2023-09-13T05:45:18.167 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-13T05:45:18.168 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} -- /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784/orig.config.yaml 2023-09-13T05:45:18.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T05:45:18.299 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784 branch: wip-rishabh-2023sep12-b2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: null first_in_suite: false job_id: '7394784' kernel: client: branch: testing flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-2023sep12-b2 ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023sep12-b2 sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2531 sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 sleep_before_teardown: 0 subset: 165/256 suite: fs suite_branch: wip-rishabh-2023sep12-b2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZER4UGcEI6enXkigtPnCyOc30c1H/DznkXXH94GzoJrvoorCMKfGD4t/n6rIIjYstXihfGkhcg9vMriF6gSHI= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOc5UpwiSAB418Q3UlT4i6G9ympj9jDTnPR4Mhje6qobPby2tceV/zpsAslXnO78jcLKUx4CIQoWDUgluT+3/xg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-12_12:12:15 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-09-13T05:45:18.299 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa; will attempt to use it 2023-09-13T05:45:18.300 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa/tasks 2023-09-13T05:45:18.300 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-13T05:45:18.302 INFO:teuthology.task.internal:Checking packages... 2023-09-13T05:45:18.326 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5' 2023-09-13T05:45:18.327 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-13T05:45:18.327 INFO:teuthology.packaging:ref: None 2023-09-13T05:45:18.327 INFO:teuthology.packaging:tag: None 2023-09-13T05:45:18.328 INFO:teuthology.packaging:branch: wip-rishabh-2023sep12-b2 2023-09-13T05:45:18.328 INFO:teuthology.packaging:sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T05:45:18.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-2023sep12-b2 2023-09-13T05:45:18.543 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6083-g4a754ac9-1jammy 2023-09-13T05:45:18.544 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-13T05:45:18.550 INFO:teuthology.task.internal:no buildpackages task found 2023-09-13T05:45:18.551 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-13T05:45:18.557 INFO:teuthology.task.internal:Saving configuration 2023-09-13T05:45:18.575 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-13T05:45:18.581 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T05:45:18.608 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 05:39:25.023643', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBHnMgnV+6MsxyEaA/UBSIwhsed0WBIEXWp1Jc5yS05R'} 2023-09-13T05:45:18.630 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 05:39:25.021696', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEYSbV2YkyG7V8CToLqJdXFJUuBLt1wM9lU1m0itSiJC'} 2023-09-13T05:45:18.630 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-13T05:45:18.637 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-09-13T05:45:18.637 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-09-13T05:45:18.637 INFO:teuthology.run_tasks:Running task console_log... 2023-09-13T05:45:18.709 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2b3f8f5af0>, signals=[15]) 2023-09-13T05:45:18.710 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-13T05:45:18.716 INFO:teuthology.task.internal:Opening connections... 2023-09-13T05:45:18.717 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T05:45:18.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:45:18.794 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T05:45:18.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:45:18.874 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-13T05:45:18.881 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2023-09-13T05:45:18.886 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2023-09-13T05:45:18.887 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-09-13T05:45:18.933 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-13T05:45:18.934 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="Ubuntu" 2023-09-13T05:45:18.934 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="22.04" 2023-09-13T05:45:18.934 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-13T05:45:18.934 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_CODENAME=jammy 2023-09-13T05:45:18.935 INFO:teuthology.orchestra.run.smithi130.stdout:ID=ubuntu 2023-09-13T05:45:18.935 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE=debian 2023-09-13T05:45:18.935 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-13T05:45:18.935 INFO:teuthology.orchestra.run.smithi130.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-13T05:45:18.935 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-13T05:45:18.935 INFO:teuthology.orchestra.run.smithi130.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-13T05:45:18.936 INFO:teuthology.orchestra.run.smithi130.stdout:UBUNTU_CODENAME=jammy 2023-09-13T05:45:18.936 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-09-13T05:45:19.072 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2023-09-13T05:45:19.078 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2023-09-13T05:45:19.079 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-09-13T05:45:19.126 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-13T05:45:19.127 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2023-09-13T05:45:19.127 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="22.04" 2023-09-13T05:45:19.127 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-13T05:45:19.128 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=jammy 2023-09-13T05:45:19.128 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2023-09-13T05:45:19.128 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2023-09-13T05:45:19.128 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-13T05:45:19.128 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-13T05:45:19.129 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-13T05:45:19.129 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-13T05:45:19.129 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=jammy 2023-09-13T05:45:19.129 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-09-13T05:45:19.155 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-13T05:45:19.165 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-13T05:45:19.216 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-13T05:45:19.217 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2023-09-13T05:45:19.220 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2023-09-13T05:45:19.225 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-13T05:45:19.230 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-13T05:45:19.230 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2023-09-13T05:45:19.267 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2023-09-13T05:45:19.354 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-13T05:45:19.410 INFO:teuthology.run_tasks:Running task kernel... 2023-09-13T05:45:19.425 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-09-13T05:45:19.426 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-09-13T05:45:19.426 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-09-13T05:45:19.427 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-13T05:45:19.428 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-13T05:45:19.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T05:45:19.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-09-13T05:45:19.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T05:45:19.437 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-09-13T05:45:19.654 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-13T05:45:19.655 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-13T05:45:19.655 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2023-09-13T05:45:19.660 INFO:teuthology.orchestra.run.smithi164.stdout:5.15.0-56-generic 2023-09-13T05:45:19.661 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-13T05:45:19.661 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-13T05:45:19.662 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-09-13T05:45:19.662 DEBUG:teuthology.orchestra.run.smithi164:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-09-13T05:45:19.717 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-13T05:45:19.717 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-13T05:45:19.717 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-09-13T05:45:19.723 INFO:teuthology.orchestra.run.smithi130.stdout:5.15.0-56-generic 2023-09-13T05:45:19.723 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-13T05:45:19.724 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-13T05:45:19.724 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-09-13T05:45:19.725 DEBUG:teuthology.orchestra.run.smithi130:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-09-13T05:45:19.725 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-09-13T05:45:19.783 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-09-13T05:45:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-09-13T05:45:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-09-13T05:45:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-09-13T05:45:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:hint: 2023-09-13T05:45:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:hint: git config --global init.defaultBranch 2023-09-13T05:45:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:hint: 2023-09-13T05:45:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-09-13T05:45:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-09-13T05:45:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:hint: 2023-09-13T05:45:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:hint: git branch -m 2023-09-13T05:45:19.869 INFO:teuthology.orchestra.run.smithi164.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-09-13T05:45:19.869 DEBUG:teuthology.orchestra.run.smithi164:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-09-13T05:45:19.903 INFO:teuthology.orchestra.run.smithi130.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-09-13T05:45:19.904 INFO:teuthology.orchestra.run.smithi130.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-09-13T05:45:19.904 INFO:teuthology.orchestra.run.smithi130.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-09-13T05:45:19.904 INFO:teuthology.orchestra.run.smithi130.stderr:hint: 2023-09-13T05:45:19.904 INFO:teuthology.orchestra.run.smithi130.stderr:hint: git config --global init.defaultBranch 2023-09-13T05:45:19.904 INFO:teuthology.orchestra.run.smithi130.stderr:hint: 2023-09-13T05:45:19.905 INFO:teuthology.orchestra.run.smithi130.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-09-13T05:45:19.905 INFO:teuthology.orchestra.run.smithi130.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-09-13T05:45:19.905 INFO:teuthology.orchestra.run.smithi130.stderr:hint: 2023-09-13T05:45:19.905 INFO:teuthology.orchestra.run.smithi130.stderr:hint: git branch -m 2023-09-13T05:45:19.906 INFO:teuthology.orchestra.run.smithi130.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-09-13T05:45:19.907 DEBUG:teuthology.orchestra.run.smithi130:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-09-13T05:45:19.936 DEBUG:teuthology.orchestra.run.smithi164:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-09-13T05:45:19.972 DEBUG:teuthology.orchestra.run.smithi130:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-09-13T05:45:19.991 DEBUG:teuthology.orchestra.run.smithi164:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-09-13T05:45:20.027 DEBUG:teuthology.orchestra.run.smithi130:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-09-13T05:46:14.902 INFO:teuthology.orchestra.run.smithi130.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-09-13T05:46:14.903 INFO:teuthology.orchestra.run.smithi130.stderr: * [new branch] main -> origin/main 2023-09-13T05:46:14.933 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190312 -> 20190312 2023-09-13T05:46:14.933 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190416 -> 20190416 2023-09-13T05:46:14.933 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190514 -> 20190514 2023-09-13T05:46:14.934 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190618 -> 20190618 2023-09-13T05:46:14.934 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190717 -> 20190717 2023-09-13T05:46:14.934 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190815 -> 20190815 2023-09-13T05:46:14.934 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190923 -> 20190923 2023-09-13T05:46:14.934 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20191022 -> 20191022 2023-09-13T05:46:14.935 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20191215 -> 20191215 2023-09-13T05:46:14.935 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200122 -> 20200122 2023-09-13T05:46:14.935 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200316 -> 20200316 2023-09-13T05:46:14.935 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200421 -> 20200421 2023-09-13T05:46:14.935 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200519 -> 20200519 2023-09-13T05:46:14.936 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200619 -> 20200619 2023-09-13T05:46:14.936 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200721 -> 20200721 2023-09-13T05:46:14.940 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200817 -> 20200817 2023-09-13T05:46:14.940 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200918 -> 20200918 2023-09-13T05:46:14.940 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20201022 -> 20201022 2023-09-13T05:46:14.941 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20201118 -> 20201118 2023-09-13T05:46:14.941 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20201218 -> 20201218 2023-09-13T05:46:14.941 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210208 -> 20210208 2023-09-13T05:46:14.941 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210315 -> 20210315 2023-09-13T05:46:14.942 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210511 -> 20210511 2023-09-13T05:46:14.942 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210716 -> 20210716 2023-09-13T05:46:14.942 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210818 -> 20210818 2023-09-13T05:46:14.942 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210919 -> 20210919 2023-09-13T05:46:14.942 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20211027 -> 20211027 2023-09-13T05:46:14.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20211216 -> 20211216 2023-09-13T05:46:14.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220209 -> 20220209 2023-09-13T05:46:14.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220310 -> 20220310 2023-09-13T05:46:14.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220411 -> 20220411 2023-09-13T05:46:14.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220509 -> 20220509 2023-09-13T05:46:14.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220610 -> 20220610 2023-09-13T05:46:14.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220708 -> 20220708 2023-09-13T05:46:14.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220815 -> 20220815 2023-09-13T05:46:14.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220913 -> 20220913 2023-09-13T05:46:14.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20221012 -> 20221012 2023-09-13T05:46:14.945 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20221109 -> 20221109 2023-09-13T05:46:14.945 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20221214 -> 20221214 2023-09-13T05:46:14.945 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230117 -> 20230117 2023-09-13T05:46:14.945 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230210 -> 20230210 2023-09-13T05:46:14.946 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230310 -> 20230310 2023-09-13T05:46:14.946 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230404 -> 20230404 2023-09-13T05:46:14.946 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230515 -> 20230515 2023-09-13T05:46:14.946 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230625 -> 20230625 2023-09-13T05:46:14.946 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230804 -> 20230804 2023-09-13T05:46:18.591 INFO:teuthology.orchestra.run.smithi130.stderr:Updating files: 51% (1615/3138) Updating files: 52% (1632/3138) Updating files: 53% (1664/3138) Updating files: 54% (1695/3138) Updating files: 55% (1726/3138) Updating files: 56% (1758/3138) Updating files: 57% (1789/3138) Updating files: 58% (1821/3138) Updating files: 59% (1852/3138) Updating files: 60% (1883/3138) Updating files: 61% (1915/3138) Updating files: 62% (1946/3138) Updating files: 63% (1977/3138) Updating files: 64% (2009/3138) Updating files: 65% (2040/3138) Updating files: 66% (2072/3138) Updating files: 66% (2084/3138) Updating files: 67% (2103/3138) Updating files: 68% (2134/3138) Updating files: 69% (2166/3138) Updating files: 70% (2197/3138) Updating files: 71% (2228/3138) Updating files: 72% (2260/3138) Updating files: 73% (2291/3138) Updating files: 74% (2323/3138) Updating files: 75% (2354/3138) Updating files: 76% (2385/3138) Updating files: 77% (2417/3138) Updating files: 78% (2448/3138) Updating files: 79% (2480/3138) Updating files: 80% (2511/3138) Updating files: 81% (2542/3138) Updating files: 81% (2566/3138) Updating files: 82% (2574/3138) Updating files: 83% (2605/3138) Updating files: 84% (2636/3138) Updating files: 85% (2668/3138) Updating files: 86% (2699/3138) Updating files: 87% (2731/3138) Updating files: 88% (2762/3138) Updating files: 89% (2793/3138) Updating files: 90% (2825/3138) Updating files: 91% (2856/3138) Updating files: 92% (2887/3138) Updating files: 93% (2919/3138) Updating files: 94% (2950/3138) Updating files: 95% (2982/3138) Updating files: 96% (3013/3138) Updating files: 97% (3044/3138) Updating files: 98% (3076/3138) Updating files: 99% (3107/3138) Updating files: 100% (3138/3138) Updating files: 100% (3138/3138), done. 2023-09-13T05:46:18.596 INFO:teuthology.orchestra.run.smithi130.stdout:HEAD is now at dfa11466 Merge branch 'main' into 'main' 2023-09-13T05:46:18.616 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-13T05:46:18.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-13T05:46:18.756 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/ 2023-09-13T05:46:18.757 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc7-gfef64f93da2b_6.5.0-rc7-gfef64f93da2b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/ --input-file=- 2023-09-13T05:46:18.760 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi130.front.sepia.ceph.com to complete... 2023-09-13T05:46:20.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13 05:46:19 URL:https://1.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/linux-image-6.5.0-rc7-gfef64f93da2b_6.5.0-rc7-gfef64f93da2b-1_amd64.deb [38830450/38830450] -> "/tmp/linux-image.deb" [1] 2023-09-13T05:46:20.350 INFO:teuthology.orchestra.run.smithi130.stderr:FINISHED --2023-09-13 05:46:19-- 2023-09-13T05:46:20.350 INFO:teuthology.orchestra.run.smithi130.stderr:Total wall clock time: 1.5s 2023-09-13T05:46:20.350 INFO:teuthology.orchestra.run.smithi130.stderr:Downloaded: 1 files, 37M in 1.4s (27.4 MB/s) 2023-09-13T05:46:20.353 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-13T05:46:20.353 DEBUG:teuthology.orchestra.run.smithi130:> sudo dpkg -i /tmp/linux-image.deb 2023-09-13T05:46:20.604 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-image-6.5.0-rc7-gfef64f93da2b. 2023-09-13T05:46:21.253 INFO:teuthology.orchestra.run.smithi164.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-09-13T05:46:21.253 INFO:teuthology.orchestra.run.smithi164.stderr: * [new branch] main -> origin/main 2023-09-13T05:46:21.290 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190312 -> 20190312 2023-09-13T05:46:21.291 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190416 -> 20190416 2023-09-13T05:46:21.291 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190514 -> 20190514 2023-09-13T05:46:21.291 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190618 -> 20190618 2023-09-13T05:46:21.292 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190717 -> 20190717 2023-09-13T05:46:21.292 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190815 -> 20190815 2023-09-13T05:46:21.292 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20190923 -> 20190923 2023-09-13T05:46:21.292 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20191022 -> 20191022 2023-09-13T05:46:21.292 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20191215 -> 20191215 2023-09-13T05:46:21.293 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200122 -> 20200122 2023-09-13T05:46:21.293 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200316 -> 20200316 2023-09-13T05:46:21.293 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200421 -> 20200421 2023-09-13T05:46:21.293 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200519 -> 20200519 2023-09-13T05:46:21.293 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200619 -> 20200619 2023-09-13T05:46:21.294 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200721 -> 20200721 2023-09-13T05:46:21.294 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200817 -> 20200817 2023-09-13T05:46:21.294 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20200918 -> 20200918 2023-09-13T05:46:21.294 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20201022 -> 20201022 2023-09-13T05:46:21.294 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20201118 -> 20201118 2023-09-13T05:46:21.295 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20201218 -> 20201218 2023-09-13T05:46:21.295 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210208 -> 20210208 2023-09-13T05:46:21.295 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210315 -> 20210315 2023-09-13T05:46:21.295 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210511 -> 20210511 2023-09-13T05:46:21.295 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210716 -> 20210716 2023-09-13T05:46:21.296 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210818 -> 20210818 2023-09-13T05:46:21.296 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20210919 -> 20210919 2023-09-13T05:46:21.296 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20211027 -> 20211027 2023-09-13T05:46:21.296 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20211216 -> 20211216 2023-09-13T05:46:21.296 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220209 -> 20220209 2023-09-13T05:46:21.297 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220310 -> 20220310 2023-09-13T05:46:21.297 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220411 -> 20220411 2023-09-13T05:46:21.297 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220509 -> 20220509 2023-09-13T05:46:21.298 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220610 -> 20220610 2023-09-13T05:46:21.298 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220708 -> 20220708 2023-09-13T05:46:21.298 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220815 -> 20220815 2023-09-13T05:46:21.299 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20220913 -> 20220913 2023-09-13T05:46:21.299 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20221012 -> 20221012 2023-09-13T05:46:21.299 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20221109 -> 20221109 2023-09-13T05:46:21.299 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20221214 -> 20221214 2023-09-13T05:46:21.300 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230117 -> 20230117 2023-09-13T05:46:21.300 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230210 -> 20230210 2023-09-13T05:46:21.300 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230310 -> 20230310 2023-09-13T05:46:21.301 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230404 -> 20230404 2023-09-13T05:46:21.301 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230515 -> 20230515 2023-09-13T05:46:21.301 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230625 -> 20230625 2023-09-13T05:46:21.302 INFO:teuthology.orchestra.run.smithi164.stderr: * [new tag] 20230804 -> 20230804 2023-09-13T05:46:22.585 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-09-13T05:46:22.589 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-09-13T05:46:22.706 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-image-6.5.0-rc7-gfef64f93da2b (6.5.0-rc7-gfef64f93da2b-1) ... 2023-09-13T05:46:24.941 INFO:teuthology.orchestra.run.smithi164.stderr:Updating files: 51% (1615/3138) Updating files: 52% (1632/3138) Updating files: 53% (1664/3138) Updating files: 54% (1695/3138) Updating files: 55% (1726/3138) Updating files: 56% (1758/3138) Updating files: 57% (1789/3138) Updating files: 58% (1821/3138) Updating files: 59% (1852/3138) Updating files: 60% (1883/3138) Updating files: 61% (1915/3138) Updating files: 62% (1946/3138) Updating files: 63% (1977/3138) Updating files: 64% (2009/3138) Updating files: 65% (2040/3138) Updating files: 66% (2072/3138) Updating files: 66% (2084/3138) Updating files: 67% (2103/3138) Updating files: 68% (2134/3138) Updating files: 69% (2166/3138) Updating files: 70% (2197/3138) Updating files: 71% (2228/3138) Updating files: 72% (2260/3138) Updating files: 73% (2291/3138) Updating files: 74% (2323/3138) Updating files: 75% (2354/3138) Updating files: 76% (2385/3138) Updating files: 77% (2417/3138) Updating files: 78% (2448/3138) Updating files: 79% (2480/3138) Updating files: 80% (2511/3138) Updating files: 81% (2542/3138) Updating files: 81% (2566/3138) Updating files: 82% (2574/3138) Updating files: 83% (2605/3138) Updating files: 84% (2636/3138) Updating files: 85% (2668/3138) Updating files: 86% (2699/3138) Updating files: 87% (2731/3138) Updating files: 88% (2762/3138) Updating files: 89% (2793/3138) Updating files: 90% (2825/3138) Updating files: 91% (2856/3138) Updating files: 92% (2887/3138) Updating files: 93% (2919/3138) Updating files: 94% (2950/3138) Updating files: 95% (2982/3138) Updating files: 96% (3013/3138) Updating files: 97% (3044/3138) Updating files: 98% (3076/3138) Updating files: 99% (3107/3138) Updating files: 100% (3138/3138) Updating files: 100% (3138/3138), done. 2023-09-13T05:46:24.946 INFO:teuthology.orchestra.run.smithi164.stdout:HEAD is now at dfa11466 Merge branch 'main' into 'main' 2023-09-13T05:46:24.966 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-09-13T05:46:24.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-13T05:46:25.189 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/ 2023-09-13T05:46:25.190 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc7-gfef64f93da2b_6.5.0-rc7-gfef64f93da2b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/ --input-file=- 2023-09-13T05:46:25.192 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi164.front.sepia.ceph.com to complete... 2023-09-13T05:46:26.023 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-image-6.5.0-rc7-gfef64f93da2b (6.5.0-rc7-gfef64f93da2b-1) ... 2023-09-13T05:46:26.113 INFO:teuthology.orchestra.run.smithi130.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13 05:46:27 URL:https://1.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/linux-image-6.5.0-rc7-gfef64f93da2b_6.5.0-rc7-gfef64f93da2b-1_amd64.deb [38830450/38830450] -> "/tmp/linux-image.deb" [1] 2023-09-13T05:46:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:FINISHED --2023-09-13 05:46:27-- 2023-09-13T05:46:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:Total wall clock time: 1.5s 2023-09-13T05:46:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:Downloaded: 1 files, 37M in 1.3s (27.5 MB/s) 2023-09-13T05:46:26.683 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-09-13T05:46:26.684 DEBUG:teuthology.orchestra.run.smithi164:> sudo dpkg -i /tmp/linux-image.deb 2023-09-13T05:46:26.974 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-image-6.5.0-rc7-gfef64f93da2b. 2023-09-13T05:46:28.947 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-09-13T05:46:28.951 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-09-13T05:46:29.173 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-image-6.5.0-rc7-gfef64f93da2b (6.5.0-rc7-gfef64f93da2b-1) ... 2023-09-13T05:46:32.505 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-image-6.5.0-rc7-gfef64f93da2b (6.5.0-rc7-gfef64f93da2b-1) ... 2023-09-13T05:46:32.634 INFO:teuthology.orchestra.run.smithi164.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:44.951 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub' 2023-09-13T05:46:44.972 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-13T05:46:45.000 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2023-09-13T05:46:45.300 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:45.326 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:45.599 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-13T05:46:45.608 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-13T05:46:45.668 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-13T05:46:45.673 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-13T05:46:45.823 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-13T05:46:45.823 INFO:teuthology.orchestra.run.smithi130.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-09-13T05:46:45.824 INFO:teuthology.orchestra.run.smithi130.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-13T05:46:45.854 INFO:teuthology.orchestra.run.smithi130.stderr:done 2023-09-13T05:46:45.999 DEBUG:teuthology.orchestra.run.smithi130:> dpkg-deb -c /tmp/linux-image.deb 2023-09-13T05:46:46.006 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./ 2023-09-13T05:46:46.006 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./boot/ 2023-09-13T05:46:46.006 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 4382168 2023-09-11 01:59 ./boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:46.015 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 168454 2023-09-11 01:59 ./boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:46.016 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11294016 2023-09-11 01:59 ./boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:46.032 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/ 2023-09-13T05:46:46.032 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/ 2023-09-13T05:46:46.033 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/postinst.d/ 2023-09-13T05:46:46.033 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/postrm.d/ 2023-09-13T05:46:46.033 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/preinst.d/ 2023-09-13T05:46:46.033 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/prerm.d/ 2023-09-13T05:46:46.033 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/ 2023-09-13T05:46:46.034 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/ 2023-09-13T05:46:46.034 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/ 2023-09-13T05:46:46.034 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/ 2023-09-13T05:46:46.034 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/ 2023-09-13T05:46:46.035 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/ 2023-09-13T05:46:46.035 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ 2023-09-13T05:46:46.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 490385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/aesni-intel.ko 2023-09-13T05:46:46.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-13T05:46:46.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-13T05:46:46.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-13T05:46:46.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 93113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-13T05:46:46.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 106729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-13T05:46:46.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 152241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-13T05:46:46.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-13T05:46:46.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-13T05:46:46.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 83889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-13T05:46:46.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-13T05:46:46.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-13T05:46:46.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-13T05:46:46.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-13T05:46:46.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-13T05:46:46.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-13T05:46:46.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 58585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-13T05:46:46.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-13T05:46:46.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-13T05:46:46.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-13T05:46:46.042 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/ 2023-09-13T05:46:46.043 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/ 2023-09-13T05:46:46.043 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/ 2023-09-13T05:46:46.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-13T05:46:46.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpuid.ko 2023-09-13T05:46:46.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/msr.ko 2023-09-13T05:46:46.044 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/ 2023-09-13T05:46:46.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 348201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-13T05:46:46.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 882105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-13T05:46:46.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 2277369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-13T05:46:46.121 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ 2023-09-13T05:46:46.121 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/af_alg.ko 2023-09-13T05:46:46.121 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/algif_hash.ko 2023-09-13T05:46:46.122 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/algif_skcipher.ko 2023-09-13T05:46:46.122 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-13T05:46:46.122 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-13T05:46:46.122 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-13T05:46:46.123 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/asymmetric_keys/ 2023-09-13T05:46:46.123 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-09-13T05:46:46.123 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/ 2023-09-13T05:46:46.123 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-13T05:46:46.124 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-13T05:46:46.124 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-13T05:46:46.124 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-13T05:46:46.124 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-13T05:46:46.124 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-13T05:46:46.125 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-13T05:46:46.125 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-13T05:46:46.125 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-13T05:46:46.125 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-13T05:46:46.125 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-13T05:46:46.126 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-13T05:46:46.126 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-13T05:46:46.126 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-13T05:46:46.126 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-13T05:46:46.127 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-13T05:46:46.127 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-13T05:46:46.127 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-13T05:46:46.127 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cryptd.ko 2023-09-13T05:46:46.128 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-13T05:46:46.128 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_simd.ko 2023-09-13T05:46:46.128 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-13T05:46:46.128 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-13T05:46:46.129 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-13T05:46:46.129 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-13T05:46:46.129 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-13T05:46:46.129 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-13T05:46:46.129 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-13T05:46:46.130 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-13T05:46:46.130 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lrw.ko 2023-09-13T05:46:46.130 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-13T05:46:46.130 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-13T05:46:46.131 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-13T05:46:46.131 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-13T05:46:46.131 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-13T05:46:46.131 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-13T05:46:46.132 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-13T05:46:46.132 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-13T05:46:46.132 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-13T05:46:46.132 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 149193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-13T05:46:46.132 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-13T05:46:46.133 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-13T05:46:46.133 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-13T05:46:46.133 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-13T05:46:46.134 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-13T05:46:46.134 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-13T05:46:46.134 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-13T05:46:46.134 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xts.ko 2023-09-13T05:46:46.135 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-13T05:46:46.135 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ 2023-09-13T05:46:46.135 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ 2023-09-13T05:46:46.135 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_extlog.ko 2023-09-13T05:46:46.135 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-13T05:46:46.136 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-13T05:46:46.136 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/apei/ 2023-09-13T05:46:46.136 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/apei/einj.ko 2023-09-13T05:46:46.136 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-13T05:46:46.137 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-13T05:46:46.137 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-13T05:46:46.137 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-13T05:46:46.137 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 100401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-13T05:46:46.138 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ 2023-09-13T05:46:46.138 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-13T05:46:46.138 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 88625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci.ko 2023-09-13T05:46:46.138 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-13T05:46:46.139 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 87841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci.ko 2023-09-13T05:46:46.139 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-13T05:46:46.139 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-13T05:46:46.139 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-13T05:46:46.140 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-13T05:46:46.140 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-13T05:46:46.140 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-13T05:46:46.140 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-13T05:46:46.141 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-13T05:46:46.141 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-13T05:46:46.141 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-13T05:46:46.141 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-13T05:46:46.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-13T05:46:46.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-13T05:46:46.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-13T05:46:46.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-13T05:46:46.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-13T05:46:46.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-13T05:46:46.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-13T05:46:46.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_legacy.ko 2023-09-13T05:46:46.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-13T05:46:46.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-13T05:46:46.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-13T05:46:46.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-13T05:46:46.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-13T05:46:46.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-13T05:46:46.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-13T05:46:46.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-13T05:46:46.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-13T05:46:46.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-13T05:46:46.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-13T05:46:46.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-13T05:46:46.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-13T05:46:46.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_radisys.ko 2023-09-13T05:46:46.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-13T05:46:46.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rz1000.ko 2023-09-13T05:46:46.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-13T05:46:46.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-13T05:46:46.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-13T05:46:46.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-13T05:46:46.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-13T05:46:46.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-13T05:46:46.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-13T05:46:46.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-13T05:46:46.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 83225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-13T05:46:46.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-13T05:46:46.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-13T05:46:46.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-13T05:46:46.150 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-13T05:46:46.150 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-13T05:46:46.150 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-13T05:46:46.150 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-13T05:46:46.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-13T05:46:46.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-13T05:46:46.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-13T05:46:46.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-13T05:46:46.152 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ 2023-09-13T05:46:46.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-13T05:46:46.152 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/ 2023-09-13T05:46:46.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 124457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-13T05:46:46.152 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/ 2023-09-13T05:46:46.153 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/ 2023-09-13T05:46:46.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 113705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-13T05:46:46.153 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/ 2023-09-13T05:46:46.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 968433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-13T05:46:46.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 173201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-13T05:46:46.154 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/ 2023-09-13T05:46:46.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 94297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-13T05:46:46.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 115345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-13T05:46:46.155 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/ 2023-09-13T05:46:46.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 110361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-13T05:46:46.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 98225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-13T05:46:46.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 259401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-13T05:46:46.155 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/ 2023-09-13T05:46:46.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 98129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-13T05:46:46.156 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/ 2023-09-13T05:46:46.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-13T05:46:46.156 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ 2023-09-13T05:46:46.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/applicom.ko 2023-09-13T05:46:46.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-13T05:46:46.157 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/ 2023-09-13T05:46:46.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-13T05:46:46.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-13T05:46:46.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-13T05:46:46.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-13T05:46:46.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-13T05:46:46.158 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ 2023-09-13T05:46:46.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-13T05:46:46.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 150665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-13T05:46:46.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-13T05:46:46.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 139057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-13T05:46:46.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-13T05:46:46.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-13T05:46:46.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-13T05:46:46.160 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/ 2023-09-13T05:46:46.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 84121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-13T05:46:46.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/nvram.ko 2023-09-13T05:46:46.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-13T05:46:46.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-13T05:46:46.161 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/ 2023-09-13T05:46:46.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-13T05:46:46.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-09-13T05:46:46.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-09-13T05:46:46.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-09-13T05:46:46.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-13T05:46:46.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-13T05:46:46.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-09-13T05:46:46.163 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/ 2023-09-13T05:46:46.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-09-13T05:46:46.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-09-13T05:46:46.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-09-13T05:46:46.164 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/ 2023-09-13T05:46:46.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-palmas.ko 2023-09-13T05:46:46.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-si5351.ko 2023-09-13T05:46:46.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-twl6040.ko 2023-09-13T05:46:46.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-wm831x.ko 2023-09-13T05:46:46.165 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/ 2023-09-13T05:46:46.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-13T05:46:46.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-13T05:46:46.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-13T05:46:46.166 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ 2023-09-13T05:46:46.166 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ 2023-09-13T05:46:46.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-13T05:46:46.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 234473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-13T05:46:46.167 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/ 2023-09-13T05:46:46.167 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/ 2023-09-13T05:46:46.167 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-09-13T05:46:46.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 408489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-13T05:46:46.168 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-09-13T05:46:46.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-13T05:46:46.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-13T05:46:46.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-13T05:46:46.169 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/ 2023-09-13T05:46:46.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 68937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-13T05:46:46.170 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/ 2023-09-13T05:46:46.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-13T05:46:46.170 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ 2023-09-13T05:46:46.171 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/ 2023-09-13T05:46:46.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-13T05:46:46.171 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ 2023-09-13T05:46:46.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 122641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-13T05:46:46.172 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ 2023-09-13T05:46:46.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 80273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-13T05:46:46.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-13T05:46:46.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 63617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-13T05:46:46.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-13T05:46:46.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-13T05:46:46.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-13T05:46:46.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-13T05:46:46.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-13T05:46:46.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-13T05:46:46.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-13T05:46:46.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-13T05:46:46.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-13T05:46:46.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-13T05:46:46.175 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/ 2023-09-13T05:46:46.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-gpio.ko 2023-09-13T05:46:46.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max14577.ko 2023-09-13T05:46:46.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max77693.ko 2023-09-13T05:46:46.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max8997.ko 2023-09-13T05:46:46.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-palmas.ko 2023-09-13T05:46:46.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-09-13T05:46:46.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-sm5502.ko 2023-09-13T05:46:46.177 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/ 2023-09-13T05:46:46.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/dmi-sysfs.ko 2023-09-13T05:46:46.177 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/efi/ 2023-09-13T05:46:46.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-09-13T05:46:46.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-13T05:46:46.178 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/ 2023-09-13T05:46:46.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-adp5520.ko 2023-09-13T05:46:46.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-amd8111.ko 2023-09-13T05:46:46.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-arizona.ko 2023-09-13T05:46:46.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-da9052.ko 2023-09-13T05:46:46.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-da9055.ko 2023-09-13T05:46:46.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-dln2.ko 2023-09-13T05:46:46.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 77849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-f7188x.ko 2023-09-13T05:46:46.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-generic.ko 2023-09-13T05:46:46.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-13T05:46:46.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-09-13T05:46:46.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-kempld.ko 2023-09-13T05:46:46.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-lp3943.ko 2023-09-13T05:46:46.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max7300.ko 2023-09-13T05:46:46.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max730x.ko 2023-09-13T05:46:46.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max732x.ko 2023-09-13T05:46:46.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-09-13T05:46:46.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-pca953x.ko 2023-09-13T05:46:46.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-09-13T05:46:46.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-09-13T05:46:46.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-sch.ko 2023-09-13T05:46:46.184 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-sch311x.ko 2023-09-13T05:46:46.184 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-tps65912.ko 2023-09-13T05:46:46.184 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-twl4030.ko 2023-09-13T05:46:46.185 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-twl6040.ko 2023-09-13T05:46:46.185 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-13T05:46:46.185 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-vx855.ko 2023-09-13T05:46:46.185 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm831x.ko 2023-09-13T05:46:46.185 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm8350.ko 2023-09-13T05:46:46.185 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm8994.ko 2023-09-13T05:46:46.186 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/ 2023-09-13T05:46:46.186 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-a4tech.ko 2023-09-13T05:46:46.187 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-apple.ko 2023-09-13T05:46:46.187 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-13T05:46:46.187 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-13T05:46:46.188 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-13T05:46:46.188 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-belkin.ko 2023-09-13T05:46:46.188 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cherry.ko 2023-09-13T05:46:46.188 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-chicony.ko 2023-09-13T05:46:46.188 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cp2112.ko 2023-09-13T05:46:46.189 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cypress.ko 2023-09-13T05:46:46.189 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-13T05:46:46.189 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-13T05:46:46.190 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-13T05:46:46.190 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-13T05:46:46.190 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ezkey.ko 2023-09-13T05:46:46.190 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-13T05:46:46.191 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-generic.ko 2023-09-13T05:46:46.191 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-13T05:46:46.191 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-13T05:46:46.191 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-13T05:46:46.192 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-13T05:46:46.192 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-13T05:46:46.192 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-13T05:46:46.193 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-13T05:46:46.193 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kensington.ko 2023-09-13T05:46:46.193 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-13T05:46:46.193 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-13T05:46:46.193 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-13T05:46:46.194 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-13T05:46:46.194 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-13T05:46:46.194 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lg-g15.ko 2023-09-13T05:46:46.195 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-13T05:46:46.195 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 101009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-13T05:46:46.195 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 80993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech.ko 2023-09-13T05:46:46.196 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-magicmouse.ko 2023-09-13T05:46:46.196 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-microsoft.ko 2023-09-13T05:46:46.196 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-monterey.ko 2023-09-13T05:46:46.197 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-13T05:46:46.197 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ntrig.ko 2023-09-13T05:46:46.197 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-13T05:46:46.197 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-13T05:46:46.197 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-13T05:46:46.198 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 72937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-13T05:46:46.198 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-13T05:46:46.198 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-13T05:46:46.199 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-13T05:46:46.199 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-13T05:46:46.199 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-13T05:46:46.199 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-13T05:46:46.200 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-13T05:46:46.200 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-13T05:46:46.200 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-13T05:46:46.200 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-13T05:46:46.201 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-13T05:46:46.201 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-13T05:46:46.201 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-13T05:46:46.202 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-13T05:46:46.202 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-13T05:46:46.202 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-13T05:46:46.202 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-13T05:46:46.203 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-13T05:46:46.203 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-13T05:46:46.203 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-13T05:46:46.203 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-13T05:46:46.204 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-13T05:46:46.204 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-13T05:46:46.204 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-13T05:46:46.205 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-13T05:46:46.205 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-13T05:46:46.205 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-13T05:46:46.206 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-13T05:46:46.206 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-13T05:46:46.206 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 71457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-13T05:46:46.207 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-13T05:46:46.207 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 143585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-13T05:46:46.207 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-13T05:46:46.207 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-13T05:46:46.207 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-13T05:46:46.208 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 267689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid.ko 2023-09-13T05:46:46.208 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-13T05:46:46.208 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/ 2023-09-13T05:46:46.208 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 125721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbhid.ko 2023-09-13T05:46:46.209 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-09-13T05:46:46.209 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-09-13T05:46:46.209 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 217401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-13T05:46:46.210 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/ 2023-09-13T05:46:46.210 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 63497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-13T05:46:46.210 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 89609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-13T05:46:46.210 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 301449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-13T05:46:46.210 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ 2023-09-13T05:46:46.211 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-13T05:46:46.211 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-13T05:46:46.211 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-13T05:46:46.211 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-13T05:46:46.211 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-13T05:46:46.212 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-13T05:46:46.212 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-13T05:46:46.212 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 97977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-13T05:46:46.213 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-13T05:46:46.213 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-13T05:46:46.213 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-13T05:46:46.213 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-13T05:46:46.213 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-13T05:46:46.214 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-13T05:46:46.214 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 74433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-13T05:46:46.214 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-13T05:46:46.214 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-13T05:46:46.214 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-13T05:46:46.215 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-13T05:46:46.215 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-13T05:46:46.215 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-13T05:46:46.215 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 58617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-13T05:46:46.216 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-13T05:46:46.216 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-13T05:46:46.216 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-13T05:46:46.216 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-09-13T05:46:46.216 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-09-13T05:46:46.217 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-13T05:46:46.217 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 99601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-13T05:46:46.217 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-13T05:46:46.217 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-13T05:46:46.217 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-13T05:46:46.218 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc2103.ko 2023-09-13T05:46:46.218 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-13T05:46:46.218 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-13T05:46:46.218 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 94457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-13T05:46:46.219 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-13T05:46:46.219 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-13T05:46:46.219 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-13T05:46:46.219 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-13T05:46:46.219 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-13T05:46:46.220 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-13T05:46:46.220 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-13T05:46:46.220 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hih6130.ko 2023-09-13T05:46:46.220 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-13T05:46:46.221 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-13T05:46:46.221 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-13T05:46:46.221 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-13T05:46:46.221 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-13T05:46:46.221 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-13T05:46:46.222 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-13T05:46:46.222 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 129217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-13T05:46:46.222 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/jc42.ko 2023-09-13T05:46:46.222 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-13T05:46:46.223 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-13T05:46:46.223 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-13T05:46:46.223 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-13T05:46:46.223 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-13T05:46:46.223 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-13T05:46:46.224 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-13T05:46:46.224 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-13T05:46:46.224 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-13T05:46:46.224 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-13T05:46:46.224 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 72833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-13T05:46:46.225 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-13T05:46:46.225 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-13T05:46:46.225 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-13T05:46:46.225 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 108841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-13T05:46:46.225 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-13T05:46:46.226 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-13T05:46:46.226 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-13T05:46:46.226 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-13T05:46:46.226 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-13T05:46:46.227 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-13T05:46:46.227 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-13T05:46:46.227 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-13T05:46:46.227 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-13T05:46:46.228 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-13T05:46:46.228 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-13T05:46:46.228 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-13T05:46:46.228 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-13T05:46:46.229 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-13T05:46:46.229 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-13T05:46:46.229 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-13T05:46:46.229 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-13T05:46:46.229 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mc13783-adc.ko 2023-09-13T05:46:46.230 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-13T05:46:46.230 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-09-13T05:46:46.230 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-13T05:46:46.230 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 116697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-13T05:46:46.231 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-13T05:46:46.231 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-13T05:46:46.231 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 82337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-13T05:46:46.231 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-13T05:46:46.231 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-13T05:46:46.232 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ 2023-09-13T05:46:46.232 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-13T05:46:46.232 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-13T05:46:46.232 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-13T05:46:46.232 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-13T05:46:46.233 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-13T05:46:46.233 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-13T05:46:46.233 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-13T05:46:46.233 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 81841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-13T05:46:46.234 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-13T05:46:46.234 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-13T05:46:46.234 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-13T05:46:46.234 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-13T05:46:46.234 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-13T05:46:46.235 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-13T05:46:46.235 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-13T05:46:46.235 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-13T05:46:46.235 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-13T05:46:46.235 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-13T05:46:46.236 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-13T05:46:46.236 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-13T05:46:46.236 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smm665.ko 2023-09-13T05:46:46.236 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-13T05:46:46.236 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-13T05:46:46.237 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-13T05:46:46.237 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-13T05:46:46.237 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-13T05:46:46.237 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-13T05:46:46.238 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-13T05:46:46.238 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-13T05:46:46.238 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-13T05:46:46.238 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-13T05:46:46.239 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-13T05:46:46.239 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-13T05:46:46.239 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-13T05:46:46.239 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-13T05:46:46.239 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 71345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-13T05:46:46.240 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 63289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-13T05:46:46.240 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 71321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-13T05:46:46.240 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 101457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-13T05:46:46.240 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 119505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-13T05:46:46.241 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-13T05:46:46.241 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-13T05:46:46.241 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-09-13T05:46:46.241 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-09-13T05:46:46.241 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/ 2023-09-13T05:46:46.242 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/ 2023-09-13T05:46:46.242 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-13T05:46:46.242 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-13T05:46:46.242 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/ 2023-09-13T05:46:46.243 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-09-13T05:46:46.243 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-09-13T05:46:46.243 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-09-13T05:46:46.243 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-13T05:46:46.243 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-13T05:46:46.244 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-13T05:46:46.244 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-09-13T05:46:46.244 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 6929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-13T05:46:46.244 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-09-13T05:46:46.244 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-13T05:46:46.245 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-13T05:46:46.245 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-13T05:46:46.245 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-13T05:46:46.245 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-09-13T05:46:46.245 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-09-13T05:46:46.246 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-13T05:46:46.246 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-13T05:46:46.246 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-13T05:46:46.246 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-09-13T05:46:46.247 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-13T05:46:46.247 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-13T05:46:46.247 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-09-13T05:46:46.247 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-13T05:46:46.247 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-13T05:46:46.248 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-13T05:46:46.248 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-09-13T05:46:46.248 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-13T05:46:46.248 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-13T05:46:46.248 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-09-13T05:46:46.249 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-09-13T05:46:46.249 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-13T05:46:46.249 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-09-13T05:46:46.249 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-13T05:46:46.249 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-13T05:46:46.250 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-13T05:46:46.250 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-13T05:46:46.250 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-09-13T05:46:46.250 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-13T05:46:46.251 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-13T05:46:46.251 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-13T05:46:46.251 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/ 2023-09-13T05:46:46.252 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-09-13T05:46:46.252 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-09-13T05:46:46.252 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-09-13T05:46:46.252 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ 2023-09-13T05:46:46.252 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ 2023-09-13T05:46:46.253 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 273641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-13T05:46:46.253 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 876913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-13T05:46:46.253 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-13T05:46:46.254 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 324145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-13T05:46:46.254 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 97961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-13T05:46:46.254 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 279345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-13T05:46:46.255 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-13T05:46:46.255 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ 2023-09-13T05:46:46.255 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/ 2023-09-13T05:46:46.255 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 492569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-13T05:46:46.256 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/ 2023-09-13T05:46:46.256 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 419193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-13T05:46:46.256 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/ 2023-09-13T05:46:46.256 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 739705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-13T05:46:46.257 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ 2023-09-13T05:46:46.257 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 296649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-13T05:46:46.257 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ocrdma/ 2023-09-13T05:46:46.258 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 153681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-09-13T05:46:46.258 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/usnic/ 2023-09-13T05:46:46.258 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 169017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-09-13T05:46:46.258 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ 2023-09-13T05:46:46.259 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ 2023-09-13T05:46:46.259 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 263177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-13T05:46:46.259 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ 2023-09-13T05:46:46.260 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 100225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-13T05:46:46.260 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ 2023-09-13T05:46:46.260 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 111993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-13T05:46:46.261 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ 2023-09-13T05:46:46.261 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 129081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-13T05:46:46.262 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ 2023-09-13T05:46:46.262 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 129553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-13T05:46:46.262 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/ 2023-09-13T05:46:46.262 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/evbug.ko 2023-09-13T05:46:46.263 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/ff-memless.ko 2023-09-13T05:46:46.263 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ 2023-09-13T05:46:46.263 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-13T05:46:46.263 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-13T05:46:46.264 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-13T05:46:46.264 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-13T05:46:46.264 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-13T05:46:46.265 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-13T05:46:46.265 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/ 2023-09-13T05:46:46.265 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-09-13T05:46:46.265 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-09-13T05:46:46.266 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-09-13T05:46:46.266 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-09-13T05:46:46.266 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-13T05:46:46.266 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-09-13T05:46:46.267 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lkkbd.ko 2023-09-13T05:46:46.269 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lm8323.ko 2023-09-13T05:46:46.269 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lm8333.ko 2023-09-13T05:46:46.269 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-09-13T05:46:46.270 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-09-13T05:46:46.270 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-09-13T05:46:46.270 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-09-13T05:46:46.271 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-09-13T05:46:46.271 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-09-13T05:46:46.271 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/qt1070.ko 2023-09-13T05:46:46.271 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/qt2160.ko 2023-09-13T05:46:46.271 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-09-13T05:46:46.272 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/stowaway.ko 2023-09-13T05:46:46.272 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/sunkbd.ko 2023-09-13T05:46:46.272 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-09-13T05:46:46.273 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-09-13T05:46:46.273 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-09-13T05:46:46.273 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/xtkbd.ko 2023-09-13T05:46:46.274 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/matrix-keymap.ko 2023-09-13T05:46:46.274 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/ 2023-09-13T05:46:46.274 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-13T05:46:46.274 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-13T05:46:46.274 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 123681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-13T05:46:46.275 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 89449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-13T05:46:46.275 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-09-13T05:46:46.275 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 335849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/psmouse.ko 2023-09-13T05:46:46.275 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-13T05:46:46.276 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-13T05:46:46.276 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-13T05:46:46.277 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-13T05:46:46.277 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/ 2023-09-13T05:46:46.277 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 109849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-13T05:46:46.278 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ 2023-09-13T05:46:46.278 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-13T05:46:46.278 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-13T05:46:46.278 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ct82c710.ko 2023-09-13T05:46:46.279 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-13T05:46:46.279 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/parkbd.ko 2023-09-13T05:46:46.279 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/pcips2.ko 2023-09-13T05:46:46.280 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ps2mult.ko 2023-09-13T05:46:46.280 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-13T05:46:46.280 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serport.ko 2023-09-13T05:46:46.280 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-13T05:46:46.281 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/ 2023-09-13T05:46:46.281 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/ 2023-09-13T05:46:46.281 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-13T05:46:46.281 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/ 2023-09-13T05:46:46.282 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-88pm860x.ko 2023-09-13T05:46:46.282 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-adp5520.ko 2023-09-13T05:46:46.282 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-bd2802.ko 2023-09-13T05:46:46.283 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-13T05:46:46.283 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-da903x.ko 2023-09-13T05:46:46.283 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-da9052.ko 2023-09-13T05:46:46.283 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-gpio.ko 2023-09-13T05:46:46.284 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-13T05:46:46.284 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3533.ko 2023-09-13T05:46:46.284 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm355x.ko 2023-09-13T05:46:46.284 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3642.ko 2023-09-13T05:46:46.285 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-13T05:46:46.285 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp8788.ko 2023-09-13T05:46:46.285 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-max8997.ko 2023-09-13T05:46:46.286 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-mc13783.ko 2023-09-13T05:46:46.286 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-menf21bmc.ko 2023-09-13T05:46:46.286 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca9532.ko 2023-09-13T05:46:46.287 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca955x.ko 2023-09-13T05:46:46.287 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca963x.ko 2023-09-13T05:46:46.287 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-13T05:46:46.287 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-tca6507.ko 2023-09-13T05:46:46.287 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-wm831x-status.ko 2023-09-13T05:46:46.288 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-wm8350.ko 2023-09-13T05:46:46.288 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ 2023-09-13T05:46:46.288 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-13T05:46:46.289 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-13T05:46:46.289 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-13T05:46:46.289 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-13T05:46:46.290 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-13T05:46:46.290 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-13T05:46:46.290 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-13T05:46:46.290 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-13T05:46:46.291 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/ 2023-09-13T05:46:46.291 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/ 2023-09-13T05:46:46.291 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 655473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-13T05:46:46.291 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-13T05:46:46.292 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 89601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bufio.ko 2023-09-13T05:46:46.292 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-13T05:46:46.292 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 155993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-13T05:46:46.293 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 107049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-13T05:46:46.293 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-13T05:46:46.293 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-era.ko 2023-09-13T05:46:46.294 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-13T05:46:46.294 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-13T05:46:46.294 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log.ko 2023-09-13T05:46:46.294 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-mirror.ko 2023-09-13T05:46:46.295 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-13T05:46:46.295 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-13T05:46:46.295 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-13T05:46:46.295 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-region-hash.ko 2023-09-13T05:46:46.295 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-13T05:46:46.296 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-13T05:46:46.296 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 109593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-snapshot.ko 2023-09-13T05:46:46.296 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-13T05:46:46.296 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 181585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-13T05:46:46.296 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-13T05:46:46.297 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-zero.ko 2023-09-13T05:46:46.297 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-13T05:46:46.297 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-13T05:46:46.297 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-13T05:46:46.298 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/ 2023-09-13T05:46:46.299 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 199937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-13T05:46:46.299 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-13T05:46:46.299 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 112609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-13T05:46:46.299 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 160553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-13T05:46:46.299 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 396153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-13T05:46:46.300 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/ 2023-09-13T05:46:46.300 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/ 2023-09-13T05:46:46.300 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 178113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-13T05:46:46.300 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 63385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-13T05:46:46.300 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-13T05:46:46.301 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-13T05:46:46.301 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 123353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-13T05:46:46.301 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 79017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-13T05:46:46.301 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-13T05:46:46.301 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/ 2023-09-13T05:46:46.302 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm800.ko 2023-09-13T05:46:46.302 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm805.ko 2023-09-13T05:46:46.302 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm80x.ko 2023-09-13T05:46:46.302 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/arizona-i2c.ko 2023-09-13T05:46:46.302 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 123721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/arizona.ko 2023-09-13T05:46:46.303 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/bcm590xx.ko 2023-09-13T05:46:46.303 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/cros_ec_dev.ko 2023-09-13T05:46:46.303 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/dln2.ko 2023-09-13T05:46:46.303 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/janz-cmodio.ko 2023-09-13T05:46:46.303 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/kempld-core.ko 2023-09-13T05:46:46.303 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lm3533-core.ko 2023-09-13T05:46:46.304 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-09-13T05:46:46.304 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lp3943.ko 2023-09-13T05:46:46.304 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-13T05:46:46.304 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-13T05:46:46.304 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/max8907.ko 2023-09-13T05:46:46.305 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mc13xxx-core.ko 2023-09-13T05:46:46.305 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-09-13T05:46:46.305 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/menf21bmc.ko 2023-09-13T05:46:46.305 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633-adc.ko 2023-09-13T05:46:46.305 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-09-13T05:46:46.306 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633.ko 2023-09-13T05:46:46.306 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-09-13T05:46:46.306 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/retu-mfd.ko 2023-09-13T05:46:46.306 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 80425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/si476x-core.ko 2023-09-13T05:46:46.306 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-13T05:46:46.307 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-09-13T05:46:46.307 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/tps65010.ko 2023-09-13T05:46:46.307 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/tps6507x.ko 2023-09-13T05:46:46.307 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-13T05:46:46.307 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-13T05:46:46.308 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-13T05:46:46.308 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wm8994.ko 2023-09-13T05:46:46.308 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ 2023-09-13T05:46:46.308 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-09-13T05:46:46.308 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ad525x_dpot.ko 2023-09-13T05:46:46.309 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/ 2023-09-13T05:46:46.309 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-13T05:46:46.309 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-13T05:46:46.309 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-13T05:46:46.309 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-13T05:46:46.310 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/ 2023-09-13T05:46:46.310 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-09-13T05:46:46.310 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/core.ko 2023-09-13T05:46:46.310 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/ 2023-09-13T05:46:46.310 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-13T05:46:46.311 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ds1682.ko 2023-09-13T05:46:46.311 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/dummy-irq.ko 2023-09-13T05:46:46.311 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/echo/ 2023-09-13T05:46:46.311 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/echo/echo.ko 2023-09-13T05:46:46.311 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/ 2023-09-13T05:46:46.312 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-13T05:46:46.312 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-13T05:46:46.312 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-13T05:46:46.312 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-13T05:46:46.312 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-13T05:46:46.312 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/genwqe/ 2023-09-13T05:46:46.313 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 152137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-09-13T05:46:46.313 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hmc6352.ko 2023-09-13T05:46:46.313 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-13T05:46:46.313 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ibmasm/ 2023-09-13T05:46:46.313 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 72601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-09-13T05:46:46.314 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ics932s401.ko 2023-09-13T05:46:46.314 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-13T05:46:46.314 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-13T05:46:46.314 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/ 2023-09-13T05:46:46.314 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-13T05:46:46.315 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-13T05:46:46.315 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/ 2023-09-13T05:46:46.315 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 125209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-13T05:46:46.315 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-13T05:46:46.315 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 309857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-13T05:46:46.316 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/phantom.ko 2023-09-13T05:46:46.316 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ti-st/ 2023-09-13T05:46:46.316 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 74905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ti-st/st_drv.ko 2023-09-13T05:46:46.316 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-13T05:46:46.316 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-13T05:46:46.316 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-13T05:46:46.317 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-13T05:46:46.317 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/ 2023-09-13T05:46:46.317 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 183857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-13T05:46:46.317 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ 2023-09-13T05:46:46.317 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/ 2023-09-13T05:46:46.318 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 487865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-13T05:46:46.318 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/ 2023-09-13T05:46:46.318 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/ 2023-09-13T05:46:46.318 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 106009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-13T05:46:46.318 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-13T05:46:46.318 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-13T05:46:46.319 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-09-13T05:46:46.319 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 452681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-13T05:46:46.319 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-13T05:46:46.319 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-13T05:46:46.319 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ 2023-09-13T05:46:46.320 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/ 2023-09-13T05:46:46.320 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-13T05:46:46.320 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-13T05:46:46.320 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 130489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-13T05:46:46.320 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 68785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-13T05:46:46.321 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ 2023-09-13T05:46:46.321 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-13T05:46:46.321 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-13T05:46:46.321 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-13T05:46:46.321 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 99113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-13T05:46:46.322 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/ 2023-09-13T05:46:46.322 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-13T05:46:46.322 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/ 2023-09-13T05:46:46.322 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-13T05:46:46.322 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/ 2023-09-13T05:46:46.323 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-13T05:46:46.323 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/ 2023-09-13T05:46:46.323 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-13T05:46:46.323 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/ 2023-09-13T05:46:46.323 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-13T05:46:46.323 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-13T05:46:46.324 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 87345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-13T05:46:46.324 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/ 2023-09-13T05:46:46.324 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/ 2023-09-13T05:46:46.324 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 97321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-13T05:46:46.325 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-09-13T05:46:46.325 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 104609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-13T05:46:46.325 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-09-13T05:46:46.325 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 90257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-13T05:46:46.325 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-09-13T05:46:46.326 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 81505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-13T05:46:46.326 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-13T05:46:46.326 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/ 2023-09-13T05:46:46.326 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-13T05:46:46.327 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 176881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-13T05:46:46.327 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-09-13T05:46:46.327 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1422209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-13T05:46:46.327 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 128377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-13T05:46:46.327 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-09-13T05:46:46.327 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 132289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-13T05:46:46.328 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 312145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-13T05:46:46.328 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/ 2023-09-13T05:46:46.328 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/ 2023-09-13T05:46:46.328 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 323553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-13T05:46:46.328 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/ 2023-09-13T05:46:46.329 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-09-13T05:46:46.329 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 193433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-13T05:46:46.329 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-09-13T05:46:46.329 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 347641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-13T05:46:46.329 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-09-13T05:46:46.330 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1044145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-13T05:46:46.330 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-09-13T05:46:46.330 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 166113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-13T05:46:46.330 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-09-13T05:46:46.330 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-13T05:46:46.331 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/ 2023-09-13T05:46:46.331 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/ 2023-09-13T05:46:46.331 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 204329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-13T05:46:46.331 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/ 2023-09-13T05:46:46.331 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/ 2023-09-13T05:46:46.332 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-13T05:46:46.332 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-13T05:46:46.332 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 141161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-13T05:46:46.332 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-13T05:46:46.332 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-13T05:46:46.333 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-13T05:46:46.333 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/ 2023-09-13T05:46:46.333 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-13T05:46:46.333 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-13T05:46:46.333 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-13T05:46:46.334 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-09-13T05:46:46.334 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/ 2023-09-13T05:46:46.334 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/ 2023-09-13T05:46:46.334 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 281329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-13T05:46:46.334 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-13T05:46:46.335 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-13T05:46:46.335 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fujitsu/ 2023-09-13T05:46:46.335 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-09-13T05:46:46.335 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ 2023-09-13T05:46:46.335 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 90465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-13T05:46:46.336 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/ 2023-09-13T05:46:46.336 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 295713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-13T05:46:46.336 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-09-13T05:46:46.336 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 584249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-13T05:46:46.336 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-09-13T05:46:46.337 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 246321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-13T05:46:46.337 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/ 2023-09-13T05:46:46.337 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 924017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-13T05:46:46.337 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/ 2023-09-13T05:46:46.337 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 302577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-13T05:46:46.338 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/ 2023-09-13T05:46:46.338 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 514889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-13T05:46:46.338 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-09-13T05:46:46.338 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 93593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-13T05:46:46.338 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-09-13T05:46:46.338 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 734297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-13T05:46:46.339 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-09-13T05:46:46.339 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 151841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-13T05:46:46.339 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 86921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-13T05:46:46.339 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/ 2023-09-13T05:46:46.339 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-13T05:46:46.340 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 102385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-13T05:46:46.340 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 122681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-13T05:46:46.340 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/ 2023-09-13T05:46:46.340 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-09-13T05:46:46.340 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 727433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-13T05:46:46.341 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 280513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-13T05:46:46.341 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-09-13T05:46:46.341 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-09-13T05:46:46.341 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1097537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-13T05:46:46.461 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ 2023-09-13T05:46:46.461 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-09-13T05:46:46.461 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-09-13T05:46:46.462 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-09-13T05:46:46.462 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 95665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-13T05:46:46.462 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/ 2023-09-13T05:46:46.462 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-09-13T05:46:46.462 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 108809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-13T05:46:46.463 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ 2023-09-13T05:46:46.463 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-13T05:46:46.463 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-13T05:46:46.463 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/ 2023-09-13T05:46:46.463 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 150905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-13T05:46:46.464 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/ 2023-09-13T05:46:46.464 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 136785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-13T05:46:46.464 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/ 2023-09-13T05:46:46.464 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-13T05:46:46.464 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-13T05:46:46.465 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/ 2023-09-13T05:46:46.465 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-09-13T05:46:46.465 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 227113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-13T05:46:46.465 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 87081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-13T05:46:46.465 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-09-13T05:46:46.466 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 671393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-13T05:46:46.466 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/ 2023-09-13T05:46:46.466 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-13T05:46:46.466 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/ 2023-09-13T05:46:46.466 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-13T05:46:46.467 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 83921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-13T05:46:46.467 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-13T05:46:46.467 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 189817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-13T05:46:46.467 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/ 2023-09-13T05:46:46.467 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-09-13T05:46:46.468 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 104241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-09-13T05:46:46.468 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/ 2023-09-13T05:46:46.468 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 952929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-13T05:46:46.468 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/ 2023-09-13T05:46:46.468 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-13T05:46:46.468 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/ 2023-09-13T05:46:46.469 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-13T05:46:46.469 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 63273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-13T05:46:46.469 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/ 2023-09-13T05:46:46.469 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-13T05:46:46.469 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-13T05:46:46.470 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-13T05:46:46.470 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 68209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-13T05:46:46.470 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/ 2023-09-13T05:46:46.470 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-09-13T05:46:46.470 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-09-13T05:46:46.471 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-13T05:46:46.471 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-09-13T05:46:46.471 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 481681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-13T05:46:46.471 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/ 2023-09-13T05:46:46.471 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 103321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-13T05:46:46.471 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 166121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-13T05:46:46.472 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-13T05:46:46.472 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-13T05:46:46.472 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/ 2023-09-13T05:46:46.472 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-13T05:46:46.473 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/ 2023-09-13T05:46:46.473 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 86465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-13T05:46:46.473 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/ 2023-09-13T05:46:46.473 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 80257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-13T05:46:46.474 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 83681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-13T05:46:46.474 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/ 2023-09-13T05:46:46.474 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-13T05:46:46.474 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-13T05:46:46.474 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/ 2023-09-13T05:46:46.475 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-13T05:46:46.475 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/ 2023-09-13T05:46:46.475 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/defxx.ko 2023-09-13T05:46:46.475 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/skfp/ 2023-09-13T05:46:46.475 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 216977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-09-13T05:46:46.476 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 77401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-13T05:46:46.476 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/ 2023-09-13T05:46:46.476 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 235593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-13T05:46:46.476 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/ 2023-09-13T05:46:46.476 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-13T05:46:46.477 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-13T05:46:46.477 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ 2023-09-13T05:46:46.477 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 83993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-13T05:46:46.477 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-13T05:46:46.477 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-13T05:46:46.478 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/ 2023-09-13T05:46:46.478 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-13T05:46:46.478 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-13T05:46:46.478 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-09-13T05:46:46.478 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-13T05:46:46.479 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-13T05:46:46.479 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-13T05:46:46.479 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-13T05:46:46.479 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-13T05:46:46.479 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/ 2023-09-13T05:46:46.480 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-13T05:46:46.480 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-13T05:46:46.480 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ 2023-09-13T05:46:46.480 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-13T05:46:46.480 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-13T05:46:46.480 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-13T05:46:46.481 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-13T05:46:46.481 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-13T05:46:46.481 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-13T05:46:46.481 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-13T05:46:46.481 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-13T05:46:46.482 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-13T05:46:46.482 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-13T05:46:46.482 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-13T05:46:46.482 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 75713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-13T05:46:46.482 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-13T05:46:46.483 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 97265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-13T05:46:46.483 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-13T05:46:46.483 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-13T05:46:46.483 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-13T05:46:46.483 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-13T05:46:46.484 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-13T05:46:46.484 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/plip/ 2023-09-13T05:46:46.484 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/plip/plip.ko 2023-09-13T05:46:46.484 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ 2023-09-13T05:46:46.484 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-13T05:46:46.484 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-13T05:46:46.485 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-13T05:46:46.485 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-13T05:46:46.485 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-13T05:46:46.485 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-13T05:46:46.485 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-13T05:46:46.486 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-13T05:46:46.486 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sb1000.ko 2023-09-13T05:46:46.486 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/ 2023-09-13T05:46:46.486 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-13T05:46:46.486 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-13T05:46:46.486 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 64937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-13T05:46:46.487 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/ 2023-09-13T05:46:46.487 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 106025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-13T05:46:46.487 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-13T05:46:46.487 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-13T05:46:46.487 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-13T05:46:46.488 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-13T05:46:46.488 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-13T05:46:46.488 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 88257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-13T05:46:46.488 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/ 2023-09-13T05:46:46.488 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 120497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-13T05:46:46.489 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/ 2023-09-13T05:46:46.489 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 293441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-13T05:46:46.489 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/ 2023-09-13T05:46:46.489 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 143889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-13T05:46:46.489 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ 2023-09-13T05:46:46.490 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-13T05:46:46.490 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/ 2023-09-13T05:46:46.490 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/ 2023-09-13T05:46:46.490 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 264585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-13T05:46:46.490 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 102393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-13T05:46:46.491 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/ 2023-09-13T05:46:46.491 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 133817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-13T05:46:46.491 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-13T05:46:46.491 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 84337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-13T05:46:46.491 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-13T05:46:46.492 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/ 2023-09-13T05:46:46.492 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/ 2023-09-13T05:46:46.492 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-13T05:46:46.492 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-09-13T05:46:46.492 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-09-13T05:46:46.493 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pci-stub.ko 2023-09-13T05:46:46.493 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-13T05:46:46.493 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/ 2023-09-13T05:46:46.493 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-13T05:46:46.493 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 145785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia.ko 2023-09-13T05:46:46.494 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-09-13T05:46:46.494 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-09-13T05:46:46.494 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-13T05:46:46.494 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 112913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-13T05:46:46.494 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/ 2023-09-13T05:46:46.494 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/broadcom/ 2023-09-13T05:46:46.495 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-09-13T05:46:46.495 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/samsung/ 2023-09-13T05:46:46.495 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-09-13T05:46:46.495 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/ 2023-09-13T05:46:46.495 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/ 2023-09-13T05:46:46.496 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 71521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-13T05:46:46.496 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/ 2023-09-13T05:46:46.496 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/ 2023-09-13T05:46:46.496 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-09-13T05:46:46.496 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec.ko 2023-09-13T05:46:46.497 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-09-13T05:46:46.497 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-09-13T05:46:46.497 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-09-13T05:46:46.497 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-09-13T05:46:46.497 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-09-13T05:46:46.497 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/ 2023-09-13T05:46:46.498 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-13T05:46:46.498 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-13T05:46:46.498 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-13T05:46:46.498 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-13T05:46:46.498 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-13T05:46:46.499 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 106873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-13T05:46:46.499 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-13T05:46:46.499 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-13T05:46:46.499 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-13T05:46:46.499 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-13T05:46:46.500 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-13T05:46:46.500 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-13T05:46:46.500 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-09-13T05:46:46.500 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/ 2023-09-13T05:46:46.500 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-13T05:46:46.501 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-09-13T05:46:46.501 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-13T05:46:46.501 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-13T05:46:46.501 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-13T05:46:46.501 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-13T05:46:46.501 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-13T05:46:46.502 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-13T05:46:46.502 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-13T05:46:46.502 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-13T05:46:46.502 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-13T05:46:46.502 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-13T05:46:46.503 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-13T05:46:46.503 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/ 2023-09-13T05:46:46.503 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ 2023-09-13T05:46:46.503 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-09-13T05:46:46.503 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-09-13T05:46:46.504 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-09-13T05:46:46.504 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq24190_charger.ko 2023-09-13T05:46:46.504 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq24735-charger.ko 2023-09-13T05:46:46.504 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-09-13T05:46:46.504 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/da9030_battery.ko 2023-09-13T05:46:46.504 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/da9052-battery.ko 2023-09-13T05:46:46.505 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2760_battery.ko 2023-09-13T05:46:46.505 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2780_battery.ko 2023-09-13T05:46:46.505 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2781_battery.ko 2023-09-13T05:46:46.505 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2782_battery.ko 2023-09-13T05:46:46.505 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/gpio-charger.ko 2023-09-13T05:46:46.506 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/isp1704_charger.ko 2023-09-13T05:46:46.506 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/lp8727_charger.ko 2023-09-13T05:46:46.506 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max14577_charger.ko 2023-09-13T05:46:46.506 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max17040_battery.ko 2023-09-13T05:46:46.506 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max17042_battery.ko 2023-09-13T05:46:46.507 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max8903_charger.ko 2023-09-13T05:46:46.507 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max8925_power.ko 2023-09-13T05:46:46.507 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-09-13T05:46:46.507 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/sbs-battery.ko 2023-09-13T05:46:46.507 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/test_power.ko 2023-09-13T05:46:46.507 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/tps65090-charger.ko 2023-09-13T05:46:46.508 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm831x_backup.ko 2023-09-13T05:46:46.508 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm831x_power.ko 2023-09-13T05:46:46.508 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm8350_power.ko 2023-09-13T05:46:46.508 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/ 2023-09-13T05:46:46.508 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-13T05:46:46.509 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-13T05:46:46.509 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/ 2023-09-13T05:46:46.509 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/ 2023-09-13T05:46:46.509 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-13T05:46:46.509 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-13T05:46:46.509 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-13T05:46:46.510 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-13T05:46:46.510 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ 2023-09-13T05:46:46.510 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-13T05:46:46.510 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-13T05:46:46.510 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/ 2023-09-13T05:46:46.511 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-09-13T05:46:46.511 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-09-13T05:46:46.511 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-13T05:46:46.511 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-13T05:46:46.511 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9052.ko 2023-09-13T05:46:46.512 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9055.ko 2023-09-13T05:46:46.512 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9063.ko 2023-09-13T05:46:46.512 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-13T05:46:46.512 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 68577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-13T05:46:46.512 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-13T05:46:46.513 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-13T05:46:46.513 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-13T05:46:46.513 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-13T05:46:46.513 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-13T05:46:46.513 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-13T05:46:46.513 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-13T05:46:46.514 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-13T05:46:46.514 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-13T05:46:46.514 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-13T05:46:46.514 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-13T05:46:46.514 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-lp8788.ko 2023-09-13T05:46:46.515 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-13T05:46:46.515 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-13T05:46:46.515 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-13T05:46:46.515 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t86.ko 2023-09-13T05:46:46.515 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-13T05:46:46.515 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8907.ko 2023-09-13T05:46:46.516 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8925.ko 2023-09-13T05:46:46.516 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8997.ko 2023-09-13T05:46:46.516 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8998.ko 2023-09-13T05:46:46.516 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-09-13T05:46:46.516 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-13T05:46:46.517 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-palmas.ko 2023-09-13T05:46:46.517 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-13T05:46:46.517 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-09-13T05:46:46.517 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-13T05:46:46.517 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-13T05:46:46.518 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-13T05:46:46.518 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-13T05:46:46.518 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-09-13T05:46:46.518 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-13T05:46:46.518 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-13T05:46:46.518 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-13T05:46:46.519 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-13T05:46:46.519 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-13T05:46:46.519 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-s35390a.ko 2023-09-13T05:46:46.519 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-13T05:46:46.519 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-09-13T05:46:46.519 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-tps65910.ko 2023-09-13T05:46:46.520 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-wm831x.ko 2023-09-13T05:46:46.520 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-wm8350.ko 2023-09-13T05:46:46.520 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-13T05:46:46.520 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ 2023-09-13T05:46:46.520 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 77617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-13T05:46:46.521 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-13T05:46:46.521 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-13T05:46:46.521 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 135169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-13T05:46:46.521 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-13T05:46:46.521 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/ 2023-09-13T05:46:46.522 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 272353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-13T05:46:46.522 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 100617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-13T05:46:46.522 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/ 2023-09-13T05:46:46.522 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 356265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-13T05:46:46.522 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 295801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-13T05:46:46.523 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic94xx/ 2023-09-13T05:46:46.523 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 189321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-09-13T05:46:46.523 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-13T05:46:46.523 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/ 2023-09-13T05:46:46.523 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 106569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-13T05:46:46.524 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-13T05:46:46.524 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/ 2023-09-13T05:46:46.524 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 246897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-13T05:46:46.524 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/ 2023-09-13T05:46:46.524 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1172185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-13T05:46:46.524 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/ 2023-09-13T05:46:46.525 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 237169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-13T05:46:46.525 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/ 2023-09-13T05:46:46.525 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 115393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-13T05:46:46.525 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-13T05:46:46.525 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/ 2023-09-13T05:46:46.526 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 308889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-13T05:46:46.526 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/ 2023-09-13T05:46:46.526 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-09-13T05:46:46.526 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 76193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-13T05:46:46.526 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-09-13T05:46:46.527 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 101449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-13T05:46:46.527 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 146785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-13T05:46:46.527 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 75529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-13T05:46:46.527 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-13T05:46:46.527 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/ 2023-09-13T05:46:46.528 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 212401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-13T05:46:46.528 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-13T05:46:46.528 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/ 2023-09-13T05:46:46.528 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-13T05:46:46.528 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 158193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-13T05:46:46.529 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fdomain.ko 2023-09-13T05:46:46.529 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/ 2023-09-13T05:46:46.529 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 262729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-13T05:46:46.529 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 201793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-13T05:46:46.529 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-13T05:46:46.530 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-13T05:46:46.530 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/imm.ko 2023-09-13T05:46:46.530 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-13T05:46:46.530 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 266521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-13T05:46:46.530 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 101881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-13T05:46:46.530 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/ 2023-09-13T05:46:46.531 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 317249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-13T05:46:46.531 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-13T05:46:46.531 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-13T05:46:46.531 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/ 2023-09-13T05:46:46.531 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 314961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-13T05:46:46.532 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 145569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-13T05:46:46.532 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-13T05:46:46.532 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/ 2023-09-13T05:46:46.532 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 217209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-13T05:46:46.532 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/ 2023-09-13T05:46:46.533 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 2192585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-13T05:46:46.533 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/ 2023-09-13T05:46:46.533 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-13T05:46:46.533 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-13T05:46:46.533 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 310729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-13T05:46:46.534 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 84697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-13T05:46:46.534 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/ 2023-09-13T05:46:46.534 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 659513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-13T05:46:46.534 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/ 2023-09-13T05:46:46.534 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 119929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-13T05:46:46.535 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-13T05:46:46.535 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/ 2023-09-13T05:46:46.535 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 81601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-09-13T05:46:46.535 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-09-13T05:46:46.535 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-09-13T05:46:46.535 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-09-13T05:46:46.536 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/ 2023-09-13T05:46:46.536 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 364257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-13T05:46:46.536 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 123489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-13T05:46:46.536 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ppa.ko 2023-09-13T05:46:46.536 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-13T05:46:46.537 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/ 2023-09-13T05:46:46.537 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1860193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-13T05:46:46.537 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-13T05:46:46.537 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/ 2023-09-13T05:46:46.537 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 558865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-13T05:46:46.538 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qlogicfas408.ko 2023-09-13T05:46:46.538 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-13T05:46:46.538 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 238801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-13T05:46:46.538 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 173921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-13T05:46:46.538 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 278865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-13T05:46:46.539 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 97705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-13T05:46:46.539 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-13T05:46:46.539 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-13T05:46:46.539 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-13T05:46:46.539 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 115849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-13T05:46:46.540 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-13T05:46:46.540 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/ 2023-09-13T05:46:46.540 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 162121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-13T05:46:46.540 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-13T05:46:46.540 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-13T05:46:46.540 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-13T05:46:46.541 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/xen-scsifront.ko 2023-09-13T05:46:46.541 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ 2023-09-13T05:46:46.541 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 129417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-13T05:46:46.541 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/ 2023-09-13T05:46:46.541 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/ 2023-09-13T05:46:46.542 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 739089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-13T05:46:46.542 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/ 2023-09-13T05:46:46.542 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-13T05:46:46.542 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-13T05:46:46.542 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-13T05:46:46.543 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 931721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-13T05:46:46.543 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-13T05:46:46.543 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 122545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-13T05:46:46.543 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/ 2023-09-13T05:46:46.543 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 75641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-13T05:46:46.544 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/ 2023-09-13T05:46:46.544 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/ 2023-09-13T05:46:46.544 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-09-13T05:46:46.544 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-13T05:46:46.544 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-13T05:46:46.544 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-13T05:46:46.545 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-13T05:46:46.545 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-13T05:46:46.545 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-13T05:46:46.545 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-13T05:46:46.545 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-13T05:46:46.546 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-13T05:46:46.546 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-13T05:46:46.546 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-13T05:46:46.546 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-13T05:46:46.546 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-09-13T05:46:46.547 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-13T05:46:46.547 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-13T05:46:46.547 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-13T05:46:46.547 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ 2023-09-13T05:46:46.547 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ 2023-09-13T05:46:46.547 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-13T05:46:46.548 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/moxa.ko 2023-09-13T05:46:46.548 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/mxser.ko 2023-09-13T05:46:46.548 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 107545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-13T05:46:46.548 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-13T05:46:46.548 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 68137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-13T05:46:46.549 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/ 2023-09-13T05:46:46.549 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/ 2023-09-13T05:46:46.549 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-09-13T05:46:46.549 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-13T05:46:46.549 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-09-13T05:46:46.550 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/altera_uart.ko 2023-09-13T05:46:46.550 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-13T05:46:46.550 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 72193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-09-13T05:46:46.550 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/ 2023-09-13T05:46:46.550 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 103017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-13T05:46:46.551 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/rp2.ko 2023-09-13T05:46:46.551 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-09-13T05:46:46.551 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 100185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-13T05:46:46.551 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/ 2023-09-13T05:46:46.551 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ 2023-09-13T05:46:46.552 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 536809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-13T05:46:46.552 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ 2023-09-13T05:46:46.552 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-13T05:46:46.552 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-09-13T05:46:46.552 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/ 2023-09-13T05:46:46.553 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-13T05:46:46.553 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-13T05:46:46.553 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-13T05:46:46.553 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-09-13T05:46:46.553 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_mf624.ko 2023-09-13T05:46:46.554 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_netx.ko 2023-09-13T05:46:46.554 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-13T05:46:46.554 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-09-13T05:46:46.554 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-13T05:46:46.554 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/ 2023-09-13T05:46:46.555 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/c67x00/ 2023-09-13T05:46:46.555 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/c67x00/c67x00.ko 2023-09-13T05:46:46.555 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ 2023-09-13T05:46:46.555 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 143785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-09-13T05:46:46.555 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-09-13T05:46:46.556 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-09-13T05:46:46.556 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-09-13T05:46:46.556 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/ 2023-09-13T05:46:46.556 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-13T05:46:46.556 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-13T05:46:46.557 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-13T05:46:46.557 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 89833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-13T05:46:46.557 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/common/ 2023-09-13T05:46:46.557 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/common/ulpi.ko 2023-09-13T05:46:46.557 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc2/ 2023-09-13T05:46:46.557 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-09-13T05:46:46.558 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/ 2023-09-13T05:46:46.558 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-09-13T05:46:46.558 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-09-13T05:46:46.558 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 445217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3.ko 2023-09-13T05:46:46.558 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/ 2023-09-13T05:46:46.559 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/ 2023-09-13T05:46:46.559 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-09-13T05:46:46.559 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-09-13T05:46:46.559 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-09-13T05:46:46.559 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-09-13T05:46:46.560 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-09-13T05:46:46.560 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-09-13T05:46:46.560 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 92377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-09-13T05:46:46.560 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-09-13T05:46:46.560 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 122073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-09-13T05:46:46.561 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-09-13T05:46:46.561 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-09-13T05:46:46.561 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-09-13T05:46:46.561 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-09-13T05:46:46.561 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-09-13T05:46:46.561 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-09-13T05:46:46.562 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 58433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-09-13T05:46:46.562 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-09-13T05:46:46.562 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/ 2023-09-13T05:46:46.562 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-09-13T05:46:46.562 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-09-13T05:46:46.563 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-09-13T05:46:46.563 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-09-13T05:46:46.563 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-09-13T05:46:46.563 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-09-13T05:46:46.563 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-09-13T05:46:46.564 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-09-13T05:46:46.564 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-09-13T05:46:46.564 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-09-13T05:46:46.564 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-09-13T05:46:46.564 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-09-13T05:46:46.564 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-09-13T05:46:46.565 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-09-13T05:46:46.565 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 161321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/libcomposite.ko 2023-09-13T05:46:46.565 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/ 2023-09-13T05:46:46.565 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-09-13T05:46:46.565 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/bdc/ 2023-09-13T05:46:46.566 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 157665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-09-13T05:46:46.566 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-09-13T05:46:46.566 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-09-13T05:46:46.566 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-09-13T05:46:46.566 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-09-13T05:46:46.567 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 76033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-09-13T05:46:46.567 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 75057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-09-13T05:46:46.567 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-09-13T05:46:46.567 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-09-13T05:46:46.567 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-09-13T05:46:46.568 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 81489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-09-13T05:46:46.568 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 156057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-09-13T05:46:46.568 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/ 2023-09-13T05:46:46.568 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/bcma-hcd.ko 2023-09-13T05:46:46.568 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 80097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-09-13T05:46:46.568 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 87337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-09-13T05:46:46.569 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-09-13T05:46:46.569 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-13T05:46:46.569 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811_cs.ko 2023-09-13T05:46:46.569 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/ssb-hcd.ko 2023-09-13T05:46:46.569 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-09-13T05:46:46.570 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/ 2023-09-13T05:46:46.570 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-13T05:46:46.570 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-13T05:46:46.570 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ 2023-09-13T05:46:46.570 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-13T05:46:46.571 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-13T05:46:46.571 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-09-13T05:46:46.571 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/cytherm.ko 2023-09-13T05:46:46.571 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ehset.ko 2023-09-13T05:46:46.571 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-13T05:46:46.572 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-13T05:46:46.572 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-13T05:46:46.572 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-13T05:46:46.572 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-13T05:46:46.572 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-13T05:46:46.573 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-13T05:46:46.573 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-13T05:46:46.573 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/lvstest.ko 2023-09-13T05:46:46.573 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/ 2023-09-13T05:46:46.573 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 64841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-13T05:46:46.573 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-13T05:46:46.574 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-13T05:46:46.574 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-13T05:46:46.574 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-13T05:46:46.574 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbtest.ko 2023-09-13T05:46:46.574 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-13T05:46:46.575 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-13T05:46:46.575 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/mon/ 2023-09-13T05:46:46.575 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/mon/usbmon.ko 2023-09-13T05:46:46.575 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/musb/ 2023-09-13T05:46:46.575 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 301521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-09-13T05:46:46.576 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/ 2023-09-13T05:46:46.576 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-13T05:46:46.576 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-09-13T05:46:46.576 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-09-13T05:46:46.576 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-09-13T05:46:46.576 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ 2023-09-13T05:46:46.577 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-13T05:46:46.577 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-13T05:46:46.577 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-13T05:46:46.577 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-13T05:46:46.577 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-13T05:46:46.578 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-13T05:46:46.578 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-13T05:46:46.578 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-13T05:46:46.578 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-13T05:46:46.578 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/f81232.ko 2023-09-13T05:46:46.579 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 175145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-13T05:46:46.579 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-13T05:46:46.579 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 137105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-13T05:46:46.579 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 124673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-13T05:46:46.579 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-13T05:46:46.579 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-13T05:46:46.580 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-13T05:46:46.580 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-13T05:46:46.580 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 107417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-13T05:46:46.580 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-13T05:46:46.580 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-13T05:46:46.581 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-13T05:46:46.581 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-13T05:46:46.581 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/metro-usb.ko 2023-09-13T05:46:46.581 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-13T05:46:46.581 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-13T05:46:46.581 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mxuport.ko 2023-09-13T05:46:46.582 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-13T05:46:46.582 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-13T05:46:46.582 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-13T05:46:46.582 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 190233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-13T05:46:46.582 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-13T05:46:46.583 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-13T05:46:46.583 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-13T05:46:46.583 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-13T05:46:46.583 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-13T05:46:46.583 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-13T05:46:46.584 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-13T05:46:46.584 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-13T05:46:46.584 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-13T05:46:46.584 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-13T05:46:46.584 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-13T05:46:46.585 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-13T05:46:46.585 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-13T05:46:46.585 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-13T05:46:46.585 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 125505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usbserial.ko 2023-09-13T05:46:46.585 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-13T05:46:46.585 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-13T05:46:46.586 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-09-13T05:46:46.586 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-13T05:46:46.586 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ 2023-09-13T05:46:46.586 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-13T05:46:46.586 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-13T05:46:46.587 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-13T05:46:46.587 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-13T05:46:46.587 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-13T05:46:46.587 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-13T05:46:46.587 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-13T05:46:46.588 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-13T05:46:46.588 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-13T05:46:46.588 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-13T05:46:46.588 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-13T05:46:46.588 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-13T05:46:46.589 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-13T05:46:46.589 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-13T05:46:46.589 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 180017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-13T05:46:46.589 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/ 2023-09-13T05:46:46.589 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-13T05:46:46.590 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 71345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-13T05:46:46.590 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 105401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-13T05:46:46.590 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/ 2023-09-13T05:46:46.590 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/ 2023-09-13T05:46:46.590 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 153697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-13T05:46:46.590 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-13T05:46:46.591 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 100569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-13T05:46:46.591 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 75137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-13T05:46:46.591 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/ 2023-09-13T05:46:46.591 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 113889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-13T05:46:46.591 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-13T05:46:46.592 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 58137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-13T05:46:46.592 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 89289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-13T05:46:46.592 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/ 2023-09-13T05:46:46.592 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/ 2023-09-13T05:46:46.592 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-09-13T05:46:46.593 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-09-13T05:46:46.593 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-09-13T05:46:46.593 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-09-13T05:46:46.593 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-09-13T05:46:46.593 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-13T05:46:46.594 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/as3711_bl.ko 2023-09-13T05:46:46.594 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/bd6107.ko 2023-09-13T05:46:46.594 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/da903x_bl.ko 2023-09-13T05:46:46.594 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/da9052_bl.ko 2023-09-13T05:46:46.594 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-09-13T05:46:46.595 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-09-13T05:46:46.595 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-13T05:46:46.595 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-09-13T05:46:46.595 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-09-13T05:46:46.595 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lv5207lp.ko 2023-09-13T05:46:46.595 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/max8925_bl.ko 2023-09-13T05:46:46.596 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/pandora_bl.ko 2023-09-13T05:46:46.596 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-09-13T05:46:46.596 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-13T05:46:46.596 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-09-13T05:46:46.596 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/ 2023-09-13T05:46:46.597 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ 2023-09-13T05:46:46.597 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-13T05:46:46.597 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-13T05:46:46.597 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/matrox_w1.ko 2023-09-13T05:46:46.597 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/w1-gpio.ko 2023-09-13T05:46:46.598 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/ 2023-09-13T05:46:46.598 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-13T05:46:46.598 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-13T05:46:46.598 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-13T05:46:46.598 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-13T05:46:46.599 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-13T05:46:46.599 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-13T05:46:46.599 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-13T05:46:46.599 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-13T05:46:46.599 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-13T05:46:46.600 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-13T05:46:46.600 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-13T05:46:46.600 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 102657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-13T05:46:46.600 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ 2023-09-13T05:46:46.600 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/acquirewdt.ko 2023-09-13T05:46:46.601 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/advantechwdt.ko 2023-09-13T05:46:46.601 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-13T05:46:46.601 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-13T05:46:46.601 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/cpu5wdt.ko 2023-09-13T05:46:46.601 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9052_wdt.ko 2023-09-13T05:46:46.602 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9055_wdt.ko 2023-09-13T05:46:46.602 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9063_wdt.ko 2023-09-13T05:46:46.602 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/dw_wdt.ko 2023-09-13T05:46:46.602 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/eurotechwdt.ko 2023-09-13T05:46:46.602 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-13T05:46:46.603 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-13T05:46:46.603 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-13T05:46:46.603 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-13T05:46:46.603 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-13T05:46:46.603 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-13T05:46:46.603 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-13T05:46:46.604 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-13T05:46:46.604 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-13T05:46:46.604 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-13T05:46:46.604 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/kempld_wdt.ko 2023-09-13T05:46:46.604 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-13T05:46:46.605 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/mena21_wdt.ko 2023-09-13T05:46:46.605 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-09-13T05:46:46.605 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-13T05:46:46.605 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-09-13T05:46:46.605 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-09-13T05:46:46.606 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-13T05:46:46.606 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-13T05:46:46.606 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/retu_wdt.ko 2023-09-13T05:46:46.606 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-09-13T05:46:46.606 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-09-13T05:46:46.607 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-13T05:46:46.607 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sc1200wdt.ko 2023-09-13T05:46:46.607 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-13T05:46:46.607 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-09-13T05:46:46.607 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-13T05:46:46.608 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-13T05:46:46.608 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-09-13T05:46:46.608 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-13T05:46:46.608 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-13T05:46:46.608 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-13T05:46:46.609 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-13T05:46:46.609 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-09-13T05:46:46.609 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-13T05:46:46.609 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-09-13T05:46:46.609 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-09-13T05:46:46.610 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-13T05:46:46.610 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/ 2023-09-13T05:46:46.610 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-13T05:46:46.610 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-13T05:46:46.610 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-13T05:46:46.611 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/ 2023-09-13T05:46:46.611 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 176417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-13T05:46:46.611 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-13T05:46:46.611 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 71321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-scsiback.ko 2023-09-13T05:46:46.611 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/ 2023-09-13T05:46:46.611 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-13T05:46:46.612 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ 2023-09-13T05:46:46.612 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/ 2023-09-13T05:46:46.612 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 165625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-13T05:46:46.612 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/adfs/ 2023-09-13T05:46:46.612 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/adfs/adfs.ko 2023-09-13T05:46:46.613 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/ 2023-09-13T05:46:46.613 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 162617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-13T05:46:46.613 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/afs/ 2023-09-13T05:46:46.613 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 931937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/afs/kafs.ko 2023-09-13T05:46:46.613 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/autofs/ 2023-09-13T05:46:46.614 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 100937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/autofs/autofs4.ko 2023-09-13T05:46:46.614 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/ 2023-09-13T05:46:46.614 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 64481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-13T05:46:46.614 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/bfs/ 2023-09-13T05:46:46.614 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/bfs/bfs.ko 2023-09-13T05:46:46.615 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-13T05:46:46.615 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/ 2023-09-13T05:46:46.615 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 3474249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-13T05:46:46.615 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/ 2023-09-13T05:46:46.615 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 305745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-13T05:46:46.616 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ 2023-09-13T05:46:46.616 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1316257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-13T05:46:46.616 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/ 2023-09-13T05:46:46.616 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 100497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-13T05:46:46.616 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/configfs/ 2023-09-13T05:46:46.616 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 108073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/configfs/configfs.ko 2023-09-13T05:46:46.617 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/ 2023-09-13T05:46:46.617 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-13T05:46:46.617 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/ 2023-09-13T05:46:46.617 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 633825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-13T05:46:46.617 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/efs/ 2023-09-13T05:46:46.618 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/efs/efs.ko 2023-09-13T05:46:46.618 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/ 2023-09-13T05:46:46.618 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1500513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-13T05:46:46.618 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/ 2023-09-13T05:46:46.618 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-13T05:46:46.619 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/freevxfs/ 2023-09-13T05:46:46.619 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/freevxfs/freevxfs.ko 2023-09-13T05:46:46.619 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/ 2023-09-13T05:46:46.619 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 226505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-13T05:46:46.619 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/ 2023-09-13T05:46:46.619 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-13T05:46:46.620 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/ 2023-09-13T05:46:46.620 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1226385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-13T05:46:46.620 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/ 2023-09-13T05:46:46.620 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 141241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-13T05:46:46.620 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/ 2023-09-13T05:46:46.620 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 221553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-13T05:46:46.621 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hpfs/ 2023-09-13T05:46:46.621 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 193577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hpfs/hpfs.ko 2023-09-13T05:46:46.621 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/ 2023-09-13T05:46:46.621 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 74393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-13T05:46:46.622 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/ 2023-09-13T05:46:46.622 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 421097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-13T05:46:46.622 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/ 2023-09-13T05:46:46.622 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 279041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-13T05:46:46.622 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/ 2023-09-13T05:46:46.623 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 87833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-13T05:46:46.623 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/ 2023-09-13T05:46:46.623 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 124697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-13T05:46:46.623 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/ 2023-09-13T05:46:46.623 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/ 2023-09-13T05:46:46.623 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 81521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-13T05:46:46.624 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/ 2023-09-13T05:46:46.624 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-13T05:46:46.624 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/ 2023-09-13T05:46:46.624 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 117705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-13T05:46:46.624 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1053889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-13T05:46:46.625 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv2.ko 2023-09-13T05:46:46.625 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 119801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-13T05:46:46.625 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 2041809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-13T05:46:46.625 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/ 2023-09-13T05:46:46.625 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-13T05:46:46.626 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-13T05:46:46.626 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/ 2023-09-13T05:46:46.626 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1504929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-13T05:46:46.626 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/ 2023-09-13T05:46:46.626 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 591401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-13T05:46:46.627 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/ 2023-09-13T05:46:46.627 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-13T05:46:46.627 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-13T05:46:46.627 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-13T05:46:46.627 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-13T05:46:46.628 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-13T05:46:46.628 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-13T05:46:46.628 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-13T05:46:46.628 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-13T05:46:46.628 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-13T05:46:46.628 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-13T05:46:46.629 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-13T05:46:46.629 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_ascii.ko 2023-09-13T05:46:46.629 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-13T05:46:46.629 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-13T05:46:46.629 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-13T05:46:46.630 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-13T05:46:46.630 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-13T05:46:46.630 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-13T05:46:46.630 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-13T05:46:46.630 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-13T05:46:46.631 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-13T05:46:46.631 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-13T05:46:46.631 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-13T05:46:46.631 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-13T05:46:46.631 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-13T05:46:46.632 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-13T05:46:46.632 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-13T05:46:46.632 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-13T05:46:46.632 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-13T05:46:46.632 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-13T05:46:46.633 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 94137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-13T05:46:46.633 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 142673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-13T05:46:46.633 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 165745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-13T05:46:46.633 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 118121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-13T05:46:46.633 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-13T05:46:46.634 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-13T05:46:46.634 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-13T05:46:46.634 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-13T05:46:46.634 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-13T05:46:46.634 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-13T05:46:46.635 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-13T05:46:46.635 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-13T05:46:46.635 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-13T05:46:46.635 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-13T05:46:46.635 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-13T05:46:46.636 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-13T05:46:46.636 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-13T05:46:46.636 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-13T05:46:46.636 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-13T05:46:46.636 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-13T05:46:46.636 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ntfs/ 2023-09-13T05:46:46.637 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 219361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ntfs/ntfs.ko 2023-09-13T05:46:46.637 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ 2023-09-13T05:46:46.637 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ 2023-09-13T05:46:46.637 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 244177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-13T05:46:46.637 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ 2023-09-13T05:46:46.638 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 440785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-13T05:46:46.638 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ 2023-09-13T05:46:46.638 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-13T05:46:46.638 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 2589873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-13T05:46:46.638 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-13T05:46:46.639 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-13T05:46:46.639 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-13T05:46:46.639 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/omfs/ 2023-09-13T05:46:46.639 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/omfs/omfs.ko 2023-09-13T05:46:46.639 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/ 2023-09-13T05:46:46.639 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 336889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-13T05:46:46.640 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ 2023-09-13T05:46:46.640 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-13T05:46:46.640 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx4/ 2023-09-13T05:46:46.640 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx4/qnx4.ko 2023-09-13T05:46:46.640 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx6/ 2023-09-13T05:46:46.641 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx6/qnx6.ko 2023-09-13T05:46:46.641 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/ 2023-09-13T05:46:46.641 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_tree.ko 2023-09-13T05:46:46.641 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_v1.ko 2023-09-13T05:46:46.641 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_v2.ko 2023-09-13T05:46:46.641 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/ 2023-09-13T05:46:46.642 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 530697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-13T05:46:46.642 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/ 2023-09-13T05:46:46.642 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-13T05:46:46.642 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/ 2023-09-13T05:46:46.642 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/ 2023-09-13T05:46:46.643 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 2661209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-13T05:46:46.643 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/ 2023-09-13T05:46:46.643 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-13T05:46:46.643 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-13T05:46:46.643 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/ 2023-09-13T05:46:46.644 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 134313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-13T05:46:46.644 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/ 2023-09-13T05:46:46.644 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 89737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-13T05:46:46.644 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/ 2023-09-13T05:46:46.644 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 248049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-13T05:46:46.645 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ 2023-09-13T05:46:46.645 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 160857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-13T05:46:46.645 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/ 2023-09-13T05:46:46.645 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 3998129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-13T05:46:46.645 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/ 2023-09-13T05:46:46.646 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/locking/ 2023-09-13T05:46:46.646 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 74865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/locking/locktorture.ko 2023-09-13T05:46:46.646 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/time/ 2023-09-13T05:46:46.646 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/time/test_udelay.ko 2023-09-13T05:46:46.646 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 58473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-13T05:46:46.647 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ 2023-09-13T05:46:46.647 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 6833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-13T05:46:46.647 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 6529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc7.ko 2023-09-13T05:46:46.647 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-13T05:46:46.647 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/ 2023-09-13T05:46:46.648 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-13T05:46:46.648 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-13T05:46:46.648 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/interval_tree_test.ko 2023-09-13T05:46:46.648 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-13T05:46:46.648 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-13T05:46:46.648 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/ 2023-09-13T05:46:46.649 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-13T05:46:46.649 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-13T05:46:46.649 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/ 2023-09-13T05:46:46.649 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 6617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-13T05:46:46.649 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/memory-notifier-error-inject.ko 2023-09-13T05:46:46.650 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/notifier-error-inject.ko 2023-09-13T05:46:46.650 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/percpu_test.ko 2023-09-13T05:46:46.650 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/pm-notifier-error-inject.ko 2023-09-13T05:46:46.650 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/ 2023-09-13T05:46:46.650 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 143433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-13T05:46:46.651 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/rbtree_test.ko 2023-09-13T05:46:46.651 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/ 2023-09-13T05:46:46.651 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-13T05:46:46.651 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test-kstrtox.ko 2023-09-13T05:46:46.651 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test-string_helpers.ko 2023-09-13T05:46:46.652 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 4760825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_bpf.ko 2023-09-13T05:46:46.652 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_firmware.ko 2023-09-13T05:46:46.652 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 6369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_module.ko 2023-09-13T05:46:46.652 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_user_copy.ko 2023-09-13T05:46:46.652 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-13T05:46:46.653 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-13T05:46:46.653 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-13T05:46:46.653 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/xz/ 2023-09-13T05:46:46.653 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/xz/xz_dec_test.ko 2023-09-13T05:46:46.653 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/ 2023-09-13T05:46:46.653 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-13T05:46:46.654 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ 2023-09-13T05:46:46.654 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/ 2023-09-13T05:46:46.654 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-13T05:46:46.654 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-13T05:46:46.655 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-13T05:46:46.655 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-13T05:46:46.655 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 6985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-13T05:46:46.655 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-13T05:46:46.655 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-13T05:46:46.655 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-13T05:46:46.656 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/ 2023-09-13T05:46:46.656 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-13T05:46:46.656 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-13T05:46:46.656 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-13T05:46:46.656 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-13T05:46:46.657 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-13T05:46:46.657 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/ 2023-09-13T05:46:46.657 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 81017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-13T05:46:46.657 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/ 2023-09-13T05:46:46.657 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 198465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-13T05:46:46.658 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-13T05:46:46.658 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-13T05:46:46.658 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-13T05:46:46.658 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/ 2023-09-13T05:46:46.658 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 652553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-13T05:46:46.658 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/ 2023-09-13T05:46:46.659 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 63825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-13T05:46:46.659 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 772505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-13T05:46:46.659 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ 2023-09-13T05:46:46.659 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-13T05:46:46.659 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-13T05:46:46.660 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-13T05:46:46.660 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-13T05:46:46.660 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-13T05:46:46.660 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-13T05:46:46.660 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-13T05:46:46.661 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-13T05:46:46.661 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-13T05:46:46.661 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-13T05:46:46.661 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-13T05:46:46.661 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-13T05:46:46.661 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-13T05:46:46.662 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-13T05:46:46.662 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-13T05:46:46.662 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-13T05:46:46.662 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-13T05:46:46.662 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-13T05:46:46.663 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-13T05:46:46.663 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-13T05:46:46.663 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-13T05:46:46.663 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-13T05:46:46.663 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-13T05:46:46.663 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/ 2023-09-13T05:46:46.664 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1046921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-13T05:46:46.664 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/ 2023-09-13T05:46:46.664 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 124793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-13T05:46:46.664 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/ 2023-09-13T05:46:46.664 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 194321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-13T05:46:46.665 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-13T05:46:46.665 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-13T05:46:46.665 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-13T05:46:46.665 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/ 2023-09-13T05:46:46.665 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 390297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-13T05:46:46.666 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-13T05:46:46.666 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-13T05:46:46.666 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-13T05:46:46.666 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-13T05:46:46.666 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/hsr/ 2023-09-13T05:46:46.666 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 100257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/hsr/hsr.ko 2023-09-13T05:46:46.667 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ 2023-09-13T05:46:46.667 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ 2023-09-13T05:46:46.667 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-13T05:46:46.667 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 254601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-13T05:46:46.667 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-13T05:46:46.668 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ 2023-09-13T05:46:46.668 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-13T05:46:46.668 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-13T05:46:46.668 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-13T05:46:46.668 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-13T05:46:46.668 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-13T05:46:46.669 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-13T05:46:46.669 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-13T05:46:46.669 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-13T05:46:46.669 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-13T05:46:46.669 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-13T05:46:46.670 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ 2023-09-13T05:46:46.670 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-13T05:46:46.670 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-13T05:46:46.670 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-13T05:46:46.670 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-09-13T05:46:46.671 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-13T05:46:46.671 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-09-13T05:46:46.671 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-13T05:46:46.671 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-13T05:46:46.671 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-13T05:46:46.671 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-09-13T05:46:46.672 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-13T05:46:46.672 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-13T05:46:46.672 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-13T05:46:46.672 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-13T05:46:46.672 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-13T05:46:46.673 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-13T05:46:46.673 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-13T05:46:46.673 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-13T05:46:46.673 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-13T05:46:46.673 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-09-13T05:46:46.674 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-13T05:46:46.674 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-13T05:46:46.674 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-13T05:46:46.674 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-13T05:46:46.674 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-13T05:46:46.674 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-13T05:46:46.675 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-13T05:46:46.675 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-13T05:46:46.675 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-13T05:46:46.675 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-13T05:46:46.675 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-13T05:46:46.676 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-13T05:46:46.676 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-13T05:46:46.676 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-13T05:46:46.676 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-13T05:46:46.676 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-13T05:46:46.676 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-13T05:46:46.677 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-13T05:46:46.677 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-13T05:46:46.677 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-13T05:46:46.677 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-13T05:46:46.677 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-13T05:46:46.678 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ 2023-09-13T05:46:46.678 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-13T05:46:46.678 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-13T05:46:46.678 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-13T05:46:46.678 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 80793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_gre.ko 2023-09-13T05:46:46.678 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 92817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-13T05:46:46.679 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-13T05:46:46.679 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-13T05:46:46.679 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-13T05:46:46.679 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/mip6.ko 2023-09-13T05:46:46.681 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ 2023-09-13T05:46:46.681 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-13T05:46:46.681 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-09-13T05:46:46.681 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-13T05:46:46.681 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-13T05:46:46.682 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-13T05:46:46.682 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-13T05:46:46.682 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-13T05:46:46.682 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-13T05:46:46.683 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-13T05:46:46.683 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-13T05:46:46.683 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-13T05:46:46.683 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-13T05:46:46.683 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-13T05:46:46.683 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-13T05:46:46.684 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-13T05:46:46.684 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-13T05:46:46.684 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-13T05:46:46.684 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-13T05:46:46.684 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-13T05:46:46.685 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-13T05:46:46.685 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-13T05:46:46.685 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-13T05:46:46.685 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-13T05:46:46.685 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-13T05:46:46.685 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-13T05:46:46.686 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-13T05:46:46.686 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-13T05:46:46.686 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-13T05:46:46.686 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/ 2023-09-13T05:46:46.686 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 82929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-13T05:46:46.687 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/ 2023-09-13T05:46:46.687 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 125873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-13T05:46:46.687 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-13T05:46:46.687 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-13T05:46:46.687 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-13T05:46:46.688 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-13T05:46:46.688 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-13T05:46:46.688 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-13T05:46:46.688 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/lapb/ 2023-09-13T05:46:46.688 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/lapb/lapb.ko 2023-09-13T05:46:46.689 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/ 2023-09-13T05:46:46.689 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-13T05:46:46.689 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 267257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc2.ko 2023-09-13T05:46:46.689 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/ 2023-09-13T05:46:46.689 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 291041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-13T05:46:46.689 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/ 2023-09-13T05:46:46.690 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-13T05:46:46.690 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ 2023-09-13T05:46:46.690 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ 2023-09-13T05:46:46.690 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 119649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-13T05:46:46.690 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-13T05:46:46.691 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-13T05:46:46.691 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-13T05:46:46.691 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 102033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-13T05:46:46.691 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 103121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-13T05:46:46.691 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 104593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-13T05:46:46.692 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 105129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-13T05:46:46.692 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 114393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-13T05:46:46.692 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-13T05:46:46.692 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 111161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-13T05:46:46.692 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 114673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-13T05:46:46.693 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 114329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-13T05:46:46.693 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 113217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-13T05:46:46.693 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 116217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-13T05:46:46.693 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-13T05:46:46.693 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ 2023-09-13T05:46:46.693 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 412889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-13T05:46:46.694 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-13T05:46:46.694 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-13T05:46:46.694 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-13T05:46:46.694 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-13T05:46:46.694 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-13T05:46:46.695 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-13T05:46:46.695 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-13T05:46:46.695 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-13T05:46:46.695 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-13T05:46:46.695 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-13T05:46:46.696 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-13T05:46:46.696 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-13T05:46:46.696 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-13T05:46:46.696 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-13T05:46:46.696 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 408665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-13T05:46:46.697 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-13T05:46:46.697 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-13T05:46:46.697 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-13T05:46:46.697 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 118145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-13T05:46:46.697 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-13T05:46:46.697 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-13T05:46:46.698 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 108393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-13T05:46:46.698 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-13T05:46:46.698 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-13T05:46:46.698 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-13T05:46:46.698 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-13T05:46:46.699 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-13T05:46:46.699 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-13T05:46:46.699 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 88513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-13T05:46:46.699 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-13T05:46:46.699 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-13T05:46:46.700 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 95353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-13T05:46:46.700 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-13T05:46:46.700 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-13T05:46:46.700 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-13T05:46:46.700 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-13T05:46:46.701 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-13T05:46:46.701 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-13T05:46:46.701 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 609257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-13T05:46:46.701 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-13T05:46:46.701 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-13T05:46:46.701 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-09-13T05:46:46.702 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-13T05:46:46.702 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-13T05:46:46.702 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-13T05:46:46.702 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-13T05:46:46.702 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-13T05:46:46.703 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-13T05:46:46.703 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-13T05:46:46.703 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-13T05:46:46.703 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-13T05:46:46.703 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-13T05:46:46.704 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-13T05:46:46.704 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-13T05:46:46.704 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-13T05:46:46.704 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-13T05:46:46.704 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-13T05:46:46.705 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_osf.ko 2023-09-13T05:46:46.705 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-13T05:46:46.705 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-13T05:46:46.705 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-13T05:46:46.705 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-13T05:46:46.706 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-13T05:46:46.706 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_synproxy.ko 2023-09-13T05:46:46.706 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tproxy.ko 2023-09-13T05:46:46.706 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 89329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/x_tables.ko 2023-09-13T05:46:46.706 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-13T05:46:46.706 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-13T05:46:46.707 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-13T05:46:46.707 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-13T05:46:46.707 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-13T05:46:46.707 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-13T05:46:46.707 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-13T05:46:46.708 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-13T05:46:46.708 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-13T05:46:46.708 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-13T05:46:46.708 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-13T05:46:46.708 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-13T05:46:46.708 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-13T05:46:46.709 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-13T05:46:46.709 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-13T05:46:46.709 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-13T05:46:46.709 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-13T05:46:46.709 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-13T05:46:46.710 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-13T05:46:46.710 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-13T05:46:46.710 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-13T05:46:46.710 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-13T05:46:46.710 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-13T05:46:46.711 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-13T05:46:46.711 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-13T05:46:46.711 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-13T05:46:46.711 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-13T05:46:46.711 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-13T05:46:46.711 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-13T05:46:46.712 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-13T05:46:46.712 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-13T05:46:46.712 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-13T05:46:46.712 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-13T05:46:46.712 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-13T05:46:46.713 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-13T05:46:46.713 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-13T05:46:46.713 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-13T05:46:46.713 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-13T05:46:46.713 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-13T05:46:46.714 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-13T05:46:46.714 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-13T05:46:46.714 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-13T05:46:46.714 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-13T05:46:46.714 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-13T05:46:46.715 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-13T05:46:46.715 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-13T05:46:46.715 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-13T05:46:46.715 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-13T05:46:46.715 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-13T05:46:46.715 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-13T05:46:46.716 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-13T05:46:46.716 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-13T05:46:46.716 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-13T05:46:46.716 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-13T05:46:46.716 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-13T05:46:46.717 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-13T05:46:46.717 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-13T05:46:46.717 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-13T05:46:46.717 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-13T05:46:46.717 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-13T05:46:46.718 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-13T05:46:46.718 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-13T05:46:46.718 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-13T05:46:46.718 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-13T05:46:46.718 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-13T05:46:46.718 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-13T05:46:46.719 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-13T05:46:46.719 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-13T05:46:46.719 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-13T05:46:46.719 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpudp.ko 2023-09-13T05:46:46.719 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-13T05:46:46.720 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-13T05:46:46.720 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/ 2023-09-13T05:46:46.720 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-13T05:46:46.720 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/ 2023-09-13T05:46:46.720 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-13T05:46:46.721 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/ 2023-09-13T05:46:46.721 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 379545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-13T05:46:46.721 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-13T05:46:46.721 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-13T05:46:46.721 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-13T05:46:46.721 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/ 2023-09-13T05:46:46.722 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-13T05:46:46.722 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/ 2023-09-13T05:46:46.722 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 109961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/phonet.ko 2023-09-13T05:46:46.722 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/pn_pep.ko 2023-09-13T05:46:46.722 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/ 2023-09-13T05:46:46.723 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 252889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-13T05:46:46.723 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 165081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-13T05:46:46.723 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-13T05:46:46.723 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rxrpc/ 2023-09-13T05:46:46.723 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 820137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rxrpc/rxrpc.ko 2023-09-13T05:46:46.724 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/ 2023-09-13T05:46:46.724 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-13T05:46:46.724 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-13T05:46:46.724 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-13T05:46:46.724 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-13T05:46:46.725 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-13T05:46:46.725 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-13T05:46:46.725 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-13T05:46:46.725 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-13T05:46:46.725 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-13T05:46:46.726 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-13T05:46:46.726 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-13T05:46:46.726 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-13T05:46:46.726 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_cgroup.ko 2023-09-13T05:46:46.726 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-13T05:46:46.726 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-13T05:46:46.727 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-13T05:46:46.727 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-13T05:46:46.727 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-13T05:46:46.727 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-13T05:46:46.727 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-13T05:46:46.728 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-13T05:46:46.728 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-13T05:46:46.728 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-13T05:46:46.728 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-13T05:46:46.728 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-13T05:46:46.729 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-13T05:46:46.729 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-13T05:46:46.729 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq_codel.ko 2023-09-13T05:46:46.729 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-13T05:46:46.729 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-13T05:46:46.729 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-13T05:46:46.730 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-13T05:46:46.730 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-13T05:46:46.730 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-13T05:46:46.730 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-13T05:46:46.730 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-13T05:46:46.731 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-13T05:46:46.731 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-13T05:46:46.731 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-13T05:46:46.731 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-13T05:46:46.731 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-13T05:46:46.732 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-13T05:46:46.732 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-13T05:46:46.732 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-13T05:46:46.732 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-13T05:46:46.732 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-13T05:46:46.732 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/ 2023-09-13T05:46:46.733 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 930369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-13T05:46:46.733 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-13T05:46:46.733 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/ 2023-09-13T05:46:46.733 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/ 2023-09-13T05:46:46.733 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 335569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-13T05:46:46.734 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-13T05:46:46.734 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1514673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-13T05:46:46.734 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/ 2023-09-13T05:46:46.734 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 707401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-13T05:46:46.734 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/ 2023-09-13T05:46:46.734 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-13T05:46:46.735 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 862385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-13T05:46:46.735 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/ 2023-09-13T05:46:46.735 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-13T05:46:46.735 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/ 2023-09-13T05:46:46.735 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 84841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-13T05:46:46.736 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 68033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-13T05:46:46.736 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 95985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-13T05:46:46.736 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-13T05:46:46.736 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-13T05:46:46.736 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/x25/ 2023-09-13T05:46:46.737 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 125097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/x25/x25.ko 2023-09-13T05:46:46.737 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/ 2023-09-13T05:46:46.737 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_algo.ko 2023-09-13T05:46:46.737 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-13T05:46:46.737 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 102353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_user.ko 2023-09-13T05:46:46.737 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/ 2023-09-13T05:46:46.738 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/ 2023-09-13T05:46:46.738 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-13T05:46:46.738 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 638591 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-13T05:46:46.738 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 624324 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-13T05:46:46.738 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7656 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-13T05:46:46.739 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.alias.bin 2023-09-13T05:46:46.739 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9821 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-13T05:46:46.739 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-13T05:46:46.739 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 146449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-13T05:46:46.739 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 232695 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-13T05:46:46.740 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 210 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-13T05:46:46.740 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 72754 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-13T05:46:46.740 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 879 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-13T05:46:46.740 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 252880 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-13T05:46:46.740 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 307898 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-13T05:46:46.740 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/ 2023-09-13T05:46:46.741 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/share/ 2023-09-13T05:46:46.741 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/share/doc/ 2023-09-13T05:46:46.741 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/ 2023-09-13T05:46:46.741 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 175 2023-09-11 01:59 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/changelog.Debian.gz 2023-09-13T05:46:46.741 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 691 2023-09-11 01:59 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/copyright 2023-09-13T05:46:46.742 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:46.743 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:46.743 DEBUG:teuthology.orchestra.run.smithi130:> egrep '(submenu|menuentry.*6.5.0-rc7-gfef64f93da2b).*{' /boot/grub/grub.cfg 2023-09-13T05:46:46.750 INFO:teuthology.orchestra.run.smithi130.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-09-13T05:46:46.750 INFO:teuthology.orchestra.run.smithi130.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-gfef64f93da2b-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-09-13T05:46:46.751 INFO:teuthology.orchestra.run.smithi130.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-gfef64f93da2b-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-09-13T05:46:46.751 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-09-13T05:46:46.752 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:46.752 DEBUG:teuthology.orchestra.run.smithi130:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-09-13T05:46:46.794 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi130.front.sepia.ceph.com to complete... 2023-09-13T05:46:47.164 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub' 2023-09-13T05:46:47.166 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-13T05:46:47.199 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2023-09-13T05:46:47.358 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:47.364 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:47.592 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-13T05:46:47.597 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-13T05:46:47.639 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-13T05:46:47.644 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-13T05:46:47.812 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-13T05:46:47.812 INFO:teuthology.orchestra.run.smithi130.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-09-13T05:46:47.812 INFO:teuthology.orchestra.run.smithi130.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-13T05:46:47.841 INFO:teuthology.orchestra.run.smithi130.stderr:done 2023-09-13T05:46:52.841 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub' 2023-09-13T05:46:52.864 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-13T05:46:52.926 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2023-09-13T05:46:53.295 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:53.316 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:53.687 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-13T05:46:53.722 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-13T05:46:53.781 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-13T05:46:53.787 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-13T05:46:53.962 INFO:teuthology.orchestra.run.smithi164.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-13T05:46:53.962 INFO:teuthology.orchestra.run.smithi164.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-09-13T05:46:53.963 INFO:teuthology.orchestra.run.smithi164.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-13T05:46:54.012 INFO:teuthology.orchestra.run.smithi164.stderr:done 2023-09-13T05:46:54.170 DEBUG:teuthology.orchestra.run.smithi164:> dpkg-deb -c /tmp/linux-image.deb 2023-09-13T05:46:54.178 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./ 2023-09-13T05:46:54.178 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./boot/ 2023-09-13T05:46:54.178 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 4382168 2023-09-11 01:59 ./boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:54.187 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 168454 2023-09-11 01:59 ./boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:54.188 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11294016 2023-09-11 01:59 ./boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:54.205 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/ 2023-09-13T05:46:54.205 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/ 2023-09-13T05:46:54.206 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/postinst.d/ 2023-09-13T05:46:54.206 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/postrm.d/ 2023-09-13T05:46:54.206 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/preinst.d/ 2023-09-13T05:46:54.206 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/prerm.d/ 2023-09-13T05:46:54.207 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/ 2023-09-13T05:46:54.207 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/ 2023-09-13T05:46:54.207 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/ 2023-09-13T05:46:54.207 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/ 2023-09-13T05:46:54.207 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/ 2023-09-13T05:46:54.208 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/ 2023-09-13T05:46:54.208 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ 2023-09-13T05:46:54.208 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 490385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/aesni-intel.ko 2023-09-13T05:46:54.211 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-13T05:46:54.211 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-13T05:46:54.212 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-13T05:46:54.212 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 93113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-13T05:46:54.212 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 106729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-13T05:46:54.212 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 152241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-13T05:46:54.213 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-13T05:46:54.213 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-13T05:46:54.213 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 83889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-13T05:46:54.213 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-13T05:46:54.213 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-13T05:46:54.214 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-13T05:46:54.214 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-13T05:46:54.214 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-13T05:46:54.214 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-13T05:46:54.214 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-13T05:46:54.215 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-13T05:46:54.215 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-13T05:46:54.215 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-13T05:46:54.215 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/ 2023-09-13T05:46:54.215 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/ 2023-09-13T05:46:54.216 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/ 2023-09-13T05:46:54.216 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-13T05:46:54.216 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpuid.ko 2023-09-13T05:46:54.216 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/msr.ko 2023-09-13T05:46:54.216 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/ 2023-09-13T05:46:54.217 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 348201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-13T05:46:54.217 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 882105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-13T05:46:54.217 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 2277369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-13T05:46:54.332 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ 2023-09-13T05:46:54.332 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/af_alg.ko 2023-09-13T05:46:54.333 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/algif_hash.ko 2023-09-13T05:46:54.333 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/algif_skcipher.ko 2023-09-13T05:46:54.333 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-13T05:46:54.333 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-13T05:46:54.333 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-13T05:46:54.334 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/asymmetric_keys/ 2023-09-13T05:46:54.334 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-09-13T05:46:54.334 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/ 2023-09-13T05:46:54.334 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-13T05:46:54.334 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-13T05:46:54.335 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-13T05:46:54.335 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-13T05:46:54.335 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-13T05:46:54.335 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-13T05:46:54.335 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-13T05:46:54.336 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-13T05:46:54.336 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-13T05:46:54.336 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-13T05:46:54.336 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-13T05:46:54.337 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-13T05:46:54.337 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-13T05:46:54.337 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-13T05:46:54.337 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-13T05:46:54.337 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-13T05:46:54.337 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-13T05:46:54.338 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-13T05:46:54.338 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cryptd.ko 2023-09-13T05:46:54.338 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-13T05:46:54.338 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_simd.ko 2023-09-13T05:46:54.338 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-13T05:46:54.339 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-13T05:46:54.339 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-13T05:46:54.339 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-13T05:46:54.339 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-13T05:46:54.339 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-13T05:46:54.340 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-13T05:46:54.340 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-13T05:46:54.340 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lrw.ko 2023-09-13T05:46:54.340 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-13T05:46:54.340 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-13T05:46:54.341 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-13T05:46:54.341 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-13T05:46:54.341 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-13T05:46:54.341 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-13T05:46:54.341 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-13T05:46:54.342 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-13T05:46:54.342 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-13T05:46:54.342 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 149193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-13T05:46:54.342 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-13T05:46:54.342 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-13T05:46:54.343 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-13T05:46:54.343 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-13T05:46:54.343 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-13T05:46:54.343 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-13T05:46:54.344 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-13T05:46:54.344 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xts.ko 2023-09-13T05:46:54.344 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-13T05:46:54.344 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ 2023-09-13T05:46:54.344 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ 2023-09-13T05:46:54.345 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_extlog.ko 2023-09-13T05:46:54.345 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-13T05:46:54.345 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-13T05:46:54.345 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/apei/ 2023-09-13T05:46:54.345 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/apei/einj.ko 2023-09-13T05:46:54.345 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-13T05:46:54.346 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-13T05:46:54.346 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-13T05:46:54.346 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-13T05:46:54.347 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 100401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-13T05:46:54.347 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ 2023-09-13T05:46:54.347 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-13T05:46:54.348 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 88625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci.ko 2023-09-13T05:46:54.348 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-13T05:46:54.348 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 87841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci.ko 2023-09-13T05:46:54.349 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-13T05:46:54.349 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-13T05:46:54.349 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-13T05:46:54.350 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-13T05:46:54.350 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-13T05:46:54.350 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-13T05:46:54.351 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-13T05:46:54.351 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-13T05:46:54.351 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-13T05:46:54.352 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-13T05:46:54.352 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-13T05:46:54.352 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-13T05:46:54.352 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-13T05:46:54.353 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-13T05:46:54.353 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-13T05:46:54.353 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-13T05:46:54.353 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-13T05:46:54.354 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-13T05:46:54.354 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_legacy.ko 2023-09-13T05:46:54.354 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-13T05:46:54.355 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-13T05:46:54.355 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-13T05:46:54.355 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-13T05:46:54.356 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-13T05:46:54.356 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-13T05:46:54.356 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-13T05:46:54.356 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-13T05:46:54.357 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-13T05:46:54.357 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-13T05:46:54.357 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-13T05:46:54.357 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-13T05:46:54.357 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-13T05:46:54.358 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_radisys.ko 2023-09-13T05:46:54.358 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-13T05:46:54.358 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rz1000.ko 2023-09-13T05:46:54.359 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-13T05:46:54.359 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-13T05:46:54.359 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-13T05:46:54.360 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-13T05:46:54.360 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-13T05:46:54.361 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-13T05:46:54.361 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-13T05:46:54.361 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-13T05:46:54.361 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 83225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-13T05:46:54.361 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-13T05:46:54.362 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-13T05:46:54.362 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-13T05:46:54.362 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-13T05:46:54.362 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-13T05:46:54.362 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-13T05:46:54.363 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-13T05:46:54.363 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-13T05:46:54.363 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-13T05:46:54.364 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-13T05:46:54.364 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-13T05:46:54.364 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ 2023-09-13T05:46:54.365 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-13T05:46:54.365 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/ 2023-09-13T05:46:54.365 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 124457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-13T05:46:54.365 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/ 2023-09-13T05:46:54.365 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/ 2023-09-13T05:46:54.366 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 113705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-13T05:46:54.366 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/ 2023-09-13T05:46:54.366 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 968433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-13T05:46:54.366 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 173201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-13T05:46:54.367 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/ 2023-09-13T05:46:54.367 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 94297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-13T05:46:54.367 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 115345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-13T05:46:54.367 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/ 2023-09-13T05:46:54.368 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 110361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-13T05:46:54.368 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 98225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-13T05:46:54.368 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 259401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-13T05:46:54.368 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/ 2023-09-13T05:46:54.368 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 98129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-13T05:46:54.369 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/ 2023-09-13T05:46:54.369 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-13T05:46:54.369 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ 2023-09-13T05:46:54.369 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/applicom.ko 2023-09-13T05:46:54.370 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-13T05:46:54.370 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/ 2023-09-13T05:46:54.370 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-13T05:46:54.371 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-13T05:46:54.371 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-13T05:46:54.371 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-13T05:46:54.372 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-13T05:46:54.372 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ 2023-09-13T05:46:54.372 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-13T05:46:54.372 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 150665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-13T05:46:54.373 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-13T05:46:54.373 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 139057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-13T05:46:54.373 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-13T05:46:54.373 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-13T05:46:54.373 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-13T05:46:54.374 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/ 2023-09-13T05:46:54.374 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 84121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-13T05:46:54.374 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/nvram.ko 2023-09-13T05:46:54.375 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-13T05:46:54.375 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-13T05:46:54.375 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/ 2023-09-13T05:46:54.375 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-13T05:46:54.375 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-09-13T05:46:54.376 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-09-13T05:46:54.376 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-09-13T05:46:54.376 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-13T05:46:54.376 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-13T05:46:54.376 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-09-13T05:46:54.376 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/ 2023-09-13T05:46:54.377 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-09-13T05:46:54.377 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-09-13T05:46:54.377 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-09-13T05:46:54.377 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/ 2023-09-13T05:46:54.378 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-palmas.ko 2023-09-13T05:46:54.378 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-si5351.ko 2023-09-13T05:46:54.378 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-twl6040.ko 2023-09-13T05:46:54.379 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-wm831x.ko 2023-09-13T05:46:54.379 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/ 2023-09-13T05:46:54.379 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-13T05:46:54.380 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-13T05:46:54.380 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-13T05:46:54.380 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ 2023-09-13T05:46:54.381 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ 2023-09-13T05:46:54.381 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-13T05:46:54.381 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 234473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-13T05:46:54.382 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/ 2023-09-13T05:46:54.382 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/ 2023-09-13T05:46:54.383 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-09-13T05:46:54.383 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 408489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-13T05:46:54.383 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-09-13T05:46:54.383 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-13T05:46:54.384 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-13T05:46:54.384 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-13T05:46:54.385 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/ 2023-09-13T05:46:54.385 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 68937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-13T05:46:54.385 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/ 2023-09-13T05:46:54.386 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-13T05:46:54.386 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ 2023-09-13T05:46:54.386 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/ 2023-09-13T05:46:54.387 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-13T05:46:54.387 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ 2023-09-13T05:46:54.387 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 122641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-13T05:46:54.388 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ 2023-09-13T05:46:54.388 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 80273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-13T05:46:54.388 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-13T05:46:54.388 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-13T05:46:54.388 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-13T05:46:54.389 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-13T05:46:54.389 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-13T05:46:54.389 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-13T05:46:54.389 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-13T05:46:54.390 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-13T05:46:54.390 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-13T05:46:54.390 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-13T05:46:54.390 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-13T05:46:54.391 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-13T05:46:54.391 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/ 2023-09-13T05:46:54.391 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-gpio.ko 2023-09-13T05:46:54.391 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max14577.ko 2023-09-13T05:46:54.391 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max77693.ko 2023-09-13T05:46:54.392 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max8997.ko 2023-09-13T05:46:54.392 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-palmas.ko 2023-09-13T05:46:54.392 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-09-13T05:46:54.392 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-sm5502.ko 2023-09-13T05:46:54.393 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/ 2023-09-13T05:46:54.393 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/dmi-sysfs.ko 2023-09-13T05:46:54.393 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/efi/ 2023-09-13T05:46:54.393 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-09-13T05:46:54.393 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-13T05:46:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/ 2023-09-13T05:46:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-adp5520.ko 2023-09-13T05:46:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-amd8111.ko 2023-09-13T05:46:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-arizona.ko 2023-09-13T05:46:54.395 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-da9052.ko 2023-09-13T05:46:54.395 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-da9055.ko 2023-09-13T05:46:54.395 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-dln2.ko 2023-09-13T05:46:54.396 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 77849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-f7188x.ko 2023-09-13T05:46:54.396 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-generic.ko 2023-09-13T05:46:54.396 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-13T05:46:54.397 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-09-13T05:46:54.397 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-kempld.ko 2023-09-13T05:46:54.397 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-lp3943.ko 2023-09-13T05:46:54.398 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max7300.ko 2023-09-13T05:46:54.398 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max730x.ko 2023-09-13T05:46:54.399 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max732x.ko 2023-09-13T05:46:54.399 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-09-13T05:46:54.399 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-pca953x.ko 2023-09-13T05:46:54.399 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-09-13T05:46:54.400 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-09-13T05:46:54.400 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-sch.ko 2023-09-13T05:46:54.400 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-sch311x.ko 2023-09-13T05:46:54.400 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-tps65912.ko 2023-09-13T05:46:54.400 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-twl4030.ko 2023-09-13T05:46:54.401 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-twl6040.ko 2023-09-13T05:46:54.401 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-13T05:46:54.401 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-vx855.ko 2023-09-13T05:46:54.401 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm831x.ko 2023-09-13T05:46:54.401 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm8350.ko 2023-09-13T05:46:54.402 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm8994.ko 2023-09-13T05:46:54.402 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/ 2023-09-13T05:46:54.402 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-a4tech.ko 2023-09-13T05:46:54.403 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-apple.ko 2023-09-13T05:46:54.403 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-13T05:46:54.403 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-13T05:46:54.404 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-13T05:46:54.404 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-belkin.ko 2023-09-13T05:46:54.404 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cherry.ko 2023-09-13T05:46:54.404 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-chicony.ko 2023-09-13T05:46:54.404 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cp2112.ko 2023-09-13T05:46:54.405 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cypress.ko 2023-09-13T05:46:54.405 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-13T05:46:54.405 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-13T05:46:54.405 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-13T05:46:54.406 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-13T05:46:54.406 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ezkey.ko 2023-09-13T05:46:54.406 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-13T05:46:54.406 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-generic.ko 2023-09-13T05:46:54.406 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-13T05:46:54.407 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-13T05:46:54.407 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-13T05:46:54.407 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-13T05:46:54.407 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-13T05:46:54.408 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-13T05:46:54.408 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-13T05:46:54.408 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kensington.ko 2023-09-13T05:46:54.409 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-13T05:46:54.409 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-13T05:46:54.409 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-13T05:46:54.409 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-13T05:46:54.409 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-13T05:46:54.410 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lg-g15.ko 2023-09-13T05:46:54.410 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-13T05:46:54.410 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 101009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-13T05:46:54.410 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 80993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech.ko 2023-09-13T05:46:54.411 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-magicmouse.ko 2023-09-13T05:46:54.411 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-microsoft.ko 2023-09-13T05:46:54.411 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-monterey.ko 2023-09-13T05:46:54.411 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-13T05:46:54.411 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ntrig.ko 2023-09-13T05:46:54.412 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-13T05:46:54.412 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-13T05:46:54.412 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-13T05:46:54.412 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 72937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-13T05:46:54.413 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-13T05:46:54.413 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-13T05:46:54.413 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-13T05:46:54.413 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-13T05:46:54.413 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-13T05:46:54.414 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-13T05:46:54.414 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-13T05:46:54.414 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-13T05:46:54.414 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-13T05:46:54.415 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-13T05:46:54.415 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-13T05:46:54.415 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-13T05:46:54.415 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-13T05:46:54.415 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-13T05:46:54.415 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-13T05:46:54.416 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-13T05:46:54.416 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-13T05:46:54.416 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-13T05:46:54.416 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-13T05:46:54.417 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-13T05:46:54.417 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-13T05:46:54.417 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-13T05:46:54.417 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-13T05:46:54.417 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-13T05:46:54.418 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-13T05:46:54.418 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-13T05:46:54.418 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-13T05:46:54.418 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-13T05:46:54.419 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-13T05:46:54.419 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 71457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-13T05:46:54.419 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-13T05:46:54.419 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 143585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-13T05:46:54.419 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-13T05:46:54.420 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-13T05:46:54.420 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-13T05:46:54.420 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 267689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid.ko 2023-09-13T05:46:54.421 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-13T05:46:54.421 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/ 2023-09-13T05:46:54.421 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 125721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbhid.ko 2023-09-13T05:46:54.422 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-09-13T05:46:54.422 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-09-13T05:46:54.422 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 217401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-13T05:46:54.423 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/ 2023-09-13T05:46:54.423 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-13T05:46:54.423 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-13T05:46:54.423 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 301449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-13T05:46:54.423 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ 2023-09-13T05:46:54.424 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-13T05:46:54.424 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-13T05:46:54.424 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-13T05:46:54.424 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-13T05:46:54.425 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-13T05:46:54.425 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-13T05:46:54.425 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-13T05:46:54.425 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 97977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-13T05:46:54.426 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-13T05:46:54.426 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-13T05:46:54.426 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-13T05:46:54.426 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-13T05:46:54.426 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-13T05:46:54.427 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-13T05:46:54.427 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 74433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-13T05:46:54.427 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-13T05:46:54.427 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-13T05:46:54.427 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-13T05:46:54.428 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-13T05:46:54.428 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-13T05:46:54.428 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-13T05:46:54.429 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-13T05:46:54.429 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-13T05:46:54.429 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-13T05:46:54.430 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-13T05:46:54.430 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-09-13T05:46:54.430 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-09-13T05:46:54.431 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-13T05:46:54.431 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 99601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-13T05:46:54.431 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-13T05:46:54.431 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-13T05:46:54.431 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-13T05:46:54.431 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc2103.ko 2023-09-13T05:46:54.432 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-13T05:46:54.432 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-13T05:46:54.432 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 94457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-13T05:46:54.432 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-13T05:46:54.432 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-13T05:46:54.433 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-13T05:46:54.433 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-13T05:46:54.433 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-13T05:46:54.433 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-13T05:46:54.433 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-13T05:46:54.434 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hih6130.ko 2023-09-13T05:46:54.434 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-13T05:46:54.434 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-13T05:46:54.434 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-13T05:46:54.434 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-13T05:46:54.435 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-13T05:46:54.435 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-13T05:46:54.435 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-13T05:46:54.435 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 129217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-13T05:46:54.436 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/jc42.ko 2023-09-13T05:46:54.436 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-13T05:46:54.436 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-13T05:46:54.437 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-13T05:46:54.437 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-13T05:46:54.437 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-13T05:46:54.437 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-13T05:46:54.438 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-13T05:46:54.438 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-13T05:46:54.438 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-13T05:46:54.439 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-13T05:46:54.439 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 72833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-13T05:46:54.439 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-13T05:46:54.439 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-13T05:46:54.440 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-13T05:46:54.440 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 108841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-13T05:46:54.440 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-13T05:46:54.441 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-13T05:46:54.441 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-13T05:46:54.441 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-13T05:46:54.441 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-13T05:46:54.442 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-13T05:46:54.442 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-13T05:46:54.442 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-13T05:46:54.443 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-13T05:46:54.443 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-13T05:46:54.443 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-13T05:46:54.443 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-13T05:46:54.444 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-13T05:46:54.444 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-13T05:46:54.444 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-13T05:46:54.445 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-13T05:46:54.445 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-13T05:46:54.445 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mc13783-adc.ko 2023-09-13T05:46:54.446 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-13T05:46:54.446 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-09-13T05:46:54.446 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-13T05:46:54.447 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 116697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-13T05:46:54.447 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-13T05:46:54.447 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-13T05:46:54.447 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 82337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-13T05:46:54.448 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-13T05:46:54.448 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-13T05:46:54.448 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ 2023-09-13T05:46:54.449 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-13T05:46:54.449 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-13T05:46:54.449 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-13T05:46:54.449 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-13T05:46:54.450 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-13T05:46:54.450 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-13T05:46:54.450 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-13T05:46:54.451 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 81841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-13T05:46:54.451 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-13T05:46:54.451 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-13T05:46:54.452 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-13T05:46:54.452 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-13T05:46:54.452 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-13T05:46:54.452 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-13T05:46:54.453 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-13T05:46:54.453 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-13T05:46:54.453 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-13T05:46:54.453 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-13T05:46:54.454 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-13T05:46:54.454 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-13T05:46:54.454 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smm665.ko 2023-09-13T05:46:54.454 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-13T05:46:54.455 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-13T05:46:54.455 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-13T05:46:54.455 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-13T05:46:54.455 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-13T05:46:54.455 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-13T05:46:54.455 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-13T05:46:54.456 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-13T05:46:54.456 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-13T05:46:54.456 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-13T05:46:54.456 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-13T05:46:54.456 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-13T05:46:54.457 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-13T05:46:54.457 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-13T05:46:54.457 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 71345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-13T05:46:54.457 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-13T05:46:54.457 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 71321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-13T05:46:54.458 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 101457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-13T05:46:54.458 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 119505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-13T05:46:54.458 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-13T05:46:54.458 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-13T05:46:54.458 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-09-13T05:46:54.459 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-09-13T05:46:54.459 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/ 2023-09-13T05:46:54.459 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/ 2023-09-13T05:46:54.459 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-13T05:46:54.459 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-13T05:46:54.460 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/ 2023-09-13T05:46:54.460 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-09-13T05:46:54.460 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-09-13T05:46:54.460 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-09-13T05:46:54.460 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-13T05:46:54.460 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-13T05:46:54.461 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-13T05:46:54.461 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-09-13T05:46:54.461 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 6929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-13T05:46:54.461 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-09-13T05:46:54.461 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-13T05:46:54.461 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-13T05:46:54.462 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-13T05:46:54.462 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-13T05:46:54.462 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-09-13T05:46:54.462 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-09-13T05:46:54.462 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-13T05:46:54.463 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-13T05:46:54.463 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-13T05:46:54.463 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-09-13T05:46:54.463 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-13T05:46:54.463 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-13T05:46:54.464 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-09-13T05:46:54.464 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-13T05:46:54.464 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-13T05:46:54.464 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-13T05:46:54.464 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-09-13T05:46:54.464 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-13T05:46:54.465 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-13T05:46:54.465 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-09-13T05:46:54.465 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-09-13T05:46:54.466 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-13T05:46:54.466 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-09-13T05:46:54.466 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-13T05:46:54.467 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-13T05:46:54.467 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-13T05:46:54.467 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-13T05:46:54.468 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-09-13T05:46:54.468 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-13T05:46:54.468 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-13T05:46:54.469 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-13T05:46:54.469 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/ 2023-09-13T05:46:54.469 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-09-13T05:46:54.470 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-09-13T05:46:54.470 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-09-13T05:46:54.470 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ 2023-09-13T05:46:54.471 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ 2023-09-13T05:46:54.471 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 273641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-13T05:46:54.471 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 876913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-13T05:46:54.472 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-13T05:46:54.472 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 324145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-13T05:46:54.472 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 97961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-13T05:46:54.473 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 279345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-13T05:46:54.473 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-13T05:46:54.474 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ 2023-09-13T05:46:54.474 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/ 2023-09-13T05:46:54.474 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 492569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-13T05:46:54.474 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/ 2023-09-13T05:46:54.474 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 419193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-13T05:46:54.475 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/ 2023-09-13T05:46:54.475 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 739705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-13T05:46:54.475 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ 2023-09-13T05:46:54.475 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 296649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-13T05:46:54.475 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ocrdma/ 2023-09-13T05:46:54.476 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 153681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-09-13T05:46:54.476 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/usnic/ 2023-09-13T05:46:54.476 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 169017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-09-13T05:46:54.476 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ 2023-09-13T05:46:54.476 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ 2023-09-13T05:46:54.476 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 263177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-13T05:46:54.477 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ 2023-09-13T05:46:54.477 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 100225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-13T05:46:54.477 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ 2023-09-13T05:46:54.477 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 111993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-13T05:46:54.477 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ 2023-09-13T05:46:54.478 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 129081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-13T05:46:54.478 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ 2023-09-13T05:46:54.478 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 129553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-13T05:46:54.478 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/ 2023-09-13T05:46:54.478 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/evbug.ko 2023-09-13T05:46:54.479 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/ff-memless.ko 2023-09-13T05:46:54.479 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ 2023-09-13T05:46:54.479 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-13T05:46:54.479 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-13T05:46:54.479 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-13T05:46:54.479 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-13T05:46:54.480 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-13T05:46:54.480 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-13T05:46:54.480 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/ 2023-09-13T05:46:54.480 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-09-13T05:46:54.480 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-09-13T05:46:54.481 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-09-13T05:46:54.481 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-09-13T05:46:54.481 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-13T05:46:54.481 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-09-13T05:46:54.481 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lkkbd.ko 2023-09-13T05:46:54.482 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lm8323.ko 2023-09-13T05:46:54.482 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lm8333.ko 2023-09-13T05:46:54.482 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-09-13T05:46:54.482 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-09-13T05:46:54.482 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-09-13T05:46:54.483 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-09-13T05:46:54.483 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-09-13T05:46:54.483 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-09-13T05:46:54.483 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/qt1070.ko 2023-09-13T05:46:54.483 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/qt2160.ko 2023-09-13T05:46:54.483 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-09-13T05:46:54.484 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/stowaway.ko 2023-09-13T05:46:54.484 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/sunkbd.ko 2023-09-13T05:46:54.484 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-09-13T05:46:54.484 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-09-13T05:46:54.484 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-09-13T05:46:54.485 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/xtkbd.ko 2023-09-13T05:46:54.485 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/matrix-keymap.ko 2023-09-13T05:46:54.485 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/ 2023-09-13T05:46:54.485 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-13T05:46:54.485 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-13T05:46:54.486 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 123681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-13T05:46:54.486 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-13T05:46:54.486 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-09-13T05:46:54.486 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 335849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/psmouse.ko 2023-09-13T05:46:54.486 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-13T05:46:54.487 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-13T05:46:54.487 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-13T05:46:54.487 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-13T05:46:54.487 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/ 2023-09-13T05:46:54.487 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 109849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-13T05:46:54.487 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ 2023-09-13T05:46:54.488 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-13T05:46:54.488 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-13T05:46:54.488 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ct82c710.ko 2023-09-13T05:46:54.488 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-13T05:46:54.488 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/parkbd.ko 2023-09-13T05:46:54.489 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/pcips2.ko 2023-09-13T05:46:54.489 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ps2mult.ko 2023-09-13T05:46:54.489 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-13T05:46:54.489 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serport.ko 2023-09-13T05:46:54.489 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-13T05:46:54.489 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/ 2023-09-13T05:46:54.490 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/ 2023-09-13T05:46:54.490 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-13T05:46:54.490 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/ 2023-09-13T05:46:54.490 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-88pm860x.ko 2023-09-13T05:46:54.490 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-adp5520.ko 2023-09-13T05:46:54.491 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-bd2802.ko 2023-09-13T05:46:54.491 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-13T05:46:54.491 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-da903x.ko 2023-09-13T05:46:54.491 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-da9052.ko 2023-09-13T05:46:54.491 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-gpio.ko 2023-09-13T05:46:54.492 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-13T05:46:54.492 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3533.ko 2023-09-13T05:46:54.492 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm355x.ko 2023-09-13T05:46:54.492 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3642.ko 2023-09-13T05:46:54.492 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-13T05:46:54.492 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp8788.ko 2023-09-13T05:46:54.493 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-max8997.ko 2023-09-13T05:46:54.493 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-mc13783.ko 2023-09-13T05:46:54.493 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-menf21bmc.ko 2023-09-13T05:46:54.493 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca9532.ko 2023-09-13T05:46:54.493 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca955x.ko 2023-09-13T05:46:54.494 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca963x.ko 2023-09-13T05:46:54.494 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-13T05:46:54.494 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-tca6507.ko 2023-09-13T05:46:54.494 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-wm831x-status.ko 2023-09-13T05:46:54.494 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-wm8350.ko 2023-09-13T05:46:54.495 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ 2023-09-13T05:46:54.495 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-13T05:46:54.495 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-13T05:46:54.495 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-13T05:46:54.495 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-13T05:46:54.496 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-13T05:46:54.496 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-13T05:46:54.496 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-13T05:46:54.496 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-13T05:46:54.496 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/ 2023-09-13T05:46:54.497 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/ 2023-09-13T05:46:54.497 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 655473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-13T05:46:54.497 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-13T05:46:54.497 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bufio.ko 2023-09-13T05:46:54.497 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-13T05:46:54.497 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 155993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-13T05:46:54.498 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 107049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-13T05:46:54.498 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-13T05:46:54.498 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-era.ko 2023-09-13T05:46:54.498 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-13T05:46:54.498 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-13T05:46:54.499 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log.ko 2023-09-13T05:46:54.499 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-mirror.ko 2023-09-13T05:46:54.499 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-13T05:46:54.499 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-13T05:46:54.499 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-13T05:46:54.500 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-region-hash.ko 2023-09-13T05:46:54.500 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-13T05:46:54.500 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-13T05:46:54.500 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 109593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-snapshot.ko 2023-09-13T05:46:54.500 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-13T05:46:54.500 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 181585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-13T05:46:54.501 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-13T05:46:54.501 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-zero.ko 2023-09-13T05:46:54.501 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-13T05:46:54.501 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-13T05:46:54.501 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-13T05:46:54.502 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/ 2023-09-13T05:46:54.502 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 199937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-13T05:46:54.502 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-13T05:46:54.502 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 112609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-13T05:46:54.502 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 160553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-13T05:46:54.503 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 396153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-13T05:46:54.503 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/ 2023-09-13T05:46:54.503 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/ 2023-09-13T05:46:54.503 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 178113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-13T05:46:54.503 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-13T05:46:54.503 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-13T05:46:54.504 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-13T05:46:54.504 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 123353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-13T05:46:54.504 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 79017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-13T05:46:54.504 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-13T05:46:54.504 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/ 2023-09-13T05:46:54.505 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm800.ko 2023-09-13T05:46:54.505 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm805.ko 2023-09-13T05:46:54.505 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm80x.ko 2023-09-13T05:46:54.505 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/arizona-i2c.ko 2023-09-13T05:46:54.505 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 123721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/arizona.ko 2023-09-13T05:46:54.505 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/bcm590xx.ko 2023-09-13T05:46:54.506 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/cros_ec_dev.ko 2023-09-13T05:46:54.506 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/dln2.ko 2023-09-13T05:46:54.506 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/janz-cmodio.ko 2023-09-13T05:46:54.506 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/kempld-core.ko 2023-09-13T05:46:54.506 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lm3533-core.ko 2023-09-13T05:46:54.507 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-09-13T05:46:54.507 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lp3943.ko 2023-09-13T05:46:54.507 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-13T05:46:54.507 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-13T05:46:54.507 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/max8907.ko 2023-09-13T05:46:54.507 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mc13xxx-core.ko 2023-09-13T05:46:54.508 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-09-13T05:46:54.508 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/menf21bmc.ko 2023-09-13T05:46:54.508 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633-adc.ko 2023-09-13T05:46:54.508 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-09-13T05:46:54.508 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633.ko 2023-09-13T05:46:54.509 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-09-13T05:46:54.509 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/retu-mfd.ko 2023-09-13T05:46:54.509 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 80425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/si476x-core.ko 2023-09-13T05:46:54.509 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-13T05:46:54.509 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-09-13T05:46:54.509 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/tps65010.ko 2023-09-13T05:46:54.510 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/tps6507x.ko 2023-09-13T05:46:54.510 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-13T05:46:54.510 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-13T05:46:54.510 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-13T05:46:54.510 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wm8994.ko 2023-09-13T05:46:54.511 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ 2023-09-13T05:46:54.511 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-09-13T05:46:54.511 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ad525x_dpot.ko 2023-09-13T05:46:54.511 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/ 2023-09-13T05:46:54.511 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-13T05:46:54.512 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-13T05:46:54.512 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-13T05:46:54.512 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-13T05:46:54.512 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/ 2023-09-13T05:46:54.512 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-09-13T05:46:54.513 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/core.ko 2023-09-13T05:46:54.513 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/ 2023-09-13T05:46:54.513 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-13T05:46:54.514 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ds1682.ko 2023-09-13T05:46:54.514 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/dummy-irq.ko 2023-09-13T05:46:54.514 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/echo/ 2023-09-13T05:46:54.515 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/echo/echo.ko 2023-09-13T05:46:54.515 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/ 2023-09-13T05:46:54.515 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-13T05:46:54.516 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-13T05:46:54.516 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-13T05:46:54.516 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-13T05:46:54.517 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-13T05:46:54.517 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/genwqe/ 2023-09-13T05:46:54.518 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 152137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-09-13T05:46:54.518 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hmc6352.ko 2023-09-13T05:46:54.518 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-13T05:46:54.518 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ibmasm/ 2023-09-13T05:46:54.519 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 72601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-09-13T05:46:54.519 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ics932s401.ko 2023-09-13T05:46:54.519 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-13T05:46:54.520 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-13T05:46:54.520 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/ 2023-09-13T05:46:54.521 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-13T05:46:54.521 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-13T05:46:54.521 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/ 2023-09-13T05:46:54.522 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 125209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-13T05:46:54.522 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-13T05:46:54.522 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 309857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-13T05:46:54.522 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/phantom.ko 2023-09-13T05:46:54.522 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ti-st/ 2023-09-13T05:46:54.523 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 74905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ti-st/st_drv.ko 2023-09-13T05:46:54.523 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-13T05:46:54.523 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-13T05:46:54.523 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-13T05:46:54.523 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-13T05:46:54.523 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/ 2023-09-13T05:46:54.524 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 183857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-13T05:46:54.524 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ 2023-09-13T05:46:54.524 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/ 2023-09-13T05:46:54.524 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 487865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-13T05:46:54.524 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/ 2023-09-13T05:46:54.525 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/ 2023-09-13T05:46:54.525 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 106009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-13T05:46:54.525 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-13T05:46:54.525 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-13T05:46:54.525 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-09-13T05:46:54.525 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 452681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-13T05:46:54.526 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-13T05:46:54.526 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-13T05:46:54.526 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ 2023-09-13T05:46:54.526 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/ 2023-09-13T05:46:54.526 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-13T05:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-13T05:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 130489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-13T05:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 68785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-13T05:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ 2023-09-13T05:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-13T05:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-13T05:46:54.528 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-13T05:46:54.528 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 99113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-13T05:46:54.528 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/ 2023-09-13T05:46:54.528 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-13T05:46:54.528 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/ 2023-09-13T05:46:54.529 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-13T05:46:54.529 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/ 2023-09-13T05:46:54.529 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-13T05:46:54.529 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/ 2023-09-13T05:46:54.529 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-13T05:46:54.529 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/ 2023-09-13T05:46:54.530 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-13T05:46:54.530 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-13T05:46:54.530 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 87345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-13T05:46:54.530 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/ 2023-09-13T05:46:54.530 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/ 2023-09-13T05:46:54.531 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 97321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-13T05:46:54.531 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-09-13T05:46:54.531 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 104609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-13T05:46:54.531 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-09-13T05:46:54.531 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-13T05:46:54.531 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-09-13T05:46:54.532 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 81505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-13T05:46:54.532 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-13T05:46:54.532 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/ 2023-09-13T05:46:54.532 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-13T05:46:54.532 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 176881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-13T05:46:54.533 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-09-13T05:46:54.533 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1422209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-13T05:46:54.533 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 128377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-13T05:46:54.533 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-09-13T05:46:54.533 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 132289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-13T05:46:54.534 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 312145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-13T05:46:54.534 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/ 2023-09-13T05:46:54.534 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/ 2023-09-13T05:46:54.534 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 323553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-13T05:46:54.534 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/ 2023-09-13T05:46:54.535 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-09-13T05:46:54.535 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 193433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-13T05:46:54.535 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-09-13T05:46:54.535 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 347641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-13T05:46:54.535 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-09-13T05:46:54.536 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1044145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-13T05:46:54.536 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-09-13T05:46:54.536 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 166113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-13T05:46:54.536 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-09-13T05:46:54.536 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-13T05:46:54.536 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/ 2023-09-13T05:46:54.537 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/ 2023-09-13T05:46:54.537 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 204329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-13T05:46:54.537 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/ 2023-09-13T05:46:54.537 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/ 2023-09-13T05:46:54.537 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-13T05:46:54.538 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-13T05:46:54.538 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 141161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-13T05:46:54.538 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-13T05:46:54.538 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-13T05:46:54.538 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-13T05:46:54.539 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/ 2023-09-13T05:46:54.539 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-13T05:46:54.539 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-13T05:46:54.539 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-13T05:46:54.540 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-09-13T05:46:54.540 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/ 2023-09-13T05:46:54.540 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/ 2023-09-13T05:46:54.540 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 281329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-13T05:46:54.541 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-13T05:46:54.541 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-13T05:46:54.541 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fujitsu/ 2023-09-13T05:46:54.541 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-09-13T05:46:54.541 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ 2023-09-13T05:46:54.542 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 90465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-13T05:46:54.542 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/ 2023-09-13T05:46:54.542 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 295713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-13T05:46:54.542 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-09-13T05:46:54.543 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 584249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-13T05:46:54.543 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-09-13T05:46:54.543 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 246321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-13T05:46:54.543 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/ 2023-09-13T05:46:54.543 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 924017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-13T05:46:54.544 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/ 2023-09-13T05:46:54.544 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 302577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-13T05:46:54.544 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/ 2023-09-13T05:46:54.544 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 514889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-13T05:46:54.544 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-09-13T05:46:54.545 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 93593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-13T05:46:54.545 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-09-13T05:46:54.545 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 734297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-13T05:46:54.546 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-09-13T05:46:54.546 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 151841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-13T05:46:54.546 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 86921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-13T05:46:54.547 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/ 2023-09-13T05:46:54.547 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-13T05:46:54.547 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 102385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-13T05:46:54.547 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 122681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-13T05:46:54.548 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/ 2023-09-13T05:46:54.548 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-09-13T05:46:54.548 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 727433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-13T05:46:54.549 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 280513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-13T05:46:54.549 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-09-13T05:46:54.549 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-09-13T05:46:54.550 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1097537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-13T05:46:54.550 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ 2023-09-13T05:46:54.550 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-09-13T05:46:54.551 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-09-13T05:46:54.551 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-09-13T05:46:54.551 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 95665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-13T05:46:54.552 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/ 2023-09-13T05:46:54.552 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-09-13T05:46:54.552 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 108809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-13T05:46:54.552 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ 2023-09-13T05:46:54.552 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 73377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-13T05:46:54.553 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-13T05:46:54.553 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/ 2023-09-13T05:46:54.553 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 150905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-13T05:46:54.553 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/ 2023-09-13T05:46:54.553 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 136785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-13T05:46:54.554 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/ 2023-09-13T05:46:54.554 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-13T05:46:54.554 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-13T05:46:54.554 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/ 2023-09-13T05:46:54.554 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-09-13T05:46:54.555 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 227113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-13T05:46:54.555 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 87081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-13T05:46:54.555 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-09-13T05:46:54.555 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 671393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-13T05:46:54.555 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/ 2023-09-13T05:46:54.556 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-13T05:46:54.556 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/ 2023-09-13T05:46:54.556 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-13T05:46:54.556 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 83921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-13T05:46:54.556 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-13T05:46:54.557 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 189817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-13T05:46:54.557 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/ 2023-09-13T05:46:54.557 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-09-13T05:46:54.557 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 104241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-09-13T05:46:54.557 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/ 2023-09-13T05:46:54.557 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 952929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-13T05:46:54.558 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/ 2023-09-13T05:46:54.558 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-13T05:46:54.558 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/ 2023-09-13T05:46:54.558 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-13T05:46:54.558 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-13T05:46:54.559 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/ 2023-09-13T05:46:54.559 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-13T05:46:54.559 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-13T05:46:54.559 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 73345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-13T05:46:54.559 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 68209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-13T05:46:54.560 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/ 2023-09-13T05:46:54.560 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-09-13T05:46:54.560 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-09-13T05:46:54.561 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-13T05:46:54.561 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-09-13T05:46:54.561 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 481681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-13T05:46:54.561 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/ 2023-09-13T05:46:54.561 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 103321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-13T05:46:54.561 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 166121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-13T05:46:54.562 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-13T05:46:54.562 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-13T05:46:54.562 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/ 2023-09-13T05:46:54.562 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-13T05:46:54.562 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/ 2023-09-13T05:46:54.563 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 86465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-13T05:46:54.563 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/ 2023-09-13T05:46:54.563 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 80257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-13T05:46:54.563 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 83681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-13T05:46:54.564 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/ 2023-09-13T05:46:54.564 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-13T05:46:54.564 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-13T05:46:54.564 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/ 2023-09-13T05:46:54.564 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-13T05:46:54.565 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/ 2023-09-13T05:46:54.565 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/defxx.ko 2023-09-13T05:46:54.565 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/skfp/ 2023-09-13T05:46:54.566 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 216977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-09-13T05:46:54.566 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 77401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-13T05:46:54.566 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/ 2023-09-13T05:46:54.567 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 235593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-13T05:46:54.567 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/ 2023-09-13T05:46:54.567 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-13T05:46:54.568 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-13T05:46:54.568 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ 2023-09-13T05:46:54.568 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 83993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-13T05:46:54.569 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-13T05:46:54.569 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-13T05:46:54.569 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/ 2023-09-13T05:46:54.570 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-13T05:46:54.570 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-13T05:46:54.570 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-09-13T05:46:54.571 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-13T05:46:54.571 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-13T05:46:54.571 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-13T05:46:54.572 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-13T05:46:54.572 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-13T05:46:54.572 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/ 2023-09-13T05:46:54.573 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-13T05:46:54.573 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-13T05:46:54.573 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ 2023-09-13T05:46:54.573 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-13T05:46:54.574 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-13T05:46:54.574 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-13T05:46:54.574 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-13T05:46:54.574 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-13T05:46:54.574 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-13T05:46:54.575 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-13T05:46:54.575 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-13T05:46:54.575 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-13T05:46:54.575 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-13T05:46:54.575 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-13T05:46:54.576 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 75713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-13T05:46:54.576 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-13T05:46:54.576 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 97265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-13T05:46:54.576 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-13T05:46:54.576 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-13T05:46:54.576 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-13T05:46:54.577 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-13T05:46:54.577 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-13T05:46:54.577 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/plip/ 2023-09-13T05:46:54.577 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/plip/plip.ko 2023-09-13T05:46:54.577 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ 2023-09-13T05:46:54.578 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-13T05:46:54.578 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-13T05:46:54.578 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-13T05:46:54.578 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-13T05:46:54.578 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-13T05:46:54.578 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-13T05:46:54.579 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-13T05:46:54.579 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-13T05:46:54.579 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sb1000.ko 2023-09-13T05:46:54.579 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/ 2023-09-13T05:46:54.579 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-13T05:46:54.580 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-13T05:46:54.580 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 64937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-13T05:46:54.580 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/ 2023-09-13T05:46:54.580 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 106025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-13T05:46:54.580 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-13T05:46:54.580 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-13T05:46:54.581 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-13T05:46:54.581 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-13T05:46:54.581 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-13T05:46:54.581 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 88257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-13T05:46:54.581 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/ 2023-09-13T05:46:54.581 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 120497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-13T05:46:54.582 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/ 2023-09-13T05:46:54.582 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 293441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-13T05:46:54.582 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/ 2023-09-13T05:46:54.582 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 143889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-13T05:46:54.582 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ 2023-09-13T05:46:54.583 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-13T05:46:54.583 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/ 2023-09-13T05:46:54.583 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/ 2023-09-13T05:46:54.583 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 264585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-13T05:46:54.583 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 102393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-13T05:46:54.584 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/ 2023-09-13T05:46:54.584 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 133817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-13T05:46:54.584 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-13T05:46:54.584 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 84337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-13T05:46:54.584 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-13T05:46:54.585 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/ 2023-09-13T05:46:54.585 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/ 2023-09-13T05:46:54.585 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-13T05:46:54.585 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-09-13T05:46:54.585 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-09-13T05:46:54.586 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pci-stub.ko 2023-09-13T05:46:54.586 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-13T05:46:54.586 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/ 2023-09-13T05:46:54.586 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-13T05:46:54.586 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 145785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia.ko 2023-09-13T05:46:54.586 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-09-13T05:46:54.587 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-09-13T05:46:54.587 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-13T05:46:54.587 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 112913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-13T05:46:54.587 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/ 2023-09-13T05:46:54.587 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/broadcom/ 2023-09-13T05:46:54.588 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-09-13T05:46:54.588 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/samsung/ 2023-09-13T05:46:54.588 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-09-13T05:46:54.588 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/ 2023-09-13T05:46:54.588 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/ 2023-09-13T05:46:54.589 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 71521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-13T05:46:54.589 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/ 2023-09-13T05:46:54.589 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/ 2023-09-13T05:46:54.589 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-09-13T05:46:54.589 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec.ko 2023-09-13T05:46:54.589 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-09-13T05:46:54.590 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-09-13T05:46:54.590 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-09-13T05:46:54.590 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-09-13T05:46:54.590 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-09-13T05:46:54.590 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/ 2023-09-13T05:46:54.591 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-13T05:46:54.591 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-13T05:46:54.591 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-13T05:46:54.591 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-13T05:46:54.591 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-13T05:46:54.591 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 106873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-13T05:46:54.592 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-13T05:46:54.592 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-13T05:46:54.592 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-13T05:46:54.592 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-13T05:46:54.592 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-13T05:46:54.593 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-13T05:46:54.593 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-09-13T05:46:54.593 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/ 2023-09-13T05:46:54.593 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-13T05:46:54.593 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-09-13T05:46:54.594 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-13T05:46:54.594 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-13T05:46:54.594 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-13T05:46:54.594 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-13T05:46:54.594 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-13T05:46:54.594 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-13T05:46:54.595 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-13T05:46:54.595 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-13T05:46:54.595 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-13T05:46:54.595 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-13T05:46:54.596 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-13T05:46:54.596 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/ 2023-09-13T05:46:54.596 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ 2023-09-13T05:46:54.596 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-09-13T05:46:54.596 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-09-13T05:46:54.597 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-09-13T05:46:54.597 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq24190_charger.ko 2023-09-13T05:46:54.597 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq24735-charger.ko 2023-09-13T05:46:54.597 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-09-13T05:46:54.597 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/da9030_battery.ko 2023-09-13T05:46:54.597 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/da9052-battery.ko 2023-09-13T05:46:54.598 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2760_battery.ko 2023-09-13T05:46:54.598 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2780_battery.ko 2023-09-13T05:46:54.598 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2781_battery.ko 2023-09-13T05:46:54.598 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2782_battery.ko 2023-09-13T05:46:54.599 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/gpio-charger.ko 2023-09-13T05:46:54.599 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/isp1704_charger.ko 2023-09-13T05:46:54.599 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/lp8727_charger.ko 2023-09-13T05:46:54.599 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max14577_charger.ko 2023-09-13T05:46:54.599 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max17040_battery.ko 2023-09-13T05:46:54.599 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max17042_battery.ko 2023-09-13T05:46:54.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max8903_charger.ko 2023-09-13T05:46:54.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max8925_power.ko 2023-09-13T05:46:54.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-09-13T05:46:54.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/sbs-battery.ko 2023-09-13T05:46:54.600 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/test_power.ko 2023-09-13T05:46:54.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/tps65090-charger.ko 2023-09-13T05:46:54.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm831x_backup.ko 2023-09-13T05:46:54.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm831x_power.ko 2023-09-13T05:46:54.601 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm8350_power.ko 2023-09-13T05:46:54.601 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/ 2023-09-13T05:46:54.602 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-13T05:46:54.602 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-13T05:46:54.602 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/ 2023-09-13T05:46:54.602 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/ 2023-09-13T05:46:54.602 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-13T05:46:54.603 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-13T05:46:54.603 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-13T05:46:54.603 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-13T05:46:54.603 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ 2023-09-13T05:46:54.603 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-13T05:46:54.604 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-13T05:46:54.604 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/ 2023-09-13T05:46:54.604 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-09-13T05:46:54.604 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-09-13T05:46:54.604 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-13T05:46:54.605 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-13T05:46:54.605 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9052.ko 2023-09-13T05:46:54.605 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9055.ko 2023-09-13T05:46:54.605 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9063.ko 2023-09-13T05:46:54.605 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-13T05:46:54.606 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 68577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-13T05:46:54.606 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-13T05:46:54.606 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-13T05:46:54.606 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-13T05:46:54.606 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-13T05:46:54.607 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-13T05:46:54.607 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-13T05:46:54.607 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-13T05:46:54.607 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-13T05:46:54.607 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-13T05:46:54.608 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-13T05:46:54.608 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-13T05:46:54.608 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-lp8788.ko 2023-09-13T05:46:54.608 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-13T05:46:54.608 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-13T05:46:54.609 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-13T05:46:54.609 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t86.ko 2023-09-13T05:46:54.609 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-13T05:46:54.609 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8907.ko 2023-09-13T05:46:54.609 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8925.ko 2023-09-13T05:46:54.609 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8997.ko 2023-09-13T05:46:54.610 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8998.ko 2023-09-13T05:46:54.610 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-09-13T05:46:54.610 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-13T05:46:54.610 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-palmas.ko 2023-09-13T05:46:54.610 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-13T05:46:54.611 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-09-13T05:46:54.611 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-13T05:46:54.611 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-13T05:46:54.611 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-13T05:46:54.611 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-13T05:46:54.611 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-09-13T05:46:54.612 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-13T05:46:54.612 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-13T05:46:54.612 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-13T05:46:54.612 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-13T05:46:54.612 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-13T05:46:54.613 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-s35390a.ko 2023-09-13T05:46:54.613 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-13T05:46:54.613 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-09-13T05:46:54.613 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-tps65910.ko 2023-09-13T05:46:54.613 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-wm831x.ko 2023-09-13T05:46:54.614 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-wm8350.ko 2023-09-13T05:46:54.614 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-13T05:46:54.614 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ 2023-09-13T05:46:54.614 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 77617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-13T05:46:54.614 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-13T05:46:54.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-13T05:46:54.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 135169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-13T05:46:54.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-13T05:46:54.615 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/ 2023-09-13T05:46:54.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 272353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-13T05:46:54.615 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 100617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-13T05:46:54.616 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/ 2023-09-13T05:46:54.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 356265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-13T05:46:54.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 295801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-13T05:46:54.616 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic94xx/ 2023-09-13T05:46:54.616 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 189321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-09-13T05:46:54.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-13T05:46:54.617 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/ 2023-09-13T05:46:54.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 106569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-13T05:46:54.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-13T05:46:54.617 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/ 2023-09-13T05:46:54.617 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 246897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-13T05:46:54.618 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/ 2023-09-13T05:46:54.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1172185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-13T05:46:54.618 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/ 2023-09-13T05:46:54.618 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 237169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-13T05:46:54.618 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/ 2023-09-13T05:46:54.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 115393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-13T05:46:54.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-13T05:46:54.619 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/ 2023-09-13T05:46:54.619 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 308889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-13T05:46:54.619 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/ 2023-09-13T05:46:54.620 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-09-13T05:46:54.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 76193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-13T05:46:54.620 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-09-13T05:46:54.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 101449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-13T05:46:54.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 146785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-13T05:46:54.620 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 75529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-13T05:46:54.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-13T05:46:54.621 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/ 2023-09-13T05:46:54.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 212401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-13T05:46:54.621 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-13T05:46:54.621 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/ 2023-09-13T05:46:54.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-13T05:46:54.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 158193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-13T05:46:54.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fdomain.ko 2023-09-13T05:46:54.622 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/ 2023-09-13T05:46:54.622 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 262729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-13T05:46:54.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 201793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-13T05:46:54.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-13T05:46:54.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-13T05:46:54.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/imm.ko 2023-09-13T05:46:54.623 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-13T05:46:54.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 266521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-13T05:46:54.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 101881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-13T05:46:54.624 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/ 2023-09-13T05:46:54.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 317249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-13T05:46:54.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-13T05:46:54.624 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-13T05:46:54.625 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/ 2023-09-13T05:46:54.625 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 314961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-13T05:46:54.625 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 145569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-13T05:46:54.625 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-13T05:46:54.625 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/ 2023-09-13T05:46:54.626 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 217209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-13T05:46:54.626 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/ 2023-09-13T05:46:54.626 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 2192585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-13T05:46:54.716 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/ 2023-09-13T05:46:54.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 73545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-13T05:46:54.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-13T05:46:54.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 310729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-13T05:46:54.717 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 84697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-13T05:46:54.717 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/ 2023-09-13T05:46:54.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 659513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-13T05:46:54.718 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/ 2023-09-13T05:46:54.718 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 119929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-13T05:46:54.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-13T05:46:54.719 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/ 2023-09-13T05:46:54.719 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 81601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-09-13T05:46:54.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-09-13T05:46:54.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-09-13T05:46:54.720 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-09-13T05:46:54.721 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/ 2023-09-13T05:46:54.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 364257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-13T05:46:54.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 123489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-13T05:46:54.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ppa.ko 2023-09-13T05:46:54.721 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-13T05:46:54.722 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/ 2023-09-13T05:46:54.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1860193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-13T05:46:54.722 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-13T05:46:54.722 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/ 2023-09-13T05:46:54.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 558865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-13T05:46:54.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qlogicfas408.ko 2023-09-13T05:46:54.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-13T05:46:54.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 238801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-13T05:46:54.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 173921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-13T05:46:54.723 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 278865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-13T05:46:54.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 97705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-13T05:46:54.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 73881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-13T05:46:54.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-13T05:46:54.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-13T05:46:54.724 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 115849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-13T05:46:54.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-13T05:46:54.725 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/ 2023-09-13T05:46:54.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 162121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-13T05:46:54.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-13T05:46:54.725 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-13T05:46:54.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-13T05:46:54.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/xen-scsifront.ko 2023-09-13T05:46:54.726 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ 2023-09-13T05:46:54.726 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 129417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-13T05:46:54.726 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/ 2023-09-13T05:46:54.727 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/ 2023-09-13T05:46:54.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 739089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-13T05:46:54.727 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/ 2023-09-13T05:46:54.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-13T05:46:54.727 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-13T05:46:54.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-13T05:46:54.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 931721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-13T05:46:54.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-13T05:46:54.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 122545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-13T05:46:54.728 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/ 2023-09-13T05:46:54.728 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 75641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-13T05:46:54.729 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/ 2023-09-13T05:46:54.729 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/ 2023-09-13T05:46:54.729 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-09-13T05:46:54.729 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-13T05:46:54.729 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-13T05:46:54.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-13T05:46:54.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-13T05:46:54.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-13T05:46:54.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-13T05:46:54.730 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-13T05:46:54.731 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-13T05:46:54.731 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-13T05:46:54.731 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-13T05:46:54.731 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-13T05:46:54.731 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-13T05:46:54.732 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-09-13T05:46:54.732 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-13T05:46:54.732 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-13T05:46:54.732 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-13T05:46:54.732 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ 2023-09-13T05:46:54.733 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ 2023-09-13T05:46:54.733 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-13T05:46:54.733 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/moxa.ko 2023-09-13T05:46:54.733 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 50793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/mxser.ko 2023-09-13T05:46:54.733 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 107545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-13T05:46:54.733 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-13T05:46:54.734 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 68137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-13T05:46:54.734 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/ 2023-09-13T05:46:54.734 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/ 2023-09-13T05:46:54.734 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-09-13T05:46:54.734 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-13T05:46:54.735 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-09-13T05:46:54.735 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/altera_uart.ko 2023-09-13T05:46:54.735 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-13T05:46:54.735 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 72193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-09-13T05:46:54.735 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/ 2023-09-13T05:46:54.736 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 103017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-13T05:46:54.736 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/rp2.ko 2023-09-13T05:46:54.736 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-09-13T05:46:54.736 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 100185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-13T05:46:54.736 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/ 2023-09-13T05:46:54.736 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ 2023-09-13T05:46:54.737 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 536809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-13T05:46:54.737 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ 2023-09-13T05:46:54.737 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-13T05:46:54.737 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-09-13T05:46:54.737 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/ 2023-09-13T05:46:54.738 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-13T05:46:54.738 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-13T05:46:54.738 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-13T05:46:54.738 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-09-13T05:46:54.739 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_mf624.ko 2023-09-13T05:46:54.739 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_netx.ko 2023-09-13T05:46:54.739 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-13T05:46:54.739 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-09-13T05:46:54.739 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-13T05:46:54.739 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/ 2023-09-13T05:46:54.740 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/c67x00/ 2023-09-13T05:46:54.740 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 73273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/c67x00/c67x00.ko 2023-09-13T05:46:54.740 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ 2023-09-13T05:46:54.740 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 143785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-09-13T05:46:54.740 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-09-13T05:46:54.741 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-09-13T05:46:54.741 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-09-13T05:46:54.741 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/ 2023-09-13T05:46:54.741 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-13T05:46:54.741 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-13T05:46:54.742 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-13T05:46:54.742 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-13T05:46:54.742 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/common/ 2023-09-13T05:46:54.742 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/common/ulpi.ko 2023-09-13T05:46:54.742 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc2/ 2023-09-13T05:46:54.743 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-09-13T05:46:54.743 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/ 2023-09-13T05:46:54.743 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-09-13T05:46:54.743 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-09-13T05:46:54.743 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 445217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3.ko 2023-09-13T05:46:54.744 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/ 2023-09-13T05:46:54.744 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/ 2023-09-13T05:46:54.744 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-09-13T05:46:54.744 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-09-13T05:46:54.744 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-09-13T05:46:54.745 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-09-13T05:46:54.745 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-09-13T05:46:54.745 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-09-13T05:46:54.745 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 92377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-09-13T05:46:54.745 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-09-13T05:46:54.745 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 122073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-09-13T05:46:54.746 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-09-13T05:46:54.746 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-09-13T05:46:54.746 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-09-13T05:46:54.746 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-09-13T05:46:54.747 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 85841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-09-13T05:46:54.747 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-09-13T05:46:54.747 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-09-13T05:46:54.747 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-09-13T05:46:54.747 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/ 2023-09-13T05:46:54.747 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-09-13T05:46:54.748 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-09-13T05:46:54.748 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-09-13T05:46:54.748 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-09-13T05:46:54.748 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-09-13T05:46:54.748 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-09-13T05:46:54.749 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-09-13T05:46:54.749 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-09-13T05:46:54.749 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-09-13T05:46:54.749 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-09-13T05:46:54.749 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-09-13T05:46:54.749 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-09-13T05:46:54.750 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 62153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-09-13T05:46:54.750 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-09-13T05:46:54.750 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 161321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/libcomposite.ko 2023-09-13T05:46:54.750 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/ 2023-09-13T05:46:54.750 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-09-13T05:46:54.751 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/bdc/ 2023-09-13T05:46:54.751 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 157665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-09-13T05:46:54.751 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-09-13T05:46:54.751 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-09-13T05:46:54.751 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-09-13T05:46:54.752 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-09-13T05:46:54.752 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 76033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-09-13T05:46:54.752 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 75057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-09-13T05:46:54.752 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 73153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-09-13T05:46:54.752 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 65793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-09-13T05:46:54.753 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-09-13T05:46:54.753 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 81489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-09-13T05:46:54.753 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 156057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-09-13T05:46:54.753 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/ 2023-09-13T05:46:54.753 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/bcma-hcd.ko 2023-09-13T05:46:54.753 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 80097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-09-13T05:46:54.754 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 87337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-09-13T05:46:54.754 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-09-13T05:46:54.754 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-13T05:46:54.754 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811_cs.ko 2023-09-13T05:46:54.754 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/ssb-hcd.ko 2023-09-13T05:46:54.755 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-09-13T05:46:54.755 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/ 2023-09-13T05:46:54.755 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-13T05:46:54.755 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-13T05:46:54.755 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ 2023-09-13T05:46:54.756 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-13T05:46:54.756 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-13T05:46:54.756 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-09-13T05:46:54.756 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/cytherm.ko 2023-09-13T05:46:54.756 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ehset.ko 2023-09-13T05:46:54.757 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-13T05:46:54.757 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-13T05:46:54.757 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-13T05:46:54.757 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-13T05:46:54.757 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-13T05:46:54.757 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-13T05:46:54.758 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-13T05:46:54.758 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-13T05:46:54.758 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/lvstest.ko 2023-09-13T05:46:54.758 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/ 2023-09-13T05:46:54.758 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 64841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-13T05:46:54.759 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-13T05:46:54.759 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-13T05:46:54.759 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-13T05:46:54.759 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-13T05:46:54.759 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbtest.ko 2023-09-13T05:46:54.759 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-13T05:46:54.760 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-13T05:46:54.760 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/mon/ 2023-09-13T05:46:54.760 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 73185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/mon/usbmon.ko 2023-09-13T05:46:54.760 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/musb/ 2023-09-13T05:46:54.760 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 301521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-09-13T05:46:54.760 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/ 2023-09-13T05:46:54.761 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-13T05:46:54.761 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-09-13T05:46:54.761 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-09-13T05:46:54.761 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-09-13T05:46:54.761 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ 2023-09-13T05:46:54.761 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-13T05:46:54.762 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-13T05:46:54.762 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-13T05:46:54.762 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-13T05:46:54.762 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 70209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-13T05:46:54.762 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-13T05:46:54.763 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-13T05:46:54.763 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-13T05:46:54.763 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-13T05:46:54.763 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/f81232.ko 2023-09-13T05:46:54.763 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 175145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-13T05:46:54.764 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-13T05:46:54.764 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 137105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-13T05:46:54.764 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 124673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-13T05:46:54.764 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-13T05:46:54.764 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-13T05:46:54.764 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-13T05:46:54.765 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 57937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-13T05:46:54.765 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 107417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-13T05:46:54.765 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-13T05:46:54.765 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-13T05:46:54.765 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-13T05:46:54.765 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-13T05:46:54.766 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/metro-usb.ko 2023-09-13T05:46:54.766 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-13T05:46:54.766 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 78113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-13T05:46:54.766 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mxuport.ko 2023-09-13T05:46:54.766 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-13T05:46:54.767 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-13T05:46:54.767 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-13T05:46:54.767 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 190233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-13T05:46:54.767 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-13T05:46:54.767 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-13T05:46:54.768 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-13T05:46:54.768 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-13T05:46:54.768 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-13T05:46:54.768 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-13T05:46:54.768 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 51297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-13T05:46:54.768 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-13T05:46:54.769 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-13T05:46:54.769 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-13T05:46:54.769 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-13T05:46:54.769 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-13T05:46:54.770 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-13T05:46:54.770 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-13T05:46:54.770 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 125505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usbserial.ko 2023-09-13T05:46:54.770 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-13T05:46:54.771 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-13T05:46:54.771 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-09-13T05:46:54.771 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-13T05:46:54.771 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ 2023-09-13T05:46:54.772 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-13T05:46:54.772 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-13T05:46:54.772 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-13T05:46:54.773 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-13T05:46:54.773 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-13T05:46:54.773 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-13T05:46:54.774 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-13T05:46:54.774 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-13T05:46:54.774 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-13T05:46:54.775 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-13T05:46:54.775 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-13T05:46:54.775 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-13T05:46:54.776 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-13T05:46:54.776 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-13T05:46:54.776 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 180017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-13T05:46:54.777 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/ 2023-09-13T05:46:54.777 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-13T05:46:54.777 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 71345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-13T05:46:54.778 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 105401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-13T05:46:54.778 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/ 2023-09-13T05:46:54.779 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/ 2023-09-13T05:46:54.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 153697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-13T05:46:54.779 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-13T05:46:54.780 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 100569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-13T05:46:54.780 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 75137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-13T05:46:54.780 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/ 2023-09-13T05:46:54.780 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 113889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-13T05:46:54.781 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-13T05:46:54.781 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-13T05:46:54.781 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-13T05:46:54.781 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/ 2023-09-13T05:46:54.781 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/ 2023-09-13T05:46:54.782 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-09-13T05:46:54.782 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-09-13T05:46:54.782 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-09-13T05:46:54.782 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-09-13T05:46:54.782 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-09-13T05:46:54.783 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-13T05:46:54.783 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/as3711_bl.ko 2023-09-13T05:46:54.783 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/bd6107.ko 2023-09-13T05:46:54.783 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/da903x_bl.ko 2023-09-13T05:46:54.783 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/da9052_bl.ko 2023-09-13T05:46:54.783 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-09-13T05:46:54.784 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-09-13T05:46:54.784 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-13T05:46:54.784 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-09-13T05:46:54.784 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-09-13T05:46:54.784 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lv5207lp.ko 2023-09-13T05:46:54.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/max8925_bl.ko 2023-09-13T05:46:54.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/pandora_bl.ko 2023-09-13T05:46:54.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-09-13T05:46:54.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-13T05:46:54.785 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-09-13T05:46:54.786 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/ 2023-09-13T05:46:54.786 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ 2023-09-13T05:46:54.786 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-13T05:46:54.786 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-13T05:46:54.786 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/matrox_w1.ko 2023-09-13T05:46:54.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/w1-gpio.ko 2023-09-13T05:46:54.787 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/ 2023-09-13T05:46:54.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-13T05:46:54.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-13T05:46:54.787 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-13T05:46:54.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-13T05:46:54.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-13T05:46:54.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-13T05:46:54.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-13T05:46:54.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-13T05:46:54.788 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-13T05:46:54.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-13T05:46:54.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-13T05:46:54.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 102657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-13T05:46:54.789 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ 2023-09-13T05:46:54.789 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/acquirewdt.ko 2023-09-13T05:46:54.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/advantechwdt.ko 2023-09-13T05:46:54.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-13T05:46:54.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-13T05:46:54.790 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/cpu5wdt.ko 2023-09-13T05:46:54.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9052_wdt.ko 2023-09-13T05:46:54.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9055_wdt.ko 2023-09-13T05:46:54.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9063_wdt.ko 2023-09-13T05:46:54.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/dw_wdt.ko 2023-09-13T05:46:54.791 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/eurotechwdt.ko 2023-09-13T05:46:54.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-13T05:46:54.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-13T05:46:54.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-13T05:46:54.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-13T05:46:54.792 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-13T05:46:54.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-13T05:46:54.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-13T05:46:54.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-13T05:46:54.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-13T05:46:54.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-13T05:46:54.793 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/kempld_wdt.ko 2023-09-13T05:46:54.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-13T05:46:54.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/mena21_wdt.ko 2023-09-13T05:46:54.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-09-13T05:46:54.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-13T05:46:54.794 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-09-13T05:46:54.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-09-13T05:46:54.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-13T05:46:54.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-13T05:46:54.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/retu_wdt.ko 2023-09-13T05:46:54.795 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-09-13T05:46:54.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-09-13T05:46:54.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-13T05:46:54.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sc1200wdt.ko 2023-09-13T05:46:54.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-13T05:46:54.796 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-09-13T05:46:54.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-13T05:46:54.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-13T05:46:54.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-09-13T05:46:54.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-13T05:46:54.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-13T05:46:54.797 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-13T05:46:54.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-13T05:46:54.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-09-13T05:46:54.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-13T05:46:54.798 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-09-13T05:46:54.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-09-13T05:46:54.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-13T05:46:54.799 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/ 2023-09-13T05:46:54.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-13T05:46:54.799 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-13T05:46:54.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-13T05:46:54.800 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/ 2023-09-13T05:46:54.800 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 176417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-13T05:46:54.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-13T05:46:54.801 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 71321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-scsiback.ko 2023-09-13T05:46:54.801 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/ 2023-09-13T05:46:54.802 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-13T05:46:54.802 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ 2023-09-13T05:46:54.802 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/ 2023-09-13T05:46:54.803 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 165625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-13T05:46:54.803 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/adfs/ 2023-09-13T05:46:54.803 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/adfs/adfs.ko 2023-09-13T05:46:54.804 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/ 2023-09-13T05:46:54.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 162617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-13T05:46:54.804 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/afs/ 2023-09-13T05:46:54.804 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 931937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/afs/kafs.ko 2023-09-13T05:46:54.805 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/autofs/ 2023-09-13T05:46:54.805 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 100937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/autofs/autofs4.ko 2023-09-13T05:46:54.805 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/ 2023-09-13T05:46:54.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 64481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-13T05:46:54.806 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/bfs/ 2023-09-13T05:46:54.806 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/bfs/bfs.ko 2023-09-13T05:46:54.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-13T05:46:54.807 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/ 2023-09-13T05:46:54.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 3474249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-13T05:46:54.807 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/ 2023-09-13T05:46:54.807 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 305745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-13T05:46:54.807 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ 2023-09-13T05:46:54.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1316257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-13T05:46:54.808 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/ 2023-09-13T05:46:54.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 100497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-13T05:46:54.808 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/configfs/ 2023-09-13T05:46:54.808 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 108073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/configfs/configfs.ko 2023-09-13T05:46:54.809 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/ 2023-09-13T05:46:54.809 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 29273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-13T05:46:54.809 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/ 2023-09-13T05:46:54.809 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 633825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-13T05:46:54.809 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/efs/ 2023-09-13T05:46:54.810 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/efs/efs.ko 2023-09-13T05:46:54.810 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/ 2023-09-13T05:46:54.810 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1500513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-13T05:46:54.810 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/ 2023-09-13T05:46:54.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-13T05:46:54.811 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/freevxfs/ 2023-09-13T05:46:54.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/freevxfs/freevxfs.ko 2023-09-13T05:46:54.811 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/ 2023-09-13T05:46:54.811 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 226505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-13T05:46:54.812 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/ 2023-09-13T05:46:54.812 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-13T05:46:54.812 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/ 2023-09-13T05:46:54.812 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1226385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-13T05:46:54.812 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/ 2023-09-13T05:46:54.813 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 141241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-13T05:46:54.813 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/ 2023-09-13T05:46:54.813 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 221553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-13T05:46:54.813 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hpfs/ 2023-09-13T05:46:54.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 193577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hpfs/hpfs.ko 2023-09-13T05:46:54.814 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/ 2023-09-13T05:46:54.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 74393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-13T05:46:54.814 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/ 2023-09-13T05:46:54.814 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 421097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-13T05:46:54.815 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/ 2023-09-13T05:46:54.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 279041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-13T05:46:54.815 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/ 2023-09-13T05:46:54.815 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 87833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-13T05:46:54.815 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/ 2023-09-13T05:46:54.816 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 124697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-13T05:46:54.816 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/ 2023-09-13T05:46:54.816 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/ 2023-09-13T05:46:54.816 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 81521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-13T05:46:54.816 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/ 2023-09-13T05:46:54.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-13T05:46:54.817 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/ 2023-09-13T05:46:54.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 117705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-13T05:46:54.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1053889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-13T05:46:54.817 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv2.ko 2023-09-13T05:46:54.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 119801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-13T05:46:54.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 2041809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-13T05:46:54.818 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/ 2023-09-13T05:46:54.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-13T05:46:54.818 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-13T05:46:54.819 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/ 2023-09-13T05:46:54.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1504929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-13T05:46:54.819 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/ 2023-09-13T05:46:54.819 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 591401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-13T05:46:54.819 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/ 2023-09-13T05:46:54.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-13T05:46:54.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-13T05:46:54.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-13T05:46:54.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-13T05:46:54.820 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-13T05:46:54.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-13T05:46:54.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-13T05:46:54.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-13T05:46:54.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-13T05:46:54.821 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-13T05:46:54.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-13T05:46:54.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_ascii.ko 2023-09-13T05:46:54.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-13T05:46:54.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-13T05:46:54.822 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-13T05:46:54.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-13T05:46:54.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-13T05:46:54.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-13T05:46:54.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-13T05:46:54.823 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-13T05:46:54.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-13T05:46:54.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-13T05:46:54.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-13T05:46:54.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-13T05:46:54.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-13T05:46:54.824 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-13T05:46:54.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-13T05:46:54.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-13T05:46:54.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-13T05:46:54.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-13T05:46:54.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 94137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-13T05:46:54.825 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 142673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-13T05:46:54.826 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 165745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-13T05:46:54.826 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 118121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-13T05:46:54.826 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-13T05:46:54.826 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-13T05:46:54.827 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-13T05:46:54.827 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-13T05:46:54.827 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-13T05:46:54.827 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-13T05:46:54.827 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-13T05:46:54.827 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-13T05:46:54.828 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-13T05:46:54.828 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-13T05:46:54.828 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-13T05:46:54.828 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-13T05:46:54.828 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-13T05:46:54.829 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-13T05:46:54.829 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-13T05:46:54.829 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-13T05:46:54.829 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ntfs/ 2023-09-13T05:46:54.829 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 219361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ntfs/ntfs.ko 2023-09-13T05:46:54.830 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ 2023-09-13T05:46:54.830 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ 2023-09-13T05:46:54.830 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 244177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-13T05:46:54.830 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ 2023-09-13T05:46:54.830 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 440785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-13T05:46:54.831 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ 2023-09-13T05:46:54.831 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-13T05:46:54.831 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 2589873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-13T05:46:54.831 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-13T05:46:54.831 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-13T05:46:54.832 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-13T05:46:54.832 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/omfs/ 2023-09-13T05:46:54.832 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 52569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/omfs/omfs.ko 2023-09-13T05:46:54.832 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/ 2023-09-13T05:46:54.832 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 336889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-13T05:46:54.833 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ 2023-09-13T05:46:54.833 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-13T05:46:54.833 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx4/ 2023-09-13T05:46:54.833 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx4/qnx4.ko 2023-09-13T05:46:54.833 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx6/ 2023-09-13T05:46:54.834 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 46649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx6/qnx6.ko 2023-09-13T05:46:54.834 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/ 2023-09-13T05:46:54.834 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_tree.ko 2023-09-13T05:46:54.834 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_v1.ko 2023-09-13T05:46:54.834 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_v2.ko 2023-09-13T05:46:54.835 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/ 2023-09-13T05:46:54.835 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 530697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-13T05:46:54.835 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/ 2023-09-13T05:46:54.835 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-13T05:46:54.835 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/ 2023-09-13T05:46:54.835 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/ 2023-09-13T05:46:54.836 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 2661209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-13T05:46:54.836 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/ 2023-09-13T05:46:54.836 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-13T05:46:54.836 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-13T05:46:54.836 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/ 2023-09-13T05:46:54.837 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 134313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-13T05:46:54.837 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/ 2023-09-13T05:46:54.837 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-13T05:46:54.837 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/ 2023-09-13T05:46:54.837 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 248049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-13T05:46:54.837 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ 2023-09-13T05:46:54.838 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 160857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-13T05:46:54.838 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/ 2023-09-13T05:46:54.838 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 3998129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-13T05:46:54.838 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/ 2023-09-13T05:46:54.838 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/locking/ 2023-09-13T05:46:54.839 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 74865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/locking/locktorture.ko 2023-09-13T05:46:54.839 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/time/ 2023-09-13T05:46:54.839 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/time/test_udelay.ko 2023-09-13T05:46:54.839 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 58473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-13T05:46:54.839 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ 2023-09-13T05:46:54.840 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 6833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-13T05:46:54.840 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 6529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc7.ko 2023-09-13T05:46:54.840 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-13T05:46:54.840 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/ 2023-09-13T05:46:54.840 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-13T05:46:54.841 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-13T05:46:54.841 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/interval_tree_test.ko 2023-09-13T05:46:54.841 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-13T05:46:54.841 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-13T05:46:54.841 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/ 2023-09-13T05:46:54.842 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-13T05:46:54.842 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-13T05:46:54.842 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/ 2023-09-13T05:46:54.842 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 6617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-13T05:46:54.842 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/memory-notifier-error-inject.ko 2023-09-13T05:46:54.843 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/notifier-error-inject.ko 2023-09-13T05:46:54.843 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/percpu_test.ko 2023-09-13T05:46:54.843 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/pm-notifier-error-inject.ko 2023-09-13T05:46:54.843 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/ 2023-09-13T05:46:54.843 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 143433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-13T05:46:54.844 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/rbtree_test.ko 2023-09-13T05:46:54.844 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/ 2023-09-13T05:46:54.844 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-13T05:46:54.844 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test-kstrtox.ko 2023-09-13T05:46:54.844 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test-string_helpers.ko 2023-09-13T05:46:54.845 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 4760825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_bpf.ko 2023-09-13T05:46:54.845 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_firmware.ko 2023-09-13T05:46:54.845 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 6369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_module.ko 2023-09-13T05:46:54.845 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_user_copy.ko 2023-09-13T05:46:54.845 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-13T05:46:54.845 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-13T05:46:54.846 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-13T05:46:54.846 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/xz/ 2023-09-13T05:46:54.846 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/xz/xz_dec_test.ko 2023-09-13T05:46:54.846 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/ 2023-09-13T05:46:54.846 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-13T05:46:54.847 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ 2023-09-13T05:46:54.847 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/ 2023-09-13T05:46:54.847 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-13T05:46:54.847 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-13T05:46:54.847 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-13T05:46:54.848 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-13T05:46:54.848 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 6985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-13T05:46:54.848 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-13T05:46:54.848 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-13T05:46:54.848 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-13T05:46:54.849 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/ 2023-09-13T05:46:54.849 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-13T05:46:54.849 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-13T05:46:54.849 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-13T05:46:54.849 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-13T05:46:54.849 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-13T05:46:54.850 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/ 2023-09-13T05:46:54.850 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 81017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-13T05:46:54.850 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/ 2023-09-13T05:46:54.850 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 198465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-13T05:46:54.851 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-13T05:46:54.851 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-13T05:46:54.851 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-13T05:46:54.851 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/ 2023-09-13T05:46:54.851 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 652553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-13T05:46:54.851 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/ 2023-09-13T05:46:54.852 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 63825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-13T05:46:54.852 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 772505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-13T05:46:54.852 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ 2023-09-13T05:46:54.852 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-13T05:46:54.853 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-13T05:46:54.853 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-13T05:46:54.853 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-13T05:46:54.854 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-13T05:46:54.854 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-13T05:46:54.854 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-13T05:46:54.855 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-13T05:46:54.855 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-13T05:46:54.855 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-13T05:46:54.855 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-13T05:46:54.856 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-13T05:46:54.856 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-13T05:46:54.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-13T05:46:54.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-13T05:46:54.857 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-13T05:46:54.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-13T05:46:54.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-13T05:46:54.858 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-13T05:46:54.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-13T05:46:54.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 55937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-13T05:46:54.859 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-13T05:46:54.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-13T05:46:54.860 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/ 2023-09-13T05:46:54.860 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1046921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-13T05:46:54.861 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/ 2023-09-13T05:46:54.861 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 124793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-13T05:46:54.861 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/ 2023-09-13T05:46:54.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 194321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-13T05:46:54.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-13T05:46:54.862 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 56945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-13T05:46:54.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 59457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-13T05:46:54.863 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/ 2023-09-13T05:46:54.863 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 390297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-13T05:46:54.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-13T05:46:54.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-13T05:46:54.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-13T05:46:54.864 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-13T05:46:54.864 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/hsr/ 2023-09-13T05:46:54.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 100257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/hsr/hsr.ko 2023-09-13T05:46:54.865 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ 2023-09-13T05:46:54.865 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ 2023-09-13T05:46:54.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 45169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-13T05:46:54.865 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 254601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-13T05:46:54.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-13T05:46:54.866 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ 2023-09-13T05:46:54.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-13T05:46:54.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-13T05:46:54.866 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-13T05:46:54.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-13T05:46:54.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-13T05:46:54.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 60593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-13T05:46:54.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-13T05:46:54.867 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-13T05:46:54.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-13T05:46:54.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-13T05:46:54.868 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ 2023-09-13T05:46:54.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-13T05:46:54.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-13T05:46:54.868 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-13T05:46:54.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-09-13T05:46:54.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-13T05:46:54.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-09-13T05:46:54.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-13T05:46:54.869 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-13T05:46:54.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-13T05:46:54.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-09-13T05:46:54.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-13T05:46:54.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-13T05:46:54.870 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-13T05:46:54.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-13T05:46:54.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-13T05:46:54.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-13T05:46:54.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-13T05:46:54.871 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-13T05:46:54.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-13T05:46:54.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-09-13T05:46:54.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-13T05:46:54.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-13T05:46:54.872 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-13T05:46:54.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-13T05:46:54.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-13T05:46:54.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-13T05:46:54.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-13T05:46:54.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-13T05:46:54.873 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-13T05:46:54.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-13T05:46:54.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-13T05:46:54.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-13T05:46:54.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-13T05:46:54.874 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-13T05:46:54.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-13T05:46:54.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-13T05:46:54.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-13T05:46:54.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-13T05:46:54.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-13T05:46:54.875 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-13T05:46:54.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 41577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-13T05:46:54.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-13T05:46:54.876 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ 2023-09-13T05:46:54.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-13T05:46:54.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-13T05:46:54.876 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-13T05:46:54.877 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 80793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_gre.ko 2023-09-13T05:46:54.877 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 92817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-13T05:46:54.877 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-13T05:46:54.877 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-13T05:46:54.877 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-13T05:46:54.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/mip6.ko 2023-09-13T05:46:54.878 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ 2023-09-13T05:46:54.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 42209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-13T05:46:54.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-09-13T05:46:54.878 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-13T05:46:54.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-13T05:46:54.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-13T05:46:54.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-13T05:46:54.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-13T05:46:54.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-13T05:46:54.879 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-13T05:46:54.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-13T05:46:54.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-13T05:46:54.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-13T05:46:54.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-13T05:46:54.880 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-13T05:46:54.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-13T05:46:54.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-13T05:46:54.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-13T05:46:54.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-13T05:46:54.881 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-13T05:46:54.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-13T05:46:54.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-13T05:46:54.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-13T05:46:54.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-13T05:46:54.882 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-13T05:46:54.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-13T05:46:54.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 73161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-13T05:46:54.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-13T05:46:54.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-13T05:46:54.883 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/ 2023-09-13T05:46:54.883 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 82929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-13T05:46:54.884 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/ 2023-09-13T05:46:54.884 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 125873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-13T05:46:54.884 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-13T05:46:54.884 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 25865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-13T05:46:54.884 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-13T05:46:54.885 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-13T05:46:54.885 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-13T05:46:54.885 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 53153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-13T05:46:54.885 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/lapb/ 2023-09-13T05:46:54.885 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/lapb/lapb.ko 2023-09-13T05:46:54.885 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/ 2023-09-13T05:46:54.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-13T05:46:54.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 267257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc2.ko 2023-09-13T05:46:54.886 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/ 2023-09-13T05:46:54.886 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 291041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-13T05:46:54.887 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/ 2023-09-13T05:46:54.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-13T05:46:54.887 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ 2023-09-13T05:46:54.887 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ 2023-09-13T05:46:54.887 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 119649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-13T05:46:54.888 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-13T05:46:54.888 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-13T05:46:54.888 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-13T05:46:54.888 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 102033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-13T05:46:54.888 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 103121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-13T05:46:54.889 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 104593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-13T05:46:54.889 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 105129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-13T05:46:54.889 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 114393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-13T05:46:54.889 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-13T05:46:54.889 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 111161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-13T05:46:54.890 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 114673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-13T05:46:54.890 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 114329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-13T05:46:54.890 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 113217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-13T05:46:54.890 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 116217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-13T05:46:54.890 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-13T05:46:54.891 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ 2023-09-13T05:46:54.891 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 412889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-13T05:46:54.891 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-13T05:46:54.891 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-13T05:46:54.891 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-13T05:46:54.891 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-13T05:46:54.892 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-13T05:46:54.892 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-13T05:46:54.892 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-13T05:46:54.892 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-13T05:46:54.892 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-13T05:46:54.893 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-13T05:46:54.893 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-13T05:46:54.893 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-13T05:46:54.893 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-13T05:46:54.893 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-13T05:46:54.894 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 408665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-13T05:46:54.894 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-13T05:46:54.894 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-13T05:46:54.897 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-13T05:46:54.897 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 118145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-13T05:46:54.897 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-13T05:46:54.897 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-13T05:46:54.898 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 108393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-13T05:46:54.898 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-13T05:46:54.898 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-13T05:46:54.898 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 66641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-13T05:46:54.899 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-13T05:46:54.899 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-13T05:46:54.899 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-13T05:46:54.899 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 88513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-13T05:46:54.899 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-13T05:46:54.900 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 37129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-13T05:46:54.900 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 95353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-13T05:46:54.900 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-13T05:46:54.900 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-13T05:46:54.900 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-13T05:46:54.900 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-13T05:46:54.901 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-13T05:46:54.901 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 44025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-13T05:46:54.901 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 609257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-13T05:46:54.901 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-13T05:46:54.901 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-13T05:46:54.902 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-09-13T05:46:54.902 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 39905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-13T05:46:54.902 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-13T05:46:54.902 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 49673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-13T05:46:54.902 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-13T05:46:54.903 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-13T05:46:54.903 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 40721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-13T05:46:54.903 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-13T05:46:54.903 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-13T05:46:54.903 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-13T05:46:54.904 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-13T05:46:54.904 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-13T05:46:54.904 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-13T05:46:54.904 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-13T05:46:54.904 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-13T05:46:54.905 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-13T05:46:54.905 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_osf.ko 2023-09-13T05:46:54.905 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-13T05:46:54.905 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-13T05:46:54.905 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-13T05:46:54.906 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-13T05:46:54.906 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-13T05:46:54.906 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_synproxy.ko 2023-09-13T05:46:54.906 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tproxy.ko 2023-09-13T05:46:54.906 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 89329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/x_tables.ko 2023-09-13T05:46:54.907 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-13T05:46:54.907 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-13T05:46:54.907 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-13T05:46:54.907 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-13T05:46:54.907 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 18169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-13T05:46:54.908 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-13T05:46:54.908 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-13T05:46:54.908 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-13T05:46:54.908 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-13T05:46:54.908 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-13T05:46:54.909 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-13T05:46:54.909 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-13T05:46:54.909 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-13T05:46:54.909 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-13T05:46:54.909 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-13T05:46:54.909 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-13T05:46:54.910 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-13T05:46:54.910 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 14337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-13T05:46:54.910 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-13T05:46:54.910 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-13T05:46:54.910 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-13T05:46:54.911 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-13T05:46:54.911 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-13T05:46:54.911 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-13T05:46:54.911 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-13T05:46:54.911 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-13T05:46:54.912 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-13T05:46:54.912 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-13T05:46:54.912 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-13T05:46:54.912 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-13T05:46:54.912 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-13T05:46:54.912 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-13T05:46:54.913 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-13T05:46:54.913 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-13T05:46:54.913 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-13T05:46:54.913 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-13T05:46:54.913 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-13T05:46:54.914 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-13T05:46:54.914 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-13T05:46:54.914 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-13T05:46:54.914 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-13T05:46:54.914 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-13T05:46:54.914 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-13T05:46:54.915 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-13T05:46:54.915 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-13T05:46:54.915 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-13T05:46:54.915 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-13T05:46:54.915 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-13T05:46:54.916 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-13T05:46:54.916 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-13T05:46:54.916 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-13T05:46:54.916 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-13T05:46:54.916 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-13T05:46:54.917 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-13T05:46:54.917 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-13T05:46:54.917 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-13T05:46:54.917 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-13T05:46:54.918 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-13T05:46:54.918 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-13T05:46:54.918 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-13T05:46:54.919 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-13T05:46:54.919 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-13T05:46:54.919 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-13T05:46:54.920 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-13T05:46:54.920 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-13T05:46:54.920 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-13T05:46:54.921 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-13T05:46:54.921 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-13T05:46:54.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 8553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-13T05:46:54.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpudp.ko 2023-09-13T05:46:54.922 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-13T05:46:54.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-13T05:46:54.923 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/ 2023-09-13T05:46:54.923 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-13T05:46:54.924 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/ 2023-09-13T05:46:54.924 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 12425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-13T05:46:54.925 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/ 2023-09-13T05:46:54.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 379545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-13T05:46:54.925 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-13T05:46:54.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-13T05:46:54.926 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 11793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-13T05:46:54.926 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/ 2023-09-13T05:46:54.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-13T05:46:54.927 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/ 2023-09-13T05:46:54.927 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 109961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/phonet.ko 2023-09-13T05:46:54.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 54761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/pn_pep.ko 2023-09-13T05:46:54.928 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/ 2023-09-13T05:46:54.928 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 252889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-13T05:46:54.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 165081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-13T05:46:54.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 67241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-13T05:46:54.929 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rxrpc/ 2023-09-13T05:46:54.929 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 820137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rxrpc/rxrpc.ko 2023-09-13T05:46:54.930 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/ 2023-09-13T05:46:54.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-13T05:46:54.930 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-13T05:46:54.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-13T05:46:54.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 34057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-13T05:46:54.931 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-13T05:46:54.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 43817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-13T05:46:54.932 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-13T05:46:54.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-13T05:46:54.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-13T05:46:54.933 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 36057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-13T05:46:54.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-13T05:46:54.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-13T05:46:54.934 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_cgroup.ko 2023-09-13T05:46:54.935 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-13T05:46:54.935 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-13T05:46:54.935 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 38489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-13T05:46:54.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-13T05:46:54.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-13T05:46:54.936 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 13457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-13T05:46:54.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-13T05:46:54.937 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-13T05:46:54.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-13T05:46:54.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-13T05:46:54.938 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 21649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-13T05:46:54.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-13T05:46:54.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-13T05:46:54.939 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 33609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-13T05:46:54.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq_codel.ko 2023-09-13T05:46:54.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-13T05:46:54.940 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 48409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-13T05:46:54.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-13T05:46:54.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 65793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-13T05:46:54.941 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 16065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-13T05:46:54.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 30273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-13T05:46:54.942 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-13T05:46:54.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-13T05:46:54.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 35601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-13T05:46:54.943 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-13T05:46:54.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-13T05:46:54.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 24729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-13T05:46:54.944 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 47849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-13T05:46:54.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 32953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-13T05:46:54.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 26881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-13T05:46:54.945 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 31425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-13T05:46:54.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 28897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-13T05:46:54.946 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 27729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-13T05:46:54.947 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/ 2023-09-13T05:46:54.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 930369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-13T05:46:54.947 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 19033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-13T05:46:54.948 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/ 2023-09-13T05:46:54.948 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/ 2023-09-13T05:46:54.948 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 335569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-13T05:46:54.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 61833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-13T05:46:54.949 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 1514673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-13T05:46:54.949 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/ 2023-09-13T05:46:54.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 707401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-13T05:46:54.950 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/ 2023-09-13T05:46:54.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-13T05:46:54.950 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 862385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-13T05:46:54.951 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/ 2023-09-13T05:46:54.951 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-13T05:46:54.951 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/ 2023-09-13T05:46:54.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 84841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-13T05:46:54.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 68033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-13T05:46:54.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 95985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-13T05:46:54.952 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 10705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-13T05:46:54.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 17521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-13T05:46:54.953 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/x25/ 2023-09-13T05:46:54.953 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 125097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/x25/x25.ko 2023-09-13T05:46:54.954 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/ 2023-09-13T05:46:54.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 22657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_algo.ko 2023-09-13T05:46:54.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 20705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-13T05:46:54.954 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 102353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_user.ko 2023-09-13T05:46:54.955 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/ 2023-09-13T05:46:54.955 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/ 2023-09-13T05:46:54.955 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 15513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-13T05:46:54.955 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 638591 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-13T05:46:54.955 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 624324 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-13T05:46:54.956 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 7656 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-13T05:46:54.956 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 23361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.alias.bin 2023-09-13T05:46:54.956 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 9821 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-13T05:46:54.956 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 69921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-13T05:46:54.956 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 146449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-13T05:46:54.956 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 232695 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-13T05:46:54.957 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 210 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-13T05:46:54.957 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 72754 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-13T05:46:54.957 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 879 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-13T05:46:54.957 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 252880 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-13T05:46:54.957 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 307898 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-13T05:46:54.958 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/ 2023-09-13T05:46:54.958 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/share/ 2023-09-13T05:46:54.958 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/share/doc/ 2023-09-13T05:46:54.958 INFO:teuthology.orchestra.run.smithi164.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/ 2023-09-13T05:46:54.958 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 175 2023-09-11 01:59 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/changelog.Debian.gz 2023-09-13T05:46:54.958 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r-- root/root 691 2023-09-11 01:59 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/copyright 2023-09-13T05:46:54.959 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:54.960 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:54.960 DEBUG:teuthology.orchestra.run.smithi164:> egrep '(submenu|menuentry.*6.5.0-rc7-gfef64f93da2b).*{' /boot/grub/grub.cfg 2023-09-13T05:46:54.967 INFO:teuthology.orchestra.run.smithi164.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-09-13T05:46:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-gfef64f93da2b-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-09-13T05:46:54.967 INFO:teuthology.orchestra.run.smithi164.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-gfef64f93da2b-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-09-13T05:46:54.968 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-09-13T05:46:54.968 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:54.968 DEBUG:teuthology.orchestra.run.smithi164:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-09-13T05:46:55.010 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi164.front.sepia.ceph.com to complete... 2023-09-13T05:46:55.420 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub' 2023-09-13T05:46:55.421 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-13T05:46:55.448 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2023-09-13T05:46:55.725 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:55.731 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-09-13T05:46:56.080 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-13T05:46:56.085 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-13T05:46:56.129 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-13T05:46:56.132 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-13T05:46:56.320 INFO:teuthology.orchestra.run.smithi164.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-13T05:46:56.321 INFO:teuthology.orchestra.run.smithi164.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-09-13T05:46:56.321 INFO:teuthology.orchestra.run.smithi164.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-13T05:46:56.340 INFO:teuthology.orchestra.run.smithi164.stderr:done 2023-09-13T05:47:18.998 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-09-13T05:47:18.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-09-13T05:47:19.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:47:27.503 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-09-13T05:47:27.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-09-13T05:47:27.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:47:37.498 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-09-13T05:47:45.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-13T05:47:46.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-09-13T05:47:46.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:47:49.565 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-09-13T05:47:54.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-09-13T05:47:54.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:47:58.010 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-13T05:48:01.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-09-13T05:48:01.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:48:10.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-09-13T05:48:10.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:48:19.994 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-09-13T05:48:35.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-09-13T05:48:35.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:48:35.275 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-09-13T05:48:35.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-09-13T05:48:35.851 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-13T05:48:35.851 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-09-13T05:48:35.900 INFO:teuthology.orchestra.run.smithi130.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-13T05:48:35.901 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-13T05:48:35.901 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-13T05:48:35.901 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-09-13T05:48:36.902 DEBUG:teuthology.parallel:result is None 2023-09-13T05:49:10.021 DEBUG:teuthology.orchestra.remote:timed out 2023-09-13T05:49:25.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-09-13T05:49:25.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:49:25.259 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-09-13T05:49:25.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-09-13T05:49:25.988 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-13T05:49:25.988 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2023-09-13T05:49:26.037 INFO:teuthology.orchestra.run.smithi164.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-13T05:49:26.037 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-13T05:49:26.038 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-13T05:49:26.038 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-09-13T05:49:27.039 DEBUG:teuthology.parallel:result is None 2023-09-13T05:49:27.040 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-13T05:49:27.050 INFO:teuthology.task.internal:Creating test directory... 2023-09-13T05:49:27.051 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-13T05:49:27.055 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-13T05:49:27.065 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-13T05:49:27.089 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-13T05:49:27.097 INFO:teuthology.task.internal:Creating archive directory... 2023-09-13T05:49:27.098 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-13T05:49:27.108 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-13T05:49:27.141 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-13T05:49:27.150 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-13T05:49:27.150 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-13T05:49:27.181 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-13T05:49:27.272 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T05:49:27.273 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T05:49:27.293 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T05:49:27.303 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T05:49:27.306 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-13T05:49:27.316 INFO:teuthology.task.internal:Configuring sudo... 2023-09-13T05:49:27.316 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-13T05:49:27.321 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-13T05:49:27.344 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-13T05:49:27.353 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-13T05:49:27.354 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-13T05:49:27.388 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-13T05:49:27.397 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T05:49:27.445 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T05:49:27.497 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T05:49:27.498 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-13T05:49:27.573 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T05:49:27.582 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T05:49:27.634 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T05:49:27.635 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-13T05:49:27.710 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2023-09-13T05:49:27.714 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2023-09-13T05:49:27.855 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-13T05:49:27.863 INFO:teuthology.task.internal:Starting timer... 2023-09-13T05:49:27.863 INFO:teuthology.run_tasks:Running task pcp... 2023-09-13T05:49:27.873 INFO:teuthology.run_tasks:Running task selinux... 2023-09-13T05:49:27.881 DEBUG:teuthology.task.selinux:Excluding smithi130: OS 'ubuntu' does not support SELinux 2023-09-13T05:49:27.882 DEBUG:teuthology.task.selinux:Excluding smithi164: OS 'ubuntu' does not support SELinux 2023-09-13T05:49:27.882 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-13T05:49:27.882 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-09-13T05:49:27.883 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-13T05:49:27.883 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-13T05:49:27.891 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-13T05:49:27.897 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-13T05:49:28.026 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-13T05:49:28.050 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-13T05:49:28.052 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi130.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-13T05:57:56.764 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi130.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2023-09-13T05:57:56.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-09-13T05:57:56.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:57:56.873 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-09-13T05:57:57.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-09-13T05:57:57.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-09-13T05:57:57.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T05:57:57.085 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-09-13T05:57:57.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-09-13T05:57:57.221 INFO:teuthology.run_tasks:Running task clock... 2023-09-13T05:57:57.234 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-13T05:57:57.234 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-13T05:57:57.235 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T05:57:57.239 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-13T05:57:57.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T05:57:57.277 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-09-13T05:57:57.277 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: Command line: ntpd -gq 2023-09-13T05:57:57.277 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: ---------------------------------------------------- 2023-09-13T05:57:57.278 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: ntp-4 is maintained by Network Time Foundation, 2023-09-13T05:57:57.278 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-09-13T05:57:57.278 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: corporation. Support and training for ntp-4 are 2023-09-13T05:57:57.278 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: available at https://www.nwtime.org/support 2023-09-13T05:57:57.278 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: ---------------------------------------------------- 2023-09-13T05:57:57.279 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: proto: precision = 0.041 usec (-24) 2023-09-13T05:57:57.279 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: basedate set to 2022-02-04 2023-09-13T05:57:57.280 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: gps base set to 2022-02-06 (week 2196) 2023-09-13T05:57:57.280 INFO:teuthology.orchestra.run.smithi130.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-13T05:57:57.281 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-13T05:57:57.281 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: restrict ::: KOD does nothing without LIMITED. 2023-09-13T05:57:57.281 INFO:teuthology.orchestra.run.smithi130.stderr:restrict ::: KOD does nothing without LIMITED. 2023-09-13T05:57:57.282 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: Listen and drop on 0 v6wildcard [::]:123 2023-09-13T05:57:57.282 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-09-13T05:57:57.283 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: Listen normally on 2 lo 127.0.0.1:123 2023-09-13T05:57:57.283 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: Listen normally on 3 enp3s0f1 172.21.15.130:123 2023-09-13T05:57:57.283 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: Listen normally on 4 lo [::1]:123 2023-09-13T05:57:57.283 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f37%5]:123 2023-09-13T05:57:57.283 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:57:57 ntpd[27796]: Listening on routing socket on fd #22 for interface updates 2023-09-13T05:57:57.302 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-09-13T05:57:57.302 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: Command line: ntpd -gq 2023-09-13T05:57:57.302 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: ---------------------------------------------------- 2023-09-13T05:57:57.302 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: ntp-4 is maintained by Network Time Foundation, 2023-09-13T05:57:57.303 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-09-13T05:57:57.303 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: corporation. Support and training for ntp-4 are 2023-09-13T05:57:57.303 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: available at https://www.nwtime.org/support 2023-09-13T05:57:57.303 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: ---------------------------------------------------- 2023-09-13T05:57:57.304 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: proto: precision = 0.045 usec (-24) 2023-09-13T05:57:57.304 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: basedate set to 2022-02-04 2023-09-13T05:57:57.304 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: gps base set to 2022-02-06 (week 2196) 2023-09-13T05:57:57.305 INFO:teuthology.orchestra.run.smithi164.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-13T05:57:57.305 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-13T05:57:57.306 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: restrict ::: KOD does nothing without LIMITED. 2023-09-13T05:57:57.306 INFO:teuthology.orchestra.run.smithi164.stderr:restrict ::: KOD does nothing without LIMITED. 2023-09-13T05:57:57.307 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: Listen and drop on 0 v6wildcard [::]:123 2023-09-13T05:57:57.307 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-09-13T05:57:57.307 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: Listen normally on 2 lo 127.0.0.1:123 2023-09-13T05:57:57.308 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: Listen normally on 3 enp3s0f1 172.21.15.164:123 2023-09-13T05:57:57.308 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: Listen normally on 4 lo [::1]:123 2023-09-13T05:57:57.308 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:73f3%5]:123 2023-09-13T05:57:57.308 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:57:57 ntpd[27812]: Listening on routing socket on fd #22 for interface updates 2023-09-13T05:57:58.302 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:57:58 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:57:58.302 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:57:58 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:00.277 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:00 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:00.277 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:00 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:00.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:00.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:00.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:00.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:00.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:00.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:00.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:00.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:00.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:00.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:00.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:00.307 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:00 ntpd[27812]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:01.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:01.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:01.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:01.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:01.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:01.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:01.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:01.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:01.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:01.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:01.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:01.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:01.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:01.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:01.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:01.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:01.282 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:01.282 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:01 ntpd[27796]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:02.303 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:02.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:02.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:02.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:02.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:02.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:02.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:02.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:02.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:02.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:02.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:02.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:02.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:02.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:02.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:02.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:02.307 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:02.307 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:02 ntpd[27812]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:03.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:03.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:03.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:03.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:03.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:03.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:03.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:03.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:03.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:03.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:03.282 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:03.282 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:03.282 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:03.282 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:03.282 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:03.283 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:03.283 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:03.283 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:03 ntpd[27796]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:04.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:04.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:04.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:04.304 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:04.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:04.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:04.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:04.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:04.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:04.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:04.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:04.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:04.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:04.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:04.307 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:04.307 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:04.307 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:04.307 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:04 ntpd[27812]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:05.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:05.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:05.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:05.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:05.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:05.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:05.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:05.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:05.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:05.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:05.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:05.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:05.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:05.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:05.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:05.282 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:05.282 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:05.282 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:05 ntpd[27796]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:06.305 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:06.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:06.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:06.306 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:06.307 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:06.307 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:06.307 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:06.308 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:06.308 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:06.308 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:06.309 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:06.309 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:06.309 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:06.310 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:06.310 INFO:teuthology.orchestra.run.smithi164.stdout:13 Sep 05:58:06 ntpd[27812]: ntpd: time slew +0.000099 s 2023-09-13T05:58:06.311 INFO:teuthology.orchestra.run.smithi164.stdout:ntpd: time slew +0.000099s 2023-09-13T05:58:06.311 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-09-13T05:58:06.312 INFO:teuthology.orchestra.run.smithi164.stderr:13 Sep 05:58:06 ntpd[27812]: can't open /var/log/ntpstats/loopstats.20230913: Permission denied 2023-09-13T05:58:06.399 INFO:teuthology.orchestra.run.smithi164.stdout: remote refid st t when poll reach delay offset jitter 2023-09-13T05:58:06.400 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================== 2023-09-13T05:58:06.400 INFO:teuthology.orchestra.run.smithi164.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-13T05:58:06.400 INFO:teuthology.orchestra.run.smithi164.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-13T05:58:06.401 INFO:teuthology.orchestra.run.smithi164.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-13T05:58:06.401 INFO:teuthology.orchestra.run.smithi164.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-13T05:58:07.278 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:07.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:07.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:07.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:07.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:07.279 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:07.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-13T05:58:07.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: can't open /var/log/ntpstats/rawstats.20230913: Permission denied 2023-09-13T05:58:07.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-13T05:58:07.280 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: can't open /var/log/ntpstats/peerstats.20230913: Permission denied 2023-09-13T05:58:07.281 INFO:teuthology.orchestra.run.smithi130.stdout:13 Sep 05:58:07 ntpd[27796]: ntpd: time slew -0.003165 s 2023-09-13T05:58:07.281 INFO:teuthology.orchestra.run.smithi130.stdout:ntpd: time slew -0.003165s 2023-09-13T05:58:07.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-09-13T05:58:07.281 INFO:teuthology.orchestra.run.smithi130.stderr:13 Sep 05:58:07 ntpd[27796]: can't open /var/log/ntpstats/loopstats.20230913: Permission denied 2023-09-13T05:58:07.392 INFO:teuthology.orchestra.run.smithi130.stdout: remote refid st t when poll reach delay offset jitter 2023-09-13T05:58:07.392 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================== 2023-09-13T05:58:07.393 INFO:teuthology.orchestra.run.smithi130.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-13T05:58:07.393 INFO:teuthology.orchestra.run.smithi130.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-13T05:58:07.393 INFO:teuthology.orchestra.run.smithi130.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-13T05:58:07.393 INFO:teuthology.orchestra.run.smithi130.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-13T05:58:07.394 INFO:teuthology.run_tasks:Running task install... 2023-09-13T05:58:07.408 DEBUG:teuthology.task.install:project ceph 2023-09-13T05:58:07.409 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'}} 2023-09-13T05:58:07.409 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'} 2023-09-13T05:58:07.409 INFO:teuthology.task.install:Using flavor: default 2023-09-13T05:58:07.415 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-13T05:58:07.416 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-13T05:58:07.416 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-key list | grep Ceph 2023-09-13T05:58:07.417 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-key list | grep Ceph 2023-09-13T05:58:07.531 INFO:teuthology.orchestra.run.smithi164.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-09-13T05:58:07.543 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-09-13T05:58:07.585 INFO:teuthology.orchestra.run.smithi164.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-13T05:58:07.585 INFO:teuthology.orchestra.run.smithi164.stdout:uid [ unknown] Ceph.com (release key) 2023-09-13T05:58:07.587 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-09-13T05:58:07.587 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-09-13T05:58:07.588 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T05:58:07.596 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-13T05:58:07.596 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph.com (release key) 2023-09-13T05:58:07.598 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-09-13T05:58:07.598 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-09-13T05:58:07.598 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T05:58:07.737 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default/ 2023-09-13T05:58:07.737 INFO:teuthology.task.install.deb:Package version is 18.0.0-6083-g4a754ac9-1jammy 2023-09-13T05:58:07.813 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default/ 2023-09-13T05:58:07.814 INFO:teuthology.task.install.deb:Package version is 18.0.0-6083-g4a754ac9-1jammy 2023-09-13T05:58:07.905 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T05:58:07.905 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-13T05:58:07.916 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T05:58:07.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-13T05:58:07.925 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get update 2023-09-13T05:58:07.936 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2023-09-13T05:58:08.118 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-13T05:58:08.124 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-13T05:58:08.125 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-13T05:58:08.141 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-13T05:58:08.167 INFO:teuthology.orchestra.run.smithi164.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy InRelease 2023-09-13T05:58:08.172 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy InRelease 2023-09-13T05:58:08.189 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-09-13T05:58:08.193 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-09-13T05:58:08.211 INFO:teuthology.orchestra.run.smithi164.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy Release.gpg 2023-09-13T05:58:08.215 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy Release.gpg 2023-09-13T05:58:08.232 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-09-13T05:58:08.236 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-09-13T05:58:08.244 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-13T05:58:08.265 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,423 B] 2023-09-13T05:58:08.268 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,423 B] 2023-09-13T05:58:08.745 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 28.5 kB in 1s (48.2 kB/s) 2023-09-13T05:58:09.672 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2023-09-13T05:58:09.688 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6083-g4a754ac9-1jammy cephadm=18.0.0-6083-g4a754ac9-1jammy ceph-mds=18.0.0-6083-g4a754ac9-1jammy ceph-mgr=18.0.0-6083-g4a754ac9-1jammy ceph-common=18.0.0-6083-g4a754ac9-1jammy ceph-fuse=18.0.0-6083-g4a754ac9-1jammy ceph-test=18.0.0-6083-g4a754ac9-1jammy ceph-volume=18.0.0-6083-g4a754ac9-1jammy radosgw=18.0.0-6083-g4a754ac9-1jammy python3-rados=18.0.0-6083-g4a754ac9-1jammy python3-rgw=18.0.0-6083-g4a754ac9-1jammy python3-cephfs=18.0.0-6083-g4a754ac9-1jammy python3-rbd=18.0.0-6083-g4a754ac9-1jammy libcephfs2=18.0.0-6083-g4a754ac9-1jammy libcephfs-dev=18.0.0-6083-g4a754ac9-1jammy librados2=18.0.0-6083-g4a754ac9-1jammy librbd1=18.0.0-6083-g4a754ac9-1jammy rbd-fuse=18.0.0-6083-g4a754ac9-1jammy python3-cephfs=18.0.0-6083-g4a754ac9-1jammy cephfs-shell=18.0.0-6083-g4a754ac9-1jammy cephfs-top=18.0.0-6083-g4a754ac9-1jammy cephfs-mirror=18.0.0-6083-g4a754ac9-1jammy 2023-09-13T05:58:09.766 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2023-09-13T05:58:09.929 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2023-09-13T05:58:09.930 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2023-09-13T05:58:10.080 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2023-09-13T05:58:10.081 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-13T05:58:10.081 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-13T05:58:10.081 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-13T05:58:10.082 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-13T05:58:10.084 INFO:teuthology.orchestra.run.smithi164.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-13T05:58:10.084 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-13T05:58:10.084 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2023-09-13T05:58:10.085 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-09-13T05:58:10.085 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-09-13T05:58:10.085 INFO:teuthology.orchestra.run.smithi164.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-13T05:58:10.085 INFO:teuthology.orchestra.run.smithi164.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-09-13T05:58:10.086 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-09-13T05:58:10.086 INFO:teuthology.orchestra.run.smithi164.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-09-13T05:58:10.086 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-09-13T05:58:10.086 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-09-13T05:58:10.087 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-09-13T05:58:10.087 INFO:teuthology.orchestra.run.smithi164.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-09-13T05:58:10.087 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-09-13T05:58:10.087 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-09-13T05:58:10.088 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-09-13T05:58:10.088 INFO:teuthology.orchestra.run.smithi164.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-09-13T05:58:10.088 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-09-13T05:58:10.088 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-09-13T05:58:10.089 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-09-13T05:58:10.089 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-09-13T05:58:10.089 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-09-13T05:58:10.090 INFO:teuthology.orchestra.run.smithi164.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-09-13T05:58:10.090 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-09-13T05:58:10.090 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-09-13T05:58:10.090 INFO:teuthology.orchestra.run.smithi164.stdout: qttranslations5-l10n socat xmlstarlet 2023-09-13T05:58:10.091 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2023-09-13T05:58:10.091 INFO:teuthology.orchestra.run.smithi164.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-09-13T05:58:10.091 INFO:teuthology.orchestra.run.smithi164.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-09-13T05:58:10.092 INFO:teuthology.orchestra.run.smithi164.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-09-13T05:58:10.092 INFO:teuthology.orchestra.run.smithi164.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-09-13T05:58:10.092 INFO:teuthology.orchestra.run.smithi164.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-09-13T05:58:10.092 INFO:teuthology.orchestra.run.smithi164.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-09-13T05:58:10.092 INFO:teuthology.orchestra.run.smithi164.stdout: python3-watchdog 2023-09-13T05:58:10.093 INFO:teuthology.orchestra.run.smithi164.stdout:Recommended packages: 2023-09-13T05:58:10.093 INFO:teuthology.orchestra.run.smithi164.stdout: btrfs-tools 2023-09-13T05:58:10.228 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2023-09-13T05:58:10.229 INFO:teuthology.orchestra.run.smithi164.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-09-13T05:58:10.229 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-09-13T05:58:10.229 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-09-13T05:58:10.230 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-09-13T05:58:10.230 INFO:teuthology.orchestra.run.smithi164.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-13T05:58:10.231 INFO:teuthology.orchestra.run.smithi164.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-09-13T05:58:10.232 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-09-13T05:58:10.232 INFO:teuthology.orchestra.run.smithi164.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-09-13T05:58:10.232 INFO:teuthology.orchestra.run.smithi164.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-09-13T05:58:10.233 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-09-13T05:58:10.233 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-09-13T05:58:10.233 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-09-13T05:58:10.233 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-09-13T05:58:10.234 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-09-13T05:58:10.234 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-09-13T05:58:10.234 INFO:teuthology.orchestra.run.smithi164.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-09-13T05:58:10.234 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-09-13T05:58:10.235 INFO:teuthology.orchestra.run.smithi164.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-09-13T05:58:10.235 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-09-13T05:58:10.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-09-13T05:58:10.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-09-13T05:58:10.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-13T05:58:10.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-09-13T05:58:10.237 INFO:teuthology.orchestra.run.smithi164.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-09-13T05:58:10.237 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-09-13T05:58:10.237 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-09-13T05:58:10.237 INFO:teuthology.orchestra.run.smithi164.stdout: socat xmlstarlet 2023-09-13T05:58:10.424 INFO:teuthology.orchestra.run.smithi164.stdout:0 upgraded, 115 newly installed, 0 to remove and 255 not upgraded. 2023-09-13T05:58:10.425 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 183 MB of archives. 2023-09-13T05:58:10.425 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 822 MB of additional disk space will be used. 2023-09-13T05:58:10.425 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-09-13T05:58:10.451 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6083-g4a754ac9-1jammy [3,438 kB] 2023-09-13T05:58:10.507 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-09-13T05:58:10.552 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-09-13T05:58:10.748 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-09-13T05:58:10.769 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6083-g4a754ac9-1jammy [3,120 kB] 2023-09-13T05:58:10.790 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-09-13T05:58:10.868 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6083-g4a754ac9-1jammy [677 kB] 2023-09-13T05:58:10.869 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-09-13T05:58:10.880 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-09-13T05:58:10.892 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6083-g4a754ac9-1jammy [345 kB] 2023-09-13T05:58:10.903 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6083-g4a754ac9-1jammy [23.0 kB] 2023-09-13T05:58:10.903 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6083-g4a754ac9-1jammy [170 kB] 2023-09-13T05:58:10.909 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6083-g4a754ac9-1jammy [52.4 kB] 2023-09-13T05:58:10.911 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6083-g4a754ac9-1jammy [318 kB] 2023-09-13T05:58:10.923 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6083-g4a754ac9-1jammy [6,112 kB] 2023-09-13T05:58:10.924 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-09-13T05:58:11.091 INFO:teuthology.orchestra.run.smithi164.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-09-13T05:58:11.100 INFO:teuthology.orchestra.run.smithi164.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-09-13T05:58:11.127 INFO:teuthology.orchestra.run.smithi164.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-09-13T05:58:11.143 INFO:teuthology.orchestra.run.smithi164.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6083-g4a754ac9-1jammy [102 kB] 2023-09-13T05:58:11.145 INFO:teuthology.orchestra.run.smithi164.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6083-g4a754ac9-1jammy [428 kB] 2023-09-13T05:58:11.160 INFO:teuthology.orchestra.run.smithi164.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6083-g4a754ac9-1jammy [22.4 MB] 2023-09-13T05:58:11.299 INFO:teuthology.orchestra.run.smithi164.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-09-13T05:58:11.494 INFO:teuthology.orchestra.run.smithi164.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-09-13T05:58:11.859 INFO:teuthology.orchestra.run.smithi164.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-09-13T05:58:11.866 INFO:teuthology.orchestra.run.smithi164.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-09-13T05:58:11.868 INFO:teuthology.orchestra.run.smithi164.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-09-13T05:58:11.880 INFO:teuthology.orchestra.run.smithi164.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-09-13T05:58:11.881 INFO:teuthology.orchestra.run.smithi164.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-09-13T05:58:11.883 INFO:teuthology.orchestra.run.smithi164.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-09-13T05:58:11.884 INFO:teuthology.orchestra.run.smithi164.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-09-13T05:58:11.886 INFO:teuthology.orchestra.run.smithi164.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-09-13T05:58:11.888 INFO:teuthology.orchestra.run.smithi164.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-09-13T05:58:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6083-g4a754ac9-1jammy [6,820 kB] 2023-09-13T05:58:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-09-13T05:58:12.189 INFO:teuthology.orchestra.run.smithi164.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6083-g4a754ac9-1jammy [227 kB] 2023-09-13T05:58:12.194 INFO:teuthology.orchestra.run.smithi164.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6083-g4a754ac9-1jammy [117 kB] 2023-09-13T05:58:12.198 INFO:teuthology.orchestra.run.smithi164.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6083-g4a754ac9-1jammy [1,486 kB] 2023-09-13T05:58:12.248 INFO:teuthology.orchestra.run.smithi164.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6083-g4a754ac9-1jammy [9,849 kB] 2023-09-13T05:58:12.484 INFO:teuthology.orchestra.run.smithi164.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-09-13T05:58:12.493 INFO:teuthology.orchestra.run.smithi164.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-09-13T05:58:12.499 INFO:teuthology.orchestra.run.smithi164.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-09-13T05:58:12.502 INFO:teuthology.orchestra.run.smithi164.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-09-13T05:58:12.520 INFO:teuthology.orchestra.run.smithi164.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-09-13T05:58:12.523 INFO:teuthology.orchestra.run.smithi164.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-09-13T05:58:12.526 INFO:teuthology.orchestra.run.smithi164.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-09-13T05:58:12.568 INFO:teuthology.orchestra.run.smithi164.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-09-13T05:58:12.573 INFO:teuthology.orchestra.run.smithi164.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6083-g4a754ac9-1jammy [31.6 MB] 2023-09-13T05:58:12.582 INFO:teuthology.orchestra.run.smithi164.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-09-13T05:58:12.586 INFO:teuthology.orchestra.run.smithi164.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-09-13T05:58:12.840 INFO:teuthology.orchestra.run.smithi164.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-09-13T05:58:12.922 INFO:teuthology.orchestra.run.smithi164.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-09-13T05:58:13.012 INFO:teuthology.orchestra.run.smithi164.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-09-13T05:58:13.069 INFO:teuthology.orchestra.run.smithi164.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-09-13T05:58:13.191 INFO:teuthology.orchestra.run.smithi164.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-09-13T05:58:13.278 INFO:teuthology.orchestra.run.smithi164.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-09-13T05:58:13.296 INFO:teuthology.orchestra.run.smithi164.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-09-13T05:58:13.325 INFO:teuthology.orchestra.run.smithi164.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-09-13T05:58:13.337 INFO:teuthology.orchestra.run.smithi164.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-09-13T05:58:13.375 INFO:teuthology.orchestra.run.smithi164.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-09-13T05:58:13.383 INFO:teuthology.orchestra.run.smithi164.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-09-13T05:58:13.575 INFO:teuthology.orchestra.run.smithi164.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-09-13T05:58:13.617 INFO:teuthology.orchestra.run.smithi164.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6083-g4a754ac9-1jammy [3,594 B] 2023-09-13T05:58:13.618 INFO:teuthology.orchestra.run.smithi164.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6083-g4a754ac9-1jammy [828 kB] 2023-09-13T05:58:13.633 INFO:teuthology.orchestra.run.smithi164.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6083-g4a754ac9-1jammy [2,138 kB] 2023-09-13T05:58:13.704 INFO:teuthology.orchestra.run.smithi164.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6083-g4a754ac9-1jammy [245 kB] 2023-09-13T05:58:13.713 INFO:teuthology.orchestra.run.smithi164.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6083-g4a754ac9-1jammy [128 kB] 2023-09-13T05:58:13.716 INFO:teuthology.orchestra.run.smithi164.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6083-g4a754ac9-1jammy [1,883 kB] 2023-09-13T05:58:13.778 INFO:teuthology.orchestra.run.smithi164.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6083-g4a754ac9-1jammy [8,615 kB] 2023-09-13T05:58:14.065 INFO:teuthology.orchestra.run.smithi164.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6083-g4a754ac9-1jammy [3,720 B] 2023-09-13T05:58:14.066 INFO:teuthology.orchestra.run.smithi164.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6083-g4a754ac9-1jammy [47.4 MB] 2023-09-13T05:58:14.386 INFO:teuthology.orchestra.run.smithi164.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-09-13T05:58:14.387 INFO:teuthology.orchestra.run.smithi164.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-09-13T05:58:14.389 INFO:teuthology.orchestra.run.smithi164.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-09-13T05:58:14.390 INFO:teuthology.orchestra.run.smithi164.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-09-13T05:58:14.390 INFO:teuthology.orchestra.run.smithi164.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-09-13T05:58:14.391 INFO:teuthology.orchestra.run.smithi164.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-09-13T05:58:14.414 INFO:teuthology.orchestra.run.smithi164.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-09-13T05:58:14.417 INFO:teuthology.orchestra.run.smithi164.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-09-13T05:58:14.417 INFO:teuthology.orchestra.run.smithi164.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-09-13T05:58:14.488 INFO:teuthology.orchestra.run.smithi164.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-09-13T05:58:14.651 INFO:teuthology.orchestra.run.smithi164.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-09-13T05:58:14.908 INFO:teuthology.orchestra.run.smithi164.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-09-13T05:58:14.940 INFO:teuthology.orchestra.run.smithi164.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-09-13T05:58:14.967 INFO:teuthology.orchestra.run.smithi164.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-09-13T05:58:15.021 INFO:teuthology.orchestra.run.smithi164.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-09-13T05:58:15.039 INFO:teuthology.orchestra.run.smithi164.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-09-13T05:58:15.067 INFO:teuthology.orchestra.run.smithi164.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-09-13T05:58:15.174 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-13T05:58:15.191 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-13T05:58:15.194 INFO:teuthology.orchestra.run.smithi164.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-09-13T05:58:15.208 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-13T05:58:15.226 INFO:teuthology.orchestra.run.smithi164.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-09-13T05:58:15.246 INFO:teuthology.orchestra.run.smithi164.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-09-13T05:58:15.253 INFO:teuthology.orchestra.run.smithi164.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-09-13T05:58:15.457 INFO:teuthology.orchestra.run.smithi164.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-09-13T05:58:15.632 INFO:teuthology.orchestra.run.smithi164.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6083-g4a754ac9-1jammy [234 kB] 2023-09-13T05:58:15.635 INFO:teuthology.orchestra.run.smithi164.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6083-g4a754ac9-1jammy [215 kB] 2023-09-13T05:58:15.637 INFO:teuthology.orchestra.run.smithi164.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6083-g4a754ac9-1jammy [23.8 kB] 2023-09-13T05:58:15.637 INFO:teuthology.orchestra.run.smithi164.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6083-g4a754ac9-1jammy [13.2 kB] 2023-09-13T05:58:15.637 INFO:teuthology.orchestra.run.smithi164.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6083-g4a754ac9-1jammy [28.4 kB] 2023-09-13T05:58:15.638 INFO:teuthology.orchestra.run.smithi164.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6083-g4a754ac9-1jammy [12.1 MB] 2023-09-13T05:58:15.681 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 28.5 kB in 8s (3,795 B/s) 2023-09-13T05:58:15.921 INFO:teuthology.orchestra.run.smithi164.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-09-13T05:58:15.924 INFO:teuthology.orchestra.run.smithi164.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-09-13T05:58:16.032 INFO:teuthology.orchestra.run.smithi164.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6083-g4a754ac9-1jammy [80.9 kB] 2023-09-13T05:58:16.051 INFO:teuthology.orchestra.run.smithi164.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-09-13T05:58:16.097 INFO:teuthology.orchestra.run.smithi164.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-09-13T05:58:16.098 INFO:teuthology.orchestra.run.smithi164.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-09-13T05:58:16.104 INFO:teuthology.orchestra.run.smithi164.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-09-13T05:58:16.106 INFO:teuthology.orchestra.run.smithi164.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-09-13T05:58:16.122 INFO:teuthology.orchestra.run.smithi164.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-09-13T05:58:16.129 INFO:teuthology.orchestra.run.smithi164.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-09-13T05:58:16.189 INFO:teuthology.orchestra.run.smithi164.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-09-13T05:58:16.354 INFO:teuthology.orchestra.run.smithi164.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-09-13T05:58:16.520 INFO:teuthology.orchestra.run.smithi164.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-09-13T05:58:16.601 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2023-09-13T05:58:16.618 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6083-g4a754ac9-1jammy cephadm=18.0.0-6083-g4a754ac9-1jammy ceph-mds=18.0.0-6083-g4a754ac9-1jammy ceph-mgr=18.0.0-6083-g4a754ac9-1jammy ceph-common=18.0.0-6083-g4a754ac9-1jammy ceph-fuse=18.0.0-6083-g4a754ac9-1jammy ceph-test=18.0.0-6083-g4a754ac9-1jammy ceph-volume=18.0.0-6083-g4a754ac9-1jammy radosgw=18.0.0-6083-g4a754ac9-1jammy python3-rados=18.0.0-6083-g4a754ac9-1jammy python3-rgw=18.0.0-6083-g4a754ac9-1jammy python3-cephfs=18.0.0-6083-g4a754ac9-1jammy python3-rbd=18.0.0-6083-g4a754ac9-1jammy libcephfs2=18.0.0-6083-g4a754ac9-1jammy libcephfs-dev=18.0.0-6083-g4a754ac9-1jammy librados2=18.0.0-6083-g4a754ac9-1jammy librbd1=18.0.0-6083-g4a754ac9-1jammy rbd-fuse=18.0.0-6083-g4a754ac9-1jammy python3-cephfs=18.0.0-6083-g4a754ac9-1jammy cephfs-shell=18.0.0-6083-g4a754ac9-1jammy cephfs-top=18.0.0-6083-g4a754ac9-1jammy cephfs-mirror=18.0.0-6083-g4a754ac9-1jammy 2023-09-13T05:58:16.695 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2023-09-13T05:58:16.794 INFO:teuthology.orchestra.run.smithi164.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-09-13T05:58:16.819 INFO:teuthology.orchestra.run.smithi164.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-09-13T05:58:16.856 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2023-09-13T05:58:16.857 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2023-09-13T05:58:17.004 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2023-09-13T05:58:17.005 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-13T05:58:17.005 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-13T05:58:17.005 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-13T05:58:17.006 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-13T05:58:17.006 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-13T05:58:17.006 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-13T05:58:17.011 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2023-09-13T05:58:17.011 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-09-13T05:58:17.011 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-09-13T05:58:17.011 INFO:teuthology.orchestra.run.smithi130.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-13T05:58:17.012 INFO:teuthology.orchestra.run.smithi130.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-09-13T05:58:17.012 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-09-13T05:58:17.012 INFO:teuthology.orchestra.run.smithi130.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-09-13T05:58:17.012 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-09-13T05:58:17.013 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-09-13T05:58:17.013 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-09-13T05:58:17.013 INFO:teuthology.orchestra.run.smithi130.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-09-13T05:58:17.013 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-09-13T05:58:17.013 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-09-13T05:58:17.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-09-13T05:58:17.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-09-13T05:58:17.014 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-09-13T05:58:17.015 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-09-13T05:58:17.015 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-09-13T05:58:17.015 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-09-13T05:58:17.015 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-09-13T05:58:17.017 INFO:teuthology.orchestra.run.smithi130.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-09-13T05:58:17.017 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-09-13T05:58:17.017 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-09-13T05:58:17.018 INFO:teuthology.orchestra.run.smithi130.stdout: qttranslations5-l10n socat xmlstarlet 2023-09-13T05:58:17.018 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2023-09-13T05:58:17.018 INFO:teuthology.orchestra.run.smithi130.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-09-13T05:58:17.018 INFO:teuthology.orchestra.run.smithi130.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-09-13T05:58:17.018 INFO:teuthology.orchestra.run.smithi130.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-09-13T05:58:17.019 INFO:teuthology.orchestra.run.smithi130.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-09-13T05:58:17.019 INFO:teuthology.orchestra.run.smithi130.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-09-13T05:58:17.019 INFO:teuthology.orchestra.run.smithi130.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-09-13T05:58:17.019 INFO:teuthology.orchestra.run.smithi130.stdout: python3-watchdog 2023-09-13T05:58:17.019 INFO:teuthology.orchestra.run.smithi130.stdout:Recommended packages: 2023-09-13T05:58:17.020 INFO:teuthology.orchestra.run.smithi130.stdout: btrfs-tools 2023-09-13T05:58:17.149 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2023-09-13T05:58:17.150 INFO:teuthology.orchestra.run.smithi130.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-09-13T05:58:17.150 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-09-13T05:58:17.150 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-09-13T05:58:17.153 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-09-13T05:58:17.153 INFO:teuthology.orchestra.run.smithi130.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-13T05:58:17.153 INFO:teuthology.orchestra.run.smithi130.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-09-13T05:58:17.153 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-09-13T05:58:17.154 INFO:teuthology.orchestra.run.smithi130.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-09-13T05:58:17.154 INFO:teuthology.orchestra.run.smithi130.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-09-13T05:58:17.154 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-09-13T05:58:17.155 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-09-13T05:58:17.155 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-09-13T05:58:17.155 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-09-13T05:58:17.155 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-09-13T05:58:17.156 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-09-13T05:58:17.156 INFO:teuthology.orchestra.run.smithi130.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-09-13T05:58:17.156 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-09-13T05:58:17.156 INFO:teuthology.orchestra.run.smithi130.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-09-13T05:58:17.156 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-09-13T05:58:17.157 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-09-13T05:58:17.157 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-09-13T05:58:17.157 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-13T05:58:17.157 INFO:teuthology.orchestra.run.smithi130.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-09-13T05:58:17.158 INFO:teuthology.orchestra.run.smithi130.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-09-13T05:58:17.158 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-09-13T05:58:17.158 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-09-13T05:58:17.158 INFO:teuthology.orchestra.run.smithi130.stdout: socat xmlstarlet 2023-09-13T05:58:17.216 INFO:teuthology.orchestra.run.smithi130.stdout:0 upgraded, 115 newly installed, 0 to remove and 255 not upgraded. 2023-09-13T05:58:17.216 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 183 MB of archives. 2023-09-13T05:58:17.216 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 822 MB of additional disk space will be used. 2023-09-13T05:58:17.216 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-09-13T05:58:17.233 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-09-13T05:58:17.243 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-09-13T05:58:17.283 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-09-13T05:58:17.292 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-09-13T05:58:17.308 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-09-13T05:58:17.310 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-09-13T05:58:17.320 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-09-13T05:58:17.357 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-09-13T05:58:17.359 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-09-13T05:58:17.366 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-09-13T05:58:17.369 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-09-13T05:58:17.370 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-09-13T05:58:17.371 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6083-g4a754ac9-1jammy [3,438 kB] 2023-09-13T05:58:17.376 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-09-13T05:58:17.377 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-09-13T05:58:17.377 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-09-13T05:58:17.378 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-09-13T05:58:17.379 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-09-13T05:58:17.394 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-09-13T05:58:17.394 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-09-13T05:58:17.394 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-09-13T05:58:17.394 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-09-13T05:58:17.409 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-09-13T05:58:17.411 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-09-13T05:58:17.412 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-09-13T05:58:17.412 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-09-13T05:58:17.413 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-09-13T05:58:17.414 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-09-13T05:58:17.426 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-09-13T05:58:17.427 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-09-13T05:58:17.427 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-09-13T05:58:17.428 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-09-13T05:58:17.443 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-09-13T05:58:17.447 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-09-13T05:58:17.448 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-09-13T05:58:17.448 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-09-13T05:58:17.449 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-09-13T05:58:17.450 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-09-13T05:58:17.460 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-09-13T05:58:17.461 INFO:teuthology.orchestra.run.smithi130.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-09-13T05:58:17.462 INFO:teuthology.orchestra.run.smithi130.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-09-13T05:58:17.463 INFO:teuthology.orchestra.run.smithi130.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-09-13T05:58:17.476 INFO:teuthology.orchestra.run.smithi130.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-09-13T05:58:17.477 INFO:teuthology.orchestra.run.smithi130.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-09-13T05:58:17.480 INFO:teuthology.orchestra.run.smithi130.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-09-13T05:58:17.529 INFO:teuthology.orchestra.run.smithi130.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-09-13T05:58:17.530 INFO:teuthology.orchestra.run.smithi130.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-09-13T05:58:17.531 INFO:teuthology.orchestra.run.smithi130.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-09-13T05:58:17.531 INFO:teuthology.orchestra.run.smithi130.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-09-13T05:58:17.532 INFO:teuthology.orchestra.run.smithi130.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-09-13T05:58:17.533 INFO:teuthology.orchestra.run.smithi130.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-09-13T05:58:17.554 INFO:teuthology.orchestra.run.smithi130.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-09-13T05:58:17.556 INFO:teuthology.orchestra.run.smithi130.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-09-13T05:58:17.557 INFO:teuthology.orchestra.run.smithi130.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-09-13T05:58:17.574 INFO:teuthology.orchestra.run.smithi130.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-09-13T05:58:17.575 INFO:teuthology.orchestra.run.smithi130.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-09-13T05:58:17.575 INFO:teuthology.orchestra.run.smithi130.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-09-13T05:58:17.576 INFO:teuthology.orchestra.run.smithi130.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-09-13T05:58:17.576 INFO:teuthology.orchestra.run.smithi130.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-09-13T05:58:17.577 INFO:teuthology.orchestra.run.smithi130.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-09-13T05:58:17.582 INFO:teuthology.orchestra.run.smithi130.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-09-13T05:58:17.583 INFO:teuthology.orchestra.run.smithi130.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-09-13T05:58:17.587 INFO:teuthology.orchestra.run.smithi130.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-09-13T05:58:17.599 INFO:teuthology.orchestra.run.smithi130.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-09-13T05:58:17.601 INFO:teuthology.orchestra.run.smithi130.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-09-13T05:58:17.601 INFO:teuthology.orchestra.run.smithi130.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-09-13T05:58:17.606 INFO:teuthology.orchestra.run.smithi130.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-09-13T05:58:17.609 INFO:teuthology.orchestra.run.smithi130.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-09-13T05:58:17.609 INFO:teuthology.orchestra.run.smithi130.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-09-13T05:58:17.614 INFO:teuthology.orchestra.run.smithi130.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-09-13T05:58:17.618 INFO:teuthology.orchestra.run.smithi130.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-09-13T05:58:17.618 INFO:teuthology.orchestra.run.smithi130.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-09-13T05:58:17.619 INFO:teuthology.orchestra.run.smithi130.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-09-13T05:58:17.632 INFO:teuthology.orchestra.run.smithi130.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-09-13T05:58:17.634 INFO:teuthology.orchestra.run.smithi130.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-09-13T05:58:17.635 INFO:teuthology.orchestra.run.smithi130.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-09-13T05:58:17.642 INFO:teuthology.orchestra.run.smithi130.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-09-13T05:58:17.643 INFO:teuthology.orchestra.run.smithi130.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-09-13T05:58:17.644 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 183 MB in 7s (26.8 MB/s) 2023-09-13T05:58:17.649 INFO:teuthology.orchestra.run.smithi130.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-09-13T05:58:17.652 INFO:teuthology.orchestra.run.smithi130.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-09-13T05:58:17.652 INFO:teuthology.orchestra.run.smithi130.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-09-13T05:58:17.673 INFO:teuthology.orchestra.run.smithi130.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6083-g4a754ac9-1jammy [3,120 kB] 2023-09-13T05:58:17.788 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyperclip. 2023-09-13T05:58:17.829 INFO:teuthology.orchestra.run.smithi130.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6083-g4a754ac9-1jammy [677 kB] 2023-09-13T05:58:17.835 INFO:teuthology.orchestra.run.smithi130.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6083-g4a754ac9-1jammy [345 kB] 2023-09-13T05:58:17.838 INFO:teuthology.orchestra.run.smithi130.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6083-g4a754ac9-1jammy [23.0 kB] 2023-09-13T05:58:17.839 INFO:teuthology.orchestra.run.smithi130.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6083-g4a754ac9-1jammy [170 kB] 2023-09-13T05:58:17.841 INFO:teuthology.orchestra.run.smithi130.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6083-g4a754ac9-1jammy [52.4 kB] 2023-09-13T05:58:17.841 INFO:teuthology.orchestra.run.smithi130.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6083-g4a754ac9-1jammy [318 kB] 2023-09-13T05:58:17.845 INFO:teuthology.orchestra.run.smithi130.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6083-g4a754ac9-1jammy [6,112 kB] 2023-09-13T05:58:17.856 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132936 files and directories currently installed.) 2023-09-13T05:58:17.860 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-09-13T05:58:17.912 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-09-13T05:58:18.030 INFO:teuthology.orchestra.run.smithi130.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6083-g4a754ac9-1jammy [102 kB] 2023-09-13T05:58:18.031 INFO:teuthology.orchestra.run.smithi130.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6083-g4a754ac9-1jammy [428 kB] 2023-09-13T05:58:18.045 INFO:teuthology.orchestra.run.smithi130.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6083-g4a754ac9-1jammy [22.4 MB] 2023-09-13T05:58:18.198 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-wcwidth. 2023-09-13T05:58:18.211 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-09-13T05:58:18.249 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-13T05:58:18.576 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cmd2. 2023-09-13T05:58:18.589 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-09-13T05:58:18.634 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-09-13T05:58:18.787 INFO:teuthology.orchestra.run.smithi130.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6083-g4a754ac9-1jammy [6,820 kB] 2023-09-13T05:58:18.979 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libfmt8:amd64. 2023-09-13T05:58:18.992 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-09-13T05:58:19.005 INFO:teuthology.orchestra.run.smithi130.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6083-g4a754ac9-1jammy [227 kB] 2023-09-13T05:58:19.010 INFO:teuthology.orchestra.run.smithi130.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6083-g4a754ac9-1jammy [117 kB] 2023-09-13T05:58:19.014 INFO:teuthology.orchestra.run.smithi130.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6083-g4a754ac9-1jammy [1,486 kB] 2023-09-13T05:58:19.063 INFO:teuthology.orchestra.run.smithi130.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6083-g4a754ac9-1jammy [9,849 kB] 2023-09-13T05:58:19.079 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-13T05:58:19.389 INFO:teuthology.orchestra.run.smithi130.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6083-g4a754ac9-1jammy [31.6 MB] 2023-09-13T05:58:19.432 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-09-13T05:58:19.446 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-09-13T05:58:19.491 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-13T05:58:19.802 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-09-13T05:58:19.817 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-09-13T05:58:19.852 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-13T05:58:20.155 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-09-13T05:58:20.170 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-09-13T05:58:20.213 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-13T05:58:20.434 INFO:teuthology.orchestra.run.smithi130.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6083-g4a754ac9-1jammy [3,594 B] 2023-09-13T05:58:20.434 INFO:teuthology.orchestra.run.smithi130.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6083-g4a754ac9-1jammy [828 kB] 2023-09-13T05:58:20.450 INFO:teuthology.orchestra.run.smithi130.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6083-g4a754ac9-1jammy [2,138 kB] 2023-09-13T05:58:20.520 INFO:teuthology.orchestra.run.smithi130.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6083-g4a754ac9-1jammy [245 kB] 2023-09-13T05:58:20.528 INFO:teuthology.orchestra.run.smithi130.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6083-g4a754ac9-1jammy [128 kB] 2023-09-13T05:58:20.532 INFO:teuthology.orchestra.run.smithi130.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6083-g4a754ac9-1jammy [1,883 kB] 2023-09-13T05:58:20.598 INFO:teuthology.orchestra.run.smithi130.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6083-g4a754ac9-1jammy [8,615 kB] 2023-09-13T05:58:20.676 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-09-13T05:58:20.690 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-13T05:58:20.742 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:58:20.880 INFO:teuthology.orchestra.run.smithi130.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6083-g4a754ac9-1jammy [3,720 B] 2023-09-13T05:58:20.880 INFO:teuthology.orchestra.run.smithi130.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6083-g4a754ac9-1jammy [47.4 MB] 2023-09-13T05:58:21.087 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-09-13T05:58:21.101 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-13T05:58:21.173 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:58:21.507 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-09-13T05:58:21.521 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-13T05:58:21.565 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:58:21.876 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-09-13T05:58:21.891 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-09-13T05:58:21.951 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-13T05:58:22.229 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librados2. 2023-09-13T05:58:22.243 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../011-librados2_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:22.287 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librados2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:22.449 INFO:teuthology.orchestra.run.smithi130.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6083-g4a754ac9-1jammy [234 kB] 2023-09-13T05:58:22.451 INFO:teuthology.orchestra.run.smithi130.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6083-g4a754ac9-1jammy [215 kB] 2023-09-13T05:58:22.453 INFO:teuthology.orchestra.run.smithi130.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6083-g4a754ac9-1jammy [23.8 kB] 2023-09-13T05:58:22.453 INFO:teuthology.orchestra.run.smithi130.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6083-g4a754ac9-1jammy [13.2 kB] 2023-09-13T05:58:22.454 INFO:teuthology.orchestra.run.smithi130.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6083-g4a754ac9-1jammy [28.4 kB] 2023-09-13T05:58:22.454 INFO:teuthology.orchestra.run.smithi130.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6083-g4a754ac9-1jammy [12.1 MB] 2023-09-13T05:58:22.740 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librbd1. 2023-09-13T05:58:22.754 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../012-librbd1_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:22.807 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librbd1 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:22.849 INFO:teuthology.orchestra.run.smithi130.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6083-g4a754ac9-1jammy [80.9 kB] 2023-09-13T05:58:23.193 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libcephfs2. 2023-09-13T05:58:23.207 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:23.243 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libcephfs2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:23.419 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 183 MB in 6s (32.1 MB/s) 2023-09-13T05:58:23.504 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rados. 2023-09-13T05:58:23.518 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:23.562 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rados (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:23.581 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyperclip. 2023-09-13T05:58:23.649 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132936 files and directories currently installed.) 2023-09-13T05:58:23.653 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-09-13T05:58:23.696 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-09-13T05:58:23.882 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-09-13T05:58:23.897 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:23.940 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-ceph-argparse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:23.982 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-wcwidth. 2023-09-13T05:58:23.995 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-09-13T05:58:24.024 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-13T05:58:24.217 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cephfs. 2023-09-13T05:58:24.232 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:24.276 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cephfs (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:24.334 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cmd2. 2023-09-13T05:58:24.347 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-09-13T05:58:24.384 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-09-13T05:58:24.537 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-ceph-common. 2023-09-13T05:58:24.551 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:24.587 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-ceph-common (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:24.745 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libfmt8:amd64. 2023-09-13T05:58:24.758 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-09-13T05:58:24.837 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-13T05:58:24.873 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-prettytable. 2023-09-13T05:58:24.887 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-09-13T05:58:24.965 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-09-13T05:58:25.165 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-09-13T05:58:25.178 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-09-13T05:58:25.224 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-13T05:58:25.468 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rbd. 2023-09-13T05:58:25.482 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:25.526 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rbd (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:25.527 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-09-13T05:58:25.540 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-09-13T05:58:25.576 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-13T05:58:25.896 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-09-13T05:58:25.910 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-09-13T05:58:25.954 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-13T05:58:26.054 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-09-13T05:58:26.068 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-09-13T05:58:26.112 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-13T05:58:26.256 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librgw2. 2023-09-13T05:58:26.271 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../021-librgw2_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:26.306 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librgw2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:26.566 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-09-13T05:58:26.581 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-13T05:58:26.633 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:58:26.792 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rgw. 2023-09-13T05:58:26.806 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:26.851 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rgw (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:26.994 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-09-13T05:58:27.008 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-13T05:58:27.044 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:58:27.229 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liboath0:amd64. 2023-09-13T05:58:27.243 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-09-13T05:58:27.287 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-09-13T05:58:27.363 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-09-13T05:58:27.378 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-13T05:58:27.421 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:58:27.557 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libradosstriper1. 2023-09-13T05:58:27.571 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:27.610 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libradosstriper1 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:27.791 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-09-13T05:58:27.806 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-09-13T05:58:27.849 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-13T05:58:28.052 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-common. 2023-09-13T05:58:28.066 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:28.110 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-common (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:28.127 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librados2. 2023-09-13T05:58:28.141 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../011-librados2_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:28.177 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librados2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:28.646 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librbd1. 2023-09-13T05:58:28.660 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../012-librbd1_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:28.704 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librbd1 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:29.123 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs2. 2023-09-13T05:58:29.137 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:29.182 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:29.241 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-base. 2023-09-13T05:58:29.255 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:29.317 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-base (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:29.450 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rados. 2023-09-13T05:58:29.465 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:29.509 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rados (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:29.778 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-09-13T05:58:29.792 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:29.836 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-argparse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:29.970 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-09-13T05:58:29.983 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-09-13T05:58:30.011 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-09-13T05:58:30.097 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cephfs. 2023-09-13T05:58:30.111 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:30.155 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cephfs (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:30.448 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cheroot. 2023-09-13T05:58:30.461 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-09-13T05:58:30.500 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-common. 2023-09-13T05:58:30.506 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-13T05:58:30.514 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:30.566 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-common (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:30.842 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-09-13T05:58:30.857 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-09-13T05:58:30.894 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-prettytable. 2023-09-13T05:58:30.901 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-09-13T05:58:30.908 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-09-13T05:58:30.952 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-09-13T05:58:31.179 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rbd. 2023-09-13T05:58:31.193 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:31.229 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.text. 2023-09-13T05:58:31.229 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rbd (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:31.243 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-09-13T05:58:31.278 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-09-13T05:58:31.523 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-09-13T05:58:31.537 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-09-13T05:58:31.557 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-09-13T05:58:31.572 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-09-13T05:58:31.573 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-09-13T05:58:31.615 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-13T05:58:31.868 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-tempora. 2023-09-13T05:58:31.882 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-09-13T05:58:31.935 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librgw2. 2023-09-13T05:58:31.949 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../021-librgw2_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:31.951 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-09-13T05:58:32.018 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librgw2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:32.254 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-portend. 2023-09-13T05:58:32.268 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-09-13T05:58:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-09-13T05:58:32.478 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rgw. 2023-09-13T05:58:32.492 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:32.537 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rgw (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:32.573 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-09-13T05:58:32.588 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-09-13T05:58:32.623 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-09-13T05:58:32.839 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liboath0:amd64. 2023-09-13T05:58:32.854 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-09-13T05:58:32.889 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-09-13T05:58:32.943 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cherrypy3. 2023-09-13T05:58:32.957 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-09-13T05:58:33.001 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-09-13T05:58:33.159 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libradosstriper1. 2023-09-13T05:58:33.173 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:33.217 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libradosstriper1 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:33.355 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-natsort. 2023-09-13T05:58:33.369 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-09-13T05:58:33.413 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-09-13T05:58:33.645 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-common. 2023-09-13T05:58:33.659 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:33.703 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-common (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:33.749 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-logutils. 2023-09-13T05:58:33.763 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-09-13T05:58:33.816 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-09-13T05:58:34.077 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-markupsafe. 2023-09-13T05:58:34.092 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-09-13T05:58:34.127 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-09-13T05:58:34.463 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-mako. 2023-09-13T05:58:34.478 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-09-13T05:58:34.521 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-13T05:58:34.685 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-base. 2023-09-13T05:58:34.698 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:34.751 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-base (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:34.867 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-simplegeneric. 2023-09-13T05:58:34.886 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-09-13T05:58:34.926 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-09-13T05:58:35.261 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-singledispatch. 2023-09-13T05:58:35.278 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-09-13T05:58:35.321 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-09-13T05:58:35.454 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-09-13T05:58:35.467 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-09-13T05:58:35.504 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-09-13T05:58:35.581 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-webob. 2023-09-13T05:58:35.596 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-09-13T05:58:35.630 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-09-13T05:58:35.798 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cheroot. 2023-09-13T05:58:35.811 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-09-13T05:58:35.848 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-13T05:58:35.967 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-waitress. 2023-09-13T05:58:35.981 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-09-13T05:58:36.028 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-13T05:58:36.320 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-tempita. 2023-09-13T05:58:36.326 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-09-13T05:58:36.334 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-09-13T05:58:36.339 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-09-13T05:58:36.378 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-09-13T05:58:36.384 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-09-13T05:58:36.706 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-paste. 2023-09-13T05:58:36.712 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.text. 2023-09-13T05:58:36.720 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-09-13T05:58:36.726 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-09-13T05:58:36.764 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-09-13T05:58:36.770 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-09-13T05:58:37.061 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-09-13T05:58:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-09-13T05:58:37.075 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-09-13T05:58:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-09-13T05:58:37.111 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-09-13T05:58:37.114 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-09-13T05:58:37.351 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempora. 2023-09-13T05:58:37.365 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-09-13T05:58:37.400 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-09-13T05:58:37.439 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pastedeploy. 2023-09-13T05:58:37.453 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-09-13T05:58:37.497 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-09-13T05:58:37.703 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-portend. 2023-09-13T05:58:37.718 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-09-13T05:58:37.761 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-09-13T05:58:37.783 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-webtest. 2023-09-13T05:58:37.798 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-09-13T05:58:37.841 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-09-13T05:58:38.089 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-09-13T05:58:38.104 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-09-13T05:58:38.147 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-09-13T05:58:38.202 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pecan. 2023-09-13T05:58:38.217 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-09-13T05:58:38.261 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-09-13T05:58:38.450 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cherrypy3. 2023-09-13T05:58:38.465 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-09-13T05:58:38.508 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-09-13T05:58:38.615 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-certifi. 2023-09-13T05:58:38.629 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-09-13T05:58:38.673 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-09-13T05:58:38.845 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-natsort. 2023-09-13T05:58:38.859 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-09-13T05:58:38.903 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-09-13T05:58:38.976 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-idna. 2023-09-13T05:58:38.991 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-09-13T05:58:39.026 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-idna (3.3-1) ... 2023-09-13T05:58:39.214 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-logutils. 2023-09-13T05:58:39.229 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-09-13T05:58:39.272 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-09-13T05:58:39.321 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-urllib3. 2023-09-13T05:58:39.335 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-09-13T05:58:39.379 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-09-13T05:58:39.592 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-markupsafe. 2023-09-13T05:58:39.606 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-09-13T05:58:39.650 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-09-13T05:58:39.732 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-requests. 2023-09-13T05:58:39.747 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-09-13T05:58:39.791 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-13T05:58:39.911 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-mako. 2023-09-13T05:58:39.925 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-09-13T05:58:39.961 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-13T05:58:40.101 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-werkzeug. 2023-09-13T05:58:40.116 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-09-13T05:58:40.151 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-13T05:58:40.264 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplegeneric. 2023-09-13T05:58:40.279 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-09-13T05:58:40.314 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-09-13T05:58:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-09-13T05:58:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:40.616 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-singledispatch. 2023-09-13T05:58:40.631 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-09-13T05:58:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:40.674 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-09-13T05:58:40.961 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webob. 2023-09-13T05:58:40.975 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-09-13T05:58:41.018 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-09-13T05:58:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-09-13T05:58:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-openssl. 2023-09-13T05:58:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-09-13T05:58:41.470 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-09-13T05:58:41.521 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-waitress. 2023-09-13T05:58:41.535 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-09-13T05:58:41.582 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-13T05:58:41.848 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr. 2023-09-13T05:58:41.863 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:41.883 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempita. 2023-09-13T05:58:41.897 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-09-13T05:58:41.906 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:41.941 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-09-13T05:58:42.210 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-paste. 2023-09-13T05:58:42.225 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-09-13T05:58:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mon. 2023-09-13T05:58:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:42.260 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-09-13T05:58:42.451 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mon (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:42.596 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-09-13T05:58:42.610 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-09-13T05:58:42.655 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-09-13T05:58:42.915 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastedeploy. 2023-09-13T05:58:42.930 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-09-13T05:58:42.965 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-09-13T05:58:43.210 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webtest. 2023-09-13T05:58:43.225 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-09-13T05:58:43.268 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-09-13T05:58:43.547 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-osd. 2023-09-13T05:58:43.561 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:43.579 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pecan. 2023-09-13T05:58:43.593 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-09-13T05:58:43.596 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-osd (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:43.637 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-09-13T05:58:44.000 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-certifi. 2023-09-13T05:58:44.013 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-09-13T05:58:44.058 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-09-13T05:58:44.377 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-idna. 2023-09-13T05:58:44.391 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-09-13T05:58:44.436 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-idna (3.3-1) ... 2023-09-13T05:58:44.705 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-urllib3. 2023-09-13T05:58:44.719 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-09-13T05:58:44.765 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-09-13T05:58:44.808 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph. 2023-09-13T05:58:44.822 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../061-ceph_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:44.866 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:45.066 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests. 2023-09-13T05:58:45.080 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-09-13T05:58:45.124 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-13T05:58:45.194 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-fuse. 2023-09-13T05:58:45.208 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:45.252 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-fuse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:45.394 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-werkzeug. 2023-09-13T05:58:45.408 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-09-13T05:58:45.444 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-13T05:58:45.647 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mds. 2023-09-13T05:58:45.662 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:45.705 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mds (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:45.738 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-09-13T05:58:45.752 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:45.796 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:46.083 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephadm. 2023-09-13T05:58:46.098 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../064-cephadm_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:46.133 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephadm (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:46.168 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-09-13T05:58:46.183 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:46.242 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:46.411 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-asyncssh. 2023-09-13T05:58:46.426 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-09-13T05:58:46.469 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-09-13T05:58:46.495 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-openssl. 2023-09-13T05:58:46.510 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-09-13T05:58:46.545 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-09-13T05:58:46.755 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-babel-localedata. 2023-09-13T05:58:46.770 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-09-13T05:58:46.839 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-13T05:58:46.881 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr. 2023-09-13T05:58:46.896 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:46.939 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:47.351 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mon. 2023-09-13T05:58:47.365 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:47.409 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mon (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:47.818 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-babel. 2023-09-13T05:58:47.832 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-09-13T05:58:47.885 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-09-13T05:58:48.170 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-osd. 2023-09-13T05:58:48.185 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:48.188 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jinja2. 2023-09-13T05:58:48.202 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-09-13T05:58:48.229 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-osd (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:48.246 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-09-13T05:58:48.608 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-09-13T05:58:48.622 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:48.666 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:48.986 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-bcrypt. 2023-09-13T05:58:49.000 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-09-13T05:58:49.044 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-09-13T05:58:49.364 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-repoze.lru. 2023-09-13T05:58:49.378 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-09-13T05:58:49.422 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-09-13T05:58:49.449 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph. 2023-09-13T05:58:49.463 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../061-ceph_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:49.498 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:49.725 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-routes. 2023-09-13T05:58:49.739 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-09-13T05:58:49.783 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-09-13T05:58:49.784 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-fuse. 2023-09-13T05:58:49.798 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:49.842 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-fuse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:50.145 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-09-13T05:58:50.160 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:50.203 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:50.220 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mds. 2023-09-13T05:58:50.235 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:50.279 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mds (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:50.556 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-09-13T05:58:50.571 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-09-13T05:58:50.640 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-13T05:58:50.648 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephadm. 2023-09-13T05:58:50.662 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../064-cephadm_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:50.707 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephadm (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:50.959 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-asyncssh. 2023-09-13T05:58:50.973 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-09-13T05:58:51.009 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-09-13T05:58:51.110 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-joblib. 2023-09-13T05:58:51.124 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-09-13T05:58:51.168 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-09-13T05:58:51.530 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-09-13T05:58:51.544 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-09-13T05:58:51.588 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-09-13T05:58:51.858 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-sklearn. 2023-09-13T05:58:51.872 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-09-13T05:58:51.916 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-13T05:58:52.137 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-babel-localedata. 2023-09-13T05:58:52.151 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-09-13T05:58:52.195 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-13T05:58:52.583 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-09-13T05:58:52.596 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:52.641 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:53.152 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-babel. 2023-09-13T05:58:53.165 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-09-13T05:58:53.210 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-09-13T05:58:53.546 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jinja2. 2023-09-13T05:58:53.559 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-09-13T05:58:53.604 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-09-13T05:58:53.644 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cachetools. 2023-09-13T05:58:53.659 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-09-13T05:58:53.702 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-09-13T05:58:53.933 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-09-13T05:58:53.946 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:53.972 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyasn1. 2023-09-13T05:58:53.986 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-09-13T05:58:53.991 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:54.021 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-09-13T05:58:54.291 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-09-13T05:58:54.306 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-09-13T05:58:54.328 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-bcrypt. 2023-09-13T05:58:54.341 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-09-13T05:58:54.371 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-09-13T05:58:54.386 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-09-13T05:58:54.669 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rsa. 2023-09-13T05:58:54.684 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-09-13T05:58:54.688 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-repoze.lru. 2023-09-13T05:58:54.703 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-09-13T05:58:54.735 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rsa (4.8-1) ... 2023-09-13T05:58:54.747 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-09-13T05:58:55.058 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-routes. 2023-09-13T05:58:55.072 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-09-13T05:58:55.117 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-09-13T05:58:55.158 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-google-auth. 2023-09-13T05:58:55.172 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-09-13T05:58:55.215 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-09-13T05:58:55.445 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-09-13T05:58:55.459 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:55.493 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-09-13T05:58:55.503 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:55.508 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-09-13T05:58:55.543 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-13T05:58:55.838 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-websocket. 2023-09-13T05:58:55.853 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-09-13T05:58:55.906 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-09-13T05:58:55.920 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-09-13T05:58:55.965 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-13T05:58:56.096 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-09-13T05:58:56.375 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-kubernetes. 2023-09-13T05:58:56.390 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-09-13T05:58:56.433 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-13T05:58:56.511 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-joblib. 2023-09-13T05:58:56.524 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-09-13T05:58:56.569 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-09-13T05:58:56.914 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-09-13T05:58:56.927 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-09-13T05:58:56.981 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-09-13T05:58:57.064 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-09-13T05:58:57.078 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:57.122 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:57.284 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn. 2023-09-13T05:58:57.297 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-09-13T05:58:57.342 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-13T05:58:57.466 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libonig5:amd64. 2023-09-13T05:58:57.480 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-09-13T05:58:57.525 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-13T05:58:57.828 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libjq1:amd64. 2023-09-13T05:58:57.842 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-09-13T05:58:57.886 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-13T05:58:58.051 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-09-13T05:58:58.064 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:58:58.108 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:58.147 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package jq. 2023-09-13T05:58:58.162 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-09-13T05:58:58.214 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-09-13T05:58:58.466 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package socat. 2023-09-13T05:58:58.481 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-09-13T05:58:58.525 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-09-13T05:58:59.003 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cachetools. 2023-09-13T05:58:59.017 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-09-13T05:58:59.019 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package xmlstarlet. 2023-09-13T05:58:59.035 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-09-13T05:58:59.061 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-09-13T05:58:59.069 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-09-13T05:58:59.364 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1. 2023-09-13T05:58:59.379 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-09-13T05:58:59.390 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-test. 2023-09-13T05:58:59.404 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:58:59.439 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-09-13T05:58:59.448 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-test (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:58:59.776 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-09-13T05:58:59.791 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-09-13T05:58:59.834 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-09-13T05:59:00.145 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rsa. 2023-09-13T05:59:00.159 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-09-13T05:59:00.203 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rsa (4.8-1) ... 2023-09-13T05:59:00.592 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-google-auth. 2023-09-13T05:59:00.606 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-09-13T05:59:00.650 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-09-13T05:59:00.953 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-09-13T05:59:00.968 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-09-13T05:59:01.012 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-13T05:59:01.277 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-volume. 2023-09-13T05:59:01.292 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:59:01.323 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-websocket. 2023-09-13T05:59:01.338 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-09-13T05:59:01.343 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-volume (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:01.381 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-09-13T05:59:01.749 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephfs-mirror. 2023-09-13T05:59:01.764 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:59:01.815 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephfs-mirror (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:01.818 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-kubernetes. 2023-09-13T05:59:01.834 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-09-13T05:59:01.876 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-13T05:59:02.218 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-colorama. 2023-09-13T05:59:02.234 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-09-13T05:59:02.285 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-09-13T05:59:02.521 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephfs-shell. 2023-09-13T05:59:02.536 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:59:02.579 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephfs-shell (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:02.706 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-09-13T05:59:02.720 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:59:02.764 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:02.823 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephfs-top. 2023-09-13T05:59:02.838 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:59:02.873 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephfs-top (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:03.051 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libonig5:amd64. 2023-09-13T05:59:03.064 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-09-13T05:59:03.109 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-13T05:59:03.118 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libcephfs-dev. 2023-09-13T05:59:03.133 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:59:03.176 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libcephfs-dev (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:03.437 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjq1:amd64. 2023-09-13T05:59:03.451 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-09-13T05:59:03.495 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-13T05:59:03.579 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package nvme-cli. 2023-09-13T05:59:03.594 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-09-13T05:59:03.637 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-09-13T05:59:03.739 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package jq. 2023-09-13T05:59:03.753 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-09-13T05:59:03.798 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-09-13T05:59:03.984 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-09-13T05:59:03.998 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-09-13T05:59:04.042 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-09-13T05:59:04.050 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package socat. 2023-09-13T05:59:04.064 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-09-13T05:59:04.100 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-09-13T05:59:04.403 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package xmlstarlet. 2023-09-13T05:59:04.417 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-09-13T05:59:04.445 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-iniconfig. 2023-09-13T05:59:04.459 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-09-13T05:59:04.461 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-09-13T05:59:04.503 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-09-13T05:59:04.782 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-test. 2023-09-13T05:59:04.796 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:59:04.814 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pastescript. 2023-09-13T05:59:04.829 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-09-13T05:59:04.841 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-test (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:04.872 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-09-13T05:59:05.217 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pluggy. 2023-09-13T05:59:05.232 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-09-13T05:59:05.275 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-09-13T05:59:05.604 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-psutil. 2023-09-13T05:59:05.619 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-09-13T05:59:05.662 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-09-13T05:59:06.015 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-py. 2023-09-13T05:59:06.030 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-09-13T05:59:06.073 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-py (1.10.0-1) ... 2023-09-13T05:59:06.620 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-volume. 2023-09-13T05:59:06.635 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:59:06.651 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pygments. 2023-09-13T05:59:06.666 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-09-13T05:59:06.678 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-volume (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-09-13T05:59:07.099 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephfs-mirror. 2023-09-13T05:59:07.114 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:59:07.158 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephfs-mirror (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:07.171 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyinotify. 2023-09-13T05:59:07.186 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-09-13T05:59:07.229 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-09-13T05:59:07.411 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-colorama. 2023-09-13T05:59:07.426 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-09-13T05:59:07.469 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-09-13T05:59:07.515 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-toml. 2023-09-13T05:59:07.529 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-09-13T05:59:07.565 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-09-13T05:59:07.705 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephfs-shell. 2023-09-13T05:59:07.720 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:59:07.755 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephfs-shell (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:07.851 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pytest. 2023-09-13T05:59:07.866 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-09-13T05:59:07.909 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-09-13T05:59:07.991 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephfs-top. 2023-09-13T05:59:08.006 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6083-g4a754ac9-1jammy_all.deb ... 2023-09-13T05:59:08.049 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephfs-top (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:08.238 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-simplejson. 2023-09-13T05:59:08.253 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-09-13T05:59:08.288 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-09-13T05:59:08.302 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs-dev. 2023-09-13T05:59:08.317 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:59:08.360 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs-dev (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:08.541 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-09-13T05:59:08.555 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-09-13T05:59:08.590 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-09-13T05:59:08.705 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package nvme-cli. 2023-09-13T05:59:08.721 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-09-13T05:59:08.755 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-09-13T05:59:09.068 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-09-13T05:59:09.083 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-09-13T05:59:09.126 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-09-13T05:59:09.286 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package radosgw. 2023-09-13T05:59:09.299 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../113-radosgw_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:59:09.344 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking radosgw (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:09.529 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-iniconfig. 2023-09-13T05:59:09.543 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-09-13T05:59:09.579 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-09-13T05:59:09.857 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastescript. 2023-09-13T05:59:09.871 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-09-13T05:59:09.935 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-09-13T05:59:09.947 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package rbd-fuse. 2023-09-13T05:59:09.961 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:59:10.005 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking rbd-fuse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:10.269 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pluggy. 2023-09-13T05:59:10.280 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-09-13T05:59:10.283 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-09-13T05:59:10.327 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-09-13T05:59:10.552 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-13T05:59:10.613 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-psutil. 2023-09-13T05:59:10.628 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-09-13T05:59:10.671 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-09-13T05:59:10.677 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-09-13T05:59:10.923 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-09-13T05:59:11.016 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-py. 2023-09-13T05:59:11.031 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-09-13T05:59:11.065 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-py (1.10.0-1) ... 2023-09-13T05:59:11.329 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-09-13T05:59:11.335 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pygments. 2023-09-13T05:59:11.350 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-09-13T05:59:11.385 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-09-13T05:59:11.831 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyinotify. 2023-09-13T05:59:11.845 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-09-13T05:59:11.889 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-09-13T05:59:11.953 INFO:teuthology.orchestra.run.smithi164.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-09-13T05:59:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-09-13T05:59:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephadm (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:12.200 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-toml. 2023-09-13T05:59:12.214 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-09-13T05:59:12.258 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-09-13T05:59:12.558 INFO:teuthology.orchestra.run.smithi164.stdout:Adding system user cephadm....done 2023-09-13T05:59:12.561 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pytest. 2023-09-13T05:59:12.575 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-09-13T05:59:12.619 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-09-13T05:59:12.694 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-13T05:59:12.998 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplejson. 2023-09-13T05:59:13.012 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-09-13T05:59:13.012 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-09-13T05:59:13.056 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-09-13T05:59:13.272 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-09-13T05:59:13.325 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-09-13T05:59:13.339 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-09-13T05:59:13.383 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-09-13T05:59:13.389 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-09-13T05:59:13.631 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-09-13T05:59:13.899 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-09-13T05:59:14.025 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-py (1.10.0-1) ... 2023-09-13T05:59:14.171 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package radosgw. 2023-09-13T05:59:14.184 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../113-radosgw_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:59:14.229 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking radosgw (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:14.344 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-09-13T05:59:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-09-13T05:59:14.807 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package rbd-fuse. 2023-09-13T05:59:14.821 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6083-g4a754ac9-1jammy_amd64.deb ... 2023-09-13T05:59:14.856 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking rbd-fuse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:14.989 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-09-13T05:59:15.140 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-09-13T05:59:15.273 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-09-13T05:59:15.395 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-13T05:59:15.521 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-09-13T05:59:15.549 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-09-13T05:59:15.781 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-09-13T05:59:15.817 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-09-13T05:59:16.197 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-09-13T05:59:16.226 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-09-13T05:59:16.494 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-ceph-argparse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:16.803 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-13T05:59:16.807 INFO:teuthology.orchestra.run.smithi130.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-09-13T05:59:16.861 INFO:teuthology.orchestra.run.smithi130.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-09-13T05:59:16.904 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-09-13T05:59:16.914 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephadm (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:17.147 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-09-13T05:59:17.406 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-13T05:59:17.426 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user cephadm....done 2023-09-13T05:59:17.532 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-09-13T05:59:17.604 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-13T05:59:17.909 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-13T05:59:17.980 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-09-13T05:59:18.034 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-09-13T05:59:18.240 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-09-13T05:59:18.336 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-09-13T05:59:18.366 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-09-13T05:59:18.606 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-09-13T05:59:18.625 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-09-13T05:59:18.902 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-09-13T05:59:18.915 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-09-13T05:59:19.045 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-py (1.10.0-1) ... 2023-09-13T05:59:19.355 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-09-13T05:59:19.625 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-09-13T05:59:19.723 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-09-13T05:59:19.893 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-09-13T05:59:19.990 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-09-13T05:59:20.019 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-09-13T05:59:20.145 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-13T05:59:20.250 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-09-13T05:59:20.454 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-09-13T05:59:20.526 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-09-13T05:59:20.769 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-09-13T05:59:20.847 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-09-13T05:59:21.090 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-09-13T05:59:21.129 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-09-13T05:59:21.396 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-argparse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:21.483 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-13T05:59:21.664 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-13T05:59:21.785 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-09-13T05:59:21.789 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-09-13T05:59:22.057 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-09-13T05:59:22.269 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-13T05:59:22.317 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-13T05:59:22.460 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-09-13T05:59:22.645 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-09-13T05:59:22.819 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-13T05:59:22.905 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-09-13T05:59:22.945 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-09-13T05:59:23.031 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-ceph-common (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:23.221 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-09-13T05:59:23.399 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-idna (3.3-1) ... 2023-09-13T05:59:23.506 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-09-13T05:59:23.741 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-13T05:59:23.816 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-09-13T05:59:24.501 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-09-13T05:59:24.768 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-09-13T05:59:24.886 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-09-13T05:59:25.006 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:59:25.037 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-13T05:59:25.114 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-toml (0.10.2-1) ... 2023-09-13T05:59:25.346 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-09-13T05:59:25.391 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-13T05:59:25.517 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-09-13T05:59:25.668 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-09-13T05:59:25.773 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-09-13T05:59:25.977 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-09-13T05:59:26.032 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-09-13T05:59:26.220 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-09-13T05:59:26.417 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-13T05:59:26.471 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:59:26.597 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-13T05:59:26.723 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-09-13T05:59:26.743 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-09-13T05:59:27.041 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-09-13T05:59:27.061 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-13T05:59:27.350 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-09-13T05:59:27.412 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-09-13T05:59:27.626 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-09-13T05:59:27.663 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-09-13T05:59:27.789 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-common (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:27.894 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-09-13T05:59:28.090 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-idna (3.3-1) ... 2023-09-13T05:59:28.162 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-09-13T05:59:28.430 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-13T05:59:28.433 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-13T05:59:28.556 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-09-13T05:59:28.874 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-13T05:59:29.000 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-13T05:59:29.301 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-09-13T05:59:29.635 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-09-13T05:59:29.664 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:59:29.798 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-toml (0.10.2-1) ... 2023-09-13T05:59:29.903 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-09-13T05:59:30.066 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-13T05:59:30.200 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-09-13T05:59:30.318 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-09-13T05:59:30.326 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-09-13T05:59:30.581 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-13T05:59:30.628 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-09-13T05:59:30.707 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-09-13T05:59:30.904 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-09-13T05:59:31.100 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-09-13T05:59:31.188 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:59:31.289 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-13T05:59:31.376 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-portend (3.0.0-1) ... 2023-09-13T05:59:31.415 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-09-13T05:59:31.660 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:59:31.733 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-09-13T05:59:31.786 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-09-13T05:59:32.001 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-09-13T05:59:32.113 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-09-13T05:59:32.261 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-09-13T05:59:32.422 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-13T05:59:32.528 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-09-13T05:59:32.690 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-09-13T05:59:32.787 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-09-13T05:59:32.815 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rsa (4.8-1) ... 2023-09-13T05:59:33.100 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-09-13T05:59:33.113 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-13T05:59:33.298 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-09-13T05:59:33.401 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-13T05:59:33.582 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-13T05:59:33.677 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-09-13T05:59:33.708 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-13T05:59:34.034 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-09-13T05:59:34.070 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-09-13T05:59:34.328 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-09-13T05:59:34.407 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-09-13T05:59:34.595 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-09-13T05:59:34.724 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-13T05:59:34.850 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librados2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:34.976 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librgw2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:35.011 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-09-13T05:59:35.178 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:35.256 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-13T05:59:35.313 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libcephfs2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:35.382 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-09-13T05:59:35.456 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libradosstriper1 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:35.557 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-09-13T05:59:35.775 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-09-13T05:59:35.850 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librbd1 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:35.976 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-modules-core (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:36.043 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-portend (3.0.0-1) ... 2023-09-13T05:59:36.102 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-fuse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:36.294 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-13T05:59:36.346 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-13T05:59:36.346 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-13T05:59:36.420 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-09-13T05:59:36.738 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-09-13T05:59:37.012 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libcephfs-dev (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-13T05:59:37.171 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rados (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:37.297 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephfs-top (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:37.315 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-09-13T05:59:37.432 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-13T05:59:37.441 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rsa (4.8-1) ... 2023-09-13T05:59:37.717 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-09-13T05:59:37.977 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-13T05:59:38.253 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-09-13T05:59:38.621 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-09-13T05:59:38.737 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rbd (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:38.846 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up rbd-fuse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:38.922 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-09-13T05:59:38.972 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rgw (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:39.099 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cephfs (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:39.250 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephfs-shell (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:39.274 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-13T05:59:39.376 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-common (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:39.402 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librados2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:39.520 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librgw2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:39.732 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:39.862 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs2 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:39.913 INFO:teuthology.orchestra.run.smithi164.stdout:Adding group ceph....done 2023-09-13T05:59:39.984 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libradosstriper1 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:40.152 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-09-13T05:59:40.305 INFO:teuthology.orchestra.run.smithi164.stdout:Adding system user ceph....done 2023-09-13T05:59:40.445 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librbd1 (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:Setting system user ceph properties....done 2023-09-13T05:59:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-09-13T05:59:40.571 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-modules-core (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-09-13T05:59:40.697 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-fuse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:40.906 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-13T05:59:40.906 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-13T05:59:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-09-13T05:59:41.548 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs-dev (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:41.674 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rados (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:41.735 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephfs-mirror (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:41.800 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephfs-top (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:41.926 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-13T05:59:41.944 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-13T05:59:41.944 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-13T05:59:42.553 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-test (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:42.679 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up radosgw (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:42.942 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-13T05:59:42.943 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-13T05:59:43.265 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rbd (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:43.391 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up rbd-fuse (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:43.492 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rgw (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:43.618 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cephfs (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:43.744 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephfs-shell (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:43.870 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-common (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:43.914 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-base (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:44.269 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-09-13T05:59:44.415 INFO:teuthology.orchestra.run.smithi130.stdout:Adding group ceph....done 2023-09-13T05:59:44.782 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user ceph....done 2023-09-13T05:59:44.952 INFO:teuthology.orchestra.run.smithi130.stdout:Setting system user ceph properties....done 2023-09-13T05:59:44.969 INFO:teuthology.orchestra.run.smithi130.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-09-13T05:59:44.974 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mds (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:45.104 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-09-13T05:59:45.197 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-13T05:59:45.197 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-13T05:59:45.503 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-09-13T05:59:45.817 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:46.031 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-13T05:59:46.031 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-13T05:59:46.230 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephfs-mirror (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:46.438 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-13T05:59:46.438 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-13T05:59:46.702 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-osd (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:47.153 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-13T05:59:47.154 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-13T05:59:47.164 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-test (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:47.308 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up radosgw (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:47.572 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-13T05:59:47.572 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-13T05:59:47.788 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:47.922 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:48.065 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mon (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:48.274 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-13T05:59:48.275 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-13T05:59:48.902 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-base (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:48.908 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-cephadm (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:49.067 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:49.201 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-dashboard (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:49.269 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-09-13T05:59:49.344 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-volume (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:49.471 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-13T05:59:49.933 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mds (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:50.165 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-13T05:59:50.165 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-13T05:59:50.604 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-13T05:59:50.785 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:50.997 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-13T05:59:50.997 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-13T05:59:51.075 INFO:teuthology.orchestra.run.smithi164.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-13T05:59:51.080 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-09-13T05:59:51.156 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2023-09-13T05:59:51.318 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2023-09-13T05:59:51.319 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2023-09-13T05:59:51.462 INFO:teuthology.orchestra.run.smithi164.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-09-13T05:59:51.463 INFO:teuthology.orchestra.run.smithi164.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-09-13T05:59:51.463 INFO:teuthology.orchestra.run.smithi164.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-09-13T05:59:51.463 INFO:teuthology.orchestra.run.smithi164.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-09-13T05:59:51.463 INFO:teuthology.orchestra.run.smithi164.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-09-13T05:59:51.463 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2023-09-13T05:59:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-13T05:59:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-13T05:59:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-13T05:59:51.464 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-13T05:59:51.465 INFO:teuthology.orchestra.run.smithi164.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-13T05:59:51.465 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-13T05:59:51.466 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2023-09-13T05:59:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-09-13T05:59:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-09-13T05:59:51.466 INFO:teuthology.orchestra.run.smithi164.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-09-13T05:59:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-09-13T05:59:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-13T05:59:51.467 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2023-09-13T05:59:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-09-13T05:59:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-09-13T05:59:51.467 INFO:teuthology.orchestra.run.smithi164.stdout: libengine-pkcs11-openssl 2023-09-13T05:59:51.512 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2023-09-13T05:59:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-09-13T05:59:51.513 INFO:teuthology.orchestra.run.smithi164.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-09-13T05:59:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-09-13T05:59:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-09-13T05:59:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-09-13T05:59:51.514 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-09-13T05:59:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-13T05:59:51.515 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages will be upgraded: 2023-09-13T05:59:51.515 INFO:teuthology.orchestra.run.smithi164.stdout: libssl3 2023-09-13T05:59:51.570 INFO:teuthology.orchestra.run.smithi164.stdout:1 upgraded, 39 newly installed, 0 to remove and 254 not upgraded. 2023-09-13T05:59:51.570 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 54.6 MB of archives. 2023-09-13T05:59:51.571 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 202 MB of additional disk space will be used. 2023-09-13T05:59:51.571 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-09-13T05:59:51.628 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-osd (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:51.669 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-09-13T05:59:51.724 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-09-13T05:59:51.732 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-09-13T05:59:51.733 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-09-13T05:59:51.735 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-09-13T05:59:51.736 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-09-13T05:59:51.737 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-09-13T05:59:51.737 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-09-13T05:59:51.738 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-09-13T05:59:51.739 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-09-13T05:59:51.744 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-09-13T05:59:51.757 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-09-13T05:59:51.938 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-13T05:59:51.938 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-13T05:59:51.994 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-09-13T05:59:51.996 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-09-13T05:59:51.996 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-09-13T05:59:51.999 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-09-13T05:59:52.000 INFO:teuthology.orchestra.run.smithi164.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-09-13T05:59:52.004 INFO:teuthology.orchestra.run.smithi164.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-09-13T05:59:52.006 INFO:teuthology.orchestra.run.smithi164.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-09-13T05:59:52.013 INFO:teuthology.orchestra.run.smithi164.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-09-13T05:59:52.014 INFO:teuthology.orchestra.run.smithi164.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-09-13T05:59:52.038 INFO:teuthology.orchestra.run.smithi164.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-09-13T05:59:52.039 INFO:teuthology.orchestra.run.smithi164.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-09-13T05:59:52.050 INFO:teuthology.orchestra.run.smithi164.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-09-13T05:59:52.074 INFO:teuthology.orchestra.run.smithi164.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-09-13T05:59:52.078 INFO:teuthology.orchestra.run.smithi164.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-09-13T05:59:52.079 INFO:teuthology.orchestra.run.smithi164.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-09-13T05:59:52.080 INFO:teuthology.orchestra.run.smithi164.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-09-13T05:59:52.081 INFO:teuthology.orchestra.run.smithi164.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-09-13T05:59:52.093 INFO:teuthology.orchestra.run.smithi164.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-09-13T05:59:52.095 INFO:teuthology.orchestra.run.smithi164.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-09-13T05:59:52.257 INFO:teuthology.orchestra.run.smithi164.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-09-13T05:59:52.257 INFO:teuthology.orchestra.run.smithi164.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-09-13T05:59:52.257 INFO:teuthology.orchestra.run.smithi164.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-09-13T05:59:52.258 INFO:teuthology.orchestra.run.smithi164.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-09-13T05:59:52.258 INFO:teuthology.orchestra.run.smithi164.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-09-13T05:59:52.258 INFO:teuthology.orchestra.run.smithi164.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-09-13T05:59:52.271 INFO:teuthology.orchestra.run.smithi164.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-09-13T05:59:52.272 INFO:teuthology.orchestra.run.smithi164.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-09-13T05:59:52.563 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:52.651 INFO:teuthology.orchestra.run.smithi164.stdout:Preconfiguring packages ... 2023-09-13T05:59:52.689 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:52.832 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mon (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:53.040 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-13T05:59:53.040 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-13T05:59:53.217 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 54.6 MB in 1s (72.8 MB/s) 2023-09-13T05:59:53.328 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package flex. 2023-09-13T05:59:53.401 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139913 files and directories currently installed.) 2023-09-13T05:59:53.404 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-09-13T05:59:53.443 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking flex (2.6.4-8build2) ... 2023-09-13T05:59:53.675 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-cephadm (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:53.860 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:53.986 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-dashboard (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:54.021 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-13T05:59:54.129 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-volume (18.0.0-6083-g4a754ac9-1jammy) ... 2023-09-13T05:59:54.191 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-09-13T05:59:54.255 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-13T05:59:54.606 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-13T05:59:55.158 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package bison. 2023-09-13T05:59:55.230 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139986 files and directories currently installed.) 2023-09-13T05:59:55.233 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-09-13T05:59:55.285 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-09-13T05:59:55.407 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-13T05:59:55.669 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-09-13T05:59:55.683 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-09-13T05:59:55.727 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-09-13T05:59:55.891 INFO:teuthology.orchestra.run.smithi130.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-13T05:59:55.895 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-09-13T05:59:55.970 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2023-09-13T05:59:56.089 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package dump. 2023-09-13T05:59:56.102 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-09-13T05:59:56.132 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2023-09-13T05:59:56.133 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2023-09-13T05:59:56.147 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking dump (0.4b47-3) ... 2023-09-13T05:59:56.277 INFO:teuthology.orchestra.run.smithi130.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-09-13T05:59:56.278 INFO:teuthology.orchestra.run.smithi130.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-09-13T05:59:56.278 INFO:teuthology.orchestra.run.smithi130.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-09-13T05:59:56.278 INFO:teuthology.orchestra.run.smithi130.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-09-13T05:59:56.278 INFO:teuthology.orchestra.run.smithi130.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-09-13T05:59:56.279 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2023-09-13T05:59:56.279 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-13T05:59:56.279 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-13T05:59:56.279 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-13T05:59:56.280 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-13T05:59:56.281 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-13T05:59:56.281 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-13T05:59:56.281 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2023-09-13T05:59:56.281 INFO:teuthology.orchestra.run.smithi130.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-09-13T05:59:56.282 INFO:teuthology.orchestra.run.smithi130.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-09-13T05:59:56.282 INFO:teuthology.orchestra.run.smithi130.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-09-13T05:59:56.282 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-09-13T05:59:56.282 INFO:teuthology.orchestra.run.smithi130.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-13T05:59:56.282 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2023-09-13T05:59:56.283 INFO:teuthology.orchestra.run.smithi130.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-09-13T05:59:56.283 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-09-13T05:59:56.283 INFO:teuthology.orchestra.run.smithi130.stdout: libengine-pkcs11-openssl 2023-09-13T05:59:56.327 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2023-09-13T05:59:56.328 INFO:teuthology.orchestra.run.smithi130.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-09-13T05:59:56.329 INFO:teuthology.orchestra.run.smithi130.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-09-13T05:59:56.329 INFO:teuthology.orchestra.run.smithi130.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-09-13T05:59:56.329 INFO:teuthology.orchestra.run.smithi130.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-09-13T05:59:56.329 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-09-13T05:59:56.330 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-09-13T05:59:56.330 INFO:teuthology.orchestra.run.smithi130.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-13T05:59:56.330 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages will be upgraded: 2023-09-13T05:59:56.331 INFO:teuthology.orchestra.run.smithi130.stdout: libssl3 2023-09-13T05:59:56.434 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package indent. 2023-09-13T05:59:56.447 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-09-13T05:59:56.500 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking indent (2.2.12-1build2) ... 2023-09-13T05:59:56.514 INFO:teuthology.orchestra.run.smithi130.stdout:1 upgraded, 39 newly installed, 0 to remove and 254 not upgraded. 2023-09-13T05:59:56.515 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 54.6 MB of archives. 2023-09-13T05:59:56.515 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 202 MB of additional disk space will be used. 2023-09-13T05:59:56.515 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-09-13T05:59:56.752 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-09-13T05:59:56.766 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-09-13T05:59:56.803 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-13T05:59:56.991 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-09-13T05:59:57.123 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-09-13T05:59:57.137 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-09-13T05:59:57.181 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-13T05:59:57.246 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-09-13T05:59:57.281 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-09-13T05:59:57.283 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-09-13T05:59:57.288 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-09-13T05:59:57.291 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-09-13T05:59:57.292 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-09-13T05:59:57.295 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-09-13T05:59:57.298 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-09-13T05:59:57.462 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-09-13T05:59:57.463 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-09-13T05:59:57.467 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-09-13T05:59:57.481 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-09-13T05:59:57.525 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-09-13T05:59:57.707 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-09-13T05:59:57.820 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libfl2:amd64. 2023-09-13T05:59:57.835 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-09-13T05:59:57.870 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-09-13T05:59:58.257 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-09-13T05:59:58.273 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-09-13T05:59:58.334 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-13T05:59:58.584 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libjson-perl. 2023-09-13T05:59:58.600 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-09-13T05:59:58.643 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-09-13T05:59:58.714 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-09-13T05:59:58.716 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-09-13T05:59:58.716 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-09-13T05:59:58.745 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-09-13T05:59:58.745 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-09-13T05:59:58.750 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-09-13T05:59:58.751 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-09-13T05:59:58.779 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-09-13T05:59:58.943 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-09-13T05:59:58.954 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libllvm14:amd64. 2023-09-13T05:59:58.969 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-09-13T05:59:59.020 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-13T05:59:59.662 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-09-13T05:59:59.662 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-09-13T05:59:59.688 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-09-13T05:59:59.768 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-09-13T05:59:59.777 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-09-13T05:59:59.777 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-09-13T05:59:59.778 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-09-13T05:59:59.779 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-09-13T05:59:59.807 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-09-13T05:59:59.810 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-09-13T06:00:00.436 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-09-13T06:00:00.465 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-09-13T06:00:00.482 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-13T06:00:00.520 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-09-13T06:00:00.521 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-09-13T06:00:00.521 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-09-13T06:00:00.523 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-13T06:00:00.608 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-09-13T06:00:00.613 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-09-13T06:00:00.759 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libmbim-proxy. 2023-09-13T06:00:00.775 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-13T06:00:00.809 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-13T06:00:01.070 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-09-13T06:00:01.072 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-09-13T06:00:01.136 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-09-13T06:00:01.152 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-13T06:00:01.195 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-13T06:00:01.462 INFO:teuthology.orchestra.run.smithi130.stdout:Preconfiguring packages ... 2023-09-13T06:00:01.531 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libndp0:amd64. 2023-09-13T06:00:01.545 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-09-13T06:00:01.589 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-13T06:00:01.612 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 54.6 MB in 5s (11.5 MB/s) 2023-09-13T06:00:01.755 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package flex. 2023-09-13T06:00:01.830 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139913 files and directories currently installed.) 2023-09-13T06:00:01.833 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-09-13T06:00:01.895 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking flex (2.6.4-8build2) ... 2023-09-13T06:00:01.934 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libnm0:amd64. 2023-09-13T06:00:01.949 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-09-13T06:00:01.992 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-13T06:00:02.261 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libpq5:amd64. 2023-09-13T06:00:02.276 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-13T06:00:02.319 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:02.423 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-13T06:00:02.610 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-09-13T06:00:02.698 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-09-13T06:00:02.713 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-13T06:00:02.756 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-13T06:00:02.981 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-13T06:00:03.042 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqmi-proxy. 2023-09-13T06:00:03.057 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-13T06:00:03.100 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-13T06:00:03.420 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-09-13T06:00:03.435 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-13T06:00:03.486 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-13T06:00:03.494 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package bison. 2023-09-13T06:00:03.568 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139986 files and directories currently installed.) 2023-09-13T06:00:03.572 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-09-13T06:00:03.621 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-09-13T06:00:03.998 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-09-13T06:00:04.013 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-09-13T06:00:04.022 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-09-13T06:00:04.036 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-09-13T06:00:04.048 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-09-13T06:00:04.106 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-09-13T06:00:04.342 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package modemmanager. 2023-09-13T06:00:04.357 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-13T06:00:04.375 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package dump. 2023-09-13T06:00:04.389 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-09-13T06:00:04.401 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-13T06:00:04.425 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking dump (0.4b47-3) ... 2023-09-13T06:00:04.687 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package indent. 2023-09-13T06:00:04.701 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-09-13T06:00:04.745 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking indent (2.2.12-1build2) ... 2023-09-13T06:00:05.006 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-09-13T06:00:05.020 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-09-13T06:00:05.040 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package network-manager. 2023-09-13T06:00:05.055 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-09-13T06:00:05.065 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-13T06:00:05.098 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-09-13T06:00:05.360 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-09-13T06:00:05.374 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-09-13T06:00:05.410 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-13T06:00:05.655 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-09-13T06:00:05.669 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-09-13T06:00:05.713 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-09-13T06:00:05.756 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ppp. 2023-09-13T06:00:05.770 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-09-13T06:00:06.050 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libfl2:amd64. 2023-09-13T06:00:06.065 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-09-13T06:00:06.108 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-09-13T06:00:06.153 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-09-13T06:00:06.352 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-09-13T06:00:06.368 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-09-13T06:00:06.402 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-13T06:00:06.527 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package pptp-linux. 2023-09-13T06:00:06.540 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-09-13T06:00:06.585 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-09-13T06:00:06.605 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjson-perl. 2023-09-13T06:00:06.620 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-09-13T06:00:06.655 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-09-13T06:00:06.837 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package network-manager-pptp. 2023-09-13T06:00:06.851 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-09-13T06:00:06.895 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-09-13T06:00:06.975 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libllvm14:amd64. 2023-09-13T06:00:06.990 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-09-13T06:00:07.033 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-13T06:00:07.182 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-client-common. 2023-09-13T06:00:07.196 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-09-13T06:00:07.232 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-client-common (238) ... 2023-09-13T06:00:07.536 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-client-14. 2023-09-13T06:00:07.550 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-13T06:00:07.594 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:08.199 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-common. 2023-09-13T06:00:08.213 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-09-13T06:00:08.274 INFO:teuthology.orchestra.run.smithi164.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-09-13T06:00:08.305 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-common (238) ... 2023-09-13T06:00:08.428 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-09-13T06:00:08.443 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-13T06:00:08.486 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-13T06:00:08.722 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmbim-proxy. 2023-09-13T06:00:08.737 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-13T06:00:08.772 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-13T06:00:08.926 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-14. 2023-09-13T06:00:08.940 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-13T06:00:08.979 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:09.066 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-09-13T06:00:09.082 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-13T06:00:09.124 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-13T06:00:09.469 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libndp0:amd64. 2023-09-13T06:00:09.485 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-09-13T06:00:09.528 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-13T06:00:09.855 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libnm0:amd64. 2023-09-13T06:00:09.871 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-09-13T06:00:09.905 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-13T06:00:10.028 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql. 2023-09-13T06:00:10.043 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-09-13T06:00:10.120 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql (14+238) ... 2023-09-13T06:00:10.258 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libpq5:amd64. 2023-09-13T06:00:10.274 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-13T06:00:10.316 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:10.364 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-client. 2023-09-13T06:00:10.378 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-09-13T06:00:10.422 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-client (14+238) ... 2023-09-13T06:00:10.658 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-contrib. 2023-09-13T06:00:10.672 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-09-13T06:00:10.678 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-09-13T06:00:10.694 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-13T06:00:10.716 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-contrib (14+238) ... 2023-09-13T06:00:10.736 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-13T06:00:11.013 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqmi-proxy. 2023-09-13T06:00:11.028 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-13T06:00:11.052 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package tcl8.6. 2023-09-13T06:00:11.063 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-13T06:00:11.066 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-09-13T06:00:11.102 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-13T06:00:11.274 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-09-13T06:00:11.289 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-13T06:00:11.332 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-13T06:00:11.354 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package tcl. 2023-09-13T06:00:11.369 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-09-13T06:00:11.417 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-09-13T06:00:11.790 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package wpasupplicant. 2023-09-13T06:00:11.806 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-09-13T06:00:11.849 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-13T06:00:11.861 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-09-13T06:00:11.875 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-09-13T06:00:11.920 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-09-13T06:00:12.219 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-09-13T06:00:12.237 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-09-13T06:00:12.247 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package modemmanager. 2023-09-13T06:00:12.263 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-13T06:00:12.277 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-09-13T06:00:12.297 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-13T06:00:12.623 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package usb-modeswitch. 2023-09-13T06:00:12.638 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-09-13T06:00:12.689 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-13T06:00:12.937 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package network-manager. 2023-09-13T06:00:12.952 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-09-13T06:00:12.964 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-client-common (238) ... 2023-09-13T06:00:13.003 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-09-13T06:00:13.178 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up flex (2.6.4-8build2) ... 2023-09-13T06:00:13.304 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-13T06:00:13.430 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:13.556 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-09-13T06:00:13.602 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ppp. 2023-09-13T06:00:13.617 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-09-13T06:00:13.724 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-13T06:00:13.850 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:13.942 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-09-13T06:00:14.215 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package pptp-linux. 2023-09-13T06:00:14.229 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-09-13T06:00:14.265 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-09-13T06:00:14.518 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package network-manager-pptp. 2023-09-13T06:00:14.532 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-09-13T06:00:14.576 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-09-13T06:00:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-09-13T06:00:14.904 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-client-common. 2023-09-13T06:00:14.918 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-09-13T06:00:14.963 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-client-common (238) ... 2023-09-13T06:00:14.971 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-13T06:00:15.258 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-client-14. 2023-09-13T06:00:15.272 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-13T06:00:15.308 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:15.349 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-13T06:00:15.349 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-13T06:00:15.863 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-common. 2023-09-13T06:00:15.877 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-09-13T06:00:15.939 INFO:teuthology.orchestra.run.smithi130.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-09-13T06:00:15.962 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-common (238) ... 2023-09-13T06:00:16.066 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-09-13T06:00:16.201 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-13T06:00:16.309 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-09-13T06:00:16.411 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-09-13T06:00:16.445 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-14. 2023-09-13T06:00:16.460 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-13T06:00:16.506 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:16.528 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-09-13T06:00:16.654 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-13T06:00:16.780 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-09-13T06:00:17.443 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-13T06:00:17.532 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql. 2023-09-13T06:00:17.544 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up dump (0.4b47-3) ... 2023-09-13T06:00:17.546 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-09-13T06:00:17.590 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql (14+238) ... 2023-09-13T06:00:17.665 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-09-13T06:00:17.729 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-13T06:00:17.934 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-client. 2023-09-13T06:00:17.948 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-09-13T06:00:17.980 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-13T06:00:17.993 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-client (14+238) ... 2023-09-13T06:00:18.106 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up tcl (8.6.11+1build2) ... 2023-09-13T06:00:18.195 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-contrib. 2023-09-13T06:00:18.209 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-09-13T06:00:18.232 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libjson-perl (4.04000-1) ... 2023-09-13T06:00:18.253 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-contrib (14+238) ... 2023-09-13T06:00:18.383 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-09-13T06:00:18.473 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-09-13T06:00:18.543 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up indent (2.2.12-1build2) ... 2023-09-13T06:00:18.572 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package tcl8.6. 2023-09-13T06:00:18.587 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-09-13T06:00:18.631 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-13T06:00:18.669 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-13T06:00:18.846 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-13T06:00:18.900 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package tcl. 2023-09-13T06:00:18.914 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-09-13T06:00:18.955 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-13T06:00:18.962 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-09-13T06:00:19.077 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-09-13T06:00:19.249 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-client (14+238) ... 2023-09-13T06:00:19.353 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package wpasupplicant. 2023-09-13T06:00:19.368 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-09-13T06:00:19.375 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-09-13T06:00:19.403 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-13T06:00:19.741 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-09-13T06:00:19.755 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-09-13T06:00:19.799 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-09-13T06:00:19.993 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:19.993 INFO:teuthology.orchestra.run.smithi164.stdout:The following network interfaces were found in /etc/network/interfaces 2023-09-13T06:00:19.993 INFO:teuthology.orchestra.run.smithi164.stdout:which means they are currently configured by ifupdown: 2023-09-13T06:00:19.994 INFO:teuthology.orchestra.run.smithi164.stdout:- enp3s0f1 2023-09-13T06:00:19.994 INFO:teuthology.orchestra.run.smithi164.stdout:If you want to manage those interfaces with NetworkManager instead 2023-09-13T06:00:19.994 INFO:teuthology.orchestra.run.smithi164.stdout:remove their configuration from /etc/network/interfaces. 2023-09-13T06:00:19.994 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:20.128 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-09-13T06:00:20.177 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package usb-modeswitch. 2023-09-13T06:00:20.192 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-09-13T06:00:20.244 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-13T06:00:20.527 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-client-common (238) ... 2023-09-13T06:00:20.545 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-09-13T06:00:20.733 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up flex (2.6.4-8build2) ... 2023-09-13T06:00:20.859 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-13T06:00:20.974 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-09-13T06:00:20.985 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:21.120 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-09-13T06:00:21.246 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-13T06:00:21.372 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:21.685 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-13T06:00:21.820 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-13T06:00:21.946 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-09-13T06:00:22.072 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-common (238) ... 2023-09-13T06:00:22.383 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-09-13T06:00:22.837 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-13T06:00:23.099 INFO:teuthology.orchestra.run.smithi164.stdout:Adding user postgres to group ssl-cert 2023-09-13T06:00:23.232 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-13T06:00:23.232 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-13T06:00:23.363 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:23.363 INFO:teuthology.orchestra.run.smithi164.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-09-13T06:00:23.630 INFO:teuthology.orchestra.run.smithi164.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-09-13T06:00:23.631 INFO:teuthology.orchestra.run.smithi164.stdout:Removing obsolete dictionary files: 2023-09-13T06:00:23.956 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-09-13T06:00:24.074 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-13T06:00:24.183 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-09-13T06:00:24.309 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-09-13T06:00:24.382 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-09-13T06:00:24.435 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-09-13T06:00:24.638 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-13T06:00:24.764 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-09-13T06:00:24.873 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:25.211 INFO:teuthology.orchestra.run.smithi164.stdout:Creating new PostgreSQL cluster 14/main ... 2023-09-13T06:00:25.232 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-09-13T06:00:25.296 INFO:teuthology.orchestra.run.smithi164.stdout:The files belonging to this database system will be owned by user "postgres". 2023-09-13T06:00:25.297 INFO:teuthology.orchestra.run.smithi164.stdout:This user must also own the server process. 2023-09-13T06:00:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:25.297 INFO:teuthology.orchestra.run.smithi164.stdout:The database cluster will be initialized with locale "en_US". 2023-09-13T06:00:25.297 INFO:teuthology.orchestra.run.smithi164.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-09-13T06:00:25.297 INFO:teuthology.orchestra.run.smithi164.stdout:The default text search configuration will be set to "english". 2023-09-13T06:00:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:25.298 INFO:teuthology.orchestra.run.smithi164.stdout:Data page checksums are disabled. 2023-09-13T06:00:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:25.299 INFO:teuthology.orchestra.run.smithi164.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-09-13T06:00:25.299 INFO:teuthology.orchestra.run.smithi164.stdout:creating subdirectories ... ok 2023-09-13T06:00:25.299 INFO:teuthology.orchestra.run.smithi164.stdout:selecting dynamic shared memory implementation ... posix 2023-09-13T06:00:25.321 INFO:teuthology.orchestra.run.smithi164.stdout:selecting default max_connections ... 100 2023-09-13T06:00:25.355 INFO:teuthology.orchestra.run.smithi164.stdout:selecting default shared_buffers ... 128MB 2023-09-13T06:00:25.368 INFO:teuthology.orchestra.run.smithi164.stdout:selecting default time zone ... Etc/UTC 2023-09-13T06:00:25.369 INFO:teuthology.orchestra.run.smithi164.stdout:creating configuration files ... ok 2023-09-13T06:00:25.420 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-13T06:00:25.544 INFO:teuthology.orchestra.run.smithi164.stdout:running bootstrap script ... ok 2023-09-13T06:00:25.546 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up dump (0.4b47-3) ... 2023-09-13T06:00:25.650 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-09-13T06:00:25.706 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-13T06:00:25.807 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-13T06:00:25.925 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up tcl (8.6.11+1build2) ... 2023-09-13T06:00:26.051 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjson-perl (4.04000-1) ... 2023-09-13T06:00:26.177 INFO:teuthology.orchestra.run.smithi164.stdout:performing post-bootstrap initialization ... ok 2023-09-13T06:00:26.177 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-09-13T06:00:26.267 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-09-13T06:00:26.337 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up indent (2.2.12-1build2) ... 2023-09-13T06:00:26.462 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-13T06:00:26.656 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-13T06:00:26.715 INFO:teuthology.orchestra.run.smithi164.stdout:syncing data to disk ... ok 2023-09-13T06:00:26.765 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-13T06:00:26.866 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-09-13T06:00:27.034 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-client (14+238) ... 2023-09-13T06:00:27.160 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-09-13T06:00:27.244 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-09-13T06:00:27.742 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:27.742 INFO:teuthology.orchestra.run.smithi130.stdout:The following network interfaces were found in /etc/network/interfaces 2023-09-13T06:00:27.742 INFO:teuthology.orchestra.run.smithi130.stdout:which means they are currently configured by ifupdown: 2023-09-13T06:00:27.742 INFO:teuthology.orchestra.run.smithi130.stdout:- enp3s0f1 2023-09-13T06:00:27.743 INFO:teuthology.orchestra.run.smithi130.stdout:If you want to manage those interfaces with NetworkManager instead 2023-09-13T06:00:27.743 INFO:teuthology.orchestra.run.smithi130.stdout:remove their configuration from /etc/network/interfaces. 2023-09-13T06:00:27.743 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:27.875 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-09-13T06:00:28.296 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-09-13T06:00:28.715 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-09-13T06:00:29.421 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-13T06:00:29.572 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-13T06:00:29.723 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-09-13T06:00:29.849 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-common (238) ... 2023-09-13T06:00:30.765 INFO:teuthology.orchestra.run.smithi130.stdout:Adding user postgres to group ssl-cert 2023-09-13T06:00:30.930 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-13T06:00:31.031 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:31.032 INFO:teuthology.orchestra.run.smithi130.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-09-13T06:00:31.056 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-contrib (14+238) ... 2023-09-13T06:00:31.174 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql (14+238) ... 2023-09-13T06:00:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-13T06:00:31.295 INFO:teuthology.orchestra.run.smithi130.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-09-13T06:00:31.296 INFO:teuthology.orchestra.run.smithi130.stdout:Removing obsolete dictionary files: 2023-09-13T06:00:31.435 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-13T06:00:31.695 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-09-13T06:00:31.695 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-09-13T06:00:32.022 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-09-13T06:00:32.470 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-09-13T06:00:32.626 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-13T06:00:32.788 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-13T06:00:32.997 INFO:teuthology.orchestra.run.smithi130.stdout:Creating new PostgreSQL cluster 14/main ... 2023-09-13T06:00:33.015 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-13T06:00:33.018 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-09-13T06:00:33.073 INFO:teuthology.orchestra.run.smithi130.stdout:The files belonging to this database system will be owned by user "postgres". 2023-09-13T06:00:33.073 INFO:teuthology.orchestra.run.smithi130.stdout:This user must also own the server process. 2023-09-13T06:00:33.073 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:33.074 INFO:teuthology.orchestra.run.smithi130.stdout:The database cluster will be initialized with locale "en_US". 2023-09-13T06:00:33.074 INFO:teuthology.orchestra.run.smithi130.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-09-13T06:00:33.074 INFO:teuthology.orchestra.run.smithi130.stdout:The default text search configuration will be set to "english". 2023-09-13T06:00:33.074 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:33.074 INFO:teuthology.orchestra.run.smithi130.stdout:Data page checksums are disabled. 2023-09-13T06:00:33.075 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:33.075 INFO:teuthology.orchestra.run.smithi130.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-09-13T06:00:33.076 INFO:teuthology.orchestra.run.smithi130.stdout:creating subdirectories ... ok 2023-09-13T06:00:33.076 INFO:teuthology.orchestra.run.smithi130.stdout:selecting dynamic shared memory implementation ... posix 2023-09-13T06:00:33.097 INFO:teuthology.orchestra.run.smithi130.stdout:selecting default max_connections ... 100 2023-09-13T06:00:33.130 INFO:teuthology.orchestra.run.smithi130.stdout:selecting default shared_buffers ... 128MB 2023-09-13T06:00:33.144 INFO:teuthology.orchestra.run.smithi130.stdout:selecting default time zone ... Etc/UTC 2023-09-13T06:00:33.144 INFO:teuthology.orchestra.run.smithi130.stdout:creating configuration files ... ok 2023-09-13T06:00:33.319 INFO:teuthology.orchestra.run.smithi130.stdout:running bootstrap script ... ok 2023-09-13T06:00:33.944 INFO:teuthology.orchestra.run.smithi130.stdout:performing post-bootstrap initialization ... ok 2023-09-13T06:00:34.392 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-09-13T06:00:34.509 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-09-13T06:00:34.533 INFO:teuthology.orchestra.run.smithi130.stdout:syncing data to disk ... ok 2023-09-13T06:00:35.066 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-09-13T06:00:35.179 INFO:teuthology.orchestra.run.smithi164.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-13T06:00:35.186 DEBUG:teuthology.parallel:result is None 2023-09-13T06:00:38.109 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-13T06:00:38.235 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-contrib (14+238) ... 2023-09-13T06:00:38.336 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql (14+238) ... 2023-09-13T06:00:38.453 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-13T06:00:38.580 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-13T06:00:38.838 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-09-13T06:00:38.839 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-09-13T06:00:39.616 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-09-13T06:00:39.925 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-13T06:00:40.077 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-13T06:00:41.422 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-09-13T06:00:41.514 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-09-13T06:00:42.216 INFO:teuthology.orchestra.run.smithi130.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-13T06:00:42.221 DEBUG:teuthology.parallel:result is None 2023-09-13T06:00:42.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T06:00:42.476 DEBUG:teuthology.orchestra.run.smithi130:> dpkg-query -W -f '${Version}' ceph 2023-09-13T06:00:42.498 INFO:teuthology.orchestra.run.smithi130.stdout:18.0.0-6083-g4a754ac9-1jammy 2023-09-13T06:00:42.499 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6083-g4a754ac9-1jammy 2023-09-13T06:00:42.500 INFO:teuthology.task.install:The correct ceph version 18.0.0-6083-g4a754ac9-1jammy is installed. 2023-09-13T06:00:42.500 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T06:00:42.732 DEBUG:teuthology.orchestra.run.smithi164:> dpkg-query -W -f '${Version}' ceph 2023-09-13T06:00:42.756 INFO:teuthology.orchestra.run.smithi164.stdout:18.0.0-6083-g4a754ac9-1jammy 2023-09-13T06:00:42.756 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6083-g4a754ac9-1jammy 2023-09-13T06:00:42.757 INFO:teuthology.task.install:The correct ceph version 18.0.0-6083-g4a754ac9-1jammy is installed. 2023-09-13T06:00:42.757 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-13T06:00:42.758 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:42.758 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-13T06:00:42.779 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:42.780 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-13T06:00:42.828 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-13T06:00:42.829 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:42.829 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2023-09-13T06:00:42.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-13T06:00:42.909 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:42.910 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2023-09-13T06:00:42.932 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-13T06:00:42.998 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-13T06:00:42.998 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:42.998 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-13T06:00:43.019 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-13T06:00:43.085 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:43.086 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-13T06:00:43.108 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-13T06:00:43.169 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-13T06:00:43.169 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:43.170 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2023-09-13T06:00:43.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-13T06:00:43.254 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:43.254 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2023-09-13T06:00:43.276 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-13T06:00:43.341 INFO:teuthology.run_tasks:Running task ceph... 2023-09-13T06:00:43.412 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-13T06:00:43.412 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2023-09-13T06:00:43.416 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2023-09-13T06:00:43.437 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-13T06:00:43.438 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-13T06:00:43.478 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-13T06:00:43.500 INFO:tasks.ceph:Creating extra log directories... 2023-09-13T06:00:43.501 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-13T06:00:43.541 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-13T06:00:43.596 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-13T06:00:43.597 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-13T06:00:43.597 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-13T06:00:43.598 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:43.598 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-13T06:00:43.614 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-13T06:00:43.711 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:43.711 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-13T06:00:43.720 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-13T06:00:43.820 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-13T06:00:43.820 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-13T06:00:43.821 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784', 'branch': 'wip-rishabh-2023sep12-b2', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7394784', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023sep12-b2'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023sep12-b2', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2531, 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'sleep_before_teardown': 0, 'subset': '165/256', 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023sep12-b2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZER4UGcEI6enXkigtPnCyOc30c1H/DznkXXH94GzoJrvoorCMKfGD4t/n6rIIjYstXihfGkhcg9vMriF6gSHI=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOc5UpwiSAB418Q3UlT4i6G9ympj9jDTnPR4Mhje6qobPby2tceV/zpsAslXnO78jcLKUx4CIQoWDUgluT+3/xg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-12_12:12:15', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1394'} 2023-09-13T06:00:43.822 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-13T06:00:43.825 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-13T06:00:43.835 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2023-09-13T06:00:43.881 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2023-09-13T06:00:43.902 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:43.903 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2023-09-13T06:00:43.950 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-13T06:00:43.951 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2023-09-13T06:00:44.006 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-13T06:00:44.007 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T06:00:44.007 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 901 Links: 1 2023-09-13T06:00:44.007 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T06:00:44.007 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-09-13 05:54:20.736237884 +0000 2023-09-13T06:00:44.007 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-09-13 05:54:20.360241243 +0000 2023-09-13T06:00:44.008 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-09-13 05:54:20.360241243 +0000 2023-09-13T06:00:44.008 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2023-09-13 05:54:20.360241243 +0000 2023-09-13T06:00:44.008 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-13T06:00:44.073 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-09-13T06:00:44.073 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-09-13T06:00:44.073 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000363883 s, 1.4 MB/s 2023-09-13T06:00:44.074 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-13T06:00:44.128 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2023-09-13T06:00:44.182 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-13T06:00:44.183 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T06:00:44.183 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-09-13T06:00:44.183 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T06:00:44.183 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-09-13 05:54:21.404231916 +0000 2023-09-13T06:00:44.183 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-09-13 05:54:21.008235455 +0000 2023-09-13T06:00:44.184 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-09-13 05:54:21.008235455 +0000 2023-09-13T06:00:44.184 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2023-09-13 05:54:21.008235455 +0000 2023-09-13T06:00:44.184 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-13T06:00:44.249 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-09-13T06:00:44.249 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-09-13T06:00:44.249 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.00036755 s, 1.4 MB/s 2023-09-13T06:00:44.251 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-13T06:00:44.304 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2023-09-13T06:00:44.354 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-13T06:00:44.355 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T06:00:44.355 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-09-13T06:00:44.355 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T06:00:44.355 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-09-13 05:54:21.792228452 +0000 2023-09-13T06:00:44.355 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-09-13 05:54:21.788228487 +0000 2023-09-13T06:00:44.356 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-09-13 05:54:21.788228487 +0000 2023-09-13T06:00:44.356 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2023-09-13 05:54:21.788228487 +0000 2023-09-13T06:00:44.356 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-13T06:00:44.421 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-09-13T06:00:44.421 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-09-13T06:00:44.421 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000363488 s, 1.4 MB/s 2023-09-13T06:00:44.423 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-13T06:00:44.480 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2023-09-13T06:00:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-13T06:00:44.531 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T06:00:44.532 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 954 Links: 1 2023-09-13T06:00:44.532 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T06:00:44.532 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-09-13 05:54:22.812219341 +0000 2023-09-13T06:00:44.532 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-09-13 05:54:22.440222664 +0000 2023-09-13T06:00:44.532 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-09-13 05:54:22.440222664 +0000 2023-09-13T06:00:44.533 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2023-09-13 05:54:22.440222664 +0000 2023-09-13T06:00:44.533 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-13T06:00:44.598 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-09-13T06:00:44.598 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-09-13T06:00:44.598 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000401446 s, 1.3 MB/s 2023-09-13T06:00:44.600 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-13T06:00:44.657 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T06:00:44.657 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:44.657 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2023-09-13T06:00:44.667 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-13T06:00:44.668 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2023-09-13T06:00:44.721 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-13T06:00:44.722 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T06:00:44.722 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 904 Links: 1 2023-09-13T06:00:44.722 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T06:00:44.722 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2023-09-13 05:54:20.340879872 +0000 2023-09-13T06:00:44.723 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2023-09-13 05:54:20.336879909 +0000 2023-09-13T06:00:44.723 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2023-09-13 05:54:20.336879909 +0000 2023-09-13T06:00:44.723 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2023-09-13 05:54:20.336879909 +0000 2023-09-13T06:00:44.724 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-13T06:00:44.788 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2023-09-13T06:00:44.788 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2023-09-13T06:00:44.789 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000401772 s, 1.3 MB/s 2023-09-13T06:00:44.790 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-13T06:00:44.848 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2023-09-13T06:00:44.898 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-13T06:00:44.898 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T06:00:44.898 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 922 Links: 1 2023-09-13T06:00:44.898 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T06:00:44.899 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2023-09-13 05:54:21.452869941 +0000 2023-09-13T06:00:44.899 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2023-09-13 05:54:21.040873620 +0000 2023-09-13T06:00:44.899 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2023-09-13 05:54:21.040873620 +0000 2023-09-13T06:00:44.899 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2023-09-13 05:54:21.040873620 +0000 2023-09-13T06:00:44.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-13T06:00:44.964 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2023-09-13T06:00:44.964 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2023-09-13T06:00:44.965 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000389649 s, 1.3 MB/s 2023-09-13T06:00:44.966 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-13T06:00:45.019 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2023-09-13T06:00:45.073 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-13T06:00:45.073 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T06:00:45.073 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-09-13T06:00:45.074 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T06:00:45.074 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2023-09-13 05:54:22.216863117 +0000 2023-09-13T06:00:45.074 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2023-09-13 05:54:21.808866761 +0000 2023-09-13T06:00:45.074 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2023-09-13 05:54:21.808866761 +0000 2023-09-13T06:00:45.074 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2023-09-13 05:54:21.808866761 +0000 2023-09-13T06:00:45.075 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-13T06:00:45.136 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2023-09-13T06:00:45.136 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2023-09-13T06:00:45.136 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000405385 s, 1.3 MB/s 2023-09-13T06:00:45.138 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-13T06:00:45.191 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2023-09-13T06:00:45.246 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-13T06:00:45.247 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T06:00:45.247 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 954 Links: 1 2023-09-13T06:00:45.247 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T06:00:45.247 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2023-09-13 05:54:22.876857220 +0000 2023-09-13T06:00:45.247 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2023-09-13 05:54:22.488860686 +0000 2023-09-13T06:00:45.248 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2023-09-13 05:54:22.488860686 +0000 2023-09-13T06:00:45.248 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2023-09-13 05:54:22.488860686 +0000 2023-09-13T06:00:45.248 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-13T06:00:45.309 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2023-09-13T06:00:45.309 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2023-09-13T06:00:45.310 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000703367 s, 728 kB/s 2023-09-13T06:00:45.311 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-13T06:00:45.363 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T06:00:45.364 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-13T06:00:45.364 INFO:tasks.ceph:Generating config... 2023-09-13T06:00:45.365 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-13T06:00:45.366 INFO:tasks.ceph:[client] debug client = 20 2023-09-13T06:00:45.366 INFO:tasks.ceph:[client] debug ms = 1 2023-09-13T06:00:45.366 INFO:tasks.ceph:[client] pid file = 2023-09-13T06:00:45.366 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-13T06:00:45.367 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-13T06:00:45.367 INFO:tasks.ceph:[client.0] debug client = 20 2023-09-13T06:00:45.367 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-09-13T06:00:45.367 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-09-13T06:00:45.368 INFO:tasks.ceph:[client.1] debug client = 20 2023-09-13T06:00:45.368 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-09-13T06:00:45.368 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-09-13T06:00:45.368 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-09-13T06:00:45.369 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-13T06:00:45.369 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-09-13T06:00:45.369 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-13T06:00:45.370 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-13T06:00:45.370 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-13T06:00:45.370 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-13T06:00:45.370 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-13T06:00:45.371 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-13T06:00:45.371 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-13T06:00:45.371 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-13T06:00:45.371 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-13T06:00:45.372 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-13T06:00:45.372 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-13T06:00:45.372 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-13T06:00:45.372 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-13T06:00:45.373 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-13T06:00:45.373 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-09-13T06:00:45.373 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-09-13T06:00:45.373 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-09-13T06:00:45.374 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-13T06:00:45.374 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-13T06:00:45.374 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-09-13T06:00:45.374 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-13T06:00:45.375 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-13T06:00:45.375 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-13T06:00:45.375 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-13T06:00:45.375 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-13T06:00:45.376 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-13T06:00:45.376 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-13T06:00:45.376 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-09-13T06:00:45.376 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-13T06:00:45.377 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-13T06:00:45.377 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-13T06:00:45.377 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-09-13T06:00:45.377 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-09-13T06:00:45.378 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-09-13T06:00:45.378 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-13T06:00:45.378 INFO:tasks.ceph:Setting up mon.a... 2023-09-13T06:00:45.379 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-13T06:00:45.425 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.keyring 2023-09-13T06:00:45.441 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-13T06:00:45.535 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-13T06:00:45.556 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.130'), ('mon.b', '172.21.15.164'), ('mon.c', '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]')] 2023-09-13T06:00:45.557 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.130,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-13T06:00:45.558 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:45.558 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-13T06:00:45.606 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.130 --add b 172.21.15.164 --addv c '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:45.702 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:45.702 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: generated fsid 33902c8f-11a4-444c-a37a-ca3bab8415c5 2023-09-13T06:00:45.703 INFO:teuthology.orchestra.run.smithi130.stdout:setting min_mon_release = pacific 2023-09-13T06:00:45.703 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 0 2023-09-13T06:00:45.703 INFO:teuthology.orchestra.run.smithi130.stdout:fsid 33902c8f-11a4-444c-a37a-ca3bab8415c5 2023-09-13T06:00:45.703 INFO:teuthology.orchestra.run.smithi130.stdout:last_changed 2023-09-13T06:00:45.702723+0000 2023-09-13T06:00:45.703 INFO:teuthology.orchestra.run.smithi130.stdout:created 2023-09-13T06:00:45.702723+0000 2023-09-13T06:00:45.704 INFO:teuthology.orchestra.run.smithi130.stdout:min_mon_release 16 (pacific) 2023-09-13T06:00:45.704 INFO:teuthology.orchestra.run.smithi130.stdout:election_strategy: 1 2023-09-13T06:00:45.704 INFO:teuthology.orchestra.run.smithi130.stdout:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2023-09-13T06:00:45.704 INFO:teuthology.orchestra.run.smithi130.stdout:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2023-09-13T06:00:45.705 INFO:teuthology.orchestra.run.smithi130.stdout:2: [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] mon.c 2023-09-13T06:00:45.705 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-13T06:00:45.706 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-13T06:00:45.714 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 33902c8f-11a4-444c-a37a-ca3bab8415c5... 2023-09-13T06:00:45.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-13T06:00:45.761 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-13T06:00:45.803 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2023-09-13T06:00:45.803 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2023-09-13T06:00:45.803 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-13T06:00:45.804 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2023-09-13T06:00:45.804 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.804 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2023-09-13T06:00:45.804 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.804 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2023-09-13T06:00:45.805 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.805 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2023-09-13T06:00:45.805 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2023-09-13T06:00:45.805 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.805 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2023-09-13T06:00:45.806 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2023-09-13T06:00:45.806 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.806 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-13T06:00:45.806 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2023-09-13T06:00:45.806 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.807 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2023-09-13T06:00:45.807 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-13T06:00:45.807 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.807 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2023-09-13T06:00:45.807 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.808 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2023-09-13T06:00:45.809 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2023-09-13T06:00:45.809 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2023-09-13T06:00:45.809 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2023-09-13T06:00:45.809 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2023-09-13T06:00:45.809 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2023-09-13T06:00:45.810 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2023-09-13T06:00:45.810 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-13T06:00:45.810 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-13T06:00:45.810 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2023-09-13T06:00:45.811 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.811 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-13T06:00:45.811 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.811 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2023-09-13T06:00:45.811 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.812 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2023-09-13T06:00:45.812 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.812 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2023-09-13T06:00:45.812 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2023-09-13T06:00:45.813 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2023-09-13T06:00:45.813 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.130,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2023-09-13T06:00:45.813 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on skipped message = False 2023-09-13T06:00:45.814 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = 33902c8f-11a4-444c-a37a-ca3bab8415c5 2023-09-13T06:00:45.814 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.814 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2023-09-13T06:00:45.814 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2023-09-13T06:00:45.815 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.815 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2023-09-13T06:00:45.815 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2023-09-13T06:00:45.815 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2023-09-13T06:00:45.815 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.816 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2023-09-13T06:00:45.816 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2023-09-13T06:00:45.816 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.816 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2023-09-13T06:00:45.817 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2023-09-13T06:00:45.817 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2023-09-13T06:00:45.817 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.817 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2023-09-13T06:00:45.817 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2023-09-13T06:00:45.817 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.818 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2023-09-13T06:00:45.818 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.818 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2023-09-13T06:00:45.818 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.819 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2023-09-13T06:00:45.819 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.819 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2023-09-13T06:00:45.819 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2023-09-13T06:00:45.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.820 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2023-09-13T06:00:45.820 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2023-09-13T06:00:45.820 INFO:teuthology.orchestra.run.smithi130.stdout: bdev async discard = True 2023-09-13T06:00:45.821 INFO:teuthology.orchestra.run.smithi130.stdout: bdev enable discard = True 2023-09-13T06:00:45.821 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore allocator = bitmap 2023-09-13T06:00:45.821 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2023-09-13T06:00:45.821 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2023-09-13T06:00:45.821 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 1/20 2023-09-13T06:00:45.822 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 1/20 2023-09-13T06:00:45.822 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-09-13T06:00:45.822 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2023-09-13T06:00:45.822 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 4/10 2023-09-13T06:00:45.823 INFO:teuthology.orchestra.run.smithi130.stdout: memstore device bytes = 200000000 2023-09-13T06:00:45.823 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2023-09-13T06:00:45.823 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2023-09-13T06:00:45.823 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2023-09-13T06:00:45.823 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 1.0 2023-09-13T06:00:45.824 INFO:teuthology.orchestra.run.smithi130.stdout: osd mon report interval = 5 2023-09-13T06:00:45.824 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = memstore 2023-09-13T06:00:45.824 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2023-09-13T06:00:45.824 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.824 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2023-09-13T06:00:45.825 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-09-13T06:00:45.825 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2023-09-13T06:00:45.825 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-09-13T06:00:45.826 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-09-13T06:00:45.826 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-09-13T06:00:45.826 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-09-13T06:00:45.826 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2023-09-13T06:00:45.827 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.827 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2023-09-13T06:00:45.827 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-09-13T06:00:45.827 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-09-13T06:00:45.828 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2023-09-13T06:00:45.828 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-09-13T06:00:45.828 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2023-09-13T06:00:45.828 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2023-09-13T06:00:45.828 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-09-13T06:00:45.829 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2023-09-13T06:00:45.829 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2023-09-13T06:00:45.829 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-09-13T06:00:45.829 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.829 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-13T06:00:45.830 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2023-09-13T06:00:45.830 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2023-09-13T06:00:45.830 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.830 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2023-09-13T06:00:45.830 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-13T06:00:45.831 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-13T06:00:45.831 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.831 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2023-09-13T06:00:45.831 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2023-09-13T06:00:45.831 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.832 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2023-09-13T06:00:45.832 INFO:teuthology.orchestra.run.smithi130.stdout: mon op complaint time = 120 2023-09-13T06:00:45.832 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull ratio = 0.6 2023-09-13T06:00:45.832 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.7 2023-09-13T06:00:45.832 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.6 2023-09-13T06:00:45.833 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:00:45.833 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2023-09-13T06:00:45.833 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2023-09-13T06:00:45.833 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2023-09-13T06:00:45.833 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2023-09-13T06:00:45.833 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-13T06:00:45.834 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-13T06:00:45.834 INFO:teuthology.orchestra.run.smithi130.stdout: client mount timeout = 600 2023-09-13T06:00:45.834 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2023-09-13T06:00:45.834 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-09-13T06:00:45.834 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = "" 2023-09-13T06:00:45.835 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2023-09-13T06:00:45.835 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2023-09-13T06:00:45.835 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2023-09-13T06:00:45.835 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2023-09-13T06:00:45.835 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2023-09-13T06:00:45.836 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2023-09-13T06:00:45.836 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2023-09-13T06:00:45.836 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2023-09-13T06:00:45.836 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2023-09-13T06:00:45.836 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:00:45.836 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2023-09-13T06:00:45.837 INFO:teuthology.orchestra.run.smithi130.stdout: debug objectcacher = 20 2023-09-13T06:00:45.837 INFO:teuthology.orchestra.run.smithi130.stdout: debug objecter = 20 2023-09-13T06:00:45.837 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2023-09-13T06:00:45.837 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2023-09-13T06:00:45.837 INFO:teuthology.orchestra.run.smithi130.stdout: debug objectcacher = 20 2023-09-13T06:00:45.838 INFO:teuthology.orchestra.run.smithi130.stdout: debug objecter = 20 2023-09-13T06:00:45.838 INFO:teuthology.orchestra.run.smithi130.stdout:[mds] 2023-09-13T06:00:45.838 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds = 20 2023-09-13T06:00:45.838 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds balancer = 20 2023-09-13T06:00:45.839 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-09-13T06:00:45.839 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug frag = True 2023-09-13T06:00:45.839 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug scatterstat = True 2023-09-13T06:00:45.839 INFO:teuthology.orchestra.run.smithi130.stdout: mds op complaint time = 180 2023-09-13T06:00:45.839 INFO:teuthology.orchestra.run.smithi130.stdout: mds verify scatter = True 2023-09-13T06:00:45.839 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2023-09-13T06:00:45.840 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2023-09-13T06:00:45.840 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2023-09-13T06:00:45.842 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2023-09-13T06:00:45.842 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2023-09-13T06:00:45.842 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-13T06:00:45.843 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2023-09-13T06:00:45.843 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.843 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2023-09-13T06:00:45.843 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.844 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2023-09-13T06:00:45.844 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.844 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2023-09-13T06:00:45.845 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2023-09-13T06:00:45.845 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.845 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2023-09-13T06:00:45.845 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2023-09-13T06:00:45.846 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.846 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-13T06:00:45.846 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2023-09-13T06:00:45.846 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.846 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2023-09-13T06:00:45.847 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-13T06:00:45.847 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.847 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2023-09-13T06:00:45.847 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.847 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2023-09-13T06:00:45.847 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2023-09-13T06:00:45.848 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2023-09-13T06:00:45.848 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2023-09-13T06:00:45.848 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2023-09-13T06:00:45.848 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2023-09-13T06:00:45.848 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2023-09-13T06:00:45.849 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-13T06:00:45.849 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-13T06:00:45.849 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2023-09-13T06:00:45.849 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.849 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-13T06:00:45.850 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.850 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2023-09-13T06:00:45.850 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.850 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2023-09-13T06:00:45.850 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.851 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2023-09-13T06:00:45.851 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2023-09-13T06:00:45.851 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2023-09-13T06:00:45.852 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.130,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2023-09-13T06:00:45.852 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on skipped message = False 2023-09-13T06:00:45.852 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 33902c8f-11a4-444c-a37a-ca3bab8415c5 2023-09-13T06:00:45.852 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.853 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2023-09-13T06:00:45.853 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2023-09-13T06:00:45.853 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.854 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2023-09-13T06:00:45.854 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2023-09-13T06:00:45.854 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2023-09-13T06:00:45.854 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.854 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2023-09-13T06:00:45.855 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2023-09-13T06:00:45.855 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.855 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2023-09-13T06:00:45.855 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2023-09-13T06:00:45.855 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2023-09-13T06:00:45.856 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.856 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2023-09-13T06:00:45.856 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2023-09-13T06:00:45.856 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.856 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2023-09-13T06:00:45.857 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.857 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2023-09-13T06:00:45.857 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.857 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2023-09-13T06:00:45.858 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.858 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2023-09-13T06:00:45.858 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2023-09-13T06:00:45.858 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.859 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2023-09-13T06:00:45.859 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2023-09-13T06:00:45.859 INFO:teuthology.orchestra.run.smithi164.stdout: bdev async discard = True 2023-09-13T06:00:45.859 INFO:teuthology.orchestra.run.smithi164.stdout: bdev enable discard = True 2023-09-13T06:00:45.860 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore allocator = bitmap 2023-09-13T06:00:45.860 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2023-09-13T06:00:45.860 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2023-09-13T06:00:45.860 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2023-09-13T06:00:45.860 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2023-09-13T06:00:45.861 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-09-13T06:00:45.861 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2023-09-13T06:00:45.861 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2023-09-13T06:00:45.861 INFO:teuthology.orchestra.run.smithi164.stdout: memstore device bytes = 200000000 2023-09-13T06:00:45.861 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2023-09-13T06:00:45.862 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2023-09-13T06:00:45.862 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2023-09-13T06:00:45.862 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 1.0 2023-09-13T06:00:45.862 INFO:teuthology.orchestra.run.smithi164.stdout: osd mon report interval = 5 2023-09-13T06:00:45.862 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = memstore 2023-09-13T06:00:45.863 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2023-09-13T06:00:45.863 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.863 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2023-09-13T06:00:45.863 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-09-13T06:00:45.863 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2023-09-13T06:00:45.864 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2023-09-13T06:00:45.864 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2023-09-13T06:00:45.864 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2023-09-13T06:00:45.864 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2023-09-13T06:00:45.864 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2023-09-13T06:00:45.865 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.865 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2023-09-13T06:00:45.865 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-09-13T06:00:45.865 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2023-09-13T06:00:45.865 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2023-09-13T06:00:45.866 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2023-09-13T06:00:45.866 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2023-09-13T06:00:45.866 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2023-09-13T06:00:45.866 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2023-09-13T06:00:45.866 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2023-09-13T06:00:45.867 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2023-09-13T06:00:45.867 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2023-09-13T06:00:45.867 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.867 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-13T06:00:45.867 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2023-09-13T06:00:45.867 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2023-09-13T06:00:45.868 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.868 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2023-09-13T06:00:45.868 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-13T06:00:45.868 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-13T06:00:45.868 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.869 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2023-09-13T06:00:45.869 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2023-09-13T06:00:45.869 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.869 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2023-09-13T06:00:45.869 INFO:teuthology.orchestra.run.smithi164.stdout: mon op complaint time = 120 2023-09-13T06:00:45.870 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull ratio = 0.6 2023-09-13T06:00:45.870 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.7 2023-09-13T06:00:45.870 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.6 2023-09-13T06:00:45.870 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-09-13T06:00:45.870 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2023-09-13T06:00:45.871 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2023-09-13T06:00:45.871 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2023-09-13T06:00:45.871 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2023-09-13T06:00:45.871 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-13T06:00:45.871 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-13T06:00:45.872 INFO:teuthology.orchestra.run.smithi164.stdout: client mount timeout = 600 2023-09-13T06:00:45.872 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2023-09-13T06:00:45.872 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-09-13T06:00:45.872 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = "" 2023-09-13T06:00:45.872 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2023-09-13T06:00:45.873 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2023-09-13T06:00:45.873 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2023-09-13T06:00:45.873 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2023-09-13T06:00:45.873 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2023-09-13T06:00:45.873 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2023-09-13T06:00:45.874 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2023-09-13T06:00:45.874 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2023-09-13T06:00:45.874 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2023-09-13T06:00:45.874 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2023-09-13T06:00:45.874 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2023-09-13T06:00:45.875 INFO:teuthology.orchestra.run.smithi164.stdout: debug objectcacher = 20 2023-09-13T06:00:45.875 INFO:teuthology.orchestra.run.smithi164.stdout: debug objecter = 20 2023-09-13T06:00:45.875 INFO:teuthology.orchestra.run.smithi164.stdout:[client.1] 2023-09-13T06:00:45.875 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2023-09-13T06:00:45.875 INFO:teuthology.orchestra.run.smithi164.stdout: debug objectcacher = 20 2023-09-13T06:00:45.875 INFO:teuthology.orchestra.run.smithi164.stdout: debug objecter = 20 2023-09-13T06:00:45.876 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2023-09-13T06:00:45.876 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds = 20 2023-09-13T06:00:45.876 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds balancer = 20 2023-09-13T06:00:45.876 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-09-13T06:00:45.877 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug frag = True 2023-09-13T06:00:45.877 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug scatterstat = True 2023-09-13T06:00:45.877 INFO:teuthology.orchestra.run.smithi164.stdout: mds op complaint time = 180 2023-09-13T06:00:45.877 INFO:teuthology.orchestra.run.smithi164.stdout: mds verify scatter = True 2023-09-13T06:00:45.877 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2023-09-13T06:00:45.878 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2023-09-13T06:00:45.878 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2023-09-13T06:00:45.878 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-13T06:00:45.879 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-13T06:00:45.944 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-13T06:00:45.944 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:45.944 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-13T06:00:45.954 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:45.954 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-13T06:00:46.010 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:00:46.010 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:46.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-13T06:00:46.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-13T06:00:46.087 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:46.087 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:46.142 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:00:46.143 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:46.143 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-13T06:00:46.143 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-13T06:00:46.181 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:46.181 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:46.238 INFO:tasks.ceph:Setting up mon nodes... 2023-09-13T06:00:46.239 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-13T06:00:46.239 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-13T06:00:46.296 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-13T06:00:46.301 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-13T06:00:46.363 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-13T06:00:46.383 INFO:tasks.ceph:Setting up mds nodes... 2023-09-13T06:00:46.384 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-13T06:00:46.441 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-13T06:00:46.446 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-13T06:00:46.467 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-13T06:00:46.566 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-13T06:00:46.571 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-13T06:00:46.593 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-13T06:00:46.657 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-13T06:00:46.661 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-13T06:00:46.683 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-09-13T06:00:46.786 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-09-13T06:00:46.790 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-09-13T06:00:46.812 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-13T06:00:46.813 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-13T06:00:46.857 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-13T06:00:46.875 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-09-13T06:00:46.961 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-09-13T06:00:46.979 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-13T06:00:47.023 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-13T06:00:47.041 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-09-13T06:00:47.132 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-09-13T06:00:47.149 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-13T06:00:47.149 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-13T06:00:47.150 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-13T06:00:47.170 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T06:00:47.171 INFO:tasks.ceph:role: osd.0 2023-09-13T06:00:47.171 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:00:47.171 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-13T06:00:47.242 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T06:00:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T06:00:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T06:00:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T06:00:47.243 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T06:00:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-09-13T06:00:47.243 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T06:00:47.243 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T06:00:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T06:00:47.244 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T06:00:47.706 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-09-13T06:00:47.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-09-13T06:00:47.709 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-13T06:00:47.822 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-13T06:00:47.840 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2023-09-13T06:00:47.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:00:47.842 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-13T06:00:47.911 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T06:00:47.911 INFO:tasks.ceph:role: osd.1 2023-09-13T06:00:47.911 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:00:47.912 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-13T06:00:47.984 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T06:00:47.984 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T06:00:47.984 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T06:00:47.985 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T06:00:47.985 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T06:00:47.985 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-09-13T06:00:47.985 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T06:00:47.986 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T06:00:47.986 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T06:00:47.986 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T06:00:48.458 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-09-13T06:00:48.462 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-09-13T06:00:48.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-13T06:00:48.614 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-13T06:00:48.632 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2023-09-13T06:00:48.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:00:48.634 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-13T06:00:48.704 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T06:00:48.704 INFO:tasks.ceph:role: osd.2 2023-09-13T06:00:48.705 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:00:48.705 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-13T06:00:48.775 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T06:00:48.775 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T06:00:48.775 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T06:00:48.775 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T06:00:48.775 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T06:00:48.776 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-09-13T06:00:48.776 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T06:00:48.776 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T06:00:48.776 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T06:00:48.776 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T06:00:49.257 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-09-13T06:00:49.260 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-09-13T06:00:49.260 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-13T06:00:49.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-13T06:00:49.385 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2023-09-13T06:00:49.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:00:49.387 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-13T06:00:49.455 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T06:00:49.455 INFO:tasks.ceph:role: osd.3 2023-09-13T06:00:49.456 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:00:49.456 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-13T06:00:49.526 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T06:00:49.527 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T06:00:49.527 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T06:00:49.527 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T06:00:49.527 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T06:00:49.527 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-09-13T06:00:49.528 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T06:00:49.528 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T06:00:49.528 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T06:00:49.528 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T06:00:49.978 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-09-13T06:00:49.981 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-09-13T06:00:49.981 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-13T06:00:50.078 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-13T06:00:50.096 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2023-09-13T06:00:50.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:00:50.098 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:50.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.229+0000 7f7fc6d3a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-13T06:00:50.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.233+0000 7f7fc6d3a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-13T06:00:50.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.237+0000 7f7fc6d3a640 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-09-13T06:00:50.260 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-13T06:00:50.282 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:50.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.373+0000 7f61a072d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-13T06:00:50.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.377+0000 7f61a072d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-13T06:00:50.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.377+0000 7f61a072d640 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-09-13T06:00:50.408 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-13T06:00:50.429 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:50.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.521+0000 7f47151d8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-13T06:00:50.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.521+0000 7f47151d8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-13T06:00:50.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.529+0000 7f47151d8640 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-09-13T06:00:50.554 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-13T06:00:50.575 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:50.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.673+0000 7f26522f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-13T06:00:50.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.677+0000 7f26522f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-13T06:00:50.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:50.685+0000 7f26522f9640 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-09-13T06:00:50.717 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-13T06:00:50.738 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-13T06:00:50.762 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T06:00:50.762 INFO:tasks.ceph:role: osd.4 2023-09-13T06:00:50.763 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:00:50.763 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-13T06:00:50.835 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T06:00:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T06:00:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T06:00:50.835 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T06:00:50.836 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T06:00:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2023-09-13T06:00:50.836 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T06:00:50.836 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T06:00:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T06:00:50.837 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T06:00:51.292 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2023-09-13T06:00:51.295 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2023-09-13T06:00:51.295 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-13T06:00:51.412 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-13T06:00:51.432 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: /sbin/restorecon: command not found 2023-09-13T06:00:51.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:00:51.433 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-13T06:00:51.502 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T06:00:51.502 INFO:tasks.ceph:role: osd.5 2023-09-13T06:00:51.503 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:00:51.503 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-13T06:00:51.575 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T06:00:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T06:00:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T06:00:51.575 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T06:00:51.576 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T06:00:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2023-09-13T06:00:51.576 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T06:00:51.576 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T06:00:51.576 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T06:00:51.577 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T06:00:52.070 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2023-09-13T06:00:52.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2023-09-13T06:00:52.073 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-13T06:00:52.207 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-13T06:00:52.225 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: /sbin/restorecon: command not found 2023-09-13T06:00:52.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:00:52.227 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-13T06:00:52.294 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T06:00:52.294 INFO:tasks.ceph:role: osd.6 2023-09-13T06:00:52.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:00:52.295 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-13T06:00:52.366 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T06:00:52.367 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T06:00:52.367 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T06:00:52.368 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T06:00:52.368 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T06:00:52.368 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2023-09-13T06:00:52.369 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T06:00:52.369 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T06:00:52.369 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T06:00:52.370 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T06:00:52.853 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2023-09-13T06:00:52.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2023-09-13T06:00:52.856 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-13T06:00:52.974 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-13T06:00:52.992 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: /sbin/restorecon: command not found 2023-09-13T06:00:52.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:00:52.995 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-13T06:00:53.062 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T06:00:53.062 INFO:tasks.ceph:role: osd.7 2023-09-13T06:00:53.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:00:53.063 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-13T06:00:53.133 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T06:00:53.134 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T06:00:53.134 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T06:00:53.134 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T06:00:53.135 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T06:00:53.135 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2023-09-13T06:00:53.135 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T06:00:53.135 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T06:00:53.135 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T06:00:53.136 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T06:00:53.590 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2023-09-13T06:00:53.594 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2023-09-13T06:00:53.594 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-13T06:00:53.708 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-13T06:00:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: /sbin/restorecon: command not found 2023-09-13T06:00:53.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:00:53.729 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:53.875 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:53.873+0000 7fe3ed165640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-13T06:00:53.880 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:53.877+0000 7fe3ed165640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-13T06:00:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:53.881+0000 7fe3ed165640 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-09-13T06:00:53.903 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-13T06:00:53.924 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:54.023 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:54.021+0000 7f42306f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-13T06:00:54.031 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:54.029+0000 7f42306f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-13T06:00:54.037 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:54.037+0000 7f42306f9640 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-09-13T06:00:54.066 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-13T06:00:54.088 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:54.187 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:54.185+0000 7fe84b584640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-13T06:00:54.192 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:54.189+0000 7fe84b584640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-13T06:00:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:54.201+0000 7fe84b584640 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-09-13T06:00:54.230 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-13T06:00:54.253 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:54.350 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:54.349+0000 7f4be4175640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-13T06:00:54.353 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:54.353+0000 7f4be4175640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-13T06:00:54.360 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:00:54.357+0000 7f4be4175640 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-09-13T06:00:54.385 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-13T06:00:54.406 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-13T06:00:54.406 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:54.407 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-13T06:00:54.430 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:54.431 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-13T06:00:54.495 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:54.495 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-13T06:00:54.559 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:54.559 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-13T06:00:54.623 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:54.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-13T06:00:54.687 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:54.688 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-13T06:00:54.755 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:54.755 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-13T06:00:54.823 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:54.823 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-13T06:00:54.844 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:54.844 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-13T06:00:54.904 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:54.904 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-09-13T06:00:54.963 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:54.964 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-13T06:00:55.028 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:55.029 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-13T06:00:55.091 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:55.092 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-13T06:00:55.152 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:55.152 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-13T06:00:55.211 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:55.212 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-13T06:00:55.222 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:00:55.223 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-09-13T06:00:55.279 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:55.279 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-13T06:00:55.288 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:00:55.288 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-09-13T06:00:55.340 INFO:tasks.ceph:Adding keys to all mons... 2023-09-13T06:00:55.341 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-13T06:00:55.344 DEBUG:teuthology.orchestra.run.smithi164:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-13T06:00:55.392 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.y] 2023-09-13T06:00:55.393 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA== 2023-09-13T06:00:55.393 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2023-09-13T06:00:55.393 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw== 2023-09-13T06:00:55.393 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2023-09-13T06:00:55.393 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A== 2023-09-13T06:00:55.394 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2023-09-13T06:00:55.394 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw== 2023-09-13T06:00:55.394 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2023-09-13T06:00:55.394 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ== 2023-09-13T06:00:55.394 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2023-09-13T06:00:55.395 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw== 2023-09-13T06:00:55.395 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.3] 2023-09-13T06:00:55.395 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g== 2023-09-13T06:00:55.395 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2023-09-13T06:00:55.395 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ== 2023-09-13T06:00:55.395 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2023-09-13T06:00:55.396 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg== 2023-09-13T06:00:55.396 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2023-09-13T06:00:55.396 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg== 2023-09-13T06:00:55.396 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.4] 2023-09-13T06:00:55.396 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ== 2023-09-13T06:00:55.397 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.5] 2023-09-13T06:00:55.397 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw== 2023-09-13T06:00:55.397 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.6] 2023-09-13T06:00:55.397 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA== 2023-09-13T06:00:55.397 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.7] 2023-09-13T06:00:55.397 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA== 2023-09-13T06:00:55.398 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:00:55.398 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:00:55.398 INFO:teuthology.orchestra.run.smithi130.stdout:[client.2] 2023-09-13T06:00:55.398 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw== 2023-09-13T06:00:55.399 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2023-09-13T06:00:55.399 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg== 2023-09-13T06:00:55.399 INFO:teuthology.orchestra.run.smithi130.stdout:[client.3] 2023-09-13T06:00:55.399 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA== 2023-09-13T06:00:55.405 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.y] 2023-09-13T06:00:55.406 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA== 2023-09-13T06:00:55.406 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2023-09-13T06:00:55.406 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw== 2023-09-13T06:00:55.406 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2023-09-13T06:00:55.406 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A== 2023-09-13T06:00:55.407 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.0] 2023-09-13T06:00:55.407 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw== 2023-09-13T06:00:55.407 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.1] 2023-09-13T06:00:55.407 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ== 2023-09-13T06:00:55.407 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.2] 2023-09-13T06:00:55.408 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw== 2023-09-13T06:00:55.408 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.3] 2023-09-13T06:00:55.408 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g== 2023-09-13T06:00:55.408 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.x] 2023-09-13T06:00:55.408 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ== 2023-09-13T06:00:55.409 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2023-09-13T06:00:55.409 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg== 2023-09-13T06:00:55.409 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2023-09-13T06:00:55.409 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg== 2023-09-13T06:00:55.410 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.4] 2023-09-13T06:00:55.410 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ== 2023-09-13T06:00:55.410 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.5] 2023-09-13T06:00:55.411 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw== 2023-09-13T06:00:55.411 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.6] 2023-09-13T06:00:55.411 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA== 2023-09-13T06:00:55.411 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.7] 2023-09-13T06:00:55.412 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA== 2023-09-13T06:00:55.412 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2023-09-13T06:00:55.412 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:00:55.412 INFO:teuthology.orchestra.run.smithi164.stdout:[client.2] 2023-09-13T06:00:55.413 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw== 2023-09-13T06:00:55.413 INFO:teuthology.orchestra.run.smithi164.stdout:[client.1] 2023-09-13T06:00:55.413 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg== 2023-09-13T06:00:55.414 INFO:teuthology.orchestra.run.smithi164.stdout:[client.3] 2023-09-13T06:00:55.414 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA== 2023-09-13T06:00:55.415 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T06:00:55.445 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T06:00:55.511 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T06:00:55.515 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T06:00:55.574 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T06:00:55.578 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T06:00:55.637 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:55.641 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:55.697 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:55.701 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:55.755 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:55.759 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:55.814 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:55.818 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:55.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T06:00:55.876 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T06:00:55.930 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T06:00:55.934 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T06:00:55.993 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T06:00:56.001 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T06:00:56.097 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:56.101 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:56.157 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:56.161 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:56.217 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:56.222 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:56.278 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:56.281 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T06:00:56.336 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T06:00:56.340 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T06:00:56.397 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T06:00:56.401 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T06:00:56.459 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T06:00:56.463 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T06:00:56.522 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T06:00:56.526 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T06:00:56.584 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-13T06:00:56.584 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-13T06:00:56.605 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-13T06:00:56.718 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-13T06:00:56.739 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-13T06:00:56.760 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-13T06:00:56.879 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-13T06:00:56.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-13T06:00:56.964 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-13T06:00:57.078 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-13T06:00:57.100 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:57.111 DEBUG:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-13T06:00:57.161 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-13T06:00:57.161 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-13T06:00:57.162 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-13T06:00:57.177 INFO:tasks.ceph.mon.a:Started 2023-09-13T06:00:57.177 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-13T06:00:57.178 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-13T06:00:57.214 INFO:tasks.ceph.mon.b:Started 2023-09-13T06:00:57.215 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-13T06:00:57.215 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-13T06:00:57.231 INFO:tasks.ceph.mon.c:Started 2023-09-13T06:00:57.232 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-13T06:00:57.232 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-13T06:00:57.233 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-13T06:00:57.240 INFO:tasks.ceph.mgr.y:Started 2023-09-13T06:00:57.241 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-13T06:00:57.241 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-13T06:00:57.252 INFO:tasks.ceph.mgr.x:Started 2023-09-13T06:00:57.253 INFO:tasks.ceph:Setting crush tunables to default 2023-09-13T06:00:57.254 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd crush tunables default 2023-09-13T06:00:57.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.393+0000 7fee16248640 1 Processor -- start 2023-09-13T06:00:57.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.393+0000 7fee16248640 1 -- start start 2023-09-13T06:00:57.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee16248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:00:57.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee16248640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:00:57.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee16248640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:00:57.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee16248640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee100ab700 con 0x7fee100d2b00 2023-09-13T06:00:57.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee16248640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee100aa120 con 0x7fee10161f10 2023-09-13T06:00:57.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee16248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee100aa400 con 0x7fee10146f10 2023-09-13T06:00:57.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0effd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:57.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0f7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:57.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0effd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:44802/0 (socket says 172.21.15.130:44802) 2023-09-13T06:00:57.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 learned_addr learned my addr 172.21.15.130:0/2428218789 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:00:57.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 msgr2=0x7fee100d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-13T06:00:57.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 msgr2=0x7fee100d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:57.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:57.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 msgr2=0x7fee100ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-13T06:00:57.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 msgr2=0x7fee100ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:57.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T06:00:57.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:57.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T06:00:57.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:57.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 msgr2=0x7fee100d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-13T06:00:57.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 msgr2=0x7fee100d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:57.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:57.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.397+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T06:00:57.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:57.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 msgr2=0x7fee100d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-13T06:00:57.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 msgr2=0x7fee100d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:57.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:57.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:57.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:57.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-13T06:00:57.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 msgr2=0x7fee100d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-13T06:00:57.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 msgr2=0x7fee100d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:57.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:57.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 msgr2=0x7fee100ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-13T06:00:57.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 msgr2=0x7fee100ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:57.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:57.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-13T06:00:57.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:57.601+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-13T06:00:58.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:58.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 msgr2=0x7fee100d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-13T06:00:58.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 msgr2=0x7fee100d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:58.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:58.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:58.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:58.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-13T06:00:58.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 msgr2=0x7fee100ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-13T06:00:58.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 msgr2=0x7fee100ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:58.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 msgr2=0x7fee100d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-13T06:00:58.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:58.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 msgr2=0x7fee100d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:58.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:58.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-13T06:00:58.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.005+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-13T06:00:58.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:58.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:58.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:00:58.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 msgr2=0x7fee100d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-13T06:00:58.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 msgr2=0x7fee100d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:58.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:58.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-13T06:00:58.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 msgr2=0x7fee100d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-13T06:00:58.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 msgr2=0x7fee100d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:58.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:58.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 msgr2=0x7fee100ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-13T06:00:58.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 msgr2=0x7fee100ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:00:58.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-13T06:00:58.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:00:58.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:00:58.809+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-13T06:01:00.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:00.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 msgr2=0x7fee100ab1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:00.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:00.397+0000 7fee0d7fa640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee10146f10 0x7fee100ab1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:00.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:00.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 msgr2=0x7fee100d25c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:00.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:00.397+0000 7fee0d7fa640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fee10161f10 0x7fee100d25c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:00.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:00.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 msgr2=0x7fee100d3340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:00.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:00.397+0000 7fee0d7fa640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fee100d2b00 0x7fee100d3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:00.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:00.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee100aa6e0 con 0x7fedf8007350 2023-09-13T06:01:00.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:00.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf800c0b0 con 0x7fedf80036a0 2023-09-13T06:01:03.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 >> v1:172.21.15.164:6789/0 conn(0x7fedf80036a0 legacy=0x7fedf8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:03.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 >> v1:172.21.15.130:6789/0 conn(0x7fedf8007350 legacy=0x7fedf8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:03.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0d7fa640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:03.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 reap_dead start 2023-09-13T06:01:03.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0d7fa640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:03.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf800d290 con 0x7fedf800cd30 2023-09-13T06:01:03.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee100ab700 con 0x7fedf800c3d0 2023-09-13T06:01:03.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee100aa120 con 0x7fedf8006250 2023-09-13T06:01:03.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:03.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:03.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 msgr2=0x7fedf800c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-13T06:01:03.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 msgr2=0x7fedf800c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:01:03.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:01:03.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T06:01:03.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 msgr2=0x7fedf80066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-13T06:01:03.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 msgr2=0x7fedf80066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:01:03.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:01:03.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.397+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T06:01:03.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.601+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:03.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.601+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:03.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.601+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 msgr2=0x7fedf800c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-13T06:01:03.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.601+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 msgr2=0x7fedf800c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:01:03.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.601+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:01:03.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.601+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 msgr2=0x7fedf80066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-13T06:01:03.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.601+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 msgr2=0x7fedf80066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:01:03.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.601+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:01:03.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.601+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-13T06:01:03.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:03.601+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-13T06:01:04.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.005+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:04.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.005+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:04.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.005+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 msgr2=0x7fedf80066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-13T06:01:04.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.005+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 msgr2=0x7fedf80066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:01:04.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.005+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:01:04.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.005+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-13T06:01:04.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.005+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 msgr2=0x7fedf800c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-13T06:01:04.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.005+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 msgr2=0x7fedf800c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:01:04.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.005+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:01:04.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.005+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-13T06:01:04.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.809+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:04.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.809+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:04.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.809+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 msgr2=0x7fedf80066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-13T06:01:04.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.809+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 msgr2=0x7fedf80066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:01:04.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.809+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:01:04.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.809+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-13T06:01:04.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.809+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 msgr2=0x7fedf800c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-13T06:01:04.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.809+0000 7fee0f7fe640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 msgr2=0x7fedf800c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:01:04.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.809+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:01:04.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:04.809+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-13T06:01:06.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 msgr2=0x7fedf80066d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:06.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0d7fa640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedf8006250 0x7fedf80066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:06.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 msgr2=0x7fedf800c7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:06.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0d7fa640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.164:3300/0 conn(0x7fedf800c3d0 0x7fedf800c7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:06.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 >> v1:172.21.15.130:6789/0 conn(0x7fedf800cd30 legacy=0x7fedf8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:06.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0d7fa640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 0x7fedf800a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:06.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf8006f70 con 0x7fedf8009ff0 2023-09-13T06:01:06.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0d7fa640 1 -- 172.21.15.130:0/2428218789 --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee100ab700 con 0x7fedf800a530 2023-09-13T06:01:06.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 0x7fedf800a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:06.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 msgr2=0x7fedf800a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-13T06:01:06.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 msgr2=0x7fedf800a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:01:06.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 0x7fedf800a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:01:06.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.397+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 0x7fedf800a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T06:01:06.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.601+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 0x7fedf800a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:06.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.601+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 msgr2=0x7fedf800a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-13T06:01:06.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.601+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 msgr2=0x7fedf800a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:01:06.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.601+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 0x7fedf800a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:01:06.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:06.601+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 0x7fedf800a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-13T06:01:07.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.005+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 0x7fedf800a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:07.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.005+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 msgr2=0x7fedf800a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-13T06:01:07.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.005+0000 7fee0effd640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 msgr2=0x7fedf800a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T06:01:07.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.005+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 0x7fedf800a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T06:01:07.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.005+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 0x7fedf800a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-13T06:01:07.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860294285 0 0) 0x7fedf8006f70 con 0x7fedf8009ff0 2023-09-13T06:01:07.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedfc003530 con 0x7fedf8009ff0 2023-09-13T06:01:07.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4010380846 0 0) 0x7fedfc003530 con 0x7fedf8009ff0 2023-09-13T06:01:07.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 msgr2=0x7fedf800a940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:07.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 --2- 172.21.15.130:0/2428218789 >> v2:172.21.15.130:3300/0 conn(0x7fedf800a530 0x7fedf800a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8015640 con 0x7fedf8009ff0 2023-09-13T06:01:07.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fee00004400 con 0x7fedf8009ff0 2023-09-13T06:01:07.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 >> v1:172.21.15.164:6789/0 conn(0x7fedf8009ff0 legacy=0x7fedf8009790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:07.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 reap_dead start 2023-09-13T06:01:07.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedfc003980 0x7fedfc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:07.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 0x7fedfc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:07.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedfc0052b0 0x7fedfc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:07.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee100ab700 con 0x7fedfc0052b0 2023-09-13T06:01:07.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc00c160 con 0x7fedfc0047d0 2023-09-13T06:01:07.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc00c320 con 0x7fedfc003980 2023-09-13T06:01:07.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedfc0052b0 0x7fedfc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:07.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0f7fe640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedfc003980 0x7fedfc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:07.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.541+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 0x7fedfc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:07.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.545+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedfc003980 msgr2=0x7fedfc003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:07.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.545+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedfc003980 0x7fedfc003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.545+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 msgr2=0x7fedfc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:07.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.545+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 0x7fedfc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.545+0000 7fee0ffff640 1 -- 172.21.15.130:0/2428218789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc003530 con 0x7fedfc0052b0 2023-09-13T06:01:07.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.545+0000 7fee0effd640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 0x7fedfc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:07.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.545+0000 7fee0ffff640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedfc0052b0 0x7fedfc00b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee10066880 tx=0x7fee0801db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca16cd4e15de75f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:07.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.545+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080a6510 con 0x7fedfc0052b0 2023-09-13T06:01:07.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.545+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee080aa070 con 0x7fedfc0052b0 2023-09-13T06:01:07.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.545+0000 7fee0e7fc640 1 -- 172.21.15.130:0/2428218789 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080a68f0 con 0x7fedfc0052b0 2023-09-13T06:01:07.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.549+0000 7fee16248640 1 -- 172.21.15.130:0/2428218789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedfc0052b0 msgr2=0x7fedfc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:07.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.549+0000 7fee16248640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedfc0052b0 0x7fedfc00b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee10066880 tx=0x7fee0801db40 comp rx=0 tx=0).stop 2023-09-13T06:01:07.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.549+0000 7fee16248640 1 -- 172.21.15.130:0/2428218789 shutdown_connections 2023-09-13T06:01:07.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.549+0000 7fee16248640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 0x7fedfc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.549+0000 7fee16248640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedfc0052b0 0x7fedfc00b990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.549+0000 7fee16248640 1 --2- 172.21.15.130:0/2428218789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedfc003980 0x7fedfc003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.549+0000 7fee16248640 1 -- 172.21.15.130:0/2428218789 >> 172.21.15.130:0/2428218789 conn(0x7fee10065990 msgr2=0x7fee10065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:07.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.549+0000 7fee16248640 1 -- 172.21.15.130:0/2428218789 shutdown_connections 2023-09-13T06:01:07.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.549+0000 7fee16248640 1 -- 172.21.15.130:0/2428218789 wait complete. 2023-09-13T06:01:07.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.549+0000 7fee16248640 1 Processor -- start 2023-09-13T06:01:07.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.549+0000 7fee16248640 1 -- start start 2023-09-13T06:01:07.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee16248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedfc003980 0x7fee1013cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:07.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee16248640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 0x7fee10141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:07.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee16248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedfc0052b0 0x7fee10142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:07.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee16248640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee10142a60 con 0x7fedfc0052b0 2023-09-13T06:01:07.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee16248640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee10142d40 con 0x7fedfc0047d0 2023-09-13T06:01:07.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee16248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee10143020 con 0x7fedfc003980 2023-09-13T06:01:07.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee0f7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedfc003980 0x7fee1013cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:07.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee0f7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedfc003980 0x7fee1013cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:41428/0 (socket says 172.21.15.130:41428) 2023-09-13T06:01:07.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee0f7fe640 1 -- 172.21.15.130:0/4007902821 learned_addr learned my addr 172.21.15.130:0/4007902821 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:07.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee0effd640 1 --2- 172.21.15.130:0/4007902821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 0x7fee10141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:07.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee0ffff640 1 --2- 172.21.15.130:0/4007902821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedfc0052b0 0x7fee10142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:07.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee0effd640 1 -- 172.21.15.130:0/4007902821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedfc003980 msgr2=0x7fee1013cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:07.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee0effd640 1 --2- 172.21.15.130:0/4007902821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedfc003980 0x7fee1013cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee0effd640 1 -- 172.21.15.130:0/4007902821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedfc0052b0 msgr2=0x7fee10142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:07.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee0effd640 1 --2- 172.21.15.130:0/4007902821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedfc0052b0 0x7fee10142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee0effd640 1 -- 172.21.15.130:0/4007902821 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee100b1f40 con 0x7fedfc0047d0 2023-09-13T06:01:07.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee0effd640 1 --2- 172.21.15.130:0/4007902821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 0x7fee10141ec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee04006f50 tx=0x7fee040188e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:07.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fedf7fff640 1 -- 172.21.15.130:0/4007902821 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0401d040 con 0x7fedfc0047d0 2023-09-13T06:01:07.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fedf7fff640 1 -- 172.21.15.130:0/4007902821 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0400c040 con 0x7fedfc0047d0 2023-09-13T06:01:07.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fedf7fff640 1 -- 172.21.15.130:0/4007902821 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04017b10 con 0x7fedfc0047d0 2023-09-13T06:01:07.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee16248640 1 -- 172.21.15.130:0/4007902821 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee10143300 con 0x7fedfc0047d0 2023-09-13T06:01:07.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee16248640 1 -- 172.21.15.130:0/4007902821 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1015fd00 con 0x7fedfc0047d0 2023-09-13T06:01:07.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fedf7fff640 1 -- 172.21.15.130:0/4007902821 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fee04022480 con 0x7fedfc0047d0 2023-09-13T06:01:07.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fedf7fff640 1 -- 172.21.15.130:0/4007902821 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fee0402c8f0 con 0x7fedfc0047d0 2023-09-13T06:01:07.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.553+0000 7fee16248640 1 -- 172.21.15.130:0/4007902821 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee100674a0 con 0x7fedfc0047d0 2023-09-13T06:01:07.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.557+0000 7fedf7fff640 1 -- 172.21.15.130:0/4007902821 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fee04031060 con 0x7fedfc0047d0 2023-09-13T06:01:07.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.617+0000 7fee16248640 1 -- 172.21.15.130:0/4007902821 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fee1013dbb0 con 0x7fedfc0047d0 2023-09-13T06:01:07.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.625+0000 7fedf7fff640 1 -- 172.21.15.130:0/4007902821 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fee04027070 con 0x7fedfc0047d0 2023-09-13T06:01:07.629 INFO:teuthology.orchestra.run.smithi130.stderr:adjusted tunables profile to default 2023-09-13T06:01:07.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.625+0000 7fee16248640 1 -- 172.21.15.130:0/4007902821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 msgr2=0x7fee10141ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:07.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.625+0000 7fee16248640 1 --2- 172.21.15.130:0/4007902821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 0x7fee10141ec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee04006f50 tx=0x7fee040188e0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.625+0000 7fee16248640 1 -- 172.21.15.130:0/4007902821 shutdown_connections 2023-09-13T06:01:07.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.625+0000 7fee16248640 1 --2- 172.21.15.130:0/4007902821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedfc0047d0 0x7fee10141ec0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.625+0000 7fee16248640 1 --2- 172.21.15.130:0/4007902821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedfc0052b0 0x7fee10142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.625+0000 7fee16248640 1 --2- 172.21.15.130:0/4007902821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fedfc003980 0x7fee1013cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:07.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.625+0000 7fee16248640 1 -- 172.21.15.130:0/4007902821 >> 172.21.15.130:0/4007902821 conn(0x7fee10065990 msgr2=0x7fee1015ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:07.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.625+0000 7fee16248640 1 -- 172.21.15.130:0/4007902821 shutdown_connections 2023-09-13T06:01:07.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:07.625+0000 7fee16248640 1 -- 172.21.15.130:0/4007902821 wait complete. 2023-09-13T06:01:07.650 INFO:tasks.ceph:check_enable_crimson: False 2023-09-13T06:01:07.650 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-13T06:01:07.651 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:01:07.651 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-13T06:01:07.672 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:01:07.673 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-13T06:01:07.734 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:01:07.735 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-13T06:01:07.742 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:07.741+0000 7f94ddd2a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-13T06:01:07.762 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:07.761+0000 7fbc5582c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-13T06:01:07.763 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:01:07.763 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-13T06:01:07.826 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:01:07.826 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-13T06:01:07.848 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:01:07.848 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-13T06:01:07.913 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:01:07.914 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-13T06:01:07.977 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:01:07.977 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-13T06:01:08.044 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-09-13T06:01:08.225 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.221+0000 7ff7019ac640 1 Processor -- start 2023-09-13T06:01:08.225 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff7019ac640 1 -- start start 2023-09-13T06:01:08.227 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff7019ac640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff6fc146f10 0x7ff6fc0ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.227 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff7019ac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff6fc0d3340 0x7ff6fc0d37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.227 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff7019ac640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0ab700 con 0x7ff6fc161f10 2023-09-13T06:01:08.227 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff7019ac640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0d3d30 con 0x7ff6fc0d3340 2023-09-13T06:01:08.228 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff7019ac640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0d2cd0 con 0x7ff6fc146f10 2023-09-13T06:01:08.228 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff6faffd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff6fc146f10 0x7ff6fc0ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.228 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff6faffd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff6fc146f10 0x7ff6fc0ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57538/0 (socket says 172.21.15.164:57538) 2023-09-13T06:01:08.228 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff6faffd640 1 -- 172.21.15.164:0/386741588 learned_addr learned my addr 172.21.15.164:0/386741588 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:08.228 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff6fb7fe640 1 --2- 172.21.15.164:0/386741588 >> v2:172.21.15.130:3300/0 conn(0x7ff6fc0d3340 0x7ff6fc0d37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.229 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff6faffd640 1 -- 172.21.15.164:0/386741588 >> v2:172.21.15.130:3300/0 conn(0x7ff6fc0d3340 msgr2=0x7ff6fc0d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:08.229 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff6faffd640 1 --2- 172.21.15.164:0/386741588 >> v2:172.21.15.130:3300/0 conn(0x7ff6fc0d3340 0x7ff6fc0d37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.229 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff6faffd640 1 -- 172.21.15.164:0/386741588 >> v1:172.21.15.130:6789/0 conn(0x7ff6fc161f10 legacy=0x7ff6fc0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.229 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.225+0000 7ff6faffd640 1 -- 172.21.15.164:0/386741588 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0aa120 con 0x7ff6fc146f10 2023-09-13T06:01:08.231 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff6faffd640 1 --2- 172.21.15.164:0/386741588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc146f10 0x7ff6fc0ab1c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0d3e70 tx=0x7ff6ec01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdbc59afba5ad348 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:08.231 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff6f9ffb640 1 -- 172.21.15.164:0/386741588 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec0aa430 con 0x7ff6fc146f10 2023-09-13T06:01:08.231 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff6f9ffb640 1 -- 172.21.15.164:0/386741588 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec0aa590 con 0x7ff6fc146f10 2023-09-13T06:01:08.231 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff6f9ffb640 1 -- 172.21.15.164:0/386741588 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec0aa920 con 0x7ff6fc146f10 2023-09-13T06:01:08.231 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff7019ac640 1 -- 172.21.15.164:0/386741588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc146f10 msgr2=0x7ff6fc0ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.232 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff7019ac640 1 --2- 172.21.15.164:0/386741588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc146f10 0x7ff6fc0ab1c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0d3e70 tx=0x7ff6ec01c4d0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.232 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff7019ac640 1 -- 172.21.15.164:0/386741588 shutdown_connections 2023-09-13T06:01:08.232 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff7019ac640 1 --2- 172.21.15.164:0/386741588 >> v2:172.21.15.130:3300/0 conn(0x7ff6fc0d3340 0x7ff6fc0d37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.232 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff7019ac640 1 --2- 172.21.15.164:0/386741588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc146f10 0x7ff6fc0ab1c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.232 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff7019ac640 1 -- 172.21.15.164:0/386741588 >> 172.21.15.164:0/386741588 conn(0x7ff6fc065990 msgr2=0x7ff6fc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:08.233 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff7019ac640 1 -- 172.21.15.164:0/386741588 shutdown_connections 2023-09-13T06:01:08.233 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.229+0000 7ff7019ac640 1 -- 172.21.15.164:0/386741588 wait complete. 2023-09-13T06:01:08.234 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff7019ac640 1 Processor -- start 2023-09-13T06:01:08.235 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff7019ac640 1 -- start start 2023-09-13T06:01:08.235 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff7019ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc0d3340 0x7ff6fc15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.235 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff7019ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc146f10 0x7ff6fc1504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.236 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff7019ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6fc15ba40 0x7ff6fc14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.236 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff7019ac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc150dc0 con 0x7ff6fc146f10 2023-09-13T06:01:08.236 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff7019ac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc15e530 con 0x7ff6fc0d3340 2023-09-13T06:01:08.236 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff7019ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc15e7d0 con 0x7ff6fc15ba40 2023-09-13T06:01:08.236 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6faffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc0d3340 0x7ff6fc15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.237 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6faffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc0d3340 0x7ff6fc15d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57554/0 (socket says 172.21.15.164:57554) 2023-09-13T06:01:08.237 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6faffd640 1 -- 172.21.15.164:0/1494107789 learned_addr learned my addr 172.21.15.164:0/1494107789 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:08.237 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6fa7fc640 1 --2- 172.21.15.164:0/1494107789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc146f10 0x7ff6fc1504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.237 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6fb7fe640 1 --2- 172.21.15.164:0/1494107789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6fc15ba40 0x7ff6fc14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.237 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6fa7fc640 1 -- 172.21.15.164:0/1494107789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6fc15ba40 msgr2=0x7ff6fc14da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.238 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6fa7fc640 1 --2- 172.21.15.164:0/1494107789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6fc15ba40 0x7ff6fc14da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.238 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6fa7fc640 1 -- 172.21.15.164:0/1494107789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc0d3340 msgr2=0x7ff6fc15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.238 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6fa7fc640 1 --2- 172.21.15.164:0/1494107789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc0d3340 0x7ff6fc15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.238 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6fa7fc640 1 -- 172.21.15.164:0/1494107789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec0094d0 con 0x7ff6fc146f10 2023-09-13T06:01:08.240 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6fa7fc640 1 --2- 172.21.15.164:0/1494107789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc146f10 0x7ff6fc1504c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0000f70 tx=0x7ff6f000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:08.240 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6e3fff640 1 -- 172.21.15.164:0/1494107789 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00052d0 con 0x7ff6fc146f10 2023-09-13T06:01:08.240 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6e3fff640 1 -- 172.21.15.164:0/1494107789 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0005430 con 0x7ff6fc146f10 2023-09-13T06:01:08.241 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff7019ac640 1 -- 172.21.15.164:0/1494107789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc15eab0 con 0x7ff6fc146f10 2023-09-13T06:01:08.241 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6e3fff640 1 -- 172.21.15.164:0/1494107789 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0003840 con 0x7ff6fc146f10 2023-09-13T06:01:08.241 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff7019ac640 1 -- 172.21.15.164:0/1494107789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc15d8e0 con 0x7ff6fc146f10 2023-09-13T06:01:08.241 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6e3fff640 1 -- 172.21.15.164:0/1494107789 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff6f0003ca0 con 0x7ff6fc146f10 2023-09-13T06:01:08.242 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff6e3fff640 1 -- 172.21.15.164:0/1494107789 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff6f001c780 con 0x7ff6fc146f10 2023-09-13T06:01:08.242 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.233+0000 7ff7019ac640 1 -- 172.21.15.164:0/1494107789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc0aa970 con 0x7ff6fc146f10 2023-09-13T06:01:08.246 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.245+0000 7ff6e3fff640 1 -- 172.21.15.164:0/1494107789 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ff6f0017070 con 0x7ff6fc146f10 2023-09-13T06:01:08.297 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:08.293+0000 7f94ddd2a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-13T06:01:08.312 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.309+0000 7ff7019ac640 1 -- 172.21.15.164:0/1494107789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7ff6fc0674a0 con 0x7ff6fc146f10 2023-09-13T06:01:08.316 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.313+0000 7ff6e3fff640 1 -- 172.21.15.164:0/1494107789 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff6f00115e0 con 0x7ff6fc146f10 2023-09-13T06:01:08.316 INFO:teuthology.orchestra.run.smithi164.stdout:0 2023-09-13T06:01:08.318 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.317+0000 7ff7019ac640 1 -- 172.21.15.164:0/1494107789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc146f10 msgr2=0x7ff6fc1504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.318 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.317+0000 7ff7019ac640 1 --2- 172.21.15.164:0/1494107789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc146f10 0x7ff6fc1504c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0000f70 tx=0x7ff6f000c820 comp rx=0 tx=0).stop 2023-09-13T06:01:08.318 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.317+0000 7ff7019ac640 1 -- 172.21.15.164:0/1494107789 shutdown_connections 2023-09-13T06:01:08.319 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.317+0000 7ff7019ac640 1 --2- 172.21.15.164:0/1494107789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6fc15ba40 0x7ff6fc14da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.319 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.317+0000 7ff7019ac640 1 --2- 172.21.15.164:0/1494107789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc146f10 0x7ff6fc1504c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.319 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.317+0000 7ff7019ac640 1 --2- 172.21.15.164:0/1494107789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc0d3340 0x7ff6fc15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.319 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.317+0000 7ff7019ac640 1 -- 172.21.15.164:0/1494107789 >> 172.21.15.164:0/1494107789 conn(0x7ff6fc065990 msgr2=0x7ff6fc1569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:08.320 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.317+0000 7ff7019ac640 1 -- 172.21.15.164:0/1494107789 shutdown_connections 2023-09-13T06:01:08.320 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.317+0000 7ff7019ac640 1 -- 172.21.15.164:0/1494107789 wait complete. 2023-09-13T06:01:08.336 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-09-13T06:01:08.352 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:08.349+0000 7fbc5582c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-13T06:01:08.473 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.469+0000 7faa9f710640 1 Processor -- start 2023-09-13T06:01:08.473 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa9f710640 1 -- start start 2023-09-13T06:01:08.475 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa9f710640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faa98146f10 0x7faa980ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.475 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa9f710640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa980ab700 con 0x7faa980d3340 2023-09-13T06:01:08.475 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa9f710640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa980d2cd0 con 0x7faa98161f10 2023-09-13T06:01:08.476 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa9f710640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa980aa120 con 0x7faa98146f10 2023-09-13T06:01:08.476 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa9ccab640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7faa98161f10 0x7faa980d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:34978/0 (socket says 172.21.15.164:34978) 2023-09-13T06:01:08.476 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa9ccab640 1 -- 172.21.15.164:0/2964837564 learned_addr learned my addr 172.21.15.164:0/2964837564 (peer_addr_for_me v1:172.21.15.164:0/0) 2023-09-13T06:01:08.477 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa9d4ac640 1 --2- 172.21.15.164:0/2964837564 >> v2:172.21.15.130:3300/0 conn(0x7faa98146f10 0x7faa980ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.477 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa8ffff640 1 -- 172.21.15.164:0/2964837564 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55385473 0 0) 0x7faa980d2cd0 con 0x7faa98161f10 2023-09-13T06:01:08.477 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa8ffff640 1 -- 172.21.15.164:0/2964837564 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa84003530 con 0x7faa98161f10 2023-09-13T06:01:08.478 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa9d4ac640 1 -- 172.21.15.164:0/2964837564 >> v1:172.21.15.164:6789/0 conn(0x7faa98161f10 legacy=0x7faa980d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.478 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa9d4ac640 1 -- 172.21.15.164:0/2964837564 >> v1:172.21.15.130:6789/0 conn(0x7faa980d3340 legacy=0x7faa9815dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.478 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa8ffff640 1 -- 172.21.15.164:0/2964837564 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47719460 0 0) 0x7faa980ab700 con 0x7faa980d3340 2023-09-13T06:01:08.478 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.473+0000 7faa9d4ac640 1 -- 172.21.15.164:0/2964837564 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa980aa400 con 0x7faa98146f10 2023-09-13T06:01:08.480 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.477+0000 7faa9d4ac640 1 --2- 172.21.15.164:0/2964837564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa98146f10 0x7faa980ab1c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faa940097c0 tx=0x7faa9401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff11ab9c45f08883 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:08.481 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.477+0000 7faa8ffff640 1 -- 172.21.15.164:0/2964837564 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940ab650 con 0x7faa98146f10 2023-09-13T06:01:08.482 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.477+0000 7faa8ffff640 1 -- 172.21.15.164:0/2964837564 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa940ab7b0 con 0x7faa98146f10 2023-09-13T06:01:08.482 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.477+0000 7faa8ffff640 1 -- 172.21.15.164:0/2964837564 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940abb40 con 0x7faa98146f10 2023-09-13T06:01:08.483 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.477+0000 7faa9f710640 1 -- 172.21.15.164:0/2964837564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa98146f10 msgr2=0x7faa980ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.483 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.477+0000 7faa9f710640 1 --2- 172.21.15.164:0/2964837564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa98146f10 0x7faa980ab1c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faa940097c0 tx=0x7faa9401c450 comp rx=0 tx=0).stop 2023-09-13T06:01:08.484 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.477+0000 7faa9f710640 1 -- 172.21.15.164:0/2964837564 shutdown_connections 2023-09-13T06:01:08.484 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.477+0000 7faa9f710640 1 --2- 172.21.15.164:0/2964837564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa98146f10 0x7faa980ab1c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.485 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.477+0000 7faa9f710640 1 -- 172.21.15.164:0/2964837564 >> 172.21.15.164:0/2964837564 conn(0x7faa98065990 msgr2=0x7faa98065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:08.485 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.477+0000 7faa9f710640 1 -- 172.21.15.164:0/2964837564 shutdown_connections 2023-09-13T06:01:08.485 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.477+0000 7faa9f710640 1 -- 172.21.15.164:0/2964837564 wait complete. 2023-09-13T06:01:08.486 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9f710640 1 Processor -- start 2023-09-13T06:01:08.489 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9f710640 1 -- start start 2023-09-13T06:01:08.490 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9f710640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa980d3340 0x7faa98156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.490 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9f710640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa98146f10 0x7faa980cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.490 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9f710640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa98154cf0 0x7faa981527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.491 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9f710640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9813d140 con 0x7faa98146f10 2023-09-13T06:01:08.491 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9f710640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa98157ea0 con 0x7faa980d3340 2023-09-13T06:01:08.491 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9f710640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa98155460 con 0x7faa98154cf0 2023-09-13T06:01:08.491 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9d4ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa980d3340 0x7faa98156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.492 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9dcad640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa98154cf0 0x7faa981527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.492 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9d4ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa980d3340 0x7faa98156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57558/0 (socket says 172.21.15.164:57558) 2023-09-13T06:01:08.492 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9d4ac640 1 -- 172.21.15.164:0/1578171958 learned_addr learned my addr 172.21.15.164:0/1578171958 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:08.492 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9ccab640 1 --2- 172.21.15.164:0/1578171958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa98146f10 0x7faa980cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.493 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9d4ac640 1 -- 172.21.15.164:0/1578171958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa98154cf0 msgr2=0x7faa981527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.494 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9d4ac640 1 --2- 172.21.15.164:0/1578171958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa98154cf0 0x7faa981527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.494 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9d4ac640 1 -- 172.21.15.164:0/1578171958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa98146f10 msgr2=0x7faa980cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.494 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9d4ac640 1 --2- 172.21.15.164:0/1578171958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa98146f10 0x7faa980cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.494 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9d4ac640 1 -- 172.21.15.164:0/1578171958 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa94009420 con 0x7faa980d3340 2023-09-13T06:01:08.495 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9ccab640 1 --2- 172.21.15.164:0/1578171958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa98146f10 0x7faa980cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:08.495 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9d4ac640 1 --2- 172.21.15.164:0/1578171958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa980d3340 0x7faa98156b90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faa940ad040 tx=0x7faa9401ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:08.496 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa8dffb640 1 -- 172.21.15.164:0/1578171958 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940b5600 con 0x7faa980d3340 2023-09-13T06:01:08.496 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa8dffb640 1 -- 172.21.15.164:0/1578171958 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa940b5760 con 0x7faa980d3340 2023-09-13T06:01:08.497 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa8dffb640 1 -- 172.21.15.164:0/1578171958 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940b5af0 con 0x7faa980d3340 2023-09-13T06:01:08.497 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9f710640 1 -- 172.21.15.164:0/1578171958 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa98157290 con 0x7faa980d3340 2023-09-13T06:01:08.497 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa9f710640 1 -- 172.21.15.164:0/1578171958 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa98157850 con 0x7faa980d3340 2023-09-13T06:01:08.497 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa8dffb640 1 -- 172.21.15.164:0/1578171958 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faa940bf450 con 0x7faa980d3340 2023-09-13T06:01:08.498 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.481+0000 7faa8dffb640 1 -- 172.21.15.164:0/1578171958 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7faa940b3790 con 0x7faa980d3340 2023-09-13T06:01:08.498 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.485+0000 7faa9f710640 1 -- 172.21.15.164:0/1578171958 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa980674a0 con 0x7faa980d3340 2023-09-13T06:01:08.498 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.485+0000 7faa8dffb640 1 -- 172.21.15.164:0/1578171958 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7faa940c4060 con 0x7faa980d3340 2023-09-13T06:01:08.544 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:08.541+0000 7f94ddd2a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-13T06:01:08.555 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.553+0000 7faa9f710640 1 -- 172.21.15.164:0/1578171958 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7faa98073e50 con 0x7faa980d3340 2023-09-13T06:01:08.556 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:08.553+0000 7fbc5582c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-13T06:01:08.559 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.557+0000 7faa8dffb640 1 -- 172.21.15.164:0/1578171958 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7faa940b3a80 con 0x7faa980d3340 2023-09-13T06:01:08.560 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:01:08.561 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.561+0000 7faa9f710640 1 -- 172.21.15.164:0/1578171958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa980d3340 msgr2=0x7faa98156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.561 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.561+0000 7faa9f710640 1 --2- 172.21.15.164:0/1578171958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa980d3340 0x7faa98156b90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faa940ad040 tx=0x7faa9401ac90 comp rx=0 tx=0).stop 2023-09-13T06:01:08.562 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.561+0000 7faa9f710640 1 -- 172.21.15.164:0/1578171958 shutdown_connections 2023-09-13T06:01:08.562 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.561+0000 7faa9f710640 1 --2- 172.21.15.164:0/1578171958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa98154cf0 0x7faa981527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.562 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.561+0000 7faa9f710640 1 --2- 172.21.15.164:0/1578171958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa98146f10 0x7faa980cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.562 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.561+0000 7faa9f710640 1 --2- 172.21.15.164:0/1578171958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa980d3340 0x7faa98156b90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.562 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.561+0000 7faa9f710640 1 -- 172.21.15.164:0/1578171958 >> 172.21.15.164:0/1578171958 conn(0x7faa98065990 msgr2=0x7faa980d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:08.563 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.561+0000 7faa9f710640 1 -- 172.21.15.164:0/1578171958 shutdown_connections 2023-09-13T06:01:08.563 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.561+0000 7faa9f710640 1 -- 172.21.15.164:0/1578171958 wait complete. 2023-09-13T06:01:08.582 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-09-13T06:01:08.759 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.757+0000 7fc477f82640 1 Processor -- start 2023-09-13T06:01:08.759 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.757+0000 7fc477f82640 1 -- start start 2023-09-13T06:01:08.761 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc477f82640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc470161f10 0x7fc4700ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.761 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc477f82640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 0x7fc4700d37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.762 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc477f82640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4700ab700 con 0x7fc470146f10 2023-09-13T06:01:08.762 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc477f82640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4700d3d30 con 0x7fc470161f10 2023-09-13T06:01:08.762 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc477f82640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4700d2cd0 con 0x7fc4700d3340 2023-09-13T06:01:08.762 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc47551d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc470161f10 0x7fc4700ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.763 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc47651f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 0x7fc4700d37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.763 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc47551d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc470161f10 0x7fc4700ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57572/0 (socket says 172.21.15.164:57572) 2023-09-13T06:01:08.763 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc47551d640 1 -- 172.21.15.164:0/2617037234 learned_addr learned my addr 172.21.15.164:0/2617037234 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:08.763 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc47551d640 1 -- 172.21.15.164:0/2617037234 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 msgr2=0x7fc4700d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:08.763 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc47551d640 1 --2- 172.21.15.164:0/2617037234 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 0x7fc4700d37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.764 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc47551d640 1 -- 172.21.15.164:0/2617037234 >> v1:172.21.15.130:6789/0 conn(0x7fc470146f10 legacy=0x7fc4700d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.764 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc47551d640 1 -- 172.21.15.164:0/2617037234 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4700aa120 con 0x7fc470161f10 2023-09-13T06:01:08.764 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc47551d640 1 --2- 172.21.15.164:0/2617037234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc470161f10 0x7fc4700ab1c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4700d3e70 tx=0x7fc46001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=681581d117a97b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:08.765 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.761+0000 7fc474d1c640 1 -- 172.21.15.164:0/2617037234 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4600aa650 con 0x7fc470161f10 2023-09-13T06:01:08.765 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc474d1c640 1 -- 172.21.15.164:0/2617037234 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4600aa7b0 con 0x7fc470161f10 2023-09-13T06:01:08.765 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc474d1c640 1 -- 172.21.15.164:0/2617037234 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4600aab40 con 0x7fc470161f10 2023-09-13T06:01:08.767 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 -- 172.21.15.164:0/2617037234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc470161f10 msgr2=0x7fc4700ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.768 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 --2- 172.21.15.164:0/2617037234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc470161f10 0x7fc4700ab1c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4700d3e70 tx=0x7fc46001c4f0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.768 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 -- 172.21.15.164:0/2617037234 shutdown_connections 2023-09-13T06:01:08.768 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 --2- 172.21.15.164:0/2617037234 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 0x7fc4700d37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.769 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 --2- 172.21.15.164:0/2617037234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc470161f10 0x7fc4700ab1c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.769 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 -- 172.21.15.164:0/2617037234 >> 172.21.15.164:0/2617037234 conn(0x7fc470065990 msgr2=0x7fc470065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:08.769 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 -- 172.21.15.164:0/2617037234 shutdown_connections 2023-09-13T06:01:08.770 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 -- 172.21.15.164:0/2617037234 wait complete. 2023-09-13T06:01:08.770 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 Processor -- start 2023-09-13T06:01:08.770 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 -- start start 2023-09-13T06:01:08.773 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 0x7fc47013d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.773 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc470146f10 0x7fc47015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.773 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc47015fc00 0x7fc47015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:08.773 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47015da90 con 0x7fc470146f10 2023-09-13T06:01:08.774 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470160930 con 0x7fc47015fc00 2023-09-13T06:01:08.774 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc477f82640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc470155b90 con 0x7fc4700d3340 2023-09-13T06:01:08.774 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc475d1e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 0x7fc47013d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.774 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc47651f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc47015fc00 0x7fc47015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.774 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc47651f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc47015fc00 0x7fc47015ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57582/0 (socket says 172.21.15.164:57582) 2023-09-13T06:01:08.775 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc475d1e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 0x7fc47013d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:36678/0 (socket says 172.21.15.164:36678) 2023-09-13T06:01:08.775 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc47651f640 1 -- 172.21.15.164:0/1797262016 learned_addr learned my addr 172.21.15.164:0/1797262016 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:08.775 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.765+0000 7fc47551d640 1 --2- 172.21.15.164:0/1797262016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc470146f10 0x7fc47015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:08.775 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc475d1e640 1 -- 172.21.15.164:0/1797262016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc47015fc00 msgr2=0x7fc47015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.775 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc475d1e640 1 --2- 172.21.15.164:0/1797262016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc47015fc00 0x7fc47015ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.776 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc475d1e640 1 -- 172.21.15.164:0/1797262016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc470146f10 msgr2=0x7fc47015c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.776 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc475d1e640 1 --2- 172.21.15.164:0/1797262016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc470146f10 0x7fc47015c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.776 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc475d1e640 1 -- 172.21.15.164:0/1797262016 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4600094d0 con 0x7fc4700d3340 2023-09-13T06:01:08.776 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc47651f640 1 --2- 172.21.15.164:0/1797262016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc47015fc00 0x7fc47015ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:08.776 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc47551d640 1 --2- 172.21.15.164:0/1797262016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc470146f10 0x7fc47015c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:08.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc475d1e640 1 --2- 172.21.15.164:0/1797262016 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 0x7fc47013d130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc46c001ec0 tx=0x7fc46c00c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:08.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc4667fc640 1 -- 172.21.15.164:0/1797262016 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0052d0 con 0x7fc4700d3340 2023-09-13T06:01:08.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc4667fc640 1 -- 172.21.15.164:0/1797262016 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c005430 con 0x7fc4700d3340 2023-09-13T06:01:08.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc4667fc640 1 -- 172.21.15.164:0/1797262016 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c003840 con 0x7fc4700d3340 2023-09-13T06:01:08.777 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc477f82640 1 -- 172.21.15.164:0/1797262016 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc470160090 con 0x7fc4700d3340 2023-09-13T06:01:08.778 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc477f82640 1 -- 172.21.15.164:0/1797262016 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc470160650 con 0x7fc4700d3340 2023-09-13T06:01:08.778 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc4667fc640 1 -- 172.21.15.164:0/1797262016 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc46c003ca0 con 0x7fc4700d3340 2023-09-13T06:01:08.778 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc4667fc640 1 -- 172.21.15.164:0/1797262016 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc46c0119b0 con 0x7fc4700d3340 2023-09-13T06:01:08.781 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.769+0000 7fc477f82640 1 -- 172.21.15.164:0/1797262016 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4701559f0 con 0x7fc4700d3340 2023-09-13T06:01:08.781 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.773+0000 7fc4667fc640 1 -- 172.21.15.164:0/1797262016 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fc4701559f0 con 0x7fc4700d3340 2023-09-13T06:01:08.841 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.841+0000 7fc477f82640 1 -- 172.21.15.164:0/1797262016 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7fc4700674a0 con 0x7fc4700d3340 2023-09-13T06:01:08.846 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.845+0000 7fc4667fc640 1 -- 172.21.15.164:0/1797262016 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc46c017070 con 0x7fc4700d3340 2023-09-13T06:01:08.847 INFO:teuthology.orchestra.run.smithi164.stdout:2 2023-09-13T06:01:08.848 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.845+0000 7fc477f82640 1 -- 172.21.15.164:0/1797262016 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 msgr2=0x7fc47013d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:08.848 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.845+0000 7fc477f82640 1 --2- 172.21.15.164:0/1797262016 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 0x7fc47013d130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc46c001ec0 tx=0x7fc46c00c890 comp rx=0 tx=0).stop 2023-09-13T06:01:08.849 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.845+0000 7fc477f82640 1 -- 172.21.15.164:0/1797262016 shutdown_connections 2023-09-13T06:01:08.849 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.845+0000 7fc477f82640 1 --2- 172.21.15.164:0/1797262016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc47015fc00 0x7fc47015ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.849 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.845+0000 7fc477f82640 1 --2- 172.21.15.164:0/1797262016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc470146f10 0x7fc47015c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.849 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.845+0000 7fc477f82640 1 --2- 172.21.15.164:0/1797262016 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4700d3340 0x7fc47013d130 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:08.850 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.845+0000 7fc477f82640 1 -- 172.21.15.164:0/1797262016 >> 172.21.15.164:0/1797262016 conn(0x7fc470065990 msgr2=0x7fc470065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:08.850 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.845+0000 7fc477f82640 1 -- 172.21.15.164:0/1797262016 shutdown_connections 2023-09-13T06:01:08.850 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:08.845+0000 7fc477f82640 1 -- 172.21.15.164:0/1797262016 wait complete. 2023-09-13T06:01:08.865 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-09-13T06:01:09.003 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.001+0000 7fe6fc833640 1 Processor -- start 2023-09-13T06:01:09.004 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.001+0000 7fe6fc833640 1 -- start start 2023-09-13T06:01:09.005 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.001+0000 7fe6fc833640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 0x7fe6f8070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.006 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.001+0000 7fe6fc833640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6f80b66a0 0x7fe6f80b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.006 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.001+0000 7fe6fc833640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f80711a0 con 0x7fe6f8070d40 2023-09-13T06:01:09.006 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.001+0000 7fe6fc833640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f8161790 con 0x7fe6f80b66a0 2023-09-13T06:01:09.006 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.001+0000 7fe6fc833640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8146dd0 con 0x7fe6f8146410 2023-09-13T06:01:09.006 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.001+0000 7fe6f6d9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 0x7fe6f8070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.007 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.005+0000 7fe6f6d9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 0x7fe6f8070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:36694/0 (socket says 172.21.15.164:36694) 2023-09-13T06:01:09.007 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.005+0000 7fe6f6d9d640 1 -- 172.21.15.164:0/3210859919 learned_addr learned my addr 172.21.15.164:0/3210859919 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:09.007 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.005+0000 7fe6f759e640 1 --2- 172.21.15.164:0/3210859919 >> v2:172.21.15.130:3300/0 conn(0x7fe6f80b66a0 0x7fe6f80b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.007 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.005+0000 7fe6f6d9d640 1 -- 172.21.15.164:0/3210859919 >> v2:172.21.15.130:3300/0 conn(0x7fe6f80b66a0 msgr2=0x7fe6f80b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:09.007 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.005+0000 7fe6f6d9d640 1 --2- 172.21.15.164:0/3210859919 >> v2:172.21.15.130:3300/0 conn(0x7fe6f80b66a0 0x7fe6f80b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.008 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.005+0000 7fe6f6d9d640 1 -- 172.21.15.164:0/3210859919 >> v1:172.21.15.130:6789/0 conn(0x7fe6f8070d40 legacy=0x7fe6f80b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.008 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.005+0000 7fe6f6d9d640 1 -- 172.21.15.164:0/3210859919 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8160e60 con 0x7fe6f8146410 2023-09-13T06:01:09.009 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.005+0000 7fe6f6d9d640 1 --2- 172.21.15.164:0/3210859919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 0x7fe6f8070800 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80098a0 tx=0x7fe6e801c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=278ea2d0ec8caf4a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:09.010 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.005+0000 7fe6f5d9b640 1 -- 172.21.15.164:0/3210859919 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80aa650 con 0x7fe6f8146410 2023-09-13T06:01:09.010 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.005+0000 7fe6f5d9b640 1 -- 172.21.15.164:0/3210859919 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e80aa7b0 con 0x7fe6f8146410 2023-09-13T06:01:09.011 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.005+0000 7fe6f5d9b640 1 -- 172.21.15.164:0/3210859919 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80aab40 con 0x7fe6f8146410 2023-09-13T06:01:09.011 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 -- 172.21.15.164:0/3210859919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 msgr2=0x7fe6f8070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.011 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 --2- 172.21.15.164:0/3210859919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 0x7fe6f8070800 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80098a0 tx=0x7fe6e801c4f0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.012 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 -- 172.21.15.164:0/3210859919 shutdown_connections 2023-09-13T06:01:09.012 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 --2- 172.21.15.164:0/3210859919 >> v2:172.21.15.130:3300/0 conn(0x7fe6f80b66a0 0x7fe6f80b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.013 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 --2- 172.21.15.164:0/3210859919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 0x7fe6f8070800 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.013 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 -- 172.21.15.164:0/3210859919 >> 172.21.15.164:0/3210859919 conn(0x7fe6f8065990 msgr2=0x7fe6f8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:09.014 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 -- 172.21.15.164:0/3210859919 shutdown_connections 2023-09-13T06:01:09.014 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 -- 172.21.15.164:0/3210859919 wait complete. 2023-09-13T06:01:09.017 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 Processor -- start 2023-09-13T06:01:09.017 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 -- start start 2023-09-13T06:01:09.018 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6f8070d40 0x7fe6f815cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.018 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6f80b66a0 0x7fe6f813b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.018 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 0x7fe6f813ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.018 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f815e940 con 0x7fe6f8070d40 2023-09-13T06:01:09.018 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f81602a0 con 0x7fe6f80b66a0 2023-09-13T06:01:09.019 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6fc833640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8142120 con 0x7fe6f8146410 2023-09-13T06:01:09.019 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6f659c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6f80b66a0 0x7fe6f813b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.019 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6f759e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 0x7fe6f813ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.019 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6f659c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6f80b66a0 0x7fe6f813b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57586/0 (socket says 172.21.15.164:57586) 2023-09-13T06:01:09.019 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6f659c640 1 -- 172.21.15.164:0/1656961605 learned_addr learned my addr 172.21.15.164:0/1656961605 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:09.020 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.009+0000 7fe6f6d9d640 1 --2- 172.21.15.164:0/1656961605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6f8070d40 0x7fe6f815cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.020 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6f759e640 1 -- 172.21.15.164:0/1656961605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6f80b66a0 msgr2=0x7fe6f813b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.020 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6f759e640 1 --2- 172.21.15.164:0/1656961605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6f80b66a0 0x7fe6f813b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.020 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6f759e640 1 -- 172.21.15.164:0/1656961605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6f8070d40 msgr2=0x7fe6f815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.021 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6f759e640 1 --2- 172.21.15.164:0/1656961605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6f8070d40 0x7fe6f815cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.022 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6f759e640 1 -- 172.21.15.164:0/1656961605 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e80094d0 con 0x7fe6f8146410 2023-09-13T06:01:09.022 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6f659c640 1 --2- 172.21.15.164:0/1656961605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6f80b66a0 0x7fe6f813b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:09.022 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6f759e640 1 --2- 172.21.15.164:0/1656961605 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 0x7fe6f813ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0007d60 tx=0x7fe6f000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:09.022 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6df7fe640 1 -- 172.21.15.164:0/1656961605 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0018070 con 0x7fe6f8146410 2023-09-13T06:01:09.023 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6df7fe640 1 -- 172.21.15.164:0/1656961605 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f000edd0 con 0x7fe6f8146410 2023-09-13T06:01:09.023 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6df7fe640 1 -- 172.21.15.164:0/1656961605 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0003bc0 con 0x7fe6f8146410 2023-09-13T06:01:09.023 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6fc833640 1 -- 172.21.15.164:0/1656961605 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f815dfa0 con 0x7fe6f8146410 2023-09-13T06:01:09.023 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6fc833640 1 -- 172.21.15.164:0/1656961605 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f815e560 con 0x7fe6f8146410 2023-09-13T06:01:09.023 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6df7fe640 1 -- 172.21.15.164:0/1656961605 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe6f0004320 con 0x7fe6f8146410 2023-09-13T06:01:09.024 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6df7fe640 1 -- 172.21.15.164:0/1656961605 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fe6f0003d20 con 0x7fe6f8146410 2023-09-13T06:01:09.024 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.013+0000 7fe6fc833640 1 -- 172.21.15.164:0/1656961605 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f8161c00 con 0x7fe6f8146410 2023-09-13T06:01:09.024 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.017+0000 7fe6df7fe640 1 -- 172.21.15.164:0/1656961605 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fe6f8161c00 con 0x7fe6f8146410 2023-09-13T06:01:09.085 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.085+0000 7fe6fc833640 1 -- 172.21.15.164:0/1656961605 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7fe6f815ea80 con 0x7fe6f8146410 2023-09-13T06:01:09.091 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.089+0000 7fe6df7fe640 1 -- 172.21.15.164:0/1656961605 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe6f815ea80 con 0x7fe6f8146410 2023-09-13T06:01:09.092 INFO:teuthology.orchestra.run.smithi164.stdout:3 2023-09-13T06:01:09.092 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.089+0000 7fe6fc833640 1 -- 172.21.15.164:0/1656961605 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 msgr2=0x7fe6f813ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.093 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.089+0000 7fe6fc833640 1 --2- 172.21.15.164:0/1656961605 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 0x7fe6f813ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0007d60 tx=0x7fe6f000e4b0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.093 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.089+0000 7fe6fc833640 1 -- 172.21.15.164:0/1656961605 shutdown_connections 2023-09-13T06:01:09.093 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.089+0000 7fe6fc833640 1 --2- 172.21.15.164:0/1656961605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6f80b66a0 0x7fe6f813b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.094 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.089+0000 7fe6fc833640 1 --2- 172.21.15.164:0/1656961605 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6f8146410 0x7fe6f813ba80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.094 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.089+0000 7fe6fc833640 1 --2- 172.21.15.164:0/1656961605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6f8070d40 0x7fe6f815cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.094 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.089+0000 7fe6fc833640 1 -- 172.21.15.164:0/1656961605 >> 172.21.15.164:0/1656961605 conn(0x7fe6f8065990 msgr2=0x7fe6f80d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:09.094 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.089+0000 7fe6fc833640 1 -- 172.21.15.164:0/1656961605 shutdown_connections 2023-09-13T06:01:09.094 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.089+0000 7fe6fc833640 1 -- 172.21.15.164:0/1656961605 wait complete. 2023-09-13T06:01:09.113 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-09-13T06:01:09.174 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:09.169+0000 7f94ddd2a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-13T06:01:09.213 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:09.213+0000 7fbc5582c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-13T06:01:09.235 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:09.233+0000 7f94ddd2a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-13T06:01:09.252 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.249+0000 7f54ea8ec640 1 Processor -- start 2023-09-13T06:01:09.252 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.249+0000 7f54ea8ec640 1 -- start start 2023-09-13T06:01:09.254 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.253+0000 7f54ea8ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e40d3a50 0x7f54e40ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.254 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.253+0000 7f54ea8ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e40ab700 con 0x7f54e4161f10 2023-09-13T06:01:09.254 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.253+0000 7f54ea8ec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e40d2cd0 con 0x7f54e4146f10 2023-09-13T06:01:09.254 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.253+0000 7f54ea8ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40aa120 con 0x7f54e40d3a50 2023-09-13T06:01:09.255 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.253+0000 7f54e3fff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f54e4146f10 0x7f54e40d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:34986/0 (socket says 172.21.15.164:34986) 2023-09-13T06:01:09.255 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.253+0000 7f54e3fff640 1 -- 172.21.15.164:0/4110383523 learned_addr learned my addr 172.21.15.164:0/4110383523 (peer_addr_for_me v1:172.21.15.164:0/0) 2023-09-13T06:01:09.255 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.253+0000 7f54e8e89640 1 --2- 172.21.15.164:0/4110383523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e40d3a50 0x7f54e40ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.256 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.253+0000 7f54e2ffd640 1 -- 172.21.15.164:0/4110383523 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049805237 0 0) 0x7f54e40d2cd0 con 0x7f54e4146f10 2023-09-13T06:01:09.256 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.253+0000 7f54e8e89640 1 -- 172.21.15.164:0/4110383523 >> v1:172.21.15.164:6789/0 conn(0x7f54e4146f10 legacy=0x7f54e40d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.256 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.253+0000 7f54e8e89640 1 -- 172.21.15.164:0/4110383523 >> v1:172.21.15.130:6789/0 conn(0x7f54e4161f10 legacy=0x7f54e40d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.256 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.253+0000 7f54e8e89640 1 -- 172.21.15.164:0/4110383523 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e40aa400 con 0x7f54e40d3a50 2023-09-13T06:01:09.257 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54e8e89640 1 --2- 172.21.15.164:0/4110383523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e40d3a50 0x7f54e40ab1c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009dc0 tx=0x7f54dc01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0e2d6d5f585029d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:09.258 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54e2ffd640 1 -- 172.21.15.164:0/4110383523 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0a5a00 con 0x7f54e40d3a50 2023-09-13T06:01:09.258 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54e2ffd640 1 -- 172.21.15.164:0/4110383523 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc0a5b60 con 0x7f54e40d3a50 2023-09-13T06:01:09.259 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54e2ffd640 1 -- 172.21.15.164:0/4110383523 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0ad440 con 0x7f54e40d3a50 2023-09-13T06:01:09.259 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54ea8ec640 1 -- 172.21.15.164:0/4110383523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e40d3a50 msgr2=0x7f54e40ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.259 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54ea8ec640 1 --2- 172.21.15.164:0/4110383523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e40d3a50 0x7f54e40ab1c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009dc0 tx=0x7f54dc01c940 comp rx=0 tx=0).stop 2023-09-13T06:01:09.259 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54ea8ec640 1 -- 172.21.15.164:0/4110383523 shutdown_connections 2023-09-13T06:01:09.259 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54ea8ec640 1 --2- 172.21.15.164:0/4110383523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e40d3a50 0x7f54e40ab1c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.260 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54ea8ec640 1 -- 172.21.15.164:0/4110383523 >> 172.21.15.164:0/4110383523 conn(0x7f54e4065990 msgr2=0x7f54e4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:09.260 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54ea8ec640 1 -- 172.21.15.164:0/4110383523 shutdown_connections 2023-09-13T06:01:09.260 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54ea8ec640 1 -- 172.21.15.164:0/4110383523 wait complete. 2023-09-13T06:01:09.263 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54ea8ec640 1 Processor -- start 2023-09-13T06:01:09.263 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.257+0000 7f54ea8ec640 1 -- start start 2023-09-13T06:01:09.263 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54ea8ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54e40d3a50 0x7f54e41445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.264 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54ea8ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e4146f10 0x7f54e415a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.264 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54ea8ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e415cfa0 0x7f54e40af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.264 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54ea8ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40b22b0 con 0x7f54e4146f10 2023-09-13T06:01:09.264 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54ea8ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40b1e20 con 0x7f54e40d3a50 2023-09-13T06:01:09.264 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54ea8ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40af5a0 con 0x7f54e415cfa0 2023-09-13T06:01:09.265 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e3fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54e40d3a50 0x7f54e41445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.265 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e8e89640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e415cfa0 0x7f54e40af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.265 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e3fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54e40d3a50 0x7f54e41445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57602/0 (socket says 172.21.15.164:57602) 2023-09-13T06:01:09.265 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e3fff640 1 -- 172.21.15.164:0/374321226 learned_addr learned my addr 172.21.15.164:0/374321226 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:09.265 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e37fe640 1 --2- 172.21.15.164:0/374321226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e4146f10 0x7f54e415a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.265 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e8e89640 1 -- 172.21.15.164:0/374321226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54e40d3a50 msgr2=0x7f54e41445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.266 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e8e89640 1 --2- 172.21.15.164:0/374321226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54e40d3a50 0x7f54e41445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.266 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e8e89640 1 -- 172.21.15.164:0/374321226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e4146f10 msgr2=0x7f54e415a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.266 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e8e89640 1 --2- 172.21.15.164:0/374321226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e4146f10 0x7f54e415a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.266 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e8e89640 1 -- 172.21.15.164:0/374321226 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc009a70 con 0x7f54e415cfa0 2023-09-13T06:01:09.266 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e3fff640 1 --2- 172.21.15.164:0/374321226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54e40d3a50 0x7f54e41445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:09.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e37fe640 1 --2- 172.21.15.164:0/374321226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e4146f10 0x7f54e415a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:09.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e8e89640 1 --2- 172.21.15.164:0/374321226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e415cfa0 0x7f54e40af930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0ac000 tx=0x7f54dc0196e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:09.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e0ff9640 1 -- 172.21.15.164:0/374321226 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0bf070 con 0x7f54e415cfa0 2023-09-13T06:01:09.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e0ff9640 1 -- 172.21.15.164:0/374321226 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc0adc40 con 0x7f54e415cfa0 2023-09-13T06:01:09.267 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54ea8ec640 1 -- 172.21.15.164:0/374321226 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e415f780 con 0x7f54e415cfa0 2023-09-13T06:01:09.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e0ff9640 1 -- 172.21.15.164:0/374321226 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0b7410 con 0x7f54e415cfa0 2023-09-13T06:01:09.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54ea8ec640 1 -- 172.21.15.164:0/374321226 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e415a9a0 con 0x7f54e415cfa0 2023-09-13T06:01:09.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e0ff9640 1 -- 172.21.15.164:0/374321226 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f54dc0b4050 con 0x7f54e415cfa0 2023-09-13T06:01:09.268 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54e0ff9640 1 -- 172.21.15.164:0/374321226 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f54dc003ca0 con 0x7f54e415cfa0 2023-09-13T06:01:09.269 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.261+0000 7f54ea8ec640 1 -- 172.21.15.164:0/374321226 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e40b1f90 con 0x7f54e415cfa0 2023-09-13T06:01:09.269 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.265+0000 7f54e0ff9640 1 -- 172.21.15.164:0/374321226 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f54dc0b2070 con 0x7f54e415cfa0 2023-09-13T06:01:09.280 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:09.277+0000 7fbc5582c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-13T06:01:09.295 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:09.293+0000 7f94ddd2a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-13T06:01:09.333 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.333+0000 7f54ea8ec640 1 -- 172.21.15.164:0/374321226 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f54e40674a0 con 0x7f54e415cfa0 2023-09-13T06:01:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.337+0000 7f54e0ff9640 1 -- 172.21.15.164:0/374321226 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54dc0d20b0 con 0x7f54e415cfa0 2023-09-13T06:01:09.338 INFO:teuthology.orchestra.run.smithi164.stdout:4 2023-09-13T06:01:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.337+0000 7f54ea8ec640 1 -- 172.21.15.164:0/374321226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e415cfa0 msgr2=0x7f54e40af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.337+0000 7f54ea8ec640 1 --2- 172.21.15.164:0/374321226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e415cfa0 0x7f54e40af930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0ac000 tx=0x7f54dc0196e0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.337+0000 7f54ea8ec640 1 -- 172.21.15.164:0/374321226 shutdown_connections 2023-09-13T06:01:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.337+0000 7f54ea8ec640 1 --2- 172.21.15.164:0/374321226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54e415cfa0 0x7f54e40af930 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.337+0000 7f54ea8ec640 1 --2- 172.21.15.164:0/374321226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e4146f10 0x7f54e415a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.337+0000 7f54ea8ec640 1 --2- 172.21.15.164:0/374321226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54e40d3a50 0x7f54e41445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.337+0000 7f54ea8ec640 1 -- 172.21.15.164:0/374321226 >> 172.21.15.164:0/374321226 conn(0x7f54e4065990 msgr2=0x7f54e40ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:09.341 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.337+0000 7f54ea8ec640 1 -- 172.21.15.164:0/374321226 shutdown_connections 2023-09-13T06:01:09.341 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.337+0000 7f54ea8ec640 1 -- 172.21.15.164:0/374321226 wait complete. 2023-09-13T06:01:09.343 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:09.341+0000 7fbc5582c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-13T06:01:09.359 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-09-13T06:01:09.385 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:09.381+0000 7f94ddd2a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-13T06:01:09.435 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:09.433+0000 7fbc5582c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-13T06:01:09.444 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:09.441+0000 7f94ddd2a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-13T06:01:09.496 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.493+0000 7fcc81937640 1 Processor -- start 2023-09-13T06:01:09.496 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.493+0000 7fcc81937640 1 -- start start 2023-09-13T06:01:09.497 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc81937640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcc7c146f10 0x7fcc7c0ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.497 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc81937640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7c0ab700 con 0x7fcc7c0d3340 2023-09-13T06:01:09.498 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc81937640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7c0d2cd0 con 0x7fcc7c161f10 2023-09-13T06:01:09.498 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc81937640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7c0aa120 con 0x7fcc7c146f10 2023-09-13T06:01:09.498 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc7a7fc640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fcc7c161f10 0x7fcc7c0d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:34996/0 (socket says 172.21.15.164:34996) 2023-09-13T06:01:09.498 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc7a7fc640 1 -- 172.21.15.164:0/3022074920 learned_addr learned my addr 172.21.15.164:0/3022074920 (peer_addr_for_me v1:172.21.15.164:0/0) 2023-09-13T06:01:09.499 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc7affd640 1 --2- 172.21.15.164:0/3022074920 >> v2:172.21.15.130:3300/0 conn(0x7fcc7c146f10 0x7fcc7c0ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.499 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc79ffb640 1 -- 172.21.15.164:0/3022074920 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932955462 0 0) 0x7fcc7c0d2cd0 con 0x7fcc7c161f10 2023-09-13T06:01:09.500 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc79ffb640 1 -- 172.21.15.164:0/3022074920 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc64003530 con 0x7fcc7c161f10 2023-09-13T06:01:09.500 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fbc5582c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-13T06:01:09.501 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc7affd640 1 -- 172.21.15.164:0/3022074920 >> v1:172.21.15.164:6789/0 conn(0x7fcc7c161f10 legacy=0x7fcc7c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.501 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc7affd640 1 -- 172.21.15.164:0/3022074920 >> v1:172.21.15.130:6789/0 conn(0x7fcc7c0d3340 legacy=0x7fcc7c15dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.502 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.497+0000 7fcc7affd640 1 -- 172.21.15.164:0/3022074920 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c0aa400 con 0x7fcc7c146f10 2023-09-13T06:01:09.502 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc7affd640 1 --2- 172.21.15.164:0/3022074920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7c146f10 0x7fcc7c0ab1c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0097c0 tx=0x7fcc6c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b62701869eccf2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:09.502 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc79ffb640 1 -- 172.21.15.164:0/3022074920 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0ab650 con 0x7fcc7c146f10 2023-09-13T06:01:09.502 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc79ffb640 1 -- 172.21.15.164:0/3022074920 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c0ab7b0 con 0x7fcc7c146f10 2023-09-13T06:01:09.503 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc79ffb640 1 -- 172.21.15.164:0/3022074920 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0abb40 con 0x7fcc7c146f10 2023-09-13T06:01:09.504 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc81937640 1 -- 172.21.15.164:0/3022074920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7c146f10 msgr2=0x7fcc7c0ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.504 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc81937640 1 --2- 172.21.15.164:0/3022074920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7c146f10 0x7fcc7c0ab1c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0097c0 tx=0x7fcc6c01c450 comp rx=0 tx=0).stop 2023-09-13T06:01:09.504 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc81937640 1 -- 172.21.15.164:0/3022074920 shutdown_connections 2023-09-13T06:01:09.505 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc81937640 1 --2- 172.21.15.164:0/3022074920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7c146f10 0x7fcc7c0ab1c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.505 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc81937640 1 -- 172.21.15.164:0/3022074920 >> 172.21.15.164:0/3022074920 conn(0x7fcc7c065990 msgr2=0x7fcc7c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:09.505 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc81937640 1 -- 172.21.15.164:0/3022074920 shutdown_connections 2023-09-13T06:01:09.505 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc81937640 1 -- 172.21.15.164:0/3022074920 wait complete. 2023-09-13T06:01:09.506 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc81937640 1 Processor -- start 2023-09-13T06:01:09.506 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.501+0000 7fcc81937640 1 -- start start 2023-09-13T06:01:09.517 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc81937640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc7c0d3340 0x7fcc7c1f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.517 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc81937640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7c146f10 0x7fcc7c1fa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.517 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc81937640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c15fe60 0x7fcc7c0b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.517 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc81937640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c1fa810 con 0x7fcc7c146f10 2023-09-13T06:01:09.517 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc81937640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c15d5f0 con 0x7fcc7c0d3340 2023-09-13T06:01:09.518 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc81937640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c1f74a0 con 0x7fcc7c15fe60 2023-09-13T06:01:09.518 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc7affd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc7c0d3340 0x7fcc7c1f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.518 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc7b7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c15fe60 0x7fcc7c0b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.518 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc7affd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc7c0d3340 0x7fcc7c1f6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57612/0 (socket says 172.21.15.164:57612) 2023-09-13T06:01:09.518 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc7affd640 1 -- 172.21.15.164:0/2770360064 learned_addr learned my addr 172.21.15.164:0/2770360064 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:09.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc7a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7c146f10 0x7fcc7c1fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc7b7fe640 1 -- 172.21.15.164:0/2770360064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc7c0d3340 msgr2=0x7fcc7c1f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc7b7fe640 1 --2- 172.21.15.164:0/2770360064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc7c0d3340 0x7fcc7c1f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc7b7fe640 1 -- 172.21.15.164:0/2770360064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7c146f10 msgr2=0x7fcc7c1fa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.519 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc7b7fe640 1 --2- 172.21.15.164:0/2770360064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7c146f10 0x7fcc7c1fa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc7b7fe640 1 -- 172.21.15.164:0/2770360064 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c009420 con 0x7fcc7c15fe60 2023-09-13T06:01:09.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc7b7fe640 1 --2- 172.21.15.164:0/2770360064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c15fe60 0x7fcc7c0b0290 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c730 tx=0x7fcc7400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:09.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc63fff640 1 -- 172.21.15.164:0/2770360064 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74003b80 con 0x7fcc7c15fe60 2023-09-13T06:01:09.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc63fff640 1 -- 172.21.15.164:0/2770360064 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc74003ce0 con 0x7fcc7c15fe60 2023-09-13T06:01:09.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc81937640 1 -- 172.21.15.164:0/2770360064 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7c1f6890 con 0x7fcc7c15fe60 2023-09-13T06:01:09.520 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc63fff640 1 -- 172.21.15.164:0/2770360064 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7400aa30 con 0x7fcc7c15fe60 2023-09-13T06:01:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc81937640 1 -- 172.21.15.164:0/2770360064 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7c1f6e50 con 0x7fcc7c15fe60 2023-09-13T06:01:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc63fff640 1 -- 172.21.15.164:0/2770360064 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcc740050d0 con 0x7fcc7c15fe60 2023-09-13T06:01:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc63fff640 1 -- 172.21.15.164:0/2770360064 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fcc74012420 con 0x7fcc7c15fe60 2023-09-13T06:01:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.505+0000 7fcc81937640 1 -- 172.21.15.164:0/2770360064 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7c0674a0 con 0x7fcc7c15fe60 2023-09-13T06:01:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.509+0000 7fcc63fff640 1 -- 172.21.15.164:0/2770360064 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fcc74005380 con 0x7fcc7c15fe60 2023-09-13T06:01:09.532 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:09.529+0000 7f94ddd2a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-13T06:01:09.577 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.577+0000 7fcc81937640 1 -- 172.21.15.164:0/2770360064 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7fcc7c073e50 con 0x7fcc7c15fe60 2023-09-13T06:01:09.582 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.581+0000 7fcc63fff640 1 -- 172.21.15.164:0/2770360064 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcc74005520 con 0x7fcc7c15fe60 2023-09-13T06:01:09.582 INFO:teuthology.orchestra.run.smithi164.stdout:5 2023-09-13T06:01:09.583 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.581+0000 7fcc81937640 1 -- 172.21.15.164:0/2770360064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c15fe60 msgr2=0x7fcc7c0b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.583 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.581+0000 7fcc81937640 1 --2- 172.21.15.164:0/2770360064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c15fe60 0x7fcc7c0b0290 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c730 tx=0x7fcc7400cbf0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.584 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.581+0000 7fcc81937640 1 -- 172.21.15.164:0/2770360064 shutdown_connections 2023-09-13T06:01:09.584 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.581+0000 7fcc81937640 1 --2- 172.21.15.164:0/2770360064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c15fe60 0x7fcc7c0b0290 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.584 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.581+0000 7fcc81937640 1 --2- 172.21.15.164:0/2770360064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7c146f10 0x7fcc7c1fa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.584 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.581+0000 7fcc81937640 1 --2- 172.21.15.164:0/2770360064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc7c0d3340 0x7fcc7c1f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.584 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.581+0000 7fcc81937640 1 -- 172.21.15.164:0/2770360064 >> 172.21.15.164:0/2770360064 conn(0x7fcc7c065990 msgr2=0x7fcc7c15e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:09.585 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.581+0000 7fcc81937640 1 -- 172.21.15.164:0/2770360064 shutdown_connections 2023-09-13T06:01:09.585 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.581+0000 7fcc81937640 1 -- 172.21.15.164:0/2770360064 wait complete. 2023-09-13T06:01:09.592 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:09.589+0000 7fbc5582c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-13T06:01:09.594 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:09.593+0000 7f94ddd2a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-13T06:01:09.601 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-09-13T06:01:09.654 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:09.653+0000 7fbc5582c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-13T06:01:09.738 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee0e419640 1 Processor -- start 2023-09-13T06:01:09.738 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee0e419640 1 -- start start 2023-09-13T06:01:09.740 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee0e419640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fee08146f10 0x7fee080ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.740 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee0e419640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08161f10 0x7fee080d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.741 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee0e419640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fee080d2b00 0x7fee080d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.741 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee0e419640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee080ab700 con 0x7fee080d2b00 2023-09-13T06:01:09.741 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee0e419640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee080aa120 con 0x7fee08146f10 2023-09-13T06:01:09.741 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee0e419640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee080aa400 con 0x7fee08161f10 2023-09-13T06:01:09.741 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee07fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fee08146f10 0x7fee080ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.742 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee077fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08161f10 0x7fee080d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.742 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee07fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fee08146f10 0x7fee080ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57624/0 (socket says 172.21.15.164:57624) 2023-09-13T06:01:09.742 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee077fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08161f10 0x7fee080d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:36730/0 (socket says 172.21.15.164:36730) 2023-09-13T06:01:09.742 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee07fff640 1 -- 172.21.15.164:0/3307860275 learned_addr learned my addr 172.21.15.164:0/3307860275 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:09.743 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee0c9b6640 1 --2- 172.21.15.164:0/3307860275 >> v2:172.21.15.130:3300/0 conn(0x7fee080d2b00 0x7fee080d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.743 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee077fe640 1 -- 172.21.15.164:0/3307860275 >> v2:172.21.15.164:3300/0 conn(0x7fee08146f10 msgr2=0x7fee080ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:09.743 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee077fe640 1 --2- 172.21.15.164:0/3307860275 >> v2:172.21.15.164:3300/0 conn(0x7fee08146f10 0x7fee080ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.743 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee077fe640 1 -- 172.21.15.164:0/3307860275 >> v2:172.21.15.130:3300/0 conn(0x7fee080d2b00 msgr2=0x7fee080d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:09.743 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee077fe640 1 --2- 172.21.15.164:0/3307860275 >> v2:172.21.15.130:3300/0 conn(0x7fee080d2b00 0x7fee080d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.744 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee077fe640 1 -- 172.21.15.164:0/3307860275 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee080aa6e0 con 0x7fee08161f10 2023-09-13T06:01:09.744 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.737+0000 7fee0c9b6640 1 --2- 172.21.15.164:0/3307860275 >> v2:172.21.15.130:3300/0 conn(0x7fee080d2b00 0x7fee080d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:09.745 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee077fe640 1 --2- 172.21.15.164:0/3307860275 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08161f10 0x7fee080d25c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee0808baa0 tx=0x7fedfc01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a894a9bccdd74019 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:09.745 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee06ffd640 1 -- 172.21.15.164:0/3307860275 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0ad680 con 0x7fee08161f10 2023-09-13T06:01:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee06ffd640 1 -- 172.21.15.164:0/3307860275 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc0ad7e0 con 0x7fee08161f10 2023-09-13T06:01:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee06ffd640 1 -- 172.21.15.164:0/3307860275 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0adb70 con 0x7fee08161f10 2023-09-13T06:01:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee0e419640 1 -- 172.21.15.164:0/3307860275 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08161f10 msgr2=0x7fee080d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee0e419640 1 --2- 172.21.15.164:0/3307860275 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08161f10 0x7fee080d25c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee0808baa0 tx=0x7fedfc01c3a0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee0e419640 1 -- 172.21.15.164:0/3307860275 shutdown_connections 2023-09-13T06:01:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee0e419640 1 --2- 172.21.15.164:0/3307860275 >> v2:172.21.15.130:3300/0 conn(0x7fee080d2b00 0x7fee080d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee0e419640 1 --2- 172.21.15.164:0/3307860275 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08161f10 0x7fee080d25c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee0e419640 1 --2- 172.21.15.164:0/3307860275 >> v2:172.21.15.164:3300/0 conn(0x7fee08146f10 0x7fee080ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee0e419640 1 -- 172.21.15.164:0/3307860275 >> 172.21.15.164:0/3307860275 conn(0x7fee08065990 msgr2=0x7fee08065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee0e419640 1 -- 172.21.15.164:0/3307860275 shutdown_connections 2023-09-13T06:01:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.741+0000 7fee0e419640 1 -- 172.21.15.164:0/3307860275 wait complete. 2023-09-13T06:01:09.750 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee0e419640 1 Processor -- start 2023-09-13T06:01:09.751 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee0e419640 1 -- start start 2023-09-13T06:01:09.751 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee0e419640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee080d2b00 0x7fee0813fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.751 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee0e419640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08146f10 0x7fee08155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.751 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee0e419640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee08159a10 0x7fee08158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.751 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee0e419640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee081566b0 con 0x7fee080d2b00 2023-09-13T06:01:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee0e419640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee08140390 con 0x7fee08159a10 2023-09-13T06:01:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee0e419640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee08155aa0 con 0x7fee08146f10 2023-09-13T06:01:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee077fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08146f10 0x7fee08155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee0c9b6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee08159a10 0x7fee08158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee077fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08146f10 0x7fee08155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:36742/0 (socket says 172.21.15.164:36742) 2023-09-13T06:01:09.753 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee077fe640 1 -- 172.21.15.164:0/1290015440 learned_addr learned my addr 172.21.15.164:0/1290015440 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:09.753 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee07fff640 1 --2- 172.21.15.164:0/1290015440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee080d2b00 0x7fee0813fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.753 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee077fe640 1 -- 172.21.15.164:0/1290015440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee08159a10 msgr2=0x7fee08158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.753 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee077fe640 1 --2- 172.21.15.164:0/1290015440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee08159a10 0x7fee08158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.753 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee077fe640 1 -- 172.21.15.164:0/1290015440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee080d2b00 msgr2=0x7fee0813fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.753 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee077fe640 1 --2- 172.21.15.164:0/1290015440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee080d2b00 0x7fee0813fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.754 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee077fe640 1 -- 172.21.15.164:0/1290015440 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc009420 con 0x7fee08146f10 2023-09-13T06:01:09.754 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee077fe640 1 --2- 172.21.15.164:0/1290015440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08146f10 0x7fee08155270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fedfc01cc40 tx=0x7fedfc01abe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:09.754 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee04ff9640 1 -- 172.21.15.164:0/1290015440 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0add60 con 0x7fee08146f10 2023-09-13T06:01:09.754 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee04ff9640 1 -- 172.21.15.164:0/1290015440 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc0b6460 con 0x7fee08146f10 2023-09-13T06:01:09.754 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee04ff9640 1 -- 172.21.15.164:0/1290015440 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0b67d0 con 0x7fee08146f10 2023-09-13T06:01:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee0e419640 1 -- 172.21.15.164:0/1290015440 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee08155d80 con 0x7fee08146f10 2023-09-13T06:01:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.745+0000 7fee0e419640 1 -- 172.21.15.164:0/1290015440 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee08156340 con 0x7fee08146f10 2023-09-13T06:01:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.749+0000 7fee04ff9640 1 -- 172.21.15.164:0/1290015440 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fedfc0b4070 con 0x7fee08146f10 2023-09-13T06:01:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.749+0000 7fee04ff9640 1 -- 172.21.15.164:0/1290015440 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fedfc0b8de0 con 0x7fee08146f10 2023-09-13T06:01:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.749+0000 7fee0e419640 1 -- 172.21.15.164:0/1290015440 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee080674a0 con 0x7fee08146f10 2023-09-13T06:01:09.756 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:09.745+0000 7f94ddd2a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-13T06:01:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.749+0000 7fee04ff9640 1 -- 172.21.15.164:0/1290015440 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fedfc0bd070 con 0x7fee08146f10 2023-09-13T06:01:09.817 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:09.813+0000 7f94ddd2a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-13T06:01:09.826 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:09.825+0000 7fbc5582c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-13T06:01:09.829 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.829+0000 7fee0e419640 1 -- 172.21.15.164:0/1290015440 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7fee08073e50 con 0x7fee08146f10 2023-09-13T06:01:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.833+0000 7fee04ff9640 1 -- 172.21.15.164:0/1290015440 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fedfc0b2070 con 0x7fee08146f10 2023-09-13T06:01:09.834 INFO:teuthology.orchestra.run.smithi164.stdout:6 2023-09-13T06:01:09.835 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.833+0000 7fee0e419640 1 -- 172.21.15.164:0/1290015440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08146f10 msgr2=0x7fee08155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:09.835 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.833+0000 7fee0e419640 1 --2- 172.21.15.164:0/1290015440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08146f10 0x7fee08155270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fedfc01cc40 tx=0x7fedfc01abe0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.835 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.833+0000 7fee0e419640 1 -- 172.21.15.164:0/1290015440 shutdown_connections 2023-09-13T06:01:09.835 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.833+0000 7fee0e419640 1 --2- 172.21.15.164:0/1290015440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee08159a10 0x7fee08158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.835 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.833+0000 7fee0e419640 1 --2- 172.21.15.164:0/1290015440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee08146f10 0x7fee08155270 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.836 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.833+0000 7fee0e419640 1 --2- 172.21.15.164:0/1290015440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee080d2b00 0x7fee0813fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.836 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.833+0000 7fee0e419640 1 -- 172.21.15.164:0/1290015440 >> 172.21.15.164:0/1290015440 conn(0x7fee08065990 msgr2=0x7fee0815a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:09.836 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.833+0000 7fee0e419640 1 -- 172.21.15.164:0/1290015440 shutdown_connections 2023-09-13T06:01:09.836 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.833+0000 7fee0e419640 1 -- 172.21.15.164:0/1290015440 wait complete. 2023-09-13T06:01:09.855 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-09-13T06:01:09.898 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:09.897+0000 7fbc5582c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-13T06:01:09.993 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ec7b640 1 Processor -- start 2023-09-13T06:01:09.993 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ec7b640 1 -- start start 2023-09-13T06:01:09.995 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ec7b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c28146f10 0x7f0c280ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.995 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ec7b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0c28161f10 0x7f0c280d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:09.995 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ec7b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c280ab700 con 0x7f0c280d2b00 2023-09-13T06:01:09.996 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ec7b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c280aa120 con 0x7f0c28161f10 2023-09-13T06:01:09.996 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ec7b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280aa400 con 0x7f0c28146f10 2023-09-13T06:01:09.996 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ca17640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c28146f10 0x7f0c280ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.996 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ca17640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c28146f10 0x7f0c280ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:36758/0 (socket says 172.21.15.164:36758) 2023-09-13T06:01:09.997 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ca17640 1 -- 172.21.15.164:0/2678348822 learned_addr learned my addr 172.21.15.164:0/2678348822 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:09.997 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c27fff640 1 --2- 172.21.15.164:0/2678348822 >> v2:172.21.15.130:3300/0 conn(0x7f0c28161f10 0x7f0c280d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:09.997 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ca17640 1 -- 172.21.15.164:0/2678348822 >> v2:172.21.15.130:3300/0 conn(0x7f0c28161f10 msgr2=0x7f0c280d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:09.997 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ca17640 1 --2- 172.21.15.164:0/2678348822 >> v2:172.21.15.130:3300/0 conn(0x7f0c28161f10 0x7f0c280d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:09.998 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ca17640 1 -- 172.21.15.164:0/2678348822 >> v1:172.21.15.130:6789/0 conn(0x7f0c280d2b00 legacy=0x7f0c280d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:09.998 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.993+0000 7f0c2ca17640 1 -- 172.21.15.164:0/2678348822 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c280aa6e0 con 0x7f0c28146f10 2023-09-13T06:01:09.999 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c2ca17640 1 --2- 172.21.15.164:0/2678348822 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c28146f10 0x7f0c280ab1c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009870 tx=0x7f0c1c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0f210712465ea11 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:09.999 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c277fe640 1 -- 172.21.15.164:0/2678348822 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0aa670 con 0x7f0c28146f10 2023-09-13T06:01:09.999 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c277fe640 1 -- 172.21.15.164:0/2678348822 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c0aa7d0 con 0x7f0c28146f10 2023-09-13T06:01:09.999 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c277fe640 1 -- 172.21.15.164:0/2678348822 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0aab60 con 0x7f0c28146f10 2023-09-13T06:01:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2678348822 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c28146f10 msgr2=0x7f0c280ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c2ec7b640 1 --2- 172.21.15.164:0/2678348822 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c28146f10 0x7f0c280ab1c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009870 tx=0x7f0c1c01c510 comp rx=0 tx=0).stop 2023-09-13T06:01:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2678348822 shutdown_connections 2023-09-13T06:01:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c2ec7b640 1 --2- 172.21.15.164:0/2678348822 >> v2:172.21.15.130:3300/0 conn(0x7f0c28161f10 0x7f0c280d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c2ec7b640 1 --2- 172.21.15.164:0/2678348822 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c28146f10 0x7f0c280ab1c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2678348822 >> 172.21.15.164:0/2678348822 conn(0x7f0c28065990 msgr2=0x7f0c28065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2678348822 shutdown_connections 2023-09-13T06:01:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:09.997+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2678348822 wait complete. 2023-09-13T06:01:10.006 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.001+0000 7f0c2ec7b640 1 Processor -- start 2023-09-13T06:01:10.007 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.001+0000 7f0c2ec7b640 1 -- start start 2023-09-13T06:01:10.007 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.001+0000 7f0c2ec7b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c280d2b00 0x7f0c28153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:10.007 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.001+0000 7f0c2ec7b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c28146f10 0x7f0c281563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:10.007 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.001+0000 7f0c2ec7b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c28134cc0 0x7f0c28135170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:10.007 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.001+0000 7f0c2ec7b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c281356b0 con 0x7f0c28146f10 2023-09-13T06:01:10.007 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.001+0000 7f0c2ec7b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2815ca20 con 0x7f0c28134cc0 2023-09-13T06:01:10.008 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.001+0000 7f0c2ec7b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2815d580 con 0x7f0c280d2b00 2023-09-13T06:01:10.008 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.001+0000 7f0c2ca17640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c280d2b00 0x7f0c28153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:10.008 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.001+0000 7f0c2d218640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c28134cc0 0x7f0c28135170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:10.008 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c2ca17640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c280d2b00 0x7f0c28153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:36768/0 (socket says 172.21.15.164:36768) 2023-09-13T06:01:10.008 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c27fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c28146f10 0x7f0c281563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:10.009 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c2ca17640 1 -- 172.21.15.164:0/2333857432 learned_addr learned my addr 172.21.15.164:0/2333857432 (peer_addr_for_me v2:172.21.15.164:0/0) 2023-09-13T06:01:10.009 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c2ca17640 1 -- 172.21.15.164:0/2333857432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c28134cc0 msgr2=0x7f0c28135170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:10.009 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c2ca17640 1 --2- 172.21.15.164:0/2333857432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c28134cc0 0x7f0c28135170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.009 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c2ca17640 1 -- 172.21.15.164:0/2333857432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c28146f10 msgr2=0x7f0c281563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:10.009 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c2ca17640 1 --2- 172.21.15.164:0/2333857432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c28146f10 0x7f0c281563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.009 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c2ca17640 1 -- 172.21.15.164:0/2333857432 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c0094d0 con 0x7f0c280d2b00 2023-09-13T06:01:10.010 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c2ca17640 1 --2- 172.21.15.164:0/2333857432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c280d2b00 0x7f0c28153b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0ac040 tx=0x7f0c1c01ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:10.010 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c257fa640 1 -- 172.21.15.164:0/2333857432 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0b3800 con 0x7f0c280d2b00 2023-09-13T06:01:10.010 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c257fa640 1 -- 172.21.15.164:0/2333857432 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c0b3980 con 0x7f0c280d2b00 2023-09-13T06:01:10.010 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c257fa640 1 -- 172.21.15.164:0/2333857432 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0b3d30 con 0x7f0c280d2b00 2023-09-13T06:01:10.010 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2333857432 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c28156a80 con 0x7f0c280d2b00 2023-09-13T06:01:10.010 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2333857432 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c28155f80 con 0x7f0c280d2b00 2023-09-13T06:01:10.011 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c257fa640 1 -- 172.21.15.164:0/2333857432 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0c1c0bd6f0 con 0x7f0c280d2b00 2023-09-13T06:01:10.011 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c257fa640 1 -- 172.21.15.164:0/2333857432 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f0c1c0b2510 con 0x7f0c280d2b00 2023-09-13T06:01:10.011 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.005+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2333857432 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c280674a0 con 0x7f0c280d2b00 2023-09-13T06:01:10.012 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.009+0000 7f0c257fa640 1 -- 172.21.15.164:0/2333857432 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0c1c0c3060 con 0x7f0c280d2b00 2023-09-13T06:01:10.074 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.073+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2333857432 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f0c28154620 con 0x7f0c280d2b00 2023-09-13T06:01:10.082 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.081+0000 7f0c257fa640 1 -- 172.21.15.164:0/2333857432 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c1c0059a0 con 0x7f0c280d2b00 2023-09-13T06:01:10.082 INFO:teuthology.orchestra.run.smithi164.stdout:7 2023-09-13T06:01:10.083 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.081+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2333857432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c280d2b00 msgr2=0x7f0c28153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:10.083 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.081+0000 7f0c2ec7b640 1 --2- 172.21.15.164:0/2333857432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c280d2b00 0x7f0c28153b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0ac040 tx=0x7f0c1c01ad50 comp rx=0 tx=0).stop 2023-09-13T06:01:10.083 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.081+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2333857432 shutdown_connections 2023-09-13T06:01:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.081+0000 7f0c2ec7b640 1 --2- 172.21.15.164:0/2333857432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c28134cc0 0x7f0c28135170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.081+0000 7f0c2ec7b640 1 --2- 172.21.15.164:0/2333857432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c28146f10 0x7f0c281563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.081+0000 7f0c2ec7b640 1 --2- 172.21.15.164:0/2333857432 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c280d2b00 0x7f0c28153b10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.081+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2333857432 >> 172.21.15.164:0/2333857432 conn(0x7f0c28065990 msgr2=0x7f0c280ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.081+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2333857432 shutdown_connections 2023-09-13T06:01:10.085 INFO:teuthology.orchestra.run.smithi164.stderr:2023-09-13T06:01:10.081+0000 7f0c2ec7b640 1 -- 172.21.15.164:0/2333857432 wait complete. 2023-09-13T06:01:10.101 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-13T06:01:10.101 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-13T06:01:10.107 INFO:tasks.ceph.osd.0:Started 2023-09-13T06:01:10.108 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-13T06:01:10.108 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-13T06:01:10.111 INFO:tasks.ceph.osd.1:Started 2023-09-13T06:01:10.112 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-13T06:01:10.112 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-13T06:01:10.115 INFO:tasks.ceph.osd.2:Started 2023-09-13T06:01:10.116 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-13T06:01:10.116 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-13T06:01:10.120 INFO:tasks.ceph.osd.3:Started 2023-09-13T06:01:10.120 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-13T06:01:10.120 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-13T06:01:10.152 INFO:tasks.ceph.osd.4:Started 2023-09-13T06:01:10.153 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-13T06:01:10.153 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-13T06:01:10.156 INFO:tasks.ceph.osd.5:Started 2023-09-13T06:01:10.157 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-13T06:01:10.157 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-13T06:01:10.161 INFO:tasks.ceph.osd.6:Started 2023-09-13T06:01:10.161 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-13T06:01:10.163 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-13T06:01:10.168 INFO:tasks.ceph.osd.7:Started 2023-09-13T06:01:10.169 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:10.259 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-09-13T06:01:10.257+0000 7f1598b4c640 -1 Falling back to public interface 2023-09-13T06:01:10.266 INFO:tasks.ceph.osd.2.smithi130.stderr:2023-09-13T06:01:10.261+0000 7f0c9842b640 -1 Falling back to public interface 2023-09-13T06:01:10.266 INFO:tasks.ceph.osd.3.smithi130.stderr:2023-09-13T06:01:10.265+0000 7f1c86d2b640 -1 Falling back to public interface 2023-09-13T06:01:10.268 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-09-13T06:01:10.265+0000 7f88ff0d4640 -1 Falling back to public interface 2023-09-13T06:01:10.277 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-09-13T06:01:10.273+0000 7f1598b4c640 -1 osd.0 0 log_to_monitors true 2023-09-13T06:01:10.287 INFO:tasks.ceph.osd.4.smithi164.stderr:2023-09-13T06:01:10.285+0000 7fa3504c1640 -1 Falling back to public interface 2023-09-13T06:01:10.289 INFO:tasks.ceph.osd.2.smithi130.stderr:2023-09-13T06:01:10.285+0000 7f0c9842b640 -1 osd.2 0 log_to_monitors true 2023-09-13T06:01:10.297 INFO:tasks.ceph.osd.3.smithi130.stderr:2023-09-13T06:01:10.293+0000 7f1c86d2b640 -1 osd.3 0 log_to_monitors true 2023-09-13T06:01:10.298 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-09-13T06:01:10.293+0000 7f88ff0d4640 -1 osd.1 0 log_to_monitors true 2023-09-13T06:01:10.302 INFO:tasks.ceph.osd.5.smithi164.stderr:2023-09-13T06:01:10.301+0000 7f1ee9c95640 -1 Falling back to public interface 2023-09-13T06:01:10.310 INFO:tasks.ceph.osd.6.smithi164.stderr:2023-09-13T06:01:10.309+0000 7ff5dec2b640 -1 Falling back to public interface 2023-09-13T06:01:10.311 INFO:tasks.ceph.osd.4.smithi164.stderr:2023-09-13T06:01:10.309+0000 7fa3504c1640 -1 osd.4 0 log_to_monitors true 2023-09-13T06:01:10.329 INFO:tasks.ceph.osd.5.smithi164.stderr:2023-09-13T06:01:10.329+0000 7f1ee9c95640 -1 osd.5 0 log_to_monitors true 2023-09-13T06:01:10.333 INFO:tasks.ceph.osd.7.smithi164.stderr:2023-09-13T06:01:10.333+0000 7fd0709cc640 -1 Falling back to public interface 2023-09-13T06:01:10.334 INFO:tasks.ceph.osd.6.smithi164.stderr:2023-09-13T06:01:10.333+0000 7ff5dec2b640 -1 osd.6 0 log_to_monitors true 2023-09-13T06:01:10.359 INFO:tasks.ceph.osd.7.smithi164.stderr:2023-09-13T06:01:10.357+0000 7fd0709cc640 -1 osd.7 0 log_to_monitors true 2023-09-13T06:01:10.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73fb2c640 1 Processor -- start 2023-09-13T06:01:10.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73fb2c640 1 -- start start 2023-09-13T06:01:10.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73fb2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7380d1090 0x7ff73815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:10.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73fb2c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff738146f30 0x7ff7380b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:10.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73fb2c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7380b63c0 con 0x7ff7380d1750 2023-09-13T06:01:10.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73fb2c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73815dea0 con 0x7ff738146f30 2023-09-13T06:01:10.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73fb2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380d0c20 con 0x7ff7380d1090 2023-09-13T06:01:10.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73d8c8640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff7380d1750 0x7ff738146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49052/0 (socket says 172.21.15.130:49052) 2023-09-13T06:01:10.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73d8c8640 1 -- 172.21.15.130:0/646711270 learned_addr learned my addr 172.21.15.130:0/646711270 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:10.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73d0c7640 1 --2- 172.21.15.130:0/646711270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7380d1090 0x7ff73815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:10.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73e0c9640 1 --2- 172.21.15.130:0/646711270 >> v2:172.21.15.164:3300/0 conn(0x7ff738146f30 0x7ff7380b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:10.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73c8c6640 1 -- 172.21.15.130:0/646711270 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359878935 0 0) 0x7ff7380b63c0 con 0x7ff7380d1750 2023-09-13T06:01:10.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73c8c6640 1 -- 172.21.15.130:0/646711270 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff724003530 con 0x7ff7380d1750 2023-09-13T06:01:10.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73d0c7640 1 -- 172.21.15.130:0/646711270 >> v2:172.21.15.164:3300/0 conn(0x7ff738146f30 msgr2=0x7ff7380b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:10.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73d0c7640 1 --2- 172.21.15.130:0/646711270 >> v2:172.21.15.164:3300/0 conn(0x7ff738146f30 0x7ff7380b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73d0c7640 1 -- 172.21.15.130:0/646711270 >> v1:172.21.15.130:6789/0 conn(0x7ff7380d1750 legacy=0x7ff738146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:10.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73c8c6640 1 -- 172.21.15.130:0/646711270 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503098232 0 0) 0x7ff724003530 con 0x7ff7380d1750 2023-09-13T06:01:10.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.373+0000 7ff73d0c7640 1 -- 172.21.15.130:0/646711270 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380b6610 con 0x7ff7380d1090 2023-09-13T06:01:10.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.377+0000 7ff73d0c7640 1 --2- 172.21.15.130:0/646711270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7380d1090 0x7ff73815d960 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff7280097c0 tx=0x7ff72801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=180e2993b35f1b1c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:10.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.377+0000 7ff73c8c6640 1 -- 172.21.15.130:0/646711270 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734001680 con 0x7ff7380d1090 2023-09-13T06:01:10.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.377+0000 7ff73c8c6640 1 -- 172.21.15.130:0/646711270 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7280a7050 con 0x7ff7380d1090 2023-09-13T06:01:10.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.377+0000 7ff73c8c6640 1 -- 172.21.15.130:0/646711270 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280ab620 con 0x7ff7380d1090 2023-09-13T06:01:10.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.377+0000 7ff73fb2c640 1 -- 172.21.15.130:0/646711270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7380d1090 msgr2=0x7ff73815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:10.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.377+0000 7ff73fb2c640 1 --2- 172.21.15.130:0/646711270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7380d1090 0x7ff73815d960 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff7280097c0 tx=0x7ff72801c370 comp rx=0 tx=0).stop 2023-09-13T06:01:10.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.377+0000 7ff73fb2c640 1 -- 172.21.15.130:0/646711270 shutdown_connections 2023-09-13T06:01:10.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.377+0000 7ff73fb2c640 1 --2- 172.21.15.130:0/646711270 >> v2:172.21.15.164:3300/0 conn(0x7ff738146f30 0x7ff7380b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.377+0000 7ff73fb2c640 1 --2- 172.21.15.130:0/646711270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7380d1090 0x7ff73815d960 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.377+0000 7ff73fb2c640 1 -- 172.21.15.130:0/646711270 >> 172.21.15.130:0/646711270 conn(0x7ff73806f170 msgr2=0x7ff73806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:10.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73fb2c640 1 -- 172.21.15.130:0/646711270 shutdown_connections 2023-09-13T06:01:10.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73fb2c640 1 -- 172.21.15.130:0/646711270 wait complete. 2023-09-13T06:01:10.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73fb2c640 1 Processor -- start 2023-09-13T06:01:10.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73fb2c640 1 -- start start 2023-09-13T06:01:10.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73fb2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7380d1090 0x7ff73813fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:10.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73fb2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7380d1750 0x7ff738167b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:10.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73fb2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff738146f30 0x7ff7381658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:10.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73fb2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff738140280 con 0x7ff738146f30 2023-09-13T06:01:10.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73fb2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73815bc60 con 0x7ff7380d1750 2023-09-13T06:01:10.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73fb2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73815bf40 con 0x7ff7380d1090 2023-09-13T06:01:10.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73e0c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff738146f30 0x7ff7381658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:10.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73d0c7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7380d1750 0x7ff738167b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:10.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73d8c8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7380d1090 0x7ff73813fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:10.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73d0c7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7380d1750 0x7ff738167b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:45950/0 (socket says 172.21.15.130:45950) 2023-09-13T06:01:10.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73d0c7640 1 -- 172.21.15.130:0/3774164965 learned_addr learned my addr 172.21.15.130:0/3774164965 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:10.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73d0c7640 1 -- 172.21.15.130:0/3774164965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7380d1090 msgr2=0x7ff73813fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:10.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73d0c7640 1 --2- 172.21.15.130:0/3774164965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7380d1090 0x7ff73813fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73d0c7640 1 -- 172.21.15.130:0/3774164965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff738146f30 msgr2=0x7ff7381658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:10.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73d0c7640 1 --2- 172.21.15.130:0/3774164965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff738146f30 0x7ff7381658f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73d0c7640 1 -- 172.21.15.130:0/3774164965 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff728009420 con 0x7ff7380d1750 2023-09-13T06:01:10.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73e0c9640 1 --2- 172.21.15.130:0/3774164965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff738146f30 0x7ff7381658f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:10.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.381+0000 7ff73d0c7640 1 --2- 172.21.15.130:0/3774164965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7380d1750 0x7ff738167b60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff72801aa20 tx=0x7ff728019110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:10.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.385+0000 7ff72e7fc640 1 -- 172.21.15.130:0/3774164965 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280b4410 con 0x7ff7380d1750 2023-09-13T06:01:10.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.385+0000 7ff72e7fc640 1 -- 172.21.15.130:0/3774164965 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7280b4590 con 0x7ff7380d1750 2023-09-13T06:01:10.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.385+0000 7ff72e7fc640 1 -- 172.21.15.130:0/3774164965 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280b4940 con 0x7ff7380d1750 2023-09-13T06:01:10.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.385+0000 7ff73fb2c640 1 -- 172.21.15.130:0/3774164965 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7380b7e40 con 0x7ff7380d1750 2023-09-13T06:01:10.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.385+0000 7ff73fb2c640 1 -- 172.21.15.130:0/3774164965 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73815c500 con 0x7ff7380d1750 2023-09-13T06:01:10.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.385+0000 7ff72e7fc640 1 -- 172.21.15.130:0/3774164965 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff7280b2040 con 0x7ff7380d1750 2023-09-13T06:01:10.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.385+0000 7ff72e7fc640 1 -- 172.21.15.130:0/3774164965 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff7280b4da0 con 0x7ff7380d1750 2023-09-13T06:01:10.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.385+0000 7ff73fb2c640 1 -- 172.21.15.130:0/3774164965 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7380618a0 con 0x7ff7380d1750 2023-09-13T06:01:10.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.397+0000 7ff72e7fc640 1 -- 172.21.15.130:0/3774164965 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ff7280c2060 con 0x7ff7380d1750 2023-09-13T06:01:10.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.453+0000 7ff73fb2c640 1 -- 172.21.15.130:0/3774164965 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7380b86c0 con 0x7ff7380d1750 2023-09-13T06:01:10.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.453+0000 7ff72e7fc640 1 -- 172.21.15.130:0/3774164965 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff7280b8070 con 0x7ff7380d1750 2023-09-13T06:01:10.456 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:10.457 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":10,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:10.076099+0000","last_up_change":"0.000000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:10.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.453+0000 7ff73fb2c640 1 -- 172.21.15.130:0/3774164965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7380d1750 msgr2=0x7ff738167b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:10.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.453+0000 7ff73fb2c640 1 --2- 172.21.15.130:0/3774164965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7380d1750 0x7ff738167b60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff72801aa20 tx=0x7ff728019110 comp rx=0 tx=0).stop 2023-09-13T06:01:10.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.453+0000 7ff73fb2c640 1 -- 172.21.15.130:0/3774164965 shutdown_connections 2023-09-13T06:01:10.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.453+0000 7ff73fb2c640 1 --2- 172.21.15.130:0/3774164965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7380d1750 0x7ff738167b60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.453+0000 7ff73fb2c640 1 --2- 172.21.15.130:0/3774164965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff738146f30 0x7ff7381658f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.453+0000 7ff73fb2c640 1 --2- 172.21.15.130:0/3774164965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7380d1090 0x7ff73813fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:10.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.453+0000 7ff73fb2c640 1 -- 172.21.15.130:0/3774164965 >> 172.21.15.130:0/3774164965 conn(0x7ff73806f170 msgr2=0x7ff73806f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:10.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.453+0000 7ff73fb2c640 1 -- 172.21.15.130:0/3774164965 shutdown_connections 2023-09-13T06:01:10.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:10.453+0000 7ff73fb2c640 1 -- 172.21.15.130:0/3774164965 wait complete. 2023-09-13T06:01:10.476 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-13T06:01:10.476 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-13T06:01:10.496 INFO:tasks.ceph.mgr.y.smithi130.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-09-13T06:01:10.497 INFO:tasks.ceph.mgr.y.smithi130.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-09-13T06:01:10.497 INFO:tasks.ceph.mgr.y.smithi130.stderr: from numpy import show_config as show_numpy_config 2023-09-13T06:01:10.540 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:10.537+0000 7f94ddd2a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-13T06:01:10.565 INFO:tasks.ceph.mgr.x.smithi164.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-09-13T06:01:10.565 INFO:tasks.ceph.mgr.x.smithi164.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-09-13T06:01:10.566 INFO:tasks.ceph.mgr.x.smithi164.stderr: from numpy import show_config as show_numpy_config 2023-09-13T06:01:10.621 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:10.621+0000 7fbc5582c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-13T06:01:10.675 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:10.673+0000 7f94ddd2a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-13T06:01:10.756 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:10.753+0000 7fbc5582c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-13T06:01:10.849 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:10.845+0000 7f94ddd2a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-13T06:01:10.921 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:10.917+0000 7f94ddd2a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-13T06:01:10.933 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:10.933+0000 7fbc5582c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-13T06:01:11.005 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:11.005+0000 7fbc5582c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-13T06:01:11.058 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:11.053+0000 7f94ddd2a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-13T06:01:11.142 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:11.141+0000 7fbc5582c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-13T06:01:11.282 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:11.412 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd131e93640 1 Processor -- start 2023-09-13T06:01:11.412 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd131e93640 1 -- start start 2023-09-13T06:01:11.414 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd131e93640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd12c15d3f0 0x7fd12c06fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:11.414 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd131e93640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 0x7fd12c0d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:11.414 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd131e93640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12c070890 con 0x7fd12c15d7d0 2023-09-13T06:01:11.414 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd131e93640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12c070b70 con 0x7fd12c15d3f0 2023-09-13T06:01:11.414 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd131e93640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c15dc80 con 0x7fd12c070410 2023-09-13T06:01:11.415 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd12b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd12c15d3f0 0x7fd12c06fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:11.415 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd12b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd12c15d3f0 0x7fd12c06fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42230/0 (socket says 172.21.15.130:42230) 2023-09-13T06:01:11.415 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd12b7fe640 1 -- 172.21.15.130:0/2757932489 learned_addr learned my addr 172.21.15.130:0/2757932489 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:11.415 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd12affd640 1 --2- 172.21.15.130:0/2757932489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 0x7fd12c0d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:11.415 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd12b7fe640 1 -- 172.21.15.130:0/2757932489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 msgr2=0x7fd12c0d1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:11.416 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd12b7fe640 1 --2- 172.21.15.130:0/2757932489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 0x7fd12c0d1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:11.416 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd12b7fe640 1 -- 172.21.15.130:0/2757932489 >> v1:172.21.15.164:6789/0 conn(0x7fd12c15d7d0 legacy=0x7fd12c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:11.416 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.409+0000 7fd12b7fe640 1 -- 172.21.15.130:0/2757932489 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c15df60 con 0x7fd12c15d3f0 2023-09-13T06:01:11.417 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd12b7fe640 1 --2- 172.21.15.130:0/2757932489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd12c15d3f0 0x7fd12c06fed0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009870 tx=0x7fd11c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b20e62b8d84cb1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:11.417 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd12a7fc640 1 -- 172.21.15.130:0/2757932489 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0a95f0 con 0x7fd12c15d3f0 2023-09-13T06:01:11.417 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd12a7fc640 1 -- 172.21.15.130:0/2757932489 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c0a9750 con 0x7fd12c15d3f0 2023-09-13T06:01:11.417 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd12a7fc640 1 -- 172.21.15.130:0/2757932489 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0a9ae0 con 0x7fd12c15d3f0 2023-09-13T06:01:11.418 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd131e93640 1 -- 172.21.15.130:0/2757932489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd12c15d3f0 msgr2=0x7fd12c06fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:11.419 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd131e93640 1 --2- 172.21.15.130:0/2757932489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd12c15d3f0 0x7fd12c06fed0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009870 tx=0x7fd11c01c510 comp rx=0 tx=0).stop 2023-09-13T06:01:11.419 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd131e93640 1 -- 172.21.15.130:0/2757932489 shutdown_connections 2023-09-13T06:01:11.419 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd131e93640 1 --2- 172.21.15.130:0/2757932489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 0x7fd12c0d1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:11.419 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd131e93640 1 --2- 172.21.15.130:0/2757932489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd12c15d3f0 0x7fd12c06fed0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:11.419 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd131e93640 1 -- 172.21.15.130:0/2757932489 >> 172.21.15.130:0/2757932489 conn(0x7fd12c0cfd70 msgr2=0x7fd12c0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:11.420 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd131e93640 1 -- 172.21.15.130:0/2757932489 shutdown_connections 2023-09-13T06:01:11.420 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.413+0000 7fd131e93640 1 -- 172.21.15.130:0/2757932489 wait complete. 2023-09-13T06:01:11.421 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd131e93640 1 Processor -- start 2023-09-13T06:01:11.421 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd131e93640 1 -- start start 2023-09-13T06:01:11.422 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd131e93640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 0x7fd12c15ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:11.422 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd131e93640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd12c15d3f0 0x7fd12c151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:11.422 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd131e93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd12c15d7d0 0x7fd12c140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:11.422 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd131e93640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c151780 con 0x7fd12c15d7d0 2023-09-13T06:01:11.423 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd131e93640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c141220 con 0x7fd12c15d3f0 2023-09-13T06:01:11.423 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd131e93640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c15f240 con 0x7fd12c070410 2023-09-13T06:01:11.423 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd12b7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 0x7fd12c15ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:11.423 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd12bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd12c15d7d0 0x7fd12c140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:11.423 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd12b7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 0x7fd12c15ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:34850/0 (socket says 172.21.15.130:34850) 2023-09-13T06:01:11.424 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd12b7fe640 1 -- 172.21.15.130:0/1452083277 learned_addr learned my addr 172.21.15.130:0/1452083277 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:11.424 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd12affd640 1 --2- 172.21.15.130:0/1452083277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd12c15d3f0 0x7fd12c151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:11.424 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd12b7fe640 1 -- 172.21.15.130:0/1452083277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd12c15d3f0 msgr2=0x7fd12c151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:11.424 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd12b7fe640 1 --2- 172.21.15.130:0/1452083277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd12c15d3f0 0x7fd12c151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:11.424 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd12b7fe640 1 -- 172.21.15.130:0/1452083277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd12c15d7d0 msgr2=0x7fd12c140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:11.424 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd12b7fe640 1 --2- 172.21.15.130:0/1452083277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd12c15d7d0 0x7fd12c140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:11.425 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd12b7fe640 1 -- 172.21.15.130:0/1452083277 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c0094d0 con 0x7fd12c070410 2023-09-13T06:01:11.426 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.417+0000 7fd12b7fe640 1 --2- 172.21.15.130:0/1452083277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 0x7fd12c15ebf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0ab040 tx=0x7fd11c01ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:11.426 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.421+0000 7fd113fff640 1 -- 172.21.15.130:0/1452083277 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0b1800 con 0x7fd12c070410 2023-09-13T06:01:11.427 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.421+0000 7fd113fff640 1 -- 172.21.15.130:0/1452083277 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c0b1980 con 0x7fd12c070410 2023-09-13T06:01:11.427 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.421+0000 7fd113fff640 1 -- 172.21.15.130:0/1452083277 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0b1d30 con 0x7fd12c070410 2023-09-13T06:01:11.427 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.421+0000 7fd131e93640 1 -- 172.21.15.130:0/1452083277 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12c15f520 con 0x7fd12c070410 2023-09-13T06:01:11.427 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.421+0000 7fd131e93640 1 -- 172.21.15.130:0/1452083277 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12c15fae0 con 0x7fd12c070410 2023-09-13T06:01:11.427 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.421+0000 7fd113fff640 1 -- 172.21.15.130:0/1452083277 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd11c0bc450 con 0x7fd12c070410 2023-09-13T06:01:11.428 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.421+0000 7fd113fff640 1 -- 172.21.15.130:0/1452083277 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1883+0+0 (secure 0 0 0) 0x7fd11c0a9570 con 0x7fd12c070410 2023-09-13T06:01:11.428 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.421+0000 7fd131e93640 1 -- 172.21.15.130:0/1452083277 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12c0618a0 con 0x7fd12c070410 2023-09-13T06:01:11.428 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.425+0000 7fd113fff640 1 -- 172.21.15.130:0/1452083277 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd11c0bc700 con 0x7fd12c070410 2023-09-13T06:01:11.485 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.481+0000 7fd131e93640 1 -- 172.21.15.130:0/1452083277 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd12c0d2b40 con 0x7fd12c070410 2023-09-13T06:01:11.486 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.485+0000 7fd113fff640 1 -- 172.21.15.130:0/1452083277 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd11c0cd090 con 0x7fd12c070410 2023-09-13T06:01:11.487 INFO:teuthology.misc.health.smithi130.stdout: 2023-09-13T06:01:11.487 INFO:teuthology.misc.health.smithi130.stdout:{"epoch":11,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:11.077944+0000","last_up_change":"0.000000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:11.488 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.485+0000 7fd131e93640 1 -- 172.21.15.130:0/1452083277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 msgr2=0x7fd12c15ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:11.488 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.485+0000 7fd131e93640 1 --2- 172.21.15.130:0/1452083277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 0x7fd12c15ebf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0ab040 tx=0x7fd11c01ad50 comp rx=0 tx=0).stop 2023-09-13T06:01:11.488 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.485+0000 7fd131e93640 1 -- 172.21.15.130:0/1452083277 shutdown_connections 2023-09-13T06:01:11.489 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.485+0000 7fd131e93640 1 --2- 172.21.15.130:0/1452083277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd12c15d3f0 0x7fd12c151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:11.489 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.485+0000 7fd131e93640 1 --2- 172.21.15.130:0/1452083277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd12c15d7d0 0x7fd12c140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:11.489 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.485+0000 7fd131e93640 1 --2- 172.21.15.130:0/1452083277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd12c070410 0x7fd12c15ebf0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:11.489 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.485+0000 7fd131e93640 1 -- 172.21.15.130:0/1452083277 >> 172.21.15.130:0/1452083277 conn(0x7fd12c0cfd70 msgr2=0x7fd12c15c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:11.490 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.485+0000 7fd131e93640 1 -- 172.21.15.130:0/1452083277 shutdown_connections 2023-09-13T06:01:11.490 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:11.485+0000 7fd131e93640 1 -- 172.21.15.130:0/1452083277 wait complete. 2023-09-13T06:01:11.504 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-13T06:01:11.760 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:11.757+0000 7f94ddd2a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-13T06:01:11.846 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:11.845+0000 7f94ddd2a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-13T06:01:11.852 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:11.849+0000 7fbc5582c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-13T06:01:11.938 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:11.937+0000 7fbc5582c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-13T06:01:12.033 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:12.029+0000 7f94ddd2a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-13T06:01:12.114 INFO:tasks.ceph.osd.2.smithi130.stderr:2023-09-13T06:01:12.109+0000 7f0c940cd640 -1 osd.2 0 waiting for initial osdmap 2023-09-13T06:01:12.115 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-09-13T06:01:12.109+0000 7f1594af4640 -1 osd.0 0 waiting for initial osdmap 2023-09-13T06:01:12.115 INFO:tasks.ceph.osd.4.smithi164.stderr:2023-09-13T06:01:12.113+0000 7fa34cc7d640 -1 osd.4 0 waiting for initial osdmap 2023-09-13T06:01:12.116 INFO:tasks.ceph.osd.7.smithi164.stderr:2023-09-13T06:01:12.113+0000 7fd06c974640 -1 osd.7 0 waiting for initial osdmap 2023-09-13T06:01:12.117 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-09-13T06:01:12.113+0000 7f158e13d640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T06:01:12.117 INFO:tasks.ceph.osd.4.smithi164.stderr:2023-09-13T06:01:12.117+0000 7fa345ab2640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T06:01:12.118 INFO:tasks.ceph.osd.2.smithi130.stderr:2023-09-13T06:01:12.113+0000 7f0c8cf02640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T06:01:12.118 INFO:tasks.ceph.osd.7.smithi164.stderr:2023-09-13T06:01:12.117+0000 7fd065fbd640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T06:01:12.124 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:12.121+0000 7f94ddd2a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-13T06:01:12.131 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-09-13T06:01:12.129+0000 7f88fb07c640 -1 osd.1 0 waiting for initial osdmap 2023-09-13T06:01:12.131 INFO:tasks.ceph.osd.3.smithi130.stderr:2023-09-13T06:01:12.129+0000 7f1c82cd3640 -1 osd.3 0 waiting for initial osdmap 2023-09-13T06:01:12.132 INFO:tasks.ceph.osd.5.smithi164.stderr:2023-09-13T06:01:12.129+0000 7f1ee5c3f640 -1 osd.5 0 waiting for initial osdmap 2023-09-13T06:01:12.132 INFO:tasks.ceph.osd.6.smithi164.stderr:2023-09-13T06:01:12.129+0000 7ff5da1b4640 -1 osd.6 0 waiting for initial osdmap 2023-09-13T06:01:12.133 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-09-13T06:01:12.129+0000 7f88f46c5640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T06:01:12.133 INFO:tasks.ceph.osd.3.smithi130.stderr:2023-09-13T06:01:12.129+0000 7f1c7c31c640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T06:01:12.134 INFO:tasks.ceph.osd.5.smithi164.stderr:2023-09-13T06:01:12.133+0000 7f1edf288640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T06:01:12.134 INFO:tasks.ceph.osd.6.smithi164.stderr:2023-09-13T06:01:12.133+0000 7ff5d37fd640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T06:01:12.135 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:12.133+0000 7fbc5582c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-13T06:01:12.220 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:12.217+0000 7fbc5582c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-13T06:01:12.452 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:12.449+0000 7f94ddd2a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-13T06:01:12.520 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:12.517+0000 7f94ddd2a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-13T06:01:12.558 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:12.557+0000 7fbc5582c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-13T06:01:12.628 INFO:tasks.ceph.mgr.x.smithi164.stderr:2023-09-13T06:01:12.625+0000 7fbc5582c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-13T06:01:13.545 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:13.541+0000 7f9485498640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-13T06:01:13.545 INFO:tasks.ceph.mgr.y.smithi130.stderr:2023-09-13T06:01:13.541+0000 7f9485498640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-13T06:01:13.823 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:01:13.827 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:01:18.312 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:18.450 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.445+0000 7f148006a640 1 Processor -- start 2023-09-13T06:01:18.450 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f148006a640 1 -- start start 2023-09-13T06:01:18.451 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f148006a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1478151f30 0x7f147815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.452 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f148006a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f147815ed30 0x7f14780b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.452 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f148006a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14780cd690 con 0x7f1478152310 2023-09-13T06:01:18.452 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f148006a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147815c700 con 0x7f1478151f30 2023-09-13T06:01:18.452 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f148006a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147815f210 con 0x7f147815ed30 2023-09-13T06:01:18.453 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f147de06640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1478151f30 0x7f147815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.453 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f147e607640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1478152310 0x7f147806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43230/0 (socket says 172.21.15.130:43230) 2023-09-13T06:01:18.454 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f147e607640 1 -- 172.21.15.130:0/173876773 learned_addr learned my addr 172.21.15.130:0/173876773 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:18.454 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f147d605640 1 --2- 172.21.15.130:0/173876773 >> v2:172.21.15.164:3300/0 conn(0x7f147815ed30 0x7f14780b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.454 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f147de06640 1 -- 172.21.15.130:0/173876773 >> v2:172.21.15.164:3300/0 conn(0x7f147815ed30 msgr2=0x7f14780b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:18.454 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f147de06640 1 --2- 172.21.15.130:0/173876773 >> v2:172.21.15.164:3300/0 conn(0x7f147815ed30 0x7f14780b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.454 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f147de06640 1 -- 172.21.15.130:0/173876773 >> v1:172.21.15.130:6789/0 conn(0x7f1478152310 legacy=0x7f147806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.455 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f147de06640 1 -- 172.21.15.130:0/173876773 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147815f4f0 con 0x7f1478151f30 2023-09-13T06:01:18.455 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.449+0000 7f147ce04640 1 -- 172.21.15.130:0/173876773 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7690329 0 0) 0x7f14780cd690 con 0x7f1478152310 2023-09-13T06:01:18.456 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f147de06640 1 --2- 172.21.15.130:0/173876773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1478151f30 0x7f147815c1c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f147806b800 tx=0x7f147401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa561fa06f34d17 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:18.456 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f147ce04640 1 -- 172.21.15.130:0/173876773 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740a7070 con 0x7f1478151f30 2023-09-13T06:01:18.457 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f147ce04640 1 -- 172.21.15.130:0/173876773 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14740ab430 con 0x7f1478151f30 2023-09-13T06:01:18.457 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f147ce04640 1 -- 172.21.15.130:0/173876773 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740ab7c0 con 0x7f1478151f30 2023-09-13T06:01:18.457 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f148006a640 1 -- 172.21.15.130:0/173876773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1478151f30 msgr2=0x7f147815c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.457 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f148006a640 1 --2- 172.21.15.130:0/173876773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1478151f30 0x7f147815c1c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f147806b800 tx=0x7f147401c430 comp rx=0 tx=0).stop 2023-09-13T06:01:18.457 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f148006a640 1 -- 172.21.15.130:0/173876773 shutdown_connections 2023-09-13T06:01:18.458 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f148006a640 1 --2- 172.21.15.130:0/173876773 >> v2:172.21.15.164:3300/0 conn(0x7f147815ed30 0x7f14780b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.458 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f148006a640 1 --2- 172.21.15.130:0/173876773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1478151f30 0x7f147815c1c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.458 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f148006a640 1 -- 172.21.15.130:0/173876773 >> 172.21.15.130:0/173876773 conn(0x7f147806a2f0 msgr2=0x7f147806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:18.458 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f148006a640 1 -- 172.21.15.130:0/173876773 shutdown_connections 2023-09-13T06:01:18.458 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.453+0000 7f148006a640 1 -- 172.21.15.130:0/173876773 wait complete. 2023-09-13T06:01:18.460 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f148006a640 1 Processor -- start 2023-09-13T06:01:18.461 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f148006a640 1 -- start start 2023-09-13T06:01:18.461 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f148006a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1478151f30 0x7f14780b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.461 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f148006a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1478152310 0x7f1478141290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.461 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f148006a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f147815ed30 0x7f1478150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.462 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f148006a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14780b4640 con 0x7f1478152310 2023-09-13T06:01:18.462 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f148006a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1478070280 con 0x7f147815ed30 2023-09-13T06:01:18.462 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f148006a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1478070560 con 0x7f1478151f30 2023-09-13T06:01:18.462 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147d605640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1478152310 0x7f1478141290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.462 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147d605640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1478152310 0x7f1478141290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42308/0 (socket says 172.21.15.130:42308) 2023-09-13T06:01:18.463 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147d605640 1 -- 172.21.15.130:0/707149904 learned_addr learned my addr 172.21.15.130:0/707149904 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:18.463 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147e607640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f147815ed30 0x7f1478150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.463 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147de06640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1478151f30 0x7f14780b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.463 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147d605640 1 -- 172.21.15.130:0/707149904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1478151f30 msgr2=0x7f14780b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.463 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147d605640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1478151f30 0x7f14780b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.464 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147d605640 1 -- 172.21.15.130:0/707149904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f147815ed30 msgr2=0x7f1478150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.464 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147d605640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f147815ed30 0x7f1478150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.464 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147d605640 1 -- 172.21.15.130:0/707149904 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474009420 con 0x7f1478152310 2023-09-13T06:01:18.464 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147de06640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1478151f30 0x7f14780b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:18.464 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f147d605640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1478152310 0x7f1478141290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f146800d5c0 tx=0x7f146800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:18.465 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f146e7fc640 1 -- 172.21.15.130:0/707149904 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468004240 con 0x7f1478152310 2023-09-13T06:01:18.465 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f146e7fc640 1 -- 172.21.15.130:0/707149904 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14680043a0 con 0x7f1478152310 2023-09-13T06:01:18.465 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f146e7fc640 1 -- 172.21.15.130:0/707149904 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468003840 con 0x7f1478152310 2023-09-13T06:01:18.465 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f148006a640 1 -- 172.21.15.130:0/707149904 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1478070840 con 0x7f1478152310 2023-09-13T06:01:18.465 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f148006a640 1 -- 172.21.15.130:0/707149904 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1478070e00 con 0x7f1478152310 2023-09-13T06:01:18.466 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.457+0000 7f148006a640 1 -- 172.21.15.130:0/707149904 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14781498b0 con 0x7f1478152310 2023-09-13T06:01:18.467 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.461+0000 7f146e7fc640 1 -- 172.21.15.130:0/707149904 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f14680039a0 con 0x7f1478152310 2023-09-13T06:01:18.467 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.461+0000 7f146e7fc640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f145c065b20 0x7f145c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.467 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.461+0000 7f146e7fc640 1 -- 172.21.15.130:0/707149904 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1468083140 con 0x7f1478152310 2023-09-13T06:01:18.467 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.461+0000 7f147de06640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f145c065b20 0x7f145c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.467 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.461+0000 7f147de06640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f145c065b20 0x7f145c067fe0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f14740af000 tx=0x7f1474008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:18.468 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.465+0000 7f146e7fc640 1 -- 172.21.15.130:0/707149904 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1468050e70 con 0x7f1478152310 2023-09-13T06:01:18.620 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.617+0000 7f148006a640 1 -- 172.21.15.130:0/707149904 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14780618a0 con 0x7f1478152310 2023-09-13T06:01:18.621 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.617+0000 7f146e7fc640 1 -- 172.21.15.130:0/707149904 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f1468054490 con 0x7f1478152310 2023-09-13T06:01:18.621 INFO:teuthology.misc.health.smithi130.stdout: 2023-09-13T06:01:18.622 INFO:teuthology.misc.health.smithi130.stdout:{"epoch":17,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:17.130604+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:18.623 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 -- 172.21.15.130:0/707149904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f145c065b20 msgr2=0x7f145c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.624 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f145c065b20 0x7f145c067fe0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f14740af000 tx=0x7f1474008040 comp rx=0 tx=0).stop 2023-09-13T06:01:18.624 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 -- 172.21.15.130:0/707149904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1478152310 msgr2=0x7f1478141290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.624 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1478152310 0x7f1478141290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f146800d5c0 tx=0x7f146800da80 comp rx=0 tx=0).stop 2023-09-13T06:01:18.625 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 -- 172.21.15.130:0/707149904 shutdown_connections 2023-09-13T06:01:18.625 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f145c065b20 0x7f145c067fe0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.625 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f147815ed30 0x7f1478150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.626 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1478152310 0x7f1478141290 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.626 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 --2- 172.21.15.130:0/707149904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1478151f30 0x7f14780b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.626 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 -- 172.21.15.130:0/707149904 >> 172.21.15.130:0/707149904 conn(0x7f147806a2f0 msgr2=0x7f14780b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:18.627 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 -- 172.21.15.130:0/707149904 shutdown_connections 2023-09-13T06:01:18.627 INFO:teuthology.misc.health.smithi130.stderr:2023-09-13T06:01:18.621+0000 7f148006a640 1 -- 172.21.15.130:0/707149904 wait complete. 2023-09-13T06:01:18.641 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-13T06:01:18.642 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-13T06:01:18.643 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T06:01:18.644 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T06:01:18.648 INFO:tasks.ceph.mds.a:Started 2023-09-13T06:01:18.648 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T06:01:18.649 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T06:01:18.652 INFO:tasks.ceph.mds.c:Started 2023-09-13T06:01:18.652 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T06:01:18.653 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T06:01:18.657 INFO:tasks.ceph.mds.b:Started 2023-09-13T06:01:18.657 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T06:01:18.658 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T06:01:18.661 INFO:tasks.ceph.mds.d:Started 2023-09-13T06:01:18.662 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-13T06:01:18.662 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:18.753 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:01:18.754 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:01:18.770 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:01:18.771 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:01:18.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff463911640 1 Processor -- start 2023-09-13T06:01:18.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff463911640 1 -- start start 2023-09-13T06:01:18.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff463911640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff45c0d1750 0x7ff45c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff463911640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff45c146f30 0x7ff45c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff463911640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45c0b63c0 con 0x7ff45c0d1090 2023-09-13T06:01:18.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff463911640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c15dea0 con 0x7ff45c0d1750 2023-09-13T06:01:18.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff463911640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c0d0c20 con 0x7ff45c146f30 2023-09-13T06:01:18.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff4616ad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff45c0d1750 0x7ff45c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff4616ad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff45c0d1750 0x7ff45c15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42344/0 (socket says 172.21.15.130:42344) 2023-09-13T06:01:18.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff4616ad640 1 -- 172.21.15.130:0/2694290529 learned_addr learned my addr 172.21.15.130:0/2694290529 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:18.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff461eae640 1 --2- 172.21.15.130:0/2694290529 >> v2:172.21.15.164:3300/0 conn(0x7ff45c146f30 0x7ff45c0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff4616ad640 1 -- 172.21.15.130:0/2694290529 >> v2:172.21.15.164:3300/0 conn(0x7ff45c146f30 msgr2=0x7ff45c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:18.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff4616ad640 1 --2- 172.21.15.130:0/2694290529 >> v2:172.21.15.164:3300/0 conn(0x7ff45c146f30 0x7ff45c0b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff4616ad640 1 -- 172.21.15.130:0/2694290529 >> v1:172.21.15.130:6789/0 conn(0x7ff45c0d1090 legacy=0x7ff45c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff4616ad640 1 -- 172.21.15.130:0/2694290529 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c0b6610 con 0x7ff45c0d1750 2023-09-13T06:01:18.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.809+0000 7ff453fff640 1 -- 172.21.15.130:0/2694290529 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107740648 0 0) 0x7ff45c0b63c0 con 0x7ff45c0d1090 2023-09-13T06:01:18.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff4616ad640 1 --2- 172.21.15.130:0/2694290529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45c0d1750 0x7ff45c15d960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0d2c80 tx=0x7ff45801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b48b61b98365c54 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:18.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff453fff640 1 -- 172.21.15.130:0/2694290529 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580ab640 con 0x7ff45c0d1750 2023-09-13T06:01:18.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff453fff640 1 -- 172.21.15.130:0/2694290529 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4580a7070 con 0x7ff45c0d1750 2023-09-13T06:01:18.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff453fff640 1 -- 172.21.15.130:0/2694290529 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580ab9c0 con 0x7ff45c0d1750 2023-09-13T06:01:18.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff463911640 1 -- 172.21.15.130:0/2694290529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45c0d1750 msgr2=0x7ff45c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff463911640 1 --2- 172.21.15.130:0/2694290529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45c0d1750 0x7ff45c15d960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0d2c80 tx=0x7ff45801c440 comp rx=0 tx=0).stop 2023-09-13T06:01:18.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff463911640 1 -- 172.21.15.130:0/2694290529 shutdown_connections 2023-09-13T06:01:18.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff463911640 1 --2- 172.21.15.130:0/2694290529 >> v2:172.21.15.164:3300/0 conn(0x7ff45c146f30 0x7ff45c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff463911640 1 --2- 172.21.15.130:0/2694290529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45c0d1750 0x7ff45c15d960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff463911640 1 -- 172.21.15.130:0/2694290529 >> 172.21.15.130:0/2694290529 conn(0x7ff45c06f170 msgr2=0x7ff45c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:18.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff463911640 1 -- 172.21.15.130:0/2694290529 shutdown_connections 2023-09-13T06:01:18.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.813+0000 7ff463911640 1 -- 172.21.15.130:0/2694290529 wait complete. 2023-09-13T06:01:18.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff463911640 1 Processor -- start 2023-09-13T06:01:18.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff463911640 1 -- start start 2023-09-13T06:01:18.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff463911640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c0d1090 0x7ff45c15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff463911640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45c0d1750 0x7ff45c144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff463911640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff45c146f30 0x7ff45c145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff463911640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c163bf0 con 0x7ff45c0d1750 2023-09-13T06:01:18.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff463911640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c13d3d0 con 0x7ff45c0d1090 2023-09-13T06:01:18.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff463911640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c13d620 con 0x7ff45c146f30 2023-09-13T06:01:18.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff460eac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45c0d1750 0x7ff45c144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff460eac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45c0d1750 0x7ff45c144f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42350/0 (socket says 172.21.15.130:42350) 2023-09-13T06:01:18.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff460eac640 1 -- 172.21.15.130:0/2115820193 learned_addr learned my addr 172.21.15.130:0/2115820193 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:18.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff4616ad640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c0d1090 0x7ff45c15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff461eae640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff45c146f30 0x7ff45c145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff460eac640 1 -- 172.21.15.130:0/2115820193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff45c146f30 msgr2=0x7ff45c145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff460eac640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff45c146f30 0x7ff45c145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff460eac640 1 -- 172.21.15.130:0/2115820193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c0d1090 msgr2=0x7ff45c15af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff460eac640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c0d1090 0x7ff45c15af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff460eac640 1 -- 172.21.15.130:0/2115820193 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580094d0 con 0x7ff45c0d1750 2023-09-13T06:01:18.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff4616ad640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c0d1090 0x7ff45c15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:18.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff460eac640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45c0d1750 0x7ff45c144f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c520 tx=0x7ff44c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:18.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff451ffb640 1 -- 172.21.15.130:0/2115820193 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c003600 con 0x7ff45c0d1750 2023-09-13T06:01:18.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff451ffb640 1 -- 172.21.15.130:0/2115820193 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c003780 con 0x7ff45c0d1750 2023-09-13T06:01:18.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff451ffb640 1 -- 172.21.15.130:0/2115820193 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c003b30 con 0x7ff45c0d1750 2023-09-13T06:01:18.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff463911640 1 -- 172.21.15.130:0/2115820193 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c0b7e40 con 0x7ff45c0d1750 2023-09-13T06:01:18.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.817+0000 7ff463911640 1 -- 172.21.15.130:0/2115820193 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c13dbe0 con 0x7ff45c0d1750 2023-09-13T06:01:18.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.821+0000 7ff463911640 1 -- 172.21.15.130:0/2115820193 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c0618a0 con 0x7ff45c0d1750 2023-09-13T06:01:18.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.821+0000 7ff451ffb640 1 -- 172.21.15.130:0/2115820193 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff44c003c90 con 0x7ff45c0d1750 2023-09-13T06:01:18.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.821+0000 7ff451ffb640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff440065b20 0x7ff440067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:18.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.821+0000 7ff451ffb640 1 -- 172.21.15.130:0/2115820193 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff44c082560 con 0x7ff45c0d1750 2023-09-13T06:01:18.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.821+0000 7ff4616ad640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff440065b20 0x7ff440067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:18.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.821+0000 7ff4616ad640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff440065b20 0x7ff440067fe0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff4580af000 tx=0x7ff4580b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:18.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.825+0000 7ff451ffb640 1 -- 172.21.15.130:0/2115820193 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff44c0502a0 con 0x7ff45c0d1750 2023-09-13T06:01:18.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.973+0000 7ff463911640 1 -- 172.21.15.130:0/2115820193 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff45c0b86c0 con 0x7ff45c0d1750 2023-09-13T06:01:18.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff451ffb640 1 -- 172.21.15.130:0/2115820193 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12886 (secure 0 0 0) 0x7ff44c017020 con 0x7ff45c0d1750 2023-09-13T06:01:18.979 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:18.979 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":17,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:17.130604+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:18.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 -- 172.21.15.130:0/2115820193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff440065b20 msgr2=0x7ff440067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff440065b20 0x7ff440067fe0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff4580af000 tx=0x7ff4580b6040 comp rx=0 tx=0).stop 2023-09-13T06:01:18.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 -- 172.21.15.130:0/2115820193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45c0d1750 msgr2=0x7ff45c144f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:18.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45c0d1750 0x7ff45c144f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c520 tx=0x7ff44c00c9e0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 -- 172.21.15.130:0/2115820193 shutdown_connections 2023-09-13T06:01:18.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff440065b20 0x7ff440067fe0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff45c146f30 0x7ff45c145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45c0d1750 0x7ff45c144f20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 --2- 172.21.15.130:0/2115820193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c0d1090 0x7ff45c15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:18.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 -- 172.21.15.130:0/2115820193 >> 172.21.15.130:0/2115820193 conn(0x7ff45c06f170 msgr2=0x7ff45c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:18.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 -- 172.21.15.130:0/2115820193 shutdown_connections 2023-09-13T06:01:18.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:18.977+0000 7ff463911640 1 -- 172.21.15.130:0/2115820193 wait complete. 2023-09-13T06:01:18.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:01:19.000 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:01:19.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.137+0000 7f648fa48640 1 Processor -- start 2023-09-13T06:01:19.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.137+0000 7f648fa48640 1 -- start start 2023-09-13T06:01:19.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648fa48640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f648815ae10 0x7f64880d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648fa48640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f64881619b0 0x7f64880cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648fa48640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648815dd40 con 0x7f64880d2b00 2023-09-13T06:01:19.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648fa48640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6488161e40 con 0x7f648815ae10 2023-09-13T06:01:19.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648fa48640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648815e020 con 0x7f64881619b0 2023-09-13T06:01:19.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648d7e4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f648815ae10 0x7f64880d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648d7e4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f648815ae10 0x7f64880d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42366/0 (socket says 172.21.15.130:42366) 2023-09-13T06:01:19.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648d7e4640 1 -- 172.21.15.130:0/1579571159 learned_addr learned my addr 172.21.15.130:0/1579571159 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:19.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648cfe3640 1 --1- 172.21.15.130:0/1579571159 >> v1:172.21.15.130:6789/0 conn(0x7f64880d2b00 0x7f64881612a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43258/0 (socket says 172.21.15.130:43258) 2023-09-13T06:01:19.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648dfe5640 1 --2- 172.21.15.130:0/1579571159 >> v2:172.21.15.164:3300/0 conn(0x7f64881619b0 0x7f64880cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648d7e4640 1 -- 172.21.15.130:0/1579571159 >> v2:172.21.15.164:3300/0 conn(0x7f64881619b0 msgr2=0x7f64880cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:19.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648d7e4640 1 --2- 172.21.15.130:0/1579571159 >> v2:172.21.15.164:3300/0 conn(0x7f64881619b0 0x7f64880cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648d7e4640 1 -- 172.21.15.130:0/1579571159 >> v1:172.21.15.130:6789/0 conn(0x7f64880d2b00 legacy=0x7f64881612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:19.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648d7e4640 1 -- 172.21.15.130:0/1579571159 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648815e300 con 0x7f648815ae10 2023-09-13T06:01:19.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.141+0000 7f648dfe5640 1 --2- 172.21.15.130:0/1579571159 >> v2:172.21.15.164:3300/0 conn(0x7f64881619b0 0x7f64880cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:19.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f648d7e4640 1 --2- 172.21.15.130:0/1579571159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f648815ae10 0x7f64880d25c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f64880d15b0 tx=0x7f648401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb2ecd6daebe0d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:19.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f647ffff640 1 -- 172.21.15.130:0/1579571159 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840ac630 con 0x7f648815ae10 2023-09-13T06:01:19.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f647ffff640 1 -- 172.21.15.130:0/1579571159 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64840ac790 con 0x7f648815ae10 2023-09-13T06:01:19.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f647ffff640 1 -- 172.21.15.130:0/1579571159 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840acb20 con 0x7f648815ae10 2023-09-13T06:01:19.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f648fa48640 1 -- 172.21.15.130:0/1579571159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f648815ae10 msgr2=0x7f64880d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:19.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f648fa48640 1 --2- 172.21.15.130:0/1579571159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f648815ae10 0x7f64880d25c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f64880d15b0 tx=0x7f648401c3b0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f648fa48640 1 -- 172.21.15.130:0/1579571159 shutdown_connections 2023-09-13T06:01:19.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f648fa48640 1 --2- 172.21.15.130:0/1579571159 >> v2:172.21.15.164:3300/0 conn(0x7f64881619b0 0x7f64880cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f648fa48640 1 --2- 172.21.15.130:0/1579571159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f648815ae10 0x7f64880d25c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f648fa48640 1 -- 172.21.15.130:0/1579571159 >> 172.21.15.130:0/1579571159 conn(0x7f6488065990 msgr2=0x7f6488065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:19.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f648fa48640 1 -- 172.21.15.130:0/1579571159 shutdown_connections 2023-09-13T06:01:19.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.145+0000 7f648fa48640 1 -- 172.21.15.130:0/1579571159 wait complete. 2023-09-13T06:01:19.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648fa48640 1 Processor -- start 2023-09-13T06:01:19.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648fa48640 1 -- start start 2023-09-13T06:01:19.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648fa48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64880d2b00 0x7f6488162020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648fa48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f648815ae10 0x7f6488159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648fa48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64881619b0 0x7f648815eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648fa48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64881564b0 con 0x7f648815ae10 2023-09-13T06:01:19.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648fa48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6488156790 con 0x7f64881619b0 2023-09-13T06:01:19.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648fa48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6488156a70 con 0x7f64880d2b00 2023-09-13T06:01:19.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648cfe3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f648815ae10 0x7f6488159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648cfe3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f648815ae10 0x7f6488159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42378/0 (socket says 172.21.15.130:42378) 2023-09-13T06:01:19.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648cfe3640 1 -- 172.21.15.130:0/4230808730 learned_addr learned my addr 172.21.15.130:0/4230808730 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:19.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648dfe5640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64881619b0 0x7f648815eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648d7e4640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64880d2b00 0x7f6488162020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648cfe3640 1 -- 172.21.15.130:0/4230808730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64880d2b00 msgr2=0x7f6488162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:19.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648cfe3640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64880d2b00 0x7f6488162020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648cfe3640 1 -- 172.21.15.130:0/4230808730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64881619b0 msgr2=0x7f648815eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:19.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648cfe3640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64881619b0 0x7f648815eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648cfe3640 1 -- 172.21.15.130:0/4230808730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64840094d0 con 0x7f648815ae10 2023-09-13T06:01:19.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648cfe3640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f648815ae10 0x7f6488159280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f647800c490 tx=0x7f647800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:19.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f647dffb640 1 -- 172.21.15.130:0/4230808730 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478007480 con 0x7f648815ae10 2023-09-13T06:01:19.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f647dffb640 1 -- 172.21.15.130:0/4230808730 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64780075e0 con 0x7f648815ae10 2023-09-13T06:01:19.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f647dffb640 1 -- 172.21.15.130:0/4230808730 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478004a10 con 0x7f648815ae10 2023-09-13T06:01:19.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648fa48640 1 -- 172.21.15.130:0/4230808730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6488156d50 con 0x7f648815ae10 2023-09-13T06:01:19.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.149+0000 7f648fa48640 1 -- 172.21.15.130:0/4230808730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6488162560 con 0x7f648815ae10 2023-09-13T06:01:19.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.153+0000 7f648fa48640 1 -- 172.21.15.130:0/4230808730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64880618a0 con 0x7f648815ae10 2023-09-13T06:01:19.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.153+0000 7f647dffb640 1 -- 172.21.15.130:0/4230808730 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6478004b70 con 0x7f648815ae10 2023-09-13T06:01:19.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.153+0000 7f647dffb640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f646c065b20 0x7f646c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.153+0000 7f647dffb640 1 -- 172.21.15.130:0/4230808730 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f64780820e0 con 0x7f648815ae10 2023-09-13T06:01:19.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.153+0000 7f648d7e4640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f646c065b20 0x7f646c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.153+0000 7f648d7e4640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f646c065b20 0x7f646c067fe0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f64840ae000 tx=0x7f64840a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:19.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.157+0000 7f647dffb640 1 -- 172.21.15.130:0/4230808730 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f647804fe30 con 0x7f648815ae10 2023-09-13T06:01:19.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 -- 172.21.15.130:0/4230808730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6488157200 con 0x7f648815ae10 2023-09-13T06:01:19.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f647dffb640 1 -- 172.21.15.130:0/4230808730 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6478018020 con 0x7f648815ae10 2023-09-13T06:01:19.308 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:01:19.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 -- 172.21.15.130:0/4230808730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f646c065b20 msgr2=0x7f646c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:19.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f646c065b20 0x7f646c067fe0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f64840ae000 tx=0x7f64840a7000 comp rx=0 tx=0).stop 2023-09-13T06:01:19.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 -- 172.21.15.130:0/4230808730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f648815ae10 msgr2=0x7f6488159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:19.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f648815ae10 0x7f6488159280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f647800c490 tx=0x7f647800c950 comp rx=0 tx=0).stop 2023-09-13T06:01:19.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 -- 172.21.15.130:0/4230808730 shutdown_connections 2023-09-13T06:01:19.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f646c065b20 0x7f646c067fe0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64881619b0 0x7f648815eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f648815ae10 0x7f6488159280 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 --2- 172.21.15.130:0/4230808730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64880d2b00 0x7f6488162020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 -- 172.21.15.130:0/4230808730 >> 172.21.15.130:0/4230808730 conn(0x7f6488065990 msgr2=0x7f6488160f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:19.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 -- 172.21.15.130:0/4230808730 shutdown_connections 2023-09-13T06:01:19.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.305+0000 7f648fa48640 1 -- 172.21.15.130:0/4230808730 wait complete. 2023-09-13T06:01:19.328 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:01:19.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.461+0000 7ff969e19640 1 Processor -- start 2023-09-13T06:01:19.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.461+0000 7ff969e19640 1 -- start start 2023-09-13T06:01:19.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff969e19640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff96415d260 0x7ff9640b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff969e19640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9640ce1a0 0x7ff96406d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff969e19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9640afc70 0x7ff96406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff969e19640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff964070e70 con 0x7ff9640ce1a0 2023-09-13T06:01:19.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff969e19640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff964070280 con 0x7ff96415d260 2023-09-13T06:01:19.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff969e19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff964070540 con 0x7ff9640afc70 2023-09-13T06:01:19.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff962ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9640ce1a0 0x7ff96406d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff962ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9640ce1a0 0x7ff96406d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42380/0 (socket says 172.21.15.130:42380) 2023-09-13T06:01:19.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff962ffd640 1 -- 172.21.15.130:0/3831936652 learned_addr learned my addr 172.21.15.130:0/3831936652 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:19.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff963fff640 1 --2- 172.21.15.130:0/3831936652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9640afc70 0x7ff96406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff9637fe640 1 --2- 172.21.15.130:0/3831936652 >> v2:172.21.15.164:3300/0 conn(0x7ff96415d260 0x7ff9640b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff962ffd640 1 -- 172.21.15.130:0/3831936652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9640afc70 msgr2=0x7ff96406dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:19.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff962ffd640 1 --2- 172.21.15.130:0/3831936652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9640afc70 0x7ff96406dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff962ffd640 1 -- 172.21.15.130:0/3831936652 >> v2:172.21.15.164:3300/0 conn(0x7ff96415d260 msgr2=0x7ff9640b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:19.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff962ffd640 1 --2- 172.21.15.130:0/3831936652 >> v2:172.21.15.164:3300/0 conn(0x7ff96415d260 0x7ff9640b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff962ffd640 1 -- 172.21.15.130:0/3831936652 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964070820 con 0x7ff9640ce1a0 2023-09-13T06:01:19.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff9637fe640 1 --2- 172.21.15.130:0/3831936652 >> v2:172.21.15.164:3300/0 conn(0x7ff96415d260 0x7ff9640b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:19.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.465+0000 7ff962ffd640 1 --2- 172.21.15.130:0/3831936652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9640ce1a0 0x7ff96406d6e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9640b3b00 tx=0x7ff95801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687cfd94a9e5fdd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:19.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff9627fc640 1 -- 172.21.15.130:0/3831936652 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9580ab670 con 0x7ff9640ce1a0 2023-09-13T06:01:19.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff9627fc640 1 -- 172.21.15.130:0/3831936652 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9580ab7d0 con 0x7ff9640ce1a0 2023-09-13T06:01:19.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff9627fc640 1 -- 172.21.15.130:0/3831936652 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9580abb60 con 0x7ff9640ce1a0 2023-09-13T06:01:19.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 -- 172.21.15.130:0/3831936652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9640ce1a0 msgr2=0x7ff96406d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:19.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 --2- 172.21.15.130:0/3831936652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9640ce1a0 0x7ff96406d6e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9640b3b00 tx=0x7ff95801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 -- 172.21.15.130:0/3831936652 shutdown_connections 2023-09-13T06:01:19.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 --2- 172.21.15.130:0/3831936652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9640afc70 0x7ff96406dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 --2- 172.21.15.130:0/3831936652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9640ce1a0 0x7ff96406d6e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 --2- 172.21.15.130:0/3831936652 >> v2:172.21.15.164:3300/0 conn(0x7ff96415d260 0x7ff9640b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 -- 172.21.15.130:0/3831936652 >> 172.21.15.130:0/3831936652 conn(0x7ff96406a2f0 msgr2=0x7ff96406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:19.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 -- 172.21.15.130:0/3831936652 shutdown_connections 2023-09-13T06:01:19.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 -- 172.21.15.130:0/3831936652 wait complete. 2023-09-13T06:01:19.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 Processor -- start 2023-09-13T06:01:19.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 -- start start 2023-09-13T06:01:19.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9640afc70 0x7ff96414e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9640ce1a0 0x7ff96414c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff96415d260 0x7ff96414f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96414c780 con 0x7ff9640afc70 2023-09-13T06:01:19.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9640cb180 con 0x7ff96415d260 2023-09-13T06:01:19.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff969e19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9640ca850 con 0x7ff9640ce1a0 2023-09-13T06:01:19.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.469+0000 7ff9637fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9640afc70 0x7ff96414e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff9637fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9640afc70 0x7ff96414e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42388/0 (socket says 172.21.15.130:42388) 2023-09-13T06:01:19.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff9637fe640 1 -- 172.21.15.130:0/544941954 learned_addr learned my addr 172.21.15.130:0/544941954 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:19.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff962ffd640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9640ce1a0 0x7ff96414c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff9637fe640 1 -- 172.21.15.130:0/544941954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9640ce1a0 msgr2=0x7ff96414c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:19.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff9637fe640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9640ce1a0 0x7ff96414c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff963fff640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff96415d260 0x7ff96414f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff9637fe640 1 -- 172.21.15.130:0/544941954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff96415d260 msgr2=0x7ff96414f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:19.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff9637fe640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff96415d260 0x7ff96414f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff9637fe640 1 -- 172.21.15.130:0/544941954 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9580094d0 con 0x7ff9640afc70 2023-09-13T06:01:19.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff962ffd640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9640ce1a0 0x7ff96414c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:19.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff963fff640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff96415d260 0x7ff96414f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:19.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff9637fe640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9640afc70 0x7ff96414e830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff95400d800 tx=0x7ff95400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:19.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff94bfff640 1 -- 172.21.15.130:0/544941954 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9540096c0 con 0x7ff9640afc70 2023-09-13T06:01:19.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff94bfff640 1 -- 172.21.15.130:0/544941954 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff954009820 con 0x7ff9640afc70 2023-09-13T06:01:19.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff969e19640 1 -- 172.21.15.130:0/544941954 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9640cab30 con 0x7ff9640afc70 2023-09-13T06:01:19.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff94bfff640 1 -- 172.21.15.130:0/544941954 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954009bd0 con 0x7ff9640afc70 2023-09-13T06:01:19.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff969e19640 1 -- 172.21.15.130:0/544941954 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96414ce50 con 0x7ff9640afc70 2023-09-13T06:01:19.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff969e19640 1 -- 172.21.15.130:0/544941954 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9640618a0 con 0x7ff9640afc70 2023-09-13T06:01:19.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff94bfff640 1 -- 172.21.15.130:0/544941954 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff954009d30 con 0x7ff9640afc70 2023-09-13T06:01:19.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff94bfff640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff950065b50 0x7ff950068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:19.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff94bfff640 1 -- 172.21.15.130:0/544941954 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff954083730 con 0x7ff9640afc70 2023-09-13T06:01:19.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.473+0000 7ff962ffd640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff950065b50 0x7ff950068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:19.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.477+0000 7ff962ffd640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff950065b50 0x7ff950068010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff9580af000 tx=0x7ff958008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:19.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.477+0000 7ff94bfff640 1 -- 172.21.15.130:0/544941954 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff954051330 con 0x7ff9640afc70 2023-09-13T06:01:19.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 -- 172.21.15.130:0/544941954 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9640b3cf0 con 0x7ff9640afc70 2023-09-13T06:01:19.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff94bfff640 1 -- 172.21.15.130:0/544941954 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7ff954054950 con 0x7ff9640afc70 2023-09-13T06:01:19.660 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:19.660 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/660561895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":660561895},{"type":"v1","addr":"172.21.15.130:6836","nonce":660561895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-13T06:01:19.661 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 2 2023-09-13T06:01:19.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 -- 172.21.15.130:0/544941954 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff950065b50 msgr2=0x7ff950068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:19.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff950065b50 0x7ff950068010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff9580af000 tx=0x7ff958008040 comp rx=0 tx=0).stop 2023-09-13T06:01:19.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 -- 172.21.15.130:0/544941954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9640afc70 msgr2=0x7ff96414e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:19.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9640afc70 0x7ff96414e830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff95400d800 tx=0x7ff95400dcc0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 -- 172.21.15.130:0/544941954 shutdown_connections 2023-09-13T06:01:19.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff950065b50 0x7ff950068010 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff96415d260 0x7ff96414f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9640ce1a0 0x7ff96414c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 --2- 172.21.15.130:0/544941954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9640afc70 0x7ff96414e830 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:19.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 -- 172.21.15.130:0/544941954 >> 172.21.15.130:0/544941954 conn(0x7ff96406a2f0 msgr2=0x7ff96406d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:19.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 -- 172.21.15.130:0/544941954 shutdown_connections 2023-09-13T06:01:19.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:19.657+0000 7ff969e19640 1 -- 172.21.15.130:0/544941954 wait complete. 2023-09-13T06:01:21.681 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:01:21.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.825+0000 7fd07e49e640 1 Processor -- start 2023-09-13T06:01:21.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd07e49e640 1 -- start start 2023-09-13T06:01:21.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd07e49e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd078157920 0x7fd0780ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:21.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd07e49e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd0780b1d20 0x7fd07806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:21.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd07e49e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0780afee0 con 0x7fd0780b0f40 2023-09-13T06:01:21.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd07e49e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0780aea50 con 0x7fd078157920 2023-09-13T06:01:21.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd07e49e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0780b0b20 con 0x7fd0780b1d20 2023-09-13T06:01:21.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd077fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd078157920 0x7fd0780ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:21.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd077fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd078157920 0x7fd0780ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35192/0 (socket says 172.21.15.130:35192) 2023-09-13T06:01:21.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd077fff640 1 -- 172.21.15.130:0/383112140 learned_addr learned my addr 172.21.15.130:0/383112140 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:21.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd07ca3b640 1 --2- 172.21.15.130:0/383112140 >> v2:172.21.15.164:3300/0 conn(0x7fd0780b1d20 0x7fd07806b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:21.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd077fff640 1 -- 172.21.15.130:0/383112140 >> v2:172.21.15.164:3300/0 conn(0x7fd0780b1d20 msgr2=0x7fd07806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:21.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd077fff640 1 --2- 172.21.15.130:0/383112140 >> v2:172.21.15.164:3300/0 conn(0x7fd0780b1d20 0x7fd07806b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:21.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd077fff640 1 -- 172.21.15.130:0/383112140 >> v1:172.21.15.164:6789/0 conn(0x7fd0780b0f40 legacy=0x7fd0780b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:21.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.829+0000 7fd077fff640 1 -- 172.21.15.130:0/383112140 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0780b0180 con 0x7fd078157920 2023-09-13T06:01:21.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd077fff640 1 --2- 172.21.15.130:0/383112140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd078157920 0x7fd0780ae190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd0780adca0 tx=0x7fd06801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fb8c98d1ab05a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:21.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd076ffd640 1 -- 172.21.15.130:0/383112140 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680aa5f0 con 0x7fd078157920 2023-09-13T06:01:21.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd076ffd640 1 -- 172.21.15.130:0/383112140 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0680aa750 con 0x7fd078157920 2023-09-13T06:01:21.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd076ffd640 1 -- 172.21.15.130:0/383112140 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680aaae0 con 0x7fd078157920 2023-09-13T06:01:21.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd07e49e640 1 -- 172.21.15.130:0/383112140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd078157920 msgr2=0x7fd0780ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:21.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd07e49e640 1 --2- 172.21.15.130:0/383112140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd078157920 0x7fd0780ae190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd0780adca0 tx=0x7fd06801c490 comp rx=0 tx=0).stop 2023-09-13T06:01:21.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd07e49e640 1 -- 172.21.15.130:0/383112140 shutdown_connections 2023-09-13T06:01:21.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd07e49e640 1 --2- 172.21.15.130:0/383112140 >> v2:172.21.15.164:3300/0 conn(0x7fd0780b1d20 0x7fd07806b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:21.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd07e49e640 1 --2- 172.21.15.130:0/383112140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd078157920 0x7fd0780ae190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:21.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd07e49e640 1 -- 172.21.15.130:0/383112140 >> 172.21.15.130:0/383112140 conn(0x7fd078065990 msgr2=0x7fd078065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:21.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd07e49e640 1 -- 172.21.15.130:0/383112140 shutdown_connections 2023-09-13T06:01:21.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd07e49e640 1 -- 172.21.15.130:0/383112140 wait complete. 2023-09-13T06:01:21.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd07e49e640 1 Processor -- start 2023-09-13T06:01:21.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.833+0000 7fd07e49e640 1 -- start start 2023-09-13T06:01:21.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07e49e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0780b0f40 0x7fd078157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:21.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07e49e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0780b1d20 0x7fd078146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:21.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07e49e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd078157920 0x7fd078146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:21.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07e49e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0781517d0 con 0x7fd078157920 2023-09-13T06:01:21.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07e49e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd078152630 con 0x7fd0780b0f40 2023-09-13T06:01:21.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07e49e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd078151a20 con 0x7fd0780b1d20 2023-09-13T06:01:21.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07ca3b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd078157920 0x7fd078146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:21.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07ca3b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd078157920 0x7fd078146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35204/0 (socket says 172.21.15.130:35204) 2023-09-13T06:01:21.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07ca3b640 1 -- 172.21.15.130:0/437017372 learned_addr learned my addr 172.21.15.130:0/437017372 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:21.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd077fff640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0780b0f40 0x7fd078157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:21.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd0777fe640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0780b1d20 0x7fd078146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:21.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07ca3b640 1 -- 172.21.15.130:0/437017372 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0780b1d20 msgr2=0x7fd078146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:21.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07ca3b640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0780b1d20 0x7fd078146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:21.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07ca3b640 1 -- 172.21.15.130:0/437017372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0780b0f40 msgr2=0x7fd078157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:21.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07ca3b640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0780b0f40 0x7fd078157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:21.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07ca3b640 1 -- 172.21.15.130:0/437017372 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0680094d0 con 0x7fd078157920 2023-09-13T06:01:21.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd0777fe640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0780b1d20 0x7fd078146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:21.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07ca3b640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd078157920 0x7fd078146bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd070007db0 tx=0x7fd07000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:21.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd074ff9640 1 -- 172.21.15.130:0/437017372 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070014420 con 0x7fd078157920 2023-09-13T06:01:21.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd074ff9640 1 -- 172.21.15.130:0/437017372 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd070014580 con 0x7fd078157920 2023-09-13T06:01:21.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07e49e640 1 -- 172.21.15.130:0/437017372 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd078151d00 con 0x7fd078157920 2023-09-13T06:01:21.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd074ff9640 1 -- 172.21.15.130:0/437017372 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070014930 con 0x7fd078157920 2023-09-13T06:01:21.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07e49e640 1 -- 172.21.15.130:0/437017372 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0781522c0 con 0x7fd078157920 2023-09-13T06:01:21.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.837+0000 7fd07e49e640 1 -- 172.21.15.130:0/437017372 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0780618a0 con 0x7fd078157920 2023-09-13T06:01:21.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.841+0000 7fd074ff9640 1 -- 172.21.15.130:0/437017372 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd070014a90 con 0x7fd078157920 2023-09-13T06:01:21.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.841+0000 7fd074ff9640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd064065b50 0x7fd064068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:21.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.841+0000 7fd074ff9640 1 -- 172.21.15.130:0/437017372 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0700837b0 con 0x7fd078157920 2023-09-13T06:01:21.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.841+0000 7fd077fff640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd064065b50 0x7fd064068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:21.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.841+0000 7fd077fff640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd064065b50 0x7fd064068010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd0680ae000 tx=0x7fd0680b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:21.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:21.845+0000 7fd074ff9640 1 -- 172.21.15.130:0/437017372 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd070051430 con 0x7fd078157920 2023-09-13T06:01:22.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.025+0000 7fd07e49e640 1 -- 172.21.15.130:0/437017372 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd078152770 con 0x7fd078157920 2023-09-13T06:01:22.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.025+0000 7fd074ff9640 1 -- 172.21.15.130:0/437017372 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7fd070054a50 con 0x7fd078157920 2023-09-13T06:01:22.030 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:22.031 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1779716448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1779716448},{"type":"v1","addr":"172.21.15.130:6837","nonce":1779716448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1022199494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":1022199494},{"type":"v1","addr":"172.21.15.164:6835","nonce":1022199494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3130227261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3130227261},{"type":"v1","addr":"172.21.15.164:6834","nonce":3130227261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/660561895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":660561895},{"type":"v1","addr":"172.21.15.130:6836","nonce":660561895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-13T06:01:22.032 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 3 2023-09-13T06:01:22.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 -- 172.21.15.130:0/437017372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd064065b50 msgr2=0x7fd064068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd064065b50 0x7fd064068010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd0680ae000 tx=0x7fd0680b5040 comp rx=0 tx=0).stop 2023-09-13T06:01:22.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 -- 172.21.15.130:0/437017372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd078157920 msgr2=0x7fd078146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd078157920 0x7fd078146bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd070007db0 tx=0x7fd07000e4b0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 -- 172.21.15.130:0/437017372 shutdown_connections 2023-09-13T06:01:22.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd064065b50 0x7fd064068010 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd078157920 0x7fd078146bb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0780b1d20 0x7fd078146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 --2- 172.21.15.130:0/437017372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0780b0f40 0x7fd078157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 -- 172.21.15.130:0/437017372 >> 172.21.15.130:0/437017372 conn(0x7fd078065990 msgr2=0x7fd078154400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:22.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 -- 172.21.15.130:0/437017372 shutdown_connections 2023-09-13T06:01:22.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.029+0000 7fd07e49e640 1 -- 172.21.15.130:0/437017372 wait complete. 2023-09-13T06:01:22.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.185+0000 7fc809d10640 1 Processor -- start 2023-09-13T06:01:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.185+0000 7fc809d10640 1 -- start start 2023-09-13T06:01:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.185+0000 7fc809d10640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc80415d260 0x7fc8040b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.185+0000 7fc809d10640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc80406ddf0 0x7fc804071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.185+0000 7fc809d10640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc804070e70 con 0x7fc8040ce1a0 2023-09-13T06:01:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.185+0000 7fc809d10640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc804070280 con 0x7fc80406ddf0 2023-09-13T06:01:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc809d10640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc804070540 con 0x7fc80415d260 2023-09-13T06:01:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc802ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc8040ce1a0 0x7fc80406d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49598/0 (socket says 172.21.15.130:49598) 2023-09-13T06:01:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc802ffd640 1 -- 172.21.15.130:0/669298225 learned_addr learned my addr 172.21.15.130:0/669298225 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:22.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc803fff640 1 --2- 172.21.15.130:0/669298225 >> v2:172.21.15.164:3300/0 conn(0x7fc80406ddf0 0x7fc804071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8037fe640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc80415d260 0x7fc8040b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673003508 0 0) 0x7fc804070e70 con 0x7fc8040ce1a0 2023-09-13T06:01:22.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7ec003530 con 0x7fc8040ce1a0 2023-09-13T06:01:22.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2223244759 0 0) 0x7fc7ec003530 con 0x7fc8040ce1a0 2023-09-13T06:01:22.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc80415d260 msgr2=0x7fc8040b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:22.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc80415d260 0x7fc8040b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 >> v2:172.21.15.164:3300/0 conn(0x7fc80406ddf0 msgr2=0x7fc804071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:22.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 --2- 172.21.15.130:0/669298225 >> v2:172.21.15.164:3300/0 conn(0x7fc80406ddf0 0x7fc804071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc804070820 con 0x7fc8040ce1a0 2023-09-13T06:01:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fc7f8001680 con 0x7fc8040ce1a0 2023-09-13T06:01:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 >> v1:172.21.15.130:6789/0 conn(0x7fc8040ce1a0 legacy=0x7fc80406d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc80415d260 0x7fc7ec0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7ec003f70 0x7fc7ec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ec004d10 0x7fc7ec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc804070280 con 0x7fc7ec003f70 2023-09-13T06:01:22.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc804070540 con 0x7fc7ec004d10 2023-09-13T06:01:22.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec00b9c0 con 0x7fc80415d260 2023-09-13T06:01:22.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc802ffd640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7ec003f70 0x7fc7ec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc8037fe640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc80415d260 0x7fc7ec0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc803fff640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ec004d10 0x7fc7ec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc802ffd640 1 -- 172.21.15.130:0/669298225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc80415d260 msgr2=0x7fc7ec0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc802ffd640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc80415d260 0x7fc7ec0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc802ffd640 1 -- 172.21.15.130:0/669298225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ec004d10 msgr2=0x7fc7ec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:22.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc802ffd640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ec004d10 0x7fc7ec005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.189+0000 7fc802ffd640 1 -- 172.21.15.130:0/669298225 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec003530 con 0x7fc7ec003f70 2023-09-13T06:01:22.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc802ffd640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7ec003f70 0x7fc7ec0047d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800c210 tx=0x7fc7f801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f2676956fffcef server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:22.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8005ae0 con 0x7fc7ec003f70 2023-09-13T06:01:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f80ab070 con 0x7fc7ec003f70 2023-09-13T06:01:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc8027fc640 1 -- 172.21.15.130:0/669298225 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8007070 con 0x7fc7ec003f70 2023-09-13T06:01:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc809d10640 1 -- 172.21.15.130:0/669298225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7ec003f70 msgr2=0x7fc7ec0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc809d10640 1 --2- 172.21.15.130:0/669298225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7ec003f70 0x7fc7ec0047d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800c210 tx=0x7fc7f801f390 comp rx=0 tx=0).stop 2023-09-13T06:01:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc803fff640 1 -- 172.21.15.130:0/669298225 reap_dead start 2023-09-13T06:01:22.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc809d10640 1 -- 172.21.15.130:0/669298225 shutdown_connections 2023-09-13T06:01:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc809d10640 1 -- 172.21.15.130:0/669298225 >> 172.21.15.130:0/669298225 conn(0x7fc80406a2f0 msgr2=0x7fc80406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc809d10640 1 -- 172.21.15.130:0/669298225 shutdown_connections 2023-09-13T06:01:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc809d10640 1 -- 172.21.15.130:0/669298225 wait complete. 2023-09-13T06:01:22.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc809d10640 1 Processor -- start 2023-09-13T06:01:22.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.193+0000 7fc809d10640 1 -- start start 2023-09-13T06:01:22.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc809d10640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ec003f70 0x7fc80414c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc809d10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8040cc260 0x7fc8040cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc809d10640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8040b1d30 0x7fc8040b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc809d10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8040ccc20 con 0x7fc8040cc260 2023-09-13T06:01:22.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc809d10640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80415cb30 con 0x7fc7ec003f70 2023-09-13T06:01:22.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc809d10640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8040b26f0 con 0x7fc8040b1d30 2023-09-13T06:01:22.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc802ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8040cc260 0x7fc8040cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc802ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8040cc260 0x7fc8040cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35230/0 (socket says 172.21.15.130:35230) 2023-09-13T06:01:22.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc802ffd640 1 -- 172.21.15.130:0/2936070423 learned_addr learned my addr 172.21.15.130:0/2936070423 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc8037fe640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ec003f70 0x7fc80414c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc803fff640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8040b1d30 0x7fc8040b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc802ffd640 1 -- 172.21.15.130:0/2936070423 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8040b1d30 msgr2=0x7fc8040b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc802ffd640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8040b1d30 0x7fc8040b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc802ffd640 1 -- 172.21.15.130:0/2936070423 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ec003f70 msgr2=0x7fc80414c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc802ffd640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ec003f70 0x7fc80414c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc802ffd640 1 -- 172.21.15.130:0/2936070423 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8041f6240 con 0x7fc8040cc260 2023-09-13T06:01:22.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc803fff640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8040b1d30 0x7fc8040b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:22.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc802ffd640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8040cc260 0x7fc8040cc6e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc7f801f1c0 tx=0x7fc7ec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:22.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc7ebfff640 1 -- 172.21.15.130:0/2936070423 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80b7070 con 0x7fc8040cc260 2023-09-13T06:01:22.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc7ebfff640 1 -- 172.21.15.130:0/2936070423 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f80047f0 con 0x7fc8040cc260 2023-09-13T06:01:22.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc809d10640 1 -- 172.21.15.130:0/2936070423 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80414cad0 con 0x7fc8040cc260 2023-09-13T06:01:22.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc7ebfff640 1 -- 172.21.15.130:0/2936070423 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8004b60 con 0x7fc8040cc260 2023-09-13T06:01:22.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc809d10640 1 -- 172.21.15.130:0/2936070423 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8040b2910 con 0x7fc8040cc260 2023-09-13T06:01:22.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc809d10640 1 -- 172.21.15.130:0/2936070423 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8040618a0 con 0x7fc8040cc260 2023-09-13T06:01:22.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.197+0000 7fc7ebfff640 1 -- 172.21.15.130:0/2936070423 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc7f80ad020 con 0x7fc8040cc260 2023-09-13T06:01:22.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.201+0000 7fc7ebfff640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc7f0065b20 0x7fc7f0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.201+0000 7fc7ebfff640 1 -- 172.21.15.130:0/2936070423 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc7f811f840 con 0x7fc8040cc260 2023-09-13T06:01:22.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.201+0000 7fc8037fe640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc7f0065b20 0x7fc7f0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.201+0000 7fc8037fe640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc7f0065b20 0x7fc7f0067fe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009b00 tx=0x7fc7f4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:22.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.205+0000 7fc7ebfff640 1 -- 172.21.15.130:0/2936070423 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc7f80f0ed0 con 0x7fc8040cc260 2023-09-13T06:01:22.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.353+0000 7fc809d10640 1 -- 172.21.15.130:0/2936070423 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc804161cc0 con 0x7fc8040cc260 2023-09-13T06:01:22.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc7ebfff640 1 -- 172.21.15.130:0/2936070423 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fc7f80c1090 con 0x7fc8040cc260 2023-09-13T06:01:22.358 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:22.359 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":17,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:17.130604+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:22.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 -- 172.21.15.130:0/2936070423 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc7f0065b20 msgr2=0x7fc7f0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc7f0065b20 0x7fc7f0067fe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009b00 tx=0x7fc7f4009190 comp rx=0 tx=0).stop 2023-09-13T06:01:22.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 -- 172.21.15.130:0/2936070423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8040cc260 msgr2=0x7fc8040cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8040cc260 0x7fc8040cc6e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc7f801f1c0 tx=0x7fc7ec005800 comp rx=0 tx=0).stop 2023-09-13T06:01:22.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 -- 172.21.15.130:0/2936070423 shutdown_connections 2023-09-13T06:01:22.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc7f0065b20 0x7fc7f0067fe0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8040b1d30 0x7fc8040b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8040cc260 0x7fc8040cc6e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 --2- 172.21.15.130:0/2936070423 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ec003f70 0x7fc80414c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 -- 172.21.15.130:0/2936070423 >> 172.21.15.130:0/2936070423 conn(0x7fc80406a2f0 msgr2=0x7fc8040d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:22.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 -- 172.21.15.130:0/2936070423 shutdown_connections 2023-09-13T06:01:22.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.357+0000 7fc809d10640 1 -- 172.21.15.130:0/2936070423 wait complete. 2023-09-13T06:01:22.379 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:01:22.380 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:01:22.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.517+0000 7f004a511640 1 Processor -- start 2023-09-13T06:01:22.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f004a511640 1 -- start start 2023-09-13T06:01:22.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f004a511640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b1460 0x7f00440b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f004a511640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00440cc850 con 0x7f00440b2fd0 2023-09-13T06:01:22.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f004a511640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00440b33f0 con 0x7f004415a080 2023-09-13T06:01:22.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f004a511640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00440b0330 con 0x7f00440b1460 2023-09-13T06:01:22.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f0048aae640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f00440b2fd0 0x7f00440ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49606/0 (socket says 172.21.15.130:49606) 2023-09-13T06:01:22.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f0048aae640 1 -- 172.21.15.130:0/3050979955 learned_addr learned my addr 172.21.15.130:0/3050979955 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:22.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f00437fe640 1 --2- 172.21.15.130:0/3050979955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b1460 0x7f00440b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f0042ffd640 1 -- 172.21.15.130:0/3050979955 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485240693 0 0) 0x7f003c0014a0 con 0x7f00440b2fd0 2023-09-13T06:01:22.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f0042ffd640 1 -- 172.21.15.130:0/3050979955 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f002c003530 con 0x7f00440b2fd0 2023-09-13T06:01:22.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f0042ffd640 1 -- 172.21.15.130:0/3050979955 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102582029 0 0) 0x7f00440b33f0 con 0x7f004415a080 2023-09-13T06:01:22.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f0042ffd640 1 -- 172.21.15.130:0/3050979955 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f003c0014a0 con 0x7f004415a080 2023-09-13T06:01:22.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f00437fe640 1 -- 172.21.15.130:0/3050979955 >> v1:172.21.15.164:6789/0 conn(0x7f004415a080 legacy=0x7f004415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f00437fe640 1 -- 172.21.15.130:0/3050979955 >> v1:172.21.15.130:6789/0 conn(0x7f00440b2fd0 legacy=0x7f00440ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.521+0000 7f00437fe640 1 -- 172.21.15.130:0/3050979955 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440cbcd0 con 0x7f00440b1460 2023-09-13T06:01:22.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.525+0000 7f00437fe640 1 --2- 172.21.15.130:0/3050979955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b1460 0x7f00440b2a90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f00380097f0 tx=0x7f003801c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=873b4ac46e68808f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:22.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.525+0000 7f0042ffd640 1 -- 172.21.15.130:0/3050979955 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380ab600 con 0x7f00440b1460 2023-09-13T06:01:22.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.525+0000 7f0042ffd640 1 -- 172.21.15.130:0/3050979955 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00380a7050 con 0x7f00440b1460 2023-09-13T06:01:22.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.525+0000 7f0042ffd640 1 -- 172.21.15.130:0/3050979955 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380ab980 con 0x7f00440b1460 2023-09-13T06:01:22.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.525+0000 7f004a511640 1 -- 172.21.15.130:0/3050979955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b1460 msgr2=0x7f00440b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.525+0000 7f004a511640 1 --2- 172.21.15.130:0/3050979955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b1460 0x7f00440b2a90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f00380097f0 tx=0x7f003801c3d0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.525+0000 7f004a511640 1 -- 172.21.15.130:0/3050979955 shutdown_connections 2023-09-13T06:01:22.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.525+0000 7f004a511640 1 --2- 172.21.15.130:0/3050979955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b1460 0x7f00440b2a90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.525+0000 7f004a511640 1 -- 172.21.15.130:0/3050979955 >> 172.21.15.130:0/3050979955 conn(0x7f0044065990 msgr2=0x7f0044065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:22.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.525+0000 7f004a511640 1 -- 172.21.15.130:0/3050979955 shutdown_connections 2023-09-13T06:01:22.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.525+0000 7f004a511640 1 -- 172.21.15.130:0/3050979955 wait complete. 2023-09-13T06:01:22.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f004a511640 1 Processor -- start 2023-09-13T06:01:22.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f004a511640 1 -- start start 2023-09-13T06:01:22.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f004a511640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00440b1460 0x7f00440ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f004a511640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b2fd0 0x7f00440af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f004a511640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f004415a080 0x7f00440cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f004a511640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00440ac7d0 con 0x7f00440b1460 2023-09-13T06:01:22.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f004a511640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00440acab0 con 0x7f004415a080 2023-09-13T06:01:22.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f004a511640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00440acd90 con 0x7f00440b2fd0 2023-09-13T06:01:22.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0043fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00440b1460 0x7f00440ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0043fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00440b1460 0x7f00440ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35240/0 (socket says 172.21.15.130:35240) 2023-09-13T06:01:22.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0043fff640 1 -- 172.21.15.130:0/3905580893 learned_addr learned my addr 172.21.15.130:0/3905580893 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:22.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0043fff640 1 -- 172.21.15.130:0/3905580893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b2fd0 msgr2=0x7f00440af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f00437fe640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b2fd0 0x7f00440af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0048aae640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f004415a080 0x7f00440cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0043fff640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b2fd0 0x7f00440af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0043fff640 1 -- 172.21.15.130:0/3905580893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f004415a080 msgr2=0x7f00440cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0043fff640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f004415a080 0x7f00440cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0043fff640 1 -- 172.21.15.130:0/3905580893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038009420 con 0x7f00440b1460 2023-09-13T06:01:22.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f00437fe640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b2fd0 0x7f00440af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:22.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0048aae640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f004415a080 0x7f00440cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:22.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0043fff640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00440b1460 0x7f00440ac110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f003400c430 tx=0x7f003400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:22.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0040ff9640 1 -- 172.21.15.130:0/3905580893 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00340052d0 con 0x7f00440b1460 2023-09-13T06:01:22.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0040ff9640 1 -- 172.21.15.130:0/3905580893 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0034005450 con 0x7f00440b1460 2023-09-13T06:01:22.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f0040ff9640 1 -- 172.21.15.130:0/3905580893 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034003840 con 0x7f00440b1460 2023-09-13T06:01:22.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f004a511640 1 -- 172.21.15.130:0/3905580893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00440ad070 con 0x7f00440b1460 2023-09-13T06:01:22.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.529+0000 7f004a511640 1 -- 172.21.15.130:0/3905580893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00440af5d0 con 0x7f00440b1460 2023-09-13T06:01:22.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.533+0000 7f004a511640 1 -- 172.21.15.130:0/3905580893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00440af7c0 con 0x7f00440b1460 2023-09-13T06:01:22.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.533+0000 7f0040ff9640 1 -- 172.21.15.130:0/3905580893 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f00340039a0 con 0x7f00440b1460 2023-09-13T06:01:22.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.533+0000 7f0040ff9640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0030065b20 0x7f0030067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.533+0000 7f0040ff9640 1 -- 172.21.15.130:0/3905580893 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0034082520 con 0x7f00440b1460 2023-09-13T06:01:22.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.533+0000 7f00437fe640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0030065b20 0x7f0030067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.533+0000 7f00437fe640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0030065b20 0x7f0030067fe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f00380ad000 tx=0x7f0038008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:22.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.537+0000 7f0040ff9640 1 -- 172.21.15.130:0/3905580893 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f00440af7c0 con 0x7f00440b1460 2023-09-13T06:01:22.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.689+0000 7f004a511640 1 -- 172.21.15.130:0/3905580893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00440af7c0 con 0x7f00440b1460 2023-09-13T06:01:22.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.689+0000 7f0040ff9640 1 -- 172.21.15.130:0/3905580893 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0034017020 con 0x7f00440b1460 2023-09-13T06:01:22.694 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:01:22.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 -- 172.21.15.130:0/3905580893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0030065b20 msgr2=0x7f0030067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0030065b20 0x7f0030067fe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f00380ad000 tx=0x7f0038008040 comp rx=0 tx=0).stop 2023-09-13T06:01:22.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 -- 172.21.15.130:0/3905580893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00440b1460 msgr2=0x7f00440ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00440b1460 0x7f00440ac110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f003400c430 tx=0x7f003400c8f0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 -- 172.21.15.130:0/3905580893 shutdown_connections 2023-09-13T06:01:22.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0030065b20 0x7f0030067fe0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f004415a080 0x7f00440cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00440b2fd0 0x7f00440af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 --2- 172.21.15.130:0/3905580893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00440b1460 0x7f00440ac110 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 -- 172.21.15.130:0/3905580893 >> 172.21.15.130:0/3905580893 conn(0x7f0044065990 msgr2=0x7f0044157710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:22.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 -- 172.21.15.130:0/3905580893 shutdown_connections 2023-09-13T06:01:22.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.693+0000 7f004a511640 1 -- 172.21.15.130:0/3905580893 wait complete. 2023-09-13T06:01:22.715 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T06:01:22.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4acde9e640 1 Processor -- start 2023-09-13T06:01:22.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4acde9e640 1 -- start start 2023-09-13T06:01:22.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4acde9e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4ac81436e0 0x7f4ac80ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4acde9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac8070d60 0x7f4ac8160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4acde9e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac806f640 con 0x7f4ac80acd80 2023-09-13T06:01:22.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4acde9e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac806f890 con 0x7f4ac81436e0 2023-09-13T06:01:22.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4acde9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac806fb70 con 0x7f4ac8070d60 2023-09-13T06:01:22.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4ac77fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4ac81436e0 0x7f4ac80ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4ac7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac8070d60 0x7f4ac8160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4ac77fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4ac81436e0 0x7f4ac80ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:46046/0 (socket says 172.21.15.130:46046) 2023-09-13T06:01:22.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4ac77fe640 1 -- 172.21.15.130:0/354281028 learned_addr learned my addr 172.21.15.130:0/354281028 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:22.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4ac7fff640 1 --2- 172.21.15.130:0/354281028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac8070d60 0x7f4ac8160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:35690/0 (socket says 172.21.15.130:35690) 2023-09-13T06:01:22.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4ac7fff640 1 -- 172.21.15.130:0/354281028 >> v2:172.21.15.164:3300/0 conn(0x7f4ac81436e0 msgr2=0x7f4ac80ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:22.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4ac7fff640 1 --2- 172.21.15.130:0/354281028 >> v2:172.21.15.164:3300/0 conn(0x7f4ac81436e0 0x7f4ac80ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4ac7fff640 1 -- 172.21.15.130:0/354281028 >> v1:172.21.15.164:6789/0 conn(0x7f4ac80acd80 legacy=0x7f4ac8070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.853+0000 7f4ac7fff640 1 -- 172.21.15.130:0/354281028 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac806fe50 con 0x7f4ac8070d60 2023-09-13T06:01:22.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4ac7fff640 1 --2- 172.21.15.130:0/354281028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac8070d60 0x7f4ac8160eb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009d90 tx=0x7f4ac001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b52176ec7b8a2cd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:22.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4ac67fc640 1 -- 172.21.15.130:0/354281028 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8146e10 con 0x7f4ac8070d60 2023-09-13T06:01:22.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4ac67fc640 1 -- 172.21.15.130:0/354281028 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac00a5800 con 0x7f4ac8070d60 2023-09-13T06:01:22.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4ac67fc640 1 -- 172.21.15.130:0/354281028 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac00a5b90 con 0x7f4ac8070d60 2023-09-13T06:01:22.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4acde9e640 1 -- 172.21.15.130:0/354281028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac8070d60 msgr2=0x7f4ac8160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4acde9e640 1 --2- 172.21.15.130:0/354281028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac8070d60 0x7f4ac8160eb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009d90 tx=0x7f4ac001c830 comp rx=0 tx=0).stop 2023-09-13T06:01:22.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4acde9e640 1 -- 172.21.15.130:0/354281028 shutdown_connections 2023-09-13T06:01:22.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4acde9e640 1 --2- 172.21.15.130:0/354281028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac8070d60 0x7f4ac8160eb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4acde9e640 1 --2- 172.21.15.130:0/354281028 >> v2:172.21.15.164:3300/0 conn(0x7f4ac81436e0 0x7f4ac80ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4acde9e640 1 -- 172.21.15.130:0/354281028 >> 172.21.15.130:0/354281028 conn(0x7f4ac80b0bc0 msgr2=0x7f4ac80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:22.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4acde9e640 1 -- 172.21.15.130:0/354281028 shutdown_connections 2023-09-13T06:01:22.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.857+0000 7f4acde9e640 1 -- 172.21.15.130:0/354281028 wait complete. 2023-09-13T06:01:22.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4acde9e640 1 Processor -- start 2023-09-13T06:01:22.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4acde9e640 1 -- start start 2023-09-13T06:01:22.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4acde9e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ac8070d60 0x7f4ac80b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4acde9e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ac80acd80 0x7f4ac813d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4acde9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac81436e0 0x7f4ac80af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4acde9e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac813cfd0 con 0x7f4ac8070d60 2023-09-13T06:01:22.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4acde9e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac813c350 con 0x7f4ac80acd80 2023-09-13T06:01:22.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4acde9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac813c630 con 0x7f4ac81436e0 2023-09-13T06:01:22.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ac8070d60 0x7f4ac80b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ac8070d60 0x7f4ac80b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35246/0 (socket says 172.21.15.130:35246) 2023-09-13T06:01:22.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac77fe640 1 -- 172.21.15.130:0/2142907456 learned_addr learned my addr 172.21.15.130:0/2142907456 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:22.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac6ffd640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ac80acd80 0x7f4ac813d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac7fff640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac81436e0 0x7f4ac80af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac77fe640 1 -- 172.21.15.130:0/2142907456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac81436e0 msgr2=0x7f4ac80af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac77fe640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac81436e0 0x7f4ac80af160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac77fe640 1 -- 172.21.15.130:0/2142907456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ac80acd80 msgr2=0x7f4ac813d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:22.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac77fe640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ac80acd80 0x7f4ac813d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:22.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac77fe640 1 -- 172.21.15.130:0/2142907456 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac0009a70 con 0x7f4ac8070d60 2023-09-13T06:01:22.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac7fff640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac81436e0 0x7f4ac80af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:22.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac6ffd640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ac80acd80 0x7f4ac813d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:22.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4ac77fe640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ac8070d60 0x7f4ac80b0580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800e890 tx=0x7f4ab800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:22.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4aaffff640 1 -- 172.21.15.130:0/2142907456 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8009620 con 0x7f4ac8070d60 2023-09-13T06:01:22.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4aaffff640 1 -- 172.21.15.130:0/2142907456 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab800c940 con 0x7f4ac8070d60 2023-09-13T06:01:22.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4acde9e640 1 -- 172.21.15.130:0/2142907456 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac813c910 con 0x7f4ac8070d60 2023-09-13T06:01:22.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4aaffff640 1 -- 172.21.15.130:0/2142907456 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab800ccf0 con 0x7f4ac8070d60 2023-09-13T06:01:22.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4acde9e640 1 -- 172.21.15.130:0/2142907456 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac80cf020 con 0x7f4ac8070d60 2023-09-13T06:01:22.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.861+0000 7f4acde9e640 1 -- 172.21.15.130:0/2142907456 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac813d240 con 0x7f4ac8070d60 2023-09-13T06:01:22.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.865+0000 7f4aaffff640 1 -- 172.21.15.130:0/2142907456 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4ab8013470 con 0x7f4ac8070d60 2023-09-13T06:01:22.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.865+0000 7f4aaffff640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ab4065b20 0x7f4ab4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:22.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.865+0000 7f4aaffff640 1 -- 172.21.15.130:0/2142907456 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4ab80830e0 con 0x7f4ac8070d60 2023-09-13T06:01:22.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.865+0000 7f4ac6ffd640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ab4065b20 0x7f4ab4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:22.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.865+0000 7f4ac6ffd640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ab4065b20 0x7f4ab4067fe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8160930 tx=0x7f4abc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:22.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:22.869+0000 7f4aaffff640 1 -- 172.21.15.130:0/2142907456 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4ab8050d70 con 0x7f4ac8070d60 2023-09-13T06:01:23.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 -- 172.21.15.130:0/2142907456 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4ac80618a0 con 0x7f4ac8070d60 2023-09-13T06:01:23.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4aaffff640 1 -- 172.21.15.130:0/2142907456 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4ab8054390 con 0x7f4ac8070d60 2023-09-13T06:01:23.024 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:23.024 INFO:teuthology.orchestra.run.smithi130.stdout:[ 2023-09-13T06:01:23.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:01:23.024 INFO:teuthology.orchestra.run.smithi130.stdout: "poolnum": 1, 2023-09-13T06:01:23.024 INFO:teuthology.orchestra.run.smithi130.stdout: "poolname": ".mgr" 2023-09-13T06:01:23.025 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:01:23.025 INFO:teuthology.orchestra.run.smithi130.stdout:] 2023-09-13T06:01:23.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 -- 172.21.15.130:0/2142907456 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ab4065b20 msgr2=0x7f4ab4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:23.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ab4065b20 0x7f4ab4067fe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8160930 tx=0x7f4abc009040 comp rx=0 tx=0).stop 2023-09-13T06:01:23.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 -- 172.21.15.130:0/2142907456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ac8070d60 msgr2=0x7f4ac80b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:23.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ac8070d60 0x7f4ac80b0580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800e890 tx=0x7f4ab800ed50 comp rx=0 tx=0).stop 2023-09-13T06:01:23.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 -- 172.21.15.130:0/2142907456 shutdown_connections 2023-09-13T06:01:23.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ab4065b20 0x7f4ab4067fe0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:23.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ac80acd80 0x7f4ac813d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:23.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ac81436e0 0x7f4ac80af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:23.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 --2- 172.21.15.130:0/2142907456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ac8070d60 0x7f4ac80b0580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:23.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 -- 172.21.15.130:0/2142907456 >> 172.21.15.130:0/2142907456 conn(0x7f4ac80b0bc0 msgr2=0x7f4ac81676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:23.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 -- 172.21.15.130:0/2142907456 shutdown_connections 2023-09-13T06:01:23.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.021+0000 7f4acde9e640 1 -- 172.21.15.130:0/2142907456 wait complete. 2023-09-13T06:01:23.044 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T06:01:23.045 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T06:01:23.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f78848640 1 Processor -- start 2023-09-13T06:01:23.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f78848640 1 -- start start 2023-09-13T06:01:23.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f78848640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3f7415a8e0 0x7f3f74159e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:23.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f78848640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f7406fda0 0x7f3f74150120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:23.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f78848640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f740cc660 con 0x7f3f740cc1b0 2023-09-13T06:01:23.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f78848640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f740ce270 con 0x7f3f7406fda0 2023-09-13T06:01:23.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f78848640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f740ced40 con 0x7f3f7415a8e0 2023-09-13T06:01:23.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f72d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f7406fda0 0x7f3f74150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:23.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f72d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f7406fda0 0x7f3f74150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35248/0 (socket says 172.21.15.130:35248) 2023-09-13T06:01:23.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f72d9d640 1 -- 172.21.15.130:0/30276310 learned_addr learned my addr 172.21.15.130:0/30276310 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:23.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f7259c640 1 --2- 172.21.15.130:0/30276310 >> v2:172.21.15.164:3300/0 conn(0x7f3f7415a8e0 0x7f3f74159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:23.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f72d9d640 1 -- 172.21.15.130:0/30276310 >> v2:172.21.15.164:3300/0 conn(0x7f3f7415a8e0 msgr2=0x7f3f74159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:23.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f72d9d640 1 --2- 172.21.15.130:0/30276310 >> v2:172.21.15.164:3300/0 conn(0x7f3f7415a8e0 0x7f3f74159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:23.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f72d9d640 1 -- 172.21.15.130:0/30276310 >> v1:172.21.15.164:6789/0 conn(0x7f3f740cc1b0 legacy=0x7f3f7406f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:23.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.185+0000 7f3f72d9d640 1 -- 172.21.15.130:0/30276310 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740cc920 con 0x7f3f7406fda0 2023-09-13T06:01:23.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f72d9d640 1 --2- 172.21.15.130:0/30276310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7406fda0 0x7f3f74150120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3f74071a50 tx=0x7f3f6c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e926348271edb683 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:23.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f71d9b640 1 -- 172.21.15.130:0/30276310 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0a57e0 con 0x7f3f7406fda0 2023-09-13T06:01:23.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f71d9b640 1 -- 172.21.15.130:0/30276310 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c0a5940 con 0x7f3f7406fda0 2023-09-13T06:01:23.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f71d9b640 1 -- 172.21.15.130:0/30276310 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0a5cd0 con 0x7f3f7406fda0 2023-09-13T06:01:23.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f78848640 1 -- 172.21.15.130:0/30276310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7406fda0 msgr2=0x7f3f74150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:23.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f78848640 1 --2- 172.21.15.130:0/30276310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7406fda0 0x7f3f74150120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3f74071a50 tx=0x7f3f6c01c9a0 comp rx=0 tx=0).stop 2023-09-13T06:01:23.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f78848640 1 -- 172.21.15.130:0/30276310 shutdown_connections 2023-09-13T06:01:23.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f78848640 1 --2- 172.21.15.130:0/30276310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7406fda0 0x7f3f74150120 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:23.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f78848640 1 --2- 172.21.15.130:0/30276310 >> v2:172.21.15.164:3300/0 conn(0x7f3f7415a8e0 0x7f3f74159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:23.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f78848640 1 -- 172.21.15.130:0/30276310 >> 172.21.15.130:0/30276310 conn(0x7f3f740735e0 msgr2=0x7f3f74065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:23.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f78848640 1 -- 172.21.15.130:0/30276310 shutdown_connections 2023-09-13T06:01:23.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f78848640 1 -- 172.21.15.130:0/30276310 wait complete. 2023-09-13T06:01:23.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.189+0000 7f3f78848640 1 Processor -- start 2023-09-13T06:01:23.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f78848640 1 -- start start 2023-09-13T06:01:23.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f78848640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f7406fda0 0x7f3f74149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:23.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f78848640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f740cc1b0 0x7f3f7414b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:23.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f78848640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f7415a8e0 0x7f3f7414bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:23.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f78848640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7414a1f0 con 0x7f3f740cc1b0 2023-09-13T06:01:23.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f78848640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740a85b0 con 0x7f3f7406fda0 2023-09-13T06:01:23.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f78848640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740a8890 con 0x7f3f7415a8e0 2023-09-13T06:01:23.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f69d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f740cc1b0 0x7f3f7414b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:23.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f7259c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f7406fda0 0x7f3f74149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:23.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f69d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f740cc1b0 0x7f3f7414b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35250/0 (socket says 172.21.15.130:35250) 2023-09-13T06:01:23.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f69d9b640 1 -- 172.21.15.130:0/942304606 learned_addr learned my addr 172.21.15.130:0/942304606 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:23.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f72d9d640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f7415a8e0 0x7f3f7414bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:23.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f69d9b640 1 -- 172.21.15.130:0/942304606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f7415a8e0 msgr2=0x7f3f7414bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:23.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f69d9b640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f7415a8e0 0x7f3f7414bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:23.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f69d9b640 1 -- 172.21.15.130:0/942304606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f7406fda0 msgr2=0x7f3f74149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:23.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f69d9b640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f7406fda0 0x7f3f74149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:23.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f69d9b640 1 -- 172.21.15.130:0/942304606 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c009b30 con 0x7f3f740cc1b0 2023-09-13T06:01:23.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f69d9b640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f740cc1b0 0x7f3f7414b620 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00c3c0 tx=0x7f3f5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:23.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f6b7fe640 1 -- 172.21.15.130:0/942304606 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c0052d0 con 0x7f3f740cc1b0 2023-09-13T06:01:23.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f6b7fe640 1 -- 172.21.15.130:0/942304606 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c005430 con 0x7f3f740cc1b0 2023-09-13T06:01:23.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f6b7fe640 1 -- 172.21.15.130:0/942304606 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c003840 con 0x7f3f740cc1b0 2023-09-13T06:01:23.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f78848640 1 -- 172.21.15.130:0/942304606 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f740a8b70 con 0x7f3f740cc1b0 2023-09-13T06:01:23.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f78848640 1 -- 172.21.15.130:0/942304606 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f741536d0 con 0x7f3f740cc1b0 2023-09-13T06:01:23.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.193+0000 7f3f78848640 1 -- 172.21.15.130:0/942304606 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f740618a0 con 0x7f3f740cc1b0 2023-09-13T06:01:23.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.197+0000 7f3f6b7fe640 1 -- 172.21.15.130:0/942304606 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3f5c0039a0 con 0x7f3f740cc1b0 2023-09-13T06:01:23.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.197+0000 7f3f6b7fe640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f54065b20 0x7f3f54067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:23.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.197+0000 7f3f6b7fe640 1 -- 172.21.15.130:0/942304606 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3f5c082360 con 0x7f3f740cc1b0 2023-09-13T06:01:23.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.197+0000 7f3f7259c640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f54065b20 0x7f3f54067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:23.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.197+0000 7f3f7259c640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f54065b20 0x7f3f54067fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009b60 tx=0x7f3f64009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:23.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.201+0000 7f3f6b7fe640 1 -- 172.21.15.130:0/942304606 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3f5c050140 con 0x7f3f740cc1b0 2023-09-13T06:01:23.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:23.353+0000 7f3f78848640 1 -- 172.21.15.130:0/942304606 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3f740705a0 con 0x7f3f740cc1b0 2023-09-13T06:01:24.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.301+0000 7f3f6b7fe640 1 -- 172.21.15.130:0/942304606 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3f5c053760 con 0x7f3f740cc1b0 2023-09-13T06:01:24.303 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' created 2023-09-13T06:01:24.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 -- 172.21.15.130:0/942304606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f54065b20 msgr2=0x7f3f54067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:24.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f54065b20 0x7f3f54067fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009b60 tx=0x7f3f64009190 comp rx=0 tx=0).stop 2023-09-13T06:01:24.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 -- 172.21.15.130:0/942304606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f740cc1b0 msgr2=0x7f3f7414b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:24.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f740cc1b0 0x7f3f7414b620 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00c3c0 tx=0x7f3f5c00c880 comp rx=0 tx=0).stop 2023-09-13T06:01:24.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 -- 172.21.15.130:0/942304606 shutdown_connections 2023-09-13T06:01:24.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f54065b20 0x7f3f54067fe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:24.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f7415a8e0 0x7f3f7414bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:24.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f740cc1b0 0x7f3f7414b620 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:24.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 --2- 172.21.15.130:0/942304606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f7406fda0 0x7f3f74149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:24.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 -- 172.21.15.130:0/942304606 >> 172.21.15.130:0/942304606 conn(0x7f3f740735e0 msgr2=0x7f3f740ae370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:24.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 -- 172.21.15.130:0/942304606 shutdown_connections 2023-09-13T06:01:24.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.305+0000 7f3f78848640 1 -- 172.21.15.130:0/942304606 wait complete. 2023-09-13T06:01:24.332 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T06:01:24.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.477+0000 7fe05694d640 1 Processor -- start 2023-09-13T06:01:24.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.477+0000 7fe05694d640 1 -- start start 2023-09-13T06:01:24.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe05694d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe050146c90 0x7fe05015da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:24.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe05694d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe050161060 0x7fe0500ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:24.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe05694d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05015e350 con 0x7fe0500aed50 2023-09-13T06:01:24.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe05694d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05015e630 con 0x7fe050161060 2023-09-13T06:01:24.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe05694d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05015e910 con 0x7fe050146c90 2023-09-13T06:01:24.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe04f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe050161060 0x7fe0500ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:24.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe04f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe050161060 0x7fe0500ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35256/0 (socket says 172.21.15.130:35256) 2023-09-13T06:01:24.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe04f7fe640 1 -- 172.21.15.130:0/4204090512 learned_addr learned my addr 172.21.15.130:0/4204090512 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:24.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe04ffff640 1 --2- 172.21.15.130:0/4204090512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe050146c90 0x7fe05015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:24.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe04f7fe640 1 -- 172.21.15.130:0/4204090512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe050146c90 msgr2=0x7fe05015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:24.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe04f7fe640 1 --2- 172.21.15.130:0/4204090512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe050146c90 0x7fe05015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:24.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe04f7fe640 1 -- 172.21.15.130:0/4204090512 >> v1:172.21.15.130:6789/0 conn(0x7fe0500aed50 legacy=0x7fe0500707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:24.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe04f7fe640 1 -- 172.21.15.130:0/4204090512 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0500ae010 con 0x7fe050161060 2023-09-13T06:01:24.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe04effd640 1 -- 172.21.15.130:0/4204090512 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281886653 0 0) 0x7fe05015e350 con 0x7fe0500aed50 2023-09-13T06:01:24.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.481+0000 7fe04f7fe640 1 --2- 172.21.15.130:0/4204090512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe050161060 0x7fe0500ae810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe044009870 tx=0x7fe04401cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7724597c0e456 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:24.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe04effd640 1 -- 172.21.15.130:0/4204090512 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0440a95f0 con 0x7fe050161060 2023-09-13T06:01:24.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe04effd640 1 -- 172.21.15.130:0/4204090512 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0440a9750 con 0x7fe050161060 2023-09-13T06:01:24.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe04effd640 1 -- 172.21.15.130:0/4204090512 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0440a9ae0 con 0x7fe050161060 2023-09-13T06:01:24.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 -- 172.21.15.130:0/4204090512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe050161060 msgr2=0x7fe0500ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:24.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 --2- 172.21.15.130:0/4204090512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe050161060 0x7fe0500ae810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe044009870 tx=0x7fe04401cf70 comp rx=0 tx=0).stop 2023-09-13T06:01:24.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 -- 172.21.15.130:0/4204090512 shutdown_connections 2023-09-13T06:01:24.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 --2- 172.21.15.130:0/4204090512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe050161060 0x7fe0500ae810 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:24.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 --2- 172.21.15.130:0/4204090512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe050146c90 0x7fe05015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:24.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 -- 172.21.15.130:0/4204090512 >> 172.21.15.130:0/4204090512 conn(0x7fe05006a730 msgr2=0x7fe050065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:24.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 -- 172.21.15.130:0/4204090512 shutdown_connections 2023-09-13T06:01:24.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 -- 172.21.15.130:0/4204090512 wait complete. 2023-09-13T06:01:24.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 Processor -- start 2023-09-13T06:01:24.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 -- start start 2023-09-13T06:01:24.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0500aed50 0x7fe05015c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:24.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe050146c90 0x7fe050144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:24.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe050161060 0x7fe050144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:24.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05012d960 con 0x7fe0500aed50 2023-09-13T06:01:24.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05013fdf0 con 0x7fe050161060 2023-09-13T06:01:24.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe05694d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05012d2a0 con 0x7fe050146c90 2023-09-13T06:01:24.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.485+0000 7fe04ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0500aed50 0x7fe05015c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:24.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0500aed50 0x7fe05015c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35266/0 (socket says 172.21.15.130:35266) 2023-09-13T06:01:24.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04ffff640 1 -- 172.21.15.130:0/1791905281 learned_addr learned my addr 172.21.15.130:0/1791905281 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:24.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04f7fe640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe050146c90 0x7fe050144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:24.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe054eea640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe050161060 0x7fe050144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:24.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04ffff640 1 -- 172.21.15.130:0/1791905281 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe050146c90 msgr2=0x7fe050144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:24.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04ffff640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe050146c90 0x7fe050144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:24.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04ffff640 1 -- 172.21.15.130:0/1791905281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe050161060 msgr2=0x7fe050144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:24.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04ffff640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe050161060 0x7fe050144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:24.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04ffff640 1 -- 172.21.15.130:0/1791905281 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440094d0 con 0x7fe0500aed50 2023-09-13T06:01:24.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04ffff640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0500aed50 0x7fe05015c940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe04000d800 tx=0x7fe04000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:24.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04cff9640 1 -- 172.21.15.130:0/1791905281 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04000b6c0 con 0x7fe0500aed50 2023-09-13T06:01:24.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04cff9640 1 -- 172.21.15.130:0/1791905281 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04000b820 con 0x7fe0500aed50 2023-09-13T06:01:24.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04cff9640 1 -- 172.21.15.130:0/1791905281 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04000bb90 con 0x7fe0500aed50 2023-09-13T06:01:24.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe05694d640 1 -- 172.21.15.130:0/1791905281 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05012d580 con 0x7fe0500aed50 2023-09-13T06:01:24.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe05694d640 1 -- 172.21.15.130:0/1791905281 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05013f0c0 con 0x7fe0500aed50 2023-09-13T06:01:24.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe05694d640 1 -- 172.21.15.130:0/1791905281 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05012d100 con 0x7fe0500aed50 2023-09-13T06:01:24.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.489+0000 7fe04cff9640 1 -- 172.21.15.130:0/1791905281 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe04000bcf0 con 0x7fe0500aed50 2023-09-13T06:01:24.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.493+0000 7fe04cff9640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe03c065b20 0x7fe03c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:24.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.493+0000 7fe04cff9640 1 -- 172.21.15.130:0/1791905281 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe040083550 con 0x7fe0500aed50 2023-09-13T06:01:24.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.493+0000 7fe04f7fe640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe03c065b20 0x7fe03c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:24.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.493+0000 7fe04f7fe640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe03c065b20 0x7fe03c067fe0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0440ae000 tx=0x7fe044009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:24.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.497+0000 7fe04cff9640 1 -- 172.21.15.130:0/1791905281 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe05012d100 con 0x7fe0500aed50 2023-09-13T06:01:24.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:24.645+0000 7fe05694d640 1 -- 172.21.15.130:0/1791905281 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe05012d100 con 0x7fe0500aed50 2023-09-13T06:01:25.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.312+0000 7fe04cff9640 1 -- 172.21.15.130:0/1791905281 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe05012d100 con 0x7fe0500aed50 2023-09-13T06:01:25.317 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' created 2023-09-13T06:01:25.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.320+0000 7fe05694d640 1 -- 172.21.15.130:0/1791905281 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe03c065b20 msgr2=0x7fe03c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:25.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.320+0000 7fe05694d640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe03c065b20 0x7fe03c067fe0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0440ae000 tx=0x7fe044009040 comp rx=0 tx=0).stop 2023-09-13T06:01:25.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.320+0000 7fe05694d640 1 -- 172.21.15.130:0/1791905281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0500aed50 msgr2=0x7fe05015c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:25.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.320+0000 7fe05694d640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0500aed50 0x7fe05015c940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe04000d800 tx=0x7fe04000dcc0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.320+0000 7fe05694d640 1 -- 172.21.15.130:0/1791905281 shutdown_connections 2023-09-13T06:01:25.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.324+0000 7fe05694d640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe03c065b20 0x7fe03c067fe0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.324+0000 7fe05694d640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe050161060 0x7fe050144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.324+0000 7fe05694d640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe050146c90 0x7fe050144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.324+0000 7fe05694d640 1 --2- 172.21.15.130:0/1791905281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0500aed50 0x7fe05015c940 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.324+0000 7fe05694d640 1 -- 172.21.15.130:0/1791905281 >> 172.21.15.130:0/1791905281 conn(0x7fe05006a730 msgr2=0x7fe050145e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:25.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.324+0000 7fe05694d640 1 -- 172.21.15.130:0/1791905281 shutdown_connections 2023-09-13T06:01:25.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.324+0000 7fe05694d640 1 -- 172.21.15.130:0/1791905281 wait complete. 2023-09-13T06:01:25.348 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T06:01:25.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf6a60b640 1 Processor -- start 2023-09-13T06:01:25.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf6a60b640 1 -- start start 2023-09-13T06:01:25.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf6a60b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcf64144d70 0x7fcf640ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:25.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf6a60b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcf640b2780 0x7fcf640b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:25.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf6a60b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 0x7fcf640b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:25.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf6a60b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf640b2430 con 0x7fcf640b2780 2023-09-13T06:01:25.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf6a60b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf640cedb0 con 0x7fcf64144d70 2023-09-13T06:01:25.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf6a60b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640b3120 con 0x7fcf640b1460 2023-09-13T06:01:25.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf637fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcf640b2780 0x7fcf640b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:25.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf637fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcf640b2780 0x7fcf640b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35268/0 (socket says 172.21.15.130:35268) 2023-09-13T06:01:25.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf637fe640 1 -- 172.21.15.130:0/1822593581 learned_addr learned my addr 172.21.15.130:0/1822593581 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:25.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf68ba8640 1 --2- 172.21.15.130:0/1822593581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 0x7fcf640b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:25.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.488+0000 7fcf63fff640 1 --2- 172.21.15.130:0/1822593581 >> v2:172.21.15.164:3300/0 conn(0x7fcf64144d70 0x7fcf640ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:25.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf637fe640 1 -- 172.21.15.130:0/1822593581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 msgr2=0x7fcf640b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:25.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf637fe640 1 --2- 172.21.15.130:0/1822593581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 0x7fcf640b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf637fe640 1 -- 172.21.15.130:0/1822593581 >> v2:172.21.15.164:3300/0 conn(0x7fcf64144d70 msgr2=0x7fcf640ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:25.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf637fe640 1 --2- 172.21.15.130:0/1822593581 >> v2:172.21.15.164:3300/0 conn(0x7fcf64144d70 0x7fcf640ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf637fe640 1 -- 172.21.15.130:0/1822593581 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf640b2150 con 0x7fcf640b2780 2023-09-13T06:01:25.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf63fff640 1 --2- 172.21.15.130:0/1822593581 >> v2:172.21.15.164:3300/0 conn(0x7fcf64144d70 0x7fcf640ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:25.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf637fe640 1 --2- 172.21.15.130:0/1822593581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf640b2780 0x7fcf640b2be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf640cff90 tx=0x7fcf5801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5834ea901354deb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:25.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf62ffd640 1 -- 172.21.15.130:0/1822593581 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf580ac410 con 0x7fcf640b2780 2023-09-13T06:01:25.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf62ffd640 1 -- 172.21.15.130:0/1822593581 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf580ac570 con 0x7fcf640b2780 2023-09-13T06:01:25.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf62ffd640 1 -- 172.21.15.130:0/1822593581 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf580ac900 con 0x7fcf640b2780 2023-09-13T06:01:25.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1822593581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf640b2780 msgr2=0x7fcf640b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:25.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.492+0000 7fcf6a60b640 1 --2- 172.21.15.130:0/1822593581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf640b2780 0x7fcf640b2be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf640cff90 tx=0x7fcf5801c500 comp rx=0 tx=0).stop 2023-09-13T06:01:25.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1822593581 shutdown_connections 2023-09-13T06:01:25.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 --2- 172.21.15.130:0/1822593581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 0x7fcf640b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 --2- 172.21.15.130:0/1822593581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf640b2780 0x7fcf640b2be0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 --2- 172.21.15.130:0/1822593581 >> v2:172.21.15.164:3300/0 conn(0x7fcf64144d70 0x7fcf640ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1822593581 >> 172.21.15.130:0/1822593581 conn(0x7fcf64065990 msgr2=0x7fcf64065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:25.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1822593581 shutdown_connections 2023-09-13T06:01:25.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1822593581 wait complete. 2023-09-13T06:01:25.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 Processor -- start 2023-09-13T06:01:25.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 -- start start 2023-09-13T06:01:25.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 0x7fcf641366f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:25.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf640b2780 0x7fcf64137200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:25.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf64144d70 0x7fcf64137740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:25.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6415d380 con 0x7fcf64144d70 2023-09-13T06:01:25.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6415c770 con 0x7fcf640b2780 2023-09-13T06:01:25.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf6a60b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6415ca50 con 0x7fcf640b1460 2023-09-13T06:01:25.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf63fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 0x7fcf641366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:25.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf68ba8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf64144d70 0x7fcf64137740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:25.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf63fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 0x7fcf641366f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:35752/0 (socket says 172.21.15.130:35752) 2023-09-13T06:01:25.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf63fff640 1 -- 172.21.15.130:0/1022676726 learned_addr learned my addr 172.21.15.130:0/1022676726 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:25.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf637fe640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf640b2780 0x7fcf64137200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:25.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf68ba8640 1 -- 172.21.15.130:0/1022676726 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 msgr2=0x7fcf641366f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:25.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf68ba8640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 0x7fcf641366f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf68ba8640 1 -- 172.21.15.130:0/1022676726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf640b2780 msgr2=0x7fcf64137200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:25.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf68ba8640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf640b2780 0x7fcf64137200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:25.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf68ba8640 1 -- 172.21.15.130:0/1022676726 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf580094d0 con 0x7fcf64144d70 2023-09-13T06:01:25.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf63fff640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 0x7fcf641366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:25.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.496+0000 7fcf68ba8640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf64144d70 0x7fcf64137740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00b0e0 tx=0x7fcf5c00b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:25.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.500+0000 7fcf60ff9640 1 -- 172.21.15.130:0/1022676726 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c015070 con 0x7fcf64144d70 2023-09-13T06:01:25.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.500+0000 7fcf60ff9640 1 -- 172.21.15.130:0/1022676726 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c019410 con 0x7fcf64144d70 2023-09-13T06:01:25.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.500+0000 7fcf60ff9640 1 -- 172.21.15.130:0/1022676726 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0197c0 con 0x7fcf64144d70 2023-09-13T06:01:25.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.500+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1022676726 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6415cd30 con 0x7fcf64144d70 2023-09-13T06:01:25.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.500+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1022676726 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6415c440 con 0x7fcf64144d70 2023-09-13T06:01:25.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.500+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1022676726 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6415d4f0 con 0x7fcf64144d70 2023-09-13T06:01:25.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.500+0000 7fcf60ff9640 1 -- 172.21.15.130:0/1022676726 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcf5c0223b0 con 0x7fcf64144d70 2023-09-13T06:01:25.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.500+0000 7fcf60ff9640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf50065b20 0x7fcf50067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:25.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.500+0000 7fcf60ff9640 1 -- 172.21.15.130:0/1022676726 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcf5c087310 con 0x7fcf64144d70 2023-09-13T06:01:25.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.500+0000 7fcf63fff640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf50065b20 0x7fcf50067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:25.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.504+0000 7fcf63fff640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf50065b20 0x7fcf50067fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400bf60 tx=0x7fcf54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:25.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.504+0000 7fcf60ff9640 1 -- 172.21.15.130:0/1022676726 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcf5c054cd0 con 0x7fcf64144d70 2023-09-13T06:01:25.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:25.688+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1022676726 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcf640618a0 con 0x7fcf64144d70 2023-09-13T06:01:26.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.312+0000 7fcf60ff9640 1 -- 172.21.15.130:0/1022676726 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcf5c01e0c0 con 0x7fcf64144d70 2023-09-13T06:01:26.323 INFO:teuthology.orchestra.run.smithi130.stderr:new fs with metadata pool 2 and data pool 3 2023-09-13T06:01:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.324+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1022676726 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf50065b20 msgr2=0x7fcf50067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.324+0000 7fcf6a60b640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf50065b20 0x7fcf50067fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400bf60 tx=0x7fcf54008040 comp rx=0 tx=0).stop 2023-09-13T06:01:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.324+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1022676726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf64144d70 msgr2=0x7fcf64137740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.324+0000 7fcf6a60b640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf64144d70 0x7fcf64137740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00b0e0 tx=0x7fcf5c00b5a0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.328+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1022676726 shutdown_connections 2023-09-13T06:01:26.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.328+0000 7fcf6a60b640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf50065b20 0x7fcf50067fe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.328+0000 7fcf6a60b640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf640b2780 0x7fcf64137200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.328+0000 7fcf6a60b640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf64144d70 0x7fcf64137740 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.328+0000 7fcf6a60b640 1 --2- 172.21.15.130:0/1022676726 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf640b1460 0x7fcf641366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.328+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1022676726 >> 172.21.15.130:0/1022676726 conn(0x7fcf64065990 msgr2=0x7fcf64143df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:26.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.328+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1022676726 shutdown_connections 2023-09-13T06:01:26.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.328+0000 7fcf6a60b640 1 -- 172.21.15.130:0/1022676726 wait complete. 2023-09-13T06:01:26.360 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:26.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f542c048640 1 Processor -- start 2023-09-13T06:01:26.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f542c048640 1 -- start start 2023-09-13T06:01:26.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f542c048640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54240d1750 0x7f542415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:26.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f542c048640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f54240d1090 0x7f5424146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:26.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f542c048640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54240b63c0 con 0x7f54240d1b30 2023-09-13T06:01:26.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f542c048640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542415dea0 con 0x7f54240d1090 2023-09-13T06:01:26.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f542c048640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54240d0c20 con 0x7f54240d1750 2023-09-13T06:01:26.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f54295e3640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f54240d1090 0x7f5424146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:26.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f54295e3640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f54240d1090 0x7f5424146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:46122/0 (socket says 172.21.15.130:46122) 2023-09-13T06:01:26.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f54295e3640 1 -- 172.21.15.130:0/2805447314 learned_addr learned my addr 172.21.15.130:0/2805447314 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:26.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f5429de4640 1 --2- 172.21.15.130:0/2805447314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54240d1750 0x7f542415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:26.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f54295e3640 1 -- 172.21.15.130:0/2805447314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54240d1750 msgr2=0x7f542415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:26.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f54295e3640 1 --2- 172.21.15.130:0/2805447314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54240d1750 0x7f542415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f54295e3640 1 -- 172.21.15.130:0/2805447314 >> v1:172.21.15.164:6789/0 conn(0x7f54240d1b30 legacy=0x7f54240b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f54295e3640 1 -- 172.21.15.130:0/2805447314 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54240b6610 con 0x7f54240d1090 2023-09-13T06:01:26.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f5428de2640 1 -- 172.21.15.130:0/2805447314 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281424929 0 0) 0x7f54240b63c0 con 0x7f54240d1b30 2023-09-13T06:01:26.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.496+0000 7f5429de4640 1 --2- 172.21.15.130:0/2805447314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54240d1750 0x7f542415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:26.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f54295e3640 1 --2- 172.21.15.130:0/2805447314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54240d1090 0x7f5424146820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5414009870 tx=0x7f541401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37c1d6044eb52a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:26.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f5428de2640 1 -- 172.21.15.130:0/2805447314 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54140aa670 con 0x7f54240d1090 2023-09-13T06:01:26.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f5428de2640 1 -- 172.21.15.130:0/2805447314 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54140aa7d0 con 0x7f54240d1090 2023-09-13T06:01:26.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f5428de2640 1 -- 172.21.15.130:0/2805447314 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54140aab60 con 0x7f54240d1090 2023-09-13T06:01:26.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f542c048640 1 -- 172.21.15.130:0/2805447314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54240d1090 msgr2=0x7f5424146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f542c048640 1 --2- 172.21.15.130:0/2805447314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54240d1090 0x7f5424146820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5414009870 tx=0x7f541401c510 comp rx=0 tx=0).stop 2023-09-13T06:01:26.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f542c048640 1 -- 172.21.15.130:0/2805447314 shutdown_connections 2023-09-13T06:01:26.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f542c048640 1 --2- 172.21.15.130:0/2805447314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54240d1090 0x7f5424146820 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f542c048640 1 --2- 172.21.15.130:0/2805447314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54240d1750 0x7f542415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f542c048640 1 -- 172.21.15.130:0/2805447314 >> 172.21.15.130:0/2805447314 conn(0x7f542406f170 msgr2=0x7f542406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:26.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f542c048640 1 -- 172.21.15.130:0/2805447314 shutdown_connections 2023-09-13T06:01:26.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.500+0000 7f542c048640 1 -- 172.21.15.130:0/2805447314 wait complete. 2023-09-13T06:01:26.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542c048640 1 Processor -- start 2023-09-13T06:01:26.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542c048640 1 -- start start 2023-09-13T06:01:26.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542c048640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54240d1090 0x7f542415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:26.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542c048640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54240d1750 0x7f542413bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:26.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542c048640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54240d1b30 0x7f542415cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:26.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542c048640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542415b950 con 0x7f54240d1b30 2023-09-13T06:01:26.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542c048640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542413c460 con 0x7f54240d1090 2023-09-13T06:01:26.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542c048640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542415bba0 con 0x7f54240d1750 2023-09-13T06:01:26.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542a5e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54240d1b30 0x7f542415cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:26.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542a5e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54240d1b30 0x7f542415cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35286/0 (socket says 172.21.15.130:35286) 2023-09-13T06:01:26.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542a5e5640 1 -- 172.21.15.130:0/3283280633 learned_addr learned my addr 172.21.15.130:0/3283280633 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:26.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f54295e3640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54240d1750 0x7f542413bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:26.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f5429de4640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54240d1090 0x7f542415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:26.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542a5e5640 1 -- 172.21.15.130:0/3283280633 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54240d1750 msgr2=0x7f542413bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542a5e5640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54240d1750 0x7f542413bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542a5e5640 1 -- 172.21.15.130:0/3283280633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54240d1090 msgr2=0x7f542415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542a5e5640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54240d1090 0x7f542415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542a5e5640 1 -- 172.21.15.130:0/3283280633 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420009420 con 0x7f54240d1b30 2023-09-13T06:01:26.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542a5e5640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54240d1b30 0x7f542415cc40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f541c00c750 tx=0x7f541c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:26.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f541a7fc640 1 -- 172.21.15.130:0/3283280633 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c003db0 con 0x7f54240d1b30 2023-09-13T06:01:26.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f541a7fc640 1 -- 172.21.15.130:0/3283280633 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00ce60 con 0x7f54240d1b30 2023-09-13T06:01:26.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f541a7fc640 1 -- 172.21.15.130:0/3283280633 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c005270 con 0x7f54240d1b30 2023-09-13T06:01:26.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.504+0000 7f542c048640 1 -- 172.21.15.130:0/3283280633 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54140094d0 con 0x7f54240d1b30 2023-09-13T06:01:26.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.508+0000 7f542c048640 1 -- 172.21.15.130:0/3283280633 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542415c160 con 0x7f54240d1b30 2023-09-13T06:01:26.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.508+0000 7f542c048640 1 -- 172.21.15.130:0/3283280633 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54240618a0 con 0x7f54240d1b30 2023-09-13T06:01:26.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.508+0000 7f541a7fc640 1 -- 172.21.15.130:0/3283280633 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f541c0053d0 con 0x7f54240d1b30 2023-09-13T06:01:26.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.508+0000 7f541a7fc640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5408065b50 0x7f5408068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:26.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.508+0000 7f541a7fc640 1 -- 172.21.15.130:0/3283280633 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f541c082a10 con 0x7f54240d1b30 2023-09-13T06:01:26.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.508+0000 7f5429de4640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5408065b50 0x7f5408068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:26.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.508+0000 7f5429de4640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5408065b50 0x7f5408068010 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5420009cf0 tx=0x7f5420009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:26.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.512+0000 7f541a7fc640 1 -- 172.21.15.130:0/3283280633 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f541c0503f0 con 0x7f54240d1b30 2023-09-13T06:01:26.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.664+0000 7f542c048640 1 -- 172.21.15.130:0/3283280633 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f542415d580 con 0x7f54240d1b30 2023-09-13T06:01:26.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.664+0000 7f541a7fc640 1 -- 172.21.15.130:0/3283280633 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16554 (secure 0 0 0) 0x7f541c017020 con 0x7f54240d1b30 2023-09-13T06:01:26.669 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:26.669 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":20,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:25.692978+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:26.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 -- 172.21.15.130:0/3283280633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5408065b50 msgr2=0x7f5408068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5408065b50 0x7f5408068010 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5420009cf0 tx=0x7f5420009190 comp rx=0 tx=0).stop 2023-09-13T06:01:26.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 -- 172.21.15.130:0/3283280633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54240d1b30 msgr2=0x7f542415cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54240d1b30 0x7f542415cc40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f541c00c750 tx=0x7f541c00cc10 comp rx=0 tx=0).stop 2023-09-13T06:01:26.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 -- 172.21.15.130:0/3283280633 shutdown_connections 2023-09-13T06:01:26.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5408065b50 0x7f5408068010 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54240d1b30 0x7f542415cc40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54240d1750 0x7f542413bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 --2- 172.21.15.130:0/3283280633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54240d1090 0x7f542415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 -- 172.21.15.130:0/3283280633 >> 172.21.15.130:0/3283280633 conn(0x7f542406f170 msgr2=0x7f54240b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:26.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 -- 172.21.15.130:0/3283280633 shutdown_connections 2023-09-13T06:01:26.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.668+0000 7f542c048640 1 -- 172.21.15.130:0/3283280633 wait complete. 2023-09-13T06:01:26.689 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:26.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fcb396640 1 Processor -- start 2023-09-13T06:01:26.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fcb396640 1 -- start start 2023-09-13T06:01:26.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fcb396640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fc4146f30 0x7f5fc415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:26.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fcb396640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40b63c0 con 0x7f5fc40d1090 2023-09-13T06:01:26.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fcb396640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40d0c20 con 0x7f5fc40d1750 2023-09-13T06:01:26.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fcb396640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc415dea0 con 0x7f5fc4146f30 2023-09-13T06:01:26.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fc8931640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5fc40d1090 0x7f5fc40b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49622/0 (socket says 172.21.15.130:49622) 2023-09-13T06:01:26.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fc8931640 1 -- 172.21.15.130:0/1514794129 learned_addr learned my addr 172.21.15.130:0/1514794129 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:26.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fc9933640 1 --2- 172.21.15.130:0/1514794129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fc4146f30 0x7f5fc415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:26.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fbbfff640 1 -- 172.21.15.130:0/1514794129 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453261639 0 0) 0x7f5fc40b63c0 con 0x7f5fc40d1090 2023-09-13T06:01:26.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fbbfff640 1 -- 172.21.15.130:0/1514794129 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fb0003530 con 0x7f5fc40d1090 2023-09-13T06:01:26.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fbbfff640 1 -- 172.21.15.130:0/1514794129 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467499788 0 0) 0x7f5fc40d0c20 con 0x7f5fc40d1750 2023-09-13T06:01:26.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fbbfff640 1 -- 172.21.15.130:0/1514794129 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc40b63c0 con 0x7f5fc40d1750 2023-09-13T06:01:26.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fc9933640 1 -- 172.21.15.130:0/1514794129 >> v1:172.21.15.164:6789/0 conn(0x7f5fc40d1750 legacy=0x7f5fc4146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fc9933640 1 -- 172.21.15.130:0/1514794129 >> v1:172.21.15.130:6789/0 conn(0x7f5fc40d1090 legacy=0x7f5fc40b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.824+0000 7f5fc9933640 1 -- 172.21.15.130:0/1514794129 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc40b6610 con 0x7f5fc4146f30 2023-09-13T06:01:26.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.828+0000 7f5fc9933640 1 --2- 172.21.15.130:0/1514794129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fc4146f30 0x7f5fc415d960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009dc0 tx=0x7f5fbc01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf0ceffd788f7ca6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:26.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.828+0000 7f5fbbfff640 1 -- 172.21.15.130:0/1514794129 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0a5a00 con 0x7f5fc4146f30 2023-09-13T06:01:26.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.828+0000 7f5fbbfff640 1 -- 172.21.15.130:0/1514794129 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc0a5b60 con 0x7f5fc4146f30 2023-09-13T06:01:26.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.828+0000 7f5fbbfff640 1 -- 172.21.15.130:0/1514794129 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0ad440 con 0x7f5fc4146f30 2023-09-13T06:01:26.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.828+0000 7f5fcb396640 1 -- 172.21.15.130:0/1514794129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fc4146f30 msgr2=0x7f5fc415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.828+0000 7f5fcb396640 1 --2- 172.21.15.130:0/1514794129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fc4146f30 0x7f5fc415d960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009dc0 tx=0x7f5fbc01c940 comp rx=0 tx=0).stop 2023-09-13T06:01:26.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.828+0000 7f5fcb396640 1 -- 172.21.15.130:0/1514794129 shutdown_connections 2023-09-13T06:01:26.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.828+0000 7f5fcb396640 1 --2- 172.21.15.130:0/1514794129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fc4146f30 0x7f5fc415d960 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.828+0000 7f5fcb396640 1 -- 172.21.15.130:0/1514794129 >> 172.21.15.130:0/1514794129 conn(0x7f5fc406f170 msgr2=0x7f5fc406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:26.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.828+0000 7f5fcb396640 1 -- 172.21.15.130:0/1514794129 shutdown_connections 2023-09-13T06:01:26.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.828+0000 7f5fcb396640 1 -- 172.21.15.130:0/1514794129 wait complete. 2023-09-13T06:01:26.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fcb396640 1 Processor -- start 2023-09-13T06:01:26.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fcb396640 1 -- start start 2023-09-13T06:01:26.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fcb396640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fc40d1090 0x7f5fc413a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:26.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fcb396640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fc40d1750 0x7f5fc4143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:26.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fcb396640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fc4146f30 0x7f5fc413ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:26.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fcb396640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc413c250 con 0x7f5fc40d1090 2023-09-13T06:01:26.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fcb396640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc413c530 con 0x7f5fc40d1750 2023-09-13T06:01:26.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fcb396640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc413c810 con 0x7f5fc4146f30 2023-09-13T06:01:26.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fc9132640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fc40d1090 0x7f5fc413a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:26.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fc9132640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fc40d1090 0x7f5fc413a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35298/0 (socket says 172.21.15.130:35298) 2023-09-13T06:01:26.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fc9132640 1 -- 172.21.15.130:0/791471835 learned_addr learned my addr 172.21.15.130:0/791471835 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:26.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fc9933640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fc4146f30 0x7f5fc413ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:26.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fc8931640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fc40d1750 0x7f5fc4143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:26.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fc9132640 1 -- 172.21.15.130:0/791471835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fc4146f30 msgr2=0x7f5fc413ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fc9132640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fc4146f30 0x7f5fc413ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fc9132640 1 -- 172.21.15.130:0/791471835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fc40d1750 msgr2=0x7f5fc4143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fc9132640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fc40d1750 0x7f5fc4143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fc9132640 1 -- 172.21.15.130:0/791471835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc009a70 con 0x7f5fc40d1090 2023-09-13T06:01:26.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fc9132640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fc40d1090 0x7f5fc413a4b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c490 tx=0x7f5fc000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:26.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fb9ffb640 1 -- 172.21.15.130:0/791471835 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00052d0 con 0x7f5fc40d1090 2023-09-13T06:01:26.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fb9ffb640 1 -- 172.21.15.130:0/791471835 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc0005430 con 0x7f5fc40d1090 2023-09-13T06:01:26.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fcb396640 1 -- 172.21.15.130:0/791471835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc413caf0 con 0x7f5fc40d1090 2023-09-13T06:01:26.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fb9ffb640 1 -- 172.21.15.130:0/791471835 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0012870 con 0x7f5fc40d1090 2023-09-13T06:01:26.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.832+0000 7f5fcb396640 1 -- 172.21.15.130:0/791471835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc413bf40 con 0x7f5fc40d1090 2023-09-13T06:01:26.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.836+0000 7f5fcb396640 1 -- 172.21.15.130:0/791471835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc40618a0 con 0x7f5fc40d1090 2023-09-13T06:01:26.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.836+0000 7f5fb9ffb640 1 -- 172.21.15.130:0/791471835 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5fc00129d0 con 0x7f5fc40d1090 2023-09-13T06:01:26.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.836+0000 7f5fb9ffb640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fa8065b50 0x7f5fa8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:26.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.836+0000 7f5fb9ffb640 1 -- 172.21.15.130:0/791471835 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fc0082e40 con 0x7f5fc40d1090 2023-09-13T06:01:26.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.836+0000 7f5fc8931640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fa8065b50 0x7f5fa8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:26.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.836+0000 7f5fc8931640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fa8065b50 0x7f5fa8068010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4141e50 tx=0x7f5fb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:26.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.840+0000 7f5fb9ffb640 1 -- 172.21.15.130:0/791471835 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5fc00506f0 con 0x7f5fc40d1090 2023-09-13T06:01:26.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.988+0000 7f5fcb396640 1 -- 172.21.15.130:0/791471835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fc413cfa0 con 0x7f5fc40d1090 2023-09-13T06:01:26.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fb9ffb640 1 -- 172.21.15.130:0/791471835 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16554 (secure 0 0 0) 0x7f5fc0053d10 con 0x7f5fc40d1090 2023-09-13T06:01:26.995 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:26.995 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":20,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:25.692978+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:26.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 -- 172.21.15.130:0/791471835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fa8065b50 msgr2=0x7f5fa8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fa8065b50 0x7f5fa8068010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4141e50 tx=0x7f5fb4009040 comp rx=0 tx=0).stop 2023-09-13T06:01:26.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 -- 172.21.15.130:0/791471835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fc40d1090 msgr2=0x7f5fc413a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:26.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fc40d1090 0x7f5fc413a4b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c490 tx=0x7f5fc000c950 comp rx=0 tx=0).stop 2023-09-13T06:01:26.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 -- 172.21.15.130:0/791471835 shutdown_connections 2023-09-13T06:01:26.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fa8065b50 0x7f5fa8068010 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fc40d1750 0x7f5fc4143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fc4146f30 0x7f5fc413ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 --2- 172.21.15.130:0/791471835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fc40d1090 0x7f5fc413a4b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:26.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 -- 172.21.15.130:0/791471835 >> 172.21.15.130:0/791471835 conn(0x7f5fc406f170 msgr2=0x7f5fc40cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:26.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 -- 172.21.15.130:0/791471835 shutdown_connections 2023-09-13T06:01:26.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:26.992+0000 7f5fcb396640 1 -- 172.21.15.130:0/791471835 wait complete. 2023-09-13T06:01:27.018 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T06:01:27.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec38967640 1 Processor -- start 2023-09-13T06:01:27.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec38967640 1 -- start start 2023-09-13T06:01:27.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec38967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec34157750 0x7fec34160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:27.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec38967640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fec3406dba0 0x7fec3415e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:27.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec38967640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3406dfe0 con 0x7fec34157b30 2023-09-13T06:01:27.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec38967640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec340ae0d0 con 0x7fec3406dba0 2023-09-13T06:01:27.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec38967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec34161e60 con 0x7fec34157750 2023-09-13T06:01:27.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec32d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fec3406dba0 0x7fec3415e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:27.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec29d9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fec34157b30 0x7fec3406f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49624/0 (socket says 172.21.15.130:49624) 2023-09-13T06:01:27.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec29d9b640 1 -- 172.21.15.130:0/3465379208 learned_addr learned my addr 172.21.15.130:0/3465379208 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:27.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec32d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fec3406dba0 0x7fec3415e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35310/0 (socket says 172.21.15.130:35310) 2023-09-13T06:01:27.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec3259c640 1 --2- 172.21.15.130:0/3465379208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec34157750 0x7fec34160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:27.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec32d9d640 1 -- 172.21.15.130:0/3465379208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec34157750 msgr2=0x7fec34160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:27.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec32d9d640 1 --2- 172.21.15.130:0/3465379208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec34157750 0x7fec34160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:27.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec31d9b640 1 -- 172.21.15.130:0/3465379208 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556426889 0 0) 0x7fec3406dfe0 con 0x7fec34157b30 2023-09-13T06:01:27.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec32d9d640 1 -- 172.21.15.130:0/3465379208 >> v1:172.21.15.130:6789/0 conn(0x7fec34157b30 legacy=0x7fec3406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:27.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.156+0000 7fec32d9d640 1 -- 172.21.15.130:0/3465379208 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec341615c0 con 0x7fec3406dba0 2023-09-13T06:01:27.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec32d9d640 1 --2- 172.21.15.130:0/3465379208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec3406dba0 0x7fec3415e020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009d90 tx=0x7fec2c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483c03f1175ec75b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:27.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec31d9b640 1 -- 172.21.15.130:0/3465379208 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0a58f0 con 0x7fec3406dba0 2023-09-13T06:01:27.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec31d9b640 1 -- 172.21.15.130:0/3465379208 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c0a5a50 con 0x7fec3406dba0 2023-09-13T06:01:27.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec31d9b640 1 -- 172.21.15.130:0/3465379208 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0a5de0 con 0x7fec3406dba0 2023-09-13T06:01:27.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec38967640 1 -- 172.21.15.130:0/3465379208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec3406dba0 msgr2=0x7fec3415e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:27.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec38967640 1 --2- 172.21.15.130:0/3465379208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec3406dba0 0x7fec3415e020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009d90 tx=0x7fec2c01c920 comp rx=0 tx=0).stop 2023-09-13T06:01:27.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec38967640 1 -- 172.21.15.130:0/3465379208 shutdown_connections 2023-09-13T06:01:27.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec38967640 1 --2- 172.21.15.130:0/3465379208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec3406dba0 0x7fec3415e020 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:27.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec38967640 1 --2- 172.21.15.130:0/3465379208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec34157750 0x7fec34160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:27.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec38967640 1 -- 172.21.15.130:0/3465379208 >> 172.21.15.130:0/3465379208 conn(0x7fec34065d60 msgr2=0x7fec340b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:27.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec38967640 1 -- 172.21.15.130:0/3465379208 shutdown_connections 2023-09-13T06:01:27.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.160+0000 7fec38967640 1 -- 172.21.15.130:0/3465379208 wait complete. 2023-09-13T06:01:27.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec38967640 1 Processor -- start 2023-09-13T06:01:27.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec38967640 1 -- start start 2023-09-13T06:01:27.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec38967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec3406dba0 0x7fec34155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:27.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec38967640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec34157750 0x7fec34149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:27.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec38967640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec34157b30 0x7fec340cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:27.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec38967640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3414c810 con 0x7fec34157750 2023-09-13T06:01:27.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec38967640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3414bc00 con 0x7fec34157b30 2023-09-13T06:01:27.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec38967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3414bee0 con 0x7fec3406dba0 2023-09-13T06:01:27.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec29d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec34157750 0x7fec34149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:27.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec29d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec34157750 0x7fec34149e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35324/0 (socket says 172.21.15.130:35324) 2023-09-13T06:01:27.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec29d9b640 1 -- 172.21.15.130:0/4078337551 learned_addr learned my addr 172.21.15.130:0/4078337551 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:27.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec32d9d640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec34157b30 0x7fec340cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:27.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec29d9b640 1 -- 172.21.15.130:0/4078337551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec3406dba0 msgr2=0x7fec34155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:27.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec29d9b640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec3406dba0 0x7fec34155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:27.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec29d9b640 1 -- 172.21.15.130:0/4078337551 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec34157b30 msgr2=0x7fec340cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:27.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec29d9b640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec34157b30 0x7fec340cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:27.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec29d9b640 1 -- 172.21.15.130:0/4078337551 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c009a70 con 0x7fec34157750 2023-09-13T06:01:27.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec29d9b640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec34157750 0x7fec34149e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00c480 tx=0x7fec1c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:27.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec2b7fe640 1 -- 172.21.15.130:0/4078337551 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0074e0 con 0x7fec34157750 2023-09-13T06:01:27.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec2b7fe640 1 -- 172.21.15.130:0/4078337551 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c007660 con 0x7fec34157750 2023-09-13T06:01:27.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec38967640 1 -- 172.21.15.130:0/4078337551 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3406fa00 con 0x7fec34157750 2023-09-13T06:01:27.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec2b7fe640 1 -- 172.21.15.130:0/4078337551 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c004a30 con 0x7fec34157750 2023-09-13T06:01:27.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.164+0000 7fec38967640 1 -- 172.21.15.130:0/4078337551 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3414c4a0 con 0x7fec34157750 2023-09-13T06:01:27.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.168+0000 7fec38967640 1 -- 172.21.15.130:0/4078337551 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec340618a0 con 0x7fec34157750 2023-09-13T06:01:27.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.168+0000 7fec2b7fe640 1 -- 172.21.15.130:0/4078337551 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fec1c004b90 con 0x7fec34157750 2023-09-13T06:01:27.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.168+0000 7fec2b7fe640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec14065b20 0x7fec14067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:27.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.168+0000 7fec2b7fe640 1 -- 172.21.15.130:0/4078337551 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec1c082820 con 0x7fec34157750 2023-09-13T06:01:27.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.168+0000 7fec3259c640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec14065b20 0x7fec14067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:27.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.168+0000 7fec3259c640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec14065b20 0x7fec14067fe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec240098f0 tx=0x7fec24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:27.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.172+0000 7fec2b7fe640 1 -- 172.21.15.130:0/4078337551 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fec1c053bf0 con 0x7fec34157750 2023-09-13T06:01:27.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:27.360+0000 7fec38967640 1 -- 172.21.15.130:0/4078337551 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fec340733f0 con 0x7fec34157750 2023-09-13T06:01:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.340+0000 7fec2b7fe640 1 -- 172.21.15.130:0/4078337551 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fec1c0180b0 con 0x7fec34157750 2023-09-13T06:01:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 -- 172.21.15.130:0/4078337551 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec14065b20 msgr2=0x7fec14067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec14065b20 0x7fec14067fe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec240098f0 tx=0x7fec24008040 comp rx=0 tx=0).stop 2023-09-13T06:01:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 -- 172.21.15.130:0/4078337551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec34157750 msgr2=0x7fec34149e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec34157750 0x7fec34149e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00c480 tx=0x7fec1c00c940 comp rx=0 tx=0).stop 2023-09-13T06:01:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 -- 172.21.15.130:0/4078337551 shutdown_connections 2023-09-13T06:01:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec14065b20 0x7fec14067fe0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec34157b30 0x7fec340cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec34157750 0x7fec34149e50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 --2- 172.21.15.130:0/4078337551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec3406dba0 0x7fec34155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 -- 172.21.15.130:0/4078337551 >> 172.21.15.130:0/4078337551 conn(0x7fec34065d60 msgr2=0x7fec341508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 -- 172.21.15.130:0/4078337551 shutdown_connections 2023-09-13T06:01:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.344+0000 7fec38967640 1 -- 172.21.15.130:0/4078337551 wait complete. 2023-09-13T06:01:28.370 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled']} 2023-09-13T06:01:28.371 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T06:01:28.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.512+0000 7fe79586d640 1 Processor -- start 2023-09-13T06:01:28.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.512+0000 7fe79586d640 1 -- start start 2023-09-13T06:01:28.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe79586d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe79015ae10 0x7fe7900d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:28.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe79586d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79015dd40 con 0x7fe7901619b0 2023-09-13T06:01:28.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe79586d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79015e020 con 0x7fe7900d2b00 2023-09-13T06:01:28.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe79586d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe790161e40 con 0x7fe79015ae10 2023-09-13T06:01:28.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe7901619b0 0x7fe7900cfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49638/0 (socket says 172.21.15.130:49638) 2023-09-13T06:01:28.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78f7fe640 1 -- 172.21.15.130:0/1727900497 learned_addr learned my addr 172.21.15.130:0/1727900497 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:28.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78effd640 1 --2- 172.21.15.130:0/1727900497 >> v2:172.21.15.164:3300/0 conn(0x7fe79015ae10 0x7fe7900d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:28.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655246490 0 0) 0x7fe79015dd40 con 0x7fe7901619b0 2023-09-13T06:01:28.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe77c003530 con 0x7fe7901619b0 2023-09-13T06:01:28.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3736420309 0 0) 0x7fe77c003530 con 0x7fe7901619b0 2023-09-13T06:01:28.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 >> v2:172.21.15.164:3300/0 conn(0x7fe79015ae10 msgr2=0x7fe7900d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:28.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 --2- 172.21.15.130:0/1727900497 >> v2:172.21.15.164:3300/0 conn(0x7fe79015ae10 0x7fe7900d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:28.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 >> v1:172.21.15.164:6789/0 conn(0x7fe7900d2b00 legacy=0x7fe7901612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:28.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79015e300 con 0x7fe7901619b0 2023-09-13T06:01:28.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fe788001a00 con 0x7fe7901619b0 2023-09-13T06:01:28.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 >> v1:172.21.15.130:6789/0 conn(0x7fe7901619b0 legacy=0x7fe7900cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:28.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe77c0039f0 0x7fe77c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:28.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe77c0047d0 0x7fe77c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:28.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe77c005290 0x7fe77c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:28.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe790161e40 con 0x7fe77c0039f0 2023-09-13T06:01:28.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c00c1d0 con 0x7fe77c005290 2023-09-13T06:01:28.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c00c390 con 0x7fe77c0047d0 2023-09-13T06:01:28.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78effd640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe77c0039f0 0x7fe77c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:28.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78f7fe640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe77c005290 0x7fe77c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:28.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe7867fc640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe77c0047d0 0x7fe77c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:28.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78effd640 1 -- 172.21.15.130:0/1727900497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe77c0047d0 msgr2=0x7fe77c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:28.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78effd640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe77c0047d0 0x7fe77c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:28.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78effd640 1 -- 172.21.15.130:0/1727900497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe77c005290 msgr2=0x7fe77c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:28.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78effd640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe77c005290 0x7fe77c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:28.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78effd640 1 -- 172.21.15.130:0/1727900497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c003530 con 0x7fe77c0039f0 2023-09-13T06:01:28.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78f7fe640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe77c005290 0x7fe77c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:28.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.516+0000 7fe78f7fe640 1 -- 172.21.15.130:0/1727900497 reap_dead start 2023-09-13T06:01:28.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.520+0000 7fe78effd640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe77c0039f0 0x7fe77c003e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe780009ae0 tx=0x7fe78001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2c6d4894c6704e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:28.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.520+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800a6510 con 0x7fe77c0039f0 2023-09-13T06:01:28.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.520+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7800a6670 con 0x7fe77c0039f0 2023-09-13T06:01:28.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.520+0000 7fe78e7fc640 1 -- 172.21.15.130:0/1727900497 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800a6a20 con 0x7fe77c0039f0 2023-09-13T06:01:28.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.520+0000 7fe79586d640 1 -- 172.21.15.130:0/1727900497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe77c0039f0 msgr2=0x7fe77c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:28.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.520+0000 7fe79586d640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe77c0039f0 0x7fe77c003e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe780009ae0 tx=0x7fe78001ca20 comp rx=0 tx=0).stop 2023-09-13T06:01:28.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.520+0000 7fe79586d640 1 -- 172.21.15.130:0/1727900497 shutdown_connections 2023-09-13T06:01:28.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.520+0000 7fe79586d640 1 --2- 172.21.15.130:0/1727900497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe77c0039f0 0x7fe77c003e10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:28.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.520+0000 7fe79586d640 1 -- 172.21.15.130:0/1727900497 >> 172.21.15.130:0/1727900497 conn(0x7fe790065990 msgr2=0x7fe790065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:28.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.520+0000 7fe79586d640 1 -- 172.21.15.130:0/1727900497 shutdown_connections 2023-09-13T06:01:28.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.520+0000 7fe79586d640 1 -- 172.21.15.130:0/1727900497 wait complete. 2023-09-13T06:01:28.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe79586d640 1 Processor -- start 2023-09-13T06:01:28.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe79586d640 1 -- start start 2023-09-13T06:01:28.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe79586d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe77c0039f0 0x7fe7901f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:28.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe79586d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7901fa1e0 0x7fe790160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:28.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe79586d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe790160650 0x7fe790144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe79586d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe790160b00 con 0x7fe790160650 2023-09-13T06:01:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe79586d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe790159810 con 0x7fe7901fa1e0 2023-09-13T06:01:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe79586d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe790145c10 con 0x7fe77c0039f0 2023-09-13T06:01:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe790160650 0x7fe790144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:28.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe790160650 0x7fe790144ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35336/0 (socket says 172.21.15.130:35336) 2023-09-13T06:01:28.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78f7fe640 1 -- 172.21.15.130:0/824268882 learned_addr learned my addr 172.21.15.130:0/824268882 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:28.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78effd640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe77c0039f0 0x7fe7901f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:28.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe7867fc640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7901fa1e0 0x7fe790160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:28.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78f7fe640 1 -- 172.21.15.130:0/824268882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe77c0039f0 msgr2=0x7fe7901f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:28.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78f7fe640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe77c0039f0 0x7fe7901f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:28.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78f7fe640 1 -- 172.21.15.130:0/824268882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7901fa1e0 msgr2=0x7fe790160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:28.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78f7fe640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7901fa1e0 0x7fe790160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:28.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78f7fe640 1 -- 172.21.15.130:0/824268882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7901f5e90 con 0x7fe790160650 2023-09-13T06:01:28.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78effd640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe77c0039f0 0x7fe7901f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:28.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78f7fe640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe790160650 0x7fe790144ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7900d1890 tx=0x7fe788007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:28.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78cff9640 1 -- 172.21.15.130:0/824268882 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800ea80 con 0x7fe790160650 2023-09-13T06:01:28.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78cff9640 1 -- 172.21.15.130:0/824268882 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78800ebe0 con 0x7fe790160650 2023-09-13T06:01:28.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe78cff9640 1 -- 172.21.15.130:0/824268882 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788013420 con 0x7fe790160650 2023-09-13T06:01:28.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe79586d640 1 -- 172.21.15.130:0/824268882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe790145930 con 0x7fe790160650 2023-09-13T06:01:28.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe79586d640 1 -- 172.21.15.130:0/824268882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7901f99e0 con 0x7fe790160650 2023-09-13T06:01:28.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.524+0000 7fe79586d640 1 -- 172.21.15.130:0/824268882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7900618a0 con 0x7fe790160650 2023-09-13T06:01:28.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.528+0000 7fe78cff9640 1 -- 172.21.15.130:0/824268882 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe788013580 con 0x7fe790160650 2023-09-13T06:01:28.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.528+0000 7fe78cff9640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe770065b20 0x7fe770067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.528+0000 7fe78cff9640 1 -- 172.21.15.130:0/824268882 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe788083570 con 0x7fe790160650 2023-09-13T06:01:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.528+0000 7fe78effd640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe770065b20 0x7fe770067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.528+0000 7fe78effd640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe770065b20 0x7fe770067fe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7800af000 tx=0x7fe780008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:28.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.532+0000 7fe78cff9640 1 -- 172.21.15.130:0/824268882 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe788050f50 con 0x7fe790160650 2023-09-13T06:01:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:28.712+0000 7fe79586d640 1 -- 172.21.15.130:0/824268882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe7900b2040 con 0x7fe790160650 2023-09-13T06:01:29.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe78cff9640 1 -- 172.21.15.130:0/824268882 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe788054570 con 0x7fe790160650 2023-09-13T06:01:29.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 -- 172.21.15.130:0/824268882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe770065b20 msgr2=0x7fe770067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe770065b20 0x7fe770067fe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7800af000 tx=0x7fe780008040 comp rx=0 tx=0).stop 2023-09-13T06:01:29.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 -- 172.21.15.130:0/824268882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe790160650 msgr2=0x7fe790144ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe790160650 0x7fe790144ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7900d1890 tx=0x7fe788007bc0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 -- 172.21.15.130:0/824268882 shutdown_connections 2023-09-13T06:01:29.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe770065b20 0x7fe770067fe0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7901fa1e0 0x7fe790160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe790160650 0x7fe790144ce0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 --2- 172.21.15.130:0/824268882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe77c0039f0 0x7fe7901f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 -- 172.21.15.130:0/824268882 >> 172.21.15.130:0/824268882 conn(0x7fe790065990 msgr2=0x7fe79015c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:29.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 -- 172.21.15.130:0/824268882 shutdown_connections 2023-09-13T06:01:29.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.352+0000 7fe79586d640 1 -- 172.21.15.130:0/824268882 wait complete. 2023-09-13T06:01:29.377 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T06:01:29.378 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:01:29.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.512+0000 7f12c98af640 1 Processor -- start 2023-09-13T06:01:29.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.512+0000 7f12c98af640 1 -- start start 2023-09-13T06:01:29.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c98af640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f12c40b64e0 0x7f12c4168470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:29.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c98af640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c4071440 con 0x7f12c4146eb0 2023-09-13T06:01:29.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c98af640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c40706a0 con 0x7f12c4161810 2023-09-13T06:01:29.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c98af640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c40b5130 con 0x7f12c40b64e0 2023-09-13T06:01:29.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c90ae640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f12c40b64e0 0x7f12c4168470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:29.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c90ae640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f12c40b64e0 0x7f12c4168470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35340/0 (socket says 172.21.15.130:35340) 2023-09-13T06:01:29.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c90ae640 1 -- 172.21.15.130:0/1012295020 learned_addr learned my addr 172.21.15.130:0/1012295020 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:29.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c88ad640 1 --1- 172.21.15.130:0/1012295020 >> v1:172.21.15.130:6789/0 conn(0x7f12c4146eb0 0x7f12c4161100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49642/0 (socket says 172.21.15.130:49642) 2023-09-13T06:01:29.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c90ae640 1 -- 172.21.15.130:0/1012295020 >> v1:172.21.15.164:6789/0 conn(0x7f12c4161810 legacy=0x7f12c40b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:29.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c90ae640 1 -- 172.21.15.130:0/1012295020 >> v1:172.21.15.130:6789/0 conn(0x7f12c4146eb0 legacy=0x7f12c4161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c90ae640 1 -- 172.21.15.130:0/1012295020 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c4147290 con 0x7f12c40b64e0 2023-09-13T06:01:29.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c90ae640 1 --2- 172.21.15.130:0/1012295020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12c40b64e0 0x7f12c4168470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009e50 tx=0x7f12bc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa850131fa12c18f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.516+0000 7f12c37fe640 1 -- 172.21.15.130:0/1012295020 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0a5860 con 0x7f12c40b64e0 2023-09-13T06:01:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c37fe640 1 -- 172.21.15.130:0/1012295020 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc0a59c0 con 0x7f12c40b64e0 2023-09-13T06:01:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c37fe640 1 -- 172.21.15.130:0/1012295020 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0a5d50 con 0x7f12c40b64e0 2023-09-13T06:01:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 -- 172.21.15.130:0/1012295020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12c40b64e0 msgr2=0x7f12c4168470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 --2- 172.21.15.130:0/1012295020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12c40b64e0 0x7f12c4168470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009e50 tx=0x7f12bc01c9a0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 -- 172.21.15.130:0/1012295020 shutdown_connections 2023-09-13T06:01:29.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 --2- 172.21.15.130:0/1012295020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12c40b64e0 0x7f12c4168470 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 -- 172.21.15.130:0/1012295020 >> 172.21.15.130:0/1012295020 conn(0x7f12c40cdd10 msgr2=0x7f12c40ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:29.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 -- 172.21.15.130:0/1012295020 shutdown_connections 2023-09-13T06:01:29.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 -- 172.21.15.130:0/1012295020 wait complete. 2023-09-13T06:01:29.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 Processor -- start 2023-09-13T06:01:29.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 -- start start 2023-09-13T06:01:29.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12c40b64e0 0x7f12c4167ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:29.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12c4146eb0 0x7f12c413cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:29.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12c4161810 0x7f12c40cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:29.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c413de60 con 0x7f12c4161810 2023-09-13T06:01:29.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c413c230 con 0x7f12c40b64e0 2023-09-13T06:01:29.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c98af640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c41680e0 con 0x7f12c4146eb0 2023-09-13T06:01:29.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c90ae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12c4161810 0x7f12c40cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:29.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c90ae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12c4161810 0x7f12c40cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35348/0 (socket says 172.21.15.130:35348) 2023-09-13T06:01:29.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.520+0000 7f12c90ae640 1 -- 172.21.15.130:0/699054254 learned_addr learned my addr 172.21.15.130:0/699054254 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:29.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c88ad640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12c40b64e0 0x7f12c4167ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:29.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c3fff640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12c4146eb0 0x7f12c413cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:29.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c90ae640 1 -- 172.21.15.130:0/699054254 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12c4146eb0 msgr2=0x7f12c413cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c90ae640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12c4146eb0 0x7f12c413cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c90ae640 1 -- 172.21.15.130:0/699054254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12c40b64e0 msgr2=0x7f12c4167ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c90ae640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12c40b64e0 0x7f12c4167ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c90ae640 1 -- 172.21.15.130:0/699054254 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc009b30 con 0x7f12c4161810 2023-09-13T06:01:29.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c90ae640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12c4161810 0x7f12c40cee40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0af040 tx=0x7f12bc019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:29.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c17fa640 1 -- 172.21.15.130:0/699054254 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0b8880 con 0x7f12c4161810 2023-09-13T06:01:29.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c17fa640 1 -- 172.21.15.130:0/699054254 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc0b89e0 con 0x7f12c4161810 2023-09-13T06:01:29.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c98af640 1 -- 172.21.15.130:0/699054254 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c413e070 con 0x7f12c4161810 2023-09-13T06:01:29.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c17fa640 1 -- 172.21.15.130:0/699054254 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0b8d90 con 0x7f12c4161810 2023-09-13T06:01:29.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c98af640 1 -- 172.21.15.130:0/699054254 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c413c480 con 0x7f12c4161810 2023-09-13T06:01:29.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c98af640 1 -- 172.21.15.130:0/699054254 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c40618a0 con 0x7f12c4161810 2023-09-13T06:01:29.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c17fa640 1 -- 172.21.15.130:0/699054254 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f12bc0c1410 con 0x7f12c4161810 2023-09-13T06:01:29.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c17fa640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f12a8065b50 0x7f12a8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:29.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c17fa640 1 -- 172.21.15.130:0/699054254 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12bc11e720 con 0x7f12c4161810 2023-09-13T06:01:29.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.524+0000 7f12c88ad640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f12a8065b50 0x7f12a8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:29.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.528+0000 7f12c88ad640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f12a8065b50 0x7f12a8068010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f12b8000f70 tx=0x7f12b8007cb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:29.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.528+0000 7f12c17fa640 1 -- 172.21.15.130:0/699054254 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f12bc0ec180 con 0x7f12c4161810 2023-09-13T06:01:29.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 -- 172.21.15.130:0/699054254 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12c40618a0 con 0x7f12c4161810 2023-09-13T06:01:29.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c17fa640 1 -- 172.21.15.130:0/699054254 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f12bc0ef7a0 con 0x7f12c4161810 2023-09-13T06:01:29.712 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:29.713 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1779716448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1779716448},{"type":"v1","addr":"172.21.15.130:6837","nonce":1779716448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1022199494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":1022199494},{"type":"v1","addr":"172.21.15.164:6835","nonce":1022199494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3130227261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3130227261},{"type":"v1","addr":"172.21.15.164:6834","nonce":3130227261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:01:25.693319+0000","modified":"2023-09-13T06:01:28.718115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/660561895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":660561895},{"type":"v1","addr":"172.21.15.130:6836","nonce":660561895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T06:01:29.714 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 7 2023-09-13T06:01:29.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 -- 172.21.15.130:0/699054254 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f12a8065b50 msgr2=0x7f12a8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f12a8065b50 0x7f12a8068010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f12b8000f70 tx=0x7f12b8007cb0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 -- 172.21.15.130:0/699054254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12c4161810 msgr2=0x7f12c40cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12c4161810 0x7f12c40cee40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0af040 tx=0x7f12bc019740 comp rx=0 tx=0).stop 2023-09-13T06:01:29.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 -- 172.21.15.130:0/699054254 shutdown_connections 2023-09-13T06:01:29.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f12a8065b50 0x7f12a8068010 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12c4161810 0x7f12c40cee40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12c4146eb0 0x7f12c413cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 --2- 172.21.15.130:0/699054254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12c40b64e0 0x7f12c4167ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 -- 172.21.15.130:0/699054254 >> 172.21.15.130:0/699054254 conn(0x7f12c40cdd10 msgr2=0x7f12c40b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:29.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 -- 172.21.15.130:0/699054254 shutdown_connections 2023-09-13T06:01:29.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.708+0000 7f12c98af640 1 -- 172.21.15.130:0/699054254 wait complete. 2023-09-13T06:01:29.733 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:29.776 INFO:tasks.ceph.mds.c.smithi130.stderr:2023-09-13T06:01:29.772+0000 7f1a2a5bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:01:29.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce043fa640 1 Processor -- start 2023-09-13T06:01:29.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce043fa640 1 -- start start 2023-09-13T06:01:29.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce043fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcdfc0d1090 0x7fcdfc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce043fa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcdfc146f30 0x7fcdfc0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce043fa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdfc0b63c0 con 0x7fcdfc0d1750 2023-09-13T06:01:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce043fa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc15dea0 con 0x7fcdfc146f30 2023-09-13T06:01:29.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce043fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0d0c20 con 0x7fcdfc0d1090 2023-09-13T06:01:29.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce02997640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcdfc146f30 0x7fcdfc0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:29.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce01995640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcdfc0d1090 0x7fcdfc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:29.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce02196640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fcdfc0d1750 0x7fcdfc146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:42640/0 (socket says 172.21.15.130:42640) 2023-09-13T06:01:29.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce02196640 1 -- 172.21.15.130:0/3939337565 learned_addr learned my addr 172.21.15.130:0/3939337565 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:29.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce02997640 1 -- 172.21.15.130:0/3939337565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcdfc0d1090 msgr2=0x7fcdfc15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:29.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce02997640 1 --2- 172.21.15.130:0/3939337565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcdfc0d1090 0x7fcdfc15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce02997640 1 -- 172.21.15.130:0/3939337565 >> v1:172.21.15.164:6789/0 conn(0x7fcdfc0d1750 legacy=0x7fcdfc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce02997640 1 -- 172.21.15.130:0/3939337565 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc0b6610 con 0x7fcdfc146f30 2023-09-13T06:01:29.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce01995640 1 --2- 172.21.15.130:0/3939337565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcdfc0d1090 0x7fcdfc15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:29.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.868+0000 7fce01194640 1 -- 172.21.15.130:0/3939337565 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231565116 0 0) 0x7fcdfc0b63c0 con 0x7fcdfc0d1750 2023-09-13T06:01:29.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce02997640 1 --2- 172.21.15.130:0/3939337565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc146f30 0x7fcdfc0b70f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009d90 tx=0x7fcdf401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8bc8d15e2b5d50b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:29.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce01194640 1 -- 172.21.15.130:0/3939337565 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40a59e0 con 0x7fcdfc146f30 2023-09-13T06:01:29.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce01194640 1 -- 172.21.15.130:0/3939337565 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40a5b40 con 0x7fcdfc146f30 2023-09-13T06:01:29.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce01194640 1 -- 172.21.15.130:0/3939337565 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40ad440 con 0x7fcdfc146f30 2023-09-13T06:01:29.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce043fa640 1 -- 172.21.15.130:0/3939337565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc146f30 msgr2=0x7fcdfc0b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce043fa640 1 --2- 172.21.15.130:0/3939337565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc146f30 0x7fcdfc0b70f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009d90 tx=0x7fcdf401c920 comp rx=0 tx=0).stop 2023-09-13T06:01:29.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce043fa640 1 -- 172.21.15.130:0/3939337565 shutdown_connections 2023-09-13T06:01:29.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce043fa640 1 --2- 172.21.15.130:0/3939337565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc146f30 0x7fcdfc0b70f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce043fa640 1 --2- 172.21.15.130:0/3939337565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcdfc0d1090 0x7fcdfc15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce043fa640 1 -- 172.21.15.130:0/3939337565 >> 172.21.15.130:0/3939337565 conn(0x7fcdfc06f170 msgr2=0x7fcdfc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:29.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce043fa640 1 -- 172.21.15.130:0/3939337565 shutdown_connections 2023-09-13T06:01:29.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.872+0000 7fce043fa640 1 -- 172.21.15.130:0/3939337565 wait complete. 2023-09-13T06:01:29.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce043fa640 1 Processor -- start 2023-09-13T06:01:29.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce043fa640 1 -- start start 2023-09-13T06:01:29.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce043fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc0d1090 0x7fcdfc15c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:29.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce043fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcdfc0d1750 0x7fcdfc143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:29.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce043fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdfc146f30 0x7fcdfc144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:29.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce043fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc146300 con 0x7fcdfc146f30 2023-09-13T06:01:29.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce043fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc146020 con 0x7fcdfc0d1090 2023-09-13T06:01:29.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce043fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc166e70 con 0x7fcdfc0d1750 2023-09-13T06:01:29.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce02997640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdfc146f30 0x7fcdfc144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:29.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce02997640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdfc146f30 0x7fcdfc144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35350/0 (socket says 172.21.15.130:35350) 2023-09-13T06:01:29.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce02997640 1 -- 172.21.15.130:0/3171605083 learned_addr learned my addr 172.21.15.130:0/3171605083 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:29.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce02196640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc0d1090 0x7fcdfc15c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:29.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce01995640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcdfc0d1750 0x7fcdfc143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:29.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce02997640 1 -- 172.21.15.130:0/3171605083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcdfc0d1750 msgr2=0x7fcdfc143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce02997640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcdfc0d1750 0x7fcdfc143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce02997640 1 -- 172.21.15.130:0/3171605083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc0d1090 msgr2=0x7fcdfc15c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:29.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce02997640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc0d1090 0x7fcdfc15c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:29.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce02997640 1 -- 172.21.15.130:0/3171605083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec009420 con 0x7fcdfc146f30 2023-09-13T06:01:29.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.876+0000 7fce02997640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdfc146f30 0x7fcdfc144050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcdf401a550 tx=0x7fcdf40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:29.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.880+0000 7fcdf2ffd640 1 -- 172.21.15.130:0/3171605083 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40bf070 con 0x7fcdfc146f30 2023-09-13T06:01:29.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.880+0000 7fcdf2ffd640 1 -- 172.21.15.130:0/3171605083 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40aeae0 con 0x7fcdfc146f30 2023-09-13T06:01:29.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.880+0000 7fce043fa640 1 -- 172.21.15.130:0/3171605083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf4009a70 con 0x7fcdfc146f30 2023-09-13T06:01:29.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.880+0000 7fcdf2ffd640 1 -- 172.21.15.130:0/3171605083 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40aee70 con 0x7fcdfc146f30 2023-09-13T06:01:29.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.880+0000 7fce043fa640 1 -- 172.21.15.130:0/3171605083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc0b7e40 con 0x7fcdfc146f30 2023-09-13T06:01:29.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.880+0000 7fce043fa640 1 -- 172.21.15.130:0/3171605083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc161e70 con 0x7fcdfc146f30 2023-09-13T06:01:29.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.880+0000 7fcdf2ffd640 1 -- 172.21.15.130:0/3171605083 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcdf40b4050 con 0x7fcdfc146f30 2023-09-13T06:01:29.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.880+0000 7fcdf2ffd640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b20 0x7fcde0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:29.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.880+0000 7fcdf2ffd640 1 -- 172.21.15.130:0/3171605083 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdf411db60 con 0x7fcdfc146f30 2023-09-13T06:01:29.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.880+0000 7fce02196640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b20 0x7fcde0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:29.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.880+0000 7fce02196640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b20 0x7fcde0067fe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8007a90 tx=0x7fcdf80079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:29.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:29.884+0000 7fcdf2ffd640 1 -- 172.21.15.130:0/3171605083 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcdf40eb670 con 0x7fcdfc146f30 2023-09-13T06:01:30.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.032+0000 7fce043fa640 1 -- 172.21.15.130:0/3171605083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdfc0618a0 con 0x7fcdfc146f30 2023-09-13T06:01:30.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.032+0000 7fcdf2ffd640 1 -- 172.21.15.130:0/3171605083 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fcdf40eec90 con 0x7fcdfc146f30 2023-09-13T06:01:30.038 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:30.038 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:30.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 -- 172.21.15.130:0/3171605083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b20 msgr2=0x7fcde0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b20 0x7fcde0067fe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8007a90 tx=0x7fcdf80079e0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 -- 172.21.15.130:0/3171605083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdfc146f30 msgr2=0x7fcdfc144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdfc146f30 0x7fcdfc144050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcdf401a550 tx=0x7fcdf40196c0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 -- 172.21.15.130:0/3171605083 shutdown_connections 2023-09-13T06:01:30.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b20 0x7fcde0067fe0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdfc146f30 0x7fcdfc144050 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcdfc0d1750 0x7fcdfc143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 --2- 172.21.15.130:0/3171605083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc0d1090 0x7fcdfc15c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 -- 172.21.15.130:0/3171605083 >> 172.21.15.130:0/3171605083 conn(0x7fcdfc06f170 msgr2=0x7fcdfc06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:30.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 -- 172.21.15.130:0/3171605083 shutdown_connections 2023-09-13T06:01:30.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.036+0000 7fce043fa640 1 -- 172.21.15.130:0/3171605083 wait complete. 2023-09-13T06:01:30.059 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T06:01:30.059 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:01:30.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f3117d4d640 1 Processor -- start 2023-09-13T06:01:30.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f3117d4d640 1 -- start start 2023-09-13T06:01:30.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f3117d4d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f31100d1750 0x7f311015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f3117d4d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f31100d1090 0x7f3110146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f3117d4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31100d1b30 0x7f3110146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f3117d4d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311015dea0 con 0x7f31100d1090 2023-09-13T06:01:30.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f3117d4d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31100b63c0 con 0x7f31100d1750 2023-09-13T06:01:30.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f3117d4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31100d0c20 con 0x7f31100d1b30 2023-09-13T06:01:30.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f31152e8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f31100d1090 0x7f3110146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f31152e8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f31100d1090 0x7f3110146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35352/0 (socket says 172.21.15.130:35352) 2023-09-13T06:01:30.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f31152e8640 1 -- 172.21.15.130:0/2979143099 learned_addr learned my addr 172.21.15.130:0/2979143099 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:30.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f31162ea640 1 --2- 172.21.15.130:0/2979143099 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31100d1b30 0x7f3110146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f3115ae9640 1 --2- 172.21.15.130:0/2979143099 >> v2:172.21.15.164:3300/0 conn(0x7f31100d1750 0x7f311015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f31152e8640 1 -- 172.21.15.130:0/2979143099 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31100d1b30 msgr2=0x7f3110146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:30.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f31152e8640 1 --2- 172.21.15.130:0/2979143099 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31100d1b30 0x7f3110146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f31152e8640 1 -- 172.21.15.130:0/2979143099 >> v2:172.21.15.164:3300/0 conn(0x7f31100d1750 msgr2=0x7f311015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:30.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f31152e8640 1 --2- 172.21.15.130:0/2979143099 >> v2:172.21.15.164:3300/0 conn(0x7f31100d1750 0x7f311015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f31152e8640 1 -- 172.21.15.130:0/2979143099 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31100b6610 con 0x7f31100d1090 2023-09-13T06:01:30.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f31162ea640 1 --2- 172.21.15.130:0/2979143099 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31100d1b30 0x7f3110146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:30.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.236+0000 7f3115ae9640 1 --2- 172.21.15.130:0/2979143099 >> v2:172.21.15.164:3300/0 conn(0x7f31100d1750 0x7f311015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:30.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f31152e8640 1 --2- 172.21.15.130:0/2979143099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31100d1090 0x7f3110146820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3110073cd0 tx=0x7f310001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d62960cf148668d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:30.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3114ae7640 1 -- 172.21.15.130:0/2979143099 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31000aa5f0 con 0x7f31100d1090 2023-09-13T06:01:30.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3114ae7640 1 -- 172.21.15.130:0/2979143099 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31000aa750 con 0x7f31100d1090 2023-09-13T06:01:30.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3114ae7640 1 -- 172.21.15.130:0/2979143099 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31000aaae0 con 0x7f31100d1090 2023-09-13T06:01:30.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3117d4d640 1 -- 172.21.15.130:0/2979143099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31100d1090 msgr2=0x7f3110146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3117d4d640 1 --2- 172.21.15.130:0/2979143099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31100d1090 0x7f3110146820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3110073cd0 tx=0x7f310001c4d0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3117d4d640 1 -- 172.21.15.130:0/2979143099 shutdown_connections 2023-09-13T06:01:30.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3117d4d640 1 --2- 172.21.15.130:0/2979143099 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31100d1b30 0x7f3110146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3117d4d640 1 --2- 172.21.15.130:0/2979143099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31100d1090 0x7f3110146820 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3117d4d640 1 --2- 172.21.15.130:0/2979143099 >> v2:172.21.15.164:3300/0 conn(0x7f31100d1750 0x7f311015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3117d4d640 1 -- 172.21.15.130:0/2979143099 >> 172.21.15.130:0/2979143099 conn(0x7f311006f170 msgr2=0x7f311006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:30.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3117d4d640 1 -- 172.21.15.130:0/2979143099 shutdown_connections 2023-09-13T06:01:30.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.240+0000 7f3117d4d640 1 -- 172.21.15.130:0/2979143099 wait complete. 2023-09-13T06:01:30.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3117d4d640 1 Processor -- start 2023-09-13T06:01:30.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3117d4d640 1 -- start start 2023-09-13T06:01:30.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3117d4d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31100d1090 0x7f311014cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3117d4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31100d1750 0x7f311015ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3117d4d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31100d1b30 0x7f311013d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3117d4d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311013aab0 con 0x7f31100d1090 2023-09-13T06:01:30.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3117d4d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3110145550 con 0x7f31100d1b30 2023-09-13T06:01:30.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3117d4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3110145830 con 0x7f31100d1750 2023-09-13T06:01:30.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3115ae9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31100d1090 0x7f311014cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3115ae9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31100d1090 0x7f311014cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35362/0 (socket says 172.21.15.130:35362) 2023-09-13T06:01:30.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3115ae9640 1 -- 172.21.15.130:0/204697318 learned_addr learned my addr 172.21.15.130:0/204697318 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:30.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f31162ea640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31100d1b30 0x7f311013d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f31152e8640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31100d1750 0x7f311015ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3115ae9640 1 -- 172.21.15.130:0/204697318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31100d1750 msgr2=0x7f311015ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3115ae9640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31100d1750 0x7f311015ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3115ae9640 1 -- 172.21.15.130:0/204697318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31100d1b30 msgr2=0x7f311013d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3115ae9640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31100d1b30 0x7f311013d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3115ae9640 1 -- 172.21.15.130:0/204697318 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000094d0 con 0x7f31100d1090 2023-09-13T06:01:30.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3115ae9640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31100d1090 0x7f311014cc00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c7c0 tx=0x7f310c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:30.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f31067fc640 1 -- 172.21.15.130:0/204697318 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c007a30 con 0x7f31100d1090 2023-09-13T06:01:30.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f31067fc640 1 -- 172.21.15.130:0/204697318 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c007b90 con 0x7f31100d1090 2023-09-13T06:01:30.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f31067fc640 1 -- 172.21.15.130:0/204697318 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c00ce70 con 0x7f31100d1090 2023-09-13T06:01:30.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3117d4d640 1 -- 172.21.15.130:0/204697318 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3110145b10 con 0x7f31100d1090 2023-09-13T06:01:30.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.244+0000 7f3117d4d640 1 -- 172.21.15.130:0/204697318 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31101451b0 con 0x7f31100d1090 2023-09-13T06:01:30.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.248+0000 7f3117d4d640 1 -- 172.21.15.130:0/204697318 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31100618a0 con 0x7f31100d1090 2023-09-13T06:01:30.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.248+0000 7f31067fc640 1 -- 172.21.15.130:0/204697318 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f310c0113f0 con 0x7f31100d1090 2023-09-13T06:01:30.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.248+0000 7f31067fc640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f30f4065b20 0x7f30f4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.248+0000 7f31067fc640 1 -- 172.21.15.130:0/204697318 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f310c083380 con 0x7f31100d1090 2023-09-13T06:01:30.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.248+0000 7f31152e8640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f30f4065b20 0x7f30f4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.248+0000 7f31152e8640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f30f4065b20 0x7f30f4067fe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31000ae000 tx=0x7f31000b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:30.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.252+0000 7f31067fc640 1 -- 172.21.15.130:0/204697318 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f310c050d80 con 0x7f31100d1090 2023-09-13T06:01:30.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.400+0000 7f3117d4d640 1 -- 172.21.15.130:0/204697318 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31100b7900 con 0x7f30f4065b20 2023-09-13T06:01:30.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.408+0000 7f31067fc640 1 -- 172.21.15.130:0/204697318 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249062 (secure 0 0 0) 0x7f31000aa940 con 0x7f30f4065b20 2023-09-13T06:01:30.413 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:30.415 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:01:30.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.408+0000 7f3117d4d640 1 -- 172.21.15.130:0/204697318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f30f4065b20 msgr2=0x7f30f4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.408+0000 7f3117d4d640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f30f4065b20 0x7f30f4067fe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31000ae000 tx=0x7f31000b5040 comp rx=0 tx=0).stop 2023-09-13T06:01:30.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.408+0000 7f3117d4d640 1 -- 172.21.15.130:0/204697318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31100d1090 msgr2=0x7f311014cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.408+0000 7f3117d4d640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31100d1090 0x7f311014cc00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c7c0 tx=0x7f310c00cc80 comp rx=0 tx=0).stop 2023-09-13T06:01:30.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.408+0000 7f3117d4d640 1 -- 172.21.15.130:0/204697318 shutdown_connections 2023-09-13T06:01:30.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.408+0000 7f3117d4d640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f30f4065b20 0x7f30f4067fe0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.412+0000 7f3117d4d640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31100d1b30 0x7f311013d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.412+0000 7f3117d4d640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f31100d1750 0x7f311015ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.412+0000 7f3117d4d640 1 --2- 172.21.15.130:0/204697318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31100d1090 0x7f311014cc00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.412+0000 7f3117d4d640 1 -- 172.21.15.130:0/204697318 >> 172.21.15.130:0/204697318 conn(0x7f311006f170 msgr2=0x7f31100cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:30.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.412+0000 7f3117d4d640 1 -- 172.21.15.130:0/204697318 shutdown_connections 2023-09-13T06:01:30.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.412+0000 7f3117d4d640 1 -- 172.21.15.130:0/204697318 wait complete. 2023-09-13T06:01:30.433 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-13T06:01:28.536918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1545,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560954,"statfs":{"total":1600000000,"available":1598417328,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.234742"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-13T06:01:17.142467+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:01:17.142467+0000","last_peered":"2023-09-13T06:01:17.142467+0000","last_clean":"2023-09-13T06:01:17.142467+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:01:17.142467+0000","last_undegraded":"2023-09-13T06:01:17.142467+0000","last_fullsized":"2023-09-13T06:01:17.142467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:25.301519+0000","last_change":"2023-09-13T06:01:25.301519+0000","last_active":"2023-09-13T06:01:25.301519+0000","last_peered":"2023-09-13T06:01:25.301519+0000","last_clean":"2023-09-13T06:01:25.301519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:25.301519+0000","last_undegraded":"2023-09-13T06:01:25.301519+0000","last_fullsized":"2023-09-13T06:01:25.301519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:01:24.290102+0000","last_change":"2023-09-13T06:01:24.290102+0000","last_active":"2023-09-13T06:01:24.290102+0000","last_peered":"2023-09-13T06:01:24.290102+0000","last_clean":"2023-09-13T06:01:24.290102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:01:24.290102+0000","last_undegraded":"2023-09-13T06:01:24.290102+0000","last_fullsized":"2023-09-13T06:01:24.290102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194686,"statfs":{"total":200000000,"available":199359390,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194686,"statfs":{"total":200000000,"available":199359390,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]}],"pool_statfs":[]}} 2023-09-13T06:01:30.440 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:01:30.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f8596693640 1 Processor -- start 2023-09-13T06:01:30.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f8596693640 1 -- start start 2023-09-13T06:01:30.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f8596693640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f85900d1750 0x7f859015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f8596693640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8590146f30 0x7f85900b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f8596693640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85900b63c0 con 0x7f85900d1090 2023-09-13T06:01:30.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f8596693640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859015dea0 con 0x7f85900d1750 2023-09-13T06:01:30.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f8596693640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85900d0c20 con 0x7f8590146f30 2023-09-13T06:01:30.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f858ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f85900d1750 0x7f859015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f858f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f85900d1090 0x7f8590146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49658/0 (socket says 172.21.15.130:49658) 2023-09-13T06:01:30.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f858f7fe640 1 -- 172.21.15.130:0/1218728831 learned_addr learned my addr 172.21.15.130:0/1218728831 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:30.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f858ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f85900d1750 0x7f859015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35370/0 (socket says 172.21.15.130:35370) 2023-09-13T06:01:30.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f8594c30640 1 --2- 172.21.15.130:0/1218728831 >> v2:172.21.15.164:3300/0 conn(0x7f8590146f30 0x7f85900b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f858effd640 1 -- 172.21.15.130:0/1218728831 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143748139 0 0) 0x7f85900b63c0 con 0x7f85900d1090 2023-09-13T06:01:30.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f858ffff640 1 -- 172.21.15.130:0/1218728831 >> v2:172.21.15.164:3300/0 conn(0x7f8590146f30 msgr2=0x7f85900b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:30.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f858ffff640 1 --2- 172.21.15.130:0/1218728831 >> v2:172.21.15.164:3300/0 conn(0x7f8590146f30 0x7f85900b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f858ffff640 1 -- 172.21.15.130:0/1218728831 >> v1:172.21.15.130:6789/0 conn(0x7f85900d1090 legacy=0x7f8590146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.608+0000 7f858ffff640 1 -- 172.21.15.130:0/1218728831 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85900b6610 con 0x7f85900d1750 2023-09-13T06:01:30.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f858ffff640 1 --2- 172.21.15.130:0/1218728831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85900d1750 0x7f859015d960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f85900d2c80 tx=0x7f858001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7329aadb9f4c90 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:30.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f858effd640 1 -- 172.21.15.130:0/1218728831 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800ac600 con 0x7f85900d1750 2023-09-13T06:01:30.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f858effd640 1 -- 172.21.15.130:0/1218728831 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85800a8050 con 0x7f85900d1750 2023-09-13T06:01:30.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f858effd640 1 -- 172.21.15.130:0/1218728831 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800ac980 con 0x7f85900d1750 2023-09-13T06:01:30.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f8596693640 1 -- 172.21.15.130:0/1218728831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85900d1750 msgr2=0x7f859015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f8596693640 1 --2- 172.21.15.130:0/1218728831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85900d1750 0x7f859015d960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f85900d2c80 tx=0x7f858001c3a0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f8596693640 1 -- 172.21.15.130:0/1218728831 shutdown_connections 2023-09-13T06:01:30.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f8596693640 1 --2- 172.21.15.130:0/1218728831 >> v2:172.21.15.164:3300/0 conn(0x7f8590146f30 0x7f85900b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f8596693640 1 --2- 172.21.15.130:0/1218728831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85900d1750 0x7f859015d960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f8596693640 1 -- 172.21.15.130:0/1218728831 >> 172.21.15.130:0/1218728831 conn(0x7f859006f170 msgr2=0x7f859006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:30.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f8596693640 1 -- 172.21.15.130:0/1218728831 shutdown_connections 2023-09-13T06:01:30.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.612+0000 7f8596693640 1 -- 172.21.15.130:0/1218728831 wait complete. 2023-09-13T06:01:30.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f8596693640 1 Processor -- start 2023-09-13T06:01:30.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f8596693640 1 -- start start 2023-09-13T06:01:30.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f8596693640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85900d1090 0x7f859015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f8596693640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85900d1750 0x7f8590140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f8596693640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8590146f30 0x7f8590147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f8596693640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8590166270 con 0x7f85900d1090 2023-09-13T06:01:30.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f8596693640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8590165f30 con 0x7f8590146f30 2023-09-13T06:01:30.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f8596693640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859013f8a0 con 0x7f85900d1750 2023-09-13T06:01:30.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85900d1090 0x7f859015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85900d1090 0x7f859015b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35380/0 (socket says 172.21.15.130:35380) 2023-09-13T06:01:30.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858ffff640 1 -- 172.21.15.130:0/4268534213 learned_addr learned my addr 172.21.15.130:0/4268534213 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:30.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858f7fe640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85900d1750 0x7f8590140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f8594c30640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8590146f30 0x7f8590147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858ffff640 1 -- 172.21.15.130:0/4268534213 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85900d1750 msgr2=0x7f8590140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858ffff640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85900d1750 0x7f8590140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858ffff640 1 -- 172.21.15.130:0/4268534213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8590146f30 msgr2=0x7f8590147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858ffff640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8590146f30 0x7f8590147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858ffff640 1 -- 172.21.15.130:0/4268534213 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580009420 con 0x7f85900d1090 2023-09-13T06:01:30.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858ffff640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85900d1090 0x7f859015b5c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8580019fd0 tx=0x7f858001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:30.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858cff9640 1 -- 172.21.15.130:0/4268534213 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800b7650 con 0x7f85900d1090 2023-09-13T06:01:30.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858cff9640 1 -- 172.21.15.130:0/4268534213 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85800b77d0 con 0x7f85900d1090 2023-09-13T06:01:30.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f858cff9640 1 -- 172.21.15.130:0/4268534213 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800b7b80 con 0x7f85900d1090 2023-09-13T06:01:30.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.616+0000 7f8596693640 1 -- 172.21.15.130:0/4268534213 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85900b7e40 con 0x7f85900d1090 2023-09-13T06:01:30.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.620+0000 7f8596693640 1 -- 172.21.15.130:0/4268534213 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8590140140 con 0x7f85900d1090 2023-09-13T06:01:30.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.620+0000 7f8596693640 1 -- 172.21.15.130:0/4268534213 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85900618a0 con 0x7f85900d1090 2023-09-13T06:01:30.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.620+0000 7f858cff9640 1 -- 172.21.15.130:0/4268534213 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f85800b3070 con 0x7f85900d1090 2023-09-13T06:01:30.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.620+0000 7f858cff9640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f857c065b20 0x7f857c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.620+0000 7f858cff9640 1 -- 172.21.15.130:0/4268534213 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f858011d6d0 con 0x7f85900d1090 2023-09-13T06:01:30.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.620+0000 7f858f7fe640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f857c065b20 0x7f857c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.620+0000 7f858f7fe640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f857c065b20 0x7f857c067fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8590146480 tx=0x7f8584007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:30.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.624+0000 7f858cff9640 1 -- 172.21.15.130:0/4268534213 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f85800eb0c0 con 0x7f85900d1090 2023-09-13T06:01:30.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.768+0000 7f8596693640 1 -- 172.21.15.130:0/4268534213 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85900b86c0 con 0x7f857c065b20 2023-09-13T06:01:30.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.776+0000 7f858cff9640 1 -- 172.21.15.130:0/4268534213 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260236 (secure 0 0 0) 0x7f85900b86c0 con 0x7f857c065b20 2023-09-13T06:01:30.784 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:30.785 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:01:30.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 -- 172.21.15.130:0/4268534213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f857c065b20 msgr2=0x7f857c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f857c065b20 0x7f857c067fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8590146480 tx=0x7f8584007d60 comp rx=0 tx=0).stop 2023-09-13T06:01:30.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 -- 172.21.15.130:0/4268534213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85900d1090 msgr2=0x7f859015b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85900d1090 0x7f859015b5c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8580019fd0 tx=0x7f858001abe0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 -- 172.21.15.130:0/4268534213 shutdown_connections 2023-09-13T06:01:30.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f857c065b20 0x7f857c067fe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8590146f30 0x7f8590147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85900d1750 0x7f8590140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 --2- 172.21.15.130:0/4268534213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85900d1090 0x7f859015b5c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 -- 172.21.15.130:0/4268534213 >> 172.21.15.130:0/4268534213 conn(0x7f859006f170 msgr2=0x7f859015f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:30.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 -- 172.21.15.130:0/4268534213 shutdown_connections 2023-09-13T06:01:30.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.780+0000 7f8596693640 1 -- 172.21.15.130:0/4268534213 wait complete. 2023-09-13T06:01:30.804 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-09-13T06:01:30.537236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560753,"statfs":{"total":1600000000,"available":1598211172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000980"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319337+0000","last_change":"2023-09-13T06:01:26.333344+0000","last_active":"2023-09-13T06:01:27.319337+0000","last_peered":"2023-09-13T06:01:27.319337+0000","last_clean":"2023-09-13T06:01:27.319337+0000","last_became_active":"2023-09-13T06:01:26.333051+0000","last_became_peered":"2023-09-13T06:01:26.333051+0000","last_unstale":"2023-09-13T06:01:27.319337+0000","last_undegraded":"2023-09-13T06:01:27.319337+0000","last_fullsized":"2023-09-13T06:01:27.319337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:11:04.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315478+0000","last_change":"2023-09-13T06:01:26.335080+0000","last_active":"2023-09-13T06:01:27.315478+0000","last_peered":"2023-09-13T06:01:27.315478+0000","last_clean":"2023-09-13T06:01:27.315478+0000","last_became_active":"2023-09-13T06:01:26.334827+0000","last_became_peered":"2023-09-13T06:01:26.334827+0000","last_unstale":"2023-09-13T06:01:27.315478+0000","last_undegraded":"2023-09-13T06:01:27.315478+0000","last_fullsized":"2023-09-13T06:01:27.315478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965878+0000","last_change":"2023-09-13T06:01:26.326639+0000","last_active":"2023-09-13T06:01:27.965878+0000","last_peered":"2023-09-13T06:01:27.965878+0000","last_clean":"2023-09-13T06:01:27.965878+0000","last_became_active":"2023-09-13T06:01:26.326385+0000","last_became_peered":"2023-09-13T06:01:26.326385+0000","last_unstale":"2023-09-13T06:01:27.965878+0000","last_undegraded":"2023-09-13T06:01:27.965878+0000","last_fullsized":"2023-09-13T06:01:27.965878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:59:06.444621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319306+0000","last_change":"2023-09-13T06:01:26.333796+0000","last_active":"2023-09-13T06:01:27.319306+0000","last_peered":"2023-09-13T06:01:27.319306+0000","last_clean":"2023-09-13T06:01:27.319306+0000","last_became_active":"2023-09-13T06:01:26.333306+0000","last_became_peered":"2023-09-13T06:01:26.333306+0000","last_unstale":"2023-09-13T06:01:27.319306+0000","last_undegraded":"2023-09-13T06:01:27.319306+0000","last_fullsized":"2023-09-13T06:01:27.319306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319513+0000","last_change":"2023-09-13T06:01:26.328538+0000","last_active":"2023-09-13T06:01:27.319513+0000","last_peered":"2023-09-13T06:01:27.319513+0000","last_clean":"2023-09-13T06:01:27.319513+0000","last_became_active":"2023-09-13T06:01:26.328008+0000","last_became_peered":"2023-09-13T06:01:26.328008+0000","last_unstale":"2023-09-13T06:01:27.319513+0000","last_undegraded":"2023-09-13T06:01:27.319513+0000","last_fullsized":"2023-09-13T06:01:27.319513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:29:19.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320317+0000","last_change":"2023-09-13T06:01:26.341210+0000","last_active":"2023-09-13T06:01:27.320317+0000","last_peered":"2023-09-13T06:01:27.320317+0000","last_clean":"2023-09-13T06:01:27.320317+0000","last_became_active":"2023-09-13T06:01:26.339644+0000","last_became_peered":"2023-09-13T06:01:26.339644+0000","last_unstale":"2023-09-13T06:01:27.320317+0000","last_undegraded":"2023-09-13T06:01:27.320317+0000","last_fullsized":"2023-09-13T06:01:27.320317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:38:19.434161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319611+0000","last_change":"2023-09-13T06:01:26.324547+0000","last_active":"2023-09-13T06:01:27.319611+0000","last_peered":"2023-09-13T06:01:27.319611+0000","last_clean":"2023-09-13T06:01:27.319611+0000","last_became_active":"2023-09-13T06:01:26.324308+0000","last_became_peered":"2023-09-13T06:01:26.324308+0000","last_unstale":"2023-09-13T06:01:27.319611+0000","last_undegraded":"2023-09-13T06:01:27.319611+0000","last_fullsized":"2023-09-13T06:01:27.319611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:15:00.989410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.805874+0000","last_change":"2023-09-13T06:01:26.331698+0000","last_active":"2023-09-13T06:01:27.805874+0000","last_peered":"2023-09-13T06:01:27.805874+0000","last_clean":"2023-09-13T06:01:27.805874+0000","last_became_active":"2023-09-13T06:01:26.329837+0000","last_became_peered":"2023-09-13T06:01:26.329837+0000","last_unstale":"2023-09-13T06:01:27.805874+0000","last_undegraded":"2023-09-13T06:01:27.805874+0000","last_fullsized":"2023-09-13T06:01:27.805874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:58:51.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319235+0000","last_change":"2023-09-13T06:01:26.331694+0000","last_active":"2023-09-13T06:01:27.319235+0000","last_peered":"2023-09-13T06:01:27.319235+0000","last_clean":"2023-09-13T06:01:27.319235+0000","last_became_active":"2023-09-13T06:01:26.331505+0000","last_became_peered":"2023-09-13T06:01:26.331505+0000","last_unstale":"2023-09-13T06:01:27.319235+0000","last_undegraded":"2023-09-13T06:01:27.319235+0000","last_fullsized":"2023-09-13T06:01:27.319235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808896+0000","last_change":"2023-09-13T06:01:26.331322+0000","last_active":"2023-09-13T06:01:27.808896+0000","last_peered":"2023-09-13T06:01:27.808896+0000","last_clean":"2023-09-13T06:01:27.808896+0000","last_became_active":"2023-09-13T06:01:26.331079+0000","last_became_peered":"2023-09-13T06:01:26.331079+0000","last_unstale":"2023-09-13T06:01:27.808896+0000","last_undegraded":"2023-09-13T06:01:27.808896+0000","last_fullsized":"2023-09-13T06:01:27.808896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808761+0000","last_change":"2023-09-13T06:01:26.339806+0000","last_active":"2023-09-13T06:01:27.808761+0000","last_peered":"2023-09-13T06:01:27.808761+0000","last_clean":"2023-09-13T06:01:27.808761+0000","last_became_active":"2023-09-13T06:01:26.339569+0000","last_became_peered":"2023-09-13T06:01:26.339569+0000","last_unstale":"2023-09-13T06:01:27.808761+0000","last_undegraded":"2023-09-13T06:01:27.808761+0000","last_fullsized":"2023-09-13T06:01:27.808761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:48.181079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809508+0000","last_change":"2023-09-13T06:01:26.332707+0000","last_active":"2023-09-13T06:01:27.809508+0000","last_peered":"2023-09-13T06:01:27.809508+0000","last_clean":"2023-09-13T06:01:27.809508+0000","last_became_active":"2023-09-13T06:01:26.332461+0000","last_became_peered":"2023-09-13T06:01:26.332461+0000","last_unstale":"2023-09-13T06:01:27.809508+0000","last_undegraded":"2023-09-13T06:01:27.809508+0000","last_fullsized":"2023-09-13T06:01:27.809508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:10:32.024779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806240+0000","last_change":"2023-09-13T06:01:26.333127+0000","last_active":"2023-09-13T06:01:27.806240+0000","last_peered":"2023-09-13T06:01:27.806240+0000","last_clean":"2023-09-13T06:01:27.806240+0000","last_became_active":"2023-09-13T06:01:26.330284+0000","last_became_peered":"2023-09-13T06:01:26.330284+0000","last_unstale":"2023-09-13T06:01:27.806240+0000","last_undegraded":"2023-09-13T06:01:27.806240+0000","last_fullsized":"2023-09-13T06:01:27.806240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:48:35.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965662+0000","last_change":"2023-09-13T06:01:26.334244+0000","last_active":"2023-09-13T06:01:27.965662+0000","last_peered":"2023-09-13T06:01:27.965662+0000","last_clean":"2023-09-13T06:01:27.965662+0000","last_became_active":"2023-09-13T06:01:26.334017+0000","last_became_peered":"2023-09-13T06:01:26.334017+0000","last_unstale":"2023-09-13T06:01:27.965662+0000","last_undegraded":"2023-09-13T06:01:27.965662+0000","last_fullsized":"2023-09-13T06:01:27.965662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:58.618446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315608+0000","last_change":"2023-09-13T06:01:26.330534+0000","last_active":"2023-09-13T06:01:27.315608+0000","last_peered":"2023-09-13T06:01:27.315608+0000","last_clean":"2023-09-13T06:01:27.315608+0000","last_became_active":"2023-09-13T06:01:26.330217+0000","last_became_peered":"2023-09-13T06:01:26.330217+0000","last_unstale":"2023-09-13T06:01:27.315608+0000","last_undegraded":"2023-09-13T06:01:27.315608+0000","last_fullsized":"2023-09-13T06:01:27.315608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320169+0000","last_change":"2023-09-13T06:01:26.345029+0000","last_active":"2023-09-13T06:01:27.320169+0000","last_peered":"2023-09-13T06:01:27.320169+0000","last_clean":"2023-09-13T06:01:27.320169+0000","last_became_active":"2023-09-13T06:01:26.339981+0000","last_became_peered":"2023-09-13T06:01:26.339981+0000","last_unstale":"2023-09-13T06:01:27.320169+0000","last_undegraded":"2023-09-13T06:01:27.320169+0000","last_fullsized":"2023-09-13T06:01:27.320169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:28:12.855923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319961+0000","last_change":"2023-09-13T06:01:26.341104+0000","last_active":"2023-09-13T06:01:27.319961+0000","last_peered":"2023-09-13T06:01:27.319961+0000","last_clean":"2023-09-13T06:01:27.319961+0000","last_became_active":"2023-09-13T06:01:26.340321+0000","last_became_peered":"2023-09-13T06:01:26.340321+0000","last_unstale":"2023-09-13T06:01:27.319961+0000","last_undegraded":"2023-09-13T06:01:27.319961+0000","last_fullsized":"2023-09-13T06:01:27.319961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:11:04.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965436+0000","last_change":"2023-09-13T06:01:26.328850+0000","last_active":"2023-09-13T06:01:27.965436+0000","last_peered":"2023-09-13T06:01:27.965436+0000","last_clean":"2023-09-13T06:01:27.965436+0000","last_became_active":"2023-09-13T06:01:26.327736+0000","last_became_peered":"2023-09-13T06:01:26.327736+0000","last_unstale":"2023-09-13T06:01:27.965436+0000","last_undegraded":"2023-09-13T06:01:27.965436+0000","last_fullsized":"2023-09-13T06:01:27.965436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:17:44.656554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319631+0000","last_change":"2023-09-13T06:01:26.326473+0000","last_active":"2023-09-13T06:01:27.319631+0000","last_peered":"2023-09-13T06:01:27.319631+0000","last_clean":"2023-09-13T06:01:27.319631+0000","last_became_active":"2023-09-13T06:01:26.326160+0000","last_became_peered":"2023-09-13T06:01:26.326160+0000","last_unstale":"2023-09-13T06:01:27.319631+0000","last_undegraded":"2023-09-13T06:01:27.319631+0000","last_fullsized":"2023-09-13T06:01:27.319631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:58:01.089760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809040+0000","last_change":"2023-09-13T06:01:26.327947+0000","last_active":"2023-09-13T06:01:27.809040+0000","last_peered":"2023-09-13T06:01:27.809040+0000","last_clean":"2023-09-13T06:01:27.809040+0000","last_became_active":"2023-09-13T06:01:26.327715+0000","last_became_peered":"2023-09-13T06:01:26.327715+0000","last_unstale":"2023-09-13T06:01:27.809040+0000","last_undegraded":"2023-09-13T06:01:27.809040+0000","last_fullsized":"2023-09-13T06:01:27.809040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966133+0000","last_change":"2023-09-13T06:01:26.323975+0000","last_active":"2023-09-13T06:01:27.966133+0000","last_peered":"2023-09-13T06:01:27.966133+0000","last_clean":"2023-09-13T06:01:27.966133+0000","last_became_active":"2023-09-13T06:01:26.323393+0000","last_became_peered":"2023-09-13T06:01:26.323393+0000","last_unstale":"2023-09-13T06:01:27.966133+0000","last_undegraded":"2023-09-13T06:01:27.966133+0000","last_fullsized":"2023-09-13T06:01:27.966133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320252+0000","last_change":"2023-09-13T06:01:26.340839+0000","last_active":"2023-09-13T06:01:27.320252+0000","last_peered":"2023-09-13T06:01:27.320252+0000","last_clean":"2023-09-13T06:01:27.320252+0000","last_became_active":"2023-09-13T06:01:26.339668+0000","last_became_peered":"2023-09-13T06:01:26.339668+0000","last_unstale":"2023-09-13T06:01:27.320252+0000","last_undegraded":"2023-09-13T06:01:27.320252+0000","last_fullsized":"2023-09-13T06:01:27.320252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:15:00.989410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806314+0000","last_change":"2023-09-13T06:01:26.333609+0000","last_active":"2023-09-13T06:01:27.806314+0000","last_peered":"2023-09-13T06:01:27.806314+0000","last_clean":"2023-09-13T06:01:27.806314+0000","last_became_active":"2023-09-13T06:01:26.331440+0000","last_became_peered":"2023-09-13T06:01:26.331440+0000","last_unstale":"2023-09-13T06:01:27.806314+0000","last_undegraded":"2023-09-13T06:01:27.806314+0000","last_fullsized":"2023-09-13T06:01:27.806314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:29:19.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319441+0000","last_change":"2023-09-13T06:01:26.333660+0000","last_active":"2023-09-13T06:01:27.319441+0000","last_peered":"2023-09-13T06:01:27.319441+0000","last_clean":"2023-09-13T06:01:27.319441+0000","last_became_active":"2023-09-13T06:01:26.330349+0000","last_became_peered":"2023-09-13T06:01:26.330349+0000","last_unstale":"2023-09-13T06:01:27.319441+0000","last_undegraded":"2023-09-13T06:01:27.319441+0000","last_fullsized":"2023-09-13T06:01:27.319441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806080+0000","last_change":"2023-09-13T06:01:26.329053+0000","last_active":"2023-09-13T06:01:27.806080+0000","last_peered":"2023-09-13T06:01:27.806080+0000","last_clean":"2023-09-13T06:01:27.806080+0000","last_became_active":"2023-09-13T06:01:26.328820+0000","last_became_peered":"2023-09-13T06:01:26.328820+0000","last_unstale":"2023-09-13T06:01:27.806080+0000","last_undegraded":"2023-09-13T06:01:27.806080+0000","last_fullsized":"2023-09-13T06:01:27.806080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808935+0000","last_change":"2023-09-13T06:01:26.334326+0000","last_active":"2023-09-13T06:01:27.808935+0000","last_peered":"2023-09-13T06:01:27.808935+0000","last_clean":"2023-09-13T06:01:27.808935+0000","last_became_active":"2023-09-13T06:01:26.334009+0000","last_became_peered":"2023-09-13T06:01:26.334009+0000","last_unstale":"2023-09-13T06:01:27.808935+0000","last_undegraded":"2023-09-13T06:01:27.808935+0000","last_fullsized":"2023-09-13T06:01:27.808935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315617+0000","last_change":"2023-09-13T06:01:26.330022+0000","last_active":"2023-09-13T06:01:27.315617+0000","last_peered":"2023-09-13T06:01:27.315617+0000","last_clean":"2023-09-13T06:01:27.315617+0000","last_became_active":"2023-09-13T06:01:26.329781+0000","last_became_peered":"2023-09-13T06:01:26.329781+0000","last_unstale":"2023-09-13T06:01:27.315617+0000","last_undegraded":"2023-09-13T06:01:27.315617+0000","last_fullsized":"2023-09-13T06:01:27.315617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806025+0000","last_change":"2023-09-13T06:01:26.333470+0000","last_active":"2023-09-13T06:01:27.806025+0000","last_peered":"2023-09-13T06:01:27.806025+0000","last_clean":"2023-09-13T06:01:27.806025+0000","last_became_active":"2023-09-13T06:01:26.330564+0000","last_became_peered":"2023-09-13T06:01:26.330564+0000","last_unstale":"2023-09-13T06:01:27.806025+0000","last_undegraded":"2023-09-13T06:01:27.806025+0000","last_fullsized":"2023-09-13T06:01:27.806025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965817+0000","last_change":"2023-09-13T06:01:26.325229+0000","last_active":"2023-09-13T06:01:27.965817+0000","last_peered":"2023-09-13T06:01:27.965817+0000","last_clean":"2023-09-13T06:01:27.965817+0000","last_became_active":"2023-09-13T06:01:26.325006+0000","last_became_peered":"2023-09-13T06:01:26.325006+0000","last_unstale":"2023-09-13T06:01:27.965817+0000","last_undegraded":"2023-09-13T06:01:27.965817+0000","last_fullsized":"2023-09-13T06:01:27.965817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:34.829927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320125+0000","last_change":"2023-09-13T06:01:26.335419+0000","last_active":"2023-09-13T06:01:27.320125+0000","last_peered":"2023-09-13T06:01:27.320125+0000","last_clean":"2023-09-13T06:01:27.320125+0000","last_became_active":"2023-09-13T06:01:26.335145+0000","last_became_peered":"2023-09-13T06:01:26.335145+0000","last_unstale":"2023-09-13T06:01:27.320125+0000","last_undegraded":"2023-09-13T06:01:27.320125+0000","last_fullsized":"2023-09-13T06:01:27.320125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:29:19.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965454+0000","last_change":"2023-09-13T06:01:26.328581+0000","last_active":"2023-09-13T06:01:27.965454+0000","last_peered":"2023-09-13T06:01:27.965454+0000","last_clean":"2023-09-13T06:01:27.965454+0000","last_became_active":"2023-09-13T06:01:26.328353+0000","last_became_peered":"2023-09-13T06:01:26.328353+0000","last_unstale":"2023-09-13T06:01:27.965454+0000","last_undegraded":"2023-09-13T06:01:27.965454+0000","last_fullsized":"2023-09-13T06:01:27.965454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:48.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808879+0000","last_change":"2023-09-13T06:01:26.337762+0000","last_active":"2023-09-13T06:01:27.808879+0000","last_peered":"2023-09-13T06:01:27.808879+0000","last_clean":"2023-09-13T06:01:27.808879+0000","last_became_active":"2023-09-13T06:01:26.337497+0000","last_became_peered":"2023-09-13T06:01:26.337497+0000","last_unstale":"2023-09-13T06:01:27.808879+0000","last_undegraded":"2023-09-13T06:01:27.808879+0000","last_fullsized":"2023-09-13T06:01:27.808879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:58:51.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809270+0000","last_change":"2023-09-13T06:01:26.325877+0000","last_active":"2023-09-13T06:01:27.809270+0000","last_peered":"2023-09-13T06:01:27.809270+0000","last_clean":"2023-09-13T06:01:27.809270+0000","last_became_active":"2023-09-13T06:01:26.325578+0000","last_became_peered":"2023-09-13T06:01:26.325578+0000","last_unstale":"2023-09-13T06:01:27.809270+0000","last_undegraded":"2023-09-13T06:01:27.809270+0000","last_fullsized":"2023-09-13T06:01:27.809270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:51.136511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806375+0000","last_change":"2023-09-13T06:01:25.324046+0000","last_active":"2023-09-13T06:01:27.806375+0000","last_peered":"2023-09-13T06:01:27.806375+0000","last_clean":"2023-09-13T06:01:27.806375+0000","last_became_active":"2023-09-13T06:01:25.323829+0000","last_became_peered":"2023-09-13T06:01:25.323829+0000","last_unstale":"2023-09-13T06:01:27.806375+0000","last_undegraded":"2023-09-13T06:01:27.806375+0000","last_fullsized":"2023-09-13T06:01:27.806375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:33.818510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965953+0000","last_change":"2023-09-13T06:01:26.334351+0000","last_active":"2023-09-13T06:01:27.965953+0000","last_peered":"2023-09-13T06:01:27.965953+0000","last_clean":"2023-09-13T06:01:27.965953+0000","last_became_active":"2023-09-13T06:01:26.329714+0000","last_became_peered":"2023-09-13T06:01:26.329714+0000","last_unstale":"2023-09-13T06:01:27.965953+0000","last_undegraded":"2023-09-13T06:01:27.965953+0000","last_fullsized":"2023-09-13T06:01:27.965953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:48.181079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809119+0000","last_change":"2023-09-13T06:01:25.331427+0000","last_active":"2023-09-13T06:01:27.809119+0000","last_peered":"2023-09-13T06:01:27.809119+0000","last_clean":"2023-09-13T06:01:27.809119+0000","last_became_active":"2023-09-13T06:01:25.331196+0000","last_became_peered":"2023-09-13T06:01:25.331196+0000","last_unstale":"2023-09-13T06:01:27.809119+0000","last_undegraded":"2023-09-13T06:01:27.809119+0000","last_fullsized":"2023-09-13T06:01:27.809119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:31:37.760882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806462+0000","last_change":"2023-09-13T06:01:25.327153+0000","last_active":"2023-09-13T06:01:27.806462+0000","last_peered":"2023-09-13T06:01:27.806462+0000","last_clean":"2023-09-13T06:01:27.806462+0000","last_became_active":"2023-09-13T06:01:25.326762+0000","last_became_peered":"2023-09-13T06:01:25.326762+0000","last_unstale":"2023-09-13T06:01:27.806462+0000","last_undegraded":"2023-09-13T06:01:27.806462+0000","last_fullsized":"2023-09-13T06:01:27.806462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:47.262828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806195+0000","last_change":"2023-09-13T06:01:26.323756+0000","last_active":"2023-09-13T06:01:27.806195+0000","last_peered":"2023-09-13T06:01:27.806195+0000","last_clean":"2023-09-13T06:01:27.806195+0000","last_became_active":"2023-09-13T06:01:26.323531+0000","last_became_peered":"2023-09-13T06:01:26.323531+0000","last_unstale":"2023-09-13T06:01:27.806195+0000","last_undegraded":"2023-09-13T06:01:27.806195+0000","last_fullsized":"2023-09-13T06:01:27.806195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320387+0000","last_change":"2023-09-13T06:01:25.330633+0000","last_active":"2023-09-13T06:01:27.320387+0000","last_peered":"2023-09-13T06:01:27.320387+0000","last_clean":"2023-09-13T06:01:27.320387+0000","last_became_active":"2023-09-13T06:01:25.330453+0000","last_became_peered":"2023-09-13T06:01:25.330453+0000","last_unstale":"2023-09-13T06:01:27.320387+0000","last_undegraded":"2023-09-13T06:01:27.320387+0000","last_fullsized":"2023-09-13T06:01:27.320387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315478+0000","last_change":"2023-09-13T06:01:26.330324+0000","last_active":"2023-09-13T06:01:27.315478+0000","last_peered":"2023-09-13T06:01:27.315478+0000","last_clean":"2023-09-13T06:01:27.315478+0000","last_became_active":"2023-09-13T06:01:26.330079+0000","last_became_peered":"2023-09-13T06:01:26.330079+0000","last_unstale":"2023-09-13T06:01:27.315478+0000","last_undegraded":"2023-09-13T06:01:27.315478+0000","last_fullsized":"2023-09-13T06:01:27.315478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809135+0000","last_change":"2023-09-13T06:01:25.329518+0000","last_active":"2023-09-13T06:01:27.809135+0000","last_peered":"2023-09-13T06:01:27.809135+0000","last_clean":"2023-09-13T06:01:27.809135+0000","last_became_active":"2023-09-13T06:01:25.329317+0000","last_became_peered":"2023-09-13T06:01:25.329317+0000","last_unstale":"2023-09-13T06:01:27.809135+0000","last_undegraded":"2023-09-13T06:01:27.809135+0000","last_fullsized":"2023-09-13T06:01:27.809135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:47.262828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320109+0000","last_change":"2023-09-13T06:01:26.340978+0000","last_active":"2023-09-13T06:01:27.320109+0000","last_peered":"2023-09-13T06:01:27.320109+0000","last_clean":"2023-09-13T06:01:27.320109+0000","last_became_active":"2023-09-13T06:01:26.339989+0000","last_became_peered":"2023-09-13T06:01:26.339989+0000","last_unstale":"2023-09-13T06:01:27.320109+0000","last_undegraded":"2023-09-13T06:01:27.320109+0000","last_fullsized":"2023-09-13T06:01:27.320109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:48:35.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320582+0000","last_change":"2023-09-13T06:01:25.327969+0000","last_active":"2023-09-13T06:01:27.320582+0000","last_peered":"2023-09-13T06:01:27.320582+0000","last_clean":"2023-09-13T06:01:27.320582+0000","last_became_active":"2023-09-13T06:01:25.327745+0000","last_became_peered":"2023-09-13T06:01:25.327745+0000","last_unstale":"2023-09-13T06:01:27.320582+0000","last_undegraded":"2023-09-13T06:01:27.320582+0000","last_fullsized":"2023-09-13T06:01:27.320582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:15.433409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966320+0000","last_change":"2023-09-13T06:01:26.329050+0000","last_active":"2023-09-13T06:01:27.966320+0000","last_peered":"2023-09-13T06:01:27.966320+0000","last_clean":"2023-09-13T06:01:27.966320+0000","last_became_active":"2023-09-13T06:01:26.328702+0000","last_became_peered":"2023-09-13T06:01:26.328702+0000","last_unstale":"2023-09-13T06:01:27.966320+0000","last_undegraded":"2023-09-13T06:01:27.966320+0000","last_fullsized":"2023-09-13T06:01:27.966320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315627+0000","last_change":"2023-09-13T06:01:25.322271+0000","last_active":"2023-09-13T06:01:27.315627+0000","last_peered":"2023-09-13T06:01:27.315627+0000","last_clean":"2023-09-13T06:01:27.315627+0000","last_became_active":"2023-09-13T06:01:25.322054+0000","last_became_peered":"2023-09-13T06:01:25.322054+0000","last_unstale":"2023-09-13T06:01:27.315627+0000","last_undegraded":"2023-09-13T06:01:27.315627+0000","last_fullsized":"2023-09-13T06:01:27.315627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809078+0000","last_change":"2023-09-13T06:01:26.322689+0000","last_active":"2023-09-13T06:01:27.809078+0000","last_peered":"2023-09-13T06:01:27.809078+0000","last_clean":"2023-09-13T06:01:27.809078+0000","last_became_active":"2023-09-13T06:01:26.322426+0000","last_became_peered":"2023-09-13T06:01:26.322426+0000","last_unstale":"2023-09-13T06:01:27.809078+0000","last_undegraded":"2023-09-13T06:01:27.809078+0000","last_fullsized":"2023-09-13T06:01:27.809078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:25:38.110206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809241+0000","last_change":"2023-09-13T06:01:25.329417+0000","last_active":"2023-09-13T06:01:27.809241+0000","last_peered":"2023-09-13T06:01:27.809241+0000","last_clean":"2023-09-13T06:01:27.809241+0000","last_became_active":"2023-09-13T06:01:25.329200+0000","last_became_peered":"2023-09-13T06:01:25.329200+0000","last_unstale":"2023-09-13T06:01:27.809241+0000","last_undegraded":"2023-09-13T06:01:27.809241+0000","last_fullsized":"2023-09-13T06:01:27.809241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:50.125094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319246+0000","last_change":"2023-09-13T06:01:26.329074+0000","last_active":"2023-09-13T06:01:27.319246+0000","last_peered":"2023-09-13T06:01:27.319246+0000","last_clean":"2023-09-13T06:01:27.319246+0000","last_became_active":"2023-09-13T06:01:26.328843+0000","last_became_peered":"2023-09-13T06:01:26.328843+0000","last_unstale":"2023-09-13T06:01:27.319246+0000","last_undegraded":"2023-09-13T06:01:27.319246+0000","last_fullsized":"2023-09-13T06:01:27.319246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966042+0000","last_change":"2023-09-13T06:01:25.319809+0000","last_active":"2023-09-13T06:01:27.966042+0000","last_peered":"2023-09-13T06:01:27.966042+0000","last_clean":"2023-09-13T06:01:27.966042+0000","last_became_active":"2023-09-13T06:01:25.319148+0000","last_became_peered":"2023-09-13T06:01:25.319148+0000","last_unstale":"2023-09-13T06:01:27.966042+0000","last_undegraded":"2023-09-13T06:01:27.966042+0000","last_fullsized":"2023-09-13T06:01:27.966042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:41:41.340256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966432+0000","last_change":"2023-09-13T06:01:26.324115+0000","last_active":"2023-09-13T06:01:27.966432+0000","last_peered":"2023-09-13T06:01:27.966432+0000","last_clean":"2023-09-13T06:01:27.966432+0000","last_became_active":"2023-09-13T06:01:26.323734+0000","last_became_peered":"2023-09-13T06:01:26.323734+0000","last_unstale":"2023-09-13T06:01:27.966432+0000","last_undegraded":"2023-09-13T06:01:27.966432+0000","last_fullsized":"2023-09-13T06:01:27.966432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320680+0000","last_change":"2023-09-13T06:01:25.325570+0000","last_active":"2023-09-13T06:01:27.320680+0000","last_peered":"2023-09-13T06:01:27.320680+0000","last_clean":"2023-09-13T06:01:27.320680+0000","last_became_active":"2023-09-13T06:01:25.324812+0000","last_became_peered":"2023-09-13T06:01:25.324812+0000","last_unstale":"2023-09-13T06:01:27.320680+0000","last_undegraded":"2023-09-13T06:01:27.320680+0000","last_fullsized":"2023-09-13T06:01:27.320680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320096+0000","last_change":"2023-09-13T06:01:26.328241+0000","last_active":"2023-09-13T06:01:27.320096+0000","last_peered":"2023-09-13T06:01:27.320096+0000","last_clean":"2023-09-13T06:01:27.320096+0000","last_became_active":"2023-09-13T06:01:26.327377+0000","last_became_peered":"2023-09-13T06:01:26.327377+0000","last_unstale":"2023-09-13T06:01:27.320096+0000","last_undegraded":"2023-09-13T06:01:27.320096+0000","last_fullsized":"2023-09-13T06:01:27.320096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:55:18.039565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808993+0000","last_change":"2023-09-13T06:01:25.332107+0000","last_active":"2023-09-13T06:01:27.808993+0000","last_peered":"2023-09-13T06:01:27.808993+0000","last_clean":"2023-09-13T06:01:27.808993+0000","last_became_active":"2023-09-13T06:01:25.331836+0000","last_became_peered":"2023-09-13T06:01:25.331836+0000","last_unstale":"2023-09-13T06:01:27.808993+0000","last_undegraded":"2023-09-13T06:01:27.808993+0000","last_fullsized":"2023-09-13T06:01:27.808993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808997+0000","last_change":"2023-09-13T06:01:26.337809+0000","last_active":"2023-09-13T06:01:27.808997+0000","last_peered":"2023-09-13T06:01:27.808997+0000","last_clean":"2023-09-13T06:01:27.808997+0000","last_became_active":"2023-09-13T06:01:26.337559+0000","last_became_peered":"2023-09-13T06:01:26.337559+0000","last_unstale":"2023-09-13T06:01:27.808997+0000","last_undegraded":"2023-09-13T06:01:27.808997+0000","last_fullsized":"2023-09-13T06:01:27.808997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965494+0000","last_change":"2023-09-13T06:01:25.320451+0000","last_active":"2023-09-13T06:01:27.965494+0000","last_peered":"2023-09-13T06:01:27.965494+0000","last_clean":"2023-09-13T06:01:27.965494+0000","last_became_active":"2023-09-13T06:01:25.320217+0000","last_became_peered":"2023-09-13T06:01:25.320217+0000","last_unstale":"2023-09-13T06:01:27.965494+0000","last_undegraded":"2023-09-13T06:01:27.965494+0000","last_fullsized":"2023-09-13T06:01:27.965494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:33.630260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319870+0000","last_change":"2023-09-13T06:01:26.325346+0000","last_active":"2023-09-13T06:01:27.319870+0000","last_peered":"2023-09-13T06:01:27.319870+0000","last_clean":"2023-09-13T06:01:27.319870+0000","last_became_active":"2023-09-13T06:01:26.325127+0000","last_became_peered":"2023-09-13T06:01:26.325127+0000","last_unstale":"2023-09-13T06:01:27.319870+0000","last_undegraded":"2023-09-13T06:01:27.319870+0000","last_fullsized":"2023-09-13T06:01:27.319870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:38:19.434161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809186+0000","last_change":"2023-09-13T06:01:25.326201+0000","last_active":"2023-09-13T06:01:27.809186+0000","last_peered":"2023-09-13T06:01:27.809186+0000","last_clean":"2023-09-13T06:01:27.809186+0000","last_became_active":"2023-09-13T06:01:25.324763+0000","last_became_peered":"2023-09-13T06:01:25.324763+0000","last_unstale":"2023-09-13T06:01:27.809186+0000","last_undegraded":"2023-09-13T06:01:27.809186+0000","last_fullsized":"2023-09-13T06:01:27.809186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:46:54.289271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320219+0000","last_change":"2023-09-13T06:01:26.328389+0000","last_active":"2023-09-13T06:01:27.320219+0000","last_peered":"2023-09-13T06:01:27.320219+0000","last_clean":"2023-09-13T06:01:27.320219+0000","last_became_active":"2023-09-13T06:01:26.327693+0000","last_became_peered":"2023-09-13T06:01:26.327693+0000","last_unstale":"2023-09-13T06:01:27.320219+0000","last_undegraded":"2023-09-13T06:01:27.320219+0000","last_fullsized":"2023-09-13T06:01:27.320219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:01:51.436754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965654+0000","last_change":"2023-09-13T06:01:25.313660+0000","last_active":"2023-09-13T06:01:27.965654+0000","last_peered":"2023-09-13T06:01:27.965654+0000","last_clean":"2023-09-13T06:01:27.965654+0000","last_became_active":"2023-09-13T06:01:25.313419+0000","last_became_peered":"2023-09-13T06:01:25.313419+0000","last_unstale":"2023-09-13T06:01:27.965654+0000","last_undegraded":"2023-09-13T06:01:27.965654+0000","last_fullsized":"2023-09-13T06:01:27.965654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:25:37.098788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319396+0000","last_change":"2023-09-13T06:01:26.324978+0000","last_active":"2023-09-13T06:01:27.319396+0000","last_peered":"2023-09-13T06:01:27.319396+0000","last_clean":"2023-09-13T06:01:27.319396+0000","last_became_active":"2023-09-13T06:01:26.324731+0000","last_became_peered":"2023-09-13T06:01:26.324731+0000","last_unstale":"2023-09-13T06:01:27.319396+0000","last_undegraded":"2023-09-13T06:01:27.319396+0000","last_fullsized":"2023-09-13T06:01:27.319396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:48:35.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315501+0000","last_change":"2023-09-13T06:01:25.327454+0000","last_active":"2023-09-13T06:01:27.315501+0000","last_peered":"2023-09-13T06:01:27.315501+0000","last_clean":"2023-09-13T06:01:27.315501+0000","last_became_active":"2023-09-13T06:01:25.327226+0000","last_became_peered":"2023-09-13T06:01:25.327226+0000","last_unstale":"2023-09-13T06:01:27.315501+0000","last_undegraded":"2023-09-13T06:01:27.315501+0000","last_fullsized":"2023-09-13T06:01:27.315501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:47.169662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320376+0000","last_change":"2023-09-13T06:01:26.341240+0000","last_active":"2023-09-13T06:01:27.320376+0000","last_peered":"2023-09-13T06:01:27.320376+0000","last_clean":"2023-09-13T06:01:27.320376+0000","last_became_active":"2023-09-13T06:01:26.340624+0000","last_became_peered":"2023-09-13T06:01:26.340624+0000","last_unstale":"2023-09-13T06:01:27.320376+0000","last_undegraded":"2023-09-13T06:01:27.320376+0000","last_fullsized":"2023-09-13T06:01:27.320376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:55:18.039565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965359+0000","last_change":"2023-09-13T06:01:25.315904+0000","last_active":"2023-09-13T06:01:27.965359+0000","last_peered":"2023-09-13T06:01:27.965359+0000","last_clean":"2023-09-13T06:01:27.965359+0000","last_became_active":"2023-09-13T06:01:25.315623+0000","last_became_peered":"2023-09-13T06:01:25.315623+0000","last_unstale":"2023-09-13T06:01:27.965359+0000","last_undegraded":"2023-09-13T06:01:27.965359+0000","last_fullsized":"2023-09-13T06:01:27.965359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:05:14.637076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319571+0000","last_change":"2023-09-13T06:01:26.330623+0000","last_active":"2023-09-13T06:01:27.319571+0000","last_peered":"2023-09-13T06:01:27.319571+0000","last_clean":"2023-09-13T06:01:27.319571+0000","last_became_active":"2023-09-13T06:01:26.330401+0000","last_became_peered":"2023-09-13T06:01:26.330401+0000","last_unstale":"2023-09-13T06:01:27.319571+0000","last_undegraded":"2023-09-13T06:01:27.319571+0000","last_fullsized":"2023-09-13T06:01:27.319571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:28:12.855923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T06:01:26.321189+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:01:26.321189+0000","last_peered":"2023-09-13T06:01:26.321189+0000","last_clean":"2023-09-13T06:01:26.321189+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:01:26.321189+0000","last_undegraded":"2023-09-13T06:01:26.321189+0000","last_fullsized":"2023-09-13T06:01:26.321189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320821+0000","last_change":"2023-09-13T06:01:25.325043+0000","last_active":"2023-09-13T06:01:27.320821+0000","last_peered":"2023-09-13T06:01:27.320821+0000","last_clean":"2023-09-13T06:01:27.320821+0000","last_became_active":"2023-09-13T06:01:25.324510+0000","last_became_peered":"2023-09-13T06:01:25.324510+0000","last_unstale":"2023-09-13T06:01:27.320821+0000","last_undegraded":"2023-09-13T06:01:27.320821+0000","last_fullsized":"2023-09-13T06:01:27.320821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806211+0000","last_change":"2023-09-13T06:01:26.339163+0000","last_active":"2023-09-13T06:01:27.806211+0000","last_peered":"2023-09-13T06:01:27.806211+0000","last_clean":"2023-09-13T06:01:27.806211+0000","last_became_active":"2023-09-13T06:01:26.338911+0000","last_became_peered":"2023-09-13T06:01:26.338911+0000","last_unstale":"2023-09-13T06:01:27.806211+0000","last_undegraded":"2023-09-13T06:01:27.806211+0000","last_fullsized":"2023-09-13T06:01:27.806211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:11:04.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319837+0000","last_change":"2023-09-13T06:01:25.325759+0000","last_active":"2023-09-13T06:01:27.319837+0000","last_peered":"2023-09-13T06:01:27.319837+0000","last_clean":"2023-09-13T06:01:27.319837+0000","last_became_active":"2023-09-13T06:01:25.325487+0000","last_became_peered":"2023-09-13T06:01:25.325487+0000","last_unstale":"2023-09-13T06:01:27.319837+0000","last_undegraded":"2023-09-13T06:01:27.319837+0000","last_fullsized":"2023-09-13T06:01:27.319837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:33.818510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966209+0000","last_change":"2023-09-13T06:01:26.333513+0000","last_active":"2023-09-13T06:01:27.966209+0000","last_peered":"2023-09-13T06:01:27.966209+0000","last_clean":"2023-09-13T06:01:27.966209+0000","last_became_active":"2023-09-13T06:01:26.333293+0000","last_became_peered":"2023-09-13T06:01:26.333293+0000","last_unstale":"2023-09-13T06:01:27.966209+0000","last_undegraded":"2023-09-13T06:01:27.966209+0000","last_fullsized":"2023-09-13T06:01:27.966209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965541+0000","last_change":"2023-09-13T06:01:25.314117+0000","last_active":"2023-09-13T06:01:27.965541+0000","last_peered":"2023-09-13T06:01:27.965541+0000","last_clean":"2023-09-13T06:01:27.965541+0000","last_became_active":"2023-09-13T06:01:25.313885+0000","last_became_peered":"2023-09-13T06:01:25.313885+0000","last_unstale":"2023-09-13T06:01:27.965541+0000","last_undegraded":"2023-09-13T06:01:27.965541+0000","last_fullsized":"2023-09-13T06:01:27.965541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:31:37.760882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315617+0000","last_change":"2023-09-13T06:01:26.326308+0000","last_active":"2023-09-13T06:01:27.315617+0000","last_peered":"2023-09-13T06:01:27.315617+0000","last_clean":"2023-09-13T06:01:27.315617+0000","last_became_active":"2023-09-13T06:01:26.326046+0000","last_became_peered":"2023-09-13T06:01:26.326046+0000","last_unstale":"2023-09-13T06:01:27.315617+0000","last_undegraded":"2023-09-13T06:01:27.315617+0000","last_fullsized":"2023-09-13T06:01:27.315617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320661+0000","last_change":"2023-09-13T06:01:25.322672+0000","last_active":"2023-09-13T06:01:27.320661+0000","last_peered":"2023-09-13T06:01:27.320661+0000","last_clean":"2023-09-13T06:01:27.320661+0000","last_became_active":"2023-09-13T06:01:25.320702+0000","last_became_peered":"2023-09-13T06:01:25.320702+0000","last_unstale":"2023-09-13T06:01:27.320661+0000","last_undegraded":"2023-09-13T06:01:27.320661+0000","last_fullsized":"2023-09-13T06:01:27.320661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:55.322422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809580+0000","last_change":"2023-09-13T06:01:26.331164+0000","last_active":"2023-09-13T06:01:27.809580+0000","last_peered":"2023-09-13T06:01:27.809580+0000","last_clean":"2023-09-13T06:01:27.809580+0000","last_became_active":"2023-09-13T06:01:26.330506+0000","last_became_peered":"2023-09-13T06:01:26.330506+0000","last_unstale":"2023-09-13T06:01:27.809580+0000","last_undegraded":"2023-09-13T06:01:27.809580+0000","last_fullsized":"2023-09-13T06:01:27.809580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:17:44.656554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315694+0000","last_change":"2023-09-13T06:01:25.325846+0000","last_active":"2023-09-13T06:01:27.315694+0000","last_peered":"2023-09-13T06:01:27.315694+0000","last_clean":"2023-09-13T06:01:27.315694+0000","last_became_active":"2023-09-13T06:01:25.325644+0000","last_became_peered":"2023-09-13T06:01:25.325644+0000","last_unstale":"2023-09-13T06:01:27.315694+0000","last_undegraded":"2023-09-13T06:01:27.315694+0000","last_fullsized":"2023-09-13T06:01:27.315694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319787+0000","last_change":"2023-09-13T06:01:26.333532+0000","last_active":"2023-09-13T06:01:27.319787+0000","last_peered":"2023-09-13T06:01:27.319787+0000","last_clean":"2023-09-13T06:01:27.319787+0000","last_became_active":"2023-09-13T06:01:26.329944+0000","last_became_peered":"2023-09-13T06:01:26.329944+0000","last_unstale":"2023-09-13T06:01:27.319787+0000","last_undegraded":"2023-09-13T06:01:27.319787+0000","last_fullsized":"2023-09-13T06:01:27.319787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319736+0000","last_change":"2023-09-13T06:01:25.322217+0000","last_active":"2023-09-13T06:01:27.319736+0000","last_peered":"2023-09-13T06:01:27.319736+0000","last_clean":"2023-09-13T06:01:27.319736+0000","last_became_active":"2023-09-13T06:01:25.321988+0000","last_became_peered":"2023-09-13T06:01:25.321988+0000","last_unstale":"2023-09-13T06:01:27.319736+0000","last_undegraded":"2023-09-13T06:01:27.319736+0000","last_fullsized":"2023-09-13T06:01:27.319736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315502+0000","last_change":"2023-09-13T06:01:26.326151+0000","last_active":"2023-09-13T06:01:27.315502+0000","last_peered":"2023-09-13T06:01:27.315502+0000","last_clean":"2023-09-13T06:01:27.315502+0000","last_became_active":"2023-09-13T06:01:26.325878+0000","last_became_peered":"2023-09-13T06:01:26.325878+0000","last_unstale":"2023-09-13T06:01:27.315502+0000","last_undegraded":"2023-09-13T06:01:27.315502+0000","last_fullsized":"2023-09-13T06:01:27.315502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315723+0000","last_change":"2023-09-13T06:01:25.325195+0000","last_active":"2023-09-13T06:01:27.315723+0000","last_peered":"2023-09-13T06:01:27.315723+0000","last_clean":"2023-09-13T06:01:27.315723+0000","last_became_active":"2023-09-13T06:01:25.324980+0000","last_became_peered":"2023-09-13T06:01:25.324980+0000","last_unstale":"2023-09-13T06:01:27.315723+0000","last_undegraded":"2023-09-13T06:01:27.315723+0000","last_fullsized":"2023-09-13T06:01:27.315723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806073+0000","last_change":"2023-09-13T06:01:26.328056+0000","last_active":"2023-09-13T06:01:27.806073+0000","last_peered":"2023-09-13T06:01:27.806073+0000","last_clean":"2023-09-13T06:01:27.806073+0000","last_became_active":"2023-09-13T06:01:26.327839+0000","last_became_peered":"2023-09-13T06:01:26.327839+0000","last_unstale":"2023-09-13T06:01:27.806073+0000","last_undegraded":"2023-09-13T06:01:27.806073+0000","last_fullsized":"2023-09-13T06:01:27.806073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809114+0000","last_change":"2023-09-13T06:01:25.330413+0000","last_active":"2023-09-13T06:01:27.809114+0000","last_peered":"2023-09-13T06:01:27.809114+0000","last_clean":"2023-09-13T06:01:27.809114+0000","last_became_active":"2023-09-13T06:01:25.330136+0000","last_became_peered":"2023-09-13T06:01:25.330136+0000","last_unstale":"2023-09-13T06:01:27.809114+0000","last_undegraded":"2023-09-13T06:01:27.809114+0000","last_fullsized":"2023-09-13T06:01:27.809114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966012+0000","last_change":"2023-09-13T06:01:26.333975+0000","last_active":"2023-09-13T06:01:27.966012+0000","last_peered":"2023-09-13T06:01:27.966012+0000","last_clean":"2023-09-13T06:01:27.966012+0000","last_became_active":"2023-09-13T06:01:26.333731+0000","last_became_peered":"2023-09-13T06:01:26.333731+0000","last_unstale":"2023-09-13T06:01:27.966012+0000","last_undegraded":"2023-09-13T06:01:27.966012+0000","last_fullsized":"2023-09-13T06:01:27.966012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:58:51.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319841+0000","last_change":"2023-09-13T06:01:25.329786+0000","last_active":"2023-09-13T06:01:27.319841+0000","last_peered":"2023-09-13T06:01:27.319841+0000","last_clean":"2023-09-13T06:01:27.319841+0000","last_became_active":"2023-09-13T06:01:25.329314+0000","last_became_peered":"2023-09-13T06:01:25.329314+0000","last_unstale":"2023-09-13T06:01:27.319841+0000","last_undegraded":"2023-09-13T06:01:27.319841+0000","last_fullsized":"2023-09-13T06:01:27.319841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809904+0000","last_change":"2023-09-13T06:01:26.329060+0000","last_active":"2023-09-13T06:01:27.809904+0000","last_peered":"2023-09-13T06:01:27.809904+0000","last_clean":"2023-09-13T06:01:27.809904+0000","last_became_active":"2023-09-13T06:01:26.328817+0000","last_became_peered":"2023-09-13T06:01:26.328817+0000","last_unstale":"2023-09-13T06:01:27.809904+0000","last_undegraded":"2023-09-13T06:01:27.809904+0000","last_fullsized":"2023-09-13T06:01:27.809904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:48.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315653+0000","last_change":"2023-09-13T06:01:25.328158+0000","last_active":"2023-09-13T06:01:27.315653+0000","last_peered":"2023-09-13T06:01:27.315653+0000","last_clean":"2023-09-13T06:01:27.315653+0000","last_became_active":"2023-09-13T06:01:25.327904+0000","last_became_peered":"2023-09-13T06:01:25.327904+0000","last_unstale":"2023-09-13T06:01:27.315653+0000","last_undegraded":"2023-09-13T06:01:27.315653+0000","last_fullsized":"2023-09-13T06:01:27.315653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:47.262828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806021+0000","last_change":"2023-09-13T06:01:26.326068+0000","last_active":"2023-09-13T06:01:27.806021+0000","last_peered":"2023-09-13T06:01:27.806021+0000","last_clean":"2023-09-13T06:01:27.806021+0000","last_became_active":"2023-09-13T06:01:26.325841+0000","last_became_peered":"2023-09-13T06:01:26.325841+0000","last_unstale":"2023-09-13T06:01:27.806021+0000","last_undegraded":"2023-09-13T06:01:27.806021+0000","last_fullsized":"2023-09-13T06:01:27.806021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315703+0000","last_change":"2023-09-13T06:01:25.326680+0000","last_active":"2023-09-13T06:01:27.315703+0000","last_peered":"2023-09-13T06:01:27.315703+0000","last_clean":"2023-09-13T06:01:27.315703+0000","last_became_active":"2023-09-13T06:01:25.326499+0000","last_became_peered":"2023-09-13T06:01:25.326499+0000","last_unstale":"2023-09-13T06:01:27.315703+0000","last_undegraded":"2023-09-13T06:01:27.315703+0000","last_fullsized":"2023-09-13T06:01:27.315703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:50.125094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806117+0000","last_change":"2023-09-13T06:01:26.325317+0000","last_active":"2023-09-13T06:01:27.806117+0000","last_peered":"2023-09-13T06:01:27.806117+0000","last_clean":"2023-09-13T06:01:27.806117+0000","last_became_active":"2023-09-13T06:01:26.325092+0000","last_became_peered":"2023-09-13T06:01:26.325092+0000","last_unstale":"2023-09-13T06:01:27.806117+0000","last_undegraded":"2023-09-13T06:01:27.806117+0000","last_fullsized":"2023-09-13T06:01:27.806117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319376+0000","last_change":"2023-09-13T06:01:25.324793+0000","last_active":"2023-09-13T06:01:27.319376+0000","last_peered":"2023-09-13T06:01:27.319376+0000","last_clean":"2023-09-13T06:01:27.319376+0000","last_became_active":"2023-09-13T06:01:25.324563+0000","last_became_peered":"2023-09-13T06:01:25.324563+0000","last_unstale":"2023-09-13T06:01:27.319376+0000","last_undegraded":"2023-09-13T06:01:27.319376+0000","last_fullsized":"2023-09-13T06:01:27.319376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:47.169662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809187+0000","last_change":"2023-09-13T06:01:26.333372+0000","last_active":"2023-09-13T06:01:27.809187+0000","last_peered":"2023-09-13T06:01:27.809187+0000","last_clean":"2023-09-13T06:01:27.809187+0000","last_became_active":"2023-09-13T06:01:26.333089+0000","last_became_peered":"2023-09-13T06:01:26.333089+0000","last_unstale":"2023-09-13T06:01:27.809187+0000","last_undegraded":"2023-09-13T06:01:27.809187+0000","last_fullsized":"2023-09-13T06:01:27.809187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320283+0000","last_change":"2023-09-13T06:01:26.334900+0000","last_active":"2023-09-13T06:01:27.320283+0000","last_peered":"2023-09-13T06:01:27.320283+0000","last_clean":"2023-09-13T06:01:27.320283+0000","last_became_active":"2023-09-13T06:01:26.334542+0000","last_became_peered":"2023-09-13T06:01:26.334542+0000","last_unstale":"2023-09-13T06:01:27.320283+0000","last_undegraded":"2023-09-13T06:01:27.320283+0000","last_fullsized":"2023-09-13T06:01:27.320283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:58:01.089760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319759+0000","last_change":"2023-09-13T06:01:25.323574+0000","last_active":"2023-09-13T06:01:27.319759+0000","last_peered":"2023-09-13T06:01:27.319759+0000","last_clean":"2023-09-13T06:01:27.319759+0000","last_became_active":"2023-09-13T06:01:25.323254+0000","last_became_peered":"2023-09-13T06:01:25.323254+0000","last_unstale":"2023-09-13T06:01:27.319759+0000","last_undegraded":"2023-09-13T06:01:27.319759+0000","last_fullsized":"2023-09-13T06:01:27.319759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320461+0000","last_change":"2023-09-13T06:01:26.340520+0000","last_active":"2023-09-13T06:01:27.320461+0000","last_peered":"2023-09-13T06:01:27.320461+0000","last_clean":"2023-09-13T06:01:27.320461+0000","last_became_active":"2023-09-13T06:01:26.335635+0000","last_became_peered":"2023-09-13T06:01:26.335635+0000","last_unstale":"2023-09-13T06:01:27.320461+0000","last_undegraded":"2023-09-13T06:01:27.320461+0000","last_fullsized":"2023-09-13T06:01:27.320461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:01:51.436754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320313+0000","last_change":"2023-09-13T06:01:25.327861+0000","last_active":"2023-09-13T06:01:27.320313+0000","last_peered":"2023-09-13T06:01:27.320313+0000","last_clean":"2023-09-13T06:01:27.320313+0000","last_became_active":"2023-09-13T06:01:25.327612+0000","last_became_peered":"2023-09-13T06:01:25.327612+0000","last_unstale":"2023-09-13T06:01:27.320313+0000","last_undegraded":"2023-09-13T06:01:27.320313+0000","last_fullsized":"2023-09-13T06:01:27.320313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:07.662063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966134+0000","last_change":"2023-09-13T06:01:26.332709+0000","last_active":"2023-09-13T06:01:27.966134+0000","last_peered":"2023-09-13T06:01:27.966134+0000","last_clean":"2023-09-13T06:01:27.966134+0000","last_became_active":"2023-09-13T06:01:26.328795+0000","last_became_peered":"2023-09-13T06:01:26.328795+0000","last_unstale":"2023-09-13T06:01:27.966134+0000","last_undegraded":"2023-09-13T06:01:27.966134+0000","last_fullsized":"2023-09-13T06:01:27.966134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806420+0000","last_change":"2023-09-13T06:01:25.325632+0000","last_active":"2023-09-13T06:01:27.806420+0000","last_peered":"2023-09-13T06:01:27.806420+0000","last_clean":"2023-09-13T06:01:27.806420+0000","last_became_active":"2023-09-13T06:01:25.324877+0000","last_became_peered":"2023-09-13T06:01:25.324877+0000","last_unstale":"2023-09-13T06:01:27.806420+0000","last_undegraded":"2023-09-13T06:01:27.806420+0000","last_fullsized":"2023-09-13T06:01:27.806420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:50.125094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806348+0000","last_change":"2023-09-13T06:01:26.327756+0000","last_active":"2023-09-13T06:01:27.806348+0000","last_peered":"2023-09-13T06:01:27.806348+0000","last_clean":"2023-09-13T06:01:27.806348+0000","last_became_active":"2023-09-13T06:01:26.327392+0000","last_became_peered":"2023-09-13T06:01:26.327392+0000","last_unstale":"2023-09-13T06:01:27.806348+0000","last_undegraded":"2023-09-13T06:01:27.806348+0000","last_fullsized":"2023-09-13T06:01:27.806348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:28:12.855923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966263+0000","last_change":"2023-09-13T06:01:25.328325+0000","last_active":"2023-09-13T06:01:27.966263+0000","last_peered":"2023-09-13T06:01:27.966263+0000","last_clean":"2023-09-13T06:01:27.966263+0000","last_became_active":"2023-09-13T06:01:25.328089+0000","last_became_peered":"2023-09-13T06:01:25.328089+0000","last_unstale":"2023-09-13T06:01:27.966263+0000","last_undegraded":"2023-09-13T06:01:27.966263+0000","last_fullsized":"2023-09-13T06:01:27.966263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333641,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924501,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]}],"pool_statfs":[]}} 2023-09-13T06:01:30.809 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T06:01:30.810 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-13T06:01:30.810 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-13T06:01:30.811 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-13T06:01:30.811 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-13T06:01:30.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f8507d11640 1 Processor -- start 2023-09-13T06:01:30.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f8507d11640 1 -- start start 2023-09-13T06:01:30.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f8507d11640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f85000d1090 0x7f850015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f8507d11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8500146f30 0x7f85000b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f8507d11640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85000b63c0 con 0x7f85000d1750 2023-09-13T06:01:30.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f8507d11640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850015dea0 con 0x7f85000d1090 2023-09-13T06:01:30.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f8507d11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85000d0c20 con 0x7f8500146f30 2023-09-13T06:01:30.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f85052ac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f85000d1090 0x7f850015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f85052ac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f85000d1090 0x7f850015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47772/0 (socket says 172.21.15.130:47772) 2023-09-13T06:01:30.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f85052ac640 1 -- 172.21.15.130:0/2888241052 learned_addr learned my addr 172.21.15.130:0/2888241052 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:30.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f85062ae640 1 --2- 172.21.15.130:0/2888241052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8500146f30 0x7f85000b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f85052ac640 1 -- 172.21.15.130:0/2888241052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8500146f30 msgr2=0x7f85000b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:30.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f85052ac640 1 --2- 172.21.15.130:0/2888241052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8500146f30 0x7f85000b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f85052ac640 1 -- 172.21.15.130:0/2888241052 >> v1:172.21.15.164:6789/0 conn(0x7f85000d1750 legacy=0x7f8500146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:30.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.980+0000 7f85052ac640 1 -- 172.21.15.130:0/2888241052 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000b6610 con 0x7f85000d1090 2023-09-13T06:01:30.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f85052ac640 1 --2- 172.21.15.130:0/2888241052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85000d1090 0x7f850015d960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009870 tx=0x7f84f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55617bbe10815d19 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:30.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8504aab640 1 -- 172.21.15.130:0/2888241052 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00aa5f0 con 0x7f85000d1090 2023-09-13T06:01:30.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8504aab640 1 -- 172.21.15.130:0/2888241052 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f00aa750 con 0x7f85000d1090 2023-09-13T06:01:30.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8504aab640 1 -- 172.21.15.130:0/2888241052 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00aaae0 con 0x7f85000d1090 2023-09-13T06:01:30.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8507d11640 1 -- 172.21.15.130:0/2888241052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85000d1090 msgr2=0x7f850015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8507d11640 1 --2- 172.21.15.130:0/2888241052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85000d1090 0x7f850015d960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009870 tx=0x7f84f001c4d0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8507d11640 1 -- 172.21.15.130:0/2888241052 shutdown_connections 2023-09-13T06:01:30.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8507d11640 1 --2- 172.21.15.130:0/2888241052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8500146f30 0x7f85000b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8507d11640 1 --2- 172.21.15.130:0/2888241052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85000d1090 0x7f850015d960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8507d11640 1 -- 172.21.15.130:0/2888241052 >> 172.21.15.130:0/2888241052 conn(0x7f850006f170 msgr2=0x7f850006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:30.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8507d11640 1 -- 172.21.15.130:0/2888241052 shutdown_connections 2023-09-13T06:01:30.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8507d11640 1 -- 172.21.15.130:0/2888241052 wait complete. 2023-09-13T06:01:30.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.984+0000 7f8507d11640 1 Processor -- start 2023-09-13T06:01:30.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8507d11640 1 -- start start 2023-09-13T06:01:30.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8507d11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85000d1090 0x7f850013ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8507d11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85000d1750 0x7f850013ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8507d11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8500146f30 0x7f8500164270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:30.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8507d11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500163590 con 0x7f85000d1750 2023-09-13T06:01:30.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8507d11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500162aa0 con 0x7f85000d1090 2023-09-13T06:01:30.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8507d11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8500166690 con 0x7f8500146f30 2023-09-13T06:01:30.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f85052ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85000d1750 0x7f850013ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f85052ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85000d1750 0x7f850013ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47778/0 (socket says 172.21.15.130:47778) 2023-09-13T06:01:30.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f85052ac640 1 -- 172.21.15.130:0/1708787241 learned_addr learned my addr 172.21.15.130:0/1708787241 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:30.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f85062ae640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8500146f30 0x7f8500164270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8505aad640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85000d1090 0x7f850013ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:30.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f85052ac640 1 -- 172.21.15.130:0/1708787241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8500146f30 msgr2=0x7f8500164270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f85052ac640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8500146f30 0x7f8500164270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f85052ac640 1 -- 172.21.15.130:0/1708787241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85000d1090 msgr2=0x7f850013ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:30.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f85052ac640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85000d1090 0x7f850013ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:30.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f85052ac640 1 -- 172.21.15.130:0/1708787241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f00094d0 con 0x7f85000d1750 2023-09-13T06:01:30.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f85062ae640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8500146f30 0x7f8500164270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:30.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8505aad640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85000d1090 0x7f850013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:30.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f85052ac640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85000d1750 0x7f850013ef60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84f001cd70 tx=0x7f84f001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:30.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f84f67fc640 1 -- 172.21.15.130:0/1708787241 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00aa5f0 con 0x7f85000d1750 2023-09-13T06:01:30.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f84f67fc640 1 -- 172.21.15.130:0/1708787241 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f00b3800 con 0x7f85000d1750 2023-09-13T06:01:30.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f84f67fc640 1 -- 172.21.15.130:0/1708787241 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00b3bb0 con 0x7f85000d1750 2023-09-13T06:01:30.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8507d11640 1 -- 172.21.15.130:0/1708787241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85000b7e40 con 0x7f85000d1750 2023-09-13T06:01:30.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8507d11640 1 -- 172.21.15.130:0/1708787241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8500162fd0 con 0x7f85000d1750 2023-09-13T06:01:30.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.988+0000 7f8507d11640 1 -- 172.21.15.130:0/1708787241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8500166850 con 0x7f85000d1750 2023-09-13T06:01:30.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.992+0000 7f84f67fc640 1 -- 172.21.15.130:0/1708787241 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f84f00b3d10 con 0x7f85000d1750 2023-09-13T06:01:31.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.992+0000 7f84f67fc640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84e4065b20 0x7f84e4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.992+0000 7f84f67fc640 1 -- 172.21.15.130:0/1708787241 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84f00a7070 con 0x7f85000d1750 2023-09-13T06:01:31.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.992+0000 7f8505aad640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84e4065b20 0x7f84e4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.992+0000 7f8505aad640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84e4065b20 0x7f84e4067fe0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f84fc003e40 tx=0x7f84fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:31.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:30.996+0000 7f84f67fc640 1 -- 172.21.15.130:0/1708787241 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f84f00eb380 con 0x7f85000d1750 2023-09-13T06:01:31.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.176+0000 7f8507d11640 1 -- 172.21.15.130:0/1708787241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f85000618a0 con 0x7f85000d1750 2023-09-13T06:01:31.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.180+0000 7f84f67fc640 1 -- 172.21.15.130:0/1708787241 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163510 (secure 0 0 0) 0x7f84f00ee9a0 con 0x7f85000d1750 2023-09-13T06:01:31.186 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:31.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 -- 172.21.15.130:0/1708787241 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84e4065b20 msgr2=0x7f84e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84e4065b20 0x7f84e4067fe0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f84fc003e40 tx=0x7f84fc009040 comp rx=0 tx=0).stop 2023-09-13T06:01:31.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 -- 172.21.15.130:0/1708787241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85000d1750 msgr2=0x7f850013ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85000d1750 0x7f850013ef60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84f001cd70 tx=0x7f84f001ad10 comp rx=0 tx=0).stop 2023-09-13T06:01:31.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 -- 172.21.15.130:0/1708787241 shutdown_connections 2023-09-13T06:01:31.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84e4065b20 0x7f84e4067fe0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8500146f30 0x7f8500164270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85000d1750 0x7f850013ef60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 --2- 172.21.15.130:0/1708787241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85000d1090 0x7f850013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 -- 172.21.15.130:0/1708787241 >> 172.21.15.130:0/1708787241 conn(0x7f850006f170 msgr2=0x7f85000cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:31.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 -- 172.21.15.130:0/1708787241 shutdown_connections 2023-09-13T06:01:31.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.184+0000 7f8507d11640 1 -- 172.21.15.130:0/1708787241 wait complete. 2023-09-13T06:01:31.206 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2737069497},{"type":"v1","addr":"172.21.15.130:6833","nonce":2737069497}]},"active_addr":"172.21.15.130:6833/2737069497","active_change":"2023-09-13T06:01:12.523434+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":328233952}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":3655377383}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":3549888498}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":1414281590}]}]} 2023-09-13T06:01:31.210 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-13T06:01:31.211 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-13T06:01:31.211 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:31.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.344+0000 7f1dee819640 1 Processor -- start 2023-09-13T06:01:31.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.344+0000 7f1dee819640 1 -- start start 2023-09-13T06:01:31.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1dee819640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1de8159f20 0x7f1de80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1dee819640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1de80cdfc0 0x7f1de80b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1dee819640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de80ccfd0 con 0x7f1de80b1610 2023-09-13T06:01:31.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1dee819640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de80b00f0 con 0x7f1de80cdfc0 2023-09-13T06:01:31.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1dee819640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80ce420 con 0x7f1de8159f20 2023-09-13T06:01:31.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1de77fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1de80cdfc0 0x7f1de80b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1decdb6640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1de80b1610 0x7f1de80ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55732/0 (socket says 172.21.15.130:55732) 2023-09-13T06:01:31.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1decdb6640 1 -- 172.21.15.130:0/178900536 learned_addr learned my addr 172.21.15.130:0/178900536 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:31.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1de7fff640 1 --2- 172.21.15.130:0/178900536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1de8159f20 0x7f1de80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1de77fe640 1 -- 172.21.15.130:0/178900536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1de8159f20 msgr2=0x7f1de80ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:31.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1de77fe640 1 --2- 172.21.15.130:0/178900536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1de8159f20 0x7f1de80ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1de77fe640 1 -- 172.21.15.130:0/178900536 >> v1:172.21.15.130:6789/0 conn(0x7f1de80b1610 legacy=0x7f1de80ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1de77fe640 1 -- 172.21.15.130:0/178900536 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de80ced90 con 0x7f1de80cdfc0 2023-09-13T06:01:31.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.348+0000 7f1de77fe640 1 --2- 172.21.15.130:0/178900536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1de80cdfc0 0x7f1de80b0c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0097c0 tx=0x7f1ddc01e520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdccec513a3ec76 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:31.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1de6ffd640 1 -- 172.21.15.130:0/178900536 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0ad680 con 0x7f1de80cdfc0 2023-09-13T06:01:31.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1de6ffd640 1 -- 172.21.15.130:0/178900536 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc0ad7e0 con 0x7f1de80cdfc0 2023-09-13T06:01:31.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1de6ffd640 1 -- 172.21.15.130:0/178900536 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0adb70 con 0x7f1de80cdfc0 2023-09-13T06:01:31.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 -- 172.21.15.130:0/178900536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1de80cdfc0 msgr2=0x7f1de80b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 --2- 172.21.15.130:0/178900536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1de80cdfc0 0x7f1de80b0c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0097c0 tx=0x7f1ddc01e520 comp rx=0 tx=0).stop 2023-09-13T06:01:31.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 -- 172.21.15.130:0/178900536 shutdown_connections 2023-09-13T06:01:31.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 --2- 172.21.15.130:0/178900536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1de80cdfc0 0x7f1de80b0c90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 --2- 172.21.15.130:0/178900536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1de8159f20 0x7f1de80ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 -- 172.21.15.130:0/178900536 >> 172.21.15.130:0/178900536 conn(0x7f1de8065990 msgr2=0x7f1de8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:31.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 -- 172.21.15.130:0/178900536 shutdown_connections 2023-09-13T06:01:31.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 -- 172.21.15.130:0/178900536 wait complete. 2023-09-13T06:01:31.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 Processor -- start 2023-09-13T06:01:31.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 -- start start 2023-09-13T06:01:31.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1de80b1610 0x7f1de80acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1de80cdfc0 0x7f1de814a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1de8159f20 0x7f1de814a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de814adb0 con 0x7f1de80b1610 2023-09-13T06:01:31.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de814e050 con 0x7f1de8159f20 2023-09-13T06:01:31.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.352+0000 7f1dee819640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de814d290 con 0x7f1de80cdfc0 2023-09-13T06:01:31.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1de80b1610 0x7f1de80acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1de80b1610 0x7f1de80acaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47806/0 (socket says 172.21.15.130:47806) 2023-09-13T06:01:31.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de7fff640 1 -- 172.21.15.130:0/2887713195 learned_addr learned my addr 172.21.15.130:0/2887713195 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:31.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de77fe640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1de80cdfc0 0x7f1de814a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1decdb6640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1de8159f20 0x7f1de814a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de7fff640 1 -- 172.21.15.130:0/2887713195 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1de80cdfc0 msgr2=0x7f1de814a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de7fff640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1de80cdfc0 0x7f1de814a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de7fff640 1 -- 172.21.15.130:0/2887713195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1de8159f20 msgr2=0x7f1de814a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de7fff640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1de8159f20 0x7f1de814a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de7fff640 1 -- 172.21.15.130:0/2887713195 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc009420 con 0x7f1de80b1610 2023-09-13T06:01:31.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de7fff640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1de80b1610 0x7f1de80acaa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800d5f0 tx=0x7f1dd800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:31.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de4ff9640 1 -- 172.21.15.130:0/2887713195 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd80125f0 con 0x7f1de80b1610 2023-09-13T06:01:31.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de4ff9640 1 -- 172.21.15.130:0/2887713195 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd8012750 con 0x7f1de80b1610 2023-09-13T06:01:31.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1dee819640 1 -- 172.21.15.130:0/2887713195 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de814d570 con 0x7f1de80b1610 2023-09-13T06:01:31.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de4ff9640 1 -- 172.21.15.130:0/2887713195 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8012ae0 con 0x7f1de80b1610 2023-09-13T06:01:31.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1dee819640 1 -- 172.21.15.130:0/2887713195 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de814db30 con 0x7f1de80b1610 2023-09-13T06:01:31.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1dee819640 1 -- 172.21.15.130:0/2887713195 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de80618a0 con 0x7f1de80b1610 2023-09-13T06:01:31.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.356+0000 7f1de4ff9640 1 -- 172.21.15.130:0/2887713195 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1dd8012c40 con 0x7f1de80b1610 2023-09-13T06:01:31.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.360+0000 7f1de4ff9640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1dd4065b20 0x7f1dd4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.360+0000 7f1de4ff9640 1 -- 172.21.15.130:0/2887713195 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dd8083630 con 0x7f1de80b1610 2023-09-13T06:01:31.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.360+0000 7f1de77fe640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1dd4065b20 0x7f1dd4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.360+0000 7f1de77fe640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1dd4065b20 0x7f1dd4067fe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0b1000 tx=0x7f1ddc0a9000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:31.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.364+0000 7f1de4ff9640 1 -- 172.21.15.130:0/2887713195 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1dd8051030 con 0x7f1de80b1610 2023-09-13T06:01:31.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 -- 172.21.15.130:0/2887713195 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1de806f320 con 0x7f1de80b1610 2023-09-13T06:01:31.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1de4ff9640 1 -- 172.21.15.130:0/2887713195 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f1dd8054650 con 0x7f1de80b1610 2023-09-13T06:01:31.521 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:31.522 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:31.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 -- 172.21.15.130:0/2887713195 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1dd4065b20 msgr2=0x7f1dd4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1dd4065b20 0x7f1dd4067fe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0b1000 tx=0x7f1ddc0a9000 comp rx=0 tx=0).stop 2023-09-13T06:01:31.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 -- 172.21.15.130:0/2887713195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1de80b1610 msgr2=0x7f1de80acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1de80b1610 0x7f1de80acaa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800d5f0 tx=0x7f1dd800dab0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 -- 172.21.15.130:0/2887713195 shutdown_connections 2023-09-13T06:01:31.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1dd4065b20 0x7f1dd4067fe0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1de8159f20 0x7f1de814a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1de80cdfc0 0x7f1de814a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 --2- 172.21.15.130:0/2887713195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1de80b1610 0x7f1de80acaa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 -- 172.21.15.130:0/2887713195 >> 172.21.15.130:0/2887713195 conn(0x7f1de8065990 msgr2=0x7f1de8158530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:31.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 -- 172.21.15.130:0/2887713195 shutdown_connections 2023-09-13T06:01:31.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.516+0000 7f1dee819640 1 -- 172.21.15.130:0/2887713195 wait complete. 2023-09-13T06:01:31.541 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-13T06:01:31.541 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:31.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca38b34640 1 Processor -- start 2023-09-13T06:01:31.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca38b34640 1 -- start start 2023-09-13T06:01:31.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca38b34640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca340d1f50 0x7fca34070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca38b34640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fca340706c0 0x7fca3415d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca38b34640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca340d1ac0 con 0x7fca34146b30 2023-09-13T06:01:31.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca38b34640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca34070b70 con 0x7fca340706c0 2023-09-13T06:01:31.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca38b34640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca340d0be0 con 0x7fca340d1f50 2023-09-13T06:01:31.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca33fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fca340706c0 0x7fca3415d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca337fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fca34146b30 0x7fca340d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:36588/0 (socket says 172.21.15.130:36588) 2023-09-13T06:01:31.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca32ffd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca340d1f50 0x7fca34070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca337fe640 1 -- 172.21.15.130:0/286645059 learned_addr learned my addr 172.21.15.130:0/286645059 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:31.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca33fff640 1 -- 172.21.15.130:0/286645059 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca340d1f50 msgr2=0x7fca34070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:31.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca33fff640 1 --2- 172.21.15.130:0/286645059 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca340d1f50 0x7fca34070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca33fff640 1 -- 172.21.15.130:0/286645059 >> v1:172.21.15.164:6789/0 conn(0x7fca34146b30 legacy=0x7fca340d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca33fff640 1 -- 172.21.15.130:0/286645059 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340d0eb0 con 0x7fca340706c0 2023-09-13T06:01:31.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.676+0000 7fca327fc640 1 -- 172.21.15.130:0/286645059 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576478760 0 0) 0x7fca340d1ac0 con 0x7fca34146b30 2023-09-13T06:01:31.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca33fff640 1 --2- 172.21.15.130:0/286645059 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca340706c0 0x7fca3415d760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009d90 tx=0x7fca2c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fe0758eb30ba1b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:31.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca327fc640 1 -- 172.21.15.130:0/286645059 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0a59e0 con 0x7fca340706c0 2023-09-13T06:01:31.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca327fc640 1 -- 172.21.15.130:0/286645059 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c0a5b40 con 0x7fca340706c0 2023-09-13T06:01:31.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca327fc640 1 -- 172.21.15.130:0/286645059 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0ad440 con 0x7fca340706c0 2023-09-13T06:01:31.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca38b34640 1 -- 172.21.15.130:0/286645059 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca340706c0 msgr2=0x7fca3415d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca38b34640 1 --2- 172.21.15.130:0/286645059 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca340706c0 0x7fca3415d760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009d90 tx=0x7fca2c01c920 comp rx=0 tx=0).stop 2023-09-13T06:01:31.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca38b34640 1 -- 172.21.15.130:0/286645059 shutdown_connections 2023-09-13T06:01:31.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca38b34640 1 --2- 172.21.15.130:0/286645059 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca340706c0 0x7fca3415d760 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca38b34640 1 --2- 172.21.15.130:0/286645059 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca340d1f50 0x7fca34070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca38b34640 1 -- 172.21.15.130:0/286645059 >> 172.21.15.130:0/286645059 conn(0x7fca340d3090 msgr2=0x7fca340d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:31.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca38b34640 1 -- 172.21.15.130:0/286645059 shutdown_connections 2023-09-13T06:01:31.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.680+0000 7fca38b34640 1 -- 172.21.15.130:0/286645059 wait complete. 2023-09-13T06:01:31.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca38b34640 1 Processor -- start 2023-09-13T06:01:31.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca38b34640 1 -- start start 2023-09-13T06:01:31.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca38b34640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca340706c0 0x7fca34166f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca38b34640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca340d1f50 0x7fca34139790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca38b34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca34146b30 0x7fca3406d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca38b34640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca34137ab0 con 0x7fca34146b30 2023-09-13T06:01:31.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca38b34640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca341f9740 con 0x7fca340d1f50 2023-09-13T06:01:31.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca38b34640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca34134790 con 0x7fca340706c0 2023-09-13T06:01:31.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca33fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca34146b30 0x7fca3406d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca33fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca34146b30 0x7fca3406d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47820/0 (socket says 172.21.15.130:47820) 2023-09-13T06:01:31.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca33fff640 1 -- 172.21.15.130:0/726794638 learned_addr learned my addr 172.21.15.130:0/726794638 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:31.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca337fe640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca340706c0 0x7fca34166f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca32ffd640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca340d1f50 0x7fca34139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca33fff640 1 -- 172.21.15.130:0/726794638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca340706c0 msgr2=0x7fca34166f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca33fff640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca340706c0 0x7fca34166f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca33fff640 1 -- 172.21.15.130:0/726794638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca340d1f50 msgr2=0x7fca34139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca33fff640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca340d1f50 0x7fca34139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca33fff640 1 -- 172.21.15.130:0/726794638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c009a70 con 0x7fca34146b30 2023-09-13T06:01:31.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca33fff640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca34146b30 0x7fca3406d670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fca2c01afd0 tx=0x7fca2c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:31.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca1bfff640 1 -- 172.21.15.130:0/726794638 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0aece0 con 0x7fca34146b30 2023-09-13T06:01:31.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca1bfff640 1 -- 172.21.15.130:0/726794638 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c0aee40 con 0x7fca34146b30 2023-09-13T06:01:31.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca1bfff640 1 -- 172.21.15.130:0/726794638 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0b7630 con 0x7fca34146b30 2023-09-13T06:01:31.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca38b34640 1 -- 172.21.15.130:0/726794638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca34133ef0 con 0x7fca34146b30 2023-09-13T06:01:31.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.684+0000 7fca38b34640 1 -- 172.21.15.130:0/726794638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca341344b0 con 0x7fca34146b30 2023-09-13T06:01:31.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.688+0000 7fca38b34640 1 -- 172.21.15.130:0/726794638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca34137bf0 con 0x7fca34146b30 2023-09-13T06:01:31.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.688+0000 7fca1bfff640 1 -- 172.21.15.130:0/726794638 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fca2c0b4050 con 0x7fca34146b30 2023-09-13T06:01:31.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.688+0000 7fca1bfff640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca20065b20 0x7fca20067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:31.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.688+0000 7fca1bfff640 1 -- 172.21.15.130:0/726794638 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca2c11e690 con 0x7fca34146b30 2023-09-13T06:01:31.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.688+0000 7fca337fe640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca20065b20 0x7fca20067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:31.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.688+0000 7fca337fe640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca20065b20 0x7fca20067fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca24000f70 tx=0x7fca24007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:31.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.692+0000 7fca1bfff640 1 -- 172.21.15.130:0/726794638 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fca34137bf0 con 0x7fca34146b30 2023-09-13T06:01:31.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.840+0000 7fca38b34640 1 -- 172.21.15.130:0/726794638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca34137bf0 con 0x7fca34146b30 2023-09-13T06:01:31.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca1bfff640 1 -- 172.21.15.130:0/726794638 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fca34137bf0 con 0x7fca34146b30 2023-09-13T06:01:31.848 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:31.848 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:31.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 -- 172.21.15.130:0/726794638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca20065b20 msgr2=0x7fca20067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca20065b20 0x7fca20067fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca24000f70 tx=0x7fca24007df0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 -- 172.21.15.130:0/726794638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca34146b30 msgr2=0x7fca3406d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:31.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca34146b30 0x7fca3406d670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fca2c01afd0 tx=0x7fca2c0196c0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 -- 172.21.15.130:0/726794638 shutdown_connections 2023-09-13T06:01:31.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca20065b20 0x7fca20067fe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca340d1f50 0x7fca34139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca34146b30 0x7fca3406d670 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 --2- 172.21.15.130:0/726794638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca340706c0 0x7fca34166f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:31.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 -- 172.21.15.130:0/726794638 >> 172.21.15.130:0/726794638 conn(0x7fca340d3090 msgr2=0x7fca34140020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:31.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 -- 172.21.15.130:0/726794638 shutdown_connections 2023-09-13T06:01:31.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:31.844+0000 7fca38b34640 1 -- 172.21.15.130:0/726794638 wait complete. 2023-09-13T06:01:31.869 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-13T06:01:31.870 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-13T06:01:31.871 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-13T06:01:31.871 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-13T06:01:31.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-13T06:01:31.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-13T06:01:31.873 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-13T06:01:31.874 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-13T06:01:32.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.108+0000 7fc3aac07640 1 Processor -- start 2023-09-13T06:01:32.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.108+0000 7fc3aac07640 1 -- start start 2023-09-13T06:01:32.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.108+0000 7f11eba7b640 1 Processor -- start 2023-09-13T06:01:32.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.108+0000 7f11eba7b640 1 -- start start 2023-09-13T06:01:32.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3aac07640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc3a4159750 0x7fc3a40b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3aac07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a406d7f0 0x7fc3a40af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3aac07640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a406c090 con 0x7fc3a40aeff0 2023-09-13T06:01:32.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3aac07640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a40af9c0 con 0x7fc3a4159750 2023-09-13T06:01:32.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3aac07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40ce410 con 0x7fc3a406d7f0 2023-09-13T06:01:32.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3a3fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc3a40aeff0 0x7fc3a415d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55740/0 (socket says 172.21.15.130:55740) 2023-09-13T06:01:32.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3a3fff640 1 -- 172.21.15.130:0/219463921 learned_addr learned my addr 172.21.15.130:0/219463921 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:32.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3a89a3640 1 --2- 172.21.15.130:0/219463921 >> v2:172.21.15.164:3300/0 conn(0x7fc3a4159750 0x7fc3a40b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3a91a4640 1 --2- 172.21.15.130:0/219463921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a406d7f0 0x7fc3a40af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11eba7b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11e4159200 0x7f11e40b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3a89a3640 1 -- 172.21.15.130:0/219463921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a406d7f0 msgr2=0x7fc3a40af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3a89a3640 1 --2- 172.21.15.130:0/219463921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a406d7f0 0x7fc3a40af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3a37fe640 1 -- 172.21.15.130:0/219463921 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086702568 0 0) 0x7fc3a406c090 con 0x7fc3a40aeff0 2023-09-13T06:01:32.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3a89a3640 1 -- 172.21.15.130:0/219463921 >> v1:172.21.15.130:6789/0 conn(0x7fc3a40aeff0 legacy=0x7fc3a415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7fc3a89a3640 1 -- 172.21.15.130:0/219463921 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a4159b30 con 0x7fc3a4159750 2023-09-13T06:01:32.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11e9817640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11e4159200 0x7f11e40b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11eba7b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11e40aeb90 0x7f11e406c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11e9817640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11e4159200 0x7f11e40b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47826/0 (socket says 172.21.15.130:47826) 2023-09-13T06:01:32.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11e9016640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f11e40cd360 0x7f11e40ae480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:36590/0 (socket says 172.21.15.130:36590) 2023-09-13T06:01:32.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11e9817640 1 -- 172.21.15.130:0/2660072847 learned_addr learned my addr 172.21.15.130:0/2660072847 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11eba7b640 1 -- 172.21.15.130:0/2660072847 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e40cdb50 con 0x7f11e40cd360 2023-09-13T06:01:32.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11ea018640 1 --2- 172.21.15.130:0/2660072847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11e40aeb90 0x7f11e406c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11e8815640 1 -- 172.21.15.130:0/2660072847 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346193446 0 0) 0x7f11e40cdb50 con 0x7f11e40cd360 2023-09-13T06:01:32.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11eba7b640 1 -- 172.21.15.130:0/2660072847 --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e406e920 con 0x7f11e4159200 2023-09-13T06:01:32.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11eba7b640 1 -- 172.21.15.130:0/2660072847 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e40cde30 con 0x7f11e40aeb90 2023-09-13T06:01:32.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.112+0000 7f11e8815640 1 -- 172.21.15.130:0/2660072847 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11d0003530 con 0x7f11e40cd360 2023-09-13T06:01:32.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.116+0000 7fc3a89a3640 1 --2- 172.21.15.130:0/219463921 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a4159750 0x7fc3a40b1d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3980097c0 tx=0x7fc39801c590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9f6431f658be542 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.116+0000 7fc3a37fe640 1 -- 172.21.15.130:0/219463921 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980a8640 con 0x7fc3a4159750 2023-09-13T06:01:32.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.116+0000 7fc3a37fe640 1 -- 172.21.15.130:0/219463921 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3980a87a0 con 0x7fc3a4159750 2023-09-13T06:01:32.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.116+0000 7fc3a37fe640 1 -- 172.21.15.130:0/219463921 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980a8b30 con 0x7fc3a4159750 2023-09-13T06:01:32.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7fc3aac07640 1 -- 172.21.15.130:0/219463921 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a4159750 msgr2=0x7fc3a40b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7fc3aac07640 1 --2- 172.21.15.130:0/219463921 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a4159750 0x7fc3a40b1d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3980097c0 tx=0x7fc39801c590 comp rx=0 tx=0).stop 2023-09-13T06:01:32.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7fc3aac07640 1 -- 172.21.15.130:0/219463921 shutdown_connections 2023-09-13T06:01:32.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7fc3aac07640 1 --2- 172.21.15.130:0/219463921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a406d7f0 0x7fc3a40af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7fc3aac07640 1 --2- 172.21.15.130:0/219463921 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a4159750 0x7fc3a40b1d90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7fc3aac07640 1 -- 172.21.15.130:0/219463921 >> 172.21.15.130:0/219463921 conn(0x7fc3a4065d90 msgr2=0x7fc3a40b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7fc3aac07640 1 -- 172.21.15.130:0/219463921 shutdown_connections 2023-09-13T06:01:32.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7fc3aac07640 1 -- 172.21.15.130:0/219463921 wait complete. 2023-09-13T06:01:32.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.116+0000 7f11ea018640 1 -- 172.21.15.130:0/2660072847 >> v2:172.21.15.130:3300/0 conn(0x7f11e4159200 msgr2=0x7f11e40b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.116+0000 7f11ea018640 1 --2- 172.21.15.130:0/2660072847 >> v2:172.21.15.130:3300/0 conn(0x7f11e4159200 0x7f11e40b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.116+0000 7f11ea018640 1 -- 172.21.15.130:0/2660072847 >> v1:172.21.15.164:6789/0 conn(0x7f11e40cd360 legacy=0x7f11e40ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.116+0000 7f11ea018640 1 -- 172.21.15.130:0/2660072847 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e406c010 con 0x7f11e40aeb90 2023-09-13T06:01:32.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.116+0000 7f11e9817640 1 --2- 172.21.15.130:0/2660072847 >> v2:172.21.15.130:3300/0 conn(0x7f11e4159200 0x7f11e40b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:32.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11ea018640 1 --2- 172.21.15.130:0/2660072847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11e40aeb90 0x7f11e406c810 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009d90 tx=0x7f11dc01e910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96165fae55705970 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11e8815640 1 -- 172.21.15.130:0/2660072847 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0001680 con 0x7f11e40aeb90 2023-09-13T06:01:32.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11e8815640 1 -- 172.21.15.130:0/2660072847 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc0a5560 con 0x7f11e40aeb90 2023-09-13T06:01:32.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11e8815640 1 -- 172.21.15.130:0/2660072847 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc0a58f0 con 0x7f11e40aeb90 2023-09-13T06:01:32.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11eba7b640 1 -- 172.21.15.130:0/2660072847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11e40aeb90 msgr2=0x7f11e406c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11eba7b640 1 --2- 172.21.15.130:0/2660072847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11e40aeb90 0x7f11e406c810 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009d90 tx=0x7f11dc01e910 comp rx=0 tx=0).stop 2023-09-13T06:01:32.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7fc3aac07640 1 Processor -- start 2023-09-13T06:01:32.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11eba7b640 1 -- 172.21.15.130:0/2660072847 shutdown_connections 2023-09-13T06:01:32.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11eba7b640 1 --2- 172.21.15.130:0/2660072847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11e40aeb90 0x7f11e406c810 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11eba7b640 1 --2- 172.21.15.130:0/2660072847 >> v2:172.21.15.130:3300/0 conn(0x7f11e4159200 0x7f11e40b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11eba7b640 1 -- 172.21.15.130:0/2660072847 >> 172.21.15.130:0/2660072847 conn(0x7f11e4065990 msgr2=0x7f11e4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11eba7b640 1 -- 172.21.15.130:0/2660072847 shutdown_connections 2023-09-13T06:01:32.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7f11eba7b640 1 -- 172.21.15.130:0/2660072847 wait complete. 2023-09-13T06:01:32.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.120+0000 7fc3aac07640 1 -- start start 2023-09-13T06:01:32.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3aac07640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a406d7f0 0x7fc3a4159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3aac07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a40aeff0 0x7fc3a41449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3aac07640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a4159750 0x7fc3a414cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a89a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a406d7f0 0x7fc3a4159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3aac07640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4144f00 con 0x7fc3a406d7f0 2023-09-13T06:01:32.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3aac07640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4149920 con 0x7fc3a4159750 2023-09-13T06:01:32.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a89a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a406d7f0 0x7fc3a4159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47836/0 (socket says 172.21.15.130:47836) 2023-09-13T06:01:32.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3aac07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4149b50 con 0x7fc3a40aeff0 2023-09-13T06:01:32.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a89a3640 1 -- 172.21.15.130:0/1963919182 learned_addr learned my addr 172.21.15.130:0/1963919182 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a3fff640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a40aeff0 0x7fc3a41449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7f8002cd8640 1 Processor -- start 2023-09-13T06:01:32.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a91a4640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a4159750 0x7fc3a414cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a3fff640 1 -- 172.21.15.130:0/1963919182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a4159750 msgr2=0x7fc3a414cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a3fff640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a4159750 0x7fc3a414cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a3fff640 1 -- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a406d7f0 msgr2=0x7fc3a4159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a3fff640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a406d7f0 0x7fc3a4159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a3fff640 1 -- 172.21.15.130:0/1963919182 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc398009420 con 0x7fc3a40aeff0 2023-09-13T06:01:32.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a3fff640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a40aeff0 0x7fc3a41449c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc39400c3e0 tx=0x7fc39400c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7f8002cd8640 1 -- start start 2023-09-13T06:01:32.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a17fa640 1 -- 172.21.15.130:0/1963919182 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3940074e0 con 0x7fc3a40aeff0 2023-09-13T06:01:32.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7f11eba7b640 1 Processor -- start 2023-09-13T06:01:32.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a17fa640 1 -- 172.21.15.130:0/1963919182 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394007640 con 0x7fc3a40aeff0 2023-09-13T06:01:32.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3aac07640 1 -- 172.21.15.130:0/1963919182 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a4149df0 con 0x7fc3a40aeff0 2023-09-13T06:01:32.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3a17fa640 1 -- 172.21.15.130:0/1963919182 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394004a30 con 0x7fc3a40aeff0 2023-09-13T06:01:32.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7f11eba7b640 1 -- start start 2023-09-13T06:01:32.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.124+0000 7fc3aac07640 1 -- 172.21.15.130:0/1963919182 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a414a3b0 con 0x7fc3a40aeff0 2023-09-13T06:01:32.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f8002cd8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ffc161560 0x7f7ffc165d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f8002cd8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc06e310 0x7f7ffc0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f8002cd8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc0cd7c0 con 0x7f7ffc0b2930 2023-09-13T06:01:32.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f8002cd8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ffc0cdaa0 con 0x7f7ffc161560 2023-09-13T06:01:32.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f8002cd8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc165290 con 0x7f7ffc06e310 2023-09-13T06:01:32.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc06e310 0x7f7ffc0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fa37caec640 1 Processor -- start 2023-09-13T06:01:32.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fc3aac07640 1 -- 172.21.15.130:0/1963919182 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3a406c2c0 con 0x7fc3a40aeff0 2023-09-13T06:01:32.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc06e310 0x7f7ffc0ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60566/0 (socket says 172.21.15.130:60566) 2023-09-13T06:01:32.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f7ffbfff640 1 -- 172.21.15.130:0/820499910 learned_addr learned my addr 172.21.15.130:0/820499910 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f11eba7b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11e40aeb90 0x7f11e40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fa37caec640 1 -- start start 2023-09-13T06:01:32.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f8000a74640 1 --2- 172.21.15.130:0/820499910 >> v2:172.21.15.130:3300/0 conn(0x7f7ffc161560 0x7f7ffc165d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f7ffbfff640 1 -- 172.21.15.130:0/820499910 >> v2:172.21.15.130:3300/0 conn(0x7f7ffc161560 msgr2=0x7f7ffc165d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f11e9817640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11e40aeb90 0x7f11e40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f11e9817640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11e40aeb90 0x7f11e40702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47854/0 (socket says 172.21.15.130:47854) 2023-09-13T06:01:32.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f11e9817640 1 -- 172.21.15.130:0/3034420561 learned_addr learned my addr 172.21.15.130:0/3034420561 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f11eba7b640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11e40cd360 0x7f11e4149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f7ffbfff640 1 --2- 172.21.15.130:0/820499910 >> v2:172.21.15.130:3300/0 conn(0x7f7ffc161560 0x7f7ffc165d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f7ffbfff640 1 -- 172.21.15.130:0/820499910 >> v1:172.21.15.164:6789/0 conn(0x7f7ffc0b2930 legacy=0x7f7ffc06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f7ffbfff640 1 -- 172.21.15.130:0/820499910 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc165570 con 0x7f7ffc06e310 2023-09-13T06:01:32.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f11eba7b640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11e4159200 0x7f11e406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f8000a74640 1 --2- 172.21.15.130:0/820499910 >> v2:172.21.15.130:3300/0 conn(0x7f7ffc161560 0x7f7ffc165d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:32.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f11e9016640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11e40cd360 0x7f11e4149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4151650 con 0x7f11e40aeb90 2023-09-13T06:01:32.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f11ea018640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11e4159200 0x7f11e406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4150360 con 0x7f11e4159200 2023-09-13T06:01:32.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4070820 con 0x7f11e40cd360 2023-09-13T06:01:32.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fa37caec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa3780adf90 0x7fa3780b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fa37caec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa3780cd360 0x7fa378158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fa37caec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3780cde30 con 0x7fa3780ae480 2023-09-13T06:01:32.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fa37caec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37806e920 con 0x7fa3780adf90 2023-09-13T06:01:32.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fa37caec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37806c010 con 0x7fa3780cd360 2023-09-13T06:01:32.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fc3a17fa640 1 -- 172.21.15.130:0/1963919182 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc394004b90 con 0x7fc3a40aeff0 2023-09-13T06:01:32.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fa37659c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa3780adf90 0x7fa3780b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fa37659c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa3780adf90 0x7fa3780b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47870/0 (socket says 172.21.15.130:47870) 2023-09-13T06:01:32.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fa37659c640 1 -- 172.21.15.130:0/1127921670 learned_addr learned my addr 172.21.15.130:0/1127921670 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.128+0000 7fc3a17fa640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc390065bf0 0x7fc3900680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fa37659c640 1 -- 172.21.15.130:0/1127921670 >> v2:172.21.15.164:3300/0 conn(0x7fa3780cd360 msgr2=0x7fa378158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fa36dd9b640 1 --2- 172.21.15.130:0/1127921670 >> v2:172.21.15.164:3300/0 conn(0x7fa3780cd360 0x7fa378158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fa375d9b640 1 -- 172.21.15.130:0/1127921670 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962998784 0 0) 0x7fa3780cde30 con 0x7fa3780ae480 2023-09-13T06:01:32.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fc3a89a3640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc390065bf0 0x7fc3900680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fc3a17fa640 1 -- 172.21.15.130:0/1963919182 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc394082f40 con 0x7fc3a40aeff0 2023-09-13T06:01:32.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fc3a17fa640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] conn(0x7fc39006dd90 0x7fc3900701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fc3a17fa640 1 -- 172.21.15.130:0/1963919182 --> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc390070860 con 0x7fc39006dd90 2023-09-13T06:01:32.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fc3a17fa640 1 -- 172.21.15.130:0/1963919182 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc394050730 con 0x7fc3a40aeff0 2023-09-13T06:01:32.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11e9817640 1 -- 172.21.15.130:0/3034420561 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11e40cd360 msgr2=0x7f11e4149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11e9817640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11e40cd360 0x7f11e4149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11e9817640 1 -- 172.21.15.130:0/3034420561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11e4159200 msgr2=0x7f11e406f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11e9817640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11e4159200 0x7f11e406f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11e9817640 1 -- 172.21.15.130:0/3034420561 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc009a70 con 0x7f11e40aeb90 2023-09-13T06:01:32.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11e9817640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11e40aeb90 0x7f11e40702e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009aa0 tx=0x7f11d4009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fa37659c640 1 --2- 172.21.15.130:0/1127921670 >> v2:172.21.15.164:3300/0 conn(0x7fa3780cd360 0x7fa378158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fa37659c640 1 -- 172.21.15.130:0/1127921670 >> v1:172.21.15.164:6789/0 conn(0x7fa3780ae480 legacy=0x7fa3780cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fa37659c640 1 -- 172.21.15.130:0/1127921670 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37806c2f0 con 0x7fa3780adf90 2023-09-13T06:01:32.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fa36dd9b640 1 --2- 172.21.15.130:0/1127921670 >> v2:172.21.15.164:3300/0 conn(0x7fa3780cd360 0x7fa378158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:32.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fd4ccb12640 1 Processor -- start 2023-09-13T06:01:32.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fc3a91a4640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] conn(0x7fc39006dd90 0x7fc3900701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11da7fc640 1 -- 172.21.15.130:0/3034420561 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4004030 con 0x7f11e40aeb90 2023-09-13T06:01:32.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fc3a89a3640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc390065bf0 0x7fc3900680b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc398000c10 tx=0x7fc398008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e40cd920 con 0x7f11e40aeb90 2023-09-13T06:01:32.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e4151bd0 con 0x7f11e40aeb90 2023-09-13T06:01:32.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11da7fc640 1 -- 172.21.15.130:0/3034420561 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d400c070 con 0x7f11e40aeb90 2023-09-13T06:01:32.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11da7fc640 1 -- 172.21.15.130:0/3034420561 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40043d0 con 0x7f11e40aeb90 2023-09-13T06:01:32.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fc3a91a4640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] conn(0x7fc39006dd90 0x7fc3900701b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11e40cd7a0 con 0x7f11e40aeb90 2023-09-13T06:01:32.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fce4a849640 1 Processor -- start 2023-09-13T06:01:32.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fce4a849640 1 -- start start 2023-09-13T06:01:32.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7f7ffbfff640 1 --2- 172.21.15.130:0/820499910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc06e310 0x7f7ffc0ccf70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009870 tx=0x7f7ff001c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5eb4236f8e71749 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fd4ccb12640 1 -- start start 2023-09-13T06:01:32.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.132+0000 7fc3a17fa640 1 -- 172.21.15.130:0/1963919182 <== osd.0 v2:172.21.15.130:6800/3085363071 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fc390070860 con 0x7fc39006dd90 2023-09-13T06:01:32.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce4a849640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce3c0e4870 0x7fce3c0388b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce4a849640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fce3c03b070 0x7fce3c038df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce4a849640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c0568b0 con 0x7fce3c055df0 2023-09-13T06:01:32.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce4a849640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3c051720 con 0x7fce3c03b070 2023-09-13T06:01:32.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce4a849640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c056b00 con 0x7fce3c0e4870 2023-09-13T06:01:32.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce49847640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce3c0e4870 0x7fce3c0388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce4a048640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fce3c03b070 0x7fce3c038df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce49847640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce3c0e4870 0x7fce3c0388b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60590/0 (socket says 172.21.15.130:60590) 2023-09-13T06:01:32.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce49847640 1 -- 172.21.15.130:0/3302918931 learned_addr learned my addr 172.21.15.130:0/3302918931 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f7ffb7fe640 1 -- 172.21.15.130:0/820499910 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00ab600 con 0x7f7ffc06e310 2023-09-13T06:01:32.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f7ffb7fe640 1 -- 172.21.15.130:0/820499910 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff00a7050 con 0x7f7ffc06e310 2023-09-13T06:01:32.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f7ffb7fe640 1 -- 172.21.15.130:0/820499910 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00ab980 con 0x7f7ffc06e310 2023-09-13T06:01:32.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce4a048640 1 -- 172.21.15.130:0/3302918931 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce3c0e4870 msgr2=0x7fce3c0388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fa37659c640 1 --2- 172.21.15.130:0/1127921670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3780adf90 0x7fa3780b2020 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa3780b0040 tx=0x7fa36001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b24cd3e8daba33e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce4a048640 1 --2- 172.21.15.130:0/3302918931 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce3c0e4870 0x7fce3c0388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce4a048640 1 -- 172.21.15.130:0/3302918931 >> v1:172.21.15.164:6789/0 conn(0x7fce3c055df0 legacy=0x7fce3c054a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fce4a048640 1 -- 172.21.15.130:0/3302918931 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0543d0 con 0x7fce3c03b070 2023-09-13T06:01:32.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fd4ccb12640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd4c0048310 0x7fd4c00eb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fd4ccb12640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c00ebeb0 con 0x7fd4c0033e20 2023-09-13T06:01:32.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fd4ccb12640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c00ec130 con 0x7fd4c0047ce0 2023-09-13T06:01:32.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fd4ccb12640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c004f310 con 0x7fd4c0048310 2023-09-13T06:01:32.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fd4c7fff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fd4c0047ce0 0x7fd4c0052ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:36638/0 (socket says 172.21.15.130:36638) 2023-09-13T06:01:32.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fd4c7fff640 1 -- 172.21.15.130:0/418283588 learned_addr learned my addr 172.21.15.130:0/418283588 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:32.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f8002cd8640 1 -- 172.21.15.130:0/820499910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc06e310 msgr2=0x7f7ffc0ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f8002cd8640 1 --2- 172.21.15.130:0/820499910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc06e310 0x7f7ffc0ccf70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009870 tx=0x7f7ff001c3d0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f8002cd8640 1 -- 172.21.15.130:0/820499910 shutdown_connections 2023-09-13T06:01:32.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f8002cd8640 1 --2- 172.21.15.130:0/820499910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc06e310 0x7f7ffc0ccf70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f8002cd8640 1 --2- 172.21.15.130:0/820499910 >> v2:172.21.15.130:3300/0 conn(0x7f7ffc161560 0x7f7ffc165d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f8002cd8640 1 -- 172.21.15.130:0/820499910 >> 172.21.15.130:0/820499910 conn(0x7f7ffc065d90 msgr2=0x7f7ffc0b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974007045 0 0) 0x7fd4c00ec130 con 0x7fd4c0047ce0 2023-09-13T06:01:32.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4b8003530 con 0x7fd4c0047ce0 2023-09-13T06:01:32.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f8002cd8640 1 -- 172.21.15.130:0/820499910 shutdown_connections 2023-09-13T06:01:32.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3599870255 0 0) 0x7fd4b8003530 con 0x7fd4c0047ce0 2023-09-13T06:01:32.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 >> v2:172.21.15.130:3300/0 conn(0x7fd4c0048310 msgr2=0x7fd4c00eb970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:32.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f8002cd8640 1 -- 172.21.15.130:0/820499910 wait complete. 2023-09-13T06:01:32.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f9026382640 1 Processor -- start 2023-09-13T06:01:32.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f11da7fc640 1 -- 172.21.15.130:0/3034420561 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f11d400e070 con 0x7f11e40aeb90 2023-09-13T06:01:32.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f9026382640 1 -- start start 2023-09-13T06:01:32.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f370c5c7640 1 Processor -- start 2023-09-13T06:01:32.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7fd4c6ffd640 1 --2- 172.21.15.130:0/418283588 >> v2:172.21.15.130:3300/0 conn(0x7fd4c0048310 0x7fd4c00eb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c67fc640 1 --2- 172.21.15.130:0/418283588 >> v2:172.21.15.130:3300/0 conn(0x7fd4c0048310 0x7fd4c00eb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 >> v1:172.21.15.130:6789/0 conn(0x7fd4c0033e20 legacy=0x7fd4c00eb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.136+0000 7f370c5c7640 1 -- start start 2023-09-13T06:01:32.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f11da7fc640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11c8065bf0 0x7f11c80680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c004f5f0 con 0x7fd4c0047ce0 2023-09-13T06:01:32.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fd4c8072660 con 0x7fd4c0047ce0 2023-09-13T06:01:32.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 >> v1:172.21.15.164:6789/0 conn(0x7fd4c0047ce0 legacy=0x7fd4c0052ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c67fc640 1 --2- 172.21.15.130:0/418283588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b8003980 0x7fd4b8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c67fc640 1 --2- 172.21.15.130:0/418283588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4b80047d0 0x7fd4b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c67fc640 1 --2- 172.21.15.130:0/418283588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b8005190 0x7fd4b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c004f310 con 0x7fd4b8003980 2023-09-13T06:01:32.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b800c030 con 0x7fd4b8005190 2023-09-13T06:01:32.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b800c1f0 con 0x7fd4b80047d0 2023-09-13T06:01:32.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c6ffd640 1 --2- 172.21.15.130:0/418283588 >> v2:172.21.15.130:3300/0 conn(0x7fd4c0048310 0x7fd4c00eb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:32.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f11e9016640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11c8065bf0 0x7f11c80680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c7fff640 1 --2- 172.21.15.130:0/418283588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b8005190 0x7fd4b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f11da7fc640 1 -- 172.21.15.130:0/3034420561 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11d4082cb0 con 0x7f11e40aeb90 2023-09-13T06:01:32.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f8002cd8640 1 Processor -- start 2023-09-13T06:01:32.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f9026382640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f90200d1750 0x7f902015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f9026382640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9020146f30 0x7f90200b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f9026382640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90200b63c0 con 0x7f90200d1090 2023-09-13T06:01:32.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f9026382640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902015dea0 con 0x7f9020146f30 2023-09-13T06:01:32.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f9026382640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90200d0c20 con 0x7f90200d1750 2023-09-13T06:01:32.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f11da7fc640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] conn(0x7f11c806de10 0x7f11c8070230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f11da7fc640 1 -- 172.21.15.130:0/3034420561 --> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11c80708e0 con 0x7f11c806de10 2023-09-13T06:01:32.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f11da7fc640 1 -- 172.21.15.130:0/3034420561 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11d4085250 con 0x7f11e40aeb90 2023-09-13T06:01:32.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f8002cd8640 1 -- start start 2023-09-13T06:01:32.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370c5c7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37040b23f0 0x7f37040cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370c5c7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3704071c70 0x7f37040cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f901f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f90200d1090 0x7f9020146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55762/0 (socket says 172.21.15.130:55762) 2023-09-13T06:01:32.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f901f7fe640 1 -- 172.21.15.130:0/2645209474 learned_addr learned my addr 172.21.15.130:0/2645209474 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:32.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f901ffff640 1 --2- 172.21.15.130:0/2645209474 >> v2:172.21.15.164:3300/0 conn(0x7f90200d1750 0x7f902015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370c5c7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3704161a80 con 0x7f3704070280 2023-09-13T06:01:32.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370c5c7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3704161d60 con 0x7f3704071c70 2023-09-13T06:01:32.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370c5c7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3704162040 con 0x7f37040b23f0 2023-09-13T06:01:32.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f11e9016640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11c8065bf0 0x7f11c80680b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f11e406fe50 tx=0x7f11e0016040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f902491f640 1 --2- 172.21.15.130:0/2645209474 >> v2:172.21.15.130:3300/0 conn(0x7f9020146f30 0x7f90200b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fce4a048640 1 --2- 172.21.15.130:0/3302918931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce3c03b070 0x7fce3c038df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce44068a10 tx=0x7fce440968a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce40b6533c04910b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370a363640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37040b23f0 0x7f37040cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370b365640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3704071c70 0x7f37040cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370b365640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3704071c70 0x7f37040cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47892/0 (socket says 172.21.15.130:47892) 2023-09-13T06:01:32.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370b365640 1 -- 172.21.15.130:0/1399161219 learned_addr learned my addr 172.21.15.130:0/1399161219 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f901ffff640 1 -- 172.21.15.130:0/2645209474 >> v2:172.21.15.130:3300/0 conn(0x7f9020146f30 msgr2=0x7f90200b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f901ffff640 1 --2- 172.21.15.130:0/2645209474 >> v2:172.21.15.130:3300/0 conn(0x7f9020146f30 0x7f90200b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f901ffff640 1 -- 172.21.15.130:0/2645209474 >> v1:172.21.15.130:6789/0 conn(0x7f90200d1090 legacy=0x7f9020146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f901ffff640 1 -- 172.21.15.130:0/2645209474 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90200b6610 con 0x7f90200d1750 2023-09-13T06:01:32.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fce48845640 1 -- 172.21.15.130:0/3302918931 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4406c2d0 con 0x7fce3c03b070 2023-09-13T06:01:32.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fce48845640 1 -- 172.21.15.130:0/3302918931 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce44122050 con 0x7fce3c03b070 2023-09-13T06:01:32.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fce48845640 1 -- 172.21.15.130:0/3302918931 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4406c6f0 con 0x7fce3c03b070 2023-09-13T06:01:32.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fa375d9b640 1 -- 172.21.15.130:0/1127921670 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600ab620 con 0x7fa3780adf90 2023-09-13T06:01:32.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fa375d9b640 1 -- 172.21.15.130:0/1127921670 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3600ab780 con 0x7fa3780adf90 2023-09-13T06:01:32.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fa375d9b640 1 -- 172.21.15.130:0/1127921670 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600abb10 con 0x7fa3780adf90 2023-09-13T06:01:32.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fce4a849640 1 -- 172.21.15.130:0/3302918931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce3c03b070 msgr2=0x7fce3c038df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fce4a849640 1 --2- 172.21.15.130:0/3302918931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce3c03b070 0x7fce3c038df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce44068a10 tx=0x7fce440968a0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f8002cd8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ffc06e310 0x7f7ffc157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f8002cd8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ffc0b2930 0x7f7ffc1fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f8002cd8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc161560 0x7f7ffc1f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f8002cd8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc1630f0 con 0x7f7ffc06e310 2023-09-13T06:01:32.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f8002cd8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc163c70 con 0x7f7ffc0b2930 2023-09-13T06:01:32.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f8002cd8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc163340 con 0x7f7ffc161560 2023-09-13T06:01:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8000a74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ffc06e310 0x7f7ffc157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8000a74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ffc06e310 0x7f7ffc157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47900/0 (socket says 172.21.15.130:47900) 2023-09-13T06:01:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8000a74640 1 -- 172.21.15.130:0/72319903 learned_addr learned my addr 172.21.15.130:0/72319903 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8001275640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc161560 0x7f7ffc1f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8000a74640 1 -- 172.21.15.130:0/72319903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc161560 msgr2=0x7f7ffc1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8000a74640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc161560 0x7f7ffc1f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8000a74640 1 -- 172.21.15.130:0/72319903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ffc0b2930 msgr2=0x7f7ffc1fa680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T06:01:32.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8000a74640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ffc0b2930 0x7f7ffc1fa680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8000a74640 1 -- 172.21.15.130:0/72319903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00094d0 con 0x7f7ffc06e310 2023-09-13T06:01:32.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370b365640 1 -- 172.21.15.130:0/1399161219 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37040b23f0 msgr2=0x7f37040cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370b365640 1 --2- 172.21.15.130:0/1399161219 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37040b23f0 0x7f37040cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370b365640 1 -- 172.21.15.130:0/1399161219 >> v1:172.21.15.130:6789/0 conn(0x7f3704070280 legacy=0x7f3704071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7f370b365640 1 -- 172.21.15.130:0/1399161219 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3704162320 con 0x7f3704071c70 2023-09-13T06:01:32.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8001275640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ffc161560 0x7f7ffc1f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:32.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fa37caec640 1 -- 172.21.15.130:0/1127921670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3780adf90 msgr2=0x7fa3780b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fa37caec640 1 --2- 172.21.15.130:0/1127921670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3780adf90 0x7fa3780b2020 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa3780b0040 tx=0x7fa36001c500 comp rx=0 tx=0).stop 2023-09-13T06:01:32.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fce4a849640 1 -- 172.21.15.130:0/3302918931 shutdown_connections 2023-09-13T06:01:32.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fce4a849640 1 --2- 172.21.15.130:0/3302918931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce3c03b070 0x7fce3c038df0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fce4a849640 1 --2- 172.21.15.130:0/3302918931 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce3c0e4870 0x7fce3c0388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fce4a849640 1 -- 172.21.15.130:0/3302918931 >> 172.21.15.130:0/3302918931 conn(0x7fce3c0538b0 msgr2=0x7fce3c053cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8000a74640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ffc06e310 0x7f7ffc157270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800d830 tx=0x7f7fe800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fce4a849640 1 -- 172.21.15.130:0/3302918931 shutdown_connections 2023-09-13T06:01:32.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fce4a849640 1 -- 172.21.15.130:0/3302918931 wait complete. 2023-09-13T06:01:32.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c7fff640 1 -- 172.21.15.130:0/418283588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4b80047d0 msgr2=0x7fd4b8004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:32.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c7fff640 1 --2- 172.21.15.130:0/418283588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4b80047d0 0x7fd4b8004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c7fff640 1 -- 172.21.15.130:0/418283588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b8003980 msgr2=0x7fd4b8003d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:32.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c7fff640 1 --2- 172.21.15.130:0/418283588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b8003980 0x7fd4b8003d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.140+0000 7fd4c7fff640 1 -- 172.21.15.130:0/418283588 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c004f5f0 con 0x7fd4b8005190 2023-09-13T06:01:32.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fd4c7fff640 1 -- 172.21.15.130:0/418283588 reap_dead start 2023-09-13T06:01:32.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f7ff97fa640 1 -- 172.21.15.130:0/72319903 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe800dee0 con 0x7f7ffc06e310 2023-09-13T06:01:32.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f7ff97fa640 1 -- 172.21.15.130:0/72319903 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe8004230 con 0x7f7ffc06e310 2023-09-13T06:01:32.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f7ff97fa640 1 -- 172.21.15.130:0/72319903 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80096c0 con 0x7f7ffc06e310 2023-09-13T06:01:32.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f11ea018640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] conn(0x7f11c806de10 0x7f11c8070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8002cd8640 1 -- 172.21.15.130:0/72319903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc163620 con 0x7f7ffc06e310 2023-09-13T06:01:32.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8002cd8640 1 -- 172.21.15.130:0/72319903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc1577b0 con 0x7f7ffc06e310 2023-09-13T06:01:32.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fd4c7fff640 1 --2- 172.21.15.130:0/418283588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b8005190 0x7fd4b800b990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80727c0 tx=0x7fd4c8097610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fb804495565491f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fa37caec640 1 -- 172.21.15.130:0/1127921670 shutdown_connections 2023-09-13T06:01:32.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fa37caec640 1 --2- 172.21.15.130:0/1127921670 >> v2:172.21.15.164:3300/0 conn(0x7fa3780cd360 0x7fa378158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fa37caec640 1 --2- 172.21.15.130:0/1127921670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3780adf90 0x7fa3780b2020 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fa37caec640 1 -- 172.21.15.130:0/1127921670 >> 172.21.15.130:0/1127921670 conn(0x7fa378065990 msgr2=0x7fa378065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f8002cd8640 1 -- 172.21.15.130:0/72319903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ffc0cd4b0 con 0x7f7ffc06e310 2023-09-13T06:01:32.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8120800 con 0x7fd4b8005190 2023-09-13T06:01:32.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c8120960 con 0x7fd4b8005190 2023-09-13T06:01:32.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fd4c67fc640 1 -- 172.21.15.130:0/418283588 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8120d10 con 0x7fd4b8005190 2023-09-13T06:01:32.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7fa37caec640 1 -- 172.21.15.130:0/1127921670 shutdown_connections 2023-09-13T06:01:32.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.144+0000 7f11ea018640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] conn(0x7f11c806de10 0x7f11c8070230 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fce4a849640 1 Processor -- start 2023-09-13T06:01:32.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fce4a849640 1 -- start start 2023-09-13T06:01:32.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fd4ccb12640 1 -- 172.21.15.130:0/418283588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b8005190 msgr2=0x7fd4b800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fd4ccb12640 1 --2- 172.21.15.130:0/418283588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b8005190 0x7fd4b800b990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80727c0 tx=0x7fd4c8097610 comp rx=0 tx=0).stop 2023-09-13T06:01:32.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fd4ccb12640 1 -- 172.21.15.130:0/418283588 shutdown_connections 2023-09-13T06:01:32.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fd4ccb12640 1 --2- 172.21.15.130:0/418283588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b8005190 0x7fd4b800b990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fd4ccb12640 1 -- 172.21.15.130:0/418283588 >> 172.21.15.130:0/418283588 conn(0x7fd4c0054c20 msgr2=0x7fd4c0055030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fd4ccb12640 1 -- 172.21.15.130:0/418283588 shutdown_connections 2023-09-13T06:01:32.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fd4ccb12640 1 -- 172.21.15.130:0/418283588 wait complete. 2023-09-13T06:01:32.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f370b365640 1 --2- 172.21.15.130:0/1399161219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3704071c70 0x7f37040cbf30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009e10 tx=0x7f36fc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ea118e2aa71d3c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f3709361640 1 -- 172.21.15.130:0/1399161219 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0a5890 con 0x7f3704071c70 2023-09-13T06:01:32.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f3709361640 1 -- 172.21.15.130:0/1399161219 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc0a59f0 con 0x7f3704071c70 2023-09-13T06:01:32.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f3709361640 1 -- 172.21.15.130:0/1399161219 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0a5890 con 0x7f3704071c70 2023-09-13T06:01:32.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f901ffff640 1 --2- 172.21.15.130:0/2645209474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90200d1750 0x7f902015d960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9020073cd0 tx=0x7f900801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=887f9b8fc17fbd89 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f901effd640 1 -- 172.21.15.130:0/2645209474 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080ac600 con 0x7f90200d1750 2023-09-13T06:01:32.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f901effd640 1 -- 172.21.15.130:0/2645209474 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90080a8050 con 0x7f90200d1750 2023-09-13T06:01:32.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f901effd640 1 -- 172.21.15.130:0/2645209474 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080ac980 con 0x7f90200d1750 2023-09-13T06:01:32.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f7ff97fa640 1 -- 172.21.15.130:0/72319903 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7fe8009820 con 0x7f7ffc06e310 2023-09-13T06:01:32.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fce4a849640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce3c03b070 0x7fce3c0dff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fce4a849640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce3c055df0 0x7fce3c04df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fce4a849640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce3c0e4870 0x7fce3c0e0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fce4a849640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c04e480 con 0x7fce3c03b070 2023-09-13T06:01:32.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fce4a849640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0d8ae0 con 0x7fce3c055df0 2023-09-13T06:01:32.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fce4a849640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0d9380 con 0x7fce3c0e4870 2023-09-13T06:01:32.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f370c5c7640 1 -- 172.21.15.130:0/1399161219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3704071c70 msgr2=0x7f37040cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f370c5c7640 1 --2- 172.21.15.130:0/1399161219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3704071c70 0x7f37040cbf30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009e10 tx=0x7f36fc01c920 comp rx=0 tx=0).stop 2023-09-13T06:01:32.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f9026382640 1 -- 172.21.15.130:0/2645209474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90200d1750 msgr2=0x7f902015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f9026382640 1 --2- 172.21.15.130:0/2645209474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90200d1750 0x7f902015d960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9020073cd0 tx=0x7f900801c3a0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f370c5c7640 1 -- 172.21.15.130:0/1399161219 shutdown_connections 2023-09-13T06:01:32.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f370c5c7640 1 --2- 172.21.15.130:0/1399161219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3704071c70 0x7f37040cbf30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f370c5c7640 1 --2- 172.21.15.130:0/1399161219 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37040b23f0 0x7f37040cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f370c5c7640 1 -- 172.21.15.130:0/1399161219 >> 172.21.15.130:0/1399161219 conn(0x7f370406f170 msgr2=0x7f370406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f9026382640 1 -- 172.21.15.130:0/2645209474 shutdown_connections 2023-09-13T06:01:32.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f9026382640 1 --2- 172.21.15.130:0/2645209474 >> v2:172.21.15.130:3300/0 conn(0x7f9020146f30 0x7f90200b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f9026382640 1 --2- 172.21.15.130:0/2645209474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90200d1750 0x7f902015d960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f9026382640 1 -- 172.21.15.130:0/2645209474 >> 172.21.15.130:0/2645209474 conn(0x7f902006f170 msgr2=0x7f902006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f9026382640 1 -- 172.21.15.130:0/2645209474 shutdown_connections 2023-09-13T06:01:32.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f11da7fc640 1 -- 172.21.15.130:0/3034420561 <== osd.1 v2:172.21.15.130:6814/338394792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f11c80708e0 con 0x7f11c806de10 2023-09-13T06:01:32.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f370c5c7640 1 -- 172.21.15.130:0/1399161219 shutdown_connections 2023-09-13T06:01:32.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fa37caec640 1 -- 172.21.15.130:0/1127921670 wait complete. 2023-09-13T06:01:32.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fa37caec640 1 Processor -- start 2023-09-13T06:01:32.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f7ff97fa640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fe0065b50 0x7f7fe0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f7ff97fa640 1 -- 172.21.15.130:0/72319903 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fe8094f90 con 0x7f7ffc06e310 2023-09-13T06:01:32.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f7ff97fa640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] conn(0x7f7fe006dd70 0x7f7fe0070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f7ff97fa640 1 -- 172.21.15.130:0/72319903 --> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fe0070840 con 0x7f7fe006dd70 2023-09-13T06:01:32.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f7ff97fa640 1 -- 172.21.15.130:0/72319903 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fe8095340 con 0x7f7ffc06e310 2023-09-13T06:01:32.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7f8001275640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] conn(0x7f7fe006dd70 0x7f7fe0070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7f8001275640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] conn(0x7f7fe006dd70 0x7f7fe0070190 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fa37caec640 1 -- start start 2023-09-13T06:01:32.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37caec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3780adf90 0x7fa378206230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37caec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3780ae480 0x7fa378203550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fd4ccb12640 1 Processor -- start 2023-09-13T06:01:32.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4ccb12640 1 -- start start 2023-09-13T06:01:32.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4ccb12640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b8005190 0x7fd4c00d5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4ccb12640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c01803f0 0x7fd4c00dd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4ccb12640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c017f850 0x7fd4c017fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4ccb12640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0180210 con 0x7fd4b8005190 2023-09-13T06:01:32.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4ccb12640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c00388e0 con 0x7fd4c01803f0 2023-09-13T06:01:32.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4ccb12640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0038b80 con 0x7fd4c017f850 2023-09-13T06:01:32.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f370c5c7640 1 -- 172.21.15.130:0/1399161219 wait complete. 2023-09-13T06:01:32.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7f370c5c7640 1 Processor -- start 2023-09-13T06:01:32.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7f9026382640 1 -- 172.21.15.130:0/2645209474 wait complete. 2023-09-13T06:01:32.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7f9026382640 1 Processor -- start 2023-09-13T06:01:32.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7f7ff97fa640 1 -- 172.21.15.130:0/72319903 <== osd.2 v2:172.21.15.130:6808/3833443455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f7fe0070840 con 0x7f7fe006dd70 2023-09-13T06:01:32.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fce49847640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce3c03b070 0x7fce3c0dff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fce49847640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce3c03b070 0x7fce3c0dff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47906/0 (socket says 172.21.15.130:47906) 2023-09-13T06:01:32.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.148+0000 7fce49847640 1 -- 172.21.15.130:0/3812886759 learned_addr learned my addr 172.21.15.130:0/3812886759 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fce49847640 1 -- 172.21.15.130:0/3812886759 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce3c0e4870 msgr2=0x7fce3c0e0760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T06:01:32.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fce49847640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce3c0e4870 0x7fce3c0e0760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fce49847640 1 -- 172.21.15.130:0/3812886759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce3c055df0 msgr2=0x7fce3c04df40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T06:01:32.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fce49847640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce3c055df0 0x7fce3c04df40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fce49847640 1 -- 172.21.15.130:0/3812886759 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4406eab0 con 0x7fce3c03b070 2023-09-13T06:01:32.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fce49847640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce3c03b070 0x7fce3c0dff80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce3400e7f0 tx=0x7fce3400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fce3a7fc640 1 -- 172.21.15.130:0/3812886759 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34017c60 con 0x7fce3c03b070 2023-09-13T06:01:32.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fce3a7fc640 1 -- 172.21.15.130:0/3812886759 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce34017dc0 con 0x7fce3c03b070 2023-09-13T06:01:32.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fce3a7fc640 1 -- 172.21.15.130:0/3812886759 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3400c950 con 0x7fce3c03b070 2023-09-13T06:01:32.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37659c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3780adf90 0x7fa378206230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37659c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3780adf90 0x7fa378206230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60612/0 (socket says 172.21.15.130:60612) 2023-09-13T06:01:32.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa36dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3780ae480 0x7fa378203550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa36dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3780ae480 0x7fa378203550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47914/0 (socket says 172.21.15.130:47914) 2023-09-13T06:01:32.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37659c640 1 -- 172.21.15.130:0/3300747034 learned_addr learned my addr 172.21.15.130:0/3300747034 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37caec640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3780cd360 0x7fa3780702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa378206770 con 0x7fa3780ae480 2023-09-13T06:01:32.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa378206a40 con 0x7fa3780cd360 2023-09-13T06:01:32.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa378206d20 con 0x7fa3780adf90 2023-09-13T06:01:32.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4c7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c017f850 0x7fd4c017fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4c7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c017f850 0x7fd4c017fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60606/0 (socket says 172.21.15.130:60606) 2023-09-13T06:01:32.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4c7fff640 1 -- 172.21.15.130:0/3749512040 learned_addr learned my addr 172.21.15.130:0/3749512040 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4c77fe640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b8005190 0x7fd4c00d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4c77fe640 1 -- 172.21.15.130:0/3749512040 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c017f850 msgr2=0x7fd4c017fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4c77fe640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c017f850 0x7fd4c017fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4c77fe640 1 -- 172.21.15.130:0/3749512040 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c01803f0 msgr2=0x7fd4c00dd3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T06:01:32.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4c77fe640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c01803f0 0x7fd4c00dd3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4c77fe640 1 -- 172.21.15.130:0/3749512040 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c0038e60 con 0x7fd4b8005190 2023-09-13T06:01:32.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4c77fe640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b8005190 0x7fd4c00d5040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00c3e0 tx=0x7fd4bc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fd4b3fff640 1 -- 172.21.15.130:0/3749512040 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc003600 con 0x7fd4b8005190 2023-09-13T06:01:32.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fd4ccb12640 1 -- 172.21.15.130:0/3749512040 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c0039140 con 0x7fd4b8005190 2023-09-13T06:01:32.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fd4b3fff640 1 -- 172.21.15.130:0/3749512040 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc003760 con 0x7fd4b8005190 2023-09-13T06:01:32.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fd4b3fff640 1 -- 172.21.15.130:0/3749512040 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc003b10 con 0x7fd4b8005190 2023-09-13T06:01:32.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fd4ccb12640 1 -- 172.21.15.130:0/3749512040 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c00d5580 con 0x7fd4b8005190 2023-09-13T06:01:32.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7f370c5c7640 1 -- start start 2023-09-13T06:01:32.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f370c5c7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3704070280 0x7f3704157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7f9026382640 1 -- start start 2023-09-13T06:01:32.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7f9026382640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90200d1090 0x7f902013eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f901ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90200d1090 0x7f902013eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f901ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90200d1090 0x7f902013eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47928/0 (socket says 172.21.15.130:47928) 2023-09-13T06:01:32.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f9026382640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90200d1750 0x7f902006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f9026382640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9020146f30 0x7f902015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f9026382640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902006c5e0 con 0x7f90200d1090 2023-09-13T06:01:32.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f9026382640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902006b9f0 con 0x7f90200d1750 2023-09-13T06:01:32.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f9026382640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902006bc40 con 0x7f9020146f30 2023-09-13T06:01:32.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f901ffff640 1 -- 172.21.15.130:0/1161884294 learned_addr learned my addr 172.21.15.130:0/1161884294 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37659c640 1 -- 172.21.15.130:0/3300747034 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3780cd360 msgr2=0x7fa3780702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37659c640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3780cd360 0x7fa3780702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37659c640 1 -- 172.21.15.130:0/3300747034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3780ae480 msgr2=0x7fa378203550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37659c640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3780ae480 0x7fa378203550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.152+0000 7fa37659c640 1 -- 172.21.15.130:0/3300747034 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3600094d0 con 0x7fa3780adf90 2023-09-13T06:01:32.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fa37659c640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3780adf90 0x7fa378206230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa36001a130 tx=0x7fa36001ad40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f370c5c7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3704071c70 0x7f37040a8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f370c5c7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37040b23f0 0x7f370406b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f7ffbfff640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fe0065b50 0x7f7fe0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fa36f7fe640 1 -- 172.21.15.130:0/3300747034 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600be3f0 con 0x7fa3780adf90 2023-09-13T06:01:32.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fa36f7fe640 1 -- 172.21.15.130:0/3300747034 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3600be570 con 0x7fa3780adf90 2023-09-13T06:01:32.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fa36f7fe640 1 -- 172.21.15.130:0/3300747034 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600be920 con 0x7fa3780adf90 2023-09-13T06:01:32.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fce4a849640 1 -- 172.21.15.130:0/3812886759 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c039540 con 0x7fce3c03b070 2023-09-13T06:01:32.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fce4a849640 1 -- 172.21.15.130:0/3812886759 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3c0d9010 con 0x7fce3c03b070 2023-09-13T06:01:32.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f901f7fe640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90200d1750 0x7f902006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f902491f640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9020146f30 0x7f902015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f370a363640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3704070280 0x7f3704157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f3709b62640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3704071c70 0x7f37040a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f370a363640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3704070280 0x7f3704157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47940/0 (socket says 172.21.15.130:47940) 2023-09-13T06:01:32.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f3709b62640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3704071c70 0x7f37040a8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37362/0 (socket says 172.21.15.130:37362) 2023-09-13T06:01:32.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f370b365640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37040b23f0 0x7f370406b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa378202d50 con 0x7fa3780adf90 2023-09-13T06:01:32.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f370b365640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37040b23f0 0x7f370406b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60624/0 (socket says 172.21.15.130:60624) 2023-09-13T06:01:32.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f901f7fe640 1 -- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9020146f30 msgr2=0x7f902015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f7ffbfff640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fe0065b50 0x7f7fe0068010 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00ad000 tx=0x7f7ff00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fce4a849640 1 -- 172.21.15.130:0/3812886759 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce3c055920 con 0x7fce3c03b070 2023-09-13T06:01:32.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa378207000 con 0x7fa3780adf90 2023-09-13T06:01:32.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7fd4b3fff640 1 -- 172.21.15.130:0/3749512040 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd4bc003c70 con 0x7fd4b8005190 2023-09-13T06:01:32.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f370c5c7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3704158850 con 0x7f3704070280 2023-09-13T06:01:32.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f370c5c7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3704158b30 con 0x7f3704071c70 2023-09-13T06:01:32.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f370c5c7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3704158e10 con 0x7f37040b23f0 2023-09-13T06:01:32.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f370a363640 1 -- 172.21.15.130:0/754219057 learned_addr learned my addr 172.21.15.130:0/754219057 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f901f7fe640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9020146f30 0x7f902015dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f901f7fe640 1 -- 172.21.15.130:0/1161884294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90200d1090 msgr2=0x7f902013eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f901f7fe640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90200d1090 0x7f902013eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f901f7fe640 1 -- 172.21.15.130:0/1161884294 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9008009420 con 0x7f90200d1750 2023-09-13T06:01:32.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f902491f640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9020146f30 0x7f902015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:32.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.156+0000 7f901f7fe640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90200d1750 0x7f902006dcf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f901000c400 tx=0x7f901000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f3709b62640 1 -- 172.21.15.130:0/754219057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37040b23f0 msgr2=0x7f370406b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f3709b62640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37040b23f0 0x7f370406b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f3709b62640 1 -- 172.21.15.130:0/754219057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3704070280 msgr2=0x7f3704157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f3709b62640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3704070280 0x7f3704157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f3709b62640 1 -- 172.21.15.130:0/754219057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc009af0 con 0x7f3704071c70 2023-09-13T06:01:32.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f370b365640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37040b23f0 0x7f370406b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:32.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fd4b3fff640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd4ac065bf0 0x7fd4ac0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fd4b3fff640 1 -- 172.21.15.130:0/3749512040 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4bc082800 con 0x7fd4b8005190 2023-09-13T06:01:32.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f3709b62640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3704071c70 0x7f37040a8590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36f400b410 tx=0x7f36f400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f901cff9640 1 -- 172.21.15.130:0/1161884294 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9010005cf0 con 0x7f90200d1750 2023-09-13T06:01:32.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f9026382640 1 -- 172.21.15.130:0/1161884294 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90200b7e40 con 0x7f90200d1750 2023-09-13T06:01:32.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f901cff9640 1 -- 172.21.15.130:0/1161884294 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9010005e50 con 0x7f90200d1750 2023-09-13T06:01:32.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fd4c6ffd640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd4ac065bf0 0x7fd4ac0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fd4c6ffd640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd4ac065bf0 0x7fd4ac0680b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00dd350 tx=0x7fd4b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f36faffd640 1 -- 172.21.15.130:0/754219057 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4011830 con 0x7f3704071c70 2023-09-13T06:01:32.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f36faffd640 1 -- 172.21.15.130:0/754219057 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f40119b0 con 0x7f3704071c70 2023-09-13T06:01:32.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f36faffd640 1 -- 172.21.15.130:0/754219057 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4011d60 con 0x7f3704071c70 2023-09-13T06:01:32.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f370c5c7640 1 -- 172.21.15.130:0/754219057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3704159ef0 con 0x7f3704071c70 2023-09-13T06:01:32.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f370c5c7640 1 -- 172.21.15.130:0/754219057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37041642e0 con 0x7f3704071c70 2023-09-13T06:01:32.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f370c5c7640 1 -- 172.21.15.130:0/754219057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36ec000fd0 con 0x7f3704071c70 2023-09-13T06:01:32.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fa36f7fe640 1 -- 172.21.15.130:0/3300747034 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa3600b43f0 con 0x7fa3780adf90 2023-09-13T06:01:32.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fa36f7fe640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa358065bf0 0x7fa3580680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fa36f7fe640 1 -- 172.21.15.130:0/3300747034 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa36011d900 con 0x7fa3780adf90 2023-09-13T06:01:32.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fa36cd99640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] conn(0x7fa3780ac8f0 0x7fa3780accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fa36cd99640 1 -- 172.21.15.130:0/3300747034 --> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa378202bd0 con 0x7fa3780ac8f0 2023-09-13T06:01:32.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f9026382640 1 -- 172.21.15.130:0/1161884294 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902006c200 con 0x7f90200d1750 2023-09-13T06:01:32.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7f901cff9640 1 -- 172.21.15.130:0/1161884294 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100072d0 con 0x7f90200d1750 2023-09-13T06:01:32.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fce3a7fc640 1 -- 172.21.15.130:0/3812886759 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fce3400cab0 con 0x7fce3c03b070 2023-09-13T06:01:32.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fce3a7fc640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce28065bf0 0x7fce280680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fce3a7fc640 1 -- 172.21.15.130:0/3812886759 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce34082f90 con 0x7fce3c03b070 2023-09-13T06:01:32.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fce3a7fc640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] conn(0x7fce2806dd90 0x7fce280701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.160+0000 7fce3a7fc640 1 -- 172.21.15.130:0/3812886759 --> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce28070860 con 0x7fce2806dd90 2023-09-13T06:01:32.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fce3a7fc640 1 -- 172.21.15.130:0/3812886759 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce34009580 con 0x7fce3c03b070 2023-09-13T06:01:32.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7f9026382640 1 -- 172.21.15.130:0/1161884294 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f902016a320 con 0x7f90200d1750 2023-09-13T06:01:32.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fce49046640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce28065bf0 0x7fce280680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc3aac07640 1 -- 172.21.15.130:0/1963919182 --> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc3a40ce130 con 0x7fc39006dd90 2023-09-13T06:01:32.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fa36dd9b640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa358065bf0 0x7fa3580680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fa376d9d640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] conn(0x7fa3780ac8f0 0x7fa3780accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fd4ccb12640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] conn(0x7fd4c00058c0 0x7fd4c0005ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fd4ccb12640 1 -- 172.21.15.130:0/3749512040 --> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4c0008b10 con 0x7fd4c00058c0 2023-09-13T06:01:32.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fce4a048640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] conn(0x7fce2806dd90 0x7fce280701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fd4c7fff640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] conn(0x7fd4c00058c0 0x7fd4c0005ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7f901cff9640 1 -- 172.21.15.130:0/1161884294 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9010007430 con 0x7f90200d1750 2023-09-13T06:01:32.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc3a17fa640 1 -- 172.21.15.130:0/1963919182 <== osd.0 v2:172.21.15.130:6800/3085363071 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc39c011040 con 0x7fc39006dd90 2023-09-13T06:01:32.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fa36dd9b640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa358065bf0 0x7fa3580680b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa378165fe0 tx=0x7fa368008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fa376d9d640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] conn(0x7fa3780ac8f0 0x7fa3780accd0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc38affd640 1 -- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] conn(0x7fc39006dd90 msgr2=0x7fc3900701b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc38affd640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] conn(0x7fc39006dd90 0x7fc3900701b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fce4a048640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] conn(0x7fce2806dd90 0x7fce280701b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fd4c7fff640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] conn(0x7fd4c00058c0 0x7fd4c0005ca0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc38affd640 1 -- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc390065bf0 msgr2=0x7fc3900680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc38affd640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc390065bf0 0x7fc3900680b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc398000c10 tx=0x7fc398008040 comp rx=0 tx=0).stop 2023-09-13T06:01:32.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc38affd640 1 -- 172.21.15.130:0/1963919182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a40aeff0 msgr2=0x7fc3a41449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc38affd640 1 --2- 172.21.15.130:0/1963919182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a40aeff0 0x7fc3a41449c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc39400c3e0 tx=0x7fc39400c8a0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc3a91a4640 1 -- 172.21.15.130:0/1963919182 reap_dead start 2023-09-13T06:01:32.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc38affd640 1 -- 172.21.15.130:0/1963919182 shutdown_connections 2023-09-13T06:01:32.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc38affd640 1 -- 172.21.15.130:0/1963919182 >> 172.21.15.130:0/1963919182 conn(0x7fc3a4065d90 msgr2=0x7fc3a406ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7f901cff9640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9000065bf0 0x7f90000680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fa36f7fe640 1 -- 172.21.15.130:0/3300747034 <== osd.4 v2:172.21.15.164:6800/2197166496 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fa370001de0 con 0x7fa3780ac8f0 2023-09-13T06:01:32.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7f901cff9640 1 -- 172.21.15.130:0/1161884294 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9010083280 con 0x7f90200d1750 2023-09-13T06:01:32.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fd4b3fff640 1 -- 172.21.15.130:0/3749512040 <== osd.5 v2:172.21.15.164:6808/848118120 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fd4c0008b10 con 0x7fd4c00058c0 2023-09-13T06:01:32.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7f901cff9640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] conn(0x7f900006dca0 0x7f90000700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7f901cff9640 1 -- 172.21.15.130:0/1161884294 --> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9000070770 con 0x7f900006dca0 2023-09-13T06:01:32.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7f901cff9640 1 -- 172.21.15.130:0/1161884294 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90100858a0 con 0x7f90200d1750 2023-09-13T06:01:32.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fce49046640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce28065bf0 0x7fce280680b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fce40007fd0 tx=0x7fce400079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7f901ffff640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9000065bf0 0x7f90000680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fce3a7fc640 1 -- 172.21.15.130:0/3812886759 <== osd.3 v2:172.21.15.130:6810/2159009057 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fce28070860 con 0x7fce2806dd90 2023-09-13T06:01:32.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7fc38affd640 1 -- 172.21.15.130:0/1963919182 shutdown_connections 2023-09-13T06:01:32.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f901ffff640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9000065bf0 0x7f90000680b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9008000c10 tx=0x7f9008008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.164+0000 7f36faffd640 1 -- 172.21.15.130:0/754219057 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f36f401a400 con 0x7f3704071c70 2023-09-13T06:01:32.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f36faffd640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f36e8065ba0 0x7f36e8068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f36faffd640 1 -- 172.21.15.130:0/754219057 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36f40837b0 con 0x7f3704071c70 2023-09-13T06:01:32.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f36faffd640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] conn(0x7f36e806ddc0 0x7f36e80701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f36faffd640 1 -- 172.21.15.130:0/754219057 --> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36e8070890 con 0x7f36e806ddc0 2023-09-13T06:01:32.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f36faffd640 1 -- 172.21.15.130:0/754219057 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36f4083c50 con 0x7f3704071c70 2023-09-13T06:01:32.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7fc38affd640 1 -- 172.21.15.130:0/1963919182 wait complete. 2023-09-13T06:01:32.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f370b365640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] conn(0x7f36e806ddc0 0x7f36e80701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f370a363640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f36e8065ba0 0x7f36e8068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f902491f640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] conn(0x7f900006dca0 0x7f90000700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f370a363640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f36e8065ba0 0x7f36e8068060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3700009c20 tx=0x7f3700009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f902491f640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] conn(0x7f900006dca0 0x7f90000700c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f370b365640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] conn(0x7f36e806ddc0 0x7f36e80701e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f901cff9640 1 -- 172.21.15.130:0/1161884294 <== osd.7 v2:172.21.15.164:6824/3372769909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f9000070770 con 0x7f900006dca0 2023-09-13T06:01:32.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.168+0000 7f36faffd640 1 -- 172.21.15.130:0/754219057 <== osd.6 v2:172.21.15.164:6815/3345829618 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f36e8070890 con 0x7f36e806ddc0 2023-09-13T06:01:32.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.176+0000 7f8002cd8640 1 -- 172.21.15.130:0/72319903 --> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ffc165850 con 0x7f7fe006dd70 2023-09-13T06:01:32.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.180+0000 7f7ff97fa640 1 -- 172.21.15.130:0/72319903 <== osd.2 v2:172.21.15.130:6808/3833443455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ff400e300 con 0x7f7fe006dd70 2023-09-13T06:01:32.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.180+0000 7f8002cd8640 1 -- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] conn(0x7f7fe006dd70 msgr2=0x7f7fe0070190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.180+0000 7f8002cd8640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] conn(0x7f7fe006dd70 0x7f7fe0070190 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.184+0000 7f8002cd8640 1 -- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fe0065b50 msgr2=0x7f7fe0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.184+0000 7f8002cd8640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fe0065b50 0x7f7fe0068010 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00ad000 tx=0x7f7ff00a6000 comp rx=0 tx=0).stop 2023-09-13T06:01:32.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.184+0000 7f8002cd8640 1 -- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ffc06e310 msgr2=0x7f7ffc157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.184+0000 7f8002cd8640 1 --2- 172.21.15.130:0/72319903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ffc06e310 0x7f7ffc157270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800d830 tx=0x7f7fe800dcf0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.184+0000 7f8001275640 1 -- 172.21.15.130:0/72319903 reap_dead start 2023-09-13T06:01:32.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.184+0000 7f8002cd8640 1 -- 172.21.15.130:0/72319903 shutdown_connections 2023-09-13T06:01:32.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.184+0000 7f8002cd8640 1 -- 172.21.15.130:0/72319903 >> 172.21.15.130:0/72319903 conn(0x7f7ffc065d90 msgr2=0x7f7ffc0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.184+0000 7f8002cd8640 1 -- 172.21.15.130:0/72319903 shutdown_connections 2023-09-13T06:01:32.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.184+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 --> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f11e406bc30 con 0x7f11c806de10 2023-09-13T06:01:32.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.184+0000 7f8002cd8640 1 -- 172.21.15.130:0/72319903 wait complete. 2023-09-13T06:01:32.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.184+0000 7f11da7fc640 1 -- 172.21.15.130:0/3034420561 <== osd.1 v2:172.21.15.130:6814/338394792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f11dc009450 con 0x7f11c806de10 2023-09-13T06:01:32.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.188+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] conn(0x7f11c806de10 msgr2=0x7f11c8070230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.188+0000 7f11eba7b640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] conn(0x7f11c806de10 0x7f11c8070230 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.188+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11c8065bf0 msgr2=0x7f11c80680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.188+0000 7f11eba7b640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11c8065bf0 0x7f11c80680b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f11e406fe50 tx=0x7f11e0016040 comp rx=0 tx=0).stop 2023-09-13T06:01:32.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.188+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11e40aeb90 msgr2=0x7f11e40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.188+0000 7f11eba7b640 1 --2- 172.21.15.130:0/3034420561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11e40aeb90 0x7f11e40702e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009aa0 tx=0x7f11d4009f60 comp rx=0 tx=0).stop 2023-09-13T06:01:32.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.188+0000 7f11ea018640 1 -- 172.21.15.130:0/3034420561 reap_dead start 2023-09-13T06:01:32.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.188+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 shutdown_connections 2023-09-13T06:01:32.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.188+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 >> 172.21.15.130:0/3034420561 conn(0x7f11e4065990 msgr2=0x7f11e40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.188+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 shutdown_connections 2023-09-13T06:01:32.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.188+0000 7f11eba7b640 1 -- 172.21.15.130:0/3034420561 wait complete. 2023-09-13T06:01:32.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.192+0000 7fce4a849640 1 -- 172.21.15.130:0/3812886759 --> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fce3c0058f0 con 0x7fce2806dd90 2023-09-13T06:01:32.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.192+0000 7fce3a7fc640 1 -- 172.21.15.130:0/3812886759 <== osd.3 v2:172.21.15.130:6810/2159009057 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fce3c0058f0 con 0x7fce2806dd90 2023-09-13T06:01:32.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.192+0000 7fce4a849640 1 -- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] conn(0x7fce2806dd90 msgr2=0x7fce280701b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.192+0000 7fce4a849640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] conn(0x7fce2806dd90 0x7fce280701b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.192+0000 7f9026382640 1 -- 172.21.15.130:0/1161884294 --> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f90200618a0 con 0x7f900006dca0 2023-09-13T06:01:32.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.192+0000 7f370c5c7640 1 -- 172.21.15.130:0/754219057 --> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36ec002cc0 con 0x7f36e806ddc0 2023-09-13T06:01:32.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.192+0000 7fce4a849640 1 -- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce28065bf0 msgr2=0x7fce280680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.192+0000 7fce4a849640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce28065bf0 0x7fce280680b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fce40007fd0 tx=0x7fce400079a0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.192+0000 7fce4a849640 1 -- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce3c03b070 msgr2=0x7fce3c0dff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fce4a849640 1 --2- 172.21.15.130:0/3812886759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce3c03b070 0x7fce3c0dff80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce3400e7f0 tx=0x7fce3400ecb0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fce4a048640 1 -- 172.21.15.130:0/3812886759 reap_dead start 2023-09-13T06:01:32.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f36faffd640 1 -- 172.21.15.130:0/754219057 <== osd.6 v2:172.21.15.164:6815/3345829618 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f36ec002cc0 con 0x7f36e806ddc0 2023-09-13T06:01:32.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f901cff9640 1 -- 172.21.15.130:0/1161884294 <== osd.7 v2:172.21.15.164:6824/3372769909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f90200618a0 con 0x7f900006dca0 2023-09-13T06:01:32.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4ccb12640 1 -- 172.21.15.130:0/3749512040 --> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4c00d5e90 con 0x7fd4c00058c0 2023-09-13T06:01:32.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fce4a849640 1 -- 172.21.15.130:0/3812886759 shutdown_connections 2023-09-13T06:01:32.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fce4a849640 1 -- 172.21.15.130:0/3812886759 >> 172.21.15.130:0/3812886759 conn(0x7fce3c0538b0 msgr2=0x7fce3c056d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f370c5c7640 1 -- 172.21.15.130:0/754219057 >> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] conn(0x7f36e806ddc0 msgr2=0x7f36e80701e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f370c5c7640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] conn(0x7f36e806ddc0 0x7f36e80701e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f9026382640 1 -- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] conn(0x7f900006dca0 msgr2=0x7f90000700c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f9026382640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] conn(0x7f900006dca0 0x7f90000700c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fce4a849640 1 -- 172.21.15.130:0/3812886759 shutdown_connections 2023-09-13T06:01:32.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fce4a849640 1 -- 172.21.15.130:0/3812886759 wait complete. 2023-09-13T06:01:32.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4b3fff640 1 -- 172.21.15.130:0/3749512040 <== osd.5 v2:172.21.15.164:6808/848118120 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd4c00d5e90 con 0x7fd4c00058c0 2023-09-13T06:01:32.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f9026382640 1 -- 172.21.15.130:0/1161884294 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9000065bf0 msgr2=0x7f90000680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f9026382640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9000065bf0 0x7f90000680b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9008000c10 tx=0x7f9008008040 comp rx=0 tx=0).stop 2023-09-13T06:01:32.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f9026382640 1 -- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90200d1750 msgr2=0x7f902006dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f9026382640 1 --2- 172.21.15.130:0/1161884294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90200d1750 0x7f902006dcf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f901000c400 tx=0x7f901000c8c0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f902491f640 1 -- 172.21.15.130:0/1161884294 reap_dead start 2023-09-13T06:01:32.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f9026382640 1 -- 172.21.15.130:0/1161884294 shutdown_connections 2023-09-13T06:01:32.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f9026382640 1 -- 172.21.15.130:0/1161884294 >> 172.21.15.130:0/1161884294 conn(0x7f902006f170 msgr2=0x7f902015f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f370c5c7640 1 -- 172.21.15.130:0/754219057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f36e8065ba0 msgr2=0x7f36e8068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f370c5c7640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f36e8065ba0 0x7f36e8068060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3700009c20 tx=0x7f3700009190 comp rx=0 tx=0).stop 2023-09-13T06:01:32.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f9026382640 1 -- 172.21.15.130:0/1161884294 shutdown_connections 2023-09-13T06:01:32.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4ccb12640 1 -- 172.21.15.130:0/3749512040 >> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] conn(0x7fd4c00058c0 msgr2=0x7fd4c0005ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4ccb12640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] conn(0x7fd4c00058c0 0x7fd4c0005ca0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f9026382640 1 -- 172.21.15.130:0/1161884294 wait complete. 2023-09-13T06:01:32.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4ccb12640 1 -- 172.21.15.130:0/3749512040 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd4ac065bf0 msgr2=0x7fd4ac0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4ccb12640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd4ac065bf0 0x7fd4ac0680b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00dd350 tx=0x7fd4b4008040 comp rx=0 tx=0).stop 2023-09-13T06:01:32.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4ccb12640 1 -- 172.21.15.130:0/3749512040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b8005190 msgr2=0x7fd4c00d5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4ccb12640 1 --2- 172.21.15.130:0/3749512040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b8005190 0x7fd4c00d5040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00c3e0 tx=0x7fd4bc00c8a0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4c7fff640 1 -- 172.21.15.130:0/3749512040 reap_dead start 2023-09-13T06:01:32.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4ccb12640 1 -- 172.21.15.130:0/3749512040 shutdown_connections 2023-09-13T06:01:32.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4ccb12640 1 -- 172.21.15.130:0/3749512040 >> 172.21.15.130:0/3749512040 conn(0x7fd4c0054c20 msgr2=0x7fd4c00366f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4ccb12640 1 -- 172.21.15.130:0/3749512040 shutdown_connections 2023-09-13T06:01:32.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f370c5c7640 1 -- 172.21.15.130:0/754219057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3704071c70 msgr2=0x7f37040a8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f370c5c7640 1 --2- 172.21.15.130:0/754219057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3704071c70 0x7f37040a8590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36f400b410 tx=0x7f36f400b8d0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7fd4ccb12640 1 -- 172.21.15.130:0/3749512040 wait complete. 2023-09-13T06:01:32.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f370b365640 1 -- 172.21.15.130:0/754219057 reap_dead start 2023-09-13T06:01:32.307 INFO:teuthology.orchestra.run.smithi130.stdout:55834574853 2023-09-13T06:01:32.307 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-13T06:01:32.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f370c5c7640 1 -- 172.21.15.130:0/754219057 shutdown_connections 2023-09-13T06:01:32.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.196+0000 7f370c5c7640 1 -- 172.21.15.130:0/754219057 >> 172.21.15.130:0/754219057 conn(0x7f370406f170 msgr2=0x7f37040b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.200+0000 7f370c5c7640 1 -- 172.21.15.130:0/754219057 shutdown_connections 2023-09-13T06:01:32.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.200+0000 7f370c5c7640 1 -- 172.21.15.130:0/754219057 wait complete. 2023-09-13T06:01:32.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.200+0000 7fa36cd99640 1 -- 172.21.15.130:0/3300747034 --> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3780618a0 con 0x7fa3780ac8f0 2023-09-13T06:01:32.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.200+0000 7fa36f7fe640 1 -- 172.21.15.130:0/3300747034 <== osd.4 v2:172.21.15.164:6800/2197166496 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3780618a0 con 0x7fa3780ac8f0 2023-09-13T06:01:32.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.200+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 >> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] conn(0x7fa3780ac8f0 msgr2=0x7fa3780accd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.200+0000 7fa37caec640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] conn(0x7fa3780ac8f0 0x7fa3780accd0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.200+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa358065bf0 msgr2=0x7fa3580680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.200+0000 7fa37caec640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa358065bf0 0x7fa3580680b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa378165fe0 tx=0x7fa368008040 comp rx=0 tx=0).stop 2023-09-13T06:01:32.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.204+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3780adf90 msgr2=0x7fa378206230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.204+0000 7fa37caec640 1 --2- 172.21.15.130:0/3300747034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3780adf90 0x7fa378206230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa36001a130 tx=0x7fa36001ad40 comp rx=0 tx=0).stop 2023-09-13T06:01:32.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.204+0000 7fa376d9d640 1 -- 172.21.15.130:0/3300747034 reap_dead start 2023-09-13T06:01:32.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.204+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 shutdown_connections 2023-09-13T06:01:32.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.204+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 >> 172.21.15.130:0/3300747034 conn(0x7fa378065990 msgr2=0x7fa3780afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.204+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 shutdown_connections 2023-09-13T06:01:32.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.204+0000 7fa37caec640 1 -- 172.21.15.130:0/3300747034 wait complete. 2023-09-13T06:01:32.314 INFO:teuthology.orchestra.run.smithi130.stdout:55834574853 2023-09-13T06:01:32.315 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-13T06:01:32.316 INFO:teuthology.orchestra.run.smithi130.stdout:55834574853 2023-09-13T06:01:32.316 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-13T06:01:32.317 INFO:teuthology.orchestra.run.smithi130.stdout:55834574853 2023-09-13T06:01:32.317 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-13T06:01:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:55834574853 2023-09-13T06:01:32.319 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-13T06:01:32.320 INFO:teuthology.orchestra.run.smithi130.stdout:55834574853 2023-09-13T06:01:32.320 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-13T06:01:32.321 INFO:teuthology.orchestra.run.smithi130.stdout:55834574853 2023-09-13T06:01:32.321 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-13T06:01:32.323 INFO:teuthology.orchestra.run.smithi130.stdout:55834574853 2023-09-13T06:01:32.323 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-13T06:01:32.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a41d59640 1 Processor -- start 2023-09-13T06:01:32.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a41d59640 1 -- start start 2023-09-13T06:01:32.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a41d59640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a3c0af700 0x7f3a3c0b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a41d59640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3a3c15a490 0x7f3a3c06cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a41d59640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a3c06c8e0 con 0x7f3a3c157a80 2023-09-13T06:01:32.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a41d59640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a3c0b34f0 con 0x7f3a3c0af700 2023-09-13T06:01:32.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a41d59640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a3c15a950 con 0x7f3a3c15a490 2023-09-13T06:01:32.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a3affd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a3c0af700 0x7f3a3c0b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a3affd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a3c0af700 0x7f3a3c0b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47948/0 (socket says 172.21.15.130:47948) 2023-09-13T06:01:32.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a3affd640 1 -- 172.21.15.130:0/53737824 learned_addr learned my addr 172.21.15.130:0/53737824 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a3bfff640 1 --2- 172.21.15.130:0/53737824 >> v2:172.21.15.164:3300/0 conn(0x7f3a3c15a490 0x7f3a3c06cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a3bfff640 1 -- 172.21.15.130:0/53737824 >> v2:172.21.15.130:3300/0 conn(0x7f3a3c0af700 msgr2=0x7f3a3c0b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a3bfff640 1 --2- 172.21.15.130:0/53737824 >> v2:172.21.15.130:3300/0 conn(0x7f3a3c0af700 0x7f3a3c0b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a3bfff640 1 -- 172.21.15.130:0/53737824 >> v1:172.21.15.164:6789/0 conn(0x7f3a3c157a80 legacy=0x7f3a3c0aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a3bfff640 1 -- 172.21.15.130:0/53737824 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c15ac30 con 0x7f3a3c15a490 2023-09-13T06:01:32.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.592+0000 7f3a3affd640 1 --2- 172.21.15.130:0/53737824 >> v2:172.21.15.130:3300/0 conn(0x7f3a3c0af700 0x7f3a3c0b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:32.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a3bfff640 1 --2- 172.21.15.130:0/53737824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a3c15a490 0x7f3a3c06cdc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c06bb50 tx=0x7f3a3401c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e251b8a73d208f8e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a3a7fc640 1 -- 172.21.15.130:0/53737824 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340a57b0 con 0x7f3a3c15a490 2023-09-13T06:01:32.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a3a7fc640 1 -- 172.21.15.130:0/53737824 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a340a5910 con 0x7f3a3c15a490 2023-09-13T06:01:32.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a3a7fc640 1 -- 172.21.15.130:0/53737824 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340a5ca0 con 0x7f3a3c15a490 2023-09-13T06:01:32.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a41d59640 1 -- 172.21.15.130:0/53737824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a3c15a490 msgr2=0x7f3a3c06cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a41d59640 1 --2- 172.21.15.130:0/53737824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a3c15a490 0x7f3a3c06cdc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c06bb50 tx=0x7f3a3401c770 comp rx=0 tx=0).stop 2023-09-13T06:01:32.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a41d59640 1 -- 172.21.15.130:0/53737824 shutdown_connections 2023-09-13T06:01:32.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a41d59640 1 --2- 172.21.15.130:0/53737824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a3c15a490 0x7f3a3c06cdc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a41d59640 1 --2- 172.21.15.130:0/53737824 >> v2:172.21.15.130:3300/0 conn(0x7f3a3c0af700 0x7f3a3c0b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a41d59640 1 -- 172.21.15.130:0/53737824 >> 172.21.15.130:0/53737824 conn(0x7f3a3c065d90 msgr2=0x7f3a3c0b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a41d59640 1 -- 172.21.15.130:0/53737824 shutdown_connections 2023-09-13T06:01:32.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.600+0000 7f3a41d59640 1 -- 172.21.15.130:0/53737824 wait complete. 2023-09-13T06:01:32.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7f3a41d59640 1 Processor -- start 2023-09-13T06:01:32.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7fa20d4ec640 1 Processor -- start 2023-09-13T06:01:32.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7fa20d4ec640 1 -- start start 2023-09-13T06:01:32.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7f3a41d59640 1 -- start start 2023-09-13T06:01:32.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7fe058d79640 1 Processor -- start 2023-09-13T06:01:32.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7fe058d79640 1 -- start start 2023-09-13T06:01:32.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7f3a41d59640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a3c0af700 0x7f3a3c0cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7f3a41d59640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3c157a80 0x7f3a3c145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7fa20d4ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa2080ccc00 0x7fa2080cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7fa20d4ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2080cd5a0 con 0x7fa2081577f0 2023-09-13T06:01:32.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7fa20d4ec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa208161a40 con 0x7fa2080b1360 2023-09-13T06:01:32.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7fa20d4ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa208160e30 con 0x7fa2080ccc00 2023-09-13T06:01:32.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.604+0000 7f3a41d59640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a3c15a490 0x7f3a3c070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a41d59640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c1428f0 con 0x7f3a3c0af700 2023-09-13T06:01:32.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3affd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3c157a80 0x7f3a3c145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3affd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3c157a80 0x7f3a3c145360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60636/0 (socket says 172.21.15.130:60636) 2023-09-13T06:01:32.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3affd640 1 -- 172.21.15.130:0/2136125181 learned_addr learned my addr 172.21.15.130:0/2136125181 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3bfff640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a3c15a490 0x7f3a3c070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a41d59640 1 -- 172.21.15.130:0/2136125181 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c1458a0 con 0x7f3a3c15a490 2023-09-13T06:01:32.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fa2077fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fa2080b1360 0x7fa2080b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:36656/0 (socket says 172.21.15.130:36656) 2023-09-13T06:01:32.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fa2077fe640 1 -- 172.21.15.130:0/1513462411 learned_addr learned my addr 172.21.15.130:0/1513462411 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:32.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fa2067fc640 1 --2- 172.21.15.130:0/1513462411 >> v2:172.21.15.130:3300/0 conn(0x7fa2080ccc00 0x7fa2080cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe058d79640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe0540703e0 0x7fe0540b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe058d79640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05406e300 0x7fe054152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe058d79640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05415a960 con 0x7fe05415a440 2023-09-13T06:01:32.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe058d79640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05415acb0 con 0x7fe0540703e0 2023-09-13T06:01:32.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe058d79640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540b1bb0 con 0x7fe05406e300 2023-09-13T06:01:32.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe052ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe05415a440 0x7fe05406dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55794/0 (socket says 172.21.15.130:55794) 2023-09-13T06:01:32.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe052ffd640 1 -- 172.21.15.130:0/2053343241 learned_addr learned my addr 172.21.15.130:0/2053343241 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:32.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a41d59640 1 -- 172.21.15.130:0/2136125181 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c0cc610 con 0x7f3a3c157a80 2023-09-13T06:01:32.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3b7fe640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a3c0af700 0x7f3a3c0cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fa205ffb640 1 -- 172.21.15.130:0/1513462411 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508698118 0 0) 0x7fa208161a40 con 0x7fa2080b1360 2023-09-13T06:01:32.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fa205ffb640 1 -- 172.21.15.130:0/1513462411 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f0003530 con 0x7fa2080b1360 2023-09-13T06:01:32.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3affd640 1 -- 172.21.15.130:0/2136125181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a3c15a490 msgr2=0x7f3a3c070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3affd640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a3c15a490 0x7f3a3c070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3affd640 1 -- 172.21.15.130:0/2136125181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a3c0af700 msgr2=0x7f3a3c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3affd640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a3c0af700 0x7f3a3c0cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3affd640 1 -- 172.21.15.130:0/2136125181 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0094d0 con 0x7f3a3c157a80 2023-09-13T06:01:32.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fa205ffb640 1 -- 172.21.15.130:0/1513462411 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394399512 0 0) 0x7fa2080cd5a0 con 0x7fa2081577f0 2023-09-13T06:01:32.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fa205ffb640 1 -- 172.21.15.130:0/1513462411 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa208161a40 con 0x7fa2081577f0 2023-09-13T06:01:32.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fa205ffb640 1 -- 172.21.15.130:0/1513462411 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 449649285 0 0) 0x7fa1f0003530 con 0x7fa2080b1360 2023-09-13T06:01:32.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fa2067fc640 1 -- 172.21.15.130:0/1513462411 >> v1:172.21.15.164:6789/0 conn(0x7fa2080b1360 legacy=0x7fa2080b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fa2067fc640 1 -- 172.21.15.130:0/1513462411 >> v1:172.21.15.130:6789/0 conn(0x7fa2081577f0 legacy=0x7fa2080b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fa2067fc640 1 -- 172.21.15.130:0/1513462411 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208161110 con 0x7fa2080ccc00 2023-09-13T06:01:32.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3b7fe640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a3c0af700 0x7f3a3c0cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:32.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a3affd640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3c157a80 0x7f3a3c145360 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00e980 tx=0x7f3a2c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe053fff640 1 --2- 172.21.15.130:0/2053343241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05406e300 0x7fe054152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe0537fe640 1 --2- 172.21.15.130:0/2053343241 >> v2:172.21.15.164:3300/0 conn(0x7fe0540703e0 0x7fe0540b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a23fff640 1 -- 172.21.15.130:0/2136125181 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c00ca00 con 0x7f3a3c157a80 2023-09-13T06:01:32.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a23fff640 1 -- 172.21.15.130:0/2136125181 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c00cb60 con 0x7f3a3c157a80 2023-09-13T06:01:32.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a23fff640 1 -- 172.21.15.130:0/2136125181 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c013470 con 0x7f3a3c157a80 2023-09-13T06:01:32.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7f3a41d59640 1 -- 172.21.15.130:0/2136125181 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a34009a70 con 0x7f3a3c157a80 2023-09-13T06:01:32.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe053fff640 1 -- 172.21.15.130:0/2053343241 >> v2:172.21.15.164:3300/0 conn(0x7fe0540703e0 msgr2=0x7fe0540b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe053fff640 1 --2- 172.21.15.130:0/2053343241 >> v2:172.21.15.164:3300/0 conn(0x7fe0540703e0 0x7fe0540b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe053fff640 1 -- 172.21.15.130:0/2053343241 >> v1:172.21.15.130:6789/0 conn(0x7fe05415a440 legacy=0x7fe05406dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe053fff640 1 -- 172.21.15.130:0/2053343241 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0540b1e90 con 0x7fe05406e300 2023-09-13T06:01:32.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.608+0000 7fe0537fe640 1 --2- 172.21.15.130:0/2053343241 >> v2:172.21.15.164:3300/0 conn(0x7fe0540703e0 0x7fe0540b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:32.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7f3a41d59640 1 -- 172.21.15.130:0/2136125181 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3c0ccbd0 con 0x7f3a3c157a80 2023-09-13T06:01:32.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7fe053fff640 1 --2- 172.21.15.130:0/2053343241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05406e300 0x7fe054152ed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009250 tx=0x7fe04c0256e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5083766f8b9ca3ea server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7f3a41d59640 1 -- 172.21.15.130:0/2136125181 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3c0618a0 con 0x7f3a3c157a80 2023-09-13T06:01:32.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7fe0527fc640 1 -- 172.21.15.130:0/2053343241 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0af6b0 con 0x7fe05406e300 2023-09-13T06:01:32.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7fa2067fc640 1 --2- 172.21.15.130:0/1513462411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2080ccc00 0x7fa2080cd060 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa200009d90 tx=0x7fa20001f020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4545a2f2a94d4a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7f64c7fff640 1 Processor -- start 2023-09-13T06:01:32.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7f3a23fff640 1 -- 172.21.15.130:0/2136125181 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3a2c0135d0 con 0x7f3a3c157a80 2023-09-13T06:01:32.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7fe0527fc640 1 -- 172.21.15.130:0/2053343241 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c0af810 con 0x7fe05406e300 2023-09-13T06:01:32.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7fe0527fc640 1 -- 172.21.15.130:0/2053343241 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0af6b0 con 0x7fe05406e300 2023-09-13T06:01:32.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7fa205ffb640 1 -- 172.21.15.130:0/1513462411 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc001680 con 0x7fa2080ccc00 2023-09-13T06:01:32.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7fa205ffb640 1 -- 172.21.15.130:0/1513462411 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2000a8bf0 con 0x7fa2080ccc00 2023-09-13T06:01:32.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7fa205ffb640 1 -- 172.21.15.130:0/1513462411 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000b0440 con 0x7fa2080ccc00 2023-09-13T06:01:32.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f3a23fff640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3a28065b70 0x7f3a28068030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f3a23fff640 1 -- 172.21.15.130:0/2136125181 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a2c084e30 con 0x7f3a3c157a80 2023-09-13T06:01:32.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fe058d79640 1 -- 172.21.15.130:0/2053343241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05406e300 msgr2=0x7fe054152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fe058d79640 1 --2- 172.21.15.130:0/2053343241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05406e300 0x7fe054152ed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009250 tx=0x7fe04c0256e0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fe058d79640 1 -- 172.21.15.130:0/2053343241 shutdown_connections 2023-09-13T06:01:32.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fe058d79640 1 --2- 172.21.15.130:0/2053343241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05406e300 0x7fe054152ed0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fe058d79640 1 --2- 172.21.15.130:0/2053343241 >> v2:172.21.15.164:3300/0 conn(0x7fe0540703e0 0x7fe0540b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fe058d79640 1 -- 172.21.15.130:0/2053343241 >> 172.21.15.130:0/2053343241 conn(0x7fe054065b60 msgr2=0x7fe0540aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f3a3b7fe640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3a28065b70 0x7f3a28068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fa20d4ec640 1 -- 172.21.15.130:0/1513462411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2080ccc00 msgr2=0x7fa2080cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fa20d4ec640 1 --2- 172.21.15.130:0/1513462411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2080ccc00 0x7fa2080cd060 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa200009d90 tx=0x7fa20001f020 comp rx=0 tx=0).stop 2023-09-13T06:01:32.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.612+0000 7f64c7fff640 1 -- start start 2023-09-13T06:01:32.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fe058d79640 1 -- 172.21.15.130:0/2053343241 shutdown_connections 2023-09-13T06:01:32.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fe058d79640 1 -- 172.21.15.130:0/2053343241 wait complete. 2023-09-13T06:01:32.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f3a3b7fe640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3a28065b70 0x7f3a28068030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a30000f70 tx=0x7f3a30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fa4f54af640 1 Processor -- start 2023-09-13T06:01:32.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fa20d4ec640 1 -- 172.21.15.130:0/1513462411 shutdown_connections 2023-09-13T06:01:32.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fa20d4ec640 1 --2- 172.21.15.130:0/1513462411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2080ccc00 0x7fa2080cd060 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fa20d4ec640 1 -- 172.21.15.130:0/1513462411 >> 172.21.15.130:0/1513462411 conn(0x7fa208065990 msgr2=0x7fa208065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fa4f54af640 1 -- start start 2023-09-13T06:01:32.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fa20d4ec640 1 -- 172.21.15.130:0/1513462411 shutdown_connections 2023-09-13T06:01:32.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f60c29a9640 1 Processor -- start 2023-09-13T06:01:32.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7fa20d4ec640 1 -- 172.21.15.130:0/1513462411 wait complete. 2023-09-13T06:01:32.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f64c7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 0x7f64c80adf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f64c7fff640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c80aec30 con 0x7f64c81613e0 2023-09-13T06:01:32.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f64c7fff640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c8165350 con 0x7f64c8165e30 2023-09-13T06:01:32.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f64c7fff640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80aef10 con 0x7f64c80b4a60 2023-09-13T06:01:32.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f64be7fc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 0x7f64c80adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f64c6ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f64c81613e0 0x7f64c80b4350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55808/0 (socket says 172.21.15.130:55808) 2023-09-13T06:01:32.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f64c6ffd640 1 -- 172.21.15.130:0/2108367508 learned_addr learned my addr 172.21.15.130:0/2108367508 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:32.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f64be7fc640 1 -- 172.21.15.130:0/2108367508 >> v1:172.21.15.164:6789/0 conn(0x7f64c8165e30 legacy=0x7f64c80ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f64be7fc640 1 -- 172.21.15.130:0/2108367508 >> v1:172.21.15.130:6789/0 conn(0x7f64c81613e0 legacy=0x7f64c80b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f60c29a9640 1 -- start start 2023-09-13T06:01:32.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe058d79640 1 Processor -- start 2023-09-13T06:01:32.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe058d79640 1 -- start start 2023-09-13T06:01:32.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa20d4ec640 1 Processor -- start 2023-09-13T06:01:32.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c29a9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc0b31c0 0x7f60bc06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c29a9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f60bc06fe00 0x7f60bc0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c29a9640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc0cded0 con 0x7f60bc1590e0 2023-09-13T06:01:32.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c29a9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60bc06b880 con 0x7f60bc06fe00 2023-09-13T06:01:32.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c29a9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0cb820 con 0x7f60bc0b31c0 2023-09-13T06:01:32.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f3a23fff640 1 -- 172.21.15.130:0/2136125181 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3a2c088060 con 0x7f3a3c157a80 2023-09-13T06:01:32.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa20d4ec640 1 -- start start 2023-09-13T06:01:32.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c11a6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc0b31c0 0x7f60bc06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c11a6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc0b31c0 0x7f60bc06f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60664/0 (socket says 172.21.15.130:60664) 2023-09-13T06:01:32.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c11a6640 1 -- 172.21.15.130:0/2384350508 learned_addr learned my addr 172.21.15.130:0/2384350508 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe058d79640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05406e300 0x7fe05406ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c21a8640 1 --2- 172.21.15.130:0/2384350508 >> v2:172.21.15.130:3300/0 conn(0x7f60bc06fe00 0x7f60bc0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c11a6640 1 -- 172.21.15.130:0/2384350508 >> v2:172.21.15.130:3300/0 conn(0x7f60bc06fe00 msgr2=0x7f60bc0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c11a6640 1 --2- 172.21.15.130:0/2384350508 >> v2:172.21.15.130:3300/0 conn(0x7f60bc06fe00 0x7f60bc0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c11a6640 1 -- 172.21.15.130:0/2384350508 >> v1:172.21.15.164:6789/0 conn(0x7f60bc1590e0 legacy=0x7f60bc0b1c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:32.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7f60c11a6640 1 -- 172.21.15.130:0/2384350508 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc070210 con 0x7f60bc0b31c0 2023-09-13T06:01:32.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe058d79640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0540703e0 0x7fe054149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa20d4ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2080b1360 0x7fa2081f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe0537fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05406e300 0x7fe05406ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe0537fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05406e300 0x7fe05406ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37400/0 (socket says 172.21.15.130:37400) 2023-09-13T06:01:32.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4f54af640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa4e80df400 0x7fa4e8007330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4f54af640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4e80e34d0 0x7fa4e8038310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4f54af640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e8005ff0 con 0x7fa4e8053df0 2023-09-13T06:01:32.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4f54af640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e80e3b80 con 0x7fa4e80e34d0 2023-09-13T06:01:32.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4f54af640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e8006290 con 0x7fa4e80df400 2023-09-13T06:01:32.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe0537fe640 1 -- 172.21.15.130:0/3563033638 learned_addr learned my addr 172.21.15.130:0/3563033638 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4effff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa4e80df400 0x7fa4e8007330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4effff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa4e80df400 0x7fa4e8007330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37396/0 (socket says 172.21.15.130:37396) 2023-09-13T06:01:32.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4effff640 1 -- 172.21.15.130:0/4001918263 learned_addr learned my addr 172.21.15.130:0/4001918263 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4effff640 1 -- 172.21.15.130:0/4001918263 >> v2:172.21.15.130:3300/0 conn(0x7fa4e80e34d0 msgr2=0x7fa4e8038310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:32.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4effff640 1 --2- 172.21.15.130:0/4001918263 >> v2:172.21.15.130:3300/0 conn(0x7fa4e80e34d0 0x7fa4e8038310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4effff640 1 -- 172.21.15.130:0/4001918263 >> v1:172.21.15.164:6789/0 conn(0x7fa4e8053df0 legacy=0x7fa4e80e2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa4effff640 1 -- 172.21.15.130:0/4001918263 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e8006570 con 0x7fa4e80df400 2023-09-13T06:01:32.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe058d79640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05415a440 0x7fe05414a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0541482c0 con 0x7fe0540703e0 2023-09-13T06:01:32.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa20d4ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2080ccc00 0x7fa20806db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa20d4ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2081577f0 0x7fa2081fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa20d4ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20806cc60 con 0x7fa2081577f0 2023-09-13T06:01:32.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa20d4ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20806c0e0 con 0x7fa2080b1360 2023-09-13T06:01:32.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa20d4ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20806c3c0 con 0x7fa2080ccc00 2023-09-13T06:01:32.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe053fff640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05415a440 0x7fe05414a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa206ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2080b1360 0x7fa2081f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.616+0000 7f64be7fc640 1 -- 172.21.15.130:0/2108367508 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c8165630 con 0x7f64c80b4a60 2023-09-13T06:01:32.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05414da40 con 0x7fe05406e300 2023-09-13T06:01:32.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe052ffd640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0540703e0 0x7fe054149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05414dce0 con 0x7fe05415a440 2023-09-13T06:01:32.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa206ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2080b1360 0x7fa2081f47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37402/0 (socket says 172.21.15.130:37402) 2023-09-13T06:01:32.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa206ffd640 1 -- 172.21.15.130:0/2443135411 learned_addr learned my addr 172.21.15.130:0/2443135411 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa2067fc640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2080ccc00 0x7fa20806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.620+0000 7fa2077fe640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2081577f0 0x7fa2081fa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe0537fe640 1 -- 172.21.15.130:0/3563033638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05415a440 msgr2=0x7fe05414a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe0537fe640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05415a440 0x7fe05414a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe0537fe640 1 -- 172.21.15.130:0/3563033638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0540703e0 msgr2=0x7fe054149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe0537fe640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0540703e0 0x7fe054149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe0537fe640 1 -- 172.21.15.130:0/3563033638 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c007910 con 0x7fe05406e300 2023-09-13T06:01:32.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fa206ffd640 1 -- 172.21.15.130:0/2443135411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2080ccc00 msgr2=0x7fa20806db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fa206ffd640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2080ccc00 0x7fa20806db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fa206ffd640 1 -- 172.21.15.130:0/2443135411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2081577f0 msgr2=0x7fa2081fa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fa206ffd640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2081577f0 0x7fa2081fa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fa206ffd640 1 -- 172.21.15.130:0/2443135411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200009a70 con 0x7fa2080b1360 2023-09-13T06:01:32.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fa206ffd640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2080b1360 0x7fa2081f47d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c480 tx=0x7fa1f800c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe0537fe640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05406e300 0x7fe05406ce80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe04400e810 tx=0x7fe04400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fa1ef7fe640 1 -- 172.21.15.130:0/2443135411 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80052d0 con 0x7fa2080b1360 2023-09-13T06:01:32.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe03bfff640 1 -- 172.21.15.130:0/3563033638 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400c8d0 con 0x7fe05406e300 2023-09-13T06:01:32.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe03bfff640 1 -- 172.21.15.130:0/3563033638 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400ca30 con 0x7fe05406e300 2023-09-13T06:01:32.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe03bfff640 1 -- 172.21.15.130:0/3563033638 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400cdc0 con 0x7fe05406e300 2023-09-13T06:01:32.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05414dfc0 con 0x7fe05406e300 2023-09-13T06:01:32.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05414e580 con 0x7fe05406e300 2023-09-13T06:01:32.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7f64be7fc640 1 --2- 172.21.15.130:0/2108367508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 0x7f64c80adf40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f64b00097f0 tx=0x7f64b001c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=330ceaf1ddf6779e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fa1ef7fe640 1 -- 172.21.15.130:0/2443135411 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f8005430 con 0x7fa2080b1360 2023-09-13T06:01:32.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fa1ef7fe640 1 -- 172.21.15.130:0/2443135411 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8012850 con 0x7fa2080b1360 2023-09-13T06:01:32.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fa20d4ec640 1 -- 172.21.15.130:0/2443135411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20806c6a0 con 0x7fa2080b1360 2023-09-13T06:01:32.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7f64c67fc640 1 -- 172.21.15.130:0/2108367508 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b00ab600 con 0x7f64c80b4a60 2023-09-13T06:01:32.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7f64c67fc640 1 -- 172.21.15.130:0/2108367508 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b00a7050 con 0x7f64c80b4a60 2023-09-13T06:01:32.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7f64c67fc640 1 -- 172.21.15.130:0/2108367508 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b00ab980 con 0x7f64c80b4a60 2023-09-13T06:01:32.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fa20d4ec640 1 -- 172.21.15.130:0/2443135411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20806b270 con 0x7fa2080b1360 2023-09-13T06:01:32.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7f60c11a6640 1 --2- 172.21.15.130:0/2384350508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc0b31c0 0x7f60bc06f8c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60a800a910 tx=0x7f60a8020be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a48d0dc5bed91da server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe034005260 con 0x7fe05406e300 2023-09-13T06:01:32.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7f64c7fff640 1 -- 172.21.15.130:0/2108367508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 msgr2=0x7f64c80adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7f64c7fff640 1 --2- 172.21.15.130:0/2108367508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 0x7f64c80adf40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f64b00097f0 tx=0x7f64b001c320 comp rx=0 tx=0).stop 2023-09-13T06:01:32.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7f60c09a5640 1 -- 172.21.15.130:0/2384350508 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a80a9c70 con 0x7f60bc0b31c0 2023-09-13T06:01:32.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7f64c7fff640 1 -- 172.21.15.130:0/2108367508 shutdown_connections 2023-09-13T06:01:32.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7f64c7fff640 1 --2- 172.21.15.130:0/2108367508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 0x7f64c80adf40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.624+0000 7f64c7fff640 1 -- 172.21.15.130:0/2108367508 >> 172.21.15.130:0/2108367508 conn(0x7f64c80cf2e0 msgr2=0x7f64c80cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f60c09a5640 1 -- 172.21.15.130:0/2384350508 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a80ad070 con 0x7f60bc0b31c0 2023-09-13T06:01:32.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f60c09a5640 1 -- 172.21.15.130:0/2384350508 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a80a9c70 con 0x7f60bc0b31c0 2023-09-13T06:01:32.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7fa20d4ec640 1 -- 172.21.15.130:0/2443135411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2080618a0 con 0x7fa2080b1360 2023-09-13T06:01:32.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f64c7fff640 1 -- 172.21.15.130:0/2108367508 shutdown_connections 2023-09-13T06:01:32.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f60c29a9640 1 -- 172.21.15.130:0/2384350508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc0b31c0 msgr2=0x7f60bc06f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f60c29a9640 1 --2- 172.21.15.130:0/2384350508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc0b31c0 0x7f60bc06f8c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60a800a910 tx=0x7f60a8020be0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7fe03bfff640 1 -- 172.21.15.130:0/3563033638 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe044013410 con 0x7fe05406e300 2023-09-13T06:01:32.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f60c29a9640 1 -- 172.21.15.130:0/2384350508 shutdown_connections 2023-09-13T06:01:32.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f60c29a9640 1 --2- 172.21.15.130:0/2384350508 >> v2:172.21.15.130:3300/0 conn(0x7f60bc06fe00 0x7f60bc0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f60c29a9640 1 --2- 172.21.15.130:0/2384350508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc0b31c0 0x7f60bc06f8c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f60c29a9640 1 -- 172.21.15.130:0/2384350508 >> 172.21.15.130:0/2384350508 conn(0x7f60bc065990 msgr2=0x7f60bc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f60c29a9640 1 -- 172.21.15.130:0/2384350508 shutdown_connections 2023-09-13T06:01:32.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f60c29a9640 1 -- 172.21.15.130:0/2384350508 wait complete. 2023-09-13T06:01:32.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7fa4effff640 1 --2- 172.21.15.130:0/4001918263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e80df400 0x7fa4e8007330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8055b40 tx=0x7fa4e401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4029f77e05f4686 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7fe03bfff640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe040065b20 0x7fe040067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7fe03bfff640 1 -- 172.21.15.130:0/3563033638 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe044082f70 con 0x7fe05406e300 2023-09-13T06:01:32.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7f64c7fff640 1 -- 172.21.15.130:0/2108367508 wait complete. 2023-09-13T06:01:32.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7fe052ffd640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe040065b20 0x7fe040067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7fa1ef7fe640 1 -- 172.21.15.130:0/2443135411 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa1f80129b0 con 0x7fa2080b1360 2023-09-13T06:01:32.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7fa1ef7fe640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa1f4065b20 0x7fa1f4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7fa1ef7fe640 1 -- 172.21.15.130:0/2443135411 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1f8082d60 con 0x7fa2080b1360 2023-09-13T06:01:32.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.628+0000 7fa2067fc640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa1f4065b20 0x7fa1f4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7ce4f7640 1 Processor -- start 2023-09-13T06:01:32.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cfddb640 1 Processor -- start 2023-09-13T06:01:32.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c7fff640 1 Processor -- start 2023-09-13T06:01:32.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c29a9640 1 Processor -- start 2023-09-13T06:01:32.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7fe052ffd640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe040065b20 0x7fe040067fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe054149860 tx=0x7fe048007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7ce4f7640 1 -- start start 2023-09-13T06:01:32.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cfddb640 1 -- start start 2023-09-13T06:01:32.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c29a9640 1 -- start start 2023-09-13T06:01:32.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c7fff640 1 -- start start 2023-09-13T06:01:32.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7fa2067fc640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa1f4065b20 0x7fa1f4067fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa2000b2000 tx=0x7fa2000aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cfddb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f20c815d1f0 0x7f20c8161660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cfddb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f20c80cc890 0x7f20c80ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 0x7f64c8155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7ce4f7640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff7c00e3080 0x7ff7c003a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c7fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c81613e0 0x7f64c806db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cfddb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c80d2e20 con 0x7f20c80d22c0 2023-09-13T06:01:32.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cfddb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c80cd260 con 0x7f20c815d1f0 2023-09-13T06:01:32.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cfddb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c80ca5a0 con 0x7f20c80cc890 2023-09-13T06:01:32.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7ce4f7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff7c004fef0 0x7ff7c00066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7ce4f7640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c0006210 con 0x7ff7c00538f0 2023-09-13T06:01:32.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7ce4f7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c0005ee0 con 0x7ff7c004fef0 2023-09-13T06:01:32.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7ce4f7640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c00e3460 con 0x7ff7c00e3080 2023-09-13T06:01:32.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c29a9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60bc06fe00 0x7f60bc146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c29a9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60bc0b31c0 0x7f60bc157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c29a9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc1590e0 0x7f60bc15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c8165e30 0x7f64c8153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c7fff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c81609b0 con 0x7f64c8165e30 2023-09-13T06:01:32.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c7fff640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c815fd30 con 0x7f64c81613e0 2023-09-13T06:01:32.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c7fff640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c8160010 con 0x7f64c80b4a60 2023-09-13T06:01:32.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c6ffd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 0x7f64c8155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c6ffd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 0x7f64c8155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60686/0 (socket says 172.21.15.130:60686) 2023-09-13T06:01:32.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c6ffd640 1 -- 172.21.15.130:0/1833520386 learned_addr learned my addr 172.21.15.130:0/1833520386 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c29a9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc1570f0 con 0x7f60bc0b31c0 2023-09-13T06:01:32.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c29a9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc1573d0 con 0x7f60bc06fe00 2023-09-13T06:01:32.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c29a9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc151f00 con 0x7f60bc1590e0 2023-09-13T06:01:32.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7cd4f5640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff7c00e3080 0x7ff7c003a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7cd4f5640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff7c00e3080 0x7ff7c003a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37422/0 (socket says 172.21.15.130:37422) 2023-09-13T06:01:32.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7cdcf6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff7c004fef0 0x7ff7c00066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7cd4f5640 1 -- 172.21.15.130:0/1496657760 learned_addr learned my addr 172.21.15.130:0/1496657760 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c77fe640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c8165e30 0x7f64c8153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c21a8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc1590e0 0x7f60bc15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c21a8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc1590e0 0x7f60bc15a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60688/0 (socket says 172.21.15.130:60688) 2023-09-13T06:01:32.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c21a8640 1 -- 172.21.15.130:0/670058947 learned_addr learned my addr 172.21.15.130:0/670058947 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c11a6640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60bc0b31c0 0x7f60bc157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cd376640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f20c80cc890 0x7f20c80ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cd376640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f20c80cc890 0x7f20c80ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37410/0 (socket says 172.21.15.130:37410) 2023-09-13T06:01:32.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cd376640 1 -- 172.21.15.130:0/3867257503 learned_addr learned my addr 172.21.15.130:0/3867257503 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cdb77640 1 --2- 172.21.15.130:0/3867257503 >> v2:172.21.15.130:3300/0 conn(0x7f20c815d1f0 0x7f20c8161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64be7fc640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c81613e0 0x7f64c806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c6ffd640 1 -- 172.21.15.130:0/1833520386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c81613e0 msgr2=0x7f64c806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c6ffd640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c81613e0 0x7f64c806db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c6ffd640 1 -- 172.21.15.130:0/1833520386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c8165e30 msgr2=0x7f64c8153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c6ffd640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c8165e30 0x7f64c8153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f64c6ffd640 1 -- 172.21.15.130:0/1833520386 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b0009420 con 0x7f64c80b4a60 2023-09-13T06:01:32.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c21a8640 1 -- 172.21.15.130:0/670058947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60bc06fe00 msgr2=0x7f60bc146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c21a8640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60bc06fe00 0x7f60bc146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c21a8640 1 -- 172.21.15.130:0/670058947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60bc0b31c0 msgr2=0x7f60bc157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c21a8640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60bc0b31c0 0x7f60bc157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f60c21a8640 1 -- 172.21.15.130:0/670058947 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a800a570 con 0x7f60bc1590e0 2023-09-13T06:01:32.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cd376640 1 -- 172.21.15.130:0/3867257503 >> v2:172.21.15.130:3300/0 conn(0x7f20c815d1f0 msgr2=0x7f20c8161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cd376640 1 --2- 172.21.15.130:0/3867257503 >> v2:172.21.15.130:3300/0 conn(0x7f20c815d1f0 0x7f20c8161660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cd376640 1 -- 172.21.15.130:0/3867257503 >> v1:172.21.15.130:6789/0 conn(0x7f20c80d22c0 legacy=0x7f20c80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7f20cd376640 1 -- 172.21.15.130:0/3867257503 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8161ba0 con 0x7f20c80cc890 2023-09-13T06:01:32.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7cd4f5640 1 -- 172.21.15.130:0/1496657760 >> v2:172.21.15.130:3300/0 conn(0x7ff7c004fef0 msgr2=0x7ff7c00066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7cd4f5640 1 --2- 172.21.15.130:0/1496657760 >> v2:172.21.15.130:3300/0 conn(0x7ff7c004fef0 0x7ff7c00066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7cd4f5640 1 -- 172.21.15.130:0/1496657760 >> v1:172.21.15.164:6789/0 conn(0x7ff7c00538f0 legacy=0x7ff7c004f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:32.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f60c21a8640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc1590e0 0x7f60bc15a1d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f60b400d830 tx=0x7f60b400dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.632+0000 7ff7cd4f5640 1 -- 172.21.15.130:0/1496657760 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c0054140 con 0x7ff7c00e3080 2023-09-13T06:01:32.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7fe03bfff640 1 -- 172.21.15.130:0/3563033638 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe044050a00 con 0x7fe05406e300 2023-09-13T06:01:32.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f64c6ffd640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 0x7f64c8155b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64b800c780 tx=0x7f64b800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f64c4ff9640 1 -- 172.21.15.130:0/1833520386 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b80074e0 con 0x7f64c80b4a60 2023-09-13T06:01:32.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f64c4ff9640 1 -- 172.21.15.130:0/1833520386 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b8007640 con 0x7f64c80b4a60 2023-09-13T06:01:32.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f64c4ff9640 1 -- 172.21.15.130:0/1833520386 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8004a30 con 0x7f64c80b4a60 2023-09-13T06:01:32.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f64c7fff640 1 -- 172.21.15.130:0/1833520386 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c81602f0 con 0x7f64c80b4a60 2023-09-13T06:01:32.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f64c7fff640 1 -- 172.21.15.130:0/1833520386 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c8156430 con 0x7f64c80b4a60 2023-09-13T06:01:32.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f60ba7fc640 1 -- 172.21.15.130:0/670058947 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b400b6c0 con 0x7f60bc1590e0 2023-09-13T06:01:32.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f60ba7fc640 1 -- 172.21.15.130:0/670058947 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b400b820 con 0x7f60bc1590e0 2023-09-13T06:01:32.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f60ba7fc640 1 -- 172.21.15.130:0/670058947 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b400bbd0 con 0x7f60bc1590e0 2023-09-13T06:01:32.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f60c29a9640 1 -- 172.21.15.130:0/670058947 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc1521e0 con 0x7f60bc1590e0 2023-09-13T06:01:32.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f60c29a9640 1 -- 172.21.15.130:0/670058947 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc150850 con 0x7f60bc1590e0 2023-09-13T06:01:32.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f64c7fff640 1 -- 172.21.15.130:0/1833520386 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c8069cc0 con 0x7f64c80b4a60 2023-09-13T06:01:32.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f60c29a9640 1 -- 172.21.15.130:0/670058947 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60bc150a40 con 0x7f60bc1590e0 2023-09-13T06:01:32.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.636+0000 7f20cd376640 1 --2- 172.21.15.130:0/3867257503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c80cc890 0x7f20c80ccd20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009870 tx=0x7f20b801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69d862bd5314f672 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7ff7cd4f5640 1 --2- 172.21.15.130:0/1496657760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c00e3080 0x7ff7c003a6f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0007ad0 tx=0x7ff7c401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9531be7f94deb3ef server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa1ef7fe640 1 -- 172.21.15.130:0/2443135411 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa1f8050750 con 0x7fa2080b1360 2023-09-13T06:01:32.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f20ccb75640 1 -- 172.21.15.130:0/3867257503 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80ab5f0 con 0x7f20c80cc890 2023-09-13T06:01:32.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7ff7bffff640 1 -- 172.21.15.130:0/1496657760 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40ac410 con 0x7ff7c00e3080 2023-09-13T06:01:32.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa4eeffd640 1 -- 172.21.15.130:0/4001918263 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4004230 con 0x7fa4e80df400 2023-09-13T06:01:32.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa4eeffd640 1 -- 172.21.15.130:0/4001918263 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e40a7050 con 0x7fa4e80df400 2023-09-13T06:01:32.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa4eeffd640 1 -- 172.21.15.130:0/4001918263 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4003620 con 0x7fa4e80df400 2023-09-13T06:01:32.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f20ccb75640 1 -- 172.21.15.130:0/3867257503 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b80ab750 con 0x7f20c80cc890 2023-09-13T06:01:32.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f64c4ff9640 1 -- 172.21.15.130:0/1833520386 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f64b8004b90 con 0x7f64c80b4a60 2023-09-13T06:01:32.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f20ccb75640 1 -- 172.21.15.130:0/3867257503 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80abae0 con 0x7f20c80cc890 2023-09-13T06:01:32.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f20cfddb640 1 -- 172.21.15.130:0/3867257503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c80cc890 msgr2=0x7f20c80ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f20cfddb640 1 --2- 172.21.15.130:0/3867257503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c80cc890 0x7f20c80ccd20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009870 tx=0x7f20b801c500 comp rx=0 tx=0).stop 2023-09-13T06:01:32.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f64c4ff9640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f64a8065bf0 0x7f64a80680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa4f54af640 1 -- 172.21.15.130:0/4001918263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e80df400 msgr2=0x7fa4e8007330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa4f54af640 1 --2- 172.21.15.130:0/4001918263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e80df400 0x7fa4e8007330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8055b40 tx=0x7fa4e401c460 comp rx=0 tx=0).stop 2023-09-13T06:01:32.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f64c4ff9640 1 -- 172.21.15.130:0/1833520386 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64b8082ac0 con 0x7f64c80b4a60 2023-09-13T06:01:32.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f20cfddb640 1 -- 172.21.15.130:0/3867257503 shutdown_connections 2023-09-13T06:01:32.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f20cfddb640 1 --2- 172.21.15.130:0/3867257503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c80cc890 0x7f20c80ccd20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f20cfddb640 1 --2- 172.21.15.130:0/3867257503 >> v2:172.21.15.130:3300/0 conn(0x7f20c815d1f0 0x7f20c8161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f20cfddb640 1 -- 172.21.15.130:0/3867257503 >> 172.21.15.130:0/3867257503 conn(0x7f20c8097090 msgr2=0x7f20c80974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa4f54af640 1 -- 172.21.15.130:0/4001918263 shutdown_connections 2023-09-13T06:01:32.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa4f54af640 1 --2- 172.21.15.130:0/4001918263 >> v2:172.21.15.130:3300/0 conn(0x7fa4e80e34d0 0x7fa4e8038310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa4f54af640 1 --2- 172.21.15.130:0/4001918263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e80df400 0x7fa4e8007330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa4f54af640 1 -- 172.21.15.130:0/4001918263 >> 172.21.15.130:0/4001918263 conn(0x7fa4e8054c20 msgr2=0x7fa4e8055030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f60ba7fc640 1 -- 172.21.15.130:0/670058947 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f60b401e460 con 0x7f60bc1590e0 2023-09-13T06:01:32.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f60ba7fc640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f60a0065bf0 0x7f60a00680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f60ba7fc640 1 -- 172.21.15.130:0/670058947 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60b40834e0 con 0x7f60bc1590e0 2023-09-13T06:01:32.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa4f54af640 1 -- 172.21.15.130:0/4001918263 shutdown_connections 2023-09-13T06:01:32.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f20cfddb640 1 -- 172.21.15.130:0/3867257503 shutdown_connections 2023-09-13T06:01:32.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f20cfddb640 1 -- 172.21.15.130:0/3867257503 wait complete. 2023-09-13T06:01:32.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f64be7fc640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f64a8065bf0 0x7f64a80680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7fa4f54af640 1 -- 172.21.15.130:0/4001918263 wait complete. 2023-09-13T06:01:32.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7f60c19a7640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f60a0065bf0 0x7f60a00680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7ff7bffff640 1 -- 172.21.15.130:0/1496657760 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40ac570 con 0x7ff7c00e3080 2023-09-13T06:01:32.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.640+0000 7ff7bffff640 1 -- 172.21.15.130:0/1496657760 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40ac410 con 0x7ff7c00e3080 2023-09-13T06:01:32.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f64be7fc640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f64a8065bf0 0x7f64a80680b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f64b00ad000 tx=0x7f64b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f60c19a7640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f60a0065bf0 0x7f60a00680b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f60b0001ff0 tx=0x7f60b0001610 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1496657760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c00e3080 msgr2=0x7ff7c003a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7ff7ce4f7640 1 --2- 172.21.15.130:0/1496657760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c00e3080 0x7ff7c003a6f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0007ad0 tx=0x7ff7c401c490 comp rx=0 tx=0).stop 2023-09-13T06:01:32.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f20cfddb640 1 Processor -- start 2023-09-13T06:01:32.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7fa4f54af640 1 Processor -- start 2023-09-13T06:01:32.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f20cfddb640 1 -- start start 2023-09-13T06:01:32.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1496657760 shutdown_connections 2023-09-13T06:01:32.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7ff7ce4f7640 1 --2- 172.21.15.130:0/1496657760 >> v2:172.21.15.130:3300/0 conn(0x7ff7c004fef0 0x7ff7c00066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7ff7ce4f7640 1 --2- 172.21.15.130:0/1496657760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c00e3080 0x7ff7c003a6f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1496657760 >> 172.21.15.130:0/1496657760 conn(0x7ff7c0054b10 msgr2=0x7ff7c0054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7fa4f54af640 1 -- start start 2023-09-13T06:01:32.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1496657760 shutdown_connections 2023-09-13T06:01:32.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f64c4ff9640 1 -- 172.21.15.130:0/1833520386 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f64b8084e60 con 0x7f64c80b4a60 2023-09-13T06:01:32.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f20cfddb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20c80cc890 0x7f20c81593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f20cfddb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c80d22c0 0x7f20c81f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f20cfddb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c815d1f0 0x7f20c80a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f20cfddb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c8160910 con 0x7f20c80cc890 2023-09-13T06:01:32.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f20cfddb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c81f5590 con 0x7f20c80d22c0 2023-09-13T06:01:32.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f20cfddb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c80b2df0 con 0x7f20c815d1f0 2023-09-13T06:01:32.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7fa4f54af640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4e8053df0 0x7fa4e80cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f20cdb77640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20c80cc890 0x7f20c81593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f20cdb77640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20c80cc890 0x7f20c81593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48024/0 (socket says 172.21.15.130:48024) 2023-09-13T06:01:32.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7f20cdb77640 1 -- 172.21.15.130:0/1118048929 learned_addr learned my addr 172.21.15.130:0/1118048929 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.644+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1496657760 wait complete. 2023-09-13T06:01:32.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4effff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4e8053df0 0x7fa4e80cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4effff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4e8053df0 0x7fa4e80cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48030/0 (socket says 172.21.15.130:48030) 2023-09-13T06:01:32.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7ff7ce4f7640 1 Processor -- start 2023-09-13T06:01:32.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20cd376640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c80d22c0 0x7f20c81f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20ce378640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c815d1f0 0x7f20c80a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4effff640 1 -- 172.21.15.130:0/907564316 learned_addr learned my addr 172.21.15.130:0/907564316 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20cdb77640 1 -- 172.21.15.130:0/1118048929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c815d1f0 msgr2=0x7f20c80a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20cdb77640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c815d1f0 0x7f20c80a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20cdb77640 1 -- 172.21.15.130:0/1118048929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c80d22c0 msgr2=0x7f20c81f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20cdb77640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c80d22c0 0x7f20c81f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20cdb77640 1 -- 172.21.15.130:0/1118048929 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80094d0 con 0x7f20c80cc890 2023-09-13T06:01:32.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20cd376640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c80d22c0 0x7f20c81f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:32.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7ff7ce4f7640 1 -- start start 2023-09-13T06:01:32.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4f54af640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4e80df400 0x7fa4e80d5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20cdb77640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20c80cc890 0x7f20c81593e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f20c400d620 tx=0x7f20c400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4f54af640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e80e34d0 0x7fa4e80d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20be7fc640 1 -- 172.21.15.130:0/1118048929 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c400b620 con 0x7f20c80cc890 2023-09-13T06:01:32.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20be7fc640 1 -- 172.21.15.130:0/1118048929 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c400b780 con 0x7f20c80cc890 2023-09-13T06:01:32.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20be7fc640 1 -- 172.21.15.130:0/1118048929 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c400bb10 con 0x7f20c80cc890 2023-09-13T06:01:32.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20cfddb640 1 -- 172.21.15.130:0/1118048929 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c81f64e0 con 0x7f20c80cc890 2023-09-13T06:01:32.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4ef7fe640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4e80df400 0x7fa4e80d5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f20cfddb640 1 -- 172.21.15.130:0/1118048929 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c8160630 con 0x7f20c80cc890 2023-09-13T06:01:32.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4f4cae640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e80e34d0 0x7fa4e80d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80d5060 con 0x7fa4e8053df0 2023-09-13T06:01:32.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80d4790 con 0x7fa4e80e34d0 2023-09-13T06:01:32.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80d9ba0 con 0x7fa4e80df400 2023-09-13T06:01:32.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7ff7ce4f7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7c004fef0 0x7ff7c00dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7f60ba7fc640 1 -- 172.21.15.130:0/670058947 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f60bc150a40 con 0x7f60bc1590e0 2023-09-13T06:01:32.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7ff7ce4f7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c00538f0 0x7ff7c00de7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7ff7cd4f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7c004fef0 0x7ff7c00dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7ff7cd4f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7c004fef0 0x7ff7c00dfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48044/0 (socket says 172.21.15.130:48044) 2023-09-13T06:01:32.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7cd4f5640 1 -- 172.21.15.130:0/1393369371 learned_addr learned my addr 172.21.15.130:0/1393369371 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:32.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7ce4f7640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7c00e3080 0x7ff7c00ded20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7cccf4640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c00538f0 0x7ff7c00de7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4ef7fe640 1 -- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e80e34d0 msgr2=0x7fa4e80d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4ef7fe640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e80e34d0 0x7fa4e80d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4ef7fe640 1 -- 172.21.15.130:0/907564316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4e8053df0 msgr2=0x7fa4e80cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4ef7fe640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4e8053df0 0x7fa4e80cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.648+0000 7fa4ef7fe640 1 -- 172.21.15.130:0/907564316 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e40094d0 con 0x7fa4e80df400 2023-09-13T06:01:32.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7fa4f4cae640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e80e34d0 0x7fa4e80d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:32.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7fa4ef7fe640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4e80df400 0x7fa4e80d5480 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc000f70 tx=0x7fa4dc00c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7fa4ecff9640 1 -- 172.21.15.130:0/907564316 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0052d0 con 0x7fa4e80df400 2023-09-13T06:01:32.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7fa4ecff9640 1 -- 172.21.15.130:0/907564316 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc005430 con 0x7fa4e80df400 2023-09-13T06:01:32.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7fa4ecff9640 1 -- 172.21.15.130:0/907564316 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc003820 con 0x7fa4e80df400 2023-09-13T06:01:32.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7cdcf6640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7c00e3080 0x7ff7c00ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c004c760 con 0x7ff7c004fef0 2023-09-13T06:01:32.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e80d49a0 con 0x7fa4e80df400 2023-09-13T06:01:32.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e80cf5e0 con 0x7fa4e80df400 2023-09-13T06:01:32.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c004ca40 con 0x7ff7c00538f0 2023-09-13T06:01:32.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c004cd20 con 0x7ff7c00e3080 2023-09-13T06:01:32.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7cd4f5640 1 -- 172.21.15.130:0/1393369371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7c00e3080 msgr2=0x7ff7c00ded20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7cd4f5640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7c00e3080 0x7ff7c00ded20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7cd4f5640 1 -- 172.21.15.130:0/1393369371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c00538f0 msgr2=0x7ff7c00de7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7cd4f5640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c00538f0 0x7ff7c00de7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7cd4f5640 1 -- 172.21.15.130:0/1393369371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c40094d0 con 0x7ff7c004fef0 2023-09-13T06:01:32.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7cdcf6640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7c00e3080 0x7ff7c00ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:32.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7cd4f5640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7c004fef0 0x7ff7c00dfd90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff7c401a0c0 tx=0x7ff7c4019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7bdffb640 1 -- 172.21.15.130:0/1393369371 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40bb070 con 0x7ff7c004fef0 2023-09-13T06:01:32.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7bdffb640 1 -- 172.21.15.130:0/1393369371 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40ad980 con 0x7ff7c004fef0 2023-09-13T06:01:32.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7ff7bdffb640 1 -- 172.21.15.130:0/1393369371 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40adb30 con 0x7ff7c004fef0 2023-09-13T06:01:32.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.656+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c004d000 con 0x7ff7c004fef0 2023-09-13T06:01:32.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.656+0000 7fa4ecff9640 1 -- 172.21.15.130:0/907564316 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa4dc003980 con 0x7fa4e80df400 2023-09-13T06:01:32.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.656+0000 7fa4ecff9640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4d4065bf0 0x7fa4d40680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.656+0000 7fa4ecff9640 1 -- 172.21.15.130:0/907564316 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4dc0826f0 con 0x7fa4e80df400 2023-09-13T06:01:32.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.660+0000 7fa4effff640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4d4065bf0 0x7fa4d40680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.660+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d0005260 con 0x7fa4e80df400 2023-09-13T06:01:32.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.660+0000 7fa4effff640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4d4065bf0 0x7fa4d40680b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80ef400 tx=0x7fa4e40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.652+0000 7f20be7fc640 1 -- 172.21.15.130:0/1118048929 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f20c400bc70 con 0x7f20c80cc890 2023-09-13T06:01:32.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.656+0000 7f20be7fc640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f20ac065bf0 0x7f20ac0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.656+0000 7f20be7fc640 1 -- 172.21.15.130:0/1118048929 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20c40836d0 con 0x7f20c80cc890 2023-09-13T06:01:32.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.656+0000 7f20cd376640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f20ac065bf0 0x7f20ac0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.656+0000 7f20cfddb640 1 -- 172.21.15.130:0/1118048929 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c80618a0 con 0x7f20c80cc890 2023-09-13T06:01:32.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.656+0000 7f20cd376640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f20ac065bf0 0x7f20ac0680b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20b80af000 tx=0x7f20b80b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.656+0000 7ff7bdffb640 1 -- 172.21.15.130:0/1393369371 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff7c40adc90 con 0x7ff7c004fef0 2023-09-13T06:01:32.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.660+0000 7ff7bdffb640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7ac06e380 0x7ff7ac070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:32.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.660+0000 7ff7cccf4640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7ac06e380 0x7ff7ac070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:32.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.660+0000 7ff7cccf4640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7ac06e380 0x7ff7ac070840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7c004c690 tx=0x7ff7b8007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:32.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.660+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c00e02d0 con 0x7ff7c004fef0 2023-09-13T06:01:32.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.664+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c00e0520 con 0x7ff7c004fef0 2023-09-13T06:01:32.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.664+0000 7fa4ecff9640 1 -- 172.21.15.130:0/907564316 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa4dc050160 con 0x7fa4e80df400 2023-09-13T06:01:32.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.668+0000 7ff7bdffb640 1 -- 172.21.15.130:0/1393369371 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7c40eea30 con 0x7ff7c004fef0 2023-09-13T06:01:32.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.668+0000 7f20be7fc640 1 -- 172.21.15.130:0/1118048929 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f20c40510b0 con 0x7f20c80cc890 2023-09-13T06:01:32.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.680+0000 7ff7bdffb640 1 -- 172.21.15.130:0/1393369371 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff7c40b1070 con 0x7ff7c004fef0 2023-09-13T06:01:32.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.944+0000 7f3a41d59640 1 -- 172.21.15.130:0/2136125181 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a3c06ce60 con 0x7f3a3c157a80 2023-09-13T06:01:32.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.944+0000 7f3a23fff640 1 -- 172.21.15.130:0/2136125181 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a2c017020 con 0x7f3a3c157a80 2023-09-13T06:01:32.950 INFO:teuthology.orchestra.run.smithi130.stdout:55834574852 2023-09-13T06:01:32.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f3a21ffb640 1 -- 172.21.15.130:0/2136125181 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3a28065b70 msgr2=0x7f3a28068030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f3a21ffb640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3a28065b70 0x7f3a28068030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a30000f70 tx=0x7f3a30009040 comp rx=0 tx=0).stop 2023-09-13T06:01:32.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f3a21ffb640 1 -- 172.21.15.130:0/2136125181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3c157a80 msgr2=0x7f3a3c145360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f3a21ffb640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3c157a80 0x7f3a3c145360 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00e980 tx=0x7f3a2c00ee40 comp rx=0 tx=0).stop 2023-09-13T06:01:32.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f3a21ffb640 1 -- 172.21.15.130:0/2136125181 shutdown_connections 2023-09-13T06:01:32.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f3a21ffb640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3a28065b70 0x7f3a28068030 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f3a21ffb640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a3c15a490 0x7f3a3c070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f3a21ffb640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a3c157a80 0x7f3a3c145360 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f3a21ffb640 1 --2- 172.21.15.130:0/2136125181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a3c0af700 0x7f3a3c0cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f3a21ffb640 1 -- 172.21.15.130:0/2136125181 >> 172.21.15.130:0/2136125181 conn(0x7f3a3c065d90 msgr2=0x7f3a3c163c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f64c7fff640 1 -- 172.21.15.130:0/1833520386 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f64c8160150 con 0x7f64c80b4a60 2023-09-13T06:01:32.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.948+0000 7f3a21ffb640 1 -- 172.21.15.130:0/2136125181 shutdown_connections 2023-09-13T06:01:32.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.952+0000 7f3a21ffb640 1 -- 172.21.15.130:0/2136125181 wait complete. 2023-09-13T06:01:32.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.952+0000 7f64c4ff9640 1 -- 172.21.15.130:0/1833520386 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64c8160150 con 0x7f64c80b4a60 2023-09-13T06:01:32.957 INFO:teuthology.orchestra.run.smithi130.stdout:55834574852 2023-09-13T06:01:32.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.952+0000 7f64c7fff640 1 -- 172.21.15.130:0/1833520386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f64a8065bf0 msgr2=0x7f64a80680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.956+0000 7f64c7fff640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f64a8065bf0 0x7f64a80680b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f64b00ad000 tx=0x7f64b0008040 comp rx=0 tx=0).stop 2023-09-13T06:01:32.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.956+0000 7f64c7fff640 1 -- 172.21.15.130:0/1833520386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 msgr2=0x7f64c8155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.956+0000 7f64c7fff640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 0x7f64c8155b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64b800c780 tx=0x7f64b800cc40 comp rx=0 tx=0).stop 2023-09-13T06:01:32.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.956+0000 7f64c7fff640 1 -- 172.21.15.130:0/1833520386 shutdown_connections 2023-09-13T06:01:32.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.956+0000 7f64c7fff640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f64a8065bf0 0x7f64a80680b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.956+0000 7f64c7fff640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c81613e0 0x7f64c806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.956+0000 7f64c7fff640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c8165e30 0x7f64c8153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.956+0000 7f64c7fff640 1 --2- 172.21.15.130:0/1833520386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64c80b4a60 0x7f64c8155b70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.956+0000 7f64c7fff640 1 -- 172.21.15.130:0/1833520386 >> 172.21.15.130:0/1833520386 conn(0x7f64c80cf2e0 msgr2=0x7f64c80b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.960+0000 7f64c7fff640 1 -- 172.21.15.130:0/1833520386 shutdown_connections 2023-09-13T06:01:32.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.960+0000 7f64c7fff640 1 -- 172.21.15.130:0/1833520386 wait complete. 2023-09-13T06:01:32.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.960+0000 7fa20d4ec640 1 -- 172.21.15.130:0/2443135411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa20815d280 con 0x7fa2080b1360 2023-09-13T06:01:32.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.960+0000 7fa1ef7fe640 1 -- 172.21.15.130:0/2443135411 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1f8053d70 con 0x7fa2080b1360 2023-09-13T06:01:32.964 INFO:teuthology.orchestra.run.smithi130.stdout:55834574852 2023-09-13T06:01:32.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 -- 172.21.15.130:0/2443135411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa1f4065b20 msgr2=0x7fa1f4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa1f4065b20 0x7fa1f4067fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa2000b2000 tx=0x7fa2000aa070 comp rx=0 tx=0).stop 2023-09-13T06:01:32.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 -- 172.21.15.130:0/2443135411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2080b1360 msgr2=0x7fa2081f47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2080b1360 0x7fa2081f47d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c480 tx=0x7fa1f800c940 comp rx=0 tx=0).stop 2023-09-13T06:01:32.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 -- 172.21.15.130:0/2443135411 shutdown_connections 2023-09-13T06:01:32.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa1f4065b20 0x7fa1f4067fe0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2081577f0 0x7fa2081fa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2080ccc00 0x7fa20806db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 --2- 172.21.15.130:0/2443135411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2080b1360 0x7fa2081f47d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 -- 172.21.15.130:0/2443135411 >> 172.21.15.130:0/2443135411 conn(0x7fa208065990 msgr2=0x7fa208156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 -- 172.21.15.130:0/2443135411 shutdown_connections 2023-09-13T06:01:32.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.964+0000 7fa1ed7fa640 1 -- 172.21.15.130:0/2443135411 wait complete. 2023-09-13T06:01:32.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.968+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe0340057e0 con 0x7fe05406e300 2023-09-13T06:01:32.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.968+0000 7fe03bfff640 1 -- 172.21.15.130:0/3563033638 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe044054020 con 0x7fe05406e300 2023-09-13T06:01:32.974 INFO:teuthology.orchestra.run.smithi130.stdout:55834574852 2023-09-13T06:01:32.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.972+0000 7f60c29a9640 1 -- 172.21.15.130:0/670058947 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f60bc150a40 con 0x7f60bc1590e0 2023-09-13T06:01:32.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.972+0000 7f60ba7fc640 1 -- 172.21.15.130:0/670058947 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f60bc150a40 con 0x7f60bc1590e0 2023-09-13T06:01:32.975 INFO:teuthology.orchestra.run.smithi130.stdout:55834574852 2023-09-13T06:01:32.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.972+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe040065b20 msgr2=0x7fe040067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.972+0000 7fe058d79640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe040065b20 0x7fe040067fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe054149860 tx=0x7fe048007e90 comp rx=0 tx=0).stop 2023-09-13T06:01:32.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.972+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05406e300 msgr2=0x7fe05406ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.972+0000 7fe058d79640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05406e300 0x7fe05406ce80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe04400e810 tx=0x7fe04400ecd0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.972+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 shutdown_connections 2023-09-13T06:01:32.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.972+0000 7fe058d79640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe040065b20 0x7fe040067fe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.972+0000 7fe058d79640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05415a440 0x7fe05414a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.972+0000 7fe058d79640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0540703e0 0x7fe054149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.972+0000 7fe058d79640 1 --2- 172.21.15.130:0/3563033638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05406e300 0x7fe05406ce80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 >> 172.21.15.130:0/3563033638 conn(0x7fe054065b60 msgr2=0x7fe0540cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 shutdown_connections 2023-09-13T06:01:32.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7fe058d79640 1 -- 172.21.15.130:0/3563033638 wait complete. 2023-09-13T06:01:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 -- 172.21.15.130:0/670058947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f60a0065bf0 msgr2=0x7f60a00680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f60a0065bf0 0x7f60a00680b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f60b0001ff0 tx=0x7f60b0001610 comp rx=0 tx=0).stop 2023-09-13T06:01:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 -- 172.21.15.130:0/670058947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc1590e0 msgr2=0x7f60bc15a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc1590e0 0x7f60bc15a1d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f60b400d830 tx=0x7f60b400dcf0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 -- 172.21.15.130:0/670058947 shutdown_connections 2023-09-13T06:01:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f60a0065bf0 0x7f60a00680b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60bc1590e0 0x7f60bc15a1d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60bc0b31c0 0x7f60bc157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 --2- 172.21.15.130:0/670058947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60bc06fe00 0x7f60bc146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:32.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 -- 172.21.15.130:0/670058947 >> 172.21.15.130:0/670058947 conn(0x7f60bc065990 msgr2=0x7f60bc065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:32.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 -- 172.21.15.130:0/670058947 shutdown_connections 2023-09-13T06:01:32.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.976+0000 7f60c29a9640 1 -- 172.21.15.130:0/670058947 wait complete. 2023-09-13T06:01:32.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.988+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa4d0005510 con 0x7fa4e80df400 2023-09-13T06:01:32.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-09-13T06:01:32.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.988+0000 7fa4ecff9640 1 -- 172.21.15.130:0/907564316 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4dc017030 con 0x7fa4e80df400 2023-09-13T06:01:32.995 INFO:teuthology.orchestra.run.smithi130.stdout:55834574852 2023-09-13T06:01:32.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.992+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4d4065bf0 msgr2=0x7fa4d40680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.992+0000 7fa4f54af640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4d4065bf0 0x7fa4d40680b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80ef400 tx=0x7fa4e40a6000 comp rx=0 tx=0).stop 2023-09-13T06:01:32.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4e80df400 msgr2=0x7fa4e80d5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:32.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7fa4f54af640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4e80df400 0x7fa4e80d5480 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc000f70 tx=0x7fa4dc00c890 comp rx=0 tx=0).stop 2023-09-13T06:01:32.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 shutdown_connections 2023-09-13T06:01:32.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7f20cfddb640 1 -- 172.21.15.130:0/1118048929 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f20c80cd930 con 0x7f20c80cc890 2023-09-13T06:01:33.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7fa4f54af640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4d4065bf0 0x7fa4d40680b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7fa4f54af640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e80e34d0 0x7fa4e80d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7fa4f54af640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4e80df400 0x7fa4e80d5480 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7fa4f54af640 1 --2- 172.21.15.130:0/907564316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4e8053df0 0x7fa4e80cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 >> 172.21.15.130:0/907564316 conn(0x7fa4e8054c20 msgr2=0x7fa4e80e1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:33.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7f20be7fc640 1 -- 172.21.15.130:0/1118048929 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20c4007380 con 0x7f20c80cc890 2023-09-13T06:01:33.002 INFO:teuthology.orchestra.run.smithi130.stdout:55834574852 2023-09-13T06:01:33.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 shutdown_connections 2023-09-13T06:01:33.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:32.996+0000 7fa4f54af640 1 -- 172.21.15.130:0/907564316 wait complete. 2023-09-13T06:01:33.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-09-13T06:01:33.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 -- 172.21.15.130:0/1118048929 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f20ac065bf0 msgr2=0x7f20ac0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:33.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f20ac065bf0 0x7f20ac0680b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20b80af000 tx=0x7f20b80b6040 comp rx=0 tx=0).stop 2023-09-13T06:01:33.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 -- 172.21.15.130:0/1118048929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20c80cc890 msgr2=0x7f20c81593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:33.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20c80cc890 0x7f20c81593e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f20c400d620 tx=0x7f20c400dae0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 -- 172.21.15.130:0/1118048929 shutdown_connections 2023-09-13T06:01:33.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f20ac065bf0 0x7f20ac0680b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c80d22c0 0x7f20c81f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c815d1f0 0x7f20c80a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 --2- 172.21.15.130:0/1118048929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20c80cc890 0x7f20c81593e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 -- 172.21.15.130:0/1118048929 >> 172.21.15.130:0/1118048929 conn(0x7f20c8097090 msgr2=0x7f20c8097470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:33.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 -- 172.21.15.130:0/1118048929 shutdown_connections 2023-09-13T06:01:33.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7f20cfddb640 1 -- 172.21.15.130:0/1118048929 wait complete. 2023-09-13T06:01:33.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff7c0005350 con 0x7ff7c004fef0 2023-09-13T06:01:33.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.000+0000 7ff7bdffb640 1 -- 172.21.15.130:0/1393369371 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7c40ea670 con 0x7ff7c004fef0 2023-09-13T06:01:33.009 INFO:teuthology.orchestra.run.smithi130.stdout:55834574852 2023-09-13T06:01:33.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-09-13T06:01:33.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.004+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7ac06e380 msgr2=0x7ff7ac070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:33.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.004+0000 7ff7ce4f7640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7ac06e380 0x7ff7ac070840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7c004c690 tx=0x7ff7b8007e40 comp rx=0 tx=0).stop 2023-09-13T06:01:33.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.004+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7c004fef0 msgr2=0x7ff7c00dfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:33.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.004+0000 7ff7ce4f7640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7c004fef0 0x7ff7c00dfd90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff7c401a0c0 tx=0x7ff7c4019230 comp rx=0 tx=0).stop 2023-09-13T06:01:33.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.004+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 shutdown_connections 2023-09-13T06:01:33.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.004+0000 7ff7ce4f7640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7ac06e380 0x7ff7ac070840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.004+0000 7ff7ce4f7640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c00538f0 0x7ff7c00de7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.004+0000 7ff7ce4f7640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7c00e3080 0x7ff7c00ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.004+0000 7ff7ce4f7640 1 --2- 172.21.15.130:0/1393369371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7c004fef0 0x7ff7c00dfd90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:33.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.004+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 >> 172.21.15.130:0/1393369371 conn(0x7ff7c0054b10 msgr2=0x7ff7c004f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:33.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.008+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 shutdown_connections 2023-09-13T06:01:33.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:33.008+0000 7ff7ce4f7640 1 -- 172.21.15.130:0/1393369371 wait complete. 2023-09-13T06:01:33.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-09-13T06:01:33.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-09-13T06:01:33.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-09-13T06:01:33.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-09-13T06:01:33.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-09-13T06:01:33.994 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-13T06:01:34.005 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-13T06:01:34.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-13T06:01:34.015 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-13T06:01:34.019 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-13T06:01:34.035 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-13T06:01:34.041 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-13T06:01:34.042 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-13T06:01:34.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.208+0000 7f93e1ef9640 1 Processor -- start 2023-09-13T06:01:34.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.208+0000 7f93e1ef9640 1 -- start start 2023-09-13T06:01:34.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93e1ef9640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f93dc0adf90 0x7f93dc0b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93e1ef9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f93dc0cd360 0x7f93dc158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93e1ef9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93dc0ae480 0x7f93dc0ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93e1ef9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93dc0aee50 con 0x7f93dc0cd360 2023-09-13T06:01:34.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93e1ef9640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93dc06e920 con 0x7f93dc0adf90 2023-09-13T06:01:34.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93e1ef9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc15fde0 con 0x7f93dc0ae480 2023-09-13T06:01:34.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93daffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f93dc0cd360 0x7f93dc158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93daffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f93dc0cd360 0x7f93dc158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48050/0 (socket says 172.21.15.130:48050) 2023-09-13T06:01:34.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93daffd640 1 -- 172.21.15.130:0/2939907073 learned_addr learned my addr 172.21.15.130:0/2939907073 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93db7fe640 1 --2- 172.21.15.130:0/2939907073 >> v2:172.21.15.164:3300/0 conn(0x7f93dc0adf90 0x7f93dc0b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93dbfff640 1 --2- 172.21.15.130:0/2939907073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93dc0ae480 0x7f93dc0ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93daffd640 1 -- 172.21.15.130:0/2939907073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93dc0ae480 msgr2=0x7f93dc0ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93daffd640 1 --2- 172.21.15.130:0/2939907073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93dc0ae480 0x7f93dc0ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93daffd640 1 -- 172.21.15.130:0/2939907073 >> v2:172.21.15.164:3300/0 conn(0x7f93dc0adf90 msgr2=0x7f93dc0b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93daffd640 1 --2- 172.21.15.130:0/2939907073 >> v2:172.21.15.164:3300/0 conn(0x7f93dc0adf90 0x7f93dc0b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93daffd640 1 -- 172.21.15.130:0/2939907073 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc0cde30 con 0x7f93dc0cd360 2023-09-13T06:01:34.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.212+0000 7f93db7fe640 1 --2- 172.21.15.130:0/2939907073 >> v2:172.21.15.164:3300/0 conn(0x7f93dc0adf90 0x7f93dc0b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:34.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.216+0000 7f93daffd640 1 --2- 172.21.15.130:0/2939907073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93dc0cd360 0x7f93dc158fa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0af4d0 tx=0x7f93d401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1d099d6652184 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.216+0000 7f93da7fc640 1 -- 172.21.15.130:0/2939907073 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40a5820 con 0x7f93dc0cd360 2023-09-13T06:01:34.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.220+0000 7f93da7fc640 1 -- 172.21.15.130:0/2939907073 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d40a5980 con 0x7f93dc0cd360 2023-09-13T06:01:34.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.220+0000 7f93e1ef9640 1 -- 172.21.15.130:0/2939907073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93dc0cd360 msgr2=0x7f93dc158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.220+0000 7f93e1ef9640 1 --2- 172.21.15.130:0/2939907073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93dc0cd360 0x7f93dc158fa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0af4d0 tx=0x7f93d401c960 comp rx=0 tx=0).stop 2023-09-13T06:01:34.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.220+0000 7f93e1ef9640 1 -- 172.21.15.130:0/2939907073 shutdown_connections 2023-09-13T06:01:34.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.220+0000 7f93e1ef9640 1 --2- 172.21.15.130:0/2939907073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93dc0ae480 0x7f93dc0ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.220+0000 7f93e1ef9640 1 --2- 172.21.15.130:0/2939907073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93dc0cd360 0x7f93dc158fa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.220+0000 7f93e1ef9640 1 --2- 172.21.15.130:0/2939907073 >> v2:172.21.15.164:3300/0 conn(0x7f93dc0adf90 0x7f93dc0b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.220+0000 7f93e1ef9640 1 -- 172.21.15.130:0/2939907073 >> 172.21.15.130:0/2939907073 conn(0x7f93dc065990 msgr2=0x7f93dc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.220+0000 7f93e1ef9640 1 -- 172.21.15.130:0/2939907073 shutdown_connections 2023-09-13T06:01:34.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.220+0000 7f93e1ef9640 1 -- 172.21.15.130:0/2939907073 wait complete. 2023-09-13T06:01:34.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.224+0000 7f93e1ef9640 1 Processor -- start 2023-09-13T06:01:34.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.224+0000 7f93e1ef9640 1 -- start start 2023-09-13T06:01:34.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.224+0000 7f93e1ef9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93dc0adf90 0x7f93dc14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.224+0000 7f93e1ef9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93dc0ae480 0x7f93dc149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93dc0adf90 0x7f93dc14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93db7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93dc0adf90 0x7f93dc14e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60734/0 (socket says 172.21.15.130:60734) 2023-09-13T06:01:34.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93daffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93dc0ae480 0x7f93dc149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93daffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93dc0ae480 0x7f93dc149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37506/0 (socket says 172.21.15.130:37506) 2023-09-13T06:01:34.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93e1ef9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93dc0cd360 0x7f93dc15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93db7fe640 1 -- 172.21.15.130:0/13809857 learned_addr learned my addr 172.21.15.130:0/13809857 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93dbfff640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93dc0cd360 0x7f93dc15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93e1ef9640 1 -- 172.21.15.130:0/13809857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc14b300 con 0x7f93dc0cd360 2023-09-13T06:01:34.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93e1ef9640 1 -- 172.21.15.130:0/13809857 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc14a680 con 0x7f93dc0ae480 2023-09-13T06:01:34.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93e1ef9640 1 -- 172.21.15.130:0/13809857 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc14a960 con 0x7f93dc0adf90 2023-09-13T06:01:34.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93daffd640 1 -- 172.21.15.130:0/13809857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93dc0adf90 msgr2=0x7f93dc14e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93daffd640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93dc0adf90 0x7f93dc14e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93daffd640 1 -- 172.21.15.130:0/13809857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93dc0cd360 msgr2=0x7f93dc15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93daffd640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93dc0cd360 0x7f93dc15efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93daffd640 1 -- 172.21.15.130:0/13809857 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d4009b30 con 0x7f93dc0ae480 2023-09-13T06:01:34.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93dbfff640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93dc0cd360 0x7f93dc15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:34.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.228+0000 7f93daffd640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93dc0ae480 0x7f93dc149d40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0af500 tx=0x7f93d4019700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.232+0000 7f93c3fff640 1 -- 172.21.15.130:0/13809857 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40bb070 con 0x7f93dc0ae480 2023-09-13T06:01:34.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.232+0000 7f93c3fff640 1 -- 172.21.15.130:0/13809857 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d40090d0 con 0x7f93dc0ae480 2023-09-13T06:01:34.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.232+0000 7f93e1ef9640 1 -- 172.21.15.130:0/13809857 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93dc0cd920 con 0x7f93dc0ae480 2023-09-13T06:01:34.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.232+0000 7f93c3fff640 1 -- 172.21.15.130:0/13809857 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40b66c0 con 0x7f93dc0ae480 2023-09-13T06:01:34.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.232+0000 7f93e1ef9640 1 -- 172.21.15.130:0/13809857 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93dc14af20 con 0x7f93dc0ae480 2023-09-13T06:01:34.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.232+0000 7f93e1ef9640 1 -- 172.21.15.130:0/13809857 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93dc14b440 con 0x7f93dc0ae480 2023-09-13T06:01:34.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.232+0000 7f93c3fff640 1 -- 172.21.15.130:0/13809857 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f93d40a5a30 con 0x7f93dc0ae480 2023-09-13T06:01:34.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.236+0000 7f93c3fff640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93c4065d60 0x7f93c4068220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.236+0000 7f93c3fff640 1 -- 172.21.15.130:0/13809857 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93d411de40 con 0x7f93dc0ae480 2023-09-13T06:01:34.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.236+0000 7f93db7fe640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93c4065d60 0x7f93c4068220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.236+0000 7f93c3fff640 1 -- 172.21.15.130:0/13809857 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f93d40eb820 con 0x7f93dc0ae480 2023-09-13T06:01:34.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.240+0000 7f93db7fe640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93c4065d60 0x7f93c4068220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f93dc14bfa0 tx=0x7f93d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.288+0000 7f4f1520b640 1 Processor -- start 2023-09-13T06:01:34.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.288+0000 7f26c9e56640 1 Processor -- start 2023-09-13T06:01:34.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.288+0000 7f26c9e56640 1 -- start start 2023-09-13T06:01:34.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.288+0000 7f4f1520b640 1 -- start start 2023-09-13T06:01:34.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.288+0000 7f26c9e56640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f26c40cc4f0 0x7f26c40cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.288+0000 7f26c9e56640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c40af040 con 0x7f26c40cbdb0 2023-09-13T06:01:34.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.288+0000 7f26c9e56640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c406b7a0 con 0x7f26c40cd580 2023-09-13T06:01:34.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.288+0000 7f26c9e56640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c40cc240 con 0x7f26c40cc4f0 2023-09-13T06:01:34.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f26c2ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f26c40cbdb0 0x7f26c40cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55822/0 (socket says 172.21.15.130:55822) 2023-09-13T06:01:34.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f26c2ffd640 1 -- 172.21.15.130:0/2969421180 learned_addr learned my addr 172.21.15.130:0/2969421180 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:34.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f26c37fe640 1 --2- 172.21.15.130:0/2969421180 >> v2:172.21.15.164:3300/0 conn(0x7f26c40cc4f0 0x7f26c40cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f26c37fe640 1 -- 172.21.15.130:0/2969421180 >> v1:172.21.15.164:6789/0 conn(0x7f26c40cd580 legacy=0x7f26c406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f26c37fe640 1 -- 172.21.15.130:0/2969421180 >> v1:172.21.15.130:6789/0 conn(0x7f26c40cbdb0 legacy=0x7f26c40cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f26c37fe640 1 -- 172.21.15.130:0/2969421180 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40cd9b0 con 0x7f26c40cc4f0 2023-09-13T06:01:34.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f1520b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4f10157a80 0x7f4f100b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f1520b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f1015a490 0x7f4f100aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f1520b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4f100af530 0x7f4f100cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f1520b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f100b34f0 con 0x7f4f10157a80 2023-09-13T06:01:34.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f1520b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f100af960 con 0x7f4f100af530 2023-09-13T06:01:34.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f1520b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1006c8e0 con 0x7f4f1015a490 2023-09-13T06:01:34.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f0e59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f1015a490 0x7f4f100aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f0e59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f1015a490 0x7f4f100aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60736/0 (socket says 172.21.15.130:60736) 2023-09-13T06:01:34.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f0e59c640 1 -- 172.21.15.130:0/2373798014 learned_addr learned my addr 172.21.15.130:0/2373798014 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f0f59e640 1 --2- 172.21.15.130:0/2373798014 >> v2:172.21.15.164:3300/0 conn(0x7f4f100af530 0x7f4f100cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f0e59c640 1 -- 172.21.15.130:0/2373798014 >> v2:172.21.15.164:3300/0 conn(0x7f4f100af530 msgr2=0x7f4f100cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f0e59c640 1 --2- 172.21.15.130:0/2373798014 >> v2:172.21.15.164:3300/0 conn(0x7f4f100af530 0x7f4f100cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f0e59c640 1 -- 172.21.15.130:0/2373798014 >> v2:172.21.15.130:3300/0 conn(0x7f4f10157a80 msgr2=0x7f4f100b2fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:34.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f0ed9d640 1 --2- 172.21.15.130:0/2373798014 >> v2:172.21.15.130:3300/0 conn(0x7f4f10157a80 0x7f4f100b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f0e59c640 1 --2- 172.21.15.130:0/2373798014 >> v2:172.21.15.130:3300/0 conn(0x7f4f10157a80 0x7f4f100b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.292+0000 7f4f0e59c640 1 -- 172.21.15.130:0/2373798014 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1015a950 con 0x7f4f1015a490 2023-09-13T06:01:34.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.296+0000 7f4f0ed9d640 1 --2- 172.21.15.130:0/2373798014 >> v2:172.21.15.130:3300/0 conn(0x7f4f10157a80 0x7f4f100b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:34.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.296+0000 7f26c37fe640 1 --2- 172.21.15.130:0/2969421180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40cc4f0 0x7f26c40cb870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009770 tx=0x7f26b801c2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=656f256532452e7c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.296+0000 7f26c27fc640 1 -- 172.21.15.130:0/2969421180 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b80ac640 con 0x7f26c40cc4f0 2023-09-13T06:01:34.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.296+0000 7f26c27fc640 1 -- 172.21.15.130:0/2969421180 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b80ac7a0 con 0x7f26c40cc4f0 2023-09-13T06:01:34.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.296+0000 7f26c27fc640 1 -- 172.21.15.130:0/2969421180 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b80acb30 con 0x7f26c40cc4f0 2023-09-13T06:01:34.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.296+0000 7f4f0e59c640 1 --2- 172.21.15.130:0/2373798014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f1015a490 0x7f4f100aeff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f1006ea40 tx=0x7f4f0001c230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22278b5d1bbf8637 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.296+0000 7fe2c5bfa640 1 Processor -- start 2023-09-13T06:01:34.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.296+0000 7f26c9e56640 1 -- 172.21.15.130:0/2969421180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40cc4f0 msgr2=0x7f26c40cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.296+0000 7f26c9e56640 1 --2- 172.21.15.130:0/2969421180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40cc4f0 0x7f26c40cb870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009770 tx=0x7f26b801c2b0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7fe2c5bfa640 1 -- start start 2023-09-13T06:01:34.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f26c9e56640 1 -- 172.21.15.130:0/2969421180 shutdown_connections 2023-09-13T06:01:34.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f26c9e56640 1 --2- 172.21.15.130:0/2969421180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40cc4f0 0x7f26c40cb870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f26c9e56640 1 -- 172.21.15.130:0/2969421180 >> 172.21.15.130:0/2969421180 conn(0x7f26c4065990 msgr2=0x7f26c4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f0dd9b640 1 -- 172.21.15.130:0/2373798014 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f000ab600 con 0x7f4f1015a490 2023-09-13T06:01:34.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f0dd9b640 1 -- 172.21.15.130:0/2373798014 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f000a7050 con 0x7f4f1015a490 2023-09-13T06:01:34.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f0dd9b640 1 -- 172.21.15.130:0/2373798014 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f000ab980 con 0x7f4f1015a490 2023-09-13T06:01:34.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f26c9e56640 1 -- 172.21.15.130:0/2969421180 shutdown_connections 2023-09-13T06:01:34.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f26c9e56640 1 -- 172.21.15.130:0/2969421180 wait complete. 2023-09-13T06:01:34.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7faacc374640 1 Processor -- start 2023-09-13T06:01:34.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f1520b640 1 -- 172.21.15.130:0/2373798014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f1015a490 msgr2=0x7f4f100aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f1520b640 1 --2- 172.21.15.130:0/2373798014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f1015a490 0x7f4f100aeff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f1006ea40 tx=0x7f4f0001c230 comp rx=0 tx=0).stop 2023-09-13T06:01:34.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f1520b640 1 -- 172.21.15.130:0/2373798014 shutdown_connections 2023-09-13T06:01:34.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f1520b640 1 --2- 172.21.15.130:0/2373798014 >> v2:172.21.15.164:3300/0 conn(0x7f4f100af530 0x7f4f100cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f1520b640 1 --2- 172.21.15.130:0/2373798014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f1015a490 0x7f4f100aeff0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f1520b640 1 --2- 172.21.15.130:0/2373798014 >> v2:172.21.15.130:3300/0 conn(0x7f4f10157a80 0x7f4f100b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f1520b640 1 -- 172.21.15.130:0/2373798014 >> 172.21.15.130:0/2373798014 conn(0x7f4f10065d90 msgr2=0x7f4f100b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f1520b640 1 -- 172.21.15.130:0/2373798014 shutdown_connections 2023-09-13T06:01:34.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f4f1520b640 1 -- 172.21.15.130:0/2373798014 wait complete. 2023-09-13T06:01:34.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7faacc374640 1 -- start start 2023-09-13T06:01:34.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7fe2c5bfa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe2c00cddc0 0x7fe2c01598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f26c9e56640 1 Processor -- start 2023-09-13T06:01:34.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7fe2c5bfa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2c00af700 0x7fe2c0159e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7fe2c5bfa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c015a640 con 0x7fe2c00cd9e0 2023-09-13T06:01:34.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7fe2c5bfa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c00cb890 con 0x7fe2c00cddc0 2023-09-13T06:01:34.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7f26c9e56640 1 -- start start 2023-09-13T06:01:34.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7fe2c5bfa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00cbb70 con 0x7fe2c00af700 2023-09-13T06:01:34.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7fe2b7fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe2c00cddc0 0x7fe2c01598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7fe2bffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2c00af700 0x7fe2c0159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7fe2b7fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe2c00cddc0 0x7fe2c01598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37532/0 (socket says 172.21.15.130:37532) 2023-09-13T06:01:34.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7fe2b7fff640 1 -- 172.21.15.130:0/3162939029 learned_addr learned my addr 172.21.15.130:0/3162939029 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7faacc374640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac40715b0 0x7faac415e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7faacc374640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faac4071990 0x7faac40d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7faacc374640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac40cfdd0 con 0x7faac40d2990 2023-09-13T06:01:34.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7faacc374640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac4140780 con 0x7faac4071990 2023-09-13T06:01:34.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7faacc374640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac40b8470 con 0x7faac40715b0 2023-09-13T06:01:34.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.300+0000 7fe2bffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2c00af700 0x7fe2c0159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60742/0 (socket says 172.21.15.130:60742) 2023-09-13T06:01:34.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7fe2b7fff640 1 -- 172.21.15.130:0/3162939029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2c00af700 msgr2=0x7fe2c0159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7faac990f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faac4071990 0x7faac40d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f8e1751f640 1 Processor -- start 2023-09-13T06:01:34.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7faac990f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faac4071990 0x7faac40d2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48094/0 (socket says 172.21.15.130:48094) 2023-09-13T06:01:34.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7faac990f640 1 -- 172.21.15.130:0/2540239325 learned_addr learned my addr 172.21.15.130:0/2540239325 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7fe2b7fff640 1 --2- 172.21.15.130:0/3162939029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2c00af700 0x7fe2c0159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7fe2b7fff640 1 -- 172.21.15.130:0/3162939029 >> v1:172.21.15.164:6789/0 conn(0x7fe2c00cd9e0 legacy=0x7fe2c00aeff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:34.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c9e56640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26c40cbdb0 0x7f26c4206c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7faaca110640 1 --2- 172.21.15.130:0/2540239325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac40715b0 0x7faac415e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c9e56640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40cc4f0 0x7f26c4165000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f1520b640 1 Processor -- start 2023-09-13T06:01:34.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c37fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26c40cbdb0 0x7f26c4206c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c37fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26c40cbdb0 0x7f26c4206c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60764/0 (socket says 172.21.15.130:60764) 2023-09-13T06:01:34.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7faac990f640 1 -- 172.21.15.130:0/2540239325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac40715b0 msgr2=0x7faac415e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7faac990f640 1 --2- 172.21.15.130:0/2540239325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac40715b0 0x7faac415e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7faac990f640 1 -- 172.21.15.130:0/2540239325 >> v1:172.21.15.164:6789/0 conn(0x7faac40d2990 legacy=0x7faac4142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7faac990f640 1 -- 172.21.15.130:0/2540239325 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac40d00b0 con 0x7faac4071990 2023-09-13T06:01:34.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7faaca110640 1 --2- 172.21.15.130:0/2540239325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac40715b0 0x7faac415e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:34.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f8e1751f640 1 -- start start 2023-09-13T06:01:34.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f56bc9ab640 1 Processor -- start 2023-09-13T06:01:34.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c37fe640 1 -- 172.21.15.130:0/2008853081 learned_addr learned my addr 172.21.15.130:0/2008853081 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c9e56640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40cd580 0x7f26c41617d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c2ffd640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40cc4f0 0x7f26c4165000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c42071a0 con 0x7f26c40cc4f0 2023-09-13T06:01:34.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c4165540 con 0x7f26c40cd580 2023-09-13T06:01:34.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c4207390 con 0x7f26c40cbdb0 2023-09-13T06:01:34.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c3fff640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40cd580 0x7f26c41617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f56bc9ab640 1 -- start start 2023-09-13T06:01:34.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f1520b640 1 -- start start 2023-09-13T06:01:34.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f1520b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f100af530 0x7f4f1014c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f1520b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f10157a80 0x7f4f101434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f1520b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1015a490 0x7f4f1014a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f0ed9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f100af530 0x7f4f1014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f0ed9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f100af530 0x7f4f1014c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60776/0 (socket says 172.21.15.130:60776) 2023-09-13T06:01:34.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f0ed9d640 1 -- 172.21.15.130:0/3470173561 learned_addr learned my addr 172.21.15.130:0/3470173561 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f1520b640 1 -- 172.21.15.130:0/3470173561 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1014b540 con 0x7f4f10157a80 2023-09-13T06:01:34.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f0e59c640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f10157a80 0x7f4f101434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f0f59e640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1015a490 0x7f4f1014a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f4f1520b640 1 -- 172.21.15.130:0/3470173561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1014c2f0 con 0x7f4f1015a490 2023-09-13T06:01:34.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4f1520b640 1 -- 172.21.15.130:0/3470173561 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1014b720 con 0x7f4f100af530 2023-09-13T06:01:34.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c2ffd640 1 -- 172.21.15.130:0/2008853081 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26c40cbdb0 msgr2=0x7f26c4206c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c2ffd640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26c40cbdb0 0x7f26c4206c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c2ffd640 1 -- 172.21.15.130:0/2008853081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40cd580 msgr2=0x7f26c41617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c2ffd640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40cd580 0x7f26c41617d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f26c2ffd640 1 -- 172.21.15.130:0/2008853081 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8009420 con 0x7f26c40cc4f0 2023-09-13T06:01:34.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f8e1751f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8e10071990 0x7f8e100d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f8e1751f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1015e8e0 con 0x7f8e100d2990 2023-09-13T06:01:34.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f8e1751f640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e100b8470 con 0x7f8e100715b0 2023-09-13T06:01:34.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7f8e1751f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e10140780 con 0x7f8e10071990 2023-09-13T06:01:34.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e15abc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f8e100d2990 0x7f8e10160f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55830/0 (socket says 172.21.15.130:55830) 2023-09-13T06:01:34.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e15abc640 1 -- 172.21.15.130:0/859771969 learned_addr learned my addr 172.21.15.130:0/859771969 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:34.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56bc9ab640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56b80d1f50 0x7f56b8070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56bc9ab640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f56b80706c0 0x7f56b815d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56bc9ab640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b80d1ac0 con 0x7f56b8146b30 2023-09-13T06:01:34.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56bc9ab640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b8070b70 con 0x7f56b80706c0 2023-09-13T06:01:34.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56bc9ab640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80d0be0 con 0x7f56b80d1f50 2023-09-13T06:01:34.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f26c2ffd640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40cc4f0 0x7f26c4165000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c3c0 tx=0x7f26b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134832663 0 0) 0x7f8e100b8470 con 0x7f8e100715b0 2023-09-13T06:01:34.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56b759e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f56b80706c0 0x7f56b815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56b759e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f56b80706c0 0x7f56b815d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37558/0 (socket says 172.21.15.130:37558) 2023-09-13T06:01:34.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56b759e640 1 -- 172.21.15.130:0/1629395568 learned_addr learned my addr 172.21.15.130:0/1629395568 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dfc003530 con 0x7f8e100715b0 2023-09-13T06:01:34.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4f0f59e640 1 -- 172.21.15.130:0/3470173561 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f100af530 msgr2=0x7f4f1014c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4f0f59e640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f100af530 0x7f4f1014c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4f0f59e640 1 -- 172.21.15.130:0/3470173561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f10157a80 msgr2=0x7f4f101434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4f0f59e640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f10157a80 0x7f4f101434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4f0f59e640 1 -- 172.21.15.130:0/3470173561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f000094d0 con 0x7f4f1015a490 2023-09-13T06:01:34.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f26abfff640 1 -- 172.21.15.130:0/2008853081 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4005cf0 con 0x7f26c40cc4f0 2023-09-13T06:01:34.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f26abfff640 1 -- 172.21.15.130:0/2008853081 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b4005e50 con 0x7f26c40cc4f0 2023-09-13T06:01:34.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c4207670 con 0x7f26c40cc4f0 2023-09-13T06:01:34.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f26abfff640 1 -- 172.21.15.130:0/2008853081 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40072f0 con 0x7f26c40cc4f0 2023-09-13T06:01:34.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56b659c640 1 --2- 172.21.15.130:0/1629395568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56b80d1f50 0x7f56b8070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56b759e640 1 -- 172.21.15.130:0/1629395568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56b80d1f50 msgr2=0x7f56b8070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955562430 0 0) 0x7f8e1015e8e0 con 0x7f8e100d2990 2023-09-13T06:01:34.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e100b8470 con 0x7f8e100d2990 2023-09-13T06:01:34.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.304+0000 7fe2b7fff640 1 -- 172.21.15.130:0/3162939029 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00cbe50 con 0x7fe2c00cddc0 2023-09-13T06:01:34.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c416b700 con 0x7f26c40cc4f0 2023-09-13T06:01:34.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4f0f59e640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1015a490 0x7f4f1014a240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800efc0 tx=0x7f4f0800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7fe2b7fff640 1 --2- 172.21.15.130:0/3162939029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2c00cddc0 0x7fe2c01598d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800aa10 tx=0x7fe2a801d8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f828dfcc265a274d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4066820432 0 0) 0x7f8dfc003530 con 0x7f8e100715b0 2023-09-13T06:01:34.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 >> v2:172.21.15.130:3300/0 conn(0x7f8e10071990 msgr2=0x7f8e100d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 --2- 172.21.15.130:0/859771969 >> v2:172.21.15.130:3300/0 conn(0x7f8e10071990 0x7f8e100d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 >> v1:172.21.15.130:6789/0 conn(0x7f8e100d2990 legacy=0x7f8e10160f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100cfdd0 con 0x7f8e100715b0 2023-09-13T06:01:34.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f8e0c001680 con 0x7f8e100715b0 2023-09-13T06:01:34.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 >> v1:172.21.15.164:6789/0 conn(0x7f8e100715b0 legacy=0x7f8e1015e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 --2- 172.21.15.130:0/859771969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dfc003b80 0x7f8dfc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 --2- 172.21.15.130:0/859771969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8dfc0047d0 0x7f8dfc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 --2- 172.21.15.130:0/859771969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dfc005390 0x7f8dfc0141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10140780 con 0x7f8dfc005390 2023-09-13T06:01:34.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc014a10 con 0x7f8dfc003b80 2023-09-13T06:01:34.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc014bd0 con 0x7f8dfc0047d0 2023-09-13T06:01:34.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e152bb640 1 --2- 172.21.15.130:0/859771969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dfc003b80 0x7f8dfc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e14aba640 1 --2- 172.21.15.130:0/859771969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8dfc0047d0 0x7f8dfc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7fe2beffd640 1 -- 172.21.15.130:0/3162939029 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80a6910 con 0x7fe2c00cddc0 2023-09-13T06:01:34.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7fe2beffd640 1 -- 172.21.15.130:0/3162939029 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a80a6a70 con 0x7fe2c00cddc0 2023-09-13T06:01:34.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4ef77fe640 1 -- 172.21.15.130:0/3470173561 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08009c00 con 0x7f4f1015a490 2023-09-13T06:01:34.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4ef77fe640 1 -- 172.21.15.130:0/3470173561 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0800f040 con 0x7f4f1015a490 2023-09-13T06:01:34.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4ef77fe640 1 -- 172.21.15.130:0/3470173561 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080146c0 con 0x7f4f1015a490 2023-09-13T06:01:34.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7fe2beffd640 1 -- 172.21.15.130:0/3162939029 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80a6910 con 0x7fe2c00cddc0 2023-09-13T06:01:34.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4f1520b640 1 -- 172.21.15.130:0/3470173561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1014b9c0 con 0x7f4f1015a490 2023-09-13T06:01:34.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e152bb640 1 -- 172.21.15.130:0/859771969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8dfc0047d0 msgr2=0x7f8dfc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e152bb640 1 --2- 172.21.15.130:0/859771969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8dfc0047d0 0x7f8dfc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e152bb640 1 -- 172.21.15.130:0/859771969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dfc005390 msgr2=0x7f8dfc0141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e152bb640 1 --2- 172.21.15.130:0/859771969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dfc005390 0x7f8dfc0141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e152bb640 1 -- 172.21.15.130:0/859771969 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100cfdd0 con 0x7f8dfc003b80 2023-09-13T06:01:34.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f8e15abc640 1 -- 172.21.15.130:0/859771969 reap_dead start 2023-09-13T06:01:34.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f4f1520b640 1 -- 172.21.15.130:0/3470173561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1014bf80 con 0x7f4f1015a490 2023-09-13T06:01:34.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7faac990f640 1 --2- 172.21.15.130:0/2540239325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faac4071990 0x7faac40d2450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faab4009870 tx=0x7faab401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e9eae408d1f0a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7faac910e640 1 -- 172.21.15.130:0/2540239325 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4004230 con 0x7faac4071990 2023-09-13T06:01:34.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3162939029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2c00cddc0 msgr2=0x7fe2c01598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7fe2c5bfa640 1 --2- 172.21.15.130:0/3162939029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2c00cddc0 0x7fe2c01598d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800aa10 tx=0x7fe2a801d8a0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7faac910e640 1 -- 172.21.15.130:0/2540239325 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab40a7050 con 0x7faac4071990 2023-09-13T06:01:34.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7faacc374640 1 -- 172.21.15.130:0/2540239325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faac4071990 msgr2=0x7faac40d2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3162939029 shutdown_connections 2023-09-13T06:01:34.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7fe2c5bfa640 1 --2- 172.21.15.130:0/3162939029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2c00af700 0x7fe2c0159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7fe2c5bfa640 1 --2- 172.21.15.130:0/3162939029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2c00cddc0 0x7fe2c01598d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3162939029 >> 172.21.15.130:0/3162939029 conn(0x7fe2c0065d90 msgr2=0x7fe2c00b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3162939029 shutdown_connections 2023-09-13T06:01:34.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3162939029 wait complete. 2023-09-13T06:01:34.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7faac910e640 1 -- 172.21.15.130:0/2540239325 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4004230 con 0x7faac4071990 2023-09-13T06:01:34.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56b759e640 1 --2- 172.21.15.130:0/1629395568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56b80d1f50 0x7f56b8070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56b759e640 1 -- 172.21.15.130:0/1629395568 >> v1:172.21.15.130:6789/0 conn(0x7f56b8146b30 legacy=0x7f56b80d04d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T06:01:34.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56b759e640 1 -- 172.21.15.130:0/1629395568 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b80d0eb0 con 0x7f56b80706c0 2023-09-13T06:01:34.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.308+0000 7f56b659c640 1 --2- 172.21.15.130:0/1629395568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56b80d1f50 0x7f56b8070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:34.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7f26abfff640 1 -- 172.21.15.130:0/2008853081 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f26b4007450 con 0x7f26c40cc4f0 2023-09-13T06:01:34.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7faacc374640 1 --2- 172.21.15.130:0/2540239325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faac4071990 0x7faac40d2450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faab4009870 tx=0x7faab401c560 comp rx=0 tx=0).stop 2023-09-13T06:01:34.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7faacc374640 1 -- 172.21.15.130:0/2540239325 shutdown_connections 2023-09-13T06:01:34.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7faacc374640 1 --2- 172.21.15.130:0/2540239325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faac4071990 0x7faac40d2450 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faab4009870 tx=0x7faab401c560 comp rx=0 tx=0).stop 2023-09-13T06:01:34.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7faacc374640 1 --2- 172.21.15.130:0/2540239325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac40715b0 0x7faac415e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7faacc374640 1 -- 172.21.15.130:0/2540239325 >> 172.21.15.130:0/2540239325 conn(0x7faac40d32a0 msgr2=0x7faac40d3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7f56b759e640 1 --2- 172.21.15.130:0/1629395568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b80706c0 0x7f56b815d760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009e50 tx=0x7f56b001c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a2636c85d152e67 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7faacc374640 1 -- 172.21.15.130:0/2540239325 shutdown_connections 2023-09-13T06:01:34.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7f56b5d9b640 1 -- 172.21.15.130:0/1629395568 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b00a5820 con 0x7f56b80706c0 2023-09-13T06:01:34.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a4005260 con 0x7f26c40cc4f0 2023-09-13T06:01:34.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7f56b5d9b640 1 -- 172.21.15.130:0/1629395568 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b00a5980 con 0x7f56b80706c0 2023-09-13T06:01:34.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7f56b5d9b640 1 -- 172.21.15.130:0/1629395568 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b00a5d10 con 0x7f56b80706c0 2023-09-13T06:01:34.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7f8e152bb640 1 --2- 172.21.15.130:0/859771969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dfc003b80 0x7f8dfc003f80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c160 tx=0x7f8e0c01f2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b2c20c0af860161 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f26abfff640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26b0065b70 0x7f26b0068030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1629395568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b80706c0 msgr2=0x7f56b815d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f56bc9ab640 1 --2- 172.21.15.130:0/1629395568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b80706c0 0x7f56b815d760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009e50 tx=0x7f56b001c9c0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f26abfff640 1 -- 172.21.15.130:0/2008853081 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26b4082790 con 0x7f26c40cc4f0 2023-09-13T06:01:34.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f26c37fe640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26b0065b70 0x7f26b0068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2c5bfa640 1 Processor -- start 2023-09-13T06:01:34.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2c5bfa640 1 -- start start 2023-09-13T06:01:34.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0b0440 con 0x7f8dfc003b80 2023-09-13T06:01:34.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c0b05c0 con 0x7f8dfc003b80 2023-09-13T06:01:34.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f8e07fff640 1 -- 172.21.15.130:0/859771969 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0b09b0 con 0x7f8dfc003b80 2023-09-13T06:01:34.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f8e1751f640 1 -- 172.21.15.130:0/859771969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dfc003b80 msgr2=0x7f8dfc003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f8e1751f640 1 --2- 172.21.15.130:0/859771969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dfc003b80 0x7f8dfc003f80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c160 tx=0x7f8e0c01f2b0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7f4ef77fe640 1 -- 172.21.15.130:0/3470173561 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4f08014820 con 0x7f4f1015a490 2023-09-13T06:01:34.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f4ef77fe640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ef8065db0 0x7f4ef8068270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f4ef77fe640 1 -- 172.21.15.130:0/3470173561 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f08084030 con 0x7f4f1015a490 2023-09-13T06:01:34.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1629395568 shutdown_connections 2023-09-13T06:01:34.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f56bc9ab640 1 --2- 172.21.15.130:0/1629395568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b80706c0 0x7f56b815d760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f56bc9ab640 1 --2- 172.21.15.130:0/1629395568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56b80d1f50 0x7f56b8070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1629395568 >> 172.21.15.130:0/1629395568 conn(0x7f56b80d3090 msgr2=0x7f56b80d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f8e1751f640 1 -- 172.21.15.130:0/859771969 shutdown_connections 2023-09-13T06:01:34.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f8e1751f640 1 --2- 172.21.15.130:0/859771969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dfc003b80 0x7f8dfc003f80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f8e1751f640 1 -- 172.21.15.130:0/859771969 >> 172.21.15.130:0/859771969 conn(0x7f8e100d32a0 msgr2=0x7f8e100d3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1629395568 shutdown_connections 2023-09-13T06:01:34.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f4f0ed9d640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ef8065db0 0x7f4ef8068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7f4ef57fa640 1 -- 172.21.15.130:0/3470173561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee8005260 con 0x7f4f1015a490 2023-09-13T06:01:34.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.312+0000 7faacc374640 1 -- 172.21.15.130:0/2540239325 wait complete. 2023-09-13T06:01:34.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f8e1751f640 1 -- 172.21.15.130:0/859771969 shutdown_connections 2023-09-13T06:01:34.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fdaa19db640 1 Processor -- start 2023-09-13T06:01:34.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f8e1751f640 1 -- 172.21.15.130:0/859771969 wait complete. 2023-09-13T06:01:34.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7faacc374640 1 Processor -- start 2023-09-13T06:01:34.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f26c37fe640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26b0065b70 0x7f26b0068030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26b8000c10 tx=0x7f26b80a6070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1629395568 wait complete. 2023-09-13T06:01:34.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7faacc374640 1 -- start start 2023-09-13T06:01:34.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2c5bfa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c00af700 0x7fe2c014d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2c5bfa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2c00cddc0 0x7fe2c015d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2c5bfa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2c01fa850 0x7fe2c01fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2c5bfa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c014de10 con 0x7fe2c00af700 2023-09-13T06:01:34.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2c5bfa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c015bf50 con 0x7fe2c01fa850 2023-09-13T06:01:34.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2c5bfa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c015b3d0 con 0x7fe2c00cddc0 2023-09-13T06:01:34.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2bffff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2c01fa850 0x7fe2c01fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2c00cddc0 0x7fe2c015d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2bffff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2c01fa850 0x7fe2c01fd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37568/0 (socket says 172.21.15.130:37568) 2023-09-13T06:01:34.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fe2bffff640 1 -- 172.21.15.130:0/3820656883 learned_addr learned my addr 172.21.15.130:0/3820656883 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fe2bffff640 1 -- 172.21.15.130:0/3820656883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2c00cddc0 msgr2=0x7fe2c015d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fe2bffff640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2c00cddc0 0x7fe2c015d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fe2bffff640 1 -- 172.21.15.130:0/3820656883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c00af700 msgr2=0x7fe2c014d8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T06:01:34.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fe2bffff640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c00af700 0x7fe2c014d8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fe2bffff640 1 -- 172.21.15.130:0/3820656883 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a800a670 con 0x7fe2c01fa850 2023-09-13T06:01:34.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fe2bffff640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2c01fa850 0x7fe2c01fd0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800e910 tx=0x7fe2b800edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faacc374640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faac40715b0 0x7faac415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faacc374640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faac40d2990 0x7faac40b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7f56bc9ab640 1 Processor -- start 2023-09-13T06:01:34.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.316+0000 7fdaa19db640 1 -- start start 2023-09-13T06:01:34.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fdaa19db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c153ce0 0x7fda9c15ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fdaa19db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fda9c06a9b0 0x7fda9c06ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fdaa19db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0c35a0 con 0x7fda9c0c2b90 2023-09-13T06:01:34.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fdaa19db640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c1540c0 con 0x7fda9c06a9b0 2023-09-13T06:01:34.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fdaa19db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c06b380 con 0x7fda9c153ce0 2023-09-13T06:01:34.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faacc374640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac4156100 0x7faac40b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7f8e1751f640 1 Processor -- start 2023-09-13T06:01:34.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faacc374640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac415ae60 con 0x7faac40715b0 2023-09-13T06:01:34.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faacc374640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac40b6290 con 0x7faac40d2990 2023-09-13T06:01:34.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faacc374640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac40b6570 con 0x7faac4156100 2023-09-13T06:01:34.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faac990f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faac40d2990 0x7faac40b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faac990f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faac40d2990 0x7faac40b7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37580/0 (socket says 172.21.15.130:37580) 2023-09-13T06:01:34.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faac990f640 1 -- 172.21.15.130:0/2855898712 learned_addr learned my addr 172.21.15.130:0/2855898712 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7f56bc9ab640 1 -- start start 2023-09-13T06:01:34.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faaca110640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faac40715b0 0x7faac415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fda9bfff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fda9c06a9b0 0x7fda9c06ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fda9bfff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fda9c06a9b0 0x7fda9c06ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37590/0 (socket says 172.21.15.130:37590) 2023-09-13T06:01:34.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fda9bfff640 1 -- 172.21.15.130:0/274746865 learned_addr learned my addr 172.21.15.130:0/274746865 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fda9affd640 1 --2- 172.21.15.130:0/274746865 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c153ce0 0x7fda9c15ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7f8e1751f640 1 -- start start 2023-09-13T06:01:34.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faaca911640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac4156100 0x7faac40b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faac990f640 1 -- 172.21.15.130:0/2855898712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac4156100 msgr2=0x7faac40b7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faac990f640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac4156100 0x7faac40b7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faac990f640 1 -- 172.21.15.130:0/2855898712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faac40715b0 msgr2=0x7faac415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faac990f640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faac40715b0 0x7faac415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faac990f640 1 -- 172.21.15.130:0/2855898712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab40094d0 con 0x7faac40d2990 2023-09-13T06:01:34.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faaca911640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac4156100 0x7faac40b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:34.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fda9bfff640 1 -- 172.21.15.130:0/274746865 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c153ce0 msgr2=0x7fda9c15ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fda9bfff640 1 --2- 172.21.15.130:0/274746865 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c153ce0 0x7fda9c15ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fda9bfff640 1 -- 172.21.15.130:0/274746865 >> v1:172.21.15.164:6789/0 conn(0x7fda9c0c2b90 legacy=0x7fda9c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7f4f0ed9d640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ef8065db0 0x7f4ef8068270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f04006fd0 tx=0x7f4f04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fda9bfff640 1 -- 172.21.15.130:0/274746865 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0c3100 con 0x7fda9c06a9b0 2023-09-13T06:01:34.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7faac990f640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faac40d2990 0x7faac40b7330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faab40ae040 tx=0x7faab4019300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7f8e1751f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dfc003b80 0x7f8e101ff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7f8e1751f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1014e790 0x7f8e1014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7fe2bcff9640 1 -- 172.21.15.130:0/3820656883 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800ca50 con 0x7fe2c01fa850 2023-09-13T06:01:34.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7fe2bcff9640 1 -- 172.21.15.130:0/3820656883 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800cbb0 con 0x7fe2c01fa850 2023-09-13T06:01:34.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7fe2bcff9640 1 -- 172.21.15.130:0/3820656883 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8013420 con 0x7fe2c01fa850 2023-09-13T06:01:34.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7f8e1751f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e10154db0 0x7f8e10155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7f8e1751f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1014f150 con 0x7f8e10154db0 2023-09-13T06:01:34.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7f8e1751f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10155a70 con 0x7f8dfc003b80 2023-09-13T06:01:34.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.320+0000 7f8e1751f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1014ce70 con 0x7f8e1014e790 2023-09-13T06:01:34.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f8e152bb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dfc003b80 0x7f8e101ff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f56bc9ab640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56b80706c0 0x7f56b815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f8e14aba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1014e790 0x7f8e1014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f56b6d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56b80706c0 0x7f56b815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f56b6d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56b80706c0 0x7f56b815cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48158/0 (socket says 172.21.15.130:48158) 2023-09-13T06:01:34.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f56b6d9d640 1 -- 172.21.15.130:0/1753829733 learned_addr learned my addr 172.21.15.130:0/1753829733 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f56bc9ab640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56b80d1f50 0x7f56b806a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f8e15abc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e10154db0 0x7f8e10155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f8e15abc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e10154db0 0x7f8e10155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48156/0 (socket says 172.21.15.130:48156) 2023-09-13T06:01:34.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f8e15abc640 1 -- 172.21.15.130:0/299128319 learned_addr learned my addr 172.21.15.130:0/299128319 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3820656883 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c015b6b0 con 0x7fe2c01fa850 2023-09-13T06:01:34.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3820656883 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c015bc70 con 0x7fe2c01fa850 2023-09-13T06:01:34.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f8e15abc640 1 -- 172.21.15.130:0/299128319 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1014e790 msgr2=0x7f8e1014ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f8e15abc640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1014e790 0x7f8e1014ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f8e15abc640 1 -- 172.21.15.130:0/299128319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dfc003b80 msgr2=0x7f8e101ff8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f8e15abc640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dfc003b80 0x7f8e101ff8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f8e15abc640 1 -- 172.21.15.130:0/299128319 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1014d150 con 0x7f8e10154db0 2023-09-13T06:01:34.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f8e15abc640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e10154db0 0x7f8e10155230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8e10157fa0 tx=0x7f8e0800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f26abfff640 1 -- 172.21.15.130:0/2008853081 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f26b4050170 con 0x7f26c40cc4f0 2023-09-13T06:01:34.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7faabaffd640 1 -- 172.21.15.130:0/2855898712 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4003ca0 con 0x7faac40d2990 2023-09-13T06:01:34.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7faabaffd640 1 -- 172.21.15.130:0/2855898712 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4003e20 con 0x7faac40d2990 2023-09-13T06:01:34.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7faabaffd640 1 -- 172.21.15.130:0/2855898712 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40ab680 con 0x7faac40d2990 2023-09-13T06:01:34.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7faacc374640 1 -- 172.21.15.130:0/2855898712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac40b6850 con 0x7faac40d2990 2023-09-13T06:01:34.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7faacc374640 1 -- 172.21.15.130:0/2855898712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac40b6e10 con 0x7faac40d2990 2023-09-13T06:01:34.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56bc9ab640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b8146b30 0x7f56b806ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b813feb0 con 0x7f56b80706c0 2023-09-13T06:01:34.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b81384b0 con 0x7f56b8146b30 2023-09-13T06:01:34.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56b659c640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56b80d1f50 0x7f56b806a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7faacc374640 1 -- 172.21.15.130:0/2855898712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac005260 con 0x7faac40d2990 2023-09-13T06:01:34.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b813fbd0 con 0x7f56b80d1f50 2023-09-13T06:01:34.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.324+0000 7f4ef77fe640 1 -- 172.21.15.130:0/3470173561 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4f08018020 con 0x7f4f1015a490 2023-09-13T06:01:34.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7faabaffd640 1 -- 172.21.15.130:0/2855898712 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7faab40ab7e0 con 0x7faac40d2990 2023-09-13T06:01:34.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7faabaffd640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaa8065c20 0x7faaa80680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7faabaffd640 1 -- 172.21.15.130:0/2855898712 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faab411db70 con 0x7faac40d2990 2023-09-13T06:01:34.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3820656883 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c00618a0 con 0x7fe2c01fa850 2023-09-13T06:01:34.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56b759e640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b8146b30 0x7f56b806ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56b6d9d640 1 -- 172.21.15.130:0/1753829733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56b80d1f50 msgr2=0x7f56b806a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56b6d9d640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56b80d1f50 0x7f56b806a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56b6d9d640 1 -- 172.21.15.130:0/1753829733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b8146b30 msgr2=0x7f56b806ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56b6d9d640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b8146b30 0x7f56b806ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56b6d9d640 1 -- 172.21.15.130:0/1753829733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b0009b30 con 0x7f56b80706c0 2023-09-13T06:01:34.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f56b6d9d640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56b80706c0 0x7f56b815cc50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f56a800b3f0 tx=0x7f56a800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7f56af7fe640 1 -- 172.21.15.130:0/1753829733 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8011830 con 0x7f56b80706c0 2023-09-13T06:01:34.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7f56af7fe640 1 -- 172.21.15.130:0/1753829733 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a8011990 con 0x7f56b80706c0 2023-09-13T06:01:34.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7f56af7fe640 1 -- 172.21.15.130:0/1753829733 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8011d40 con 0x7f56b80706c0 2023-09-13T06:01:34.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f8e05ffb640 1 -- 172.21.15.130:0/299128319 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800aa80 con 0x7f8e10154db0 2023-09-13T06:01:34.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f8e1751f640 1 -- 172.21.15.130:0/299128319 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1014d430 con 0x7f8e10154db0 2023-09-13T06:01:34.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f8e05ffb640 1 -- 172.21.15.130:0/299128319 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0800abe0 con 0x7f8e10154db0 2023-09-13T06:01:34.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f8e1751f640 1 -- 172.21.15.130:0/299128319 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e10155770 con 0x7f8e10154db0 2023-09-13T06:01:34.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f8e1751f640 1 -- 172.21.15.130:0/299128319 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e10073cd0 con 0x7f8e10154db0 2023-09-13T06:01:34.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7f8e05ffb640 1 -- 172.21.15.130:0/299128319 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0801c440 con 0x7f8e10154db0 2023-09-13T06:01:34.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7faaca110640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaa8065c20 0x7faaa80680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7fda9bfff640 1 --2- 172.21.15.130:0/274746865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c06a9b0 0x7fda9c06ae40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda8c008870 tx=0x7fda8c01ea10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45a9c740040aa68e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b8138750 con 0x7f56b80706c0 2023-09-13T06:01:34.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b813ee50 con 0x7f56b80706c0 2023-09-13T06:01:34.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7faaca110640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaa8065c20 0x7faaa80680e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faac000ab60 tx=0x7faac0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.328+0000 7fe2bcff9640 1 -- 172.21.15.130:0/3820656883 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe2b8013580 con 0x7fe2c01fa850 2023-09-13T06:01:34.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7fe2bcff9640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe2a0065bf0 0x7fe2a00680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7fe2bcff9640 1 -- 172.21.15.130:0/3820656883 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2b8083400 con 0x7fe2c01fa850 2023-09-13T06:01:34.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7fe2bf7fe640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe2a0065bf0 0x7fe2a00680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7faabaffd640 1 -- 172.21.15.130:0/2855898712 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7faab40eb530 con 0x7faac40d2990 2023-09-13T06:01:34.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7f8e05ffb640 1 -- 172.21.15.130:0/299128319 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8e08012400 con 0x7f8e10154db0 2023-09-13T06:01:34.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7fe2bf7fe640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe2a0065bf0 0x7fe2a00680b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00afcc0 tx=0x7fe2b0006be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.332+0000 7f8e05ffb640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8df4065b50 0x7f8df4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.336+0000 7f8e05ffb640 1 -- 172.21.15.130:0/299128319 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e08083790 con 0x7f8e10154db0 2023-09-13T06:01:34.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.336+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b8138310 con 0x7f56b80706c0 2023-09-13T06:01:34.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.336+0000 7f8e152bb640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8df4065b50 0x7f8df4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.336+0000 7f8e152bb640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8df4065b50 0x7f8df4068010 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0b2000 tx=0x7f8e0c005040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.336+0000 7fda99ffb640 1 -- 172.21.15.130:0/274746865 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0a7ac0 con 0x7fda9c06a9b0 2023-09-13T06:01:34.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.336+0000 7fda99ffb640 1 -- 172.21.15.130:0/274746865 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c0ab070 con 0x7fda9c06a9b0 2023-09-13T06:01:34.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.336+0000 7fda99ffb640 1 -- 172.21.15.130:0/274746865 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0a7e40 con 0x7fda9c06a9b0 2023-09-13T06:01:34.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.336+0000 7fdaa19db640 1 -- 172.21.15.130:0/274746865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c06a9b0 msgr2=0x7fda9c06ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.336+0000 7fdaa19db640 1 --2- 172.21.15.130:0/274746865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c06a9b0 0x7fda9c06ae40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda8c008870 tx=0x7fda8c01ea10 comp rx=0 tx=0).stop 2023-09-13T06:01:34.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.336+0000 7fe2bcff9640 1 -- 172.21.15.130:0/3820656883 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe2b8050e70 con 0x7fe2c01fa850 2023-09-13T06:01:34.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.340+0000 7fdaa19db640 1 -- 172.21.15.130:0/274746865 shutdown_connections 2023-09-13T06:01:34.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.340+0000 7fdaa19db640 1 --2- 172.21.15.130:0/274746865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c06a9b0 0x7fda9c06ae40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.340+0000 7fdaa19db640 1 --2- 172.21.15.130:0/274746865 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c153ce0 0x7fda9c15ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.340+0000 7fdaa19db640 1 -- 172.21.15.130:0/274746865 >> 172.21.15.130:0/274746865 conn(0x7fda9c06a5a0 msgr2=0x7fda9c071180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.340+0000 7fdaa19db640 1 -- 172.21.15.130:0/274746865 shutdown_connections 2023-09-13T06:01:34.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.340+0000 7fdaa19db640 1 -- 172.21.15.130:0/274746865 wait complete. 2023-09-13T06:01:34.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.340+0000 7f8e05ffb640 1 -- 172.21.15.130:0/299128319 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8e080510f0 con 0x7f8e10154db0 2023-09-13T06:01:34.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.340+0000 7fdaa19db640 1 Processor -- start 2023-09-13T06:01:34.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.340+0000 7fdaa19db640 1 -- start start 2023-09-13T06:01:34.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7fdaa19db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c06a9b0 0x7fda9c15cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7fdaa19db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda9c0c2b90 0x7fda9c1fa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7fda9affd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c06a9b0 0x7fda9c15cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7fda9affd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c06a9b0 0x7fda9c15cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:60844/0 (socket says 172.21.15.130:60844) 2023-09-13T06:01:34.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7fda9affd640 1 -- 172.21.15.130:0/1968745078 learned_addr learned my addr 172.21.15.130:0/1968745078 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7fda9a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda9c0c2b90 0x7fda9c1fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7fdaa19db640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c153ce0 0x7fda9c0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1fb390 con 0x7fda9c0c2b90 2023-09-13T06:01:34.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c15d300 con 0x7fda9c153ce0 2023-09-13T06:01:34.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1fa8c0 con 0x7fda9c06a9b0 2023-09-13T06:01:34.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7f56af7fe640 1 -- 172.21.15.130:0/1753829733 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f56a801a400 con 0x7f56b80706c0 2023-09-13T06:01:34.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7f56af7fe640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5698065bf0 0x7f56980680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.344+0000 7f56af7fe640 1 -- 172.21.15.130:0/1753829733 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56a8083800 con 0x7f56b80706c0 2023-09-13T06:01:34.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7fda9affd640 1 -- 172.21.15.130:0/1968745078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c153ce0 msgr2=0x7fda9c0b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7fda9affd640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c153ce0 0x7fda9c0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7fda9affd640 1 -- 172.21.15.130:0/1968745078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda9c0c2b90 msgr2=0x7fda9c1fa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7fda9affd640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda9c0c2b90 0x7fda9c1fa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7fda9affd640 1 -- 172.21.15.130:0/1968745078 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c008550 con 0x7fda9c06a9b0 2023-09-13T06:01:34.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7fda9affd640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c06a9b0 0x7fda9c15cdc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fda9000e8a0 tx=0x7fda9000eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7f56b659c640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5698065bf0 0x7f56980680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7f56b659c640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5698065bf0 0x7f56980680b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56b81374d0 tx=0x7f56a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7fda83fff640 1 -- 172.21.15.130:0/1968745078 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000c940 con 0x7fda9c06a9b0 2023-09-13T06:01:34.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c1faaf0 con 0x7fda9c06a9b0 2023-09-13T06:01:34.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7fda83fff640 1 -- 172.21.15.130:0/1968745078 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9000caa0 con 0x7fda9c06a9b0 2023-09-13T06:01:34.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7f56af7fe640 1 -- 172.21.15.130:0/1753829733 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f56a8051130 con 0x7f56b80706c0 2023-09-13T06:01:34.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7fda83fff640 1 -- 172.21.15.130:0/1968745078 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000ce10 con 0x7fda9c06a9b0 2023-09-13T06:01:34.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.348+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c1fb0b0 con 0x7fda9c06a9b0 2023-09-13T06:01:34.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.352+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c0618a0 con 0x7fda9c06a9b0 2023-09-13T06:01:34.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.352+0000 7fda83fff640 1 -- 172.21.15.130:0/1968745078 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fda90013470 con 0x7fda9c06a9b0 2023-09-13T06:01:34.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.352+0000 7fda83fff640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda84065d20 0x7fda840681e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.352+0000 7fda83fff640 1 -- 172.21.15.130:0/1968745078 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda90086500 con 0x7fda9c06a9b0 2023-09-13T06:01:34.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.352+0000 7fda9a7fc640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda84065d20 0x7fda840681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.356+0000 7fda9a7fc640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda84065d20 0x7fda840681e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0700d0 tx=0x7fda94003dd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.360+0000 7fda83fff640 1 -- 172.21.15.130:0/1968745078 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fda90050440 con 0x7fda9c06a9b0 2023-09-13T06:01:34.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.572+0000 7f93e1ef9640 1 -- 172.21.15.130:0/13809857 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f93dc14b440 con 0x7f93dc0ae480 2023-09-13T06:01:34.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.572+0000 7f93c3fff640 1 -- 172.21.15.130:0/13809857 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93dc14b440 con 0x7f93dc0ae480 2023-09-13T06:01:34.579 INFO:teuthology.orchestra.run.smithi130.stdout:55834574853 2023-09-13T06:01:34.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.576+0000 7f93c1ffb640 1 -- 172.21.15.130:0/13809857 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93c4065d60 msgr2=0x7f93c4068220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.576+0000 7f93c1ffb640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93c4065d60 0x7f93c4068220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f93dc14bfa0 tx=0x7f93d0008040 comp rx=0 tx=0).stop 2023-09-13T06:01:34.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.576+0000 7f93c1ffb640 1 -- 172.21.15.130:0/13809857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93dc0ae480 msgr2=0x7f93dc149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.576+0000 7f93c1ffb640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93dc0ae480 0x7f93dc149d40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0af500 tx=0x7f93d4019700 comp rx=0 tx=0).stop 2023-09-13T06:01:34.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.576+0000 7f93c1ffb640 1 -- 172.21.15.130:0/13809857 shutdown_connections 2023-09-13T06:01:34.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.576+0000 7f93c1ffb640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93c4065d60 0x7f93c4068220 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.576+0000 7f93c1ffb640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93dc0ae480 0x7f93dc149d40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.576+0000 7f93c1ffb640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93dc0cd360 0x7f93dc15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.576+0000 7f93c1ffb640 1 --2- 172.21.15.130:0/13809857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93dc0adf90 0x7f93dc14e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.576+0000 7f93c1ffb640 1 -- 172.21.15.130:0/13809857 >> 172.21.15.130:0/13809857 conn(0x7f93dc065990 msgr2=0x7f93dc0cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.580+0000 7f93c1ffb640 1 -- 172.21.15.130:0/13809857 shutdown_connections 2023-09-13T06:01:34.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.580+0000 7f93c1ffb640 1 -- 172.21.15.130:0/13809857 wait complete. 2023-09-13T06:01:34.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-09-13T06:01:34.616 DEBUG:teuthology.parallel:result is None 2023-09-13T06:01:34.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.640+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f56b8138310 con 0x7f56b80706c0 2023-09-13T06:01:34.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.640+0000 7f56af7fe640 1 -- 172.21.15.130:0/1753829733 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56a8015020 con 0x7f56b80706c0 2023-09-13T06:01:34.647 INFO:teuthology.orchestra.run.smithi130.stdout:55834574854 2023-09-13T06:01:34.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5698065bf0 msgr2=0x7f56980680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5698065bf0 0x7f56980680b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56b81374d0 tx=0x7f56a0008040 comp rx=0 tx=0).stop 2023-09-13T06:01:34.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56b80706c0 msgr2=0x7f56b815cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56b80706c0 0x7f56b815cc50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f56a800b3f0 tx=0x7f56a800b8b0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 shutdown_connections 2023-09-13T06:01:34.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5698065bf0 0x7f56980680b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b8146b30 0x7f56b806ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56b80d1f50 0x7f56b806a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 --2- 172.21.15.130:0/1753829733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56b80706c0 0x7f56b815cc50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 >> 172.21.15.130:0/1753829733 conn(0x7f56b80d3090 msgr2=0x7f56b8145c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 shutdown_connections 2023-09-13T06:01:34.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.644+0000 7f56bc9ab640 1 -- 172.21.15.130:0/1753829733 wait complete. 2023-09-13T06:01:34.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.652+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f26a4005510 con 0x7f26c40cc4f0 2023-09-13T06:01:34.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.656+0000 7f26abfff640 1 -- 172.21.15.130:0/2008853081 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26b4053790 con 0x7f26c40cc4f0 2023-09-13T06:01:34.659 INFO:teuthology.orchestra.run.smithi130.stdout:55834574854 2023-09-13T06:01:34.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.656+0000 7faacc374640 1 -- 172.21.15.130:0/2855898712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faaac0057e0 con 0x7faac40d2990 2023-09-13T06:01:34.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.656+0000 7faabaffd640 1 -- 172.21.15.130:0/2855898712 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faab40b0020 con 0x7faac40d2990 2023-09-13T06:01:34.661 INFO:teuthology.orchestra.run.smithi130.stdout:55834574854 2023-09-13T06:01:34.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f4ef57fa640 1 -- 172.21.15.130:0/3470173561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4ee8005510 con 0x7f4f1015a490 2023-09-13T06:01:34.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26b0065b70 msgr2=0x7f26b0068030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26b0065b70 0x7f26b0068030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26b8000c10 tx=0x7f26b80a6070 comp rx=0 tx=0).stop 2023-09-13T06:01:34.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40cc4f0 msgr2=0x7f26c4165000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40cc4f0 0x7f26c4165000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c3c0 tx=0x7f26b400c880 comp rx=0 tx=0).stop 2023-09-13T06:01:34.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f8e1751f640 1 -- 172.21.15.130:0/299128319 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8e100618a0 con 0x7f8e10154db0 2023-09-13T06:01:34.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f4ef77fe640 1 -- 172.21.15.130:0/3470173561 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f08051a10 con 0x7f4f1015a490 2023-09-13T06:01:34.665 INFO:teuthology.orchestra.run.smithi130.stdout:55834574854 2023-09-13T06:01:34.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 shutdown_connections 2023-09-13T06:01:34.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26b0065b70 0x7f26b0068030 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26c40cd580 0x7f26c41617d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40cc4f0 0x7f26c4165000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 --2- 172.21.15.130:0/2008853081 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26c40cbdb0 0x7f26c4206c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f8e05ffb640 1 -- 172.21.15.130:0/299128319 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e08021020 con 0x7f8e10154db0 2023-09-13T06:01:34.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 >> 172.21.15.130:0/2008853081 conn(0x7f26c4065990 msgr2=0x7f26c40cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 shutdown_connections 2023-09-13T06:01:34.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7f26c9e56640 1 -- 172.21.15.130:0/2008853081 wait complete. 2023-09-13T06:01:34.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 -- 172.21.15.130:0/2855898712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaa8065c20 msgr2=0x7faaa80680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaa8065c20 0x7faaa80680e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faac000ab60 tx=0x7faac0008040 comp rx=0 tx=0).stop 2023-09-13T06:01:34.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 -- 172.21.15.130:0/2855898712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faac40d2990 msgr2=0x7faac40b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faac40d2990 0x7faac40b7330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faab40ae040 tx=0x7faab4019300 comp rx=0 tx=0).stop 2023-09-13T06:01:34.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 -- 172.21.15.130:0/2855898712 shutdown_connections 2023-09-13T06:01:34.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaa8065c20 0x7faaa80680e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faac40d2990 0x7faac40b7330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faac4156100 0x7faac40b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 --2- 172.21.15.130:0/2855898712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faac40715b0 0x7faac415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 -- 172.21.15.130:0/2855898712 >> 172.21.15.130:0/2855898712 conn(0x7faac40d32a0 msgr2=0x7faac415fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 -- 172.21.15.130:0/2855898712 shutdown_connections 2023-09-13T06:01:34.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.660+0000 7faacc374640 1 -- 172.21.15.130:0/2855898712 wait complete. 2023-09-13T06:01:34.675 INFO:teuthology.orchestra.run.smithi130.stdout:55834574854 2023-09-13T06:01:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 -- 172.21.15.130:0/3470173561 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ef8065db0 msgr2=0x7f4ef8068270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ef8065db0 0x7f4ef8068270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f04006fd0 tx=0x7f4f04008040 comp rx=0 tx=0).stop 2023-09-13T06:01:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 -- 172.21.15.130:0/3470173561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1015a490 msgr2=0x7f4f1014a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1015a490 0x7f4f1014a240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800efc0 tx=0x7f4f0800c490 comp rx=0 tx=0).stop 2023-09-13T06:01:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 -- 172.21.15.130:0/3470173561 shutdown_connections 2023-09-13T06:01:34.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4ef8065db0 0x7f4ef8068270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1015a490 0x7f4f1014a240 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f10157a80 0x7f4f101434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 --2- 172.21.15.130:0/3470173561 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f100af530 0x7f4f1014c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 -- 172.21.15.130:0/3470173561 >> 172.21.15.130:0/3470173561 conn(0x7f4f10065d90 msgr2=0x7f4f10155410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 -- 172.21.15.130:0/299128319 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8df4065b50 msgr2=0x7f8df4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8df4065b50 0x7f8df4068010 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0b2000 tx=0x7f8e0c005040 comp rx=0 tx=0).stop 2023-09-13T06:01:34.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 -- 172.21.15.130:0/299128319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e10154db0 msgr2=0x7f8e10155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e10154db0 0x7f8e10155230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8e10157fa0 tx=0x7f8e0800cf00 comp rx=0 tx=0).stop 2023-09-13T06:01:34.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 -- 172.21.15.130:0/3470173561 shutdown_connections 2023-09-13T06:01:34.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 -- 172.21.15.130:0/299128319 shutdown_connections 2023-09-13T06:01:34.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8df4065b50 0x7f8df4068010 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e10154db0 0x7f8e10155230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1014e790 0x7f8e1014ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 --2- 172.21.15.130:0/299128319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dfc003b80 0x7f8e101ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 -- 172.21.15.130:0/299128319 >> 172.21.15.130:0/299128319 conn(0x7f8e100d32a0 msgr2=0x7f8e1015deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f4ef57fa640 1 -- 172.21.15.130:0/3470173561 wait complete. 2023-09-13T06:01:34.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 -- 172.21.15.130:0/299128319 shutdown_connections 2023-09-13T06:01:34.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.664+0000 7f8e1751f640 1 -- 172.21.15.130:0/299128319 wait complete. 2023-09-13T06:01:34.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2023-09-13T06:01:34.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.672+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3820656883 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe2c00b3440 con 0x7fe2c01fa850 2023-09-13T06:01:34.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.672+0000 7fe2bcff9640 1 -- 172.21.15.130:0/3820656883 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2b801a090 con 0x7fe2c01fa850 2023-09-13T06:01:34.686 DEBUG:teuthology.parallel:result is None 2023-09-13T06:01:34.687 INFO:teuthology.orchestra.run.smithi130.stdout:55834574854 2023-09-13T06:01:34.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3820656883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe2a0065bf0 msgr2=0x7fe2a00680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe2a0065bf0 0x7fe2a00680b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00afcc0 tx=0x7fe2b0006be0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3820656883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2c01fa850 msgr2=0x7fe2c01fd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2c01fa850 0x7fe2c01fd0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800e910 tx=0x7fe2b800edd0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3820656883 shutdown_connections 2023-09-13T06:01:34.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe2a0065bf0 0x7fe2a00680b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2c01fa850 0x7fe2c01fd0c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2c00cddc0 0x7fe2c015d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 --2- 172.21.15.130:0/3820656883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c00af700 0x7fe2c014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3820656883 >> 172.21.15.130:0/3820656883 conn(0x7fe2c0065d90 msgr2=0x7fe2c01597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3820656883 shutdown_connections 2023-09-13T06:01:34.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.676+0000 7fe2c5bfa640 1 -- 172.21.15.130:0/3820656883 wait complete. 2023-09-13T06:01:34.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.680+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fda9c0d0340 con 0x7fda9c06a9b0 2023-09-13T06:01:34.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.680+0000 7fda83fff640 1 -- 172.21.15.130:0/1968745078 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda90017020 con 0x7fda9c06a9b0 2023-09-13T06:01:34.693 INFO:teuthology.orchestra.run.smithi130.stdout:55834574854 2023-09-13T06:01:34.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.684+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda84065d20 msgr2=0x7fda840681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.684+0000 7fdaa19db640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda84065d20 0x7fda840681e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0700d0 tx=0x7fda94003dd0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.684+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c06a9b0 msgr2=0x7fda9c15cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.684+0000 7fdaa19db640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c06a9b0 0x7fda9c15cdc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fda9000e8a0 tx=0x7fda9000eca0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.688+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 shutdown_connections 2023-09-13T06:01:34.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.688+0000 7fdaa19db640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda84065d20 0x7fda840681e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.688+0000 7fdaa19db640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9c153ce0 0x7fda9c0b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.688+0000 7fdaa19db640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda9c0c2b90 0x7fda9c1fa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.688+0000 7fdaa19db640 1 --2- 172.21.15.130:0/1968745078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda9c06a9b0 0x7fda9c15cdc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.688+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 >> 172.21.15.130:0/1968745078 conn(0x7fda9c06a5a0 msgr2=0x7fda9c157760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.688+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 shutdown_connections 2023-09-13T06:01:34.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.688+0000 7fdaa19db640 1 -- 172.21.15.130:0/1968745078 wait complete. 2023-09-13T06:01:34.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2023-09-13T06:01:34.707 DEBUG:teuthology.parallel:result is None 2023-09-13T06:01:34.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2023-09-13T06:01:34.708 DEBUG:teuthology.parallel:result is None 2023-09-13T06:01:34.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2023-09-13T06:01:34.714 DEBUG:teuthology.parallel:result is None 2023-09-13T06:01:34.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2023-09-13T06:01:34.716 DEBUG:teuthology.parallel:result is None 2023-09-13T06:01:34.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2023-09-13T06:01:34.717 DEBUG:teuthology.parallel:result is None 2023-09-13T06:01:34.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2023-09-13T06:01:34.719 DEBUG:teuthology.parallel:result is None 2023-09-13T06:01:34.720 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-13T06:01:34.720 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:01:34.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.892+0000 7efef4eab640 1 Processor -- start 2023-09-13T06:01:34.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efef4eab640 1 -- start start 2023-09-13T06:01:34.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efef4eab640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efef00d1750 0x7efef015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efef4eab640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef00b63c0 con 0x7efef0146f30 2023-09-13T06:01:34.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efef4eab640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef00d0c20 con 0x7efef00d1090 2023-09-13T06:01:34.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efef4eab640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef015dea0 con 0x7efef00d1750 2023-09-13T06:01:34.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeeed9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7efef0146f30 0x7efef00b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55838/0 (socket says 172.21.15.130:55838) 2023-09-13T06:01:34.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeeed9d640 1 -- 172.21.15.130:0/2854601819 learned_addr learned my addr 172.21.15.130:0/2854601819 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:34.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeee59c640 1 --2- 172.21.15.130:0/2854601819 >> v2:172.21.15.164:3300/0 conn(0x7efef00d1750 0x7efef015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706404068 0 0) 0x7efef00b63c0 con 0x7efef0146f30 2023-09-13T06:01:34.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed8003530 con 0x7efef0146f30 2023-09-13T06:01:34.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2857441219 0 0) 0x7efed8003530 con 0x7efef0146f30 2023-09-13T06:01:34.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 >> v2:172.21.15.164:3300/0 conn(0x7efef00d1750 msgr2=0x7efef015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 --2- 172.21.15.130:0/2854601819 >> v2:172.21.15.164:3300/0 conn(0x7efef00d1750 0x7efef015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 >> v1:172.21.15.164:6789/0 conn(0x7efef00d1090 legacy=0x7efef0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef00b6610 con 0x7efef0146f30 2023-09-13T06:01:34.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7efee8001a00 con 0x7efef0146f30 2023-09-13T06:01:34.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 >> v1:172.21.15.130:6789/0 conn(0x7efef0146f30 legacy=0x7efef00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed80039f0 0x7efed8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efed80047d0 0x7efed8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8005200 0x7efed800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed800c130 con 0x7efed8005200 2023-09-13T06:01:34.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed800c2a0 con 0x7efed80039f0 2023-09-13T06:01:34.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed800c460 con 0x7efed80047d0 2023-09-13T06:01:34.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeeed9d640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8005200 0x7efed800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeee59c640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed80039f0 0x7efed8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeedd9b640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efed80047d0 0x7efed8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeeed9d640 1 -- 172.21.15.130:0/2854601819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efed80047d0 msgr2=0x7efed8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeeed9d640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efed80047d0 0x7efed8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeeed9d640 1 -- 172.21.15.130:0/2854601819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed80039f0 msgr2=0x7efed8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:34.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeeed9d640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed80039f0 0x7efed8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeeed9d640 1 -- 172.21.15.130:0/2854601819 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8003530 con 0x7efed8005200 2023-09-13T06:01:34.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeedd9b640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efed80047d0 0x7efed8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:34.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.896+0000 7efeee59c640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed80039f0 0x7efed8003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:34.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efeeed9d640 1 -- 172.21.15.130:0/2854601819 reap_dead start 2023-09-13T06:01:34.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efeeed9d640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8005200 0x7efed800b990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efee800a830 tx=0x7efee801f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b594b17513ccf244 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee80072d0 con 0x7efed8005200 2023-09-13T06:01:34.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee8007470 con 0x7efed8005200 2023-09-13T06:01:34.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efeed59a640 1 -- 172.21.15.130:0/2854601819 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee8007820 con 0x7efed8005200 2023-09-13T06:01:34.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efef4eab640 1 -- 172.21.15.130:0/2854601819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8005200 msgr2=0x7efed800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efef4eab640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8005200 0x7efed800b990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efee800a830 tx=0x7efee801f9e0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efef4eab640 1 -- 172.21.15.130:0/2854601819 shutdown_connections 2023-09-13T06:01:34.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efef4eab640 1 --2- 172.21.15.130:0/2854601819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8005200 0x7efed800b990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efef4eab640 1 -- 172.21.15.130:0/2854601819 >> 172.21.15.130:0/2854601819 conn(0x7efef006f170 msgr2=0x7efef006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:34.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efef4eab640 1 -- 172.21.15.130:0/2854601819 shutdown_connections 2023-09-13T06:01:34.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.900+0000 7efef4eab640 1 -- 172.21.15.130:0/2854601819 wait complete. 2023-09-13T06:01:34.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efef4eab640 1 Processor -- start 2023-09-13T06:01:34.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efef4eab640 1 -- start start 2023-09-13T06:01:34.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efef4eab640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8005200 0x7efef015ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efef4eab640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efef015ea70 0x7efef00cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efef4eab640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efef015eef0 0x7efef00ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efef4eab640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef015d3a0 con 0x7efef015ea70 2023-09-13T06:01:34.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efef4eab640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef01600d0 con 0x7efed8005200 2023-09-13T06:01:34.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efef4eab640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef00ce590 con 0x7efef015eef0 2023-09-13T06:01:34.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeedd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efef015ea70 0x7efef00cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeedd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efef015ea70 0x7efef00cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48182/0 (socket says 172.21.15.130:48182) 2023-09-13T06:01:34.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeedd9b640 1 -- 172.21.15.130:0/4198005488 learned_addr learned my addr 172.21.15.130:0/4198005488 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:34.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeeed9d640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efef015eef0 0x7efef00ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeee59c640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8005200 0x7efef015ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeedd9b640 1 -- 172.21.15.130:0/4198005488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efef015eef0 msgr2=0x7efef00ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeedd9b640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efef015eef0 0x7efef00ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeedd9b640 1 -- 172.21.15.130:0/4198005488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8005200 msgr2=0x7efef015ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:34.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeedd9b640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8005200 0x7efef015ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:34.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeedd9b640 1 -- 172.21.15.130:0/4198005488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef015f4c0 con 0x7efef015ea70 2023-09-13T06:01:34.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeeed9d640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efef015eef0 0x7efef00ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:34.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeee59c640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8005200 0x7efef015ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:34.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efeedd9b640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efef015ea70 0x7efef00cdb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efee400e3c0 tx=0x7efee400e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efedeffd640 1 -- 172.21.15.130:0/4198005488 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee40052e0 con 0x7efef015ea70 2023-09-13T06:01:34.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efedeffd640 1 -- 172.21.15.130:0/4198005488 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee4005440 con 0x7efef015ea70 2023-09-13T06:01:34.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efef4eab640 1 -- 172.21.15.130:0/4198005488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef015f7a0 con 0x7efef015ea70 2023-09-13T06:01:34.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efedeffd640 1 -- 172.21.15.130:0/4198005488 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4003820 con 0x7efef015ea70 2023-09-13T06:01:34.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.904+0000 7efef4eab640 1 -- 172.21.15.130:0/4198005488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef015fd60 con 0x7efef015ea70 2023-09-13T06:01:34.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.908+0000 7efef4eab640 1 -- 172.21.15.130:0/4198005488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef00618a0 con 0x7efef015ea70 2023-09-13T06:01:34.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.908+0000 7efedeffd640 1 -- 172.21.15.130:0/4198005488 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efee4003980 con 0x7efef015ea70 2023-09-13T06:01:34.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.908+0000 7efedeffd640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b20 0x7efed0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:34.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.908+0000 7efedeffd640 1 -- 172.21.15.130:0/4198005488 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efee4082a00 con 0x7efef015ea70 2023-09-13T06:01:34.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.908+0000 7efeee59c640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b20 0x7efed0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:34.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.908+0000 7efeee59c640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b20 0x7efed0067fe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efee0009a70 tx=0x7efee0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:34.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:34.912+0000 7efedeffd640 1 -- 172.21.15.130:0/4198005488 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7efee4050360 con 0x7efef015ea70 2023-09-13T06:01:35.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.056+0000 7efef4eab640 1 -- 172.21.15.130:0/4198005488 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efef00b6bd0 con 0x7efed0065b20 2023-09-13T06:01:35.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.060+0000 7efedeffd640 1 -- 172.21.15.130:0/4198005488 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260225 (secure 0 0 0) 0x7efee0013a20 con 0x7efed0065b20 2023-09-13T06:01:35.068 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:35.070 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:01:35.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 -- 172.21.15.130:0/4198005488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b20 msgr2=0x7efed0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b20 0x7efed0067fe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efee0009a70 tx=0x7efee0008040 comp rx=0 tx=0).stop 2023-09-13T06:01:35.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 -- 172.21.15.130:0/4198005488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efef015ea70 msgr2=0x7efef00cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efef015ea70 0x7efef00cdb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efee400e3c0 tx=0x7efee400e880 comp rx=0 tx=0).stop 2023-09-13T06:01:35.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 -- 172.21.15.130:0/4198005488 shutdown_connections 2023-09-13T06:01:35.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b20 0x7efed0067fe0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efef015eef0 0x7efef00ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efef015ea70 0x7efef00cdb10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 --2- 172.21.15.130:0/4198005488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8005200 0x7efef015ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 -- 172.21.15.130:0/4198005488 >> 172.21.15.130:0/4198005488 conn(0x7efef006f170 msgr2=0x7efef0160b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:35.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 -- 172.21.15.130:0/4198005488 shutdown_connections 2023-09-13T06:01:35.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.064+0000 7efef4eab640 1 -- 172.21.15.130:0/4198005488 wait complete. 2023-09-13T06:01:35.088 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-13T06:01:34.538292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560753,"statfs":{"total":1600000000,"available":1598211172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.220651"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319337+0000","last_change":"2023-09-13T06:01:26.333344+0000","last_active":"2023-09-13T06:01:27.319337+0000","last_peered":"2023-09-13T06:01:27.319337+0000","last_clean":"2023-09-13T06:01:27.319337+0000","last_became_active":"2023-09-13T06:01:26.333051+0000","last_became_peered":"2023-09-13T06:01:26.333051+0000","last_unstale":"2023-09-13T06:01:27.319337+0000","last_undegraded":"2023-09-13T06:01:27.319337+0000","last_fullsized":"2023-09-13T06:01:27.319337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:11:04.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315478+0000","last_change":"2023-09-13T06:01:26.335080+0000","last_active":"2023-09-13T06:01:27.315478+0000","last_peered":"2023-09-13T06:01:27.315478+0000","last_clean":"2023-09-13T06:01:27.315478+0000","last_became_active":"2023-09-13T06:01:26.334827+0000","last_became_peered":"2023-09-13T06:01:26.334827+0000","last_unstale":"2023-09-13T06:01:27.315478+0000","last_undegraded":"2023-09-13T06:01:27.315478+0000","last_fullsized":"2023-09-13T06:01:27.315478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965878+0000","last_change":"2023-09-13T06:01:26.326639+0000","last_active":"2023-09-13T06:01:27.965878+0000","last_peered":"2023-09-13T06:01:27.965878+0000","last_clean":"2023-09-13T06:01:27.965878+0000","last_became_active":"2023-09-13T06:01:26.326385+0000","last_became_peered":"2023-09-13T06:01:26.326385+0000","last_unstale":"2023-09-13T06:01:27.965878+0000","last_undegraded":"2023-09-13T06:01:27.965878+0000","last_fullsized":"2023-09-13T06:01:27.965878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:59:06.444621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319306+0000","last_change":"2023-09-13T06:01:26.333796+0000","last_active":"2023-09-13T06:01:27.319306+0000","last_peered":"2023-09-13T06:01:27.319306+0000","last_clean":"2023-09-13T06:01:27.319306+0000","last_became_active":"2023-09-13T06:01:26.333306+0000","last_became_peered":"2023-09-13T06:01:26.333306+0000","last_unstale":"2023-09-13T06:01:27.319306+0000","last_undegraded":"2023-09-13T06:01:27.319306+0000","last_fullsized":"2023-09-13T06:01:27.319306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319513+0000","last_change":"2023-09-13T06:01:26.328538+0000","last_active":"2023-09-13T06:01:27.319513+0000","last_peered":"2023-09-13T06:01:27.319513+0000","last_clean":"2023-09-13T06:01:27.319513+0000","last_became_active":"2023-09-13T06:01:26.328008+0000","last_became_peered":"2023-09-13T06:01:26.328008+0000","last_unstale":"2023-09-13T06:01:27.319513+0000","last_undegraded":"2023-09-13T06:01:27.319513+0000","last_fullsized":"2023-09-13T06:01:27.319513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:29:19.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320317+0000","last_change":"2023-09-13T06:01:26.341210+0000","last_active":"2023-09-13T06:01:27.320317+0000","last_peered":"2023-09-13T06:01:27.320317+0000","last_clean":"2023-09-13T06:01:27.320317+0000","last_became_active":"2023-09-13T06:01:26.339644+0000","last_became_peered":"2023-09-13T06:01:26.339644+0000","last_unstale":"2023-09-13T06:01:27.320317+0000","last_undegraded":"2023-09-13T06:01:27.320317+0000","last_fullsized":"2023-09-13T06:01:27.320317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:38:19.434161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319611+0000","last_change":"2023-09-13T06:01:26.324547+0000","last_active":"2023-09-13T06:01:27.319611+0000","last_peered":"2023-09-13T06:01:27.319611+0000","last_clean":"2023-09-13T06:01:27.319611+0000","last_became_active":"2023-09-13T06:01:26.324308+0000","last_became_peered":"2023-09-13T06:01:26.324308+0000","last_unstale":"2023-09-13T06:01:27.319611+0000","last_undegraded":"2023-09-13T06:01:27.319611+0000","last_fullsized":"2023-09-13T06:01:27.319611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:15:00.989410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.805874+0000","last_change":"2023-09-13T06:01:26.331698+0000","last_active":"2023-09-13T06:01:27.805874+0000","last_peered":"2023-09-13T06:01:27.805874+0000","last_clean":"2023-09-13T06:01:27.805874+0000","last_became_active":"2023-09-13T06:01:26.329837+0000","last_became_peered":"2023-09-13T06:01:26.329837+0000","last_unstale":"2023-09-13T06:01:27.805874+0000","last_undegraded":"2023-09-13T06:01:27.805874+0000","last_fullsized":"2023-09-13T06:01:27.805874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:58:51.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319235+0000","last_change":"2023-09-13T06:01:26.331694+0000","last_active":"2023-09-13T06:01:27.319235+0000","last_peered":"2023-09-13T06:01:27.319235+0000","last_clean":"2023-09-13T06:01:27.319235+0000","last_became_active":"2023-09-13T06:01:26.331505+0000","last_became_peered":"2023-09-13T06:01:26.331505+0000","last_unstale":"2023-09-13T06:01:27.319235+0000","last_undegraded":"2023-09-13T06:01:27.319235+0000","last_fullsized":"2023-09-13T06:01:27.319235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808896+0000","last_change":"2023-09-13T06:01:26.331322+0000","last_active":"2023-09-13T06:01:27.808896+0000","last_peered":"2023-09-13T06:01:27.808896+0000","last_clean":"2023-09-13T06:01:27.808896+0000","last_became_active":"2023-09-13T06:01:26.331079+0000","last_became_peered":"2023-09-13T06:01:26.331079+0000","last_unstale":"2023-09-13T06:01:27.808896+0000","last_undegraded":"2023-09-13T06:01:27.808896+0000","last_fullsized":"2023-09-13T06:01:27.808896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808761+0000","last_change":"2023-09-13T06:01:26.339806+0000","last_active":"2023-09-13T06:01:27.808761+0000","last_peered":"2023-09-13T06:01:27.808761+0000","last_clean":"2023-09-13T06:01:27.808761+0000","last_became_active":"2023-09-13T06:01:26.339569+0000","last_became_peered":"2023-09-13T06:01:26.339569+0000","last_unstale":"2023-09-13T06:01:27.808761+0000","last_undegraded":"2023-09-13T06:01:27.808761+0000","last_fullsized":"2023-09-13T06:01:27.808761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:48.181079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809508+0000","last_change":"2023-09-13T06:01:26.332707+0000","last_active":"2023-09-13T06:01:27.809508+0000","last_peered":"2023-09-13T06:01:27.809508+0000","last_clean":"2023-09-13T06:01:27.809508+0000","last_became_active":"2023-09-13T06:01:26.332461+0000","last_became_peered":"2023-09-13T06:01:26.332461+0000","last_unstale":"2023-09-13T06:01:27.809508+0000","last_undegraded":"2023-09-13T06:01:27.809508+0000","last_fullsized":"2023-09-13T06:01:27.809508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:10:32.024779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806240+0000","last_change":"2023-09-13T06:01:26.333127+0000","last_active":"2023-09-13T06:01:27.806240+0000","last_peered":"2023-09-13T06:01:27.806240+0000","last_clean":"2023-09-13T06:01:27.806240+0000","last_became_active":"2023-09-13T06:01:26.330284+0000","last_became_peered":"2023-09-13T06:01:26.330284+0000","last_unstale":"2023-09-13T06:01:27.806240+0000","last_undegraded":"2023-09-13T06:01:27.806240+0000","last_fullsized":"2023-09-13T06:01:27.806240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:48:35.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965662+0000","last_change":"2023-09-13T06:01:26.334244+0000","last_active":"2023-09-13T06:01:27.965662+0000","last_peered":"2023-09-13T06:01:27.965662+0000","last_clean":"2023-09-13T06:01:27.965662+0000","last_became_active":"2023-09-13T06:01:26.334017+0000","last_became_peered":"2023-09-13T06:01:26.334017+0000","last_unstale":"2023-09-13T06:01:27.965662+0000","last_undegraded":"2023-09-13T06:01:27.965662+0000","last_fullsized":"2023-09-13T06:01:27.965662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:58.618446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315608+0000","last_change":"2023-09-13T06:01:26.330534+0000","last_active":"2023-09-13T06:01:27.315608+0000","last_peered":"2023-09-13T06:01:27.315608+0000","last_clean":"2023-09-13T06:01:27.315608+0000","last_became_active":"2023-09-13T06:01:26.330217+0000","last_became_peered":"2023-09-13T06:01:26.330217+0000","last_unstale":"2023-09-13T06:01:27.315608+0000","last_undegraded":"2023-09-13T06:01:27.315608+0000","last_fullsized":"2023-09-13T06:01:27.315608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320169+0000","last_change":"2023-09-13T06:01:26.345029+0000","last_active":"2023-09-13T06:01:27.320169+0000","last_peered":"2023-09-13T06:01:27.320169+0000","last_clean":"2023-09-13T06:01:27.320169+0000","last_became_active":"2023-09-13T06:01:26.339981+0000","last_became_peered":"2023-09-13T06:01:26.339981+0000","last_unstale":"2023-09-13T06:01:27.320169+0000","last_undegraded":"2023-09-13T06:01:27.320169+0000","last_fullsized":"2023-09-13T06:01:27.320169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:28:12.855923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319961+0000","last_change":"2023-09-13T06:01:26.341104+0000","last_active":"2023-09-13T06:01:27.319961+0000","last_peered":"2023-09-13T06:01:27.319961+0000","last_clean":"2023-09-13T06:01:27.319961+0000","last_became_active":"2023-09-13T06:01:26.340321+0000","last_became_peered":"2023-09-13T06:01:26.340321+0000","last_unstale":"2023-09-13T06:01:27.319961+0000","last_undegraded":"2023-09-13T06:01:27.319961+0000","last_fullsized":"2023-09-13T06:01:27.319961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:11:04.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965436+0000","last_change":"2023-09-13T06:01:26.328850+0000","last_active":"2023-09-13T06:01:27.965436+0000","last_peered":"2023-09-13T06:01:27.965436+0000","last_clean":"2023-09-13T06:01:27.965436+0000","last_became_active":"2023-09-13T06:01:26.327736+0000","last_became_peered":"2023-09-13T06:01:26.327736+0000","last_unstale":"2023-09-13T06:01:27.965436+0000","last_undegraded":"2023-09-13T06:01:27.965436+0000","last_fullsized":"2023-09-13T06:01:27.965436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:17:44.656554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319631+0000","last_change":"2023-09-13T06:01:26.326473+0000","last_active":"2023-09-13T06:01:27.319631+0000","last_peered":"2023-09-13T06:01:27.319631+0000","last_clean":"2023-09-13T06:01:27.319631+0000","last_became_active":"2023-09-13T06:01:26.326160+0000","last_became_peered":"2023-09-13T06:01:26.326160+0000","last_unstale":"2023-09-13T06:01:27.319631+0000","last_undegraded":"2023-09-13T06:01:27.319631+0000","last_fullsized":"2023-09-13T06:01:27.319631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:58:01.089760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809040+0000","last_change":"2023-09-13T06:01:26.327947+0000","last_active":"2023-09-13T06:01:27.809040+0000","last_peered":"2023-09-13T06:01:27.809040+0000","last_clean":"2023-09-13T06:01:27.809040+0000","last_became_active":"2023-09-13T06:01:26.327715+0000","last_became_peered":"2023-09-13T06:01:26.327715+0000","last_unstale":"2023-09-13T06:01:27.809040+0000","last_undegraded":"2023-09-13T06:01:27.809040+0000","last_fullsized":"2023-09-13T06:01:27.809040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966133+0000","last_change":"2023-09-13T06:01:26.323975+0000","last_active":"2023-09-13T06:01:27.966133+0000","last_peered":"2023-09-13T06:01:27.966133+0000","last_clean":"2023-09-13T06:01:27.966133+0000","last_became_active":"2023-09-13T06:01:26.323393+0000","last_became_peered":"2023-09-13T06:01:26.323393+0000","last_unstale":"2023-09-13T06:01:27.966133+0000","last_undegraded":"2023-09-13T06:01:27.966133+0000","last_fullsized":"2023-09-13T06:01:27.966133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320252+0000","last_change":"2023-09-13T06:01:26.340839+0000","last_active":"2023-09-13T06:01:27.320252+0000","last_peered":"2023-09-13T06:01:27.320252+0000","last_clean":"2023-09-13T06:01:27.320252+0000","last_became_active":"2023-09-13T06:01:26.339668+0000","last_became_peered":"2023-09-13T06:01:26.339668+0000","last_unstale":"2023-09-13T06:01:27.320252+0000","last_undegraded":"2023-09-13T06:01:27.320252+0000","last_fullsized":"2023-09-13T06:01:27.320252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:15:00.989410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806314+0000","last_change":"2023-09-13T06:01:26.333609+0000","last_active":"2023-09-13T06:01:27.806314+0000","last_peered":"2023-09-13T06:01:27.806314+0000","last_clean":"2023-09-13T06:01:27.806314+0000","last_became_active":"2023-09-13T06:01:26.331440+0000","last_became_peered":"2023-09-13T06:01:26.331440+0000","last_unstale":"2023-09-13T06:01:27.806314+0000","last_undegraded":"2023-09-13T06:01:27.806314+0000","last_fullsized":"2023-09-13T06:01:27.806314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:29:19.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319441+0000","last_change":"2023-09-13T06:01:26.333660+0000","last_active":"2023-09-13T06:01:27.319441+0000","last_peered":"2023-09-13T06:01:27.319441+0000","last_clean":"2023-09-13T06:01:27.319441+0000","last_became_active":"2023-09-13T06:01:26.330349+0000","last_became_peered":"2023-09-13T06:01:26.330349+0000","last_unstale":"2023-09-13T06:01:27.319441+0000","last_undegraded":"2023-09-13T06:01:27.319441+0000","last_fullsized":"2023-09-13T06:01:27.319441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806080+0000","last_change":"2023-09-13T06:01:26.329053+0000","last_active":"2023-09-13T06:01:27.806080+0000","last_peered":"2023-09-13T06:01:27.806080+0000","last_clean":"2023-09-13T06:01:27.806080+0000","last_became_active":"2023-09-13T06:01:26.328820+0000","last_became_peered":"2023-09-13T06:01:26.328820+0000","last_unstale":"2023-09-13T06:01:27.806080+0000","last_undegraded":"2023-09-13T06:01:27.806080+0000","last_fullsized":"2023-09-13T06:01:27.806080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808935+0000","last_change":"2023-09-13T06:01:26.334326+0000","last_active":"2023-09-13T06:01:27.808935+0000","last_peered":"2023-09-13T06:01:27.808935+0000","last_clean":"2023-09-13T06:01:27.808935+0000","last_became_active":"2023-09-13T06:01:26.334009+0000","last_became_peered":"2023-09-13T06:01:26.334009+0000","last_unstale":"2023-09-13T06:01:27.808935+0000","last_undegraded":"2023-09-13T06:01:27.808935+0000","last_fullsized":"2023-09-13T06:01:27.808935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315617+0000","last_change":"2023-09-13T06:01:26.330022+0000","last_active":"2023-09-13T06:01:27.315617+0000","last_peered":"2023-09-13T06:01:27.315617+0000","last_clean":"2023-09-13T06:01:27.315617+0000","last_became_active":"2023-09-13T06:01:26.329781+0000","last_became_peered":"2023-09-13T06:01:26.329781+0000","last_unstale":"2023-09-13T06:01:27.315617+0000","last_undegraded":"2023-09-13T06:01:27.315617+0000","last_fullsized":"2023-09-13T06:01:27.315617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806025+0000","last_change":"2023-09-13T06:01:26.333470+0000","last_active":"2023-09-13T06:01:27.806025+0000","last_peered":"2023-09-13T06:01:27.806025+0000","last_clean":"2023-09-13T06:01:27.806025+0000","last_became_active":"2023-09-13T06:01:26.330564+0000","last_became_peered":"2023-09-13T06:01:26.330564+0000","last_unstale":"2023-09-13T06:01:27.806025+0000","last_undegraded":"2023-09-13T06:01:27.806025+0000","last_fullsized":"2023-09-13T06:01:27.806025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965817+0000","last_change":"2023-09-13T06:01:26.325229+0000","last_active":"2023-09-13T06:01:27.965817+0000","last_peered":"2023-09-13T06:01:27.965817+0000","last_clean":"2023-09-13T06:01:27.965817+0000","last_became_active":"2023-09-13T06:01:26.325006+0000","last_became_peered":"2023-09-13T06:01:26.325006+0000","last_unstale":"2023-09-13T06:01:27.965817+0000","last_undegraded":"2023-09-13T06:01:27.965817+0000","last_fullsized":"2023-09-13T06:01:27.965817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:34.829927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320125+0000","last_change":"2023-09-13T06:01:26.335419+0000","last_active":"2023-09-13T06:01:27.320125+0000","last_peered":"2023-09-13T06:01:27.320125+0000","last_clean":"2023-09-13T06:01:27.320125+0000","last_became_active":"2023-09-13T06:01:26.335145+0000","last_became_peered":"2023-09-13T06:01:26.335145+0000","last_unstale":"2023-09-13T06:01:27.320125+0000","last_undegraded":"2023-09-13T06:01:27.320125+0000","last_fullsized":"2023-09-13T06:01:27.320125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:29:19.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965454+0000","last_change":"2023-09-13T06:01:26.328581+0000","last_active":"2023-09-13T06:01:27.965454+0000","last_peered":"2023-09-13T06:01:27.965454+0000","last_clean":"2023-09-13T06:01:27.965454+0000","last_became_active":"2023-09-13T06:01:26.328353+0000","last_became_peered":"2023-09-13T06:01:26.328353+0000","last_unstale":"2023-09-13T06:01:27.965454+0000","last_undegraded":"2023-09-13T06:01:27.965454+0000","last_fullsized":"2023-09-13T06:01:27.965454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:48.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808879+0000","last_change":"2023-09-13T06:01:26.337762+0000","last_active":"2023-09-13T06:01:27.808879+0000","last_peered":"2023-09-13T06:01:27.808879+0000","last_clean":"2023-09-13T06:01:27.808879+0000","last_became_active":"2023-09-13T06:01:26.337497+0000","last_became_peered":"2023-09-13T06:01:26.337497+0000","last_unstale":"2023-09-13T06:01:27.808879+0000","last_undegraded":"2023-09-13T06:01:27.808879+0000","last_fullsized":"2023-09-13T06:01:27.808879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:58:51.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809270+0000","last_change":"2023-09-13T06:01:26.325877+0000","last_active":"2023-09-13T06:01:27.809270+0000","last_peered":"2023-09-13T06:01:27.809270+0000","last_clean":"2023-09-13T06:01:27.809270+0000","last_became_active":"2023-09-13T06:01:26.325578+0000","last_became_peered":"2023-09-13T06:01:26.325578+0000","last_unstale":"2023-09-13T06:01:27.809270+0000","last_undegraded":"2023-09-13T06:01:27.809270+0000","last_fullsized":"2023-09-13T06:01:27.809270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:51.136511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806375+0000","last_change":"2023-09-13T06:01:25.324046+0000","last_active":"2023-09-13T06:01:27.806375+0000","last_peered":"2023-09-13T06:01:27.806375+0000","last_clean":"2023-09-13T06:01:27.806375+0000","last_became_active":"2023-09-13T06:01:25.323829+0000","last_became_peered":"2023-09-13T06:01:25.323829+0000","last_unstale":"2023-09-13T06:01:27.806375+0000","last_undegraded":"2023-09-13T06:01:27.806375+0000","last_fullsized":"2023-09-13T06:01:27.806375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:33.818510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965953+0000","last_change":"2023-09-13T06:01:26.334351+0000","last_active":"2023-09-13T06:01:27.965953+0000","last_peered":"2023-09-13T06:01:27.965953+0000","last_clean":"2023-09-13T06:01:27.965953+0000","last_became_active":"2023-09-13T06:01:26.329714+0000","last_became_peered":"2023-09-13T06:01:26.329714+0000","last_unstale":"2023-09-13T06:01:27.965953+0000","last_undegraded":"2023-09-13T06:01:27.965953+0000","last_fullsized":"2023-09-13T06:01:27.965953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:48.181079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809119+0000","last_change":"2023-09-13T06:01:25.331427+0000","last_active":"2023-09-13T06:01:27.809119+0000","last_peered":"2023-09-13T06:01:27.809119+0000","last_clean":"2023-09-13T06:01:27.809119+0000","last_became_active":"2023-09-13T06:01:25.331196+0000","last_became_peered":"2023-09-13T06:01:25.331196+0000","last_unstale":"2023-09-13T06:01:27.809119+0000","last_undegraded":"2023-09-13T06:01:27.809119+0000","last_fullsized":"2023-09-13T06:01:27.809119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:31:37.760882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806462+0000","last_change":"2023-09-13T06:01:25.327153+0000","last_active":"2023-09-13T06:01:27.806462+0000","last_peered":"2023-09-13T06:01:27.806462+0000","last_clean":"2023-09-13T06:01:27.806462+0000","last_became_active":"2023-09-13T06:01:25.326762+0000","last_became_peered":"2023-09-13T06:01:25.326762+0000","last_unstale":"2023-09-13T06:01:27.806462+0000","last_undegraded":"2023-09-13T06:01:27.806462+0000","last_fullsized":"2023-09-13T06:01:27.806462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:47.262828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806195+0000","last_change":"2023-09-13T06:01:26.323756+0000","last_active":"2023-09-13T06:01:27.806195+0000","last_peered":"2023-09-13T06:01:27.806195+0000","last_clean":"2023-09-13T06:01:27.806195+0000","last_became_active":"2023-09-13T06:01:26.323531+0000","last_became_peered":"2023-09-13T06:01:26.323531+0000","last_unstale":"2023-09-13T06:01:27.806195+0000","last_undegraded":"2023-09-13T06:01:27.806195+0000","last_fullsized":"2023-09-13T06:01:27.806195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320387+0000","last_change":"2023-09-13T06:01:25.330633+0000","last_active":"2023-09-13T06:01:27.320387+0000","last_peered":"2023-09-13T06:01:27.320387+0000","last_clean":"2023-09-13T06:01:27.320387+0000","last_became_active":"2023-09-13T06:01:25.330453+0000","last_became_peered":"2023-09-13T06:01:25.330453+0000","last_unstale":"2023-09-13T06:01:27.320387+0000","last_undegraded":"2023-09-13T06:01:27.320387+0000","last_fullsized":"2023-09-13T06:01:27.320387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315478+0000","last_change":"2023-09-13T06:01:26.330324+0000","last_active":"2023-09-13T06:01:27.315478+0000","last_peered":"2023-09-13T06:01:27.315478+0000","last_clean":"2023-09-13T06:01:27.315478+0000","last_became_active":"2023-09-13T06:01:26.330079+0000","last_became_peered":"2023-09-13T06:01:26.330079+0000","last_unstale":"2023-09-13T06:01:27.315478+0000","last_undegraded":"2023-09-13T06:01:27.315478+0000","last_fullsized":"2023-09-13T06:01:27.315478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809135+0000","last_change":"2023-09-13T06:01:25.329518+0000","last_active":"2023-09-13T06:01:27.809135+0000","last_peered":"2023-09-13T06:01:27.809135+0000","last_clean":"2023-09-13T06:01:27.809135+0000","last_became_active":"2023-09-13T06:01:25.329317+0000","last_became_peered":"2023-09-13T06:01:25.329317+0000","last_unstale":"2023-09-13T06:01:27.809135+0000","last_undegraded":"2023-09-13T06:01:27.809135+0000","last_fullsized":"2023-09-13T06:01:27.809135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:47.262828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320109+0000","last_change":"2023-09-13T06:01:26.340978+0000","last_active":"2023-09-13T06:01:27.320109+0000","last_peered":"2023-09-13T06:01:27.320109+0000","last_clean":"2023-09-13T06:01:27.320109+0000","last_became_active":"2023-09-13T06:01:26.339989+0000","last_became_peered":"2023-09-13T06:01:26.339989+0000","last_unstale":"2023-09-13T06:01:27.320109+0000","last_undegraded":"2023-09-13T06:01:27.320109+0000","last_fullsized":"2023-09-13T06:01:27.320109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:48:35.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320582+0000","last_change":"2023-09-13T06:01:25.327969+0000","last_active":"2023-09-13T06:01:27.320582+0000","last_peered":"2023-09-13T06:01:27.320582+0000","last_clean":"2023-09-13T06:01:27.320582+0000","last_became_active":"2023-09-13T06:01:25.327745+0000","last_became_peered":"2023-09-13T06:01:25.327745+0000","last_unstale":"2023-09-13T06:01:27.320582+0000","last_undegraded":"2023-09-13T06:01:27.320582+0000","last_fullsized":"2023-09-13T06:01:27.320582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:15.433409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966320+0000","last_change":"2023-09-13T06:01:26.329050+0000","last_active":"2023-09-13T06:01:27.966320+0000","last_peered":"2023-09-13T06:01:27.966320+0000","last_clean":"2023-09-13T06:01:27.966320+0000","last_became_active":"2023-09-13T06:01:26.328702+0000","last_became_peered":"2023-09-13T06:01:26.328702+0000","last_unstale":"2023-09-13T06:01:27.966320+0000","last_undegraded":"2023-09-13T06:01:27.966320+0000","last_fullsized":"2023-09-13T06:01:27.966320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315627+0000","last_change":"2023-09-13T06:01:25.322271+0000","last_active":"2023-09-13T06:01:27.315627+0000","last_peered":"2023-09-13T06:01:27.315627+0000","last_clean":"2023-09-13T06:01:27.315627+0000","last_became_active":"2023-09-13T06:01:25.322054+0000","last_became_peered":"2023-09-13T06:01:25.322054+0000","last_unstale":"2023-09-13T06:01:27.315627+0000","last_undegraded":"2023-09-13T06:01:27.315627+0000","last_fullsized":"2023-09-13T06:01:27.315627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809078+0000","last_change":"2023-09-13T06:01:26.322689+0000","last_active":"2023-09-13T06:01:27.809078+0000","last_peered":"2023-09-13T06:01:27.809078+0000","last_clean":"2023-09-13T06:01:27.809078+0000","last_became_active":"2023-09-13T06:01:26.322426+0000","last_became_peered":"2023-09-13T06:01:26.322426+0000","last_unstale":"2023-09-13T06:01:27.809078+0000","last_undegraded":"2023-09-13T06:01:27.809078+0000","last_fullsized":"2023-09-13T06:01:27.809078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:25:38.110206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809241+0000","last_change":"2023-09-13T06:01:25.329417+0000","last_active":"2023-09-13T06:01:27.809241+0000","last_peered":"2023-09-13T06:01:27.809241+0000","last_clean":"2023-09-13T06:01:27.809241+0000","last_became_active":"2023-09-13T06:01:25.329200+0000","last_became_peered":"2023-09-13T06:01:25.329200+0000","last_unstale":"2023-09-13T06:01:27.809241+0000","last_undegraded":"2023-09-13T06:01:27.809241+0000","last_fullsized":"2023-09-13T06:01:27.809241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:50.125094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319246+0000","last_change":"2023-09-13T06:01:26.329074+0000","last_active":"2023-09-13T06:01:27.319246+0000","last_peered":"2023-09-13T06:01:27.319246+0000","last_clean":"2023-09-13T06:01:27.319246+0000","last_became_active":"2023-09-13T06:01:26.328843+0000","last_became_peered":"2023-09-13T06:01:26.328843+0000","last_unstale":"2023-09-13T06:01:27.319246+0000","last_undegraded":"2023-09-13T06:01:27.319246+0000","last_fullsized":"2023-09-13T06:01:27.319246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966042+0000","last_change":"2023-09-13T06:01:25.319809+0000","last_active":"2023-09-13T06:01:27.966042+0000","last_peered":"2023-09-13T06:01:27.966042+0000","last_clean":"2023-09-13T06:01:27.966042+0000","last_became_active":"2023-09-13T06:01:25.319148+0000","last_became_peered":"2023-09-13T06:01:25.319148+0000","last_unstale":"2023-09-13T06:01:27.966042+0000","last_undegraded":"2023-09-13T06:01:27.966042+0000","last_fullsized":"2023-09-13T06:01:27.966042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:41:41.340256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966432+0000","last_change":"2023-09-13T06:01:26.324115+0000","last_active":"2023-09-13T06:01:27.966432+0000","last_peered":"2023-09-13T06:01:27.966432+0000","last_clean":"2023-09-13T06:01:27.966432+0000","last_became_active":"2023-09-13T06:01:26.323734+0000","last_became_peered":"2023-09-13T06:01:26.323734+0000","last_unstale":"2023-09-13T06:01:27.966432+0000","last_undegraded":"2023-09-13T06:01:27.966432+0000","last_fullsized":"2023-09-13T06:01:27.966432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320680+0000","last_change":"2023-09-13T06:01:25.325570+0000","last_active":"2023-09-13T06:01:27.320680+0000","last_peered":"2023-09-13T06:01:27.320680+0000","last_clean":"2023-09-13T06:01:27.320680+0000","last_became_active":"2023-09-13T06:01:25.324812+0000","last_became_peered":"2023-09-13T06:01:25.324812+0000","last_unstale":"2023-09-13T06:01:27.320680+0000","last_undegraded":"2023-09-13T06:01:27.320680+0000","last_fullsized":"2023-09-13T06:01:27.320680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320096+0000","last_change":"2023-09-13T06:01:26.328241+0000","last_active":"2023-09-13T06:01:27.320096+0000","last_peered":"2023-09-13T06:01:27.320096+0000","last_clean":"2023-09-13T06:01:27.320096+0000","last_became_active":"2023-09-13T06:01:26.327377+0000","last_became_peered":"2023-09-13T06:01:26.327377+0000","last_unstale":"2023-09-13T06:01:27.320096+0000","last_undegraded":"2023-09-13T06:01:27.320096+0000","last_fullsized":"2023-09-13T06:01:27.320096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:55:18.039565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808993+0000","last_change":"2023-09-13T06:01:25.332107+0000","last_active":"2023-09-13T06:01:27.808993+0000","last_peered":"2023-09-13T06:01:27.808993+0000","last_clean":"2023-09-13T06:01:27.808993+0000","last_became_active":"2023-09-13T06:01:25.331836+0000","last_became_peered":"2023-09-13T06:01:25.331836+0000","last_unstale":"2023-09-13T06:01:27.808993+0000","last_undegraded":"2023-09-13T06:01:27.808993+0000","last_fullsized":"2023-09-13T06:01:27.808993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808997+0000","last_change":"2023-09-13T06:01:26.337809+0000","last_active":"2023-09-13T06:01:27.808997+0000","last_peered":"2023-09-13T06:01:27.808997+0000","last_clean":"2023-09-13T06:01:27.808997+0000","last_became_active":"2023-09-13T06:01:26.337559+0000","last_became_peered":"2023-09-13T06:01:26.337559+0000","last_unstale":"2023-09-13T06:01:27.808997+0000","last_undegraded":"2023-09-13T06:01:27.808997+0000","last_fullsized":"2023-09-13T06:01:27.808997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965494+0000","last_change":"2023-09-13T06:01:25.320451+0000","last_active":"2023-09-13T06:01:27.965494+0000","last_peered":"2023-09-13T06:01:27.965494+0000","last_clean":"2023-09-13T06:01:27.965494+0000","last_became_active":"2023-09-13T06:01:25.320217+0000","last_became_peered":"2023-09-13T06:01:25.320217+0000","last_unstale":"2023-09-13T06:01:27.965494+0000","last_undegraded":"2023-09-13T06:01:27.965494+0000","last_fullsized":"2023-09-13T06:01:27.965494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:33.630260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319870+0000","last_change":"2023-09-13T06:01:26.325346+0000","last_active":"2023-09-13T06:01:27.319870+0000","last_peered":"2023-09-13T06:01:27.319870+0000","last_clean":"2023-09-13T06:01:27.319870+0000","last_became_active":"2023-09-13T06:01:26.325127+0000","last_became_peered":"2023-09-13T06:01:26.325127+0000","last_unstale":"2023-09-13T06:01:27.319870+0000","last_undegraded":"2023-09-13T06:01:27.319870+0000","last_fullsized":"2023-09-13T06:01:27.319870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:38:19.434161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809186+0000","last_change":"2023-09-13T06:01:25.326201+0000","last_active":"2023-09-13T06:01:27.809186+0000","last_peered":"2023-09-13T06:01:27.809186+0000","last_clean":"2023-09-13T06:01:27.809186+0000","last_became_active":"2023-09-13T06:01:25.324763+0000","last_became_peered":"2023-09-13T06:01:25.324763+0000","last_unstale":"2023-09-13T06:01:27.809186+0000","last_undegraded":"2023-09-13T06:01:27.809186+0000","last_fullsized":"2023-09-13T06:01:27.809186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:46:54.289271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320219+0000","last_change":"2023-09-13T06:01:26.328389+0000","last_active":"2023-09-13T06:01:27.320219+0000","last_peered":"2023-09-13T06:01:27.320219+0000","last_clean":"2023-09-13T06:01:27.320219+0000","last_became_active":"2023-09-13T06:01:26.327693+0000","last_became_peered":"2023-09-13T06:01:26.327693+0000","last_unstale":"2023-09-13T06:01:27.320219+0000","last_undegraded":"2023-09-13T06:01:27.320219+0000","last_fullsized":"2023-09-13T06:01:27.320219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:01:51.436754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965654+0000","last_change":"2023-09-13T06:01:25.313660+0000","last_active":"2023-09-13T06:01:27.965654+0000","last_peered":"2023-09-13T06:01:27.965654+0000","last_clean":"2023-09-13T06:01:27.965654+0000","last_became_active":"2023-09-13T06:01:25.313419+0000","last_became_peered":"2023-09-13T06:01:25.313419+0000","last_unstale":"2023-09-13T06:01:27.965654+0000","last_undegraded":"2023-09-13T06:01:27.965654+0000","last_fullsized":"2023-09-13T06:01:27.965654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:25:37.098788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319396+0000","last_change":"2023-09-13T06:01:26.324978+0000","last_active":"2023-09-13T06:01:27.319396+0000","last_peered":"2023-09-13T06:01:27.319396+0000","last_clean":"2023-09-13T06:01:27.319396+0000","last_became_active":"2023-09-13T06:01:26.324731+0000","last_became_peered":"2023-09-13T06:01:26.324731+0000","last_unstale":"2023-09-13T06:01:27.319396+0000","last_undegraded":"2023-09-13T06:01:27.319396+0000","last_fullsized":"2023-09-13T06:01:27.319396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:48:35.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315501+0000","last_change":"2023-09-13T06:01:25.327454+0000","last_active":"2023-09-13T06:01:27.315501+0000","last_peered":"2023-09-13T06:01:27.315501+0000","last_clean":"2023-09-13T06:01:27.315501+0000","last_became_active":"2023-09-13T06:01:25.327226+0000","last_became_peered":"2023-09-13T06:01:25.327226+0000","last_unstale":"2023-09-13T06:01:27.315501+0000","last_undegraded":"2023-09-13T06:01:27.315501+0000","last_fullsized":"2023-09-13T06:01:27.315501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:47.169662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320376+0000","last_change":"2023-09-13T06:01:26.341240+0000","last_active":"2023-09-13T06:01:27.320376+0000","last_peered":"2023-09-13T06:01:27.320376+0000","last_clean":"2023-09-13T06:01:27.320376+0000","last_became_active":"2023-09-13T06:01:26.340624+0000","last_became_peered":"2023-09-13T06:01:26.340624+0000","last_unstale":"2023-09-13T06:01:27.320376+0000","last_undegraded":"2023-09-13T06:01:27.320376+0000","last_fullsized":"2023-09-13T06:01:27.320376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:55:18.039565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965359+0000","last_change":"2023-09-13T06:01:25.315904+0000","last_active":"2023-09-13T06:01:27.965359+0000","last_peered":"2023-09-13T06:01:27.965359+0000","last_clean":"2023-09-13T06:01:27.965359+0000","last_became_active":"2023-09-13T06:01:25.315623+0000","last_became_peered":"2023-09-13T06:01:25.315623+0000","last_unstale":"2023-09-13T06:01:27.965359+0000","last_undegraded":"2023-09-13T06:01:27.965359+0000","last_fullsized":"2023-09-13T06:01:27.965359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:05:14.637076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319571+0000","last_change":"2023-09-13T06:01:26.330623+0000","last_active":"2023-09-13T06:01:27.319571+0000","last_peered":"2023-09-13T06:01:27.319571+0000","last_clean":"2023-09-13T06:01:27.319571+0000","last_became_active":"2023-09-13T06:01:26.330401+0000","last_became_peered":"2023-09-13T06:01:26.330401+0000","last_unstale":"2023-09-13T06:01:27.319571+0000","last_undegraded":"2023-09-13T06:01:27.319571+0000","last_fullsized":"2023-09-13T06:01:27.319571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:28:12.855923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T06:01:26.321189+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:01:26.321189+0000","last_peered":"2023-09-13T06:01:26.321189+0000","last_clean":"2023-09-13T06:01:26.321189+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:01:26.321189+0000","last_undegraded":"2023-09-13T06:01:26.321189+0000","last_fullsized":"2023-09-13T06:01:26.321189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320821+0000","last_change":"2023-09-13T06:01:25.325043+0000","last_active":"2023-09-13T06:01:27.320821+0000","last_peered":"2023-09-13T06:01:27.320821+0000","last_clean":"2023-09-13T06:01:27.320821+0000","last_became_active":"2023-09-13T06:01:25.324510+0000","last_became_peered":"2023-09-13T06:01:25.324510+0000","last_unstale":"2023-09-13T06:01:27.320821+0000","last_undegraded":"2023-09-13T06:01:27.320821+0000","last_fullsized":"2023-09-13T06:01:27.320821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806211+0000","last_change":"2023-09-13T06:01:26.339163+0000","last_active":"2023-09-13T06:01:27.806211+0000","last_peered":"2023-09-13T06:01:27.806211+0000","last_clean":"2023-09-13T06:01:27.806211+0000","last_became_active":"2023-09-13T06:01:26.338911+0000","last_became_peered":"2023-09-13T06:01:26.338911+0000","last_unstale":"2023-09-13T06:01:27.806211+0000","last_undegraded":"2023-09-13T06:01:27.806211+0000","last_fullsized":"2023-09-13T06:01:27.806211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:11:04.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319837+0000","last_change":"2023-09-13T06:01:25.325759+0000","last_active":"2023-09-13T06:01:27.319837+0000","last_peered":"2023-09-13T06:01:27.319837+0000","last_clean":"2023-09-13T06:01:27.319837+0000","last_became_active":"2023-09-13T06:01:25.325487+0000","last_became_peered":"2023-09-13T06:01:25.325487+0000","last_unstale":"2023-09-13T06:01:27.319837+0000","last_undegraded":"2023-09-13T06:01:27.319837+0000","last_fullsized":"2023-09-13T06:01:27.319837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:33.818510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966209+0000","last_change":"2023-09-13T06:01:26.333513+0000","last_active":"2023-09-13T06:01:27.966209+0000","last_peered":"2023-09-13T06:01:27.966209+0000","last_clean":"2023-09-13T06:01:27.966209+0000","last_became_active":"2023-09-13T06:01:26.333293+0000","last_became_peered":"2023-09-13T06:01:26.333293+0000","last_unstale":"2023-09-13T06:01:27.966209+0000","last_undegraded":"2023-09-13T06:01:27.966209+0000","last_fullsized":"2023-09-13T06:01:27.966209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965541+0000","last_change":"2023-09-13T06:01:25.314117+0000","last_active":"2023-09-13T06:01:27.965541+0000","last_peered":"2023-09-13T06:01:27.965541+0000","last_clean":"2023-09-13T06:01:27.965541+0000","last_became_active":"2023-09-13T06:01:25.313885+0000","last_became_peered":"2023-09-13T06:01:25.313885+0000","last_unstale":"2023-09-13T06:01:27.965541+0000","last_undegraded":"2023-09-13T06:01:27.965541+0000","last_fullsized":"2023-09-13T06:01:27.965541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:31:37.760882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315617+0000","last_change":"2023-09-13T06:01:26.326308+0000","last_active":"2023-09-13T06:01:27.315617+0000","last_peered":"2023-09-13T06:01:27.315617+0000","last_clean":"2023-09-13T06:01:27.315617+0000","last_became_active":"2023-09-13T06:01:26.326046+0000","last_became_peered":"2023-09-13T06:01:26.326046+0000","last_unstale":"2023-09-13T06:01:27.315617+0000","last_undegraded":"2023-09-13T06:01:27.315617+0000","last_fullsized":"2023-09-13T06:01:27.315617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320661+0000","last_change":"2023-09-13T06:01:25.322672+0000","last_active":"2023-09-13T06:01:27.320661+0000","last_peered":"2023-09-13T06:01:27.320661+0000","last_clean":"2023-09-13T06:01:27.320661+0000","last_became_active":"2023-09-13T06:01:25.320702+0000","last_became_peered":"2023-09-13T06:01:25.320702+0000","last_unstale":"2023-09-13T06:01:27.320661+0000","last_undegraded":"2023-09-13T06:01:27.320661+0000","last_fullsized":"2023-09-13T06:01:27.320661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:55.322422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809580+0000","last_change":"2023-09-13T06:01:26.331164+0000","last_active":"2023-09-13T06:01:27.809580+0000","last_peered":"2023-09-13T06:01:27.809580+0000","last_clean":"2023-09-13T06:01:27.809580+0000","last_became_active":"2023-09-13T06:01:26.330506+0000","last_became_peered":"2023-09-13T06:01:26.330506+0000","last_unstale":"2023-09-13T06:01:27.809580+0000","last_undegraded":"2023-09-13T06:01:27.809580+0000","last_fullsized":"2023-09-13T06:01:27.809580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:17:44.656554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315694+0000","last_change":"2023-09-13T06:01:25.325846+0000","last_active":"2023-09-13T06:01:27.315694+0000","last_peered":"2023-09-13T06:01:27.315694+0000","last_clean":"2023-09-13T06:01:27.315694+0000","last_became_active":"2023-09-13T06:01:25.325644+0000","last_became_peered":"2023-09-13T06:01:25.325644+0000","last_unstale":"2023-09-13T06:01:27.315694+0000","last_undegraded":"2023-09-13T06:01:27.315694+0000","last_fullsized":"2023-09-13T06:01:27.315694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319787+0000","last_change":"2023-09-13T06:01:26.333532+0000","last_active":"2023-09-13T06:01:27.319787+0000","last_peered":"2023-09-13T06:01:27.319787+0000","last_clean":"2023-09-13T06:01:27.319787+0000","last_became_active":"2023-09-13T06:01:26.329944+0000","last_became_peered":"2023-09-13T06:01:26.329944+0000","last_unstale":"2023-09-13T06:01:27.319787+0000","last_undegraded":"2023-09-13T06:01:27.319787+0000","last_fullsized":"2023-09-13T06:01:27.319787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319736+0000","last_change":"2023-09-13T06:01:25.322217+0000","last_active":"2023-09-13T06:01:27.319736+0000","last_peered":"2023-09-13T06:01:27.319736+0000","last_clean":"2023-09-13T06:01:27.319736+0000","last_became_active":"2023-09-13T06:01:25.321988+0000","last_became_peered":"2023-09-13T06:01:25.321988+0000","last_unstale":"2023-09-13T06:01:27.319736+0000","last_undegraded":"2023-09-13T06:01:27.319736+0000","last_fullsized":"2023-09-13T06:01:27.319736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315502+0000","last_change":"2023-09-13T06:01:26.326151+0000","last_active":"2023-09-13T06:01:27.315502+0000","last_peered":"2023-09-13T06:01:27.315502+0000","last_clean":"2023-09-13T06:01:27.315502+0000","last_became_active":"2023-09-13T06:01:26.325878+0000","last_became_peered":"2023-09-13T06:01:26.325878+0000","last_unstale":"2023-09-13T06:01:27.315502+0000","last_undegraded":"2023-09-13T06:01:27.315502+0000","last_fullsized":"2023-09-13T06:01:27.315502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:28.542839+0000","last_change":"2023-09-13T06:01:25.325195+0000","last_active":"2023-09-13T06:01:28.542839+0000","last_peered":"2023-09-13T06:01:28.542839+0000","last_clean":"2023-09-13T06:01:28.542839+0000","last_became_active":"2023-09-13T06:01:25.324980+0000","last_became_peered":"2023-09-13T06:01:25.324980+0000","last_unstale":"2023-09-13T06:01:28.542839+0000","last_undegraded":"2023-09-13T06:01:28.542839+0000","last_fullsized":"2023-09-13T06:01:28.542839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806073+0000","last_change":"2023-09-13T06:01:26.328056+0000","last_active":"2023-09-13T06:01:27.806073+0000","last_peered":"2023-09-13T06:01:27.806073+0000","last_clean":"2023-09-13T06:01:27.806073+0000","last_became_active":"2023-09-13T06:01:26.327839+0000","last_became_peered":"2023-09-13T06:01:26.327839+0000","last_unstale":"2023-09-13T06:01:27.806073+0000","last_undegraded":"2023-09-13T06:01:27.806073+0000","last_fullsized":"2023-09-13T06:01:27.806073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809114+0000","last_change":"2023-09-13T06:01:25.330413+0000","last_active":"2023-09-13T06:01:27.809114+0000","last_peered":"2023-09-13T06:01:27.809114+0000","last_clean":"2023-09-13T06:01:27.809114+0000","last_became_active":"2023-09-13T06:01:25.330136+0000","last_became_peered":"2023-09-13T06:01:25.330136+0000","last_unstale":"2023-09-13T06:01:27.809114+0000","last_undegraded":"2023-09-13T06:01:27.809114+0000","last_fullsized":"2023-09-13T06:01:27.809114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966012+0000","last_change":"2023-09-13T06:01:26.333975+0000","last_active":"2023-09-13T06:01:27.966012+0000","last_peered":"2023-09-13T06:01:27.966012+0000","last_clean":"2023-09-13T06:01:27.966012+0000","last_became_active":"2023-09-13T06:01:26.333731+0000","last_became_peered":"2023-09-13T06:01:26.333731+0000","last_unstale":"2023-09-13T06:01:27.966012+0000","last_undegraded":"2023-09-13T06:01:27.966012+0000","last_fullsized":"2023-09-13T06:01:27.966012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:58:51.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319841+0000","last_change":"2023-09-13T06:01:25.329786+0000","last_active":"2023-09-13T06:01:27.319841+0000","last_peered":"2023-09-13T06:01:27.319841+0000","last_clean":"2023-09-13T06:01:27.319841+0000","last_became_active":"2023-09-13T06:01:25.329314+0000","last_became_peered":"2023-09-13T06:01:25.329314+0000","last_unstale":"2023-09-13T06:01:27.319841+0000","last_undegraded":"2023-09-13T06:01:27.319841+0000","last_fullsized":"2023-09-13T06:01:27.319841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809904+0000","last_change":"2023-09-13T06:01:26.329060+0000","last_active":"2023-09-13T06:01:27.809904+0000","last_peered":"2023-09-13T06:01:27.809904+0000","last_clean":"2023-09-13T06:01:27.809904+0000","last_became_active":"2023-09-13T06:01:26.328817+0000","last_became_peered":"2023-09-13T06:01:26.328817+0000","last_unstale":"2023-09-13T06:01:27.809904+0000","last_undegraded":"2023-09-13T06:01:27.809904+0000","last_fullsized":"2023-09-13T06:01:27.809904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:48.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315653+0000","last_change":"2023-09-13T06:01:25.328158+0000","last_active":"2023-09-13T06:01:27.315653+0000","last_peered":"2023-09-13T06:01:27.315653+0000","last_clean":"2023-09-13T06:01:27.315653+0000","last_became_active":"2023-09-13T06:01:25.327904+0000","last_became_peered":"2023-09-13T06:01:25.327904+0000","last_unstale":"2023-09-13T06:01:27.315653+0000","last_undegraded":"2023-09-13T06:01:27.315653+0000","last_fullsized":"2023-09-13T06:01:27.315653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:47.262828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806021+0000","last_change":"2023-09-13T06:01:26.326068+0000","last_active":"2023-09-13T06:01:27.806021+0000","last_peered":"2023-09-13T06:01:27.806021+0000","last_clean":"2023-09-13T06:01:27.806021+0000","last_became_active":"2023-09-13T06:01:26.325841+0000","last_became_peered":"2023-09-13T06:01:26.325841+0000","last_unstale":"2023-09-13T06:01:27.806021+0000","last_undegraded":"2023-09-13T06:01:27.806021+0000","last_fullsized":"2023-09-13T06:01:27.806021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315703+0000","last_change":"2023-09-13T06:01:25.326680+0000","last_active":"2023-09-13T06:01:27.315703+0000","last_peered":"2023-09-13T06:01:27.315703+0000","last_clean":"2023-09-13T06:01:27.315703+0000","last_became_active":"2023-09-13T06:01:25.326499+0000","last_became_peered":"2023-09-13T06:01:25.326499+0000","last_unstale":"2023-09-13T06:01:27.315703+0000","last_undegraded":"2023-09-13T06:01:27.315703+0000","last_fullsized":"2023-09-13T06:01:27.315703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:50.125094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806117+0000","last_change":"2023-09-13T06:01:26.325317+0000","last_active":"2023-09-13T06:01:27.806117+0000","last_peered":"2023-09-13T06:01:27.806117+0000","last_clean":"2023-09-13T06:01:27.806117+0000","last_became_active":"2023-09-13T06:01:26.325092+0000","last_became_peered":"2023-09-13T06:01:26.325092+0000","last_unstale":"2023-09-13T06:01:27.806117+0000","last_undegraded":"2023-09-13T06:01:27.806117+0000","last_fullsized":"2023-09-13T06:01:27.806117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319376+0000","last_change":"2023-09-13T06:01:25.324793+0000","last_active":"2023-09-13T06:01:27.319376+0000","last_peered":"2023-09-13T06:01:27.319376+0000","last_clean":"2023-09-13T06:01:27.319376+0000","last_became_active":"2023-09-13T06:01:25.324563+0000","last_became_peered":"2023-09-13T06:01:25.324563+0000","last_unstale":"2023-09-13T06:01:27.319376+0000","last_undegraded":"2023-09-13T06:01:27.319376+0000","last_fullsized":"2023-09-13T06:01:27.319376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:47.169662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809187+0000","last_change":"2023-09-13T06:01:26.333372+0000","last_active":"2023-09-13T06:01:27.809187+0000","last_peered":"2023-09-13T06:01:27.809187+0000","last_clean":"2023-09-13T06:01:27.809187+0000","last_became_active":"2023-09-13T06:01:26.333089+0000","last_became_peered":"2023-09-13T06:01:26.333089+0000","last_unstale":"2023-09-13T06:01:27.809187+0000","last_undegraded":"2023-09-13T06:01:27.809187+0000","last_fullsized":"2023-09-13T06:01:27.809187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320283+0000","last_change":"2023-09-13T06:01:26.334900+0000","last_active":"2023-09-13T06:01:27.320283+0000","last_peered":"2023-09-13T06:01:27.320283+0000","last_clean":"2023-09-13T06:01:27.320283+0000","last_became_active":"2023-09-13T06:01:26.334542+0000","last_became_peered":"2023-09-13T06:01:26.334542+0000","last_unstale":"2023-09-13T06:01:27.320283+0000","last_undegraded":"2023-09-13T06:01:27.320283+0000","last_fullsized":"2023-09-13T06:01:27.320283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:58:01.089760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319759+0000","last_change":"2023-09-13T06:01:25.323574+0000","last_active":"2023-09-13T06:01:27.319759+0000","last_peered":"2023-09-13T06:01:27.319759+0000","last_clean":"2023-09-13T06:01:27.319759+0000","last_became_active":"2023-09-13T06:01:25.323254+0000","last_became_peered":"2023-09-13T06:01:25.323254+0000","last_unstale":"2023-09-13T06:01:27.319759+0000","last_undegraded":"2023-09-13T06:01:27.319759+0000","last_fullsized":"2023-09-13T06:01:27.319759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320461+0000","last_change":"2023-09-13T06:01:26.340520+0000","last_active":"2023-09-13T06:01:27.320461+0000","last_peered":"2023-09-13T06:01:27.320461+0000","last_clean":"2023-09-13T06:01:27.320461+0000","last_became_active":"2023-09-13T06:01:26.335635+0000","last_became_peered":"2023-09-13T06:01:26.335635+0000","last_unstale":"2023-09-13T06:01:27.320461+0000","last_undegraded":"2023-09-13T06:01:27.320461+0000","last_fullsized":"2023-09-13T06:01:27.320461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:01:51.436754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320313+0000","last_change":"2023-09-13T06:01:25.327861+0000","last_active":"2023-09-13T06:01:27.320313+0000","last_peered":"2023-09-13T06:01:27.320313+0000","last_clean":"2023-09-13T06:01:27.320313+0000","last_became_active":"2023-09-13T06:01:25.327612+0000","last_became_peered":"2023-09-13T06:01:25.327612+0000","last_unstale":"2023-09-13T06:01:27.320313+0000","last_undegraded":"2023-09-13T06:01:27.320313+0000","last_fullsized":"2023-09-13T06:01:27.320313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:07.662063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966134+0000","last_change":"2023-09-13T06:01:26.332709+0000","last_active":"2023-09-13T06:01:27.966134+0000","last_peered":"2023-09-13T06:01:27.966134+0000","last_clean":"2023-09-13T06:01:27.966134+0000","last_became_active":"2023-09-13T06:01:26.328795+0000","last_became_peered":"2023-09-13T06:01:26.328795+0000","last_unstale":"2023-09-13T06:01:27.966134+0000","last_undegraded":"2023-09-13T06:01:27.966134+0000","last_fullsized":"2023-09-13T06:01:27.966134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806420+0000","last_change":"2023-09-13T06:01:25.325632+0000","last_active":"2023-09-13T06:01:27.806420+0000","last_peered":"2023-09-13T06:01:27.806420+0000","last_clean":"2023-09-13T06:01:27.806420+0000","last_became_active":"2023-09-13T06:01:25.324877+0000","last_became_peered":"2023-09-13T06:01:25.324877+0000","last_unstale":"2023-09-13T06:01:27.806420+0000","last_undegraded":"2023-09-13T06:01:27.806420+0000","last_fullsized":"2023-09-13T06:01:27.806420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:50.125094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806348+0000","last_change":"2023-09-13T06:01:26.327756+0000","last_active":"2023-09-13T06:01:27.806348+0000","last_peered":"2023-09-13T06:01:27.806348+0000","last_clean":"2023-09-13T06:01:27.806348+0000","last_became_active":"2023-09-13T06:01:26.327392+0000","last_became_peered":"2023-09-13T06:01:26.327392+0000","last_unstale":"2023-09-13T06:01:27.806348+0000","last_undegraded":"2023-09-13T06:01:27.806348+0000","last_fullsized":"2023-09-13T06:01:27.806348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:28:12.855923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966263+0000","last_change":"2023-09-13T06:01:25.328325+0000","last_active":"2023-09-13T06:01:27.966263+0000","last_peered":"2023-09-13T06:01:27.966263+0000","last_clean":"2023-09-13T06:01:27.966263+0000","last_became_active":"2023-09-13T06:01:25.328089+0000","last_became_peered":"2023-09-13T06:01:25.328089+0000","last_unstale":"2023-09-13T06:01:27.966263+0000","last_undegraded":"2023-09-13T06:01:27.966263+0000","last_fullsized":"2023-09-13T06:01:27.966263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333641,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924501,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]}],"pool_statfs":[]}} 2023-09-13T06:01:35.093 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:01:35.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.264+0000 7fac2b66d640 1 Processor -- start 2023-09-13T06:01:35.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.264+0000 7fac2b66d640 1 -- start start 2023-09-13T06:01:35.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac2b66d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fac240b1d20 0x7fac240ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac2b66d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240ccfd0 con 0x7fac24159f20 2023-09-13T06:01:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac2b66d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240ced90 con 0x7fac240cdfc0 2023-09-13T06:01:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac2b66d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac240ce430 con 0x7fac240b1d20 2023-09-13T06:01:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac28c08640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fac240b1d20 0x7fac240ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac28c08640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fac240b1d20 0x7fac240ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48184/0 (socket says 172.21.15.130:48184) 2023-09-13T06:01:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac29409640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fac24159f20 0x7fac240b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55854/0 (socket says 172.21.15.130:55854) 2023-09-13T06:01:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac28c08640 1 -- 172.21.15.130:0/2123510119 learned_addr learned my addr 172.21.15.130:0/2123510119 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac28c08640 1 -- 172.21.15.130:0/2123510119 >> v1:172.21.15.164:6789/0 conn(0x7fac240cdfc0 legacy=0x7fac240ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac28c08640 1 -- 172.21.15.130:0/2123510119 >> v1:172.21.15.130:6789/0 conn(0x7fac24159f20 legacy=0x7fac240b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac1bfff640 1 -- 172.21.15.130:0/2123510119 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687509866 0 0) 0x7fac240ccfd0 con 0x7fac24159f20 2023-09-13T06:01:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.268+0000 7fac28c08640 1 -- 172.21.15.130:0/2123510119 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240cd200 con 0x7fac240b1d20 2023-09-13T06:01:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac28c08640 1 --2- 172.21.15.130:0/2123510119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac240b1d20 0x7fac240ce7b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fac140098a0 tx=0x7fac1401e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4447e3f086a777e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:35.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac1bfff640 1 -- 172.21.15.130:0/2123510119 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140ab620 con 0x7fac240b1d20 2023-09-13T06:01:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac1bfff640 1 -- 172.21.15.130:0/2123510119 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac140ab780 con 0x7fac240b1d20 2023-09-13T06:01:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac1bfff640 1 -- 172.21.15.130:0/2123510119 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140abb10 con 0x7fac240b1d20 2023-09-13T06:01:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac2b66d640 1 -- 172.21.15.130:0/2123510119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac240b1d20 msgr2=0x7fac240ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac2b66d640 1 --2- 172.21.15.130:0/2123510119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac240b1d20 0x7fac240ce7b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fac140098a0 tx=0x7fac1401e660 comp rx=0 tx=0).stop 2023-09-13T06:01:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac2b66d640 1 -- 172.21.15.130:0/2123510119 shutdown_connections 2023-09-13T06:01:35.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac2b66d640 1 --2- 172.21.15.130:0/2123510119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac240b1d20 0x7fac240ce7b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac2b66d640 1 -- 172.21.15.130:0/2123510119 >> 172.21.15.130:0/2123510119 conn(0x7fac24065990 msgr2=0x7fac24065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:35.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac2b66d640 1 -- 172.21.15.130:0/2123510119 shutdown_connections 2023-09-13T06:01:35.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac2b66d640 1 -- 172.21.15.130:0/2123510119 wait complete. 2023-09-13T06:01:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac2b66d640 1 Processor -- start 2023-09-13T06:01:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.272+0000 7fac2b66d640 1 -- start start 2023-09-13T06:01:35.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac2b66d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac240b1d20 0x7fac240a8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac2b66d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac240cdfc0 0x7fac241f3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac2b66d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac24159f20 0x7fac241f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac2b66d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2413aa40 con 0x7fac240b1d20 2023-09-13T06:01:35.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac2b66d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2413a6f0 con 0x7fac24159f20 2023-09-13T06:01:35.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac2b66d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac241f40e0 con 0x7fac240cdfc0 2023-09-13T06:01:35.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac29409640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac240b1d20 0x7fac240a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:35.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac29409640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac240b1d20 0x7fac240a8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48186/0 (socket says 172.21.15.130:48186) 2023-09-13T06:01:35.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac29409640 1 -- 172.21.15.130:0/2925240152 learned_addr learned my addr 172.21.15.130:0/2925240152 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:35.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac29409640 1 -- 172.21.15.130:0/2925240152 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac240cdfc0 msgr2=0x7fac241f3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac29409640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac240cdfc0 0x7fac241f3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac29c0a640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac24159f20 0x7fac241f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:35.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac29409640 1 -- 172.21.15.130:0/2925240152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac24159f20 msgr2=0x7fac241f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac29409640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac24159f20 0x7fac241f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac29409640 1 -- 172.21.15.130:0/2925240152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140094d0 con 0x7fac240b1d20 2023-09-13T06:01:35.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac29c0a640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac24159f20 0x7fac241f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:35.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac29409640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac240b1d20 0x7fac240a8690 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c480 tx=0x7fac2000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:35.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac19ffb640 1 -- 172.21.15.130:0/2925240152 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac200074e0 con 0x7fac240b1d20 2023-09-13T06:01:35.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac19ffb640 1 -- 172.21.15.130:0/2925240152 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20007660 con 0x7fac240b1d20 2023-09-13T06:01:35.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac19ffb640 1 -- 172.21.15.130:0/2925240152 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20004a30 con 0x7fac240b1d20 2023-09-13T06:01:35.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac2b66d640 1 -- 172.21.15.130:0/2925240152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac241f43a0 con 0x7fac240b1d20 2023-09-13T06:01:35.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac2b66d640 1 -- 172.21.15.130:0/2925240152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac241f4960 con 0x7fac240b1d20 2023-09-13T06:01:35.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac2b66d640 1 -- 172.21.15.130:0/2925240152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac241f4b80 con 0x7fac240b1d20 2023-09-13T06:01:35.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.276+0000 7fac19ffb640 1 -- 172.21.15.130:0/2925240152 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fac20004b90 con 0x7fac240b1d20 2023-09-13T06:01:35.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.280+0000 7fac19ffb640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fac08065b20 0x7fac08067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.280+0000 7fac19ffb640 1 -- 172.21.15.130:0/2925240152 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac20082400 con 0x7fac240b1d20 2023-09-13T06:01:35.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.280+0000 7fac28c08640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fac08065b20 0x7fac08067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:35.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.280+0000 7fac28c08640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fac08065b20 0x7fac08067fe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac140b0000 tx=0x7fac14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:35.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.284+0000 7fac19ffb640 1 -- 172.21.15.130:0/2925240152 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fac20053870 con 0x7fac240b1d20 2023-09-13T06:01:35.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.428+0000 7fac2b66d640 1 -- 172.21.15.130:0/2925240152 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac240b10a0 con 0x7fac08065b20 2023-09-13T06:01:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac19ffb640 1 -- 172.21.15.130:0/2925240152 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260225 (secure 0 0 0) 0x7fac140ab8f0 con 0x7fac08065b20 2023-09-13T06:01:35.441 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:35.442 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:01:35.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 -- 172.21.15.130:0/2925240152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fac08065b20 msgr2=0x7fac08067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fac08065b20 0x7fac08067fe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac140b0000 tx=0x7fac14008040 comp rx=0 tx=0).stop 2023-09-13T06:01:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 -- 172.21.15.130:0/2925240152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac240b1d20 msgr2=0x7fac240a8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac240b1d20 0x7fac240a8690 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c480 tx=0x7fac2000c940 comp rx=0 tx=0).stop 2023-09-13T06:01:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 -- 172.21.15.130:0/2925240152 shutdown_connections 2023-09-13T06:01:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fac08065b20 0x7fac08067fe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac24159f20 0x7fac241f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac240cdfc0 0x7fac241f3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 --2- 172.21.15.130:0/2925240152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac240b1d20 0x7fac240a8690 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 -- 172.21.15.130:0/2925240152 >> 172.21.15.130:0/2925240152 conn(0x7fac24065990 msgr2=0x7fac2406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 -- 172.21.15.130:0/2925240152 shutdown_connections 2023-09-13T06:01:35.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.436+0000 7fac2b66d640 1 -- 172.21.15.130:0/2925240152 wait complete. 2023-09-13T06:01:35.460 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-13T06:01:34.538292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560753,"statfs":{"total":1600000000,"available":1598211172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.220651"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319337+0000","last_change":"2023-09-13T06:01:26.333344+0000","last_active":"2023-09-13T06:01:27.319337+0000","last_peered":"2023-09-13T06:01:27.319337+0000","last_clean":"2023-09-13T06:01:27.319337+0000","last_became_active":"2023-09-13T06:01:26.333051+0000","last_became_peered":"2023-09-13T06:01:26.333051+0000","last_unstale":"2023-09-13T06:01:27.319337+0000","last_undegraded":"2023-09-13T06:01:27.319337+0000","last_fullsized":"2023-09-13T06:01:27.319337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:11:04.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315478+0000","last_change":"2023-09-13T06:01:26.335080+0000","last_active":"2023-09-13T06:01:27.315478+0000","last_peered":"2023-09-13T06:01:27.315478+0000","last_clean":"2023-09-13T06:01:27.315478+0000","last_became_active":"2023-09-13T06:01:26.334827+0000","last_became_peered":"2023-09-13T06:01:26.334827+0000","last_unstale":"2023-09-13T06:01:27.315478+0000","last_undegraded":"2023-09-13T06:01:27.315478+0000","last_fullsized":"2023-09-13T06:01:27.315478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965878+0000","last_change":"2023-09-13T06:01:26.326639+0000","last_active":"2023-09-13T06:01:27.965878+0000","last_peered":"2023-09-13T06:01:27.965878+0000","last_clean":"2023-09-13T06:01:27.965878+0000","last_became_active":"2023-09-13T06:01:26.326385+0000","last_became_peered":"2023-09-13T06:01:26.326385+0000","last_unstale":"2023-09-13T06:01:27.965878+0000","last_undegraded":"2023-09-13T06:01:27.965878+0000","last_fullsized":"2023-09-13T06:01:27.965878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:59:06.444621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319306+0000","last_change":"2023-09-13T06:01:26.333796+0000","last_active":"2023-09-13T06:01:27.319306+0000","last_peered":"2023-09-13T06:01:27.319306+0000","last_clean":"2023-09-13T06:01:27.319306+0000","last_became_active":"2023-09-13T06:01:26.333306+0000","last_became_peered":"2023-09-13T06:01:26.333306+0000","last_unstale":"2023-09-13T06:01:27.319306+0000","last_undegraded":"2023-09-13T06:01:27.319306+0000","last_fullsized":"2023-09-13T06:01:27.319306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319513+0000","last_change":"2023-09-13T06:01:26.328538+0000","last_active":"2023-09-13T06:01:27.319513+0000","last_peered":"2023-09-13T06:01:27.319513+0000","last_clean":"2023-09-13T06:01:27.319513+0000","last_became_active":"2023-09-13T06:01:26.328008+0000","last_became_peered":"2023-09-13T06:01:26.328008+0000","last_unstale":"2023-09-13T06:01:27.319513+0000","last_undegraded":"2023-09-13T06:01:27.319513+0000","last_fullsized":"2023-09-13T06:01:27.319513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:29:19.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320317+0000","last_change":"2023-09-13T06:01:26.341210+0000","last_active":"2023-09-13T06:01:27.320317+0000","last_peered":"2023-09-13T06:01:27.320317+0000","last_clean":"2023-09-13T06:01:27.320317+0000","last_became_active":"2023-09-13T06:01:26.339644+0000","last_became_peered":"2023-09-13T06:01:26.339644+0000","last_unstale":"2023-09-13T06:01:27.320317+0000","last_undegraded":"2023-09-13T06:01:27.320317+0000","last_fullsized":"2023-09-13T06:01:27.320317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:38:19.434161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319611+0000","last_change":"2023-09-13T06:01:26.324547+0000","last_active":"2023-09-13T06:01:27.319611+0000","last_peered":"2023-09-13T06:01:27.319611+0000","last_clean":"2023-09-13T06:01:27.319611+0000","last_became_active":"2023-09-13T06:01:26.324308+0000","last_became_peered":"2023-09-13T06:01:26.324308+0000","last_unstale":"2023-09-13T06:01:27.319611+0000","last_undegraded":"2023-09-13T06:01:27.319611+0000","last_fullsized":"2023-09-13T06:01:27.319611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:15:00.989410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.805874+0000","last_change":"2023-09-13T06:01:26.331698+0000","last_active":"2023-09-13T06:01:27.805874+0000","last_peered":"2023-09-13T06:01:27.805874+0000","last_clean":"2023-09-13T06:01:27.805874+0000","last_became_active":"2023-09-13T06:01:26.329837+0000","last_became_peered":"2023-09-13T06:01:26.329837+0000","last_unstale":"2023-09-13T06:01:27.805874+0000","last_undegraded":"2023-09-13T06:01:27.805874+0000","last_fullsized":"2023-09-13T06:01:27.805874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:58:51.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319235+0000","last_change":"2023-09-13T06:01:26.331694+0000","last_active":"2023-09-13T06:01:27.319235+0000","last_peered":"2023-09-13T06:01:27.319235+0000","last_clean":"2023-09-13T06:01:27.319235+0000","last_became_active":"2023-09-13T06:01:26.331505+0000","last_became_peered":"2023-09-13T06:01:26.331505+0000","last_unstale":"2023-09-13T06:01:27.319235+0000","last_undegraded":"2023-09-13T06:01:27.319235+0000","last_fullsized":"2023-09-13T06:01:27.319235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808896+0000","last_change":"2023-09-13T06:01:26.331322+0000","last_active":"2023-09-13T06:01:27.808896+0000","last_peered":"2023-09-13T06:01:27.808896+0000","last_clean":"2023-09-13T06:01:27.808896+0000","last_became_active":"2023-09-13T06:01:26.331079+0000","last_became_peered":"2023-09-13T06:01:26.331079+0000","last_unstale":"2023-09-13T06:01:27.808896+0000","last_undegraded":"2023-09-13T06:01:27.808896+0000","last_fullsized":"2023-09-13T06:01:27.808896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808761+0000","last_change":"2023-09-13T06:01:26.339806+0000","last_active":"2023-09-13T06:01:27.808761+0000","last_peered":"2023-09-13T06:01:27.808761+0000","last_clean":"2023-09-13T06:01:27.808761+0000","last_became_active":"2023-09-13T06:01:26.339569+0000","last_became_peered":"2023-09-13T06:01:26.339569+0000","last_unstale":"2023-09-13T06:01:27.808761+0000","last_undegraded":"2023-09-13T06:01:27.808761+0000","last_fullsized":"2023-09-13T06:01:27.808761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:48.181079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809508+0000","last_change":"2023-09-13T06:01:26.332707+0000","last_active":"2023-09-13T06:01:27.809508+0000","last_peered":"2023-09-13T06:01:27.809508+0000","last_clean":"2023-09-13T06:01:27.809508+0000","last_became_active":"2023-09-13T06:01:26.332461+0000","last_became_peered":"2023-09-13T06:01:26.332461+0000","last_unstale":"2023-09-13T06:01:27.809508+0000","last_undegraded":"2023-09-13T06:01:27.809508+0000","last_fullsized":"2023-09-13T06:01:27.809508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:10:32.024779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806240+0000","last_change":"2023-09-13T06:01:26.333127+0000","last_active":"2023-09-13T06:01:27.806240+0000","last_peered":"2023-09-13T06:01:27.806240+0000","last_clean":"2023-09-13T06:01:27.806240+0000","last_became_active":"2023-09-13T06:01:26.330284+0000","last_became_peered":"2023-09-13T06:01:26.330284+0000","last_unstale":"2023-09-13T06:01:27.806240+0000","last_undegraded":"2023-09-13T06:01:27.806240+0000","last_fullsized":"2023-09-13T06:01:27.806240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:48:35.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965662+0000","last_change":"2023-09-13T06:01:26.334244+0000","last_active":"2023-09-13T06:01:27.965662+0000","last_peered":"2023-09-13T06:01:27.965662+0000","last_clean":"2023-09-13T06:01:27.965662+0000","last_became_active":"2023-09-13T06:01:26.334017+0000","last_became_peered":"2023-09-13T06:01:26.334017+0000","last_unstale":"2023-09-13T06:01:27.965662+0000","last_undegraded":"2023-09-13T06:01:27.965662+0000","last_fullsized":"2023-09-13T06:01:27.965662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:58.618446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315608+0000","last_change":"2023-09-13T06:01:26.330534+0000","last_active":"2023-09-13T06:01:27.315608+0000","last_peered":"2023-09-13T06:01:27.315608+0000","last_clean":"2023-09-13T06:01:27.315608+0000","last_became_active":"2023-09-13T06:01:26.330217+0000","last_became_peered":"2023-09-13T06:01:26.330217+0000","last_unstale":"2023-09-13T06:01:27.315608+0000","last_undegraded":"2023-09-13T06:01:27.315608+0000","last_fullsized":"2023-09-13T06:01:27.315608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320169+0000","last_change":"2023-09-13T06:01:26.345029+0000","last_active":"2023-09-13T06:01:27.320169+0000","last_peered":"2023-09-13T06:01:27.320169+0000","last_clean":"2023-09-13T06:01:27.320169+0000","last_became_active":"2023-09-13T06:01:26.339981+0000","last_became_peered":"2023-09-13T06:01:26.339981+0000","last_unstale":"2023-09-13T06:01:27.320169+0000","last_undegraded":"2023-09-13T06:01:27.320169+0000","last_fullsized":"2023-09-13T06:01:27.320169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:28:12.855923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319961+0000","last_change":"2023-09-13T06:01:26.341104+0000","last_active":"2023-09-13T06:01:27.319961+0000","last_peered":"2023-09-13T06:01:27.319961+0000","last_clean":"2023-09-13T06:01:27.319961+0000","last_became_active":"2023-09-13T06:01:26.340321+0000","last_became_peered":"2023-09-13T06:01:26.340321+0000","last_unstale":"2023-09-13T06:01:27.319961+0000","last_undegraded":"2023-09-13T06:01:27.319961+0000","last_fullsized":"2023-09-13T06:01:27.319961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:11:04.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965436+0000","last_change":"2023-09-13T06:01:26.328850+0000","last_active":"2023-09-13T06:01:27.965436+0000","last_peered":"2023-09-13T06:01:27.965436+0000","last_clean":"2023-09-13T06:01:27.965436+0000","last_became_active":"2023-09-13T06:01:26.327736+0000","last_became_peered":"2023-09-13T06:01:26.327736+0000","last_unstale":"2023-09-13T06:01:27.965436+0000","last_undegraded":"2023-09-13T06:01:27.965436+0000","last_fullsized":"2023-09-13T06:01:27.965436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:17:44.656554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319631+0000","last_change":"2023-09-13T06:01:26.326473+0000","last_active":"2023-09-13T06:01:27.319631+0000","last_peered":"2023-09-13T06:01:27.319631+0000","last_clean":"2023-09-13T06:01:27.319631+0000","last_became_active":"2023-09-13T06:01:26.326160+0000","last_became_peered":"2023-09-13T06:01:26.326160+0000","last_unstale":"2023-09-13T06:01:27.319631+0000","last_undegraded":"2023-09-13T06:01:27.319631+0000","last_fullsized":"2023-09-13T06:01:27.319631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:58:01.089760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809040+0000","last_change":"2023-09-13T06:01:26.327947+0000","last_active":"2023-09-13T06:01:27.809040+0000","last_peered":"2023-09-13T06:01:27.809040+0000","last_clean":"2023-09-13T06:01:27.809040+0000","last_became_active":"2023-09-13T06:01:26.327715+0000","last_became_peered":"2023-09-13T06:01:26.327715+0000","last_unstale":"2023-09-13T06:01:27.809040+0000","last_undegraded":"2023-09-13T06:01:27.809040+0000","last_fullsized":"2023-09-13T06:01:27.809040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966133+0000","last_change":"2023-09-13T06:01:26.323975+0000","last_active":"2023-09-13T06:01:27.966133+0000","last_peered":"2023-09-13T06:01:27.966133+0000","last_clean":"2023-09-13T06:01:27.966133+0000","last_became_active":"2023-09-13T06:01:26.323393+0000","last_became_peered":"2023-09-13T06:01:26.323393+0000","last_unstale":"2023-09-13T06:01:27.966133+0000","last_undegraded":"2023-09-13T06:01:27.966133+0000","last_fullsized":"2023-09-13T06:01:27.966133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320252+0000","last_change":"2023-09-13T06:01:26.340839+0000","last_active":"2023-09-13T06:01:27.320252+0000","last_peered":"2023-09-13T06:01:27.320252+0000","last_clean":"2023-09-13T06:01:27.320252+0000","last_became_active":"2023-09-13T06:01:26.339668+0000","last_became_peered":"2023-09-13T06:01:26.339668+0000","last_unstale":"2023-09-13T06:01:27.320252+0000","last_undegraded":"2023-09-13T06:01:27.320252+0000","last_fullsized":"2023-09-13T06:01:27.320252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:15:00.989410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806314+0000","last_change":"2023-09-13T06:01:26.333609+0000","last_active":"2023-09-13T06:01:27.806314+0000","last_peered":"2023-09-13T06:01:27.806314+0000","last_clean":"2023-09-13T06:01:27.806314+0000","last_became_active":"2023-09-13T06:01:26.331440+0000","last_became_peered":"2023-09-13T06:01:26.331440+0000","last_unstale":"2023-09-13T06:01:27.806314+0000","last_undegraded":"2023-09-13T06:01:27.806314+0000","last_fullsized":"2023-09-13T06:01:27.806314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:29:19.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319441+0000","last_change":"2023-09-13T06:01:26.333660+0000","last_active":"2023-09-13T06:01:27.319441+0000","last_peered":"2023-09-13T06:01:27.319441+0000","last_clean":"2023-09-13T06:01:27.319441+0000","last_became_active":"2023-09-13T06:01:26.330349+0000","last_became_peered":"2023-09-13T06:01:26.330349+0000","last_unstale":"2023-09-13T06:01:27.319441+0000","last_undegraded":"2023-09-13T06:01:27.319441+0000","last_fullsized":"2023-09-13T06:01:27.319441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806080+0000","last_change":"2023-09-13T06:01:26.329053+0000","last_active":"2023-09-13T06:01:27.806080+0000","last_peered":"2023-09-13T06:01:27.806080+0000","last_clean":"2023-09-13T06:01:27.806080+0000","last_became_active":"2023-09-13T06:01:26.328820+0000","last_became_peered":"2023-09-13T06:01:26.328820+0000","last_unstale":"2023-09-13T06:01:27.806080+0000","last_undegraded":"2023-09-13T06:01:27.806080+0000","last_fullsized":"2023-09-13T06:01:27.806080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808935+0000","last_change":"2023-09-13T06:01:26.334326+0000","last_active":"2023-09-13T06:01:27.808935+0000","last_peered":"2023-09-13T06:01:27.808935+0000","last_clean":"2023-09-13T06:01:27.808935+0000","last_became_active":"2023-09-13T06:01:26.334009+0000","last_became_peered":"2023-09-13T06:01:26.334009+0000","last_unstale":"2023-09-13T06:01:27.808935+0000","last_undegraded":"2023-09-13T06:01:27.808935+0000","last_fullsized":"2023-09-13T06:01:27.808935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315617+0000","last_change":"2023-09-13T06:01:26.330022+0000","last_active":"2023-09-13T06:01:27.315617+0000","last_peered":"2023-09-13T06:01:27.315617+0000","last_clean":"2023-09-13T06:01:27.315617+0000","last_became_active":"2023-09-13T06:01:26.329781+0000","last_became_peered":"2023-09-13T06:01:26.329781+0000","last_unstale":"2023-09-13T06:01:27.315617+0000","last_undegraded":"2023-09-13T06:01:27.315617+0000","last_fullsized":"2023-09-13T06:01:27.315617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806025+0000","last_change":"2023-09-13T06:01:26.333470+0000","last_active":"2023-09-13T06:01:27.806025+0000","last_peered":"2023-09-13T06:01:27.806025+0000","last_clean":"2023-09-13T06:01:27.806025+0000","last_became_active":"2023-09-13T06:01:26.330564+0000","last_became_peered":"2023-09-13T06:01:26.330564+0000","last_unstale":"2023-09-13T06:01:27.806025+0000","last_undegraded":"2023-09-13T06:01:27.806025+0000","last_fullsized":"2023-09-13T06:01:27.806025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965817+0000","last_change":"2023-09-13T06:01:26.325229+0000","last_active":"2023-09-13T06:01:27.965817+0000","last_peered":"2023-09-13T06:01:27.965817+0000","last_clean":"2023-09-13T06:01:27.965817+0000","last_became_active":"2023-09-13T06:01:26.325006+0000","last_became_peered":"2023-09-13T06:01:26.325006+0000","last_unstale":"2023-09-13T06:01:27.965817+0000","last_undegraded":"2023-09-13T06:01:27.965817+0000","last_fullsized":"2023-09-13T06:01:27.965817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:34.829927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320125+0000","last_change":"2023-09-13T06:01:26.335419+0000","last_active":"2023-09-13T06:01:27.320125+0000","last_peered":"2023-09-13T06:01:27.320125+0000","last_clean":"2023-09-13T06:01:27.320125+0000","last_became_active":"2023-09-13T06:01:26.335145+0000","last_became_peered":"2023-09-13T06:01:26.335145+0000","last_unstale":"2023-09-13T06:01:27.320125+0000","last_undegraded":"2023-09-13T06:01:27.320125+0000","last_fullsized":"2023-09-13T06:01:27.320125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:29:19.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965454+0000","last_change":"2023-09-13T06:01:26.328581+0000","last_active":"2023-09-13T06:01:27.965454+0000","last_peered":"2023-09-13T06:01:27.965454+0000","last_clean":"2023-09-13T06:01:27.965454+0000","last_became_active":"2023-09-13T06:01:26.328353+0000","last_became_peered":"2023-09-13T06:01:26.328353+0000","last_unstale":"2023-09-13T06:01:27.965454+0000","last_undegraded":"2023-09-13T06:01:27.965454+0000","last_fullsized":"2023-09-13T06:01:27.965454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:48.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808879+0000","last_change":"2023-09-13T06:01:26.337762+0000","last_active":"2023-09-13T06:01:27.808879+0000","last_peered":"2023-09-13T06:01:27.808879+0000","last_clean":"2023-09-13T06:01:27.808879+0000","last_became_active":"2023-09-13T06:01:26.337497+0000","last_became_peered":"2023-09-13T06:01:26.337497+0000","last_unstale":"2023-09-13T06:01:27.808879+0000","last_undegraded":"2023-09-13T06:01:27.808879+0000","last_fullsized":"2023-09-13T06:01:27.808879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:58:51.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809270+0000","last_change":"2023-09-13T06:01:26.325877+0000","last_active":"2023-09-13T06:01:27.809270+0000","last_peered":"2023-09-13T06:01:27.809270+0000","last_clean":"2023-09-13T06:01:27.809270+0000","last_became_active":"2023-09-13T06:01:26.325578+0000","last_became_peered":"2023-09-13T06:01:26.325578+0000","last_unstale":"2023-09-13T06:01:27.809270+0000","last_undegraded":"2023-09-13T06:01:27.809270+0000","last_fullsized":"2023-09-13T06:01:27.809270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:51.136511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806375+0000","last_change":"2023-09-13T06:01:25.324046+0000","last_active":"2023-09-13T06:01:27.806375+0000","last_peered":"2023-09-13T06:01:27.806375+0000","last_clean":"2023-09-13T06:01:27.806375+0000","last_became_active":"2023-09-13T06:01:25.323829+0000","last_became_peered":"2023-09-13T06:01:25.323829+0000","last_unstale":"2023-09-13T06:01:27.806375+0000","last_undegraded":"2023-09-13T06:01:27.806375+0000","last_fullsized":"2023-09-13T06:01:27.806375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:33.818510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965953+0000","last_change":"2023-09-13T06:01:26.334351+0000","last_active":"2023-09-13T06:01:27.965953+0000","last_peered":"2023-09-13T06:01:27.965953+0000","last_clean":"2023-09-13T06:01:27.965953+0000","last_became_active":"2023-09-13T06:01:26.329714+0000","last_became_peered":"2023-09-13T06:01:26.329714+0000","last_unstale":"2023-09-13T06:01:27.965953+0000","last_undegraded":"2023-09-13T06:01:27.965953+0000","last_fullsized":"2023-09-13T06:01:27.965953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:48.181079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809119+0000","last_change":"2023-09-13T06:01:25.331427+0000","last_active":"2023-09-13T06:01:27.809119+0000","last_peered":"2023-09-13T06:01:27.809119+0000","last_clean":"2023-09-13T06:01:27.809119+0000","last_became_active":"2023-09-13T06:01:25.331196+0000","last_became_peered":"2023-09-13T06:01:25.331196+0000","last_unstale":"2023-09-13T06:01:27.809119+0000","last_undegraded":"2023-09-13T06:01:27.809119+0000","last_fullsized":"2023-09-13T06:01:27.809119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:31:37.760882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806462+0000","last_change":"2023-09-13T06:01:25.327153+0000","last_active":"2023-09-13T06:01:27.806462+0000","last_peered":"2023-09-13T06:01:27.806462+0000","last_clean":"2023-09-13T06:01:27.806462+0000","last_became_active":"2023-09-13T06:01:25.326762+0000","last_became_peered":"2023-09-13T06:01:25.326762+0000","last_unstale":"2023-09-13T06:01:27.806462+0000","last_undegraded":"2023-09-13T06:01:27.806462+0000","last_fullsized":"2023-09-13T06:01:27.806462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:47.262828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806195+0000","last_change":"2023-09-13T06:01:26.323756+0000","last_active":"2023-09-13T06:01:27.806195+0000","last_peered":"2023-09-13T06:01:27.806195+0000","last_clean":"2023-09-13T06:01:27.806195+0000","last_became_active":"2023-09-13T06:01:26.323531+0000","last_became_peered":"2023-09-13T06:01:26.323531+0000","last_unstale":"2023-09-13T06:01:27.806195+0000","last_undegraded":"2023-09-13T06:01:27.806195+0000","last_fullsized":"2023-09-13T06:01:27.806195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320387+0000","last_change":"2023-09-13T06:01:25.330633+0000","last_active":"2023-09-13T06:01:27.320387+0000","last_peered":"2023-09-13T06:01:27.320387+0000","last_clean":"2023-09-13T06:01:27.320387+0000","last_became_active":"2023-09-13T06:01:25.330453+0000","last_became_peered":"2023-09-13T06:01:25.330453+0000","last_unstale":"2023-09-13T06:01:27.320387+0000","last_undegraded":"2023-09-13T06:01:27.320387+0000","last_fullsized":"2023-09-13T06:01:27.320387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315478+0000","last_change":"2023-09-13T06:01:26.330324+0000","last_active":"2023-09-13T06:01:27.315478+0000","last_peered":"2023-09-13T06:01:27.315478+0000","last_clean":"2023-09-13T06:01:27.315478+0000","last_became_active":"2023-09-13T06:01:26.330079+0000","last_became_peered":"2023-09-13T06:01:26.330079+0000","last_unstale":"2023-09-13T06:01:27.315478+0000","last_undegraded":"2023-09-13T06:01:27.315478+0000","last_fullsized":"2023-09-13T06:01:27.315478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809135+0000","last_change":"2023-09-13T06:01:25.329518+0000","last_active":"2023-09-13T06:01:27.809135+0000","last_peered":"2023-09-13T06:01:27.809135+0000","last_clean":"2023-09-13T06:01:27.809135+0000","last_became_active":"2023-09-13T06:01:25.329317+0000","last_became_peered":"2023-09-13T06:01:25.329317+0000","last_unstale":"2023-09-13T06:01:27.809135+0000","last_undegraded":"2023-09-13T06:01:27.809135+0000","last_fullsized":"2023-09-13T06:01:27.809135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:47.262828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320109+0000","last_change":"2023-09-13T06:01:26.340978+0000","last_active":"2023-09-13T06:01:27.320109+0000","last_peered":"2023-09-13T06:01:27.320109+0000","last_clean":"2023-09-13T06:01:27.320109+0000","last_became_active":"2023-09-13T06:01:26.339989+0000","last_became_peered":"2023-09-13T06:01:26.339989+0000","last_unstale":"2023-09-13T06:01:27.320109+0000","last_undegraded":"2023-09-13T06:01:27.320109+0000","last_fullsized":"2023-09-13T06:01:27.320109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:48:35.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320582+0000","last_change":"2023-09-13T06:01:25.327969+0000","last_active":"2023-09-13T06:01:27.320582+0000","last_peered":"2023-09-13T06:01:27.320582+0000","last_clean":"2023-09-13T06:01:27.320582+0000","last_became_active":"2023-09-13T06:01:25.327745+0000","last_became_peered":"2023-09-13T06:01:25.327745+0000","last_unstale":"2023-09-13T06:01:27.320582+0000","last_undegraded":"2023-09-13T06:01:27.320582+0000","last_fullsized":"2023-09-13T06:01:27.320582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:15.433409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966320+0000","last_change":"2023-09-13T06:01:26.329050+0000","last_active":"2023-09-13T06:01:27.966320+0000","last_peered":"2023-09-13T06:01:27.966320+0000","last_clean":"2023-09-13T06:01:27.966320+0000","last_became_active":"2023-09-13T06:01:26.328702+0000","last_became_peered":"2023-09-13T06:01:26.328702+0000","last_unstale":"2023-09-13T06:01:27.966320+0000","last_undegraded":"2023-09-13T06:01:27.966320+0000","last_fullsized":"2023-09-13T06:01:27.966320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:31:48.994785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315627+0000","last_change":"2023-09-13T06:01:25.322271+0000","last_active":"2023-09-13T06:01:27.315627+0000","last_peered":"2023-09-13T06:01:27.315627+0000","last_clean":"2023-09-13T06:01:27.315627+0000","last_became_active":"2023-09-13T06:01:25.322054+0000","last_became_peered":"2023-09-13T06:01:25.322054+0000","last_unstale":"2023-09-13T06:01:27.315627+0000","last_undegraded":"2023-09-13T06:01:27.315627+0000","last_fullsized":"2023-09-13T06:01:27.315627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809078+0000","last_change":"2023-09-13T06:01:26.322689+0000","last_active":"2023-09-13T06:01:27.809078+0000","last_peered":"2023-09-13T06:01:27.809078+0000","last_clean":"2023-09-13T06:01:27.809078+0000","last_became_active":"2023-09-13T06:01:26.322426+0000","last_became_peered":"2023-09-13T06:01:26.322426+0000","last_unstale":"2023-09-13T06:01:27.809078+0000","last_undegraded":"2023-09-13T06:01:27.809078+0000","last_fullsized":"2023-09-13T06:01:27.809078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:25:38.110206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809241+0000","last_change":"2023-09-13T06:01:25.329417+0000","last_active":"2023-09-13T06:01:27.809241+0000","last_peered":"2023-09-13T06:01:27.809241+0000","last_clean":"2023-09-13T06:01:27.809241+0000","last_became_active":"2023-09-13T06:01:25.329200+0000","last_became_peered":"2023-09-13T06:01:25.329200+0000","last_unstale":"2023-09-13T06:01:27.809241+0000","last_undegraded":"2023-09-13T06:01:27.809241+0000","last_fullsized":"2023-09-13T06:01:27.809241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:50.125094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319246+0000","last_change":"2023-09-13T06:01:26.329074+0000","last_active":"2023-09-13T06:01:27.319246+0000","last_peered":"2023-09-13T06:01:27.319246+0000","last_clean":"2023-09-13T06:01:27.319246+0000","last_became_active":"2023-09-13T06:01:26.328843+0000","last_became_peered":"2023-09-13T06:01:26.328843+0000","last_unstale":"2023-09-13T06:01:27.319246+0000","last_undegraded":"2023-09-13T06:01:27.319246+0000","last_fullsized":"2023-09-13T06:01:27.319246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966042+0000","last_change":"2023-09-13T06:01:25.319809+0000","last_active":"2023-09-13T06:01:27.966042+0000","last_peered":"2023-09-13T06:01:27.966042+0000","last_clean":"2023-09-13T06:01:27.966042+0000","last_became_active":"2023-09-13T06:01:25.319148+0000","last_became_peered":"2023-09-13T06:01:25.319148+0000","last_unstale":"2023-09-13T06:01:27.966042+0000","last_undegraded":"2023-09-13T06:01:27.966042+0000","last_fullsized":"2023-09-13T06:01:27.966042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:41:41.340256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966432+0000","last_change":"2023-09-13T06:01:26.324115+0000","last_active":"2023-09-13T06:01:27.966432+0000","last_peered":"2023-09-13T06:01:27.966432+0000","last_clean":"2023-09-13T06:01:27.966432+0000","last_became_active":"2023-09-13T06:01:26.323734+0000","last_became_peered":"2023-09-13T06:01:26.323734+0000","last_unstale":"2023-09-13T06:01:27.966432+0000","last_undegraded":"2023-09-13T06:01:27.966432+0000","last_fullsized":"2023-09-13T06:01:27.966432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320680+0000","last_change":"2023-09-13T06:01:25.325570+0000","last_active":"2023-09-13T06:01:27.320680+0000","last_peered":"2023-09-13T06:01:27.320680+0000","last_clean":"2023-09-13T06:01:27.320680+0000","last_became_active":"2023-09-13T06:01:25.324812+0000","last_became_peered":"2023-09-13T06:01:25.324812+0000","last_unstale":"2023-09-13T06:01:27.320680+0000","last_undegraded":"2023-09-13T06:01:27.320680+0000","last_fullsized":"2023-09-13T06:01:27.320680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320096+0000","last_change":"2023-09-13T06:01:26.328241+0000","last_active":"2023-09-13T06:01:27.320096+0000","last_peered":"2023-09-13T06:01:27.320096+0000","last_clean":"2023-09-13T06:01:27.320096+0000","last_became_active":"2023-09-13T06:01:26.327377+0000","last_became_peered":"2023-09-13T06:01:26.327377+0000","last_unstale":"2023-09-13T06:01:27.320096+0000","last_undegraded":"2023-09-13T06:01:27.320096+0000","last_fullsized":"2023-09-13T06:01:27.320096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:55:18.039565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808993+0000","last_change":"2023-09-13T06:01:25.332107+0000","last_active":"2023-09-13T06:01:27.808993+0000","last_peered":"2023-09-13T06:01:27.808993+0000","last_clean":"2023-09-13T06:01:27.808993+0000","last_became_active":"2023-09-13T06:01:25.331836+0000","last_became_peered":"2023-09-13T06:01:25.331836+0000","last_unstale":"2023-09-13T06:01:27.808993+0000","last_undegraded":"2023-09-13T06:01:27.808993+0000","last_fullsized":"2023-09-13T06:01:27.808993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.808997+0000","last_change":"2023-09-13T06:01:26.337809+0000","last_active":"2023-09-13T06:01:27.808997+0000","last_peered":"2023-09-13T06:01:27.808997+0000","last_clean":"2023-09-13T06:01:27.808997+0000","last_became_active":"2023-09-13T06:01:26.337559+0000","last_became_peered":"2023-09-13T06:01:26.337559+0000","last_unstale":"2023-09-13T06:01:27.808997+0000","last_undegraded":"2023-09-13T06:01:27.808997+0000","last_fullsized":"2023-09-13T06:01:27.808997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965494+0000","last_change":"2023-09-13T06:01:25.320451+0000","last_active":"2023-09-13T06:01:27.965494+0000","last_peered":"2023-09-13T06:01:27.965494+0000","last_clean":"2023-09-13T06:01:27.965494+0000","last_became_active":"2023-09-13T06:01:25.320217+0000","last_became_peered":"2023-09-13T06:01:25.320217+0000","last_unstale":"2023-09-13T06:01:27.965494+0000","last_undegraded":"2023-09-13T06:01:27.965494+0000","last_fullsized":"2023-09-13T06:01:27.965494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:33.630260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319870+0000","last_change":"2023-09-13T06:01:26.325346+0000","last_active":"2023-09-13T06:01:27.319870+0000","last_peered":"2023-09-13T06:01:27.319870+0000","last_clean":"2023-09-13T06:01:27.319870+0000","last_became_active":"2023-09-13T06:01:26.325127+0000","last_became_peered":"2023-09-13T06:01:26.325127+0000","last_unstale":"2023-09-13T06:01:27.319870+0000","last_undegraded":"2023-09-13T06:01:27.319870+0000","last_fullsized":"2023-09-13T06:01:27.319870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:38:19.434161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809186+0000","last_change":"2023-09-13T06:01:25.326201+0000","last_active":"2023-09-13T06:01:27.809186+0000","last_peered":"2023-09-13T06:01:27.809186+0000","last_clean":"2023-09-13T06:01:27.809186+0000","last_became_active":"2023-09-13T06:01:25.324763+0000","last_became_peered":"2023-09-13T06:01:25.324763+0000","last_unstale":"2023-09-13T06:01:27.809186+0000","last_undegraded":"2023-09-13T06:01:27.809186+0000","last_fullsized":"2023-09-13T06:01:27.809186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:46:54.289271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320219+0000","last_change":"2023-09-13T06:01:26.328389+0000","last_active":"2023-09-13T06:01:27.320219+0000","last_peered":"2023-09-13T06:01:27.320219+0000","last_clean":"2023-09-13T06:01:27.320219+0000","last_became_active":"2023-09-13T06:01:26.327693+0000","last_became_peered":"2023-09-13T06:01:26.327693+0000","last_unstale":"2023-09-13T06:01:27.320219+0000","last_undegraded":"2023-09-13T06:01:27.320219+0000","last_fullsized":"2023-09-13T06:01:27.320219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:01:51.436754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965654+0000","last_change":"2023-09-13T06:01:25.313660+0000","last_active":"2023-09-13T06:01:27.965654+0000","last_peered":"2023-09-13T06:01:27.965654+0000","last_clean":"2023-09-13T06:01:27.965654+0000","last_became_active":"2023-09-13T06:01:25.313419+0000","last_became_peered":"2023-09-13T06:01:25.313419+0000","last_unstale":"2023-09-13T06:01:27.965654+0000","last_undegraded":"2023-09-13T06:01:27.965654+0000","last_fullsized":"2023-09-13T06:01:27.965654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:25:37.098788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319396+0000","last_change":"2023-09-13T06:01:26.324978+0000","last_active":"2023-09-13T06:01:27.319396+0000","last_peered":"2023-09-13T06:01:27.319396+0000","last_clean":"2023-09-13T06:01:27.319396+0000","last_became_active":"2023-09-13T06:01:26.324731+0000","last_became_peered":"2023-09-13T06:01:26.324731+0000","last_unstale":"2023-09-13T06:01:27.319396+0000","last_undegraded":"2023-09-13T06:01:27.319396+0000","last_fullsized":"2023-09-13T06:01:27.319396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:48:35.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315501+0000","last_change":"2023-09-13T06:01:25.327454+0000","last_active":"2023-09-13T06:01:27.315501+0000","last_peered":"2023-09-13T06:01:27.315501+0000","last_clean":"2023-09-13T06:01:27.315501+0000","last_became_active":"2023-09-13T06:01:25.327226+0000","last_became_peered":"2023-09-13T06:01:25.327226+0000","last_unstale":"2023-09-13T06:01:27.315501+0000","last_undegraded":"2023-09-13T06:01:27.315501+0000","last_fullsized":"2023-09-13T06:01:27.315501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:47.169662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320376+0000","last_change":"2023-09-13T06:01:26.341240+0000","last_active":"2023-09-13T06:01:27.320376+0000","last_peered":"2023-09-13T06:01:27.320376+0000","last_clean":"2023-09-13T06:01:27.320376+0000","last_became_active":"2023-09-13T06:01:26.340624+0000","last_became_peered":"2023-09-13T06:01:26.340624+0000","last_unstale":"2023-09-13T06:01:27.320376+0000","last_undegraded":"2023-09-13T06:01:27.320376+0000","last_fullsized":"2023-09-13T06:01:27.320376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:55:18.039565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965359+0000","last_change":"2023-09-13T06:01:25.315904+0000","last_active":"2023-09-13T06:01:27.965359+0000","last_peered":"2023-09-13T06:01:27.965359+0000","last_clean":"2023-09-13T06:01:27.965359+0000","last_became_active":"2023-09-13T06:01:25.315623+0000","last_became_peered":"2023-09-13T06:01:25.315623+0000","last_unstale":"2023-09-13T06:01:27.965359+0000","last_undegraded":"2023-09-13T06:01:27.965359+0000","last_fullsized":"2023-09-13T06:01:27.965359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:05:14.637076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319571+0000","last_change":"2023-09-13T06:01:26.330623+0000","last_active":"2023-09-13T06:01:27.319571+0000","last_peered":"2023-09-13T06:01:27.319571+0000","last_clean":"2023-09-13T06:01:27.319571+0000","last_became_active":"2023-09-13T06:01:26.330401+0000","last_became_peered":"2023-09-13T06:01:26.330401+0000","last_unstale":"2023-09-13T06:01:27.319571+0000","last_undegraded":"2023-09-13T06:01:27.319571+0000","last_fullsized":"2023-09-13T06:01:27.319571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:28:12.855923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-13T06:01:26.321189+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:01:26.321189+0000","last_peered":"2023-09-13T06:01:26.321189+0000","last_clean":"2023-09-13T06:01:26.321189+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:01:26.321189+0000","last_undegraded":"2023-09-13T06:01:26.321189+0000","last_fullsized":"2023-09-13T06:01:26.321189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320821+0000","last_change":"2023-09-13T06:01:25.325043+0000","last_active":"2023-09-13T06:01:27.320821+0000","last_peered":"2023-09-13T06:01:27.320821+0000","last_clean":"2023-09-13T06:01:27.320821+0000","last_became_active":"2023-09-13T06:01:25.324510+0000","last_became_peered":"2023-09-13T06:01:25.324510+0000","last_unstale":"2023-09-13T06:01:27.320821+0000","last_undegraded":"2023-09-13T06:01:27.320821+0000","last_fullsized":"2023-09-13T06:01:27.320821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806211+0000","last_change":"2023-09-13T06:01:26.339163+0000","last_active":"2023-09-13T06:01:27.806211+0000","last_peered":"2023-09-13T06:01:27.806211+0000","last_clean":"2023-09-13T06:01:27.806211+0000","last_became_active":"2023-09-13T06:01:26.338911+0000","last_became_peered":"2023-09-13T06:01:26.338911+0000","last_unstale":"2023-09-13T06:01:27.806211+0000","last_undegraded":"2023-09-13T06:01:27.806211+0000","last_fullsized":"2023-09-13T06:01:27.806211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:11:04.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319837+0000","last_change":"2023-09-13T06:01:25.325759+0000","last_active":"2023-09-13T06:01:27.319837+0000","last_peered":"2023-09-13T06:01:27.319837+0000","last_clean":"2023-09-13T06:01:27.319837+0000","last_became_active":"2023-09-13T06:01:25.325487+0000","last_became_peered":"2023-09-13T06:01:25.325487+0000","last_unstale":"2023-09-13T06:01:27.319837+0000","last_undegraded":"2023-09-13T06:01:27.319837+0000","last_fullsized":"2023-09-13T06:01:27.319837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:33.818510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966209+0000","last_change":"2023-09-13T06:01:26.333513+0000","last_active":"2023-09-13T06:01:27.966209+0000","last_peered":"2023-09-13T06:01:27.966209+0000","last_clean":"2023-09-13T06:01:27.966209+0000","last_became_active":"2023-09-13T06:01:26.333293+0000","last_became_peered":"2023-09-13T06:01:26.333293+0000","last_unstale":"2023-09-13T06:01:27.966209+0000","last_undegraded":"2023-09-13T06:01:27.966209+0000","last_fullsized":"2023-09-13T06:01:27.966209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.965541+0000","last_change":"2023-09-13T06:01:25.314117+0000","last_active":"2023-09-13T06:01:27.965541+0000","last_peered":"2023-09-13T06:01:27.965541+0000","last_clean":"2023-09-13T06:01:27.965541+0000","last_became_active":"2023-09-13T06:01:25.313885+0000","last_became_peered":"2023-09-13T06:01:25.313885+0000","last_unstale":"2023-09-13T06:01:27.965541+0000","last_undegraded":"2023-09-13T06:01:27.965541+0000","last_fullsized":"2023-09-13T06:01:27.965541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:31:37.760882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315617+0000","last_change":"2023-09-13T06:01:26.326308+0000","last_active":"2023-09-13T06:01:27.315617+0000","last_peered":"2023-09-13T06:01:27.315617+0000","last_clean":"2023-09-13T06:01:27.315617+0000","last_became_active":"2023-09-13T06:01:26.326046+0000","last_became_peered":"2023-09-13T06:01:26.326046+0000","last_unstale":"2023-09-13T06:01:27.315617+0000","last_undegraded":"2023-09-13T06:01:27.315617+0000","last_fullsized":"2023-09-13T06:01:27.315617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320661+0000","last_change":"2023-09-13T06:01:25.322672+0000","last_active":"2023-09-13T06:01:27.320661+0000","last_peered":"2023-09-13T06:01:27.320661+0000","last_clean":"2023-09-13T06:01:27.320661+0000","last_became_active":"2023-09-13T06:01:25.320702+0000","last_became_peered":"2023-09-13T06:01:25.320702+0000","last_unstale":"2023-09-13T06:01:27.320661+0000","last_undegraded":"2023-09-13T06:01:27.320661+0000","last_fullsized":"2023-09-13T06:01:27.320661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:55.322422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809580+0000","last_change":"2023-09-13T06:01:26.331164+0000","last_active":"2023-09-13T06:01:27.809580+0000","last_peered":"2023-09-13T06:01:27.809580+0000","last_clean":"2023-09-13T06:01:27.809580+0000","last_became_active":"2023-09-13T06:01:26.330506+0000","last_became_peered":"2023-09-13T06:01:26.330506+0000","last_unstale":"2023-09-13T06:01:27.809580+0000","last_undegraded":"2023-09-13T06:01:27.809580+0000","last_fullsized":"2023-09-13T06:01:27.809580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:17:44.656554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315694+0000","last_change":"2023-09-13T06:01:25.325846+0000","last_active":"2023-09-13T06:01:27.315694+0000","last_peered":"2023-09-13T06:01:27.315694+0000","last_clean":"2023-09-13T06:01:27.315694+0000","last_became_active":"2023-09-13T06:01:25.325644+0000","last_became_peered":"2023-09-13T06:01:25.325644+0000","last_unstale":"2023-09-13T06:01:27.315694+0000","last_undegraded":"2023-09-13T06:01:27.315694+0000","last_fullsized":"2023-09-13T06:01:27.315694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319787+0000","last_change":"2023-09-13T06:01:26.333532+0000","last_active":"2023-09-13T06:01:27.319787+0000","last_peered":"2023-09-13T06:01:27.319787+0000","last_clean":"2023-09-13T06:01:27.319787+0000","last_became_active":"2023-09-13T06:01:26.329944+0000","last_became_peered":"2023-09-13T06:01:26.329944+0000","last_unstale":"2023-09-13T06:01:27.319787+0000","last_undegraded":"2023-09-13T06:01:27.319787+0000","last_fullsized":"2023-09-13T06:01:27.319787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:22:27.906548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319736+0000","last_change":"2023-09-13T06:01:25.322217+0000","last_active":"2023-09-13T06:01:27.319736+0000","last_peered":"2023-09-13T06:01:27.319736+0000","last_clean":"2023-09-13T06:01:27.319736+0000","last_became_active":"2023-09-13T06:01:25.321988+0000","last_became_peered":"2023-09-13T06:01:25.321988+0000","last_unstale":"2023-09-13T06:01:27.319736+0000","last_undegraded":"2023-09-13T06:01:27.319736+0000","last_fullsized":"2023-09-13T06:01:27.319736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:43.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315502+0000","last_change":"2023-09-13T06:01:26.326151+0000","last_active":"2023-09-13T06:01:27.315502+0000","last_peered":"2023-09-13T06:01:27.315502+0000","last_clean":"2023-09-13T06:01:27.315502+0000","last_became_active":"2023-09-13T06:01:26.325878+0000","last_became_peered":"2023-09-13T06:01:26.325878+0000","last_unstale":"2023-09-13T06:01:27.315502+0000","last_undegraded":"2023-09-13T06:01:27.315502+0000","last_fullsized":"2023-09-13T06:01:27.315502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:28.542839+0000","last_change":"2023-09-13T06:01:25.325195+0000","last_active":"2023-09-13T06:01:28.542839+0000","last_peered":"2023-09-13T06:01:28.542839+0000","last_clean":"2023-09-13T06:01:28.542839+0000","last_became_active":"2023-09-13T06:01:25.324980+0000","last_became_peered":"2023-09-13T06:01:25.324980+0000","last_unstale":"2023-09-13T06:01:28.542839+0000","last_undegraded":"2023-09-13T06:01:28.542839+0000","last_fullsized":"2023-09-13T06:01:28.542839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806073+0000","last_change":"2023-09-13T06:01:26.328056+0000","last_active":"2023-09-13T06:01:27.806073+0000","last_peered":"2023-09-13T06:01:27.806073+0000","last_clean":"2023-09-13T06:01:27.806073+0000","last_became_active":"2023-09-13T06:01:26.327839+0000","last_became_peered":"2023-09-13T06:01:26.327839+0000","last_unstale":"2023-09-13T06:01:27.806073+0000","last_undegraded":"2023-09-13T06:01:27.806073+0000","last_fullsized":"2023-09-13T06:01:27.806073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:08.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809114+0000","last_change":"2023-09-13T06:01:25.330413+0000","last_active":"2023-09-13T06:01:27.809114+0000","last_peered":"2023-09-13T06:01:27.809114+0000","last_clean":"2023-09-13T06:01:27.809114+0000","last_became_active":"2023-09-13T06:01:25.330136+0000","last_became_peered":"2023-09-13T06:01:25.330136+0000","last_unstale":"2023-09-13T06:01:27.809114+0000","last_undegraded":"2023-09-13T06:01:27.809114+0000","last_fullsized":"2023-09-13T06:01:27.809114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966012+0000","last_change":"2023-09-13T06:01:26.333975+0000","last_active":"2023-09-13T06:01:27.966012+0000","last_peered":"2023-09-13T06:01:27.966012+0000","last_clean":"2023-09-13T06:01:27.966012+0000","last_became_active":"2023-09-13T06:01:26.333731+0000","last_became_peered":"2023-09-13T06:01:26.333731+0000","last_unstale":"2023-09-13T06:01:27.966012+0000","last_undegraded":"2023-09-13T06:01:27.966012+0000","last_fullsized":"2023-09-13T06:01:27.966012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:58:51.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319841+0000","last_change":"2023-09-13T06:01:25.329786+0000","last_active":"2023-09-13T06:01:27.319841+0000","last_peered":"2023-09-13T06:01:27.319841+0000","last_clean":"2023-09-13T06:01:27.319841+0000","last_became_active":"2023-09-13T06:01:25.329314+0000","last_became_peered":"2023-09-13T06:01:25.329314+0000","last_unstale":"2023-09-13T06:01:27.319841+0000","last_undegraded":"2023-09-13T06:01:27.319841+0000","last_fullsized":"2023-09-13T06:01:27.319841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809904+0000","last_change":"2023-09-13T06:01:26.329060+0000","last_active":"2023-09-13T06:01:27.809904+0000","last_peered":"2023-09-13T06:01:27.809904+0000","last_clean":"2023-09-13T06:01:27.809904+0000","last_became_active":"2023-09-13T06:01:26.328817+0000","last_became_peered":"2023-09-13T06:01:26.328817+0000","last_unstale":"2023-09-13T06:01:27.809904+0000","last_undegraded":"2023-09-13T06:01:27.809904+0000","last_fullsized":"2023-09-13T06:01:27.809904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:48.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315653+0000","last_change":"2023-09-13T06:01:25.328158+0000","last_active":"2023-09-13T06:01:27.315653+0000","last_peered":"2023-09-13T06:01:27.315653+0000","last_clean":"2023-09-13T06:01:27.315653+0000","last_became_active":"2023-09-13T06:01:25.327904+0000","last_became_peered":"2023-09-13T06:01:25.327904+0000","last_unstale":"2023-09-13T06:01:27.315653+0000","last_undegraded":"2023-09-13T06:01:27.315653+0000","last_fullsized":"2023-09-13T06:01:27.315653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:47.262828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806021+0000","last_change":"2023-09-13T06:01:26.326068+0000","last_active":"2023-09-13T06:01:27.806021+0000","last_peered":"2023-09-13T06:01:27.806021+0000","last_clean":"2023-09-13T06:01:27.806021+0000","last_became_active":"2023-09-13T06:01:26.325841+0000","last_became_peered":"2023-09-13T06:01:26.325841+0000","last_unstale":"2023-09-13T06:01:27.806021+0000","last_undegraded":"2023-09-13T06:01:27.806021+0000","last_fullsized":"2023-09-13T06:01:27.806021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:45:16.444826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.315703+0000","last_change":"2023-09-13T06:01:25.326680+0000","last_active":"2023-09-13T06:01:27.315703+0000","last_peered":"2023-09-13T06:01:27.315703+0000","last_clean":"2023-09-13T06:01:27.315703+0000","last_became_active":"2023-09-13T06:01:25.326499+0000","last_became_peered":"2023-09-13T06:01:25.326499+0000","last_unstale":"2023-09-13T06:01:27.315703+0000","last_undegraded":"2023-09-13T06:01:27.315703+0000","last_fullsized":"2023-09-13T06:01:27.315703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:50.125094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806117+0000","last_change":"2023-09-13T06:01:26.325317+0000","last_active":"2023-09-13T06:01:27.806117+0000","last_peered":"2023-09-13T06:01:27.806117+0000","last_clean":"2023-09-13T06:01:27.806117+0000","last_became_active":"2023-09-13T06:01:26.325092+0000","last_became_peered":"2023-09-13T06:01:26.325092+0000","last_unstale":"2023-09-13T06:01:27.806117+0000","last_undegraded":"2023-09-13T06:01:27.806117+0000","last_fullsized":"2023-09-13T06:01:27.806117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319376+0000","last_change":"2023-09-13T06:01:25.324793+0000","last_active":"2023-09-13T06:01:27.319376+0000","last_peered":"2023-09-13T06:01:27.319376+0000","last_clean":"2023-09-13T06:01:27.319376+0000","last_became_active":"2023-09-13T06:01:25.324563+0000","last_became_peered":"2023-09-13T06:01:25.324563+0000","last_unstale":"2023-09-13T06:01:27.319376+0000","last_undegraded":"2023-09-13T06:01:27.319376+0000","last_fullsized":"2023-09-13T06:01:27.319376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:00:47.169662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.809187+0000","last_change":"2023-09-13T06:01:26.333372+0000","last_active":"2023-09-13T06:01:27.809187+0000","last_peered":"2023-09-13T06:01:27.809187+0000","last_clean":"2023-09-13T06:01:27.809187+0000","last_became_active":"2023-09-13T06:01:26.333089+0000","last_became_peered":"2023-09-13T06:01:26.333089+0000","last_unstale":"2023-09-13T06:01:27.809187+0000","last_undegraded":"2023-09-13T06:01:27.809187+0000","last_fullsized":"2023-09-13T06:01:27.809187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:02.829997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320283+0000","last_change":"2023-09-13T06:01:26.334900+0000","last_active":"2023-09-13T06:01:27.320283+0000","last_peered":"2023-09-13T06:01:27.320283+0000","last_clean":"2023-09-13T06:01:27.320283+0000","last_became_active":"2023-09-13T06:01:26.334542+0000","last_became_peered":"2023-09-13T06:01:26.334542+0000","last_unstale":"2023-09-13T06:01:27.320283+0000","last_undegraded":"2023-09-13T06:01:27.320283+0000","last_fullsized":"2023-09-13T06:01:27.320283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:58:01.089760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.319759+0000","last_change":"2023-09-13T06:01:25.323574+0000","last_active":"2023-09-13T06:01:27.319759+0000","last_peered":"2023-09-13T06:01:27.319759+0000","last_clean":"2023-09-13T06:01:27.319759+0000","last_became_active":"2023-09-13T06:01:25.323254+0000","last_became_peered":"2023-09-13T06:01:25.323254+0000","last_unstale":"2023-09-13T06:01:27.319759+0000","last_undegraded":"2023-09-13T06:01:27.319759+0000","last_fullsized":"2023-09-13T06:01:27.319759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320461+0000","last_change":"2023-09-13T06:01:26.340520+0000","last_active":"2023-09-13T06:01:27.320461+0000","last_peered":"2023-09-13T06:01:27.320461+0000","last_clean":"2023-09-13T06:01:27.320461+0000","last_became_active":"2023-09-13T06:01:26.335635+0000","last_became_peered":"2023-09-13T06:01:26.335635+0000","last_unstale":"2023-09-13T06:01:27.320461+0000","last_undegraded":"2023-09-13T06:01:27.320461+0000","last_fullsized":"2023-09-13T06:01:27.320461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:01:51.436754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.320313+0000","last_change":"2023-09-13T06:01:25.327861+0000","last_active":"2023-09-13T06:01:27.320313+0000","last_peered":"2023-09-13T06:01:27.320313+0000","last_clean":"2023-09-13T06:01:27.320313+0000","last_became_active":"2023-09-13T06:01:25.327612+0000","last_became_peered":"2023-09-13T06:01:25.327612+0000","last_unstale":"2023-09-13T06:01:27.320313+0000","last_undegraded":"2023-09-13T06:01:27.320313+0000","last_fullsized":"2023-09-13T06:01:27.320313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:07.662063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966134+0000","last_change":"2023-09-13T06:01:26.332709+0000","last_active":"2023-09-13T06:01:27.966134+0000","last_peered":"2023-09-13T06:01:27.966134+0000","last_clean":"2023-09-13T06:01:27.966134+0000","last_became_active":"2023-09-13T06:01:26.328795+0000","last_became_peered":"2023-09-13T06:01:26.328795+0000","last_unstale":"2023-09-13T06:01:27.966134+0000","last_undegraded":"2023-09-13T06:01:27.966134+0000","last_fullsized":"2023-09-13T06:01:27.966134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:56.333839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806420+0000","last_change":"2023-09-13T06:01:25.325632+0000","last_active":"2023-09-13T06:01:27.806420+0000","last_peered":"2023-09-13T06:01:27.806420+0000","last_clean":"2023-09-13T06:01:27.806420+0000","last_became_active":"2023-09-13T06:01:25.324877+0000","last_became_peered":"2023-09-13T06:01:25.324877+0000","last_unstale":"2023-09-13T06:01:27.806420+0000","last_undegraded":"2023-09-13T06:01:27.806420+0000","last_fullsized":"2023-09-13T06:01:27.806420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:18:50.125094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.806348+0000","last_change":"2023-09-13T06:01:26.327756+0000","last_active":"2023-09-13T06:01:27.806348+0000","last_peered":"2023-09-13T06:01:27.806348+0000","last_clean":"2023-09-13T06:01:27.806348+0000","last_became_active":"2023-09-13T06:01:26.327392+0000","last_became_peered":"2023-09-13T06:01:26.327392+0000","last_unstale":"2023-09-13T06:01:27.806348+0000","last_undegraded":"2023-09-13T06:01:27.806348+0000","last_fullsized":"2023-09-13T06:01:27.806348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:25.301519+0000","last_clean_scrub_stamp":"2023-09-13T06:01:25.301519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:28:12.855923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-13T06:01:27.966263+0000","last_change":"2023-09-13T06:01:25.328325+0000","last_active":"2023-09-13T06:01:27.966263+0000","last_peered":"2023-09-13T06:01:27.966263+0000","last_clean":"2023-09-13T06:01:27.966263+0000","last_became_active":"2023-09-13T06:01:25.328089+0000","last_became_peered":"2023-09-13T06:01:25.328089+0000","last_unstale":"2023-09-13T06:01:27.966263+0000","last_undegraded":"2023-09-13T06:01:27.966263+0000","last_fullsized":"2023-09-13T06:01:27.966263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:24.290102+0000","last_clean_scrub_stamp":"2023-09-13T06:01:24.290102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:51.698434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333641,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924501,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]}],"pool_statfs":[]}} 2023-09-13T06:01:35.466 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-13T06:01:35.466 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-13T06:01:35.467 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-13T06:01:35.467 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-13T06:01:35.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f053c207640 1 Processor -- start 2023-09-13T06:01:35.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f053c207640 1 -- start start 2023-09-13T06:01:35.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f053c207640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05340d1750 0x7f053415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f053c207640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340b63c0 con 0x7f0534146f30 2023-09-13T06:01:35.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f053c207640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340d0c20 con 0x7f05340d1090 2023-09-13T06:01:35.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f053c207640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053415dea0 con 0x7f05340d1750 2023-09-13T06:01:35.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f053a7a4640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0534146f30 0x7f05340b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55870/0 (socket says 172.21.15.130:55870) 2023-09-13T06:01:35.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f053a7a4640 1 -- 172.21.15.130:0/3975969588 learned_addr learned my addr 172.21.15.130:0/3975969588 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:35.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f0539fa3640 1 --2- 172.21.15.130:0/3975969588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05340d1750 0x7f053415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:35.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f0538fa1640 1 -- 172.21.15.130:0/3975969588 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138162698 0 0) 0x7f05340b63c0 con 0x7f0534146f30 2023-09-13T06:01:35.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f0538fa1640 1 -- 172.21.15.130:0/3975969588 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0520003530 con 0x7f0534146f30 2023-09-13T06:01:35.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f0538fa1640 1 -- 172.21.15.130:0/3975969588 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880698558 0 0) 0x7f05340d0c20 con 0x7f05340d1090 2023-09-13T06:01:35.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f0538fa1640 1 -- 172.21.15.130:0/3975969588 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05340b63c0 con 0x7f05340d1090 2023-09-13T06:01:35.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f0539fa3640 1 -- 172.21.15.130:0/3975969588 >> v1:172.21.15.164:6789/0 conn(0x7f05340d1090 legacy=0x7f0534146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f0539fa3640 1 -- 172.21.15.130:0/3975969588 >> v1:172.21.15.130:6789/0 conn(0x7f0534146f30 legacy=0x7f05340b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.640+0000 7f0539fa3640 1 -- 172.21.15.130:0/3975969588 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340b6610 con 0x7f05340d1750 2023-09-13T06:01:35.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.644+0000 7f0539fa3640 1 --2- 172.21.15.130:0/3975969588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05340d1750 0x7f053415d960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f05300097f0 tx=0x7f053001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a14de37f7bf0b401 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:35.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.644+0000 7f0538fa1640 1 -- 172.21.15.130:0/3975969588 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300aa5f0 con 0x7f05340d1750 2023-09-13T06:01:35.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.644+0000 7f0538fa1640 1 -- 172.21.15.130:0/3975969588 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05300aa750 con 0x7f05340d1750 2023-09-13T06:01:35.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.644+0000 7f0538fa1640 1 -- 172.21.15.130:0/3975969588 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300aaae0 con 0x7f05340d1750 2023-09-13T06:01:35.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.644+0000 7f053c207640 1 -- 172.21.15.130:0/3975969588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05340d1750 msgr2=0x7f053415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.644+0000 7f053c207640 1 --2- 172.21.15.130:0/3975969588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05340d1750 0x7f053415d960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f05300097f0 tx=0x7f053001c490 comp rx=0 tx=0).stop 2023-09-13T06:01:35.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.644+0000 7f053c207640 1 -- 172.21.15.130:0/3975969588 shutdown_connections 2023-09-13T06:01:35.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.644+0000 7f053c207640 1 --2- 172.21.15.130:0/3975969588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05340d1750 0x7f053415d960 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.644+0000 7f053c207640 1 -- 172.21.15.130:0/3975969588 >> 172.21.15.130:0/3975969588 conn(0x7f053406f170 msgr2=0x7f053406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:35.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.644+0000 7f053c207640 1 -- 172.21.15.130:0/3975969588 shutdown_connections 2023-09-13T06:01:35.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.644+0000 7f053c207640 1 -- 172.21.15.130:0/3975969588 wait complete. 2023-09-13T06:01:35.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053c207640 1 Processor -- start 2023-09-13T06:01:35.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053c207640 1 -- start start 2023-09-13T06:01:35.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053c207640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05340d1090 0x7f053415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053c207640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05340d1750 0x7f0534159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053c207640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0534146f30 0x7f053413ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053c207640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0534145600 con 0x7f05340d1090 2023-09-13T06:01:35.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053c207640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053415a100 con 0x7f05340d1750 2023-09-13T06:01:35.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053c207640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0534145040 con 0x7f0534146f30 2023-09-13T06:01:35.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f0539fa3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05340d1090 0x7f053415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:35.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f0539fa3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05340d1090 0x7f053415c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48194/0 (socket says 172.21.15.130:48194) 2023-09-13T06:01:35.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f0539fa3640 1 -- 172.21.15.130:0/669107698 learned_addr learned my addr 172.21.15.130:0/669107698 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:35.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f05397a2640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05340d1750 0x7f0534159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:35.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053a7a4640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0534146f30 0x7f053413ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:35.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f0539fa3640 1 -- 172.21.15.130:0/669107698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0534146f30 msgr2=0x7f053413ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f0539fa3640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0534146f30 0x7f053413ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f0539fa3640 1 -- 172.21.15.130:0/669107698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05340d1750 msgr2=0x7f0534159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f0539fa3640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05340d1750 0x7f0534159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f0539fa3640 1 -- 172.21.15.130:0/669107698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530009420 con 0x7f05340d1090 2023-09-13T06:01:35.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f05397a2640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05340d1750 0x7f0534159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:35.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f0539fa3640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05340d1090 0x7f053415c810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f05300190a0 tx=0x7f053001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:35.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f052a7fc640 1 -- 172.21.15.130:0/669107698 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300be610 con 0x7f05340d1090 2023-09-13T06:01:35.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f052a7fc640 1 -- 172.21.15.130:0/669107698 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05300be790 con 0x7f05340d1090 2023-09-13T06:01:35.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f052a7fc640 1 -- 172.21.15.130:0/669107698 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300beb40 con 0x7f05340d1090 2023-09-13T06:01:35.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053c207640 1 -- 172.21.15.130:0/669107698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0534145320 con 0x7f05340d1090 2023-09-13T06:01:35.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053c207640 1 -- 172.21.15.130:0/669107698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053415d480 con 0x7f05340d1090 2023-09-13T06:01:35.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.648+0000 7f053c207640 1 -- 172.21.15.130:0/669107698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053413c3a0 con 0x7f05340d1090 2023-09-13T06:01:35.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.652+0000 7f052a7fc640 1 -- 172.21.15.130:0/669107698 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f05300b4400 con 0x7f05340d1090 2023-09-13T06:01:35.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.652+0000 7f052a7fc640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0518065b20 0x7f0518067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.652+0000 7f052a7fc640 1 -- 172.21.15.130:0/669107698 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05300a7070 con 0x7f05340d1090 2023-09-13T06:01:35.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.652+0000 7f05397a2640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0518065b20 0x7f0518067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:35.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.652+0000 7f05397a2640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0518065b20 0x7f0518067fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05340b5530 tx=0x7f0524009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:35.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.656+0000 7f052a7fc640 1 -- 172.21.15.130:0/669107698 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f053413c3a0 con 0x7f05340d1090 2023-09-13T06:01:35.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.832+0000 7f053c207640 1 -- 172.21.15.130:0/669107698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f053413c3a0 con 0x7f05340d1090 2023-09-13T06:01:35.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f052a7fc640 1 -- 172.21.15.130:0/669107698 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f053413c3a0 con 0x7f05340d1090 2023-09-13T06:01:35.839 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:35.839 INFO:teuthology.orchestra.run.smithi130.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-13T06:01:35.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 -- 172.21.15.130:0/669107698 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0518065b20 msgr2=0x7f0518067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0518065b20 0x7f0518067fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05340b5530 tx=0x7f0524009040 comp rx=0 tx=0).stop 2023-09-13T06:01:35.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 -- 172.21.15.130:0/669107698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05340d1090 msgr2=0x7f053415c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:35.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05340d1090 0x7f053415c810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f05300190a0 tx=0x7f053001acd0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 -- 172.21.15.130:0/669107698 shutdown_connections 2023-09-13T06:01:35.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0518065b20 0x7f0518067fe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05340d1750 0x7f0534159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0534146f30 0x7f053413ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 --2- 172.21.15.130:0/669107698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05340d1090 0x7f053415c810 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:35.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 -- 172.21.15.130:0/669107698 >> 172.21.15.130:0/669107698 conn(0x7f053406f170 msgr2=0x7f053415f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:35.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 -- 172.21.15.130:0/669107698 shutdown_connections 2023-09-13T06:01:35.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.836+0000 7f053c207640 1 -- 172.21.15.130:0/669107698 wait complete. 2023-09-13T06:01:35.859 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-13T06:01:35.859 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:35.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.992+0000 7fe2775c6640 1 Processor -- start 2023-09-13T06:01:35.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.992+0000 7fe2775c6640 1 -- start start 2023-09-13T06:01:35.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe2775c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2700cd910 0x7fe27015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe2775c6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe27015f6c0 0x7fe27015dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:35.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe2775c6640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27015fbc0 con 0x7fe270141650 2023-09-13T06:01:36.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe2775c6640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27015c920 con 0x7fe27015f6c0 2023-09-13T06:01:36.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe2775c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27015cc00 con 0x7fe2700cd910 2023-09-13T06:01:36.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe275362640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe270141650 0x7fe2700cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55878/0 (socket says 172.21.15.130:55878) 2023-09-13T06:01:36.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe275362640 1 -- 172.21.15.130:0/3976207821 learned_addr learned my addr 172.21.15.130:0/3976207821 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:36.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe275b63640 1 --2- 172.21.15.130:0/3976207821 >> v2:172.21.15.164:3300/0 conn(0x7fe27015f6c0 0x7fe27015dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe274b61640 1 --2- 172.21.15.130:0/3976207821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2700cd910 0x7fe27015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe267fff640 1 -- 172.21.15.130:0/3976207821 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762343309 0 0) 0x7fe27015fbc0 con 0x7fe270141650 2023-09-13T06:01:36.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe267fff640 1 -- 172.21.15.130:0/3976207821 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe25c003530 con 0x7fe270141650 2023-09-13T06:01:36.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe275b63640 1 -- 172.21.15.130:0/3976207821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2700cd910 msgr2=0x7fe27015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:36.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe275b63640 1 --2- 172.21.15.130:0/3976207821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2700cd910 0x7fe27015d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe275b63640 1 -- 172.21.15.130:0/3976207821 >> v1:172.21.15.130:6789/0 conn(0x7fe270141650 legacy=0x7fe2700cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe267fff640 1 -- 172.21.15.130:0/3976207821 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1333725060 0 0) 0x7fe25c003530 con 0x7fe270141650 2023-09-13T06:01:36.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:35.996+0000 7fe275b63640 1 -- 172.21.15.130:0/3976207821 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27015cee0 con 0x7fe27015f6c0 2023-09-13T06:01:36.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe275b63640 1 --2- 172.21.15.130:0/3976207821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe27015f6c0 0x7fe27015dc20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe268009dc0 tx=0x7fe26801c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83f0af2acd37b4aa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:36.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe267fff640 1 -- 172.21.15.130:0/3976207821 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680a5900 con 0x7fe27015f6c0 2023-09-13T06:01:36.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe267fff640 1 -- 172.21.15.130:0/3976207821 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2680a5a60 con 0x7fe27015f6c0 2023-09-13T06:01:36.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe267fff640 1 -- 172.21.15.130:0/3976207821 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680a5df0 con 0x7fe27015f6c0 2023-09-13T06:01:36.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe2775c6640 1 -- 172.21.15.130:0/3976207821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe27015f6c0 msgr2=0x7fe27015dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe2775c6640 1 --2- 172.21.15.130:0/3976207821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe27015f6c0 0x7fe27015dc20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe268009dc0 tx=0x7fe26801c930 comp rx=0 tx=0).stop 2023-09-13T06:01:36.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe2775c6640 1 -- 172.21.15.130:0/3976207821 shutdown_connections 2023-09-13T06:01:36.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe2775c6640 1 --2- 172.21.15.130:0/3976207821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe27015f6c0 0x7fe27015dc20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe2775c6640 1 --2- 172.21.15.130:0/3976207821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2700cd910 0x7fe27015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe2775c6640 1 -- 172.21.15.130:0/3976207821 >> 172.21.15.130:0/3976207821 conn(0x7fe2700b0bc0 msgr2=0x7fe2700b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:36.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe2775c6640 1 -- 172.21.15.130:0/3976207821 shutdown_connections 2023-09-13T06:01:36.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe2775c6640 1 -- 172.21.15.130:0/3976207821 wait complete. 2023-09-13T06:01:36.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe2775c6640 1 Processor -- start 2023-09-13T06:01:36.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.000+0000 7fe2775c6640 1 -- start start 2023-09-13T06:01:36.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe2775c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2700cd910 0x7fe27013fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe2775c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe270141650 0x7fe2701538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe2775c6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe27015f6c0 0x7fe2700affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe2775c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe270140470 con 0x7fe270141650 2023-09-13T06:01:36.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe2775c6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27013dcc0 con 0x7fe27015f6c0 2023-09-13T06:01:36.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe2775c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2701423e0 con 0x7fe2700cd910 2023-09-13T06:01:36.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe274b61640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe270141650 0x7fe2701538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe274b61640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe270141650 0x7fe2701538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48206/0 (socket says 172.21.15.130:48206) 2023-09-13T06:01:36.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe274b61640 1 -- 172.21.15.130:0/2092137917 learned_addr learned my addr 172.21.15.130:0/2092137917 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:36.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe275362640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2700cd910 0x7fe27013fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe275b63640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe27015f6c0 0x7fe2700affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe274b61640 1 -- 172.21.15.130:0/2092137917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2700cd910 msgr2=0x7fe27013fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe274b61640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2700cd910 0x7fe27013fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe274b61640 1 -- 172.21.15.130:0/2092137917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe27015f6c0 msgr2=0x7fe2700affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe274b61640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe27015f6c0 0x7fe2700affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe274b61640 1 -- 172.21.15.130:0/2092137917 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe268009a70 con 0x7fe270141650 2023-09-13T06:01:36.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe275362640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2700cd910 0x7fe27013fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:36.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe275b63640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe27015f6c0 0x7fe2700affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:36.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe274b61640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe270141650 0x7fe2701538b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe26000e900 tx=0x7fe26000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:36.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe265ffb640 1 -- 172.21.15.130:0/2092137917 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260009690 con 0x7fe270141650 2023-09-13T06:01:36.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe265ffb640 1 -- 172.21.15.130:0/2092137917 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26000ca00 con 0x7fe270141650 2023-09-13T06:01:36.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe2775c6640 1 -- 172.21.15.130:0/2092137917 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe270140190 con 0x7fe270141650 2023-09-13T06:01:36.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe265ffb640 1 -- 172.21.15.130:0/2092137917 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26000cdb0 con 0x7fe270141650 2023-09-13T06:01:36.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe2775c6640 1 -- 172.21.15.130:0/2092137917 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe270142960 con 0x7fe270141650 2023-09-13T06:01:36.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe2775c6640 1 -- 172.21.15.130:0/2092137917 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2700618a0 con 0x7fe270141650 2023-09-13T06:01:36.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.004+0000 7fe265ffb640 1 -- 172.21.15.130:0/2092137917 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe260013470 con 0x7fe270141650 2023-09-13T06:01:36.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.008+0000 7fe265ffb640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe254065b20 0x7fe254067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.008+0000 7fe265ffb640 1 -- 172.21.15.130:0/2092137917 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe260083510 con 0x7fe270141650 2023-09-13T06:01:36.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.008+0000 7fe275362640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe254065b20 0x7fe254067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.008+0000 7fe275362640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe254065b20 0x7fe254067fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe26c001450 tx=0x7fe26c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:36.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.012+0000 7fe265ffb640 1 -- 172.21.15.130:0/2092137917 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe260050e60 con 0x7fe270141650 2023-09-13T06:01:36.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.160+0000 7fe2775c6640 1 -- 172.21.15.130:0/2092137917 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe270165b50 con 0x7fe270141650 2023-09-13T06:01:36.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.160+0000 7fe265ffb640 1 -- 172.21.15.130:0/2092137917 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fe260081e60 con 0x7fe270141650 2023-09-13T06:01:36.165 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:36.165 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:36.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 -- 172.21.15.130:0/2092137917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe254065b20 msgr2=0x7fe254067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe254065b20 0x7fe254067fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe26c001450 tx=0x7fe26c009040 comp rx=0 tx=0).stop 2023-09-13T06:01:36.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 -- 172.21.15.130:0/2092137917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe270141650 msgr2=0x7fe2701538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe270141650 0x7fe2701538b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe26000e900 tx=0x7fe26000edc0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 -- 172.21.15.130:0/2092137917 shutdown_connections 2023-09-13T06:01:36.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe254065b20 0x7fe254067fe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe27015f6c0 0x7fe2700affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe270141650 0x7fe2701538b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 --2- 172.21.15.130:0/2092137917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2700cd910 0x7fe27013fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 -- 172.21.15.130:0/2092137917 >> 172.21.15.130:0/2092137917 conn(0x7fe2700b0bc0 msgr2=0x7fe2700cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 -- 172.21.15.130:0/2092137917 shutdown_connections 2023-09-13T06:01:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.164+0000 7fe2775c6640 1 -- 172.21.15.130:0/2092137917 wait complete. 2023-09-13T06:01:36.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:01:36.187 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:01:36.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff17327b640 1 Processor -- start 2023-09-13T06:01:36.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff17327b640 1 -- start start 2023-09-13T06:01:36.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff17327b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c1617f0 0x7ff16c0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff17327b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16c0b2620 con 0x7ff16c0ce890 2023-09-13T06:01:36.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff17327b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16c0b1a80 con 0x7ff16c0cc880 2023-09-13T06:01:36.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff17327b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0ccce0 con 0x7ff16c1617f0 2023-09-13T06:01:36.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff171818640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff16c0ce890 0x7ff16c161bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55882/0 (socket says 172.21.15.130:55882) 2023-09-13T06:01:36.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff171818640 1 -- 172.21.15.130:0/772048686 learned_addr learned my addr 172.21.15.130:0/772048686 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:36.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff171017640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c1617f0 0x7ff16c0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714993206 0 0) 0x7ff16c0b2620 con 0x7ff16c0ce890 2023-09-13T06:01:36.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff158003530 con 0x7ff16c0ce890 2023-09-13T06:01:36.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238093966 0 0) 0x7ff16c0b1a80 con 0x7ff16c0cc880 2023-09-13T06:01:36.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff16c0b2620 con 0x7ff16c0cc880 2023-09-13T06:01:36.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585308510 0 0) 0x7ff158003530 con 0x7ff16c0ce890 2023-09-13T06:01:36.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c1617f0 msgr2=0x7ff16c0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:36.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c1617f0 0x7ff16c0cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 >> v1:172.21.15.164:6789/0 conn(0x7ff16c0cc880 legacy=0x7ff16c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c0b2ab0 con 0x7ff16c0ce890 2023-09-13T06:01:36.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7ff164001a00 con 0x7ff16c0ce890 2023-09-13T06:01:36.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 >> v1:172.21.15.130:6789/0 conn(0x7ff16c0ce890 legacy=0x7ff16c161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 0x7ff158003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c1617f0 0x7ff1580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff158004d10 0x7ff158005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0ccce0 con 0x7ff158003bb0 2023-09-13T06:01:36.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15800ba70 con 0x7ff158004d10 2023-09-13T06:01:36.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15800bc30 con 0x7ff16c1617f0 2023-09-13T06:01:36.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff171017640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 0x7ff158003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff170816640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c1617f0 0x7ff1580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.324+0000 7ff171818640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff158004d10 0x7ff158005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff171017640 1 -- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c1617f0 msgr2=0x7ff1580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:36.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff171017640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c1617f0 0x7ff1580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff171017640 1 -- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff158004d10 msgr2=0x7ff158005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:36.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff171017640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff158004d10 0x7ff158005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff171017640 1 -- 172.21.15.130:0/772048686 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff158003530 con 0x7ff158003bb0 2023-09-13T06:01:36.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff171818640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff158004d10 0x7ff158005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:36.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff171017640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 0x7ff158003fb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff168009ab0 tx=0x7ff16801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b41b4756058a4da server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:36.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1680a64f0 con 0x7ff158003bb0 2023-09-13T06:01:36.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1680a6650 con 0x7ff158003bb0 2023-09-13T06:01:36.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff163fff640 1 -- 172.21.15.130:0/772048686 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1680a6a00 con 0x7ff158003bb0 2023-09-13T06:01:36.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff17327b640 1 -- 172.21.15.130:0/772048686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 msgr2=0x7ff158003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff17327b640 1 --2- 172.21.15.130:0/772048686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 0x7ff158003fb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff168009ab0 tx=0x7ff16801ca00 comp rx=0 tx=0).stop 2023-09-13T06:01:36.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff171818640 1 -- 172.21.15.130:0/772048686 reap_dead start 2023-09-13T06:01:36.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff17327b640 1 -- 172.21.15.130:0/772048686 shutdown_connections 2023-09-13T06:01:36.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.328+0000 7ff17327b640 1 -- 172.21.15.130:0/772048686 >> 172.21.15.130:0/772048686 conn(0x7ff16c065990 msgr2=0x7ff16c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:36.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff17327b640 1 -- 172.21.15.130:0/772048686 shutdown_connections 2023-09-13T06:01:36.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff17327b640 1 -- 172.21.15.130:0/772048686 wait complete. 2023-09-13T06:01:36.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff17327b640 1 Processor -- start 2023-09-13T06:01:36.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff17327b640 1 -- start start 2023-09-13T06:01:36.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff17327b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 0x7ff16c165110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff17327b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff16c15abf0 0x7ff16c165650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff17327b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c155a30 0x7ff16c155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff17327b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c1563f0 con 0x7ff158003bb0 2023-09-13T06:01:36.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff17327b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c1fb1e0 con 0x7ff16c15abf0 2023-09-13T06:01:36.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff17327b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c1fa5d0 con 0x7ff16c155a30 2023-09-13T06:01:36.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff171017640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 0x7ff16c165110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff171017640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 0x7ff16c165110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48222/0 (socket says 172.21.15.130:48222) 2023-09-13T06:01:36.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff171017640 1 -- 172.21.15.130:0/3343218715 learned_addr learned my addr 172.21.15.130:0/3343218715 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:36.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff170816640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff16c15abf0 0x7ff16c165650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff171818640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c155a30 0x7ff16c155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff171017640 1 -- 172.21.15.130:0/3343218715 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c155a30 msgr2=0x7ff16c155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff171017640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c155a30 0x7ff16c155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff171017640 1 -- 172.21.15.130:0/3343218715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff16c15abf0 msgr2=0x7ff16c165650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff171017640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff16c15abf0 0x7ff16c165650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff171017640 1 -- 172.21.15.130:0/3343218715 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c1fa8b0 con 0x7ff158003bb0 2023-09-13T06:01:36.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.332+0000 7ff171017640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 0x7ff16c165110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff16801c830 tx=0x7ff158005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:36.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.336+0000 7ff161ffb640 1 -- 172.21.15.130:0/3343218715 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16800f000 con 0x7ff158003bb0 2023-09-13T06:01:36.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.336+0000 7ff161ffb640 1 -- 172.21.15.130:0/3343218715 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1680a67c0 con 0x7ff158003bb0 2023-09-13T06:01:36.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.336+0000 7ff161ffb640 1 -- 172.21.15.130:0/3343218715 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1680a6b70 con 0x7ff158003bb0 2023-09-13T06:01:36.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.336+0000 7ff17327b640 1 -- 172.21.15.130:0/3343218715 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16c1fab90 con 0x7ff158003bb0 2023-09-13T06:01:36.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.336+0000 7ff17327b640 1 -- 172.21.15.130:0/3343218715 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16c1fa280 con 0x7ff158003bb0 2023-09-13T06:01:36.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.336+0000 7ff17327b640 1 -- 172.21.15.130:0/3343218715 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16c0618a0 con 0x7ff158003bb0 2023-09-13T06:01:36.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.336+0000 7ff161ffb640 1 -- 172.21.15.130:0/3343218715 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff1680a6cd0 con 0x7ff158003bb0 2023-09-13T06:01:36.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.336+0000 7ff161ffb640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b20 0x7ff150067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.336+0000 7ff161ffb640 1 -- 172.21.15.130:0/3343218715 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1680aa070 con 0x7ff158003bb0 2023-09-13T06:01:36.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.336+0000 7ff170816640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b20 0x7ff150067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.336+0000 7ff170816640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b20 0x7ff150067fe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff16c158330 tx=0x7ff15c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:36.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.340+0000 7ff161ffb640 1 -- 172.21.15.130:0/3343218715 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff1680eb800 con 0x7ff158003bb0 2023-09-13T06:01:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 -- 172.21.15.130:0/3343218715 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff16c0afb50 con 0x7ff158003bb0 2023-09-13T06:01:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff161ffb640 1 -- 172.21.15.130:0/3343218715 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1680eee20 con 0x7ff158003bb0 2023-09-13T06:01:36.495 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:01:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 -- 172.21.15.130:0/3343218715 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b20 msgr2=0x7ff150067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b20 0x7ff150067fe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff16c158330 tx=0x7ff15c009040 comp rx=0 tx=0).stop 2023-09-13T06:01:36.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 -- 172.21.15.130:0/3343218715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 msgr2=0x7ff16c165110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 0x7ff16c165110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff16801c830 tx=0x7ff158005800 comp rx=0 tx=0).stop 2023-09-13T06:01:36.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 -- 172.21.15.130:0/3343218715 shutdown_connections 2023-09-13T06:01:36.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b20 0x7ff150067fe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff16c15abf0 0x7ff16c165650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff16c155a30 0x7ff16c155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 --2- 172.21.15.130:0/3343218715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff158003bb0 0x7ff16c165110 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 -- 172.21.15.130:0/3343218715 >> 172.21.15.130:0/3343218715 conn(0x7ff16c065990 msgr2=0x7ff16c0af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:36.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 -- 172.21.15.130:0/3343218715 shutdown_connections 2023-09-13T06:01:36.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.492+0000 7ff17327b640 1 -- 172.21.15.130:0/3343218715 wait complete. 2023-09-13T06:01:36.516 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:01:36.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.656+0000 7fd9925fa640 1 Processor -- start 2023-09-13T06:01:36.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.656+0000 7fd9925fa640 1 -- start start 2023-09-13T06:01:36.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.656+0000 7fd9925fa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd98c154380 0x7fd98c0b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.656+0000 7fd9925fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd98c154760 0x7fd98c070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.656+0000 7fd9925fa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd98c161140 0x7fd98c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.656+0000 7fd9925fa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c0b2690 con 0x7fd98c161140 2023-09-13T06:01:36.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.656+0000 7fd9925fa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c161700 con 0x7fd98c154380 2023-09-13T06:01:36.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.656+0000 7fd9925fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c1619e0 con 0x7fd98c154760 2023-09-13T06:01:36.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd990b97640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd98c161140 0x7fd98c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd990b97640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd98c161140 0x7fd98c15e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48230/0 (socket says 172.21.15.130:48230) 2023-09-13T06:01:36.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd990b97640 1 -- 172.21.15.130:0/2309158831 learned_addr learned my addr 172.21.15.130:0/2309158831 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:36.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd98b7fe640 1 --2- 172.21.15.130:0/2309158831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd98c154760 0x7fd98c070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd98bfff640 1 --2- 172.21.15.130:0/2309158831 >> v2:172.21.15.164:3300/0 conn(0x7fd98c154380 0x7fd98c0b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd990b97640 1 -- 172.21.15.130:0/2309158831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd98c154760 msgr2=0x7fd98c070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:36.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd990b97640 1 --2- 172.21.15.130:0/2309158831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd98c154760 0x7fd98c070670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd990b97640 1 -- 172.21.15.130:0/2309158831 >> v2:172.21.15.164:3300/0 conn(0x7fd98c154380 msgr2=0x7fd98c0b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:36.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd990b97640 1 --2- 172.21.15.130:0/2309158831 >> v2:172.21.15.164:3300/0 conn(0x7fd98c154380 0x7fd98c0b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd990b97640 1 -- 172.21.15.130:0/2309158831 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c161cc0 con 0x7fd98c161140 2023-09-13T06:01:36.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd98bfff640 1 --2- 172.21.15.130:0/2309158831 >> v2:172.21.15.164:3300/0 conn(0x7fd98c154380 0x7fd98c0b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:36.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd990b97640 1 --2- 172.21.15.130:0/2309158831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd98c161140 0x7fd98c15e180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd98c069f90 tx=0x7fd98401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b27c28052066890 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:36.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd98affd640 1 -- 172.21.15.130:0/2309158831 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840a57e0 con 0x7fd98c161140 2023-09-13T06:01:36.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd98affd640 1 -- 172.21.15.130:0/2309158831 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9840a5940 con 0x7fd98c161140 2023-09-13T06:01:36.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.660+0000 7fd98affd640 1 -- 172.21.15.130:0/2309158831 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840a5cd0 con 0x7fd98c161140 2023-09-13T06:01:36.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 -- 172.21.15.130:0/2309158831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd98c161140 msgr2=0x7fd98c15e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 --2- 172.21.15.130:0/2309158831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd98c161140 0x7fd98c15e180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd98c069f90 tx=0x7fd98401c940 comp rx=0 tx=0).stop 2023-09-13T06:01:36.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 -- 172.21.15.130:0/2309158831 shutdown_connections 2023-09-13T06:01:36.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 --2- 172.21.15.130:0/2309158831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd98c161140 0x7fd98c15e180 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 --2- 172.21.15.130:0/2309158831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd98c154760 0x7fd98c070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 --2- 172.21.15.130:0/2309158831 >> v2:172.21.15.164:3300/0 conn(0x7fd98c154380 0x7fd98c0b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 -- 172.21.15.130:0/2309158831 >> 172.21.15.130:0/2309158831 conn(0x7fd98c065990 msgr2=0x7fd98c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:36.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 -- 172.21.15.130:0/2309158831 shutdown_connections 2023-09-13T06:01:36.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 -- 172.21.15.130:0/2309158831 wait complete. 2023-09-13T06:01:36.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 Processor -- start 2023-09-13T06:01:36.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 -- start start 2023-09-13T06:01:36.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd98c154380 0x7fd98c159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd98c154760 0x7fd98c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd98c161140 0x7fd98c145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c14d470 con 0x7fd98c154380 2023-09-13T06:01:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c14f880 con 0x7fd98c161140 2023-09-13T06:01:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd9925fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c14ed00 con 0x7fd98c154760 2023-09-13T06:01:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd98bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd98c154380 0x7fd98c159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd98bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd98c154380 0x7fd98c159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48240/0 (socket says 172.21.15.130:48240) 2023-09-13T06:01:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd98bfff640 1 -- 172.21.15.130:0/398578855 learned_addr learned my addr 172.21.15.130:0/398578855 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd990b97640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd98c161140 0x7fd98c145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd98b7fe640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd98c154760 0x7fd98c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd98bfff640 1 -- 172.21.15.130:0/398578855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd98c154760 msgr2=0x7fd98c0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd98bfff640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd98c154760 0x7fd98c0b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd98bfff640 1 -- 172.21.15.130:0/398578855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd98c161140 msgr2=0x7fd98c145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd98bfff640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd98c161140 0x7fd98c145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.664+0000 7fd98bfff640 1 -- 172.21.15.130:0/398578855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd984009b30 con 0x7fd98c154380 2023-09-13T06:01:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd98b7fe640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd98c154760 0x7fd98c0b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:36.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd98bfff640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd98c154380 0x7fd98c159330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c7f0 tx=0x7fd97c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:36.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd988ff9640 1 -- 172.21.15.130:0/398578855 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c007820 con 0x7fd98c154380 2023-09-13T06:01:36.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd988ff9640 1 -- 172.21.15.130:0/398578855 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c007980 con 0x7fd98c154380 2023-09-13T06:01:36.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd988ff9640 1 -- 172.21.15.130:0/398578855 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c007d30 con 0x7fd98c154380 2023-09-13T06:01:36.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd9925fa640 1 -- 172.21.15.130:0/398578855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c14efe0 con 0x7fd98c154380 2023-09-13T06:01:36.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd9925fa640 1 -- 172.21.15.130:0/398578855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c14f5a0 con 0x7fd98c154380 2023-09-13T06:01:36.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd9925fa640 1 -- 172.21.15.130:0/398578855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c14b240 con 0x7fd98c154380 2023-09-13T06:01:36.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd988ff9640 1 -- 172.21.15.130:0/398578855 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd97c0113f0 con 0x7fd98c154380 2023-09-13T06:01:36.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd988ff9640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd978065b20 0x7fd978067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd988ff9640 1 -- 172.21.15.130:0/398578855 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd97c083680 con 0x7fd98c154380 2023-09-13T06:01:36.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd98b7fe640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd978065b20 0x7fd978067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.668+0000 7fd98b7fe640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd978065b20 0x7fd978067fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd98c154350 tx=0x7fd980008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:36.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.672+0000 7fd988ff9640 1 -- 172.21.15.130:0/398578855 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd97c050f50 con 0x7fd98c154380 2023-09-13T06:01:36.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 -- 172.21.15.130:0/398578855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd98c0618a0 con 0x7fd98c154380 2023-09-13T06:01:36.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd988ff9640 1 -- 172.21.15.130:0/398578855 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd97c054570 con 0x7fd98c154380 2023-09-13T06:01:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:01:36.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 -- 172.21.15.130:0/398578855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd978065b20 msgr2=0x7fd978067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd978065b20 0x7fd978067fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd98c154350 tx=0x7fd980008040 comp rx=0 tx=0).stop 2023-09-13T06:01:36.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 -- 172.21.15.130:0/398578855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd98c154380 msgr2=0x7fd98c159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd98c154380 0x7fd98c159330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c7f0 tx=0x7fd97c00ccb0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 -- 172.21.15.130:0/398578855 shutdown_connections 2023-09-13T06:01:36.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd978065b20 0x7fd978067fe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd98c161140 0x7fd98c145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd98c154760 0x7fd98c0b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 --2- 172.21.15.130:0/398578855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd98c154380 0x7fd98c159330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 -- 172.21.15.130:0/398578855 >> 172.21.15.130:0/398578855 conn(0x7fd98c065990 msgr2=0x7fd98c0b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:36.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 -- 172.21.15.130:0/398578855 shutdown_connections 2023-09-13T06:01:36.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.824+0000 7fd9925fa640 1 -- 172.21.15.130:0/398578855 wait complete. 2023-09-13T06:01:36.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:01:36.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.984+0000 7fdfc5c9e640 1 Processor -- start 2023-09-13T06:01:36.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.984+0000 7fdfc5c9e640 1 -- start start 2023-09-13T06:01:36.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfc5c9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfc0144d70 0x7fdfc00ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfc5c9e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdfc00b1b70 0x7fdfc00b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:36.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfc5c9e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc00b3120 con 0x7fdfc00b2780 2023-09-13T06:01:36.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfc5c9e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc00b2430 con 0x7fdfc00b1b70 2023-09-13T06:01:36.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfc5c9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00cedb0 con 0x7fdfc0144d70 2023-09-13T06:01:36.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfbffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdfc00b1b70 0x7fdfc00b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfbffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdfc00b1b70 0x7fdfc00b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48248/0 (socket says 172.21.15.130:48248) 2023-09-13T06:01:36.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfbffff640 1 -- 172.21.15.130:0/1033430012 learned_addr learned my addr 172.21.15.130:0/1033430012 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:36.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfbf7fe640 1 --2- 172.21.15.130:0/1033430012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfc0144d70 0x7fdfc00ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:36.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfbffff640 1 -- 172.21.15.130:0/1033430012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfc0144d70 msgr2=0x7fdfc00ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:36.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfbffff640 1 --2- 172.21.15.130:0/1033430012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfc0144d70 0x7fdfc00ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfbffff640 1 -- 172.21.15.130:0/1033430012 >> v1:172.21.15.164:6789/0 conn(0x7fdfc00b2780 legacy=0x7fdfc00b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:36.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfbffff640 1 -- 172.21.15.130:0/1033430012 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc00b2150 con 0x7fdfc00b1b70 2023-09-13T06:01:36.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.988+0000 7fdfbf7fe640 1 --2- 172.21.15.130:0/1033430012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfc0144d70 0x7fdfc00ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:36.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfbffff640 1 --2- 172.21.15.130:0/1033430012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc00b1b70 0x7fdfc00b2be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009e50 tx=0x7fdfb801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a659c41005499473 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:36.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfbe7fc640 1 -- 172.21.15.130:0/1033430012 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80a5740 con 0x7fdfc00b1b70 2023-09-13T06:01:36.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfbe7fc640 1 -- 172.21.15.130:0/1033430012 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb80a58a0 con 0x7fdfc00b1b70 2023-09-13T06:01:36.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfbe7fc640 1 -- 172.21.15.130:0/1033430012 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80a5c30 con 0x7fdfc00b1b70 2023-09-13T06:01:36.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1033430012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc00b1b70 msgr2=0x7fdfc00b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:36.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfc5c9e640 1 --2- 172.21.15.130:0/1033430012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc00b1b70 0x7fdfc00b2be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009e50 tx=0x7fdfb801c9d0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1033430012 shutdown_connections 2023-09-13T06:01:36.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfc5c9e640 1 --2- 172.21.15.130:0/1033430012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc00b1b70 0x7fdfc00b2be0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfc5c9e640 1 --2- 172.21.15.130:0/1033430012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfc0144d70 0x7fdfc00ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:36.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1033430012 >> 172.21.15.130:0/1033430012 conn(0x7fdfc0065990 msgr2=0x7fdfc0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:36.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1033430012 shutdown_connections 2023-09-13T06:01:36.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1033430012 wait complete. 2023-09-13T06:01:37.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfc5c9e640 1 Processor -- start 2023-09-13T06:01:37.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.992+0000 7fdfc5c9e640 1 -- start start 2023-09-13T06:01:37.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfc5c9e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc00b1b70 0x7fdfc015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfc5c9e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfc00b2780 0x7fdfc006b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfc5c9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfc0144d70 0x7fdfc006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfc5c9e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc015b900 con 0x7fdfc00b1b70 2023-09-13T06:01:37.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfc5c9e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc01393a0 con 0x7fdfc00b2780 2023-09-13T06:01:37.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfc5c9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0139680 con 0x7fdfc0144d70 2023-09-13T06:01:37.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfbf7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc00b1b70 0x7fdfc015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfbf7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc00b1b70 0x7fdfc015dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48254/0 (socket says 172.21.15.130:48254) 2023-09-13T06:01:37.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfbf7fe640 1 -- 172.21.15.130:0/1395102284 learned_addr learned my addr 172.21.15.130:0/1395102284 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:37.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfbeffd640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfc00b2780 0x7fdfc006b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfbffff640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfc0144d70 0x7fdfc006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfbf7fe640 1 -- 172.21.15.130:0/1395102284 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfc0144d70 msgr2=0x7fdfc006b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfbf7fe640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfc0144d70 0x7fdfc006b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfbf7fe640 1 -- 172.21.15.130:0/1395102284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfc00b2780 msgr2=0x7fdfc006b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfbf7fe640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfc00b2780 0x7fdfc006b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfbf7fe640 1 -- 172.21.15.130:0/1395102284 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8009b30 con 0x7fdfc00b1b70 2023-09-13T06:01:37.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfbf7fe640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc00b1b70 0x7fdfc015dd10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c7f0 tx=0x7fdfb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:37.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfa7fff640 1 -- 172.21.15.130:0/1395102284 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0007820 con 0x7fdfc00b1b70 2023-09-13T06:01:37.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfa7fff640 1 -- 172.21.15.130:0/1395102284 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb0007980 con 0x7fdfc00b1b70 2023-09-13T06:01:37.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1395102284 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc0139960 con 0x7fdfc00b1b70 2023-09-13T06:01:37.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfa7fff640 1 -- 172.21.15.130:0/1395102284 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0007d30 con 0x7fdfc00b1b70 2023-09-13T06:01:37.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1395102284 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc0138970 con 0x7fdfc00b1b70 2023-09-13T06:01:37.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1395102284 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc0139ba0 con 0x7fdfc00b1b70 2023-09-13T06:01:37.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:36.996+0000 7fdfa7fff640 1 -- 172.21.15.130:0/1395102284 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdfb00113f0 con 0x7fdfc00b1b70 2023-09-13T06:01:37.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.000+0000 7fdfa7fff640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 0x7fdfac067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.000+0000 7fdfa7fff640 1 -- 172.21.15.130:0/1395102284 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfb00834f0 con 0x7fdfc00b1b70 2023-09-13T06:01:37.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.000+0000 7fdfbeffd640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 0x7fdfac067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.000+0000 7fdfbeffd640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 0x7fdfac067fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00cb4f0 tx=0x7fdfb4007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:37.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.004+0000 7fdfa7fff640 1 -- 172.21.15.130:0/1395102284 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdfb0050f80 con 0x7fdfc00b1b70 2023-09-13T06:01:37.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.152+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1395102284 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdfc00618a0 con 0x7fdfc00b1b70 2023-09-13T06:01:37.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.152+0000 7fdfa7fff640 1 -- 172.21.15.130:0/1395102284 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdfb00545a0 con 0x7fdfc00b1b70 2023-09-13T06:01:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:01:37.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1395102284 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 msgr2=0x7fdfac067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 0x7fdfac067fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00cb4f0 tx=0x7fdfb4007e40 comp rx=0 tx=0).stop 2023-09-13T06:01:37.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1395102284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc00b1b70 msgr2=0x7fdfc015dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc00b1b70 0x7fdfc015dd10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c7f0 tx=0x7fdfb000ccb0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1395102284 shutdown_connections 2023-09-13T06:01:37.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 0x7fdfac067fe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfc00b2780 0x7fdfc006b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfc0144d70 0x7fdfc006b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 --2- 172.21.15.130:0/1395102284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc00b1b70 0x7fdfc015dd10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1395102284 >> 172.21.15.130:0/1395102284 conn(0x7fdfc0065990 msgr2=0x7fdfc015b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:37.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1395102284 shutdown_connections 2023-09-13T06:01:37.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.156+0000 7fdfc5c9e640 1 -- 172.21.15.130:0/1395102284 wait complete. 2023-09-13T06:01:37.179 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:01:37.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6b1b96640 1 Processor -- start 2023-09-13T06:01:37.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6b1b96640 1 -- start start 2023-09-13T06:01:37.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6b1b96640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd6ac15b130 0x7fd6ac0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6b1b96640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac0ce180 0x7fd6ac15b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6b1b96640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd6ac0b04a0 0x7fd6ac0b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6b1b96640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac0b0e70 con 0x7fd6ac15b130 2023-09-13T06:01:37.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6b1b96640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac0ce980 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6b1b96640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0cec60 con 0x7fd6ac0ce180 2023-09-13T06:01:37.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6ab7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd6ac15b130 0x7fd6ac0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6ab7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd6ac15b130 0x7fd6ac0cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48258/0 (socket says 172.21.15.130:48258) 2023-09-13T06:01:37.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6ab7fe640 1 -- 172.21.15.130:0/340343581 learned_addr learned my addr 172.21.15.130:0/340343581 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:37.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6abfff640 1 --2- 172.21.15.130:0/340343581 >> v2:172.21.15.164:3300/0 conn(0x7fd6ac0b04a0 0x7fd6ac0b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6aaffd640 1 --2- 172.21.15.130:0/340343581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac0ce180 0x7fd6ac15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6ab7fe640 1 -- 172.21.15.130:0/340343581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac0ce180 msgr2=0x7fd6ac15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:37.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6ab7fe640 1 --2- 172.21.15.130:0/340343581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac0ce180 0x7fd6ac15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6ab7fe640 1 -- 172.21.15.130:0/340343581 >> v2:172.21.15.164:3300/0 conn(0x7fd6ac0b04a0 msgr2=0x7fd6ac0b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:37.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6ab7fe640 1 --2- 172.21.15.130:0/340343581 >> v2:172.21.15.164:3300/0 conn(0x7fd6ac0b04a0 0x7fd6ac0b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6ab7fe640 1 -- 172.21.15.130:0/340343581 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac06c640 con 0x7fd6ac15b130 2023-09-13T06:01:37.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.316+0000 7fd6aaffd640 1 --2- 172.21.15.130:0/340343581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac0ce180 0x7fd6ac15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:37.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6ab7fe640 1 --2- 172.21.15.130:0/340343581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6ac15b130 0x7fd6ac0cc780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0cce60 tx=0x7fd69c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a06aeec317254af server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:37.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6aa7fc640 1 -- 172.21.15.130:0/340343581 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0aa620 con 0x7fd6ac15b130 2023-09-13T06:01:37.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6aa7fc640 1 -- 172.21.15.130:0/340343581 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c0aa780 con 0x7fd6ac15b130 2023-09-13T06:01:37.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6aa7fc640 1 -- 172.21.15.130:0/340343581 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0aab10 con 0x7fd6ac15b130 2023-09-13T06:01:37.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6b1b96640 1 -- 172.21.15.130:0/340343581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6ac15b130 msgr2=0x7fd6ac0cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6b1b96640 1 --2- 172.21.15.130:0/340343581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6ac15b130 0x7fd6ac0cc780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0cce60 tx=0x7fd69c01c500 comp rx=0 tx=0).stop 2023-09-13T06:01:37.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6b1b96640 1 -- 172.21.15.130:0/340343581 shutdown_connections 2023-09-13T06:01:37.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6b1b96640 1 --2- 172.21.15.130:0/340343581 >> v2:172.21.15.164:3300/0 conn(0x7fd6ac0b04a0 0x7fd6ac0b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6b1b96640 1 --2- 172.21.15.130:0/340343581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac0ce180 0x7fd6ac15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6b1b96640 1 --2- 172.21.15.130:0/340343581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6ac15b130 0x7fd6ac0cc780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6b1b96640 1 -- 172.21.15.130:0/340343581 >> 172.21.15.130:0/340343581 conn(0x7fd6ac065990 msgr2=0x7fd6ac065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:37.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6b1b96640 1 -- 172.21.15.130:0/340343581 shutdown_connections 2023-09-13T06:01:37.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.320+0000 7fd6b1b96640 1 -- 172.21.15.130:0/340343581 wait complete. 2023-09-13T06:01:37.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6b1b96640 1 Processor -- start 2023-09-13T06:01:37.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6b1b96640 1 -- start start 2023-09-13T06:01:37.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6b1b96640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6ac0b04a0 0x7fd6ac0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6b1b96640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6ac0ce180 0x7fd6ac0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6b1b96640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac15b130 0x7fd6ac15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6b1b96640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0afd20 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6b1b96640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0cb750 con 0x7fd6ac0ce180 2023-09-13T06:01:37.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6b1b96640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac14b4d0 con 0x7fd6ac15b130 2023-09-13T06:01:37.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6ab7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6ac0b04a0 0x7fd6ac0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6ab7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6ac0b04a0 0x7fd6ac0cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48266/0 (socket says 172.21.15.130:48266) 2023-09-13T06:01:37.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6ab7fe640 1 -- 172.21.15.130:0/3007528906 learned_addr learned my addr 172.21.15.130:0/3007528906 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:37.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6aaffd640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6ac0ce180 0x7fd6ac0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6abfff640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac15b130 0x7fd6ac15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6ab7fe640 1 -- 172.21.15.130:0/3007528906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac15b130 msgr2=0x7fd6ac15c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6ab7fe640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac15b130 0x7fd6ac15c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6ab7fe640 1 -- 172.21.15.130:0/3007528906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6ac0ce180 msgr2=0x7fd6ac0aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6ab7fe640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6ac0ce180 0x7fd6ac0aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6ab7fe640 1 -- 172.21.15.130:0/3007528906 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c0094d0 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6abfff640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac15b130 0x7fd6ac15c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:37.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6ab7fe640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6ac0b04a0 0x7fd6ac0cb210 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0ac040 tx=0x7fd69c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:37.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd693fff640 1 -- 172.21.15.130:0/3007528906 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0aae80 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd693fff640 1 -- 172.21.15.130:0/3007528906 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c0bd3f0 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd693fff640 1 -- 172.21.15.130:0/3007528906 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0bd7a0 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6b1b96640 1 -- 172.21.15.130:0/3007528906 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac15d070 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.324+0000 7fd6b1b96640 1 -- 172.21.15.130:0/3007528906 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac0af480 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.328+0000 7fd6b1b96640 1 -- 172.21.15.130:0/3007528906 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac0618a0 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.328+0000 7fd693fff640 1 -- 172.21.15.130:0/3007528906 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd69c0b33f0 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.328+0000 7fd693fff640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd698065b50 0x7fd698068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.328+0000 7fd693fff640 1 -- 172.21.15.130:0/3007528906 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd69c11d4b0 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.328+0000 7fd6aaffd640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd698065b50 0x7fd698068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.328+0000 7fd6aaffd640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd698065b50 0x7fd698068010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0cc1e0 tx=0x7fd6a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:37.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.332+0000 7fd693fff640 1 -- 172.21.15.130:0/3007528906 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd69c0eafc0 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.508+0000 7fd6b1b96640 1 -- 172.21.15.130:0/3007528906 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6ac0cbf30 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd693fff640 1 -- 172.21.15.130:0/3007528906 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fd69c0ee5e0 con 0x7fd6ac0b04a0 2023-09-13T06:01:37.515 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:37.515 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1779716448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1779716448},{"type":"v1","addr":"172.21.15.130:6837","nonce":1779716448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1022199494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":1022199494},{"type":"v1","addr":"172.21.15.164:6835","nonce":1022199494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3130227261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3130227261},{"type":"v1","addr":"172.21.15.164:6834","nonce":3130227261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:01:25.693319+0000","modified":"2023-09-13T06:01:28.718115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/660561895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":660561895},{"type":"v1","addr":"172.21.15.130:6836","nonce":660561895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T06:01:37.516 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 7 2023-09-13T06:01:37.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 -- 172.21.15.130:0/3007528906 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd698065b50 msgr2=0x7fd698068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd698065b50 0x7fd698068010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0cc1e0 tx=0x7fd6a0008040 comp rx=0 tx=0).stop 2023-09-13T06:01:37.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 -- 172.21.15.130:0/3007528906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6ac0b04a0 msgr2=0x7fd6ac0cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6ac0b04a0 0x7fd6ac0cb210 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0ac040 tx=0x7fd69c01ad40 comp rx=0 tx=0).stop 2023-09-13T06:01:37.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 -- 172.21.15.130:0/3007528906 shutdown_connections 2023-09-13T06:01:37.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd698065b50 0x7fd698068010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6ac0ce180 0x7fd6ac0aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6ac15b130 0x7fd6ac15c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 --2- 172.21.15.130:0/3007528906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6ac0b04a0 0x7fd6ac0cb210 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 -- 172.21.15.130:0/3007528906 >> 172.21.15.130:0/3007528906 conn(0x7fd6ac065990 msgr2=0x7fd6ac0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:37.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 -- 172.21.15.130:0/3007528906 shutdown_connections 2023-09-13T06:01:37.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.512+0000 7fd6b1b96640 1 -- 172.21.15.130:0/3007528906 wait complete. 2023-09-13T06:01:37.536 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:37.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b9889e640 1 Processor -- start 2023-09-13T06:01:37.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b9889e640 1 -- start start 2023-09-13T06:01:37.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b9889e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b941436e0 0x7f7b940ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b9889e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7b940acd80 0x7f7b94070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b9889e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7b94146540 0x7f7b94070b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b9889e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9406f640 con 0x7f7b940acd80 2023-09-13T06:01:37.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b9889e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9406f890 con 0x7f7b94146540 2023-09-13T06:01:37.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b9889e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9406fb70 con 0x7f7b941436e0 2023-09-13T06:01:37.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b91d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7b940acd80 0x7f7b94070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b91d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7b940acd80 0x7f7b94070650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48272/0 (socket says 172.21.15.130:48272) 2023-09-13T06:01:37.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b91d9b640 1 -- 172.21.15.130:0/370590295 learned_addr learned my addr 172.21.15.130:0/370590295 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:37.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b9259c640 1 --2- 172.21.15.130:0/370590295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b941436e0 0x7f7b940ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b92d9d640 1 --2- 172.21.15.130:0/370590295 >> v2:172.21.15.164:3300/0 conn(0x7f7b94146540 0x7f7b94070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b91d9b640 1 -- 172.21.15.130:0/370590295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b941436e0 msgr2=0x7f7b940ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:37.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b91d9b640 1 --2- 172.21.15.130:0/370590295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b941436e0 0x7f7b940ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b91d9b640 1 -- 172.21.15.130:0/370590295 >> v2:172.21.15.164:3300/0 conn(0x7f7b94146540 msgr2=0x7f7b94070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:37.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b91d9b640 1 --2- 172.21.15.130:0/370590295 >> v2:172.21.15.164:3300/0 conn(0x7f7b94146540 0x7f7b94070b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b91d9b640 1 -- 172.21.15.130:0/370590295 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9406fe50 con 0x7f7b940acd80 2023-09-13T06:01:37.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.672+0000 7f7b92d9d640 1 --2- 172.21.15.130:0/370590295 >> v2:172.21.15.164:3300/0 conn(0x7f7b94146540 0x7f7b94070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:37.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b91d9b640 1 --2- 172.21.15.130:0/370590295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b940acd80 0x7f7b94070650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7b9406bd60 tx=0x7f7b7c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e795e6dea6d596 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:37.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9159a640 1 -- 172.21.15.130:0/370590295 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b94146e10 con 0x7f7b940acd80 2023-09-13T06:01:37.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9159a640 1 -- 172.21.15.130:0/370590295 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c0a7050 con 0x7f7b940acd80 2023-09-13T06:01:37.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9159a640 1 -- 172.21.15.130:0/370590295 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c0ab820 con 0x7f7b940acd80 2023-09-13T06:01:37.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9889e640 1 -- 172.21.15.130:0/370590295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b940acd80 msgr2=0x7f7b94070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9889e640 1 --2- 172.21.15.130:0/370590295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b940acd80 0x7f7b94070650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7b9406bd60 tx=0x7f7b7c01c3e0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9889e640 1 -- 172.21.15.130:0/370590295 shutdown_connections 2023-09-13T06:01:37.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9889e640 1 --2- 172.21.15.130:0/370590295 >> v2:172.21.15.164:3300/0 conn(0x7f7b94146540 0x7f7b94070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9889e640 1 --2- 172.21.15.130:0/370590295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b940acd80 0x7f7b94070650 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9889e640 1 --2- 172.21.15.130:0/370590295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b941436e0 0x7f7b940ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9889e640 1 -- 172.21.15.130:0/370590295 >> 172.21.15.130:0/370590295 conn(0x7f7b940b0bc0 msgr2=0x7f7b940b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:37.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9889e640 1 -- 172.21.15.130:0/370590295 shutdown_connections 2023-09-13T06:01:37.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.676+0000 7f7b9889e640 1 -- 172.21.15.130:0/370590295 wait complete. 2023-09-13T06:01:37.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b9889e640 1 Processor -- start 2023-09-13T06:01:37.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b9889e640 1 -- start start 2023-09-13T06:01:37.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b9889e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b940acd80 0x7f7b9415da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b9889e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b941436e0 0x7f7b9415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b9889e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b94146540 0x7f7b941629c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b9889e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9415d0b0 con 0x7f7b941436e0 2023-09-13T06:01:37.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b9889e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94162f00 con 0x7f7b940acd80 2023-09-13T06:01:37.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b9889e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b941631d0 con 0x7f7b94146540 2023-09-13T06:01:37.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b91d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b941436e0 0x7f7b9415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b91d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b941436e0 0x7f7b9415cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48276/0 (socket says 172.21.15.130:48276) 2023-09-13T06:01:37.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b91d9b640 1 -- 172.21.15.130:0/3698386638 learned_addr learned my addr 172.21.15.130:0/3698386638 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:37.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b9259c640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b940acd80 0x7f7b9415da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b92d9d640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b94146540 0x7f7b941629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b91d9b640 1 -- 172.21.15.130:0/3698386638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b94146540 msgr2=0x7f7b941629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b91d9b640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b94146540 0x7f7b941629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b91d9b640 1 -- 172.21.15.130:0/3698386638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b940acd80 msgr2=0x7f7b9415da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b91d9b640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b940acd80 0x7f7b9415da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b91d9b640 1 -- 172.21.15.130:0/3698386638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c0094d0 con 0x7f7b941436e0 2023-09-13T06:01:37.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b91d9b640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b941436e0 0x7f7b9415cb70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c01aa90 tx=0x7f7b7c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:37.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b8affd640 1 -- 172.21.15.130:0/3698386638 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c0b37d0 con 0x7f7b941436e0 2023-09-13T06:01:37.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b8affd640 1 -- 172.21.15.130:0/3698386638 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c0b3930 con 0x7f7b941436e0 2023-09-13T06:01:37.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b8affd640 1 -- 172.21.15.130:0/3698386638 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c0b3ca0 con 0x7f7b941436e0 2023-09-13T06:01:37.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b9889e640 1 -- 172.21.15.130:0/3698386638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b94165c90 con 0x7f7b941436e0 2023-09-13T06:01:37.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.680+0000 7f7b9889e640 1 -- 172.21.15.130:0/3698386638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b94166250 con 0x7f7b941436e0 2023-09-13T06:01:37.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.684+0000 7f7b9889e640 1 -- 172.21.15.130:0/3698386638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b940618a0 con 0x7f7b941436e0 2023-09-13T06:01:37.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.684+0000 7f7b8affd640 1 -- 172.21.15.130:0/3698386638 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7b7c0b2070 con 0x7f7b941436e0 2023-09-13T06:01:37.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.684+0000 7f7b8affd640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b74065b20 0x7f7b74067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:37.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.684+0000 7f7b8affd640 1 -- 172.21.15.130:0/3698386638 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b7c11d5d0 con 0x7f7b941436e0 2023-09-13T06:01:37.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.684+0000 7f7b9259c640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b74065b20 0x7f7b74067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:37.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.684+0000 7f7b9259c640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b74065b20 0x7f7b74067fe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b9413da20 tx=0x7f7b84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:37.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.688+0000 7f7b8affd640 1 -- 172.21.15.130:0/3698386638 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7b7c0eae00 con 0x7f7b941436e0 2023-09-13T06:01:37.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.840+0000 7f7b9889e640 1 -- 172.21.15.130:0/3698386638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b94166440 con 0x7f7b941436e0 2023-09-13T06:01:37.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b8affd640 1 -- 172.21.15.130:0/3698386638 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f7b7c0ee420 con 0x7f7b941436e0 2023-09-13T06:01:37.847 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:37.848 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:37.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 -- 172.21.15.130:0/3698386638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b74065b20 msgr2=0x7f7b74067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b74065b20 0x7f7b74067fe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b9413da20 tx=0x7f7b84008040 comp rx=0 tx=0).stop 2023-09-13T06:01:37.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 -- 172.21.15.130:0/3698386638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b941436e0 msgr2=0x7f7b9415cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:37.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b941436e0 0x7f7b9415cb70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c01aa90 tx=0x7f7b7c019180 comp rx=0 tx=0).stop 2023-09-13T06:01:37.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 -- 172.21.15.130:0/3698386638 shutdown_connections 2023-09-13T06:01:37.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b74065b20 0x7f7b74067fe0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b94146540 0x7f7b941629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b941436e0 0x7f7b9415cb70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 --2- 172.21.15.130:0/3698386638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b940acd80 0x7f7b9415da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:37.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 -- 172.21.15.130:0/3698386638 >> 172.21.15.130:0/3698386638 conn(0x7f7b940b0bc0 msgr2=0x7f7b94145e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:37.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 -- 172.21.15.130:0/3698386638 shutdown_connections 2023-09-13T06:01:37.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:37.844+0000 7f7b9889e640 1 -- 172.21.15.130:0/3698386638 wait complete. 2023-09-13T06:01:37.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:01:37.869 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:01:38.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7bb5219640 1 Processor -- start 2023-09-13T06:01:38.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7bb5219640 1 -- start start 2023-09-13T06:01:38.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7bb5219640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0157750 0x7f7bb0160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7bb5219640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7bb0157b30 0x7f7bb006dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7bb5219640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7bb006f170 0x7f7bb006f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7bb5219640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb00ae0d0 con 0x7f7bb0157b30 2023-09-13T06:01:38.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7bb5219640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb0161e60 con 0x7f7bb006f170 2023-09-13T06:01:38.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7bb5219640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb01615c0 con 0x7f7bb0157750 2023-09-13T06:01:38.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7ba659c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7bb0157b30 0x7f7bb006dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7ba659c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7bb0157b30 0x7f7bb006dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48284/0 (socket says 172.21.15.130:48284) 2023-09-13T06:01:38.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7ba659c640 1 -- 172.21.15.130:0/1711885572 learned_addr learned my addr 172.21.15.130:0/1711885572 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:38.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7ba659c640 1 -- 172.21.15.130:0/1711885572 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0157750 msgr2=0x7f7bb0160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:38.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7baed9d640 1 --2- 172.21.15.130:0/1711885572 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0157750 0x7f7bb0160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7baf59e640 1 --2- 172.21.15.130:0/1711885572 >> v2:172.21.15.164:3300/0 conn(0x7f7bb006f170 0x7f7bb006f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.004+0000 7f7ba659c640 1 --2- 172.21.15.130:0/1711885572 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0157750 0x7f7bb0160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7ba659c640 1 -- 172.21.15.130:0/1711885572 >> v2:172.21.15.164:3300/0 conn(0x7f7bb006f170 msgr2=0x7f7bb006f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:38.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7ba659c640 1 --2- 172.21.15.130:0/1711885572 >> v2:172.21.15.164:3300/0 conn(0x7f7bb006f170 0x7f7bb006f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7ba659c640 1 -- 172.21.15.130:0/1711885572 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb01618a0 con 0x7f7bb0157b30 2023-09-13T06:01:38.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7baf59e640 1 --2- 172.21.15.130:0/1711885572 >> v2:172.21.15.164:3300/0 conn(0x7f7bb006f170 0x7f7bb006f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:38.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7baed9d640 1 --2- 172.21.15.130:0/1711885572 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0157750 0x7f7bb0160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:38.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7ba659c640 1 --2- 172.21.15.130:0/1711885572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb0157b30 0x7f7bb006dba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00ae8a0 tx=0x7f7b9801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597a25785e7ce0b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:38.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bae59c640 1 -- 172.21.15.130:0/1711885572 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980aa5f0 con 0x7f7bb0157b30 2023-09-13T06:01:38.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bae59c640 1 -- 172.21.15.130:0/1711885572 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b980aa750 con 0x7f7bb0157b30 2023-09-13T06:01:38.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bae59c640 1 -- 172.21.15.130:0/1711885572 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980aaae0 con 0x7f7bb0157b30 2023-09-13T06:01:38.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bb5219640 1 -- 172.21.15.130:0/1711885572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb0157b30 msgr2=0x7f7bb006dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bb5219640 1 --2- 172.21.15.130:0/1711885572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb0157b30 0x7f7bb006dba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00ae8a0 tx=0x7f7b9801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bb5219640 1 -- 172.21.15.130:0/1711885572 shutdown_connections 2023-09-13T06:01:38.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bb5219640 1 --2- 172.21.15.130:0/1711885572 >> v2:172.21.15.164:3300/0 conn(0x7f7bb006f170 0x7f7bb006f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bb5219640 1 --2- 172.21.15.130:0/1711885572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb0157b30 0x7f7bb006dba0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bb5219640 1 --2- 172.21.15.130:0/1711885572 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0157750 0x7f7bb0160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bb5219640 1 -- 172.21.15.130:0/1711885572 >> 172.21.15.130:0/1711885572 conn(0x7f7bb0065d60 msgr2=0x7f7bb00b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:38.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bb5219640 1 -- 172.21.15.130:0/1711885572 shutdown_connections 2023-09-13T06:01:38.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.008+0000 7f7bb5219640 1 -- 172.21.15.130:0/1711885572 wait complete. 2023-09-13T06:01:38.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7bb5219640 1 Processor -- start 2023-09-13T06:01:38.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7bb5219640 1 -- start start 2023-09-13T06:01:38.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7bb5219640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb006f170 0x7f7bb0155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7bb5219640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0157750 0x7f7bb00cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7bb5219640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb0157b30 0x7f7bb0155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7bb5219640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb01552f0 con 0x7f7bb006f170 2023-09-13T06:01:38.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7bb5219640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0155c50 con 0x7f7bb0157b30 2023-09-13T06:01:38.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7bb5219640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0154950 con 0x7f7bb0157750 2023-09-13T06:01:38.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7baed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb006f170 0x7f7bb0155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7baed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb006f170 0x7f7bb0155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48288/0 (socket says 172.21.15.130:48288) 2023-09-13T06:01:38.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7baed9d640 1 -- 172.21.15.130:0/1076855208 learned_addr learned my addr 172.21.15.130:0/1076855208 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:38.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7ba659c640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0157750 0x7f7bb00cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7baf59e640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb0157b30 0x7f7bb0155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7baed9d640 1 -- 172.21.15.130:0/1076855208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0157750 msgr2=0x7f7bb00cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7baed9d640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0157750 0x7f7bb00cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7baed9d640 1 -- 172.21.15.130:0/1076855208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb0157b30 msgr2=0x7f7bb0155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7baed9d640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb0157b30 0x7f7bb0155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7baed9d640 1 -- 172.21.15.130:0/1076855208 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980094d0 con 0x7f7bb006f170 2023-09-13T06:01:38.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.012+0000 7f7baed9d640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb006f170 0x7f7bb0155710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c7f0 tx=0x7f7ba000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:38.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.016+0000 7f7ba7fff640 1 -- 172.21.15.130:0/1076855208 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba000cea0 con 0x7f7bb006f170 2023-09-13T06:01:38.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.016+0000 7f7ba7fff640 1 -- 172.21.15.130:0/1076855208 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba0007a30 con 0x7f7bb006f170 2023-09-13T06:01:38.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.016+0000 7f7bb5219640 1 -- 172.21.15.130:0/1076855208 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb0154c30 con 0x7f7bb006f170 2023-09-13T06:01:38.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.016+0000 7f7ba7fff640 1 -- 172.21.15.130:0/1076855208 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0007de0 con 0x7f7bb006f170 2023-09-13T06:01:38.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.016+0000 7f7bb5219640 1 -- 172.21.15.130:0/1076855208 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb00ac3f0 con 0x7f7bb006f170 2023-09-13T06:01:38.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.016+0000 7f7bb5219640 1 -- 172.21.15.130:0/1076855208 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb0155430 con 0x7f7bb006f170 2023-09-13T06:01:38.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.016+0000 7f7ba7fff640 1 -- 172.21.15.130:0/1076855208 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7ba00113f0 con 0x7f7bb006f170 2023-09-13T06:01:38.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.016+0000 7f7ba7fff640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b90065b20 0x7f7b90067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.016+0000 7f7ba7fff640 1 -- 172.21.15.130:0/1076855208 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ba0083350 con 0x7f7bb006f170 2023-09-13T06:01:38.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.016+0000 7f7ba659c640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b90065b20 0x7f7b90067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.020+0000 7f7ba659c640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b90065b20 0x7f7b90067fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b980ae000 tx=0x7f7b980b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:38.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.020+0000 7f7ba7fff640 1 -- 172.21.15.130:0/1076855208 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7bb0155430 con 0x7f7bb006f170 2023-09-13T06:01:38.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.168+0000 7f7bb5219640 1 -- 172.21.15.130:0/1076855208 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7bb0155430 con 0x7f7bb006f170 2023-09-13T06:01:38.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.168+0000 7f7ba7fff640 1 -- 172.21.15.130:0/1076855208 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7bb0155430 con 0x7f7bb006f170 2023-09-13T06:01:38.174 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:01:38.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 -- 172.21.15.130:0/1076855208 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b90065b20 msgr2=0x7f7b90067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b90065b20 0x7f7b90067fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b980ae000 tx=0x7f7b980b5040 comp rx=0 tx=0).stop 2023-09-13T06:01:38.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 -- 172.21.15.130:0/1076855208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb006f170 msgr2=0x7f7bb0155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb006f170 0x7f7bb0155710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c7f0 tx=0x7f7ba000ccb0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 -- 172.21.15.130:0/1076855208 shutdown_connections 2023-09-13T06:01:38.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b90065b20 0x7f7b90067fe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb0157b30 0x7f7bb0155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0157750 0x7f7bb00cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 --2- 172.21.15.130:0/1076855208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb006f170 0x7f7bb0155710 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 -- 172.21.15.130:0/1076855208 >> 172.21.15.130:0/1076855208 conn(0x7f7bb0065d60 msgr2=0x7f7bb0156cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:38.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 -- 172.21.15.130:0/1076855208 shutdown_connections 2023-09-13T06:01:38.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.172+0000 7f7bb5219640 1 -- 172.21.15.130:0/1076855208 wait complete. 2023-09-13T06:01:38.195 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:01:38.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.332+0000 7f00afc48640 1 Processor -- start 2023-09-13T06:01:38.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.332+0000 7f00afc48640 1 -- start start 2023-09-13T06:01:38.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.332+0000 7f00afc48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00a815a080 0x7f00a80b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.332+0000 7f00afc48640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f00a80b31a0 0x7f00a80ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.332+0000 7f00afc48640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a80cc850 con 0x7f00a815e650 2023-09-13T06:01:38.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.332+0000 7f00afc48640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a80b0330 con 0x7f00a80b31a0 2023-09-13T06:01:38.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.332+0000 7f00afc48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80cbcd0 con 0x7f00a815a080 2023-09-13T06:01:38.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.332+0000 7f00ae1e5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f00a80b31a0 0x7f00a80ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.332+0000 7f00ad1e3640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f00a815e650 0x7f00a80b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55894/0 (socket says 172.21.15.130:55894) 2023-09-13T06:01:38.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.332+0000 7f00ad1e3640 1 -- 172.21.15.130:0/181296729 learned_addr learned my addr 172.21.15.130:0/181296729 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:38.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.332+0000 7f00ad9e4640 1 --2- 172.21.15.130:0/181296729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00a815a080 0x7f00a80b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.336+0000 7f00ae1e5640 1 -- 172.21.15.130:0/181296729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00a815a080 msgr2=0x7f00a80b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:38.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.336+0000 7f00ae1e5640 1 --2- 172.21.15.130:0/181296729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00a815a080 0x7f00a80b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.336+0000 7f00ae1e5640 1 -- 172.21.15.130:0/181296729 >> v1:172.21.15.130:6789/0 conn(0x7f00a815e650 legacy=0x7f00a80b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.336+0000 7f00ae1e5640 1 -- 172.21.15.130:0/181296729 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a80cbfb0 con 0x7f00a80b31a0 2023-09-13T06:01:38.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.336+0000 7f00ac9e2640 1 -- 172.21.15.130:0/181296729 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571366868 0 0) 0x7f0098001120 con 0x7f00a815e650 2023-09-13T06:01:38.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.336+0000 7f00ae1e5640 1 --2- 172.21.15.130:0/181296729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a80b31a0 0x7f00a80ccfe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009d90 tx=0x7f00a001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f97637bd9abfa5f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:38.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.336+0000 7f00ac9e2640 1 -- 172.21.15.130:0/181296729 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a00a5750 con 0x7f00a80b31a0 2023-09-13T06:01:38.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.336+0000 7f00ac9e2640 1 -- 172.21.15.130:0/181296729 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a00a58b0 con 0x7f00a80b31a0 2023-09-13T06:01:38.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.336+0000 7f00ac9e2640 1 -- 172.21.15.130:0/181296729 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a00a5c40 con 0x7f00a80b31a0 2023-09-13T06:01:38.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.336+0000 7f00afc48640 1 -- 172.21.15.130:0/181296729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a80b31a0 msgr2=0x7f00a80ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.336+0000 7f00afc48640 1 --2- 172.21.15.130:0/181296729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a80b31a0 0x7f00a80ccfe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009d90 tx=0x7f00a001c890 comp rx=0 tx=0).stop 2023-09-13T06:01:38.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 -- 172.21.15.130:0/181296729 shutdown_connections 2023-09-13T06:01:38.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 --2- 172.21.15.130:0/181296729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a80b31a0 0x7f00a80ccfe0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 --2- 172.21.15.130:0/181296729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00a815a080 0x7f00a80b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 -- 172.21.15.130:0/181296729 >> 172.21.15.130:0/181296729 conn(0x7f00a8065990 msgr2=0x7f00a8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:38.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 -- 172.21.15.130:0/181296729 shutdown_connections 2023-09-13T06:01:38.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 -- 172.21.15.130:0/181296729 wait complete. 2023-09-13T06:01:38.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 Processor -- start 2023-09-13T06:01:38.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 -- start start 2023-09-13T06:01:38.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00a80b31a0 0x7f00a81439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a815a080 0x7f00a81556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00a815e650 0x7f00a80ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a8143f10 con 0x7f00a815a080 2023-09-13T06:01:38.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a81536f0 con 0x7f00a80b31a0 2023-09-13T06:01:38.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00afc48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a81539d0 con 0x7f00a815e650 2023-09-13T06:01:38.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00ad1e3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a815a080 0x7f00a81556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00ad1e3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a815a080 0x7f00a81556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48308/0 (socket says 172.21.15.130:48308) 2023-09-13T06:01:38.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00ad1e3640 1 -- 172.21.15.130:0/1183100311 learned_addr learned my addr 172.21.15.130:0/1183100311 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:38.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00ad9e4640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00a80b31a0 0x7f00a81439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00ae1e5640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00a815e650 0x7f00a80ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00ad1e3640 1 -- 172.21.15.130:0/1183100311 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00a815e650 msgr2=0x7f00a80ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00ad1e3640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00a815e650 0x7f00a80ab4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00ad1e3640 1 -- 172.21.15.130:0/1183100311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00a80b31a0 msgr2=0x7f00a81439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00ad1e3640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00a80b31a0 0x7f00a81439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00ad1e3640 1 -- 172.21.15.130:0/1183100311 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0009a70 con 0x7f00a815a080 2023-09-13T06:01:38.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.340+0000 7f00ad1e3640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a815a080 0x7f00a81556c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0098007fd0 tx=0x7f009800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:38.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.344+0000 7f009e7fc640 1 -- 172.21.15.130:0/1183100311 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098005cf0 con 0x7f00a815a080 2023-09-13T06:01:38.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.344+0000 7f009e7fc640 1 -- 172.21.15.130:0/1183100311 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0098005e70 con 0x7f00a815a080 2023-09-13T06:01:38.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.344+0000 7f009e7fc640 1 -- 172.21.15.130:0/1183100311 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00980072f0 con 0x7f00a815a080 2023-09-13T06:01:38.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.344+0000 7f00afc48640 1 -- 172.21.15.130:0/1183100311 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a8153cb0 con 0x7f00a815a080 2023-09-13T06:01:38.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.344+0000 7f00afc48640 1 -- 172.21.15.130:0/1183100311 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a8154270 con 0x7f00a815a080 2023-09-13T06:01:38.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.344+0000 7f00afc48640 1 -- 172.21.15.130:0/1183100311 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a80618a0 con 0x7f00a815a080 2023-09-13T06:01:38.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.344+0000 7f009e7fc640 1 -- 172.21.15.130:0/1183100311 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0098007450 con 0x7f00a815a080 2023-09-13T06:01:38.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.344+0000 7f009e7fc640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f008c069f30 0x7f008c06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.344+0000 7f009e7fc640 1 -- 172.21.15.130:0/1183100311 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0098082750 con 0x7f00a815a080 2023-09-13T06:01:38.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.344+0000 7f00ad9e4640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f008c069f30 0x7f008c06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.344+0000 7f00ad9e4640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f008c069f30 0x7f008c06c3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009b60 tx=0x7f00a4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:38.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.348+0000 7f009e7fc640 1 -- 172.21.15.130:0/1183100311 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f00980500b0 con 0x7f00a815a080 2023-09-13T06:01:38.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.496+0000 7f00afc48640 1 -- 172.21.15.130:0/1183100311 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00a80cc850 con 0x7f00a815a080 2023-09-13T06:01:38.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.496+0000 7f009e7fc640 1 -- 172.21.15.130:0/1183100311 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00a80cc850 con 0x7f00a815a080 2023-09-13T06:01:38.501 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:01:38.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 -- 172.21.15.130:0/1183100311 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f008c069f30 msgr2=0x7f008c06c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f008c069f30 0x7f008c06c3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009b60 tx=0x7f00a4009190 comp rx=0 tx=0).stop 2023-09-13T06:01:38.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 -- 172.21.15.130:0/1183100311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a815a080 msgr2=0x7f00a81556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a815a080 0x7f00a81556c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0098007fd0 tx=0x7f009800c8e0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 -- 172.21.15.130:0/1183100311 shutdown_connections 2023-09-13T06:01:38.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f008c069f30 0x7f008c06c3f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00a815e650 0x7f00a80ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a815a080 0x7f00a81556c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 --2- 172.21.15.130:0/1183100311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00a80b31a0 0x7f00a81439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 -- 172.21.15.130:0/1183100311 >> 172.21.15.130:0/1183100311 conn(0x7f00a8065990 msgr2=0x7f00a80af420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:38.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 -- 172.21.15.130:0/1183100311 shutdown_connections 2023-09-13T06:01:38.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.500+0000 7f00afc48640 1 -- 172.21.15.130:0/1183100311 wait complete. 2023-09-13T06:01:38.521 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:01:38.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.660+0000 7efc760d8640 1 Processor -- start 2023-09-13T06:01:38.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.660+0000 7efc760d8640 1 -- start start 2023-09-13T06:01:38.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc760d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efc70154380 0x7efc700b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc760d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efc70154760 0x7efc70070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc760d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc700b2690 con 0x7efc70161140 2023-09-13T06:01:38.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc760d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc70161700 con 0x7efc70154760 2023-09-13T06:01:38.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc760d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc701619e0 con 0x7efc70154380 2023-09-13T06:01:38.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc6effd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efc70154760 0x7efc70070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc6ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7efc70161140 0x7efc7015e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55902/0 (socket says 172.21.15.130:55902) 2023-09-13T06:01:38.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc6ffff640 1 -- 172.21.15.130:0/2569976035 learned_addr learned my addr 172.21.15.130:0/2569976035 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:38.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc6f7fe640 1 --2- 172.21.15.130:0/2569976035 >> v2:172.21.15.164:3300/0 conn(0x7efc70154380 0x7efc700b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc6effd640 1 -- 172.21.15.130:0/2569976035 >> v2:172.21.15.164:3300/0 conn(0x7efc70154380 msgr2=0x7efc700b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:38.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc6effd640 1 --2- 172.21.15.130:0/2569976035 >> v2:172.21.15.164:3300/0 conn(0x7efc70154380 0x7efc700b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc6effd640 1 -- 172.21.15.130:0/2569976035 >> v1:172.21.15.130:6789/0 conn(0x7efc70161140 legacy=0x7efc7015e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc6e7fc640 1 -- 172.21.15.130:0/2569976035 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712393835 0 0) 0x7efc700b2690 con 0x7efc70161140 2023-09-13T06:01:38.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.664+0000 7efc6effd640 1 -- 172.21.15.130:0/2569976035 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc70161cc0 con 0x7efc70154760 2023-09-13T06:01:38.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc6effd640 1 --2- 172.21.15.130:0/2569976035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc70154760 0x7efc70070670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc70069f90 tx=0x7efc6401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ac788393888074 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:38.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc6e7fc640 1 -- 172.21.15.130:0/2569976035 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640ab600 con 0x7efc70154760 2023-09-13T06:01:38.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc6e7fc640 1 -- 172.21.15.130:0/2569976035 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640a7050 con 0x7efc70154760 2023-09-13T06:01:38.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc6e7fc640 1 -- 172.21.15.130:0/2569976035 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640ab980 con 0x7efc70154760 2023-09-13T06:01:38.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc760d8640 1 -- 172.21.15.130:0/2569976035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc70154760 msgr2=0x7efc70070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc760d8640 1 --2- 172.21.15.130:0/2569976035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc70154760 0x7efc70070670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc70069f90 tx=0x7efc6401c460 comp rx=0 tx=0).stop 2023-09-13T06:01:38.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc760d8640 1 -- 172.21.15.130:0/2569976035 shutdown_connections 2023-09-13T06:01:38.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc760d8640 1 --2- 172.21.15.130:0/2569976035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc70154760 0x7efc70070670 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc760d8640 1 --2- 172.21.15.130:0/2569976035 >> v2:172.21.15.164:3300/0 conn(0x7efc70154380 0x7efc700b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc760d8640 1 -- 172.21.15.130:0/2569976035 >> 172.21.15.130:0/2569976035 conn(0x7efc70065990 msgr2=0x7efc70065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:38.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc760d8640 1 -- 172.21.15.130:0/2569976035 shutdown_connections 2023-09-13T06:01:38.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc760d8640 1 -- 172.21.15.130:0/2569976035 wait complete. 2023-09-13T06:01:38.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc760d8640 1 Processor -- start 2023-09-13T06:01:38.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.668+0000 7efc760d8640 1 -- start start 2023-09-13T06:01:38.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc760d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc70154380 0x7efc7014d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc760d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc70154760 0x7efc7013ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc760d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc70161140 0x7efc70154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc760d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70158da0 con 0x7efc70161140 2023-09-13T06:01:38.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc760d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70159040 con 0x7efc70154380 2023-09-13T06:01:38.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc760d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc70159320 con 0x7efc70154760 2023-09-13T06:01:38.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc6ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc70161140 0x7efc70154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc6ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc70161140 0x7efc70154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48318/0 (socket says 172.21.15.130:48318) 2023-09-13T06:01:38.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc6ffff640 1 -- 172.21.15.130:0/4112101373 learned_addr learned my addr 172.21.15.130:0/4112101373 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:38.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc6f7fe640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc70154380 0x7efc7014d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc6effd640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc70154760 0x7efc7013ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc6ffff640 1 -- 172.21.15.130:0/4112101373 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc70154760 msgr2=0x7efc7013ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc6ffff640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc70154760 0x7efc7013ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc6ffff640 1 -- 172.21.15.130:0/4112101373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc70154380 msgr2=0x7efc7014d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc6ffff640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc70154380 0x7efc7014d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc6ffff640 1 -- 172.21.15.130:0/4112101373 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64009420 con 0x7efc70161140 2023-09-13T06:01:38.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc6ffff640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc70161140 0x7efc70154e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efc68001570 tx=0x7efc6800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:38.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc57fff640 1 -- 172.21.15.130:0/4112101373 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6800a640 con 0x7efc70161140 2023-09-13T06:01:38.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc57fff640 1 -- 172.21.15.130:0/4112101373 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6800a7c0 con 0x7efc70161140 2023-09-13T06:01:38.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc760d8640 1 -- 172.21.15.130:0/4112101373 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc70159600 con 0x7efc70161140 2023-09-13T06:01:38.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc57fff640 1 -- 172.21.15.130:0/4112101373 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6800ab70 con 0x7efc70161140 2023-09-13T06:01:38.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc760d8640 1 -- 172.21.15.130:0/4112101373 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7013cf90 con 0x7efc70161140 2023-09-13T06:01:38.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc760d8640 1 -- 172.21.15.130:0/4112101373 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc700618a0 con 0x7efc70161140 2023-09-13T06:01:38.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.672+0000 7efc57fff640 1 -- 172.21.15.130:0/4112101373 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efc6800acd0 con 0x7efc70161140 2023-09-13T06:01:38.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.676+0000 7efc57fff640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc5c065b20 0x7efc5c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.676+0000 7efc57fff640 1 -- 172.21.15.130:0/4112101373 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc68082c00 con 0x7efc70161140 2023-09-13T06:01:38.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.676+0000 7efc6f7fe640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc5c065b20 0x7efc5c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.676+0000 7efc6f7fe640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc5c065b20 0x7efc5c067fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc6000b930 tx=0x7efc60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:38.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.680+0000 7efc57fff640 1 -- 172.21.15.130:0/4112101373 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7efc680504b0 con 0x7efc70161140 2023-09-13T06:01:38.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 -- 172.21.15.130:0/4112101373 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc70159ab0 con 0x7efc70161140 2023-09-13T06:01:38.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc57fff640 1 -- 172.21.15.130:0/4112101373 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc680180a0 con 0x7efc70161140 2023-09-13T06:01:38.833 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:01:38.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 -- 172.21.15.130:0/4112101373 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc5c065b20 msgr2=0x7efc5c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc5c065b20 0x7efc5c067fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc6000b930 tx=0x7efc60008040 comp rx=0 tx=0).stop 2023-09-13T06:01:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 -- 172.21.15.130:0/4112101373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc70161140 msgr2=0x7efc70154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc70161140 0x7efc70154e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efc68001570 tx=0x7efc6800cca0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 -- 172.21.15.130:0/4112101373 shutdown_connections 2023-09-13T06:01:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc5c065b20 0x7efc5c067fe0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc70161140 0x7efc70154e90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc70154760 0x7efc7013ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 --2- 172.21.15.130:0/4112101373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc70154380 0x7efc7014d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 -- 172.21.15.130:0/4112101373 >> 172.21.15.130:0/4112101373 conn(0x7efc70065990 msgr2=0x7efc700d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 -- 172.21.15.130:0/4112101373 shutdown_connections 2023-09-13T06:01:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.828+0000 7efc760d8640 1 -- 172.21.15.130:0/4112101373 wait complete. 2023-09-13T06:01:38.853 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:01:38.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd69b111640 1 Processor -- start 2023-09-13T06:01:38.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd69b111640 1 -- start start 2023-09-13T06:01:38.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd69b111640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd69415b130 0x7fd6940cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd69b111640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd6940ce180 0x7fd69415b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:38.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd69b111640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6940ce980 con 0x7fd6940b04a0 2023-09-13T06:01:38.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd69b111640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6940cec60 con 0x7fd69415b130 2023-09-13T06:01:38.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd69b111640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69406c640 con 0x7fd6940ce180 2023-09-13T06:01:38.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd698ead640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd69415b130 0x7fd6940cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd698ead640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd69415b130 0x7fd6940cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48322/0 (socket says 172.21.15.130:48322) 2023-09-13T06:01:38.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd698ead640 1 -- 172.21.15.130:0/3981624789 learned_addr learned my addr 172.21.15.130:0/3981624789 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:38.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd693fff640 1 --2- 172.21.15.130:0/3981624789 >> v2:172.21.15.164:3300/0 conn(0x7fd6940ce180 0x7fd69415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:38.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd698ead640 1 -- 172.21.15.130:0/3981624789 >> v2:172.21.15.164:3300/0 conn(0x7fd6940ce180 msgr2=0x7fd69415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:38.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd698ead640 1 --2- 172.21.15.130:0/3981624789 >> v2:172.21.15.164:3300/0 conn(0x7fd6940ce180 0x7fd69415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd698ead640 1 -- 172.21.15.130:0/3981624789 >> v1:172.21.15.164:6789/0 conn(0x7fd6940b04a0 legacy=0x7fd69406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:38.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd698ead640 1 -- 172.21.15.130:0/3981624789 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69406c920 con 0x7fd69415b130 2023-09-13T06:01:38.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.988+0000 7fd693fff640 1 --2- 172.21.15.130:0/3981624789 >> v2:172.21.15.164:3300/0 conn(0x7fd6940ce180 0x7fd69415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:38.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd698ead640 1 --2- 172.21.15.130:0/3981624789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd69415b130 0x7fd6940cc780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd69406bc40 tx=0x7fd68801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a006c3f1b8f5d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:38.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd6937fe640 1 -- 172.21.15.130:0/3981624789 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6880aa610 con 0x7fd69415b130 2023-09-13T06:01:38.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd6937fe640 1 -- 172.21.15.130:0/3981624789 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6880a6040 con 0x7fd69415b130 2023-09-13T06:01:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd6937fe640 1 -- 172.21.15.130:0/3981624789 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6880aa990 con 0x7fd69415b130 2023-09-13T06:01:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd69b111640 1 -- 172.21.15.130:0/3981624789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd69415b130 msgr2=0x7fd6940cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd69b111640 1 --2- 172.21.15.130:0/3981624789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd69415b130 0x7fd6940cc780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd69406bc40 tx=0x7fd68801c4c0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd69b111640 1 -- 172.21.15.130:0/3981624789 shutdown_connections 2023-09-13T06:01:38.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd69b111640 1 --2- 172.21.15.130:0/3981624789 >> v2:172.21.15.164:3300/0 conn(0x7fd6940ce180 0x7fd69415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd69b111640 1 --2- 172.21.15.130:0/3981624789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd69415b130 0x7fd6940cc780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:38.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd69b111640 1 -- 172.21.15.130:0/3981624789 >> 172.21.15.130:0/3981624789 conn(0x7fd694065990 msgr2=0x7fd694065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:38.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd69b111640 1 -- 172.21.15.130:0/3981624789 shutdown_connections 2023-09-13T06:01:38.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.992+0000 7fd69b111640 1 -- 172.21.15.130:0/3981624789 wait complete. 2023-09-13T06:01:39.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd69b111640 1 Processor -- start 2023-09-13T06:01:39.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd69b111640 1 -- start start 2023-09-13T06:01:39.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd69b111640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6940b04a0 0x7fd6941f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd69b111640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6940ce180 0x7fd69415d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd69b111640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd69415b130 0x7fd6940af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd69b111640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69415e140 con 0x7fd6940ce180 2023-09-13T06:01:39.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd69b111640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6941f5670 con 0x7fd6940b04a0 2023-09-13T06:01:39.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd69b111640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69406f2b0 con 0x7fd69415b130 2023-09-13T06:01:39.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd693fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6940ce180 0x7fd69415d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd693fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6940ce180 0x7fd69415d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48326/0 (socket says 172.21.15.130:48326) 2023-09-13T06:01:39.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd693fff640 1 -- 172.21.15.130:0/516292968 learned_addr learned my addr 172.21.15.130:0/516292968 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:39.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd698ead640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6940b04a0 0x7fd6941f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd6996ae640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd69415b130 0x7fd6940af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd693fff640 1 -- 172.21.15.130:0/516292968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd69415b130 msgr2=0x7fd6940af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd693fff640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd69415b130 0x7fd6940af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd693fff640 1 -- 172.21.15.130:0/516292968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6940b04a0 msgr2=0x7fd6941f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd693fff640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6940b04a0 0x7fd6941f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd693fff640 1 -- 172.21.15.130:0/516292968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880094d0 con 0x7fd6940ce180 2023-09-13T06:01:39.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd693fff640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6940ce180 0x7fd69415d840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd68000c7c0 tx=0x7fd68000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:39.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd6917fa640 1 -- 172.21.15.130:0/516292968 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680007a30 con 0x7fd6940ce180 2023-09-13T06:01:39.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd6917fa640 1 -- 172.21.15.130:0/516292968 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd680007b90 con 0x7fd6940ce180 2023-09-13T06:01:39.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd69b111640 1 -- 172.21.15.130:0/516292968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69406f590 con 0x7fd6940ce180 2023-09-13T06:01:39.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd6917fa640 1 -- 172.21.15.130:0/516292968 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000ce70 con 0x7fd6940ce180 2023-09-13T06:01:39.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd69b111640 1 -- 172.21.15.130:0/516292968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69406fb50 con 0x7fd6940ce180 2023-09-13T06:01:39.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:38.996+0000 7fd69b111640 1 -- 172.21.15.130:0/516292968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69406fd70 con 0x7fd6940ce180 2023-09-13T06:01:39.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.000+0000 7fd6917fa640 1 -- 172.21.15.130:0/516292968 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd6800113f0 con 0x7fd6940ce180 2023-09-13T06:01:39.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.000+0000 7fd6917fa640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd678065b20 0x7fd678067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.000+0000 7fd6917fa640 1 -- 172.21.15.130:0/516292968 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd680083760 con 0x7fd6940ce180 2023-09-13T06:01:39.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.000+0000 7fd698ead640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd678065b20 0x7fd678067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.000+0000 7fd698ead640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd678065b20 0x7fd678067fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd6880ae000 tx=0x7fd6880b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:39.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.004+0000 7fd6917fa640 1 -- 172.21.15.130:0/516292968 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd6800510c0 con 0x7fd6940ce180 2023-09-13T06:01:39.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.180+0000 7fd69b111640 1 -- 172.21.15.130:0/516292968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6940618a0 con 0x7fd6940ce180 2023-09-13T06:01:39.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.180+0000 7fd6917fa640 1 -- 172.21.15.130:0/516292968 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fd68001e090 con 0x7fd6940ce180 2023-09-13T06:01:39.185 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:39.185 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1779716448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1779716448},{"type":"v1","addr":"172.21.15.130:6837","nonce":1779716448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1022199494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":1022199494},{"type":"v1","addr":"172.21.15.164:6835","nonce":1022199494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3130227261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3130227261},{"type":"v1","addr":"172.21.15.164:6834","nonce":3130227261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:01:25.693319+0000","modified":"2023-09-13T06:01:28.718115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/660561895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":660561895},{"type":"v1","addr":"172.21.15.130:6836","nonce":660561895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T06:01:39.186 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 7 2023-09-13T06:01:39.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 -- 172.21.15.130:0/516292968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd678065b20 msgr2=0x7fd678067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd678065b20 0x7fd678067fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd6880ae000 tx=0x7fd6880b5040 comp rx=0 tx=0).stop 2023-09-13T06:01:39.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 -- 172.21.15.130:0/516292968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6940ce180 msgr2=0x7fd69415d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6940ce180 0x7fd69415d840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd68000c7c0 tx=0x7fd68000cc80 comp rx=0 tx=0).stop 2023-09-13T06:01:39.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 -- 172.21.15.130:0/516292968 shutdown_connections 2023-09-13T06:01:39.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd678065b20 0x7fd678067fe0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd69415b130 0x7fd6940af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6940ce180 0x7fd69415d840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 --2- 172.21.15.130:0/516292968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6940b04a0 0x7fd6941f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 -- 172.21.15.130:0/516292968 >> 172.21.15.130:0/516292968 conn(0x7fd694065990 msgr2=0x7fd6940cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:39.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 -- 172.21.15.130:0/516292968 shutdown_connections 2023-09-13T06:01:39.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.184+0000 7fd69b111640 1 -- 172.21.15.130:0/516292968 wait complete. 2023-09-13T06:01:39.207 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:39.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.340+0000 7f3041f74640 1 Processor -- start 2023-09-13T06:01:39.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.340+0000 7f3041f74640 1 -- start start 2023-09-13T06:01:39.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f3041f74640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f303c0b0f40 0x7f303c0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f3041f74640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c0afee0 con 0x7f303c15e560 2023-09-13T06:01:39.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f3041f74640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c0b0180 con 0x7f303c157920 2023-09-13T06:01:39.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f3041f74640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c0aea50 con 0x7f303c0b0f40 2023-09-13T06:01:39.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f303bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f303c15e560 0x7f303c06b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55906/0 (socket says 172.21.15.130:55906) 2023-09-13T06:01:39.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f303bfff640 1 -- 172.21.15.130:0/3540716395 learned_addr learned my addr 172.21.15.130:0/3540716395 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:39.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f303affd640 1 --2- 172.21.15.130:0/3540716395 >> v2:172.21.15.164:3300/0 conn(0x7f303c0b0f40 0x7f303c0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f303a7fc640 1 -- 172.21.15.130:0/3540716395 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273890033 0 0) 0x7f303c0afee0 con 0x7f303c15e560 2023-09-13T06:01:39.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f303a7fc640 1 -- 172.21.15.130:0/3540716395 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3024003530 con 0x7f303c15e560 2023-09-13T06:01:39.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f303affd640 1 -- 172.21.15.130:0/3540716395 >> v1:172.21.15.164:6789/0 conn(0x7f303c157920 legacy=0x7f303c0ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f303a7fc640 1 -- 172.21.15.130:0/3540716395 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654306540 0 0) 0x7f303c0b0180 con 0x7f303c157920 2023-09-13T06:01:39.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f303affd640 1 -- 172.21.15.130:0/3540716395 >> v1:172.21.15.130:6789/0 conn(0x7f303c15e560 legacy=0x7f303c06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f303affd640 1 -- 172.21.15.130:0/3540716395 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0b0460 con 0x7f303c0b0f40 2023-09-13T06:01:39.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.344+0000 7f303affd640 1 --2- 172.21.15.130:0/3540716395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f303c0b0f40 0x7f303c0b1610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f30300097c0 tx=0x7f303001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e81996db2f9b6c84 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:39.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f303a7fc640 1 -- 172.21.15.130:0/3540716395 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30300ab600 con 0x7f303c0b0f40 2023-09-13T06:01:39.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f303a7fc640 1 -- 172.21.15.130:0/3540716395 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30300a7050 con 0x7f303c0b0f40 2023-09-13T06:01:39.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f303a7fc640 1 -- 172.21.15.130:0/3540716395 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30300ab980 con 0x7f303c0b0f40 2023-09-13T06:01:39.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 -- 172.21.15.130:0/3540716395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f303c0b0f40 msgr2=0x7f303c0b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 --2- 172.21.15.130:0/3540716395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f303c0b0f40 0x7f303c0b1610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f30300097c0 tx=0x7f303001c480 comp rx=0 tx=0).stop 2023-09-13T06:01:39.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 -- 172.21.15.130:0/3540716395 shutdown_connections 2023-09-13T06:01:39.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 --2- 172.21.15.130:0/3540716395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f303c0b0f40 0x7f303c0b1610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 -- 172.21.15.130:0/3540716395 >> 172.21.15.130:0/3540716395 conn(0x7f303c065990 msgr2=0x7f303c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:39.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 -- 172.21.15.130:0/3540716395 shutdown_connections 2023-09-13T06:01:39.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 -- 172.21.15.130:0/3540716395 wait complete. 2023-09-13T06:01:39.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 Processor -- start 2023-09-13T06:01:39.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 -- start start 2023-09-13T06:01:39.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f303c0b0f40 0x7f303c14e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f303c157920 0x7f303c1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f303c15e560 0x7f303c153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0b0b20 con 0x7f303c0b0f40 2023-09-13T06:01:39.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c148d90 con 0x7f303c15e560 2023-09-13T06:01:39.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f3041f74640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c158a10 con 0x7f303c157920 2023-09-13T06:01:39.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f303b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f303c0b0f40 0x7f303c14e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f303bfff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f303c15e560 0x7f303c153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.348+0000 7f303b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f303c0b0f40 0x7f303c14e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48338/0 (socket says 172.21.15.130:48338) 2023-09-13T06:01:39.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f303b7fe640 1 -- 172.21.15.130:0/781008280 learned_addr learned my addr 172.21.15.130:0/781008280 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:39.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f303affd640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f303c157920 0x7f303c1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f303b7fe640 1 -- 172.21.15.130:0/781008280 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f303c157920 msgr2=0x7f303c1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f303b7fe640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f303c157920 0x7f303c1539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f303b7fe640 1 -- 172.21.15.130:0/781008280 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f303c15e560 msgr2=0x7f303c153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f303b7fe640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f303c15e560 0x7f303c153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f303b7fe640 1 -- 172.21.15.130:0/781008280 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3030009420 con 0x7f303c0b0f40 2023-09-13T06:01:39.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f303b7fe640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f303c0b0f40 0x7f303c14e640 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f302c00c500 tx=0x7f302c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:39.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f3023fff640 1 -- 172.21.15.130:0/781008280 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c003600 con 0x7f303c0b0f40 2023-09-13T06:01:39.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f3023fff640 1 -- 172.21.15.130:0/781008280 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c003760 con 0x7f303c0b0f40 2023-09-13T06:01:39.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f3023fff640 1 -- 172.21.15.130:0/781008280 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c003b10 con 0x7f303c0b0f40 2023-09-13T06:01:39.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f3041f74640 1 -- 172.21.15.130:0/781008280 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c158fd0 con 0x7f303c0b0f40 2023-09-13T06:01:39.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f3041f74640 1 -- 172.21.15.130:0/781008280 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c1522f0 con 0x7f303c0b0f40 2023-09-13T06:01:39.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f3041f74640 1 -- 172.21.15.130:0/781008280 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c1591c0 con 0x7f303c0b0f40 2023-09-13T06:01:39.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f3023fff640 1 -- 172.21.15.130:0/781008280 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f302c003c70 con 0x7f303c0b0f40 2023-09-13T06:01:39.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f3023fff640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3028065b20 0x7f3028067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.352+0000 7f3023fff640 1 -- 172.21.15.130:0/781008280 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f302c082910 con 0x7f303c0b0f40 2023-09-13T06:01:39.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.356+0000 7f303affd640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3028065b20 0x7f3028067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.356+0000 7f303affd640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3028065b20 0x7f3028067fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30300ad000 tx=0x7f30300a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:39.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.356+0000 7f3023fff640 1 -- 172.21.15.130:0/781008280 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f302c0503c0 con 0x7f303c0b0f40 2023-09-13T06:01:39.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 -- 172.21.15.130:0/781008280 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f303c0618a0 con 0x7f303c0b0f40 2023-09-13T06:01:39.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3023fff640 1 -- 172.21.15.130:0/781008280 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f302c017020 con 0x7f303c0b0f40 2023-09-13T06:01:39.512 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:39.512 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:39.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 -- 172.21.15.130:0/781008280 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3028065b20 msgr2=0x7f3028067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3028065b20 0x7f3028067fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30300ad000 tx=0x7f30300a6000 comp rx=0 tx=0).stop 2023-09-13T06:01:39.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 -- 172.21.15.130:0/781008280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f303c0b0f40 msgr2=0x7f303c14e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f303c0b0f40 0x7f303c14e640 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f302c00c500 tx=0x7f302c00c9c0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 -- 172.21.15.130:0/781008280 shutdown_connections 2023-09-13T06:01:39.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3028065b20 0x7f3028067fe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f303c15e560 0x7f303c153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f303c157920 0x7f303c1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 --2- 172.21.15.130:0/781008280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f303c0b0f40 0x7f303c14e640 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 -- 172.21.15.130:0/781008280 >> 172.21.15.130:0/781008280 conn(0x7f303c065990 msgr2=0x7f303c14f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:39.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 -- 172.21.15.130:0/781008280 shutdown_connections 2023-09-13T06:01:39.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.508+0000 7f3041f74640 1 -- 172.21.15.130:0/781008280 wait complete. 2023-09-13T06:01:39.533 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:01:39.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.668+0000 7fd8fb69c640 1 Processor -- start 2023-09-13T06:01:39.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.668+0000 7fd8fb69c640 1 -- start start 2023-09-13T06:01:39.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8fb69c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8f415b130 0x7fd8f40cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8fb69c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd8f40b04a0 0x7fd8f40b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8fb69c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40ce980 con 0x7fd8f40ce180 2023-09-13T06:01:39.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8fb69c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40b0e70 con 0x7fd8f40b04a0 2023-09-13T06:01:39.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8fb69c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40cec60 con 0x7fd8f415b130 2023-09-13T06:01:39.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8f9c39640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd8f40b04a0 0x7fd8f40b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8f8c37640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd8f40ce180 0x7fd8f415b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55912/0 (socket says 172.21.15.130:55912) 2023-09-13T06:01:39.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8f8c37640 1 -- 172.21.15.130:0/3806620367 learned_addr learned my addr 172.21.15.130:0/3806620367 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:39.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8f9438640 1 --2- 172.21.15.130:0/3806620367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8f415b130 0x7fd8f40cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8f9c39640 1 -- 172.21.15.130:0/3806620367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8f415b130 msgr2=0x7fd8f40cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:39.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8f9c39640 1 --2- 172.21.15.130:0/3806620367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8f415b130 0x7fd8f40cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8f9c39640 1 -- 172.21.15.130:0/3806620367 >> v1:172.21.15.130:6789/0 conn(0x7fd8f40ce180 legacy=0x7fd8f415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8f9c39640 1 -- 172.21.15.130:0/3806620367 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f406c640 con 0x7fd8f40b04a0 2023-09-13T06:01:39.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.672+0000 7fd8ebfff640 1 -- 172.21.15.130:0/3806620367 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456969653 0 0) 0x7fd8f40ce980 con 0x7fd8f40ce180 2023-09-13T06:01:39.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8f9c39640 1 --2- 172.21.15.130:0/3806620367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8f40b04a0 0x7fd8f40b0930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009d90 tx=0x7fd8ec01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5338f2ff32d016ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:39.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8ebfff640 1 -- 172.21.15.130:0/3806620367 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0a5a10 con 0x7fd8f40b04a0 2023-09-13T06:01:39.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8ebfff640 1 -- 172.21.15.130:0/3806620367 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec0a5b70 con 0x7fd8f40b04a0 2023-09-13T06:01:39.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8ebfff640 1 -- 172.21.15.130:0/3806620367 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0ad440 con 0x7fd8f40b04a0 2023-09-13T06:01:39.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8fb69c640 1 -- 172.21.15.130:0/3806620367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8f40b04a0 msgr2=0x7fd8f40b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8fb69c640 1 --2- 172.21.15.130:0/3806620367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8f40b04a0 0x7fd8f40b0930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009d90 tx=0x7fd8ec01c950 comp rx=0 tx=0).stop 2023-09-13T06:01:39.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8fb69c640 1 -- 172.21.15.130:0/3806620367 shutdown_connections 2023-09-13T06:01:39.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8fb69c640 1 --2- 172.21.15.130:0/3806620367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8f40b04a0 0x7fd8f40b0930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8fb69c640 1 --2- 172.21.15.130:0/3806620367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8f415b130 0x7fd8f40cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8fb69c640 1 -- 172.21.15.130:0/3806620367 >> 172.21.15.130:0/3806620367 conn(0x7fd8f4065990 msgr2=0x7fd8f4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:39.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8fb69c640 1 -- 172.21.15.130:0/3806620367 shutdown_connections 2023-09-13T06:01:39.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8fb69c640 1 -- 172.21.15.130:0/3806620367 wait complete. 2023-09-13T06:01:39.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8fb69c640 1 Processor -- start 2023-09-13T06:01:39.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8fb69c640 1 -- start start 2023-09-13T06:01:39.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.676+0000 7fd8fb69c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8f40b04a0 0x7fd8f41497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8fb69c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8f40ce180 0x7fd8f4159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8fb69c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8f415b130 0x7fd8f4159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8fb69c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f414a230 con 0x7fd8f415b130 2023-09-13T06:01:39.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8fb69c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40af820 con 0x7fd8f40ce180 2023-09-13T06:01:39.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8fb69c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f406f110 con 0x7fd8f40b04a0 2023-09-13T06:01:39.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8f9c39640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8f415b130 0x7fd8f4159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8f9c39640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8f415b130 0x7fd8f4159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48346/0 (socket says 172.21.15.130:48346) 2023-09-13T06:01:39.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8f9c39640 1 -- 172.21.15.130:0/440633621 learned_addr learned my addr 172.21.15.130:0/440633621 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:39.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8f8c37640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8f40ce180 0x7fd8f4159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8f9438640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8f40b04a0 0x7fd8f41497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8f9c39640 1 -- 172.21.15.130:0/440633621 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8f40b04a0 msgr2=0x7fd8f41497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8f9c39640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8f40b04a0 0x7fd8f41497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8f9c39640 1 -- 172.21.15.130:0/440633621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8f40ce180 msgr2=0x7fd8f4159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8f9c39640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8f40ce180 0x7fd8f4159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8f9c39640 1 -- 172.21.15.130:0/440633621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec009a70 con 0x7fd8f415b130 2023-09-13T06:01:39.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8f9c39640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8f415b130 0x7fd8f4159c80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009d90 tx=0x7fd8ec0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:39.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8e9ffb640 1 -- 172.21.15.130:0/440633621 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0adce0 con 0x7fd8f415b130 2023-09-13T06:01:39.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8e9ffb640 1 -- 172.21.15.130:0/440633621 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec0ade40 con 0x7fd8f415b130 2023-09-13T06:01:39.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8e9ffb640 1 -- 172.21.15.130:0/440633621 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0b9690 con 0x7fd8f415b130 2023-09-13T06:01:39.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8fb69c640 1 -- 172.21.15.130:0/440633621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f40aeca0 con 0x7fd8f415b130 2023-09-13T06:01:39.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8fb69c640 1 -- 172.21.15.130:0/440633621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f40af260 con 0x7fd8f415b130 2023-09-13T06:01:39.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8fb69c640 1 -- 172.21.15.130:0/440633621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f40618a0 con 0x7fd8f415b130 2023-09-13T06:01:39.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.680+0000 7fd8e9ffb640 1 -- 172.21.15.130:0/440633621 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd8ec0b97f0 con 0x7fd8f415b130 2023-09-13T06:01:39.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.684+0000 7fd8e9ffb640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd8d8065b20 0x7fd8d8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:39.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.684+0000 7fd8e9ffb640 1 -- 172.21.15.130:0/440633621 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8ec11e7f0 con 0x7fd8f415b130 2023-09-13T06:01:39.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.684+0000 7fd8f9438640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd8d8065b20 0x7fd8d8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:39.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.684+0000 7fd8f9438640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd8d8065b20 0x7fd8d8067fe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009ac0 tx=0x7fd8f0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:39.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.688+0000 7fd8e9ffb640 1 -- 172.21.15.130:0/440633621 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd8ec0ec1e0 con 0x7fd8f415b130 2023-09-13T06:01:39.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.864+0000 7fd8fb69c640 1 -- 172.21.15.130:0/440633621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8f40ad180 con 0x7fd8f415b130 2023-09-13T06:01:39.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.864+0000 7fd8e9ffb640 1 -- 172.21.15.130:0/440633621 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fd8ec009450 con 0x7fd8f415b130 2023-09-13T06:01:39.869 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:39.869 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1779716448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1779716448},{"type":"v1","addr":"172.21.15.130:6837","nonce":1779716448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1022199494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":1022199494},{"type":"v1","addr":"172.21.15.164:6835","nonce":1022199494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3130227261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3130227261},{"type":"v1","addr":"172.21.15.164:6834","nonce":3130227261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:01:25.693319+0000","modified":"2023-09-13T06:01:28.718115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/660561895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":660561895},{"type":"v1","addr":"172.21.15.130:6836","nonce":660561895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T06:01:39.870 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 7 2023-09-13T06:01:39.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 -- 172.21.15.130:0/440633621 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd8d8065b20 msgr2=0x7fd8d8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd8d8065b20 0x7fd8d8067fe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009ac0 tx=0x7fd8f0009190 comp rx=0 tx=0).stop 2023-09-13T06:01:39.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 -- 172.21.15.130:0/440633621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8f415b130 msgr2=0x7fd8f4159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:39.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8f415b130 0x7fd8f4159c80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009d90 tx=0x7fd8ec0196f0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 -- 172.21.15.130:0/440633621 shutdown_connections 2023-09-13T06:01:39.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd8d8065b20 0x7fd8d8067fe0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8f40ce180 0x7fd8f4159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8f415b130 0x7fd8f4159c80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 --2- 172.21.15.130:0/440633621 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8f40b04a0 0x7fd8f41497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:39.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 -- 172.21.15.130:0/440633621 >> 172.21.15.130:0/440633621 conn(0x7fd8f4065990 msgr2=0x7fd8f40b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:39.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 -- 172.21.15.130:0/440633621 shutdown_connections 2023-09-13T06:01:39.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:39.868+0000 7fd8fb69c640 1 -- 172.21.15.130:0/440633621 wait complete. 2023-09-13T06:01:40.291 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T06:01:25.693319+0000', 'modified': '2023-09-13T06:01:28.718115+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6836/660561895', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 660561895}, {'type': 'v1', 'addr': '172.21.15.130:6836', 'nonce': 660561895}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T06:01:40.292 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T06:01:40.292 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-13T06:01:40.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.428+0000 7fd6c7c48640 1 Processor -- start 2023-09-13T06:01:40.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c7c48640 1 -- start start 2023-09-13T06:01:40.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c7c48640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd6c00b1d20 0x7fd6c00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c7c48640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd6c00cdfc0 0x7fd6c00b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c7c48640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c00ccfd0 con 0x7fd6c0159f20 2023-09-13T06:01:40.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c7c48640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c00ce430 con 0x7fd6c00b1d20 2023-09-13T06:01:40.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c7c48640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c00b00f0 con 0x7fd6c00cdfc0 2023-09-13T06:01:40.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c51e3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd6c00b1d20 0x7fd6c00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c59e4640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd6c0159f20 0x7fd6c00b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55916/0 (socket says 172.21.15.130:55916) 2023-09-13T06:01:40.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c59e4640 1 -- 172.21.15.130:0/1310293327 learned_addr learned my addr 172.21.15.130:0/1310293327 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:40.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/1310293327 >> v2:172.21.15.164:3300/0 conn(0x7fd6c00cdfc0 0x7fd6c00b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c51e3640 1 -- 172.21.15.130:0/1310293327 >> v2:172.21.15.164:3300/0 conn(0x7fd6c00cdfc0 msgr2=0x7fd6c00b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:40.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c51e3640 1 --2- 172.21.15.130:0/1310293327 >> v2:172.21.15.164:3300/0 conn(0x7fd6c00cdfc0 0x7fd6c00b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c51e3640 1 -- 172.21.15.130:0/1310293327 >> v1:172.21.15.130:6789/0 conn(0x7fd6c0159f20 legacy=0x7fd6c00b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:40.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c51e3640 1 -- 172.21.15.130:0/1310293327 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c00ced90 con 0x7fd6c00b1d20 2023-09-13T06:01:40.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c49e2640 1 -- 172.21.15.130:0/1310293327 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823465208 0 0) 0x7fd6c00ccfd0 con 0x7fd6c0159f20 2023-09-13T06:01:40.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.432+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/1310293327 >> v2:172.21.15.164:3300/0 conn(0x7fd6c00cdfc0 0x7fd6c00b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:40.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c51e3640 1 --2- 172.21.15.130:0/1310293327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c00b1d20 0x7fd6c00ce7b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00097c0 tx=0x7fd6b001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa28a33a1b49f126 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:40.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c49e2640 1 -- 172.21.15.130:0/1310293327 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00ad680 con 0x7fd6c00b1d20 2023-09-13T06:01:40.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c49e2640 1 -- 172.21.15.130:0/1310293327 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b00ad7e0 con 0x7fd6c00b1d20 2023-09-13T06:01:40.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c49e2640 1 -- 172.21.15.130:0/1310293327 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00adb70 con 0x7fd6c00b1d20 2023-09-13T06:01:40.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c7c48640 1 -- 172.21.15.130:0/1310293327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c00b1d20 msgr2=0x7fd6c00ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:40.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c7c48640 1 --2- 172.21.15.130:0/1310293327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c00b1d20 0x7fd6c00ce7b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00097c0 tx=0x7fd6b001c380 comp rx=0 tx=0).stop 2023-09-13T06:01:40.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c7c48640 1 -- 172.21.15.130:0/1310293327 shutdown_connections 2023-09-13T06:01:40.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c7c48640 1 --2- 172.21.15.130:0/1310293327 >> v2:172.21.15.164:3300/0 conn(0x7fd6c00cdfc0 0x7fd6c00b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c7c48640 1 --2- 172.21.15.130:0/1310293327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c00b1d20 0x7fd6c00ce7b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c7c48640 1 -- 172.21.15.130:0/1310293327 >> 172.21.15.130:0/1310293327 conn(0x7fd6c0065990 msgr2=0x7fd6c0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:40.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c7c48640 1 -- 172.21.15.130:0/1310293327 shutdown_connections 2023-09-13T06:01:40.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c7c48640 1 -- 172.21.15.130:0/1310293327 wait complete. 2023-09-13T06:01:40.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.436+0000 7fd6c7c48640 1 Processor -- start 2023-09-13T06:01:40.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c7c48640 1 -- start start 2023-09-13T06:01:40.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c7c48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c00b1d20 0x7fd6c014bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c7c48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c00cdfc0 0x7fd6c014d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c7c48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c0159f20 0x7fd6c014d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c7c48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c006b6d0 con 0x7fd6c0159f20 2023-09-13T06:01:40.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c7c48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0155090 con 0x7fd6c00cdfc0 2023-09-13T06:01:40.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c7c48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c014c1d0 con 0x7fd6c00b1d20 2023-09-13T06:01:40.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c61e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c0159f20 0x7fd6c014d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c61e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c0159f20 0x7fd6c014d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48358/0 (socket says 172.21.15.130:48358) 2023-09-13T06:01:40.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c61e5640 1 -- 172.21.15.130:0/3364352584 learned_addr learned my addr 172.21.15.130:0/3364352584 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:40.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c51e3640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c00cdfc0 0x7fd6c014d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c59e4640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c00b1d20 0x7fd6c014bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c61e5640 1 -- 172.21.15.130:0/3364352584 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c00b1d20 msgr2=0x7fd6c014bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:40.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c00b1d20 0x7fd6c014bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c61e5640 1 -- 172.21.15.130:0/3364352584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c00cdfc0 msgr2=0x7fd6c014d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:40.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c00cdfc0 0x7fd6c014d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c61e5640 1 -- 172.21.15.130:0/3364352584 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b0009420 con 0x7fd6c0159f20 2023-09-13T06:01:40.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c51e3640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c00cdfc0 0x7fd6c014d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:40.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c59e4640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c00b1d20 0x7fd6c014bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:40.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c0159f20 0x7fd6c014d880 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800ce70 tx=0x7fd6b800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:40.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6b67fc640 1 -- 172.21.15.130:0/3364352584 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800d840 con 0x7fd6c0159f20 2023-09-13T06:01:40.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6b67fc640 1 -- 172.21.15.130:0/3364352584 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b800d9a0 con 0x7fd6c0159f20 2023-09-13T06:01:40.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6b67fc640 1 -- 172.21.15.130:0/3364352584 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800dd50 con 0x7fd6c0159f20 2023-09-13T06:01:40.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c7c48640 1 -- 172.21.15.130:0/3364352584 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c01552e0 con 0x7fd6c0159f20 2023-09-13T06:01:40.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.440+0000 7fd6c7c48640 1 -- 172.21.15.130:0/3364352584 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c014ef80 con 0x7fd6c0159f20 2023-09-13T06:01:40.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6b67fc640 1 -- 172.21.15.130:0/3364352584 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd6b801e3b0 con 0x7fd6c0159f20 2023-09-13T06:01:40.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6b67fc640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd6a4065b20 0x7fd6a4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6b67fc640 1 -- 172.21.15.130:0/3364352584 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6b8083d80 con 0x7fd6c0159f20 2023-09-13T06:01:40.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c59e4640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd6a4065b20 0x7fd6a4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6cafd2000 1 Processor -- start 2023-09-13T06:01:40.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c59e4640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd6a4065b20 0x7fd6a4067fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc000f70 tx=0x7fd6bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:40.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6cafd2000 1 -- start start 2023-09-13T06:01:40.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 0x5634efced930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efcd1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634efb6b1e0 con 0x5634efcd22b0 2023-09-13T06:01:40.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634efafa4c0 con 0x5634efcede70 2023-09-13T06:01:40.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634efaf79f0 con 0x5634efced550 2023-09-13T06:01:40.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c61e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c61e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48374/0 (socket says 172.21.15.130:48374) 2023-09-13T06:01:40.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c61e5640 1 -- 172.21.15.130:0/2024440322 learned_addr learned my addr 172.21.15.130:0/2024440322 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:40.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c51e3640 1 --2- 172.21.15.130:0/2024440322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efcd1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c59e4640 1 --2- 172.21.15.130:0/2024440322 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 0x5634efced930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c61e5640 1 -- 172.21.15.130:0/2024440322 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 msgr2=0x5634efced930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:40.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/2024440322 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 0x5634efced930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c61e5640 1 -- 172.21.15.130:0/2024440322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 msgr2=0x5634efcd1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:40.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/2024440322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efcd1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.444+0000 7fd6c61e5640 1 -- 172.21.15.130:0/2024440322 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634ef7ed890 con 0x5634efcd22b0 2023-09-13T06:01:40.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/2024440322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd2690 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8054ff0 tx=0x7fd6b80516b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd66288aa660cd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:40.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6a37fe640 1 -- 172.21.15.130:0/2024440322 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b805d2d0 con 0x5634efcd22b0 2023-09-13T06:01:40.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6a37fe640 1 -- 172.21.15.130:0/2024440322 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b8053690 con 0x5634efcd22b0 2023-09-13T06:01:40.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6a37fe640 1 -- 172.21.15.130:0/2024440322 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b805b070 con 0x5634efcd22b0 2023-09-13T06:01:40.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 -- 172.21.15.130:0/2024440322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 msgr2=0x5634efcd2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:40.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/2024440322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd2690 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8054ff0 tx=0x7fd6b80516b0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 -- 172.21.15.130:0/2024440322 shutdown_connections 2023-09-13T06:01:40.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/2024440322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efcd1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/2024440322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd2690 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/2024440322 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 0x5634efced930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 -- 172.21.15.130:0/2024440322 >> 172.21.15.130:0/2024440322 conn(0x5634efc9ac40 msgr2=0x5634efca9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:40.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 -- 172.21.15.130:0/2024440322 shutdown_connections 2023-09-13T06:01:40.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 -- 172.21.15.130:0/2024440322 wait complete. 2023-09-13T06:01:40.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 -- start start 2023-09-13T06:01:40.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 Processor -- start 2023-09-13T06:01:40.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 0x5634efca70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efca7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634efaf32e0 con 0x5634efcd22b0 2023-09-13T06:01:40.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634efaadfe0 con 0x5634efcede70 2023-09-13T06:01:40.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634efaadc80 con 0x5634efced550 2023-09-13T06:01:40.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6cafd2000 10 client.0 _ll_register_callbacks cb 0x5634efc8f260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:01:40.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c59e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c59e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48386/0 (socket says 172.21.15.130:48386) 2023-09-13T06:01:40.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c59e4640 1 -- 172.21.15.130:0/934900535 learned_addr learned my addr 172.21.15.130:0/934900535 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:40.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efca7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c51e3640 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 0x5634efca70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c61e5640 1 -- 172.21.15.130:0/934900535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 msgr2=0x5634efca70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:40.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 0x5634efca70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c61e5640 1 -- 172.21.15.130:0/934900535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 msgr2=0x5634efcd1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:40.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c61e5640 1 -- 172.21.15.130:0/934900535 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c014ef80 con 0x5634efcede70 2023-09-13T06:01:40.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.448+0000 7fd6c59e4640 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:40.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efca7610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8082210 tx=0x7fd6b8004a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=327e14391ccbba91 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:40.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2023-09-13T06:01:40.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/934900535 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b805b270 con 0x5634efcede70 2023-09-13T06:01:40.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/934900535 <== mon.1 v2:172.21.15.164:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6b805d2d0 con 0x5634efcede70 2023-09-13T06:01:40.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 -- 172.21.15.130:0/934900535 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634efa8aa50 con 0x5634efcede70 2023-09-13T06:01:40.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/934900535 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6b80547e0 con 0x5634efcede70 2023-09-13T06:01:40.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 10 client.4582 fetch_fsmap learned FSMap version 7 2023-09-13T06:01:40.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 -- 172.21.15.130:0/934900535 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5634efab6210 con 0x5634efcede70 2023-09-13T06:01:40.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/934900535 <== mon.1 v2:172.21.15.164:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5634efa8aa50 con 0x5634efcede70 2023-09-13T06:01:40.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/934900535 <== mon.1 v2:172.21.15.164:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd6b8005d20 con 0x5634efcede70 2023-09-13T06:01:40.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 10 client.4582 fetch_fsmap finished waiting for FSMap version 7 2023-09-13T06:01:40.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 10 client.4582 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T06:01:40.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 20 client.4582 populate_metadata read hostname 'smithi130' 2023-09-13T06:01:40.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.130:6834/660561895,v1:172.21.15.130:6836/660561895] conn(0x5634efca8380 0x5634efcff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 4 client.4582 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T06:01:40.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 -- 172.21.15.130:0/934900535 --> [v2:172.21.15.130:6834/660561895,v1:172.21.15.130:6836/660561895] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634efaaa820 con 0x5634efca8380 2023-09-13T06:01:40.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6c59e4640 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.130:6834/660561895,v1:172.21.15.130:6836/660561895] conn(0x5634efca8380 0x5634efcff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6a0ff9640 10 client.4582 ms_handle_connect on v2:172.21.15.130:6834/660561895 2023-09-13T06:01:40.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6c59e4640 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.130:6834/660561895,v1:172.21.15.130:6836/660561895] conn(0x5634efca8380 0x5634efcff600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c827188adcdf5554 server_cookie=61ce3a32cd6656aa in_seq=0 out_seq=0 2023-09-13T06:01:40.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/934900535 <== mds.0 v2:172.21.15.130:6834/660561895 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5634efaaa820 con 0x5634efca8380 2023-09-13T06:01:40.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6a0ff9640 10 client.4582 handle_command_reply: tid=0 2023-09-13T06:01:40.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 client.4582 shutdown 2023-09-13T06:01:40.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 -- 172.21.15.130:0/934900535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 msgr2=0x5634efca7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:40.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efca7610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8082210 tx=0x7fd6b8004a50 comp rx=0 tx=0).stop 2023-09-13T06:01:40.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 -- 172.21.15.130:0/934900535 shutdown_connections 2023-09-13T06:01:40.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.130:6834/660561895,v1:172.21.15.130:6836/660561895] conn(0x5634efca8380 0x5634efcff600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efca7610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 0x5634efca70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/934900535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcd22b0 0x5634efcd1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6a0ff9640 0 client.4582 ms_handle_reset on v2:172.21.15.130:6834/660561895 2023-09-13T06:01:40.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 -- 172.21.15.130:0/934900535 >> 172.21.15.130:0/934900535 conn(0x5634efc9ac40 msgr2=0x5634efcd3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:40.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 -- 172.21.15.130:0/934900535 shutdown_connections 2023-09-13T06:01:40.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 1 -- 172.21.15.130:0/934900535 wait complete. 2023-09-13T06:01:40.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.452+0000 7fd6cafd2000 20 client.4582 trim_cache size 0 max 16384 2023-09-13T06:01:40.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6cafd2000 1 Processor -- start 2023-09-13T06:01:40.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6cafd2000 1 -- start start 2023-09-13T06:01:40.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcd22b0 0x5634efca7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 0x5634efca6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcede70 0x5634efca65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634ef7ae940 con 0x5634efcede70 2023-09-13T06:01:40.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634efafd160 con 0x5634efcd22b0 2023-09-13T06:01:40.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634efaf32e0 con 0x5634efced550 2023-09-13T06:01:40.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6c61e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcede70 0x5634efca65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6c61e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcede70 0x5634efca65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48398/0 (socket says 172.21.15.130:48398) 2023-09-13T06:01:40.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6c61e5640 1 -- 172.21.15.130:0/838612623 learned_addr learned my addr 172.21.15.130:0/838612623 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:40.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6c61e5640 1 -- 172.21.15.130:0/838612623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 msgr2=0x5634efca6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:40.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/838612623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 0x5634efca6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6c61e5640 1 -- 172.21.15.130:0/838612623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcd22b0 msgr2=0x5634efca7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:40.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/838612623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcd22b0 0x5634efca7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6c61e5640 1 -- 172.21.15.130:0/838612623 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634efa9c4a0 con 0x5634efcede70 2023-09-13T06:01:40.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/838612623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcede70 0x5634efca65c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8055160 tx=0x7fd6b807f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2379ebe9a8c693 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:40.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6a3fff640 1 -- 172.21.15.130:0/838612623 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8054a30 con 0x5634efcede70 2023-09-13T06:01:40.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6a3fff640 1 -- 172.21.15.130:0/838612623 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b805d2d0 con 0x5634efcede70 2023-09-13T06:01:40.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.468+0000 7fd6a3fff640 1 -- 172.21.15.130:0/838612623 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b805b270 con 0x5634efcede70 2023-09-13T06:01:40.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 -- 172.21.15.130:0/838612623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcede70 msgr2=0x5634efca65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:40.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/838612623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcede70 0x5634efca65c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8055160 tx=0x7fd6b807f040 comp rx=0 tx=0).stop 2023-09-13T06:01:40.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 -- 172.21.15.130:0/838612623 shutdown_connections 2023-09-13T06:01:40.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/838612623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efcede70 0x5634efca65c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/838612623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efced550 0x5634efca6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/838612623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcd22b0 0x5634efca7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 -- 172.21.15.130:0/838612623 >> 172.21.15.130:0/838612623 conn(0x5634efc9ac40 msgr2=0x5634efcfab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:40.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 -- 172.21.15.130:0/838612623 shutdown_connections 2023-09-13T06:01:40.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 -- 172.21.15.130:0/838612623 wait complete. 2023-09-13T06:01:40.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 -- start start 2023-09-13T06:01:40.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 Processor -- start 2023-09-13T06:01:40.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efcd22b0 0x5634efd4bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efced550 0x5634efd4c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efcff910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634efab34b0 con 0x5634efced550 2023-09-13T06:01:40.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634efd03f90 con 0x5634efcede70 2023-09-13T06:01:40.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634efca9e70 con 0x5634efcd22b0 2023-09-13T06:01:40.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 10 client.0 _ll_register_callbacks cb 0x5634efaa9ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:01:40.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c51e3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efced550 0x5634efd4c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c51e3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efced550 0x5634efd4c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48412/0 (socket says 172.21.15.130:48412) 2023-09-13T06:01:40.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c51e3640 1 -- 172.21.15.130:0/807169846 learned_addr learned my addr 172.21.15.130:0/807169846 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:40.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efcff910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c59e4640 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efcd22b0 0x5634efd4bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c51e3640 1 -- 172.21.15.130:0/807169846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efcd22b0 msgr2=0x5634efd4bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:40.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c51e3640 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efcd22b0 0x5634efd4bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c51e3640 1 -- 172.21.15.130:0/807169846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 msgr2=0x5634efcff910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:40.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c51e3640 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efcff910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c51e3640 1 -- 172.21.15.130:0/807169846 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634efab6210 con 0x5634efced550 2023-09-13T06:01:40.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c61e5640 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efcff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:40.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6c51e3640 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efced550 0x5634efd4c240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0019fb0 tx=0x7fd6b0019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab0f5b1e4e2d123 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:40.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:01:40.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/807169846 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00add10 con 0x5634efced550 2023-09-13T06:01:40.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 -- 172.21.15.130:0/807169846 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634efaae900 con 0x5634efced550 2023-09-13T06:01:40.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/807169846 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6b00bb070 con 0x5634efced550 2023-09-13T06:01:40.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/807169846 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6b00ade70 con 0x5634efced550 2023-09-13T06:01:40.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 10 client.4674 fetch_fsmap learned FSMap version 7 2023-09-13T06:01:40.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.472+0000 7fd6cafd2000 1 -- 172.21.15.130:0/807169846 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5634ef7edcc0 con 0x5634efced550 2023-09-13T06:01:40.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/807169846 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5634efaae900 con 0x5634efced550 2023-09-13T06:01:40.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/807169846 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd6b00c0480 con 0x5634efced550 2023-09-13T06:01:40.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 10 client.4674 fetch_fsmap finished waiting for FSMap version 7 2023-09-13T06:01:40.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 10 client.4674 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T06:01:40.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 20 client.4674 populate_metadata read hostname 'smithi130' 2023-09-13T06:01:40.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.130:6834/660561895,v1:172.21.15.130:6836/660561895] conn(0x5634efd52bd0 0x5634efd54fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:40.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 4 client.4674 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T06:01:40.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 -- 172.21.15.130:0/807169846 --> [v2:172.21.15.130:6834/660561895,v1:172.21.15.130:6836/660561895] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5634efaec2c0 con 0x5634efd52bd0 2023-09-13T06:01:40.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c59e4640 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.130:6834/660561895,v1:172.21.15.130:6836/660561895] conn(0x5634efd52bd0 0x5634efd54fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:40.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c59e4640 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.130:6834/660561895,v1:172.21.15.130:6836/660561895] conn(0x5634efd52bd0 0x5634efd54fc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a375443841d1150b server_cookie=7cb4f77ba6f5c602 in_seq=0 out_seq=0 2023-09-13T06:01:40.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6a0ff9640 10 client.4674 ms_handle_connect on v2:172.21.15.130:6834/660561895 2023-09-13T06:01:40.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6a0ff9640 1 -- 172.21.15.130:0/807169846 <== mds.0 v2:172.21.15.130:6834/660561895 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5634efaec2c0 con 0x5634efd52bd0 2023-09-13T06:01:40.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6a0ff9640 10 client.4674 handle_command_reply: tid=0 2023-09-13T06:01:40.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 client.4674 shutdown 2023-09-13T06:01:40.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 -- 172.21.15.130:0/807169846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efced550 msgr2=0x5634efd4c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:40.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efced550 0x5634efd4c240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0019fb0 tx=0x7fd6b0019120 comp rx=0 tx=0).stop 2023-09-13T06:01:40.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 -- 172.21.15.130:0/807169846 shutdown_connections 2023-09-13T06:01:40.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.130:6834/660561895,v1:172.21.15.130:6836/660561895] conn(0x5634efd52bd0 0x5634efd54fc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5634efcede70 0x5634efcff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634efced550 0x5634efd4c240 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 --2- 172.21.15.130:0/807169846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5634efcd22b0 0x5634efd4bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 -- 172.21.15.130:0/807169846 >> 172.21.15.130:0/807169846 conn(0x5634efc9ac40 msgr2=0x5634efcd0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:40.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6a0ff9640 0 client.4674 ms_handle_reset on v2:172.21.15.130:6834/660561895 2023-09-13T06:01:40.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 -- 172.21.15.130:0/807169846 shutdown_connections 2023-09-13T06:01:40.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 1 -- 172.21.15.130:0/807169846 wait complete. 2023-09-13T06:01:40.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6cafd2000 20 client.4674 trim_cache size 0 max 16384 2023-09-13T06:01:40.498 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:01:40.498 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:01:40.498 INFO:teuthology.orchestra.run.smithi130.stdout: "whoami": 0, 2023-09-13T06:01:40.498 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 4281, 2023-09-13T06:01:40.499 INFO:teuthology.orchestra.run.smithi130.stdout: "want_state": "up:active", 2023-09-13T06:01:40.499 INFO:teuthology.orchestra.run.smithi130.stdout: "state": "up:active", 2023-09-13T06:01:40.499 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs", 2023-09-13T06:01:40.499 INFO:teuthology.orchestra.run.smithi130.stdout: "rank_uptime": 14.167091415, 2023-09-13T06:01:40.499 INFO:teuthology.orchestra.run.smithi130.stdout: "mdsmap_epoch": 7, 2023-09-13T06:01:40.500 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch": 21, 2023-09-13T06:01:40.500 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch_barrier": 21, 2023-09-13T06:01:40.500 INFO:teuthology.orchestra.run.smithi130.stdout: "uptime": 21.723019856000001 2023-09-13T06:01:40.500 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:01:40.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 -- 172.21.15.130:0/3364352584 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd6a4065b20 msgr2=0x7fd6a4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:40.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd6a4065b20 0x7fd6a4067fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc000f70 tx=0x7fd6bc009040 comp rx=0 tx=0).stop 2023-09-13T06:01:40.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 -- 172.21.15.130:0/3364352584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c0159f20 msgr2=0x7fd6c014d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:40.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c0159f20 0x7fd6c014d880 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800ce70 tx=0x7fd6b800a710 comp rx=0 tx=0).stop 2023-09-13T06:01:40.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 -- 172.21.15.130:0/3364352584 shutdown_connections 2023-09-13T06:01:40.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd6a4065b20 0x7fd6a4067fe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6c00cdfc0 0x7fd6c014d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c0159f20 0x7fd6c014d880 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 --2- 172.21.15.130:0/3364352584 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6c00b1d20 0x7fd6c014bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:40.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 -- 172.21.15.130:0/3364352584 >> 172.21.15.130:0/3364352584 conn(0x7fd6c0065990 msgr2=0x7fd6c0155740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:40.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 -- 172.21.15.130:0/3364352584 shutdown_connections 2023-09-13T06:01:40.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:40.476+0000 7fd6c7c48640 1 -- 172.21.15.130:0/3364352584 wait complete. 2023-09-13T06:01:40.504 INFO:teuthology.run_tasks:Running task kclient... 2023-09-13T06:01:40.531 INFO:tasks.kclient:Mounting kernel clients... 2023-09-13T06:01:40.532 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-09-13T06:01:40.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:40.533 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:01:40.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:40.544 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2023-09-13T06:01:40.614 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2023-09-13T06:01:40.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:01:40.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:40.617 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:01:40.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:40.671 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2023-09-13T06:01:40.741 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2023-09-13T06:01:40.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:01:40.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:40.744 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:01:40.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:40.755 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2023-09-13T06:01:40.823 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2023-09-13T06:01:40.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:01:40.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:40.826 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:01:40.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:40.880 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2023-09-13T06:01:40.946 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2023-09-13T06:01:40.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:01:40.949 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-09-13T06:01:40.949 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-13T06:01:40.950 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:01:40.950 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:01:41.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f564a619640 1 Processor -- start 2023-09-13T06:01:41.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f564a619640 1 -- start start 2023-09-13T06:01:41.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f564a619640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f56440d1090 0x7f564415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:41.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f564a619640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440b63c0 con 0x7f5644146f30 2023-09-13T06:01:41.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f564a619640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440d0c20 con 0x7f56440d1750 2023-09-13T06:01:41.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f564a619640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564415dea0 con 0x7f56440d1090 2023-09-13T06:01:41.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5648bb6640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5644146f30 0x7f56440b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37072/0 (socket says 172.21.15.130:37072) 2023-09-13T06:01:41.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5648bb6640 1 -- 172.21.15.130:0/2793727311 learned_addr learned my addr 172.21.15.130:0/2793727311 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:41.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f56437fe640 1 --2- 172.21.15.130:0/2793727311 >> v2:172.21.15.164:3300/0 conn(0x7f56440d1090 0x7f564415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:41.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123973866 0 0) 0x7f56440b63c0 con 0x7f5644146f30 2023-09-13T06:01:41.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f562c003530 con 0x7f5644146f30 2023-09-13T06:01:41.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693573889 0 0) 0x7f56440d0c20 con 0x7f56440d1750 2023-09-13T06:01:41.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56440b63c0 con 0x7f56440d1750 2023-09-13T06:01:41.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3166493549 0 0) 0x7f562c003530 con 0x7f5644146f30 2023-09-13T06:01:41.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 >> v2:172.21.15.164:3300/0 conn(0x7f56440d1090 msgr2=0x7f564415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:41.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 --2- 172.21.15.130:0/2793727311 >> v2:172.21.15.164:3300/0 conn(0x7f56440d1090 0x7f564415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:41.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 >> v1:172.21.15.164:6789/0 conn(0x7f56440d1750 legacy=0x7f5644146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:41.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440b6610 con 0x7f5644146f30 2023-09-13T06:01:41.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f563c001a00 con 0x7f5644146f30 2023-09-13T06:01:41.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 >> v1:172.21.15.130:6789/0 conn(0x7f5644146f30 legacy=0x7f56440b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:41.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 --2- 172.21.15.130:0/2793727311 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f562c003bd0 0x7f562c003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:41.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 --2- 172.21.15.130:0/2793727311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 0x7f562c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:41.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 --2- 172.21.15.130:0/2793727311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f562c005250 0x7f562c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:41.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c00c130 con 0x7f562c0047d0 2023-09-13T06:01:41.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c00c2a0 con 0x7f562c005250 2023-09-13T06:01:41.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.084+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c00c460 con 0x7f562c003bd0 2023-09-13T06:01:41.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f56437fe640 1 --2- 172.21.15.130:0/2793727311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 0x7f562c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:41.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f5648bb6640 1 --2- 172.21.15.130:0/2793727311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f562c005250 0x7f562c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:41.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f5643fff640 1 --2- 172.21.15.130:0/2793727311 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f562c003bd0 0x7f562c003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:41.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f56437fe640 1 -- 172.21.15.130:0/2793727311 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f562c003bd0 msgr2=0x7f562c003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:41.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f56437fe640 1 --2- 172.21.15.130:0/2793727311 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f562c003bd0 0x7f562c003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:41.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f56437fe640 1 -- 172.21.15.130:0/2793727311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f562c005250 msgr2=0x7f562c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:41.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f56437fe640 1 --2- 172.21.15.130:0/2793727311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f562c005250 0x7f562c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:41.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f56437fe640 1 -- 172.21.15.130:0/2793727311 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c003530 con 0x7f562c0047d0 2023-09-13T06:01:41.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f5648bb6640 1 -- 172.21.15.130:0/2793727311 reap_dead start 2023-09-13T06:01:41.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f56437fe640 1 --2- 172.21.15.130:0/2793727311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 0x7f562c004c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5638009ab0 tx=0x7f563801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc73ec484b6e34f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:41.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56380a55d0 con 0x7f562c0047d0 2023-09-13T06:01:41.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56380a5730 con 0x7f562c0047d0 2023-09-13T06:01:41.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.088+0000 7f5642ffd640 1 -- 172.21.15.130:0/2793727311 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56380a5ae0 con 0x7f562c0047d0 2023-09-13T06:01:41.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 -- 172.21.15.130:0/2793727311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 msgr2=0x7f562c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:41.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 --2- 172.21.15.130:0/2793727311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 0x7f562c004c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5638009ab0 tx=0x7f563801ca00 comp rx=0 tx=0).stop 2023-09-13T06:01:41.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 -- 172.21.15.130:0/2793727311 shutdown_connections 2023-09-13T06:01:41.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 --2- 172.21.15.130:0/2793727311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 0x7f562c004c50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:41.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 -- 172.21.15.130:0/2793727311 >> 172.21.15.130:0/2793727311 conn(0x7f564406f170 msgr2=0x7f564406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:41.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 -- 172.21.15.130:0/2793727311 shutdown_connections 2023-09-13T06:01:41.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 -- 172.21.15.130:0/2793727311 wait complete. 2023-09-13T06:01:41.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 Processor -- start 2023-09-13T06:01:41.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 -- start start 2023-09-13T06:01:41.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 0x7f5644152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:41.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56440cdc20 0x7f56440ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:41.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5644151120 0x7f56441515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:41.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56441528d0 con 0x7f562c0047d0 2023-09-13T06:01:41.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5644151c50 con 0x7f5644151120 2023-09-13T06:01:41.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f564a619640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5644151f30 con 0x7f56440cdc20 2023-09-13T06:01:41.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f5643fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 0x7f5644152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:41.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f5643fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 0x7f5644152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:32972/0 (socket says 172.21.15.130:32972) 2023-09-13T06:01:41.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f5643fff640 1 -- 172.21.15.130:0/3525223807 learned_addr learned my addr 172.21.15.130:0/3525223807 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:41.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f56437fe640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56440cdc20 0x7f56440ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:41.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f5648bb6640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5644151120 0x7f56441515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:41.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f5643fff640 1 -- 172.21.15.130:0/3525223807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56440cdc20 msgr2=0x7f56440ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:41.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f5643fff640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56440cdc20 0x7f56440ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:41.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f5643fff640 1 -- 172.21.15.130:0/3525223807 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5644151120 msgr2=0x7f56441515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:41.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f5643fff640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5644151120 0x7f56441515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:41.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.092+0000 7f5643fff640 1 -- 172.21.15.130:0/3525223807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5644152210 con 0x7f562c0047d0 2023-09-13T06:01:41.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.096+0000 7f5643fff640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 0x7f5644152cf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f563400f770 tx=0x7f563400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:41.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.096+0000 7f5640ff9640 1 -- 172.21.15.130:0/3525223807 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563400fe80 con 0x7f562c0047d0 2023-09-13T06:01:41.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.096+0000 7f5640ff9640 1 -- 172.21.15.130:0/3525223807 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5634005320 con 0x7f562c0047d0 2023-09-13T06:01:41.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.096+0000 7f5640ff9640 1 -- 172.21.15.130:0/3525223807 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634006a20 con 0x7f562c0047d0 2023-09-13T06:01:41.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.096+0000 7f564a619640 1 -- 172.21.15.130:0/3525223807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56441524f0 con 0x7f562c0047d0 2023-09-13T06:01:41.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.096+0000 7f564a619640 1 -- 172.21.15.130:0/3525223807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564413c980 con 0x7f562c0047d0 2023-09-13T06:01:41.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.096+0000 7f564a619640 1 -- 172.21.15.130:0/3525223807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56440618a0 con 0x7f562c0047d0 2023-09-13T06:01:41.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.096+0000 7f5640ff9640 1 -- 172.21.15.130:0/3525223807 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5634006b80 con 0x7f562c0047d0 2023-09-13T06:01:41.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.096+0000 7f5640ff9640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5630065b50 0x7f5630068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:41.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.096+0000 7f5640ff9640 1 -- 172.21.15.130:0/3525223807 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5634082ae0 con 0x7f562c0047d0 2023-09-13T06:01:41.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.096+0000 7f56437fe640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5630065b50 0x7f5630068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:41.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.100+0000 7f56437fe640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5630065b50 0x7f5630068010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f56380af000 tx=0x7f56380046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:41.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.100+0000 7f5640ff9640 1 -- 172.21.15.130:0/3525223807 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5634053d90 con 0x7f562c0047d0 2023-09-13T06:01:41.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.280+0000 7f564a619640 1 -- 172.21.15.130:0/3525223807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f56440b86c0 con 0x7f562c0047d0 2023-09-13T06:01:41.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.280+0000 7f5640ff9640 1 -- 172.21.15.130:0/3525223807 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f563401a020 con 0x7f562c0047d0 2023-09-13T06:01:41.286 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:01:41.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 -- 172.21.15.130:0/3525223807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5630065b50 msgr2=0x7f5630068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:41.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5630065b50 0x7f5630068010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f56380af000 tx=0x7f56380046d0 comp rx=0 tx=0).stop 2023-09-13T06:01:41.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 -- 172.21.15.130:0/3525223807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 msgr2=0x7f5644152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:41.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 0x7f5644152cf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f563400f770 tx=0x7f563400fc30 comp rx=0 tx=0).stop 2023-09-13T06:01:41.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 -- 172.21.15.130:0/3525223807 shutdown_connections 2023-09-13T06:01:41.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5630065b50 0x7f5630068010 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:41.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5644151120 0x7f56441515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:41.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56440cdc20 0x7f56440ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:41.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 --2- 172.21.15.130:0/3525223807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f562c0047d0 0x7f5644152cf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:41.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 -- 172.21.15.130:0/3525223807 >> 172.21.15.130:0/3525223807 conn(0x7f564406f170 msgr2=0x7f56440cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:41.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 -- 172.21.15.130:0/3525223807 shutdown_connections 2023-09-13T06:01:41.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:41.284+0000 7f564a619640 1 -- 172.21.15.130:0/3525223807 wait complete. 2023-09-13T06:01:41.307 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-13T06:01:41.307 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:01:41.308 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:01:41.308 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T06:01:41.308 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:01:41.308 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-13T06:01:41.309 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-13T06:01:41.309 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:01:41.309 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:01:41.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:41.310 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:01:41.320 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:01:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:01:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:01:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:41.320 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:01:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:41.321 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:41.321 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:01:41.321 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:01:41.322 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:41.322 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:41.322 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:01:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:01:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42406sec preferred_lft 42406sec 2023-09-13T06:01:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:01:41.323 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:41.324 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:01:41.324 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:41.324 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:01:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:41.326 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-13T06:01:41.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:41.326 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:01:41.327 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:01:41.327 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add name ceph-brx type bridge 2023-09-13T06:01:41.327 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr flush dev ceph-brx 2023-09-13T06:01:41.328 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set ceph-brx up 2023-09-13T06:01:41.328 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-13T06:01:41.328 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:01:41.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:41.440 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:01:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:01:41.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:41.463 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:01:41.536 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:01:41.537 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:01:41.537 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:01:41.537 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:01:41.537 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:01:41.537 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:01:41.538 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:41.538 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:41.538 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:41.538 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:01:41.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:41.539 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:01:41.539 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:01:41.540 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:01:41.540 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:01:41.540 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:01:41.541 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:01:41.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:41.630 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:01:41.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:41.641 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2023-09-13T06:01:41.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:41.695 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:01:41.696 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:01:41.696 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:01:41.697 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-13T06:01:41.697 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:01:41.783 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-13T06:01:41.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:41.784 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:01:41.784 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:01:41.785 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-13T06:01:41.785 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-13T06:01:41.785 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-13T06:01:41.785 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-13T06:01:41.786 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-13T06:01:41.786 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:01:41.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:41.947 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:01:41.947 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:01:41.948 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-09-13T06:01:41.948 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.0 master ceph-brx 2023-09-13T06:01:41.948 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:01:41.990 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:01:41.991 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T06:01:42.046 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:01:42.047 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:01:42.047 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:01:42.098 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:01:42.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:42.098 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:01:42.211 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:01:42.211 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:01:42.211 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:01:42.331 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:01:42.332 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:01:42.332 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:01:42.332 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:01:42.333 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:01:42.341 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:01:42.342 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:01:42.342 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:01:42.342 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:01:42.342 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:01:42.342 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:01:42.343 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:01:42.343 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:01:42.345 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:01:42.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:42.346 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:01:42.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:42.368 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:42.434 INFO:teuthology.orchestra.run.smithi130.stdout:client4597 2023-09-13T06:01:42.434 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:01:42.435 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:01:42.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:42.491 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:42.554 INFO:teuthology.orchestra.run.smithi130.stdout:client4597 2023-09-13T06:01:42.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:42.555 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:42.614 INFO:teuthology.orchestra.run.smithi130.stdout:client4597 2023-09-13T06:01:42.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:42.615 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client4597/status') 2023-09-13T06:01:42.681 INFO:teuthology.orchestra.run.smithi130.stdout:instance: client.4597 (3)172.21.15.130:0/1901368785 2023-09-13T06:01:42.682 INFO:teuthology.orchestra.run.smithi130.stdout:blocklisted: false 2023-09-13T06:01:42.682 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records in 2023-09-13T06:01:42.683 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records out 2023-09-13T06:01:42.683 INFO:teuthology.orchestra.run.smithi130.stderr:71 bytes copied, 6.7975e-05 s, 1.0 MB/s 2023-09-13T06:01:42.685 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-09-13T06:01:42.685 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-13T06:01:42.686 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-13T06:01:42.686 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:01:42.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.856+0000 7f3c2dc07640 1 Processor -- start 2023-09-13T06:01:42.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c2dc07640 1 -- start start 2023-09-13T06:01:42.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c2dc07640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3c28144a90 0x7f3c2815f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:42.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c2dc07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c280cc020 0x7f3c280cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:42.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c2dc07640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2815f530 con 0x7f3c28144e70 2023-09-13T06:01:42.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c2dc07640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c280cc9d0 con 0x7f3c28144a90 2023-09-13T06:01:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c2dc07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28070b60 con 0x7f3c280cc020 2023-09-13T06:01:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c277fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3c28144a90 0x7f3c2815f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c277fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3c28144a90 0x7f3c2815f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:32974/0 (socket says 172.21.15.130:32974) 2023-09-13T06:01:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c277fe640 1 -- 172.21.15.130:0/2830264050 learned_addr learned my addr 172.21.15.130:0/2830264050 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c27fff640 1 --2- 172.21.15.130:0/2830264050 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c280cc020 0x7f3c280cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:42.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c277fe640 1 -- 172.21.15.130:0/2830264050 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c280cc020 msgr2=0x7f3c280cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:42.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c277fe640 1 --2- 172.21.15.130:0/2830264050 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c280cc020 0x7f3c280cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:42.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c277fe640 1 -- 172.21.15.130:0/2830264050 >> v1:172.21.15.164:6789/0 conn(0x7f3c28144e70 legacy=0x7f3c280cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:42.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.860+0000 7f3c277fe640 1 -- 172.21.15.130:0/2830264050 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c280cb600 con 0x7f3c28144a90 2023-09-13T06:01:42.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c277fe640 1 --2- 172.21.15.130:0/2830264050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c28144a90 0x7f3c2815f9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009870 tx=0x7f3c1801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c57a7de2c3ed78c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:42.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c26ffd640 1 -- 172.21.15.130:0/2830264050 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180aa670 con 0x7f3c28144a90 2023-09-13T06:01:42.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c26ffd640 1 -- 172.21.15.130:0/2830264050 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c180aa7d0 con 0x7f3c28144a90 2023-09-13T06:01:42.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c26ffd640 1 -- 172.21.15.130:0/2830264050 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180aab60 con 0x7f3c28144a90 2023-09-13T06:01:42.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c2dc07640 1 -- 172.21.15.130:0/2830264050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c28144a90 msgr2=0x7f3c2815f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:42.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c2dc07640 1 --2- 172.21.15.130:0/2830264050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c28144a90 0x7f3c2815f9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009870 tx=0x7f3c1801c510 comp rx=0 tx=0).stop 2023-09-13T06:01:42.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c2dc07640 1 -- 172.21.15.130:0/2830264050 shutdown_connections 2023-09-13T06:01:42.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c2dc07640 1 --2- 172.21.15.130:0/2830264050 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c280cc020 0x7f3c280cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:42.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c2dc07640 1 --2- 172.21.15.130:0/2830264050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c28144a90 0x7f3c2815f9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:42.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c2dc07640 1 -- 172.21.15.130:0/2830264050 >> 172.21.15.130:0/2830264050 conn(0x7f3c28065ff0 msgr2=0x7f3c280b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:42.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c2dc07640 1 -- 172.21.15.130:0/2830264050 shutdown_connections 2023-09-13T06:01:42.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c2dc07640 1 -- 172.21.15.130:0/2830264050 wait complete. 2023-09-13T06:01:42.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c2dc07640 1 Processor -- start 2023-09-13T06:01:42.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.864+0000 7f3c2dc07640 1 -- start start 2023-09-13T06:01:42.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c2dc07640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c280cc020 0x7f3c2815af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:42.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c2dc07640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c28144a90 0x7f3c280cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:42.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c2dc07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c28144e70 0x7f3c2813c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:42.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c2dc07640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280ce0a0 con 0x7f3c28144a90 2023-09-13T06:01:42.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c2dc07640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281f6ae0 con 0x7f3c280cc020 2023-09-13T06:01:42.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c2dc07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280ce2d0 con 0x7f3c28144e70 2023-09-13T06:01:42.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c1ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c28144a90 0x7f3c280cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:42.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c1ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c28144a90 0x7f3c280cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:32988/0 (socket says 172.21.15.130:32988) 2023-09-13T06:01:42.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c1ffff640 1 -- 172.21.15.130:0/1902797196 learned_addr learned my addr 172.21.15.130:0/1902797196 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:42.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c277fe640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c280cc020 0x7f3c2815af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:42.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c27fff640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c28144e70 0x7f3c2813c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:42.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c1ffff640 1 -- 172.21.15.130:0/1902797196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c28144e70 msgr2=0x7f3c2813c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:42.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c1ffff640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c28144e70 0x7f3c2813c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:42.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c1ffff640 1 -- 172.21.15.130:0/1902797196 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c280cc020 msgr2=0x7f3c2815af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:42.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c1ffff640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c280cc020 0x7f3c2815af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:42.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c1ffff640 1 -- 172.21.15.130:0/1902797196 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c180094d0 con 0x7f3c28144a90 2023-09-13T06:01:42.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c1ffff640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c28144a90 0x7f3c280cf090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c390 tx=0x7f3c1000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:42.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c24ff9640 1 -- 172.21.15.130:0/1902797196 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c100052d0 con 0x7f3c28144a90 2023-09-13T06:01:42.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c24ff9640 1 -- 172.21.15.130:0/1902797196 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c10005430 con 0x7f3c28144a90 2023-09-13T06:01:42.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c2dc07640 1 -- 172.21.15.130:0/1902797196 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c280cb3d0 con 0x7f3c28144a90 2023-09-13T06:01:42.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c24ff9640 1 -- 172.21.15.130:0/1902797196 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10003820 con 0x7f3c28144a90 2023-09-13T06:01:42.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c2dc07640 1 -- 172.21.15.130:0/1902797196 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c280ce890 con 0x7f3c28144a90 2023-09-13T06:01:42.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c2dc07640 1 -- 172.21.15.130:0/1902797196 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c280618a0 con 0x7f3c28144a90 2023-09-13T06:01:42.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.868+0000 7f3c24ff9640 1 -- 172.21.15.130:0/1902797196 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3c10003980 con 0x7f3c28144a90 2023-09-13T06:01:42.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.872+0000 7f3c24ff9640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c08065b20 0x7f3c08067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:42.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.872+0000 7f3c24ff9640 1 -- 172.21.15.130:0/1902797196 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c10082710 con 0x7f3c28144a90 2023-09-13T06:01:42.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.872+0000 7f3c277fe640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c08065b20 0x7f3c08067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:42.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.872+0000 7f3c277fe640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c08065b20 0x7f3c08067fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c180ae000 tx=0x7f3c180b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:42.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:42.876+0000 7f3c24ff9640 1 -- 172.21.15.130:0/1902797196 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3c100501a0 con 0x7f3c28144a90 2023-09-13T06:01:43.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.052+0000 7f3c2dc07640 1 -- 172.21.15.130:0/1902797196 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3c28165cc0 con 0x7f3c28144a90 2023-09-13T06:01:43.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.052+0000 7f3c24ff9640 1 -- 172.21.15.130:0/1902797196 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3c10017060 con 0x7f3c28144a90 2023-09-13T06:01:43.057 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:01:43.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 -- 172.21.15.130:0/1902797196 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c08065b20 msgr2=0x7f3c08067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:43.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c08065b20 0x7f3c08067fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c180ae000 tx=0x7f3c180b5040 comp rx=0 tx=0).stop 2023-09-13T06:01:43.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 -- 172.21.15.130:0/1902797196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c28144a90 msgr2=0x7f3c280cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:43.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c28144a90 0x7f3c280cf090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c390 tx=0x7f3c1000c850 comp rx=0 tx=0).stop 2023-09-13T06:01:43.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 -- 172.21.15.130:0/1902797196 shutdown_connections 2023-09-13T06:01:43.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c08065b20 0x7f3c08067fe0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:43.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c28144e70 0x7f3c2813c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:43.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c28144a90 0x7f3c280cf090 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:43.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 --2- 172.21.15.130:0/1902797196 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c280cc020 0x7f3c2815af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:43.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 -- 172.21.15.130:0/1902797196 >> 172.21.15.130:0/1902797196 conn(0x7f3c28065ff0 msgr2=0x7f3c280afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:43.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 -- 172.21.15.130:0/1902797196 shutdown_connections 2023-09-13T06:01:43.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:43.056+0000 7f3c2dc07640 1 -- 172.21.15.130:0/1902797196 wait complete. 2023-09-13T06:01:43.077 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-13T06:01:43.078 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:01:43.078 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:01:43.078 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-09-13T06:01:43.079 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-13T06:01:43.079 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-13T06:01:43.079 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-13T06:01:43.079 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:01:43.079 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-09-13T06:01:43.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.080 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:01:43.090 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:01:43.091 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:01:43.091 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:01:43.091 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.091 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:01:43.092 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.092 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:43.092 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:43.092 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:01:43.092 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:43.092 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:43.093 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:01:43.093 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:43.093 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:43.093 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:01:43.093 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:43.094 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:01:43.094 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42404sec preferred_lft 42404sec 2023-09-13T06:01:43.094 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:01:43.094 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.094 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:01:43.095 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:43.095 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:01:43.095 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.095 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:01:43.095 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:43.096 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:01:43.096 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.096 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-09-13T06:01:43.096 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.096 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:01:43.096 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:01:43.097 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-09-13T06:01:43.097 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.097 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:01:43.156 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:01:43.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.159 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:01:43.213 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:01:43.213 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:01:43.214 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:01:43.214 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:01:43.214 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:01:43.214 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:01:43.214 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:43.215 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:43.215 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:43.215 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:01:43.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.216 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:01:43.216 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:01:43.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:01:43.217 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:01:43.217 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:01:43.217 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:01:43.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.311 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:01:43.321 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:01:43.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.322 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2023-09-13T06:01:43.370 INFO:teuthology.orchestra.run.smithi130.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-09-13T06:01:43.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.371 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:01:43.371 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:01:43.372 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:01:43.372 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-09-13T06:01:43.372 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:01:43.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.453 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-13T06:01:43.516 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:01:43.516 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:01:43.516 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:01:43.517 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.517 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:01:43.517 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.517 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:01:43.517 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 86:09:e8:40:b7:64 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-13T06:01:43.517 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-13T06:01:43.518 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.518 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::8409:e8ff:fe40:b764/64 scope link 2023-09-13T06:01:43.518 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.520 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-13T06:01:43.583 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:01:43.584 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:01:43.584 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:01:43.584 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.584 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:01:43.585 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.585 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:01:43.585 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 86:09:e8:40:b7:64 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-13T06:01:43.585 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-13T06:01:43.585 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.586 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::8409:e8ff:fe40:b764/64 scope link 2023-09-13T06:01:43.586 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:43.587 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-09-13T06:01:43.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.588 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:01:43.588 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:01:43.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-09-13T06:01:43.589 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-13T06:01:43.589 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-09-13T06:01:43.589 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-09-13T06:01:43.590 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-09-13T06:01:43.590 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:01:43.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.729 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:01:43.729 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:01:43.729 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.1 up 2023-09-13T06:01:43.730 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.1 master ceph-brx 2023-09-13T06:01:43.730 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:01:43.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:01:43.772 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-09-13T06:01:43.826 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-09-13T06:01:43.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:01:43.827 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-09-13T06:01:43.878 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:01:43.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:43.879 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-13T06:01:43.912 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:01:43.926 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:01:43.972 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-13T06:01:43.972 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-13T06:01:43.973 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:01:43.987 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-13T06:01:43.988 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-13T06:01:43.988 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:01:43.988 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:01:43.988 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-13T06:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-13T06:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:01:43.996 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:01:43.997 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:01:43.997 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:01:43.997 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:01:43.997 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:01:43.999 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:01:44.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:44.000 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-09-13T06:01:44.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:44.066 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:44.125 INFO:teuthology.orchestra.run.smithi130.stdout:client4606 2023-09-13T06:01:44.125 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:01:44.125 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:01:44.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:44.175 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:44.229 INFO:teuthology.orchestra.run.smithi130.stdout:client4606 2023-09-13T06:01:44.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:44.230 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:44.280 INFO:teuthology.orchestra.run.smithi130.stdout:client4606 2023-09-13T06:01:44.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:44.282 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client4606/status') 2023-09-13T06:01:44.342 INFO:teuthology.orchestra.run.smithi130.stdout:instance: client.4606 (3)172.21.15.130:0/3461803496 2023-09-13T06:01:44.343 INFO:teuthology.orchestra.run.smithi130.stdout:blocklisted: false 2023-09-13T06:01:44.343 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records in 2023-09-13T06:01:44.344 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records out 2023-09-13T06:01:44.344 INFO:teuthology.orchestra.run.smithi130.stderr:71 bytes copied, 5.0169e-05 s, 1.4 MB/s 2023-09-13T06:01:44.346 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-09-13T06:01:44.347 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-13T06:01:44.347 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:01:44.347 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:01:44.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fe379640 1 Processor -- start 2023-09-13T06:01:44.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fe379640 1 -- start start 2023-09-13T06:01:44.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fe379640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40f8146b30 0x7f40f80d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:44.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fe379640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f40f80d1f50 0x7f40f815d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:44.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fe379640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f80d1ac0 con 0x7f40f80d0a10 2023-09-13T06:01:44.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fe379640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f80d0eb0 con 0x7f40f80d1f50 2023-09-13T06:01:44.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fe379640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80d1190 con 0x7f40f8146b30 2023-09-13T06:01:44.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fdb78640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f40f80d1f50 0x7f40f815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:44.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fdb78640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f40f80d1f50 0x7f40f815d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:32990/0 (socket says 172.21.15.130:32990) 2023-09-13T06:01:44.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fdb78640 1 -- 172.21.15.130:0/667529115 learned_addr learned my addr 172.21.15.130:0/667529115 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:44.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fd377640 1 --2- 172.21.15.130:0/667529115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40f8146b30 0x7f40f80d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:44.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fdb78640 1 -- 172.21.15.130:0/667529115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40f8146b30 msgr2=0x7f40f80d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:44.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fdb78640 1 --2- 172.21.15.130:0/667529115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40f8146b30 0x7f40f80d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:44.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fdb78640 1 -- 172.21.15.130:0/667529115 >> v1:172.21.15.164:6789/0 conn(0x7f40f80d0a10 legacy=0x7f40f8070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:44.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.528+0000 7f40fdb78640 1 -- 172.21.15.130:0/667529115 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f80d1470 con 0x7f40f80d1f50 2023-09-13T06:01:44.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40fdb78640 1 --2- 172.21.15.130:0/667529115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f80d1f50 0x7f40f815d760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009e50 tx=0x7f40f001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c24e4126361c025 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:44.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40effff640 1 -- 172.21.15.130:0/667529115 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00a58d0 con 0x7f40f80d1f50 2023-09-13T06:01:44.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40effff640 1 -- 172.21.15.130:0/667529115 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f00a5a30 con 0x7f40f80d1f50 2023-09-13T06:01:44.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40effff640 1 -- 172.21.15.130:0/667529115 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00a5dc0 con 0x7f40f80d1f50 2023-09-13T06:01:44.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40fe379640 1 -- 172.21.15.130:0/667529115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f80d1f50 msgr2=0x7f40f815d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:44.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40fe379640 1 --2- 172.21.15.130:0/667529115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f80d1f50 0x7f40f815d760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009e50 tx=0x7f40f001c9e0 comp rx=0 tx=0).stop 2023-09-13T06:01:44.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40fe379640 1 -- 172.21.15.130:0/667529115 shutdown_connections 2023-09-13T06:01:44.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40fe379640 1 --2- 172.21.15.130:0/667529115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f80d1f50 0x7f40f815d760 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:44.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40fe379640 1 --2- 172.21.15.130:0/667529115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40f8146b30 0x7f40f80d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:44.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40fe379640 1 -- 172.21.15.130:0/667529115 >> 172.21.15.130:0/667529115 conn(0x7f40f80d3090 msgr2=0x7f40f80d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:44.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40fe379640 1 -- 172.21.15.130:0/667529115 shutdown_connections 2023-09-13T06:01:44.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.532+0000 7f40fe379640 1 -- 172.21.15.130:0/667529115 wait complete. 2023-09-13T06:01:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fe379640 1 Processor -- start 2023-09-13T06:01:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fe379640 1 -- start start 2023-09-13T06:01:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fe379640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40f80d0a10 0x7f40f8145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fe379640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f80d1f50 0x7f40f8139e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fe379640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40f8146b30 0x7f40f80c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fe379640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f8141810 con 0x7f40f80d1f50 2023-09-13T06:01:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fe379640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f813a350 con 0x7f40f8146b30 2023-09-13T06:01:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fe379640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f8138d70 con 0x7f40f80d0a10 2023-09-13T06:01:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fcb76640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f80d1f50 0x7f40f8139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fcb76640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f80d1f50 0x7f40f8139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33002/0 (socket says 172.21.15.130:33002) 2023-09-13T06:01:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fcb76640 1 -- 172.21.15.130:0/1916497087 learned_addr learned my addr 172.21.15.130:0/1916497087 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fd377640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40f80d0a10 0x7f40f8145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fdb78640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40f8146b30 0x7f40f80c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fcb76640 1 -- 172.21.15.130:0/1916497087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40f80d0a10 msgr2=0x7f40f8145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fcb76640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40f80d0a10 0x7f40f8145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fcb76640 1 -- 172.21.15.130:0/1916497087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40f8146b30 msgr2=0x7f40f80c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fcb76640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40f8146b30 0x7f40f80c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fcb76640 1 -- 172.21.15.130:0/1916497087 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f0009b30 con 0x7f40f80d1f50 2023-09-13T06:01:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fcb76640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f80d1f50 0x7f40f8139e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f40e800c500 tx=0x7f40e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40edffb640 1 -- 172.21.15.130:0/1916497087 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8005220 con 0x7f40f80d1f50 2023-09-13T06:01:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40edffb640 1 -- 172.21.15.130:0/1916497087 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e8005380 con 0x7f40f80d1f50 2023-09-13T06:01:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fe379640 1 -- 172.21.15.130:0/1916497087 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f8139050 con 0x7f40f80d1f50 2023-09-13T06:01:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40edffb640 1 -- 172.21.15.130:0/1916497087 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8007270 con 0x7f40f80d1f50 2023-09-13T06:01:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.536+0000 7f40fe379640 1 -- 172.21.15.130:0/1916497087 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f8141430 con 0x7f40f80d1f50 2023-09-13T06:01:44.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.540+0000 7f40fe379640 1 -- 172.21.15.130:0/1916497087 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f8141950 con 0x7f40f80d1f50 2023-09-13T06:01:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.540+0000 7f40edffb640 1 -- 172.21.15.130:0/1916497087 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f40e80073d0 con 0x7f40f80d1f50 2023-09-13T06:01:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.540+0000 7f40edffb640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40dc065b20 0x7f40dc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.540+0000 7f40edffb640 1 -- 172.21.15.130:0/1916497087 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40e8082b60 con 0x7f40f80d1f50 2023-09-13T06:01:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.540+0000 7f40fd377640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40dc065b20 0x7f40dc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.540+0000 7f40fd377640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40dc065b20 0x7f40dc067fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f40f40079c0 tx=0x7f40f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:44.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.544+0000 7f40edffb640 1 -- 172.21.15.130:0/1916497087 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f40f8141950 con 0x7f40f80d1f50 2023-09-13T06:01:44.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.724+0000 7f40fe379640 1 -- 172.21.15.130:0/1916497087 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40f8141950 con 0x7f40f80d1f50 2023-09-13T06:01:44.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.724+0000 7f40edffb640 1 -- 172.21.15.130:0/1916497087 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f40f8141950 con 0x7f40f80d1f50 2023-09-13T06:01:44.730 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:01:44.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 -- 172.21.15.130:0/1916497087 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40dc065b20 msgr2=0x7f40dc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:44.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40dc065b20 0x7f40dc067fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f40f40079c0 tx=0x7f40f4008040 comp rx=0 tx=0).stop 2023-09-13T06:01:44.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 -- 172.21.15.130:0/1916497087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f80d1f50 msgr2=0x7f40f8139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:44.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f80d1f50 0x7f40f8139e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f40e800c500 tx=0x7f40e800c9c0 comp rx=0 tx=0).stop 2023-09-13T06:01:44.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 -- 172.21.15.130:0/1916497087 shutdown_connections 2023-09-13T06:01:44.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40dc065b20 0x7f40dc067fe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:44.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40f8146b30 0x7f40f80c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:44.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f80d1f50 0x7f40f8139e10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:44.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 --2- 172.21.15.130:0/1916497087 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40f80d0a10 0x7f40f8145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:44.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 -- 172.21.15.130:0/1916497087 >> 172.21.15.130:0/1916497087 conn(0x7f40f80d3090 msgr2=0x7f40f8145b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:44.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 -- 172.21.15.130:0/1916497087 shutdown_connections 2023-09-13T06:01:44.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:44.728+0000 7f40fe379640 1 -- 172.21.15.130:0/1916497087 wait complete. 2023-09-13T06:01:44.750 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-13T06:01:44.751 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:01:44.751 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:01:44.751 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T06:01:44.751 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:01:44.752 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-13T06:01:44.752 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-13T06:01:44.752 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:01:44.752 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:01:44.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:44.753 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:01:44.763 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:01:44.764 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:01:44.764 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:01:44.764 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:44.764 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:01:44.764 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:44.765 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:44.765 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:44.765 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:01:44.765 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:44.765 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:44.766 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:01:44.766 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:44.766 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:44.766 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:01:44.766 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:44.766 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:01:44.767 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42419sec preferred_lft 42419sec 2023-09-13T06:01:44.767 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:01:44.767 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:44.767 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:01:44.767 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:44.768 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:01:44.768 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:44.769 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-13T06:01:44.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:44.770 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:01:44.770 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:01:44.770 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add name ceph-brx type bridge 2023-09-13T06:01:44.770 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr flush dev ceph-brx 2023-09-13T06:01:44.771 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set ceph-brx up 2023-09-13T06:01:44.771 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-13T06:01:44.771 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:01:44.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:44.888 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:01:44.908 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:01:44.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:44.910 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:01:44.985 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:01:44.986 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:01:44.986 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:01:44.986 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:01:44.986 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:01:44.987 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:01:44.987 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:44.987 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:44.987 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:44.988 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:01:44.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:44.988 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:01:44.989 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:01:44.989 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:01:44.989 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:01:44.990 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:01:44.990 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:01:45.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:45.078 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:01:45.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:45.089 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2023-09-13T06:01:45.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:45.340 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:01:45.340 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:01:45.341 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:01:45.342 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-09-13T06:01:45.342 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:01:45.385 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-09-13T06:01:45.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:45.387 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:01:45.387 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:01:45.388 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-09-13T06:01:45.388 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-13T06:01:45.388 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-09-13T06:01:45.389 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-09-13T06:01:45.389 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-09-13T06:01:45.390 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:01:45.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:45.567 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:01:45.568 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:01:45.568 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-09-13T06:01:45.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.0 master ceph-brx 2023-09-13T06:01:45.569 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:01:45.612 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:01:45.612 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T06:01:45.666 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:01:45.667 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:01:45.667 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:01:45.721 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:01:45.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:45.722 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:01:45.823 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:01:45.823 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:01:45.823 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:01:45.949 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:01:45.950 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:01:45.950 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:01:45.950 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:01:45.951 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:01:45.961 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:01:45.961 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:01:45.961 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:01:45.961 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:01:45.962 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:01:45.962 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:01:45.962 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:01:45.963 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:01:45.964 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:01:45.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:45.965 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:01:45.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:45.987 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:46.050 INFO:teuthology.orchestra.run.smithi164.stdout:client4695 2023-09-13T06:01:46.051 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:01:46.052 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:01:46.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:46.104 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:46.157 INFO:teuthology.orchestra.run.smithi164.stdout:client4695 2023-09-13T06:01:46.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:46.158 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:46.210 INFO:teuthology.orchestra.run.smithi164.stdout:client4695 2023-09-13T06:01:46.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:46.211 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client4695/status') 2023-09-13T06:01:46.274 INFO:teuthology.orchestra.run.smithi164.stdout:instance: client.4695 (3)172.21.15.164:0/501401208 2023-09-13T06:01:46.274 INFO:teuthology.orchestra.run.smithi164.stdout:blocklisted: false 2023-09-13T06:01:46.275 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2023-09-13T06:01:46.275 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2023-09-13T06:01:46.275 INFO:teuthology.orchestra.run.smithi164.stderr:70 bytes copied, 5.1334e-05 s, 1.4 MB/s 2023-09-13T06:01:46.276 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-09-13T06:01:46.276 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-13T06:01:46.277 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-13T06:01:46.277 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:01:46.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad400b640 1 Processor -- start 2023-09-13T06:01:46.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad400b640 1 -- start start 2023-09-13T06:01:46.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad400b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7faacc0d1750 0x7faacc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:46.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad400b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc0b63c0 con 0x7faacc146f30 2023-09-13T06:01:46.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad400b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc0d0c20 con 0x7faacc0d1090 2023-09-13T06:01:46.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad400b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faacc15dea0 con 0x7faacc0d1750 2023-09-13T06:01:46.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad25a8640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7faacc146f30 0x7faacc0b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37078/0 (socket says 172.21.15.130:37078) 2023-09-13T06:01:46.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad25a8640 1 -- 172.21.15.130:0/1478974425 learned_addr learned my addr 172.21.15.130:0/1478974425 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:46.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad1da7640 1 --2- 172.21.15.130:0/1478974425 >> v2:172.21.15.164:3300/0 conn(0x7faacc0d1750 0x7faacc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:46.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad0da5640 1 -- 172.21.15.130:0/1478974425 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401651706 0 0) 0x7faacc0b63c0 con 0x7faacc146f30 2023-09-13T06:01:46.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad0da5640 1 -- 172.21.15.130:0/1478974425 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab8003530 con 0x7faacc146f30 2023-09-13T06:01:46.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad1da7640 1 -- 172.21.15.130:0/1478974425 >> v1:172.21.15.164:6789/0 conn(0x7faacc0d1090 legacy=0x7faacc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:46.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad1da7640 1 -- 172.21.15.130:0/1478974425 >> v1:172.21.15.130:6789/0 conn(0x7faacc146f30 legacy=0x7faacc0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:46.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.424+0000 7faad1da7640 1 -- 172.21.15.130:0/1478974425 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc0b6610 con 0x7faacc0d1750 2023-09-13T06:01:46.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.428+0000 7faad1da7640 1 --2- 172.21.15.130:0/1478974425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faacc0d1750 0x7faacc15d960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faac80097c0 tx=0x7faac801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c6e8186843b0c42 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:46.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.428+0000 7faad0da5640 1 -- 172.21.15.130:0/1478974425 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac80ac620 con 0x7faacc0d1750 2023-09-13T06:01:46.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.428+0000 7faad0da5640 1 -- 172.21.15.130:0/1478974425 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac80ac780 con 0x7faacc0d1750 2023-09-13T06:01:46.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.428+0000 7faad0da5640 1 -- 172.21.15.130:0/1478974425 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac80acb10 con 0x7faacc0d1750 2023-09-13T06:01:46.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.428+0000 7faad400b640 1 -- 172.21.15.130:0/1478974425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faacc0d1750 msgr2=0x7faacc15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:46.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.428+0000 7faad400b640 1 --2- 172.21.15.130:0/1478974425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faacc0d1750 0x7faacc15d960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faac80097c0 tx=0x7faac801c3c0 comp rx=0 tx=0).stop 2023-09-13T06:01:46.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.428+0000 7faad400b640 1 -- 172.21.15.130:0/1478974425 shutdown_connections 2023-09-13T06:01:46.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.428+0000 7faad400b640 1 --2- 172.21.15.130:0/1478974425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faacc0d1750 0x7faacc15d960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:46.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.428+0000 7faad400b640 1 -- 172.21.15.130:0/1478974425 >> 172.21.15.130:0/1478974425 conn(0x7faacc06f170 msgr2=0x7faacc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:46.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.428+0000 7faad400b640 1 -- 172.21.15.130:0/1478974425 shutdown_connections 2023-09-13T06:01:46.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.428+0000 7faad400b640 1 -- 172.21.15.130:0/1478974425 wait complete. 2023-09-13T06:01:46.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad400b640 1 Processor -- start 2023-09-13T06:01:46.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad400b640 1 -- start start 2023-09-13T06:01:46.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad400b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faacc0d1090 0x7faacc15cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:46.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad400b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faacc0d1750 0x7faacc1413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:46.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad400b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faacc146f30 0x7faacc141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:46.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad400b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc145500 con 0x7faacc0d1090 2023-09-13T06:01:46.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad400b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc0c9fa0 con 0x7faacc0d1750 2023-09-13T06:01:46.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad400b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faacc0c9670 con 0x7faacc146f30 2023-09-13T06:01:46.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad1da7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faacc0d1090 0x7faacc15cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:46.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad1da7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faacc0d1090 0x7faacc15cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33016/0 (socket says 172.21.15.130:33016) 2023-09-13T06:01:46.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad1da7640 1 -- 172.21.15.130:0/353762899 learned_addr learned my addr 172.21.15.130:0/353762899 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:46.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad25a8640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faacc146f30 0x7faacc141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:46.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad15a6640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faacc0d1750 0x7faacc1413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:46.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad1da7640 1 -- 172.21.15.130:0/353762899 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faacc146f30 msgr2=0x7faacc141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:46.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad1da7640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faacc146f30 0x7faacc141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:46.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad1da7640 1 -- 172.21.15.130:0/353762899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faacc0d1750 msgr2=0x7faacc1413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:46.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad1da7640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faacc0d1750 0x7faacc1413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:46.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad1da7640 1 -- 172.21.15.130:0/353762899 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac8009420 con 0x7faacc0d1090 2023-09-13T06:01:46.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad25a8640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faacc146f30 0x7faacc141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:46.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad1da7640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faacc0d1090 0x7faacc15cbc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faac8018fd0 tx=0x7faac801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:46.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faac27fc640 1 -- 172.21.15.130:0/353762899 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac80b8450 con 0x7faacc0d1090 2023-09-13T06:01:46.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faac27fc640 1 -- 172.21.15.130:0/353762899 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac80b85d0 con 0x7faacc0d1090 2023-09-13T06:01:46.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faac27fc640 1 -- 172.21.15.130:0/353762899 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac80b8980 con 0x7faacc0d1090 2023-09-13T06:01:46.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad400b640 1 -- 172.21.15.130:0/353762899 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc0c9950 con 0x7faacc0d1090 2023-09-13T06:01:46.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.432+0000 7faad400b640 1 -- 172.21.15.130:0/353762899 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc15d100 con 0x7faacc0d1090 2023-09-13T06:01:46.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.436+0000 7faad400b640 1 -- 172.21.15.130:0/353762899 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faacc142330 con 0x7faacc0d1090 2023-09-13T06:01:46.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.436+0000 7faac27fc640 1 -- 172.21.15.130:0/353762899 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7faac80aa070 con 0x7faacc0d1090 2023-09-13T06:01:46.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.436+0000 7faac27fc640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faab0065b20 0x7faab0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:46.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.436+0000 7faac27fc640 1 -- 172.21.15.130:0/353762899 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faac811d9e0 con 0x7faacc0d1090 2023-09-13T06:01:46.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.436+0000 7faad15a6640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faab0065b20 0x7faab0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:46.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.436+0000 7faad15a6640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faab0065b20 0x7faab0067fe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faacc0b2500 tx=0x7faabc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:46.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.440+0000 7faac27fc640 1 -- 172.21.15.130:0/353762899 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7faac80eb290 con 0x7faacc0d1090 2023-09-13T06:01:46.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 -- 172.21.15.130:0/353762899 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faacc0ca280 con 0x7faacc0d1090 2023-09-13T06:01:46.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faac27fc640 1 -- 172.21.15.130:0/353762899 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7faac80b1060 con 0x7faacc0d1090 2023-09-13T06:01:46.632 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:01:46.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 -- 172.21.15.130:0/353762899 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faab0065b20 msgr2=0x7faab0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:46.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faab0065b20 0x7faab0067fe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faacc0b2500 tx=0x7faabc009040 comp rx=0 tx=0).stop 2023-09-13T06:01:46.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 -- 172.21.15.130:0/353762899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faacc0d1090 msgr2=0x7faacc15cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:46.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faacc0d1090 0x7faacc15cbc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faac8018fd0 tx=0x7faac801ac00 comp rx=0 tx=0).stop 2023-09-13T06:01:46.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 -- 172.21.15.130:0/353762899 shutdown_connections 2023-09-13T06:01:46.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faab0065b20 0x7faab0067fe0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:46.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faacc0d1750 0x7faacc1413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:46.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faacc146f30 0x7faacc141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:46.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 --2- 172.21.15.130:0/353762899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faacc0d1090 0x7faacc15cbc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:46.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 -- 172.21.15.130:0/353762899 >> 172.21.15.130:0/353762899 conn(0x7faacc06f170 msgr2=0x7faacc0b70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:46.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 -- 172.21.15.130:0/353762899 shutdown_connections 2023-09-13T06:01:46.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:46.628+0000 7faad400b640 1 -- 172.21.15.130:0/353762899 wait complete. 2023-09-13T06:01:46.651 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-13T06:01:46.652 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:01:46.652 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:01:46.652 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-09-13T06:01:46.652 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-13T06:01:46.653 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-13T06:01:46.653 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-13T06:01:46.653 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:01:46.653 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-09-13T06:01:46.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:46.654 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:01:46.664 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:01:46.664 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:01:46.665 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:01:46.665 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:46.665 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:01:46.665 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:46.665 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:46.666 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:46.666 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:01:46.666 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:46.666 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:46.666 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:01:46.667 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:01:46.667 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:46.667 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:01:46.667 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:46.667 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:01:46.668 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42417sec preferred_lft 42417sec 2023-09-13T06:01:46.668 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:01:46.668 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:46.668 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:01:46.668 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:46.669 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:01:46.669 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:46.669 INFO:teuthology.orchestra.run.smithi164.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:01:46.669 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:01:46.669 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:01:46.670 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:46.670 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-09-13T06:01:46.670 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:46.670 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:01:46.670 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:01:46.671 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-09-13T06:01:46.671 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:46.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:46.672 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:01:46.730 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:01:46.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:46.732 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:01:46.785 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:01:46.786 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:01:46.786 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:01:46.786 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:01:46.786 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:01:46.787 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:01:46.787 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:46.787 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:46.787 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:01:46.787 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:01:46.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:46.788 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:01:46.789 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:01:46.789 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:01:46.789 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:01:46.790 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:01:46.790 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:01:46.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:46.877 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:01:46.886 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:01:46.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:46.888 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2023-09-13T06:01:46.942 INFO:teuthology.orchestra.run.smithi164.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-09-13T06:01:46.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:46.943 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:01:46.943 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:01:46.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:01:46.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-09-13T06:01:46.944 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:01:47.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:47.026 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-13T06:01:47.091 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:01:47.091 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:01:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:01:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:01:47.092 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:47.092 INFO:teuthology.orchestra.run.smithi164.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:01:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 46:a3:45:61:24:a6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-13T06:01:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-13T06:01:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::44a3:45ff:fe61:24a6/64 scope link 2023-09-13T06:01:47.093 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:47.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:47.097 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-13T06:01:47.159 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:01:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:01:47.159 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:01:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:01:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:47.160 INFO:teuthology.orchestra.run.smithi164.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:01:47.160 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 46:a3:45:61:24:a6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-13T06:01:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-13T06:01:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::44a3:45ff:fe61:24a6/64 scope link 2023-09-13T06:01:47.161 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:01:47.162 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-09-13T06:01:47.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:47.163 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:01:47.163 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:01:47.164 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-09-13T06:01:47.165 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-13T06:01:47.165 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-09-13T06:01:47.165 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-09-13T06:01:47.166 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-09-13T06:01:47.166 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:01:47.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:47.306 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:01:47.306 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:01:47.306 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.1 up 2023-09-13T06:01:47.307 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.1 master ceph-brx 2023-09-13T06:01:47.307 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:01:47.347 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:01:47.348 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-09-13T06:01:47.398 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-09-13T06:01:47.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:01:47.399 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-09-13T06:01:47.450 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:01:47.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:47.451 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-13T06:01:47.540 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-13T06:01:47.540 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-13T06:01:47.541 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:01:47.555 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-13T06:01:47.555 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-13T06:01:47.555 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:01:47.556 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:01:47.556 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:01:47.564 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-13T06:01:47.564 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-13T06:01:47.565 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:01:47.565 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:01:47.565 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:01:47.565 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:01:47.565 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:01:47.565 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:01:47.569 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:01:47.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:47.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-09-13T06:01:47.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:47.591 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:47.650 INFO:teuthology.orchestra.run.smithi164.stdout:client4624 2023-09-13T06:01:47.650 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:01:47.651 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:01:47.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:47.707 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:47.766 INFO:teuthology.orchestra.run.smithi164.stdout:client4624 2023-09-13T06:01:47.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:47.767 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:01:47.817 INFO:teuthology.orchestra.run.smithi164.stdout:client4624 2023-09-13T06:01:47.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:47.818 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client4624/status') 2023-09-13T06:01:47.878 INFO:teuthology.orchestra.run.smithi164.stdout:instance: client.4624 (3)192.168.0.2:0/1420100886 2023-09-13T06:01:47.878 INFO:teuthology.orchestra.run.smithi164.stdout:blocklisted: false 2023-09-13T06:01:47.879 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2023-09-13T06:01:47.879 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2023-09-13T06:01:47.879 INFO:teuthology.orchestra.run.smithi164.stderr:69 bytes copied, 4.8407e-05 s, 1.4 MB/s 2023-09-13T06:01:47.880 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-09-13T06:01:47.933 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:48.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.076+0000 7f0a0de7b640 1 Processor -- start 2023-09-13T06:01:48.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.076+0000 7f0a0de7b640 1 -- start start 2023-09-13T06:01:48.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a0de7b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0a0815d5f0 0x7f0a080cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a0de7b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a080ae170 0x7f0a080cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a0de7b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a080cce60 con 0x7f0a0815d9d0 2023-09-13T06:01:48.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a0de7b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a080cd140 con 0x7f0a0815d5f0 2023-09-13T06:01:48.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a0de7b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080cd420 con 0x7f0a080ae170 2023-09-13T06:01:48.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a077fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0a0815d5f0 0x7f0a080cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a06ffd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a080ae170 0x7f0a080cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a07fff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0a0815d9d0 0x7f0a081591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:39274/0 (socket says 172.21.15.130:39274) 2023-09-13T06:01:48.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a07fff640 1 -- 172.21.15.130:0/1206932690 learned_addr learned my addr 172.21.15.130:0/1206932690 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:48.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a077fe640 1 -- 172.21.15.130:0/1206932690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a080ae170 msgr2=0x7f0a080cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:48.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a077fe640 1 --2- 172.21.15.130:0/1206932690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a080ae170 0x7f0a080cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a077fe640 1 -- 172.21.15.130:0/1206932690 >> v1:172.21.15.164:6789/0 conn(0x7f0a0815d9d0 legacy=0x7f0a081591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a077fe640 1 -- 172.21.15.130:0/1206932690 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a080cd700 con 0x7f0a0815d5f0 2023-09-13T06:01:48.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a06ffd640 1 --2- 172.21.15.130:0/1206932690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a080ae170 0x7f0a080cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:48.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.080+0000 7f0a067fc640 1 -- 172.21.15.130:0/1206932690 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659785798 0 0) 0x7f0a080cce60 con 0x7f0a0815d9d0 2023-09-13T06:01:48.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a077fe640 1 --2- 172.21.15.130:0/1206932690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a0815d5f0 0x7f0a080cc7f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f09f800a960 tx=0x7f09f801d7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a56bf76010f23f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:48.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a067fc640 1 -- 172.21.15.130:0/1206932690 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80a6720 con 0x7f0a0815d5f0 2023-09-13T06:01:48.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a067fc640 1 -- 172.21.15.130:0/1206932690 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f80a6880 con 0x7f0a0815d5f0 2023-09-13T06:01:48.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a067fc640 1 -- 172.21.15.130:0/1206932690 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80a6c10 con 0x7f0a0815d5f0 2023-09-13T06:01:48.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1206932690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a0815d5f0 msgr2=0x7f0a080cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a0de7b640 1 --2- 172.21.15.130:0/1206932690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a0815d5f0 0x7f0a080cc7f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f09f800a960 tx=0x7f09f801d7c0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1206932690 shutdown_connections 2023-09-13T06:01:48.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a0de7b640 1 --2- 172.21.15.130:0/1206932690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a080ae170 0x7f0a080cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a0de7b640 1 --2- 172.21.15.130:0/1206932690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a0815d5f0 0x7f0a080cc7f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1206932690 >> 172.21.15.130:0/1206932690 conn(0x7f0a08065990 msgr2=0x7f0a08065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:48.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1206932690 shutdown_connections 2023-09-13T06:01:48.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1206932690 wait complete. 2023-09-13T06:01:48.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a0de7b640 1 Processor -- start 2023-09-13T06:01:48.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.084+0000 7f0a0de7b640 1 -- start start 2023-09-13T06:01:48.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a0de7b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a080ae170 0x7f0a08143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a0de7b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a0815d5f0 0x7f0a081507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a0de7b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a0815d9d0 0x7f0a08150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a0de7b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08164400 con 0x7f0a080ae170 2023-09-13T06:01:48.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a0de7b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0815ea30 con 0x7f0a0815d5f0 2023-09-13T06:01:48.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a0de7b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08163e40 con 0x7f0a0815d9d0 2023-09-13T06:01:48.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a077fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a080ae170 0x7f0a08143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a077fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a080ae170 0x7f0a08143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33026/0 (socket says 172.21.15.130:33026) 2023-09-13T06:01:48.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a077fe640 1 -- 172.21.15.130:0/1430365128 learned_addr learned my addr 172.21.15.130:0/1430365128 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:48.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a07fff640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a0815d9d0 0x7f0a08150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a06ffd640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a0815d5f0 0x7f0a081507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a077fe640 1 -- 172.21.15.130:0/1430365128 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a0815d9d0 msgr2=0x7f0a08150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a077fe640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a0815d9d0 0x7f0a08150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a077fe640 1 -- 172.21.15.130:0/1430365128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a0815d5f0 msgr2=0x7f0a081507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a077fe640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a0815d5f0 0x7f0a081507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a077fe640 1 -- 172.21.15.130:0/1430365128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc009420 con 0x7f0a080ae170 2023-09-13T06:01:48.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a077fe640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a080ae170 0x7f0a08143d30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f09f80b1040 tx=0x7f09f801a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:48.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f09effff640 1 -- 172.21.15.130:0/1430365128 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80ae8d0 con 0x7f0a080ae170 2023-09-13T06:01:48.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f09effff640 1 -- 172.21.15.130:0/1430365128 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f80aea30 con 0x7f0a080ae170 2023-09-13T06:01:48.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1430365128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f800a5c0 con 0x7f0a080ae170 2023-09-13T06:01:48.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f09effff640 1 -- 172.21.15.130:0/1430365128 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80aede0 con 0x7f0a080ae170 2023-09-13T06:01:48.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1430365128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0815e6c0 con 0x7f0a080ae170 2023-09-13T06:01:48.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1430365128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a080618a0 con 0x7f0a080ae170 2023-09-13T06:01:48.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.088+0000 7f09effff640 1 -- 172.21.15.130:0/1430365128 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f09f80b5040 con 0x7f0a080ae170 2023-09-13T06:01:48.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.092+0000 7f09effff640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09f4065b20 0x7f09f4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.092+0000 7f09effff640 1 -- 172.21.15.130:0/1430365128 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09f811db70 con 0x7f0a080ae170 2023-09-13T06:01:48.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.092+0000 7f0a06ffd640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09f4065b20 0x7f09f4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.092+0000 7f0a06ffd640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09f4065b20 0x7f09f4067fe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a08151350 tx=0x7f09fc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:48.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.096+0000 7f09effff640 1 -- 172.21.15.130:0/1430365128 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f09f80eb560 con 0x7f0a080ae170 2023-09-13T06:01:48.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.244+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1430365128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a0806d690 con 0x7f0a080ae170 2023-09-13T06:01:48.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.244+0000 7f09effff640 1 -- 172.21.15.130:0/1430365128 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f09f80eeb80 con 0x7f0a080ae170 2023-09-13T06:01:48.249 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:48.249 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:48.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1430365128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09f4065b20 msgr2=0x7f09f4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09f4065b20 0x7f09f4067fe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a08151350 tx=0x7f09fc009190 comp rx=0 tx=0).stop 2023-09-13T06:01:48.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1430365128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a080ae170 msgr2=0x7f0a08143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a080ae170 0x7f0a08143d30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f09f80b1040 tx=0x7f09f801a560 comp rx=0 tx=0).stop 2023-09-13T06:01:48.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1430365128 shutdown_connections 2023-09-13T06:01:48.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09f4065b20 0x7f09f4067fe0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a0815d5f0 0x7f0a081507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a0815d9d0 0x7f0a08150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 --2- 172.21.15.130:0/1430365128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a080ae170 0x7f0a08143d30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1430365128 >> 172.21.15.130:0/1430365128 conn(0x7f0a08065990 msgr2=0x7f0a080701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:48.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1430365128 shutdown_connections 2023-09-13T06:01:48.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.248+0000 7f0a0de7b640 1 -- 172.21.15.130:0/1430365128 wait complete. 2023-09-13T06:01:48.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:01:48.272 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:01:48.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.408+0000 7ff1dcd40640 1 Processor -- start 2023-09-13T06:01:48.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.408+0000 7ff1dcd40640 1 -- start start 2023-09-13T06:01:48.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.408+0000 7ff1dcd40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d80b4830 0x7ff1d80cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.408+0000 7ff1dcd40640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d80cc9d0 con 0x7ff1d80b2750 2023-09-13T06:01:48.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.408+0000 7ff1dcd40640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d80cccb0 con 0x7ff1d8159900 2023-09-13T06:01:48.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.408+0000 7ff1dcd40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d80b0c20 con 0x7ff1d80b4830 2023-09-13T06:01:48.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.408+0000 7ff1d6d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff1d80b2750 0x7ff1d8163410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37084/0 (socket says 172.21.15.130:37084) 2023-09-13T06:01:48.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.408+0000 7ff1d6d9d640 1 -- 172.21.15.130:0/668810313 learned_addr learned my addr 172.21.15.130:0/668810313 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:48.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.408+0000 7ff1cdd9b640 1 --2- 172.21.15.130:0/668810313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d80b4830 0x7ff1d80cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1d5d9b640 1 -- 172.21.15.130:0/668810313 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183384313 0 0) 0x7ff1d80cc9d0 con 0x7ff1d80b2750 2023-09-13T06:01:48.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1d5d9b640 1 -- 172.21.15.130:0/668810313 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1c4005740 con 0x7ff1d80b2750 2023-09-13T06:01:48.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1d5d9b640 1 -- 172.21.15.130:0/668810313 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159989813 0 0) 0x7ff1d80cccb0 con 0x7ff1d8159900 2023-09-13T06:01:48.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1d5d9b640 1 -- 172.21.15.130:0/668810313 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d80cc9d0 con 0x7ff1d8159900 2023-09-13T06:01:48.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1cdd9b640 1 -- 172.21.15.130:0/668810313 >> v1:172.21.15.164:6789/0 conn(0x7ff1d8159900 legacy=0x7ff1d80b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1cdd9b640 1 -- 172.21.15.130:0/668810313 >> v1:172.21.15.130:6789/0 conn(0x7ff1d80b2750 legacy=0x7ff1d8163410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1cdd9b640 1 -- 172.21.15.130:0/668810313 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d80ccf90 con 0x7ff1d80b4830 2023-09-13T06:01:48.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1cdd9b640 1 --2- 172.21.15.130:0/668810313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d80b4830 0x7ff1d80cc2d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000a990 tx=0x7ff1c001c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aae5da570531f5c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:48.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1d5d9b640 1 -- 172.21.15.130:0/668810313 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00a57d0 con 0x7ff1d80b4830 2023-09-13T06:01:48.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1d5d9b640 1 -- 172.21.15.130:0/668810313 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c00a5930 con 0x7ff1d80b4830 2023-09-13T06:01:48.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1d5d9b640 1 -- 172.21.15.130:0/668810313 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00a5cc0 con 0x7ff1d80b4830 2023-09-13T06:01:48.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1dcd40640 1 -- 172.21.15.130:0/668810313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d80b4830 msgr2=0x7ff1d80cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.412+0000 7ff1dcd40640 1 --2- 172.21.15.130:0/668810313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d80b4830 0x7ff1d80cc2d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000a990 tx=0x7ff1c001c790 comp rx=0 tx=0).stop 2023-09-13T06:01:48.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 -- 172.21.15.130:0/668810313 shutdown_connections 2023-09-13T06:01:48.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 --2- 172.21.15.130:0/668810313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d80b4830 0x7ff1d80cc2d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 -- 172.21.15.130:0/668810313 >> 172.21.15.130:0/668810313 conn(0x7ff1d8065990 msgr2=0x7ff1d8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:48.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 -- 172.21.15.130:0/668810313 shutdown_connections 2023-09-13T06:01:48.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 -- 172.21.15.130:0/668810313 wait complete. 2023-09-13T06:01:48.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 Processor -- start 2023-09-13T06:01:48.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 -- start start 2023-09-13T06:01:48.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1d80b2750 0x7ff1d813a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1d80b4830 0x7ff1d813d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d8159900 0x7ff1d813a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d81f57b0 con 0x7ff1d80b2750 2023-09-13T06:01:48.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d81f9600 con 0x7ff1d80b4830 2023-09-13T06:01:48.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1dcd40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d81f98e0 con 0x7ff1d8159900 2023-09-13T06:01:48.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1d659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1d80b2750 0x7ff1d813a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1d659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1d80b2750 0x7ff1d813a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33038/0 (socket says 172.21.15.130:33038) 2023-09-13T06:01:48.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1d659c640 1 -- 172.21.15.130:0/1664106681 learned_addr learned my addr 172.21.15.130:0/1664106681 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:48.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1cdd9b640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1d80b4830 0x7ff1d813d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1d6d9d640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d8159900 0x7ff1d813a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1d659c640 1 -- 172.21.15.130:0/1664106681 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d8159900 msgr2=0x7ff1d813a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1d659c640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d8159900 0x7ff1d813a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1d659c640 1 -- 172.21.15.130:0/1664106681 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1d80b4830 msgr2=0x7ff1d813d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1d659c640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1d80b4830 0x7ff1d813d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1d659c640 1 -- 172.21.15.130:0/1664106681 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c000a5c0 con 0x7ff1d80b2750 2023-09-13T06:01:48.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.416+0000 7ff1d6d9d640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d8159900 0x7ff1d813a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:48.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.420+0000 7ff1d659c640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1d80b2750 0x7ff1d813a950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c430 tx=0x7ff1c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:48.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.420+0000 7ff1cf7fe640 1 -- 172.21.15.130:0/1664106681 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80052d0 con 0x7ff1d80b2750 2023-09-13T06:01:48.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.420+0000 7ff1cf7fe640 1 -- 172.21.15.130:0/1664106681 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c8005450 con 0x7ff1d80b2750 2023-09-13T06:01:48.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.420+0000 7ff1cf7fe640 1 -- 172.21.15.130:0/1664106681 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8003840 con 0x7ff1d80b2750 2023-09-13T06:01:48.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.420+0000 7ff1dcd40640 1 -- 172.21.15.130:0/1664106681 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d81f9bc0 con 0x7ff1d80b2750 2023-09-13T06:01:48.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.420+0000 7ff1dcd40640 1 -- 172.21.15.130:0/1664106681 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d8152eb0 con 0x7ff1d80b2750 2023-09-13T06:01:48.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.420+0000 7ff1dcd40640 1 -- 172.21.15.130:0/1664106681 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d81f9db0 con 0x7ff1d80b2750 2023-09-13T06:01:48.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.420+0000 7ff1cf7fe640 1 -- 172.21.15.130:0/1664106681 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff1c80039a0 con 0x7ff1d80b2750 2023-09-13T06:01:48.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.420+0000 7ff1cf7fe640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff1b8065b20 0x7ff1b8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.420+0000 7ff1cf7fe640 1 -- 172.21.15.130:0/1664106681 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1c8082870 con 0x7ff1d80b2750 2023-09-13T06:01:48.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.424+0000 7ff1cdd9b640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff1b8065b20 0x7ff1b8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.424+0000 7ff1cdd9b640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff1b8065b20 0x7ff1b8067fe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00af000 tx=0x7ff1c00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:48.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.424+0000 7ff1cf7fe640 1 -- 172.21.15.130:0/1664106681 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff1c8050270 con 0x7ff1d80b2750 2023-09-13T06:01:48.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.576+0000 7ff1dcd40640 1 -- 172.21.15.130:0/1664106681 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1d80618a0 con 0x7ff1d80b2750 2023-09-13T06:01:48.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.576+0000 7ff1cf7fe640 1 -- 172.21.15.130:0/1664106681 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1c80170a0 con 0x7ff1d80b2750 2023-09-13T06:01:48.581 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:01:48.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 -- 172.21.15.130:0/1664106681 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff1b8065b20 msgr2=0x7ff1b8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff1b8065b20 0x7ff1b8067fe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00af000 tx=0x7ff1c00a7070 comp rx=0 tx=0).stop 2023-09-13T06:01:48.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 -- 172.21.15.130:0/1664106681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1d80b2750 msgr2=0x7ff1d813a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1d80b2750 0x7ff1d813a950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c430 tx=0x7ff1c800c8f0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 -- 172.21.15.130:0/1664106681 shutdown_connections 2023-09-13T06:01:48.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff1b8065b20 0x7ff1b8067fe0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1d80b4830 0x7ff1d813d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1d8159900 0x7ff1d813a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 --2- 172.21.15.130:0/1664106681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1d80b2750 0x7ff1d813a950 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 -- 172.21.15.130:0/1664106681 >> 172.21.15.130:0/1664106681 conn(0x7ff1d8065990 msgr2=0x7ff1d815c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:48.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 -- 172.21.15.130:0/1664106681 shutdown_connections 2023-09-13T06:01:48.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.580+0000 7ff1dcd40640 1 -- 172.21.15.130:0/1664106681 wait complete. 2023-09-13T06:01:48.602 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:01:48.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03bb019640 1 Processor -- start 2023-09-13T06:01:48.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03bb019640 1 -- start start 2023-09-13T06:01:48.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03bb019640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f03b41579c0 0x7f03b406f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03bb019640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f03b4161ac0 0x7f03b406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03bb019640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b4157da0 con 0x7f03b415d870 2023-09-13T06:01:48.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03bb019640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b415e3f0 con 0x7f03b4161ac0 2023-09-13T06:01:48.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03bb019640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b415e610 con 0x7f03b41579c0 2023-09-13T06:01:48.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03b3fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f03b4161ac0 0x7f03b406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03b95b6640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f03b415d870 0x7f03b415dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37100/0 (socket says 172.21.15.130:37100) 2023-09-13T06:01:48.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03b95b6640 1 -- 172.21.15.130:0/4244472634 learned_addr learned my addr 172.21.15.130:0/4244472634 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:48.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03b3fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f03b4161ac0 0x7f03b406f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33050/0 (socket says 172.21.15.130:33050) 2023-09-13T06:01:48.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03b8db5640 1 --2- 172.21.15.130:0/4244472634 >> v2:172.21.15.164:3300/0 conn(0x7f03b41579c0 0x7f03b406f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03b3fff640 1 -- 172.21.15.130:0/4244472634 >> v2:172.21.15.164:3300/0 conn(0x7f03b41579c0 msgr2=0x7f03b406f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:48.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03b3fff640 1 --2- 172.21.15.130:0/4244472634 >> v2:172.21.15.164:3300/0 conn(0x7f03b41579c0 0x7f03b406f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03b3fff640 1 -- 172.21.15.130:0/4244472634 >> v1:172.21.15.130:6789/0 conn(0x7f03b415d870 legacy=0x7f03b415dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03b3fff640 1 -- 172.21.15.130:0/4244472634 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b4160fe0 con 0x7f03b4161ac0 2023-09-13T06:01:48.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03b37fe640 1 -- 172.21.15.130:0/4244472634 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27312538 0 0) 0x7f03b4157da0 con 0x7f03b415d870 2023-09-13T06:01:48.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.740+0000 7f03b8db5640 1 --2- 172.21.15.130:0/4244472634 >> v2:172.21.15.164:3300/0 conn(0x7f03b41579c0 0x7f03b406f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:48.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03b3fff640 1 --2- 172.21.15.130:0/4244472634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03b4161ac0 0x7f03b406f9e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f03b40701a0 tx=0x7f03a001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2121a013ca527c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:48.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03b37fe640 1 -- 172.21.15.130:0/4244472634 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00ac630 con 0x7f03b4161ac0 2023-09-13T06:01:48.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03b37fe640 1 -- 172.21.15.130:0/4244472634 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a00ac790 con 0x7f03b4161ac0 2023-09-13T06:01:48.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03b37fe640 1 -- 172.21.15.130:0/4244472634 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00acb20 con 0x7f03b4161ac0 2023-09-13T06:01:48.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03bb019640 1 -- 172.21.15.130:0/4244472634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03b4161ac0 msgr2=0x7f03b406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03bb019640 1 --2- 172.21.15.130:0/4244472634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03b4161ac0 0x7f03b406f9e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f03b40701a0 tx=0x7f03a001c3d0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03bb019640 1 -- 172.21.15.130:0/4244472634 shutdown_connections 2023-09-13T06:01:48.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03bb019640 1 --2- 172.21.15.130:0/4244472634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03b4161ac0 0x7f03b406f9e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03bb019640 1 --2- 172.21.15.130:0/4244472634 >> v2:172.21.15.164:3300/0 conn(0x7f03b41579c0 0x7f03b406f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03bb019640 1 -- 172.21.15.130:0/4244472634 >> 172.21.15.130:0/4244472634 conn(0x7f03b4065990 msgr2=0x7f03b4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:48.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03bb019640 1 -- 172.21.15.130:0/4244472634 shutdown_connections 2023-09-13T06:01:48.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.744+0000 7f03bb019640 1 -- 172.21.15.130:0/4244472634 wait complete. 2023-09-13T06:01:48.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03bb019640 1 Processor -- start 2023-09-13T06:01:48.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03bb019640 1 -- start start 2023-09-13T06:01:48.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03bb019640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03b41579c0 0x7f03b414b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03bb019640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03b415d870 0x7f03b40b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03bb019640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b4161ac0 0x7f03b413a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03bb019640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b4154ae0 con 0x7f03b415d870 2023-09-13T06:01:48.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03bb019640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40b4680 con 0x7f03b41579c0 2023-09-13T06:01:48.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03bb019640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40b4960 con 0x7f03b4161ac0 2023-09-13T06:01:48.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03b415d870 0x7f03b40b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03b415d870 0x7f03b40b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33060/0 (socket says 172.21.15.130:33060) 2023-09-13T06:01:48.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b3fff640 1 -- 172.21.15.130:0/3972657497 learned_addr learned my addr 172.21.15.130:0/3972657497 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:48.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b8db5640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03b41579c0 0x7f03b414b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b95b6640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b4161ac0 0x7f03b413a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b3fff640 1 -- 172.21.15.130:0/3972657497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b4161ac0 msgr2=0x7f03b413a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b3fff640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b4161ac0 0x7f03b413a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b3fff640 1 -- 172.21.15.130:0/3972657497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03b41579c0 msgr2=0x7f03b414b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b3fff640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03b41579c0 0x7f03b414b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b3fff640 1 -- 172.21.15.130:0/3972657497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a0009420 con 0x7f03b415d870 2023-09-13T06:01:48.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b3fff640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03b415d870 0x7f03b40b19c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f03a001a000 tx=0x7f03a0019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:48.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b17fa640 1 -- 172.21.15.130:0/3972657497 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00b5600 con 0x7f03b415d870 2023-09-13T06:01:48.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b17fa640 1 -- 172.21.15.130:0/3972657497 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a00b5780 con 0x7f03b415d870 2023-09-13T06:01:48.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03bb019640 1 -- 172.21.15.130:0/3972657497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b40b4c40 con 0x7f03b415d870 2023-09-13T06:01:48.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03b17fa640 1 -- 172.21.15.130:0/3972657497 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00b5b30 con 0x7f03b415d870 2023-09-13T06:01:48.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.748+0000 7f03bb019640 1 -- 172.21.15.130:0/3972657497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b414ba60 con 0x7f03b415d870 2023-09-13T06:01:48.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.752+0000 7f03bb019640 1 -- 172.21.15.130:0/3972657497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b4154c20 con 0x7f03b415d870 2023-09-13T06:01:48.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.752+0000 7f03b17fa640 1 -- 172.21.15.130:0/3972657497 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f03a00b3040 con 0x7f03b415d870 2023-09-13T06:01:48.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.752+0000 7f03b17fa640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0398065b20 0x7f0398067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:48.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.752+0000 7f03b17fa640 1 -- 172.21.15.130:0/3972657497 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03a011d3c0 con 0x7f03b415d870 2023-09-13T06:01:48.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.752+0000 7f03b8db5640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0398065b20 0x7f0398067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:48.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.752+0000 7f03b8db5640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0398065b20 0x7f0398067fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03a800c900 tx=0x7f03a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:48.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.756+0000 7f03b17fa640 1 -- 172.21.15.130:0/3972657497 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f03b4154c20 con 0x7f03b415d870 2023-09-13T06:01:48.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03bb019640 1 -- 172.21.15.130:0/3972657497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f03b4154c20 con 0x7f03b415d870 2023-09-13T06:01:48.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03b17fa640 1 -- 172.21.15.130:0/3972657497 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f03b4154c20 con 0x7f03b415d870 2023-09-13T06:01:48.909 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:01:48.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03bb019640 1 -- 172.21.15.130:0/3972657497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0398065b20 msgr2=0x7f0398067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03bb019640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0398065b20 0x7f0398067fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03a800c900 tx=0x7f03a8008040 comp rx=0 tx=0).stop 2023-09-13T06:01:48.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03bb019640 1 -- 172.21.15.130:0/3972657497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03b415d870 msgr2=0x7f03b40b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:48.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03bb019640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03b415d870 0x7f03b40b19c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f03a001a000 tx=0x7f03a0019170 comp rx=0 tx=0).stop 2023-09-13T06:01:48.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03bb019640 1 -- 172.21.15.130:0/3972657497 shutdown_connections 2023-09-13T06:01:48.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03bb019640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0398065b20 0x7f0398067fe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03bb019640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03b4161ac0 0x7f03b413a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03bb019640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03b415d870 0x7f03b40b19c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03bb019640 1 --2- 172.21.15.130:0/3972657497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03b41579c0 0x7f03b414b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:48.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.904+0000 7f03bb019640 1 -- 172.21.15.130:0/3972657497 >> 172.21.15.130:0/3972657497 conn(0x7f03b4065990 msgr2=0x7f03b406ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:48.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.908+0000 7f03bb019640 1 -- 172.21.15.130:0/3972657497 shutdown_connections 2023-09-13T06:01:48.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:48.908+0000 7f03bb019640 1 -- 172.21.15.130:0/3972657497 wait complete. 2023-09-13T06:01:48.930 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:01:49.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f090547b640 1 Processor -- start 2023-09-13T06:01:49.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f090547b640 1 -- start start 2023-09-13T06:01:49.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f090547b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f090015ae10 0x7f09000d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f090547b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09000d2b00 0x7f09001612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f090547b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090015dd40 con 0x7f09001617e0 2023-09-13T06:01:49.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f090547b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090015e020 con 0x7f090015ae10 2023-09-13T06:01:49.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f090547b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090015e300 con 0x7f09000d2b00 2023-09-13T06:01:49.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f08feffd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f090015ae10 0x7f09000d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f08f67fc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09000d2b00 0x7f09001612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f08ff7fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f09001617e0 0x7f09000709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:39302/0 (socket says 172.21.15.130:39302) 2023-09-13T06:01:49.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f08ff7fe640 1 -- 172.21.15.130:0/3687428098 learned_addr learned my addr 172.21.15.130:0/3687428098 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:49.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f08feffd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f090015ae10 0x7f09000d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:43464/0 (socket says 172.21.15.130:43464) 2023-09-13T06:01:49.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f08f67fc640 1 -- 172.21.15.130:0/3687428098 >> v2:172.21.15.164:3300/0 conn(0x7f090015ae10 msgr2=0x7f09000d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:49.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f08f67fc640 1 --2- 172.21.15.130:0/3687428098 >> v2:172.21.15.164:3300/0 conn(0x7f090015ae10 0x7f09000d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f08f67fc640 1 -- 172.21.15.130:0/3687428098 >> v1:172.21.15.164:6789/0 conn(0x7f09001617e0 legacy=0x7f09000709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f08f67fc640 1 -- 172.21.15.130:0/3687428098 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090015e5e0 con 0x7f09000d2b00 2023-09-13T06:01:49.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.068+0000 7f08feffd640 1 --2- 172.21.15.130:0/3687428098 >> v2:172.21.15.164:3300/0 conn(0x7f090015ae10 0x7f09000d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:49.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f08f67fc640 1 --2- 172.21.15.130:0/3687428098 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09000d2b00 0x7f09001612a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f08e80097c0 tx=0x7f08e801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7d2c09a1b7dd7f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:49.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f08fe7fc640 1 -- 172.21.15.130:0/3687428098 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e80ab600 con 0x7f09000d2b00 2023-09-13T06:01:49.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f08fe7fc640 1 -- 172.21.15.130:0/3687428098 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e80a7050 con 0x7f09000d2b00 2023-09-13T06:01:49.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f08fe7fc640 1 -- 172.21.15.130:0/3687428098 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e80ab980 con 0x7f09000d2b00 2023-09-13T06:01:49.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f090547b640 1 -- 172.21.15.130:0/3687428098 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09000d2b00 msgr2=0x7f09001612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f090547b640 1 --2- 172.21.15.130:0/3687428098 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09000d2b00 0x7f09001612a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f08e80097c0 tx=0x7f08e801c360 comp rx=0 tx=0).stop 2023-09-13T06:01:49.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f090547b640 1 -- 172.21.15.130:0/3687428098 shutdown_connections 2023-09-13T06:01:49.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f090547b640 1 --2- 172.21.15.130:0/3687428098 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09000d2b00 0x7f09001612a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f090547b640 1 --2- 172.21.15.130:0/3687428098 >> v2:172.21.15.164:3300/0 conn(0x7f090015ae10 0x7f09000d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f090547b640 1 -- 172.21.15.130:0/3687428098 >> 172.21.15.130:0/3687428098 conn(0x7f0900065990 msgr2=0x7f0900065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:49.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f090547b640 1 -- 172.21.15.130:0/3687428098 shutdown_connections 2023-09-13T06:01:49.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.072+0000 7f090547b640 1 -- 172.21.15.130:0/3687428098 wait complete. 2023-09-13T06:01:49.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f090547b640 1 Processor -- start 2023-09-13T06:01:49.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f090547b640 1 -- start start 2023-09-13T06:01:49.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f090547b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09000d2b00 0x7f0900158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f090547b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f090015ae10 0x7f0900155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f090547b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09001617e0 0x7f09000b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f090547b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090015a500 con 0x7f09001617e0 2023-09-13T06:01:49.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f090547b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900070a60 con 0x7f09000d2b00 2023-09-13T06:01:49.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f090547b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0900070d40 con 0x7f090015ae10 2023-09-13T06:01:49.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08ff7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09001617e0 0x7f09000b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08ff7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09001617e0 0x7f09000b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33068/0 (socket says 172.21.15.130:33068) 2023-09-13T06:01:49.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08ff7fe640 1 -- 172.21.15.130:0/2228845944 learned_addr learned my addr 172.21.15.130:0/2228845944 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:49.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08feffd640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09000d2b00 0x7f0900158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08f67fc640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f090015ae10 0x7f0900155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08ff7fe640 1 -- 172.21.15.130:0/2228845944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f090015ae10 msgr2=0x7f0900155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08ff7fe640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f090015ae10 0x7f0900155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08ff7fe640 1 -- 172.21.15.130:0/2228845944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09000d2b00 msgr2=0x7f0900158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08ff7fe640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09000d2b00 0x7f0900158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08ff7fe640 1 -- 172.21.15.130:0/2228845944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0009420 con 0x7f09001617e0 2023-09-13T06:01:49.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08ff7fe640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09001617e0 0x7f09000b4ac0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f08f800ca80 tx=0x7f08f800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:49.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08f7fff640 1 -- 172.21.15.130:0/2228845944 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f800ac30 con 0x7f09001617e0 2023-09-13T06:01:49.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08f7fff640 1 -- 172.21.15.130:0/2228845944 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f800ad90 con 0x7f09001617e0 2023-09-13T06:01:49.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f090547b640 1 -- 172.21.15.130:0/2228845944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e8009420 con 0x7f09001617e0 2023-09-13T06:01:49.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.076+0000 7f08f7fff640 1 -- 172.21.15.130:0/2228845944 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8012600 con 0x7f09001617e0 2023-09-13T06:01:49.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.080+0000 7f090547b640 1 -- 172.21.15.130:0/2228845944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0900151070 con 0x7f09001617e0 2023-09-13T06:01:49.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.080+0000 7f090547b640 1 -- 172.21.15.130:0/2228845944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09000618a0 con 0x7f09001617e0 2023-09-13T06:01:49.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.080+0000 7f08f7fff640 1 -- 172.21.15.130:0/2228845944 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f08f8007070 con 0x7f09001617e0 2023-09-13T06:01:49.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.080+0000 7f08f7fff640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08e0065b20 0x7f08e0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.080+0000 7f08f7fff640 1 -- 172.21.15.130:0/2228845944 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08f80830d0 con 0x7f09001617e0 2023-09-13T06:01:49.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.080+0000 7f08feffd640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08e0065b20 0x7f08e0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.080+0000 7f08feffd640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08e0065b20 0x7f08e0067fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0900153370 tx=0x7f08f0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:49.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.084+0000 7f08f7fff640 1 -- 172.21.15.130:0/2228845944 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f08f8050ac0 con 0x7f09001617e0 2023-09-13T06:01:49.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 -- 172.21.15.130:0/2228845944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0900160b40 con 0x7f09001617e0 2023-09-13T06:01:49.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f08f7fff640 1 -- 172.21.15.130:0/2228845944 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08f80170a0 con 0x7f09001617e0 2023-09-13T06:01:49.236 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:01:49.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 -- 172.21.15.130:0/2228845944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08e0065b20 msgr2=0x7f08e0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08e0065b20 0x7f08e0067fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0900153370 tx=0x7f08f0009190 comp rx=0 tx=0).stop 2023-09-13T06:01:49.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 -- 172.21.15.130:0/2228845944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09001617e0 msgr2=0x7f09000b4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09001617e0 0x7f09000b4ac0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f08f800ca80 tx=0x7f08f800cf40 comp rx=0 tx=0).stop 2023-09-13T06:01:49.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 -- 172.21.15.130:0/2228845944 shutdown_connections 2023-09-13T06:01:49.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08e0065b20 0x7f08e0067fe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09001617e0 0x7f09000b4ac0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f090015ae10 0x7f0900155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 --2- 172.21.15.130:0/2228845944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09000d2b00 0x7f0900158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 -- 172.21.15.130:0/2228845944 >> 172.21.15.130:0/2228845944 conn(0x7f0900065990 msgr2=0x7f0900154300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:49.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 -- 172.21.15.130:0/2228845944 shutdown_connections 2023-09-13T06:01:49.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.232+0000 7f090547b640 1 -- 172.21.15.130:0/2228845944 wait complete. 2023-09-13T06:01:49.257 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:49.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff58520b640 1 Processor -- start 2023-09-13T06:01:49.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff58520b640 1 -- start start 2023-09-13T06:01:49.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff58520b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff580161810 0x7ff5800b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff58520b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5800b7ca0 0x7ff5800b8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff58520b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff580071440 con 0x7ff580146eb0 2023-09-13T06:01:49.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff58520b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5800b5130 con 0x7ff580161810 2023-09-13T06:01:49.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff58520b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5800706a0 con 0x7ff5800b7ca0 2023-09-13T06:01:49.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff57ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff580146eb0 0x7ff580161100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37108/0 (socket says 172.21.15.130:37108) 2023-09-13T06:01:49.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff57ffff640 1 -- 172.21.15.130:0/3054279371 learned_addr learned my addr 172.21.15.130:0/3054279371 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:49.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff57f7fe640 1 --2- 172.21.15.130:0/3054279371 >> v2:172.21.15.130:3300/0 conn(0x7ff580161810 0x7ff5800b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff584a0a640 1 --2- 172.21.15.130:0/3054279371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5800b7ca0 0x7ff5800b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff57effd640 1 -- 172.21.15.130:0/3054279371 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800859335 0 0) 0x7ff580071440 con 0x7ff580146eb0 2023-09-13T06:01:49.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff57effd640 1 -- 172.21.15.130:0/3054279371 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff568003530 con 0x7ff580146eb0 2023-09-13T06:01:49.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff57f7fe640 1 -- 172.21.15.130:0/3054279371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5800b7ca0 msgr2=0x7ff5800b8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:49.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff57f7fe640 1 --2- 172.21.15.130:0/3054279371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5800b7ca0 0x7ff5800b8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff57f7fe640 1 -- 172.21.15.130:0/3054279371 >> v1:172.21.15.130:6789/0 conn(0x7ff580146eb0 legacy=0x7ff580161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff57f7fe640 1 -- 172.21.15.130:0/3054279371 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff580147290 con 0x7ff580161810 2023-09-13T06:01:49.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.396+0000 7ff584a0a640 1 --2- 172.21.15.130:0/3054279371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5800b7ca0 0x7ff5800b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:49.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff57f7fe640 1 --2- 172.21.15.130:0/3054279371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff580161810 0x7ff5800b64e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5740097c0 tx=0x7ff57401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223320ad8c80e108 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:49.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff57effd640 1 -- 172.21.15.130:0/3054279371 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5740ab650 con 0x7ff580161810 2023-09-13T06:01:49.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff57effd640 1 -- 172.21.15.130:0/3054279371 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5740ab7b0 con 0x7ff580161810 2023-09-13T06:01:49.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff57effd640 1 -- 172.21.15.130:0/3054279371 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5740abb40 con 0x7ff580161810 2023-09-13T06:01:49.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff58520b640 1 -- 172.21.15.130:0/3054279371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff580161810 msgr2=0x7ff5800b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff58520b640 1 --2- 172.21.15.130:0/3054279371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff580161810 0x7ff5800b64e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5740097c0 tx=0x7ff57401c450 comp rx=0 tx=0).stop 2023-09-13T06:01:49.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff58520b640 1 -- 172.21.15.130:0/3054279371 shutdown_connections 2023-09-13T06:01:49.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff58520b640 1 --2- 172.21.15.130:0/3054279371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff5800b7ca0 0x7ff5800b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff58520b640 1 --2- 172.21.15.130:0/3054279371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff580161810 0x7ff5800b64e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff58520b640 1 -- 172.21.15.130:0/3054279371 >> 172.21.15.130:0/3054279371 conn(0x7ff5800cdd10 msgr2=0x7ff5800ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:49.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff58520b640 1 -- 172.21.15.130:0/3054279371 shutdown_connections 2023-09-13T06:01:49.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff58520b640 1 -- 172.21.15.130:0/3054279371 wait complete. 2023-09-13T06:01:49.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.400+0000 7ff58520b640 1 Processor -- start 2023-09-13T06:01:49.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff58520b640 1 -- start start 2023-09-13T06:01:49.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff58520b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5800b7ca0 0x7ff58015de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff58520b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff580146eb0 0x7ff5801557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff58520b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff580161810 0x7ff58013e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff58520b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff580156eb0 con 0x7ff5800b7ca0 2023-09-13T06:01:49.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff58520b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff580156230 con 0x7ff580161810 2023-09-13T06:01:49.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff58520b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff580156510 con 0x7ff580146eb0 2023-09-13T06:01:49.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5800b7ca0 0x7ff58015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5800b7ca0 0x7ff58015de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33076/0 (socket says 172.21.15.130:33076) 2023-09-13T06:01:49.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57ffff640 1 -- 172.21.15.130:0/4147397510 learned_addr learned my addr 172.21.15.130:0/4147397510 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:49.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57f7fe640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff580146eb0 0x7ff5801557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff584a0a640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff580161810 0x7ff58013e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57ffff640 1 -- 172.21.15.130:0/4147397510 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff580146eb0 msgr2=0x7ff5801557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57ffff640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff580146eb0 0x7ff5801557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57ffff640 1 -- 172.21.15.130:0/4147397510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff580161810 msgr2=0x7ff58013e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57ffff640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff580161810 0x7ff58013e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57ffff640 1 -- 172.21.15.130:0/4147397510 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff574009420 con 0x7ff5800b7ca0 2023-09-13T06:01:49.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff584a0a640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff580161810 0x7ff58013e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:49.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57ffff640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5800b7ca0 0x7ff58015de20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff57000c4d0 tx=0x7ff57000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:49.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57cff9640 1 -- 172.21.15.130:0/4147397510 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570005cf0 con 0x7ff5800b7ca0 2023-09-13T06:01:49.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57cff9640 1 -- 172.21.15.130:0/4147397510 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff570005e50 con 0x7ff5800b7ca0 2023-09-13T06:01:49.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff57cff9640 1 -- 172.21.15.130:0/4147397510 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570007270 con 0x7ff5800b7ca0 2023-09-13T06:01:49.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff58520b640 1 -- 172.21.15.130:0/4147397510 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5801567f0 con 0x7ff5800b7ca0 2023-09-13T06:01:49.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff58520b640 1 -- 172.21.15.130:0/4147397510 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5800d2400 con 0x7ff5800b7ca0 2023-09-13T06:01:49.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.404+0000 7ff58520b640 1 -- 172.21.15.130:0/4147397510 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5800618a0 con 0x7ff5800b7ca0 2023-09-13T06:01:49.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.408+0000 7ff57cff9640 1 -- 172.21.15.130:0/4147397510 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff5700073d0 con 0x7ff5800b7ca0 2023-09-13T06:01:49.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.408+0000 7ff57cff9640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff56c065b20 0x7ff56c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.408+0000 7ff57cff9640 1 -- 172.21.15.130:0/4147397510 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5700827d0 con 0x7ff5800b7ca0 2023-09-13T06:01:49.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.408+0000 7ff57f7fe640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff56c065b20 0x7ff56c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.408+0000 7ff57f7fe640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff56c065b20 0x7ff56c067fe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff5740af000 tx=0x7ff5740b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:49.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.412+0000 7ff57cff9640 1 -- 172.21.15.130:0/4147397510 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff5700501c0 con 0x7ff5800b7ca0 2023-09-13T06:01:49.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.564+0000 7ff58520b640 1 -- 172.21.15.130:0/4147397510 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff580070300 con 0x7ff5800b7ca0 2023-09-13T06:01:49.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.564+0000 7ff57cff9640 1 -- 172.21.15.130:0/4147397510 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7ff570017090 con 0x7ff5800b7ca0 2023-09-13T06:01:49.569 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:49.569 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:49.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 -- 172.21.15.130:0/4147397510 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff56c065b20 msgr2=0x7ff56c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff56c065b20 0x7ff56c067fe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff5740af000 tx=0x7ff5740b6040 comp rx=0 tx=0).stop 2023-09-13T06:01:49.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 -- 172.21.15.130:0/4147397510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5800b7ca0 msgr2=0x7ff58015de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5800b7ca0 0x7ff58015de20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff57000c4d0 tx=0x7ff57000c990 comp rx=0 tx=0).stop 2023-09-13T06:01:49.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 -- 172.21.15.130:0/4147397510 shutdown_connections 2023-09-13T06:01:49.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff56c065b20 0x7ff56c067fe0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff580161810 0x7ff58013e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff580146eb0 0x7ff5801557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 --2- 172.21.15.130:0/4147397510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5800b7ca0 0x7ff58015de20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 -- 172.21.15.130:0/4147397510 >> 172.21.15.130:0/4147397510 conn(0x7ff5800cdd10 msgr2=0x7ff5800b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:49.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 -- 172.21.15.130:0/4147397510 shutdown_connections 2023-09-13T06:01:49.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.568+0000 7ff58520b640 1 -- 172.21.15.130:0/4147397510 wait complete. 2023-09-13T06:01:49.590 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:01:49.591 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:01:49.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.728+0000 7f6269967640 1 Processor -- start 2023-09-13T06:01:49.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.728+0000 7f6269967640 1 -- start start 2023-09-13T06:01:49.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.728+0000 7f6269967640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f62640b2e90 0x7f62640ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.728+0000 7f6269967640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f62640b1460 0x7f62640b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.728+0000 7f6269967640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62640b2150 con 0x7f6264144d70 2023-09-13T06:01:49.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.728+0000 7f6269967640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62640b2430 con 0x7f62640b1460 2023-09-13T06:01:49.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.728+0000 7f6269967640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62640cedb0 con 0x7f62640b2e90 2023-09-13T06:01:49.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f6262ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6264144d70 0x7f62640b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37118/0 (socket says 172.21.15.130:37118) 2023-09-13T06:01:49.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f6262ffd640 1 -- 172.21.15.130:0/2994550664 learned_addr learned my addr 172.21.15.130:0/2994550664 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:49.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f62637fe640 1 --2- 172.21.15.130:0/2994550664 >> v2:172.21.15.130:3300/0 conn(0x7f62640b1460 0x7f62640b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f625a7fc640 1 --2- 172.21.15.130:0/2994550664 >> v2:172.21.15.164:3300/0 conn(0x7f62640b2e90 0x7f62640ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f62627fc640 1 -- 172.21.15.130:0/2994550664 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765705152 0 0) 0x7f62640b2150 con 0x7f6264144d70 2023-09-13T06:01:49.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f62627fc640 1 -- 172.21.15.130:0/2994550664 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6250003530 con 0x7f6264144d70 2023-09-13T06:01:49.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f62637fe640 1 -- 172.21.15.130:0/2994550664 >> v2:172.21.15.164:3300/0 conn(0x7f62640b2e90 msgr2=0x7f62640ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:49.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f62637fe640 1 --2- 172.21.15.130:0/2994550664 >> v2:172.21.15.164:3300/0 conn(0x7f62640b2e90 0x7f62640ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f62637fe640 1 -- 172.21.15.130:0/2994550664 >> v1:172.21.15.130:6789/0 conn(0x7f6264144d70 legacy=0x7f62640b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f62637fe640 1 -- 172.21.15.130:0/2994550664 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640cdd90 con 0x7f62640b1460 2023-09-13T06:01:49.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f62637fe640 1 --2- 172.21.15.130:0/2994550664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62640b1460 0x7f62640b18f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6264145150 tx=0x7f625c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1a0a4532c9498a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:49.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f62627fc640 1 -- 172.21.15.130:0/2994550664 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c004230 con 0x7f62640b1460 2023-09-13T06:01:49.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f62627fc640 1 -- 172.21.15.130:0/2994550664 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c0a7050 con 0x7f62640b1460 2023-09-13T06:01:49.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.732+0000 7f62627fc640 1 -- 172.21.15.130:0/2994550664 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c003620 con 0x7f62640b1460 2023-09-13T06:01:49.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 -- 172.21.15.130:0/2994550664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62640b1460 msgr2=0x7f62640b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 --2- 172.21.15.130:0/2994550664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62640b1460 0x7f62640b18f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6264145150 tx=0x7f625c01c460 comp rx=0 tx=0).stop 2023-09-13T06:01:49.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 -- 172.21.15.130:0/2994550664 shutdown_connections 2023-09-13T06:01:49.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 --2- 172.21.15.130:0/2994550664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62640b1460 0x7f62640b18f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 --2- 172.21.15.130:0/2994550664 >> v2:172.21.15.164:3300/0 conn(0x7f62640b2e90 0x7f62640ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 -- 172.21.15.130:0/2994550664 >> 172.21.15.130:0/2994550664 conn(0x7f6264065990 msgr2=0x7f6264065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:49.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 -- 172.21.15.130:0/2994550664 shutdown_connections 2023-09-13T06:01:49.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 -- 172.21.15.130:0/2994550664 wait complete. 2023-09-13T06:01:49.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 Processor -- start 2023-09-13T06:01:49.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 -- start start 2023-09-13T06:01:49.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62640b1460 0x7f6264156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62640b2e90 0x7f626414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6264144d70 0x7f62641575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626414e190 con 0x7f62640b1460 2023-09-13T06:01:49.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6264156c20 con 0x7f62640b2e90 2023-09-13T06:01:49.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6269967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626414a2b0 con 0x7f6264144d70 2023-09-13T06:01:49.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6262ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62640b1460 0x7f6264156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6262ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62640b1460 0x7f6264156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33094/0 (socket says 172.21.15.130:33094) 2023-09-13T06:01:49.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6262ffd640 1 -- 172.21.15.130:0/3396418804 learned_addr learned my addr 172.21.15.130:0/3396418804 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:49.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f625a7fc640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62640b2e90 0x7f626414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f62637fe640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6264144d70 0x7f62641575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6262ffd640 1 -- 172.21.15.130:0/3396418804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6264144d70 msgr2=0x7f62641575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6262ffd640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6264144d70 0x7f62641575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6262ffd640 1 -- 172.21.15.130:0/3396418804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62640b2e90 msgr2=0x7f626414dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6262ffd640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62640b2e90 0x7f626414dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f6262ffd640 1 -- 172.21.15.130:0/3396418804 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c009420 con 0x7f62640b1460 2023-09-13T06:01:49.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.736+0000 7f625a7fc640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62640b2e90 0x7f626414dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:49.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.740+0000 7f6262ffd640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62640b1460 0x7f6264156590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f625400cbc0 tx=0x7f625400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:49.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.740+0000 7f6260ff9640 1 -- 172.21.15.130:0/3396418804 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625400ad40 con 0x7f62640b1460 2023-09-13T06:01:49.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.740+0000 7f6260ff9640 1 -- 172.21.15.130:0/3396418804 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254012400 con 0x7f62640b1460 2023-09-13T06:01:49.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.740+0000 7f6260ff9640 1 -- 172.21.15.130:0/3396418804 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625400aea0 con 0x7f62640b1460 2023-09-13T06:01:49.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.740+0000 7f6269967640 1 -- 172.21.15.130:0/3396418804 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626414a590 con 0x7f62640b1460 2023-09-13T06:01:49.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.740+0000 7f6269967640 1 -- 172.21.15.130:0/3396418804 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626414ab50 con 0x7f62640b1460 2023-09-13T06:01:49.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.740+0000 7f6269967640 1 -- 172.21.15.130:0/3396418804 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626414ad40 con 0x7f62640b1460 2023-09-13T06:01:49.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.740+0000 7f6260ff9640 1 -- 172.21.15.130:0/3396418804 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6254007070 con 0x7f62640b1460 2023-09-13T06:01:49.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.740+0000 7f6260ff9640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6244065b20 0x7f6244067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:49.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.740+0000 7f6260ff9640 1 -- 172.21.15.130:0/3396418804 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62540833a0 con 0x7f62640b1460 2023-09-13T06:01:49.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.740+0000 7f625a7fc640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6244065b20 0x7f6244067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:49.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.744+0000 7f625a7fc640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6244065b20 0x7f6244067fe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6264158190 tx=0x7f624c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:49.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.744+0000 7f6260ff9640 1 -- 172.21.15.130:0/3396418804 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6254050c50 con 0x7f62640b1460 2023-09-13T06:01:49.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.892+0000 7f6269967640 1 -- 172.21.15.130:0/3396418804 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62640618a0 con 0x7f62640b1460 2023-09-13T06:01:49.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.892+0000 7f6260ff9640 1 -- 172.21.15.130:0/3396418804 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6254054270 con 0x7f62640b1460 2023-09-13T06:01:49.898 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:01:49.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 -- 172.21.15.130:0/3396418804 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6244065b20 msgr2=0x7f6244067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6244065b20 0x7f6244067fe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6264158190 tx=0x7f624c008040 comp rx=0 tx=0).stop 2023-09-13T06:01:49.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 -- 172.21.15.130:0/3396418804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62640b1460 msgr2=0x7f6264156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:49.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62640b1460 0x7f6264156590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f625400cbc0 tx=0x7f625400a430 comp rx=0 tx=0).stop 2023-09-13T06:01:49.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 -- 172.21.15.130:0/3396418804 shutdown_connections 2023-09-13T06:01:49.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6244065b20 0x7f6244067fe0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62640b2e90 0x7f626414dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6264144d70 0x7f62641575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 --2- 172.21.15.130:0/3396418804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62640b1460 0x7f6264156590 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:49.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 -- 172.21.15.130:0/3396418804 >> 172.21.15.130:0/3396418804 conn(0x7f6264065990 msgr2=0x7f62640b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:49.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 -- 172.21.15.130:0/3396418804 shutdown_connections 2023-09-13T06:01:49.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:49.896+0000 7f6269967640 1 -- 172.21.15.130:0/3396418804 wait complete. 2023-09-13T06:01:49.919 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:01:50.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6c0e9c640 1 Processor -- start 2023-09-13T06:01:50.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6c0e9c640 1 -- start start 2023-09-13T06:01:50.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6c0e9c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc6bc0b2e90 0x7fc6bc0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6c0e9c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6bc0b1460 0x7fc6bc0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6c0e9c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6bc0b2150 con 0x7fc6bc144d70 2023-09-13T06:01:50.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6c0e9c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6bc0b2430 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6c0e9c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0cedb0 con 0x7fc6bc0b1460 2023-09-13T06:01:50.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6b1d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc6bc0b2e90 0x7fc6bc0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6b1d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc6bc0b2e90 0x7fc6bc0ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33100/0 (socket says 172.21.15.130:33100) 2023-09-13T06:01:50.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6b1d9b640 1 -- 172.21.15.130:0/1331947689 learned_addr learned my addr 172.21.15.130:0/1331947689 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:50.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6ba59c640 1 --1- 172.21.15.130:0/1331947689 >> v1:172.21.15.130:6789/0 conn(0x7fc6bc144d70 0x7fc6bc0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37134/0 (socket says 172.21.15.130:37134) 2023-09-13T06:01:50.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6bad9d640 1 --2- 172.21.15.130:0/1331947689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6bc0b1460 0x7fc6bc0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6b1d9b640 1 -- 172.21.15.130:0/1331947689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6bc0b1460 msgr2=0x7fc6bc0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:50.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6b1d9b640 1 --2- 172.21.15.130:0/1331947689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6bc0b1460 0x7fc6bc0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6b1d9b640 1 -- 172.21.15.130:0/1331947689 >> v1:172.21.15.130:6789/0 conn(0x7fc6bc144d70 legacy=0x7fc6bc0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6b1d9b640 1 -- 172.21.15.130:0/1331947689 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc0cdd90 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6bad9d640 1 --2- 172.21.15.130:0/1331947689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6bc0b1460 0x7fc6bc0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:50.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.056+0000 7fc6b9d9b640 1 -- 172.21.15.130:0/1331947689 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789263564 0 0) 0x7fc6bc0b2150 con 0x7fc6bc144d70 2023-09-13T06:01:50.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6b1d9b640 1 --2- 172.21.15.130:0/1331947689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc0b2e90 0x7fc6bc0ce870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009870 tx=0x7fc6a401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9b40c9e10bff2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:50.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6b9d9b640 1 -- 172.21.15.130:0/1331947689 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40a7070 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6b9d9b640 1 -- 172.21.15.130:0/1331947689 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a40ab430 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6b9d9b640 1 -- 172.21.15.130:0/1331947689 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40ab7c0 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1331947689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc0b2e90 msgr2=0x7fc6bc0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6c0e9c640 1 --2- 172.21.15.130:0/1331947689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc0b2e90 0x7fc6bc0ce870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009870 tx=0x7fc6a401c540 comp rx=0 tx=0).stop 2023-09-13T06:01:50.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1331947689 shutdown_connections 2023-09-13T06:01:50.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6c0e9c640 1 --2- 172.21.15.130:0/1331947689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6bc0b1460 0x7fc6bc0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6c0e9c640 1 --2- 172.21.15.130:0/1331947689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc0b2e90 0x7fc6bc0ce870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1331947689 >> 172.21.15.130:0/1331947689 conn(0x7fc6bc065990 msgr2=0x7fc6bc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:50.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1331947689 shutdown_connections 2023-09-13T06:01:50.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.060+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1331947689 wait complete. 2023-09-13T06:01:50.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6c0e9c640 1 Processor -- start 2023-09-13T06:01:50.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6c0e9c640 1 -- start start 2023-09-13T06:01:50.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6c0e9c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc0b1460 0x7fc6bc13d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6c0e9c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc0b2e90 0x7fc6bc159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6c0e9c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6bc144d70 0x7fc6bc0b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6c0e9c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0b1110 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6c0e9c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc13e490 con 0x7fc6bc0b1460 2023-09-13T06:01:50.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6c0e9c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc13cd10 con 0x7fc6bc144d70 2023-09-13T06:01:50.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b1d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc0b2e90 0x7fc6bc159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b1d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc0b2e90 0x7fc6bc159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33104/0 (socket says 172.21.15.130:33104) 2023-09-13T06:01:50.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b1d9b640 1 -- 172.21.15.130:0/1966554521 learned_addr learned my addr 172.21.15.130:0/1966554521 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:50.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6bad9d640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6bc144d70 0x7fc6bc0b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6ba59c640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc0b1460 0x7fc6bc13d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b1d9b640 1 -- 172.21.15.130:0/1966554521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6bc144d70 msgr2=0x7fc6bc0b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b1d9b640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6bc144d70 0x7fc6bc0b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b1d9b640 1 -- 172.21.15.130:0/1966554521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc0b1460 msgr2=0x7fc6bc13d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b1d9b640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc0b1460 0x7fc6bc13d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b1d9b640 1 -- 172.21.15.130:0/1966554521 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40094d0 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b1d9b640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc0b2e90 0x7fc6bc159f70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40ad040 tx=0x7fc6a40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:50.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b37fe640 1 -- 172.21.15.130:0/1966554521 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40ba070 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b37fe640 1 -- 172.21.15.130:0/1966554521 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a40abe10 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1966554521 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc13aae0 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6b37fe640 1 -- 172.21.15.130:0/1966554521 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40b4870 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.064+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1966554521 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc13e1b0 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.068+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1966554521 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc0618a0 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.068+0000 7fc6b37fe640 1 -- 172.21.15.130:0/1966554521 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc6a40b49d0 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.068+0000 7fc6b37fe640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc69c065b50 0x7fc69c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.068+0000 7fc6b37fe640 1 -- 172.21.15.130:0/1966554521 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6a411cb60 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.068+0000 7fc6ba59c640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc69c065b50 0x7fc69c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.068+0000 7fc6ba59c640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc69c065b50 0x7fc69c068010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac000f70 tx=0x7fc6ac007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:50.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.072+0000 7fc6b37fe640 1 -- 172.21.15.130:0/1966554521 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc6a40ea5f0 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1966554521 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6bc15e370 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6b37fe640 1 -- 172.21.15.130:0/1966554521 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6a40edc10 con 0x7fc6bc0b2e90 2023-09-13T06:01:50.224 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:01:50.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1966554521 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc69c065b50 msgr2=0x7fc69c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc69c065b50 0x7fc69c068010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac000f70 tx=0x7fc6ac007df0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1966554521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc0b2e90 msgr2=0x7fc6bc159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc0b2e90 0x7fc6bc159f70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40ad040 tx=0x7fc6a40192e0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1966554521 shutdown_connections 2023-09-13T06:01:50.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc69c065b50 0x7fc69c068010 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6bc144d70 0x7fc6bc0b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc0b2e90 0x7fc6bc159f70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 --2- 172.21.15.130:0/1966554521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc0b1460 0x7fc6bc13d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1966554521 >> 172.21.15.130:0/1966554521 conn(0x7fc6bc065990 msgr2=0x7fc6bc06b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:50.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1966554521 shutdown_connections 2023-09-13T06:01:50.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.220+0000 7fc6c0e9c640 1 -- 172.21.15.130:0/1966554521 wait complete. 2023-09-13T06:01:50.247 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:01:50.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.388+0000 7fd6761b7640 1 Processor -- start 2023-09-13T06:01:50.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.388+0000 7fd6761b7640 1 -- start start 2023-09-13T06:01:50.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6761b7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd6700d3a80 0x7fd670070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6761b7640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd670070cb0 0x7fd6700b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6761b7640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd670071100 con 0x7fd670146d40 2023-09-13T06:01:50.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6761b7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6700b42a0 con 0x7fd6700d3a80 2023-09-13T06:01:50.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6761b7640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6700b4560 con 0x7fd670070cb0 2023-09-13T06:01:50.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6749b4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd6700d3a80 0x7fd670070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6749b4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd6700d3a80 0x7fd670070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33108/0 (socket says 172.21.15.130:33108) 2023-09-13T06:01:50.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6749b4640 1 -- 172.21.15.130:0/688006141 learned_addr learned my addr 172.21.15.130:0/688006141 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:50.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6759b6640 1 --2- 172.21.15.130:0/688006141 >> v2:172.21.15.164:3300/0 conn(0x7fd670070cb0 0x7fd6700b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6749b4640 1 -- 172.21.15.130:0/688006141 >> v2:172.21.15.164:3300/0 conn(0x7fd670070cb0 msgr2=0x7fd6700b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:50.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6749b4640 1 --2- 172.21.15.130:0/688006141 >> v2:172.21.15.164:3300/0 conn(0x7fd670070cb0 0x7fd6700b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6749b4640 1 -- 172.21.15.130:0/688006141 >> v1:172.21.15.164:6789/0 conn(0x7fd670146d40 legacy=0x7fd6700b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:50.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.392+0000 7fd6749b4640 1 -- 172.21.15.130:0/688006141 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6700b4840 con 0x7fd6700d3a80 2023-09-13T06:01:50.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6749b4640 1 --2- 172.21.15.130:0/688006141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6700d3a80 0x7fd670070770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd67008ba00 tx=0x7fd66001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252a7a5d7ae5e0f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:50.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd667fff640 1 -- 172.21.15.130:0/688006141 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6600ab610 con 0x7fd6700d3a80 2023-09-13T06:01:50.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd667fff640 1 -- 172.21.15.130:0/688006141 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6600ab770 con 0x7fd6700d3a80 2023-09-13T06:01:50.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd667fff640 1 -- 172.21.15.130:0/688006141 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6600abb00 con 0x7fd6700d3a80 2023-09-13T06:01:50.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 -- 172.21.15.130:0/688006141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6700d3a80 msgr2=0x7fd670070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 --2- 172.21.15.130:0/688006141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6700d3a80 0x7fd670070770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd67008ba00 tx=0x7fd66001c500 comp rx=0 tx=0).stop 2023-09-13T06:01:50.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 -- 172.21.15.130:0/688006141 shutdown_connections 2023-09-13T06:01:50.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 --2- 172.21.15.130:0/688006141 >> v2:172.21.15.164:3300/0 conn(0x7fd670070cb0 0x7fd6700b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 --2- 172.21.15.130:0/688006141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6700d3a80 0x7fd670070770 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 -- 172.21.15.130:0/688006141 >> 172.21.15.130:0/688006141 conn(0x7fd6700d2f60 msgr2=0x7fd6700d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:50.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 -- 172.21.15.130:0/688006141 shutdown_connections 2023-09-13T06:01:50.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 -- 172.21.15.130:0/688006141 wait complete. 2023-09-13T06:01:50.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 Processor -- start 2023-09-13T06:01:50.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 -- start start 2023-09-13T06:01:50.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd670070cb0 0x7fd670155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6700d3a80 0x7fd6701f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd670146d40 0x7fd670143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67013b1b0 con 0x7fd670146d40 2023-09-13T06:01:50.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67013b770 con 0x7fd6700d3a80 2023-09-13T06:01:50.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.396+0000 7fd6761b7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6701f9510 con 0x7fd670070cb0 2023-09-13T06:01:50.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6749b4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6700d3a80 0x7fd6701f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6749b4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6700d3a80 0x7fd6701f8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:43524/0 (socket says 172.21.15.130:43524) 2023-09-13T06:01:50.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6749b4640 1 -- 172.21.15.130:0/3287384980 learned_addr learned my addr 172.21.15.130:0/3287384980 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:50.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6759b6640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd670146d40 0x7fd670143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6751b5640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd670070cb0 0x7fd670155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6749b4640 1 -- 172.21.15.130:0/3287384980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd670070cb0 msgr2=0x7fd670155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6749b4640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd670070cb0 0x7fd670155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6749b4640 1 -- 172.21.15.130:0/3287384980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd670146d40 msgr2=0x7fd670143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6749b4640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd670146d40 0x7fd670143370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6749b4640 1 -- 172.21.15.130:0/3287384980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6600094d0 con 0x7fd6700d3a80 2023-09-13T06:01:50.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6749b4640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6700d3a80 0x7fd6701f8a50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd660019110 tx=0x7fd66001ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:50.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd665ffb640 1 -- 172.21.15.130:0/3287384980 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6600b4800 con 0x7fd6700d3a80 2023-09-13T06:01:50.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd665ffb640 1 -- 172.21.15.130:0/3287384980 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6600b4960 con 0x7fd6700d3a80 2023-09-13T06:01:50.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd665ffb640 1 -- 172.21.15.130:0/3287384980 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6600b4d10 con 0x7fd6700d3a80 2023-09-13T06:01:50.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6761b7640 1 -- 172.21.15.130:0/3287384980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6701f97f0 con 0x7fd6700d3a80 2023-09-13T06:01:50.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6761b7640 1 -- 172.21.15.130:0/3287384980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67013df70 con 0x7fd6700d3a80 2023-09-13T06:01:50.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd6761b7640 1 -- 172.21.15.130:0/3287384980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6700b7f60 con 0x7fd6700d3a80 2023-09-13T06:01:50.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.400+0000 7fd665ffb640 1 -- 172.21.15.130:0/3287384980 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd6600be3f0 con 0x7fd6700d3a80 2023-09-13T06:01:50.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.404+0000 7fd665ffb640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd654065b50 0x7fd654068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.404+0000 7fd665ffb640 1 -- 172.21.15.130:0/3287384980 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd66011dff0 con 0x7fd6700d3a80 2023-09-13T06:01:50.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.404+0000 7fd6751b5640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd654065b50 0x7fd654068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.404+0000 7fd6751b5640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd654065b50 0x7fd654068010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd66c007fd0 tx=0x7fd66c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:50.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.408+0000 7fd665ffb640 1 -- 172.21.15.130:0/3287384980 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd6600ebaf0 con 0x7fd6700d3a80 2023-09-13T06:01:50.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.556+0000 7fd6761b7640 1 -- 172.21.15.130:0/3287384980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd670070390 con 0x7fd6700d3a80 2023-09-13T06:01:50.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.556+0000 7fd665ffb640 1 -- 172.21.15.130:0/3287384980 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6600ef110 con 0x7fd6700d3a80 2023-09-13T06:01:50.561 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:01:50.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 -- 172.21.15.130:0/3287384980 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd654065b50 msgr2=0x7fd654068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd654065b50 0x7fd654068010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd66c007fd0 tx=0x7fd66c009040 comp rx=0 tx=0).stop 2023-09-13T06:01:50.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 -- 172.21.15.130:0/3287384980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6700d3a80 msgr2=0x7fd6701f8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6700d3a80 0x7fd6701f8a50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd660019110 tx=0x7fd66001ad40 comp rx=0 tx=0).stop 2023-09-13T06:01:50.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 -- 172.21.15.130:0/3287384980 shutdown_connections 2023-09-13T06:01:50.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd654065b50 0x7fd654068010 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6700d3a80 0x7fd6701f8a50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd670146d40 0x7fd670143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 --2- 172.21.15.130:0/3287384980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd670070cb0 0x7fd670155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 -- 172.21.15.130:0/3287384980 >> 172.21.15.130:0/3287384980 conn(0x7fd6700d2f60 msgr2=0x7fd6700d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:50.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 -- 172.21.15.130:0/3287384980 shutdown_connections 2023-09-13T06:01:50.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.560+0000 7fd6761b7640 1 -- 172.21.15.130:0/3287384980 wait complete. 2023-09-13T06:01:50.582 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:50.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.716+0000 7f06a520b640 1 Processor -- start 2023-09-13T06:01:50.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.716+0000 7f06a520b640 1 -- start start 2023-09-13T06:01:50.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f06a520b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f06a0159f20 0x7f06a00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f06a520b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f06a00cdfc0 0x7f06a00b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f06a520b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a00ccfd0 con 0x7f06a00b1610 2023-09-13T06:01:50.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f06a520b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a00b00f0 con 0x7f06a0159f20 2023-09-13T06:01:50.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f06a520b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a00b11d0 con 0x7f06a00cdfc0 2023-09-13T06:01:50.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f069ed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f06a0159f20 0x7f06a00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f069ed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f06a0159f20 0x7f06a00ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33140/0 (socket says 172.21.15.130:33140) 2023-09-13T06:01:50.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f069ed9d640 1 -- 172.21.15.130:0/1687850164 learned_addr learned my addr 172.21.15.130:0/1687850164 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:50.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f069659c640 1 --2- 172.21.15.130:0/1687850164 >> v2:172.21.15.164:3300/0 conn(0x7f06a00cdfc0 0x7f06a00b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f069ed9d640 1 -- 172.21.15.130:0/1687850164 >> v2:172.21.15.164:3300/0 conn(0x7f06a00cdfc0 msgr2=0x7f06a00b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:50.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f069ed9d640 1 --2- 172.21.15.130:0/1687850164 >> v2:172.21.15.164:3300/0 conn(0x7f06a00cdfc0 0x7f06a00b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f069ed9d640 1 -- 172.21.15.130:0/1687850164 >> v1:172.21.15.164:6789/0 conn(0x7f06a00b1610 legacy=0x7f06a00ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.720+0000 7f069ed9d640 1 -- 172.21.15.130:0/1687850164 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a00ced90 con 0x7f06a0159f20 2023-09-13T06:01:50.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f069ed9d640 1 --2- 172.21.15.130:0/1687850164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a0159f20 0x7f06a00ce7b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06a00ccb10 tx=0x7f069001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316418e87faee2ab server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:50.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f069e59c640 1 -- 172.21.15.130:0/1687850164 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900ab670 con 0x7f06a0159f20 2023-09-13T06:01:50.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f069e59c640 1 -- 172.21.15.130:0/1687850164 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06900ab7d0 con 0x7f06a0159f20 2023-09-13T06:01:50.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f069e59c640 1 -- 172.21.15.130:0/1687850164 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900abb60 con 0x7f06a0159f20 2023-09-13T06:01:50.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f06a520b640 1 -- 172.21.15.130:0/1687850164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a0159f20 msgr2=0x7f06a00ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f06a520b640 1 --2- 172.21.15.130:0/1687850164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a0159f20 0x7f06a00ce7b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06a00ccb10 tx=0x7f069001c470 comp rx=0 tx=0).stop 2023-09-13T06:01:50.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f06a520b640 1 -- 172.21.15.130:0/1687850164 shutdown_connections 2023-09-13T06:01:50.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f06a520b640 1 --2- 172.21.15.130:0/1687850164 >> v2:172.21.15.164:3300/0 conn(0x7f06a00cdfc0 0x7f06a00b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f06a520b640 1 --2- 172.21.15.130:0/1687850164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a0159f20 0x7f06a00ce7b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f06a520b640 1 -- 172.21.15.130:0/1687850164 >> 172.21.15.130:0/1687850164 conn(0x7f06a0065990 msgr2=0x7f06a0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:50.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f06a520b640 1 -- 172.21.15.130:0/1687850164 shutdown_connections 2023-09-13T06:01:50.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f06a520b640 1 -- 172.21.15.130:0/1687850164 wait complete. 2023-09-13T06:01:50.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f06a520b640 1 Processor -- start 2023-09-13T06:01:50.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.724+0000 7f06a520b640 1 -- start start 2023-09-13T06:01:50.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f06a520b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a00b1610 0x7f06a0157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f06a520b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06a00cdfc0 0x7f06a013cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f06a520b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06a0159f20 0x7f06a0150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f06a520b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0159830 con 0x7f06a00b1610 2023-09-13T06:01:50.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f06a520b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a01577d0 con 0x7f06a00cdfc0 2023-09-13T06:01:50.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f06a520b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0158f90 con 0x7f06a0159f20 2023-09-13T06:01:50.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f069ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a00b1610 0x7f06a0157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f069ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a00b1610 0x7f06a0157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33152/0 (socket says 172.21.15.130:33152) 2023-09-13T06:01:50.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f069ed9d640 1 -- 172.21.15.130:0/1019945278 learned_addr learned my addr 172.21.15.130:0/1019945278 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:50.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f069659c640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06a00cdfc0 0x7f06a013cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f069f59e640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06a0159f20 0x7f06a0150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f069ed9d640 1 -- 172.21.15.130:0/1019945278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06a0159f20 msgr2=0x7f06a0150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f069ed9d640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06a0159f20 0x7f06a0150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f069ed9d640 1 -- 172.21.15.130:0/1019945278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06a00cdfc0 msgr2=0x7f06a013cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f069ed9d640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06a00cdfc0 0x7f06a013cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f069ed9d640 1 -- 172.21.15.130:0/1019945278 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900094d0 con 0x7f06a00b1610 2023-09-13T06:01:50.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f069ed9d640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a00b1610 0x7f06a0157290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0690019080 tx=0x7f069001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:50.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f0697fff640 1 -- 172.21.15.130:0/1019945278 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900b4800 con 0x7f06a00b1610 2023-09-13T06:01:50.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f0697fff640 1 -- 172.21.15.130:0/1019945278 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06900b4980 con 0x7f06a00b1610 2023-09-13T06:01:50.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f06a520b640 1 -- 172.21.15.130:0/1019945278 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a0159270 con 0x7f06a00b1610 2023-09-13T06:01:50.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f0697fff640 1 -- 172.21.15.130:0/1019945278 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900b4d30 con 0x7f06a00b1610 2023-09-13T06:01:50.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f06a520b640 1 -- 172.21.15.130:0/1019945278 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a0156d70 con 0x7f06a00b1610 2023-09-13T06:01:50.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f06a520b640 1 -- 172.21.15.130:0/1019945278 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a0156bd0 con 0x7f06a00b1610 2023-09-13T06:01:50.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.728+0000 7f0697fff640 1 -- 172.21.15.130:0/1019945278 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f06900c7390 con 0x7f06a00b1610 2023-09-13T06:01:50.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.732+0000 7f0697fff640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0680065b20 0x7f0680067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:50.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.732+0000 7f0697fff640 1 -- 172.21.15.130:0/1019945278 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f069011dc10 con 0x7f06a00b1610 2023-09-13T06:01:50.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.732+0000 7f069659c640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0680065b20 0x7f0680067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:50.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.732+0000 7f069659c640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0680065b20 0x7f0680067fe0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06a01549f0 tx=0x7f068800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:50.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.736+0000 7f0697fff640 1 -- 172.21.15.130:0/1019945278 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f06a0156bd0 con 0x7f06a00b1610 2023-09-13T06:01:50.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.884+0000 7f06a520b640 1 -- 172.21.15.130:0/1019945278 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06a0156bd0 con 0x7f06a00b1610 2023-09-13T06:01:50.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.884+0000 7f0697fff640 1 -- 172.21.15.130:0/1019945278 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f06a0156bd0 con 0x7f06a00b1610 2023-09-13T06:01:50.891 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:50.891 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:50.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 -- 172.21.15.130:0/1019945278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0680065b20 msgr2=0x7f0680067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0680065b20 0x7f0680067fe0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06a01549f0 tx=0x7f068800b040 comp rx=0 tx=0).stop 2023-09-13T06:01:50.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 -- 172.21.15.130:0/1019945278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a00b1610 msgr2=0x7f06a0157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:50.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a00b1610 0x7f06a0157290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0690019080 tx=0x7f069001acb0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 -- 172.21.15.130:0/1019945278 shutdown_connections 2023-09-13T06:01:50.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0680065b20 0x7f0680067fe0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06a00cdfc0 0x7f06a013cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06a0159f20 0x7f06a0150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 --2- 172.21.15.130:0/1019945278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a00b1610 0x7f06a0157290 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:50.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 -- 172.21.15.130:0/1019945278 >> 172.21.15.130:0/1019945278 conn(0x7f06a0065990 msgr2=0x7f06a00ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:50.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 -- 172.21.15.130:0/1019945278 shutdown_connections 2023-09-13T06:01:50.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:50.888+0000 7f06a520b640 1 -- 172.21.15.130:0/1019945278 wait complete. 2023-09-13T06:01:50.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:01:50.912 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:01:51.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.048+0000 7f9cc6e34640 1 Processor -- start 2023-09-13T06:01:51.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.048+0000 7f9cc6e34640 1 -- start start 2023-09-13T06:01:51.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cc6e34640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9cc00b31a0 0x7f9cc00ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cc6e34640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc00cc850 con 0x7f9cc015a080 2023-09-13T06:01:51.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cc6e34640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc00b0330 con 0x7f9cc00b1460 2023-09-13T06:01:51.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cc6e34640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc00cbcd0 con 0x7f9cc00b31a0 2023-09-13T06:01:51.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cc4bd0640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9cc015a080 0x7f9cc015e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35970/0 (socket says 172.21.15.130:35970) 2023-09-13T06:01:51.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cc4bd0640 1 -- 172.21.15.130:0/1159298845 learned_addr learned my addr 172.21.15.130:0/1159298845 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:51.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cc53d1640 1 --2- 172.21.15.130:0/1159298845 >> v2:172.21.15.164:3300/0 conn(0x7f9cc00b31a0 0x7f9cc00ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cbf7fe640 1 -- 172.21.15.130:0/1159298845 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386819854 0 0) 0x7f9cb4001120 con 0x7f9cc015a080 2023-09-13T06:01:51.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cbf7fe640 1 -- 172.21.15.130:0/1159298845 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cb0003530 con 0x7f9cc015a080 2023-09-13T06:01:51.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cc53d1640 1 -- 172.21.15.130:0/1159298845 >> v1:172.21.15.164:6789/0 conn(0x7f9cc00b1460 legacy=0x7f9cc00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cc53d1640 1 -- 172.21.15.130:0/1159298845 >> v1:172.21.15.130:6789/0 conn(0x7f9cc015a080 legacy=0x7f9cc015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.052+0000 7f9cc53d1640 1 -- 172.21.15.130:0/1159298845 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc00cbfb0 con 0x7f9cc00b31a0 2023-09-13T06:01:51.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cc53d1640 1 --2- 172.21.15.130:0/1159298845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc00b31a0 0x7f9cc00ccfe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009d90 tx=0x7f9cb801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53c242799e2cc022 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:51.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cbf7fe640 1 -- 172.21.15.130:0/1159298845 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80a5660 con 0x7f9cc00b31a0 2023-09-13T06:01:51.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cbf7fe640 1 -- 172.21.15.130:0/1159298845 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb80a57c0 con 0x7f9cc00b31a0 2023-09-13T06:01:51.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cbf7fe640 1 -- 172.21.15.130:0/1159298845 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80a5b50 con 0x7f9cc00b31a0 2023-09-13T06:01:51.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cc6e34640 1 -- 172.21.15.130:0/1159298845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc00b31a0 msgr2=0x7f9cc00ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cc6e34640 1 --2- 172.21.15.130:0/1159298845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc00b31a0 0x7f9cc00ccfe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009d90 tx=0x7f9cb801c890 comp rx=0 tx=0).stop 2023-09-13T06:01:51.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cc6e34640 1 -- 172.21.15.130:0/1159298845 shutdown_connections 2023-09-13T06:01:51.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cc6e34640 1 --2- 172.21.15.130:0/1159298845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc00b31a0 0x7f9cc00ccfe0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cc6e34640 1 -- 172.21.15.130:0/1159298845 >> 172.21.15.130:0/1159298845 conn(0x7f9cc0065990 msgr2=0x7f9cc0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:51.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cc6e34640 1 -- 172.21.15.130:0/1159298845 shutdown_connections 2023-09-13T06:01:51.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cc6e34640 1 -- 172.21.15.130:0/1159298845 wait complete. 2023-09-13T06:01:51.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cc6e34640 1 Processor -- start 2023-09-13T06:01:51.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.056+0000 7f9cc6e34640 1 -- start start 2023-09-13T06:01:51.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cc6e34640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc00b1460 0x7f9cc006cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cc6e34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cc00b31a0 0x7f9cc01438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cc6e34640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc015a080 0x7f9cc014fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cc6e34640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc006e0e0 con 0x7f9cc00b31a0 2023-09-13T06:01:51.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cc6e34640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc01503b0 con 0x7f9cc015a080 2023-09-13T06:01:51.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cc6e34640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc006d130 con 0x7f9cc00b1460 2023-09-13T06:01:51.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cc00b31a0 0x7f9cc01438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cc00b31a0 0x7f9cc01438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47468/0 (socket says 172.21.15.130:47468) 2023-09-13T06:01:51.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbffff640 1 -- 172.21.15.130:0/4262532437 learned_addr learned my addr 172.21.15.130:0/4262532437 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:51.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cc4bd0640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc00b1460 0x7f9cc006cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cc53d1640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc015a080 0x7f9cc014fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbffff640 1 -- 172.21.15.130:0/4262532437 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc00b1460 msgr2=0x7f9cc006cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbffff640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc00b1460 0x7f9cc006cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbffff640 1 -- 172.21.15.130:0/4262532437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc015a080 msgr2=0x7f9cc014fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbffff640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc015a080 0x7f9cc014fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbffff640 1 -- 172.21.15.130:0/4262532437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8009a70 con 0x7f9cc00b31a0 2023-09-13T06:01:51.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbffff640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cc00b31a0 0x7f9cc01438f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c450 tx=0x7f9cac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:51.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbd7fa640 1 -- 172.21.15.130:0/4262532437 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac0052d0 con 0x7f9cc00b31a0 2023-09-13T06:01:51.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbd7fa640 1 -- 172.21.15.130:0/4262532437 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac005430 con 0x7f9cc00b31a0 2023-09-13T06:01:51.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cbd7fa640 1 -- 172.21.15.130:0/4262532437 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac007260 con 0x7f9cc00b31a0 2023-09-13T06:01:51.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cc6e34640 1 -- 172.21.15.130:0/4262532437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc006be30 con 0x7f9cc00b31a0 2023-09-13T06:01:51.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cc6e34640 1 -- 172.21.15.130:0/4262532437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc006c3f0 con 0x7f9cc00b31a0 2023-09-13T06:01:51.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.060+0000 7f9cc6e34640 1 -- 172.21.15.130:0/4262532437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc00618a0 con 0x7f9cc00b31a0 2023-09-13T06:01:51.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.064+0000 7f9cbd7fa640 1 -- 172.21.15.130:0/4262532437 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9cac0073c0 con 0x7f9cc00b31a0 2023-09-13T06:01:51.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.064+0000 7f9cbd7fa640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ca4065b20 0x7f9ca4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.064+0000 7f9cbd7fa640 1 -- 172.21.15.130:0/4262532437 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cac0829e0 con 0x7f9cc00b31a0 2023-09-13T06:01:51.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.064+0000 7f9cc4bd0640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ca4065b20 0x7f9ca4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.064+0000 7f9cc4bd0640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ca4065b20 0x7f9ca4067fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4001280 tx=0x7f9cb4007bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:51.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.068+0000 7f9cbd7fa640 1 -- 172.21.15.130:0/4262532437 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9cac050470 con 0x7f9cc00b31a0 2023-09-13T06:01:51.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.216+0000 7f9cc6e34640 1 -- 172.21.15.130:0/4262532437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cc00b2ae0 con 0x7f9cc00b31a0 2023-09-13T06:01:51.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.216+0000 7f9cbd7fa640 1 -- 172.21.15.130:0/4262532437 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cac053a90 con 0x7f9cc00b31a0 2023-09-13T06:01:51.222 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:01:51.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 -- 172.21.15.130:0/4262532437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ca4065b20 msgr2=0x7f9ca4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ca4065b20 0x7f9ca4067fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4001280 tx=0x7f9cb4007bc0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 -- 172.21.15.130:0/4262532437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cc00b31a0 msgr2=0x7f9cc01438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cc00b31a0 0x7f9cc01438f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c450 tx=0x7f9cac00c910 comp rx=0 tx=0).stop 2023-09-13T06:01:51.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 -- 172.21.15.130:0/4262532437 shutdown_connections 2023-09-13T06:01:51.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ca4065b20 0x7f9ca4067fe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc015a080 0x7f9cc014fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cc00b31a0 0x7f9cc01438f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 --2- 172.21.15.130:0/4262532437 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc00b1460 0x7f9cc006cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 -- 172.21.15.130:0/4262532437 >> 172.21.15.130:0/4262532437 conn(0x7f9cc0065990 msgr2=0x7f9cc014d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:51.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 -- 172.21.15.130:0/4262532437 shutdown_connections 2023-09-13T06:01:51.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.220+0000 7f9cc6e34640 1 -- 172.21.15.130:0/4262532437 wait complete. 2023-09-13T06:01:51.242 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:01:51.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73f714d640 1 Processor -- start 2023-09-13T06:01:51.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73f714d640 1 -- start start 2023-09-13T06:01:51.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73f714d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f73f00adbd0 0x7f73f00ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73f714d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f0161370 con 0x7f73f00ad540 2023-09-13T06:01:51.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73f714d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f0161650 con 0x7f73f015d480 2023-09-13T06:01:51.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73f714d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f0161ff0 con 0x7f73f00adbd0 2023-09-13T06:01:51.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73e7fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f73f00adbd0 0x7f73f00ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73e7fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f73f00adbd0 0x7f73f00ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47476/0 (socket says 172.21.15.130:47476) 2023-09-13T06:01:51.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73e7fff640 1 -- 172.21.15.130:0/1603738225 learned_addr learned my addr 172.21.15.130:0/1603738225 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:51.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73e7fff640 1 -- 172.21.15.130:0/1603738225 >> v1:172.21.15.164:6789/0 conn(0x7f73f015d480 legacy=0x7f73f00ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73e7fff640 1 -- 172.21.15.130:0/1603738225 >> v1:172.21.15.130:6789/0 conn(0x7f73f00ad540 legacy=0x7f73f00b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73e7fff640 1 -- 172.21.15.130:0/1603738225 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f0161930 con 0x7f73f00adbd0 2023-09-13T06:01:51.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.380+0000 7f73e77fe640 1 -- 172.21.15.130:0/1603738225 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349227577 0 0) 0x7f73f0161370 con 0x7f73f00ad540 2023-09-13T06:01:51.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73e7fff640 1 --2- 172.21.15.130:0/1603738225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73f00adbd0 0x7f73f00ceeb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009870 tx=0x7f73e001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245d20afaaa5e9d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:51.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73e77fe640 1 -- 172.21.15.130:0/1603738225 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e00ab600 con 0x7f73f00adbd0 2023-09-13T06:01:51.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73e77fe640 1 -- 172.21.15.130:0/1603738225 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e00a7050 con 0x7f73f00adbd0 2023-09-13T06:01:51.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73e77fe640 1 -- 172.21.15.130:0/1603738225 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e00ab980 con 0x7f73f00adbd0 2023-09-13T06:01:51.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73f714d640 1 -- 172.21.15.130:0/1603738225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73f00adbd0 msgr2=0x7f73f00ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73f714d640 1 --2- 172.21.15.130:0/1603738225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73f00adbd0 0x7f73f00ceeb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009870 tx=0x7f73e001c540 comp rx=0 tx=0).stop 2023-09-13T06:01:51.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73f714d640 1 -- 172.21.15.130:0/1603738225 shutdown_connections 2023-09-13T06:01:51.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73f714d640 1 --2- 172.21.15.130:0/1603738225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73f00adbd0 0x7f73f00ceeb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73f714d640 1 -- 172.21.15.130:0/1603738225 >> 172.21.15.130:0/1603738225 conn(0x7f73f0073130 msgr2=0x7f73f0065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:51.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73f714d640 1 -- 172.21.15.130:0/1603738225 shutdown_connections 2023-09-13T06:01:51.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73f714d640 1 -- 172.21.15.130:0/1603738225 wait complete. 2023-09-13T06:01:51.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73f714d640 1 Processor -- start 2023-09-13T06:01:51.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.384+0000 7f73f714d640 1 -- start start 2023-09-13T06:01:51.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f714d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73f00ad540 0x7f73f0160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f714d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73f00adbd0 0x7f73f01556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f714d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73f015d480 0x7f73f015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f714d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f01570d0 con 0x7f73f015d480 2023-09-13T06:01:51.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f714d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0156450 con 0x7f73f00ad540 2023-09-13T06:01:51.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f714d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0156730 con 0x7f73f00adbd0 2023-09-13T06:01:51.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f56ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73f015d480 0x7f73f015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f56ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73f015d480 0x7f73f015dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47478/0 (socket says 172.21.15.130:47478) 2023-09-13T06:01:51.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f56ea640 1 -- 172.21.15.130:0/1468843947 learned_addr learned my addr 172.21.15.130:0/1468843947 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:51.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73e7fff640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73f00adbd0 0x7f73f01556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f4ee9640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73f00ad540 0x7f73f0160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f56ea640 1 -- 172.21.15.130:0/1468843947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73f00adbd0 msgr2=0x7f73f01556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f56ea640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73f00adbd0 0x7f73f01556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f56ea640 1 -- 172.21.15.130:0/1468843947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73f00ad540 msgr2=0x7f73f0160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f56ea640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73f00ad540 0x7f73f0160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f56ea640 1 -- 172.21.15.130:0/1468843947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e00094d0 con 0x7f73f015d480 2023-09-13T06:01:51.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73e7fff640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73f00adbd0 0x7f73f01556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:51.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f56ea640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73f015d480 0x7f73f015dcc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f73e8002240 tx=0x7f73e800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:51.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73e57fa640 1 -- 172.21.15.130:0/1468843947 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800cea0 con 0x7f73f015d480 2023-09-13T06:01:51.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73e57fa640 1 -- 172.21.15.130:0/1468843947 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8003ba0 con 0x7f73f015d480 2023-09-13T06:01:51.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f714d640 1 -- 172.21.15.130:0/1468843947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f0156a10 con 0x7f73f015d480 2023-09-13T06:01:51.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73e57fa640 1 -- 172.21.15.130:0/1468843947 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800a850 con 0x7f73f015d480 2023-09-13T06:01:51.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f714d640 1 -- 172.21.15.130:0/1468843947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f0155c10 con 0x7f73f015d480 2023-09-13T06:01:51.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.388+0000 7f73f714d640 1 -- 172.21.15.130:0/1468843947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f0157210 con 0x7f73f015d480 2023-09-13T06:01:51.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.392+0000 7f73e57fa640 1 -- 172.21.15.130:0/1468843947 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f73e800a9b0 con 0x7f73f015d480 2023-09-13T06:01:51.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.392+0000 7f73e57fa640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f73dc065b20 0x7f73dc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.392+0000 7f73e57fa640 1 -- 172.21.15.130:0/1468843947 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73e8083050 con 0x7f73f015d480 2023-09-13T06:01:51.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.392+0000 7f73f4ee9640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f73dc065b20 0x7f73dc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.392+0000 7f73f4ee9640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f73dc065b20 0x7f73dc067fe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73f014dc10 tx=0x7f73ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:51.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.396+0000 7f73e57fa640 1 -- 172.21.15.130:0/1468843947 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f73f0157210 con 0x7f73f015d480 2023-09-13T06:01:51.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.540+0000 7f73f714d640 1 -- 172.21.15.130:0/1468843947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73f0157210 con 0x7f73f015d480 2023-09-13T06:01:51.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73e57fa640 1 -- 172.21.15.130:0/1468843947 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f73f0157210 con 0x7f73f015d480 2023-09-13T06:01:51.547 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:01:51.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 -- 172.21.15.130:0/1468843947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f73dc065b20 msgr2=0x7f73dc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f73dc065b20 0x7f73dc067fe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73f014dc10 tx=0x7f73ec009040 comp rx=0 tx=0).stop 2023-09-13T06:01:51.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 -- 172.21.15.130:0/1468843947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73f015d480 msgr2=0x7f73f015dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73f015d480 0x7f73f015dcc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f73e8002240 tx=0x7f73e800cc50 comp rx=0 tx=0).stop 2023-09-13T06:01:51.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 -- 172.21.15.130:0/1468843947 shutdown_connections 2023-09-13T06:01:51.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f73dc065b20 0x7f73dc067fe0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73f015d480 0x7f73f015dcc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73f00adbd0 0x7f73f01556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 --2- 172.21.15.130:0/1468843947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73f00ad540 0x7f73f0160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 -- 172.21.15.130:0/1468843947 >> 172.21.15.130:0/1468843947 conn(0x7f73f0073130 msgr2=0x7f73f006cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:51.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 -- 172.21.15.130:0/1468843947 shutdown_connections 2023-09-13T06:01:51.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.544+0000 7f73f714d640 1 -- 172.21.15.130:0/1468843947 wait complete. 2023-09-13T06:01:51.568 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:01:51.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f30a4a19640 1 Processor -- start 2023-09-13T06:01:51.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f30a4a19640 1 -- start start 2023-09-13T06:01:51.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f30a4a19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a015a080 0x7f30a00b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f30a4a19640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f30a015e650 0x7f30a00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f30a4a19640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a00cc850 con 0x7f30a00b2fd0 2023-09-13T06:01:51.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f30a4a19640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a00b3420 con 0x7f30a015e650 2023-09-13T06:01:51.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f30a4a19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00b0330 con 0x7f30a015a080 2023-09-13T06:01:51.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f309ed9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f30a00b2fd0 0x7f30a00ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35988/0 (socket says 172.21.15.130:35988) 2023-09-13T06:01:51.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f309ed9d640 1 -- 172.21.15.130:0/3616457088 learned_addr learned my addr 172.21.15.130:0/3616457088 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:51.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f309e59c640 1 --2- 172.21.15.130:0/3616457088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a015a080 0x7f30a00b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f3097fff640 1 --2- 172.21.15.130:0/3616457088 >> v2:172.21.15.164:3300/0 conn(0x7f30a015e650 0x7f30a00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f309dd9b640 1 -- 172.21.15.130:0/3616457088 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878189520 0 0) 0x7f30980014a0 con 0x7f30a00b2fd0 2023-09-13T06:01:51.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f309dd9b640 1 -- 172.21.15.130:0/3616457088 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f308c003530 con 0x7f30a00b2fd0 2023-09-13T06:01:51.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f309e59c640 1 -- 172.21.15.130:0/3616457088 >> v2:172.21.15.164:3300/0 conn(0x7f30a015e650 msgr2=0x7f30a00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:51.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f309e59c640 1 --2- 172.21.15.130:0/3616457088 >> v2:172.21.15.164:3300/0 conn(0x7f30a015e650 0x7f30a00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f309e59c640 1 -- 172.21.15.130:0/3616457088 >> v1:172.21.15.130:6789/0 conn(0x7f30a00b2fd0 legacy=0x7f30a00ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f309e59c640 1 -- 172.21.15.130:0/3616457088 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a00cbcd0 con 0x7f30a015a080 2023-09-13T06:01:51.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.708+0000 7f3097fff640 1 --2- 172.21.15.130:0/3616457088 >> v2:172.21.15.164:3300/0 conn(0x7f30a015e650 0x7f30a00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:51.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f309e59c640 1 --2- 172.21.15.130:0/3616457088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a015a080 0x7f30a00b1460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f30900097c0 tx=0x7f309001c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa4d167bcccdc6ba server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:51.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f309dd9b640 1 -- 172.21.15.130:0/3616457088 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30900ab600 con 0x7f30a015a080 2023-09-13T06:01:51.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f309dd9b640 1 -- 172.21.15.130:0/3616457088 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30900a7050 con 0x7f30a015a080 2023-09-13T06:01:51.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f309dd9b640 1 -- 172.21.15.130:0/3616457088 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30900ab980 con 0x7f30a015a080 2023-09-13T06:01:51.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f30a4a19640 1 -- 172.21.15.130:0/3616457088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a015a080 msgr2=0x7f30a00b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f30a4a19640 1 --2- 172.21.15.130:0/3616457088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a015a080 0x7f30a00b1460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f30900097c0 tx=0x7f309001c390 comp rx=0 tx=0).stop 2023-09-13T06:01:51.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f30a4a19640 1 -- 172.21.15.130:0/3616457088 shutdown_connections 2023-09-13T06:01:51.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f30a4a19640 1 --2- 172.21.15.130:0/3616457088 >> v2:172.21.15.164:3300/0 conn(0x7f30a015e650 0x7f30a00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f30a4a19640 1 --2- 172.21.15.130:0/3616457088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a015a080 0x7f30a00b1460 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f30a4a19640 1 -- 172.21.15.130:0/3616457088 >> 172.21.15.130:0/3616457088 conn(0x7f30a0065990 msgr2=0x7f30a0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:51.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f30a4a19640 1 -- 172.21.15.130:0/3616457088 shutdown_connections 2023-09-13T06:01:51.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.712+0000 7f30a4a19640 1 -- 172.21.15.130:0/3616457088 wait complete. 2023-09-13T06:01:51.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f30a4a19640 1 Processor -- start 2023-09-13T06:01:51.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f30a4a19640 1 -- start start 2023-09-13T06:01:51.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f30a4a19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a00b2fd0 0x7f30a01419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f30a4a19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a015a080 0x7f30a0158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f30a4a19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a015e650 0x7f30a00cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f30a4a19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0141f10 con 0x7f30a015e650 2023-09-13T06:01:51.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f30a4a19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a006c4b0 con 0x7f30a015a080 2023-09-13T06:01:51.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f30a4a19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a006ca70 con 0x7f30a00b2fd0 2023-09-13T06:01:51.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f309ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a015e650 0x7f30a00cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f309ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a015e650 0x7f30a00cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47482/0 (socket says 172.21.15.130:47482) 2023-09-13T06:01:51.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f309ed9d640 1 -- 172.21.15.130:0/2395491752 learned_addr learned my addr 172.21.15.130:0/2395491752 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:51.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f309e59c640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a00b2fd0 0x7f30a01419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f3097fff640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a015a080 0x7f30a0158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f309ed9d640 1 -- 172.21.15.130:0/2395491752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a00b2fd0 msgr2=0x7f30a01419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f309ed9d640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a00b2fd0 0x7f30a01419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f309ed9d640 1 -- 172.21.15.130:0/2395491752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a015a080 msgr2=0x7f30a0158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f309ed9d640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a015a080 0x7f30a0158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f309ed9d640 1 -- 172.21.15.130:0/2395491752 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3088009420 con 0x7f30a015e650 2023-09-13T06:01:51.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f309e59c640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a00b2fd0 0x7f30a01419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:51.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f3097fff640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a015a080 0x7f30a0158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:51.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f309ed9d640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a015e650 0x7f30a00cef00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f309800cb70 tx=0x7f309800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:51.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f3096ffd640 1 -- 172.21.15.130:0/2395491752 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800ad40 con 0x7f30a015e650 2023-09-13T06:01:51.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f3096ffd640 1 -- 172.21.15.130:0/2395491752 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3098012400 con 0x7f30a015e650 2023-09-13T06:01:51.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f3096ffd640 1 -- 172.21.15.130:0/2395491752 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800aea0 con 0x7f30a015e650 2023-09-13T06:01:51.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f30a4a19640 1 -- 172.21.15.130:0/2395491752 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3090009420 con 0x7f30a015e650 2023-09-13T06:01:51.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.716+0000 7f30a4a19640 1 -- 172.21.15.130:0/2395491752 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a0159760 con 0x7f30a015e650 2023-09-13T06:01:51.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.720+0000 7f30a4a19640 1 -- 172.21.15.130:0/2395491752 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a00618a0 con 0x7f30a015e650 2023-09-13T06:01:51.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.720+0000 7f3096ffd640 1 -- 172.21.15.130:0/2395491752 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3098007070 con 0x7f30a015e650 2023-09-13T06:01:51.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.720+0000 7f3096ffd640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3080065b20 0x7f3080067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:51.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.720+0000 7f3096ffd640 1 -- 172.21.15.130:0/2395491752 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3098083160 con 0x7f30a015e650 2023-09-13T06:01:51.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.720+0000 7f309e59c640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3080065b20 0x7f3080067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:51.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.720+0000 7f309e59c640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3080065b20 0x7f3080067fe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f30900ad000 tx=0x7f3090008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:51.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.724+0000 7f3096ffd640 1 -- 172.21.15.130:0/2395491752 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3098050aa0 con 0x7f30a015e650 2023-09-13T06:01:51.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.872+0000 7f30a4a19640 1 -- 172.21.15.130:0/2395491752 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30a00cc850 con 0x7f30a015e650 2023-09-13T06:01:51.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.872+0000 7f3096ffd640 1 -- 172.21.15.130:0/2395491752 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30a00cc850 con 0x7f30a015e650 2023-09-13T06:01:51.880 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:01:51.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.872+0000 7f30a4a19640 1 -- 172.21.15.130:0/2395491752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3080065b20 msgr2=0x7f3080067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.872+0000 7f30a4a19640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3080065b20 0x7f3080067fe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f30900ad000 tx=0x7f3090008040 comp rx=0 tx=0).stop 2023-09-13T06:01:51.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.872+0000 7f30a4a19640 1 -- 172.21.15.130:0/2395491752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a015e650 msgr2=0x7f30a00cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:51.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.872+0000 7f30a4a19640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a015e650 0x7f30a00cef00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f309800cb70 tx=0x7f309800a430 comp rx=0 tx=0).stop 2023-09-13T06:01:51.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.876+0000 7f30a4a19640 1 -- 172.21.15.130:0/2395491752 shutdown_connections 2023-09-13T06:01:51.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.876+0000 7f30a4a19640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3080065b20 0x7f3080067fe0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.876+0000 7f30a4a19640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a015a080 0x7f30a0158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.876+0000 7f30a4a19640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a015e650 0x7f30a00cef00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.876+0000 7f30a4a19640 1 --2- 172.21.15.130:0/2395491752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a00b2fd0 0x7f30a01419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:51.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.876+0000 7f30a4a19640 1 -- 172.21.15.130:0/2395491752 >> 172.21.15.130:0/2395491752 conn(0x7f30a0065990 msgr2=0x7f30a00ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:51.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.876+0000 7f30a4a19640 1 -- 172.21.15.130:0/2395491752 shutdown_connections 2023-09-13T06:01:51.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:51.876+0000 7f30a4a19640 1 -- 172.21.15.130:0/2395491752 wait complete. 2023-09-13T06:01:51.897 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:52.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4d05ba640 1 Processor -- start 2023-09-13T06:01:52.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4d05ba640 1 -- start start 2023-09-13T06:01:52.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4d05ba640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe4c80b04a0 0x7fe4c80b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4d05ba640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c80ccbe0 con 0x7fe4c815b130 2023-09-13T06:01:52.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4d05ba640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c80ce980 con 0x7fe4c80cc780 2023-09-13T06:01:52.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4d05ba640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c80b0e50 con 0x7fe4c80b04a0 2023-09-13T06:01:52.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4ce356640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe4c815b130 0x7fe4c80ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36000/0 (socket says 172.21.15.130:36000) 2023-09-13T06:01:52.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4ce356640 1 -- 172.21.15.130:0/1006358321 learned_addr learned my addr 172.21.15.130:0/1006358321 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:52.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4ceb57640 1 --2- 172.21.15.130:0/1006358321 >> v2:172.21.15.130:3300/0 conn(0x7fe4c80b04a0 0x7fe4c80b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4cd354640 1 -- 172.21.15.130:0/1006358321 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537951744 0 0) 0x7fe4c80ccbe0 con 0x7fe4c815b130 2023-09-13T06:01:52.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4cd354640 1 -- 172.21.15.130:0/1006358321 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b4003530 con 0x7fe4c815b130 2023-09-13T06:01:52.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4ceb57640 1 -- 172.21.15.130:0/1006358321 >> v1:172.21.15.164:6789/0 conn(0x7fe4c80cc780 legacy=0x7fe4c815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:52.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4ceb57640 1 -- 172.21.15.130:0/1006358321 >> v1:172.21.15.130:6789/0 conn(0x7fe4c815b130 legacy=0x7fe4c80ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.032+0000 7fe4ceb57640 1 -- 172.21.15.130:0/1006358321 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c80cec60 con 0x7fe4c80b04a0 2023-09-13T06:01:52.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.036+0000 7fe4ceb57640 1 --2- 172.21.15.130:0/1006358321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c80b04a0 0x7fe4c80b0910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009d90 tx=0x7fe4c001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751e9d6185642310 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:52.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.036+0000 7fe4cd354640 1 -- 172.21.15.130:0/1006358321 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00a59a0 con 0x7fe4c80b04a0 2023-09-13T06:01:52.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.036+0000 7fe4cd354640 1 -- 172.21.15.130:0/1006358321 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c00a5b00 con 0x7fe4c80b04a0 2023-09-13T06:01:52.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.036+0000 7fe4cd354640 1 -- 172.21.15.130:0/1006358321 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00a5e90 con 0x7fe4c80b04a0 2023-09-13T06:01:52.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.036+0000 7fe4d05ba640 1 -- 172.21.15.130:0/1006358321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c80b04a0 msgr2=0x7fe4c80b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.036+0000 7fe4d05ba640 1 --2- 172.21.15.130:0/1006358321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c80b04a0 0x7fe4c80b0910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009d90 tx=0x7fe4c001c8e0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.036+0000 7fe4d05ba640 1 -- 172.21.15.130:0/1006358321 shutdown_connections 2023-09-13T06:01:52.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.036+0000 7fe4d05ba640 1 --2- 172.21.15.130:0/1006358321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c80b04a0 0x7fe4c80b0910 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.036+0000 7fe4d05ba640 1 -- 172.21.15.130:0/1006358321 >> 172.21.15.130:0/1006358321 conn(0x7fe4c8065990 msgr2=0x7fe4c8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:52.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.036+0000 7fe4d05ba640 1 -- 172.21.15.130:0/1006358321 shutdown_connections 2023-09-13T06:01:52.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.036+0000 7fe4d05ba640 1 -- 172.21.15.130:0/1006358321 wait complete. 2023-09-13T06:01:52.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4d05ba640 1 Processor -- start 2023-09-13T06:01:52.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4d05ba640 1 -- start start 2023-09-13T06:01:52.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4d05ba640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c80b04a0 0x7fe4c8154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4d05ba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4c80cc780 0x7fe4c815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4d05ba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c815b130 0x7fe4c8150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4d05ba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c81f5370 con 0x7fe4c815b130 2023-09-13T06:01:52.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4d05ba640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c81f55c0 con 0x7fe4c80b04a0 2023-09-13T06:01:52.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4d05ba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c81f58a0 con 0x7fe4c80cc780 2023-09-13T06:01:52.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4ceb57640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c815b130 0x7fe4c8150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4ceb57640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c815b130 0x7fe4c8150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47504/0 (socket says 172.21.15.130:47504) 2023-09-13T06:01:52.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4ceb57640 1 -- 172.21.15.130:0/3971182048 learned_addr learned my addr 172.21.15.130:0/3971182048 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:52.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4ce356640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c80b04a0 0x7fe4c8154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4cdb55640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4c80cc780 0x7fe4c815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4ceb57640 1 -- 172.21.15.130:0/3971182048 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4c80cc780 msgr2=0x7fe4c815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4ceb57640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4c80cc780 0x7fe4c815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4ceb57640 1 -- 172.21.15.130:0/3971182048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c80b04a0 msgr2=0x7fe4c8154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4ceb57640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c80b04a0 0x7fe4c8154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4ceb57640 1 -- 172.21.15.130:0/3971182048 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c0009a70 con 0x7fe4c815b130 2023-09-13T06:01:52.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4ceb57640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c815b130 0x7fe4c8150390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00b0040 tx=0x7fe4c0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:52.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4beffd640 1 -- 172.21.15.130:0/3971182048 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00adce0 con 0x7fe4c815b130 2023-09-13T06:01:52.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4beffd640 1 -- 172.21.15.130:0/3971182048 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c00ade40 con 0x7fe4c815b130 2023-09-13T06:01:52.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4beffd640 1 -- 172.21.15.130:0/3971182048 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00b9690 con 0x7fe4c815b130 2023-09-13T06:01:52.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4d05ba640 1 -- 172.21.15.130:0/3971182048 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c81f5b80 con 0x7fe4c815b130 2023-09-13T06:01:52.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.040+0000 7fe4d05ba640 1 -- 172.21.15.130:0/3971182048 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c80ae3e0 con 0x7fe4c815b130 2023-09-13T06:01:52.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.044+0000 7fe4d05ba640 1 -- 172.21.15.130:0/3971182048 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c80618a0 con 0x7fe4c815b130 2023-09-13T06:01:52.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.044+0000 7fe4beffd640 1 -- 172.21.15.130:0/3971182048 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe4c00b97f0 con 0x7fe4c815b130 2023-09-13T06:01:52.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.044+0000 7fe4beffd640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe4ac065b50 0x7fe4ac068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.044+0000 7fe4beffd640 1 -- 172.21.15.130:0/3971182048 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4c011e3c0 con 0x7fe4c815b130 2023-09-13T06:01:52.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.044+0000 7fe4ce356640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe4ac065b50 0x7fe4ac068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.044+0000 7fe4ce356640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe4ac065b50 0x7fe4ac068010 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40011f0 tx=0x7fe4c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:52.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.048+0000 7fe4beffd640 1 -- 172.21.15.130:0/3971182048 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe4c00ebc70 con 0x7fe4c815b130 2023-09-13T06:01:52.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.208+0000 7fe4d05ba640 1 -- 172.21.15.130:0/3971182048 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4c80cc080 con 0x7fe4c815b130 2023-09-13T06:01:52.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4beffd640 1 -- 172.21.15.130:0/3971182048 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fe4c0009450 con 0x7fe4c815b130 2023-09-13T06:01:52.216 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:52.216 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:52.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 -- 172.21.15.130:0/3971182048 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe4ac065b50 msgr2=0x7fe4ac068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe4ac065b50 0x7fe4ac068010 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40011f0 tx=0x7fe4c4009040 comp rx=0 tx=0).stop 2023-09-13T06:01:52.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 -- 172.21.15.130:0/3971182048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c815b130 msgr2=0x7fe4c8150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c815b130 0x7fe4c8150390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00b0040 tx=0x7fe4c0019680 comp rx=0 tx=0).stop 2023-09-13T06:01:52.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 -- 172.21.15.130:0/3971182048 shutdown_connections 2023-09-13T06:01:52.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe4ac065b50 0x7fe4ac068010 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c815b130 0x7fe4c8150390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4c80cc780 0x7fe4c815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 --2- 172.21.15.130:0/3971182048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c80b04a0 0x7fe4c8154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 -- 172.21.15.130:0/3971182048 >> 172.21.15.130:0/3971182048 conn(0x7fe4c8065990 msgr2=0x7fe4c8152b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:52.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 -- 172.21.15.130:0/3971182048 shutdown_connections 2023-09-13T06:01:52.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.212+0000 7fe4d05ba640 1 -- 172.21.15.130:0/3971182048 wait complete. 2023-09-13T06:01:52.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:01:52.237 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:01:52.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a60048640 1 Processor -- start 2023-09-13T06:01:52.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a60048640 1 -- start start 2023-09-13T06:01:52.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a60048640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1a58159900 0x7f1a580cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a60048640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5815a190 con 0x7f1a58159ce0 2023-09-13T06:01:52.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a60048640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a580cc9d0 con 0x7f1a580b4830 2023-09-13T06:01:52.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a60048640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a580b0c20 con 0x7f1a58159900 2023-09-13T06:01:52.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5d5e3640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1a58159ce0 0x7f1a580b4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36002/0 (socket says 172.21.15.130:36002) 2023-09-13T06:01:52.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5d5e3640 1 -- 172.21.15.130:0/287679535 learned_addr learned my addr 172.21.15.130:0/287679535 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:52.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5dde4640 1 --2- 172.21.15.130:0/287679535 >> v2:172.21.15.164:3300/0 conn(0x7f1a58159900 0x7f1a580cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045389535 0 0) 0x7f1a5815a190 con 0x7f1a58159ce0 2023-09-13T06:01:52.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a44003530 con 0x7f1a58159ce0 2023-09-13T06:01:52.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4228149300 0 0) 0x7f1a44003530 con 0x7f1a58159ce0 2023-09-13T06:01:52.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 >> v2:172.21.15.164:3300/0 conn(0x7f1a58159900 msgr2=0x7f1a580cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:52.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 --2- 172.21.15.130:0/287679535 >> v2:172.21.15.164:3300/0 conn(0x7f1a58159900 0x7f1a580cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 >> v1:172.21.15.164:6789/0 conn(0x7f1a580b4830 legacy=0x7f1a58163410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a580cccb0 con 0x7f1a58159ce0 2023-09-13T06:01:52.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f1a48001680 con 0x7f1a58159ce0 2023-09-13T06:01:52.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 >> v1:172.21.15.130:6789/0 conn(0x7f1a58159ce0 legacy=0x7f1a580b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a440039f0 0x7f1a44003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 0x7f1a44004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a44005190 0x7f1a4400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a580b0c20 con 0x7f1a440047d0 2023-09-13T06:01:52.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4400e2d0 con 0x7f1a440039f0 2023-09-13T06:01:52.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4400e490 con 0x7f1a44005190 2023-09-13T06:01:52.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5dde4640 1 --2- 172.21.15.130:0/287679535 >> v2:172.21.15.164:3300/0 conn(0x7f1a58159900 0x7f1a580cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:52.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5d5e3640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 0x7f1a44004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5dde4640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a440039f0 0x7f1a44003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.376+0000 7f1a5e5e5640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a44005190 0x7f1a4400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a5d5e3640 1 -- 172.21.15.130:0/287679535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a44005190 msgr2=0x7f1a4400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:52.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a5d5e3640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a44005190 0x7f1a4400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a5d5e3640 1 -- 172.21.15.130:0/287679535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a440039f0 msgr2=0x7f1a44003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:52.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a5d5e3640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a440039f0 0x7f1a44003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a5d5e3640 1 -- 172.21.15.130:0/287679535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a44003530 con 0x7f1a440047d0 2023-09-13T06:01:52.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a5e5e5640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a44005190 0x7f1a4400dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:52.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a5e5e5640 1 -- 172.21.15.130:0/287679535 reap_dead start 2023-09-13T06:01:52.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a5d5e3640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 0x7f1a44004c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800c240 tx=0x7f1a4801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209d2460570a4880 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:52.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48005ae0 con 0x7f1a440047d0 2023-09-13T06:01:52.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a480ab070 con 0x7f1a440047d0 2023-09-13T06:01:52.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a5cde2640 1 -- 172.21.15.130:0/287679535 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48007070 con 0x7f1a440047d0 2023-09-13T06:01:52.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a60048640 1 -- 172.21.15.130:0/287679535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 msgr2=0x7f1a44004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a60048640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 0x7f1a44004c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800c240 tx=0x7f1a4801f3b0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a60048640 1 -- 172.21.15.130:0/287679535 shutdown_connections 2023-09-13T06:01:52.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a60048640 1 --2- 172.21.15.130:0/287679535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 0x7f1a44004c50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.380+0000 7f1a60048640 1 -- 172.21.15.130:0/287679535 >> 172.21.15.130:0/287679535 conn(0x7f1a58065990 msgr2=0x7f1a58065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:52.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a60048640 1 -- 172.21.15.130:0/287679535 shutdown_connections 2023-09-13T06:01:52.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a60048640 1 -- 172.21.15.130:0/287679535 wait complete. 2023-09-13T06:01:52.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a60048640 1 Processor -- start 2023-09-13T06:01:52.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a60048640 1 -- start start 2023-09-13T06:01:52.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a60048640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 0x7f1a581e30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a60048640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a581539c0 0x7f1a5813c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a60048640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a58153e40 0x7f1a5813cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a60048640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a581e3900 con 0x7f1a440047d0 2023-09-13T06:01:52.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a60048640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a581e3be0 con 0x7f1a581539c0 2023-09-13T06:01:52.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a60048640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a581e3ec0 con 0x7f1a58153e40 2023-09-13T06:01:52.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5dde4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 0x7f1a581e30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5dde4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 0x7f1a581e30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47536/0 (socket says 172.21.15.130:47536) 2023-09-13T06:01:52.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5dde4640 1 -- 172.21.15.130:0/2568376190 learned_addr learned my addr 172.21.15.130:0/2568376190 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:52.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5d5e3640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a581539c0 0x7f1a5813c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5e5e5640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a58153e40 0x7f1a5813cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5dde4640 1 -- 172.21.15.130:0/2568376190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a58153e40 msgr2=0x7f1a5813cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5dde4640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a58153e40 0x7f1a5813cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5dde4640 1 -- 172.21.15.130:0/2568376190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a581539c0 msgr2=0x7f1a5813c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5dde4640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a581539c0 0x7f1a5813c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5dde4640 1 -- 172.21.15.130:0/2568376190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a581e41a0 con 0x7f1a440047d0 2023-09-13T06:01:52.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5d5e3640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a581539c0 0x7f1a5813c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:52.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5e5e5640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a58153e40 0x7f1a5813cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:52.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a5dde4640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 0x7f1a581e30b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a54011b10 tx=0x7f1a5400f2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:52.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.384+0000 7f1a4e7fc640 1 -- 172.21.15.130:0/2568376190 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5400fe90 con 0x7f1a440047d0 2023-09-13T06:01:52.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.388+0000 7f1a4e7fc640 1 -- 172.21.15.130:0/2568376190 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54004030 con 0x7f1a440047d0 2023-09-13T06:01:52.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.388+0000 7f1a4e7fc640 1 -- 172.21.15.130:0/2568376190 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540043c0 con 0x7f1a440047d0 2023-09-13T06:01:52.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.388+0000 7f1a60048640 1 -- 172.21.15.130:0/2568376190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a581e4480 con 0x7f1a440047d0 2023-09-13T06:01:52.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.388+0000 7f1a60048640 1 -- 172.21.15.130:0/2568376190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a581e35f0 con 0x7f1a440047d0 2023-09-13T06:01:52.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.388+0000 7f1a60048640 1 -- 172.21.15.130:0/2568376190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a580618a0 con 0x7f1a440047d0 2023-09-13T06:01:52.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.388+0000 7f1a4e7fc640 1 -- 172.21.15.130:0/2568376190 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1a54003620 con 0x7f1a440047d0 2023-09-13T06:01:52.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.388+0000 7f1a4e7fc640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a3c065b50 0x7f1a3c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.388+0000 7f1a4e7fc640 1 -- 172.21.15.130:0/2568376190 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a54017070 con 0x7f1a440047d0 2023-09-13T06:01:52.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.388+0000 7f1a5d5e3640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a3c065b50 0x7f1a3c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.392+0000 7f1a5d5e3640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a3c065b50 0x7f1a3c068010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a480af000 tx=0x7f1a480aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:52.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.392+0000 7f1a4e7fc640 1 -- 172.21.15.130:0/2568376190 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1a54051c50 con 0x7f1a440047d0 2023-09-13T06:01:52.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 -- 172.21.15.130:0/2568376190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a580b3890 con 0x7f1a440047d0 2023-09-13T06:01:52.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a4e7fc640 1 -- 172.21.15.130:0/2568376190 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a54055270 con 0x7f1a440047d0 2023-09-13T06:01:52.547 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:01:52.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 -- 172.21.15.130:0/2568376190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a3c065b50 msgr2=0x7f1a3c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a3c065b50 0x7f1a3c068010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a480af000 tx=0x7f1a480aa000 comp rx=0 tx=0).stop 2023-09-13T06:01:52.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 -- 172.21.15.130:0/2568376190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 msgr2=0x7f1a581e30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 0x7f1a581e30b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a54011b10 tx=0x7f1a5400f2e0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 -- 172.21.15.130:0/2568376190 shutdown_connections 2023-09-13T06:01:52.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a3c065b50 0x7f1a3c068010 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a581539c0 0x7f1a5813c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a58153e40 0x7f1a5813cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 --2- 172.21.15.130:0/2568376190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a440047d0 0x7f1a581e30b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 -- 172.21.15.130:0/2568376190 >> 172.21.15.130:0/2568376190 conn(0x7f1a58065990 msgr2=0x7f1a580af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:52.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 -- 172.21.15.130:0/2568376190 shutdown_connections 2023-09-13T06:01:52.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.544+0000 7f1a60048640 1 -- 172.21.15.130:0/2568376190 wait complete. 2023-09-13T06:01:52.568 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:01:52.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbad5ad8640 1 Processor -- start 2023-09-13T06:01:52.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbad5ad8640 1 -- start start 2023-09-13T06:01:52.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbad5ad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad00b1460 0x7fbad00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbad5ad8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad00cc850 con 0x7fbad015a080 2023-09-13T06:01:52.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbad5ad8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad00b33f0 con 0x7fbad00b2fd0 2023-09-13T06:01:52.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbad5ad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00b0330 con 0x7fbad00b1460 2023-09-13T06:01:52.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbacf7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fbad015a080 0x7fbad015e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36016/0 (socket says 172.21.15.130:36016) 2023-09-13T06:01:52.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbacf7fe640 1 -- 172.21.15.130:0/373335259 learned_addr learned my addr 172.21.15.130:0/373335259 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:52.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330299179 0 0) 0x7fbac0001120 con 0x7fbad015a080 2023-09-13T06:01:52.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab8005740 con 0x7fbad015a080 2023-09-13T06:01:52.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbaceffd640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad00b1460 0x7fbad00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1897097183 0 0) 0x7fbab8005740 con 0x7fbad015a080 2023-09-13T06:01:52.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad00b1460 msgr2=0x7fbad00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:52.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad00b1460 0x7fbad00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 >> v1:172.21.15.164:6789/0 conn(0x7fbad00b2fd0 legacy=0x7fbad00ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad00cbcd0 con 0x7fbad015a080 2023-09-13T06:01:52.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fbac0001810 con 0x7fbad015a080 2023-09-13T06:01:52.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbaceffd640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad00b1460 0x7fbad00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:52.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 >> v1:172.21.15.130:6789/0 conn(0x7fbad015a080 legacy=0x7fbad015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8005c30 0x7fbab8006050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbab80069e0 0x7fbab8006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbab80074c0 0x7fbab800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00b0330 con 0x7fbab8005c30 2023-09-13T06:01:52.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab800e3c0 con 0x7fbab80074c0 2023-09-13T06:01:52.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab800e580 con 0x7fbab80069e0 2023-09-13T06:01:52.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbacf7fe640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8005c30 0x7fbab8006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbaceffd640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbab80069e0 0x7fbab8006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbacffff640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbab80074c0 0x7fbab800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbacf7fe640 1 -- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbab80069e0 msgr2=0x7fbab8006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:52.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbacf7fe640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbab80069e0 0x7fbab8006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbacf7fe640 1 -- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbab80074c0 msgr2=0x7fbab800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:52.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbacf7fe640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbab80074c0 0x7fbab800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbacf7fe640 1 -- 172.21.15.130:0/373335259 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8005740 con 0x7fbab8005c30 2023-09-13T06:01:52.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.708+0000 7fbaceffd640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbab80069e0 0x7fbab8006e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:52.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.712+0000 7fbacf7fe640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8005c30 0x7fbab8006050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbac0007fd0 tx=0x7fbac001cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571ff2dd8884ec7e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:52.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.712+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0005ae0 con 0x7fbab8005c30 2023-09-13T06:01:52.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.712+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac0005c60 con 0x7fbab8005c30 2023-09-13T06:01:52.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.712+0000 7fbace7fc640 1 -- 172.21.15.130:0/373335259 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0007070 con 0x7fbab8005c30 2023-09-13T06:01:52.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.712+0000 7fbad5ad8640 1 -- 172.21.15.130:0/373335259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8005c30 msgr2=0x7fbab8006050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.712+0000 7fbad5ad8640 1 --2- 172.21.15.130:0/373335259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8005c30 0x7fbab8006050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbac0007fd0 tx=0x7fbac001cb30 comp rx=0 tx=0).stop 2023-09-13T06:01:52.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.712+0000 7fbacffff640 1 -- 172.21.15.130:0/373335259 reap_dead start 2023-09-13T06:01:52.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.712+0000 7fbad5ad8640 1 -- 172.21.15.130:0/373335259 shutdown_connections 2023-09-13T06:01:52.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.712+0000 7fbad5ad8640 1 -- 172.21.15.130:0/373335259 >> 172.21.15.130:0/373335259 conn(0x7fbad0065990 msgr2=0x7fbad0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:52.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.712+0000 7fbad5ad8640 1 -- 172.21.15.130:0/373335259 shutdown_connections 2023-09-13T06:01:52.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.712+0000 7fbad5ad8640 1 -- 172.21.15.130:0/373335259 wait complete. 2023-09-13T06:01:52.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbad5ad8640 1 Processor -- start 2023-09-13T06:01:52.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbad5ad8640 1 -- start start 2023-09-13T06:01:52.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbad5ad8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbab8005c30 0x7fbad0148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbad5ad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad0160120 0x7fbad01605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbad5ad8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad00cef70 0x7fbad00cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbad5ad8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad006ca20 con 0x7fbad00cef70 2023-09-13T06:01:52.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbad5ad8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad015df40 con 0x7fbab8005c30 2023-09-13T06:01:52.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbad5ad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad006be30 con 0x7fbad0160120 2023-09-13T06:01:52.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbacffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad00cef70 0x7fbad00cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbacffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad00cef70 0x7fbad00cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47548/0 (socket says 172.21.15.130:47548) 2023-09-13T06:01:52.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbacffff640 1 -- 172.21.15.130:0/1074712950 learned_addr learned my addr 172.21.15.130:0/1074712950 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:52.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbacf7fe640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbab8005c30 0x7fbad0148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbaceffd640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad0160120 0x7fbad01605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbacffff640 1 -- 172.21.15.130:0/1074712950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad0160120 msgr2=0x7fbad01605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbacffff640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad0160120 0x7fbad01605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbacffff640 1 -- 172.21.15.130:0/1074712950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbab8005c30 msgr2=0x7fbad0148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbacffff640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbab8005c30 0x7fbad0148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbacffff640 1 -- 172.21.15.130:0/1074712950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad0160ae0 con 0x7fbad00cef70 2023-09-13T06:01:52.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbacf7fe640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbab8005c30 0x7fbad0148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:52.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbacffff640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad00cef70 0x7fbad00cf3f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbac8002240 tx=0x7fbac800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:52.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbab7fff640 1 -- 172.21.15.130:0/1074712950 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8003b90 con 0x7fbad00cef70 2023-09-13T06:01:52.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbab7fff640 1 -- 172.21.15.130:0/1074712950 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac8003cf0 con 0x7fbad00cef70 2023-09-13T06:01:52.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbab7fff640 1 -- 172.21.15.130:0/1074712950 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8005310 con 0x7fbad00cef70 2023-09-13T06:01:52.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbad5ad8640 1 -- 172.21.15.130:0/1074712950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad00cf930 con 0x7fbad00cef70 2023-09-13T06:01:52.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.716+0000 7fbad5ad8640 1 -- 172.21.15.130:0/1074712950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad006c360 con 0x7fbad00cef70 2023-09-13T06:01:52.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.720+0000 7fbad5ad8640 1 -- 172.21.15.130:0/1074712950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad006cb60 con 0x7fbad00cef70 2023-09-13T06:01:52.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.720+0000 7fbab7fff640 1 -- 172.21.15.130:0/1074712950 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbac8005470 con 0x7fbad00cef70 2023-09-13T06:01:52.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.720+0000 7fbab7fff640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbabc065b20 0x7fbabc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:52.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.720+0000 7fbab7fff640 1 -- 172.21.15.130:0/1074712950 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbac8082ef0 con 0x7fbad00cef70 2023-09-13T06:01:52.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.720+0000 7fbacf7fe640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbabc065b20 0x7fbabc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:52.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.720+0000 7fbacf7fe640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbabc065b20 0x7fbabc067fe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbac00ab000 tx=0x7fbac00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:52.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.724+0000 7fbab7fff640 1 -- 172.21.15.130:0/1074712950 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbad006cb60 con 0x7fbad00cef70 2023-09-13T06:01:52.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbad5ad8640 1 -- 172.21.15.130:0/1074712950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbad006cb60 con 0x7fbad00cef70 2023-09-13T06:01:52.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbab7fff640 1 -- 172.21.15.130:0/1074712950 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbad006cb60 con 0x7fbad00cef70 2023-09-13T06:01:52.876 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:01:52.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbad5ad8640 1 -- 172.21.15.130:0/1074712950 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbabc065b20 msgr2=0x7fbabc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbad5ad8640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbabc065b20 0x7fbabc067fe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbac00ab000 tx=0x7fbac00a7070 comp rx=0 tx=0).stop 2023-09-13T06:01:52.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbad5ad8640 1 -- 172.21.15.130:0/1074712950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad00cef70 msgr2=0x7fbad00cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:52.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbad5ad8640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad00cef70 0x7fbad00cf3f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbac8002240 tx=0x7fbac800e960 comp rx=0 tx=0).stop 2023-09-13T06:01:52.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbad5ad8640 1 -- 172.21.15.130:0/1074712950 shutdown_connections 2023-09-13T06:01:52.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbad5ad8640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbabc065b20 0x7fbabc067fe0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbad5ad8640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad00cef70 0x7fbad00cf3f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbad5ad8640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad0160120 0x7fbad01605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbad5ad8640 1 --2- 172.21.15.130:0/1074712950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbab8005c30 0x7fbad0148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:52.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.872+0000 7fbad5ad8640 1 -- 172.21.15.130:0/1074712950 >> 172.21.15.130:0/1074712950 conn(0x7fbad0065990 msgr2=0x7fbad00b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:52.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.876+0000 7fbad5ad8640 1 -- 172.21.15.130:0/1074712950 shutdown_connections 2023-09-13T06:01:52.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:52.876+0000 7fbad5ad8640 1 -- 172.21.15.130:0/1074712950 wait complete. 2023-09-13T06:01:52.898 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:01:53.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.032+0000 7fb511256640 1 Processor -- start 2023-09-13T06:01:53.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.032+0000 7fb511256640 1 -- start start 2023-09-13T06:01:53.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb511256640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb50c0b2e90 0x7fb50c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb511256640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c0b2150 con 0x7fb50c0b1460 2023-09-13T06:01:53.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb511256640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c0cdd90 con 0x7fb50c144d70 2023-09-13T06:01:53.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb511256640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c0b2430 con 0x7fb50c0b2e90 2023-09-13T06:01:53.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb50259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb50c0b2e90 0x7fb50c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb50259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb50c0b2e90 0x7fb50c0ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47550/0 (socket says 172.21.15.130:47550) 2023-09-13T06:01:53.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb50b59e640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb50c0b1460 0x7fb50c0b18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36024/0 (socket says 172.21.15.130:36024) 2023-09-13T06:01:53.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb50259c640 1 -- 172.21.15.130:0/1059335996 learned_addr learned my addr 172.21.15.130:0/1059335996 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:53.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb50259c640 1 -- 172.21.15.130:0/1059335996 >> v1:172.21.15.164:6789/0 conn(0x7fb50c144d70 legacy=0x7fb50c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:53.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb50259c640 1 -- 172.21.15.130:0/1059335996 >> v1:172.21.15.130:6789/0 conn(0x7fb50c0b1460 legacy=0x7fb50c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb50259c640 1 -- 172.21.15.130:0/1059335996 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c0ce070 con 0x7fb50c0b2e90 2023-09-13T06:01:53.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.036+0000 7fb50a59c640 1 -- 172.21.15.130:0/1059335996 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800757523 0 0) 0x7fb50c0b2150 con 0x7fb50c0b1460 2023-09-13T06:01:53.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb50259c640 1 --2- 172.21.15.130:0/1059335996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c0b2e90 0x7fb50c0ce870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009870 tx=0x7fb4f401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b95c9f4bfa634c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:53.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb50a59c640 1 -- 172.21.15.130:0/1059335996 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40ab600 con 0x7fb50c0b2e90 2023-09-13T06:01:53.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb50a59c640 1 -- 172.21.15.130:0/1059335996 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f40a7050 con 0x7fb50c0b2e90 2023-09-13T06:01:53.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb50a59c640 1 -- 172.21.15.130:0/1059335996 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40ab980 con 0x7fb50c0b2e90 2023-09-13T06:01:53.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb511256640 1 -- 172.21.15.130:0/1059335996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c0b2e90 msgr2=0x7fb50c0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb511256640 1 --2- 172.21.15.130:0/1059335996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c0b2e90 0x7fb50c0ce870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009870 tx=0x7fb4f401c540 comp rx=0 tx=0).stop 2023-09-13T06:01:53.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb511256640 1 -- 172.21.15.130:0/1059335996 shutdown_connections 2023-09-13T06:01:53.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb511256640 1 --2- 172.21.15.130:0/1059335996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c0b2e90 0x7fb50c0ce870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb511256640 1 -- 172.21.15.130:0/1059335996 >> 172.21.15.130:0/1059335996 conn(0x7fb50c065990 msgr2=0x7fb50c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:53.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb511256640 1 -- 172.21.15.130:0/1059335996 shutdown_connections 2023-09-13T06:01:53.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb511256640 1 -- 172.21.15.130:0/1059335996 wait complete. 2023-09-13T06:01:53.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb511256640 1 Processor -- start 2023-09-13T06:01:53.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.040+0000 7fb511256640 1 -- start start 2023-09-13T06:01:53.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb511256640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c0b1460 0x7fb50c138260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb511256640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb50c0b2e90 0x7fb50c13eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb511256640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb50c144d70 0x7fb50c13dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb511256640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0cdab0 con 0x7fb50c0b1460 2023-09-13T06:01:53.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb511256640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c13d730 con 0x7fb50c0b2e90 2023-09-13T06:01:53.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb511256640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c13f530 con 0x7fb50c144d70 2023-09-13T06:01:53.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb50ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c0b1460 0x7fb50c138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb50ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c0b1460 0x7fb50c138260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47560/0 (socket says 172.21.15.130:47560) 2023-09-13T06:01:53.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb50ad9d640 1 -- 172.21.15.130:0/3752743227 learned_addr learned my addr 172.21.15.130:0/3752743227 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:53.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb50259c640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb50c0b2e90 0x7fb50c13eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb50b59e640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb50c144d70 0x7fb50c13dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb50ad9d640 1 -- 172.21.15.130:0/3752743227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb50c144d70 msgr2=0x7fb50c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb50ad9d640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb50c144d70 0x7fb50c13dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb50ad9d640 1 -- 172.21.15.130:0/3752743227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb50c0b2e90 msgr2=0x7fb50c13eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb50ad9d640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb50c0b2e90 0x7fb50c13eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb50ad9d640 1 -- 172.21.15.130:0/3752743227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f40094d0 con 0x7fb50c0b1460 2023-09-13T06:01:53.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb50ad9d640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c0b1460 0x7fb50c138260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c3c0 tx=0x7fb4fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:53.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb503fff640 1 -- 172.21.15.130:0/3752743227 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0052d0 con 0x7fb50c0b1460 2023-09-13T06:01:53.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb503fff640 1 -- 172.21.15.130:0/3752743227 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc005430 con 0x7fb50c0b1460 2023-09-13T06:01:53.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb503fff640 1 -- 172.21.15.130:0/3752743227 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc003840 con 0x7fb50c0b1460 2023-09-13T06:01:53.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb511256640 1 -- 172.21.15.130:0/3752743227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c0cd7d0 con 0x7fb50c0b1460 2023-09-13T06:01:53.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb511256640 1 -- 172.21.15.130:0/3752743227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c0cbe60 con 0x7fb50c0b1460 2023-09-13T06:01:53.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb511256640 1 -- 172.21.15.130:0/3752743227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50c0cb9e0 con 0x7fb50c0b1460 2023-09-13T06:01:53.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.044+0000 7fb503fff640 1 -- 172.21.15.130:0/3752743227 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb4fc0039a0 con 0x7fb50c0b1460 2023-09-13T06:01:53.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.048+0000 7fb503fff640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4ec065b20 0x7fb4ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.048+0000 7fb503fff640 1 -- 172.21.15.130:0/3752743227 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4fc082820 con 0x7fb50c0b1460 2023-09-13T06:01:53.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.048+0000 7fb50259c640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4ec065b20 0x7fb4ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.048+0000 7fb50259c640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4ec065b20 0x7fb4ec067fe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0668f0 tx=0x7fb4f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:53.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.052+0000 7fb503fff640 1 -- 172.21.15.130:0/3752743227 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb50c0cb9e0 con 0x7fb50c0b1460 2023-09-13T06:01:53.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.196+0000 7fb511256640 1 -- 172.21.15.130:0/3752743227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb50c0cb9e0 con 0x7fb50c0b1460 2023-09-13T06:01:53.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.196+0000 7fb503fff640 1 -- 172.21.15.130:0/3752743227 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4fc017020 con 0x7fb50c0b1460 2023-09-13T06:01:53.202 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:01:53.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 -- 172.21.15.130:0/3752743227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4ec065b20 msgr2=0x7fb4ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4ec065b20 0x7fb4ec067fe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0668f0 tx=0x7fb4f4008040 comp rx=0 tx=0).stop 2023-09-13T06:01:53.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 -- 172.21.15.130:0/3752743227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c0b1460 msgr2=0x7fb50c138260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c0b1460 0x7fb50c138260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c3c0 tx=0x7fb4fc00c880 comp rx=0 tx=0).stop 2023-09-13T06:01:53.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 -- 172.21.15.130:0/3752743227 shutdown_connections 2023-09-13T06:01:53.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4ec065b20 0x7fb4ec067fe0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb50c0b2e90 0x7fb50c13eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb50c144d70 0x7fb50c13dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 --2- 172.21.15.130:0/3752743227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c0b1460 0x7fb50c138260 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 -- 172.21.15.130:0/3752743227 >> 172.21.15.130:0/3752743227 conn(0x7fb50c065990 msgr2=0x7fb50c0b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:53.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 -- 172.21.15.130:0/3752743227 shutdown_connections 2023-09-13T06:01:53.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.200+0000 7fb511256640 1 -- 172.21.15.130:0/3752743227 wait complete. 2023-09-13T06:01:53.245 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-09-13T06:01:53.248 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-09-13T06:01:53.249 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:53.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95d5a48640 1 Processor -- start 2023-09-13T06:01:53.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95d5a48640 1 -- start start 2023-09-13T06:01:53.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95d5a48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1750 0x7f95d015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95d5a48640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f95d00d1090 0x7f95d0146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95d5a48640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d00b63c0 con 0x7f95d00d1b30 2023-09-13T06:01:53.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95d5a48640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d015dea0 con 0x7f95d00d1090 2023-09-13T06:01:53.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95d5a48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00d0c20 con 0x7f95d00d1750 2023-09-13T06:01:53.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95ceffd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1750 0x7f95d015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95ceffd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1750 0x7f95d015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:51436/0 (socket says 172.21.15.130:51436) 2023-09-13T06:01:53.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95ceffd640 1 -- 172.21.15.130:0/282484371 learned_addr learned my addr 172.21.15.130:0/282484371 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:53.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95ce7fc640 1 --2- 172.21.15.130:0/282484371 >> v2:172.21.15.164:3300/0 conn(0x7f95d00d1090 0x7f95d0146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95ceffd640 1 -- 172.21.15.130:0/282484371 >> v2:172.21.15.164:3300/0 conn(0x7f95d00d1090 msgr2=0x7f95d0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:53.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95ceffd640 1 --2- 172.21.15.130:0/282484371 >> v2:172.21.15.164:3300/0 conn(0x7f95d00d1090 0x7f95d0146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95ceffd640 1 -- 172.21.15.130:0/282484371 >> v1:172.21.15.164:6789/0 conn(0x7f95d00d1b30 legacy=0x7f95d00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.384+0000 7f95ceffd640 1 -- 172.21.15.130:0/282484371 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d00b6610 con 0x7f95d00d1750 2023-09-13T06:01:53.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95ceffd640 1 --2- 172.21.15.130:0/282484371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1750 0x7f95d015d960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009870 tx=0x7f95c001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5344ebe4d6a3bb35 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:53.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95cdffb640 1 -- 172.21.15.130:0/282484371 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00aa670 con 0x7f95d00d1750 2023-09-13T06:01:53.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95cdffb640 1 -- 172.21.15.130:0/282484371 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c00aa7d0 con 0x7f95d00d1750 2023-09-13T06:01:53.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95cdffb640 1 -- 172.21.15.130:0/282484371 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00aab60 con 0x7f95d00d1750 2023-09-13T06:01:53.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95d5a48640 1 -- 172.21.15.130:0/282484371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1750 msgr2=0x7f95d015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95d5a48640 1 --2- 172.21.15.130:0/282484371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1750 0x7f95d015d960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009870 tx=0x7f95c001c510 comp rx=0 tx=0).stop 2023-09-13T06:01:53.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95d5a48640 1 -- 172.21.15.130:0/282484371 shutdown_connections 2023-09-13T06:01:53.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95d5a48640 1 --2- 172.21.15.130:0/282484371 >> v2:172.21.15.164:3300/0 conn(0x7f95d00d1090 0x7f95d0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95d5a48640 1 --2- 172.21.15.130:0/282484371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1750 0x7f95d015d960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95d5a48640 1 -- 172.21.15.130:0/282484371 >> 172.21.15.130:0/282484371 conn(0x7f95d006f170 msgr2=0x7f95d006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:53.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95d5a48640 1 -- 172.21.15.130:0/282484371 shutdown_connections 2023-09-13T06:01:53.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.388+0000 7f95d5a48640 1 -- 172.21.15.130:0/282484371 wait complete. 2023-09-13T06:01:53.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95d5a48640 1 Processor -- start 2023-09-13T06:01:53.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95d5a48640 1 -- start start 2023-09-13T06:01:53.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95d5a48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d00d1090 0x7f95d013bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95d5a48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d00d1750 0x7f95d013d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95d5a48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1b30 0x7f95d013fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95d5a48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d013de40 con 0x7f95d00d1090 2023-09-13T06:01:53.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95d5a48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d013e120 con 0x7f95d00d1750 2023-09-13T06:01:53.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95d5a48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d013e400 con 0x7f95d00d1b30 2023-09-13T06:01:53.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95ceffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d00d1090 0x7f95d013bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95ceffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d00d1090 0x7f95d013bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47562/0 (socket says 172.21.15.130:47562) 2023-09-13T06:01:53.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95ceffd640 1 -- 172.21.15.130:0/3405998811 learned_addr learned my addr 172.21.15.130:0/3405998811 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:53.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95ce7fc640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d00d1750 0x7f95d013d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95cf7fe640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1b30 0x7f95d013fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95ceffd640 1 -- 172.21.15.130:0/3405998811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1b30 msgr2=0x7f95d013fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95ceffd640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1b30 0x7f95d013fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95ceffd640 1 -- 172.21.15.130:0/3405998811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d00d1750 msgr2=0x7f95d013d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95ceffd640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d00d1750 0x7f95d013d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95ceffd640 1 -- 172.21.15.130:0/3405998811 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c00094d0 con 0x7f95d00d1090 2023-09-13T06:01:53.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95cf7fe640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1b30 0x7f95d013fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:53.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95ceffd640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d00d1090 0x7f95d013bb70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f95c00ac040 tx=0x7f95c001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:53.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95b7fff640 1 -- 172.21.15.130:0/3405998811 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00b3800 con 0x7f95d00d1090 2023-09-13T06:01:53.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95b7fff640 1 -- 172.21.15.130:0/3405998811 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c00b3980 con 0x7f95d00d1090 2023-09-13T06:01:53.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95b7fff640 1 -- 172.21.15.130:0/3405998811 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00b3d30 con 0x7f95d00d1090 2023-09-13T06:01:53.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.392+0000 7f95d5a48640 1 -- 172.21.15.130:0/3405998811 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d013e6e0 con 0x7f95d00d1090 2023-09-13T06:01:53.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.396+0000 7f95d5a48640 1 -- 172.21.15.130:0/3405998811 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d013c0b0 con 0x7f95d00d1090 2023-09-13T06:01:53.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.396+0000 7f95d5a48640 1 -- 172.21.15.130:0/3405998811 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d00618a0 con 0x7f95d00d1090 2023-09-13T06:01:53.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.396+0000 7f95b7fff640 1 -- 172.21.15.130:0/3405998811 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f95c00b2380 con 0x7f95d00d1090 2023-09-13T06:01:53.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.396+0000 7f95b7fff640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95bc065b20 0x7f95bc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.396+0000 7f95b7fff640 1 -- 172.21.15.130:0/3405998811 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95c011db70 con 0x7f95d00d1090 2023-09-13T06:01:53.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.396+0000 7f95ce7fc640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95bc065b20 0x7f95bc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.396+0000 7f95ce7fc640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95bc065b20 0x7f95bc067fe0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f95d015d4c0 tx=0x7f95c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:53.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.400+0000 7f95b7fff640 1 -- 172.21.15.130:0/3405998811 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f95c00eb4d0 con 0x7f95d00d1090 2023-09-13T06:01:53.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95d5a48640 1 -- 172.21.15.130:0/3405998811 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95d013eb90 con 0x7f95d00d1090 2023-09-13T06:01:53.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95b7fff640 1 -- 172.21.15.130:0/3405998811 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f95c00eeaf0 con 0x7f95d00d1090 2023-09-13T06:01:53.556 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:53.556 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:53.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95d5a48640 1 -- 172.21.15.130:0/3405998811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95bc065b20 msgr2=0x7f95bc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95d5a48640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95bc065b20 0x7f95bc067fe0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f95d015d4c0 tx=0x7f95c4008040 comp rx=0 tx=0).stop 2023-09-13T06:01:53.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95d5a48640 1 -- 172.21.15.130:0/3405998811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d00d1090 msgr2=0x7f95d013bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95d5a48640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d00d1090 0x7f95d013bb70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f95c00ac040 tx=0x7f95c001ad50 comp rx=0 tx=0).stop 2023-09-13T06:01:53.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95d5a48640 1 -- 172.21.15.130:0/3405998811 shutdown_connections 2023-09-13T06:01:53.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95d5a48640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95bc065b20 0x7f95bc067fe0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95d5a48640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d00d1750 0x7f95d013d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95d5a48640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95d00d1b30 0x7f95d013fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95d5a48640 1 --2- 172.21.15.130:0/3405998811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d00d1090 0x7f95d013bb70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.552+0000 7f95d5a48640 1 -- 172.21.15.130:0/3405998811 >> 172.21.15.130:0/3405998811 conn(0x7f95d006f170 msgr2=0x7f95d015dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:53.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.556+0000 7f95d5a48640 1 -- 172.21.15.130:0/3405998811 shutdown_connections 2023-09-13T06:01:53.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.556+0000 7f95d5a48640 1 -- 172.21.15.130:0/3405998811 wait complete. 2023-09-13T06:01:53.578 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:01:53.579 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:01:53.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d81c19640 1 Processor -- start 2023-09-13T06:01:53.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d81c19640 1 -- start start 2023-09-13T06:01:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d81c19640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5d7c0b2e90 0x7f5d7c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d81c19640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5d7c0b1460 0x7f5d7c0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d81c19640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c0b2150 con 0x7f5d7c144d70 2023-09-13T06:01:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d81c19640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7c0b2430 con 0x7f5d7c0b1460 2023-09-13T06:01:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d81c19640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7c0cedb0 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d7bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5d7c0b1460 0x7f5d7c0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d7bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5d7c0b1460 0x7f5d7c0b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47566/0 (socket says 172.21.15.130:47566) 2023-09-13T06:01:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d7bfff640 1 -- 172.21.15.130:0/1128311018 learned_addr learned my addr 172.21.15.130:0/1128311018 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:53.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d73fff640 1 --2- 172.21.15.130:0/1128311018 >> v2:172.21.15.164:3300/0 conn(0x7f5d7c0b2e90 0x7f5d7c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d7bfff640 1 -- 172.21.15.130:0/1128311018 >> v2:172.21.15.164:3300/0 conn(0x7f5d7c0b2e90 msgr2=0x7f5d7c0ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:53.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d7bfff640 1 --2- 172.21.15.130:0/1128311018 >> v2:172.21.15.164:3300/0 conn(0x7f5d7c0b2e90 0x7f5d7c0ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d7bfff640 1 -- 172.21.15.130:0/1128311018 >> v1:172.21.15.164:6789/0 conn(0x7f5d7c144d70 legacy=0x7f5d7c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.716+0000 7f5d7bfff640 1 -- 172.21.15.130:0/1128311018 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c0cdd90 con 0x7f5d7c0b1460 2023-09-13T06:01:53.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d7bfff640 1 --2- 172.21.15.130:0/1128311018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c0b1460 0x7f5d7c0b18f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c145150 tx=0x7f5d7401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29999d42a1e12ab1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:53.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d7affd640 1 -- 172.21.15.130:0/1128311018 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d740a5780 con 0x7f5d7c0b1460 2023-09-13T06:01:53.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d7affd640 1 -- 172.21.15.130:0/1128311018 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d740a58e0 con 0x7f5d7c0b1460 2023-09-13T06:01:53.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d7affd640 1 -- 172.21.15.130:0/1128311018 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d740a5c70 con 0x7f5d7c0b1460 2023-09-13T06:01:53.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d81c19640 1 -- 172.21.15.130:0/1128311018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c0b1460 msgr2=0x7f5d7c0b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d81c19640 1 --2- 172.21.15.130:0/1128311018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c0b1460 0x7f5d7c0b18f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c145150 tx=0x7f5d7401c9d0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d81c19640 1 -- 172.21.15.130:0/1128311018 shutdown_connections 2023-09-13T06:01:53.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d81c19640 1 --2- 172.21.15.130:0/1128311018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c0b1460 0x7f5d7c0b18f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d81c19640 1 --2- 172.21.15.130:0/1128311018 >> v2:172.21.15.164:3300/0 conn(0x7f5d7c0b2e90 0x7f5d7c0ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d81c19640 1 -- 172.21.15.130:0/1128311018 >> 172.21.15.130:0/1128311018 conn(0x7f5d7c065990 msgr2=0x7f5d7c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:53.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d81c19640 1 -- 172.21.15.130:0/1128311018 shutdown_connections 2023-09-13T06:01:53.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.720+0000 7f5d81c19640 1 -- 172.21.15.130:0/1128311018 wait complete. 2023-09-13T06:01:53.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d81c19640 1 Processor -- start 2023-09-13T06:01:53.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d81c19640 1 -- start start 2023-09-13T06:01:53.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d81c19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d7c0b1460 0x7f5d7c13e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d81c19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c0b2e90 0x7f5d7c13df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d81c19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d7c144d70 0x7f5d7c157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d81c19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c13e4c0 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d81c19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c13f220 con 0x7f5d7c0b1460 2023-09-13T06:01:53.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d81c19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c13ec60 con 0x7f5d7c144d70 2023-09-13T06:01:53.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d73fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c0b2e90 0x7f5d7c13df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d73fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c0b2e90 0x7f5d7c13df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47568/0 (socket says 172.21.15.130:47568) 2023-09-13T06:01:53.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d73fff640 1 -- 172.21.15.130:0/3679973998 learned_addr learned my addr 172.21.15.130:0/3679973998 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:53.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d7b7fe640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d7c0b1460 0x7f5d7c13e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d7bfff640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d7c144d70 0x7f5d7c157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d73fff640 1 -- 172.21.15.130:0/3679973998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d7c144d70 msgr2=0x7f5d7c157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d73fff640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d7c144d70 0x7f5d7c157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d73fff640 1 -- 172.21.15.130:0/3679973998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d7c0b1460 msgr2=0x7f5d7c13e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d73fff640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d7c0b1460 0x7f5d7c13e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d73fff640 1 -- 172.21.15.130:0/3679973998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74009b30 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d7b7fe640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d7c0b1460 0x7f5d7c13e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:53.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d73fff640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c0b2e90 0x7f5d7c13df80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400e930 tx=0x7f5d6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:53.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d78ff9640 1 -- 172.21.15.130:0/3679973998 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64009690 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d78ff9640 1 -- 172.21.15.130:0/3679973998 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6400ca00 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d78ff9640 1 -- 172.21.15.130:0/3679973998 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400cd70 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d81c19640 1 -- 172.21.15.130:0/3679973998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c13ef40 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.724+0000 7f5d81c19640 1 -- 172.21.15.130:0/3679973998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c157410 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.728+0000 7f5d81c19640 1 -- 172.21.15.130:0/3679973998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c1575d0 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.728+0000 7f5d78ff9640 1 -- 172.21.15.130:0/3679973998 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5d64013470 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.728+0000 7f5d78ff9640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d5c065b20 0x7f5d5c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:53.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.728+0000 7f5d78ff9640 1 -- 172.21.15.130:0/3679973998 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d64083570 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.728+0000 7f5d7b7fe640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d5c065b20 0x7f5d5c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:53.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.728+0000 7f5d7b7fe640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d5c065b20 0x7f5d5c067fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c000f70 tx=0x7f5d6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:53.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.732+0000 7f5d78ff9640 1 -- 172.21.15.130:0/3679973998 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5d64050f80 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.880+0000 7f5d81c19640 1 -- 172.21.15.130:0/3679973998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d7c156f90 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.880+0000 7f5d78ff9640 1 -- 172.21.15.130:0/3679973998 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d7c156f90 con 0x7f5d7c0b2e90 2023-09-13T06:01:53.886 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:01:53.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 -- 172.21.15.130:0/3679973998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d5c065b20 msgr2=0x7f5d5c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d5c065b20 0x7f5d5c067fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c000f70 tx=0x7f5d6c009040 comp rx=0 tx=0).stop 2023-09-13T06:01:53.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 -- 172.21.15.130:0/3679973998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c0b2e90 msgr2=0x7f5d7c13df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:53.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c0b2e90 0x7f5d7c13df80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400e930 tx=0x7f5d6400edf0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 -- 172.21.15.130:0/3679973998 shutdown_connections 2023-09-13T06:01:53.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d5c065b20 0x7f5d5c067fe0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d7c144d70 0x7f5d7c157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c0b2e90 0x7f5d7c13df80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 --2- 172.21.15.130:0/3679973998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d7c0b1460 0x7f5d7c13e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:53.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 -- 172.21.15.130:0/3679973998 >> 172.21.15.130:0/3679973998 conn(0x7f5d7c065990 msgr2=0x7f5d7c06b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:53.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 -- 172.21.15.130:0/3679973998 shutdown_connections 2023-09-13T06:01:53.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:53.884+0000 7f5d81c19640 1 -- 172.21.15.130:0/3679973998 wait complete. 2023-09-13T06:01:53.906 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:01:54.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458ea93640 1 Processor -- start 2023-09-13T06:01:54.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458ea93640 1 -- start start 2023-09-13T06:01:54.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458ea93640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 0x7f458806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458ea93640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458806f210 con 0x7f4588152240 2023-09-13T06:01:54.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458ea93640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458806f480 con 0x7f4588070d60 2023-09-13T06:01:54.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458ea93640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458806f760 con 0x7f458815c0b0 2023-09-13T06:01:54.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458c82f640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4588152240 0x7f4588070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36036/0 (socket says 172.21.15.130:36036) 2023-09-13T06:01:54.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458c82f640 1 -- 172.21.15.130:0/3912796291 learned_addr learned my addr 172.21.15.130:0/3912796291 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:54.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458d030640 1 --2- 172.21.15.130:0/3912796291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 0x7f458806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f45877fe640 1 -- 172.21.15.130:0/3912796291 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588750155 0 0) 0x7f458806f210 con 0x7f4588152240 2023-09-13T06:01:54.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f45877fe640 1 -- 172.21.15.130:0/3912796291 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4578003530 con 0x7f4588152240 2023-09-13T06:01:54.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f45877fe640 1 -- 172.21.15.130:0/3912796291 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637612412 0 0) 0x7f458806f480 con 0x7f4588070d60 2023-09-13T06:01:54.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f45877fe640 1 -- 172.21.15.130:0/3912796291 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f458806f210 con 0x7f4588070d60 2023-09-13T06:01:54.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458d030640 1 -- 172.21.15.130:0/3912796291 >> v1:172.21.15.164:6789/0 conn(0x7f4588070d60 legacy=0x7f458815b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458d030640 1 -- 172.21.15.130:0/3912796291 >> v1:172.21.15.130:6789/0 conn(0x7f4588152240 legacy=0x7f4588070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.044+0000 7f458d030640 1 -- 172.21.15.130:0/3912796291 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458806fa40 con 0x7f458815c0b0 2023-09-13T06:01:54.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.048+0000 7f458d030640 1 --2- 172.21.15.130:0/3912796291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 0x7f458806ff60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4580009df0 tx=0x7f458001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d07249d4bcef685 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:54.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.048+0000 7f45877fe640 1 -- 172.21.15.130:0/3912796291 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45800a5940 con 0x7f458815c0b0 2023-09-13T06:01:54.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.048+0000 7f45877fe640 1 -- 172.21.15.130:0/3912796291 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45800a5aa0 con 0x7f458815c0b0 2023-09-13T06:01:54.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.048+0000 7f45877fe640 1 -- 172.21.15.130:0/3912796291 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45800a5e30 con 0x7f458815c0b0 2023-09-13T06:01:54.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.048+0000 7f458ea93640 1 -- 172.21.15.130:0/3912796291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 msgr2=0x7f458806ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.048+0000 7f458ea93640 1 --2- 172.21.15.130:0/3912796291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 0x7f458806ff60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4580009df0 tx=0x7f458001c970 comp rx=0 tx=0).stop 2023-09-13T06:01:54.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.048+0000 7f458ea93640 1 -- 172.21.15.130:0/3912796291 shutdown_connections 2023-09-13T06:01:54.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.048+0000 7f458ea93640 1 --2- 172.21.15.130:0/3912796291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 0x7f458806ff60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.048+0000 7f458ea93640 1 -- 172.21.15.130:0/3912796291 >> 172.21.15.130:0/3912796291 conn(0x7f4588065d60 msgr2=0x7f45880b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:54.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.048+0000 7f458ea93640 1 -- 172.21.15.130:0/3912796291 shutdown_connections 2023-09-13T06:01:54.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.048+0000 7f458ea93640 1 -- 172.21.15.130:0/3912796291 wait complete. 2023-09-13T06:01:54.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458ea93640 1 Processor -- start 2023-09-13T06:01:54.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458ea93640 1 -- start start 2023-09-13T06:01:54.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458ea93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4588070d60 0x7f4588152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458ea93640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4588152240 0x7f458814e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458ea93640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 0x7f4588143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458ea93640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4588144400 con 0x7f4588070d60 2023-09-13T06:01:54.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458ea93640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45881446e0 con 0x7f4588152240 2023-09-13T06:01:54.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458ea93640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45881449c0 con 0x7f458815c0b0 2023-09-13T06:01:54.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458c82f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4588070d60 0x7f4588152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458c82f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4588070d60 0x7f4588152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47580/0 (socket says 172.21.15.130:47580) 2023-09-13T06:01:54.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458c82f640 1 -- 172.21.15.130:0/2263256310 learned_addr learned my addr 172.21.15.130:0/2263256310 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:54.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f4587fff640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4588152240 0x7f458814e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458d030640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 0x7f4588143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458c82f640 1 -- 172.21.15.130:0/2263256310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 msgr2=0x7f4588143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458c82f640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 0x7f4588143840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458c82f640 1 -- 172.21.15.130:0/2263256310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4588152240 msgr2=0x7f458814e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458c82f640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4588152240 0x7f458814e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458c82f640 1 -- 172.21.15.130:0/2263256310 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4580009a70 con 0x7f4588070d60 2023-09-13T06:01:54.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458d030640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 0x7f4588143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:54.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458c82f640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4588070d60 0x7f4588152900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f457c00c4d0 tx=0x7f457c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:54.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f45857fa640 1 -- 172.21.15.130:0/2263256310 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c005cf0 con 0x7f4588070d60 2023-09-13T06:01:54.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f45857fa640 1 -- 172.21.15.130:0/2263256310 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c005e50 con 0x7f4588070d60 2023-09-13T06:01:54.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f45857fa640 1 -- 172.21.15.130:0/2263256310 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c0072b0 con 0x7f4588070d60 2023-09-13T06:01:54.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458ea93640 1 -- 172.21.15.130:0/2263256310 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4588144ca0 con 0x7f4588070d60 2023-09-13T06:01:54.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.052+0000 7f458ea93640 1 -- 172.21.15.130:0/2263256310 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4588142470 con 0x7f4588070d60 2023-09-13T06:01:54.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.056+0000 7f458ea93640 1 -- 172.21.15.130:0/2263256310 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45880618a0 con 0x7f4588070d60 2023-09-13T06:01:54.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.056+0000 7f45857fa640 1 -- 172.21.15.130:0/2263256310 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f457c007410 con 0x7f4588070d60 2023-09-13T06:01:54.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.056+0000 7f45857fa640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f456c065b20 0x7f456c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.056+0000 7f45857fa640 1 -- 172.21.15.130:0/2263256310 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f457c0829d0 con 0x7f4588070d60 2023-09-13T06:01:54.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.056+0000 7f4587fff640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f456c065b20 0x7f456c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.056+0000 7f4587fff640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f456c065b20 0x7f456c067fe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45880b0b30 tx=0x7f4574009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:54.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.060+0000 7f45857fa640 1 -- 172.21.15.130:0/2263256310 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f457c050280 con 0x7f4588070d60 2023-09-13T06:01:54.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.204+0000 7f458ea93640 1 -- 172.21.15.130:0/2263256310 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4588145150 con 0x7f4588070d60 2023-09-13T06:01:54.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.204+0000 7f45857fa640 1 -- 172.21.15.130:0/2263256310 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f457c0170a0 con 0x7f4588070d60 2023-09-13T06:01:54.210 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:01:54.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 -- 172.21.15.130:0/2263256310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f456c065b20 msgr2=0x7f456c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f456c065b20 0x7f456c067fe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45880b0b30 tx=0x7f4574009040 comp rx=0 tx=0).stop 2023-09-13T06:01:54.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 -- 172.21.15.130:0/2263256310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4588070d60 msgr2=0x7f4588152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4588070d60 0x7f4588152900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f457c00c4d0 tx=0x7f457c00c990 comp rx=0 tx=0).stop 2023-09-13T06:01:54.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 -- 172.21.15.130:0/2263256310 shutdown_connections 2023-09-13T06:01:54.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f456c065b20 0x7f456c067fe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4588152240 0x7f458814e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f458815c0b0 0x7f4588143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 --2- 172.21.15.130:0/2263256310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4588070d60 0x7f4588152900 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 -- 172.21.15.130:0/2263256310 >> 172.21.15.130:0/2263256310 conn(0x7f4588065d60 msgr2=0x7f458806d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:54.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 -- 172.21.15.130:0/2263256310 shutdown_connections 2023-09-13T06:01:54.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.208+0000 7f458ea93640 1 -- 172.21.15.130:0/2263256310 wait complete. 2023-09-13T06:01:54.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:01:54.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d2769c640 1 Processor -- start 2023-09-13T06:01:54.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d2769c640 1 -- start start 2023-09-13T06:01:54.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d2769c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d20154760 0x7f2d200b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d2769c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2d20161140 0x7f2d2015e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d2769c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d200b2690 con 0x7f2d20154380 2023-09-13T06:01:54.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d2769c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d20070d80 con 0x7f2d20161140 2023-09-13T06:01:54.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d2769c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d20161700 con 0x7f2d20154760 2023-09-13T06:01:54.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d25438640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2d20154380 0x7f2d20070670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36050/0 (socket says 172.21.15.130:36050) 2023-09-13T06:01:54.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d25438640 1 -- 172.21.15.130:0/4250301903 learned_addr learned my addr 172.21.15.130:0/4250301903 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:54.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d24c37640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d20154760 0x7f2d200b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d25c39640 1 --2- 172.21.15.130:0/4250301903 >> v2:172.21.15.164:3300/0 conn(0x7f2d20161140 0x7f2d2015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730054453 0 0) 0x7f2d200b2690 con 0x7f2d20154380 2023-09-13T06:01:54.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d0c003530 con 0x7f2d20154380 2023-09-13T06:01:54.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3287989637 0 0) 0x7f2d0c003530 con 0x7f2d20154380 2023-09-13T06:01:54.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d20154760 msgr2=0x7f2d200b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:54.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d20154760 0x7f2d200b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 >> v2:172.21.15.164:3300/0 conn(0x7f2d20161140 msgr2=0x7f2d2015e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:54.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 --2- 172.21.15.130:0/4250301903 >> v2:172.21.15.164:3300/0 conn(0x7f2d20161140 0x7f2d2015e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d201619e0 con 0x7f2d20154380 2023-09-13T06:01:54.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f2d1c001680 con 0x7f2d20154380 2023-09-13T06:01:54.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 >> v1:172.21.15.130:6789/0 conn(0x7f2d20154380 legacy=0x7f2d20070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0c0039f0 0x7f2d0c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0c0047d0 0x7f2d0c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d0c005190 0x7f2d0c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d20070d80 con 0x7f2d0c005190 2023-09-13T06:01:54.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d20161700 con 0x7f2d0c0047d0 2023-09-13T06:01:54.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c00bfd0 con 0x7f2d0c0039f0 2023-09-13T06:01:54.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d24c37640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d20154760 0x7f2d200b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:54.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d25c39640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d0c005190 0x7f2d0c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d25438640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0c0039f0 0x7f2d0c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d24c37640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0c0047d0 0x7f2d0c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d25c39640 1 -- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0c0039f0 msgr2=0x7f2d0c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:54.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d25c39640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0c0039f0 0x7f2d0c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d25c39640 1 -- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0c0047d0 msgr2=0x7f2d0c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:54.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d25c39640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0c0047d0 0x7f2d0c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d25c39640 1 -- 172.21.15.130:0/4250301903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c003530 con 0x7f2d0c005190 2023-09-13T06:01:54.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.368+0000 7f2d24c37640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d0c0047d0 0x7f2d0c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:54.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.372+0000 7f2d25c39640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d0c005190 0x7f2d0c00b990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800e170 tx=0x7f2d1801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff93c815801eaf02 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:54.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.372+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d180a5c60 con 0x7f2d0c005190 2023-09-13T06:01:54.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.372+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1800f040 con 0x7f2d0c005190 2023-09-13T06:01:54.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.372+0000 7f2d17fff640 1 -- 172.21.15.130:0/4250301903 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d180ad440 con 0x7f2d0c005190 2023-09-13T06:01:54.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.372+0000 7f2d2769c640 1 -- 172.21.15.130:0/4250301903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d0c005190 msgr2=0x7f2d0c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.372+0000 7f2d2769c640 1 --2- 172.21.15.130:0/4250301903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d0c005190 0x7f2d0c00b990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800e170 tx=0x7f2d1801cc50 comp rx=0 tx=0).stop 2023-09-13T06:01:54.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.372+0000 7f2d25c39640 1 -- 172.21.15.130:0/4250301903 reap_dead start 2023-09-13T06:01:54.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.372+0000 7f2d2769c640 1 -- 172.21.15.130:0/4250301903 shutdown_connections 2023-09-13T06:01:54.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.372+0000 7f2d2769c640 1 -- 172.21.15.130:0/4250301903 >> 172.21.15.130:0/4250301903 conn(0x7f2d20065990 msgr2=0x7f2d20065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:54.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.372+0000 7f2d2769c640 1 -- 172.21.15.130:0/4250301903 shutdown_connections 2023-09-13T06:01:54.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.372+0000 7f2d2769c640 1 -- 172.21.15.130:0/4250301903 wait complete. 2023-09-13T06:01:54.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d2769c640 1 Processor -- start 2023-09-13T06:01:54.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d2769c640 1 -- start start 2023-09-13T06:01:54.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d2769c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0c005190 0x7f2d20150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d2769c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d20156f70 0x7f2d20149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d2769c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d201573d0 0x7f2d201f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d2769c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d20152bc0 con 0x7f2d20156f70 2023-09-13T06:01:54.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d2769c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d20152ea0 con 0x7f2d201573d0 2023-09-13T06:01:54.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d2769c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d20156770 con 0x7f2d0c005190 2023-09-13T06:01:54.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d24c37640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d20156f70 0x7f2d20149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d24c37640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d20156f70 0x7f2d20149a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47600/0 (socket says 172.21.15.130:47600) 2023-09-13T06:01:54.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d24c37640 1 -- 172.21.15.130:0/1616610031 learned_addr learned my addr 172.21.15.130:0/1616610031 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:54.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d25438640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0c005190 0x7f2d20150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d24c37640 1 -- 172.21.15.130:0/1616610031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0c005190 msgr2=0x7f2d20150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d25c39640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d201573d0 0x7f2d201f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d24c37640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0c005190 0x7f2d20150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d24c37640 1 -- 172.21.15.130:0/1616610031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d201573d0 msgr2=0x7f2d201f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d24c37640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d201573d0 0x7f2d201f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d24c37640 1 -- 172.21.15.130:0/1616610031 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d20156a50 con 0x7f2d20156f70 2023-09-13T06:01:54.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d25438640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0c005190 0x7f2d20150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:54.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d25c39640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d201573d0 0x7f2d201f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:54.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d24c37640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d20156f70 0x7f2d20149a60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2d10011880 tx=0x7f2d10011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:54.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d15ffb640 1 -- 172.21.15.130:0/1616610031 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1000fbd0 con 0x7f2d20156f70 2023-09-13T06:01:54.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d15ffb640 1 -- 172.21.15.130:0/1616610031 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1000fd30 con 0x7f2d20156f70 2023-09-13T06:01:54.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d15ffb640 1 -- 172.21.15.130:0/1616610031 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10015660 con 0x7f2d20156f70 2023-09-13T06:01:54.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d2769c640 1 -- 172.21.15.130:0/1616610031 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d20153180 con 0x7f2d20156f70 2023-09-13T06:01:54.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.376+0000 7f2d2769c640 1 -- 172.21.15.130:0/1616610031 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d201f2af0 con 0x7f2d20156f70 2023-09-13T06:01:54.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.380+0000 7f2d2769c640 1 -- 172.21.15.130:0/1616610031 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d200618a0 con 0x7f2d20156f70 2023-09-13T06:01:54.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.380+0000 7f2d15ffb640 1 -- 172.21.15.130:0/1616610031 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2d100157c0 con 0x7f2d20156f70 2023-09-13T06:01:54.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.380+0000 7f2d15ffb640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d04065b20 0x7f2d04067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.380+0000 7f2d15ffb640 1 -- 172.21.15.130:0/1616610031 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d10083e50 con 0x7f2d20156f70 2023-09-13T06:01:54.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.380+0000 7f2d25438640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d04065b20 0x7f2d04067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.380+0000 7f2d25438640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d04065b20 0x7f2d04067fe0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c001060 tx=0x7f2d1c001550 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:54.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.384+0000 7f2d15ffb640 1 -- 172.21.15.130:0/1616610031 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2d10051670 con 0x7f2d20156f70 2023-09-13T06:01:54.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.532+0000 7f2d2769c640 1 -- 172.21.15.130:0/1616610031 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d20156be0 con 0x7f2d20156f70 2023-09-13T06:01:54.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.532+0000 7f2d15ffb640 1 -- 172.21.15.130:0/1616610031 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d10022020 con 0x7f2d20156f70 2023-09-13T06:01:54.538 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:01:54.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 -- 172.21.15.130:0/1616610031 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d04065b20 msgr2=0x7f2d04067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d04065b20 0x7f2d04067fe0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c001060 tx=0x7f2d1c001550 comp rx=0 tx=0).stop 2023-09-13T06:01:54.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 -- 172.21.15.130:0/1616610031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d20156f70 msgr2=0x7f2d20149a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d20156f70 0x7f2d20149a60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2d10011880 tx=0x7f2d10011d40 comp rx=0 tx=0).stop 2023-09-13T06:01:54.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 -- 172.21.15.130:0/1616610031 shutdown_connections 2023-09-13T06:01:54.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d04065b20 0x7f2d04067fe0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d201573d0 0x7f2d201f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d20156f70 0x7f2d20149a60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 --2- 172.21.15.130:0/1616610031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d0c005190 0x7f2d20150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 -- 172.21.15.130:0/1616610031 >> 172.21.15.130:0/1616610031 conn(0x7f2d20065990 msgr2=0x7f2d2015ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:54.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 -- 172.21.15.130:0/1616610031 shutdown_connections 2023-09-13T06:01:54.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.536+0000 7f2d2769c640 1 -- 172.21.15.130:0/1616610031 wait complete. 2023-09-13T06:01:54.558 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-09-13T06:01:54.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.692+0000 7f233f910640 1 Processor -- start 2023-09-13T06:01:54.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.692+0000 7f233f910640 1 -- start start 2023-09-13T06:01:54.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f233f910640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f233815b130 0x7f23380cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f233f910640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23380ce980 con 0x7f23380ce180 2023-09-13T06:01:54.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f233f910640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23380cec60 con 0x7f23380b04a0 2023-09-13T06:01:54.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f233f910640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233806c640 con 0x7f233815b130 2023-09-13T06:01:54.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f233d6ac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f233815b130 0x7f23380cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f233ceab640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f23380ce180 0x7f233815b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36056/0 (socket says 172.21.15.130:36056) 2023-09-13T06:01:54.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f233ceab640 1 -- 172.21.15.130:0/1484257496 learned_addr learned my addr 172.21.15.130:0/1484257496 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:54.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f233d6ac640 1 -- 172.21.15.130:0/1484257496 >> v1:172.21.15.164:6789/0 conn(0x7f23380b04a0 legacy=0x7f233806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:54.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f233d6ac640 1 -- 172.21.15.130:0/1484257496 >> v1:172.21.15.130:6789/0 conn(0x7f23380ce180 legacy=0x7f233815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f233d6ac640 1 -- 172.21.15.130:0/1484257496 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233806c920 con 0x7f233815b130 2023-09-13T06:01:54.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f232ffff640 1 -- 172.21.15.130:0/1484257496 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503646003 0 0) 0x7f23380ce980 con 0x7f23380ce180 2023-09-13T06:01:54.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f233d6ac640 1 --2- 172.21.15.130:0/1484257496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f233815b130 0x7f23380cc780 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23340097c0 tx=0x7f233401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dd0e7c1c505c57 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:54.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f232ffff640 1 -- 172.21.15.130:0/1484257496 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340a7070 con 0x7f233815b130 2023-09-13T06:01:54.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.696+0000 7f232ffff640 1 -- 172.21.15.130:0/1484257496 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23340ab430 con 0x7f233815b130 2023-09-13T06:01:54.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f232ffff640 1 -- 172.21.15.130:0/1484257496 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340ab7c0 con 0x7f233815b130 2023-09-13T06:01:54.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 -- 172.21.15.130:0/1484257496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f233815b130 msgr2=0x7f23380cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 --2- 172.21.15.130:0/1484257496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f233815b130 0x7f23380cc780 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23340097c0 tx=0x7f233401c440 comp rx=0 tx=0).stop 2023-09-13T06:01:54.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 -- 172.21.15.130:0/1484257496 shutdown_connections 2023-09-13T06:01:54.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 --2- 172.21.15.130:0/1484257496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f233815b130 0x7f23380cc780 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 -- 172.21.15.130:0/1484257496 >> 172.21.15.130:0/1484257496 conn(0x7f2338065990 msgr2=0x7f2338065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:54.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 -- 172.21.15.130:0/1484257496 shutdown_connections 2023-09-13T06:01:54.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 -- 172.21.15.130:0/1484257496 wait complete. 2023-09-13T06:01:54.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 Processor -- start 2023-09-13T06:01:54.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 -- start start 2023-09-13T06:01:54.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23380b04a0 0x7f23381585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23380ce180 0x7f2338146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f233815b130 0x7f2338163050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2338147430 con 0x7f23380b04a0 2023-09-13T06:01:54.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233815f350 con 0x7f23380ce180 2023-09-13T06:01:54.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233f910640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233815f630 con 0x7f233815b130 2023-09-13T06:01:54.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233d6ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23380b04a0 0x7f23381585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233d6ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23380b04a0 0x7f23381585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47622/0 (socket says 172.21.15.130:47622) 2023-09-13T06:01:54.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.700+0000 7f233d6ac640 1 -- 172.21.15.130:0/4095248593 learned_addr learned my addr 172.21.15.130:0/4095248593 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:54.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233ceab640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23380ce180 0x7f2338146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233dead640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f233815b130 0x7f2338163050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233d6ac640 1 -- 172.21.15.130:0/4095248593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f233815b130 msgr2=0x7f2338163050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233d6ac640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f233815b130 0x7f2338163050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233d6ac640 1 -- 172.21.15.130:0/4095248593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23380ce180 msgr2=0x7f2338146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:54.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233d6ac640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23380ce180 0x7f2338146ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:54.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233d6ac640 1 -- 172.21.15.130:0/4095248593 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334009420 con 0x7f23380b04a0 2023-09-13T06:01:54.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233dead640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f233815b130 0x7f2338163050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:54.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233ceab640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23380ce180 0x7f2338146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:54.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233d6ac640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23380b04a0 0x7f23381585a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f23340ad040 tx=0x7f233401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:54.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f232dffb640 1 -- 172.21.15.130:0/4095248593 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340b5810 con 0x7f23380b04a0 2023-09-13T06:01:54.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f232dffb640 1 -- 172.21.15.130:0/4095248593 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23340b59b0 con 0x7f23380b04a0 2023-09-13T06:01:54.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f232dffb640 1 -- 172.21.15.130:0/4095248593 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340b5d60 con 0x7f23380b04a0 2023-09-13T06:01:54.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233f910640 1 -- 172.21.15.130:0/4095248593 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233815f910 con 0x7f23380b04a0 2023-09-13T06:01:54.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233f910640 1 -- 172.21.15.130:0/4095248593 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233815eec0 con 0x7f23380b04a0 2023-09-13T06:01:54.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f233f910640 1 -- 172.21.15.130:0/4095248593 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23380618a0 con 0x7f23380b04a0 2023-09-13T06:01:54.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.704+0000 7f232dffb640 1 -- 172.21.15.130:0/4095248593 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f23340b4390 con 0x7f23380b04a0 2023-09-13T06:01:54.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.708+0000 7f232dffb640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f231c065b20 0x7f231c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:54.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.708+0000 7f232dffb640 1 -- 172.21.15.130:0/4095248593 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f233411dab0 con 0x7f23380b04a0 2023-09-13T06:01:54.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.708+0000 7f233ceab640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f231c065b20 0x7f231c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:54.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.708+0000 7f233ceab640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f231c065b20 0x7f231c067fe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2338159540 tx=0x7f2328009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:54.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.712+0000 7f232dffb640 1 -- 172.21.15.130:0/4095248593 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f23340eb4a0 con 0x7f23380b04a0 2023-09-13T06:01:54.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:54.908+0000 7f233f910640 1 -- 172.21.15.130:0/4095248593 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f233815fdc0 con 0x7f23380b04a0 2023-09-13T06:01:55.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f232dffb640 1 -- 172.21.15.130:0/4095248593 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f23340eeac0 con 0x7f23380b04a0 2023-09-13T06:01:55.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 -- 172.21.15.130:0/4095248593 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f231c065b20 msgr2=0x7f231c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:55.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f231c065b20 0x7f231c067fe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2338159540 tx=0x7f2328009040 comp rx=0 tx=0).stop 2023-09-13T06:01:55.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 -- 172.21.15.130:0/4095248593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23380b04a0 msgr2=0x7f23381585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:55.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23380b04a0 0x7f23381585a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f23340ad040 tx=0x7f233401ac80 comp rx=0 tx=0).stop 2023-09-13T06:01:55.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 -- 172.21.15.130:0/4095248593 shutdown_connections 2023-09-13T06:01:55.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f231c065b20 0x7f231c067fe0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:55.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23380ce180 0x7f2338146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:55.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f233815b130 0x7f2338163050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:55.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 --2- 172.21.15.130:0/4095248593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23380b04a0 0x7f23381585a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:55.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 -- 172.21.15.130:0/4095248593 >> 172.21.15.130:0/4095248593 conn(0x7f2338065990 msgr2=0x7f233815b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:55.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 -- 172.21.15.130:0/4095248593 shutdown_connections 2023-09-13T06:01:55.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.656+0000 7f233f910640 1 -- 172.21.15.130:0/4095248593 wait complete. 2023-09-13T06:01:55.684 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-09-13T06:01:55.842 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_objectstore":"memstore"} 2023-09-13T06:01:55.843 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-09-13T06:01:55.844 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-13T06:01:55.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.980+0000 7fcf9b448640 1 Processor -- start 2023-09-13T06:01:55.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.980+0000 7fcf9b448640 1 -- start start 2023-09-13T06:01:55.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.980+0000 7fcf9b448640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf94070680 0x7fcf94142d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:55.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.980+0000 7fcf9b448640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcf9406d7d0 0x7fcf94143280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:55.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.980+0000 7fcf9b448640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9415d4c0 con 0x7fcf940cc1f0 2023-09-13T06:01:55.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.980+0000 7fcf9b448640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9406cd10 con 0x7fcf9406d7d0 2023-09-13T06:01:55.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.980+0000 7fcf9b448640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9415d710 con 0x7fcf94070680 2023-09-13T06:01:55.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf999e5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fcf940cc1f0 0x7fcf9406f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36062/0 (socket says 172.21.15.130:36062) 2023-09-13T06:01:55.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf999e5640 1 -- 172.21.15.130:0/776075232 learned_addr learned my addr 172.21.15.130:0/776075232 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:55.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf991e4640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf94070680 0x7fcf94142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:55.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728836977 0 0) 0x7fcf9415d4c0 con 0x7fcf940cc1f0 2023-09-13T06:01:55.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf989e3640 1 --2- 172.21.15.130:0/776075232 >> v2:172.21.15.164:3300/0 conn(0x7fcf9406d7d0 0x7fcf94143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:55.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf80003450 con 0x7fcf940cc1f0 2023-09-13T06:01:55.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 571003962 0 0) 0x7fcf80003450 con 0x7fcf940cc1f0 2023-09-13T06:01:55.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf94070680 msgr2=0x7fcf94142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:55.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf94070680 0x7fcf94142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:55.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 >> v2:172.21.15.164:3300/0 conn(0x7fcf9406d7d0 msgr2=0x7fcf94143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:55.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 --2- 172.21.15.130:0/776075232 >> v2:172.21.15.164:3300/0 conn(0x7fcf9406d7d0 0x7fcf94143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9415d9f0 con 0x7fcf940cc1f0 2023-09-13T06:01:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fcf8c001a00 con 0x7fcf940cc1f0 2023-09-13T06:01:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 >> v1:172.21.15.130:6789/0 conn(0x7fcf940cc1f0 legacy=0x7fcf9406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf80003ae0 0x7fcf80003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf94070680 0x7fcf8000a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:55.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8000aeb0 0x7fcf8000d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:55.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9406cd10 con 0x7fcf8000aeb0 2023-09-13T06:01:55.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9415d710 con 0x7fcf80003ae0 2023-09-13T06:01:55.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8000dba0 con 0x7fcf94070680 2023-09-13T06:01:55.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf999e5640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8000aeb0 0x7fcf8000d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:55.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf991e4640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf80003ae0 0x7fcf80003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:55.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf989e3640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf94070680 0x7fcf8000a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:55.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf999e5640 1 -- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf94070680 msgr2=0x7fcf8000a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:55.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf999e5640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf94070680 0x7fcf8000a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:55.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf999e5640 1 -- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf80003ae0 msgr2=0x7fcf80003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:55.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf999e5640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf80003ae0 0x7fcf80003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:55.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf999e5640 1 -- 172.21.15.130:0/776075232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80003450 con 0x7fcf8000aeb0 2023-09-13T06:01:55.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.984+0000 7fcf989e3640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf94070680 0x7fcf8000a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:55.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf999e5640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8000aeb0 0x7fcf8000d340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00a790 tx=0x7fcf8c01d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a6ef7cb0d147a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:55.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0ad630 con 0x7fcf8000aeb0 2023-09-13T06:01:55.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c0a8070 con 0x7fcf8000aeb0 2023-09-13T06:01:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf8bfff640 1 -- 172.21.15.130:0/776075232 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0ad9f0 con 0x7fcf8000aeb0 2023-09-13T06:01:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf9b448640 1 -- 172.21.15.130:0/776075232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8000aeb0 msgr2=0x7fcf8000d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf9b448640 1 --2- 172.21.15.130:0/776075232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8000aeb0 0x7fcf8000d340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00a790 tx=0x7fcf8c01d2a0 comp rx=0 tx=0).stop 2023-09-13T06:01:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf999e5640 1 -- 172.21.15.130:0/776075232 reap_dead start 2023-09-13T06:01:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf9b448640 1 -- 172.21.15.130:0/776075232 shutdown_connections 2023-09-13T06:01:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf9b448640 1 -- 172.21.15.130:0/776075232 >> 172.21.15.130:0/776075232 conn(0x7fcf94065d60 msgr2=0x7fcf940b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf9b448640 1 -- 172.21.15.130:0/776075232 shutdown_connections 2023-09-13T06:01:56.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf9b448640 1 -- 172.21.15.130:0/776075232 wait complete. 2023-09-13T06:01:56.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf9b448640 1 Processor -- start 2023-09-13T06:01:56.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.988+0000 7fcf9b448640 1 -- start start 2023-09-13T06:01:56.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf9b448640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf8000aeb0 0x7fcf9414f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf9b448640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf94158fb0 0x7fcf94156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf9b448640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf94151860 0x7fcf94151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf9b448640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf94152530 con 0x7fcf94151860 2023-09-13T06:01:56.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf9b448640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9414f5e0 con 0x7fcf94158fb0 2023-09-13T06:01:56.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf9b448640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940b0820 con 0x7fcf8000aeb0 2023-09-13T06:01:56.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf999e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf94151860 0x7fcf94151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf999e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf94151860 0x7fcf94151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47634/0 (socket says 172.21.15.130:47634) 2023-09-13T06:01:56.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf999e5640 1 -- 172.21.15.130:0/3818970240 learned_addr learned my addr 172.21.15.130:0/3818970240 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:56.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf991e4640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf8000aeb0 0x7fcf9414f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf989e3640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf94158fb0 0x7fcf94156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf999e5640 1 -- 172.21.15.130:0/3818970240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf8000aeb0 msgr2=0x7fcf9414f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf999e5640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf8000aeb0 0x7fcf9414f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf999e5640 1 -- 172.21.15.130:0/3818970240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf94158fb0 msgr2=0x7fcf94156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf999e5640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf94158fb0 0x7fcf94156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf999e5640 1 -- 172.21.15.130:0/3818970240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf94157170 con 0x7fcf94151860 2023-09-13T06:01:56.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf999e5640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf94151860 0x7fcf94151cc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c01cd10 tx=0x7fcf80003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:56.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf89ffb640 1 -- 172.21.15.130:0/3818970240 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0017c0 con 0x7fcf94151860 2023-09-13T06:01:56.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf89ffb640 1 -- 172.21.15.130:0/3818970240 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c001920 con 0x7fcf94151860 2023-09-13T06:01:56.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf89ffb640 1 -- 172.21.15.130:0/3818970240 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c004d70 con 0x7fcf94151860 2023-09-13T06:01:56.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf9b448640 1 -- 172.21.15.130:0/3818970240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf94152200 con 0x7fcf94151860 2023-09-13T06:01:56.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf9b448640 1 -- 172.21.15.130:0/3818970240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf941576d0 con 0x7fcf94151860 2023-09-13T06:01:56.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf9b448640 1 -- 172.21.15.130:0/3818970240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf940618a0 con 0x7fcf94151860 2023-09-13T06:01:56.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.992+0000 7fcf89ffb640 1 -- 172.21.15.130:0/3818970240 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcf8c0aa030 con 0x7fcf94151860 2023-09-13T06:01:56.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.996+0000 7fcf89ffb640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf78065b20 0x7fcf78067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.996+0000 7fcf89ffb640 1 -- 172.21.15.130:0/3818970240 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf8c11cf10 con 0x7fcf94151860 2023-09-13T06:01:56.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.996+0000 7fcf991e4640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf78065b20 0x7fcf78067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:55.996+0000 7fcf991e4640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf78065b20 0x7fcf78067fe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009b60 tx=0x7fcf90009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.000+0000 7fcf89ffb640 1 -- 172.21.15.130:0/3818970240 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcf8c0ea9a0 con 0x7fcf94151860 2023-09-13T06:01:56.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.144+0000 7fcf9b448640 1 -- 172.21.15.130:0/3818970240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcf940b2ec0 con 0x7fcf94151860 2023-09-13T06:01:56.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf89ffb640 1 -- 172.21.15.130:0/3818970240 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcf8c0bc0c0 con 0x7fcf94151860 2023-09-13T06:01:56.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 -- 172.21.15.130:0/3818970240 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf78065b20 msgr2=0x7fcf78067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf78065b20 0x7fcf78067fe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009b60 tx=0x7fcf90009190 comp rx=0 tx=0).stop 2023-09-13T06:01:56.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 -- 172.21.15.130:0/3818970240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf94151860 msgr2=0x7fcf94151cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf94151860 0x7fcf94151cc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c01cd10 tx=0x7fcf80003700 comp rx=0 tx=0).stop 2023-09-13T06:01:56.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 -- 172.21.15.130:0/3818970240 shutdown_connections 2023-09-13T06:01:56.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcf78065b20 0x7fcf78067fe0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf94158fb0 0x7fcf94156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf94151860 0x7fcf94151cc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 --2- 172.21.15.130:0/3818970240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf8000aeb0 0x7fcf9414f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 -- 172.21.15.130:0/3818970240 >> 172.21.15.130:0/3818970240 conn(0x7fcf94065d60 msgr2=0x7fcf940ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 -- 172.21.15.130:0/3818970240 shutdown_connections 2023-09-13T06:01:56.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.152+0000 7fcf9b448640 1 -- 172.21.15.130:0/3818970240 wait complete. 2023-09-13T06:01:56.176 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:01:56.176 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:01:56.225 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:01:56.286 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:01:56.287 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:01:56.287 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:01:56.296 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:01:56.297 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:01:56.346 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:01:56.347 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:01:56.398 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:56.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.576+0000 7fab12448640 1 Processor -- start 2023-09-13T06:01:56.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.576+0000 7fab12448640 1 -- start start 2023-09-13T06:01:56.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab12448640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fab0c15b130 0x7fab0c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab12448640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0c0ce980 con 0x7fab0c0ce180 2023-09-13T06:01:56.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab12448640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0c0cec60 con 0x7fab0c0b04a0 2023-09-13T06:01:56.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab12448640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0c06c640 con 0x7fab0c15b130 2023-09-13T06:01:56.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab0bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fab0c15b130 0x7fab0c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab0bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fab0c15b130 0x7fab0c0cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47640/0 (socket says 172.21.15.130:47640) 2023-09-13T06:01:56.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab0bfff640 1 -- 172.21.15.130:0/3456655717 learned_addr learned my addr 172.21.15.130:0/3456655717 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:56.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab0bfff640 1 -- 172.21.15.130:0/3456655717 >> v1:172.21.15.164:6789/0 conn(0x7fab0c0b04a0 legacy=0x7fab0c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:56.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab0bfff640 1 -- 172.21.15.130:0/3456655717 >> v1:172.21.15.130:6789/0 conn(0x7fab0c0ce180 legacy=0x7fab0c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab0bfff640 1 -- 172.21.15.130:0/3456655717 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c06c920 con 0x7fab0c15b130 2023-09-13T06:01:56.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab0bfff640 1 --2- 172.21.15.130:0/3456655717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab0c15b130 0x7fab0c0cc780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faafc009870 tx=0x7faafc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bf37bb64cb73fe server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:56.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab0affd640 1 -- 172.21.15.130:0/3456655717 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0aa650 con 0x7fab0c15b130 2023-09-13T06:01:56.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.580+0000 7fab0affd640 1 -- 172.21.15.130:0/3456655717 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc0aa7b0 con 0x7fab0c15b130 2023-09-13T06:01:56.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab0affd640 1 -- 172.21.15.130:0/3456655717 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0aab40 con 0x7fab0c15b130 2023-09-13T06:01:56.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 -- 172.21.15.130:0/3456655717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab0c15b130 msgr2=0x7fab0c0cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 --2- 172.21.15.130:0/3456655717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab0c15b130 0x7fab0c0cc780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faafc009870 tx=0x7faafc01c500 comp rx=0 tx=0).stop 2023-09-13T06:01:56.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 -- 172.21.15.130:0/3456655717 shutdown_connections 2023-09-13T06:01:56.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 --2- 172.21.15.130:0/3456655717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab0c15b130 0x7fab0c0cc780 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 -- 172.21.15.130:0/3456655717 >> 172.21.15.130:0/3456655717 conn(0x7fab0c065990 msgr2=0x7fab0c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:56.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 -- 172.21.15.130:0/3456655717 shutdown_connections 2023-09-13T06:01:56.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 -- 172.21.15.130:0/3456655717 wait complete. 2023-09-13T06:01:56.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 Processor -- start 2023-09-13T06:01:56.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 -- start start 2023-09-13T06:01:56.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab0c0b04a0 0x7fab0c157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab0c0ce180 0x7fab0c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab0c15b130 0x7fab0c1518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c15c0c0 con 0x7fab0c0b04a0 2023-09-13T06:01:56.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c15cc40 con 0x7fab0c15b130 2023-09-13T06:01:56.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab12448640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c15c310 con 0x7fab0c0ce180 2023-09-13T06:01:56.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab0c0b04a0 0x7fab0c157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab0c0b04a0 0x7fab0c157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47650/0 (socket says 172.21.15.130:47650) 2023-09-13T06:01:56.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.584+0000 7fab0bfff640 1 -- 172.21.15.130:0/3160776695 learned_addr learned my addr 172.21.15.130:0/3160776695 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:56.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab0bfff640 1 -- 172.21.15.130:0/3160776695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab0c0ce180 msgr2=0x7fab0c155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab0bfff640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab0c0ce180 0x7fab0c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab0bfff640 1 -- 172.21.15.130:0/3160776695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab0c15b130 msgr2=0x7fab0c1518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab0bfff640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab0c15b130 0x7fab0c1518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab0bfff640 1 -- 172.21.15.130:0/3160776695 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc0094d0 con 0x7fab0c0b04a0 2023-09-13T06:01:56.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab0bfff640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab0c0b04a0 0x7fab0c157710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faafc019110 tx=0x7faafc01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:56.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab08ff9640 1 -- 172.21.15.130:0/3160776695 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0b38c0 con 0x7fab0c0b04a0 2023-09-13T06:01:56.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab08ff9640 1 -- 172.21.15.130:0/3160776695 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc0b3a20 con 0x7fab0c0b04a0 2023-09-13T06:01:56.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab08ff9640 1 -- 172.21.15.130:0/3160776695 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0b3dd0 con 0x7fab0c0b04a0 2023-09-13T06:01:56.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab12448640 1 -- 172.21.15.130:0/3160776695 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0c15c5f0 con 0x7fab0c0b04a0 2023-09-13T06:01:56.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab12448640 1 -- 172.21.15.130:0/3160776695 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0c157c50 con 0x7fab0c0b04a0 2023-09-13T06:01:56.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab12448640 1 -- 172.21.15.130:0/3160776695 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0c0618a0 con 0x7fab0c0b04a0 2023-09-13T06:01:56.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab08ff9640 1 -- 172.21.15.130:0/3160776695 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7faafc0b2380 con 0x7fab0c0b04a0 2023-09-13T06:01:56.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab08ff9640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaf8065b20 0x7faaf8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.588+0000 7fab08ff9640 1 -- 172.21.15.130:0/3160776695 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faafc11da10 con 0x7fab0c0b04a0 2023-09-13T06:01:56.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.592+0000 7fab0b7fe640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaf8065b20 0x7faaf8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.592+0000 7fab0b7fe640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaf8065b20 0x7faaf8067fe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fab00000f70 tx=0x7fab000079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:56.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.592+0000 7fab08ff9640 1 -- 172.21.15.130:0/3160776695 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7faafc0eb540 con 0x7fab0c0b04a0 2023-09-13T06:01:56.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.744+0000 7fab12448640 1 -- 172.21.15.130:0/3160776695 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab0c150de0 con 0x7fab0c0b04a0 2023-09-13T06:01:56.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.744+0000 7fab08ff9640 1 -- 172.21.15.130:0/3160776695 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7faafc0eeb60 con 0x7fab0c0b04a0 2023-09-13T06:01:56.749 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:56.749 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:56.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 -- 172.21.15.130:0/3160776695 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaf8065b20 msgr2=0x7faaf8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaf8065b20 0x7faaf8067fe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fab00000f70 tx=0x7fab000079c0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 -- 172.21.15.130:0/3160776695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab0c0b04a0 msgr2=0x7fab0c157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab0c0b04a0 0x7fab0c157710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faafc019110 tx=0x7faafc01ad40 comp rx=0 tx=0).stop 2023-09-13T06:01:56.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 -- 172.21.15.130:0/3160776695 shutdown_connections 2023-09-13T06:01:56.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faaf8065b20 0x7faaf8067fe0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab0c15b130 0x7fab0c1518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab0c0ce180 0x7fab0c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 --2- 172.21.15.130:0/3160776695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab0c0b04a0 0x7fab0c157710 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 -- 172.21.15.130:0/3160776695 >> 172.21.15.130:0/3160776695 conn(0x7fab0c065990 msgr2=0x7fab0c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:56.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 -- 172.21.15.130:0/3160776695 shutdown_connections 2023-09-13T06:01:56.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.748+0000 7fab12448640 1 -- 172.21.15.130:0/3160776695 wait complete. 2023-09-13T06:01:56.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:01:56.771 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:01:56.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b6c759640 1 Processor -- start 2023-09-13T06:01:56.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b6c759640 1 -- start start 2023-09-13T06:01:56.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b6c759640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b640d2cd0 0x7f3b641612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b6c759640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3b641617e0 0x7f3b640cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b6c759640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6415dd40 con 0x7f3b6415ae10 2023-09-13T06:01:56.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b6c759640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6415e020 con 0x7f3b641617e0 2023-09-13T06:01:56.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b6c759640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6415e300 con 0x7f3b640d2cd0 2023-09-13T06:01:56.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b6a4f5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3b6415ae10 0x7f3b640d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36088/0 (socket says 172.21.15.130:36088) 2023-09-13T06:01:56.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b6a4f5640 1 -- 172.21.15.130:0/3749607768 learned_addr learned my addr 172.21.15.130:0/3749607768 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:56.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b69cf4640 1 --2- 172.21.15.130:0/3749607768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b640d2cd0 0x7f3b641612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b6acf6640 1 --2- 172.21.15.130:0/3749607768 >> v2:172.21.15.164:3300/0 conn(0x7f3b641617e0 0x7f3b640cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b694f3640 1 -- 172.21.15.130:0/3749607768 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007252422 0 0) 0x7f3b6415dd40 con 0x7f3b6415ae10 2023-09-13T06:01:56.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.908+0000 7f3b694f3640 1 -- 172.21.15.130:0/3749607768 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b50003530 con 0x7f3b6415ae10 2023-09-13T06:01:56.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.912+0000 7f3b69cf4640 1 -- 172.21.15.130:0/3749607768 >> v2:172.21.15.164:3300/0 conn(0x7f3b641617e0 msgr2=0x7f3b640cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:56.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.912+0000 7f3b69cf4640 1 --2- 172.21.15.130:0/3749607768 >> v2:172.21.15.164:3300/0 conn(0x7f3b641617e0 0x7f3b640cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.912+0000 7f3b69cf4640 1 -- 172.21.15.130:0/3749607768 >> v1:172.21.15.130:6789/0 conn(0x7f3b6415ae10 legacy=0x7f3b640d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.912+0000 7f3b69cf4640 1 -- 172.21.15.130:0/3749607768 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6415e5e0 con 0x7f3b640d2cd0 2023-09-13T06:01:56.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.912+0000 7f3b6acf6640 1 --2- 172.21.15.130:0/3749607768 >> v2:172.21.15.164:3300/0 conn(0x7f3b641617e0 0x7f3b640cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:56.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.912+0000 7f3b69cf4640 1 --2- 172.21.15.130:0/3749607768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b640d2cd0 0x7f3b641612a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b540097c0 tx=0x7f3b5401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71b42b731052251e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:56.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.912+0000 7f3b694f3640 1 -- 172.21.15.130:0/3749607768 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b540ab610 con 0x7f3b640d2cd0 2023-09-13T06:01:56.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.912+0000 7f3b694f3640 1 -- 172.21.15.130:0/3749607768 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b540ab770 con 0x7f3b640d2cd0 2023-09-13T06:01:56.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.912+0000 7f3b694f3640 1 -- 172.21.15.130:0/3749607768 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b540abb00 con 0x7f3b640d2cd0 2023-09-13T06:01:56.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.912+0000 7f3b6c759640 1 -- 172.21.15.130:0/3749607768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b640d2cd0 msgr2=0x7f3b641612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.912+0000 7f3b6c759640 1 --2- 172.21.15.130:0/3749607768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b640d2cd0 0x7f3b641612a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b540097c0 tx=0x7f3b5401c3f0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 -- 172.21.15.130:0/3749607768 shutdown_connections 2023-09-13T06:01:56.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 --2- 172.21.15.130:0/3749607768 >> v2:172.21.15.164:3300/0 conn(0x7f3b641617e0 0x7f3b640cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 --2- 172.21.15.130:0/3749607768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b640d2cd0 0x7f3b641612a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 -- 172.21.15.130:0/3749607768 >> 172.21.15.130:0/3749607768 conn(0x7f3b64065990 msgr2=0x7f3b64065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:56.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 -- 172.21.15.130:0/3749607768 shutdown_connections 2023-09-13T06:01:56.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 -- 172.21.15.130:0/3749607768 wait complete. 2023-09-13T06:01:56.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 Processor -- start 2023-09-13T06:01:56.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 -- start start 2023-09-13T06:01:56.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b640d2cd0 0x7f3b64162f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b6415ae10 0x7f3b64153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b641617e0 0x7f3b64163ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641641e0 con 0x7f3b640d2cd0 2023-09-13T06:01:56.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64164480 con 0x7f3b6415ae10 2023-09-13T06:01:56.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6c759640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64164760 con 0x7f3b641617e0 2023-09-13T06:01:56.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6a4f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b640d2cd0 0x7f3b64162f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6a4f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b640d2cd0 0x7f3b64162f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47658/0 (socket says 172.21.15.130:47658) 2023-09-13T06:01:56.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6a4f5640 1 -- 172.21.15.130:0/3387388174 learned_addr learned my addr 172.21.15.130:0/3387388174 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:56.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6acf6640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b641617e0 0x7f3b64163ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b69cf4640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b6415ae10 0x7f3b64153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6a4f5640 1 -- 172.21.15.130:0/3387388174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b641617e0 msgr2=0x7f3b64163ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6a4f5640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b641617e0 0x7f3b64163ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6a4f5640 1 -- 172.21.15.130:0/3387388174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b6415ae10 msgr2=0x7f3b64153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:56.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6a4f5640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b6415ae10 0x7f3b64153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:56.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6a4f5640 1 -- 172.21.15.130:0/3387388174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c009a70 con 0x7f3b640d2cd0 2023-09-13T06:01:56.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b69cf4640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b6415ae10 0x7f3b64153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:01:56.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.916+0000 7f3b6a4f5640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b640d2cd0 0x7f3b64162f90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000c4d0 tx=0x7f3b6000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:56.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.920+0000 7f3b5affd640 1 -- 172.21.15.130:0/3387388174 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60005cf0 con 0x7f3b640d2cd0 2023-09-13T06:01:56.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.920+0000 7f3b5affd640 1 -- 172.21.15.130:0/3387388174 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b60005e50 con 0x7f3b640d2cd0 2023-09-13T06:01:56.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.920+0000 7f3b6c759640 1 -- 172.21.15.130:0/3387388174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b54009420 con 0x7f3b640d2cd0 2023-09-13T06:01:56.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.920+0000 7f3b5affd640 1 -- 172.21.15.130:0/3387388174 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b600072d0 con 0x7f3b640d2cd0 2023-09-13T06:01:56.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.920+0000 7f3b6c759640 1 -- 172.21.15.130:0/3387388174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b64164d20 con 0x7f3b640d2cd0 2023-09-13T06:01:56.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.920+0000 7f3b6c759640 1 -- 172.21.15.130:0/3387388174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b640618a0 con 0x7f3b640d2cd0 2023-09-13T06:01:56.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.920+0000 7f3b5affd640 1 -- 172.21.15.130:0/3387388174 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3b60007430 con 0x7f3b640d2cd0 2023-09-13T06:01:56.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.920+0000 7f3b5affd640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3b48065b20 0x7f3b48067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:56.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.920+0000 7f3b5affd640 1 -- 172.21.15.130:0/3387388174 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b60082770 con 0x7f3b640d2cd0 2023-09-13T06:01:56.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.920+0000 7f3b69cf4640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3b48065b20 0x7f3b48067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:56.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.920+0000 7f3b69cf4640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3b48065b20 0x7f3b48067fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b540af000 tx=0x7f3b540a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:56.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:56.924+0000 7f3b5affd640 1 -- 172.21.15.130:0/3387388174 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3b60050200 con 0x7f3b640d2cd0 2023-09-13T06:01:57.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.072+0000 7f3b6c759640 1 -- 172.21.15.130:0/3387388174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b641622d0 con 0x7f3b640d2cd0 2023-09-13T06:01:57.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.072+0000 7f3b5affd640 1 -- 172.21.15.130:0/3387388174 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b60053820 con 0x7f3b640d2cd0 2023-09-13T06:01:57.078 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:01:57.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 -- 172.21.15.130:0/3387388174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3b48065b20 msgr2=0x7f3b48067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3b48065b20 0x7f3b48067fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b540af000 tx=0x7f3b540a7000 comp rx=0 tx=0).stop 2023-09-13T06:01:57.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 -- 172.21.15.130:0/3387388174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b640d2cd0 msgr2=0x7f3b64162f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b640d2cd0 0x7f3b64162f90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000c4d0 tx=0x7f3b6000c8d0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 -- 172.21.15.130:0/3387388174 shutdown_connections 2023-09-13T06:01:57.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3b48065b20 0x7f3b48067fe0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b6415ae10 0x7f3b64153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b641617e0 0x7f3b64163ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 --2- 172.21.15.130:0/3387388174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b640d2cd0 0x7f3b64162f90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 -- 172.21.15.130:0/3387388174 >> 172.21.15.130:0/3387388174 conn(0x7f3b64065990 msgr2=0x7f3b641572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:57.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 -- 172.21.15.130:0/3387388174 shutdown_connections 2023-09-13T06:01:57.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.076+0000 7f3b6c759640 1 -- 172.21.15.130:0/3387388174 wait complete. 2023-09-13T06:01:57.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:01:57.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.240+0000 7f7c1680b640 1 Processor -- start 2023-09-13T06:01:57.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.240+0000 7f7c1680b640 1 -- start start 2023-09-13T06:01:57.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c1680b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c10146d40 0x7f7c100b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c1680b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7c100d3a80 0x7f7c10070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c1680b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7c10070cb0 0x7f7c10160e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c1680b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c10071140 con 0x7f7c100d3a80 2023-09-13T06:01:57.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c1680b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100b42a0 con 0x7f7c10070cb0 2023-09-13T06:01:57.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c1680b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100b4560 con 0x7f7c10146d40 2023-09-13T06:01:57.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c15008640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7c100d3a80 0x7f7c10070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c15008640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7c100d3a80 0x7f7c10070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47670/0 (socket says 172.21.15.130:47670) 2023-09-13T06:01:57.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c15008640 1 -- 172.21.15.130:0/1783835251 learned_addr learned my addr 172.21.15.130:0/1783835251 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:57.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c1600a640 1 --2- 172.21.15.130:0/1783835251 >> v2:172.21.15.164:3300/0 conn(0x7f7c10070cb0 0x7f7c10160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c15809640 1 --2- 172.21.15.130:0/1783835251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c10146d40 0x7f7c100b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c15008640 1 -- 172.21.15.130:0/1783835251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c10146d40 msgr2=0x7f7c100b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:57.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c15008640 1 --2- 172.21.15.130:0/1783835251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c10146d40 0x7f7c100b8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c15008640 1 -- 172.21.15.130:0/1783835251 >> v2:172.21.15.164:3300/0 conn(0x7f7c10070cb0 msgr2=0x7f7c10160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:57.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c15008640 1 --2- 172.21.15.130:0/1783835251 >> v2:172.21.15.164:3300/0 conn(0x7f7c10070cb0 0x7f7c10160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.244+0000 7f7c15008640 1 -- 172.21.15.130:0/1783835251 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100b4840 con 0x7f7c100d3a80 2023-09-13T06:01:57.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c15008640 1 --2- 172.21.15.130:0/1783835251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c100d3a80 0x7f7c10070770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c10070080 tx=0x7f7c0001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366085341c10d81b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:57.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c14807640 1 -- 172.21.15.130:0/1783835251 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000ab600 con 0x7f7c100d3a80 2023-09-13T06:01:57.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c14807640 1 -- 172.21.15.130:0/1783835251 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c000a7050 con 0x7f7c100d3a80 2023-09-13T06:01:57.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c14807640 1 -- 172.21.15.130:0/1783835251 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000ab980 con 0x7f7c100d3a80 2023-09-13T06:01:57.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 -- 172.21.15.130:0/1783835251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c100d3a80 msgr2=0x7f7c10070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 --2- 172.21.15.130:0/1783835251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c100d3a80 0x7f7c10070770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c10070080 tx=0x7f7c0001c240 comp rx=0 tx=0).stop 2023-09-13T06:01:57.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 -- 172.21.15.130:0/1783835251 shutdown_connections 2023-09-13T06:01:57.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 --2- 172.21.15.130:0/1783835251 >> v2:172.21.15.164:3300/0 conn(0x7f7c10070cb0 0x7f7c10160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 --2- 172.21.15.130:0/1783835251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c100d3a80 0x7f7c10070770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 --2- 172.21.15.130:0/1783835251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c10146d40 0x7f7c100b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 -- 172.21.15.130:0/1783835251 >> 172.21.15.130:0/1783835251 conn(0x7f7c100d2f60 msgr2=0x7f7c100d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:57.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 -- 172.21.15.130:0/1783835251 shutdown_connections 2023-09-13T06:01:57.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 -- 172.21.15.130:0/1783835251 wait complete. 2023-09-13T06:01:57.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 Processor -- start 2023-09-13T06:01:57.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 -- start start 2023-09-13T06:01:57.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c10070cb0 0x7f7c1015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.248+0000 7f7c1680b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100d3a80 0x7f7c101421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1680b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c10146d40 0x7f7c1012c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1680b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1015a820 con 0x7f7c10146d40 2023-09-13T06:01:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1680b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1015b0c0 con 0x7f7c10070cb0 2023-09-13T06:01:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1680b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10142720 con 0x7f7c100d3a80 2023-09-13T06:01:57.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1600a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c10146d40 0x7f7c1012c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1600a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c10146d40 0x7f7c1012c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47678/0 (socket says 172.21.15.130:47678) 2023-09-13T06:01:57.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1600a640 1 -- 172.21.15.130:0/613054429 learned_addr learned my addr 172.21.15.130:0/613054429 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:57.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c15809640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c10070cb0 0x7f7c1015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c15008640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100d3a80 0x7f7c101421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1600a640 1 -- 172.21.15.130:0/613054429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100d3a80 msgr2=0x7f7c101421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1600a640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100d3a80 0x7f7c101421e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1600a640 1 -- 172.21.15.130:0/613054429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c10070cb0 msgr2=0x7f7c1015b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1600a640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c10070cb0 0x7f7c1015b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1600a640 1 -- 172.21.15.130:0/613054429 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c000094d0 con 0x7f7c10146d40 2023-09-13T06:01:57.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1600a640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c10146d40 0x7f7c1012c940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7c08007e60 tx=0x7f7c0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:57.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c067fc640 1 -- 172.21.15.130:0/613054429 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08014620 con 0x7f7c10146d40 2023-09-13T06:01:57.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c067fc640 1 -- 172.21.15.130:0/613054429 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800ee90 con 0x7f7c10146d40 2023-09-13T06:01:57.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1680b640 1 -- 172.21.15.130:0/613054429 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c10150c40 con 0x7f7c10146d40 2023-09-13T06:01:57.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c067fc640 1 -- 172.21.15.130:0/613054429 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080149e0 con 0x7f7c10146d40 2023-09-13T06:01:57.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1680b640 1 -- 172.21.15.130:0/613054429 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1015ad50 con 0x7f7c10146d40 2023-09-13T06:01:57.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c1680b640 1 -- 172.21.15.130:0/613054429 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c100b7f60 con 0x7f7c10146d40 2023-09-13T06:01:57.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c067fc640 1 -- 172.21.15.130:0/613054429 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7c08014b40 con 0x7f7c10146d40 2023-09-13T06:01:57.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.252+0000 7f7c067fc640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bf4065b20 0x7f7bf4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.256+0000 7f7c067fc640 1 -- 172.21.15.130:0/613054429 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c08083b10 con 0x7f7c10146d40 2023-09-13T06:01:57.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.256+0000 7f7c15809640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bf4065b20 0x7f7bf4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.256+0000 7f7c15809640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bf4065b20 0x7f7bf4067fe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c006fd0 tx=0x7f7c0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:57.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.256+0000 7f7c067fc640 1 -- 172.21.15.130:0/613054429 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7c08051500 con 0x7f7c10146d40 2023-09-13T06:01:57.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.408+0000 7f7c1680b640 1 -- 172.21.15.130:0/613054429 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c10070390 con 0x7f7c10146d40 2023-09-13T06:01:57.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.408+0000 7f7c067fc640 1 -- 172.21.15.130:0/613054429 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c08054b20 con 0x7f7c10146d40 2023-09-13T06:01:57.414 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:01:57.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 -- 172.21.15.130:0/613054429 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bf4065b20 msgr2=0x7f7bf4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bf4065b20 0x7f7bf4067fe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c006fd0 tx=0x7f7c0c008040 comp rx=0 tx=0).stop 2023-09-13T06:01:57.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 -- 172.21.15.130:0/613054429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c10146d40 msgr2=0x7f7c1012c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c10146d40 0x7f7c1012c940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7c08007e60 tx=0x7f7c0800e4b0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 -- 172.21.15.130:0/613054429 shutdown_connections 2023-09-13T06:01:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bf4065b20 0x7f7bf4067fe0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c10146d40 0x7f7c1012c940 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100d3a80 0x7f7c101421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 --2- 172.21.15.130:0/613054429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c10070cb0 0x7f7c1015b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 -- 172.21.15.130:0/613054429 >> 172.21.15.130:0/613054429 conn(0x7f7c100d2f60 msgr2=0x7f7c10143130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:57.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 -- 172.21.15.130:0/613054429 shutdown_connections 2023-09-13T06:01:57.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.412+0000 7f7c1680b640 1 -- 172.21.15.130:0/613054429 wait complete. 2023-09-13T06:01:57.435 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:01:57.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.572+0000 7fdff809c640 1 Processor -- start 2023-09-13T06:01:57.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.572+0000 7fdff809c640 1 -- start start 2023-09-13T06:01:57.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.576+0000 7fdff809c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdff015ae10 0x7fdff00d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.576+0000 7fdff809c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff015dd40 con 0x7fdff01619b0 2023-09-13T06:01:57.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.576+0000 7fdff809c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff015e020 con 0x7fdff00d2b00 2023-09-13T06:01:57.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.576+0000 7fdff809c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff0161e40 con 0x7fdff015ae10 2023-09-13T06:01:57.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.576+0000 7fdff5e38640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdff015ae10 0x7fdff00d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.576+0000 7fdff6639640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fdff01619b0 0x7fdff00cfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36096/0 (socket says 172.21.15.130:36096) 2023-09-13T06:01:57.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.576+0000 7fdff6639640 1 -- 172.21.15.130:0/890334027 learned_addr learned my addr 172.21.15.130:0/890334027 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:57.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.576+0000 7fdff5e38640 1 -- 172.21.15.130:0/890334027 >> v1:172.21.15.164:6789/0 conn(0x7fdff00d2b00 legacy=0x7fdff01612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:57.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.576+0000 7fdff5e38640 1 -- 172.21.15.130:0/890334027 >> v1:172.21.15.130:6789/0 conn(0x7fdff01619b0 legacy=0x7fdff00cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.576+0000 7fdff5e38640 1 -- 172.21.15.130:0/890334027 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff015e300 con 0x7fdff015ae10 2023-09-13T06:01:57.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.576+0000 7fdff5e38640 1 --2- 172.21.15.130:0/890334027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff015ae10 0x7fdff00d25c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0097c0 tx=0x7fdfec01c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25003b69d0ace0f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:57.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff4e36640 1 -- 172.21.15.130:0/890334027 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0ac640 con 0x7fdff015ae10 2023-09-13T06:01:57.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff4e36640 1 -- 172.21.15.130:0/890334027 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec0ac7a0 con 0x7fdff015ae10 2023-09-13T06:01:57.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff4e36640 1 -- 172.21.15.130:0/890334027 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0acb30 con 0x7fdff015ae10 2023-09-13T06:01:57.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 -- 172.21.15.130:0/890334027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff015ae10 msgr2=0x7fdff00d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 --2- 172.21.15.130:0/890334027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff015ae10 0x7fdff00d25c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0097c0 tx=0x7fdfec01c2f0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 -- 172.21.15.130:0/890334027 shutdown_connections 2023-09-13T06:01:57.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 --2- 172.21.15.130:0/890334027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff015ae10 0x7fdff00d25c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 -- 172.21.15.130:0/890334027 >> 172.21.15.130:0/890334027 conn(0x7fdff0065990 msgr2=0x7fdff0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:57.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 -- 172.21.15.130:0/890334027 shutdown_connections 2023-09-13T06:01:57.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 -- 172.21.15.130:0/890334027 wait complete. 2023-09-13T06:01:57.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 Processor -- start 2023-09-13T06:01:57.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 -- start start 2023-09-13T06:01:57.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00d2b00 0x7fdff0151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdff015ae10 0x7fdff0158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdff01619b0 0x7fdff01f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0156020 con 0x7fdff00d2b00 2023-09-13T06:01:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0163aa0 con 0x7fdff015ae10 2023-09-13T06:01:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff809c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0155a10 con 0x7fdff01619b0 2023-09-13T06:01:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff5e38640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00d2b00 0x7fdff0151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff5e38640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00d2b00 0x7fdff0151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47704/0 (socket says 172.21.15.130:47704) 2023-09-13T06:01:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.580+0000 7fdff5e38640 1 -- 172.21.15.130:0/590569806 learned_addr learned my addr 172.21.15.130:0/590569806 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:57.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdff5637640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdff015ae10 0x7fdff0158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdff6639640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdff01619b0 0x7fdff01f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdff5e38640 1 -- 172.21.15.130:0/590569806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdff01619b0 msgr2=0x7fdff01f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdff5e38640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdff01619b0 0x7fdff01f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdff5e38640 1 -- 172.21.15.130:0/590569806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdff015ae10 msgr2=0x7fdff0158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdff5e38640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdff015ae10 0x7fdff0158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdff5e38640 1 -- 172.21.15.130:0/590569806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec009420 con 0x7fdff00d2b00 2023-09-13T06:01:57.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdff5e38640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00d2b00 0x7fdff0151be0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0af040 tx=0x7fdfec01ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:57.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdfe67fc640 1 -- 172.21.15.130:0/590569806 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0b8860 con 0x7fdff00d2b00 2023-09-13T06:01:57.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdfe67fc640 1 -- 172.21.15.130:0/590569806 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec0b89c0 con 0x7fdff00d2b00 2023-09-13T06:01:57.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdfe67fc640 1 -- 172.21.15.130:0/590569806 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0b8d70 con 0x7fdff00d2b00 2023-09-13T06:01:57.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdff809c640 1 -- 172.21.15.130:0/590569806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff0152120 con 0x7fdff00d2b00 2023-09-13T06:01:57.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdff809c640 1 -- 172.21.15.130:0/590569806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff0159b80 con 0x7fdff00d2b00 2023-09-13T06:01:57.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdff809c640 1 -- 172.21.15.130:0/590569806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff0159d40 con 0x7fdff00d2b00 2023-09-13T06:01:57.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdfe67fc640 1 -- 172.21.15.130:0/590569806 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdfec0b6400 con 0x7fdff00d2b00 2023-09-13T06:01:57.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.584+0000 7fdfe67fc640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfd4065b50 0x7fdfd4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.588+0000 7fdfe67fc640 1 -- 172.21.15.130:0/590569806 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfec11ded0 con 0x7fdff00d2b00 2023-09-13T06:01:57.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.588+0000 7fdff5637640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfd4065b50 0x7fdfd4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.588+0000 7fdff5637640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfd4065b50 0x7fdfd4068010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdff0168db0 tx=0x7fdfe0007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:57.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.592+0000 7fdfe67fc640 1 -- 172.21.15.130:0/590569806 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdfec0eb950 con 0x7fdff00d2b00 2023-09-13T06:01:57.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.736+0000 7fdff809c640 1 -- 172.21.15.130:0/590569806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdff00618a0 con 0x7fdff00d2b00 2023-09-13T06:01:57.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdfe67fc640 1 -- 172.21.15.130:0/590569806 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdfec0b10a0 con 0x7fdff00d2b00 2023-09-13T06:01:57.743 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:01:57.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 -- 172.21.15.130:0/590569806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfd4065b50 msgr2=0x7fdfd4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfd4065b50 0x7fdfd4068010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdff0168db0 tx=0x7fdfe0007e40 comp rx=0 tx=0).stop 2023-09-13T06:01:57.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 -- 172.21.15.130:0/590569806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00d2b00 msgr2=0x7fdff0151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00d2b00 0x7fdff0151be0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0af040 tx=0x7fdfec01ab30 comp rx=0 tx=0).stop 2023-09-13T06:01:57.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 -- 172.21.15.130:0/590569806 shutdown_connections 2023-09-13T06:01:57.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfd4065b50 0x7fdfd4068010 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdff015ae10 0x7fdff0158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdff01619b0 0x7fdff01f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 --2- 172.21.15.130:0/590569806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00d2b00 0x7fdff0151be0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 -- 172.21.15.130:0/590569806 >> 172.21.15.130:0/590569806 conn(0x7fdff0065990 msgr2=0x7fdff015cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:57.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 -- 172.21.15.130:0/590569806 shutdown_connections 2023-09-13T06:01:57.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.740+0000 7fdff809c640 1 -- 172.21.15.130:0/590569806 wait complete. 2023-09-13T06:01:57.763 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:01:57.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.896+0000 7f9bbdd4d640 1 Processor -- start 2023-09-13T06:01:57.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bbdd4d640 1 -- start start 2023-09-13T06:01:57.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bbdd4d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9bb8146540 0x7f9bb8070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bbdd4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bb8070b90 0x7f9bb8160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bbdd4d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb8070fe0 con 0x7f9bb81436e0 2023-09-13T06:01:57.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bbdd4d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb806f640 con 0x7f9bb8146540 2023-09-13T06:01:57.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bbdd4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb806f890 con 0x7f9bb8070b90 2023-09-13T06:01:57.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bb77fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9bb81436e0 0x7f9bb80ac840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36102/0 (socket says 172.21.15.130:36102) 2023-09-13T06:01:57.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bb77fe640 1 -- 172.21.15.130:0/4004521955 learned_addr learned my addr 172.21.15.130:0/4004521955 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:57.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bb6ffd640 1 --2- 172.21.15.130:0/4004521955 >> v2:172.21.15.130:3300/0 conn(0x7f9bb8146540 0x7f9bb8070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bb7fff640 1 --2- 172.21.15.130:0/4004521955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bb8070b90 0x7f9bb8160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bb67fc640 1 -- 172.21.15.130:0/4004521955 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005698515 0 0) 0x7f9bb8070fe0 con 0x7f9bb81436e0 2023-09-13T06:01:57.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bb67fc640 1 -- 172.21.15.130:0/4004521955 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba0003530 con 0x7f9bb81436e0 2023-09-13T06:01:57.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bb6ffd640 1 -- 172.21.15.130:0/4004521955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bb8070b90 msgr2=0x7f9bb8160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:57.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bb6ffd640 1 --2- 172.21.15.130:0/4004521955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bb8070b90 0x7f9bb8160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bb6ffd640 1 -- 172.21.15.130:0/4004521955 >> v1:172.21.15.130:6789/0 conn(0x7f9bb81436e0 legacy=0x7f9bb80ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.900+0000 7f9bb6ffd640 1 -- 172.21.15.130:0/4004521955 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb806fb70 con 0x7f9bb8146540 2023-09-13T06:01:57.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bb6ffd640 1 --2- 172.21.15.130:0/4004521955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bb8146540 0x7f9bb8070650 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0097c0 tx=0x7f9bac01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2c5cc5564fa90f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:57.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bb67fc640 1 -- 172.21.15.130:0/4004521955 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac0ab600 con 0x7f9bb8146540 2023-09-13T06:01:57.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bb67fc640 1 -- 172.21.15.130:0/4004521955 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac0a7050 con 0x7f9bb8146540 2023-09-13T06:01:57.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bb67fc640 1 -- 172.21.15.130:0/4004521955 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac0ab980 con 0x7f9bb8146540 2023-09-13T06:01:57.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/4004521955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bb8146540 msgr2=0x7f9bb8070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bbdd4d640 1 --2- 172.21.15.130:0/4004521955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bb8146540 0x7f9bb8070650 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0097c0 tx=0x7f9bac01c360 comp rx=0 tx=0).stop 2023-09-13T06:01:57.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/4004521955 shutdown_connections 2023-09-13T06:01:57.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bbdd4d640 1 --2- 172.21.15.130:0/4004521955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bb8070b90 0x7f9bb8160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bbdd4d640 1 --2- 172.21.15.130:0/4004521955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bb8146540 0x7f9bb8070650 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/4004521955 >> 172.21.15.130:0/4004521955 conn(0x7f9bb80b0bc0 msgr2=0x7f9bb80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:57.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/4004521955 shutdown_connections 2023-09-13T06:01:57.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.904+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/4004521955 wait complete. 2023-09-13T06:01:57.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bbdd4d640 1 Processor -- start 2023-09-13T06:01:57.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bbdd4d640 1 -- start start 2023-09-13T06:01:57.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bbdd4d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb8070b90 0x7f9bb813c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bbdd4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bb81436e0 0x7f9bb815ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bbdd4d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bb8146540 0x7f9bb815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bbdd4d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb813dd50 con 0x7f9bb8146540 2023-09-13T06:01:57.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bbdd4d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb813d140 con 0x7f9bb8070b90 2023-09-13T06:01:57.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bbdd4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb813d420 con 0x7f9bb81436e0 2023-09-13T06:01:57.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bb8146540 0x7f9bb815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bb8146540 0x7f9bb815b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47728/0 (socket says 172.21.15.130:47728) 2023-09-13T06:01:57.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb7fff640 1 -- 172.21.15.130:0/36028 learned_addr learned my addr 172.21.15.130:0/36028 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:57.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb7fff640 1 -- 172.21.15.130:0/36028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bb81436e0 msgr2=0x7f9bb815ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb6ffd640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bb81436e0 0x7f9bb815ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb77fe640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb8070b90 0x7f9bb813c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb7fff640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bb81436e0 0x7f9bb815ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb7fff640 1 -- 172.21.15.130:0/36028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb8070b90 msgr2=0x7f9bb813c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:57.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb7fff640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb8070b90 0x7f9bb813c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:57.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb7fff640 1 -- 172.21.15.130:0/36028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac009420 con 0x7f9bb8146540 2023-09-13T06:01:57.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb77fe640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb8070b90 0x7f9bb813c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:57.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bb7fff640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bb8146540 0x7f9bb815b4c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000efc0 tx=0x7f9bb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:57.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9b9ffff640 1 -- 172.21.15.130:0/36028 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0009ba0 con 0x7f9bb8146540 2023-09-13T06:01:57.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9b9ffff640 1 -- 172.21.15.130:0/36028 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb000f040 con 0x7f9bb8146540 2023-09-13T06:01:57.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/36028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb813d700 con 0x7f9bb8146540 2023-09-13T06:01:57.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9b9ffff640 1 -- 172.21.15.130:0/36028 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb00146c0 con 0x7f9bb8146540 2023-09-13T06:01:57.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/36028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb813cd80 con 0x7f9bb8146540 2023-09-13T06:01:57.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.908+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/36028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb80618a0 con 0x7f9bb8146540 2023-09-13T06:01:57.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.912+0000 7f9b9ffff640 1 -- 172.21.15.130:0/36028 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9bb0014820 con 0x7f9bb8146540 2023-09-13T06:01:57.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.912+0000 7f9b9ffff640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ba4065b50 0x7f9ba4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:57.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.912+0000 7f9b9ffff640 1 -- 172.21.15.130:0/36028 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bb0083e50 con 0x7f9bb8146540 2023-09-13T06:01:57.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.912+0000 7f9bb77fe640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ba4065b50 0x7f9ba4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:57.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.912+0000 7f9bb77fe640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ba4065b50 0x7f9ba4068010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80011f0 tx=0x7f9ba8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:57.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:57.916+0000 7f9b9ffff640 1 -- 172.21.15.130:0/36028 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9bb0051700 con 0x7f9bb8146540 2023-09-13T06:01:58.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/36028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9bb8160f80 con 0x7f9bb8146540 2023-09-13T06:01:58.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9b9ffff640 1 -- 172.21.15.130:0/36028 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9bb0054d20 con 0x7f9bb8146540 2023-09-13T06:01:58.080 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:01:58.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/36028 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ba4065b50 msgr2=0x7f9ba4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ba4065b50 0x7f9ba4068010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80011f0 tx=0x7f9ba8009040 comp rx=0 tx=0).stop 2023-09-13T06:01:58.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/36028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bb8146540 msgr2=0x7f9bb815b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bb8146540 0x7f9bb815b4c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000efc0 tx=0x7f9bb000c490 comp rx=0 tx=0).stop 2023-09-13T06:01:58.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/36028 shutdown_connections 2023-09-13T06:01:58.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ba4065b50 0x7f9ba4068010 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bb8146540 0x7f9bb815b4c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bb81436e0 0x7f9bb815ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 --2- 172.21.15.130:0/36028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb8070b90 0x7f9bb813c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/36028 >> 172.21.15.130:0/36028 conn(0x7f9bb80b0bc0 msgr2=0x7f9bb80ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:58.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/36028 shutdown_connections 2023-09-13T06:01:58.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.076+0000 7f9bbdd4d640 1 -- 172.21.15.130:0/36028 wait complete. 2023-09-13T06:01:58.100 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T06:01:58.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:58.101 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-09-13T06:01:58.166 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:01:58.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:58.167 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T06:01:58.182 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:01:58.183 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:01:58.193 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:01:58.193 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:01:58.243 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:01:58.244 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:01:58.302 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:01:58.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff415f3d640 1 Processor -- start 2023-09-13T06:01:58.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff415f3d640 1 -- start start 2023-09-13T06:01:58.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff415f3d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff410146b30 0x7ff4100d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff415f3d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4100d1ac0 con 0x7ff4100d0a10 2023-09-13T06:01:58.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff415f3d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4100d0eb0 con 0x7ff4100d1f50 2023-09-13T06:01:58.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff415f3d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100d1190 con 0x7ff410146b30 2023-09-13T06:01:58.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff4100d0a10 0x7ff410070180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36116/0 (socket says 172.21.15.130:36116) 2023-09-13T06:01:58.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40ffff640 1 -- 172.21.15.130:0/1959858412 learned_addr learned my addr 172.21.15.130:0/1959858412 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:58.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff414f3b640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff410146b30 0x7ff4100d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254308539 0 0) 0x7ff4100d1ac0 con 0x7ff4100d0a10 2023-09-13T06:01:58.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff400003530 con 0x7ff4100d0a10 2023-09-13T06:01:58.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240977007 0 0) 0x7ff4100d0eb0 con 0x7ff4100d1f50 2023-09-13T06:01:58.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4100d1ac0 con 0x7ff4100d1f50 2023-09-13T06:01:58.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437981361 0 0) 0x7ff400003530 con 0x7ff4100d0a10 2023-09-13T06:01:58.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff410146b30 msgr2=0x7ff4100d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:58.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff410146b30 0x7ff4100d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 >> v1:172.21.15.164:6789/0 conn(0x7ff4100d1f50 legacy=0x7ff41015d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100d1470 con 0x7ff4100d0a10 2023-09-13T06:01:58.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7ff3fc001600 con 0x7ff4100d0a10 2023-09-13T06:01:58.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 >> v1:172.21.15.130:6789/0 conn(0x7ff4100d0a10 legacy=0x7ff410070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400003bb0 0x7ff400003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff410146b30 0x7ff4000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff400004d10 0x7ff400005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100d1190 con 0x7ff400003bb0 2023-09-13T06:01:58.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40000bac0 con 0x7ff400004d10 2023-09-13T06:01:58.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40000bc80 con 0x7ff410146b30 2023-09-13T06:01:58.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff414f3b640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400003bb0 0x7ff400003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff40ffff640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff410146b30 0x7ff4000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff41573c640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff400004d10 0x7ff400005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff414f3b640 1 -- 172.21.15.130:0/1959858412 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff410146b30 msgr2=0x7ff4000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:58.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff414f3b640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff410146b30 0x7ff4000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff414f3b640 1 -- 172.21.15.130:0/1959858412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff400004d10 msgr2=0x7ff400005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:58.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff414f3b640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff400004d10 0x7ff400005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.440+0000 7ff414f3b640 1 -- 172.21.15.130:0/1959858412 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400003530 con 0x7ff400003bb0 2023-09-13T06:01:58.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.444+0000 7ff414f3b640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400003bb0 0x7ff400003fb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff404009ae0 tx=0x7ff40401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e589f17af0757c24 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:58.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.444+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4040a5550 con 0x7ff400003bb0 2023-09-13T06:01:58.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.444+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4040a56b0 con 0x7ff400003bb0 2023-09-13T06:01:58.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.444+0000 7ff40f7fe640 1 -- 172.21.15.130:0/1959858412 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4040a5a60 con 0x7ff400003bb0 2023-09-13T06:01:58.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.444+0000 7ff415f3d640 1 -- 172.21.15.130:0/1959858412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400003bb0 msgr2=0x7ff400003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.444+0000 7ff415f3d640 1 --2- 172.21.15.130:0/1959858412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400003bb0 0x7ff400003fb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff404009ae0 tx=0x7ff40401c960 comp rx=0 tx=0).stop 2023-09-13T06:01:58.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.444+0000 7ff41573c640 1 -- 172.21.15.130:0/1959858412 reap_dead start 2023-09-13T06:01:58.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.444+0000 7ff415f3d640 1 -- 172.21.15.130:0/1959858412 shutdown_connections 2023-09-13T06:01:58.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.444+0000 7ff415f3d640 1 -- 172.21.15.130:0/1959858412 >> 172.21.15.130:0/1959858412 conn(0x7ff4100d3090 msgr2=0x7ff4100d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:58.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.444+0000 7ff415f3d640 1 -- 172.21.15.130:0/1959858412 shutdown_connections 2023-09-13T06:01:58.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.444+0000 7ff415f3d640 1 -- 172.21.15.130:0/1959858412 wait complete. 2023-09-13T06:01:58.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff415f3d640 1 Processor -- start 2023-09-13T06:01:58.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff415f3d640 1 -- start start 2023-09-13T06:01:58.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff415f3d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff400003bb0 0x7ff41015a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff415f3d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4100b5420 0x7ff4100b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff415f3d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff410145660 0x7ff410145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff415f3d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff410140500 con 0x7ff4100b5420 2023-09-13T06:01:58.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff415f3d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4101fa1a0 con 0x7ff410145660 2023-09-13T06:01:58.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff415f3d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff410146020 con 0x7ff400003bb0 2023-09-13T06:01:58.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4100b5420 0x7ff4100b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4100b5420 0x7ff4100b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47738/0 (socket says 172.21.15.130:47738) 2023-09-13T06:01:58.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40ffff640 1 -- 172.21.15.130:0/3316246542 learned_addr learned my addr 172.21.15.130:0/3316246542 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:58.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff41573c640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff410145660 0x7ff410145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff414f3b640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff400003bb0 0x7ff41015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40ffff640 1 -- 172.21.15.130:0/3316246542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff400003bb0 msgr2=0x7ff41015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40ffff640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff400003bb0 0x7ff41015a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40ffff640 1 -- 172.21.15.130:0/3316246542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff410145660 msgr2=0x7ff410145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40ffff640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff410145660 0x7ff410145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40ffff640 1 -- 172.21.15.130:0/3316246542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4101f9ec0 con 0x7ff4100b5420 2023-09-13T06:01:58.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40ffff640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4100b5420 0x7ff4100b58a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0072f0 tx=0x7ff3fc0077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:58.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40d7fa640 1 -- 172.21.15.130:0/3316246542 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00f9c0 con 0x7ff4100b5420 2023-09-13T06:01:58.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40d7fa640 1 -- 172.21.15.130:0/3316246542 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc00fb20 con 0x7ff4100b5420 2023-09-13T06:01:58.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff40d7fa640 1 -- 172.21.15.130:0/3316246542 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00fed0 con 0x7ff4100b5420 2023-09-13T06:01:58.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff415f3d640 1 -- 172.21.15.130:0/3316246542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41013a230 con 0x7ff4100b5420 2023-09-13T06:01:58.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.448+0000 7ff415f3d640 1 -- 172.21.15.130:0/3316246542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41013a7f0 con 0x7ff4100b5420 2023-09-13T06:01:58.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.452+0000 7ff415f3d640 1 -- 172.21.15.130:0/3316246542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41013a090 con 0x7ff4100b5420 2023-09-13T06:01:58.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.452+0000 7ff40d7fa640 1 -- 172.21.15.130:0/3316246542 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff3fc01d360 con 0x7ff4100b5420 2023-09-13T06:01:58.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.452+0000 7ff40d7fa640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff3f4065b50 0x7ff3f4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.452+0000 7ff40d7fa640 1 -- 172.21.15.130:0/3316246542 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3fc082b80 con 0x7ff4100b5420 2023-09-13T06:01:58.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.452+0000 7ff414f3b640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff3f4065b50 0x7ff3f4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.452+0000 7ff414f3b640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff3f4065b50 0x7ff3f4068010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4040af000 tx=0x7ff4040046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:58.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.456+0000 7ff40d7fa640 1 -- 172.21.15.130:0/3316246542 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff41013a090 con 0x7ff4100b5420 2023-09-13T06:01:58.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.608+0000 7ff415f3d640 1 -- 172.21.15.130:0/3316246542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff41013a090 con 0x7ff4100b5420 2023-09-13T06:01:58.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.608+0000 7ff40d7fa640 1 -- 172.21.15.130:0/3316246542 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7ff41013a090 con 0x7ff4100b5420 2023-09-13T06:01:58.613 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:01:58.614 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:01:58.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 -- 172.21.15.130:0/3316246542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff3f4065b50 msgr2=0x7ff3f4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff3f4065b50 0x7ff3f4068010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4040af000 tx=0x7ff4040046d0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 -- 172.21.15.130:0/3316246542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4100b5420 msgr2=0x7ff4100b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4100b5420 0x7ff4100b58a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0072f0 tx=0x7ff3fc0077b0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 -- 172.21.15.130:0/3316246542 shutdown_connections 2023-09-13T06:01:58.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff3f4065b50 0x7ff3f4068010 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff410145660 0x7ff410145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4100b5420 0x7ff4100b58a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 --2- 172.21.15.130:0/3316246542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff400003bb0 0x7ff41015a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 -- 172.21.15.130:0/3316246542 >> 172.21.15.130:0/3316246542 conn(0x7ff4100d3090 msgr2=0x7ff41006ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:58.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 -- 172.21.15.130:0/3316246542 shutdown_connections 2023-09-13T06:01:58.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.612+0000 7ff415f3d640 1 -- 172.21.15.130:0/3316246542 wait complete. 2023-09-13T06:01:58.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:01:58.636 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:01:58.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.772+0000 7f616d311640 1 Processor -- start 2023-09-13T06:01:58.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.772+0000 7f616d311640 1 -- start start 2023-09-13T06:01:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f616d311640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f61680b4830 0x7f61680cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f616d311640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61680b2750 0x7f6168159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f616d311640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680cc9d0 con 0x7f6168159900 2023-09-13T06:01:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f616d311640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616815a220 con 0x7f61680b4830 2023-09-13T06:01:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f616d311640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61680b0c20 con 0x7f61680b2750 2023-09-13T06:01:58.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f61677fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61680b2750 0x7f6168159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f615e7fc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f61680b4830 0x7f61680cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f615e7fc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f61680b4830 0x7f61680cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:36196/0 (socket says 172.21.15.130:36196) 2023-09-13T06:01:58.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f615e7fc640 1 -- 172.21.15.130:0/2958677244 learned_addr learned my addr 172.21.15.130:0/2958677244 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:58.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f615e7fc640 1 -- 172.21.15.130:0/2958677244 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61680b2750 msgr2=0x7f6168159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:58.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f615e7fc640 1 --2- 172.21.15.130:0/2958677244 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61680b2750 0x7f6168159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f615e7fc640 1 -- 172.21.15.130:0/2958677244 >> v1:172.21.15.164:6789/0 conn(0x7f6168159900 legacy=0x7f61680b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.776+0000 7f615e7fc640 1 -- 172.21.15.130:0/2958677244 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680cccb0 con 0x7f61680b4830 2023-09-13T06:01:58.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f615e7fc640 1 --2- 172.21.15.130:0/2958677244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61680b4830 0x7f61680cc2d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f61500098a0 tx=0x7f615001c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b65026fa37203c1c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:58.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f61667fc640 1 -- 172.21.15.130:0/2958677244 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61500ab610 con 0x7f61680b4830 2023-09-13T06:01:58.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f61667fc640 1 -- 172.21.15.130:0/2958677244 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61500ab770 con 0x7f61680b4830 2023-09-13T06:01:58.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f61667fc640 1 -- 172.21.15.130:0/2958677244 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61500abb00 con 0x7f61680b4830 2023-09-13T06:01:58.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f616d311640 1 -- 172.21.15.130:0/2958677244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61680b4830 msgr2=0x7f61680cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f616d311640 1 --2- 172.21.15.130:0/2958677244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61680b4830 0x7f61680cc2d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f61500098a0 tx=0x7f615001c490 comp rx=0 tx=0).stop 2023-09-13T06:01:58.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f616d311640 1 -- 172.21.15.130:0/2958677244 shutdown_connections 2023-09-13T06:01:58.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f616d311640 1 --2- 172.21.15.130:0/2958677244 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61680b2750 0x7f6168159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f616d311640 1 --2- 172.21.15.130:0/2958677244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61680b4830 0x7f61680cc2d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f616d311640 1 -- 172.21.15.130:0/2958677244 >> 172.21.15.130:0/2958677244 conn(0x7f6168065990 msgr2=0x7f6168065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:58.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f616d311640 1 -- 172.21.15.130:0/2958677244 shutdown_connections 2023-09-13T06:01:58.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f616d311640 1 -- 172.21.15.130:0/2958677244 wait complete. 2023-09-13T06:01:58.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f616d311640 1 Processor -- start 2023-09-13T06:01:58.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.780+0000 7f616d311640 1 -- start start 2023-09-13T06:01:58.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f616d311640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61680b2750 0x7f616813d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f616d311640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61680b4830 0x7f616814ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f616d311640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6168159900 0x7f616814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f616d311640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616806d640 con 0x7f6168159900 2023-09-13T06:01:58.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f616d311640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616813de20 con 0x7f61680b2750 2023-09-13T06:01:58.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f616d311640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616814fdd0 con 0x7f61680b4830 2023-09-13T06:01:58.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f61677fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6168159900 0x7f616814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f615e7fc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61680b4830 0x7f616814ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61680b2750 0x7f616813d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61680b2750 0x7f616813d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:36200/0 (socket says 172.21.15.130:36200) 2023-09-13T06:01:58.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f6166ffd640 1 -- 172.21.15.130:0/3839462176 learned_addr learned my addr 172.21.15.130:0/3839462176 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:58.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f61677fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6168159900 0x7f616814f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47752/0 (socket says 172.21.15.130:47752) 2023-09-13T06:01:58.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f615e7fc640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61680b4830 0x7f616814ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:51704/0 (socket says 172.21.15.130:51704) 2023-09-13T06:01:58.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f61677fe640 1 -- 172.21.15.130:0/3839462176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61680b4830 msgr2=0x7f616814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f61677fe640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61680b4830 0x7f616814ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f61677fe640 1 -- 172.21.15.130:0/3839462176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61680b2750 msgr2=0x7f616813d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f61677fe640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61680b2750 0x7f616813d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f61677fe640 1 -- 172.21.15.130:0/3839462176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61500094d0 con 0x7f6168159900 2023-09-13T06:01:58.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f6166ffd640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61680b2750 0x7f616813d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:01:58.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f61677fe640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6168159900 0x7f616814f140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6160009e30 tx=0x7f61600075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:58.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f615ffff640 1 -- 172.21.15.130:0/3839462176 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616000add0 con 0x7f6168159900 2023-09-13T06:01:58.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f615ffff640 1 -- 172.21.15.130:0/3839462176 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160010040 con 0x7f6168159900 2023-09-13T06:01:58.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f615ffff640 1 -- 172.21.15.130:0/3839462176 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160003de0 con 0x7f6168159900 2023-09-13T06:01:58.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f616d311640 1 -- 172.21.15.130:0/3839462176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61681500b0 con 0x7f6168159900 2023-09-13T06:01:58.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f616d311640 1 -- 172.21.15.130:0/3839462176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6168150670 con 0x7f6168159900 2023-09-13T06:01:58.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.784+0000 7f616d311640 1 -- 172.21.15.130:0/3839462176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616806d780 con 0x7f6168159900 2023-09-13T06:01:58.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.788+0000 7f615ffff640 1 -- 172.21.15.130:0/3839462176 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6160004030 con 0x7f6168159900 2023-09-13T06:01:58.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.788+0000 7f615ffff640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6148065b50 0x7f6148068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:58.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.788+0000 7f615ffff640 1 -- 172.21.15.130:0/3839462176 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61600832e0 con 0x7f6168159900 2023-09-13T06:01:58.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.788+0000 7f6166ffd640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6148065b50 0x7f6148068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:58.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.788+0000 7f6166ffd640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6148065b50 0x7f6148068010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6158000f70 tx=0x7f6158009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:58.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.792+0000 7f615ffff640 1 -- 172.21.15.130:0/3839462176 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f616806d780 con 0x7f6168159900 2023-09-13T06:01:58.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 -- 172.21.15.130:0/3839462176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f616806d780 con 0x7f6168159900 2023-09-13T06:01:58.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f615ffff640 1 -- 172.21.15.130:0/3839462176 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f616806d780 con 0x7f6168159900 2023-09-13T06:01:58.944 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:01:58.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 -- 172.21.15.130:0/3839462176 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6148065b50 msgr2=0x7f6148068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6148065b50 0x7f6148068010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6158000f70 tx=0x7f6158009040 comp rx=0 tx=0).stop 2023-09-13T06:01:58.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 -- 172.21.15.130:0/3839462176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6168159900 msgr2=0x7f616814f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:58.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6168159900 0x7f616814f140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6160009e30 tx=0x7f61600075c0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 -- 172.21.15.130:0/3839462176 shutdown_connections 2023-09-13T06:01:58.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6148065b50 0x7f6148068010 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6168159900 0x7f616814f140 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61680b4830 0x7f616814ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 --2- 172.21.15.130:0/3839462176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61680b2750 0x7f616813d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:58.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 -- 172.21.15.130:0/3839462176 >> 172.21.15.130:0/3839462176 conn(0x7f6168065990 msgr2=0x7f61680ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:58.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 -- 172.21.15.130:0/3839462176 shutdown_connections 2023-09-13T06:01:58.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:58.940+0000 7f616d311640 1 -- 172.21.15.130:0/3839462176 wait complete. 2023-09-13T06:01:58.964 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:01:59.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.100+0000 7fa77309c640 1 Processor -- start 2023-09-13T06:01:59.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa77309c640 1 -- start start 2023-09-13T06:01:59.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa77309c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76c15a080 0x7fa76c0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa77309c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa76c0b31a0 0x7fa76c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa77309c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c0cc850 con 0x7fa76c15e650 2023-09-13T06:01:59.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa77309c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c0b0330 con 0x7fa76c0b31a0 2023-09-13T06:01:59.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa77309c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0cbcd0 con 0x7fa76c15a080 2023-09-13T06:01:59.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa771639640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa76c0b31a0 0x7fa76c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa763fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa76c15e650 0x7fa76c0b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36124/0 (socket says 172.21.15.130:36124) 2023-09-13T06:01:59.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa763fff640 1 -- 172.21.15.130:0/1841532241 learned_addr learned my addr 172.21.15.130:0/1841532241 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:01:59.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa770e38640 1 --2- 172.21.15.130:0/1841532241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76c15a080 0x7fa76c0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa7637fe640 1 -- 172.21.15.130:0/1841532241 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013588764 0 0) 0x7fa75c001120 con 0x7fa76c15e650 2023-09-13T06:01:59.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa7637fe640 1 -- 172.21.15.130:0/1841532241 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa754003530 con 0x7fa76c15e650 2023-09-13T06:01:59.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa771639640 1 -- 172.21.15.130:0/1841532241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76c15a080 msgr2=0x7fa76c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:59.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa771639640 1 --2- 172.21.15.130:0/1841532241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76c15a080 0x7fa76c0b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa771639640 1 -- 172.21.15.130:0/1841532241 >> v1:172.21.15.130:6789/0 conn(0x7fa76c15e650 legacy=0x7fa76c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.104+0000 7fa771639640 1 -- 172.21.15.130:0/1841532241 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0cbfb0 con 0x7fa76c0b31a0 2023-09-13T06:01:59.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa771639640 1 --2- 172.21.15.130:0/1841532241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa76c0b31a0 0x7fa76c0ccfe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa764009d90 tx=0x7fa76401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d9309060a357e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:59.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa7637fe640 1 -- 172.21.15.130:0/1841532241 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7640a5750 con 0x7fa76c0b31a0 2023-09-13T06:01:59.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa7637fe640 1 -- 172.21.15.130:0/1841532241 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7640a58b0 con 0x7fa76c0b31a0 2023-09-13T06:01:59.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa7637fe640 1 -- 172.21.15.130:0/1841532241 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7640a5c40 con 0x7fa76c0b31a0 2023-09-13T06:01:59.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa77309c640 1 -- 172.21.15.130:0/1841532241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa76c0b31a0 msgr2=0x7fa76c0ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa77309c640 1 --2- 172.21.15.130:0/1841532241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa76c0b31a0 0x7fa76c0ccfe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa764009d90 tx=0x7fa76401c890 comp rx=0 tx=0).stop 2023-09-13T06:01:59.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa77309c640 1 -- 172.21.15.130:0/1841532241 shutdown_connections 2023-09-13T06:01:59.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa77309c640 1 --2- 172.21.15.130:0/1841532241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa76c0b31a0 0x7fa76c0ccfe0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa77309c640 1 --2- 172.21.15.130:0/1841532241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76c15a080 0x7fa76c0b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa77309c640 1 -- 172.21.15.130:0/1841532241 >> 172.21.15.130:0/1841532241 conn(0x7fa76c065990 msgr2=0x7fa76c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:59.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa77309c640 1 -- 172.21.15.130:0/1841532241 shutdown_connections 2023-09-13T06:01:59.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa77309c640 1 -- 172.21.15.130:0/1841532241 wait complete. 2023-09-13T06:01:59.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa77309c640 1 Processor -- start 2023-09-13T06:01:59.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.108+0000 7fa77309c640 1 -- start start 2023-09-13T06:01:59.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa77309c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76c0b31a0 0x7fa76c06db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa77309c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa76c15a080 0x7fa76c06cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa77309c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c15e650 0x7fa76c163180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa77309c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c14f760 con 0x7fa76c15a080 2023-09-13T06:01:59.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa77309c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c1f8830 con 0x7fa76c15e650 2023-09-13T06:01:59.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa77309c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c1f90d0 con 0x7fa76c0b31a0 2023-09-13T06:01:59.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa763fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa76c15a080 0x7fa76c06cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa763fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa76c15a080 0x7fa76c06cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47764/0 (socket says 172.21.15.130:47764) 2023-09-13T06:01:59.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa763fff640 1 -- 172.21.15.130:0/4109511395 learned_addr learned my addr 172.21.15.130:0/4109511395 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:59.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa770e38640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76c0b31a0 0x7fa76c06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa771639640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c15e650 0x7fa76c163180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa763fff640 1 -- 172.21.15.130:0/4109511395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76c0b31a0 msgr2=0x7fa76c06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa763fff640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76c0b31a0 0x7fa76c06db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa763fff640 1 -- 172.21.15.130:0/4109511395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c15e650 msgr2=0x7fa76c163180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa763fff640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c15e650 0x7fa76c163180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa763fff640 1 -- 172.21.15.130:0/4109511395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764009a70 con 0x7fa76c15a080 2023-09-13T06:01:59.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa763fff640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa76c15a080 0x7fa76c06cd90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c730 tx=0x7fa75c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:59.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa7617fa640 1 -- 172.21.15.130:0/4109511395 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c005ac0 con 0x7fa76c15a080 2023-09-13T06:01:59.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa7617fa640 1 -- 172.21.15.130:0/4109511395 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c005c20 con 0x7fa76c15a080 2023-09-13T06:01:59.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa7617fa640 1 -- 172.21.15.130:0/4109511395 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c007070 con 0x7fa76c15a080 2023-09-13T06:01:59.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa77309c640 1 -- 172.21.15.130:0/4109511395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c06e470 con 0x7fa76c15a080 2023-09-13T06:01:59.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa77309c640 1 -- 172.21.15.130:0/4109511395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c1f8d60 con 0x7fa76c15a080 2023-09-13T06:01:59.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.112+0000 7fa77309c640 1 -- 172.21.15.130:0/4109511395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c0618a0 con 0x7fa76c15a080 2023-09-13T06:01:59.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.116+0000 7fa7617fa640 1 -- 172.21.15.130:0/4109511395 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa75c0071f0 con 0x7fa76c15a080 2023-09-13T06:01:59.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.116+0000 7fa7617fa640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa758065b50 0x7fa758068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.116+0000 7fa7617fa640 1 -- 172.21.15.130:0/4109511395 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa75c0826b0 con 0x7fa76c15a080 2023-09-13T06:01:59.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.116+0000 7fa770e38640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa758065b50 0x7fa758068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.116+0000 7fa770e38640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa758065b50 0x7fa758068010 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa768009b60 tx=0x7fa768009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:59.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.120+0000 7fa7617fa640 1 -- 172.21.15.130:0/4109511395 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa75c050010 con 0x7fa76c15a080 2023-09-13T06:01:59.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.268+0000 7fa77309c640 1 -- 172.21.15.130:0/4109511395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa76c0cc850 con 0x7fa76c15a080 2023-09-13T06:01:59.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.268+0000 7fa7617fa640 1 -- 172.21.15.130:0/4109511395 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa76c0cc850 con 0x7fa76c15a080 2023-09-13T06:01:59.273 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:01:59.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.268+0000 7fa77309c640 1 -- 172.21.15.130:0/4109511395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa758065b50 msgr2=0x7fa758068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.268+0000 7fa77309c640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa758065b50 0x7fa758068010 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa768009b60 tx=0x7fa768009190 comp rx=0 tx=0).stop 2023-09-13T06:01:59.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.268+0000 7fa77309c640 1 -- 172.21.15.130:0/4109511395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa76c15a080 msgr2=0x7fa76c06cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.268+0000 7fa77309c640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa76c15a080 0x7fa76c06cd90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c730 tx=0x7fa75c00cbf0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.272+0000 7fa77309c640 1 -- 172.21.15.130:0/4109511395 shutdown_connections 2023-09-13T06:01:59.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.272+0000 7fa77309c640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa758065b50 0x7fa758068010 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.272+0000 7fa77309c640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c15e650 0x7fa76c163180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.272+0000 7fa77309c640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa76c15a080 0x7fa76c06cd90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.272+0000 7fa77309c640 1 --2- 172.21.15.130:0/4109511395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76c0b31a0 0x7fa76c06db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.272+0000 7fa77309c640 1 -- 172.21.15.130:0/4109511395 >> 172.21.15.130:0/4109511395 conn(0x7fa76c065990 msgr2=0x7fa76c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:59.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.272+0000 7fa77309c640 1 -- 172.21.15.130:0/4109511395 shutdown_connections 2023-09-13T06:01:59.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.272+0000 7fa77309c640 1 -- 172.21.15.130:0/4109511395 wait complete. 2023-09-13T06:01:59.293 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:01:59.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.428+0000 7f08590d8640 1 Processor -- start 2023-09-13T06:01:59.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f08590d8640 1 -- start start 2023-09-13T06:01:59.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f08590d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0854157b30 0x7f0854160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f08590d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085406e010 con 0x7f085406dba0 2023-09-13T06:01:59.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f08590d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0854161e60 con 0x7f0854157750 2023-09-13T06:01:59.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f08590d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08540ae0d0 con 0x7f0854157b30 2023-09-13T06:01:59.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f085259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0854157b30 0x7f0854160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f085259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0854157b30 0x7f0854160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47776/0 (socket says 172.21.15.130:47776) 2023-09-13T06:01:59.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f085259c640 1 -- 172.21.15.130:0/678868140 learned_addr learned my addr 172.21.15.130:0/678868140 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:59.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f085359e640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f085406dba0 0x7f085415e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36130/0 (socket says 172.21.15.130:36130) 2023-09-13T06:01:59.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f085259c640 1 -- 172.21.15.130:0/678868140 >> v1:172.21.15.164:6789/0 conn(0x7f0854157750 legacy=0x7f085406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f085259c640 1 -- 172.21.15.130:0/678868140 >> v1:172.21.15.130:6789/0 conn(0x7f085406dba0 legacy=0x7f085415e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.432+0000 7f085259c640 1 -- 172.21.15.130:0/678868140 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08541615c0 con 0x7f0854157b30 2023-09-13T06:01:59.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f085259c640 1 --2- 172.21.15.130:0/678868140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0854157b30 0x7f0854160fe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0848009870 tx=0x7f084801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2496d37bc49167 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:59.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f0851d9b640 1 -- 172.21.15.130:0/678868140 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480aa670 con 0x7f0854157b30 2023-09-13T06:01:59.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f0851d9b640 1 -- 172.21.15.130:0/678868140 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480aa7d0 con 0x7f0854157b30 2023-09-13T06:01:59.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f0851d9b640 1 -- 172.21.15.130:0/678868140 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480aab60 con 0x7f0854157b30 2023-09-13T06:01:59.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f08590d8640 1 -- 172.21.15.130:0/678868140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0854157b30 msgr2=0x7f0854160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f08590d8640 1 --2- 172.21.15.130:0/678868140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0854157b30 0x7f0854160fe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0848009870 tx=0x7f084801c510 comp rx=0 tx=0).stop 2023-09-13T06:01:59.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f08590d8640 1 -- 172.21.15.130:0/678868140 shutdown_connections 2023-09-13T06:01:59.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f08590d8640 1 --2- 172.21.15.130:0/678868140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0854157b30 0x7f0854160fe0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f08590d8640 1 -- 172.21.15.130:0/678868140 >> 172.21.15.130:0/678868140 conn(0x7f0854065d60 msgr2=0x7f08540b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:59.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f08590d8640 1 -- 172.21.15.130:0/678868140 shutdown_connections 2023-09-13T06:01:59.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f08590d8640 1 -- 172.21.15.130:0/678868140 wait complete. 2023-09-13T06:01:59.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f08590d8640 1 Processor -- start 2023-09-13T06:01:59.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.436+0000 7f08590d8640 1 -- start start 2023-09-13T06:01:59.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f08590d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085406dba0 0x7f08541463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f08590d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0854157750 0x7f085414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f08590d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0854157b30 0x7f085415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f08590d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08540b0430 con 0x7f0854157750 2023-09-13T06:01:59.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f08590d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08540b0f30 con 0x7f085406dba0 2023-09-13T06:01:59.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f08590d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08540b0690 con 0x7f0854157b30 2023-09-13T06:01:59.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f085259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0854157750 0x7f085414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f085259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0854157750 0x7f085414e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47782/0 (socket says 172.21.15.130:47782) 2023-09-13T06:01:59.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f085259c640 1 -- 172.21.15.130:0/1781925539 learned_addr learned my addr 172.21.15.130:0/1781925539 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:59.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f0852d9d640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085406dba0 0x7f08541463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f085259c640 1 -- 172.21.15.130:0/1781925539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0854157b30 msgr2=0x7f085415eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f085259c640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0854157b30 0x7f085415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f085259c640 1 -- 172.21.15.130:0/1781925539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085406dba0 msgr2=0x7f08541463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f085259c640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085406dba0 0x7f08541463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f085259c640 1 -- 172.21.15.130:0/1781925539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480094d0 con 0x7f0854157750 2023-09-13T06:01:59.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f0852d9d640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085406dba0 0x7f08541463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:01:59.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f085259c640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0854157750 0x7f085414e760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0848019120 tx=0x7f084801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:59.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f083b7fe640 1 -- 172.21.15.130:0/1781925539 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480b3800 con 0x7f0854157750 2023-09-13T06:01:59.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f083b7fe640 1 -- 172.21.15.130:0/1781925539 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480b3980 con 0x7f0854157750 2023-09-13T06:01:59.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f08590d8640 1 -- 172.21.15.130:0/1781925539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085406fa00 con 0x7f0854157750 2023-09-13T06:01:59.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f083b7fe640 1 -- 172.21.15.130:0/1781925539 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480b3d30 con 0x7f0854157750 2023-09-13T06:01:59.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f08590d8640 1 -- 172.21.15.130:0/1781925539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08540b0c50 con 0x7f0854157750 2023-09-13T06:01:59.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.440+0000 7f08590d8640 1 -- 172.21.15.130:0/1781925539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08541503e0 con 0x7f0854157750 2023-09-13T06:01:59.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.444+0000 7f083b7fe640 1 -- 172.21.15.130:0/1781925539 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f08480b2380 con 0x7f0854157750 2023-09-13T06:01:59.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.444+0000 7f083b7fe640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0840065b20 0x7f0840067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.444+0000 7f083b7fe640 1 -- 172.21.15.130:0/1781925539 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f084811dbd0 con 0x7f0854157750 2023-09-13T06:01:59.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.444+0000 7f0852d9d640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0840065b20 0x7f0840067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.444+0000 7f0852d9d640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0840065b20 0x7f0840067fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0844000f70 tx=0x7f0844009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:59.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.448+0000 7f083b7fe640 1 -- 172.21.15.130:0/1781925539 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f08541503e0 con 0x7f0854157750 2023-09-13T06:01:59.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.592+0000 7f08590d8640 1 -- 172.21.15.130:0/1781925539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08541503e0 con 0x7f0854157750 2023-09-13T06:01:59.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f083b7fe640 1 -- 172.21.15.130:0/1781925539 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08541503e0 con 0x7f0854157750 2023-09-13T06:01:59.599 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:01:59.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 -- 172.21.15.130:0/1781925539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0840065b20 msgr2=0x7f0840067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0840065b20 0x7f0840067fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0844000f70 tx=0x7f0844009040 comp rx=0 tx=0).stop 2023-09-13T06:01:59.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 -- 172.21.15.130:0/1781925539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0854157750 msgr2=0x7f085414e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0854157750 0x7f085414e760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0848019120 tx=0x7f084801ad50 comp rx=0 tx=0).stop 2023-09-13T06:01:59.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 -- 172.21.15.130:0/1781925539 shutdown_connections 2023-09-13T06:01:59.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0840065b20 0x7f0840067fe0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0854157b30 0x7f085415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0854157750 0x7f085414e760 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 --2- 172.21.15.130:0/1781925539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085406dba0 0x7f08541463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 -- 172.21.15.130:0/1781925539 >> 172.21.15.130:0/1781925539 conn(0x7f0854065d60 msgr2=0x7f085406fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:59.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 -- 172.21.15.130:0/1781925539 shutdown_connections 2023-09-13T06:01:59.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.596+0000 7f08590d8640 1 -- 172.21.15.130:0/1781925539 wait complete. 2023-09-13T06:01:59.620 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:01:59.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f228132c640 1 Processor -- start 2023-09-13T06:01:59.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f228132c640 1 -- start start 2023-09-13T06:01:59.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f228132c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f227c159f20 0x7f227c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f228132c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f227c0cdfc0 0x7f227c0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f228132c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f227c0b1610 0x7f227c0b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f228132c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c0b00f0 con 0x7f227c0cdfc0 2023-09-13T06:01:59.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f228132c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c0b11d0 con 0x7f227c159f20 2023-09-13T06:01:59.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f228132c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c0b1fc0 con 0x7f227c0b1610 2023-09-13T06:01:59.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f22727fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f227c0cdfc0 0x7f227c0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f22727fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f227c0cdfc0 0x7f227c0b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47784/0 (socket says 172.21.15.130:47784) 2023-09-13T06:01:59.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f22727fc640 1 -- 172.21.15.130:0/3754575701 learned_addr learned my addr 172.21.15.130:0/3754575701 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:59.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f227affd640 1 --2- 172.21.15.130:0/3754575701 >> v2:172.21.15.164:3300/0 conn(0x7f227c159f20 0x7f227c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f227b7fe640 1 --2- 172.21.15.130:0/3754575701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f227c0b1610 0x7f227c0b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f22727fc640 1 -- 172.21.15.130:0/3754575701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f227c0b1610 msgr2=0x7f227c0b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:59.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f22727fc640 1 --2- 172.21.15.130:0/3754575701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f227c0b1610 0x7f227c0b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f22727fc640 1 -- 172.21.15.130:0/3754575701 >> v2:172.21.15.164:3300/0 conn(0x7f227c159f20 msgr2=0x7f227c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:01:59.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f22727fc640 1 --2- 172.21.15.130:0/3754575701 >> v2:172.21.15.164:3300/0 conn(0x7f227c159f20 0x7f227c0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.756+0000 7f22727fc640 1 -- 172.21.15.130:0/3754575701 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c0ccfd0 con 0x7f227c0cdfc0 2023-09-13T06:01:59.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f22727fc640 1 --2- 172.21.15.130:0/3754575701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227c0cdfc0 0x7f227c0b0c90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f227c0b2660 tx=0x7f226c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1d0f5aff436663 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:59.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f227a7fc640 1 -- 172.21.15.130:0/3754575701 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c0ac630 con 0x7f227c0cdfc0 2023-09-13T06:01:59.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f227a7fc640 1 -- 172.21.15.130:0/3754575701 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c0ac790 con 0x7f227c0cdfc0 2023-09-13T06:01:59.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f227a7fc640 1 -- 172.21.15.130:0/3754575701 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c0acb20 con 0x7f227c0cdfc0 2023-09-13T06:01:59.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f228132c640 1 -- 172.21.15.130:0/3754575701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227c0cdfc0 msgr2=0x7f227c0b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f228132c640 1 --2- 172.21.15.130:0/3754575701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227c0cdfc0 0x7f227c0b0c90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f227c0b2660 tx=0x7f226c01c500 comp rx=0 tx=0).stop 2023-09-13T06:01:59.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f228132c640 1 -- 172.21.15.130:0/3754575701 shutdown_connections 2023-09-13T06:01:59.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f228132c640 1 --2- 172.21.15.130:0/3754575701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f227c0b1610 0x7f227c0b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f228132c640 1 --2- 172.21.15.130:0/3754575701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227c0cdfc0 0x7f227c0b0c90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f228132c640 1 --2- 172.21.15.130:0/3754575701 >> v2:172.21.15.164:3300/0 conn(0x7f227c159f20 0x7f227c0ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f228132c640 1 -- 172.21.15.130:0/3754575701 >> 172.21.15.130:0/3754575701 conn(0x7f227c065990 msgr2=0x7f227c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:59.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f228132c640 1 -- 172.21.15.130:0/3754575701 shutdown_connections 2023-09-13T06:01:59.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.760+0000 7f228132c640 1 -- 172.21.15.130:0/3754575701 wait complete. 2023-09-13T06:01:59.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f228132c640 1 Processor -- start 2023-09-13T06:01:59.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f228132c640 1 -- start start 2023-09-13T06:01:59.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f228132c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f227c0b1610 0x7f227c150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f228132c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f227c0cdfc0 0x7f227c150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f228132c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227c159f20 0x7f227c14cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f228132c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c151360 con 0x7f227c159f20 2023-09-13T06:01:59.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f228132c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c148900 con 0x7f227c0b1610 2023-09-13T06:01:59.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f228132c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c148be0 con 0x7f227c0cdfc0 2023-09-13T06:01:59.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f227b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227c159f20 0x7f227c14cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f227b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227c159f20 0x7f227c14cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47800/0 (socket says 172.21.15.130:47800) 2023-09-13T06:01:59.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f227b7fe640 1 -- 172.21.15.130:0/2132304755 learned_addr learned my addr 172.21.15.130:0/2132304755 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:01:59.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f227affd640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f227c0b1610 0x7f227c150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f22727fc640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f227c0cdfc0 0x7f227c150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f227b7fe640 1 -- 172.21.15.130:0/2132304755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f227c0cdfc0 msgr2=0x7f227c150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f227b7fe640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f227c0cdfc0 0x7f227c150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f227b7fe640 1 -- 172.21.15.130:0/2132304755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f227c0b1610 msgr2=0x7f227c150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f227b7fe640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f227c0b1610 0x7f227c150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f227b7fe640 1 -- 172.21.15.130:0/2132304755 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c0094d0 con 0x7f227c159f20 2023-09-13T06:01:59.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f227b7fe640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227c159f20 0x7f227c14cc20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2274007cf0 tx=0x7f227400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:59.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f2273fff640 1 -- 172.21.15.130:0/2132304755 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274014420 con 0x7f227c159f20 2023-09-13T06:01:59.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f2273fff640 1 -- 172.21.15.130:0/2132304755 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22740145a0 con 0x7f227c159f20 2023-09-13T06:01:59.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f2273fff640 1 -- 172.21.15.130:0/2132304755 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274014950 con 0x7f227c159f20 2023-09-13T06:01:59.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f228132c640 1 -- 172.21.15.130:0/2132304755 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c152a00 con 0x7f227c159f20 2023-09-13T06:01:59.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.764+0000 7f228132c640 1 -- 172.21.15.130:0/2132304755 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c152f20 con 0x7f227c159f20 2023-09-13T06:01:59.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.768+0000 7f228132c640 1 -- 172.21.15.130:0/2132304755 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c152860 con 0x7f227c159f20 2023-09-13T06:01:59.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.768+0000 7f2273fff640 1 -- 172.21.15.130:0/2132304755 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2274014ab0 con 0x7f227c159f20 2023-09-13T06:01:59.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.768+0000 7f2273fff640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f225c065b20 0x7f225c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:01:59.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.768+0000 7f2273fff640 1 -- 172.21.15.130:0/2132304755 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2274083a00 con 0x7f227c159f20 2023-09-13T06:01:59.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.768+0000 7f227affd640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f225c065b20 0x7f225c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:01:59.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.768+0000 7f227affd640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f225c065b20 0x7f225c067fe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2264009ae0 tx=0x7f2264009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:01:59.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.772+0000 7f2273fff640 1 -- 172.21.15.130:0/2132304755 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f227c152860 con 0x7f227c159f20 2023-09-13T06:01:59.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.928+0000 7f228132c640 1 -- 172.21.15.130:0/2132304755 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f227c152860 con 0x7f227c159f20 2023-09-13T06:01:59.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.928+0000 7f2273fff640 1 -- 172.21.15.130:0/2132304755 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f227c152860 con 0x7f227c159f20 2023-09-13T06:01:59.934 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:01:59.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 -- 172.21.15.130:0/2132304755 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f225c065b20 msgr2=0x7f225c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f225c065b20 0x7f225c067fe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2264009ae0 tx=0x7f2264009190 comp rx=0 tx=0).stop 2023-09-13T06:01:59.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 -- 172.21.15.130:0/2132304755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227c159f20 msgr2=0x7f227c14cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:01:59.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227c159f20 0x7f227c14cc20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2274007cf0 tx=0x7f227400e4b0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 -- 172.21.15.130:0/2132304755 shutdown_connections 2023-09-13T06:01:59.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f225c065b20 0x7f225c067fe0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227c159f20 0x7f227c14cc20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f227c0cdfc0 0x7f227c150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 --2- 172.21.15.130:0/2132304755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f227c0b1610 0x7f227c150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:01:59.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 -- 172.21.15.130:0/2132304755 >> 172.21.15.130:0/2132304755 conn(0x7f227c065990 msgr2=0x7f227c0cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:01:59.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 -- 172.21.15.130:0/2132304755 shutdown_connections 2023-09-13T06:01:59.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:01:59.932+0000 7f228132c640 1 -- 172.21.15.130:0/2132304755 wait complete. 2023-09-13T06:01:59.955 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T06:01:59.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:01:59.957 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-09-13T06:02:00.024 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:02:00.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:00.025 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T06:02:00.045 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:02:00.045 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:00.056 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:02:00.057 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:00.106 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:02:00.106 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:00.158 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:00.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.332+0000 7fa5e7f2c640 1 Processor -- start 2023-09-13T06:02:00.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e7f2c640 1 -- start start 2023-09-13T06:02:00.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e7f2c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa5e015d260 0x7fa5e00b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e7f2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e00ce1a0 0x7fa5e006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e7f2c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e0072310 con 0x7fa5e00afc70 2023-09-13T06:02:00.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e7f2c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e0070e70 con 0x7fa5e015d260 2023-09-13T06:02:00.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e7f2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e0070280 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e5cc8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa5e015d260 0x7fa5e00b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e5cc8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa5e015d260 0x7fa5e00b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47804/0 (socket says 172.21.15.130:47804) 2023-09-13T06:02:00.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e5cc8640 1 -- 172.21.15.130:0/1259281703 learned_addr learned my addr 172.21.15.130:0/1259281703 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:00.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e54c7640 1 --2- 172.21.15.130:0/1259281703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e00ce1a0 0x7fa5e006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e5cc8640 1 -- 172.21.15.130:0/1259281703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e00ce1a0 msgr2=0x7fa5e006d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:00.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e5cc8640 1 --2- 172.21.15.130:0/1259281703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e00ce1a0 0x7fa5e006d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e5cc8640 1 -- 172.21.15.130:0/1259281703 >> v1:172.21.15.164:6789/0 conn(0x7fa5e00afc70 legacy=0x7fa5e0160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.336+0000 7fa5e5cc8640 1 -- 172.21.15.130:0/1259281703 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0070540 con 0x7fa5e015d260 2023-09-13T06:02:00.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e5cc8640 1 --2- 172.21.15.130:0/1259281703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5e015d260 0x7fa5e00b5800 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009870 tx=0x7fa5dc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4da37935197eca server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:00.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e4cc6640 1 -- 172.21.15.130:0/1259281703 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0ab620 con 0x7fa5e015d260 2023-09-13T06:02:00.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e4cc6640 1 -- 172.21.15.130:0/1259281703 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc0ab780 con 0x7fa5e015d260 2023-09-13T06:02:00.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e4cc6640 1 -- 172.21.15.130:0/1259281703 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0abb10 con 0x7fa5e015d260 2023-09-13T06:02:00.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1259281703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5e015d260 msgr2=0x7fa5e00b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e7f2c640 1 --2- 172.21.15.130:0/1259281703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5e015d260 0x7fa5e00b5800 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009870 tx=0x7fa5dc01c510 comp rx=0 tx=0).stop 2023-09-13T06:02:00.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1259281703 shutdown_connections 2023-09-13T06:02:00.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e7f2c640 1 --2- 172.21.15.130:0/1259281703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e00ce1a0 0x7fa5e006d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e7f2c640 1 --2- 172.21.15.130:0/1259281703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5e015d260 0x7fa5e00b5800 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1259281703 >> 172.21.15.130:0/1259281703 conn(0x7fa5e006a2f0 msgr2=0x7fa5e006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:00.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1259281703 shutdown_connections 2023-09-13T06:02:00.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1259281703 wait complete. 2023-09-13T06:02:00.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e7f2c640 1 Processor -- start 2023-09-13T06:02:00.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.340+0000 7fa5e7f2c640 1 -- start start 2023-09-13T06:02:00.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e7f2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e00afc70 0x7fa5e00cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e7f2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5e00ce1a0 0x7fa5e00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e7f2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e015d260 0x7fa5e014f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e7f2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e015e790 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e7f2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e015ea70 con 0x7fa5e015d260 2023-09-13T06:02:00.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e7f2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e015ed50 con 0x7fa5e00afc70 2023-09-13T06:02:00.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e54c7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5e00ce1a0 0x7fa5e00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e54c7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5e00ce1a0 0x7fa5e00b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47816/0 (socket says 172.21.15.130:47816) 2023-09-13T06:02:00.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e54c7640 1 -- 172.21.15.130:0/1375222512 learned_addr learned my addr 172.21.15.130:0/1375222512 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:00.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e5cc8640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e00afc70 0x7fa5e00cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e64c9640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e015d260 0x7fa5e014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e54c7640 1 -- 172.21.15.130:0/1375222512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e00afc70 msgr2=0x7fa5e00cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e54c7640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e00afc70 0x7fa5e00cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e54c7640 1 -- 172.21.15.130:0/1375222512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e015d260 msgr2=0x7fa5e014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e54c7640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e015d260 0x7fa5e014f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e54c7640 1 -- 172.21.15.130:0/1375222512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc0094d0 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e54c7640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5e00ce1a0 0x7fa5e00b4d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000e900 tx=0x7fa5d000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:00.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5d67fc640 1 -- 172.21.15.130:0/1375222512 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0009690 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5d67fc640 1 -- 172.21.15.130:0/1375222512 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d000ca00 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5d67fc640 1 -- 172.21.15.130:0/1375222512 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d000cdb0 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1375222512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e015f030 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1375222512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e015e3b0 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1375222512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e00d1080 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.344+0000 7fa5d67fc640 1 -- 172.21.15.130:0/1375222512 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa5d0013470 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.348+0000 7fa5d67fc640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5c4065b20 0x7fa5c4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.348+0000 7fa5d67fc640 1 -- 172.21.15.130:0/1375222512 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5d00834a0 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.348+0000 7fa5e5cc8640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5c4065b20 0x7fa5c4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.348+0000 7fa5e5cc8640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5c4065b20 0x7fa5c4067fe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0af000 tx=0x7fa5dc0b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:00.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.352+0000 7fa5d67fc640 1 -- 172.21.15.130:0/1375222512 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa5d0050e90 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.500+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1375222512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5e00618a0 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.500+0000 7fa5d67fc640 1 -- 172.21.15.130:0/1375222512 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fa5d00544b0 con 0x7fa5e00ce1a0 2023-09-13T06:02:00.504 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:00.505 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:00.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.500+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1375222512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5c4065b20 msgr2=0x7fa5c4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.500+0000 7fa5e7f2c640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5c4065b20 0x7fa5c4067fe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0af000 tx=0x7fa5dc0b6040 comp rx=0 tx=0).stop 2023-09-13T06:02:00.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.504+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1375222512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5e00ce1a0 msgr2=0x7fa5e00b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.504+0000 7fa5e7f2c640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5e00ce1a0 0x7fa5e00b4d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000e900 tx=0x7fa5d000edc0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.504+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1375222512 shutdown_connections 2023-09-13T06:02:00.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.504+0000 7fa5e7f2c640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5c4065b20 0x7fa5c4067fe0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.504+0000 7fa5e7f2c640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e015d260 0x7fa5e014f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.504+0000 7fa5e7f2c640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5e00ce1a0 0x7fa5e00b4d20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.504+0000 7fa5e7f2c640 1 --2- 172.21.15.130:0/1375222512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e00afc70 0x7fa5e00cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.504+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1375222512 >> 172.21.15.130:0/1375222512 conn(0x7fa5e006a2f0 msgr2=0x7fa5e00b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:00.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.504+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1375222512 shutdown_connections 2023-09-13T06:02:00.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.504+0000 7fa5e7f2c640 1 -- 172.21.15.130:0/1375222512 wait complete. 2023-09-13T06:02:00.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:02:00.527 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:02:00.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.664+0000 7f0f70c48640 1 Processor -- start 2023-09-13T06:02:00.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.664+0000 7f0f70c48640 1 -- start start 2023-09-13T06:02:00.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f70c48640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0f6c0d2cd0 0x7f0f6c1612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f70c48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1617e0 0x7f0f6c0cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f70c48640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c15dd40 con 0x7f0f6c15ae10 2023-09-13T06:02:00.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f70c48640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c15e020 con 0x7f0f6c0d2cd0 2023-09-13T06:02:00.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f70c48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c15e300 con 0x7f0f6c1617e0 2023-09-13T06:02:00.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f63fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0f6c0d2cd0 0x7f0f6c1612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f6ad9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1617e0 0x7f0f6c0cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f63fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0f6c0d2cd0 0x7f0f6c1612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:36256/0 (socket says 172.21.15.130:36256) 2023-09-13T06:02:00.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f63fff640 1 -- 172.21.15.130:0/3328437065 learned_addr learned my addr 172.21.15.130:0/3328437065 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:00.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f6a59c640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0f6c15ae10 0x7f0f6c0d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:54594/0 (socket says 172.21.15.130:54594) 2023-09-13T06:02:00.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f6ad9d640 1 -- 172.21.15.130:0/3328437065 >> v2:172.21.15.164:3300/0 conn(0x7f0f6c0d2cd0 msgr2=0x7f0f6c1612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:00.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f6ad9d640 1 --2- 172.21.15.130:0/3328437065 >> v2:172.21.15.164:3300/0 conn(0x7f0f6c0d2cd0 0x7f0f6c1612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f6ad9d640 1 -- 172.21.15.130:0/3328437065 >> v1:172.21.15.164:6789/0 conn(0x7f0f6c15ae10 legacy=0x7f0f6c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.668+0000 7f0f6ad9d640 1 -- 172.21.15.130:0/3328437065 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c15e5e0 con 0x7f0f6c1617e0 2023-09-13T06:02:00.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f6ad9d640 1 --2- 172.21.15.130:0/3328437065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1617e0 0x7f0f6c0cfd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009d90 tx=0x7f0f6401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8cc29abe45ae10f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:00.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f69d9b640 1 -- 172.21.15.130:0/3328437065 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f640a59a0 con 0x7f0f6c1617e0 2023-09-13T06:02:00.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f69d9b640 1 -- 172.21.15.130:0/3328437065 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f640a5b00 con 0x7f0f6c1617e0 2023-09-13T06:02:00.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f69d9b640 1 -- 172.21.15.130:0/3328437065 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f640a5e90 con 0x7f0f6c1617e0 2023-09-13T06:02:00.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f70c48640 1 -- 172.21.15.130:0/3328437065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1617e0 msgr2=0x7f0f6c0cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f70c48640 1 --2- 172.21.15.130:0/3328437065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1617e0 0x7f0f6c0cfd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009d90 tx=0x7f0f6401c8c0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f70c48640 1 -- 172.21.15.130:0/3328437065 shutdown_connections 2023-09-13T06:02:00.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f70c48640 1 --2- 172.21.15.130:0/3328437065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1617e0 0x7f0f6c0cfd00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f70c48640 1 --2- 172.21.15.130:0/3328437065 >> v2:172.21.15.164:3300/0 conn(0x7f0f6c0d2cd0 0x7f0f6c1612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f70c48640 1 -- 172.21.15.130:0/3328437065 >> 172.21.15.130:0/3328437065 conn(0x7f0f6c065990 msgr2=0x7f0f6c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:00.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f70c48640 1 -- 172.21.15.130:0/3328437065 shutdown_connections 2023-09-13T06:02:00.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f70c48640 1 -- 172.21.15.130:0/3328437065 wait complete. 2023-09-13T06:02:00.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f70c48640 1 Processor -- start 2023-09-13T06:02:00.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.672+0000 7f0f70c48640 1 -- start start 2023-09-13T06:02:00.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f70c48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f6c0d2cd0 0x7f0f6c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f70c48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c15ae10 0x7f0f6c13fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f70c48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1617e0 0x7f0f6c141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f70c48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c141970 con 0x7f0f6c15ae10 2023-09-13T06:02:00.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f70c48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c140230 con 0x7f0f6c0d2cd0 2023-09-13T06:02:00.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f70c48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c140fd0 con 0x7f0f6c1617e0 2023-09-13T06:02:00.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f63fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c15ae10 0x7f0f6c13fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f63fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c15ae10 0x7f0f6c13fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:47822/0 (socket says 172.21.15.130:47822) 2023-09-13T06:02:00.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f63fff640 1 -- 172.21.15.130:0/2897304478 learned_addr learned my addr 172.21.15.130:0/2897304478 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:00.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f6a59c640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f6c0d2cd0 0x7f0f6c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f6ad9d640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1617e0 0x7f0f6c141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f63fff640 1 -- 172.21.15.130:0/2897304478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1617e0 msgr2=0x7f0f6c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f63fff640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1617e0 0x7f0f6c141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f63fff640 1 -- 172.21.15.130:0/2897304478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f6c0d2cd0 msgr2=0x7f0f6c155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f63fff640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f6c0d2cd0 0x7f0f6c155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f63fff640 1 -- 172.21.15.130:0/2897304478 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64009a70 con 0x7f0f6c15ae10 2023-09-13T06:02:00.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f63fff640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c15ae10 0x7f0f6c13fcf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400e890 tx=0x7f0f5400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:00.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f62ffd640 1 -- 172.21.15.130:0/2897304478 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54009620 con 0x7f0f6c15ae10 2023-09-13T06:02:00.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f62ffd640 1 -- 172.21.15.130:0/2897304478 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5400c940 con 0x7f0f6c15ae10 2023-09-13T06:02:00.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f70c48640 1 -- 172.21.15.130:0/2897304478 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c1412b0 con 0x7f0f6c15ae10 2023-09-13T06:02:00.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f62ffd640 1 -- 172.21.15.130:0/2897304478 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400ccf0 con 0x7f0f6c15ae10 2023-09-13T06:02:00.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f70c48640 1 -- 172.21.15.130:0/2897304478 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c1422d0 con 0x7f0f6c15ae10 2023-09-13T06:02:00.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f70c48640 1 -- 172.21.15.130:0/2897304478 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c141ab0 con 0x7f0f6c15ae10 2023-09-13T06:02:00.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.676+0000 7f0f62ffd640 1 -- 172.21.15.130:0/2897304478 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0f54013470 con 0x7f0f6c15ae10 2023-09-13T06:02:00.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.680+0000 7f0f62ffd640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f4c065b20 0x7f0f4c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.680+0000 7f0f62ffd640 1 -- 172.21.15.130:0/2897304478 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f540834c0 con 0x7f0f6c15ae10 2023-09-13T06:02:00.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.680+0000 7f0f6a59c640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f4c065b20 0x7f0f4c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:00.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.680+0000 7f0f6a59c640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f4c065b20 0x7f0f4c067fe0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c000f70 tx=0x7f0f5c007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:00.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.684+0000 7f0f62ffd640 1 -- 172.21.15.130:0/2897304478 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0f6c141ab0 con 0x7f0f6c15ae10 2023-09-13T06:02:00.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 -- 172.21.15.130:0/2897304478 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f6c141ab0 con 0x7f0f6c15ae10 2023-09-13T06:02:00.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f62ffd640 1 -- 172.21.15.130:0/2897304478 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f6c141ab0 con 0x7f0f6c15ae10 2023-09-13T06:02:00.836 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:02:00.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 -- 172.21.15.130:0/2897304478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f4c065b20 msgr2=0x7f0f4c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f4c065b20 0x7f0f4c067fe0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c000f70 tx=0x7f0f5c007c90 comp rx=0 tx=0).stop 2023-09-13T06:02:00.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 -- 172.21.15.130:0/2897304478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c15ae10 msgr2=0x7f0f6c13fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:00.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c15ae10 0x7f0f6c13fcf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400e890 tx=0x7f0f5400ed50 comp rx=0 tx=0).stop 2023-09-13T06:02:00.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 -- 172.21.15.130:0/2897304478 shutdown_connections 2023-09-13T06:02:00.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f4c065b20 0x7f0f4c067fe0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1617e0 0x7f0f6c141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c15ae10 0x7f0f6c13fcf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 --2- 172.21.15.130:0/2897304478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f6c0d2cd0 0x7f0f6c155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:00.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 -- 172.21.15.130:0/2897304478 >> 172.21.15.130:0/2897304478 conn(0x7f0f6c065990 msgr2=0x7f0f6c0d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:00.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 -- 172.21.15.130:0/2897304478 shutdown_connections 2023-09-13T06:02:00.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.832+0000 7f0f70c48640 1 -- 172.21.15.130:0/2897304478 wait complete. 2023-09-13T06:02:00.856 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:02:00.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.992+0000 7ff10b737640 1 Processor -- start 2023-09-13T06:02:00.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.992+0000 7ff10b737640 1 -- start start 2023-09-13T06:02:00.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.992+0000 7ff10b737640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff104157750 0x7ff104160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.992+0000 7ff10b737640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff10406dba0 0x7ff10415e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:00.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.992+0000 7ff10b737640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10406dfe0 con 0x7ff104157b30 2023-09-13T06:02:00.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.992+0000 7ff10b737640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1040ae0d0 con 0x7ff104157750 2023-09-13T06:02:00.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.992+0000 7ff10b737640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff104161e60 con 0x7ff10406dba0 2023-09-13T06:02:00.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.992+0000 7ff1094d3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff104157750 0x7ff104160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.992+0000 7ff1094d3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff104157750 0x7ff104160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41796/0 (socket says 172.21.15.130:41796) 2023-09-13T06:02:01.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.992+0000 7ff1094d3640 1 -- 172.21.15.130:0/3054150237 learned_addr learned my addr 172.21.15.130:0/3054150237 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:01.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff109cd4640 1 --2- 172.21.15.130:0/3054150237 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff10406dba0 0x7ff10415e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff1094d3640 1 -- 172.21.15.130:0/3054150237 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff10406dba0 msgr2=0x7ff10415e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:01.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff1094d3640 1 --2- 172.21.15.130:0/3054150237 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff10406dba0 0x7ff10415e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff1094d3640 1 -- 172.21.15.130:0/3054150237 >> v1:172.21.15.164:6789/0 conn(0x7ff104157b30 legacy=0x7ff10406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff1094d3640 1 -- 172.21.15.130:0/3054150237 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1041615c0 con 0x7ff104157750 2023-09-13T06:02:01.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff109cd4640 1 --2- 172.21.15.130:0/3054150237 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff10406dba0 0x7ff10415e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:01.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff1094d3640 1 --2- 172.21.15.130:0/3054150237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff104157750 0x7ff104160fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff100009870 tx=0x7ff10001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3e59e590072099 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:01.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff0fbfff640 1 -- 172.21.15.130:0/3054150237 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1000ab620 con 0x7ff104157750 2023-09-13T06:02:01.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff0fbfff640 1 -- 172.21.15.130:0/3054150237 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1000ab780 con 0x7ff104157750 2023-09-13T06:02:01.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff0fbfff640 1 -- 172.21.15.130:0/3054150237 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1000abb10 con 0x7ff104157750 2023-09-13T06:02:01.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff10b737640 1 -- 172.21.15.130:0/3054150237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff104157750 msgr2=0x7ff104160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff10b737640 1 --2- 172.21.15.130:0/3054150237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff104157750 0x7ff104160fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff100009870 tx=0x7ff10001c510 comp rx=0 tx=0).stop 2023-09-13T06:02:01.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff10b737640 1 -- 172.21.15.130:0/3054150237 shutdown_connections 2023-09-13T06:02:01.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff10b737640 1 --2- 172.21.15.130:0/3054150237 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff10406dba0 0x7ff10415e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:00.996+0000 7ff10b737640 1 --2- 172.21.15.130:0/3054150237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff104157750 0x7ff104160fe0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff10b737640 1 -- 172.21.15.130:0/3054150237 >> 172.21.15.130:0/3054150237 conn(0x7ff104065d60 msgr2=0x7ff1040b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:01.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff10b737640 1 -- 172.21.15.130:0/3054150237 shutdown_connections 2023-09-13T06:02:01.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff10b737640 1 -- 172.21.15.130:0/3054150237 wait complete. 2023-09-13T06:02:01.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff10b737640 1 Processor -- start 2023-09-13T06:02:01.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff10b737640 1 -- start start 2023-09-13T06:02:01.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff10b737640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff10406dba0 0x7ff104139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff10b737640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff104157750 0x7ff104154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff10b737640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff104157b30 0x7ff1040b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff10b737640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10415f580 con 0x7ff104157750 2023-09-13T06:02:01.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff10b737640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff104139660 con 0x7ff10406dba0 2023-09-13T06:02:01.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff10b737640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1040b0b90 con 0x7ff104157b30 2023-09-13T06:02:01.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff108cd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff104157750 0x7ff104154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff1094d3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff10406dba0 0x7ff104139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff1094d3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff10406dba0 0x7ff104139120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:38928/0 (socket says 172.21.15.130:38928) 2023-09-13T06:02:01.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff1094d3640 1 -- 172.21.15.130:0/3325944406 learned_addr learned my addr 172.21.15.130:0/3325944406 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:01.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff108cd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff104157750 0x7ff104154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41802/0 (socket says 172.21.15.130:41802) 2023-09-13T06:02:01.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff109cd4640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff104157b30 0x7ff1040b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff1094d3640 1 -- 172.21.15.130:0/3325944406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff104157b30 msgr2=0x7ff1040b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff1094d3640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff104157b30 0x7ff1040b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff1094d3640 1 -- 172.21.15.130:0/3325944406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff104157750 msgr2=0x7ff104154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff1094d3640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff104157750 0x7ff104154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff1094d3640 1 -- 172.21.15.130:0/3325944406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1000094d0 con 0x7ff10406dba0 2023-09-13T06:02:01.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff108cd2640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff104157750 0x7ff104154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:01.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff109cd4640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff104157b30 0x7ff1040b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:01.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.000+0000 7ff1094d3640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff10406dba0 0x7ff104139120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff1000ad040 tx=0x7ff10001ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:01.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.004+0000 7ff0f9ffb640 1 -- 172.21.15.130:0/3325944406 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1000be3f0 con 0x7ff10406dba0 2023-09-13T06:02:01.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.004+0000 7ff0f9ffb640 1 -- 172.21.15.130:0/3325944406 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1000be570 con 0x7ff10406dba0 2023-09-13T06:02:01.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.004+0000 7ff0f9ffb640 1 -- 172.21.15.130:0/3325944406 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1000be920 con 0x7ff10406dba0 2023-09-13T06:02:01.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.004+0000 7ff10b737640 1 -- 172.21.15.130:0/3325944406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10406fa00 con 0x7ff10406dba0 2023-09-13T06:02:01.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.004+0000 7ff10b737640 1 -- 172.21.15.130:0/3325944406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10415ef30 con 0x7ff10406dba0 2023-09-13T06:02:01.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.004+0000 7ff10b737640 1 -- 172.21.15.130:0/3325944406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1040618a0 con 0x7ff10406dba0 2023-09-13T06:02:01.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.004+0000 7ff0f9ffb640 1 -- 172.21.15.130:0/3325944406 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff1000c7440 con 0x7ff10406dba0 2023-09-13T06:02:01.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.004+0000 7ff0f9ffb640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff0e8065b20 0x7ff0e8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.004+0000 7ff0f9ffb640 1 -- 172.21.15.130:0/3325944406 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff10011da90 con 0x7ff10406dba0 2023-09-13T06:02:01.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.004+0000 7ff108cd2640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff0e8065b20 0x7ff0e8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.008+0000 7ff108cd2640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff0e8065b20 0x7ff0e8067fe0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff104070780 tx=0x7ff0f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:01.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.008+0000 7ff0f9ffb640 1 -- 172.21.15.130:0/3325944406 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff1000eb480 con 0x7ff10406dba0 2023-09-13T06:02:01.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.156+0000 7ff10b737640 1 -- 172.21.15.130:0/3325944406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff104168150 con 0x7ff10406dba0 2023-09-13T06:02:01.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.156+0000 7ff0f9ffb640 1 -- 172.21.15.130:0/3325944406 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1000eeaa0 con 0x7ff10406dba0 2023-09-13T06:02:01.161 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:02:01.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 -- 172.21.15.130:0/3325944406 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff0e8065b20 msgr2=0x7ff0e8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff0e8065b20 0x7ff0e8067fe0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff104070780 tx=0x7ff0f4009040 comp rx=0 tx=0).stop 2023-09-13T06:02:01.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 -- 172.21.15.130:0/3325944406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff10406dba0 msgr2=0x7ff104139120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff10406dba0 0x7ff104139120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff1000ad040 tx=0x7ff10001ad50 comp rx=0 tx=0).stop 2023-09-13T06:02:01.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 -- 172.21.15.130:0/3325944406 shutdown_connections 2023-09-13T06:02:01.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff0e8065b20 0x7ff0e8067fe0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff104157b30 0x7ff1040b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff104157750 0x7ff104154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 --2- 172.21.15.130:0/3325944406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff10406dba0 0x7ff104139120 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 -- 172.21.15.130:0/3325944406 >> 172.21.15.130:0/3325944406 conn(0x7ff104065d60 msgr2=0x7ff10415b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:01.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 -- 172.21.15.130:0/3325944406 shutdown_connections 2023-09-13T06:02:01.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.160+0000 7ff10b737640 1 -- 172.21.15.130:0/3325944406 wait complete. 2023-09-13T06:02:01.183 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:02:01.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde35ddb640 1 Processor -- start 2023-09-13T06:02:01.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde35ddb640 1 -- start start 2023-09-13T06:02:01.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde35ddb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fde3015a080 0x7fde300b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde35ddb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fde300b31a0 0x7fde300ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde35ddb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde300cc850 con 0x7fde3015e650 2023-09-13T06:02:01.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde35ddb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300b0330 con 0x7fde300b31a0 2023-09-13T06:02:01.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde35ddb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300cbcd0 con 0x7fde3015a080 2023-09-13T06:02:01.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde2ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fde300b31a0 0x7fde300ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde2ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fde300b31a0 0x7fde300ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41818/0 (socket says 172.21.15.130:41818) 2023-09-13T06:02:01.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde2ffff640 1 -- 172.21.15.130:0/3565871053 learned_addr learned my addr 172.21.15.130:0/3565871053 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:01.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde2f7fe640 1 --2- 172.21.15.130:0/3565871053 >> v2:172.21.15.164:3300/0 conn(0x7fde3015a080 0x7fde300b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde2ffff640 1 -- 172.21.15.130:0/3565871053 >> v2:172.21.15.164:3300/0 conn(0x7fde3015a080 msgr2=0x7fde300b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:01.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde2ffff640 1 --2- 172.21.15.130:0/3565871053 >> v2:172.21.15.164:3300/0 conn(0x7fde3015a080 0x7fde300b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde2ffff640 1 -- 172.21.15.130:0/3565871053 >> v1:172.21.15.164:6789/0 conn(0x7fde3015e650 legacy=0x7fde300b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:01.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.320+0000 7fde2ffff640 1 -- 172.21.15.130:0/3565871053 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde300cbfb0 con 0x7fde300b31a0 2023-09-13T06:02:01.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde2ffff640 1 --2- 172.21.15.130:0/3565871053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde300b31a0 0x7fde300ccfe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fde300706b0 tx=0x7fde2801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9659f45c7e0e5e01 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:01.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde2effd640 1 -- 172.21.15.130:0/3565871053 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde280090d0 con 0x7fde300b31a0 2023-09-13T06:02:01.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde2effd640 1 -- 172.21.15.130:0/3565871053 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde28009230 con 0x7fde300b31a0 2023-09-13T06:02:01.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde2effd640 1 -- 172.21.15.130:0/3565871053 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde280a59b0 con 0x7fde300b31a0 2023-09-13T06:02:01.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde35ddb640 1 -- 172.21.15.130:0/3565871053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde300b31a0 msgr2=0x7fde300ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde35ddb640 1 --2- 172.21.15.130:0/3565871053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde300b31a0 0x7fde300ccfe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fde300706b0 tx=0x7fde2801c8d0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde35ddb640 1 -- 172.21.15.130:0/3565871053 shutdown_connections 2023-09-13T06:02:01.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde35ddb640 1 --2- 172.21.15.130:0/3565871053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde300b31a0 0x7fde300ccfe0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde35ddb640 1 --2- 172.21.15.130:0/3565871053 >> v2:172.21.15.164:3300/0 conn(0x7fde3015a080 0x7fde300b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde35ddb640 1 -- 172.21.15.130:0/3565871053 >> 172.21.15.130:0/3565871053 conn(0x7fde30065990 msgr2=0x7fde30065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:01.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde35ddb640 1 -- 172.21.15.130:0/3565871053 shutdown_connections 2023-09-13T06:02:01.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.324+0000 7fde35ddb640 1 -- 172.21.15.130:0/3565871053 wait complete. 2023-09-13T06:02:01.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde35ddb640 1 Processor -- start 2023-09-13T06:02:01.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde35ddb640 1 -- start start 2023-09-13T06:02:01.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde35ddb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde300b31a0 0x7fde3014ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde35ddb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde3015a080 0x7fde301507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde35ddb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde3015e650 0x7fde3006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde35ddb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3015b5f0 con 0x7fde300b31a0 2023-09-13T06:02:01.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde35ddb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3006c830 con 0x7fde3015e650 2023-09-13T06:02:01.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde35ddb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3006cb10 con 0x7fde3015a080 2023-09-13T06:02:01.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde300b31a0 0x7fde3014ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde300b31a0 0x7fde3014ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41830/0 (socket says 172.21.15.130:41830) 2023-09-13T06:02:01.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2f7fe640 1 -- 172.21.15.130:0/2629896012 learned_addr learned my addr 172.21.15.130:0/2629896012 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:01.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde27fff640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde3015a080 0x7fde301507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2ffff640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde3015e650 0x7fde3006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2f7fe640 1 -- 172.21.15.130:0/2629896012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde3015a080 msgr2=0x7fde301507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2f7fe640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde3015a080 0x7fde301507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2f7fe640 1 -- 172.21.15.130:0/2629896012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde3015e650 msgr2=0x7fde3006d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2f7fe640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde3015e650 0x7fde3006d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2f7fe640 1 -- 172.21.15.130:0/2629896012 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28009b30 con 0x7fde300b31a0 2023-09-13T06:02:01.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde27fff640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde3015a080 0x7fde301507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:01.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2f7fe640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde300b31a0 0x7fde3014ee30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fde2000d800 tx=0x7fde2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:01.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2cff9640 1 -- 172.21.15.130:0/2629896012 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000b6c0 con 0x7fde300b31a0 2023-09-13T06:02:01.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2cff9640 1 -- 172.21.15.130:0/2629896012 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2000b820 con 0x7fde300b31a0 2023-09-13T06:02:01.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde2cff9640 1 -- 172.21.15.130:0/2629896012 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000bb90 con 0x7fde300b31a0 2023-09-13T06:02:01.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde35ddb640 1 -- 172.21.15.130:0/2629896012 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3006cdf0 con 0x7fde300b31a0 2023-09-13T06:02:01.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.328+0000 7fde35ddb640 1 -- 172.21.15.130:0/2629896012 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3014f370 con 0x7fde300b31a0 2023-09-13T06:02:01.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.332+0000 7fde35ddb640 1 -- 172.21.15.130:0/2629896012 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3015eae0 con 0x7fde300b31a0 2023-09-13T06:02:01.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.332+0000 7fde2cff9640 1 -- 172.21.15.130:0/2629896012 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fde2000bcf0 con 0x7fde300b31a0 2023-09-13T06:02:01.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.332+0000 7fde2cff9640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde10065b20 0x7fde10067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.332+0000 7fde2cff9640 1 -- 172.21.15.130:0/2629896012 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde20083870 con 0x7fde300b31a0 2023-09-13T06:02:01.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.332+0000 7fde27fff640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde10065b20 0x7fde10067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.332+0000 7fde27fff640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde10065b20 0x7fde10067fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fde300b4c30 tx=0x7fde18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:01.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.336+0000 7fde2cff9640 1 -- 172.21.15.130:0/2629896012 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fde3015eae0 con 0x7fde300b31a0 2023-09-13T06:02:01.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 -- 172.21.15.130:0/2629896012 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde3006cfe0 con 0x7fde300b31a0 2023-09-13T06:02:01.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde2cff9640 1 -- 172.21.15.130:0/2629896012 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde3006cfe0 con 0x7fde300b31a0 2023-09-13T06:02:01.488 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:02:01.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 -- 172.21.15.130:0/2629896012 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde10065b20 msgr2=0x7fde10067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde10065b20 0x7fde10067fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fde300b4c30 tx=0x7fde18008040 comp rx=0 tx=0).stop 2023-09-13T06:02:01.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 -- 172.21.15.130:0/2629896012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde300b31a0 msgr2=0x7fde3014ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde300b31a0 0x7fde3014ee30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fde2000d800 tx=0x7fde2000dcc0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 -- 172.21.15.130:0/2629896012 shutdown_connections 2023-09-13T06:02:01.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde10065b20 0x7fde10067fe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde3015e650 0x7fde3006d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde3015a080 0x7fde301507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 --2- 172.21.15.130:0/2629896012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde300b31a0 0x7fde3014ee30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 -- 172.21.15.130:0/2629896012 >> 172.21.15.130:0/2629896012 conn(0x7fde30065990 msgr2=0x7fde30157720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:01.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 -- 172.21.15.130:0/2629896012 shutdown_connections 2023-09-13T06:02:01.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.484+0000 7fde35ddb640 1 -- 172.21.15.130:0/2629896012 wait complete. 2023-09-13T06:02:01.509 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:02:01.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f779299f640 1 Processor -- start 2023-09-13T06:02:01.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f779299f640 1 -- start start 2023-09-13T06:02:01.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f779299f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f778c159f20 0x7f778c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f779299f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f778c0cdfc0 0x7f778c0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f779299f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778c0ccfd0 con 0x7f778c0b1610 2023-09-13T06:02:01.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f779299f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c0b00f0 con 0x7f778c0cdfc0 2023-09-13T06:02:01.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f779299f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c0b11d0 con 0x7f778c159f20 2023-09-13T06:02:01.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f778b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f778c0cdfc0 0x7f778c0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f778b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f778c0cdfc0 0x7f778c0b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41840/0 (socket says 172.21.15.130:41840) 2023-09-13T06:02:01.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f778b7fe640 1 -- 172.21.15.130:0/1846793666 learned_addr learned my addr 172.21.15.130:0/1846793666 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:01.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f7790f3c640 1 --1- 172.21.15.130:0/1846793666 >> v1:172.21.15.130:6789/0 conn(0x7f778c0b1610 0x7f778c0ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:32796/0 (socket says 172.21.15.130:32796) 2023-09-13T06:02:01.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f778bfff640 1 --2- 172.21.15.130:0/1846793666 >> v2:172.21.15.164:3300/0 conn(0x7f778c159f20 0x7f778c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f778b7fe640 1 -- 172.21.15.130:0/1846793666 >> v2:172.21.15.164:3300/0 conn(0x7f778c159f20 msgr2=0x7f778c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:01.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f778b7fe640 1 --2- 172.21.15.130:0/1846793666 >> v2:172.21.15.164:3300/0 conn(0x7f778c159f20 0x7f778c0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f778b7fe640 1 -- 172.21.15.130:0/1846793666 >> v1:172.21.15.130:6789/0 conn(0x7f778c0b1610 legacy=0x7f778c0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f778b7fe640 1 -- 172.21.15.130:0/1846793666 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c0ced90 con 0x7f778c0cdfc0 2023-09-13T06:02:01.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.648+0000 7f778affd640 1 -- 172.21.15.130:0/1846793666 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27752222 0 0) 0x7f778c0ccfd0 con 0x7f778c0b1610 2023-09-13T06:02:01.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f778b7fe640 1 --2- 172.21.15.130:0/1846793666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778c0cdfc0 0x7f778c0b0c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f778c0b2660 tx=0x7f778001e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5601c99dca6654 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:01.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f778affd640 1 -- 172.21.15.130:0/1846793666 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77800a8650 con 0x7f778c0cdfc0 2023-09-13T06:02:01.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f778affd640 1 -- 172.21.15.130:0/1846793666 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77800a87b0 con 0x7f778c0cdfc0 2023-09-13T06:02:01.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f778affd640 1 -- 172.21.15.130:0/1846793666 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77800a8b40 con 0x7f778c0cdfc0 2023-09-13T06:02:01.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f779299f640 1 -- 172.21.15.130:0/1846793666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778c0cdfc0 msgr2=0x7f778c0b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f779299f640 1 --2- 172.21.15.130:0/1846793666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778c0cdfc0 0x7f778c0b0c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f778c0b2660 tx=0x7f778001e680 comp rx=0 tx=0).stop 2023-09-13T06:02:01.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f779299f640 1 -- 172.21.15.130:0/1846793666 shutdown_connections 2023-09-13T06:02:01.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f779299f640 1 --2- 172.21.15.130:0/1846793666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778c0cdfc0 0x7f778c0b0c90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f779299f640 1 --2- 172.21.15.130:0/1846793666 >> v2:172.21.15.164:3300/0 conn(0x7f778c159f20 0x7f778c0ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f779299f640 1 -- 172.21.15.130:0/1846793666 >> 172.21.15.130:0/1846793666 conn(0x7f778c065990 msgr2=0x7f778c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:01.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f779299f640 1 -- 172.21.15.130:0/1846793666 shutdown_connections 2023-09-13T06:02:01.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f779299f640 1 -- 172.21.15.130:0/1846793666 wait complete. 2023-09-13T06:02:01.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.652+0000 7f779299f640 1 Processor -- start 2023-09-13T06:02:01.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f779299f640 1 -- start start 2023-09-13T06:02:01.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f779299f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f778c0b1610 0x7f778c13a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f779299f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778c0cdfc0 0x7f778c06bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f779299f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f778c159f20 0x7f778c06c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f779299f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c13a720 con 0x7f778c0cdfc0 2023-09-13T06:02:01.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f779299f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c158f90 con 0x7f778c0b1610 2023-09-13T06:02:01.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f779299f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c13a9d0 con 0x7f778c159f20 2023-09-13T06:02:01.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f778b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778c0cdfc0 0x7f778c06bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f778b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778c0cdfc0 0x7f778c06bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41856/0 (socket says 172.21.15.130:41856) 2023-09-13T06:02:01.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f778b7fe640 1 -- 172.21.15.130:0/2679307922 learned_addr learned my addr 172.21.15.130:0/2679307922 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:01.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f778bfff640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f778c0b1610 0x7f778c13a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f7790f3c640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f778c159f20 0x7f778c06c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f778b7fe640 1 -- 172.21.15.130:0/2679307922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f778c159f20 msgr2=0x7f778c06c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f778b7fe640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f778c159f20 0x7f778c06c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f778b7fe640 1 -- 172.21.15.130:0/2679307922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f778c0b1610 msgr2=0x7f778c13a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f778b7fe640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f778c0b1610 0x7f778c13a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f778b7fe640 1 -- 172.21.15.130:0/2679307922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77800094d0 con 0x7f778c0cdfc0 2023-09-13T06:02:01.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f778b7fe640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778c0cdfc0 0x7f778c06bb10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f778001b290 tx=0x7f778001b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:01.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f7788ff9640 1 -- 172.21.15.130:0/2679307922 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77800bc640 con 0x7f778c0cdfc0 2023-09-13T06:02:01.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f7788ff9640 1 -- 172.21.15.130:0/2679307922 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77800bc7a0 con 0x7f778c0cdfc0 2023-09-13T06:02:01.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f7788ff9640 1 -- 172.21.15.130:0/2679307922 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77800bcb10 con 0x7f778c0cdfc0 2023-09-13T06:02:01.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f779299f640 1 -- 172.21.15.130:0/2679307922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c13acb0 con 0x7f778c0cdfc0 2023-09-13T06:02:01.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f779299f640 1 -- 172.21.15.130:0/2679307922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c13b270 con 0x7f778c0cdfc0 2023-09-13T06:02:01.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.656+0000 7f779299f640 1 -- 172.21.15.130:0/2679307922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778c13b460 con 0x7f778c0cdfc0 2023-09-13T06:02:01.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.660+0000 7f7788ff9640 1 -- 172.21.15.130:0/2679307922 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f77800c5430 con 0x7f778c0cdfc0 2023-09-13T06:02:01.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.660+0000 7f7788ff9640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7778065b20 0x7f7778067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:01.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.660+0000 7f7788ff9640 1 -- 172.21.15.130:0/2679307922 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f778011fdf0 con 0x7f778c0cdfc0 2023-09-13T06:02:01.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.660+0000 7f778bfff640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7778065b20 0x7f7778067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:01.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.660+0000 7f778bfff640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7778065b20 0x7f7778067fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f777c009ac0 tx=0x7f777c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:01.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.664+0000 7f7788ff9640 1 -- 172.21.15.130:0/2679307922 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f77800ed8f0 con 0x7f778c0cdfc0 2023-09-13T06:02:01.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.824+0000 7f779299f640 1 -- 172.21.15.130:0/2679307922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f778c0618a0 con 0x7f778c0cdfc0 2023-09-13T06:02:01.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.824+0000 7f7788ff9640 1 -- 172.21.15.130:0/2679307922 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f77800f0f10 con 0x7f778c0cdfc0 2023-09-13T06:02:01.830 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:02:01.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 -- 172.21.15.130:0/2679307922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7778065b20 msgr2=0x7f7778067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7778065b20 0x7f7778067fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f777c009ac0 tx=0x7f777c009190 comp rx=0 tx=0).stop 2023-09-13T06:02:01.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 -- 172.21.15.130:0/2679307922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778c0cdfc0 msgr2=0x7f778c06bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:01.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778c0cdfc0 0x7f778c06bb10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f778001b290 tx=0x7f778001b420 comp rx=0 tx=0).stop 2023-09-13T06:02:01.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 -- 172.21.15.130:0/2679307922 shutdown_connections 2023-09-13T06:02:01.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7778065b20 0x7f7778067fe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f778c159f20 0x7f778c06c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f778c0cdfc0 0x7f778c06bb10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 --2- 172.21.15.130:0/2679307922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f778c0b1610 0x7f778c13a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:01.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 -- 172.21.15.130:0/2679307922 >> 172.21.15.130:0/2679307922 conn(0x7f778c065990 msgr2=0x7f778c1538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:01.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 -- 172.21.15.130:0/2679307922 shutdown_connections 2023-09-13T06:02:01.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:01.828+0000 7f779299f640 1 -- 172.21.15.130:0/2679307922 wait complete. 2023-09-13T06:02:01.851 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-09-13T06:02:01.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:01.852 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-09-13T06:02:01.906 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:02:01.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:01.907 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-13T06:02:01.917 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:02:01.917 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:01.928 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:02:01.928 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:01.979 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:02:01.980 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:02.031 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:02.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.164+0000 7f7d35ad8640 1 Processor -- start 2023-09-13T06:02:02.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.164+0000 7f7d35ad8640 1 -- start start 2023-09-13T06:02:02.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.164+0000 7f7d35ad8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7d30159f20 0x7f7d300ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.164+0000 7f7d35ad8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d300b1d20 0x7f7d300b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.164+0000 7f7d35ad8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d300ccfd0 con 0x7f7d300cdfc0 2023-09-13T06:02:02.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d35ad8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d300b00f0 con 0x7f7d300b1d20 2023-09-13T06:02:02.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d35ad8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d300b11d0 con 0x7f7d30159f20 2023-09-13T06:02:02.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d300b1d20 0x7f7d300b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d300b1d20 0x7f7d300b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41858/0 (socket says 172.21.15.130:41858) 2023-09-13T06:02:02.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2ffff640 1 -- 172.21.15.130:0/1692348946 learned_addr learned my addr 172.21.15.130:0/1692348946 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:02.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2f7fe640 1 --2- 172.21.15.130:0/1692348946 >> v2:172.21.15.164:3300/0 conn(0x7f7d30159f20 0x7f7d300ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2ffff640 1 -- 172.21.15.130:0/1692348946 >> v2:172.21.15.164:3300/0 conn(0x7f7d30159f20 msgr2=0x7f7d300ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:02.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2ffff640 1 --2- 172.21.15.130:0/1692348946 >> v2:172.21.15.164:3300/0 conn(0x7f7d30159f20 0x7f7d300ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2ffff640 1 -- 172.21.15.130:0/1692348946 >> v1:172.21.15.164:6789/0 conn(0x7f7d300cdfc0 legacy=0x7f7d300b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2ffff640 1 -- 172.21.15.130:0/1692348946 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d300ced90 con 0x7f7d300b1d20 2023-09-13T06:02:02.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2ffff640 1 --2- 172.21.15.130:0/1692348946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d300b1d20 0x7f7d300b0c90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7d300b2660 tx=0x7f7d2801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b64dc5a87ea5f69 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:02.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2effd640 1 -- 172.21.15.130:0/1692348946 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280a5860 con 0x7f7d300b1d20 2023-09-13T06:02:02.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2effd640 1 -- 172.21.15.130:0/1692348946 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d280a59c0 con 0x7f7d300b1d20 2023-09-13T06:02:02.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.168+0000 7f7d2effd640 1 -- 172.21.15.130:0/1692348946 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280a5d50 con 0x7f7d300b1d20 2023-09-13T06:02:02.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 -- 172.21.15.130:0/1692348946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d300b1d20 msgr2=0x7f7d300b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 --2- 172.21.15.130:0/1692348946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d300b1d20 0x7f7d300b0c90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7d300b2660 tx=0x7f7d2801c9a0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 -- 172.21.15.130:0/1692348946 shutdown_connections 2023-09-13T06:02:02.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 --2- 172.21.15.130:0/1692348946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d300b1d20 0x7f7d300b0c90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 --2- 172.21.15.130:0/1692348946 >> v2:172.21.15.164:3300/0 conn(0x7f7d30159f20 0x7f7d300ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 -- 172.21.15.130:0/1692348946 >> 172.21.15.130:0/1692348946 conn(0x7f7d30065990 msgr2=0x7f7d30065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:02.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 -- 172.21.15.130:0/1692348946 shutdown_connections 2023-09-13T06:02:02.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 -- 172.21.15.130:0/1692348946 wait complete. 2023-09-13T06:02:02.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 Processor -- start 2023-09-13T06:02:02.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 -- start start 2023-09-13T06:02:02.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d300b1d20 0x7f7d30145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d300cdfc0 0x7f7d300cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30159f20 0x7f7d300cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30145ed0 con 0x7f7d30159f20 2023-09-13T06:02:02.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300ab150 con 0x7f7d300cdfc0 2023-09-13T06:02:02.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d35ad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300ab430 con 0x7f7d300b1d20 2023-09-13T06:02:02.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30159f20 0x7f7d300cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30159f20 0x7f7d300cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41872/0 (socket says 172.21.15.130:41872) 2023-09-13T06:02:02.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d2ffff640 1 -- 172.21.15.130:0/2737343845 learned_addr learned my addr 172.21.15.130:0/2737343845 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:02.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d27fff640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d300cdfc0 0x7f7d300cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.172+0000 7f7d2f7fe640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d300b1d20 0x7f7d30145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d2ffff640 1 -- 172.21.15.130:0/2737343845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d300b1d20 msgr2=0x7f7d30145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d2ffff640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d300b1d20 0x7f7d30145990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d2ffff640 1 -- 172.21.15.130:0/2737343845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d300cdfc0 msgr2=0x7f7d300cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d2ffff640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d300cdfc0 0x7f7d300cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d2ffff640 1 -- 172.21.15.130:0/2737343845 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28009b30 con 0x7f7d30159f20 2023-09-13T06:02:02.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d2ffff640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30159f20 0x7f7d300cf480 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7d280af040 tx=0x7f7d28019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:02.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d2cff9640 1 -- 172.21.15.130:0/2737343845 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280b8670 con 0x7f7d30159f20 2023-09-13T06:02:02.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d2cff9640 1 -- 172.21.15.130:0/2737343845 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d280b87d0 con 0x7f7d30159f20 2023-09-13T06:02:02.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d2cff9640 1 -- 172.21.15.130:0/2737343845 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280b8b60 con 0x7f7d30159f20 2023-09-13T06:02:02.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d35ad8640 1 -- 172.21.15.130:0/2737343845 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d300ab710 con 0x7f7d30159f20 2023-09-13T06:02:02.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d35ad8640 1 -- 172.21.15.130:0/2737343845 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d301eebe0 con 0x7f7d30159f20 2023-09-13T06:02:02.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d35ad8640 1 -- 172.21.15.130:0/2737343845 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d300618a0 con 0x7f7d30159f20 2023-09-13T06:02:02.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.176+0000 7f7d2cff9640 1 -- 172.21.15.130:0/2737343845 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7d280b8cc0 con 0x7f7d30159f20 2023-09-13T06:02:02.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.180+0000 7f7d2cff9640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d10065b20 0x7f7d10067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.180+0000 7f7d2cff9640 1 -- 172.21.15.130:0/2737343845 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d2811e8d0 con 0x7f7d30159f20 2023-09-13T06:02:02.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.180+0000 7f7d2f7fe640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d10065b20 0x7f7d10067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.180+0000 7f7d2f7fe640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d10065b20 0x7f7d10067fe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7d300cb1f0 tx=0x7f7d20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:02.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.184+0000 7f7d2cff9640 1 -- 172.21.15.130:0/2737343845 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7d280ec2f0 con 0x7f7d30159f20 2023-09-13T06:02:02.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 -- 172.21.15.130:0/2737343845 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d300b08b0 con 0x7f7d30159f20 2023-09-13T06:02:02.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d2cff9640 1 -- 172.21.15.130:0/2737343845 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f7d280ef910 con 0x7f7d30159f20 2023-09-13T06:02:02.336 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:02.336 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:02.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 -- 172.21.15.130:0/2737343845 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d10065b20 msgr2=0x7f7d10067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d10065b20 0x7f7d10067fe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7d300cb1f0 tx=0x7f7d20008040 comp rx=0 tx=0).stop 2023-09-13T06:02:02.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 -- 172.21.15.130:0/2737343845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30159f20 msgr2=0x7f7d300cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30159f20 0x7f7d300cf480 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7d280af040 tx=0x7f7d28019740 comp rx=0 tx=0).stop 2023-09-13T06:02:02.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 -- 172.21.15.130:0/2737343845 shutdown_connections 2023-09-13T06:02:02.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d10065b20 0x7f7d10067fe0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d300cdfc0 0x7f7d300cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30159f20 0x7f7d300cf480 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 --2- 172.21.15.130:0/2737343845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d300b1d20 0x7f7d30145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 -- 172.21.15.130:0/2737343845 >> 172.21.15.130:0/2737343845 conn(0x7f7d30065990 msgr2=0x7f7d30070900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:02.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 -- 172.21.15.130:0/2737343845 shutdown_connections 2023-09-13T06:02:02.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.332+0000 7f7d35ad8640 1 -- 172.21.15.130:0/2737343845 wait complete. 2023-09-13T06:02:02.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:02:02.359 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:02:02.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff7535fa640 1 Processor -- start 2023-09-13T06:02:02.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff7535fa640 1 -- start start 2023-09-13T06:02:02.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff7535fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff74c0b08a0 0x7ff74c0acf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff7535fa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff74c0b2c30 0x7ff74c0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff7535fa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c15e800 con 0x7ff74c0b1990 2023-09-13T06:02:02.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff7535fa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c0b2330 con 0x7ff74c0b2c30 2023-09-13T06:02:02.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff7535fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c15d990 con 0x7ff74c0b08a0 2023-09-13T06:02:02.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff751b97640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff74c0b2c30 0x7ff74c0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff751b97640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff74c0b2c30 0x7ff74c0b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41876/0 (socket says 172.21.15.130:41876) 2023-09-13T06:02:02.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff751b97640 1 -- 172.21.15.130:0/4202903352 learned_addr learned my addr 172.21.15.130:0/4202903352 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:02.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff751396640 1 --2- 172.21.15.130:0/4202903352 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff74c0b08a0 0x7ff74c0acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff751b97640 1 -- 172.21.15.130:0/4202903352 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff74c0b08a0 msgr2=0x7ff74c0acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:02.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff751b97640 1 --2- 172.21.15.130:0/4202903352 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff74c0b08a0 0x7ff74c0acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff751b97640 1 -- 172.21.15.130:0/4202903352 >> v1:172.21.15.164:6789/0 conn(0x7ff74c0b1990 legacy=0x7ff74c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:02.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff751b97640 1 -- 172.21.15.130:0/4202903352 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c15dbf0 con 0x7ff74c0b2c30 2023-09-13T06:02:02.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.496+0000 7ff751396640 1 --2- 172.21.15.130:0/4202903352 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff74c0b08a0 0x7ff74c0acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:02.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff751b97640 1 --2- 172.21.15.130:0/4202903352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff74c0b2c30 0x7ff74c0b1df0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff744009e50 tx=0x7ff74401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f15290f7022872b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:02.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff743fff640 1 -- 172.21.15.130:0/4202903352 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7440a5820 con 0x7ff74c0b2c30 2023-09-13T06:02:02.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff743fff640 1 -- 172.21.15.130:0/4202903352 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7440a5980 con 0x7ff74c0b2c30 2023-09-13T06:02:02.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff743fff640 1 -- 172.21.15.130:0/4202903352 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7440a5d10 con 0x7ff74c0b2c30 2023-09-13T06:02:02.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff7535fa640 1 -- 172.21.15.130:0/4202903352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff74c0b2c30 msgr2=0x7ff74c0b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff7535fa640 1 --2- 172.21.15.130:0/4202903352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff74c0b2c30 0x7ff74c0b1df0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff744009e50 tx=0x7ff74401c9a0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff7535fa640 1 -- 172.21.15.130:0/4202903352 shutdown_connections 2023-09-13T06:02:02.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff7535fa640 1 --2- 172.21.15.130:0/4202903352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff74c0b2c30 0x7ff74c0b1df0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff7535fa640 1 --2- 172.21.15.130:0/4202903352 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff74c0b08a0 0x7ff74c0acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff7535fa640 1 -- 172.21.15.130:0/4202903352 >> 172.21.15.130:0/4202903352 conn(0x7ff74c065990 msgr2=0x7ff74c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:02.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff7535fa640 1 -- 172.21.15.130:0/4202903352 shutdown_connections 2023-09-13T06:02:02.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.500+0000 7ff7535fa640 1 -- 172.21.15.130:0/4202903352 wait complete. 2023-09-13T06:02:02.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff7535fa640 1 Processor -- start 2023-09-13T06:02:02.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff7535fa640 1 -- start start 2023-09-13T06:02:02.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff7535fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff74c0b08a0 0x7ff74c14f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff7535fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff74c0b1990 0x7ff74c15f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff7535fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff74c0b2c30 0x7ff74c15fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff7535fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c1549a0 con 0x7ff74c0b1990 2023-09-13T06:02:02.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff7535fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c154100 con 0x7ff74c0b08a0 2023-09-13T06:02:02.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff7535fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c1543e0 con 0x7ff74c0b2c30 2023-09-13T06:02:02.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff750b95640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff74c0b1990 0x7ff74c15f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff750b95640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff74c0b1990 0x7ff74c15f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41892/0 (socket says 172.21.15.130:41892) 2023-09-13T06:02:02.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff750b95640 1 -- 172.21.15.130:0/2476709851 learned_addr learned my addr 172.21.15.130:0/2476709851 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:02.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff751396640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff74c0b08a0 0x7ff74c14f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff751b97640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff74c0b2c30 0x7ff74c15fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff750b95640 1 -- 172.21.15.130:0/2476709851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff74c0b2c30 msgr2=0x7ff74c15fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff750b95640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff74c0b2c30 0x7ff74c15fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff750b95640 1 -- 172.21.15.130:0/2476709851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff74c0b08a0 msgr2=0x7ff74c14f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff750b95640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff74c0b08a0 0x7ff74c14f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff750b95640 1 -- 172.21.15.130:0/2476709851 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff744009b30 con 0x7ff74c0b1990 2023-09-13T06:02:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff751396640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff74c0b08a0 0x7ff74c14f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff750b95640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff74c0b1990 0x7ff74c15f710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c450 tx=0x7ff73c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff741ffb640 1 -- 172.21.15.130:0/2476709851 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c012830 con 0x7ff74c0b1990 2023-09-13T06:02:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff741ffb640 1 -- 172.21.15.130:0/2476709851 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c0129b0 con 0x7ff74c0b1990 2023-09-13T06:02:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff741ffb640 1 -- 172.21.15.130:0/2476709851 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c012d60 con 0x7ff74c0b1990 2023-09-13T06:02:02.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff7535fa640 1 -- 172.21.15.130:0/2476709851 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74c1546c0 con 0x7ff74c0b1990 2023-09-13T06:02:02.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.504+0000 7ff7535fa640 1 -- 172.21.15.130:0/2476709851 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74c160190 con 0x7ff74c0b1990 2023-09-13T06:02:02.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.508+0000 7ff7535fa640 1 -- 172.21.15.130:0/2476709851 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74c150f40 con 0x7ff74c0b1990 2023-09-13T06:02:02.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.508+0000 7ff741ffb640 1 -- 172.21.15.130:0/2476709851 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff73c01c460 con 0x7ff74c0b1990 2023-09-13T06:02:02.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.508+0000 7ff741ffb640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff730065b20 0x7ff730067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.508+0000 7ff741ffb640 1 -- 172.21.15.130:0/2476709851 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff73c0832a0 con 0x7ff74c0b1990 2023-09-13T06:02:02.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.508+0000 7ff751396640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff730065b20 0x7ff730067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.508+0000 7ff751396640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff730065b20 0x7ff730067fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff74c160b00 tx=0x7ff748008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:02.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.512+0000 7ff741ffb640 1 -- 172.21.15.130:0/2476709851 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff74c150f40 con 0x7ff74c0b1990 2023-09-13T06:02:02.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 -- 172.21.15.130:0/2476709851 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff74c150f40 con 0x7ff74c0b1990 2023-09-13T06:02:02.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff741ffb640 1 -- 172.21.15.130:0/2476709851 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff74c150f40 con 0x7ff74c0b1990 2023-09-13T06:02:02.668 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:02:02.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 -- 172.21.15.130:0/2476709851 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff730065b20 msgr2=0x7ff730067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff730065b20 0x7ff730067fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff74c160b00 tx=0x7ff748008040 comp rx=0 tx=0).stop 2023-09-13T06:02:02.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 -- 172.21.15.130:0/2476709851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff74c0b1990 msgr2=0x7ff74c15f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff74c0b1990 0x7ff74c15f710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c450 tx=0x7ff73c00c910 comp rx=0 tx=0).stop 2023-09-13T06:02:02.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 -- 172.21.15.130:0/2476709851 shutdown_connections 2023-09-13T06:02:02.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff730065b20 0x7ff730067fe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff74c0b2c30 0x7ff74c15fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff74c0b1990 0x7ff74c15f710 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 --2- 172.21.15.130:0/2476709851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff74c0b08a0 0x7ff74c14f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 -- 172.21.15.130:0/2476709851 >> 172.21.15.130:0/2476709851 conn(0x7ff74c065990 msgr2=0x7ff74c0cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:02.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 -- 172.21.15.130:0/2476709851 shutdown_connections 2023-09-13T06:02:02.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.664+0000 7ff7535fa640 1 -- 172.21.15.130:0/2476709851 wait complete. 2023-09-13T06:02:02.690 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:02:02.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fe2448640 1 Processor -- start 2023-09-13T06:02:02.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fe2448640 1 -- start start 2023-09-13T06:02:02.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fe2448640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5fdc158f50 0x7f5fdc0b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fe2448640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5fdc0d0930 0x7f5fdc0b6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fe2448640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc0b2e00 con 0x7f5fdc15c470 2023-09-13T06:02:02.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fe2448640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc0b2880 con 0x7f5fdc158f50 2023-09-13T06:02:02.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fe2448640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc0b2b20 con 0x7f5fdc0d0930 2023-09-13T06:02:02.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fdbfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5fdc158f50 0x7f5fdc0b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fe09e5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5fdc15c470 0x7f5fdc06d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:32802/0 (socket says 172.21.15.130:32802) 2023-09-13T06:02:02.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fe09e5640 1 -- 172.21.15.130:0/3496389051 learned_addr learned my addr 172.21.15.130:0/3496389051 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:02.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fdb7fe640 1 --2- 172.21.15.130:0/3496389051 >> v2:172.21.15.164:3300/0 conn(0x7f5fdc0d0930 0x7f5fdc0b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fdbfff640 1 -- 172.21.15.130:0/3496389051 >> v2:172.21.15.164:3300/0 conn(0x7f5fdc0d0930 msgr2=0x7f5fdc0b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:02.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fdbfff640 1 --2- 172.21.15.130:0/3496389051 >> v2:172.21.15.164:3300/0 conn(0x7f5fdc0d0930 0x7f5fdc0b6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fdbfff640 1 -- 172.21.15.130:0/3496389051 >> v1:172.21.15.130:6789/0 conn(0x7f5fdc15c470 legacy=0x7f5fdc06d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.828+0000 7f5fdbfff640 1 -- 172.21.15.130:0/3496389051 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc15b990 con 0x7f5fdc158f50 2023-09-13T06:02:02.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fdbfff640 1 --2- 172.21.15.130:0/3496389051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fdc158f50 0x7f5fdc0b2340 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc06b720 tx=0x7f5fcc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee423d6ec4c3225 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:02.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fdaffd640 1 -- 172.21.15.130:0/3496389051 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0ab600 con 0x7f5fdc158f50 2023-09-13T06:02:02.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fdaffd640 1 -- 172.21.15.130:0/3496389051 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc0a7050 con 0x7f5fdc158f50 2023-09-13T06:02:02.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fdaffd640 1 -- 172.21.15.130:0/3496389051 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0ab980 con 0x7f5fdc158f50 2023-09-13T06:02:02.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fe2448640 1 -- 172.21.15.130:0/3496389051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fdc158f50 msgr2=0x7f5fdc0b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fe2448640 1 --2- 172.21.15.130:0/3496389051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fdc158f50 0x7f5fdc0b2340 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc06b720 tx=0x7f5fcc01c430 comp rx=0 tx=0).stop 2023-09-13T06:02:02.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fe2448640 1 -- 172.21.15.130:0/3496389051 shutdown_connections 2023-09-13T06:02:02.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fe2448640 1 --2- 172.21.15.130:0/3496389051 >> v2:172.21.15.164:3300/0 conn(0x7f5fdc0d0930 0x7f5fdc0b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fe2448640 1 --2- 172.21.15.130:0/3496389051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fdc158f50 0x7f5fdc0b2340 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fe2448640 1 -- 172.21.15.130:0/3496389051 >> 172.21.15.130:0/3496389051 conn(0x7f5fdc065990 msgr2=0x7f5fdc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:02.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fe2448640 1 -- 172.21.15.130:0/3496389051 shutdown_connections 2023-09-13T06:02:02.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.832+0000 7f5fe2448640 1 -- 172.21.15.130:0/3496389051 wait complete. 2023-09-13T06:02:02.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe2448640 1 Processor -- start 2023-09-13T06:02:02.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe2448640 1 -- start start 2023-09-13T06:02:02.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe2448640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fdc0d0930 0x7f5fdc1459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe2448640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fdc158f50 0x7f5fdc1f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe2448640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fdc15c470 0x7f5fdc1f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe2448640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc1f9cf0 con 0x7f5fdc158f50 2023-09-13T06:02:02.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe2448640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc14e6e0 con 0x7f5fdc15c470 2023-09-13T06:02:02.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe2448640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc14e9c0 con 0x7f5fdc0d0930 2023-09-13T06:02:02.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fdb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fdc158f50 0x7f5fdc1f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fdb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fdc158f50 0x7f5fdc1f8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41920/0 (socket says 172.21.15.130:41920) 2023-09-13T06:02:02.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fdb7fe640 1 -- 172.21.15.130:0/1860600310 learned_addr learned my addr 172.21.15.130:0/1860600310 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:02.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe09e5640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fdc15c470 0x7f5fdc1f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fdbfff640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fdc0d0930 0x7f5fdc1459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fdb7fe640 1 -- 172.21.15.130:0/1860600310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fdc0d0930 msgr2=0x7f5fdc1459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fdb7fe640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fdc0d0930 0x7f5fdc1459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fdb7fe640 1 -- 172.21.15.130:0/1860600310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fdc15c470 msgr2=0x7f5fdc1f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fdb7fe640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fdc15c470 0x7f5fdc1f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fdb7fe640 1 -- 172.21.15.130:0/1860600310 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc009420 con 0x7f5fdc158f50 2023-09-13T06:02:02.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe09e5640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fdc15c470 0x7f5fdc1f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:02.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fdb7fe640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fdc158f50 0x7f5fdc1f8e40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000d5f0 tx=0x7f5fd000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:02.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fd8ff9640 1 -- 172.21.15.130:0/1860600310 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00125f0 con 0x7f5fdc158f50 2023-09-13T06:02:02.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fd8ff9640 1 -- 172.21.15.130:0/1860600310 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0012750 con 0x7f5fdc158f50 2023-09-13T06:02:02.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe2448640 1 -- 172.21.15.130:0/1860600310 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc070750 con 0x7f5fdc158f50 2023-09-13T06:02:02.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fd8ff9640 1 -- 172.21.15.130:0/1860600310 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0012ae0 con 0x7f5fdc158f50 2023-09-13T06:02:02.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe2448640 1 -- 172.21.15.130:0/1860600310 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc070d10 con 0x7f5fdc158f50 2023-09-13T06:02:02.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.836+0000 7f5fe2448640 1 -- 172.21.15.130:0/1860600310 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc070ed0 con 0x7f5fdc158f50 2023-09-13T06:02:02.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.840+0000 7f5fd8ff9640 1 -- 172.21.15.130:0/1860600310 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5fd0012c40 con 0x7f5fdc158f50 2023-09-13T06:02:02.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.840+0000 7f5fd8ff9640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fc8065b20 0x7f5fc8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:02.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.840+0000 7f5fd8ff9640 1 -- 172.21.15.130:0/1860600310 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fd0083840 con 0x7f5fdc158f50 2023-09-13T06:02:02.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.840+0000 7f5fdbfff640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fc8065b20 0x7f5fc8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:02.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.840+0000 7f5fdbfff640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fc8065b20 0x7f5fc8067fe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc069f40 tx=0x7f5fcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:02.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.844+0000 7f5fd8ff9640 1 -- 172.21.15.130:0/1860600310 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5fd00510f0 con 0x7f5fdc158f50 2023-09-13T06:02:02.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.988+0000 7f5fe2448640 1 -- 172.21.15.130:0/1860600310 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5fdc0618a0 con 0x7f5fdc158f50 2023-09-13T06:02:02.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fd8ff9640 1 -- 172.21.15.130:0/1860600310 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fd0007380 con 0x7f5fdc158f50 2023-09-13T06:02:02.995 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:02:02.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 -- 172.21.15.130:0/1860600310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fc8065b20 msgr2=0x7f5fc8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fc8065b20 0x7f5fc8067fe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc069f40 tx=0x7f5fcc008040 comp rx=0 tx=0).stop 2023-09-13T06:02:02.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 -- 172.21.15.130:0/1860600310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fdc158f50 msgr2=0x7f5fdc1f8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:02.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fdc158f50 0x7f5fdc1f8e40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000d5f0 tx=0x7f5fd000dab0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 -- 172.21.15.130:0/1860600310 shutdown_connections 2023-09-13T06:02:02.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5fc8065b20 0x7f5fc8067fe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fdc15c470 0x7f5fdc1f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fdc158f50 0x7f5fdc1f8e40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 --2- 172.21.15.130:0/1860600310 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fdc0d0930 0x7f5fdc1459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:02.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 -- 172.21.15.130:0/1860600310 >> 172.21.15.130:0/1860600310 conn(0x7f5fdc065990 msgr2=0x7f5fdc065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:02.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 -- 172.21.15.130:0/1860600310 shutdown_connections 2023-09-13T06:02:02.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:02.992+0000 7f5fe2448640 1 -- 172.21.15.130:0/1860600310 wait complete. 2023-09-13T06:02:03.016 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:02:03.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe106ea0640 1 Processor -- start 2023-09-13T06:02:03.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe106ea0640 1 -- start start 2023-09-13T06:02:03.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe106ea0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe100144d70 0x7fe1000ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe106ea0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1000b2780 0x7fe1000b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe106ea0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1000b3120 con 0x7fe1000b1460 2023-09-13T06:02:03.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe106ea0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1000b2430 con 0x7fe100144d70 2023-09-13T06:02:03.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe106ea0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000cedb0 con 0x7fe1000b2780 2023-09-13T06:02:03.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe104c3c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe100144d70 0x7fe1000ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe104c3c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe100144d70 0x7fe1000ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41936/0 (socket says 172.21.15.130:41936) 2023-09-13T06:02:03.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe10543d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe1000b1460 0x7fe1000b18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:32810/0 (socket says 172.21.15.130:32810) 2023-09-13T06:02:03.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe104c3c640 1 -- 172.21.15.130:0/1376664406 learned_addr learned my addr 172.21.15.130:0/1376664406 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:03.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe0fffff640 1 --2- 172.21.15.130:0/1376664406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1000b2780 0x7fe1000b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe104c3c640 1 -- 172.21.15.130:0/1376664406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1000b2780 msgr2=0x7fe1000b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:03.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe104c3c640 1 --2- 172.21.15.130:0/1376664406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1000b2780 0x7fe1000b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe104c3c640 1 -- 172.21.15.130:0/1376664406 >> v1:172.21.15.130:6789/0 conn(0x7fe1000b1460 legacy=0x7fe1000b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe104c3c640 1 -- 172.21.15.130:0/1376664406 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1000b2150 con 0x7fe100144d70 2023-09-13T06:02:03.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.156+0000 7fe0ff7fe640 1 -- 172.21.15.130:0/1376664406 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743028316 0 0) 0x7fe1000b3120 con 0x7fe1000b1460 2023-09-13T06:02:03.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe104c3c640 1 --2- 172.21.15.130:0/1376664406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe100144d70 0x7fe1000ce870 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4009870 tx=0x7fe0f401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7895b4ae76bd49e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:03.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe0ff7fe640 1 -- 172.21.15.130:0/1376664406 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f40a7070 con 0x7fe100144d70 2023-09-13T06:02:03.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe0ff7fe640 1 -- 172.21.15.130:0/1376664406 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f40ab430 con 0x7fe100144d70 2023-09-13T06:02:03.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe0ff7fe640 1 -- 172.21.15.130:0/1376664406 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f40ab7c0 con 0x7fe100144d70 2023-09-13T06:02:03.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe106ea0640 1 -- 172.21.15.130:0/1376664406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe100144d70 msgr2=0x7fe1000ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe106ea0640 1 --2- 172.21.15.130:0/1376664406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe100144d70 0x7fe1000ce870 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4009870 tx=0x7fe0f401c540 comp rx=0 tx=0).stop 2023-09-13T06:02:03.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe106ea0640 1 -- 172.21.15.130:0/1376664406 shutdown_connections 2023-09-13T06:02:03.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe106ea0640 1 --2- 172.21.15.130:0/1376664406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1000b2780 0x7fe1000b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe106ea0640 1 --2- 172.21.15.130:0/1376664406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe100144d70 0x7fe1000ce870 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe106ea0640 1 -- 172.21.15.130:0/1376664406 >> 172.21.15.130:0/1376664406 conn(0x7fe100065990 msgr2=0x7fe100065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:03.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe106ea0640 1 -- 172.21.15.130:0/1376664406 shutdown_connections 2023-09-13T06:02:03.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.160+0000 7fe106ea0640 1 -- 172.21.15.130:0/1376664406 wait complete. 2023-09-13T06:02:03.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe106ea0640 1 Processor -- start 2023-09-13T06:02:03.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe106ea0640 1 -- start start 2023-09-13T06:02:03.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe106ea0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1000b1460 0x7fe1000b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe106ea0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1000b2780 0x7fe100153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe106ea0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe100144d70 0x7fe100155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe106ea0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000b0cb0 con 0x7fe1000b1460 2023-09-13T06:02:03.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe106ea0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe100157410 con 0x7fe100144d70 2023-09-13T06:02:03.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe106ea0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000b06f0 con 0x7fe1000b2780 2023-09-13T06:02:03.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe104c3c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1000b1460 0x7fe1000b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe104c3c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1000b1460 0x7fe1000b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41948/0 (socket says 172.21.15.130:41948) 2023-09-13T06:02:03.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe104c3c640 1 -- 172.21.15.130:0/536046571 learned_addr learned my addr 172.21.15.130:0/536046571 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:03.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe10543d640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe100144d70 0x7fe100155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe0fffff640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1000b2780 0x7fe100153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe104c3c640 1 -- 172.21.15.130:0/536046571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1000b2780 msgr2=0x7fe100153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe104c3c640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1000b2780 0x7fe100153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe104c3c640 1 -- 172.21.15.130:0/536046571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe100144d70 msgr2=0x7fe100155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe104c3c640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe100144d70 0x7fe100155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe104c3c640 1 -- 172.21.15.130:0/536046571 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40094d0 con 0x7fe1000b1460 2023-09-13T06:02:03.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe0fffff640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1000b2780 0x7fe100153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:03.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe10543d640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe100144d70 0x7fe100155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:03.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe104c3c640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1000b1460 0x7fe1000b0110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40ad040 tx=0x7fe0f40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:03.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe0fd7fa640 1 -- 172.21.15.130:0/536046571 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f40bc070 con 0x7fe1000b1460 2023-09-13T06:02:03.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe0fd7fa640 1 -- 172.21.15.130:0/536046571 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f40b4420 con 0x7fe1000b1460 2023-09-13T06:02:03.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe106ea0640 1 -- 172.21.15.130:0/536046571 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1000b09d0 con 0x7fe1000b1460 2023-09-13T06:02:03.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe0fd7fa640 1 -- 172.21.15.130:0/536046571 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f40b47f0 con 0x7fe1000b1460 2023-09-13T06:02:03.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.164+0000 7fe106ea0640 1 -- 172.21.15.130:0/536046571 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1001542d0 con 0x7fe1000b1460 2023-09-13T06:02:03.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.168+0000 7fe106ea0640 1 -- 172.21.15.130:0/536046571 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe100156f00 con 0x7fe1000b1460 2023-09-13T06:02:03.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.168+0000 7fe0fd7fa640 1 -- 172.21.15.130:0/536046571 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe0f40b4950 con 0x7fe1000b1460 2023-09-13T06:02:03.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.168+0000 7fe0fd7fa640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe0e4065b20 0x7fe0e4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.168+0000 7fe0fd7fa640 1 -- 172.21.15.130:0/536046571 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0f411ccd0 con 0x7fe1000b1460 2023-09-13T06:02:03.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.168+0000 7fe0fffff640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe0e4065b20 0x7fe0e4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.168+0000 7fe0fffff640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe0e4065b20 0x7fe0e4067fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe1001f8ba0 tx=0x7fe0ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:03.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.172+0000 7fe0fd7fa640 1 -- 172.21.15.130:0/536046571 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe100156f00 con 0x7fe1000b1460 2023-09-13T06:02:03.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.324+0000 7fe106ea0640 1 -- 172.21.15.130:0/536046571 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe100156f00 con 0x7fe1000b1460 2023-09-13T06:02:03.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.324+0000 7fe0fd7fa640 1 -- 172.21.15.130:0/536046571 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe100156f00 con 0x7fe1000b1460 2023-09-13T06:02:03.330 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:02:03.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 -- 172.21.15.130:0/536046571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe0e4065b20 msgr2=0x7fe0e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe0e4065b20 0x7fe0e4067fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe1001f8ba0 tx=0x7fe0ec008040 comp rx=0 tx=0).stop 2023-09-13T06:02:03.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 -- 172.21.15.130:0/536046571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1000b1460 msgr2=0x7fe1000b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1000b1460 0x7fe1000b0110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40ad040 tx=0x7fe0f40192e0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 -- 172.21.15.130:0/536046571 shutdown_connections 2023-09-13T06:02:03.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe0e4065b20 0x7fe0e4067fe0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe100144d70 0x7fe100155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1000b2780 0x7fe100153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 --2- 172.21.15.130:0/536046571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1000b1460 0x7fe1000b0110 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 -- 172.21.15.130:0/536046571 >> 172.21.15.130:0/536046571 conn(0x7fe100065990 msgr2=0x7fe1000acb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:03.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 -- 172.21.15.130:0/536046571 shutdown_connections 2023-09-13T06:02:03.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.328+0000 7fe106ea0640 1 -- 172.21.15.130:0/536046571 wait complete. 2023-09-13T06:02:03.351 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:02:03.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.484+0000 7f187b60b640 1 Processor -- start 2023-09-13T06:02:03.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.484+0000 7f187b60b640 1 -- start start 2023-09-13T06:02:03.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f187b60b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f18740af9e0 0x7f187406bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f187b60b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187406b5e0 con 0x7f1874147b50 2023-09-13T06:02:03.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f187b60b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187406b8c0 con 0x7f1874147f30 2023-09-13T06:02:03.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f187b60b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1874165ac0 con 0x7f18740af9e0 2023-09-13T06:02:03.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f1879ba8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f18740af9e0 0x7f187406bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f1879ba8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f18740af9e0 0x7f187406bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41962/0 (socket says 172.21.15.130:41962) 2023-09-13T06:02:03.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f18793a7640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1874147b50 0x7f18741652b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:32814/0 (socket says 172.21.15.130:32814) 2023-09-13T06:02:03.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f1879ba8640 1 -- 172.21.15.130:0/1905388507 learned_addr learned my addr 172.21.15.130:0/1905388507 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:03.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f1879ba8640 1 -- 172.21.15.130:0/1905388507 >> v1:172.21.15.164:6789/0 conn(0x7f1874147f30 legacy=0x7f1874148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f1879ba8640 1 -- 172.21.15.130:0/1905388507 >> v1:172.21.15.130:6789/0 conn(0x7f1874147b50 legacy=0x7f18741652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f1879ba8640 1 -- 172.21.15.130:0/1905388507 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1874165da0 con 0x7f18740af9e0 2023-09-13T06:02:03.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.488+0000 7f186bfff640 1 -- 172.21.15.130:0/1905388507 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579559393 0 0) 0x7f187406b5e0 con 0x7f1874147b50 2023-09-13T06:02:03.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f1879ba8640 1 --2- 172.21.15.130:0/1905388507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18740af9e0 0x7f187406bd50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f186c009e50 tx=0x7f186c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca570f798a1905a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:03.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f186bfff640 1 -- 172.21.15.130:0/1905388507 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0a57d0 con 0x7f18740af9e0 2023-09-13T06:02:03.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f186bfff640 1 -- 172.21.15.130:0/1905388507 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c0a5930 con 0x7f18740af9e0 2023-09-13T06:02:03.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f186bfff640 1 -- 172.21.15.130:0/1905388507 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0a5cc0 con 0x7f18740af9e0 2023-09-13T06:02:03.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f187b60b640 1 -- 172.21.15.130:0/1905388507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18740af9e0 msgr2=0x7f187406bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f187b60b640 1 --2- 172.21.15.130:0/1905388507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18740af9e0 0x7f187406bd50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f186c009e50 tx=0x7f186c01c9e0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f187b60b640 1 -- 172.21.15.130:0/1905388507 shutdown_connections 2023-09-13T06:02:03.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f187b60b640 1 --2- 172.21.15.130:0/1905388507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18740af9e0 0x7f187406bd50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f187b60b640 1 -- 172.21.15.130:0/1905388507 >> 172.21.15.130:0/1905388507 conn(0x7f1874065990 msgr2=0x7f1874065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:03.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f187b60b640 1 -- 172.21.15.130:0/1905388507 shutdown_connections 2023-09-13T06:02:03.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f187b60b640 1 -- 172.21.15.130:0/1905388507 wait complete. 2023-09-13T06:02:03.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f187b60b640 1 Processor -- start 2023-09-13T06:02:03.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.492+0000 7f187b60b640 1 -- start start 2023-09-13T06:02:03.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f187b60b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18740af9e0 0x7f187413e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f187b60b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1874147b50 0x7f1874160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f187b60b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1874147f30 0x7f18740cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f187b60b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18741614d0 con 0x7f18740af9e0 2023-09-13T06:02:03.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f187b60b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18740cf2f0 con 0x7f1874147b50 2023-09-13T06:02:03.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f187b60b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18740ce6e0 con 0x7f1874147f30 2023-09-13T06:02:03.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f18793a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18740af9e0 0x7f187413e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f18793a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18740af9e0 0x7f187413e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41978/0 (socket says 172.21.15.130:41978) 2023-09-13T06:02:03.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f18793a7640 1 -- 172.21.15.130:0/868374724 learned_addr learned my addr 172.21.15.130:0/868374724 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:03.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f1878ba6640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1874147b50 0x7f1874160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f1879ba8640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1874147f30 0x7f18740cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f18793a7640 1 -- 172.21.15.130:0/868374724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1874147f30 msgr2=0x7f18740cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f18793a7640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1874147f30 0x7f18740cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f18793a7640 1 -- 172.21.15.130:0/868374724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1874147b50 msgr2=0x7f1874160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f18793a7640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1874147b50 0x7f1874160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f18793a7640 1 -- 172.21.15.130:0/868374724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c009b30 con 0x7f18740af9e0 2023-09-13T06:02:03.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f18793a7640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18740af9e0 0x7f187413e7c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f187000c4a0 tx=0x7f187000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:03.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f1869ffb640 1 -- 172.21.15.130:0/868374724 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700074e0 con 0x7f18740af9e0 2023-09-13T06:02:03.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f1869ffb640 1 -- 172.21.15.130:0/868374724 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1870007640 con 0x7f18740af9e0 2023-09-13T06:02:03.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f187b60b640 1 -- 172.21.15.130:0/868374724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18740ce9c0 con 0x7f18740af9e0 2023-09-13T06:02:03.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f1869ffb640 1 -- 172.21.15.130:0/868374724 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870004a30 con 0x7f18740af9e0 2023-09-13T06:02:03.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f187b60b640 1 -- 172.21.15.130:0/868374724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18740cef80 con 0x7f18740af9e0 2023-09-13T06:02:03.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f187b60b640 1 -- 172.21.15.130:0/868374724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18740618a0 con 0x7f18740af9e0 2023-09-13T06:02:03.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.496+0000 7f1869ffb640 1 -- 172.21.15.130:0/868374724 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1870004b90 con 0x7f18740af9e0 2023-09-13T06:02:03.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.500+0000 7f1869ffb640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1858065b20 0x7f1858067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.500+0000 7f1869ffb640 1 -- 172.21.15.130:0/868374724 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1870082550 con 0x7f18740af9e0 2023-09-13T06:02:03.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.500+0000 7f1878ba6640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1858065b20 0x7f1858067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.500+0000 7f1878ba6640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1858065b20 0x7f1858067fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f187406f380 tx=0x7f1864009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:03.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.504+0000 7f1869ffb640 1 -- 172.21.15.130:0/868374724 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f187004feb0 con 0x7f18740af9e0 2023-09-13T06:02:03.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.664+0000 7f187b60b640 1 -- 172.21.15.130:0/868374724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f187406c810 con 0x7f18740af9e0 2023-09-13T06:02:03.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.664+0000 7f1869ffb640 1 -- 172.21.15.130:0/868374724 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1870018080 con 0x7f18740af9e0 2023-09-13T06:02:03.669 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:02:03.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 -- 172.21.15.130:0/868374724 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1858065b20 msgr2=0x7f1858067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1858065b20 0x7f1858067fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f187406f380 tx=0x7f1864009040 comp rx=0 tx=0).stop 2023-09-13T06:02:03.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 -- 172.21.15.130:0/868374724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18740af9e0 msgr2=0x7f187413e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18740af9e0 0x7f187413e7c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f187000c4a0 tx=0x7f187000c960 comp rx=0 tx=0).stop 2023-09-13T06:02:03.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 -- 172.21.15.130:0/868374724 shutdown_connections 2023-09-13T06:02:03.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1858065b20 0x7f1858067fe0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1874147b50 0x7f1874160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1874147f30 0x7f18740cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 --2- 172.21.15.130:0/868374724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18740af9e0 0x7f187413e7c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 -- 172.21.15.130:0/868374724 >> 172.21.15.130:0/868374724 conn(0x7f1874065990 msgr2=0x7f1874148310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:03.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 -- 172.21.15.130:0/868374724 shutdown_connections 2023-09-13T06:02:03.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.668+0000 7f187b60b640 1 -- 172.21.15.130:0/868374724 wait complete. 2023-09-13T06:02:03.691 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-09-13T06:02:03.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:03.691 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-09-13T06:02:03.760 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:02:03.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:03.761 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-13T06:02:03.771 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-13T06:02:03.772 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:03.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab0b5ba640 1 Processor -- start 2023-09-13T06:02:03.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab0b5ba640 1 -- start start 2023-09-13T06:02:03.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab0b5ba640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fab040d1750 0x7fab0415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab0b5ba640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fab04146f30 0x7fab040b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab0b5ba640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab040b63c0 con 0x7fab040d1090 2023-09-13T06:02:03.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab0b5ba640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0415dea0 con 0x7fab04146f30 2023-09-13T06:02:03.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab0b5ba640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab040d0c20 con 0x7fab040d1750 2023-09-13T06:02:03.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab09b57640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fab04146f30 0x7fab040b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab09b57640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fab04146f30 0x7fab040b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41982/0 (socket says 172.21.15.130:41982) 2023-09-13T06:02:03.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab09b57640 1 -- 172.21.15.130:0/3477226439 learned_addr learned my addr 172.21.15.130:0/3477226439 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:03.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab09356640 1 --2- 172.21.15.130:0/3477226439 >> v2:172.21.15.164:3300/0 conn(0x7fab040d1750 0x7fab0415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab09b57640 1 -- 172.21.15.130:0/3477226439 >> v2:172.21.15.164:3300/0 conn(0x7fab040d1750 msgr2=0x7fab0415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:03.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab09b57640 1 --2- 172.21.15.130:0/3477226439 >> v2:172.21.15.164:3300/0 conn(0x7fab040d1750 0x7fab0415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab09b57640 1 -- 172.21.15.130:0/3477226439 >> v1:172.21.15.164:6789/0 conn(0x7fab040d1090 legacy=0x7fab04146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:03.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab09b57640 1 -- 172.21.15.130:0/3477226439 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab040b6610 con 0x7fab04146f30 2023-09-13T06:02:03.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.908+0000 7fab09356640 1 --2- 172.21.15.130:0/3477226439 >> v2:172.21.15.164:3300/0 conn(0x7fab040d1750 0x7fab0415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:03.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7fab09b57640 1 --2- 172.21.15.130:0/3477226439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab04146f30 0x7fab040b70f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fab04073cd0 tx=0x7faafc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c369dbbdaa42c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:03.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7faafbfff640 1 -- 172.21.15.130:0/3477226439 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0a5790 con 0x7fab04146f30 2023-09-13T06:02:03.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7faafbfff640 1 -- 172.21.15.130:0/3477226439 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc0a58f0 con 0x7fab04146f30 2023-09-13T06:02:03.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7faafbfff640 1 -- 172.21.15.130:0/3477226439 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0a5c80 con 0x7fab04146f30 2023-09-13T06:02:03.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7fab0b5ba640 1 -- 172.21.15.130:0/3477226439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab04146f30 msgr2=0x7fab040b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7fab0b5ba640 1 --2- 172.21.15.130:0/3477226439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab04146f30 0x7fab040b70f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fab04073cd0 tx=0x7faafc01c8d0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7fab0b5ba640 1 -- 172.21.15.130:0/3477226439 shutdown_connections 2023-09-13T06:02:03.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7fab0b5ba640 1 --2- 172.21.15.130:0/3477226439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab04146f30 0x7fab040b70f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7fab0b5ba640 1 --2- 172.21.15.130:0/3477226439 >> v2:172.21.15.164:3300/0 conn(0x7fab040d1750 0x7fab0415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7fab0b5ba640 1 -- 172.21.15.130:0/3477226439 >> 172.21.15.130:0/3477226439 conn(0x7fab0406f170 msgr2=0x7fab0406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:03.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7fab0b5ba640 1 -- 172.21.15.130:0/3477226439 shutdown_connections 2023-09-13T06:02:03.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.912+0000 7fab0b5ba640 1 -- 172.21.15.130:0/3477226439 wait complete. 2023-09-13T06:02:03.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab0b5ba640 1 Processor -- start 2023-09-13T06:02:03.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab0b5ba640 1 -- start start 2023-09-13T06:02:03.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab0b5ba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab040d1090 0x7fab0413d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab0b5ba640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab040d1750 0x7fab0413d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab0b5ba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab04146f30 0x7fab04157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab0b5ba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab04143f50 con 0x7fab040d1090 2023-09-13T06:02:03.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab0b5ba640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0413ec50 con 0x7fab040d1750 2023-09-13T06:02:03.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab0b5ba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0413d710 con 0x7fab04146f30 2023-09-13T06:02:03.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab09356640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab040d1090 0x7fab0413d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab09356640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab040d1090 0x7fab0413d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41986/0 (socket says 172.21.15.130:41986) 2023-09-13T06:02:03.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab09356640 1 -- 172.21.15.130:0/969810539 learned_addr learned my addr 172.21.15.130:0/969810539 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:03.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab08b55640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab040d1750 0x7fab0413d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab09b57640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab04146f30 0x7fab04157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab09356640 1 -- 172.21.15.130:0/969810539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab04146f30 msgr2=0x7fab04157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab09356640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab04146f30 0x7fab04157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab09356640 1 -- 172.21.15.130:0/969810539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab040d1750 msgr2=0x7fab0413d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:03.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab09356640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab040d1750 0x7fab0413d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:03.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab09356640 1 -- 172.21.15.130:0/969810539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc009b30 con 0x7fab040d1090 2023-09-13T06:02:03.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab09b57640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab04146f30 0x7fab04157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:03.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab09356640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab040d1090 0x7fab0413d1d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fab0000c7c0 tx=0x7fab0000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:03.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7faaf9ffb640 1 -- 172.21.15.130:0/969810539 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00007a30 con 0x7fab040d1090 2023-09-13T06:02:03.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7faaf9ffb640 1 -- 172.21.15.130:0/969810539 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab00007b90 con 0x7fab040d1090 2023-09-13T06:02:03.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7faaf9ffb640 1 -- 172.21.15.130:0/969810539 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0000ce70 con 0x7fab040d1090 2023-09-13T06:02:03.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab0b5ba640 1 -- 172.21.15.130:0/969810539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab040b7e40 con 0x7fab040d1090 2023-09-13T06:02:03.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab0b5ba640 1 -- 172.21.15.130:0/969810539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0413e690 con 0x7fab040d1090 2023-09-13T06:02:03.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.916+0000 7fab0b5ba640 1 -- 172.21.15.130:0/969810539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab040618a0 con 0x7fab040d1090 2023-09-13T06:02:03.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.920+0000 7faaf9ffb640 1 -- 172.21.15.130:0/969810539 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fab000113f0 con 0x7fab040d1090 2023-09-13T06:02:03.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.920+0000 7faaf9ffb640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faae8065b20 0x7faae8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:03.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.920+0000 7faaf9ffb640 1 -- 172.21.15.130:0/969810539 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab000837d0 con 0x7fab040d1090 2023-09-13T06:02:03.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.920+0000 7fab08b55640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faae8065b20 0x7faae8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:03.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.920+0000 7fab08b55640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faae8065b20 0x7faae8067fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab0413f370 tx=0x7faaf4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:03.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:03.924+0000 7faaf9ffb640 1 -- 172.21.15.130:0/969810539 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fab00051110 con 0x7fab040d1090 2023-09-13T06:02:04.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.100+0000 7fab0b5ba640 1 -- 172.21.15.130:0/969810539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab04146290 con 0x7fab040d1090 2023-09-13T06:02:04.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.100+0000 7faaf9ffb640 1 -- 172.21.15.130:0/969810539 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fab00054730 con 0x7fab040d1090 2023-09-13T06:02:04.105 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:04.105 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1779716448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1779716448},{"type":"v1","addr":"172.21.15.130:6837","nonce":1779716448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1022199494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":1022199494},{"type":"v1","addr":"172.21.15.164:6835","nonce":1022199494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3130227261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3130227261},{"type":"v1","addr":"172.21.15.164:6834","nonce":3130227261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:01:25.693319+0000","modified":"2023-09-13T06:01:28.718115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/660561895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":660561895},{"type":"v1","addr":"172.21.15.130:6836","nonce":660561895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T06:02:04.106 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 7 2023-09-13T06:02:04.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 -- 172.21.15.130:0/969810539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faae8065b20 msgr2=0x7faae8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faae8065b20 0x7faae8067fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab0413f370 tx=0x7faaf4009040 comp rx=0 tx=0).stop 2023-09-13T06:02:04.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 -- 172.21.15.130:0/969810539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab040d1090 msgr2=0x7fab0413d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab040d1090 0x7fab0413d1d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fab0000c7c0 tx=0x7fab0000cc80 comp rx=0 tx=0).stop 2023-09-13T06:02:04.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 -- 172.21.15.130:0/969810539 shutdown_connections 2023-09-13T06:02:04.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faae8065b20 0x7faae8067fe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab040d1750 0x7fab0413d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab04146f30 0x7fab04157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 --2- 172.21.15.130:0/969810539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab040d1090 0x7fab0413d1d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 -- 172.21.15.130:0/969810539 >> 172.21.15.130:0/969810539 conn(0x7fab0406f170 msgr2=0x7fab040b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:04.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 -- 172.21.15.130:0/969810539 shutdown_connections 2023-09-13T06:02:04.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.104+0000 7fab0b5ba640 1 -- 172.21.15.130:0/969810539 wait complete. 2023-09-13T06:02:04.126 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:04.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.260+0000 7f1f32159640 1 Processor -- start 2023-09-13T06:02:04.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.260+0000 7f1f32159640 1 -- start start 2023-09-13T06:02:04.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.260+0000 7f1f32159640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1f2c0ce7b0 0x7f1f2c0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.260+0000 7f1f32159640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2c0ccfd0 con 0x7f1f2c159f20 2023-09-13T06:02:04.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.260+0000 7f1f32159640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2c0ced90 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.260+0000 7f1f32159640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c0b00f0 con 0x7f1f2c0ce7b0 2023-09-13T06:02:04.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.260+0000 7f1f2bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1f2c0ce7b0 0x7f1f2c0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.260+0000 7f1f2b7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1f2c159f20 0x7f1f2c0b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:32820/0 (socket says 172.21.15.130:32820) 2023-09-13T06:02:04.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.260+0000 7f1f2b7fe640 1 -- 172.21.15.130:0/1771849385 learned_addr learned my addr 172.21.15.130:0/1771849385 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:04.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.264+0000 7f1f2bfff640 1 -- 172.21.15.130:0/1771849385 >> v1:172.21.15.164:6789/0 conn(0x7f1f2c0b1d20 legacy=0x7f1f2c0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.264+0000 7f1f2bfff640 1 -- 172.21.15.130:0/1771849385 >> v1:172.21.15.130:6789/0 conn(0x7f1f2c159f20 legacy=0x7f1f2c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.264+0000 7f1f2bfff640 1 -- 172.21.15.130:0/1771849385 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c0cd200 con 0x7f1f2c0ce7b0 2023-09-13T06:02:04.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.264+0000 7f1f2a7fc640 1 -- 172.21.15.130:0/1771849385 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987324320 0 0) 0x7f1f2c0ccfd0 con 0x7f1f2c159f20 2023-09-13T06:02:04.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.264+0000 7f1f2bfff640 1 --2- 172.21.15.130:0/1771849385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0ce7b0 0x7f1f2c0cdfc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009dc0 tx=0x7f1f2401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fafbfc837f17c06 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:04.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.264+0000 7f1f2a7fc640 1 -- 172.21.15.130:0/1771849385 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f240a5930 con 0x7f1f2c0ce7b0 2023-09-13T06:02:04.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.264+0000 7f1f2a7fc640 1 -- 172.21.15.130:0/1771849385 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f240a5a90 con 0x7f1f2c0ce7b0 2023-09-13T06:02:04.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.264+0000 7f1f2a7fc640 1 -- 172.21.15.130:0/1771849385 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f240a5e20 con 0x7f1f2c0ce7b0 2023-09-13T06:02:04.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.264+0000 7f1f32159640 1 -- 172.21.15.130:0/1771849385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0ce7b0 msgr2=0x7f1f2c0cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.264+0000 7f1f32159640 1 --2- 172.21.15.130:0/1771849385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0ce7b0 0x7f1f2c0cdfc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009dc0 tx=0x7f1f2401c870 comp rx=0 tx=0).stop 2023-09-13T06:02:04.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 -- 172.21.15.130:0/1771849385 shutdown_connections 2023-09-13T06:02:04.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 --2- 172.21.15.130:0/1771849385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0ce7b0 0x7f1f2c0cdfc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 -- 172.21.15.130:0/1771849385 >> 172.21.15.130:0/1771849385 conn(0x7f1f2c065990 msgr2=0x7f1f2c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:04.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 -- 172.21.15.130:0/1771849385 shutdown_connections 2023-09-13T06:02:04.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 -- 172.21.15.130:0/1771849385 wait complete. 2023-09-13T06:02:04.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 Processor -- start 2023-09-13T06:02:04.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 -- start start 2023-09-13T06:02:04.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b1d20 0x7f1f2c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c0ce7b0 0x7f1f2c148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f2c159f20 0x7f1f2c14a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c150200 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c1504e0 con 0x7f1f2c0ce7b0 2023-09-13T06:02:04.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f32159640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c1507c0 con 0x7f1f2c159f20 2023-09-13T06:02:04.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b1d20 0x7f1f2c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b1d20 0x7f1f2c14f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42010/0 (socket says 172.21.15.130:42010) 2023-09-13T06:02:04.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2b7fe640 1 -- 172.21.15.130:0/66415104 learned_addr learned my addr 172.21.15.130:0/66415104 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:04.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2bfff640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f2c159f20 0x7f1f2c14a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2affd640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c0ce7b0 0x7f1f2c148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2b7fe640 1 -- 172.21.15.130:0/66415104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f2c159f20 msgr2=0x7f1f2c14a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2b7fe640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f2c159f20 0x7f1f2c14a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2b7fe640 1 -- 172.21.15.130:0/66415104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c0ce7b0 msgr2=0x7f1f2c148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2b7fe640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c0ce7b0 0x7f1f2c148730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2b7fe640 1 -- 172.21.15.130:0/66415104 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24009a70 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2affd640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c0ce7b0 0x7f1f2c148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:04.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.268+0000 7f1f2b7fe640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b1d20 0x7f1f2c14f330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00c410 tx=0x7f1f1c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:04.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.272+0000 7f1f13fff640 1 -- 172.21.15.130:0/66415104 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c0074e0 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.272+0000 7f1f13fff640 1 -- 172.21.15.130:0/66415104 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c007640 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.272+0000 7f1f13fff640 1 -- 172.21.15.130:0/66415104 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c004a30 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.272+0000 7f1f32159640 1 -- 172.21.15.130:0/66415104 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2c150aa0 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.272+0000 7f1f32159640 1 -- 172.21.15.130:0/66415104 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c151060 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.272+0000 7f1f32159640 1 -- 172.21.15.130:0/66415104 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c0618a0 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.272+0000 7f1f13fff640 1 -- 172.21.15.130:0/66415104 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1f1c004b90 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.272+0000 7f1f13fff640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f18065b20 0x7f1f18067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.272+0000 7f1f13fff640 1 -- 172.21.15.130:0/66415104 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f1c083020 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.272+0000 7f1f2affd640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f18065b20 0x7f1f18067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.272+0000 7f1f2affd640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f18065b20 0x7f1f18067fe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0af5a0 tx=0x7f1f20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:04.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.276+0000 7f1f13fff640 1 -- 172.21.15.130:0/66415104 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1f1c050970 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.428+0000 7f1f32159640 1 -- 172.21.15.130:0/66415104 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f2c1582f0 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.428+0000 7f1f13fff640 1 -- 172.21.15.130:0/66415104 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f1f1c053f90 con 0x7f1f2c0b1d20 2023-09-13T06:02:04.432 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:04.433 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:04.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.428+0000 7f1f32159640 1 -- 172.21.15.130:0/66415104 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f18065b20 msgr2=0x7f1f18067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.428+0000 7f1f32159640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f18065b20 0x7f1f18067fe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0af5a0 tx=0x7f1f20009040 comp rx=0 tx=0).stop 2023-09-13T06:02:04.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.428+0000 7f1f32159640 1 -- 172.21.15.130:0/66415104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b1d20 msgr2=0x7f1f2c14f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.428+0000 7f1f32159640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b1d20 0x7f1f2c14f330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00c410 tx=0x7f1f1c00c8d0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.432+0000 7f1f32159640 1 -- 172.21.15.130:0/66415104 shutdown_connections 2023-09-13T06:02:04.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.432+0000 7f1f32159640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f18065b20 0x7f1f18067fe0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.432+0000 7f1f32159640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f2c0ce7b0 0x7f1f2c148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.432+0000 7f1f32159640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f2c159f20 0x7f1f2c14a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.432+0000 7f1f32159640 1 --2- 172.21.15.130:0/66415104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b1d20 0x7f1f2c14f330 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.432+0000 7f1f32159640 1 -- 172.21.15.130:0/66415104 >> 172.21.15.130:0/66415104 conn(0x7f1f2c065990 msgr2=0x7f1f2c0cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:04.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.432+0000 7f1f32159640 1 -- 172.21.15.130:0/66415104 shutdown_connections 2023-09-13T06:02:04.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.432+0000 7f1f32159640 1 -- 172.21.15.130:0/66415104 wait complete. 2023-09-13T06:02:04.454 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:01:23.397348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:01:24.691458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:02:04.455 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:02:04.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4994d40640 1 Processor -- start 2023-09-13T06:02:04.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4994d40640 1 -- start start 2023-09-13T06:02:04.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4994d40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4990144d70 0x7f49900ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4994d40640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f49900b2780 0x7f49900b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4994d40640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49900b3120 con 0x7f49900b1460 2023-09-13T06:02:04.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4994d40640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49900b2430 con 0x7f49900b2780 2023-09-13T06:02:04.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4994d40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49900cedb0 con 0x7f4990144d70 2023-09-13T06:02:04.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4987fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f49900b2780 0x7f49900b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4987fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f49900b2780 0x7f49900b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42018/0 (socket says 172.21.15.130:42018) 2023-09-13T06:02:04.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4987fff640 1 -- 172.21.15.130:0/3884454340 learned_addr learned my addr 172.21.15.130:0/3884454340 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:04.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f498e59c640 1 --2- 172.21.15.130:0/3884454340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4990144d70 0x7f49900ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4987fff640 1 -- 172.21.15.130:0/3884454340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4990144d70 msgr2=0x7f49900ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:04.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4987fff640 1 --2- 172.21.15.130:0/3884454340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4990144d70 0x7f49900ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4987fff640 1 -- 172.21.15.130:0/3884454340 >> v1:172.21.15.164:6789/0 conn(0x7f49900b1460 legacy=0x7f49900b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:04.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.592+0000 7f4987fff640 1 -- 172.21.15.130:0/3884454340 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900b2150 con 0x7f49900b2780 2023-09-13T06:02:04.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f4987fff640 1 --2- 172.21.15.130:0/3884454340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49900b2780 0x7f49900b2be0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4978009870 tx=0x7f497801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38ab2ca5f9919fc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:04.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f498dd9b640 1 -- 172.21.15.130:0/3884454340 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49780ac410 con 0x7f49900b2780 2023-09-13T06:02:04.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f498dd9b640 1 -- 172.21.15.130:0/3884454340 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49780ac570 con 0x7f49900b2780 2023-09-13T06:02:04.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f498dd9b640 1 -- 172.21.15.130:0/3884454340 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49780ac900 con 0x7f49900b2780 2023-09-13T06:02:04.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f4994d40640 1 -- 172.21.15.130:0/3884454340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49900b2780 msgr2=0x7f49900b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f4994d40640 1 --2- 172.21.15.130:0/3884454340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49900b2780 0x7f49900b2be0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4978009870 tx=0x7f497801c500 comp rx=0 tx=0).stop 2023-09-13T06:02:04.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f4994d40640 1 -- 172.21.15.130:0/3884454340 shutdown_connections 2023-09-13T06:02:04.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f4994d40640 1 --2- 172.21.15.130:0/3884454340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49900b2780 0x7f49900b2be0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f4994d40640 1 --2- 172.21.15.130:0/3884454340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4990144d70 0x7f49900ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f4994d40640 1 -- 172.21.15.130:0/3884454340 >> 172.21.15.130:0/3884454340 conn(0x7f4990065990 msgr2=0x7f4990065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:04.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f4994d40640 1 -- 172.21.15.130:0/3884454340 shutdown_connections 2023-09-13T06:02:04.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.596+0000 7f4994d40640 1 -- 172.21.15.130:0/3884454340 wait complete. 2023-09-13T06:02:04.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4994d40640 1 Processor -- start 2023-09-13T06:02:04.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4994d40640 1 -- start start 2023-09-13T06:02:04.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4994d40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49900b1460 0x7f499015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4994d40640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49900b2780 0x7f49901385f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4994d40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4990144d70 0x7f49900ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4994d40640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49900cc1b0 con 0x7f49900b1460 2023-09-13T06:02:04.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4994d40640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4990138b30 con 0x7f49900b2780 2023-09-13T06:02:04.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4994d40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4990138e40 con 0x7f4990144d70 2023-09-13T06:02:04.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f498e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49900b1460 0x7f499015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f498e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49900b1460 0x7f499015ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42030/0 (socket says 172.21.15.130:42030) 2023-09-13T06:02:04.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f498e59c640 1 -- 172.21.15.130:0/1752210512 learned_addr learned my addr 172.21.15.130:0/1752210512 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:04.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4987fff640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49900b2780 0x7f49901385f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f498ed9d640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4990144d70 0x7f49900ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f498e59c640 1 -- 172.21.15.130:0/1752210512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4990144d70 msgr2=0x7f49900ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f498e59c640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4990144d70 0x7f49900ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f498e59c640 1 -- 172.21.15.130:0/1752210512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49900b2780 msgr2=0x7f49901385f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f498e59c640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49900b2780 0x7f49901385f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f498e59c640 1 -- 172.21.15.130:0/1752210512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49780094d0 con 0x7f49900b1460 2023-09-13T06:02:04.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f498e59c640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49900b1460 0x7f499015ba70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f498000d5f0 tx=0x7f498000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:04.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4986ffd640 1 -- 172.21.15.130:0/1752210512 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800125f0 con 0x7f49900b1460 2023-09-13T06:02:04.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4986ffd640 1 -- 172.21.15.130:0/1752210512 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4980012750 con 0x7f49900b1460 2023-09-13T06:02:04.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4986ffd640 1 -- 172.21.15.130:0/1752210512 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980012ae0 con 0x7f49900b1460 2023-09-13T06:02:04.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4994d40640 1 -- 172.21.15.130:0/1752210512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499015c170 con 0x7f49900b1460 2023-09-13T06:02:04.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.600+0000 7f4994d40640 1 -- 172.21.15.130:0/1752210512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49900cbdd0 con 0x7f49900b1460 2023-09-13T06:02:04.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.604+0000 7f4994d40640 1 -- 172.21.15.130:0/1752210512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49900cc420 con 0x7f49900b1460 2023-09-13T06:02:04.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.604+0000 7f4986ffd640 1 -- 172.21.15.130:0/1752210512 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4980012c40 con 0x7f49900b1460 2023-09-13T06:02:04.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.604+0000 7f4986ffd640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4970065b20 0x7f4970067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.604+0000 7f4986ffd640 1 -- 172.21.15.130:0/1752210512 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4980083740 con 0x7f49900b1460 2023-09-13T06:02:04.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.604+0000 7f4987fff640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4970065b20 0x7f4970067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.604+0000 7f4987fff640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4970065b20 0x7f4970067fe0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f49780ae000 tx=0x7f4978009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.608+0000 7f4986ffd640 1 -- 172.21.15.130:0/1752210512 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4980051080 con 0x7f49900b1460 2023-09-13T06:02:04.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.756+0000 7f4994d40640 1 -- 172.21.15.130:0/1752210512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49900618a0 con 0x7f49900b1460 2023-09-13T06:02:04.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.756+0000 7f4986ffd640 1 -- 172.21.15.130:0/1752210512 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4980007380 con 0x7f49900b1460 2023-09-13T06:02:04.762 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:02:04.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 -- 172.21.15.130:0/1752210512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4970065b20 msgr2=0x7f4970067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4970065b20 0x7f4970067fe0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f49780ae000 tx=0x7f4978009040 comp rx=0 tx=0).stop 2023-09-13T06:02:04.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 -- 172.21.15.130:0/1752210512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49900b1460 msgr2=0x7f499015ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49900b1460 0x7f499015ba70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f498000d5f0 tx=0x7f498000dab0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 -- 172.21.15.130:0/1752210512 shutdown_connections 2023-09-13T06:02:04.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4970065b20 0x7f4970067fe0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49900b2780 0x7f49901385f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4990144d70 0x7f49900ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 --2- 172.21.15.130:0/1752210512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49900b1460 0x7f499015ba70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 -- 172.21.15.130:0/1752210512 >> 172.21.15.130:0/1752210512 conn(0x7f4990065990 msgr2=0x7f499013fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:04.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 -- 172.21.15.130:0/1752210512 shutdown_connections 2023-09-13T06:02:04.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.760+0000 7f4994d40640 1 -- 172.21.15.130:0/1752210512 wait complete. 2023-09-13T06:02:04.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:02:04.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55b58d8640 1 Processor -- start 2023-09-13T06:02:04.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55b58d8640 1 -- start start 2023-09-13T06:02:04.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55b58d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b015ae10 0x7f55b00d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55b58d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f55b01619b0 0x7f55b00cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55b58d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b015dd40 con 0x7f55b00d2b00 2023-09-13T06:02:04.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55b58d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b0161e40 con 0x7f55b01619b0 2023-09-13T06:02:04.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55b58d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b015e020 con 0x7f55b015ae10 2023-09-13T06:02:04.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55a67fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f55b00d2b00 0x7f55b01612a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:32832/0 (socket says 172.21.15.130:32832) 2023-09-13T06:02:04.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55a67fc640 1 -- 172.21.15.130:0/4265550082 learned_addr learned my addr 172.21.15.130:0/4265550082 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:04.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55aeffd640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b015ae10 0x7f55b00d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55af7fe640 1 --2- 172.21.15.130:0/4265550082 >> v2:172.21.15.164:3300/0 conn(0x7f55b01619b0 0x7f55b00cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816995565 0 0) 0x7f55b015dd40 con 0x7f55b00d2b00 2023-09-13T06:02:04.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f559c003530 con 0x7f55b00d2b00 2023-09-13T06:02:04.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3086046531 0 0) 0x7f559c003530 con 0x7f55b00d2b00 2023-09-13T06:02:04.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b015ae10 msgr2=0x7f55b00d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:04.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b015ae10 0x7f55b00d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 >> v2:172.21.15.164:3300/0 conn(0x7f55b01619b0 msgr2=0x7f55b00cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:04.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 --2- 172.21.15.130:0/4265550082 >> v2:172.21.15.164:3300/0 conn(0x7f55b01619b0 0x7f55b00cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b015e300 con 0x7f55b00d2b00 2023-09-13T06:02:04.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f5598001680 con 0x7f55b00d2b00 2023-09-13T06:02:04.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 >> v1:172.21.15.130:6789/0 conn(0x7f55b00d2b00 legacy=0x7f55b01612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f559c0039f0 0x7f559c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b015ae10 0x7f559c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 0x7f559c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0161e40 con 0x7f559c004d10 2023-09-13T06:02:04.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b015e020 con 0x7f559c0039f0 2023-09-13T06:02:04.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c00ba90 con 0x7f55b015ae10 2023-09-13T06:02:04.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55af7fe640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 0x7f559c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55aeffd640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f559c0039f0 0x7f559c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55a67fc640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b015ae10 0x7f559c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55af7fe640 1 -- 172.21.15.130:0/4265550082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b015ae10 msgr2=0x7f559c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:04.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55af7fe640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b015ae10 0x7f559c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55af7fe640 1 -- 172.21.15.130:0/4265550082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f559c0039f0 msgr2=0x7f559c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:04.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55af7fe640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f559c0039f0 0x7f559c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.920+0000 7f55af7fe640 1 -- 172.21.15.130:0/4265550082 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c003530 con 0x7f559c004d10 2023-09-13T06:02:04.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.924+0000 7f55af7fe640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 0x7f559c005190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009b10 tx=0x7f55a801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff925a4fc4a1c35 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:04.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.924+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80a5540 con 0x7f559c004d10 2023-09-13T06:02:04.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.924+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a80a56a0 con 0x7f559c004d10 2023-09-13T06:02:04.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.924+0000 7f55ae7fc640 1 -- 172.21.15.130:0/4265550082 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80a5a50 con 0x7f559c004d10 2023-09-13T06:02:04.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.924+0000 7f55b58d8640 1 -- 172.21.15.130:0/4265550082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 msgr2=0x7f559c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.924+0000 7f55b58d8640 1 --2- 172.21.15.130:0/4265550082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 0x7f559c005190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009b10 tx=0x7f55a801ca60 comp rx=0 tx=0).stop 2023-09-13T06:02:04.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.924+0000 7f55af7fe640 1 -- 172.21.15.130:0/4265550082 reap_dead start 2023-09-13T06:02:04.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.924+0000 7f55b58d8640 1 -- 172.21.15.130:0/4265550082 shutdown_connections 2023-09-13T06:02:04.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.924+0000 7f55b58d8640 1 -- 172.21.15.130:0/4265550082 >> 172.21.15.130:0/4265550082 conn(0x7f55b0065990 msgr2=0x7f55b0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:04.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.924+0000 7f55b58d8640 1 -- 172.21.15.130:0/4265550082 shutdown_connections 2023-09-13T06:02:04.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.924+0000 7f55b58d8640 1 -- 172.21.15.130:0/4265550082 wait complete. 2023-09-13T06:02:04.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55b58d8640 1 Processor -- start 2023-09-13T06:02:04.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55b58d8640 1 -- start start 2023-09-13T06:02:04.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55b58d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 0x7f55b0156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55b58d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b01e9b90 0x7f55b015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55b58d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55b01ea010 0x7f55b015ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55b58d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0156ac0 con 0x7f559c004d10 2023-09-13T06:02:04.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55b58d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00c99e0 con 0x7f55b01ea010 2023-09-13T06:02:04.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55b58d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00c9cc0 con 0x7f55b01e9b90 2023-09-13T06:02:04.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55aeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 0x7f55b0156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55aeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 0x7f55b0156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42038/0 (socket says 172.21.15.130:42038) 2023-09-13T06:02:04.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55aeffd640 1 -- 172.21.15.130:0/8198722 learned_addr learned my addr 172.21.15.130:0/8198722 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:04.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55a67fc640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b01e9b90 0x7f55b015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55af7fe640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55b01ea010 0x7f55b015ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55aeffd640 1 -- 172.21.15.130:0/8198722 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b01e9b90 msgr2=0x7f55b015b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55aeffd640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b01e9b90 0x7f55b015b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55aeffd640 1 -- 172.21.15.130:0/8198722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55b01ea010 msgr2=0x7f55b015ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:04.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55aeffd640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55b01ea010 0x7f55b015ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:04.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55aeffd640 1 -- 172.21.15.130:0/8198722 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b00c9fa0 con 0x7f559c004d10 2023-09-13T06:02:04.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55af7fe640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55b01ea010 0x7f55b015ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:04.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55aeffd640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 0x7f55b0156580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f55a0011e30 tx=0x7f55a000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:04.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55acff9640 1 -- 172.21.15.130:0/8198722 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a000e040 con 0x7f559c004d10 2023-09-13T06:02:04.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55acff9640 1 -- 172.21.15.130:0/8198722 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a000f040 con 0x7f559c004d10 2023-09-13T06:02:04.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55b58d8640 1 -- 172.21.15.130:0/8198722 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b00ca280 con 0x7f559c004d10 2023-09-13T06:02:04.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55acff9640 1 -- 172.21.15.130:0/8198722 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0009c00 con 0x7f559c004d10 2023-09-13T06:02:04.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.928+0000 7f55b58d8640 1 -- 172.21.15.130:0/8198722 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b00caa80 con 0x7f559c004d10 2023-09-13T06:02:04.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.932+0000 7f55b58d8640 1 -- 172.21.15.130:0/8198722 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b00618a0 con 0x7f559c004d10 2023-09-13T06:02:04.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.932+0000 7f55acff9640 1 -- 172.21.15.130:0/8198722 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f55a0015850 con 0x7f559c004d10 2023-09-13T06:02:04.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.932+0000 7f55acff9640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 0x7f5590068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:04.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.932+0000 7f55acff9640 1 -- 172.21.15.130:0/8198722 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55a00841a0 con 0x7f559c004d10 2023-09-13T06:02:04.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.932+0000 7f55a67fc640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 0x7f5590068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:04.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.932+0000 7f55a67fc640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 0x7f5590068010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5598001ec0 tx=0x7f5598009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:04.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:04.936+0000 7f55acff9640 1 -- 172.21.15.130:0/8198722 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f55a0051a50 con 0x7f559c004d10 2023-09-13T06:02:05.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.080+0000 7f55b58d8640 1 -- 172.21.15.130:0/8198722 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55b00b68a0 con 0x7f559c004d10 2023-09-13T06:02:05.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.080+0000 7f55acff9640 1 -- 172.21.15.130:0/8198722 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55a0055070 con 0x7f559c004d10 2023-09-13T06:02:05.086 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:02:05.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 -- 172.21.15.130:0/8198722 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 msgr2=0x7f5590068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 0x7f5590068010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5598001ec0 tx=0x7f5598009040 comp rx=0 tx=0).stop 2023-09-13T06:02:05.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 -- 172.21.15.130:0/8198722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 msgr2=0x7f55b0156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 0x7f55b0156580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f55a0011e30 tx=0x7f55a000f580 comp rx=0 tx=0).stop 2023-09-13T06:02:05.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 -- 172.21.15.130:0/8198722 shutdown_connections 2023-09-13T06:02:05.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 0x7f5590068010 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55b01ea010 0x7f55b015ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55b01e9b90 0x7f55b015b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 --2- 172.21.15.130:0/8198722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f559c004d10 0x7f55b0156580 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 -- 172.21.15.130:0/8198722 >> 172.21.15.130:0/8198722 conn(0x7f55b0065990 msgr2=0x7f55b0159e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:05.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 -- 172.21.15.130:0/8198722 shutdown_connections 2023-09-13T06:02:05.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.084+0000 7f55b58d8640 1 -- 172.21.15.130:0/8198722 wait complete. 2023-09-13T06:02:05.106 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:02:05.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54d15ac640 1 Processor -- start 2023-09-13T06:02:05.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54d15ac640 1 -- start start 2023-09-13T06:02:05.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54d15ac640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f54cc15ae10 0x7f54cc0d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54d15ac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f54cc1619b0 0x7f54cc0cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54d15ac640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54cc15dd40 con 0x7f54cc0d2b00 2023-09-13T06:02:05.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54d15ac640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc161e40 con 0x7f54cc1619b0 2023-09-13T06:02:05.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54d15ac640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc15e020 con 0x7f54cc15ae10 2023-09-13T06:02:05.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54cb7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f54cc1619b0 0x7f54cc0cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54cb7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f54cc1619b0 0x7f54cc0cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42042/0 (socket says 172.21.15.130:42042) 2023-09-13T06:02:05.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54ca7fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f54cc0d2b00 0x7f54cc1612a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:32844/0 (socket says 172.21.15.130:32844) 2023-09-13T06:02:05.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54cb7fe640 1 -- 172.21.15.130:0/374295627 learned_addr learned my addr 172.21.15.130:0/374295627 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:05.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54caffd640 1 --2- 172.21.15.130:0/374295627 >> v2:172.21.15.164:3300/0 conn(0x7f54cc15ae10 0x7f54cc0d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54cb7fe640 1 -- 172.21.15.130:0/374295627 >> v2:172.21.15.164:3300/0 conn(0x7f54cc15ae10 msgr2=0x7f54cc0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:05.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54cb7fe640 1 --2- 172.21.15.130:0/374295627 >> v2:172.21.15.164:3300/0 conn(0x7f54cc15ae10 0x7f54cc0d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54cb7fe640 1 -- 172.21.15.130:0/374295627 >> v1:172.21.15.130:6789/0 conn(0x7f54cc0d2b00 legacy=0x7f54cc1612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54cb7fe640 1 -- 172.21.15.130:0/374295627 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc15e300 con 0x7f54cc1619b0 2023-09-13T06:02:05.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.244+0000 7f54caffd640 1 --2- 172.21.15.130:0/374295627 >> v2:172.21.15.164:3300/0 conn(0x7f54cc15ae10 0x7f54cc0d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:05.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54cb7fe640 1 --2- 172.21.15.130:0/374295627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54cc1619b0 0x7f54cc0cfd00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0669b0 tx=0x7f54c401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c81262c33dee1ca server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:05.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54c9ffb640 1 -- 172.21.15.130:0/374295627 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40a5760 con 0x7f54cc1619b0 2023-09-13T06:02:05.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54c9ffb640 1 -- 172.21.15.130:0/374295627 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c40a58c0 con 0x7f54cc1619b0 2023-09-13T06:02:05.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54c9ffb640 1 -- 172.21.15.130:0/374295627 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40a5c50 con 0x7f54cc1619b0 2023-09-13T06:02:05.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54d15ac640 1 -- 172.21.15.130:0/374295627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54cc1619b0 msgr2=0x7f54cc0cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54d15ac640 1 --2- 172.21.15.130:0/374295627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54cc1619b0 0x7f54cc0cfd00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0669b0 tx=0x7f54c401c880 comp rx=0 tx=0).stop 2023-09-13T06:02:05.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54d15ac640 1 -- 172.21.15.130:0/374295627 shutdown_connections 2023-09-13T06:02:05.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54d15ac640 1 --2- 172.21.15.130:0/374295627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54cc1619b0 0x7f54cc0cfd00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54d15ac640 1 --2- 172.21.15.130:0/374295627 >> v2:172.21.15.164:3300/0 conn(0x7f54cc15ae10 0x7f54cc0d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54d15ac640 1 -- 172.21.15.130:0/374295627 >> 172.21.15.130:0/374295627 conn(0x7f54cc065990 msgr2=0x7f54cc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:05.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54d15ac640 1 -- 172.21.15.130:0/374295627 shutdown_connections 2023-09-13T06:02:05.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54d15ac640 1 -- 172.21.15.130:0/374295627 wait complete. 2023-09-13T06:02:05.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.248+0000 7f54d15ac640 1 Processor -- start 2023-09-13T06:02:05.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54d15ac640 1 -- start start 2023-09-13T06:02:05.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54d15ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54cc0d2b00 0x7f54cc14b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54d15ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54cc15ae10 0x7f54cc157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54d15ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54cc1619b0 0x7f54cc153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54d15ac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc1534c0 con 0x7f54cc1619b0 2023-09-13T06:02:05.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54d15ac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc152420 con 0x7f54cc0d2b00 2023-09-13T06:02:05.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54d15ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc152700 con 0x7f54cc15ae10 2023-09-13T06:02:05.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54cb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54cc1619b0 0x7f54cc153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54cb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54cc1619b0 0x7f54cc153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42050/0 (socket says 172.21.15.130:42050) 2023-09-13T06:02:05.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54cb7fe640 1 -- 172.21.15.130:0/1221297612 learned_addr learned my addr 172.21.15.130:0/1221297612 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:05.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54caffd640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54cc0d2b00 0x7f54cc14b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54ca7fc640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54cc15ae10 0x7f54cc157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54cb7fe640 1 -- 172.21.15.130:0/1221297612 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54cc15ae10 msgr2=0x7f54cc157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54cb7fe640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54cc15ae10 0x7f54cc157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54cb7fe640 1 -- 172.21.15.130:0/1221297612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54cc0d2b00 msgr2=0x7f54cc14b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54cb7fe640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54cc0d2b00 0x7f54cc14b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54cb7fe640 1 -- 172.21.15.130:0/1221297612 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4009b30 con 0x7f54cc1619b0 2023-09-13T06:02:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54cb7fe640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54cc1619b0 0x7f54cc153d00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f54c40af040 tx=0x7f54c4019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54b37fe640 1 -- 172.21.15.130:0/1221297612 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40b8670 con 0x7f54cc1619b0 2023-09-13T06:02:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54b37fe640 1 -- 172.21.15.130:0/1221297612 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c40b87d0 con 0x7f54cc1619b0 2023-09-13T06:02:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54b37fe640 1 -- 172.21.15.130:0/1221297612 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40b8b60 con 0x7f54cc1619b0 2023-09-13T06:02:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54d15ac640 1 -- 172.21.15.130:0/1221297612 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc1529e0 con 0x7f54cc1619b0 2023-09-13T06:02:05.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54d15ac640 1 -- 172.21.15.130:0/1221297612 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc152fa0 con 0x7f54cc1619b0 2023-09-13T06:02:05.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.252+0000 7f54d15ac640 1 -- 172.21.15.130:0/1221297612 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54cc153190 con 0x7f54cc1619b0 2023-09-13T06:02:05.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.256+0000 7f54b37fe640 1 -- 172.21.15.130:0/1221297612 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f54c40b8cc0 con 0x7f54cc1619b0 2023-09-13T06:02:05.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.256+0000 7f54b37fe640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54b8065b20 0x7f54b8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.256+0000 7f54b37fe640 1 -- 172.21.15.130:0/1221297612 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54c411e920 con 0x7f54cc1619b0 2023-09-13T06:02:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.256+0000 7f54caffd640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54b8065b20 0x7f54b8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.256+0000 7f54caffd640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54b8065b20 0x7f54b8067fe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f54cc151a70 tx=0x7f54bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.260+0000 7f54b37fe640 1 -- 172.21.15.130:0/1221297612 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f54c40ec450 con 0x7f54cc1619b0 2023-09-13T06:02:05.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 -- 172.21.15.130:0/1221297612 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54cc0618a0 con 0x7f54cc1619b0 2023-09-13T06:02:05.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54b37fe640 1 -- 172.21.15.130:0/1221297612 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f54c40efa70 con 0x7f54cc1619b0 2023-09-13T06:02:05.415 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:02:05.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 -- 172.21.15.130:0/1221297612 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54b8065b20 msgr2=0x7f54b8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54b8065b20 0x7f54b8067fe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f54cc151a70 tx=0x7f54bc008040 comp rx=0 tx=0).stop 2023-09-13T06:02:05.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 -- 172.21.15.130:0/1221297612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54cc1619b0 msgr2=0x7f54cc153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54cc1619b0 0x7f54cc153d00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f54c40af040 tx=0x7f54c4019620 comp rx=0 tx=0).stop 2023-09-13T06:02:05.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 -- 172.21.15.130:0/1221297612 shutdown_connections 2023-09-13T06:02:05.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54b8065b20 0x7f54b8067fe0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54cc1619b0 0x7f54cc153d00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54cc15ae10 0x7f54cc157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 --2- 172.21.15.130:0/1221297612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54cc0d2b00 0x7f54cc14b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 -- 172.21.15.130:0/1221297612 >> 172.21.15.130:0/1221297612 conn(0x7f54cc065990 msgr2=0x7f54cc15b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:05.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 -- 172.21.15.130:0/1221297612 shutdown_connections 2023-09-13T06:02:05.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.412+0000 7f54d15ac640 1 -- 172.21.15.130:0/1221297612 wait complete. 2023-09-13T06:02:05.437 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:05.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.572+0000 7f39a2196640 1 Processor -- start 2023-09-13T06:02:05.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.572+0000 7f39a2196640 1 -- start start 2023-09-13T06:02:05.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f39a2196640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f399c0b1d20 0x7f399c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f39a2196640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c0ccfd0 con 0x7f399c0cdfc0 2023-09-13T06:02:05.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f39a2196640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c0ced90 con 0x7f399c159f20 2023-09-13T06:02:05.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f39a2196640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399c0ce430 con 0x7f399c0b1d20 2023-09-13T06:02:05.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f399bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f399c0cdfc0 0x7f399c0ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:32846/0 (socket says 172.21.15.130:32846) 2023-09-13T06:02:05.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f399bfff640 1 -- 172.21.15.130:0/1397039924 learned_addr learned my addr 172.21.15.130:0/1397039924 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:05.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f3993fff640 1 --2- 172.21.15.130:0/1397039924 >> v2:172.21.15.164:3300/0 conn(0x7f399c0b1d20 0x7f399c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f399affd640 1 -- 172.21.15.130:0/1397039924 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316614054 0 0) 0x7f399c0ccfd0 con 0x7f399c0cdfc0 2023-09-13T06:02:05.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f399affd640 1 -- 172.21.15.130:0/1397039924 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3988003530 con 0x7f399c0cdfc0 2023-09-13T06:02:05.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f3993fff640 1 -- 172.21.15.130:0/1397039924 >> v1:172.21.15.164:6789/0 conn(0x7f399c159f20 legacy=0x7f399c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f3993fff640 1 -- 172.21.15.130:0/1397039924 >> v1:172.21.15.130:6789/0 conn(0x7f399c0cdfc0 legacy=0x7f399c0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.576+0000 7f3993fff640 1 -- 172.21.15.130:0/1397039924 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c0cd200 con 0x7f399c0b1d20 2023-09-13T06:02:05.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f3993fff640 1 --2- 172.21.15.130:0/1397039924 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f399c0b1d20 0x7f399c0ce7b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f39840097f0 tx=0x7f398401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4987fa895683d89f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:05.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f399affd640 1 -- 172.21.15.130:0/1397039924 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840ab600 con 0x7f399c0b1d20 2023-09-13T06:02:05.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f399affd640 1 -- 172.21.15.130:0/1397039924 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39840a7050 con 0x7f399c0b1d20 2023-09-13T06:02:05.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f399affd640 1 -- 172.21.15.130:0/1397039924 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840ab980 con 0x7f399c0b1d20 2023-09-13T06:02:05.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f39a2196640 1 -- 172.21.15.130:0/1397039924 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f399c0b1d20 msgr2=0x7f399c0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f39a2196640 1 --2- 172.21.15.130:0/1397039924 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f399c0b1d20 0x7f399c0ce7b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f39840097f0 tx=0x7f398401c3f0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f39a2196640 1 -- 172.21.15.130:0/1397039924 shutdown_connections 2023-09-13T06:02:05.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f39a2196640 1 --2- 172.21.15.130:0/1397039924 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f399c0b1d20 0x7f399c0ce7b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f39a2196640 1 -- 172.21.15.130:0/1397039924 >> 172.21.15.130:0/1397039924 conn(0x7f399c065990 msgr2=0x7f399c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:05.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f39a2196640 1 -- 172.21.15.130:0/1397039924 shutdown_connections 2023-09-13T06:02:05.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f39a2196640 1 -- 172.21.15.130:0/1397039924 wait complete. 2023-09-13T06:02:05.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f39a2196640 1 Processor -- start 2023-09-13T06:02:05.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.580+0000 7f39a2196640 1 -- start start 2023-09-13T06:02:05.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f39a2196640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f399c0b1d20 0x7f399c14f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f39a2196640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f399c0cdfc0 0x7f399c13c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f39a2196640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f399c159f20 0x7f399c1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f39a2196640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c150470 con 0x7f399c159f20 2023-09-13T06:02:05.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f39a2196640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c14f860 con 0x7f399c0cdfc0 2023-09-13T06:02:05.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f39a2196640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c14fb40 con 0x7f399c0b1d20 2023-09-13T06:02:05.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f399bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f399c159f20 0x7f399c1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f399bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f399c159f20 0x7f399c1546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42056/0 (socket says 172.21.15.130:42056) 2023-09-13T06:02:05.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f399bfff640 1 -- 172.21.15.130:0/3348495885 learned_addr learned my addr 172.21.15.130:0/3348495885 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:05.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f3993fff640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f399c0cdfc0 0x7f399c13c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f399b7fe640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f399c0b1d20 0x7f399c14f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f399bfff640 1 -- 172.21.15.130:0/3348495885 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f399c0b1d20 msgr2=0x7f399c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f399bfff640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f399c0b1d20 0x7f399c14f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f399bfff640 1 -- 172.21.15.130:0/3348495885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f399c0cdfc0 msgr2=0x7f399c13c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f399bfff640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f399c0cdfc0 0x7f399c13c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f399bfff640 1 -- 172.21.15.130:0/3348495885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3984009420 con 0x7f399c159f20 2023-09-13T06:02:05.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f399bfff640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f399c159f20 0x7f399c1546e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f399400caa0 tx=0x7f399400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:05.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f3998ff9640 1 -- 172.21.15.130:0/3348495885 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399400ac00 con 0x7f399c159f20 2023-09-13T06:02:05.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f3998ff9640 1 -- 172.21.15.130:0/3348495885 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399400ad60 con 0x7f399c159f20 2023-09-13T06:02:05.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f3998ff9640 1 -- 172.21.15.130:0/3348495885 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994012620 con 0x7f399c159f20 2023-09-13T06:02:05.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f39a2196640 1 -- 172.21.15.130:0/3348495885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399c14fe20 con 0x7f399c159f20 2023-09-13T06:02:05.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f39a2196640 1 -- 172.21.15.130:0/3348495885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c14f570 con 0x7f399c159f20 2023-09-13T06:02:05.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f39a2196640 1 -- 172.21.15.130:0/3348495885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399c1505e0 con 0x7f399c159f20 2023-09-13T06:02:05.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.584+0000 7f3998ff9640 1 -- 172.21.15.130:0/3348495885 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3994007070 con 0x7f399c159f20 2023-09-13T06:02:05.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.588+0000 7f3998ff9640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f397c065b20 0x7f397c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.588+0000 7f3998ff9640 1 -- 172.21.15.130:0/3348495885 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39940832b0 con 0x7f399c159f20 2023-09-13T06:02:05.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.588+0000 7f399b7fe640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f397c065b20 0x7f397c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.588+0000 7f399b7fe640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f397c065b20 0x7f397c067fe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f398c007fd0 tx=0x7f398c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:05.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.592+0000 7f3998ff9640 1 -- 172.21.15.130:0/3348495885 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3994050c10 con 0x7f399c159f20 2023-09-13T06:02:05.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.776+0000 7f39a2196640 1 -- 172.21.15.130:0/3348495885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f399c0618a0 con 0x7f399c159f20 2023-09-13T06:02:05.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.776+0000 7f3998ff9640 1 -- 172.21.15.130:0/3348495885 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f3994054230 con 0x7f399c159f20 2023-09-13T06:02:05.781 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:05.781 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1779716448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1779716448},{"type":"v1","addr":"172.21.15.130:6837","nonce":1779716448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1022199494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":1022199494},{"type":"v1","addr":"172.21.15.164:6835","nonce":1022199494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3130227261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3130227261},{"type":"v1","addr":"172.21.15.164:6834","nonce":3130227261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:01:25.693319+0000","modified":"2023-09-13T06:01:28.718115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/660561895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":660561895},{"type":"v1","addr":"172.21.15.130:6836","nonce":660561895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T06:02:05.782 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 7 2023-09-13T06:02:05.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 -- 172.21.15.130:0/3348495885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f397c065b20 msgr2=0x7f397c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f397c065b20 0x7f397c067fe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f398c007fd0 tx=0x7f398c009040 comp rx=0 tx=0).stop 2023-09-13T06:02:05.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 -- 172.21.15.130:0/3348495885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f399c159f20 msgr2=0x7f399c1546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f399c159f20 0x7f399c1546e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f399400caa0 tx=0x7f399400cf60 comp rx=0 tx=0).stop 2023-09-13T06:02:05.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 -- 172.21.15.130:0/3348495885 shutdown_connections 2023-09-13T06:02:05.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f397c065b20 0x7f397c067fe0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f399c0cdfc0 0x7f399c13c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f399c159f20 0x7f399c1546e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 --2- 172.21.15.130:0/3348495885 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f399c0b1d20 0x7f399c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 -- 172.21.15.130:0/3348495885 >> 172.21.15.130:0/3348495885 conn(0x7f399c065990 msgr2=0x7f399c06f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:05.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 -- 172.21.15.130:0/3348495885 shutdown_connections 2023-09-13T06:02:05.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.780+0000 7f39a2196640 1 -- 172.21.15.130:0/3348495885 wait complete. 2023-09-13T06:02:05.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:05.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f39597c6640 1 Processor -- start 2023-09-13T06:02:05.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f39597c6640 1 -- start start 2023-09-13T06:02:05.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f39597c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39540d1090 0x7f395415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f39597c6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3954146f30 0x7f39540b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f39597c6640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39540b63c0 con 0x7f39540d1750 2023-09-13T06:02:05.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f39597c6640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395415dea0 con 0x7f3954146f30 2023-09-13T06:02:05.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f39597c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39540d0c20 con 0x7f39540d1090 2023-09-13T06:02:05.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f39537fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3954146f30 0x7f39540b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f394a7fc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39540d1090 0x7f395415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f3952ffd640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f39540d1750 0x7f3954146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:52124/0 (socket says 172.21.15.130:52124) 2023-09-13T06:02:05.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f3952ffd640 1 -- 172.21.15.130:0/801476229 learned_addr learned my addr 172.21.15.130:0/801476229 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:05.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f394a7fc640 1 -- 172.21.15.130:0/801476229 >> v2:172.21.15.164:3300/0 conn(0x7f3954146f30 msgr2=0x7f39540b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:05.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f394a7fc640 1 --2- 172.21.15.130:0/801476229 >> v2:172.21.15.164:3300/0 conn(0x7f3954146f30 0x7f39540b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f394a7fc640 1 -- 172.21.15.130:0/801476229 >> v1:172.21.15.164:6789/0 conn(0x7f39540d1750 legacy=0x7f3954146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f394a7fc640 1 -- 172.21.15.130:0/801476229 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39540b6610 con 0x7f39540d1090 2023-09-13T06:02:05.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.936+0000 7f39537fe640 1 --2- 172.21.15.130:0/801476229 >> v2:172.21.15.164:3300/0 conn(0x7f3954146f30 0x7f39540b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:05.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f394a7fc640 1 --2- 172.21.15.130:0/801476229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39540d1090 0x7f395415d960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f393c009d90 tx=0x7f393c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a7f59b733eefc3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:05.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f39527fc640 1 -- 172.21.15.130:0/801476229 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0a59e0 con 0x7f39540d1090 2023-09-13T06:02:05.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f39527fc640 1 -- 172.21.15.130:0/801476229 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c0a5b40 con 0x7f39540d1090 2023-09-13T06:02:05.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f39527fc640 1 -- 172.21.15.130:0/801476229 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0ad440 con 0x7f39540d1090 2023-09-13T06:02:05.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f39597c6640 1 -- 172.21.15.130:0/801476229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39540d1090 msgr2=0x7f395415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f39597c6640 1 --2- 172.21.15.130:0/801476229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39540d1090 0x7f395415d960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f393c009d90 tx=0x7f393c01c920 comp rx=0 tx=0).stop 2023-09-13T06:02:05.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f39597c6640 1 -- 172.21.15.130:0/801476229 shutdown_connections 2023-09-13T06:02:05.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f39597c6640 1 --2- 172.21.15.130:0/801476229 >> v2:172.21.15.164:3300/0 conn(0x7f3954146f30 0x7f39540b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f39597c6640 1 --2- 172.21.15.130:0/801476229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39540d1090 0x7f395415d960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f39597c6640 1 -- 172.21.15.130:0/801476229 >> 172.21.15.130:0/801476229 conn(0x7f395406f170 msgr2=0x7f395406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:05.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f39597c6640 1 -- 172.21.15.130:0/801476229 shutdown_connections 2023-09-13T06:02:05.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.940+0000 7f39597c6640 1 -- 172.21.15.130:0/801476229 wait complete. 2023-09-13T06:02:05.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f39597c6640 1 Processor -- start 2023-09-13T06:02:05.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f39597c6640 1 -- start start 2023-09-13T06:02:05.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f39597c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39540d1090 0x7f39540b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f39597c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39540d1750 0x7f395415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f39597c6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3954146f30 0x7f39541446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f39597c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395415b360 con 0x7f39540d1750 2023-09-13T06:02:05.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f39597c6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3954144f40 con 0x7f3954146f30 2023-09-13T06:02:05.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f39597c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3954145220 con 0x7f39540d1090 2023-09-13T06:02:05.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39540d1750 0x7f395415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39540d1750 0x7f395415ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42066/0 (socket says 172.21.15.130:42066) 2023-09-13T06:02:05.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394a7fc640 1 -- 172.21.15.130:0/4104110553 learned_addr learned my addr 172.21.15.130:0/4104110553 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:05.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f3952ffd640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39540d1090 0x7f39540b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f39537fe640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3954146f30 0x7f39541446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394a7fc640 1 -- 172.21.15.130:0/4104110553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39540d1090 msgr2=0x7f39540b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394a7fc640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39540d1090 0x7f39540b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394a7fc640 1 -- 172.21.15.130:0/4104110553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3954146f30 msgr2=0x7f39541446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:05.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394a7fc640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3954146f30 0x7f39541446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:05.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394a7fc640 1 -- 172.21.15.130:0/4104110553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c009420 con 0x7f39540d1750 2023-09-13T06:02:05.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394a7fc640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39540d1750 0x7f395415ae20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f393c01a550 tx=0x7f393c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:05.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394bfff640 1 -- 172.21.15.130:0/4104110553 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0ade30 con 0x7f39540d1750 2023-09-13T06:02:05.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394bfff640 1 -- 172.21.15.130:0/4104110553 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c009450 con 0x7f39540d1750 2023-09-13T06:02:05.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f39597c6640 1 -- 172.21.15.130:0/4104110553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c009a70 con 0x7f39540d1750 2023-09-13T06:02:05.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f394bfff640 1 -- 172.21.15.130:0/4104110553 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0b9690 con 0x7f39540d1750 2023-09-13T06:02:05.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.944+0000 7f39597c6640 1 -- 172.21.15.130:0/4104110553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39540b7e40 con 0x7f39540d1750 2023-09-13T06:02:05.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.948+0000 7f39597c6640 1 -- 172.21.15.130:0/4104110553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39540618a0 con 0x7f39540d1750 2023-09-13T06:02:05.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.948+0000 7f394bfff640 1 -- 172.21.15.130:0/4104110553 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f393c0b97f0 con 0x7f39540d1750 2023-09-13T06:02:05.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.948+0000 7f394bfff640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3934065b20 0x7f3934067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:05.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.948+0000 7f394bfff640 1 -- 172.21.15.130:0/4104110553 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f393c11e9f0 con 0x7f39540d1750 2023-09-13T06:02:05.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.948+0000 7f3952ffd640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3934065b20 0x7f3934067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:05.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.948+0000 7f3952ffd640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3934065b20 0x7f3934067fe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3944005890 tx=0x7f3944009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:05.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:05.952+0000 7f394bfff640 1 -- 172.21.15.130:0/4104110553 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f393c0ec3c0 con 0x7f39540d1750 2023-09-13T06:02:06.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.100+0000 7f39597c6640 1 -- 172.21.15.130:0/4104110553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39541680f0 con 0x7f39540d1750 2023-09-13T06:02:06.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.100+0000 7f394bfff640 1 -- 172.21.15.130:0/4104110553 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f393c0ef9e0 con 0x7f39540d1750 2023-09-13T06:02:06.106 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:06.106 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:06.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 -- 172.21.15.130:0/4104110553 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3934065b20 msgr2=0x7f3934067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3934065b20 0x7f3934067fe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3944005890 tx=0x7f3944009040 comp rx=0 tx=0).stop 2023-09-13T06:02:06.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 -- 172.21.15.130:0/4104110553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39540d1750 msgr2=0x7f395415ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39540d1750 0x7f395415ae20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f393c01a550 tx=0x7f393c0196c0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 -- 172.21.15.130:0/4104110553 shutdown_connections 2023-09-13T06:02:06.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3934065b20 0x7f3934067fe0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3954146f30 0x7f39541446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39540d1750 0x7f395415ae20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 --2- 172.21.15.130:0/4104110553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39540d1090 0x7f39540b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 -- 172.21.15.130:0/4104110553 >> 172.21.15.130:0/4104110553 conn(0x7f395406f170 msgr2=0x7f395415fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:06.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 -- 172.21.15.130:0/4104110553 shutdown_connections 2023-09-13T06:02:06.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.104+0000 7f39597c6640 1 -- 172.21.15.130:0/4104110553 wait complete. 2023-09-13T06:02:06.127 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:02:06.128 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:06.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.260+0000 7fc94c89c640 1 Processor -- start 2023-09-13T06:02:06.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc94c89c640 1 -- start start 2023-09-13T06:02:06.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc94c89c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc9480d1750 0x7fc94815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc94c89c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc948146f30 0x7fc9480b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc94c89c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9480b63c0 con 0x7fc9480d1090 2023-09-13T06:02:06.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc94c89c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94815dea0 con 0x7fc9480d1750 2023-09-13T06:02:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc94c89c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480d0c20 con 0x7fc948146f30 2023-09-13T06:02:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc94659c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc9480d1750 0x7fc94815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc93dd9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc9480d1090 0x7fc948146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:32862/0 (socket says 172.21.15.130:32862) 2023-09-13T06:02:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc93dd9b640 1 -- 172.21.15.130:0/2291727207 learned_addr learned my addr 172.21.15.130:0/2291727207 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc946d9d640 1 --2- 172.21.15.130:0/2291727207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc948146f30 0x7fc9480b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc94659c640 1 -- 172.21.15.130:0/2291727207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc948146f30 msgr2=0x7fc9480b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc94659c640 1 --2- 172.21.15.130:0/2291727207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc948146f30 0x7fc9480b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc94659c640 1 -- 172.21.15.130:0/2291727207 >> v1:172.21.15.130:6789/0 conn(0x7fc9480d1090 legacy=0x7fc948146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc94659c640 1 -- 172.21.15.130:0/2291727207 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480b6610 con 0x7fc9480d1750 2023-09-13T06:02:06.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc946d9d640 1 --2- 172.21.15.130:0/2291727207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc948146f30 0x7fc9480b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:06.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.264+0000 7fc945d9b640 1 -- 172.21.15.130:0/2291727207 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881242192 0 0) 0x7fc9480b63c0 con 0x7fc9480d1090 2023-09-13T06:02:06.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc94659c640 1 --2- 172.21.15.130:0/2291727207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9480d1750 0x7fc94815d960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc9380097c0 tx=0x7fc93801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1740624ead70a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:06.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc945d9b640 1 -- 172.21.15.130:0/2291727207 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380ab650 con 0x7fc9480d1750 2023-09-13T06:02:06.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc945d9b640 1 -- 172.21.15.130:0/2291727207 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9380ab7b0 con 0x7fc9480d1750 2023-09-13T06:02:06.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc945d9b640 1 -- 172.21.15.130:0/2291727207 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380abb40 con 0x7fc9480d1750 2023-09-13T06:02:06.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc94c89c640 1 -- 172.21.15.130:0/2291727207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9480d1750 msgr2=0x7fc94815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc94c89c640 1 --2- 172.21.15.130:0/2291727207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9480d1750 0x7fc94815d960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc9380097c0 tx=0x7fc93801c450 comp rx=0 tx=0).stop 2023-09-13T06:02:06.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc94c89c640 1 -- 172.21.15.130:0/2291727207 shutdown_connections 2023-09-13T06:02:06.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc94c89c640 1 --2- 172.21.15.130:0/2291727207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc948146f30 0x7fc9480b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc94c89c640 1 --2- 172.21.15.130:0/2291727207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9480d1750 0x7fc94815d960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc94c89c640 1 -- 172.21.15.130:0/2291727207 >> 172.21.15.130:0/2291727207 conn(0x7fc94806f170 msgr2=0x7fc94806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:06.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc94c89c640 1 -- 172.21.15.130:0/2291727207 shutdown_connections 2023-09-13T06:02:06.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc94c89c640 1 -- 172.21.15.130:0/2291727207 wait complete. 2023-09-13T06:02:06.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc94c89c640 1 Processor -- start 2023-09-13T06:02:06.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.268+0000 7fc94c89c640 1 -- start start 2023-09-13T06:02:06.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc94c89c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9480d1090 0x7fc9480cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc94c89c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9480d1750 0x7fc94815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc94c89c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc948146f30 0x7fc9480cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc94c89c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815d340 con 0x7fc948146f30 2023-09-13T06:02:06.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc94c89c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480ce060 con 0x7fc9480d1750 2023-09-13T06:02:06.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc94c89c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480ce340 con 0x7fc9480d1090 2023-09-13T06:02:06.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc946d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc948146f30 0x7fc9480cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc946d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc948146f30 0x7fc9480cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42078/0 (socket says 172.21.15.130:42078) 2023-09-13T06:02:06.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc946d9d640 1 -- 172.21.15.130:0/2254608938 learned_addr learned my addr 172.21.15.130:0/2254608938 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:06.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc94659c640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9480d1090 0x7fc9480cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc93dd9b640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9480d1750 0x7fc94815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc946d9d640 1 -- 172.21.15.130:0/2254608938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9480d1090 msgr2=0x7fc9480cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc946d9d640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9480d1090 0x7fc9480cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc946d9d640 1 -- 172.21.15.130:0/2254608938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9480d1750 msgr2=0x7fc94815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc946d9d640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9480d1750 0x7fc94815ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc946d9d640 1 -- 172.21.15.130:0/2254608938 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc938009420 con 0x7fc948146f30 2023-09-13T06:02:06.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc94659c640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9480d1090 0x7fc9480cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:06.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc93dd9b640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9480d1750 0x7fc94815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:06.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc946d9d640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc948146f30 0x7fc9480cb460 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc94000d800 tx=0x7fc94000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:06.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc93f7fe640 1 -- 172.21.15.130:0/2254608938 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400096a0 con 0x7fc948146f30 2023-09-13T06:02:06.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc93f7fe640 1 -- 172.21.15.130:0/2254608938 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc940009800 con 0x7fc948146f30 2023-09-13T06:02:06.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc93f7fe640 1 -- 172.21.15.130:0/2254608938 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940009bb0 con 0x7fc948146f30 2023-09-13T06:02:06.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc94c89c640 1 -- 172.21.15.130:0/2254608938 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9480b7e40 con 0x7fc948146f30 2023-09-13T06:02:06.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc94c89c640 1 -- 172.21.15.130:0/2254608938 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9480c8d00 con 0x7fc948146f30 2023-09-13T06:02:06.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc94c89c640 1 -- 172.21.15.130:0/2254608938 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9480c8880 con 0x7fc948146f30 2023-09-13T06:02:06.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.272+0000 7fc93f7fe640 1 -- 172.21.15.130:0/2254608938 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc940009d10 con 0x7fc948146f30 2023-09-13T06:02:06.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.276+0000 7fc93f7fe640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc928065b20 0x7fc928067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.276+0000 7fc93f7fe640 1 -- 172.21.15.130:0/2254608938 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc940083780 con 0x7fc948146f30 2023-09-13T06:02:06.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.276+0000 7fc94659c640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc928065b20 0x7fc928067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.276+0000 7fc94659c640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc928065b20 0x7fc928067fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc9380af000 tx=0x7fc9380a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:06.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.280+0000 7fc93f7fe640 1 -- 172.21.15.130:0/2254608938 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc9480c8880 con 0x7fc948146f30 2023-09-13T06:02:06.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.464+0000 7fc94c89c640 1 -- 172.21.15.130:0/2254608938 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9480c8880 con 0x7fc948146f30 2023-09-13T06:02:06.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.464+0000 7fc93f7fe640 1 -- 172.21.15.130:0/2254608938 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fc9480c8880 con 0x7fc948146f30 2023-09-13T06:02:06.470 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:06.470 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1779716448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1779716448},{"type":"v1","addr":"172.21.15.130:6837","nonce":1779716448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1022199494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":1022199494},{"type":"v1","addr":"172.21.15.164:6835","nonce":1022199494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3130227261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3130227261},{"type":"v1","addr":"172.21.15.164:6834","nonce":3130227261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:01:25.693319+0000","modified":"2023-09-13T06:01:28.718115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/660561895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":660561895},{"type":"v1","addr":"172.21.15.130:6836","nonce":660561895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T06:02:06.471 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 7 2023-09-13T06:02:06.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 -- 172.21.15.130:0/2254608938 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc928065b20 msgr2=0x7fc928067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc928065b20 0x7fc928067fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc9380af000 tx=0x7fc9380a7000 comp rx=0 tx=0).stop 2023-09-13T06:02:06.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 -- 172.21.15.130:0/2254608938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc948146f30 msgr2=0x7fc9480cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc948146f30 0x7fc9480cb460 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc94000d800 tx=0x7fc94000dcc0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 -- 172.21.15.130:0/2254608938 shutdown_connections 2023-09-13T06:02:06.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc928065b20 0x7fc928067fe0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9480d1750 0x7fc94815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc948146f30 0x7fc9480cb460 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 --2- 172.21.15.130:0/2254608938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9480d1090 0x7fc9480cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 -- 172.21.15.130:0/2254608938 >> 172.21.15.130:0/2254608938 conn(0x7fc94806f170 msgr2=0x7fc948142bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:06.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 -- 172.21.15.130:0/2254608938 shutdown_connections 2023-09-13T06:02:06.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.468+0000 7fc94c89c640 1 -- 172.21.15.130:0/2254608938 wait complete. 2023-09-13T06:02:06.492 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:06.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.624+0000 7f389f5db640 1 Processor -- start 2023-09-13T06:02:06.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.624+0000 7f389f5db640 1 -- start start 2023-09-13T06:02:06.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389f5db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3898159f20 0x7f38980ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389f5db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38980cdfc0 0x7f38980b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389f5db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38980ccfd0 con 0x7f38980b1610 2023-09-13T06:02:06.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389f5db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38980b00f0 con 0x7f3898159f20 2023-09-13T06:02:06.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389f5db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38980ce420 con 0x7f38980cdfc0 2023-09-13T06:02:06.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389d377640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3898159f20 0x7f38980ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389d377640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3898159f20 0x7f38980ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42084/0 (socket says 172.21.15.130:42084) 2023-09-13T06:02:06.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389d377640 1 -- 172.21.15.130:0/3239086126 learned_addr learned my addr 172.21.15.130:0/3239086126 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:06.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389cb76640 1 --2- 172.21.15.130:0/3239086126 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38980cdfc0 0x7f38980b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389d377640 1 -- 172.21.15.130:0/3239086126 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38980cdfc0 msgr2=0x7f38980b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:06.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389d377640 1 --2- 172.21.15.130:0/3239086126 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38980cdfc0 0x7f38980b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389d377640 1 -- 172.21.15.130:0/3239086126 >> v1:172.21.15.164:6789/0 conn(0x7f38980b1610 legacy=0x7f38980ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.628+0000 7f389d377640 1 -- 172.21.15.130:0/3239086126 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980ced90 con 0x7f3898159f20 2023-09-13T06:02:06.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f389d377640 1 --2- 172.21.15.130:0/3239086126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3898159f20 0x7f38980ce7b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3894009870 tx=0x7f389401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3580b6d554c4d465 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:06.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f388ffff640 1 -- 172.21.15.130:0/3239086126 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38940a7070 con 0x7f3898159f20 2023-09-13T06:02:06.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f388ffff640 1 -- 172.21.15.130:0/3239086126 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38940ab430 con 0x7f3898159f20 2023-09-13T06:02:06.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f388ffff640 1 -- 172.21.15.130:0/3239086126 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38940ab7c0 con 0x7f3898159f20 2023-09-13T06:02:06.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f389f5db640 1 -- 172.21.15.130:0/3239086126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3898159f20 msgr2=0x7f38980ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f389f5db640 1 --2- 172.21.15.130:0/3239086126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3898159f20 0x7f38980ce7b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3894009870 tx=0x7f389401c540 comp rx=0 tx=0).stop 2023-09-13T06:02:06.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f389f5db640 1 -- 172.21.15.130:0/3239086126 shutdown_connections 2023-09-13T06:02:06.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f389f5db640 1 --2- 172.21.15.130:0/3239086126 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38980cdfc0 0x7f38980b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f389f5db640 1 --2- 172.21.15.130:0/3239086126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3898159f20 0x7f38980ce7b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f389f5db640 1 -- 172.21.15.130:0/3239086126 >> 172.21.15.130:0/3239086126 conn(0x7f3898065990 msgr2=0x7f3898065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:06.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f389f5db640 1 -- 172.21.15.130:0/3239086126 shutdown_connections 2023-09-13T06:02:06.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f389f5db640 1 -- 172.21.15.130:0/3239086126 wait complete. 2023-09-13T06:02:06.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f389f5db640 1 Processor -- start 2023-09-13T06:02:06.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.632+0000 7f389f5db640 1 -- start start 2023-09-13T06:02:06.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389f5db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38980b1610 0x7f389814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389f5db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38980cdfc0 0x7f38981560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389f5db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3898159f20 0x7f389806ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389f5db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38981575d0 con 0x7f3898159f20 2023-09-13T06:02:06.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389f5db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3898156950 con 0x7f38980b1610 2023-09-13T06:02:06.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389f5db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3898156c30 con 0x7f38980cdfc0 2023-09-13T06:02:06.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389db78640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3898159f20 0x7f389806ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389db78640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3898159f20 0x7f389806ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42090/0 (socket says 172.21.15.130:42090) 2023-09-13T06:02:06.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389db78640 1 -- 172.21.15.130:0/3788175843 learned_addr learned my addr 172.21.15.130:0/3788175843 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:06.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389cb76640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38980cdfc0 0x7f38981560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389d377640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38980b1610 0x7f389814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389db78640 1 -- 172.21.15.130:0/3788175843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38980cdfc0 msgr2=0x7f38981560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389db78640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38980cdfc0 0x7f38981560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389db78640 1 -- 172.21.15.130:0/3788175843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38980b1610 msgr2=0x7f389814d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389db78640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38980b1610 0x7f389814d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389db78640 1 -- 172.21.15.130:0/3788175843 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940094d0 con 0x7f3898159f20 2023-09-13T06:02:06.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389db78640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3898159f20 0x7f389806ce50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f389000c6c0 tx=0x7f389000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:06.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f388dffb640 1 -- 172.21.15.130:0/3788175843 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890003b80 con 0x7f3898159f20 2023-09-13T06:02:06.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f388dffb640 1 -- 172.21.15.130:0/3788175843 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3890003ce0 con 0x7f3898159f20 2023-09-13T06:02:06.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f388dffb640 1 -- 172.21.15.130:0/3788175843 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38900052f0 con 0x7f3898159f20 2023-09-13T06:02:06.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389f5db640 1 -- 172.21.15.130:0/3788175843 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3898156f10 con 0x7f3898159f20 2023-09-13T06:02:06.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389f5db640 1 -- 172.21.15.130:0/3788175843 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3898156620 con 0x7f3898159f20 2023-09-13T06:02:06.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f389f5db640 1 -- 172.21.15.130:0/3788175843 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38980618a0 con 0x7f3898159f20 2023-09-13T06:02:06.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.636+0000 7f388dffb640 1 -- 172.21.15.130:0/3788175843 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3890005450 con 0x7f3898159f20 2023-09-13T06:02:06.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.640+0000 7f388dffb640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f387c065b50 0x7f387c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.640+0000 7f388dffb640 1 -- 172.21.15.130:0/3788175843 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3890082ff0 con 0x7f3898159f20 2023-09-13T06:02:06.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.640+0000 7f389d377640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f387c065b50 0x7f387c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.640+0000 7f389d377640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f387c065b50 0x7f387c068010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38940af000 tx=0x7f3894008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:06.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.644+0000 7f388dffb640 1 -- 172.21.15.130:0/3788175843 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3890050990 con 0x7f3898159f20 2023-09-13T06:02:06.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 -- 172.21.15.130:0/3788175843 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38980adc20 con 0x7f3898159f20 2023-09-13T06:02:06.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f388dffb640 1 -- 172.21.15.130:0/3788175843 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f3890053fb0 con 0x7f3898159f20 2023-09-13T06:02:06.828 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:06.829 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1779716448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1779716448},{"type":"v1","addr":"172.21.15.130:6837","nonce":1779716448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1022199494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":1022199494},{"type":"v1","addr":"172.21.15.164:6835","nonce":1022199494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3130227261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3130227261},{"type":"v1","addr":"172.21.15.164:6834","nonce":3130227261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:01:25.693319+0000","modified":"2023-09-13T06:01:28.718115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/660561895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":660561895},{"type":"v1","addr":"172.21.15.130:6836","nonce":660561895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T06:02:06.830 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 7 2023-09-13T06:02:06.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 -- 172.21.15.130:0/3788175843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f387c065b50 msgr2=0x7f387c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f387c065b50 0x7f387c068010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38940af000 tx=0x7f3894008040 comp rx=0 tx=0).stop 2023-09-13T06:02:06.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 -- 172.21.15.130:0/3788175843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3898159f20 msgr2=0x7f389806ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3898159f20 0x7f389806ce50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f389000c6c0 tx=0x7f389000cb80 comp rx=0 tx=0).stop 2023-09-13T06:02:06.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 -- 172.21.15.130:0/3788175843 shutdown_connections 2023-09-13T06:02:06.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f387c065b50 0x7f387c068010 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3898159f20 0x7f389806ce50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38980cdfc0 0x7f38981560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 --2- 172.21.15.130:0/3788175843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38980b1610 0x7f389814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 -- 172.21.15.130:0/3788175843 >> 172.21.15.130:0/3788175843 conn(0x7f3898065990 msgr2=0x7f389806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:06.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 -- 172.21.15.130:0/3788175843 shutdown_connections 2023-09-13T06:02:06.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.824+0000 7f389f5db640 1 -- 172.21.15.130:0/3788175843 wait complete. 2023-09-13T06:02:06.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:06.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7359e640 1 Processor -- start 2023-09-13T06:02:06.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7359e640 1 -- start start 2023-09-13T06:02:06.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7359e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6f74146eb0 0x7f6f740b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7359e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6f740b7ca0 0x7f6f740b8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7359e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f74071440 con 0x7f6f74161100 2023-09-13T06:02:06.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7359e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f740b5130 con 0x7f6f74146eb0 2023-09-13T06:02:06.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7359e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f740706a0 con 0x7f6f740b7ca0 2023-09-13T06:02:06.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6f74146eb0 0x7f6f740b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6f74146eb0 0x7f6f740b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42096/0 (socket says 172.21.15.130:42096) 2023-09-13T06:02:06.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7259c640 1 -- 172.21.15.130:0/2394347984 learned_addr learned my addr 172.21.15.130:0/2394347984 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:06.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f72d9d640 1 --2- 172.21.15.130:0/2394347984 >> v2:172.21.15.164:3300/0 conn(0x7f6f740b7ca0 0x7f6f740b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:06.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7259c640 1 -- 172.21.15.130:0/2394347984 >> v2:172.21.15.164:3300/0 conn(0x7f6f740b7ca0 msgr2=0x7f6f740b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:06.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7259c640 1 --2- 172.21.15.130:0/2394347984 >> v2:172.21.15.164:3300/0 conn(0x7f6f740b7ca0 0x7f6f740b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7259c640 1 -- 172.21.15.130:0/2394347984 >> v1:172.21.15.130:6789/0 conn(0x7f6f74161100 legacy=0x7f6f74161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.984+0000 7f6f7259c640 1 -- 172.21.15.130:0/2394347984 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f74147290 con 0x7f6f74146eb0 2023-09-13T06:02:06.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f7259c640 1 --2- 172.21.15.130:0/2394347984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f74146eb0 0x7f6f740b64e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6f740b5270 tx=0x7f6f6401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a551af3a987e37 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:06.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f71d9b640 1 -- 172.21.15.130:0/2394347984 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f640aa430 con 0x7f6f74146eb0 2023-09-13T06:02:06.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f71d9b640 1 -- 172.21.15.130:0/2394347984 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f640aa590 con 0x7f6f74146eb0 2023-09-13T06:02:06.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f71d9b640 1 -- 172.21.15.130:0/2394347984 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f640aa920 con 0x7f6f74146eb0 2023-09-13T06:02:06.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f7359e640 1 -- 172.21.15.130:0/2394347984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f74146eb0 msgr2=0x7f6f740b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:06.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f7359e640 1 --2- 172.21.15.130:0/2394347984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f74146eb0 0x7f6f740b64e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6f740b5270 tx=0x7f6f6401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f7359e640 1 -- 172.21.15.130:0/2394347984 shutdown_connections 2023-09-13T06:02:06.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f7359e640 1 --2- 172.21.15.130:0/2394347984 >> v2:172.21.15.164:3300/0 conn(0x7f6f740b7ca0 0x7f6f740b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f7359e640 1 --2- 172.21.15.130:0/2394347984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f74146eb0 0x7f6f740b64e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:06.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f7359e640 1 -- 172.21.15.130:0/2394347984 >> 172.21.15.130:0/2394347984 conn(0x7f6f740cdd10 msgr2=0x7f6f740ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:06.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f7359e640 1 -- 172.21.15.130:0/2394347984 shutdown_connections 2023-09-13T06:02:06.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f7359e640 1 -- 172.21.15.130:0/2394347984 wait complete. 2023-09-13T06:02:06.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f7359e640 1 Processor -- start 2023-09-13T06:02:06.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.988+0000 7f6f7359e640 1 -- start start 2023-09-13T06:02:06.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f7359e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f740b7ca0 0x7f6f7415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f7359e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f74146eb0 0x7f6f74156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f7359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f74161100 0x7f6f741553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:06.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f7359e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f74155eb0 con 0x7f6f74161100 2023-09-13T06:02:06.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f7359e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f74156190 con 0x7f6f740b7ca0 2023-09-13T06:02:06.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f7359e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f74156470 con 0x7f6f74146eb0 2023-09-13T06:02:07.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f72d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f74161100 0x7f6f741553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f72d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f74161100 0x7f6f741553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42106/0 (socket says 172.21.15.130:42106) 2023-09-13T06:02:07.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f72d9d640 1 -- 172.21.15.130:0/1305908445 learned_addr learned my addr 172.21.15.130:0/1305908445 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:07.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f7259c640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f740b7ca0 0x7f6f7415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f6bfff640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f74146eb0 0x7f6f74156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f72d9d640 1 -- 172.21.15.130:0/1305908445 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f74146eb0 msgr2=0x7f6f74156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f72d9d640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f74146eb0 0x7f6f74156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f72d9d640 1 -- 172.21.15.130:0/1305908445 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f740b7ca0 msgr2=0x7f6f7415cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f72d9d640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f740b7ca0 0x7f6f7415cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f72d9d640 1 -- 172.21.15.130:0/1305908445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f640094d0 con 0x7f6f74161100 2023-09-13T06:02:07.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f72d9d640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f74161100 0x7f6f741553f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c007e40 tx=0x7f6f6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:07.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f6affd640 1 -- 172.21.15.130:0/1305908445 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c014620 con 0x7f6f74161100 2023-09-13T06:02:07.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f6affd640 1 -- 172.21.15.130:0/1305908445 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c00ee90 con 0x7f6f74161100 2023-09-13T06:02:07.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f7359e640 1 -- 172.21.15.130:0/1305908445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f74156750 con 0x7f6f74161100 2023-09-13T06:02:07.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f6affd640 1 -- 172.21.15.130:0/1305908445 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0149e0 con 0x7f6f74161100 2023-09-13T06:02:07.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f7359e640 1 -- 172.21.15.130:0/1305908445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f74157490 con 0x7f6f74161100 2023-09-13T06:02:07.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.992+0000 7f6f7359e640 1 -- 172.21.15.130:0/1305908445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f74070b10 con 0x7f6f74161100 2023-09-13T06:02:07.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.996+0000 7f6f6affd640 1 -- 172.21.15.130:0/1305908445 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6f6c014b40 con 0x7f6f74161100 2023-09-13T06:02:07.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.996+0000 7f6f6affd640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6f54065b20 0x7f6f54067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.996+0000 7f6f6affd640 1 -- 172.21.15.130:0/1305908445 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f6c083b60 con 0x7f6f74161100 2023-09-13T06:02:07.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.996+0000 7f6f7259c640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6f54065b20 0x7f6f54067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:06.996+0000 7f6f7259c640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6f54065b20 0x7f6f54067fe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6f640ae000 tx=0x7f6f640b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:07.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.000+0000 7f6f6affd640 1 -- 172.21.15.130:0/1305908445 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6f74070b10 con 0x7f6f74161100 2023-09-13T06:02:07.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.148+0000 7f6f7359e640 1 -- 172.21.15.130:0/1305908445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f74156c70 con 0x7f6f74161100 2023-09-13T06:02:07.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f6affd640 1 -- 172.21.15.130:0/1305908445 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f6f74156c70 con 0x7f6f74161100 2023-09-13T06:02:07.155 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:07.155 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:01:27.312190+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:01:23.397348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T06:01:24.691458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:07.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 -- 172.21.15.130:0/1305908445 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6f54065b20 msgr2=0x7f6f54067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6f54065b20 0x7f6f54067fe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6f640ae000 tx=0x7f6f640b5040 comp rx=0 tx=0).stop 2023-09-13T06:02:07.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 -- 172.21.15.130:0/1305908445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f74161100 msgr2=0x7f6f741553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f74161100 0x7f6f741553f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c007e40 tx=0x7f6f6c00e4b0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 -- 172.21.15.130:0/1305908445 shutdown_connections 2023-09-13T06:02:07.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6f54065b20 0x7f6f54067fe0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f74161100 0x7f6f741553f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f74146eb0 0x7f6f74156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 --2- 172.21.15.130:0/1305908445 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f740b7ca0 0x7f6f7415cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 -- 172.21.15.130:0/1305908445 >> 172.21.15.130:0/1305908445 conn(0x7f6f740cdd10 msgr2=0x7f6f740d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:07.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 -- 172.21.15.130:0/1305908445 shutdown_connections 2023-09-13T06:02:07.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.152+0000 7f6f7359e640 1 -- 172.21.15.130:0/1305908445 wait complete. 2023-09-13T06:02:07.176 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T06:02:07.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff9e48640 1 Processor -- start 2023-09-13T06:02:07.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff9e48640 1 -- start start 2023-09-13T06:02:07.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff9e48640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1ff415b130 0x7f1ff40cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff9e48640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff40ce980 con 0x7f1ff40ce180 2023-09-13T06:02:07.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff9e48640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff40cec60 con 0x7f1ff40b04a0 2023-09-13T06:02:07.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff9e48640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff406c640 con 0x7f1ff415b130 2023-09-13T06:02:07.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1febfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1ff40ce180 0x7f1ff415b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:32874/0 (socket says 172.21.15.130:32874) 2023-09-13T06:02:07.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1febfff640 1 -- 172.21.15.130:0/1947718406 learned_addr learned my addr 172.21.15.130:0/1947718406 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:07.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff37fe640 1 --2- 172.21.15.130:0/1947718406 >> v2:172.21.15.164:3300/0 conn(0x7f1ff415b130 0x7f1ff40cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff2ffd640 1 -- 172.21.15.130:0/1947718406 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473108723 0 0) 0x7f1ff40ce980 con 0x7f1ff40ce180 2023-09-13T06:02:07.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff2ffd640 1 -- 172.21.15.130:0/1947718406 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe0003530 con 0x7f1ff40ce180 2023-09-13T06:02:07.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff2ffd640 1 -- 172.21.15.130:0/1947718406 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318786362 0 0) 0x7f1ff40cec60 con 0x7f1ff40b04a0 2023-09-13T06:02:07.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff2ffd640 1 -- 172.21.15.130:0/1947718406 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ff40ce980 con 0x7f1ff40b04a0 2023-09-13T06:02:07.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.312+0000 7f1ff37fe640 1 -- 172.21.15.130:0/1947718406 >> v1:172.21.15.164:6789/0 conn(0x7f1ff40b04a0 legacy=0x7f1ff406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.316+0000 7f1ff37fe640 1 -- 172.21.15.130:0/1947718406 >> v1:172.21.15.130:6789/0 conn(0x7f1ff40ce180 legacy=0x7f1ff415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.316+0000 7f1ff37fe640 1 -- 172.21.15.130:0/1947718406 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff406c920 con 0x7f1ff415b130 2023-09-13T06:02:07.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.316+0000 7f1ff37fe640 1 --2- 172.21.15.130:0/1947718406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ff415b130 0x7f1ff40cc780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40097c0 tx=0x7f1fe401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf08a456a49ad74b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:07.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.316+0000 7f1ff2ffd640 1 -- 172.21.15.130:0/1947718406 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40ab600 con 0x7f1ff415b130 2023-09-13T06:02:07.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.316+0000 7f1ff2ffd640 1 -- 172.21.15.130:0/1947718406 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe40a7050 con 0x7f1ff415b130 2023-09-13T06:02:07.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.316+0000 7f1ff2ffd640 1 -- 172.21.15.130:0/1947718406 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40ab960 con 0x7f1ff415b130 2023-09-13T06:02:07.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.316+0000 7f1ff9e48640 1 -- 172.21.15.130:0/1947718406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ff415b130 msgr2=0x7f1ff40cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.316+0000 7f1ff9e48640 1 --2- 172.21.15.130:0/1947718406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ff415b130 0x7f1ff40cc780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40097c0 tx=0x7f1fe401c480 comp rx=0 tx=0).stop 2023-09-13T06:02:07.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 -- 172.21.15.130:0/1947718406 shutdown_connections 2023-09-13T06:02:07.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 --2- 172.21.15.130:0/1947718406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ff415b130 0x7f1ff40cc780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 -- 172.21.15.130:0/1947718406 >> 172.21.15.130:0/1947718406 conn(0x7f1ff4065990 msgr2=0x7f1ff4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:07.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 -- 172.21.15.130:0/1947718406 shutdown_connections 2023-09-13T06:02:07.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 -- 172.21.15.130:0/1947718406 wait complete. 2023-09-13T06:02:07.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 Processor -- start 2023-09-13T06:02:07.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 -- start start 2023-09-13T06:02:07.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ff40b04a0 0x7f1ff40a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ff40ce180 0x7f1ff4153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ff415b130 0x7f1ff40abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40aaf80 con 0x7f1ff415b130 2023-09-13T06:02:07.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40a97b0 con 0x7f1ff40b04a0 2023-09-13T06:02:07.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff9e48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40ab190 con 0x7f1ff40ce180 2023-09-13T06:02:07.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ff415b130 0x7f1ff40abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ff415b130 0x7f1ff40abc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42118/0 (socket says 172.21.15.130:42118) 2023-09-13T06:02:07.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff3fff640 1 -- 172.21.15.130:0/905356092 learned_addr learned my addr 172.21.15.130:0/905356092 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:07.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff37fe640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ff40b04a0 0x7f1ff40a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1febfff640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ff40ce180 0x7f1ff4153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff3fff640 1 -- 172.21.15.130:0/905356092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ff40ce180 msgr2=0x7f1ff4153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff3fff640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ff40ce180 0x7f1ff4153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff3fff640 1 -- 172.21.15.130:0/905356092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ff40b04a0 msgr2=0x7f1ff40a8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff3fff640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ff40b04a0 0x7f1ff40a8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff3fff640 1 -- 172.21.15.130:0/905356092 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4009420 con 0x7f1ff415b130 2023-09-13T06:02:07.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1febfff640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ff40ce180 0x7f1ff4153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:07.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff3fff640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ff415b130 0x7f1ff40abc50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00c730 tx=0x7f1fec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:07.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.320+0000 7f1ff0ff9640 1 -- 172.21.15.130:0/905356092 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec003b80 con 0x7f1ff415b130 2023-09-13T06:02:07.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.324+0000 7f1ff0ff9640 1 -- 172.21.15.130:0/905356092 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec003ce0 con 0x7f1ff415b130 2023-09-13T06:02:07.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.324+0000 7f1ff0ff9640 1 -- 172.21.15.130:0/905356092 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00aa90 con 0x7f1ff415b130 2023-09-13T06:02:07.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.324+0000 7f1ff9e48640 1 -- 172.21.15.130:0/905356092 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff40ab470 con 0x7f1ff415b130 2023-09-13T06:02:07.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.324+0000 7f1ff9e48640 1 -- 172.21.15.130:0/905356092 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff40a9a90 con 0x7f1ff415b130 2023-09-13T06:02:07.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.324+0000 7f1ff9e48640 1 -- 172.21.15.130:0/905356092 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff40cae90 con 0x7f1ff415b130 2023-09-13T06:02:07.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.324+0000 7f1ff0ff9640 1 -- 172.21.15.130:0/905356092 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1fec00abf0 con 0x7f1ff415b130 2023-09-13T06:02:07.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.324+0000 7f1ff0ff9640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1fd4065b20 0x7f1fd4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.324+0000 7f1ff0ff9640 1 -- 172.21.15.130:0/905356092 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fec083220 con 0x7f1ff415b130 2023-09-13T06:02:07.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.324+0000 7f1ff37fe640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1fd4065b20 0x7f1fd4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.324+0000 7f1ff37fe640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1fd4065b20 0x7f1fd4067fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40ad000 tx=0x7f1fe40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:07.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.328+0000 7f1ff0ff9640 1 -- 172.21.15.130:0/905356092 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1fec0509c0 con 0x7f1ff415b130 2023-09-13T06:02:07.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.512+0000 7f1ff9e48640 1 -- 172.21.15.130:0/905356092 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1ff40618a0 con 0x7f1ff415b130 2023-09-13T06:02:07.515 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:02:07.512+0000 7faa00e50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T06:02:07.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.516+0000 7f1ff0ff9640 1 -- 172.21.15.130:0/905356092 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1fec053fe0 con 0x7f1ff415b130 2023-09-13T06:02:07.521 INFO:teuthology.orchestra.run.smithi130.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T06:02:07.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 -- 172.21.15.130:0/905356092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1fd4065b20 msgr2=0x7f1fd4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1fd4065b20 0x7f1fd4067fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40ad000 tx=0x7f1fe40a6000 comp rx=0 tx=0).stop 2023-09-13T06:02:07.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 -- 172.21.15.130:0/905356092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ff415b130 msgr2=0x7f1ff40abc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ff415b130 0x7f1ff40abc50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00c730 tx=0x7f1fec00cbf0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 -- 172.21.15.130:0/905356092 shutdown_connections 2023-09-13T06:02:07.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1fd4065b20 0x7f1fd4067fe0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ff415b130 0x7f1ff40abc50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ff40ce180 0x7f1ff4153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 --2- 172.21.15.130:0/905356092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ff40b04a0 0x7f1ff40a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 -- 172.21.15.130:0/905356092 >> 172.21.15.130:0/905356092 conn(0x7f1ff4065990 msgr2=0x7f1ff40709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:07.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 -- 172.21.15.130:0/905356092 shutdown_connections 2023-09-13T06:02:07.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.520+0000 7f1ff9e48640 1 -- 172.21.15.130:0/905356092 wait complete. 2023-09-13T06:02:07.532 INFO:tasks.ceph.mds.c.smithi130.stderr: -6698> 2023-09-13T06:01:29.772+0000 7f1a2a5bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:02:07.543 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T06:02:07.584 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:02:07.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.684+0000 7f3f52fb7640 1 Processor -- start 2023-09-13T06:02:07.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.684+0000 7f3f52fb7640 1 -- start start 2023-09-13T06:02:07.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.684+0000 7f3f52fb7640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3f4c146410 0x7f3f4c070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.684+0000 7f3f52fb7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f4c0b66a0 0x7f3f4c0b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.684+0000 7f3f52fb7640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4c0711a0 con 0x7f3f4c070d40 2023-09-13T06:02:07.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.684+0000 7f3f52fb7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c161790 con 0x7f3f4c0b66a0 2023-09-13T06:02:07.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.684+0000 7f3f52fb7640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c146dd0 con 0x7f3f4c146410 2023-09-13T06:02:07.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f527b6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f4c0b66a0 0x7f3f4c0b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f527b6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f4c0b66a0 0x7f3f4c0b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42132/0 (socket says 172.21.15.130:42132) 2023-09-13T06:02:07.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f527b6640 1 -- 172.21.15.130:0/1682750661 learned_addr learned my addr 172.21.15.130:0/1682750661 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:07.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f51fb5640 1 --2- 172.21.15.130:0/1682750661 >> v2:172.21.15.164:3300/0 conn(0x7f3f4c146410 0x7f3f4c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f527b6640 1 -- 172.21.15.130:0/1682750661 >> v2:172.21.15.164:3300/0 conn(0x7f3f4c146410 msgr2=0x7f3f4c070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:07.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f527b6640 1 --2- 172.21.15.130:0/1682750661 >> v2:172.21.15.164:3300/0 conn(0x7f3f4c146410 0x7f3f4c070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f527b6640 1 -- 172.21.15.130:0/1682750661 >> v1:172.21.15.164:6789/0 conn(0x7f3f4c070d40 legacy=0x7f3f4c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:07.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f527b6640 1 -- 172.21.15.130:0/1682750661 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c160e60 con 0x7f3f4c0b66a0 2023-09-13T06:02:07.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f527b6640 1 --2- 172.21.15.130:0/1682750661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4c0b66a0 0x7f3f4c0b4120 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0d0d90 tx=0x7f3f4401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de5219aa46eca98 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:07.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f50fb3640 1 -- 172.21.15.130:0/1682750661 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f440a5820 con 0x7f3f4c0b66a0 2023-09-13T06:02:07.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f50fb3640 1 -- 172.21.15.130:0/1682750661 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f440a5980 con 0x7f3f4c0b66a0 2023-09-13T06:02:07.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.688+0000 7f3f50fb3640 1 -- 172.21.15.130:0/1682750661 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f440a5d10 con 0x7f3f4c0b66a0 2023-09-13T06:02:07.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1682750661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4c0b66a0 msgr2=0x7f3f4c0b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 --2- 172.21.15.130:0/1682750661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4c0b66a0 0x7f3f4c0b4120 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0d0d90 tx=0x7f3f4401c960 comp rx=0 tx=0).stop 2023-09-13T06:02:07.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1682750661 shutdown_connections 2023-09-13T06:02:07.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 --2- 172.21.15.130:0/1682750661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4c0b66a0 0x7f3f4c0b4120 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 --2- 172.21.15.130:0/1682750661 >> v2:172.21.15.164:3300/0 conn(0x7f3f4c146410 0x7f3f4c070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1682750661 >> 172.21.15.130:0/1682750661 conn(0x7f3f4c065990 msgr2=0x7f3f4c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:07.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1682750661 shutdown_connections 2023-09-13T06:02:07.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1682750661 wait complete. 2023-09-13T06:02:07.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 Processor -- start 2023-09-13T06:02:07.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 -- start start 2023-09-13T06:02:07.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4c070d40 0x7f3f4c13c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f4c0b66a0 0x7f3f4c142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f4c146410 0x7f3f4c1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c15a350 con 0x7f3f4c070d40 2023-09-13T06:02:07.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c1440a0 con 0x7f3f4c0b66a0 2023-09-13T06:02:07.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f52fb7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c15f930 con 0x7f3f4c146410 2023-09-13T06:02:07.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f51fb5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4c070d40 0x7f3f4c13c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f51fb5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4c070d40 0x7f3f4c13c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42138/0 (socket says 172.21.15.130:42138) 2023-09-13T06:02:07.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f51fb5640 1 -- 172.21.15.130:0/1766857017 learned_addr learned my addr 172.21.15.130:0/1766857017 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:07.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f527b6640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f4c146410 0x7f3f4c1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f517b4640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f4c0b66a0 0x7f3f4c142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f51fb5640 1 -- 172.21.15.130:0/1766857017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f4c146410 msgr2=0x7f3f4c1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f51fb5640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f4c146410 0x7f3f4c1432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f51fb5640 1 -- 172.21.15.130:0/1766857017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f4c0b66a0 msgr2=0x7f3f4c142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:07.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.692+0000 7f3f51fb5640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f4c0b66a0 0x7f3f4c142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:07.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.696+0000 7f3f51fb5640 1 -- 172.21.15.130:0/1766857017 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f44009b30 con 0x7f3f4c070d40 2023-09-13T06:02:07.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.696+0000 7f3f517b4640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f4c0b66a0 0x7f3f4c142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:07.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.696+0000 7f3f51fb5640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4c070d40 0x7f3f4c13c2c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800d5f0 tx=0x7f3f4800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:07.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.696+0000 7f3f427fc640 1 -- 172.21.15.130:0/1766857017 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480125f0 con 0x7f3f4c070d40 2023-09-13T06:02:07.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.696+0000 7f3f427fc640 1 -- 172.21.15.130:0/1766857017 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f48012750 con 0x7f3f4c070d40 2023-09-13T06:02:07.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.696+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1766857017 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4c15fc10 con 0x7f3f4c070d40 2023-09-13T06:02:07.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.696+0000 7f3f427fc640 1 -- 172.21.15.130:0/1766857017 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48012ae0 con 0x7f3f4c070d40 2023-09-13T06:02:07.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.696+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1766857017 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4c1601d0 con 0x7f3f4c070d40 2023-09-13T06:02:07.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.700+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1766857017 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4c0618a0 con 0x7f3f4c070d40 2023-09-13T06:02:07.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.700+0000 7f3f427fc640 1 -- 172.21.15.130:0/1766857017 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3f48012c40 con 0x7f3f4c070d40 2023-09-13T06:02:07.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.700+0000 7f3f427fc640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f30065b20 0x7f3f30067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:07.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.700+0000 7f3f427fc640 1 -- 172.21.15.130:0/1766857017 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3f480837a0 con 0x7f3f4c070d40 2023-09-13T06:02:07.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.700+0000 7f3f517b4640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f30065b20 0x7f3f30067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:07.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.700+0000 7f3f517b4640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f30065b20 0x7f3f30067fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c142a60 tx=0x7f3f3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:07.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.704+0000 7f3f427fc640 1 -- 172.21.15.130:0/1766857017 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3f48051080 con 0x7f3f4c070d40 2023-09-13T06:02:07.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:07.884+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1766857017 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3f4c156b30 con 0x7f3f4c070d40 2023-09-13T06:02:08.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.520+0000 7f3f427fc640 1 -- 172.21.15.130:0/1766857017 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3f48007380 con 0x7f3f4c070d40 2023-09-13T06:02:08.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.520+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1766857017 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f30065b20 msgr2=0x7f3f30067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:08.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.520+0000 7f3f52fb7640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f30065b20 0x7f3f30067fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c142a60 tx=0x7f3f3c009040 comp rx=0 tx=0).stop 2023-09-13T06:02:08.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.520+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1766857017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4c070d40 msgr2=0x7f3f4c13c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:08.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.520+0000 7f3f52fb7640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4c070d40 0x7f3f4c13c2c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800d5f0 tx=0x7f3f4800dab0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.524+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1766857017 shutdown_connections 2023-09-13T06:02:08.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.524+0000 7f3f52fb7640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f30065b20 0x7f3f30067fe0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.524+0000 7f3f52fb7640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f4c0b66a0 0x7f3f4c142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.524+0000 7f3f52fb7640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f4c146410 0x7f3f4c1432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.524+0000 7f3f52fb7640 1 --2- 172.21.15.130:0/1766857017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4c070d40 0x7f3f4c13c2c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.524+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1766857017 >> 172.21.15.130:0/1766857017 conn(0x7f3f4c065990 msgr2=0x7f3f4c0b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:08.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.524+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1766857017 shutdown_connections 2023-09-13T06:02:08.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.524+0000 7f3f52fb7640 1 -- 172.21.15.130:0/1766857017 wait complete. 2023-09-13T06:02:08.549 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T06:02:08.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.732+0000 7f3b03d96640 1 Processor -- start 2023-09-13T06:02:08.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.732+0000 7f3b03d96640 1 -- start start 2023-09-13T06:02:08.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b03d96640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3afc15a8e0 0x7f3afc159e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:08.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b03d96640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3afc0cc1b0 0x7f3afc06f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:08.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b03d96640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3afc06fbd0 0x7f3afc150120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:08.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b03d96640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc0ce270 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b03d96640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc0ced40 con 0x7f3afc06fbd0 2023-09-13T06:02:08.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b03d96640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc070020 con 0x7f3afc15a8e0 2023-09-13T06:02:08.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b01331640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3afc0cc1b0 0x7f3afc06f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:08.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b01331640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3afc0cc1b0 0x7f3afc06f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42142/0 (socket says 172.21.15.130:42142) 2023-09-13T06:02:08.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b01331640 1 -- 172.21.15.130:0/379033554 learned_addr learned my addr 172.21.15.130:0/379033554 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:08.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b01b32640 1 --2- 172.21.15.130:0/379033554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3afc15a8e0 0x7f3afc159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:08.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b02333640 1 --2- 172.21.15.130:0/379033554 >> v2:172.21.15.164:3300/0 conn(0x7f3afc06fbd0 0x7f3afc150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:08.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b01331640 1 -- 172.21.15.130:0/379033554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3afc15a8e0 msgr2=0x7f3afc159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:08.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b01331640 1 --2- 172.21.15.130:0/379033554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3afc15a8e0 0x7f3afc159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b01331640 1 -- 172.21.15.130:0/379033554 >> v2:172.21.15.164:3300/0 conn(0x7f3afc06fbd0 msgr2=0x7f3afc150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:08.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b01331640 1 --2- 172.21.15.130:0/379033554 >> v2:172.21.15.164:3300/0 conn(0x7f3afc06fbd0 0x7f3afc150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b01331640 1 -- 172.21.15.130:0/379033554 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc0cc920 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b02333640 1 --2- 172.21.15.130:0/379033554 >> v2:172.21.15.164:3300/0 conn(0x7f3afc06fbd0 0x7f3afc150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:08.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.736+0000 7f3b01331640 1 --2- 172.21.15.130:0/379033554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3afc0cc1b0 0x7f3afc06f690 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3afc06ea40 tx=0x7f3aec01d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302d25cc87654754 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:08.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b00b30640 1 -- 172.21.15.130:0/379033554 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0a6890 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b00b30640 1 -- 172.21.15.130:0/379033554 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec0a69f0 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b00b30640 1 -- 172.21.15.130:0/379033554 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0a6d80 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 -- 172.21.15.130:0/379033554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3afc0cc1b0 msgr2=0x7f3afc06f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:08.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 --2- 172.21.15.130:0/379033554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3afc0cc1b0 0x7f3afc06f690 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3afc06ea40 tx=0x7f3aec01d8a0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 -- 172.21.15.130:0/379033554 shutdown_connections 2023-09-13T06:02:08.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 --2- 172.21.15.130:0/379033554 >> v2:172.21.15.164:3300/0 conn(0x7f3afc06fbd0 0x7f3afc150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 --2- 172.21.15.130:0/379033554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3afc0cc1b0 0x7f3afc06f690 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 --2- 172.21.15.130:0/379033554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3afc15a8e0 0x7f3afc159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 -- 172.21.15.130:0/379033554 >> 172.21.15.130:0/379033554 conn(0x7f3afc0735e0 msgr2=0x7f3afc065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:08.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 -- 172.21.15.130:0/379033554 shutdown_connections 2023-09-13T06:02:08.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 -- 172.21.15.130:0/379033554 wait complete. 2023-09-13T06:02:08.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 Processor -- start 2023-09-13T06:02:08.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 -- start start 2023-09-13T06:02:08.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3afc06fbd0 0x7f3afc149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:08.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3afc0cc1b0 0x7f3afc14b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:08.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc15a8e0 0x7f3afc06d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:08.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc154640 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1506e0 con 0x7f3afc15a8e0 2023-09-13T06:02:08.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b03d96640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc14fad0 con 0x7f3afc06fbd0 2023-09-13T06:02:08.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b01331640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3afc0cc1b0 0x7f3afc14b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:08.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b01331640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3afc0cc1b0 0x7f3afc14b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42150/0 (socket says 172.21.15.130:42150) 2023-09-13T06:02:08.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b01331640 1 -- 172.21.15.130:0/2966190286 learned_addr learned my addr 172.21.15.130:0/2966190286 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:08.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.740+0000 7f3b01b32640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3afc06fbd0 0x7f3afc149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:08.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3b02333640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc15a8e0 0x7f3afc06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:08.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3b01331640 1 -- 172.21.15.130:0/2966190286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3afc06fbd0 msgr2=0x7f3afc149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:08.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3b01331640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3afc06fbd0 0x7f3afc149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3b01331640 1 -- 172.21.15.130:0/2966190286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc15a8e0 msgr2=0x7f3afc06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:08.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3b01331640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc15a8e0 0x7f3afc06d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:08.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3b01331640 1 -- 172.21.15.130:0/2966190286 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec00a670 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3b01331640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3afc0cc1b0 0x7f3afc14b530 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3aec01bf50 tx=0x7f3aec01a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:08.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3af27fc640 1 -- 172.21.15.130:0/2966190286 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0ae950 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3af27fc640 1 -- 172.21.15.130:0/2966190286 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec0aeab0 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3af27fc640 1 -- 172.21.15.130:0/2966190286 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0aee40 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3b03d96640 1 -- 172.21.15.130:0/2966190286 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc14fdb0 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3b03d96640 1 -- 172.21.15.130:0/2966190286 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc150370 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3b03d96640 1 -- 172.21.15.130:0/2966190286 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc0618a0 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3af27fc640 1 -- 172.21.15.130:0/2966190286 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3aec0b63f0 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3af27fc640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ae0065b20 0x7f3ae0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:08.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3af27fc640 1 -- 172.21.15.130:0/2966190286 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3aec11d6c0 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.744+0000 7f3b01b32640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ae0065b20 0x7f3ae0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:08.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.748+0000 7f3b01b32640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ae0065b20 0x7f3ae0067fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3af80079c0 tx=0x7f3af8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:08.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.748+0000 7f3af27fc640 1 -- 172.21.15.130:0/2966190286 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3aec0eaf30 con 0x7f3afc0cc1b0 2023-09-13T06:02:08.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:08.896+0000 7f3b03d96640 1 -- 172.21.15.130:0/2966190286 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3afc0705a0 con 0x7f3afc0cc1b0 2023-09-13T06:02:09.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.704+0000 7f3af27fc640 1 -- 172.21.15.130:0/2966190286 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3aec0be0d0 con 0x7f3afc0cc1b0 2023-09-13T06:02:09.711 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' removed 2023-09-13T06:02:09.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 -- 172.21.15.130:0/2966190286 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ae0065b20 msgr2=0x7f3ae0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:09.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ae0065b20 0x7f3ae0067fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3af80079c0 tx=0x7f3af8008040 comp rx=0 tx=0).stop 2023-09-13T06:02:09.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 -- 172.21.15.130:0/2966190286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3afc0cc1b0 msgr2=0x7f3afc14b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:09.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3afc0cc1b0 0x7f3afc14b530 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3aec01bf50 tx=0x7f3aec01a640 comp rx=0 tx=0).stop 2023-09-13T06:02:09.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 -- 172.21.15.130:0/2966190286 shutdown_connections 2023-09-13T06:02:09.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ae0065b20 0x7f3ae0067fe0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:09.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc15a8e0 0x7f3afc06d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:09.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3afc0cc1b0 0x7f3afc14b530 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:09.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 --2- 172.21.15.130:0/2966190286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3afc06fbd0 0x7f3afc149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:09.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 -- 172.21.15.130:0/2966190286 >> 172.21.15.130:0/2966190286 conn(0x7f3afc0735e0 msgr2=0x7f3afc0ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:09.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 -- 172.21.15.130:0/2966190286 shutdown_connections 2023-09-13T06:02:09.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.708+0000 7f3b03d96640 1 -- 172.21.15.130:0/2966190286 wait complete. 2023-09-13T06:02:09.736 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T06:02:09.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.876+0000 7f0ee8bdb640 1 Processor -- start 2023-09-13T06:02:09.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.876+0000 7f0ee8bdb640 1 -- start start 2023-09-13T06:02:09.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee8bdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40b25e0 0x7f0ee4159e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:09.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee8bdb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee40cc920 con 0x7f0ee406fda0 2023-09-13T06:02:09.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee8bdb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee40ccc00 con 0x7f0ee415a8e0 2023-09-13T06:02:09.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee8bdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40ce270 con 0x7f0ee40b25e0 2023-09-13T06:02:09.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ed9d9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0ee406fda0 0x7f0ee4150120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:32880/0 (socket says 172.21.15.130:32880) 2023-09-13T06:02:09.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ed9d9b640 1 -- 172.21.15.130:0/3762985938 learned_addr learned my addr 172.21.15.130:0/3762985938 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:09.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee2d9d640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40b25e0 0x7f0ee4159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:09.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719049334 0 0) 0x7f0ee40cc920 con 0x7f0ee406fda0 2023-09-13T06:02:09.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ed0003530 con 0x7f0ee406fda0 2023-09-13T06:02:09.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2990898671 0 0) 0x7f0ed0003530 con 0x7f0ee406fda0 2023-09-13T06:02:09.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40b25e0 msgr2=0x7f0ee4159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:09.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40b25e0 0x7f0ee4159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:09.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 >> v1:172.21.15.164:6789/0 conn(0x7f0ee415a8e0 legacy=0x7f0ee406f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:09.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40ccee0 con 0x7f0ee406fda0 2023-09-13T06:02:09.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f0ecc001680 con 0x7f0ee406fda0 2023-09-13T06:02:09.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 >> v1:172.21.15.130:6789/0 conn(0x7f0ee406fda0 legacy=0x7f0ee4150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:09.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ed0003a20 0x7f0ed0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:09.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40b25e0 0x7f0ed00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:09.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed0004d10 0x7f0ed0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:09.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed000ba40 con 0x7f0ed0003a20 2023-09-13T06:02:09.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed000bb80 con 0x7f0ed0004d10 2023-09-13T06:02:09.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed000bd40 con 0x7f0ee40b25e0 2023-09-13T06:02:09.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee259c640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ed0003a20 0x7f0ed0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:09.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ed9d9b640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40b25e0 0x7f0ed00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:09.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee2d9d640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed0004d10 0x7f0ed0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:09.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee259c640 1 -- 172.21.15.130:0/3762985938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40b25e0 msgr2=0x7f0ed00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:09.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee259c640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40b25e0 0x7f0ed00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:09.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee259c640 1 -- 172.21.15.130:0/3762985938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed0004d10 msgr2=0x7f0ed0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:09.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee259c640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed0004d10 0x7f0ed0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:09.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.880+0000 7f0ee259c640 1 -- 172.21.15.130:0/3762985938 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0003530 con 0x7f0ed0003a20 2023-09-13T06:02:09.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.884+0000 7f0ee259c640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ed0003a20 0x7f0ed0003e00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4001910 tx=0x7f0ed401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e0dfa03171d711 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:09.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.884+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40ab600 con 0x7f0ed0003a20 2023-09-13T06:02:09.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.884+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed40a7050 con 0x7f0ed0003a20 2023-09-13T06:02:09.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.884+0000 7f0ee1d9b640 1 -- 172.21.15.130:0/3762985938 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40ab9c0 con 0x7f0ed0003a20 2023-09-13T06:02:09.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.884+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/3762985938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ed0003a20 msgr2=0x7f0ed0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:09.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.884+0000 7f0ee8bdb640 1 --2- 172.21.15.130:0/3762985938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ed0003a20 0x7f0ed0003e00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4001910 tx=0x7f0ed401c560 comp rx=0 tx=0).stop 2023-09-13T06:02:09.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.884+0000 7f0ee2d9d640 1 -- 172.21.15.130:0/3762985938 reap_dead start 2023-09-13T06:02:09.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.884+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/3762985938 shutdown_connections 2023-09-13T06:02:09.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.884+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/3762985938 >> 172.21.15.130:0/3762985938 conn(0x7f0ee40735e0 msgr2=0x7f0ee4065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:09.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.884+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/3762985938 shutdown_connections 2023-09-13T06:02:09.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.884+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/3762985938 wait complete. 2023-09-13T06:02:09.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee8bdb640 1 Processor -- start 2023-09-13T06:02:09.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee8bdb640 1 -- start start 2023-09-13T06:02:09.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee8bdb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed0003a20 0x7f0ee414d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:09.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee8bdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee40ae810 0x7f0ee40aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:09.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee8bdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40abdb0 0x7f0ee40ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:09.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee8bdb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40ad5c0 con 0x7f0ee40ae810 2023-09-13T06:02:09.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee8bdb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40af1b0 con 0x7f0ed0003a20 2023-09-13T06:02:09.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee8bdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40a8430 con 0x7f0ee40abdb0 2023-09-13T06:02:09.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ed9d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee40ae810 0x7f0ee40aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:09.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ed9d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee40ae810 0x7f0ee40aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42180/0 (socket says 172.21.15.130:42180) 2023-09-13T06:02:09.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ed9d9b640 1 -- 172.21.15.130:0/1784673508 learned_addr learned my addr 172.21.15.130:0/1784673508 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:09.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee2d9d640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40abdb0 0x7f0ee40ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:09.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee259c640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed0003a20 0x7f0ee414d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:09.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ed9d9b640 1 -- 172.21.15.130:0/1784673508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40abdb0 msgr2=0x7f0ee40ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:09.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ed9d9b640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40abdb0 0x7f0ee40ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:09.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ed9d9b640 1 -- 172.21.15.130:0/1784673508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed0003a20 msgr2=0x7f0ee414d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:09.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ed9d9b640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed0003a20 0x7f0ee414d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:09.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ed9d9b640 1 -- 172.21.15.130:0/1784673508 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40a9290 con 0x7f0ee40ae810 2023-09-13T06:02:09.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ed9d9b640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee40ae810 0x7f0ee40aec70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00e710 tx=0x7f0ecc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:09.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0edb7fe640 1 -- 172.21.15.130:0/1784673508 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00c6c0 con 0x7f0ee40ae810 2023-09-13T06:02:09.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0edb7fe640 1 -- 172.21.15.130:0/1784673508 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc00c840 con 0x7f0ee40ae810 2023-09-13T06:02:09.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0edb7fe640 1 -- 172.21.15.130:0/1784673508 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00cbf0 con 0x7f0ee40ae810 2023-09-13T06:02:09.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/1784673508 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee40a8680 con 0x7f0ee40ae810 2023-09-13T06:02:09.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/1784673508 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee40a8c40 con 0x7f0ee40ae810 2023-09-13T06:02:09.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.888+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/1784673508 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee40a9420 con 0x7f0ee40ae810 2023-09-13T06:02:09.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.892+0000 7f0edb7fe640 1 -- 172.21.15.130:0/1784673508 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0ecc01d460 con 0x7f0ee40ae810 2023-09-13T06:02:09.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.892+0000 7f0edb7fe640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ec4065b20 0x7f0ec4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:09.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.892+0000 7f0edb7fe640 1 -- 172.21.15.130:0/1784673508 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f0ecc083280 con 0x7f0ee40ae810 2023-09-13T06:02:09.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.892+0000 7f0ee259c640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ec4065b20 0x7f0ec4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:09.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.892+0000 7f0ee259c640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ec4065b20 0x7f0ec4067fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40ad000 tx=0x7f0ed4001330 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:09.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:09.896+0000 7f0edb7fe640 1 -- 172.21.15.130:0/1784673508 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0ecc050d40 con 0x7f0ee40ae810 2023-09-13T06:02:10.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.044+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/1784673508 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ee40618a0 con 0x7f0ee40ae810 2023-09-13T06:02:10.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.716+0000 7f0edb7fe640 1 -- 172.21.15.130:0/1784673508 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0ecc054360 con 0x7f0ee40ae810 2023-09-13T06:02:10.720 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' removed 2023-09-13T06:02:10.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/1784673508 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ec4065b20 msgr2=0x7f0ec4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:10.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ec4065b20 0x7f0ec4067fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40ad000 tx=0x7f0ed4001330 comp rx=0 tx=0).stop 2023-09-13T06:02:10.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/1784673508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee40ae810 msgr2=0x7f0ee40aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:10.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee40ae810 0x7f0ee40aec70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00e710 tx=0x7f0ecc00ebd0 comp rx=0 tx=0).stop 2023-09-13T06:02:10.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/1784673508 shutdown_connections 2023-09-13T06:02:10.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ec4065b20 0x7f0ec4067fe0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:10.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee40abdb0 0x7f0ee40ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:10.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee40ae810 0x7f0ee40aec70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:10.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 --2- 172.21.15.130:0/1784673508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed0003a20 0x7f0ee414d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:10.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/1784673508 >> 172.21.15.130:0/1784673508 conn(0x7f0ee40735e0 msgr2=0x7f0ee4152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:10.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/1784673508 shutdown_connections 2023-09-13T06:02:10.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.720+0000 7f0ee8bdb640 1 -- 172.21.15.130:0/1784673508 wait complete. 2023-09-13T06:02:10.744 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T06:02:10.745 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-13T06:02:10.745 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T06:02:10.745 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:02:10.746 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T06:02:10.746 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-13T06:02:10.746 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T06:02:10.747 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:02:10.747 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T06:02:10.747 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-13T06:02:10.747 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T06:02:10.748 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:02:10.748 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T06:02:10.748 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-13T06:02:10.749 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T06:02:10.749 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:02:10.759 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T06:02:10.760 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T06:02:10.761 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T06:02:10.761 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T06:02:10.763 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T06:02:10.763 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T06:02:10.764 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T06:02:10.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T06:02:10.808 INFO:tasks.ceph.mds.b:Started 2023-09-13T06:02:10.808 DEBUG:teuthology.parallel:result is None 2023-09-13T06:02:10.812 INFO:tasks.ceph.mds.a:Started 2023-09-13T06:02:10.812 INFO:tasks.ceph.mds.d:Started 2023-09-13T06:02:10.813 DEBUG:teuthology.parallel:result is None 2023-09-13T06:02:10.813 DEBUG:teuthology.parallel:result is None 2023-09-13T06:02:10.814 INFO:tasks.ceph.mds.c:Started 2023-09-13T06:02:10.815 DEBUG:teuthology.parallel:result is None 2023-09-13T06:02:10.815 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-13T06:02:10.899 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:02:10.900 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:02:10.901 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:02:10.905 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:02:10.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb769e640 1 Processor -- start 2023-09-13T06:02:10.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb769e640 1 -- start start 2023-09-13T06:02:10.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb769e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2fb0159f20 0x7f2fb00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb769e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2fb00cdfc0 0x7f2fb00b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb769e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00ccfd0 con 0x7f2fb00b1610 2023-09-13T06:02:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb769e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00b00f0 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb769e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00b11d0 con 0x7f2fb0159f20 2023-09-13T06:02:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb4c39640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2fb00cdfc0 0x7f2fb00b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb5c3b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2fb00b1610 0x7f2fb00ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:45486/0 (socket says 172.21.15.130:45486) 2023-09-13T06:02:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb5c3b640 1 -- 172.21.15.130:0/3367581405 learned_addr learned my addr 172.21.15.130:0/3367581405 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb4c39640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2fb00cdfc0 0x7f2fb00b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49870/0 (socket says 172.21.15.130:49870) 2023-09-13T06:02:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb543a640 1 --2- 172.21.15.130:0/3367581405 >> v2:172.21.15.164:3300/0 conn(0x7f2fb0159f20 0x7f2fb00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb4c39640 1 -- 172.21.15.130:0/3367581405 >> v2:172.21.15.164:3300/0 conn(0x7f2fb0159f20 msgr2=0x7f2fb00ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:10.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb4c39640 1 --2- 172.21.15.130:0/3367581405 >> v2:172.21.15.164:3300/0 conn(0x7f2fb0159f20 0x7f2fb00ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:10.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.964+0000 7f2fb4c39640 1 -- 172.21.15.130:0/3367581405 >> v1:172.21.15.130:6789/0 conn(0x7f2fb00b1610 legacy=0x7f2fb00ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:10.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fb4c39640 1 -- 172.21.15.130:0/3367581405 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00ced90 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fa7fff640 1 -- 172.21.15.130:0/3367581405 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247936312 0 0) 0x7f2fb00ccfd0 con 0x7f2fb00b1610 2023-09-13T06:02:10.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fb4c39640 1 --2- 172.21.15.130:0/3367581405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fb00cdfc0 0x7f2fb00b0c90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00b2660 tx=0x7f2fa001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ccf8d6be9959d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:10.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fa7fff640 1 -- 172.21.15.130:0/3367581405 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00a7b50 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fa7fff640 1 -- 172.21.15.130:0/3367581405 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa00a7cb0 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fa7fff640 1 -- 172.21.15.130:0/3367581405 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00af660 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fb769e640 1 -- 172.21.15.130:0/3367581405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fb00cdfc0 msgr2=0x7f2fb00b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:10.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fb769e640 1 --2- 172.21.15.130:0/3367581405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fb00cdfc0 0x7f2fb00b0c90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00b2660 tx=0x7f2fa001ea80 comp rx=0 tx=0).stop 2023-09-13T06:02:10.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fb769e640 1 -- 172.21.15.130:0/3367581405 shutdown_connections 2023-09-13T06:02:10.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fb769e640 1 --2- 172.21.15.130:0/3367581405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fb00cdfc0 0x7f2fb00b0c90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:10.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fb769e640 1 --2- 172.21.15.130:0/3367581405 >> v2:172.21.15.164:3300/0 conn(0x7f2fb0159f20 0x7f2fb00ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:10.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fb769e640 1 -- 172.21.15.130:0/3367581405 >> 172.21.15.130:0/3367581405 conn(0x7f2fb0065990 msgr2=0x7f2fb0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:10.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fb769e640 1 -- 172.21.15.130:0/3367581405 shutdown_connections 2023-09-13T06:02:10.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.968+0000 7f2fb769e640 1 -- 172.21.15.130:0/3367581405 wait complete. 2023-09-13T06:02:10.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb769e640 1 Processor -- start 2023-09-13T06:02:10.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb769e640 1 -- start start 2023-09-13T06:02:10.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb769e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fb00b1610 0x7f2fb013a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:10.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb769e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fb00cdfc0 0x7f2fb006bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:10.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb769e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fb0159f20 0x7f2fb006c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:10.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb769e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb013a720 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb769e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0158f90 con 0x7f2fb00b1610 2023-09-13T06:02:10.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb769e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb013a9d0 con 0x7f2fb0159f20 2023-09-13T06:02:10.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb4c39640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fb00cdfc0 0x7f2fb006bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:10.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb4c39640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fb00cdfc0 0x7f2fb006bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49872/0 (socket says 172.21.15.130:49872) 2023-09-13T06:02:10.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb4c39640 1 -- 172.21.15.130:0/68326575 learned_addr learned my addr 172.21.15.130:0/68326575 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:10.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb543a640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fb00b1610 0x7f2fb013a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:10.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb5c3b640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fb0159f20 0x7f2fb006c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:10.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb4c39640 1 -- 172.21.15.130:0/68326575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fb0159f20 msgr2=0x7f2fb006c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:10.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb4c39640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fb0159f20 0x7f2fb006c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:10.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb4c39640 1 -- 172.21.15.130:0/68326575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fb00b1610 msgr2=0x7f2fb013a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:10.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb4c39640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fb00b1610 0x7f2fb013a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:10.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb4c39640 1 -- 172.21.15.130:0/68326575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa000b6c0 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb4c39640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fb00cdfc0 0x7f2fb006bb10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00b2040 tx=0x7f2fa001b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:10.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fa5ffb640 1 -- 172.21.15.130:0/68326575 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00b8660 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fa5ffb640 1 -- 172.21.15.130:0/68326575 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa00b87e0 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fa5ffb640 1 -- 172.21.15.130:0/68326575 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00b8b90 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.972+0000 7f2fb769e640 1 -- 172.21.15.130:0/68326575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb013acb0 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.976+0000 7f2fb769e640 1 -- 172.21.15.130:0/68326575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb013b270 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.976+0000 7f2fb769e640 1 -- 172.21.15.130:0/68326575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb013b460 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.976+0000 7f2fa5ffb640 1 -- 172.21.15.130:0/68326575 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2fa00b6070 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.976+0000 7f2fa5ffb640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2f94065b20 0x7f2f94067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:10.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.976+0000 7f2fa5ffb640 1 -- 172.21.15.130:0/68326575 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2fa011de40 con 0x7f2fb00cdfc0 2023-09-13T06:02:10.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.976+0000 7f2fb543a640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2f94065b20 0x7f2f94067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:10.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.976+0000 7f2fb543a640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2f94065b20 0x7f2f94067fe0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009ac0 tx=0x7f2fac009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:10.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:10.980+0000 7f2fa5ffb640 1 -- 172.21.15.130:0/68326575 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2fa00ebb30 con 0x7f2fb00cdfc0 2023-09-13T06:02:11.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.140+0000 7f2fb769e640 1 -- 172.21.15.130:0/68326575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2fb00618a0 con 0x7f2fb00cdfc0 2023-09-13T06:02:11.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.724+0000 7f2fa5ffb640 1 -- 172.21.15.130:0/68326575 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2fa00ef150 con 0x7f2fb00cdfc0 2023-09-13T06:02:11.730 INFO:teuthology.orchestra.run.smithi130.stderr: removed all blocklist entries 2023-09-13T06:02:11.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 -- 172.21.15.130:0/68326575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2f94065b20 msgr2=0x7f2f94067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:11.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2f94065b20 0x7f2f94067fe0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009ac0 tx=0x7f2fac009190 comp rx=0 tx=0).stop 2023-09-13T06:02:11.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 -- 172.21.15.130:0/68326575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fb00cdfc0 msgr2=0x7f2fb006bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:11.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fb00cdfc0 0x7f2fb006bb10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00b2040 tx=0x7f2fa001b820 comp rx=0 tx=0).stop 2023-09-13T06:02:11.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 -- 172.21.15.130:0/68326575 shutdown_connections 2023-09-13T06:02:11.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2f94065b20 0x7f2f94067fe0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:11.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fb0159f20 0x7f2fb006c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:11.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fb00cdfc0 0x7f2fb006bb10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:11.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 --2- 172.21.15.130:0/68326575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fb00b1610 0x7f2fb013a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:11.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 -- 172.21.15.130:0/68326575 >> 172.21.15.130:0/68326575 conn(0x7f2fb0065990 msgr2=0x7f2fb01538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:11.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 -- 172.21.15.130:0/68326575 shutdown_connections 2023-09-13T06:02:11.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.728+0000 7f2fb769e640 1 -- 172.21.15.130:0/68326575 wait complete. 2023-09-13T06:02:11.755 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-13T06:02:11.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f11209ba640 1 Processor -- start 2023-09-13T06:02:11.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f11209ba640 1 -- start start 2023-09-13T06:02:11.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f11209ba640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f111c06c9b0 0x7f111c0cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:11.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f11209ba640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f111c0cdee0 0x7f111c06f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:11.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f11209ba640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111c06d120 con 0x7f111c1597d0 2023-09-13T06:02:11.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f11209ba640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c159bb0 con 0x7f111c06c9b0 2023-09-13T06:02:11.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f11209ba640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c0ce640 con 0x7f111c0cdee0 2023-09-13T06:02:11.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f1113fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f111c06c9b0 0x7f111c0cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:11.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f1113fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f111c06c9b0 0x7f111c0cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49882/0 (socket says 172.21.15.130:49882) 2023-09-13T06:02:11.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f1113fff640 1 -- 172.21.15.130:0/542830304 learned_addr learned my addr 172.21.15.130:0/542830304 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:11.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f111ad9d640 1 --2- 172.21.15.130:0/542830304 >> v2:172.21.15.164:3300/0 conn(0x7f111c0cdee0 0x7f111c06f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:11.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f1113fff640 1 -- 172.21.15.130:0/542830304 >> v2:172.21.15.164:3300/0 conn(0x7f111c0cdee0 msgr2=0x7f111c06f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:11.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f1113fff640 1 --2- 172.21.15.130:0/542830304 >> v2:172.21.15.164:3300/0 conn(0x7f111c0cdee0 0x7f111c06f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:11.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.892+0000 7f1113fff640 1 -- 172.21.15.130:0/542830304 >> v1:172.21.15.164:6789/0 conn(0x7f111c1597d0 legacy=0x7f111c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:11.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f1113fff640 1 -- 172.21.15.130:0/542830304 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c0ce920 con 0x7f111c06c9b0 2023-09-13T06:02:11.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f1113fff640 1 --2- 172.21.15.130:0/542830304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f111c06c9b0 0x7f111c0cd9a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f111c06e970 tx=0x7f110401d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4287cc9bb8f6024a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:11.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f1119d9b640 1 -- 172.21.15.130:0/542830304 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040ab620 con 0x7f111c06c9b0 2023-09-13T06:02:11.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f1119d9b640 1 -- 172.21.15.130:0/542830304 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11040ab780 con 0x7f111c06c9b0 2023-09-13T06:02:11.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f1119d9b640 1 -- 172.21.15.130:0/542830304 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040abb10 con 0x7f111c06c9b0 2023-09-13T06:02:11.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f11209ba640 1 -- 172.21.15.130:0/542830304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f111c06c9b0 msgr2=0x7f111c0cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:11.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f11209ba640 1 --2- 172.21.15.130:0/542830304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f111c06c9b0 0x7f111c0cd9a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f111c06e970 tx=0x7f110401d550 comp rx=0 tx=0).stop 2023-09-13T06:02:11.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f11209ba640 1 -- 172.21.15.130:0/542830304 shutdown_connections 2023-09-13T06:02:11.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f11209ba640 1 --2- 172.21.15.130:0/542830304 >> v2:172.21.15.164:3300/0 conn(0x7f111c0cdee0 0x7f111c06f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:11.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f11209ba640 1 --2- 172.21.15.130:0/542830304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f111c06c9b0 0x7f111c0cd9a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:11.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f11209ba640 1 -- 172.21.15.130:0/542830304 >> 172.21.15.130:0/542830304 conn(0x7f111c0b0bc0 msgr2=0x7f111c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:11.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f11209ba640 1 -- 172.21.15.130:0/542830304 shutdown_connections 2023-09-13T06:02:11.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.896+0000 7f11209ba640 1 -- 172.21.15.130:0/542830304 wait complete. 2023-09-13T06:02:11.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f11209ba640 1 Processor -- start 2023-09-13T06:02:11.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f11209ba640 1 -- start start 2023-09-13T06:02:11.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f11209ba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f111c06c9b0 0x7f111c140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:11.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f11209ba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f111c0cdee0 0x7f111c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:11.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f11209ba640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f111c1597d0 0x7f111c162870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:11.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f11209ba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c150a20 con 0x7f111c0cdee0 2023-09-13T06:02:11.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f11209ba640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c150c80 con 0x7f111c1597d0 2023-09-13T06:02:11.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f11209ba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c150f60 con 0x7f111c06c9b0 2023-09-13T06:02:11.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f1113fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f111c0cdee0 0x7f111c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:11.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f1113fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f111c0cdee0 0x7f111c1504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49892/0 (socket says 172.21.15.130:49892) 2023-09-13T06:02:11.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f1113fff640 1 -- 172.21.15.130:0/4237245575 learned_addr learned my addr 172.21.15.130:0/4237245575 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:11.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f111ad9d640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f111c1597d0 0x7f111c162870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:11.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f111a59c640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f111c06c9b0 0x7f111c140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:11.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f1113fff640 1 -- 172.21.15.130:0/4237245575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f111c06c9b0 msgr2=0x7f111c140500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:11.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f1113fff640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f111c06c9b0 0x7f111c140500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:11.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f1113fff640 1 -- 172.21.15.130:0/4237245575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f111c1597d0 msgr2=0x7f111c162870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:11.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f1113fff640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f111c1597d0 0x7f111c162870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:11.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f1113fff640 1 -- 172.21.15.130:0/4237245575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11040094d0 con 0x7f111c0cdee0 2023-09-13T06:02:11.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f1113fff640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f111c0cdee0 0x7f111c1504e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f110401a160 tx=0x7f110401a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:11.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.900+0000 7f1112ffd640 1 -- 172.21.15.130:0/4237245575 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040ba070 con 0x7f111c0cdee0 2023-09-13T06:02:11.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.904+0000 7f1112ffd640 1 -- 172.21.15.130:0/4237245575 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11040abbc0 con 0x7f111c0cdee0 2023-09-13T06:02:11.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.904+0000 7f1112ffd640 1 -- 172.21.15.130:0/4237245575 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040b4420 con 0x7f111c0cdee0 2023-09-13T06:02:11.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.904+0000 7f11209ba640 1 -- 172.21.15.130:0/4237245575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c151240 con 0x7f111c0cdee0 2023-09-13T06:02:11.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.904+0000 7f11209ba640 1 -- 172.21.15.130:0/4237245575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c14d5d0 con 0x7f111c0cdee0 2023-09-13T06:02:11.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.904+0000 7f11209ba640 1 -- 172.21.15.130:0/4237245575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111c0618a0 con 0x7f111c0cdee0 2023-09-13T06:02:11.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.904+0000 7f1112ffd640 1 -- 172.21.15.130:0/4237245575 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f11040b4580 con 0x7f111c0cdee0 2023-09-13T06:02:11.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.904+0000 7f1112ffd640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10fc065b20 0x7f10fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:11.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.904+0000 7f1112ffd640 1 -- 172.21.15.130:0/4237245575 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f110411c8c0 con 0x7f111c0cdee0 2023-09-13T06:02:11.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.904+0000 7f111a59c640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10fc065b20 0x7f10fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:11.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.908+0000 7f111a59c640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10fc065b20 0x7f10fc067fe0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f110c007fd0 tx=0x7f110c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:11.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:11.908+0000 7f1112ffd640 1 -- 172.21.15.130:0/4237245575 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f11040ea500 con 0x7f111c0cdee0 2023-09-13T06:02:12.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 -- 172.21.15.130:0/4237245575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f111c164270 con 0x7f111c0cdee0 2023-09-13T06:02:12.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f1112ffd640 1 -- 172.21.15.130:0/4237245575 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f11040edb20 con 0x7f111c0cdee0 2023-09-13T06:02:12.117 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:12.117 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:02:12.117 INFO:teuthology.orchestra.run.smithi130.stdout: "auth_dump": [ 2023-09-13T06:02:12.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.118 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.a", 2023-09-13T06:02:12.118 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw==", 2023-09-13T06:02:12.119 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.119 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:12.119 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:02:12.120 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:02:12.120 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.120 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.121 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.b", 2023-09-13T06:02:12.121 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg==", 2023-09-13T06:02:12.121 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.121 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:12.122 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:02:12.122 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:02:12.122 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.122 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.123 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.c", 2023-09-13T06:02:12.123 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A==", 2023-09-13T06:02:12.123 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.124 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:12.124 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:02:12.124 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:02:12.124 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.125 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.125 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.d", 2023-09-13T06:02:12.126 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg==", 2023-09-13T06:02:12.126 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.126 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:12.126 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:02:12.126 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:02:12.127 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.127 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.128 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.0", 2023-09-13T06:02:12.128 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw==", 2023-09-13T06:02:12.129 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.129 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:12.129 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:12.130 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.130 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.131 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.1", 2023-09-13T06:02:12.131 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ==", 2023-09-13T06:02:12.131 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.131 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:12.132 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:12.132 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.132 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.133 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.2", 2023-09-13T06:02:12.133 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw==", 2023-09-13T06:02:12.134 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.134 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:12.134 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:12.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.135 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.136 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.3", 2023-09-13T06:02:12.136 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g==", 2023-09-13T06:02:12.137 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.137 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:12.137 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:12.137 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.137 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.138 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.4", 2023-09-13T06:02:12.138 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ==", 2023-09-13T06:02:12.139 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.139 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:12.139 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:12.140 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.140 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.140 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.141 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.5", 2023-09-13T06:02:12.141 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw==", 2023-09-13T06:02:12.141 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.141 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:12.141 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:12.142 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.142 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.143 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.143 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.6", 2023-09-13T06:02:12.143 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA==", 2023-09-13T06:02:12.143 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.143 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:12.143 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:12.144 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.144 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.144 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.145 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.7", 2023-09-13T06:02:12.145 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA==", 2023-09-13T06:02:12.145 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.146 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:12.146 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:12.146 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.147 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.147 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.0", 2023-09-13T06:02:12.147 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA==", 2023-09-13T06:02:12.148 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.148 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:12.148 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:02:12.148 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:02:12.148 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:02:12.149 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.149 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.149 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.150 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.1", 2023-09-13T06:02:12.150 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg==", 2023-09-13T06:02:12.150 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.151 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:12.151 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:02:12.151 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:02:12.151 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:02:12.151 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.152 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.2", 2023-09-13T06:02:12.152 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw==", 2023-09-13T06:02:12.152 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.153 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:12.153 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:02:12.153 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:02:12.153 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:02:12.153 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.154 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.3", 2023-09-13T06:02:12.154 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA==", 2023-09-13T06:02:12.155 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.155 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:12.155 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:02:12.156 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:02:12.156 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:02:12.156 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.157 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.admin", 2023-09-13T06:02:12.157 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQANUAFl5ccJOBAAP4KJItnG8vNd5OP/63ai0g==", 2023-09-13T06:02:12.158 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.158 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:02:12.159 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:02:12.159 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:02:12.159 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.159 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.161 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.bootstrap-mds", 2023-09-13T06:02:12.161 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAjUAFlqLNiHxAA6lGkGcsp4veuoCRoNpNgTQ==", 2023-09-13T06:02:12.161 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.162 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile bootstrap-mds" 2023-09-13T06:02:12.162 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.163 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.bootstrap-mgr", 2023-09-13T06:02:12.163 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAjUAFlrsZiHxAA8o3r84Z5MKJO9MXRVOiOdg==", 2023-09-13T06:02:12.163 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.164 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile bootstrap-mgr" 2023-09-13T06:02:12.164 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.165 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.bootstrap-osd", 2023-09-13T06:02:12.165 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAjUAFlh9ViHxAAjsLwOrYY+uvJ7d3L/CgYdA==", 2023-09-13T06:02:12.166 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.166 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile bootstrap-osd" 2023-09-13T06:02:12.166 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.167 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.bootstrap-rbd", 2023-09-13T06:02:12.167 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAjUAFlV+ViHxAADI6XBU4fRn4wGSsMD4Exgw==", 2023-09-13T06:02:12.168 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.168 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile bootstrap-rbd" 2023-09-13T06:02:12.168 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.169 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-09-13T06:02:12.169 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAjUAFlFPZiHxAAmJhbqVJ9SB+24JzD8oVKAw==", 2023-09-13T06:02:12.169 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.170 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-09-13T06:02:12.170 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.171 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.bootstrap-rgw", 2023-09-13T06:02:12.171 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAjUAFl4ABjHxAAM9bVFYU33F700zn2QFR/Tw==", 2023-09-13T06:02:12.171 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.171 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile bootstrap-rgw" 2023-09-13T06:02:12.171 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.172 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.x", 2023-09-13T06:02:12.172 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ==", 2023-09-13T06:02:12.173 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.173 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:02:12.173 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:02:12.173 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.174 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:12.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:12.175 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.y", 2023-09-13T06:02:12.175 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA==", 2023-09-13T06:02:12.175 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:12.176 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:02:12.176 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:02:12.176 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:12.177 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.177 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:12.178 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:02:12.178 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:02:12.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 -- 172.21.15.130:0/4237245575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10fc065b20 msgr2=0x7f10fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10fc065b20 0x7f10fc067fe0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f110c007fd0 tx=0x7f110c009040 comp rx=0 tx=0).stop 2023-09-13T06:02:12.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 -- 172.21.15.130:0/4237245575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f111c0cdee0 msgr2=0x7f111c1504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f111c0cdee0 0x7f111c1504e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f110401a160 tx=0x7f110401a2f0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 -- 172.21.15.130:0/4237245575 shutdown_connections 2023-09-13T06:02:12.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10fc065b20 0x7f10fc067fe0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f111c1597d0 0x7f111c162870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f111c0cdee0 0x7f111c1504e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 --2- 172.21.15.130:0/4237245575 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f111c06c9b0 0x7f111c140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 -- 172.21.15.130:0/4237245575 >> 172.21.15.130:0/4237245575 conn(0x7f111c0b0bc0 msgr2=0x7f111c0b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:12.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 -- 172.21.15.130:0/4237245575 shutdown_connections 2023-09-13T06:02:12.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.112+0000 7f11209ba640 1 -- 172.21.15.130:0/4237245575 wait complete. 2023-09-13T06:02:12.184 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-09-13T06:02:12.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.316+0000 7f11c64cb640 1 Processor -- start 2023-09-13T06:02:12.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11c64cb640 1 -- start start 2023-09-13T06:02:12.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11c64cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11c015b130 0x7f11c00cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11c64cb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f11c00b04a0 0x7f11c00b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11c64cb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c00ce980 con 0x7f11c00ce180 2023-09-13T06:02:12.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11c64cb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c00b0e70 con 0x7f11c00b04a0 2023-09-13T06:02:12.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11c64cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00cec60 con 0x7f11c015b130 2023-09-13T06:02:12.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11bffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11c015b130 0x7f11c00cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11c4a68640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f11c00b04a0 0x7f11c00b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11bf7fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f11c00ce180 0x7f11c015b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:54326/0 (socket says 172.21.15.130:54326) 2023-09-13T06:02:12.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11bf7fe640 1 -- 172.21.15.130:0/2136957870 learned_addr learned my addr 172.21.15.130:0/2136957870 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:12.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11bffff640 1 -- 172.21.15.130:0/2136957870 >> v2:172.21.15.164:3300/0 conn(0x7f11c00b04a0 msgr2=0x7f11c00b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:12.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11bffff640 1 --2- 172.21.15.130:0/2136957870 >> v2:172.21.15.164:3300/0 conn(0x7f11c00b04a0 0x7f11c00b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11bffff640 1 -- 172.21.15.130:0/2136957870 >> v1:172.21.15.164:6789/0 conn(0x7f11c00ce180 legacy=0x7f11c015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.320+0000 7f11bffff640 1 -- 172.21.15.130:0/2136957870 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c006c640 con 0x7f11c015b130 2023-09-13T06:02:12.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11bffff640 1 --2- 172.21.15.130:0/2136957870 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11c015b130 0x7f11c00cc780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097c0 tx=0x7f11b001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=696d4b93e746492b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:12.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11beffd640 1 -- 172.21.15.130:0/2136957870 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00ab680 con 0x7f11c015b130 2023-09-13T06:02:12.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11beffd640 1 -- 172.21.15.130:0/2136957870 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b00ab7e0 con 0x7f11c015b130 2023-09-13T06:02:12.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11beffd640 1 -- 172.21.15.130:0/2136957870 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00abb70 con 0x7f11c015b130 2023-09-13T06:02:12.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11c64cb640 1 -- 172.21.15.130:0/2136957870 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11c015b130 msgr2=0x7f11c00cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11c64cb640 1 --2- 172.21.15.130:0/2136957870 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11c015b130 0x7f11c00cc780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097c0 tx=0x7f11b001c480 comp rx=0 tx=0).stop 2023-09-13T06:02:12.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11c64cb640 1 -- 172.21.15.130:0/2136957870 shutdown_connections 2023-09-13T06:02:12.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11c64cb640 1 --2- 172.21.15.130:0/2136957870 >> v2:172.21.15.164:3300/0 conn(0x7f11c00b04a0 0x7f11c00b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11c64cb640 1 --2- 172.21.15.130:0/2136957870 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11c015b130 0x7f11c00cc780 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11c64cb640 1 -- 172.21.15.130:0/2136957870 >> 172.21.15.130:0/2136957870 conn(0x7f11c0065990 msgr2=0x7f11c0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:12.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11c64cb640 1 -- 172.21.15.130:0/2136957870 shutdown_connections 2023-09-13T06:02:12.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11c64cb640 1 -- 172.21.15.130:0/2136957870 wait complete. 2023-09-13T06:02:12.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.324+0000 7f11c64cb640 1 Processor -- start 2023-09-13T06:02:12.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11c64cb640 1 -- start start 2023-09-13T06:02:12.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11c64cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11c00b04a0 0x7f11c014cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11c64cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11c00ce180 0x7f11c014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11c64cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11c015b130 0x7f11c01502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11c64cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c014c8a0 con 0x7f11c00b04a0 2023-09-13T06:02:12.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11c64cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c014bc90 con 0x7f11c015b130 2023-09-13T06:02:12.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11c64cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c014bf70 con 0x7f11c00ce180 2023-09-13T06:02:12.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11c00b04a0 0x7f11c014cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11c00b04a0 0x7f11c014cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49894/0 (socket says 172.21.15.130:49894) 2023-09-13T06:02:12.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bffff640 1 -- 172.21.15.130:0/2840065831 learned_addr learned my addr 172.21.15.130:0/2840065831 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:12.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bf7fe640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11c00ce180 0x7f11c014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11c4a68640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11c015b130 0x7f11c01502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bffff640 1 -- 172.21.15.130:0/2840065831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11c00ce180 msgr2=0x7f11c014fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bffff640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11c00ce180 0x7f11c014fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bffff640 1 -- 172.21.15.130:0/2840065831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11c015b130 msgr2=0x7f11c01502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bffff640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11c015b130 0x7f11c01502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bffff640 1 -- 172.21.15.130:0/2840065831 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009420 con 0x7f11c00b04a0 2023-09-13T06:02:12.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bffff640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11c00b04a0 0x7f11c014cd30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f11b001a0b0 tx=0x7f11b001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:12.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bcff9640 1 -- 172.21.15.130:0/2840065831 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00bf610 con 0x7f11c00b04a0 2023-09-13T06:02:12.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bcff9640 1 -- 172.21.15.130:0/2840065831 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b00bf770 con 0x7f11c00b04a0 2023-09-13T06:02:12.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11bcff9640 1 -- 172.21.15.130:0/2840065831 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00bfb20 con 0x7f11c00b04a0 2023-09-13T06:02:12.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11c64cb640 1 -- 172.21.15.130:0/2840065831 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c014c250 con 0x7f11c00b04a0 2023-09-13T06:02:12.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11c64cb640 1 -- 172.21.15.130:0/2840065831 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c014b790 con 0x7f11c00b04a0 2023-09-13T06:02:12.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.328+0000 7f11c64cb640 1 -- 172.21.15.130:0/2840065831 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c00618a0 con 0x7f11c00b04a0 2023-09-13T06:02:12.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.332+0000 7f11bcff9640 1 -- 172.21.15.130:0/2840065831 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f11b00b5400 con 0x7f11c00b04a0 2023-09-13T06:02:12.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.332+0000 7f11bcff9640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11ac065b20 0x7f11ac067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.332+0000 7f11bcff9640 1 -- 172.21.15.130:0/2840065831 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f11b011dc90 con 0x7f11c00b04a0 2023-09-13T06:02:12.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.332+0000 7f11bf7fe640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11ac065b20 0x7f11ac067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.332+0000 7f11bf7fe640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11ac065b20 0x7f11ac067fe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11c0151e10 tx=0x7f11b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:12.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.336+0000 7f11bcff9640 1 -- 172.21.15.130:0/2840065831 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f11b00eb940 con 0x7f11c00b04a0 2023-09-13T06:02:12.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.536+0000 7f11c64cb640 1 -- 172.21.15.130:0/2840065831 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f11c0151880 con 0x7f11c00b04a0 2023-09-13T06:02:12.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.540+0000 7f11bcff9640 1 -- 172.21.15.130:0/2840065831 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f11b00eef60 con 0x7f11c00b04a0 2023-09-13T06:02:12.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.540+0000 7f11c64cb640 1 -- 172.21.15.130:0/2840065831 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11ac065b20 msgr2=0x7f11ac067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.544+0000 7f11c64cb640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11ac065b20 0x7f11ac067fe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11c0151e10 tx=0x7f11b4009040 comp rx=0 tx=0).stop 2023-09-13T06:02:12.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.544+0000 7f11c64cb640 1 -- 172.21.15.130:0/2840065831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11c00b04a0 msgr2=0x7f11c014cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.544+0000 7f11c64cb640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11c00b04a0 0x7f11c014cd30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f11b001a0b0 tx=0x7f11b001acc0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.544+0000 7f11c64cb640 1 -- 172.21.15.130:0/2840065831 shutdown_connections 2023-09-13T06:02:12.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.544+0000 7f11c64cb640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11ac065b20 0x7f11ac067fe0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.544+0000 7f11c64cb640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11c015b130 0x7f11c01502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.544+0000 7f11c64cb640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11c00ce180 0x7f11c014fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.544+0000 7f11c64cb640 1 --2- 172.21.15.130:0/2840065831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11c00b04a0 0x7f11c014cd30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.544+0000 7f11c64cb640 1 -- 172.21.15.130:0/2840065831 >> 172.21.15.130:0/2840065831 conn(0x7f11c0065990 msgr2=0x7f11c0154bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:12.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.544+0000 7f11c64cb640 1 -- 172.21.15.130:0/2840065831 shutdown_connections 2023-09-13T06:02:12.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.544+0000 7f11c64cb640 1 -- 172.21.15.130:0/2840065831 wait complete. 2023-09-13T06:02:12.567 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-09-13T06:02:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cba46d640 1 Processor -- start 2023-09-13T06:02:12.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cba46d640 1 -- start start 2023-09-13T06:02:12.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cba46d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb4146540 0x7f2cb4070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cba46d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2cb4070b90 0x7f2cb4160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cba46d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb4070fe0 con 0x7f2cb41436e0 2023-09-13T06:02:12.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cba46d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb406f640 con 0x7f2cb4070b90 2023-09-13T06:02:12.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cba46d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb406f890 con 0x7f2cb4146540 2023-09-13T06:02:12.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cb8a0a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2cb4070b90 0x7f2cb4160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cb8a0a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2cb4070b90 0x7f2cb4160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49908/0 (socket says 172.21.15.130:49908) 2023-09-13T06:02:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cb8a0a640 1 -- 172.21.15.130:0/1622762900 learned_addr learned my addr 172.21.15.130:0/1622762900 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cb37fe640 1 --2- 172.21.15.130:0/1622762900 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb4146540 0x7f2cb4070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cb8a0a640 1 -- 172.21.15.130:0/1622762900 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb4146540 msgr2=0x7f2cb4070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cb8a0a640 1 --2- 172.21.15.130:0/1622762900 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb4146540 0x7f2cb4070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cb8a0a640 1 -- 172.21.15.130:0/1622762900 >> v1:172.21.15.130:6789/0 conn(0x7f2cb41436e0 legacy=0x7f2cb40ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.704+0000 7f2cb8a0a640 1 -- 172.21.15.130:0/1622762900 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb406fb70 con 0x7f2cb4070b90 2023-09-13T06:02:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cb8a0a640 1 --2- 172.21.15.130:0/1622762900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb4070b90 0x7f2cb4160eb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009e50 tx=0x7f2cac01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8579d79feecb3ba server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cb2ffd640 1 -- 172.21.15.130:0/1622762900 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0a56a0 con 0x7f2cb4070b90 2023-09-13T06:02:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cb2ffd640 1 -- 172.21.15.130:0/1622762900 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac0a5800 con 0x7f2cb4070b90 2023-09-13T06:02:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cb2ffd640 1 -- 172.21.15.130:0/1622762900 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0a5b90 con 0x7f2cb4070b90 2023-09-13T06:02:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cba46d640 1 -- 172.21.15.130:0/1622762900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb4070b90 msgr2=0x7f2cb4160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cba46d640 1 --2- 172.21.15.130:0/1622762900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb4070b90 0x7f2cb4160eb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009e50 tx=0x7f2cac01c8f0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cba46d640 1 -- 172.21.15.130:0/1622762900 shutdown_connections 2023-09-13T06:02:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cba46d640 1 --2- 172.21.15.130:0/1622762900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb4070b90 0x7f2cb4160eb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cba46d640 1 --2- 172.21.15.130:0/1622762900 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb4146540 0x7f2cb4070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cba46d640 1 -- 172.21.15.130:0/1622762900 >> 172.21.15.130:0/1622762900 conn(0x7f2cb40b0bc0 msgr2=0x7f2cb40b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cba46d640 1 -- 172.21.15.130:0/1622762900 shutdown_connections 2023-09-13T06:02:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cba46d640 1 -- 172.21.15.130:0/1622762900 wait complete. 2023-09-13T06:02:12.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.708+0000 7f2cba46d640 1 Processor -- start 2023-09-13T06:02:12.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cba46d640 1 -- start start 2023-09-13T06:02:12.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cba46d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb4070b90 0x7f2cb413a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cba46d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb41436e0 0x7f2cb4141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cba46d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb4146540 0x7f2cb41424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cba46d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4139f70 con 0x7f2cb4146540 2023-09-13T06:02:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cba46d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4139c90 con 0x7f2cb4070b90 2023-09-13T06:02:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cba46d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4140d80 con 0x7f2cb41436e0 2023-09-13T06:02:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb8a0a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb4146540 0x7f2cb41424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb8a0a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb4146540 0x7f2cb41424b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49918/0 (socket says 172.21.15.130:49918) 2023-09-13T06:02:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb8a0a640 1 -- 172.21.15.130:0/836307105 learned_addr learned my addr 172.21.15.130:0/836307105 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb37fe640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb41436e0 0x7f2cb4141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb3fff640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb4070b90 0x7f2cb413a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb8a0a640 1 -- 172.21.15.130:0/836307105 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb41436e0 msgr2=0x7f2cb4141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb8a0a640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb41436e0 0x7f2cb4141860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb8a0a640 1 -- 172.21.15.130:0/836307105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb4070b90 msgr2=0x7f2cb413a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb8a0a640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb4070b90 0x7f2cb413a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb8a0a640 1 -- 172.21.15.130:0/836307105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac009b30 con 0x7f2cb4146540 2023-09-13T06:02:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb8a0a640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb4146540 0x7f2cb41424b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2cac01a520 tx=0x7f2cac019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb0ff9640 1 -- 172.21.15.130:0/836307105 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0b8670 con 0x7f2cb4146540 2023-09-13T06:02:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb0ff9640 1 -- 172.21.15.130:0/836307105 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac0b87d0 con 0x7f2cb4146540 2023-09-13T06:02:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cb0ff9640 1 -- 172.21.15.130:0/836307105 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0b8b60 con 0x7f2cb4146540 2023-09-13T06:02:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cba46d640 1 -- 172.21.15.130:0/836307105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb4141060 con 0x7f2cb4146540 2023-09-13T06:02:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cba46d640 1 -- 172.21.15.130:0/836307105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb4141da0 con 0x7f2cb4146540 2023-09-13T06:02:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.712+0000 7f2cba46d640 1 -- 172.21.15.130:0/836307105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb40618a0 con 0x7f2cb4146540 2023-09-13T06:02:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.716+0000 7f2cb0ff9640 1 -- 172.21.15.130:0/836307105 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2cb4161c00 con 0x7f2cb4146540 2023-09-13T06:02:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.716+0000 7f2cb0ff9640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ca0065b20 0x7f2ca0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.716+0000 7f2cb0ff9640 1 -- 172.21.15.130:0/836307105 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2cac11dfe0 con 0x7f2cb4146540 2023-09-13T06:02:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.716+0000 7f2cb3fff640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ca0065b20 0x7f2ca0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.716+0000 7f2cb3fff640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ca0065b20 0x7f2ca0067fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4007fd0 tx=0x7f2ca4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.720+0000 7f2cb0ff9640 1 -- 172.21.15.130:0/836307105 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2cac0ebd80 con 0x7f2cb4146540 2023-09-13T06:02:12.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.920+0000 7f2cba46d640 1 -- 172.21.15.130:0/836307105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f2cb4140a80 con 0x7f2cb4146540 2023-09-13T06:02:12.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.924+0000 7f2cb0ff9640 1 -- 172.21.15.130:0/836307105 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2cac009510 con 0x7f2cb4146540 2023-09-13T06:02:12.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 -- 172.21.15.130:0/836307105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ca0065b20 msgr2=0x7f2ca0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ca0065b20 0x7f2ca0067fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4007fd0 tx=0x7f2ca4009040 comp rx=0 tx=0).stop 2023-09-13T06:02:12.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 -- 172.21.15.130:0/836307105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb4146540 msgr2=0x7f2cb41424b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:12.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb4146540 0x7f2cb41424b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2cac01a520 tx=0x7f2cac019690 comp rx=0 tx=0).stop 2023-09-13T06:02:12.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 -- 172.21.15.130:0/836307105 shutdown_connections 2023-09-13T06:02:12.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ca0065b20 0x7f2ca0067fe0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cb4146540 0x7f2cb41424b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb41436e0 0x7f2cb4141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 --2- 172.21.15.130:0/836307105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb4070b90 0x7f2cb413a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:12.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 -- 172.21.15.130:0/836307105 >> 172.21.15.130:0/836307105 conn(0x7f2cb40b0bc0 msgr2=0x7f2cb40ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:12.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 -- 172.21.15.130:0/836307105 shutdown_connections 2023-09-13T06:02:12.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:12.928+0000 7f2cba46d640 1 -- 172.21.15.130:0/836307105 wait complete. 2023-09-13T06:02:12.950 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-09-13T06:02:13.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.084+0000 7fcb8009c640 1 Processor -- start 2023-09-13T06:02:13.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.084+0000 7fcb8009c640 1 -- start start 2023-09-13T06:02:13.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb8009c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcb7815d260 0x7fcb780b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb8009c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb780ce1a0 0x7fcb7806d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb8009c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb78072310 con 0x7fcb780afc70 2023-09-13T06:02:13.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb8009c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb78070e70 con 0x7fcb7815d260 2023-09-13T06:02:13.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb8009c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb78070280 con 0x7fcb780ce1a0 2023-09-13T06:02:13.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7de38640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcb7815d260 0x7fcb780b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7de38640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcb7815d260 0x7fcb780b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49930/0 (socket says 172.21.15.130:49930) 2023-09-13T06:02:13.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7de38640 1 -- 172.21.15.130:0/894307023 learned_addr learned my addr 172.21.15.130:0/894307023 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:13.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7e639640 1 --1- 172.21.15.130:0/894307023 >> v1:172.21.15.130:6789/0 conn(0x7fcb780afc70 0x7fcb78160f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:45508/0 (socket says 172.21.15.130:45508) 2023-09-13T06:02:13.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7de38640 1 -- 172.21.15.130:0/894307023 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb780ce1a0 msgr2=0x7fcb7806d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:13.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7de38640 1 --2- 172.21.15.130:0/894307023 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb780ce1a0 0x7fcb7806d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7de38640 1 -- 172.21.15.130:0/894307023 >> v1:172.21.15.130:6789/0 conn(0x7fcb780afc70 legacy=0x7fcb78160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7de38640 1 -- 172.21.15.130:0/894307023 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb78070540 con 0x7fcb7815d260 2023-09-13T06:02:13.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7de38640 1 --2- 172.21.15.130:0/894307023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb7815d260 0x7fcb780b5800 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009870 tx=0x7fcb7401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d90542346f015c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:13.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7ce36640 1 -- 172.21.15.130:0/894307023 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740ab620 con 0x7fcb7815d260 2023-09-13T06:02:13.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7ce36640 1 -- 172.21.15.130:0/894307023 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb740ab780 con 0x7fcb7815d260 2023-09-13T06:02:13.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.088+0000 7fcb7ce36640 1 -- 172.21.15.130:0/894307023 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740abb10 con 0x7fcb7815d260 2023-09-13T06:02:13.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 -- 172.21.15.130:0/894307023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb7815d260 msgr2=0x7fcb780b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 --2- 172.21.15.130:0/894307023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb7815d260 0x7fcb780b5800 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009870 tx=0x7fcb7401c510 comp rx=0 tx=0).stop 2023-09-13T06:02:13.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 -- 172.21.15.130:0/894307023 shutdown_connections 2023-09-13T06:02:13.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 --2- 172.21.15.130:0/894307023 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb780ce1a0 0x7fcb7806d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 --2- 172.21.15.130:0/894307023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb7815d260 0x7fcb780b5800 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 -- 172.21.15.130:0/894307023 >> 172.21.15.130:0/894307023 conn(0x7fcb7806a2f0 msgr2=0x7fcb7806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:13.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 -- 172.21.15.130:0/894307023 shutdown_connections 2023-09-13T06:02:13.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 -- 172.21.15.130:0/894307023 wait complete. 2023-09-13T06:02:13.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 Processor -- start 2023-09-13T06:02:13.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 -- start start 2023-09-13T06:02:13.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb780afc70 0x7fcb780d0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb780ce1a0 0x7fcb780ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb7815d260 0x7fcb78151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780caeb0 con 0x7fcb780afc70 2023-09-13T06:02:13.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780cb130 con 0x7fcb7815d260 2023-09-13T06:02:13.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb8009c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780cb410 con 0x7fcb780ce1a0 2023-09-13T06:02:13.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb7de38640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb780afc70 0x7fcb780d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb7de38640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb780afc70 0x7fcb780d0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49934/0 (socket says 172.21.15.130:49934) 2023-09-13T06:02:13.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb7de38640 1 -- 172.21.15.130:0/1093593259 learned_addr learned my addr 172.21.15.130:0/1093593259 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:13.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb7e639640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb7815d260 0x7fcb78151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb7d637640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb780ce1a0 0x7fcb780ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb7de38640 1 -- 172.21.15.130:0/1093593259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb780ce1a0 msgr2=0x7fcb780ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb7de38640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb780ce1a0 0x7fcb780ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb7de38640 1 -- 172.21.15.130:0/1093593259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb7815d260 msgr2=0x7fcb78151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb7de38640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb7815d260 0x7fcb78151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb7de38640 1 -- 172.21.15.130:0/1093593259 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb740094d0 con 0x7fcb780afc70 2023-09-13T06:02:13.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.092+0000 7fcb7d637640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb780ce1a0 0x7fcb780ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:13.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.096+0000 7fcb7de38640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb780afc70 0x7fcb780d0430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcb740ad040 tx=0x7fcb7401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:13.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.096+0000 7fcb6e7fc640 1 -- 172.21.15.130:0/1093593259 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740be3f0 con 0x7fcb780afc70 2023-09-13T06:02:13.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.096+0000 7fcb6e7fc640 1 -- 172.21.15.130:0/1093593259 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb740be550 con 0x7fcb780afc70 2023-09-13T06:02:13.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.096+0000 7fcb8009c640 1 -- 172.21.15.130:0/1093593259 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb780cb6f0 con 0x7fcb780afc70 2023-09-13T06:02:13.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.096+0000 7fcb6e7fc640 1 -- 172.21.15.130:0/1093593259 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740be900 con 0x7fcb780afc70 2023-09-13T06:02:13.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.096+0000 7fcb8009c640 1 -- 172.21.15.130:0/1093593259 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb78151c40 con 0x7fcb780afc70 2023-09-13T06:02:13.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.096+0000 7fcb8009c640 1 -- 172.21.15.130:0/1093593259 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb780618a0 con 0x7fcb780afc70 2023-09-13T06:02:13.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.096+0000 7fcb6e7fc640 1 -- 172.21.15.130:0/1093593259 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcb740bea60 con 0x7fcb780afc70 2023-09-13T06:02:13.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.096+0000 7fcb6e7fc640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb5c065b20 0x7fcb5c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.096+0000 7fcb6e7fc640 1 -- 172.21.15.130:0/1093593259 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcb7411d810 con 0x7fcb780afc70 2023-09-13T06:02:13.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.096+0000 7fcb7d637640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb5c065b20 0x7fcb5c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.100+0000 7fcb7d637640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb5c065b20 0x7fcb5c067fe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb780ce5a0 tx=0x7fcb68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:13.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.100+0000 7fcb6e7fc640 1 -- 172.21.15.130:0/1093593259 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcb740eb4a0 con 0x7fcb780afc70 2023-09-13T06:02:13.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.300+0000 7fcb8009c640 1 -- 172.21.15.130:0/1093593259 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fcb78153ce0 con 0x7fcb780afc70 2023-09-13T06:02:13.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.304+0000 7fcb6e7fc640 1 -- 172.21.15.130:0/1093593259 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcb740eeac0 con 0x7fcb780afc70 2023-09-13T06:02:13.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 -- 172.21.15.130:0/1093593259 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb5c065b20 msgr2=0x7fcb5c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb5c065b20 0x7fcb5c067fe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb780ce5a0 tx=0x7fcb68008040 comp rx=0 tx=0).stop 2023-09-13T06:02:13.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 -- 172.21.15.130:0/1093593259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb780afc70 msgr2=0x7fcb780d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb780afc70 0x7fcb780d0430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcb740ad040 tx=0x7fcb7401ad50 comp rx=0 tx=0).stop 2023-09-13T06:02:13.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 -- 172.21.15.130:0/1093593259 shutdown_connections 2023-09-13T06:02:13.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb5c065b20 0x7fcb5c067fe0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb7815d260 0x7fcb78151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb780ce1a0 0x7fcb780ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 --2- 172.21.15.130:0/1093593259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb780afc70 0x7fcb780d0430 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 -- 172.21.15.130:0/1093593259 >> 172.21.15.130:0/1093593259 conn(0x7fcb7806a2f0 msgr2=0x7fcb780ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:13.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 -- 172.21.15.130:0/1093593259 shutdown_connections 2023-09-13T06:02:13.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.308+0000 7fcb8009c640 1 -- 172.21.15.130:0/1093593259 wait complete. 2023-09-13T06:02:13.331 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-09-13T06:02:13.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.464+0000 7f1a5e1fa640 1 Processor -- start 2023-09-13T06:02:13.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a5e1fa640 1 -- start start 2023-09-13T06:02:13.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a5e1fa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1a580b2da0 0x7f1a5806f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a5e1fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a580cf2a0 0x7f1a58160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a5e1fa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5815d9e0 con 0x7f1a5806fc70 2023-09-13T06:02:13.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a5e1fa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5815e660 con 0x7f1a580b2da0 2023-09-13T06:02:13.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a5e1fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5815dcc0 con 0x7f1a580cf2a0 2023-09-13T06:02:13.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a57fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a580cf2a0 0x7f1a58160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a577fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1a580b2da0 0x7f1a5806f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a57fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a580cf2a0 0x7f1a58160ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:33758/0 (socket says 172.21.15.130:33758) 2023-09-13T06:02:13.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a4ffff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f1a5806fc70 0x7f1a580ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:54338/0 (socket says 172.21.15.130:54338) 2023-09-13T06:02:13.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a577fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1a580b2da0 0x7f1a5806f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:53880/0 (socket says 172.21.15.130:53880) 2023-09-13T06:02:13.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a57fff640 1 -- 172.21.15.130:0/3514905718 learned_addr learned my addr 172.21.15.130:0/3514905718 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:13.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a577fe640 1 -- 172.21.15.130:0/3514905718 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a580cf2a0 msgr2=0x7f1a58160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:13.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a577fe640 1 --2- 172.21.15.130:0/3514905718 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a580cf2a0 0x7f1a58160ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a577fe640 1 -- 172.21.15.130:0/3514905718 >> v1:172.21.15.164:6789/0 conn(0x7f1a5806fc70 legacy=0x7f1a580ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.468+0000 7f1a577fe640 1 -- 172.21.15.130:0/3514905718 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5815dfa0 con 0x7f1a580b2da0 2023-09-13T06:02:13.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a577fe640 1 --2- 172.21.15.130:0/3514905718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a580b2da0 0x7f1a5806f730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a480097c0 tx=0x7f1a4801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a794739be814f82e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:13.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a56ffd640 1 -- 172.21.15.130:0/3514905718 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a480a8970 con 0x7f1a580b2da0 2023-09-13T06:02:13.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a56ffd640 1 -- 172.21.15.130:0/3514905718 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a480a8ad0 con 0x7f1a580b2da0 2023-09-13T06:02:13.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a56ffd640 1 -- 172.21.15.130:0/3514905718 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a480a8e60 con 0x7f1a580b2da0 2023-09-13T06:02:13.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3514905718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a580b2da0 msgr2=0x7f1a5806f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a5e1fa640 1 --2- 172.21.15.130:0/3514905718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a580b2da0 0x7f1a5806f730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a480097c0 tx=0x7f1a4801ec70 comp rx=0 tx=0).stop 2023-09-13T06:02:13.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3514905718 shutdown_connections 2023-09-13T06:02:13.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a5e1fa640 1 --2- 172.21.15.130:0/3514905718 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a580cf2a0 0x7f1a58160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a5e1fa640 1 --2- 172.21.15.130:0/3514905718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a580b2da0 0x7f1a5806f730 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3514905718 >> 172.21.15.130:0/3514905718 conn(0x7f1a5806a2f0 msgr2=0x7f1a5806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:13.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3514905718 shutdown_connections 2023-09-13T06:02:13.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3514905718 wait complete. 2023-09-13T06:02:13.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.472+0000 7f1a5e1fa640 1 Processor -- start 2023-09-13T06:02:13.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a5e1fa640 1 -- start start 2023-09-13T06:02:13.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a5e1fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a5806fc70 0x7f1a5813ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a5e1fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a580b2da0 0x7f1a581421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a5e1fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a580cf2a0 0x7f1a580ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a5e1fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5813f290 con 0x7f1a580cf2a0 2023-09-13T06:02:13.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a5e1fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58143d30 con 0x7f1a5806fc70 2023-09-13T06:02:13.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a5e1fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a580cac00 con 0x7f1a580b2da0 2023-09-13T06:02:13.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a57fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a580cf2a0 0x7f1a580ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a577fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a5806fc70 0x7f1a5813ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a577fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a5806fc70 0x7f1a5813ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:53886/0 (socket says 172.21.15.130:53886) 2023-09-13T06:02:13.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a577fe640 1 -- 172.21.15.130:0/3247281568 learned_addr learned my addr 172.21.15.130:0/3247281568 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:13.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a57fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a580cf2a0 0x7f1a580ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49938/0 (socket says 172.21.15.130:49938) 2023-09-13T06:02:13.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a4ffff640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a580b2da0 0x7f1a581421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a57fff640 1 -- 172.21.15.130:0/3247281568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a580b2da0 msgr2=0x7f1a581421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a57fff640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a580b2da0 0x7f1a581421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a57fff640 1 -- 172.21.15.130:0/3247281568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a5806fc70 msgr2=0x7f1a5813ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a57fff640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a5806fc70 0x7f1a5813ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a57fff640 1 -- 172.21.15.130:0/3247281568 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a48009420 con 0x7f1a580cf2a0 2023-09-13T06:02:13.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a577fe640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a5806fc70 0x7f1a5813ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:13.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a57fff640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a580cf2a0 0x7f1a580ca290 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000efc0 tx=0x7f1a5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:13.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a54ff9640 1 -- 172.21.15.130:0/3247281568 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5000cd20 con 0x7f1a580cf2a0 2023-09-13T06:02:13.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a54ff9640 1 -- 172.21.15.130:0/3247281568 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5000f040 con 0x7f1a580cf2a0 2023-09-13T06:02:13.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3247281568 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a580caee0 con 0x7f1a580cf2a0 2023-09-13T06:02:13.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a54ff9640 1 -- 172.21.15.130:0/3247281568 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50003be0 con 0x7f1a580cf2a0 2023-09-13T06:02:13.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3247281568 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a58143f80 con 0x7f1a580cf2a0 2023-09-13T06:02:13.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.476+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3247281568 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a581441a0 con 0x7f1a580cf2a0 2023-09-13T06:02:13.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.480+0000 7f1a54ff9640 1 -- 172.21.15.130:0/3247281568 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1a50003d40 con 0x7f1a580cf2a0 2023-09-13T06:02:13.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.480+0000 7f1a54ff9640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a38065b20 0x7f1a38067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.480+0000 7f1a54ff9640 1 -- 172.21.15.130:0/3247281568 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a50083480 con 0x7f1a580cf2a0 2023-09-13T06:02:13.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.480+0000 7f1a577fe640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a38065b20 0x7f1a38067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.480+0000 7f1a577fe640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a38065b20 0x7f1a38067fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1a480097c0 tx=0x7f1a48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:13.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.484+0000 7f1a54ff9640 1 -- 172.21.15.130:0/3247281568 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1a50051140 con 0x7f1a580cf2a0 2023-09-13T06:02:13.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.684+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3247281568 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f1a580618a0 con 0x7f1a580cf2a0 2023-09-13T06:02:13.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a54ff9640 1 -- 172.21.15.130:0/3247281568 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1a50054760 con 0x7f1a580cf2a0 2023-09-13T06:02:13.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3247281568 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a38065b20 msgr2=0x7f1a38067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a38065b20 0x7f1a38067fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1a480097c0 tx=0x7f1a48008040 comp rx=0 tx=0).stop 2023-09-13T06:02:13.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3247281568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a580cf2a0 msgr2=0x7f1a580ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a580cf2a0 0x7f1a580ca290 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000efc0 tx=0x7f1a5000c490 comp rx=0 tx=0).stop 2023-09-13T06:02:13.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3247281568 shutdown_connections 2023-09-13T06:02:13.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a38065b20 0x7f1a38067fe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a580cf2a0 0x7f1a580ca290 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a580b2da0 0x7f1a581421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 --2- 172.21.15.130:0/3247281568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a5806fc70 0x7f1a5813ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3247281568 >> 172.21.15.130:0/3247281568 conn(0x7f1a5806a2f0 msgr2=0x7f1a580ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:13.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3247281568 shutdown_connections 2023-09-13T06:02:13.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.692+0000 7f1a5e1fa640 1 -- 172.21.15.130:0/3247281568 wait complete. 2023-09-13T06:02:13.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-09-13T06:02:13.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.852+0000 7f8924d2c640 1 Processor -- start 2023-09-13T06:02:13.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.852+0000 7f8924d2c640 1 -- start start 2023-09-13T06:02:13.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f8924d2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8920146cf0 0x7f89200c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f8924d2c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89200c4150 con 0x7f89200cd170 2023-09-13T06:02:13.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f8924d2c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89200c4430 con 0x7f89201610a0 2023-09-13T06:02:13.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f8924d2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892006f170 con 0x7f8920146cf0 2023-09-13T06:02:13.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f891ed9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f89200cd170 0x7f892006f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:45524/0 (socket says 172.21.15.130:45524) 2023-09-13T06:02:13.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f891ed9d640 1 -- 172.21.15.130:0/1219801028 learned_addr learned my addr 172.21.15.130:0/1219801028 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:13.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f891e59c640 1 --2- 172.21.15.130:0/1219801028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8920146cf0 0x7f89200c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f891d59a640 1 -- 172.21.15.130:0/1219801028 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267887042 0 0) 0x7f89200c4150 con 0x7f89200cd170 2023-09-13T06:02:13.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f891d59a640 1 -- 172.21.15.130:0/1219801028 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8908003530 con 0x7f89200cd170 2023-09-13T06:02:13.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f891d59a640 1 -- 172.21.15.130:0/1219801028 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786335501 0 0) 0x7f89200c4430 con 0x7f89201610a0 2023-09-13T06:02:13.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f891d59a640 1 -- 172.21.15.130:0/1219801028 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89200c4150 con 0x7f89201610a0 2023-09-13T06:02:13.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f891e59c640 1 -- 172.21.15.130:0/1219801028 >> v1:172.21.15.164:6789/0 conn(0x7f89201610a0 legacy=0x7f89200cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f891e59c640 1 -- 172.21.15.130:0/1219801028 >> v1:172.21.15.130:6789/0 conn(0x7f89200cd170 legacy=0x7f892006f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f891d59a640 1 -- 172.21.15.130:0/1219801028 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2791929300 0 0) 0x7f8908003530 con 0x7f89200cd170 2023-09-13T06:02:13.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.856+0000 7f891e59c640 1 -- 172.21.15.130:0/1219801028 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89200c4710 con 0x7f8920146cf0 2023-09-13T06:02:13.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f891e59c640 1 --2- 172.21.15.130:0/1219801028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8920146cf0 0x7f89200c38e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8910009dc0 tx=0x7f891001f080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=275c289609692908 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:13.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f891d59a640 1 -- 172.21.15.130:0/1219801028 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918001680 con 0x7f8920146cf0 2023-09-13T06:02:13.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f891d59a640 1 -- 172.21.15.130:0/1219801028 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89100a8c10 con 0x7f8920146cf0 2023-09-13T06:02:13.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f891d59a640 1 -- 172.21.15.130:0/1219801028 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100b0440 con 0x7f8920146cf0 2023-09-13T06:02:13.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f8924d2c640 1 -- 172.21.15.130:0/1219801028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8920146cf0 msgr2=0x7f89200c38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f8924d2c640 1 --2- 172.21.15.130:0/1219801028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8920146cf0 0x7f89200c38e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8910009dc0 tx=0x7f891001f080 comp rx=0 tx=0).stop 2023-09-13T06:02:13.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f8924d2c640 1 -- 172.21.15.130:0/1219801028 shutdown_connections 2023-09-13T06:02:13.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f8924d2c640 1 --2- 172.21.15.130:0/1219801028 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8920146cf0 0x7f89200c38e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f8924d2c640 1 -- 172.21.15.130:0/1219801028 >> 172.21.15.130:0/1219801028 conn(0x7f892006a2f0 msgr2=0x7f892006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:13.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f8924d2c640 1 -- 172.21.15.130:0/1219801028 shutdown_connections 2023-09-13T06:02:13.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f8924d2c640 1 -- 172.21.15.130:0/1219801028 wait complete. 2023-09-13T06:02:13.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.860+0000 7f8924d2c640 1 Processor -- start 2023-09-13T06:02:13.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f8924d2c640 1 -- start start 2023-09-13T06:02:13.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f8924d2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89200cd170 0x7f89200cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f8924d2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8920146cf0 0x7f892012f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f8924d2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89201610a0 0x7f8920131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f8924d2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892012c300 con 0x7f89201610a0 2023-09-13T06:02:13.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f8924d2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892012d160 con 0x7f8920146cf0 2023-09-13T06:02:13.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f8924d2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892012c550 con 0x7f89200cd170 2023-09-13T06:02:13.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f891ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89201610a0 0x7f8920131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f891ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89201610a0 0x7f8920131630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49946/0 (socket says 172.21.15.130:49946) 2023-09-13T06:02:13.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f891ed9d640 1 -- 172.21.15.130:0/423694737 learned_addr learned my addr 172.21.15.130:0/423694737 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:13.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f891e59c640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89200cd170 0x7f89200cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f891dd9b640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8920146cf0 0x7f892012f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f891ed9d640 1 -- 172.21.15.130:0/423694737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89200cd170 msgr2=0x7f89200cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f891ed9d640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89200cd170 0x7f89200cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f891ed9d640 1 -- 172.21.15.130:0/423694737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8920146cf0 msgr2=0x7f892012f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:13.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f891ed9d640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8920146cf0 0x7f892012f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:13.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f891ed9d640 1 -- 172.21.15.130:0/423694737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910009a70 con 0x7f89201610a0 2023-09-13T06:02:13.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f891ed9d640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89201610a0 0x7f8920131630 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f891800c780 tx=0x7f891800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:13.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f890effd640 1 -- 172.21.15.130:0/423694737 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918005cf0 con 0x7f89201610a0 2023-09-13T06:02:13.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f890effd640 1 -- 172.21.15.130:0/423694737 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8918005e50 con 0x7f89201610a0 2023-09-13T06:02:13.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f890effd640 1 -- 172.21.15.130:0/423694737 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918007290 con 0x7f89201610a0 2023-09-13T06:02:13.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f8924d2c640 1 -- 172.21.15.130:0/423694737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892012c830 con 0x7f89201610a0 2023-09-13T06:02:13.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f8924d2c640 1 -- 172.21.15.130:0/423694737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892012cdf0 con 0x7f89201610a0 2023-09-13T06:02:13.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.864+0000 7f8924d2c640 1 -- 172.21.15.130:0/423694737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892012d2f0 con 0x7f89201610a0 2023-09-13T06:02:13.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.868+0000 7f890effd640 1 -- 172.21.15.130:0/423694737 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f89180073f0 con 0x7f89201610a0 2023-09-13T06:02:13.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.868+0000 7f890effd640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8900065b20 0x7f8900067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:13.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.868+0000 7f890effd640 1 -- 172.21.15.130:0/423694737 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8918082ce0 con 0x7f89201610a0 2023-09-13T06:02:13.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.868+0000 7f891e59c640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8900065b20 0x7f8900067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:13.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.868+0000 7f891e59c640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8900065b20 0x7f8900067fe0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f89100b2000 tx=0x7f89100aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:13.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:13.872+0000 7f890effd640 1 -- 172.21.15.130:0/423694737 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8918054420 con 0x7f89201610a0 2023-09-13T06:02:13.984 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:02:13.988 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:02:14.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.072+0000 7f8924d2c640 1 -- 172.21.15.130:0/423694737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f89200618a0 con 0x7f89201610a0 2023-09-13T06:02:14.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.076+0000 7f890effd640 1 -- 172.21.15.130:0/423694737 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8918053fb0 con 0x7f89201610a0 2023-09-13T06:02:14.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 -- 172.21.15.130:0/423694737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8900065b20 msgr2=0x7f8900067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8900065b20 0x7f8900067fe0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f89100b2000 tx=0x7f89100aa070 comp rx=0 tx=0).stop 2023-09-13T06:02:14.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 -- 172.21.15.130:0/423694737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89201610a0 msgr2=0x7f8920131630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89201610a0 0x7f8920131630 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f891800c780 tx=0x7f891800cc40 comp rx=0 tx=0).stop 2023-09-13T06:02:14.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 -- 172.21.15.130:0/423694737 shutdown_connections 2023-09-13T06:02:14.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8900065b20 0x7f8900067fe0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8920146cf0 0x7f892012f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89201610a0 0x7f8920131630 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 --2- 172.21.15.130:0/423694737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89200cd170 0x7f89200cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 -- 172.21.15.130:0/423694737 >> 172.21.15.130:0/423694737 conn(0x7f892006a2f0 msgr2=0x7f89201602a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:14.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 -- 172.21.15.130:0/423694737 shutdown_connections 2023-09-13T06:02:14.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.080+0000 7f8924d2c640 1 -- 172.21.15.130:0/423694737 wait complete. 2023-09-13T06:02:14.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-09-13T06:02:14.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f308ca19640 1 Processor -- start 2023-09-13T06:02:14.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f308ca19640 1 -- start start 2023-09-13T06:02:14.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f308ca19640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3088161810 0x7f30880b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:14.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f308ca19640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3088071440 con 0x7f30880b7ca0 2023-09-13T06:02:14.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f308ca19640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30880706a0 con 0x7f3088146eb0 2023-09-13T06:02:14.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f308ca19640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30880b5130 con 0x7f3088161810 2023-09-13T06:02:14.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f3086ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3088161810 0x7f30880b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:14.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f3086ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3088161810 0x7f30880b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49954/0 (socket says 172.21.15.130:49954) 2023-09-13T06:02:14.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f3086ffd640 1 -- 172.21.15.130:0/1381128877 learned_addr learned my addr 172.21.15.130:0/1381128877 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:14.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f3086ffd640 1 -- 172.21.15.130:0/1381128877 >> v1:172.21.15.164:6789/0 conn(0x7f3088146eb0 legacy=0x7f3088161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:14.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f3086ffd640 1 -- 172.21.15.130:0/1381128877 >> v1:172.21.15.130:6789/0 conn(0x7f30880b7ca0 legacy=0x7f30880b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f30867fc640 1 -- 172.21.15.130:0/1381128877 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755537014 0 0) 0x7f3088071440 con 0x7f30880b7ca0 2023-09-13T06:02:14.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.280+0000 7f3086ffd640 1 -- 172.21.15.130:0/1381128877 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3088147290 con 0x7f3088161810 2023-09-13T06:02:14.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.284+0000 7f3086ffd640 1 --2- 172.21.15.130:0/1381128877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3088161810 0x7f30880b64e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f307c009870 tx=0x7f307c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c1c0f471c1faca server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:14.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.284+0000 7f30867fc640 1 -- 172.21.15.130:0/1381128877 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c0aa430 con 0x7f3088161810 2023-09-13T06:02:14.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.284+0000 7f30867fc640 1 -- 172.21.15.130:0/1381128877 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307c0aa590 con 0x7f3088161810 2023-09-13T06:02:14.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.284+0000 7f30867fc640 1 -- 172.21.15.130:0/1381128877 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c0aa920 con 0x7f3088161810 2023-09-13T06:02:14.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.284+0000 7f308ca19640 1 -- 172.21.15.130:0/1381128877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3088161810 msgr2=0x7f30880b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.284+0000 7f308ca19640 1 --2- 172.21.15.130:0/1381128877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3088161810 0x7f30880b64e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f307c009870 tx=0x7f307c01c4d0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.284+0000 7f308ca19640 1 -- 172.21.15.130:0/1381128877 shutdown_connections 2023-09-13T06:02:14.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.284+0000 7f308ca19640 1 --2- 172.21.15.130:0/1381128877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3088161810 0x7f30880b64e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.284+0000 7f308ca19640 1 -- 172.21.15.130:0/1381128877 >> 172.21.15.130:0/1381128877 conn(0x7f30880cdd10 msgr2=0x7f30880ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:14.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.284+0000 7f308ca19640 1 -- 172.21.15.130:0/1381128877 shutdown_connections 2023-09-13T06:02:14.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.284+0000 7f308ca19640 1 -- 172.21.15.130:0/1381128877 wait complete. 2023-09-13T06:02:14.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f308ca19640 1 Processor -- start 2023-09-13T06:02:14.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f308ca19640 1 -- start start 2023-09-13T06:02:14.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f308ca19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30880b7ca0 0x7f308813bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:14.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f308ca19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3088146eb0 0x7f30881451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:14.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f308ca19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3088161810 0x7f308815a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:14.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f308ca19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30881f8630 con 0x7f30880b7ca0 2023-09-13T06:02:14.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f308ca19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30881f7a20 con 0x7f3088161810 2023-09-13T06:02:14.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f308ca19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30881f7d00 con 0x7f3088146eb0 2023-09-13T06:02:14.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f30877fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30880b7ca0 0x7f308813bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:14.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f30877fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30880b7ca0 0x7f308813bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49962/0 (socket says 172.21.15.130:49962) 2023-09-13T06:02:14.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f30877fe640 1 -- 172.21.15.130:0/3885253543 learned_addr learned my addr 172.21.15.130:0/3885253543 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:14.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f3086ffd640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3088146eb0 0x7f30881451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:14.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f3087fff640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3088161810 0x7f308815a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:14.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f30877fe640 1 -- 172.21.15.130:0/3885253543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3088146eb0 msgr2=0x7f30881451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f30877fe640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3088146eb0 0x7f30881451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f30877fe640 1 -- 172.21.15.130:0/3885253543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3088161810 msgr2=0x7f308815a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f30877fe640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3088161810 0x7f308815a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f30877fe640 1 -- 172.21.15.130:0/3885253543 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c0094d0 con 0x7f30880b7ca0 2023-09-13T06:02:14.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f3087fff640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3088161810 0x7f308815a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:14.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f30877fe640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30880b7ca0 0x7f308813bdb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f307800c450 tx=0x7f307800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:14.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f306ffff640 1 -- 172.21.15.130:0/3885253543 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078012830 con 0x7f30880b7ca0 2023-09-13T06:02:14.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f306ffff640 1 -- 172.21.15.130:0/3885253543 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30780129b0 con 0x7f30880b7ca0 2023-09-13T06:02:14.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f306ffff640 1 -- 172.21.15.130:0/3885253543 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078012d60 con 0x7f30880b7ca0 2023-09-13T06:02:14.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f308ca19640 1 -- 172.21.15.130:0/3885253543 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30881f7fe0 con 0x7f30880b7ca0 2023-09-13T06:02:14.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.288+0000 7f308ca19640 1 -- 172.21.15.130:0/3885253543 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3088145710 con 0x7f30880b7ca0 2023-09-13T06:02:14.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.292+0000 7f308ca19640 1 -- 172.21.15.130:0/3885253543 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3088070b10 con 0x7f30880b7ca0 2023-09-13T06:02:14.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.292+0000 7f306ffff640 1 -- 172.21.15.130:0/3885253543 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f307801c460 con 0x7f30880b7ca0 2023-09-13T06:02:14.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.292+0000 7f306ffff640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3074065b50 0x7f3074068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:14.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.292+0000 7f306ffff640 1 -- 172.21.15.130:0/3885253543 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3078082da0 con 0x7f30880b7ca0 2023-09-13T06:02:14.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.292+0000 7f3086ffd640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3074065b50 0x7f3074068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:14.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.292+0000 7f3086ffd640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3074065b50 0x7f3074068010 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f307c0ae000 tx=0x7f307c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:14.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.296+0000 7f306ffff640 1 -- 172.21.15.130:0/3885253543 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3088070b10 con 0x7f30880b7ca0 2023-09-13T06:02:14.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.496+0000 7f308ca19640 1 -- 172.21.15.130:0/3885253543 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f3088070b10 con 0x7f30880b7ca0 2023-09-13T06:02:14.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f306ffff640 1 -- 172.21.15.130:0/3885253543 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3088070b10 con 0x7f30880b7ca0 2023-09-13T06:02:14.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 -- 172.21.15.130:0/3885253543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3074065b50 msgr2=0x7f3074068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3074065b50 0x7f3074068010 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f307c0ae000 tx=0x7f307c0a7000 comp rx=0 tx=0).stop 2023-09-13T06:02:14.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 -- 172.21.15.130:0/3885253543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30880b7ca0 msgr2=0x7f308813bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30880b7ca0 0x7f308813bdb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f307800c450 tx=0x7f307800c910 comp rx=0 tx=0).stop 2023-09-13T06:02:14.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 -- 172.21.15.130:0/3885253543 shutdown_connections 2023-09-13T06:02:14.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3074065b50 0x7f3074068010 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3088161810 0x7f308815a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3088146eb0 0x7f30881451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 --2- 172.21.15.130:0/3885253543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30880b7ca0 0x7f308813bdb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 -- 172.21.15.130:0/3885253543 >> 172.21.15.130:0/3885253543 conn(0x7f30880cdd10 msgr2=0x7f308815fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:14.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 -- 172.21.15.130:0/3885253543 shutdown_connections 2023-09-13T06:02:14.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.504+0000 7f308ca19640 1 -- 172.21.15.130:0/3885253543 wait complete. 2023-09-13T06:02:14.529 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:14.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.664+0000 7f3a21711640 1 Processor -- start 2023-09-13T06:02:14.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.664+0000 7f3a21711640 1 -- start start 2023-09-13T06:02:14.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.664+0000 7f3a21711640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a1c0d1750 0x7f3a1c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:14.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.664+0000 7f3a21711640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3a1c146f30 0x7f3a1c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:14.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.664+0000 7f3a21711640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c0b63c0 con 0x7f3a1c0d1090 2023-09-13T06:02:14.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.668+0000 7f3a21711640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c15dea0 con 0x7f3a1c0d1750 2023-09-13T06:02:14.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.668+0000 7f3a21711640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c0d0c20 con 0x7f3a1c146f30 2023-09-13T06:02:14.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.668+0000 7f3a1affd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a1c0d1750 0x7f3a1c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:14.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.668+0000 7f3a1affd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a1c0d1750 0x7f3a1c15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49978/0 (socket says 172.21.15.130:49978) 2023-09-13T06:02:14.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.668+0000 7f3a1affd640 1 -- 172.21.15.130:0/3772717696 learned_addr learned my addr 172.21.15.130:0/3772717696 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:14.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.668+0000 7f3a1affd640 1 -- 172.21.15.130:0/3772717696 >> v2:172.21.15.164:3300/0 conn(0x7f3a1c146f30 msgr2=0x7f3a1c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:14.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.668+0000 7f3a1affd640 1 --2- 172.21.15.130:0/3772717696 >> v2:172.21.15.164:3300/0 conn(0x7f3a1c146f30 0x7f3a1c0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.668+0000 7f3a1affd640 1 -- 172.21.15.130:0/3772717696 >> v1:172.21.15.130:6789/0 conn(0x7f3a1c0d1090 legacy=0x7f3a1c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.668+0000 7f3a1affd640 1 -- 172.21.15.130:0/3772717696 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c0b6610 con 0x7f3a1c0d1750 2023-09-13T06:02:14.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.668+0000 7f3a1a7fc640 1 -- 172.21.15.130:0/3772717696 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190902298 0 0) 0x7f3a1c0b63c0 con 0x7f3a1c0d1090 2023-09-13T06:02:14.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.668+0000 7f3a1affd640 1 --2- 172.21.15.130:0/3772717696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a1c0d1750 0x7f3a1c15d960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0d2c80 tx=0x7f3a0c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cffcfea09579982 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:14.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a1a7fc640 1 -- 172.21.15.130:0/3772717696 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0ab640 con 0x7f3a1c0d1750 2023-09-13T06:02:14.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a1a7fc640 1 -- 172.21.15.130:0/3772717696 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c0a7070 con 0x7f3a1c0d1750 2023-09-13T06:02:14.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a1a7fc640 1 -- 172.21.15.130:0/3772717696 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0ab9c0 con 0x7f3a1c0d1750 2023-09-13T06:02:14.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 -- 172.21.15.130:0/3772717696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a1c0d1750 msgr2=0x7f3a1c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 --2- 172.21.15.130:0/3772717696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a1c0d1750 0x7f3a1c15d960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0d2c80 tx=0x7f3a0c01c440 comp rx=0 tx=0).stop 2023-09-13T06:02:14.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 -- 172.21.15.130:0/3772717696 shutdown_connections 2023-09-13T06:02:14.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 --2- 172.21.15.130:0/3772717696 >> v2:172.21.15.164:3300/0 conn(0x7f3a1c146f30 0x7f3a1c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 --2- 172.21.15.130:0/3772717696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a1c0d1750 0x7f3a1c15d960 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 -- 172.21.15.130:0/3772717696 >> 172.21.15.130:0/3772717696 conn(0x7f3a1c06f170 msgr2=0x7f3a1c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:14.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 -- 172.21.15.130:0/3772717696 shutdown_connections 2023-09-13T06:02:14.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 -- 172.21.15.130:0/3772717696 wait complete. 2023-09-13T06:02:14.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 Processor -- start 2023-09-13T06:02:14.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 -- start start 2023-09-13T06:02:14.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a1c0d1090 0x7f3a1c15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:14.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c0d1750 0x7f3a1c162090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:14.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a1c146f30 0x7f3a1c13eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:14.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c146320 con 0x7f3a1c146f30 2023-09-13T06:02:14.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c146040 con 0x7f3a1c0d1750 2023-09-13T06:02:14.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a21711640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c1664c0 con 0x7f3a1c0d1090 2023-09-13T06:02:14.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.672+0000 7f3a1b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a1c146f30 0x7f3a1c13eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:14.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a1b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a1c146f30 0x7f3a1c13eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49980/0 (socket says 172.21.15.130:49980) 2023-09-13T06:02:14.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a1b7fe640 1 -- 172.21.15.130:0/2560102978 learned_addr learned my addr 172.21.15.130:0/2560102978 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:14.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a127fc640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c0d1750 0x7f3a1c162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:14.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a1affd640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a1c0d1090 0x7f3a1c15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:14.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a1b7fe640 1 -- 172.21.15.130:0/2560102978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a1c0d1090 msgr2=0x7f3a1c15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a1b7fe640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a1c0d1090 0x7f3a1c15c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a1b7fe640 1 -- 172.21.15.130:0/2560102978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c0d1750 msgr2=0x7f3a1c162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a1b7fe640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c0d1750 0x7f3a1c162090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a1b7fe640 1 -- 172.21.15.130:0/2560102978 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0094d0 con 0x7f3a1c146f30 2023-09-13T06:02:14.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a1b7fe640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a1c146f30 0x7f3a1c13eca0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400b970 tx=0x7f3a1400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:14.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a13fff640 1 -- 172.21.15.130:0/2560102978 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400cb40 con 0x7f3a1c146f30 2023-09-13T06:02:14.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a13fff640 1 -- 172.21.15.130:0/2560102978 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1400ccc0 con 0x7f3a1c146f30 2023-09-13T06:02:14.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a21711640 1 -- 172.21.15.130:0/2560102978 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c0b7e40 con 0x7f3a1c146f30 2023-09-13T06:02:14.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a13fff640 1 -- 172.21.15.130:0/2560102978 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14014680 con 0x7f3a1c146f30 2023-09-13T06:02:14.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a21711640 1 -- 172.21.15.130:0/2560102978 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c166a80 con 0x7f3a1c146f30 2023-09-13T06:02:14.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a21711640 1 -- 172.21.15.130:0/2560102978 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c166300 con 0x7f3a1c146f30 2023-09-13T06:02:14.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.676+0000 7f3a13fff640 1 -- 172.21.15.130:0/2560102978 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3a14007370 con 0x7f3a1c146f30 2023-09-13T06:02:14.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.680+0000 7f3a13fff640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f39fc065b50 0x7f39fc068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:14.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.680+0000 7f3a13fff640 1 -- 172.21.15.130:0/2560102978 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3a14082ee0 con 0x7f3a1c146f30 2023-09-13T06:02:14.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.680+0000 7f3a1affd640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f39fc065b50 0x7f39fc068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:14.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.680+0000 7f3a1affd640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f39fc065b50 0x7f39fc068010 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0af000 tx=0x7f3a0c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:14.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.684+0000 7f3a13fff640 1 -- 172.21.15.130:0/2560102978 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3a14050b80 con 0x7f3a1c146f30 2023-09-13T06:02:14.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.832+0000 7f3a21711640 1 -- 172.21.15.130:0/2560102978 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a1c166ca0 con 0x7f3a1c146f30 2023-09-13T06:02:14.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a13fff640 1 -- 172.21.15.130:0/2560102978 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12893 (secure 0 0 0) 0x7f3a14019020 con 0x7f3a1c146f30 2023-09-13T06:02:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:14.839 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":28,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:11.735555+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:14.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 -- 172.21.15.130:0/2560102978 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f39fc065b50 msgr2=0x7f39fc068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f39fc065b50 0x7f39fc068010 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0af000 tx=0x7f3a0c0a7000 comp rx=0 tx=0).stop 2023-09-13T06:02:14.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 -- 172.21.15.130:0/2560102978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a1c146f30 msgr2=0x7f3a1c13eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:14.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a1c146f30 0x7f3a1c13eca0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400b970 tx=0x7f3a1400be30 comp rx=0 tx=0).stop 2023-09-13T06:02:14.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 -- 172.21.15.130:0/2560102978 shutdown_connections 2023-09-13T06:02:14.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f39fc065b50 0x7f39fc068010 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a1c0d1750 0x7f3a1c162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a1c146f30 0x7f3a1c13eca0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 --2- 172.21.15.130:0/2560102978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a1c0d1090 0x7f3a1c15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:14.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 -- 172.21.15.130:0/2560102978 >> 172.21.15.130:0/2560102978 conn(0x7f3a1c06f170 msgr2=0x7f3a1c142c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:14.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 -- 172.21.15.130:0/2560102978 shutdown_connections 2023-09-13T06:02:14.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.836+0000 7f3a21711640 1 -- 172.21.15.130:0/2560102978 wait complete. 2023-09-13T06:02:14.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:02:14.860 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:02:15.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:14.996+0000 7f5d38007640 1 Processor -- start 2023-09-13T06:02:15.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d38007640 1 -- start start 2023-09-13T06:02:15.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d38007640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d3015a080 0x7f5d300b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d38007640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d300cc850 con 0x7f5d3015e650 2023-09-13T06:02:15.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d38007640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d300b0330 con 0x7f5d300b31a0 2023-09-13T06:02:15.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d38007640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d300cbcd0 con 0x7f5d3015a080 2023-09-13T06:02:15.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d355a2640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5d3015e650 0x7f5d300b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:45556/0 (socket says 172.21.15.130:45556) 2023-09-13T06:02:15.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d355a2640 1 -- 172.21.15.130:0/3198654286 learned_addr learned my addr 172.21.15.130:0/3198654286 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:15.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d35da3640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d3015a080 0x7f5d300b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214441916 0 0) 0x7f5d20001120 con 0x7f5d3015e650 2023-09-13T06:02:15.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d1c005740 con 0x7f5d3015e650 2023-09-13T06:02:15.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403309422 0 0) 0x7f5d300b0330 con 0x7f5d300b31a0 2023-09-13T06:02:15.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d20001120 con 0x7f5d300b31a0 2023-09-13T06:02:15.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2073335845 0 0) 0x7f5d1c005740 con 0x7f5d3015e650 2023-09-13T06:02:15.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d3015a080 msgr2=0x7f5d300b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:15.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d3015a080 0x7f5d300b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 >> v1:172.21.15.164:6789/0 conn(0x7f5d300b31a0 legacy=0x7f5d300ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d300cbfb0 con 0x7f5d3015e650 2023-09-13T06:02:15.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f5d20001830 con 0x7f5d3015e650 2023-09-13T06:02:15.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d35da3640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d3015a080 0x7f5d300b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:15.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 >> v1:172.21.15.130:6789/0 conn(0x7f5d3015e650 legacy=0x7f5d300b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d1c005dc0 0x7f5d1c0061c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d1c0069e0 0x7f5d1c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d3015a080 0x7f5d1c007430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d300cbcd0 con 0x7f5d1c0069e0 2023-09-13T06:02:15.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c00dd30 con 0x7f5d1c005dc0 2023-09-13T06:02:15.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c0035b0 con 0x7f5d3015a080 2023-09-13T06:02:15.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d355a2640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d1c0069e0 0x7f5d1c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d35da3640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d1c005dc0 0x7f5d1c0061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d365a4640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d3015a080 0x7f5d1c007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d355a2640 1 -- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d3015a080 msgr2=0x7f5d1c007430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:15.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d355a2640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d3015a080 0x7f5d1c007430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d355a2640 1 -- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d1c005dc0 msgr2=0x7f5d1c0061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:15.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d355a2640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d1c005dc0 0x7f5d1c0061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.000+0000 7f5d355a2640 1 -- 172.21.15.130:0/3198654286 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c009420 con 0x7f5d1c0069e0 2023-09-13T06:02:15.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.004+0000 7f5d355a2640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d1c0069e0 0x7f5d1c006e60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5d300ae040 tx=0x7f5d2001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195aed1c5b9e7b66 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:15.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.004+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20005ae0 con 0x7f5d1c0069e0 2023-09-13T06:02:15.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.004+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d20005c40 con 0x7f5d1c0069e0 2023-09-13T06:02:15.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.004+0000 7f5d34da1640 1 -- 172.21.15.130:0/3198654286 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20007070 con 0x7f5d1c0069e0 2023-09-13T06:02:15.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.004+0000 7f5d38007640 1 -- 172.21.15.130:0/3198654286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d1c0069e0 msgr2=0x7f5d1c006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.004+0000 7f5d38007640 1 --2- 172.21.15.130:0/3198654286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d1c0069e0 0x7f5d1c006e60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5d300ae040 tx=0x7f5d2001ca90 comp rx=0 tx=0).stop 2023-09-13T06:02:15.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.004+0000 7f5d365a4640 1 -- 172.21.15.130:0/3198654286 reap_dead start 2023-09-13T06:02:15.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.004+0000 7f5d38007640 1 -- 172.21.15.130:0/3198654286 shutdown_connections 2023-09-13T06:02:15.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.004+0000 7f5d38007640 1 -- 172.21.15.130:0/3198654286 >> 172.21.15.130:0/3198654286 conn(0x7f5d30065990 msgr2=0x7f5d30065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:15.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.004+0000 7f5d38007640 1 -- 172.21.15.130:0/3198654286 shutdown_connections 2023-09-13T06:02:15.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.004+0000 7f5d38007640 1 -- 172.21.15.130:0/3198654286 wait complete. 2023-09-13T06:02:15.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d38007640 1 Processor -- start 2023-09-13T06:02:15.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d38007640 1 -- start start 2023-09-13T06:02:15.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d38007640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d1c0069e0 0x7f5d30150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d38007640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d30156a60 0x7f5d3006e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d38007640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d30152dd0 0x7f5d30153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d38007640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d301537c0 con 0x7f5d30156a60 2023-09-13T06:02:15.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d38007640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30155720 con 0x7f5d30152dd0 2023-09-13T06:02:15.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d38007640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3006e840 con 0x7f5d1c0069e0 2023-09-13T06:02:15.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d355a2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d30156a60 0x7f5d3006e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d355a2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d30156a60 0x7f5d3006e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49996/0 (socket says 172.21.15.130:49996) 2023-09-13T06:02:15.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d355a2640 1 -- 172.21.15.130:0/2880060483 learned_addr learned my addr 172.21.15.130:0/2880060483 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:15.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d365a4640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d30152dd0 0x7f5d30153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d35da3640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d1c0069e0 0x7f5d30150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d355a2640 1 -- 172.21.15.130:0/2880060483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d1c0069e0 msgr2=0x7f5d30150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d355a2640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d1c0069e0 0x7f5d30150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d355a2640 1 -- 172.21.15.130:0/2880060483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d30152dd0 msgr2=0x7f5d30153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d355a2640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d30152dd0 0x7f5d30153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d355a2640 1 -- 172.21.15.130:0/2880060483 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d301559c0 con 0x7f5d30156a60 2023-09-13T06:02:15.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d355a2640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d30156a60 0x7f5d3006e300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5d2001cf70 tx=0x7f5d1c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:15.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d267fc640 1 -- 172.21.15.130:0/2880060483 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200b4070 con 0x7f5d30156a60 2023-09-13T06:02:15.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d267fc640 1 -- 172.21.15.130:0/2880060483 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d20001630 con 0x7f5d30156a60 2023-09-13T06:02:15.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d267fc640 1 -- 172.21.15.130:0/2880060483 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200072a0 con 0x7f5d30156a60 2023-09-13T06:02:15.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d38007640 1 -- 172.21.15.130:0/2880060483 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d30155ca0 con 0x7f5d30156a60 2023-09-13T06:02:15.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.008+0000 7f5d38007640 1 -- 172.21.15.130:0/2880060483 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d30156260 con 0x7f5d30156a60 2023-09-13T06:02:15.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.012+0000 7f5d38007640 1 -- 172.21.15.130:0/2880060483 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d300618a0 con 0x7f5d30156a60 2023-09-13T06:02:15.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.012+0000 7f5d267fc640 1 -- 172.21.15.130:0/2880060483 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5d20007400 con 0x7f5d30156a60 2023-09-13T06:02:15.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.012+0000 7f5d267fc640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d14065b20 0x7f5d14067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.012+0000 7f5d267fc640 1 -- 172.21.15.130:0/2880060483 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d2011c0c0 con 0x7f5d30156a60 2023-09-13T06:02:15.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.012+0000 7f5d35da3640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d14065b20 0x7f5d14067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.012+0000 7f5d35da3640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d14065b20 0x7f5d14067fe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5d3006e290 tx=0x7f5d2c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:15.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.016+0000 7f5d267fc640 1 -- 172.21.15.130:0/2880060483 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5d200e9e10 con 0x7f5d30156a60 2023-09-13T06:02:15.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d38007640 1 -- 172.21.15.130:0/2880060483 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d300cc850 con 0x7f5d30156a60 2023-09-13T06:02:15.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d267fc640 1 -- 172.21.15.130:0/2880060483 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d300cc850 con 0x7f5d30156a60 2023-09-13T06:02:15.169 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:02:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d38007640 1 -- 172.21.15.130:0/2880060483 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d14065b20 msgr2=0x7f5d14067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d38007640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d14065b20 0x7f5d14067fe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5d3006e290 tx=0x7f5d2c009190 comp rx=0 tx=0).stop 2023-09-13T06:02:15.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d38007640 1 -- 172.21.15.130:0/2880060483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d30156a60 msgr2=0x7f5d3006e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d38007640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d30156a60 0x7f5d3006e300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5d2001cf70 tx=0x7f5d1c007a10 comp rx=0 tx=0).stop 2023-09-13T06:02:15.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d38007640 1 -- 172.21.15.130:0/2880060483 shutdown_connections 2023-09-13T06:02:15.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d38007640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d14065b20 0x7f5d14067fe0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d38007640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d30152dd0 0x7f5d30153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d38007640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d30156a60 0x7f5d3006e300 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d38007640 1 --2- 172.21.15.130:0/2880060483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d1c0069e0 0x7f5d30150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.164+0000 7f5d38007640 1 -- 172.21.15.130:0/2880060483 >> 172.21.15.130:0/2880060483 conn(0x7f5d30065990 msgr2=0x7f5d300afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:15.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.168+0000 7f5d38007640 1 -- 172.21.15.130:0/2880060483 shutdown_connections 2023-09-13T06:02:15.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.168+0000 7f5d38007640 1 -- 172.21.15.130:0/2880060483 wait complete. 2023-09-13T06:02:15.189 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T06:02:15.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f199a996640 1 Processor -- start 2023-09-13T06:02:15.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f199a996640 1 -- start start 2023-09-13T06:02:15.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f199a996640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1994159f20 0x7f19940ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f199a996640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f19940b1d20 0x7f19940b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f199a996640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19940ccfd0 con 0x7f19940cdfc0 2023-09-13T06:02:15.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f199a996640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19940b00f0 con 0x7f19940b1d20 2023-09-13T06:02:15.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f199a996640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19940b11d0 con 0x7f1994159f20 2023-09-13T06:02:15.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f1998f33640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f19940b1d20 0x7f19940b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f1998f33640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f19940b1d20 0x7f19940b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50004/0 (socket says 172.21.15.130:50004) 2023-09-13T06:02:15.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f1998f33640 1 -- 172.21.15.130:0/1694825656 learned_addr learned my addr 172.21.15.130:0/1694825656 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:15.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f1998f33640 1 -- 172.21.15.130:0/1694825656 >> v2:172.21.15.164:3300/0 conn(0x7f1994159f20 msgr2=0x7f19940ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:15.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f1998f33640 1 --2- 172.21.15.130:0/1694825656 >> v2:172.21.15.164:3300/0 conn(0x7f1994159f20 0x7f19940ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f1998f33640 1 -- 172.21.15.130:0/1694825656 >> v1:172.21.15.164:6789/0 conn(0x7f19940cdfc0 legacy=0x7f19940b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:15.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.324+0000 7f1998f33640 1 -- 172.21.15.130:0/1694825656 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19940ced90 con 0x7f19940b1d20 2023-09-13T06:02:15.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f1998f33640 1 --2- 172.21.15.130:0/1694825656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19940b1d20 0x7f19940b0c90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f19940b2660 tx=0x7f198c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6012107503d7c9d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:15.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f1992ffd640 1 -- 172.21.15.130:0/1694825656 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0a5820 con 0x7f19940b1d20 2023-09-13T06:02:15.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f1992ffd640 1 -- 172.21.15.130:0/1694825656 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c0a5980 con 0x7f19940b1d20 2023-09-13T06:02:15.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f1992ffd640 1 -- 172.21.15.130:0/1694825656 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0a5d10 con 0x7f19940b1d20 2023-09-13T06:02:15.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f199a996640 1 -- 172.21.15.130:0/1694825656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19940b1d20 msgr2=0x7f19940b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f199a996640 1 --2- 172.21.15.130:0/1694825656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19940b1d20 0x7f19940b0c90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f19940b2660 tx=0x7f198c01c960 comp rx=0 tx=0).stop 2023-09-13T06:02:15.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f199a996640 1 -- 172.21.15.130:0/1694825656 shutdown_connections 2023-09-13T06:02:15.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f199a996640 1 --2- 172.21.15.130:0/1694825656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19940b1d20 0x7f19940b0c90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f199a996640 1 --2- 172.21.15.130:0/1694825656 >> v2:172.21.15.164:3300/0 conn(0x7f1994159f20 0x7f19940ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f199a996640 1 -- 172.21.15.130:0/1694825656 >> 172.21.15.130:0/1694825656 conn(0x7f1994065990 msgr2=0x7f1994065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:15.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f199a996640 1 -- 172.21.15.130:0/1694825656 shutdown_connections 2023-09-13T06:02:15.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.328+0000 7f199a996640 1 -- 172.21.15.130:0/1694825656 wait complete. 2023-09-13T06:02:15.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f199a996640 1 Processor -- start 2023-09-13T06:02:15.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f199a996640 1 -- start start 2023-09-13T06:02:15.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f199a996640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19940b1d20 0x7f199413fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f199a996640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19940cdfc0 0x7f19940ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f199a996640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1994159f20 0x7f19940ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f199a996640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199414f6d0 con 0x7f1994159f20 2023-09-13T06:02:15.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f199a996640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19940cb6a0 con 0x7f19940b1d20 2023-09-13T06:02:15.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f199a996640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19940cae00 con 0x7f19940cdfc0 2023-09-13T06:02:15.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1998f33640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1994159f20 0x7f19940ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1998f33640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1994159f20 0x7f19940ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50016/0 (socket says 172.21.15.130:50016) 2023-09-13T06:02:15.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1998f33640 1 -- 172.21.15.130:0/2910007653 learned_addr learned my addr 172.21.15.130:0/2910007653 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:15.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1993fff640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19940b1d20 0x7f199413fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f19937fe640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19940cdfc0 0x7f19940ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1998f33640 1 -- 172.21.15.130:0/2910007653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19940cdfc0 msgr2=0x7f19940ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1998f33640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19940cdfc0 0x7f19940ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1998f33640 1 -- 172.21.15.130:0/2910007653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19940b1d20 msgr2=0x7f199413fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1998f33640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19940b1d20 0x7f199413fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1998f33640 1 -- 172.21.15.130:0/2910007653 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c009b30 con 0x7f1994159f20 2023-09-13T06:02:15.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1998f33640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1994159f20 0x7f19940ca7f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f198c01a590 tx=0x7f198c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:15.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1990ff9640 1 -- 172.21.15.130:0/2910007653 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0b8670 con 0x7f1994159f20 2023-09-13T06:02:15.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1990ff9640 1 -- 172.21.15.130:0/2910007653 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c0b87d0 con 0x7f1994159f20 2023-09-13T06:02:15.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f1990ff9640 1 -- 172.21.15.130:0/2910007653 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0b8b80 con 0x7f1994159f20 2023-09-13T06:02:15.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f199a996640 1 -- 172.21.15.130:0/2910007653 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19940cb0e0 con 0x7f1994159f20 2023-09-13T06:02:15.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.332+0000 7f199a996640 1 -- 172.21.15.130:0/2910007653 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199414f0c0 con 0x7f1994159f20 2023-09-13T06:02:15.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.336+0000 7f199a996640 1 -- 172.21.15.130:0/2910007653 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199414f880 con 0x7f1994159f20 2023-09-13T06:02:15.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.336+0000 7f1990ff9640 1 -- 172.21.15.130:0/2910007653 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f198c0b8ce0 con 0x7f1994159f20 2023-09-13T06:02:15.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.336+0000 7f1990ff9640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1980065b20 0x7f1980067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.336+0000 7f1990ff9640 1 -- 172.21.15.130:0/2910007653 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f198c11e510 con 0x7f1994159f20 2023-09-13T06:02:15.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.336+0000 7f1993fff640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1980065b20 0x7f1980067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.336+0000 7f1993fff640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1980065b20 0x7f1980067fe0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f19840098f0 tx=0x7f1984006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:15.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.340+0000 7f1990ff9640 1 -- 172.21.15.130:0/2910007653 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f199414f880 con 0x7f1994159f20 2023-09-13T06:02:15.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.492+0000 7f199a996640 1 -- 172.21.15.130:0/2910007653 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f19940618a0 con 0x7f1994159f20 2023-09-13T06:02:15.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.492+0000 7f1990ff9640 1 -- 172.21.15.130:0/2910007653 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f198c0ec360 con 0x7f1994159f20 2023-09-13T06:02:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:15.498 INFO:teuthology.orchestra.run.smithi130.stdout:[ 2023-09-13T06:02:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:15.498 INFO:teuthology.orchestra.run.smithi130.stdout: "poolnum": 1, 2023-09-13T06:02:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: "poolname": ".mgr" 2023-09-13T06:02:15.499 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:15.499 INFO:teuthology.orchestra.run.smithi130.stdout:] 2023-09-13T06:02:15.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 -- 172.21.15.130:0/2910007653 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1980065b20 msgr2=0x7f1980067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1980065b20 0x7f1980067fe0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f19840098f0 tx=0x7f1984006f90 comp rx=0 tx=0).stop 2023-09-13T06:02:15.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 -- 172.21.15.130:0/2910007653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1994159f20 msgr2=0x7f19940ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1994159f20 0x7f19940ca7f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f198c01a590 tx=0x7f198c019700 comp rx=0 tx=0).stop 2023-09-13T06:02:15.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 -- 172.21.15.130:0/2910007653 shutdown_connections 2023-09-13T06:02:15.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1980065b20 0x7f1980067fe0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1994159f20 0x7f19940ca7f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19940cdfc0 0x7f19940ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 --2- 172.21.15.130:0/2910007653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19940b1d20 0x7f199413fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 -- 172.21.15.130:0/2910007653 >> 172.21.15.130:0/2910007653 conn(0x7f1994065990 msgr2=0x7f19940cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:15.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 -- 172.21.15.130:0/2910007653 shutdown_connections 2023-09-13T06:02:15.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.496+0000 7f199a996640 1 -- 172.21.15.130:0/2910007653 wait complete. 2023-09-13T06:02:15.519 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T06:02:15.520 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T06:02:15.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.656+0000 7f3613a9c640 1 Processor -- start 2023-09-13T06:02:15.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.656+0000 7f3613a9c640 1 -- start start 2023-09-13T06:02:15.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3613a9c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f360c0b3170 0x7f360c0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3613a9c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360c0ccff0 con 0x7f360c0b1ff0 2023-09-13T06:02:15.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3613a9c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360c15b590 con 0x7f360c0ccc10 2023-09-13T06:02:15.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3613a9c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360c0b12f0 con 0x7f360c0b3170 2023-09-13T06:02:15.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3611037640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f360c0b3170 0x7f360c0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3611037640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f360c0b3170 0x7f360c0b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50024/0 (socket says 172.21.15.130:50024) 2023-09-13T06:02:15.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3611037640 1 -- 172.21.15.130:0/3213395104 learned_addr learned my addr 172.21.15.130:0/3213395104 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:15.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3612039640 1 --1- 172.21.15.130:0/3213395104 >> v1:172.21.15.130:6789/0 conn(0x7f360c0b1ff0 0x7f360c0cb710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:45558/0 (socket says 172.21.15.130:45558) 2023-09-13T06:02:15.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3611037640 1 -- 172.21.15.130:0/3213395104 >> v1:172.21.15.164:6789/0 conn(0x7f360c0ccc10 legacy=0x7f360c15dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3611037640 1 -- 172.21.15.130:0/3213395104 >> v1:172.21.15.130:6789/0 conn(0x7f360c0b1ff0 legacy=0x7f360c0cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3611037640 1 -- 172.21.15.130:0/3213395104 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c15e520 con 0x7f360c0b3170 2023-09-13T06:02:15.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.660+0000 7f3611037640 1 --2- 172.21.15.130:0/3213395104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f360c0b3170 0x7f360c0b1ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009870 tx=0x7f35fc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdbb12f632e3e23 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:15.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3610836640 1 -- 172.21.15.130:0/3213395104 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0aa670 con 0x7f360c0b3170 2023-09-13T06:02:15.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3610836640 1 -- 172.21.15.130:0/3213395104 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc0aa7d0 con 0x7f360c0b3170 2023-09-13T06:02:15.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3610836640 1 -- 172.21.15.130:0/3213395104 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0aab60 con 0x7f360c0b3170 2023-09-13T06:02:15.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 -- 172.21.15.130:0/3213395104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f360c0b3170 msgr2=0x7f360c0b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 --2- 172.21.15.130:0/3213395104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f360c0b3170 0x7f360c0b1ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009870 tx=0x7f35fc01c510 comp rx=0 tx=0).stop 2023-09-13T06:02:15.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 -- 172.21.15.130:0/3213395104 shutdown_connections 2023-09-13T06:02:15.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 --2- 172.21.15.130:0/3213395104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f360c0b3170 0x7f360c0b1ab0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 -- 172.21.15.130:0/3213395104 >> 172.21.15.130:0/3213395104 conn(0x7f360c0735e0 msgr2=0x7f360c065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:15.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 -- 172.21.15.130:0/3213395104 shutdown_connections 2023-09-13T06:02:15.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 -- 172.21.15.130:0/3213395104 wait complete. 2023-09-13T06:02:15.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 Processor -- start 2023-09-13T06:02:15.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 -- start start 2023-09-13T06:02:15.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f360c0b1ff0 0x7f360c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f360c0b3170 0x7f360c0ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f360c0ccc10 0x7f360c1f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c154540 con 0x7f360c0ccc10 2023-09-13T06:02:15.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c154820 con 0x7f360c0b3170 2023-09-13T06:02:15.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3613a9c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360c154b00 con 0x7f360c0b1ff0 2023-09-13T06:02:15.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3612039640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f360c0ccc10 0x7f360c1f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3612039640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f360c0ccc10 0x7f360c1f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50026/0 (socket says 172.21.15.130:50026) 2023-09-13T06:02:15.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.664+0000 7f3612039640 1 -- 172.21.15.130:0/1307012357 learned_addr learned my addr 172.21.15.130:0/1307012357 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:15.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3612039640 1 -- 172.21.15.130:0/1307012357 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f360c0b1ff0 msgr2=0x7f360c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3612039640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f360c0b1ff0 0x7f360c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3611037640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f360c0b3170 0x7f360c0ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3612039640 1 -- 172.21.15.130:0/1307012357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f360c0b3170 msgr2=0x7f360c0ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:15.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3612039640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f360c0b3170 0x7f360c0ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:15.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3612039640 1 -- 172.21.15.130:0/1307012357 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0094d0 con 0x7f360c0ccc10 2023-09-13T06:02:15.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3611037640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f360c0b3170 0x7f360c0ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:15.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3612039640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f360c0ccc10 0x7f360c1f5d10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f360400c7a0 tx=0x7f360400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:15.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f36027fc640 1 -- 172.21.15.130:0/1307012357 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400a640 con 0x7f360c0ccc10 2023-09-13T06:02:15.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f36027fc640 1 -- 172.21.15.130:0/1307012357 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360400a7a0 con 0x7f360c0ccc10 2023-09-13T06:02:15.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3613a9c640 1 -- 172.21.15.130:0/1307012357 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c154de0 con 0x7f360c0ccc10 2023-09-13T06:02:15.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f36027fc640 1 -- 172.21.15.130:0/1307012357 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400ab10 con 0x7f360c0ccc10 2023-09-13T06:02:15.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3613a9c640 1 -- 172.21.15.130:0/1307012357 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c14d110 con 0x7f360c0ccc10 2023-09-13T06:02:15.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3613a9c640 1 -- 172.21.15.130:0/1307012357 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c155300 con 0x7f360c0ccc10 2023-09-13T06:02:15.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f36027fc640 1 -- 172.21.15.130:0/1307012357 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f360400ac70 con 0x7f360c0ccc10 2023-09-13T06:02:15.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f36027fc640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35f0065b20 0x7f35f0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:15.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f36027fc640 1 -- 172.21.15.130:0/1307012357 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3604082720 con 0x7f360c0ccc10 2023-09-13T06:02:15.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.668+0000 7f3611838640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35f0065b20 0x7f35f0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:15.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.672+0000 7f3611838640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35f0065b20 0x7f35f0067fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3608000f70 tx=0x7f36080079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:15.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.672+0000 7f36027fc640 1 -- 172.21.15.130:0/1307012357 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f360c155300 con 0x7f360c0ccc10 2023-09-13T06:02:15.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:15.820+0000 7f3613a9c640 1 -- 172.21.15.130:0/1307012357 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f360c155300 con 0x7f360c0ccc10 2023-09-13T06:02:16.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.744+0000 7f36027fc640 1 -- 172.21.15.130:0/1307012357 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f360c155300 con 0x7f360c0ccc10 2023-09-13T06:02:16.750 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' created 2023-09-13T06:02:16.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.748+0000 7f3613a9c640 1 -- 172.21.15.130:0/1307012357 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35f0065b20 msgr2=0x7f35f0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:16.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.748+0000 7f3613a9c640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35f0065b20 0x7f35f0067fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3608000f70 tx=0x7f36080079c0 comp rx=0 tx=0).stop 2023-09-13T06:02:16.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.748+0000 7f3613a9c640 1 -- 172.21.15.130:0/1307012357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f360c0ccc10 msgr2=0x7f360c1f5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:16.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.748+0000 7f3613a9c640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f360c0ccc10 0x7f360c1f5d10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f360400c7a0 tx=0x7f360400cc60 comp rx=0 tx=0).stop 2023-09-13T06:02:16.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.748+0000 7f3613a9c640 1 -- 172.21.15.130:0/1307012357 shutdown_connections 2023-09-13T06:02:16.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.748+0000 7f3613a9c640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35f0065b20 0x7f35f0067fe0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:16.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.748+0000 7f3613a9c640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f360c0b3170 0x7f360c0ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:16.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.748+0000 7f3613a9c640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f360c0ccc10 0x7f360c1f5d10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:16.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.748+0000 7f3613a9c640 1 --2- 172.21.15.130:0/1307012357 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f360c0b1ff0 0x7f360c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:16.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.748+0000 7f3613a9c640 1 -- 172.21.15.130:0/1307012357 >> 172.21.15.130:0/1307012357 conn(0x7f360c0735e0 msgr2=0x7f360c15ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:16.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.748+0000 7f3613a9c640 1 -- 172.21.15.130:0/1307012357 shutdown_connections 2023-09-13T06:02:16.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.752+0000 7f3613a9c640 1 -- 172.21.15.130:0/1307012357 wait complete. 2023-09-13T06:02:16.777 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T06:02:16.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.924+0000 7f659d111640 1 Processor -- start 2023-09-13T06:02:16.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.924+0000 7f659d111640 1 -- start start 2023-09-13T06:02:16.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.924+0000 7f659d111640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f65980b2e90 0x7f65980ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:16.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.924+0000 7f659d111640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f65980b1460 0x7f65980b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:16.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.924+0000 7f659d111640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65980b2150 con 0x7f6598144d70 2023-09-13T06:02:16.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.924+0000 7f659d111640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65980b2430 con 0x7f65980b2e90 2023-09-13T06:02:16.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.924+0000 7f659d111640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65980cedb0 con 0x7f65980b1460 2023-09-13T06:02:16.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.924+0000 7f658e59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f65980b2e90 0x7f65980ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:16.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.924+0000 7f658e59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f65980b2e90 0x7f65980ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50032/0 (socket says 172.21.15.130:50032) 2023-09-13T06:02:16.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.924+0000 7f658e59c640 1 -- 172.21.15.130:0/380044189 learned_addr learned my addr 172.21.15.130:0/380044189 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:16.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.924+0000 7f659759e640 1 --2- 172.21.15.130:0/380044189 >> v2:172.21.15.164:3300/0 conn(0x7f65980b1460 0x7f65980b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:16.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f658e59c640 1 -- 172.21.15.130:0/380044189 >> v2:172.21.15.164:3300/0 conn(0x7f65980b1460 msgr2=0x7f65980b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:16.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f658e59c640 1 --2- 172.21.15.130:0/380044189 >> v2:172.21.15.164:3300/0 conn(0x7f65980b1460 0x7f65980b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:16.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f658e59c640 1 -- 172.21.15.130:0/380044189 >> v1:172.21.15.130:6789/0 conn(0x7f6598144d70 legacy=0x7f65980b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:16.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f658e59c640 1 -- 172.21.15.130:0/380044189 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65980cdd90 con 0x7f65980b2e90 2023-09-13T06:02:16.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f658e59c640 1 --2- 172.21.15.130:0/380044189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65980b2e90 0x7f65980ce870 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f65980668f0 tx=0x7f658001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ef18eb30e12282 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:16.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f659659c640 1 -- 172.21.15.130:0/380044189 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800ab5f0 con 0x7f65980b2e90 2023-09-13T06:02:16.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f659659c640 1 -- 172.21.15.130:0/380044189 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800ab750 con 0x7f65980b2e90 2023-09-13T06:02:16.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f659659c640 1 -- 172.21.15.130:0/380044189 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800abae0 con 0x7f65980b2e90 2023-09-13T06:02:16.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f659d111640 1 -- 172.21.15.130:0/380044189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65980b2e90 msgr2=0x7f65980ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:16.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f659d111640 1 --2- 172.21.15.130:0/380044189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65980b2e90 0x7f65980ce870 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f65980668f0 tx=0x7f658001c500 comp rx=0 tx=0).stop 2023-09-13T06:02:16.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f659d111640 1 -- 172.21.15.130:0/380044189 shutdown_connections 2023-09-13T06:02:16.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f659d111640 1 --2- 172.21.15.130:0/380044189 >> v2:172.21.15.164:3300/0 conn(0x7f65980b1460 0x7f65980b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:16.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f659d111640 1 --2- 172.21.15.130:0/380044189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65980b2e90 0x7f65980ce870 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:16.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f659d111640 1 -- 172.21.15.130:0/380044189 >> 172.21.15.130:0/380044189 conn(0x7f6598065990 msgr2=0x7f6598065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:16.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f659d111640 1 -- 172.21.15.130:0/380044189 shutdown_connections 2023-09-13T06:02:16.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.928+0000 7f659d111640 1 -- 172.21.15.130:0/380044189 wait complete. 2023-09-13T06:02:16.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f659d111640 1 Processor -- start 2023-09-13T06:02:16.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f659d111640 1 -- start start 2023-09-13T06:02:16.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f659d111640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65980b1460 0x7f6598139b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:16.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f659d111640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65980b2e90 0x7f65980ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:16.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f659d111640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6598144d70 0x7f659813b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:16.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f659d111640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659813b9e0 con 0x7f65980b1460 2023-09-13T06:02:16.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f659d111640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659813bca0 con 0x7f65980b2e90 2023-09-13T06:02:16.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f659d111640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659813bf80 con 0x7f6598144d70 2023-09-13T06:02:16.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65980b1460 0x7f6598139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:16.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65980b1460 0x7f6598139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50040/0 (socket says 172.21.15.130:50040) 2023-09-13T06:02:16.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f6596d9d640 1 -- 172.21.15.130:0/787019382 learned_addr learned my addr 172.21.15.130:0/787019382 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:16.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f658e59c640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65980b2e90 0x7f65980ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:16.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f659759e640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6598144d70 0x7f659813b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:16.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f6596d9d640 1 -- 172.21.15.130:0/787019382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6598144d70 msgr2=0x7f659813b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:16.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f6596d9d640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6598144d70 0x7f659813b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:16.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f6596d9d640 1 -- 172.21.15.130:0/787019382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65980b2e90 msgr2=0x7f65980ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:16.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f6596d9d640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65980b2e90 0x7f65980ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:16.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f6596d9d640 1 -- 172.21.15.130:0/787019382 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65800094d0 con 0x7f65980b1460 2023-09-13T06:02:16.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f659759e640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6598144d70 0x7f659813b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:16.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f6596d9d640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65980b1460 0x7f6598139b10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f658800c3c0 tx=0x7f658800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:16.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.932+0000 7f658ffff640 1 -- 172.21.15.130:0/787019382 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65880052d0 con 0x7f65980b1460 2023-09-13T06:02:16.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.936+0000 7f658ffff640 1 -- 172.21.15.130:0/787019382 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6588005430 con 0x7f65980b1460 2023-09-13T06:02:16.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.936+0000 7f658ffff640 1 -- 172.21.15.130:0/787019382 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588003840 con 0x7f65980b1460 2023-09-13T06:02:16.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.936+0000 7f659d111640 1 -- 172.21.15.130:0/787019382 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659813c260 con 0x7f65980b1460 2023-09-13T06:02:16.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.936+0000 7f659d111640 1 -- 172.21.15.130:0/787019382 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659813b6f0 con 0x7f65980b1460 2023-09-13T06:02:16.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.936+0000 7f659d111640 1 -- 172.21.15.130:0/787019382 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6598155580 con 0x7f65980b1460 2023-09-13T06:02:16.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.936+0000 7f658ffff640 1 -- 172.21.15.130:0/787019382 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f65880039a0 con 0x7f65980b1460 2023-09-13T06:02:16.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.936+0000 7f658ffff640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6578065b20 0x7f6578067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:16.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.936+0000 7f658ffff640 1 -- 172.21.15.130:0/787019382 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f65880826f0 con 0x7f65980b1460 2023-09-13T06:02:16.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.936+0000 7f658e59c640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6578065b20 0x7f6578067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:16.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.936+0000 7f658e59c640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6578065b20 0x7f6578067fe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65800af000 tx=0x7f65800a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:16.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:16.940+0000 7f658ffff640 1 -- 172.21.15.130:0/787019382 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6598155580 con 0x7f65980b1460 2023-09-13T06:02:17.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.092+0000 7f659d111640 1 -- 172.21.15.130:0/787019382 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f65980618a0 con 0x7f65980b1460 2023-09-13T06:02:17.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.756+0000 7f658ffff640 1 -- 172.21.15.130:0/787019382 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6588050180 con 0x7f65980b1460 2023-09-13T06:02:17.763 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' created 2023-09-13T06:02:17.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 -- 172.21.15.130:0/787019382 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6578065b20 msgr2=0x7f6578067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:17.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6578065b20 0x7f6578067fe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65800af000 tx=0x7f65800a7000 comp rx=0 tx=0).stop 2023-09-13T06:02:17.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 -- 172.21.15.130:0/787019382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65980b1460 msgr2=0x7f6598139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:17.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65980b1460 0x7f6598139b10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f658800c3c0 tx=0x7f658800c880 comp rx=0 tx=0).stop 2023-09-13T06:02:17.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 -- 172.21.15.130:0/787019382 shutdown_connections 2023-09-13T06:02:17.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6578065b20 0x7f6578067fe0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:17.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65980b2e90 0x7f65980ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:17.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6598144d70 0x7f659813b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:17.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 --2- 172.21.15.130:0/787019382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65980b1460 0x7f6598139b10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:17.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 -- 172.21.15.130:0/787019382 >> 172.21.15.130:0/787019382 conn(0x7f6598065990 msgr2=0x7f659815da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:17.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 -- 172.21.15.130:0/787019382 shutdown_connections 2023-09-13T06:02:17.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.764+0000 7f659d111640 1 -- 172.21.15.130:0/787019382 wait complete. 2023-09-13T06:02:17.790 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T06:02:17.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.928+0000 7fc581f20640 1 Processor -- start 2023-09-13T06:02:17.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.928+0000 7fc581f20640 1 -- start start 2023-09-13T06:02:17.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc581f20640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc57c15d160 0x7fc57c0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:17.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc581f20640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc57c0cc660 0x7fc57c0afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:17.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc581f20640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c0b2150 con 0x7fc57c0acd10 2023-09-13T06:02:17.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc581f20640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c0cb720 con 0x7fc57c15d160 2023-09-13T06:02:17.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc581f20640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c15d540 con 0x7fc57c0cc660 2023-09-13T06:02:17.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc580f1e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc57c15d160 0x7fc57c0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:17.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc57bfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc57c0cc660 0x7fc57c0afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:17.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc58171f640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc57c0acd10 0x7fc57c160ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:54390/0 (socket says 172.21.15.130:54390) 2023-09-13T06:02:17.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc58171f640 1 -- 172.21.15.130:0/19126330 learned_addr learned my addr 172.21.15.130:0/19126330 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:17.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc580f1e640 1 -- 172.21.15.130:0/19126330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc57c0cc660 msgr2=0x7fc57c0afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:17.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc580f1e640 1 --2- 172.21.15.130:0/19126330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc57c0cc660 0x7fc57c0afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:17.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc580f1e640 1 -- 172.21.15.130:0/19126330 >> v1:172.21.15.164:6789/0 conn(0x7fc57c0acd10 legacy=0x7fc57c160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:17.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc580f1e640 1 -- 172.21.15.130:0/19126330 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0b2460 con 0x7fc57c15d160 2023-09-13T06:02:17.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.932+0000 7fc57bfff640 1 --2- 172.21.15.130:0/19126330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc57c0cc660 0x7fc57c0afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:17.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc580f1e640 1 --2- 172.21.15.130:0/19126330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc57c15d160 0x7fc57c0cb020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc5700097c0 tx=0x7fc57001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1bb31ea8aaa205f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:17.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc57b7fe640 1 -- 172.21.15.130:0/19126330 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700ab600 con 0x7fc57c15d160 2023-09-13T06:02:17.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc57b7fe640 1 -- 172.21.15.130:0/19126330 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5700a7050 con 0x7fc57c15d160 2023-09-13T06:02:17.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc57b7fe640 1 -- 172.21.15.130:0/19126330 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700ab980 con 0x7fc57c15d160 2023-09-13T06:02:17.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc581f20640 1 -- 172.21.15.130:0/19126330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc57c15d160 msgr2=0x7fc57c0cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:17.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc581f20640 1 --2- 172.21.15.130:0/19126330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc57c15d160 0x7fc57c0cb020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc5700097c0 tx=0x7fc57001c360 comp rx=0 tx=0).stop 2023-09-13T06:02:17.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc581f20640 1 -- 172.21.15.130:0/19126330 shutdown_connections 2023-09-13T06:02:17.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc581f20640 1 --2- 172.21.15.130:0/19126330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc57c0cc660 0x7fc57c0afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:17.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc581f20640 1 --2- 172.21.15.130:0/19126330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc57c15d160 0x7fc57c0cb020 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:17.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc581f20640 1 -- 172.21.15.130:0/19126330 >> 172.21.15.130:0/19126330 conn(0x7fc57c065990 msgr2=0x7fc57c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:17.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc581f20640 1 -- 172.21.15.130:0/19126330 shutdown_connections 2023-09-13T06:02:17.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc581f20640 1 -- 172.21.15.130:0/19126330 wait complete. 2023-09-13T06:02:17.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc581f20640 1 Processor -- start 2023-09-13T06:02:17.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.936+0000 7fc581f20640 1 -- start start 2023-09-13T06:02:17.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc581f20640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc57c0acd10 0x7fc57c1367b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:17.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc581f20640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc57c0cc660 0x7fc57c14ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:17.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc581f20640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc57c15d160 0x7fc57c0b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:17.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc581f20640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c136cf0 con 0x7fc57c15d160 2023-09-13T06:02:17.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc581f20640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c14bcb0 con 0x7fc57c0cc660 2023-09-13T06:02:17.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc581f20640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c14b0a0 con 0x7fc57c0acd10 2023-09-13T06:02:17.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc58171f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc57c15d160 0x7fc57c0b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:17.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc58171f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc57c15d160 0x7fc57c0b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50046/0 (socket says 172.21.15.130:50046) 2023-09-13T06:02:17.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc58171f640 1 -- 172.21.15.130:0/2498777663 learned_addr learned my addr 172.21.15.130:0/2498777663 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:17.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc57bfff640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc57c0cc660 0x7fc57c14ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:17.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc580f1e640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc57c0acd10 0x7fc57c1367b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:17.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc58171f640 1 -- 172.21.15.130:0/2498777663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc57c0acd10 msgr2=0x7fc57c1367b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:17.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc58171f640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc57c0acd10 0x7fc57c1367b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:17.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc58171f640 1 -- 172.21.15.130:0/2498777663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc57c0cc660 msgr2=0x7fc57c14ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:17.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc58171f640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc57c0cc660 0x7fc57c14ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:17.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc58171f640 1 -- 172.21.15.130:0/2498777663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568009420 con 0x7fc57c15d160 2023-09-13T06:02:17.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc58171f640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc57c15d160 0x7fc57c0b0fa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc57400caf0 tx=0x7fc57400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:17.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc5797fa640 1 -- 172.21.15.130:0/2498777663 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400aca0 con 0x7fc57c15d160 2023-09-13T06:02:17.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc5797fa640 1 -- 172.21.15.130:0/2498777663 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57400ae00 con 0x7fc57c15d160 2023-09-13T06:02:17.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc581f20640 1 -- 172.21.15.130:0/2498777663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc570009420 con 0x7fc57c15d160 2023-09-13T06:02:17.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc5797fa640 1 -- 172.21.15.130:0/2498777663 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574012600 con 0x7fc57c15d160 2023-09-13T06:02:17.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc581f20640 1 -- 172.21.15.130:0/2498777663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c14b660 con 0x7fc57c15d160 2023-09-13T06:02:17.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.940+0000 7fc581f20640 1 -- 172.21.15.130:0/2498777663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c0618a0 con 0x7fc57c15d160 2023-09-13T06:02:17.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.944+0000 7fc5797fa640 1 -- 172.21.15.130:0/2498777663 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc574007070 con 0x7fc57c15d160 2023-09-13T06:02:17.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.944+0000 7fc5797fa640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc560065b50 0x7fc560068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:17.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.944+0000 7fc5797fa640 1 -- 172.21.15.130:0/2498777663 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc574083170 con 0x7fc57c15d160 2023-09-13T06:02:17.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.944+0000 7fc580f1e640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc560065b50 0x7fc560068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:17.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.944+0000 7fc580f1e640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc560065b50 0x7fc560068010 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc5700ad000 tx=0x7fc570008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:17.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:17.948+0000 7fc5797fa640 1 -- 172.21.15.130:0/2498777663 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc574050b30 con 0x7fc57c15d160 2023-09-13T06:02:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.128+0000 7fc581f20640 1 -- 172.21.15.130:0/2498777663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc57c14bdf0 con 0x7fc57c15d160 2023-09-13T06:02:18.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.776+0000 7fc5797fa640 1 -- 172.21.15.130:0/2498777663 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc574054150 con 0x7fc57c15d160 2023-09-13T06:02:18.790 INFO:teuthology.orchestra.run.smithi130.stderr:new fs with metadata pool 4 and data pool 5 2023-09-13T06:02:18.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 -- 172.21.15.130:0/2498777663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc560065b50 msgr2=0x7fc560068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:18.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc560065b50 0x7fc560068010 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc5700ad000 tx=0x7fc570008040 comp rx=0 tx=0).stop 2023-09-13T06:02:18.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 -- 172.21.15.130:0/2498777663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc57c15d160 msgr2=0x7fc57c0b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:18.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc57c15d160 0x7fc57c0b0fa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc57400caf0 tx=0x7fc57400a060 comp rx=0 tx=0).stop 2023-09-13T06:02:18.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 -- 172.21.15.130:0/2498777663 shutdown_connections 2023-09-13T06:02:18.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc560065b50 0x7fc560068010 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:18.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc57c0cc660 0x7fc57c14ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:18.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc57c15d160 0x7fc57c0b0fa0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:18.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 --2- 172.21.15.130:0/2498777663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc57c0acd10 0x7fc57c1367b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:18.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 -- 172.21.15.130:0/2498777663 >> 172.21.15.130:0/2498777663 conn(0x7fc57c065990 msgr2=0x7fc57c0b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:18.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 -- 172.21.15.130:0/2498777663 shutdown_connections 2023-09-13T06:02:18.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.788+0000 7fc581f20640 1 -- 172.21.15.130:0/2498777663 wait complete. 2023-09-13T06:02:18.815 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:18.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb081dd2640 1 Processor -- start 2023-09-13T06:02:18.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb081dd2640 1 -- start start 2023-09-13T06:02:18.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb081dd2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb07c0d1750 0x7fb07c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:18.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb081dd2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb07c146f30 0x7fb07c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:18.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb081dd2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c0b63c0 con 0x7fb07c0d1090 2023-09-13T06:02:18.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb081dd2640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c15dea0 con 0x7fb07c0d1750 2023-09-13T06:02:18.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb081dd2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0d0c20 con 0x7fb07c146f30 2023-09-13T06:02:18.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb07b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb07c0d1750 0x7fb07c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:18.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb07b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb07c0d1750 0x7fb07c15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50058/0 (socket says 172.21.15.130:50058) 2023-09-13T06:02:18.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb07b7fe640 1 -- 172.21.15.130:0/209259482 learned_addr learned my addr 172.21.15.130:0/209259482 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:18.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb07bfff640 1 --2- 172.21.15.130:0/209259482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb07c146f30 0x7fb07c0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:18.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb07b7fe640 1 -- 172.21.15.130:0/209259482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb07c146f30 msgr2=0x7fb07c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:18.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb07b7fe640 1 --2- 172.21.15.130:0/209259482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb07c146f30 0x7fb07c0b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:18.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb07b7fe640 1 -- 172.21.15.130:0/209259482 >> v1:172.21.15.164:6789/0 conn(0x7fb07c0d1090 legacy=0x7fb07c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:18.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb07b7fe640 1 -- 172.21.15.130:0/209259482 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0b6610 con 0x7fb07c0d1750 2023-09-13T06:02:18.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.952+0000 7fb07bfff640 1 --2- 172.21.15.130:0/209259482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb07c146f30 0x7fb07c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:18.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb07b7fe640 1 --2- 172.21.15.130:0/209259482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c0d1750 0x7fb07c15d960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009870 tx=0x7fb06c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f116d5145fa9f2b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:18.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb07a7fc640 1 -- 172.21.15.130:0/209259482 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0aa5f0 con 0x7fb07c0d1750 2023-09-13T06:02:18.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb07a7fc640 1 -- 172.21.15.130:0/209259482 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c0aa750 con 0x7fb07c0d1750 2023-09-13T06:02:18.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb07a7fc640 1 -- 172.21.15.130:0/209259482 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0aaae0 con 0x7fb07c0d1750 2023-09-13T06:02:18.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb081dd2640 1 -- 172.21.15.130:0/209259482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c0d1750 msgr2=0x7fb07c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:18.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb081dd2640 1 --2- 172.21.15.130:0/209259482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c0d1750 0x7fb07c15d960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009870 tx=0x7fb06c01c4d0 comp rx=0 tx=0).stop 2023-09-13T06:02:18.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb081dd2640 1 -- 172.21.15.130:0/209259482 shutdown_connections 2023-09-13T06:02:18.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb081dd2640 1 --2- 172.21.15.130:0/209259482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb07c146f30 0x7fb07c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:18.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb081dd2640 1 --2- 172.21.15.130:0/209259482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c0d1750 0x7fb07c15d960 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:18.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb081dd2640 1 -- 172.21.15.130:0/209259482 >> 172.21.15.130:0/209259482 conn(0x7fb07c06f170 msgr2=0x7fb07c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:18.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb081dd2640 1 -- 172.21.15.130:0/209259482 shutdown_connections 2023-09-13T06:02:18.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb081dd2640 1 -- 172.21.15.130:0/209259482 wait complete. 2023-09-13T06:02:18.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.956+0000 7fb081dd2640 1 Processor -- start 2023-09-13T06:02:18.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb081dd2640 1 -- start start 2023-09-13T06:02:18.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb081dd2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb07c0d1090 0x7fb07c1413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:18.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb081dd2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb07c0d1750 0x7fb07c0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:18.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb081dd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c146f30 0x7fb07c0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:18.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb081dd2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c141930 con 0x7fb07c146f30 2023-09-13T06:02:18.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb081dd2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c144000 con 0x7fb07c0d1750 2023-09-13T06:02:18.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb081dd2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c141b40 con 0x7fb07c0d1090 2023-09-13T06:02:18.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c146f30 0x7fb07c0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:18.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c146f30 0x7fb07c0cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50062/0 (socket says 172.21.15.130:50062) 2023-09-13T06:02:18.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb07bfff640 1 -- 172.21.15.130:0/2089260113 learned_addr learned my addr 172.21.15.130:0/2089260113 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:18.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb07b7fe640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb07c0d1090 0x7fb07c1413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:18.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb07affd640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb07c0d1750 0x7fb07c0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:18.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb07bfff640 1 -- 172.21.15.130:0/2089260113 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb07c0d1090 msgr2=0x7fb07c1413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:18.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb07bfff640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb07c0d1090 0x7fb07c1413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:18.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb07bfff640 1 -- 172.21.15.130:0/2089260113 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb07c0d1750 msgr2=0x7fb07c0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:18.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb07bfff640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb07c0d1750 0x7fb07c0c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:18.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb07bfff640 1 -- 172.21.15.130:0/2089260113 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0094d0 con 0x7fb07c146f30 2023-09-13T06:02:18.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb07bfff640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c146f30 0x7fb07c0cdc60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb07400cd80 tx=0x7fb07400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:18.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb063fff640 1 -- 172.21.15.130:0/2089260113 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400f680 con 0x7fb07c146f30 2023-09-13T06:02:18.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb063fff640 1 -- 172.21.15.130:0/2089260113 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07400f800 con 0x7fb07c146f30 2023-09-13T06:02:18.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb081dd2640 1 -- 172.21.15.130:0/2089260113 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c0b7e40 con 0x7fb07c146f30 2023-09-13T06:02:18.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb063fff640 1 -- 172.21.15.130:0/2089260113 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400fbb0 con 0x7fb07c146f30 2023-09-13T06:02:18.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb081dd2640 1 -- 172.21.15.130:0/2089260113 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c142100 con 0x7fb07c146f30 2023-09-13T06:02:18.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.960+0000 7fb081dd2640 1 -- 172.21.15.130:0/2089260113 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c1441d0 con 0x7fb07c146f30 2023-09-13T06:02:18.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.964+0000 7fb063fff640 1 -- 172.21.15.130:0/2089260113 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb07400b040 con 0x7fb07c146f30 2023-09-13T06:02:18.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.964+0000 7fb063fff640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb068065b20 0x7fb068067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:18.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.964+0000 7fb063fff640 1 -- 172.21.15.130:0/2089260113 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb074083c10 con 0x7fb07c146f30 2023-09-13T06:02:18.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.964+0000 7fb07b7fe640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb068065b20 0x7fb068067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:18.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.964+0000 7fb07b7fe640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb068065b20 0x7fb068067fe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb06c0ae000 tx=0x7fb06c0b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:18.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:18.968+0000 7fb063fff640 1 -- 172.21.15.130:0/2089260113 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb07c1441d0 con 0x7fb07c146f30 2023-09-13T06:02:19.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.116+0000 7fb081dd2640 1 -- 172.21.15.130:0/2089260113 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb07c1441d0 con 0x7fb07c146f30 2023-09-13T06:02:19.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.116+0000 7fb063fff640 1 -- 172.21.15.130:0/2089260113 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16618 (secure 0 0 0) 0x7fb07c1441d0 con 0x7fb07c146f30 2023-09-13T06:02:19.123 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:19.123 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":31,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:18.134955+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:15.867393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:17.140116+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:19.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 -- 172.21.15.130:0/2089260113 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb068065b20 msgr2=0x7fb068067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb068065b20 0x7fb068067fe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb06c0ae000 tx=0x7fb06c0b5040 comp rx=0 tx=0).stop 2023-09-13T06:02:19.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 -- 172.21.15.130:0/2089260113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c146f30 msgr2=0x7fb07c0cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c146f30 0x7fb07c0cdc60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb07400cd80 tx=0x7fb07400a650 comp rx=0 tx=0).stop 2023-09-13T06:02:19.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 -- 172.21.15.130:0/2089260113 shutdown_connections 2023-09-13T06:02:19.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb068065b20 0x7fb068067fe0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb07c0d1750 0x7fb07c0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c146f30 0x7fb07c0cdc60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 --2- 172.21.15.130:0/2089260113 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb07c0d1090 0x7fb07c1413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 -- 172.21.15.130:0/2089260113 >> 172.21.15.130:0/2089260113 conn(0x7fb07c06f170 msgr2=0x7fb07c13f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:19.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 -- 172.21.15.130:0/2089260113 shutdown_connections 2023-09-13T06:02:19.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.120+0000 7fb081dd2640 1 -- 172.21.15.130:0/2089260113 wait complete. 2023-09-13T06:02:19.144 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:19.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e29b79640 1 Processor -- start 2023-09-13T06:02:19.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e29b79640 1 -- start start 2023-09-13T06:02:19.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e29b79640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4e24070890 0x7f4e24167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:19.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e29b79640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e240d1ac0 con 0x7f4e24146b30 2023-09-13T06:02:19.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e29b79640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e240d0be0 con 0x7f4e240d1f50 2023-09-13T06:02:19.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e29b79640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e240d0eb0 con 0x7f4e24070890 2023-09-13T06:02:19.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e28b77640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4e24146b30 0x7f4e240d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:45574/0 (socket says 172.21.15.130:45574) 2023-09-13T06:02:19.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e28b77640 1 -- 172.21.15.130:0/822816578 learned_addr learned my addr 172.21.15.130:0/822816578 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:19.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e29378640 1 --2- 172.21.15.130:0/822816578 >> v2:172.21.15.130:3300/0 conn(0x7f4e24070890 0x7f4e24167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:19.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e237fe640 1 -- 172.21.15.130:0/822816578 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253242912 0 0) 0x7f4e240d1ac0 con 0x7f4e24146b30 2023-09-13T06:02:19.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e237fe640 1 -- 172.21.15.130:0/822816578 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e14003530 con 0x7f4e24146b30 2023-09-13T06:02:19.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e29378640 1 -- 172.21.15.130:0/822816578 >> v1:172.21.15.164:6789/0 conn(0x7f4e240d1f50 legacy=0x7f4e24070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e29378640 1 -- 172.21.15.130:0/822816578 >> v1:172.21.15.130:6789/0 conn(0x7f4e24146b30 legacy=0x7f4e240d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.280+0000 7f4e29378640 1 -- 172.21.15.130:0/822816578 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e240d1190 con 0x7f4e24070890 2023-09-13T06:02:19.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e29378640 1 --2- 172.21.15.130:0/822816578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e24070890 0x7f4e24167dd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009d90 tx=0x7f4e1c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7162d1a6d7dacbd3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:19.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e237fe640 1 -- 172.21.15.130:0/822816578 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0a59e0 con 0x7f4e24070890 2023-09-13T06:02:19.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e237fe640 1 -- 172.21.15.130:0/822816578 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c0a5b40 con 0x7f4e24070890 2023-09-13T06:02:19.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e237fe640 1 -- 172.21.15.130:0/822816578 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0ad440 con 0x7f4e24070890 2023-09-13T06:02:19.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e29b79640 1 -- 172.21.15.130:0/822816578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e24070890 msgr2=0x7f4e24167dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e29b79640 1 --2- 172.21.15.130:0/822816578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e24070890 0x7f4e24167dd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009d90 tx=0x7f4e1c01c920 comp rx=0 tx=0).stop 2023-09-13T06:02:19.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e29b79640 1 -- 172.21.15.130:0/822816578 shutdown_connections 2023-09-13T06:02:19.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e29b79640 1 --2- 172.21.15.130:0/822816578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e24070890 0x7f4e24167dd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e29b79640 1 -- 172.21.15.130:0/822816578 >> 172.21.15.130:0/822816578 conn(0x7f4e240d3090 msgr2=0x7f4e240d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:19.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e29b79640 1 -- 172.21.15.130:0/822816578 shutdown_connections 2023-09-13T06:02:19.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e29b79640 1 -- 172.21.15.130:0/822816578 wait complete. 2023-09-13T06:02:19.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.284+0000 7f4e29b79640 1 Processor -- start 2023-09-13T06:02:19.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29b79640 1 -- start start 2023-09-13T06:02:19.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29b79640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e24070890 0x7f4e24159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:19.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29b79640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e240d1f50 0x7f4e24143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:19.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29b79640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e24146b30 0x7f4e24143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:19.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29b79640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24145010 con 0x7f4e24146b30 2023-09-13T06:02:19.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29b79640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2415d100 con 0x7f4e240d1f50 2023-09-13T06:02:19.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29b79640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24144390 con 0x7f4e24070890 2023-09-13T06:02:19.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29378640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e24146b30 0x7f4e24143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:19.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29378640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e24146b30 0x7f4e24143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50090/0 (socket says 172.21.15.130:50090) 2023-09-13T06:02:19.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29378640 1 -- 172.21.15.130:0/4280950155 learned_addr learned my addr 172.21.15.130:0/4280950155 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:19.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e28b77640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e24070890 0x7f4e24159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:19.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e23fff640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e240d1f50 0x7f4e24143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:19.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29378640 1 -- 172.21.15.130:0/4280950155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e24070890 msgr2=0x7f4e24159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29378640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e24070890 0x7f4e24159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29378640 1 -- 172.21.15.130:0/4280950155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e240d1f50 msgr2=0x7f4e24143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29378640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e240d1f50 0x7f4e24143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29378640 1 -- 172.21.15.130:0/4280950155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c009a70 con 0x7f4e24146b30 2023-09-13T06:02:19.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e28b77640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e24070890 0x7f4e24159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:19.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29378640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e24146b30 0x7f4e24143d60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c01a550 tx=0x7f4e1c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:19.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e217fa640 1 -- 172.21.15.130:0/4280950155 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0add90 con 0x7f4e24146b30 2023-09-13T06:02:19.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e217fa640 1 -- 172.21.15.130:0/4280950155 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c009450 con 0x7f4e24146b30 2023-09-13T06:02:19.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e217fa640 1 -- 172.21.15.130:0/4280950155 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0b9670 con 0x7f4e24146b30 2023-09-13T06:02:19.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29b79640 1 -- 172.21.15.130:0/4280950155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e24144670 con 0x7f4e24146b30 2023-09-13T06:02:19.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29b79640 1 -- 172.21.15.130:0/4280950155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e24144c30 con 0x7f4e24146b30 2023-09-13T06:02:19.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.288+0000 7f4e29b79640 1 -- 172.21.15.130:0/4280950155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e24145150 con 0x7f4e24146b30 2023-09-13T06:02:19.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.292+0000 7f4e217fa640 1 -- 172.21.15.130:0/4280950155 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4e1c0b97d0 con 0x7f4e24146b30 2023-09-13T06:02:19.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.292+0000 7f4e217fa640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e08065b20 0x7f4e08067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:19.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.292+0000 7f4e217fa640 1 -- 172.21.15.130:0/4280950155 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e1c11ea80 con 0x7f4e24146b30 2023-09-13T06:02:19.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.292+0000 7f4e28b77640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e08065b20 0x7f4e08067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:19.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.292+0000 7f4e28b77640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e08065b20 0x7f4e08067fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4e180011f0 tx=0x7f4e18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:19.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.296+0000 7f4e217fa640 1 -- 172.21.15.130:0/4280950155 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4e24145150 con 0x7f4e24146b30 2023-09-13T06:02:19.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.444+0000 7f4e29b79640 1 -- 172.21.15.130:0/4280950155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e24145150 con 0x7f4e24146b30 2023-09-13T06:02:19.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.444+0000 7f4e217fa640 1 -- 172.21.15.130:0/4280950155 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16618 (secure 0 0 0) 0x7f4e24145150 con 0x7f4e24146b30 2023-09-13T06:02:19.449 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:19.449 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":31,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:18.134955+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:15.867393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:17.140116+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:19.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 -- 172.21.15.130:0/4280950155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e08065b20 msgr2=0x7f4e08067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e08065b20 0x7f4e08067fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4e180011f0 tx=0x7f4e18009040 comp rx=0 tx=0).stop 2023-09-13T06:02:19.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 -- 172.21.15.130:0/4280950155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e24146b30 msgr2=0x7f4e24143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e24146b30 0x7f4e24143d60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c01a550 tx=0x7f4e1c0196c0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 -- 172.21.15.130:0/4280950155 shutdown_connections 2023-09-13T06:02:19.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e08065b20 0x7f4e08067fe0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e240d1f50 0x7f4e24143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e24146b30 0x7f4e24143d60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 --2- 172.21.15.130:0/4280950155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e24070890 0x7f4e24159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 -- 172.21.15.130:0/4280950155 >> 172.21.15.130:0/4280950155 conn(0x7f4e240d3090 msgr2=0x7f4e240b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:19.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 -- 172.21.15.130:0/4280950155 shutdown_connections 2023-09-13T06:02:19.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.448+0000 7f4e29b79640 1 -- 172.21.15.130:0/4280950155 wait complete. 2023-09-13T06:02:19.471 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T06:02:19.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.608+0000 7f717046a640 1 Processor -- start 2023-09-13T06:02:19.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.608+0000 7f717046a640 1 -- start start 2023-09-13T06:02:19.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f717046a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f71680b4830 0x7f71680cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:19.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f717046a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71680cc9d0 con 0x7f71680b2750 2023-09-13T06:02:19.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f717046a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71680cccb0 con 0x7f7168159900 2023-09-13T06:02:19.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f717046a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71680b0c20 con 0x7f71680b4830 2023-09-13T06:02:19.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f716da05640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f71680b4830 0x7f71680cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:19.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f716ea07640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f71680b2750 0x7f7168163410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:45590/0 (socket says 172.21.15.130:45590) 2023-09-13T06:02:19.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f716ea07640 1 -- 172.21.15.130:0/1170631629 learned_addr learned my addr 172.21.15.130:0/1170631629 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:19.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f716da05640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f71680b4830 0x7f71680cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50094/0 (socket says 172.21.15.130:50094) 2023-09-13T06:02:19.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f716da05640 1 -- 172.21.15.130:0/1170631629 >> v1:172.21.15.164:6789/0 conn(0x7f7168159900 legacy=0x7f71680b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f716da05640 1 -- 172.21.15.130:0/1170631629 >> v1:172.21.15.130:6789/0 conn(0x7f71680b2750 legacy=0x7f7168163410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f716da05640 1 -- 172.21.15.130:0/1170631629 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680ccf90 con 0x7f71680b4830 2023-09-13T06:02:19.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f716d204640 1 -- 172.21.15.130:0/1170631629 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566961313 0 0) 0x7f71680cc9d0 con 0x7f71680b2750 2023-09-13T06:02:19.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.612+0000 7f716da05640 1 --2- 172.21.15.130:0/1170631629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71680b4830 0x7f71680cc2d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f715800a960 tx=0x7f715801d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410d3ca793de883e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:19.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f716d204640 1 -- 172.21.15.130:0/1170631629 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580a6880 con 0x7f71680b4830 2023-09-13T06:02:19.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f716d204640 1 -- 172.21.15.130:0/1170631629 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71580a69e0 con 0x7f71680b4830 2023-09-13T06:02:19.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f716d204640 1 -- 172.21.15.130:0/1170631629 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580a6d70 con 0x7f71680b4830 2023-09-13T06:02:19.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 -- 172.21.15.130:0/1170631629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71680b4830 msgr2=0x7f71680cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 --2- 172.21.15.130:0/1170631629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71680b4830 0x7f71680cc2d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f715800a960 tx=0x7f715801d850 comp rx=0 tx=0).stop 2023-09-13T06:02:19.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 -- 172.21.15.130:0/1170631629 shutdown_connections 2023-09-13T06:02:19.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 --2- 172.21.15.130:0/1170631629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71680b4830 0x7f71680cc2d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 -- 172.21.15.130:0/1170631629 >> 172.21.15.130:0/1170631629 conn(0x7f7168065990 msgr2=0x7f7168065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:19.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 -- 172.21.15.130:0/1170631629 shutdown_connections 2023-09-13T06:02:19.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 -- 172.21.15.130:0/1170631629 wait complete. 2023-09-13T06:02:19.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 Processor -- start 2023-09-13T06:02:19.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 -- start start 2023-09-13T06:02:19.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71680b2750 0x7f716806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:19.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71680b4830 0x7f716806e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:19.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7168159900 0x7f7168147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:19.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7168147f70 con 0x7f71680b4830 2023-09-13T06:02:19.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716806db70 con 0x7f7168159900 2023-09-13T06:02:19.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f717046a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716806cf60 con 0x7f71680b2750 2023-09-13T06:02:19.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f716da05640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71680b4830 0x7f716806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:19.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f716da05640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71680b4830 0x7f716806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50102/0 (socket says 172.21.15.130:50102) 2023-09-13T06:02:19.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.616+0000 7f716da05640 1 -- 172.21.15.130:0/3106627765 learned_addr learned my addr 172.21.15.130:0/3106627765 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:19.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f716e206640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71680b2750 0x7f716806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:19.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f716ea07640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7168159900 0x7f7168147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:19.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f716da05640 1 -- 172.21.15.130:0/3106627765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71680b2750 msgr2=0x7f716806c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f716da05640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71680b2750 0x7f716806c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f716da05640 1 -- 172.21.15.130:0/3106627765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7168159900 msgr2=0x7f7168147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:19.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f716da05640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7168159900 0x7f7168147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:19.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f716da05640 1 -- 172.21.15.130:0/3106627765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715800a5c0 con 0x7f71680b4830 2023-09-13T06:02:19.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f716e206640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71680b2750 0x7f716806c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:19.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f716ea07640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7168159900 0x7f7168147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:19.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f716da05640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71680b4830 0x7f716806e000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71580b1040 tx=0x7f715801a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:19.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f715effd640 1 -- 172.21.15.130:0/3106627765 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580ae950 con 0x7f71680b4830 2023-09-13T06:02:19.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f715effd640 1 -- 172.21.15.130:0/3106627765 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71580aeab0 con 0x7f71680b4830 2023-09-13T06:02:19.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f717046a640 1 -- 172.21.15.130:0/3106627765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716806d240 con 0x7f71680b4830 2023-09-13T06:02:19.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f715effd640 1 -- 172.21.15.130:0/3106627765 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580aee60 con 0x7f71680b4830 2023-09-13T06:02:19.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f717046a640 1 -- 172.21.15.130:0/3106627765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716806d800 con 0x7f71680b4830 2023-09-13T06:02:19.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f717046a640 1 -- 172.21.15.130:0/3106627765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71680618a0 con 0x7f71680b4830 2023-09-13T06:02:19.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f715effd640 1 -- 172.21.15.130:0/3106627765 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f71580b5040 con 0x7f71680b4830 2023-09-13T06:02:19.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f715effd640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f714c065b20 0x7f714c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:19.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f715effd640 1 -- 172.21.15.130:0/3106627765 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f715811d8f0 con 0x7f71680b4830 2023-09-13T06:02:19.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.620+0000 7f716e206640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f714c065b20 0x7f714c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:19.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.624+0000 7f716e206640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f714c065b20 0x7f714c067fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7164000f70 tx=0x7f7164009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:19.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.624+0000 7f715effd640 1 -- 172.21.15.130:0/3106627765 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f71580eb2b0 con 0x7f71680b4830 2023-09-13T06:02:19.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:19.808+0000 7f717046a640 1 -- 172.21.15.130:0/3106627765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f71680cdb40 con 0x7f71680b4830 2023-09-13T06:02:20.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.800+0000 7f715effd640 1 -- 172.21.15.130:0/3106627765 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f71580ee8d0 con 0x7f71680b4830 2023-09-13T06:02:20.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 -- 172.21.15.130:0/3106627765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f714c065b20 msgr2=0x7f714c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:20.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f714c065b20 0x7f714c067fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7164000f70 tx=0x7f7164009040 comp rx=0 tx=0).stop 2023-09-13T06:02:20.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 -- 172.21.15.130:0/3106627765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71680b4830 msgr2=0x7f716806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:20.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71680b4830 0x7f716806e000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71580b1040 tx=0x7f715801a5f0 comp rx=0 tx=0).stop 2023-09-13T06:02:20.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 -- 172.21.15.130:0/3106627765 shutdown_connections 2023-09-13T06:02:20.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f714c065b20 0x7f714c067fe0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:20.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7168159900 0x7f7168147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:20.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71680b4830 0x7f716806e000 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:20.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 --2- 172.21.15.130:0/3106627765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71680b2750 0x7f716806c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:20.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 -- 172.21.15.130:0/3106627765 >> 172.21.15.130:0/3106627765 conn(0x7f7168065990 msgr2=0x7f71680ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:20.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 -- 172.21.15.130:0/3106627765 shutdown_connections 2023-09-13T06:02:20.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.804+0000 7f717046a640 1 -- 172.21.15.130:0/3106627765 wait complete. 2023-09-13T06:02:20.831 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T06:02:20.832 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T06:02:20.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.972+0000 7f43c5bac640 1 Processor -- start 2023-09-13T06:02:20.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43c5bac640 1 -- start start 2023-09-13T06:02:20.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43c5bac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43c0144d70 0x7f43c00ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:20.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43c5bac640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f43c00b1b70 0x7f43c00b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:20.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43c5bac640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c00b3120 con 0x7f43c00b2780 2023-09-13T06:02:20.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43c5bac640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c00b2430 con 0x7f43c00b1b70 2023-09-13T06:02:20.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43c5bac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00cedb0 con 0x7f43c0144d70 2023-09-13T06:02:20.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43bf7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43c0144d70 0x7f43c00ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:20.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43bffff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f43c00b1b70 0x7f43c00b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:20.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43beffd640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f43c00b2780 0x7f43c00b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:59554/0 (socket says 172.21.15.130:59554) 2023-09-13T06:02:20.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43beffd640 1 -- 172.21.15.130:0/1835590545 learned_addr learned my addr 172.21.15.130:0/1835590545 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:20.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43be7fc640 1 -- 172.21.15.130:0/1835590545 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909890621 0 0) 0x7f43c00b3120 con 0x7f43c00b2780 2023-09-13T06:02:20.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43bf7fe640 1 -- 172.21.15.130:0/1835590545 >> v2:172.21.15.164:3300/0 conn(0x7f43c00b1b70 msgr2=0x7f43c00b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:20.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43bf7fe640 1 --2- 172.21.15.130:0/1835590545 >> v2:172.21.15.164:3300/0 conn(0x7f43c00b1b70 0x7f43c00b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:20.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43bf7fe640 1 -- 172.21.15.130:0/1835590545 >> v1:172.21.15.164:6789/0 conn(0x7f43c00b2780 legacy=0x7f43c00b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:20.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43bf7fe640 1 -- 172.21.15.130:0/1835590545 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c00b2150 con 0x7f43c0144d70 2023-09-13T06:02:20.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.976+0000 7f43bffff640 1 --2- 172.21.15.130:0/1835590545 >> v2:172.21.15.164:3300/0 conn(0x7f43c00b1b70 0x7f43c00b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:20.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43bf7fe640 1 --2- 172.21.15.130:0/1835590545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43c0144d70 0x7f43c00ce870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097c0 tx=0x7f43b001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb7c2faa3e4cd44a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:20.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43be7fc640 1 -- 172.21.15.130:0/1835590545 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00ab600 con 0x7f43c0144d70 2023-09-13T06:02:20.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43be7fc640 1 -- 172.21.15.130:0/1835590545 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b00a7050 con 0x7f43c0144d70 2023-09-13T06:02:20.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43be7fc640 1 -- 172.21.15.130:0/1835590545 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00ab980 con 0x7f43c0144d70 2023-09-13T06:02:20.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43c5bac640 1 -- 172.21.15.130:0/1835590545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43c0144d70 msgr2=0x7f43c00ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:20.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43c5bac640 1 --2- 172.21.15.130:0/1835590545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43c0144d70 0x7f43c00ce870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097c0 tx=0x7f43b001c480 comp rx=0 tx=0).stop 2023-09-13T06:02:20.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43c5bac640 1 -- 172.21.15.130:0/1835590545 shutdown_connections 2023-09-13T06:02:20.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43c5bac640 1 --2- 172.21.15.130:0/1835590545 >> v2:172.21.15.164:3300/0 conn(0x7f43c00b1b70 0x7f43c00b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:20.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43c5bac640 1 --2- 172.21.15.130:0/1835590545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43c0144d70 0x7f43c00ce870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:20.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43c5bac640 1 -- 172.21.15.130:0/1835590545 >> 172.21.15.130:0/1835590545 conn(0x7f43c0065990 msgr2=0x7f43c0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:20.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43c5bac640 1 -- 172.21.15.130:0/1835590545 shutdown_connections 2023-09-13T06:02:20.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.980+0000 7f43c5bac640 1 -- 172.21.15.130:0/1835590545 wait complete. 2023-09-13T06:02:20.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43c5bac640 1 Processor -- start 2023-09-13T06:02:20.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43c5bac640 1 -- start start 2023-09-13T06:02:20.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43c5bac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43c00b1b70 0x7f43c015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:20.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43c5bac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43c00b2780 0x7f43c00cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:20.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43c5bac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c0144d70 0x7f43c0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:20.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43c5bac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c015ac90 con 0x7f43c0144d70 2023-09-13T06:02:20.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43c5bac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c0152900 con 0x7f43c00b1b70 2023-09-13T06:02:20.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43c5bac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c015a640 con 0x7f43c00b2780 2023-09-13T06:02:20.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43bffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c0144d70 0x7f43c0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:20.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43bffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c0144d70 0x7f43c0151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46260/0 (socket says 172.21.15.130:46260) 2023-09-13T06:02:20.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43bffff640 1 -- 172.21.15.130:0/2899129672 learned_addr learned my addr 172.21.15.130:0/2899129672 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:20.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43beffd640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43c00b2780 0x7f43c00cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:20.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43bf7fe640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43c00b1b70 0x7f43c015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:20.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43bffff640 1 -- 172.21.15.130:0/2899129672 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43c00b2780 msgr2=0x7f43c00cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:20.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43bffff640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43c00b2780 0x7f43c00cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:20.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43bffff640 1 -- 172.21.15.130:0/2899129672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43c00b1b70 msgr2=0x7f43c015b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:20.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43bffff640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43c00b1b70 0x7f43c015b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:20.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43bffff640 1 -- 172.21.15.130:0/2899129672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b8009a70 con 0x7f43c0144d70 2023-09-13T06:02:20.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43bffff640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c0144d70 0x7f43c0151eb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f43b800efc0 tx=0x7f43b8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:20.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43a7fff640 1 -- 172.21.15.130:0/2899129672 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8009d70 con 0x7f43c0144d70 2023-09-13T06:02:20.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43a7fff640 1 -- 172.21.15.130:0/2899129672 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b800f040 con 0x7f43c0144d70 2023-09-13T06:02:20.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43a7fff640 1 -- 172.21.15.130:0/2899129672 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b80039a0 con 0x7f43c0144d70 2023-09-13T06:02:20.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43c5bac640 1 -- 172.21.15.130:0/2899129672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b0009420 con 0x7f43c0144d70 2023-09-13T06:02:20.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43c5bac640 1 -- 172.21.15.130:0/2899129672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c0152be0 con 0x7f43c0144d70 2023-09-13T06:02:20.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.984+0000 7f43c5bac640 1 -- 172.21.15.130:0/2899129672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c015ae40 con 0x7f43c0144d70 2023-09-13T06:02:20.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.988+0000 7f43a7fff640 1 -- 172.21.15.130:0/2899129672 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f43b80144a0 con 0x7f43c0144d70 2023-09-13T06:02:20.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.988+0000 7f43a7fff640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43ac065b20 0x7f43ac067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:20.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.988+0000 7f43a7fff640 1 -- 172.21.15.130:0/2899129672 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43b8083e10 con 0x7f43c0144d70 2023-09-13T06:02:20.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.988+0000 7f43bf7fe640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43ac065b20 0x7f43ac067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:20.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.988+0000 7f43bf7fe640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43ac065b20 0x7f43ac067fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43b00ad000 tx=0x7f43b00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:20.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:20.992+0000 7f43a7fff640 1 -- 172.21.15.130:0/2899129672 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f43c015ae40 con 0x7f43c0144d70 2023-09-13T06:02:21.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.176+0000 7f43c5bac640 1 -- 172.21.15.130:0/2899129672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f43c015ae40 con 0x7f43c0144d70 2023-09-13T06:02:21.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.808+0000 7f43a7fff640 1 -- 172.21.15.130:0/2899129672 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f43c015ae40 con 0x7f43c0144d70 2023-09-13T06:02:21.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.808+0000 7f43c5bac640 1 -- 172.21.15.130:0/2899129672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43ac065b20 msgr2=0x7f43ac067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:21.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.808+0000 7f43c5bac640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43ac065b20 0x7f43ac067fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43b00ad000 tx=0x7f43b00a6000 comp rx=0 tx=0).stop 2023-09-13T06:02:21.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.808+0000 7f43c5bac640 1 -- 172.21.15.130:0/2899129672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c0144d70 msgr2=0x7f43c0151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:21.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.808+0000 7f43c5bac640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c0144d70 0x7f43c0151eb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f43b800efc0 tx=0x7f43b8009f90 comp rx=0 tx=0).stop 2023-09-13T06:02:21.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.808+0000 7f43c5bac640 1 -- 172.21.15.130:0/2899129672 shutdown_connections 2023-09-13T06:02:21.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.808+0000 7f43c5bac640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43ac065b20 0x7f43ac067fe0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:21.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.808+0000 7f43c5bac640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c0144d70 0x7f43c0151eb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:21.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.808+0000 7f43c5bac640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43c00b2780 0x7f43c00cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:21.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.812+0000 7f43c5bac640 1 --2- 172.21.15.130:0/2899129672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43c00b1b70 0x7f43c015b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:21.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.812+0000 7f43c5bac640 1 -- 172.21.15.130:0/2899129672 >> 172.21.15.130:0/2899129672 conn(0x7f43c0065990 msgr2=0x7f43c00aca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:21.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.812+0000 7f43c5bac640 1 -- 172.21.15.130:0/2899129672 shutdown_connections 2023-09-13T06:02:21.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.812+0000 7f43c5bac640 1 -- 172.21.15.130:0/2899129672 wait complete. 2023-09-13T06:02:21.837 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T06:02:21.838 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:21.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.972+0000 7fb2bcd2c640 1 Processor -- start 2023-09-13T06:02:21.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.972+0000 7fb2bcd2c640 1 -- start start 2023-09-13T06:02:21.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2bcd2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2b8070d60 0x7fb2b8160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:21.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2bcd2c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b806f640 con 0x7fb2b81436e0 2023-09-13T06:02:21.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2bcd2c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b806f890 con 0x7fb2b8146540 2023-09-13T06:02:21.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2bcd2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b806fb70 con 0x7fb2b8070d60 2023-09-13T06:02:21.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b659c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb2b81436e0 0x7fb2b80ac840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54466/0 (socket says 172.21.15.130:54466) 2023-09-13T06:02:21.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b659c640 1 -- 172.21.15.130:0/2315908783 learned_addr learned my addr 172.21.15.130:0/2315908783 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:21.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975993225 0 0) 0x7fb2b806f640 con 0x7fb2b81436e0 2023-09-13T06:02:21.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2a4003530 con 0x7fb2b81436e0 2023-09-13T06:02:21.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278043238 0 0) 0x7fb2b806f890 con 0x7fb2b8146540 2023-09-13T06:02:21.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b6d9d640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2b8070d60 0x7fb2b8160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:21.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2b806f640 con 0x7fb2b8146540 2023-09-13T06:02:21.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 104512310 0 0) 0x7fb2a4003530 con 0x7fb2b81436e0 2023-09-13T06:02:21.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2b8070d60 msgr2=0x7fb2b8160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:21.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2b8070d60 0x7fb2b8160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:21.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 >> v1:172.21.15.164:6789/0 conn(0x7fb2b8146540 legacy=0x7fb2b8070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:21.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b806fe50 con 0x7fb2b81436e0 2023-09-13T06:02:21.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fb2a8001680 con 0x7fb2b81436e0 2023-09-13T06:02:21.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 >> v1:172.21.15.130:6789/0 conn(0x7fb2b81436e0 legacy=0x7fb2b80ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:21.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a4003bb0 0x7fb2a4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:21.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2b8070d60 0x7fb2a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:21.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a4004e30 0x7fb2a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:21.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b806fb70 con 0x7fb2a4003bb0 2023-09-13T06:02:21.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40055f0 con 0x7fb2a4004e30 2023-09-13T06:02:21.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a400bed0 con 0x7fb2b8070d60 2023-09-13T06:02:21.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b659c640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a4003bb0 0x7fb2a4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:21.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2add9b640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2b8070d60 0x7fb2a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:21.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b6d9d640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a4004e30 0x7fb2a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:21.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b659c640 1 -- 172.21.15.130:0/2315908783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2b8070d60 msgr2=0x7fb2a40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:21.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b659c640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2b8070d60 0x7fb2a40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:21.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b659c640 1 -- 172.21.15.130:0/2315908783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a4004e30 msgr2=0x7fb2a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:21.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b659c640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a4004e30 0x7fb2a400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:21.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.976+0000 7fb2b659c640 1 -- 172.21.15.130:0/2315908783 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4003530 con 0x7fb2a4003bb0 2023-09-13T06:02:21.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.980+0000 7fb2b659c640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a4003bb0 0x7fb2a4003fb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8007fb0 tx=0x7fb2a801cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde789d9007c4e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:21.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.980+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8005ae0 con 0x7fb2a4003bb0 2023-09-13T06:02:21.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.980+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a8005c40 con 0x7fb2a4003bb0 2023-09-13T06:02:21.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.980+0000 7fb2b5d9b640 1 -- 172.21.15.130:0/2315908783 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8007070 con 0x7fb2a4003bb0 2023-09-13T06:02:21.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.980+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/2315908783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a4003bb0 msgr2=0x7fb2a4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:21.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.980+0000 7fb2bcd2c640 1 --2- 172.21.15.130:0/2315908783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a4003bb0 0x7fb2a4003fb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8007fb0 tx=0x7fb2a801cb20 comp rx=0 tx=0).stop 2023-09-13T06:02:21.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.980+0000 7fb2b6d9d640 1 -- 172.21.15.130:0/2315908783 reap_dead start 2023-09-13T06:02:21.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.980+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/2315908783 shutdown_connections 2023-09-13T06:02:21.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.980+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/2315908783 >> 172.21.15.130:0/2315908783 conn(0x7fb2b80b0bc0 msgr2=0x7fb2b80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:21.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.980+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/2315908783 shutdown_connections 2023-09-13T06:02:21.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.980+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/2315908783 wait complete. 2023-09-13T06:02:21.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2bcd2c640 1 Processor -- start 2023-09-13T06:02:21.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2bcd2c640 1 -- start start 2023-09-13T06:02:21.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2bcd2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2a4003bb0 0x7fb2b8135aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:21.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2bcd2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2b815fd50 0x7fb2b8145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:21.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2bcd2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2b8145680 0x7fb2b8138370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:21.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2bcd2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b81460d0 con 0x7fb2b8145680 2023-09-13T06:02:21.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2bcd2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8135fe0 con 0x7fb2b815fd50 2023-09-13T06:02:21.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2bcd2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b81347b0 con 0x7fb2a4003bb0 2023-09-13T06:02:21.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2b6d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2b8145680 0x7fb2b8138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:21.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2b6d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2b8145680 0x7fb2b8138370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46274/0 (socket says 172.21.15.130:46274) 2023-09-13T06:02:21.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2b6d9d640 1 -- 172.21.15.130:0/1281981313 learned_addr learned my addr 172.21.15.130:0/1281981313 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:21.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2add9b640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2b815fd50 0x7fb2b8145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:21.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2b659c640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2a4003bb0 0x7fb2b8135aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:21.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2b6d9d640 1 -- 172.21.15.130:0/1281981313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2a4003bb0 msgr2=0x7fb2b8135aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:21.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2b6d9d640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2a4003bb0 0x7fb2b8135aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:21.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2b6d9d640 1 -- 172.21.15.130:0/1281981313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2b815fd50 msgr2=0x7fb2b8145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:21.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2b6d9d640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2b815fd50 0x7fb2b8145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:21.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2b6d9d640 1 -- 172.21.15.130:0/1281981313 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b8134a00 con 0x7fb2b8145680 2023-09-13T06:02:21.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2b6d9d640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2b8145680 0x7fb2b8138370 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8146f90 tx=0x7fb2b0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:21.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2af7fe640 1 -- 172.21.15.130:0/1281981313 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00046a0 con 0x7fb2b8145680 2023-09-13T06:02:21.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2af7fe640 1 -- 172.21.15.130:0/1281981313 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b0004800 con 0x7fb2b8145680 2023-09-13T06:02:21.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2af7fe640 1 -- 172.21.15.130:0/1281981313 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0015640 con 0x7fb2b8145680 2023-09-13T06:02:21.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/1281981313 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b8134ce0 con 0x7fb2b8145680 2023-09-13T06:02:21.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/1281981313 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b81352a0 con 0x7fb2b8145680 2023-09-13T06:02:21.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.984+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/1281981313 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b80618a0 con 0x7fb2b8145680 2023-09-13T06:02:21.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.988+0000 7fb2af7fe640 1 -- 172.21.15.130:0/1281981313 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb2b00157a0 con 0x7fb2b8145680 2023-09-13T06:02:21.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.988+0000 7fb2af7fe640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb298065b50 0x7fb298068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:21.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.988+0000 7fb2af7fe640 1 -- 172.21.15.130:0/1281981313 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2b0083aa0 con 0x7fb2b8145680 2023-09-13T06:02:21.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.988+0000 7fb2b659c640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb298065b50 0x7fb298068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:21.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.988+0000 7fb2b659c640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb298065b50 0x7fb298068010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8007f80 tx=0x7fb2a80a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:21.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:21.992+0000 7fb2af7fe640 1 -- 172.21.15.130:0/1281981313 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb2b0051400 con 0x7fb2b8145680 2023-09-13T06:02:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.172+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/1281981313 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2b80aedd0 con 0x7fb2b8145680 2023-09-13T06:02:22.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.172+0000 7fb2af7fe640 1 -- 172.21.15.130:0/1281981313 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fb2b0054a20 con 0x7fb2b8145680 2023-09-13T06:02:22.178 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:22.178 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3600813785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3600813785},{"type":"v1","addr":"172.21.15.164:6834","nonce":3600813785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3946401321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3946401321},{"type":"v1","addr":"172.21.15.164:6835","nonce":3946401321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5097,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/746143804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":746143804},{"type":"v1","addr":"172.21.15.130:6835","nonce":746143804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:18.135350+0000","modified":"2023-09-13T06:02:21.179925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1879815978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1879815978},{"type":"v1","addr":"172.21.15.130:6837","nonce":1879815978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-13T06:02:22.179 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 16 2023-09-13T06:02:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/1281981313 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb298065b50 msgr2=0x7fb298068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb298065b50 0x7fb298068010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8007f80 tx=0x7fb2a80a7070 comp rx=0 tx=0).stop 2023-09-13T06:02:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/1281981313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2b8145680 msgr2=0x7fb2b8138370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2b8145680 0x7fb2b8138370 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8146f90 tx=0x7fb2b0007700 comp rx=0 tx=0).stop 2023-09-13T06:02:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/1281981313 shutdown_connections 2023-09-13T06:02:22.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb298065b50 0x7fb298068010 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2b815fd50 0x7fb2b8145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2b8145680 0x7fb2b8138370 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 --2- 172.21.15.130:0/1281981313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2a4003bb0 0x7fb2b8135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/1281981313 >> 172.21.15.130:0/1281981313 conn(0x7fb2b80b0bc0 msgr2=0x7fb2b813ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:22.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/1281981313 shutdown_connections 2023-09-13T06:02:22.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.176+0000 7fb2bcd2c640 1 -- 172.21.15.130:0/1281981313 wait complete. 2023-09-13T06:02:22.199 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:22.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.332+0000 7f15974ec640 1 Processor -- start 2023-09-13T06:02:22.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.332+0000 7f15974ec640 1 -- start start 2023-09-13T06:02:22.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.336+0000 7f15974ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f15900b2da0 0x7f159006f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:22.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.336+0000 7f15974ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159015d9e0 con 0x7f159006fc70 2023-09-13T06:02:22.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.336+0000 7f15974ec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159015dcc0 con 0x7f15900cf2a0 2023-09-13T06:02:22.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.336+0000 7f15974ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159015e660 con 0x7f15900b2da0 2023-09-13T06:02:22.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.336+0000 7f1595288640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f15900b2da0 0x7f159006f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:22.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.336+0000 7f1594a87640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f159006fc70 0x7f15900ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54474/0 (socket says 172.21.15.130:54474) 2023-09-13T06:02:22.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.336+0000 7f1594a87640 1 -- 172.21.15.130:0/554408563 learned_addr learned my addr 172.21.15.130:0/554408563 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:22.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.336+0000 7f1595288640 1 -- 172.21.15.130:0/554408563 >> v1:172.21.15.164:6789/0 conn(0x7f15900cf2a0 legacy=0x7f1590160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.336+0000 7f1595288640 1 -- 172.21.15.130:0/554408563 >> v1:172.21.15.130:6789/0 conn(0x7f159006fc70 legacy=0x7f15900ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.336+0000 7f1595288640 1 -- 172.21.15.130:0/554408563 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159015dfa0 con 0x7f15900b2da0 2023-09-13T06:02:22.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f1595288640 1 --2- 172.21.15.130:0/554408563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15900b2da0 0x7f159006f730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f158c0097c0 tx=0x7f158c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fc284f6b85a7f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:22.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f1587fff640 1 -- 172.21.15.130:0/554408563 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c0a8970 con 0x7f15900b2da0 2023-09-13T06:02:22.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f1587fff640 1 -- 172.21.15.130:0/554408563 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c0a8ad0 con 0x7f15900b2da0 2023-09-13T06:02:22.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f1587fff640 1 -- 172.21.15.130:0/554408563 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c0a8e60 con 0x7f15900b2da0 2023-09-13T06:02:22.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f15974ec640 1 -- 172.21.15.130:0/554408563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15900b2da0 msgr2=0x7f159006f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f15974ec640 1 --2- 172.21.15.130:0/554408563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15900b2da0 0x7f159006f730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f158c0097c0 tx=0x7f158c01ec70 comp rx=0 tx=0).stop 2023-09-13T06:02:22.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f15974ec640 1 -- 172.21.15.130:0/554408563 shutdown_connections 2023-09-13T06:02:22.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f15974ec640 1 --2- 172.21.15.130:0/554408563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15900b2da0 0x7f159006f730 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f15974ec640 1 -- 172.21.15.130:0/554408563 >> 172.21.15.130:0/554408563 conn(0x7f159006a2f0 msgr2=0x7f159006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:22.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f15974ec640 1 -- 172.21.15.130:0/554408563 shutdown_connections 2023-09-13T06:02:22.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f15974ec640 1 -- 172.21.15.130:0/554408563 wait complete. 2023-09-13T06:02:22.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f15974ec640 1 Processor -- start 2023-09-13T06:02:22.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.340+0000 7f15974ec640 1 -- start start 2023-09-13T06:02:22.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f15974ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f159006fc70 0x7f15900ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:22.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f15974ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15900b2da0 0x7f159013cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:22.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f15974ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15900cf2a0 0x7f15901454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:22.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f15974ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159013d250 con 0x7f15900cf2a0 2023-09-13T06:02:22.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f15974ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15900c92e0 con 0x7f159006fc70 2023-09-13T06:02:22.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f15974ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1590145d20 con 0x7f15900b2da0 2023-09-13T06:02:22.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1595a89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15900cf2a0 0x7f15901454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:22.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1595a89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15900cf2a0 0x7f15901454d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46284/0 (socket says 172.21.15.130:46284) 2023-09-13T06:02:22.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1595a89640 1 -- 172.21.15.130:0/108300159 learned_addr learned my addr 172.21.15.130:0/108300159 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:22.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1594a87640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15900b2da0 0x7f159013cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:22.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1595288640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f159006fc70 0x7f15900ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:22.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1595a89640 1 -- 172.21.15.130:0/108300159 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15900b2da0 msgr2=0x7f159013cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1595a89640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15900b2da0 0x7f159013cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1595a89640 1 -- 172.21.15.130:0/108300159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f159006fc70 msgr2=0x7f15900ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1595a89640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f159006fc70 0x7f15900ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1595a89640 1 -- 172.21.15.130:0/108300159 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c009420 con 0x7f15900cf2a0 2023-09-13T06:02:22.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1595a89640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15900cf2a0 0x7f15901454d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f158800c730 tx=0x7f158800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:22.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1585ffb640 1 -- 172.21.15.130:0/108300159 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588003b80 con 0x7f15900cf2a0 2023-09-13T06:02:22.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1585ffb640 1 -- 172.21.15.130:0/108300159 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1588003ce0 con 0x7f15900cf2a0 2023-09-13T06:02:22.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1585ffb640 1 -- 172.21.15.130:0/108300159 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800aa30 con 0x7f15900cf2a0 2023-09-13T06:02:22.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f15974ec640 1 -- 172.21.15.130:0/108300159 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1590146000 con 0x7f15900cf2a0 2023-09-13T06:02:22.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f15974ec640 1 -- 172.21.15.130:0/108300159 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1590145a10 con 0x7f15900cf2a0 2023-09-13T06:02:22.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f15974ec640 1 -- 172.21.15.130:0/108300159 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15900618a0 con 0x7f15900cf2a0 2023-09-13T06:02:22.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.344+0000 7f1585ffb640 1 -- 172.21.15.130:0/108300159 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f158800ab90 con 0x7f15900cf2a0 2023-09-13T06:02:22.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.348+0000 7f1585ffb640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1574065b20 0x7f1574067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:22.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.348+0000 7f1585ffb640 1 -- 172.21.15.130:0/108300159 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1588082f30 con 0x7f15900cf2a0 2023-09-13T06:02:22.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.348+0000 7f1595288640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1574065b20 0x7f1574067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:22.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.348+0000 7f1595288640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1574065b20 0x7f1574067fe0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f158c0b2000 tx=0x7f158c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:22.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.352+0000 7f1585ffb640 1 -- 172.21.15.130:0/108300159 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1588050930 con 0x7f15900cf2a0 2023-09-13T06:02:22.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.500+0000 7f15974ec640 1 -- 172.21.15.130:0/108300159 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15900c9720 con 0x7f15900cf2a0 2023-09-13T06:02:22.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.500+0000 7f1585ffb640 1 -- 172.21.15.130:0/108300159 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f1588053f50 con 0x7f15900cf2a0 2023-09-13T06:02:22.505 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:22.505 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":32,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:19.769937+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:15.867393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:17.140116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:22.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 -- 172.21.15.130:0/108300159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1574065b20 msgr2=0x7f1574067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1574065b20 0x7f1574067fe0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f158c0b2000 tx=0x7f158c008040 comp rx=0 tx=0).stop 2023-09-13T06:02:22.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 -- 172.21.15.130:0/108300159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15900cf2a0 msgr2=0x7f15901454d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15900cf2a0 0x7f15901454d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f158800c730 tx=0x7f158800cbf0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 -- 172.21.15.130:0/108300159 shutdown_connections 2023-09-13T06:02:22.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1574065b20 0x7f1574067fe0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15900cf2a0 0x7f15901454d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15900b2da0 0x7f159013cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 --2- 172.21.15.130:0/108300159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f159006fc70 0x7f15900ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 -- 172.21.15.130:0/108300159 >> 172.21.15.130:0/108300159 conn(0x7f159006a2f0 msgr2=0x7f15900c2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:22.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 -- 172.21.15.130:0/108300159 shutdown_connections 2023-09-13T06:02:22.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.504+0000 7f15974ec640 1 -- 172.21.15.130:0/108300159 wait complete. 2023-09-13T06:02:22.526 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T06:02:22.527 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:02:22.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f1525ad8640 1 Processor -- start 2023-09-13T06:02:22.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f1525ad8640 1 -- start start 2023-09-13T06:02:22.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f1525ad8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f15200d1750 0x7f152015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:22.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f1525ad8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f15200d1090 0x7f1520146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:22.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f1525ad8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15200b63c0 con 0x7f15200d1b30 2023-09-13T06:02:22.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f1525ad8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152015dea0 con 0x7f15200d1750 2023-09-13T06:02:22.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f1525ad8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15200d0c20 con 0x7f15200d1090 2023-09-13T06:02:22.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f151f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f15200d1750 0x7f152015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:22.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f151f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f15200d1750 0x7f152015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46296/0 (socket says 172.21.15.130:46296) 2023-09-13T06:02:22.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f151ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f15200d1b30 0x7f15200b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54488/0 (socket says 172.21.15.130:54488) 2023-09-13T06:02:22.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f151f7fe640 1 -- 172.21.15.130:0/2747153793 learned_addr learned my addr 172.21.15.130:0/2747153793 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:22.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f151effd640 1 --2- 172.21.15.130:0/2747153793 >> v2:172.21.15.164:3300/0 conn(0x7f15200d1090 0x7f1520146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:22.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f151f7fe640 1 -- 172.21.15.130:0/2747153793 >> v2:172.21.15.164:3300/0 conn(0x7f15200d1090 msgr2=0x7f1520146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:22.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f151f7fe640 1 --2- 172.21.15.130:0/2747153793 >> v2:172.21.15.164:3300/0 conn(0x7f15200d1090 0x7f1520146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f151f7fe640 1 -- 172.21.15.130:0/2747153793 >> v1:172.21.15.130:6789/0 conn(0x7f15200d1b30 legacy=0x7f15200b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.664+0000 7f151f7fe640 1 -- 172.21.15.130:0/2747153793 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15200b6610 con 0x7f15200d1750 2023-09-13T06:02:22.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f151f7fe640 1 --2- 172.21.15.130:0/2747153793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15200d1750 0x7f152015d960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f15200c8360 tx=0x7f151001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bf011128c256cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:22.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f151e7fc640 1 -- 172.21.15.130:0/2747153793 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15100aa430 con 0x7f15200d1750 2023-09-13T06:02:22.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f151e7fc640 1 -- 172.21.15.130:0/2747153793 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15100aa590 con 0x7f15200d1750 2023-09-13T06:02:22.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f151e7fc640 1 -- 172.21.15.130:0/2747153793 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15100aa920 con 0x7f15200d1750 2023-09-13T06:02:22.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f1525ad8640 1 -- 172.21.15.130:0/2747153793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15200d1750 msgr2=0x7f152015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f1525ad8640 1 --2- 172.21.15.130:0/2747153793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15200d1750 0x7f152015d960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f15200c8360 tx=0x7f151001c4d0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f1525ad8640 1 -- 172.21.15.130:0/2747153793 shutdown_connections 2023-09-13T06:02:22.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f1525ad8640 1 --2- 172.21.15.130:0/2747153793 >> v2:172.21.15.164:3300/0 conn(0x7f15200d1090 0x7f1520146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f1525ad8640 1 --2- 172.21.15.130:0/2747153793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15200d1750 0x7f152015d960 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f1525ad8640 1 -- 172.21.15.130:0/2747153793 >> 172.21.15.130:0/2747153793 conn(0x7f152006f170 msgr2=0x7f152006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:22.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f1525ad8640 1 -- 172.21.15.130:0/2747153793 shutdown_connections 2023-09-13T06:02:22.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.668+0000 7f1525ad8640 1 -- 172.21.15.130:0/2747153793 wait complete. 2023-09-13T06:02:22.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1525ad8640 1 Processor -- start 2023-09-13T06:02:22.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1525ad8640 1 -- start start 2023-09-13T06:02:22.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1525ad8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15200d1090 0x7f15201fa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:22.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1525ad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15200d1750 0x7f152015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:22.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1525ad8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15200d1b30 0x7f15200b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:22.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1525ad8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15201fa700 con 0x7f15200d1b30 2023-09-13T06:02:22.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1525ad8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1520139980 con 0x7f15200d1090 2023-09-13T06:02:22.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1525ad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152013bab0 con 0x7f15200d1750 2023-09-13T06:02:22.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15200d1b30 0x7f15200b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:22.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15200d1b30 0x7f15200b7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46308/0 (socket says 172.21.15.130:46308) 2023-09-13T06:02:22.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151ffff640 1 -- 172.21.15.130:0/1314811149 learned_addr learned my addr 172.21.15.130:0/1314811149 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:22.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151f7fe640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15200d1090 0x7f15201fa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:22.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151effd640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15200d1750 0x7f152015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:22.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151ffff640 1 -- 172.21.15.130:0/1314811149 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15200d1750 msgr2=0x7f152015aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151ffff640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15200d1750 0x7f152015aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151ffff640 1 -- 172.21.15.130:0/1314811149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15200d1090 msgr2=0x7f15201fa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151ffff640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15200d1090 0x7f15201fa1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151ffff640 1 -- 172.21.15.130:0/1314811149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15100094d0 con 0x7f15200d1b30 2023-09-13T06:02:22.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151f7fe640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15200d1090 0x7f15201fa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:22.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151effd640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15200d1750 0x7f152015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:22.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f151ffff640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15200d1b30 0x7f15200b7890 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f151800c7d0 tx=0x7f151800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:22.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1507fff640 1 -- 172.21.15.130:0/1314811149 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800a640 con 0x7f15200d1b30 2023-09-13T06:02:22.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1507fff640 1 -- 172.21.15.130:0/1314811149 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151800a7a0 con 0x7f15200d1b30 2023-09-13T06:02:22.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1507fff640 1 -- 172.21.15.130:0/1314811149 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800ab10 con 0x7f15200d1b30 2023-09-13T06:02:22.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1525ad8640 1 -- 172.21.15.130:0/1314811149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152013c350 con 0x7f15200d1b30 2023-09-13T06:02:22.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.672+0000 7f1525ad8640 1 -- 172.21.15.130:0/1314811149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152013bd00 con 0x7f15200d1b30 2023-09-13T06:02:22.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.676+0000 7f1525ad8640 1 -- 172.21.15.130:0/1314811149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152013c4e0 con 0x7f15200d1b30 2023-09-13T06:02:22.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.676+0000 7f1507fff640 1 -- 172.21.15.130:0/1314811149 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f151800ac70 con 0x7f15200d1b30 2023-09-13T06:02:22.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.676+0000 7f1507fff640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f150c065b50 0x7f150c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:22.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.676+0000 7f1507fff640 1 -- 172.21.15.130:0/1314811149 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1518082a90 con 0x7f15200d1b30 2023-09-13T06:02:22.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.676+0000 7f151f7fe640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f150c065b50 0x7f150c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:22.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.676+0000 7f151f7fe640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f150c065b50 0x7f150c068010 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f15100ae000 tx=0x7f15100a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:22.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.680+0000 7f1507fff640 1 -- 172.21.15.130:0/1314811149 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1518050480 con 0x7f15200d1b30 2023-09-13T06:02:22.735 INFO:tasks.ceph.mds.c.smithi130.stderr:2023-09-13T06:02:22.732+0000 7f9033f2d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:02:22.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.828+0000 7f1525ad8640 1 -- 172.21.15.130:0/1314811149 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1520147170 con 0x7f150c065b50 2023-09-13T06:02:22.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.836+0000 7f1507fff640 1 -- 172.21.15.130:0/1314811149 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279890 (secure 0 0 0) 0x7f15100aa960 con 0x7f150c065b50 2023-09-13T06:02:22.843 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:22.845 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:02:22.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 -- 172.21.15.130:0/1314811149 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f150c065b50 msgr2=0x7f150c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f150c065b50 0x7f150c068010 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f15100ae000 tx=0x7f15100a7000 comp rx=0 tx=0).stop 2023-09-13T06:02:22.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 -- 172.21.15.130:0/1314811149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15200d1b30 msgr2=0x7f15200b7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:22.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15200d1b30 0x7f15200b7890 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f151800c7d0 tx=0x7f151800cc90 comp rx=0 tx=0).stop 2023-09-13T06:02:22.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 -- 172.21.15.130:0/1314811149 shutdown_connections 2023-09-13T06:02:22.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f150c065b50 0x7f150c068010 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15200d1b30 0x7f15200b7890 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15200d1750 0x7f152015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 --2- 172.21.15.130:0/1314811149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15200d1090 0x7f15201fa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:22.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 -- 172.21.15.130:0/1314811149 >> 172.21.15.130:0/1314811149 conn(0x7f152006f170 msgr2=0x7f152015f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:22.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 -- 172.21.15.130:0/1314811149 shutdown_connections 2023-09-13T06:02:22.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:22.840+0000 7f1525ad8640 1 -- 172.21.15.130:0/1314811149 wait complete. 2023-09-13T06:02:22.863 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-09-13T06:02:22.547281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560372,"statfs":{"total":1600000000,"available":1597821323,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.798032"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.759190+0000","last_change":"2023-09-13T06:02:17.759190+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.759190+0000","last_undegraded":"2023-09-13T06:02:17.759190+0000","last_fullsized":"2023-09-13T06:02:17.759190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763540+0000","last_change":"2023-09-13T06:02:17.763540+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763540+0000","last_undegraded":"2023-09-13T06:02:17.763540+0000","last_fullsized":"2023-09-13T06:02:17.763540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753181+0000","last_change":"2023-09-13T06:02:17.753181+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753181+0000","last_undegraded":"2023-09-13T06:02:17.753181+0000","last_fullsized":"2023-09-13T06:02:17.753181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762726+0000","last_change":"2023-09-13T06:02:17.762726+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762726+0000","last_undegraded":"2023-09-13T06:02:17.762726+0000","last_fullsized":"2023-09-13T06:02:17.762726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753181+0000","last_change":"2023-09-13T06:02:17.753181+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753181+0000","last_undegraded":"2023-09-13T06:02:17.753181+0000","last_fullsized":"2023-09-13T06:02:17.753181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763304+0000","last_change":"2023-09-13T06:02:17.763304+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763304+0000","last_undegraded":"2023-09-13T06:02:17.763304+0000","last_fullsized":"2023-09-13T06:02:17.763304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754030+0000","last_change":"2023-09-13T06:02:17.754030+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754030+0000","last_undegraded":"2023-09-13T06:02:17.754030+0000","last_fullsized":"2023-09-13T06:02:17.754030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.756115+0000","last_change":"2023-09-13T06:02:17.756115+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.756115+0000","last_undegraded":"2023-09-13T06:02:17.756115+0000","last_fullsized":"2023-09-13T06:02:17.756115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762849+0000","last_change":"2023-09-13T06:02:17.762849+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762849+0000","last_undegraded":"2023-09-13T06:02:17.762849+0000","last_fullsized":"2023-09-13T06:02:17.762849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763164+0000","last_change":"2023-09-13T06:02:17.763164+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763164+0000","last_undegraded":"2023-09-13T06:02:17.763164+0000","last_fullsized":"2023-09-13T06:02:17.763164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754028+0000","last_change":"2023-09-13T06:02:17.754028+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754028+0000","last_undegraded":"2023-09-13T06:02:17.754028+0000","last_fullsized":"2023-09-13T06:02:17.754028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.755004+0000","last_change":"2023-09-13T06:02:17.755004+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.755004+0000","last_undegraded":"2023-09-13T06:02:17.755004+0000","last_fullsized":"2023-09-13T06:02:17.755004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752513+0000","last_change":"2023-09-13T06:02:17.752513+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752513+0000","last_undegraded":"2023-09-13T06:02:17.752513+0000","last_fullsized":"2023-09-13T06:02:17.752513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.764449+0000","last_change":"2023-09-13T06:02:17.764449+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.764449+0000","last_undegraded":"2023-09-13T06:02:17.764449+0000","last_fullsized":"2023-09-13T06:02:17.764449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752472+0000","last_change":"2023-09-13T06:02:17.752472+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752472+0000","last_undegraded":"2023-09-13T06:02:17.752472+0000","last_fullsized":"2023-09-13T06:02:17.752472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753663+0000","last_change":"2023-09-13T06:02:17.753663+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753663+0000","last_undegraded":"2023-09-13T06:02:17.753663+0000","last_fullsized":"2023-09-13T06:02:17.753663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753759+0000","last_change":"2023-09-13T06:02:17.753759+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753759+0000","last_undegraded":"2023-09-13T06:02:17.753759+0000","last_fullsized":"2023-09-13T06:02:17.753759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762486+0000","last_change":"2023-09-13T06:02:17.762486+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762486+0000","last_undegraded":"2023-09-13T06:02:17.762486+0000","last_fullsized":"2023-09-13T06:02:17.762486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.764146+0000","last_change":"2023-09-13T06:02:17.764146+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.764146+0000","last_undegraded":"2023-09-13T06:02:17.764146+0000","last_fullsized":"2023-09-13T06:02:17.764146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752466+0000","last_change":"2023-09-13T06:02:17.752466+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752466+0000","last_undegraded":"2023-09-13T06:02:17.752466+0000","last_fullsized":"2023-09-13T06:02:17.752466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762542+0000","last_change":"2023-09-13T06:02:17.762542+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762542+0000","last_undegraded":"2023-09-13T06:02:17.762542+0000","last_fullsized":"2023-09-13T06:02:17.762542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762008+0000","last_change":"2023-09-13T06:02:17.762008+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762008+0000","last_undegraded":"2023-09-13T06:02:17.762008+0000","last_fullsized":"2023-09-13T06:02:17.762008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762227+0000","last_change":"2023-09-13T06:02:17.762227+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762227+0000","last_undegraded":"2023-09-13T06:02:17.762227+0000","last_fullsized":"2023-09-13T06:02:17.762227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753330+0000","last_change":"2023-09-13T06:02:17.753330+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753330+0000","last_undegraded":"2023-09-13T06:02:17.753330+0000","last_fullsized":"2023-09-13T06:02:17.753330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762825+0000","last_change":"2023-09-13T06:02:17.762825+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762825+0000","last_undegraded":"2023-09-13T06:02:17.762825+0000","last_fullsized":"2023-09-13T06:02:17.762825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762962+0000","last_change":"2023-09-13T06:02:17.762962+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762962+0000","last_undegraded":"2023-09-13T06:02:17.762962+0000","last_fullsized":"2023-09-13T06:02:17.762962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762687+0000","last_change":"2023-09-13T06:02:17.762687+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762687+0000","last_undegraded":"2023-09-13T06:02:17.762687+0000","last_fullsized":"2023-09-13T06:02:17.762687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753851+0000","last_change":"2023-09-13T06:02:17.753851+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753851+0000","last_undegraded":"2023-09-13T06:02:17.753851+0000","last_fullsized":"2023-09-13T06:02:17.753851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762453+0000","last_change":"2023-09-13T06:02:17.762453+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762453+0000","last_undegraded":"2023-09-13T06:02:17.762453+0000","last_fullsized":"2023-09-13T06:02:17.762453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753307+0000","last_change":"2023-09-13T06:02:17.753307+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753307+0000","last_undegraded":"2023-09-13T06:02:17.753307+0000","last_fullsized":"2023-09-13T06:02:17.753307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758841+0000","last_change":"2023-09-13T06:02:17.758841+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758841+0000","last_undegraded":"2023-09-13T06:02:17.758841+0000","last_fullsized":"2023-09-13T06:02:17.758841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753310+0000","last_change":"2023-09-13T06:02:17.753310+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753310+0000","last_undegraded":"2023-09-13T06:02:17.753310+0000","last_fullsized":"2023-09-13T06:02:17.753310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762978+0000","last_change":"2023-09-13T06:02:17.762978+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762978+0000","last_undegraded":"2023-09-13T06:02:17.762978+0000","last_fullsized":"2023-09-13T06:02:17.762978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.764037+0000","last_change":"2023-09-13T06:02:17.762285+0000","last_active":"2023-09-13T06:02:17.764037+0000","last_peered":"2023-09-13T06:02:17.764037+0000","last_clean":"2023-09-13T06:02:17.764037+0000","last_became_active":"2023-09-13T06:02:17.762063+0000","last_became_peered":"2023-09-13T06:02:17.762063+0000","last_unstale":"2023-09-13T06:02:17.764037+0000","last_undegraded":"2023-09-13T06:02:17.764037+0000","last_fullsized":"2023-09-13T06:02:17.764037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:39:04.037652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.759621+0000","last_change":"2023-09-13T06:02:17.759621+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.759621+0000","last_undegraded":"2023-09-13T06:02:17.759621+0000","last_fullsized":"2023-09-13T06:02:17.759621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.761090+0000","last_change":"2023-09-13T06:02:17.761021+0000","last_active":"2023-09-13T06:02:17.761090+0000","last_peered":"2023-09-13T06:02:17.761090+0000","last_clean":"2023-09-13T06:02:17.761090+0000","last_became_active":"2023-09-13T06:02:17.760790+0000","last_became_peered":"2023-09-13T06:02:17.760790+0000","last_unstale":"2023-09-13T06:02:17.761090+0000","last_undegraded":"2023-09-13T06:02:17.761090+0000","last_fullsized":"2023-09-13T06:02:17.761090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:39:04.037652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.761926+0000","last_change":"2023-09-13T06:02:17.761926+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.761926+0000","last_undegraded":"2023-09-13T06:02:17.761926+0000","last_fullsized":"2023-09-13T06:02:17.761926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757327+0000","last_change":"2023-09-13T06:02:17.757092+0000","last_active":"2023-09-13T06:02:17.757327+0000","last_peered":"2023-09-13T06:02:17.757327+0000","last_clean":"2023-09-13T06:02:17.757327+0000","last_became_active":"2023-09-13T06:02:17.756854+0000","last_became_peered":"2023-09-13T06:02:17.756854+0000","last_unstale":"2023-09-13T06:02:17.757327+0000","last_undegraded":"2023-09-13T06:02:17.757327+0000","last_fullsized":"2023-09-13T06:02:17.757327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:52.822633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762517+0000","last_change":"2023-09-13T06:02:17.762517+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762517+0000","last_undegraded":"2023-09-13T06:02:17.762517+0000","last_fullsized":"2023-09-13T06:02:17.762517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.759395+0000","last_change":"2023-09-13T06:02:17.758909+0000","last_active":"2023-09-13T06:02:17.759395+0000","last_peered":"2023-09-13T06:02:17.759395+0000","last_clean":"2023-09-13T06:02:17.759395+0000","last_became_active":"2023-09-13T06:02:17.758503+0000","last_became_peered":"2023-09-13T06:02:17.758503+0000","last_unstale":"2023-09-13T06:02:17.759395+0000","last_undegraded":"2023-09-13T06:02:17.759395+0000","last_fullsized":"2023-09-13T06:02:17.759395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:48.120438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.755778+0000","last_change":"2023-09-13T06:02:17.755778+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.755778+0000","last_undegraded":"2023-09-13T06:02:17.755778+0000","last_fullsized":"2023-09-13T06:02:17.755778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760136+0000","last_change":"2023-09-13T06:02:17.760031+0000","last_active":"2023-09-13T06:02:17.760136+0000","last_peered":"2023-09-13T06:02:17.760136+0000","last_clean":"2023-09-13T06:02:17.760136+0000","last_became_active":"2023-09-13T06:02:17.759461+0000","last_became_peered":"2023-09-13T06:02:17.759461+0000","last_unstale":"2023-09-13T06:02:17.760136+0000","last_undegraded":"2023-09-13T06:02:17.760136+0000","last_fullsized":"2023-09-13T06:02:17.760136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:46:36.044318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754695+0000","last_change":"2023-09-13T06:02:17.754695+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754695+0000","last_undegraded":"2023-09-13T06:02:17.754695+0000","last_fullsized":"2023-09-13T06:02:17.754695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757236+0000","last_change":"2023-09-13T06:02:17.757157+0000","last_active":"2023-09-13T06:02:17.757236+0000","last_peered":"2023-09-13T06:02:17.757236+0000","last_clean":"2023-09-13T06:02:17.757236+0000","last_became_active":"2023-09-13T06:02:17.756751+0000","last_became_peered":"2023-09-13T06:02:17.756751+0000","last_unstale":"2023-09-13T06:02:17.757236+0000","last_undegraded":"2023-09-13T06:02:17.757236+0000","last_fullsized":"2023-09-13T06:02:17.757236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:03:55.320781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763080+0000","last_change":"2023-09-13T06:02:17.763080+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763080+0000","last_undegraded":"2023-09-13T06:02:17.763080+0000","last_fullsized":"2023-09-13T06:02:17.763080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.756148+0000","last_change":"2023-09-13T06:02:17.756021+0000","last_active":"2023-09-13T06:02:17.756148+0000","last_peered":"2023-09-13T06:02:17.756148+0000","last_clean":"2023-09-13T06:02:17.756148+0000","last_became_active":"2023-09-13T06:02:17.755754+0000","last_became_peered":"2023-09-13T06:02:17.755754+0000","last_unstale":"2023-09-13T06:02:17.756148+0000","last_undegraded":"2023-09-13T06:02:17.756148+0000","last_fullsized":"2023-09-13T06:02:17.756148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:49.936804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762416+0000","last_change":"2023-09-13T06:02:17.762416+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762416+0000","last_undegraded":"2023-09-13T06:02:17.762416+0000","last_fullsized":"2023-09-13T06:02:17.762416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765712+0000","last_change":"2023-09-13T06:02:17.765596+0000","last_active":"2023-09-13T06:02:17.765712+0000","last_peered":"2023-09-13T06:02:17.765712+0000","last_clean":"2023-09-13T06:02:17.765712+0000","last_became_active":"2023-09-13T06:02:17.764626+0000","last_became_peered":"2023-09-13T06:02:17.764626+0000","last_unstale":"2023-09-13T06:02:17.765712+0000","last_undegraded":"2023-09-13T06:02:17.765712+0000","last_fullsized":"2023-09-13T06:02:17.765712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:18:57.717040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754042+0000","last_change":"2023-09-13T06:02:17.754042+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754042+0000","last_undegraded":"2023-09-13T06:02:17.754042+0000","last_fullsized":"2023-09-13T06:02:17.754042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760403+0000","last_change":"2023-09-13T06:02:17.760344+0000","last_active":"2023-09-13T06:02:17.760403+0000","last_peered":"2023-09-13T06:02:17.760403+0000","last_clean":"2023-09-13T06:02:17.760403+0000","last_became_active":"2023-09-13T06:02:17.760112+0000","last_became_peered":"2023-09-13T06:02:17.760112+0000","last_unstale":"2023-09-13T06:02:17.760403+0000","last_undegraded":"2023-09-13T06:02:17.760403+0000","last_fullsized":"2023-09-13T06:02:17.760403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:35:44.141658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762674+0000","last_change":"2023-09-13T06:02:17.762674+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762674+0000","last_undegraded":"2023-09-13T06:02:17.762674+0000","last_fullsized":"2023-09-13T06:02:17.762674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757398+0000","last_change":"2023-09-13T06:02:17.757230+0000","last_active":"2023-09-13T06:02:17.757398+0000","last_peered":"2023-09-13T06:02:17.757398+0000","last_clean":"2023-09-13T06:02:17.757398+0000","last_became_active":"2023-09-13T06:02:17.756995+0000","last_became_peered":"2023-09-13T06:02:17.756995+0000","last_unstale":"2023-09-13T06:02:17.757398+0000","last_undegraded":"2023-09-13T06:02:17.757398+0000","last_fullsized":"2023-09-13T06:02:17.757398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763849+0000","last_change":"2023-09-13T06:02:17.763849+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763849+0000","last_undegraded":"2023-09-13T06:02:17.763849+0000","last_fullsized":"2023-09-13T06:02:17.763849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760875+0000","last_change":"2023-09-13T06:02:17.760513+0000","last_active":"2023-09-13T06:02:17.760875+0000","last_peered":"2023-09-13T06:02:17.760875+0000","last_clean":"2023-09-13T06:02:17.760875+0000","last_became_active":"2023-09-13T06:02:17.759698+0000","last_became_peered":"2023-09-13T06:02:17.759698+0000","last_unstale":"2023-09-13T06:02:17.760875+0000","last_undegraded":"2023-09-13T06:02:17.760875+0000","last_fullsized":"2023-09-13T06:02:17.760875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:36:09.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753498+0000","last_change":"2023-09-13T06:02:17.753498+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753498+0000","last_undegraded":"2023-09-13T06:02:17.753498+0000","last_fullsized":"2023-09-13T06:02:17.753498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758829+0000","last_change":"2023-09-13T06:02:17.758625+0000","last_active":"2023-09-13T06:02:17.758829+0000","last_peered":"2023-09-13T06:02:17.758829+0000","last_clean":"2023-09-13T06:02:17.758829+0000","last_became_active":"2023-09-13T06:02:17.757273+0000","last_became_peered":"2023-09-13T06:02:17.757273+0000","last_unstale":"2023-09-13T06:02:17.758829+0000","last_undegraded":"2023-09-13T06:02:17.758829+0000","last_fullsized":"2023-09-13T06:02:17.758829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:06.883601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763737+0000","last_change":"2023-09-13T06:02:17.763737+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763737+0000","last_undegraded":"2023-09-13T06:02:17.763737+0000","last_fullsized":"2023-09-13T06:02:17.763737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765479+0000","last_change":"2023-09-13T06:02:17.765217+0000","last_active":"2023-09-13T06:02:17.765479+0000","last_peered":"2023-09-13T06:02:17.765479+0000","last_clean":"2023-09-13T06:02:17.765479+0000","last_became_active":"2023-09-13T06:02:17.764324+0000","last_became_peered":"2023-09-13T06:02:17.764324+0000","last_unstale":"2023-09-13T06:02:17.765479+0000","last_undegraded":"2023-09-13T06:02:17.765479+0000","last_fullsized":"2023-09-13T06:02:17.765479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:13:15.204110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762341+0000","last_change":"2023-09-13T06:02:17.762341+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762341+0000","last_undegraded":"2023-09-13T06:02:17.762341+0000","last_fullsized":"2023-09-13T06:02:17.762341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.764568+0000","last_change":"2023-09-13T06:02:17.763991+0000","last_active":"2023-09-13T06:02:17.764568+0000","last_peered":"2023-09-13T06:02:17.764568+0000","last_clean":"2023-09-13T06:02:17.764568+0000","last_became_active":"2023-09-13T06:02:17.762961+0000","last_became_peered":"2023-09-13T06:02:17.762961+0000","last_unstale":"2023-09-13T06:02:17.764568+0000","last_undegraded":"2023-09-13T06:02:17.764568+0000","last_fullsized":"2023-09-13T06:02:17.764568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753319+0000","last_change":"2023-09-13T06:02:17.753319+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753319+0000","last_undegraded":"2023-09-13T06:02:17.753319+0000","last_fullsized":"2023-09-13T06:02:17.753319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760385+0000","last_change":"2023-09-13T06:02:17.760312+0000","last_active":"2023-09-13T06:02:17.760385+0000","last_peered":"2023-09-13T06:02:17.760385+0000","last_clean":"2023-09-13T06:02:17.760385+0000","last_became_active":"2023-09-13T06:02:17.760047+0000","last_became_peered":"2023-09-13T06:02:17.760047+0000","last_unstale":"2023-09-13T06:02:17.760385+0000","last_undegraded":"2023-09-13T06:02:17.760385+0000","last_fullsized":"2023-09-13T06:02:17.760385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758771+0000","last_change":"2023-09-13T06:02:17.758771+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758771+0000","last_undegraded":"2023-09-13T06:02:17.758771+0000","last_fullsized":"2023-09-13T06:02:17.758771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757360+0000","last_change":"2023-09-13T06:02:17.757243+0000","last_active":"2023-09-13T06:02:17.757360+0000","last_peered":"2023-09-13T06:02:17.757360+0000","last_clean":"2023-09-13T06:02:17.757360+0000","last_became_active":"2023-09-13T06:02:17.757000+0000","last_became_peered":"2023-09-13T06:02:17.757000+0000","last_unstale":"2023-09-13T06:02:17.757360+0000","last_undegraded":"2023-09-13T06:02:17.757360+0000","last_fullsized":"2023-09-13T06:02:17.757360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:40.428906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762681+0000","last_change":"2023-09-13T06:02:17.762681+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762681+0000","last_undegraded":"2023-09-13T06:02:17.762681+0000","last_fullsized":"2023-09-13T06:02:17.762681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760270+0000","last_change":"2023-09-13T06:02:17.759850+0000","last_active":"2023-09-13T06:02:17.760270+0000","last_peered":"2023-09-13T06:02:17.760270+0000","last_clean":"2023-09-13T06:02:17.760270+0000","last_became_active":"2023-09-13T06:02:17.759571+0000","last_became_peered":"2023-09-13T06:02:17.759571+0000","last_unstale":"2023-09-13T06:02:17.760270+0000","last_undegraded":"2023-09-13T06:02:17.760270+0000","last_fullsized":"2023-09-13T06:02:17.760270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752931+0000","last_change":"2023-09-13T06:02:17.752931+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752931+0000","last_undegraded":"2023-09-13T06:02:17.752931+0000","last_fullsized":"2023-09-13T06:02:17.752931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762227+0000","last_change":"2023-09-13T06:02:17.761635+0000","last_active":"2023-09-13T06:02:17.762227+0000","last_peered":"2023-09-13T06:02:17.762227+0000","last_clean":"2023-09-13T06:02:17.762227+0000","last_became_active":"2023-09-13T06:02:17.761041+0000","last_became_peered":"2023-09-13T06:02:17.761041+0000","last_unstale":"2023-09-13T06:02:17.762227+0000","last_undegraded":"2023-09-13T06:02:17.762227+0000","last_fullsized":"2023-09-13T06:02:17.762227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:49:26.757377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762311+0000","last_change":"2023-09-13T06:02:17.762311+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762311+0000","last_undegraded":"2023-09-13T06:02:17.762311+0000","last_fullsized":"2023-09-13T06:02:17.762311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760931+0000","last_change":"2023-09-13T06:02:17.760800+0000","last_active":"2023-09-13T06:02:17.760931+0000","last_peered":"2023-09-13T06:02:17.760931+0000","last_clean":"2023-09-13T06:02:17.760931+0000","last_became_active":"2023-09-13T06:02:17.760585+0000","last_became_peered":"2023-09-13T06:02:17.760585+0000","last_unstale":"2023-09-13T06:02:17.760931+0000","last_undegraded":"2023-09-13T06:02:17.760931+0000","last_fullsized":"2023-09-13T06:02:17.760931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:48.120438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752434+0000","last_change":"2023-09-13T06:02:17.752434+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752434+0000","last_undegraded":"2023-09-13T06:02:17.752434+0000","last_fullsized":"2023-09-13T06:02:17.752434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760363+0000","last_change":"2023-09-13T06:02:17.760200+0000","last_active":"2023-09-13T06:02:17.760363+0000","last_peered":"2023-09-13T06:02:17.760363+0000","last_clean":"2023-09-13T06:02:17.760363+0000","last_became_active":"2023-09-13T06:02:17.759800+0000","last_became_peered":"2023-09-13T06:02:17.759800+0000","last_unstale":"2023-09-13T06:02:17.760363+0000","last_undegraded":"2023-09-13T06:02:17.760363+0000","last_fullsized":"2023-09-13T06:02:17.760363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:53:23.415803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.751719+0000","last_change":"2023-09-13T06:02:17.751719+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.751719+0000","last_undegraded":"2023-09-13T06:02:17.751719+0000","last_fullsized":"2023-09-13T06:02:17.751719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757379+0000","last_change":"2023-09-13T06:02:17.757106+0000","last_active":"2023-09-13T06:02:17.757379+0000","last_peered":"2023-09-13T06:02:17.757379+0000","last_clean":"2023-09-13T06:02:17.757379+0000","last_became_active":"2023-09-13T06:02:17.756876+0000","last_became_peered":"2023-09-13T06:02:17.756876+0000","last_unstale":"2023-09-13T06:02:17.757379+0000","last_undegraded":"2023-09-13T06:02:17.757379+0000","last_fullsized":"2023-09-13T06:02:17.757379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752081+0000","last_change":"2023-09-13T06:02:17.752081+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752081+0000","last_undegraded":"2023-09-13T06:02:17.752081+0000","last_fullsized":"2023-09-13T06:02:17.752081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765089+0000","last_change":"2023-09-13T06:02:17.764974+0000","last_active":"2023-09-13T06:02:17.765089+0000","last_peered":"2023-09-13T06:02:17.765089+0000","last_clean":"2023-09-13T06:02:17.765089+0000","last_became_active":"2023-09-13T06:02:17.764364+0000","last_became_peered":"2023-09-13T06:02:17.764364+0000","last_unstale":"2023-09-13T06:02:17.765089+0000","last_undegraded":"2023-09-13T06:02:17.765089+0000","last_fullsized":"2023-09-13T06:02:17.765089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:37:09.637327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752086+0000","last_change":"2023-09-13T06:02:17.752086+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752086+0000","last_undegraded":"2023-09-13T06:02:17.752086+0000","last_fullsized":"2023-09-13T06:02:17.752086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762247+0000","last_change":"2023-09-13T06:02:17.761800+0000","last_active":"2023-09-13T06:02:17.762247+0000","last_peered":"2023-09-13T06:02:17.762247+0000","last_clean":"2023-09-13T06:02:17.762247+0000","last_became_active":"2023-09-13T06:02:17.761387+0000","last_became_peered":"2023-09-13T06:02:17.761387+0000","last_unstale":"2023-09-13T06:02:17.762247+0000","last_undegraded":"2023-09-13T06:02:17.762247+0000","last_fullsized":"2023-09-13T06:02:17.762247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:00:07.340159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752926+0000","last_change":"2023-09-13T06:02:17.752926+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752926+0000","last_undegraded":"2023-09-13T06:02:17.752926+0000","last_fullsized":"2023-09-13T06:02:17.752926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757398+0000","last_change":"2023-09-13T06:02:17.757279+0000","last_active":"2023-09-13T06:02:17.757398+0000","last_peered":"2023-09-13T06:02:17.757398+0000","last_clean":"2023-09-13T06:02:17.757398+0000","last_became_active":"2023-09-13T06:02:17.757046+0000","last_became_peered":"2023-09-13T06:02:17.757046+0000","last_unstale":"2023-09-13T06:02:17.757398+0000","last_undegraded":"2023-09-13T06:02:17.757398+0000","last_fullsized":"2023-09-13T06:02:17.757398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:06.883601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.751741+0000","last_change":"2023-09-13T06:02:17.751741+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.751741+0000","last_undegraded":"2023-09-13T06:02:17.751741+0000","last_fullsized":"2023-09-13T06:02:17.751741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762269+0000","last_change":"2023-09-13T06:02:17.761961+0000","last_active":"2023-09-13T06:02:17.762269+0000","last_peered":"2023-09-13T06:02:17.762269+0000","last_clean":"2023-09-13T06:02:17.762269+0000","last_became_active":"2023-09-13T06:02:17.760216+0000","last_became_peered":"2023-09-13T06:02:17.760216+0000","last_unstale":"2023-09-13T06:02:17.762269+0000","last_undegraded":"2023-09-13T06:02:17.762269+0000","last_fullsized":"2023-09-13T06:02:17.762269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754405+0000","last_change":"2023-09-13T06:02:17.754405+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754405+0000","last_undegraded":"2023-09-13T06:02:17.754405+0000","last_fullsized":"2023-09-13T06:02:17.754405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758176+0000","last_change":"2023-09-13T06:02:17.758069+0000","last_active":"2023-09-13T06:02:17.758176+0000","last_peered":"2023-09-13T06:02:17.758176+0000","last_clean":"2023-09-13T06:02:17.758176+0000","last_became_active":"2023-09-13T06:02:17.757840+0000","last_became_peered":"2023-09-13T06:02:17.757840+0000","last_unstale":"2023-09-13T06:02:17.758176+0000","last_undegraded":"2023-09-13T06:02:17.758176+0000","last_fullsized":"2023-09-13T06:02:17.758176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762640+0000","last_change":"2023-09-13T06:02:17.762640+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762640+0000","last_undegraded":"2023-09-13T06:02:17.762640+0000","last_fullsized":"2023-09-13T06:02:17.762640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758599+0000","last_change":"2023-09-13T06:02:17.758184+0000","last_active":"2023-09-13T06:02:17.758599+0000","last_peered":"2023-09-13T06:02:17.758599+0000","last_clean":"2023-09-13T06:02:17.758599+0000","last_became_active":"2023-09-13T06:02:17.757752+0000","last_became_peered":"2023-09-13T06:02:17.757752+0000","last_unstale":"2023-09-13T06:02:17.758599+0000","last_undegraded":"2023-09-13T06:02:17.758599+0000","last_fullsized":"2023-09-13T06:02:17.758599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:35:44.141658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758385+0000","last_change":"2023-09-13T06:02:17.758385+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758385+0000","last_undegraded":"2023-09-13T06:02:17.758385+0000","last_fullsized":"2023-09-13T06:02:17.758385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760898+0000","last_change":"2023-09-13T06:02:17.759047+0000","last_active":"2023-09-13T06:02:17.760898+0000","last_peered":"2023-09-13T06:02:17.760898+0000","last_clean":"2023-09-13T06:02:17.760898+0000","last_became_active":"2023-09-13T06:02:17.758821+0000","last_became_peered":"2023-09-13T06:02:17.758821+0000","last_unstale":"2023-09-13T06:02:17.760898+0000","last_undegraded":"2023-09-13T06:02:17.760898+0000","last_fullsized":"2023-09-13T06:02:17.760898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:13.821905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762222+0000","last_change":"2023-09-13T06:02:17.762222+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762222+0000","last_undegraded":"2023-09-13T06:02:17.762222+0000","last_fullsized":"2023-09-13T06:02:17.762222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.763378+0000","last_change":"2023-09-13T06:02:17.762871+0000","last_active":"2023-09-13T06:02:17.763378+0000","last_peered":"2023-09-13T06:02:17.763378+0000","last_clean":"2023-09-13T06:02:17.763378+0000","last_became_active":"2023-09-13T06:02:17.761720+0000","last_became_peered":"2023-09-13T06:02:17.761720+0000","last_unstale":"2023-09-13T06:02:17.763378+0000","last_undegraded":"2023-09-13T06:02:17.763378+0000","last_fullsized":"2023-09-13T06:02:17.763378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:13.821905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763035+0000","last_change":"2023-09-13T06:02:17.763035+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763035+0000","last_undegraded":"2023-09-13T06:02:17.763035+0000","last_fullsized":"2023-09-13T06:02:17.763035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.763920+0000","last_change":"2023-09-13T06:02:17.763666+0000","last_active":"2023-09-13T06:02:17.763920+0000","last_peered":"2023-09-13T06:02:17.763920+0000","last_clean":"2023-09-13T06:02:17.763920+0000","last_became_active":"2023-09-13T06:02:17.763447+0000","last_became_peered":"2023-09-13T06:02:17.763447+0000","last_unstale":"2023-09-13T06:02:17.763920+0000","last_undegraded":"2023-09-13T06:02:17.763920+0000","last_fullsized":"2023-09-13T06:02:17.763920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:23:06.205141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763136+0000","last_change":"2023-09-13T06:02:17.763136+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763136+0000","last_undegraded":"2023-09-13T06:02:17.763136+0000","last_fullsized":"2023-09-13T06:02:17.763136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758845+0000","last_change":"2023-09-13T06:02:17.758766+0000","last_active":"2023-09-13T06:02:17.758845+0000","last_peered":"2023-09-13T06:02:17.758845+0000","last_clean":"2023-09-13T06:02:17.758845+0000","last_became_active":"2023-09-13T06:02:17.758343+0000","last_became_peered":"2023-09-13T06:02:17.758343+0000","last_unstale":"2023-09-13T06:02:17.758845+0000","last_undegraded":"2023-09-13T06:02:17.758845+0000","last_fullsized":"2023-09-13T06:02:17.758845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752539+0000","last_change":"2023-09-13T06:02:17.752539+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752539+0000","last_undegraded":"2023-09-13T06:02:17.752539+0000","last_fullsized":"2023-09-13T06:02:17.752539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765268+0000","last_change":"2023-09-13T06:02:17.765194+0000","last_active":"2023-09-13T06:02:17.765268+0000","last_peered":"2023-09-13T06:02:17.765268+0000","last_clean":"2023-09-13T06:02:17.765268+0000","last_became_active":"2023-09-13T06:02:17.764751+0000","last_became_peered":"2023-09-13T06:02:17.764751+0000","last_unstale":"2023-09-13T06:02:17.765268+0000","last_undegraded":"2023-09-13T06:02:17.765268+0000","last_fullsized":"2023-09-13T06:02:17.765268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-09-13T06:02:16.750081+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:02:16.750081+0000","last_peered":"2023-09-13T06:02:16.750081+0000","last_clean":"2023-09-13T06:02:16.750081+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:02:16.750081+0000","last_undegraded":"2023-09-13T06:02:16.750081+0000","last_fullsized":"2023-09-13T06:02:16.750081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194613,"statfs":{"total":200000000,"available":199284106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.875}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.82899999999999996}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.627},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.57999999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.89500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70299999999999996}]},{"osd":1,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.77000000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.74399999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.75900000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55600000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.623},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.89100000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.76800000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.91000000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.97999999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.78800000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.86599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.629},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.77600000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.85799999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.875},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.81799999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.90400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40699999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.751}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.873}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.30299999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.38900000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.66500000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.502},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.435}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.70499999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.77300000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194613,"statfs":{"total":200000000,"available":199284106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45700000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51400000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.872},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.75800000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.82499999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.73499999999999999}]}]}],"pool_statfs":[]}} 2023-09-13T06:02:22.870 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:02:23.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff3868d8640 1 Processor -- start 2023-09-13T06:02:23.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff3868d8640 1 -- start start 2023-09-13T06:02:23.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff3868d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff3800d1090 0x7ff38015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff3868d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3800b63c0 con 0x7ff380146f30 2023-09-13T06:02:23.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff3868d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3800d0c20 con 0x7ff3800d1750 2023-09-13T06:02:23.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff3868d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38015dea0 con 0x7ff3800d1090 2023-09-13T06:02:23.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff37f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff3800d1090 0x7ff38015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff384e75640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff380146f30 0x7ff3800b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54502/0 (socket says 172.21.15.130:54502) 2023-09-13T06:02:23.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff384e75640 1 -- 172.21.15.130:0/3946333134 learned_addr learned my addr 172.21.15.130:0/3946333134 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:23.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff37f7fe640 1 -- 172.21.15.130:0/3946333134 >> v1:172.21.15.164:6789/0 conn(0x7ff3800d1750 legacy=0x7ff380146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff37f7fe640 1 -- 172.21.15.130:0/3946333134 >> v1:172.21.15.130:6789/0 conn(0x7ff380146f30 legacy=0x7ff3800b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff37f7fe640 1 -- 172.21.15.130:0/3946333134 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3800b6610 con 0x7ff3800d1090 2023-09-13T06:02:23.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.040+0000 7ff37effd640 1 -- 172.21.15.130:0/3946333134 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001518318 0 0) 0x7ff3800b63c0 con 0x7ff380146f30 2023-09-13T06:02:23.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.044+0000 7ff37f7fe640 1 --2- 172.21.15.130:0/3946333134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3800d1090 0x7ff38015d960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff3740097c0 tx=0x7ff37401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb3d174102af156 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:23.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.044+0000 7ff37effd640 1 -- 172.21.15.130:0/3946333134 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740ac620 con 0x7ff3800d1090 2023-09-13T06:02:23.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.044+0000 7ff37effd640 1 -- 172.21.15.130:0/3946333134 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3740ac780 con 0x7ff3800d1090 2023-09-13T06:02:23.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.044+0000 7ff37effd640 1 -- 172.21.15.130:0/3946333134 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740acb10 con 0x7ff3800d1090 2023-09-13T06:02:23.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.044+0000 7ff3868d8640 1 -- 172.21.15.130:0/3946333134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3800d1090 msgr2=0x7ff38015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.044+0000 7ff3868d8640 1 --2- 172.21.15.130:0/3946333134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3800d1090 0x7ff38015d960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff3740097c0 tx=0x7ff37401c3c0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.044+0000 7ff3868d8640 1 -- 172.21.15.130:0/3946333134 shutdown_connections 2023-09-13T06:02:23.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.044+0000 7ff3868d8640 1 --2- 172.21.15.130:0/3946333134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3800d1090 0x7ff38015d960 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.044+0000 7ff3868d8640 1 -- 172.21.15.130:0/3946333134 >> 172.21.15.130:0/3946333134 conn(0x7ff38006f170 msgr2=0x7ff38006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:23.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.044+0000 7ff3868d8640 1 -- 172.21.15.130:0/3946333134 shutdown_connections 2023-09-13T06:02:23.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.044+0000 7ff3868d8640 1 -- 172.21.15.130:0/3946333134 wait complete. 2023-09-13T06:02:23.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff3868d8640 1 Processor -- start 2023-09-13T06:02:23.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff3868d8640 1 -- start start 2023-09-13T06:02:23.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff3868d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3800d1090 0x7ff38013b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff3868d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3800d1750 0x7ff380159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff3868d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff380146f30 0x7ff38013cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff3868d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3801432b0 con 0x7ff3800d1750 2023-09-13T06:02:23.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff3868d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38015a300 con 0x7ff3800d1090 2023-09-13T06:02:23.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff3868d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3801426a0 con 0x7ff380146f30 2023-09-13T06:02:23.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3800d1750 0x7ff380159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3800d1750 0x7ff380159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46314/0 (socket says 172.21.15.130:46314) 2023-09-13T06:02:23.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37f7fe640 1 -- 172.21.15.130:0/343946689 learned_addr learned my addr 172.21.15.130:0/343946689 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:23.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37ffff640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3800d1090 0x7ff38013b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff384e75640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff380146f30 0x7ff38013cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37f7fe640 1 -- 172.21.15.130:0/343946689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff380146f30 msgr2=0x7ff38013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37f7fe640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff380146f30 0x7ff38013cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37f7fe640 1 -- 172.21.15.130:0/343946689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3800d1090 msgr2=0x7ff38013b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37f7fe640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3800d1090 0x7ff38013b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37f7fe640 1 -- 172.21.15.130:0/343946689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374009420 con 0x7ff3800d1750 2023-09-13T06:02:23.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37f7fe640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3800d1750 0x7ff380159dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff374018fd0 tx=0x7ff374019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:23.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37cff9640 1 -- 172.21.15.130:0/343946689 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740b5610 con 0x7ff3800d1750 2023-09-13T06:02:23.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37cff9640 1 -- 172.21.15.130:0/343946689 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3740b5790 con 0x7ff3800d1750 2023-09-13T06:02:23.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff37cff9640 1 -- 172.21.15.130:0/343946689 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740b5b40 con 0x7ff3800d1750 2023-09-13T06:02:23.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff3868d8640 1 -- 172.21.15.130:0/343946689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff380142980 con 0x7ff3800d1750 2023-09-13T06:02:23.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.048+0000 7ff3868d8640 1 -- 172.21.15.130:0/343946689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff380142f40 con 0x7ff3800d1750 2023-09-13T06:02:23.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.052+0000 7ff3868d8640 1 -- 172.21.15.130:0/343946689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff380143420 con 0x7ff3800d1750 2023-09-13T06:02:23.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.052+0000 7ff37cff9640 1 -- 172.21.15.130:0/343946689 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff3740b3040 con 0x7ff3800d1750 2023-09-13T06:02:23.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.052+0000 7ff37cff9640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff36c065b20 0x7ff36c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.052+0000 7ff37cff9640 1 -- 172.21.15.130:0/343946689 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff37411d500 con 0x7ff3800d1750 2023-09-13T06:02:23.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.052+0000 7ff37ffff640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff36c065b20 0x7ff36c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.052+0000 7ff37ffff640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff36c065b20 0x7ff36c067fe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff370007fd0 tx=0x7ff370009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:23.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.056+0000 7ff37cff9640 1 -- 172.21.15.130:0/343946689 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff3740eae60 con 0x7ff3800d1750 2023-09-13T06:02:23.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.200+0000 7ff3868d8640 1 -- 172.21.15.130:0/343946689 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3800b7800 con 0x7ff36c065b20 2023-09-13T06:02:23.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.208+0000 7ff37cff9640 1 -- 172.21.15.130:0/343946689 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279890 (secure 0 0 0) 0x7ff37000f820 con 0x7ff36c065b20 2023-09-13T06:02:23.305 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:23.307 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:02:23.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 -- 172.21.15.130:0/343946689 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff36c065b20 msgr2=0x7ff36c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff36c065b20 0x7ff36c067fe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff370007fd0 tx=0x7ff370009040 comp rx=0 tx=0).stop 2023-09-13T06:02:23.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 -- 172.21.15.130:0/343946689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3800d1750 msgr2=0x7ff380159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3800d1750 0x7ff380159dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff374018fd0 tx=0x7ff374019160 comp rx=0 tx=0).stop 2023-09-13T06:02:23.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 -- 172.21.15.130:0/343946689 shutdown_connections 2023-09-13T06:02:23.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff36c065b20 0x7ff36c067fe0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff380146f30 0x7ff38013cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3800d1750 0x7ff380159dc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 --2- 172.21.15.130:0/343946689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3800d1090 0x7ff38013b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 -- 172.21.15.130:0/343946689 >> 172.21.15.130:0/343946689 conn(0x7ff38006f170 msgr2=0x7ff3800cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:23.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 -- 172.21.15.130:0/343946689 shutdown_connections 2023-09-13T06:02:23.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.212+0000 7ff3868d8640 1 -- 172.21.15.130:0/343946689 wait complete. 2023-09-13T06:02:23.311 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-09-13T06:02:22.547281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560372,"statfs":{"total":1600000000,"available":1597821323,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.798032"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.759190+0000","last_change":"2023-09-13T06:02:17.759190+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.759190+0000","last_undegraded":"2023-09-13T06:02:17.759190+0000","last_fullsized":"2023-09-13T06:02:17.759190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763540+0000","last_change":"2023-09-13T06:02:17.763540+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763540+0000","last_undegraded":"2023-09-13T06:02:17.763540+0000","last_fullsized":"2023-09-13T06:02:17.763540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753181+0000","last_change":"2023-09-13T06:02:17.753181+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753181+0000","last_undegraded":"2023-09-13T06:02:17.753181+0000","last_fullsized":"2023-09-13T06:02:17.753181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762726+0000","last_change":"2023-09-13T06:02:17.762726+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762726+0000","last_undegraded":"2023-09-13T06:02:17.762726+0000","last_fullsized":"2023-09-13T06:02:17.762726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753181+0000","last_change":"2023-09-13T06:02:17.753181+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753181+0000","last_undegraded":"2023-09-13T06:02:17.753181+0000","last_fullsized":"2023-09-13T06:02:17.753181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763304+0000","last_change":"2023-09-13T06:02:17.763304+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763304+0000","last_undegraded":"2023-09-13T06:02:17.763304+0000","last_fullsized":"2023-09-13T06:02:17.763304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754030+0000","last_change":"2023-09-13T06:02:17.754030+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754030+0000","last_undegraded":"2023-09-13T06:02:17.754030+0000","last_fullsized":"2023-09-13T06:02:17.754030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.756115+0000","last_change":"2023-09-13T06:02:17.756115+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.756115+0000","last_undegraded":"2023-09-13T06:02:17.756115+0000","last_fullsized":"2023-09-13T06:02:17.756115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762849+0000","last_change":"2023-09-13T06:02:17.762849+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762849+0000","last_undegraded":"2023-09-13T06:02:17.762849+0000","last_fullsized":"2023-09-13T06:02:17.762849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763164+0000","last_change":"2023-09-13T06:02:17.763164+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763164+0000","last_undegraded":"2023-09-13T06:02:17.763164+0000","last_fullsized":"2023-09-13T06:02:17.763164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754028+0000","last_change":"2023-09-13T06:02:17.754028+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754028+0000","last_undegraded":"2023-09-13T06:02:17.754028+0000","last_fullsized":"2023-09-13T06:02:17.754028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.755004+0000","last_change":"2023-09-13T06:02:17.755004+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.755004+0000","last_undegraded":"2023-09-13T06:02:17.755004+0000","last_fullsized":"2023-09-13T06:02:17.755004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752513+0000","last_change":"2023-09-13T06:02:17.752513+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752513+0000","last_undegraded":"2023-09-13T06:02:17.752513+0000","last_fullsized":"2023-09-13T06:02:17.752513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.764449+0000","last_change":"2023-09-13T06:02:17.764449+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.764449+0000","last_undegraded":"2023-09-13T06:02:17.764449+0000","last_fullsized":"2023-09-13T06:02:17.764449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752472+0000","last_change":"2023-09-13T06:02:17.752472+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752472+0000","last_undegraded":"2023-09-13T06:02:17.752472+0000","last_fullsized":"2023-09-13T06:02:17.752472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753663+0000","last_change":"2023-09-13T06:02:17.753663+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753663+0000","last_undegraded":"2023-09-13T06:02:17.753663+0000","last_fullsized":"2023-09-13T06:02:17.753663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753759+0000","last_change":"2023-09-13T06:02:17.753759+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753759+0000","last_undegraded":"2023-09-13T06:02:17.753759+0000","last_fullsized":"2023-09-13T06:02:17.753759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762486+0000","last_change":"2023-09-13T06:02:17.762486+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762486+0000","last_undegraded":"2023-09-13T06:02:17.762486+0000","last_fullsized":"2023-09-13T06:02:17.762486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.764146+0000","last_change":"2023-09-13T06:02:17.764146+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.764146+0000","last_undegraded":"2023-09-13T06:02:17.764146+0000","last_fullsized":"2023-09-13T06:02:17.764146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752466+0000","last_change":"2023-09-13T06:02:17.752466+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752466+0000","last_undegraded":"2023-09-13T06:02:17.752466+0000","last_fullsized":"2023-09-13T06:02:17.752466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762542+0000","last_change":"2023-09-13T06:02:17.762542+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762542+0000","last_undegraded":"2023-09-13T06:02:17.762542+0000","last_fullsized":"2023-09-13T06:02:17.762542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762008+0000","last_change":"2023-09-13T06:02:17.762008+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762008+0000","last_undegraded":"2023-09-13T06:02:17.762008+0000","last_fullsized":"2023-09-13T06:02:17.762008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762227+0000","last_change":"2023-09-13T06:02:17.762227+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762227+0000","last_undegraded":"2023-09-13T06:02:17.762227+0000","last_fullsized":"2023-09-13T06:02:17.762227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753330+0000","last_change":"2023-09-13T06:02:17.753330+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753330+0000","last_undegraded":"2023-09-13T06:02:17.753330+0000","last_fullsized":"2023-09-13T06:02:17.753330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762825+0000","last_change":"2023-09-13T06:02:17.762825+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762825+0000","last_undegraded":"2023-09-13T06:02:17.762825+0000","last_fullsized":"2023-09-13T06:02:17.762825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762962+0000","last_change":"2023-09-13T06:02:17.762962+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762962+0000","last_undegraded":"2023-09-13T06:02:17.762962+0000","last_fullsized":"2023-09-13T06:02:17.762962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762687+0000","last_change":"2023-09-13T06:02:17.762687+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762687+0000","last_undegraded":"2023-09-13T06:02:17.762687+0000","last_fullsized":"2023-09-13T06:02:17.762687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753851+0000","last_change":"2023-09-13T06:02:17.753851+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753851+0000","last_undegraded":"2023-09-13T06:02:17.753851+0000","last_fullsized":"2023-09-13T06:02:17.753851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762453+0000","last_change":"2023-09-13T06:02:17.762453+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762453+0000","last_undegraded":"2023-09-13T06:02:17.762453+0000","last_fullsized":"2023-09-13T06:02:17.762453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753307+0000","last_change":"2023-09-13T06:02:17.753307+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753307+0000","last_undegraded":"2023-09-13T06:02:17.753307+0000","last_fullsized":"2023-09-13T06:02:17.753307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758841+0000","last_change":"2023-09-13T06:02:17.758841+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758841+0000","last_undegraded":"2023-09-13T06:02:17.758841+0000","last_fullsized":"2023-09-13T06:02:17.758841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753310+0000","last_change":"2023-09-13T06:02:17.753310+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753310+0000","last_undegraded":"2023-09-13T06:02:17.753310+0000","last_fullsized":"2023-09-13T06:02:17.753310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762978+0000","last_change":"2023-09-13T06:02:17.762978+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762978+0000","last_undegraded":"2023-09-13T06:02:17.762978+0000","last_fullsized":"2023-09-13T06:02:17.762978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.764037+0000","last_change":"2023-09-13T06:02:17.762285+0000","last_active":"2023-09-13T06:02:17.764037+0000","last_peered":"2023-09-13T06:02:17.764037+0000","last_clean":"2023-09-13T06:02:17.764037+0000","last_became_active":"2023-09-13T06:02:17.762063+0000","last_became_peered":"2023-09-13T06:02:17.762063+0000","last_unstale":"2023-09-13T06:02:17.764037+0000","last_undegraded":"2023-09-13T06:02:17.764037+0000","last_fullsized":"2023-09-13T06:02:17.764037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:39:04.037652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.759621+0000","last_change":"2023-09-13T06:02:17.759621+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.759621+0000","last_undegraded":"2023-09-13T06:02:17.759621+0000","last_fullsized":"2023-09-13T06:02:17.759621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.761090+0000","last_change":"2023-09-13T06:02:17.761021+0000","last_active":"2023-09-13T06:02:17.761090+0000","last_peered":"2023-09-13T06:02:17.761090+0000","last_clean":"2023-09-13T06:02:17.761090+0000","last_became_active":"2023-09-13T06:02:17.760790+0000","last_became_peered":"2023-09-13T06:02:17.760790+0000","last_unstale":"2023-09-13T06:02:17.761090+0000","last_undegraded":"2023-09-13T06:02:17.761090+0000","last_fullsized":"2023-09-13T06:02:17.761090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:39:04.037652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.761926+0000","last_change":"2023-09-13T06:02:17.761926+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.761926+0000","last_undegraded":"2023-09-13T06:02:17.761926+0000","last_fullsized":"2023-09-13T06:02:17.761926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757327+0000","last_change":"2023-09-13T06:02:17.757092+0000","last_active":"2023-09-13T06:02:17.757327+0000","last_peered":"2023-09-13T06:02:17.757327+0000","last_clean":"2023-09-13T06:02:17.757327+0000","last_became_active":"2023-09-13T06:02:17.756854+0000","last_became_peered":"2023-09-13T06:02:17.756854+0000","last_unstale":"2023-09-13T06:02:17.757327+0000","last_undegraded":"2023-09-13T06:02:17.757327+0000","last_fullsized":"2023-09-13T06:02:17.757327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:52.822633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762517+0000","last_change":"2023-09-13T06:02:17.762517+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762517+0000","last_undegraded":"2023-09-13T06:02:17.762517+0000","last_fullsized":"2023-09-13T06:02:17.762517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.759395+0000","last_change":"2023-09-13T06:02:17.758909+0000","last_active":"2023-09-13T06:02:17.759395+0000","last_peered":"2023-09-13T06:02:17.759395+0000","last_clean":"2023-09-13T06:02:17.759395+0000","last_became_active":"2023-09-13T06:02:17.758503+0000","last_became_peered":"2023-09-13T06:02:17.758503+0000","last_unstale":"2023-09-13T06:02:17.759395+0000","last_undegraded":"2023-09-13T06:02:17.759395+0000","last_fullsized":"2023-09-13T06:02:17.759395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:48.120438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.755778+0000","last_change":"2023-09-13T06:02:17.755778+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.755778+0000","last_undegraded":"2023-09-13T06:02:17.755778+0000","last_fullsized":"2023-09-13T06:02:17.755778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760136+0000","last_change":"2023-09-13T06:02:17.760031+0000","last_active":"2023-09-13T06:02:17.760136+0000","last_peered":"2023-09-13T06:02:17.760136+0000","last_clean":"2023-09-13T06:02:17.760136+0000","last_became_active":"2023-09-13T06:02:17.759461+0000","last_became_peered":"2023-09-13T06:02:17.759461+0000","last_unstale":"2023-09-13T06:02:17.760136+0000","last_undegraded":"2023-09-13T06:02:17.760136+0000","last_fullsized":"2023-09-13T06:02:17.760136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:46:36.044318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754695+0000","last_change":"2023-09-13T06:02:17.754695+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754695+0000","last_undegraded":"2023-09-13T06:02:17.754695+0000","last_fullsized":"2023-09-13T06:02:17.754695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757236+0000","last_change":"2023-09-13T06:02:17.757157+0000","last_active":"2023-09-13T06:02:17.757236+0000","last_peered":"2023-09-13T06:02:17.757236+0000","last_clean":"2023-09-13T06:02:17.757236+0000","last_became_active":"2023-09-13T06:02:17.756751+0000","last_became_peered":"2023-09-13T06:02:17.756751+0000","last_unstale":"2023-09-13T06:02:17.757236+0000","last_undegraded":"2023-09-13T06:02:17.757236+0000","last_fullsized":"2023-09-13T06:02:17.757236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:03:55.320781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763080+0000","last_change":"2023-09-13T06:02:17.763080+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763080+0000","last_undegraded":"2023-09-13T06:02:17.763080+0000","last_fullsized":"2023-09-13T06:02:17.763080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.756148+0000","last_change":"2023-09-13T06:02:17.756021+0000","last_active":"2023-09-13T06:02:17.756148+0000","last_peered":"2023-09-13T06:02:17.756148+0000","last_clean":"2023-09-13T06:02:17.756148+0000","last_became_active":"2023-09-13T06:02:17.755754+0000","last_became_peered":"2023-09-13T06:02:17.755754+0000","last_unstale":"2023-09-13T06:02:17.756148+0000","last_undegraded":"2023-09-13T06:02:17.756148+0000","last_fullsized":"2023-09-13T06:02:17.756148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:49.936804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762416+0000","last_change":"2023-09-13T06:02:17.762416+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762416+0000","last_undegraded":"2023-09-13T06:02:17.762416+0000","last_fullsized":"2023-09-13T06:02:17.762416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765712+0000","last_change":"2023-09-13T06:02:17.765596+0000","last_active":"2023-09-13T06:02:17.765712+0000","last_peered":"2023-09-13T06:02:17.765712+0000","last_clean":"2023-09-13T06:02:17.765712+0000","last_became_active":"2023-09-13T06:02:17.764626+0000","last_became_peered":"2023-09-13T06:02:17.764626+0000","last_unstale":"2023-09-13T06:02:17.765712+0000","last_undegraded":"2023-09-13T06:02:17.765712+0000","last_fullsized":"2023-09-13T06:02:17.765712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:18:57.717040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754042+0000","last_change":"2023-09-13T06:02:17.754042+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754042+0000","last_undegraded":"2023-09-13T06:02:17.754042+0000","last_fullsized":"2023-09-13T06:02:17.754042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760403+0000","last_change":"2023-09-13T06:02:17.760344+0000","last_active":"2023-09-13T06:02:17.760403+0000","last_peered":"2023-09-13T06:02:17.760403+0000","last_clean":"2023-09-13T06:02:17.760403+0000","last_became_active":"2023-09-13T06:02:17.760112+0000","last_became_peered":"2023-09-13T06:02:17.760112+0000","last_unstale":"2023-09-13T06:02:17.760403+0000","last_undegraded":"2023-09-13T06:02:17.760403+0000","last_fullsized":"2023-09-13T06:02:17.760403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:35:44.141658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762674+0000","last_change":"2023-09-13T06:02:17.762674+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762674+0000","last_undegraded":"2023-09-13T06:02:17.762674+0000","last_fullsized":"2023-09-13T06:02:17.762674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757398+0000","last_change":"2023-09-13T06:02:17.757230+0000","last_active":"2023-09-13T06:02:17.757398+0000","last_peered":"2023-09-13T06:02:17.757398+0000","last_clean":"2023-09-13T06:02:17.757398+0000","last_became_active":"2023-09-13T06:02:17.756995+0000","last_became_peered":"2023-09-13T06:02:17.756995+0000","last_unstale":"2023-09-13T06:02:17.757398+0000","last_undegraded":"2023-09-13T06:02:17.757398+0000","last_fullsized":"2023-09-13T06:02:17.757398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763849+0000","last_change":"2023-09-13T06:02:17.763849+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763849+0000","last_undegraded":"2023-09-13T06:02:17.763849+0000","last_fullsized":"2023-09-13T06:02:17.763849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760875+0000","last_change":"2023-09-13T06:02:17.760513+0000","last_active":"2023-09-13T06:02:17.760875+0000","last_peered":"2023-09-13T06:02:17.760875+0000","last_clean":"2023-09-13T06:02:17.760875+0000","last_became_active":"2023-09-13T06:02:17.759698+0000","last_became_peered":"2023-09-13T06:02:17.759698+0000","last_unstale":"2023-09-13T06:02:17.760875+0000","last_undegraded":"2023-09-13T06:02:17.760875+0000","last_fullsized":"2023-09-13T06:02:17.760875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:36:09.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753498+0000","last_change":"2023-09-13T06:02:17.753498+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753498+0000","last_undegraded":"2023-09-13T06:02:17.753498+0000","last_fullsized":"2023-09-13T06:02:17.753498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758829+0000","last_change":"2023-09-13T06:02:17.758625+0000","last_active":"2023-09-13T06:02:17.758829+0000","last_peered":"2023-09-13T06:02:17.758829+0000","last_clean":"2023-09-13T06:02:17.758829+0000","last_became_active":"2023-09-13T06:02:17.757273+0000","last_became_peered":"2023-09-13T06:02:17.757273+0000","last_unstale":"2023-09-13T06:02:17.758829+0000","last_undegraded":"2023-09-13T06:02:17.758829+0000","last_fullsized":"2023-09-13T06:02:17.758829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:06.883601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763737+0000","last_change":"2023-09-13T06:02:17.763737+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763737+0000","last_undegraded":"2023-09-13T06:02:17.763737+0000","last_fullsized":"2023-09-13T06:02:17.763737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765479+0000","last_change":"2023-09-13T06:02:17.765217+0000","last_active":"2023-09-13T06:02:17.765479+0000","last_peered":"2023-09-13T06:02:17.765479+0000","last_clean":"2023-09-13T06:02:17.765479+0000","last_became_active":"2023-09-13T06:02:17.764324+0000","last_became_peered":"2023-09-13T06:02:17.764324+0000","last_unstale":"2023-09-13T06:02:17.765479+0000","last_undegraded":"2023-09-13T06:02:17.765479+0000","last_fullsized":"2023-09-13T06:02:17.765479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:13:15.204110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762341+0000","last_change":"2023-09-13T06:02:17.762341+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762341+0000","last_undegraded":"2023-09-13T06:02:17.762341+0000","last_fullsized":"2023-09-13T06:02:17.762341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.764568+0000","last_change":"2023-09-13T06:02:17.763991+0000","last_active":"2023-09-13T06:02:17.764568+0000","last_peered":"2023-09-13T06:02:17.764568+0000","last_clean":"2023-09-13T06:02:17.764568+0000","last_became_active":"2023-09-13T06:02:17.762961+0000","last_became_peered":"2023-09-13T06:02:17.762961+0000","last_unstale":"2023-09-13T06:02:17.764568+0000","last_undegraded":"2023-09-13T06:02:17.764568+0000","last_fullsized":"2023-09-13T06:02:17.764568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753319+0000","last_change":"2023-09-13T06:02:17.753319+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753319+0000","last_undegraded":"2023-09-13T06:02:17.753319+0000","last_fullsized":"2023-09-13T06:02:17.753319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760385+0000","last_change":"2023-09-13T06:02:17.760312+0000","last_active":"2023-09-13T06:02:17.760385+0000","last_peered":"2023-09-13T06:02:17.760385+0000","last_clean":"2023-09-13T06:02:17.760385+0000","last_became_active":"2023-09-13T06:02:17.760047+0000","last_became_peered":"2023-09-13T06:02:17.760047+0000","last_unstale":"2023-09-13T06:02:17.760385+0000","last_undegraded":"2023-09-13T06:02:17.760385+0000","last_fullsized":"2023-09-13T06:02:17.760385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758771+0000","last_change":"2023-09-13T06:02:17.758771+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758771+0000","last_undegraded":"2023-09-13T06:02:17.758771+0000","last_fullsized":"2023-09-13T06:02:17.758771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757360+0000","last_change":"2023-09-13T06:02:17.757243+0000","last_active":"2023-09-13T06:02:17.757360+0000","last_peered":"2023-09-13T06:02:17.757360+0000","last_clean":"2023-09-13T06:02:17.757360+0000","last_became_active":"2023-09-13T06:02:17.757000+0000","last_became_peered":"2023-09-13T06:02:17.757000+0000","last_unstale":"2023-09-13T06:02:17.757360+0000","last_undegraded":"2023-09-13T06:02:17.757360+0000","last_fullsized":"2023-09-13T06:02:17.757360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:40.428906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762681+0000","last_change":"2023-09-13T06:02:17.762681+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762681+0000","last_undegraded":"2023-09-13T06:02:17.762681+0000","last_fullsized":"2023-09-13T06:02:17.762681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760270+0000","last_change":"2023-09-13T06:02:17.759850+0000","last_active":"2023-09-13T06:02:17.760270+0000","last_peered":"2023-09-13T06:02:17.760270+0000","last_clean":"2023-09-13T06:02:17.760270+0000","last_became_active":"2023-09-13T06:02:17.759571+0000","last_became_peered":"2023-09-13T06:02:17.759571+0000","last_unstale":"2023-09-13T06:02:17.760270+0000","last_undegraded":"2023-09-13T06:02:17.760270+0000","last_fullsized":"2023-09-13T06:02:17.760270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752931+0000","last_change":"2023-09-13T06:02:17.752931+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752931+0000","last_undegraded":"2023-09-13T06:02:17.752931+0000","last_fullsized":"2023-09-13T06:02:17.752931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762227+0000","last_change":"2023-09-13T06:02:17.761635+0000","last_active":"2023-09-13T06:02:17.762227+0000","last_peered":"2023-09-13T06:02:17.762227+0000","last_clean":"2023-09-13T06:02:17.762227+0000","last_became_active":"2023-09-13T06:02:17.761041+0000","last_became_peered":"2023-09-13T06:02:17.761041+0000","last_unstale":"2023-09-13T06:02:17.762227+0000","last_undegraded":"2023-09-13T06:02:17.762227+0000","last_fullsized":"2023-09-13T06:02:17.762227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:49:26.757377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762311+0000","last_change":"2023-09-13T06:02:17.762311+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762311+0000","last_undegraded":"2023-09-13T06:02:17.762311+0000","last_fullsized":"2023-09-13T06:02:17.762311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760931+0000","last_change":"2023-09-13T06:02:17.760800+0000","last_active":"2023-09-13T06:02:17.760931+0000","last_peered":"2023-09-13T06:02:17.760931+0000","last_clean":"2023-09-13T06:02:17.760931+0000","last_became_active":"2023-09-13T06:02:17.760585+0000","last_became_peered":"2023-09-13T06:02:17.760585+0000","last_unstale":"2023-09-13T06:02:17.760931+0000","last_undegraded":"2023-09-13T06:02:17.760931+0000","last_fullsized":"2023-09-13T06:02:17.760931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:48.120438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752434+0000","last_change":"2023-09-13T06:02:17.752434+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752434+0000","last_undegraded":"2023-09-13T06:02:17.752434+0000","last_fullsized":"2023-09-13T06:02:17.752434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760363+0000","last_change":"2023-09-13T06:02:17.760200+0000","last_active":"2023-09-13T06:02:17.760363+0000","last_peered":"2023-09-13T06:02:17.760363+0000","last_clean":"2023-09-13T06:02:17.760363+0000","last_became_active":"2023-09-13T06:02:17.759800+0000","last_became_peered":"2023-09-13T06:02:17.759800+0000","last_unstale":"2023-09-13T06:02:17.760363+0000","last_undegraded":"2023-09-13T06:02:17.760363+0000","last_fullsized":"2023-09-13T06:02:17.760363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:53:23.415803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.751719+0000","last_change":"2023-09-13T06:02:17.751719+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.751719+0000","last_undegraded":"2023-09-13T06:02:17.751719+0000","last_fullsized":"2023-09-13T06:02:17.751719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757379+0000","last_change":"2023-09-13T06:02:17.757106+0000","last_active":"2023-09-13T06:02:17.757379+0000","last_peered":"2023-09-13T06:02:17.757379+0000","last_clean":"2023-09-13T06:02:17.757379+0000","last_became_active":"2023-09-13T06:02:17.756876+0000","last_became_peered":"2023-09-13T06:02:17.756876+0000","last_unstale":"2023-09-13T06:02:17.757379+0000","last_undegraded":"2023-09-13T06:02:17.757379+0000","last_fullsized":"2023-09-13T06:02:17.757379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752081+0000","last_change":"2023-09-13T06:02:17.752081+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752081+0000","last_undegraded":"2023-09-13T06:02:17.752081+0000","last_fullsized":"2023-09-13T06:02:17.752081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765089+0000","last_change":"2023-09-13T06:02:17.764974+0000","last_active":"2023-09-13T06:02:17.765089+0000","last_peered":"2023-09-13T06:02:17.765089+0000","last_clean":"2023-09-13T06:02:17.765089+0000","last_became_active":"2023-09-13T06:02:17.764364+0000","last_became_peered":"2023-09-13T06:02:17.764364+0000","last_unstale":"2023-09-13T06:02:17.765089+0000","last_undegraded":"2023-09-13T06:02:17.765089+0000","last_fullsized":"2023-09-13T06:02:17.765089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:37:09.637327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752086+0000","last_change":"2023-09-13T06:02:17.752086+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752086+0000","last_undegraded":"2023-09-13T06:02:17.752086+0000","last_fullsized":"2023-09-13T06:02:17.752086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762247+0000","last_change":"2023-09-13T06:02:17.761800+0000","last_active":"2023-09-13T06:02:17.762247+0000","last_peered":"2023-09-13T06:02:17.762247+0000","last_clean":"2023-09-13T06:02:17.762247+0000","last_became_active":"2023-09-13T06:02:17.761387+0000","last_became_peered":"2023-09-13T06:02:17.761387+0000","last_unstale":"2023-09-13T06:02:17.762247+0000","last_undegraded":"2023-09-13T06:02:17.762247+0000","last_fullsized":"2023-09-13T06:02:17.762247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:00:07.340159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752926+0000","last_change":"2023-09-13T06:02:17.752926+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752926+0000","last_undegraded":"2023-09-13T06:02:17.752926+0000","last_fullsized":"2023-09-13T06:02:17.752926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757398+0000","last_change":"2023-09-13T06:02:17.757279+0000","last_active":"2023-09-13T06:02:17.757398+0000","last_peered":"2023-09-13T06:02:17.757398+0000","last_clean":"2023-09-13T06:02:17.757398+0000","last_became_active":"2023-09-13T06:02:17.757046+0000","last_became_peered":"2023-09-13T06:02:17.757046+0000","last_unstale":"2023-09-13T06:02:17.757398+0000","last_undegraded":"2023-09-13T06:02:17.757398+0000","last_fullsized":"2023-09-13T06:02:17.757398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:06.883601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.751741+0000","last_change":"2023-09-13T06:02:17.751741+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.751741+0000","last_undegraded":"2023-09-13T06:02:17.751741+0000","last_fullsized":"2023-09-13T06:02:17.751741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762269+0000","last_change":"2023-09-13T06:02:17.761961+0000","last_active":"2023-09-13T06:02:17.762269+0000","last_peered":"2023-09-13T06:02:17.762269+0000","last_clean":"2023-09-13T06:02:17.762269+0000","last_became_active":"2023-09-13T06:02:17.760216+0000","last_became_peered":"2023-09-13T06:02:17.760216+0000","last_unstale":"2023-09-13T06:02:17.762269+0000","last_undegraded":"2023-09-13T06:02:17.762269+0000","last_fullsized":"2023-09-13T06:02:17.762269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754405+0000","last_change":"2023-09-13T06:02:17.754405+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754405+0000","last_undegraded":"2023-09-13T06:02:17.754405+0000","last_fullsized":"2023-09-13T06:02:17.754405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758176+0000","last_change":"2023-09-13T06:02:17.758069+0000","last_active":"2023-09-13T06:02:17.758176+0000","last_peered":"2023-09-13T06:02:17.758176+0000","last_clean":"2023-09-13T06:02:17.758176+0000","last_became_active":"2023-09-13T06:02:17.757840+0000","last_became_peered":"2023-09-13T06:02:17.757840+0000","last_unstale":"2023-09-13T06:02:17.758176+0000","last_undegraded":"2023-09-13T06:02:17.758176+0000","last_fullsized":"2023-09-13T06:02:17.758176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762640+0000","last_change":"2023-09-13T06:02:17.762640+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762640+0000","last_undegraded":"2023-09-13T06:02:17.762640+0000","last_fullsized":"2023-09-13T06:02:17.762640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758599+0000","last_change":"2023-09-13T06:02:17.758184+0000","last_active":"2023-09-13T06:02:17.758599+0000","last_peered":"2023-09-13T06:02:17.758599+0000","last_clean":"2023-09-13T06:02:17.758599+0000","last_became_active":"2023-09-13T06:02:17.757752+0000","last_became_peered":"2023-09-13T06:02:17.757752+0000","last_unstale":"2023-09-13T06:02:17.758599+0000","last_undegraded":"2023-09-13T06:02:17.758599+0000","last_fullsized":"2023-09-13T06:02:17.758599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:35:44.141658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758385+0000","last_change":"2023-09-13T06:02:17.758385+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758385+0000","last_undegraded":"2023-09-13T06:02:17.758385+0000","last_fullsized":"2023-09-13T06:02:17.758385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760898+0000","last_change":"2023-09-13T06:02:17.759047+0000","last_active":"2023-09-13T06:02:17.760898+0000","last_peered":"2023-09-13T06:02:17.760898+0000","last_clean":"2023-09-13T06:02:17.760898+0000","last_became_active":"2023-09-13T06:02:17.758821+0000","last_became_peered":"2023-09-13T06:02:17.758821+0000","last_unstale":"2023-09-13T06:02:17.760898+0000","last_undegraded":"2023-09-13T06:02:17.760898+0000","last_fullsized":"2023-09-13T06:02:17.760898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:13.821905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762222+0000","last_change":"2023-09-13T06:02:17.762222+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762222+0000","last_undegraded":"2023-09-13T06:02:17.762222+0000","last_fullsized":"2023-09-13T06:02:17.762222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.763378+0000","last_change":"2023-09-13T06:02:17.762871+0000","last_active":"2023-09-13T06:02:17.763378+0000","last_peered":"2023-09-13T06:02:17.763378+0000","last_clean":"2023-09-13T06:02:17.763378+0000","last_became_active":"2023-09-13T06:02:17.761720+0000","last_became_peered":"2023-09-13T06:02:17.761720+0000","last_unstale":"2023-09-13T06:02:17.763378+0000","last_undegraded":"2023-09-13T06:02:17.763378+0000","last_fullsized":"2023-09-13T06:02:17.763378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:13.821905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763035+0000","last_change":"2023-09-13T06:02:17.763035+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763035+0000","last_undegraded":"2023-09-13T06:02:17.763035+0000","last_fullsized":"2023-09-13T06:02:17.763035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.763920+0000","last_change":"2023-09-13T06:02:17.763666+0000","last_active":"2023-09-13T06:02:17.763920+0000","last_peered":"2023-09-13T06:02:17.763920+0000","last_clean":"2023-09-13T06:02:17.763920+0000","last_became_active":"2023-09-13T06:02:17.763447+0000","last_became_peered":"2023-09-13T06:02:17.763447+0000","last_unstale":"2023-09-13T06:02:17.763920+0000","last_undegraded":"2023-09-13T06:02:17.763920+0000","last_fullsized":"2023-09-13T06:02:17.763920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:23:06.205141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763136+0000","last_change":"2023-09-13T06:02:17.763136+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763136+0000","last_undegraded":"2023-09-13T06:02:17.763136+0000","last_fullsized":"2023-09-13T06:02:17.763136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758845+0000","last_change":"2023-09-13T06:02:17.758766+0000","last_active":"2023-09-13T06:02:17.758845+0000","last_peered":"2023-09-13T06:02:17.758845+0000","last_clean":"2023-09-13T06:02:17.758845+0000","last_became_active":"2023-09-13T06:02:17.758343+0000","last_became_peered":"2023-09-13T06:02:17.758343+0000","last_unstale":"2023-09-13T06:02:17.758845+0000","last_undegraded":"2023-09-13T06:02:17.758845+0000","last_fullsized":"2023-09-13T06:02:17.758845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752539+0000","last_change":"2023-09-13T06:02:17.752539+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752539+0000","last_undegraded":"2023-09-13T06:02:17.752539+0000","last_fullsized":"2023-09-13T06:02:17.752539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765268+0000","last_change":"2023-09-13T06:02:17.765194+0000","last_active":"2023-09-13T06:02:17.765268+0000","last_peered":"2023-09-13T06:02:17.765268+0000","last_clean":"2023-09-13T06:02:17.765268+0000","last_became_active":"2023-09-13T06:02:17.764751+0000","last_became_peered":"2023-09-13T06:02:17.764751+0000","last_unstale":"2023-09-13T06:02:17.765268+0000","last_undegraded":"2023-09-13T06:02:17.765268+0000","last_fullsized":"2023-09-13T06:02:17.765268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-09-13T06:02:16.750081+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:02:16.750081+0000","last_peered":"2023-09-13T06:02:16.750081+0000","last_clean":"2023-09-13T06:02:16.750081+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:02:16.750081+0000","last_undegraded":"2023-09-13T06:02:16.750081+0000","last_fullsized":"2023-09-13T06:02:16.750081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194613,"statfs":{"total":200000000,"available":199284106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.875}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.82899999999999996}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.627},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.57999999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.89500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70299999999999996}]},{"osd":1,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.77000000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.74399999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.75900000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55600000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.623},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.89100000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.76800000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.91000000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.97999999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.78800000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.86599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.629},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.77600000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.85799999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.875},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.81799999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.90400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40699999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.751}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.873}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.30299999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.38900000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.66500000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.502},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.435}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.70499999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.77300000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194613,"statfs":{"total":200000000,"available":199284106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45700000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51400000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.872},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.75800000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.82499999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.73499999999999999}]}]}],"pool_statfs":[]}} 2023-09-13T06:02:23.318 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:02:23.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.452+0000 7f3d52aec640 1 Processor -- start 2023-09-13T06:02:23.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.452+0000 7f3d52aec640 1 -- start start 2023-09-13T06:02:23.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d52aec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3d4c1436e0 0x7f3d4c0ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d52aec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3d4c0acd80 0x7f3d4c070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d52aec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c06f640 con 0x7f3d4c146540 2023-09-13T06:02:23.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d52aec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c06f890 con 0x7f3d4c1436e0 2023-09-13T06:02:23.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d52aec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c06fb70 con 0x7f3d4c0acd80 2023-09-13T06:02:23.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d50888640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3d4c1436e0 0x7f3d4c0ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d50888640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3d4c1436e0 0x7f3d4c0ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46328/0 (socket says 172.21.15.130:46328) 2023-09-13T06:02:23.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d50888640 1 -- 172.21.15.130:0/256699055 learned_addr learned my addr 172.21.15.130:0/256699055 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:23.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d43fff640 1 --2- 172.21.15.130:0/256699055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3d4c0acd80 0x7f3d4c070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d50888640 1 -- 172.21.15.130:0/256699055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3d4c0acd80 msgr2=0x7f3d4c070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:23.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d50888640 1 --2- 172.21.15.130:0/256699055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3d4c0acd80 0x7f3d4c070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d50888640 1 -- 172.21.15.130:0/256699055 >> v1:172.21.15.164:6789/0 conn(0x7f3d4c146540 legacy=0x7f3d4c160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.456+0000 7f3d50888640 1 -- 172.21.15.130:0/256699055 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c06fe50 con 0x7f3d4c1436e0 2023-09-13T06:02:23.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d50888640 1 --2- 172.21.15.130:0/256699055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4c1436e0 0x7f3d4c0ac840 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009870 tx=0x7f3d4801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c693c2f2037b8c22 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:23.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d437fe640 1 -- 172.21.15.130:0/256699055 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480ab600 con 0x7f3d4c1436e0 2023-09-13T06:02:23.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d437fe640 1 -- 172.21.15.130:0/256699055 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d480a7050 con 0x7f3d4c1436e0 2023-09-13T06:02:23.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d437fe640 1 -- 172.21.15.130:0/256699055 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480ab980 con 0x7f3d4c1436e0 2023-09-13T06:02:23.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d52aec640 1 -- 172.21.15.130:0/256699055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4c1436e0 msgr2=0x7f3d4c0ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d52aec640 1 --2- 172.21.15.130:0/256699055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4c1436e0 0x7f3d4c0ac840 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009870 tx=0x7f3d4801c420 comp rx=0 tx=0).stop 2023-09-13T06:02:23.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d52aec640 1 -- 172.21.15.130:0/256699055 shutdown_connections 2023-09-13T06:02:23.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d52aec640 1 --2- 172.21.15.130:0/256699055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3d4c0acd80 0x7f3d4c070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d52aec640 1 --2- 172.21.15.130:0/256699055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4c1436e0 0x7f3d4c0ac840 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d52aec640 1 -- 172.21.15.130:0/256699055 >> 172.21.15.130:0/256699055 conn(0x7f3d4c0b0bc0 msgr2=0x7f3d4c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:23.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d52aec640 1 -- 172.21.15.130:0/256699055 shutdown_connections 2023-09-13T06:02:23.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d52aec640 1 -- 172.21.15.130:0/256699055 wait complete. 2023-09-13T06:02:23.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d52aec640 1 Processor -- start 2023-09-13T06:02:23.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.460+0000 7f3d52aec640 1 -- start start 2023-09-13T06:02:23.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d52aec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3d4c0acd80 0x7f3d4c15ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d52aec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d4c1436e0 0x7f3d4c15fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d52aec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4c146540 0x7f3d4c160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d52aec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c167ef0 con 0x7f3d4c146540 2023-09-13T06:02:23.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d52aec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c139d40 con 0x7f3d4c1436e0 2023-09-13T06:02:23.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d52aec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0b09f0 con 0x7f3d4c0acd80 2023-09-13T06:02:23.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d51089640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4c146540 0x7f3d4c160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d50888640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3d4c0acd80 0x7f3d4c15ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d43fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d4c1436e0 0x7f3d4c15fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d51089640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4c146540 0x7f3d4c160020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46336/0 (socket says 172.21.15.130:46336) 2023-09-13T06:02:23.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d50888640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3d4c0acd80 0x7f3d4c15ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:58258/0 (socket says 172.21.15.130:58258) 2023-09-13T06:02:23.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d51089640 1 -- 172.21.15.130:0/1297901183 learned_addr learned my addr 172.21.15.130:0/1297901183 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:23.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d51089640 1 -- 172.21.15.130:0/1297901183 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3d4c0acd80 msgr2=0x7f3d4c15ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d51089640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3d4c0acd80 0x7f3d4c15ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d51089640 1 -- 172.21.15.130:0/1297901183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d4c1436e0 msgr2=0x7f3d4c15fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d51089640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d4c1436e0 0x7f3d4c15fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d51089640 1 -- 172.21.15.130:0/1297901183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480094d0 con 0x7f3d4c146540 2023-09-13T06:02:23.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d51089640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4c146540 0x7f3d4c160020 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400c7d0 tx=0x7f3d4400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:23.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d417fa640 1 -- 172.21.15.130:0/1297901183 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44003b80 con 0x7f3d4c146540 2023-09-13T06:02:23.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d417fa640 1 -- 172.21.15.130:0/1297901183 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d44003ce0 con 0x7f3d4c146540 2023-09-13T06:02:23.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d417fa640 1 -- 172.21.15.130:0/1297901183 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400aa90 con 0x7f3d4c146540 2023-09-13T06:02:23.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d52aec640 1 -- 172.21.15.130:0/1297901183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c167c10 con 0x7f3d4c146540 2023-09-13T06:02:23.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d52aec640 1 -- 172.21.15.130:0/1297901183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c1399d0 con 0x7f3d4c146540 2023-09-13T06:02:23.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.464+0000 7f3d52aec640 1 -- 172.21.15.130:0/1297901183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c139550 con 0x7f3d4c146540 2023-09-13T06:02:23.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.468+0000 7f3d417fa640 1 -- 172.21.15.130:0/1297901183 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3d4400abf0 con 0x7f3d4c146540 2023-09-13T06:02:23.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.468+0000 7f3d417fa640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d38065b20 0x7f3d38067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.468+0000 7f3d417fa640 1 -- 172.21.15.130:0/1297901183 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d44083000 con 0x7f3d4c146540 2023-09-13T06:02:23.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.468+0000 7f3d50888640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d38065b20 0x7f3d38067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.468+0000 7f3d50888640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d38065b20 0x7f3d38067fe0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d480ad000 tx=0x7f3d48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:23.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.472+0000 7f3d417fa640 1 -- 172.21.15.130:0/1297901183 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3d4c139550 con 0x7f3d4c146540 2023-09-13T06:02:23.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.620+0000 7f3d52aec640 1 -- 172.21.15.130:0/1297901183 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d4c139550 con 0x7f3d38065b20 2023-09-13T06:02:23.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.628+0000 7f3d417fa640 1 -- 172.21.15.130:0/1297901183 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279890 (secure 0 0 0) 0x7f3d4c139550 con 0x7f3d38065b20 2023-09-13T06:02:23.634 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:23.635 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:02:23.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 -- 172.21.15.130:0/1297901183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d38065b20 msgr2=0x7f3d38067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d38065b20 0x7f3d38067fe0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d480ad000 tx=0x7f3d48008040 comp rx=0 tx=0).stop 2023-09-13T06:02:23.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 -- 172.21.15.130:0/1297901183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4c146540 msgr2=0x7f3d4c160020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4c146540 0x7f3d4c160020 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400c7d0 tx=0x7f3d4400cc90 comp rx=0 tx=0).stop 2023-09-13T06:02:23.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 -- 172.21.15.130:0/1297901183 shutdown_connections 2023-09-13T06:02:23.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d38065b20 0x7f3d38067fe0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d4c1436e0 0x7f3d4c15fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4c146540 0x7f3d4c160020 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 --2- 172.21.15.130:0/1297901183 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3d4c0acd80 0x7f3d4c15ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 -- 172.21.15.130:0/1297901183 >> 172.21.15.130:0/1297901183 conn(0x7f3d4c0b0bc0 msgr2=0x7f3d4c13c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:23.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 -- 172.21.15.130:0/1297901183 shutdown_connections 2023-09-13T06:02:23.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.632+0000 7f3d52aec640 1 -- 172.21.15.130:0/1297901183 wait complete. 2023-09-13T06:02:23.654 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-09-13T06:02:22.547281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560372,"statfs":{"total":1600000000,"available":1597821323,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.798032"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.759190+0000","last_change":"2023-09-13T06:02:17.759190+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.759190+0000","last_undegraded":"2023-09-13T06:02:17.759190+0000","last_fullsized":"2023-09-13T06:02:17.759190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763540+0000","last_change":"2023-09-13T06:02:17.763540+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763540+0000","last_undegraded":"2023-09-13T06:02:17.763540+0000","last_fullsized":"2023-09-13T06:02:17.763540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753181+0000","last_change":"2023-09-13T06:02:17.753181+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753181+0000","last_undegraded":"2023-09-13T06:02:17.753181+0000","last_fullsized":"2023-09-13T06:02:17.753181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762726+0000","last_change":"2023-09-13T06:02:17.762726+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762726+0000","last_undegraded":"2023-09-13T06:02:17.762726+0000","last_fullsized":"2023-09-13T06:02:17.762726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753181+0000","last_change":"2023-09-13T06:02:17.753181+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753181+0000","last_undegraded":"2023-09-13T06:02:17.753181+0000","last_fullsized":"2023-09-13T06:02:17.753181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763304+0000","last_change":"2023-09-13T06:02:17.763304+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763304+0000","last_undegraded":"2023-09-13T06:02:17.763304+0000","last_fullsized":"2023-09-13T06:02:17.763304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754030+0000","last_change":"2023-09-13T06:02:17.754030+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754030+0000","last_undegraded":"2023-09-13T06:02:17.754030+0000","last_fullsized":"2023-09-13T06:02:17.754030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.756115+0000","last_change":"2023-09-13T06:02:17.756115+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.756115+0000","last_undegraded":"2023-09-13T06:02:17.756115+0000","last_fullsized":"2023-09-13T06:02:17.756115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762849+0000","last_change":"2023-09-13T06:02:17.762849+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762849+0000","last_undegraded":"2023-09-13T06:02:17.762849+0000","last_fullsized":"2023-09-13T06:02:17.762849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763164+0000","last_change":"2023-09-13T06:02:17.763164+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763164+0000","last_undegraded":"2023-09-13T06:02:17.763164+0000","last_fullsized":"2023-09-13T06:02:17.763164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754028+0000","last_change":"2023-09-13T06:02:17.754028+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754028+0000","last_undegraded":"2023-09-13T06:02:17.754028+0000","last_fullsized":"2023-09-13T06:02:17.754028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.755004+0000","last_change":"2023-09-13T06:02:17.755004+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.755004+0000","last_undegraded":"2023-09-13T06:02:17.755004+0000","last_fullsized":"2023-09-13T06:02:17.755004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752513+0000","last_change":"2023-09-13T06:02:17.752513+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752513+0000","last_undegraded":"2023-09-13T06:02:17.752513+0000","last_fullsized":"2023-09-13T06:02:17.752513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.764449+0000","last_change":"2023-09-13T06:02:17.764449+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.764449+0000","last_undegraded":"2023-09-13T06:02:17.764449+0000","last_fullsized":"2023-09-13T06:02:17.764449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752472+0000","last_change":"2023-09-13T06:02:17.752472+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752472+0000","last_undegraded":"2023-09-13T06:02:17.752472+0000","last_fullsized":"2023-09-13T06:02:17.752472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753663+0000","last_change":"2023-09-13T06:02:17.753663+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753663+0000","last_undegraded":"2023-09-13T06:02:17.753663+0000","last_fullsized":"2023-09-13T06:02:17.753663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753759+0000","last_change":"2023-09-13T06:02:17.753759+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753759+0000","last_undegraded":"2023-09-13T06:02:17.753759+0000","last_fullsized":"2023-09-13T06:02:17.753759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762486+0000","last_change":"2023-09-13T06:02:17.762486+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762486+0000","last_undegraded":"2023-09-13T06:02:17.762486+0000","last_fullsized":"2023-09-13T06:02:17.762486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.764146+0000","last_change":"2023-09-13T06:02:17.764146+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.764146+0000","last_undegraded":"2023-09-13T06:02:17.764146+0000","last_fullsized":"2023-09-13T06:02:17.764146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752466+0000","last_change":"2023-09-13T06:02:17.752466+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752466+0000","last_undegraded":"2023-09-13T06:02:17.752466+0000","last_fullsized":"2023-09-13T06:02:17.752466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762542+0000","last_change":"2023-09-13T06:02:17.762542+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762542+0000","last_undegraded":"2023-09-13T06:02:17.762542+0000","last_fullsized":"2023-09-13T06:02:17.762542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762008+0000","last_change":"2023-09-13T06:02:17.762008+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762008+0000","last_undegraded":"2023-09-13T06:02:17.762008+0000","last_fullsized":"2023-09-13T06:02:17.762008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762227+0000","last_change":"2023-09-13T06:02:17.762227+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762227+0000","last_undegraded":"2023-09-13T06:02:17.762227+0000","last_fullsized":"2023-09-13T06:02:17.762227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753330+0000","last_change":"2023-09-13T06:02:17.753330+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753330+0000","last_undegraded":"2023-09-13T06:02:17.753330+0000","last_fullsized":"2023-09-13T06:02:17.753330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762825+0000","last_change":"2023-09-13T06:02:17.762825+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762825+0000","last_undegraded":"2023-09-13T06:02:17.762825+0000","last_fullsized":"2023-09-13T06:02:17.762825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762962+0000","last_change":"2023-09-13T06:02:17.762962+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762962+0000","last_undegraded":"2023-09-13T06:02:17.762962+0000","last_fullsized":"2023-09-13T06:02:17.762962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762687+0000","last_change":"2023-09-13T06:02:17.762687+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762687+0000","last_undegraded":"2023-09-13T06:02:17.762687+0000","last_fullsized":"2023-09-13T06:02:17.762687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753851+0000","last_change":"2023-09-13T06:02:17.753851+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753851+0000","last_undegraded":"2023-09-13T06:02:17.753851+0000","last_fullsized":"2023-09-13T06:02:17.753851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762453+0000","last_change":"2023-09-13T06:02:17.762453+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762453+0000","last_undegraded":"2023-09-13T06:02:17.762453+0000","last_fullsized":"2023-09-13T06:02:17.762453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753307+0000","last_change":"2023-09-13T06:02:17.753307+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753307+0000","last_undegraded":"2023-09-13T06:02:17.753307+0000","last_fullsized":"2023-09-13T06:02:17.753307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758841+0000","last_change":"2023-09-13T06:02:17.758841+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758841+0000","last_undegraded":"2023-09-13T06:02:17.758841+0000","last_fullsized":"2023-09-13T06:02:17.758841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753310+0000","last_change":"2023-09-13T06:02:17.753310+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753310+0000","last_undegraded":"2023-09-13T06:02:17.753310+0000","last_fullsized":"2023-09-13T06:02:17.753310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762978+0000","last_change":"2023-09-13T06:02:17.762978+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762978+0000","last_undegraded":"2023-09-13T06:02:17.762978+0000","last_fullsized":"2023-09-13T06:02:17.762978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.764037+0000","last_change":"2023-09-13T06:02:17.762285+0000","last_active":"2023-09-13T06:02:17.764037+0000","last_peered":"2023-09-13T06:02:17.764037+0000","last_clean":"2023-09-13T06:02:17.764037+0000","last_became_active":"2023-09-13T06:02:17.762063+0000","last_became_peered":"2023-09-13T06:02:17.762063+0000","last_unstale":"2023-09-13T06:02:17.764037+0000","last_undegraded":"2023-09-13T06:02:17.764037+0000","last_fullsized":"2023-09-13T06:02:17.764037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:39:04.037652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.759621+0000","last_change":"2023-09-13T06:02:17.759621+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.759621+0000","last_undegraded":"2023-09-13T06:02:17.759621+0000","last_fullsized":"2023-09-13T06:02:17.759621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.761090+0000","last_change":"2023-09-13T06:02:17.761021+0000","last_active":"2023-09-13T06:02:17.761090+0000","last_peered":"2023-09-13T06:02:17.761090+0000","last_clean":"2023-09-13T06:02:17.761090+0000","last_became_active":"2023-09-13T06:02:17.760790+0000","last_became_peered":"2023-09-13T06:02:17.760790+0000","last_unstale":"2023-09-13T06:02:17.761090+0000","last_undegraded":"2023-09-13T06:02:17.761090+0000","last_fullsized":"2023-09-13T06:02:17.761090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:39:04.037652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.761926+0000","last_change":"2023-09-13T06:02:17.761926+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.761926+0000","last_undegraded":"2023-09-13T06:02:17.761926+0000","last_fullsized":"2023-09-13T06:02:17.761926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757327+0000","last_change":"2023-09-13T06:02:17.757092+0000","last_active":"2023-09-13T06:02:17.757327+0000","last_peered":"2023-09-13T06:02:17.757327+0000","last_clean":"2023-09-13T06:02:17.757327+0000","last_became_active":"2023-09-13T06:02:17.756854+0000","last_became_peered":"2023-09-13T06:02:17.756854+0000","last_unstale":"2023-09-13T06:02:17.757327+0000","last_undegraded":"2023-09-13T06:02:17.757327+0000","last_fullsized":"2023-09-13T06:02:17.757327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:52.822633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762517+0000","last_change":"2023-09-13T06:02:17.762517+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762517+0000","last_undegraded":"2023-09-13T06:02:17.762517+0000","last_fullsized":"2023-09-13T06:02:17.762517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.759395+0000","last_change":"2023-09-13T06:02:17.758909+0000","last_active":"2023-09-13T06:02:17.759395+0000","last_peered":"2023-09-13T06:02:17.759395+0000","last_clean":"2023-09-13T06:02:17.759395+0000","last_became_active":"2023-09-13T06:02:17.758503+0000","last_became_peered":"2023-09-13T06:02:17.758503+0000","last_unstale":"2023-09-13T06:02:17.759395+0000","last_undegraded":"2023-09-13T06:02:17.759395+0000","last_fullsized":"2023-09-13T06:02:17.759395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:48.120438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.755778+0000","last_change":"2023-09-13T06:02:17.755778+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.755778+0000","last_undegraded":"2023-09-13T06:02:17.755778+0000","last_fullsized":"2023-09-13T06:02:17.755778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760136+0000","last_change":"2023-09-13T06:02:17.760031+0000","last_active":"2023-09-13T06:02:17.760136+0000","last_peered":"2023-09-13T06:02:17.760136+0000","last_clean":"2023-09-13T06:02:17.760136+0000","last_became_active":"2023-09-13T06:02:17.759461+0000","last_became_peered":"2023-09-13T06:02:17.759461+0000","last_unstale":"2023-09-13T06:02:17.760136+0000","last_undegraded":"2023-09-13T06:02:17.760136+0000","last_fullsized":"2023-09-13T06:02:17.760136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:46:36.044318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754695+0000","last_change":"2023-09-13T06:02:17.754695+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754695+0000","last_undegraded":"2023-09-13T06:02:17.754695+0000","last_fullsized":"2023-09-13T06:02:17.754695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757236+0000","last_change":"2023-09-13T06:02:17.757157+0000","last_active":"2023-09-13T06:02:17.757236+0000","last_peered":"2023-09-13T06:02:17.757236+0000","last_clean":"2023-09-13T06:02:17.757236+0000","last_became_active":"2023-09-13T06:02:17.756751+0000","last_became_peered":"2023-09-13T06:02:17.756751+0000","last_unstale":"2023-09-13T06:02:17.757236+0000","last_undegraded":"2023-09-13T06:02:17.757236+0000","last_fullsized":"2023-09-13T06:02:17.757236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:03:55.320781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763080+0000","last_change":"2023-09-13T06:02:17.763080+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763080+0000","last_undegraded":"2023-09-13T06:02:17.763080+0000","last_fullsized":"2023-09-13T06:02:17.763080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.756148+0000","last_change":"2023-09-13T06:02:17.756021+0000","last_active":"2023-09-13T06:02:17.756148+0000","last_peered":"2023-09-13T06:02:17.756148+0000","last_clean":"2023-09-13T06:02:17.756148+0000","last_became_active":"2023-09-13T06:02:17.755754+0000","last_became_peered":"2023-09-13T06:02:17.755754+0000","last_unstale":"2023-09-13T06:02:17.756148+0000","last_undegraded":"2023-09-13T06:02:17.756148+0000","last_fullsized":"2023-09-13T06:02:17.756148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:49.936804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762416+0000","last_change":"2023-09-13T06:02:17.762416+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762416+0000","last_undegraded":"2023-09-13T06:02:17.762416+0000","last_fullsized":"2023-09-13T06:02:17.762416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765712+0000","last_change":"2023-09-13T06:02:17.765596+0000","last_active":"2023-09-13T06:02:17.765712+0000","last_peered":"2023-09-13T06:02:17.765712+0000","last_clean":"2023-09-13T06:02:17.765712+0000","last_became_active":"2023-09-13T06:02:17.764626+0000","last_became_peered":"2023-09-13T06:02:17.764626+0000","last_unstale":"2023-09-13T06:02:17.765712+0000","last_undegraded":"2023-09-13T06:02:17.765712+0000","last_fullsized":"2023-09-13T06:02:17.765712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:18:57.717040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754042+0000","last_change":"2023-09-13T06:02:17.754042+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754042+0000","last_undegraded":"2023-09-13T06:02:17.754042+0000","last_fullsized":"2023-09-13T06:02:17.754042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760403+0000","last_change":"2023-09-13T06:02:17.760344+0000","last_active":"2023-09-13T06:02:17.760403+0000","last_peered":"2023-09-13T06:02:17.760403+0000","last_clean":"2023-09-13T06:02:17.760403+0000","last_became_active":"2023-09-13T06:02:17.760112+0000","last_became_peered":"2023-09-13T06:02:17.760112+0000","last_unstale":"2023-09-13T06:02:17.760403+0000","last_undegraded":"2023-09-13T06:02:17.760403+0000","last_fullsized":"2023-09-13T06:02:17.760403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:35:44.141658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762674+0000","last_change":"2023-09-13T06:02:17.762674+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762674+0000","last_undegraded":"2023-09-13T06:02:17.762674+0000","last_fullsized":"2023-09-13T06:02:17.762674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757398+0000","last_change":"2023-09-13T06:02:17.757230+0000","last_active":"2023-09-13T06:02:17.757398+0000","last_peered":"2023-09-13T06:02:17.757398+0000","last_clean":"2023-09-13T06:02:17.757398+0000","last_became_active":"2023-09-13T06:02:17.756995+0000","last_became_peered":"2023-09-13T06:02:17.756995+0000","last_unstale":"2023-09-13T06:02:17.757398+0000","last_undegraded":"2023-09-13T06:02:17.757398+0000","last_fullsized":"2023-09-13T06:02:17.757398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763849+0000","last_change":"2023-09-13T06:02:17.763849+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763849+0000","last_undegraded":"2023-09-13T06:02:17.763849+0000","last_fullsized":"2023-09-13T06:02:17.763849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760875+0000","last_change":"2023-09-13T06:02:17.760513+0000","last_active":"2023-09-13T06:02:17.760875+0000","last_peered":"2023-09-13T06:02:17.760875+0000","last_clean":"2023-09-13T06:02:17.760875+0000","last_became_active":"2023-09-13T06:02:17.759698+0000","last_became_peered":"2023-09-13T06:02:17.759698+0000","last_unstale":"2023-09-13T06:02:17.760875+0000","last_undegraded":"2023-09-13T06:02:17.760875+0000","last_fullsized":"2023-09-13T06:02:17.760875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:36:09.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753498+0000","last_change":"2023-09-13T06:02:17.753498+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753498+0000","last_undegraded":"2023-09-13T06:02:17.753498+0000","last_fullsized":"2023-09-13T06:02:17.753498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758829+0000","last_change":"2023-09-13T06:02:17.758625+0000","last_active":"2023-09-13T06:02:17.758829+0000","last_peered":"2023-09-13T06:02:17.758829+0000","last_clean":"2023-09-13T06:02:17.758829+0000","last_became_active":"2023-09-13T06:02:17.757273+0000","last_became_peered":"2023-09-13T06:02:17.757273+0000","last_unstale":"2023-09-13T06:02:17.758829+0000","last_undegraded":"2023-09-13T06:02:17.758829+0000","last_fullsized":"2023-09-13T06:02:17.758829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:06.883601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763737+0000","last_change":"2023-09-13T06:02:17.763737+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763737+0000","last_undegraded":"2023-09-13T06:02:17.763737+0000","last_fullsized":"2023-09-13T06:02:17.763737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765479+0000","last_change":"2023-09-13T06:02:17.765217+0000","last_active":"2023-09-13T06:02:17.765479+0000","last_peered":"2023-09-13T06:02:17.765479+0000","last_clean":"2023-09-13T06:02:17.765479+0000","last_became_active":"2023-09-13T06:02:17.764324+0000","last_became_peered":"2023-09-13T06:02:17.764324+0000","last_unstale":"2023-09-13T06:02:17.765479+0000","last_undegraded":"2023-09-13T06:02:17.765479+0000","last_fullsized":"2023-09-13T06:02:17.765479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:13:15.204110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762341+0000","last_change":"2023-09-13T06:02:17.762341+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762341+0000","last_undegraded":"2023-09-13T06:02:17.762341+0000","last_fullsized":"2023-09-13T06:02:17.762341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.764568+0000","last_change":"2023-09-13T06:02:17.763991+0000","last_active":"2023-09-13T06:02:17.764568+0000","last_peered":"2023-09-13T06:02:17.764568+0000","last_clean":"2023-09-13T06:02:17.764568+0000","last_became_active":"2023-09-13T06:02:17.762961+0000","last_became_peered":"2023-09-13T06:02:17.762961+0000","last_unstale":"2023-09-13T06:02:17.764568+0000","last_undegraded":"2023-09-13T06:02:17.764568+0000","last_fullsized":"2023-09-13T06:02:17.764568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753319+0000","last_change":"2023-09-13T06:02:17.753319+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753319+0000","last_undegraded":"2023-09-13T06:02:17.753319+0000","last_fullsized":"2023-09-13T06:02:17.753319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760385+0000","last_change":"2023-09-13T06:02:17.760312+0000","last_active":"2023-09-13T06:02:17.760385+0000","last_peered":"2023-09-13T06:02:17.760385+0000","last_clean":"2023-09-13T06:02:17.760385+0000","last_became_active":"2023-09-13T06:02:17.760047+0000","last_became_peered":"2023-09-13T06:02:17.760047+0000","last_unstale":"2023-09-13T06:02:17.760385+0000","last_undegraded":"2023-09-13T06:02:17.760385+0000","last_fullsized":"2023-09-13T06:02:17.760385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758771+0000","last_change":"2023-09-13T06:02:17.758771+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758771+0000","last_undegraded":"2023-09-13T06:02:17.758771+0000","last_fullsized":"2023-09-13T06:02:17.758771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757360+0000","last_change":"2023-09-13T06:02:17.757243+0000","last_active":"2023-09-13T06:02:17.757360+0000","last_peered":"2023-09-13T06:02:17.757360+0000","last_clean":"2023-09-13T06:02:17.757360+0000","last_became_active":"2023-09-13T06:02:17.757000+0000","last_became_peered":"2023-09-13T06:02:17.757000+0000","last_unstale":"2023-09-13T06:02:17.757360+0000","last_undegraded":"2023-09-13T06:02:17.757360+0000","last_fullsized":"2023-09-13T06:02:17.757360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:40.428906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762681+0000","last_change":"2023-09-13T06:02:17.762681+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762681+0000","last_undegraded":"2023-09-13T06:02:17.762681+0000","last_fullsized":"2023-09-13T06:02:17.762681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760270+0000","last_change":"2023-09-13T06:02:17.759850+0000","last_active":"2023-09-13T06:02:17.760270+0000","last_peered":"2023-09-13T06:02:17.760270+0000","last_clean":"2023-09-13T06:02:17.760270+0000","last_became_active":"2023-09-13T06:02:17.759571+0000","last_became_peered":"2023-09-13T06:02:17.759571+0000","last_unstale":"2023-09-13T06:02:17.760270+0000","last_undegraded":"2023-09-13T06:02:17.760270+0000","last_fullsized":"2023-09-13T06:02:17.760270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752931+0000","last_change":"2023-09-13T06:02:17.752931+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752931+0000","last_undegraded":"2023-09-13T06:02:17.752931+0000","last_fullsized":"2023-09-13T06:02:17.752931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762227+0000","last_change":"2023-09-13T06:02:17.761635+0000","last_active":"2023-09-13T06:02:17.762227+0000","last_peered":"2023-09-13T06:02:17.762227+0000","last_clean":"2023-09-13T06:02:17.762227+0000","last_became_active":"2023-09-13T06:02:17.761041+0000","last_became_peered":"2023-09-13T06:02:17.761041+0000","last_unstale":"2023-09-13T06:02:17.762227+0000","last_undegraded":"2023-09-13T06:02:17.762227+0000","last_fullsized":"2023-09-13T06:02:17.762227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:49:26.757377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762311+0000","last_change":"2023-09-13T06:02:17.762311+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762311+0000","last_undegraded":"2023-09-13T06:02:17.762311+0000","last_fullsized":"2023-09-13T06:02:17.762311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760931+0000","last_change":"2023-09-13T06:02:17.760800+0000","last_active":"2023-09-13T06:02:17.760931+0000","last_peered":"2023-09-13T06:02:17.760931+0000","last_clean":"2023-09-13T06:02:17.760931+0000","last_became_active":"2023-09-13T06:02:17.760585+0000","last_became_peered":"2023-09-13T06:02:17.760585+0000","last_unstale":"2023-09-13T06:02:17.760931+0000","last_undegraded":"2023-09-13T06:02:17.760931+0000","last_fullsized":"2023-09-13T06:02:17.760931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:48.120438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752434+0000","last_change":"2023-09-13T06:02:17.752434+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752434+0000","last_undegraded":"2023-09-13T06:02:17.752434+0000","last_fullsized":"2023-09-13T06:02:17.752434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760363+0000","last_change":"2023-09-13T06:02:17.760200+0000","last_active":"2023-09-13T06:02:17.760363+0000","last_peered":"2023-09-13T06:02:17.760363+0000","last_clean":"2023-09-13T06:02:17.760363+0000","last_became_active":"2023-09-13T06:02:17.759800+0000","last_became_peered":"2023-09-13T06:02:17.759800+0000","last_unstale":"2023-09-13T06:02:17.760363+0000","last_undegraded":"2023-09-13T06:02:17.760363+0000","last_fullsized":"2023-09-13T06:02:17.760363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:53:23.415803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.751719+0000","last_change":"2023-09-13T06:02:17.751719+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.751719+0000","last_undegraded":"2023-09-13T06:02:17.751719+0000","last_fullsized":"2023-09-13T06:02:17.751719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757379+0000","last_change":"2023-09-13T06:02:17.757106+0000","last_active":"2023-09-13T06:02:17.757379+0000","last_peered":"2023-09-13T06:02:17.757379+0000","last_clean":"2023-09-13T06:02:17.757379+0000","last_became_active":"2023-09-13T06:02:17.756876+0000","last_became_peered":"2023-09-13T06:02:17.756876+0000","last_unstale":"2023-09-13T06:02:17.757379+0000","last_undegraded":"2023-09-13T06:02:17.757379+0000","last_fullsized":"2023-09-13T06:02:17.757379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752081+0000","last_change":"2023-09-13T06:02:17.752081+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752081+0000","last_undegraded":"2023-09-13T06:02:17.752081+0000","last_fullsized":"2023-09-13T06:02:17.752081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765089+0000","last_change":"2023-09-13T06:02:17.764974+0000","last_active":"2023-09-13T06:02:17.765089+0000","last_peered":"2023-09-13T06:02:17.765089+0000","last_clean":"2023-09-13T06:02:17.765089+0000","last_became_active":"2023-09-13T06:02:17.764364+0000","last_became_peered":"2023-09-13T06:02:17.764364+0000","last_unstale":"2023-09-13T06:02:17.765089+0000","last_undegraded":"2023-09-13T06:02:17.765089+0000","last_fullsized":"2023-09-13T06:02:17.765089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:37:09.637327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752086+0000","last_change":"2023-09-13T06:02:17.752086+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752086+0000","last_undegraded":"2023-09-13T06:02:17.752086+0000","last_fullsized":"2023-09-13T06:02:17.752086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762247+0000","last_change":"2023-09-13T06:02:17.761800+0000","last_active":"2023-09-13T06:02:17.762247+0000","last_peered":"2023-09-13T06:02:17.762247+0000","last_clean":"2023-09-13T06:02:17.762247+0000","last_became_active":"2023-09-13T06:02:17.761387+0000","last_became_peered":"2023-09-13T06:02:17.761387+0000","last_unstale":"2023-09-13T06:02:17.762247+0000","last_undegraded":"2023-09-13T06:02:17.762247+0000","last_fullsized":"2023-09-13T06:02:17.762247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:00:07.340159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752926+0000","last_change":"2023-09-13T06:02:17.752926+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752926+0000","last_undegraded":"2023-09-13T06:02:17.752926+0000","last_fullsized":"2023-09-13T06:02:17.752926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757398+0000","last_change":"2023-09-13T06:02:17.757279+0000","last_active":"2023-09-13T06:02:17.757398+0000","last_peered":"2023-09-13T06:02:17.757398+0000","last_clean":"2023-09-13T06:02:17.757398+0000","last_became_active":"2023-09-13T06:02:17.757046+0000","last_became_peered":"2023-09-13T06:02:17.757046+0000","last_unstale":"2023-09-13T06:02:17.757398+0000","last_undegraded":"2023-09-13T06:02:17.757398+0000","last_fullsized":"2023-09-13T06:02:17.757398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:06.883601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.751741+0000","last_change":"2023-09-13T06:02:17.751741+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.751741+0000","last_undegraded":"2023-09-13T06:02:17.751741+0000","last_fullsized":"2023-09-13T06:02:17.751741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762269+0000","last_change":"2023-09-13T06:02:17.761961+0000","last_active":"2023-09-13T06:02:17.762269+0000","last_peered":"2023-09-13T06:02:17.762269+0000","last_clean":"2023-09-13T06:02:17.762269+0000","last_became_active":"2023-09-13T06:02:17.760216+0000","last_became_peered":"2023-09-13T06:02:17.760216+0000","last_unstale":"2023-09-13T06:02:17.762269+0000","last_undegraded":"2023-09-13T06:02:17.762269+0000","last_fullsized":"2023-09-13T06:02:17.762269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754405+0000","last_change":"2023-09-13T06:02:17.754405+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754405+0000","last_undegraded":"2023-09-13T06:02:17.754405+0000","last_fullsized":"2023-09-13T06:02:17.754405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758176+0000","last_change":"2023-09-13T06:02:17.758069+0000","last_active":"2023-09-13T06:02:17.758176+0000","last_peered":"2023-09-13T06:02:17.758176+0000","last_clean":"2023-09-13T06:02:17.758176+0000","last_became_active":"2023-09-13T06:02:17.757840+0000","last_became_peered":"2023-09-13T06:02:17.757840+0000","last_unstale":"2023-09-13T06:02:17.758176+0000","last_undegraded":"2023-09-13T06:02:17.758176+0000","last_fullsized":"2023-09-13T06:02:17.758176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762640+0000","last_change":"2023-09-13T06:02:17.762640+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762640+0000","last_undegraded":"2023-09-13T06:02:17.762640+0000","last_fullsized":"2023-09-13T06:02:17.762640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758599+0000","last_change":"2023-09-13T06:02:17.758184+0000","last_active":"2023-09-13T06:02:17.758599+0000","last_peered":"2023-09-13T06:02:17.758599+0000","last_clean":"2023-09-13T06:02:17.758599+0000","last_became_active":"2023-09-13T06:02:17.757752+0000","last_became_peered":"2023-09-13T06:02:17.757752+0000","last_unstale":"2023-09-13T06:02:17.758599+0000","last_undegraded":"2023-09-13T06:02:17.758599+0000","last_fullsized":"2023-09-13T06:02:17.758599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:35:44.141658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758385+0000","last_change":"2023-09-13T06:02:17.758385+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758385+0000","last_undegraded":"2023-09-13T06:02:17.758385+0000","last_fullsized":"2023-09-13T06:02:17.758385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760898+0000","last_change":"2023-09-13T06:02:17.759047+0000","last_active":"2023-09-13T06:02:17.760898+0000","last_peered":"2023-09-13T06:02:17.760898+0000","last_clean":"2023-09-13T06:02:17.760898+0000","last_became_active":"2023-09-13T06:02:17.758821+0000","last_became_peered":"2023-09-13T06:02:17.758821+0000","last_unstale":"2023-09-13T06:02:17.760898+0000","last_undegraded":"2023-09-13T06:02:17.760898+0000","last_fullsized":"2023-09-13T06:02:17.760898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:13.821905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762222+0000","last_change":"2023-09-13T06:02:17.762222+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762222+0000","last_undegraded":"2023-09-13T06:02:17.762222+0000","last_fullsized":"2023-09-13T06:02:17.762222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.763378+0000","last_change":"2023-09-13T06:02:17.762871+0000","last_active":"2023-09-13T06:02:17.763378+0000","last_peered":"2023-09-13T06:02:17.763378+0000","last_clean":"2023-09-13T06:02:17.763378+0000","last_became_active":"2023-09-13T06:02:17.761720+0000","last_became_peered":"2023-09-13T06:02:17.761720+0000","last_unstale":"2023-09-13T06:02:17.763378+0000","last_undegraded":"2023-09-13T06:02:17.763378+0000","last_fullsized":"2023-09-13T06:02:17.763378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:13.821905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763035+0000","last_change":"2023-09-13T06:02:17.763035+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763035+0000","last_undegraded":"2023-09-13T06:02:17.763035+0000","last_fullsized":"2023-09-13T06:02:17.763035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.763920+0000","last_change":"2023-09-13T06:02:17.763666+0000","last_active":"2023-09-13T06:02:17.763920+0000","last_peered":"2023-09-13T06:02:17.763920+0000","last_clean":"2023-09-13T06:02:17.763920+0000","last_became_active":"2023-09-13T06:02:17.763447+0000","last_became_peered":"2023-09-13T06:02:17.763447+0000","last_unstale":"2023-09-13T06:02:17.763920+0000","last_undegraded":"2023-09-13T06:02:17.763920+0000","last_fullsized":"2023-09-13T06:02:17.763920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:23:06.205141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763136+0000","last_change":"2023-09-13T06:02:17.763136+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763136+0000","last_undegraded":"2023-09-13T06:02:17.763136+0000","last_fullsized":"2023-09-13T06:02:17.763136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758845+0000","last_change":"2023-09-13T06:02:17.758766+0000","last_active":"2023-09-13T06:02:17.758845+0000","last_peered":"2023-09-13T06:02:17.758845+0000","last_clean":"2023-09-13T06:02:17.758845+0000","last_became_active":"2023-09-13T06:02:17.758343+0000","last_became_peered":"2023-09-13T06:02:17.758343+0000","last_unstale":"2023-09-13T06:02:17.758845+0000","last_undegraded":"2023-09-13T06:02:17.758845+0000","last_fullsized":"2023-09-13T06:02:17.758845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752539+0000","last_change":"2023-09-13T06:02:17.752539+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752539+0000","last_undegraded":"2023-09-13T06:02:17.752539+0000","last_fullsized":"2023-09-13T06:02:17.752539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765268+0000","last_change":"2023-09-13T06:02:17.765194+0000","last_active":"2023-09-13T06:02:17.765268+0000","last_peered":"2023-09-13T06:02:17.765268+0000","last_clean":"2023-09-13T06:02:17.765268+0000","last_became_active":"2023-09-13T06:02:17.764751+0000","last_became_peered":"2023-09-13T06:02:17.764751+0000","last_unstale":"2023-09-13T06:02:17.765268+0000","last_undegraded":"2023-09-13T06:02:17.765268+0000","last_fullsized":"2023-09-13T06:02:17.765268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-09-13T06:02:16.750081+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:02:16.750081+0000","last_peered":"2023-09-13T06:02:16.750081+0000","last_clean":"2023-09-13T06:02:16.750081+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:02:16.750081+0000","last_undegraded":"2023-09-13T06:02:16.750081+0000","last_fullsized":"2023-09-13T06:02:16.750081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194613,"statfs":{"total":200000000,"available":199284106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.875}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.82899999999999996}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.627},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.57999999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.89500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70299999999999996}]},{"osd":1,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.77000000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.74399999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.75900000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55600000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.623},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.89100000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.76800000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.91000000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.97999999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.78800000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.86599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.629},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.77600000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.85799999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.875},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.81799999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.90400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40699999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.751}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.873}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.30299999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.38900000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.66500000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.502},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.435}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.70499999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.77300000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194613,"statfs":{"total":200000000,"available":199284106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45700000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51400000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.872},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.75800000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.82499999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.73499999999999999}]}]}],"pool_statfs":[]}} 2023-09-13T06:02:23.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-09-13T06:02:23.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.759190+0000', 'last_change': '2023-09-13T06:02:17.759190+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.759190+0000', 'last_undegraded': '2023-09-13T06:02:17.759190+0000', 'last_fullsized': '2023-09-13T06:02:17.759190+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-09-13T06:02:23.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-09-13T06:02:23.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.763540+0000', 'last_change': '2023-09-13T06:02:17.763540+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.763540+0000', 'last_undegraded': '2023-09-13T06:02:17.763540+0000', 'last_fullsized': '2023-09-13T06:02:17.763540+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-13T06:02:23.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-09-13T06:02:23.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.753181+0000', 'last_change': '2023-09-13T06:02:17.753181+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.753181+0000', 'last_undegraded': '2023-09-13T06:02:17.753181+0000', 'last_fullsized': '2023-09-13T06:02:17.753181+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:02:23.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-09-13T06:02:23.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762726+0000', 'last_change': '2023-09-13T06:02:17.762726+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762726+0000', 'last_undegraded': '2023-09-13T06:02:17.762726+0000', 'last_fullsized': '2023-09-13T06:02:17.762726+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-13T06:02:23.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-09-13T06:02:23.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.753181+0000', 'last_change': '2023-09-13T06:02:17.753181+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.753181+0000', 'last_undegraded': '2023-09-13T06:02:17.753181+0000', 'last_fullsized': '2023-09-13T06:02:17.753181+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-13T06:02:23.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-09-13T06:02:23.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.763304+0000', 'last_change': '2023-09-13T06:02:17.763304+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.763304+0000', 'last_undegraded': '2023-09-13T06:02:17.763304+0000', 'last_fullsized': '2023-09-13T06:02:17.763304+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-13T06:02:23.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-09-13T06:02:23.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.754030+0000', 'last_change': '2023-09-13T06:02:17.754030+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.754030+0000', 'last_undegraded': '2023-09-13T06:02:17.754030+0000', 'last_fullsized': '2023-09-13T06:02:17.754030+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:02:23.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-09-13T06:02:23.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.756115+0000', 'last_change': '2023-09-13T06:02:17.756115+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.756115+0000', 'last_undegraded': '2023-09-13T06:02:17.756115+0000', 'last_fullsized': '2023-09-13T06:02:17.756115+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:02:23.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-09-13T06:02:23.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762849+0000', 'last_change': '2023-09-13T06:02:17.762849+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762849+0000', 'last_undegraded': '2023-09-13T06:02:17.762849+0000', 'last_fullsized': '2023-09-13T06:02:17.762849+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:02:23.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-09-13T06:02:23.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.763164+0000', 'last_change': '2023-09-13T06:02:17.763164+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.763164+0000', 'last_undegraded': '2023-09-13T06:02:17.763164+0000', 'last_fullsized': '2023-09-13T06:02:17.763164+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-13T06:02:23.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-09-13T06:02:23.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.754028+0000', 'last_change': '2023-09-13T06:02:17.754028+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.754028+0000', 'last_undegraded': '2023-09-13T06:02:17.754028+0000', 'last_fullsized': '2023-09-13T06:02:17.754028+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:02:23.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-09-13T06:02:23.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.755004+0000', 'last_change': '2023-09-13T06:02:17.755004+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.755004+0000', 'last_undegraded': '2023-09-13T06:02:17.755004+0000', 'last_fullsized': '2023-09-13T06:02:17.755004+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:02:23.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-09-13T06:02:23.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.752513+0000', 'last_change': '2023-09-13T06:02:17.752513+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.752513+0000', 'last_undegraded': '2023-09-13T06:02:17.752513+0000', 'last_fullsized': '2023-09-13T06:02:17.752513+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-13T06:02:23.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-09-13T06:02:23.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.764449+0000', 'last_change': '2023-09-13T06:02:17.764449+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.764449+0000', 'last_undegraded': '2023-09-13T06:02:17.764449+0000', 'last_fullsized': '2023-09-13T06:02:17.764449+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-13T06:02:23.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-09-13T06:02:23.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.752472+0000', 'last_change': '2023-09-13T06:02:17.752472+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.752472+0000', 'last_undegraded': '2023-09-13T06:02:17.752472+0000', 'last_fullsized': '2023-09-13T06:02:17.752472+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:02:23.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-09-13T06:02:23.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.753663+0000', 'last_change': '2023-09-13T06:02:17.753663+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.753663+0000', 'last_undegraded': '2023-09-13T06:02:17.753663+0000', 'last_fullsized': '2023-09-13T06:02:17.753663+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:02:23.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-09-13T06:02:23.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.753759+0000', 'last_change': '2023-09-13T06:02:17.753759+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.753759+0000', 'last_undegraded': '2023-09-13T06:02:17.753759+0000', 'last_fullsized': '2023-09-13T06:02:17.753759+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:02:23.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-09-13T06:02:23.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762486+0000', 'last_change': '2023-09-13T06:02:17.762486+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762486+0000', 'last_undegraded': '2023-09-13T06:02:17.762486+0000', 'last_fullsized': '2023-09-13T06:02:17.762486+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-13T06:02:23.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-09-13T06:02:23.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.764146+0000', 'last_change': '2023-09-13T06:02:17.764146+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.764146+0000', 'last_undegraded': '2023-09-13T06:02:17.764146+0000', 'last_fullsized': '2023-09-13T06:02:17.764146+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-13T06:02:23.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-09-13T06:02:23.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.752466+0000', 'last_change': '2023-09-13T06:02:17.752466+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.752466+0000', 'last_undegraded': '2023-09-13T06:02:17.752466+0000', 'last_fullsized': '2023-09-13T06:02:17.752466+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-13T06:02:23.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-09-13T06:02:23.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762542+0000', 'last_change': '2023-09-13T06:02:17.762542+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762542+0000', 'last_undegraded': '2023-09-13T06:02:17.762542+0000', 'last_fullsized': '2023-09-13T06:02:17.762542+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:02:23.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-09-13T06:02:23.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762008+0000', 'last_change': '2023-09-13T06:02:17.762008+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762008+0000', 'last_undegraded': '2023-09-13T06:02:17.762008+0000', 'last_fullsized': '2023-09-13T06:02:17.762008+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:02:23.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-09-13T06:02:23.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762227+0000', 'last_change': '2023-09-13T06:02:17.762227+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762227+0000', 'last_undegraded': '2023-09-13T06:02:17.762227+0000', 'last_fullsized': '2023-09-13T06:02:17.762227+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-13T06:02:23.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-09-13T06:02:23.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.753330+0000', 'last_change': '2023-09-13T06:02:17.753330+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.753330+0000', 'last_undegraded': '2023-09-13T06:02:17.753330+0000', 'last_fullsized': '2023-09-13T06:02:17.753330+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:02:23.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-09-13T06:02:23.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762825+0000', 'last_change': '2023-09-13T06:02:17.762825+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762825+0000', 'last_undegraded': '2023-09-13T06:02:17.762825+0000', 'last_fullsized': '2023-09-13T06:02:17.762825+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-13T06:02:23.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-09-13T06:02:23.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762962+0000', 'last_change': '2023-09-13T06:02:17.762962+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762962+0000', 'last_undegraded': '2023-09-13T06:02:17.762962+0000', 'last_fullsized': '2023-09-13T06:02:17.762962+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-13T06:02:23.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-09-13T06:02:23.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762687+0000', 'last_change': '2023-09-13T06:02:17.762687+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762687+0000', 'last_undegraded': '2023-09-13T06:02:17.762687+0000', 'last_fullsized': '2023-09-13T06:02:17.762687+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-13T06:02:23.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-09-13T06:02:23.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.753851+0000', 'last_change': '2023-09-13T06:02:17.753851+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.753851+0000', 'last_undegraded': '2023-09-13T06:02:17.753851+0000', 'last_fullsized': '2023-09-13T06:02:17.753851+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:02:23.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-09-13T06:02:23.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762453+0000', 'last_change': '2023-09-13T06:02:17.762453+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762453+0000', 'last_undegraded': '2023-09-13T06:02:17.762453+0000', 'last_fullsized': '2023-09-13T06:02:17.762453+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:02:23.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-09-13T06:02:23.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.753307+0000', 'last_change': '2023-09-13T06:02:17.753307+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.753307+0000', 'last_undegraded': '2023-09-13T06:02:17.753307+0000', 'last_fullsized': '2023-09-13T06:02:17.753307+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:02:23.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-09-13T06:02:23.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.758841+0000', 'last_change': '2023-09-13T06:02:17.758841+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.758841+0000', 'last_undegraded': '2023-09-13T06:02:17.758841+0000', 'last_fullsized': '2023-09-13T06:02:17.758841+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-09-13T06:02:23.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-09-13T06:02:23.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.753310+0000', 'last_change': '2023-09-13T06:02:17.753310+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.753310+0000', 'last_undegraded': '2023-09-13T06:02:17.753310+0000', 'last_fullsized': '2023-09-13T06:02:17.753310+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:02:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-09-13T06:02:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762978+0000', 'last_change': '2023-09-13T06:02:17.762978+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762978+0000', 'last_undegraded': '2023-09-13T06:02:17.762978+0000', 'last_fullsized': '2023-09-13T06:02:17.762978+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-13T06:02:23.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-09-13T06:02:23.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.759621+0000', 'last_change': '2023-09-13T06:02:17.759621+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.759621+0000', 'last_undegraded': '2023-09-13T06:02:17.759621+0000', 'last_fullsized': '2023-09-13T06:02:17.759621+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-09-13T06:02:23.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-09-13T06:02:23.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.761926+0000', 'last_change': '2023-09-13T06:02:17.761926+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.761926+0000', 'last_undegraded': '2023-09-13T06:02:17.761926+0000', 'last_fullsized': '2023-09-13T06:02:17.761926+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:02:23.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-09-13T06:02:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762517+0000', 'last_change': '2023-09-13T06:02:17.762517+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762517+0000', 'last_undegraded': '2023-09-13T06:02:17.762517+0000', 'last_fullsized': '2023-09-13T06:02:17.762517+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-13T06:02:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-09-13T06:02:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.755778+0000', 'last_change': '2023-09-13T06:02:17.755778+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.755778+0000', 'last_undegraded': '2023-09-13T06:02:17.755778+0000', 'last_fullsized': '2023-09-13T06:02:17.755778+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:02:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-09-13T06:02:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.754695+0000', 'last_change': '2023-09-13T06:02:17.754695+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.754695+0000', 'last_undegraded': '2023-09-13T06:02:17.754695+0000', 'last_fullsized': '2023-09-13T06:02:17.754695+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:02:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-09-13T06:02:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.763080+0000', 'last_change': '2023-09-13T06:02:17.763080+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.763080+0000', 'last_undegraded': '2023-09-13T06:02:17.763080+0000', 'last_fullsized': '2023-09-13T06:02:17.763080+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:02:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-09-13T06:02:23.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762416+0000', 'last_change': '2023-09-13T06:02:17.762416+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762416+0000', 'last_undegraded': '2023-09-13T06:02:17.762416+0000', 'last_fullsized': '2023-09-13T06:02:17.762416+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-13T06:02:23.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-09-13T06:02:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.754042+0000', 'last_change': '2023-09-13T06:02:17.754042+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.754042+0000', 'last_undegraded': '2023-09-13T06:02:17.754042+0000', 'last_fullsized': '2023-09-13T06:02:17.754042+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:02:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-09-13T06:02:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762674+0000', 'last_change': '2023-09-13T06:02:17.762674+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762674+0000', 'last_undegraded': '2023-09-13T06:02:17.762674+0000', 'last_fullsized': '2023-09-13T06:02:17.762674+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-13T06:02:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-09-13T06:02:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.763849+0000', 'last_change': '2023-09-13T06:02:17.763849+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.763849+0000', 'last_undegraded': '2023-09-13T06:02:17.763849+0000', 'last_fullsized': '2023-09-13T06:02:17.763849+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-13T06:02:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-09-13T06:02:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.753498+0000', 'last_change': '2023-09-13T06:02:17.753498+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.753498+0000', 'last_undegraded': '2023-09-13T06:02:17.753498+0000', 'last_fullsized': '2023-09-13T06:02:17.753498+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:02:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-09-13T06:02:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.763737+0000', 'last_change': '2023-09-13T06:02:17.763737+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.763737+0000', 'last_undegraded': '2023-09-13T06:02:17.763737+0000', 'last_fullsized': '2023-09-13T06:02:17.763737+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-13T06:02:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-09-13T06:02:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762341+0000', 'last_change': '2023-09-13T06:02:17.762341+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762341+0000', 'last_undegraded': '2023-09-13T06:02:17.762341+0000', 'last_fullsized': '2023-09-13T06:02:17.762341+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-13T06:02:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-09-13T06:02:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.753319+0000', 'last_change': '2023-09-13T06:02:17.753319+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.753319+0000', 'last_undegraded': '2023-09-13T06:02:17.753319+0000', 'last_fullsized': '2023-09-13T06:02:17.753319+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:02:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-09-13T06:02:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.758771+0000', 'last_change': '2023-09-13T06:02:17.758771+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.758771+0000', 'last_undegraded': '2023-09-13T06:02:17.758771+0000', 'last_fullsized': '2023-09-13T06:02:17.758771+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-09-13T06:02:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-09-13T06:02:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762681+0000', 'last_change': '2023-09-13T06:02:17.762681+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762681+0000', 'last_undegraded': '2023-09-13T06:02:17.762681+0000', 'last_fullsized': '2023-09-13T06:02:17.762681+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:02:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-09-13T06:02:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.752931+0000', 'last_change': '2023-09-13T06:02:17.752931+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.752931+0000', 'last_undegraded': '2023-09-13T06:02:17.752931+0000', 'last_fullsized': '2023-09-13T06:02:17.752931+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:02:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-09-13T06:02:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762311+0000', 'last_change': '2023-09-13T06:02:17.762311+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762311+0000', 'last_undegraded': '2023-09-13T06:02:17.762311+0000', 'last_fullsized': '2023-09-13T06:02:17.762311+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-13T06:02:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-09-13T06:02:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.752434+0000', 'last_change': '2023-09-13T06:02:17.752434+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.752434+0000', 'last_undegraded': '2023-09-13T06:02:17.752434+0000', 'last_fullsized': '2023-09-13T06:02:17.752434+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-13T06:02:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-09-13T06:02:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.751719+0000', 'last_change': '2023-09-13T06:02:17.751719+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.751719+0000', 'last_undegraded': '2023-09-13T06:02:17.751719+0000', 'last_fullsized': '2023-09-13T06:02:17.751719+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-13T06:02:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-09-13T06:02:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.752081+0000', 'last_change': '2023-09-13T06:02:17.752081+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.752081+0000', 'last_undegraded': '2023-09-13T06:02:17.752081+0000', 'last_fullsized': '2023-09-13T06:02:17.752081+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-13T06:02:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-09-13T06:02:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.752086+0000', 'last_change': '2023-09-13T06:02:17.752086+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.752086+0000', 'last_undegraded': '2023-09-13T06:02:17.752086+0000', 'last_fullsized': '2023-09-13T06:02:17.752086+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-13T06:02:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-09-13T06:02:23.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.752926+0000', 'last_change': '2023-09-13T06:02:17.752926+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.752926+0000', 'last_undegraded': '2023-09-13T06:02:17.752926+0000', 'last_fullsized': '2023-09-13T06:02:17.752926+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:02:23.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-09-13T06:02:23.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.751741+0000', 'last_change': '2023-09-13T06:02:17.751741+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.751741+0000', 'last_undegraded': '2023-09-13T06:02:17.751741+0000', 'last_fullsized': '2023-09-13T06:02:17.751741+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-13T06:02:23.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-09-13T06:02:23.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.754405+0000', 'last_change': '2023-09-13T06:02:17.754405+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.754405+0000', 'last_undegraded': '2023-09-13T06:02:17.754405+0000', 'last_fullsized': '2023-09-13T06:02:17.754405+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:02:23.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-09-13T06:02:23.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762640+0000', 'last_change': '2023-09-13T06:02:17.762640+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762640+0000', 'last_undegraded': '2023-09-13T06:02:17.762640+0000', 'last_fullsized': '2023-09-13T06:02:17.762640+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-13T06:02:23.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-09-13T06:02:23.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.758385+0000', 'last_change': '2023-09-13T06:02:17.758385+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.758385+0000', 'last_undegraded': '2023-09-13T06:02:17.758385+0000', 'last_fullsized': '2023-09-13T06:02:17.758385+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-09-13T06:02:23.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-09-13T06:02:23.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.762222+0000', 'last_change': '2023-09-13T06:02:17.762222+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.762222+0000', 'last_undegraded': '2023-09-13T06:02:17.762222+0000', 'last_fullsized': '2023-09-13T06:02:17.762222+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-13T06:02:23.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-09-13T06:02:23.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.763035+0000', 'last_change': '2023-09-13T06:02:17.763035+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.763035+0000', 'last_undegraded': '2023-09-13T06:02:17.763035+0000', 'last_fullsized': '2023-09-13T06:02:17.763035+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-13T06:02:23.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-09-13T06:02:23.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.763136+0000', 'last_change': '2023-09-13T06:02:17.763136+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.763136+0000', 'last_undegraded': '2023-09-13T06:02:17.763136+0000', 'last_fullsized': '2023-09-13T06:02:17.763136+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:02:23.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-09-13T06:02:23.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:17.752539+0000', 'last_change': '2023-09-13T06:02:17.752539+0000', 'last_active': '2023-09-13T06:02:17.745565+0000', 'last_peered': '2023-09-13T06:02:17.745565+0000', 'last_clean': '2023-09-13T06:02:17.745565+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:17.752539+0000', 'last_undegraded': '2023-09-13T06:02:17.752539+0000', 'last_fullsized': '2023-09-13T06:02:17.752539+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:17.745565+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:02:23.714 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-13T06:02:23.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f23a6c07640 1 Processor -- start 2023-09-13T06:02:23.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f23a6c07640 1 -- start start 2023-09-13T06:02:23.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f23a6c07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23a0159f20 0x7f23a00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f23a6c07640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f23a00cdfc0 0x7f23a00b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f23a6c07640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f23a00b1610 0x7f23a00b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f23a6c07640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a00b00f0 con 0x7f23a00cdfc0 2023-09-13T06:02:23.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f23a6c07640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a00ce420 con 0x7f23a00b1610 2023-09-13T06:02:23.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f23a6c07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00b11d0 con 0x7f23a0159f20 2023-09-13T06:02:23.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f2397fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f23a00cdfc0 0x7f23a00b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f2397fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f23a00cdfc0 0x7f23a00b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46352/0 (socket says 172.21.15.130:46352) 2023-09-13T06:02:23.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f2397fff640 1 -- 172.21.15.130:0/1565305163 learned_addr learned my addr 172.21.15.130:0/1565305163 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f23a51a4640 1 --2- 172.21.15.130:0/1565305163 >> v2:172.21.15.164:3300/0 conn(0x7f23a00b1610 0x7f23a00b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f23a49a3640 1 --2- 172.21.15.130:0/1565305163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23a0159f20 0x7f23a00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f2397fff640 1 -- 172.21.15.130:0/1565305163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23a0159f20 msgr2=0x7f23a00ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.848+0000 7f2397fff640 1 --2- 172.21.15.130:0/1565305163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23a0159f20 0x7f23a00ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f2397fff640 1 -- 172.21.15.130:0/1565305163 >> v2:172.21.15.164:3300/0 conn(0x7f23a00b1610 msgr2=0x7f23a00b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:23.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f2397fff640 1 --2- 172.21.15.130:0/1565305163 >> v2:172.21.15.164:3300/0 conn(0x7f23a00b1610 0x7f23a00b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f2397fff640 1 -- 172.21.15.130:0/1565305163 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a00ccfd0 con 0x7f23a00cdfc0 2023-09-13T06:02:23.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f2397fff640 1 --2- 172.21.15.130:0/1565305163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a00cdfc0 0x7f23a00b0c90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f23a00afcc0 tx=0x7f239001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a84a3b9ea43f6b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:23.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23977fe640 1 -- 172.21.15.130:0/1565305163 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23900a7950 con 0x7f23a00cdfc0 2023-09-13T06:02:23.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23977fe640 1 -- 172.21.15.130:0/1565305163 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23900a7ab0 con 0x7f23a00cdfc0 2023-09-13T06:02:23.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23977fe640 1 -- 172.21.15.130:0/1565305163 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23900a7e40 con 0x7f23a00cdfc0 2023-09-13T06:02:23.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23a6c07640 1 -- 172.21.15.130:0/1565305163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a00cdfc0 msgr2=0x7f23a00b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23a6c07640 1 --2- 172.21.15.130:0/1565305163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a00cdfc0 0x7f23a00b0c90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f23a00afcc0 tx=0x7f239001ebd0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23a6c07640 1 -- 172.21.15.130:0/1565305163 shutdown_connections 2023-09-13T06:02:23.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23a6c07640 1 --2- 172.21.15.130:0/1565305163 >> v2:172.21.15.164:3300/0 conn(0x7f23a00b1610 0x7f23a00b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23a6c07640 1 --2- 172.21.15.130:0/1565305163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a00cdfc0 0x7f23a00b0c90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23a6c07640 1 --2- 172.21.15.130:0/1565305163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23a0159f20 0x7f23a00ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23a6c07640 1 -- 172.21.15.130:0/1565305163 >> 172.21.15.130:0/1565305163 conn(0x7f23a0065990 msgr2=0x7f23a0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:23.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23a6c07640 1 -- 172.21.15.130:0/1565305163 shutdown_connections 2023-09-13T06:02:23.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.852+0000 7f23a6c07640 1 -- 172.21.15.130:0/1565305163 wait complete. 2023-09-13T06:02:23.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a6c07640 1 Processor -- start 2023-09-13T06:02:23.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a6c07640 1 -- start start 2023-09-13T06:02:23.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a6c07640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23a00b1610 0x7f23a0147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a6c07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23a00cdfc0 0x7f23a00ac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a6c07640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a0159f20 0x7f23a00ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a6c07640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00a89f0 con 0x7f23a0159f20 2023-09-13T06:02:23.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a6c07640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00acc10 con 0x7f23a00b1610 2023-09-13T06:02:23.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a6c07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00a8c40 con 0x7f23a00cdfc0 2023-09-13T06:02:23.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a51a4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a0159f20 0x7f23a00ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a51a4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a0159f20 0x7f23a00ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46358/0 (socket says 172.21.15.130:46358) 2023-09-13T06:02:23.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a51a4640 1 -- 172.21.15.130:0/1049114633 learned_addr learned my addr 172.21.15.130:0/1049114633 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:23.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a49a3640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23a00b1610 0x7f23a0147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f2397fff640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23a00cdfc0 0x7f23a00ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a51a4640 1 -- 172.21.15.130:0/1049114633 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23a00cdfc0 msgr2=0x7f23a00ac190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a51a4640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23a00cdfc0 0x7f23a00ac190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a51a4640 1 -- 172.21.15.130:0/1049114633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23a00b1610 msgr2=0x7f23a0147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:23.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a51a4640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23a00b1610 0x7f23a0147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:23.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a51a4640 1 -- 172.21.15.130:0/1049114633 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239000b770 con 0x7f23a0159f20 2023-09-13T06:02:23.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23a51a4640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a0159f20 0x7f23a00ac6d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2398007dc0 tx=0x7f239800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:23.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.856+0000 7f23957fa640 1 -- 172.21.15.130:0/1049114633 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398014420 con 0x7f23a0159f20 2023-09-13T06:02:23.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.860+0000 7f23957fa640 1 -- 172.21.15.130:0/1049114633 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23980145a0 con 0x7f23a0159f20 2023-09-13T06:02:23.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.860+0000 7f23957fa640 1 -- 172.21.15.130:0/1049114633 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398014950 con 0x7f23a0159f20 2023-09-13T06:02:23.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.860+0000 7f23a6c07640 1 -- 172.21.15.130:0/1049114633 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a00a8f20 con 0x7f23a0159f20 2023-09-13T06:02:23.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.860+0000 7f23a6c07640 1 -- 172.21.15.130:0/1049114633 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a00a94e0 con 0x7f23a0159f20 2023-09-13T06:02:23.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.860+0000 7f23a6c07640 1 -- 172.21.15.130:0/1049114633 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a00a96d0 con 0x7f23a0159f20 2023-09-13T06:02:23.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.860+0000 7f23957fa640 1 -- 172.21.15.130:0/1049114633 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2398014ab0 con 0x7f23a0159f20 2023-09-13T06:02:23.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.860+0000 7f23957fa640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f238c065b20 0x7f238c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:23.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.860+0000 7f23957fa640 1 -- 172.21.15.130:0/1049114633 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2398083ae0 con 0x7f23a0159f20 2023-09-13T06:02:23.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.860+0000 7f23a49a3640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f238c065b20 0x7f238c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:23.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.860+0000 7f23a49a3640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f238c065b20 0x7f238c067fe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f239c007940 tx=0x7f239c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:23.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:23.864+0000 7f23957fa640 1 -- 172.21.15.130:0/1049114633 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f23980514e0 con 0x7f23a0159f20 2023-09-13T06:02:24.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 -- 172.21.15.130:0/1049114633 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f23a00618a0 con 0x7f23a0159f20 2023-09-13T06:02:24.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23957fa640 1 -- 172.21.15.130:0/1049114633 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1574 (secure 0 0 0) 0x7f2398054b00 con 0x7f23a0159f20 2023-09-13T06:02:24.067 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:24.068 INFO:teuthology.orchestra.run.smithi130.stdout:{"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":76,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1694584873,"num_in_osds":8,"osd_in_since":1694584870,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2178677,"bytes_avail":1597821323,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5106}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-09-13T06:02:14.545962+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-09-13T06:02:24.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 -- 172.21.15.130:0/1049114633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f238c065b20 msgr2=0x7f238c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:24.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f238c065b20 0x7f238c067fe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f239c007940 tx=0x7f239c008040 comp rx=0 tx=0).stop 2023-09-13T06:02:24.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 -- 172.21.15.130:0/1049114633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a0159f20 msgr2=0x7f23a00ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:24.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a0159f20 0x7f23a00ac6d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2398007dc0 tx=0x7f239800e4b0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 -- 172.21.15.130:0/1049114633 shutdown_connections 2023-09-13T06:02:24.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f238c065b20 0x7f238c067fe0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a0159f20 0x7f23a00ac6d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23a00cdfc0 0x7f23a00ac190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 --2- 172.21.15.130:0/1049114633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23a00b1610 0x7f23a0147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 -- 172.21.15.130:0/1049114633 >> 172.21.15.130:0/1049114633 conn(0x7f23a0065990 msgr2=0x7f23a006f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:24.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 -- 172.21.15.130:0/1049114633 shutdown_connections 2023-09-13T06:02:24.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.064+0000 7f23a6c07640 1 -- 172.21.15.130:0/1049114633 wait complete. 2023-09-13T06:02:24.090 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-13T06:02:24.090 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:02:24.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.224+0000 7f8fe0088640 1 Processor -- start 2023-09-13T06:02:24.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.224+0000 7f8fe0088640 1 -- start start 2023-09-13T06:02:24.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.224+0000 7f8fe0088640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd815d5f0 0x7f8fd80cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:24.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.224+0000 7f8fe0088640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8fd80ae170 0x7f8fd80cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:24.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.224+0000 7f8fe0088640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd80cce60 con 0x7f8fd815d9d0 2023-09-13T06:02:24.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.224+0000 7f8fe0088640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd80cd140 con 0x7f8fd80ae170 2023-09-13T06:02:24.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.224+0000 7f8fe0088640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80cd420 con 0x7f8fd815d5f0 2023-09-13T06:02:24.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.224+0000 7f8fde625640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f8fd815d9d0 0x7f8fd81591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54518/0 (socket says 172.21.15.130:54518) 2023-09-13T06:02:24.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.224+0000 7f8fde625640 1 -- 172.21.15.130:0/1345488362 learned_addr learned my addr 172.21.15.130:0/1345488362 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:24.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.224+0000 7f8fdde24640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd815d5f0 0x7f8fd80cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:24.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.224+0000 7f8fdd623640 1 --2- 172.21.15.130:0/1345488362 >> v2:172.21.15.164:3300/0 conn(0x7f8fd80ae170 0x7f8fd80cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:24.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584461986 0 0) 0x7f8fd80cce60 con 0x7f8fd815d9d0 2023-09-13T06:02:24.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc4003530 con 0x7f8fd815d9d0 2023-09-13T06:02:24.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3226699293 0 0) 0x7f8fc4003530 con 0x7f8fd815d9d0 2023-09-13T06:02:24.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd815d5f0 msgr2=0x7f8fd80cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:24.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd815d5f0 0x7f8fd80cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 >> v2:172.21.15.164:3300/0 conn(0x7f8fd80ae170 msgr2=0x7f8fd80cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:24.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 --2- 172.21.15.130:0/1345488362 >> v2:172.21.15.164:3300/0 conn(0x7f8fd80ae170 0x7f8fd80cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80cd700 con 0x7f8fd815d9d0 2023-09-13T06:02:24.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f8fd0001a00 con 0x7f8fd815d9d0 2023-09-13T06:02:24.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 >> v1:172.21.15.130:6789/0 conn(0x7f8fd815d9d0 legacy=0x7f8fd81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:24.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fc40039f0 0x7f8fc4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:24.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fc40047d0 0x7f8fc4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:24.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fc4005190 0x7f8fc400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:24.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80cd140 con 0x7f8fc40047d0 2023-09-13T06:02:24.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80cd420 con 0x7f8fc40039f0 2023-09-13T06:02:24.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc400bf80 con 0x7f8fc4005190 2023-09-13T06:02:24.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdde24640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd815d5f0 0x7f8fd80cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:24.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdd623640 1 --2- 172.21.15.130:0/1345488362 >> v2:172.21.15.164:3300/0 conn(0x7f8fd80ae170 0x7f8fd80cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:24.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdd623640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fc40047d0 0x7f8fc4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:24.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdde24640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fc40039f0 0x7f8fc4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:24.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fde625640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fc4005190 0x7f8fc400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:24.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdd623640 1 -- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fc4005190 msgr2=0x7f8fc400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:24.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdd623640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fc4005190 0x7f8fc400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdd623640 1 -- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fc40039f0 msgr2=0x7f8fc4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:24.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdd623640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fc40039f0 0x7f8fc4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.228+0000 7f8fdd623640 1 -- 172.21.15.130:0/1345488362 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc4003530 con 0x7f8fc40047d0 2023-09-13T06:02:24.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fdd623640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fc40047d0 0x7f8fc4004c50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009c60 tx=0x7f8fc801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a3a92680ddf07a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:24.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8004020 con 0x7f8fc40047d0 2023-09-13T06:02:24.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8004180 con 0x7f8fc40047d0 2023-09-13T06:02:24.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fdce22640 1 -- 172.21.15.130:0/1345488362 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80a57c0 con 0x7f8fc40047d0 2023-09-13T06:02:24.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fe0088640 1 -- 172.21.15.130:0/1345488362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fc40047d0 msgr2=0x7f8fc4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:24.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fe0088640 1 --2- 172.21.15.130:0/1345488362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fc40047d0 0x7f8fc4004c50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009c60 tx=0x7f8fc801cc10 comp rx=0 tx=0).stop 2023-09-13T06:02:24.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fde625640 1 -- 172.21.15.130:0/1345488362 reap_dead start 2023-09-13T06:02:24.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fe0088640 1 -- 172.21.15.130:0/1345488362 shutdown_connections 2023-09-13T06:02:24.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fe0088640 1 -- 172.21.15.130:0/1345488362 >> 172.21.15.130:0/1345488362 conn(0x7f8fd8065990 msgr2=0x7f8fd8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:24.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fe0088640 1 -- 172.21.15.130:0/1345488362 shutdown_connections 2023-09-13T06:02:24.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fe0088640 1 -- 172.21.15.130:0/1345488362 wait complete. 2023-09-13T06:02:24.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fe0088640 1 Processor -- start 2023-09-13T06:02:24.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.232+0000 7f8fe0088640 1 -- start start 2023-09-13T06:02:24.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fe0088640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fc40047d0 0x7f8fd815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:24.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fe0088640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd81580e0 0x7f8fd815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:24.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fe0088640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fd814e670 0x7f8fd80ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:24.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fe0088640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd815cd00 con 0x7f8fd81580e0 2023-09-13T06:02:24.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fe0088640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd81587f0 con 0x7f8fd814e670 2023-09-13T06:02:24.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fe0088640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd815aa90 con 0x7f8fc40047d0 2023-09-13T06:02:24.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fdd623640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd81580e0 0x7f8fd815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:24.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fdd623640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd81580e0 0x7f8fd815c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46370/0 (socket says 172.21.15.130:46370) 2023-09-13T06:02:24.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fdd623640 1 -- 172.21.15.130:0/4142771903 learned_addr learned my addr 172.21.15.130:0/4142771903 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:24.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fde625640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fd814e670 0x7f8fd80ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:24.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fdde24640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fc40047d0 0x7f8fd815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:24.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fdd623640 1 -- 172.21.15.130:0/4142771903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fc40047d0 msgr2=0x7f8fd815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:24.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fdd623640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fc40047d0 0x7f8fd815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fdd623640 1 -- 172.21.15.130:0/4142771903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fd814e670 msgr2=0x7f8fd80ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:24.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fdd623640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fd814e670 0x7f8fd80ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fdd623640 1 -- 172.21.15.130:0/4142771903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd815ad30 con 0x7f8fd81580e0 2023-09-13T06:02:24.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fdd623640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd81580e0 0x7f8fd815c7c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8fc801c680 tx=0x7f8fc4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:24.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fce7fc640 1 -- 172.21.15.130:0/4142771903 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80044f0 con 0x7f8fd81580e0 2023-09-13T06:02:24.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fce7fc640 1 -- 172.21.15.130:0/4142771903 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc80a57c0 con 0x7f8fd81580e0 2023-09-13T06:02:24.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fe0088640 1 -- 172.21.15.130:0/4142771903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd8158540 con 0x7f8fd81580e0 2023-09-13T06:02:24.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fce7fc640 1 -- 172.21.15.130:0/4142771903 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80a5b30 con 0x7f8fd81580e0 2023-09-13T06:02:24.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fe0088640 1 -- 172.21.15.130:0/4142771903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd815b2b0 con 0x7f8fd81580e0 2023-09-13T06:02:24.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fe0088640 1 -- 172.21.15.130:0/4142771903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd80618a0 con 0x7f8fd81580e0 2023-09-13T06:02:24.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.236+0000 7f8fce7fc640 1 -- 172.21.15.130:0/4142771903 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8fc80a5c90 con 0x7f8fd81580e0 2023-09-13T06:02:24.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.240+0000 7f8fce7fc640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:24.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.240+0000 7f8fce7fc640 1 -- 172.21.15.130:0/4142771903 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fc811de80 con 0x7f8fd81580e0 2023-09-13T06:02:24.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.240+0000 7f8fdde24640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:24.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.240+0000 7f8fdde24640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80b2910 tx=0x7f8fd4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:24.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.244+0000 7f8fce7fc640 1 -- 172.21.15.130:0/4142771903 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8fc80eb6b0 con 0x7f8fd81580e0 2023-09-13T06:02:24.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.388+0000 7f8fe0088640 1 -- 172.21.15.130:0/4142771903 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fd806d690 con 0x7f8fbc065b20 2023-09-13T06:02:24.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.396+0000 7f8fce7fc640 1 -- 172.21.15.130:0/4142771903 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279890 (secure 0 0 0) 0x7f8fd806d690 con 0x7f8fbc065b20 2023-09-13T06:02:24.402 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:24.404 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:02:24.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 -- 172.21.15.130:0/4142771903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 msgr2=0x7f8fbc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:24.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80b2910 tx=0x7f8fd4008040 comp rx=0 tx=0).stop 2023-09-13T06:02:24.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 -- 172.21.15.130:0/4142771903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd81580e0 msgr2=0x7f8fd815c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:24.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd81580e0 0x7f8fd815c7c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8fc801c680 tx=0x7f8fc4005800 comp rx=0 tx=0).stop 2023-09-13T06:02:24.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 -- 172.21.15.130:0/4142771903 shutdown_connections 2023-09-13T06:02:24.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fd814e670 0x7f8fd80ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd81580e0 0x7f8fd815c7c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 --2- 172.21.15.130:0/4142771903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fc40047d0 0x7f8fd815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:24.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 -- 172.21.15.130:0/4142771903 >> 172.21.15.130:0/4142771903 conn(0x7f8fd8065990 msgr2=0x7f8fd8150dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:24.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 -- 172.21.15.130:0/4142771903 shutdown_connections 2023-09-13T06:02:24.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:24.400+0000 7f8fe0088640 1 -- 172.21.15.130:0/4142771903 wait complete. 2023-09-13T06:02:24.421 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-09-13T06:02:22.547281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560372,"statfs":{"total":1600000000,"available":1597821323,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.798032"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.759190+0000","last_change":"2023-09-13T06:02:17.759190+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.759190+0000","last_undegraded":"2023-09-13T06:02:17.759190+0000","last_fullsized":"2023-09-13T06:02:17.759190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763540+0000","last_change":"2023-09-13T06:02:17.763540+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763540+0000","last_undegraded":"2023-09-13T06:02:17.763540+0000","last_fullsized":"2023-09-13T06:02:17.763540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753181+0000","last_change":"2023-09-13T06:02:17.753181+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753181+0000","last_undegraded":"2023-09-13T06:02:17.753181+0000","last_fullsized":"2023-09-13T06:02:17.753181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762726+0000","last_change":"2023-09-13T06:02:17.762726+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762726+0000","last_undegraded":"2023-09-13T06:02:17.762726+0000","last_fullsized":"2023-09-13T06:02:17.762726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753181+0000","last_change":"2023-09-13T06:02:17.753181+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753181+0000","last_undegraded":"2023-09-13T06:02:17.753181+0000","last_fullsized":"2023-09-13T06:02:17.753181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763304+0000","last_change":"2023-09-13T06:02:17.763304+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763304+0000","last_undegraded":"2023-09-13T06:02:17.763304+0000","last_fullsized":"2023-09-13T06:02:17.763304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754030+0000","last_change":"2023-09-13T06:02:17.754030+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754030+0000","last_undegraded":"2023-09-13T06:02:17.754030+0000","last_fullsized":"2023-09-13T06:02:17.754030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.756115+0000","last_change":"2023-09-13T06:02:17.756115+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.756115+0000","last_undegraded":"2023-09-13T06:02:17.756115+0000","last_fullsized":"2023-09-13T06:02:17.756115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762849+0000","last_change":"2023-09-13T06:02:17.762849+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762849+0000","last_undegraded":"2023-09-13T06:02:17.762849+0000","last_fullsized":"2023-09-13T06:02:17.762849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763164+0000","last_change":"2023-09-13T06:02:17.763164+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763164+0000","last_undegraded":"2023-09-13T06:02:17.763164+0000","last_fullsized":"2023-09-13T06:02:17.763164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754028+0000","last_change":"2023-09-13T06:02:17.754028+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754028+0000","last_undegraded":"2023-09-13T06:02:17.754028+0000","last_fullsized":"2023-09-13T06:02:17.754028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.755004+0000","last_change":"2023-09-13T06:02:17.755004+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.755004+0000","last_undegraded":"2023-09-13T06:02:17.755004+0000","last_fullsized":"2023-09-13T06:02:17.755004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752513+0000","last_change":"2023-09-13T06:02:17.752513+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752513+0000","last_undegraded":"2023-09-13T06:02:17.752513+0000","last_fullsized":"2023-09-13T06:02:17.752513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.764449+0000","last_change":"2023-09-13T06:02:17.764449+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.764449+0000","last_undegraded":"2023-09-13T06:02:17.764449+0000","last_fullsized":"2023-09-13T06:02:17.764449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752472+0000","last_change":"2023-09-13T06:02:17.752472+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752472+0000","last_undegraded":"2023-09-13T06:02:17.752472+0000","last_fullsized":"2023-09-13T06:02:17.752472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753663+0000","last_change":"2023-09-13T06:02:17.753663+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753663+0000","last_undegraded":"2023-09-13T06:02:17.753663+0000","last_fullsized":"2023-09-13T06:02:17.753663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753759+0000","last_change":"2023-09-13T06:02:17.753759+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753759+0000","last_undegraded":"2023-09-13T06:02:17.753759+0000","last_fullsized":"2023-09-13T06:02:17.753759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762486+0000","last_change":"2023-09-13T06:02:17.762486+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762486+0000","last_undegraded":"2023-09-13T06:02:17.762486+0000","last_fullsized":"2023-09-13T06:02:17.762486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.764146+0000","last_change":"2023-09-13T06:02:17.764146+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.764146+0000","last_undegraded":"2023-09-13T06:02:17.764146+0000","last_fullsized":"2023-09-13T06:02:17.764146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752466+0000","last_change":"2023-09-13T06:02:17.752466+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752466+0000","last_undegraded":"2023-09-13T06:02:17.752466+0000","last_fullsized":"2023-09-13T06:02:17.752466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762542+0000","last_change":"2023-09-13T06:02:17.762542+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762542+0000","last_undegraded":"2023-09-13T06:02:17.762542+0000","last_fullsized":"2023-09-13T06:02:17.762542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762008+0000","last_change":"2023-09-13T06:02:17.762008+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762008+0000","last_undegraded":"2023-09-13T06:02:17.762008+0000","last_fullsized":"2023-09-13T06:02:17.762008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762227+0000","last_change":"2023-09-13T06:02:17.762227+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762227+0000","last_undegraded":"2023-09-13T06:02:17.762227+0000","last_fullsized":"2023-09-13T06:02:17.762227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753330+0000","last_change":"2023-09-13T06:02:17.753330+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753330+0000","last_undegraded":"2023-09-13T06:02:17.753330+0000","last_fullsized":"2023-09-13T06:02:17.753330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762825+0000","last_change":"2023-09-13T06:02:17.762825+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762825+0000","last_undegraded":"2023-09-13T06:02:17.762825+0000","last_fullsized":"2023-09-13T06:02:17.762825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762962+0000","last_change":"2023-09-13T06:02:17.762962+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762962+0000","last_undegraded":"2023-09-13T06:02:17.762962+0000","last_fullsized":"2023-09-13T06:02:17.762962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762687+0000","last_change":"2023-09-13T06:02:17.762687+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762687+0000","last_undegraded":"2023-09-13T06:02:17.762687+0000","last_fullsized":"2023-09-13T06:02:17.762687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753851+0000","last_change":"2023-09-13T06:02:17.753851+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753851+0000","last_undegraded":"2023-09-13T06:02:17.753851+0000","last_fullsized":"2023-09-13T06:02:17.753851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762453+0000","last_change":"2023-09-13T06:02:17.762453+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762453+0000","last_undegraded":"2023-09-13T06:02:17.762453+0000","last_fullsized":"2023-09-13T06:02:17.762453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753307+0000","last_change":"2023-09-13T06:02:17.753307+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753307+0000","last_undegraded":"2023-09-13T06:02:17.753307+0000","last_fullsized":"2023-09-13T06:02:17.753307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758841+0000","last_change":"2023-09-13T06:02:17.758841+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758841+0000","last_undegraded":"2023-09-13T06:02:17.758841+0000","last_fullsized":"2023-09-13T06:02:17.758841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753310+0000","last_change":"2023-09-13T06:02:17.753310+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753310+0000","last_undegraded":"2023-09-13T06:02:17.753310+0000","last_fullsized":"2023-09-13T06:02:17.753310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762978+0000","last_change":"2023-09-13T06:02:17.762978+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762978+0000","last_undegraded":"2023-09-13T06:02:17.762978+0000","last_fullsized":"2023-09-13T06:02:17.762978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.764037+0000","last_change":"2023-09-13T06:02:17.762285+0000","last_active":"2023-09-13T06:02:17.764037+0000","last_peered":"2023-09-13T06:02:17.764037+0000","last_clean":"2023-09-13T06:02:17.764037+0000","last_became_active":"2023-09-13T06:02:17.762063+0000","last_became_peered":"2023-09-13T06:02:17.762063+0000","last_unstale":"2023-09-13T06:02:17.764037+0000","last_undegraded":"2023-09-13T06:02:17.764037+0000","last_fullsized":"2023-09-13T06:02:17.764037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:39:04.037652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.759621+0000","last_change":"2023-09-13T06:02:17.759621+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.759621+0000","last_undegraded":"2023-09-13T06:02:17.759621+0000","last_fullsized":"2023-09-13T06:02:17.759621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.761090+0000","last_change":"2023-09-13T06:02:17.761021+0000","last_active":"2023-09-13T06:02:17.761090+0000","last_peered":"2023-09-13T06:02:17.761090+0000","last_clean":"2023-09-13T06:02:17.761090+0000","last_became_active":"2023-09-13T06:02:17.760790+0000","last_became_peered":"2023-09-13T06:02:17.760790+0000","last_unstale":"2023-09-13T06:02:17.761090+0000","last_undegraded":"2023-09-13T06:02:17.761090+0000","last_fullsized":"2023-09-13T06:02:17.761090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:39:04.037652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.761926+0000","last_change":"2023-09-13T06:02:17.761926+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.761926+0000","last_undegraded":"2023-09-13T06:02:17.761926+0000","last_fullsized":"2023-09-13T06:02:17.761926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757327+0000","last_change":"2023-09-13T06:02:17.757092+0000","last_active":"2023-09-13T06:02:17.757327+0000","last_peered":"2023-09-13T06:02:17.757327+0000","last_clean":"2023-09-13T06:02:17.757327+0000","last_became_active":"2023-09-13T06:02:17.756854+0000","last_became_peered":"2023-09-13T06:02:17.756854+0000","last_unstale":"2023-09-13T06:02:17.757327+0000","last_undegraded":"2023-09-13T06:02:17.757327+0000","last_fullsized":"2023-09-13T06:02:17.757327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:52.822633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762517+0000","last_change":"2023-09-13T06:02:17.762517+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762517+0000","last_undegraded":"2023-09-13T06:02:17.762517+0000","last_fullsized":"2023-09-13T06:02:17.762517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.759395+0000","last_change":"2023-09-13T06:02:17.758909+0000","last_active":"2023-09-13T06:02:17.759395+0000","last_peered":"2023-09-13T06:02:17.759395+0000","last_clean":"2023-09-13T06:02:17.759395+0000","last_became_active":"2023-09-13T06:02:17.758503+0000","last_became_peered":"2023-09-13T06:02:17.758503+0000","last_unstale":"2023-09-13T06:02:17.759395+0000","last_undegraded":"2023-09-13T06:02:17.759395+0000","last_fullsized":"2023-09-13T06:02:17.759395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:48.120438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.755778+0000","last_change":"2023-09-13T06:02:17.755778+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.755778+0000","last_undegraded":"2023-09-13T06:02:17.755778+0000","last_fullsized":"2023-09-13T06:02:17.755778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760136+0000","last_change":"2023-09-13T06:02:17.760031+0000","last_active":"2023-09-13T06:02:17.760136+0000","last_peered":"2023-09-13T06:02:17.760136+0000","last_clean":"2023-09-13T06:02:17.760136+0000","last_became_active":"2023-09-13T06:02:17.759461+0000","last_became_peered":"2023-09-13T06:02:17.759461+0000","last_unstale":"2023-09-13T06:02:17.760136+0000","last_undegraded":"2023-09-13T06:02:17.760136+0000","last_fullsized":"2023-09-13T06:02:17.760136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:46:36.044318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754695+0000","last_change":"2023-09-13T06:02:17.754695+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754695+0000","last_undegraded":"2023-09-13T06:02:17.754695+0000","last_fullsized":"2023-09-13T06:02:17.754695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757236+0000","last_change":"2023-09-13T06:02:17.757157+0000","last_active":"2023-09-13T06:02:17.757236+0000","last_peered":"2023-09-13T06:02:17.757236+0000","last_clean":"2023-09-13T06:02:17.757236+0000","last_became_active":"2023-09-13T06:02:17.756751+0000","last_became_peered":"2023-09-13T06:02:17.756751+0000","last_unstale":"2023-09-13T06:02:17.757236+0000","last_undegraded":"2023-09-13T06:02:17.757236+0000","last_fullsized":"2023-09-13T06:02:17.757236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:03:55.320781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763080+0000","last_change":"2023-09-13T06:02:17.763080+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763080+0000","last_undegraded":"2023-09-13T06:02:17.763080+0000","last_fullsized":"2023-09-13T06:02:17.763080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.756148+0000","last_change":"2023-09-13T06:02:17.756021+0000","last_active":"2023-09-13T06:02:17.756148+0000","last_peered":"2023-09-13T06:02:17.756148+0000","last_clean":"2023-09-13T06:02:17.756148+0000","last_became_active":"2023-09-13T06:02:17.755754+0000","last_became_peered":"2023-09-13T06:02:17.755754+0000","last_unstale":"2023-09-13T06:02:17.756148+0000","last_undegraded":"2023-09-13T06:02:17.756148+0000","last_fullsized":"2023-09-13T06:02:17.756148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:49.936804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762416+0000","last_change":"2023-09-13T06:02:17.762416+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762416+0000","last_undegraded":"2023-09-13T06:02:17.762416+0000","last_fullsized":"2023-09-13T06:02:17.762416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765712+0000","last_change":"2023-09-13T06:02:17.765596+0000","last_active":"2023-09-13T06:02:17.765712+0000","last_peered":"2023-09-13T06:02:17.765712+0000","last_clean":"2023-09-13T06:02:17.765712+0000","last_became_active":"2023-09-13T06:02:17.764626+0000","last_became_peered":"2023-09-13T06:02:17.764626+0000","last_unstale":"2023-09-13T06:02:17.765712+0000","last_undegraded":"2023-09-13T06:02:17.765712+0000","last_fullsized":"2023-09-13T06:02:17.765712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:18:57.717040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754042+0000","last_change":"2023-09-13T06:02:17.754042+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754042+0000","last_undegraded":"2023-09-13T06:02:17.754042+0000","last_fullsized":"2023-09-13T06:02:17.754042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760403+0000","last_change":"2023-09-13T06:02:17.760344+0000","last_active":"2023-09-13T06:02:17.760403+0000","last_peered":"2023-09-13T06:02:17.760403+0000","last_clean":"2023-09-13T06:02:17.760403+0000","last_became_active":"2023-09-13T06:02:17.760112+0000","last_became_peered":"2023-09-13T06:02:17.760112+0000","last_unstale":"2023-09-13T06:02:17.760403+0000","last_undegraded":"2023-09-13T06:02:17.760403+0000","last_fullsized":"2023-09-13T06:02:17.760403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:35:44.141658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762674+0000","last_change":"2023-09-13T06:02:17.762674+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762674+0000","last_undegraded":"2023-09-13T06:02:17.762674+0000","last_fullsized":"2023-09-13T06:02:17.762674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757398+0000","last_change":"2023-09-13T06:02:17.757230+0000","last_active":"2023-09-13T06:02:17.757398+0000","last_peered":"2023-09-13T06:02:17.757398+0000","last_clean":"2023-09-13T06:02:17.757398+0000","last_became_active":"2023-09-13T06:02:17.756995+0000","last_became_peered":"2023-09-13T06:02:17.756995+0000","last_unstale":"2023-09-13T06:02:17.757398+0000","last_undegraded":"2023-09-13T06:02:17.757398+0000","last_fullsized":"2023-09-13T06:02:17.757398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763849+0000","last_change":"2023-09-13T06:02:17.763849+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763849+0000","last_undegraded":"2023-09-13T06:02:17.763849+0000","last_fullsized":"2023-09-13T06:02:17.763849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760875+0000","last_change":"2023-09-13T06:02:17.760513+0000","last_active":"2023-09-13T06:02:17.760875+0000","last_peered":"2023-09-13T06:02:17.760875+0000","last_clean":"2023-09-13T06:02:17.760875+0000","last_became_active":"2023-09-13T06:02:17.759698+0000","last_became_peered":"2023-09-13T06:02:17.759698+0000","last_unstale":"2023-09-13T06:02:17.760875+0000","last_undegraded":"2023-09-13T06:02:17.760875+0000","last_fullsized":"2023-09-13T06:02:17.760875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:36:09.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753498+0000","last_change":"2023-09-13T06:02:17.753498+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753498+0000","last_undegraded":"2023-09-13T06:02:17.753498+0000","last_fullsized":"2023-09-13T06:02:17.753498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758829+0000","last_change":"2023-09-13T06:02:17.758625+0000","last_active":"2023-09-13T06:02:17.758829+0000","last_peered":"2023-09-13T06:02:17.758829+0000","last_clean":"2023-09-13T06:02:17.758829+0000","last_became_active":"2023-09-13T06:02:17.757273+0000","last_became_peered":"2023-09-13T06:02:17.757273+0000","last_unstale":"2023-09-13T06:02:17.758829+0000","last_undegraded":"2023-09-13T06:02:17.758829+0000","last_fullsized":"2023-09-13T06:02:17.758829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:06.883601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763737+0000","last_change":"2023-09-13T06:02:17.763737+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763737+0000","last_undegraded":"2023-09-13T06:02:17.763737+0000","last_fullsized":"2023-09-13T06:02:17.763737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765479+0000","last_change":"2023-09-13T06:02:17.765217+0000","last_active":"2023-09-13T06:02:17.765479+0000","last_peered":"2023-09-13T06:02:17.765479+0000","last_clean":"2023-09-13T06:02:17.765479+0000","last_became_active":"2023-09-13T06:02:17.764324+0000","last_became_peered":"2023-09-13T06:02:17.764324+0000","last_unstale":"2023-09-13T06:02:17.765479+0000","last_undegraded":"2023-09-13T06:02:17.765479+0000","last_fullsized":"2023-09-13T06:02:17.765479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:13:15.204110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762341+0000","last_change":"2023-09-13T06:02:17.762341+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762341+0000","last_undegraded":"2023-09-13T06:02:17.762341+0000","last_fullsized":"2023-09-13T06:02:17.762341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.764568+0000","last_change":"2023-09-13T06:02:17.763991+0000","last_active":"2023-09-13T06:02:17.764568+0000","last_peered":"2023-09-13T06:02:17.764568+0000","last_clean":"2023-09-13T06:02:17.764568+0000","last_became_active":"2023-09-13T06:02:17.762961+0000","last_became_peered":"2023-09-13T06:02:17.762961+0000","last_unstale":"2023-09-13T06:02:17.764568+0000","last_undegraded":"2023-09-13T06:02:17.764568+0000","last_fullsized":"2023-09-13T06:02:17.764568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.753319+0000","last_change":"2023-09-13T06:02:17.753319+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.753319+0000","last_undegraded":"2023-09-13T06:02:17.753319+0000","last_fullsized":"2023-09-13T06:02:17.753319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760385+0000","last_change":"2023-09-13T06:02:17.760312+0000","last_active":"2023-09-13T06:02:17.760385+0000","last_peered":"2023-09-13T06:02:17.760385+0000","last_clean":"2023-09-13T06:02:17.760385+0000","last_became_active":"2023-09-13T06:02:17.760047+0000","last_became_peered":"2023-09-13T06:02:17.760047+0000","last_unstale":"2023-09-13T06:02:17.760385+0000","last_undegraded":"2023-09-13T06:02:17.760385+0000","last_fullsized":"2023-09-13T06:02:17.760385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758771+0000","last_change":"2023-09-13T06:02:17.758771+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758771+0000","last_undegraded":"2023-09-13T06:02:17.758771+0000","last_fullsized":"2023-09-13T06:02:17.758771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757360+0000","last_change":"2023-09-13T06:02:17.757243+0000","last_active":"2023-09-13T06:02:17.757360+0000","last_peered":"2023-09-13T06:02:17.757360+0000","last_clean":"2023-09-13T06:02:17.757360+0000","last_became_active":"2023-09-13T06:02:17.757000+0000","last_became_peered":"2023-09-13T06:02:17.757000+0000","last_unstale":"2023-09-13T06:02:17.757360+0000","last_undegraded":"2023-09-13T06:02:17.757360+0000","last_fullsized":"2023-09-13T06:02:17.757360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:40.428906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762681+0000","last_change":"2023-09-13T06:02:17.762681+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762681+0000","last_undegraded":"2023-09-13T06:02:17.762681+0000","last_fullsized":"2023-09-13T06:02:17.762681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760270+0000","last_change":"2023-09-13T06:02:17.759850+0000","last_active":"2023-09-13T06:02:17.760270+0000","last_peered":"2023-09-13T06:02:17.760270+0000","last_clean":"2023-09-13T06:02:17.760270+0000","last_became_active":"2023-09-13T06:02:17.759571+0000","last_became_peered":"2023-09-13T06:02:17.759571+0000","last_unstale":"2023-09-13T06:02:17.760270+0000","last_undegraded":"2023-09-13T06:02:17.760270+0000","last_fullsized":"2023-09-13T06:02:17.760270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752931+0000","last_change":"2023-09-13T06:02:17.752931+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752931+0000","last_undegraded":"2023-09-13T06:02:17.752931+0000","last_fullsized":"2023-09-13T06:02:17.752931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762227+0000","last_change":"2023-09-13T06:02:17.761635+0000","last_active":"2023-09-13T06:02:17.762227+0000","last_peered":"2023-09-13T06:02:17.762227+0000","last_clean":"2023-09-13T06:02:17.762227+0000","last_became_active":"2023-09-13T06:02:17.761041+0000","last_became_peered":"2023-09-13T06:02:17.761041+0000","last_unstale":"2023-09-13T06:02:17.762227+0000","last_undegraded":"2023-09-13T06:02:17.762227+0000","last_fullsized":"2023-09-13T06:02:17.762227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:49:26.757377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762311+0000","last_change":"2023-09-13T06:02:17.762311+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762311+0000","last_undegraded":"2023-09-13T06:02:17.762311+0000","last_fullsized":"2023-09-13T06:02:17.762311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760931+0000","last_change":"2023-09-13T06:02:17.760800+0000","last_active":"2023-09-13T06:02:17.760931+0000","last_peered":"2023-09-13T06:02:17.760931+0000","last_clean":"2023-09-13T06:02:17.760931+0000","last_became_active":"2023-09-13T06:02:17.760585+0000","last_became_peered":"2023-09-13T06:02:17.760585+0000","last_unstale":"2023-09-13T06:02:17.760931+0000","last_undegraded":"2023-09-13T06:02:17.760931+0000","last_fullsized":"2023-09-13T06:02:17.760931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:48.120438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752434+0000","last_change":"2023-09-13T06:02:17.752434+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752434+0000","last_undegraded":"2023-09-13T06:02:17.752434+0000","last_fullsized":"2023-09-13T06:02:17.752434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760363+0000","last_change":"2023-09-13T06:02:17.760200+0000","last_active":"2023-09-13T06:02:17.760363+0000","last_peered":"2023-09-13T06:02:17.760363+0000","last_clean":"2023-09-13T06:02:17.760363+0000","last_became_active":"2023-09-13T06:02:17.759800+0000","last_became_peered":"2023-09-13T06:02:17.759800+0000","last_unstale":"2023-09-13T06:02:17.760363+0000","last_undegraded":"2023-09-13T06:02:17.760363+0000","last_fullsized":"2023-09-13T06:02:17.760363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:53:23.415803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.751719+0000","last_change":"2023-09-13T06:02:17.751719+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.751719+0000","last_undegraded":"2023-09-13T06:02:17.751719+0000","last_fullsized":"2023-09-13T06:02:17.751719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757379+0000","last_change":"2023-09-13T06:02:17.757106+0000","last_active":"2023-09-13T06:02:17.757379+0000","last_peered":"2023-09-13T06:02:17.757379+0000","last_clean":"2023-09-13T06:02:17.757379+0000","last_became_active":"2023-09-13T06:02:17.756876+0000","last_became_peered":"2023-09-13T06:02:17.756876+0000","last_unstale":"2023-09-13T06:02:17.757379+0000","last_undegraded":"2023-09-13T06:02:17.757379+0000","last_fullsized":"2023-09-13T06:02:17.757379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752081+0000","last_change":"2023-09-13T06:02:17.752081+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752081+0000","last_undegraded":"2023-09-13T06:02:17.752081+0000","last_fullsized":"2023-09-13T06:02:17.752081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765089+0000","last_change":"2023-09-13T06:02:17.764974+0000","last_active":"2023-09-13T06:02:17.765089+0000","last_peered":"2023-09-13T06:02:17.765089+0000","last_clean":"2023-09-13T06:02:17.765089+0000","last_became_active":"2023-09-13T06:02:17.764364+0000","last_became_peered":"2023-09-13T06:02:17.764364+0000","last_unstale":"2023-09-13T06:02:17.765089+0000","last_undegraded":"2023-09-13T06:02:17.765089+0000","last_fullsized":"2023-09-13T06:02:17.765089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:37:09.637327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752086+0000","last_change":"2023-09-13T06:02:17.752086+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752086+0000","last_undegraded":"2023-09-13T06:02:17.752086+0000","last_fullsized":"2023-09-13T06:02:17.752086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762247+0000","last_change":"2023-09-13T06:02:17.761800+0000","last_active":"2023-09-13T06:02:17.762247+0000","last_peered":"2023-09-13T06:02:17.762247+0000","last_clean":"2023-09-13T06:02:17.762247+0000","last_became_active":"2023-09-13T06:02:17.761387+0000","last_became_peered":"2023-09-13T06:02:17.761387+0000","last_unstale":"2023-09-13T06:02:17.762247+0000","last_undegraded":"2023-09-13T06:02:17.762247+0000","last_fullsized":"2023-09-13T06:02:17.762247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:00:07.340159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752926+0000","last_change":"2023-09-13T06:02:17.752926+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752926+0000","last_undegraded":"2023-09-13T06:02:17.752926+0000","last_fullsized":"2023-09-13T06:02:17.752926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.757398+0000","last_change":"2023-09-13T06:02:17.757279+0000","last_active":"2023-09-13T06:02:17.757398+0000","last_peered":"2023-09-13T06:02:17.757398+0000","last_clean":"2023-09-13T06:02:17.757398+0000","last_became_active":"2023-09-13T06:02:17.757046+0000","last_became_peered":"2023-09-13T06:02:17.757046+0000","last_unstale":"2023-09-13T06:02:17.757398+0000","last_undegraded":"2023-09-13T06:02:17.757398+0000","last_fullsized":"2023-09-13T06:02:17.757398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:06.883601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.751741+0000","last_change":"2023-09-13T06:02:17.751741+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.751741+0000","last_undegraded":"2023-09-13T06:02:17.751741+0000","last_fullsized":"2023-09-13T06:02:17.751741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.762269+0000","last_change":"2023-09-13T06:02:17.761961+0000","last_active":"2023-09-13T06:02:17.762269+0000","last_peered":"2023-09-13T06:02:17.762269+0000","last_clean":"2023-09-13T06:02:17.762269+0000","last_became_active":"2023-09-13T06:02:17.760216+0000","last_became_peered":"2023-09-13T06:02:17.760216+0000","last_unstale":"2023-09-13T06:02:17.762269+0000","last_undegraded":"2023-09-13T06:02:17.762269+0000","last_fullsized":"2023-09-13T06:02:17.762269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.754405+0000","last_change":"2023-09-13T06:02:17.754405+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.754405+0000","last_undegraded":"2023-09-13T06:02:17.754405+0000","last_fullsized":"2023-09-13T06:02:17.754405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758176+0000","last_change":"2023-09-13T06:02:17.758069+0000","last_active":"2023-09-13T06:02:17.758176+0000","last_peered":"2023-09-13T06:02:17.758176+0000","last_clean":"2023-09-13T06:02:17.758176+0000","last_became_active":"2023-09-13T06:02:17.757840+0000","last_became_peered":"2023-09-13T06:02:17.757840+0000","last_unstale":"2023-09-13T06:02:17.758176+0000","last_undegraded":"2023-09-13T06:02:17.758176+0000","last_fullsized":"2023-09-13T06:02:17.758176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762640+0000","last_change":"2023-09-13T06:02:17.762640+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762640+0000","last_undegraded":"2023-09-13T06:02:17.762640+0000","last_fullsized":"2023-09-13T06:02:17.762640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758599+0000","last_change":"2023-09-13T06:02:17.758184+0000","last_active":"2023-09-13T06:02:17.758599+0000","last_peered":"2023-09-13T06:02:17.758599+0000","last_clean":"2023-09-13T06:02:17.758599+0000","last_became_active":"2023-09-13T06:02:17.757752+0000","last_became_peered":"2023-09-13T06:02:17.757752+0000","last_unstale":"2023-09-13T06:02:17.758599+0000","last_undegraded":"2023-09-13T06:02:17.758599+0000","last_fullsized":"2023-09-13T06:02:17.758599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:35:44.141658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.758385+0000","last_change":"2023-09-13T06:02:17.758385+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.758385+0000","last_undegraded":"2023-09-13T06:02:17.758385+0000","last_fullsized":"2023-09-13T06:02:17.758385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.760898+0000","last_change":"2023-09-13T06:02:17.759047+0000","last_active":"2023-09-13T06:02:17.760898+0000","last_peered":"2023-09-13T06:02:17.760898+0000","last_clean":"2023-09-13T06:02:17.760898+0000","last_became_active":"2023-09-13T06:02:17.758821+0000","last_became_peered":"2023-09-13T06:02:17.758821+0000","last_unstale":"2023-09-13T06:02:17.760898+0000","last_undegraded":"2023-09-13T06:02:17.760898+0000","last_fullsized":"2023-09-13T06:02:17.760898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:13.821905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.762222+0000","last_change":"2023-09-13T06:02:17.762222+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.762222+0000","last_undegraded":"2023-09-13T06:02:17.762222+0000","last_fullsized":"2023-09-13T06:02:17.762222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.763378+0000","last_change":"2023-09-13T06:02:17.762871+0000","last_active":"2023-09-13T06:02:17.763378+0000","last_peered":"2023-09-13T06:02:17.763378+0000","last_clean":"2023-09-13T06:02:17.763378+0000","last_became_active":"2023-09-13T06:02:17.761720+0000","last_became_peered":"2023-09-13T06:02:17.761720+0000","last_unstale":"2023-09-13T06:02:17.763378+0000","last_undegraded":"2023-09-13T06:02:17.763378+0000","last_fullsized":"2023-09-13T06:02:17.763378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:13.821905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763035+0000","last_change":"2023-09-13T06:02:17.763035+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763035+0000","last_undegraded":"2023-09-13T06:02:17.763035+0000","last_fullsized":"2023-09-13T06:02:17.763035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.763920+0000","last_change":"2023-09-13T06:02:17.763666+0000","last_active":"2023-09-13T06:02:17.763920+0000","last_peered":"2023-09-13T06:02:17.763920+0000","last_clean":"2023-09-13T06:02:17.763920+0000","last_became_active":"2023-09-13T06:02:17.763447+0000","last_became_peered":"2023-09-13T06:02:17.763447+0000","last_unstale":"2023-09-13T06:02:17.763920+0000","last_undegraded":"2023-09-13T06:02:17.763920+0000","last_fullsized":"2023-09-13T06:02:17.763920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:23:06.205141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.763136+0000","last_change":"2023-09-13T06:02:17.763136+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.763136+0000","last_undegraded":"2023-09-13T06:02:17.763136+0000","last_fullsized":"2023-09-13T06:02:17.763136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.758845+0000","last_change":"2023-09-13T06:02:17.758766+0000","last_active":"2023-09-13T06:02:17.758845+0000","last_peered":"2023-09-13T06:02:17.758845+0000","last_clean":"2023-09-13T06:02:17.758845+0000","last_became_active":"2023-09-13T06:02:17.758343+0000","last_became_peered":"2023-09-13T06:02:17.758343+0000","last_unstale":"2023-09-13T06:02:17.758845+0000","last_undegraded":"2023-09-13T06:02:17.758845+0000","last_fullsized":"2023-09-13T06:02:17.758845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:16.364256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-09-13T06:02:17.752539+0000","last_change":"2023-09-13T06:02:17.752539+0000","last_active":"2023-09-13T06:02:17.745565+0000","last_peered":"2023-09-13T06:02:17.745565+0000","last_clean":"2023-09-13T06:02:17.745565+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:17.752539+0000","last_undegraded":"2023-09-13T06:02:17.752539+0000","last_fullsized":"2023-09-13T06:02:17.752539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-13T06:02:17.765268+0000","last_change":"2023-09-13T06:02:17.765194+0000","last_active":"2023-09-13T06:02:17.765268+0000","last_peered":"2023-09-13T06:02:17.765268+0000","last_clean":"2023-09-13T06:02:17.765268+0000","last_became_active":"2023-09-13T06:02:17.764751+0000","last_became_peered":"2023-09-13T06:02:17.764751+0000","last_unstale":"2023-09-13T06:02:17.765268+0000","last_undegraded":"2023-09-13T06:02:17.765268+0000","last_fullsized":"2023-09-13T06:02:17.765268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:20.803483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-09-13T06:02:16.750081+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:02:16.750081+0000","last_peered":"2023-09-13T06:02:16.750081+0000","last_clean":"2023-09-13T06:02:16.750081+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:02:16.750081+0000","last_undegraded":"2023-09-13T06:02:16.750081+0000","last_fullsized":"2023-09-13T06:02:16.750081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194613,"statfs":{"total":200000000,"available":199284106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.875}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.82899999999999996}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.627},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.57999999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.89500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70299999999999996}]},{"osd":1,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.77000000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.74399999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.75900000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55600000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.623},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.89100000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.76800000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.91000000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.97999999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.78800000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.86599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.629},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.77600000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.85799999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.875},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.81799999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.90400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40699999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.751}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.873}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.30299999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.38900000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.66500000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":122,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195189,"statfs":{"total":200000000,"available":199874474,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.502},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.435}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.70499999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.77300000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194613,"statfs":{"total":200000000,"available":199284106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45700000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51400000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.872},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.75800000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.82499999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.73499999999999999}]}]}],"pool_statfs":[]}} 2023-09-13T06:02:27.431 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:02:27.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb159c7640 1 Processor -- start 2023-09-13T06:02:27.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb159c7640 1 -- start start 2023-09-13T06:02:27.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb159c7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb1015b130 0x7fcb100cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb159c7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb100ce980 con 0x7fcb100ce180 2023-09-13T06:02:27.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb159c7640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb100cec60 con 0x7fcb100b04a0 2023-09-13T06:02:27.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb159c7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1006c640 con 0x7fcb1015b130 2023-09-13T06:02:27.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb067fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fcb100ce180 0x7fcb1015b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54524/0 (socket says 172.21.15.130:54524) 2023-09-13T06:02:27.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb067fc640 1 -- 172.21.15.130:0/1674449440 learned_addr learned my addr 172.21.15.130:0/1674449440 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:27.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb0effd640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb1015b130 0x7fcb100cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414104829 0 0) 0x7fcb100ce980 con 0x7fcb100ce180 2023-09-13T06:02:27.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcafc003530 con 0x7fcb100ce180 2023-09-13T06:02:27.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.575+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3190864199 0 0) 0x7fcafc003530 con 0x7fcb100ce180 2023-09-13T06:02:27.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb1015b130 msgr2=0x7fcb100cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:27.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb1015b130 0x7fcb100cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 >> v1:172.21.15.164:6789/0 conn(0x7fcb100b04a0 legacy=0x7fcb1006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:27.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1006c920 con 0x7fcb100ce180 2023-09-13T06:02:27.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fcaf8001a00 con 0x7fcb100ce180 2023-09-13T06:02:27.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 >> v1:172.21.15.130:6789/0 conn(0x7fcb100ce180 legacy=0x7fcb1015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:27.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcafc003a20 0x7fcafc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcafc0047d0 0x7fcafc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb1015b130 0x7fcafc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1006c640 con 0x7fcafc003a20 2023-09-13T06:02:27.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc00ba90 con 0x7fcafc0047d0 2023-09-13T06:02:27.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc00bc50 con 0x7fcb1015b130 2023-09-13T06:02:27.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0effd640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcafc003a20 0x7fcafc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb067fc640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcafc0047d0 0x7fcafc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0f7fe640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb1015b130 0x7fcafc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0effd640 1 -- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb1015b130 msgr2=0x7fcafc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:27.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0effd640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb1015b130 0x7fcafc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0effd640 1 -- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcafc0047d0 msgr2=0x7fcafc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:27.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0effd640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcafc0047d0 0x7fcafc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0effd640 1 -- 172.21.15.130:0/1674449440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc003530 con 0x7fcafc003a20 2023-09-13T06:02:27.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0f7fe640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb1015b130 0x7fcafc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:27.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0effd640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcafc003a20 0x7fcafc003e40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcb00009ae0 tx=0x7fcb0001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82736e02c6d366c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:27.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb000a6500 con 0x7fcafc003a20 2023-09-13T06:02:27.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb000a6660 con 0x7fcafc003a20 2023-09-13T06:02:27.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.579+0000 7fcb0e7fc640 1 -- 172.21.15.130:0/1674449440 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb000a6a10 con 0x7fcafc003a20 2023-09-13T06:02:27.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 -- 172.21.15.130:0/1674449440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcafc003a20 msgr2=0x7fcafc003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:27.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 --2- 172.21.15.130:0/1674449440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcafc003a20 0x7fcafc003e40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcb00009ae0 tx=0x7fcb0001ca20 comp rx=0 tx=0).stop 2023-09-13T06:02:27.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb0f7fe640 1 -- 172.21.15.130:0/1674449440 reap_dead start 2023-09-13T06:02:27.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 -- 172.21.15.130:0/1674449440 shutdown_connections 2023-09-13T06:02:27.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 -- 172.21.15.130:0/1674449440 >> 172.21.15.130:0/1674449440 conn(0x7fcb10065990 msgr2=0x7fcb10065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:27.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 -- 172.21.15.130:0/1674449440 shutdown_connections 2023-09-13T06:02:27.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 -- 172.21.15.130:0/1674449440 wait complete. 2023-09-13T06:02:27.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 Processor -- start 2023-09-13T06:02:27.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 -- start start 2023-09-13T06:02:27.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcafc003a20 0x7fcb1006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb1006fbf0 0x7fcb10154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb101549c0 0x7fcb100a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10070070 con 0x7fcb1006fbf0 2023-09-13T06:02:27.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100ac0c0 con 0x7fcb101549c0 2023-09-13T06:02:27.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb159c7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100acc40 con 0x7fcafc003a20 2023-09-13T06:02:27.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb067fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb1006fbf0 0x7fcb10154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb067fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb1006fbf0 0x7fcb10154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46382/0 (socket says 172.21.15.130:46382) 2023-09-13T06:02:27.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.583+0000 7fcb067fc640 1 -- 172.21.15.130:0/689891374 learned_addr learned my addr 172.21.15.130:0/689891374 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:27.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb0effd640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcafc003a20 0x7fcb1006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb0f7fe640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb101549c0 0x7fcb100a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb067fc640 1 -- 172.21.15.130:0/689891374 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcafc003a20 msgr2=0x7fcb1006f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:27.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb067fc640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcafc003a20 0x7fcb1006f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb067fc640 1 -- 172.21.15.130:0/689891374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb101549c0 msgr2=0x7fcb100a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:27.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb067fc640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb101549c0 0x7fcb100a8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb067fc640 1 -- 172.21.15.130:0/689891374 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb100b0e40 con 0x7fcb1006fbf0 2023-09-13T06:02:27.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb067fc640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb1006fbf0 0x7fcb10154480 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8007a00 tx=0x7fcaf800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:27.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb0cff9640 1 -- 172.21.15.130:0/689891374 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8007af0 con 0x7fcb1006fbf0 2023-09-13T06:02:27.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb0cff9640 1 -- 172.21.15.130:0/689891374 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf80133f0 con 0x7fcb1006fbf0 2023-09-13T06:02:27.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb159c7640 1 -- 172.21.15.130:0/689891374 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb100ac310 con 0x7fcb1006fbf0 2023-09-13T06:02:27.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb0cff9640 1 -- 172.21.15.130:0/689891374 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80137a0 con 0x7fcb1006fbf0 2023-09-13T06:02:27.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb159c7640 1 -- 172.21.15.130:0/689891374 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb100ac8d0 con 0x7fcb1006fbf0 2023-09-13T06:02:27.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb159c7640 1 -- 172.21.15.130:0/689891374 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb100618a0 con 0x7fcb1006fbf0 2023-09-13T06:02:27.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb0cff9640 1 -- 172.21.15.130:0/689891374 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcaf8013900 con 0x7fcb1006fbf0 2023-09-13T06:02:27.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb0cff9640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcaf0065b20 0x7fcaf0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.587+0000 7fcb0cff9640 1 -- 172.21.15.130:0/689891374 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaf8083c10 con 0x7fcb1006fbf0 2023-09-13T06:02:27.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.591+0000 7fcb0effd640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcaf0065b20 0x7fcaf0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.591+0000 7fcb0effd640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcaf0065b20 0x7fcaf0067fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcb000af000 tx=0x7fcb000046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:27.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.595+0000 7fcb0cff9640 1 -- 172.21.15.130:0/689891374 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcaf8051550 con 0x7fcb1006fbf0 2023-09-13T06:02:27.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.739+0000 7fcb159c7640 1 -- 172.21.15.130:0/689891374 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb100b0cc0 con 0x7fcaf0065b20 2023-09-13T06:02:27.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.747+0000 7fcb0cff9640 1 -- 172.21.15.130:0/689891374 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285106 (secure 0 0 0) 0x7fcb0000f080 con 0x7fcaf0065b20 2023-09-13T06:02:27.754 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:27.755 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:02:27.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 -- 172.21.15.130:0/689891374 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcaf0065b20 msgr2=0x7fcaf0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:27.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcaf0065b20 0x7fcaf0067fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcb000af000 tx=0x7fcb000046d0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 -- 172.21.15.130:0/689891374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb1006fbf0 msgr2=0x7fcb10154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:27.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb1006fbf0 0x7fcb10154480 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8007a00 tx=0x7fcaf800a6e0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 -- 172.21.15.130:0/689891374 shutdown_connections 2023-09-13T06:02:27.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcaf0065b20 0x7fcaf0067fe0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb101549c0 0x7fcb100a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb1006fbf0 0x7fcb10154480 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 --2- 172.21.15.130:0/689891374 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcafc003a20 0x7fcb1006f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 -- 172.21.15.130:0/689891374 >> 172.21.15.130:0/689891374 conn(0x7fcb10065990 msgr2=0x7fcb10159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:27.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 -- 172.21.15.130:0/689891374 shutdown_connections 2023-09-13T06:02:27.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.751+0000 7fcb159c7640 1 -- 172.21.15.130:0/689891374 wait complete. 2023-09-13T06:02:27.773 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2023-09-13T06:02:26.548138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560259,"statfs":{"total":1600000000,"available":1597705636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001526"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601820+0000","last_change":"2023-09-13T06:02:18.788797+0000","last_active":"2023-09-13T06:02:20.601820+0000","last_peered":"2023-09-13T06:02:20.601820+0000","last_clean":"2023-09-13T06:02:20.601820+0000","last_became_active":"2023-09-13T06:02:18.788337+0000","last_became_peered":"2023-09-13T06:02:18.788337+0000","last_unstale":"2023-09-13T06:02:20.601820+0000","last_undegraded":"2023-09-13T06:02:20.601820+0000","last_fullsized":"2023-09-13T06:02:20.601820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:18.137384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.727749+0000","last_change":"2023-09-13T06:02:18.786672+0000","last_active":"2023-09-13T06:02:20.727749+0000","last_peered":"2023-09-13T06:02:20.727749+0000","last_clean":"2023-09-13T06:02:20.727749+0000","last_became_active":"2023-09-13T06:02:18.786404+0000","last_became_peered":"2023-09-13T06:02:18.786404+0000","last_unstale":"2023-09-13T06:02:20.727749+0000","last_undegraded":"2023-09-13T06:02:20.727749+0000","last_fullsized":"2023-09-13T06:02:20.727749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:53.987558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774843+0000","last_change":"2023-09-13T06:02:18.787424+0000","last_active":"2023-09-13T06:02:19.774843+0000","last_peered":"2023-09-13T06:02:19.774843+0000","last_clean":"2023-09-13T06:02:19.774843+0000","last_became_active":"2023-09-13T06:02:18.785698+0000","last_became_peered":"2023-09-13T06:02:18.785698+0000","last_unstale":"2023-09-13T06:02:19.774843+0000","last_undegraded":"2023-09-13T06:02:19.774843+0000","last_fullsized":"2023-09-13T06:02:19.774843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:19:43.834410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773351+0000","last_change":"2023-09-13T06:02:18.789788+0000","last_active":"2023-09-13T06:02:19.773351+0000","last_peered":"2023-09-13T06:02:19.773351+0000","last_clean":"2023-09-13T06:02:19.773351+0000","last_became_active":"2023-09-13T06:02:18.789481+0000","last_became_peered":"2023-09-13T06:02:18.789481+0000","last_unstale":"2023-09-13T06:02:19.773351+0000","last_undegraded":"2023-09-13T06:02:19.773351+0000","last_fullsized":"2023-09-13T06:02:19.773351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:12:57.693942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601628+0000","last_change":"2023-09-13T06:02:18.784008+0000","last_active":"2023-09-13T06:02:20.601628+0000","last_peered":"2023-09-13T06:02:20.601628+0000","last_clean":"2023-09-13T06:02:20.601628+0000","last_became_active":"2023-09-13T06:02:18.783741+0000","last_became_peered":"2023-09-13T06:02:18.783741+0000","last_unstale":"2023-09-13T06:02:20.601628+0000","last_undegraded":"2023-09-13T06:02:20.601628+0000","last_fullsized":"2023-09-13T06:02:20.601628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:53.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.727742+0000","last_change":"2023-09-13T06:02:18.786336+0000","last_active":"2023-09-13T06:02:20.727742+0000","last_peered":"2023-09-13T06:02:20.727742+0000","last_clean":"2023-09-13T06:02:20.727742+0000","last_became_active":"2023-09-13T06:02:18.785403+0000","last_became_peered":"2023-09-13T06:02:18.785403+0000","last_unstale":"2023-09-13T06:02:20.727742+0000","last_undegraded":"2023-09-13T06:02:20.727742+0000","last_fullsized":"2023-09-13T06:02:20.727742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:39.588015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774253+0000","last_change":"2023-09-13T06:02:18.781491+0000","last_active":"2023-09-13T06:02:19.774253+0000","last_peered":"2023-09-13T06:02:19.774253+0000","last_clean":"2023-09-13T06:02:19.774253+0000","last_became_active":"2023-09-13T06:02:18.781118+0000","last_became_peered":"2023-09-13T06:02:18.781118+0000","last_unstale":"2023-09-13T06:02:19.774253+0000","last_undegraded":"2023-09-13T06:02:19.774253+0000","last_fullsized":"2023-09-13T06:02:19.774253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:42:28.096301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774024+0000","last_change":"2023-09-13T06:02:18.776395+0000","last_active":"2023-09-13T06:02:19.774024+0000","last_peered":"2023-09-13T06:02:19.774024+0000","last_clean":"2023-09-13T06:02:19.774024+0000","last_became_active":"2023-09-13T06:02:18.775647+0000","last_became_peered":"2023-09-13T06:02:18.775647+0000","last_unstale":"2023-09-13T06:02:19.774024+0000","last_undegraded":"2023-09-13T06:02:19.774024+0000","last_fullsized":"2023-09-13T06:02:19.774024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:04:30.973901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601600+0000","last_change":"2023-09-13T06:02:18.788622+0000","last_active":"2023-09-13T06:02:20.601600+0000","last_peered":"2023-09-13T06:02:20.601600+0000","last_clean":"2023-09-13T06:02:20.601600+0000","last_became_active":"2023-09-13T06:02:18.788330+0000","last_became_peered":"2023-09-13T06:02:18.788330+0000","last_unstale":"2023-09-13T06:02:20.601600+0000","last_undegraded":"2023-09-13T06:02:20.601600+0000","last_fullsized":"2023-09-13T06:02:20.601600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:18.137384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773819+0000","last_change":"2023-09-13T06:02:18.787398+0000","last_active":"2023-09-13T06:02:19.773819+0000","last_peered":"2023-09-13T06:02:19.773819+0000","last_clean":"2023-09-13T06:02:19.773819+0000","last_became_active":"2023-09-13T06:02:18.787173+0000","last_became_peered":"2023-09-13T06:02:18.787173+0000","last_unstale":"2023-09-13T06:02:19.773819+0000","last_undegraded":"2023-09-13T06:02:19.773819+0000","last_fullsized":"2023-09-13T06:02:19.773819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:42:28.096301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774676+0000","last_change":"2023-09-13T06:02:18.775007+0000","last_active":"2023-09-13T06:02:19.774676+0000","last_peered":"2023-09-13T06:02:19.774676+0000","last_clean":"2023-09-13T06:02:19.774676+0000","last_became_active":"2023-09-13T06:02:18.774682+0000","last_became_peered":"2023-09-13T06:02:18.774682+0000","last_unstale":"2023-09-13T06:02:19.774676+0000","last_undegraded":"2023-09-13T06:02:19.774676+0000","last_fullsized":"2023-09-13T06:02:19.774676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:51:17.901866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773829+0000","last_change":"2023-09-13T06:02:18.785960+0000","last_active":"2023-09-13T06:02:19.773829+0000","last_peered":"2023-09-13T06:02:19.773829+0000","last_clean":"2023-09-13T06:02:19.773829+0000","last_became_active":"2023-09-13T06:02:18.785517+0000","last_became_peered":"2023-09-13T06:02:18.785517+0000","last_unstale":"2023-09-13T06:02:19.773829+0000","last_undegraded":"2023-09-13T06:02:19.773829+0000","last_fullsized":"2023-09-13T06:02:19.773829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:45:22.198010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601511+0000","last_change":"2023-09-13T06:02:18.778652+0000","last_active":"2023-09-13T06:02:20.601511+0000","last_peered":"2023-09-13T06:02:20.601511+0000","last_clean":"2023-09-13T06:02:20.601511+0000","last_became_active":"2023-09-13T06:02:18.778267+0000","last_became_peered":"2023-09-13T06:02:18.778267+0000","last_unstale":"2023-09-13T06:02:20.601511+0000","last_undegraded":"2023-09-13T06:02:20.601511+0000","last_fullsized":"2023-09-13T06:02:20.601511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:36:14.830508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.728192+0000","last_change":"2023-09-13T06:02:18.791873+0000","last_active":"2023-09-13T06:02:20.728192+0000","last_peered":"2023-09-13T06:02:20.728192+0000","last_clean":"2023-09-13T06:02:20.728192+0000","last_became_active":"2023-09-13T06:02:18.791612+0000","last_became_peered":"2023-09-13T06:02:18.791612+0000","last_unstale":"2023-09-13T06:02:20.728192+0000","last_undegraded":"2023-09-13T06:02:20.728192+0000","last_fullsized":"2023-09-13T06:02:20.728192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:06:00.462677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774841+0000","last_change":"2023-09-13T06:02:18.789783+0000","last_active":"2023-09-13T06:02:19.774841+0000","last_peered":"2023-09-13T06:02:19.774841+0000","last_clean":"2023-09-13T06:02:19.774841+0000","last_became_active":"2023-09-13T06:02:18.789496+0000","last_became_peered":"2023-09-13T06:02:18.789496+0000","last_unstale":"2023-09-13T06:02:19.774841+0000","last_undegraded":"2023-09-13T06:02:19.774841+0000","last_fullsized":"2023-09-13T06:02:19.774841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:39.588015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774830+0000","last_change":"2023-09-13T06:02:18.786091+0000","last_active":"2023-09-13T06:02:19.774830+0000","last_peered":"2023-09-13T06:02:19.774830+0000","last_clean":"2023-09-13T06:02:19.774830+0000","last_became_active":"2023-09-13T06:02:18.785873+0000","last_became_peered":"2023-09-13T06:02:18.785873+0000","last_unstale":"2023-09-13T06:02:19.774830+0000","last_undegraded":"2023-09-13T06:02:19.774830+0000","last_fullsized":"2023-09-13T06:02:19.774830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:39.588015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774404+0000","last_change":"2023-09-13T06:02:18.781354+0000","last_active":"2023-09-13T06:02:19.774404+0000","last_peered":"2023-09-13T06:02:19.774404+0000","last_clean":"2023-09-13T06:02:19.774404+0000","last_became_active":"2023-09-13T06:02:18.780815+0000","last_became_peered":"2023-09-13T06:02:18.780815+0000","last_unstale":"2023-09-13T06:02:19.774404+0000","last_undegraded":"2023-09-13T06:02:19.774404+0000","last_fullsized":"2023-09-13T06:02:19.774404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:41:18.274591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.727643+0000","last_change":"2023-09-13T06:02:18.785460+0000","last_active":"2023-09-13T06:02:20.727643+0000","last_peered":"2023-09-13T06:02:20.727643+0000","last_clean":"2023-09-13T06:02:20.727643+0000","last_became_active":"2023-09-13T06:02:18.785175+0000","last_became_peered":"2023-09-13T06:02:18.785175+0000","last_unstale":"2023-09-13T06:02:20.727643+0000","last_undegraded":"2023-09-13T06:02:20.727643+0000","last_fullsized":"2023-09-13T06:02:20.727643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:51:17.901866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.727543+0000","last_change":"2023-09-13T06:02:18.788032+0000","last_active":"2023-09-13T06:02:20.727543+0000","last_peered":"2023-09-13T06:02:20.727543+0000","last_clean":"2023-09-13T06:02:20.727543+0000","last_became_active":"2023-09-13T06:02:18.787345+0000","last_became_peered":"2023-09-13T06:02:18.787345+0000","last_unstale":"2023-09-13T06:02:20.727543+0000","last_undegraded":"2023-09-13T06:02:20.727543+0000","last_fullsized":"2023-09-13T06:02:20.727543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:18:32.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601777+0000","last_change":"2023-09-13T06:02:18.778769+0000","last_active":"2023-09-13T06:02:20.601777+0000","last_peered":"2023-09-13T06:02:20.601777+0000","last_clean":"2023-09-13T06:02:20.601777+0000","last_became_active":"2023-09-13T06:02:18.778477+0000","last_became_peered":"2023-09-13T06:02:18.778477+0000","last_unstale":"2023-09-13T06:02:20.601777+0000","last_undegraded":"2023-09-13T06:02:20.601777+0000","last_fullsized":"2023-09-13T06:02:20.601777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:50.945408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.602048+0000","last_change":"2023-09-13T06:02:18.784859+0000","last_active":"2023-09-13T06:02:20.602048+0000","last_peered":"2023-09-13T06:02:20.602048+0000","last_clean":"2023-09-13T06:02:20.602048+0000","last_became_active":"2023-09-13T06:02:18.784589+0000","last_became_peered":"2023-09-13T06:02:18.784589+0000","last_unstale":"2023-09-13T06:02:20.602048+0000","last_undegraded":"2023-09-13T06:02:20.602048+0000","last_fullsized":"2023-09-13T06:02:20.602048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:47.783387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.602097+0000","last_change":"2023-09-13T06:02:18.786944+0000","last_active":"2023-09-13T06:02:20.602097+0000","last_peered":"2023-09-13T06:02:20.602097+0000","last_clean":"2023-09-13T06:02:20.602097+0000","last_became_active":"2023-09-13T06:02:18.786572+0000","last_became_peered":"2023-09-13T06:02:18.786572+0000","last_unstale":"2023-09-13T06:02:20.602097+0000","last_undegraded":"2023-09-13T06:02:20.602097+0000","last_fullsized":"2023-09-13T06:02:20.602097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:33:47.896284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.420136+0000","last_change":"2023-09-13T06:02:18.780326+0000","last_active":"2023-09-13T06:02:20.420136+0000","last_peered":"2023-09-13T06:02:20.420136+0000","last_clean":"2023-09-13T06:02:20.420136+0000","last_became_active":"2023-09-13T06:02:18.780102+0000","last_became_peered":"2023-09-13T06:02:18.780102+0000","last_unstale":"2023-09-13T06:02:20.420136+0000","last_undegraded":"2023-09-13T06:02:20.420136+0000","last_fullsized":"2023-09-13T06:02:20.420136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:33:47.896284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773824+0000","last_change":"2023-09-13T06:02:18.784875+0000","last_active":"2023-09-13T06:02:19.773824+0000","last_peered":"2023-09-13T06:02:19.773824+0000","last_clean":"2023-09-13T06:02:19.773824+0000","last_became_active":"2023-09-13T06:02:18.784507+0000","last_became_peered":"2023-09-13T06:02:18.784507+0000","last_unstale":"2023-09-13T06:02:19.773824+0000","last_undegraded":"2023-09-13T06:02:19.773824+0000","last_fullsized":"2023-09-13T06:02:19.773824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:04:30.973901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773561+0000","last_change":"2023-09-13T06:02:18.775277+0000","last_active":"2023-09-13T06:02:19.773561+0000","last_peered":"2023-09-13T06:02:19.773561+0000","last_clean":"2023-09-13T06:02:19.773561+0000","last_became_active":"2023-09-13T06:02:18.775059+0000","last_became_peered":"2023-09-13T06:02:18.775059+0000","last_unstale":"2023-09-13T06:02:19.773561+0000","last_undegraded":"2023-09-13T06:02:19.773561+0000","last_fullsized":"2023-09-13T06:02:19.773561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:37:38.896778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.727903+0000","last_change":"2023-09-13T06:02:18.790920+0000","last_active":"2023-09-13T06:02:20.727903+0000","last_peered":"2023-09-13T06:02:20.727903+0000","last_clean":"2023-09-13T06:02:20.727903+0000","last_became_active":"2023-09-13T06:02:18.790619+0000","last_became_peered":"2023-09-13T06:02:18.790619+0000","last_unstale":"2023-09-13T06:02:20.727903+0000","last_undegraded":"2023-09-13T06:02:20.727903+0000","last_fullsized":"2023-09-13T06:02:20.727903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:32:07.526354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773567+0000","last_change":"2023-09-13T06:02:18.791051+0000","last_active":"2023-09-13T06:02:19.773567+0000","last_peered":"2023-09-13T06:02:19.773567+0000","last_clean":"2023-09-13T06:02:19.773567+0000","last_became_active":"2023-09-13T06:02:18.790697+0000","last_became_peered":"2023-09-13T06:02:18.790697+0000","last_unstale":"2023-09-13T06:02:19.773567+0000","last_undegraded":"2023-09-13T06:02:19.773567+0000","last_fullsized":"2023-09-13T06:02:19.773567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:45:22.198010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774525+0000","last_change":"2023-09-13T06:02:18.782475+0000","last_active":"2023-09-13T06:02:19.774525+0000","last_peered":"2023-09-13T06:02:19.774525+0000","last_clean":"2023-09-13T06:02:19.774525+0000","last_became_active":"2023-09-13T06:02:18.782105+0000","last_became_peered":"2023-09-13T06:02:18.782105+0000","last_unstale":"2023-09-13T06:02:19.774525+0000","last_undegraded":"2023-09-13T06:02:19.774525+0000","last_fullsized":"2023-09-13T06:02:19.774525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:54:12.183299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601749+0000","last_change":"2023-09-13T06:02:18.795417+0000","last_active":"2023-09-13T06:02:20.601749+0000","last_peered":"2023-09-13T06:02:20.601749+0000","last_clean":"2023-09-13T06:02:20.601749+0000","last_became_active":"2023-09-13T06:02:18.795238+0000","last_became_peered":"2023-09-13T06:02:18.795238+0000","last_unstale":"2023-09-13T06:02:20.601749+0000","last_undegraded":"2023-09-13T06:02:20.601749+0000","last_fullsized":"2023-09-13T06:02:20.601749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:12:58.428104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774819+0000","last_change":"2023-09-13T06:02:18.783242+0000","last_active":"2023-09-13T06:02:19.774819+0000","last_peered":"2023-09-13T06:02:19.774819+0000","last_clean":"2023-09-13T06:02:19.774819+0000","last_became_active":"2023-09-13T06:02:18.782869+0000","last_became_peered":"2023-09-13T06:02:18.782869+0000","last_unstale":"2023-09-13T06:02:19.774819+0000","last_undegraded":"2023-09-13T06:02:19.774819+0000","last_fullsized":"2023-09-13T06:02:19.774819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:19:43.834410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601985+0000","last_change":"2023-09-13T06:02:18.788630+0000","last_active":"2023-09-13T06:02:20.601985+0000","last_peered":"2023-09-13T06:02:20.601985+0000","last_clean":"2023-09-13T06:02:20.601985+0000","last_became_active":"2023-09-13T06:02:18.787765+0000","last_became_peered":"2023-09-13T06:02:18.787765+0000","last_unstale":"2023-09-13T06:02:20.601985+0000","last_undegraded":"2023-09-13T06:02:20.601985+0000","last_fullsized":"2023-09-13T06:02:20.601985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:47.783387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774549+0000","last_change":"2023-09-13T06:02:18.785746+0000","last_active":"2023-09-13T06:02:19.774549+0000","last_peered":"2023-09-13T06:02:19.774549+0000","last_clean":"2023-09-13T06:02:19.774549+0000","last_became_active":"2023-09-13T06:02:18.785510+0000","last_became_peered":"2023-09-13T06:02:18.785510+0000","last_unstale":"2023-09-13T06:02:19.774549+0000","last_undegraded":"2023-09-13T06:02:19.774549+0000","last_fullsized":"2023-09-13T06:02:19.774549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:54:12.183299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.420362+0000","last_change":"2023-09-13T06:02:18.781768+0000","last_active":"2023-09-13T06:02:20.420362+0000","last_peered":"2023-09-13T06:02:20.420362+0000","last_clean":"2023-09-13T06:02:20.420362+0000","last_became_active":"2023-09-13T06:02:18.781551+0000","last_became_peered":"2023-09-13T06:02:18.781551+0000","last_unstale":"2023-09-13T06:02:20.420362+0000","last_undegraded":"2023-09-13T06:02:20.420362+0000","last_fullsized":"2023-09-13T06:02:20.420362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:07.090744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.794731+0000","last_change":"2023-09-13T06:02:17.762285+0000","last_active":"2023-09-13T06:02:18.794731+0000","last_peered":"2023-09-13T06:02:18.794731+0000","last_clean":"2023-09-13T06:02:18.794731+0000","last_became_active":"2023-09-13T06:02:17.762063+0000","last_became_peered":"2023-09-13T06:02:17.762063+0000","last_unstale":"2023-09-13T06:02:18.794731+0000","last_undegraded":"2023-09-13T06:02:18.794731+0000","last_fullsized":"2023-09-13T06:02:18.794731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:28.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601515+0000","last_change":"2023-09-13T06:02:18.786242+0000","last_active":"2023-09-13T06:02:20.601515+0000","last_peered":"2023-09-13T06:02:20.601515+0000","last_clean":"2023-09-13T06:02:20.601515+0000","last_became_active":"2023-09-13T06:02:18.786011+0000","last_became_peered":"2023-09-13T06:02:18.786011+0000","last_unstale":"2023-09-13T06:02:20.601515+0000","last_undegraded":"2023-09-13T06:02:20.601515+0000","last_fullsized":"2023-09-13T06:02:20.601515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:32:29.439503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.792968+0000","last_change":"2023-09-13T06:02:17.761021+0000","last_active":"2023-09-13T06:02:18.792968+0000","last_peered":"2023-09-13T06:02:18.792968+0000","last_clean":"2023-09-13T06:02:18.792968+0000","last_became_active":"2023-09-13T06:02:17.760790+0000","last_became_peered":"2023-09-13T06:02:17.760790+0000","last_unstale":"2023-09-13T06:02:18.792968+0000","last_undegraded":"2023-09-13T06:02:18.792968+0000","last_fullsized":"2023-09-13T06:02:18.792968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:49.936804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.602220+0000","last_change":"2023-09-13T06:02:18.788098+0000","last_active":"2023-09-13T06:02:20.602220+0000","last_peered":"2023-09-13T06:02:20.602220+0000","last_clean":"2023-09-13T06:02:20.602220+0000","last_became_active":"2023-09-13T06:02:18.787777+0000","last_became_peered":"2023-09-13T06:02:18.787777+0000","last_unstale":"2023-09-13T06:02:20.602220+0000","last_undegraded":"2023-09-13T06:02:20.602220+0000","last_fullsized":"2023-09-13T06:02:20.602220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:07.090744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.796770+0000","last_change":"2023-09-13T06:02:17.757092+0000","last_active":"2023-09-13T06:02:18.796770+0000","last_peered":"2023-09-13T06:02:18.796770+0000","last_clean":"2023-09-13T06:02:18.796770+0000","last_became_active":"2023-09-13T06:02:17.756854+0000","last_became_peered":"2023-09-13T06:02:17.756854+0000","last_unstale":"2023-09-13T06:02:18.796770+0000","last_undegraded":"2023-09-13T06:02:18.796770+0000","last_fullsized":"2023-09-13T06:02:18.796770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:45:21.189406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773697+0000","last_change":"2023-09-13T06:02:18.789552+0000","last_active":"2023-09-13T06:02:19.773697+0000","last_peered":"2023-09-13T06:02:19.773697+0000","last_clean":"2023-09-13T06:02:19.773697+0000","last_became_active":"2023-09-13T06:02:18.789338+0000","last_became_peered":"2023-09-13T06:02:18.789338+0000","last_unstale":"2023-09-13T06:02:19.773697+0000","last_undegraded":"2023-09-13T06:02:19.773697+0000","last_fullsized":"2023-09-13T06:02:19.773697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:04:30.973901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.796021+0000","last_change":"2023-09-13T06:02:17.758909+0000","last_active":"2023-09-13T06:02:18.796021+0000","last_peered":"2023-09-13T06:02:18.796021+0000","last_clean":"2023-09-13T06:02:18.796021+0000","last_became_active":"2023-09-13T06:02:17.758503+0000","last_became_peered":"2023-09-13T06:02:17.758503+0000","last_unstale":"2023-09-13T06:02:18.796021+0000","last_undegraded":"2023-09-13T06:02:18.796021+0000","last_fullsized":"2023-09-13T06:02:18.796021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:42:45.843689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774295+0000","last_change":"2023-09-13T06:02:18.788859+0000","last_active":"2023-09-13T06:02:19.774295+0000","last_peered":"2023-09-13T06:02:19.774295+0000","last_clean":"2023-09-13T06:02:19.774295+0000","last_became_active":"2023-09-13T06:02:18.786530+0000","last_became_peered":"2023-09-13T06:02:18.786530+0000","last_unstale":"2023-09-13T06:02:19.774295+0000","last_undegraded":"2023-09-13T06:02:19.774295+0000","last_fullsized":"2023-09-13T06:02:19.774295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:20:15.098375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.795087+0000","last_change":"2023-09-13T06:02:17.760031+0000","last_active":"2023-09-13T06:02:18.795087+0000","last_peered":"2023-09-13T06:02:18.795087+0000","last_clean":"2023-09-13T06:02:18.795087+0000","last_became_active":"2023-09-13T06:02:17.759461+0000","last_became_peered":"2023-09-13T06:02:17.759461+0000","last_unstale":"2023-09-13T06:02:18.795087+0000","last_undegraded":"2023-09-13T06:02:18.795087+0000","last_fullsized":"2023-09-13T06:02:18.795087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:40.428906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773987+0000","last_change":"2023-09-13T06:02:18.778674+0000","last_active":"2023-09-13T06:02:19.773987+0000","last_peered":"2023-09-13T06:02:19.773987+0000","last_clean":"2023-09-13T06:02:19.773987+0000","last_became_active":"2023-09-13T06:02:18.778423+0000","last_became_peered":"2023-09-13T06:02:18.778423+0000","last_unstale":"2023-09-13T06:02:19.773987+0000","last_undegraded":"2023-09-13T06:02:19.773987+0000","last_fullsized":"2023-09-13T06:02:19.773987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:42:28.096301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.795221+0000","last_change":"2023-09-13T06:02:17.757157+0000","last_active":"2023-09-13T06:02:18.795221+0000","last_peered":"2023-09-13T06:02:18.795221+0000","last_clean":"2023-09-13T06:02:18.795221+0000","last_became_active":"2023-09-13T06:02:17.756751+0000","last_became_peered":"2023-09-13T06:02:17.756751+0000","last_unstale":"2023-09-13T06:02:18.795221+0000","last_undegraded":"2023-09-13T06:02:18.795221+0000","last_fullsized":"2023-09-13T06:02:18.795221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:52.822633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.602059+0000","last_change":"2023-09-13T06:02:18.790491+0000","last_active":"2023-09-13T06:02:20.602059+0000","last_peered":"2023-09-13T06:02:20.602059+0000","last_clean":"2023-09-13T06:02:20.602059+0000","last_became_active":"2023-09-13T06:02:18.790103+0000","last_became_peered":"2023-09-13T06:02:18.790103+0000","last_unstale":"2023-09-13T06:02:20.602059+0000","last_undegraded":"2023-09-13T06:02:20.602059+0000","last_fullsized":"2023-09-13T06:02:20.602059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:21:56.721183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.779061+0000","last_change":"2023-09-13T06:02:17.756021+0000","last_active":"2023-09-13T06:02:18.779061+0000","last_peered":"2023-09-13T06:02:18.779061+0000","last_clean":"2023-09-13T06:02:18.779061+0000","last_became_active":"2023-09-13T06:02:17.755754+0000","last_became_peered":"2023-09-13T06:02:17.755754+0000","last_unstale":"2023-09-13T06:02:18.779061+0000","last_undegraded":"2023-09-13T06:02:18.779061+0000","last_fullsized":"2023-09-13T06:02:18.779061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:12:57.419500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773507+0000","last_change":"2023-09-13T06:02:18.784583+0000","last_active":"2023-09-13T06:02:19.773507+0000","last_peered":"2023-09-13T06:02:19.773507+0000","last_clean":"2023-09-13T06:02:19.773507+0000","last_became_active":"2023-09-13T06:02:18.783822+0000","last_became_peered":"2023-09-13T06:02:18.783822+0000","last_unstale":"2023-09-13T06:02:19.773507+0000","last_undegraded":"2023-09-13T06:02:19.773507+0000","last_fullsized":"2023-09-13T06:02:19.773507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:24:01.867193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.784846+0000","last_change":"2023-09-13T06:02:17.765596+0000","last_active":"2023-09-13T06:02:18.784846+0000","last_peered":"2023-09-13T06:02:18.784846+0000","last_clean":"2023-09-13T06:02:18.784846+0000","last_became_active":"2023-09-13T06:02:17.764626+0000","last_became_peered":"2023-09-13T06:02:17.764626+0000","last_unstale":"2023-09-13T06:02:18.784846+0000","last_undegraded":"2023-09-13T06:02:18.784846+0000","last_fullsized":"2023-09-13T06:02:18.784846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:06.883601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774303+0000","last_change":"2023-09-13T06:02:18.782706+0000","last_active":"2023-09-13T06:02:19.774303+0000","last_peered":"2023-09-13T06:02:19.774303+0000","last_clean":"2023-09-13T06:02:19.774303+0000","last_became_active":"2023-09-13T06:02:18.782471+0000","last_became_peered":"2023-09-13T06:02:18.782471+0000","last_unstale":"2023-09-13T06:02:19.774303+0000","last_undegraded":"2023-09-13T06:02:19.774303+0000","last_fullsized":"2023-09-13T06:02:19.774303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:18:32.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.780528+0000","last_change":"2023-09-13T06:02:17.760344+0000","last_active":"2023-09-13T06:02:18.780528+0000","last_peered":"2023-09-13T06:02:18.780528+0000","last_clean":"2023-09-13T06:02:18.780528+0000","last_became_active":"2023-09-13T06:02:17.760112+0000","last_became_peered":"2023-09-13T06:02:17.760112+0000","last_unstale":"2023-09-13T06:02:18.780528+0000","last_undegraded":"2023-09-13T06:02:18.780528+0000","last_fullsized":"2023-09-13T06:02:18.780528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:12:56.685338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.728045+0000","last_change":"2023-09-13T06:02:18.786484+0000","last_active":"2023-09-13T06:02:20.728045+0000","last_peered":"2023-09-13T06:02:20.728045+0000","last_clean":"2023-09-13T06:02:20.728045+0000","last_became_active":"2023-09-13T06:02:18.786096+0000","last_became_peered":"2023-09-13T06:02:18.786096+0000","last_unstale":"2023-09-13T06:02:20.728045+0000","last_undegraded":"2023-09-13T06:02:20.728045+0000","last_fullsized":"2023-09-13T06:02:20.728045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:50:44.134177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.776475+0000","last_change":"2023-09-13T06:02:17.757230+0000","last_active":"2023-09-13T06:02:18.776475+0000","last_peered":"2023-09-13T06:02:18.776475+0000","last_clean":"2023-09-13T06:02:18.776475+0000","last_became_active":"2023-09-13T06:02:17.756995+0000","last_became_peered":"2023-09-13T06:02:17.756995+0000","last_unstale":"2023-09-13T06:02:18.776475+0000","last_undegraded":"2023-09-13T06:02:18.776475+0000","last_fullsized":"2023-09-13T06:02:18.776475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:46:05.270362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.727986+0000","last_change":"2023-09-13T06:02:18.782812+0000","last_active":"2023-09-13T06:02:20.727986+0000","last_peered":"2023-09-13T06:02:20.727986+0000","last_clean":"2023-09-13T06:02:20.727986+0000","last_became_active":"2023-09-13T06:02:18.782601+0000","last_became_peered":"2023-09-13T06:02:18.782601+0000","last_unstale":"2023-09-13T06:02:20.727986+0000","last_undegraded":"2023-09-13T06:02:20.727986+0000","last_fullsized":"2023-09-13T06:02:20.727986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:12.787858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.795955+0000","last_change":"2023-09-13T06:02:17.760513+0000","last_active":"2023-09-13T06:02:18.795955+0000","last_peered":"2023-09-13T06:02:18.795955+0000","last_clean":"2023-09-13T06:02:18.795955+0000","last_became_active":"2023-09-13T06:02:17.759698+0000","last_became_peered":"2023-09-13T06:02:17.759698+0000","last_unstale":"2023-09-13T06:02:18.795955+0000","last_undegraded":"2023-09-13T06:02:18.795955+0000","last_fullsized":"2023-09-13T06:02:18.795955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:12:56.685338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774718+0000","last_change":"2023-09-13T06:02:18.787807+0000","last_active":"2023-09-13T06:02:19.774718+0000","last_peered":"2023-09-13T06:02:19.774718+0000","last_clean":"2023-09-13T06:02:19.774718+0000","last_became_active":"2023-09-13T06:02:18.786587+0000","last_became_peered":"2023-09-13T06:02:18.786587+0000","last_unstale":"2023-09-13T06:02:19.774718+0000","last_undegraded":"2023-09-13T06:02:19.774718+0000","last_fullsized":"2023-09-13T06:02:19.774718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:51:17.901866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.798681+0000","last_change":"2023-09-13T06:02:17.758625+0000","last_active":"2023-09-13T06:02:18.798681+0000","last_peered":"2023-09-13T06:02:18.798681+0000","last_clean":"2023-09-13T06:02:18.798681+0000","last_became_active":"2023-09-13T06:02:17.757273+0000","last_became_peered":"2023-09-13T06:02:17.757273+0000","last_unstale":"2023-09-13T06:02:18.798681+0000","last_undegraded":"2023-09-13T06:02:18.798681+0000","last_fullsized":"2023-09-13T06:02:18.798681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:46.774783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773336+0000","last_change":"2023-09-13T06:02:18.783193+0000","last_active":"2023-09-13T06:02:19.773336+0000","last_peered":"2023-09-13T06:02:19.773336+0000","last_clean":"2023-09-13T06:02:19.773336+0000","last_became_active":"2023-09-13T06:02:18.782494+0000","last_became_peered":"2023-09-13T06:02:18.782494+0000","last_unstale":"2023-09-13T06:02:19.773336+0000","last_undegraded":"2023-09-13T06:02:19.773336+0000","last_fullsized":"2023-09-13T06:02:19.773336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:13:03.400044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.793463+0000","last_change":"2023-09-13T06:02:17.765217+0000","last_active":"2023-09-13T06:02:18.793463+0000","last_peered":"2023-09-13T06:02:18.793463+0000","last_clean":"2023-09-13T06:02:18.793463+0000","last_became_active":"2023-09-13T06:02:17.764324+0000","last_became_peered":"2023-09-13T06:02:17.764324+0000","last_unstale":"2023-09-13T06:02:18.793463+0000","last_undegraded":"2023-09-13T06:02:18.793463+0000","last_fullsized":"2023-09-13T06:02:18.793463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:46:05.270362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.727653+0000","last_change":"2023-09-13T06:02:18.786373+0000","last_active":"2023-09-13T06:02:20.727653+0000","last_peered":"2023-09-13T06:02:20.727653+0000","last_clean":"2023-09-13T06:02:20.727653+0000","last_became_active":"2023-09-13T06:02:18.786023+0000","last_became_peered":"2023-09-13T06:02:18.786023+0000","last_unstale":"2023-09-13T06:02:20.727653+0000","last_undegraded":"2023-09-13T06:02:20.727653+0000","last_fullsized":"2023-09-13T06:02:20.727653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:54:12.183299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.771904+0000","last_change":"2023-09-13T06:02:17.763991+0000","last_active":"2023-09-13T06:02:18.771904+0000","last_peered":"2023-09-13T06:02:18.771904+0000","last_clean":"2023-09-13T06:02:18.771904+0000","last_became_active":"2023-09-13T06:02:17.762961+0000","last_became_peered":"2023-09-13T06:02:17.762961+0000","last_unstale":"2023-09-13T06:02:18.771904+0000","last_undegraded":"2023-09-13T06:02:18.771904+0000","last_fullsized":"2023-09-13T06:02:18.771904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:24:15.496715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774449+0000","last_change":"2023-09-13T06:02:18.789055+0000","last_active":"2023-09-13T06:02:19.774449+0000","last_peered":"2023-09-13T06:02:19.774449+0000","last_clean":"2023-09-13T06:02:19.774449+0000","last_became_active":"2023-09-13T06:02:18.788627+0000","last_became_peered":"2023-09-13T06:02:18.788627+0000","last_unstale":"2023-09-13T06:02:19.774449+0000","last_undegraded":"2023-09-13T06:02:19.774449+0000","last_fullsized":"2023-09-13T06:02:19.774449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:18:32.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.781301+0000","last_change":"2023-09-13T06:02:17.760312+0000","last_active":"2023-09-13T06:02:18.781301+0000","last_peered":"2023-09-13T06:02:18.781301+0000","last_clean":"2023-09-13T06:02:18.781301+0000","last_became_active":"2023-09-13T06:02:17.760047+0000","last_became_peered":"2023-09-13T06:02:17.760047+0000","last_unstale":"2023-09-13T06:02:18.781301+0000","last_undegraded":"2023-09-13T06:02:18.781301+0000","last_fullsized":"2023-09-13T06:02:18.781301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:04:29.965297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601696+0000","last_change":"2023-09-13T06:02:18.790719+0000","last_active":"2023-09-13T06:02:20.601696+0000","last_peered":"2023-09-13T06:02:20.601696+0000","last_clean":"2023-09-13T06:02:20.601696+0000","last_became_active":"2023-09-13T06:02:18.790494+0000","last_became_peered":"2023-09-13T06:02:18.790494+0000","last_unstale":"2023-09-13T06:02:20.601696+0000","last_undegraded":"2023-09-13T06:02:20.601696+0000","last_fullsized":"2023-09-13T06:02:20.601696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:40:16.399910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.797534+0000","last_change":"2023-09-13T06:02:17.757243+0000","last_active":"2023-09-13T06:02:18.797534+0000","last_peered":"2023-09-13T06:02:18.797534+0000","last_clean":"2023-09-13T06:02:18.797534+0000","last_became_active":"2023-09-13T06:02:17.757000+0000","last_became_peered":"2023-09-13T06:02:17.757000+0000","last_unstale":"2023-09-13T06:02:18.797534+0000","last_undegraded":"2023-09-13T06:02:18.797534+0000","last_fullsized":"2023-09-13T06:02:18.797534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:06.082140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.602288+0000","last_change":"2023-09-13T06:02:18.787346+0000","last_active":"2023-09-13T06:02:20.602288+0000","last_peered":"2023-09-13T06:02:20.602288+0000","last_clean":"2023-09-13T06:02:20.602288+0000","last_became_active":"2023-09-13T06:02:18.787104+0000","last_became_peered":"2023-09-13T06:02:18.787104+0000","last_unstale":"2023-09-13T06:02:20.602288+0000","last_undegraded":"2023-09-13T06:02:20.602288+0000","last_fullsized":"2023-09-13T06:02:20.602288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:13:03.400044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.789284+0000","last_change":"2023-09-13T06:02:17.759850+0000","last_active":"2023-09-13T06:02:18.789284+0000","last_peered":"2023-09-13T06:02:18.789284+0000","last_clean":"2023-09-13T06:02:18.789284+0000","last_became_active":"2023-09-13T06:02:17.759571+0000","last_became_peered":"2023-09-13T06:02:17.759571+0000","last_unstale":"2023-09-13T06:02:18.789284+0000","last_undegraded":"2023-09-13T06:02:18.789284+0000","last_fullsized":"2023-09-13T06:02:18.789284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:40:15.391306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773993+0000","last_change":"2023-09-13T06:02:18.789681+0000","last_active":"2023-09-13T06:02:19.773993+0000","last_peered":"2023-09-13T06:02:19.773993+0000","last_clean":"2023-09-13T06:02:19.773993+0000","last_became_active":"2023-09-13T06:02:18.789414+0000","last_became_peered":"2023-09-13T06:02:18.789414+0000","last_unstale":"2023-09-13T06:02:19.773993+0000","last_undegraded":"2023-09-13T06:02:19.773993+0000","last_fullsized":"2023-09-13T06:02:19.773993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:20:15.098375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.793217+0000","last_change":"2023-09-13T06:02:17.761635+0000","last_active":"2023-09-13T06:02:18.793217+0000","last_peered":"2023-09-13T06:02:18.793217+0000","last_clean":"2023-09-13T06:02:18.793217+0000","last_became_active":"2023-09-13T06:02:17.761041+0000","last_became_peered":"2023-09-13T06:02:17.761041+0000","last_unstale":"2023-09-13T06:02:18.793217+0000","last_undegraded":"2023-09-13T06:02:18.793217+0000","last_fullsized":"2023-09-13T06:02:18.793217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:24:15.496715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.773340+0000","last_change":"2023-09-13T06:02:18.790906+0000","last_active":"2023-09-13T06:02:19.773340+0000","last_peered":"2023-09-13T06:02:19.773340+0000","last_clean":"2023-09-13T06:02:19.773340+0000","last_became_active":"2023-09-13T06:02:18.790410+0000","last_became_peered":"2023-09-13T06:02:18.790410+0000","last_unstale":"2023-09-13T06:02:19.773340+0000","last_undegraded":"2023-09-13T06:02:19.773340+0000","last_fullsized":"2023-09-13T06:02:19.773340+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:50:28.876342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.792636+0000","last_change":"2023-09-13T06:02:17.760800+0000","last_active":"2023-09-13T06:02:18.792636+0000","last_peered":"2023-09-13T06:02:18.792636+0000","last_clean":"2023-09-13T06:02:18.792636+0000","last_became_active":"2023-09-13T06:02:17.760585+0000","last_became_peered":"2023-09-13T06:02:17.760585+0000","last_unstale":"2023-09-13T06:02:18.792636+0000","last_undegraded":"2023-09-13T06:02:18.792636+0000","last_fullsized":"2023-09-13T06:02:18.792636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:35:44.141658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601520+0000","last_change":"2023-09-13T06:02:18.775886+0000","last_active":"2023-09-13T06:02:20.601520+0000","last_peered":"2023-09-13T06:02:20.601520+0000","last_clean":"2023-09-13T06:02:20.601520+0000","last_became_active":"2023-09-13T06:02:18.775677+0000","last_became_peered":"2023-09-13T06:02:18.775677+0000","last_unstale":"2023-09-13T06:02:20.601520+0000","last_undegraded":"2023-09-13T06:02:20.601520+0000","last_fullsized":"2023-09-13T06:02:20.601520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:17.372860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.784606+0000","last_change":"2023-09-13T06:02:17.760200+0000","last_active":"2023-09-13T06:02:18.784606+0000","last_peered":"2023-09-13T06:02:18.784606+0000","last_clean":"2023-09-13T06:02:18.784606+0000","last_became_active":"2023-09-13T06:02:17.759800+0000","last_became_peered":"2023-09-13T06:02:17.759800+0000","last_unstale":"2023-09-13T06:02:18.784606+0000","last_undegraded":"2023-09-13T06:02:18.784606+0000","last_fullsized":"2023-09-13T06:02:18.784606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:49.936804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601601+0000","last_change":"2023-09-13T06:02:18.789335+0000","last_active":"2023-09-13T06:02:20.601601+0000","last_peered":"2023-09-13T06:02:20.601601+0000","last_clean":"2023-09-13T06:02:20.601601+0000","last_became_active":"2023-09-13T06:02:18.789112+0000","last_became_peered":"2023-09-13T06:02:18.789112+0000","last_unstale":"2023-09-13T06:02:20.601601+0000","last_undegraded":"2023-09-13T06:02:20.601601+0000","last_fullsized":"2023-09-13T06:02:20.601601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:29.417152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.796733+0000","last_change":"2023-09-13T06:02:17.757106+0000","last_active":"2023-09-13T06:02:18.796733+0000","last_peered":"2023-09-13T06:02:18.796733+0000","last_clean":"2023-09-13T06:02:18.796733+0000","last_became_active":"2023-09-13T06:02:17.756876+0000","last_became_peered":"2023-09-13T06:02:17.756876+0000","last_unstale":"2023-09-13T06:02:18.796733+0000","last_undegraded":"2023-09-13T06:02:18.796733+0000","last_fullsized":"2023-09-13T06:02:18.796733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:06.883601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601659+0000","last_change":"2023-09-13T06:02:18.778521+0000","last_active":"2023-09-13T06:02:20.601659+0000","last_peered":"2023-09-13T06:02:20.601659+0000","last_clean":"2023-09-13T06:02:20.601659+0000","last_became_active":"2023-09-13T06:02:18.777974+0000","last_became_peered":"2023-09-13T06:02:18.777974+0000","last_unstale":"2023-09-13T06:02:20.601659+0000","last_undegraded":"2023-09-13T06:02:20.601659+0000","last_fullsized":"2023-09-13T06:02:20.601659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:14:41.437510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.776696+0000","last_change":"2023-09-13T06:02:17.764974+0000","last_active":"2023-09-13T06:02:18.776696+0000","last_peered":"2023-09-13T06:02:18.776696+0000","last_clean":"2023-09-13T06:02:18.776696+0000","last_became_active":"2023-09-13T06:02:17.764364+0000","last_became_peered":"2023-09-13T06:02:17.764364+0000","last_unstale":"2023-09-13T06:02:18.776696+0000","last_undegraded":"2023-09-13T06:02:18.776696+0000","last_fullsized":"2023-09-13T06:02:18.776696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:35:44.141658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601618+0000","last_change":"2023-09-13T06:02:18.779292+0000","last_active":"2023-09-13T06:02:20.601618+0000","last_peered":"2023-09-13T06:02:20.601618+0000","last_clean":"2023-09-13T06:02:20.601618+0000","last_became_active":"2023-09-13T06:02:18.779056+0000","last_became_peered":"2023-09-13T06:02:18.779056+0000","last_unstale":"2023-09-13T06:02:20.601618+0000","last_undegraded":"2023-09-13T06:02:20.601618+0000","last_fullsized":"2023-09-13T06:02:20.601618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:35:45.150261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.784989+0000","last_change":"2023-09-13T06:02:17.761800+0000","last_active":"2023-09-13T06:02:18.784989+0000","last_peered":"2023-09-13T06:02:18.784989+0000","last_clean":"2023-09-13T06:02:18.784989+0000","last_became_active":"2023-09-13T06:02:17.761387+0000","last_became_peered":"2023-09-13T06:02:17.761387+0000","last_unstale":"2023-09-13T06:02:18.784989+0000","last_undegraded":"2023-09-13T06:02:18.784989+0000","last_fullsized":"2023-09-13T06:02:18.784989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:36:09.673283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774950+0000","last_change":"2023-09-13T06:02:18.783095+0000","last_active":"2023-09-13T06:02:19.774950+0000","last_peered":"2023-09-13T06:02:19.774950+0000","last_clean":"2023-09-13T06:02:19.774950+0000","last_became_active":"2023-09-13T06:02:18.782572+0000","last_became_peered":"2023-09-13T06:02:18.782572+0000","last_unstale":"2023-09-13T06:02:19.774950+0000","last_undegraded":"2023-09-13T06:02:19.774950+0000","last_fullsized":"2023-09-13T06:02:19.774950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:53.987558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.776501+0000","last_change":"2023-09-13T06:02:17.757279+0000","last_active":"2023-09-13T06:02:18.776501+0000","last_peered":"2023-09-13T06:02:18.776501+0000","last_clean":"2023-09-13T06:02:18.776501+0000","last_became_active":"2023-09-13T06:02:17.757046+0000","last_became_peered":"2023-09-13T06:02:17.757046+0000","last_unstale":"2023-09-13T06:02:18.776501+0000","last_undegraded":"2023-09-13T06:02:18.776501+0000","last_fullsized":"2023-09-13T06:02:18.776501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:40:15.391306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601782+0000","last_change":"2023-09-13T06:02:18.782423+0000","last_active":"2023-09-13T06:02:20.601782+0000","last_peered":"2023-09-13T06:02:20.601782+0000","last_clean":"2023-09-13T06:02:20.601782+0000","last_became_active":"2023-09-13T06:02:18.782204+0000","last_became_peered":"2023-09-13T06:02:18.782204+0000","last_unstale":"2023-09-13T06:02:20.601782+0000","last_undegraded":"2023-09-13T06:02:20.601782+0000","last_fullsized":"2023-09-13T06:02:20.601782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:07.892205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.787876+0000","last_change":"2023-09-13T06:02:17.761961+0000","last_active":"2023-09-13T06:02:18.787876+0000","last_peered":"2023-09-13T06:02:18.787876+0000","last_clean":"2023-09-13T06:02:18.787876+0000","last_became_active":"2023-09-13T06:02:17.760216+0000","last_became_peered":"2023-09-13T06:02:17.760216+0000","last_unstale":"2023-09-13T06:02:18.787876+0000","last_undegraded":"2023-09-13T06:02:18.787876+0000","last_fullsized":"2023-09-13T06:02:18.787876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:46:05.270362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.774118+0000","last_change":"2023-09-13T06:02:18.785796+0000","last_active":"2023-09-13T06:02:19.774118+0000","last_peered":"2023-09-13T06:02:19.774118+0000","last_clean":"2023-09-13T06:02:19.774118+0000","last_became_active":"2023-09-13T06:02:18.785117+0000","last_became_peered":"2023-09-13T06:02:18.785117+0000","last_unstale":"2023-09-13T06:02:19.774118+0000","last_undegraded":"2023-09-13T06:02:19.774118+0000","last_fullsized":"2023-09-13T06:02:19.774118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:41:18.274591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.420340+0000","last_change":"2023-09-13T06:02:17.758069+0000","last_active":"2023-09-13T06:02:20.420340+0000","last_peered":"2023-09-13T06:02:20.420340+0000","last_clean":"2023-09-13T06:02:20.420340+0000","last_became_active":"2023-09-13T06:02:17.757840+0000","last_became_peered":"2023-09-13T06:02:17.757840+0000","last_unstale":"2023-09-13T06:02:20.420340+0000","last_undegraded":"2023-09-13T06:02:20.420340+0000","last_fullsized":"2023-09-13T06:02:20.420340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:32:57.042316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.420110+0000","last_change":"2023-09-13T06:02:18.779696+0000","last_active":"2023-09-13T06:02:20.420110+0000","last_peered":"2023-09-13T06:02:20.420110+0000","last_clean":"2023-09-13T06:02:20.420110+0000","last_became_active":"2023-09-13T06:02:18.779465+0000","last_became_peered":"2023-09-13T06:02:18.779465+0000","last_unstale":"2023-09-13T06:02:20.420110+0000","last_undegraded":"2023-09-13T06:02:20.420110+0000","last_fullsized":"2023-09-13T06:02:20.420110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:21:56.721183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.774294+0000","last_change":"2023-09-13T06:02:17.758184+0000","last_active":"2023-09-13T06:02:18.774294+0000","last_peered":"2023-09-13T06:02:18.774294+0000","last_clean":"2023-09-13T06:02:18.774294+0000","last_became_active":"2023-09-13T06:02:17.757752+0000","last_became_peered":"2023-09-13T06:02:17.757752+0000","last_unstale":"2023-09-13T06:02:18.774294+0000","last_undegraded":"2023-09-13T06:02:18.774294+0000","last_fullsized":"2023-09-13T06:02:18.774294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:33:46.887680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.601852+0000","last_change":"2023-09-13T06:02:18.783650+0000","last_active":"2023-09-13T06:02:20.601852+0000","last_peered":"2023-09-13T06:02:20.601852+0000","last_clean":"2023-09-13T06:02:20.601852+0000","last_became_active":"2023-09-13T06:02:18.783095+0000","last_became_peered":"2023-09-13T06:02:18.783095+0000","last_unstale":"2023-09-13T06:02:20.601852+0000","last_undegraded":"2023-09-13T06:02:20.601852+0000","last_fullsized":"2023-09-13T06:02:20.601852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:12:58.428104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.777372+0000","last_change":"2023-09-13T06:02:17.759047+0000","last_active":"2023-09-13T06:02:18.777372+0000","last_peered":"2023-09-13T06:02:18.777372+0000","last_clean":"2023-09-13T06:02:18.777372+0000","last_became_active":"2023-09-13T06:02:17.758821+0000","last_became_peered":"2023-09-13T06:02:17.758821+0000","last_unstale":"2023-09-13T06:02:18.777372+0000","last_undegraded":"2023-09-13T06:02:18.777372+0000","last_fullsized":"2023-09-13T06:02:18.777372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:32:28.430899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.420084+0000","last_change":"2023-09-13T06:02:18.780825+0000","last_active":"2023-09-13T06:02:20.420084+0000","last_peered":"2023-09-13T06:02:20.420084+0000","last_clean":"2023-09-13T06:02:20.420084+0000","last_became_active":"2023-09-13T06:02:18.780517+0000","last_became_peered":"2023-09-13T06:02:18.780517+0000","last_unstale":"2023-09-13T06:02:20.420084+0000","last_undegraded":"2023-09-13T06:02:20.420084+0000","last_fullsized":"2023-09-13T06:02:20.420084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:47.783387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.772667+0000","last_change":"2023-09-13T06:02:17.762871+0000","last_active":"2023-09-13T06:02:18.772667+0000","last_peered":"2023-09-13T06:02:18.772667+0000","last_clean":"2023-09-13T06:02:18.772667+0000","last_became_active":"2023-09-13T06:02:17.761720+0000","last_became_peered":"2023-09-13T06:02:17.761720+0000","last_unstale":"2023-09-13T06:02:18.772667+0000","last_undegraded":"2023-09-13T06:02:18.772667+0000","last_fullsized":"2023-09-13T06:02:18.772667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:12:57.419500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.727731+0000","last_change":"2023-09-13T06:02:18.788167+0000","last_active":"2023-09-13T06:02:20.727731+0000","last_peered":"2023-09-13T06:02:20.727731+0000","last_clean":"2023-09-13T06:02:20.727731+0000","last_became_active":"2023-09-13T06:02:18.787650+0000","last_became_peered":"2023-09-13T06:02:18.787650+0000","last_unstale":"2023-09-13T06:02:20.727731+0000","last_undegraded":"2023-09-13T06:02:20.727731+0000","last_fullsized":"2023-09-13T06:02:20.727731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:19:43.834410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.785137+0000","last_change":"2023-09-13T06:02:17.763666+0000","last_active":"2023-09-13T06:02:18.785137+0000","last_peered":"2023-09-13T06:02:18.785137+0000","last_clean":"2023-09-13T06:02:18.785137+0000","last_became_active":"2023-09-13T06:02:17.763447+0000","last_became_peered":"2023-09-13T06:02:17.763447+0000","last_unstale":"2023-09-13T06:02:18.785137+0000","last_undegraded":"2023-09-13T06:02:18.785137+0000","last_fullsized":"2023-09-13T06:02:18.785137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:32:57.042316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:20.602327+0000","last_change":"2023-09-13T06:02:18.786116+0000","last_active":"2023-09-13T06:02:20.602327+0000","last_peered":"2023-09-13T06:02:20.602327+0000","last_clean":"2023-09-13T06:02:20.602327+0000","last_became_active":"2023-09-13T06:02:18.785887+0000","last_became_peered":"2023-09-13T06:02:18.785887+0000","last_unstale":"2023-09-13T06:02:20.602327+0000","last_undegraded":"2023-09-13T06:02:20.602327+0000","last_fullsized":"2023-09-13T06:02:20.602327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:50:28.876342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.778622+0000","last_change":"2023-09-13T06:02:17.758766+0000","last_active":"2023-09-13T06:02:18.778622+0000","last_peered":"2023-09-13T06:02:18.778622+0000","last_clean":"2023-09-13T06:02:18.778622+0000","last_became_active":"2023-09-13T06:02:17.758343+0000","last_became_peered":"2023-09-13T06:02:17.758343+0000","last_unstale":"2023-09-13T06:02:18.778622+0000","last_undegraded":"2023-09-13T06:02:18.778622+0000","last_fullsized":"2023-09-13T06:02:18.778622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:40:15.391306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-09-13T06:02:19.775090+0000","last_change":"2023-09-13T06:02:18.775562+0000","last_active":"2023-09-13T06:02:19.775090+0000","last_peered":"2023-09-13T06:02:19.775090+0000","last_clean":"2023-09-13T06:02:19.775090+0000","last_became_active":"2023-09-13T06:02:18.775305+0000","last_became_peered":"2023-09-13T06:02:18.775305+0000","last_unstale":"2023-09-13T06:02:19.775090+0000","last_undegraded":"2023-09-13T06:02:19.775090+0000","last_fullsized":"2023-09-13T06:02:19.775090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:17.745565+0000","last_clean_scrub_stamp":"2023-09-13T06:02:17.745565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:32:07.526354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.776812+0000","last_change":"2023-09-13T06:02:17.765194+0000","last_active":"2023-09-13T06:02:18.776812+0000","last_peered":"2023-09-13T06:02:18.776812+0000","last_clean":"2023-09-13T06:02:18.776812+0000","last_became_active":"2023-09-13T06:02:17.764751+0000","last_became_peered":"2023-09-13T06:02:17.764751+0000","last_unstale":"2023-09-13T06:02:18.776812+0000","last_undegraded":"2023-09-13T06:02:18.776812+0000","last_fullsized":"2023-09-13T06:02:18.776812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:16.736961+0000","last_clean_scrub_stamp":"2023-09-13T06:02:16.736961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:52.822633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-09-13T06:02:18.772202+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:02:18.772202+0000","last_peered":"2023-09-13T06:02:18.772202+0000","last_clean":"2023-09-13T06:02:18.772202+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:02:18.772202+0000","last_undegraded":"2023-09-13T06:02:18.772202+0000","last_fullsized":"2023-09-13T06:02:18.772202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.77100000000000002}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.73099999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.621},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.504}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70499999999999996}]},{"osd":1,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.75700000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.628},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48799999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.51300000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.58799999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53200000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.70899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.63100000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.871},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69899999999999995}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.748}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.88800000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.85199999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.81999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.432},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.505}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.82699999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.86799999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.71199999999999997}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.75}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861329,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.34899999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.377},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.44900000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55300000000000005}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.64300000000000002}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.502},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.52300000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.57599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.372},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.501}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.752},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.627}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.72399999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.64000000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199271031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.438}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.91800000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.871}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.82399999999999995}]}]}],"pool_statfs":[]}} 2023-09-13T06:02:27.781 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T06:02:27.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-13T06:02:27.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.955+0000 7f66f2e7b640 1 Processor -- start 2023-09-13T06:02:27.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.955+0000 7f66f2e7b640 1 -- start start 2023-09-13T06:02:27.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f2e7b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec15a080 0x7f66ec0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f2e7b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f66ec15e650 0x7f66ec0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f2e7b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec0cc850 con 0x7f66ec0b2fd0 2023-09-13T06:02:27.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f2e7b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec0b3420 con 0x7f66ec15e650 2023-09-13T06:02:27.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f2e7b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec0b0330 con 0x7f66ec15a080 2023-09-13T06:02:27.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f1418640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f66ec0b2fd0 0x7f66ec0ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54536/0 (socket says 172.21.15.130:54536) 2023-09-13T06:02:27.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f1418640 1 -- 172.21.15.130:0/2373260231 learned_addr learned my addr 172.21.15.130:0/2373260231 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:27.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f0c17640 1 --2- 172.21.15.130:0/2373260231 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec15a080 0x7f66ec0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66ebfff640 1 --2- 172.21.15.130:0/2373260231 >> v2:172.21.15.164:3300/0 conn(0x7f66ec15e650 0x7f66ec0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66eb7fe640 1 -- 172.21.15.130:0/2373260231 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287680929 0 0) 0x7f66e40014a0 con 0x7f66ec0b2fd0 2023-09-13T06:02:27.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66eb7fe640 1 -- 172.21.15.130:0/2373260231 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66dc003530 con 0x7f66ec0b2fd0 2023-09-13T06:02:27.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f0c17640 1 -- 172.21.15.130:0/2373260231 >> v2:172.21.15.164:3300/0 conn(0x7f66ec15e650 msgr2=0x7f66ec0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:27.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f0c17640 1 --2- 172.21.15.130:0/2373260231 >> v2:172.21.15.164:3300/0 conn(0x7f66ec15e650 0x7f66ec0b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f0c17640 1 -- 172.21.15.130:0/2373260231 >> v1:172.21.15.130:6789/0 conn(0x7f66ec0b2fd0 legacy=0x7f66ec0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:27.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.959+0000 7f66f0c17640 1 -- 172.21.15.130:0/2373260231 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec0cbcd0 con 0x7f66ec15a080 2023-09-13T06:02:27.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66f0c17640 1 --2- 172.21.15.130:0/2373260231 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec15a080 0x7f66ec0b1460 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66e00097c0 tx=0x7f66e001c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=915093f23d023c33 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:27.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66eb7fe640 1 -- 172.21.15.130:0/2373260231 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e00ab600 con 0x7f66ec15a080 2023-09-13T06:02:27.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66eb7fe640 1 -- 172.21.15.130:0/2373260231 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e00a7050 con 0x7f66ec15a080 2023-09-13T06:02:27.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66eb7fe640 1 -- 172.21.15.130:0/2373260231 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e00ab980 con 0x7f66ec15a080 2023-09-13T06:02:27.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66f2e7b640 1 -- 172.21.15.130:0/2373260231 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec15a080 msgr2=0x7f66ec0b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:27.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66f2e7b640 1 --2- 172.21.15.130:0/2373260231 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec15a080 0x7f66ec0b1460 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66e00097c0 tx=0x7f66e001c390 comp rx=0 tx=0).stop 2023-09-13T06:02:27.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66f2e7b640 1 -- 172.21.15.130:0/2373260231 shutdown_connections 2023-09-13T06:02:27.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66f2e7b640 1 --2- 172.21.15.130:0/2373260231 >> v2:172.21.15.164:3300/0 conn(0x7f66ec15e650 0x7f66ec0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66f2e7b640 1 --2- 172.21.15.130:0/2373260231 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec15a080 0x7f66ec0b1460 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66f2e7b640 1 -- 172.21.15.130:0/2373260231 >> 172.21.15.130:0/2373260231 conn(0x7f66ec065990 msgr2=0x7f66ec065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:27.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66f2e7b640 1 -- 172.21.15.130:0/2373260231 shutdown_connections 2023-09-13T06:02:27.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66f2e7b640 1 -- 172.21.15.130:0/2373260231 wait complete. 2023-09-13T06:02:27.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66f2e7b640 1 Processor -- start 2023-09-13T06:02:27.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.963+0000 7f66f2e7b640 1 -- start start 2023-09-13T06:02:27.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f2e7b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec0b2fd0 0x7f66ec153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f2e7b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66ec15a080 0x7f66ec149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f2e7b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66ec15e650 0x7f66ec06e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f2e7b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec142200 con 0x7f66ec15a080 2023-09-13T06:02:27.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f2e7b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec149890 con 0x7f66ec15e650 2023-09-13T06:02:27.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f2e7b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec149b30 con 0x7f66ec0b2fd0 2023-09-13T06:02:27.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66ebfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66ec15a080 0x7f66ec149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66ebfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66ec15a080 0x7f66ec149350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46390/0 (socket says 172.21.15.130:46390) 2023-09-13T06:02:27.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66ebfff640 1 -- 172.21.15.130:0/447056122 learned_addr learned my addr 172.21.15.130:0/447056122 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:27.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f1418640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66ec15e650 0x7f66ec06e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f0c17640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec0b2fd0 0x7f66ec153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66ebfff640 1 -- 172.21.15.130:0/447056122 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec0b2fd0 msgr2=0x7f66ec153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:27.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66ebfff640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec0b2fd0 0x7f66ec153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66ebfff640 1 -- 172.21.15.130:0/447056122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66ec15e650 msgr2=0x7f66ec06e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:27.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66ebfff640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66ec15e650 0x7f66ec06e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:27.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66ebfff640 1 -- 172.21.15.130:0/447056122 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e0009420 con 0x7f66ec15a080 2023-09-13T06:02:27.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f0c17640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec0b2fd0 0x7f66ec153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:27.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66ebfff640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66ec15a080 0x7f66ec149350 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f66d800e870 tx=0x7f66d800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:27.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66e97fa640 1 -- 172.21.15.130:0/447056122 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8009510 con 0x7f66ec15a080 2023-09-13T06:02:27.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66e97fa640 1 -- 172.21.15.130:0/447056122 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800eec0 con 0x7f66ec15a080 2023-09-13T06:02:27.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66e97fa640 1 -- 172.21.15.130:0/447056122 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800cb40 con 0x7f66ec15a080 2023-09-13T06:02:27.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f2e7b640 1 -- 172.21.15.130:0/447056122 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec149e10 con 0x7f66ec15a080 2023-09-13T06:02:27.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f2e7b640 1 -- 172.21.15.130:0/447056122 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec14a3d0 con 0x7f66ec15a080 2023-09-13T06:02:27.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.967+0000 7f66f2e7b640 1 -- 172.21.15.130:0/447056122 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec0618a0 con 0x7f66ec15a080 2023-09-13T06:02:27.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.971+0000 7f66e97fa640 1 -- 172.21.15.130:0/447056122 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f66d800ccc0 con 0x7f66ec15a080 2023-09-13T06:02:27.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.971+0000 7f66e97fa640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d0065b20 0x7f66d0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:27.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.971+0000 7f66e97fa640 1 -- 172.21.15.130:0/447056122 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66d8083340 con 0x7f66ec15a080 2023-09-13T06:02:27.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.971+0000 7f66f0c17640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d0065b20 0x7f66d0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:27.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.971+0000 7f66f0c17640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d0065b20 0x7f66d0067fe0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f66e00ad000 tx=0x7f66e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:27.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:27.975+0000 7f66e97fa640 1 -- 172.21.15.130:0/447056122 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f66d8050d30 con 0x7f66ec15a080 2023-09-13T06:02:28.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.171+0000 7f66f2e7b640 1 -- 172.21.15.130:0/447056122 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f66ec0cd3d0 con 0x7f66ec15a080 2023-09-13T06:02:28.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.175+0000 7f66e97fa640 1 -- 172.21.15.130:0/447056122 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f66d8054350 con 0x7f66ec15a080 2023-09-13T06:02:28.185 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:02:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:02:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: caps mds = "allow" 2023-09-13T06:02:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: caps mon = "allow r" 2023-09-13T06:02:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-13T06:02:28.187 INFO:teuthology.orchestra.run.smithi130.stderr:updated caps for client.0 2023-09-13T06:02:28.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 -- 172.21.15.130:0/447056122 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d0065b20 msgr2=0x7f66d0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:28.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d0065b20 0x7f66d0067fe0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f66e00ad000 tx=0x7f66e0008040 comp rx=0 tx=0).stop 2023-09-13T06:02:28.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 -- 172.21.15.130:0/447056122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66ec15a080 msgr2=0x7f66ec149350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:28.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66ec15a080 0x7f66ec149350 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f66d800e870 tx=0x7f66d800ec70 comp rx=0 tx=0).stop 2023-09-13T06:02:28.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 -- 172.21.15.130:0/447056122 shutdown_connections 2023-09-13T06:02:28.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d0065b20 0x7f66d0067fe0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66ec15e650 0x7f66ec06e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66ec15a080 0x7f66ec149350 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 --2- 172.21.15.130:0/447056122 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66ec0b2fd0 0x7f66ec153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 -- 172.21.15.130:0/447056122 >> 172.21.15.130:0/447056122 conn(0x7f66ec065990 msgr2=0x7f66ec14f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:28.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 -- 172.21.15.130:0/447056122 shutdown_connections 2023-09-13T06:02:28.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.179+0000 7f66f2e7b640 1 -- 172.21.15.130:0/447056122 wait complete. 2023-09-13T06:02:28.203 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:28.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.335+0000 7f79ccb67640 1 Processor -- start 2023-09-13T06:02:28.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.335+0000 7f79ccb67640 1 -- start start 2023-09-13T06:02:28.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79ccb67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79c80b1d20 0x7f79c80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79ccb67640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c80ccfd0 con 0x7f79c8159f20 2023-09-13T06:02:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79ccb67640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c80ced90 con 0x7f79c80cdfc0 2023-09-13T06:02:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79ccb67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80ce430 con 0x7f79c80b1d20 2023-09-13T06:02:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c659c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f79c8159f20 0x7f79c80b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54544/0 (socket says 172.21.15.130:54544) 2023-09-13T06:02:28.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c659c640 1 -- 172.21.15.130:0/3684320330 learned_addr learned my addr 172.21.15.130:0/3684320330 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:28.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227570158 0 0) 0x7f79c80ccfd0 con 0x7f79c8159f20 2023-09-13T06:02:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79b4005740 con 0x7f79c8159f20 2023-09-13T06:02:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79bdd9b640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79c80b1d20 0x7f79c80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3627738620 0 0) 0x7f79b4005740 con 0x7f79c8159f20 2023-09-13T06:02:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79c80b1d20 msgr2=0x7f79c80ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79c80b1d20 0x7f79c80ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 >> v1:172.21.15.164:6789/0 conn(0x7f79c80cdfc0 legacy=0x7f79c80ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c80cd200 con 0x7f79c8159f20 2023-09-13T06:02:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f79b8001680 con 0x7f79c8159f20 2023-09-13T06:02:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 >> v1:172.21.15.130:6789/0 conn(0x7f79c8159f20 legacy=0x7f79c80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79c80b1d20 0x7f79b4005c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79b4006200 0x7f79b40069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79b4006f20 0x7f79b40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80ce430 con 0x7f79b4006200 2023-09-13T06:02:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b400dd60 con 0x7f79b4006f20 2023-09-13T06:02:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b400df20 con 0x7f79c80b1d20 2023-09-13T06:02:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79bdd9b640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79b4006200 0x7f79b40069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c6d9d640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79b4006f20 0x7f79b40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79c659c640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79c80b1d20 0x7f79b4005c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79bdd9b640 1 -- 172.21.15.130:0/3684320330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79c80b1d20 msgr2=0x7f79b4005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79bdd9b640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79c80b1d20 0x7f79b4005c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79bdd9b640 1 -- 172.21.15.130:0/3684320330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79b4006f20 msgr2=0x7f79b40073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79bdd9b640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79b4006f20 0x7f79b40073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.339+0000 7f79bdd9b640 1 -- 172.21.15.130:0/3684320330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b4005740 con 0x7f79b4006200 2023-09-13T06:02:28.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.343+0000 7f79bdd9b640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79b4006200 0x7f79b40069e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009ae0 tx=0x7f79b001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be493f837caf76e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:28.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.343+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00a55e0 con 0x7f79b4006200 2023-09-13T06:02:28.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.343+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00a5740 con 0x7f79b4006200 2023-09-13T06:02:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.343+0000 7f79c5d9b640 1 -- 172.21.15.130:0/3684320330 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00a5af0 con 0x7f79b4006200 2023-09-13T06:02:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.343+0000 7f79ccb67640 1 -- 172.21.15.130:0/3684320330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79b4006200 msgr2=0x7f79b40069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.343+0000 7f79ccb67640 1 --2- 172.21.15.130:0/3684320330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79b4006200 0x7f79b40069e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009ae0 tx=0x7f79b001c9f0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.343+0000 7f79c6d9d640 1 -- 172.21.15.130:0/3684320330 reap_dead start 2023-09-13T06:02:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.343+0000 7f79ccb67640 1 -- 172.21.15.130:0/3684320330 shutdown_connections 2023-09-13T06:02:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.343+0000 7f79ccb67640 1 -- 172.21.15.130:0/3684320330 >> 172.21.15.130:0/3684320330 conn(0x7f79c8065990 msgr2=0x7f79c8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.343+0000 7f79ccb67640 1 -- 172.21.15.130:0/3684320330 shutdown_connections 2023-09-13T06:02:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.343+0000 7f79ccb67640 1 -- 172.21.15.130:0/3684320330 wait complete. 2023-09-13T06:02:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79ccb67640 1 Processor -- start 2023-09-13T06:02:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79ccb67640 1 -- start start 2023-09-13T06:02:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79ccb67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79b4006200 0x7f79c8148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79ccb67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c8157260 0x7f79c81576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79ccb67640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79c806f4b0 0x7f79c806f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79ccb67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c81489d0 con 0x7f79c8157260 2023-09-13T06:02:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79ccb67640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c806fe70 con 0x7f79c806f4b0 2023-09-13T06:02:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79ccb67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c8158920 con 0x7f79b4006200 2023-09-13T06:02:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bdd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c8157260 0x7f79c81576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bdd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c8157260 0x7f79c81576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46414/0 (socket says 172.21.15.130:46414) 2023-09-13T06:02:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bdd9b640 1 -- 172.21.15.130:0/3238728549 learned_addr learned my addr 172.21.15.130:0/3238728549 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79c659c640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79b4006200 0x7f79c8148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79c6d9d640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79c806f4b0 0x7f79c806f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bdd9b640 1 -- 172.21.15.130:0/3238728549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79b4006200 msgr2=0x7f79c8148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bdd9b640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79b4006200 0x7f79c8148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bdd9b640 1 -- 172.21.15.130:0/3238728549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79c806f4b0 msgr2=0x7f79c806f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bdd9b640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79c806f4b0 0x7f79c806f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bdd9b640 1 -- 172.21.15.130:0/3238728549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8157d10 con 0x7f79c8157260 2023-09-13T06:02:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bdd9b640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c8157260 0x7f79c81576e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009ae0 tx=0x7f79b4007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bf7fe640 1 -- 172.21.15.130:0/3238728549 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00be070 con 0x7f79c8157260 2023-09-13T06:02:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bf7fe640 1 -- 172.21.15.130:0/3238728549 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0004020 con 0x7f79c8157260 2023-09-13T06:02:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79bf7fe640 1 -- 172.21.15.130:0/3238728549 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00a55e0 con 0x7f79c8157260 2023-09-13T06:02:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79ccb67640 1 -- 172.21.15.130:0/3238728549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c8157ff0 con 0x7f79c8157260 2023-09-13T06:02:28.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79ccb67640 1 -- 172.21.15.130:0/3238728549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c81585b0 con 0x7f79c8157260 2023-09-13T06:02:28.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.347+0000 7f79ccb67640 1 -- 172.21.15.130:0/3238728549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c80618a0 con 0x7f79c8157260 2023-09-13T06:02:28.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.351+0000 7f79bf7fe640 1 -- 172.21.15.130:0/3238728549 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f79b00b4040 con 0x7f79c8157260 2023-09-13T06:02:28.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.351+0000 7f79bf7fe640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79a8065b20 0x7f79a8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:28.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.351+0000 7f79bf7fe640 1 -- 172.21.15.130:0/3238728549 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79b011ce30 con 0x7f79c8157260 2023-09-13T06:02:28.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.351+0000 7f79c659c640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79a8065b20 0x7f79a8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:28.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.351+0000 7f79c659c640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79a8065b20 0x7f79a8067fe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f79b8000c10 tx=0x7f79b8001470 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:28.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.355+0000 7f79bf7fe640 1 -- 172.21.15.130:0/3238728549 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f79b00ea9e0 con 0x7f79c8157260 2023-09-13T06:02:28.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 -- 172.21.15.130:0/3238728549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79c81e7f10 con 0x7f79c8157260 2023-09-13T06:02:28.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79bf7fe640 1 -- 172.21.15.130:0/3238728549 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f79b00ee000 con 0x7f79c8157260 2023-09-13T06:02:28.543 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:28.543 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3600813785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3600813785},{"type":"v1","addr":"172.21.15.164:6834","nonce":3600813785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3946401321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3946401321},{"type":"v1","addr":"172.21.15.164:6835","nonce":3946401321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5097,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/746143804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":746143804},{"type":"v1","addr":"172.21.15.130:6835","nonce":746143804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:18.135350+0000","modified":"2023-09-13T06:02:21.179925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1879815978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1879815978},{"type":"v1","addr":"172.21.15.130:6837","nonce":1879815978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-13T06:02:28.544 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 16 2023-09-13T06:02:28.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 -- 172.21.15.130:0/3238728549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79a8065b20 msgr2=0x7f79a8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:28.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79a8065b20 0x7f79a8067fe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f79b8000c10 tx=0x7f79b8001470 comp rx=0 tx=0).stop 2023-09-13T06:02:28.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 -- 172.21.15.130:0/3238728549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c8157260 msgr2=0x7f79c81576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:28.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c8157260 0x7f79c81576e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009ae0 tx=0x7f79b4007a10 comp rx=0 tx=0).stop 2023-09-13T06:02:28.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 -- 172.21.15.130:0/3238728549 shutdown_connections 2023-09-13T06:02:28.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79a8065b20 0x7f79a8067fe0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79c806f4b0 0x7f79c806f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c8157260 0x7f79c81576e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 --2- 172.21.15.130:0/3238728549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79b4006200 0x7f79c8148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:28.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 -- 172.21.15.130:0/3238728549 >> 172.21.15.130:0/3238728549 conn(0x7f79c8065990 msgr2=0x7f79c80ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:28.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.535+0000 7f79ccb67640 1 -- 172.21.15.130:0/3238728549 shutdown_connections 2023-09-13T06:02:28.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:28.539+0000 7f79ccb67640 1 -- 172.21.15.130:0/3238728549 wait complete. 2023-09-13T06:02:28.964 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T06:02:18.135350+0000', 'modified': '2023-09-13T06:02:21.179925+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5106}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5106': {'gid': 5106, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6837/1879815978', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 1879815978}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 1879815978}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T06:02:28.965 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T06:02:28.965 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-13T06:02:29.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.099+0000 7f7b964d8640 1 Processor -- start 2023-09-13T06:02:29.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.099+0000 7f7b964d8640 1 -- start start 2023-09-13T06:02:29.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.099+0000 7f7b964d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b9015b130 0x7f7b900cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.099+0000 7f7b964d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b900ce980 con 0x7f7b900ce180 2023-09-13T06:02:29.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.099+0000 7f7b964d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b900cec60 con 0x7f7b900b04a0 2023-09-13T06:02:29.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.099+0000 7f7b964d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9006c640 con 0x7f7b9015b130 2023-09-13T06:02:29.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.103+0000 7f7b8f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f7b900ce180 0x7f7b9015b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54558/0 (socket says 172.21.15.130:54558) 2023-09-13T06:02:29.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.103+0000 7f7b8f7fe640 1 -- 172.21.15.130:0/3123275043 learned_addr learned my addr 172.21.15.130:0/3123275043 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:29.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.103+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/3123275043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b9015b130 0x7f7b900cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.103+0000 7f7b8effd640 1 -- 172.21.15.130:0/3123275043 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240403269 0 0) 0x7f7b900cec60 con 0x7f7b900b04a0 2023-09-13T06:02:29.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.103+0000 7f7b8effd640 1 -- 172.21.15.130:0/3123275043 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b78003530 con 0x7f7b900b04a0 2023-09-13T06:02:29.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.103+0000 7f7b8effd640 1 -- 172.21.15.130:0/3123275043 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706588319 0 0) 0x7f7b900ce980 con 0x7f7b900ce180 2023-09-13T06:02:29.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.103+0000 7f7b8effd640 1 -- 172.21.15.130:0/3123275043 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b900cec60 con 0x7f7b900ce180 2023-09-13T06:02:29.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.103+0000 7f7b8ffff640 1 -- 172.21.15.130:0/3123275043 >> v1:172.21.15.164:6789/0 conn(0x7f7b900b04a0 legacy=0x7f7b9006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.103+0000 7f7b8ffff640 1 -- 172.21.15.130:0/3123275043 >> v1:172.21.15.130:6789/0 conn(0x7f7b900ce180 legacy=0x7f7b9015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.103+0000 7f7b8ffff640 1 -- 172.21.15.130:0/3123275043 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9006c920 con 0x7f7b9015b130 2023-09-13T06:02:29.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.103+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/3123275043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b9015b130 0x7f7b900cc780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7b800097f0 tx=0x7f7b8001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeb91465b6f29640 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:29.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b8effd640 1 -- 172.21.15.130:0/3123275043 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800ac410 con 0x7f7b9015b130 2023-09-13T06:02:29.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b8effd640 1 -- 172.21.15.130:0/3123275043 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b800ac570 con 0x7f7b9015b130 2023-09-13T06:02:29.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b8effd640 1 -- 172.21.15.130:0/3123275043 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800ac900 con 0x7f7b9015b130 2023-09-13T06:02:29.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 -- 172.21.15.130:0/3123275043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b9015b130 msgr2=0x7f7b900cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 --2- 172.21.15.130:0/3123275043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b9015b130 0x7f7b900cc780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7b800097f0 tx=0x7f7b8001c4c0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 -- 172.21.15.130:0/3123275043 shutdown_connections 2023-09-13T06:02:29.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 --2- 172.21.15.130:0/3123275043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b9015b130 0x7f7b900cc780 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 -- 172.21.15.130:0/3123275043 >> 172.21.15.130:0/3123275043 conn(0x7f7b90065990 msgr2=0x7f7b90065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:29.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 -- 172.21.15.130:0/3123275043 shutdown_connections 2023-09-13T06:02:29.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 -- 172.21.15.130:0/3123275043 wait complete. 2023-09-13T06:02:29.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 Processor -- start 2023-09-13T06:02:29.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 -- start start 2023-09-13T06:02:29.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b900b04a0 0x7f7b90158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b900ce180 0x7f7b90155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b9015b130 0x7f7b90151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b90159980 con 0x7f7b900b04a0 2023-09-13T06:02:29.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b90159da0 con 0x7f7b900ce180 2023-09-13T06:02:29.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b964d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b90158d00 con 0x7f7b9015b130 2023-09-13T06:02:29.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b8ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b900b04a0 0x7f7b90158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b8ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b900b04a0 0x7f7b90158620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46424/0 (socket says 172.21.15.130:46424) 2023-09-13T06:02:29.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.107+0000 7f7b8ffff640 1 -- 172.21.15.130:0/1890824997 learned_addr learned my addr 172.21.15.130:0/1890824997 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:29.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b900ce180 0x7f7b90155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b94a75640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b9015b130 0x7f7b90151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8ffff640 1 -- 172.21.15.130:0/1890824997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b9015b130 msgr2=0x7f7b90151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b9015b130 0x7f7b90151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8ffff640 1 -- 172.21.15.130:0/1890824997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b900ce180 msgr2=0x7f7b90155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b900ce180 0x7f7b90155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8ffff640 1 -- 172.21.15.130:0/1890824997 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b80009420 con 0x7f7b900b04a0 2023-09-13T06:02:29.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b900b04a0 0x7f7b90158620 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7b800190d0 tx=0x7f7b80019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:29.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8cff9640 1 -- 172.21.15.130:0/1890824997 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80006e20 con 0x7f7b900b04a0 2023-09-13T06:02:29.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8cff9640 1 -- 172.21.15.130:0/1890824997 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b800ace20 con 0x7f7b900b04a0 2023-09-13T06:02:29.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8cff9640 1 -- 172.21.15.130:0/1890824997 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800b5880 con 0x7f7b900b04a0 2023-09-13T06:02:29.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b964d8640 1 -- 172.21.15.130:0/1890824997 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b90158fe0 con 0x7f7b900b04a0 2023-09-13T06:02:29.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b964d8640 1 -- 172.21.15.130:0/1890824997 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b901595a0 con 0x7f7b900b04a0 2023-09-13T06:02:29.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8cff9640 1 -- 172.21.15.130:0/1890824997 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7b800b3040 con 0x7f7b900b04a0 2023-09-13T06:02:29.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.111+0000 7f7b8cff9640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b7c065b20 0x7f7b7c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8cff9640 1 -- 172.21.15.130:0/1890824997 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b8011ce50 con 0x7f7b900b04a0 2023-09-13T06:02:29.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b7c065b20 0x7f7b7c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 Processor -- start 2023-09-13T06:02:29.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 -- start start 2023-09-13T06:02:29.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b7c065b20 0x7f7b7c067fe0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7b900cc860 tx=0x7f7b84007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:29.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c24758c550 0x55c24758c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c247570d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c2475712b0 0x55c247571690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24740a1e0 con 0x55c24758ce70 2023-09-13T06:02:29.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2473994c0 con 0x55c2475712b0 2023-09-13T06:02:29.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2473969f0 con 0x55c24758c550 2023-09-13T06:02:29.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c247570d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c247570d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46432/0 (socket says 172.21.15.130:46432) 2023-09-13T06:02:29.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8f7fe640 1 -- 172.21.15.130:0/1620749185 learned_addr learned my addr 172.21.15.130:0/1620749185 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:29.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/1620749185 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c24758c550 0x55c24758c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b94a75640 1 --2- 172.21.15.130:0/1620749185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c2475712b0 0x55c247571690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8f7fe640 1 -- 172.21.15.130:0/1620749185 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c24758c550 msgr2=0x55c24758c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:29.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/1620749185 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c24758c550 0x55c24758c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8f7fe640 1 -- 172.21.15.130:0/1620749185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c2475712b0 msgr2=0x55c247571690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:29.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/1620749185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c2475712b0 0x55c247571690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8f7fe640 1 -- 172.21.15.130:0/1620749185 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c24708c890 con 0x55c24758ce70 2023-09-13T06:02:29.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/1620749185 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c247570d70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7b84007fd0 tx=0x7f7b84012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0593b1de33861f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:29.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b75ffb640 1 -- 172.21.15.130:0/1620749185 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84005860 con 0x55c24758ce70 2023-09-13T06:02:29.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b75ffb640 1 -- 172.21.15.130:0/1620749185 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b840059c0 con 0x55c24758ce70 2023-09-13T06:02:29.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b75ffb640 1 -- 172.21.15.130:0/1620749185 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84005d30 con 0x55c24758ce70 2023-09-13T06:02:29.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 -- 172.21.15.130:0/1620749185 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 msgr2=0x55c247570d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 --2- 172.21.15.130:0/1620749185 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c247570d70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7b84007fd0 tx=0x7f7b84012000 comp rx=0 tx=0).stop 2023-09-13T06:02:29.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 -- 172.21.15.130:0/1620749185 shutdown_connections 2023-09-13T06:02:29.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 --2- 172.21.15.130:0/1620749185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c2475712b0 0x55c247571690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 --2- 172.21.15.130:0/1620749185 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c247570d70 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 --2- 172.21.15.130:0/1620749185 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c24758c550 0x55c24758c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 -- 172.21.15.130:0/1620749185 >> 172.21.15.130:0/1620749185 conn(0x55c247539c40 msgr2=0x55c247548c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:29.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 -- 172.21.15.130:0/1620749185 shutdown_connections 2023-09-13T06:02:29.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.115+0000 7f7b99855000 1 -- 172.21.15.130:0/1620749185 wait complete. 2023-09-13T06:02:29.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 -- start start 2023-09-13T06:02:29.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 Processor -- start 2023-09-13T06:02:29.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c2475712b0 0x55c247570d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758c550 0x55c247546100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c24758ce70 0x55c247546640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2473922e0 con 0x55c24758c550 2023-09-13T06:02:29.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24734cfe0 con 0x55c24758ce70 2023-09-13T06:02:29.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c24734cc80 con 0x55c2475712b0 2023-09-13T06:02:29.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 10 client.0 _ll_register_callbacks cb 0x55c24752e260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:02:29.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758c550 0x55c247546100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8ffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c2475712b0 0x55c247570d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758c550 0x55c247546100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46436/0 (socket says 172.21.15.130:46436) 2023-09-13T06:02:29.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8f7fe640 1 -- 172.21.15.130:0/1230957582 learned_addr learned my addr 172.21.15.130:0/1230957582 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:29.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b94a75640 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c24758ce70 0x55c247546640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8ffff640 1 -- 172.21.15.130:0/1230957582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c24758ce70 msgr2=0x55c247546640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:29.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c24758ce70 0x55c247546640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8ffff640 1 -- 172.21.15.130:0/1230957582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758c550 msgr2=0x55c247546100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:29.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758c550 0x55c247546100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8ffff640 1 -- 172.21.15.130:0/1230957582 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b900cec60 con 0x55c2475712b0 2023-09-13T06:02:29.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758c550 0x55c247546100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:29.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c2475712b0 0x55c247570d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b8011b370 tx=0x7f7b800ee5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55178532a1f6b5fa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:29.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b6effd640 10 client.0 ms_handle_connect on v2:172.21.15.164:3301/0 2023-09-13T06:02:29.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b6effd640 1 -- 172.21.15.130:0/1230957582 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80105070 con 0x55c2475712b0 2023-09-13T06:02:29.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 -- 172.21.15.130:0/1230957582 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c247329a50 con 0x55c2475712b0 2023-09-13T06:02:29.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b6effd640 1 -- 172.21.15.130:0/1230957582 <== mon.2 v2:172.21.15.164:3301/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b800f61a0 con 0x55c2475712b0 2023-09-13T06:02:29.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b6effd640 1 -- 172.21.15.130:0/1230957582 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b800f40b0 con 0x55c2475712b0 2023-09-13T06:02:29.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 10 client.4892 fetch_fsmap learned FSMap version 16 2023-09-13T06:02:29.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 -- 172.21.15.130:0/1230957582 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c247355210 con 0x55c2475712b0 2023-09-13T06:02:29.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b6effd640 1 -- 172.21.15.130:0/1230957582 <== mon.2 v2:172.21.15.164:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b80109080 con 0x55c2475712b0 2023-09-13T06:02:29.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b6effd640 1 -- 172.21.15.130:0/1230957582 <== mon.2 v2:172.21.15.164:3301/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7b800c6020 con 0x55c2475712b0 2023-09-13T06:02:29.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 10 client.4892 fetch_fsmap finished waiting for FSMap version 16 2023-09-13T06:02:29.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 10 client.4892 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T06:02:29.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 20 client.4892 populate_metadata read hostname 'smithi130' 2023-09-13T06:02:29.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.130:6836/1879815978,v1:172.21.15.130:6837/1879815978] conn(0x55c2475473b0 0x55c24759e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 4 client.4892 mds_command: new command op to 5106 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T06:02:29.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b99855000 1 -- 172.21.15.130:0/1230957582 --> [v2:172.21.15.130:6836/1879815978,v1:172.21.15.130:6837/1879815978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c247349820 con 0x55c2475473b0 2023-09-13T06:02:29.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.119+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.130:6836/1879815978,v1:172.21.15.130:6837/1879815978] conn(0x55c2475473b0 0x55c24759e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.130:6836/1879815978,v1:172.21.15.130:6837/1879815978] conn(0x55c2475473b0 0x55c24759e600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=704ade7b457f3da1 server_cookie=ee06068b631b0d1d in_seq=0 out_seq=0 2023-09-13T06:02:29.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b6effd640 10 client.4892 ms_handle_connect on v2:172.21.15.130:6836/1879815978 2023-09-13T06:02:29.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b6effd640 1 -- 172.21.15.130:0/1230957582 <== mds.0 v2:172.21.15.130:6836/1879815978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c247349820 con 0x55c2475473b0 2023-09-13T06:02:29.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b6effd640 10 client.4892 handle_command_reply: tid=0 2023-09-13T06:02:29.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 1 client.4892 shutdown 2023-09-13T06:02:29.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 1 -- 172.21.15.130:0/1230957582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c2475712b0 msgr2=0x55c247570d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c2475712b0 0x55c247570d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b8011b370 tx=0x7f7b800ee5c0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 1 -- 172.21.15.130:0/1230957582 shutdown_connections 2023-09-13T06:02:29.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.130:6836/1879815978,v1:172.21.15.130:6837/1879815978] conn(0x55c2475473b0 0x55c24759e600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c24758ce70 0x55c247546640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758c550 0x55c247546100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b6effd640 0 client.4892 ms_handle_reset on v2:172.21.15.130:6836/1879815978 2023-09-13T06:02:29.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 1 --2- 172.21.15.130:0/1230957582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c2475712b0 0x55c247570d40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 1 -- 172.21.15.130:0/1230957582 >> 172.21.15.130:0/1230957582 conn(0x55c247539c40 msgr2=0x55c247572130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:29.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 1 -- 172.21.15.130:0/1230957582 shutdown_connections 2023-09-13T06:02:29.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 1 -- 172.21.15.130:0/1230957582 wait complete. 2023-09-13T06:02:29.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.123+0000 7f7b99855000 20 client.4892 trim_cache size 0 max 16384 2023-09-13T06:02:29.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 Processor -- start 2023-09-13T06:02:29.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 -- start start 2023-09-13T06:02:29.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c2475712b0 0x55c247546210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c24758c550 0x55c2475450b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c2475455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24704d940 con 0x55c24758ce70 2023-09-13T06:02:29.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24738faf0 con 0x55c24758c550 2023-09-13T06:02:29.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2473d3f90 con 0x55c2475712b0 2023-09-13T06:02:29.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b94a75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c2475455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b94a75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c2475455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46446/0 (socket says 172.21.15.130:46446) 2023-09-13T06:02:29.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b94a75640 1 -- 172.21.15.130:0/1288326362 learned_addr learned my addr 172.21.15.130:0/1288326362 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:29.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/1288326362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c24758c550 0x55c2475450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/1288326362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c2475712b0 0x55c247546210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b94a75640 1 -- 172.21.15.130:0/1288326362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c2475712b0 msgr2=0x55c247546210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:29.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b94a75640 1 --2- 172.21.15.130:0/1288326362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c2475712b0 0x55c247546210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b94a75640 1 -- 172.21.15.130:0/1288326362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c24758c550 msgr2=0x55c2475450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:29.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b94a75640 1 --2- 172.21.15.130:0/1288326362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c24758c550 0x55c2475450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b94a75640 1 -- 172.21.15.130:0/1288326362 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c24733b4a0 con 0x55c24758ce70 2023-09-13T06:02:29.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/1288326362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c24758c550 0x55c2475450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:29.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b94a75640 1 --2- 172.21.15.130:0/1288326362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c2475455f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7b88001e50 tx=0x7f7b88015780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e5120e5676036c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:29.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b767fc640 1 -- 172.21.15.130:0/1288326362 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88003980 con 0x55c24758ce70 2023-09-13T06:02:29.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b767fc640 1 -- 172.21.15.130:0/1288326362 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88003ae0 con 0x55c24758ce70 2023-09-13T06:02:29.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b767fc640 1 -- 172.21.15.130:0/1288326362 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88003e90 con 0x55c24758ce70 2023-09-13T06:02:29.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 -- 172.21.15.130:0/1288326362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 msgr2=0x55c2475455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 --2- 172.21.15.130:0/1288326362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c2475455f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7b88001e50 tx=0x7f7b88015780 comp rx=0 tx=0).stop 2023-09-13T06:02:29.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 -- 172.21.15.130:0/1288326362 shutdown_connections 2023-09-13T06:02:29.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 --2- 172.21.15.130:0/1288326362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c24758c550 0x55c2475450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 --2- 172.21.15.130:0/1288326362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c2475455f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 --2- 172.21.15.130:0/1288326362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c2475712b0 0x55c247546210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 -- 172.21.15.130:0/1288326362 >> 172.21.15.130:0/1288326362 conn(0x55c247539c40 msgr2=0x55c2475992b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:29.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 -- 172.21.15.130:0/1288326362 shutdown_connections 2023-09-13T06:02:29.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 -- 172.21.15.130:0/1288326362 wait complete. 2023-09-13T06:02:29.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.139+0000 7f7b99855000 1 -- start start 2023-09-13T06:02:29.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 Processor -- start 2023-09-13T06:02:29.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c2475712b0 0x55c2475eace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c24758c550 0x55c2475eb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c24759e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2475a2f90 con 0x55c24758ce70 2023-09-13T06:02:29.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24738f6e0 con 0x55c2475712b0 2023-09-13T06:02:29.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c24734cc80 con 0x55c24758c550 2023-09-13T06:02:29.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 10 client.0 _ll_register_callbacks cb 0x55c247348ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:02:29.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b94a75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c24759e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b94a75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c24759e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46448/0 (socket says 172.21.15.130:46448) 2023-09-13T06:02:29.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b94a75640 1 -- 172.21.15.130:0/3656038929 learned_addr learned my addr 172.21.15.130:0/3656038929 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:29.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b8f7fe640 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c24758c550 0x55c2475eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b8ffff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c2475712b0 0x55c2475eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b94a75640 1 -- 172.21.15.130:0/3656038929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c24758c550 msgr2=0x55c2475eb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:29.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b94a75640 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c24758c550 0x55c2475eb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b94a75640 1 -- 172.21.15.130:0/3656038929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c2475712b0 msgr2=0x55c2475eace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:29.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b94a75640 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c2475712b0 0x55c2475eace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b94a75640 1 -- 172.21.15.130:0/3656038929 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c24708c890 con 0x55c24758ce70 2023-09-13T06:02:29.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b94a75640 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c24759e910 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7b88001340 tx=0x7f7b88001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c1ed163e631b00 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:29.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b6effd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:02:29.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b6effd640 1 -- 172.21.15.130:0/3656038929 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88026070 con 0x55c24758ce70 2023-09-13T06:02:29.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 -- 172.21.15.130:0/3656038929 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c24734d900 con 0x55c24758ce70 2023-09-13T06:02:29.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b6effd640 1 -- 172.21.15.130:0/3656038929 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b88006b60 con 0x55c24758ce70 2023-09-13T06:02:29.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b6effd640 1 -- 172.21.15.130:0/3656038929 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b88006d80 con 0x55c24758ce70 2023-09-13T06:02:29.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 10 client.5316 fetch_fsmap learned FSMap version 16 2023-09-13T06:02:29.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 -- 172.21.15.130:0/3656038929 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7f7b78003530 con 0x55c24758ce70 2023-09-13T06:02:29.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b6effd640 1 -- 172.21.15.130:0/3656038929 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c24734d900 con 0x55c24758ce70 2023-09-13T06:02:29.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b6effd640 1 -- 172.21.15.130:0/3656038929 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7b88012050 con 0x55c24758ce70 2023-09-13T06:02:29.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 10 client.5316 fetch_fsmap finished waiting for FSMap version 16 2023-09-13T06:02:29.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 10 client.5316 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T06:02:29.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 20 client.5316 populate_metadata read hostname 'smithi130' 2023-09-13T06:02:29.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.130:6836/1879815978,v1:172.21.15.130:6837/1879815978] conn(0x55c2475f1bb0 0x55c2475f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 4 client.5316 mds_command: new command op to 5106 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T06:02:29.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 -- 172.21.15.130:0/3656038929 --> [v2:172.21.15.130:6836/1879815978,v1:172.21.15.130:6837/1879815978] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c24738b2c0 con 0x55c2475f1bb0 2023-09-13T06:02:29.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.130:6836/1879815978,v1:172.21.15.130:6837/1879815978] conn(0x55c2475f1bb0 0x55c2475f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b8ffff640 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.130:6836/1879815978,v1:172.21.15.130:6837/1879815978] conn(0x55c2475f1bb0 0x55c2475f3fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=243f77cdf4a7b407 server_cookie=95060fdb2de04c5b in_seq=0 out_seq=0 2023-09-13T06:02:29.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b6effd640 10 client.5316 ms_handle_connect on v2:172.21.15.130:6836/1879815978 2023-09-13T06:02:29.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b6effd640 1 -- 172.21.15.130:0/3656038929 <== mds.0 v2:172.21.15.130:6836/1879815978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55c24738b2c0 con 0x55c2475f1bb0 2023-09-13T06:02:29.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b6effd640 10 client.5316 handle_command_reply: tid=0 2023-09-13T06:02:29.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.143+0000 7f7b99855000 1 client.5316 shutdown 2023-09-13T06:02:29.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b99855000 1 -- 172.21.15.130:0/3656038929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 msgr2=0x55c24759e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b99855000 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c24759e910 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7b88001340 tx=0x7f7b88001260 comp rx=0 tx=0).stop 2023-09-13T06:02:29.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b99855000 1 -- 172.21.15.130:0/3656038929 shutdown_connections 2023-09-13T06:02:29.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b99855000 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.130:6836/1879815978,v1:172.21.15.130:6837/1879815978] conn(0x55c2475f1bb0 0x55c2475f3fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b99855000 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c24758ce70 0x55c24759e910 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b99855000 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55c24758c550 0x55c2475eb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b99855000 1 --2- 172.21.15.130:0/3656038929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c2475712b0 0x55c2475eace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b6effd640 0 client.5316 ms_handle_reset on v2:172.21.15.130:6836/1879815978 2023-09-13T06:02:29.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b99855000 1 -- 172.21.15.130:0/3656038929 >> 172.21.15.130:0/3656038929 conn(0x55c247539c40 msgr2=0x55c2475992b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:29.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b99855000 1 -- 172.21.15.130:0/3656038929 shutdown_connections 2023-09-13T06:02:29.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b99855000 1 -- 172.21.15.130:0/3656038929 wait complete. 2023-09-13T06:02:29.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b99855000 20 client.5316 trim_cache size 0 max 16384 2023-09-13T06:02:29.168 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:02:29.168 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:02:29.168 INFO:teuthology.orchestra.run.smithi130.stdout: "whoami": 0, 2023-09-13T06:02:29.168 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 5106, 2023-09-13T06:02:29.168 INFO:teuthology.orchestra.run.smithi130.stdout: "want_state": "up:active", 2023-09-13T06:02:29.169 INFO:teuthology.orchestra.run.smithi130.stdout: "state": "up:active", 2023-09-13T06:02:29.169 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs", 2023-09-13T06:02:29.169 INFO:teuthology.orchestra.run.smithi130.stdout: "rank_uptime": 10.380108601, 2023-09-13T06:02:29.169 INFO:teuthology.orchestra.run.smithi130.stdout: "mdsmap_epoch": 16, 2023-09-13T06:02:29.169 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch": 32, 2023-09-13T06:02:29.169 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch_barrier": 32, 2023-09-13T06:02:29.170 INFO:teuthology.orchestra.run.smithi130.stdout: "uptime": 18.240948643999999 2023-09-13T06:02:29.170 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:02:29.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 -- 172.21.15.130:0/1890824997 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b7c065b20 msgr2=0x7f7b7c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b7c065b20 0x7f7b7c067fe0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7b900cc860 tx=0x7f7b84007d40 comp rx=0 tx=0).stop 2023-09-13T06:02:29.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 -- 172.21.15.130:0/1890824997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b900b04a0 msgr2=0x7f7b90158620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b900b04a0 0x7f7b90158620 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7b800190d0 tx=0x7f7b80019260 comp rx=0 tx=0).stop 2023-09-13T06:02:29.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 -- 172.21.15.130:0/1890824997 shutdown_connections 2023-09-13T06:02:29.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b7c065b20 0x7f7b7c067fe0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b900ce180 0x7f7b90155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b9015b130 0x7f7b90151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 --2- 172.21.15.130:0/1890824997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b900b04a0 0x7f7b90158620 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 -- 172.21.15.130:0/1890824997 >> 172.21.15.130:0/1890824997 conn(0x7f7b90065990 msgr2=0x7f7b900ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:29.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 -- 172.21.15.130:0/1890824997 shutdown_connections 2023-09-13T06:02:29.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.147+0000 7f7b964d8640 1 -- 172.21.15.130:0/1890824997 wait complete. 2023-09-13T06:02:29.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:02:29.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.307+0000 7fb7d3248640 1 Processor -- start 2023-09-13T06:02:29.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.307+0000 7fb7d3248640 1 -- start start 2023-09-13T06:02:29.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d3248640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb7cc0d1750 0x7fb7cc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d3248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc0d1090 0x7fb7cc146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d3248640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb7cc0d1b30 0x7fb7cc146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d3248640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc15dea0 con 0x7fb7cc0d1750 2023-09-13T06:02:29.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d3248640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc0b63c0 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d3248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0d0c20 con 0x7fb7cc0d1090 2023-09-13T06:02:29.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d0fe4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb7cc0d1750 0x7fb7cc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d0fe4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb7cc0d1750 0x7fb7cc15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46464/0 (socket says 172.21.15.130:46464) 2023-09-13T06:02:29.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d0fe4640 1 -- 172.21.15.130:0/2295602378 learned_addr learned my addr 172.21.15.130:0/2295602378 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:29.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d17e5640 1 --2- 172.21.15.130:0/2295602378 >> v2:172.21.15.164:3300/0 conn(0x7fb7cc0d1b30 0x7fb7cc146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7cbfff640 1 --2- 172.21.15.130:0/2295602378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc0d1090 0x7fb7cc146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d0fe4640 1 -- 172.21.15.130:0/2295602378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc0d1090 msgr2=0x7fb7cc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:29.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d0fe4640 1 --2- 172.21.15.130:0/2295602378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc0d1090 0x7fb7cc146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d0fe4640 1 -- 172.21.15.130:0/2295602378 >> v2:172.21.15.164:3300/0 conn(0x7fb7cc0d1b30 msgr2=0x7fb7cc146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:29.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d0fe4640 1 --2- 172.21.15.130:0/2295602378 >> v2:172.21.15.164:3300/0 conn(0x7fb7cc0d1b30 0x7fb7cc146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.311+0000 7fb7d0fe4640 1 -- 172.21.15.130:0/2295602378 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc0b6610 con 0x7fb7cc0d1750 2023-09-13T06:02:29.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d0fe4640 1 --2- 172.21.15.130:0/2295602378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc0d1750 0x7fb7cc15d960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc08ba90 tx=0x7fb7c001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd5b88a9139ef45 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:29.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7cb7fe640 1 -- 172.21.15.130:0/2295602378 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c00a5820 con 0x7fb7cc0d1750 2023-09-13T06:02:29.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7cb7fe640 1 -- 172.21.15.130:0/2295602378 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c00a5980 con 0x7fb7cc0d1750 2023-09-13T06:02:29.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7cb7fe640 1 -- 172.21.15.130:0/2295602378 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c00a5d10 con 0x7fb7cc0d1750 2023-09-13T06:02:29.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d3248640 1 -- 172.21.15.130:0/2295602378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc0d1750 msgr2=0x7fb7cc15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d3248640 1 --2- 172.21.15.130:0/2295602378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc0d1750 0x7fb7cc15d960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc08ba90 tx=0x7fb7c001c9a0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d3248640 1 -- 172.21.15.130:0/2295602378 shutdown_connections 2023-09-13T06:02:29.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d3248640 1 --2- 172.21.15.130:0/2295602378 >> v2:172.21.15.164:3300/0 conn(0x7fb7cc0d1b30 0x7fb7cc146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d3248640 1 --2- 172.21.15.130:0/2295602378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc0d1090 0x7fb7cc146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d3248640 1 --2- 172.21.15.130:0/2295602378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc0d1750 0x7fb7cc15d960 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d3248640 1 -- 172.21.15.130:0/2295602378 >> 172.21.15.130:0/2295602378 conn(0x7fb7cc06f170 msgr2=0x7fb7cc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:29.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d3248640 1 -- 172.21.15.130:0/2295602378 shutdown_connections 2023-09-13T06:02:29.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d3248640 1 -- 172.21.15.130:0/2295602378 wait complete. 2023-09-13T06:02:29.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d3248640 1 Processor -- start 2023-09-13T06:02:29.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.315+0000 7fb7d3248640 1 -- start start 2023-09-13T06:02:29.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d3248640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7cc0d1090 0x7fb7cc13ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d3248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc0d1750 0x7fb7cc162470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d3248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc0d1b30 0x7fb7cc15c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d3248640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc140050 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d3248640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc13f440 con 0x7fb7cc0d1090 2023-09-13T06:02:29.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d3248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc13f720 con 0x7fb7cc0d1750 2023-09-13T06:02:29.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d17e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc0d1b30 0x7fb7cc15c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d17e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc0d1b30 0x7fb7cc15c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46468/0 (socket says 172.21.15.130:46468) 2023-09-13T06:02:29.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d17e5640 1 -- 172.21.15.130:0/4137648071 learned_addr learned my addr 172.21.15.130:0/4137648071 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:29.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d0fe4640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7cc0d1090 0x7fb7cc13ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7cbfff640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc0d1750 0x7fb7cc162470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d17e5640 1 -- 172.21.15.130:0/4137648071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc0d1750 msgr2=0x7fb7cc162470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d17e5640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc0d1750 0x7fb7cc162470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d17e5640 1 -- 172.21.15.130:0/4137648071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7cc0d1090 msgr2=0x7fb7cc13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d17e5640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7cc0d1090 0x7fb7cc13ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d17e5640 1 -- 172.21.15.130:0/4137648071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c0009b30 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d17e5640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc0d1b30 0x7fb7cc15c2a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400d560 tx=0x7fb7c400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:29.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7c97fa640 1 -- 172.21.15.130:0/4137648071 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c40125f0 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7c97fa640 1 -- 172.21.15.130:0/4137648071 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c4012770 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7c97fa640 1 -- 172.21.15.130:0/4137648071 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4012b20 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d3248640 1 -- 172.21.15.130:0/4137648071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc13fa00 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d3248640 1 -- 172.21.15.130:0/4137648071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc1629b0 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.319+0000 7fb7d3248640 1 -- 172.21.15.130:0/4137648071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7cc0618a0 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.323+0000 7fb7c97fa640 1 -- 172.21.15.130:0/4137648071 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb7c4012c80 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.323+0000 7fb7c97fa640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 0x7fb7b0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:29.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.323+0000 7fb7c97fa640 1 -- 172.21.15.130:0/4137648071 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7c40835e0 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.323+0000 7fb7d0fe4640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 0x7fb7b0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:29.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.323+0000 7fb7d0fe4640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 0x7fb7b0067fe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00ae000 tx=0x7fb7c00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:29.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.327+0000 7fb7c97fa640 1 -- 172.21.15.130:0/4137648071 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb7c4051070 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.507+0000 7fb7d3248640 1 -- 172.21.15.130:0/4137648071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb7cc140190 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.507+0000 7fb7c97fa640 1 -- 172.21.15.130:0/4137648071 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb7c4054690 con 0x7fb7cc0d1b30 2023-09-13T06:02:29.513 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:02:29.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 -- 172.21.15.130:0/4137648071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 msgr2=0x7fb7b0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 0x7fb7b0067fe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00ae000 tx=0x7fb7c00a7070 comp rx=0 tx=0).stop 2023-09-13T06:02:29.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 -- 172.21.15.130:0/4137648071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc0d1b30 msgr2=0x7fb7cc15c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:29.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc0d1b30 0x7fb7cc15c2a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400d560 tx=0x7fb7c400da20 comp rx=0 tx=0).stop 2023-09-13T06:02:29.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 -- 172.21.15.130:0/4137648071 shutdown_connections 2023-09-13T06:02:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 0x7fb7b0067fe0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc0d1b30 0x7fb7cc15c2a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc0d1750 0x7fb7cc162470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 --2- 172.21.15.130:0/4137648071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7cc0d1090 0x7fb7cc13ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 -- 172.21.15.130:0/4137648071 >> 172.21.15.130:0/4137648071 conn(0x7fb7cc06f170 msgr2=0x7fb7cc15cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:29.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 -- 172.21.15.130:0/4137648071 shutdown_connections 2023-09-13T06:02:29.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:29.511+0000 7fb7d3248640 1 -- 172.21.15.130:0/4137648071 wait complete. 2023-09-13T06:02:29.534 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:02:29.535 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:02:29.535 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:02:29.535 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T06:02:29.536 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:02:29.536 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:02:29.536 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:02:29.537 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:02:29.537 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:02:29.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:29.538 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:02:29.549 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:02:29.549 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:02:29.549 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:02:29.549 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:29.550 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:02:29.550 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:29.550 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:02:29.551 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:29.551 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:02:29.551 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:02:29.551 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:29.552 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:02:29.552 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:02:29.553 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:29.553 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:02:29.553 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:29.553 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:02:29.553 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42358sec preferred_lft 42358sec 2023-09-13T06:02:29.554 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:02:29.554 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:29.554 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:02:29.554 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:29.554 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:02:29.555 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:29.555 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:02:29.555 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:29.555 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:02:29.555 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:29.556 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:02:29.556 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:29.556 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:02:29.556 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:02:29.556 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:02:29.556 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:29.557 INFO:teuthology.orchestra.run.smithi130.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:02:29.557 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:02:29.557 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:02:29.557 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:29.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:29.558 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:02:29.608 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:02:29.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:29.611 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:02:29.665 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:02:29.665 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:02:29.666 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:02:29.666 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:02:29.666 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:02:29.667 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:02:29.667 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:02:29.667 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:02:29.668 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:02:29.668 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:02:29.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:29.669 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:02:29.670 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:02:29.670 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:02:29.671 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:02:29.671 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:02:29.672 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:02:29.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:29.758 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:02:29.767 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T06:02:29.768 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:02:29.768 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:02:29.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:29.769 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-09-13T06:02:29.830 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:02:29.831 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T06:02:29.886 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:02:29.886 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:02:29.887 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:02:29.941 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:02:29.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:29.942 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:02:30.040 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:02:30.040 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:02:30.041 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:02:30.055 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:02:30.056 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:02:30.056 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:02:30.056 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:02:30.056 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:02:30.063 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:02:30.064 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:02:30.064 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:02:30.064 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:02:30.064 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:02:30.064 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:02:30.065 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:02:30.065 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:02:30.066 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:02:30.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:30.067 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:02:30.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:30.089 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:02:30.145 INFO:teuthology.orchestra.run.smithi130.stdout:client5325 2023-09-13T06:02:30.146 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:02:30.147 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:30.202 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:02:30.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.383+0000 7fefc5574640 1 Processor -- start 2023-09-13T06:02:30.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.383+0000 7fefc5574640 1 -- start start 2023-09-13T06:02:30.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.383+0000 7fefc5574640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fefc00d1090 0x7fefc015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:30.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.383+0000 7fefc5574640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fefc0146f30 0x7fefc00b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:30.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.383+0000 7fefc5574640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc00b63c0 con 0x7fefc00d1750 2023-09-13T06:02:30.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.383+0000 7fefc5574640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc015dea0 con 0x7fefc0146f30 2023-09-13T06:02:30.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.383+0000 7fefc5574640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc00d0c20 con 0x7fefc00d1090 2023-09-13T06:02:30.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefbeffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fefc00d1750 0x7fefc0146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54574/0 (socket says 172.21.15.130:54574) 2023-09-13T06:02:30.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefbeffd640 1 -- 172.21.15.130:0/295611631 learned_addr learned my addr 172.21.15.130:0/295611631 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:30.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefbf7fe640 1 --2- 172.21.15.130:0/295611631 >> v2:172.21.15.164:3300/0 conn(0x7fefc0146f30 0x7fefc00b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:30.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefb7fff640 1 --2- 172.21.15.130:0/295611631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fefc00d1090 0x7fefc015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:30.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefbe7fc640 1 -- 172.21.15.130:0/295611631 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589152326 0 0) 0x7fefc00b63c0 con 0x7fefc00d1750 2023-09-13T06:02:30.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefbe7fc640 1 -- 172.21.15.130:0/295611631 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefac003530 con 0x7fefc00d1750 2023-09-13T06:02:30.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefbe7fc640 1 -- 172.21.15.130:0/295611631 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4077721970 0 0) 0x7fefac003530 con 0x7fefc00d1750 2023-09-13T06:02:30.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefbf7fe640 1 -- 172.21.15.130:0/295611631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fefc00d1090 msgr2=0x7fefc015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:30.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefbf7fe640 1 --2- 172.21.15.130:0/295611631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fefc00d1090 0x7fefc015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:30.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefbf7fe640 1 -- 172.21.15.130:0/295611631 >> v1:172.21.15.130:6789/0 conn(0x7fefc00d1750 legacy=0x7fefc0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:30.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefbf7fe640 1 -- 172.21.15.130:0/295611631 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc00b6610 con 0x7fefc0146f30 2023-09-13T06:02:30.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.387+0000 7fefbf7fe640 1 --2- 172.21.15.130:0/295611631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefc0146f30 0x7fefc00b70f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009d90 tx=0x7fefb801c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c8f1e667deea2ab server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:30.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefbe7fc640 1 -- 172.21.15.130:0/295611631 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0001680 con 0x7fefc0146f30 2023-09-13T06:02:30.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefbe7fc640 1 -- 172.21.15.130:0/295611631 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb80a5640 con 0x7fefc0146f30 2023-09-13T06:02:30.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefbe7fc640 1 -- 172.21.15.130:0/295611631 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80a59d0 con 0x7fefc0146f30 2023-09-13T06:02:30.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 -- 172.21.15.130:0/295611631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefc0146f30 msgr2=0x7fefc00b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:30.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 --2- 172.21.15.130:0/295611631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefc0146f30 0x7fefc00b70f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009d90 tx=0x7fefb801c840 comp rx=0 tx=0).stop 2023-09-13T06:02:30.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 -- 172.21.15.130:0/295611631 shutdown_connections 2023-09-13T06:02:30.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 --2- 172.21.15.130:0/295611631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefc0146f30 0x7fefc00b70f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:30.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 --2- 172.21.15.130:0/295611631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fefc00d1090 0x7fefc015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:30.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 -- 172.21.15.130:0/295611631 >> 172.21.15.130:0/295611631 conn(0x7fefc006f170 msgr2=0x7fefc006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:30.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 -- 172.21.15.130:0/295611631 shutdown_connections 2023-09-13T06:02:30.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 -- 172.21.15.130:0/295611631 wait complete. 2023-09-13T06:02:30.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 Processor -- start 2023-09-13T06:02:30.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 -- start start 2023-09-13T06:02:30.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefc00d1090 0x7fefc013e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:30.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefc00d1750 0x7fefc01566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:30.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fefc0146f30 0x7fefc015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:30.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc01459a0 con 0x7fefc00d1750 2023-09-13T06:02:30.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc013eb00 con 0x7fefc00d1090 2023-09-13T06:02:30.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.391+0000 7fefc5574640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc0156220 con 0x7fefc0146f30 2023-09-13T06:02:30.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefc00d1750 0x7fefc01566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:30.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefc00d1750 0x7fefc01566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:46472/0 (socket says 172.21.15.130:46472) 2023-09-13T06:02:30.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb7fff640 1 -- 172.21.15.130:0/4001803748 learned_addr learned my addr 172.21.15.130:0/4001803748 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:30.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefbeffd640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefc00d1090 0x7fefc013e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:30.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefbf7fe640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fefc0146f30 0x7fefc015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:30.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb7fff640 1 -- 172.21.15.130:0/4001803748 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fefc0146f30 msgr2=0x7fefc015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:30.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb7fff640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fefc0146f30 0x7fefc015ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:30.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb7fff640 1 -- 172.21.15.130:0/4001803748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefc00d1090 msgr2=0x7fefc013e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:30.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb7fff640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefc00d1090 0x7fefc013e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:30.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb7fff640 1 -- 172.21.15.130:0/4001803748 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb8009a70 con 0x7fefc00d1750 2023-09-13T06:02:30.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb7fff640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefc00d1750 0x7fefc01566b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fefa800e930 tx=0x7fefa800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:30.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb77fe640 1 -- 172.21.15.130:0/4001803748 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8009690 con 0x7fefc00d1750 2023-09-13T06:02:30.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb77fe640 1 -- 172.21.15.130:0/4001803748 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa800ca00 con 0x7fefc00d1750 2023-09-13T06:02:30.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb77fe640 1 -- 172.21.15.130:0/4001803748 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa800cd70 con 0x7fefc00d1750 2023-09-13T06:02:30.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefc5574640 1 -- 172.21.15.130:0/4001803748 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc00b7e40 con 0x7fefc00d1750 2023-09-13T06:02:30.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefc5574640 1 -- 172.21.15.130:0/4001803748 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc01558f0 con 0x7fefc00d1750 2023-09-13T06:02:30.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefc5574640 1 -- 172.21.15.130:0/4001803748 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc00618a0 con 0x7fefc00d1750 2023-09-13T06:02:30.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb77fe640 1 -- 172.21.15.130:0/4001803748 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fefa8013470 con 0x7fefc00d1750 2023-09-13T06:02:30.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.395+0000 7fefb77fe640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fefa0065b20 0x7fefa0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:30.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.399+0000 7fefb77fe640 1 -- 172.21.15.130:0/4001803748 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefa8083460 con 0x7fefc00d1750 2023-09-13T06:02:30.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.399+0000 7fefbeffd640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fefa0065b20 0x7fefa0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:30.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.399+0000 7fefbeffd640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fefa0065b20 0x7fefa0067fe0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fefb0001ec0 tx=0x7fefb0001a60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:30.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.399+0000 7fefb77fe640 1 -- 172.21.15.130:0/4001803748 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fefa8050f20 con 0x7fefc00d1750 2023-09-13T06:02:30.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 -- 172.21.15.130:0/4001803748 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fefc01563b0 con 0x7fefc00d1750 2023-09-13T06:02:30.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefb77fe640 1 -- 172.21.15.130:0/4001803748 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fefa8054540 con 0x7fefc00d1750 2023-09-13T06:02:30.596 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:02:30.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 -- 172.21.15.130:0/4001803748 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fefa0065b20 msgr2=0x7fefa0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:30.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fefa0065b20 0x7fefa0067fe0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fefb0001ec0 tx=0x7fefb0001a60 comp rx=0 tx=0).stop 2023-09-13T06:02:30.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 -- 172.21.15.130:0/4001803748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefc00d1750 msgr2=0x7fefc01566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:30.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefc00d1750 0x7fefc01566b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fefa800e930 tx=0x7fefa800edf0 comp rx=0 tx=0).stop 2023-09-13T06:02:30.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 -- 172.21.15.130:0/4001803748 shutdown_connections 2023-09-13T06:02:30.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fefa0065b20 0x7fefa0067fe0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:30.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fefc0146f30 0x7fefc015ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:30.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefc00d1750 0x7fefc01566b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:30.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 --2- 172.21.15.130:0/4001803748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefc00d1090 0x7fefc013e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:30.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 -- 172.21.15.130:0/4001803748 >> 172.21.15.130:0/4001803748 conn(0x7fefc006f170 msgr2=0x7fefc00cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:30.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 -- 172.21.15.130:0/4001803748 shutdown_connections 2023-09-13T06:02:30.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:30.591+0000 7fefc5574640 1 -- 172.21.15.130:0/4001803748 wait complete. 2023-09-13T06:02:30.616 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:02:30.617 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:02:30.617 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:02:30.618 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T06:02:30.618 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:02:30.618 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:02:30.619 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:02:30.620 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:02:30.620 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:02:30.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:30.621 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:02:30.632 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:02:30.632 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:02:30.632 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:02:30.632 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:30.633 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:02:30.633 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:30.633 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:02:30.633 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:30.633 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:02:30.634 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:02:30.634 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:30.634 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:02:30.634 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:02:30.635 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:30.635 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:02:30.635 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:30.635 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:02:30.635 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42373sec preferred_lft 42373sec 2023-09-13T06:02:30.635 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:02:30.636 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:30.636 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:02:30.636 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:30.636 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:02:30.636 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:30.637 INFO:teuthology.orchestra.run.smithi164.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:02:30.637 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:02:30.637 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:02:30.637 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:30.637 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:02:30.638 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:30.638 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:02:30.638 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:02:30.638 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:02:30.638 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:30.639 INFO:teuthology.orchestra.run.smithi164.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:02:30.639 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:02:30.639 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:02:30.639 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:02:30.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:30.641 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:02:30.704 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:02:30.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:30.707 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:02:30.760 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:02:30.760 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:02:30.760 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:02:30.761 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:02:30.761 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:02:30.761 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:02:30.761 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:02:30.762 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:02:30.762 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:02:30.762 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:02:30.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:30.763 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:02:30.763 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:02:30.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:02:30.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:02:30.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:02:30.765 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:02:30.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:30.861 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:02:30.871 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-13T06:02:30.871 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:02:30.872 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:02:30.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:30.872 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-09-13T06:02:30.933 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:02:30.934 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T06:02:30.984 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:02:30.984 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:02:30.985 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:02:31.035 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:02:31.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:31.036 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:02:31.131 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:02:31.132 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:02:31.132 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:02:31.147 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:02:31.147 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:02:31.148 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:02:31.148 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:02:31.148 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:02:31.156 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:02:31.156 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:02:31.156 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:02:31.156 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:02:31.157 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:02:31.157 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:02:31.157 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:02:31.157 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:02:31.159 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:02:31.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:31.160 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:02:31.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:31.181 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:02:31.234 INFO:teuthology.orchestra.run.smithi164.stdout:client5334 2023-09-13T06:02:31.235 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:02:31.235 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:31.284 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:31.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.423+0000 7fe575103640 1 Processor -- start 2023-09-13T06:02:31.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.423+0000 7fe575103640 1 -- start start 2023-09-13T06:02:31.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.427+0000 7fe575103640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe57006ddf0 0x7fe570168090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:31.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.427+0000 7fe575103640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe570072310 con 0x7fe5700ce1a0 2023-09-13T06:02:31.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.427+0000 7fe575103640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe570070e70 con 0x7fe57015d260 2023-09-13T06:02:31.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.427+0000 7fe575103640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe570070280 con 0x7fe57006ddf0 2023-09-13T06:02:31.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.427+0000 7fe56f59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe57006ddf0 0x7fe570168090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:31.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.427+0000 7fe56f59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe57006ddf0 0x7fe570168090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42710/0 (socket says 172.21.15.130:42710) 2023-09-13T06:02:31.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.427+0000 7fe56f59e640 1 -- 172.21.15.130:0/2033696391 learned_addr learned my addr 172.21.15.130:0/2033696391 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:31.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.427+0000 7fe56659c640 1 --1- 172.21.15.130:0/2033696391 >> v1:172.21.15.130:6789/0 conn(0x7fe5700ce1a0 0x7fe57006d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37776/0 (socket says 172.21.15.130:37776) 2023-09-13T06:02:31.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.427+0000 7fe56f59e640 1 -- 172.21.15.130:0/2033696391 >> v1:172.21.15.164:6789/0 conn(0x7fe57015d260 legacy=0x7fe5700b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:31.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.427+0000 7fe56f59e640 1 -- 172.21.15.130:0/2033696391 >> v1:172.21.15.130:6789/0 conn(0x7fe5700ce1a0 legacy=0x7fe57006d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:31.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.427+0000 7fe56f59e640 1 -- 172.21.15.130:0/2033696391 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe570070540 con 0x7fe57006ddf0 2023-09-13T06:02:31.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe56f59e640 1 --2- 172.21.15.130:0/2033696391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe57006ddf0 0x7fe570168090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe568009870 tx=0x7fe56801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502e1660c2c773e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:31.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe56e59c640 1 -- 172.21.15.130:0/2033696391 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680aa670 con 0x7fe57006ddf0 2023-09-13T06:02:31.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe56e59c640 1 -- 172.21.15.130:0/2033696391 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5680aa7d0 con 0x7fe57006ddf0 2023-09-13T06:02:31.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe56e59c640 1 -- 172.21.15.130:0/2033696391 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680aab60 con 0x7fe57006ddf0 2023-09-13T06:02:31.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe575103640 1 -- 172.21.15.130:0/2033696391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe57006ddf0 msgr2=0x7fe570168090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:31.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe575103640 1 --2- 172.21.15.130:0/2033696391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe57006ddf0 0x7fe570168090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe568009870 tx=0x7fe56801c510 comp rx=0 tx=0).stop 2023-09-13T06:02:31.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe575103640 1 -- 172.21.15.130:0/2033696391 shutdown_connections 2023-09-13T06:02:31.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe575103640 1 --2- 172.21.15.130:0/2033696391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe57006ddf0 0x7fe570168090 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe575103640 1 -- 172.21.15.130:0/2033696391 >> 172.21.15.130:0/2033696391 conn(0x7fe57006a2f0 msgr2=0x7fe57006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:31.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe575103640 1 -- 172.21.15.130:0/2033696391 shutdown_connections 2023-09-13T06:02:31.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe575103640 1 -- 172.21.15.130:0/2033696391 wait complete. 2023-09-13T06:02:31.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe575103640 1 Processor -- start 2023-09-13T06:02:31.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.431+0000 7fe575103640 1 -- start start 2023-09-13T06:02:31.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe575103640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe57006ddf0 0x7fe5701480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:31.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe575103640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5700ce1a0 0x7fe5700cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:31.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe575103640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe57015d260 0x7fe57015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:31.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe575103640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700cd6f0 con 0x7fe57015d260 2023-09-13T06:02:31.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe575103640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5701485e0 con 0x7fe5700ce1a0 2023-09-13T06:02:31.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe575103640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700cca70 con 0x7fe57006ddf0 2023-09-13T06:02:31.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe56ed9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe57006ddf0 0x7fe5701480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:31.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe56f59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe57015d260 0x7fe57015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:31.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe56ed9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe57006ddf0 0x7fe5701480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:42054/0 (socket says 172.21.15.130:42054) 2023-09-13T06:02:31.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe56ed9d640 1 -- 172.21.15.130:0/1029061317 learned_addr learned my addr 172.21.15.130:0/1029061317 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:31.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe56659c640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5700ce1a0 0x7fe5700cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:31.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe56f59e640 1 -- 172.21.15.130:0/1029061317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe57006ddf0 msgr2=0x7fe5701480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:31.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe56f59e640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe57006ddf0 0x7fe5701480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe56f59e640 1 -- 172.21.15.130:0/1029061317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5700ce1a0 msgr2=0x7fe5700cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:31.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe56f59e640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5700ce1a0 0x7fe5700cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe56f59e640 1 -- 172.21.15.130:0/1029061317 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680094d0 con 0x7fe57015d260 2023-09-13T06:02:31.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe56f59e640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe57015d260 0x7fe57015ef70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe5680ab000 tx=0x7fe56801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:31.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe567fff640 1 -- 172.21.15.130:0/1029061317 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680b3800 con 0x7fe57015d260 2023-09-13T06:02:31.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe567fff640 1 -- 172.21.15.130:0/1029061317 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5680b3980 con 0x7fe57015d260 2023-09-13T06:02:31.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe567fff640 1 -- 172.21.15.130:0/1029061317 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680b3d30 con 0x7fe57015d260 2023-09-13T06:02:31.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe575103640 1 -- 172.21.15.130:0/1029061317 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5700ccd50 con 0x7fe57015d260 2023-09-13T06:02:31.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe575103640 1 -- 172.21.15.130:0/1029061317 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5700cd310 con 0x7fe57015d260 2023-09-13T06:02:31.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe575103640 1 -- 172.21.15.130:0/1029061317 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5700618a0 con 0x7fe57015d260 2023-09-13T06:02:31.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.435+0000 7fe567fff640 1 -- 172.21.15.130:0/1029061317 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe5680c73a0 con 0x7fe57015d260 2023-09-13T06:02:31.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.439+0000 7fe567fff640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe550065b20 0x7fe550067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:31.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.439+0000 7fe567fff640 1 -- 172.21.15.130:0/1029061317 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe56811ded0 con 0x7fe57015d260 2023-09-13T06:02:31.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.439+0000 7fe56ed9d640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe550065b20 0x7fe550067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:31.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.439+0000 7fe56ed9d640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe550065b20 0x7fe550067fe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe560001810 tx=0x7fe560009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:31.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.443+0000 7fe567fff640 1 -- 172.21.15.130:0/1029061317 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe5680eb960 con 0x7fe57015d260 2023-09-13T06:02:31.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.619+0000 7fe575103640 1 -- 172.21.15.130:0/1029061317 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5700cdc00 con 0x7fe57015d260 2023-09-13T06:02:31.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.619+0000 7fe567fff640 1 -- 172.21.15.130:0/1029061317 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fe5680eef80 con 0x7fe57015d260 2023-09-13T06:02:31.626 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:31.626 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3600813785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3600813785},{"type":"v1","addr":"172.21.15.164:6834","nonce":3600813785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3946401321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3946401321},{"type":"v1","addr":"172.21.15.164:6835","nonce":3946401321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5097,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/746143804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":746143804},{"type":"v1","addr":"172.21.15.130:6835","nonce":746143804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:18.135350+0000","modified":"2023-09-13T06:02:21.179925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1879815978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1879815978},{"type":"v1","addr":"172.21.15.130:6837","nonce":1879815978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-13T06:02:31.627 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 16 2023-09-13T06:02:31.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 -- 172.21.15.130:0/1029061317 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe550065b20 msgr2=0x7fe550067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:31.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe550065b20 0x7fe550067fe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe560001810 tx=0x7fe560009040 comp rx=0 tx=0).stop 2023-09-13T06:02:31.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 -- 172.21.15.130:0/1029061317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe57015d260 msgr2=0x7fe57015ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:31.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe57015d260 0x7fe57015ef70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe5680ab000 tx=0x7fe56801ad50 comp rx=0 tx=0).stop 2023-09-13T06:02:31.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 -- 172.21.15.130:0/1029061317 shutdown_connections 2023-09-13T06:02:31.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe550065b20 0x7fe550067fe0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5700ce1a0 0x7fe5700cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe57015d260 0x7fe57015ef70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 --2- 172.21.15.130:0/1029061317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe57006ddf0 0x7fe5701480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 -- 172.21.15.130:0/1029061317 >> 172.21.15.130:0/1029061317 conn(0x7fe57006a2f0 msgr2=0x7fe570155620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:31.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 -- 172.21.15.130:0/1029061317 shutdown_connections 2023-09-13T06:02:31.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.623+0000 7fe575103640 1 -- 172.21.15.130:0/1029061317 wait complete. 2023-09-13T06:02:31.646 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-09-13T06:02:31.802 INFO:teuthology.orchestra.run.smithi130.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":5106,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.017425528,"mdsmap_epoch":16,"osdmap_epoch":32,"osdmap_epoch_barrier":32,"uptime":20.878264673} 2023-09-13T06:02:31.803 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 5106, "mdsmap_epoch": 16, "osdmap_epoch": 32, "osdmap_epoch_barrier": 32, "rank_uptime": 13.017425528, "state": "up:active", "uptime": 20.878264673, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:02:31.803 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-09-13T06:02:31.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.935+0000 7fd2dc648640 1 Processor -- start 2023-09-13T06:02:31.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.935+0000 7fd2dc648640 1 -- start start 2023-09-13T06:02:31.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.935+0000 7fd2dc648640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd2d4159f20 0x7fd2d40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:31.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.935+0000 7fd2dc648640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd2d40b1d20 0x7fd2d40b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:31.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.935+0000 7fd2dc648640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d40ccfd0 con 0x7fd2d40cdfc0 2023-09-13T06:02:31.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.935+0000 7fd2dc648640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d40b00f0 con 0x7fd2d4159f20 2023-09-13T06:02:31.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.935+0000 7fd2dc648640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d40b11d0 con 0x7fd2d40b1d20 2023-09-13T06:02:31.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.935+0000 7fd2da3e4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd2d4159f20 0x7fd2d40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:31.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2da3e4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd2d4159f20 0x7fd2d40ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42726/0 (socket says 172.21.15.130:42726) 2023-09-13T06:02:31.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2da3e4640 1 -- 172.21.15.130:0/329106036 learned_addr learned my addr 172.21.15.130:0/329106036 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:31.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2dabe5640 1 --2- 172.21.15.130:0/329106036 >> v2:172.21.15.164:3300/0 conn(0x7fd2d40b1d20 0x7fd2d40b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:31.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2da3e4640 1 -- 172.21.15.130:0/329106036 >> v2:172.21.15.164:3300/0 conn(0x7fd2d40b1d20 msgr2=0x7fd2d40b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:31.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2da3e4640 1 --2- 172.21.15.130:0/329106036 >> v2:172.21.15.164:3300/0 conn(0x7fd2d40b1d20 0x7fd2d40b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2da3e4640 1 -- 172.21.15.130:0/329106036 >> v1:172.21.15.130:6789/0 conn(0x7fd2d40cdfc0 legacy=0x7fd2d40b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:31.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2da3e4640 1 -- 172.21.15.130:0/329106036 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d40ced90 con 0x7fd2d4159f20 2023-09-13T06:02:31.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2dabe5640 1 --2- 172.21.15.130:0/329106036 >> v2:172.21.15.164:3300/0 conn(0x7fd2d40b1d20 0x7fd2d40b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:31.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2da3e4640 1 --2- 172.21.15.130:0/329106036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d4159f20 0x7fd2d40ce7b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40cbf60 tx=0x7fd2d001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de57756d86626eb5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:31.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2d93e2640 1 -- 172.21.15.130:0/329106036 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00aa430 con 0x7fd2d4159f20 2023-09-13T06:02:31.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2d93e2640 1 -- 172.21.15.130:0/329106036 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d00aa590 con 0x7fd2d4159f20 2023-09-13T06:02:31.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.939+0000 7fd2d93e2640 1 -- 172.21.15.130:0/329106036 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00aa920 con 0x7fd2d4159f20 2023-09-13T06:02:31.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 -- 172.21.15.130:0/329106036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d4159f20 msgr2=0x7fd2d40ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:31.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 --2- 172.21.15.130:0/329106036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d4159f20 0x7fd2d40ce7b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40cbf60 tx=0x7fd2d001c4d0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 -- 172.21.15.130:0/329106036 shutdown_connections 2023-09-13T06:02:31.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 --2- 172.21.15.130:0/329106036 >> v2:172.21.15.164:3300/0 conn(0x7fd2d40b1d20 0x7fd2d40b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 --2- 172.21.15.130:0/329106036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d4159f20 0x7fd2d40ce7b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 -- 172.21.15.130:0/329106036 >> 172.21.15.130:0/329106036 conn(0x7fd2d4065990 msgr2=0x7fd2d4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:31.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 -- 172.21.15.130:0/329106036 shutdown_connections 2023-09-13T06:02:31.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 -- 172.21.15.130:0/329106036 wait complete. 2023-09-13T06:02:31.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 Processor -- start 2023-09-13T06:02:31.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 -- start start 2023-09-13T06:02:31.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2d40b1d20 0x7fd2d41495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:31.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d40cdfc0 0x7fd2d414bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:31.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2d4159f20 0x7fd2d4158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:31.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d406d8b0 con 0x7fd2d40cdfc0 2023-09-13T06:02:31.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d414c280 con 0x7fd2d40b1d20 2023-09-13T06:02:31.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dc648640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d406cd30 con 0x7fd2d4159f20 2023-09-13T06:02:31.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2d9be3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d40cdfc0 0x7fd2d414bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:31.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2d9be3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d40cdfc0 0x7fd2d414bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42736/0 (socket says 172.21.15.130:42736) 2023-09-13T06:02:31.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2d9be3640 1 -- 172.21.15.130:0/1267194882 learned_addr learned my addr 172.21.15.130:0/1267194882 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:31.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2da3e4640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2d40b1d20 0x7fd2d41495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:31.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2dabe5640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2d4159f20 0x7fd2d4158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:31.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2d9be3640 1 -- 172.21.15.130:0/1267194882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2d4159f20 msgr2=0x7fd2d4158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:31.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2d9be3640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2d4159f20 0x7fd2d4158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2d9be3640 1 -- 172.21.15.130:0/1267194882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2d40b1d20 msgr2=0x7fd2d41495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:31.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2d9be3640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2d40b1d20 0x7fd2d41495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:31.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2d9be3640 1 -- 172.21.15.130:0/1267194882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d00094d0 con 0x7fd2d40cdfc0 2023-09-13T06:02:31.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.943+0000 7fd2d9be3640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d40cdfc0 0x7fd2d414bd40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400c500 tx=0x7fd2c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:31.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.947+0000 7fd2caffd640 1 -- 172.21.15.130:0/1267194882 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4005220 con 0x7fd2d40cdfc0 2023-09-13T06:02:31.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.947+0000 7fd2caffd640 1 -- 172.21.15.130:0/1267194882 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c4005380 con 0x7fd2d40cdfc0 2023-09-13T06:02:31.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.947+0000 7fd2caffd640 1 -- 172.21.15.130:0/1267194882 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4007270 con 0x7fd2d40cdfc0 2023-09-13T06:02:31.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.947+0000 7fd2dc648640 1 -- 172.21.15.130:0/1267194882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d406d010 con 0x7fd2d40cdfc0 2023-09-13T06:02:31.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.947+0000 7fd2dc648640 1 -- 172.21.15.130:0/1267194882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d406d5d0 con 0x7fd2d40cdfc0 2023-09-13T06:02:31.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.947+0000 7fd2dc648640 1 -- 172.21.15.130:0/1267194882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d40618a0 con 0x7fd2d40cdfc0 2023-09-13T06:02:31.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.947+0000 7fd2caffd640 1 -- 172.21.15.130:0/1267194882 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd2c40073d0 con 0x7fd2d40cdfc0 2023-09-13T06:02:31.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.947+0000 7fd2caffd640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2b8065b20 0x7fd2b8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:31.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.947+0000 7fd2caffd640 1 -- 172.21.15.130:0/1267194882 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2c4082b20 con 0x7fd2d40cdfc0 2023-09-13T06:02:31.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.947+0000 7fd2da3e4640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2b8065b20 0x7fd2b8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:31.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.947+0000 7fd2da3e4640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2b8065b20 0x7fd2b8067fe0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00ae000 tx=0x7fd2d00b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:31.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:31.951+0000 7fd2caffd640 1 -- 172.21.15.130:0/1267194882 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd2c4050480 con 0x7fd2d40cdfc0 2023-09-13T06:02:32.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.151+0000 7fd2dc648640 1 -- 172.21.15.130:0/1267194882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fd2d40cd790 con 0x7fd2d40cdfc0 2023-09-13T06:02:32.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.151+0000 7fd2caffd640 1 -- 172.21.15.130:0/1267194882 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1620 (secure 0 0 0) 0x7fd2c4053aa0 con 0x7fd2d40cdfc0 2023-09-13T06:02:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:02:32.158 INFO:teuthology.orchestra.run.smithi130.stdout: "stats": { 2023-09-13T06:02:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "total_bytes": 1600000000, 2023-09-13T06:02:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "total_avail_bytes": 1597705636, 2023-09-13T06:02:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "total_used_bytes": 2294364, 2023-09-13T06:02:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "total_used_raw_bytes": 2294364, 2023-09-13T06:02:32.159 INFO:teuthology.orchestra.run.smithi130.stdout: "total_used_raw_ratio": 0.0014339775079861283, 2023-09-13T06:02:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "num_osds": 8, 2023-09-13T06:02:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "num_per_pool_osds": 0, 2023-09-13T06:02:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "num_per_pool_omap_osds": 0 2023-09-13T06:02:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:32.160 INFO:teuthology.orchestra.run.smithi130.stdout: "stats_by_class": { 2023-09-13T06:02:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "hdd": { 2023-09-13T06:02:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "total_bytes": 1600000000, 2023-09-13T06:02:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "total_avail_bytes": 1597705636, 2023-09-13T06:02:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "total_used_bytes": 2294364, 2023-09-13T06:02:32.161 INFO:teuthology.orchestra.run.smithi130.stdout: "total_used_raw_bytes": 2294364, 2023-09-13T06:02:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: "total_used_raw_ratio": 0.0014339775079861283 2023-09-13T06:02:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:02:32.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "name": ".mgr", 2023-09-13T06:02:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 1, 2023-09-13T06:02:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "stats": { 2023-09-13T06:02:32.163 INFO:teuthology.orchestra.run.smithi130.stdout: "stored": 590368, 2023-09-13T06:02:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "objects": 2, 2023-09-13T06:02:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "kb_used": 577, 2023-09-13T06:02:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "bytes_used": 590368, 2023-09-13T06:02:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "percent_used": 0.00052959454478695989, 2023-09-13T06:02:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: "max_avail": 557082176 2023-09-13T06:02:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: "name": "cephfs_metadata", 2023-09-13T06:02:32.165 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 4, 2023-09-13T06:02:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "stats": { 2023-09-13T06:02:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "stored": 2410, 2023-09-13T06:02:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "objects": 22, 2023-09-13T06:02:32.166 INFO:teuthology.orchestra.run.smithi130.stdout: "kb_used": 3, 2023-09-13T06:02:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "bytes_used": 2410, 2023-09-13T06:02:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "percent_used": 2.1630514766002307e-06, 2023-09-13T06:02:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: "max_avail": 557082176 2023-09-13T06:02:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:32.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "name": "cephfs_data", 2023-09-13T06:02:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 5, 2023-09-13T06:02:32.168 INFO:teuthology.orchestra.run.smithi130.stdout: "stats": { 2023-09-13T06:02:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "stored": 0, 2023-09-13T06:02:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "objects": 0, 2023-09-13T06:02:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "kb_used": 0, 2023-09-13T06:02:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: "bytes_used": 0, 2023-09-13T06:02:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: "percent_used": 0, 2023-09-13T06:02:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: "max_avail": 557082176 2023-09-13T06:02:32.170 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:32.171 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:02:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:02:32.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 -- 172.21.15.130:0/1267194882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2b8065b20 msgr2=0x7fd2b8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:32.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2b8065b20 0x7fd2b8067fe0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00ae000 tx=0x7fd2d00b5040 comp rx=0 tx=0).stop 2023-09-13T06:02:32.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 -- 172.21.15.130:0/1267194882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d40cdfc0 msgr2=0x7fd2d414bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:32.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d40cdfc0 0x7fd2d414bd40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400c500 tx=0x7fd2c400c9c0 comp rx=0 tx=0).stop 2023-09-13T06:02:32.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 -- 172.21.15.130:0/1267194882 shutdown_connections 2023-09-13T06:02:32.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2b8065b20 0x7fd2b8067fe0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:32.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2d4159f20 0x7fd2d4158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:32.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d40cdfc0 0x7fd2d414bd40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:32.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 --2- 172.21.15.130:0/1267194882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2d40b1d20 0x7fd2d41495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:32.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 -- 172.21.15.130:0/1267194882 >> 172.21.15.130:0/1267194882 conn(0x7fd2d4065990 msgr2=0x7fd2d40ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:32.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 -- 172.21.15.130:0/1267194882 shutdown_connections 2023-09-13T06:02:32.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.155+0000 7fd2dc648640 1 -- 172.21.15.130:0/1267194882 wait complete. 2023-09-13T06:02:32.179 DEBUG:teuthology.orchestra.run.smithi130:> stdin-killer -- python3 -c ' 2023-09-13T06:02:32.179 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-09-13T06:02:32.180 DEBUG:teuthology.orchestra.run.smithi130:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-13T06:02:32.180 DEBUG:teuthology.orchestra.run.smithi130:> os.fchmod(fd, 0O666) 2023-09-13T06:02:32.180 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(fd) 2023-09-13T06:02:32.181 DEBUG:teuthology.orchestra.run.smithi130:> os.close(fd) 2023-09-13T06:02:32.181 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-09-13T06:02:32.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-13T06:02:32.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:32.260 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:02:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:client5325 2023-09-13T06:02:32.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:32.319 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client5325/osdmap') 2023-09-13T06:02:32.382 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 32 barrier 32 flags 0x588000 2023-09-13T06:02:32.382 INFO:teuthology.orchestra.run.smithi130.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:32.382 INFO:teuthology.orchestra.run.smithi130.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:32.383 INFO:teuthology.orchestra.run.smithi130.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:32.383 INFO:teuthology.orchestra.run.smithi130.stdout:osd0 (1)172.21.15.130:6801 100% (exists, up) 100% -1 2023-09-13T06:02:32.383 INFO:teuthology.orchestra.run.smithi130.stdout:osd1 (1)172.21.15.130:6817 100% (exists, up) 100% -1 2023-09-13T06:02:32.383 INFO:teuthology.orchestra.run.smithi130.stdout:osd2 (1)172.21.15.130:6809 100% (exists, up) 100% -1 2023-09-13T06:02:32.384 INFO:teuthology.orchestra.run.smithi130.stdout:osd3 (1)172.21.15.130:6812 100% (exists, up) 100% -1 2023-09-13T06:02:32.384 INFO:teuthology.orchestra.run.smithi130.stdout:osd4 (1)172.21.15.164:6801 100% (exists, up) 100% -1 2023-09-13T06:02:32.384 INFO:teuthology.orchestra.run.smithi130.stdout:osd5 (1)172.21.15.164:6809 100% (exists, up) 100% -1 2023-09-13T06:02:32.384 INFO:teuthology.orchestra.run.smithi130.stdout:osd6 (1)172.21.15.164:6817 100% (exists, up) 100% -1 2023-09-13T06:02:32.384 INFO:teuthology.orchestra.run.smithi130.stdout:osd7 (1)172.21.15.164:6825 100% (exists, up) 100% -1 2023-09-13T06:02:32.385 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records in 2023-09-13T06:02:32.385 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records out 2023-09-13T06:02:32.386 INFO:teuthology.orchestra.run.smithi130.stderr:799 bytes copied, 0.000140346 s, 5.7 MB/s 2023-09-13T06:02:32.386 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-09-13T06:02:32.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.563+0000 7f7b4880a640 1 Processor -- start 2023-09-13T06:02:32.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.563+0000 7f7b4880a640 1 -- start start 2023-09-13T06:02:32.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b4880a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7b44157980 0x7f7b4415af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:32.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b4880a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b4406d930 0x7f7b440cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:32.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b4880a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b440cc670 con 0x7f7b440cc220 2023-09-13T06:02:32.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b4880a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4415b480 con 0x7f7b44157980 2023-09-13T06:02:32.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b4880a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4406c890 con 0x7f7b4406d930 2023-09-13T06:02:32.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b42d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7b44157980 0x7f7b4415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:32.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b42d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7b44157980 0x7f7b4415af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42740/0 (socket says 172.21.15.130:42740) 2023-09-13T06:02:32.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b42d9d640 1 -- 172.21.15.130:0/4177931693 learned_addr learned my addr 172.21.15.130:0/4177931693 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:32.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b3bfff640 1 --2- 172.21.15.130:0/4177931693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b4406d930 0x7f7b440cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:32.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b42d9d640 1 -- 172.21.15.130:0/4177931693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b4406d930 msgr2=0x7f7b440cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:32.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b42d9d640 1 --2- 172.21.15.130:0/4177931693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b4406d930 0x7f7b440cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:32.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b42d9d640 1 -- 172.21.15.130:0/4177931693 >> v1:172.21.15.164:6789/0 conn(0x7f7b440cc220 legacy=0x7f7b440ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:32.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.567+0000 7f7b42d9d640 1 -- 172.21.15.130:0/4177931693 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4406cb70 con 0x7f7b44157980 2023-09-13T06:02:32.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b42d9d640 1 --2- 172.21.15.130:0/4177931693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b44157980 0x7f7b4415af40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009870 tx=0x7f7b3401e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137df3c59626dd3c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:32.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4259c640 1 -- 172.21.15.130:0/4177931693 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340ab670 con 0x7f7b44157980 2023-09-13T06:02:32.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4259c640 1 -- 172.21.15.130:0/4177931693 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b340ab7d0 con 0x7f7b44157980 2023-09-13T06:02:32.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4259c640 1 -- 172.21.15.130:0/4177931693 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340abb60 con 0x7f7b44157980 2023-09-13T06:02:32.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4880a640 1 -- 172.21.15.130:0/4177931693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b44157980 msgr2=0x7f7b4415af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:32.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4880a640 1 --2- 172.21.15.130:0/4177931693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b44157980 0x7f7b4415af40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009870 tx=0x7f7b3401e6e0 comp rx=0 tx=0).stop 2023-09-13T06:02:32.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4880a640 1 -- 172.21.15.130:0/4177931693 shutdown_connections 2023-09-13T06:02:32.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4880a640 1 --2- 172.21.15.130:0/4177931693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b4406d930 0x7f7b440cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:32.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4880a640 1 --2- 172.21.15.130:0/4177931693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b44157980 0x7f7b4415af40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:32.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4880a640 1 -- 172.21.15.130:0/4177931693 >> 172.21.15.130:0/4177931693 conn(0x7f7b44065b60 msgr2=0x7f7b440aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:32.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4880a640 1 -- 172.21.15.130:0/4177931693 shutdown_connections 2023-09-13T06:02:32.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4880a640 1 -- 172.21.15.130:0/4177931693 wait complete. 2023-09-13T06:02:32.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4880a640 1 Processor -- start 2023-09-13T06:02:32.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.571+0000 7f7b4880a640 1 -- start start 2023-09-13T06:02:32.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b4880a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4406d930 0x7f7b44144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:32.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b4880a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b440cc220 0x7f7b441537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:32.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b4880a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b44157980 0x7f7b44153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:32.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b4880a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b440adee0 con 0x7f7b4406d930 2023-09-13T06:02:32.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b4880a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b440b33b0 con 0x7f7b44157980 2023-09-13T06:02:32.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b4880a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b44156480 con 0x7f7b440cc220 2023-09-13T06:02:32.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b42d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4406d930 0x7f7b44144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:32.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b42d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4406d930 0x7f7b44144a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42748/0 (socket says 172.21.15.130:42748) 2023-09-13T06:02:32.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b42d9d640 1 -- 172.21.15.130:0/4146451152 learned_addr learned my addr 172.21.15.130:0/4146451152 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:32.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b3bfff640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b440cc220 0x7f7b441537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:32.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b4359e640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b44157980 0x7f7b44153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:32.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b42d9d640 1 -- 172.21.15.130:0/4146451152 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b440cc220 msgr2=0x7f7b441537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:32.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b42d9d640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b440cc220 0x7f7b441537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:32.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b42d9d640 1 -- 172.21.15.130:0/4146451152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b44157980 msgr2=0x7f7b44153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:32.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b42d9d640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b44157980 0x7f7b44153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:32.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b42d9d640 1 -- 172.21.15.130:0/4146451152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b340094d0 con 0x7f7b4406d930 2023-09-13T06:02:32.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b4359e640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b44157980 0x7f7b44153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:32.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b42d9d640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4406d930 0x7f7b44144a50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7b3401ef80 tx=0x7f7b3401b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:32.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b3b7fe640 1 -- 172.21.15.130:0/4146451152 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340b3800 con 0x7f7b4406d930 2023-09-13T06:02:32.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b3b7fe640 1 -- 172.21.15.130:0/4146451152 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b340b3980 con 0x7f7b4406d930 2023-09-13T06:02:32.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b3b7fe640 1 -- 172.21.15.130:0/4146451152 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340b3d30 con 0x7f7b4406d930 2023-09-13T06:02:32.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b4880a640 1 -- 172.21.15.130:0/4146451152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b44144f90 con 0x7f7b4406d930 2023-09-13T06:02:32.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b4880a640 1 -- 172.21.15.130:0/4146451152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b440b2330 con 0x7f7b4406d930 2023-09-13T06:02:32.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b4880a640 1 -- 172.21.15.130:0/4146451152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b440618a0 con 0x7f7b4406d930 2023-09-13T06:02:32.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.575+0000 7f7b3b7fe640 1 -- 172.21.15.130:0/4146451152 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7b340aa3d0 con 0x7f7b4406d930 2023-09-13T06:02:32.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.579+0000 7f7b3b7fe640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b24065b20 0x7f7b24067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:32.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.579+0000 7f7b3b7fe640 1 -- 172.21.15.130:0/4146451152 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b3411dbd0 con 0x7f7b4406d930 2023-09-13T06:02:32.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.579+0000 7f7b3bfff640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b24065b20 0x7f7b24067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:32.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.579+0000 7f7b3bfff640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b24065b20 0x7f7b24067fe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7b441569c0 tx=0x7f7b2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:32.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.583+0000 7f7b3b7fe640 1 -- 172.21.15.130:0/4146451152 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7b340eb510 con 0x7f7b4406d930 2023-09-13T06:02:32.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:32.739+0000 7f7b4880a640 1 -- 172.21.15.130:0/4146451152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f7b440b0cb0 con 0x7f7b4406d930 2023-09-13T06:02:33.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.319+0000 7f7b3b7fe640 1 -- 172.21.15.130:0/4146451152 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v33) v1 ==== 93+0+0 (secure 0 0 0) 0x7f7b340eeb30 con 0x7f7b4406d930 2023-09-13T06:02:33.326 INFO:teuthology.orchestra.run.smithi130.stderr:pauserd,pausewr is set 2023-09-13T06:02:33.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 -- 172.21.15.130:0/4146451152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b24065b20 msgr2=0x7f7b24067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:33.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b24065b20 0x7f7b24067fe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7b441569c0 tx=0x7f7b2c008040 comp rx=0 tx=0).stop 2023-09-13T06:02:33.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 -- 172.21.15.130:0/4146451152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4406d930 msgr2=0x7f7b44144a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:33.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4406d930 0x7f7b44144a50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7b3401ef80 tx=0x7f7b3401b480 comp rx=0 tx=0).stop 2023-09-13T06:02:33.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 -- 172.21.15.130:0/4146451152 shutdown_connections 2023-09-13T06:02:33.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b24065b20 0x7f7b24067fe0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:33.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b44157980 0x7f7b44153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:33.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b440cc220 0x7f7b441537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:33.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 --2- 172.21.15.130:0/4146451152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b4406d930 0x7f7b44144a50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:33.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 -- 172.21.15.130:0/4146451152 >> 172.21.15.130:0/4146451152 conn(0x7f7b44065b60 msgr2=0x7f7b440ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:33.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 -- 172.21.15.130:0/4146451152 shutdown_connections 2023-09-13T06:02:33.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.323+0000 7f7b4880a640 1 -- 172.21.15.130:0/4146451152 wait complete. 2023-09-13T06:02:33.349 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-09-13T06:02:33.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.483+0000 7fb1f02ec640 1 Processor -- start 2023-09-13T06:02:33.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.483+0000 7fb1f02ec640 1 -- start start 2023-09-13T06:02:33.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.483+0000 7fb1f02ec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb1e8146540 0x7fb1e8070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:33.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.483+0000 7fb1f02ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1e8070b90 0x7fb1e8160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:33.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.483+0000 7fb1f02ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e806f640 con 0x7fb1e81436e0 2023-09-13T06:02:33.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.483+0000 7fb1f02ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e8070fa0 con 0x7fb1e8070b90 2023-09-13T06:02:33.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.483+0000 7fb1f02ec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e806f890 con 0x7fb1e8146540 2023-09-13T06:02:33.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ee889640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1e8070b90 0x7fb1e8160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:33.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ee889640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1e8070b90 0x7fb1e8160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42750/0 (socket says 172.21.15.130:42750) 2023-09-13T06:02:33.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ee889640 1 -- 172.21.15.130:0/2153690233 learned_addr learned my addr 172.21.15.130:0/2153690233 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:33.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ee088640 1 --1- 172.21.15.130:0/2153690233 >> v1:172.21.15.130:6789/0 conn(0x7fb1e81436e0 0x7fb1e80ac840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37784/0 (socket says 172.21.15.130:37784) 2023-09-13T06:02:33.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ed887640 1 --2- 172.21.15.130:0/2153690233 >> v2:172.21.15.164:3300/0 conn(0x7fb1e8146540 0x7fb1e8070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:33.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ee889640 1 -- 172.21.15.130:0/2153690233 >> v2:172.21.15.164:3300/0 conn(0x7fb1e8146540 msgr2=0x7fb1e8070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:33.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ee889640 1 --2- 172.21.15.130:0/2153690233 >> v2:172.21.15.164:3300/0 conn(0x7fb1e8146540 0x7fb1e8070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:33.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ee889640 1 -- 172.21.15.130:0/2153690233 >> v1:172.21.15.130:6789/0 conn(0x7fb1e81436e0 legacy=0x7fb1e80ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:33.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ee889640 1 -- 172.21.15.130:0/2153690233 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e806fb70 con 0x7fb1e8070b90 2023-09-13T06:02:33.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ed887640 1 --2- 172.21.15.130:0/2153690233 >> v2:172.21.15.164:3300/0 conn(0x7fb1e8146540 0x7fb1e8070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:33.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ee889640 1 --2- 172.21.15.130:0/2153690233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e8070b90 0x7fb1e8160eb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb1e806ba00 tx=0x7fb1e001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0d0954458db0ad server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:33.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ed086640 1 -- 172.21.15.130:0/2153690233 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00a5660 con 0x7fb1e8070b90 2023-09-13T06:02:33.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ed086640 1 -- 172.21.15.130:0/2153690233 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e00a57c0 con 0x7fb1e8070b90 2023-09-13T06:02:33.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.487+0000 7fb1ed086640 1 -- 172.21.15.130:0/2153690233 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00a5b50 con 0x7fb1e8070b90 2023-09-13T06:02:33.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 -- 172.21.15.130:0/2153690233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e8070b90 msgr2=0x7fb1e8160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:33.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 --2- 172.21.15.130:0/2153690233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e8070b90 0x7fb1e8160eb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb1e806ba00 tx=0x7fb1e001c8b0 comp rx=0 tx=0).stop 2023-09-13T06:02:33.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 -- 172.21.15.130:0/2153690233 shutdown_connections 2023-09-13T06:02:33.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 --2- 172.21.15.130:0/2153690233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e8070b90 0x7fb1e8160eb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:33.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 --2- 172.21.15.130:0/2153690233 >> v2:172.21.15.164:3300/0 conn(0x7fb1e8146540 0x7fb1e8070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:33.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 -- 172.21.15.130:0/2153690233 >> 172.21.15.130:0/2153690233 conn(0x7fb1e80b0bc0 msgr2=0x7fb1e80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:33.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 -- 172.21.15.130:0/2153690233 shutdown_connections 2023-09-13T06:02:33.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 -- 172.21.15.130:0/2153690233 wait complete. 2023-09-13T06:02:33.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 Processor -- start 2023-09-13T06:02:33.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 -- start start 2023-09-13T06:02:33.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb1e8070b90 0x7fb1e815aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:33.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e81436e0 0x7fb1e8145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:33.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1e8146540 0x7fb1e8138660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:33.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8144050 con 0x7fb1e81436e0 2023-09-13T06:02:33.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8145390 con 0x7fb1e8146540 2023-09-13T06:02:33.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1f02ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e81442f0 con 0x7fb1e8070b90 2023-09-13T06:02:33.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1ed887640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e81436e0 0x7fb1e8145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:33.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1ed887640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e81436e0 0x7fb1e8145d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42754/0 (socket says 172.21.15.130:42754) 2023-09-13T06:02:33.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1ed887640 1 -- 172.21.15.130:0/316636191 learned_addr learned my addr 172.21.15.130:0/316636191 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:33.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1ee088640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb1e8070b90 0x7fb1e815aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:33.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1ee889640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1e8146540 0x7fb1e8138660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:33.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1ed887640 1 -- 172.21.15.130:0/316636191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb1e8070b90 msgr2=0x7fb1e815aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:33.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1ed887640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb1e8070b90 0x7fb1e815aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:33.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1ed887640 1 -- 172.21.15.130:0/316636191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1e8146540 msgr2=0x7fb1e8138660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:33.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1ed887640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1e8146540 0x7fb1e8138660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:33.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1ed887640 1 -- 172.21.15.130:0/316636191 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e0009b30 con 0x7fb1e81436e0 2023-09-13T06:02:33.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.491+0000 7fb1ee889640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1e8146540 0x7fb1e8138660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:33.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.495+0000 7fb1ed887640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e81436e0 0x7fb1e8145d10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800c7f0 tx=0x7fb1d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:33.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.495+0000 7fb1deffd640 1 -- 172.21.15.130:0/316636191 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8007820 con 0x7fb1e81436e0 2023-09-13T06:02:33.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.495+0000 7fb1deffd640 1 -- 172.21.15.130:0/316636191 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d8007980 con 0x7fb1e81436e0 2023-09-13T06:02:33.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.495+0000 7fb1deffd640 1 -- 172.21.15.130:0/316636191 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8007d30 con 0x7fb1e81436e0 2023-09-13T06:02:33.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.495+0000 7fb1f02ec640 1 -- 172.21.15.130:0/316636191 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e81445d0 con 0x7fb1e81436e0 2023-09-13T06:02:33.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.495+0000 7fb1f02ec640 1 -- 172.21.15.130:0/316636191 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e8144b90 con 0x7fb1e81436e0 2023-09-13T06:02:33.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.495+0000 7fb1f02ec640 1 -- 172.21.15.130:0/316636191 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e80618a0 con 0x7fb1e81436e0 2023-09-13T06:02:33.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.495+0000 7fb1deffd640 1 -- 172.21.15.130:0/316636191 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb1d80113f0 con 0x7fb1e81436e0 2023-09-13T06:02:33.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.495+0000 7fb1deffd640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb1cc065b20 0x7fb1cc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:33.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.495+0000 7fb1deffd640 1 -- 172.21.15.130:0/316636191 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1d8083690 con 0x7fb1e81436e0 2023-09-13T06:02:33.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.495+0000 7fb1ee088640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb1cc065b20 0x7fb1cc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:33.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.499+0000 7fb1deffd640 1 -- 172.21.15.130:0/316636191 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=34+}) v3 -- 0x7fb1cc06d650 con 0x7fb1e81436e0 2023-09-13T06:02:33.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.499+0000 7fb1ee088640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb1cc065b20 0x7fb1cc067fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4000f70 tx=0x7fb1e4007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:33.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.499+0000 7fb1deffd640 1 -- 172.21.15.130:0/316636191 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb1d8050fe0 con 0x7fb1e81436e0 2023-09-13T06:02:33.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:33.659+0000 7fb1f02ec640 1 -- 172.21.15.130:0/316636191 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fb1e80b2bc0 con 0x7fb1e81436e0 2023-09-13T06:02:34.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.327+0000 7fb1deffd640 1 -- 172.21.15.130:0/316636191 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(34..34 src has 1..34) v4 ==== 288+0+0 (secure 0 0 0) 0x7fb1d80553a0 con 0x7fb1e81436e0 2023-09-13T06:02:34.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.327+0000 7fb1deffd640 1 -- 172.21.15.130:0/316636191 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=35}) v3 -- 0x7fb1cc06de20 con 0x7fb1e81436e0 2023-09-13T06:02:34.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.331+0000 7fb1deffd640 1 -- 172.21.15.130:0/316636191 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb1d801f020 con 0x7fb1e81436e0 2023-09-13T06:02:34.335 INFO:teuthology.orchestra.run.smithi130.stderr:pauserd,pausewr is unset 2023-09-13T06:02:34.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.331+0000 7fb1f02ec640 1 -- 172.21.15.130:0/316636191 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb1cc065b20 msgr2=0x7fb1cc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:34.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.331+0000 7fb1f02ec640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb1cc065b20 0x7fb1cc067fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4000f70 tx=0x7fb1e4007c90 comp rx=0 tx=0).stop 2023-09-13T06:02:34.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.331+0000 7fb1f02ec640 1 -- 172.21.15.130:0/316636191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e81436e0 msgr2=0x7fb1e8145d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:34.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.331+0000 7fb1f02ec640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e81436e0 0x7fb1e8145d10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800c7f0 tx=0x7fb1d800ccb0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.335+0000 7fb1f02ec640 1 -- 172.21.15.130:0/316636191 shutdown_connections 2023-09-13T06:02:34.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.335+0000 7fb1f02ec640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb1cc065b20 0x7fb1cc067fe0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.335+0000 7fb1f02ec640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1e8146540 0x7fb1e8138660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.335+0000 7fb1f02ec640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e81436e0 0x7fb1e8145d10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.335+0000 7fb1f02ec640 1 --2- 172.21.15.130:0/316636191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb1e8070b90 0x7fb1e815aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.335+0000 7fb1f02ec640 1 -- 172.21.15.130:0/316636191 >> 172.21.15.130:0/316636191 conn(0x7fb1e80b0bc0 msgr2=0x7fb1e8071170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:34.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.335+0000 7fb1f02ec640 1 -- 172.21.15.130:0/316636191 shutdown_connections 2023-09-13T06:02:34.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.335+0000 7fb1f02ec640 1 -- 172.21.15.130:0/316636191 wait complete. 2023-09-13T06:02:34.361 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:34.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.495+0000 7f904b4de640 1 Processor -- start 2023-09-13T06:02:34.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904b4de640 1 -- start start 2023-09-13T06:02:34.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904b4de640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f904415af40 0x7f904406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:34.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904b4de640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904406c890 con 0x7f90440cc3f0 2023-09-13T06:02:34.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904b4de640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904406cb70 con 0x7f9044157980 2023-09-13T06:02:34.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904b4de640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904406de70 con 0x7f904415af40 2023-09-13T06:02:34.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f9049cdb640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f90440cc3f0 0x7f90440ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37790/0 (socket says 172.21.15.130:37790) 2023-09-13T06:02:34.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f9049cdb640 1 -- 172.21.15.130:0/1452694785 learned_addr learned my addr 172.21.15.130:0/1452694785 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:34.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904acdd640 1 --2- 172.21.15.130:0/1452694785 >> v2:172.21.15.164:3300/0 conn(0x7f904415af40 0x7f904406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:34.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968222119 0 0) 0x7f904406c890 con 0x7f90440cc3f0 2023-09-13T06:02:34.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9030003530 con 0x7f90440cc3f0 2023-09-13T06:02:34.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689236551 0 0) 0x7f904406cb70 con 0x7f9044157980 2023-09-13T06:02:34.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f904406c890 con 0x7f9044157980 2023-09-13T06:02:34.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1718299341 0 0) 0x7f9030003530 con 0x7f90440cc3f0 2023-09-13T06:02:34.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 >> v2:172.21.15.164:3300/0 conn(0x7f904415af40 msgr2=0x7f904406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:34.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 --2- 172.21.15.130:0/1452694785 >> v2:172.21.15.164:3300/0 conn(0x7f904415af40 0x7f904406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 >> v1:172.21.15.164:6789/0 conn(0x7f9044157980 legacy=0x7f90440cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:34.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904406ce50 con 0x7f90440cc3f0 2023-09-13T06:02:34.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f9034001680 con 0x7f90440cc3f0 2023-09-13T06:02:34.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 >> v1:172.21.15.130:6789/0 conn(0x7f90440cc3f0 legacy=0x7f90440ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:34.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 --2- 172.21.15.130:0/1452694785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9030003b80 0x7f9030003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:34.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 --2- 172.21.15.130:0/1452694785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90300047d0 0x7f9030004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:34.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 --2- 172.21.15.130:0/1452694785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9030005190 0x7f903000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:34.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904406de70 con 0x7f9030005190 2023-09-13T06:02:34.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903000e2a0 con 0x7f9030003b80 2023-09-13T06:02:34.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903000e460 con 0x7f90300047d0 2023-09-13T06:02:34.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904acdd640 1 --2- 172.21.15.130:0/1452694785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9030005190 0x7f903000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:34.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904a4dc640 1 --2- 172.21.15.130:0/1452694785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9030003b80 0x7f9030003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:34.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f9049cdb640 1 --2- 172.21.15.130:0/1452694785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90300047d0 0x7f9030004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:34.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904acdd640 1 -- 172.21.15.130:0/1452694785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90300047d0 msgr2=0x7f9030004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:34.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904acdd640 1 --2- 172.21.15.130:0/1452694785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90300047d0 0x7f9030004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904acdd640 1 -- 172.21.15.130:0/1452694785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9030003b80 msgr2=0x7f9030003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:34.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904acdd640 1 --2- 172.21.15.130:0/1452694785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9030003b80 0x7f9030003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.499+0000 7f904acdd640 1 -- 172.21.15.130:0/1452694785 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030003530 con 0x7f9030005190 2023-09-13T06:02:34.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f904acdd640 1 -- 172.21.15.130:0/1452694785 reap_dead start 2023-09-13T06:02:34.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f904acdd640 1 --2- 172.21.15.130:0/1452694785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9030005190 0x7f903000dba0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f903c009fc0 tx=0x7f903c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0dcf96f93ba665 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:34.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0a5cb0 con 0x7f9030005190 2023-09-13T06:02:34.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c00f040 con 0x7f9030005190 2023-09-13T06:02:34.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f90494da640 1 -- 172.21.15.130:0/1452694785 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c003be0 con 0x7f9030005190 2023-09-13T06:02:34.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f904b4de640 1 -- 172.21.15.130:0/1452694785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9030005190 msgr2=0x7f903000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:34.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f904b4de640 1 --2- 172.21.15.130:0/1452694785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9030005190 0x7f903000dba0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f903c009fc0 tx=0x7f903c01cca0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f904b4de640 1 -- 172.21.15.130:0/1452694785 shutdown_connections 2023-09-13T06:02:34.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f904b4de640 1 --2- 172.21.15.130:0/1452694785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9030005190 0x7f903000dba0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f904b4de640 1 -- 172.21.15.130:0/1452694785 >> 172.21.15.130:0/1452694785 conn(0x7f9044065b60 msgr2=0x7f90440aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:34.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f904b4de640 1 -- 172.21.15.130:0/1452694785 shutdown_connections 2023-09-13T06:02:34.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.503+0000 7f904b4de640 1 -- 172.21.15.130:0/1452694785 wait complete. 2023-09-13T06:02:34.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904b4de640 1 Processor -- start 2023-09-13T06:02:34.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904b4de640 1 -- start start 2023-09-13T06:02:34.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904b4de640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9030005190 0x7f9044157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:34.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904b4de640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90441f5a20 0x7f9044146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:34.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904b4de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90440ae100 0x7f904415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:34.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904b4de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9044151d90 con 0x7f90440ae100 2023-09-13T06:02:34.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904b4de640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90440af7e0 con 0x7f90441f5a20 2023-09-13T06:02:34.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904b4de640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90441f5f20 con 0x7f9030005190 2023-09-13T06:02:34.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904acdd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90440ae100 0x7f904415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:34.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904acdd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90440ae100 0x7f904415bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42772/0 (socket says 172.21.15.130:42772) 2023-09-13T06:02:34.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904acdd640 1 -- 172.21.15.130:0/677239464 learned_addr learned my addr 172.21.15.130:0/677239464 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:34.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904a4dc640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9030005190 0x7f9044157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:34.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f9049cdb640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90441f5a20 0x7f9044146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:34.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904acdd640 1 -- 172.21.15.130:0/677239464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9030005190 msgr2=0x7f9044157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:34.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904acdd640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9030005190 0x7f9044157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904acdd640 1 -- 172.21.15.130:0/677239464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90441f5a20 msgr2=0x7f9044146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:34.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904acdd640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90441f5a20 0x7f9044146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904acdd640 1 -- 172.21.15.130:0/677239464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90441f6200 con 0x7f90440ae100 2023-09-13T06:02:34.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904acdd640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90440ae100 0x7f904415bee0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f903c01c710 tx=0x7f903c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:34.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f903affd640 1 -- 172.21.15.130:0/677239464 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c003db0 con 0x7f90440ae100 2023-09-13T06:02:34.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f903affd640 1 -- 172.21.15.130:0/677239464 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c004030 con 0x7f90440ae100 2023-09-13T06:02:34.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904b4de640 1 -- 172.21.15.130:0/677239464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90441f64e0 con 0x7f90440ae100 2023-09-13T06:02:34.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f903affd640 1 -- 172.21.15.130:0/677239464 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0043a0 con 0x7f90440ae100 2023-09-13T06:02:34.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.507+0000 7f904b4de640 1 -- 172.21.15.130:0/677239464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9044146b90 con 0x7f90440ae100 2023-09-13T06:02:34.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.511+0000 7f904b4de640 1 -- 172.21.15.130:0/677239464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9044151f00 con 0x7f90440ae100 2023-09-13T06:02:34.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.511+0000 7f903affd640 1 -- 172.21.15.130:0/677239464 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f903c004500 con 0x7f90440ae100 2023-09-13T06:02:34.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.511+0000 7f903affd640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9028065b50 0x7f9028068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:34.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.511+0000 7f903affd640 1 -- 172.21.15.130:0/677239464 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f903c11ecb0 con 0x7f90440ae100 2023-09-13T06:02:34.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.511+0000 7f904a4dc640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9028065b50 0x7f9028068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:34.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.511+0000 7f904a4dc640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9028065b50 0x7f9028068010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9040007fd0 tx=0x7f9040009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:34.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.515+0000 7f903affd640 1 -- 172.21.15.130:0/677239464 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9044151f00 con 0x7f90440ae100 2023-09-13T06:02:34.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.667+0000 7f904b4de640 1 -- 172.21.15.130:0/677239464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9044151f00 con 0x7f90440ae100 2023-09-13T06:02:34.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.667+0000 7f903affd640 1 -- 172.21.15.130:0/677239464 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f9044151f00 con 0x7f90440ae100 2023-09-13T06:02:34.672 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:34.673 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:34.323976+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:15.867393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:17.140116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:34.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 -- 172.21.15.130:0/677239464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9028065b50 msgr2=0x7f9028068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:34.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9028065b50 0x7f9028068010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9040007fd0 tx=0x7f9040009040 comp rx=0 tx=0).stop 2023-09-13T06:02:34.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 -- 172.21.15.130:0/677239464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90440ae100 msgr2=0x7f904415bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:34.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90440ae100 0x7f904415bee0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f903c01c710 tx=0x7f903c009750 comp rx=0 tx=0).stop 2023-09-13T06:02:34.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 -- 172.21.15.130:0/677239464 shutdown_connections 2023-09-13T06:02:34.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9028065b50 0x7f9028068010 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90441f5a20 0x7f9044146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90440ae100 0x7f904415bee0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 --2- 172.21.15.130:0/677239464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9030005190 0x7f9044157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 -- 172.21.15.130:0/677239464 >> 172.21.15.130:0/677239464 conn(0x7f9044065b60 msgr2=0x7f904415b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 -- 172.21.15.130:0/677239464 shutdown_connections 2023-09-13T06:02:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34.671+0000 7f904b4de640 1 -- 172.21.15.130:0/677239464 wait complete. 2023-09-13T06:02:34.694 DEBUG:teuthology.orchestra.run.smithi130:> stdin-killer -- python3 -c ' 2023-09-13T06:02:34.694 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-09-13T06:02:34.694 DEBUG:teuthology.orchestra.run.smithi130:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-13T06:02:34.695 DEBUG:teuthology.orchestra.run.smithi130:> os.fchmod(fd, 0O666) 2023-09-13T06:02:34.695 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(fd) 2023-09-13T06:02:34.695 DEBUG:teuthology.orchestra.run.smithi130:> os.close(fd) 2023-09-13T06:02:34.696 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-09-13T06:02:34.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-13T06:02:34.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:34.773 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:02:34.825 INFO:teuthology.orchestra.run.smithi130.stdout:client5325 2023-09-13T06:02:34.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:34.826 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client5325/osdmap') 2023-09-13T06:02:34.886 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 32 barrier 32 flags 0x588000 2023-09-13T06:02:34.886 INFO:teuthology.orchestra.run.smithi130.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:34.887 INFO:teuthology.orchestra.run.smithi130.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:34.887 INFO:teuthology.orchestra.run.smithi130.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:34.887 INFO:teuthology.orchestra.run.smithi130.stdout:osd0 (1)172.21.15.130:6801 100% (exists, up) 100% -1 2023-09-13T06:02:34.887 INFO:teuthology.orchestra.run.smithi130.stdout:osd1 (1)172.21.15.130:6817 100% (exists, up) 100% -1 2023-09-13T06:02:34.888 INFO:teuthology.orchestra.run.smithi130.stdout:osd2 (1)172.21.15.130:6809 100% (exists, up) 100% -1 2023-09-13T06:02:34.888 INFO:teuthology.orchestra.run.smithi130.stdout:osd3 (1)172.21.15.130:6812 100% (exists, up) 100% -1 2023-09-13T06:02:34.888 INFO:teuthology.orchestra.run.smithi130.stdout:osd4 (1)172.21.15.164:6801 100% (exists, up) 100% -1 2023-09-13T06:02:34.888 INFO:teuthology.orchestra.run.smithi130.stdout:osd5 (1)172.21.15.164:6809 100% (exists, up) 100% -1 2023-09-13T06:02:34.888 INFO:teuthology.orchestra.run.smithi130.stdout:osd6 (1)172.21.15.164:6817 100% (exists, up) 100% -1 2023-09-13T06:02:34.888 INFO:teuthology.orchestra.run.smithi130.stdout:osd7 (1)172.21.15.164:6825 100% (exists, up) 100% -1 2023-09-13T06:02:34.889 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records in 2023-09-13T06:02:34.890 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records out 2023-09-13T06:02:34.890 INFO:teuthology.orchestra.run.smithi130.stderr:799 bytes copied, 9.7705e-05 s, 8.2 MB/s 2023-09-13T06:02:34.890 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:35.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff184ec640 1 Processor -- start 2023-09-13T06:02:35.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff184ec640 1 -- start start 2023-09-13T06:02:35.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff184ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff10144c20 0x7eff100b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:35.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff184ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff100d0d10 0x7eff100b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:35.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff184ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff100b6230 con 0x7eff1006d6e0 2023-09-13T06:02:35.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff184ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff10145000 con 0x7eff100d0d10 2023-09-13T06:02:35.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff184ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100b5620 con 0x7eff10144c20 2023-09-13T06:02:35.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff15a87640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff100d0d10 0x7eff100b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:35.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff16a89640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7eff1006d6e0 0x7eff1015b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37796/0 (socket says 172.21.15.130:37796) 2023-09-13T06:02:35.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff16a89640 1 -- 172.21.15.130:0/2112037514 learned_addr learned my addr 172.21.15.130:0/2112037514 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:35.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff16288640 1 --2- 172.21.15.130:0/2112037514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff10144c20 0x7eff100b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:35.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff15a87640 1 -- 172.21.15.130:0/2112037514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff10144c20 msgr2=0x7eff100b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:35.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff15a87640 1 --2- 172.21.15.130:0/2112037514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff10144c20 0x7eff100b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:35.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff15a87640 1 -- 172.21.15.130:0/2112037514 >> v1:172.21.15.130:6789/0 conn(0x7eff1006d6e0 legacy=0x7eff1015b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:35.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff15a87640 1 -- 172.21.15.130:0/2112037514 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100b5900 con 0x7eff100d0d10 2023-09-13T06:02:35.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff16288640 1 --2- 172.21.15.130:0/2112037514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff10144c20 0x7eff100b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:35.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.067+0000 7eff15286640 1 -- 172.21.15.130:0/2112037514 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221803383 0 0) 0x7eff100b6230 con 0x7eff1006d6e0 2023-09-13T06:02:35.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff15a87640 1 --2- 172.21.15.130:0/2112037514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff100d0d10 0x7eff100b66c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7eff000097c0 tx=0x7eff0001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902da288075ef2bf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:35.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff15286640 1 -- 172.21.15.130:0/2112037514 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff000ad660 con 0x7eff100d0d10 2023-09-13T06:02:35.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff15286640 1 -- 172.21.15.130:0/2112037514 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff000ad7c0 con 0x7eff100d0d10 2023-09-13T06:02:35.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff15286640 1 -- 172.21.15.130:0/2112037514 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff000adb50 con 0x7eff100d0d10 2023-09-13T06:02:35.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff184ec640 1 -- 172.21.15.130:0/2112037514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff100d0d10 msgr2=0x7eff100b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:35.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff184ec640 1 --2- 172.21.15.130:0/2112037514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff100d0d10 0x7eff100b66c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7eff000097c0 tx=0x7eff0001c450 comp rx=0 tx=0).stop 2023-09-13T06:02:35.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff184ec640 1 -- 172.21.15.130:0/2112037514 shutdown_connections 2023-09-13T06:02:35.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff184ec640 1 --2- 172.21.15.130:0/2112037514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff100d0d10 0x7eff100b66c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:35.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff184ec640 1 --2- 172.21.15.130:0/2112037514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff10144c20 0x7eff100b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:35.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff184ec640 1 -- 172.21.15.130:0/2112037514 >> 172.21.15.130:0/2112037514 conn(0x7eff1006a2f0 msgr2=0x7eff1006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:35.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff184ec640 1 -- 172.21.15.130:0/2112037514 shutdown_connections 2023-09-13T06:02:35.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.071+0000 7eff184ec640 1 -- 172.21.15.130:0/2112037514 wait complete. 2023-09-13T06:02:35.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff184ec640 1 Processor -- start 2023-09-13T06:02:35.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff184ec640 1 -- start start 2023-09-13T06:02:35.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff184ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff1006d6e0 0x7eff101f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:35.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff184ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff100d0d10 0x7eff1015cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:35.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff184ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff10144c20 0x7eff1015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:35.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff184ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff101629c0 con 0x7eff10144c20 2023-09-13T06:02:35.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff184ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff101f80e0 con 0x7eff100d0d10 2023-09-13T06:02:35.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff184ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff10161d40 con 0x7eff1006d6e0 2023-09-13T06:02:35.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff16a89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff10144c20 0x7eff1015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:35.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff16a89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff10144c20 0x7eff1015a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42792/0 (socket says 172.21.15.130:42792) 2023-09-13T06:02:35.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff16a89640 1 -- 172.21.15.130:0/4267374364 learned_addr learned my addr 172.21.15.130:0/4267374364 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:35.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff15a87640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff100d0d10 0x7eff1015cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:35.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff16288640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff1006d6e0 0x7eff101f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:35.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff16a89640 1 -- 172.21.15.130:0/4267374364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff1006d6e0 msgr2=0x7eff101f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:35.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff16a89640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff1006d6e0 0x7eff101f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:35.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff16a89640 1 -- 172.21.15.130:0/4267374364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff100d0d10 msgr2=0x7eff1015cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:35.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff16a89640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff100d0d10 0x7eff1015cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:35.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff16a89640 1 -- 172.21.15.130:0/4267374364 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00009420 con 0x7eff10144c20 2023-09-13T06:02:35.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff16a89640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff10144c20 0x7eff1015a530 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c780 tx=0x7eff0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:35.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff06ffd640 1 -- 172.21.15.130:0/4267374364 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800ce90 con 0x7eff10144c20 2023-09-13T06:02:35.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff06ffd640 1 -- 172.21.15.130:0/4267374364 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0800a640 con 0x7eff10144c20 2023-09-13T06:02:35.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff06ffd640 1 -- 172.21.15.130:0/4267374364 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800a9d0 con 0x7eff10144c20 2023-09-13T06:02:35.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff184ec640 1 -- 172.21.15.130:0/4267374364 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff10162080 con 0x7eff10144c20 2023-09-13T06:02:35.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff184ec640 1 -- 172.21.15.130:0/4267374364 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff101647d0 con 0x7eff10144c20 2023-09-13T06:02:35.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.075+0000 7eff184ec640 1 -- 172.21.15.130:0/4267374364 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff100618a0 con 0x7eff10144c20 2023-09-13T06:02:35.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.079+0000 7eff06ffd640 1 -- 172.21.15.130:0/4267374364 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7eff0800ab30 con 0x7eff10144c20 2023-09-13T06:02:35.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.079+0000 7eff06ffd640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efef4065b20 0x7efef4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:35.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.079+0000 7eff06ffd640 1 -- 172.21.15.130:0/4267374364 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff08082710 con 0x7eff10144c20 2023-09-13T06:02:35.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.079+0000 7eff16288640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efef4065b20 0x7efef4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:35.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.079+0000 7eff16288640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efef4065b20 0x7efef4067fe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009950 tx=0x7eff0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:35.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.083+0000 7eff06ffd640 1 -- 172.21.15.130:0/4267374364 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7eff080501a0 con 0x7eff10144c20 2023-09-13T06:02:35.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff184ec640 1 -- 172.21.15.130:0/4267374364 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff100b6da0 con 0x7eff10144c20 2023-09-13T06:02:35.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff06ffd640 1 -- 172.21.15.130:0/4267374364 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7eff08018020 con 0x7eff10144c20 2023-09-13T06:02:35.268 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:35.269 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3600813785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3600813785},{"type":"v1","addr":"172.21.15.164:6834","nonce":3600813785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3946401321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3946401321},{"type":"v1","addr":"172.21.15.164:6835","nonce":3946401321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5097,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/746143804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":746143804},{"type":"v1","addr":"172.21.15.130:6835","nonce":746143804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:18.135350+0000","modified":"2023-09-13T06:02:21.179925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1879815978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1879815978},{"type":"v1","addr":"172.21.15.130:6837","nonce":1879815978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-13T06:02:35.270 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 16 2023-09-13T06:02:35.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff184ec640 1 -- 172.21.15.130:0/4267374364 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efef4065b20 msgr2=0x7efef4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:35.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff184ec640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efef4065b20 0x7efef4067fe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009950 tx=0x7eff0c008040 comp rx=0 tx=0).stop 2023-09-13T06:02:35.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff184ec640 1 -- 172.21.15.130:0/4267374364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff10144c20 msgr2=0x7eff1015a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:35.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff184ec640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff10144c20 0x7eff1015a530 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c780 tx=0x7eff0800cc40 comp rx=0 tx=0).stop 2023-09-13T06:02:35.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff184ec640 1 -- 172.21.15.130:0/4267374364 shutdown_connections 2023-09-13T06:02:35.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff184ec640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efef4065b20 0x7efef4067fe0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff184ec640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff100d0d10 0x7eff1015cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff184ec640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff10144c20 0x7eff1015a530 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff184ec640 1 --2- 172.21.15.130:0/4267374364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff1006d6e0 0x7eff101f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.263+0000 7eff184ec640 1 -- 172.21.15.130:0/4267374364 >> 172.21.15.130:0/4267374364 conn(0x7eff1006a2f0 msgr2=0x7eff10072f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.267+0000 7eff184ec640 1 -- 172.21.15.130:0/4267374364 shutdown_connections 2023-09-13T06:02:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35.267+0000 7eff184ec640 1 -- 172.21.15.130:0/4267374364 wait complete. 2023-09-13T06:02:35.289 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 34 2023-09-13T06:02:35.448 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-09-13T06:02:35.448 DEBUG:teuthology.orchestra.run.smithi130:> stdin-killer -- python3 -c ' 2023-09-13T06:02:35.449 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-09-13T06:02:35.449 DEBUG:teuthology.orchestra.run.smithi130:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-13T06:02:35.449 DEBUG:teuthology.orchestra.run.smithi130:> os.fchmod(fd, 0O666) 2023-09-13T06:02:35.450 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(fd) 2023-09-13T06:02:35.450 DEBUG:teuthology.orchestra.run.smithi130:> os.close(fd) 2023-09-13T06:02:35.451 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-09-13T06:02:35.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-13T06:02:35.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:35.527 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:02:35.585 INFO:teuthology.orchestra.run.smithi130.stdout:client5325 2023-09-13T06:02:35.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:35.586 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client5325/osdmap') 2023-09-13T06:02:35.650 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 34 barrier 34 flags 0x588000 2023-09-13T06:02:35.651 INFO:teuthology.orchestra.run.smithi130.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:35.651 INFO:teuthology.orchestra.run.smithi130.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:35.651 INFO:teuthology.orchestra.run.smithi130.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:35.651 INFO:teuthology.orchestra.run.smithi130.stdout:osd0 (1)172.21.15.130:6801 100% (exists, up) 100% -1 2023-09-13T06:02:35.652 INFO:teuthology.orchestra.run.smithi130.stdout:osd1 (1)172.21.15.130:6817 100% (exists, up) 100% -1 2023-09-13T06:02:35.652 INFO:teuthology.orchestra.run.smithi130.stdout:osd2 (1)172.21.15.130:6809 100% (exists, up) 100% -1 2023-09-13T06:02:35.652 INFO:teuthology.orchestra.run.smithi130.stdout:osd3 (1)172.21.15.130:6812 100% (exists, up) 100% -1 2023-09-13T06:02:35.652 INFO:teuthology.orchestra.run.smithi130.stdout:osd4 (1)172.21.15.164:6801 100% (exists, up) 100% -1 2023-09-13T06:02:35.652 INFO:teuthology.orchestra.run.smithi130.stdout:osd5 (1)172.21.15.164:6809 100% (exists, up) 100% -1 2023-09-13T06:02:35.653 INFO:teuthology.orchestra.run.smithi130.stdout:osd6 (1)172.21.15.164:6817 100% (exists, up) 100% -1 2023-09-13T06:02:35.653 INFO:teuthology.orchestra.run.smithi130.stdout:osd7 (1)172.21.15.164:6825 100% (exists, up) 100% -1 2023-09-13T06:02:35.654 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records in 2023-09-13T06:02:35.655 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records out 2023-09-13T06:02:35.655 INFO:teuthology.orchestra.run.smithi130.stderr:799 bytes copied, 6.3506e-05 s, 12.6 MB/s 2023-09-13T06:02:35.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:35.656 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:02:35.712 INFO:teuthology.orchestra.run.smithi130.stdout:client5325 2023-09-13T06:02:35.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:35.713 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client5325/osdmap') 2023-09-13T06:02:35.774 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 34 barrier 34 flags 0x588000 2023-09-13T06:02:35.775 INFO:teuthology.orchestra.run.smithi130.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:35.775 INFO:teuthology.orchestra.run.smithi130.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:35.776 INFO:teuthology.orchestra.run.smithi130.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:02:35.776 INFO:teuthology.orchestra.run.smithi130.stdout:osd0 (1)172.21.15.130:6801 100% (exists, up) 100% -1 2023-09-13T06:02:35.776 INFO:teuthology.orchestra.run.smithi130.stdout:osd1 (1)172.21.15.130:6817 100% (exists, up) 100% -1 2023-09-13T06:02:35.776 INFO:teuthology.orchestra.run.smithi130.stdout:osd2 (1)172.21.15.130:6809 100% (exists, up) 100% -1 2023-09-13T06:02:35.777 INFO:teuthology.orchestra.run.smithi130.stdout:osd3 (1)172.21.15.130:6812 100% (exists, up) 100% -1 2023-09-13T06:02:35.777 INFO:teuthology.orchestra.run.smithi130.stdout:osd4 (1)172.21.15.164:6801 100% (exists, up) 100% -1 2023-09-13T06:02:35.778 INFO:teuthology.orchestra.run.smithi130.stdout:osd5 (1)172.21.15.164:6809 100% (exists, up) 100% -1 2023-09-13T06:02:35.778 INFO:teuthology.orchestra.run.smithi130.stdout:osd6 (1)172.21.15.164:6817 100% (exists, up) 100% -1 2023-09-13T06:02:35.778 INFO:teuthology.orchestra.run.smithi130.stdout:osd7 (1)172.21.15.164:6825 100% (exists, up) 100% -1 2023-09-13T06:02:35.780 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records in 2023-09-13T06:02:35.781 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records out 2023-09-13T06:02:35.781 INFO:teuthology.orchestra.run.smithi130.stderr:799 bytes copied, 6.6474e-05 s, 12.0 MB/s 2023-09-13T06:02:35.781 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-13T06:02:35.782 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:02:35.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:02:35.889 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:02:35.947 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:02:35.948 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:02:35.949 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:35.958 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:02:35.959 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:36.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:36.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.187+0000 7f26a1159640 1 Processor -- start 2023-09-13T06:02:36.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f26a1159640 1 -- start start 2023-09-13T06:02:36.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f26a1159640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f269c0d1090 0x7f269c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f26a1159640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269c146f30 0x7f269c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f26a1159640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c0b63c0 con 0x7f269c0d1750 2023-09-13T06:02:36.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f26a1159640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269c15dea0 con 0x7f269c0d1090 2023-09-13T06:02:36.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f26a1159640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0d0c20 con 0x7f269c146f30 2023-09-13T06:02:36.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f269259c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f269c0d1090 0x7f269c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f269b59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269c146f30 0x7f269c0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f269259c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f269c0d1090 0x7f269c15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:50012/0 (socket says 172.21.15.130:50012) 2023-09-13T06:02:36.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f269ad9d640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f269c0d1750 0x7f269c146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:46156/0 (socket says 172.21.15.130:46156) 2023-09-13T06:02:36.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f269259c640 1 -- 172.21.15.130:0/4107739303 learned_addr learned my addr 172.21.15.130:0/4107739303 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:36.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f269259c640 1 -- 172.21.15.130:0/4107739303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269c146f30 msgr2=0x7f269c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:36.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f269259c640 1 --2- 172.21.15.130:0/4107739303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269c146f30 0x7f269c0b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f269259c640 1 -- 172.21.15.130:0/4107739303 >> v1:172.21.15.164:6789/0 conn(0x7f269c0d1750 legacy=0x7f269c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.191+0000 7f269259c640 1 -- 172.21.15.130:0/4107739303 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c0b6610 con 0x7f269c0d1090 2023-09-13T06:02:36.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f269259c640 1 --2- 172.21.15.130:0/4107739303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f269c0d1090 0x7f269c15d960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2684009870 tx=0x7f268401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=662ddba700a9a454 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:36.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f269a59c640 1 -- 172.21.15.130:0/4107739303 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26840aa670 con 0x7f269c0d1090 2023-09-13T06:02:36.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f269a59c640 1 -- 172.21.15.130:0/4107739303 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26840aa7d0 con 0x7f269c0d1090 2023-09-13T06:02:36.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f269a59c640 1 -- 172.21.15.130:0/4107739303 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26840aab60 con 0x7f269c0d1090 2023-09-13T06:02:36.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f26a1159640 1 -- 172.21.15.130:0/4107739303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f269c0d1090 msgr2=0x7f269c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f26a1159640 1 --2- 172.21.15.130:0/4107739303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f269c0d1090 0x7f269c15d960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2684009870 tx=0x7f268401c510 comp rx=0 tx=0).stop 2023-09-13T06:02:36.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f26a1159640 1 -- 172.21.15.130:0/4107739303 shutdown_connections 2023-09-13T06:02:36.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f26a1159640 1 --2- 172.21.15.130:0/4107739303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269c146f30 0x7f269c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f26a1159640 1 --2- 172.21.15.130:0/4107739303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f269c0d1090 0x7f269c15d960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f26a1159640 1 -- 172.21.15.130:0/4107739303 >> 172.21.15.130:0/4107739303 conn(0x7f269c06f170 msgr2=0x7f269c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:36.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f26a1159640 1 -- 172.21.15.130:0/4107739303 shutdown_connections 2023-09-13T06:02:36.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.195+0000 7f26a1159640 1 -- 172.21.15.130:0/4107739303 wait complete. 2023-09-13T06:02:36.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f26a1159640 1 Processor -- start 2023-09-13T06:02:36.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f26a1159640 1 -- start start 2023-09-13T06:02:36.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f26a1159640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f269c0d1090 0x7f269c164110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f26a1159640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269c0d1750 0x7f269c13eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f26a1159640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f269c146f30 0x7f269c162090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f26a1159640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c15b870 con 0x7f269c0d1090 2023-09-13T06:02:36.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f26a1159640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c164650 con 0x7f269c146f30 2023-09-13T06:02:36.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f26a1159640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c15abf0 con 0x7f269c0d1750 2023-09-13T06:02:36.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f269ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f269c0d1090 0x7f269c164110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f269259c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269c0d1750 0x7f269c13eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f269ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f269c0d1090 0x7f269c164110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42796/0 (socket says 172.21.15.130:42796) 2023-09-13T06:02:36.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f269ad9d640 1 -- 172.21.15.130:0/1007711763 learned_addr learned my addr 172.21.15.130:0/1007711763 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:36.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f269b59e640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f269c146f30 0x7f269c162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f269ad9d640 1 -- 172.21.15.130:0/1007711763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269c0d1750 msgr2=0x7f269c13eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f269ad9d640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269c0d1750 0x7f269c13eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f269ad9d640 1 -- 172.21.15.130:0/1007711763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f269c146f30 msgr2=0x7f269c162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f269ad9d640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f269c146f30 0x7f269c162090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f269ad9d640 1 -- 172.21.15.130:0/1007711763 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26840094d0 con 0x7f269c0d1090 2023-09-13T06:02:36.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f269ad9d640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f269c0d1090 0x7f269c164110 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f268c00c490 tx=0x7f268c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:36.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f2693fff640 1 -- 172.21.15.130:0/1007711763 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c0074e0 con 0x7f269c0d1090 2023-09-13T06:02:36.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f2693fff640 1 -- 172.21.15.130:0/1007711763 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c007640 con 0x7f269c0d1090 2023-09-13T06:02:36.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f2693fff640 1 -- 172.21.15.130:0/1007711763 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c004a10 con 0x7f269c0d1090 2023-09-13T06:02:36.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f26a1159640 1 -- 172.21.15.130:0/1007711763 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c0b7e40 con 0x7f269c0d1090 2023-09-13T06:02:36.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.199+0000 7f26a1159640 1 -- 172.21.15.130:0/1007711763 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c15b1b0 con 0x7f269c0d1090 2023-09-13T06:02:36.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.203+0000 7f26a1159640 1 -- 172.21.15.130:0/1007711763 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269c0618a0 con 0x7f269c0d1090 2023-09-13T06:02:36.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.203+0000 7f2693fff640 1 -- 172.21.15.130:0/1007711763 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f268c004b70 con 0x7f269c0d1090 2023-09-13T06:02:36.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.203+0000 7f2693fff640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f267c065b20 0x7f267c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.203+0000 7f2693fff640 1 -- 172.21.15.130:0/1007711763 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f268c082bd0 con 0x7f269c0d1090 2023-09-13T06:02:36.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.203+0000 7f269259c640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f267c065b20 0x7f267c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.203+0000 7f269259c640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f267c065b20 0x7f267c067fe0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f26840ae000 tx=0x7f26840b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:36.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.207+0000 7f2693fff640 1 -- 172.21.15.130:0/1007711763 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f268c0505d0 con 0x7f269c0d1090 2023-09-13T06:02:36.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.355+0000 7f26a1159640 1 -- 172.21.15.130:0/1007711763 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f269c0b86c0 con 0x7f269c0d1090 2023-09-13T06:02:36.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.355+0000 7f2693fff640 1 -- 172.21.15.130:0/1007711763 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f268c053bf0 con 0x7f269c0d1090 2023-09-13T06:02:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:36.362 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:34.323976+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:15.867393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:17.140116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:36.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 -- 172.21.15.130:0/1007711763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f267c065b20 msgr2=0x7f267c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f267c065b20 0x7f267c067fe0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f26840ae000 tx=0x7f26840b5040 comp rx=0 tx=0).stop 2023-09-13T06:02:36.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 -- 172.21.15.130:0/1007711763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f269c0d1090 msgr2=0x7f269c164110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f269c0d1090 0x7f269c164110 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f268c00c490 tx=0x7f268c00c950 comp rx=0 tx=0).stop 2023-09-13T06:02:36.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 -- 172.21.15.130:0/1007711763 shutdown_connections 2023-09-13T06:02:36.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f267c065b20 0x7f267c067fe0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f269c146f30 0x7f269c162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269c0d1750 0x7f269c13eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 --2- 172.21.15.130:0/1007711763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f269c0d1090 0x7f269c164110 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 -- 172.21.15.130:0/1007711763 >> 172.21.15.130:0/1007711763 conn(0x7f269c06f170 msgr2=0x7f269c06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:36.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 -- 172.21.15.130:0/1007711763 shutdown_connections 2023-09-13T06:02:36.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.359+0000 7f26a1159640 1 -- 172.21.15.130:0/1007711763 wait complete. 2023-09-13T06:02:36.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:02:15.867393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:02:17.140116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:02:36.385 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:02:36.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb277f40640 1 Processor -- start 2023-09-13T06:02:36.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb277f40640 1 -- start start 2023-09-13T06:02:36.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb277f40640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb270144d70 0x7fb2700ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb277f40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 0x7fb2700b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb277f40640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2700b3120 con 0x7fb2700b2780 2023-09-13T06:02:36.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb277f40640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2700b2430 con 0x7fb270144d70 2023-09-13T06:02:36.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb277f40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2700cedb0 con 0x7fb2700b1b70 2023-09-13T06:02:36.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb2764dd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 0x7fb2700b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb275cdc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb270144d70 0x7fb2700ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb2754db640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fb2700b2780 0x7fb2700b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:46170/0 (socket says 172.21.15.130:46170) 2023-09-13T06:02:36.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb275cdc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb270144d70 0x7fb2700ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:50026/0 (socket says 172.21.15.130:50026) 2023-09-13T06:02:36.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb275cdc640 1 -- 172.21.15.130:0/3105881118 learned_addr learned my addr 172.21.15.130:0/3105881118 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:36.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb2764dd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 0x7fb2700b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:42182/0 (socket says 172.21.15.130:42182) 2023-09-13T06:02:36.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb275cdc640 1 -- 172.21.15.130:0/3105881118 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 msgr2=0x7fb2700b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:36.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb275cdc640 1 --2- 172.21.15.130:0/3105881118 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 0x7fb2700b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb275cdc640 1 -- 172.21.15.130:0/3105881118 >> v1:172.21.15.164:6789/0 conn(0x7fb2700b2780 legacy=0x7fb2700b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.523+0000 7fb275cdc640 1 -- 172.21.15.130:0/3105881118 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2700b2150 con 0x7fb270144d70 2023-09-13T06:02:36.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb275cdc640 1 --2- 172.21.15.130:0/3105881118 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb270144d70 0x7fb2700ce870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009870 tx=0x7fb26c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc4a33e406040df2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:36.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb274cda640 1 -- 172.21.15.130:0/3105881118 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0ab600 con 0x7fb270144d70 2023-09-13T06:02:36.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb274cda640 1 -- 172.21.15.130:0/3105881118 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c0a7050 con 0x7fb270144d70 2023-09-13T06:02:36.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb274cda640 1 -- 172.21.15.130:0/3105881118 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0ab980 con 0x7fb270144d70 2023-09-13T06:02:36.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb277f40640 1 -- 172.21.15.130:0/3105881118 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb270144d70 msgr2=0x7fb2700ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb277f40640 1 --2- 172.21.15.130:0/3105881118 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb270144d70 0x7fb2700ce870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009870 tx=0x7fb26c01c540 comp rx=0 tx=0).stop 2023-09-13T06:02:36.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb277f40640 1 -- 172.21.15.130:0/3105881118 shutdown_connections 2023-09-13T06:02:36.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb277f40640 1 --2- 172.21.15.130:0/3105881118 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 0x7fb2700b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb277f40640 1 --2- 172.21.15.130:0/3105881118 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb270144d70 0x7fb2700ce870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb277f40640 1 -- 172.21.15.130:0/3105881118 >> 172.21.15.130:0/3105881118 conn(0x7fb270065990 msgr2=0x7fb270065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:36.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb277f40640 1 -- 172.21.15.130:0/3105881118 shutdown_connections 2023-09-13T06:02:36.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.527+0000 7fb277f40640 1 -- 172.21.15.130:0/3105881118 wait complete. 2023-09-13T06:02:36.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb277f40640 1 Processor -- start 2023-09-13T06:02:36.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb277f40640 1 -- start start 2023-09-13T06:02:36.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb277f40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 0x7fb27015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb277f40640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2700b2780 0x7fb27015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb277f40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb270144d70 0x7fb270145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb277f40640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27015c400 con 0x7fb270144d70 2023-09-13T06:02:36.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb277f40640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27015dcb0 con 0x7fb2700b2780 2023-09-13T06:02:36.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb277f40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27006e130 con 0x7fb2700b1b70 2023-09-13T06:02:36.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2764dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb270144d70 0x7fb270145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb275cdc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 0x7fb27015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2764dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb270144d70 0x7fb270145390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42802/0 (socket says 172.21.15.130:42802) 2023-09-13T06:02:36.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2754db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2700b2780 0x7fb27015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2764dd640 1 -- 172.21.15.130:0/3099256492 learned_addr learned my addr 172.21.15.130:0/3099256492 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:36.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2764dd640 1 -- 172.21.15.130:0/3099256492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 msgr2=0x7fb27015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2764dd640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 0x7fb27015d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2764dd640 1 -- 172.21.15.130:0/3099256492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2700b2780 msgr2=0x7fb27015a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2764dd640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2700b2780 0x7fb27015a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2764dd640 1 -- 172.21.15.130:0/3099256492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0094d0 con 0x7fb270144d70 2023-09-13T06:02:36.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb275cdc640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 0x7fb27015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:36.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2764dd640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb270144d70 0x7fb270145390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb26800efc0 tx=0x7fb26800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:36.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2667fc640 1 -- 172.21.15.130:0/3099256492 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268014480 con 0x7fb270144d70 2023-09-13T06:02:36.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2667fc640 1 -- 172.21.15.130:0/3099256492 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26800f040 con 0x7fb270144d70 2023-09-13T06:02:36.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb277f40640 1 -- 172.21.15.130:0/3099256492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27006e410 con 0x7fb270144d70 2023-09-13T06:02:36.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb2667fc640 1 -- 172.21.15.130:0/3099256492 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268014820 con 0x7fb270144d70 2023-09-13T06:02:36.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.531+0000 7fb277f40640 1 -- 172.21.15.130:0/3099256492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27015af30 con 0x7fb270144d70 2023-09-13T06:02:36.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.535+0000 7fb277f40640 1 -- 172.21.15.130:0/3099256492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27015c570 con 0x7fb270144d70 2023-09-13T06:02:36.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.535+0000 7fb2667fc640 1 -- 172.21.15.130:0/3099256492 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb268014980 con 0x7fb270144d70 2023-09-13T06:02:36.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.535+0000 7fb2667fc640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb254065b20 0x7fb254067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.535+0000 7fb2667fc640 1 -- 172.21.15.130:0/3099256492 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb268084000 con 0x7fb270144d70 2023-09-13T06:02:36.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.535+0000 7fb275cdc640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb254065b20 0x7fb254067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.535+0000 7fb275cdc640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb254065b20 0x7fb254067fe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb270145150 tx=0x7fb26c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:36.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.539+0000 7fb2667fc640 1 -- 172.21.15.130:0/3099256492 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb268051a00 con 0x7fb270144d70 2023-09-13T06:02:36.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb277f40640 1 -- 172.21.15.130:0/3099256492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2700618a0 con 0x7fb270144d70 2023-09-13T06:02:36.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb2667fc640 1 -- 172.21.15.130:0/3099256492 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb268018020 con 0x7fb270144d70 2023-09-13T06:02:36.692 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:02:36.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb277f40640 1 -- 172.21.15.130:0/3099256492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb254065b20 msgr2=0x7fb254067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb277f40640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb254065b20 0x7fb254067fe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb270145150 tx=0x7fb26c0a6000 comp rx=0 tx=0).stop 2023-09-13T06:02:36.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb277f40640 1 -- 172.21.15.130:0/3099256492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb270144d70 msgr2=0x7fb270145390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb277f40640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb270144d70 0x7fb270145390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb26800efc0 tx=0x7fb26800c490 comp rx=0 tx=0).stop 2023-09-13T06:02:36.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb277f40640 1 -- 172.21.15.130:0/3099256492 shutdown_connections 2023-09-13T06:02:36.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb277f40640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb254065b20 0x7fb254067fe0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb277f40640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2700b2780 0x7fb27015a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb277f40640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb270144d70 0x7fb270145390 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb277f40640 1 --2- 172.21.15.130:0/3099256492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2700b1b70 0x7fb27015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.687+0000 7fb277f40640 1 -- 172.21.15.130:0/3099256492 >> 172.21.15.130:0/3099256492 conn(0x7fb270065990 msgr2=0x7fb270143d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:36.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.691+0000 7fb277f40640 1 -- 172.21.15.130:0/3099256492 shutdown_connections 2023-09-13T06:02:36.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.691+0000 7fb277f40640 1 -- 172.21.15.130:0/3099256492 wait complete. 2023-09-13T06:02:36.713 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:02:36.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.847+0000 7f1613a6d640 1 Processor -- start 2023-09-13T06:02:36.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1613a6d640 1 -- start start 2023-09-13T06:02:36.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1613a6d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f160c157b30 0x7f160c160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1613a6d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c06e010 con 0x7f160c06dba0 2023-09-13T06:02:36.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1613a6d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c161e60 con 0x7f160c157750 2023-09-13T06:02:36.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1613a6d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c0ae0d0 con 0x7f160c157b30 2023-09-13T06:02:36.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1611008640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f160c157b30 0x7f160c160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1611008640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f160c157b30 0x7f160c160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42812/0 (socket says 172.21.15.130:42812) 2023-09-13T06:02:36.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1611008640 1 -- 172.21.15.130:0/4135026127 learned_addr learned my addr 172.21.15.130:0/4135026127 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:36.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f161200a640 1 --1- 172.21.15.130:0/4135026127 >> v1:172.21.15.130:6789/0 conn(0x7f160c06dba0 0x7f160c15e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37810/0 (socket says 172.21.15.130:37810) 2023-09-13T06:02:36.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1611008640 1 -- 172.21.15.130:0/4135026127 >> v1:172.21.15.164:6789/0 conn(0x7f160c157750 legacy=0x7f160c06f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1611008640 1 -- 172.21.15.130:0/4135026127 >> v1:172.21.15.130:6789/0 conn(0x7f160c06dba0 legacy=0x7f160c15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1611008640 1 -- 172.21.15.130:0/4135026127 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c1615c0 con 0x7f160c157b30 2023-09-13T06:02:36.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.851+0000 7f1610807640 1 -- 172.21.15.130:0/4135026127 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585611874 0 0) 0x7f160c06e010 con 0x7f160c06dba0 2023-09-13T06:02:36.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1611008640 1 --2- 172.21.15.130:0/4135026127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f160c157b30 0x7f160c160fe0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009870 tx=0x7f15fc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbb5c0da44693ce server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:36.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1610807640 1 -- 172.21.15.130:0/4135026127 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0aa670 con 0x7f160c157b30 2023-09-13T06:02:36.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1610807640 1 -- 172.21.15.130:0/4135026127 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc0aa7d0 con 0x7f160c157b30 2023-09-13T06:02:36.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1610807640 1 -- 172.21.15.130:0/4135026127 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0aab60 con 0x7f160c157b30 2023-09-13T06:02:36.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1613a6d640 1 -- 172.21.15.130:0/4135026127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f160c157b30 msgr2=0x7f160c160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1613a6d640 1 --2- 172.21.15.130:0/4135026127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f160c157b30 0x7f160c160fe0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009870 tx=0x7f15fc01c510 comp rx=0 tx=0).stop 2023-09-13T06:02:36.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1613a6d640 1 -- 172.21.15.130:0/4135026127 shutdown_connections 2023-09-13T06:02:36.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1613a6d640 1 --2- 172.21.15.130:0/4135026127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f160c157b30 0x7f160c160fe0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1613a6d640 1 -- 172.21.15.130:0/4135026127 >> 172.21.15.130:0/4135026127 conn(0x7f160c065d60 msgr2=0x7f160c0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:36.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1613a6d640 1 -- 172.21.15.130:0/4135026127 shutdown_connections 2023-09-13T06:02:36.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1613a6d640 1 -- 172.21.15.130:0/4135026127 wait complete. 2023-09-13T06:02:36.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1613a6d640 1 Processor -- start 2023-09-13T06:02:36.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.855+0000 7f1613a6d640 1 -- start start 2023-09-13T06:02:36.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1613a6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f160c06dba0 0x7f160c0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1613a6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f160c157750 0x7f160c155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1613a6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f160c157b30 0x7f160c14bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1613a6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c14ef40 con 0x7f160c157750 2023-09-13T06:02:36.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1613a6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c154790 con 0x7f160c157b30 2023-09-13T06:02:36.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1613a6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c153b80 con 0x7f160c06dba0 2023-09-13T06:02:36.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1611008640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f160c157750 0x7f160c155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1611008640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f160c157750 0x7f160c155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42816/0 (socket says 172.21.15.130:42816) 2023-09-13T06:02:36.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1611008640 1 -- 172.21.15.130:0/2001181628 learned_addr learned my addr 172.21.15.130:0/2001181628 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:36.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f161200a640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f160c157b30 0x7f160c14bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1611809640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f160c06dba0 0x7f160c0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1611008640 1 -- 172.21.15.130:0/2001181628 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f160c06dba0 msgr2=0x7f160c0cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1611008640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f160c06dba0 0x7f160c0cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1611008640 1 -- 172.21.15.130:0/2001181628 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f160c157b30 msgr2=0x7f160c14bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:36.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1611008640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f160c157b30 0x7f160c14bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:36.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1611008640 1 -- 172.21.15.130:0/2001181628 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc0094d0 con 0x7f160c157750 2023-09-13T06:02:36.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1611008640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f160c157750 0x7f160c155f60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f15fc019120 tx=0x7f15fc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:36.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f16027fc640 1 -- 172.21.15.130:0/2001181628 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0b3800 con 0x7f160c157750 2023-09-13T06:02:36.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f16027fc640 1 -- 172.21.15.130:0/2001181628 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc0b3980 con 0x7f160c157750 2023-09-13T06:02:36.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f16027fc640 1 -- 172.21.15.130:0/2001181628 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0b3d30 con 0x7f160c157750 2023-09-13T06:02:36.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1613a6d640 1 -- 172.21.15.130:0/2001181628 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c06fa00 con 0x7f160c157750 2023-09-13T06:02:36.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1613a6d640 1 -- 172.21.15.130:0/2001181628 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c154140 con 0x7f160c157750 2023-09-13T06:02:36.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.859+0000 7f1613a6d640 1 -- 172.21.15.130:0/2001181628 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c154900 con 0x7f160c157750 2023-09-13T06:02:36.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.863+0000 7f16027fc640 1 -- 172.21.15.130:0/2001181628 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f15fc0b2380 con 0x7f160c157750 2023-09-13T06:02:36.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.863+0000 7f16027fc640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f0065b20 0x7f15f0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:36.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.863+0000 7f16027fc640 1 -- 172.21.15.130:0/2001181628 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15fc11dc00 con 0x7f160c157750 2023-09-13T06:02:36.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.863+0000 7f1611809640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f0065b20 0x7f15f0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:36.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.863+0000 7f1611809640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f0065b20 0x7f15f0067fe0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1608007fd0 tx=0x7f1608009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:36.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:36.867+0000 7f16027fc640 1 -- 172.21.15.130:0/2001181628 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f15fc124080 con 0x7f160c157750 2023-09-13T06:02:37.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 -- 172.21.15.130:0/2001181628 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f160c0618a0 con 0x7f160c157750 2023-09-13T06:02:37.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f16027fc640 1 -- 172.21.15.130:0/2001181628 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15fc0eb690 con 0x7f160c157750 2023-09-13T06:02:37.019 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:02:37.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 -- 172.21.15.130:0/2001181628 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f0065b20 msgr2=0x7f15f0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f0065b20 0x7f15f0067fe0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1608007fd0 tx=0x7f1608009040 comp rx=0 tx=0).stop 2023-09-13T06:02:37.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 -- 172.21.15.130:0/2001181628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f160c157750 msgr2=0x7f160c155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f160c157750 0x7f160c155f60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f15fc019120 tx=0x7f15fc01ad50 comp rx=0 tx=0).stop 2023-09-13T06:02:37.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 -- 172.21.15.130:0/2001181628 shutdown_connections 2023-09-13T06:02:37.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f0065b20 0x7f15f0067fe0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f160c157b30 0x7f160c14bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f160c157750 0x7f160c155f60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 --2- 172.21.15.130:0/2001181628 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f160c06dba0 0x7f160c0cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 -- 172.21.15.130:0/2001181628 >> 172.21.15.130:0/2001181628 conn(0x7f160c065d60 msgr2=0x7f160c06fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:37.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 -- 172.21.15.130:0/2001181628 shutdown_connections 2023-09-13T06:02:37.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.015+0000 7f1613a6d640 1 -- 172.21.15.130:0/2001181628 wait complete. 2023-09-13T06:02:37.039 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:02:37.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.175+0000 7fda59f40640 1 Processor -- start 2023-09-13T06:02:37.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.175+0000 7fda59f40640 1 -- start start 2023-09-13T06:02:37.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda59f40640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fda540b1460 0x7fda540b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda59f40640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fda540b2fd0 0x7fda540ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda59f40640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda540cc850 con 0x7fda5415a080 2023-09-13T06:02:37.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda59f40640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda540b3420 con 0x7fda540b2fd0 2023-09-13T06:02:37.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda59f40640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda540b0330 con 0x7fda540b1460 2023-09-13T06:02:37.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda53fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fda540b2fd0 0x7fda540ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda53fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fda540b2fd0 0x7fda540ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42818/0 (socket says 172.21.15.130:42818) 2023-09-13T06:02:37.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda53fff640 1 -- 172.21.15.130:0/2146138178 learned_addr learned my addr 172.21.15.130:0/2146138178 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:37.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda52ffd640 1 --2- 172.21.15.130:0/2146138178 >> v2:172.21.15.164:3300/0 conn(0x7fda540b1460 0x7fda540b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda53fff640 1 -- 172.21.15.130:0/2146138178 >> v2:172.21.15.164:3300/0 conn(0x7fda540b1460 msgr2=0x7fda540b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:37.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda53fff640 1 --2- 172.21.15.130:0/2146138178 >> v2:172.21.15.164:3300/0 conn(0x7fda540b1460 0x7fda540b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda53fff640 1 -- 172.21.15.130:0/2146138178 >> v1:172.21.15.164:6789/0 conn(0x7fda5415a080 legacy=0x7fda5415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda53fff640 1 -- 172.21.15.130:0/2146138178 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda540cbcd0 con 0x7fda540b2fd0 2023-09-13T06:02:37.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda527fc640 1 -- 172.21.15.130:0/2146138178 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144583989 0 0) 0x7fda44001120 con 0x7fda5415a080 2023-09-13T06:02:37.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.179+0000 7fda53fff640 1 --2- 172.21.15.130:0/2146138178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda540b2fd0 0x7fda540ccfe0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fda540671e0 tx=0x7fda4c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b91d18c1663e33c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:37.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda527fc640 1 -- 172.21.15.130:0/2146138178 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0090d0 con 0x7fda540b2fd0 2023-09-13T06:02:37.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda527fc640 1 -- 172.21.15.130:0/2146138178 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c009230 con 0x7fda540b2fd0 2023-09-13T06:02:37.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda527fc640 1 -- 172.21.15.130:0/2146138178 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0a5900 con 0x7fda540b2fd0 2023-09-13T06:02:37.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 -- 172.21.15.130:0/2146138178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda540b2fd0 msgr2=0x7fda540ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 --2- 172.21.15.130:0/2146138178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda540b2fd0 0x7fda540ccfe0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fda540671e0 tx=0x7fda4c01c910 comp rx=0 tx=0).stop 2023-09-13T06:02:37.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 -- 172.21.15.130:0/2146138178 shutdown_connections 2023-09-13T06:02:37.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 --2- 172.21.15.130:0/2146138178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda540b2fd0 0x7fda540ccfe0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 --2- 172.21.15.130:0/2146138178 >> v2:172.21.15.164:3300/0 conn(0x7fda540b1460 0x7fda540b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 -- 172.21.15.130:0/2146138178 >> 172.21.15.130:0/2146138178 conn(0x7fda54065990 msgr2=0x7fda54065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:37.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 -- 172.21.15.130:0/2146138178 shutdown_connections 2023-09-13T06:02:37.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 -- 172.21.15.130:0/2146138178 wait complete. 2023-09-13T06:02:37.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 Processor -- start 2023-09-13T06:02:37.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 -- start start 2023-09-13T06:02:37.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda540b1460 0x7fda541358f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda540b2fd0 0x7fda54146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda5415a080 0x7fda540aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda54135e30 con 0x7fda540b1460 2023-09-13T06:02:37.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda54147790 con 0x7fda5415a080 2023-09-13T06:02:37.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda59f40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda54147a70 con 0x7fda540b2fd0 2023-09-13T06:02:37.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.183+0000 7fda537fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda540b1460 0x7fda541358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda537fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda540b1460 0x7fda541358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42822/0 (socket says 172.21.15.130:42822) 2023-09-13T06:02:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda537fe640 1 -- 172.21.15.130:0/2423804102 learned_addr learned my addr 172.21.15.130:0/2423804102 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda52ffd640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda540b2fd0 0x7fda54146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda53fff640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda5415a080 0x7fda540aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda537fe640 1 -- 172.21.15.130:0/2423804102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda540b2fd0 msgr2=0x7fda54146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda537fe640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda540b2fd0 0x7fda54146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda537fe640 1 -- 172.21.15.130:0/2423804102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda5415a080 msgr2=0x7fda540aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda537fe640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda5415a080 0x7fda540aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda537fe640 1 -- 172.21.15.130:0/2423804102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c009b30 con 0x7fda540b1460 2023-09-13T06:02:37.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda537fe640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda540b1460 0x7fda541358f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fda4400c750 tx=0x7fda4400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:37.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda3bfff640 1 -- 172.21.15.130:0/2423804102 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44005270 con 0x7fda540b1460 2023-09-13T06:02:37.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda3bfff640 1 -- 172.21.15.130:0/2423804102 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda440053f0 con 0x7fda540b1460 2023-09-13T06:02:37.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda59f40640 1 -- 172.21.15.130:0/2423804102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda54147d50 con 0x7fda540b1460 2023-09-13T06:02:37.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda3bfff640 1 -- 172.21.15.130:0/2423804102 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4400a880 con 0x7fda540b1460 2023-09-13T06:02:37.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda59f40640 1 -- 172.21.15.130:0/2423804102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda54148030 con 0x7fda540b1460 2023-09-13T06:02:37.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda59f40640 1 -- 172.21.15.130:0/2423804102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda54167140 con 0x7fda540b1460 2023-09-13T06:02:37.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda3bfff640 1 -- 172.21.15.130:0/2423804102 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fda4400a9e0 con 0x7fda540b1460 2023-09-13T06:02:37.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda3bfff640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda40065b20 0x7fda40067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.187+0000 7fda3bfff640 1 -- 172.21.15.130:0/2423804102 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda440826b0 con 0x7fda540b1460 2023-09-13T06:02:37.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.191+0000 7fda52ffd640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda40065b20 0x7fda40067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.191+0000 7fda52ffd640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda40065b20 0x7fda40067fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda48009ac0 tx=0x7fda48009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:37.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.191+0000 7fda3bfff640 1 -- 172.21.15.130:0/2423804102 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fda54167140 con 0x7fda540b1460 2023-09-13T06:02:37.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.339+0000 7fda59f40640 1 -- 172.21.15.130:0/2423804102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda540cc850 con 0x7fda540b1460 2023-09-13T06:02:37.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.339+0000 7fda3bfff640 1 -- 172.21.15.130:0/2423804102 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda540cc850 con 0x7fda540b1460 2023-09-13T06:02:37.346 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:02:37.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 -- 172.21.15.130:0/2423804102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda40065b20 msgr2=0x7fda40067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda40065b20 0x7fda40067fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda48009ac0 tx=0x7fda48009190 comp rx=0 tx=0).stop 2023-09-13T06:02:37.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 -- 172.21.15.130:0/2423804102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda540b1460 msgr2=0x7fda541358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda540b1460 0x7fda541358f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fda4400c750 tx=0x7fda4400cc10 comp rx=0 tx=0).stop 2023-09-13T06:02:37.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 -- 172.21.15.130:0/2423804102 shutdown_connections 2023-09-13T06:02:37.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda40065b20 0x7fda40067fe0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda5415a080 0x7fda540aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda540b2fd0 0x7fda54146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 --2- 172.21.15.130:0/2423804102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda540b1460 0x7fda541358f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 -- 172.21.15.130:0/2423804102 >> 172.21.15.130:0/2423804102 conn(0x7fda54065990 msgr2=0x7fda54065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:37.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 -- 172.21.15.130:0/2423804102 shutdown_connections 2023-09-13T06:02:37.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.343+0000 7fda59f40640 1 -- 172.21.15.130:0/2423804102 wait complete. 2023-09-13T06:02:37.367 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:02:37.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.503+0000 7fc6477c6640 1 Processor -- start 2023-09-13T06:02:37.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.503+0000 7fc6477c6640 1 -- start start 2023-09-13T06:02:37.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.503+0000 7fc6477c6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc640157920 0x7fc6400ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.503+0000 7fc6477c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6400b1d20 0x7fc64006b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.503+0000 7fc6477c6640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6400afee0 con 0x7fc6400b0f40 2023-09-13T06:02:37.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.503+0000 7fc6477c6640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6400aea50 con 0x7fc640157920 2023-09-13T06:02:37.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.503+0000 7fc6477c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400b0b20 con 0x7fc6400b1d20 2023-09-13T06:02:37.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.503+0000 7fc645562640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc640157920 0x7fc6400ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.503+0000 7fc645562640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc640157920 0x7fc6400ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42826/0 (socket says 172.21.15.130:42826) 2023-09-13T06:02:37.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.503+0000 7fc645562640 1 -- 172.21.15.130:0/242394515 learned_addr learned my addr 172.21.15.130:0/242394515 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:37.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc645d63640 1 --2- 172.21.15.130:0/242394515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6400b1d20 0x7fc64006b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc645562640 1 -- 172.21.15.130:0/242394515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6400b1d20 msgr2=0x7fc64006b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:37.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc645562640 1 --2- 172.21.15.130:0/242394515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6400b1d20 0x7fc64006b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc645562640 1 -- 172.21.15.130:0/242394515 >> v1:172.21.15.164:6789/0 conn(0x7fc6400b0f40 legacy=0x7fc6400b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc645562640 1 -- 172.21.15.130:0/242394515 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6400b0180 con 0x7fc640157920 2023-09-13T06:02:37.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc645562640 1 --2- 172.21.15.130:0/242394515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc640157920 0x7fc6400ae190 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009870 tx=0x7fc63c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981c87aa91aee50 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:37.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc637fff640 1 -- 172.21.15.130:0/242394515 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0aa670 con 0x7fc640157920 2023-09-13T06:02:37.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc637fff640 1 -- 172.21.15.130:0/242394515 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c0aa7d0 con 0x7fc640157920 2023-09-13T06:02:37.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc637fff640 1 -- 172.21.15.130:0/242394515 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0aab60 con 0x7fc640157920 2023-09-13T06:02:37.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc6477c6640 1 -- 172.21.15.130:0/242394515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc640157920 msgr2=0x7fc6400ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc6477c6640 1 --2- 172.21.15.130:0/242394515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc640157920 0x7fc6400ae190 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009870 tx=0x7fc63c01c510 comp rx=0 tx=0).stop 2023-09-13T06:02:37.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc6477c6640 1 -- 172.21.15.130:0/242394515 shutdown_connections 2023-09-13T06:02:37.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc6477c6640 1 --2- 172.21.15.130:0/242394515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6400b1d20 0x7fc64006b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.507+0000 7fc6477c6640 1 --2- 172.21.15.130:0/242394515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc640157920 0x7fc6400ae190 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc6477c6640 1 -- 172.21.15.130:0/242394515 >> 172.21.15.130:0/242394515 conn(0x7fc640065990 msgr2=0x7fc640065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:37.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc6477c6640 1 -- 172.21.15.130:0/242394515 shutdown_connections 2023-09-13T06:02:37.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc6477c6640 1 -- 172.21.15.130:0/242394515 wait complete. 2023-09-13T06:02:37.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc6477c6640 1 Processor -- start 2023-09-13T06:02:37.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc6477c6640 1 -- start start 2023-09-13T06:02:37.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc6477c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6400b0f40 0x7fc64013d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc6477c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6400b1d20 0x7fc6401530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc6477c6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc640157920 0x7fc64006fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc6477c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64013ddc0 con 0x7fc6400b0f40 2023-09-13T06:02:37.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc6477c6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64013e0a0 con 0x7fc640157920 2023-09-13T06:02:37.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc6477c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64013e380 con 0x7fc6400b1d20 2023-09-13T06:02:37.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc645562640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6400b0f40 0x7fc64013d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc645562640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6400b0f40 0x7fc64013d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42840/0 (socket says 172.21.15.130:42840) 2023-09-13T06:02:37.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc645562640 1 -- 172.21.15.130:0/417553562 learned_addr learned my addr 172.21.15.130:0/417553562 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:37.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc645d63640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc640157920 0x7fc64006fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc644d61640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6400b1d20 0x7fc6401530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc645562640 1 -- 172.21.15.130:0/417553562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6400b1d20 msgr2=0x7fc6401530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc645562640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6400b1d20 0x7fc6401530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc645562640 1 -- 172.21.15.130:0/417553562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc640157920 msgr2=0x7fc64006fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc645562640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc640157920 0x7fc64006fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc645562640 1 -- 172.21.15.130:0/417553562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0094d0 con 0x7fc6400b0f40 2023-09-13T06:02:37.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.511+0000 7fc645562640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6400b0f40 0x7fc64013d640 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0ac040 tx=0x7fc63c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:37.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.515+0000 7fc635ffb640 1 -- 172.21.15.130:0/417553562 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0b3800 con 0x7fc6400b0f40 2023-09-13T06:02:37.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.515+0000 7fc635ffb640 1 -- 172.21.15.130:0/417553562 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c0b3980 con 0x7fc6400b0f40 2023-09-13T06:02:37.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.515+0000 7fc6477c6640 1 -- 172.21.15.130:0/417553562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64013e660 con 0x7fc6400b0f40 2023-09-13T06:02:37.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.515+0000 7fc635ffb640 1 -- 172.21.15.130:0/417553562 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0b3d30 con 0x7fc6400b0f40 2023-09-13T06:02:37.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.515+0000 7fc6477c6640 1 -- 172.21.15.130:0/417553562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64013f3b0 con 0x7fc6400b0f40 2023-09-13T06:02:37.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.515+0000 7fc6477c6640 1 -- 172.21.15.130:0/417553562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6400618a0 con 0x7fc6400b0f40 2023-09-13T06:02:37.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.515+0000 7fc635ffb640 1 -- 172.21.15.130:0/417553562 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc63c0bd3f0 con 0x7fc6400b0f40 2023-09-13T06:02:37.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.515+0000 7fc635ffb640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc624065b20 0x7fc624067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:37.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.515+0000 7fc635ffb640 1 -- 172.21.15.130:0/417553562 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc63c11df80 con 0x7fc6400b0f40 2023-09-13T06:02:37.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.515+0000 7fc644d61640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc624065b20 0x7fc624067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:37.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.515+0000 7fc644d61640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc624065b20 0x7fc624067fe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6401f95c0 tx=0x7fc630009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:37.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.519+0000 7fc635ffb640 1 -- 172.21.15.130:0/417553562 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc63c0eb970 con 0x7fc6400b0f40 2023-09-13T06:02:37.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 -- 172.21.15.130:0/417553562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc640070da0 con 0x7fc6400b0f40 2023-09-13T06:02:37.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc635ffb640 1 -- 172.21.15.130:0/417553562 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc63c0c3080 con 0x7fc6400b0f40 2023-09-13T06:02:37.688 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:02:37.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 -- 172.21.15.130:0/417553562 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc624065b20 msgr2=0x7fc624067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc624065b20 0x7fc624067fe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6401f95c0 tx=0x7fc630009040 comp rx=0 tx=0).stop 2023-09-13T06:02:37.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 -- 172.21.15.130:0/417553562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6400b0f40 msgr2=0x7fc64013d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:37.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6400b0f40 0x7fc64013d640 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0ac040 tx=0x7fc63c01ad50 comp rx=0 tx=0).stop 2023-09-13T06:02:37.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 -- 172.21.15.130:0/417553562 shutdown_connections 2023-09-13T06:02:37.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc624065b20 0x7fc624067fe0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc640157920 0x7fc64006fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6400b1d20 0x7fc6401530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 --2- 172.21.15.130:0/417553562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6400b0f40 0x7fc64013d640 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:37.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 -- 172.21.15.130:0/417553562 >> 172.21.15.130:0/417553562 conn(0x7fc640065990 msgr2=0x7fc64015c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:37.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 -- 172.21.15.130:0/417553562 shutdown_connections 2023-09-13T06:02:37.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:37.683+0000 7fc6477c6640 1 -- 172.21.15.130:0/417553562 wait complete. 2023-09-13T06:02:37.708 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T06:02:37.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:37.709 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-13T06:02:37.798 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:02:37.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:37.799 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T06:02:37.809 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:02:37.809 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:37.819 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:02:37.820 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:37.873 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:38.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb43952c640 1 Processor -- start 2023-09-13T06:02:38.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb43952c640 1 -- start start 2023-09-13T06:02:38.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb43952c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb4340ce7b0 0x7fb4340cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb43952c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4340ccfd0 con 0x7fb4340b1d20 2023-09-13T06:02:38.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb43952c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4340ced90 con 0x7fb434159f20 2023-09-13T06:02:38.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb43952c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4340b00f0 con 0x7fb4340ce7b0 2023-09-13T06:02:38.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb42a7fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb4340b1d20 0x7fb4340ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37816/0 (socket says 172.21.15.130:37816) 2023-09-13T06:02:38.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb42a7fc640 1 -- 172.21.15.130:0/862138477 learned_addr learned my addr 172.21.15.130:0/862138477 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:38.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4337fe640 1 --2- 172.21.15.130:0/862138477 >> v2:172.21.15.164:3300/0 conn(0x7fb4340ce7b0 0x7fb4340cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272498162 0 0) 0x7fb4340ccfd0 con 0x7fb4340b1d20 2023-09-13T06:02:38.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb420005740 con 0x7fb4340b1d20 2023-09-13T06:02:38.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4160186438 0 0) 0x7fb420005740 con 0x7fb4340b1d20 2023-09-13T06:02:38.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 >> v2:172.21.15.164:3300/0 conn(0x7fb4340ce7b0 msgr2=0x7fb4340cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:38.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 --2- 172.21.15.130:0/862138477 >> v2:172.21.15.164:3300/0 conn(0x7fb4340ce7b0 0x7fb4340cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 >> v1:172.21.15.164:6789/0 conn(0x7fb434159f20 legacy=0x7fb4340b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4340cd200 con 0x7fb4340b1d20 2023-09-13T06:02:38.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fb424001680 con 0x7fb4340b1d20 2023-09-13T06:02:38.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 >> v1:172.21.15.130:6789/0 conn(0x7fb4340b1d20 legacy=0x7fb4340ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb420005c50 0x7fb420006070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4200069e0 0x7fb420006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4200074c0 0x7fb42000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42000e360 con 0x7fb420005c50 2023-09-13T06:02:38.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42000e4d0 con 0x7fb4200074c0 2023-09-13T06:02:38.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42000e690 con 0x7fb4200069e0 2023-09-13T06:02:38.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb432ffd640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb420005c50 0x7fb420006070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb4337fe640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4200074c0 0x7fb42000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb42a7fc640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4200069e0 0x7fb420006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb432ffd640 1 -- 172.21.15.130:0/862138477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4200069e0 msgr2=0x7fb420006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:38.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb432ffd640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4200069e0 0x7fb420006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb432ffd640 1 -- 172.21.15.130:0/862138477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4200074c0 msgr2=0x7fb42000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:38.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.007+0000 7fb432ffd640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4200074c0 0x7fb42000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb432ffd640 1 -- 172.21.15.130:0/862138477 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420005740 con 0x7fb420005c50 2023-09-13T06:02:38.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb4337fe640 1 -- 172.21.15.130:0/862138477 reap_dead start 2023-09-13T06:02:38.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb42a7fc640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4200069e0 0x7fb420006e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:38.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb432ffd640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb420005c50 0x7fb420006070 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb41c001780 tx=0x7fb41c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c644a89a7239fac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:38.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0052d0 con 0x7fb420005c50 2023-09-13T06:02:38.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c0a7050 con 0x7fb420005c50 2023-09-13T06:02:38.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb4327fc640 1 -- 172.21.15.130:0/862138477 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c003600 con 0x7fb420005c50 2023-09-13T06:02:38.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb43952c640 1 -- 172.21.15.130:0/862138477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb420005c50 msgr2=0x7fb420006070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb43952c640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb420005c50 0x7fb420006070 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb41c001780 tx=0x7fb41c01c3b0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb43952c640 1 -- 172.21.15.130:0/862138477 shutdown_connections 2023-09-13T06:02:38.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb43952c640 1 --2- 172.21.15.130:0/862138477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb420005c50 0x7fb420006070 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb43952c640 1 -- 172.21.15.130:0/862138477 >> 172.21.15.130:0/862138477 conn(0x7fb434065990 msgr2=0x7fb434065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:38.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb43952c640 1 -- 172.21.15.130:0/862138477 shutdown_connections 2023-09-13T06:02:38.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.011+0000 7fb43952c640 1 -- 172.21.15.130:0/862138477 wait complete. 2023-09-13T06:02:38.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb43952c640 1 Processor -- start 2023-09-13T06:02:38.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb43952c640 1 -- start start 2023-09-13T06:02:38.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb43952c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb420005c50 0x7fb434157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb43952c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb434156d20 0x7fb4341f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb43952c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb434153a70 0x7fb4341eb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb43952c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb434156890 con 0x7fb434153a70 2023-09-13T06:02:38.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb43952c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb434153ef0 con 0x7fb420005c50 2023-09-13T06:02:38.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb43952c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb434157d70 con 0x7fb434156d20 2023-09-13T06:02:38.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb434153a70 0x7fb4341eb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb434153a70 0x7fb4341eb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42860/0 (socket says 172.21.15.130:42860) 2023-09-13T06:02:38.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb4337fe640 1 -- 172.21.15.130:0/4154768663 learned_addr learned my addr 172.21.15.130:0/4154768663 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:38.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb42a7fc640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb434156d20 0x7fb4341f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb432ffd640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb420005c50 0x7fb434157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb4337fe640 1 -- 172.21.15.130:0/4154768663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb434156d20 msgr2=0x7fb4341f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb4337fe640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb434156d20 0x7fb4341f6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb4337fe640 1 -- 172.21.15.130:0/4154768663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb420005c50 msgr2=0x7fb434157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb4337fe640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb420005c50 0x7fb434157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb4337fe640 1 -- 172.21.15.130:0/4154768663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb434155f60 con 0x7fb434153a70 2023-09-13T06:02:38.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb4337fe640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb434153a70 0x7fb4341eb8e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb4340cc550 tx=0x7fb42c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:38.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb42bfff640 1 -- 172.21.15.130:0/4154768663 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00e040 con 0x7fb434153a70 2023-09-13T06:02:38.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb42bfff640 1 -- 172.21.15.130:0/4154768663 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c00f040 con 0x7fb434153a70 2023-09-13T06:02:38.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb42bfff640 1 -- 172.21.15.130:0/4154768663 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c015430 con 0x7fb434153a70 2023-09-13T06:02:38.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.015+0000 7fb43952c640 1 -- 172.21.15.130:0/4154768663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb434156240 con 0x7fb434153a70 2023-09-13T06:02:38.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.019+0000 7fb43952c640 1 -- 172.21.15.130:0/4154768663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4341ebe20 con 0x7fb434153a70 2023-09-13T06:02:38.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.019+0000 7fb43952c640 1 -- 172.21.15.130:0/4154768663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4340618a0 con 0x7fb434153a70 2023-09-13T06:02:38.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.019+0000 7fb42bfff640 1 -- 172.21.15.130:0/4154768663 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb42c015590 con 0x7fb434153a70 2023-09-13T06:02:38.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.019+0000 7fb42bfff640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb414065b20 0x7fb414067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.019+0000 7fb42bfff640 1 -- 172.21.15.130:0/4154768663 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb42c083d50 con 0x7fb434153a70 2023-09-13T06:02:38.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.019+0000 7fb432ffd640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb414065b20 0x7fb414067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.019+0000 7fb432ffd640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb414065b20 0x7fb414067fe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb41c001750 tx=0x7fb41c0011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:38.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.023+0000 7fb42bfff640 1 -- 172.21.15.130:0/4154768663 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb42c051690 con 0x7fb434153a70 2023-09-13T06:02:38.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.171+0000 7fb43952c640 1 -- 172.21.15.130:0/4154768663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb434159310 con 0x7fb434153a70 2023-09-13T06:02:38.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb42bfff640 1 -- 172.21.15.130:0/4154768663 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fb42c054cb0 con 0x7fb434153a70 2023-09-13T06:02:38.179 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:38.179 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:34.323976+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:15.867393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:17.140116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:38.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 -- 172.21.15.130:0/4154768663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb414065b20 msgr2=0x7fb414067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb414065b20 0x7fb414067fe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb41c001750 tx=0x7fb41c0011a0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 -- 172.21.15.130:0/4154768663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb434153a70 msgr2=0x7fb4341eb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb434153a70 0x7fb4341eb8e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb4340cc550 tx=0x7fb42c00f1b0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 -- 172.21.15.130:0/4154768663 shutdown_connections 2023-09-13T06:02:38.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb414065b20 0x7fb414067fe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb434153a70 0x7fb4341eb8e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb434156d20 0x7fb4341f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 --2- 172.21.15.130:0/4154768663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb420005c50 0x7fb434157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 -- 172.21.15.130:0/4154768663 >> 172.21.15.130:0/4154768663 conn(0x7fb434065990 msgr2=0x7fb43406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:38.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 -- 172.21.15.130:0/4154768663 shutdown_connections 2023-09-13T06:02:38.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.175+0000 7fb43952c640 1 -- 172.21.15.130:0/4154768663 wait complete. 2023-09-13T06:02:38.200 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:02:15.867393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:02:17.140116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:02:38.200 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:02:38.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.335+0000 7f3074419640 1 Processor -- start 2023-09-13T06:02:38.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.335+0000 7f3074419640 1 -- start start 2023-09-13T06:02:38.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f3074419640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f306c0d2cd0 0x7f306c1612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f3074419640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c1617e0 0x7f306c0cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f3074419640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c15dd40 con 0x7f306c15ae10 2023-09-13T06:02:38.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f3074419640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c15e020 con 0x7f306c0d2cd0 2023-09-13T06:02:38.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f3074419640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c15e300 con 0x7f306c1617e0 2023-09-13T06:02:38.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30721b5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f306c15ae10 0x7f306c0d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37832/0 (socket says 172.21.15.130:37832) 2023-09-13T06:02:38.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30721b5640 1 -- 172.21.15.130:0/3067793933 learned_addr learned my addr 172.21.15.130:0/3067793933 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:38.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30719b4640 1 --2- 172.21.15.130:0/3067793933 >> v2:172.21.15.164:3300/0 conn(0x7f306c0d2cd0 0x7f306c1612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30729b6640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c1617e0 0x7f306c0cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434229987 0 0) 0x7f306c15dd40 con 0x7f306c15ae10 2023-09-13T06:02:38.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3058003530 con 0x7f306c15ae10 2023-09-13T06:02:38.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2575209125 0 0) 0x7f3058003530 con 0x7f306c15ae10 2023-09-13T06:02:38.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c1617e0 msgr2=0x7f306c0cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:38.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c1617e0 0x7f306c0cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 >> v2:172.21.15.164:3300/0 conn(0x7f306c0d2cd0 msgr2=0x7f306c1612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:38.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 --2- 172.21.15.130:0/3067793933 >> v2:172.21.15.164:3300/0 conn(0x7f306c0d2cd0 0x7f306c1612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c15e5e0 con 0x7f306c15ae10 2023-09-13T06:02:38.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f3068001680 con 0x7f306c15ae10 2023-09-13T06:02:38.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 >> v1:172.21.15.130:6789/0 conn(0x7f306c15ae10 legacy=0x7f306c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c1617e0 0x7f30580039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3058003f70 0x7f30580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3058004d10 0x7f3058005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c15e020 con 0x7f3058004d10 2023-09-13T06:02:38.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c15e300 con 0x7f3058003f70 2023-09-13T06:02:38.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305800ba40 con 0x7f306c1617e0 2023-09-13T06:02:38.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30719b4640 1 --2- 172.21.15.130:0/3067793933 >> v2:172.21.15.164:3300/0 conn(0x7f306c0d2cd0 0x7f306c1612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:38.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30729b6640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3058004d10 0x7f3058005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30721b5640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c1617e0 0x7f30580039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30719b4640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3058003f70 0x7f30580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30729b6640 1 -- 172.21.15.130:0/3067793933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c1617e0 msgr2=0x7f30580039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:38.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30729b6640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c1617e0 0x7f30580039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30729b6640 1 -- 172.21.15.130:0/3067793933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3058003f70 msgr2=0x7f30580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:38.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30729b6640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3058003f70 0x7f30580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.339+0000 7f30729b6640 1 -- 172.21.15.130:0/3067793933 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058003530 con 0x7f3058004d10 2023-09-13T06:02:38.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.343+0000 7f30729b6640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3058004d10 0x7f3058005190 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3064009fc0 tx=0x7f306401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ee6e8bb17eb176 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:38.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.343+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30640a5c70 con 0x7f3058004d10 2023-09-13T06:02:38.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.343+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306400f040 con 0x7f3058004d10 2023-09-13T06:02:38.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.343+0000 7f30711b3640 1 -- 172.21.15.130:0/3067793933 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30640ad440 con 0x7f3058004d10 2023-09-13T06:02:38.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.343+0000 7f3074419640 1 -- 172.21.15.130:0/3067793933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3058004d10 msgr2=0x7f3058005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.343+0000 7f3074419640 1 --2- 172.21.15.130:0/3067793933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3058004d10 0x7f3058005190 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3064009fc0 tx=0x7f306401cc60 comp rx=0 tx=0).stop 2023-09-13T06:02:38.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.343+0000 7f30729b6640 1 -- 172.21.15.130:0/3067793933 reap_dead start 2023-09-13T06:02:38.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.343+0000 7f3074419640 1 -- 172.21.15.130:0/3067793933 shutdown_connections 2023-09-13T06:02:38.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.343+0000 7f3074419640 1 -- 172.21.15.130:0/3067793933 >> 172.21.15.130:0/3067793933 conn(0x7f306c065990 msgr2=0x7f306c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:38.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.343+0000 7f3074419640 1 -- 172.21.15.130:0/3067793933 shutdown_connections 2023-09-13T06:02:38.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.343+0000 7f3074419640 1 -- 172.21.15.130:0/3067793933 wait complete. 2023-09-13T06:02:38.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3074419640 1 Processor -- start 2023-09-13T06:02:38.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3074419640 1 -- start start 2023-09-13T06:02:38.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3074419640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3058004d10 0x7f306c1574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3074419640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c0c9700 0x7f306c0d0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3074419640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c0c9b80 0x7f306c0d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3074419640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c1579f0 con 0x7f306c0c9b80 2023-09-13T06:02:38.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3074419640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0c86a0 con 0x7f3058004d10 2023-09-13T06:02:38.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3074419640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0c8940 con 0x7f306c0c9700 2023-09-13T06:02:38.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f30729b6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c0c9b80 0x7f306c0d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f30729b6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c0c9b80 0x7f306c0d0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42876/0 (socket says 172.21.15.130:42876) 2023-09-13T06:02:38.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f30729b6640 1 -- 172.21.15.130:0/1800350112 learned_addr learned my addr 172.21.15.130:0/1800350112 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:38.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f30719b4640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c0c9700 0x7f306c0d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f30721b5640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3058004d10 0x7f306c1574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f30729b6640 1 -- 172.21.15.130:0/1800350112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c0c9700 msgr2=0x7f306c0d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f30729b6640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c0c9700 0x7f306c0d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f30729b6640 1 -- 172.21.15.130:0/1800350112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3058004d10 msgr2=0x7f306c1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f30729b6640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3058004d10 0x7f306c1574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f30729b6640 1 -- 172.21.15.130:0/1800350112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c0c8c20 con 0x7f306c0c9b80 2023-09-13T06:02:38.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f30729b6640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c0c9b80 0x7f306c0d0c40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f30640b0040 tx=0x7f3064009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:38.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3062ffd640 1 -- 172.21.15.130:0/1800350112 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30640ba070 con 0x7f306c0c9b80 2023-09-13T06:02:38.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3062ffd640 1 -- 172.21.15.130:0/1800350112 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30640039a0 con 0x7f306c0c9b80 2023-09-13T06:02:38.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3062ffd640 1 -- 172.21.15.130:0/1800350112 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064003b30 con 0x7f306c0c9b80 2023-09-13T06:02:38.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3074419640 1 -- 172.21.15.130:0/1800350112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c0c8f00 con 0x7f306c0c9b80 2023-09-13T06:02:38.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.347+0000 7f3074419640 1 -- 172.21.15.130:0/1800350112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c0ccfa0 con 0x7f306c0c9b80 2023-09-13T06:02:38.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.351+0000 7f3074419640 1 -- 172.21.15.130:0/1800350112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c0618a0 con 0x7f306c0c9b80 2023-09-13T06:02:38.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.351+0000 7f3062ffd640 1 -- 172.21.15.130:0/1800350112 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f30640b4040 con 0x7f306c0c9b80 2023-09-13T06:02:38.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.351+0000 7f3062ffd640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3050065b50 0x7f3050068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.351+0000 7f3062ffd640 1 -- 172.21.15.130:0/1800350112 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f306411cbf0 con 0x7f306c0c9b80 2023-09-13T06:02:38.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.351+0000 7f30721b5640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3050065b50 0x7f3050068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.351+0000 7f30721b5640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3050065b50 0x7f3050068010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3068000c10 tx=0x7f3068007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:38.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.355+0000 7f3062ffd640 1 -- 172.21.15.130:0/1800350112 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f30640ea5e0 con 0x7f306c0c9b80 2023-09-13T06:02:38.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.503+0000 7f3074419640 1 -- 172.21.15.130:0/1800350112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f306c0c93b0 con 0x7f306c0c9b80 2023-09-13T06:02:38.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3062ffd640 1 -- 172.21.15.130:0/1800350112 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30640edc00 con 0x7f306c0c9b80 2023-09-13T06:02:38.510 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:02:38.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 -- 172.21.15.130:0/1800350112 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3050065b50 msgr2=0x7f3050068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3050065b50 0x7f3050068010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3068000c10 tx=0x7f3068007900 comp rx=0 tx=0).stop 2023-09-13T06:02:38.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 -- 172.21.15.130:0/1800350112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c0c9b80 msgr2=0x7f306c0d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c0c9b80 0x7f306c0d0c40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f30640b0040 tx=0x7f3064009750 comp rx=0 tx=0).stop 2023-09-13T06:02:38.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 -- 172.21.15.130:0/1800350112 shutdown_connections 2023-09-13T06:02:38.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3050065b50 0x7f3050068010 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c0c9b80 0x7f306c0d0c40 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306c0c9700 0x7f306c0d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 --2- 172.21.15.130:0/1800350112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3058004d10 0x7f306c1574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 -- 172.21.15.130:0/1800350112 >> 172.21.15.130:0/1800350112 conn(0x7f306c065990 msgr2=0x7f306c15b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:38.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 -- 172.21.15.130:0/1800350112 shutdown_connections 2023-09-13T06:02:38.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.507+0000 7f3074419640 1 -- 172.21.15.130:0/1800350112 wait complete. 2023-09-13T06:02:38.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:02:38.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f6563167640 1 Processor -- start 2023-09-13T06:02:38.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f6563167640 1 -- start start 2023-09-13T06:02:38.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f6563167640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f655c146c90 0x7f655c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f6563167640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f655c161060 0x7f655c0ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f6563167640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c15e350 con 0x7f655c0aed50 2023-09-13T06:02:38.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f6563167640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c15e630 con 0x7f655c161060 2023-09-13T06:02:38.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f6563167640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c15e910 con 0x7f655c146c90 2023-09-13T06:02:38.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f655bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f655c161060 0x7f655c0ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f655bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f655c161060 0x7f655c0ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42892/0 (socket says 172.21.15.130:42892) 2023-09-13T06:02:38.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f655bfff640 1 -- 172.21.15.130:0/3827370573 learned_addr learned my addr 172.21.15.130:0/3827370573 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:38.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f6560f03640 1 --2- 172.21.15.130:0/3827370573 >> v2:172.21.15.164:3300/0 conn(0x7f655c146c90 0x7f655c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f655bfff640 1 -- 172.21.15.130:0/3827370573 >> v2:172.21.15.164:3300/0 conn(0x7f655c146c90 msgr2=0x7f655c15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:38.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f655bfff640 1 --2- 172.21.15.130:0/3827370573 >> v2:172.21.15.164:3300/0 conn(0x7f655c146c90 0x7f655c15da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f655bfff640 1 -- 172.21.15.130:0/3827370573 >> v1:172.21.15.164:6789/0 conn(0x7f655c0aed50 legacy=0x7f655c0707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.671+0000 7f655bfff640 1 -- 172.21.15.130:0/3827370573 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c0ae010 con 0x7f655c161060 2023-09-13T06:02:38.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f655bfff640 1 --2- 172.21.15.130:0/3827370573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f655c161060 0x7f655c0ae810 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f655c0664a0 tx=0x7f654801cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152db233816634c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:38.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f655b7fe640 1 -- 172.21.15.130:0/3827370573 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65480aa650 con 0x7f655c161060 2023-09-13T06:02:38.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f655b7fe640 1 -- 172.21.15.130:0/3827370573 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65480aa7b0 con 0x7f655c161060 2023-09-13T06:02:38.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f655b7fe640 1 -- 172.21.15.130:0/3827370573 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65480aab40 con 0x7f655c161060 2023-09-13T06:02:38.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f6563167640 1 -- 172.21.15.130:0/3827370573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f655c161060 msgr2=0x7f655c0ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f6563167640 1 --2- 172.21.15.130:0/3827370573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f655c161060 0x7f655c0ae810 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f655c0664a0 tx=0x7f654801cf30 comp rx=0 tx=0).stop 2023-09-13T06:02:38.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f6563167640 1 -- 172.21.15.130:0/3827370573 shutdown_connections 2023-09-13T06:02:38.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f6563167640 1 --2- 172.21.15.130:0/3827370573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f655c161060 0x7f655c0ae810 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f6563167640 1 --2- 172.21.15.130:0/3827370573 >> v2:172.21.15.164:3300/0 conn(0x7f655c146c90 0x7f655c15da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f6563167640 1 -- 172.21.15.130:0/3827370573 >> 172.21.15.130:0/3827370573 conn(0x7f655c06a730 msgr2=0x7f655c065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:38.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f6563167640 1 -- 172.21.15.130:0/3827370573 shutdown_connections 2023-09-13T06:02:38.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.675+0000 7f6563167640 1 -- 172.21.15.130:0/3827370573 wait complete. 2023-09-13T06:02:38.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6563167640 1 Processor -- start 2023-09-13T06:02:38.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6563167640 1 -- start start 2023-09-13T06:02:38.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6563167640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f655c0aed50 0x7f655c13e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6563167640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f655c146c90 0x7f655c144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6563167640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f655c161060 0x7f655c15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6563167640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c13e910 con 0x7f655c161060 2023-09-13T06:02:38.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6563167640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c13ebf0 con 0x7f655c0aed50 2023-09-13T06:02:38.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6563167640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c13eed0 con 0x7f655c146c90 2023-09-13T06:02:38.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6561704640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f655c161060 0x7f655c15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6561704640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f655c161060 0x7f655c15c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42894/0 (socket says 172.21.15.130:42894) 2023-09-13T06:02:38.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6561704640 1 -- 172.21.15.130:0/3564383482 learned_addr learned my addr 172.21.15.130:0/3564383482 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:38.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6560f03640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f655c0aed50 0x7f655c13e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f655bfff640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f655c146c90 0x7f655c144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6561704640 1 -- 172.21.15.130:0/3564383482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f655c146c90 msgr2=0x7f655c144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6561704640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f655c146c90 0x7f655c144ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6561704640 1 -- 172.21.15.130:0/3564383482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f655c0aed50 msgr2=0x7f655c13e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6561704640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f655c0aed50 0x7f655c13e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6561704640 1 -- 172.21.15.130:0/3564383482 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65480094d0 con 0x7f655c161060 2023-09-13T06:02:38.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6561704640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f655c161060 0x7f655c15c920 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f655400c7a0 tx=0x7f655400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:38.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f65597fa640 1 -- 172.21.15.130:0/3564383482 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554003b80 con 0x7f655c161060 2023-09-13T06:02:38.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f65597fa640 1 -- 172.21.15.130:0/3564383482 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6554003ce0 con 0x7f655c161060 2023-09-13T06:02:38.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f65597fa640 1 -- 172.21.15.130:0/3564383482 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655400aa30 con 0x7f655c161060 2023-09-13T06:02:38.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6563167640 1 -- 172.21.15.130:0/3564383482 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c13f1b0 con 0x7f655c161060 2023-09-13T06:02:38.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6563167640 1 -- 172.21.15.130:0/3564383482 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c144ff0 con 0x7f655c161060 2023-09-13T06:02:38.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.679+0000 7f6563167640 1 -- 172.21.15.130:0/3564383482 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c145240 con 0x7f655c161060 2023-09-13T06:02:38.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.683+0000 7f65597fa640 1 -- 172.21.15.130:0/3564383482 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f655400ab90 con 0x7f655c161060 2023-09-13T06:02:38.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.683+0000 7f65597fa640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6540065b50 0x7f6540068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:38.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.683+0000 7f65597fa640 1 -- 172.21.15.130:0/3564383482 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6554082fb0 con 0x7f655c161060 2023-09-13T06:02:38.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.683+0000 7f6560f03640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6540065b50 0x7f6540068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:38.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.683+0000 7f6560f03640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6540065b50 0x7f6540068010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6550007a60 tx=0x7f6550008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:38.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.687+0000 7f65597fa640 1 -- 172.21.15.130:0/3564383482 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f655c145240 con 0x7f655c161060 2023-09-13T06:02:38.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 -- 172.21.15.130:0/3564383482 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f655c145240 con 0x7f655c161060 2023-09-13T06:02:38.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f65597fa640 1 -- 172.21.15.130:0/3564383482 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f655c145240 con 0x7f655c161060 2023-09-13T06:02:38.839 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:02:38.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 -- 172.21.15.130:0/3564383482 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6540065b50 msgr2=0x7f6540068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6540065b50 0x7f6540068010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6550007a60 tx=0x7f6550008040 comp rx=0 tx=0).stop 2023-09-13T06:02:38.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 -- 172.21.15.130:0/3564383482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f655c161060 msgr2=0x7f655c15c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:38.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f655c161060 0x7f655c15c920 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f655400c7a0 tx=0x7f655400cc60 comp rx=0 tx=0).stop 2023-09-13T06:02:38.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 -- 172.21.15.130:0/3564383482 shutdown_connections 2023-09-13T06:02:38.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6540065b50 0x7f6540068010 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f655c161060 0x7f655c15c920 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f655c146c90 0x7f655c144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 --2- 172.21.15.130:0/3564383482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f655c0aed50 0x7f655c13e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:38.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 -- 172.21.15.130:0/3564383482 >> 172.21.15.130:0/3564383482 conn(0x7f655c06a730 msgr2=0x7f655c15f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:38.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 -- 172.21.15.130:0/3564383482 shutdown_connections 2023-09-13T06:02:38.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:38.835+0000 7f6563167640 1 -- 172.21.15.130:0/3564383482 wait complete. 2023-09-13T06:02:38.887 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:02:39.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7febab14d640 1 Processor -- start 2023-09-13T06:02:39.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7febab14d640 1 -- start start 2023-09-13T06:02:39.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7febab14d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feba415a080 0x7feba40b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7febab14d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7feba415e650 0x7feba40b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7febab14d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40cc850 con 0x7feba40b2fd0 2023-09-13T06:02:39.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7febab14d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba40b33f0 con 0x7feba415a080 2023-09-13T06:02:39.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7febab14d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba40b0330 con 0x7feba415e650 2023-09-13T06:02:39.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7feba8ee9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feba415a080 0x7feba40b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7feba8ee9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feba415a080 0x7feba40b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42896/0 (socket says 172.21.15.130:42896) 2023-09-13T06:02:39.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7feba96ea640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7feba40b2fd0 0x7feba40ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37848/0 (socket says 172.21.15.130:37848) 2023-09-13T06:02:39.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7feba8ee9640 1 -- 172.21.15.130:0/1889234271 learned_addr learned my addr 172.21.15.130:0/1889234271 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:39.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7feba3fff640 1 --2- 172.21.15.130:0/1889234271 >> v2:172.21.15.164:3300/0 conn(0x7feba415e650 0x7feba40b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7feba8ee9640 1 -- 172.21.15.130:0/1889234271 >> v2:172.21.15.164:3300/0 conn(0x7feba415e650 msgr2=0x7feba40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:39.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7feba8ee9640 1 --2- 172.21.15.130:0/1889234271 >> v2:172.21.15.164:3300/0 conn(0x7feba415e650 0x7feba40b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7feba8ee9640 1 -- 172.21.15.130:0/1889234271 >> v1:172.21.15.130:6789/0 conn(0x7feba40b2fd0 legacy=0x7feba40ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.031+0000 7feba8ee9640 1 -- 172.21.15.130:0/1889234271 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40cbcd0 con 0x7feba415a080 2023-09-13T06:02:39.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7feba8ee9640 1 --2- 172.21.15.130:0/1889234271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba415a080 0x7feba40b1460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7feba40671b0 tx=0x7feb9801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491a92ddbad71e1c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:39.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7feba37fe640 1 -- 172.21.15.130:0/1889234271 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980ad680 con 0x7feba415a080 2023-09-13T06:02:39.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7feba37fe640 1 -- 172.21.15.130:0/1889234271 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb980ad7e0 con 0x7feba415a080 2023-09-13T06:02:39.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7feba37fe640 1 -- 172.21.15.130:0/1889234271 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980adb70 con 0x7feba415a080 2023-09-13T06:02:39.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7febab14d640 1 -- 172.21.15.130:0/1889234271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba415a080 msgr2=0x7feba40b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7febab14d640 1 --2- 172.21.15.130:0/1889234271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba415a080 0x7feba40b1460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7feba40671b0 tx=0x7feb9801c410 comp rx=0 tx=0).stop 2023-09-13T06:02:39.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7febab14d640 1 -- 172.21.15.130:0/1889234271 shutdown_connections 2023-09-13T06:02:39.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7febab14d640 1 --2- 172.21.15.130:0/1889234271 >> v2:172.21.15.164:3300/0 conn(0x7feba415e650 0x7feba40b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7febab14d640 1 --2- 172.21.15.130:0/1889234271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba415a080 0x7feba40b1460 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7febab14d640 1 -- 172.21.15.130:0/1889234271 >> 172.21.15.130:0/1889234271 conn(0x7feba4065990 msgr2=0x7feba4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:39.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7febab14d640 1 -- 172.21.15.130:0/1889234271 shutdown_connections 2023-09-13T06:02:39.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.035+0000 7febab14d640 1 -- 172.21.15.130:0/1889234271 wait complete. 2023-09-13T06:02:39.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7febab14d640 1 Processor -- start 2023-09-13T06:02:39.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7febab14d640 1 -- start start 2023-09-13T06:02:39.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7febab14d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba40b2fd0 0x7feba4148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7febab14d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba415a080 0x7feba4158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7febab14d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feba415e650 0x7feba40b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7febab14d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba406e0b0 con 0x7feba40b2fd0 2023-09-13T06:02:39.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7febab14d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba406e390 con 0x7feba415e650 2023-09-13T06:02:39.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7febab14d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba406e670 con 0x7feba415a080 2023-09-13T06:02:39.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba8ee9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba40b2fd0 0x7feba4148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba8ee9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba40b2fd0 0x7feba4148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42906/0 (socket says 172.21.15.130:42906) 2023-09-13T06:02:39.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba8ee9640 1 -- 172.21.15.130:0/3809717069 learned_addr learned my addr 172.21.15.130:0/3809717069 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:39.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba96ea640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feba415e650 0x7feba40b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba3fff640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba415a080 0x7feba4158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba8ee9640 1 -- 172.21.15.130:0/3809717069 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba415a080 msgr2=0x7feba4158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba8ee9640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba415a080 0x7feba4158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba8ee9640 1 -- 172.21.15.130:0/3809717069 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feba415e650 msgr2=0x7feba40b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba8ee9640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feba415e650 0x7feba40b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba8ee9640 1 -- 172.21.15.130:0/3809717069 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb980094d0 con 0x7feba40b2fd0 2023-09-13T06:02:39.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba8ee9640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba40b2fd0 0x7feba4148560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feb98019020 tx=0x7feb9801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:39.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba17fa640 1 -- 172.21.15.130:0/3809717069 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980ade60 con 0x7feba40b2fd0 2023-09-13T06:02:39.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba17fa640 1 -- 172.21.15.130:0/3809717069 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb980b8420 con 0x7feba40b2fd0 2023-09-13T06:02:39.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7feba17fa640 1 -- 172.21.15.130:0/3809717069 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980b8790 con 0x7feba40b2fd0 2023-09-13T06:02:39.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7febab14d640 1 -- 172.21.15.130:0/3809717069 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba4148aa0 con 0x7feba40b2fd0 2023-09-13T06:02:39.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.039+0000 7febab14d640 1 -- 172.21.15.130:0/3809717069 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba4158940 con 0x7feba40b2fd0 2023-09-13T06:02:39.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.043+0000 7febab14d640 1 -- 172.21.15.130:0/3809717069 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba4158b30 con 0x7feba40b2fd0 2023-09-13T06:02:39.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.043+0000 7feba17fa640 1 -- 172.21.15.130:0/3809717069 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7feb980b4040 con 0x7feba40b2fd0 2023-09-13T06:02:39.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.043+0000 7feba17fa640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb88065b50 0x7feb88068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.043+0000 7feba17fa640 1 -- 172.21.15.130:0/3809717069 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb9811d7d0 con 0x7feba40b2fd0 2023-09-13T06:02:39.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.043+0000 7feba3fff640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb88065b50 0x7feb88068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.043+0000 7feba3fff640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb88065b50 0x7feb88068010 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feba415d810 tx=0x7feb90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:39.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.047+0000 7feba17fa640 1 -- 172.21.15.130:0/3809717069 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7feba4158b30 con 0x7feba40b2fd0 2023-09-13T06:02:39.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 -- 172.21.15.130:0/3809717069 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feba4158b30 con 0x7feba40b2fd0 2023-09-13T06:02:39.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7feba17fa640 1 -- 172.21.15.130:0/3809717069 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7feba4158b30 con 0x7feba40b2fd0 2023-09-13T06:02:39.199 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:02:39.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 -- 172.21.15.130:0/3809717069 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb88065b50 msgr2=0x7feb88068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb88065b50 0x7feb88068010 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feba415d810 tx=0x7feb90008040 comp rx=0 tx=0).stop 2023-09-13T06:02:39.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 -- 172.21.15.130:0/3809717069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba40b2fd0 msgr2=0x7feba4148560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba40b2fd0 0x7feba4148560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feb98019020 tx=0x7feb9801ac50 comp rx=0 tx=0).stop 2023-09-13T06:02:39.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 -- 172.21.15.130:0/3809717069 shutdown_connections 2023-09-13T06:02:39.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb88065b50 0x7feb88068010 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feba415e650 0x7feba40b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba415a080 0x7feba4158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 --2- 172.21.15.130:0/3809717069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba40b2fd0 0x7feba4148560 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 -- 172.21.15.130:0/3809717069 >> 172.21.15.130:0/3809717069 conn(0x7feba4065990 msgr2=0x7feba40b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:39.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 -- 172.21.15.130:0/3809717069 shutdown_connections 2023-09-13T06:02:39.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.195+0000 7febab14d640 1 -- 172.21.15.130:0/3809717069 wait complete. 2023-09-13T06:02:39.220 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:02:39.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd6476640 1 Processor -- start 2023-09-13T06:02:39.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd6476640 1 -- start start 2023-09-13T06:02:39.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd6476640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bd0146eb0 0x7f0bd00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd6476640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0bd0161100 0x7f0bd0161520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd6476640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd0071440 con 0x7f0bd00b4120 2023-09-13T06:02:39.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd6476640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd00706a0 con 0x7f0bd0161100 2023-09-13T06:02:39.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd6476640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0161a60 con 0x7f0bd0146eb0 2023-09-13T06:02:39.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd4c73640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0bd0161100 0x7f0bd0161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd4c73640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0bd0161100 0x7f0bd0161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42916/0 (socket says 172.21.15.130:42916) 2023-09-13T06:02:39.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd4c73640 1 -- 172.21.15.130:0/1236649156 learned_addr learned my addr 172.21.15.130:0/1236649156 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:39.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd5474640 1 --2- 172.21.15.130:0/1236649156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bd0146eb0 0x7f0bd00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd4c73640 1 -- 172.21.15.130:0/1236649156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bd0146eb0 msgr2=0x7f0bd00b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:39.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd4c73640 1 --2- 172.21.15.130:0/1236649156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bd0146eb0 0x7f0bd00b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd4c73640 1 -- 172.21.15.130:0/1236649156 >> v1:172.21.15.130:6789/0 conn(0x7f0bd00b4120 legacy=0x7f0bd00b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd4c73640 1 -- 172.21.15.130:0/1236649156 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd0147290 con 0x7f0bd0161100 2023-09-13T06:02:39.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.355+0000 7f0bd5474640 1 --2- 172.21.15.130:0/1236649156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bd0146eb0 0x7f0bd00b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:39.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bd4c73640 1 --2- 172.21.15.130:0/1236649156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bd0161100 0x7f0bd0161520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009870 tx=0x7f0bc001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69daaf2a80db169c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:39.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bc7fff640 1 -- 172.21.15.130:0/1236649156 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00ab620 con 0x7f0bd0161100 2023-09-13T06:02:39.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bc7fff640 1 -- 172.21.15.130:0/1236649156 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc00ab780 con 0x7f0bd0161100 2023-09-13T06:02:39.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bc7fff640 1 -- 172.21.15.130:0/1236649156 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00abb10 con 0x7f0bd0161100 2023-09-13T06:02:39.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bd6476640 1 -- 172.21.15.130:0/1236649156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bd0161100 msgr2=0x7f0bd0161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bd6476640 1 --2- 172.21.15.130:0/1236649156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bd0161100 0x7f0bd0161520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009870 tx=0x7f0bc001c510 comp rx=0 tx=0).stop 2023-09-13T06:02:39.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bd6476640 1 -- 172.21.15.130:0/1236649156 shutdown_connections 2023-09-13T06:02:39.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bd6476640 1 --2- 172.21.15.130:0/1236649156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bd0161100 0x7f0bd0161520 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bd6476640 1 --2- 172.21.15.130:0/1236649156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bd0146eb0 0x7f0bd00b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bd6476640 1 -- 172.21.15.130:0/1236649156 >> 172.21.15.130:0/1236649156 conn(0x7f0bd00cdd10 msgr2=0x7f0bd00ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:39.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bd6476640 1 -- 172.21.15.130:0/1236649156 shutdown_connections 2023-09-13T06:02:39.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.359+0000 7f0bd6476640 1 -- 172.21.15.130:0/1236649156 wait complete. 2023-09-13T06:02:39.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd6476640 1 Processor -- start 2023-09-13T06:02:39.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd6476640 1 -- start start 2023-09-13T06:02:39.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd6476640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bd00b4120 0x7f0bd00ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd6476640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bd0146eb0 0x7f0bd013ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd6476640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bd0161100 0x7f0bd013e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd6476640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00c8ad0 con 0x7f0bd0161100 2023-09-13T06:02:39.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd6476640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd015ef40 con 0x7f0bd0146eb0 2023-09-13T06:02:39.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd6476640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd013d230 con 0x7f0bd00b4120 2023-09-13T06:02:39.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd5c75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bd0161100 0x7f0bd013e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd5c75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bd0161100 0x7f0bd013e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42924/0 (socket says 172.21.15.130:42924) 2023-09-13T06:02:39.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd5c75640 1 -- 172.21.15.130:0/3591362872 learned_addr learned my addr 172.21.15.130:0/3591362872 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:39.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd5474640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bd00b4120 0x7f0bd00ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd4c73640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bd0146eb0 0x7f0bd013ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd5c75640 1 -- 172.21.15.130:0/3591362872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bd00b4120 msgr2=0x7f0bd00ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd5c75640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bd00b4120 0x7f0bd00ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd5c75640 1 -- 172.21.15.130:0/3591362872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bd0146eb0 msgr2=0x7f0bd013ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd5c75640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bd0146eb0 0x7f0bd013ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd5c75640 1 -- 172.21.15.130:0/3591362872 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc00094d0 con 0x7f0bd0161100 2023-09-13T06:02:39.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd5c75640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bd0161100 0x7f0bd013e0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800c7a0 tx=0x7f0bc800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:39.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bc5ffb640 1 -- 172.21.15.130:0/3591362872 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8003b80 con 0x7f0bd0161100 2023-09-13T06:02:39.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bc5ffb640 1 -- 172.21.15.130:0/3591362872 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc8003ce0 con 0x7f0bd0161100 2023-09-13T06:02:39.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd6476640 1 -- 172.21.15.130:0/3591362872 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd015ec60 con 0x7f0bd0161100 2023-09-13T06:02:39.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bc5ffb640 1 -- 172.21.15.130:0/3591362872 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800aa90 con 0x7f0bd0161100 2023-09-13T06:02:39.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.363+0000 7f0bd6476640 1 -- 172.21.15.130:0/3591362872 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd013d8a0 con 0x7f0bd0161100 2023-09-13T06:02:39.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.367+0000 7f0bd6476640 1 -- 172.21.15.130:0/3591362872 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd00618a0 con 0x7f0bd0161100 2023-09-13T06:02:39.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.367+0000 7f0bc5ffb640 1 -- 172.21.15.130:0/3591362872 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0bc800abf0 con 0x7f0bd0161100 2023-09-13T06:02:39.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.367+0000 7f0bc5ffb640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0bb4065b20 0x7f0bb4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.367+0000 7f0bc5ffb640 1 -- 172.21.15.130:0/3591362872 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bc8083120 con 0x7f0bd0161100 2023-09-13T06:02:39.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.367+0000 7f0bd5474640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0bb4065b20 0x7f0bb4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.367+0000 7f0bd5474640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0bb4065b20 0x7f0bb4067fe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00a9a0 tx=0x7f0bcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:39.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.371+0000 7f0bc5ffb640 1 -- 172.21.15.130:0/3591362872 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0bc8050a60 con 0x7f0bd0161100 2023-09-13T06:02:39.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.531+0000 7f0bd6476640 1 -- 172.21.15.130:0/3591362872 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0bd006f420 con 0x7f0bd0161100 2023-09-13T06:02:39.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.531+0000 7f0bc5ffb640 1 -- 172.21.15.130:0/3591362872 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0bc8054080 con 0x7f0bd0161100 2023-09-13T06:02:39.537 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:02:39.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 -- 172.21.15.130:0/3591362872 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0bb4065b20 msgr2=0x7f0bb4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0bb4065b20 0x7f0bb4067fe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00a9a0 tx=0x7f0bcc008040 comp rx=0 tx=0).stop 2023-09-13T06:02:39.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 -- 172.21.15.130:0/3591362872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bd0161100 msgr2=0x7f0bd013e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bd0161100 0x7f0bd013e0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800c7a0 tx=0x7f0bc800cc60 comp rx=0 tx=0).stop 2023-09-13T06:02:39.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 -- 172.21.15.130:0/3591362872 shutdown_connections 2023-09-13T06:02:39.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0bb4065b20 0x7f0bb4067fe0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bd0146eb0 0x7f0bd013ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bd0161100 0x7f0bd013e0a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 --2- 172.21.15.130:0/3591362872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bd00b4120 0x7f0bd00ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 -- 172.21.15.130:0/3591362872 >> 172.21.15.130:0/3591362872 conn(0x7f0bd00cdd10 msgr2=0x7f0bd00ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:39.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 -- 172.21.15.130:0/3591362872 shutdown_connections 2023-09-13T06:02:39.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.535+0000 7f0bd6476640 1 -- 172.21.15.130:0/3591362872 wait complete. 2023-09-13T06:02:39.557 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T06:02:39.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:39.558 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-13T06:02:39.624 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:02:39.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:02:39.625 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T06:02:39.635 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:02:39.636 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:39.647 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:02:39.648 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:02:39.648 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:39.692 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:02:39.693 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:39.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.823+0000 7fef61e9e640 1 Processor -- start 2023-09-13T06:02:39.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.823+0000 7fef61e9e640 1 -- start start 2023-09-13T06:02:39.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef61e9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c15d5f0 0x7fef5c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef61e9e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0cce60 con 0x7fef5c0ae170 2023-09-13T06:02:39.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef61e9e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0cd140 con 0x7fef5c15d9d0 2023-09-13T06:02:39.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef61e9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0cd420 con 0x7fef5c15d5f0 2023-09-13T06:02:39.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef53fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fef5c0ae170 0x7fef5c1591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37868/0 (socket says 172.21.15.130:37868) 2023-09-13T06:02:39.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef53fff640 1 -- 172.21.15.130:0/2133366484 learned_addr learned my addr 172.21.15.130:0/2133366484 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:39.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5b7fe640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c15d5f0 0x7fef5c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926698607 0 0) 0x7fef5c0cce60 con 0x7fef5c0ae170 2023-09-13T06:02:39.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef48003450 con 0x7fef5c0ae170 2023-09-13T06:02:39.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 168595254 0 0) 0x7fef48003450 con 0x7fef5c0ae170 2023-09-13T06:02:39.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c15d5f0 msgr2=0x7fef5c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:39.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c15d5f0 0x7fef5c0cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 >> v1:172.21.15.164:6789/0 conn(0x7fef5c15d9d0 legacy=0x7fef5c0cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0cd700 con 0x7fef5c0ae170 2023-09-13T06:02:39.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fef44001680 con 0x7fef5c0ae170 2023-09-13T06:02:39.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 >> v1:172.21.15.130:6789/0 conn(0x7fef5c0ae170 legacy=0x7fef5c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 0x7fef48003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008860 0x7fef4800ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c15d5f0 0x7fef4800d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0cd420 con 0x7fef48003b10 2023-09-13T06:02:39.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4800dca0 con 0x7fef48008860 2023-09-13T06:02:39.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4800de60 con 0x7fef5c15d5f0 2023-09-13T06:02:39.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5b7fe640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 0x7fef48003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef53fff640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008860 0x7fef4800ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5bfff640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c15d5f0 0x7fef4800d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5b7fe640 1 -- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c15d5f0 msgr2=0x7fef4800d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:39.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5b7fe640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c15d5f0 0x7fef4800d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5b7fe640 1 -- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008860 msgr2=0x7fef4800ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:39.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5b7fe640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008860 0x7fef4800ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef5b7fe640 1 -- 172.21.15.130:0/2133366484 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48003450 con 0x7fef48003b10 2023-09-13T06:02:39.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.827+0000 7fef53fff640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008860 0x7fef4800ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:39.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.831+0000 7fef5b7fe640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 0x7fef48003ef0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009ae0 tx=0x7fef4c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb003889ab1374b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:39.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.831+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0a5530 con 0x7fef48003b10 2023-09-13T06:02:39.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.831+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c0a5690 con 0x7fef48003b10 2023-09-13T06:02:39.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.831+0000 7fef5affd640 1 -- 172.21.15.130:0/2133366484 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0a5a40 con 0x7fef48003b10 2023-09-13T06:02:39.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.831+0000 7fef61e9e640 1 -- 172.21.15.130:0/2133366484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 msgr2=0x7fef48003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.831+0000 7fef61e9e640 1 --2- 172.21.15.130:0/2133366484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 0x7fef48003ef0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009ae0 tx=0x7fef4c01ca50 comp rx=0 tx=0).stop 2023-09-13T06:02:39.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.831+0000 7fef5bfff640 1 -- 172.21.15.130:0/2133366484 reap_dead start 2023-09-13T06:02:39.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.831+0000 7fef61e9e640 1 -- 172.21.15.130:0/2133366484 shutdown_connections 2023-09-13T06:02:39.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.831+0000 7fef61e9e640 1 -- 172.21.15.130:0/2133366484 >> 172.21.15.130:0/2133366484 conn(0x7fef5c065990 msgr2=0x7fef5c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:39.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.831+0000 7fef61e9e640 1 -- 172.21.15.130:0/2133366484 shutdown_connections 2023-09-13T06:02:39.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.831+0000 7fef61e9e640 1 -- 172.21.15.130:0/2133366484 wait complete. 2023-09-13T06:02:39.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef61e9e640 1 Processor -- start 2023-09-13T06:02:39.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef61e9e640 1 -- start start 2023-09-13T06:02:39.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef61e9e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 0x7fef5c1f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef61e9e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef5c147c70 0x7fef5c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef61e9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c0acdb0 0x7fef5c0af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef61e9e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0ad260 con 0x7fef48003b10 2023-09-13T06:02:39.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef61e9e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c1f7ac0 con 0x7fef5c147c70 2023-09-13T06:02:39.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef61e9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0afe10 con 0x7fef5c0acdb0 2023-09-13T06:02:39.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef5b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 0x7fef5c1f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef5b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 0x7fef5c1f7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42936/0 (socket says 172.21.15.130:42936) 2023-09-13T06:02:39.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef5b7fe640 1 -- 172.21.15.130:0/446575885 learned_addr learned my addr 172.21.15.130:0/446575885 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:39.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef5bfff640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c0acdb0 0x7fef5c0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef53fff640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef5c147c70 0x7fef5c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef5b7fe640 1 -- 172.21.15.130:0/446575885 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c0acdb0 msgr2=0x7fef5c0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef5b7fe640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c0acdb0 0x7fef5c0af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef5b7fe640 1 -- 172.21.15.130:0/446575885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef5c147c70 msgr2=0x7fef5c0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:39.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef5b7fe640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef5c147c70 0x7fef5c0ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:39.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef5b7fe640 1 -- 172.21.15.130:0/446575885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c153dc0 con 0x7fef48003b10 2023-09-13T06:02:39.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef5b7fe640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 0x7fef5c1f7580 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0b0040 tx=0x7fef48003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:39.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef58ff9640 1 -- 172.21.15.130:0/446575885 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c004020 con 0x7fef48003b10 2023-09-13T06:02:39.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef58ff9640 1 -- 172.21.15.130:0/446575885 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c0041a0 con 0x7fef48003b10 2023-09-13T06:02:39.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef58ff9640 1 -- 172.21.15.130:0/446575885 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c003620 con 0x7fef48003b10 2023-09-13T06:02:39.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef61e9e640 1 -- 172.21.15.130:0/446575885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c1540a0 con 0x7fef48003b10 2023-09-13T06:02:39.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.835+0000 7fef61e9e640 1 -- 172.21.15.130:0/446575885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c154660 con 0x7fef48003b10 2023-09-13T06:02:39.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.839+0000 7fef61e9e640 1 -- 172.21.15.130:0/446575885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c0ad1c0 con 0x7fef48003b10 2023-09-13T06:02:39.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.839+0000 7fef58ff9640 1 -- 172.21.15.130:0/446575885 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fef4c0b4040 con 0x7fef48003b10 2023-09-13T06:02:39.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.839+0000 7fef58ff9640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef3c065b20 0x7fef3c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:39.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.839+0000 7fef58ff9640 1 -- 172.21.15.130:0/446575885 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef4c11d400 con 0x7fef48003b10 2023-09-13T06:02:39.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.839+0000 7fef53fff640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef3c065b20 0x7fef3c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:39.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.839+0000 7fef53fff640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef3c065b20 0x7fef3c067fe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef44000fe0 tx=0x7fef44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:39.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:39.843+0000 7fef58ff9640 1 -- 172.21.15.130:0/446575885 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fef4c0ead60 con 0x7fef48003b10 2023-09-13T06:02:40.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.023+0000 7fef61e9e640 1 -- 172.21.15.130:0/446575885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef5c0618a0 con 0x7fef48003b10 2023-09-13T06:02:40.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef58ff9640 1 -- 172.21.15.130:0/446575885 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fef4c0ee380 con 0x7fef48003b10 2023-09-13T06:02:40.031 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:40.031 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3600813785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3600813785},{"type":"v1","addr":"172.21.15.164:6834","nonce":3600813785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3946401321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3946401321},{"type":"v1","addr":"172.21.15.164:6835","nonce":3946401321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5097,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/746143804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":746143804},{"type":"v1","addr":"172.21.15.130:6835","nonce":746143804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:18.135350+0000","modified":"2023-09-13T06:02:21.179925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1879815978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1879815978},{"type":"v1","addr":"172.21.15.130:6837","nonce":1879815978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-13T06:02:40.032 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 16 2023-09-13T06:02:40.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 -- 172.21.15.130:0/446575885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef3c065b20 msgr2=0x7fef3c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef3c065b20 0x7fef3c067fe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef44000fe0 tx=0x7fef44009040 comp rx=0 tx=0).stop 2023-09-13T06:02:40.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 -- 172.21.15.130:0/446575885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 msgr2=0x7fef5c1f7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 0x7fef5c1f7580 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0b0040 tx=0x7fef48003700 comp rx=0 tx=0).stop 2023-09-13T06:02:40.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 -- 172.21.15.130:0/446575885 shutdown_connections 2023-09-13T06:02:40.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef3c065b20 0x7fef3c067fe0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef5c147c70 0x7fef5c0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef5c0acdb0 0x7fef5c0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 --2- 172.21.15.130:0/446575885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef48003b10 0x7fef5c1f7580 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 -- 172.21.15.130:0/446575885 >> 172.21.15.130:0/446575885 conn(0x7fef5c065990 msgr2=0x7fef5c148410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:40.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 -- 172.21.15.130:0/446575885 shutdown_connections 2023-09-13T06:02:40.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.027+0000 7fef61e9e640 1 -- 172.21.15.130:0/446575885 wait complete. 2023-09-13T06:02:40.052 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:40.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.183+0000 7f3cd826d640 1 Processor -- start 2023-09-13T06:02:40.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.183+0000 7f3cd826d640 1 -- start start 2023-09-13T06:02:40.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd826d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00cc780 0x7f3cd015b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd826d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3cd00b04a0 0x7f3cd00b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd826d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd00ccbe0 con 0x7f3cd015b130 2023-09-13T06:02:40.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd826d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd00b0e70 con 0x7f3cd00b04a0 2023-09-13T06:02:40.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd826d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00ce980 con 0x7f3cd00cc780 2023-09-13T06:02:40.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd5808640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00cc780 0x7f3cd015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd680a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3cd00b04a0 0x7f3cd00b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd5808640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00cc780 0x7f3cd015b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:42314/0 (socket says 172.21.15.130:42314) 2023-09-13T06:02:40.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd5808640 1 -- 172.21.15.130:0/2981636673 learned_addr learned my addr 172.21.15.130:0/2981636673 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:40.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd6009640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f3cd015b130 0x7f3cd00ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:46220/0 (socket says 172.21.15.130:46220) 2023-09-13T06:02:40.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd5007640 1 -- 172.21.15.130:0/2981636673 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229368939 0 0) 0x7f3cd00ccbe0 con 0x7f3cd015b130 2023-09-13T06:02:40.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd5007640 1 -- 172.21.15.130:0/2981636673 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cbc003530 con 0x7f3cd015b130 2023-09-13T06:02:40.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd5808640 1 -- 172.21.15.130:0/2981636673 >> v2:172.21.15.164:3300/0 conn(0x7f3cd00b04a0 msgr2=0x7f3cd00b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:40.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd5808640 1 --2- 172.21.15.130:0/2981636673 >> v2:172.21.15.164:3300/0 conn(0x7f3cd00b04a0 0x7f3cd00b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd5808640 1 -- 172.21.15.130:0/2981636673 >> v1:172.21.15.164:6789/0 conn(0x7f3cd015b130 legacy=0x7f3cd00ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd5808640 1 -- 172.21.15.130:0/2981636673 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00cec60 con 0x7f3cd00cc780 2023-09-13T06:02:40.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.187+0000 7f3cd680a640 1 --2- 172.21.15.130:0/2981636673 >> v2:172.21.15.164:3300/0 conn(0x7f3cd00b04a0 0x7f3cd00b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:40.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd5808640 1 --2- 172.21.15.130:0/2981636673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00cc780 0x7f3cd015b510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009870 tx=0x7f3cc001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5af1356db8487d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:40.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd5007640 1 -- 172.21.15.130:0/2981636673 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00aa670 con 0x7f3cd00cc780 2023-09-13T06:02:40.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd5007640 1 -- 172.21.15.130:0/2981636673 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc00aa7d0 con 0x7f3cd00cc780 2023-09-13T06:02:40.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd5007640 1 -- 172.21.15.130:0/2981636673 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00aab40 con 0x7f3cd00cc780 2023-09-13T06:02:40.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd826d640 1 -- 172.21.15.130:0/2981636673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00cc780 msgr2=0x7f3cd015b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd826d640 1 --2- 172.21.15.130:0/2981636673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00cc780 0x7f3cd015b510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009870 tx=0x7f3cc001c510 comp rx=0 tx=0).stop 2023-09-13T06:02:40.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd826d640 1 -- 172.21.15.130:0/2981636673 shutdown_connections 2023-09-13T06:02:40.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd826d640 1 --2- 172.21.15.130:0/2981636673 >> v2:172.21.15.164:3300/0 conn(0x7f3cd00b04a0 0x7f3cd00b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd826d640 1 --2- 172.21.15.130:0/2981636673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00cc780 0x7f3cd015b510 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd826d640 1 -- 172.21.15.130:0/2981636673 >> 172.21.15.130:0/2981636673 conn(0x7f3cd0065990 msgr2=0x7f3cd0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:40.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd826d640 1 -- 172.21.15.130:0/2981636673 shutdown_connections 2023-09-13T06:02:40.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.191+0000 7f3cd826d640 1 -- 172.21.15.130:0/2981636673 wait complete. 2023-09-13T06:02:40.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd826d640 1 Processor -- start 2023-09-13T06:02:40.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd826d640 1 -- start start 2023-09-13T06:02:40.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd826d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00b04a0 0x7f3cd0150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd826d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cd00cc780 0x7f3cd0154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd826d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3cd015b130 0x7f3cd01f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd826d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0151270 con 0x7f3cd00cc780 2023-09-13T06:02:40.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd826d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd015da20 con 0x7f3cd015b130 2023-09-13T06:02:40.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd826d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0151460 con 0x7f3cd00b04a0 2023-09-13T06:02:40.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd5808640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cd00cc780 0x7f3cd0154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd5808640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cd00cc780 0x7f3cd0154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42940/0 (socket says 172.21.15.130:42940) 2023-09-13T06:02:40.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd5808640 1 -- 172.21.15.130:0/1511562132 learned_addr learned my addr 172.21.15.130:0/1511562132 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:40.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd680a640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3cd015b130 0x7f3cd01f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd6009640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00b04a0 0x7f3cd0150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd5808640 1 -- 172.21.15.130:0/1511562132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00b04a0 msgr2=0x7f3cd0150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd5808640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00b04a0 0x7f3cd0150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd5808640 1 -- 172.21.15.130:0/1511562132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3cd015b130 msgr2=0x7f3cd01f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd5808640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3cd015b130 0x7f3cd01f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd5808640 1 -- 172.21.15.130:0/1511562132 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc8009a70 con 0x7f3cd00cc780 2023-09-13T06:02:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd5808640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cd00cc780 0x7f3cd0154be0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00ac040 tx=0x7f3cc00192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cc6ffd640 1 -- 172.21.15.130:0/1511562132 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00aad50 con 0x7f3cd00cc780 2023-09-13T06:02:40.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cc6ffd640 1 -- 172.21.15.130:0/1511562132 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc00aa5f0 con 0x7f3cd00cc780 2023-09-13T06:02:40.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd826d640 1 -- 172.21.15.130:0/1511562132 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc00094d0 con 0x7f3cd00cc780 2023-09-13T06:02:40.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cc6ffd640 1 -- 172.21.15.130:0/1511562132 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0003820 con 0x7f3cd00cc780 2023-09-13T06:02:40.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd826d640 1 -- 172.21.15.130:0/1511562132 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd0151a20 con 0x7f3cd00cc780 2023-09-13T06:02:40.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.195+0000 7f3cd826d640 1 -- 172.21.15.130:0/1511562132 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd00618a0 con 0x7f3cd00cc780 2023-09-13T06:02:40.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.199+0000 7f3cc6ffd640 1 -- 172.21.15.130:0/1511562132 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3cc0003980 con 0x7f3cd00cc780 2023-09-13T06:02:40.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.199+0000 7f3cc6ffd640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cb4065b20 0x7f3cb4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.199+0000 7f3cc6ffd640 1 -- 172.21.15.130:0/1511562132 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cc011dc20 con 0x7f3cd00cc780 2023-09-13T06:02:40.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.199+0000 7f3cd6009640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cb4065b20 0x7f3cb4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.199+0000 7f3cd6009640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cb4065b20 0x7f3cb4067fe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc007fd0 tx=0x7f3ccc007b20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:40.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.203+0000 7f3cc6ffd640 1 -- 172.21.15.130:0/1511562132 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3cc00eb610 con 0x7f3cd00cc780 2023-09-13T06:02:40.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.351+0000 7f3cd826d640 1 -- 172.21.15.130:0/1511562132 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cd0159990 con 0x7f3cd00cc780 2023-09-13T06:02:40.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.351+0000 7f3cc6ffd640 1 -- 172.21.15.130:0/1511562132 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f3cc00eec30 con 0x7f3cd00cc780 2023-09-13T06:02:40.357 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:40.357 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:34.323976+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:15.867393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:17.140116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:40.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 -- 172.21.15.130:0/1511562132 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cb4065b20 msgr2=0x7f3cb4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cb4065b20 0x7f3cb4067fe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc007fd0 tx=0x7f3ccc007b20 comp rx=0 tx=0).stop 2023-09-13T06:02:40.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 -- 172.21.15.130:0/1511562132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cd00cc780 msgr2=0x7f3cd0154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cd00cc780 0x7f3cd0154be0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00ac040 tx=0x7f3cc00192b0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 -- 172.21.15.130:0/1511562132 shutdown_connections 2023-09-13T06:02:40.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cb4065b20 0x7f3cb4067fe0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3cd015b130 0x7f3cd01f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cd00cc780 0x7f3cd0154be0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 --2- 172.21.15.130:0/1511562132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cd00b04a0 0x7f3cd0150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 -- 172.21.15.130:0/1511562132 >> 172.21.15.130:0/1511562132 conn(0x7f3cd0065990 msgr2=0x7f3cd0155f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:40.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 -- 172.21.15.130:0/1511562132 shutdown_connections 2023-09-13T06:02:40.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.355+0000 7f3cd826d640 1 -- 172.21.15.130:0/1511562132 wait complete. 2023-09-13T06:02:40.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:02:15.867393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:02:17.140116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:02:40.379 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:02:40.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3d1f1f640 1 Processor -- start 2023-09-13T06:02:40.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3d1f1f640 1 -- start start 2023-09-13T06:02:40.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3d1f1f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc3cc15ae10 0x7fc3cc0d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3d1f1f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3cc1619b0 0x7fc3cc0cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3d1f1f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc15dd40 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3d1f1f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc161e40 con 0x7fc3cc15ae10 2023-09-13T06:02:40.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3d1f1f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc15e020 con 0x7fc3cc1619b0 2023-09-13T06:02:40.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3cb7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc3cc15ae10 0x7fc3cc0d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3cb7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc3cc15ae10 0x7fc3cc0d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42950/0 (socket says 172.21.15.130:42950) 2023-09-13T06:02:40.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3cb7fe640 1 -- 172.21.15.130:0/1632329811 learned_addr learned my addr 172.21.15.130:0/1632329811 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:40.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3c3fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc3cc0d2b00 0x7fc3cc1612a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37870/0 (socket says 172.21.15.130:37870) 2023-09-13T06:02:40.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3cbfff640 1 --2- 172.21.15.130:0/1632329811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3cc1619b0 0x7fc3cc0cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3cb7fe640 1 -- 172.21.15.130:0/1632329811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3cc1619b0 msgr2=0x7fc3cc0cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:40.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3cb7fe640 1 --2- 172.21.15.130:0/1632329811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3cc1619b0 0x7fc3cc0cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3cb7fe640 1 -- 172.21.15.130:0/1632329811 >> v1:172.21.15.130:6789/0 conn(0x7fc3cc0d2b00 legacy=0x7fc3cc1612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3cb7fe640 1 -- 172.21.15.130:0/1632329811 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc15e300 con 0x7fc3cc15ae10 2023-09-13T06:02:40.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3caffd640 1 -- 172.21.15.130:0/1632329811 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096552975 0 0) 0x7fc3cc15dd40 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.515+0000 7fc3cbfff640 1 --2- 172.21.15.130:0/1632329811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3cc1619b0 0x7fc3cc0cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:40.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3cb7fe640 1 --2- 172.21.15.130:0/1632329811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3cc15ae10 0x7fc3cc0d25c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009870 tx=0x7fc3bc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307113a85dbf9d32 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:40.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3caffd640 1 -- 172.21.15.130:0/1632329811 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0ad680 con 0x7fc3cc15ae10 2023-09-13T06:02:40.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3caffd640 1 -- 172.21.15.130:0/1632329811 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc0ad7e0 con 0x7fc3cc15ae10 2023-09-13T06:02:40.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3caffd640 1 -- 172.21.15.130:0/1632329811 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0adb70 con 0x7fc3cc15ae10 2023-09-13T06:02:40.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/1632329811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3cc15ae10 msgr2=0x7fc3cc0d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3d1f1f640 1 --2- 172.21.15.130:0/1632329811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3cc15ae10 0x7fc3cc0d25c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009870 tx=0x7fc3bc01c3f0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/1632329811 shutdown_connections 2023-09-13T06:02:40.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3d1f1f640 1 --2- 172.21.15.130:0/1632329811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3cc1619b0 0x7fc3cc0cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3d1f1f640 1 --2- 172.21.15.130:0/1632329811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3cc15ae10 0x7fc3cc0d25c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/1632329811 >> 172.21.15.130:0/1632329811 conn(0x7fc3cc065990 msgr2=0x7fc3cc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:40.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/1632329811 shutdown_connections 2023-09-13T06:02:40.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.519+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/1632329811 wait complete. 2023-09-13T06:02:40.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3d1f1f640 1 Processor -- start 2023-09-13T06:02:40.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3d1f1f640 1 -- start start 2023-09-13T06:02:40.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3d1f1f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3cc0d2b00 0x7fc3cc13fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3d1f1f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3cc15ae10 0x7fc3cc15eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3d1f1f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3cc1619b0 0x7fc3cc0b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3d1f1f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1601d0 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3d1f1f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc15f5c0 con 0x7fc3cc1619b0 2023-09-13T06:02:40.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3d1f1f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc15f8a0 con 0x7fc3cc15ae10 2023-09-13T06:02:40.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3cb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3cc0d2b00 0x7fc3cc13fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3cb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3cc0d2b00 0x7fc3cc13fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42966/0 (socket says 172.21.15.130:42966) 2023-09-13T06:02:40.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3cb7fe640 1 -- 172.21.15.130:0/2080406554 learned_addr learned my addr 172.21.15.130:0/2080406554 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:40.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3c3fff640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3cc15ae10 0x7fc3cc15eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3cbfff640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3cc1619b0 0x7fc3cc0b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3cb7fe640 1 -- 172.21.15.130:0/2080406554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3cc15ae10 msgr2=0x7fc3cc15eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3cb7fe640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3cc15ae10 0x7fc3cc15eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3cb7fe640 1 -- 172.21.15.130:0/2080406554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3cc1619b0 msgr2=0x7fc3cc0b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3cb7fe640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3cc1619b0 0x7fc3cc0b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3cb7fe640 1 -- 172.21.15.130:0/2080406554 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc0094d0 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3cb7fe640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3cc0d2b00 0x7fc3cc13fdf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc01aaa0 tx=0x7fc3bc01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:40.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3c8ff9640 1 -- 172.21.15.130:0/2080406554 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0b8420 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3c8ff9640 1 -- 172.21.15.130:0/2080406554 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc0b85a0 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/2080406554 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc15fb80 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3c8ff9640 1 -- 172.21.15.130:0/2080406554 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0b8950 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.523+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/2080406554 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc0b7a90 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.527+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/2080406554 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3cc0618a0 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.527+0000 7fc3c8ff9640 1 -- 172.21.15.130:0/2080406554 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc3bc0b4040 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.527+0000 7fc3c8ff9640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc3ac065b20 0x7fc3ac067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.527+0000 7fc3c8ff9640 1 -- 172.21.15.130:0/2080406554 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3bc11d9f0 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.527+0000 7fc3c3fff640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc3ac065b20 0x7fc3ac067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.527+0000 7fc3c3fff640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc3ac065b20 0x7fc3ac067fe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc1f88d0 tx=0x7fc3b4007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:40.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.531+0000 7fc3c8ff9640 1 -- 172.21.15.130:0/2080406554 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc3bc0eb2c0 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.679+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/2080406554 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3cc065e80 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.679+0000 7fc3c8ff9640 1 -- 172.21.15.130:0/2080406554 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3bc0ee8e0 con 0x7fc3cc0d2b00 2023-09-13T06:02:40.686 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:02:40.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/2080406554 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc3ac065b20 msgr2=0x7fc3ac067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc3ac065b20 0x7fc3ac067fe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc1f88d0 tx=0x7fc3b4007d60 comp rx=0 tx=0).stop 2023-09-13T06:02:40.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/2080406554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3cc0d2b00 msgr2=0x7fc3cc13fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3cc0d2b00 0x7fc3cc13fdf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc01aaa0 tx=0x7fc3bc01ac30 comp rx=0 tx=0).stop 2023-09-13T06:02:40.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/2080406554 shutdown_connections 2023-09-13T06:02:40.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc3ac065b20 0x7fc3ac067fe0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3cc1619b0 0x7fc3cc0b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3cc15ae10 0x7fc3cc15eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 --2- 172.21.15.130:0/2080406554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3cc0d2b00 0x7fc3cc13fdf0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/2080406554 >> 172.21.15.130:0/2080406554 conn(0x7fc3cc065990 msgr2=0x7fc3cc160f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:40.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/2080406554 shutdown_connections 2023-09-13T06:02:40.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.683+0000 7fc3d1f1f640 1 -- 172.21.15.130:0/2080406554 wait complete. 2023-09-13T06:02:40.706 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:02:40.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d3a182640 1 Processor -- start 2023-09-13T06:02:40.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d3a182640 1 -- start start 2023-09-13T06:02:40.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d3a182640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0d340b1460 0x7f0d340b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d3a182640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d340cc850 con 0x7f0d3415a080 2023-09-13T06:02:40.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d3a182640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d340b3420 con 0x7f0d340b2fd0 2023-09-13T06:02:40.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d3a182640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d340b0330 con 0x7f0d340b1460 2023-09-13T06:02:40.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d32ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0d340b1460 0x7f0d340b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d32ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0d340b1460 0x7f0d340b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42974/0 (socket says 172.21.15.130:42974) 2023-09-13T06:02:40.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d32ffd640 1 -- 172.21.15.130:0/398143890 learned_addr learned my addr 172.21.15.130:0/398143890 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:40.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d337fe640 1 --1- 172.21.15.130:0/398143890 >> v1:172.21.15.130:6789/0 conn(0x7f0d3415a080 0x7f0d3415e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:37886/0 (socket says 172.21.15.130:37886) 2023-09-13T06:02:40.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d32ffd640 1 -- 172.21.15.130:0/398143890 >> v1:172.21.15.164:6789/0 conn(0x7f0d340b2fd0 legacy=0x7f0d340ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:40.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d32ffd640 1 -- 172.21.15.130:0/398143890 >> v1:172.21.15.130:6789/0 conn(0x7f0d3415a080 legacy=0x7f0d3415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.843+0000 7f0d32ffd640 1 -- 172.21.15.130:0/398143890 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d340cbcd0 con 0x7f0d340b1460 2023-09-13T06:02:40.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.847+0000 7f0d32ffd640 1 --2- 172.21.15.130:0/398143890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d340b1460 0x7f0d340b2a90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0d28009870 tx=0x7f0d2801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d5a92045520123 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:40.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.847+0000 7f0d327fc640 1 -- 172.21.15.130:0/398143890 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d280ac620 con 0x7f0d340b1460 2023-09-13T06:02:40.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.847+0000 7f0d327fc640 1 -- 172.21.15.130:0/398143890 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d280ac780 con 0x7f0d340b1460 2023-09-13T06:02:40.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.847+0000 7f0d327fc640 1 -- 172.21.15.130:0/398143890 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d280acb10 con 0x7f0d340b1460 2023-09-13T06:02:40.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.847+0000 7f0d3a182640 1 -- 172.21.15.130:0/398143890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d340b1460 msgr2=0x7f0d340b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.847+0000 7f0d3a182640 1 --2- 172.21.15.130:0/398143890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d340b1460 0x7f0d340b2a90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0d28009870 tx=0x7f0d2801c410 comp rx=0 tx=0).stop 2023-09-13T06:02:40.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.847+0000 7f0d3a182640 1 -- 172.21.15.130:0/398143890 shutdown_connections 2023-09-13T06:02:40.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.847+0000 7f0d3a182640 1 --2- 172.21.15.130:0/398143890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d340b1460 0x7f0d340b2a90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.847+0000 7f0d3a182640 1 -- 172.21.15.130:0/398143890 >> 172.21.15.130:0/398143890 conn(0x7f0d34065990 msgr2=0x7f0d34065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:40.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.847+0000 7f0d3a182640 1 -- 172.21.15.130:0/398143890 shutdown_connections 2023-09-13T06:02:40.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.847+0000 7f0d3a182640 1 -- 172.21.15.130:0/398143890 wait complete. 2023-09-13T06:02:40.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d3a182640 1 Processor -- start 2023-09-13T06:02:40.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d3a182640 1 -- start start 2023-09-13T06:02:40.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d3a182640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d340b1460 0x7f0d341422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d3a182640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d340b2fd0 0x7f0d340ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d3a182640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d3415a080 0x7f0d340ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d3a182640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340af790 con 0x7f0d340b1460 2023-09-13T06:02:40.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d3a182640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3415bab0 con 0x7f0d3415a080 2023-09-13T06:02:40.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d3a182640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340aeb80 con 0x7f0d340b2fd0 2023-09-13T06:02:40.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d340b1460 0x7f0d341422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d340b1460 0x7f0d341422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:42986/0 (socket says 172.21.15.130:42986) 2023-09-13T06:02:40.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d337fe640 1 -- 172.21.15.130:0/3136538779 learned_addr learned my addr 172.21.15.130:0/3136538779 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:40.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d33fff640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d3415a080 0x7f0d340ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d32ffd640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d340b2fd0 0x7f0d340ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d337fe640 1 -- 172.21.15.130:0/3136538779 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d340b2fd0 msgr2=0x7f0d340ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d337fe640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d340b2fd0 0x7f0d340ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d337fe640 1 -- 172.21.15.130:0/3136538779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d3415a080 msgr2=0x7f0d340ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:40.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d337fe640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d3415a080 0x7f0d340ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:40.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d337fe640 1 -- 172.21.15.130:0/3136538779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d280094d0 con 0x7f0d340b1460 2023-09-13T06:02:40.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d337fe640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d340b1460 0x7f0d341422d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c430 tx=0x7f0d2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:40.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d1bfff640 1 -- 172.21.15.130:0/3136538779 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240074e0 con 0x7f0d340b1460 2023-09-13T06:02:40.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d1bfff640 1 -- 172.21.15.130:0/3136538779 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d24007640 con 0x7f0d340b1460 2023-09-13T06:02:40.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d3a182640 1 -- 172.21.15.130:0/3136538779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d340aee60 con 0x7f0d340b1460 2023-09-13T06:02:40.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d1bfff640 1 -- 172.21.15.130:0/3136538779 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24004a10 con 0x7f0d340b1460 2023-09-13T06:02:40.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d3a182640 1 -- 172.21.15.130:0/3136538779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d340af420 con 0x7f0d340b1460 2023-09-13T06:02:40.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.851+0000 7f0d3a182640 1 -- 172.21.15.130:0/3136538779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d340618a0 con 0x7f0d340b1460 2023-09-13T06:02:40.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.855+0000 7f0d1bfff640 1 -- 172.21.15.130:0/3136538779 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0d24004b70 con 0x7f0d340b1460 2023-09-13T06:02:40.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.855+0000 7f0d1bfff640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 0x7f0d20067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:40.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.855+0000 7f0d1bfff640 1 -- 172.21.15.130:0/3136538779 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d24082c40 con 0x7f0d340b1460 2023-09-13T06:02:40.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.855+0000 7f0d32ffd640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 0x7f0d20067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:40.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.855+0000 7f0d32ffd640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 0x7f0d20067fe0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d280ae000 tx=0x7f0d28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:40.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:40.859+0000 7f0d1bfff640 1 -- 172.21.15.130:0/3136538779 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0d240504f0 con 0x7f0d340b1460 2023-09-13T06:02:41.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.003+0000 7f0d3a182640 1 -- 172.21.15.130:0/3136538779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d340cc850 con 0x7f0d340b1460 2023-09-13T06:02:41.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d1bfff640 1 -- 172.21.15.130:0/3136538779 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d340cc850 con 0x7f0d340b1460 2023-09-13T06:02:41.011 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:02:41.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 -- 172.21.15.130:0/3136538779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 msgr2=0x7f0d20067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 0x7f0d20067fe0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d280ae000 tx=0x7f0d28008040 comp rx=0 tx=0).stop 2023-09-13T06:02:41.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 -- 172.21.15.130:0/3136538779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d340b1460 msgr2=0x7f0d341422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d340b1460 0x7f0d341422d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c430 tx=0x7f0d2400c8f0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 -- 172.21.15.130:0/3136538779 shutdown_connections 2023-09-13T06:02:41.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 0x7f0d20067fe0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d3415a080 0x7f0d340ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d340b2fd0 0x7f0d340ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 --2- 172.21.15.130:0/3136538779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d340b1460 0x7f0d341422d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 -- 172.21.15.130:0/3136538779 >> 172.21.15.130:0/3136538779 conn(0x7f0d34065990 msgr2=0x7f0d341531d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:41.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 -- 172.21.15.130:0/3136538779 shutdown_connections 2023-09-13T06:02:41.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.007+0000 7f0d3a182640 1 -- 172.21.15.130:0/3136538779 wait complete. 2023-09-13T06:02:41.031 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:02:41.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.167+0000 7f66fa248640 1 Processor -- start 2023-09-13T06:02:41.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.167+0000 7f66fa248640 1 -- start start 2023-09-13T06:02:41.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.167+0000 7f66fa248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40b3150 0x7f66f4165e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.167+0000 7f66fa248640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f40b2570 con 0x7f66f415b120 2023-09-13T06:02:41.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.167+0000 7f66fa248640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f415b9e0 con 0x7f66f406caa0 2023-09-13T06:02:41.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.167+0000 7f66fa248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f415c620 con 0x7f66f40b3150 2023-09-13T06:02:41.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.167+0000 7f66f37fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f66f415b120 0x7f66f40b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49572/0 (socket says 172.21.15.130:49572) 2023-09-13T06:02:41.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.167+0000 7f66f37fe640 1 -- 172.21.15.130:0/2770485861 learned_addr learned my addr 172.21.15.130:0/2770485861 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:41.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.167+0000 7f66f3fff640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40b3150 0x7f66f4165e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.167+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207059469 0 0) 0x7f66f40b2570 con 0x7f66f415b120 2023-09-13T06:02:41.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e0003530 con 0x7f66f415b120 2023-09-13T06:02:41.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406553809 0 0) 0x7f66f415b9e0 con 0x7f66f406caa0 2023-09-13T06:02:41.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f40b2570 con 0x7f66f406caa0 2023-09-13T06:02:41.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3529920756 0 0) 0x7f66e0003530 con 0x7f66f415b120 2023-09-13T06:02:41.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40b3150 msgr2=0x7f66f4165e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:41.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40b3150 0x7f66f4165e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 >> v1:172.21.15.164:6789/0 conn(0x7f66f406caa0 legacy=0x7f66f40b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f415bc80 con 0x7f66f415b120 2023-09-13T06:02:41.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f66e4001680 con 0x7f66f415b120 2023-09-13T06:02:41.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 >> v1:172.21.15.130:6789/0 conn(0x7f66f415b120 legacy=0x7f66f40b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66e0003bb0 0x7f66e0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40b3150 0x7f66e00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 0x7f66e0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f415c620 con 0x7f66e0004d10 2023-09-13T06:02:41.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e000baa0 con 0x7f66e0003bb0 2023-09-13T06:02:41.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e000bc60 con 0x7f66f40b3150 2023-09-13T06:02:41.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f3fff640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 0x7f66e0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f37fe640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66e0003bb0 0x7f66e0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66ebfff640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40b3150 0x7f66e00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f3fff640 1 -- 172.21.15.130:0/2770485861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40b3150 msgr2=0x7f66e00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:41.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f3fff640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40b3150 0x7f66e00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f3fff640 1 -- 172.21.15.130:0/2770485861 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66e0003bb0 msgr2=0x7f66e0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:41.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f3fff640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66e0003bb0 0x7f66e0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f3fff640 1 -- 172.21.15.130:0/2770485861 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e0003530 con 0x7f66e0004d10 2023-09-13T06:02:41.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.171+0000 7f66f3fff640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 0x7f66e0005190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009f90 tx=0x7f66ec01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17215adf4124fc7c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:41.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0a5c30 con 0x7f66e0004d10 2023-09-13T06:02:41.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec00f040 con 0x7f66e0004d10 2023-09-13T06:02:41.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66f2ffd640 1 -- 172.21.15.130:0/2770485861 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0ad440 con 0x7f66e0004d10 2023-09-13T06:02:41.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 -- 172.21.15.130:0/2770485861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 msgr2=0x7f66e0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 --2- 172.21.15.130:0/2770485861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 0x7f66e0005190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009f90 tx=0x7f66ec01cc20 comp rx=0 tx=0).stop 2023-09-13T06:02:41.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66f3fff640 1 -- 172.21.15.130:0/2770485861 reap_dead start 2023-09-13T06:02:41.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 -- 172.21.15.130:0/2770485861 shutdown_connections 2023-09-13T06:02:41.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 -- 172.21.15.130:0/2770485861 >> 172.21.15.130:0/2770485861 conn(0x7f66f4065990 msgr2=0x7f66f4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:41.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 -- 172.21.15.130:0/2770485861 shutdown_connections 2023-09-13T06:02:41.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 -- 172.21.15.130:0/2770485861 wait complete. 2023-09-13T06:02:41.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 Processor -- start 2023-09-13T06:02:41.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 -- start start 2023-09-13T06:02:41.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 0x7f66f41f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66f40ae190 0x7f66f40ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40aeaa0 0x7f66f40aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41f6d30 con 0x7f66e0004d10 2023-09-13T06:02:41.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f40b08e0 con 0x7f66f40ae190 2023-09-13T06:02:41.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.175+0000 7f66fa248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41f6490 con 0x7f66f40aeaa0 2023-09-13T06:02:41.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 0x7f66f41f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 0x7f66f41f5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36556/0 (socket says 172.21.15.130:36556) 2023-09-13T06:02:41.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f37fe640 1 -- 172.21.15.130:0/3468761089 learned_addr learned my addr 172.21.15.130:0/3468761089 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:41.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f37fe640 1 -- 172.21.15.130:0/3468761089 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40aeaa0 msgr2=0x7f66f40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f37fe640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40aeaa0 0x7f66f40aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f37fe640 1 -- 172.21.15.130:0/3468761089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66f40ae190 msgr2=0x7f66f40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f37fe640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66f40ae190 0x7f66f40ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f37fe640 1 -- 172.21.15.130:0/3468761089 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f41f6770 con 0x7f66e0004d10 2023-09-13T06:02:41.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f37fe640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 0x7f66f41f5e00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f66e40122e0 tx=0x7f66e40127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:41.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f0ff9640 1 -- 172.21.15.130:0/3468761089 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4014750 con 0x7f66e0004d10 2023-09-13T06:02:41.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f0ff9640 1 -- 172.21.15.130:0/3468761089 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e40148b0 con 0x7f66e0004d10 2023-09-13T06:02:41.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66fa248640 1 -- 172.21.15.130:0/3468761089 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f41f6a50 con 0x7f66e0004d10 2023-09-13T06:02:41.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f0ff9640 1 -- 172.21.15.130:0/3468761089 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4014c60 con 0x7f66e0004d10 2023-09-13T06:02:41.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66fa248640 1 -- 172.21.15.130:0/3468761089 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f40cab60 con 0x7f66e0004d10 2023-09-13T06:02:41.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66fa248640 1 -- 172.21.15.130:0/3468761089 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f41f2bf0 con 0x7f66e0004d10 2023-09-13T06:02:41.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.179+0000 7f66f0ff9640 1 -- 172.21.15.130:0/3468761089 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f66e40153e0 con 0x7f66e0004d10 2023-09-13T06:02:41.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.183+0000 7f66f0ff9640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d4065b20 0x7f66d4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.183+0000 7f66f0ff9640 1 -- 172.21.15.130:0/3468761089 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66e4085f50 con 0x7f66e0004d10 2023-09-13T06:02:41.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.183+0000 7f66ebfff640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d4065b20 0x7f66d4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.183+0000 7f66ebfff640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d4065b20 0x7f66d4067fe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f66dc007fd0 tx=0x7f66dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:41.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.187+0000 7f66f0ff9640 1 -- 172.21.15.130:0/3468761089 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f66f41f2bf0 con 0x7f66e0004d10 2023-09-13T06:02:41.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.331+0000 7f66fa248640 1 -- 172.21.15.130:0/3468761089 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66f41f2bf0 con 0x7f66e0004d10 2023-09-13T06:02:41.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66f0ff9640 1 -- 172.21.15.130:0/3468761089 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66f41f2bf0 con 0x7f66e0004d10 2023-09-13T06:02:41.339 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:02:41.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 -- 172.21.15.130:0/3468761089 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d4065b20 msgr2=0x7f66d4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d4065b20 0x7f66d4067fe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f66dc007fd0 tx=0x7f66dc009040 comp rx=0 tx=0).stop 2023-09-13T06:02:41.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 -- 172.21.15.130:0/3468761089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 msgr2=0x7f66f41f5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 0x7f66f41f5e00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f66e40122e0 tx=0x7f66e40127a0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 -- 172.21.15.130:0/3468761089 shutdown_connections 2023-09-13T06:02:41.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66d4065b20 0x7f66d4067fe0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66f40ae190 0x7f66f40ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66f40aeaa0 0x7f66f40aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 --2- 172.21.15.130:0/3468761089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e0004d10 0x7f66f41f5e00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 -- 172.21.15.130:0/3468761089 >> 172.21.15.130:0/3468761089 conn(0x7f66f4065990 msgr2=0x7f66f40ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:41.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 -- 172.21.15.130:0/3468761089 shutdown_connections 2023-09-13T06:02:41.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.335+0000 7f66fa248640 1 -- 172.21.15.130:0/3468761089 wait complete. 2023-09-13T06:02:41.359 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:41.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e1166d640 1 Processor -- start 2023-09-13T06:02:41.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e1166d640 1 -- start start 2023-09-13T06:02:41.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e1166d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 0x7f9e0c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e1166d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9e0c146f30 0x7f9e0c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e1166d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c0b63c0 con 0x7f9e0c0d1750 2023-09-13T06:02:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e1166d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c15dea0 con 0x7f9e0c146f30 2023-09-13T06:02:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e1166d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0d0c20 con 0x7f9e0c0d1090 2023-09-13T06:02:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e03fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 0x7f9e0c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e03fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 0x7f9e0c15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:56238/0 (socket says 172.21.15.130:56238) 2023-09-13T06:02:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e03fff640 1 -- 172.21.15.130:0/1821607932 learned_addr learned my addr 172.21.15.130:0/1821607932 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e0b7fe640 1 --2- 172.21.15.130:0/1821607932 >> v2:172.21.15.164:3300/0 conn(0x7f9e0c146f30 0x7f9e0c0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e03fff640 1 -- 172.21.15.130:0/1821607932 >> v2:172.21.15.164:3300/0 conn(0x7f9e0c146f30 msgr2=0x7f9e0c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:41.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e03fff640 1 --2- 172.21.15.130:0/1821607932 >> v2:172.21.15.164:3300/0 conn(0x7f9e0c146f30 0x7f9e0c0b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e03fff640 1 -- 172.21.15.130:0/1821607932 >> v1:172.21.15.164:6789/0 conn(0x7f9e0c0d1750 legacy=0x7f9e0c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e03fff640 1 -- 172.21.15.130:0/1821607932 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0b6610 con 0x7f9e0c0d1090 2023-09-13T06:02:41.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.495+0000 7f9e0a7fc640 1 -- 172.21.15.130:0/1821607932 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849087081 0 0) 0x7f9e0c0b63c0 con 0x7f9e0c0d1750 2023-09-13T06:02:41.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e03fff640 1 --2- 172.21.15.130:0/1821607932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 0x7f9e0c15d960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009870 tx=0x7f9df401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ca164243ce6b39b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:41.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e0a7fc640 1 -- 172.21.15.130:0/1821607932 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40aa670 con 0x7f9e0c0d1090 2023-09-13T06:02:41.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e0a7fc640 1 -- 172.21.15.130:0/1821607932 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df40aa7d0 con 0x7f9e0c0d1090 2023-09-13T06:02:41.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e0a7fc640 1 -- 172.21.15.130:0/1821607932 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40aab60 con 0x7f9e0c0d1090 2023-09-13T06:02:41.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e1166d640 1 -- 172.21.15.130:0/1821607932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 msgr2=0x7f9e0c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e1166d640 1 --2- 172.21.15.130:0/1821607932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 0x7f9e0c15d960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009870 tx=0x7f9df401c510 comp rx=0 tx=0).stop 2023-09-13T06:02:41.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e1166d640 1 -- 172.21.15.130:0/1821607932 shutdown_connections 2023-09-13T06:02:41.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e1166d640 1 --2- 172.21.15.130:0/1821607932 >> v2:172.21.15.164:3300/0 conn(0x7f9e0c146f30 0x7f9e0c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e1166d640 1 --2- 172.21.15.130:0/1821607932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 0x7f9e0c15d960 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e1166d640 1 -- 172.21.15.130:0/1821607932 >> 172.21.15.130:0/1821607932 conn(0x7f9e0c06f170 msgr2=0x7f9e0c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:41.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e1166d640 1 -- 172.21.15.130:0/1821607932 shutdown_connections 2023-09-13T06:02:41.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.499+0000 7f9e1166d640 1 -- 172.21.15.130:0/1821607932 wait complete. 2023-09-13T06:02:41.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e1166d640 1 Processor -- start 2023-09-13T06:02:41.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e1166d640 1 -- start start 2023-09-13T06:02:41.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e1166d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 0x7f9e0c167ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e1166d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0c0d1750 0x7f9e0c145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e1166d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e0c146f30 0x7f9e0c15c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e1166d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c167250 con 0x7f9e0c0d1750 2023-09-13T06:02:41.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e1166d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c15ee90 con 0x7f9e0c146f30 2023-09-13T06:02:41.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e1166d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c15f170 con 0x7f9e0c0d1090 2023-09-13T06:02:41.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e03fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0c0d1750 0x7f9e0c145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e0affd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 0x7f9e0c167ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e03fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0c0d1750 0x7f9e0c145e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36566/0 (socket says 172.21.15.130:36566) 2023-09-13T06:02:41.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e03fff640 1 -- 172.21.15.130:0/3947625227 learned_addr learned my addr 172.21.15.130:0/3947625227 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:41.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e0b7fe640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e0c146f30 0x7f9e0c15c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e03fff640 1 -- 172.21.15.130:0/3947625227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 msgr2=0x7f9e0c167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e03fff640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 0x7f9e0c167ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e03fff640 1 -- 172.21.15.130:0/3947625227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e0c146f30 msgr2=0x7f9e0c15c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e03fff640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e0c146f30 0x7f9e0c15c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e03fff640 1 -- 172.21.15.130:0/3947625227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df40094d0 con 0x7f9e0c0d1750 2023-09-13T06:02:41.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e03fff640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0c0d1750 0x7f9e0c145e20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9df401a140 tx=0x7f9df401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:41.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e037fe640 1 -- 172.21.15.130:0/3947625227 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40aa670 con 0x7f9e0c0d1750 2023-09-13T06:02:41.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e037fe640 1 -- 172.21.15.130:0/3947625227 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df40b3800 con 0x7f9e0c0d1750 2023-09-13T06:02:41.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.503+0000 7f9e1166d640 1 -- 172.21.15.130:0/3947625227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c0b7e40 con 0x7f9e0c0d1750 2023-09-13T06:02:41.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.507+0000 7f9e037fe640 1 -- 172.21.15.130:0/3947625227 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40b3bb0 con 0x7f9e0c0d1750 2023-09-13T06:02:41.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.507+0000 7f9e1166d640 1 -- 172.21.15.130:0/3947625227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c167780 con 0x7f9e0c0d1750 2023-09-13T06:02:41.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.507+0000 7f9e1166d640 1 -- 172.21.15.130:0/3947625227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c15f390 con 0x7f9e0c0d1750 2023-09-13T06:02:41.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.507+0000 7f9e037fe640 1 -- 172.21.15.130:0/3947625227 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9df40b3d10 con 0x7f9e0c0d1750 2023-09-13T06:02:41.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.507+0000 7f9e037fe640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dec065b20 0x7f9dec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.507+0000 7f9e037fe640 1 -- 172.21.15.130:0/3947625227 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9df411dad0 con 0x7f9e0c0d1750 2023-09-13T06:02:41.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.507+0000 7f9e0affd640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dec065b20 0x7f9dec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.507+0000 7f9e0affd640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dec065b20 0x7f9dec067fe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc000f70 tx=0x7f9dfc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:41.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.511+0000 7f9e037fe640 1 -- 172.21.15.130:0/3947625227 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9df40eb430 con 0x7f9e0c0d1750 2023-09-13T06:02:41.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 -- 172.21.15.130:0/3947625227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e0c0618a0 con 0x7f9e0c0d1750 2023-09-13T06:02:41.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e037fe640 1 -- 172.21.15.130:0/3947625227 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f9df40eea50 con 0x7f9e0c0d1750 2023-09-13T06:02:41.699 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:41.700 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3600813785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3600813785},{"type":"v1","addr":"172.21.15.164:6834","nonce":3600813785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3946401321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3946401321},{"type":"v1","addr":"172.21.15.164:6835","nonce":3946401321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5097,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/746143804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":746143804},{"type":"v1","addr":"172.21.15.130:6835","nonce":746143804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:18.135350+0000","modified":"2023-09-13T06:02:21.179925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1879815978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1879815978},{"type":"v1","addr":"172.21.15.130:6837","nonce":1879815978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-13T06:02:41.701 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 16 2023-09-13T06:02:41.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 -- 172.21.15.130:0/3947625227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dec065b20 msgr2=0x7f9dec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dec065b20 0x7f9dec067fe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc000f70 tx=0x7f9dfc009040 comp rx=0 tx=0).stop 2023-09-13T06:02:41.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 -- 172.21.15.130:0/3947625227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0c0d1750 msgr2=0x7f9e0c145e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0c0d1750 0x7f9e0c145e20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9df401a140 tx=0x7f9df401ad50 comp rx=0 tx=0).stop 2023-09-13T06:02:41.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 -- 172.21.15.130:0/3947625227 shutdown_connections 2023-09-13T06:02:41.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dec065b20 0x7f9dec067fe0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e0c146f30 0x7f9e0c15c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0c0d1750 0x7f9e0c145e20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 --2- 172.21.15.130:0/3947625227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c0d1090 0x7f9e0c167ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 -- 172.21.15.130:0/3947625227 >> 172.21.15.130:0/3947625227 conn(0x7f9e0c06f170 msgr2=0x7f9e0c15f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:41.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 -- 172.21.15.130:0/3947625227 shutdown_connections 2023-09-13T06:02:41.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.695+0000 7f9e1166d640 1 -- 172.21.15.130:0/3947625227 wait complete. 2023-09-13T06:02:41.720 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:41.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.855+0000 7fe7a6140640 1 Processor -- start 2023-09-13T06:02:41.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.855+0000 7fe7a6140640 1 -- start start 2023-09-13T06:02:41.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe7a6140640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe7a015b130 0x7fe7a00cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe7a6140640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7a00b04a0 0x7fe7a00b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe7a6140640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a00ce980 con 0x7fe7a00ce180 2023-09-13T06:02:41.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe7a6140640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a00b0e70 con 0x7fe7a015b130 2023-09-13T06:02:41.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe7a6140640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00cec60 con 0x7fe7a00b04a0 2023-09-13T06:02:41.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe7a015b130 0x7fe7a00cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe7a015b130 0x7fe7a00cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36576/0 (socket says 172.21.15.130:36576) 2023-09-13T06:02:41.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79f7fe640 1 -- 172.21.15.130:0/2215917588 learned_addr learned my addr 172.21.15.130:0/2215917588 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:41.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79f7fe640 1 -- 172.21.15.130:0/2215917588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7a00b04a0 msgr2=0x7fe7a00b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:41.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79ffff640 1 --2- 172.21.15.130:0/2215917588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7a00b04a0 0x7fe7a00b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79e7fc640 1 -- 172.21.15.130:0/2215917588 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072458275 0 0) 0x7fe7a00ce980 con 0x7fe7a00ce180 2023-09-13T06:02:41.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79f7fe640 1 --2- 172.21.15.130:0/2215917588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7a00b04a0 0x7fe7a00b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79f7fe640 1 -- 172.21.15.130:0/2215917588 >> v1:172.21.15.130:6789/0 conn(0x7fe7a00ce180 legacy=0x7fe7a015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79f7fe640 1 -- 172.21.15.130:0/2215917588 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a006c640 con 0x7fe7a015b130 2023-09-13T06:02:41.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79ffff640 1 --2- 172.21.15.130:0/2215917588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7a00b04a0 0x7fe7a00b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:41.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79f7fe640 1 --2- 172.21.15.130:0/2215917588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a015b130 0x7fe7a00cc780 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe790009e50 tx=0x7fe79001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe77c954dac3ebf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:41.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79e7fc640 1 -- 172.21.15.130:0/2215917588 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900a58e0 con 0x7fe7a015b130 2023-09-13T06:02:41.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79e7fc640 1 -- 172.21.15.130:0/2215917588 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7900a5a40 con 0x7fe7a015b130 2023-09-13T06:02:41.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.859+0000 7fe79e7fc640 1 -- 172.21.15.130:0/2215917588 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900a5dd0 con 0x7fe7a015b130 2023-09-13T06:02:41.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 -- 172.21.15.130:0/2215917588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a015b130 msgr2=0x7fe7a00cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 --2- 172.21.15.130:0/2215917588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a015b130 0x7fe7a00cc780 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe790009e50 tx=0x7fe79001ca10 comp rx=0 tx=0).stop 2023-09-13T06:02:41.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 -- 172.21.15.130:0/2215917588 shutdown_connections 2023-09-13T06:02:41.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 --2- 172.21.15.130:0/2215917588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7a00b04a0 0x7fe7a00b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 --2- 172.21.15.130:0/2215917588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a015b130 0x7fe7a00cc780 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 -- 172.21.15.130:0/2215917588 >> 172.21.15.130:0/2215917588 conn(0x7fe7a0065990 msgr2=0x7fe7a0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 -- 172.21.15.130:0/2215917588 shutdown_connections 2023-09-13T06:02:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 -- 172.21.15.130:0/2215917588 wait complete. 2023-09-13T06:02:41.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 Processor -- start 2023-09-13T06:02:41.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 -- start start 2023-09-13T06:02:41.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7a00b04a0 0x7fe7a0151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a00ce180 0x7fe7a01542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7a015b130 0x7fe7a01547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0155a60 con 0x7fe7a00ce180 2023-09-13T06:02:41.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0150820 con 0x7fe7a015b130 2023-09-13T06:02:41.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe7a6140640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0154de0 con 0x7fe7a00b04a0 2023-09-13T06:02:41.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe79effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a00ce180 0x7fe7a01542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe79effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a00ce180 0x7fe7a01542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36578/0 (socket says 172.21.15.130:36578) 2023-09-13T06:02:41.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe79effd640 1 -- 172.21.15.130:0/1656923079 learned_addr learned my addr 172.21.15.130:0/1656923079 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:41.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe79f7fe640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7a00b04a0 0x7fe7a0151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.863+0000 7fe79ffff640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7a015b130 0x7fe7a01547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe79effd640 1 -- 172.21.15.130:0/1656923079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7a00b04a0 msgr2=0x7fe7a0151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe79effd640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7a00b04a0 0x7fe7a0151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe79effd640 1 -- 172.21.15.130:0/1656923079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7a015b130 msgr2=0x7fe7a01547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:41.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe79effd640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7a015b130 0x7fe7a01547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:41.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe79effd640 1 -- 172.21.15.130:0/1656923079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe790009b30 con 0x7fe7a00ce180 2023-09-13T06:02:41.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe79effd640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a00ce180 0x7fe7a01542b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c4d0 tx=0x7fe79400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:41.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe787fff640 1 -- 172.21.15.130:0/1656923079 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794005480 con 0x7fe7a00ce180 2023-09-13T06:02:41.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe787fff640 1 -- 172.21.15.130:0/1656923079 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe794003600 con 0x7fe7a00ce180 2023-09-13T06:02:41.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe7a6140640 1 -- 172.21.15.130:0/1656923079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a01550c0 con 0x7fe7a00ce180 2023-09-13T06:02:41.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe787fff640 1 -- 172.21.15.130:0/1656923079 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7940039b0 con 0x7fe7a00ce180 2023-09-13T06:02:41.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe7a6140640 1 -- 172.21.15.130:0/1656923079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a0155450 con 0x7fe7a00ce180 2023-09-13T06:02:41.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe7a6140640 1 -- 172.21.15.130:0/1656923079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a00618a0 con 0x7fe7a00ce180 2023-09-13T06:02:41.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe787fff640 1 -- 172.21.15.130:0/1656923079 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe794003b10 con 0x7fe7a00ce180 2023-09-13T06:02:41.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe787fff640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe78c065b20 0x7fe78c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:41.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe787fff640 1 -- 172.21.15.130:0/1656923079 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe794082840 con 0x7fe7a00ce180 2023-09-13T06:02:41.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.867+0000 7fe79f7fe640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe78c065b20 0x7fe78c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.871+0000 7fe79f7fe640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe78c065b20 0x7fe78c067fe0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe7900ae000 tx=0x7fe7900a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:41.871+0000 7fe787fff640 1 -- 172.21.15.130:0/1656923079 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe7940502f0 con 0x7fe7a00ce180 2023-09-13T06:02:42.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.023+0000 7fe7a6140640 1 -- 172.21.15.130:0/1656923079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7a00b1ed0 con 0x7fe7a00ce180 2023-09-13T06:02:42.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.023+0000 7fe787fff640 1 -- 172.21.15.130:0/1656923079 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fe794017020 con 0x7fe7a00ce180 2023-09-13T06:02:42.029 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:42.029 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:34.323976+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:15.867393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:17.140116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:42.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 -- 172.21.15.130:0/1656923079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe78c065b20 msgr2=0x7fe78c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe78c065b20 0x7fe78c067fe0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe7900ae000 tx=0x7fe7900a7070 comp rx=0 tx=0).stop 2023-09-13T06:02:42.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 -- 172.21.15.130:0/1656923079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a00ce180 msgr2=0x7fe7a01542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a00ce180 0x7fe7a01542b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c4d0 tx=0x7fe79400c990 comp rx=0 tx=0).stop 2023-09-13T06:02:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 -- 172.21.15.130:0/1656923079 shutdown_connections 2023-09-13T06:02:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe78c065b20 0x7fe78c067fe0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7a015b130 0x7fe7a01547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a00ce180 0x7fe7a01542b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 --2- 172.21.15.130:0/1656923079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7a00b04a0 0x7fe7a0151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 -- 172.21.15.130:0/1656923079 >> 172.21.15.130:0/1656923079 conn(0x7fe7a0065990 msgr2=0x7fe7a00b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:42.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 -- 172.21.15.130:0/1656923079 shutdown_connections 2023-09-13T06:02:42.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.027+0000 7fe7a6140640 1 -- 172.21.15.130:0/1656923079 wait complete. 2023-09-13T06:02:42.051 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:02:42.052 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:42.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d986a640 1 Processor -- start 2023-09-13T06:02:42.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d986a640 1 -- start start 2023-09-13T06:02:42.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d986a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f97d40d1090 0x7f97d415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d986a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97d4146f30 0x7f97d40b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d986a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d40b63c0 con 0x7f97d40d1750 2023-09-13T06:02:42.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d986a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d415dea0 con 0x7f97d40d1090 2023-09-13T06:02:42.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d986a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40d0c20 con 0x7f97d4146f30 2023-09-13T06:02:42.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d2ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f97d40d1750 0x7f97d4146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49600/0 (socket says 172.21.15.130:49600) 2023-09-13T06:02:42.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d2ffd640 1 -- 172.21.15.130:0/395181425 learned_addr learned my addr 172.21.15.130:0/395181425 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:42.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d37fe640 1 --2- 172.21.15.130:0/395181425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97d4146f30 0x7f97d40b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d27fc640 1 --2- 172.21.15.130:0/395181425 >> v2:172.21.15.164:3300/0 conn(0x7f97d40d1090 0x7f97d415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d1ffb640 1 -- 172.21.15.130:0/395181425 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573545318 0 0) 0x7f97d40b63c0 con 0x7f97d40d1750 2023-09-13T06:02:42.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d1ffb640 1 -- 172.21.15.130:0/395181425 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97bc003530 con 0x7f97d40d1750 2023-09-13T06:02:42.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d1ffb640 1 -- 172.21.15.130:0/395181425 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2222774936 0 0) 0x7f97bc003530 con 0x7f97d40d1750 2023-09-13T06:02:42.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d27fc640 1 -- 172.21.15.130:0/395181425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97d4146f30 msgr2=0x7f97d40b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:42.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d27fc640 1 --2- 172.21.15.130:0/395181425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97d4146f30 0x7f97d40b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d27fc640 1 -- 172.21.15.130:0/395181425 >> v1:172.21.15.130:6789/0 conn(0x7f97d40d1750 legacy=0x7f97d4146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d27fc640 1 -- 172.21.15.130:0/395181425 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d40b6610 con 0x7f97d40d1090 2023-09-13T06:02:42.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.187+0000 7f97d37fe640 1 --2- 172.21.15.130:0/395181425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97d4146f30 0x7f97d40b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:42.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d27fc640 1 --2- 172.21.15.130:0/395181425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97d40d1090 0x7f97d415d960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f97c80097c0 tx=0x7f97c801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ea7dbfde21a4b2c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:42.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d1ffb640 1 -- 172.21.15.130:0/395181425 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4001680 con 0x7f97d40d1090 2023-09-13T06:02:42.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d1ffb640 1 -- 172.21.15.130:0/395181425 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c80a7050 con 0x7f97d40d1090 2023-09-13T06:02:42.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d1ffb640 1 -- 172.21.15.130:0/395181425 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c80ab600 con 0x7f97d40d1090 2023-09-13T06:02:42.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d986a640 1 -- 172.21.15.130:0/395181425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97d40d1090 msgr2=0x7f97d415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d986a640 1 --2- 172.21.15.130:0/395181425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97d40d1090 0x7f97d415d960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f97c80097c0 tx=0x7f97c801c370 comp rx=0 tx=0).stop 2023-09-13T06:02:42.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d986a640 1 -- 172.21.15.130:0/395181425 shutdown_connections 2023-09-13T06:02:42.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d986a640 1 --2- 172.21.15.130:0/395181425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97d4146f30 0x7f97d40b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d986a640 1 --2- 172.21.15.130:0/395181425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97d40d1090 0x7f97d415d960 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d986a640 1 -- 172.21.15.130:0/395181425 >> 172.21.15.130:0/395181425 conn(0x7f97d406f170 msgr2=0x7f97d406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:42.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d986a640 1 -- 172.21.15.130:0/395181425 shutdown_connections 2023-09-13T06:02:42.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.191+0000 7f97d986a640 1 -- 172.21.15.130:0/395181425 wait complete. 2023-09-13T06:02:42.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d986a640 1 Processor -- start 2023-09-13T06:02:42.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d986a640 1 -- start start 2023-09-13T06:02:42.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d986a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d40d1090 0x7f97d4145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d986a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97d40d1750 0x7f97d406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d986a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97d4146f30 0x7f97d415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d986a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d415d380 con 0x7f97d40d1090 2023-09-13T06:02:42.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d986a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d41faad0 con 0x7f97d4146f30 2023-09-13T06:02:42.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d986a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d41fa1a0 con 0x7f97d40d1750 2023-09-13T06:02:42.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d40d1090 0x7f97d4145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d40d1090 0x7f97d4145060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36588/0 (socket says 172.21.15.130:36588) 2023-09-13T06:02:42.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d2ffd640 1 -- 172.21.15.130:0/824940494 learned_addr learned my addr 172.21.15.130:0/824940494 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:42.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d37fe640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97d4146f30 0x7f97d415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d27fc640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97d40d1750 0x7f97d406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d2ffd640 1 -- 172.21.15.130:0/824940494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97d40d1750 msgr2=0x7f97d406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d2ffd640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97d40d1750 0x7f97d406dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d2ffd640 1 -- 172.21.15.130:0/824940494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97d4146f30 msgr2=0x7f97d415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d2ffd640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97d4146f30 0x7f97d415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d2ffd640 1 -- 172.21.15.130:0/824940494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc009a70 con 0x7f97d40d1090 2023-09-13T06:02:42.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d2ffd640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d40d1090 0x7f97d4145060 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f97c400c750 tx=0x7f97c400cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:42.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97bbfff640 1 -- 172.21.15.130:0/824940494 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4005ae0 con 0x7f97d40d1090 2023-09-13T06:02:42.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97bbfff640 1 -- 172.21.15.130:0/824940494 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c400ce90 con 0x7f97d40d1090 2023-09-13T06:02:42.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d986a640 1 -- 172.21.15.130:0/824940494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c8009420 con 0x7f97d40d1090 2023-09-13T06:02:42.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97bbfff640 1 -- 172.21.15.130:0/824940494 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4005e80 con 0x7f97d40d1090 2023-09-13T06:02:42.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d986a640 1 -- 172.21.15.130:0/824940494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d40b7e40 con 0x7f97d40d1090 2023-09-13T06:02:42.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.195+0000 7f97d986a640 1 -- 172.21.15.130:0/824940494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d40618a0 con 0x7f97d40d1090 2023-09-13T06:02:42.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.199+0000 7f97bbfff640 1 -- 172.21.15.130:0/824940494 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f97c4007070 con 0x7f97d40d1090 2023-09-13T06:02:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.199+0000 7f97bbfff640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c0065b20 0x7f97c0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.199+0000 7f97bbfff640 1 -- 172.21.15.130:0/824940494 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97c4082a10 con 0x7f97d40d1090 2023-09-13T06:02:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.199+0000 7f97d27fc640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c0065b20 0x7f97c0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.199+0000 7f97d27fc640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c0065b20 0x7f97c0067fe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f97c80ad000 tx=0x7f97c80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.203+0000 7f97bbfff640 1 -- 172.21.15.130:0/824940494 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f97c4053d50 con 0x7f97d40d1090 2023-09-13T06:02:42.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.383+0000 7f97d986a640 1 -- 172.21.15.130:0/824940494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97d40b86c0 con 0x7f97d40d1090 2023-09-13T06:02:42.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.383+0000 7f97bbfff640 1 -- 172.21.15.130:0/824940494 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f97c4017020 con 0x7f97d40d1090 2023-09-13T06:02:42.388 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:42.389 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3600813785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3600813785},{"type":"v1","addr":"172.21.15.164:6834","nonce":3600813785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3946401321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3946401321},{"type":"v1","addr":"172.21.15.164:6835","nonce":3946401321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5097,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/746143804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":746143804},{"type":"v1","addr":"172.21.15.130:6835","nonce":746143804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:18.135350+0000","modified":"2023-09-13T06:02:21.179925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1879815978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1879815978},{"type":"v1","addr":"172.21.15.130:6837","nonce":1879815978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-13T06:02:42.389 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 16 2023-09-13T06:02:42.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.383+0000 7f97d986a640 1 -- 172.21.15.130:0/824940494 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c0065b20 msgr2=0x7f97c0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.383+0000 7f97d986a640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c0065b20 0x7f97c0067fe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f97c80ad000 tx=0x7f97c80a6000 comp rx=0 tx=0).stop 2023-09-13T06:02:42.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.383+0000 7f97d986a640 1 -- 172.21.15.130:0/824940494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d40d1090 msgr2=0x7f97d4145060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.383+0000 7f97d986a640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d40d1090 0x7f97d4145060 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f97c400c750 tx=0x7f97c400cb50 comp rx=0 tx=0).stop 2023-09-13T06:02:42.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.387+0000 7f97d986a640 1 -- 172.21.15.130:0/824940494 shutdown_connections 2023-09-13T06:02:42.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.387+0000 7f97d986a640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c0065b20 0x7f97c0067fe0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.387+0000 7f97d986a640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97d4146f30 0x7f97d415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.387+0000 7f97d986a640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97d40d1750 0x7f97d406dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.387+0000 7f97d986a640 1 --2- 172.21.15.130:0/824940494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d40d1090 0x7f97d4145060 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.387+0000 7f97d986a640 1 -- 172.21.15.130:0/824940494 >> 172.21.15.130:0/824940494 conn(0x7f97d406f170 msgr2=0x7f97d415f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:42.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.387+0000 7f97d986a640 1 -- 172.21.15.130:0/824940494 shutdown_connections 2023-09-13T06:02:42.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.387+0000 7f97d986a640 1 -- 172.21.15.130:0/824940494 wait complete. 2023-09-13T06:02:42.410 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:42.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.543+0000 7f58657d2640 1 Processor -- start 2023-09-13T06:02:42.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.543+0000 7f58657d2640 1 -- start start 2023-09-13T06:02:42.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f58657d2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f58600d1750 0x7f586015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f58657d2640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f58600d1090 0x7f5860146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f58657d2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58600d1b30 0x7f5860146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f58657d2640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586015dea0 con 0x7f58600d1750 2023-09-13T06:02:42.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f58657d2640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58600b63c0 con 0x7f58600d1090 2023-09-13T06:02:42.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f58657d2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58600d0c20 con 0x7f58600d1b30 2023-09-13T06:02:42.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f585effd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f58600d1750 0x7f586015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f585effd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f58600d1750 0x7f586015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36594/0 (socket says 172.21.15.130:36594) 2023-09-13T06:02:42.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f585effd640 1 -- 172.21.15.130:0/4207533810 learned_addr learned my addr 172.21.15.130:0/4207533810 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:42.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f5857fff640 1 --2- 172.21.15.130:0/4207533810 >> v2:172.21.15.164:3300/0 conn(0x7f58600d1090 0x7f5860146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f585f7fe640 1 --2- 172.21.15.130:0/4207533810 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58600d1b30 0x7f5860146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f585effd640 1 -- 172.21.15.130:0/4207533810 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58600d1b30 msgr2=0x7f5860146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:42.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f585effd640 1 --2- 172.21.15.130:0/4207533810 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58600d1b30 0x7f5860146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f585effd640 1 -- 172.21.15.130:0/4207533810 >> v2:172.21.15.164:3300/0 conn(0x7f58600d1090 msgr2=0x7f5860146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:42.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f585effd640 1 --2- 172.21.15.130:0/4207533810 >> v2:172.21.15.164:3300/0 conn(0x7f58600d1090 0x7f5860146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f585effd640 1 -- 172.21.15.130:0/4207533810 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58600b6610 con 0x7f58600d1750 2023-09-13T06:02:42.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.547+0000 7f5857fff640 1 --2- 172.21.15.130:0/4207533810 >> v2:172.21.15.164:3300/0 conn(0x7f58600d1090 0x7f5860146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:42.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f585effd640 1 --2- 172.21.15.130:0/4207533810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58600d1750 0x7f586015d960 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f58600c8360 tx=0x7f585001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58886160e1422a73 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:42.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f585e7fc640 1 -- 172.21.15.130:0/4207533810 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500aa5f0 con 0x7f58600d1750 2023-09-13T06:02:42.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f585e7fc640 1 -- 172.21.15.130:0/4207533810 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58500aa750 con 0x7f58600d1750 2023-09-13T06:02:42.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f585e7fc640 1 -- 172.21.15.130:0/4207533810 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500aaae0 con 0x7f58600d1750 2023-09-13T06:02:42.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f58657d2640 1 -- 172.21.15.130:0/4207533810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58600d1750 msgr2=0x7f586015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f58657d2640 1 --2- 172.21.15.130:0/4207533810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58600d1750 0x7f586015d960 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f58600c8360 tx=0x7f585001c4d0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f58657d2640 1 -- 172.21.15.130:0/4207533810 shutdown_connections 2023-09-13T06:02:42.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f58657d2640 1 --2- 172.21.15.130:0/4207533810 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58600d1b30 0x7f5860146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f58657d2640 1 --2- 172.21.15.130:0/4207533810 >> v2:172.21.15.164:3300/0 conn(0x7f58600d1090 0x7f5860146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f58657d2640 1 --2- 172.21.15.130:0/4207533810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58600d1750 0x7f586015d960 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f58657d2640 1 -- 172.21.15.130:0/4207533810 >> 172.21.15.130:0/4207533810 conn(0x7f586006f170 msgr2=0x7f586006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:42.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f58657d2640 1 -- 172.21.15.130:0/4207533810 shutdown_connections 2023-09-13T06:02:42.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f58657d2640 1 -- 172.21.15.130:0/4207533810 wait complete. 2023-09-13T06:02:42.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f58657d2640 1 Processor -- start 2023-09-13T06:02:42.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.551+0000 7f58657d2640 1 -- start start 2023-09-13T06:02:42.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58657d2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58600d1090 0x7f58601661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58657d2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58600d1750 0x7f586015cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58657d2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58600d1b30 0x7f58601465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58657d2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5860167530 con 0x7f58600d1750 2023-09-13T06:02:42.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58657d2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5860167d00 con 0x7f58600d1b30 2023-09-13T06:02:42.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58657d2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58601668b0 con 0x7f58600d1090 2023-09-13T06:02:42.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f5857fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58600d1750 0x7f586015cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f5857fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58600d1750 0x7f586015cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36606/0 (socket says 172.21.15.130:36606) 2023-09-13T06:02:42.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f5857fff640 1 -- 172.21.15.130:0/1851793335 learned_addr learned my addr 172.21.15.130:0/1851793335 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:42.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f585f7fe640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58600d1b30 0x7f58601465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f585effd640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58600d1090 0x7f58601661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f5857fff640 1 -- 172.21.15.130:0/1851793335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58600d1090 msgr2=0x7f58601661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f5857fff640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58600d1090 0x7f58601661b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f5857fff640 1 -- 172.21.15.130:0/1851793335 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58600d1b30 msgr2=0x7f58601465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f5857fff640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58600d1b30 0x7f58601465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f5857fff640 1 -- 172.21.15.130:0/1851793335 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500094d0 con 0x7f58600d1750 2023-09-13T06:02:42.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f5857fff640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58600d1750 0x7f586015cc70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f584800e840 tx=0x7f584800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:42.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58577fe640 1 -- 172.21.15.130:0/1851793335 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584800c8d0 con 0x7f58600d1750 2023-09-13T06:02:42.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58577fe640 1 -- 172.21.15.130:0/1851793335 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584800ca30 con 0x7f58600d1750 2023-09-13T06:02:42.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58657d2640 1 -- 172.21.15.130:0/1851793335 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5860166b90 con 0x7f58600d1750 2023-09-13T06:02:42.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58577fe640 1 -- 172.21.15.130:0/1851793335 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584800cde0 con 0x7f58600d1750 2023-09-13T06:02:42.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58657d2640 1 -- 172.21.15.130:0/1851793335 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5860167150 con 0x7f58600d1750 2023-09-13T06:02:42.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58657d2640 1 -- 172.21.15.130:0/1851793335 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58600618a0 con 0x7f58600d1750 2023-09-13T06:02:42.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.555+0000 7f58577fe640 1 -- 172.21.15.130:0/1851793335 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5848013410 con 0x7f58600d1750 2023-09-13T06:02:42.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.559+0000 7f58577fe640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5840065b50 0x7f5840068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.559+0000 7f58577fe640 1 -- 172.21.15.130:0/1851793335 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5848082f30 con 0x7f58600d1750 2023-09-13T06:02:42.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.559+0000 7f585effd640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5840065b50 0x7f5840068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.559+0000 7f585effd640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5840065b50 0x7f5840068010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58500ae000 tx=0x7f58500b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:42.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.563+0000 7f58577fe640 1 -- 172.21.15.130:0/1851793335 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5848050920 con 0x7f58600d1750 2023-09-13T06:02:42.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.743+0000 7f58657d2640 1 -- 172.21.15.130:0/1851793335 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58600b86c0 con 0x7f58600d1750 2023-09-13T06:02:42.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.743+0000 7f58577fe640 1 -- 172.21.15.130:0/1851793335 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f5848021090 con 0x7f58600d1750 2023-09-13T06:02:42.750 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:42.751 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3600813785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3600813785},{"type":"v1","addr":"172.21.15.164:6834","nonce":3600813785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3946401321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3946401321},{"type":"v1","addr":"172.21.15.164:6835","nonce":3946401321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5097,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/746143804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":746143804},{"type":"v1","addr":"172.21.15.130:6835","nonce":746143804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:18.135350+0000","modified":"2023-09-13T06:02:21.179925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1879815978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1879815978},{"type":"v1","addr":"172.21.15.130:6837","nonce":1879815978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-13T06:02:42.752 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 16 2023-09-13T06:02:42.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 -- 172.21.15.130:0/1851793335 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5840065b50 msgr2=0x7f5840068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5840065b50 0x7f5840068010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58500ae000 tx=0x7f58500b5040 comp rx=0 tx=0).stop 2023-09-13T06:02:42.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 -- 172.21.15.130:0/1851793335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58600d1750 msgr2=0x7f586015cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58600d1750 0x7f586015cc70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f584800e840 tx=0x7f584800ed00 comp rx=0 tx=0).stop 2023-09-13T06:02:42.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 -- 172.21.15.130:0/1851793335 shutdown_connections 2023-09-13T06:02:42.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5840065b50 0x7f5840068010 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58600d1b30 0x7f58601465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58600d1750 0x7f586015cc70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 --2- 172.21.15.130:0/1851793335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58600d1090 0x7f58601661b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 -- 172.21.15.130:0/1851793335 >> 172.21.15.130:0/1851793335 conn(0x7f586006f170 msgr2=0x7f586015f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:42.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 -- 172.21.15.130:0/1851793335 shutdown_connections 2023-09-13T06:02:42.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.747+0000 7f58657d2640 1 -- 172.21.15.130:0/1851793335 wait complete. 2023-09-13T06:02:42.770 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:42.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.907+0000 7efe41f40640 1 Processor -- start 2023-09-13T06:02:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.907+0000 7efe41f40640 1 -- start start 2023-09-13T06:02:42.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe41f40640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efe3c0ce1a0 0x7efe3c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe41f40640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efe3c0afc70 0x7efe3c06dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe41f40640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c070e70 con 0x7efe3c15d260 2023-09-13T06:02:42.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe41f40640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c072310 con 0x7efe3c0afc70 2023-09-13T06:02:42.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe41f40640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c070280 con 0x7efe3c0ce1a0 2023-09-13T06:02:42.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe3bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efe3c0afc70 0x7efe3c06dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe3bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efe3c0afc70 0x7efe3c06dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36610/0 (socket says 172.21.15.130:36610) 2023-09-13T06:02:42.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe3b7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7efe3c15d260 0x7efe3c0b5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49614/0 (socket says 172.21.15.130:49614) 2023-09-13T06:02:42.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe3bfff640 1 -- 172.21.15.130:0/270064258 learned_addr learned my addr 172.21.15.130:0/270064258 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:42.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe3affd640 1 --2- 172.21.15.130:0/270064258 >> v2:172.21.15.164:3300/0 conn(0x7efe3c0ce1a0 0x7efe3c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe3bfff640 1 -- 172.21.15.130:0/270064258 >> v2:172.21.15.164:3300/0 conn(0x7efe3c0ce1a0 msgr2=0x7efe3c06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:42.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe3bfff640 1 --2- 172.21.15.130:0/270064258 >> v2:172.21.15.164:3300/0 conn(0x7efe3c0ce1a0 0x7efe3c06d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe3bfff640 1 -- 172.21.15.130:0/270064258 >> v1:172.21.15.130:6789/0 conn(0x7efe3c15d260 legacy=0x7efe3c0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe3bfff640 1 -- 172.21.15.130:0/270064258 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c070540 con 0x7efe3c0afc70 2023-09-13T06:02:42.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.911+0000 7efe3affd640 1 --2- 172.21.15.130:0/270064258 >> v2:172.21.15.164:3300/0 conn(0x7efe3c0ce1a0 0x7efe3c06d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:42.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe3bfff640 1 --2- 172.21.15.130:0/270064258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c0afc70 0x7efe3c06dc20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efe3c073d60 tx=0x7efe3401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0d958e9b78e8e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:42.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe3a7fc640 1 -- 172.21.15.130:0/270064258 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe340a5840 con 0x7efe3c0afc70 2023-09-13T06:02:42.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe3a7fc640 1 -- 172.21.15.130:0/270064258 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe340a59a0 con 0x7efe3c0afc70 2023-09-13T06:02:42.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe3a7fc640 1 -- 172.21.15.130:0/270064258 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe340a5d30 con 0x7efe3c0afc70 2023-09-13T06:02:42.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe41f40640 1 -- 172.21.15.130:0/270064258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c0afc70 msgr2=0x7efe3c06dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe41f40640 1 --2- 172.21.15.130:0/270064258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c0afc70 0x7efe3c06dc20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efe3c073d60 tx=0x7efe3401c980 comp rx=0 tx=0).stop 2023-09-13T06:02:42.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe41f40640 1 -- 172.21.15.130:0/270064258 shutdown_connections 2023-09-13T06:02:42.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe41f40640 1 --2- 172.21.15.130:0/270064258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c0afc70 0x7efe3c06dc20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe41f40640 1 --2- 172.21.15.130:0/270064258 >> v2:172.21.15.164:3300/0 conn(0x7efe3c0ce1a0 0x7efe3c06d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe41f40640 1 -- 172.21.15.130:0/270064258 >> 172.21.15.130:0/270064258 conn(0x7efe3c06a2f0 msgr2=0x7efe3c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:42.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe41f40640 1 -- 172.21.15.130:0/270064258 shutdown_connections 2023-09-13T06:02:42.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe41f40640 1 -- 172.21.15.130:0/270064258 wait complete. 2023-09-13T06:02:42.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe41f40640 1 Processor -- start 2023-09-13T06:02:42.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.915+0000 7efe41f40640 1 -- start start 2023-09-13T06:02:42.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe41f40640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe3c0afc70 0x7efe3c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe41f40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe3c0ce1a0 0x7efe3c0b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe41f40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15d260 0x7efe3c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe41f40640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c1518c0 con 0x7efe3c15d260 2023-09-13T06:02:42.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe41f40640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0cb8a0 con 0x7efe3c0afc70 2023-09-13T06:02:42.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe41f40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0cbb80 con 0x7efe3c0ce1a0 2023-09-13T06:02:42.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe3bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15d260 0x7efe3c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe3bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15d260 0x7efe3c152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36620/0 (socket says 172.21.15.130:36620) 2023-09-13T06:02:42.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe3bfff640 1 -- 172.21.15.130:0/2857774489 learned_addr learned my addr 172.21.15.130:0/2857774489 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:42.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe3affd640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe3c0ce1a0 0x7efe3c0b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe3b7fe640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe3c0afc70 0x7efe3c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe3bfff640 1 -- 172.21.15.130:0/2857774489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe3c0ce1a0 msgr2=0x7efe3c0b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe3bfff640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe3c0ce1a0 0x7efe3c0b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe3bfff640 1 -- 172.21.15.130:0/2857774489 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe3c0afc70 msgr2=0x7efe3c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:42.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe3bfff640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe3c0afc70 0x7efe3c0b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:42.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe3bfff640 1 -- 172.21.15.130:0/2857774489 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe34009b30 con 0x7efe3c15d260 2023-09-13T06:02:42.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe3bfff640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15d260 0x7efe3c152ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7efe340af040 tx=0x7efe34019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:42.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe23fff640 1 -- 172.21.15.130:0/2857774489 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe340b8670 con 0x7efe3c15d260 2023-09-13T06:02:42.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe23fff640 1 -- 172.21.15.130:0/2857774489 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe340b87d0 con 0x7efe3c15d260 2023-09-13T06:02:42.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe23fff640 1 -- 172.21.15.130:0/2857774489 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe340b8b80 con 0x7efe3c15d260 2023-09-13T06:02:42.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe41f40640 1 -- 172.21.15.130:0/2857774489 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c0cbe60 con 0x7efe3c15d260 2023-09-13T06:02:42.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe41f40640 1 -- 172.21.15.130:0/2857774489 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c1514c0 con 0x7efe3c15d260 2023-09-13T06:02:42.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.919+0000 7efe41f40640 1 -- 172.21.15.130:0/2857774489 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c151650 con 0x7efe3c15d260 2023-09-13T06:02:42.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.923+0000 7efe23fff640 1 -- 172.21.15.130:0/2857774489 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efe340b8ce0 con 0x7efe3c15d260 2023-09-13T06:02:42.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.923+0000 7efe23fff640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efe28065b20 0x7efe28067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:42.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.923+0000 7efe23fff640 1 -- 172.21.15.130:0/2857774489 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe3411e7b0 con 0x7efe3c15d260 2023-09-13T06:02:42.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.923+0000 7efe3b7fe640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efe28065b20 0x7efe28067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:42.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.923+0000 7efe3b7fe640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efe28065b20 0x7efe28067fe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efe2c000f70 tx=0x7efe2c007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:42.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:42.927+0000 7efe23fff640 1 -- 172.21.15.130:0/2857774489 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7efe340ec420 con 0x7efe3c15d260 2023-09-13T06:02:43.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.075+0000 7efe41f40640 1 -- 172.21.15.130:0/2857774489 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe3c0618a0 con 0x7efe3c15d260 2023-09-13T06:02:43.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.075+0000 7efe23fff640 1 -- 172.21.15.130:0/2857774489 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16605 (secure 0 0 0) 0x7efe340efa40 con 0x7efe3c15d260 2023-09-13T06:02:43.080 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:43.080 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:34.323976+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:15.867393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:17.140116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:43.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 -- 172.21.15.130:0/2857774489 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efe28065b20 msgr2=0x7efe28067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efe28065b20 0x7efe28067fe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efe2c000f70 tx=0x7efe2c007e50 comp rx=0 tx=0).stop 2023-09-13T06:02:43.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 -- 172.21.15.130:0/2857774489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15d260 msgr2=0x7efe3c152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15d260 0x7efe3c152ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7efe340af040 tx=0x7efe34019720 comp rx=0 tx=0).stop 2023-09-13T06:02:43.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 -- 172.21.15.130:0/2857774489 shutdown_connections 2023-09-13T06:02:43.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efe28065b20 0x7efe28067fe0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15d260 0x7efe3c152ce0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe3c0ce1a0 0x7efe3c0b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 --2- 172.21.15.130:0/2857774489 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe3c0afc70 0x7efe3c0b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 -- 172.21.15.130:0/2857774489 >> 172.21.15.130:0/2857774489 conn(0x7efe3c06a2f0 msgr2=0x7efe3c160280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:43.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 -- 172.21.15.130:0/2857774489 shutdown_connections 2023-09-13T06:02:43.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.079+0000 7efe41f40640 1 -- 172.21.15.130:0/2857774489 wait complete. 2023-09-13T06:02:43.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T06:02:43.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6ccce31640 1 Processor -- start 2023-09-13T06:02:43.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6ccce31640 1 -- start start 2023-09-13T06:02:43.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6ccce31640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6cc8161810 0x7f6cc80b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6ccce31640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cc80b7ca0 0x7f6cc80b8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6ccce31640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc8071440 con 0x7f6cc8146eb0 2023-09-13T06:02:43.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6ccce31640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc80b5130 con 0x7f6cc8161810 2023-09-13T06:02:43.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6ccce31640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80706a0 con 0x7f6cc80b7ca0 2023-09-13T06:02:43.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6cc6ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6cc8161810 0x7f6cc80b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6cc6ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6cc8161810 0x7f6cc80b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36626/0 (socket says 172.21.15.130:36626) 2023-09-13T06:02:43.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6cc77fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6cc8146eb0 0x7f6cc8161100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49616/0 (socket says 172.21.15.130:49616) 2023-09-13T06:02:43.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6cc6ffd640 1 -- 172.21.15.130:0/3621729811 learned_addr learned my addr 172.21.15.130:0/3621729811 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:43.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6cc7fff640 1 --2- 172.21.15.130:0/3621729811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cc80b7ca0 0x7f6cc80b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6cc6ffd640 1 -- 172.21.15.130:0/3621729811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cc80b7ca0 msgr2=0x7f6cc80b8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:43.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6cc6ffd640 1 --2- 172.21.15.130:0/3621729811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cc80b7ca0 0x7f6cc80b8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6cc6ffd640 1 -- 172.21.15.130:0/3621729811 >> v1:172.21.15.130:6789/0 conn(0x7f6cc8146eb0 legacy=0x7f6cc8161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6cc6ffd640 1 -- 172.21.15.130:0/3621729811 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8147290 con 0x7f6cc8161810 2023-09-13T06:02:43.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.239+0000 7f6cc67fc640 1 -- 172.21.15.130:0/3621729811 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622898550 0 0) 0x7f6cc8071440 con 0x7f6cc8146eb0 2023-09-13T06:02:43.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6cc6ffd640 1 --2- 172.21.15.130:0/3621729811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cc8161810 0x7f6cc80b64e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009870 tx=0x7f6cbc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7e0d253b2c7ce5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:43.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6cc67fc640 1 -- 172.21.15.130:0/3621729811 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0aa670 con 0x7f6cc8161810 2023-09-13T06:02:43.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6cc67fc640 1 -- 172.21.15.130:0/3621729811 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc0aa7d0 con 0x7f6cc8161810 2023-09-13T06:02:43.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6cc67fc640 1 -- 172.21.15.130:0/3621729811 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0aab60 con 0x7f6cc8161810 2023-09-13T06:02:43.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6ccce31640 1 -- 172.21.15.130:0/3621729811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cc8161810 msgr2=0x7f6cc80b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6ccce31640 1 --2- 172.21.15.130:0/3621729811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cc8161810 0x7f6cc80b64e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009870 tx=0x7f6cbc01c510 comp rx=0 tx=0).stop 2023-09-13T06:02:43.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6ccce31640 1 -- 172.21.15.130:0/3621729811 shutdown_connections 2023-09-13T06:02:43.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6ccce31640 1 --2- 172.21.15.130:0/3621729811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cc80b7ca0 0x7f6cc80b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6ccce31640 1 --2- 172.21.15.130:0/3621729811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cc8161810 0x7f6cc80b64e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6ccce31640 1 -- 172.21.15.130:0/3621729811 >> 172.21.15.130:0/3621729811 conn(0x7f6cc80cdd10 msgr2=0x7f6cc80ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:43.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6ccce31640 1 -- 172.21.15.130:0/3621729811 shutdown_connections 2023-09-13T06:02:43.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.243+0000 7f6ccce31640 1 -- 172.21.15.130:0/3621729811 wait complete. 2023-09-13T06:02:43.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6ccce31640 1 Processor -- start 2023-09-13T06:02:43.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6ccce31640 1 -- start start 2023-09-13T06:02:43.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6ccce31640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cc80b7ca0 0x7f6cc8151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6ccce31640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cc8146eb0 0x7f6cc815fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6ccce31640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cc8161810 0x7f6cc8155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6ccce31640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc815fbe0 con 0x7f6cc8146eb0 2023-09-13T06:02:43.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6ccce31640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc81602e0 con 0x7f6cc80b7ca0 2023-09-13T06:02:43.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6ccce31640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc815f620 con 0x7f6cc8161810 2023-09-13T06:02:43.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6cc6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cc8146eb0 0x7f6cc815fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6cc6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cc8146eb0 0x7f6cc815fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36638/0 (socket says 172.21.15.130:36638) 2023-09-13T06:02:43.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6cc6ffd640 1 -- 172.21.15.130:0/3075955190 learned_addr learned my addr 172.21.15.130:0/3075955190 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:43.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6cc77fe640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cc80b7ca0 0x7f6cc8151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6cc7fff640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cc8161810 0x7f6cc8155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6cc6ffd640 1 -- 172.21.15.130:0/3075955190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cc8161810 msgr2=0x7f6cc8155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6cc6ffd640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cc8161810 0x7f6cc8155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6cc6ffd640 1 -- 172.21.15.130:0/3075955190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cc80b7ca0 msgr2=0x7f6cc8151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6cc6ffd640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cc80b7ca0 0x7f6cc8151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6cc6ffd640 1 -- 172.21.15.130:0/3075955190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc0094d0 con 0x7f6cc8146eb0 2023-09-13T06:02:43.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6cc6ffd640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cc8146eb0 0x7f6cc815fda0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0ac040 tx=0x7f6cbc0192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:43.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6caffff640 1 -- 172.21.15.130:0/3075955190 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0b4810 con 0x7f6cc8146eb0 2023-09-13T06:02:43.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6caffff640 1 -- 172.21.15.130:0/3075955190 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc0b4990 con 0x7f6cc8146eb0 2023-09-13T06:02:43.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6caffff640 1 -- 172.21.15.130:0/3075955190 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0b4d40 con 0x7f6cc8146eb0 2023-09-13T06:02:43.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6ccce31640 1 -- 172.21.15.130:0/3075955190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc815f900 con 0x7f6cc8146eb0 2023-09-13T06:02:43.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.247+0000 7f6ccce31640 1 -- 172.21.15.130:0/3075955190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc81557e0 con 0x7f6cc8146eb0 2023-09-13T06:02:43.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.251+0000 7f6ccce31640 1 -- 172.21.15.130:0/3075955190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc8070b10 con 0x7f6cc8146eb0 2023-09-13T06:02:43.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.251+0000 7f6caffff640 1 -- 172.21.15.130:0/3075955190 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6cbc0be410 con 0x7f6cc8146eb0 2023-09-13T06:02:43.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.251+0000 7f6caffff640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cb4065b20 0x7f6cb4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.251+0000 7f6caffff640 1 -- 172.21.15.130:0/3075955190 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cbc11df20 con 0x7f6cc8146eb0 2023-09-13T06:02:43.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.251+0000 7f6cc77fe640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cb4065b20 0x7f6cb4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.251+0000 7f6cc77fe640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cb4065b20 0x7f6cb4067fe0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8000f70 tx=0x7f6cb8007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:43.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.255+0000 7f6caffff640 1 -- 172.21.15.130:0/3075955190 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6cc8070b10 con 0x7f6cc8146eb0 2023-09-13T06:02:43.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.435+0000 7f6ccce31640 1 -- 172.21.15.130:0/3075955190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6cc8070b10 con 0x7f6cc8146eb0 2023-09-13T06:02:43.439 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:02:43.435+0000 7faa00e50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T06:02:43.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.439+0000 7f6caffff640 1 -- 172.21.15.130:0/3075955190 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6cc8070b10 con 0x7f6cc8146eb0 2023-09-13T06:02:43.445 INFO:teuthology.orchestra.run.smithi130.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T06:02:43.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 -- 172.21.15.130:0/3075955190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cb4065b20 msgr2=0x7f6cb4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cb4065b20 0x7f6cb4067fe0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8000f70 tx=0x7f6cb8007b80 comp rx=0 tx=0).stop 2023-09-13T06:02:43.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 -- 172.21.15.130:0/3075955190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cc8146eb0 msgr2=0x7f6cc815fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cc8146eb0 0x7f6cc815fda0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0ac040 tx=0x7f6cbc0192b0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 -- 172.21.15.130:0/3075955190 shutdown_connections 2023-09-13T06:02:43.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cb4065b20 0x7f6cb4067fe0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cc8161810 0x7f6cc8155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cc8146eb0 0x7f6cc815fda0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 --2- 172.21.15.130:0/3075955190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cc80b7ca0 0x7f6cc8151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 -- 172.21.15.130:0/3075955190 >> 172.21.15.130:0/3075955190 conn(0x7f6cc80cdd10 msgr2=0x7f6cc80b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:43.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 -- 172.21.15.130:0/3075955190 shutdown_connections 2023-09-13T06:02:43.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.443+0000 7f6ccce31640 1 -- 172.21.15.130:0/3075955190 wait complete. 2023-09-13T06:02:43.456 INFO:tasks.ceph.mds.c.smithi130.stderr: -4728> 2023-09-13T06:02:22.732+0000 7f9033f2d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:02:43.469 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T06:02:43.508 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:02:43.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.607+0000 7f4ad160b640 1 Processor -- start 2023-09-13T06:02:43.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.607+0000 7f4ad160b640 1 -- start start 2023-09-13T06:02:43.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.607+0000 7f4ad160b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4acc157ca0 0x7f4acc15b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.607+0000 7f4ad160b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4acc0ccf00 0x7f4acc0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.607+0000 7f4ad160b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4acc15ada0 con 0x7f4acc0cd380 2023-09-13T06:02:43.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.607+0000 7f4ad160b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4acc15b770 con 0x7f4acc157ca0 2023-09-13T06:02:43.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.607+0000 7f4ad160b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0cdca0 con 0x7f4acc0ccf00 2023-09-13T06:02:43.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.607+0000 7f4acb7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4acc0cd380 0x7f4acc15de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49618/0 (socket says 172.21.15.130:49618) 2023-09-13T06:02:43.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.607+0000 7f4acb7fe640 1 -- 172.21.15.130:0/3142945542 learned_addr learned my addr 172.21.15.130:0/3142945542 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:43.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.607+0000 7f4ac27fc640 1 --2- 172.21.15.130:0/3142945542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4acc0ccf00 0x7f4acc0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.607+0000 7f4acaffd640 1 --2- 172.21.15.130:0/3142945542 >> v2:172.21.15.164:3300/0 conn(0x7f4acc157ca0 0x7f4acc15b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4aca7fc640 1 -- 172.21.15.130:0/3142945542 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583912700 0 0) 0x7f4acc15ada0 con 0x7f4acc0cd380 2023-09-13T06:02:43.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4aca7fc640 1 -- 172.21.15.130:0/3142945542 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ab8003530 con 0x7f4acc0cd380 2023-09-13T06:02:43.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4acaffd640 1 -- 172.21.15.130:0/3142945542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4acc0ccf00 msgr2=0x7f4acc0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:43.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4acaffd640 1 --2- 172.21.15.130:0/3142945542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4acc0ccf00 0x7f4acc0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4acaffd640 1 -- 172.21.15.130:0/3142945542 >> v1:172.21.15.130:6789/0 conn(0x7f4acc0cd380 legacy=0x7f4acc15de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4acaffd640 1 -- 172.21.15.130:0/3142945542 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc0cdf80 con 0x7f4acc157ca0 2023-09-13T06:02:43.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4ac27fc640 1 --2- 172.21.15.130:0/3142945542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4acc0ccf00 0x7f4acc0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:43.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4acaffd640 1 --2- 172.21.15.130:0/3142945542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4acc157ca0 0x7f4acc15b230 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0097c0 tx=0x7f4abc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5e0d17bde326db8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:43.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4aca7fc640 1 -- 172.21.15.130:0/3142945542 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0ab600 con 0x7f4acc157ca0 2023-09-13T06:02:43.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4aca7fc640 1 -- 172.21.15.130:0/3142945542 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc0a7050 con 0x7f4acc157ca0 2023-09-13T06:02:43.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4aca7fc640 1 -- 172.21.15.130:0/3142945542 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0ab980 con 0x7f4acc157ca0 2023-09-13T06:02:43.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4ad160b640 1 -- 172.21.15.130:0/3142945542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4acc157ca0 msgr2=0x7f4acc15b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.611+0000 7f4ad160b640 1 --2- 172.21.15.130:0/3142945542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4acc157ca0 0x7f4acc15b230 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0097c0 tx=0x7f4abc01c450 comp rx=0 tx=0).stop 2023-09-13T06:02:43.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 -- 172.21.15.130:0/3142945542 shutdown_connections 2023-09-13T06:02:43.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 --2- 172.21.15.130:0/3142945542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4acc0ccf00 0x7f4acc0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 --2- 172.21.15.130:0/3142945542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4acc157ca0 0x7f4acc15b230 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 -- 172.21.15.130:0/3142945542 >> 172.21.15.130:0/3142945542 conn(0x7f4acc065990 msgr2=0x7f4acc065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:43.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 -- 172.21.15.130:0/3142945542 shutdown_connections 2023-09-13T06:02:43.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 -- 172.21.15.130:0/3142945542 wait complete. 2023-09-13T06:02:43.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 Processor -- start 2023-09-13T06:02:43.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 -- start start 2023-09-13T06:02:43.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4acc0ccf00 0x7f4acc14a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4acc0cd380 0x7f4acc15ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4acc157ca0 0x7f4acc139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc159ad0 con 0x7f4acc0cd380 2023-09-13T06:02:43.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc159ef0 con 0x7f4acc0ccf00 2023-09-13T06:02:43.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ad160b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc158e50 con 0x7f4acc157ca0 2023-09-13T06:02:43.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ac27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4acc0cd380 0x7f4acc15ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ac27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4acc0cd380 0x7f4acc15ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36666/0 (socket says 172.21.15.130:36666) 2023-09-13T06:02:43.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ac27fc640 1 -- 172.21.15.130:0/1043881003 learned_addr learned my addr 172.21.15.130:0/1043881003 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:43.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4acaffd640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4acc0ccf00 0x7f4acc14a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4acb7fe640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4acc157ca0 0x7f4acc139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ac27fc640 1 -- 172.21.15.130:0/1043881003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4acc157ca0 msgr2=0x7f4acc139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ac27fc640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4acc157ca0 0x7f4acc139480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ac27fc640 1 -- 172.21.15.130:0/1043881003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4acc0ccf00 msgr2=0x7f4acc14a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:43.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ac27fc640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4acc0ccf00 0x7f4acc14a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:43.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ac27fc640 1 -- 172.21.15.130:0/1043881003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab400bc80 con 0x7f4acc0cd380 2023-09-13T06:02:43.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.615+0000 7f4ac27fc640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4acc0cd380 0x7f4acc15ca60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400e390 tx=0x7f4ab400e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:43.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.619+0000 7f4ac3fff640 1 -- 172.21.15.130:0/1043881003 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4010050 con 0x7f4acc0cd380 2023-09-13T06:02:43.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.619+0000 7f4ac3fff640 1 -- 172.21.15.130:0/1043881003 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab4011040 con 0x7f4acc0cd380 2023-09-13T06:02:43.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.619+0000 7f4ac3fff640 1 -- 172.21.15.130:0/1043881003 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4009740 con 0x7f4acc0cd380 2023-09-13T06:02:43.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.619+0000 7f4ad160b640 1 -- 172.21.15.130:0/1043881003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4abc009420 con 0x7f4acc0cd380 2023-09-13T06:02:43.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.619+0000 7f4ad160b640 1 -- 172.21.15.130:0/1043881003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4acc159410 con 0x7f4acc0cd380 2023-09-13T06:02:43.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.619+0000 7f4ad160b640 1 -- 172.21.15.130:0/1043881003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4acc159d40 con 0x7f4acc0cd380 2023-09-13T06:02:43.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.619+0000 7f4ac3fff640 1 -- 172.21.15.130:0/1043881003 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4ab40098a0 con 0x7f4acc0cd380 2023-09-13T06:02:43.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.619+0000 7f4ac3fff640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4aac065b50 0x7f4aac068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:43.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.619+0000 7f4ac3fff640 1 -- 172.21.15.130:0/1043881003 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4ab40858a0 con 0x7f4acc0cd380 2023-09-13T06:02:43.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.619+0000 7f4acaffd640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4aac065b50 0x7f4aac068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:43.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.619+0000 7f4acaffd640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4aac065b50 0x7f4aac068010 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0ad000 tx=0x7f4abc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:43.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.623+0000 7f4ac3fff640 1 -- 172.21.15.130:0/1043881003 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4ab4053230 con 0x7f4acc0cd380 2023-09-13T06:02:43.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:43.803+0000 7f4ad160b640 1 -- 172.21.15.130:0/1043881003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4acc0674a0 con 0x7f4acc0cd380 2023-09-13T06:02:44.043 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:02:44.047 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:02:44.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.459+0000 7f4ac3fff640 1 -- 172.21.15.130:0/1043881003 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4ab4056850 con 0x7f4acc0cd380 2023-09-13T06:02:44.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 -- 172.21.15.130:0/1043881003 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4aac065b50 msgr2=0x7f4aac068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:44.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4aac065b50 0x7f4aac068010 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0ad000 tx=0x7f4abc008040 comp rx=0 tx=0).stop 2023-09-13T06:02:44.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 -- 172.21.15.130:0/1043881003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4acc0cd380 msgr2=0x7f4acc15ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:44.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4acc0cd380 0x7f4acc15ca60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400e390 tx=0x7f4ab400e850 comp rx=0 tx=0).stop 2023-09-13T06:02:44.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 -- 172.21.15.130:0/1043881003 shutdown_connections 2023-09-13T06:02:44.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4aac065b50 0x7f4aac068010 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:44.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4acc157ca0 0x7f4acc139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:44.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4acc0cd380 0x7f4acc15ca60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:44.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 --2- 172.21.15.130:0/1043881003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4acc0ccf00 0x7f4acc14a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:44.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 -- 172.21.15.130:0/1043881003 >> 172.21.15.130:0/1043881003 conn(0x7f4acc065990 msgr2=0x7f4acc15bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:44.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 -- 172.21.15.130:0/1043881003 shutdown_connections 2023-09-13T06:02:44.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.463+0000 7f4ad160b640 1 -- 172.21.15.130:0/1043881003 wait complete. 2023-09-13T06:02:44.488 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T06:02:44.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.627+0000 7f0a48540640 1 Processor -- start 2023-09-13T06:02:44.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.627+0000 7f0a48540640 1 -- start start 2023-09-13T06:02:44.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.627+0000 7f0a48540640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a400b0fa0 0x7f0a400713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:44.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.627+0000 7f0a48540640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0a400cb940 0x7f0a400ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:44.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.627+0000 7f0a48540640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4015d890 con 0x7f0a4015d4b0 2023-09-13T06:02:44.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.627+0000 7f0a48540640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a400b2710 con 0x7f0a400cb940 2023-09-13T06:02:44.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.627+0000 7f0a48540640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a400cbeb0 con 0x7f0a400b0fa0 2023-09-13T06:02:44.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.627+0000 7f0a46add640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0a400cb940 0x7f0a400ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:44.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a462dc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0a4015d4b0 0x7f0a400b0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49630/0 (socket says 172.21.15.130:49630) 2023-09-13T06:02:44.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a462dc640 1 -- 172.21.15.130:0/1521831693 learned_addr learned my addr 172.21.15.130:0/1521831693 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:44.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a46add640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0a400cb940 0x7f0a400ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36682/0 (socket says 172.21.15.130:36682) 2023-09-13T06:02:44.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a45adb640 1 --2- 172.21.15.130:0/1521831693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a400b0fa0 0x7f0a400713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:44.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a46add640 1 -- 172.21.15.130:0/1521831693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a400b0fa0 msgr2=0x7f0a400713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:44.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a46add640 1 --2- 172.21.15.130:0/1521831693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a400b0fa0 0x7f0a400713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:44.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a46add640 1 -- 172.21.15.130:0/1521831693 >> v1:172.21.15.130:6789/0 conn(0x7f0a4015d4b0 legacy=0x7f0a400b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:44.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a46add640 1 -- 172.21.15.130:0/1521831693 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a400b2b30 con 0x7f0a400cb940 2023-09-13T06:02:44.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a46add640 1 --2- 172.21.15.130:0/1521831693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a400cb940 0x7f0a400ca160 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009d90 tx=0x7f0a3801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a0458cf7ecf44c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:44.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a452da640 1 -- 172.21.15.130:0/1521831693 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a380a5950 con 0x7f0a400cb940 2023-09-13T06:02:44.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a452da640 1 -- 172.21.15.130:0/1521831693 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a380a5ab0 con 0x7f0a400cb940 2023-09-13T06:02:44.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.631+0000 7f0a452da640 1 -- 172.21.15.130:0/1521831693 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a380a5e40 con 0x7f0a400cb940 2023-09-13T06:02:44.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 -- 172.21.15.130:0/1521831693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a400cb940 msgr2=0x7f0a400ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:44.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 --2- 172.21.15.130:0/1521831693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a400cb940 0x7f0a400ca160 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009d90 tx=0x7f0a3801c890 comp rx=0 tx=0).stop 2023-09-13T06:02:44.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 -- 172.21.15.130:0/1521831693 shutdown_connections 2023-09-13T06:02:44.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 --2- 172.21.15.130:0/1521831693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a400cb940 0x7f0a400ca160 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:44.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 --2- 172.21.15.130:0/1521831693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a400b0fa0 0x7f0a400713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:44.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 -- 172.21.15.130:0/1521831693 >> 172.21.15.130:0/1521831693 conn(0x7f0a40065f90 msgr2=0x7f0a400cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:44.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 -- 172.21.15.130:0/1521831693 shutdown_connections 2023-09-13T06:02:44.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 -- 172.21.15.130:0/1521831693 wait complete. 2023-09-13T06:02:44.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 Processor -- start 2023-09-13T06:02:44.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 -- start start 2023-09-13T06:02:44.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a400b0fa0 0x7f0a400c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:44.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a400cb940 0x7f0a4015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:44.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a4015d4b0 0x7f0a400c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:44.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4015a550 con 0x7f0a400b0fa0 2023-09-13T06:02:44.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4015a7d0 con 0x7f0a400cb940 2023-09-13T06:02:44.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a48540640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4015aab0 con 0x7f0a4015d4b0 2023-09-13T06:02:44.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a462dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a400b0fa0 0x7f0a400c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a462dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a400b0fa0 0x7f0a400c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36694/0 (socket says 172.21.15.130:36694) 2023-09-13T06:02:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a462dc640 1 -- 172.21.15.130:0/2442555174 learned_addr learned my addr 172.21.15.130:0/2442555174 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a45adb640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a400cb940 0x7f0a4015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a46add640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a4015d4b0 0x7f0a400c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a462dc640 1 -- 172.21.15.130:0/2442555174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a4015d4b0 msgr2=0x7f0a400c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a462dc640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a4015d4b0 0x7f0a400c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a462dc640 1 -- 172.21.15.130:0/2442555174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a400cb940 msgr2=0x7f0a4015a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a462dc640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a400cb940 0x7f0a4015a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a462dc640 1 -- 172.21.15.130:0/2442555174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38009a70 con 0x7f0a400b0fa0 2023-09-13T06:02:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.635+0000 7f0a45adb640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a400cb940 0x7f0a4015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.639+0000 7f0a462dc640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a400b0fa0 0x7f0a400c32f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00c400 tx=0x7f0a3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:44.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.639+0000 7f0a36ffd640 1 -- 172.21.15.130:0/2442555174 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c005cf0 con 0x7f0a400b0fa0 2023-09-13T06:02:44.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.639+0000 7f0a36ffd640 1 -- 172.21.15.130:0/2442555174 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c005e50 con 0x7f0a400b0fa0 2023-09-13T06:02:44.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.639+0000 7f0a36ffd640 1 -- 172.21.15.130:0/2442555174 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0072d0 con 0x7f0a400b0fa0 2023-09-13T06:02:44.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.639+0000 7f0a48540640 1 -- 172.21.15.130:0/2442555174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4015ad90 con 0x7f0a400b0fa0 2023-09-13T06:02:44.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.639+0000 7f0a48540640 1 -- 172.21.15.130:0/2442555174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4015b350 con 0x7f0a400b0fa0 2023-09-13T06:02:44.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.639+0000 7f0a48540640 1 -- 172.21.15.130:0/2442555174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a400618a0 con 0x7f0a400b0fa0 2023-09-13T06:02:44.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.639+0000 7f0a36ffd640 1 -- 172.21.15.130:0/2442555174 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0a3c007430 con 0x7f0a400b0fa0 2023-09-13T06:02:44.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.639+0000 7f0a36ffd640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0a24065b20 0x7f0a24067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:44.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.639+0000 7f0a36ffd640 1 -- 172.21.15.130:0/2442555174 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0a3c082820 con 0x7f0a400b0fa0 2023-09-13T06:02:44.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.639+0000 7f0a45adb640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0a24065b20 0x7f0a24067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:44.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.643+0000 7f0a45adb640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0a24065b20 0x7f0a24067fe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009bb0 tx=0x7f0a30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:44.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.643+0000 7f0a36ffd640 1 -- 172.21.15.130:0/2442555174 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0a3c0501b0 con 0x7f0a400b0fa0 2023-09-13T06:02:44.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:44.791+0000 7f0a48540640 1 -- 172.21.15.130:0/2442555174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a400b39c0 con 0x7f0a400b0fa0 2023-09-13T06:02:45.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.471+0000 7f0a36ffd640 1 -- 172.21.15.130:0/2442555174 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0a3c0537d0 con 0x7f0a400b0fa0 2023-09-13T06:02:45.475 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' removed 2023-09-13T06:02:45.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.471+0000 7f0a48540640 1 -- 172.21.15.130:0/2442555174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0a24065b20 msgr2=0x7f0a24067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:45.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.471+0000 7f0a48540640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0a24065b20 0x7f0a24067fe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009bb0 tx=0x7f0a30008040 comp rx=0 tx=0).stop 2023-09-13T06:02:45.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.471+0000 7f0a48540640 1 -- 172.21.15.130:0/2442555174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a400b0fa0 msgr2=0x7f0a400c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:45.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.471+0000 7f0a48540640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a400b0fa0 0x7f0a400c32f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00c400 tx=0x7f0a3c00c8c0 comp rx=0 tx=0).stop 2023-09-13T06:02:45.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.471+0000 7f0a48540640 1 -- 172.21.15.130:0/2442555174 shutdown_connections 2023-09-13T06:02:45.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.471+0000 7f0a48540640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0a24065b20 0x7f0a24067fe0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:45.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.471+0000 7f0a48540640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a400cb940 0x7f0a4015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:45.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.471+0000 7f0a48540640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a4015d4b0 0x7f0a400c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:45.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.471+0000 7f0a48540640 1 --2- 172.21.15.130:0/2442555174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a400b0fa0 0x7f0a400c32f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:45.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.471+0000 7f0a48540640 1 -- 172.21.15.130:0/2442555174 >> 172.21.15.130:0/2442555174 conn(0x7f0a40065f90 msgr2=0x7f0a401675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:45.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.475+0000 7f0a48540640 1 -- 172.21.15.130:0/2442555174 shutdown_connections 2023-09-13T06:02:45.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.475+0000 7f0a48540640 1 -- 172.21.15.130:0/2442555174 wait complete. 2023-09-13T06:02:45.499 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T06:02:45.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6f4cb640 1 Processor -- start 2023-09-13T06:02:45.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6f4cb640 1 -- start start 2023-09-13T06:02:45.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6f4cb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fca680d0c10 0x7fca68160de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:45.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6f4cb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6815d900 con 0x7fca68143460 2023-09-13T06:02:45.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6f4cb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca680d0ff0 con 0x7fca6806f530 2023-09-13T06:02:45.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6f4cb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca68140740 con 0x7fca680d0c10 2023-09-13T06:02:45.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6d267640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fca680d0c10 0x7fca68160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:45.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6ca66640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fca68143460 0x7fca680b6f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49632/0 (socket says 172.21.15.130:49632) 2023-09-13T06:02:45.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6ca66640 1 -- 172.21.15.130:0/2809031023 learned_addr learned my addr 172.21.15.130:0/2809031023 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:45.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6d267640 1 -- 172.21.15.130:0/2809031023 >> v1:172.21.15.164:6789/0 conn(0x7fca6806f530 legacy=0x7fca6806f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:45.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6d267640 1 -- 172.21.15.130:0/2809031023 >> v1:172.21.15.130:6789/0 conn(0x7fca68143460 legacy=0x7fca680b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:45.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca6d267640 1 -- 172.21.15.130:0/2809031023 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca680b7670 con 0x7fca680d0c10 2023-09-13T06:02:45.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.639+0000 7fca5ffff640 1 -- 172.21.15.130:0/2809031023 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235282323 0 0) 0x7fca6815d900 con 0x7fca68143460 2023-09-13T06:02:45.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.643+0000 7fca6d267640 1 --2- 172.21.15.130:0/2809031023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca680d0c10 0x7fca68160de0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fca640097c0 tx=0x7fca6401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498d368085b9a6e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:45.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.643+0000 7fca5ffff640 1 -- 172.21.15.130:0/2809031023 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca640ab650 con 0x7fca680d0c10 2023-09-13T06:02:45.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.643+0000 7fca5ffff640 1 -- 172.21.15.130:0/2809031023 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca640ab7b0 con 0x7fca680d0c10 2023-09-13T06:02:45.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.643+0000 7fca5ffff640 1 -- 172.21.15.130:0/2809031023 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca640abb40 con 0x7fca680d0c10 2023-09-13T06:02:45.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.643+0000 7fca6f4cb640 1 -- 172.21.15.130:0/2809031023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca680d0c10 msgr2=0x7fca68160de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:45.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.643+0000 7fca6f4cb640 1 --2- 172.21.15.130:0/2809031023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca680d0c10 0x7fca68160de0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fca640097c0 tx=0x7fca6401c450 comp rx=0 tx=0).stop 2023-09-13T06:02:45.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.643+0000 7fca6f4cb640 1 -- 172.21.15.130:0/2809031023 shutdown_connections 2023-09-13T06:02:45.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.643+0000 7fca6f4cb640 1 --2- 172.21.15.130:0/2809031023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca680d0c10 0x7fca68160de0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:45.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.643+0000 7fca6f4cb640 1 -- 172.21.15.130:0/2809031023 >> 172.21.15.130:0/2809031023 conn(0x7fca68065990 msgr2=0x7fca68065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:45.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.643+0000 7fca6f4cb640 1 -- 172.21.15.130:0/2809031023 shutdown_connections 2023-09-13T06:02:45.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.643+0000 7fca6f4cb640 1 -- 172.21.15.130:0/2809031023 wait complete. 2023-09-13T06:02:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6f4cb640 1 Processor -- start 2023-09-13T06:02:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6f4cb640 1 -- start start 2023-09-13T06:02:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6f4cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca6806f530 0x7fca6813c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6f4cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca680d0c10 0x7fca6813fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6f4cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca68143460 0x7fca68156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6f4cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6813e2f0 con 0x7fca680d0c10 2023-09-13T06:02:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6f4cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6813e5d0 con 0x7fca68143460 2023-09-13T06:02:45.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6f4cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6813e8b0 con 0x7fca6806f530 2023-09-13T06:02:45.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6ca66640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca680d0c10 0x7fca6813fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:45.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6ca66640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca680d0c10 0x7fca6813fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36720/0 (socket says 172.21.15.130:36720) 2023-09-13T06:02:45.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6ca66640 1 -- 172.21.15.130:0/3579107229 learned_addr learned my addr 172.21.15.130:0/3579107229 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:45.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6da68640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca68143460 0x7fca68156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:45.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6d267640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca6806f530 0x7fca6813c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:45.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6ca66640 1 -- 172.21.15.130:0/3579107229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca6806f530 msgr2=0x7fca6813c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:45.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6ca66640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca6806f530 0x7fca6813c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:45.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6ca66640 1 -- 172.21.15.130:0/3579107229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca68143460 msgr2=0x7fca68156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:45.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6ca66640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca68143460 0x7fca68156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:45.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6ca66640 1 -- 172.21.15.130:0/3579107229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca64009420 con 0x7fca680d0c10 2023-09-13T06:02:45.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6ca66640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca680d0c10 0x7fca6813fb20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fca5800c4a0 tx=0x7fca5800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:45.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca5dffb640 1 -- 172.21.15.130:0/3579107229 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580074e0 con 0x7fca680d0c10 2023-09-13T06:02:45.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca5dffb640 1 -- 172.21.15.130:0/3579107229 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca58007640 con 0x7fca680d0c10 2023-09-13T06:02:45.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca5dffb640 1 -- 172.21.15.130:0/3579107229 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58004a30 con 0x7fca680d0c10 2023-09-13T06:02:45.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6f4cb640 1 -- 172.21.15.130:0/3579107229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6813eb90 con 0x7fca680d0c10 2023-09-13T06:02:45.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6f4cb640 1 -- 172.21.15.130:0/3579107229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca68143dd0 con 0x7fca680d0c10 2023-09-13T06:02:45.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.647+0000 7fca6f4cb640 1 -- 172.21.15.130:0/3579107229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca680618a0 con 0x7fca680d0c10 2023-09-13T06:02:45.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.651+0000 7fca5dffb640 1 -- 172.21.15.130:0/3579107229 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fca58004b90 con 0x7fca680d0c10 2023-09-13T06:02:45.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.651+0000 7fca5dffb640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca4c065af0 0x7fca4c067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:45.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.651+0000 7fca5dffb640 1 -- 172.21.15.130:0/3579107229 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fca580823f0 con 0x7fca680d0c10 2023-09-13T06:02:45.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.651+0000 7fca6d267640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca4c065af0 0x7fca4c067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:45.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.651+0000 7fca6d267640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca4c065af0 0x7fca4c067fb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca640af000 tx=0x7fca640a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:45.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.655+0000 7fca5dffb640 1 -- 172.21.15.130:0/3579107229 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fca5804feb0 con 0x7fca680d0c10 2023-09-13T06:02:45.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:45.803+0000 7fca6f4cb640 1 -- 172.21.15.130:0/3579107229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca6813f040 con 0x7fca680d0c10 2023-09-13T06:02:46.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.483+0000 7fca5dffb640 1 -- 172.21.15.130:0/3579107229 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7fca580180d0 con 0x7fca680d0c10 2023-09-13T06:02:46.489 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' removed 2023-09-13T06:02:46.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 -- 172.21.15.130:0/3579107229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca4c065af0 msgr2=0x7fca4c067fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:46.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca4c065af0 0x7fca4c067fb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca640af000 tx=0x7fca640a7000 comp rx=0 tx=0).stop 2023-09-13T06:02:46.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 -- 172.21.15.130:0/3579107229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca680d0c10 msgr2=0x7fca6813fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:46.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca680d0c10 0x7fca6813fb20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fca5800c4a0 tx=0x7fca5800c960 comp rx=0 tx=0).stop 2023-09-13T06:02:46.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 -- 172.21.15.130:0/3579107229 shutdown_connections 2023-09-13T06:02:46.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca4c065af0 0x7fca4c067fb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca68143460 0x7fca68156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca680d0c10 0x7fca6813fb20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 --2- 172.21.15.130:0/3579107229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca6806f530 0x7fca6813c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 -- 172.21.15.130:0/3579107229 >> 172.21.15.130:0/3579107229 conn(0x7fca68065990 msgr2=0x7fca68142ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:46.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 -- 172.21.15.130:0/3579107229 shutdown_connections 2023-09-13T06:02:46.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.487+0000 7fca6f4cb640 1 -- 172.21.15.130:0/3579107229 wait complete. 2023-09-13T06:02:46.514 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-13T06:02:46.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.651+0000 7ff80132c640 1 Processor -- start 2023-09-13T06:02:46.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.651+0000 7ff80132c640 1 -- start start 2023-09-13T06:02:46.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff80132c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff7fc146f10 0x7ff7fc0ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:46.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff80132c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7fc161f10 0x7ff7fc0d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:46.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff80132c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc0ab700 con 0x7ff7fc0d2b00 2023-09-13T06:02:46.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff80132c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc0aa120 con 0x7ff7fc146f10 2023-09-13T06:02:46.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff80132c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0aa400 con 0x7ff7fc161f10 2023-09-13T06:02:46.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff7faffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff7fc146f10 0x7ff7fc0ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:46.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff7faffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff7fc146f10 0x7ff7fc0ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36726/0 (socket says 172.21.15.130:36726) 2023-09-13T06:02:46.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff7faffd640 1 -- 172.21.15.130:0/4261208124 learned_addr learned my addr 172.21.15.130:0/4261208124 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:46.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff7f3fff640 1 --2- 172.21.15.130:0/4261208124 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7fc161f10 0x7ff7fc0d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:46.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff7faffd640 1 -- 172.21.15.130:0/4261208124 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7fc161f10 msgr2=0x7ff7fc0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:46.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff7faffd640 1 --2- 172.21.15.130:0/4261208124 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7fc161f10 0x7ff7fc0d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff7faffd640 1 -- 172.21.15.130:0/4261208124 >> v1:172.21.15.164:6789/0 conn(0x7ff7fc0d2b00 legacy=0x7ff7fc0d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:46.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.655+0000 7ff7faffd640 1 -- 172.21.15.130:0/4261208124 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc0aa6e0 con 0x7ff7fc146f10 2023-09-13T06:02:46.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff7faffd640 1 --2- 172.21.15.130:0/4261208124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7fc146f10 0x7ff7fc0ab1c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009870 tx=0x7ff7ec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3058680036c6c4e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:46.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff7fa7fc640 1 -- 172.21.15.130:0/4261208124 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec0aa670 con 0x7ff7fc146f10 2023-09-13T06:02:46.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff7fa7fc640 1 -- 172.21.15.130:0/4261208124 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec0aa7d0 con 0x7ff7fc146f10 2023-09-13T06:02:46.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff7fa7fc640 1 -- 172.21.15.130:0/4261208124 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec0aab60 con 0x7ff7fc146f10 2023-09-13T06:02:46.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff80132c640 1 -- 172.21.15.130:0/4261208124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7fc146f10 msgr2=0x7ff7fc0ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:46.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff80132c640 1 --2- 172.21.15.130:0/4261208124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7fc146f10 0x7ff7fc0ab1c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009870 tx=0x7ff7ec01c510 comp rx=0 tx=0).stop 2023-09-13T06:02:46.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff80132c640 1 -- 172.21.15.130:0/4261208124 shutdown_connections 2023-09-13T06:02:46.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff80132c640 1 --2- 172.21.15.130:0/4261208124 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7fc161f10 0x7ff7fc0d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff80132c640 1 --2- 172.21.15.130:0/4261208124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7fc146f10 0x7ff7fc0ab1c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff80132c640 1 -- 172.21.15.130:0/4261208124 >> 172.21.15.130:0/4261208124 conn(0x7ff7fc065990 msgr2=0x7ff7fc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:46.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff80132c640 1 -- 172.21.15.130:0/4261208124 shutdown_connections 2023-09-13T06:02:46.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff80132c640 1 -- 172.21.15.130:0/4261208124 wait complete. 2023-09-13T06:02:46.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff80132c640 1 Processor -- start 2023-09-13T06:02:46.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.659+0000 7ff80132c640 1 -- start start 2023-09-13T06:02:46.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff80132c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7fc0d2b00 0x7ff7fc153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:46.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff80132c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7fc146f10 0x7ff7fc1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:46.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff80132c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7fc159d50 0x7ff7fc1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:46.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff80132c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc158780 con 0x7ff7fc146f10 2023-09-13T06:02:46.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff80132c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1589d0 con 0x7ff7fc0d2b00 2023-09-13T06:02:46.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff80132c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc158cb0 con 0x7ff7fc159d50 2023-09-13T06:02:46.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7fc146f10 0x7ff7fc1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:46.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7fc146f10 0x7ff7fc1591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36738/0 (socket says 172.21.15.130:36738) 2023-09-13T06:02:46.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f3fff640 1 -- 172.21.15.130:0/2546648987 learned_addr learned my addr 172.21.15.130:0/2546648987 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:46.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7fb7fe640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7fc159d50 0x7ff7fc1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:46.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7faffd640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7fc0d2b00 0x7ff7fc153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:46.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f3fff640 1 -- 172.21.15.130:0/2546648987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7fc159d50 msgr2=0x7ff7fc1596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:46.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f3fff640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7fc159d50 0x7ff7fc1596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f3fff640 1 -- 172.21.15.130:0/2546648987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7fc0d2b00 msgr2=0x7ff7fc153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:46.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f3fff640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7fc0d2b00 0x7ff7fc153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f3fff640 1 -- 172.21.15.130:0/2546648987 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec0094d0 con 0x7ff7fc146f10 2023-09-13T06:02:46.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f3fff640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7fc146f10 0x7ff7fc1591b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400d5f0 tx=0x7ff7e400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:46.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f37fe640 1 -- 172.21.15.130:0/2546648987 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40125f0 con 0x7ff7fc146f10 2023-09-13T06:02:46.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f37fe640 1 -- 172.21.15.130:0/2546648987 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e4012750 con 0x7ff7fc146f10 2023-09-13T06:02:46.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff80132c640 1 -- 172.21.15.130:0/2546648987 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc1f7620 con 0x7ff7fc146f10 2023-09-13T06:02:46.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f37fe640 1 -- 172.21.15.130:0/2546648987 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4012b00 con 0x7ff7fc146f10 2023-09-13T06:02:46.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff80132c640 1 -- 172.21.15.130:0/2546648987 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc1542e0 con 0x7ff7fc146f10 2023-09-13T06:02:46.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff80132c640 1 -- 172.21.15.130:0/2546648987 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7fc0674a0 con 0x7ff7fc146f10 2023-09-13T06:02:46.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.663+0000 7ff7f37fe640 1 -- 172.21.15.130:0/2546648987 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff7e4012c60 con 0x7ff7fc146f10 2023-09-13T06:02:46.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.667+0000 7ff7f37fe640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7dc065b20 0x7ff7dc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:46.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.667+0000 7ff7f37fe640 1 -- 172.21.15.130:0/2546648987 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff7e40833e0 con 0x7ff7fc146f10 2023-09-13T06:02:46.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.667+0000 7ff7faffd640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7dc065b20 0x7ff7dc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:46.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.667+0000 7ff7faffd640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7dc065b20 0x7ff7dc067fe0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0ae000 tx=0x7ff7ec0b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:46.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.671+0000 7ff7f37fe640 1 -- 172.21.15.130:0/2546648987 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff7e40510c0 con 0x7ff7fc146f10 2023-09-13T06:02:46.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.815+0000 7ff80132c640 1 -- 172.21.15.130:0/2546648987 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff7fc073e50 con 0x7ff7fc146f10 2023-09-13T06:02:46.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.823+0000 7ff7f37fe640 1 -- 172.21.15.130:0/2546648987 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff7e40546e0 con 0x7ff7fc146f10 2023-09-13T06:02:46.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 -- 172.21.15.130:0/2546648987 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7dc065b20 msgr2=0x7ff7dc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:46.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7dc065b20 0x7ff7dc067fe0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0ae000 tx=0x7ff7ec0b5040 comp rx=0 tx=0).stop 2023-09-13T06:02:46.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 -- 172.21.15.130:0/2546648987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7fc146f10 msgr2=0x7ff7fc1591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:46.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7fc146f10 0x7ff7fc1591b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400d5f0 tx=0x7ff7e400dab0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 -- 172.21.15.130:0/2546648987 shutdown_connections 2023-09-13T06:02:46.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff7dc065b20 0x7ff7dc067fe0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7fc159d50 0x7ff7fc1596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7fc146f10 0x7ff7fc1591b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 --2- 172.21.15.130:0/2546648987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7fc0d2b00 0x7ff7fc153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:46.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 -- 172.21.15.130:0/2546648987 >> 172.21.15.130:0/2546648987 conn(0x7ff7fc065990 msgr2=0x7ff7fc1359d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:46.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 -- 172.21.15.130:0/2546648987 shutdown_connections 2023-09-13T06:02:46.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.827+0000 7ff80132c640 1 -- 172.21.15.130:0/2546648987 wait complete. 2023-09-13T06:02:46.850 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-09-13T06:02:46.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa6867c6640 1 Processor -- start 2023-09-13T06:02:46.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa6867c6640 1 -- start start 2023-09-13T06:02:46.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa6867c6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa6800d1090 0x7fa68015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:46.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa6867c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa680146f30 0x7fa6800b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:46.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa6867c6640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6800b63c0 con 0x7fa6800d1750 2023-09-13T06:02:46.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa6867c6640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68015dea0 con 0x7fa6800d1090 2023-09-13T06:02:46.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa6867c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800d0c20 con 0x7fa680146f30 2023-09-13T06:02:47.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa677fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa6800d1090 0x7fa68015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa684d63640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa680146f30 0x7fa6800b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa67ffff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fa6800d1750 0x7fa680146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:44842/0 (socket says 172.21.15.130:44842) 2023-09-13T06:02:47.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa67ffff640 1 -- 172.21.15.130:0/3039490190 learned_addr learned my addr 172.21.15.130:0/3039490190 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:47.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa677fff640 1 -- 172.21.15.130:0/3039490190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa680146f30 msgr2=0x7fa6800b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:47.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa677fff640 1 --2- 172.21.15.130:0/3039490190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa680146f30 0x7fa6800b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa677fff640 1 -- 172.21.15.130:0/3039490190 >> v1:172.21.15.164:6789/0 conn(0x7fa6800d1750 legacy=0x7fa680146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa677fff640 1 -- 172.21.15.130:0/3039490190 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6800b6610 con 0x7fa6800d1090 2023-09-13T06:02:47.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.991+0000 7fa684d63640 1 --2- 172.21.15.130:0/3039490190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa680146f30 0x7fa6800b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:47.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa677fff640 1 --2- 172.21.15.130:0/3039490190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6800d1090 0x7fa68015d960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa6680097c0 tx=0x7fa66801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1effda4a62a99a7c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:47.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa67f7fe640 1 -- 172.21.15.130:0/3039490190 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6680ab650 con 0x7fa6800d1090 2023-09-13T06:02:47.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa67f7fe640 1 -- 172.21.15.130:0/3039490190 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6680ab7b0 con 0x7fa6800d1090 2023-09-13T06:02:47.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa67f7fe640 1 -- 172.21.15.130:0/3039490190 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6680abb40 con 0x7fa6800d1090 2023-09-13T06:02:47.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa6867c6640 1 -- 172.21.15.130:0/3039490190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6800d1090 msgr2=0x7fa68015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa6867c6640 1 --2- 172.21.15.130:0/3039490190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6800d1090 0x7fa68015d960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa6680097c0 tx=0x7fa66801c450 comp rx=0 tx=0).stop 2023-09-13T06:02:47.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa6867c6640 1 -- 172.21.15.130:0/3039490190 shutdown_connections 2023-09-13T06:02:47.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa6867c6640 1 --2- 172.21.15.130:0/3039490190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa680146f30 0x7fa6800b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa6867c6640 1 --2- 172.21.15.130:0/3039490190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6800d1090 0x7fa68015d960 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa6867c6640 1 -- 172.21.15.130:0/3039490190 >> 172.21.15.130:0/3039490190 conn(0x7fa68006f170 msgr2=0x7fa68006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:47.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa6867c6640 1 -- 172.21.15.130:0/3039490190 shutdown_connections 2023-09-13T06:02:47.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.995+0000 7fa6867c6640 1 -- 172.21.15.130:0/3039490190 wait complete. 2023-09-13T06:02:47.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa6867c6640 1 Processor -- start 2023-09-13T06:02:47.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa6867c6640 1 -- start start 2023-09-13T06:02:47.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa6867c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6800d1090 0x7fa68013ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa6867c6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6800d1750 0x7fa680141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa6867c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa680146f30 0x7fa68015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa6867c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa680164ab0 con 0x7fa6800d1090 2023-09-13T06:02:47.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa6867c6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68013f490 con 0x7fa6800d1750 2023-09-13T06:02:47.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa6867c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa680141950 con 0x7fa680146f30 2023-09-13T06:02:47.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6800d1090 0x7fa68013ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6800d1090 0x7fa68013ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36742/0 (socket says 172.21.15.130:36742) 2023-09-13T06:02:47.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67ffff640 1 -- 172.21.15.130:0/2221261544 learned_addr learned my addr 172.21.15.130:0/2221261544 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:47.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa677fff640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6800d1750 0x7fa680141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa684d63640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa680146f30 0x7fa68015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67ffff640 1 -- 172.21.15.130:0/2221261544 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa680146f30 msgr2=0x7fa68015c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67ffff640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa680146f30 0x7fa68015c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67ffff640 1 -- 172.21.15.130:0/2221261544 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6800d1750 msgr2=0x7fa680141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67ffff640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6800d1750 0x7fa680141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67ffff640 1 -- 172.21.15.130:0/2221261544 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678009a70 con 0x7fa6800d1090 2023-09-13T06:02:47.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67ffff640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6800d1090 0x7fa68013ef50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c420 tx=0x7fa67000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:47.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67d7fa640 1 -- 172.21.15.130:0/2221261544 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670005cf0 con 0x7fa6800d1090 2023-09-13T06:02:47.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67d7fa640 1 -- 172.21.15.130:0/2221261544 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa670005e50 con 0x7fa6800d1090 2023-09-13T06:02:47.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa6867c6640 1 -- 172.21.15.130:0/2221261544 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa668009420 con 0x7fa6800d1090 2023-09-13T06:02:47.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa67d7fa640 1 -- 172.21.15.130:0/2221261544 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6700072f0 con 0x7fa6800d1090 2023-09-13T06:02:47.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:46.999+0000 7fa6867c6640 1 -- 172.21.15.130:0/2221261544 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6800b7e40 con 0x7fa6800d1090 2023-09-13T06:02:47.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.003+0000 7fa6867c6640 1 -- 172.21.15.130:0/2221261544 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6800618a0 con 0x7fa6800d1090 2023-09-13T06:02:47.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.003+0000 7fa67d7fa640 1 -- 172.21.15.130:0/2221261544 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa670007450 con 0x7fa6800d1090 2023-09-13T06:02:47.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.003+0000 7fa67d7fa640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa660065b20 0x7fa660067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.003+0000 7fa67d7fa640 1 -- 172.21.15.130:0/2221261544 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa670082570 con 0x7fa6800d1090 2023-09-13T06:02:47.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.003+0000 7fa677fff640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa660065b20 0x7fa660067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.003+0000 7fa677fff640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa660065b20 0x7fa660067fe0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa6680af000 tx=0x7fa6680a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:47.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.007+0000 7fa67d7fa640 1 -- 172.21.15.130:0/2221261544 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa6700501e0 con 0x7fa6800d1090 2023-09-13T06:02:47.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.207+0000 7fa6867c6640 1 -- 172.21.15.130:0/2221261544 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7fa6800b86c0 con 0x7fa6800d1090 2023-09-13T06:02:47.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.491+0000 7fa67d7fa640 1 -- 172.21.15.130:0/2221261544 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v98) v1 ==== 130+0+0 (secure 0 0 0) 0x7fa670053800 con 0x7fa6800d1090 2023-09-13T06:02:47.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.491+0000 7fa6867c6640 1 -- 172.21.15.130:0/2221261544 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa660065b20 msgr2=0x7fa660067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.491+0000 7fa6867c6640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa660065b20 0x7fa660067fe0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa6680af000 tx=0x7fa6680a7000 comp rx=0 tx=0).stop 2023-09-13T06:02:47.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.491+0000 7fa6867c6640 1 -- 172.21.15.130:0/2221261544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6800d1090 msgr2=0x7fa68013ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.491+0000 7fa6867c6640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6800d1090 0x7fa68013ef50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c420 tx=0x7fa67000c820 comp rx=0 tx=0).stop 2023-09-13T06:02:47.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.495+0000 7fa6867c6640 1 -- 172.21.15.130:0/2221261544 shutdown_connections 2023-09-13T06:02:47.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.495+0000 7fa6867c6640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa660065b20 0x7fa660067fe0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.495+0000 7fa6867c6640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6800d1750 0x7fa680141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.495+0000 7fa6867c6640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa680146f30 0x7fa68015c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.495+0000 7fa6867c6640 1 --2- 172.21.15.130:0/2221261544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6800d1090 0x7fa68013ef50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.495+0000 7fa6867c6640 1 -- 172.21.15.130:0/2221261544 >> 172.21.15.130:0/2221261544 conn(0x7fa68006f170 msgr2=0x7fa68015ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:47.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.495+0000 7fa6867c6640 1 -- 172.21.15.130:0/2221261544 shutdown_connections 2023-09-13T06:02:47.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.495+0000 7fa6867c6640 1 -- 172.21.15.130:0/2221261544 wait complete. 2023-09-13T06:02:47.518 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-09-13T06:02:47.519 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-09-13T06:02:47.519 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:47.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb801f10640 1 Processor -- start 2023-09-13T06:02:47.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb801f10640 1 -- start start 2023-09-13T06:02:47.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb801f10640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb7fc146f30 0x7fb7fc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb801f10640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc0b63c0 con 0x7fb7fc0d1090 2023-09-13T06:02:47.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb801f10640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc0d0c20 con 0x7fb7fc0d1750 2023-09-13T06:02:47.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb801f10640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc15dea0 con 0x7fb7fc146f30 2023-09-13T06:02:47.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb7fbfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb7fc146f30 0x7fb7fc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb7fbfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb7fc146f30 0x7fb7fc15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36754/0 (socket says 172.21.15.130:36754) 2023-09-13T06:02:47.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb7fbfff640 1 -- 172.21.15.130:0/4032920305 learned_addr learned my addr 172.21.15.130:0/4032920305 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:47.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb7fbfff640 1 -- 172.21.15.130:0/4032920305 >> v1:172.21.15.164:6789/0 conn(0x7fb7fc0d1750 legacy=0x7fb7fc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:47.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb7fbfff640 1 -- 172.21.15.130:0/4032920305 >> v1:172.21.15.130:6789/0 conn(0x7fb7fc0d1090 legacy=0x7fb7fc0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.655+0000 7fb7fbfff640 1 -- 172.21.15.130:0/4032920305 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0b6610 con 0x7fb7fc146f30 2023-09-13T06:02:47.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb7fbfff640 1 --2- 172.21.15.130:0/4032920305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc146f30 0x7fb7fc15d960 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009e50 tx=0x7fb7f401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ccfc3b7c55c1ed server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:47.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb7fa7fc640 1 -- 172.21.15.130:0/4032920305 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40a57d0 con 0x7fb7fc146f30 2023-09-13T06:02:47.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb7fa7fc640 1 -- 172.21.15.130:0/4032920305 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f40a5930 con 0x7fb7fc146f30 2023-09-13T06:02:47.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb7fa7fc640 1 -- 172.21.15.130:0/4032920305 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40a5cc0 con 0x7fb7fc146f30 2023-09-13T06:02:47.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb801f10640 1 -- 172.21.15.130:0/4032920305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc146f30 msgr2=0x7fb7fc15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb801f10640 1 --2- 172.21.15.130:0/4032920305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc146f30 0x7fb7fc15d960 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009e50 tx=0x7fb7f401c910 comp rx=0 tx=0).stop 2023-09-13T06:02:47.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb801f10640 1 -- 172.21.15.130:0/4032920305 shutdown_connections 2023-09-13T06:02:47.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb801f10640 1 --2- 172.21.15.130:0/4032920305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc146f30 0x7fb7fc15d960 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb801f10640 1 -- 172.21.15.130:0/4032920305 >> 172.21.15.130:0/4032920305 conn(0x7fb7fc06f170 msgr2=0x7fb7fc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:47.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb801f10640 1 -- 172.21.15.130:0/4032920305 shutdown_connections 2023-09-13T06:02:47.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb801f10640 1 -- 172.21.15.130:0/4032920305 wait complete. 2023-09-13T06:02:47.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.659+0000 7fb801f10640 1 Processor -- start 2023-09-13T06:02:47.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb801f10640 1 -- start start 2023-09-13T06:02:47.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb801f10640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7fc0d1090 0x7fb7fc1f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb801f10640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7fc0d1750 0x7fb7fc13d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb801f10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc146f30 0x7fb7fc13b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb801f10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc15f1c0 con 0x7fb7fc146f30 2023-09-13T06:02:47.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb801f10640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc1fa370 con 0x7fb7fc0d1090 2023-09-13T06:02:47.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb801f10640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc1f9ad0 con 0x7fb7fc0d1750 2023-09-13T06:02:47.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7fbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc146f30 0x7fb7fc13b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7fbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc146f30 0x7fb7fc13b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36764/0 (socket says 172.21.15.130:36764) 2023-09-13T06:02:47.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7fbfff640 1 -- 172.21.15.130:0/1865996306 learned_addr learned my addr 172.21.15.130:0/1865996306 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:47.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7fb7fe640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7fc0d1090 0x7fb7fc1f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7faffd640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7fc0d1750 0x7fb7fc13d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7fbfff640 1 -- 172.21.15.130:0/1865996306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7fc0d1750 msgr2=0x7fb7fc13d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7fbfff640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7fc0d1750 0x7fb7fc13d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7fbfff640 1 -- 172.21.15.130:0/1865996306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7fc0d1090 msgr2=0x7fb7fc1f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7fbfff640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7fc0d1090 0x7fb7fc1f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7fbfff640 1 -- 172.21.15.130:0/1865996306 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f4009b30 con 0x7fb7fc146f30 2023-09-13T06:02:47.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7faffd640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7fc0d1750 0x7fb7fc13d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:47.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7fb7fe640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7fc0d1090 0x7fb7fc1f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:47.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7fbfff640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc146f30 0x7fb7fc13b330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40af040 tx=0x7fb7f40196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:47.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7e3fff640 1 -- 172.21.15.130:0/1865996306 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40b8670 con 0x7fb7fc146f30 2023-09-13T06:02:47.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7e3fff640 1 -- 172.21.15.130:0/1865996306 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f40b87d0 con 0x7fb7fc146f30 2023-09-13T06:02:47.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb7e3fff640 1 -- 172.21.15.130:0/1865996306 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40b8b60 con 0x7fb7fc146f30 2023-09-13T06:02:47.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb801f10640 1 -- 172.21.15.130:0/1865996306 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc1f9db0 con 0x7fb7fc146f30 2023-09-13T06:02:47.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb801f10640 1 -- 172.21.15.130:0/1865996306 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc1427d0 con 0x7fb7fc146f30 2023-09-13T06:02:47.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.663+0000 7fb801f10640 1 -- 172.21.15.130:0/1865996306 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc0618a0 con 0x7fb7fc146f30 2023-09-13T06:02:47.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.667+0000 7fb7e3fff640 1 -- 172.21.15.130:0/1865996306 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb7f40b8cc0 con 0x7fb7fc146f30 2023-09-13T06:02:47.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.667+0000 7fb7e3fff640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7e8065b20 0x7fb7e8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.667+0000 7fb7e3fff640 1 -- 172.21.15.130:0/1865996306 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb7f411e8e0 con 0x7fb7fc146f30 2023-09-13T06:02:47.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.667+0000 7fb7fb7fe640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7e8065b20 0x7fb7e8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.667+0000 7fb7fb7fe640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7e8065b20 0x7fb7e8067fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec001760 tx=0x7fb7ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:47.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.671+0000 7fb7e3fff640 1 -- 172.21.15.130:0/1865996306 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb7f40ec640 con 0x7fb7fc146f30 2023-09-13T06:02:47.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 -- 172.21.15.130:0/1865996306 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7fc0b86c0 con 0x7fb7fc146f30 2023-09-13T06:02:47.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb7e3fff640 1 -- 172.21.15.130:0/1865996306 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13024 (secure 0 0 0) 0x7fb7f40efc60 con 0x7fb7fc146f30 2023-09-13T06:02:47.827 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:47.828 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":37,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:46.473806+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.130:6837/1879815978":"2023-09-14T06:02:43.440100+0000","172.21.15.130:6836/1879815978":"2023-09-14T06:02:43.440100+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:47.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 -- 172.21.15.130:0/1865996306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7e8065b20 msgr2=0x7fb7e8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7e8065b20 0x7fb7e8067fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec001760 tx=0x7fb7ec009040 comp rx=0 tx=0).stop 2023-09-13T06:02:47.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 -- 172.21.15.130:0/1865996306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc146f30 msgr2=0x7fb7fc13b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc146f30 0x7fb7fc13b330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40af040 tx=0x7fb7f40196b0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 -- 172.21.15.130:0/1865996306 shutdown_connections 2023-09-13T06:02:47.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7e8065b20 0x7fb7e8067fe0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc146f30 0x7fb7fc13b330 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7fc0d1750 0x7fb7fc13d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 --2- 172.21.15.130:0/1865996306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7fc0d1090 0x7fb7fc1f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 -- 172.21.15.130:0/1865996306 >> 172.21.15.130:0/1865996306 conn(0x7fb7fc06f170 msgr2=0x7fb7fc0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:47.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 -- 172.21.15.130:0/1865996306 shutdown_connections 2023-09-13T06:02:47.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.823+0000 7fb801f10640 1 -- 172.21.15.130:0/1865996306 wait complete. 2023-09-13T06:02:47.849 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:02:47.850 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:02:47.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f8a07640 1 Processor -- start 2023-09-13T06:02:47.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f8a07640 1 -- start start 2023-09-13T06:02:47.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f8a07640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f22f40b08a0 0x7f22f40acf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f8a07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f40b1990 0x7f22f40b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f8a07640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f22f40b2520 0x7f22f40b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:47.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f8a07640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f40b2ef0 con 0x7f22f40b08a0 2023-09-13T06:02:47.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f8a07640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f40b2330 con 0x7f22f40b2520 2023-09-13T06:02:47.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f8a07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f415e800 con 0x7f22f40b1990 2023-09-13T06:02:47.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f22f40b08a0 0x7f22f40acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f22f40b08a0 0x7f22f40acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36770/0 (socket says 172.21.15.130:36770) 2023-09-13T06:02:47.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f259c640 1 -- 172.21.15.130:0/3670073840 learned_addr learned my addr 172.21.15.130:0/3670073840 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:47.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f2d9d640 1 --2- 172.21.15.130:0/3670073840 >> v2:172.21.15.164:3300/0 conn(0x7f22f40b2520 0x7f22f40b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22e9d9b640 1 --2- 172.21.15.130:0/3670073840 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f40b1990 0x7f22f40b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:47.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f259c640 1 -- 172.21.15.130:0/3670073840 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f40b1990 msgr2=0x7f22f40b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:47.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f259c640 1 --2- 172.21.15.130:0/3670073840 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f40b1990 0x7f22f40b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f259c640 1 -- 172.21.15.130:0/3670073840 >> v2:172.21.15.164:3300/0 conn(0x7f22f40b2520 msgr2=0x7f22f40b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:47.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f259c640 1 --2- 172.21.15.130:0/3670073840 >> v2:172.21.15.164:3300/0 conn(0x7f22f40b2520 0x7f22f40b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f259c640 1 -- 172.21.15.130:0/3670073840 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f415d990 con 0x7f22f40b08a0 2023-09-13T06:02:47.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22f2d9d640 1 --2- 172.21.15.130:0/3670073840 >> v2:172.21.15.164:3300/0 conn(0x7f22f40b2520 0x7f22f40b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:47.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.987+0000 7f22e9d9b640 1 --2- 172.21.15.130:0/3670073840 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f40b1990 0x7f22f40b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:47.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f259c640 1 --2- 172.21.15.130:0/3670073840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22f40b08a0 0x7f22f40acf10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f22f40ace30 tx=0x7f22e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb1837b979a3cf8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:47.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f1d9b640 1 -- 172.21.15.130:0/3670073840 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e40aa5f0 con 0x7f22f40b08a0 2023-09-13T06:02:47.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f1d9b640 1 -- 172.21.15.130:0/3670073840 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e40aa750 con 0x7f22f40b08a0 2023-09-13T06:02:47.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f1d9b640 1 -- 172.21.15.130:0/3670073840 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e40aaae0 con 0x7f22f40b08a0 2023-09-13T06:02:47.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f8a07640 1 -- 172.21.15.130:0/3670073840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22f40b08a0 msgr2=0x7f22f40acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:47.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f8a07640 1 --2- 172.21.15.130:0/3670073840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22f40b08a0 0x7f22f40acf10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f22f40ace30 tx=0x7f22e401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:02:47.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f8a07640 1 -- 172.21.15.130:0/3670073840 shutdown_connections 2023-09-13T06:02:47.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f8a07640 1 --2- 172.21.15.130:0/3670073840 >> v2:172.21.15.164:3300/0 conn(0x7f22f40b2520 0x7f22f40b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f8a07640 1 --2- 172.21.15.130:0/3670073840 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f40b1990 0x7f22f40b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f8a07640 1 --2- 172.21.15.130:0/3670073840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22f40b08a0 0x7f22f40acf10 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f8a07640 1 -- 172.21.15.130:0/3670073840 >> 172.21.15.130:0/3670073840 conn(0x7f22f4065990 msgr2=0x7f22f4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:48.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f8a07640 1 -- 172.21.15.130:0/3670073840 shutdown_connections 2023-09-13T06:02:48.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.991+0000 7f22f8a07640 1 -- 172.21.15.130:0/3670073840 wait complete. 2023-09-13T06:02:48.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f8a07640 1 Processor -- start 2023-09-13T06:02:48.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f8a07640 1 -- start start 2023-09-13T06:02:48.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f8a07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f40b08a0 0x7f22f41f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:48.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f8a07640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f40b1990 0x7f22f4155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:48.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f8a07640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22f40b2520 0x7f22f41560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:48.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f8a07640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f415b0c0 con 0x7f22f40b2520 2023-09-13T06:02:48.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f8a07640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f406b520 con 0x7f22f40b1990 2023-09-13T06:02:48.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f8a07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f415a820 con 0x7f22f40b08a0 2023-09-13T06:02:48.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22f40b2520 0x7f22f41560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:48.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f259c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f40b08a0 0x7f22f41f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:48.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22f40b2520 0x7f22f41560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36782/0 (socket says 172.21.15.130:36782) 2023-09-13T06:02:48.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f2d9d640 1 -- 172.21.15.130:0/2656802010 learned_addr learned my addr 172.21.15.130:0/2656802010 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:48.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22e9d9b640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f40b1990 0x7f22f4155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:48.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f2d9d640 1 -- 172.21.15.130:0/2656802010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f40b08a0 msgr2=0x7f22f41f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:48.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f2d9d640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f40b08a0 0x7f22f41f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f2d9d640 1 -- 172.21.15.130:0/2656802010 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f40b1990 msgr2=0x7f22f4155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:48.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f2d9d640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f40b1990 0x7f22f4155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f2d9d640 1 -- 172.21.15.130:0/2656802010 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e40094d0 con 0x7f22f40b2520 2023-09-13T06:02:48.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f2d9d640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22f40b2520 0x7f22f41560e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f22ec007f20 tx=0x7f22ec00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:48.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22eb7fe640 1 -- 172.21.15.130:0/2656802010 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00dee0 con 0x7f22f40b2520 2023-09-13T06:02:48.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22eb7fe640 1 -- 172.21.15.130:0/2656802010 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec00f040 con 0x7f22f40b2520 2023-09-13T06:02:48.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f8a07640 1 -- 172.21.15.130:0/2656802010 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f415ab00 con 0x7f22f40b2520 2023-09-13T06:02:48.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22eb7fe640 1 -- 172.21.15.130:0/2656802010 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec003de0 con 0x7f22f40b2520 2023-09-13T06:02:48.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.995+0000 7f22f8a07640 1 -- 172.21.15.130:0/2656802010 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f41f6610 con 0x7f22f40b2520 2023-09-13T06:02:48.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.999+0000 7f22f8a07640 1 -- 172.21.15.130:0/2656802010 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f41f5920 con 0x7f22f40b2520 2023-09-13T06:02:48.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.999+0000 7f22eb7fe640 1 -- 172.21.15.130:0/2656802010 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f22ec004030 con 0x7f22f40b2520 2023-09-13T06:02:48.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.999+0000 7f22eb7fe640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22d4065b20 0x7f22d4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:48.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.999+0000 7f22eb7fe640 1 -- 172.21.15.130:0/2656802010 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f22ec0832b0 con 0x7f22f40b2520 2023-09-13T06:02:48.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.999+0000 7f22f259c640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22d4065b20 0x7f22d4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:48.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:47.999+0000 7f22f259c640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22d4065b20 0x7f22d4067fe0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22e40ae000 tx=0x7f22e40b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:48.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.003+0000 7f22eb7fe640 1 -- 172.21.15.130:0/2656802010 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f22ec050fb0 con 0x7f22f40b2520 2023-09-13T06:02:48.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.151+0000 7f22f8a07640 1 -- 172.21.15.130:0/2656802010 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22f40618a0 con 0x7f22f40b2520 2023-09-13T06:02:48.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.151+0000 7f22eb7fe640 1 -- 172.21.15.130:0/2656802010 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22ec0545d0 con 0x7f22f40b2520 2023-09-13T06:02:48.157 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:02:48.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 -- 172.21.15.130:0/2656802010 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22d4065b20 msgr2=0x7f22d4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:48.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22d4065b20 0x7f22d4067fe0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22e40ae000 tx=0x7f22e40b5040 comp rx=0 tx=0).stop 2023-09-13T06:02:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 -- 172.21.15.130:0/2656802010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22f40b2520 msgr2=0x7f22f41560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22f40b2520 0x7f22f41560e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f22ec007f20 tx=0x7f22ec00d560 comp rx=0 tx=0).stop 2023-09-13T06:02:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 -- 172.21.15.130:0/2656802010 shutdown_connections 2023-09-13T06:02:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22d4065b20 0x7f22d4067fe0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f40b1990 0x7f22f4155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22f40b2520 0x7f22f41560e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 --2- 172.21.15.130:0/2656802010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f40b08a0 0x7f22f41f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 -- 172.21.15.130:0/2656802010 >> 172.21.15.130:0/2656802010 conn(0x7f22f4065990 msgr2=0x7f22f4157230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:48.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 -- 172.21.15.130:0/2656802010 shutdown_connections 2023-09-13T06:02:48.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.155+0000 7f22f8a07640 1 -- 172.21.15.130:0/2656802010 wait complete. 2023-09-13T06:02:48.178 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-09-13T06:02:48.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.311+0000 7f826b456640 1 Processor -- start 2023-09-13T06:02:48.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.311+0000 7f826b456640 1 -- start start 2023-09-13T06:02:48.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f826b456640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f826406c9b0 0x7f82640cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:48.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f826b456640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82640cdee0 0x7f826406f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:48.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f826b456640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826406d120 con 0x7f82641597d0 2023-09-13T06:02:48.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f826b456640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8264159bb0 con 0x7f826406c9b0 2023-09-13T06:02:48.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f826b456640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82640ce640 con 0x7f82640cdee0 2023-09-13T06:02:48.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f82689f1640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f826406c9b0 0x7f82640cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:48.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f82689f1640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f826406c9b0 0x7f82640cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36792/0 (socket says 172.21.15.130:36792) 2023-09-13T06:02:48.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f82689f1640 1 -- 172.21.15.130:0/2697617574 learned_addr learned my addr 172.21.15.130:0/2697617574 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:48.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f82699f3640 1 --2- 172.21.15.130:0/2697617574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82640cdee0 0x7f826406f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:48.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f82689f1640 1 -- 172.21.15.130:0/2697617574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82640cdee0 msgr2=0x7f826406f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:48.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f82689f1640 1 --2- 172.21.15.130:0/2697617574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82640cdee0 0x7f826406f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f82689f1640 1 -- 172.21.15.130:0/2697617574 >> v1:172.21.15.164:6789/0 conn(0x7f82641597d0 legacy=0x7f826406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:48.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f82689f1640 1 -- 172.21.15.130:0/2697617574 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82640ce920 con 0x7f826406c9b0 2023-09-13T06:02:48.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f82699f3640 1 --2- 172.21.15.130:0/2697617574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82640cdee0 0x7f826406f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:48.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.315+0000 7f82689f1640 1 --2- 172.21.15.130:0/2697617574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f826406c9b0 0x7f82640cd9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8254009870 tx=0x7f825401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24040109f5b11322 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:48.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f825bfff640 1 -- 172.21.15.130:0/2697617574 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540ab600 con 0x7f826406c9b0 2023-09-13T06:02:48.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f825bfff640 1 -- 172.21.15.130:0/2697617574 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82540a7050 con 0x7f826406c9b0 2023-09-13T06:02:48.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f825bfff640 1 -- 172.21.15.130:0/2697617574 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540ab980 con 0x7f826406c9b0 2023-09-13T06:02:48.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 -- 172.21.15.130:0/2697617574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f826406c9b0 msgr2=0x7f82640cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:48.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 --2- 172.21.15.130:0/2697617574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f826406c9b0 0x7f82640cd9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8254009870 tx=0x7f825401c480 comp rx=0 tx=0).stop 2023-09-13T06:02:48.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 -- 172.21.15.130:0/2697617574 shutdown_connections 2023-09-13T06:02:48.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 --2- 172.21.15.130:0/2697617574 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82640cdee0 0x7f826406f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 --2- 172.21.15.130:0/2697617574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f826406c9b0 0x7f82640cd9a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 -- 172.21.15.130:0/2697617574 >> 172.21.15.130:0/2697617574 conn(0x7f82640b0bc0 msgr2=0x7f82640b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:48.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 -- 172.21.15.130:0/2697617574 shutdown_connections 2023-09-13T06:02:48.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 -- 172.21.15.130:0/2697617574 wait complete. 2023-09-13T06:02:48.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 Processor -- start 2023-09-13T06:02:48.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 -- start start 2023-09-13T06:02:48.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f826406c9b0 0x7f82641566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:48.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82640cdee0 0x7f826414e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:48.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82641597d0 0x7f8264162870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:48.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8264138fe0 con 0x7f82641597d0 2023-09-13T06:02:48.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8264156bf0 con 0x7f82640cdee0 2023-09-13T06:02:48.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f826b456640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8264137570 con 0x7f826406c9b0 2023-09-13T06:02:48.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f82699f3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82641597d0 0x7f8264162870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:48.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f82699f3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82641597d0 0x7f8264162870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36800/0 (socket says 172.21.15.130:36800) 2023-09-13T06:02:48.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f82699f3640 1 -- 172.21.15.130:0/639723677 learned_addr learned my addr 172.21.15.130:0/639723677 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:48.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.319+0000 7f82691f2640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f826406c9b0 0x7f82641566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:48.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f82689f1640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82640cdee0 0x7f826414e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:48.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f82699f3640 1 -- 172.21.15.130:0/639723677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f826406c9b0 msgr2=0x7f82641566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:48.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f82699f3640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f826406c9b0 0x7f82641566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f82699f3640 1 -- 172.21.15.130:0/639723677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82640cdee0 msgr2=0x7f826414e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:48.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f82699f3640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82640cdee0 0x7f826414e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:48.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f82699f3640 1 -- 172.21.15.130:0/639723677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82540094d0 con 0x7f82641597d0 2023-09-13T06:02:48.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f82699f3640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82641597d0 0x7f8264162870 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f825c007ef0 tx=0x7f825c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:48.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f8259ffb640 1 -- 172.21.15.130:0/639723677 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c003ba0 con 0x7f82641597d0 2023-09-13T06:02:48.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f8259ffb640 1 -- 172.21.15.130:0/639723677 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c00f040 con 0x7f82641597d0 2023-09-13T06:02:48.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f8259ffb640 1 -- 172.21.15.130:0/639723677 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c00de80 con 0x7f82641597d0 2023-09-13T06:02:48.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f826b456640 1 -- 172.21.15.130:0/639723677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82641383d0 con 0x7f82641597d0 2023-09-13T06:02:48.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f826b456640 1 -- 172.21.15.130:0/639723677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8264138990 con 0x7f82641597d0 2023-09-13T06:02:48.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f826b456640 1 -- 172.21.15.130:0/639723677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82640618a0 con 0x7f82641597d0 2023-09-13T06:02:48.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f8259ffb640 1 -- 172.21.15.130:0/639723677 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f825c004030 con 0x7f82641597d0 2023-09-13T06:02:48.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f8259ffb640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8248065b20 0x7f8248067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:48.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f8259ffb640 1 -- 172.21.15.130:0/639723677 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f825c083200 con 0x7f82641597d0 2023-09-13T06:02:48.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.323+0000 7f82691f2640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8248065b20 0x7f8248067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:48.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.327+0000 7f82691f2640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8248065b20 0x7f8248067fe0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8260007fd0 tx=0x7f8260009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:48.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.327+0000 7f8259ffb640 1 -- 172.21.15.130:0/639723677 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f825c050f10 con 0x7f82641597d0 2023-09-13T06:02:48.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:48.531+0000 7f826b456640 1 -- 172.21.15.130:0/639723677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f826406f110 con 0x7f82641597d0 2023-09-13T06:02:49.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f8259ffb640 1 -- 172.21.15.130:0/639723677 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v100) v1 ==== 145+0+0 (secure 0 0 0) 0x7f825c054530 con 0x7f82641597d0 2023-09-13T06:02:49.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 -- 172.21.15.130:0/639723677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8248065b20 msgr2=0x7f8248067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:49.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8248065b20 0x7f8248067fe0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8260007fd0 tx=0x7f8260009040 comp rx=0 tx=0).stop 2023-09-13T06:02:49.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 -- 172.21.15.130:0/639723677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82641597d0 msgr2=0x7f8264162870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:49.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82641597d0 0x7f8264162870 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f825c007ef0 tx=0x7f825c00d4a0 comp rx=0 tx=0).stop 2023-09-13T06:02:49.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 -- 172.21.15.130:0/639723677 shutdown_connections 2023-09-13T06:02:49.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8248065b20 0x7f8248067fe0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:49.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82640cdee0 0x7f826414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:49.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82641597d0 0x7f8264162870 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:49.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 --2- 172.21.15.130:0/639723677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f826406c9b0 0x7f82641566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:49.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 -- 172.21.15.130:0/639723677 >> 172.21.15.130:0/639723677 conn(0x7f82640b0bc0 msgr2=0x7f82640b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:49.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 -- 172.21.15.130:0/639723677 shutdown_connections 2023-09-13T06:02:49.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.503+0000 7f826b456640 1 -- 172.21.15.130:0/639723677 wait complete. 2023-09-13T06:02:49.532 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-09-13T06:02:49.691 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_objectstore":"memstore"} 2023-09-13T06:02:49.691 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-09-13T06:02:49.692 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-13T06:02:49.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.827+0000 7fd33172c640 1 Processor -- start 2023-09-13T06:02:49.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.827+0000 7fd33172c640 1 -- start start 2023-09-13T06:02:49.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd33172c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd32c0b2e90 0x7fd32c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:49.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd33172c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c0b2150 con 0x7fd32c144d70 2023-09-13T06:02:49.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd33172c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c0cdd90 con 0x7fd32c0b1460 2023-09-13T06:02:49.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd33172c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0b2430 con 0x7fd32c0b2e90 2023-09-13T06:02:49.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd32affd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd32c144d70 0x7fd32c0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49664/0 (socket says 172.21.15.130:49664) 2023-09-13T06:02:49.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd32affd640 1 -- 172.21.15.130:0/2112661883 learned_addr learned my addr 172.21.15.130:0/2112661883 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:49.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd3227fc640 1 --2- 172.21.15.130:0/2112661883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd32c0b2e90 0x7fd32c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:49.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd32a7fc640 1 -- 172.21.15.130:0/2112661883 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970959531 0 0) 0x7fd32c0b2150 con 0x7fd32c144d70 2023-09-13T06:02:49.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd32a7fc640 1 -- 172.21.15.130:0/2112661883 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd318003530 con 0x7fd32c144d70 2023-09-13T06:02:49.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd32a7fc640 1 -- 172.21.15.130:0/2112661883 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170398906 0 0) 0x7fd32c0cdd90 con 0x7fd32c0b1460 2023-09-13T06:02:49.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd32a7fc640 1 -- 172.21.15.130:0/2112661883 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd32c0b2150 con 0x7fd32c0b1460 2023-09-13T06:02:49.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd3227fc640 1 -- 172.21.15.130:0/2112661883 >> v1:172.21.15.164:6789/0 conn(0x7fd32c0b1460 legacy=0x7fd32c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:49.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd3227fc640 1 -- 172.21.15.130:0/2112661883 >> v1:172.21.15.130:6789/0 conn(0x7fd32c144d70 legacy=0x7fd32c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:49.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd32a7fc640 1 -- 172.21.15.130:0/2112661883 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1402285188 0 0) 0x7fd318003530 con 0x7fd32c144d70 2023-09-13T06:02:49.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.831+0000 7fd3227fc640 1 -- 172.21.15.130:0/2112661883 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c0ce070 con 0x7fd32c0b2e90 2023-09-13T06:02:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd3227fc640 1 --2- 172.21.15.130:0/2112661883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd32c0b2e90 0x7fd32c0ce870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3140097f0 tx=0x7fd31401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddb01083ad5bc60b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd32a7fc640 1 -- 172.21.15.130:0/2112661883 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c001680 con 0x7fd32c0b2e90 2023-09-13T06:02:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd32a7fc640 1 -- 172.21.15.130:0/2112661883 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3140a7050 con 0x7fd32c0b2e90 2023-09-13T06:02:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd32a7fc640 1 -- 172.21.15.130:0/2112661883 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3140ab620 con 0x7fd32c0b2e90 2023-09-13T06:02:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd33172c640 1 -- 172.21.15.130:0/2112661883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd32c0b2e90 msgr2=0x7fd32c0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:49.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd33172c640 1 --2- 172.21.15.130:0/2112661883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd32c0b2e90 0x7fd32c0ce870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3140097f0 tx=0x7fd31401c3e0 comp rx=0 tx=0).stop 2023-09-13T06:02:49.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd33172c640 1 -- 172.21.15.130:0/2112661883 shutdown_connections 2023-09-13T06:02:49.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd33172c640 1 --2- 172.21.15.130:0/2112661883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd32c0b2e90 0x7fd32c0ce870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:49.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd33172c640 1 -- 172.21.15.130:0/2112661883 >> 172.21.15.130:0/2112661883 conn(0x7fd32c065990 msgr2=0x7fd32c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:49.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd33172c640 1 -- 172.21.15.130:0/2112661883 shutdown_connections 2023-09-13T06:02:49.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd33172c640 1 -- 172.21.15.130:0/2112661883 wait complete. 2023-09-13T06:02:49.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd33172c640 1 Processor -- start 2023-09-13T06:02:49.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.835+0000 7fd33172c640 1 -- start start 2023-09-13T06:02:49.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd33172c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd32c0b1460 0x7fd32c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:49.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd33172c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd32c0b2e90 0x7fd32c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:49.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd33172c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd32c144d70 0x7fd32c138a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:49.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd33172c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0b03c0 con 0x7fd32c144d70 2023-09-13T06:02:49.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd33172c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c155150 con 0x7fd32c0b1460 2023-09-13T06:02:49.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd33172c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c154e70 con 0x7fd32c0b2e90 2023-09-13T06:02:49.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd32b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd32c144d70 0x7fd32c138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:49.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd32b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd32c144d70 0x7fd32c138a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36810/0 (socket says 172.21.15.130:36810) 2023-09-13T06:02:49.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd32b7fe640 1 -- 172.21.15.130:0/843776 learned_addr learned my addr 172.21.15.130:0/843776 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:49.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd32affd640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd32c0b1460 0x7fd32c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:49.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd3227fc640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd32c0b2e90 0x7fd32c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:49.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd32b7fe640 1 -- 172.21.15.130:0/843776 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd32c0b2e90 msgr2=0x7fd32c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:49.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd32b7fe640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd32c0b2e90 0x7fd32c1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:49.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd32b7fe640 1 -- 172.21.15.130:0/843776 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd32c0b1460 msgr2=0x7fd32c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:49.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd32b7fe640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd32c0b1460 0x7fd32c15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:49.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd32b7fe640 1 -- 172.21.15.130:0/843776 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd314009420 con 0x7fd32c144d70 2023-09-13T06:02:49.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd32b7fe640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd32c144d70 0x7fd32c138a20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd32400c790 tx=0x7fd32400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd323fff640 1 -- 172.21.15.130:0/843776 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400cea0 con 0x7fd32c144d70 2023-09-13T06:02:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd323fff640 1 -- 172.21.15.130:0/843776 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd324003b80 con 0x7fd32c144d70 2023-09-13T06:02:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd33172c640 1 -- 172.21.15.130:0/843776 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32c0b0050 con 0x7fd32c144d70 2023-09-13T06:02:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd323fff640 1 -- 172.21.15.130:0/843776 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400a850 con 0x7fd32c144d70 2023-09-13T06:02:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd33172c640 1 -- 172.21.15.130:0/843776 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c139130 con 0x7fd32c144d70 2023-09-13T06:02:49.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.839+0000 7fd33172c640 1 -- 172.21.15.130:0/843776 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c155af0 con 0x7fd32c144d70 2023-09-13T06:02:49.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.843+0000 7fd323fff640 1 -- 172.21.15.130:0/843776 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd32400a9b0 con 0x7fd32c144d70 2023-09-13T06:02:49.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.843+0000 7fd323fff640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd30c065b20 0x7fd30c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:49.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.843+0000 7fd323fff640 1 -- 172.21.15.130:0/843776 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd324082e30 con 0x7fd32c144d70 2023-09-13T06:02:49.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.843+0000 7fd32affd640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd30c065b20 0x7fd30c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:49.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.843+0000 7fd32affd640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd30c065b20 0x7fd30c067fe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd31c001ec0 tx=0x7fd31c0019c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:49.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.847+0000 7fd323fff640 1 -- 172.21.15.130:0/843776 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd324050a90 con 0x7fd32c144d70 2023-09-13T06:02:49.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.991+0000 7fd33172c640 1 -- 172.21.15.130:0/843776 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd32c0618a0 con 0x7fd32c144d70 2023-09-13T06:02:50.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.995+0000 7fd323fff640 1 -- 172.21.15.130:0/843776 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd3240540b0 con 0x7fd32c144d70 2023-09-13T06:02:50.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 -- 172.21.15.130:0/843776 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd30c065b20 msgr2=0x7fd30c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd30c065b20 0x7fd30c067fe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd31c001ec0 tx=0x7fd31c0019c0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 -- 172.21.15.130:0/843776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd32c144d70 msgr2=0x7fd32c138a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd32c144d70 0x7fd32c138a20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd32400c790 tx=0x7fd32400cc50 comp rx=0 tx=0).stop 2023-09-13T06:02:50.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 -- 172.21.15.130:0/843776 shutdown_connections 2023-09-13T06:02:50.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd30c065b20 0x7fd30c067fe0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd32c144d70 0x7fd32c138a20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd32c0b2e90 0x7fd32c1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 --2- 172.21.15.130:0/843776 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd32c0b1460 0x7fd32c15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 -- 172.21.15.130:0/843776 >> 172.21.15.130:0/843776 conn(0x7fd32c065990 msgr2=0x7fd32c0b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:50.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 -- 172.21.15.130:0/843776 shutdown_connections 2023-09-13T06:02:50.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:49.999+0000 7fd33172c640 1 -- 172.21.15.130:0/843776 wait complete. 2023-09-13T06:02:50.023 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:02:50.024 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:02:50.076 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:02:50.143 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:02:50.144 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:02:50.144 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:50.153 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:02:50.154 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:02:50.154 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:50.164 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:02:50.164 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:02:50.164 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:50.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:02:50.206 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:02:50.207 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:02:50.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:02:50.217 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-13T06:02:50.217 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:50.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277ed20640 1 Processor -- start 2023-09-13T06:02:50.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277ed20640 1 -- start start 2023-09-13T06:02:50.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277ed20640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2778071460 0x7f2778161100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277ed20640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27780b5590 con 0x7f2778146f40 2023-09-13T06:02:50.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277ed20640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27780718a0 con 0x7f2778161640 2023-09-13T06:02:50.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277ed20640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2778161ad0 con 0x7f2778071460 2023-09-13T06:02:50.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277dd1e640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2778146f40 0x7f27780b63c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49668/0 (socket says 172.21.15.130:49668) 2023-09-13T06:02:50.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277dd1e640 1 -- 172.21.15.130:0/439301775 learned_addr learned my addr 172.21.15.130:0/439301775 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:50.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277d51d640 1 --2- 172.21.15.130:0/439301775 >> v2:172.21.15.164:3300/0 conn(0x7f2778071460 0x7f2778161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507504208 0 0) 0x7f27780b5590 con 0x7f2778146f40 2023-09-13T06:02:50.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2764003530 con 0x7f2778146f40 2023-09-13T06:02:50.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3016416419 0 0) 0x7f2764003530 con 0x7f2778146f40 2023-09-13T06:02:50.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 >> v2:172.21.15.164:3300/0 conn(0x7f2778071460 msgr2=0x7f2778161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:50.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 --2- 172.21.15.130:0/439301775 >> v2:172.21.15.164:3300/0 conn(0x7f2778071460 0x7f2778161100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 >> v1:172.21.15.164:6789/0 conn(0x7f2778161640 legacy=0x7f277806f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2778071af0 con 0x7f2778146f40 2023-09-13T06:02:50.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f2774001680 con 0x7f2778146f40 2023-09-13T06:02:50.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 >> v1:172.21.15.130:6789/0 conn(0x7f2778146f40 legacy=0x7f27780b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27640039f0 0x7f2764003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27640047d0 0x7f2764004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2764005190 0x7f276400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2778161ad0 con 0x7f27640047d0 2023-09-13T06:02:50.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276400c0c0 con 0x7f27640039f0 2023-09-13T06:02:50.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276400c280 con 0x7f2764005190 2023-09-13T06:02:50.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277d51d640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27640047d0 0x7f2764004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277dd1e640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27640039f0 0x7f2764003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277e51f640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2764005190 0x7f276400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277d51d640 1 -- 172.21.15.130:0/439301775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2764005190 msgr2=0x7f276400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:50.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277d51d640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2764005190 0x7f276400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277d51d640 1 -- 172.21.15.130:0/439301775 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27640039f0 msgr2=0x7f2764003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:50.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277d51d640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27640039f0 0x7f2764003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277d51d640 1 -- 172.21.15.130:0/439301775 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764003530 con 0x7f27640047d0 2023-09-13T06:02:50.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277e51f640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2764005190 0x7f276400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:50.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.383+0000 7f277e51f640 1 -- 172.21.15.130:0/439301775 reap_dead start 2023-09-13T06:02:50.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.387+0000 7f277d51d640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27640047d0 0x7f2764004c50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2768009ae0 tx=0x7f276801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987149338936eb4c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:50.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.387+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27680a6440 con 0x7f27640047d0 2023-09-13T06:02:50.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.387+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27680a65a0 con 0x7f27640047d0 2023-09-13T06:02:50.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.387+0000 7f277cd1c640 1 -- 172.21.15.130:0/439301775 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27680a6950 con 0x7f27640047d0 2023-09-13T06:02:50.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.387+0000 7f277ed20640 1 -- 172.21.15.130:0/439301775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27640047d0 msgr2=0x7f2764004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.387+0000 7f277ed20640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27640047d0 0x7f2764004c50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2768009ae0 tx=0x7f276801ca50 comp rx=0 tx=0).stop 2023-09-13T06:02:50.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.387+0000 7f277ed20640 1 -- 172.21.15.130:0/439301775 shutdown_connections 2023-09-13T06:02:50.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.387+0000 7f277ed20640 1 --2- 172.21.15.130:0/439301775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27640047d0 0x7f2764004c50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.387+0000 7f277ed20640 1 -- 172.21.15.130:0/439301775 >> 172.21.15.130:0/439301775 conn(0x7f27780cdd10 msgr2=0x7f27780ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:50.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.387+0000 7f277ed20640 1 -- 172.21.15.130:0/439301775 shutdown_connections 2023-09-13T06:02:50.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.387+0000 7f277ed20640 1 -- 172.21.15.130:0/439301775 wait complete. 2023-09-13T06:02:50.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277ed20640 1 Processor -- start 2023-09-13T06:02:50.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277ed20640 1 -- start start 2023-09-13T06:02:50.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277ed20640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27640047d0 0x7f277815ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277ed20640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27781f2ff0 0x7f27781f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277ed20640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f277815eee0 0x7f277815f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277ed20640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277815f8d0 con 0x7f277815eee0 2023-09-13T06:02:50.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277ed20640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27781f63c0 con 0x7f27640047d0 2023-09-13T06:02:50.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277ed20640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277813d2c0 con 0x7f27781f2ff0 2023-09-13T06:02:50.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277e51f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f277815eee0 0x7f277815f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277e51f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f277815eee0 0x7f277815f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36820/0 (socket says 172.21.15.130:36820) 2023-09-13T06:02:50.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277e51f640 1 -- 172.21.15.130:0/2428886172 learned_addr learned my addr 172.21.15.130:0/2428886172 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:50.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277dd1e640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27640047d0 0x7f277815ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277d51d640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27781f2ff0 0x7f27781f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277e51f640 1 -- 172.21.15.130:0/2428886172 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27781f2ff0 msgr2=0x7f27781f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277e51f640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27781f2ff0 0x7f27781f3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277e51f640 1 -- 172.21.15.130:0/2428886172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27640047d0 msgr2=0x7f277815ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277e51f640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27640047d0 0x7f277815ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277e51f640 1 -- 172.21.15.130:0/2428886172 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277813d510 con 0x7f277815eee0 2023-09-13T06:02:50.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277e51f640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f277815eee0 0x7f277815f390 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2778161a20 tx=0x7f277000ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:50.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f276e7fc640 1 -- 172.21.15.130:0/2428886172 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770017070 con 0x7f277815eee0 2023-09-13T06:02:50.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f276e7fc640 1 -- 172.21.15.130:0/2428886172 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2770003b90 con 0x7f277815eee0 2023-09-13T06:02:50.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f276e7fc640 1 -- 172.21.15.130:0/2428886172 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770003d40 con 0x7f277815eee0 2023-09-13T06:02:50.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277ed20640 1 -- 172.21.15.130:0/2428886172 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277813d7f0 con 0x7f277815eee0 2023-09-13T06:02:50.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.391+0000 7f277ed20640 1 -- 172.21.15.130:0/2428886172 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277813ddb0 con 0x7f277815eee0 2023-09-13T06:02:50.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.395+0000 7f277ed20640 1 -- 172.21.15.130:0/2428886172 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27780618a0 con 0x7f277815eee0 2023-09-13T06:02:50.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.395+0000 7f276e7fc640 1 -- 172.21.15.130:0/2428886172 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f27700050d0 con 0x7f277815eee0 2023-09-13T06:02:50.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.395+0000 7f276e7fc640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f275c065b20 0x7f275c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.395+0000 7f276e7fc640 1 -- 172.21.15.130:0/2428886172 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2770082300 con 0x7f277815eee0 2023-09-13T06:02:50.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.395+0000 7f277dd1e640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f275c065b20 0x7f275c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.395+0000 7f277dd1e640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f275c065b20 0x7f275c067fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2774001060 tx=0x7f2774001b30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:50.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.399+0000 7f276e7fc640 1 -- 172.21.15.130:0/2428886172 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f277004ff40 con 0x7f277815eee0 2023-09-13T06:02:50.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.579+0000 7f277ed20640 1 -- 172.21.15.130:0/2428886172 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27780cf980 con 0x7f277815eee0 2023-09-13T06:02:50.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f276e7fc640 1 -- 172.21.15.130:0/2428886172 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f2770053560 con 0x7f277815eee0 2023-09-13T06:02:50.587 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:50.587 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3600813785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3600813785},{"type":"v1","addr":"172.21.15.164:6834","nonce":3600813785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3946401321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3946401321},{"type":"v1","addr":"172.21.15.164:6835","nonce":3946401321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5097,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/746143804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":746143804},{"type":"v1","addr":"172.21.15.130:6835","nonce":746143804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/101379245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":101379245},{"type":"v1","addr":"172.21.15.130:6837","nonce":101379245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2023-09-13T06:02:50.588 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 18 2023-09-13T06:02:50.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 -- 172.21.15.130:0/2428886172 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f275c065b20 msgr2=0x7f275c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f275c065b20 0x7f275c067fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2774001060 tx=0x7f2774001b30 comp rx=0 tx=0).stop 2023-09-13T06:02:50.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 -- 172.21.15.130:0/2428886172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f277815eee0 msgr2=0x7f277815f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f277815eee0 0x7f277815f390 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2778161a20 tx=0x7f277000ead0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 -- 172.21.15.130:0/2428886172 shutdown_connections 2023-09-13T06:02:50.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f275c065b20 0x7f275c067fe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f277815eee0 0x7f277815f390 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27781f2ff0 0x7f27781f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 --2- 172.21.15.130:0/2428886172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27640047d0 0x7f277815ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 -- 172.21.15.130:0/2428886172 >> 172.21.15.130:0/2428886172 conn(0x7f27780cdd10 msgr2=0x7f27780b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:50.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 -- 172.21.15.130:0/2428886172 shutdown_connections 2023-09-13T06:02:50.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.583+0000 7f277ed20640 1 -- 172.21.15.130:0/2428886172 wait complete. 2023-09-13T06:02:50.607 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T06:02:50.608 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-13T06:02:50.608 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T06:02:50.608 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:02:50.609 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T06:02:50.609 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-13T06:02:50.609 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T06:02:50.609 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:02:50.610 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T06:02:50.610 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-13T06:02:50.610 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T06:02:50.610 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:02:50.611 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T06:02:50.611 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-13T06:02:50.611 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T06:02:50.612 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:02:50.624 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T06:02:50.625 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T06:02:50.626 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T06:02:50.626 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T06:02:50.628 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T06:02:50.628 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T06:02:50.629 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T06:02:50.629 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T06:02:50.673 INFO:tasks.ceph.mds.a:Started 2023-09-13T06:02:50.673 DEBUG:teuthology.parallel:result is None 2023-09-13T06:02:50.674 INFO:tasks.ceph.mds.c:Started 2023-09-13T06:02:50.675 DEBUG:teuthology.parallel:result is None 2023-09-13T06:02:50.675 INFO:tasks.ceph.mds.b:Started 2023-09-13T06:02:50.676 DEBUG:teuthology.parallel:result is None 2023-09-13T06:02:50.677 INFO:tasks.ceph.mds.d:Started 2023-09-13T06:02:50.677 DEBUG:teuthology.parallel:result is None 2023-09-13T06:02:50.678 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-13T06:02:50.760 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:02:50.760 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:02:50.768 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:02:50.769 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:02:50.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.823+0000 7f569572c640 1 Processor -- start 2023-09-13T06:02:50.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.823+0000 7f569572c640 1 -- start start 2023-09-13T06:02:50.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.823+0000 7f569572c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5690159f20 0x7f56900ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.823+0000 7f569572c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f56900b1d20 0x7f56900b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.823+0000 7f569572c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56900ccfd0 con 0x7f56900cdfc0 2023-09-13T06:02:50.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.823+0000 7f569572c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900b00f0 con 0x7f56900b1d20 2023-09-13T06:02:50.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.823+0000 7f569572c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56900ce420 con 0x7f5690159f20 2023-09-13T06:02:50.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.823+0000 7f56867fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f56900cdfc0 0x7f56900b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49698/0 (socket says 172.21.15.130:49698) 2023-09-13T06:02:50.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.823+0000 7f56867fc640 1 -- 172.21.15.130:0/2566031429 learned_addr learned my addr 172.21.15.130:0/2566031429 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:50.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568f7fe640 1 --2- 172.21.15.130:0/2566031429 >> v2:172.21.15.164:3300/0 conn(0x7f56900b1d20 0x7f56900b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568effd640 1 --2- 172.21.15.130:0/2566031429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5690159f20 0x7f56900ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568e7fc640 1 -- 172.21.15.130:0/2566031429 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857244433 0 0) 0x7f56900ccfd0 con 0x7f56900cdfc0 2023-09-13T06:02:50.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568e7fc640 1 -- 172.21.15.130:0/2566031429 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f567c003530 con 0x7f56900cdfc0 2023-09-13T06:02:50.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568f7fe640 1 -- 172.21.15.130:0/2566031429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5690159f20 msgr2=0x7f56900ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:50.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568f7fe640 1 --2- 172.21.15.130:0/2566031429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5690159f20 0x7f56900ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568e7fc640 1 -- 172.21.15.130:0/2566031429 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3120430951 0 0) 0x7f567c003530 con 0x7f56900cdfc0 2023-09-13T06:02:50.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568f7fe640 1 -- 172.21.15.130:0/2566031429 >> v1:172.21.15.130:6789/0 conn(0x7f56900cdfc0 legacy=0x7f56900b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568f7fe640 1 -- 172.21.15.130:0/2566031429 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900ced90 con 0x7f56900b1d20 2023-09-13T06:02:50.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568f7fe640 1 --2- 172.21.15.130:0/2566031429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56900b1d20 0x7f56900b0c90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5688009d90 tx=0x7f568801c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=423567ee77a060f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:50.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568e7fc640 1 -- 172.21.15.130:0/2566031429 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678001680 con 0x7f56900b1d20 2023-09-13T06:02:50.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568e7fc640 1 -- 172.21.15.130:0/2566031429 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56880a5560 con 0x7f56900b1d20 2023-09-13T06:02:50.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.827+0000 7f568e7fc640 1 -- 172.21.15.130:0/2566031429 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880a58f0 con 0x7f56900b1d20 2023-09-13T06:02:50.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 -- 172.21.15.130:0/2566031429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56900b1d20 msgr2=0x7f56900b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 --2- 172.21.15.130:0/2566031429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56900b1d20 0x7f56900b0c90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5688009d90 tx=0x7f568801c870 comp rx=0 tx=0).stop 2023-09-13T06:02:50.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 -- 172.21.15.130:0/2566031429 shutdown_connections 2023-09-13T06:02:50.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 --2- 172.21.15.130:0/2566031429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56900b1d20 0x7f56900b0c90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 --2- 172.21.15.130:0/2566031429 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5690159f20 0x7f56900ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 -- 172.21.15.130:0/2566031429 >> 172.21.15.130:0/2566031429 conn(0x7f5690065990 msgr2=0x7f5690065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:50.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 -- 172.21.15.130:0/2566031429 shutdown_connections 2023-09-13T06:02:50.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 -- 172.21.15.130:0/2566031429 wait complete. 2023-09-13T06:02:50.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 Processor -- start 2023-09-13T06:02:50.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 -- start start 2023-09-13T06:02:50.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56900b1d20 0x7f56901523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56900cdfc0 0x7f5690148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5690159f20 0x7f56901574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5690148ad0 con 0x7f56900cdfc0 2023-09-13T06:02:50.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5690134f80 con 0x7f56900b1d20 2023-09-13T06:02:50.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f569572c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56901579e0 con 0x7f5690159f20 2023-09-13T06:02:50.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f56867fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56900cdfc0 0x7f5690148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f56867fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56900cdfc0 0x7f5690148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36842/0 (socket says 172.21.15.130:36842) 2023-09-13T06:02:50.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f56867fc640 1 -- 172.21.15.130:0/2493047887 learned_addr learned my addr 172.21.15.130:0/2493047887 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:50.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.831+0000 7f568f7fe640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5690159f20 0x7f56901574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f568effd640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56900b1d20 0x7f56901523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f56867fc640 1 -- 172.21.15.130:0/2493047887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5690159f20 msgr2=0x7f56901574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f56867fc640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5690159f20 0x7f56901574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f56867fc640 1 -- 172.21.15.130:0/2493047887 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56900b1d20 msgr2=0x7f56901523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:50.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f56867fc640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56900b1d20 0x7f56901523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:50.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f56867fc640 1 -- 172.21.15.130:0/2493047887 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5688009a70 con 0x7f56900cdfc0 2023-09-13T06:02:50.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f568f7fe640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5690159f20 0x7f56901574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:50.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f56867fc640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56900cdfc0 0x7f5690148590 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f567800c780 tx=0x7f567800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:50.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f5687fff640 1 -- 172.21.15.130:0/2493047887 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678005cf0 con 0x7f56900cdfc0 2023-09-13T06:02:50.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f5687fff640 1 -- 172.21.15.130:0/2493047887 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5678005e50 con 0x7f56900cdfc0 2023-09-13T06:02:50.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f5687fff640 1 -- 172.21.15.130:0/2493047887 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56780072b0 con 0x7f56900cdfc0 2023-09-13T06:02:50.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f569572c640 1 -- 172.21.15.130:0/2493047887 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5690157cb0 con 0x7f56900cdfc0 2023-09-13T06:02:50.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f569572c640 1 -- 172.21.15.130:0/2493047887 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5690134c10 con 0x7f56900cdfc0 2023-09-13T06:02:50.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f569572c640 1 -- 172.21.15.130:0/2493047887 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56900ad960 con 0x7f56900cdfc0 2023-09-13T06:02:50.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f5687fff640 1 -- 172.21.15.130:0/2493047887 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5678007410 con 0x7f56900cdfc0 2023-09-13T06:02:50.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f5687fff640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5670065b20 0x7f5670067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:50.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f5687fff640 1 -- 172.21.15.130:0/2493047887 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5678082e50 con 0x7f56900cdfc0 2023-09-13T06:02:50.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.835+0000 7f568effd640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5670065b20 0x7f5670067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:50.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.839+0000 7f568effd640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5670065b20 0x7f5670067fe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5680009a50 tx=0x7f5680008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:50.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.839+0000 7f5687fff640 1 -- 172.21.15.130:0/2493047887 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5678050a00 con 0x7f56900cdfc0 2023-09-13T06:02:51.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:50.999+0000 7f569572c640 1 -- 172.21.15.130:0/2493047887 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f56901350f0 con 0x7f56900cdfc0 2023-09-13T06:02:51.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.519+0000 7f5687fff640 1 -- 172.21.15.130:0/2493047887 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5678054020 con 0x7f56900cdfc0 2023-09-13T06:02:51.525 INFO:teuthology.orchestra.run.smithi130.stderr: removed all blocklist entries 2023-09-13T06:02:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 -- 172.21.15.130:0/2493047887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5670065b20 msgr2=0x7f5670067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5670065b20 0x7f5670067fe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5680009a50 tx=0x7f5680008040 comp rx=0 tx=0).stop 2023-09-13T06:02:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 -- 172.21.15.130:0/2493047887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56900cdfc0 msgr2=0x7f5690148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56900cdfc0 0x7f5690148590 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f567800c780 tx=0x7f567800cc40 comp rx=0 tx=0).stop 2023-09-13T06:02:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 -- 172.21.15.130:0/2493047887 shutdown_connections 2023-09-13T06:02:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5670065b20 0x7f5670067fe0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5690159f20 0x7f56901574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56900cdfc0 0x7f5690148590 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 --2- 172.21.15.130:0/2493047887 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56900b1d20 0x7f56901523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 -- 172.21.15.130:0/2493047887 >> 172.21.15.130:0/2493047887 conn(0x7f5690065990 msgr2=0x7f5690070870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:51.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 -- 172.21.15.130:0/2493047887 shutdown_connections 2023-09-13T06:02:51.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.523+0000 7f569572c640 1 -- 172.21.15.130:0/2493047887 wait complete. 2023-09-13T06:02:51.549 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-13T06:02:51.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb7757fa640 1 Processor -- start 2023-09-13T06:02:51.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb7757fa640 1 -- start start 2023-09-13T06:02:51.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb7757fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 0x7fb77015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:51.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb7757fa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb770146f30 0x7fb7700b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:51.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb7757fa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7700b63c0 con 0x7fb7700d1090 2023-09-13T06:02:51.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb7757fa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77015dea0 con 0x7fb770146f30 2023-09-13T06:02:51.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb7757fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700d0c20 con 0x7fb7700d1750 2023-09-13T06:02:51.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb7667fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb7700d1090 0x7fb770146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59702/0 (socket says 172.21.15.130:59702) 2023-09-13T06:02:51.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb7667fc640 1 -- 172.21.15.130:0/654551869 learned_addr learned my addr 172.21.15.130:0/654551869 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:51.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb76effd640 1 --2- 172.21.15.130:0/654551869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 0x7fb77015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:51.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb76f7fe640 1 --2- 172.21.15.130:0/654551869 >> v2:172.21.15.164:3300/0 conn(0x7fb770146f30 0x7fb7700b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:51.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.683+0000 7fb76e7fc640 1 -- 172.21.15.130:0/654551869 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251467434 0 0) 0x7fb7700b63c0 con 0x7fb7700d1090 2023-09-13T06:02:51.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.687+0000 7fb76e7fc640 1 -- 172.21.15.130:0/654551869 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb750003530 con 0x7fb7700d1090 2023-09-13T06:02:51.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.687+0000 7fb76effd640 1 -- 172.21.15.130:0/654551869 >> v2:172.21.15.164:3300/0 conn(0x7fb770146f30 msgr2=0x7fb7700b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:51.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.687+0000 7fb76effd640 1 --2- 172.21.15.130:0/654551869 >> v2:172.21.15.164:3300/0 conn(0x7fb770146f30 0x7fb7700b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.687+0000 7fb76effd640 1 -- 172.21.15.130:0/654551869 >> v1:172.21.15.130:6789/0 conn(0x7fb7700d1090 legacy=0x7fb770146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:51.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.687+0000 7fb76effd640 1 -- 172.21.15.130:0/654551869 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700b6610 con 0x7fb7700d1750 2023-09-13T06:02:51.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.687+0000 7fb76effd640 1 --2- 172.21.15.130:0/654551869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 0x7fb77015d960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7600097c0 tx=0x7fb76001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=813ff83a1885bee3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:51.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.687+0000 7fb76e7fc640 1 -- 172.21.15.130:0/654551869 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600ab650 con 0x7fb7700d1750 2023-09-13T06:02:51.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.687+0000 7fb76e7fc640 1 -- 172.21.15.130:0/654551869 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7600ab7b0 con 0x7fb7700d1750 2023-09-13T06:02:51.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.687+0000 7fb76e7fc640 1 -- 172.21.15.130:0/654551869 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600abb40 con 0x7fb7700d1750 2023-09-13T06:02:51.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.687+0000 7fb7757fa640 1 -- 172.21.15.130:0/654551869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 msgr2=0x7fb77015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:51.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.687+0000 7fb7757fa640 1 --2- 172.21.15.130:0/654551869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 0x7fb77015d960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7600097c0 tx=0x7fb76001c450 comp rx=0 tx=0).stop 2023-09-13T06:02:51.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 -- 172.21.15.130:0/654551869 shutdown_connections 2023-09-13T06:02:51.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 --2- 172.21.15.130:0/654551869 >> v2:172.21.15.164:3300/0 conn(0x7fb770146f30 0x7fb7700b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 --2- 172.21.15.130:0/654551869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 0x7fb77015d960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 -- 172.21.15.130:0/654551869 >> 172.21.15.130:0/654551869 conn(0x7fb77006f170 msgr2=0x7fb77006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:51.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 -- 172.21.15.130:0/654551869 shutdown_connections 2023-09-13T06:02:51.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 -- 172.21.15.130:0/654551869 wait complete. 2023-09-13T06:02:51.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 Processor -- start 2023-09-13T06:02:51.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 -- start start 2023-09-13T06:02:51.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7700d1090 0x7fb77013e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:51.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 0x7fb7701f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:51.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb770146f30 0x7fb7701f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:51.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77015d3a0 con 0x7fb7700d1090 2023-09-13T06:02:51.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7701f7ef0 con 0x7fb770146f30 2023-09-13T06:02:51.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7757fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7701f72e0 con 0x7fb7700d1750 2023-09-13T06:02:51.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb76effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7700d1090 0x7fb77013e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:51.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb76effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7700d1090 0x7fb77013e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51966/0 (socket says 172.21.15.130:51966) 2023-09-13T06:02:51.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb76effd640 1 -- 172.21.15.130:0/1245259038 learned_addr learned my addr 172.21.15.130:0/1245259038 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:51.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7667fc640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 0x7fb7701f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:51.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb76f7fe640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb770146f30 0x7fb7701f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:51.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb76effd640 1 -- 172.21.15.130:0/1245259038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 msgr2=0x7fb7701f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:51.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb76effd640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 0x7fb7701f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb76effd640 1 -- 172.21.15.130:0/1245259038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb770146f30 msgr2=0x7fb7701f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:51.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb76effd640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb770146f30 0x7fb7701f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb76effd640 1 -- 172.21.15.130:0/1245259038 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760009420 con 0x7fb7700d1090 2023-09-13T06:02:51.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb7667fc640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 0x7fb7701f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:51.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb76f7fe640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb770146f30 0x7fb7701f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:51.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.691+0000 7fb76effd640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7700d1090 0x7fb77013e750 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb76001ab00 tx=0x7fb76001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:51.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.695+0000 7fb767fff640 1 -- 172.21.15.130:0/1245259038 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600bf610 con 0x7fb7700d1090 2023-09-13T06:02:51.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.695+0000 7fb767fff640 1 -- 172.21.15.130:0/1245259038 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7600bf770 con 0x7fb7700d1090 2023-09-13T06:02:51.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.695+0000 7fb7757fa640 1 -- 172.21.15.130:0/1245259038 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7700b7e40 con 0x7fb7700d1090 2023-09-13T06:02:51.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.695+0000 7fb767fff640 1 -- 172.21.15.130:0/1245259038 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600bfb20 con 0x7fb7700d1090 2023-09-13T06:02:51.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.695+0000 7fb7757fa640 1 -- 172.21.15.130:0/1245259038 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7701f78a0 con 0x7fb7700d1090 2023-09-13T06:02:51.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.695+0000 7fb7757fa640 1 -- 172.21.15.130:0/1245259038 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7700618a0 con 0x7fb7700d1090 2023-09-13T06:02:51.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.695+0000 7fb767fff640 1 -- 172.21.15.130:0/1245259038 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb7600bfc80 con 0x7fb7700d1090 2023-09-13T06:02:51.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.695+0000 7fb767fff640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb754065b20 0x7fb754067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:51.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.695+0000 7fb767fff640 1 -- 172.21.15.130:0/1245259038 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb76011ddc0 con 0x7fb7700d1090 2023-09-13T06:02:51.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.695+0000 7fb7667fc640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb754065b20 0x7fb754067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:51.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.695+0000 7fb7667fc640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb754065b20 0x7fb754067fe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb770146350 tx=0x7fb758009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:51.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.699+0000 7fb767fff640 1 -- 172.21.15.130:0/1245259038 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb7600ebb80 con 0x7fb7700d1090 2023-09-13T06:02:51.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 -- 172.21.15.130:0/1245259038 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb7700cfa80 con 0x7fb7700d1090 2023-09-13T06:02:51.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb767fff640 1 -- 172.21.15.130:0/1245259038 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb7600ef1a0 con 0x7fb7700d1090 2023-09-13T06:02:51.903 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:51.904 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:02:51.904 INFO:teuthology.orchestra.run.smithi130.stdout: "auth_dump": [ 2023-09-13T06:02:51.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.904 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.a", 2023-09-13T06:02:51.905 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw==", 2023-09-13T06:02:51.905 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.905 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:51.905 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:02:51.905 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:02:51.906 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.906 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.907 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.b", 2023-09-13T06:02:51.908 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg==", 2023-09-13T06:02:51.908 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.908 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:51.909 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:02:51.909 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:02:51.909 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.909 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.910 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.c", 2023-09-13T06:02:51.911 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A==", 2023-09-13T06:02:51.911 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.911 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:51.912 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:02:51.912 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:02:51.912 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.913 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.913 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.d", 2023-09-13T06:02:51.914 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg==", 2023-09-13T06:02:51.914 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.914 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:51.914 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:02:51.915 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:02:51.915 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.915 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.916 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.0", 2023-09-13T06:02:51.916 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw==", 2023-09-13T06:02:51.917 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.917 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:51.917 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:51.918 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.918 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.918 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.1", 2023-09-13T06:02:51.919 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ==", 2023-09-13T06:02:51.919 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.919 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:51.920 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:51.920 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.920 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.921 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.921 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.2", 2023-09-13T06:02:51.922 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw==", 2023-09-13T06:02:51.922 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.922 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:51.922 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:51.923 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.923 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.924 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.3", 2023-09-13T06:02:51.924 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g==", 2023-09-13T06:02:51.924 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.925 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:51.925 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:51.925 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.925 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.926 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.4", 2023-09-13T06:02:51.926 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ==", 2023-09-13T06:02:51.927 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.927 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:51.928 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:51.928 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.928 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.929 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.5", 2023-09-13T06:02:51.929 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw==", 2023-09-13T06:02:51.929 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.930 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:51.930 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:51.930 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.931 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.932 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.6", 2023-09-13T06:02:51.932 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA==", 2023-09-13T06:02:51.932 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.933 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:51.933 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:51.933 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.933 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.934 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.7", 2023-09-13T06:02:51.935 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA==", 2023-09-13T06:02:51.935 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.935 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:02:51.936 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:02:51.936 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.937 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.938 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.0", 2023-09-13T06:02:51.938 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA==", 2023-09-13T06:02:51.938 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.939 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:51.939 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow r", 2023-09-13T06:02:51.941 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-13T06:02:51.941 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.942 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.1", 2023-09-13T06:02:51.943 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg==", 2023-09-13T06:02:51.943 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.943 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:51.944 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:02:51.944 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:02:51.945 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:02:51.945 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.946 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.2", 2023-09-13T06:02:51.946 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw==", 2023-09-13T06:02:51.946 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.946 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:51.947 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:02:51.947 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:02:51.947 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:02:51.948 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.948 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.3", 2023-09-13T06:02:51.949 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA==", 2023-09-13T06:02:51.949 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.949 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:02:51.949 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:02:51.950 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:02:51.950 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:02:51.950 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.951 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.admin", 2023-09-13T06:02:51.951 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQANUAFl5ccJOBAAP4KJItnG8vNd5OP/63ai0g==", 2023-09-13T06:02:51.951 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.952 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:02:51.952 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:02:51.952 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:02:51.952 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.953 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.954 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.x", 2023-09-13T06:02:51.954 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ==", 2023-09-13T06:02:51.954 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.954 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:02:51.955 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:02:51.955 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.955 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:02:51.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:51.956 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.y", 2023-09-13T06:02:51.957 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA==", 2023-09-13T06:02:51.957 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:02:51.958 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:02:51.958 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:02:51.958 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:02:51.958 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.959 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:51.959 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:02:51.959 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:02:51.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 -- 172.21.15.130:0/1245259038 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb754065b20 msgr2=0x7fb754067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:51.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb754065b20 0x7fb754067fe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb770146350 tx=0x7fb758009040 comp rx=0 tx=0).stop 2023-09-13T06:02:51.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 -- 172.21.15.130:0/1245259038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7700d1090 msgr2=0x7fb77013e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:51.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7700d1090 0x7fb77013e750 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb76001ab00 tx=0x7fb76001ac90 comp rx=0 tx=0).stop 2023-09-13T06:02:51.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 -- 172.21.15.130:0/1245259038 shutdown_connections 2023-09-13T06:02:51.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb754065b20 0x7fb754067fe0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb770146f30 0x7fb7701f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7700d1750 0x7fb7701f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 --2- 172.21.15.130:0/1245259038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7700d1090 0x7fb77013e750 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:51.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 -- 172.21.15.130:0/1245259038 >> 172.21.15.130:0/1245259038 conn(0x7fb77006f170 msgr2=0x7fb7701465f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:51.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 -- 172.21.15.130:0/1245259038 shutdown_connections 2023-09-13T06:02:51.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:51.899+0000 7fb7757fa640 1 -- 172.21.15.130:0/1245259038 wait complete. 2023-09-13T06:02:51.966 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:52.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde45c6640 1 Processor -- start 2023-09-13T06:02:52.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde45c6640 1 -- start start 2023-09-13T06:02:52.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde45c6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbddc0d1750 0x7fbddc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde45c6640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbddc0b63c0 con 0x7fbddc0d1090 2023-09-13T06:02:52.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde45c6640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbddc0d0c20 con 0x7fbddc146f30 2023-09-13T06:02:52.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde45c6640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbddc15dea0 con 0x7fbddc0d1750 2023-09-13T06:02:52.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde2362640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbddc0d1750 0x7fbddc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde1b61640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fbddc0d1090 0x7fbddc146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59708/0 (socket says 172.21.15.130:59708) 2023-09-13T06:02:52.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde1b61640 1 -- 172.21.15.130:0/677556864 learned_addr learned my addr 172.21.15.130:0/677556864 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:52.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde2362640 1 -- 172.21.15.130:0/677556864 >> v1:172.21.15.164:6789/0 conn(0x7fbddc146f30 legacy=0x7fbddc0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:52.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde2362640 1 -- 172.21.15.130:0/677556864 >> v1:172.21.15.130:6789/0 conn(0x7fbddc0d1090 legacy=0x7fbddc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde2362640 1 -- 172.21.15.130:0/677556864 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc0b6610 con 0x7fbddc0d1750 2023-09-13T06:02:52.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.099+0000 7fbde1360640 1 -- 172.21.15.130:0/677556864 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089759814 0 0) 0x7fbddc0b63c0 con 0x7fbddc0d1090 2023-09-13T06:02:52.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.103+0000 7fbde2362640 1 --2- 172.21.15.130:0/677556864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbddc0d1750 0x7fbddc15d960 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80097c0 tx=0x7fbdd801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26621d904d7de64b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:52.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.103+0000 7fbde1360640 1 -- 172.21.15.130:0/677556864 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80ad680 con 0x7fbddc0d1750 2023-09-13T06:02:52.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.103+0000 7fbde1360640 1 -- 172.21.15.130:0/677556864 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd80ad7e0 con 0x7fbddc0d1750 2023-09-13T06:02:52.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.103+0000 7fbde1360640 1 -- 172.21.15.130:0/677556864 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80adb70 con 0x7fbddc0d1750 2023-09-13T06:02:52.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.103+0000 7fbde45c6640 1 -- 172.21.15.130:0/677556864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbddc0d1750 msgr2=0x7fbddc15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.103+0000 7fbde45c6640 1 --2- 172.21.15.130:0/677556864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbddc0d1750 0x7fbddc15d960 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80097c0 tx=0x7fbdd801c380 comp rx=0 tx=0).stop 2023-09-13T06:02:52.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.103+0000 7fbde45c6640 1 -- 172.21.15.130:0/677556864 shutdown_connections 2023-09-13T06:02:52.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.103+0000 7fbde45c6640 1 --2- 172.21.15.130:0/677556864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbddc0d1750 0x7fbddc15d960 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.103+0000 7fbde45c6640 1 -- 172.21.15.130:0/677556864 >> 172.21.15.130:0/677556864 conn(0x7fbddc06f170 msgr2=0x7fbddc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:52.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.103+0000 7fbde45c6640 1 -- 172.21.15.130:0/677556864 shutdown_connections 2023-09-13T06:02:52.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.103+0000 7fbde45c6640 1 -- 172.21.15.130:0/677556864 wait complete. 2023-09-13T06:02:52.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde45c6640 1 Processor -- start 2023-09-13T06:02:52.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde45c6640 1 -- start start 2023-09-13T06:02:52.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde45c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbddc0d1090 0x7fbddc15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde45c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbddc0d1750 0x7fbddc12f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde45c6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbddc146f30 0x7fbddc1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde45c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc1456b0 con 0x7fbddc0d1750 2023-09-13T06:02:52.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde45c6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc144b30 con 0x7fbddc146f30 2023-09-13T06:02:52.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde45c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc144e10 con 0x7fbddc0d1090 2023-09-13T06:02:52.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde1b61640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbddc0d1750 0x7fbddc12f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde1b61640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbddc0d1750 0x7fbddc12f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51990/0 (socket says 172.21.15.130:51990) 2023-09-13T06:02:52.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde1b61640 1 -- 172.21.15.130:0/2183917143 learned_addr learned my addr 172.21.15.130:0/2183917143 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:52.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde2362640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbddc0d1090 0x7fbddc15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde2b63640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbddc146f30 0x7fbddc1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde1b61640 1 -- 172.21.15.130:0/2183917143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbddc0d1090 msgr2=0x7fbddc15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde1b61640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbddc0d1090 0x7fbddc15cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde1b61640 1 -- 172.21.15.130:0/2183917143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbddc146f30 msgr2=0x7fbddc1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde1b61640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbddc146f30 0x7fbddc1566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde1b61640 1 -- 172.21.15.130:0/2183917143 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd8009420 con 0x7fbddc0d1750 2023-09-13T06:02:52.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde1b61640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbddc0d1750 0x7fbddc12f880 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c4b0 tx=0x7fbdcc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:52.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbdd2ffd640 1 -- 172.21.15.130:0/2183917143 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0074e0 con 0x7fbddc0d1750 2023-09-13T06:02:52.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbdd2ffd640 1 -- 172.21.15.130:0/2183917143 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc007660 con 0x7fbddc0d1750 2023-09-13T06:02:52.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbdd2ffd640 1 -- 172.21.15.130:0/2183917143 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc004a30 con 0x7fbddc0d1750 2023-09-13T06:02:52.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde45c6640 1 -- 172.21.15.130:0/2183917143 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbddc1450f0 con 0x7fbddc0d1750 2023-09-13T06:02:52.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.107+0000 7fbde45c6640 1 -- 172.21.15.130:0/2183917143 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbddc15d4c0 con 0x7fbddc0d1750 2023-09-13T06:02:52.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.111+0000 7fbde45c6640 1 -- 172.21.15.130:0/2183917143 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbddc0618a0 con 0x7fbddc0d1750 2023-09-13T06:02:52.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.111+0000 7fbdd2ffd640 1 -- 172.21.15.130:0/2183917143 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbdcc004b90 con 0x7fbddc0d1750 2023-09-13T06:02:52.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.111+0000 7fbdd2ffd640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdc0065b20 0x7fbdc0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.111+0000 7fbdd2ffd640 1 -- 172.21.15.130:0/2183917143 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbdcc082240 con 0x7fbddc0d1750 2023-09-13T06:02:52.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.111+0000 7fbde2362640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdc0065b20 0x7fbdc0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.111+0000 7fbde2362640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdc0065b20 0x7fbdc0067fe0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80af000 tx=0x7fbdd80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:52.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.115+0000 7fbdd2ffd640 1 -- 172.21.15.130:0/2183917143 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbdcc04ff90 con 0x7fbddc0d1750 2023-09-13T06:02:52.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.267+0000 7fbde45c6640 1 -- 172.21.15.130:0/2183917143 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbddc15ae90 con 0x7fbddc0d1750 2023-09-13T06:02:52.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.267+0000 7fbdd2ffd640 1 -- 172.21.15.130:0/2183917143 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+12893 (secure 0 0 0) 0x7fbdcc018090 con 0x7fbddc0d1750 2023-09-13T06:02:52.272 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:52.273 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":41,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:51.530468+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:52.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 -- 172.21.15.130:0/2183917143 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdc0065b20 msgr2=0x7fbdc0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdc0065b20 0x7fbdc0067fe0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80af000 tx=0x7fbdd80a7000 comp rx=0 tx=0).stop 2023-09-13T06:02:52.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 -- 172.21.15.130:0/2183917143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbddc0d1750 msgr2=0x7fbddc12f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbddc0d1750 0x7fbddc12f880 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c4b0 tx=0x7fbdcc00c970 comp rx=0 tx=0).stop 2023-09-13T06:02:52.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 -- 172.21.15.130:0/2183917143 shutdown_connections 2023-09-13T06:02:52.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdc0065b20 0x7fbdc0067fe0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbddc146f30 0x7fbddc1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbddc0d1750 0x7fbddc12f880 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 --2- 172.21.15.130:0/2183917143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbddc0d1090 0x7fbddc15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 -- 172.21.15.130:0/2183917143 >> 172.21.15.130:0/2183917143 conn(0x7fbddc06f170 msgr2=0x7fbddc15dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:52.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 -- 172.21.15.130:0/2183917143 shutdown_connections 2023-09-13T06:02:52.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.271+0000 7fbde45c6640 1 -- 172.21.15.130:0/2183917143 wait complete. 2023-09-13T06:02:52.293 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:02:52.294 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:02:52.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.431+0000 7fab23856640 1 Processor -- start 2023-09-13T06:02:52.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.431+0000 7fab23856640 1 -- start start 2023-09-13T06:02:52.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.431+0000 7fab23856640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab1c0b31a0 0x7fab1c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.431+0000 7fab23856640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c0cc850 con 0x7fab1c15a080 2023-09-13T06:02:52.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.431+0000 7fab23856640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c0b0330 con 0x7fab1c0b1460 2023-09-13T06:02:52.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.431+0000 7fab23856640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0cbcd0 con 0x7fab1c0b31a0 2023-09-13T06:02:52.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.431+0000 7fab215f2640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fab1c15a080 0x7fab1c15e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59714/0 (socket says 172.21.15.130:59714) 2023-09-13T06:02:52.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.431+0000 7fab215f2640 1 -- 172.21.15.130:0/31659073 learned_addr learned my addr 172.21.15.130:0/31659073 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:52.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.431+0000 7fab21df3640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab1c0b31a0 0x7fab1c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.431+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490723744 0 0) 0x7fab18001120 con 0x7fab1c15a080 2023-09-13T06:02:52.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab08003530 con 0x7fab1c15a080 2023-09-13T06:02:52.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1310603677 0 0) 0x7fab08003530 con 0x7fab1c15a080 2023-09-13T06:02:52.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab1c0b31a0 msgr2=0x7fab1c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:52.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab1c0b31a0 0x7fab1c0ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 >> v1:172.21.15.164:6789/0 conn(0x7fab1c0b1460 legacy=0x7fab1c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c0cbfb0 con 0x7fab1c15a080 2023-09-13T06:02:52.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fab18001810 con 0x7fab1c15a080 2023-09-13T06:02:52.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 >> v1:172.21.15.130:6789/0 conn(0x7fab1c15a080 legacy=0x7fab1c15e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab08003a20 0x7fab08003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab080047d0 0x7fab08004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab1c0b31a0 0x7fab08005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0cbcd0 con 0x7fab08003a20 2023-09-13T06:02:52.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0800bb80 con 0x7fab080047d0 2023-09-13T06:02:52.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0800bd40 con 0x7fab1c0b31a0 2023-09-13T06:02:52.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab215f2640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab08003a20 0x7fab08003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab20df1640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab080047d0 0x7fab08004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab21df3640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab1c0b31a0 0x7fab08005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab215f2640 1 -- 172.21.15.130:0/31659073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab1c0b31a0 msgr2=0x7fab08005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:52.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab215f2640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab1c0b31a0 0x7fab08005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab215f2640 1 -- 172.21.15.130:0/31659073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab080047d0 msgr2=0x7fab08004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:52.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab215f2640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab080047d0 0x7fab08004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.435+0000 7fab215f2640 1 -- 172.21.15.130:0/31659073 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08003530 con 0x7fab08003a20 2023-09-13T06:02:52.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab215f2640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab08003a20 0x7fab08003e40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fab18007e50 tx=0x7fab1801ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2781a92a450c0ff6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:52.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180a7bf0 con 0x7fab08003a20 2023-09-13T06:02:52.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab180a7d70 con 0x7fab08003a20 2023-09-13T06:02:52.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab13fff640 1 -- 172.21.15.130:0/31659073 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18005b20 con 0x7fab08003a20 2023-09-13T06:02:52.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 -- 172.21.15.130:0/31659073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab08003a20 msgr2=0x7fab08003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 --2- 172.21.15.130:0/31659073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab08003a20 0x7fab08003e40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fab18007e50 tx=0x7fab1801ee00 comp rx=0 tx=0).stop 2023-09-13T06:02:52.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab21df3640 1 -- 172.21.15.130:0/31659073 reap_dead start 2023-09-13T06:02:52.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 -- 172.21.15.130:0/31659073 shutdown_connections 2023-09-13T06:02:52.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 -- 172.21.15.130:0/31659073 >> 172.21.15.130:0/31659073 conn(0x7fab1c065990 msgr2=0x7fab1c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:52.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 -- 172.21.15.130:0/31659073 shutdown_connections 2023-09-13T06:02:52.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 -- 172.21.15.130:0/31659073 wait complete. 2023-09-13T06:02:52.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 Processor -- start 2023-09-13T06:02:52.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 -- start start 2023-09-13T06:02:52.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab08003a20 0x7fab1c13e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab1c13f370 0x7fab1c13f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab1c152860 0x7fab1c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c13fd10 con 0x7fab1c152860 2023-09-13T06:02:52.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c153220 con 0x7fab1c13f370 2023-09-13T06:02:52.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.439+0000 7fab23856640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c147f70 con 0x7fab08003a20 2023-09-13T06:02:52.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab21df3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab1c152860 0x7fab1c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab21df3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab1c152860 0x7fab1c152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51998/0 (socket says 172.21.15.130:51998) 2023-09-13T06:02:52.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab21df3640 1 -- 172.21.15.130:0/545703900 learned_addr learned my addr 172.21.15.130:0/545703900 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:52.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab215f2640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab08003a20 0x7fab1c13e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab20df1640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab1c13f370 0x7fab1c13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab21df3640 1 -- 172.21.15.130:0/545703900 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab08003a20 msgr2=0x7fab1c13e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab21df3640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab08003a20 0x7fab1c13e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab21df3640 1 -- 172.21.15.130:0/545703900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab1c13f370 msgr2=0x7fab1c13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab21df3640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab1c13f370 0x7fab1c13f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab21df3640 1 -- 172.21.15.130:0/545703900 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c13e740 con 0x7fab1c152860 2023-09-13T06:02:52.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab21df3640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab1c152860 0x7fab1c152ce0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0d0000 tx=0x7fab1400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:52.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab11ffb640 1 -- 172.21.15.130:0/545703900 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1400e040 con 0x7fab1c152860 2023-09-13T06:02:52.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab11ffb640 1 -- 172.21.15.130:0/545703900 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1400f040 con 0x7fab1c152860 2023-09-13T06:02:52.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab23856640 1 -- 172.21.15.130:0/545703900 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c147080 con 0x7fab1c152860 2023-09-13T06:02:52.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab11ffb640 1 -- 172.21.15.130:0/545703900 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14015670 con 0x7fab1c152860 2023-09-13T06:02:52.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab23856640 1 -- 172.21.15.130:0/545703900 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c147640 con 0x7fab1c152860 2023-09-13T06:02:52.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab23856640 1 -- 172.21.15.130:0/545703900 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1c1480e0 con 0x7fab1c152860 2023-09-13T06:02:52.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab11ffb640 1 -- 172.21.15.130:0/545703900 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fab140157d0 con 0x7fab1c152860 2023-09-13T06:02:52.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.443+0000 7fab11ffb640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab00065b50 0x7fab00068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.447+0000 7fab11ffb640 1 -- 172.21.15.130:0/545703900 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab14083690 con 0x7fab1c152860 2023-09-13T06:02:52.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.447+0000 7fab215f2640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab00065b50 0x7fab00068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.447+0000 7fab215f2640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab00065b50 0x7fab00068010 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fab180ad000 tx=0x7fab180b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:52.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.451+0000 7fab11ffb640 1 -- 172.21.15.130:0/545703900 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fab140512b0 con 0x7fab1c152860 2023-09-13T06:02:52.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.603+0000 7fab23856640 1 -- 172.21.15.130:0/545703900 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab1c0b2010 con 0x7fab1c152860 2023-09-13T06:02:52.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.603+0000 7fab11ffb640 1 -- 172.21.15.130:0/545703900 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab140548d0 con 0x7fab1c152860 2023-09-13T06:02:52.608 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:02:52.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 -- 172.21.15.130:0/545703900 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab00065b50 msgr2=0x7fab00068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab00065b50 0x7fab00068010 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fab180ad000 tx=0x7fab180b3040 comp rx=0 tx=0).stop 2023-09-13T06:02:52.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 -- 172.21.15.130:0/545703900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab1c152860 msgr2=0x7fab1c152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab1c152860 0x7fab1c152ce0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0d0000 tx=0x7fab1400f580 comp rx=0 tx=0).stop 2023-09-13T06:02:52.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 -- 172.21.15.130:0/545703900 shutdown_connections 2023-09-13T06:02:52.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab00065b50 0x7fab00068010 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab1c13f370 0x7fab1c13f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab1c152860 0x7fab1c152ce0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 --2- 172.21.15.130:0/545703900 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab08003a20 0x7fab1c13e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 -- 172.21.15.130:0/545703900 >> 172.21.15.130:0/545703900 conn(0x7fab1c065990 msgr2=0x7fab1c15b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:52.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 -- 172.21.15.130:0/545703900 shutdown_connections 2023-09-13T06:02:52.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.607+0000 7fab23856640 1 -- 172.21.15.130:0/545703900 wait complete. 2023-09-13T06:02:52.629 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T06:02:52.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.763+0000 7f4051e7b640 1 Processor -- start 2023-09-13T06:02:52.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.763+0000 7f4051e7b640 1 -- start start 2023-09-13T06:02:52.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f4051e7b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f404c15b130 0x7f404c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f4051e7b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f404c0b04a0 0x7f404c0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f4051e7b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404c0ce980 con 0x7f404c0ce180 2023-09-13T06:02:52.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f4051e7b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c0b0e50 con 0x7f404c15b130 2023-09-13T06:02:52.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f4051e7b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c0cec60 con 0x7f404c0b04a0 2023-09-13T06:02:52.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f404b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f404c15b130 0x7f404c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f404b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f404c15b130 0x7f404c0cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52012/0 (socket says 172.21.15.130:52012) 2023-09-13T06:02:52.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f404b7fe640 1 -- 172.21.15.130:0/995796389 learned_addr learned my addr 172.21.15.130:0/995796389 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:52.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f404affd640 1 --1- 172.21.15.130:0/995796389 >> v1:172.21.15.130:6789/0 conn(0x7f404c0ce180 0x7f404c15b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59720/0 (socket says 172.21.15.130:59720) 2023-09-13T06:02:52.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f404bfff640 1 --2- 172.21.15.130:0/995796389 >> v2:172.21.15.164:3300/0 conn(0x7f404c0b04a0 0x7f404c0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f404b7fe640 1 -- 172.21.15.130:0/995796389 >> v2:172.21.15.164:3300/0 conn(0x7f404c0b04a0 msgr2=0x7f404c0b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:52.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f404b7fe640 1 --2- 172.21.15.130:0/995796389 >> v2:172.21.15.164:3300/0 conn(0x7f404c0b04a0 0x7f404c0b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f404b7fe640 1 -- 172.21.15.130:0/995796389 >> v1:172.21.15.130:6789/0 conn(0x7f404c0ce180 legacy=0x7f404c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f404b7fe640 1 -- 172.21.15.130:0/995796389 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c06c640 con 0x7f404c15b130 2023-09-13T06:02:52.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f404bfff640 1 --2- 172.21.15.130:0/995796389 >> v2:172.21.15.164:3300/0 conn(0x7f404c0b04a0 0x7f404c0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:52.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.767+0000 7f404a7fc640 1 -- 172.21.15.130:0/995796389 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512585467 0 0) 0x7f404c0ce980 con 0x7f404c0ce180 2023-09-13T06:02:52.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f404b7fe640 1 --2- 172.21.15.130:0/995796389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f404c15b130 0x7f404c0cc780 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f404c0b28c0 tx=0x7f403c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57efcc8620fb532e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:52.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f404a7fc640 1 -- 172.21.15.130:0/995796389 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0aa660 con 0x7f404c15b130 2023-09-13T06:02:52.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f404a7fc640 1 -- 172.21.15.130:0/995796389 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c0aa7c0 con 0x7f404c15b130 2023-09-13T06:02:52.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f404a7fc640 1 -- 172.21.15.130:0/995796389 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0aab50 con 0x7f404c15b130 2023-09-13T06:02:52.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f4051e7b640 1 -- 172.21.15.130:0/995796389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f404c15b130 msgr2=0x7f404c0cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f4051e7b640 1 --2- 172.21.15.130:0/995796389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f404c15b130 0x7f404c0cc780 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f404c0b28c0 tx=0x7f403c01c500 comp rx=0 tx=0).stop 2023-09-13T06:02:52.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f4051e7b640 1 -- 172.21.15.130:0/995796389 shutdown_connections 2023-09-13T06:02:52.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f4051e7b640 1 --2- 172.21.15.130:0/995796389 >> v2:172.21.15.164:3300/0 conn(0x7f404c0b04a0 0x7f404c0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f4051e7b640 1 --2- 172.21.15.130:0/995796389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f404c15b130 0x7f404c0cc780 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f4051e7b640 1 -- 172.21.15.130:0/995796389 >> 172.21.15.130:0/995796389 conn(0x7f404c065990 msgr2=0x7f404c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:52.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f4051e7b640 1 -- 172.21.15.130:0/995796389 shutdown_connections 2023-09-13T06:02:52.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f4051e7b640 1 -- 172.21.15.130:0/995796389 wait complete. 2023-09-13T06:02:52.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f4051e7b640 1 Processor -- start 2023-09-13T06:02:52.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.771+0000 7f4051e7b640 1 -- start start 2023-09-13T06:02:52.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4051e7b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f404c0b04a0 0x7f404c0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4051e7b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f404c0ce180 0x7f404c159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4051e7b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f404c15b130 0x7f404c1547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4051e7b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c1533c0 con 0x7f404c15b130 2023-09-13T06:02:52.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4051e7b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c15a490 con 0x7f404c0ce180 2023-09-13T06:02:52.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4051e7b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c15a210 con 0x7f404c0b04a0 2023-09-13T06:02:52.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f404c15b130 0x7f404c1547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f404c15b130 0x7f404c1547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52016/0 (socket says 172.21.15.130:52016) 2023-09-13T06:02:52.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404bfff640 1 -- 172.21.15.130:0/36326428 learned_addr learned my addr 172.21.15.130:0/36326428 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:52.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404affd640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f404c0ce180 0x7f404c159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404bfff640 1 -- 172.21.15.130:0/36326428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f404c0b04a0 msgr2=0x7f404c0cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404b7fe640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f404c0b04a0 0x7f404c0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404bfff640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f404c0b04a0 0x7f404c0cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404bfff640 1 -- 172.21.15.130:0/36326428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f404c0ce180 msgr2=0x7f404c159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404bfff640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f404c0ce180 0x7f404c159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404bfff640 1 -- 172.21.15.130:0/36326428 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c0094d0 con 0x7f404c15b130 2023-09-13T06:02:52.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404b7fe640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f404c0b04a0 0x7f404c0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:52.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404affd640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f404c0ce180 0x7f404c159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:52.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f404bfff640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f404c15b130 0x7f404c1547a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4044007e10 tx=0x7f404400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:52.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4033fff640 1 -- 172.21.15.130:0/36326428 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044003ba0 con 0x7f404c15b130 2023-09-13T06:02:52.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4033fff640 1 -- 172.21.15.130:0/36326428 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404400f040 con 0x7f404c15b130 2023-09-13T06:02:52.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4033fff640 1 -- 172.21.15.130:0/36326428 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404400de80 con 0x7f404c15b130 2023-09-13T06:02:52.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4051e7b640 1 -- 172.21.15.130:0/36326428 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c1535b0 con 0x7f404c15b130 2023-09-13T06:02:52.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4051e7b640 1 -- 172.21.15.130:0/36326428 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c153b30 con 0x7f404c15b130 2023-09-13T06:02:52.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4051e7b640 1 -- 172.21.15.130:0/36326428 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c0618a0 con 0x7f404c15b130 2023-09-13T06:02:52.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.775+0000 7f4033fff640 1 -- 172.21.15.130:0/36326428 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4044004030 con 0x7f404c15b130 2023-09-13T06:02:52.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.779+0000 7f4033fff640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4038065b20 0x7f4038067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:52.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.779+0000 7f4033fff640 1 -- 172.21.15.130:0/36326428 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f40440832c0 con 0x7f404c15b130 2023-09-13T06:02:52.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.779+0000 7f404b7fe640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4038065b20 0x7f4038067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:52.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.779+0000 7f404b7fe640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4038065b20 0x7f4038067fe0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f403c0ae000 tx=0x7f403c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:52.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.783+0000 7f4033fff640 1 -- 172.21.15.130:0/36326428 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4044050f60 con 0x7f404c15b130 2023-09-13T06:02:52.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.935+0000 7f4051e7b640 1 -- 172.21.15.130:0/36326428 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f404c0b1dd0 con 0x7f404c15b130 2023-09-13T06:02:52.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4033fff640 1 -- 172.21.15.130:0/36326428 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4044054580 con 0x7f404c15b130 2023-09-13T06:02:52.943 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:52.943 INFO:teuthology.orchestra.run.smithi130.stdout:[ 2023-09-13T06:02:52.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:02:52.943 INFO:teuthology.orchestra.run.smithi130.stdout: "poolnum": 1, 2023-09-13T06:02:52.943 INFO:teuthology.orchestra.run.smithi130.stdout: "poolname": ".mgr" 2023-09-13T06:02:52.944 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:02:52.944 INFO:teuthology.orchestra.run.smithi130.stdout:] 2023-09-13T06:02:52.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 -- 172.21.15.130:0/36326428 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4038065b20 msgr2=0x7f4038067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4038065b20 0x7f4038067fe0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f403c0ae000 tx=0x7f403c008040 comp rx=0 tx=0).stop 2023-09-13T06:02:52.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 -- 172.21.15.130:0/36326428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f404c15b130 msgr2=0x7f404c1547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:52.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f404c15b130 0x7f404c1547a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4044007e10 tx=0x7f404400d4a0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 -- 172.21.15.130:0/36326428 shutdown_connections 2023-09-13T06:02:52.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4038065b20 0x7f4038067fe0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f404c0ce180 0x7f404c159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f404c15b130 0x7f404c1547a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 --2- 172.21.15.130:0/36326428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f404c0b04a0 0x7f404c0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:52.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 -- 172.21.15.130:0/36326428 >> 172.21.15.130:0/36326428 conn(0x7f404c065990 msgr2=0x7f404c070990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:52.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 -- 172.21.15.130:0/36326428 shutdown_connections 2023-09-13T06:02:52.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:52.939+0000 7f4051e7b640 1 -- 172.21.15.130:0/36326428 wait complete. 2023-09-13T06:02:52.963 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T06:02:52.964 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T06:02:53.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.099+0000 7fa18e60b640 1 Processor -- start 2023-09-13T06:02:53.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.099+0000 7fa18e60b640 1 -- start start 2023-09-13T06:02:53.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa18e60b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1880ccc10 0x7fa18815dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa18e60b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa1880b3170 0x7fa1880b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa18e60b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa1880b1ff0 0x7fa1880cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa18e60b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1880ccff0 con 0x7fa1880b3170 2023-09-13T06:02:53.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa18e60b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1880b12f0 con 0x7fa1880b1ff0 2023-09-13T06:02:53.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa18e60b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18815e520 con 0x7fa1880ccc10 2023-09-13T06:02:53.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa1877fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa1880b3170 0x7fa1880b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:53.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa1877fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa1880b3170 0x7fa1880b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52022/0 (socket says 172.21.15.130:52022) 2023-09-13T06:02:53.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa1877fe640 1 -- 172.21.15.130:0/2810948498 learned_addr learned my addr 172.21.15.130:0/2810948498 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:53.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa1877fe640 1 -- 172.21.15.130:0/2810948498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1880ccc10 msgr2=0x7fa18815dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:53.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa1877fe640 1 --2- 172.21.15.130:0/2810948498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1880ccc10 0x7fa18815dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa1877fe640 1 -- 172.21.15.130:0/2810948498 >> v2:172.21.15.164:3300/0 conn(0x7fa1880b1ff0 msgr2=0x7fa1880cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:53.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa1877fe640 1 --2- 172.21.15.130:0/2810948498 >> v2:172.21.15.164:3300/0 conn(0x7fa1880b1ff0 0x7fa1880cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.103+0000 7fa1877fe640 1 -- 172.21.15.130:0/2810948498 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18815e800 con 0x7fa1880b3170 2023-09-13T06:02:53.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa1877fe640 1 --2- 172.21.15.130:0/2810948498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1880b3170 0x7fa1880b1ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa18806e8c0 tx=0x7fa17c01e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ecd5de95e90e04 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:53.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa186ffd640 1 -- 172.21.15.130:0/2810948498 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0ab680 con 0x7fa1880b3170 2023-09-13T06:02:53.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa186ffd640 1 -- 172.21.15.130:0/2810948498 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c0ab7e0 con 0x7fa1880b3170 2023-09-13T06:02:53.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa186ffd640 1 -- 172.21.15.130:0/2810948498 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0abb70 con 0x7fa1880b3170 2023-09-13T06:02:53.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa18e60b640 1 -- 172.21.15.130:0/2810948498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1880b3170 msgr2=0x7fa1880b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:53.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa18e60b640 1 --2- 172.21.15.130:0/2810948498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1880b3170 0x7fa1880b1ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa18806e8c0 tx=0x7fa17c01e6e0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa18e60b640 1 -- 172.21.15.130:0/2810948498 shutdown_connections 2023-09-13T06:02:53.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa18e60b640 1 --2- 172.21.15.130:0/2810948498 >> v2:172.21.15.164:3300/0 conn(0x7fa1880b1ff0 0x7fa1880cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa18e60b640 1 --2- 172.21.15.130:0/2810948498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1880b3170 0x7fa1880b1ab0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa18e60b640 1 --2- 172.21.15.130:0/2810948498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1880ccc10 0x7fa18815dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa18e60b640 1 -- 172.21.15.130:0/2810948498 >> 172.21.15.130:0/2810948498 conn(0x7fa1880735e0 msgr2=0x7fa188065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:53.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa18e60b640 1 -- 172.21.15.130:0/2810948498 shutdown_connections 2023-09-13T06:02:53.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa18e60b640 1 -- 172.21.15.130:0/2810948498 wait complete. 2023-09-13T06:02:53.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa18e60b640 1 Processor -- start 2023-09-13T06:02:53.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.107+0000 7fa18e60b640 1 -- start start 2023-09-13T06:02:53.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa18e60b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1880b1ff0 0x7fa188158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa18e60b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1880b3170 0x7fa18815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa18e60b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1880ccc10 0x7fa18815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa18e60b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18815cfb0 con 0x7fa1880b3170 2023-09-13T06:02:53.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa18e60b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa188158aa0 con 0x7fa1880b1ff0 2023-09-13T06:02:53.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa18e60b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18815bf10 con 0x7fa1880ccc10 2023-09-13T06:02:53.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa1877fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1880b3170 0x7fa18815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:53.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa1877fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1880b3170 0x7fa18815b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52026/0 (socket says 172.21.15.130:52026) 2023-09-13T06:02:53.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa1877fe640 1 -- 172.21.15.130:0/4137041789 learned_addr learned my addr 172.21.15.130:0/4137041789 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:53.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa18cba8640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1880ccc10 0x7fa18815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:53.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa187fff640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1880b1ff0 0x7fa188158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:53.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa1877fe640 1 -- 172.21.15.130:0/4137041789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1880ccc10 msgr2=0x7fa18815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:53.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa1877fe640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1880ccc10 0x7fa18815b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa1877fe640 1 -- 172.21.15.130:0/4137041789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1880b1ff0 msgr2=0x7fa188158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:53.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa1877fe640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1880b1ff0 0x7fa188158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa1877fe640 1 -- 172.21.15.130:0/4137041789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c0094d0 con 0x7fa1880b3170 2023-09-13T06:02:53.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa187fff640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1880b1ff0 0x7fa188158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:53.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa1877fe640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1880b3170 0x7fa18815b3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0ad040 tx=0x7fa17c01cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:53.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa184ff9640 1 -- 172.21.15.130:0/4137041789 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0b3800 con 0x7fa1880b3170 2023-09-13T06:02:53.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa184ff9640 1 -- 172.21.15.130:0/4137041789 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c0b3980 con 0x7fa1880b3170 2023-09-13T06:02:53.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa18e60b640 1 -- 172.21.15.130:0/4137041789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18815c1f0 con 0x7fa1880b3170 2023-09-13T06:02:53.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa184ff9640 1 -- 172.21.15.130:0/4137041789 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0b3d30 con 0x7fa1880b3170 2023-09-13T06:02:53.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa18e60b640 1 -- 172.21.15.130:0/4137041789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18815c7b0 con 0x7fa1880b3170 2023-09-13T06:02:53.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa18e60b640 1 -- 172.21.15.130:0/4137041789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1880618a0 con 0x7fa1880b3170 2023-09-13T06:02:53.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.111+0000 7fa184ff9640 1 -- 172.21.15.130:0/4137041789 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa17c0aa3e0 con 0x7fa1880b3170 2023-09-13T06:02:53.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.115+0000 7fa184ff9640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa174065b20 0x7fa174067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.115+0000 7fa184ff9640 1 -- 172.21.15.130:0/4137041789 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa17c11d5e0 con 0x7fa1880b3170 2023-09-13T06:02:53.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.115+0000 7fa187fff640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa174065b20 0x7fa174067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:53.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.115+0000 7fa187fff640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa174065b20 0x7fa174067fe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa188065ea0 tx=0x7fa178008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:53.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.119+0000 7fa184ff9640 1 -- 172.21.15.130:0/4137041789 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa17c0eb330 con 0x7fa1880b3170 2023-09-13T06:02:53.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.263+0000 7fa18e60b640 1 -- 172.21.15.130:0/4137041789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa18815d8d0 con 0x7fa1880b3170 2023-09-13T06:02:53.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.535+0000 7fa184ff9640 1 -- 172.21.15.130:0/4137041789 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa17c0ee950 con 0x7fa1880b3170 2023-09-13T06:02:53.538 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' created 2023-09-13T06:02:53.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.535+0000 7fa18e60b640 1 -- 172.21.15.130:0/4137041789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa174065b20 msgr2=0x7fa174067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:53.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.535+0000 7fa18e60b640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa174065b20 0x7fa174067fe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa188065ea0 tx=0x7fa178008040 comp rx=0 tx=0).stop 2023-09-13T06:02:53.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.535+0000 7fa18e60b640 1 -- 172.21.15.130:0/4137041789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1880b3170 msgr2=0x7fa18815b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:53.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.535+0000 7fa18e60b640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1880b3170 0x7fa18815b3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0ad040 tx=0x7fa17c01cf20 comp rx=0 tx=0).stop 2023-09-13T06:02:53.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.539+0000 7fa18e60b640 1 -- 172.21.15.130:0/4137041789 shutdown_connections 2023-09-13T06:02:53.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.539+0000 7fa18e60b640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa174065b20 0x7fa174067fe0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.539+0000 7fa18e60b640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1880ccc10 0x7fa18815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.539+0000 7fa18e60b640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1880b3170 0x7fa18815b3a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.539+0000 7fa18e60b640 1 --2- 172.21.15.130:0/4137041789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1880b1ff0 0x7fa188158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.539+0000 7fa18e60b640 1 -- 172.21.15.130:0/4137041789 >> 172.21.15.130:0/4137041789 conn(0x7fa1880735e0 msgr2=0x7fa18815daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:53.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.539+0000 7fa18e60b640 1 -- 172.21.15.130:0/4137041789 shutdown_connections 2023-09-13T06:02:53.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.539+0000 7fa18e60b640 1 -- 172.21.15.130:0/4137041789 wait complete. 2023-09-13T06:02:53.563 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T06:02:53.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff296cb640 1 Processor -- start 2023-09-13T06:02:53.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff296cb640 1 -- start start 2023-09-13T06:02:53.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff296cb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff2415a080 0x7eff240b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff296cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2415e650 0x7eff240b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff296cb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7eff240b2fd0 0x7eff240ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff296cb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff240cc850 con 0x7eff2415a080 2023-09-13T06:02:53.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff296cb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff240b3420 con 0x7eff240b2fd0 2023-09-13T06:02:53.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff296cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff240b0330 con 0x7eff2415e650 2023-09-13T06:02:53.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff22ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff2415a080 0x7eff240b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:53.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff22ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff2415a080 0x7eff240b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52034/0 (socket says 172.21.15.130:52034) 2023-09-13T06:02:53.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff22ffd640 1 -- 172.21.15.130:0/1137714544 learned_addr learned my addr 172.21.15.130:0/1137714544 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:53.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff237fe640 1 --2- 172.21.15.130:0/1137714544 >> v2:172.21.15.164:3300/0 conn(0x7eff240b2fd0 0x7eff240ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:53.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff22ffd640 1 -- 172.21.15.130:0/1137714544 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2415e650 msgr2=0x7eff240b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:53.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff22ffd640 1 --2- 172.21.15.130:0/1137714544 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2415e650 0x7eff240b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff22ffd640 1 -- 172.21.15.130:0/1137714544 >> v2:172.21.15.164:3300/0 conn(0x7eff240b2fd0 msgr2=0x7eff240ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:53.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff22ffd640 1 --2- 172.21.15.130:0/1137714544 >> v2:172.21.15.164:3300/0 conn(0x7eff240b2fd0 0x7eff240ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff22ffd640 1 -- 172.21.15.130:0/1137714544 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff240cbcd0 con 0x7eff2415a080 2023-09-13T06:02:53.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.703+0000 7eff237fe640 1 --2- 172.21.15.130:0/1137714544 >> v2:172.21.15.164:3300/0 conn(0x7eff240b2fd0 0x7eff240ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:53.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff22ffd640 1 --2- 172.21.15.130:0/1137714544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2415a080 0x7eff240b1460 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7eff240b2830 tx=0x7eff1401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce182871efb1ee3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:53.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff21ffb640 1 -- 172.21.15.130:0/1137714544 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140ab400 con 0x7eff2415a080 2023-09-13T06:02:53.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff21ffb640 1 -- 172.21.15.130:0/1137714544 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff140ab560 con 0x7eff2415a080 2023-09-13T06:02:53.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff21ffb640 1 -- 172.21.15.130:0/1137714544 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140ab8f0 con 0x7eff2415a080 2023-09-13T06:02:53.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff296cb640 1 -- 172.21.15.130:0/1137714544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2415a080 msgr2=0x7eff240b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:53.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff296cb640 1 --2- 172.21.15.130:0/1137714544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2415a080 0x7eff240b1460 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7eff240b2830 tx=0x7eff1401c440 comp rx=0 tx=0).stop 2023-09-13T06:02:53.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff296cb640 1 -- 172.21.15.130:0/1137714544 shutdown_connections 2023-09-13T06:02:53.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff296cb640 1 --2- 172.21.15.130:0/1137714544 >> v2:172.21.15.164:3300/0 conn(0x7eff240b2fd0 0x7eff240ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff296cb640 1 --2- 172.21.15.130:0/1137714544 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2415e650 0x7eff240b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff296cb640 1 --2- 172.21.15.130:0/1137714544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2415a080 0x7eff240b1460 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff296cb640 1 -- 172.21.15.130:0/1137714544 >> 172.21.15.130:0/1137714544 conn(0x7eff24065990 msgr2=0x7eff24065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:53.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff296cb640 1 -- 172.21.15.130:0/1137714544 shutdown_connections 2023-09-13T06:02:53.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.707+0000 7eff296cb640 1 -- 172.21.15.130:0/1137714544 wait complete. 2023-09-13T06:02:53.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff296cb640 1 Processor -- start 2023-09-13T06:02:53.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff296cb640 1 -- start start 2023-09-13T06:02:53.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff296cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff240b2fd0 0x7eff24150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff296cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2415a080 0x7eff2414b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff296cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2415e650 0x7eff241499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff296cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2415ba80 con 0x7eff2415e650 2023-09-13T06:02:53.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff296cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2414bbe0 con 0x7eff240b2fd0 2023-09-13T06:02:53.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff296cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2414bec0 con 0x7eff2415a080 2023-09-13T06:02:53.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff237fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2415e650 0x7eff241499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:53.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff22ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff240b2fd0 0x7eff24150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:53.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff227fc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2415a080 0x7eff2414b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:53.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff237fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2415e650 0x7eff241499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52048/0 (socket says 172.21.15.130:52048) 2023-09-13T06:02:53.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff237fe640 1 -- 172.21.15.130:0/1524898585 learned_addr learned my addr 172.21.15.130:0/1524898585 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:53.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff237fe640 1 -- 172.21.15.130:0/1524898585 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2415a080 msgr2=0x7eff2414b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:53.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff237fe640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2415a080 0x7eff2414b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff237fe640 1 -- 172.21.15.130:0/1524898585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff240b2fd0 msgr2=0x7eff24150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff237fe640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff240b2fd0 0x7eff24150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff237fe640 1 -- 172.21.15.130:0/1524898585 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140094d0 con 0x7eff2415e650 2023-09-13T06:02:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff237fe640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2415e650 0x7eff241499a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00cd50 tx=0x7eff1c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff0b7fe640 1 -- 172.21.15.130:0/1524898585 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00f680 con 0x7eff2415e650 2023-09-13T06:02:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff0b7fe640 1 -- 172.21.15.130:0/1524898585 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c00f800 con 0x7eff2415e650 2023-09-13T06:02:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff0b7fe640 1 -- 172.21.15.130:0/1524898585 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00fbb0 con 0x7eff2415e650 2023-09-13T06:02:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff296cb640 1 -- 172.21.15.130:0/1524898585 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2414c1a0 con 0x7eff2415e650 2023-09-13T06:02:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.711+0000 7eff296cb640 1 -- 172.21.15.130:0/1524898585 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2415b610 con 0x7eff2415e650 2023-09-13T06:02:53.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.715+0000 7eff296cb640 1 -- 172.21.15.130:0/1524898585 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2415ea90 con 0x7eff2415e650 2023-09-13T06:02:53.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.715+0000 7eff0b7fe640 1 -- 172.21.15.130:0/1524898585 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7eff1c00b040 con 0x7eff2415e650 2023-09-13T06:02:53.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.715+0000 7eff0b7fe640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff10065b50 0x7eff10068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:53.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.715+0000 7eff0b7fe640 1 -- 172.21.15.130:0/1524898585 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5227+0+0 (secure 0 0 0) 0x7eff1c083e90 con 0x7eff2415e650 2023-09-13T06:02:53.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.715+0000 7eff22ffd640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff10065b50 0x7eff10068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:53.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.715+0000 7eff22ffd640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff10065b50 0x7eff10068010 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7eff140af000 tx=0x7eff140b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:53.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.719+0000 7eff0b7fe640 1 -- 172.21.15.130:0/1524898585 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7eff1c051ae0 con 0x7eff2415e650 2023-09-13T06:02:53.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:53.871+0000 7eff296cb640 1 -- 172.21.15.130:0/1524898585 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7eff2415ea90 con 0x7eff2415e650 2023-09-13T06:02:54.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.539+0000 7eff0b7fe640 1 -- 172.21.15.130:0/1524898585 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) v1 ==== 170+0+0 (secure 0 0 0) 0x7eff2415ea90 con 0x7eff2415e650 2023-09-13T06:02:54.544 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' created 2023-09-13T06:02:54.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.547+0000 7eff296cb640 1 -- 172.21.15.130:0/1524898585 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff10065b50 msgr2=0x7eff10068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:54.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.551+0000 7eff296cb640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff10065b50 0x7eff10068010 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7eff140af000 tx=0x7eff140b6040 comp rx=0 tx=0).stop 2023-09-13T06:02:54.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.551+0000 7eff296cb640 1 -- 172.21.15.130:0/1524898585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2415e650 msgr2=0x7eff241499a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:54.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.551+0000 7eff296cb640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2415e650 0x7eff241499a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00cd50 tx=0x7eff1c00a650 comp rx=0 tx=0).stop 2023-09-13T06:02:54.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.551+0000 7eff296cb640 1 -- 172.21.15.130:0/1524898585 shutdown_connections 2023-09-13T06:02:54.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.551+0000 7eff296cb640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff10065b50 0x7eff10068010 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:54.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.551+0000 7eff296cb640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2415e650 0x7eff241499a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:54.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.551+0000 7eff296cb640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2415a080 0x7eff2414b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:54.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.551+0000 7eff296cb640 1 --2- 172.21.15.130:0/1524898585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff240b2fd0 0x7eff24150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:54.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.551+0000 7eff296cb640 1 -- 172.21.15.130:0/1524898585 >> 172.21.15.130:0/1524898585 conn(0x7eff24065990 msgr2=0x7eff2406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:54.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.551+0000 7eff296cb640 1 -- 172.21.15.130:0/1524898585 shutdown_connections 2023-09-13T06:02:54.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.551+0000 7eff296cb640 1 -- 172.21.15.130:0/1524898585 wait complete. 2023-09-13T06:02:54.578 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T06:02:54.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.715+0000 7f184ccd8640 1 Processor -- start 2023-09-13T06:02:54.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f184ccd8640 1 -- start start 2023-09-13T06:02:54.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f184ccd8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f18480b1460 0x7f18480b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:54.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f184ccd8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18480cc850 con 0x7f184815a080 2023-09-13T06:02:54.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f184ccd8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18480b3420 con 0x7f18480b2fd0 2023-09-13T06:02:54.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f184ccd8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18480b0330 con 0x7f18480b1460 2023-09-13T06:02:54.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f1845d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f18480b1460 0x7f18480b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:54.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f1845d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f18480b1460 0x7f18480b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52054/0 (socket says 172.21.15.130:52054) 2023-09-13T06:02:54.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f1845d9b640 1 -- 172.21.15.130:0/4222895466 learned_addr learned my addr 172.21.15.130:0/4222895466 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:54.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f184659c640 1 --1- 172.21.15.130:0/4222895466 >> v1:172.21.15.130:6789/0 conn(0x7f184815a080 0x7f184815e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59724/0 (socket says 172.21.15.130:59724) 2023-09-13T06:02:54.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f1845d9b640 1 -- 172.21.15.130:0/4222895466 >> v1:172.21.15.164:6789/0 conn(0x7f18480b2fd0 legacy=0x7f18480ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:54.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f1845d9b640 1 -- 172.21.15.130:0/4222895466 >> v1:172.21.15.130:6789/0 conn(0x7f184815a080 legacy=0x7f184815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:54.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.719+0000 7f1845d9b640 1 -- 172.21.15.130:0/4222895466 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480cbcd0 con 0x7f18480b1460 2023-09-13T06:02:54.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.723+0000 7f1845d9b640 1 --2- 172.21.15.130:0/4222895466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18480b1460 0x7f18480b2a90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f183c009870 tx=0x7f183c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6417953d80314b31 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:54.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.723+0000 7f184559a640 1 -- 172.21.15.130:0/4222895466 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0ac620 con 0x7f18480b1460 2023-09-13T06:02:54.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.723+0000 7f184559a640 1 -- 172.21.15.130:0/4222895466 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c0ac780 con 0x7f18480b1460 2023-09-13T06:02:54.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.723+0000 7f184559a640 1 -- 172.21.15.130:0/4222895466 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0acb10 con 0x7f18480b1460 2023-09-13T06:02:54.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.723+0000 7f184ccd8640 1 -- 172.21.15.130:0/4222895466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18480b1460 msgr2=0x7f18480b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:54.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.723+0000 7f184ccd8640 1 --2- 172.21.15.130:0/4222895466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18480b1460 0x7f18480b2a90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f183c009870 tx=0x7f183c01c410 comp rx=0 tx=0).stop 2023-09-13T06:02:54.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.723+0000 7f184ccd8640 1 -- 172.21.15.130:0/4222895466 shutdown_connections 2023-09-13T06:02:54.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.723+0000 7f184ccd8640 1 --2- 172.21.15.130:0/4222895466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18480b1460 0x7f18480b2a90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:54.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.723+0000 7f184ccd8640 1 -- 172.21.15.130:0/4222895466 >> 172.21.15.130:0/4222895466 conn(0x7f1848065990 msgr2=0x7f1848065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:54.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.723+0000 7f184ccd8640 1 -- 172.21.15.130:0/4222895466 shutdown_connections 2023-09-13T06:02:54.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.723+0000 7f184ccd8640 1 -- 172.21.15.130:0/4222895466 wait complete. 2023-09-13T06:02:54.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184ccd8640 1 Processor -- start 2023-09-13T06:02:54.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184ccd8640 1 -- start start 2023-09-13T06:02:54.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184ccd8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18480b1460 0x7f1848155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:54.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184ccd8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18480b2fd0 0x7f18480aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:54.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184ccd8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f184815a080 0x7f1848143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:54.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184ccd8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1848169e50 con 0x7f18480b2fd0 2023-09-13T06:02:54.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184ccd8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1848168db0 con 0x7f18480b1460 2023-09-13T06:02:54.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184ccd8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1848169090 con 0x7f184815a080 2023-09-13T06:02:54.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1845d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18480b2fd0 0x7f18480aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:54.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1845d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18480b2fd0 0x7f18480aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52056/0 (socket says 172.21.15.130:52056) 2023-09-13T06:02:54.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1845d9b640 1 -- 172.21.15.130:0/296422342 learned_addr learned my addr 172.21.15.130:0/296422342 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:54.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184659c640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18480b1460 0x7f1848155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:54.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1846d9d640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f184815a080 0x7f1848143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:54.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1845d9b640 1 -- 172.21.15.130:0/296422342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f184815a080 msgr2=0x7f1848143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:54.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1845d9b640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f184815a080 0x7f1848143ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:54.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1845d9b640 1 -- 172.21.15.130:0/296422342 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18480b1460 msgr2=0x7f1848155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:54.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1845d9b640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18480b1460 0x7f1848155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:54.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1845d9b640 1 -- 172.21.15.130:0/296422342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c0094d0 con 0x7f18480b2fd0 2023-09-13T06:02:54.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1845d9b640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18480b2fd0 0x7f18480aea40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f183c0af040 tx=0x7f183c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:54.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1836ffd640 1 -- 172.21.15.130:0/296422342 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0ac620 con 0x7f18480b2fd0 2023-09-13T06:02:54.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1836ffd640 1 -- 172.21.15.130:0/296422342 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c0b7690 con 0x7f18480b2fd0 2023-09-13T06:02:54.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f1836ffd640 1 -- 172.21.15.130:0/296422342 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0b7a40 con 0x7f18480b2fd0 2023-09-13T06:02:54.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184ccd8640 1 -- 172.21.15.130:0/296422342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1848169370 con 0x7f18480b2fd0 2023-09-13T06:02:54.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184ccd8640 1 -- 172.21.15.130:0/296422342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1848169930 con 0x7f18480b2fd0 2023-09-13T06:02:54.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.727+0000 7f184ccd8640 1 -- 172.21.15.130:0/296422342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1848169b20 con 0x7f18480b2fd0 2023-09-13T06:02:54.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.731+0000 7f1836ffd640 1 -- 172.21.15.130:0/296422342 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f183c0b3070 con 0x7f18480b2fd0 2023-09-13T06:02:54.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.731+0000 7f1836ffd640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1828065b20 0x7f1828067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:54.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.731+0000 7f1836ffd640 1 -- 172.21.15.130:0/296422342 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f183c11d7f0 con 0x7f18480b2fd0 2023-09-13T06:02:54.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.731+0000 7f184659c640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1828065b20 0x7f1828067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:54.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.731+0000 7f184659c640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1828065b20 0x7f1828067fe0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18380012f0 tx=0x7f1838001660 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:54.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.735+0000 7f1836ffd640 1 -- 172.21.15.130:0/296422342 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f183c0eb1c0 con 0x7f18480b2fd0 2023-09-13T06:02:54.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:54.911+0000 7f184ccd8640 1 -- 172.21.15.130:0/296422342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f18480b3420 con 0x7f18480b2fd0 2023-09-13T06:02:55.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.575+0000 7f1836ffd640 1 -- 172.21.15.130:0/296422342 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f18480b3420 con 0x7f18480b2fd0 2023-09-13T06:02:55.579 INFO:teuthology.orchestra.run.smithi130.stderr:new fs with metadata pool 6 and data pool 7 2023-09-13T06:02:55.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.579+0000 7f184ccd8640 1 -- 172.21.15.130:0/296422342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1828065b20 msgr2=0x7f1828067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:55.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.579+0000 7f184ccd8640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1828065b20 0x7f1828067fe0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18380012f0 tx=0x7f1838001660 comp rx=0 tx=0).stop 2023-09-13T06:02:55.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.579+0000 7f184ccd8640 1 -- 172.21.15.130:0/296422342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18480b2fd0 msgr2=0x7f18480aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:55.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.579+0000 7f184ccd8640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18480b2fd0 0x7f18480aea40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f183c0af040 tx=0x7f183c0191b0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.579+0000 7f184ccd8640 1 -- 172.21.15.130:0/296422342 shutdown_connections 2023-09-13T06:02:55.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.579+0000 7f184ccd8640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1828065b20 0x7f1828067fe0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.579+0000 7f184ccd8640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f184815a080 0x7f1848143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.579+0000 7f184ccd8640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18480b2fd0 0x7f18480aea40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.579+0000 7f184ccd8640 1 --2- 172.21.15.130:0/296422342 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18480b1460 0x7f1848155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.579+0000 7f184ccd8640 1 -- 172.21.15.130:0/296422342 >> 172.21.15.130:0/296422342 conn(0x7f1848065990 msgr2=0x7f18480cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:55.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.583+0000 7f184ccd8640 1 -- 172.21.15.130:0/296422342 shutdown_connections 2023-09-13T06:02:55.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.583+0000 7f184ccd8640 1 -- 172.21.15.130:0/296422342 wait complete. 2023-09-13T06:02:55.607 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:55.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37cc958640 1 Processor -- start 2023-09-13T06:02:55.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37cc958640 1 -- start start 2023-09-13T06:02:55.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37cc958640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f37c8146eb0 0x7f37c80b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:55.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37cc958640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f37c80b7ca0 0x7f37c80b8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:55.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37cc958640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c8071440 con 0x7f37c8161100 2023-09-13T06:02:55.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37cc958640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c80b5130 con 0x7f37c8146eb0 2023-09-13T06:02:55.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37cc958640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c80706a0 con 0x7f37c80b7ca0 2023-09-13T06:02:55.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37c77fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f37c8146eb0 0x7f37c80b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:55.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37c77fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f37c8146eb0 0x7f37c80b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52058/0 (socket says 172.21.15.130:52058) 2023-09-13T06:02:55.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37c77fe640 1 -- 172.21.15.130:0/4150071377 learned_addr learned my addr 172.21.15.130:0/4150071377 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:55.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37c7fff640 1 --2- 172.21.15.130:0/4150071377 >> v2:172.21.15.164:3300/0 conn(0x7f37c80b7ca0 0x7f37c80b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:55.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37c77fe640 1 -- 172.21.15.130:0/4150071377 >> v2:172.21.15.164:3300/0 conn(0x7f37c80b7ca0 msgr2=0x7f37c80b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:55.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37c77fe640 1 --2- 172.21.15.130:0/4150071377 >> v2:172.21.15.164:3300/0 conn(0x7f37c80b7ca0 0x7f37c80b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37c77fe640 1 -- 172.21.15.130:0/4150071377 >> v1:172.21.15.164:6789/0 conn(0x7f37c8161100 legacy=0x7f37c8161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:55.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.743+0000 7f37c77fe640 1 -- 172.21.15.130:0/4150071377 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8147290 con 0x7f37c8146eb0 2023-09-13T06:02:55.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37c77fe640 1 --2- 172.21.15.130:0/4150071377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37c8146eb0 0x7f37c80b64e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f37c80b5270 tx=0x7f37b801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db8710b192a0060 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:55.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37c67fc640 1 -- 172.21.15.130:0/4150071377 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b80aa5f0 con 0x7f37c8146eb0 2023-09-13T06:02:55.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37c67fc640 1 -- 172.21.15.130:0/4150071377 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b80aa750 con 0x7f37c8146eb0 2023-09-13T06:02:55.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37c67fc640 1 -- 172.21.15.130:0/4150071377 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b80aaae0 con 0x7f37c8146eb0 2023-09-13T06:02:55.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37cc958640 1 -- 172.21.15.130:0/4150071377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37c8146eb0 msgr2=0x7f37c80b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:55.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37cc958640 1 --2- 172.21.15.130:0/4150071377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37c8146eb0 0x7f37c80b64e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f37c80b5270 tx=0x7f37b801c490 comp rx=0 tx=0).stop 2023-09-13T06:02:55.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37cc958640 1 -- 172.21.15.130:0/4150071377 shutdown_connections 2023-09-13T06:02:55.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37cc958640 1 --2- 172.21.15.130:0/4150071377 >> v2:172.21.15.164:3300/0 conn(0x7f37c80b7ca0 0x7f37c80b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37cc958640 1 --2- 172.21.15.130:0/4150071377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37c8146eb0 0x7f37c80b64e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37cc958640 1 -- 172.21.15.130:0/4150071377 >> 172.21.15.130:0/4150071377 conn(0x7f37c80cdd10 msgr2=0x7f37c80ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:55.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37cc958640 1 -- 172.21.15.130:0/4150071377 shutdown_connections 2023-09-13T06:02:55.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37cc958640 1 -- 172.21.15.130:0/4150071377 wait complete. 2023-09-13T06:02:55.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.747+0000 7f37cc958640 1 Processor -- start 2023-09-13T06:02:55.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37cc958640 1 -- start start 2023-09-13T06:02:55.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37cc958640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c80b7ca0 0x7f37c813edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:55.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37cc958640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37c8146eb0 0x7f37c8153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:55.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37cc958640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37c8161100 0x7f37c815cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:55.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37cc958640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c8152450 con 0x7f37c8146eb0 2023-09-13T06:02:55.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37cc958640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c8152730 con 0x7f37c8161100 2023-09-13T06:02:55.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37cc958640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c8152a10 con 0x7f37c80b7ca0 2023-09-13T06:02:55.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37c6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37c8146eb0 0x7f37c8153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:55.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37c6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37c8146eb0 0x7f37c8153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52068/0 (socket says 172.21.15.130:52068) 2023-09-13T06:02:55.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37c6ffd640 1 -- 172.21.15.130:0/3615619953 learned_addr learned my addr 172.21.15.130:0/3615619953 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:55.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37c77fe640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c80b7ca0 0x7f37c813edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:55.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37c7fff640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37c8161100 0x7f37c815cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:55.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37c6ffd640 1 -- 172.21.15.130:0/3615619953 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c80b7ca0 msgr2=0x7f37c813edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:55.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37c6ffd640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c80b7ca0 0x7f37c813edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37c6ffd640 1 -- 172.21.15.130:0/3615619953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37c8161100 msgr2=0x7f37c815cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:55.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37c6ffd640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37c8161100 0x7f37c815cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37c6ffd640 1 -- 172.21.15.130:0/3615619953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b80094d0 con 0x7f37c8146eb0 2023-09-13T06:02:55.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37c6ffd640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37c8146eb0 0x7f37c8153930 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00b410 tx=0x7f37bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:55.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37affff640 1 -- 172.21.15.130:0/3615619953 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc004020 con 0x7f37c8146eb0 2023-09-13T06:02:55.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37affff640 1 -- 172.21.15.130:0/3615619953 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc004180 con 0x7f37c8146eb0 2023-09-13T06:02:55.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37affff640 1 -- 172.21.15.130:0/3615619953 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc011630 con 0x7f37c8146eb0 2023-09-13T06:02:55.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37cc958640 1 -- 172.21.15.130:0/3615619953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c8152cf0 con 0x7f37c8146eb0 2023-09-13T06:02:55.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37cc958640 1 -- 172.21.15.130:0/3615619953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c8153e70 con 0x7f37c8146eb0 2023-09-13T06:02:55.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.751+0000 7f37cc958640 1 -- 172.21.15.130:0/3615619953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c8070b10 con 0x7f37c8146eb0 2023-09-13T06:02:55.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.755+0000 7f37affff640 1 -- 172.21.15.130:0/3615619953 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f37bc011790 con 0x7f37c8146eb0 2023-09-13T06:02:55.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.755+0000 7f37affff640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37b4065b20 0x7f37b4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:55.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.755+0000 7f37affff640 1 -- 172.21.15.130:0/3615619953 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37bc082ff0 con 0x7f37c8146eb0 2023-09-13T06:02:55.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.755+0000 7f37c77fe640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37b4065b20 0x7f37b4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:55.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.755+0000 7f37c77fe640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37b4065b20 0x7f37b4067fe0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f37b80ae000 tx=0x7f37b80b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:55.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.759+0000 7f37affff640 1 -- 172.21.15.130:0/3615619953 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f37bc0b3db0 con 0x7f37c8146eb0 2023-09-13T06:02:55.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.907+0000 7f37cc958640 1 -- 172.21.15.130:0/3615619953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37c80618a0 con 0x7f37c8146eb0 2023-09-13T06:02:55.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.907+0000 7f37affff640 1 -- 172.21.15.130:0/3615619953 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16562 (secure 0 0 0) 0x7f37bc015090 con 0x7f37c8146eb0 2023-09-13T06:02:55.914 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:55.914 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":44,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:54.919039+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:53.311861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:53.919645+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:55.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 -- 172.21.15.130:0/3615619953 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37b4065b20 msgr2=0x7f37b4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:55.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37b4065b20 0x7f37b4067fe0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f37b80ae000 tx=0x7f37b80b5040 comp rx=0 tx=0).stop 2023-09-13T06:02:55.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 -- 172.21.15.130:0/3615619953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37c8146eb0 msgr2=0x7f37c8153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:55.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37c8146eb0 0x7f37c8153930 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00b410 tx=0x7f37bc00b8d0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 -- 172.21.15.130:0/3615619953 shutdown_connections 2023-09-13T06:02:55.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37b4065b20 0x7f37b4067fe0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37c8161100 0x7f37c815cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37c8146eb0 0x7f37c8153930 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 --2- 172.21.15.130:0/3615619953 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c80b7ca0 0x7f37c813edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:55.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 -- 172.21.15.130:0/3615619953 >> 172.21.15.130:0/3615619953 conn(0x7f37c80cdd10 msgr2=0x7f37c8161520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:55.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 -- 172.21.15.130:0/3615619953 shutdown_connections 2023-09-13T06:02:55.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:55.911+0000 7f37cc958640 1 -- 172.21.15.130:0/3615619953 wait complete. 2023-09-13T06:02:55.935 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:56.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524fc0b640 1 Processor -- start 2023-09-13T06:02:56.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524fc0b640 1 -- start start 2023-09-13T06:02:56.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524fc0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f524815b130 0x7f52480cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:56.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524fc0b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52480ce980 con 0x7f52480ce180 2023-09-13T06:02:56.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524fc0b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52480cec60 con 0x7f52480b04a0 2023-09-13T06:02:56.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524fc0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524806c640 con 0x7f524815b130 2023-09-13T06:02:56.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524d1a6640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f52480ce180 0x7f524815b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59728/0 (socket says 172.21.15.130:59728) 2023-09-13T06:02:56.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524d1a6640 1 -- 172.21.15.130:0/2750211698 learned_addr learned my addr 172.21.15.130:0/2750211698 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:56.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524d9a7640 1 --2- 172.21.15.130:0/2750211698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f524815b130 0x7f52480cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:56.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524c9a5640 1 -- 172.21.15.130:0/2750211698 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740727481 0 0) 0x7f52480ce980 con 0x7f52480ce180 2023-09-13T06:02:56.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524c9a5640 1 -- 172.21.15.130:0/2750211698 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5234003530 con 0x7f52480ce180 2023-09-13T06:02:56.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524d9a7640 1 -- 172.21.15.130:0/2750211698 >> v1:172.21.15.164:6789/0 conn(0x7f52480b04a0 legacy=0x7f524806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:56.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524c9a5640 1 -- 172.21.15.130:0/2750211698 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685006872 0 0) 0x7f52480cec60 con 0x7f52480b04a0 2023-09-13T06:02:56.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524d9a7640 1 -- 172.21.15.130:0/2750211698 >> v1:172.21.15.130:6789/0 conn(0x7f52480ce180 legacy=0x7f524815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:56.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.071+0000 7f524d9a7640 1 -- 172.21.15.130:0/2750211698 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524806c920 con 0x7f524815b130 2023-09-13T06:02:56.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.075+0000 7f524d9a7640 1 --2- 172.21.15.130:0/2750211698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f524815b130 0x7f52480cc780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f52440097f0 tx=0x7f524401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34eb8023ced4dd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:56.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.075+0000 7f524c9a5640 1 -- 172.21.15.130:0/2750211698 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440ab5f0 con 0x7f524815b130 2023-09-13T06:02:56.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.075+0000 7f524c9a5640 1 -- 172.21.15.130:0/2750211698 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52440ab750 con 0x7f524815b130 2023-09-13T06:02:56.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.075+0000 7f524c9a5640 1 -- 172.21.15.130:0/2750211698 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440abae0 con 0x7f524815b130 2023-09-13T06:02:56.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.075+0000 7f524fc0b640 1 -- 172.21.15.130:0/2750211698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f524815b130 msgr2=0x7f52480cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:56.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.075+0000 7f524fc0b640 1 --2- 172.21.15.130:0/2750211698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f524815b130 0x7f52480cc780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f52440097f0 tx=0x7f524401c4c0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.075+0000 7f524fc0b640 1 -- 172.21.15.130:0/2750211698 shutdown_connections 2023-09-13T06:02:56.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.075+0000 7f524fc0b640 1 --2- 172.21.15.130:0/2750211698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f524815b130 0x7f52480cc780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.075+0000 7f524fc0b640 1 -- 172.21.15.130:0/2750211698 >> 172.21.15.130:0/2750211698 conn(0x7f5248065990 msgr2=0x7f5248065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:56.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.075+0000 7f524fc0b640 1 -- 172.21.15.130:0/2750211698 shutdown_connections 2023-09-13T06:02:56.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.075+0000 7f524fc0b640 1 -- 172.21.15.130:0/2750211698 wait complete. 2023-09-13T06:02:56.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524fc0b640 1 Processor -- start 2023-09-13T06:02:56.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524fc0b640 1 -- start start 2023-09-13T06:02:56.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524fc0b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52480b04a0 0x7f5248156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:56.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524fc0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52480ce180 0x7f5248155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:56.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524fc0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f524815b130 0x7f524814f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:56.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524fc0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5248155a80 con 0x7f52480ce180 2023-09-13T06:02:56.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524fc0b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5248157250 con 0x7f52480b04a0 2023-09-13T06:02:56.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524fc0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5248154e00 con 0x7f524815b130 2023-09-13T06:02:56.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524d1a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52480ce180 0x7f5248155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:56.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524d1a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52480ce180 0x7f5248155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52070/0 (socket says 172.21.15.130:52070) 2023-09-13T06:02:56.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524d1a6640 1 -- 172.21.15.130:0/3518023790 learned_addr learned my addr 172.21.15.130:0/3518023790 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:56.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524d9a7640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52480b04a0 0x7f5248156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:56.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524e1a8640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f524815b130 0x7f524814f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:56.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524d1a6640 1 -- 172.21.15.130:0/3518023790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f524815b130 msgr2=0x7f524814f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:56.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524d1a6640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f524815b130 0x7f524814f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524d1a6640 1 -- 172.21.15.130:0/3518023790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52480b04a0 msgr2=0x7f5248156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:56.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524d1a6640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52480b04a0 0x7f5248156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524d1a6640 1 -- 172.21.15.130:0/3518023790 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5244009420 con 0x7f52480ce180 2023-09-13T06:02:56.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524d1a6640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52480ce180 0x7f5248155ea0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f523800c450 tx=0x7f523800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f523e7fc640 1 -- 172.21.15.130:0/3518023790 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238005cf0 con 0x7f52480ce180 2023-09-13T06:02:56.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f523e7fc640 1 -- 172.21.15.130:0/3518023790 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5238005e50 con 0x7f52480ce180 2023-09-13T06:02:56.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f523e7fc640 1 -- 172.21.15.130:0/3518023790 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238007290 con 0x7f52480ce180 2023-09-13T06:02:56.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524fc0b640 1 -- 172.21.15.130:0/3518023790 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52481550e0 con 0x7f52480ce180 2023-09-13T06:02:56.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524fc0b640 1 -- 172.21.15.130:0/3518023790 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52481556a0 con 0x7f52480ce180 2023-09-13T06:02:56.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.079+0000 7f524fc0b640 1 -- 172.21.15.130:0/3518023790 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52480618a0 con 0x7f52480ce180 2023-09-13T06:02:56.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.083+0000 7f523e7fc640 1 -- 172.21.15.130:0/3518023790 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f52380073f0 con 0x7f52480ce180 2023-09-13T06:02:56.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.083+0000 7f523e7fc640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f522c065b20 0x7f522c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:56.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.083+0000 7f523e7fc640 1 -- 172.21.15.130:0/3518023790 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5238082820 con 0x7f52480ce180 2023-09-13T06:02:56.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.083+0000 7f524d9a7640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f522c065b20 0x7f522c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:56.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.083+0000 7f524d9a7640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f522c065b20 0x7f522c067fe0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f52440af000 tx=0x7f52440a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:56.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.087+0000 7f523e7fc640 1 -- 172.21.15.130:0/3518023790 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5238050210 con 0x7f52480ce180 2023-09-13T06:02:56.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.235+0000 7f524fc0b640 1 -- 172.21.15.130:0/3518023790 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52481573f0 con 0x7f52480ce180 2023-09-13T06:02:56.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.235+0000 7f523e7fc640 1 -- 172.21.15.130:0/3518023790 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16562 (secure 0 0 0) 0x7f5238017020 con 0x7f52480ce180 2023-09-13T06:02:56.241 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:56.241 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":44,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:54.919039+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:53.311861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:53.919645+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:56.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 -- 172.21.15.130:0/3518023790 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f522c065b20 msgr2=0x7f522c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:56.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f522c065b20 0x7f522c067fe0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f52440af000 tx=0x7f52440a7000 comp rx=0 tx=0).stop 2023-09-13T06:02:56.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 -- 172.21.15.130:0/3518023790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52480ce180 msgr2=0x7f5248155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:56.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52480ce180 0x7f5248155ea0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f523800c450 tx=0x7f523800c910 comp rx=0 tx=0).stop 2023-09-13T06:02:56.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 -- 172.21.15.130:0/3518023790 shutdown_connections 2023-09-13T06:02:56.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f522c065b20 0x7f522c067fe0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f524815b130 0x7f524814f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52480ce180 0x7f5248155ea0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 --2- 172.21.15.130:0/3518023790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52480b04a0 0x7f5248156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 -- 172.21.15.130:0/3518023790 >> 172.21.15.130:0/3518023790 conn(0x7f5248065990 msgr2=0x7f5248070880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:56.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 -- 172.21.15.130:0/3518023790 shutdown_connections 2023-09-13T06:02:56.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.239+0000 7f524fc0b640 1 -- 172.21.15.130:0/3518023790 wait complete. 2023-09-13T06:02:56.262 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T06:02:56.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11c1911640 1 Processor -- start 2023-09-13T06:02:56.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11c1911640 1 -- start start 2023-09-13T06:02:56.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11c1911640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f11bc15a080 0x7f11bc0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11c1911640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11bc0b31a0 0x7f11bc0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11c1911640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11bc0cc850 con 0x7f11bc15e650 2023-09-13T06:02:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11c1911640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11bc0b0330 con 0x7f11bc15a080 2023-09-13T06:02:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11c1911640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0cbcd0 con 0x7f11bc0b31a0 2023-09-13T06:02:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11ba7fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f11bc15e650 0x7f11bc0b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59734/0 (socket says 172.21.15.130:59734) 2023-09-13T06:02:56.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11ba7fc640 1 -- 172.21.15.130:0/1041747227 learned_addr learned my addr 172.21.15.130:0/1041747227 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:02:56.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11bb7fe640 1 --2- 172.21.15.130:0/1041747227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11bc0b31a0 0x7f11bc0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:56.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11baffd640 1 --2- 172.21.15.130:0/1041747227 >> v2:172.21.15.164:3300/0 conn(0x7f11bc15a080 0x7f11bc0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:56.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.399+0000 7f11b9ffb640 1 -- 172.21.15.130:0/1041747227 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051125080 0 0) 0x7f11b0001120 con 0x7f11bc15e650 2023-09-13T06:02:56.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.403+0000 7f11b9ffb640 1 -- 172.21.15.130:0/1041747227 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11a4003530 con 0x7f11bc15e650 2023-09-13T06:02:56.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.403+0000 7f11bb7fe640 1 -- 172.21.15.130:0/1041747227 >> v2:172.21.15.164:3300/0 conn(0x7f11bc15a080 msgr2=0x7f11bc0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:56.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.403+0000 7f11bb7fe640 1 --2- 172.21.15.130:0/1041747227 >> v2:172.21.15.164:3300/0 conn(0x7f11bc15a080 0x7f11bc0b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.403+0000 7f11bb7fe640 1 -- 172.21.15.130:0/1041747227 >> v1:172.21.15.130:6789/0 conn(0x7f11bc15e650 legacy=0x7f11bc0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:56.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.403+0000 7f11b9ffb640 1 -- 172.21.15.130:0/1041747227 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2958424013 0 0) 0x7f11a4003530 con 0x7f11bc15e650 2023-09-13T06:02:56.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.403+0000 7f11bb7fe640 1 -- 172.21.15.130:0/1041747227 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc0cbfb0 con 0x7f11bc0b31a0 2023-09-13T06:02:56.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.403+0000 7f11bb7fe640 1 --2- 172.21.15.130:0/1041747227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11bc0b31a0 0x7f11bc0ccfe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f11b40097c0 tx=0x7f11b401c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9ffd4bd8dd332d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:56.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.403+0000 7f11b9ffb640 1 -- 172.21.15.130:0/1041747227 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0001830 con 0x7f11bc0b31a0 2023-09-13T06:02:56.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.403+0000 7f11b9ffb640 1 -- 172.21.15.130:0/1041747227 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b40a7050 con 0x7f11bc0b31a0 2023-09-13T06:02:56.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.403+0000 7f11b9ffb640 1 -- 172.21.15.130:0/1041747227 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40ab400 con 0x7f11bc0b31a0 2023-09-13T06:02:56.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 -- 172.21.15.130:0/1041747227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11bc0b31a0 msgr2=0x7f11bc0ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:56.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 --2- 172.21.15.130:0/1041747227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11bc0b31a0 0x7f11bc0ccfe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f11b40097c0 tx=0x7f11b401c2e0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 -- 172.21.15.130:0/1041747227 shutdown_connections 2023-09-13T06:02:56.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 --2- 172.21.15.130:0/1041747227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11bc0b31a0 0x7f11bc0ccfe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 --2- 172.21.15.130:0/1041747227 >> v2:172.21.15.164:3300/0 conn(0x7f11bc15a080 0x7f11bc0b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 -- 172.21.15.130:0/1041747227 >> 172.21.15.130:0/1041747227 conn(0x7f11bc065990 msgr2=0x7f11bc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:56.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 -- 172.21.15.130:0/1041747227 shutdown_connections 2023-09-13T06:02:56.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 -- 172.21.15.130:0/1041747227 wait complete. 2023-09-13T06:02:56.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 Processor -- start 2023-09-13T06:02:56.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 -- start start 2023-09-13T06:02:56.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11bc0b31a0 0x7f11bc0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:56.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc15a080 0x7f11bc157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:56.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc15e650 0x7f11bc06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:56.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc144220 con 0x7f11bc15a080 2023-09-13T06:02:56.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0b1a10 con 0x7f11bc15e650 2023-09-13T06:02:56.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11c1911640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc1444e0 con 0x7f11bc0b31a0 2023-09-13T06:02:56.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11ba7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc15a080 0x7f11bc157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:56.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11ba7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc15a080 0x7f11bc157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52072/0 (socket says 172.21.15.130:52072) 2023-09-13T06:02:56.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11ba7fc640 1 -- 172.21.15.130:0/1651495643 learned_addr learned my addr 172.21.15.130:0/1651495643 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:56.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11baffd640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11bc0b31a0 0x7f11bc0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:56.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11bb7fe640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc15e650 0x7f11bc06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:56.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11ba7fc640 1 -- 172.21.15.130:0/1651495643 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11bc0b31a0 msgr2=0x7f11bc0aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:56.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11ba7fc640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11bc0b31a0 0x7f11bc0aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11ba7fc640 1 -- 172.21.15.130:0/1651495643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc15e650 msgr2=0x7f11bc06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:56.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11ba7fc640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc15e650 0x7f11bc06cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:56.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11ba7fc640 1 -- 172.21.15.130:0/1651495643 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4009420 con 0x7f11bc15a080 2023-09-13T06:02:56.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.407+0000 7f11bb7fe640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc15e650 0x7f11bc06cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:56.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11ba7fc640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc15a080 0x7f11bc157f20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f11b000c5a0 tx=0x7f11b000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:56.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11a3fff640 1 -- 172.21.15.130:0/1651495643 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00074e0 con 0x7f11bc15a080 2023-09-13T06:02:56.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11a3fff640 1 -- 172.21.15.130:0/1651495643 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b0007660 con 0x7f11bc15a080 2023-09-13T06:02:56.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11a3fff640 1 -- 172.21.15.130:0/1651495643 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0004a30 con 0x7f11bc15a080 2023-09-13T06:02:56.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11c1911640 1 -- 172.21.15.130:0/1651495643 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc157720 con 0x7f11bc15a080 2023-09-13T06:02:56.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11c1911640 1 -- 172.21.15.130:0/1651495643 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc0af3e0 con 0x7f11bc15a080 2023-09-13T06:02:56.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11c1911640 1 -- 172.21.15.130:0/1651495643 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc0af5a0 con 0x7f11bc15a080 2023-09-13T06:02:56.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11a3fff640 1 -- 172.21.15.130:0/1651495643 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f11b0004b90 con 0x7f11bc15a080 2023-09-13T06:02:56.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11a3fff640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11a8065b20 0x7f11a8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:56.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11a3fff640 1 -- 172.21.15.130:0/1651495643 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11b00824b0 con 0x7f11bc15a080 2023-09-13T06:02:56.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11baffd640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11a8065b20 0x7f11a8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:56.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.411+0000 7f11baffd640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11a8065b20 0x7f11a8067fe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f11bc15d670 tx=0x7f11ac00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:56.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.415+0000 7f11a3fff640 1 -- 172.21.15.130:0/1651495643 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f11b004fea0 con 0x7f11bc15a080 2023-09-13T06:02:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:56.599+0000 7f11c1911640 1 -- 172.21.15.130:0/1651495643 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f11bc0cc850 con 0x7f11bc15a080 2023-09-13T06:02:57.530 INFO:tasks.ceph.mds.a.smithi130.stderr:2023-09-13T06:02:57.527+0000 7f3d7363c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:02:57.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.587+0000 7f11a3fff640 1 -- 172.21.15.130:0/1651495643 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f11bc0cc850 con 0x7f11bc15a080 2023-09-13T06:02:57.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 -- 172.21.15.130:0/1651495643 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11a8065b20 msgr2=0x7f11a8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:57.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11a8065b20 0x7f11a8067fe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f11bc15d670 tx=0x7f11ac00b040 comp rx=0 tx=0).stop 2023-09-13T06:02:57.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 -- 172.21.15.130:0/1651495643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc15a080 msgr2=0x7f11bc157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:57.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc15a080 0x7f11bc157f20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f11b000c5a0 tx=0x7f11b000ca60 comp rx=0 tx=0).stop 2023-09-13T06:02:57.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 -- 172.21.15.130:0/1651495643 shutdown_connections 2023-09-13T06:02:57.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11a8065b20 0x7f11a8067fe0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:57.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11bc15e650 0x7f11bc06cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:57.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc15a080 0x7f11bc157f20 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:57.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 --2- 172.21.15.130:0/1651495643 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11bc0b31a0 0x7f11bc0aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:57.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 -- 172.21.15.130:0/1651495643 >> 172.21.15.130:0/1651495643 conn(0x7f11bc065990 msgr2=0x7f11bc065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:57.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 -- 172.21.15.130:0/1651495643 shutdown_connections 2023-09-13T06:02:57.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.591+0000 7f11c1911640 1 -- 172.21.15.130:0/1651495643 wait complete. 2023-09-13T06:02:57.617 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T06:02:57.618 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T06:02:57.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc7a06d640 1 Processor -- start 2023-09-13T06:02:57.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc7a06d640 1 -- start start 2023-09-13T06:02:57.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc7a06d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efc74144d70 0x7efc740ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:57.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc7a06d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efc740b1b70 0x7efc740b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:57.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc7a06d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc740b3120 con 0x7efc740b2780 2023-09-13T06:02:57.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc7a06d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc740b2430 con 0x7efc740b1b70 2023-09-13T06:02:57.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc7a06d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc740cedb0 con 0x7efc74144d70 2023-09-13T06:02:57.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc73fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efc740b1b70 0x7efc740b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:57.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc73fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efc740b1b70 0x7efc740b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52074/0 (socket says 172.21.15.130:52074) 2023-09-13T06:02:57.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc73fff640 1 -- 172.21.15.130:0/3119561628 learned_addr learned my addr 172.21.15.130:0/3119561628 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:57.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc737fe640 1 --2- 172.21.15.130:0/3119561628 >> v2:172.21.15.164:3300/0 conn(0x7efc74144d70 0x7efc740ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:57.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc73fff640 1 -- 172.21.15.130:0/3119561628 >> v2:172.21.15.164:3300/0 conn(0x7efc74144d70 msgr2=0x7efc740ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:57.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc73fff640 1 --2- 172.21.15.130:0/3119561628 >> v2:172.21.15.164:3300/0 conn(0x7efc74144d70 0x7efc740ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:57.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc73fff640 1 -- 172.21.15.130:0/3119561628 >> v1:172.21.15.164:6789/0 conn(0x7efc740b2780 legacy=0x7efc740b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:57.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.759+0000 7efc73fff640 1 -- 172.21.15.130:0/3119561628 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc740b2150 con 0x7efc740b1b70 2023-09-13T06:02:57.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc73fff640 1 --2- 172.21.15.130:0/3119561628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740b1b70 0x7efc740b2be0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efc740cff90 tx=0x7efc6c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5aab80d5fbfb79 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:57.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc727fc640 1 -- 172.21.15.130:0/3119561628 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0a5780 con 0x7efc740b1b70 2023-09-13T06:02:57.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc727fc640 1 -- 172.21.15.130:0/3119561628 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c0a58e0 con 0x7efc740b1b70 2023-09-13T06:02:57.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc727fc640 1 -- 172.21.15.130:0/3119561628 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0a5c70 con 0x7efc740b1b70 2023-09-13T06:02:57.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc7a06d640 1 -- 172.21.15.130:0/3119561628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740b1b70 msgr2=0x7efc740b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:57.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc7a06d640 1 --2- 172.21.15.130:0/3119561628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740b1b70 0x7efc740b2be0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efc740cff90 tx=0x7efc6c01c9d0 comp rx=0 tx=0).stop 2023-09-13T06:02:57.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc7a06d640 1 -- 172.21.15.130:0/3119561628 shutdown_connections 2023-09-13T06:02:57.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc7a06d640 1 --2- 172.21.15.130:0/3119561628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740b1b70 0x7efc740b2be0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:57.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc7a06d640 1 --2- 172.21.15.130:0/3119561628 >> v2:172.21.15.164:3300/0 conn(0x7efc74144d70 0x7efc740ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:57.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc7a06d640 1 -- 172.21.15.130:0/3119561628 >> 172.21.15.130:0/3119561628 conn(0x7efc74065990 msgr2=0x7efc74065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:57.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc7a06d640 1 -- 172.21.15.130:0/3119561628 shutdown_connections 2023-09-13T06:02:57.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.763+0000 7efc7a06d640 1 -- 172.21.15.130:0/3119561628 wait complete. 2023-09-13T06:02:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc7a06d640 1 Processor -- start 2023-09-13T06:02:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc7a06d640 1 -- start start 2023-09-13T06:02:57.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc7a06d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc740b1b70 0x7efc7415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:57.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc7a06d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740b2780 0x7efc741f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:57.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc7a06d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc74144d70 0x7efc74158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:57.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc7a06d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc741f9690 con 0x7efc740b2780 2023-09-13T06:02:57.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc7a06d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc741589c0 con 0x7efc740b1b70 2023-09-13T06:02:57.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc7a06d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc74159ab0 con 0x7efc74144d70 2023-09-13T06:02:57.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc737fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc740b1b70 0x7efc7415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:57.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc72ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740b2780 0x7efc741f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:57.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc737fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc740b1b70 0x7efc7415ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:59468/0 (socket says 172.21.15.130:59468) 2023-09-13T06:02:57.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc737fe640 1 -- 172.21.15.130:0/2120339052 learned_addr learned my addr 172.21.15.130:0/2120339052 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc73fff640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc74144d70 0x7efc74158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc72ffd640 1 -- 172.21.15.130:0/2120339052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc74144d70 msgr2=0x7efc74158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc72ffd640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc74144d70 0x7efc74158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc72ffd640 1 -- 172.21.15.130:0/2120339052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc740b1b70 msgr2=0x7efc7415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc72ffd640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc740b1b70 0x7efc7415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc72ffd640 1 -- 172.21.15.130:0/2120339052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c009b30 con 0x7efc740b2780 2023-09-13T06:02:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc737fe640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc740b1b70 0x7efc7415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc72ffd640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740b2780 0x7efc741f9150 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7efc68000f70 tx=0x7efc6800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc5bfff640 1 -- 172.21.15.130:0/2120339052 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc680052d0 con 0x7efc740b2780 2023-09-13T06:02:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc5bfff640 1 -- 172.21.15.130:0/2120339052 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc68005430 con 0x7efc740b2780 2023-09-13T06:02:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc5bfff640 1 -- 172.21.15.130:0/2120339052 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68003840 con 0x7efc740b2780 2023-09-13T06:02:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc7a06d640 1 -- 172.21.15.130:0/2120339052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc74159d90 con 0x7efc740b2780 2023-09-13T06:02:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.767+0000 7efc7a06d640 1 -- 172.21.15.130:0/2120339052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7415a350 con 0x7efc740b2780 2023-09-13T06:02:57.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.771+0000 7efc7a06d640 1 -- 172.21.15.130:0/2120339052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc740618a0 con 0x7efc740b2780 2023-09-13T06:02:57.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.771+0000 7efc5bfff640 1 -- 172.21.15.130:0/2120339052 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efc680039a0 con 0x7efc740b2780 2023-09-13T06:02:57.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.771+0000 7efc5bfff640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc60065b20 0x7efc60067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:57.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.771+0000 7efc5bfff640 1 -- 172.21.15.130:0/2120339052 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc68082880 con 0x7efc740b2780 2023-09-13T06:02:57.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.771+0000 7efc737fe640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc60065b20 0x7efc60067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:57.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.771+0000 7efc737fe640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc60065b20 0x7efc60067fe0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efc64009f70 tx=0x7efc64009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:57.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.775+0000 7efc5bfff640 1 -- 172.21.15.130:0/2120339052 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7efc680501e0 con 0x7efc740b2780 2023-09-13T06:02:57.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:57.955+0000 7efc7a06d640 1 -- 172.21.15.130:0/2120339052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efc7406dc80 con 0x7efc740b2780 2023-09-13T06:02:58.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc5bfff640 1 -- 172.21.15.130:0/2120339052 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7efc68053800 con 0x7efc740b2780 2023-09-13T06:02:58.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 -- 172.21.15.130:0/2120339052 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc60065b20 msgr2=0x7efc60067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:58.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc60065b20 0x7efc60067fe0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efc64009f70 tx=0x7efc64009190 comp rx=0 tx=0).stop 2023-09-13T06:02:58.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 -- 172.21.15.130:0/2120339052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740b2780 msgr2=0x7efc741f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:58.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740b2780 0x7efc741f9150 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7efc68000f70 tx=0x7efc6800c890 comp rx=0 tx=0).stop 2023-09-13T06:02:58.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 -- 172.21.15.130:0/2120339052 shutdown_connections 2023-09-13T06:02:58.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc60065b20 0x7efc60067fe0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc74144d70 0x7efc74158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740b2780 0x7efc741f9150 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 --2- 172.21.15.130:0/2120339052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc740b1b70 0x7efc7415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 -- 172.21.15.130:0/2120339052 >> 172.21.15.130:0/2120339052 conn(0x7efc74065990 msgr2=0x7efc7415d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:58.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 -- 172.21.15.130:0/2120339052 shutdown_connections 2023-09-13T06:02:58.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.595+0000 7efc7a06d640 1 -- 172.21.15.130:0/2120339052 wait complete. 2023-09-13T06:02:58.622 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T06:02:58.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:02:58.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.759+0000 7f6455b11640 1 Processor -- start 2023-09-13T06:02:58.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.759+0000 7f6455b11640 1 -- start start 2023-09-13T06:02:58.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.759+0000 7f6455b11640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f645015d5f0 0x7f64500cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:58.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.759+0000 7f6455b11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f645015d9d0 0x7f64500cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:58.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.759+0000 7f6455b11640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64500cce60 con 0x7f64500ae170 2023-09-13T06:02:58.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.759+0000 7f6455b11640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64500cd140 con 0x7f645015d5f0 2023-09-13T06:02:58.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.759+0000 7f6455b11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64500cd420 con 0x7f645015d9d0 2023-09-13T06:02:58.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.759+0000 7f644ffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f645015d9d0 0x7f64500cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:58.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.759+0000 7f644f7fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f645015d5f0 0x7f64500cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:58.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644f7fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f645015d5f0 0x7f64500cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:59480/0 (socket says 172.21.15.130:59480) 2023-09-13T06:02:58.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644ffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f645015d9d0 0x7f64500cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:57806/0 (socket says 172.21.15.130:57806) 2023-09-13T06:02:58.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644f7fe640 1 -- 172.21.15.130:0/2153789346 learned_addr learned my addr 172.21.15.130:0/2153789346 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:58.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644f7fe640 1 -- 172.21.15.130:0/2153789346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f645015d9d0 msgr2=0x7f64500cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:58.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644f7fe640 1 --2- 172.21.15.130:0/2153789346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f645015d9d0 0x7f64500cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644f7fe640 1 -- 172.21.15.130:0/2153789346 >> v1:172.21.15.164:6789/0 conn(0x7f64500ae170 legacy=0x7f64501591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:58.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644f7fe640 1 -- 172.21.15.130:0/2153789346 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64500cd700 con 0x7f645015d5f0 2023-09-13T06:02:58.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644ffff640 1 --2- 172.21.15.130:0/2153789346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f645015d9d0 0x7f64500cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:58.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644f7fe640 1 --2- 172.21.15.130:0/2153789346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645015d5f0 0x7f64500cc7f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6440009870 tx=0x7f644001e6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434fdaa9d1fb3d23 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:58.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644effd640 1 -- 172.21.15.130:0/2153789346 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400ad660 con 0x7f645015d5f0 2023-09-13T06:02:58.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644effd640 1 -- 172.21.15.130:0/2153789346 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64400ad7c0 con 0x7f645015d5f0 2023-09-13T06:02:58.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.763+0000 7f644effd640 1 -- 172.21.15.130:0/2153789346 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400adb50 con 0x7f645015d5f0 2023-09-13T06:02:58.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 -- 172.21.15.130:0/2153789346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645015d5f0 msgr2=0x7f64500cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:58.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 --2- 172.21.15.130:0/2153789346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645015d5f0 0x7f64500cc7f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6440009870 tx=0x7f644001e6d0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 -- 172.21.15.130:0/2153789346 shutdown_connections 2023-09-13T06:02:58.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 --2- 172.21.15.130:0/2153789346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f645015d9d0 0x7f64500cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 --2- 172.21.15.130:0/2153789346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645015d5f0 0x7f64500cc7f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 -- 172.21.15.130:0/2153789346 >> 172.21.15.130:0/2153789346 conn(0x7f6450065990 msgr2=0x7f6450065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:58.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 -- 172.21.15.130:0/2153789346 shutdown_connections 2023-09-13T06:02:58.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 -- 172.21.15.130:0/2153789346 wait complete. 2023-09-13T06:02:58.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 Processor -- start 2023-09-13T06:02:58.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 -- start start 2023-09-13T06:02:58.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64500ae170 0x7f645015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:58.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645015d5f0 0x7f645014ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:58.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f645015d9d0 0x7f645014d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:58.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645014c0a0 con 0x7f645015d9d0 2023-09-13T06:02:58.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645014b420 con 0x7f645015d5f0 2023-09-13T06:02:58.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6455b11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645014b700 con 0x7f64500ae170 2023-09-13T06:02:58.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f644ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f645015d9d0 0x7f645014d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:58.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f644ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f645015d9d0 0x7f645014d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52086/0 (socket says 172.21.15.130:52086) 2023-09-13T06:02:58.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f644ffff640 1 -- 172.21.15.130:0/2461199640 learned_addr learned my addr 172.21.15.130:0/2461199640 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:58.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f644f7fe640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64500ae170 0x7f645015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:58.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.767+0000 7f6447fff640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645015d5f0 0x7f645014ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:58.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644ffff640 1 -- 172.21.15.130:0/2461199640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64500ae170 msgr2=0x7f645015c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:58.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644ffff640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64500ae170 0x7f645015c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644ffff640 1 -- 172.21.15.130:0/2461199640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645015d5f0 msgr2=0x7f645014ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:58.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644ffff640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645015d5f0 0x7f645014ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644ffff640 1 -- 172.21.15.130:0/2461199640 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6448009a70 con 0x7f645015d9d0 2023-09-13T06:02:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f6447fff640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645015d5f0 0x7f645014ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644ffff640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f645015d9d0 0x7f645014d020 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f644800efc0 tx=0x7f644800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644cff9640 1 -- 172.21.15.130:0/2461199640 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448009c20 con 0x7f645015d9d0 2023-09-13T06:02:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644cff9640 1 -- 172.21.15.130:0/2461199640 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644800f040 con 0x7f645015d9d0 2023-09-13T06:02:58.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f6455b11640 1 -- 172.21.15.130:0/2461199640 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64400094d0 con 0x7f645015d9d0 2023-09-13T06:02:58.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644cff9640 1 -- 172.21.15.130:0/2461199640 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64480039a0 con 0x7f645015d9d0 2023-09-13T06:02:58.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f6455b11640 1 -- 172.21.15.130:0/2461199640 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645014bcc0 con 0x7f645015d9d0 2023-09-13T06:02:58.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f6455b11640 1 -- 172.21.15.130:0/2461199640 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6450148820 con 0x7f645015d9d0 2023-09-13T06:02:58.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644cff9640 1 -- 172.21.15.130:0/2461199640 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6448014480 con 0x7f645015d9d0 2023-09-13T06:02:58.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644cff9640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6430065b20 0x7f6430067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:58.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644cff9640 1 -- 172.21.15.130:0/2461199640 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6448083d50 con 0x7f645015d9d0 2023-09-13T06:02:58.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.771+0000 7f644f7fe640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6430065b20 0x7f6430067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:58.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.775+0000 7f644f7fe640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6430065b20 0x7f6430067fe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f64400b1000 tx=0x7f64400b8040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:58.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.775+0000 7f644cff9640 1 -- 172.21.15.130:0/2461199640 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6448051690 con 0x7f645015d9d0 2023-09-13T06:02:58.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.963+0000 7f6455b11640 1 -- 172.21.15.130:0/2461199640 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64500618a0 con 0x7f645015d9d0 2023-09-13T06:02:58.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.963+0000 7f644cff9640 1 -- 172.21.15.130:0/2461199640 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f6448054cb0 con 0x7f645015d9d0 2023-09-13T06:02:58.970 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:58.970 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2126646405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2126646405},{"type":"v1","addr":"172.21.15.164:6835","nonce":2126646405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1274935773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1274935773},{"type":"v1","addr":"172.21.15.164:6834","nonce":1274935773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/4174632972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4174632972},{"type":"v1","addr":"172.21.15.130:6836","nonce":4174632972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:54.919386+0000","modified":"2023-09-13T06:02:57.960043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5613":{"gid":5613,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1098709916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1098709916},{"type":"v1","addr":"172.21.15.130:6837","nonce":1098709916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-13T06:02:58.970 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 25 2023-09-13T06:02:58.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 -- 172.21.15.130:0/2461199640 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6430065b20 msgr2=0x7f6430067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:58.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6430065b20 0x7f6430067fe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f64400b1000 tx=0x7f64400b8040 comp rx=0 tx=0).stop 2023-09-13T06:02:58.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 -- 172.21.15.130:0/2461199640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f645015d9d0 msgr2=0x7f645014d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:58.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f645015d9d0 0x7f645014d020 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f644800efc0 tx=0x7f644800c490 comp rx=0 tx=0).stop 2023-09-13T06:02:58.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 -- 172.21.15.130:0/2461199640 shutdown_connections 2023-09-13T06:02:58.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6430065b20 0x7f6430067fe0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645015d5f0 0x7f645014ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f645015d9d0 0x7f645014d020 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 --2- 172.21.15.130:0/2461199640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64500ae170 0x7f645015c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:58.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 -- 172.21.15.130:0/2461199640 >> 172.21.15.130:0/2461199640 conn(0x7f6450065990 msgr2=0x7f645006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:58.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 -- 172.21.15.130:0/2461199640 shutdown_connections 2023-09-13T06:02:58.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:58.967+0000 7f6455b11640 1 -- 172.21.15.130:0/2461199640 wait complete. 2023-09-13T06:02:58.991 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:02:59.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.123+0000 7f5f57019640 1 Processor -- start 2023-09-13T06:02:59.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.123+0000 7f5f57019640 1 -- start start 2023-09-13T06:02:59.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f57019640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5f50141650 0x7f5f500cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f57019640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5015f6c0 0x7f5f500cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f57019640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5f50144970 0x7f5f5015b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f57019640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5015fbc0 con 0x7f5f50144970 2023-09-13T06:02:59.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f57019640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5015c920 con 0x7f5f50141650 2023-09-13T06:02:59.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f57019640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5015cc00 con 0x7f5f5015f6c0 2023-09-13T06:02:59.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f555b6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5f50144970 0x7f5f5015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f555b6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5f50144970 0x7f5f5015b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52100/0 (socket says 172.21.15.130:52100) 2023-09-13T06:02:59.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f555b6640 1 -- 172.21.15.130:0/2619580545 learned_addr learned my addr 172.21.15.130:0/2619580545 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:59.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f54db5640 1 --2- 172.21.15.130:0/2619580545 >> v2:172.21.15.164:3300/0 conn(0x7f5f50141650 0x7f5f500cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f47fff640 1 --2- 172.21.15.130:0/2619580545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5015f6c0 0x7f5f500cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f555b6640 1 -- 172.21.15.130:0/2619580545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5015f6c0 msgr2=0x7f5f500cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:59.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f555b6640 1 --2- 172.21.15.130:0/2619580545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5015f6c0 0x7f5f500cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f555b6640 1 -- 172.21.15.130:0/2619580545 >> v2:172.21.15.164:3300/0 conn(0x7f5f50141650 msgr2=0x7f5f500cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:59.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f555b6640 1 --2- 172.21.15.130:0/2619580545 >> v2:172.21.15.164:3300/0 conn(0x7f5f50141650 0x7f5f500cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f555b6640 1 -- 172.21.15.130:0/2619580545 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5015cee0 con 0x7f5f50144970 2023-09-13T06:02:59.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.127+0000 7f5f47fff640 1 --2- 172.21.15.130:0/2619580545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5015f6c0 0x7f5f500cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:02:59.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f555b6640 1 --2- 172.21.15.130:0/2619580545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f50144970 0x7f5f5015b720 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009870 tx=0x7f5f4801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2774e9703b407625 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:59.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f477fe640 1 -- 172.21.15.130:0/2619580545 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480ac630 con 0x7f5f50144970 2023-09-13T06:02:59.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f477fe640 1 -- 172.21.15.130:0/2619580545 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f480ac790 con 0x7f5f50144970 2023-09-13T06:02:59.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f477fe640 1 -- 172.21.15.130:0/2619580545 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480acb20 con 0x7f5f50144970 2023-09-13T06:02:59.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f57019640 1 -- 172.21.15.130:0/2619580545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f50144970 msgr2=0x7f5f5015b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f57019640 1 --2- 172.21.15.130:0/2619580545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f50144970 0x7f5f5015b720 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009870 tx=0x7f5f4801c500 comp rx=0 tx=0).stop 2023-09-13T06:02:59.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f57019640 1 -- 172.21.15.130:0/2619580545 shutdown_connections 2023-09-13T06:02:59.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f57019640 1 --2- 172.21.15.130:0/2619580545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f50144970 0x7f5f5015b720 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f57019640 1 --2- 172.21.15.130:0/2619580545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5015f6c0 0x7f5f500cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f57019640 1 --2- 172.21.15.130:0/2619580545 >> v2:172.21.15.164:3300/0 conn(0x7f5f50141650 0x7f5f500cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f57019640 1 -- 172.21.15.130:0/2619580545 >> 172.21.15.130:0/2619580545 conn(0x7f5f500b0bc0 msgr2=0x7f5f500b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:59.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f57019640 1 -- 172.21.15.130:0/2619580545 shutdown_connections 2023-09-13T06:02:59.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f57019640 1 -- 172.21.15.130:0/2619580545 wait complete. 2023-09-13T06:02:59.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f57019640 1 Processor -- start 2023-09-13T06:02:59.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.131+0000 7f5f57019640 1 -- start start 2023-09-13T06:02:59.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f57019640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f50141650 0x7f5f5006da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f57019640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f50144970 0x7f5f5013dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f57019640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f5015f6c0 0x7f5f50152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f57019640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5006d570 con 0x7f5f50144970 2023-09-13T06:02:59.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f57019640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5006c960 con 0x7f5f5015f6c0 2023-09-13T06:02:59.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f57019640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5006cc40 con 0x7f5f50141650 2023-09-13T06:02:59.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f47fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f50144970 0x7f5f5013dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f47fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f50144970 0x7f5f5013dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52114/0 (socket says 172.21.15.130:52114) 2023-09-13T06:02:59.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f47fff640 1 -- 172.21.15.130:0/1402955091 learned_addr learned my addr 172.21.15.130:0/1402955091 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:59.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f54db5640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f50141650 0x7f5f5006da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f555b6640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f5015f6c0 0x7f5f50152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f47fff640 1 -- 172.21.15.130:0/1402955091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f50141650 msgr2=0x7f5f5006da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f47fff640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f50141650 0x7f5f5006da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f47fff640 1 -- 172.21.15.130:0/1402955091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f5015f6c0 msgr2=0x7f5f50152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f47fff640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f5015f6c0 0x7f5f50152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f47fff640 1 -- 172.21.15.130:0/1402955091 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f480094d0 con 0x7f5f50144970 2023-09-13T06:02:59.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f555b6640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f5015f6c0 0x7f5f50152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:59.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f47fff640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f50144970 0x7f5f5013dcf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000d800 tx=0x7f5f4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:59.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f457fa640 1 -- 172.21.15.130:0/1402955091 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f400096c0 con 0x7f5f50144970 2023-09-13T06:02:59.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f457fa640 1 -- 172.21.15.130:0/1402955091 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f40009820 con 0x7f5f50144970 2023-09-13T06:02:59.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f457fa640 1 -- 172.21.15.130:0/1402955091 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f40009bd0 con 0x7f5f50144970 2023-09-13T06:02:59.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f57019640 1 -- 172.21.15.130:0/1402955091 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5006cf20 con 0x7f5f50144970 2023-09-13T06:02:59.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f57019640 1 -- 172.21.15.130:0/1402955091 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5006c530 con 0x7f5f50144970 2023-09-13T06:02:59.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f57019640 1 -- 172.21.15.130:0/1402955091 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5006d720 con 0x7f5f50144970 2023-09-13T06:02:59.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.135+0000 7f5f457fa640 1 -- 172.21.15.130:0/1402955091 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5f40009d30 con 0x7f5f50144970 2023-09-13T06:02:59.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.139+0000 7f5f457fa640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f3c065b20 0x7f5f3c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.139+0000 7f5f457fa640 1 -- 172.21.15.130:0/1402955091 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f40083a50 con 0x7f5f50144970 2023-09-13T06:02:59.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.139+0000 7f5f54db5640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f3c065b20 0x7f5f3c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.139+0000 7f5f54db5640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f3c065b20 0x7f5f3c067fe0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5f5013f860 tx=0x7f5f4c00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:59.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.143+0000 7f5f457fa640 1 -- 172.21.15.130:0/1402955091 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5f5006d720 con 0x7f5f50144970 2023-09-13T06:02:59.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.291+0000 7f5f57019640 1 -- 172.21.15.130:0/1402955091 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f500618a0 con 0x7f5f50144970 2023-09-13T06:02:59.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.291+0000 7f5f457fa640 1 -- 172.21.15.130:0/1402955091 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16549 (secure 0 0 0) 0x7f5f40051380 con 0x7f5f50144970 2023-09-13T06:02:59.297 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:59.297 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":45,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:02:56.557447+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:53.311861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:53.919645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:02:59.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 -- 172.21.15.130:0/1402955091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f3c065b20 msgr2=0x7f5f3c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f3c065b20 0x7f5f3c067fe0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5f5013f860 tx=0x7f5f4c00d040 comp rx=0 tx=0).stop 2023-09-13T06:02:59.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 -- 172.21.15.130:0/1402955091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f50144970 msgr2=0x7f5f5013dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f50144970 0x7f5f5013dcf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000d800 tx=0x7f5f4000dcc0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 -- 172.21.15.130:0/1402955091 shutdown_connections 2023-09-13T06:02:59.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f3c065b20 0x7f5f3c067fe0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f5015f6c0 0x7f5f50152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f50144970 0x7f5f5013dcf0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 --2- 172.21.15.130:0/1402955091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f50141650 0x7f5f5006da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 -- 172.21.15.130:0/1402955091 >> 172.21.15.130:0/1402955091 conn(0x7f5f500b0bc0 msgr2=0x7f5f50154450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:59.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 -- 172.21.15.130:0/1402955091 shutdown_connections 2023-09-13T06:02:59.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.295+0000 7f5f57019640 1 -- 172.21.15.130:0/1402955091 wait complete. 2023-09-13T06:02:59.318 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T06:02:59.319 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:02:59.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.451+0000 7f9358ccb640 1 Processor -- start 2023-09-13T06:02:59.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.451+0000 7f9358ccb640 1 -- start start 2023-09-13T06:02:59.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f9358ccb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9354159f20 0x7f93540ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f9358ccb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93540cdfc0 0x7f93540b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f9358ccb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f93540b1610 0x7f93540b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f9358ccb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93540b00f0 con 0x7f9354159f20 2023-09-13T06:02:59.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f9358ccb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93540ce420 con 0x7f93540b1610 2023-09-13T06:02:59.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f9358ccb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93540b11d0 con 0x7f93540cdfc0 2023-09-13T06:02:59.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f935259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9354159f20 0x7f93540ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f935259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9354159f20 0x7f93540ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52128/0 (socket says 172.21.15.130:52128) 2023-09-13T06:02:59.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f935259c640 1 -- 172.21.15.130:0/1987171616 learned_addr learned my addr 172.21.15.130:0/1987171616 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:59.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f935259c640 1 -- 172.21.15.130:0/1987171616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93540cdfc0 msgr2=0x7f93540b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:59.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f935259c640 1 --2- 172.21.15.130:0/1987171616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93540cdfc0 0x7f93540b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f9352d9d640 1 --2- 172.21.15.130:0/1987171616 >> v2:172.21.15.164:3300/0 conn(0x7f93540b1610 0x7f93540b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f935259c640 1 -- 172.21.15.130:0/1987171616 >> v2:172.21.15.164:3300/0 conn(0x7f93540b1610 msgr2=0x7f93540b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:59.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f935259c640 1 --2- 172.21.15.130:0/1987171616 >> v2:172.21.15.164:3300/0 conn(0x7f93540b1610 0x7f93540b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f935259c640 1 -- 172.21.15.130:0/1987171616 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93540ccfd0 con 0x7f9354159f20 2023-09-13T06:02:59.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f9352d9d640 1 --2- 172.21.15.130:0/1987171616 >> v2:172.21.15.164:3300/0 conn(0x7f93540b1610 0x7f93540b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:59.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.455+0000 7f935259c640 1 --2- 172.21.15.130:0/1987171616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9354159f20 0x7f93540ce7b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f93540afcc0 tx=0x7f934401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb8da1fdb103aff server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:59.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9351d9b640 1 -- 172.21.15.130:0/1987171616 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93440a5650 con 0x7f9354159f20 2023-09-13T06:02:59.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9351d9b640 1 -- 172.21.15.130:0/1987171616 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93440a57b0 con 0x7f9354159f20 2023-09-13T06:02:59.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9351d9b640 1 -- 172.21.15.130:0/1987171616 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93440a5b40 con 0x7f9354159f20 2023-09-13T06:02:59.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 -- 172.21.15.130:0/1987171616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9354159f20 msgr2=0x7f93540ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 --2- 172.21.15.130:0/1987171616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9354159f20 0x7f93540ce7b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f93540afcc0 tx=0x7f934401c9d0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 -- 172.21.15.130:0/1987171616 shutdown_connections 2023-09-13T06:02:59.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 --2- 172.21.15.130:0/1987171616 >> v2:172.21.15.164:3300/0 conn(0x7f93540b1610 0x7f93540b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 --2- 172.21.15.130:0/1987171616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93540cdfc0 0x7f93540b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 --2- 172.21.15.130:0/1987171616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9354159f20 0x7f93540ce7b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 -- 172.21.15.130:0/1987171616 >> 172.21.15.130:0/1987171616 conn(0x7f9354065990 msgr2=0x7f9354065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:59.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 -- 172.21.15.130:0/1987171616 shutdown_connections 2023-09-13T06:02:59.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 -- 172.21.15.130:0/1987171616 wait complete. 2023-09-13T06:02:59.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 Processor -- start 2023-09-13T06:02:59.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 -- start start 2023-09-13T06:02:59.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.459+0000 7f9358ccb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93540b1610 0x7f9354148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9358ccb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93540cdfc0 0x7f935414b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9358ccb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9354159f20 0x7f9354149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9358ccb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9354148e90 con 0x7f9354159f20 2023-09-13T06:02:59.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9358ccb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9354149850 con 0x7f93540cdfc0 2023-09-13T06:02:59.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9358ccb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935414b540 con 0x7f93540b1610 2023-09-13T06:02:59.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9352d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9354159f20 0x7f9354149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f935259c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93540b1610 0x7f9354148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9352d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9354159f20 0x7f9354149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52142/0 (socket says 172.21.15.130:52142) 2023-09-13T06:02:59.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9352d9d640 1 -- 172.21.15.130:0/1701931468 learned_addr learned my addr 172.21.15.130:0/1701931468 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:59.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9349d9b640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93540cdfc0 0x7f935414b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9352d9d640 1 -- 172.21.15.130:0/1701931468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93540b1610 msgr2=0x7f9354148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9352d9d640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93540b1610 0x7f9354148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9352d9d640 1 -- 172.21.15.130:0/1701931468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93540cdfc0 msgr2=0x7f935414b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9352d9d640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93540cdfc0 0x7f935414b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9352d9d640 1 -- 172.21.15.130:0/1701931468 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344009b30 con 0x7f9354159f20 2023-09-13T06:02:59.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f935259c640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93540b1610 0x7f9354148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:02:59.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9352d9d640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9354159f20 0x7f9354149ce0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c7f0 tx=0x7f934c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:59.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f934b7fe640 1 -- 172.21.15.130:0/1701931468 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c007820 con 0x7f9354159f20 2023-09-13T06:02:59.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f934b7fe640 1 -- 172.21.15.130:0/1701931468 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c0079a0 con 0x7f9354159f20 2023-09-13T06:02:59.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9358ccb640 1 -- 172.21.15.130:0/1701931468 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9354159550 con 0x7f9354159f20 2023-09-13T06:02:59.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f934b7fe640 1 -- 172.21.15.130:0/1701931468 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c007d50 con 0x7f9354159f20 2023-09-13T06:02:59.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9358ccb640 1 -- 172.21.15.130:0/1701931468 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93541494e0 con 0x7f9354159f20 2023-09-13T06:02:59.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f9358ccb640 1 -- 172.21.15.130:0/1701931468 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9354149a00 con 0x7f9354159f20 2023-09-13T06:02:59.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.463+0000 7f934b7fe640 1 -- 172.21.15.130:0/1701931468 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f934c0113f0 con 0x7f9354159f20 2023-09-13T06:02:59.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.467+0000 7f934b7fe640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9334065b20 0x7f9334067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.467+0000 7f934b7fe640 1 -- 172.21.15.130:0/1701931468 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f934c083590 con 0x7f9354159f20 2023-09-13T06:02:59.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.467+0000 7f935259c640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9334065b20 0x7f9334067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.467+0000 7f935259c640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9334065b20 0x7f9334067fe0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f93440ae000 tx=0x7f93440a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:59.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.467+0000 7f934b7fe640 1 -- 172.21.15.130:0/1701931468 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9354149a00 con 0x7f9354159f20 2023-09-13T06:02:59.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.615+0000 7f9358ccb640 1 -- 172.21.15.130:0/1701931468 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f935414d660 con 0x7f9334065b20 2023-09-13T06:02:59.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.623+0000 7f934b7fe640 1 -- 172.21.15.130:0/1701931468 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280209 (secure 0 0 0) 0x7f935414d660 con 0x7f9334065b20 2023-09-13T06:02:59.632 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:02:59.633 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:02:59.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 -- 172.21.15.130:0/1701931468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9334065b20 msgr2=0x7f9334067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9334065b20 0x7f9334067fe0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f93440ae000 tx=0x7f93440a7070 comp rx=0 tx=0).stop 2023-09-13T06:02:59.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 -- 172.21.15.130:0/1701931468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9354159f20 msgr2=0x7f9354149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9354159f20 0x7f9354149ce0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c7f0 tx=0x7f934c00ccb0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 -- 172.21.15.130:0/1701931468 shutdown_connections 2023-09-13T06:02:59.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9334065b20 0x7f9334067fe0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93540cdfc0 0x7f935414b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9354159f20 0x7f9354149ce0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 --2- 172.21.15.130:0/1701931468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93540b1610 0x7f9354148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 -- 172.21.15.130:0/1701931468 >> 172.21.15.130:0/1701931468 conn(0x7f9354065990 msgr2=0x7f93540cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:59.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 -- 172.21.15.130:0/1701931468 shutdown_connections 2023-09-13T06:02:59.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.627+0000 7f9358ccb640 1 -- 172.21.15.130:0/1701931468 wait complete. 2023-09-13T06:02:59.652 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-09-13T06:02:58.553546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2725,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559774,"statfs":{"total":1600000000,"available":1597208636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.019523"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154162+0000","last_change":"2023-09-13T06:02:55.576304+0000","last_active":"2023-09-13T06:02:57.154162+0000","last_peered":"2023-09-13T06:02:57.154162+0000","last_clean":"2023-09-13T06:02:57.154162+0000","last_became_active":"2023-09-13T06:02:55.576093+0000","last_became_peered":"2023-09-13T06:02:55.576093+0000","last_unstale":"2023-09-13T06:02:57.154162+0000","last_undegraded":"2023-09-13T06:02:57.154162+0000","last_fullsized":"2023-09-13T06:02:57.154162+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:16:23.458455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560881+0000","last_change":"2023-09-13T06:02:55.566320+0000","last_active":"2023-09-13T06:02:56.560881+0000","last_peered":"2023-09-13T06:02:56.560881+0000","last_clean":"2023-09-13T06:02:56.560881+0000","last_became_active":"2023-09-13T06:02:55.565921+0000","last_became_peered":"2023-09-13T06:02:55.565921+0000","last_unstale":"2023-09-13T06:02:56.560881+0000","last_undegraded":"2023-09-13T06:02:56.560881+0000","last_fullsized":"2023-09-13T06:02:56.560881+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:33:20.937865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153727+0000","last_change":"2023-09-13T06:02:55.573024+0000","last_active":"2023-09-13T06:02:57.153727+0000","last_peered":"2023-09-13T06:02:57.153727+0000","last_clean":"2023-09-13T06:02:57.153727+0000","last_became_active":"2023-09-13T06:02:55.572812+0000","last_became_peered":"2023-09-13T06:02:55.572812+0000","last_unstale":"2023-09-13T06:02:57.153727+0000","last_undegraded":"2023-09-13T06:02:57.153727+0000","last_fullsized":"2023-09-13T06:02:57.153727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:54.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154313+0000","last_change":"2023-09-13T06:02:55.571715+0000","last_active":"2023-09-13T06:02:57.154313+0000","last_peered":"2023-09-13T06:02:57.154313+0000","last_clean":"2023-09-13T06:02:57.154313+0000","last_became_active":"2023-09-13T06:02:55.571192+0000","last_became_peered":"2023-09-13T06:02:55.571192+0000","last_unstale":"2023-09-13T06:02:57.154313+0000","last_undegraded":"2023-09-13T06:02:57.154313+0000","last_fullsized":"2023-09-13T06:02:57.154313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:17:43.885392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153946+0000","last_change":"2023-09-13T06:02:55.575986+0000","last_active":"2023-09-13T06:02:57.153946+0000","last_peered":"2023-09-13T06:02:57.153946+0000","last_clean":"2023-09-13T06:02:57.153946+0000","last_became_active":"2023-09-13T06:02:55.575791+0000","last_became_peered":"2023-09-13T06:02:55.575791+0000","last_unstale":"2023-09-13T06:02:57.153946+0000","last_undegraded":"2023-09-13T06:02:57.153946+0000","last_fullsized":"2023-09-13T06:02:57.153946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:30.054070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154032+0000","last_change":"2023-09-13T06:02:55.565063+0000","last_active":"2023-09-13T06:02:57.154032+0000","last_peered":"2023-09-13T06:02:57.154032+0000","last_clean":"2023-09-13T06:02:57.154032+0000","last_became_active":"2023-09-13T06:02:55.564847+0000","last_became_peered":"2023-09-13T06:02:55.564847+0000","last_unstale":"2023-09-13T06:02:57.154032+0000","last_undegraded":"2023-09-13T06:02:57.154032+0000","last_fullsized":"2023-09-13T06:02:57.154032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:48.470117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153708+0000","last_change":"2023-09-13T06:02:55.569821+0000","last_active":"2023-09-13T06:02:57.153708+0000","last_peered":"2023-09-13T06:02:57.153708+0000","last_clean":"2023-09-13T06:02:57.153708+0000","last_became_active":"2023-09-13T06:02:55.569596+0000","last_became_peered":"2023-09-13T06:02:55.569596+0000","last_unstale":"2023-09-13T06:02:57.153708+0000","last_undegraded":"2023-09-13T06:02:57.153708+0000","last_fullsized":"2023-09-13T06:02:57.153708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:17:55.915552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154649+0000","last_change":"2023-09-13T06:02:55.571859+0000","last_active":"2023-09-13T06:02:57.154649+0000","last_peered":"2023-09-13T06:02:57.154649+0000","last_clean":"2023-09-13T06:02:57.154649+0000","last_became_active":"2023-09-13T06:02:55.571512+0000","last_became_peered":"2023-09-13T06:02:55.571512+0000","last_unstale":"2023-09-13T06:02:57.154649+0000","last_undegraded":"2023-09-13T06:02:57.154649+0000","last_fullsized":"2023-09-13T06:02:57.154649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:03:57.908839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560750+0000","last_change":"2023-09-13T06:02:55.566258+0000","last_active":"2023-09-13T06:02:56.560750+0000","last_peered":"2023-09-13T06:02:56.560750+0000","last_clean":"2023-09-13T06:02:56.560750+0000","last_became_active":"2023-09-13T06:02:55.566046+0000","last_became_peered":"2023-09-13T06:02:55.566046+0000","last_unstale":"2023-09-13T06:02:56.560750+0000","last_undegraded":"2023-09-13T06:02:56.560750+0000","last_fullsized":"2023-09-13T06:02:56.560750+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:23:02.216766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153771+0000","last_change":"2023-09-13T06:02:55.573245+0000","last_active":"2023-09-13T06:02:57.153771+0000","last_peered":"2023-09-13T06:02:57.153771+0000","last_clean":"2023-09-13T06:02:57.153771+0000","last_became_active":"2023-09-13T06:02:55.573014+0000","last_became_peered":"2023-09-13T06:02:55.573014+0000","last_unstale":"2023-09-13T06:02:57.153771+0000","last_undegraded":"2023-09-13T06:02:57.153771+0000","last_fullsized":"2023-09-13T06:02:57.153771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:24:16.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561006+0000","last_change":"2023-09-13T06:02:55.570152+0000","last_active":"2023-09-13T06:02:56.561006+0000","last_peered":"2023-09-13T06:02:56.561006+0000","last_clean":"2023-09-13T06:02:56.561006+0000","last_became_active":"2023-09-13T06:02:55.569932+0000","last_became_peered":"2023-09-13T06:02:55.569932+0000","last_unstale":"2023-09-13T06:02:56.561006+0000","last_undegraded":"2023-09-13T06:02:56.561006+0000","last_fullsized":"2023-09-13T06:02:56.561006+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:31:37.037162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154101+0000","last_change":"2023-09-13T06:02:55.576177+0000","last_active":"2023-09-13T06:02:57.154101+0000","last_peered":"2023-09-13T06:02:57.154101+0000","last_clean":"2023-09-13T06:02:57.154101+0000","last_became_active":"2023-09-13T06:02:55.575860+0000","last_became_peered":"2023-09-13T06:02:55.575860+0000","last_unstale":"2023-09-13T06:02:57.154101+0000","last_undegraded":"2023-09-13T06:02:57.154101+0000","last_fullsized":"2023-09-13T06:02:57.154101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:52.140701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153836+0000","last_change":"2023-09-13T06:02:55.573937+0000","last_active":"2023-09-13T06:02:57.153836+0000","last_peered":"2023-09-13T06:02:57.153836+0000","last_clean":"2023-09-13T06:02:57.153836+0000","last_became_active":"2023-09-13T06:02:55.573729+0000","last_became_peered":"2023-09-13T06:02:55.573729+0000","last_unstale":"2023-09-13T06:02:57.153836+0000","last_undegraded":"2023-09-13T06:02:57.153836+0000","last_fullsized":"2023-09-13T06:02:57.153836+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:34:29.520875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561115+0000","last_change":"2023-09-13T06:02:55.566159+0000","last_active":"2023-09-13T06:02:56.561115+0000","last_peered":"2023-09-13T06:02:56.561115+0000","last_clean":"2023-09-13T06:02:56.561115+0000","last_became_active":"2023-09-13T06:02:55.565600+0000","last_became_peered":"2023-09-13T06:02:55.565600+0000","last_unstale":"2023-09-13T06:02:56.561115+0000","last_undegraded":"2023-09-13T06:02:56.561115+0000","last_fullsized":"2023-09-13T06:02:56.561115+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:21:14.123686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153705+0000","last_change":"2023-09-13T06:02:55.571221+0000","last_active":"2023-09-13T06:02:57.153705+0000","last_peered":"2023-09-13T06:02:57.153705+0000","last_clean":"2023-09-13T06:02:57.153705+0000","last_became_active":"2023-09-13T06:02:55.571005+0000","last_became_peered":"2023-09-13T06:02:55.571005+0000","last_unstale":"2023-09-13T06:02:57.153705+0000","last_undegraded":"2023-09-13T06:02:57.153705+0000","last_fullsized":"2023-09-13T06:02:57.153705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:48.044030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115239+0000","last_change":"2023-09-13T06:02:55.569767+0000","last_active":"2023-09-13T06:02:57.115239+0000","last_peered":"2023-09-13T06:02:57.115239+0000","last_clean":"2023-09-13T06:02:57.115239+0000","last_became_active":"2023-09-13T06:02:55.569428+0000","last_became_peered":"2023-09-13T06:02:55.569428+0000","last_unstale":"2023-09-13T06:02:57.115239+0000","last_undegraded":"2023-09-13T06:02:57.115239+0000","last_fullsized":"2023-09-13T06:02:57.115239+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:33.201660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588141+0000","last_change":"2023-09-13T06:02:54.553420+0000","last_active":"2023-09-13T06:02:55.588141+0000","last_peered":"2023-09-13T06:02:55.588141+0000","last_clean":"2023-09-13T06:02:55.588141+0000","last_became_active":"2023-09-13T06:02:54.553123+0000","last_became_peered":"2023-09-13T06:02:54.553123+0000","last_unstale":"2023-09-13T06:02:55.588141+0000","last_undegraded":"2023-09-13T06:02:55.588141+0000","last_fullsized":"2023-09-13T06:02:55.588141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:13:21.882042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538877+0000","last_change":"2023-09-13T06:02:53.538877+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538877+0000","last_undegraded":"2023-09-13T06:02:53.538877+0000","last_fullsized":"2023-09-13T06:02:53.538877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588197+0000","last_change":"2023-09-13T06:02:54.547570+0000","last_active":"2023-09-13T06:02:55.588197+0000","last_peered":"2023-09-13T06:02:55.588197+0000","last_clean":"2023-09-13T06:02:55.588197+0000","last_became_active":"2023-09-13T06:02:54.546154+0000","last_became_peered":"2023-09-13T06:02:54.546154+0000","last_unstale":"2023-09-13T06:02:55.588197+0000","last_undegraded":"2023-09-13T06:02:55.588197+0000","last_fullsized":"2023-09-13T06:02:55.588197+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115288+0000","last_change":"2023-09-13T06:02:55.571812+0000","last_active":"2023-09-13T06:02:57.115288+0000","last_peered":"2023-09-13T06:02:57.115288+0000","last_clean":"2023-09-13T06:02:57.115288+0000","last_became_active":"2023-09-13T06:02:55.571348+0000","last_became_peered":"2023-09-13T06:02:55.571348+0000","last_unstale":"2023-09-13T06:02:57.115288+0000","last_undegraded":"2023-09-13T06:02:57.115288+0000","last_fullsized":"2023-09-13T06:02:57.115288+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:28.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534663+0000","last_change":"2023-09-13T06:02:53.534663+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534663+0000","last_undegraded":"2023-09-13T06:02:53.534663+0000","last_fullsized":"2023-09-13T06:02:53.534663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.586558+0000","last_change":"2023-09-13T06:02:54.542145+0000","last_active":"2023-09-13T06:02:55.586558+0000","last_peered":"2023-09-13T06:02:55.586558+0000","last_clean":"2023-09-13T06:02:55.586558+0000","last_became_active":"2023-09-13T06:02:54.541895+0000","last_became_peered":"2023-09-13T06:02:54.541895+0000","last_unstale":"2023-09-13T06:02:55.586558+0000","last_undegraded":"2023-09-13T06:02:55.586558+0000","last_fullsized":"2023-09-13T06:02:55.586558+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:29.046660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154185+0000","last_change":"2023-09-13T06:02:55.573275+0000","last_active":"2023-09-13T06:02:57.154185+0000","last_peered":"2023-09-13T06:02:57.154185+0000","last_clean":"2023-09-13T06:02:57.154185+0000","last_became_active":"2023-09-13T06:02:55.572872+0000","last_became_peered":"2023-09-13T06:02:55.572872+0000","last_unstale":"2023-09-13T06:02:57.154185+0000","last_undegraded":"2023-09-13T06:02:57.154185+0000","last_fullsized":"2023-09-13T06:02:57.154185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:27.803689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538868+0000","last_change":"2023-09-13T06:02:53.538868+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538868+0000","last_undegraded":"2023-09-13T06:02:53.538868+0000","last_fullsized":"2023-09-13T06:02:53.538868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154083+0000","last_change":"2023-09-13T06:02:55.573786+0000","last_active":"2023-09-13T06:02:57.154083+0000","last_peered":"2023-09-13T06:02:57.154083+0000","last_clean":"2023-09-13T06:02:57.154083+0000","last_became_active":"2023-09-13T06:02:55.573021+0000","last_became_peered":"2023-09-13T06:02:55.573021+0000","last_unstale":"2023-09-13T06:02:57.154083+0000","last_undegraded":"2023-09-13T06:02:57.154083+0000","last_fullsized":"2023-09-13T06:02:57.154083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:39.312149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534026+0000","last_change":"2023-09-13T06:02:53.534026+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534026+0000","last_undegraded":"2023-09-13T06:02:53.534026+0000","last_fullsized":"2023-09-13T06:02:53.534026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563741+0000","last_change":"2023-09-13T06:02:54.555524+0000","last_active":"2023-09-13T06:02:55.563741+0000","last_peered":"2023-09-13T06:02:55.563741+0000","last_clean":"2023-09-13T06:02:55.563741+0000","last_became_active":"2023-09-13T06:02:54.554282+0000","last_became_peered":"2023-09-13T06:02:54.554282+0000","last_unstale":"2023-09-13T06:02:55.563741+0000","last_undegraded":"2023-09-13T06:02:55.563741+0000","last_fullsized":"2023-09-13T06:02:55.563741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:12:41.106016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538844+0000","last_change":"2023-09-13T06:02:53.538844+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538844+0000","last_undegraded":"2023-09-13T06:02:53.538844+0000","last_fullsized":"2023-09-13T06:02:53.538844+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.562440+0000","last_change":"2023-09-13T06:02:54.550521+0000","last_active":"2023-09-13T06:02:55.562440+0000","last_peered":"2023-09-13T06:02:55.562440+0000","last_clean":"2023-09-13T06:02:55.562440+0000","last_became_active":"2023-09-13T06:02:54.550233+0000","last_became_peered":"2023-09-13T06:02:54.550233+0000","last_unstale":"2023-09-13T06:02:55.562440+0000","last_undegraded":"2023-09-13T06:02:55.562440+0000","last_fullsized":"2023-09-13T06:02:55.562440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:11:28.345524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560882+0000","last_change":"2023-09-13T06:02:55.572306+0000","last_active":"2023-09-13T06:02:56.560882+0000","last_peered":"2023-09-13T06:02:56.560882+0000","last_clean":"2023-09-13T06:02:56.560882+0000","last_became_active":"2023-09-13T06:02:55.571811+0000","last_became_peered":"2023-09-13T06:02:55.571811+0000","last_unstale":"2023-09-13T06:02:56.560882+0000","last_undegraded":"2023-09-13T06:02:56.560882+0000","last_fullsized":"2023-09-13T06:02:56.560882+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:44.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534005+0000","last_change":"2023-09-13T06:02:53.534005+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534005+0000","last_undegraded":"2023-09-13T06:02:53.534005+0000","last_fullsized":"2023-09-13T06:02:53.534005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588927+0000","last_change":"2023-09-13T06:02:54.549352+0000","last_active":"2023-09-13T06:02:55.588927+0000","last_peered":"2023-09-13T06:02:55.588927+0000","last_clean":"2023-09-13T06:02:55.588927+0000","last_became_active":"2023-09-13T06:02:54.549113+0000","last_became_peered":"2023-09-13T06:02:54.549113+0000","last_unstale":"2023-09-13T06:02:55.588927+0000","last_undegraded":"2023-09-13T06:02:55.588927+0000","last_fullsized":"2023-09-13T06:02:55.588927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:08:58.059162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587540+0000","last_change":"2023-09-13T06:02:54.548194+0000","last_active":"2023-09-13T06:02:55.587540+0000","last_peered":"2023-09-13T06:02:55.587540+0000","last_clean":"2023-09-13T06:02:55.587540+0000","last_became_active":"2023-09-13T06:02:54.547973+0000","last_became_peered":"2023-09-13T06:02:54.547973+0000","last_unstale":"2023-09-13T06:02:55.587540+0000","last_undegraded":"2023-09-13T06:02:55.587540+0000","last_fullsized":"2023-09-13T06:02:55.587540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:36.921705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154163+0000","last_change":"2023-09-13T06:02:55.567612+0000","last_active":"2023-09-13T06:02:57.154163+0000","last_peered":"2023-09-13T06:02:57.154163+0000","last_clean":"2023-09-13T06:02:57.154163+0000","last_became_active":"2023-09-13T06:02:55.567338+0000","last_became_peered":"2023-09-13T06:02:55.567338+0000","last_unstale":"2023-09-13T06:02:57.154163+0000","last_undegraded":"2023-09-13T06:02:57.154163+0000","last_fullsized":"2023-09-13T06:02:57.154163+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:26:27.736729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534356+0000","last_change":"2023-09-13T06:02:53.534356+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534356+0000","last_undegraded":"2023-09-13T06:02:53.534356+0000","last_fullsized":"2023-09-13T06:02:53.534356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560705+0000","last_change":"2023-09-13T06:02:55.571558+0000","last_active":"2023-09-13T06:02:56.560705+0000","last_peered":"2023-09-13T06:02:56.560705+0000","last_clean":"2023-09-13T06:02:56.560705+0000","last_became_active":"2023-09-13T06:02:55.571251+0000","last_became_peered":"2023-09-13T06:02:55.571251+0000","last_unstale":"2023-09-13T06:02:56.560705+0000","last_undegraded":"2023-09-13T06:02:56.560705+0000","last_fullsized":"2023-09-13T06:02:56.560705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:03:57.908839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559344+0000","last_change":"2023-09-13T06:02:54.548947+0000","last_active":"2023-09-13T06:02:55.559344+0000","last_peered":"2023-09-13T06:02:55.559344+0000","last_clean":"2023-09-13T06:02:55.559344+0000","last_became_active":"2023-09-13T06:02:54.548729+0000","last_became_peered":"2023-09-13T06:02:54.548729+0000","last_unstale":"2023-09-13T06:02:55.559344+0000","last_undegraded":"2023-09-13T06:02:55.559344+0000","last_fullsized":"2023-09-13T06:02:55.559344+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:38.304740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588745+0000","last_change":"2023-09-13T06:02:54.549606+0000","last_active":"2023-09-13T06:02:55.588745+0000","last_peered":"2023-09-13T06:02:55.588745+0000","last_clean":"2023-09-13T06:02:55.588745+0000","last_became_active":"2023-09-13T06:02:54.549385+0000","last_became_peered":"2023-09-13T06:02:54.549385+0000","last_unstale":"2023-09-13T06:02:55.588745+0000","last_undegraded":"2023-09-13T06:02:55.588745+0000","last_fullsized":"2023-09-13T06:02:55.588745+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153897+0000","last_change":"2023-09-13T06:02:55.570594+0000","last_active":"2023-09-13T06:02:57.153897+0000","last_peered":"2023-09-13T06:02:57.153897+0000","last_clean":"2023-09-13T06:02:57.153897+0000","last_became_active":"2023-09-13T06:02:55.570387+0000","last_became_peered":"2023-09-13T06:02:55.570387+0000","last_unstale":"2023-09-13T06:02:57.153897+0000","last_undegraded":"2023-09-13T06:02:57.153897+0000","last_fullsized":"2023-09-13T06:02:57.153897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:30:42.957097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.584236+0000","last_change":"2023-09-13T06:02:54.543232+0000","last_active":"2023-09-13T06:02:55.584236+0000","last_peered":"2023-09-13T06:02:55.584236+0000","last_clean":"2023-09-13T06:02:55.584236+0000","last_became_active":"2023-09-13T06:02:54.542975+0000","last_became_peered":"2023-09-13T06:02:54.542975+0000","last_unstale":"2023-09-13T06:02:55.584236+0000","last_undegraded":"2023-09-13T06:02:55.584236+0000","last_fullsized":"2023-09-13T06:02:55.584236+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:35:14.538719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154448+0000","last_change":"2023-09-13T06:02:55.568883+0000","last_active":"2023-09-13T06:02:57.154448+0000","last_peered":"2023-09-13T06:02:57.154448+0000","last_clean":"2023-09-13T06:02:57.154448+0000","last_became_active":"2023-09-13T06:02:55.568626+0000","last_became_peered":"2023-09-13T06:02:55.568626+0000","last_unstale":"2023-09-13T06:02:57.154448+0000","last_undegraded":"2023-09-13T06:02:57.154448+0000","last_fullsized":"2023-09-13T06:02:57.154448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538865+0000","last_change":"2023-09-13T06:02:53.538865+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538865+0000","last_undegraded":"2023-09-13T06:02:53.538865+0000","last_fullsized":"2023-09-13T06:02:53.538865+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533468+0000","last_change":"2023-09-13T06:02:53.533468+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533468+0000","last_undegraded":"2023-09-13T06:02:53.533468+0000","last_fullsized":"2023-09-13T06:02:53.533468+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559471+0000","last_change":"2023-09-13T06:02:54.551437+0000","last_active":"2023-09-13T06:02:55.559471+0000","last_peered":"2023-09-13T06:02:55.559471+0000","last_clean":"2023-09-13T06:02:55.559471+0000","last_became_active":"2023-09-13T06:02:54.551207+0000","last_became_peered":"2023-09-13T06:02:54.551207+0000","last_unstale":"2023-09-13T06:02:55.559471+0000","last_undegraded":"2023-09-13T06:02:55.559471+0000","last_fullsized":"2023-09-13T06:02:55.559471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:16:22.451045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560697+0000","last_change":"2023-09-13T06:02:55.572167+0000","last_active":"2023-09-13T06:02:56.560697+0000","last_peered":"2023-09-13T06:02:56.560697+0000","last_clean":"2023-09-13T06:02:56.560697+0000","last_became_active":"2023-09-13T06:02:55.571528+0000","last_became_peered":"2023-09-13T06:02:55.571528+0000","last_unstale":"2023-09-13T06:02:56.560697+0000","last_undegraded":"2023-09-13T06:02:56.560697+0000","last_fullsized":"2023-09-13T06:02:56.560697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587418+0000","last_change":"2023-09-13T06:02:54.542740+0000","last_active":"2023-09-13T06:02:55.587418+0000","last_peered":"2023-09-13T06:02:55.587418+0000","last_clean":"2023-09-13T06:02:55.587418+0000","last_became_active":"2023-09-13T06:02:54.542497+0000","last_became_peered":"2023-09-13T06:02:54.542497+0000","last_unstale":"2023-09-13T06:02:55.587418+0000","last_undegraded":"2023-09-13T06:02:55.587418+0000","last_fullsized":"2023-09-13T06:02:55.587418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:47.462707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115118+0000","last_change":"2023-09-13T06:02:55.567745+0000","last_active":"2023-09-13T06:02:57.115118+0000","last_peered":"2023-09-13T06:02:57.115118+0000","last_clean":"2023-09-13T06:02:57.115118+0000","last_became_active":"2023-09-13T06:02:55.567535+0000","last_became_peered":"2023-09-13T06:02:55.567535+0000","last_unstale":"2023-09-13T06:02:57.115118+0000","last_undegraded":"2023-09-13T06:02:57.115118+0000","last_fullsized":"2023-09-13T06:02:57.115118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:52:17.036879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533656+0000","last_change":"2023-09-13T06:02:53.533656+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533656+0000","last_undegraded":"2023-09-13T06:02:53.533656+0000","last_fullsized":"2023-09-13T06:02:53.533656+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153959+0000","last_change":"2023-09-13T06:02:55.574403+0000","last_active":"2023-09-13T06:02:57.153959+0000","last_peered":"2023-09-13T06:02:57.153959+0000","last_clean":"2023-09-13T06:02:57.153959+0000","last_became_active":"2023-09-13T06:02:55.574180+0000","last_became_peered":"2023-09-13T06:02:55.574180+0000","last_unstale":"2023-09-13T06:02:57.153959+0000","last_undegraded":"2023-09-13T06:02:57.153959+0000","last_fullsized":"2023-09-13T06:02:57.153959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:34:30.195506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563869+0000","last_change":"2023-09-13T06:02:54.551857+0000","last_active":"2023-09-13T06:02:55.563869+0000","last_peered":"2023-09-13T06:02:55.563869+0000","last_clean":"2023-09-13T06:02:55.563869+0000","last_became_active":"2023-09-13T06:02:54.551624+0000","last_became_peered":"2023-09-13T06:02:54.551624+0000","last_unstale":"2023-09-13T06:02:55.563869+0000","last_undegraded":"2023-09-13T06:02:55.563869+0000","last_fullsized":"2023-09-13T06:02:55.563869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:36:43.156835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154247+0000","last_change":"2023-09-13T06:02:55.567084+0000","last_active":"2023-09-13T06:02:57.154247+0000","last_peered":"2023-09-13T06:02:57.154247+0000","last_clean":"2023-09-13T06:02:57.154247+0000","last_became_active":"2023-09-13T06:02:55.566832+0000","last_became_peered":"2023-09-13T06:02:55.566832+0000","last_unstale":"2023-09-13T06:02:57.154247+0000","last_undegraded":"2023-09-13T06:02:57.154247+0000","last_fullsized":"2023-09-13T06:02:57.154247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:31:40.315456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533918+0000","last_change":"2023-09-13T06:02:53.533918+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533918+0000","last_undegraded":"2023-09-13T06:02:53.533918+0000","last_fullsized":"2023-09-13T06:02:53.533918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559374+0000","last_change":"2023-09-13T06:02:54.550539+0000","last_active":"2023-09-13T06:02:55.559374+0000","last_peered":"2023-09-13T06:02:55.559374+0000","last_clean":"2023-09-13T06:02:55.559374+0000","last_became_active":"2023-09-13T06:02:54.550282+0000","last_became_peered":"2023-09-13T06:02:54.550282+0000","last_unstale":"2023-09-13T06:02:55.559374+0000","last_undegraded":"2023-09-13T06:02:55.559374+0000","last_fullsized":"2023-09-13T06:02:55.559374+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:51.133291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154322+0000","last_change":"2023-09-13T06:02:55.573567+0000","last_active":"2023-09-13T06:02:57.154322+0000","last_peered":"2023-09-13T06:02:57.154322+0000","last_clean":"2023-09-13T06:02:57.154322+0000","last_became_active":"2023-09-13T06:02:55.572708+0000","last_became_peered":"2023-09-13T06:02:55.572708+0000","last_unstale":"2023-09-13T06:02:57.154322+0000","last_undegraded":"2023-09-13T06:02:57.154322+0000","last_fullsized":"2023-09-13T06:02:57.154322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:47.080838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533415+0000","last_change":"2023-09-13T06:02:53.533415+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533415+0000","last_undegraded":"2023-09-13T06:02:53.533415+0000","last_fullsized":"2023-09-13T06:02:53.533415+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563170+0000","last_change":"2023-09-13T06:02:54.547697+0000","last_active":"2023-09-13T06:02:55.563170+0000","last_peered":"2023-09-13T06:02:55.563170+0000","last_clean":"2023-09-13T06:02:55.563170+0000","last_became_active":"2023-09-13T06:02:54.546477+0000","last_became_peered":"2023-09-13T06:02:54.546477+0000","last_unstale":"2023-09-13T06:02:55.563170+0000","last_undegraded":"2023-09-13T06:02:55.563170+0000","last_fullsized":"2023-09-13T06:02:55.563170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:32:16.554135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560725+0000","last_change":"2023-09-13T06:02:55.564878+0000","last_active":"2023-09-13T06:02:56.560725+0000","last_peered":"2023-09-13T06:02:56.560725+0000","last_clean":"2023-09-13T06:02:56.560725+0000","last_became_active":"2023-09-13T06:02:55.564647+0000","last_became_peered":"2023-09-13T06:02:55.564647+0000","last_unstale":"2023-09-13T06:02:56.560725+0000","last_undegraded":"2023-09-13T06:02:56.560725+0000","last_fullsized":"2023-09-13T06:02:56.560725+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:39.317324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533406+0000","last_change":"2023-09-13T06:02:53.533406+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533406+0000","last_undegraded":"2023-09-13T06:02:53.533406+0000","last_fullsized":"2023-09-13T06:02:53.533406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561187+0000","last_change":"2023-09-13T06:02:55.570627+0000","last_active":"2023-09-13T06:02:56.561187+0000","last_peered":"2023-09-13T06:02:56.561187+0000","last_clean":"2023-09-13T06:02:56.561187+0000","last_became_active":"2023-09-13T06:02:55.570379+0000","last_became_peered":"2023-09-13T06:02:55.570379+0000","last_unstale":"2023-09-13T06:02:56.561187+0000","last_undegraded":"2023-09-13T06:02:56.561187+0000","last_fullsized":"2023-09-13T06:02:56.561187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:06.965866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538855+0000","last_change":"2023-09-13T06:02:53.538855+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538855+0000","last_undegraded":"2023-09-13T06:02:53.538855+0000","last_fullsized":"2023-09-13T06:02:53.538855+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.564799+0000","last_change":"2023-09-13T06:02:54.552935+0000","last_active":"2023-09-13T06:02:55.564799+0000","last_peered":"2023-09-13T06:02:55.564799+0000","last_clean":"2023-09-13T06:02:55.564799+0000","last_became_active":"2023-09-13T06:02:54.552709+0000","last_became_peered":"2023-09-13T06:02:54.552709+0000","last_unstale":"2023-09-13T06:02:55.564799+0000","last_undegraded":"2023-09-13T06:02:55.564799+0000","last_fullsized":"2023-09-13T06:02:55.564799+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:06:58.669309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563150+0000","last_change":"2023-09-13T06:02:54.554295+0000","last_active":"2023-09-13T06:02:55.563150+0000","last_peered":"2023-09-13T06:02:55.563150+0000","last_clean":"2023-09-13T06:02:55.563150+0000","last_became_active":"2023-09-13T06:02:54.553764+0000","last_became_peered":"2023-09-13T06:02:54.553764+0000","last_unstale":"2023-09-13T06:02:55.563150+0000","last_undegraded":"2023-09-13T06:02:55.563150+0000","last_fullsized":"2023-09-13T06:02:55.563150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:36.571962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153857+0000","last_change":"2023-09-13T06:02:55.566022+0000","last_active":"2023-09-13T06:02:57.153857+0000","last_peered":"2023-09-13T06:02:57.153857+0000","last_clean":"2023-09-13T06:02:57.153857+0000","last_became_active":"2023-09-13T06:02:55.565405+0000","last_became_peered":"2023-09-13T06:02:55.565405+0000","last_unstale":"2023-09-13T06:02:57.153857+0000","last_undegraded":"2023-09-13T06:02:57.153857+0000","last_fullsized":"2023-09-13T06:02:57.153857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:37.929114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533441+0000","last_change":"2023-09-13T06:02:53.533441+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533441+0000","last_undegraded":"2023-09-13T06:02:53.533441+0000","last_fullsized":"2023-09-13T06:02:53.533441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-09-13T06:02:51.535693+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:02:51.535693+0000","last_peered":"2023-09-13T06:02:51.535693+0000","last_clean":"2023-09-13T06:02:51.535693+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:02:51.535693+0000","last_undegraded":"2023-09-13T06:02:51.535693+0000","last_fullsized":"2023-09-13T06:02:51.535693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":760,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194551,"statfs":{"total":200000000,"available":199221180,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.73999999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.63500000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76900000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.89400000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.83599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":184,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195128,"statfs":{"total":200000000,"available":199811548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.65600000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67000000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.754},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.70299999999999996}]},{"osd":4,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48999999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.50800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":184,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195128,"statfs":{"total":200000000,"available":199811548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.65200000000000002}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.84099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.621},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.89000000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.78400000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81799999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.751}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":184,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195128,"statfs":{"total":200000000,"available":199811548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.78300000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.621},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.83999999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68799999999999994}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.872},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.72099999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.89400000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.80700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.628},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.60199999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.5}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.41399999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.505}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.371},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.88700000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.91300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786319,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.48799999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.2150000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.878},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.1140000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":1.2769999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195987,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40000000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.627}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.53000000000000003}]}]}],"pool_statfs":[]}} 2023-09-13T06:02:59.658 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:02:59.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a7e574640 1 Processor -- start 2023-09-13T06:02:59.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a7e574640 1 -- start start 2023-09-13T06:02:59.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a7e574640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4a780d1750 0x7f4a7815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a7e574640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a780d1090 0x7f4a78146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a7e574640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a780b63c0 con 0x7f4a780d1b30 2023-09-13T06:02:59.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a7e574640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7815dea0 con 0x7f4a780d1090 2023-09-13T06:02:59.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a7e574640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a780d0c20 con 0x7f4a780d1750 2023-09-13T06:02:59.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a777fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a780d1090 0x7f4a78146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a777fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a780d1090 0x7f4a78146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52144/0 (socket says 172.21.15.130:52144) 2023-09-13T06:02:59.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a777fe640 1 -- 172.21.15.130:0/85628432 learned_addr learned my addr 172.21.15.130:0/85628432 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:59.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a777fe640 1 -- 172.21.15.130:0/85628432 >> v2:172.21.15.164:3300/0 conn(0x7f4a780d1750 msgr2=0x7f4a7815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:59.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a77fff640 1 --2- 172.21.15.130:0/85628432 >> v2:172.21.15.164:3300/0 conn(0x7f4a780d1750 0x7f4a7815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a777fe640 1 --2- 172.21.15.130:0/85628432 >> v2:172.21.15.164:3300/0 conn(0x7f4a780d1750 0x7f4a7815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a777fe640 1 -- 172.21.15.130:0/85628432 >> v1:172.21.15.164:6789/0 conn(0x7f4a780d1b30 legacy=0x7f4a780b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:02:59.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a777fe640 1 -- 172.21.15.130:0/85628432 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780b6610 con 0x7f4a780d1090 2023-09-13T06:02:59.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.831+0000 7f4a77fff640 1 --2- 172.21.15.130:0/85628432 >> v2:172.21.15.164:3300/0 conn(0x7f4a780d1750 0x7f4a7815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:02:59.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a777fe640 1 --2- 172.21.15.130:0/85628432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a780d1090 0x7f4a78146820 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4a78073cd0 tx=0x7f4a6c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b350a8901cdc67 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:59.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a76ffd640 1 -- 172.21.15.130:0/85628432 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0aa5f0 con 0x7f4a780d1090 2023-09-13T06:02:59.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a76ffd640 1 -- 172.21.15.130:0/85628432 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c0aa750 con 0x7f4a780d1090 2023-09-13T06:02:59.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a76ffd640 1 -- 172.21.15.130:0/85628432 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0aaae0 con 0x7f4a780d1090 2023-09-13T06:02:59.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a7e574640 1 -- 172.21.15.130:0/85628432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a780d1090 msgr2=0x7f4a78146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a7e574640 1 --2- 172.21.15.130:0/85628432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a780d1090 0x7f4a78146820 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4a78073cd0 tx=0x7f4a6c01c490 comp rx=0 tx=0).stop 2023-09-13T06:02:59.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a7e574640 1 -- 172.21.15.130:0/85628432 shutdown_connections 2023-09-13T06:02:59.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a7e574640 1 --2- 172.21.15.130:0/85628432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a780d1090 0x7f4a78146820 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a7e574640 1 --2- 172.21.15.130:0/85628432 >> v2:172.21.15.164:3300/0 conn(0x7f4a780d1750 0x7f4a7815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a7e574640 1 -- 172.21.15.130:0/85628432 >> 172.21.15.130:0/85628432 conn(0x7f4a7806f170 msgr2=0x7f4a7806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:02:59.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a7e574640 1 -- 172.21.15.130:0/85628432 shutdown_connections 2023-09-13T06:02:59.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.835+0000 7f4a7e574640 1 -- 172.21.15.130:0/85628432 wait complete. 2023-09-13T06:02:59.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7e574640 1 Processor -- start 2023-09-13T06:02:59.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7e574640 1 -- start start 2023-09-13T06:02:59.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7e574640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a780d1090 0x7f4a78141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7e574640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a780d1750 0x7f4a7815c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7e574640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a780d1b30 0x7f4a78163360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7e574640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78140670 con 0x7f4a780d1b30 2023-09-13T06:02:59.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7e574640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78141ea0 con 0x7f4a780d1090 2023-09-13T06:02:59.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7e574640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7815cd90 con 0x7f4a780d1750 2023-09-13T06:02:59.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7cb11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a780d1b30 0x7f4a78163360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7cb11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a780d1b30 0x7f4a78163360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52158/0 (socket says 172.21.15.130:52158) 2023-09-13T06:02:59.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7cb11640 1 -- 172.21.15.130:0/3090668886 learned_addr learned my addr 172.21.15.130:0/3090668886 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:02:59.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a777fe640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a780d1750 0x7f4a7815c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a77fff640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a780d1090 0x7f4a78141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7cb11640 1 -- 172.21.15.130:0/3090668886 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a780d1750 msgr2=0x7f4a7815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7cb11640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a780d1750 0x7f4a7815c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7cb11640 1 -- 172.21.15.130:0/3090668886 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a780d1090 msgr2=0x7f4a78141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:02:59.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7cb11640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a780d1090 0x7f4a78141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:02:59.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7cb11640 1 -- 172.21.15.130:0/3090668886 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c0094d0 con 0x7f4a780d1b30 2023-09-13T06:02:59.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7cb11640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a780d1b30 0x7f4a78163360 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000c7b0 tx=0x7f4a7000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:59.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a74ff9640 1 -- 172.21.15.130:0/3090668886 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70004b70 con 0x7f4a780d1b30 2023-09-13T06:02:59.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a74ff9640 1 -- 172.21.15.130:0/3090668886 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70004cd0 con 0x7f4a780d1b30 2023-09-13T06:02:59.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a74ff9640 1 -- 172.21.15.130:0/3090668886 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000aa90 con 0x7f4a780d1b30 2023-09-13T06:02:59.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7e574640 1 -- 172.21.15.130:0/3090668886 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a781408c0 con 0x7f4a780d1b30 2023-09-13T06:02:59.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.839+0000 7f4a7e574640 1 -- 172.21.15.130:0/3090668886 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a78140e80 con 0x7f4a780d1b30 2023-09-13T06:02:59.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.843+0000 7f4a7e574640 1 -- 172.21.15.130:0/3090668886 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a780618a0 con 0x7f4a780d1b30 2023-09-13T06:02:59.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.843+0000 7f4a74ff9640 1 -- 172.21.15.130:0/3090668886 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4a7000abf0 con 0x7f4a780d1b30 2023-09-13T06:02:59.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.843+0000 7f4a74ff9640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a64065b50 0x7f4a64068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:02:59.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.843+0000 7f4a74ff9640 1 -- 172.21.15.130:0/3090668886 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a70083440 con 0x7f4a780d1b30 2023-09-13T06:02:59.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.843+0000 7f4a77fff640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a64065b50 0x7f4a64068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:02:59.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.843+0000 7f4a77fff640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a64065b50 0x7f4a64068010 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800ab60 tx=0x7f4a68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:02:59.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.847+0000 7f4a74ff9640 1 -- 172.21.15.130:0/3090668886 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4a70050d20 con 0x7f4a780d1b30 2023-09-13T06:02:59.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.991+0000 7f4a7e574640 1 -- 172.21.15.130:0/3090668886 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a78147170 con 0x7f4a64065b50 2023-09-13T06:03:00.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:02:59.999+0000 7f4a74ff9640 1 -- 172.21.15.130:0/3090668886 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280209 (secure 0 0 0) 0x7f4a6800c040 con 0x7f4a64065b50 2023-09-13T06:03:00.006 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:00.008 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:03:00.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 -- 172.21.15.130:0/3090668886 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a64065b50 msgr2=0x7f4a64068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a64065b50 0x7f4a64068010 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800ab60 tx=0x7f4a68008040 comp rx=0 tx=0).stop 2023-09-13T06:03:00.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 -- 172.21.15.130:0/3090668886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a780d1b30 msgr2=0x7f4a78163360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a780d1b30 0x7f4a78163360 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000c7b0 tx=0x7f4a7000cc70 comp rx=0 tx=0).stop 2023-09-13T06:03:00.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 -- 172.21.15.130:0/3090668886 shutdown_connections 2023-09-13T06:03:00.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a64065b50 0x7f4a64068010 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a780d1b30 0x7f4a78163360 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a780d1750 0x7f4a7815c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 --2- 172.21.15.130:0/3090668886 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a780d1090 0x7f4a78141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 -- 172.21.15.130:0/3090668886 >> 172.21.15.130:0/3090668886 conn(0x7f4a7806f170 msgr2=0x7f4a7815efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:00.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 -- 172.21.15.130:0/3090668886 shutdown_connections 2023-09-13T06:03:00.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.003+0000 7f4a7e574640 1 -- 172.21.15.130:0/3090668886 wait complete. 2023-09-13T06:03:00.028 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-09-13T06:02:58.553546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2725,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559774,"statfs":{"total":1600000000,"available":1597208636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.019523"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154162+0000","last_change":"2023-09-13T06:02:55.576304+0000","last_active":"2023-09-13T06:02:57.154162+0000","last_peered":"2023-09-13T06:02:57.154162+0000","last_clean":"2023-09-13T06:02:57.154162+0000","last_became_active":"2023-09-13T06:02:55.576093+0000","last_became_peered":"2023-09-13T06:02:55.576093+0000","last_unstale":"2023-09-13T06:02:57.154162+0000","last_undegraded":"2023-09-13T06:02:57.154162+0000","last_fullsized":"2023-09-13T06:02:57.154162+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:16:23.458455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560881+0000","last_change":"2023-09-13T06:02:55.566320+0000","last_active":"2023-09-13T06:02:56.560881+0000","last_peered":"2023-09-13T06:02:56.560881+0000","last_clean":"2023-09-13T06:02:56.560881+0000","last_became_active":"2023-09-13T06:02:55.565921+0000","last_became_peered":"2023-09-13T06:02:55.565921+0000","last_unstale":"2023-09-13T06:02:56.560881+0000","last_undegraded":"2023-09-13T06:02:56.560881+0000","last_fullsized":"2023-09-13T06:02:56.560881+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:33:20.937865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153727+0000","last_change":"2023-09-13T06:02:55.573024+0000","last_active":"2023-09-13T06:02:57.153727+0000","last_peered":"2023-09-13T06:02:57.153727+0000","last_clean":"2023-09-13T06:02:57.153727+0000","last_became_active":"2023-09-13T06:02:55.572812+0000","last_became_peered":"2023-09-13T06:02:55.572812+0000","last_unstale":"2023-09-13T06:02:57.153727+0000","last_undegraded":"2023-09-13T06:02:57.153727+0000","last_fullsized":"2023-09-13T06:02:57.153727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:54.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154313+0000","last_change":"2023-09-13T06:02:55.571715+0000","last_active":"2023-09-13T06:02:57.154313+0000","last_peered":"2023-09-13T06:02:57.154313+0000","last_clean":"2023-09-13T06:02:57.154313+0000","last_became_active":"2023-09-13T06:02:55.571192+0000","last_became_peered":"2023-09-13T06:02:55.571192+0000","last_unstale":"2023-09-13T06:02:57.154313+0000","last_undegraded":"2023-09-13T06:02:57.154313+0000","last_fullsized":"2023-09-13T06:02:57.154313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:17:43.885392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153946+0000","last_change":"2023-09-13T06:02:55.575986+0000","last_active":"2023-09-13T06:02:57.153946+0000","last_peered":"2023-09-13T06:02:57.153946+0000","last_clean":"2023-09-13T06:02:57.153946+0000","last_became_active":"2023-09-13T06:02:55.575791+0000","last_became_peered":"2023-09-13T06:02:55.575791+0000","last_unstale":"2023-09-13T06:02:57.153946+0000","last_undegraded":"2023-09-13T06:02:57.153946+0000","last_fullsized":"2023-09-13T06:02:57.153946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:30.054070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154032+0000","last_change":"2023-09-13T06:02:55.565063+0000","last_active":"2023-09-13T06:02:57.154032+0000","last_peered":"2023-09-13T06:02:57.154032+0000","last_clean":"2023-09-13T06:02:57.154032+0000","last_became_active":"2023-09-13T06:02:55.564847+0000","last_became_peered":"2023-09-13T06:02:55.564847+0000","last_unstale":"2023-09-13T06:02:57.154032+0000","last_undegraded":"2023-09-13T06:02:57.154032+0000","last_fullsized":"2023-09-13T06:02:57.154032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:48.470117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153708+0000","last_change":"2023-09-13T06:02:55.569821+0000","last_active":"2023-09-13T06:02:57.153708+0000","last_peered":"2023-09-13T06:02:57.153708+0000","last_clean":"2023-09-13T06:02:57.153708+0000","last_became_active":"2023-09-13T06:02:55.569596+0000","last_became_peered":"2023-09-13T06:02:55.569596+0000","last_unstale":"2023-09-13T06:02:57.153708+0000","last_undegraded":"2023-09-13T06:02:57.153708+0000","last_fullsized":"2023-09-13T06:02:57.153708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:17:55.915552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154649+0000","last_change":"2023-09-13T06:02:55.571859+0000","last_active":"2023-09-13T06:02:57.154649+0000","last_peered":"2023-09-13T06:02:57.154649+0000","last_clean":"2023-09-13T06:02:57.154649+0000","last_became_active":"2023-09-13T06:02:55.571512+0000","last_became_peered":"2023-09-13T06:02:55.571512+0000","last_unstale":"2023-09-13T06:02:57.154649+0000","last_undegraded":"2023-09-13T06:02:57.154649+0000","last_fullsized":"2023-09-13T06:02:57.154649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:03:57.908839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560750+0000","last_change":"2023-09-13T06:02:55.566258+0000","last_active":"2023-09-13T06:02:56.560750+0000","last_peered":"2023-09-13T06:02:56.560750+0000","last_clean":"2023-09-13T06:02:56.560750+0000","last_became_active":"2023-09-13T06:02:55.566046+0000","last_became_peered":"2023-09-13T06:02:55.566046+0000","last_unstale":"2023-09-13T06:02:56.560750+0000","last_undegraded":"2023-09-13T06:02:56.560750+0000","last_fullsized":"2023-09-13T06:02:56.560750+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:23:02.216766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153771+0000","last_change":"2023-09-13T06:02:55.573245+0000","last_active":"2023-09-13T06:02:57.153771+0000","last_peered":"2023-09-13T06:02:57.153771+0000","last_clean":"2023-09-13T06:02:57.153771+0000","last_became_active":"2023-09-13T06:02:55.573014+0000","last_became_peered":"2023-09-13T06:02:55.573014+0000","last_unstale":"2023-09-13T06:02:57.153771+0000","last_undegraded":"2023-09-13T06:02:57.153771+0000","last_fullsized":"2023-09-13T06:02:57.153771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:24:16.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561006+0000","last_change":"2023-09-13T06:02:55.570152+0000","last_active":"2023-09-13T06:02:56.561006+0000","last_peered":"2023-09-13T06:02:56.561006+0000","last_clean":"2023-09-13T06:02:56.561006+0000","last_became_active":"2023-09-13T06:02:55.569932+0000","last_became_peered":"2023-09-13T06:02:55.569932+0000","last_unstale":"2023-09-13T06:02:56.561006+0000","last_undegraded":"2023-09-13T06:02:56.561006+0000","last_fullsized":"2023-09-13T06:02:56.561006+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:31:37.037162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154101+0000","last_change":"2023-09-13T06:02:55.576177+0000","last_active":"2023-09-13T06:02:57.154101+0000","last_peered":"2023-09-13T06:02:57.154101+0000","last_clean":"2023-09-13T06:02:57.154101+0000","last_became_active":"2023-09-13T06:02:55.575860+0000","last_became_peered":"2023-09-13T06:02:55.575860+0000","last_unstale":"2023-09-13T06:02:57.154101+0000","last_undegraded":"2023-09-13T06:02:57.154101+0000","last_fullsized":"2023-09-13T06:02:57.154101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:52.140701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153836+0000","last_change":"2023-09-13T06:02:55.573937+0000","last_active":"2023-09-13T06:02:57.153836+0000","last_peered":"2023-09-13T06:02:57.153836+0000","last_clean":"2023-09-13T06:02:57.153836+0000","last_became_active":"2023-09-13T06:02:55.573729+0000","last_became_peered":"2023-09-13T06:02:55.573729+0000","last_unstale":"2023-09-13T06:02:57.153836+0000","last_undegraded":"2023-09-13T06:02:57.153836+0000","last_fullsized":"2023-09-13T06:02:57.153836+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:34:29.520875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561115+0000","last_change":"2023-09-13T06:02:55.566159+0000","last_active":"2023-09-13T06:02:56.561115+0000","last_peered":"2023-09-13T06:02:56.561115+0000","last_clean":"2023-09-13T06:02:56.561115+0000","last_became_active":"2023-09-13T06:02:55.565600+0000","last_became_peered":"2023-09-13T06:02:55.565600+0000","last_unstale":"2023-09-13T06:02:56.561115+0000","last_undegraded":"2023-09-13T06:02:56.561115+0000","last_fullsized":"2023-09-13T06:02:56.561115+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:21:14.123686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153705+0000","last_change":"2023-09-13T06:02:55.571221+0000","last_active":"2023-09-13T06:02:57.153705+0000","last_peered":"2023-09-13T06:02:57.153705+0000","last_clean":"2023-09-13T06:02:57.153705+0000","last_became_active":"2023-09-13T06:02:55.571005+0000","last_became_peered":"2023-09-13T06:02:55.571005+0000","last_unstale":"2023-09-13T06:02:57.153705+0000","last_undegraded":"2023-09-13T06:02:57.153705+0000","last_fullsized":"2023-09-13T06:02:57.153705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:48.044030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115239+0000","last_change":"2023-09-13T06:02:55.569767+0000","last_active":"2023-09-13T06:02:57.115239+0000","last_peered":"2023-09-13T06:02:57.115239+0000","last_clean":"2023-09-13T06:02:57.115239+0000","last_became_active":"2023-09-13T06:02:55.569428+0000","last_became_peered":"2023-09-13T06:02:55.569428+0000","last_unstale":"2023-09-13T06:02:57.115239+0000","last_undegraded":"2023-09-13T06:02:57.115239+0000","last_fullsized":"2023-09-13T06:02:57.115239+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:33.201660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588141+0000","last_change":"2023-09-13T06:02:54.553420+0000","last_active":"2023-09-13T06:02:55.588141+0000","last_peered":"2023-09-13T06:02:55.588141+0000","last_clean":"2023-09-13T06:02:55.588141+0000","last_became_active":"2023-09-13T06:02:54.553123+0000","last_became_peered":"2023-09-13T06:02:54.553123+0000","last_unstale":"2023-09-13T06:02:55.588141+0000","last_undegraded":"2023-09-13T06:02:55.588141+0000","last_fullsized":"2023-09-13T06:02:55.588141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:13:21.882042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538877+0000","last_change":"2023-09-13T06:02:53.538877+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538877+0000","last_undegraded":"2023-09-13T06:02:53.538877+0000","last_fullsized":"2023-09-13T06:02:53.538877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588197+0000","last_change":"2023-09-13T06:02:54.547570+0000","last_active":"2023-09-13T06:02:55.588197+0000","last_peered":"2023-09-13T06:02:55.588197+0000","last_clean":"2023-09-13T06:02:55.588197+0000","last_became_active":"2023-09-13T06:02:54.546154+0000","last_became_peered":"2023-09-13T06:02:54.546154+0000","last_unstale":"2023-09-13T06:02:55.588197+0000","last_undegraded":"2023-09-13T06:02:55.588197+0000","last_fullsized":"2023-09-13T06:02:55.588197+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115288+0000","last_change":"2023-09-13T06:02:55.571812+0000","last_active":"2023-09-13T06:02:57.115288+0000","last_peered":"2023-09-13T06:02:57.115288+0000","last_clean":"2023-09-13T06:02:57.115288+0000","last_became_active":"2023-09-13T06:02:55.571348+0000","last_became_peered":"2023-09-13T06:02:55.571348+0000","last_unstale":"2023-09-13T06:02:57.115288+0000","last_undegraded":"2023-09-13T06:02:57.115288+0000","last_fullsized":"2023-09-13T06:02:57.115288+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:28.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534663+0000","last_change":"2023-09-13T06:02:53.534663+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534663+0000","last_undegraded":"2023-09-13T06:02:53.534663+0000","last_fullsized":"2023-09-13T06:02:53.534663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.586558+0000","last_change":"2023-09-13T06:02:54.542145+0000","last_active":"2023-09-13T06:02:55.586558+0000","last_peered":"2023-09-13T06:02:55.586558+0000","last_clean":"2023-09-13T06:02:55.586558+0000","last_became_active":"2023-09-13T06:02:54.541895+0000","last_became_peered":"2023-09-13T06:02:54.541895+0000","last_unstale":"2023-09-13T06:02:55.586558+0000","last_undegraded":"2023-09-13T06:02:55.586558+0000","last_fullsized":"2023-09-13T06:02:55.586558+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:29.046660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154185+0000","last_change":"2023-09-13T06:02:55.573275+0000","last_active":"2023-09-13T06:02:57.154185+0000","last_peered":"2023-09-13T06:02:57.154185+0000","last_clean":"2023-09-13T06:02:57.154185+0000","last_became_active":"2023-09-13T06:02:55.572872+0000","last_became_peered":"2023-09-13T06:02:55.572872+0000","last_unstale":"2023-09-13T06:02:57.154185+0000","last_undegraded":"2023-09-13T06:02:57.154185+0000","last_fullsized":"2023-09-13T06:02:57.154185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:27.803689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538868+0000","last_change":"2023-09-13T06:02:53.538868+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538868+0000","last_undegraded":"2023-09-13T06:02:53.538868+0000","last_fullsized":"2023-09-13T06:02:53.538868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154083+0000","last_change":"2023-09-13T06:02:55.573786+0000","last_active":"2023-09-13T06:02:57.154083+0000","last_peered":"2023-09-13T06:02:57.154083+0000","last_clean":"2023-09-13T06:02:57.154083+0000","last_became_active":"2023-09-13T06:02:55.573021+0000","last_became_peered":"2023-09-13T06:02:55.573021+0000","last_unstale":"2023-09-13T06:02:57.154083+0000","last_undegraded":"2023-09-13T06:02:57.154083+0000","last_fullsized":"2023-09-13T06:02:57.154083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:39.312149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534026+0000","last_change":"2023-09-13T06:02:53.534026+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534026+0000","last_undegraded":"2023-09-13T06:02:53.534026+0000","last_fullsized":"2023-09-13T06:02:53.534026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563741+0000","last_change":"2023-09-13T06:02:54.555524+0000","last_active":"2023-09-13T06:02:55.563741+0000","last_peered":"2023-09-13T06:02:55.563741+0000","last_clean":"2023-09-13T06:02:55.563741+0000","last_became_active":"2023-09-13T06:02:54.554282+0000","last_became_peered":"2023-09-13T06:02:54.554282+0000","last_unstale":"2023-09-13T06:02:55.563741+0000","last_undegraded":"2023-09-13T06:02:55.563741+0000","last_fullsized":"2023-09-13T06:02:55.563741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:12:41.106016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538844+0000","last_change":"2023-09-13T06:02:53.538844+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538844+0000","last_undegraded":"2023-09-13T06:02:53.538844+0000","last_fullsized":"2023-09-13T06:02:53.538844+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.562440+0000","last_change":"2023-09-13T06:02:54.550521+0000","last_active":"2023-09-13T06:02:55.562440+0000","last_peered":"2023-09-13T06:02:55.562440+0000","last_clean":"2023-09-13T06:02:55.562440+0000","last_became_active":"2023-09-13T06:02:54.550233+0000","last_became_peered":"2023-09-13T06:02:54.550233+0000","last_unstale":"2023-09-13T06:02:55.562440+0000","last_undegraded":"2023-09-13T06:02:55.562440+0000","last_fullsized":"2023-09-13T06:02:55.562440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:11:28.345524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560882+0000","last_change":"2023-09-13T06:02:55.572306+0000","last_active":"2023-09-13T06:02:56.560882+0000","last_peered":"2023-09-13T06:02:56.560882+0000","last_clean":"2023-09-13T06:02:56.560882+0000","last_became_active":"2023-09-13T06:02:55.571811+0000","last_became_peered":"2023-09-13T06:02:55.571811+0000","last_unstale":"2023-09-13T06:02:56.560882+0000","last_undegraded":"2023-09-13T06:02:56.560882+0000","last_fullsized":"2023-09-13T06:02:56.560882+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:44.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534005+0000","last_change":"2023-09-13T06:02:53.534005+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534005+0000","last_undegraded":"2023-09-13T06:02:53.534005+0000","last_fullsized":"2023-09-13T06:02:53.534005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588927+0000","last_change":"2023-09-13T06:02:54.549352+0000","last_active":"2023-09-13T06:02:55.588927+0000","last_peered":"2023-09-13T06:02:55.588927+0000","last_clean":"2023-09-13T06:02:55.588927+0000","last_became_active":"2023-09-13T06:02:54.549113+0000","last_became_peered":"2023-09-13T06:02:54.549113+0000","last_unstale":"2023-09-13T06:02:55.588927+0000","last_undegraded":"2023-09-13T06:02:55.588927+0000","last_fullsized":"2023-09-13T06:02:55.588927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:08:58.059162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587540+0000","last_change":"2023-09-13T06:02:54.548194+0000","last_active":"2023-09-13T06:02:55.587540+0000","last_peered":"2023-09-13T06:02:55.587540+0000","last_clean":"2023-09-13T06:02:55.587540+0000","last_became_active":"2023-09-13T06:02:54.547973+0000","last_became_peered":"2023-09-13T06:02:54.547973+0000","last_unstale":"2023-09-13T06:02:55.587540+0000","last_undegraded":"2023-09-13T06:02:55.587540+0000","last_fullsized":"2023-09-13T06:02:55.587540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:36.921705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154163+0000","last_change":"2023-09-13T06:02:55.567612+0000","last_active":"2023-09-13T06:02:57.154163+0000","last_peered":"2023-09-13T06:02:57.154163+0000","last_clean":"2023-09-13T06:02:57.154163+0000","last_became_active":"2023-09-13T06:02:55.567338+0000","last_became_peered":"2023-09-13T06:02:55.567338+0000","last_unstale":"2023-09-13T06:02:57.154163+0000","last_undegraded":"2023-09-13T06:02:57.154163+0000","last_fullsized":"2023-09-13T06:02:57.154163+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:26:27.736729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534356+0000","last_change":"2023-09-13T06:02:53.534356+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534356+0000","last_undegraded":"2023-09-13T06:02:53.534356+0000","last_fullsized":"2023-09-13T06:02:53.534356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560705+0000","last_change":"2023-09-13T06:02:55.571558+0000","last_active":"2023-09-13T06:02:56.560705+0000","last_peered":"2023-09-13T06:02:56.560705+0000","last_clean":"2023-09-13T06:02:56.560705+0000","last_became_active":"2023-09-13T06:02:55.571251+0000","last_became_peered":"2023-09-13T06:02:55.571251+0000","last_unstale":"2023-09-13T06:02:56.560705+0000","last_undegraded":"2023-09-13T06:02:56.560705+0000","last_fullsized":"2023-09-13T06:02:56.560705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:03:57.908839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559344+0000","last_change":"2023-09-13T06:02:54.548947+0000","last_active":"2023-09-13T06:02:55.559344+0000","last_peered":"2023-09-13T06:02:55.559344+0000","last_clean":"2023-09-13T06:02:55.559344+0000","last_became_active":"2023-09-13T06:02:54.548729+0000","last_became_peered":"2023-09-13T06:02:54.548729+0000","last_unstale":"2023-09-13T06:02:55.559344+0000","last_undegraded":"2023-09-13T06:02:55.559344+0000","last_fullsized":"2023-09-13T06:02:55.559344+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:38.304740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588745+0000","last_change":"2023-09-13T06:02:54.549606+0000","last_active":"2023-09-13T06:02:55.588745+0000","last_peered":"2023-09-13T06:02:55.588745+0000","last_clean":"2023-09-13T06:02:55.588745+0000","last_became_active":"2023-09-13T06:02:54.549385+0000","last_became_peered":"2023-09-13T06:02:54.549385+0000","last_unstale":"2023-09-13T06:02:55.588745+0000","last_undegraded":"2023-09-13T06:02:55.588745+0000","last_fullsized":"2023-09-13T06:02:55.588745+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153897+0000","last_change":"2023-09-13T06:02:55.570594+0000","last_active":"2023-09-13T06:02:57.153897+0000","last_peered":"2023-09-13T06:02:57.153897+0000","last_clean":"2023-09-13T06:02:57.153897+0000","last_became_active":"2023-09-13T06:02:55.570387+0000","last_became_peered":"2023-09-13T06:02:55.570387+0000","last_unstale":"2023-09-13T06:02:57.153897+0000","last_undegraded":"2023-09-13T06:02:57.153897+0000","last_fullsized":"2023-09-13T06:02:57.153897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:30:42.957097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.584236+0000","last_change":"2023-09-13T06:02:54.543232+0000","last_active":"2023-09-13T06:02:55.584236+0000","last_peered":"2023-09-13T06:02:55.584236+0000","last_clean":"2023-09-13T06:02:55.584236+0000","last_became_active":"2023-09-13T06:02:54.542975+0000","last_became_peered":"2023-09-13T06:02:54.542975+0000","last_unstale":"2023-09-13T06:02:55.584236+0000","last_undegraded":"2023-09-13T06:02:55.584236+0000","last_fullsized":"2023-09-13T06:02:55.584236+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:35:14.538719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154448+0000","last_change":"2023-09-13T06:02:55.568883+0000","last_active":"2023-09-13T06:02:57.154448+0000","last_peered":"2023-09-13T06:02:57.154448+0000","last_clean":"2023-09-13T06:02:57.154448+0000","last_became_active":"2023-09-13T06:02:55.568626+0000","last_became_peered":"2023-09-13T06:02:55.568626+0000","last_unstale":"2023-09-13T06:02:57.154448+0000","last_undegraded":"2023-09-13T06:02:57.154448+0000","last_fullsized":"2023-09-13T06:02:57.154448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538865+0000","last_change":"2023-09-13T06:02:53.538865+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538865+0000","last_undegraded":"2023-09-13T06:02:53.538865+0000","last_fullsized":"2023-09-13T06:02:53.538865+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533468+0000","last_change":"2023-09-13T06:02:53.533468+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533468+0000","last_undegraded":"2023-09-13T06:02:53.533468+0000","last_fullsized":"2023-09-13T06:02:53.533468+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559471+0000","last_change":"2023-09-13T06:02:54.551437+0000","last_active":"2023-09-13T06:02:55.559471+0000","last_peered":"2023-09-13T06:02:55.559471+0000","last_clean":"2023-09-13T06:02:55.559471+0000","last_became_active":"2023-09-13T06:02:54.551207+0000","last_became_peered":"2023-09-13T06:02:54.551207+0000","last_unstale":"2023-09-13T06:02:55.559471+0000","last_undegraded":"2023-09-13T06:02:55.559471+0000","last_fullsized":"2023-09-13T06:02:55.559471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:16:22.451045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560697+0000","last_change":"2023-09-13T06:02:55.572167+0000","last_active":"2023-09-13T06:02:56.560697+0000","last_peered":"2023-09-13T06:02:56.560697+0000","last_clean":"2023-09-13T06:02:56.560697+0000","last_became_active":"2023-09-13T06:02:55.571528+0000","last_became_peered":"2023-09-13T06:02:55.571528+0000","last_unstale":"2023-09-13T06:02:56.560697+0000","last_undegraded":"2023-09-13T06:02:56.560697+0000","last_fullsized":"2023-09-13T06:02:56.560697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587418+0000","last_change":"2023-09-13T06:02:54.542740+0000","last_active":"2023-09-13T06:02:55.587418+0000","last_peered":"2023-09-13T06:02:55.587418+0000","last_clean":"2023-09-13T06:02:55.587418+0000","last_became_active":"2023-09-13T06:02:54.542497+0000","last_became_peered":"2023-09-13T06:02:54.542497+0000","last_unstale":"2023-09-13T06:02:55.587418+0000","last_undegraded":"2023-09-13T06:02:55.587418+0000","last_fullsized":"2023-09-13T06:02:55.587418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:47.462707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115118+0000","last_change":"2023-09-13T06:02:55.567745+0000","last_active":"2023-09-13T06:02:57.115118+0000","last_peered":"2023-09-13T06:02:57.115118+0000","last_clean":"2023-09-13T06:02:57.115118+0000","last_became_active":"2023-09-13T06:02:55.567535+0000","last_became_peered":"2023-09-13T06:02:55.567535+0000","last_unstale":"2023-09-13T06:02:57.115118+0000","last_undegraded":"2023-09-13T06:02:57.115118+0000","last_fullsized":"2023-09-13T06:02:57.115118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:52:17.036879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533656+0000","last_change":"2023-09-13T06:02:53.533656+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533656+0000","last_undegraded":"2023-09-13T06:02:53.533656+0000","last_fullsized":"2023-09-13T06:02:53.533656+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153959+0000","last_change":"2023-09-13T06:02:55.574403+0000","last_active":"2023-09-13T06:02:57.153959+0000","last_peered":"2023-09-13T06:02:57.153959+0000","last_clean":"2023-09-13T06:02:57.153959+0000","last_became_active":"2023-09-13T06:02:55.574180+0000","last_became_peered":"2023-09-13T06:02:55.574180+0000","last_unstale":"2023-09-13T06:02:57.153959+0000","last_undegraded":"2023-09-13T06:02:57.153959+0000","last_fullsized":"2023-09-13T06:02:57.153959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:34:30.195506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563869+0000","last_change":"2023-09-13T06:02:54.551857+0000","last_active":"2023-09-13T06:02:55.563869+0000","last_peered":"2023-09-13T06:02:55.563869+0000","last_clean":"2023-09-13T06:02:55.563869+0000","last_became_active":"2023-09-13T06:02:54.551624+0000","last_became_peered":"2023-09-13T06:02:54.551624+0000","last_unstale":"2023-09-13T06:02:55.563869+0000","last_undegraded":"2023-09-13T06:02:55.563869+0000","last_fullsized":"2023-09-13T06:02:55.563869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:36:43.156835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154247+0000","last_change":"2023-09-13T06:02:55.567084+0000","last_active":"2023-09-13T06:02:57.154247+0000","last_peered":"2023-09-13T06:02:57.154247+0000","last_clean":"2023-09-13T06:02:57.154247+0000","last_became_active":"2023-09-13T06:02:55.566832+0000","last_became_peered":"2023-09-13T06:02:55.566832+0000","last_unstale":"2023-09-13T06:02:57.154247+0000","last_undegraded":"2023-09-13T06:02:57.154247+0000","last_fullsized":"2023-09-13T06:02:57.154247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:31:40.315456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533918+0000","last_change":"2023-09-13T06:02:53.533918+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533918+0000","last_undegraded":"2023-09-13T06:02:53.533918+0000","last_fullsized":"2023-09-13T06:02:53.533918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559374+0000","last_change":"2023-09-13T06:02:54.550539+0000","last_active":"2023-09-13T06:02:55.559374+0000","last_peered":"2023-09-13T06:02:55.559374+0000","last_clean":"2023-09-13T06:02:55.559374+0000","last_became_active":"2023-09-13T06:02:54.550282+0000","last_became_peered":"2023-09-13T06:02:54.550282+0000","last_unstale":"2023-09-13T06:02:55.559374+0000","last_undegraded":"2023-09-13T06:02:55.559374+0000","last_fullsized":"2023-09-13T06:02:55.559374+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:51.133291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154322+0000","last_change":"2023-09-13T06:02:55.573567+0000","last_active":"2023-09-13T06:02:57.154322+0000","last_peered":"2023-09-13T06:02:57.154322+0000","last_clean":"2023-09-13T06:02:57.154322+0000","last_became_active":"2023-09-13T06:02:55.572708+0000","last_became_peered":"2023-09-13T06:02:55.572708+0000","last_unstale":"2023-09-13T06:02:57.154322+0000","last_undegraded":"2023-09-13T06:02:57.154322+0000","last_fullsized":"2023-09-13T06:02:57.154322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:47.080838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533415+0000","last_change":"2023-09-13T06:02:53.533415+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533415+0000","last_undegraded":"2023-09-13T06:02:53.533415+0000","last_fullsized":"2023-09-13T06:02:53.533415+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563170+0000","last_change":"2023-09-13T06:02:54.547697+0000","last_active":"2023-09-13T06:02:55.563170+0000","last_peered":"2023-09-13T06:02:55.563170+0000","last_clean":"2023-09-13T06:02:55.563170+0000","last_became_active":"2023-09-13T06:02:54.546477+0000","last_became_peered":"2023-09-13T06:02:54.546477+0000","last_unstale":"2023-09-13T06:02:55.563170+0000","last_undegraded":"2023-09-13T06:02:55.563170+0000","last_fullsized":"2023-09-13T06:02:55.563170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:32:16.554135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560725+0000","last_change":"2023-09-13T06:02:55.564878+0000","last_active":"2023-09-13T06:02:56.560725+0000","last_peered":"2023-09-13T06:02:56.560725+0000","last_clean":"2023-09-13T06:02:56.560725+0000","last_became_active":"2023-09-13T06:02:55.564647+0000","last_became_peered":"2023-09-13T06:02:55.564647+0000","last_unstale":"2023-09-13T06:02:56.560725+0000","last_undegraded":"2023-09-13T06:02:56.560725+0000","last_fullsized":"2023-09-13T06:02:56.560725+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:39.317324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533406+0000","last_change":"2023-09-13T06:02:53.533406+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533406+0000","last_undegraded":"2023-09-13T06:02:53.533406+0000","last_fullsized":"2023-09-13T06:02:53.533406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561187+0000","last_change":"2023-09-13T06:02:55.570627+0000","last_active":"2023-09-13T06:02:56.561187+0000","last_peered":"2023-09-13T06:02:56.561187+0000","last_clean":"2023-09-13T06:02:56.561187+0000","last_became_active":"2023-09-13T06:02:55.570379+0000","last_became_peered":"2023-09-13T06:02:55.570379+0000","last_unstale":"2023-09-13T06:02:56.561187+0000","last_undegraded":"2023-09-13T06:02:56.561187+0000","last_fullsized":"2023-09-13T06:02:56.561187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:06.965866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538855+0000","last_change":"2023-09-13T06:02:53.538855+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538855+0000","last_undegraded":"2023-09-13T06:02:53.538855+0000","last_fullsized":"2023-09-13T06:02:53.538855+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.564799+0000","last_change":"2023-09-13T06:02:54.552935+0000","last_active":"2023-09-13T06:02:55.564799+0000","last_peered":"2023-09-13T06:02:55.564799+0000","last_clean":"2023-09-13T06:02:55.564799+0000","last_became_active":"2023-09-13T06:02:54.552709+0000","last_became_peered":"2023-09-13T06:02:54.552709+0000","last_unstale":"2023-09-13T06:02:55.564799+0000","last_undegraded":"2023-09-13T06:02:55.564799+0000","last_fullsized":"2023-09-13T06:02:55.564799+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:06:58.669309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563150+0000","last_change":"2023-09-13T06:02:54.554295+0000","last_active":"2023-09-13T06:02:55.563150+0000","last_peered":"2023-09-13T06:02:55.563150+0000","last_clean":"2023-09-13T06:02:55.563150+0000","last_became_active":"2023-09-13T06:02:54.553764+0000","last_became_peered":"2023-09-13T06:02:54.553764+0000","last_unstale":"2023-09-13T06:02:55.563150+0000","last_undegraded":"2023-09-13T06:02:55.563150+0000","last_fullsized":"2023-09-13T06:02:55.563150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:36.571962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153857+0000","last_change":"2023-09-13T06:02:55.566022+0000","last_active":"2023-09-13T06:02:57.153857+0000","last_peered":"2023-09-13T06:02:57.153857+0000","last_clean":"2023-09-13T06:02:57.153857+0000","last_became_active":"2023-09-13T06:02:55.565405+0000","last_became_peered":"2023-09-13T06:02:55.565405+0000","last_unstale":"2023-09-13T06:02:57.153857+0000","last_undegraded":"2023-09-13T06:02:57.153857+0000","last_fullsized":"2023-09-13T06:02:57.153857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:37.929114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533441+0000","last_change":"2023-09-13T06:02:53.533441+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533441+0000","last_undegraded":"2023-09-13T06:02:53.533441+0000","last_fullsized":"2023-09-13T06:02:53.533441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-09-13T06:02:51.535693+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:02:51.535693+0000","last_peered":"2023-09-13T06:02:51.535693+0000","last_clean":"2023-09-13T06:02:51.535693+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:02:51.535693+0000","last_undegraded":"2023-09-13T06:02:51.535693+0000","last_fullsized":"2023-09-13T06:02:51.535693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":760,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194551,"statfs":{"total":200000000,"available":199221180,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.73999999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.63500000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76900000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.89400000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.83599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":184,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195128,"statfs":{"total":200000000,"available":199811548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.65600000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67000000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.754},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.70299999999999996}]},{"osd":4,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48999999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.50800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":184,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195128,"statfs":{"total":200000000,"available":199811548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.65200000000000002}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.84099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.621},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.89000000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.78400000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81799999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.751}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":184,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195128,"statfs":{"total":200000000,"available":199811548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.78300000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.621},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.83999999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68799999999999994}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.872},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.72099999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.89400000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.80700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.628},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.60199999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.5}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.41399999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.505}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.371},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.88700000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.91300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786319,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.48799999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.2150000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.878},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.1140000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":1.2769999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195987,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40000000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.627}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.53000000000000003}]}]}],"pool_statfs":[]}} 2023-09-13T06:03:00.034 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:03:00.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40acffa640 1 Processor -- start 2023-09-13T06:03:00.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40acffa640 1 -- start start 2023-09-13T06:03:00.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40acffa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f40a80d1090 0x7f40a815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40acffa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40a8146f30 0x7f40a80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40acffa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a80b63c0 con 0x7f40a80d1750 2023-09-13T06:03:00.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40acffa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a815dea0 con 0x7f40a80d1090 2023-09-13T06:03:00.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40acffa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80d0c20 con 0x7f40a8146f30 2023-09-13T06:03:00.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a659c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f40a80d1750 0x7f40a8146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59746/0 (socket says 172.21.15.130:59746) 2023-09-13T06:03:00.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a659c640 1 -- 172.21.15.130:0/3699466346 learned_addr learned my addr 172.21.15.130:0/3699466346 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:00.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f409dd9b640 1 --2- 172.21.15.130:0/3699466346 >> v2:172.21.15.164:3300/0 conn(0x7f40a80d1090 0x7f40a815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a6d9d640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40a8146f30 0x7f40a80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542697347 0 0) 0x7f40a80b63c0 con 0x7f40a80d1750 2023-09-13T06:03:00.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4094003530 con 0x7f40a80d1750 2023-09-13T06:03:00.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3882776017 0 0) 0x7f4094003530 con 0x7f40a80d1750 2023-09-13T06:03:00.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40a8146f30 msgr2=0x7f40a80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:00.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40a8146f30 0x7f40a80b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 >> v2:172.21.15.164:3300/0 conn(0x7f40a80d1090 msgr2=0x7f40a815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 --2- 172.21.15.130:0/3699466346 >> v2:172.21.15.164:3300/0 conn(0x7f40a80d1090 0x7f40a815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a80b6610 con 0x7f40a80d1750 2023-09-13T06:03:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f4090001680 con 0x7f40a80d1750 2023-09-13T06:03:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 >> v1:172.21.15.130:6789/0 conn(0x7f40a80d1750 legacy=0x7f40a8146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40940039f0 0x7f4094003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40940047d0 0x7f4094004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40a8146f30 0x7f4094005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80d0c20 con 0x7f40940039f0 2023-09-13T06:03:00.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409400b990 con 0x7f40940047d0 2023-09-13T06:03:00.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409400bb20 con 0x7f40a8146f30 2023-09-13T06:03:00.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f409dd9b640 1 --2- 172.21.15.130:0/3699466346 >> v2:172.21.15.164:3300/0 conn(0x7f40a80d1090 0x7f40a815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:00.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a659c640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40940039f0 0x7f4094003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a6d9d640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40a8146f30 0x7f4094005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f409dd9b640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40940047d0 0x7f4094004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a659c640 1 -- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40a8146f30 msgr2=0x7f4094005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:00.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a659c640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40a8146f30 0x7f4094005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a659c640 1 -- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40940047d0 msgr2=0x7f4094004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:00.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a659c640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40940047d0 0x7f4094004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a659c640 1 -- 172.21.15.130:0/3699466346 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4094003530 con 0x7f40940039f0 2023-09-13T06:03:00.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.207+0000 7f40a6d9d640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40a8146f30 0x7f4094005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:00.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.211+0000 7f40a659c640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40940039f0 0x7f4094003e10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f409000c140 tx=0x7f409001cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb239c3d314223f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:00.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.211+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900058e0 con 0x7f40940039f0 2023-09-13T06:03:00.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.211+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4090005a60 con 0x7f40940039f0 2023-09-13T06:03:00.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.211+0000 7f40a5d9b640 1 -- 172.21.15.130:0/3699466346 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090005e10 con 0x7f40940039f0 2023-09-13T06:03:00.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.211+0000 7f40acffa640 1 -- 172.21.15.130:0/3699466346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40940039f0 msgr2=0x7f4094003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.211+0000 7f40acffa640 1 --2- 172.21.15.130:0/3699466346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40940039f0 0x7f4094003e10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f409000c140 tx=0x7f409001cb50 comp rx=0 tx=0).stop 2023-09-13T06:03:00.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.211+0000 7f40a6d9d640 1 -- 172.21.15.130:0/3699466346 reap_dead start 2023-09-13T06:03:00.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.211+0000 7f40acffa640 1 -- 172.21.15.130:0/3699466346 shutdown_connections 2023-09-13T06:03:00.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.211+0000 7f40acffa640 1 -- 172.21.15.130:0/3699466346 >> 172.21.15.130:0/3699466346 conn(0x7f40a806f170 msgr2=0x7f40a806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:00.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.211+0000 7f40acffa640 1 -- 172.21.15.130:0/3699466346 shutdown_connections 2023-09-13T06:03:00.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.211+0000 7f40acffa640 1 -- 172.21.15.130:0/3699466346 wait complete. 2023-09-13T06:03:00.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40acffa640 1 Processor -- start 2023-09-13T06:03:00.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40acffa640 1 -- start start 2023-09-13T06:03:00.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40acffa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40940039f0 0x7f40a81f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40acffa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40a81407a0 0x7f40a815caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40acffa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a80705d0 0x7f40a8070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40acffa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8070f90 con 0x7f40a80705d0 2023-09-13T06:03:00.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40acffa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81fa130 con 0x7f40a81407a0 2023-09-13T06:03:00.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40acffa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80c9260 con 0x7f40940039f0 2023-09-13T06:03:00.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40a6d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a80705d0 0x7f40a8070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40a6d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a80705d0 0x7f40a8070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52188/0 (socket says 172.21.15.130:52188) 2023-09-13T06:03:00.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40a6d9d640 1 -- 172.21.15.130:0/112090727 learned_addr learned my addr 172.21.15.130:0/112090727 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:00.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f409dd9b640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40a81407a0 0x7f40a815caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40a659c640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40940039f0 0x7f40a81f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40a6d9d640 1 -- 172.21.15.130:0/112090727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40940039f0 msgr2=0x7f40a81f9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40a6d9d640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40940039f0 0x7f40a81f9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40a6d9d640 1 -- 172.21.15.130:0/112090727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40a81407a0 msgr2=0x7f40a815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40a6d9d640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40a81407a0 0x7f40a815caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40a6d9d640 1 -- 172.21.15.130:0/112090727 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a80c9540 con 0x7f40a80705d0 2023-09-13T06:03:00.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40a6d9d640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a80705d0 0x7f40a8070a50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f40a80c8330 tx=0x7f40a0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:00.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f409f7fe640 1 -- 172.21.15.130:0/112090727 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000e050 con 0x7f40a80705d0 2023-09-13T06:03:00.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f409f7fe640 1 -- 172.21.15.130:0/112090727 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a000f040 con 0x7f40a80705d0 2023-09-13T06:03:00.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40acffa640 1 -- 172.21.15.130:0/112090727 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a80c9820 con 0x7f40a80705d0 2023-09-13T06:03:00.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f409f7fe640 1 -- 172.21.15.130:0/112090727 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a00039a0 con 0x7f40a80705d0 2023-09-13T06:03:00.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.215+0000 7f40acffa640 1 -- 172.21.15.130:0/112090727 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a81644a0 con 0x7f40a80705d0 2023-09-13T06:03:00.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.219+0000 7f40acffa640 1 -- 172.21.15.130:0/112090727 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a80c9a10 con 0x7f40a80705d0 2023-09-13T06:03:00.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.219+0000 7f409f7fe640 1 -- 172.21.15.130:0/112090727 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f40a0015440 con 0x7f40a80705d0 2023-09-13T06:03:00.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.219+0000 7f409f7fe640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4088065b20 0x7f4088067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.219+0000 7f409f7fe640 1 -- 172.21.15.130:0/112090727 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40a0083ce0 con 0x7f40a80705d0 2023-09-13T06:03:00.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.219+0000 7f40a659c640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4088065b20 0x7f4088067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.219+0000 7f40a659c640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4088065b20 0x7f4088067fe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f40900aa000 tx=0x7f40900019b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:00.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.223+0000 7f409f7fe640 1 -- 172.21.15.130:0/112090727 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f40a80c9a10 con 0x7f40a80705d0 2023-09-13T06:03:00.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.367+0000 7f40acffa640 1 -- 172.21.15.130:0/112090727 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40a80c93d0 con 0x7f4088065b20 2023-09-13T06:03:00.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.375+0000 7f409f7fe640 1 -- 172.21.15.130:0/112090727 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280209 (secure 0 0 0) 0x7f40a80c93d0 con 0x7f4088065b20 2023-09-13T06:03:00.383 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:00.385 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:03:00.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 -- 172.21.15.130:0/112090727 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4088065b20 msgr2=0x7f4088067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4088065b20 0x7f4088067fe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f40900aa000 tx=0x7f40900019b0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 -- 172.21.15.130:0/112090727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a80705d0 msgr2=0x7f40a8070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a80705d0 0x7f40a8070a50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f40a80c8330 tx=0x7f40a0010590 comp rx=0 tx=0).stop 2023-09-13T06:03:00.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 -- 172.21.15.130:0/112090727 shutdown_connections 2023-09-13T06:03:00.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4088065b20 0x7f4088067fe0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40a81407a0 0x7f40a815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a80705d0 0x7f40a8070a50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 --2- 172.21.15.130:0/112090727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40940039f0 0x7f40a81f9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 -- 172.21.15.130:0/112090727 >> 172.21.15.130:0/112090727 conn(0x7f40a806f170 msgr2=0x7f40a815dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:00.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 -- 172.21.15.130:0/112090727 shutdown_connections 2023-09-13T06:03:00.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.379+0000 7f40acffa640 1 -- 172.21.15.130:0/112090727 wait complete. 2023-09-13T06:03:00.402 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-09-13T06:02:58.553546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2725,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559774,"statfs":{"total":1600000000,"available":1597208636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.019523"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154162+0000","last_change":"2023-09-13T06:02:55.576304+0000","last_active":"2023-09-13T06:02:57.154162+0000","last_peered":"2023-09-13T06:02:57.154162+0000","last_clean":"2023-09-13T06:02:57.154162+0000","last_became_active":"2023-09-13T06:02:55.576093+0000","last_became_peered":"2023-09-13T06:02:55.576093+0000","last_unstale":"2023-09-13T06:02:57.154162+0000","last_undegraded":"2023-09-13T06:02:57.154162+0000","last_fullsized":"2023-09-13T06:02:57.154162+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:16:23.458455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560881+0000","last_change":"2023-09-13T06:02:55.566320+0000","last_active":"2023-09-13T06:02:56.560881+0000","last_peered":"2023-09-13T06:02:56.560881+0000","last_clean":"2023-09-13T06:02:56.560881+0000","last_became_active":"2023-09-13T06:02:55.565921+0000","last_became_peered":"2023-09-13T06:02:55.565921+0000","last_unstale":"2023-09-13T06:02:56.560881+0000","last_undegraded":"2023-09-13T06:02:56.560881+0000","last_fullsized":"2023-09-13T06:02:56.560881+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:33:20.937865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153727+0000","last_change":"2023-09-13T06:02:55.573024+0000","last_active":"2023-09-13T06:02:57.153727+0000","last_peered":"2023-09-13T06:02:57.153727+0000","last_clean":"2023-09-13T06:02:57.153727+0000","last_became_active":"2023-09-13T06:02:55.572812+0000","last_became_peered":"2023-09-13T06:02:55.572812+0000","last_unstale":"2023-09-13T06:02:57.153727+0000","last_undegraded":"2023-09-13T06:02:57.153727+0000","last_fullsized":"2023-09-13T06:02:57.153727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:54.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154313+0000","last_change":"2023-09-13T06:02:55.571715+0000","last_active":"2023-09-13T06:02:57.154313+0000","last_peered":"2023-09-13T06:02:57.154313+0000","last_clean":"2023-09-13T06:02:57.154313+0000","last_became_active":"2023-09-13T06:02:55.571192+0000","last_became_peered":"2023-09-13T06:02:55.571192+0000","last_unstale":"2023-09-13T06:02:57.154313+0000","last_undegraded":"2023-09-13T06:02:57.154313+0000","last_fullsized":"2023-09-13T06:02:57.154313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:17:43.885392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153946+0000","last_change":"2023-09-13T06:02:55.575986+0000","last_active":"2023-09-13T06:02:57.153946+0000","last_peered":"2023-09-13T06:02:57.153946+0000","last_clean":"2023-09-13T06:02:57.153946+0000","last_became_active":"2023-09-13T06:02:55.575791+0000","last_became_peered":"2023-09-13T06:02:55.575791+0000","last_unstale":"2023-09-13T06:02:57.153946+0000","last_undegraded":"2023-09-13T06:02:57.153946+0000","last_fullsized":"2023-09-13T06:02:57.153946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:30.054070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154032+0000","last_change":"2023-09-13T06:02:55.565063+0000","last_active":"2023-09-13T06:02:57.154032+0000","last_peered":"2023-09-13T06:02:57.154032+0000","last_clean":"2023-09-13T06:02:57.154032+0000","last_became_active":"2023-09-13T06:02:55.564847+0000","last_became_peered":"2023-09-13T06:02:55.564847+0000","last_unstale":"2023-09-13T06:02:57.154032+0000","last_undegraded":"2023-09-13T06:02:57.154032+0000","last_fullsized":"2023-09-13T06:02:57.154032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:48.470117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153708+0000","last_change":"2023-09-13T06:02:55.569821+0000","last_active":"2023-09-13T06:02:57.153708+0000","last_peered":"2023-09-13T06:02:57.153708+0000","last_clean":"2023-09-13T06:02:57.153708+0000","last_became_active":"2023-09-13T06:02:55.569596+0000","last_became_peered":"2023-09-13T06:02:55.569596+0000","last_unstale":"2023-09-13T06:02:57.153708+0000","last_undegraded":"2023-09-13T06:02:57.153708+0000","last_fullsized":"2023-09-13T06:02:57.153708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:17:55.915552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154649+0000","last_change":"2023-09-13T06:02:55.571859+0000","last_active":"2023-09-13T06:02:57.154649+0000","last_peered":"2023-09-13T06:02:57.154649+0000","last_clean":"2023-09-13T06:02:57.154649+0000","last_became_active":"2023-09-13T06:02:55.571512+0000","last_became_peered":"2023-09-13T06:02:55.571512+0000","last_unstale":"2023-09-13T06:02:57.154649+0000","last_undegraded":"2023-09-13T06:02:57.154649+0000","last_fullsized":"2023-09-13T06:02:57.154649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:03:57.908839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560750+0000","last_change":"2023-09-13T06:02:55.566258+0000","last_active":"2023-09-13T06:02:56.560750+0000","last_peered":"2023-09-13T06:02:56.560750+0000","last_clean":"2023-09-13T06:02:56.560750+0000","last_became_active":"2023-09-13T06:02:55.566046+0000","last_became_peered":"2023-09-13T06:02:55.566046+0000","last_unstale":"2023-09-13T06:02:56.560750+0000","last_undegraded":"2023-09-13T06:02:56.560750+0000","last_fullsized":"2023-09-13T06:02:56.560750+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:23:02.216766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153771+0000","last_change":"2023-09-13T06:02:55.573245+0000","last_active":"2023-09-13T06:02:57.153771+0000","last_peered":"2023-09-13T06:02:57.153771+0000","last_clean":"2023-09-13T06:02:57.153771+0000","last_became_active":"2023-09-13T06:02:55.573014+0000","last_became_peered":"2023-09-13T06:02:55.573014+0000","last_unstale":"2023-09-13T06:02:57.153771+0000","last_undegraded":"2023-09-13T06:02:57.153771+0000","last_fullsized":"2023-09-13T06:02:57.153771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:24:16.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561006+0000","last_change":"2023-09-13T06:02:55.570152+0000","last_active":"2023-09-13T06:02:56.561006+0000","last_peered":"2023-09-13T06:02:56.561006+0000","last_clean":"2023-09-13T06:02:56.561006+0000","last_became_active":"2023-09-13T06:02:55.569932+0000","last_became_peered":"2023-09-13T06:02:55.569932+0000","last_unstale":"2023-09-13T06:02:56.561006+0000","last_undegraded":"2023-09-13T06:02:56.561006+0000","last_fullsized":"2023-09-13T06:02:56.561006+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:31:37.037162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154101+0000","last_change":"2023-09-13T06:02:55.576177+0000","last_active":"2023-09-13T06:02:57.154101+0000","last_peered":"2023-09-13T06:02:57.154101+0000","last_clean":"2023-09-13T06:02:57.154101+0000","last_became_active":"2023-09-13T06:02:55.575860+0000","last_became_peered":"2023-09-13T06:02:55.575860+0000","last_unstale":"2023-09-13T06:02:57.154101+0000","last_undegraded":"2023-09-13T06:02:57.154101+0000","last_fullsized":"2023-09-13T06:02:57.154101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:52.140701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153836+0000","last_change":"2023-09-13T06:02:55.573937+0000","last_active":"2023-09-13T06:02:57.153836+0000","last_peered":"2023-09-13T06:02:57.153836+0000","last_clean":"2023-09-13T06:02:57.153836+0000","last_became_active":"2023-09-13T06:02:55.573729+0000","last_became_peered":"2023-09-13T06:02:55.573729+0000","last_unstale":"2023-09-13T06:02:57.153836+0000","last_undegraded":"2023-09-13T06:02:57.153836+0000","last_fullsized":"2023-09-13T06:02:57.153836+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:34:29.520875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561115+0000","last_change":"2023-09-13T06:02:55.566159+0000","last_active":"2023-09-13T06:02:56.561115+0000","last_peered":"2023-09-13T06:02:56.561115+0000","last_clean":"2023-09-13T06:02:56.561115+0000","last_became_active":"2023-09-13T06:02:55.565600+0000","last_became_peered":"2023-09-13T06:02:55.565600+0000","last_unstale":"2023-09-13T06:02:56.561115+0000","last_undegraded":"2023-09-13T06:02:56.561115+0000","last_fullsized":"2023-09-13T06:02:56.561115+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:21:14.123686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153705+0000","last_change":"2023-09-13T06:02:55.571221+0000","last_active":"2023-09-13T06:02:57.153705+0000","last_peered":"2023-09-13T06:02:57.153705+0000","last_clean":"2023-09-13T06:02:57.153705+0000","last_became_active":"2023-09-13T06:02:55.571005+0000","last_became_peered":"2023-09-13T06:02:55.571005+0000","last_unstale":"2023-09-13T06:02:57.153705+0000","last_undegraded":"2023-09-13T06:02:57.153705+0000","last_fullsized":"2023-09-13T06:02:57.153705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:48.044030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115239+0000","last_change":"2023-09-13T06:02:55.569767+0000","last_active":"2023-09-13T06:02:57.115239+0000","last_peered":"2023-09-13T06:02:57.115239+0000","last_clean":"2023-09-13T06:02:57.115239+0000","last_became_active":"2023-09-13T06:02:55.569428+0000","last_became_peered":"2023-09-13T06:02:55.569428+0000","last_unstale":"2023-09-13T06:02:57.115239+0000","last_undegraded":"2023-09-13T06:02:57.115239+0000","last_fullsized":"2023-09-13T06:02:57.115239+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:33.201660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588141+0000","last_change":"2023-09-13T06:02:54.553420+0000","last_active":"2023-09-13T06:02:55.588141+0000","last_peered":"2023-09-13T06:02:55.588141+0000","last_clean":"2023-09-13T06:02:55.588141+0000","last_became_active":"2023-09-13T06:02:54.553123+0000","last_became_peered":"2023-09-13T06:02:54.553123+0000","last_unstale":"2023-09-13T06:02:55.588141+0000","last_undegraded":"2023-09-13T06:02:55.588141+0000","last_fullsized":"2023-09-13T06:02:55.588141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:13:21.882042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538877+0000","last_change":"2023-09-13T06:02:53.538877+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538877+0000","last_undegraded":"2023-09-13T06:02:53.538877+0000","last_fullsized":"2023-09-13T06:02:53.538877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588197+0000","last_change":"2023-09-13T06:02:54.547570+0000","last_active":"2023-09-13T06:02:55.588197+0000","last_peered":"2023-09-13T06:02:55.588197+0000","last_clean":"2023-09-13T06:02:55.588197+0000","last_became_active":"2023-09-13T06:02:54.546154+0000","last_became_peered":"2023-09-13T06:02:54.546154+0000","last_unstale":"2023-09-13T06:02:55.588197+0000","last_undegraded":"2023-09-13T06:02:55.588197+0000","last_fullsized":"2023-09-13T06:02:55.588197+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115288+0000","last_change":"2023-09-13T06:02:55.571812+0000","last_active":"2023-09-13T06:02:57.115288+0000","last_peered":"2023-09-13T06:02:57.115288+0000","last_clean":"2023-09-13T06:02:57.115288+0000","last_became_active":"2023-09-13T06:02:55.571348+0000","last_became_peered":"2023-09-13T06:02:55.571348+0000","last_unstale":"2023-09-13T06:02:57.115288+0000","last_undegraded":"2023-09-13T06:02:57.115288+0000","last_fullsized":"2023-09-13T06:02:57.115288+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:28.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534663+0000","last_change":"2023-09-13T06:02:53.534663+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534663+0000","last_undegraded":"2023-09-13T06:02:53.534663+0000","last_fullsized":"2023-09-13T06:02:53.534663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.586558+0000","last_change":"2023-09-13T06:02:54.542145+0000","last_active":"2023-09-13T06:02:55.586558+0000","last_peered":"2023-09-13T06:02:55.586558+0000","last_clean":"2023-09-13T06:02:55.586558+0000","last_became_active":"2023-09-13T06:02:54.541895+0000","last_became_peered":"2023-09-13T06:02:54.541895+0000","last_unstale":"2023-09-13T06:02:55.586558+0000","last_undegraded":"2023-09-13T06:02:55.586558+0000","last_fullsized":"2023-09-13T06:02:55.586558+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:29.046660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154185+0000","last_change":"2023-09-13T06:02:55.573275+0000","last_active":"2023-09-13T06:02:57.154185+0000","last_peered":"2023-09-13T06:02:57.154185+0000","last_clean":"2023-09-13T06:02:57.154185+0000","last_became_active":"2023-09-13T06:02:55.572872+0000","last_became_peered":"2023-09-13T06:02:55.572872+0000","last_unstale":"2023-09-13T06:02:57.154185+0000","last_undegraded":"2023-09-13T06:02:57.154185+0000","last_fullsized":"2023-09-13T06:02:57.154185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:27.803689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538868+0000","last_change":"2023-09-13T06:02:53.538868+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538868+0000","last_undegraded":"2023-09-13T06:02:53.538868+0000","last_fullsized":"2023-09-13T06:02:53.538868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154083+0000","last_change":"2023-09-13T06:02:55.573786+0000","last_active":"2023-09-13T06:02:57.154083+0000","last_peered":"2023-09-13T06:02:57.154083+0000","last_clean":"2023-09-13T06:02:57.154083+0000","last_became_active":"2023-09-13T06:02:55.573021+0000","last_became_peered":"2023-09-13T06:02:55.573021+0000","last_unstale":"2023-09-13T06:02:57.154083+0000","last_undegraded":"2023-09-13T06:02:57.154083+0000","last_fullsized":"2023-09-13T06:02:57.154083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:39.312149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534026+0000","last_change":"2023-09-13T06:02:53.534026+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534026+0000","last_undegraded":"2023-09-13T06:02:53.534026+0000","last_fullsized":"2023-09-13T06:02:53.534026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563741+0000","last_change":"2023-09-13T06:02:54.555524+0000","last_active":"2023-09-13T06:02:55.563741+0000","last_peered":"2023-09-13T06:02:55.563741+0000","last_clean":"2023-09-13T06:02:55.563741+0000","last_became_active":"2023-09-13T06:02:54.554282+0000","last_became_peered":"2023-09-13T06:02:54.554282+0000","last_unstale":"2023-09-13T06:02:55.563741+0000","last_undegraded":"2023-09-13T06:02:55.563741+0000","last_fullsized":"2023-09-13T06:02:55.563741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:12:41.106016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538844+0000","last_change":"2023-09-13T06:02:53.538844+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538844+0000","last_undegraded":"2023-09-13T06:02:53.538844+0000","last_fullsized":"2023-09-13T06:02:53.538844+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.562440+0000","last_change":"2023-09-13T06:02:54.550521+0000","last_active":"2023-09-13T06:02:55.562440+0000","last_peered":"2023-09-13T06:02:55.562440+0000","last_clean":"2023-09-13T06:02:55.562440+0000","last_became_active":"2023-09-13T06:02:54.550233+0000","last_became_peered":"2023-09-13T06:02:54.550233+0000","last_unstale":"2023-09-13T06:02:55.562440+0000","last_undegraded":"2023-09-13T06:02:55.562440+0000","last_fullsized":"2023-09-13T06:02:55.562440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:11:28.345524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560882+0000","last_change":"2023-09-13T06:02:55.572306+0000","last_active":"2023-09-13T06:02:56.560882+0000","last_peered":"2023-09-13T06:02:56.560882+0000","last_clean":"2023-09-13T06:02:56.560882+0000","last_became_active":"2023-09-13T06:02:55.571811+0000","last_became_peered":"2023-09-13T06:02:55.571811+0000","last_unstale":"2023-09-13T06:02:56.560882+0000","last_undegraded":"2023-09-13T06:02:56.560882+0000","last_fullsized":"2023-09-13T06:02:56.560882+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:44.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534005+0000","last_change":"2023-09-13T06:02:53.534005+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534005+0000","last_undegraded":"2023-09-13T06:02:53.534005+0000","last_fullsized":"2023-09-13T06:02:53.534005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588927+0000","last_change":"2023-09-13T06:02:54.549352+0000","last_active":"2023-09-13T06:02:55.588927+0000","last_peered":"2023-09-13T06:02:55.588927+0000","last_clean":"2023-09-13T06:02:55.588927+0000","last_became_active":"2023-09-13T06:02:54.549113+0000","last_became_peered":"2023-09-13T06:02:54.549113+0000","last_unstale":"2023-09-13T06:02:55.588927+0000","last_undegraded":"2023-09-13T06:02:55.588927+0000","last_fullsized":"2023-09-13T06:02:55.588927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:08:58.059162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587540+0000","last_change":"2023-09-13T06:02:54.548194+0000","last_active":"2023-09-13T06:02:55.587540+0000","last_peered":"2023-09-13T06:02:55.587540+0000","last_clean":"2023-09-13T06:02:55.587540+0000","last_became_active":"2023-09-13T06:02:54.547973+0000","last_became_peered":"2023-09-13T06:02:54.547973+0000","last_unstale":"2023-09-13T06:02:55.587540+0000","last_undegraded":"2023-09-13T06:02:55.587540+0000","last_fullsized":"2023-09-13T06:02:55.587540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:36.921705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154163+0000","last_change":"2023-09-13T06:02:55.567612+0000","last_active":"2023-09-13T06:02:57.154163+0000","last_peered":"2023-09-13T06:02:57.154163+0000","last_clean":"2023-09-13T06:02:57.154163+0000","last_became_active":"2023-09-13T06:02:55.567338+0000","last_became_peered":"2023-09-13T06:02:55.567338+0000","last_unstale":"2023-09-13T06:02:57.154163+0000","last_undegraded":"2023-09-13T06:02:57.154163+0000","last_fullsized":"2023-09-13T06:02:57.154163+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:26:27.736729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.534356+0000","last_change":"2023-09-13T06:02:53.534356+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.534356+0000","last_undegraded":"2023-09-13T06:02:53.534356+0000","last_fullsized":"2023-09-13T06:02:53.534356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560705+0000","last_change":"2023-09-13T06:02:55.571558+0000","last_active":"2023-09-13T06:02:56.560705+0000","last_peered":"2023-09-13T06:02:56.560705+0000","last_clean":"2023-09-13T06:02:56.560705+0000","last_became_active":"2023-09-13T06:02:55.571251+0000","last_became_peered":"2023-09-13T06:02:55.571251+0000","last_unstale":"2023-09-13T06:02:56.560705+0000","last_undegraded":"2023-09-13T06:02:56.560705+0000","last_fullsized":"2023-09-13T06:02:56.560705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:03:57.908839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559344+0000","last_change":"2023-09-13T06:02:54.548947+0000","last_active":"2023-09-13T06:02:55.559344+0000","last_peered":"2023-09-13T06:02:55.559344+0000","last_clean":"2023-09-13T06:02:55.559344+0000","last_became_active":"2023-09-13T06:02:54.548729+0000","last_became_peered":"2023-09-13T06:02:54.548729+0000","last_unstale":"2023-09-13T06:02:55.559344+0000","last_undegraded":"2023-09-13T06:02:55.559344+0000","last_fullsized":"2023-09-13T06:02:55.559344+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:38.304740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588745+0000","last_change":"2023-09-13T06:02:54.549606+0000","last_active":"2023-09-13T06:02:55.588745+0000","last_peered":"2023-09-13T06:02:55.588745+0000","last_clean":"2023-09-13T06:02:55.588745+0000","last_became_active":"2023-09-13T06:02:54.549385+0000","last_became_peered":"2023-09-13T06:02:54.549385+0000","last_unstale":"2023-09-13T06:02:55.588745+0000","last_undegraded":"2023-09-13T06:02:55.588745+0000","last_fullsized":"2023-09-13T06:02:55.588745+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153897+0000","last_change":"2023-09-13T06:02:55.570594+0000","last_active":"2023-09-13T06:02:57.153897+0000","last_peered":"2023-09-13T06:02:57.153897+0000","last_clean":"2023-09-13T06:02:57.153897+0000","last_became_active":"2023-09-13T06:02:55.570387+0000","last_became_peered":"2023-09-13T06:02:55.570387+0000","last_unstale":"2023-09-13T06:02:57.153897+0000","last_undegraded":"2023-09-13T06:02:57.153897+0000","last_fullsized":"2023-09-13T06:02:57.153897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:30:42.957097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.584236+0000","last_change":"2023-09-13T06:02:54.543232+0000","last_active":"2023-09-13T06:02:55.584236+0000","last_peered":"2023-09-13T06:02:55.584236+0000","last_clean":"2023-09-13T06:02:55.584236+0000","last_became_active":"2023-09-13T06:02:54.542975+0000","last_became_peered":"2023-09-13T06:02:54.542975+0000","last_unstale":"2023-09-13T06:02:55.584236+0000","last_undegraded":"2023-09-13T06:02:55.584236+0000","last_fullsized":"2023-09-13T06:02:55.584236+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:35:14.538719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154448+0000","last_change":"2023-09-13T06:02:55.568883+0000","last_active":"2023-09-13T06:02:57.154448+0000","last_peered":"2023-09-13T06:02:57.154448+0000","last_clean":"2023-09-13T06:02:57.154448+0000","last_became_active":"2023-09-13T06:02:55.568626+0000","last_became_peered":"2023-09-13T06:02:55.568626+0000","last_unstale":"2023-09-13T06:02:57.154448+0000","last_undegraded":"2023-09-13T06:02:57.154448+0000","last_fullsized":"2023-09-13T06:02:57.154448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538865+0000","last_change":"2023-09-13T06:02:53.538865+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538865+0000","last_undegraded":"2023-09-13T06:02:53.538865+0000","last_fullsized":"2023-09-13T06:02:53.538865+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533468+0000","last_change":"2023-09-13T06:02:53.533468+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533468+0000","last_undegraded":"2023-09-13T06:02:53.533468+0000","last_fullsized":"2023-09-13T06:02:53.533468+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559471+0000","last_change":"2023-09-13T06:02:54.551437+0000","last_active":"2023-09-13T06:02:55.559471+0000","last_peered":"2023-09-13T06:02:55.559471+0000","last_clean":"2023-09-13T06:02:55.559471+0000","last_became_active":"2023-09-13T06:02:54.551207+0000","last_became_peered":"2023-09-13T06:02:54.551207+0000","last_unstale":"2023-09-13T06:02:55.559471+0000","last_undegraded":"2023-09-13T06:02:55.559471+0000","last_fullsized":"2023-09-13T06:02:55.559471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:16:22.451045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560697+0000","last_change":"2023-09-13T06:02:55.572167+0000","last_active":"2023-09-13T06:02:56.560697+0000","last_peered":"2023-09-13T06:02:56.560697+0000","last_clean":"2023-09-13T06:02:56.560697+0000","last_became_active":"2023-09-13T06:02:55.571528+0000","last_became_peered":"2023-09-13T06:02:55.571528+0000","last_unstale":"2023-09-13T06:02:56.560697+0000","last_undegraded":"2023-09-13T06:02:56.560697+0000","last_fullsized":"2023-09-13T06:02:56.560697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587418+0000","last_change":"2023-09-13T06:02:54.542740+0000","last_active":"2023-09-13T06:02:55.587418+0000","last_peered":"2023-09-13T06:02:55.587418+0000","last_clean":"2023-09-13T06:02:55.587418+0000","last_became_active":"2023-09-13T06:02:54.542497+0000","last_became_peered":"2023-09-13T06:02:54.542497+0000","last_unstale":"2023-09-13T06:02:55.587418+0000","last_undegraded":"2023-09-13T06:02:55.587418+0000","last_fullsized":"2023-09-13T06:02:55.587418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:47.462707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115118+0000","last_change":"2023-09-13T06:02:55.567745+0000","last_active":"2023-09-13T06:02:57.115118+0000","last_peered":"2023-09-13T06:02:57.115118+0000","last_clean":"2023-09-13T06:02:57.115118+0000","last_became_active":"2023-09-13T06:02:55.567535+0000","last_became_peered":"2023-09-13T06:02:55.567535+0000","last_unstale":"2023-09-13T06:02:57.115118+0000","last_undegraded":"2023-09-13T06:02:57.115118+0000","last_fullsized":"2023-09-13T06:02:57.115118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:52:17.036879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533656+0000","last_change":"2023-09-13T06:02:53.533656+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533656+0000","last_undegraded":"2023-09-13T06:02:53.533656+0000","last_fullsized":"2023-09-13T06:02:53.533656+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153959+0000","last_change":"2023-09-13T06:02:55.574403+0000","last_active":"2023-09-13T06:02:57.153959+0000","last_peered":"2023-09-13T06:02:57.153959+0000","last_clean":"2023-09-13T06:02:57.153959+0000","last_became_active":"2023-09-13T06:02:55.574180+0000","last_became_peered":"2023-09-13T06:02:55.574180+0000","last_unstale":"2023-09-13T06:02:57.153959+0000","last_undegraded":"2023-09-13T06:02:57.153959+0000","last_fullsized":"2023-09-13T06:02:57.153959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:34:30.195506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563869+0000","last_change":"2023-09-13T06:02:54.551857+0000","last_active":"2023-09-13T06:02:55.563869+0000","last_peered":"2023-09-13T06:02:55.563869+0000","last_clean":"2023-09-13T06:02:55.563869+0000","last_became_active":"2023-09-13T06:02:54.551624+0000","last_became_peered":"2023-09-13T06:02:54.551624+0000","last_unstale":"2023-09-13T06:02:55.563869+0000","last_undegraded":"2023-09-13T06:02:55.563869+0000","last_fullsized":"2023-09-13T06:02:55.563869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:36:43.156835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154247+0000","last_change":"2023-09-13T06:02:55.567084+0000","last_active":"2023-09-13T06:02:57.154247+0000","last_peered":"2023-09-13T06:02:57.154247+0000","last_clean":"2023-09-13T06:02:57.154247+0000","last_became_active":"2023-09-13T06:02:55.566832+0000","last_became_peered":"2023-09-13T06:02:55.566832+0000","last_unstale":"2023-09-13T06:02:57.154247+0000","last_undegraded":"2023-09-13T06:02:57.154247+0000","last_fullsized":"2023-09-13T06:02:57.154247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:31:40.315456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533918+0000","last_change":"2023-09-13T06:02:53.533918+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533918+0000","last_undegraded":"2023-09-13T06:02:53.533918+0000","last_fullsized":"2023-09-13T06:02:53.533918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559374+0000","last_change":"2023-09-13T06:02:54.550539+0000","last_active":"2023-09-13T06:02:55.559374+0000","last_peered":"2023-09-13T06:02:55.559374+0000","last_clean":"2023-09-13T06:02:55.559374+0000","last_became_active":"2023-09-13T06:02:54.550282+0000","last_became_peered":"2023-09-13T06:02:54.550282+0000","last_unstale":"2023-09-13T06:02:55.559374+0000","last_undegraded":"2023-09-13T06:02:55.559374+0000","last_fullsized":"2023-09-13T06:02:55.559374+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:51.133291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154322+0000","last_change":"2023-09-13T06:02:55.573567+0000","last_active":"2023-09-13T06:02:57.154322+0000","last_peered":"2023-09-13T06:02:57.154322+0000","last_clean":"2023-09-13T06:02:57.154322+0000","last_became_active":"2023-09-13T06:02:55.572708+0000","last_became_peered":"2023-09-13T06:02:55.572708+0000","last_unstale":"2023-09-13T06:02:57.154322+0000","last_undegraded":"2023-09-13T06:02:57.154322+0000","last_fullsized":"2023-09-13T06:02:57.154322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:47.080838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533415+0000","last_change":"2023-09-13T06:02:53.533415+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533415+0000","last_undegraded":"2023-09-13T06:02:53.533415+0000","last_fullsized":"2023-09-13T06:02:53.533415+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563170+0000","last_change":"2023-09-13T06:02:54.547697+0000","last_active":"2023-09-13T06:02:55.563170+0000","last_peered":"2023-09-13T06:02:55.563170+0000","last_clean":"2023-09-13T06:02:55.563170+0000","last_became_active":"2023-09-13T06:02:54.546477+0000","last_became_peered":"2023-09-13T06:02:54.546477+0000","last_unstale":"2023-09-13T06:02:55.563170+0000","last_undegraded":"2023-09-13T06:02:55.563170+0000","last_fullsized":"2023-09-13T06:02:55.563170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:32:16.554135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560725+0000","last_change":"2023-09-13T06:02:55.564878+0000","last_active":"2023-09-13T06:02:56.560725+0000","last_peered":"2023-09-13T06:02:56.560725+0000","last_clean":"2023-09-13T06:02:56.560725+0000","last_became_active":"2023-09-13T06:02:55.564647+0000","last_became_peered":"2023-09-13T06:02:55.564647+0000","last_unstale":"2023-09-13T06:02:56.560725+0000","last_undegraded":"2023-09-13T06:02:56.560725+0000","last_fullsized":"2023-09-13T06:02:56.560725+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:39.317324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533406+0000","last_change":"2023-09-13T06:02:53.533406+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533406+0000","last_undegraded":"2023-09-13T06:02:53.533406+0000","last_fullsized":"2023-09-13T06:02:53.533406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561187+0000","last_change":"2023-09-13T06:02:55.570627+0000","last_active":"2023-09-13T06:02:56.561187+0000","last_peered":"2023-09-13T06:02:56.561187+0000","last_clean":"2023-09-13T06:02:56.561187+0000","last_became_active":"2023-09-13T06:02:55.570379+0000","last_became_peered":"2023-09-13T06:02:55.570379+0000","last_unstale":"2023-09-13T06:02:56.561187+0000","last_undegraded":"2023-09-13T06:02:56.561187+0000","last_fullsized":"2023-09-13T06:02:56.561187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:06.965866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.538855+0000","last_change":"2023-09-13T06:02:53.538855+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.538855+0000","last_undegraded":"2023-09-13T06:02:53.538855+0000","last_fullsized":"2023-09-13T06:02:53.538855+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.564799+0000","last_change":"2023-09-13T06:02:54.552935+0000","last_active":"2023-09-13T06:02:55.564799+0000","last_peered":"2023-09-13T06:02:55.564799+0000","last_clean":"2023-09-13T06:02:55.564799+0000","last_became_active":"2023-09-13T06:02:54.552709+0000","last_became_peered":"2023-09-13T06:02:54.552709+0000","last_unstale":"2023-09-13T06:02:55.564799+0000","last_undegraded":"2023-09-13T06:02:55.564799+0000","last_fullsized":"2023-09-13T06:02:55.564799+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:06:58.669309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:02:54.532518+0000","last_change":"2023-09-13T06:02:54.532518+0000","last_active":"2023-09-13T06:02:54.532518+0000","last_peered":"2023-09-13T06:02:54.532518+0000","last_clean":"2023-09-13T06:02:54.532518+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:54.532518+0000","last_undegraded":"2023-09-13T06:02:54.532518+0000","last_fullsized":"2023-09-13T06:02:54.532518+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563150+0000","last_change":"2023-09-13T06:02:54.554295+0000","last_active":"2023-09-13T06:02:55.563150+0000","last_peered":"2023-09-13T06:02:55.563150+0000","last_clean":"2023-09-13T06:02:55.563150+0000","last_became_active":"2023-09-13T06:02:54.553764+0000","last_became_peered":"2023-09-13T06:02:54.553764+0000","last_unstale":"2023-09-13T06:02:55.563150+0000","last_undegraded":"2023-09-13T06:02:55.563150+0000","last_fullsized":"2023-09-13T06:02:55.563150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:36.571962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153857+0000","last_change":"2023-09-13T06:02:55.566022+0000","last_active":"2023-09-13T06:02:57.153857+0000","last_peered":"2023-09-13T06:02:57.153857+0000","last_clean":"2023-09-13T06:02:57.153857+0000","last_became_active":"2023-09-13T06:02:55.565405+0000","last_became_peered":"2023-09-13T06:02:55.565405+0000","last_unstale":"2023-09-13T06:02:57.153857+0000","last_undegraded":"2023-09-13T06:02:57.153857+0000","last_fullsized":"2023-09-13T06:02:57.153857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:37.929114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2023-09-13T06:02:53.533441+0000","last_change":"2023-09-13T06:02:53.533441+0000","last_active":"2023-09-13T06:02:53.525108+0000","last_peered":"2023-09-13T06:02:53.525108+0000","last_clean":"2023-09-13T06:02:53.525108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:02:53.533441+0000","last_undegraded":"2023-09-13T06:02:53.533441+0000","last_fullsized":"2023-09-13T06:02:53.533441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-09-13T06:02:51.535693+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:02:51.535693+0000","last_peered":"2023-09-13T06:02:51.535693+0000","last_clean":"2023-09-13T06:02:51.535693+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:02:51.535693+0000","last_undegraded":"2023-09-13T06:02:51.535693+0000","last_fullsized":"2023-09-13T06:02:51.535693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":760,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194551,"statfs":{"total":200000000,"available":199221180,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.73999999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.63500000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76900000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.56799999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.89400000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.83599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":184,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195128,"statfs":{"total":200000000,"available":199811548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.65600000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67000000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.754},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.70299999999999996}]},{"osd":4,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48999999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.50800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":184,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195128,"statfs":{"total":200000000,"available":199811548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.65200000000000002}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.84099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.621},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.89000000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.78400000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81799999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.751}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":184,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195128,"statfs":{"total":200000000,"available":199811548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.78300000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.621},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.83999999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68799999999999994}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.872},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.72099999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.89400000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.80700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.628},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.60199999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.5}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.41399999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.505}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.371},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.88700000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.91300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786319,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.48799999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.2150000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.878},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.1140000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":1.2769999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195987,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40000000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.627}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.53000000000000003}]}]}],"pool_statfs":[]}} 2023-09-13T06:03:00.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-09-13T06:03:00.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-09-13T06:03:00.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-09-13T06:03:00.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-09-13T06:03:00.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-09-13T06:03:00.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-09-13T06:03:00.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-09-13T06:03:00.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-09-13T06:03:00.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-09-13T06:03:00.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-09-13T06:03:00.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-09-13T06:03:00.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-09-13T06:03:00.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-09-13T06:03:00.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-09-13T06:03:00.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-09-13T06:03:00.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-09-13T06:03:00.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-09-13T06:03:00.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-09-13T06:03:00.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-09-13T06:03:00.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.538877+0000', 'last_change': '2023-09-13T06:02:53.538877+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.538877+0000', 'last_undegraded': '2023-09-13T06:02:53.538877+0000', 'last_fullsized': '2023-09-13T06:02:53.538877+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:03:00.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-09-13T06:03:00.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-09-13T06:03:00.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.534663+0000', 'last_change': '2023-09-13T06:02:53.534663+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.534663+0000', 'last_undegraded': '2023-09-13T06:02:53.534663+0000', 'last_fullsized': '2023-09-13T06:02:53.534663+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:03:00.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-09-13T06:03:00.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-09-13T06:03:00.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.538868+0000', 'last_change': '2023-09-13T06:02:53.538868+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.538868+0000', 'last_undegraded': '2023-09-13T06:02:53.538868+0000', 'last_fullsized': '2023-09-13T06:02:53.538868+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:03:00.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-09-13T06:03:00.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.534026+0000', 'last_change': '2023-09-13T06:02:53.534026+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.534026+0000', 'last_undegraded': '2023-09-13T06:02:53.534026+0000', 'last_fullsized': '2023-09-13T06:02:53.534026+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:03:00.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-09-13T06:03:00.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-09-13T06:03:00.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-09-13T06:03:00.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.538844+0000', 'last_change': '2023-09-13T06:02:53.538844+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.538844+0000', 'last_undegraded': '2023-09-13T06:02:53.538844+0000', 'last_fullsized': '2023-09-13T06:02:53.538844+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:03:00.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-09-13T06:03:00.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-09-13T06:03:00.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.534005+0000', 'last_change': '2023-09-13T06:02:53.534005+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.534005+0000', 'last_undegraded': '2023-09-13T06:02:53.534005+0000', 'last_fullsized': '2023-09-13T06:02:53.534005+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:03:00.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-09-13T06:03:00.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-09-13T06:03:00.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-09-13T06:03:00.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.534356+0000', 'last_change': '2023-09-13T06:02:53.534356+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.534356+0000', 'last_undegraded': '2023-09-13T06:02:53.534356+0000', 'last_fullsized': '2023-09-13T06:02:53.534356+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:03:00.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-09-13T06:03:00.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-09-13T06:03:00.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.538865+0000', 'last_change': '2023-09-13T06:02:53.538865+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.538865+0000', 'last_undegraded': '2023-09-13T06:02:53.538865+0000', 'last_fullsized': '2023-09-13T06:02:53.538865+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:03:00.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-09-13T06:03:00.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-09-13T06:03:00.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.533468+0000', 'last_change': '2023-09-13T06:02:53.533468+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.533468+0000', 'last_undegraded': '2023-09-13T06:02:53.533468+0000', 'last_fullsized': '2023-09-13T06:02:53.533468+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:03:00.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-09-13T06:03:00.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-09-13T06:03:00.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.533656+0000', 'last_change': '2023-09-13T06:02:53.533656+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.533656+0000', 'last_undegraded': '2023-09-13T06:02:53.533656+0000', 'last_fullsized': '2023-09-13T06:02:53.533656+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:03:00.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-09-13T06:03:00.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.533918+0000', 'last_change': '2023-09-13T06:02:53.533918+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.533918+0000', 'last_undegraded': '2023-09-13T06:02:53.533918+0000', 'last_fullsized': '2023-09-13T06:02:53.533918+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:03:00.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-09-13T06:03:00.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-09-13T06:03:00.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.533415+0000', 'last_change': '2023-09-13T06:02:53.533415+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.533415+0000', 'last_undegraded': '2023-09-13T06:02:53.533415+0000', 'last_fullsized': '2023-09-13T06:02:53.533415+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:03:00.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-09-13T06:03:00.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-09-13T06:03:00.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.533406+0000', 'last_change': '2023-09-13T06:02:53.533406+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.533406+0000', 'last_undegraded': '2023-09-13T06:02:53.533406+0000', 'last_fullsized': '2023-09-13T06:02:53.533406+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-09-13T06:03:00.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-09-13T06:03:00.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.538855+0000', 'last_change': '2023-09-13T06:02:53.538855+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.538855+0000', 'last_undegraded': '2023-09-13T06:02:53.538855+0000', 'last_fullsized': '2023-09-13T06:02:53.538855+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-09-13T06:03:00.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-09-13T06:03:00.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-09-13T06:03:00.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-13T06:02:54.532518+0000', 'last_change': '2023-09-13T06:02:54.532518+0000', 'last_active': '2023-09-13T06:02:54.532518+0000', 'last_peered': '2023-09-13T06:02:54.532518+0000', 'last_clean': '2023-09-13T06:02:54.532518+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:54.532518+0000', 'last_undegraded': '2023-09-13T06:02:54.532518+0000', 'last_fullsized': '2023-09-13T06:02:54.532518+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:54.532518+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-13T06:03:00.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-09-13T06:03:00.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2023-09-13T06:02:53.533441+0000', 'last_change': '2023-09-13T06:02:53.533441+0000', 'last_active': '2023-09-13T06:02:53.525108+0000', 'last_peered': '2023-09-13T06:02:53.525108+0000', 'last_clean': '2023-09-13T06:02:53.525108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-13T06:02:53.533441+0000', 'last_undegraded': '2023-09-13T06:02:53.533441+0000', 'last_fullsized': '2023-09-13T06:02:53.533441+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'last_clean_scrub_stamp': '2023-09-13T06:02:53.525108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-09-13T06:03:00.446 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-13T06:03:00.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.579+0000 7f22f0e6d640 1 Processor -- start 2023-09-13T06:03:00.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.579+0000 7f22f0e6d640 1 -- start start 2023-09-13T06:03:00.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22f0e6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec0b1d20 0x7f22ec0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22f0e6d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ec0ccfd0 con 0x7f22ec0cdfc0 2023-09-13T06:03:00.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22f0e6d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ec0ced90 con 0x7f22ec159f20 2023-09-13T06:03:00.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22f0e6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0ce430 con 0x7f22ec0b1d20 2023-09-13T06:03:00.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22ead9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f22ec0cdfc0 0x7f22ec0ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59756/0 (socket says 172.21.15.130:59756) 2023-09-13T06:03:00.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22ead9d640 1 -- 172.21.15.130:0/3253358025 learned_addr learned my addr 172.21.15.130:0/3253358025 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:00.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e1d9b640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec0b1d20 0x7f22ec0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621546607 0 0) 0x7f22ec0ccfd0 con 0x7f22ec0cdfc0 2023-09-13T06:03:00.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d8005740 con 0x7f22ec0cdfc0 2023-09-13T06:03:00.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331238180 0 0) 0x7f22ec0ced90 con 0x7f22ec159f20 2023-09-13T06:03:00.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22ec0ccfd0 con 0x7f22ec159f20 2023-09-13T06:03:00.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2085191881 0 0) 0x7f22d8005740 con 0x7f22ec0cdfc0 2023-09-13T06:03:00.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec0b1d20 msgr2=0x7f22ec0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:00.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec0b1d20 0x7f22ec0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 >> v1:172.21.15.164:6789/0 conn(0x7f22ec159f20 legacy=0x7f22ec0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0cd200 con 0x7f22ec0cdfc0 2023-09-13T06:03:00.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f22e4001680 con 0x7f22ec0cdfc0 2023-09-13T06:03:00.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 >> v1:172.21.15.130:6789/0 conn(0x7f22ec0cdfc0 legacy=0x7f22ec0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d8005dc0 0x7f22d80061c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d80069e0 0x7f22d8006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 0x7f22d800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0ce430 con 0x7f22d80073a0 2023-09-13T06:03:00.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d800e270 con 0x7f22d8005dc0 2023-09-13T06:03:00.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d800e430 con 0x7f22d80069e0 2023-09-13T06:03:00.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e1d9b640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec0b1d20 0x7f22ec0ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:00.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22ead9d640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 0x7f22d800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22ea59c640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d8005dc0 0x7f22d80061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22e1d9b640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d80069e0 0x7f22d8006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22ead9d640 1 -- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d80069e0 msgr2=0x7f22d8006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:00.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22ead9d640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d80069e0 0x7f22d8006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22ead9d640 1 -- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d8005dc0 msgr2=0x7f22d80061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:00.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22ead9d640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d8005dc0 0x7f22d80061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.583+0000 7f22ead9d640 1 -- 172.21.15.130:0/3253358025 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8005740 con 0x7f22d80073a0 2023-09-13T06:03:00.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22ead9d640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 0x7f22d800dba0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f22e4007fa0 tx=0x7f22e401f250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac946a01d55aabf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:00.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e40a8e70 con 0x7f22d80073a0 2023-09-13T06:03:00.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e40058e0 con 0x7f22d80073a0 2023-09-13T06:03:00.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22e9d9b640 1 -- 172.21.15.130:0/3253358025 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4005cb0 con 0x7f22d80073a0 2023-09-13T06:03:00.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3253358025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 msgr2=0x7f22d800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22f0e6d640 1 --2- 172.21.15.130:0/3253358025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 0x7f22d800dba0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f22e4007fa0 tx=0x7f22e401f250 comp rx=0 tx=0).stop 2023-09-13T06:03:00.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22ead9d640 1 -- 172.21.15.130:0/3253358025 reap_dead start 2023-09-13T06:03:00.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3253358025 shutdown_connections 2023-09-13T06:03:00.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3253358025 >> 172.21.15.130:0/3253358025 conn(0x7f22ec065990 msgr2=0x7f22ec065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:00.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3253358025 shutdown_connections 2023-09-13T06:03:00.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3253358025 wait complete. 2023-09-13T06:03:00.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.587+0000 7f22f0e6d640 1 Processor -- start 2023-09-13T06:03:00.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22f0e6d640 1 -- start start 2023-09-13T06:03:00.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22f0e6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 0x7f22ec146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22f0e6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec0a8430 0x7f22ec158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22f0e6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec0a9c50 0x7f22ec0aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22f0e6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0aa640 con 0x7f22d80073a0 2023-09-13T06:03:00.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22f0e6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec1470f0 con 0x7f22ec0a8430 2023-09-13T06:03:00.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22f0e6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0a89a0 con 0x7f22ec0a9c50 2023-09-13T06:03:00.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22ea59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 0x7f22ec146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22ea59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 0x7f22ec146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52214/0 (socket says 172.21.15.130:52214) 2023-09-13T06:03:00.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22ea59c640 1 -- 172.21.15.130:0/3545665988 learned_addr learned my addr 172.21.15.130:0/3545665988 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:00.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22e1d9b640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec0a8430 0x7f22ec158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22ead9d640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec0a9c50 0x7f22ec0aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22ea59c640 1 -- 172.21.15.130:0/3545665988 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec0a9c50 msgr2=0x7f22ec0aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22ea59c640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec0a9c50 0x7f22ec0aa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22ea59c640 1 -- 172.21.15.130:0/3545665988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec0a8430 msgr2=0x7f22ec158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22ea59c640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec0a8430 0x7f22ec158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22ea59c640 1 -- 172.21.15.130:0/3545665988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0a8c80 con 0x7f22d80073a0 2023-09-13T06:03:00.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22ea59c640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 0x7f22ec146bb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00e7b0 tx=0x7f22dc00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:00.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22e37fe640 1 -- 172.21.15.130:0/3545665988 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc017070 con 0x7f22d80073a0 2023-09-13T06:03:00.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22e37fe640 1 -- 172.21.15.130:0/3545665988 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc0050d0 con 0x7f22d80073a0 2023-09-13T06:03:00.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3545665988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec0a8f60 con 0x7f22d80073a0 2023-09-13T06:03:00.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22e37fe640 1 -- 172.21.15.130:0/3545665988 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc005260 con 0x7f22d80073a0 2023-09-13T06:03:00.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3545665988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec1585b0 con 0x7f22d80073a0 2023-09-13T06:03:00.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.591+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3545665988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec0618a0 con 0x7f22d80073a0 2023-09-13T06:03:00.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.595+0000 7f22e37fe640 1 -- 172.21.15.130:0/3545665988 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f22dc00c640 con 0x7f22d80073a0 2023-09-13T06:03:00.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.595+0000 7f22e37fe640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22cc065b20 0x7f22cc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.595+0000 7f22e37fe640 1 -- 172.21.15.130:0/3545665988 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22dc082850 con 0x7f22d80073a0 2023-09-13T06:03:00.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.595+0000 7f22e1d9b640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22cc065b20 0x7f22cc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.595+0000 7f22e1d9b640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22cc065b20 0x7f22cc067fe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0afc50 tx=0x7f22d400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:00.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.599+0000 7f22e37fe640 1 -- 172.21.15.130:0/3545665988 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f22dc050100 con 0x7f22d80073a0 2023-09-13T06:03:00.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3545665988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f22ec06c040 con 0x7f22d80073a0 2023-09-13T06:03:00.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22e37fe640 1 -- 172.21.15.130:0/3545665988 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1554 (secure 0 0 0) 0x7f22dc053720 con 0x7f22d80073a0 2023-09-13T06:03:00.811 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:00.811 INFO:teuthology.orchestra.run.smithi130.stdout:{"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":113,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1694584873,"num_in_osds":8,"osd_in_since":1694584870,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":2894444,"bytes_avail":1597105556,"bytes_total":1600000000,"write_bytes_sec":2383,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5613}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-09-13T06:02:14.545962+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-09-13T06:03:00.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3545665988 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22cc065b20 msgr2=0x7f22cc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22cc065b20 0x7f22cc067fe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0afc50 tx=0x7f22d400b040 comp rx=0 tx=0).stop 2023-09-13T06:03:00.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3545665988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 msgr2=0x7f22ec146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 0x7f22ec146bb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00e7b0 tx=0x7f22dc00ebb0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3545665988 shutdown_connections 2023-09-13T06:03:00.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22cc065b20 0x7f22cc067fe0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec0a8430 0x7f22ec158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec0a9c50 0x7f22ec0aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 --2- 172.21.15.130:0/3545665988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d80073a0 0x7f22ec146bb0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3545665988 >> 172.21.15.130:0/3545665988 conn(0x7f22ec065990 msgr2=0x7f22ec0b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:00.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3545665988 shutdown_connections 2023-09-13T06:03:00.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.807+0000 7f22f0e6d640 1 -- 172.21.15.130:0/3545665988 wait complete. 2023-09-13T06:03:00.832 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-13T06:03:00.833 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:03:00.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05ccc56640 1 Processor -- start 2023-09-13T06:03:00.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05ccc56640 1 -- start start 2023-09-13T06:03:00.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05ccc56640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05c80b0f40 0x7f05c80b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05ccc56640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05c815e560 0x7f05c80b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05ccc56640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c80afee0 con 0x7f05c8157920 2023-09-13T06:03:00.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05ccc56640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c80aea50 con 0x7f05c815e560 2023-09-13T06:03:00.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05ccc56640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80b0b20 con 0x7f05c80b0f40 2023-09-13T06:03:00.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05c6d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05c815e560 0x7f05c80b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05c6d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05c815e560 0x7f05c80b1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52466/0 (socket says 172.21.15.130:52466) 2023-09-13T06:03:00.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05c6d9d640 1 -- 172.21.15.130:0/2530978837 learned_addr learned my addr 172.21.15.130:0/2530978837 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:00.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05bffff640 1 --2- 172.21.15.130:0/2530978837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05c80b0f40 0x7f05c80b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05c6d9d640 1 -- 172.21.15.130:0/2530978837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05c80b0f40 msgr2=0x7f05c80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:00.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05c6d9d640 1 --2- 172.21.15.130:0/2530978837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05c80b0f40 0x7f05c80b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05c6d9d640 1 -- 172.21.15.130:0/2530978837 >> v1:172.21.15.164:6789/0 conn(0x7f05c8157920 legacy=0x7f05c80ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:00.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.967+0000 7f05c6d9d640 1 -- 172.21.15.130:0/2530978837 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c80b0180 con 0x7f05c815e560 2023-09-13T06:03:00.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05c6d9d640 1 --2- 172.21.15.130:0/2530978837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c815e560 0x7f05c80b1b50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009e50 tx=0x7f05c001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cef76d24719595 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:00.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05c5d9b640 1 -- 172.21.15.130:0/2530978837 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c00a57d0 con 0x7f05c815e560 2023-09-13T06:03:00.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05c5d9b640 1 -- 172.21.15.130:0/2530978837 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c00a5930 con 0x7f05c815e560 2023-09-13T06:03:00.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05c5d9b640 1 -- 172.21.15.130:0/2530978837 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c00a5cc0 con 0x7f05c815e560 2023-09-13T06:03:00.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05ccc56640 1 -- 172.21.15.130:0/2530978837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c815e560 msgr2=0x7f05c80b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05ccc56640 1 --2- 172.21.15.130:0/2530978837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c815e560 0x7f05c80b1b50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009e50 tx=0x7f05c001ca10 comp rx=0 tx=0).stop 2023-09-13T06:03:00.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05ccc56640 1 -- 172.21.15.130:0/2530978837 shutdown_connections 2023-09-13T06:03:00.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05ccc56640 1 --2- 172.21.15.130:0/2530978837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c815e560 0x7f05c80b1b50 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05ccc56640 1 --2- 172.21.15.130:0/2530978837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05c80b0f40 0x7f05c80b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05ccc56640 1 -- 172.21.15.130:0/2530978837 >> 172.21.15.130:0/2530978837 conn(0x7f05c8065990 msgr2=0x7f05c8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:00.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05ccc56640 1 -- 172.21.15.130:0/2530978837 shutdown_connections 2023-09-13T06:03:00.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.971+0000 7f05ccc56640 1 -- 172.21.15.130:0/2530978837 wait complete. 2023-09-13T06:03:00.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05ccc56640 1 Processor -- start 2023-09-13T06:03:00.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05ccc56640 1 -- start start 2023-09-13T06:03:00.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05ccc56640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80b0f40 0x7f05c8156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05ccc56640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05c8157920 0x7f05c80ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05ccc56640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05c815e560 0x7f05c8149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05ccc56640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c81560d0 con 0x7f05c80b0f40 2023-09-13T06:03:00.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05ccc56640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c814f290 con 0x7f05c8157920 2023-09-13T06:03:00.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05ccc56640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c814f570 con 0x7f05c815e560 2023-09-13T06:03:00.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05c659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80b0f40 0x7f05c8156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05c659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80b0f40 0x7f05c8156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52470/0 (socket says 172.21.15.130:52470) 2023-09-13T06:03:00.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05c659c640 1 -- 172.21.15.130:0/2863410716 learned_addr learned my addr 172.21.15.130:0/2863410716 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:00.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05c6d9d640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05c815e560 0x7f05c8149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05bffff640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05c8157920 0x7f05c80ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05c659c640 1 -- 172.21.15.130:0/2863410716 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05c815e560 msgr2=0x7f05c8149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05c659c640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05c815e560 0x7f05c8149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05c659c640 1 -- 172.21.15.130:0/2863410716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05c8157920 msgr2=0x7f05c80ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:00.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05c659c640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05c8157920 0x7f05c80ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:00.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05c659c640 1 -- 172.21.15.130:0/2863410716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c0009b30 con 0x7f05c80b0f40 2023-09-13T06:03:00.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05c659c640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80b0f40 0x7f05c8156560 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c500 tx=0x7f05b800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:00.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05beffd640 1 -- 172.21.15.130:0/2863410716 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8005220 con 0x7f05c80b0f40 2023-09-13T06:03:00.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05beffd640 1 -- 172.21.15.130:0/2863410716 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8005380 con 0x7f05c80b0f40 2023-09-13T06:03:00.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05beffd640 1 -- 172.21.15.130:0/2863410716 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8007270 con 0x7f05c80b0f40 2023-09-13T06:03:00.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05ccc56640 1 -- 172.21.15.130:0/2863410716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c814f850 con 0x7f05c80b0f40 2023-09-13T06:03:00.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.975+0000 7f05ccc56640 1 -- 172.21.15.130:0/2863410716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c8155c60 con 0x7f05c80b0f40 2023-09-13T06:03:00.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.979+0000 7f05ccc56640 1 -- 172.21.15.130:0/2863410716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c80618a0 con 0x7f05c80b0f40 2023-09-13T06:03:00.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.979+0000 7f05beffd640 1 -- 172.21.15.130:0/2863410716 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f05b80073d0 con 0x7f05c80b0f40 2023-09-13T06:03:00.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.979+0000 7f05beffd640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05a8065b20 0x7f05a8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:00.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.979+0000 7f05beffd640 1 -- 172.21.15.130:0/2863410716 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05b8082b30 con 0x7f05c80b0f40 2023-09-13T06:03:00.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.979+0000 7f05bffff640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05a8065b20 0x7f05a8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:00.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.979+0000 7f05bffff640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05a8065b20 0x7f05a8067fe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f05c80cfd60 tx=0x7f05b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:00.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:00.983+0000 7f05beffd640 1 -- 172.21.15.130:0/2863410716 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f05b80504a0 con 0x7f05c80b0f40 2023-09-13T06:03:01.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.127+0000 7f05ccc56640 1 -- 172.21.15.130:0/2863410716 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05c8157d00 con 0x7f05a8065b20 2023-09-13T06:03:01.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.135+0000 7f05beffd640 1 -- 172.21.15.130:0/2863410716 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285155 (secure 0 0 0) 0x7f05b0010960 con 0x7f05a8065b20 2023-09-13T06:03:01.436 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:01.438 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:03:01.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 -- 172.21.15.130:0/2863410716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05a8065b20 msgr2=0x7f05a8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:01.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05a8065b20 0x7f05a8067fe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f05c80cfd60 tx=0x7f05b0008040 comp rx=0 tx=0).stop 2023-09-13T06:03:01.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 -- 172.21.15.130:0/2863410716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80b0f40 msgr2=0x7f05c8156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:01.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80b0f40 0x7f05c8156560 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c500 tx=0x7f05b800c9c0 comp rx=0 tx=0).stop 2023-09-13T06:03:01.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 -- 172.21.15.130:0/2863410716 shutdown_connections 2023-09-13T06:03:01.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05a8065b20 0x7f05a8067fe0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:01.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05c8157920 0x7f05c80ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:01.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05c815e560 0x7f05c8149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:01.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 --2- 172.21.15.130:0/2863410716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80b0f40 0x7f05c8156560 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:01.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 -- 172.21.15.130:0/2863410716 >> 172.21.15.130:0/2863410716 conn(0x7f05c8065990 msgr2=0x7f05c8156be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:01.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 -- 172.21.15.130:0/2863410716 shutdown_connections 2023-09-13T06:03:01.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:01.139+0000 7f05ccc56640 1 -- 172.21.15.130:0/2863410716 wait complete. 2023-09-13T06:03:01.443 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-09-13T06:03:00.554098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2826,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559673,"statfs":{"total":1600000000,"available":1597105556,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.013802"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561193+0000","last_change":"2023-09-13T06:02:55.568864+0000","last_active":"2023-09-13T06:02:56.561193+0000","last_peered":"2023-09-13T06:02:56.561193+0000","last_clean":"2023-09-13T06:02:56.561193+0000","last_became_active":"2023-09-13T06:02:55.566152+0000","last_became_peered":"2023-09-13T06:02:55.566152+0000","last_unstale":"2023-09-13T06:02:56.561193+0000","last_undegraded":"2023-09-13T06:02:56.561193+0000","last_fullsized":"2023-09-13T06:02:56.561193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:47.080838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560290+0000","last_change":"2023-09-13T06:02:55.565126+0000","last_active":"2023-09-13T06:02:56.560290+0000","last_peered":"2023-09-13T06:02:56.560290+0000","last_clean":"2023-09-13T06:02:56.560290+0000","last_became_active":"2023-09-13T06:02:55.564752+0000","last_became_peered":"2023-09-13T06:02:55.564752+0000","last_unstale":"2023-09-13T06:02:56.560290+0000","last_undegraded":"2023-09-13T06:02:56.560290+0000","last_fullsized":"2023-09-13T06:02:56.560290+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:54.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114779+0000","last_change":"2023-09-13T06:02:55.570002+0000","last_active":"2023-09-13T06:02:57.114779+0000","last_peered":"2023-09-13T06:02:57.114779+0000","last_clean":"2023-09-13T06:02:57.114779+0000","last_became_active":"2023-09-13T06:02:55.569454+0000","last_became_peered":"2023-09-13T06:02:55.569454+0000","last_unstale":"2023-09-13T06:02:57.114779+0000","last_undegraded":"2023-09-13T06:02:57.114779+0000","last_fullsized":"2023-09-13T06:02:57.114779+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:23.150613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154162+0000","last_change":"2023-09-13T06:02:55.576304+0000","last_active":"2023-09-13T06:02:57.154162+0000","last_peered":"2023-09-13T06:02:57.154162+0000","last_clean":"2023-09-13T06:02:57.154162+0000","last_became_active":"2023-09-13T06:02:55.576093+0000","last_became_peered":"2023-09-13T06:02:55.576093+0000","last_unstale":"2023-09-13T06:02:57.154162+0000","last_undegraded":"2023-09-13T06:02:57.154162+0000","last_fullsized":"2023-09-13T06:02:57.154162+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:16:23.458455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560774+0000","last_change":"2023-09-13T06:02:55.564070+0000","last_active":"2023-09-13T06:02:56.560774+0000","last_peered":"2023-09-13T06:02:56.560774+0000","last_clean":"2023-09-13T06:02:56.560774+0000","last_became_active":"2023-09-13T06:02:55.563819+0000","last_became_peered":"2023-09-13T06:02:55.563819+0000","last_unstale":"2023-09-13T06:02:56.560774+0000","last_undegraded":"2023-09-13T06:02:56.560774+0000","last_fullsized":"2023-09-13T06:02:56.560774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:52.140701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560881+0000","last_change":"2023-09-13T06:02:55.566320+0000","last_active":"2023-09-13T06:02:56.560881+0000","last_peered":"2023-09-13T06:02:56.560881+0000","last_clean":"2023-09-13T06:02:56.560881+0000","last_became_active":"2023-09-13T06:02:55.565921+0000","last_became_peered":"2023-09-13T06:02:55.565921+0000","last_unstale":"2023-09-13T06:02:56.560881+0000","last_undegraded":"2023-09-13T06:02:56.560881+0000","last_fullsized":"2023-09-13T06:02:56.560881+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:33:20.937865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560237+0000","last_change":"2023-09-13T06:02:55.564224+0000","last_active":"2023-09-13T06:02:56.560237+0000","last_peered":"2023-09-13T06:02:56.560237+0000","last_clean":"2023-09-13T06:02:56.560237+0000","last_became_active":"2023-09-13T06:02:55.563912+0000","last_became_peered":"2023-09-13T06:02:55.563912+0000","last_unstale":"2023-09-13T06:02:56.560237+0000","last_undegraded":"2023-09-13T06:02:56.560237+0000","last_fullsized":"2023-09-13T06:02:56.560237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:26:27.736729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153727+0000","last_change":"2023-09-13T06:02:55.573024+0000","last_active":"2023-09-13T06:02:57.153727+0000","last_peered":"2023-09-13T06:02:57.153727+0000","last_clean":"2023-09-13T06:02:57.153727+0000","last_became_active":"2023-09-13T06:02:55.572812+0000","last_became_peered":"2023-09-13T06:02:55.572812+0000","last_unstale":"2023-09-13T06:02:57.153727+0000","last_undegraded":"2023-09-13T06:02:57.153727+0000","last_fullsized":"2023-09-13T06:02:57.153727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:54.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154313+0000","last_change":"2023-09-13T06:02:55.571715+0000","last_active":"2023-09-13T06:02:57.154313+0000","last_peered":"2023-09-13T06:02:57.154313+0000","last_clean":"2023-09-13T06:02:57.154313+0000","last_became_active":"2023-09-13T06:02:55.571192+0000","last_became_peered":"2023-09-13T06:02:55.571192+0000","last_unstale":"2023-09-13T06:02:57.154313+0000","last_undegraded":"2023-09-13T06:02:57.154313+0000","last_fullsized":"2023-09-13T06:02:57.154313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:17:43.885392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153946+0000","last_change":"2023-09-13T06:02:55.575986+0000","last_active":"2023-09-13T06:02:57.153946+0000","last_peered":"2023-09-13T06:02:57.153946+0000","last_clean":"2023-09-13T06:02:57.153946+0000","last_became_active":"2023-09-13T06:02:55.575791+0000","last_became_peered":"2023-09-13T06:02:55.575791+0000","last_unstale":"2023-09-13T06:02:57.153946+0000","last_undegraded":"2023-09-13T06:02:57.153946+0000","last_fullsized":"2023-09-13T06:02:57.153946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:30.054070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154032+0000","last_change":"2023-09-13T06:02:55.565063+0000","last_active":"2023-09-13T06:02:57.154032+0000","last_peered":"2023-09-13T06:02:57.154032+0000","last_clean":"2023-09-13T06:02:57.154032+0000","last_became_active":"2023-09-13T06:02:55.564847+0000","last_became_peered":"2023-09-13T06:02:55.564847+0000","last_unstale":"2023-09-13T06:02:57.154032+0000","last_undegraded":"2023-09-13T06:02:57.154032+0000","last_fullsized":"2023-09-13T06:02:57.154032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:48.470117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560448+0000","last_change":"2023-09-13T06:02:55.570230+0000","last_active":"2023-09-13T06:02:56.560448+0000","last_peered":"2023-09-13T06:02:56.560448+0000","last_clean":"2023-09-13T06:02:56.560448+0000","last_became_active":"2023-09-13T06:02:55.569986+0000","last_became_peered":"2023-09-13T06:02:55.569986+0000","last_unstale":"2023-09-13T06:02:56.560448+0000","last_undegraded":"2023-09-13T06:02:56.560448+0000","last_fullsized":"2023-09-13T06:02:56.560448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:30.054070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153708+0000","last_change":"2023-09-13T06:02:55.569821+0000","last_active":"2023-09-13T06:02:57.153708+0000","last_peered":"2023-09-13T06:02:57.153708+0000","last_clean":"2023-09-13T06:02:57.153708+0000","last_became_active":"2023-09-13T06:02:55.569596+0000","last_became_peered":"2023-09-13T06:02:55.569596+0000","last_unstale":"2023-09-13T06:02:57.153708+0000","last_undegraded":"2023-09-13T06:02:57.153708+0000","last_fullsized":"2023-09-13T06:02:57.153708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:17:55.915552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154649+0000","last_change":"2023-09-13T06:02:55.571859+0000","last_active":"2023-09-13T06:02:57.154649+0000","last_peered":"2023-09-13T06:02:57.154649+0000","last_clean":"2023-09-13T06:02:57.154649+0000","last_became_active":"2023-09-13T06:02:55.571512+0000","last_became_peered":"2023-09-13T06:02:55.571512+0000","last_unstale":"2023-09-13T06:02:57.154649+0000","last_undegraded":"2023-09-13T06:02:57.154649+0000","last_fullsized":"2023-09-13T06:02:57.154649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:03:57.908839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560750+0000","last_change":"2023-09-13T06:02:55.566258+0000","last_active":"2023-09-13T06:02:56.560750+0000","last_peered":"2023-09-13T06:02:56.560750+0000","last_clean":"2023-09-13T06:02:56.560750+0000","last_became_active":"2023-09-13T06:02:55.566046+0000","last_became_peered":"2023-09-13T06:02:55.566046+0000","last_unstale":"2023-09-13T06:02:56.560750+0000","last_undegraded":"2023-09-13T06:02:56.560750+0000","last_fullsized":"2023-09-13T06:02:56.560750+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:23:02.216766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114363+0000","last_change":"2023-09-13T06:02:55.574223+0000","last_active":"2023-09-13T06:02:57.114363+0000","last_peered":"2023-09-13T06:02:57.114363+0000","last_clean":"2023-09-13T06:02:57.114363+0000","last_became_active":"2023-09-13T06:02:55.571362+0000","last_became_peered":"2023-09-13T06:02:55.571362+0000","last_unstale":"2023-09-13T06:02:57.114363+0000","last_undegraded":"2023-09-13T06:02:57.114363+0000","last_fullsized":"2023-09-13T06:02:57.114363+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:18:11.389519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114978+0000","last_change":"2023-09-13T06:02:55.566838+0000","last_active":"2023-09-13T06:02:57.114978+0000","last_peered":"2023-09-13T06:02:57.114978+0000","last_clean":"2023-09-13T06:02:57.114978+0000","last_became_active":"2023-09-13T06:02:55.566472+0000","last_became_peered":"2023-09-13T06:02:55.566472+0000","last_unstale":"2023-09-13T06:02:57.114978+0000","last_undegraded":"2023-09-13T06:02:57.114978+0000","last_fullsized":"2023-09-13T06:02:57.114978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:12:42.113425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115164+0000","last_change":"2023-09-13T06:02:55.569839+0000","last_active":"2023-09-13T06:02:57.115164+0000","last_peered":"2023-09-13T06:02:57.115164+0000","last_clean":"2023-09-13T06:02:57.115164+0000","last_became_active":"2023-09-13T06:02:55.569043+0000","last_became_peered":"2023-09-13T06:02:55.569043+0000","last_unstale":"2023-09-13T06:02:57.115164+0000","last_undegraded":"2023-09-13T06:02:57.115164+0000","last_fullsized":"2023-09-13T06:02:57.115164+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:11.893687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115119+0000","last_change":"2023-09-13T06:02:55.575472+0000","last_active":"2023-09-13T06:02:57.115119+0000","last_peered":"2023-09-13T06:02:57.115119+0000","last_clean":"2023-09-13T06:02:57.115119+0000","last_became_active":"2023-09-13T06:02:55.571549+0000","last_became_peered":"2023-09-13T06:02:55.571549+0000","last_unstale":"2023-09-13T06:02:57.115119+0000","last_undegraded":"2023-09-13T06:02:57.115119+0000","last_fullsized":"2023-09-13T06:02:57.115119+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:50:47.718338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153771+0000","last_change":"2023-09-13T06:02:55.573245+0000","last_active":"2023-09-13T06:02:57.153771+0000","last_peered":"2023-09-13T06:02:57.153771+0000","last_clean":"2023-09-13T06:02:57.153771+0000","last_became_active":"2023-09-13T06:02:55.573014+0000","last_became_peered":"2023-09-13T06:02:55.573014+0000","last_unstale":"2023-09-13T06:02:57.153771+0000","last_undegraded":"2023-09-13T06:02:57.153771+0000","last_fullsized":"2023-09-13T06:02:57.153771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:24:16.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561006+0000","last_change":"2023-09-13T06:02:55.570152+0000","last_active":"2023-09-13T06:02:56.561006+0000","last_peered":"2023-09-13T06:02:56.561006+0000","last_clean":"2023-09-13T06:02:56.561006+0000","last_became_active":"2023-09-13T06:02:55.569932+0000","last_became_peered":"2023-09-13T06:02:55.569932+0000","last_unstale":"2023-09-13T06:02:56.561006+0000","last_undegraded":"2023-09-13T06:02:56.561006+0000","last_fullsized":"2023-09-13T06:02:56.561006+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:31:37.037162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154101+0000","last_change":"2023-09-13T06:02:55.576177+0000","last_active":"2023-09-13T06:02:57.154101+0000","last_peered":"2023-09-13T06:02:57.154101+0000","last_clean":"2023-09-13T06:02:57.154101+0000","last_became_active":"2023-09-13T06:02:55.575860+0000","last_became_peered":"2023-09-13T06:02:55.575860+0000","last_unstale":"2023-09-13T06:02:57.154101+0000","last_undegraded":"2023-09-13T06:02:57.154101+0000","last_fullsized":"2023-09-13T06:02:57.154101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:52.140701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114704+0000","last_change":"2023-09-13T06:02:55.574172+0000","last_active":"2023-09-13T06:02:57.114704+0000","last_peered":"2023-09-13T06:02:57.114704+0000","last_clean":"2023-09-13T06:02:57.114704+0000","last_became_active":"2023-09-13T06:02:55.571330+0000","last_became_peered":"2023-09-13T06:02:55.571330+0000","last_unstale":"2023-09-13T06:02:57.114704+0000","last_undegraded":"2023-09-13T06:02:57.114704+0000","last_fullsized":"2023-09-13T06:02:57.114704+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:32:17.561545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114353+0000","last_change":"2023-09-13T06:02:55.576592+0000","last_active":"2023-09-13T06:02:57.114353+0000","last_peered":"2023-09-13T06:02:57.114353+0000","last_clean":"2023-09-13T06:02:57.114353+0000","last_became_active":"2023-09-13T06:02:55.575224+0000","last_became_peered":"2023-09-13T06:02:55.575224+0000","last_unstale":"2023-09-13T06:02:57.114353+0000","last_undegraded":"2023-09-13T06:02:57.114353+0000","last_fullsized":"2023-09-13T06:02:57.114353+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:34:30.195506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114943+0000","last_change":"2023-09-13T06:02:55.569550+0000","last_active":"2023-09-13T06:02:57.114943+0000","last_peered":"2023-09-13T06:02:57.114943+0000","last_clean":"2023-09-13T06:02:57.114943+0000","last_became_active":"2023-09-13T06:02:55.567920+0000","last_became_peered":"2023-09-13T06:02:55.567920+0000","last_unstale":"2023-09-13T06:02:57.114943+0000","last_undegraded":"2023-09-13T06:02:57.114943+0000","last_fullsized":"2023-09-13T06:02:57.114943+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:11:29.352933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153836+0000","last_change":"2023-09-13T06:02:55.573937+0000","last_active":"2023-09-13T06:02:57.153836+0000","last_peered":"2023-09-13T06:02:57.153836+0000","last_clean":"2023-09-13T06:02:57.153836+0000","last_became_active":"2023-09-13T06:02:55.573729+0000","last_became_peered":"2023-09-13T06:02:55.573729+0000","last_unstale":"2023-09-13T06:02:57.153836+0000","last_undegraded":"2023-09-13T06:02:57.153836+0000","last_fullsized":"2023-09-13T06:02:57.153836+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:34:29.520875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115116+0000","last_change":"2023-09-13T06:02:55.569491+0000","last_active":"2023-09-13T06:02:57.115116+0000","last_peered":"2023-09-13T06:02:57.115116+0000","last_clean":"2023-09-13T06:02:57.115116+0000","last_became_active":"2023-09-13T06:02:55.567375+0000","last_became_peered":"2023-09-13T06:02:55.567375+0000","last_unstale":"2023-09-13T06:02:57.115116+0000","last_undegraded":"2023-09-13T06:02:57.115116+0000","last_fullsized":"2023-09-13T06:02:57.115116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:36:44.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560414+0000","last_change":"2023-09-13T06:02:55.569984+0000","last_active":"2023-09-13T06:02:56.560414+0000","last_peered":"2023-09-13T06:02:56.560414+0000","last_clean":"2023-09-13T06:02:56.560414+0000","last_became_active":"2023-09-13T06:02:55.569744+0000","last_became_peered":"2023-09-13T06:02:55.569744+0000","last_unstale":"2023-09-13T06:02:56.560414+0000","last_undegraded":"2023-09-13T06:02:56.560414+0000","last_fullsized":"2023-09-13T06:02:56.560414+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:37.929114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114619+0000","last_change":"2023-09-13T06:02:55.575620+0000","last_active":"2023-09-13T06:02:57.114619+0000","last_peered":"2023-09-13T06:02:57.114619+0000","last_clean":"2023-09-13T06:02:57.114619+0000","last_became_active":"2023-09-13T06:02:55.574431+0000","last_became_peered":"2023-09-13T06:02:55.574431+0000","last_unstale":"2023-09-13T06:02:57.114619+0000","last_undegraded":"2023-09-13T06:02:57.114619+0000","last_fullsized":"2023-09-13T06:02:57.114619+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:04:46.769004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115377+0000","last_change":"2023-09-13T06:02:55.567658+0000","last_active":"2023-09-13T06:02:57.115377+0000","last_peered":"2023-09-13T06:02:57.115377+0000","last_clean":"2023-09-13T06:02:57.115377+0000","last_became_active":"2023-09-13T06:02:55.567280+0000","last_became_peered":"2023-09-13T06:02:55.567280+0000","last_unstale":"2023-09-13T06:02:57.115377+0000","last_undegraded":"2023-09-13T06:02:57.115377+0000","last_fullsized":"2023-09-13T06:02:57.115377+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:54.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561115+0000","last_change":"2023-09-13T06:02:55.566159+0000","last_active":"2023-09-13T06:02:56.561115+0000","last_peered":"2023-09-13T06:02:56.561115+0000","last_clean":"2023-09-13T06:02:56.561115+0000","last_became_active":"2023-09-13T06:02:55.565600+0000","last_became_peered":"2023-09-13T06:02:55.565600+0000","last_unstale":"2023-09-13T06:02:56.561115+0000","last_undegraded":"2023-09-13T06:02:56.561115+0000","last_fullsized":"2023-09-13T06:02:56.561115+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:21:14.123686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153705+0000","last_change":"2023-09-13T06:02:55.571221+0000","last_active":"2023-09-13T06:02:57.153705+0000","last_peered":"2023-09-13T06:02:57.153705+0000","last_clean":"2023-09-13T06:02:57.153705+0000","last_became_active":"2023-09-13T06:02:55.571005+0000","last_became_peered":"2023-09-13T06:02:55.571005+0000","last_unstale":"2023-09-13T06:02:57.153705+0000","last_undegraded":"2023-09-13T06:02:57.153705+0000","last_fullsized":"2023-09-13T06:02:57.153705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:48.044030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115239+0000","last_change":"2023-09-13T06:02:55.569767+0000","last_active":"2023-09-13T06:02:57.115239+0000","last_peered":"2023-09-13T06:02:57.115239+0000","last_clean":"2023-09-13T06:02:57.115239+0000","last_became_active":"2023-09-13T06:02:55.569428+0000","last_became_peered":"2023-09-13T06:02:55.569428+0000","last_unstale":"2023-09-13T06:02:57.115239+0000","last_undegraded":"2023-09-13T06:02:57.115239+0000","last_fullsized":"2023-09-13T06:02:57.115239+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:33.201660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588141+0000","last_change":"2023-09-13T06:02:54.553420+0000","last_active":"2023-09-13T06:02:55.588141+0000","last_peered":"2023-09-13T06:02:55.588141+0000","last_clean":"2023-09-13T06:02:55.588141+0000","last_became_active":"2023-09-13T06:02:54.553123+0000","last_became_peered":"2023-09-13T06:02:54.553123+0000","last_unstale":"2023-09-13T06:02:55.588141+0000","last_undegraded":"2023-09-13T06:02:55.588141+0000","last_fullsized":"2023-09-13T06:02:55.588141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:13:21.882042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114425+0000","last_change":"2023-09-13T06:02:55.570480+0000","last_active":"2023-09-13T06:02:57.114425+0000","last_peered":"2023-09-13T06:02:57.114425+0000","last_clean":"2023-09-13T06:02:57.114425+0000","last_became_active":"2023-09-13T06:02:55.570180+0000","last_became_peered":"2023-09-13T06:02:55.570180+0000","last_unstale":"2023-09-13T06:02:57.114425+0000","last_undegraded":"2023-09-13T06:02:57.114425+0000","last_fullsized":"2023-09-13T06:02:57.114425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:54:10.681181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.586829+0000","last_change":"2023-09-13T06:02:54.550251+0000","last_active":"2023-09-13T06:02:55.586829+0000","last_peered":"2023-09-13T06:02:55.586829+0000","last_clean":"2023-09-13T06:02:55.586829+0000","last_became_active":"2023-09-13T06:02:54.549938+0000","last_became_peered":"2023-09-13T06:02:54.549938+0000","last_unstale":"2023-09-13T06:02:55.586829+0000","last_undegraded":"2023-09-13T06:02:55.586829+0000","last_fullsized":"2023-09-13T06:02:55.586829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:18:10.382110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560494+0000","last_change":"2023-09-13T06:02:55.564456+0000","last_active":"2023-09-13T06:02:56.560494+0000","last_peered":"2023-09-13T06:02:56.560494+0000","last_clean":"2023-09-13T06:02:56.560494+0000","last_became_active":"2023-09-13T06:02:55.564223+0000","last_became_peered":"2023-09-13T06:02:55.564223+0000","last_unstale":"2023-09-13T06:02:56.560494+0000","last_undegraded":"2023-09-13T06:02:56.560494+0000","last_fullsized":"2023-09-13T06:02:56.560494+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:48.470117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588197+0000","last_change":"2023-09-13T06:02:54.547570+0000","last_active":"2023-09-13T06:02:55.588197+0000","last_peered":"2023-09-13T06:02:55.588197+0000","last_clean":"2023-09-13T06:02:55.588197+0000","last_became_active":"2023-09-13T06:02:54.546154+0000","last_became_peered":"2023-09-13T06:02:54.546154+0000","last_unstale":"2023-09-13T06:02:55.588197+0000","last_undegraded":"2023-09-13T06:02:55.588197+0000","last_fullsized":"2023-09-13T06:02:55.588197+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115288+0000","last_change":"2023-09-13T06:02:55.571812+0000","last_active":"2023-09-13T06:02:57.115288+0000","last_peered":"2023-09-13T06:02:57.115288+0000","last_clean":"2023-09-13T06:02:57.115288+0000","last_became_active":"2023-09-13T06:02:55.571348+0000","last_became_peered":"2023-09-13T06:02:55.571348+0000","last_unstale":"2023-09-13T06:02:57.115288+0000","last_undegraded":"2023-09-13T06:02:57.115288+0000","last_fullsized":"2023-09-13T06:02:57.115288+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:28.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.584816+0000","last_change":"2023-09-13T06:02:54.553822+0000","last_active":"2023-09-13T06:02:55.584816+0000","last_peered":"2023-09-13T06:02:55.584816+0000","last_clean":"2023-09-13T06:02:55.584816+0000","last_became_active":"2023-09-13T06:02:54.552921+0000","last_became_peered":"2023-09-13T06:02:54.552921+0000","last_unstale":"2023-09-13T06:02:55.584816+0000","last_undegraded":"2023-09-13T06:02:55.584816+0000","last_fullsized":"2023-09-13T06:02:55.584816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:36.921705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114644+0000","last_change":"2023-09-13T06:02:55.571954+0000","last_active":"2023-09-13T06:02:57.114644+0000","last_peered":"2023-09-13T06:02:57.114644+0000","last_clean":"2023-09-13T06:02:57.114644+0000","last_became_active":"2023-09-13T06:02:55.571685+0000","last_became_peered":"2023-09-13T06:02:55.571685+0000","last_unstale":"2023-09-13T06:02:57.114644+0000","last_undegraded":"2023-09-13T06:02:57.114644+0000","last_fullsized":"2023-09-13T06:02:57.114644+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:37.579372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.586558+0000","last_change":"2023-09-13T06:02:54.542145+0000","last_active":"2023-09-13T06:02:55.586558+0000","last_peered":"2023-09-13T06:02:55.586558+0000","last_clean":"2023-09-13T06:02:55.586558+0000","last_became_active":"2023-09-13T06:02:54.541895+0000","last_became_peered":"2023-09-13T06:02:54.541895+0000","last_unstale":"2023-09-13T06:02:55.586558+0000","last_undegraded":"2023-09-13T06:02:55.586558+0000","last_fullsized":"2023-09-13T06:02:55.586558+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:29.046660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154185+0000","last_change":"2023-09-13T06:02:55.573275+0000","last_active":"2023-09-13T06:02:57.154185+0000","last_peered":"2023-09-13T06:02:57.154185+0000","last_clean":"2023-09-13T06:02:57.154185+0000","last_became_active":"2023-09-13T06:02:55.572872+0000","last_became_peered":"2023-09-13T06:02:55.572872+0000","last_unstale":"2023-09-13T06:02:57.154185+0000","last_undegraded":"2023-09-13T06:02:57.154185+0000","last_fullsized":"2023-09-13T06:02:57.154185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:27.803689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587245+0000","last_change":"2023-09-13T06:02:54.549413+0000","last_active":"2023-09-13T06:02:55.587245+0000","last_peered":"2023-09-13T06:02:55.587245+0000","last_clean":"2023-09-13T06:02:55.587245+0000","last_became_active":"2023-09-13T06:02:54.549098+0000","last_became_peered":"2023-09-13T06:02:54.549098+0000","last_unstale":"2023-09-13T06:02:55.587245+0000","last_undegraded":"2023-09-13T06:02:55.587245+0000","last_fullsized":"2023-09-13T06:02:55.587245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:50:46.710928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154083+0000","last_change":"2023-09-13T06:02:55.573786+0000","last_active":"2023-09-13T06:02:57.154083+0000","last_peered":"2023-09-13T06:02:57.154083+0000","last_clean":"2023-09-13T06:02:57.154083+0000","last_became_active":"2023-09-13T06:02:55.573021+0000","last_became_peered":"2023-09-13T06:02:55.573021+0000","last_unstale":"2023-09-13T06:02:57.154083+0000","last_undegraded":"2023-09-13T06:02:57.154083+0000","last_fullsized":"2023-09-13T06:02:57.154083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:39.312149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.560234+0000","last_change":"2023-09-13T06:02:54.544890+0000","last_active":"2023-09-13T06:02:55.560234+0000","last_peered":"2023-09-13T06:02:55.560234+0000","last_clean":"2023-09-13T06:02:55.560234+0000","last_became_active":"2023-09-13T06:02:54.544610+0000","last_became_peered":"2023-09-13T06:02:54.544610+0000","last_unstale":"2023-09-13T06:02:55.560234+0000","last_undegraded":"2023-09-13T06:02:55.560234+0000","last_fullsized":"2023-09-13T06:02:55.560234+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:27.218457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114749+0000","last_change":"2023-09-13T06:02:55.575799+0000","last_active":"2023-09-13T06:02:57.114749+0000","last_peered":"2023-09-13T06:02:57.114749+0000","last_clean":"2023-09-13T06:02:57.114749+0000","last_became_active":"2023-09-13T06:02:55.574735+0000","last_became_peered":"2023-09-13T06:02:55.574735+0000","last_unstale":"2023-09-13T06:02:57.114749+0000","last_undegraded":"2023-09-13T06:02:57.114749+0000","last_fullsized":"2023-09-13T06:02:57.114749+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:06:59.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563741+0000","last_change":"2023-09-13T06:02:54.555524+0000","last_active":"2023-09-13T06:02:55.563741+0000","last_peered":"2023-09-13T06:02:55.563741+0000","last_clean":"2023-09-13T06:02:55.563741+0000","last_became_active":"2023-09-13T06:02:54.554282+0000","last_became_peered":"2023-09-13T06:02:54.554282+0000","last_unstale":"2023-09-13T06:02:55.563741+0000","last_undegraded":"2023-09-13T06:02:55.563741+0000","last_fullsized":"2023-09-13T06:02:55.563741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:12:41.106016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115200+0000","last_change":"2023-09-13T06:02:55.569138+0000","last_active":"2023-09-13T06:02:57.115200+0000","last_peered":"2023-09-13T06:02:57.115200+0000","last_clean":"2023-09-13T06:02:57.115200+0000","last_became_active":"2023-09-13T06:02:55.567098+0000","last_became_peered":"2023-09-13T06:02:55.567098+0000","last_unstale":"2023-09-13T06:02:57.115200+0000","last_undegraded":"2023-09-13T06:02:57.115200+0000","last_fullsized":"2023-09-13T06:02:57.115200+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:13:22.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.561278+0000","last_change":"2023-09-13T06:02:54.552886+0000","last_active":"2023-09-13T06:02:55.561278+0000","last_peered":"2023-09-13T06:02:55.561278+0000","last_clean":"2023-09-13T06:02:55.561278+0000","last_became_active":"2023-09-13T06:02:54.552612+0000","last_became_peered":"2023-09-13T06:02:54.552612+0000","last_unstale":"2023-09-13T06:02:55.561278+0000","last_undegraded":"2023-09-13T06:02:55.561278+0000","last_fullsized":"2023-09-13T06:02:55.561278+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:13:12.802256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561324+0000","last_change":"2023-09-13T06:02:55.569126+0000","last_active":"2023-09-13T06:02:56.561324+0000","last_peered":"2023-09-13T06:02:56.561324+0000","last_clean":"2023-09-13T06:02:56.561324+0000","last_became_active":"2023-09-13T06:02:55.567387+0000","last_became_peered":"2023-09-13T06:02:55.567387+0000","last_unstale":"2023-09-13T06:02:56.561324+0000","last_undegraded":"2023-09-13T06:02:56.561324+0000","last_fullsized":"2023-09-13T06:02:56.561324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.562440+0000","last_change":"2023-09-13T06:02:54.550521+0000","last_active":"2023-09-13T06:02:55.562440+0000","last_peered":"2023-09-13T06:02:55.562440+0000","last_clean":"2023-09-13T06:02:55.562440+0000","last_became_active":"2023-09-13T06:02:54.550233+0000","last_became_peered":"2023-09-13T06:02:54.550233+0000","last_unstale":"2023-09-13T06:02:55.562440+0000","last_undegraded":"2023-09-13T06:02:55.562440+0000","last_fullsized":"2023-09-13T06:02:55.562440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:11:28.345524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560882+0000","last_change":"2023-09-13T06:02:55.572306+0000","last_active":"2023-09-13T06:02:56.560882+0000","last_peered":"2023-09-13T06:02:56.560882+0000","last_clean":"2023-09-13T06:02:56.560882+0000","last_became_active":"2023-09-13T06:02:55.571811+0000","last_became_peered":"2023-09-13T06:02:55.571811+0000","last_unstale":"2023-09-13T06:02:56.560882+0000","last_undegraded":"2023-09-13T06:02:56.560882+0000","last_fullsized":"2023-09-13T06:02:56.560882+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:44.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.585287+0000","last_change":"2023-09-13T06:02:54.552381+0000","last_active":"2023-09-13T06:02:55.585287+0000","last_peered":"2023-09-13T06:02:55.585287+0000","last_clean":"2023-09-13T06:02:55.585287+0000","last_became_active":"2023-09-13T06:02:54.552037+0000","last_became_peered":"2023-09-13T06:02:54.552037+0000","last_unstale":"2023-09-13T06:02:55.585287+0000","last_undegraded":"2023-09-13T06:02:55.585287+0000","last_fullsized":"2023-09-13T06:02:55.585287+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:50:39.893124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560710+0000","last_change":"2023-09-13T06:02:55.564858+0000","last_active":"2023-09-13T06:02:56.560710+0000","last_peered":"2023-09-13T06:02:56.560710+0000","last_clean":"2023-09-13T06:02:56.560710+0000","last_became_active":"2023-09-13T06:02:55.564604+0000","last_became_peered":"2023-09-13T06:02:55.564604+0000","last_unstale":"2023-09-13T06:02:56.560710+0000","last_undegraded":"2023-09-13T06:02:56.560710+0000","last_fullsized":"2023-09-13T06:02:56.560710+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:17:43.885392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588927+0000","last_change":"2023-09-13T06:02:54.549352+0000","last_active":"2023-09-13T06:02:55.588927+0000","last_peered":"2023-09-13T06:02:55.588927+0000","last_clean":"2023-09-13T06:02:55.588927+0000","last_became_active":"2023-09-13T06:02:54.549113+0000","last_became_peered":"2023-09-13T06:02:54.549113+0000","last_unstale":"2023-09-13T06:02:55.588927+0000","last_undegraded":"2023-09-13T06:02:55.588927+0000","last_fullsized":"2023-09-13T06:02:55.588927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:08:58.059162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114514+0000","last_change":"2023-09-13T06:02:55.573919+0000","last_active":"2023-09-13T06:02:57.114514+0000","last_peered":"2023-09-13T06:02:57.114514+0000","last_clean":"2023-09-13T06:02:57.114514+0000","last_became_active":"2023-09-13T06:02:55.570600+0000","last_became_peered":"2023-09-13T06:02:55.570600+0000","last_unstale":"2023-09-13T06:02:57.114514+0000","last_undegraded":"2023-09-13T06:02:57.114514+0000","last_fullsized":"2023-09-13T06:02:57.114514+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:21:32.233802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587540+0000","last_change":"2023-09-13T06:02:54.548194+0000","last_active":"2023-09-13T06:02:55.587540+0000","last_peered":"2023-09-13T06:02:55.587540+0000","last_clean":"2023-09-13T06:02:55.587540+0000","last_became_active":"2023-09-13T06:02:54.547973+0000","last_became_peered":"2023-09-13T06:02:54.547973+0000","last_unstale":"2023-09-13T06:02:55.587540+0000","last_undegraded":"2023-09-13T06:02:55.587540+0000","last_fullsized":"2023-09-13T06:02:55.587540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:36.921705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154163+0000","last_change":"2023-09-13T06:02:55.567612+0000","last_active":"2023-09-13T06:02:57.154163+0000","last_peered":"2023-09-13T06:02:57.154163+0000","last_clean":"2023-09-13T06:02:57.154163+0000","last_became_active":"2023-09-13T06:02:55.567338+0000","last_became_peered":"2023-09-13T06:02:55.567338+0000","last_unstale":"2023-09-13T06:02:57.154163+0000","last_undegraded":"2023-09-13T06:02:57.154163+0000","last_fullsized":"2023-09-13T06:02:57.154163+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:26:27.736729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.562019+0000","last_change":"2023-09-13T06:02:54.553482+0000","last_active":"2023-09-13T06:02:55.562019+0000","last_peered":"2023-09-13T06:02:55.562019+0000","last_clean":"2023-09-13T06:02:55.562019+0000","last_became_active":"2023-09-13T06:02:54.550885+0000","last_became_peered":"2023-09-13T06:02:54.550885+0000","last_unstale":"2023-09-13T06:02:55.562019+0000","last_undegraded":"2023-09-13T06:02:55.562019+0000","last_fullsized":"2023-09-13T06:02:55.562019+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:29.046660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560705+0000","last_change":"2023-09-13T06:02:55.571558+0000","last_active":"2023-09-13T06:02:56.560705+0000","last_peered":"2023-09-13T06:02:56.560705+0000","last_clean":"2023-09-13T06:02:56.560705+0000","last_became_active":"2023-09-13T06:02:55.571251+0000","last_became_peered":"2023-09-13T06:02:55.571251+0000","last_unstale":"2023-09-13T06:02:56.560705+0000","last_undegraded":"2023-09-13T06:02:56.560705+0000","last_fullsized":"2023-09-13T06:02:56.560705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:03:57.908839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559344+0000","last_change":"2023-09-13T06:02:54.548947+0000","last_active":"2023-09-13T06:02:55.559344+0000","last_peered":"2023-09-13T06:02:55.559344+0000","last_clean":"2023-09-13T06:02:55.559344+0000","last_became_active":"2023-09-13T06:02:54.548729+0000","last_became_peered":"2023-09-13T06:02:54.548729+0000","last_unstale":"2023-09-13T06:02:55.559344+0000","last_undegraded":"2023-09-13T06:02:55.559344+0000","last_fullsized":"2023-09-13T06:02:55.559344+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:38.304740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560371+0000","last_change":"2023-09-13T06:02:55.575609+0000","last_active":"2023-09-13T06:02:56.560371+0000","last_peered":"2023-09-13T06:02:56.560371+0000","last_clean":"2023-09-13T06:02:56.560371+0000","last_became_active":"2023-09-13T06:02:55.575372+0000","last_became_peered":"2023-09-13T06:02:55.575372+0000","last_unstale":"2023-09-13T06:02:56.560371+0000","last_undegraded":"2023-09-13T06:02:56.560371+0000","last_fullsized":"2023-09-13T06:02:56.560371+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:31:40.315456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588745+0000","last_change":"2023-09-13T06:02:54.549606+0000","last_active":"2023-09-13T06:02:55.588745+0000","last_peered":"2023-09-13T06:02:55.588745+0000","last_clean":"2023-09-13T06:02:55.588745+0000","last_became_active":"2023-09-13T06:02:54.549385+0000","last_became_peered":"2023-09-13T06:02:54.549385+0000","last_unstale":"2023-09-13T06:02:55.588745+0000","last_undegraded":"2023-09-13T06:02:55.588745+0000","last_fullsized":"2023-09-13T06:02:55.588745+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153897+0000","last_change":"2023-09-13T06:02:55.570594+0000","last_active":"2023-09-13T06:02:57.153897+0000","last_peered":"2023-09-13T06:02:57.153897+0000","last_clean":"2023-09-13T06:02:57.153897+0000","last_became_active":"2023-09-13T06:02:55.570387+0000","last_became_peered":"2023-09-13T06:02:55.570387+0000","last_unstale":"2023-09-13T06:02:57.153897+0000","last_undegraded":"2023-09-13T06:02:57.153897+0000","last_fullsized":"2023-09-13T06:02:57.153897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:30:42.957097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.584236+0000","last_change":"2023-09-13T06:02:54.543232+0000","last_active":"2023-09-13T06:02:55.584236+0000","last_peered":"2023-09-13T06:02:55.584236+0000","last_clean":"2023-09-13T06:02:55.584236+0000","last_became_active":"2023-09-13T06:02:54.542975+0000","last_became_peered":"2023-09-13T06:02:54.542975+0000","last_unstale":"2023-09-13T06:02:55.584236+0000","last_undegraded":"2023-09-13T06:02:55.584236+0000","last_fullsized":"2023-09-13T06:02:55.584236+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:35:14.538719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154448+0000","last_change":"2023-09-13T06:02:55.568883+0000","last_active":"2023-09-13T06:02:57.154448+0000","last_peered":"2023-09-13T06:02:57.154448+0000","last_clean":"2023-09-13T06:02:57.154448+0000","last_became_active":"2023-09-13T06:02:55.568626+0000","last_became_peered":"2023-09-13T06:02:55.568626+0000","last_unstale":"2023-09-13T06:02:57.154448+0000","last_undegraded":"2023-09-13T06:02:57.154448+0000","last_fullsized":"2023-09-13T06:02:57.154448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587128+0000","last_change":"2023-09-13T06:02:54.550074+0000","last_active":"2023-09-13T06:02:55.587128+0000","last_peered":"2023-09-13T06:02:55.587128+0000","last_clean":"2023-09-13T06:02:55.587128+0000","last_became_active":"2023-09-13T06:02:54.549799+0000","last_became_peered":"2023-09-13T06:02:54.549799+0000","last_unstale":"2023-09-13T06:02:55.587128+0000","last_undegraded":"2023-09-13T06:02:55.587128+0000","last_fullsized":"2023-09-13T06:02:55.587128+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114440+0000","last_change":"2023-09-13T06:02:55.574493+0000","last_active":"2023-09-13T06:02:57.114440+0000","last_peered":"2023-09-13T06:02:57.114440+0000","last_clean":"2023-09-13T06:02:57.114440+0000","last_became_active":"2023-09-13T06:02:55.574261+0000","last_became_peered":"2023-09-13T06:02:55.574261+0000","last_unstale":"2023-09-13T06:02:57.114440+0000","last_undegraded":"2023-09-13T06:02:57.114440+0000","last_fullsized":"2023-09-13T06:02:57.114440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:13:13.809666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587139+0000","last_change":"2023-09-13T06:02:54.545656+0000","last_active":"2023-09-13T06:02:55.587139+0000","last_peered":"2023-09-13T06:02:55.587139+0000","last_clean":"2023-09-13T06:02:55.587139+0000","last_became_active":"2023-09-13T06:02:54.545040+0000","last_became_peered":"2023-09-13T06:02:54.545040+0000","last_unstale":"2023-09-13T06:02:55.587139+0000","last_undegraded":"2023-09-13T06:02:55.587139+0000","last_fullsized":"2023-09-13T06:02:55.587139+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:36.571962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114674+0000","last_change":"2023-09-13T06:02:55.570275+0000","last_active":"2023-09-13T06:02:57.114674+0000","last_peered":"2023-09-13T06:02:57.114674+0000","last_clean":"2023-09-13T06:02:57.114674+0000","last_became_active":"2023-09-13T06:02:55.569867+0000","last_became_peered":"2023-09-13T06:02:55.569867+0000","last_unstale":"2023-09-13T06:02:57.114674+0000","last_undegraded":"2023-09-13T06:02:57.114674+0000","last_fullsized":"2023-09-13T06:02:57.114674+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:38.732543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559471+0000","last_change":"2023-09-13T06:02:54.551437+0000","last_active":"2023-09-13T06:02:55.559471+0000","last_peered":"2023-09-13T06:02:55.559471+0000","last_clean":"2023-09-13T06:02:55.559471+0000","last_became_active":"2023-09-13T06:02:54.551207+0000","last_became_peered":"2023-09-13T06:02:54.551207+0000","last_unstale":"2023-09-13T06:02:55.559471+0000","last_undegraded":"2023-09-13T06:02:55.559471+0000","last_fullsized":"2023-09-13T06:02:55.559471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:16:22.451045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560697+0000","last_change":"2023-09-13T06:02:55.572167+0000","last_active":"2023-09-13T06:02:56.560697+0000","last_peered":"2023-09-13T06:02:56.560697+0000","last_clean":"2023-09-13T06:02:56.560697+0000","last_became_active":"2023-09-13T06:02:55.571528+0000","last_became_peered":"2023-09-13T06:02:55.571528+0000","last_unstale":"2023-09-13T06:02:56.560697+0000","last_undegraded":"2023-09-13T06:02:56.560697+0000","last_fullsized":"2023-09-13T06:02:56.560697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587418+0000","last_change":"2023-09-13T06:02:54.542740+0000","last_active":"2023-09-13T06:02:55.587418+0000","last_peered":"2023-09-13T06:02:55.587418+0000","last_clean":"2023-09-13T06:02:55.587418+0000","last_became_active":"2023-09-13T06:02:54.542497+0000","last_became_peered":"2023-09-13T06:02:54.542497+0000","last_unstale":"2023-09-13T06:02:55.587418+0000","last_undegraded":"2023-09-13T06:02:55.587418+0000","last_fullsized":"2023-09-13T06:02:55.587418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:47.462707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115118+0000","last_change":"2023-09-13T06:02:55.567745+0000","last_active":"2023-09-13T06:02:57.115118+0000","last_peered":"2023-09-13T06:02:57.115118+0000","last_clean":"2023-09-13T06:02:57.115118+0000","last_became_active":"2023-09-13T06:02:55.567535+0000","last_became_peered":"2023-09-13T06:02:55.567535+0000","last_unstale":"2023-09-13T06:02:57.115118+0000","last_undegraded":"2023-09-13T06:02:57.115118+0000","last_fullsized":"2023-09-13T06:02:57.115118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:52:17.036879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.560378+0000","last_change":"2023-09-13T06:02:54.549682+0000","last_active":"2023-09-13T06:02:55.560378+0000","last_peered":"2023-09-13T06:02:55.560378+0000","last_clean":"2023-09-13T06:02:55.560378+0000","last_became_active":"2023-09-13T06:02:54.549467+0000","last_became_peered":"2023-09-13T06:02:54.549467+0000","last_unstale":"2023-09-13T06:02:55.560378+0000","last_undegraded":"2023-09-13T06:02:55.560378+0000","last_fullsized":"2023-09-13T06:02:55.560378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:36:43.156835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153959+0000","last_change":"2023-09-13T06:02:55.574403+0000","last_active":"2023-09-13T06:02:57.153959+0000","last_peered":"2023-09-13T06:02:57.153959+0000","last_clean":"2023-09-13T06:02:57.153959+0000","last_became_active":"2023-09-13T06:02:55.574180+0000","last_became_peered":"2023-09-13T06:02:55.574180+0000","last_unstale":"2023-09-13T06:02:57.153959+0000","last_undegraded":"2023-09-13T06:02:57.153959+0000","last_fullsized":"2023-09-13T06:02:57.153959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:34:30.195506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563869+0000","last_change":"2023-09-13T06:02:54.551857+0000","last_active":"2023-09-13T06:02:55.563869+0000","last_peered":"2023-09-13T06:02:55.563869+0000","last_clean":"2023-09-13T06:02:55.563869+0000","last_became_active":"2023-09-13T06:02:54.551624+0000","last_became_peered":"2023-09-13T06:02:54.551624+0000","last_unstale":"2023-09-13T06:02:55.563869+0000","last_undegraded":"2023-09-13T06:02:55.563869+0000","last_fullsized":"2023-09-13T06:02:55.563869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:36:43.156835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154247+0000","last_change":"2023-09-13T06:02:55.567084+0000","last_active":"2023-09-13T06:02:57.154247+0000","last_peered":"2023-09-13T06:02:57.154247+0000","last_clean":"2023-09-13T06:02:57.154247+0000","last_became_active":"2023-09-13T06:02:55.566832+0000","last_became_peered":"2023-09-13T06:02:55.566832+0000","last_unstale":"2023-09-13T06:02:57.154247+0000","last_undegraded":"2023-09-13T06:02:57.154247+0000","last_fullsized":"2023-09-13T06:02:57.154247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:31:40.315456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.562146+0000","last_change":"2023-09-13T06:02:54.553655+0000","last_active":"2023-09-13T06:02:55.562146+0000","last_peered":"2023-09-13T06:02:55.562146+0000","last_clean":"2023-09-13T06:02:55.562146+0000","last_became_active":"2023-09-13T06:02:54.551344+0000","last_became_peered":"2023-09-13T06:02:54.551344+0000","last_unstale":"2023-09-13T06:02:55.562146+0000","last_undegraded":"2023-09-13T06:02:55.562146+0000","last_fullsized":"2023-09-13T06:02:55.562146+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:47.462707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114605+0000","last_change":"2023-09-13T06:02:55.573999+0000","last_active":"2023-09-13T06:02:57.114605+0000","last_peered":"2023-09-13T06:02:57.114605+0000","last_clean":"2023-09-13T06:02:57.114605+0000","last_became_active":"2023-09-13T06:02:55.570987+0000","last_became_peered":"2023-09-13T06:02:55.570987+0000","last_unstale":"2023-09-13T06:02:57.114605+0000","last_undegraded":"2023-09-13T06:02:57.114605+0000","last_fullsized":"2023-09-13T06:02:57.114605+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:49:08.555964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559374+0000","last_change":"2023-09-13T06:02:54.550539+0000","last_active":"2023-09-13T06:02:55.559374+0000","last_peered":"2023-09-13T06:02:55.559374+0000","last_clean":"2023-09-13T06:02:55.559374+0000","last_became_active":"2023-09-13T06:02:54.550282+0000","last_became_peered":"2023-09-13T06:02:54.550282+0000","last_unstale":"2023-09-13T06:02:55.559374+0000","last_undegraded":"2023-09-13T06:02:55.559374+0000","last_fullsized":"2023-09-13T06:02:55.559374+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:51.133291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154322+0000","last_change":"2023-09-13T06:02:55.573567+0000","last_active":"2023-09-13T06:02:57.154322+0000","last_peered":"2023-09-13T06:02:57.154322+0000","last_clean":"2023-09-13T06:02:57.154322+0000","last_became_active":"2023-09-13T06:02:55.572708+0000","last_became_peered":"2023-09-13T06:02:55.572708+0000","last_unstale":"2023-09-13T06:02:57.154322+0000","last_undegraded":"2023-09-13T06:02:57.154322+0000","last_fullsized":"2023-09-13T06:02:57.154322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:47.080838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.560055+0000","last_change":"2023-09-13T06:02:54.551715+0000","last_active":"2023-09-13T06:02:55.560055+0000","last_peered":"2023-09-13T06:02:55.560055+0000","last_clean":"2023-09-13T06:02:55.560055+0000","last_became_active":"2023-09-13T06:02:54.551508+0000","last_became_peered":"2023-09-13T06:02:54.551508+0000","last_unstale":"2023-09-13T06:02:55.560055+0000","last_undegraded":"2023-09-13T06:02:55.560055+0000","last_fullsized":"2023-09-13T06:02:55.560055+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:10.886278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560290+0000","last_change":"2023-09-13T06:02:55.568555+0000","last_active":"2023-09-13T06:02:56.560290+0000","last_peered":"2023-09-13T06:02:56.560290+0000","last_clean":"2023-09-13T06:02:56.560290+0000","last_became_active":"2023-09-13T06:02:55.568188+0000","last_became_peered":"2023-09-13T06:02:55.568188+0000","last_unstale":"2023-09-13T06:02:56.560290+0000","last_undegraded":"2023-09-13T06:02:56.560290+0000","last_fullsized":"2023-09-13T06:02:56.560290+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:27.803689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563170+0000","last_change":"2023-09-13T06:02:54.547697+0000","last_active":"2023-09-13T06:02:55.563170+0000","last_peered":"2023-09-13T06:02:55.563170+0000","last_clean":"2023-09-13T06:02:55.563170+0000","last_became_active":"2023-09-13T06:02:54.546477+0000","last_became_peered":"2023-09-13T06:02:54.546477+0000","last_unstale":"2023-09-13T06:02:55.563170+0000","last_undegraded":"2023-09-13T06:02:55.563170+0000","last_fullsized":"2023-09-13T06:02:55.563170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:32:16.554135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560725+0000","last_change":"2023-09-13T06:02:55.564878+0000","last_active":"2023-09-13T06:02:56.560725+0000","last_peered":"2023-09-13T06:02:56.560725+0000","last_clean":"2023-09-13T06:02:56.560725+0000","last_became_active":"2023-09-13T06:02:55.564647+0000","last_became_peered":"2023-09-13T06:02:55.564647+0000","last_unstale":"2023-09-13T06:02:56.560725+0000","last_undegraded":"2023-09-13T06:02:56.560725+0000","last_fullsized":"2023-09-13T06:02:56.560725+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:39.317324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.562271+0000","last_change":"2023-09-13T06:02:54.554045+0000","last_active":"2023-09-13T06:02:55.562271+0000","last_peered":"2023-09-13T06:02:55.562271+0000","last_clean":"2023-09-13T06:02:55.562271+0000","last_became_active":"2023-09-13T06:02:54.553239+0000","last_became_peered":"2023-09-13T06:02:54.553239+0000","last_unstale":"2023-09-13T06:02:55.562271+0000","last_undegraded":"2023-09-13T06:02:55.562271+0000","last_fullsized":"2023-09-13T06:02:55.562271+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:38.304740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561187+0000","last_change":"2023-09-13T06:02:55.570627+0000","last_active":"2023-09-13T06:02:56.561187+0000","last_peered":"2023-09-13T06:02:56.561187+0000","last_clean":"2023-09-13T06:02:56.561187+0000","last_became_active":"2023-09-13T06:02:55.570379+0000","last_became_peered":"2023-09-13T06:02:55.570379+0000","last_unstale":"2023-09-13T06:02:56.561187+0000","last_undegraded":"2023-09-13T06:02:56.561187+0000","last_fullsized":"2023-09-13T06:02:56.561187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:06.965866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.566148+0000","last_change":"2023-09-13T06:02:54.548719+0000","last_active":"2023-09-13T06:02:55.566148+0000","last_peered":"2023-09-13T06:02:55.566148+0000","last_clean":"2023-09-13T06:02:55.566148+0000","last_became_active":"2023-09-13T06:02:54.548445+0000","last_became_peered":"2023-09-13T06:02:54.548445+0000","last_unstale":"2023-09-13T06:02:55.566148+0000","last_undegraded":"2023-09-13T06:02:55.566148+0000","last_fullsized":"2023-09-13T06:02:55.566148+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:32.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560700+0000","last_change":"2023-09-13T06:02:55.565447+0000","last_active":"2023-09-13T06:02:56.560700+0000","last_peered":"2023-09-13T06:02:56.560700+0000","last_clean":"2023-09-13T06:02:56.560700+0000","last_became_active":"2023-09-13T06:02:55.565164+0000","last_became_peered":"2023-09-13T06:02:55.565164+0000","last_unstale":"2023-09-13T06:02:56.560700+0000","last_undegraded":"2023-09-13T06:02:56.560700+0000","last_fullsized":"2023-09-13T06:02:56.560700+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:39.312149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.564799+0000","last_change":"2023-09-13T06:02:54.552935+0000","last_active":"2023-09-13T06:02:55.564799+0000","last_peered":"2023-09-13T06:02:55.564799+0000","last_clean":"2023-09-13T06:02:55.564799+0000","last_became_active":"2023-09-13T06:02:54.552709+0000","last_became_peered":"2023-09-13T06:02:54.552709+0000","last_unstale":"2023-09-13T06:02:55.564799+0000","last_undegraded":"2023-09-13T06:02:55.564799+0000","last_fullsized":"2023-09-13T06:02:55.564799+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:06:58.669309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114922+0000","last_change":"2023-09-13T06:02:55.569691+0000","last_active":"2023-09-13T06:02:57.114922+0000","last_peered":"2023-09-13T06:02:57.114922+0000","last_clean":"2023-09-13T06:02:57.114922+0000","last_became_active":"2023-09-13T06:02:55.568717+0000","last_became_peered":"2023-09-13T06:02:55.568717+0000","last_unstale":"2023-09-13T06:02:57.114922+0000","last_undegraded":"2023-09-13T06:02:57.114922+0000","last_fullsized":"2023-09-13T06:02:57.114922+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:50:40.900533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563150+0000","last_change":"2023-09-13T06:02:54.554295+0000","last_active":"2023-09-13T06:02:55.563150+0000","last_peered":"2023-09-13T06:02:55.563150+0000","last_clean":"2023-09-13T06:02:55.563150+0000","last_became_active":"2023-09-13T06:02:54.553764+0000","last_became_peered":"2023-09-13T06:02:54.553764+0000","last_unstale":"2023-09-13T06:02:55.563150+0000","last_undegraded":"2023-09-13T06:02:55.563150+0000","last_fullsized":"2023-09-13T06:02:55.563150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:36.571962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153857+0000","last_change":"2023-09-13T06:02:55.566022+0000","last_active":"2023-09-13T06:02:57.153857+0000","last_peered":"2023-09-13T06:02:57.153857+0000","last_clean":"2023-09-13T06:02:57.153857+0000","last_became_active":"2023-09-13T06:02:55.565405+0000","last_became_peered":"2023-09-13T06:02:55.565405+0000","last_unstale":"2023-09-13T06:02:57.153857+0000","last_undegraded":"2023-09-13T06:02:57.153857+0000","last_fullsized":"2023-09-13T06:02:57.153857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:37.929114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587499+0000","last_change":"2023-09-13T06:02:54.546553+0000","last_active":"2023-09-13T06:02:55.587499+0000","last_peered":"2023-09-13T06:02:55.587499+0000","last_clean":"2023-09-13T06:02:55.587499+0000","last_became_active":"2023-09-13T06:02:54.546197+0000","last_became_peered":"2023-09-13T06:02:54.546197+0000","last_unstale":"2023-09-13T06:02:55.587499+0000","last_undegraded":"2023-09-13T06:02:55.587499+0000","last_fullsized":"2023-09-13T06:02:55.587499+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:10.886278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.560178+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:02:55.560178+0000","last_peered":"2023-09-13T06:02:55.560178+0000","last_clean":"2023-09-13T06:02:55.560178+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:02:55.560178+0000","last_undegraded":"2023-09-13T06:02:55.560178+0000","last_fullsized":"2023-09-13T06:02:55.560178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195931,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65600000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.629},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.73799999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.67300000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.68400000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.54200000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785717,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.54500000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.628},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.68600000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.63800000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.70499999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786319,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.72299999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.82399999999999995}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65900000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.629},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.78800000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.60899999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784777,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.79300000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53100000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.623}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54700000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.76900000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.67800000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.628},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.60199999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.5}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.41399999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.505}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.371},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.88700000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.91300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786319,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.48799999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.2150000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.878},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.1140000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":1.2769999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195987,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40000000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.627}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.53000000000000003}]}]}],"pool_statfs":[]}} 2023-09-13T06:03:04.452 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:03:04.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc09a910640 1 Processor -- start 2023-09-13T06:03:04.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc09a910640 1 -- start start 2023-09-13T06:03:04.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc09a910640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 0x7fc094070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:04.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc09a910640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc094070f90 con 0x7fc094146d40 2023-09-13T06:03:04.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc09a910640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc094071270 con 0x7fc094072030 2023-09-13T06:03:04.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc09a910640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940cf140 con 0x7fc09406dea0 2023-09-13T06:03:04.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc093fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc094146d40 0x7fc09406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46126/0 (socket says 172.21.15.130:46126) 2023-09-13T06:03:04.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc093fff640 1 -- 172.21.15.130:0/1627407003 learned_addr learned my addr 172.21.15.130:0/1627407003 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:04.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc0937fe640 1 --2- 172.21.15.130:0/1627407003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 0x7fc094070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:04.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc092ffd640 1 -- 172.21.15.130:0/1627407003 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725675229 0 0) 0x7fc094070f90 con 0x7fc094146d40 2023-09-13T06:03:04.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc092ffd640 1 -- 172.21.15.130:0/1627407003 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc07c003530 con 0x7fc094146d40 2023-09-13T06:03:04.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc092ffd640 1 -- 172.21.15.130:0/1627407003 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511101048 0 0) 0x7fc094071270 con 0x7fc094072030 2023-09-13T06:03:04.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc092ffd640 1 -- 172.21.15.130:0/1627407003 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc094070f90 con 0x7fc094072030 2023-09-13T06:03:04.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc0937fe640 1 -- 172.21.15.130:0/1627407003 >> v1:172.21.15.164:6789/0 conn(0x7fc094072030 legacy=0x7fc0940707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:04.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc0937fe640 1 -- 172.21.15.130:0/1627407003 >> v1:172.21.15.130:6789/0 conn(0x7fc094146d40 legacy=0x7fc09406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:04.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.599+0000 7fc0937fe640 1 -- 172.21.15.130:0/1627407003 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094071550 con 0x7fc09406dea0 2023-09-13T06:03:04.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.603+0000 7fc0937fe640 1 --2- 172.21.15.130:0/1627407003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 0x7fc094070280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0880097f0 tx=0x7fc08801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f98b7970819636c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:04.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc092ffd640 1 -- 172.21.15.130:0/1627407003 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880aa5f0 con 0x7fc09406dea0 2023-09-13T06:03:04.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc092ffd640 1 -- 172.21.15.130:0/1627407003 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0880aa750 con 0x7fc09406dea0 2023-09-13T06:03:04.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc092ffd640 1 -- 172.21.15.130:0/1627407003 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880aaae0 con 0x7fc09406dea0 2023-09-13T06:03:04.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc09a910640 1 -- 172.21.15.130:0/1627407003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 msgr2=0x7fc094070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:04.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc09a910640 1 --2- 172.21.15.130:0/1627407003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 0x7fc094070280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0880097f0 tx=0x7fc08801c4b0 comp rx=0 tx=0).stop 2023-09-13T06:03:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc09a910640 1 -- 172.21.15.130:0/1627407003 shutdown_connections 2023-09-13T06:03:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc09a910640 1 --2- 172.21.15.130:0/1627407003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 0x7fc094070280 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc09a910640 1 -- 172.21.15.130:0/1627407003 >> 172.21.15.130:0/1627407003 conn(0x7fc09406a2f0 msgr2=0x7fc09406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc09a910640 1 -- 172.21.15.130:0/1627407003 shutdown_connections 2023-09-13T06:03:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc09a910640 1 -- 172.21.15.130:0/1627407003 wait complete. 2023-09-13T06:03:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc09a910640 1 Processor -- start 2023-09-13T06:03:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.607+0000 7fc09a910640 1 -- start start 2023-09-13T06:03:04.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc09a910640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 0x7fc094159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:04.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc09a910640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094072030 0x7fc09413b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:04.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc09a910640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094146d40 0x7fc09413cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:04.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc09a910640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0941571f0 con 0x7fc094146d40 2023-09-13T06:03:04.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc09a910640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09413da20 con 0x7fc094072030 2023-09-13T06:03:04.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc09a910640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09413dcc0 con 0x7fc09406dea0 2023-09-13T06:03:04.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc098ead640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094146d40 0x7fc09413cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:04.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc098ead640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094146d40 0x7fc09413cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52474/0 (socket says 172.21.15.130:52474) 2023-09-13T06:03:04.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc098ead640 1 -- 172.21.15.130:0/570788044 learned_addr learned my addr 172.21.15.130:0/570788044 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:04.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc093fff640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 0x7fc094159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:04.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc0937fe640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094072030 0x7fc09413b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc098ead640 1 -- 172.21.15.130:0/570788044 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 msgr2=0x7fc094159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc098ead640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 0x7fc094159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc098ead640 1 -- 172.21.15.130:0/570788044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094072030 msgr2=0x7fc09413b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc098ead640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094072030 0x7fc09413b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc098ead640 1 -- 172.21.15.130:0/570788044 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088009420 con 0x7fc094146d40 2023-09-13T06:03:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc093fff640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 0x7fc094159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc0937fe640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094072030 0x7fc09413b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc098ead640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094146d40 0x7fc09413cd50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00c790 tx=0x7fc08c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc090ff9640 1 -- 172.21.15.130:0/570788044 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00cea0 con 0x7fc094146d40 2023-09-13T06:03:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc09a910640 1 -- 172.21.15.130:0/570788044 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09413dfa0 con 0x7fc094146d40 2023-09-13T06:03:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc090ff9640 1 -- 172.21.15.130:0/570788044 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c003b80 con 0x7fc094146d40 2023-09-13T06:03:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc090ff9640 1 -- 172.21.15.130:0/570788044 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00a850 con 0x7fc094146d40 2023-09-13T06:03:04.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc09a910640 1 -- 172.21.15.130:0/570788044 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0940cd3f0 con 0x7fc094146d40 2023-09-13T06:03:04.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.611+0000 7fc09a910640 1 -- 172.21.15.130:0/570788044 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0940618a0 con 0x7fc094146d40 2023-09-13T06:03:04.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.615+0000 7fc090ff9640 1 -- 172.21.15.130:0/570788044 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc08c00a9b0 con 0x7fc094146d40 2023-09-13T06:03:04.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.615+0000 7fc090ff9640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc080065b20 0x7fc080067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:04.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.615+0000 7fc090ff9640 1 -- 172.21.15.130:0/570788044 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc08c083270 con 0x7fc094146d40 2023-09-13T06:03:04.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.615+0000 7fc093fff640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc080065b20 0x7fc080067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:04.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.615+0000 7fc093fff640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc080065b20 0x7fc080067fe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc0840011f0 tx=0x7fc084009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:04.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.619+0000 7fc090ff9640 1 -- 172.21.15.130:0/570788044 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc08c050b20 con 0x7fc094146d40 2023-09-13T06:03:04.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.767+0000 7fc09a910640 1 -- 172.21.15.130:0/570788044 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc09413e190 con 0x7fc080065b20 2023-09-13T06:03:04.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.775+0000 7fc090ff9640 1 -- 172.21.15.130:0/570788044 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285188 (secure 0 0 0) 0x7fc09413e190 con 0x7fc080065b20 2023-09-13T06:03:04.779 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:04.783 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:03:04.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 -- 172.21.15.130:0/570788044 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc080065b20 msgr2=0x7fc080067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:04.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc080065b20 0x7fc080067fe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc0840011f0 tx=0x7fc084009040 comp rx=0 tx=0).stop 2023-09-13T06:03:04.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 -- 172.21.15.130:0/570788044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094146d40 msgr2=0x7fc09413cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:04.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094146d40 0x7fc09413cd50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00c790 tx=0x7fc08c00cc50 comp rx=0 tx=0).stop 2023-09-13T06:03:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 -- 172.21.15.130:0/570788044 shutdown_connections 2023-09-13T06:03:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc080065b20 0x7fc080067fe0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094072030 0x7fc09413b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc094146d40 0x7fc09413cd50 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 --2- 172.21.15.130:0/570788044 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc09406dea0 0x7fc094159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 -- 172.21.15.130:0/570788044 >> 172.21.15.130:0/570788044 conn(0x7fc09406a2f0 msgr2=0x7fc094155e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 -- 172.21.15.130:0/570788044 shutdown_connections 2023-09-13T06:03:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.779+0000 7fc09a910640 1 -- 172.21.15.130:0/570788044 wait complete. 2023-09-13T06:03:04.801 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-09-13T06:03:04.554934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2826,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559673,"statfs":{"total":1600000000,"available":1597105556,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.995553"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561193+0000","last_change":"2023-09-13T06:02:55.568864+0000","last_active":"2023-09-13T06:02:56.561193+0000","last_peered":"2023-09-13T06:02:56.561193+0000","last_clean":"2023-09-13T06:02:56.561193+0000","last_became_active":"2023-09-13T06:02:55.566152+0000","last_became_peered":"2023-09-13T06:02:55.566152+0000","last_unstale":"2023-09-13T06:02:56.561193+0000","last_undegraded":"2023-09-13T06:02:56.561193+0000","last_fullsized":"2023-09-13T06:02:56.561193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:47.080838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560290+0000","last_change":"2023-09-13T06:02:55.565126+0000","last_active":"2023-09-13T06:02:56.560290+0000","last_peered":"2023-09-13T06:02:56.560290+0000","last_clean":"2023-09-13T06:02:56.560290+0000","last_became_active":"2023-09-13T06:02:55.564752+0000","last_became_peered":"2023-09-13T06:02:55.564752+0000","last_unstale":"2023-09-13T06:02:56.560290+0000","last_undegraded":"2023-09-13T06:02:56.560290+0000","last_fullsized":"2023-09-13T06:02:56.560290+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:54.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114779+0000","last_change":"2023-09-13T06:02:55.570002+0000","last_active":"2023-09-13T06:02:57.114779+0000","last_peered":"2023-09-13T06:02:57.114779+0000","last_clean":"2023-09-13T06:02:57.114779+0000","last_became_active":"2023-09-13T06:02:55.569454+0000","last_became_peered":"2023-09-13T06:02:55.569454+0000","last_unstale":"2023-09-13T06:02:57.114779+0000","last_undegraded":"2023-09-13T06:02:57.114779+0000","last_fullsized":"2023-09-13T06:02:57.114779+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:23.150613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154162+0000","last_change":"2023-09-13T06:02:55.576304+0000","last_active":"2023-09-13T06:02:57.154162+0000","last_peered":"2023-09-13T06:02:57.154162+0000","last_clean":"2023-09-13T06:02:57.154162+0000","last_became_active":"2023-09-13T06:02:55.576093+0000","last_became_peered":"2023-09-13T06:02:55.576093+0000","last_unstale":"2023-09-13T06:02:57.154162+0000","last_undegraded":"2023-09-13T06:02:57.154162+0000","last_fullsized":"2023-09-13T06:02:57.154162+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:16:23.458455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560774+0000","last_change":"2023-09-13T06:02:55.564070+0000","last_active":"2023-09-13T06:02:56.560774+0000","last_peered":"2023-09-13T06:02:56.560774+0000","last_clean":"2023-09-13T06:02:56.560774+0000","last_became_active":"2023-09-13T06:02:55.563819+0000","last_became_peered":"2023-09-13T06:02:55.563819+0000","last_unstale":"2023-09-13T06:02:56.560774+0000","last_undegraded":"2023-09-13T06:02:56.560774+0000","last_fullsized":"2023-09-13T06:02:56.560774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:52.140701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560881+0000","last_change":"2023-09-13T06:02:55.566320+0000","last_active":"2023-09-13T06:02:56.560881+0000","last_peered":"2023-09-13T06:02:56.560881+0000","last_clean":"2023-09-13T06:02:56.560881+0000","last_became_active":"2023-09-13T06:02:55.565921+0000","last_became_peered":"2023-09-13T06:02:55.565921+0000","last_unstale":"2023-09-13T06:02:56.560881+0000","last_undegraded":"2023-09-13T06:02:56.560881+0000","last_fullsized":"2023-09-13T06:02:56.560881+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:33:20.937865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560237+0000","last_change":"2023-09-13T06:02:55.564224+0000","last_active":"2023-09-13T06:02:56.560237+0000","last_peered":"2023-09-13T06:02:56.560237+0000","last_clean":"2023-09-13T06:02:56.560237+0000","last_became_active":"2023-09-13T06:02:55.563912+0000","last_became_peered":"2023-09-13T06:02:55.563912+0000","last_unstale":"2023-09-13T06:02:56.560237+0000","last_undegraded":"2023-09-13T06:02:56.560237+0000","last_fullsized":"2023-09-13T06:02:56.560237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:26:27.736729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153727+0000","last_change":"2023-09-13T06:02:55.573024+0000","last_active":"2023-09-13T06:02:57.153727+0000","last_peered":"2023-09-13T06:02:57.153727+0000","last_clean":"2023-09-13T06:02:57.153727+0000","last_became_active":"2023-09-13T06:02:55.572812+0000","last_became_peered":"2023-09-13T06:02:55.572812+0000","last_unstale":"2023-09-13T06:02:57.153727+0000","last_undegraded":"2023-09-13T06:02:57.153727+0000","last_fullsized":"2023-09-13T06:02:57.153727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:54.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154313+0000","last_change":"2023-09-13T06:02:55.571715+0000","last_active":"2023-09-13T06:02:57.154313+0000","last_peered":"2023-09-13T06:02:57.154313+0000","last_clean":"2023-09-13T06:02:57.154313+0000","last_became_active":"2023-09-13T06:02:55.571192+0000","last_became_peered":"2023-09-13T06:02:55.571192+0000","last_unstale":"2023-09-13T06:02:57.154313+0000","last_undegraded":"2023-09-13T06:02:57.154313+0000","last_fullsized":"2023-09-13T06:02:57.154313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:17:43.885392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153946+0000","last_change":"2023-09-13T06:02:55.575986+0000","last_active":"2023-09-13T06:02:57.153946+0000","last_peered":"2023-09-13T06:02:57.153946+0000","last_clean":"2023-09-13T06:02:57.153946+0000","last_became_active":"2023-09-13T06:02:55.575791+0000","last_became_peered":"2023-09-13T06:02:55.575791+0000","last_unstale":"2023-09-13T06:02:57.153946+0000","last_undegraded":"2023-09-13T06:02:57.153946+0000","last_fullsized":"2023-09-13T06:02:57.153946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:30.054070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154032+0000","last_change":"2023-09-13T06:02:55.565063+0000","last_active":"2023-09-13T06:02:57.154032+0000","last_peered":"2023-09-13T06:02:57.154032+0000","last_clean":"2023-09-13T06:02:57.154032+0000","last_became_active":"2023-09-13T06:02:55.564847+0000","last_became_peered":"2023-09-13T06:02:55.564847+0000","last_unstale":"2023-09-13T06:02:57.154032+0000","last_undegraded":"2023-09-13T06:02:57.154032+0000","last_fullsized":"2023-09-13T06:02:57.154032+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:48.470117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560448+0000","last_change":"2023-09-13T06:02:55.570230+0000","last_active":"2023-09-13T06:02:56.560448+0000","last_peered":"2023-09-13T06:02:56.560448+0000","last_clean":"2023-09-13T06:02:56.560448+0000","last_became_active":"2023-09-13T06:02:55.569986+0000","last_became_peered":"2023-09-13T06:02:55.569986+0000","last_unstale":"2023-09-13T06:02:56.560448+0000","last_undegraded":"2023-09-13T06:02:56.560448+0000","last_fullsized":"2023-09-13T06:02:56.560448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:30.054070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153708+0000","last_change":"2023-09-13T06:02:55.569821+0000","last_active":"2023-09-13T06:02:57.153708+0000","last_peered":"2023-09-13T06:02:57.153708+0000","last_clean":"2023-09-13T06:02:57.153708+0000","last_became_active":"2023-09-13T06:02:55.569596+0000","last_became_peered":"2023-09-13T06:02:55.569596+0000","last_unstale":"2023-09-13T06:02:57.153708+0000","last_undegraded":"2023-09-13T06:02:57.153708+0000","last_fullsized":"2023-09-13T06:02:57.153708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:17:55.915552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154649+0000","last_change":"2023-09-13T06:02:55.571859+0000","last_active":"2023-09-13T06:02:57.154649+0000","last_peered":"2023-09-13T06:02:57.154649+0000","last_clean":"2023-09-13T06:02:57.154649+0000","last_became_active":"2023-09-13T06:02:55.571512+0000","last_became_peered":"2023-09-13T06:02:55.571512+0000","last_unstale":"2023-09-13T06:02:57.154649+0000","last_undegraded":"2023-09-13T06:02:57.154649+0000","last_fullsized":"2023-09-13T06:02:57.154649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:03:57.908839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560750+0000","last_change":"2023-09-13T06:02:55.566258+0000","last_active":"2023-09-13T06:02:56.560750+0000","last_peered":"2023-09-13T06:02:56.560750+0000","last_clean":"2023-09-13T06:02:56.560750+0000","last_became_active":"2023-09-13T06:02:55.566046+0000","last_became_peered":"2023-09-13T06:02:55.566046+0000","last_unstale":"2023-09-13T06:02:56.560750+0000","last_undegraded":"2023-09-13T06:02:56.560750+0000","last_fullsized":"2023-09-13T06:02:56.560750+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:23:02.216766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114363+0000","last_change":"2023-09-13T06:02:55.574223+0000","last_active":"2023-09-13T06:02:57.114363+0000","last_peered":"2023-09-13T06:02:57.114363+0000","last_clean":"2023-09-13T06:02:57.114363+0000","last_became_active":"2023-09-13T06:02:55.571362+0000","last_became_peered":"2023-09-13T06:02:55.571362+0000","last_unstale":"2023-09-13T06:02:57.114363+0000","last_undegraded":"2023-09-13T06:02:57.114363+0000","last_fullsized":"2023-09-13T06:02:57.114363+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:18:11.389519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114978+0000","last_change":"2023-09-13T06:02:55.566838+0000","last_active":"2023-09-13T06:02:57.114978+0000","last_peered":"2023-09-13T06:02:57.114978+0000","last_clean":"2023-09-13T06:02:57.114978+0000","last_became_active":"2023-09-13T06:02:55.566472+0000","last_became_peered":"2023-09-13T06:02:55.566472+0000","last_unstale":"2023-09-13T06:02:57.114978+0000","last_undegraded":"2023-09-13T06:02:57.114978+0000","last_fullsized":"2023-09-13T06:02:57.114978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:12:42.113425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115164+0000","last_change":"2023-09-13T06:02:55.569839+0000","last_active":"2023-09-13T06:02:57.115164+0000","last_peered":"2023-09-13T06:02:57.115164+0000","last_clean":"2023-09-13T06:02:57.115164+0000","last_became_active":"2023-09-13T06:02:55.569043+0000","last_became_peered":"2023-09-13T06:02:55.569043+0000","last_unstale":"2023-09-13T06:02:57.115164+0000","last_undegraded":"2023-09-13T06:02:57.115164+0000","last_fullsized":"2023-09-13T06:02:57.115164+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:11.893687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115119+0000","last_change":"2023-09-13T06:02:55.575472+0000","last_active":"2023-09-13T06:02:57.115119+0000","last_peered":"2023-09-13T06:02:57.115119+0000","last_clean":"2023-09-13T06:02:57.115119+0000","last_became_active":"2023-09-13T06:02:55.571549+0000","last_became_peered":"2023-09-13T06:02:55.571549+0000","last_unstale":"2023-09-13T06:02:57.115119+0000","last_undegraded":"2023-09-13T06:02:57.115119+0000","last_fullsized":"2023-09-13T06:02:57.115119+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:50:47.718338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153771+0000","last_change":"2023-09-13T06:02:55.573245+0000","last_active":"2023-09-13T06:02:57.153771+0000","last_peered":"2023-09-13T06:02:57.153771+0000","last_clean":"2023-09-13T06:02:57.153771+0000","last_became_active":"2023-09-13T06:02:55.573014+0000","last_became_peered":"2023-09-13T06:02:55.573014+0000","last_unstale":"2023-09-13T06:02:57.153771+0000","last_undegraded":"2023-09-13T06:02:57.153771+0000","last_fullsized":"2023-09-13T06:02:57.153771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:24:16.619149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561006+0000","last_change":"2023-09-13T06:02:55.570152+0000","last_active":"2023-09-13T06:02:56.561006+0000","last_peered":"2023-09-13T06:02:56.561006+0000","last_clean":"2023-09-13T06:02:56.561006+0000","last_became_active":"2023-09-13T06:02:55.569932+0000","last_became_peered":"2023-09-13T06:02:55.569932+0000","last_unstale":"2023-09-13T06:02:56.561006+0000","last_undegraded":"2023-09-13T06:02:56.561006+0000","last_fullsized":"2023-09-13T06:02:56.561006+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:31:37.037162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154101+0000","last_change":"2023-09-13T06:02:55.576177+0000","last_active":"2023-09-13T06:02:57.154101+0000","last_peered":"2023-09-13T06:02:57.154101+0000","last_clean":"2023-09-13T06:02:57.154101+0000","last_became_active":"2023-09-13T06:02:55.575860+0000","last_became_peered":"2023-09-13T06:02:55.575860+0000","last_unstale":"2023-09-13T06:02:57.154101+0000","last_undegraded":"2023-09-13T06:02:57.154101+0000","last_fullsized":"2023-09-13T06:02:57.154101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:52.140701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114704+0000","last_change":"2023-09-13T06:02:55.574172+0000","last_active":"2023-09-13T06:02:57.114704+0000","last_peered":"2023-09-13T06:02:57.114704+0000","last_clean":"2023-09-13T06:02:57.114704+0000","last_became_active":"2023-09-13T06:02:55.571330+0000","last_became_peered":"2023-09-13T06:02:55.571330+0000","last_unstale":"2023-09-13T06:02:57.114704+0000","last_undegraded":"2023-09-13T06:02:57.114704+0000","last_fullsized":"2023-09-13T06:02:57.114704+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:32:17.561545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114353+0000","last_change":"2023-09-13T06:02:55.576592+0000","last_active":"2023-09-13T06:02:57.114353+0000","last_peered":"2023-09-13T06:02:57.114353+0000","last_clean":"2023-09-13T06:02:57.114353+0000","last_became_active":"2023-09-13T06:02:55.575224+0000","last_became_peered":"2023-09-13T06:02:55.575224+0000","last_unstale":"2023-09-13T06:02:57.114353+0000","last_undegraded":"2023-09-13T06:02:57.114353+0000","last_fullsized":"2023-09-13T06:02:57.114353+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:34:30.195506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114943+0000","last_change":"2023-09-13T06:02:55.569550+0000","last_active":"2023-09-13T06:02:57.114943+0000","last_peered":"2023-09-13T06:02:57.114943+0000","last_clean":"2023-09-13T06:02:57.114943+0000","last_became_active":"2023-09-13T06:02:55.567920+0000","last_became_peered":"2023-09-13T06:02:55.567920+0000","last_unstale":"2023-09-13T06:02:57.114943+0000","last_undegraded":"2023-09-13T06:02:57.114943+0000","last_fullsized":"2023-09-13T06:02:57.114943+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:11:29.352933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153836+0000","last_change":"2023-09-13T06:02:55.573937+0000","last_active":"2023-09-13T06:02:57.153836+0000","last_peered":"2023-09-13T06:02:57.153836+0000","last_clean":"2023-09-13T06:02:57.153836+0000","last_became_active":"2023-09-13T06:02:55.573729+0000","last_became_peered":"2023-09-13T06:02:55.573729+0000","last_unstale":"2023-09-13T06:02:57.153836+0000","last_undegraded":"2023-09-13T06:02:57.153836+0000","last_fullsized":"2023-09-13T06:02:57.153836+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:34:29.520875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115116+0000","last_change":"2023-09-13T06:02:55.569491+0000","last_active":"2023-09-13T06:02:57.115116+0000","last_peered":"2023-09-13T06:02:57.115116+0000","last_clean":"2023-09-13T06:02:57.115116+0000","last_became_active":"2023-09-13T06:02:55.567375+0000","last_became_peered":"2023-09-13T06:02:55.567375+0000","last_unstale":"2023-09-13T06:02:57.115116+0000","last_undegraded":"2023-09-13T06:02:57.115116+0000","last_fullsized":"2023-09-13T06:02:57.115116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:36:44.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560414+0000","last_change":"2023-09-13T06:02:55.569984+0000","last_active":"2023-09-13T06:02:56.560414+0000","last_peered":"2023-09-13T06:02:56.560414+0000","last_clean":"2023-09-13T06:02:56.560414+0000","last_became_active":"2023-09-13T06:02:55.569744+0000","last_became_peered":"2023-09-13T06:02:55.569744+0000","last_unstale":"2023-09-13T06:02:56.560414+0000","last_undegraded":"2023-09-13T06:02:56.560414+0000","last_fullsized":"2023-09-13T06:02:56.560414+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:37.929114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114619+0000","last_change":"2023-09-13T06:02:55.575620+0000","last_active":"2023-09-13T06:02:57.114619+0000","last_peered":"2023-09-13T06:02:57.114619+0000","last_clean":"2023-09-13T06:02:57.114619+0000","last_became_active":"2023-09-13T06:02:55.574431+0000","last_became_peered":"2023-09-13T06:02:55.574431+0000","last_unstale":"2023-09-13T06:02:57.114619+0000","last_undegraded":"2023-09-13T06:02:57.114619+0000","last_fullsized":"2023-09-13T06:02:57.114619+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:04:46.769004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115377+0000","last_change":"2023-09-13T06:02:55.567658+0000","last_active":"2023-09-13T06:02:57.115377+0000","last_peered":"2023-09-13T06:02:57.115377+0000","last_clean":"2023-09-13T06:02:57.115377+0000","last_became_active":"2023-09-13T06:02:55.567280+0000","last_became_peered":"2023-09-13T06:02:55.567280+0000","last_unstale":"2023-09-13T06:02:57.115377+0000","last_undegraded":"2023-09-13T06:02:57.115377+0000","last_fullsized":"2023-09-13T06:02:57.115377+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:54.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561115+0000","last_change":"2023-09-13T06:02:55.566159+0000","last_active":"2023-09-13T06:02:56.561115+0000","last_peered":"2023-09-13T06:02:56.561115+0000","last_clean":"2023-09-13T06:02:56.561115+0000","last_became_active":"2023-09-13T06:02:55.565600+0000","last_became_peered":"2023-09-13T06:02:55.565600+0000","last_unstale":"2023-09-13T06:02:56.561115+0000","last_undegraded":"2023-09-13T06:02:56.561115+0000","last_fullsized":"2023-09-13T06:02:56.561115+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:21:14.123686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153705+0000","last_change":"2023-09-13T06:02:55.571221+0000","last_active":"2023-09-13T06:02:57.153705+0000","last_peered":"2023-09-13T06:02:57.153705+0000","last_clean":"2023-09-13T06:02:57.153705+0000","last_became_active":"2023-09-13T06:02:55.571005+0000","last_became_peered":"2023-09-13T06:02:55.571005+0000","last_unstale":"2023-09-13T06:02:57.153705+0000","last_undegraded":"2023-09-13T06:02:57.153705+0000","last_fullsized":"2023-09-13T06:02:57.153705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:48.044030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115239+0000","last_change":"2023-09-13T06:02:55.569767+0000","last_active":"2023-09-13T06:02:57.115239+0000","last_peered":"2023-09-13T06:02:57.115239+0000","last_clean":"2023-09-13T06:02:57.115239+0000","last_became_active":"2023-09-13T06:02:55.569428+0000","last_became_peered":"2023-09-13T06:02:55.569428+0000","last_unstale":"2023-09-13T06:02:57.115239+0000","last_undegraded":"2023-09-13T06:02:57.115239+0000","last_fullsized":"2023-09-13T06:02:57.115239+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:33.201660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588141+0000","last_change":"2023-09-13T06:02:54.553420+0000","last_active":"2023-09-13T06:02:55.588141+0000","last_peered":"2023-09-13T06:02:55.588141+0000","last_clean":"2023-09-13T06:02:55.588141+0000","last_became_active":"2023-09-13T06:02:54.553123+0000","last_became_peered":"2023-09-13T06:02:54.553123+0000","last_unstale":"2023-09-13T06:02:55.588141+0000","last_undegraded":"2023-09-13T06:02:55.588141+0000","last_fullsized":"2023-09-13T06:02:55.588141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:13:21.882042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114425+0000","last_change":"2023-09-13T06:02:55.570480+0000","last_active":"2023-09-13T06:02:57.114425+0000","last_peered":"2023-09-13T06:02:57.114425+0000","last_clean":"2023-09-13T06:02:57.114425+0000","last_became_active":"2023-09-13T06:02:55.570180+0000","last_became_peered":"2023-09-13T06:02:55.570180+0000","last_unstale":"2023-09-13T06:02:57.114425+0000","last_undegraded":"2023-09-13T06:02:57.114425+0000","last_fullsized":"2023-09-13T06:02:57.114425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:54:10.681181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.586829+0000","last_change":"2023-09-13T06:02:54.550251+0000","last_active":"2023-09-13T06:02:55.586829+0000","last_peered":"2023-09-13T06:02:55.586829+0000","last_clean":"2023-09-13T06:02:55.586829+0000","last_became_active":"2023-09-13T06:02:54.549938+0000","last_became_peered":"2023-09-13T06:02:54.549938+0000","last_unstale":"2023-09-13T06:02:55.586829+0000","last_undegraded":"2023-09-13T06:02:55.586829+0000","last_fullsized":"2023-09-13T06:02:55.586829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:18:10.382110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560494+0000","last_change":"2023-09-13T06:02:55.564456+0000","last_active":"2023-09-13T06:02:56.560494+0000","last_peered":"2023-09-13T06:02:56.560494+0000","last_clean":"2023-09-13T06:02:56.560494+0000","last_became_active":"2023-09-13T06:02:55.564223+0000","last_became_peered":"2023-09-13T06:02:55.564223+0000","last_unstale":"2023-09-13T06:02:56.560494+0000","last_undegraded":"2023-09-13T06:02:56.560494+0000","last_fullsized":"2023-09-13T06:02:56.560494+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:48.470117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588197+0000","last_change":"2023-09-13T06:02:54.547570+0000","last_active":"2023-09-13T06:02:55.588197+0000","last_peered":"2023-09-13T06:02:55.588197+0000","last_clean":"2023-09-13T06:02:55.588197+0000","last_became_active":"2023-09-13T06:02:54.546154+0000","last_became_peered":"2023-09-13T06:02:54.546154+0000","last_unstale":"2023-09-13T06:02:55.588197+0000","last_undegraded":"2023-09-13T06:02:55.588197+0000","last_fullsized":"2023-09-13T06:02:55.588197+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115288+0000","last_change":"2023-09-13T06:02:55.571812+0000","last_active":"2023-09-13T06:02:57.115288+0000","last_peered":"2023-09-13T06:02:57.115288+0000","last_clean":"2023-09-13T06:02:57.115288+0000","last_became_active":"2023-09-13T06:02:55.571348+0000","last_became_peered":"2023-09-13T06:02:55.571348+0000","last_unstale":"2023-09-13T06:02:57.115288+0000","last_undegraded":"2023-09-13T06:02:57.115288+0000","last_fullsized":"2023-09-13T06:02:57.115288+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:28.225867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.584816+0000","last_change":"2023-09-13T06:02:54.553822+0000","last_active":"2023-09-13T06:02:55.584816+0000","last_peered":"2023-09-13T06:02:55.584816+0000","last_clean":"2023-09-13T06:02:55.584816+0000","last_became_active":"2023-09-13T06:02:54.552921+0000","last_became_peered":"2023-09-13T06:02:54.552921+0000","last_unstale":"2023-09-13T06:02:55.584816+0000","last_undegraded":"2023-09-13T06:02:55.584816+0000","last_fullsized":"2023-09-13T06:02:55.584816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:36.921705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114644+0000","last_change":"2023-09-13T06:02:55.571954+0000","last_active":"2023-09-13T06:02:57.114644+0000","last_peered":"2023-09-13T06:02:57.114644+0000","last_clean":"2023-09-13T06:02:57.114644+0000","last_became_active":"2023-09-13T06:02:55.571685+0000","last_became_peered":"2023-09-13T06:02:55.571685+0000","last_unstale":"2023-09-13T06:02:57.114644+0000","last_undegraded":"2023-09-13T06:02:57.114644+0000","last_fullsized":"2023-09-13T06:02:57.114644+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:37.579372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.586558+0000","last_change":"2023-09-13T06:02:54.542145+0000","last_active":"2023-09-13T06:02:55.586558+0000","last_peered":"2023-09-13T06:02:55.586558+0000","last_clean":"2023-09-13T06:02:55.586558+0000","last_became_active":"2023-09-13T06:02:54.541895+0000","last_became_peered":"2023-09-13T06:02:54.541895+0000","last_unstale":"2023-09-13T06:02:55.586558+0000","last_undegraded":"2023-09-13T06:02:55.586558+0000","last_fullsized":"2023-09-13T06:02:55.586558+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:29.046660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154185+0000","last_change":"2023-09-13T06:02:55.573275+0000","last_active":"2023-09-13T06:02:57.154185+0000","last_peered":"2023-09-13T06:02:57.154185+0000","last_clean":"2023-09-13T06:02:57.154185+0000","last_became_active":"2023-09-13T06:02:55.572872+0000","last_became_peered":"2023-09-13T06:02:55.572872+0000","last_unstale":"2023-09-13T06:02:57.154185+0000","last_undegraded":"2023-09-13T06:02:57.154185+0000","last_fullsized":"2023-09-13T06:02:57.154185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:27.803689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587245+0000","last_change":"2023-09-13T06:02:54.549413+0000","last_active":"2023-09-13T06:02:55.587245+0000","last_peered":"2023-09-13T06:02:55.587245+0000","last_clean":"2023-09-13T06:02:55.587245+0000","last_became_active":"2023-09-13T06:02:54.549098+0000","last_became_peered":"2023-09-13T06:02:54.549098+0000","last_unstale":"2023-09-13T06:02:55.587245+0000","last_undegraded":"2023-09-13T06:02:55.587245+0000","last_fullsized":"2023-09-13T06:02:55.587245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:50:46.710928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154083+0000","last_change":"2023-09-13T06:02:55.573786+0000","last_active":"2023-09-13T06:02:57.154083+0000","last_peered":"2023-09-13T06:02:57.154083+0000","last_clean":"2023-09-13T06:02:57.154083+0000","last_became_active":"2023-09-13T06:02:55.573021+0000","last_became_peered":"2023-09-13T06:02:55.573021+0000","last_unstale":"2023-09-13T06:02:57.154083+0000","last_undegraded":"2023-09-13T06:02:57.154083+0000","last_fullsized":"2023-09-13T06:02:57.154083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:39.312149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.560234+0000","last_change":"2023-09-13T06:02:54.544890+0000","last_active":"2023-09-13T06:02:55.560234+0000","last_peered":"2023-09-13T06:02:55.560234+0000","last_clean":"2023-09-13T06:02:55.560234+0000","last_became_active":"2023-09-13T06:02:54.544610+0000","last_became_peered":"2023-09-13T06:02:54.544610+0000","last_unstale":"2023-09-13T06:02:55.560234+0000","last_undegraded":"2023-09-13T06:02:55.560234+0000","last_fullsized":"2023-09-13T06:02:55.560234+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:27.218457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114749+0000","last_change":"2023-09-13T06:02:55.575799+0000","last_active":"2023-09-13T06:02:57.114749+0000","last_peered":"2023-09-13T06:02:57.114749+0000","last_clean":"2023-09-13T06:02:57.114749+0000","last_became_active":"2023-09-13T06:02:55.574735+0000","last_became_peered":"2023-09-13T06:02:55.574735+0000","last_unstale":"2023-09-13T06:02:57.114749+0000","last_undegraded":"2023-09-13T06:02:57.114749+0000","last_fullsized":"2023-09-13T06:02:57.114749+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:06:59.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563741+0000","last_change":"2023-09-13T06:02:54.555524+0000","last_active":"2023-09-13T06:02:55.563741+0000","last_peered":"2023-09-13T06:02:55.563741+0000","last_clean":"2023-09-13T06:02:55.563741+0000","last_became_active":"2023-09-13T06:02:54.554282+0000","last_became_peered":"2023-09-13T06:02:54.554282+0000","last_unstale":"2023-09-13T06:02:55.563741+0000","last_undegraded":"2023-09-13T06:02:55.563741+0000","last_fullsized":"2023-09-13T06:02:55.563741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:12:41.106016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115200+0000","last_change":"2023-09-13T06:02:55.569138+0000","last_active":"2023-09-13T06:02:57.115200+0000","last_peered":"2023-09-13T06:02:57.115200+0000","last_clean":"2023-09-13T06:02:57.115200+0000","last_became_active":"2023-09-13T06:02:55.567098+0000","last_became_peered":"2023-09-13T06:02:55.567098+0000","last_unstale":"2023-09-13T06:02:57.115200+0000","last_undegraded":"2023-09-13T06:02:57.115200+0000","last_fullsized":"2023-09-13T06:02:57.115200+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:13:22.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.561278+0000","last_change":"2023-09-13T06:02:54.552886+0000","last_active":"2023-09-13T06:02:55.561278+0000","last_peered":"2023-09-13T06:02:55.561278+0000","last_clean":"2023-09-13T06:02:55.561278+0000","last_became_active":"2023-09-13T06:02:54.552612+0000","last_became_peered":"2023-09-13T06:02:54.552612+0000","last_unstale":"2023-09-13T06:02:55.561278+0000","last_undegraded":"2023-09-13T06:02:55.561278+0000","last_fullsized":"2023-09-13T06:02:55.561278+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:13:12.802256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561324+0000","last_change":"2023-09-13T06:02:55.569126+0000","last_active":"2023-09-13T06:02:56.561324+0000","last_peered":"2023-09-13T06:02:56.561324+0000","last_clean":"2023-09-13T06:02:56.561324+0000","last_became_active":"2023-09-13T06:02:55.567387+0000","last_became_peered":"2023-09-13T06:02:55.567387+0000","last_unstale":"2023-09-13T06:02:56.561324+0000","last_undegraded":"2023-09-13T06:02:56.561324+0000","last_fullsized":"2023-09-13T06:02:56.561324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.562440+0000","last_change":"2023-09-13T06:02:54.550521+0000","last_active":"2023-09-13T06:02:55.562440+0000","last_peered":"2023-09-13T06:02:55.562440+0000","last_clean":"2023-09-13T06:02:55.562440+0000","last_became_active":"2023-09-13T06:02:54.550233+0000","last_became_peered":"2023-09-13T06:02:54.550233+0000","last_unstale":"2023-09-13T06:02:55.562440+0000","last_undegraded":"2023-09-13T06:02:55.562440+0000","last_fullsized":"2023-09-13T06:02:55.562440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:11:28.345524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560882+0000","last_change":"2023-09-13T06:02:55.572306+0000","last_active":"2023-09-13T06:02:56.560882+0000","last_peered":"2023-09-13T06:02:56.560882+0000","last_clean":"2023-09-13T06:02:56.560882+0000","last_became_active":"2023-09-13T06:02:55.571811+0000","last_became_peered":"2023-09-13T06:02:55.571811+0000","last_unstale":"2023-09-13T06:02:56.560882+0000","last_undegraded":"2023-09-13T06:02:56.560882+0000","last_fullsized":"2023-09-13T06:02:56.560882+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:44.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.585287+0000","last_change":"2023-09-13T06:02:54.552381+0000","last_active":"2023-09-13T06:02:55.585287+0000","last_peered":"2023-09-13T06:02:55.585287+0000","last_clean":"2023-09-13T06:02:55.585287+0000","last_became_active":"2023-09-13T06:02:54.552037+0000","last_became_peered":"2023-09-13T06:02:54.552037+0000","last_unstale":"2023-09-13T06:02:55.585287+0000","last_undegraded":"2023-09-13T06:02:55.585287+0000","last_fullsized":"2023-09-13T06:02:55.585287+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:50:39.893124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560710+0000","last_change":"2023-09-13T06:02:55.564858+0000","last_active":"2023-09-13T06:02:56.560710+0000","last_peered":"2023-09-13T06:02:56.560710+0000","last_clean":"2023-09-13T06:02:56.560710+0000","last_became_active":"2023-09-13T06:02:55.564604+0000","last_became_peered":"2023-09-13T06:02:55.564604+0000","last_unstale":"2023-09-13T06:02:56.560710+0000","last_undegraded":"2023-09-13T06:02:56.560710+0000","last_fullsized":"2023-09-13T06:02:56.560710+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:17:43.885392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588927+0000","last_change":"2023-09-13T06:02:54.549352+0000","last_active":"2023-09-13T06:02:55.588927+0000","last_peered":"2023-09-13T06:02:55.588927+0000","last_clean":"2023-09-13T06:02:55.588927+0000","last_became_active":"2023-09-13T06:02:54.549113+0000","last_became_peered":"2023-09-13T06:02:54.549113+0000","last_unstale":"2023-09-13T06:02:55.588927+0000","last_undegraded":"2023-09-13T06:02:55.588927+0000","last_fullsized":"2023-09-13T06:02:55.588927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:08:58.059162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114514+0000","last_change":"2023-09-13T06:02:55.573919+0000","last_active":"2023-09-13T06:02:57.114514+0000","last_peered":"2023-09-13T06:02:57.114514+0000","last_clean":"2023-09-13T06:02:57.114514+0000","last_became_active":"2023-09-13T06:02:55.570600+0000","last_became_peered":"2023-09-13T06:02:55.570600+0000","last_unstale":"2023-09-13T06:02:57.114514+0000","last_undegraded":"2023-09-13T06:02:57.114514+0000","last_fullsized":"2023-09-13T06:02:57.114514+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:21:32.233802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587540+0000","last_change":"2023-09-13T06:02:54.548194+0000","last_active":"2023-09-13T06:02:55.587540+0000","last_peered":"2023-09-13T06:02:55.587540+0000","last_clean":"2023-09-13T06:02:55.587540+0000","last_became_active":"2023-09-13T06:02:54.547973+0000","last_became_peered":"2023-09-13T06:02:54.547973+0000","last_unstale":"2023-09-13T06:02:55.587540+0000","last_undegraded":"2023-09-13T06:02:55.587540+0000","last_fullsized":"2023-09-13T06:02:55.587540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:36.921705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154163+0000","last_change":"2023-09-13T06:02:55.567612+0000","last_active":"2023-09-13T06:02:57.154163+0000","last_peered":"2023-09-13T06:02:57.154163+0000","last_clean":"2023-09-13T06:02:57.154163+0000","last_became_active":"2023-09-13T06:02:55.567338+0000","last_became_peered":"2023-09-13T06:02:55.567338+0000","last_unstale":"2023-09-13T06:02:57.154163+0000","last_undegraded":"2023-09-13T06:02:57.154163+0000","last_fullsized":"2023-09-13T06:02:57.154163+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:26:27.736729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.562019+0000","last_change":"2023-09-13T06:02:54.553482+0000","last_active":"2023-09-13T06:02:55.562019+0000","last_peered":"2023-09-13T06:02:55.562019+0000","last_clean":"2023-09-13T06:02:55.562019+0000","last_became_active":"2023-09-13T06:02:54.550885+0000","last_became_peered":"2023-09-13T06:02:54.550885+0000","last_unstale":"2023-09-13T06:02:55.562019+0000","last_undegraded":"2023-09-13T06:02:55.562019+0000","last_fullsized":"2023-09-13T06:02:55.562019+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:02:29.046660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560705+0000","last_change":"2023-09-13T06:02:55.571558+0000","last_active":"2023-09-13T06:02:56.560705+0000","last_peered":"2023-09-13T06:02:56.560705+0000","last_clean":"2023-09-13T06:02:56.560705+0000","last_became_active":"2023-09-13T06:02:55.571251+0000","last_became_peered":"2023-09-13T06:02:55.571251+0000","last_unstale":"2023-09-13T06:02:56.560705+0000","last_undegraded":"2023-09-13T06:02:56.560705+0000","last_fullsized":"2023-09-13T06:02:56.560705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:03:57.908839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559344+0000","last_change":"2023-09-13T06:02:54.548947+0000","last_active":"2023-09-13T06:02:55.559344+0000","last_peered":"2023-09-13T06:02:55.559344+0000","last_clean":"2023-09-13T06:02:55.559344+0000","last_became_active":"2023-09-13T06:02:54.548729+0000","last_became_peered":"2023-09-13T06:02:54.548729+0000","last_unstale":"2023-09-13T06:02:55.559344+0000","last_undegraded":"2023-09-13T06:02:55.559344+0000","last_fullsized":"2023-09-13T06:02:55.559344+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:38.304740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560371+0000","last_change":"2023-09-13T06:02:55.575609+0000","last_active":"2023-09-13T06:02:56.560371+0000","last_peered":"2023-09-13T06:02:56.560371+0000","last_clean":"2023-09-13T06:02:56.560371+0000","last_became_active":"2023-09-13T06:02:55.575372+0000","last_became_peered":"2023-09-13T06:02:55.575372+0000","last_unstale":"2023-09-13T06:02:56.560371+0000","last_undegraded":"2023-09-13T06:02:56.560371+0000","last_fullsized":"2023-09-13T06:02:56.560371+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:31:40.315456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.588745+0000","last_change":"2023-09-13T06:02:54.549606+0000","last_active":"2023-09-13T06:02:55.588745+0000","last_peered":"2023-09-13T06:02:55.588745+0000","last_clean":"2023-09-13T06:02:55.588745+0000","last_became_active":"2023-09-13T06:02:54.549385+0000","last_became_peered":"2023-09-13T06:02:54.549385+0000","last_unstale":"2023-09-13T06:02:55.588745+0000","last_undegraded":"2023-09-13T06:02:55.588745+0000","last_fullsized":"2023-09-13T06:02:55.588745+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153897+0000","last_change":"2023-09-13T06:02:55.570594+0000","last_active":"2023-09-13T06:02:57.153897+0000","last_peered":"2023-09-13T06:02:57.153897+0000","last_clean":"2023-09-13T06:02:57.153897+0000","last_became_active":"2023-09-13T06:02:55.570387+0000","last_became_peered":"2023-09-13T06:02:55.570387+0000","last_unstale":"2023-09-13T06:02:57.153897+0000","last_undegraded":"2023-09-13T06:02:57.153897+0000","last_fullsized":"2023-09-13T06:02:57.153897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:30:42.957097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.584236+0000","last_change":"2023-09-13T06:02:54.543232+0000","last_active":"2023-09-13T06:02:55.584236+0000","last_peered":"2023-09-13T06:02:55.584236+0000","last_clean":"2023-09-13T06:02:55.584236+0000","last_became_active":"2023-09-13T06:02:54.542975+0000","last_became_peered":"2023-09-13T06:02:54.542975+0000","last_unstale":"2023-09-13T06:02:55.584236+0000","last_undegraded":"2023-09-13T06:02:55.584236+0000","last_fullsized":"2023-09-13T06:02:55.584236+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:35:14.538719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154448+0000","last_change":"2023-09-13T06:02:55.568883+0000","last_active":"2023-09-13T06:02:57.154448+0000","last_peered":"2023-09-13T06:02:57.154448+0000","last_clean":"2023-09-13T06:02:57.154448+0000","last_became_active":"2023-09-13T06:02:55.568626+0000","last_became_peered":"2023-09-13T06:02:55.568626+0000","last_unstale":"2023-09-13T06:02:57.154448+0000","last_undegraded":"2023-09-13T06:02:57.154448+0000","last_fullsized":"2023-09-13T06:02:57.154448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587128+0000","last_change":"2023-09-13T06:02:54.550074+0000","last_active":"2023-09-13T06:02:55.587128+0000","last_peered":"2023-09-13T06:02:55.587128+0000","last_clean":"2023-09-13T06:02:55.587128+0000","last_became_active":"2023-09-13T06:02:54.549799+0000","last_became_peered":"2023-09-13T06:02:54.549799+0000","last_unstale":"2023-09-13T06:02:55.587128+0000","last_undegraded":"2023-09-13T06:02:55.587128+0000","last_fullsized":"2023-09-13T06:02:55.587128+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:37.725134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114440+0000","last_change":"2023-09-13T06:02:55.574493+0000","last_active":"2023-09-13T06:02:57.114440+0000","last_peered":"2023-09-13T06:02:57.114440+0000","last_clean":"2023-09-13T06:02:57.114440+0000","last_became_active":"2023-09-13T06:02:55.574261+0000","last_became_peered":"2023-09-13T06:02:55.574261+0000","last_unstale":"2023-09-13T06:02:57.114440+0000","last_undegraded":"2023-09-13T06:02:57.114440+0000","last_fullsized":"2023-09-13T06:02:57.114440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:13:13.809666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587139+0000","last_change":"2023-09-13T06:02:54.545656+0000","last_active":"2023-09-13T06:02:55.587139+0000","last_peered":"2023-09-13T06:02:55.587139+0000","last_clean":"2023-09-13T06:02:55.587139+0000","last_became_active":"2023-09-13T06:02:54.545040+0000","last_became_peered":"2023-09-13T06:02:54.545040+0000","last_unstale":"2023-09-13T06:02:55.587139+0000","last_undegraded":"2023-09-13T06:02:55.587139+0000","last_fullsized":"2023-09-13T06:02:55.587139+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:36.571962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114674+0000","last_change":"2023-09-13T06:02:55.570275+0000","last_active":"2023-09-13T06:02:57.114674+0000","last_peered":"2023-09-13T06:02:57.114674+0000","last_clean":"2023-09-13T06:02:57.114674+0000","last_became_active":"2023-09-13T06:02:55.569867+0000","last_became_peered":"2023-09-13T06:02:55.569867+0000","last_unstale":"2023-09-13T06:02:57.114674+0000","last_undegraded":"2023-09-13T06:02:57.114674+0000","last_fullsized":"2023-09-13T06:02:57.114674+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:38.732543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.559471+0000","last_change":"2023-09-13T06:02:54.551437+0000","last_active":"2023-09-13T06:02:55.559471+0000","last_peered":"2023-09-13T06:02:55.559471+0000","last_clean":"2023-09-13T06:02:55.559471+0000","last_became_active":"2023-09-13T06:02:54.551207+0000","last_became_peered":"2023-09-13T06:02:54.551207+0000","last_unstale":"2023-09-13T06:02:55.559471+0000","last_undegraded":"2023-09-13T06:02:55.559471+0000","last_fullsized":"2023-09-13T06:02:55.559471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:16:22.451045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560697+0000","last_change":"2023-09-13T06:02:55.572167+0000","last_active":"2023-09-13T06:02:56.560697+0000","last_peered":"2023-09-13T06:02:56.560697+0000","last_clean":"2023-09-13T06:02:56.560697+0000","last_became_active":"2023-09-13T06:02:55.571528+0000","last_became_peered":"2023-09-13T06:02:55.571528+0000","last_unstale":"2023-09-13T06:02:56.560697+0000","last_undegraded":"2023-09-13T06:02:56.560697+0000","last_fullsized":"2023-09-13T06:02:56.560697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:18.016740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587418+0000","last_change":"2023-09-13T06:02:54.542740+0000","last_active":"2023-09-13T06:02:55.587418+0000","last_peered":"2023-09-13T06:02:55.587418+0000","last_clean":"2023-09-13T06:02:55.587418+0000","last_became_active":"2023-09-13T06:02:54.542497+0000","last_became_peered":"2023-09-13T06:02:54.542497+0000","last_unstale":"2023-09-13T06:02:55.587418+0000","last_undegraded":"2023-09-13T06:02:55.587418+0000","last_fullsized":"2023-09-13T06:02:55.587418+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:47.462707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.115118+0000","last_change":"2023-09-13T06:02:55.567745+0000","last_active":"2023-09-13T06:02:57.115118+0000","last_peered":"2023-09-13T06:02:57.115118+0000","last_clean":"2023-09-13T06:02:57.115118+0000","last_became_active":"2023-09-13T06:02:55.567535+0000","last_became_peered":"2023-09-13T06:02:55.567535+0000","last_unstale":"2023-09-13T06:02:57.115118+0000","last_undegraded":"2023-09-13T06:02:57.115118+0000","last_fullsized":"2023-09-13T06:02:57.115118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:52:17.036879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.560378+0000","last_change":"2023-09-13T06:02:54.549682+0000","last_active":"2023-09-13T06:02:55.560378+0000","last_peered":"2023-09-13T06:02:55.560378+0000","last_clean":"2023-09-13T06:02:55.560378+0000","last_became_active":"2023-09-13T06:02:54.549467+0000","last_became_peered":"2023-09-13T06:02:54.549467+0000","last_unstale":"2023-09-13T06:02:55.560378+0000","last_undegraded":"2023-09-13T06:02:55.560378+0000","last_fullsized":"2023-09-13T06:02:55.560378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:36:43.156835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153959+0000","last_change":"2023-09-13T06:02:55.574403+0000","last_active":"2023-09-13T06:02:57.153959+0000","last_peered":"2023-09-13T06:02:57.153959+0000","last_clean":"2023-09-13T06:02:57.153959+0000","last_became_active":"2023-09-13T06:02:55.574180+0000","last_became_peered":"2023-09-13T06:02:55.574180+0000","last_unstale":"2023-09-13T06:02:57.153959+0000","last_undegraded":"2023-09-13T06:02:57.153959+0000","last_fullsized":"2023-09-13T06:02:57.153959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:34:30.195506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563869+0000","last_change":"2023-09-13T06:02:54.551857+0000","last_active":"2023-09-13T06:02:55.563869+0000","last_peered":"2023-09-13T06:02:55.563869+0000","last_clean":"2023-09-13T06:02:55.563869+0000","last_became_active":"2023-09-13T06:02:54.551624+0000","last_became_peered":"2023-09-13T06:02:54.551624+0000","last_unstale":"2023-09-13T06:02:55.563869+0000","last_undegraded":"2023-09-13T06:02:55.563869+0000","last_fullsized":"2023-09-13T06:02:55.563869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:36:43.156835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154247+0000","last_change":"2023-09-13T06:02:55.567084+0000","last_active":"2023-09-13T06:02:57.154247+0000","last_peered":"2023-09-13T06:02:57.154247+0000","last_clean":"2023-09-13T06:02:57.154247+0000","last_became_active":"2023-09-13T06:02:55.566832+0000","last_became_peered":"2023-09-13T06:02:55.566832+0000","last_unstale":"2023-09-13T06:02:57.154247+0000","last_undegraded":"2023-09-13T06:02:57.154247+0000","last_fullsized":"2023-09-13T06:02:57.154247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:31:40.315456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.562146+0000","last_change":"2023-09-13T06:02:54.553655+0000","last_active":"2023-09-13T06:02:55.562146+0000","last_peered":"2023-09-13T06:02:55.562146+0000","last_clean":"2023-09-13T06:02:55.562146+0000","last_became_active":"2023-09-13T06:02:54.551344+0000","last_became_peered":"2023-09-13T06:02:54.551344+0000","last_unstale":"2023-09-13T06:02:55.562146+0000","last_undegraded":"2023-09-13T06:02:55.562146+0000","last_fullsized":"2023-09-13T06:02:55.562146+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:47.462707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114605+0000","last_change":"2023-09-13T06:02:55.573999+0000","last_active":"2023-09-13T06:02:57.114605+0000","last_peered":"2023-09-13T06:02:57.114605+0000","last_clean":"2023-09-13T06:02:57.114605+0000","last_became_active":"2023-09-13T06:02:55.570987+0000","last_became_peered":"2023-09-13T06:02:55.570987+0000","last_unstale":"2023-09-13T06:02:57.114605+0000","last_undegraded":"2023-09-13T06:02:57.114605+0000","last_fullsized":"2023-09-13T06:02:57.114605+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:49:08.555964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561074+0000","last_change":"2023-09-13T06:02:54.550539+0000","last_active":"2023-09-13T06:02:56.561074+0000","last_peered":"2023-09-13T06:02:56.561074+0000","last_clean":"2023-09-13T06:02:56.561074+0000","last_became_active":"2023-09-13T06:02:54.550282+0000","last_became_peered":"2023-09-13T06:02:54.550282+0000","last_unstale":"2023-09-13T06:02:56.561074+0000","last_undegraded":"2023-09-13T06:02:56.561074+0000","last_fullsized":"2023-09-13T06:02:56.561074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:23:51.133291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.154322+0000","last_change":"2023-09-13T06:02:55.573567+0000","last_active":"2023-09-13T06:02:57.154322+0000","last_peered":"2023-09-13T06:02:57.154322+0000","last_clean":"2023-09-13T06:02:57.154322+0000","last_became_active":"2023-09-13T06:02:55.572708+0000","last_became_peered":"2023-09-13T06:02:55.572708+0000","last_unstale":"2023-09-13T06:02:57.154322+0000","last_undegraded":"2023-09-13T06:02:57.154322+0000","last_fullsized":"2023-09-13T06:02:57.154322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:47.080838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.560055+0000","last_change":"2023-09-13T06:02:54.551715+0000","last_active":"2023-09-13T06:02:55.560055+0000","last_peered":"2023-09-13T06:02:55.560055+0000","last_clean":"2023-09-13T06:02:55.560055+0000","last_became_active":"2023-09-13T06:02:54.551508+0000","last_became_peered":"2023-09-13T06:02:54.551508+0000","last_unstale":"2023-09-13T06:02:55.560055+0000","last_undegraded":"2023-09-13T06:02:55.560055+0000","last_fullsized":"2023-09-13T06:02:55.560055+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:10.886278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560290+0000","last_change":"2023-09-13T06:02:55.568555+0000","last_active":"2023-09-13T06:02:56.560290+0000","last_peered":"2023-09-13T06:02:56.560290+0000","last_clean":"2023-09-13T06:02:56.560290+0000","last_became_active":"2023-09-13T06:02:55.568188+0000","last_became_peered":"2023-09-13T06:02:55.568188+0000","last_unstale":"2023-09-13T06:02:56.560290+0000","last_undegraded":"2023-09-13T06:02:56.560290+0000","last_fullsized":"2023-09-13T06:02:56.560290+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:27.803689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563170+0000","last_change":"2023-09-13T06:02:54.547697+0000","last_active":"2023-09-13T06:02:55.563170+0000","last_peered":"2023-09-13T06:02:55.563170+0000","last_clean":"2023-09-13T06:02:55.563170+0000","last_became_active":"2023-09-13T06:02:54.546477+0000","last_became_peered":"2023-09-13T06:02:54.546477+0000","last_unstale":"2023-09-13T06:02:55.563170+0000","last_undegraded":"2023-09-13T06:02:55.563170+0000","last_fullsized":"2023-09-13T06:02:55.563170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:32:16.554135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560725+0000","last_change":"2023-09-13T06:02:55.564878+0000","last_active":"2023-09-13T06:02:56.560725+0000","last_peered":"2023-09-13T06:02:56.560725+0000","last_clean":"2023-09-13T06:02:56.560725+0000","last_became_active":"2023-09-13T06:02:55.564647+0000","last_became_peered":"2023-09-13T06:02:55.564647+0000","last_unstale":"2023-09-13T06:02:56.560725+0000","last_undegraded":"2023-09-13T06:02:56.560725+0000","last_fullsized":"2023-09-13T06:02:56.560725+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:39.317324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.562271+0000","last_change":"2023-09-13T06:02:54.554045+0000","last_active":"2023-09-13T06:02:55.562271+0000","last_peered":"2023-09-13T06:02:55.562271+0000","last_clean":"2023-09-13T06:02:55.562271+0000","last_became_active":"2023-09-13T06:02:54.553239+0000","last_became_peered":"2023-09-13T06:02:54.553239+0000","last_unstale":"2023-09-13T06:02:55.562271+0000","last_undegraded":"2023-09-13T06:02:55.562271+0000","last_fullsized":"2023-09-13T06:02:55.562271+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:38.304740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.561187+0000","last_change":"2023-09-13T06:02:55.570627+0000","last_active":"2023-09-13T06:02:56.561187+0000","last_peered":"2023-09-13T06:02:56.561187+0000","last_clean":"2023-09-13T06:02:56.561187+0000","last_became_active":"2023-09-13T06:02:55.570379+0000","last_became_peered":"2023-09-13T06:02:55.570379+0000","last_unstale":"2023-09-13T06:02:56.561187+0000","last_undegraded":"2023-09-13T06:02:56.561187+0000","last_fullsized":"2023-09-13T06:02:56.561187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:06.965866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.566148+0000","last_change":"2023-09-13T06:02:54.548719+0000","last_active":"2023-09-13T06:02:55.566148+0000","last_peered":"2023-09-13T06:02:55.566148+0000","last_clean":"2023-09-13T06:02:55.566148+0000","last_became_active":"2023-09-13T06:02:54.548445+0000","last_became_peered":"2023-09-13T06:02:54.548445+0000","last_unstale":"2023-09-13T06:02:55.566148+0000","last_undegraded":"2023-09-13T06:02:55.566148+0000","last_fullsized":"2023-09-13T06:02:55.566148+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:49:32.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:56.560700+0000","last_change":"2023-09-13T06:02:55.565447+0000","last_active":"2023-09-13T06:02:56.560700+0000","last_peered":"2023-09-13T06:02:56.560700+0000","last_clean":"2023-09-13T06:02:56.560700+0000","last_became_active":"2023-09-13T06:02:55.565164+0000","last_became_peered":"2023-09-13T06:02:55.565164+0000","last_unstale":"2023-09-13T06:02:56.560700+0000","last_undegraded":"2023-09-13T06:02:56.560700+0000","last_fullsized":"2023-09-13T06:02:56.560700+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:58:39.312149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.564799+0000","last_change":"2023-09-13T06:02:54.552935+0000","last_active":"2023-09-13T06:02:55.564799+0000","last_peered":"2023-09-13T06:02:55.564799+0000","last_clean":"2023-09-13T06:02:55.564799+0000","last_became_active":"2023-09-13T06:02:54.552709+0000","last_became_peered":"2023-09-13T06:02:54.552709+0000","last_unstale":"2023-09-13T06:02:55.564799+0000","last_undegraded":"2023-09-13T06:02:55.564799+0000","last_fullsized":"2023-09-13T06:02:55.564799+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:06:58.669309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.114922+0000","last_change":"2023-09-13T06:02:55.569691+0000","last_active":"2023-09-13T06:02:57.114922+0000","last_peered":"2023-09-13T06:02:57.114922+0000","last_clean":"2023-09-13T06:02:57.114922+0000","last_became_active":"2023-09-13T06:02:55.568717+0000","last_became_peered":"2023-09-13T06:02:55.568717+0000","last_unstale":"2023-09-13T06:02:57.114922+0000","last_undegraded":"2023-09-13T06:02:57.114922+0000","last_fullsized":"2023-09-13T06:02:57.114922+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:50:40.900533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.563150+0000","last_change":"2023-09-13T06:02:54.554295+0000","last_active":"2023-09-13T06:02:55.563150+0000","last_peered":"2023-09-13T06:02:55.563150+0000","last_clean":"2023-09-13T06:02:55.563150+0000","last_became_active":"2023-09-13T06:02:54.553764+0000","last_became_peered":"2023-09-13T06:02:54.553764+0000","last_unstale":"2023-09-13T06:02:55.563150+0000","last_undegraded":"2023-09-13T06:02:55.563150+0000","last_fullsized":"2023-09-13T06:02:55.563150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:36.571962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-13T06:02:57.153857+0000","last_change":"2023-09-13T06:02:55.566022+0000","last_active":"2023-09-13T06:02:57.153857+0000","last_peered":"2023-09-13T06:02:57.153857+0000","last_clean":"2023-09-13T06:02:57.153857+0000","last_became_active":"2023-09-13T06:02:55.565405+0000","last_became_peered":"2023-09-13T06:02:55.565405+0000","last_unstale":"2023-09-13T06:02:57.153857+0000","last_undegraded":"2023-09-13T06:02:57.153857+0000","last_fullsized":"2023-09-13T06:02:57.153857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:54.532518+0000","last_clean_scrub_stamp":"2023-09-13T06:02:54.532518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:43:37.929114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.587499+0000","last_change":"2023-09-13T06:02:54.546553+0000","last_active":"2023-09-13T06:02:55.587499+0000","last_peered":"2023-09-13T06:02:55.587499+0000","last_clean":"2023-09-13T06:02:55.587499+0000","last_became_active":"2023-09-13T06:02:54.546197+0000","last_became_peered":"2023-09-13T06:02:54.546197+0000","last_unstale":"2023-09-13T06:02:55.587499+0000","last_undegraded":"2023-09-13T06:02:55.587499+0000","last_fullsized":"2023-09-13T06:02:55.587499+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:02:53.525108+0000","last_clean_scrub_stamp":"2023-09-13T06:02:53.525108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:10.886278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-09-13T06:02:55.560178+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:02:55.560178+0000","last_peered":"2023-09-13T06:02:55.560178+0000","last_clean":"2023-09-13T06:02:55.560178+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:02:55.560178+0000","last_undegraded":"2023-09-13T06:02:55.560178+0000","last_fullsized":"2023-09-13T06:02:55.560178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.247452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195931,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.64100000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.69099999999999995}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.75600000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.48899999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.61099999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785717,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94699999999999995}]},{"osd":2,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.875}]},{"osd":3,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.92300000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786319,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.83899999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.78900000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.80500000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.748}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.624},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54500000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.51900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784777,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49199999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.439}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67000000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.75700000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78700000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.85999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.42699999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.51900000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.628},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40200000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.56000000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.749},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.61399999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.71899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.48099999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.56200000000000006}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.752}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.624},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.74099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786319,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.50700000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.41399999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65500000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.79000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195987,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.70599999999999996}]},{"osd":2,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.80800000000000005}]},{"osd":4,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.878}]},{"osd":5,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.92200000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.98099999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:02:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.0349999999999999}]}]}],"pool_statfs":[]}} 2023-09-13T06:03:04.807 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T06:03:04.808 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-13T06:03:04.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.983+0000 7f1963140640 1 Processor -- start 2023-09-13T06:03:04.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.983+0000 7f1963140640 1 -- start start 2023-09-13T06:03:04.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f1963140640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f195c144d70 0x7f195c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:04.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f1963140640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0b2780 0x7f195c0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:04.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f1963140640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0b3120 con 0x7f195c0b1460 2023-09-13T06:03:04.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f1963140640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c0b2430 con 0x7f195c144d70 2023-09-13T06:03:04.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f1963140640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0cedb0 con 0x7f195c0b2780 2023-09-13T06:03:04.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f195bfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0b2780 0x7f195c0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:04.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f1960edc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f195c144d70 0x7f195c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:04.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f1960edc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f195c144d70 0x7f195c0ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:58606/0 (socket says 172.21.15.130:58606) 2023-09-13T06:03:04.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f1960edc640 1 -- 172.21.15.130:0/641158782 learned_addr learned my addr 172.21.15.130:0/641158782 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:04.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f195bfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0b2780 0x7f195c0b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:40170/0 (socket says 172.21.15.130:40170) 2023-09-13T06:03:04.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f19616dd640 1 --1- 172.21.15.130:0/641158782 >> v1:172.21.15.164:6789/0 conn(0x7f195c0b1460 0x7f195c0b18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:49086/0 (socket says 172.21.15.130:49086) 2023-09-13T06:03:04.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f195bfff640 1 -- 172.21.15.130:0/641158782 >> v2:172.21.15.164:3300/0 conn(0x7f195c144d70 msgr2=0x7f195c0ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:04.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f195bfff640 1 --2- 172.21.15.130:0/641158782 >> v2:172.21.15.164:3300/0 conn(0x7f195c144d70 0x7f195c0ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:04.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f195bfff640 1 -- 172.21.15.130:0/641158782 >> v1:172.21.15.164:6789/0 conn(0x7f195c0b1460 legacy=0x7f195c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:04.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f195bfff640 1 -- 172.21.15.130:0/641158782 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0b2150 con 0x7f195c0b2780 2023-09-13T06:03:04.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.987+0000 7f1960edc640 1 --2- 172.21.15.130:0/641158782 >> v2:172.21.15.164:3300/0 conn(0x7f195c144d70 0x7f195c0ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:04.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f195bfff640 1 --2- 172.21.15.130:0/641158782 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0b2780 0x7f195c0b2be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19480097c0 tx=0x7f194801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e3c7fd192e67de8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:04.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f195b7fe640 1 -- 172.21.15.130:0/641158782 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19480ab600 con 0x7f195c0b2780 2023-09-13T06:03:04.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f195b7fe640 1 -- 172.21.15.130:0/641158782 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19480a7050 con 0x7f195c0b2780 2023-09-13T06:03:04.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f195b7fe640 1 -- 172.21.15.130:0/641158782 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19480ab980 con 0x7f195c0b2780 2023-09-13T06:03:04.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f1963140640 1 -- 172.21.15.130:0/641158782 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0b2780 msgr2=0x7f195c0b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:04.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f1963140640 1 --2- 172.21.15.130:0/641158782 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0b2780 0x7f195c0b2be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19480097c0 tx=0x7f194801c480 comp rx=0 tx=0).stop 2023-09-13T06:03:04.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f1963140640 1 -- 172.21.15.130:0/641158782 shutdown_connections 2023-09-13T06:03:04.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f1963140640 1 --2- 172.21.15.130:0/641158782 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0b2780 0x7f195c0b2be0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:04.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f1963140640 1 --2- 172.21.15.130:0/641158782 >> v2:172.21.15.164:3300/0 conn(0x7f195c144d70 0x7f195c0ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:04.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f1963140640 1 -- 172.21.15.130:0/641158782 >> 172.21.15.130:0/641158782 conn(0x7f195c065990 msgr2=0x7f195c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:05.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f1963140640 1 -- 172.21.15.130:0/641158782 shutdown_connections 2023-09-13T06:03:05.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f1963140640 1 -- 172.21.15.130:0/641158782 wait complete. 2023-09-13T06:03:05.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.991+0000 7f1963140640 1 Processor -- start 2023-09-13T06:03:05.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f1963140640 1 -- start start 2023-09-13T06:03:05.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f1963140640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f195c0b1460 0x7f195c159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:05.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f1963140640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0b2780 0x7f195c136660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:05.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f1963140640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c144d70 0x7f195c137b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:05.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f1963140640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c136e10 con 0x7f195c0b2780 2023-09-13T06:03:05.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f1963140640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c06e1c0 con 0x7f195c0b1460 2023-09-13T06:03:05.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f1963140640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c137060 con 0x7f195c144d70 2023-09-13T06:03:05.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f195bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0b2780 0x7f195c136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:05.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f195bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0b2780 0x7f195c136660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52484/0 (socket says 172.21.15.130:52484) 2023-09-13T06:03:05.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f195bfff640 1 -- 172.21.15.130:0/775866973 learned_addr learned my addr 172.21.15.130:0/775866973 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:05.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f1960edc640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f195c0b1460 0x7f195c159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:05.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f19616dd640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c144d70 0x7f195c137b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:05.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f195bfff640 1 -- 172.21.15.130:0/775866973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c144d70 msgr2=0x7f195c137b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:05.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f195bfff640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c144d70 0x7f195c137b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f195bfff640 1 -- 172.21.15.130:0/775866973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f195c0b1460 msgr2=0x7f195c159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:05.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f195bfff640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f195c0b1460 0x7f195c159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f195bfff640 1 -- 172.21.15.130:0/775866973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19500094d0 con 0x7f195c0b2780 2023-09-13T06:03:05.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f19616dd640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c144d70 0x7f195c137b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:05.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f195bfff640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0b2780 0x7f195c136660 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f19480ae040 tx=0x7f1948019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:05.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f19597fa640 1 -- 172.21.15.130:0/775866973 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19480b4430 con 0x7f195c0b2780 2023-09-13T06:03:05.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f19597fa640 1 -- 172.21.15.130:0/775866973 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19480b4590 con 0x7f195c0b2780 2023-09-13T06:03:05.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f19597fa640 1 -- 172.21.15.130:0/775866973 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19480b4940 con 0x7f195c0b2780 2023-09-13T06:03:05.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f1963140640 1 -- 172.21.15.130:0/775866973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1948009420 con 0x7f195c0b2780 2023-09-13T06:03:05.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f1963140640 1 -- 172.21.15.130:0/775866973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c137620 con 0x7f195c0b2780 2023-09-13T06:03:05.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.995+0000 7f1963140640 1 -- 172.21.15.130:0/775866973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c06e4a0 con 0x7f195c0b2780 2023-09-13T06:03:05.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.999+0000 7f19597fa640 1 -- 172.21.15.130:0/775866973 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f19480b2040 con 0x7f195c0b2780 2023-09-13T06:03:05.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.999+0000 7f19597fa640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1940065b20 0x7f1940067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:05.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.999+0000 7f19597fa640 1 -- 172.21.15.130:0/775866973 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f194811d1b0 con 0x7f195c0b2780 2023-09-13T06:03:05.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.999+0000 7f1960edc640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1940065b20 0x7f1940067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:05.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:04.999+0000 7f1960edc640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1940065b20 0x7f1940067fe0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f195c15b6c0 tx=0x7f1950009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:05.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.003+0000 7f19597fa640 1 -- 172.21.15.130:0/775866973 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f19480eaa60 con 0x7f195c0b2780 2023-09-13T06:03:05.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.203+0000 7f1963140640 1 -- 172.21.15.130:0/775866973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f195c137810 con 0x7f195c0b2780 2023-09-13T06:03:05.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f19597fa640 1 -- 172.21.15.130:0/775866973 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7f19480ee080 con 0x7f195c0b2780 2023-09-13T06:03:05.215 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:03:05.215 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:03:05.215 INFO:teuthology.orchestra.run.smithi130.stdout: caps mds = "allow" 2023-09-13T06:03:05.216 INFO:teuthology.orchestra.run.smithi130.stdout: caps mon = "allow r" 2023-09-13T06:03:05.216 INFO:teuthology.orchestra.run.smithi130.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-13T06:03:05.217 INFO:teuthology.orchestra.run.smithi130.stderr:updated caps for client.0 2023-09-13T06:03:05.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 -- 172.21.15.130:0/775866973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1940065b20 msgr2=0x7f1940067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:05.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1940065b20 0x7f1940067fe0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f195c15b6c0 tx=0x7f1950009240 comp rx=0 tx=0).stop 2023-09-13T06:03:05.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 -- 172.21.15.130:0/775866973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0b2780 msgr2=0x7f195c136660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:05.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0b2780 0x7f195c136660 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f19480ae040 tx=0x7f1948019220 comp rx=0 tx=0).stop 2023-09-13T06:03:05.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 -- 172.21.15.130:0/775866973 shutdown_connections 2023-09-13T06:03:05.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1940065b20 0x7f1940067fe0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c144d70 0x7f195c137b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0b2780 0x7f195c136660 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 --2- 172.21.15.130:0/775866973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f195c0b1460 0x7f195c159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 -- 172.21.15.130:0/775866973 >> 172.21.15.130:0/775866973 conn(0x7f195c065990 msgr2=0x7f195c0b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:05.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 -- 172.21.15.130:0/775866973 shutdown_connections 2023-09-13T06:03:05.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.211+0000 7f1963140640 1 -- 172.21.15.130:0/775866973 wait complete. 2023-09-13T06:03:05.235 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:03:05.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6dbe9c640 1 Processor -- start 2023-09-13T06:03:05.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6dbe9c640 1 -- start start 2023-09-13T06:03:05.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6dbe9c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6d40d1750 0x7fe6d415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:05.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6dbe9c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d40d1090 0x7fe6d4146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:05.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6dbe9c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d40b63c0 con 0x7fe6d40d1b30 2023-09-13T06:03:05.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6dbe9c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d415dea0 con 0x7fe6d40d1750 2023-09-13T06:03:05.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6dbe9c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d40d0c20 con 0x7fe6d40d1090 2023-09-13T06:03:05.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6d9c38640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6d40d1750 0x7fe6d415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:05.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6d9c38640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6d40d1750 0x7fe6d415d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52490/0 (socket says 172.21.15.130:52490) 2023-09-13T06:03:05.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6d9c38640 1 -- 172.21.15.130:0/754326889 learned_addr learned my addr 172.21.15.130:0/754326889 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:05.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6da439640 1 --1- 172.21.15.130:0/754326889 >> v1:172.21.15.130:6789/0 conn(0x7fe6d40d1b30 0x7fe6d40b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46128/0 (socket says 172.21.15.130:46128) 2023-09-13T06:03:05.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6d9437640 1 --2- 172.21.15.130:0/754326889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d40d1090 0x7fe6d4146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:05.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6d9c38640 1 -- 172.21.15.130:0/754326889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d40d1090 msgr2=0x7fe6d4146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:05.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6d9c38640 1 --2- 172.21.15.130:0/754326889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d40d1090 0x7fe6d4146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6d9c38640 1 -- 172.21.15.130:0/754326889 >> v1:172.21.15.130:6789/0 conn(0x7fe6d40d1b30 legacy=0x7fe6d40b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:05.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6d9c38640 1 -- 172.21.15.130:0/754326889 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d40b6610 con 0x7fe6d40d1750 2023-09-13T06:03:05.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6d8c36640 1 -- 172.21.15.130:0/754326889 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808609749 0 0) 0x7fe6d40b63c0 con 0x7fe6d40d1b30 2023-09-13T06:03:05.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.371+0000 7fe6d9437640 1 --2- 172.21.15.130:0/754326889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d40d1090 0x7fe6d4146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:05.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6d9c38640 1 --2- 172.21.15.130:0/754326889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d40d1750 0x7fe6d415d960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009870 tx=0x7fe6d001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6df933b250164f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:05.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6d8c36640 1 -- 172.21.15.130:0/754326889 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00aa670 con 0x7fe6d40d1750 2023-09-13T06:03:05.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6d8c36640 1 -- 172.21.15.130:0/754326889 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d00aa7d0 con 0x7fe6d40d1750 2023-09-13T06:03:05.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6d8c36640 1 -- 172.21.15.130:0/754326889 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00aab60 con 0x7fe6d40d1750 2023-09-13T06:03:05.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/754326889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d40d1750 msgr2=0x7fe6d415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:05.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6dbe9c640 1 --2- 172.21.15.130:0/754326889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d40d1750 0x7fe6d415d960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009870 tx=0x7fe6d001c510 comp rx=0 tx=0).stop 2023-09-13T06:03:05.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/754326889 shutdown_connections 2023-09-13T06:03:05.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6dbe9c640 1 --2- 172.21.15.130:0/754326889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d40d1090 0x7fe6d4146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6dbe9c640 1 --2- 172.21.15.130:0/754326889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d40d1750 0x7fe6d415d960 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/754326889 >> 172.21.15.130:0/754326889 conn(0x7fe6d406f170 msgr2=0x7fe6d406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:05.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/754326889 shutdown_connections 2023-09-13T06:03:05.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.375+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/754326889 wait complete. 2023-09-13T06:03:05.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6dbe9c640 1 Processor -- start 2023-09-13T06:03:05.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6dbe9c640 1 -- start start 2023-09-13T06:03:05.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6dbe9c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d40d1090 0x7fe6d4145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:05.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6dbe9c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6d40d1750 0x7fe6d406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:05.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6dbe9c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d40d1b30 0x7fe6d406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:05.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6dbe9c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d415bca0 con 0x7fe6d40d1b30 2023-09-13T06:03:05.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6dbe9c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d415bf80 con 0x7fe6d40d1750 2023-09-13T06:03:05.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6dbe9c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d415c260 con 0x7fe6d40d1090 2023-09-13T06:03:05.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6da439640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d40d1b30 0x7fe6d406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:05.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6da439640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d40d1b30 0x7fe6d406fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52496/0 (socket says 172.21.15.130:52496) 2023-09-13T06:03:05.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6da439640 1 -- 172.21.15.130:0/960287781 learned_addr learned my addr 172.21.15.130:0/960287781 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:05.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6d9437640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6d40d1750 0x7fe6d406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:05.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6d9c38640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d40d1090 0x7fe6d4145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:05.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6da439640 1 -- 172.21.15.130:0/960287781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d40d1090 msgr2=0x7fe6d4145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:05.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6da439640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d40d1090 0x7fe6d4145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6da439640 1 -- 172.21.15.130:0/960287781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6d40d1750 msgr2=0x7fe6d406f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:05.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6da439640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6d40d1750 0x7fe6d406f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6da439640 1 -- 172.21.15.130:0/960287781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d00094d0 con 0x7fe6d40d1b30 2023-09-13T06:03:05.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6d9437640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6d40d1750 0x7fe6d406f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:05.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6da439640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d40d1b30 0x7fe6d406fef0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00c700 tx=0x7fe6cc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:05.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6ca7fc640 1 -- 172.21.15.130:0/960287781 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc00ce10 con 0x7fe6d40d1b30 2023-09-13T06:03:05.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6ca7fc640 1 -- 172.21.15.130:0/960287781 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc00a640 con 0x7fe6d40d1b30 2023-09-13T06:03:05.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6ca7fc640 1 -- 172.21.15.130:0/960287781 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc00aa70 con 0x7fe6d40d1b30 2023-09-13T06:03:05.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/960287781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d415c540 con 0x7fe6d40d1b30 2023-09-13T06:03:05.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/960287781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d41461b0 con 0x7fe6d40d1b30 2023-09-13T06:03:05.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.379+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/960287781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d415c730 con 0x7fe6d40d1b30 2023-09-13T06:03:05.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.383+0000 7fe6ca7fc640 1 -- 172.21.15.130:0/960287781 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe6cc00abd0 con 0x7fe6d40d1b30 2023-09-13T06:03:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.383+0000 7fe6ca7fc640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b8065b20 0x7fe6b8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.383+0000 7fe6ca7fc640 1 -- 172.21.15.130:0/960287781 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6cc082890 con 0x7fe6d40d1b30 2023-09-13T06:03:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.383+0000 7fe6d9c38640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b8065b20 0x7fe6b8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.383+0000 7fe6d9c38640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b8065b20 0x7fe6b8067fe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00ae000 tx=0x7fe6d00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.387+0000 7fe6ca7fc640 1 -- 172.21.15.130:0/960287781 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe6cc050140 con 0x7fe6d40d1b30 2023-09-13T06:03:05.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.567+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/960287781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6d415bde0 con 0x7fe6d40d1b30 2023-09-13T06:03:05.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.567+0000 7fe6ca7fc640 1 -- 172.21.15.130:0/960287781 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fe6d415bde0 con 0x7fe6d40d1b30 2023-09-13T06:03:05.573 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:05.573 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2126646405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2126646405},{"type":"v1","addr":"172.21.15.164:6835","nonce":2126646405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1274935773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1274935773},{"type":"v1","addr":"172.21.15.164:6834","nonce":1274935773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/4174632972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4174632972},{"type":"v1","addr":"172.21.15.130:6836","nonce":4174632972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:54.919386+0000","modified":"2023-09-13T06:02:57.960043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5613":{"gid":5613,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1098709916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1098709916},{"type":"v1","addr":"172.21.15.130:6837","nonce":1098709916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-13T06:03:05.575 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 25 2023-09-13T06:03:05.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/960287781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b8065b20 msgr2=0x7fe6b8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:05.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b8065b20 0x7fe6b8067fe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00ae000 tx=0x7fe6d00a7000 comp rx=0 tx=0).stop 2023-09-13T06:03:05.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/960287781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d40d1b30 msgr2=0x7fe6d406fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:05.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d40d1b30 0x7fe6d406fef0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00c700 tx=0x7fe6cc00cbc0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/960287781 shutdown_connections 2023-09-13T06:03:05.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b8065b20 0x7fe6b8067fe0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6d40d1750 0x7fe6d406f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d40d1b30 0x7fe6d406fef0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 --2- 172.21.15.130:0/960287781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d40d1090 0x7fe6d4145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:05.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/960287781 >> 172.21.15.130:0/960287781 conn(0x7fe6d406f170 msgr2=0x7fe6d415dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:05.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/960287781 shutdown_connections 2023-09-13T06:03:05.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:05.571+0000 7fe6dbe9c640 1 -- 172.21.15.130:0/960287781 wait complete. 2023-09-13T06:03:05.997 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T06:02:54.919386+0000', 'modified': '2023-09-13T06:02:57.960043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5613}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5613': {'gid': 5613, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6837/1098709916', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6835', 'nonce': 1098709916}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 1098709916}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T06:03:05.997 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T06:03:05.998 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-13T06:03:06.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f49a8911640 1 Processor -- start 2023-09-13T06:03:06.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f49a8911640 1 -- start start 2023-09-13T06:03:06.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f49a8911640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f49a4159f20 0x7f49a40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f49a8911640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f49a40cdfc0 0x7f49a40b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f49a8911640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49a40b1610 0x7f49a40b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f49a8911640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a40b00f0 con 0x7f49a40cdfc0 2023-09-13T06:03:06.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f49a8911640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a40b11d0 con 0x7f49a4159f20 2023-09-13T06:03:06.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f49a8911640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40b1fc0 con 0x7f49a40b1610 2023-09-13T06:03:06.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f499bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f49a40cdfc0 0x7f49a40b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f499bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f49a40cdfc0 0x7f49a40b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52508/0 (socket says 172.21.15.130:52508) 2023-09-13T06:03:06.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f499bfff640 1 -- 172.21.15.130:0/503786755 learned_addr learned my addr 172.21.15.130:0/503786755 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:06.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f49a2d9d640 1 --2- 172.21.15.130:0/503786755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49a40b1610 0x7f49a40b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.135+0000 7f49a259c640 1 --2- 172.21.15.130:0/503786755 >> v2:172.21.15.164:3300/0 conn(0x7f49a4159f20 0x7f49a40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f499bfff640 1 -- 172.21.15.130:0/503786755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49a40b1610 msgr2=0x7f49a40b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:06.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f499bfff640 1 --2- 172.21.15.130:0/503786755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49a40b1610 0x7f49a40b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f499bfff640 1 -- 172.21.15.130:0/503786755 >> v2:172.21.15.164:3300/0 conn(0x7f49a4159f20 msgr2=0x7f49a40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:06.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f499bfff640 1 --2- 172.21.15.130:0/503786755 >> v2:172.21.15.164:3300/0 conn(0x7f49a4159f20 0x7f49a40ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f499bfff640 1 -- 172.21.15.130:0/503786755 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40ccfd0 con 0x7f49a40cdfc0 2023-09-13T06:03:06.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f499bfff640 1 --2- 172.21.15.130:0/503786755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a40cdfc0 0x7f49a40b0c90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f49a40b2660 tx=0x7f498c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e83d355a7412e59 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:06.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a1d9b640 1 -- 172.21.15.130:0/503786755 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c0ac630 con 0x7f49a40cdfc0 2023-09-13T06:03:06.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a1d9b640 1 -- 172.21.15.130:0/503786755 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c0ac790 con 0x7f49a40cdfc0 2023-09-13T06:03:06.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a1d9b640 1 -- 172.21.15.130:0/503786755 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c0acb20 con 0x7f49a40cdfc0 2023-09-13T06:03:06.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a8911640 1 -- 172.21.15.130:0/503786755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a40cdfc0 msgr2=0x7f49a40b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a8911640 1 --2- 172.21.15.130:0/503786755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a40cdfc0 0x7f49a40b0c90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f49a40b2660 tx=0x7f498c01c500 comp rx=0 tx=0).stop 2023-09-13T06:03:06.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a8911640 1 -- 172.21.15.130:0/503786755 shutdown_connections 2023-09-13T06:03:06.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a8911640 1 --2- 172.21.15.130:0/503786755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49a40b1610 0x7f49a40b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a8911640 1 --2- 172.21.15.130:0/503786755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a40cdfc0 0x7f49a40b0c90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a8911640 1 --2- 172.21.15.130:0/503786755 >> v2:172.21.15.164:3300/0 conn(0x7f49a4159f20 0x7f49a40ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a8911640 1 -- 172.21.15.130:0/503786755 >> 172.21.15.130:0/503786755 conn(0x7f49a4065990 msgr2=0x7f49a4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:06.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a8911640 1 -- 172.21.15.130:0/503786755 shutdown_connections 2023-09-13T06:03:06.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.139+0000 7f49a8911640 1 -- 172.21.15.130:0/503786755 wait complete. 2023-09-13T06:03:06.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a8911640 1 Processor -- start 2023-09-13T06:03:06.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a8911640 1 -- start start 2023-09-13T06:03:06.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a8911640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49a40b1610 0x7f49a4143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a8911640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49a40cdfc0 0x7f49a4140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a8911640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a4159f20 0x7f49a41f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a8911640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a406bb80 con 0x7f49a4159f20 2023-09-13T06:03:06.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a8911640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a406be60 con 0x7f49a40b1610 2023-09-13T06:03:06.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a8911640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a406c140 con 0x7f49a40cdfc0 2023-09-13T06:03:06.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a4159f20 0x7f49a41f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a4159f20 0x7f49a41f8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52512/0 (socket says 172.21.15.130:52512) 2023-09-13T06:03:06.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a2d9d640 1 -- 172.21.15.130:0/3760009277 learned_addr learned my addr 172.21.15.130:0/3760009277 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:06.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f499bfff640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49a40cdfc0 0x7f49a4140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a259c640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49a40b1610 0x7f49a4143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a2d9d640 1 -- 172.21.15.130:0/3760009277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49a40cdfc0 msgr2=0x7f49a4140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a2d9d640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49a40cdfc0 0x7f49a4140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a2d9d640 1 -- 172.21.15.130:0/3760009277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49a40b1610 msgr2=0x7f49a4143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a2d9d640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49a40b1610 0x7f49a4143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a2d9d640 1 -- 172.21.15.130:0/3760009277 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0094d0 con 0x7f49a4159f20 2023-09-13T06:03:06.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.143+0000 7f49a2d9d640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a4159f20 0x7f49a41f8d60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f499c00ec10 tx=0x7f499c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:06.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f499affd640 1 -- 172.21.15.130:0/3760009277 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c00cd20 con 0x7f49a4159f20 2023-09-13T06:03:06.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f499affd640 1 -- 172.21.15.130:0/3760009277 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c00f040 con 0x7f49a4159f20 2023-09-13T06:03:06.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f499affd640 1 -- 172.21.15.130:0/3760009277 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0146c0 con 0x7f49a4159f20 2023-09-13T06:03:06.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f49a8911640 1 -- 172.21.15.130:0/3760009277 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a406c420 con 0x7f49a4159f20 2023-09-13T06:03:06.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f49a8911640 1 -- 172.21.15.130:0/3760009277 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a406b7a0 con 0x7f49a4159f20 2023-09-13T06:03:06.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f499affd640 1 -- 172.21.15.130:0/3760009277 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f499c014a30 con 0x7f49a4159f20 2023-09-13T06:03:06.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f499affd640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4984065b20 0x7f4984067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f499affd640 1 -- 172.21.15.130:0/3760009277 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f499c083d90 con 0x7f49a4159f20 2023-09-13T06:03:06.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f49a259c640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4984065b20 0x7f4984067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f49abc84000 1 Processor -- start 2023-09-13T06:03:06.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f49a259c640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4984065b20 0x7f4984067fe0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4994009ae0 tx=0x7f4994009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:06.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.147+0000 7f49abc84000 1 -- start start 2023-09-13T06:03:06.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac62f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac62fe70 0x55d4ac613d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac6142b0 0x55d4ac614690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac4ad1e0 con 0x55d4ac62f550 2023-09-13T06:03:06.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac43c4c0 con 0x55d4ac62fe70 2023-09-13T06:03:06.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac4399f0 con 0x55d4ac6142b0 2023-09-13T06:03:06.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49a259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac62f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49a259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac62f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52524/0 (socket says 172.21.15.130:52524) 2023-09-13T06:03:06.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49a259c640 1 -- 172.21.15.130:0/1611985475 learned_addr learned my addr 172.21.15.130:0/1611985475 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:06.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f499bfff640 1 --2- 172.21.15.130:0/1611985475 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac62fe70 0x55d4ac613d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49a2d9d640 1 --2- 172.21.15.130:0/1611985475 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac6142b0 0x55d4ac614690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49a259c640 1 -- 172.21.15.130:0/1611985475 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac6142b0 msgr2=0x55d4ac614690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:06.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49a259c640 1 --2- 172.21.15.130:0/1611985475 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac6142b0 0x55d4ac614690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49a259c640 1 -- 172.21.15.130:0/1611985475 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac62fe70 msgr2=0x55d4ac613d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:06.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49a259c640 1 --2- 172.21.15.130:0/1611985475 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac62fe70 0x55d4ac613d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49a259c640 1 -- 172.21.15.130:0/1611985475 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ac12f890 con 0x55d4ac62f550 2023-09-13T06:03:06.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f499bfff640 1 --2- 172.21.15.130:0/1611985475 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac62fe70 0x55d4ac613d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:06.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49a259c640 1 --2- 172.21.15.130:0/1611985475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac62f930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4994009160 tx=0x7f4994014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925158d36bfa4944 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:06.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f4983fff640 1 -- 172.21.15.130:0/1611985475 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499401c040 con 0x55d4ac62f550 2023-09-13T06:03:06.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f4983fff640 1 -- 172.21.15.130:0/1611985475 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994003830 con 0x55d4ac62f550 2023-09-13T06:03:06.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f4983fff640 1 -- 172.21.15.130:0/1611985475 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994003ba0 con 0x55d4ac62f550 2023-09-13T06:03:06.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 -- 172.21.15.130:0/1611985475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 msgr2=0x55d4ac62f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 --2- 172.21.15.130:0/1611985475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac62f930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4994009160 tx=0x7f4994014000 comp rx=0 tx=0).stop 2023-09-13T06:03:06.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 -- 172.21.15.130:0/1611985475 shutdown_connections 2023-09-13T06:03:06.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 --2- 172.21.15.130:0/1611985475 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac62fe70 0x55d4ac613d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 --2- 172.21.15.130:0/1611985475 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac6142b0 0x55d4ac614690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 --2- 172.21.15.130:0/1611985475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac62f930 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 -- 172.21.15.130:0/1611985475 >> 172.21.15.130:0/1611985475 conn(0x55d4ac5dcc40 msgr2=0x55d4ac5ebc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:06.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 -- 172.21.15.130:0/1611985475 shutdown_connections 2023-09-13T06:03:06.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 -- 172.21.15.130:0/1611985475 wait complete. 2023-09-13T06:03:06.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 -- start start 2023-09-13T06:03:06.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.151+0000 7f49abc84000 1 Processor -- start 2023-09-13T06:03:06.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac6142b0 0x55d4ac613d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac62f550 0x55d4ac5e9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac62fe70 0x55d4ac5e9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac4352e0 con 0x55d4ac6142b0 2023-09-13T06:03:06.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac3effe0 con 0x55d4ac62f550 2023-09-13T06:03:06.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac3efc80 con 0x55d4ac62fe70 2023-09-13T06:03:06.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 10 client.0 _ll_register_callbacks cb 0x55d4ac5d1260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:03:06.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49a259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac6142b0 0x55d4ac613d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49a259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac6142b0 0x55d4ac613d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52540/0 (socket says 172.21.15.130:52540) 2023-09-13T06:03:06.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49a259c640 1 -- 172.21.15.130:0/1358528589 learned_addr learned my addr 172.21.15.130:0/1358528589 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:06.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49a259c640 1 -- 172.21.15.130:0/1358528589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac62fe70 msgr2=0x55d4ac5e9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:06.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49a259c640 1 --2- 172.21.15.130:0/1358528589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac62fe70 0x55d4ac5e9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49a259c640 1 -- 172.21.15.130:0/1358528589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac62f550 msgr2=0x55d4ac5e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:06.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49a259c640 1 --2- 172.21.15.130:0/1358528589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac62f550 0x55d4ac5e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49a259c640 1 -- 172.21.15.130:0/1358528589 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4994011b60 con 0x55d4ac6142b0 2023-09-13T06:03:06.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49a259c640 1 --2- 172.21.15.130:0/1358528589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac6142b0 0x55d4ac613d40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4994009130 tx=0x7f4994004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7d2cf35e320700 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:06.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49817fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:03:06.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49817fa640 1 -- 172.21.15.130:0/1358528589 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994022670 con 0x55d4ac6142b0 2023-09-13T06:03:06.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49817fa640 1 -- 172.21.15.130:0/1358528589 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4994037ae0 con 0x55d4ac6142b0 2023-09-13T06:03:06.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 1 -- 172.21.15.130:0/1358528589 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4ac3cca50 con 0x55d4ac6142b0 2023-09-13T06:03:06.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49817fa640 1 -- 172.21.15.130:0/1358528589 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4994037ca0 con 0x55d4ac6142b0 2023-09-13T06:03:06.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 10 client.5766 fetch_fsmap learned FSMap version 25 2023-09-13T06:03:06.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 1 -- 172.21.15.130:0/1358528589 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55d4ac3f8210 con 0x55d4ac6142b0 2023-09-13T06:03:06.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49817fa640 1 -- 172.21.15.130:0/1358528589 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4ac3cca50 con 0x55d4ac6142b0 2023-09-13T06:03:06.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49817fa640 1 -- 172.21.15.130:0/1358528589 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f49940227d0 con 0x55d4ac6142b0 2023-09-13T06:03:06.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 10 client.5766 fetch_fsmap finished waiting for FSMap version 25 2023-09-13T06:03:06.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 10 client.5766 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-13T06:03:06.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 20 client.5766 populate_metadata read hostname 'smithi130' 2023-09-13T06:03:06.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 1 --2- 172.21.15.130:0/1358528589 >> [v2:172.21.15.130:6835/1098709916,v1:172.21.15.130:6837/1098709916] conn(0x55d4ac5ea3e0 0x55d4ac641600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 4 client.5766 mds_command: new command op to 5613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T06:03:06.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49abc84000 1 -- 172.21.15.130:0/1358528589 --> [v2:172.21.15.130:6835/1098709916,v1:172.21.15.130:6837/1098709916] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4ac3ec820 con 0x55d4ac5ea3e0 2023-09-13T06:03:06.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f499bfff640 1 --2- 172.21.15.130:0/1358528589 >> [v2:172.21.15.130:6835/1098709916,v1:172.21.15.130:6837/1098709916] conn(0x55d4ac5ea3e0 0x55d4ac641600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f49817fa640 10 client.5766 ms_handle_connect on v2:172.21.15.130:6835/1098709916 2023-09-13T06:03:06.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.155+0000 7f499bfff640 1 --2- 172.21.15.130:0/1358528589 >> [v2:172.21.15.130:6835/1098709916,v1:172.21.15.130:6837/1098709916] conn(0x55d4ac5ea3e0 0x55d4ac641600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd77dbb73a178b25 server_cookie=6bc59ebc475bcd22 in_seq=0 out_seq=0 2023-09-13T06:03:06.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49817fa640 1 -- 172.21.15.130:0/1358528589 <== mds.0 v2:172.21.15.130:6835/1098709916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d4ac3ec820 con 0x55d4ac5ea3e0 2023-09-13T06:03:06.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49817fa640 10 client.5766 handle_command_reply: tid=0 2023-09-13T06:03:06.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 1 client.5766 shutdown 2023-09-13T06:03:06.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 1 -- 172.21.15.130:0/1358528589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac6142b0 msgr2=0x55d4ac613d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 1 --2- 172.21.15.130:0/1358528589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac6142b0 0x55d4ac613d40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4994009130 tx=0x7f4994004740 comp rx=0 tx=0).stop 2023-09-13T06:03:06.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 1 -- 172.21.15.130:0/1358528589 shutdown_connections 2023-09-13T06:03:06.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 1 --2- 172.21.15.130:0/1358528589 >> [v2:172.21.15.130:6835/1098709916,v1:172.21.15.130:6837/1098709916] conn(0x55d4ac5ea3e0 0x55d4ac641600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 1 --2- 172.21.15.130:0/1358528589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac62f550 0x55d4ac5e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 1 --2- 172.21.15.130:0/1358528589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac62fe70 0x55d4ac5e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 1 --2- 172.21.15.130:0/1358528589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac6142b0 0x55d4ac613d40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 1 -- 172.21.15.130:0/1358528589 >> 172.21.15.130:0/1358528589 conn(0x55d4ac5dcc40 msgr2=0x55d4ac615130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:06.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49817fa640 0 client.5766 ms_handle_reset on v2:172.21.15.130:6835/1098709916 2023-09-13T06:03:06.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 1 -- 172.21.15.130:0/1358528589 shutdown_connections 2023-09-13T06:03:06.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 1 -- 172.21.15.130:0/1358528589 wait complete. 2023-09-13T06:03:06.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.159+0000 7f49abc84000 20 client.5766 trim_cache size 0 max 16384 2023-09-13T06:03:06.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.171+0000 7f49abc84000 1 Processor -- start 2023-09-13T06:03:06.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.171+0000 7f49abc84000 1 -- start start 2023-09-13T06:03:06.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac5dcc40 0x55d4ac612d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac6142b0 0x55d4ac613270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac62f550 0x55d4ac63f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac0f0940 con 0x55d4ac5dcc40 2023-09-13T06:03:06.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac62f200 con 0x55d4ac6142b0 2023-09-13T06:03:06.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac43f160 con 0x55d4ac62f550 2023-09-13T06:03:06.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49a259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac5dcc40 0x55d4ac612d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49a259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac5dcc40 0x55d4ac612d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52556/0 (socket says 172.21.15.130:52556) 2023-09-13T06:03:06.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49a259c640 1 -- 172.21.15.130:0/4108719515 learned_addr learned my addr 172.21.15.130:0/4108719515 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:06.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f499bfff640 1 --2- 172.21.15.130:0/4108719515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac6142b0 0x55d4ac613270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49a2d9d640 1 --2- 172.21.15.130:0/4108719515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac62f550 0x55d4ac63f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49a259c640 1 -- 172.21.15.130:0/4108719515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac62f550 msgr2=0x55d4ac63f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:06.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49a259c640 1 --2- 172.21.15.130:0/4108719515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac62f550 0x55d4ac63f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49a259c640 1 -- 172.21.15.130:0/4108719515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac6142b0 msgr2=0x55d4ac613270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:06.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49a259c640 1 --2- 172.21.15.130:0/4108719515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac6142b0 0x55d4ac613270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49a259c640 1 -- 172.21.15.130:0/4108719515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ac3de4a0 con 0x55d4ac5dcc40 2023-09-13T06:03:06.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49a2d9d640 1 --2- 172.21.15.130:0/4108719515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac62f550 0x55d4ac63f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:06.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49a259c640 1 --2- 172.21.15.130:0/4108719515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac5dcc40 0x55d4ac612d30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4994006c10 tx=0x7f499402f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9355903b600e49 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:06.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f4998ff9640 1 -- 172.21.15.130:0/4108719515 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994022d30 con 0x55d4ac5dcc40 2023-09-13T06:03:06.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f4998ff9640 1 -- 172.21.15.130:0/4108719515 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994031070 con 0x55d4ac5dcc40 2023-09-13T06:03:06.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f4998ff9640 1 -- 172.21.15.130:0/4108719515 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994022670 con 0x55d4ac5dcc40 2023-09-13T06:03:06.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 -- 172.21.15.130:0/4108719515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac5dcc40 msgr2=0x55d4ac612d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 --2- 172.21.15.130:0/4108719515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac5dcc40 0x55d4ac612d30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4994006c10 tx=0x7f499402f070 comp rx=0 tx=0).stop 2023-09-13T06:03:06.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 -- 172.21.15.130:0/4108719515 shutdown_connections 2023-09-13T06:03:06.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 --2- 172.21.15.130:0/4108719515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac6142b0 0x55d4ac613270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 --2- 172.21.15.130:0/4108719515 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac62f550 0x55d4ac63f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 --2- 172.21.15.130:0/4108719515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac5dcc40 0x55d4ac612d30 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 -- 172.21.15.130:0/4108719515 >> 172.21.15.130:0/4108719515 conn(0x55d4ac5eb3e0 msgr2=0x55d4ac612620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 -- 172.21.15.130:0/4108719515 shutdown_connections 2023-09-13T06:03:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 -- 172.21.15.130:0/4108719515 wait complete. 2023-09-13T06:03:06.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 -- start start 2023-09-13T06:03:06.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.175+0000 7f49abc84000 1 Processor -- start 2023-09-13T06:03:06.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac5dcc40 0x55d4ac642670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac6142b0 0x55d4ac68d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac68d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac43da90 con 0x55d4ac62f550 2023-09-13T06:03:06.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac3f54b0 con 0x55d4ac6142b0 2023-09-13T06:03:06.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ac4326e0 con 0x55d4ac5dcc40 2023-09-13T06:03:06.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 10 client.0 _ll_register_callbacks cb 0x55d4ac3ebea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:03:06.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac68d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac68d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52564/0 (socket says 172.21.15.130:52564) 2023-09-13T06:03:06.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a2d9d640 1 -- 172.21.15.130:0/4119248103 learned_addr learned my addr 172.21.15.130:0/4119248103 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:06.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a259c640 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac5dcc40 0x55d4ac642670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f499bfff640 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac6142b0 0x55d4ac68d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a2d9d640 1 -- 172.21.15.130:0/4119248103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac5dcc40 msgr2=0x55d4ac642670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:06.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a2d9d640 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac5dcc40 0x55d4ac642670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a2d9d640 1 -- 172.21.15.130:0/4119248103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac6142b0 msgr2=0x55d4ac68d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:06.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a2d9d640 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac6142b0 0x55d4ac68d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a2d9d640 1 -- 172.21.15.130:0/4119248103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4ac3f8210 con 0x55d4ac62f550 2023-09-13T06:03:06.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f499bfff640 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac6142b0 0x55d4ac68d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:06.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a259c640 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac5dcc40 0x55d4ac642670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:06.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a2d9d640 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac68d900 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f499c05ce40 tx=0x7f499c055550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5805418e22123f94 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:06.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49817fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:03:06.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49817fa640 1 -- 172.21.15.130:0/4119248103 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c05b2b0 con 0x55d4ac62f550 2023-09-13T06:03:06.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49817fa640 1 -- 172.21.15.130:0/4119248103 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f499c0538a0 con 0x55d4ac62f550 2023-09-13T06:03:06.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 -- 172.21.15.130:0/4119248103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4ac3f0900 con 0x55d4ac62f550 2023-09-13T06:03:06.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49817fa640 1 -- 172.21.15.130:0/4119248103 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f499c054930 con 0x55d4ac62f550 2023-09-13T06:03:06.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 10 client.5772 fetch_fsmap learned FSMap version 25 2023-09-13T06:03:06.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 -- 172.21.15.130:0/4119248103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55d4ac12fcc0 con 0x55d4ac62f550 2023-09-13T06:03:06.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49817fa640 1 -- 172.21.15.130:0/4119248103 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4ac3f0900 con 0x55d4ac62f550 2023-09-13T06:03:06.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49817fa640 1 -- 172.21.15.130:0/4119248103 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f499c005d20 con 0x55d4ac62f550 2023-09-13T06:03:06.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 10 client.5772 fetch_fsmap finished waiting for FSMap version 25 2023-09-13T06:03:06.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 10 client.5772 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-13T06:03:06.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 20 client.5772 populate_metadata read hostname 'smithi130' 2023-09-13T06:03:06.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.130:6835/1098709916,v1:172.21.15.130:6837/1098709916] conn(0x55d4ac62fe70 0x55d4ac697020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 4 client.5772 mds_command: new command op to 5613 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T06:03:06.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 -- 172.21.15.130:0/4119248103 --> [v2:172.21.15.130:6835/1098709916,v1:172.21.15.130:6837/1098709916] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d4ac42e2c0 con 0x55d4ac62fe70 2023-09-13T06:03:06.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a259c640 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.130:6835/1098709916,v1:172.21.15.130:6837/1098709916] conn(0x55d4ac62fe70 0x55d4ac697020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49817fa640 10 client.5772 ms_handle_connect on v2:172.21.15.130:6835/1098709916 2023-09-13T06:03:06.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a259c640 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.130:6835/1098709916,v1:172.21.15.130:6837/1098709916] conn(0x55d4ac62fe70 0x55d4ac697020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2254037eea5f8f server_cookie=9cc7ea961ed73f5e in_seq=0 out_seq=0 2023-09-13T06:03:06.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49817fa640 1 -- 172.21.15.130:0/4119248103 <== mds.0 v2:172.21.15.130:6835/1098709916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55d4ac42e2c0 con 0x55d4ac62fe70 2023-09-13T06:03:06.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49817fa640 10 client.5772 handle_command_reply: tid=0 2023-09-13T06:03:06.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 client.5772 shutdown 2023-09-13T06:03:06.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 -- 172.21.15.130:0/4119248103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 msgr2=0x55d4ac68d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac68d900 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f499c05ce40 tx=0x7f499c055550 comp rx=0 tx=0).stop 2023-09-13T06:03:06.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 -- 172.21.15.130:0/4119248103 shutdown_connections 2023-09-13T06:03:06.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.130:6835/1098709916,v1:172.21.15.130:6837/1098709916] conn(0x55d4ac62fe70 0x55d4ac697020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d4ac6142b0 0x55d4ac68d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4ac62f550 0x55d4ac68d900 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 --2- 172.21.15.130:0/4119248103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55d4ac5dcc40 0x55d4ac642670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49817fa640 0 client.5772 ms_handle_reset on v2:172.21.15.130:6835/1098709916 2023-09-13T06:03:06.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 -- 172.21.15.130:0/4119248103 >> 172.21.15.130:0/4119248103 conn(0x55d4ac5eb3e0 msgr2=0x55d4ac612620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:06.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 -- 172.21.15.130:0/4119248103 shutdown_connections 2023-09-13T06:03:06.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 1 -- 172.21.15.130:0/4119248103 wait complete. 2023-09-13T06:03:06.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49abc84000 20 client.5772 trim_cache size 0 max 16384 2023-09-13T06:03:06.200 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:03:06.201 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:03:06.201 INFO:teuthology.orchestra.run.smithi130.stdout: "whoami": 0, 2023-09-13T06:03:06.201 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 5613, 2023-09-13T06:03:06.201 INFO:teuthology.orchestra.run.smithi130.stdout: "want_state": "up:active", 2023-09-13T06:03:06.202 INFO:teuthology.orchestra.run.smithi130.stdout: "state": "up:active", 2023-09-13T06:03:06.202 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs", 2023-09-13T06:03:06.202 INFO:teuthology.orchestra.run.smithi130.stdout: "rank_uptime": 10.610020086, 2023-09-13T06:03:06.202 INFO:teuthology.orchestra.run.smithi130.stdout: "mdsmap_epoch": 25, 2023-09-13T06:03:06.202 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch": 45, 2023-09-13T06:03:06.202 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch_barrier": 45, 2023-09-13T06:03:06.203 INFO:teuthology.orchestra.run.smithi130.stdout: "uptime": 15.419567273 2023-09-13T06:03:06.203 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:03:06.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.179+0000 7f49a8911640 1 -- 172.21.15.130:0/3760009277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4984065b20 msgr2=0x7f4984067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.183+0000 7f49a8911640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4984065b20 0x7f4984067fe0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4994009ae0 tx=0x7f4994009190 comp rx=0 tx=0).stop 2023-09-13T06:03:06.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.183+0000 7f49a8911640 1 -- 172.21.15.130:0/3760009277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a4159f20 msgr2=0x7f49a41f8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.183+0000 7f49a8911640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a4159f20 0x7f49a41f8d60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f499c00ec10 tx=0x7f499c00c490 comp rx=0 tx=0).stop 2023-09-13T06:03:06.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.183+0000 7f49a8911640 1 -- 172.21.15.130:0/3760009277 shutdown_connections 2023-09-13T06:03:06.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.183+0000 7f49a8911640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4984065b20 0x7f4984067fe0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.183+0000 7f49a8911640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a4159f20 0x7f49a41f8d60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.183+0000 7f49a8911640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49a40cdfc0 0x7f49a4140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.183+0000 7f49a8911640 1 --2- 172.21.15.130:0/3760009277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49a40b1610 0x7f49a4143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.183+0000 7f49a8911640 1 -- 172.21.15.130:0/3760009277 >> 172.21.15.130:0/3760009277 conn(0x7f49a4065990 msgr2=0x7f49a40cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:06.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.183+0000 7f49a8911640 1 -- 172.21.15.130:0/3760009277 shutdown_connections 2023-09-13T06:03:06.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.183+0000 7f49a8911640 1 -- 172.21.15.130:0/3760009277 wait complete. 2023-09-13T06:03:06.207 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:03:06.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.339+0000 7f2418f4d640 1 Processor -- start 2023-09-13T06:03:06.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.339+0000 7f2418f4d640 1 -- start start 2023-09-13T06:03:06.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2418f4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2414159f20 0x7f24140ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2418f4d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f24140b1d20 0x7f24140b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2418f4d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24140ccfd0 con 0x7f24140cdfc0 2023-09-13T06:03:06.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2418f4d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24140b00f0 con 0x7f24140b1d20 2023-09-13T06:03:06.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2418f4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24140ce420 con 0x7f2414159f20 2023-09-13T06:03:06.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2411d9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f24140cdfc0 0x7f24140b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46142/0 (socket says 172.21.15.130:46142) 2023-09-13T06:03:06.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2411d9b640 1 -- 172.21.15.130:0/4065668457 learned_addr learned my addr 172.21.15.130:0/4065668457 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:06.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2412d9d640 1 --2- 172.21.15.130:0/4065668457 >> v2:172.21.15.130:3300/0 conn(0x7f24140b1d20 0x7f24140b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f241259c640 1 --2- 172.21.15.130:0/4065668457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2414159f20 0x7f24140ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2412d9d640 1 -- 172.21.15.130:0/4065668457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2414159f20 msgr2=0x7f24140ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:06.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2412d9d640 1 --2- 172.21.15.130:0/4065668457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2414159f20 0x7f24140ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2412d9d640 1 -- 172.21.15.130:0/4065668457 >> v1:172.21.15.130:6789/0 conn(0x7f24140cdfc0 legacy=0x7f24140b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f241159a640 1 -- 172.21.15.130:0/4065668457 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974708581 0 0) 0x7f24140ccfd0 con 0x7f24140cdfc0 2023-09-13T06:03:06.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f2412d9d640 1 -- 172.21.15.130:0/4065668457 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24140ced90 con 0x7f24140b1d20 2023-09-13T06:03:06.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.343+0000 7f241259c640 1 --2- 172.21.15.130:0/4065668457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2414159f20 0x7f24140ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:06.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f2412d9d640 1 --2- 172.21.15.130:0/4065668457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24140b1d20 0x7f24140b0c90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f240c0097c0 tx=0x7f240c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d367be3db259df9d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:06.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f241159a640 1 -- 172.21.15.130:0/4065668457 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c0ab600 con 0x7f24140b1d20 2023-09-13T06:03:06.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f241159a640 1 -- 172.21.15.130:0/4065668457 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c0a7050 con 0x7f24140b1d20 2023-09-13T06:03:06.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f241159a640 1 -- 172.21.15.130:0/4065668457 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c0ab980 con 0x7f24140b1d20 2023-09-13T06:03:06.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f2418f4d640 1 -- 172.21.15.130:0/4065668457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24140b1d20 msgr2=0x7f24140b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f2418f4d640 1 --2- 172.21.15.130:0/4065668457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24140b1d20 0x7f24140b0c90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f240c0097c0 tx=0x7f240c01c480 comp rx=0 tx=0).stop 2023-09-13T06:03:06.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f2418f4d640 1 -- 172.21.15.130:0/4065668457 shutdown_connections 2023-09-13T06:03:06.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f2418f4d640 1 --2- 172.21.15.130:0/4065668457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24140b1d20 0x7f24140b0c90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f2418f4d640 1 --2- 172.21.15.130:0/4065668457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2414159f20 0x7f24140ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f2418f4d640 1 -- 172.21.15.130:0/4065668457 >> 172.21.15.130:0/4065668457 conn(0x7f2414065990 msgr2=0x7f2414065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:06.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f2418f4d640 1 -- 172.21.15.130:0/4065668457 shutdown_connections 2023-09-13T06:03:06.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f2418f4d640 1 -- 172.21.15.130:0/4065668457 wait complete. 2023-09-13T06:03:06.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f2418f4d640 1 Processor -- start 2023-09-13T06:03:06.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.347+0000 7f2418f4d640 1 -- start start 2023-09-13T06:03:06.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2418f4d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24140b1d20 0x7f2414155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2418f4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24140cdfc0 0x7f2414158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2418f4d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2414159f20 0x7f2414158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2418f4d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2414154a80 con 0x7f24140b1d20 2023-09-13T06:03:06.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2418f4d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2414154d60 con 0x7f2414159f20 2023-09-13T06:03:06.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2418f4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2414155040 con 0x7f24140cdfc0 2023-09-13T06:03:06.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f241259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24140b1d20 0x7f2414155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f241259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24140b1d20 0x7f2414155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52588/0 (socket says 172.21.15.130:52588) 2023-09-13T06:03:06.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f241259c640 1 -- 172.21.15.130:0/2315008964 learned_addr learned my addr 172.21.15.130:0/2315008964 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:06.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2411d9b640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24140cdfc0 0x7f2414158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2412d9d640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2414159f20 0x7f2414158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f241259c640 1 -- 172.21.15.130:0/2315008964 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24140cdfc0 msgr2=0x7f2414158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f241259c640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24140cdfc0 0x7f2414158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f241259c640 1 -- 172.21.15.130:0/2315008964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2414159f20 msgr2=0x7f2414158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f241259c640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2414159f20 0x7f2414158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f241259c640 1 -- 172.21.15.130:0/2315008964 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c009420 con 0x7f24140b1d20 2023-09-13T06:03:06.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f241259c640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24140b1d20 0x7f2414155b20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f240400ce00 tx=0x7f240400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:06.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2402ffd640 1 -- 172.21.15.130:0/2315008964 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240400f890 con 0x7f24140b1d20 2023-09-13T06:03:06.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2402ffd640 1 -- 172.21.15.130:0/2315008964 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240400f9f0 con 0x7f24140b1d20 2023-09-13T06:03:06.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2402ffd640 1 -- 172.21.15.130:0/2315008964 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240400fdc0 con 0x7f24140b1d20 2023-09-13T06:03:06.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2418f4d640 1 -- 172.21.15.130:0/2315008964 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2414155320 con 0x7f24140b1d20 2023-09-13T06:03:06.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2418f4d640 1 -- 172.21.15.130:0/2315008964 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2414152110 con 0x7f24140b1d20 2023-09-13T06:03:06.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.351+0000 7f2418f4d640 1 -- 172.21.15.130:0/2315008964 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24140618a0 con 0x7f24140b1d20 2023-09-13T06:03:06.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.355+0000 7f2402ffd640 1 -- 172.21.15.130:0/2315008964 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f240400b040 con 0x7f24140b1d20 2023-09-13T06:03:06.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.355+0000 7f2402ffd640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f23f4065b20 0x7f23f4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:06.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.355+0000 7f2402ffd640 1 -- 172.21.15.130:0/2315008964 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2404083d00 con 0x7f24140b1d20 2023-09-13T06:03:06.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.355+0000 7f2411d9b640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f23f4065b20 0x7f23f4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:06.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.355+0000 7f2411d9b640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f23f4065b20 0x7f23f4067fe0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f24141575a0 tx=0x7f2408007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:06.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.359+0000 7f2402ffd640 1 -- 172.21.15.130:0/2315008964 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2404051640 con 0x7f24140b1d20 2023-09-13T06:03:06.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.539+0000 7f2418f4d640 1 -- 172.21.15.130:0/2315008964 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f241406f490 con 0x7f24140b1d20 2023-09-13T06:03:06.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2402ffd640 1 -- 172.21.15.130:0/2315008964 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2404054c60 con 0x7f24140b1d20 2023-09-13T06:03:06.547 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:03:06.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 -- 172.21.15.130:0/2315008964 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f23f4065b20 msgr2=0x7f23f4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f23f4065b20 0x7f23f4067fe0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f24141575a0 tx=0x7f2408007b60 comp rx=0 tx=0).stop 2023-09-13T06:03:06.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 -- 172.21.15.130:0/2315008964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24140b1d20 msgr2=0x7f2414155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:06.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24140b1d20 0x7f2414155b20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f240400ce00 tx=0x7f240400a650 comp rx=0 tx=0).stop 2023-09-13T06:03:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 -- 172.21.15.130:0/2315008964 shutdown_connections 2023-09-13T06:03:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f23f4065b20 0x7f23f4067fe0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2414159f20 0x7f2414158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24140cdfc0 0x7f2414158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 --2- 172.21.15.130:0/2315008964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24140b1d20 0x7f2414155b20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:06.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 -- 172.21.15.130:0/2315008964 >> 172.21.15.130:0/2315008964 conn(0x7f2414065990 msgr2=0x7f241406b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:06.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 -- 172.21.15.130:0/2315008964 shutdown_connections 2023-09-13T06:03:06.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:06.543+0000 7f2418f4d640 1 -- 172.21.15.130:0/2315008964 wait complete. 2023-09-13T06:03:06.567 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:03:06.568 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:03:06.568 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:03:06.568 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T06:03:06.569 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:03:06.569 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:03:06.569 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:03:06.570 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:03:06.570 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:03:06.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:06.571 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:03:06.582 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:03:06.582 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:03:06.582 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:03:06.582 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:06.583 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:03:06.583 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:06.583 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:03:06.583 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:06.583 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:03:06.584 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:03:06.584 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:06.584 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:03:06.584 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:03:06.584 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:06.585 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:03:06.585 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:06.585 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:03:06.586 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42321sec preferred_lft 42321sec 2023-09-13T06:03:06.586 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:03:06.586 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:06.586 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:03:06.587 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:06.587 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:03:06.587 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:06.587 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:03:06.587 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:06.588 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:03:06.588 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:06.588 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:03:06.588 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:06.588 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:03:06.589 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:03:06.589 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:03:06.589 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:06.589 INFO:teuthology.orchestra.run.smithi130.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:03:06.589 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:03:06.590 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:03:06.590 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:06.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:06.591 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:03:06.646 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:03:06.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:06.648 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:03:06.701 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:03:06.701 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:03:06.702 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:03:06.702 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:03:06.702 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:03:06.703 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:03:06.703 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:03:06.703 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:03:06.703 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:03:06.704 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:03:06.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:06.705 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:03:06.706 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:03:06.706 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:03:06.706 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:03:06.707 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:03:06.707 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:03:06.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:06.802 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:03:06.812 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T06:03:06.813 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:03:06.813 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:03:06.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:06.814 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-09-13T06:03:06.878 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:03:06.879 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T06:03:06.929 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:03:06.930 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:03:06.930 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:03:06.981 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:03:06.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:06.982 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:03:07.071 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:03:07.072 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:03:07.072 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:03:07.087 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:03:07.087 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:03:07.087 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:03:07.087 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:03:07.088 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:03:07.095 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:03:07.095 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:03:07.096 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:03:07.096 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:03:07.096 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:03:07.096 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:03:07.096 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:03:07.097 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:03:07.099 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:03:07.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:07.100 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:03:07.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:07.121 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:03:07.182 INFO:teuthology.orchestra.run.smithi130.stdout:client5219 2023-09-13T06:03:07.183 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:03:07.184 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:07.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:03:07.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.411+0000 7f662c40b640 1 Processor -- start 2023-09-13T06:03:07.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.411+0000 7f662c40b640 1 -- start start 2023-09-13T06:03:07.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.411+0000 7f662c40b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6624159f20 0x7f66240ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:07.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.411+0000 7f662c40b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66240b1d20 0x7f66240b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:07.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.411+0000 7f662c40b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66240ccfd0 con 0x7f66240cdfc0 2023-09-13T06:03:07.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.411+0000 7f662c40b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66240b00f0 con 0x7f6624159f20 2023-09-13T06:03:07.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.411+0000 7f662c40b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66240b11d0 con 0x7f66240b1d20 2023-09-13T06:03:07.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f66299a6640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f66240cdfc0 0x7f66240b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46150/0 (socket says 172.21.15.130:46150) 2023-09-13T06:03:07.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f66299a6640 1 -- 172.21.15.130:0/1388491012 learned_addr learned my addr 172.21.15.130:0/1388491012 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:07.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f662a1a7640 1 --2- 172.21.15.130:0/1388491012 >> v2:172.21.15.164:3300/0 conn(0x7f6624159f20 0x7f66240ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:07.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f662a9a8640 1 --2- 172.21.15.130:0/1388491012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66240b1d20 0x7f66240b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:07.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f66291a5640 1 -- 172.21.15.130:0/1388491012 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579051052 0 0) 0x7f66240ccfd0 con 0x7f66240cdfc0 2023-09-13T06:03:07.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f66291a5640 1 -- 172.21.15.130:0/1388491012 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6610003530 con 0x7f66240cdfc0 2023-09-13T06:03:07.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f66291a5640 1 -- 172.21.15.130:0/1388491012 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1125142211 0 0) 0x7f6610003530 con 0x7f66240cdfc0 2023-09-13T06:03:07.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f662a1a7640 1 -- 172.21.15.130:0/1388491012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66240b1d20 msgr2=0x7f66240b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:07.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f662a1a7640 1 --2- 172.21.15.130:0/1388491012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66240b1d20 0x7f66240b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:07.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f662a1a7640 1 -- 172.21.15.130:0/1388491012 >> v1:172.21.15.130:6789/0 conn(0x7f66240cdfc0 legacy=0x7f66240b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:07.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f662a1a7640 1 -- 172.21.15.130:0/1388491012 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66240ced90 con 0x7f6624159f20 2023-09-13T06:03:07.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.415+0000 7f662a1a7640 1 --2- 172.21.15.130:0/1388491012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6624159f20 0x7f66240ce7b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f66200097c0 tx=0x7f662001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aae363c3c1db48b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:07.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f66291a5640 1 -- 172.21.15.130:0/1388491012 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614001680 con 0x7f6624159f20 2023-09-13T06:03:07.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f66291a5640 1 -- 172.21.15.130:0/1388491012 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66200a7050 con 0x7f6624159f20 2023-09-13T06:03:07.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f66291a5640 1 -- 172.21.15.130:0/1388491012 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200ab620 con 0x7f6624159f20 2023-09-13T06:03:07.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 -- 172.21.15.130:0/1388491012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6624159f20 msgr2=0x7f66240ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:07.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 --2- 172.21.15.130:0/1388491012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6624159f20 0x7f66240ce7b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f66200097c0 tx=0x7f662001c3a0 comp rx=0 tx=0).stop 2023-09-13T06:03:07.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 -- 172.21.15.130:0/1388491012 shutdown_connections 2023-09-13T06:03:07.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 --2- 172.21.15.130:0/1388491012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66240b1d20 0x7f66240b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:07.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 --2- 172.21.15.130:0/1388491012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6624159f20 0x7f66240ce7b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:07.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 -- 172.21.15.130:0/1388491012 >> 172.21.15.130:0/1388491012 conn(0x7f6624065990 msgr2=0x7f6624065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:07.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 -- 172.21.15.130:0/1388491012 shutdown_connections 2023-09-13T06:03:07.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 -- 172.21.15.130:0/1388491012 wait complete. 2023-09-13T06:03:07.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 Processor -- start 2023-09-13T06:03:07.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 -- start start 2023-09-13T06:03:07.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66240b1d20 0x7f66241f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:07.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66240cdfc0 0x7f662414dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:07.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6624159f20 0x7f662414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:07.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662414fd90 con 0x7f6624159f20 2023-09-13T06:03:07.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662414d440 con 0x7f66240b1d20 2023-09-13T06:03:07.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.419+0000 7f662c40b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6624152f30 con 0x7f66240cdfc0 2023-09-13T06:03:07.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a9a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6624159f20 0x7f662414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:07.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a9a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6624159f20 0x7f662414e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52596/0 (socket says 172.21.15.130:52596) 2023-09-13T06:03:07.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a9a8640 1 -- 172.21.15.130:0/1426570300 learned_addr learned my addr 172.21.15.130:0/1426570300 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:07.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a1a7640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66240b1d20 0x7f66241f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:07.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a9a8640 1 -- 172.21.15.130:0/1426570300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66240cdfc0 msgr2=0x7f662414dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:07.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a9a8640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66240cdfc0 0x7f662414dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:07.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a9a8640 1 -- 172.21.15.130:0/1426570300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66240b1d20 msgr2=0x7f66241f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:07.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a9a8640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66240b1d20 0x7f66241f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:07.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a9a8640 1 -- 172.21.15.130:0/1426570300 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6620009420 con 0x7f6624159f20 2023-09-13T06:03:07.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a1a7640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66240b1d20 0x7f66241f5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:07.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a9a8640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6624159f20 0x7f662414e420 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f661c00efc0 tx=0x7f661c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:07.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f661affd640 1 -- 172.21.15.130:0/1426570300 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00cd20 con 0x7f6624159f20 2023-09-13T06:03:07.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f661affd640 1 -- 172.21.15.130:0/1426570300 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c00f040 con 0x7f6624159f20 2023-09-13T06:03:07.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662c40b640 1 -- 172.21.15.130:0/1426570300 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6624153210 con 0x7f6624159f20 2023-09-13T06:03:07.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f661affd640 1 -- 172.21.15.130:0/1426570300 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c00cea0 con 0x7f6624159f20 2023-09-13T06:03:07.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662c40b640 1 -- 172.21.15.130:0/1426570300 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662414d9e0 con 0x7f6624159f20 2023-09-13T06:03:07.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662c40b640 1 -- 172.21.15.130:0/1426570300 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662414dba0 con 0x7f6624159f20 2023-09-13T06:03:07.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f661affd640 1 -- 172.21.15.130:0/1426570300 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f661c014930 con 0x7f6624159f20 2023-09-13T06:03:07.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f661affd640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6608065b20 0x7f6608067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:07.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f661affd640 1 -- 172.21.15.130:0/1426570300 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f661c084540 con 0x7f6624159f20 2023-09-13T06:03:07.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.423+0000 7f662a1a7640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6608065b20 0x7f6608067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:07.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.427+0000 7f662a1a7640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6608065b20 0x7f6608067fe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f66200ad000 tx=0x7f6620008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:07.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.427+0000 7f661affd640 1 -- 172.21.15.130:0/1426570300 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f661c051df0 con 0x7f6624159f20 2023-09-13T06:03:07.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.611+0000 7f662c40b640 1 -- 172.21.15.130:0/1426570300 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f66240618a0 con 0x7f6624159f20 2023-09-13T06:03:07.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f661affd640 1 -- 172.21.15.130:0/1426570300 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f661c055410 con 0x7f6624159f20 2023-09-13T06:03:07.619 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:03:07.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 -- 172.21.15.130:0/1426570300 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6608065b20 msgr2=0x7f6608067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:07.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6608065b20 0x7f6608067fe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f66200ad000 tx=0x7f6620008040 comp rx=0 tx=0).stop 2023-09-13T06:03:07.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 -- 172.21.15.130:0/1426570300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6624159f20 msgr2=0x7f662414e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:07.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6624159f20 0x7f662414e420 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f661c00efc0 tx=0x7f661c00c490 comp rx=0 tx=0).stop 2023-09-13T06:03:07.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 -- 172.21.15.130:0/1426570300 shutdown_connections 2023-09-13T06:03:07.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6608065b20 0x7f6608067fe0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:07.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6624159f20 0x7f662414e420 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:07.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66240cdfc0 0x7f662414dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:07.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 --2- 172.21.15.130:0/1426570300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66240b1d20 0x7f66241f5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:07.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 -- 172.21.15.130:0/1426570300 >> 172.21.15.130:0/1426570300 conn(0x7f6624065990 msgr2=0x7f662406c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:07.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 -- 172.21.15.130:0/1426570300 shutdown_connections 2023-09-13T06:03:07.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:07.615+0000 7f662c40b640 1 -- 172.21.15.130:0/1426570300 wait complete. 2023-09-13T06:03:07.638 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:03:07.639 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:03:07.639 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:03:07.640 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T06:03:07.640 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:03:07.640 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:03:07.641 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:03:07.641 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:03:07.641 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:03:07.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:07.642 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:03:07.654 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:03:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:03:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:03:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:03:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:07.656 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:03:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:03:07.656 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:03:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:03:07.657 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:03:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:07.657 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:03:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:03:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42336sec preferred_lft 42336sec 2023-09-13T06:03:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:03:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:07.659 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:03:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:03:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:07.659 INFO:teuthology.orchestra.run.smithi164.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:03:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:03:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:03:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:03:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:07.661 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:03:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:03:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:03:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:07.661 INFO:teuthology.orchestra.run.smithi164.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:03:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:03:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:03:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:03:07.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:07.664 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:03:07.729 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:03:07.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:07.732 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:03:07.787 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:03:07.787 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:03:07.787 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:03:07.788 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:03:07.788 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:03:07.788 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:03:07.788 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:03:07.788 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:03:07.789 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:03:07.789 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:03:07.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:07.790 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:03:07.790 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:03:07.791 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:03:07.791 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:03:07.791 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:03:07.792 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:03:07.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:07.889 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:03:07.899 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-13T06:03:07.899 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:03:07.899 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:03:07.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:07.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-09-13T06:03:07.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:03:07.962 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T06:03:08.012 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:03:08.013 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:03:08.013 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:03:08.067 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:03:08.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:08.068 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:03:08.159 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:03:08.160 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:03:08.160 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:03:08.175 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:03:08.175 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:03:08.175 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:03:08.176 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:03:08.176 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:03:08.185 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:03:08.186 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:03:08.186 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:03:08.186 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:03:08.186 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:03:08.187 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:03:08.187 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:03:08.187 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:03:08.190 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:03:08.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:08.191 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:03:08.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:08.212 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:03:08.267 INFO:teuthology.orchestra.run.smithi164.stdout:client5790 2023-09-13T06:03:08.267 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:03:08.268 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:08.321 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:03:08.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.455+0000 7f81d0759640 1 Processor -- start 2023-09-13T06:03:08.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.455+0000 7f81d0759640 1 -- start start 2023-09-13T06:03:08.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81d0759640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f81c80ce7b0 0x7f81c80cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:08.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81d0759640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c80ccfd0 con 0x7f81c8159f20 2023-09-13T06:03:08.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81d0759640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c80ced90 con 0x7f81c80b1d20 2023-09-13T06:03:08.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81d0759640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80b00f0 con 0x7f81c80ce7b0 2023-09-13T06:03:08.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81ce4f5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f81c8159f20 0x7f81c80b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46166/0 (socket says 172.21.15.130:46166) 2023-09-13T06:03:08.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81ce4f5640 1 -- 172.21.15.130:0/1039188731 learned_addr learned my addr 172.21.15.130:0/1039188731 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:08.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81cecf6640 1 --2- 172.21.15.130:0/1039188731 >> v2:172.21.15.130:3300/0 conn(0x7f81c80ce7b0 0x7f81c80cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:08.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81cd4f3640 1 -- 172.21.15.130:0/1039188731 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461428127 0 0) 0x7f81c80ccfd0 con 0x7f81c8159f20 2023-09-13T06:03:08.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81cd4f3640 1 -- 172.21.15.130:0/1039188731 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b4003530 con 0x7f81c8159f20 2023-09-13T06:03:08.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81cecf6640 1 -- 172.21.15.130:0/1039188731 >> v1:172.21.15.164:6789/0 conn(0x7f81c80b1d20 legacy=0x7f81c80ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:08.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81cecf6640 1 -- 172.21.15.130:0/1039188731 >> v1:172.21.15.130:6789/0 conn(0x7f81c8159f20 legacy=0x7f81c80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:08.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.459+0000 7f81cecf6640 1 -- 172.21.15.130:0/1039188731 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80cd200 con 0x7f81c80ce7b0 2023-09-13T06:03:08.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81cecf6640 1 --2- 172.21.15.130:0/1039188731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80ce7b0 0x7f81c80cdfc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009dc0 tx=0x7f81c001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e262b553f35a7cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:08.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81cd4f3640 1 -- 172.21.15.130:0/1039188731 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c00a5930 con 0x7f81c80ce7b0 2023-09-13T06:03:08.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81cd4f3640 1 -- 172.21.15.130:0/1039188731 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c00a5a90 con 0x7f81c80ce7b0 2023-09-13T06:03:08.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81cd4f3640 1 -- 172.21.15.130:0/1039188731 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c00a5e20 con 0x7f81c80ce7b0 2023-09-13T06:03:08.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81d0759640 1 -- 172.21.15.130:0/1039188731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80ce7b0 msgr2=0x7f81c80cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:08.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81d0759640 1 --2- 172.21.15.130:0/1039188731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80ce7b0 0x7f81c80cdfc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009dc0 tx=0x7f81c001c870 comp rx=0 tx=0).stop 2023-09-13T06:03:08.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81d0759640 1 -- 172.21.15.130:0/1039188731 shutdown_connections 2023-09-13T06:03:08.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81d0759640 1 --2- 172.21.15.130:0/1039188731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80ce7b0 0x7f81c80cdfc0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:08.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81d0759640 1 -- 172.21.15.130:0/1039188731 >> 172.21.15.130:0/1039188731 conn(0x7f81c8065990 msgr2=0x7f81c8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:08.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81d0759640 1 -- 172.21.15.130:0/1039188731 shutdown_connections 2023-09-13T06:03:08.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81d0759640 1 -- 172.21.15.130:0/1039188731 wait complete. 2023-09-13T06:03:08.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81d0759640 1 Processor -- start 2023-09-13T06:03:08.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.463+0000 7f81d0759640 1 -- start start 2023-09-13T06:03:08.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81d0759640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81c80b1d20 0x7f81c8147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:08.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81d0759640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80ce7b0 0x7f81c80ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:08.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81d0759640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81c8159f20 0x7f81c814f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:08.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81d0759640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c81489b0 con 0x7f81c80ce7b0 2023-09-13T06:03:08.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81d0759640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8151070 con 0x7f81c80b1d20 2023-09-13T06:03:08.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81d0759640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c814fe30 con 0x7f81c8159f20 2023-09-13T06:03:08.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81cdcf4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80ce7b0 0x7f81c80ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:08.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81cdcf4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80ce7b0 0x7f81c80ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52626/0 (socket says 172.21.15.130:52626) 2023-09-13T06:03:08.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81cdcf4640 1 -- 172.21.15.130:0/3429626250 learned_addr learned my addr 172.21.15.130:0/3429626250 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:08.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81ce4f5640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81c80b1d20 0x7f81c8147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:08.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81cecf6640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81c8159f20 0x7f81c814f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:08.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81cdcf4640 1 -- 172.21.15.130:0/3429626250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81c8159f20 msgr2=0x7f81c814f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:08.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81cdcf4640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81c8159f20 0x7f81c814f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:08.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81cdcf4640 1 -- 172.21.15.130:0/3429626250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81c80b1d20 msgr2=0x7f81c8147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:08.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81cdcf4640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81c80b1d20 0x7f81c8147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:08.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81cdcf4640 1 -- 172.21.15.130:0/3429626250 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c0009a70 con 0x7f81c80ce7b0 2023-09-13T06:03:08.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81cdcf4640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80ce7b0 0x7f81c80ca820 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c500 tx=0x7f81b800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:08.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81beffd640 1 -- 172.21.15.130:0/3429626250 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8005220 con 0x7f81c80ce7b0 2023-09-13T06:03:08.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81beffd640 1 -- 172.21.15.130:0/3429626250 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b8005380 con 0x7f81c80ce7b0 2023-09-13T06:03:08.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81d0759640 1 -- 172.21.15.130:0/3429626250 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c8150ab0 con 0x7f81c80ce7b0 2023-09-13T06:03:08.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81beffd640 1 -- 172.21.15.130:0/3429626250 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8007270 con 0x7f81c80ce7b0 2023-09-13T06:03:08.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81d0759640 1 -- 172.21.15.130:0/3429626250 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c81485d0 con 0x7f81c80ce7b0 2023-09-13T06:03:08.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81d0759640 1 -- 172.21.15.130:0/3429626250 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c8148430 con 0x7f81c80ce7b0 2023-09-13T06:03:08.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.467+0000 7f81beffd640 1 -- 172.21.15.130:0/3429626250 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f81b80073d0 con 0x7f81c80ce7b0 2023-09-13T06:03:08.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.471+0000 7f81beffd640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81ac065b20 0x7f81ac067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:08.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.471+0000 7f81beffd640 1 -- 172.21.15.130:0/3429626250 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81b8082670 con 0x7f81c80ce7b0 2023-09-13T06:03:08.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.471+0000 7f81ce4f5640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81ac065b20 0x7f81ac067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:08.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.471+0000 7f81ce4f5640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81ac065b20 0x7f81ac067fe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f81c40011f0 tx=0x7f81c4007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:08.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.475+0000 7f81beffd640 1 -- 172.21.15.130:0/3429626250 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f81c8148430 con 0x7f81c80ce7b0 2023-09-13T06:03:08.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.655+0000 7f81d0759640 1 -- 172.21.15.130:0/3429626250 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81c8148430 con 0x7f81c80ce7b0 2023-09-13T06:03:08.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81beffd640 1 -- 172.21.15.130:0/3429626250 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f81c8148430 con 0x7f81c80ce7b0 2023-09-13T06:03:08.662 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:08.663 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2126646405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2126646405},{"type":"v1","addr":"172.21.15.164:6835","nonce":2126646405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1274935773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1274935773},{"type":"v1","addr":"172.21.15.164:6834","nonce":1274935773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/4174632972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4174632972},{"type":"v1","addr":"172.21.15.130:6836","nonce":4174632972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:54.919386+0000","modified":"2023-09-13T06:02:57.960043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5613":{"gid":5613,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1098709916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1098709916},{"type":"v1","addr":"172.21.15.130:6837","nonce":1098709916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-13T06:03:08.664 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 25 2023-09-13T06:03:08.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 -- 172.21.15.130:0/3429626250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81ac065b20 msgr2=0x7f81ac067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:08.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81ac065b20 0x7f81ac067fe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f81c40011f0 tx=0x7f81c4007d40 comp rx=0 tx=0).stop 2023-09-13T06:03:08.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 -- 172.21.15.130:0/3429626250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80ce7b0 msgr2=0x7f81c80ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:08.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80ce7b0 0x7f81c80ca820 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c500 tx=0x7f81b800c9c0 comp rx=0 tx=0).stop 2023-09-13T06:03:08.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 -- 172.21.15.130:0/3429626250 shutdown_connections 2023-09-13T06:03:08.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81ac065b20 0x7f81ac067fe0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:08.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81c8159f20 0x7f81c814f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:08.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80ce7b0 0x7f81c80ca820 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:08.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 --2- 172.21.15.130:0/3429626250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81c80b1d20 0x7f81c8147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:08.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 -- 172.21.15.130:0/3429626250 >> 172.21.15.130:0/3429626250 conn(0x7f81c8065990 msgr2=0x7f81c80cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:08.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 -- 172.21.15.130:0/3429626250 shutdown_connections 2023-09-13T06:03:08.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:08.659+0000 7f81d0759640 1 -- 172.21.15.130:0/3429626250 wait complete. 2023-09-13T06:03:08.683 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-13T06:03:08.841 INFO:teuthology.orchestra.run.smithi130.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":5613,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.251666030000001,"mdsmap_epoch":25,"osdmap_epoch":45,"osdmap_epoch_barrier":45,"uptime":18.061225241999999} 2023-09-13T06:03:08.842 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 5613, "mdsmap_epoch": 25, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "rank_uptime": 13.25166603, "state": "up:active", "uptime": 18.061225242, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:03:08.842 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-13T06:03:08.996 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_mon_report_interval":"5"} 2023-09-13T06:03:08.997 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-13T06:03:08.997 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-09-13T06:03:08.998 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:03:08.998 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:09.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:09.008 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-09-13T06:03:11.455 INFO:teuthology.orchestra.run.smithi130.stderr:265+0 records in 2023-09-13T06:03:11.455 INFO:teuthology.orchestra.run.smithi130.stderr:265+0 records out 2023-09-13T06:03:11.455 INFO:teuthology.orchestra.run.smithi130.stderr:277872640 bytes (278 MB, 265 MiB) copied, 2.39277 s, 116 MB/s 2023-09-13T06:03:11.456 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:03:11.456 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:11.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:11.467 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-09-13T06:03:14.104 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:03:14.109 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:03:14.333 INFO:teuthology.orchestra.run.smithi130.stderr:292+0 records in 2023-09-13T06:03:14.333 INFO:teuthology.orchestra.run.smithi130.stderr:292+0 records out 2023-09-13T06:03:14.334 INFO:teuthology.orchestra.run.smithi130.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.8098 s, 109 MB/s 2023-09-13T06:03:14.335 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-09-13T06:03:14.335 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:03:14.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.467+0000 7fcc72f96640 1 Processor -- start 2023-09-13T06:03:14.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.467+0000 7fcc72f96640 1 -- start start 2023-09-13T06:03:14.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc72f96640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 0x7fcc6c0ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:14.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc72f96640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcc6c0b0f40 0x7fcc6c0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:14.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc72f96640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc6c0afee0 con 0x7fcc6c15e560 2023-09-13T06:03:14.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc72f96640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6c0aea50 con 0x7fcc6c0b0f40 2023-09-13T06:03:14.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc72f96640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c0b0b20 con 0x7fcc6c157920 2023-09-13T06:03:14.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc70d32640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 0x7fcc6c0ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:14.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc63fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcc6c0b0f40 0x7fcc6c0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:14.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc70d32640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 0x7fcc6c0ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:53988/0 (socket says 172.21.15.130:53988) 2023-09-13T06:03:14.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc70d32640 1 -- 172.21.15.130:0/1589630411 learned_addr learned my addr 172.21.15.130:0/1589630411 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:14.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc63fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcc6c0b0f40 0x7fcc6c0b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:56122/0 (socket says 172.21.15.130:56122) 2023-09-13T06:03:14.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc63fff640 1 -- 172.21.15.130:0/1589630411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 msgr2=0x7fcc6c0ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:14.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc63fff640 1 --2- 172.21.15.130:0/1589630411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 0x7fcc6c0ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:14.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc63fff640 1 -- 172.21.15.130:0/1589630411 >> v1:172.21.15.164:6789/0 conn(0x7fcc6c15e560 legacy=0x7fcc6c0ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:14.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc63fff640 1 -- 172.21.15.130:0/1589630411 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c0b0180 con 0x7fcc6c0b0f40 2023-09-13T06:03:14.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.471+0000 7fcc70d32640 1 --2- 172.21.15.130:0/1589630411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 0x7fcc6c0ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:14.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc63fff640 1 --2- 172.21.15.130:0/1589630411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc6c0b0f40 0x7fcc6c0b1610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0097c0 tx=0x7fcc5c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32437f7e11c10b47 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:14.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc637fe640 1 -- 172.21.15.130:0/1589630411 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0ad660 con 0x7fcc6c0b0f40 2023-09-13T06:03:14.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc637fe640 1 -- 172.21.15.130:0/1589630411 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c0ad7c0 con 0x7fcc6c0b0f40 2023-09-13T06:03:14.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc637fe640 1 -- 172.21.15.130:0/1589630411 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0adb50 con 0x7fcc6c0b0f40 2023-09-13T06:03:14.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc72f96640 1 -- 172.21.15.130:0/1589630411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc6c0b0f40 msgr2=0x7fcc6c0b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:14.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc72f96640 1 --2- 172.21.15.130:0/1589630411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc6c0b0f40 0x7fcc6c0b1610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0097c0 tx=0x7fcc5c01c450 comp rx=0 tx=0).stop 2023-09-13T06:03:14.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc72f96640 1 -- 172.21.15.130:0/1589630411 shutdown_connections 2023-09-13T06:03:14.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc72f96640 1 --2- 172.21.15.130:0/1589630411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc6c0b0f40 0x7fcc6c0b1610 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:14.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc72f96640 1 --2- 172.21.15.130:0/1589630411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 0x7fcc6c0ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:14.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc72f96640 1 -- 172.21.15.130:0/1589630411 >> 172.21.15.130:0/1589630411 conn(0x7fcc6c065990 msgr2=0x7fcc6c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:14.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc72f96640 1 -- 172.21.15.130:0/1589630411 shutdown_connections 2023-09-13T06:03:14.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc72f96640 1 -- 172.21.15.130:0/1589630411 wait complete. 2023-09-13T06:03:14.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc72f96640 1 Processor -- start 2023-09-13T06:03:14.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.475+0000 7fcc72f96640 1 -- start start 2023-09-13T06:03:14.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc72f96640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc6c0b0f40 0x7fcc6c153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:14.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc72f96640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 0x7fcc6c1475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:14.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc72f96640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc6c15e560 0x7fcc6c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:14.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc72f96640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c147af0 con 0x7fcc6c15e560 2023-09-13T06:03:14.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc72f96640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c14b3d0 con 0x7fcc6c0b0f40 2023-09-13T06:03:14.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc72f96640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c138000 con 0x7fcc6c157920 2023-09-13T06:03:14.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc71533640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc6c15e560 0x7fcc6c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:14.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc71533640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc6c15e560 0x7fcc6c137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59712/0 (socket says 172.21.15.130:59712) 2023-09-13T06:03:14.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc71533640 1 -- 172.21.15.130:0/684241699 learned_addr learned my addr 172.21.15.130:0/684241699 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:14.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc70d32640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc6c0b0f40 0x7fcc6c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:14.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc63fff640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 0x7fcc6c1475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:14.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc71533640 1 -- 172.21.15.130:0/684241699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 msgr2=0x7fcc6c1475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:14.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc71533640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 0x7fcc6c1475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:14.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc71533640 1 -- 172.21.15.130:0/684241699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc6c0b0f40 msgr2=0x7fcc6c153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:14.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc71533640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc6c0b0f40 0x7fcc6c153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:14.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc71533640 1 -- 172.21.15.130:0/684241699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc680094d0 con 0x7fcc6c15e560 2023-09-13T06:03:14.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc71533640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc6c15e560 0x7fcc6c137ac0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400c730 tx=0x7fcc6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:14.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc617fa640 1 -- 172.21.15.130:0/684241699 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc64006d60 con 0x7fcc6c15e560 2023-09-13T06:03:14.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc617fa640 1 -- 172.21.15.130:0/684241699 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc64005020 con 0x7fcc6c15e560 2023-09-13T06:03:14.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc617fa640 1 -- 172.21.15.130:0/684241699 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc64005410 con 0x7fcc6c15e560 2023-09-13T06:03:14.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc72f96640 1 -- 172.21.15.130:0/684241699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c009420 con 0x7fcc6c15e560 2023-09-13T06:03:14.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc72f96640 1 -- 172.21.15.130:0/684241699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6c148030 con 0x7fcc6c15e560 2023-09-13T06:03:14.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.479+0000 7fcc72f96640 1 -- 172.21.15.130:0/684241699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6c0ae260 con 0x7fcc6c15e560 2023-09-13T06:03:14.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.483+0000 7fcc617fa640 1 -- 172.21.15.130:0/684241699 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcc64005570 con 0x7fcc6c15e560 2023-09-13T06:03:14.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.483+0000 7fcc617fa640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc58065b20 0x7fcc58067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:14.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.483+0000 7fcc617fa640 1 -- 172.21.15.130:0/684241699 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcc64082ca0 con 0x7fcc6c15e560 2023-09-13T06:03:14.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.483+0000 7fcc70d32640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc58065b20 0x7fcc58067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:14.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.483+0000 7fcc70d32640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc58065b20 0x7fcc58067fe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcc68006cb0 tx=0x7fcc68009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:14.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.487+0000 7fcc617fa640 1 -- 172.21.15.130:0/684241699 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcc64050650 con 0x7fcc6c15e560 2023-09-13T06:03:14.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.639+0000 7fcc72f96640 1 -- 172.21.15.130:0/684241699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcc6c0618a0 con 0x7fcc6c15e560 2023-09-13T06:03:14.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.639+0000 7fcc617fa640 1 -- 172.21.15.130:0/684241699 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v47) v1 ==== 81+0+34355 (secure 0 0 0) 0x7fcc64053c70 con 0x7fcc6c15e560 2023-09-13T06:03:14.646 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:14.646 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:03:14.646 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 47, 2023-09-13T06:03:14.646 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:03:14.646 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:03:14.647 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:03:14.318106+0000", 2023-09-13T06:03:14.647 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:03:14.647 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:03:14.647 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:03:14.647 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:03:14.648 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:03:14.648 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:03:14.648 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:03:14.648 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:03:14.648 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:03:14.648 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:14.649 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:03:14.649 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:03:14.649 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:03:14.649 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:03:14.649 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:03:14.650 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 7, 2023-09-13T06:03:14.650 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:03:14.650 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:03:14.650 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "luminous", 2023-09-13T06:03:14.650 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:03:14.651 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:03:14.651 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:03:14.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.651 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:03:14.651 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:03:14.652 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:03:14.652 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:03:14.652 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:03:14.652 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:14.652 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:14.652 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:14.653 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:14.653 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:14.653 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:14.653 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:14.653 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:14.654 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:14.654 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:14.654 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:03:14.654 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:03:14.654 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:03:14.655 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:03:14.655 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:03:14.655 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:14.655 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:14.655 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:14.655 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:14.656 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:14.656 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:14.656 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:14.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.656 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "17", 2023-09-13T06:03:14.657 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:14.657 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:14.657 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:14.657 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:14.658 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:14.658 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:14.658 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:14.658 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:14.658 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:14.659 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:14.659 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:14.659 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:14.659 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:14.659 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:14.659 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:14.660 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:14.660 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:14.660 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:14.660 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:14.660 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:14.661 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:14.661 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:14.661 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:14.661 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:14.661 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:14.662 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:14.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.662 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:14.662 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:14.662 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:14.662 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:14.663 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:14.663 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:14.663 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:14.663 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:14.663 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:14.664 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:14.664 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:14.664 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:14.664 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:03:14.664 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:03:14.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.665 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:14.665 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:03:14.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.665 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:14.665 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:03:14.666 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:03:14.666 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:03:14.666 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:03:14.666 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:03:14.666 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:14.667 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:14.667 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:14.667 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.668 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 6, 2023-09-13T06:03:14.668 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:03:14.668 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.311861+0000", 2023-09-13T06:03:14.668 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:03:14.668 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:03:14.668 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:14.669 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:14.669 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:14.669 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:14.669 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:14.669 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:14.670 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:14.670 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:14.670 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:14.670 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:14.670 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:03:14.671 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:03:14.671 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:03:14.671 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:03:14.671 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:03:14.671 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:14.671 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:14.672 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:14.672 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:14.672 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:14.672 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:14.672 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:14.673 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.673 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "44", 2023-09-13T06:03:14.673 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:14.673 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:14.673 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:14.673 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:14.674 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:14.674 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:14.674 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:14.674 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:14.674 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:14.675 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:14.675 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:14.675 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:14.675 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:14.675 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:14.675 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:14.676 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:14.676 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:14.676 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:14.676 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:14.676 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:14.677 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:14.677 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:14.677 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:14.677 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:14.677 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:14.678 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:14.678 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.678 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:14.678 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:14.678 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:14.679 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:14.679 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:14.679 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:14.679 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:14.679 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:14.679 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:14.680 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:14.680 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:14.680 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:14.680 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:03:14.680 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:03:14.681 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:03:14.681 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.681 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:14.681 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:14.681 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:03:14.681 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.682 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:14.682 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:03:14.682 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:03:14.682 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:14.683 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:03:14.683 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:03:14.683 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:14.683 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:14.683 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:14.684 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.684 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.684 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.684 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 7, 2023-09-13T06:03:14.684 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:03:14.684 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.919645+0000", 2023-09-13T06:03:14.685 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:03:14.685 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:03:14.685 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:14.685 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:14.685 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:14.686 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:14.686 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:14.686 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:14.686 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:14.686 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:14.686 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:14.687 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:14.687 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:03:14.687 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:03:14.687 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:03:14.687 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:03:14.688 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:03:14.688 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:14.688 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:14.688 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:14.688 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:14.688 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:14.689 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:14.689 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:14.689 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.689 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "45", 2023-09-13T06:03:14.689 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:14.690 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:14.690 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:14.690 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:14.690 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:14.690 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:14.691 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:14.691 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:14.691 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:14.691 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:14.691 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:14.691 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:14.692 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:14.692 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:14.692 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:14.692 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:14.692 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:14.693 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:14.693 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:14.693 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:14.693 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:14.693 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:14.694 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:14.694 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:14.694 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:14.694 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:14.694 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.694 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:14.695 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:14.695 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:14.695 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:14.695 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:14.695 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:14.696 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:14.696 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:14.696 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:14.696 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:14.696 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:14.697 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:14.697 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:03:14.697 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:03:14.697 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.697 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:14.697 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:14.698 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:03:14.698 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.698 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:14.698 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.5, 2023-09-13T06:03:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.5, 2023-09-13T06:03:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.5, 2023-09-13T06:03:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.5, 2023-09-13T06:03:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:14.700 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:14.700 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.700 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.700 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:14.700 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:03:14.701 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.701 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:14.701 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:14.701 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:14.701 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:14.702 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:14.702 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:14.702 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:14.702 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:14.702 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:14.702 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:14.703 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:14.703 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:14.703 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:14.703 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.703 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.704 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.704 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:03:14.704 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:14.704 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.704 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.704 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.705 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:03:14.705 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:14.705 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.705 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.705 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.706 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:14.706 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.706 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.706 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.706 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:03:14.707 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:14.707 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.707 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.707 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.707 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:03:14.708 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:14.708 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.708 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.708 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.708 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:14.708 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.709 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.709 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.709 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:03:14.709 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:14.709 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.710 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.710 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.710 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:03:14.710 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:14.710 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.711 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.711 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.711 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:14.711 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.711 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.712 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.712 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:03:14.712 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:14.712 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.712 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.712 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.713 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:03:14.713 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:14.713 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.713 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.713 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.714 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:03:14.714 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:03:14.714 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:03:14.714 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:03:14.714 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:14.715 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:14.715 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:14.715 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.715 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.715 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:14.716 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:14.716 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:14.716 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:14.716 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:14.716 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:14.717 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:14.717 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:14.717 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:14.717 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:14.717 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:14.717 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:14.718 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:14.718 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.718 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.721 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.721 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:03:14.721 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:14.721 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.721 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.722 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.722 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:03:14.722 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:14.722 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.722 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.723 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:14.723 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.723 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.723 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.723 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:03:14.724 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:14.724 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.724 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.724 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.724 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:03:14.725 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:14.725 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.725 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.725 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.725 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:14.725 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.726 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.726 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.726 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:03:14.726 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:14.726 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.727 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.727 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:03:14.727 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:14.727 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.728 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.728 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:14.728 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:03:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.730 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:03:14.730 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:14.730 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.730 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.730 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.731 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:03:14.731 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:03:14.731 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:03:14.731 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:03:14.731 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:14.733 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:14.733 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:14.733 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:14.733 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:14.733 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:14.735 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:14.735 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.735 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.735 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.735 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:03:14.736 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:14.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.736 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.736 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:03:14.736 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:14.737 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.737 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.737 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.737 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:14.737 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.738 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.738 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.738 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:03:14.738 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:14.738 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.739 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.739 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:03:14.739 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:14.739 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.739 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.740 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:14.740 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.740 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.741 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:03:14.741 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:14.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.741 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.742 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:03:14.742 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:14.742 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.742 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.742 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.743 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:14.743 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.743 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.743 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.743 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:03:14.743 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:14.744 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.744 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.744 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:03:14.744 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:14.745 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.745 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.745 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:03:14.745 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:03:14.746 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:03:14.746 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:03:14.746 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:14.746 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:14.746 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:14.747 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.747 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.747 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:14.747 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:14.748 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:14.748 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:14.748 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:14.748 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:14.748 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:14.748 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:14.749 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:14.749 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:14.749 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:14.749 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:14.749 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:14.750 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.750 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.750 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:03:14.750 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:14.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.751 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.751 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.751 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:03:14.751 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:14.751 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.752 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.752 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.752 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:14.752 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.753 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.753 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:03:14.753 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:14.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.753 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.754 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:03:14.754 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:14.754 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.754 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.755 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:14.755 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.755 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.755 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:03:14.756 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:14.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.756 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.756 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:03:14.756 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:14.757 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.757 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.757 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:14.757 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.758 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.758 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:03:14.758 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:14.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.759 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.759 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:03:14.759 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:14.759 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.760 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.760 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:03:14.760 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:03:14.760 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:03:14.760 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:03:14.761 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:14.761 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:14.761 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:14.761 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.762 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:14.762 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:14.762 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:14.762 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:14.762 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:14.763 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:14.763 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:14.763 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:14.763 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:14.763 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:14.764 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:14.764 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:14.764 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:14.764 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.765 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.765 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:03:14.765 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:14.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.766 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.766 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:03:14.766 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:14.766 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.766 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.767 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:14.767 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.767 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.767 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:03:14.768 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:14.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.768 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.768 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:03:14.769 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:14.769 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.769 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.769 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:14.769 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.770 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.770 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:03:14.770 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:14.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.771 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.771 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:03:14.771 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:14.771 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:03:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:03:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:03:14.775 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:03:14.775 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:03:14.775 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:03:14.775 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:14.775 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:14.777 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:14.777 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:14.777 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:14.777 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:14.777 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:14.778 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:14.778 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:14.778 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:14.778 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:14.778 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:03:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:14.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.780 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.780 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:03:14.780 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:14.781 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.781 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.781 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:14.781 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.782 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.782 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:03:14.782 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:14.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.783 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.783 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:03:14.783 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:14.783 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.783 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.785 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:03:14.785 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:14.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.785 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.786 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:03:14.786 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:14.786 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.786 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.787 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:14.787 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.787 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.787 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:03:14.788 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:14.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.788 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.788 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:03:14.788 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:14.789 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.789 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.789 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:03:14.789 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:03:14.790 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:03:14.790 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:03:14.790 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:14.790 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:14.790 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:14.791 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:14.791 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:14.792 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:14.792 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:14.792 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:14.792 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:14.792 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:14.792 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:14.793 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:14.793 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:14.793 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:14.793 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:14.793 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:14.794 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.794 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.794 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:03:14.794 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:03:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:03:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:03:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:03:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:03:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:03:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:03:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:03:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:03:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:03:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:03:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:03:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:03:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:03:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:03:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:03:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:03:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:03:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:03:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:03:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:03:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:03:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:03:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:03:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:03:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:03:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:03:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:03:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:03:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:03:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:03:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:03:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:03:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [ 2023-09-13T06:03:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.13", 2023-09-13T06:03:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 5 2023-09-13T06:03:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.32", 2023-09-13T06:03:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 4 2023-09-13T06:03:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:03:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:03:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:03:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:03:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:03:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:03:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:03:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:03:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:03:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:03:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:03:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:03:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:03:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:03:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:03:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:03:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:03:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:03:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:03:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:03:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:03:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:03:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:03:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:14.844 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:03:14.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 -- 172.21.15.130:0/684241699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc58065b20 msgr2=0x7fcc58067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:14.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc58065b20 0x7fcc58067fe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcc68006cb0 tx=0x7fcc68009240 comp rx=0 tx=0).stop 2023-09-13T06:03:14.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 -- 172.21.15.130:0/684241699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc6c15e560 msgr2=0x7fcc6c137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:14.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc6c15e560 0x7fcc6c137ac0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400c730 tx=0x7fcc6400cbf0 comp rx=0 tx=0).stop 2023-09-13T06:03:14.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 -- 172.21.15.130:0/684241699 shutdown_connections 2023-09-13T06:03:14.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc58065b20 0x7fcc58067fe0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:14.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc6c15e560 0x7fcc6c137ac0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:14.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc6c157920 0x7fcc6c1475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:14.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 --2- 172.21.15.130:0/684241699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc6c0b0f40 0x7fcc6c153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:14.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 -- 172.21.15.130:0/684241699 >> 172.21.15.130:0/684241699 conn(0x7fcc6c065990 msgr2=0x7fcc6c15ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:14.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 -- 172.21.15.130:0/684241699 shutdown_connections 2023-09-13T06:03:14.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:14.643+0000 7fcc72f96640 1 -- 172.21.15.130:0/684241699 wait complete. 2023-09-13T06:03:14.849 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:03:16.338 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:03:16.335+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-09-13T06:03:19.850 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:03:20.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.995+0000 7f107029c640 1 Processor -- start 2023-09-13T06:03:20.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f107029c640 1 -- start start 2023-09-13T06:03:20.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f107029c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10680d1090 0x7f106815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f107029c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1068146f30 0x7f10680b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f107029c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10680b63c0 con 0x7f10680d1750 2023-09-13T06:03:20.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f107029c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106815dea0 con 0x7f10680d1090 2023-09-13T06:03:20.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f107029c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10680d0c20 con 0x7f1068146f30 2023-09-13T06:03:20.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f106d837640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10680d1090 0x7f106815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f106e839640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1068146f30 0x7f10680b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f106e038640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f10680d1750 0x7f1068146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:50574/0 (socket says 172.21.15.130:50574) 2023-09-13T06:03:20.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f106d837640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10680d1090 0x7f106815d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:56154/0 (socket says 172.21.15.130:56154) 2023-09-13T06:03:20.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f106e038640 1 -- 172.21.15.130:0/159507831 learned_addr learned my addr 172.21.15.130:0/159507831 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:20.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f106d837640 1 -- 172.21.15.130:0/159507831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1068146f30 msgr2=0x7f10680b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:20.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f106d837640 1 --2- 172.21.15.130:0/159507831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1068146f30 0x7f10680b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f106d837640 1 -- 172.21.15.130:0/159507831 >> v1:172.21.15.164:6789/0 conn(0x7f10680d1750 legacy=0x7f1068146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:20.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f106d837640 1 -- 172.21.15.130:0/159507831 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10680b6610 con 0x7f10680d1090 2023-09-13T06:03:20.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f106d036640 1 -- 172.21.15.130:0/159507831 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150086621 0 0) 0x7f10680b63c0 con 0x7f10680d1750 2023-09-13T06:03:20.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:19.999+0000 7f106e839640 1 --2- 172.21.15.130:0/159507831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1068146f30 0x7f10680b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:20.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f106d837640 1 --2- 172.21.15.130:0/159507831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10680d1090 0x7f106815d960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f10580097c0 tx=0x7f105801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b6f7af81a282a22 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:20.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f106d036640 1 -- 172.21.15.130:0/159507831 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580ab650 con 0x7f10680d1090 2023-09-13T06:03:20.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f106d036640 1 -- 172.21.15.130:0/159507831 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10580ab7b0 con 0x7f10680d1090 2023-09-13T06:03:20.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f106d036640 1 -- 172.21.15.130:0/159507831 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580abb40 con 0x7f10680d1090 2023-09-13T06:03:20.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f107029c640 1 -- 172.21.15.130:0/159507831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10680d1090 msgr2=0x7f106815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:20.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f107029c640 1 --2- 172.21.15.130:0/159507831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10680d1090 0x7f106815d960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f10580097c0 tx=0x7f105801c450 comp rx=0 tx=0).stop 2023-09-13T06:03:20.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f107029c640 1 -- 172.21.15.130:0/159507831 shutdown_connections 2023-09-13T06:03:20.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f107029c640 1 --2- 172.21.15.130:0/159507831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1068146f30 0x7f10680b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f107029c640 1 --2- 172.21.15.130:0/159507831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10680d1090 0x7f106815d960 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f107029c640 1 -- 172.21.15.130:0/159507831 >> 172.21.15.130:0/159507831 conn(0x7f106806f170 msgr2=0x7f106806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:20.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f107029c640 1 -- 172.21.15.130:0/159507831 shutdown_connections 2023-09-13T06:03:20.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.003+0000 7f107029c640 1 -- 172.21.15.130:0/159507831 wait complete. 2023-09-13T06:03:20.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f107029c640 1 Processor -- start 2023-09-13T06:03:20.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f107029c640 1 -- start start 2023-09-13T06:03:20.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f107029c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10680d1090 0x7f106815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f107029c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10680d1750 0x7f1068145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f107029c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1068146f30 0x7f10680b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f107029c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10681621c0 con 0x7f1068146f30 2023-09-13T06:03:20.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f107029c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106815c060 con 0x7f10680d1750 2023-09-13T06:03:20.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f107029c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106815c340 con 0x7f10680d1090 2023-09-13T06:03:20.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f106e839640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1068146f30 0x7f10680b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f106e839640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1068146f30 0x7f10680b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59718/0 (socket says 172.21.15.130:59718) 2023-09-13T06:03:20.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f106e839640 1 -- 172.21.15.130:0/2603859835 learned_addr learned my addr 172.21.15.130:0/2603859835 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:20.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f106d837640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10680d1750 0x7f1068145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f106e038640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10680d1090 0x7f106815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f106e839640 1 -- 172.21.15.130:0/2603859835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10680d1090 msgr2=0x7f106815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:20.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f106e839640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10680d1090 0x7f106815ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f106e839640 1 -- 172.21.15.130:0/2603859835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10680d1750 msgr2=0x7f1068145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:20.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f106e839640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10680d1750 0x7f1068145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f106e839640 1 -- 172.21.15.130:0/2603859835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060009a70 con 0x7f1068146f30 2023-09-13T06:03:20.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f106e839640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1068146f30 0x7f10680b46c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f106000efc0 tx=0x7f106000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:20.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f105effd640 1 -- 172.21.15.130:0/2603859835 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060009cd0 con 0x7f1068146f30 2023-09-13T06:03:20.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f105effd640 1 -- 172.21.15.130:0/2603859835 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000f040 con 0x7f1068146f30 2023-09-13T06:03:20.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f105effd640 1 -- 172.21.15.130:0/2603859835 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10600039a0 con 0x7f1068146f30 2023-09-13T06:03:20.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f107029c640 1 -- 172.21.15.130:0/2603859835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1058009420 con 0x7f1068146f30 2023-09-13T06:03:20.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.007+0000 7f107029c640 1 -- 172.21.15.130:0/2603859835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10680b7e40 con 0x7f1068146f30 2023-09-13T06:03:20.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.011+0000 7f107029c640 1 -- 172.21.15.130:0/2603859835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1068162330 con 0x7f1068146f30 2023-09-13T06:03:20.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.011+0000 7f105effd640 1 -- 172.21.15.130:0/2603859835 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1060014480 con 0x7f1068146f30 2023-09-13T06:03:20.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.011+0000 7f105effd640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f104c065b20 0x7f104c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.011+0000 7f105effd640 1 -- 172.21.15.130:0/2603859835 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1060083eb0 con 0x7f1068146f30 2023-09-13T06:03:20.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.011+0000 7f105effd640 1 -- 172.21.15.130:0/2603859835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=51}) v3 -- 0x7f104c06d710 con 0x7f1068146f30 2023-09-13T06:03:20.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.011+0000 7f106e038640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f104c065b20 0x7f104c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.011+0000 7f106e038640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f104c065b20 0x7f104c067fe0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1064007fd0 tx=0x7f1064007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:20.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.015+0000 7f105effd640 1 -- 172.21.15.130:0/2603859835 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f10600517d0 con 0x7f1068146f30 2023-09-13T06:03:20.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.179+0000 7f107029c640 1 -- 172.21.15.130:0/2603859835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f10680618a0 con 0x7f1068146f30 2023-09-13T06:03:20.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.179+0000 7f105effd640 1 -- 172.21.15.130:0/2603859835 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+34474 (secure 0 0 0) 0x7f1060018030 con 0x7f1068146f30 2023-09-13T06:03:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:20.185 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:03:20.185 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 50, 2023-09-13T06:03:20.185 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:03:20.185 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:03:20.185 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:03:17.349343+0000", 2023-09-13T06:03:20.186 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:03:20.186 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:03:20.186 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:03:20.186 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:03:20.186 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:03:20.187 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:03:20.187 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:03:20.187 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:03:20.187 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:03:20.187 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:20.187 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:03:20.188 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:03:20.188 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:03:20.188 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:03:20.188 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:03:20.188 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 7, 2023-09-13T06:03:20.189 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:03:20.189 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:03:20.189 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "luminous", 2023-09-13T06:03:20.190 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:03:20.190 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:03:20.190 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:03:20.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.190 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:03:20.191 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:03:20.191 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:03:20.191 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:20.191 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:20.191 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:20.191 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:20.192 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:20.192 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:20.192 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:20.192 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:20.192 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:20.193 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:20.193 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:20.193 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:20.193 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:03:20.193 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:03:20.194 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:03:20.194 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:03:20.194 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:03:20.194 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:20.194 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:20.195 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:20.195 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:20.195 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:20.195 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:20.195 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:20.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.196 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:20.196 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:20.196 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:20.196 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:20.197 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:20.197 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:20.197 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:20.197 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:20.197 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:20.197 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:20.198 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:20.198 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:20.198 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:20.198 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:20.198 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:20.199 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:20.199 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:20.199 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:20.199 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:20.199 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:20.200 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:20.200 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:20.200 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:20.201 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:20.201 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:20.201 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:20.201 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:20.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.202 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:20.202 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:20.203 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:20.203 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:20.203 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:20.203 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:20.203 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:20.204 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:20.204 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:20.204 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:20.204 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:20.205 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:20.205 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:03:20.205 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:03:20.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.205 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:20.206 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:03:20.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.206 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:20.206 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:03:20.206 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:03:20.207 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:03:20.207 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:03:20.207 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:03:20.207 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:20.207 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:20.208 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:20.208 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.208 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 6, 2023-09-13T06:03:20.209 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:03:20.209 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.311861+0000", 2023-09-13T06:03:20.209 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:20.209 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:20.209 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:20.210 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:20.210 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:20.210 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:20.211 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:20.211 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:20.211 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:20.211 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:20.211 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:20.212 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:20.212 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:03:20.212 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:03:20.212 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:03:20.212 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:03:20.212 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:03:20.213 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:20.213 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:20.213 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:20.213 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:20.213 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:20.214 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:20.214 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:20.214 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.214 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:20.214 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:20.215 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:20.215 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:20.215 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:20.215 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:20.215 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:20.215 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:20.216 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:20.216 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:20.216 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:20.216 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:20.217 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:20.217 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:20.217 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:20.217 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:20.217 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:20.218 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:20.218 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:20.218 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:20.218 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:20.218 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:20.219 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:20.219 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:20.219 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:20.219 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:20.219 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:20.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.220 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:20.220 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:20.220 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:20.220 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:20.221 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:20.221 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:20.221 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:20.221 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:20.221 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:20.222 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:20.222 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:20.222 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:20.222 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:03:20.222 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:03:20.223 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:03:20.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.223 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:20.223 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:20.223 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:03:20.224 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.224 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:20.224 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:03:20.224 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:03:20.225 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:20.225 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:03:20.225 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:03:20.225 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:20.225 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:20.225 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:20.226 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.226 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 7, 2023-09-13T06:03:20.226 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:03:20.227 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.919645+0000", 2023-09-13T06:03:20.227 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:20.227 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:20.227 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:20.227 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:20.228 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:20.228 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:20.228 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:20.228 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:20.228 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:20.229 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:20.229 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:20.229 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:20.229 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:03:20.229 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:03:20.229 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:03:20.230 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:03:20.230 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:03:20.230 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:20.230 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:20.231 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:20.231 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:20.231 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:20.231 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:20.231 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:20.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:20.233 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:20.233 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:20.233 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:20.233 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:20.234 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:20.234 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:20.234 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:20.234 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:20.234 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:20.235 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:20.235 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:20.235 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:20.235 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:20.235 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:20.235 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:20.236 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:20.236 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:20.236 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:20.236 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:20.236 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:20.237 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:20.237 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:20.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.237 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:20.237 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:20.238 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:20.238 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:20.238 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:20.238 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:20.238 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:20.239 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:20.239 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:20.239 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:20.239 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:20.239 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:20.239 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:03:20.240 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:03:20.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.240 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:20.240 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:20.240 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:03:20.241 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.241 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:20.241 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.5, 2023-09-13T06:03:20.241 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.5, 2023-09-13T06:03:20.241 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:20.242 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.5, 2023-09-13T06:03:20.242 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.5, 2023-09-13T06:03:20.242 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:20.242 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:20.242 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:20.243 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.243 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.243 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:20.243 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:03:20.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.244 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:20.244 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:20.244 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:20.244 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:20.244 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:20.244 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:20.245 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:20.245 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:20.245 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:20.245 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:20.245 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:20.246 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:20.246 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:20.246 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.246 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.246 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:03:20.247 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:20.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.247 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.247 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:03:20.248 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:20.248 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.248 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.248 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:20.248 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.249 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.249 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:03:20.249 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:20.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.250 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.250 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:03:20.250 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:20.250 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.251 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.251 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:20.251 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.251 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.251 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.252 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:03:20.252 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:20.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.254 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.254 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:03:20.255 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:20.255 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.255 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.255 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:20.256 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.256 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.256 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.256 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:03:20.256 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:20.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.257 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.257 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.257 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:03:20.257 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:20.257 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.258 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.258 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:03:20.258 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:03:20.258 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:03:20.259 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:03:20.259 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:20.259 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:20.259 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:20.259 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:20.259 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.260 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:20.260 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:20.260 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:20.261 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:20.261 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:20.261 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:20.261 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:20.261 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:20.262 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:20.262 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:20.262 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:20.262 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:20.262 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:20.263 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.263 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.263 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:03:20.263 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:20.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.264 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.264 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:03:20.264 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:20.264 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.265 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.265 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:20.265 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.266 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.266 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:03:20.266 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:20.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.267 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.267 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:03:20.267 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:20.267 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.267 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.268 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:20.268 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.268 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.269 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:03:20.269 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:20.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.269 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.270 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:03:20.270 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:20.270 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.270 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.270 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:20.271 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.271 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.271 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:03:20.271 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:20.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.272 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.272 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:03:20.272 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:20.273 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.273 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.273 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:03:20.273 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:03:20.273 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:03:20.274 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:03:20.274 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:20.274 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:20.274 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:20.274 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.275 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:20.275 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:20.275 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:20.276 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:20.276 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:20.276 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:20.276 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:20.276 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:20.277 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:20.277 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:20.277 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:20.277 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:20.277 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:20.278 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.278 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.278 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:03:20.278 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:20.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.279 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.279 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:03:20.279 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:20.279 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.280 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.280 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:20.280 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.281 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.281 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:03:20.281 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:20.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.282 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.282 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:03:20.282 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:20.282 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.282 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.283 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:20.283 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.283 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.283 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.283 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:03:20.284 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:20.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.284 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.284 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.284 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:03:20.285 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:20.285 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.285 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.285 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:20.286 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.286 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.286 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.286 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:03:20.286 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:20.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.287 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.287 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:03:20.287 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:20.288 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.288 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.288 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:03:20.288 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:03:20.289 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:03:20.289 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:03:20.289 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:20.289 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:20.289 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:20.290 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:20.290 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:20.290 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:20.291 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:20.291 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:20.291 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:20.291 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:20.291 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:20.293 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:20.293 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.293 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.293 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:03:20.294 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:20.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.294 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.294 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:03:20.295 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:20.295 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.295 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.295 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:20.296 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.296 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.296 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:03:20.296 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:20.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.297 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.297 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:03:20.297 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:20.297 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.298 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.298 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:20.298 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:03:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.300 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:03:20.300 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:20.300 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.300 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.301 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:20.301 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.301 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.301 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:03:20.301 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:20.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.302 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.302 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:03:20.302 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:20.303 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.303 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.303 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:03:20.303 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:03:20.304 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:03:20.304 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:03:20.304 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:20.304 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull", 2023-09-13T06:03:20.304 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:20.304 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:20.305 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.305 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:20.305 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:20.306 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:20.306 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:20.306 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:20.306 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:20.306 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:20.307 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:20.307 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:20.307 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:20.307 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:20.307 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:20.307 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:20.308 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.308 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.308 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:03:20.308 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:20.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.309 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.309 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:03:20.309 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:20.310 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.310 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.310 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:20.310 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.311 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.311 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:03:20.311 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:20.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.311 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.312 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.312 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:03:20.312 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:20.312 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.312 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.313 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:20.313 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.313 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.314 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:03:20.314 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:20.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.314 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.315 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:03:20.315 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:20.315 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.315 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.315 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:20.316 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.316 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.316 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:03:20.316 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:20.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.317 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.317 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:03:20.317 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:20.317 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.318 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.318 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:03:20.318 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:03:20.318 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:03:20.319 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:03:20.319 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:20.319 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:20.319 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:20.319 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:20.321 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:20.321 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:20.321 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:20.321 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:20.321 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:20.322 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:20.322 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:20.322 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:20.322 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:20.322 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.323 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.323 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:03:20.323 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:20.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.324 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.324 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:03:20.324 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:20.324 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.324 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.325 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:20.325 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.325 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.325 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:03:20.326 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:20.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.326 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.326 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.326 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:03:20.326 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:20.327 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.327 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.327 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:20.327 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.328 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.328 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:03:20.328 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:20.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.329 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.329 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:03:20.329 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:20.329 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.330 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.330 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:20.330 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.330 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.331 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:03:20.331 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:20.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.332 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.332 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:03:20.332 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:20.332 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.332 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.333 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.333 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:03:20.333 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:03:20.333 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:03:20.333 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:03:20.334 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:20.334 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:20.334 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:20.334 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.335 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:20.335 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:20.335 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:20.336 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:20.336 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:20.336 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:20.336 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:20.336 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:20.337 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:20.337 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:20.337 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:20.337 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:20.338 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:20.338 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.338 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.339 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:03:20.339 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:20.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.339 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.340 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:03:20.340 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:20.340 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.340 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.341 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:20.341 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.342 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.342 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:03:20.342 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:20.342 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.343 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.343 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:03:20.343 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:20.343 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.343 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.344 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:20.344 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.344 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.344 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:03:20.345 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:20.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.345 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.345 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:03:20.346 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:20.346 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.346 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.346 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:20.346 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.347 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.347 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:03:20.347 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:20.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.348 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.348 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:03:20.348 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:20.348 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.349 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.349 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:03:20.349 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:03:20.349 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:03:20.349 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:03:20.350 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:20.350 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:20.350 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:20.350 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:20.350 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.351 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:20.351 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:20.351 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:20.351 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:20.352 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:20.352 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:20.352 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:20.352 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:20.352 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:20.353 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:20.353 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:20.353 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:20.353 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:20.353 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.354 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.354 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:03:20.354 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:20.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.355 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.355 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:03:20.355 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:20.355 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.355 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.356 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:20.356 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.356 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.357 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:03:20.357 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:20.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.357 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.358 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:03:20.358 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:20.358 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.358 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.358 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:20.359 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.359 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.359 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:03:20.359 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:20.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.360 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.360 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:03:20.360 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:20.360 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.361 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.361 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:20.361 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:20.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.362 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:20.362 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:03:20.362 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:20.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.362 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:20.363 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:03:20.363 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:20.363 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.363 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:03:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:03:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:03:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:03:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:20.365 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:20.365 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.365 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.365 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:20.365 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:03:20.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.366 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:20.366 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:20.366 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:20.366 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:20.366 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:20.367 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:20.367 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:03:20.367 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:20.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.368 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:20.368 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:20.368 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:20.368 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:20.368 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:20.369 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:20.369 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:03:20.369 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:20.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.369 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.370 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:20.370 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:20.370 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:20.370 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:20.370 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:20.370 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:20.371 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:03:20.371 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:20.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.371 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:20.372 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:20.372 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:20.372 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:20.372 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:20.372 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:20.373 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:03:20.373 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:20.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.373 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:20.373 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:20.374 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:20.374 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:20.374 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:20.374 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:20.374 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:03:20.375 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:20.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.375 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:20.375 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:20.375 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:20.376 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:20.376 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:20.376 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:20.376 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:03:20.376 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:20.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.377 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:20.377 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:20.377 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:20.378 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:20.378 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:20.378 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:20.378 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:03:20.378 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:20.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.379 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:20.379 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:20.379 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:20.379 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:20.380 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:20.380 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:20.380 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:03:20.380 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:20.380 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.381 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:20.381 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:03:20.381 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [ 2023-09-13T06:03:20.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.381 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.13", 2023-09-13T06:03:20.382 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:20.382 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.382 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:20.382 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 5 2023-09-13T06:03:20.382 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.383 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.383 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.32", 2023-09-13T06:03:20.383 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:20.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:20.384 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:20.384 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 4 2023-09-13T06:03:20.384 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.384 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:20.384 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.385 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:20.385 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:03:20.385 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:03:20.385 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:03:20.385 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:03:20.386 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:03:20.386 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:03:20.386 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:03:20.386 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:03:20.386 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:03:20.387 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:03:20.387 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:03:20.387 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:03:20.387 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:20.388 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:03:20.388 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:03:20.388 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:03:20.388 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:03:20.388 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:03:20.389 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:03:20.389 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:03:20.389 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:03:20.389 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:03:20.389 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:03:20.390 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:03:20.390 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:20.390 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:03:20.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 -- 172.21.15.130:0/2603859835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f104c065b20 msgr2=0x7f104c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:20.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f104c065b20 0x7f104c067fe0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1064007fd0 tx=0x7f1064007d60 comp rx=0 tx=0).stop 2023-09-13T06:03:20.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 -- 172.21.15.130:0/2603859835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1068146f30 msgr2=0x7f10680b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:20.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1068146f30 0x7f10680b46c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f106000efc0 tx=0x7f106000c490 comp rx=0 tx=0).stop 2023-09-13T06:03:20.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 -- 172.21.15.130:0/2603859835 shutdown_connections 2023-09-13T06:03:20.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f104c065b20 0x7f104c067fe0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10680d1750 0x7f1068145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1068146f30 0x7f10680b46c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 --2- 172.21.15.130:0/2603859835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10680d1090 0x7f106815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 -- 172.21.15.130:0/2603859835 >> 172.21.15.130:0/2603859835 conn(0x7f106806f170 msgr2=0x7f106806f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:20.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 -- 172.21.15.130:0/2603859835 shutdown_connections 2023-09-13T06:03:20.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.183+0000 7f107029c640 1 -- 172.21.15.130:0/2603859835 wait complete. 2023-09-13T06:03:20.395 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-09-13T06:03:20.395 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:03:20.395 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:20.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:20.405 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-09-13T06:03:20.745 INFO:teuthology.orchestra.run.smithi130.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-09-13T06:03:20.745 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records in 2023-09-13T06:03:20.745 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records out 2023-09-13T06:03:20.745 INFO:teuthology.orchestra.run.smithi130.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.276822 s, 189 MB/s 2023-09-13T06:03:20.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:03:20.747 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:03:20.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.879+0000 7feb76bba640 1 Processor -- start 2023-09-13T06:03:20.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.879+0000 7feb76bba640 1 -- start start 2023-09-13T06:03:20.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb76bba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb70146d40 0x7feb7006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb76bba640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb70072030 0x7feb7006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb76bba640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb70070f90 con 0x7feb70070280 2023-09-13T06:03:20.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb76bba640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb700cf140 con 0x7feb70072030 2023-09-13T06:03:20.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb76bba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb70071270 con 0x7feb70146d40 2023-09-13T06:03:20.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb67fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb70072030 0x7feb7006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb67fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb70072030 0x7feb7006dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34992/0 (socket says 172.21.15.130:34992) 2023-09-13T06:03:20.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb67fff640 1 -- 172.21.15.130:0/4163494692 learned_addr learned my addr 172.21.15.130:0/4163494692 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:20.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb74956640 1 --2- 172.21.15.130:0/4163494692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb70146d40 0x7feb7006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb67fff640 1 -- 172.21.15.130:0/4163494692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb70146d40 msgr2=0x7feb7006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:20.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb67fff640 1 --2- 172.21.15.130:0/4163494692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb70146d40 0x7feb7006d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb67fff640 1 -- 172.21.15.130:0/4163494692 >> v1:172.21.15.164:6789/0 conn(0x7feb70070280 legacy=0x7feb70070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:20.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb67fff640 1 -- 172.21.15.130:0/4163494692 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70071550 con 0x7feb70072030 2023-09-13T06:03:20.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb74956640 1 --2- 172.21.15.130:0/4163494692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb70146d40 0x7feb7006d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:20.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.883+0000 7feb67fff640 1 --2- 172.21.15.130:0/4163494692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70072030 0x7feb7006dcd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7feb60009870 tx=0x7feb6001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af6c919543ff43f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:20.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb677fe640 1 -- 172.21.15.130:0/4163494692 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600aa670 con 0x7feb70072030 2023-09-13T06:03:20.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb677fe640 1 -- 172.21.15.130:0/4163494692 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb600aa7d0 con 0x7feb70072030 2023-09-13T06:03:20.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb677fe640 1 -- 172.21.15.130:0/4163494692 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600aab60 con 0x7feb70072030 2023-09-13T06:03:20.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 -- 172.21.15.130:0/4163494692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70072030 msgr2=0x7feb7006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:20.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 --2- 172.21.15.130:0/4163494692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70072030 0x7feb7006dcd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7feb60009870 tx=0x7feb6001c510 comp rx=0 tx=0).stop 2023-09-13T06:03:20.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 -- 172.21.15.130:0/4163494692 shutdown_connections 2023-09-13T06:03:20.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 --2- 172.21.15.130:0/4163494692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70072030 0x7feb7006dcd0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 --2- 172.21.15.130:0/4163494692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb70146d40 0x7feb7006d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 -- 172.21.15.130:0/4163494692 >> 172.21.15.130:0/4163494692 conn(0x7feb7006a2f0 msgr2=0x7feb7006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:20.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 -- 172.21.15.130:0/4163494692 shutdown_connections 2023-09-13T06:03:20.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 -- 172.21.15.130:0/4163494692 wait complete. 2023-09-13T06:03:20.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 Processor -- start 2023-09-13T06:03:20.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 -- start start 2023-09-13T06:03:20.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb70070280 0x7feb700b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70072030 0x7feb70155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb70146d40 0x7feb70155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700b5120 con 0x7feb70072030 2023-09-13T06:03:20.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700b4510 con 0x7feb70146d40 2023-09-13T06:03:20.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb76bba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb700b47f0 con 0x7feb70070280 2023-09-13T06:03:20.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.887+0000 7feb67fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70072030 0x7feb70155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb67fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70072030 0x7feb70155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34996/0 (socket says 172.21.15.130:34996) 2023-09-13T06:03:20.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb67fff640 1 -- 172.21.15.130:0/1920520582 learned_addr learned my addr 172.21.15.130:0/1920520582 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:20.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb75157640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb70146d40 0x7feb70155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb74956640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb70070280 0x7feb700b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb67fff640 1 -- 172.21.15.130:0/1920520582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb70070280 msgr2=0x7feb700b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:20.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb67fff640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb70070280 0x7feb700b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb67fff640 1 -- 172.21.15.130:0/1920520582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb70146d40 msgr2=0x7feb70155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:20.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb67fff640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb70146d40 0x7feb70155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:20.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb67fff640 1 -- 172.21.15.130:0/1920520582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb600094d0 con 0x7feb70072030 2023-09-13T06:03:20.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb67fff640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70072030 0x7feb70155740 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7feb6001a140 tx=0x7feb6001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:20.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb657fa640 1 -- 172.21.15.130:0/1920520582 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600b38c0 con 0x7feb70072030 2023-09-13T06:03:20.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb657fa640 1 -- 172.21.15.130:0/1920520582 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb600b3a20 con 0x7feb70072030 2023-09-13T06:03:20.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb657fa640 1 -- 172.21.15.130:0/1920520582 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600b3dd0 con 0x7feb70072030 2023-09-13T06:03:20.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb76bba640 1 -- 172.21.15.130:0/1920520582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb700b4ad0 con 0x7feb70072030 2023-09-13T06:03:20.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb76bba640 1 -- 172.21.15.130:0/1920520582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb70144ae0 con 0x7feb70072030 2023-09-13T06:03:20.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb76bba640 1 -- 172.21.15.130:0/1920520582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb700b5290 con 0x7feb70072030 2023-09-13T06:03:20.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.891+0000 7feb657fa640 1 -- 172.21.15.130:0/1920520582 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7feb600b2380 con 0x7feb70072030 2023-09-13T06:03:20.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.895+0000 7feb657fa640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb5c065b50 0x7feb5c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:20.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.895+0000 7feb657fa640 1 -- 172.21.15.130:0/1920520582 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5767+0+0 (secure 0 0 0) 0x7feb6011dbd0 con 0x7feb70072030 2023-09-13T06:03:20.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.895+0000 7feb74956640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb5c065b50 0x7feb5c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:20.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.895+0000 7feb657fa640 1 -- 172.21.15.130:0/1920520582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7feb5c06d740 con 0x7feb70072030 2023-09-13T06:03:20.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.895+0000 7feb74956640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb5c065b50 0x7feb5c068010 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feb70156620 tx=0x7feb6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:20.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:20.899+0000 7feb657fa640 1 -- 172.21.15.130:0/1920520582 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7feb600eb590 con 0x7feb70072030 2023-09-13T06:03:21.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.047+0000 7feb76bba640 1 -- 172.21.15.130:0/1920520582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7feb700618a0 con 0x7feb70072030 2023-09-13T06:03:21.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.047+0000 7feb657fa640 1 -- 172.21.15.130:0/1920520582 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+34498 (secure 0 0 0) 0x7feb600c3070 con 0x7feb70072030 2023-09-13T06:03:21.053 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:21.053 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:03:21.053 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 51, 2023-09-13T06:03:21.054 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:03:21.054 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:03:21.054 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:03:20.366252+0000", 2023-09-13T06:03:21.054 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:03:21.054 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:03:21.055 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:03:21.055 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:03:21.055 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:03:21.055 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:03:21.055 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:03:21.056 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:03:21.056 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:03:21.056 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:21.056 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:03:21.056 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:03:21.057 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:03:21.057 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:03:21.057 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:03:21.057 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 7, 2023-09-13T06:03:21.057 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:03:21.058 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:03:21.058 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "luminous", 2023-09-13T06:03:21.058 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:03:21.058 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:03:21.058 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:03:21.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.059 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:03:21.059 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:03:21.059 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:03:21.059 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:21.059 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:21.060 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:21.060 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:21.060 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:21.060 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:21.060 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:21.061 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:21.061 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:21.061 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:21.061 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:21.061 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:21.062 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:03:21.062 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:03:21.062 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:03:21.062 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:03:21.062 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:03:21.063 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:21.063 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:21.063 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:21.063 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:21.063 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:21.064 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:21.064 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:21.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.064 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:21.064 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:21.065 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:21.065 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:21.065 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:21.065 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:21.065 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:21.066 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:21.066 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:21.066 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:21.066 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:21.066 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:21.067 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:21.067 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:21.067 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:21.067 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:21.067 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:21.067 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:21.068 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:21.068 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:21.068 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:21.068 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:21.068 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:21.069 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:21.069 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:21.069 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:21.069 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:21.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.070 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:21.070 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:21.070 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:21.070 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:21.070 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:21.071 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:21.071 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:21.071 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:21.071 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:21.071 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:21.072 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:21.072 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:21.072 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:03:21.072 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:03:21.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.073 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:21.073 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:03:21.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.073 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:21.074 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:03:21.074 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:03:21.074 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:03:21.074 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:03:21.074 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:03:21.075 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:21.075 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:21.075 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:21.075 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.076 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 6, 2023-09-13T06:03:21.076 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:03:21.076 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.311861+0000", 2023-09-13T06:03:21.076 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:21.076 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:21.077 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:21.077 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:21.077 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:21.077 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:21.077 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:21.078 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:21.078 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:21.078 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:21.078 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:21.078 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:21.081 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:03:21.081 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:03:21.081 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:03:21.081 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:03:21.082 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:03:21.082 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:21.082 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:21.082 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:21.083 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:21.083 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:21.083 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:21.083 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:21.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.083 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:21.084 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:21.084 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:21.084 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:21.084 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:21.084 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:21.085 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:21.085 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:21.085 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:21.085 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:21.085 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:21.085 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:21.086 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:21.086 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:21.086 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:21.086 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:21.086 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:21.087 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:21.087 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:21.087 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:21.087 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:21.087 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:21.088 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:21.088 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:21.088 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:21.088 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:21.088 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:21.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.089 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:21.089 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:21.089 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:21.089 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:21.089 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:21.090 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:21.090 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:21.090 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:21.090 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:21.090 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:21.091 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:21.091 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:21.091 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:03:21.091 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:03:21.091 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:03:21.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.092 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:21.092 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:21.092 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:03:21.092 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.093 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:21.093 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:03:21.093 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:03:21.093 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:21.093 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:03:21.094 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:03:21.094 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:21.094 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:21.094 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:21.095 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.095 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 7, 2023-09-13T06:03:21.095 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:03:21.095 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.919645+0000", 2023-09-13T06:03:21.096 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:21.096 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:21.096 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:21.096 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:21.096 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:21.097 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:21.097 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:21.097 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:21.097 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:21.097 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:21.098 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:21.098 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:21.098 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:03:21.098 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:03:21.098 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:03:21.099 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:03:21.099 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:03:21.099 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:21.099 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:21.099 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:21.100 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:21.100 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:21.100 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:21.100 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:21.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.100 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:21.101 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:21.101 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:21.101 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:21.101 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:21.101 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:21.102 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:21.102 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:21.102 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:21.102 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:21.102 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:21.103 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:21.103 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:21.103 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:21.103 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:21.103 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:21.104 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:21.104 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:21.104 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:21.104 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:21.104 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:21.104 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:21.105 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:21.105 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:21.105 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:21.105 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:21.105 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:21.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.106 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:21.106 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:21.106 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:21.106 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:21.107 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:21.107 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:21.107 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:21.107 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:21.107 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:21.107 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:21.108 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:21.108 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:21.108 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:03:21.108 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:03:21.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.109 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:21.109 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:21.109 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:03:21.109 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.110 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:21.110 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.5, 2023-09-13T06:03:21.110 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.5, 2023-09-13T06:03:21.110 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:21.110 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.5, 2023-09-13T06:03:21.110 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.5, 2023-09-13T06:03:21.111 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:21.111 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:21.111 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:21.111 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.111 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.112 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:21.112 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:03:21.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.112 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:21.112 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:21.113 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:21.113 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:21.113 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:21.113 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:21.113 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:21.113 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:21.114 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:21.114 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:21.114 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:21.114 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:21.114 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:21.115 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.115 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.115 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:03:21.115 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:21.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.116 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.116 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:03:21.116 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:21.117 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.117 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.117 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:21.118 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.118 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.119 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:03:21.119 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:21.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.119 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.120 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:03:21.120 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:21.120 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.120 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.121 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:21.121 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.122 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.122 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:03:21.122 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:21.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.123 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.123 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:03:21.123 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:21.123 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.123 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.124 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:21.125 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.125 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.125 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:03:21.126 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:21.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.126 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.126 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:03:21.127 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:21.127 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.127 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.128 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:03:21.128 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:03:21.128 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:03:21.129 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:03:21.129 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:21.130 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:21.130 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:21.131 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:21.131 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.131 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:21.132 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:21.132 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:21.132 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:21.132 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:21.133 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:21.133 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:21.134 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:21.134 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:21.134 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:21.134 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:21.134 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:21.135 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:21.135 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.135 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.136 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:03:21.136 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:21.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.136 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.137 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:03:21.137 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:21.137 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.137 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.138 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.138 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:21.138 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.139 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.139 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:03:21.139 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:21.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.140 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.140 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:03:21.140 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:21.141 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.141 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.142 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:21.142 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.142 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.142 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.143 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:03:21.143 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:21.143 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.143 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.143 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.144 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:03:21.144 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:21.144 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.144 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.145 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:21.145 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.146 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.146 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:03:21.146 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:21.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.146 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.147 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.147 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:03:21.147 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:21.148 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.148 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.149 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:03:21.149 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:03:21.149 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:03:21.150 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:03:21.150 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:21.150 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:21.150 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:21.151 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.151 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:21.151 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:21.152 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:21.152 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:21.152 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:21.152 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:21.152 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:21.153 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:21.153 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:21.153 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:21.154 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:21.154 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:21.154 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:21.155 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.155 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.156 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:03:21.156 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:21.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.157 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.157 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:03:21.157 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:21.158 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.158 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.158 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:21.159 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.159 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.159 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:03:21.160 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:21.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.160 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.161 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:03:21.161 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:21.161 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.161 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.162 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:21.162 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.162 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.163 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.163 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:03:21.163 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:21.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.163 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.164 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.164 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:03:21.164 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:21.164 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.165 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.165 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:21.165 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.166 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.166 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:03:21.166 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:21.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.167 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.167 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:03:21.167 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:21.168 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.168 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.169 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:03:21.169 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:03:21.169 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:03:21.170 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:03:21.170 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:21.170 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:21.171 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:21.171 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:21.171 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.172 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:21.172 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:21.173 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:21.173 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:21.173 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:21.173 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:21.174 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:21.174 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:21.174 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:21.174 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:21.174 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:21.175 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:21.175 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:21.175 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.176 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.176 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:03:21.176 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:21.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.177 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.177 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.177 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:03:21.177 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:21.177 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.178 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.178 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.178 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:21.178 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.179 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.179 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:03:21.179 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:21.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.180 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.180 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.180 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:03:21.180 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:21.181 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.181 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.181 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.181 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:21.182 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.182 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.182 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:03:21.182 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:21.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.183 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.183 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:03:21.184 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:21.184 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.184 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.184 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:21.185 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.185 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.185 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:03:21.186 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:21.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.186 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.186 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:03:21.187 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:21.187 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.187 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.187 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:03:21.188 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:03:21.188 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:03:21.188 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:03:21.188 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:21.189 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull", 2023-09-13T06:03:21.189 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:21.189 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:21.189 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.190 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:21.190 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:21.190 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:21.191 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:21.191 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:21.191 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:21.191 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:21.191 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:21.192 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:21.192 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:21.192 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:21.192 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:21.192 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:21.193 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.193 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.193 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:03:21.193 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:21.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.194 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.194 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:03:21.194 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:21.194 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.195 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.195 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.195 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:21.195 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.195 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.196 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.196 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:03:21.196 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:21.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.197 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.197 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:03:21.197 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:21.197 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.197 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.197 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.198 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:21.198 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.198 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.198 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.198 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:03:21.199 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:21.199 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.199 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.200 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:03:21.200 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:21.200 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.200 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.201 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:21.201 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.201 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.201 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.201 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:03:21.201 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:21.202 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.202 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.202 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:03:21.202 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:21.203 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.203 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.203 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:03:21.203 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:03:21.204 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:03:21.204 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:03:21.204 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:21.204 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:21.204 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:21.204 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.205 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:21.205 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:21.205 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:21.206 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:21.206 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:21.206 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:21.206 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:21.206 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:21.207 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:21.207 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:21.207 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:21.207 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:21.207 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:21.207 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.208 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.208 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:03:21.208 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:21.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.209 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.209 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:03:21.209 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:21.209 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.209 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.210 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:21.210 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.210 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.210 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.211 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:03:21.211 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:21.211 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.211 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.211 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.211 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:03:21.212 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:21.212 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.212 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.212 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:21.213 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.213 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.213 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.213 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:03:21.213 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:21.213 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.214 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.214 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.214 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:03:21.214 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:21.214 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.215 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.215 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.215 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:21.215 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.216 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.216 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:03:21.216 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:21.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.217 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.217 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:03:21.217 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:21.217 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.217 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.218 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.218 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:03:21.218 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:03:21.218 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:03:21.218 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:03:21.219 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:21.219 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:21.219 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:21.219 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.220 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.220 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:21.220 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:21.220 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:21.220 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:21.220 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:21.221 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:21.221 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:21.221 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:21.221 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:21.221 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:21.222 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:21.222 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:21.222 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:21.222 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.223 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.223 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:03:21.223 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:21.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.223 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.224 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:03:21.224 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:21.224 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.224 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.225 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:21.225 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.225 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.225 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.225 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:03:21.226 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:21.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.226 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.226 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.226 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:03:21.227 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:21.227 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.227 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.227 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:21.228 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.228 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.228 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:03:21.228 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:21.228 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.229 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.229 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:03:21.229 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:21.229 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.230 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.230 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:21.230 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.231 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.231 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:03:21.231 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:21.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.231 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.232 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.232 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:03:21.232 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:21.232 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.232 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.233 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:03:21.233 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:03:21.233 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:03:21.233 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:03:21.234 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:21.234 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:21.234 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:21.234 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:21.234 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.235 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:21.235 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:21.235 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:21.235 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:21.236 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:21.236 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:21.236 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:21.236 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:21.236 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:21.237 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:21.237 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:21.237 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:21.237 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:21.237 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.238 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.238 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:03:21.238 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:21.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.239 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.239 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:03:21.239 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:21.239 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.239 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.240 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.240 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:21.240 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.240 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.241 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:03:21.241 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:21.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.242 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.242 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:03:21.242 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:21.242 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.242 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.243 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:21.243 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.243 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.244 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.244 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:03:21.244 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:21.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.245 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.245 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:03:21.245 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:21.245 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.245 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.245 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.246 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:21.246 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:21.246 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.246 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:21.247 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:03:21.247 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:21.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.248 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:21.248 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:03:21.248 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:21.248 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.249 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.249 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:03:21.249 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:03:21.249 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:03:21.250 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:03:21.250 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:21.250 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:21.250 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:21.251 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:21.251 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.251 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.252 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:21.252 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:03:21.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.252 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:21.253 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:21.253 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:21.253 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:21.254 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:21.254 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:21.254 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:03:21.255 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:21.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.255 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:21.256 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:21.256 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:21.256 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:21.256 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:21.256 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:21.257 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:03:21.257 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:21.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.258 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:21.258 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:21.258 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:03:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:21.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:21.260 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:21.261 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:03:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:21.262 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:03:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.264 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:21.265 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:03:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:21.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:21.267 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:03:21.268 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:21.269 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:21.270 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:03:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:21.271 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:03:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [ 2023-09-13T06:03:21.272 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.13", 2023-09-13T06:03:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.273 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 5 2023-09-13T06:03:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.32", 2023-09-13T06:03:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:21.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:21.276 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:21.276 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 4 2023-09-13T06:03:21.276 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.276 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:21.276 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:03:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:03:21.277 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:03:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:03:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:03:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:03:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:03:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:03:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:03:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:03:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:03:21.279 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:03:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:03:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:03:21.281 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:03:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:03:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:03:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:03:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:03:21.285 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:03:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:03:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:03:21.286 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:03:21.287 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:21.287 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:03:21.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 -- 172.21.15.130:0/1920520582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb5c065b50 msgr2=0x7feb5c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:21.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb5c065b50 0x7feb5c068010 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feb70156620 tx=0x7feb6c008040 comp rx=0 tx=0).stop 2023-09-13T06:03:21.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 -- 172.21.15.130:0/1920520582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70072030 msgr2=0x7feb70155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:21.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70072030 0x7feb70155740 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7feb6001a140 tx=0x7feb6001ad50 comp rx=0 tx=0).stop 2023-09-13T06:03:21.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 -- 172.21.15.130:0/1920520582 shutdown_connections 2023-09-13T06:03:21.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb5c065b50 0x7feb5c068010 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb70146d40 0x7feb70155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70072030 0x7feb70155740 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 --2- 172.21.15.130:0/1920520582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb70070280 0x7feb700b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 -- 172.21.15.130:0/1920520582 >> 172.21.15.130:0/1920520582 conn(0x7feb7006a2f0 msgr2=0x7feb70159980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:21.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 -- 172.21.15.130:0/1920520582 shutdown_connections 2023-09-13T06:03:21.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.051+0000 7feb76bba640 1 -- 172.21.15.130:0/1920520582 wait complete. 2023-09-13T06:03:21.293 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:03:21.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f031ed74640 1 Processor -- start 2023-09-13T06:03:21.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f031ed74640 1 -- start start 2023-09-13T06:03:21.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f031ed74640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f03180d1750 0x7f031815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:21.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f031ed74640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1090 0x7f0318146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:21.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f031ed74640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03180b63c0 con 0x7f03180d1b30 2023-09-13T06:03:21.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f031ed74640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031815dea0 con 0x7f03180d1750 2023-09-13T06:03:21.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f031ed74640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03180d0c20 con 0x7f03180d1090 2023-09-13T06:03:21.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f031cb10640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f03180d1750 0x7f031815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:21.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f0317fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1090 0x7f0318146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:21.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f0317fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1090 0x7f0318146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:50450/0 (socket says 172.21.15.130:50450) 2023-09-13T06:03:21.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f0317fff640 1 -- 172.21.15.130:0/473399610 learned_addr learned my addr 172.21.15.130:0/473399610 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:21.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f031cb10640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f03180d1750 0x7f031815d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:56920/0 (socket says 172.21.15.130:56920) 2023-09-13T06:03:21.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f031d311640 1 --1- 172.21.15.130:0/473399610 >> v1:172.21.15.164:6789/0 conn(0x7f03180d1b30 0x7f03180b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:41136/0 (socket says 172.21.15.130:41136) 2023-09-13T06:03:21.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f0317fff640 1 -- 172.21.15.130:0/473399610 >> v2:172.21.15.164:3300/0 conn(0x7f03180d1750 msgr2=0x7f031815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:21.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f0317fff640 1 --2- 172.21.15.130:0/473399610 >> v2:172.21.15.164:3300/0 conn(0x7f03180d1750 0x7f031815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f0317fff640 1 -- 172.21.15.130:0/473399610 >> v1:172.21.15.164:6789/0 conn(0x7f03180d1b30 legacy=0x7f03180b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:21.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f0317fff640 1 -- 172.21.15.130:0/473399610 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03180b6610 con 0x7f03180d1090 2023-09-13T06:03:21.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.431+0000 7f031cb10640 1 --2- 172.21.15.130:0/473399610 >> v2:172.21.15.164:3300/0 conn(0x7f03180d1750 0x7f031815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:21.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f0317fff640 1 --2- 172.21.15.130:0/473399610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1090 0x7f0318146820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0304009870 tx=0x7f030401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a69053f180af905a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:21.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f03177fe640 1 -- 172.21.15.130:0/473399610 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040aa670 con 0x7f03180d1090 2023-09-13T06:03:21.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f03177fe640 1 -- 172.21.15.130:0/473399610 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03040aa7d0 con 0x7f03180d1090 2023-09-13T06:03:21.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f03177fe640 1 -- 172.21.15.130:0/473399610 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040aab60 con 0x7f03180d1090 2023-09-13T06:03:21.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f031ed74640 1 -- 172.21.15.130:0/473399610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1090 msgr2=0x7f0318146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:21.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f031ed74640 1 --2- 172.21.15.130:0/473399610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1090 0x7f0318146820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0304009870 tx=0x7f030401c510 comp rx=0 tx=0).stop 2023-09-13T06:03:21.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f031ed74640 1 -- 172.21.15.130:0/473399610 shutdown_connections 2023-09-13T06:03:21.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f031ed74640 1 --2- 172.21.15.130:0/473399610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1090 0x7f0318146820 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f031ed74640 1 --2- 172.21.15.130:0/473399610 >> v2:172.21.15.164:3300/0 conn(0x7f03180d1750 0x7f031815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f031ed74640 1 -- 172.21.15.130:0/473399610 >> 172.21.15.130:0/473399610 conn(0x7f031806f170 msgr2=0x7f031806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:21.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f031ed74640 1 -- 172.21.15.130:0/473399610 shutdown_connections 2023-09-13T06:03:21.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.435+0000 7f031ed74640 1 -- 172.21.15.130:0/473399610 wait complete. 2023-09-13T06:03:21.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031ed74640 1 Processor -- start 2023-09-13T06:03:21.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031ed74640 1 -- start start 2023-09-13T06:03:21.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031ed74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03180d1090 0x7f0318143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:21.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031ed74640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03180d1750 0x7f03181f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:21.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031ed74640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1b30 0x7f0318145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:21.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031ed74640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03181f92a0 con 0x7f03180d1090 2023-09-13T06:03:21.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031ed74640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03181458c0 con 0x7f03180d1750 2023-09-13T06:03:21.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031ed74640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0318143cc0 con 0x7f03180d1b30 2023-09-13T06:03:21.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031cb10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03180d1090 0x7f0318143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:21.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031cb10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03180d1090 0x7f0318143630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35012/0 (socket says 172.21.15.130:35012) 2023-09-13T06:03:21.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031cb10640 1 -- 172.21.15.130:0/612032523 learned_addr learned my addr 172.21.15.130:0/612032523 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:21.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f0317fff640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03180d1750 0x7f03181f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:21.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031d311640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1b30 0x7f0318145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:21.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031cb10640 1 -- 172.21.15.130:0/612032523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1b30 msgr2=0x7f0318145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:21.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031cb10640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1b30 0x7f0318145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031cb10640 1 -- 172.21.15.130:0/612032523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03180d1750 msgr2=0x7f03181f8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:21.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031cb10640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03180d1750 0x7f03181f8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031cb10640 1 -- 172.21.15.130:0/612032523 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c009420 con 0x7f03180d1090 2023-09-13T06:03:21.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031cb10640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03180d1090 0x7f0318143630 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f030c00ebe0 tx=0x7f030c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:21.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f03157fa640 1 -- 172.21.15.130:0/612032523 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c00eee0 con 0x7f03180d1090 2023-09-13T06:03:21.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f03157fa640 1 -- 172.21.15.130:0/612032523 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c00cc30 con 0x7f03180d1090 2023-09-13T06:03:21.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031ed74640 1 -- 172.21.15.130:0/612032523 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03040094d0 con 0x7f03180d1090 2023-09-13T06:03:21.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f03157fa640 1 -- 172.21.15.130:0/612032523 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c013470 con 0x7f03180d1090 2023-09-13T06:03:21.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031ed74640 1 -- 172.21.15.130:0/612032523 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0318144280 con 0x7f03180d1090 2023-09-13T06:03:21.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.439+0000 7f031ed74640 1 -- 172.21.15.130:0/612032523 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03180618a0 con 0x7f03180d1090 2023-09-13T06:03:21.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.443+0000 7f03157fa640 1 -- 172.21.15.130:0/612032523 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f030c0135d0 con 0x7f03180d1090 2023-09-13T06:03:21.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.443+0000 7f03157fa640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f02fc065b20 0x7f02fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:21.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.443+0000 7f03157fa640 1 -- 172.21.15.130:0/612032523 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f030c083600 con 0x7f03180d1090 2023-09-13T06:03:21.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.443+0000 7f0317fff640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f02fc065b20 0x7f02fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:21.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.443+0000 7f03157fa640 1 -- 172.21.15.130:0/612032523 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7f02fc06d710 con 0x7f03180d1090 2023-09-13T06:03:21.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.443+0000 7f0317fff640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f02fc065b20 0x7f02fc067fe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f03040ae000 tx=0x7f03040b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:21.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.447+0000 7f03157fa640 1 -- 172.21.15.130:0/612032523 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f030c050fc0 con 0x7f03180d1090 2023-09-13T06:03:21.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.627+0000 7f031ed74640 1 -- 172.21.15.130:0/612032523 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03180b86c0 con 0x7f03180d1090 2023-09-13T06:03:21.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.627+0000 7f03157fa640 1 -- 172.21.15.130:0/612032523 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f030c021090 con 0x7f03180d1090 2023-09-13T06:03:21.633 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:21.633 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2126646405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2126646405},{"type":"v1","addr":"172.21.15.164:6835","nonce":2126646405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1274935773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1274935773},{"type":"v1","addr":"172.21.15.164:6834","nonce":1274935773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/4174632972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4174632972},{"type":"v1","addr":"172.21.15.130:6836","nonce":4174632972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:54.919386+0000","modified":"2023-09-13T06:02:57.960043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5613":{"gid":5613,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1098709916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1098709916},{"type":"v1","addr":"172.21.15.130:6837","nonce":1098709916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-13T06:03:21.634 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 25 2023-09-13T06:03:21.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 -- 172.21.15.130:0/612032523 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f02fc065b20 msgr2=0x7f02fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:21.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f02fc065b20 0x7f02fc067fe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f03040ae000 tx=0x7f03040b5040 comp rx=0 tx=0).stop 2023-09-13T06:03:21.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 -- 172.21.15.130:0/612032523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03180d1090 msgr2=0x7f0318143630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:21.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03180d1090 0x7f0318143630 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f030c00ebe0 tx=0x7f030c00c520 comp rx=0 tx=0).stop 2023-09-13T06:03:21.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 -- 172.21.15.130:0/612032523 shutdown_connections 2023-09-13T06:03:21.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f02fc065b20 0x7f02fc067fe0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03180d1750 0x7f03181f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03180d1b30 0x7f0318145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 --2- 172.21.15.130:0/612032523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03180d1090 0x7f0318143630 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:21.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 -- 172.21.15.130:0/612032523 >> 172.21.15.130:0/612032523 conn(0x7f031806f170 msgr2=0x7f031815f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:21.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 -- 172.21.15.130:0/612032523 shutdown_connections 2023-09-13T06:03:21.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:21.631+0000 7f031ed74640 1 -- 172.21.15.130:0/612032523 wait complete. 2023-09-13T06:03:21.654 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-13T06:03:21.812 INFO:teuthology.orchestra.run.smithi130.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":5613,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":26.222086036,"mdsmap_epoch":25,"osdmap_epoch":51,"osdmap_epoch_barrier":51,"uptime":31.031634030999999} 2023-09-13T06:03:21.813 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 5613, "mdsmap_epoch": 25, "osdmap_epoch": 51, "osdmap_epoch_barrier": 51, "rank_uptime": 26.222086036, "state": "up:active", "uptime": 31.031634031, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:03:21.814 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-13T06:03:21.815 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:03:21.815 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:21.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:21.827 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-09-13T06:03:21.878 INFO:teuthology.orchestra.run.smithi130.stderr:dd: failed to open 'small_file_1': Permission denied 2023-09-13T06:03:21.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:03:21.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:21.880 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-09-13T06:03:21.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:21.936 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-09-13T06:03:21.989 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:03:22.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58c252c640 1 Processor -- start 2023-09-13T06:03:22.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58c252c640 1 -- start start 2023-09-13T06:03:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58c252c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f58bc146f30 0x7f58bc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58c252c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc0b63c0 con 0x7f58bc0d1090 2023-09-13T06:03:22.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58c252c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc0d0c20 con 0x7f58bc0d1750 2023-09-13T06:03:22.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58c252c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc15dea0 con 0x7f58bc146f30 2023-09-13T06:03:22.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58c0ac9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f58bc146f30 0x7f58bc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:22.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58bb7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f58bc0d1090 0x7f58bc0b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36174/0 (socket says 172.21.15.130:36174) 2023-09-13T06:03:22.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58bb7fe640 1 -- 172.21.15.130:0/3134554513 learned_addr learned my addr 172.21.15.130:0/3134554513 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:22.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58c0ac9640 1 -- 172.21.15.130:0/3134554513 >> v1:172.21.15.164:6789/0 conn(0x7f58bc0d1750 legacy=0x7f58bc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:22.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58c0ac9640 1 -- 172.21.15.130:0/3134554513 >> v1:172.21.15.130:6789/0 conn(0x7f58bc0d1090 legacy=0x7f58bc0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:22.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58c0ac9640 1 -- 172.21.15.130:0/3134554513 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0b6610 con 0x7f58bc146f30 2023-09-13T06:03:22.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.167+0000 7f58baffd640 1 -- 172.21.15.130:0/3134554513 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879028629 0 0) 0x7f58bc0b63c0 con 0x7f58bc0d1090 2023-09-13T06:03:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.171+0000 7f58c0ac9640 1 --2- 172.21.15.130:0/3134554513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58bc146f30 0x7f58bc15d960 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009d90 tx=0x7f58b401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a353439ed40212 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.171+0000 7f58baffd640 1 -- 172.21.15.130:0/3134554513 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40a5950 con 0x7f58bc146f30 2023-09-13T06:03:22.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.171+0000 7f58baffd640 1 -- 172.21.15.130:0/3134554513 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b40a5ab0 con 0x7f58bc146f30 2023-09-13T06:03:22.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.171+0000 7f58baffd640 1 -- 172.21.15.130:0/3134554513 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40a5e40 con 0x7f58bc146f30 2023-09-13T06:03:22.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.171+0000 7f58c252c640 1 -- 172.21.15.130:0/3134554513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58bc146f30 msgr2=0x7f58bc15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:22.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.171+0000 7f58c252c640 1 --2- 172.21.15.130:0/3134554513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58bc146f30 0x7f58bc15d960 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009d90 tx=0x7f58b401c890 comp rx=0 tx=0).stop 2023-09-13T06:03:22.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.171+0000 7f58c252c640 1 -- 172.21.15.130:0/3134554513 shutdown_connections 2023-09-13T06:03:22.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.171+0000 7f58c252c640 1 --2- 172.21.15.130:0/3134554513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58bc146f30 0x7f58bc15d960 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.171+0000 7f58c252c640 1 -- 172.21.15.130:0/3134554513 >> 172.21.15.130:0/3134554513 conn(0x7f58bc06f170 msgr2=0x7f58bc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.171+0000 7f58c252c640 1 -- 172.21.15.130:0/3134554513 shutdown_connections 2023-09-13T06:03:22.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.171+0000 7f58c252c640 1 -- 172.21.15.130:0/3134554513 wait complete. 2023-09-13T06:03:22.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c252c640 1 Processor -- start 2023-09-13T06:03:22.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c252c640 1 -- start start 2023-09-13T06:03:22.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c252c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58bc0d1090 0x7f58bc13a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:22.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c252c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58bc0d1750 0x7f58bc158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:22.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c252c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58bc146f30 0x7f58bc158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:22.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c252c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc140bf0 con 0x7f58bc0d1090 2023-09-13T06:03:22.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c252c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc140ed0 con 0x7f58bc146f30 2023-09-13T06:03:22.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c252c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc13bf40 con 0x7f58bc0d1750 2023-09-13T06:03:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58bbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58bc0d1090 0x7f58bc13a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58bbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58bc0d1090 0x7f58bc13a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35032/0 (socket says 172.21.15.130:35032) 2023-09-13T06:03:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58bbfff640 1 -- 172.21.15.130:0/3043733622 learned_addr learned my addr 172.21.15.130:0/3043733622 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c0ac9640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58bc146f30 0x7f58bc158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58bb7fe640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58bc0d1750 0x7f58bc158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58bbfff640 1 -- 172.21.15.130:0/3043733622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58bc0d1750 msgr2=0x7f58bc158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58bbfff640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58bc0d1750 0x7f58bc158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58bbfff640 1 -- 172.21.15.130:0/3043733622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58bc146f30 msgr2=0x7f58bc158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58bbfff640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58bc146f30 0x7f58bc158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58bbfff640 1 -- 172.21.15.130:0/3043733622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b4009a70 con 0x7f58bc0d1090 2023-09-13T06:03:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58bbfff640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58bc0d1090 0x7f58bc13a930 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c500 tx=0x7f58ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58b8ff9640 1 -- 172.21.15.130:0/3043733622 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac005220 con 0x7f58bc0d1090 2023-09-13T06:03:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58b8ff9640 1 -- 172.21.15.130:0/3043733622 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac005380 con 0x7f58bc0d1090 2023-09-13T06:03:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c252c640 1 -- 172.21.15.130:0/3043733622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc13c220 con 0x7f58bc0d1090 2023-09-13T06:03:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58b8ff9640 1 -- 172.21.15.130:0/3043733622 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac007270 con 0x7f58bc0d1090 2023-09-13T06:03:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c252c640 1 -- 172.21.15.130:0/3043733622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc13b380 con 0x7f58bc0d1090 2023-09-13T06:03:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.175+0000 7f58c252c640 1 -- 172.21.15.130:0/3043733622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc13bda0 con 0x7f58bc0d1090 2023-09-13T06:03:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.179+0000 7f58b8ff9640 1 -- 172.21.15.130:0/3043733622 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f58ac0073d0 con 0x7f58bc0d1090 2023-09-13T06:03:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.179+0000 7f58b8ff9640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58a8065b50 0x7f58a8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:22.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.179+0000 7f58b8ff9640 1 -- 172.21.15.130:0/3043733622 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f58ac082b10 con 0x7f58bc0d1090 2023-09-13T06:03:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.179+0000 7f58b8ff9640 1 -- 172.21.15.130:0/3043733622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7f58a806d740 con 0x7f58bc0d1090 2023-09-13T06:03:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.179+0000 7f58bb7fe640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58a8065b50 0x7f58a8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.179+0000 7f58bb7fe640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58a8065b50 0x7f58a8068010 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f58bc15b610 tx=0x7f58b0007240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:22.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.183+0000 7f58b8ff9640 1 -- 172.21.15.130:0/3043733622 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f58bc13bda0 con 0x7f58bc0d1090 2023-09-13T06:03:22.310 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:03:22.303+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-09-13T06:03:22.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.331+0000 7f58c252c640 1 -- 172.21.15.130:0/3043733622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f58bc13bda0 con 0x7f58bc0d1090 2023-09-13T06:03:22.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58b8ff9640 1 -- 172.21.15.130:0/3043733622 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+34498 (secure 0 0 0) 0x7f58bc13bda0 con 0x7f58bc0d1090 2023-09-13T06:03:22.339 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:22.339 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:03:22.339 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 51, 2023-09-13T06:03:22.339 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:03:22.340 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:03:22.340 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:03:20.366252+0000", 2023-09-13T06:03:22.340 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:03:22.340 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:03:22.341 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:03:22.341 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:03:22.341 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:03:22.342 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:03:22.342 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:03:22.342 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:03:22.342 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:03:22.342 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:22.343 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:03:22.343 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:03:22.343 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:03:22.343 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:03:22.343 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:03:22.343 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 7, 2023-09-13T06:03:22.344 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:03:22.344 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:03:22.344 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "luminous", 2023-09-13T06:03:22.344 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:03:22.344 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:03:22.345 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:03:22.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.345 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:03:22.345 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:03:22.345 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:03:22.345 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:22.346 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:22.346 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:22.346 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:22.346 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:22.347 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:22.347 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:22.347 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:22.347 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:22.347 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:22.347 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:22.348 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:22.348 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:03:22.348 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:03:22.349 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:03:22.349 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:03:22.349 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:03:22.349 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:22.349 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:22.349 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:22.350 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:22.350 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:22.350 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:22.350 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:22.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.351 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:22.351 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:22.351 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:22.351 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:22.352 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:22.352 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:22.352 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:22.352 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:22.353 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:22.353 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:22.353 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:22.353 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:22.354 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:22.354 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:22.354 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:22.354 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:22.354 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:22.355 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:22.355 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:22.355 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:22.355 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:22.355 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:22.356 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:22.356 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:22.356 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:22.356 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:22.356 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:22.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.357 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:22.357 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:22.357 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:22.357 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:22.357 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:22.358 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:22.358 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:22.358 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:22.358 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:22.359 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:22.359 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:22.359 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:22.359 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:03:22.360 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:03:22.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.360 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:22.360 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:03:22.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.361 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:22.361 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:03:22.362 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:03:22.362 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:03:22.362 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:03:22.363 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:03:22.363 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:22.363 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:22.364 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:22.364 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.365 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 6, 2023-09-13T06:03:22.365 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:03:22.366 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.311861+0000", 2023-09-13T06:03:22.366 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:22.366 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:22.368 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:22.368 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:22.368 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:22.368 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:22.368 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:22.369 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:22.369 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:22.369 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:22.369 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:03:22.370 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:03:22.370 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:03:22.370 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:03:22.371 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:03:22.371 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:22.371 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:22.372 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:22.372 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:22.372 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:22.372 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:22.372 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:22.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.373 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:22.373 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:22.373 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:22.373 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:22.374 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:22.374 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:22.374 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:22.374 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:22.375 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:22.375 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:22.375 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:22.375 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:22.375 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:22.376 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:22.376 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:22.376 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:22.376 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:22.376 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:22.377 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:22.377 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:22.377 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:22.377 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:22.377 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:22.378 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:22.378 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:22.378 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:22.379 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:22.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.379 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:22.379 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:22.379 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:22.380 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:22.380 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:22.380 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:22.381 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:22.381 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:22.381 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:22.382 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:22.382 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:22.383 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:22.383 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:03:22.383 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:03:22.384 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:03:22.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.384 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:22.385 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:22.385 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:03:22.385 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.386 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:22.386 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:03:22.387 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:03:22.387 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:22.388 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:03:22.388 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:03:22.388 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:22.389 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:22.389 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:22.389 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.390 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.390 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 7, 2023-09-13T06:03:22.391 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:03:22.391 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.919645+0000", 2023-09-13T06:03:22.392 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:22.392 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:22.392 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:22.393 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:22.393 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:22.393 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:22.394 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:22.394 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:22.394 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:22.395 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:22.395 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:22.395 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:22.396 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:03:22.396 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:03:22.397 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:03:22.397 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:03:22.397 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:03:22.398 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:22.398 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:22.398 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:22.399 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:22.399 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:22.399 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:22.400 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:22.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.401 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:22.401 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:22.401 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:22.402 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:22.402 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:22.402 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:22.403 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:22.403 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:22.403 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:22.404 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:22.404 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:22.404 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:22.405 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:22.405 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:22.406 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:22.406 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:22.406 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:22.407 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:22.407 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:22.407 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:22.408 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:22.408 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:22.408 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:22.409 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:22.409 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:22.410 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:22.410 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:22.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.411 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:22.411 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:22.411 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:22.412 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:22.412 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:22.412 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:22.413 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:22.413 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:22.414 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:22.414 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:22.414 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:22.415 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:22.415 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:03:22.415 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:03:22.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.416 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:22.416 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:22.417 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:03:22.417 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.418 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:22.418 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.5, 2023-09-13T06:03:22.419 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.5, 2023-09-13T06:03:22.419 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:22.419 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.5, 2023-09-13T06:03:22.420 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.5, 2023-09-13T06:03:22.420 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:22.421 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:22.421 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:22.421 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.422 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.422 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:22.422 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:03:22.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.423 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:22.423 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:22.423 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:22.423 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:22.424 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:22.424 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:22.424 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:22.424 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:22.425 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:22.425 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:22.425 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:22.425 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:22.425 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:22.425 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.426 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.426 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:03:22.426 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:22.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.427 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.427 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:03:22.427 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:22.428 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.428 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.428 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.429 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:22.429 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.429 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.430 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:03:22.430 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:22.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.431 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.431 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:03:22.431 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:22.432 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.432 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.432 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:22.432 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.433 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.433 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:03:22.433 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:22.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.434 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.434 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:03:22.435 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:22.435 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.435 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.436 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:22.436 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.436 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.436 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.436 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:03:22.437 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:22.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.437 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.437 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:03:22.438 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:22.438 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.438 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.438 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:03:22.439 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:03:22.439 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:03:22.439 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:03:22.439 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:22.439 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:22.439 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:22.440 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:22.440 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.440 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:22.441 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:22.441 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:22.441 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:22.441 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:22.441 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:22.441 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:22.442 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:22.442 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:22.442 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:22.442 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:22.442 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:22.443 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:22.443 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.443 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.443 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:03:22.444 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:22.444 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.444 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.444 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.444 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:03:22.444 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:22.445 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.445 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.445 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:22.445 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.446 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.446 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:03:22.446 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:22.446 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.447 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.447 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:03:22.447 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:22.447 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.447 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.448 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:22.448 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.448 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.448 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:03:22.449 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:22.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.449 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.449 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:03:22.450 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:22.450 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.450 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.450 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:22.450 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.451 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.451 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:03:22.451 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:22.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.452 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.452 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:03:22.452 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:22.452 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.452 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.453 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:03:22.453 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:03:22.453 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:03:22.453 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:03:22.454 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:22.454 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:22.454 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:22.454 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.455 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:22.455 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:22.455 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:22.455 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:22.455 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:22.456 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:22.456 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:22.456 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:22.456 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:22.456 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:22.457 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:22.457 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:22.457 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:22.457 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.457 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.457 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.458 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:03:22.458 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:22.458 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.458 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.458 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.459 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:03:22.459 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:22.459 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.459 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.459 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:22.460 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.460 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.460 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:03:22.460 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:22.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.461 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.461 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:03:22.461 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:22.462 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.462 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.462 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:22.462 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.463 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.463 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:03:22.463 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:22.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.464 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.464 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:03:22.464 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:22.464 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.464 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.465 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:22.465 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.465 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.465 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:03:22.466 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:22.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.466 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.466 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:03:22.467 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:22.467 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.467 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.467 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:03:22.467 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:03:22.468 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:03:22.468 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:03:22.468 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:22.468 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:22.468 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:22.469 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:22.469 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.469 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.469 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:22.470 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:22.470 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:22.470 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:22.470 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:22.470 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:22.470 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:22.471 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:22.471 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:22.471 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:22.471 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:22.471 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:22.472 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:22.472 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.472 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.472 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.472 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:03:22.472 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:22.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.473 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.473 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:03:22.473 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:22.474 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.474 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.474 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:22.474 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.475 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.475 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:03:22.475 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:22.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.475 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.476 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.476 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:03:22.476 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:22.476 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.476 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.477 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:22.477 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.477 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.477 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:03:22.478 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:22.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.478 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.478 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:03:22.479 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:22.479 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.479 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.479 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:22.479 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.480 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.480 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:03:22.480 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:22.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.481 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.481 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:03:22.481 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:22.481 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.481 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.482 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:03:22.482 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:03:22.482 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:03:22.482 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:03:22.483 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:22.483 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull", 2023-09-13T06:03:22.483 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:22.483 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:22.483 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.484 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.484 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:22.484 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:22.484 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:22.484 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:22.485 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:22.485 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:22.485 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:22.485 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:22.485 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:22.485 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:22.486 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:22.486 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:22.486 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:22.486 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.486 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.487 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.487 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:03:22.487 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:22.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.488 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.488 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:03:22.488 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:22.488 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.488 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.489 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:22.489 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.489 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.489 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:03:22.490 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:22.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.490 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.490 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:03:22.490 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:22.491 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.491 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.491 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:22.491 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.492 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.492 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:03:22.492 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:22.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.493 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.493 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:03:22.493 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:22.493 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.493 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.494 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:22.494 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.494 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.495 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:03:22.495 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:22.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.495 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.495 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:03:22.496 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:22.496 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.496 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.496 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:03:22.496 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:03:22.497 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:03:22.497 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:03:22.497 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:22.497 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:22.497 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:22.498 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.498 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:22.498 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:22.499 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:22.499 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:22.499 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:22.499 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:22.499 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:22.500 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:22.500 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:22.500 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:22.500 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:22.500 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:22.501 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:22.501 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.501 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.501 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:03:22.501 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:22.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.502 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.502 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:03:22.502 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:22.503 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.503 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.503 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:22.503 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.504 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.504 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:03:22.504 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:22.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.505 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.505 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:03:22.505 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:22.505 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.505 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.506 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:22.506 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.506 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.507 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:03:22.507 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:22.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.507 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.508 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:03:22.508 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:22.508 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.508 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.508 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:22.509 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.509 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.509 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:03:22.509 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:22.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.514 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.515 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:03:22.515 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:22.515 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.515 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.515 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:03:22.516 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:03:22.516 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:03:22.516 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:03:22.516 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:22.516 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:22.517 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:22.517 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.517 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:22.518 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:22.518 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:22.518 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:22.518 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:22.518 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:22.519 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:22.519 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:22.519 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:22.519 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:22.519 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:22.519 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:22.520 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:22.520 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.520 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.520 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:03:22.521 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:22.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.521 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.521 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:03:22.521 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:22.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.522 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.522 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:22.522 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.523 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.523 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:03:22.523 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:22.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.524 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.524 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:03:22.524 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:22.524 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.524 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.525 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:22.525 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.525 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.525 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:03:22.526 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:22.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.526 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.526 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:03:22.527 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:22.527 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.527 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.527 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:22.528 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.528 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.528 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:03:22.528 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:22.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.529 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.529 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:03:22.529 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:22.529 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.530 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.530 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:03:22.530 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:03:22.530 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:03:22.530 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:03:22.531 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:22.531 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:22.531 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:22.531 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:22.531 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.532 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:22.532 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:22.532 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:22.533 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:22.533 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:22.533 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:22.533 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:22.533 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:22.533 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:22.534 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:22.534 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:22.534 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:22.534 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:22.534 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.535 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.535 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:03:22.535 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:22.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.536 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.536 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:03:22.536 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:22.536 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.536 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.537 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:22.537 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.537 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.538 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:03:22.538 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:22.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.538 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.539 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:03:22.539 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:22.539 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.539 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.539 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:22.540 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.540 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.540 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:03:22.540 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:22.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.541 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.541 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:03:22.541 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:22.542 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.542 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.542 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:22.542 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:22.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.543 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:22.543 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:03:22.543 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:22.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.544 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:22.544 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:03:22.544 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:22.544 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.544 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.545 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:03:22.545 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:03:22.545 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:03:22.545 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:03:22.545 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:22.546 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:22.546 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:22.546 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:22.546 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.546 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.547 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:22.547 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:03:22.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.547 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:22.547 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:22.548 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:22.548 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:22.548 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:22.548 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:22.548 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:03:22.548 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:22.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.549 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:22.549 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:22.549 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:22.550 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:22.550 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:22.550 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:22.550 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:03:22.550 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:22.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.551 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:22.551 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:22.551 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:22.551 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:22.552 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:22.552 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:22.552 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:03:22.552 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:22.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.553 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:22.553 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:22.553 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:22.553 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:22.553 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:22.554 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:22.554 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:03:22.554 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:22.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.554 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:22.555 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:22.555 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:22.555 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:22.555 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:22.555 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:22.556 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:03:22.556 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:22.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.556 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:22.556 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:22.557 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:22.557 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:22.557 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:22.557 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:22.557 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:03:22.558 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:22.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.558 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:22.558 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:22.559 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:22.559 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:22.559 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:22.559 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:22.559 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:03:22.559 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:22.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.560 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:22.560 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:22.560 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:22.561 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:22.561 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:22.561 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:22.561 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:03:22.561 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:22.561 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.562 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:22.562 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:03:22.562 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [ 2023-09-13T06:03:22.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.562 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.13", 2023-09-13T06:03:22.563 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:22.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.563 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:22.563 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 5 2023-09-13T06:03:22.563 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.564 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.564 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.32", 2023-09-13T06:03:22.564 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:22.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:22.565 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:22.565 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 4 2023-09-13T06:03:22.565 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.565 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:22.565 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.566 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:22.566 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:03:22.566 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:03:22.566 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:03:22.566 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:03:22.566 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:03:22.567 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:03:22.567 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:03:22.567 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:03:22.567 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:03:22.567 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:03:22.568 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:03:22.568 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:03:22.568 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:22.568 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:03:22.568 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:03:22.569 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:03:22.569 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:03:22.569 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:03:22.569 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:03:22.569 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:03:22.569 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:03:22.570 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:03:22.570 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:03:22.570 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:03:22.570 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:22.570 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:03:22.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 -- 172.21.15.130:0/3043733622 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58a8065b50 msgr2=0x7f58a8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:22.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58a8065b50 0x7f58a8068010 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f58bc15b610 tx=0x7f58b0007240 comp rx=0 tx=0).stop 2023-09-13T06:03:22.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 -- 172.21.15.130:0/3043733622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58bc0d1090 msgr2=0x7f58bc13a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:22.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58bc0d1090 0x7f58bc13a930 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c500 tx=0x7f58ac00c9c0 comp rx=0 tx=0).stop 2023-09-13T06:03:22.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 -- 172.21.15.130:0/3043733622 shutdown_connections 2023-09-13T06:03:22.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58a8065b50 0x7f58a8068010 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:22.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58bc146f30 0x7f58bc158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:22.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58bc0d1750 0x7f58bc158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:22.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 --2- 172.21.15.130:0/3043733622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58bc0d1090 0x7f58bc13a930 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:22.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 -- 172.21.15.130:0/3043733622 >> 172.21.15.130:0/3043733622 conn(0x7f58bc06f170 msgr2=0x7f58bc06fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:22.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 -- 172.21.15.130:0/3043733622 shutdown_connections 2023-09-13T06:03:22.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:22.335+0000 7f58c252c640 1 -- 172.21.15.130:0/3043733622 wait complete. 2023-09-13T06:03:22.575 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:03:27.576 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:03:27.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98eb67640 1 Processor -- start 2023-09-13T06:03:27.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98eb67640 1 -- start start 2023-09-13T06:03:27.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98eb67640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9880d1750 0x7fa98815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:27.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98eb67640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa9880d1090 0x7fa988146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:27.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98eb67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9880d1b30 0x7fa988146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:27.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98eb67640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98815dea0 con 0x7fa9880d1750 2023-09-13T06:03:27.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98eb67640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9880b63c0 con 0x7fa9880d1090 2023-09-13T06:03:27.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98eb67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880d0c20 con 0x7fa9880d1b30 2023-09-13T06:03:27.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98c903640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9880d1750 0x7fa98815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:27.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98c903640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9880d1750 0x7fa98815d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35034/0 (socket says 172.21.15.130:35034) 2023-09-13T06:03:27.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98c903640 1 -- 172.21.15.130:0/1877391968 learned_addr learned my addr 172.21.15.130:0/1877391968 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:27.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa97ffff640 1 --2- 172.21.15.130:0/1877391968 >> v2:172.21.15.164:3300/0 conn(0x7fa9880d1090 0x7fa988146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:27.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98d104640 1 --2- 172.21.15.130:0/1877391968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9880d1b30 0x7fa988146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:27.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98c903640 1 -- 172.21.15.130:0/1877391968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9880d1b30 msgr2=0x7fa988146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:27.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98c903640 1 --2- 172.21.15.130:0/1877391968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9880d1b30 0x7fa988146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:27.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98c903640 1 -- 172.21.15.130:0/1877391968 >> v2:172.21.15.164:3300/0 conn(0x7fa9880d1090 msgr2=0x7fa988146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:27.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98c903640 1 --2- 172.21.15.130:0/1877391968 >> v2:172.21.15.164:3300/0 conn(0x7fa9880d1090 0x7fa988146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:27.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.739+0000 7fa98c903640 1 -- 172.21.15.130:0/1877391968 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880b6610 con 0x7fa9880d1750 2023-09-13T06:03:27.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa98c903640 1 --2- 172.21.15.130:0/1877391968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9880d1750 0x7fa98815d960 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa9880c8360 tx=0x7fa98401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e4872bbd3afb23 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:27.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa97f7fe640 1 -- 172.21.15.130:0/1877391968 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840aa5f0 con 0x7fa9880d1750 2023-09-13T06:03:27.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa97f7fe640 1 -- 172.21.15.130:0/1877391968 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9840aa750 con 0x7fa9880d1750 2023-09-13T06:03:27.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa97f7fe640 1 -- 172.21.15.130:0/1877391968 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840aaae0 con 0x7fa9880d1750 2023-09-13T06:03:27.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa98eb67640 1 -- 172.21.15.130:0/1877391968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9880d1750 msgr2=0x7fa98815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:27.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa98eb67640 1 --2- 172.21.15.130:0/1877391968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9880d1750 0x7fa98815d960 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa9880c8360 tx=0x7fa98401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:03:27.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa98eb67640 1 -- 172.21.15.130:0/1877391968 shutdown_connections 2023-09-13T06:03:27.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa98eb67640 1 --2- 172.21.15.130:0/1877391968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9880d1b30 0x7fa988146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:27.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa98eb67640 1 --2- 172.21.15.130:0/1877391968 >> v2:172.21.15.164:3300/0 conn(0x7fa9880d1090 0x7fa988146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:27.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa98eb67640 1 --2- 172.21.15.130:0/1877391968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9880d1750 0x7fa98815d960 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:27.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa98eb67640 1 -- 172.21.15.130:0/1877391968 >> 172.21.15.130:0/1877391968 conn(0x7fa98806f170 msgr2=0x7fa98806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:27.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa98eb67640 1 -- 172.21.15.130:0/1877391968 shutdown_connections 2023-09-13T06:03:27.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.743+0000 7fa98eb67640 1 -- 172.21.15.130:0/1877391968 wait complete. 2023-09-13T06:03:27.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98eb67640 1 Processor -- start 2023-09-13T06:03:27.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98eb67640 1 -- start start 2023-09-13T06:03:27.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98eb67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9880d1090 0x7fa9881661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:27.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98eb67640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9880d1750 0x7fa98815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:27.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98eb67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9880d1b30 0x7fa9881465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:27.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98eb67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988167530 con 0x7fa9880d1090 2023-09-13T06:03:27.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98eb67640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988167d00 con 0x7fa9880d1750 2023-09-13T06:03:27.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98eb67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9881668b0 con 0x7fa9880d1b30 2023-09-13T06:03:27.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98c903640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9880d1090 0x7fa9881661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:27.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98c903640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9880d1090 0x7fa9881661b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35040/0 (socket says 172.21.15.130:35040) 2023-09-13T06:03:27.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98c903640 1 -- 172.21.15.130:0/715918606 learned_addr learned my addr 172.21.15.130:0/715918606 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:27.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa97ffff640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9880d1750 0x7fa98815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:27.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98d104640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9880d1b30 0x7fa9881465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:27.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98c903640 1 -- 172.21.15.130:0/715918606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9880d1b30 msgr2=0x7fa9881465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:27.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98c903640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9880d1b30 0x7fa9881465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:27.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98c903640 1 -- 172.21.15.130:0/715918606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9880d1750 msgr2=0x7fa98815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:27.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98c903640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9880d1750 0x7fa98815cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:27.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98c903640 1 -- 172.21.15.130:0/715918606 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9840094d0 con 0x7fa9880d1090 2023-09-13T06:03:27.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98c903640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9880d1090 0x7fa9881661b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa9840ac040 tx=0x7fa98401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:27.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa97d7fa640 1 -- 172.21.15.130:0/715918606 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840bd5f0 con 0x7fa9880d1090 2023-09-13T06:03:27.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa97d7fa640 1 -- 172.21.15.130:0/715918606 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9840bd750 con 0x7fa9880d1090 2023-09-13T06:03:27.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa97d7fa640 1 -- 172.21.15.130:0/715918606 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840bdb00 con 0x7fa9880d1090 2023-09-13T06:03:27.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98eb67640 1 -- 172.21.15.130:0/715918606 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa988166b90 con 0x7fa9880d1090 2023-09-13T06:03:27.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.747+0000 7fa98eb67640 1 -- 172.21.15.130:0/715918606 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa988167150 con 0x7fa9880d1090 2023-09-13T06:03:27.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.751+0000 7fa98eb67640 1 -- 172.21.15.130:0/715918606 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9880618a0 con 0x7fa9880d1090 2023-09-13T06:03:27.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.751+0000 7fa97d7fa640 1 -- 172.21.15.130:0/715918606 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa9840b33f0 con 0x7fa9880d1090 2023-09-13T06:03:27.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.751+0000 7fa97d7fa640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa974065b50 0x7fa974068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:27.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.751+0000 7fa97d7fa640 1 -- 172.21.15.130:0/715918606 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa9840a7070 con 0x7fa9880d1090 2023-09-13T06:03:27.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.751+0000 7fa97ffff640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa974065b50 0x7fa974068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:27.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.751+0000 7fa97d7fa640 1 -- 172.21.15.130:0/715918606 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7fa97406d740 con 0x7fa9880d1090 2023-09-13T06:03:27.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.751+0000 7fa97ffff640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa974065b50 0x7fa974068010 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa98813ea80 tx=0x7fa978009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:27.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.755+0000 7fa97d7fa640 1 -- 172.21.15.130:0/715918606 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa9840eb940 con 0x7fa9880d1090 2023-09-13T06:03:27.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.903+0000 7fa98eb67640 1 -- 172.21.15.130:0/715918606 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa9880b86c0 con 0x7fa9880d1090 2023-09-13T06:03:27.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.903+0000 7fa97d7fa640 1 -- 172.21.15.130:0/715918606 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+34498 (secure 0 0 0) 0x7fa9840c3070 con 0x7fa9880d1090 2023-09-13T06:03:27.909 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:27.909 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:03:27.909 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 51, 2023-09-13T06:03:27.910 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:03:27.910 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:03:27.910 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:03:20.366252+0000", 2023-09-13T06:03:27.910 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:03:27.910 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:03:27.911 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:03:27.911 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:03:27.911 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:03:27.911 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:03:27.911 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:03:27.912 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:03:27.912 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:03:27.912 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:27.912 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:03:27.912 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:03:27.912 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:03:27.913 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:03:27.913 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:03:27.913 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 7, 2023-09-13T06:03:27.913 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:03:27.913 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:03:27.914 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "luminous", 2023-09-13T06:03:27.914 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:03:27.914 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:03:27.914 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:03:27.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.915 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:03:27.915 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:03:27.915 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:03:27.915 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:27.915 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:27.916 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:27.916 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:27.916 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:27.916 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:27.916 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:27.917 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:27.917 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:27.917 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:27.917 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:27.917 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:27.917 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:03:27.918 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:03:27.918 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:03:27.918 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:03:27.918 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:03:27.918 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:27.919 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:27.919 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:27.919 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:27.919 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:27.919 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:27.920 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:27.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.920 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:27.920 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:27.920 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:27.921 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:27.921 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:27.921 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:27.921 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:27.921 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:27.921 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:27.922 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:27.922 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:27.922 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:27.922 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:27.922 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:27.923 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:27.923 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:27.923 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:27.923 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:27.923 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:27.924 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:27.924 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:27.924 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:27.924 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:27.924 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:27.924 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:27.925 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:27.925 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:27.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.925 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:27.925 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:27.926 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:27.926 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:27.926 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:27.926 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:27.926 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:27.927 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:27.927 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:27.927 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:27.927 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:27.927 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:27.927 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:03:27.928 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:03:27.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.928 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:27.928 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:03:27.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.928 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:27.929 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:03:27.929 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:03:27.929 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:03:27.929 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:03:27.929 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:03:27.930 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:27.930 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:27.930 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:27.930 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.930 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.931 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.931 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 6, 2023-09-13T06:03:27.931 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:03:27.931 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.311861+0000", 2023-09-13T06:03:27.931 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:27.932 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:27.932 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:27.932 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:27.932 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:27.932 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:27.933 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:27.933 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:27.933 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:27.933 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:27.933 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:27.933 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:27.934 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:03:27.934 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:03:27.934 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:03:27.934 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:03:27.934 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:03:27.935 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:27.935 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:27.935 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:27.935 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:27.935 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:27.936 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:27.936 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:27.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.936 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:27.936 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:27.936 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:27.937 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:27.937 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:27.937 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:27.937 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:27.937 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:27.937 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:27.938 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:27.938 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:27.938 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:27.938 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:27.938 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:27.939 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:27.939 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:27.939 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:27.939 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:27.939 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:27.939 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:27.940 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:27.940 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:27.940 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:27.940 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:27.940 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:27.941 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:27.941 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:27.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.941 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:27.941 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:27.941 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:27.942 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:27.942 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:27.942 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:27.942 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:27.942 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:27.943 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:27.943 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:27.943 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:27.943 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:27.943 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:03:27.944 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:03:27.944 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:03:27.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.944 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:27.944 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:27.945 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:03:27.945 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.945 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:27.945 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:03:27.945 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:03:27.946 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:27.946 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:03:27.946 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:03:27.946 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:27.946 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:27.947 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:27.947 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.947 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 7, 2023-09-13T06:03:27.948 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:03:27.948 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.919645+0000", 2023-09-13T06:03:27.948 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:03:27.948 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:03:27.948 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:27.949 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:27.949 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:27.949 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:27.949 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:27.949 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:27.949 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:27.950 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:27.950 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:27.950 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:27.950 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:03:27.950 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:03:27.951 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:03:27.951 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:03:27.951 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:03:27.951 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:27.951 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:27.952 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:27.952 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:27.952 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:27.952 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:27.952 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:27.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.953 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "49", 2023-09-13T06:03:27.953 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:27.953 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:27.953 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:27.953 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:27.954 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:27.954 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:27.954 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:27.954 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:27.954 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:27.955 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:27.955 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:27.955 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:27.955 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:27.955 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:27.955 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:27.956 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:27.956 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:27.956 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:27.956 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:27.956 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:27.957 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:27.957 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:27.957 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:27.957 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:27.958 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:27.958 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:27.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.958 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:27.958 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:27.959 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:27.959 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:27.959 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:27.959 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:27.959 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:27.960 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:27.960 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:27.960 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:27.960 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:27.960 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:27.961 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:03:27.961 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:03:27.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.961 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:27.961 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:27.962 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:03:27.962 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.962 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:27.962 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.5, 2023-09-13T06:03:27.963 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.5, 2023-09-13T06:03:27.963 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:27.963 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.5, 2023-09-13T06:03:27.963 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.5, 2023-09-13T06:03:27.963 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:27.964 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:27.964 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:27.964 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.964 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.964 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:27.964 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:03:27.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.965 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:27.965 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:27.965 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:27.965 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:27.966 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:27.966 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:27.966 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:27.966 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:27.966 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:27.967 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:27.967 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:27.967 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:27.967 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:27.967 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:27.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.968 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:27.968 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:03:27.968 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:27.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.969 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:27.969 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:03:27.969 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:27.969 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.969 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:27.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.970 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:27.970 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:27.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.970 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:27.970 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:03:27.971 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:27.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.971 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:27.971 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:03:27.972 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:27.972 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.972 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:27.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.972 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:27.973 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:27.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.973 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:27.973 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:03:27.973 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:27.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.974 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:27.974 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:03:27.974 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:27.974 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.975 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:27.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.975 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:27.975 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:27.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.976 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:27.976 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:03:27.976 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:27.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.976 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:27.977 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:03:27.977 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:27.977 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.977 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:27.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.978 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:03:27.978 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:03:27.978 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:03:27.978 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:03:27.978 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:27.979 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:27.979 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:27.979 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:27.979 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:27.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.980 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:27.980 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:27.980 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:27.980 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:27.980 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:27.981 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:27.981 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:27.981 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:27.981 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:27.981 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:27.982 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:27.982 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:27.982 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:27.982 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:27.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.983 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:27.983 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:03:27.983 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:27.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.983 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:27.984 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:03:27.984 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:27.984 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.984 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:27.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.985 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:27.985 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:27.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.985 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:27.985 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:03:27.985 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:27.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.986 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:27.986 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:03:27.986 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:27.987 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.987 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:27.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.987 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:27.987 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:27.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.988 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:27.988 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:03:27.988 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:27.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.989 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:27.989 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:03:27.989 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:27.989 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.989 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:27.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.990 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:27.990 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:27.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.990 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:27.991 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:03:27.991 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:27.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.991 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:27.991 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:03:27.992 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:27.992 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.992 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:27.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.992 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:03:27.993 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:03:27.993 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:03:27.993 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:03:27.993 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:27.993 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:27.994 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:27.994 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:27.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.994 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:27.995 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:27.995 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:27.995 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:27.995 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:27.995 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:27.995 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:27.996 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:27.996 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:27.996 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:27.996 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:27.996 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:27.997 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:27.997 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:27.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.997 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:27.997 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:03:27.998 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:27.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:27.998 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:27.998 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:03:27.999 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:27.999 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:27.999 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:27.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:27.999 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:27.999 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.000 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.000 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:03:28.000 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:28.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.001 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.001 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:03:28.001 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:28.001 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.002 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.002 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:28.002 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.002 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.003 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:03:28.003 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:28.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.003 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.004 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:03:28.004 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:28.004 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.004 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.004 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:28.005 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.005 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.005 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:03:28.005 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:28.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.006 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.006 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:03:28.006 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:28.007 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.007 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.007 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:03:28.007 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:03:28.007 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:03:28.008 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:03:28.008 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:28.008 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:28.008 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:28.009 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:28.009 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.009 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:28.009 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:28.010 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:28.010 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:28.010 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:28.010 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:28.010 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:28.011 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:28.011 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:28.011 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:28.011 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:28.011 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:28.012 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:28.012 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.012 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.012 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:03:28.013 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:28.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.013 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.013 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:03:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.015 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.015 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:03:28.015 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:28.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.016 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.016 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:03:28.016 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:28.016 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.017 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.017 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:28.017 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.017 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.018 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:03:28.018 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:28.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.018 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:03:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:03:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:28.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.021 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.021 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:03:28.021 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:28.022 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.022 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.022 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:03:28.022 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:03:28.023 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:03:28.023 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:03:28.023 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:28.023 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull", 2023-09-13T06:03:28.023 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:28.024 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:28.024 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.024 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:28.024 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:28.025 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:28.025 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:28.025 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:28.025 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:28.025 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:28.026 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:28.026 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:28.026 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:28.026 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:28.026 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:03:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:03:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:03:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:03:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.032 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:28.032 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.032 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.033 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:03:28.033 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:28.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.033 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.034 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:03:28.034 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:28.034 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.034 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.034 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:28.035 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.035 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.037 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.037 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:03:28.037 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:28.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.038 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.038 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:03:28.038 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:28.038 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.038 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.039 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:03:28.039 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:03:28.039 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:03:28.039 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:03:28.040 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:28.040 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:28.040 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:28.040 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:28.042 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:28.042 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:28.042 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:28.042 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:28.042 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.044 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:03:28.044 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:28.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.044 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.045 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:03:28.045 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:28.045 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.045 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.046 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:28.046 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.046 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.046 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:03:28.046 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:28.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.047 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.047 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:03:28.047 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:28.048 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.048 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.048 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:28.048 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.049 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.049 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:03:28.049 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:28.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:03:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.051 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:28.051 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.051 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.052 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:03:28.052 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:28.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.052 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:03:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:03:28.054 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:03:28.054 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:03:28.054 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:03:28.054 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:28.054 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:28.055 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:28.055 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.055 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:28.056 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:28.056 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:28.056 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:28.056 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:28.056 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:28.056 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:28.057 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:28.057 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:28.057 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:28.057 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:28.057 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:03:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:28.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.059 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.059 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:03:28.059 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:28.060 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.060 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.060 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:28.060 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.061 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.061 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:03:28.061 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:28.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.062 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.062 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:03:28.062 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:28.062 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.062 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.063 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:28.063 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.063 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.063 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:03:28.064 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:28.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.064 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.064 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:03:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.066 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.066 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:03:28.066 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:28.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.067 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.067 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:03:28.067 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:28.067 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:03:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:03:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:03:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:03:28.069 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:28.069 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:28.069 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:28.069 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:28.069 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.070 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:28.070 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:28.070 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:28.071 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:28.071 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:28.071 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:28.071 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:28.071 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:28.071 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:28.072 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:28.072 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:28.072 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:28.072 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:28.072 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.073 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.073 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:03:28.073 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:28.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.074 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.074 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:03:28.074 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:28.074 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.076 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:03:28.076 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:28.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.076 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.077 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:03:28.077 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:28.077 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.077 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.078 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:28.078 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.078 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.078 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:03:28.078 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:28.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.079 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.079 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:03:28.079 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:28.080 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.080 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.080 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:28.080 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:28.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.081 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:28.081 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:03:28.081 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:28.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.082 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:28.082 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:03:28.082 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:28.082 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.083 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.083 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:03:28.083 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:03:28.083 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:03:28.083 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:03:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:03:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:03:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:28.086 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:28.086 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:28.086 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:28.086 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:28.086 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:03:28.087 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:28.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.087 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:28.087 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:03:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:28.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.089 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:28.089 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:28.089 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:28.090 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:28.090 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:28.090 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:28.090 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:03:28.090 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:28.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.091 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:28.091 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:28.091 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:28.091 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:28.092 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:28.092 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:28.092 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:03:28.092 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:28.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:28.094 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:28.094 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:03:28.094 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:28.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:28.096 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:03:28.096 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:28.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.096 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:28.098 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:03:28.098 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:28.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.098 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:28.099 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:28.099 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:28.099 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:28.099 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:28.099 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:28.100 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:03:28.100 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:28.100 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.100 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:28.100 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:03:28.100 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [ 2023-09-13T06:03:28.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.101 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.13", 2023-09-13T06:03:28.101 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:28.101 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.101 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:28.102 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 5 2023-09-13T06:03:28.102 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.102 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.32", 2023-09-13T06:03:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 4 2023-09-13T06:03:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.104 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:28.104 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.104 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:28.104 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:03:28.104 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:03:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:03:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:03:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:03:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:03:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:03:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:03:28.106 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:03:28.106 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:03:28.106 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:03:28.106 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:03:28.106 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:03:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:03:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:03:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:03:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:03:28.108 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:03:28.108 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:03:28.108 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:03:28.108 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:03:28.108 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:03:28.109 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:03:28.109 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:28.109 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:03:28.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 -- 172.21.15.130:0/715918606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa974065b50 msgr2=0x7fa974068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:28.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa974065b50 0x7fa974068010 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa98813ea80 tx=0x7fa978009190 comp rx=0 tx=0).stop 2023-09-13T06:03:28.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 -- 172.21.15.130:0/715918606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9880d1090 msgr2=0x7fa9881661b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:28.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9880d1090 0x7fa9881661b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa9840ac040 tx=0x7fa98401ad10 comp rx=0 tx=0).stop 2023-09-13T06:03:28.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 -- 172.21.15.130:0/715918606 shutdown_connections 2023-09-13T06:03:28.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa974065b50 0x7fa974068010 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:28.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9880d1750 0x7fa98815cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:28.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9880d1b30 0x7fa9881465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:28.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 --2- 172.21.15.130:0/715918606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9880d1090 0x7fa9881661b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:28.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 -- 172.21.15.130:0/715918606 >> 172.21.15.130:0/715918606 conn(0x7fa98806f170 msgr2=0x7fa98815f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:28.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 -- 172.21.15.130:0/715918606 shutdown_connections 2023-09-13T06:03:28.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:27.907+0000 7fa98eb67640 1 -- 172.21.15.130:0/715918606 wait complete. 2023-09-13T06:03:28.114 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:03:29.316 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:03:29.315+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-09-13T06:03:33.115 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:03:33.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.259+0000 7f83d0b96640 1 Processor -- start 2023-09-13T06:03:33.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.259+0000 7f83d0b96640 1 -- start start 2023-09-13T06:03:33.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.259+0000 7f83d0b96640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f83cc15b130 0x7f83cc0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.259+0000 7f83d0b96640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f83cc0b04a0 0x7f83cc0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.259+0000 7f83d0b96640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc0ce980 con 0x7f83cc0ce180 2023-09-13T06:03:33.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.259+0000 7f83d0b96640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc0b0e50 con 0x7f83cc0b04a0 2023-09-13T06:03:33.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.259+0000 7f83d0b96640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc0cec60 con 0x7f83cc15b130 2023-09-13T06:03:33.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.259+0000 7f83cad9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f83cc0b04a0 0x7f83cc0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:33.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.259+0000 7f83cad9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f83cc0b04a0 0x7f83cc0b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57200/0 (socket says 172.21.15.130:57200) 2023-09-13T06:03:33.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.259+0000 7f83cad9d640 1 -- 172.21.15.130:0/1709614792 learned_addr learned my addr 172.21.15.130:0/1709614792 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:33.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83ca59c640 1 --2- 172.21.15.130:0/1709614792 >> v2:172.21.15.164:3300/0 conn(0x7f83cc15b130 0x7f83cc0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:33.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83cad9d640 1 -- 172.21.15.130:0/1709614792 >> v2:172.21.15.164:3300/0 conn(0x7f83cc15b130 msgr2=0x7f83cc0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:33.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83cad9d640 1 --2- 172.21.15.130:0/1709614792 >> v2:172.21.15.164:3300/0 conn(0x7f83cc15b130 0x7f83cc0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83cad9d640 1 -- 172.21.15.130:0/1709614792 >> v1:172.21.15.164:6789/0 conn(0x7f83cc0ce180 legacy=0x7f83cc15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:33.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83cad9d640 1 -- 172.21.15.130:0/1709614792 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc06c640 con 0x7f83cc0b04a0 2023-09-13T06:03:33.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83ca59c640 1 --2- 172.21.15.130:0/1709614792 >> v2:172.21.15.164:3300/0 conn(0x7f83cc15b130 0x7f83cc0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:33.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83cad9d640 1 --2- 172.21.15.130:0/1709614792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83cc0b04a0 0x7f83cc0b0910 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0b1040 tx=0x7f83c401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da17715a09cb4236 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:33.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83c9d9b640 1 -- 172.21.15.130:0/1709614792 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c40a5890 con 0x7f83cc0b04a0 2023-09-13T06:03:33.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83c9d9b640 1 -- 172.21.15.130:0/1709614792 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c40a59f0 con 0x7f83cc0b04a0 2023-09-13T06:03:33.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83c9d9b640 1 -- 172.21.15.130:0/1709614792 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c40a5d80 con 0x7f83cc0b04a0 2023-09-13T06:03:33.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83d0b96640 1 -- 172.21.15.130:0/1709614792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83cc0b04a0 msgr2=0x7f83cc0b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:33.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.263+0000 7f83d0b96640 1 --2- 172.21.15.130:0/1709614792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83cc0b04a0 0x7f83cc0b0910 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0b1040 tx=0x7f83c401c9d0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 -- 172.21.15.130:0/1709614792 shutdown_connections 2023-09-13T06:03:33.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 --2- 172.21.15.130:0/1709614792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83cc0b04a0 0x7f83cc0b0910 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 --2- 172.21.15.130:0/1709614792 >> v2:172.21.15.164:3300/0 conn(0x7f83cc15b130 0x7f83cc0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 -- 172.21.15.130:0/1709614792 >> 172.21.15.130:0/1709614792 conn(0x7f83cc065990 msgr2=0x7f83cc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:33.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 -- 172.21.15.130:0/1709614792 shutdown_connections 2023-09-13T06:03:33.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 -- 172.21.15.130:0/1709614792 wait complete. 2023-09-13T06:03:33.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 Processor -- start 2023-09-13T06:03:33.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 -- start start 2023-09-13T06:03:33.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83cc0b04a0 0x7f83cc14b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83cc0ce180 0x7f83cc14c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83cc15b130 0x7f83cc14cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc14c1c0 con 0x7f83cc0b04a0 2023-09-13T06:03:33.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc14b6a0 con 0x7f83cc0ce180 2023-09-13T06:03:33.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83d0b96640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc15d270 con 0x7f83cc15b130 2023-09-13T06:03:33.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83ca59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83cc0b04a0 0x7f83cc14b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:33.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83ca59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83cc0b04a0 0x7f83cc14b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57216/0 (socket says 172.21.15.130:57216) 2023-09-13T06:03:33.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83ca59c640 1 -- 172.21.15.130:0/3103431549 learned_addr learned my addr 172.21.15.130:0/3103431549 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83ca59c640 1 -- 172.21.15.130:0/3103431549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83cc15b130 msgr2=0x7f83cc14cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83ca59c640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83cc15b130 0x7f83cc14cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83ca59c640 1 -- 172.21.15.130:0/3103431549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83cc0ce180 msgr2=0x7f83cc14c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83ca59c640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83cc0ce180 0x7f83cc14c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83ca59c640 1 -- 172.21.15.130:0/3103431549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c4009b30 con 0x7f83cc0b04a0 2023-09-13T06:03:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83ca59c640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83cc0b04a0 0x7f83cc14b160 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00d830 tx=0x7f83bc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:33.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.267+0000 7f83c2ffd640 1 -- 172.21.15.130:0/3103431549 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0096c0 con 0x7f83cc0b04a0 2023-09-13T06:03:33.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.271+0000 7f83c2ffd640 1 -- 172.21.15.130:0/3103431549 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc009820 con 0x7f83cc0b04a0 2023-09-13T06:03:33.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.271+0000 7f83d0b96640 1 -- 172.21.15.130:0/3103431549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83cc14b890 con 0x7f83cc0b04a0 2023-09-13T06:03:33.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.271+0000 7f83c2ffd640 1 -- 172.21.15.130:0/3103431549 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc009bd0 con 0x7f83cc0b04a0 2023-09-13T06:03:33.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.271+0000 7f83d0b96640 1 -- 172.21.15.130:0/3103431549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc14be50 con 0x7f83cc0b04a0 2023-09-13T06:03:33.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.271+0000 7f83d0b96640 1 -- 172.21.15.130:0/3103431549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83cc0618a0 con 0x7f83cc0b04a0 2023-09-13T06:03:33.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.271+0000 7f83c2ffd640 1 -- 172.21.15.130:0/3103431549 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f83bc009d30 con 0x7f83cc0b04a0 2023-09-13T06:03:33.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.271+0000 7f83c2ffd640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83ac065b20 0x7f83ac067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.271+0000 7f83c2ffd640 1 -- 172.21.15.130:0/3103431549 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f83bc083ad0 con 0x7f83cc0b04a0 2023-09-13T06:03:33.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.271+0000 7f83c3fff640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83ac065b20 0x7f83ac067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:33.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.271+0000 7f83c3fff640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83ac065b20 0x7f83ac067fe0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83b4000f70 tx=0x7f83b40079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:33.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.275+0000 7f83c2ffd640 1 -- 172.21.15.130:0/3103431549 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f83bc051340 con 0x7f83cc0b04a0 2023-09-13T06:03:33.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.427+0000 7f83d0b96640 1 -- 172.21.15.130:0/3103431549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f83cc0cb6c0 con 0x7f83cc0b04a0 2023-09-13T06:03:33.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83c2ffd640 1 -- 172.21.15.130:0/3103431549 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) v1 ==== 81+0+34355 (secure 0 0 0) 0x7f83bc054960 con 0x7f83cc0b04a0 2023-09-13T06:03:33.434 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:33.434 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:03:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 54, 2023-09-13T06:03:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:03:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:03:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:03:31.332756+0000", 2023-09-13T06:03:33.435 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:03:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:03:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:03:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:03:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:03:33.436 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:03:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:03:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:03:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:03:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:33.437 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:03:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:03:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:03:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:03:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:03:33.438 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 7, 2023-09-13T06:03:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:03:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:03:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "luminous", 2023-09-13T06:03:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:03:33.439 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:03:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:03:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:03:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:03:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:03:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:03:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:03:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:33.441 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:33.442 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:03:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:03:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:03:33.443 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:03:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:03:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:33.444 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:33.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "54", 2023-09-13T06:03:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:33.446 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:33.447 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:33.448 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:33.450 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:33.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.451 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:33.451 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:33.451 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:33.451 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:33.452 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:03:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:03:33.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:03:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:03:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:03:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:03:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:03:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:03:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:33.455 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.456 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 6, 2023-09-13T06:03:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:03:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.311861+0000", 2023-09-13T06:03:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:03:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:03:33.457 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:33.458 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:03:33.459 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:03:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:03:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:03:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:03:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:33.460 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:33.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "54", 2023-09-13T06:03:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:33.462 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:33.463 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:33.464 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:33.465 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:33.466 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:33.467 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:33.468 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:03:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:03:33.469 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:03:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:03:33.470 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:03:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:03:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:33.471 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:03:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:03:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 7, 2023-09-13T06:03:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:03:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.919645+0000", 2023-09-13T06:03:33.473 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:03:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:03:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:33.474 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:33.475 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:03:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:03:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:03:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:03:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:03:33.476 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:33.477 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "54", 2023-09-13T06:03:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:33.478 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:33.479 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:33.480 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:33.481 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:33.482 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:33.483 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:33.484 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:33.485 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:03:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:03:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:33.486 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:03:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.5, 2023-09-13T06:03:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.5, 2023-09-13T06:03:33.487 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.5, 2023-09-13T06:03:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.5, 2023-09-13T06:03:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:33.488 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:03:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.489 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:33.490 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:33.491 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.492 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:03:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.493 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:03:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:33.494 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:03:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:33.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:03:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.496 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.497 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:03:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.498 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:03:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.499 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:03:33.500 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:03:33.501 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:03:33.502 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:03:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:03:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:03:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:33.503 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:33.504 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:33.505 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:03:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:03:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:33.508 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.509 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:03:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.510 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:03:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.511 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:03:33.512 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:03:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:33.513 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:03:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.515 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:03:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:03:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:03:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:03:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:03:33.517 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.518 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:33.519 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:33.520 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.521 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:03:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:03:33.522 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:33.523 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.523 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.523 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:33.523 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.524 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.524 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:03:33.524 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:33.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.525 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.525 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:03:33.525 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:33.525 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.526 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.526 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:33.526 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.527 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.527 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:03:33.527 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:33.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.527 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.528 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:03:33.528 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:33.528 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.528 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.528 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.529 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:33.529 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.529 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.529 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:03:33.530 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:33.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.530 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.530 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:03:33.530 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:33.531 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.531 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.531 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:03:33.531 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:03:33.532 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:03:33.532 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:03:33.532 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:33.532 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:33.532 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:33.532 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.533 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:33.533 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:33.533 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:33.534 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:33.534 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:33.534 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:33.534 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:33.534 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:33.535 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:33.535 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:33.535 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:33.535 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:33.535 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:33.535 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.536 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.536 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:03:33.536 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:33.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.537 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.537 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:03:33.537 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:33.537 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.537 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.538 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:33.538 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.538 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.539 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:03:33.539 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:33.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.539 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.539 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:03:33.540 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:33.540 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.540 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.541 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:33.541 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.541 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.541 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:03:33.542 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:33.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.542 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.542 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:03:33.542 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:33.543 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.543 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.543 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:33.543 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.544 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.544 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:03:33.544 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:33.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.545 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.545 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:03:33.545 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:33.545 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.545 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.546 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:03:33.546 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:03:33.546 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:03:33.546 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:03:33.547 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:33.547 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:33.547 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:33.547 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.548 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:33.548 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:33.548 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:33.548 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:33.548 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:33.549 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:33.549 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:33.549 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:33.549 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:33.549 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:33.549 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:33.550 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:33.550 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:33.550 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.550 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.551 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:03:33.551 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:33.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.551 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.551 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:03:33.552 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:33.552 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.552 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.552 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:33.553 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.553 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.553 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:03:33.553 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:33.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.554 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.554 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:03:33.554 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:33.554 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.555 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.555 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:33.555 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.555 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.556 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:03:33.556 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:33.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.556 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.556 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:03:33.557 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:33.557 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.557 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.557 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:33.558 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.558 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.558 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:03:33.558 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:33.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.559 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.559 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.559 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:03:33.559 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:33.559 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.560 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.560 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:03:33.560 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:03:33.560 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:03:33.560 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:03:33.561 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:33.561 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:33.561 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:33.561 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.561 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.562 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:33.562 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:33.562 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:33.562 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:33.562 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:33.563 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:33.563 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:33.563 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:33.563 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:33.564 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:33.564 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:33.564 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:33.564 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:33.564 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.565 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.565 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:03:33.565 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:33.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.566 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.566 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:03:33.566 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:33.566 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.566 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.567 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:33.567 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.567 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.567 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:03:33.568 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:33.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.568 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.568 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:03:33.569 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:33.569 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.569 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.569 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:33.569 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.570 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.570 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:03:33.570 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:33.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.571 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.571 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:03:33.571 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:33.571 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.571 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.572 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:33.572 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.572 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.573 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:03:33.573 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:33.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.573 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.574 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:03:33.574 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:33.574 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.574 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.574 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:03:33.575 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:03:33.575 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:03:33.576 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:03:33.577 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:33.577 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:33.577 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:33.577 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.578 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:33.578 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:33.578 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:33.578 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:33.579 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:33.579 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:33.579 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:33.579 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:33.579 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:33.579 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:33.580 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:33.580 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:33.580 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:33.580 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.581 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.581 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:03:33.581 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:33.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.582 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.582 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:03:33.582 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:33.582 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.582 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.583 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:33.583 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.583 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.583 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:03:33.584 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:33.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.584 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.584 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:03:33.585 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:33.585 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.585 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.585 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:33.585 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.586 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.586 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:03:33.586 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:33.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.587 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.587 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:03:33.587 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:33.587 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.587 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.588 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:33.588 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.588 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.588 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:03:33.589 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:33.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.589 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.589 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:03:33.590 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:33.590 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.590 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.590 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:03:33.591 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:03:33.591 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:03:33.591 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:03:33.591 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:33.591 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:33.592 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:33.592 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.592 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:33.592 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:33.593 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:33.593 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:33.593 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:33.593 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:33.593 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:33.594 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:33.594 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:33.594 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:33.594 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:33.594 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:33.594 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:33.595 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.595 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.595 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:03:33.595 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:33.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.596 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.596 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:03:33.596 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:33.596 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.597 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.597 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:33.597 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.598 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.598 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:03:33.598 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:33.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.598 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.599 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:03:33.599 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:33.599 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.599 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.600 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:33.600 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.600 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.600 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:03:33.600 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:33.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.601 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.601 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:03:33.601 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:33.602 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.602 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.602 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:33.602 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:33.602 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.603 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:33.603 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:03:33.603 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:33.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.604 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:33.604 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:03:33.604 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:33.604 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.604 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.605 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:03:33.605 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:03:33.605 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:03:33.605 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:03:33.605 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:33.606 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:33.606 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:33.606 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.606 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.606 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:33.607 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:03:33.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.607 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:33.607 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:33.607 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:33.607 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:33.608 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:33.608 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:33.608 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:03:33.608 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:33.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.609 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:33.609 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:33.609 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:33.609 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:33.609 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:33.610 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:33.610 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:03:33.610 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:33.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.611 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:33.611 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:33.611 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:33.611 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:33.611 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:33.612 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:33.612 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:03:33.612 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:33.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.612 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:33.613 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:33.613 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:33.613 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:33.613 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:33.613 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:33.614 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:03:33.614 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:33.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.614 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:33.615 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:33.615 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:33.615 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:33.615 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:33.615 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:33.615 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:03:33.616 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:33.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.616 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:33.616 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:33.617 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:33.617 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:33.617 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:33.617 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:33.617 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:03:33.617 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:33.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.618 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:33.618 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:33.618 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:33.619 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:33.619 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:33.619 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:33.619 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:03:33.619 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:33.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.620 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:33.620 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:33.620 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:33.621 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:33.621 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:33.621 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:33.621 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:03:33.621 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:33.621 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.622 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:33.622 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:03:33.622 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [ 2023-09-13T06:03:33.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.622 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.13", 2023-09-13T06:03:33.623 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:33.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.623 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:33.623 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 5 2023-09-13T06:03:33.623 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.624 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.624 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.32", 2023-09-13T06:03:33.624 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:33.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.625 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:33.625 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 4 2023-09-13T06:03:33.625 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.625 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:33.625 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.626 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:33.626 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:03:33.626 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:03:33.626 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:03:33.626 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:03:33.627 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:03:33.627 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:03:33.627 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:03:33.627 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:03:33.627 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:03:33.627 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:03:33.628 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:03:33.628 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:03:33.628 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.628 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:03:33.628 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:03:33.629 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:03:33.629 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:03:33.629 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:03:33.629 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:03:33.629 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:03:33.630 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:03:33.630 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:03:33.630 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:03:33.630 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:03:33.630 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.630 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:03:33.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 -- 172.21.15.130:0/3103431549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83ac065b20 msgr2=0x7f83ac067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:33.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83ac065b20 0x7f83ac067fe0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83b4000f70 tx=0x7f83b40079c0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 -- 172.21.15.130:0/3103431549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83cc0b04a0 msgr2=0x7f83cc14b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:33.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83cc0b04a0 0x7f83cc14b160 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00d830 tx=0x7f83bc00dcf0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 -- 172.21.15.130:0/3103431549 shutdown_connections 2023-09-13T06:03:33.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83ac065b20 0x7f83ac067fe0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83cc0ce180 0x7f83cc14c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83cc15b130 0x7f83cc14cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 --2- 172.21.15.130:0/3103431549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83cc0b04a0 0x7f83cc14b160 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 -- 172.21.15.130:0/3103431549 >> 172.21.15.130:0/3103431549 conn(0x7f83cc065990 msgr2=0x7f83cc06f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:33.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 -- 172.21.15.130:0/3103431549 shutdown_connections 2023-09-13T06:03:33.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.431+0000 7f83d0b96640 1 -- 172.21.15.130:0/3103431549 wait complete. 2023-09-13T06:03:33.635 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-09-13T06:03:33.636 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:03:33.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad4434640 1 Processor -- start 2023-09-13T06:03:33.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad4434640 1 -- start start 2023-09-13T06:03:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad4434640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2acc0d1750 0x7f2acc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad4434640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2acc0d1090 0x7f2acc146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad4434640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2acc0b63c0 con 0x7f2acc0d1b30 2023-09-13T06:03:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad4434640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2acc15dea0 con 0x7f2acc0d1750 2023-09-13T06:03:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad4434640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2acc0d0c20 con 0x7f2acc0d1090 2023-09-13T06:03:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad21d0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2acc0d1750 0x7f2acc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad21d0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2acc0d1750 0x7f2acc15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57230/0 (socket says 172.21.15.130:57230) 2023-09-13T06:03:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad21d0640 1 -- 172.21.15.130:0/3365317332 learned_addr learned my addr 172.21.15.130:0/3365317332 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad19cf640 1 --2- 172.21.15.130:0/3365317332 >> v2:172.21.15.164:3300/0 conn(0x7f2acc0d1090 0x7f2acc146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:33.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad21d0640 1 -- 172.21.15.130:0/3365317332 >> v2:172.21.15.164:3300/0 conn(0x7f2acc0d1090 msgr2=0x7f2acc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:33.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad21d0640 1 --2- 172.21.15.130:0/3365317332 >> v2:172.21.15.164:3300/0 conn(0x7f2acc0d1090 0x7f2acc146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad21d0640 1 -- 172.21.15.130:0/3365317332 >> v1:172.21.15.164:6789/0 conn(0x7f2acc0d1b30 legacy=0x7f2acc0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:33.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.771+0000 7f2ad21d0640 1 -- 172.21.15.130:0/3365317332 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc0b6610 con 0x7f2acc0d1750 2023-09-13T06:03:33.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad21d0640 1 --2- 172.21.15.130:0/3365317332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2acc0d1750 0x7f2acc15d960 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0c8360 tx=0x7f2ac801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d40ca895c60b0f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:33.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad11ce640 1 -- 172.21.15.130:0/3365317332 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80aa5f0 con 0x7f2acc0d1750 2023-09-13T06:03:33.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad11ce640 1 -- 172.21.15.130:0/3365317332 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac80aa750 con 0x7f2acc0d1750 2023-09-13T06:03:33.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad11ce640 1 -- 172.21.15.130:0/3365317332 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80aaae0 con 0x7f2acc0d1750 2023-09-13T06:03:33.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad4434640 1 -- 172.21.15.130:0/3365317332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2acc0d1750 msgr2=0x7f2acc15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:33.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad4434640 1 --2- 172.21.15.130:0/3365317332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2acc0d1750 0x7f2acc15d960 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0c8360 tx=0x7f2ac801c490 comp rx=0 tx=0).stop 2023-09-13T06:03:33.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad4434640 1 -- 172.21.15.130:0/3365317332 shutdown_connections 2023-09-13T06:03:33.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad4434640 1 --2- 172.21.15.130:0/3365317332 >> v2:172.21.15.164:3300/0 conn(0x7f2acc0d1090 0x7f2acc146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad4434640 1 --2- 172.21.15.130:0/3365317332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2acc0d1750 0x7f2acc15d960 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad4434640 1 -- 172.21.15.130:0/3365317332 >> 172.21.15.130:0/3365317332 conn(0x7f2acc06f170 msgr2=0x7f2acc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:33.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad4434640 1 -- 172.21.15.130:0/3365317332 shutdown_connections 2023-09-13T06:03:33.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.775+0000 7f2ad4434640 1 -- 172.21.15.130:0/3365317332 wait complete. 2023-09-13T06:03:33.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad4434640 1 Processor -- start 2023-09-13T06:03:33.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad4434640 1 -- start start 2023-09-13T06:03:33.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad4434640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2acc0d1090 0x7f2acc15a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad4434640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2acc0d1750 0x7f2acc144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad4434640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2acc0d1b30 0x7f2acc145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad4434640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0b53b0 con 0x7f2acc0d1750 2023-09-13T06:03:33.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad4434640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0b45f0 con 0x7f2acc0d1090 2023-09-13T06:03:33.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad4434640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0b48d0 con 0x7f2acc0d1b30 2023-09-13T06:03:33.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad19cf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2acc0d1750 0x7f2acc144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:33.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad19cf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2acc0d1750 0x7f2acc144e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57246/0 (socket says 172.21.15.130:57246) 2023-09-13T06:03:33.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad19cf640 1 -- 172.21.15.130:0/2959954847 learned_addr learned my addr 172.21.15.130:0/2959954847 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:33.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad19cf640 1 -- 172.21.15.130:0/2959954847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2acc0d1b30 msgr2=0x7f2acc145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:33.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad21d0640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2acc0d1090 0x7f2acc15a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:33.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad29d1640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2acc0d1b30 0x7f2acc145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:33.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad19cf640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2acc0d1b30 0x7f2acc145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad19cf640 1 -- 172.21.15.130:0/2959954847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2acc0d1090 msgr2=0x7f2acc15a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:33.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad19cf640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2acc0d1090 0x7f2acc15a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:33.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad19cf640 1 -- 172.21.15.130:0/2959954847 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80094d0 con 0x7f2acc0d1750 2023-09-13T06:03:33.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad21d0640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2acc0d1090 0x7f2acc15a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:33.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad29d1640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2acc0d1b30 0x7f2acc145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:33.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad19cf640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2acc0d1750 0x7f2acc144e50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00d5d0 tx=0x7f2abc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:33.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ac2ffd640 1 -- 172.21.15.130:0/2959954847 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc004240 con 0x7f2acc0d1750 2023-09-13T06:03:33.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ac2ffd640 1 -- 172.21.15.130:0/2959954847 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc0043a0 con 0x7f2acc0d1750 2023-09-13T06:03:33.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ac2ffd640 1 -- 172.21.15.130:0/2959954847 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc003840 con 0x7f2acc0d1750 2023-09-13T06:03:33.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad4434640 1 -- 172.21.15.130:0/2959954847 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2acc0b4bb0 con 0x7f2acc0d1750 2023-09-13T06:03:33.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.779+0000 7f2ad4434640 1 -- 172.21.15.130:0/2959954847 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc0b6160 con 0x7f2acc0d1750 2023-09-13T06:03:33.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.783+0000 7f2ad4434640 1 -- 172.21.15.130:0/2959954847 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2acc0618a0 con 0x7f2acc0d1750 2023-09-13T06:03:33.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.783+0000 7f2ac2ffd640 1 -- 172.21.15.130:0/2959954847 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2abc0039a0 con 0x7f2acc0d1750 2023-09-13T06:03:33.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.783+0000 7f2ac2ffd640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ab0065b20 0x7f2ab0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:33.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.783+0000 7f2ac2ffd640 1 -- 172.21.15.130:0/2959954847 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2abc0834e0 con 0x7f2acc0d1750 2023-09-13T06:03:33.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.783+0000 7f2ad21d0640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ab0065b20 0x7f2ab0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:33.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.783+0000 7f2ad21d0640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ab0065b20 0x7f2ab0067fe0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80ae000 tx=0x7f2ac8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:33.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.787+0000 7f2ac2ffd640 1 -- 172.21.15.130:0/2959954847 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2abc050de0 con 0x7f2acc0d1750 2023-09-13T06:03:33.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.935+0000 7f2ad4434640 1 -- 172.21.15.130:0/2959954847 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2acc0b86c0 con 0x7f2acc0d1750 2023-09-13T06:03:33.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.935+0000 7f2ac2ffd640 1 -- 172.21.15.130:0/2959954847 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) v1 ==== 81+0+34355 (secure 0 0 0) 0x7f2abc054400 con 0x7f2acc0d1750 2023-09-13T06:03:33.942 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:33.942 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:03:33.942 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 54, 2023-09-13T06:03:33.943 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:03:33.943 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:03:33.943 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:03:31.332756+0000", 2023-09-13T06:03:33.943 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:03:33.943 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:03:33.944 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:03:33.944 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:03:33.944 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:03:33.944 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:03:33.944 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:03:33.944 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:03:33.945 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:03:33.945 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:33.945 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:03:33.945 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:03:33.945 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:03:33.946 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:03:33.946 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:03:33.946 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 7, 2023-09-13T06:03:33.946 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:03:33.946 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:03:33.947 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "luminous", 2023-09-13T06:03:33.947 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:03:33.947 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:03:33.947 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:03:33.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.947 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:03:33.948 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:03:33.948 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:03:33.948 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:03:33.948 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:03:33.949 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:33.949 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:33.949 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:33.949 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:33.950 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:33.950 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:33.950 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:33.950 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:33.951 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:33.951 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:33.951 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:03:33.951 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:03:33.952 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:03:33.952 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:03:33.952 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:03:33.952 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:33.952 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:33.952 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:33.953 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:33.953 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:33.953 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:33.953 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:33.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.954 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "54", 2023-09-13T06:03:33.954 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:33.954 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:33.954 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:33.954 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:33.955 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:33.955 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:33.955 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:33.955 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:33.955 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:33.956 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:33.956 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:33.956 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:33.956 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:33.957 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:33.957 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:33.957 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:33.957 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:33.959 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:33.960 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:33.962 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:03:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:03:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:03:33.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:03:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:03:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:03:33.964 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:03:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:03:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 6, 2023-09-13T06:03:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:03:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.311861+0000", 2023-09-13T06:03:33.966 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:03:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:03:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:33.967 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:33.968 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:03:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:03:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:03:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:03:33.969 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:03:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:33.970 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "54", 2023-09-13T06:03:33.971 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:33.972 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:33.973 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:33.974 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:33.975 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:33.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:33.977 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:33.978 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:03:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:03:33.979 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:03:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:03:33.980 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:03:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:03:33.981 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:33.982 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:03:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:03:33.985 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:33.986 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 7, 2023-09-13T06:03:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:03:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:02:53.919645+0000", 2023-09-13T06:03:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:03:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:03:33.987 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:03:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:03:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:03:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:03:33.988 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:03:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:03:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:03:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:03:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:03:33.989 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:03:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:03:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:03:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:03:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:03:33.990 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:03:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:03:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:03:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:03:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:03:33.991 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:03:33.992 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:03:33.992 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:03:33.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.992 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "54", 2023-09-13T06:03:33.992 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:03:33.992 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:03:33.993 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:03:33.993 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:03:33.993 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:03:33.993 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:03:33.993 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:03:33.994 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:03:33.994 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:03:33.994 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:03:33.994 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:03:33.994 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:03:33.995 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:03:33.995 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:03:33.995 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:03:33.995 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:03:33.995 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:03:33.995 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:03:33.996 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:03:33.996 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:03:33.996 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:03:33.996 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:03:33.996 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:03:33.997 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:03:33.997 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:03:33.997 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:03:33.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:33.997 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:03:33.997 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:03:33.998 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:03:33.998 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:03:33.998 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:03:33.998 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:03:33.998 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:03:33.999 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:03:33.999 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:03:33.999 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:03:33.999 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:03:34.000 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:03:34.000 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:03:34.000 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:03:34.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.000 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:03:34.001 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:03:34.001 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:03:34.001 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.001 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:03:34.001 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.5, 2023-09-13T06:03:34.002 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.5, 2023-09-13T06:03:34.002 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:03:34.002 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.5, 2023-09-13T06:03:34.002 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.5, 2023-09-13T06:03:34.002 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:03:34.003 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:03:34.003 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:03:34.003 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.003 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.003 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:34.004 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:03:34.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.004 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:34.004 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:34.004 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:34.004 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:34.005 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:34.005 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:34.005 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:34.005 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:34.005 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:34.006 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:34.006 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:34.006 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:34.006 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:34.006 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.007 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.007 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:03:34.007 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:34.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.008 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.008 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:03:34.008 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:34.008 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.008 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.009 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:34.009 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.010 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.010 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:03:34.010 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:34.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.011 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.011 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:03:34.011 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:34.011 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.011 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.012 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:34.012 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.012 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.012 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:03:34.013 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:34.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.013 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.013 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:03:34.014 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:34.014 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.014 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.014 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:34.015 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.015 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.015 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:03:34.015 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:34.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.016 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.016 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:03:34.016 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:03:34.016 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.017 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.017 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:03:34.017 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:03:34.017 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:03:34.018 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:03:34.018 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:34.018 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:34.018 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:34.018 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.019 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:34.019 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:34.019 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:34.020 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:34.020 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:34.020 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:34.020 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:34.020 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:34.021 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:34.021 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:34.021 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:34.021 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:34.021 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:34.022 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.022 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.022 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:03:34.022 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:34.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.023 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.023 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:03:34.023 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:34.024 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.024 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.024 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:34.024 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.025 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.025 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:03:34.025 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:34.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.026 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.026 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:03:34.026 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:34.026 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.026 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.027 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:34.027 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.027 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.027 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:03:34.028 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:34.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.028 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.028 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:03:34.029 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:34.029 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.029 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.029 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:34.029 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.030 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.030 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:03:34.030 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:34.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.031 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.031 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:03:34.031 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:03:34.032 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.032 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.032 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:03:34.032 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:03:34.032 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:03:34.033 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:03:34.033 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:34.033 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:34.033 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:34.033 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.034 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:34.034 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:34.034 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:34.035 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:34.035 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:34.035 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:34.035 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:34.035 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:34.035 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:34.036 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:34.036 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:34.036 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:34.036 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:34.036 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.037 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.037 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:03:34.037 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:34.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.038 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.038 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:03:34.038 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:34.038 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.038 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.039 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:34.039 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.039 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.039 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:03:34.040 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:34.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.040 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.041 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:03:34.041 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:34.041 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.041 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.042 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:34.042 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.042 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.042 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:03:34.043 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:34.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.043 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.043 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:03:34.044 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:34.044 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.044 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.044 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:34.044 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.045 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.045 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:03:34.045 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:34.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.046 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.046 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:03:34.046 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:03:34.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.047 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.047 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:03:34.047 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:03:34.047 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:03:34.047 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:03:34.048 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:34.048 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:34.048 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:34.048 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.049 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:34.049 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:34.049 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:34.049 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:34.049 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:34.050 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:34.050 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:34.050 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:34.050 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:34.051 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:34.051 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:34.051 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:34.051 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:34.051 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.052 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.052 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:03:34.052 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:34.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.053 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.053 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:03:34.053 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:34.053 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.053 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.054 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:34.054 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.054 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.054 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:03:34.055 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:34.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.055 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.055 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:03:34.055 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:34.056 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.056 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.056 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:34.056 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.057 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.057 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:03:34.057 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:34.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.058 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.058 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:03:34.058 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:34.058 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.058 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.059 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:34.059 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.059 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.060 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:03:34.060 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:34.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.060 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.060 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:03:34.061 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:03:34.061 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.061 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.061 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:03:34.062 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:03:34.062 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:03:34.062 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:03:34.062 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:34.062 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:34.062 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:34.063 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.063 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:34.063 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:34.064 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:34.064 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:34.064 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:34.064 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:34.064 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:34.064 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:34.065 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:34.065 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:34.065 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:34.065 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:34.065 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:34.066 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.066 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.066 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:03:34.066 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:34.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.067 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.067 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:03:34.067 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:34.067 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.068 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.068 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:34.068 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.068 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.069 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:03:34.069 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:34.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.069 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.070 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:03:34.070 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:34.070 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.070 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.070 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:34.071 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.071 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.071 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:03:34.071 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:34.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.072 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.072 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:03:34.072 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:34.072 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.073 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.073 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:34.073 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.074 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.074 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:03:34.074 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:34.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.075 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.075 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:03:34.075 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:03:34.075 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.075 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.076 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:03:34.076 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:03:34.076 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:03:34.076 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:03:34.076 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:34.077 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:34.077 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:34.077 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.078 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:34.078 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:34.078 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:34.078 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:34.078 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:34.078 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:34.079 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:34.079 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:34.079 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:34.079 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 46, 2023-09-13T06:03:34.079 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:34.080 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:34.080 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:34.080 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.080 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.081 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:03:34.081 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:34.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.081 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.081 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:03:34.082 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:34.082 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.082 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.082 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:34.083 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.083 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.083 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:03:34.083 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:34.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.084 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.084 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:03:34.084 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:34.084 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.085 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.085 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:34.085 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.085 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.086 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:03:34.086 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:34.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.086 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.087 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:03:34.087 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:34.087 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.087 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.087 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:34.088 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.088 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.088 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:03:34.088 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:34.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.089 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.089 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:03:34.089 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:03:34.089 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.090 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.090 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:03:34.090 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:03:34.090 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:03:34.090 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:03:34.091 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:34.091 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:34.091 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:34.091 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.092 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.092 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:34.092 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:34.092 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:34.092 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:34.093 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:34.093 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:34.093 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:34.093 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:34.093 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:34.093 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:34.094 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:34.094 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:34.094 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:34.094 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.095 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.095 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:03:34.095 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:34.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.095 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.096 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:03:34.096 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:34.096 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.096 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.097 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:34.097 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.097 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.097 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:03:34.097 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:34.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.098 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.098 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.098 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:03:34.098 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:34.098 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:03:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:03:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:34.102 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.102 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.102 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:03:34.102 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:34.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.103 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.103 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:03:34.103 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:03:34.103 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.104 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.104 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:03:34.104 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:03:34.104 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:03:34.105 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:03:34.105 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:34.105 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:34.105 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:34.105 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.106 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:34.106 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:03:34.106 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:03:34.106 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:03:34.107 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:03:34.107 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:03:34.107 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:03:34.107 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:03:34.107 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:03:34.107 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 43, 2023-09-13T06:03:34.108 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:03:34.108 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:03:34.108 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:03:34.108 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.108 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.109 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:03:34.109 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:34.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.109 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.109 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:03:34.110 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:34.110 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.110 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.110 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:03:34.111 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.111 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.111 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:03:34.111 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:34.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.112 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.112 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:03:34.112 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:34.112 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.113 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.113 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:03:34.113 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.114 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.114 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:03:34.114 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:34.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.114 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.115 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:03:34.115 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:34.115 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.115 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.115 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:03:34.116 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:03:34.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.116 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:03:34.116 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:03:34.116 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:34.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.117 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:03:34.117 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:03:34.117 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:03:34.117 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.118 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.118 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:03:34.118 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:03:34.118 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:03:34.119 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:03:34.119 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:03:34.119 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:03:34.119 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:03:34.119 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.120 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.120 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:34.120 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:03:34.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.120 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:03:34.120 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:34.121 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:34.121 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:34.121 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:34.121 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:34.121 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:03:34.122 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:34.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.122 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:03:34.122 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:34.123 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:34.123 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:34.123 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:34.123 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:34.123 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:03:34.124 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:34.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.124 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:03:34.124 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:34.124 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:34.125 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:34.125 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:34.125 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:34.125 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:03:34.125 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:34.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.126 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:03:34.126 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:34.126 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:34.126 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:34.127 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:34.127 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:34.127 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:03:34.127 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:34.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.128 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:03:34.128 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:34.128 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:34.128 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:34.128 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:34.129 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:34.129 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:03:34.129 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:34.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.130 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:03:34.130 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:34.130 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:34.130 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:34.130 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:34.131 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:34.131 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:03:34.131 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:34.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.131 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:03:34.132 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:34.132 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:34.132 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:34.132 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:34.132 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:34.133 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:03:34.133 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:34.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.133 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:03:34.133 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:03:34.134 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:03:34.134 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:03:34.134 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:03:34.134 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:03:34.134 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:03:34.135 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:03:34.135 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.135 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:34.135 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:03:34.135 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [ 2023-09-13T06:03:34.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.136 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.13", 2023-09-13T06:03:34.136 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:34.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.136 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:34.136 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 5 2023-09-13T06:03:34.137 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.137 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.137 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.137 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "7.32", 2023-09-13T06:03:34.138 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:03:34.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:34.138 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:03:34.138 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 4 2023-09-13T06:03:34.138 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.138 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:34.139 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.139 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:03:34.139 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:03:34.139 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:03:34.139 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:03:34.140 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:03:34.140 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:03:34.140 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:03:34.140 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:03:34.140 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:03:34.140 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:03:34.141 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:03:34.141 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:03:34.141 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:03:34.141 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:34.141 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:03:34.142 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:03:34.142 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:03:34.142 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:03:34.142 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:03:34.142 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:03:34.143 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:03:34.143 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:03:34.143 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:03:34.143 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:03:34.143 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:03:34.144 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:34.144 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:03:34.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 -- 172.21.15.130:0/2959954847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ab0065b20 msgr2=0x7f2ab0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:34.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ab0065b20 0x7f2ab0067fe0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80ae000 tx=0x7f2ac8008040 comp rx=0 tx=0).stop 2023-09-13T06:03:34.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 -- 172.21.15.130:0/2959954847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2acc0d1750 msgr2=0x7f2acc144e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:34.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2acc0d1750 0x7f2acc144e50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00d5d0 tx=0x7f2abc00da90 comp rx=0 tx=0).stop 2023-09-13T06:03:34.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 -- 172.21.15.130:0/2959954847 shutdown_connections 2023-09-13T06:03:34.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ab0065b20 0x7f2ab0067fe0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2acc0d1b30 0x7f2acc145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2acc0d1750 0x7f2acc144e50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 --2- 172.21.15.130:0/2959954847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2acc0d1090 0x7f2acc15a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 -- 172.21.15.130:0/2959954847 >> 172.21.15.130:0/2959954847 conn(0x7f2acc06f170 msgr2=0x7f2acc15f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:34.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 -- 172.21.15.130:0/2959954847 shutdown_connections 2023-09-13T06:03:34.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:33.939+0000 7f2ad4434640 1 -- 172.21.15.130:0/2959954847 wait complete. 2023-09-13T06:03:34.148 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:03:34.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e17967640 1 Processor -- start 2023-09-13T06:03:34.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e17967640 1 -- start start 2023-09-13T06:03:34.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e17967640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3e100d1750 0x7f3e1015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:34.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e17967640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3e100d1090 0x7f3e10146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:34.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e17967640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100b63c0 con 0x7f3e100d1b30 2023-09-13T06:03:34.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e17967640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1015dea0 con 0x7f3e100d1750 2023-09-13T06:03:34.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e17967640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e100d0c20 con 0x7f3e100d1090 2023-09-13T06:03:34.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e15f04640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3e100d1b30 0x7f3e100b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55162/0 (socket says 172.21.15.130:55162) 2023-09-13T06:03:34.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e15f04640 1 -- 172.21.15.130:0/1953764880 learned_addr learned my addr 172.21.15.130:0/1953764880 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:34.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e15703640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3e100d1750 0x7f3e1015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:34.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e14f02640 1 --2- 172.21.15.130:0/1953764880 >> v2:172.21.15.164:3300/0 conn(0x7f3e100d1090 0x7f3e10146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:34.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e15703640 1 -- 172.21.15.130:0/1953764880 >> v2:172.21.15.164:3300/0 conn(0x7f3e100d1090 msgr2=0x7f3e10146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:34.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e15703640 1 --2- 172.21.15.130:0/1953764880 >> v2:172.21.15.164:3300/0 conn(0x7f3e100d1090 0x7f3e10146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e15703640 1 -- 172.21.15.130:0/1953764880 >> v1:172.21.15.130:6789/0 conn(0x7f3e100d1b30 legacy=0x7f3e100b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:34.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e07fff640 1 -- 172.21.15.130:0/1953764880 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088249213 0 0) 0x7f3e100b63c0 con 0x7f3e100d1b30 2023-09-13T06:03:34.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.283+0000 7f3e15703640 1 -- 172.21.15.130:0/1953764880 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e100b6610 con 0x7f3e100d1750 2023-09-13T06:03:34.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e15703640 1 --2- 172.21.15.130:0/1953764880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e100d1750 0x7f3e1015d960 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3e100c8360 tx=0x7f3e0c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54094f510e4b4dc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:34.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e07fff640 1 -- 172.21.15.130:0/1953764880 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0a7070 con 0x7f3e100d1750 2023-09-13T06:03:34.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e07fff640 1 -- 172.21.15.130:0/1953764880 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c0ab430 con 0x7f3e100d1750 2023-09-13T06:03:34.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e07fff640 1 -- 172.21.15.130:0/1953764880 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0ab7c0 con 0x7f3e100d1750 2023-09-13T06:03:34.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e17967640 1 -- 172.21.15.130:0/1953764880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e100d1750 msgr2=0x7f3e1015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:34.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e17967640 1 --2- 172.21.15.130:0/1953764880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e100d1750 0x7f3e1015d960 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3e100c8360 tx=0x7f3e0c01c430 comp rx=0 tx=0).stop 2023-09-13T06:03:34.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e17967640 1 -- 172.21.15.130:0/1953764880 shutdown_connections 2023-09-13T06:03:34.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e17967640 1 --2- 172.21.15.130:0/1953764880 >> v2:172.21.15.164:3300/0 conn(0x7f3e100d1090 0x7f3e10146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e17967640 1 --2- 172.21.15.130:0/1953764880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e100d1750 0x7f3e1015d960 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e17967640 1 -- 172.21.15.130:0/1953764880 >> 172.21.15.130:0/1953764880 conn(0x7f3e1006f170 msgr2=0x7f3e1006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:34.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e17967640 1 -- 172.21.15.130:0/1953764880 shutdown_connections 2023-09-13T06:03:34.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.287+0000 7f3e17967640 1 -- 172.21.15.130:0/1953764880 wait complete. 2023-09-13T06:03:34.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e17967640 1 Processor -- start 2023-09-13T06:03:34.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e17967640 1 -- start start 2023-09-13T06:03:34.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e17967640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e100d1090 0x7f3e1015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:34.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e17967640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e100d1750 0x7f3e10167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:34.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e17967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e100d1b30 0x7f3e101416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:34.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e17967640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1015d5e0 con 0x7f3e100d1750 2023-09-13T06:03:34.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e17967640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e101635c0 con 0x7f3e100d1090 2023-09-13T06:03:34.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e17967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e10162520 con 0x7f3e100d1b30 2023-09-13T06:03:34.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e14f02640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e100d1750 0x7f3e10167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:34.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e14f02640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e100d1750 0x7f3e10167940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57270/0 (socket says 172.21.15.130:57270) 2023-09-13T06:03:34.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e14f02640 1 -- 172.21.15.130:0/2913068391 learned_addr learned my addr 172.21.15.130:0/2913068391 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:34.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e15f04640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e100d1b30 0x7f3e101416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:34.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e15703640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e100d1090 0x7f3e1015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:34.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e14f02640 1 -- 172.21.15.130:0/2913068391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e100d1b30 msgr2=0x7f3e101416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:34.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e14f02640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e100d1b30 0x7f3e101416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e14f02640 1 -- 172.21.15.130:0/2913068391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e100d1090 msgr2=0x7f3e1015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:34.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e14f02640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e100d1090 0x7f3e1015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e14f02640 1 -- 172.21.15.130:0/2913068391 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c009420 con 0x7f3e100d1750 2023-09-13T06:03:34.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e14f02640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e100d1750 0x7f3e10167940 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000d600 tx=0x7f3e0000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:34.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e05ffb640 1 -- 172.21.15.130:0/2913068391 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00004240 con 0x7f3e100d1750 2023-09-13T06:03:34.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e05ffb640 1 -- 172.21.15.130:0/2913068391 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e000043a0 con 0x7f3e100d1750 2023-09-13T06:03:34.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e17967640 1 -- 172.21.15.130:0/2913068391 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e10162800 con 0x7f3e100d1750 2023-09-13T06:03:34.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e05ffb640 1 -- 172.21.15.130:0/2913068391 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00003840 con 0x7f3e100d1750 2023-09-13T06:03:34.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.291+0000 7f3e17967640 1 -- 172.21.15.130:0/2913068391 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e10162dc0 con 0x7f3e100d1750 2023-09-13T06:03:34.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.295+0000 7f3e17967640 1 -- 172.21.15.130:0/2913068391 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e100618a0 con 0x7f3e100d1750 2023-09-13T06:03:34.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.295+0000 7f3e05ffb640 1 -- 172.21.15.130:0/2913068391 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3e000039a0 con 0x7f3e100d1750 2023-09-13T06:03:34.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.295+0000 7f3e05ffb640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3df4065b20 0x7f3df4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:34.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.295+0000 7f3e05ffb640 1 -- 172.21.15.130:0/2913068391 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3e000835f0 con 0x7f3e100d1750 2023-09-13T06:03:34.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.295+0000 7f3e15703640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3df4065b20 0x7f3df4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:34.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.295+0000 7f3e15703640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3df4065b20 0x7f3df4067fe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0af000 tx=0x7f3e0c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:34.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.299+0000 7f3e05ffb640 1 -- 172.21.15.130:0/2913068391 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3e00050dd0 con 0x7f3e100d1750 2023-09-13T06:03:34.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 -- 172.21.15.130:0/2913068391 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e100b86c0 con 0x7f3e100d1750 2023-09-13T06:03:34.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e05ffb640 1 -- 172.21.15.130:0/2913068391 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f3e00081e60 con 0x7f3e100d1750 2023-09-13T06:03:34.483 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:34.484 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2126646405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2126646405},{"type":"v1","addr":"172.21.15.164:6835","nonce":2126646405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1274935773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1274935773},{"type":"v1","addr":"172.21.15.164:6834","nonce":1274935773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/4174632972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4174632972},{"type":"v1","addr":"172.21.15.130:6836","nonce":4174632972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:54.919386+0000","modified":"2023-09-13T06:02:57.960043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5613":{"gid":5613,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1098709916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1098709916},{"type":"v1","addr":"172.21.15.130:6837","nonce":1098709916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-13T06:03:34.484 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 25 2023-09-13T06:03:34.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 -- 172.21.15.130:0/2913068391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3df4065b20 msgr2=0x7f3df4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:34.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3df4065b20 0x7f3df4067fe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0af000 tx=0x7f3e0c0a7000 comp rx=0 tx=0).stop 2023-09-13T06:03:34.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 -- 172.21.15.130:0/2913068391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e100d1750 msgr2=0x7f3e10167940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:34.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e100d1750 0x7f3e10167940 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000d600 tx=0x7f3e0000dac0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 -- 172.21.15.130:0/2913068391 shutdown_connections 2023-09-13T06:03:34.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3df4065b20 0x7f3df4067fe0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e100d1b30 0x7f3e101416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e100d1750 0x7f3e10167940 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 --2- 172.21.15.130:0/2913068391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e100d1090 0x7f3e1015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:34.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 -- 172.21.15.130:0/2913068391 >> 172.21.15.130:0/2913068391 conn(0x7f3e1006f170 msgr2=0x7f3e1015dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:34.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 -- 172.21.15.130:0/2913068391 shutdown_connections 2023-09-13T06:03:34.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:34.479+0000 7f3e17967640 1 -- 172.21.15.130:0/2913068391 wait complete. 2023-09-13T06:03:34.504 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-13T06:03:34.665 INFO:teuthology.orchestra.run.smithi130.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":5613,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":39.075091659999998,"mdsmap_epoch":25,"osdmap_epoch":54,"osdmap_epoch_barrier":51,"uptime":43.884643531999998} 2023-09-13T06:03:34.665 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 5613, "mdsmap_epoch": 25, "osdmap_epoch": 54, "osdmap_epoch_barrier": 51, "rank_uptime": 39.07509166, "state": "up:active", "uptime": 43.884643532, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:03:34.666 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-13T06:03:34.666 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:03:34.666 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:34.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:34.676 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-09-13T06:03:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records in 2023-09-13T06:03:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records out 2023-09-13T06:03:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.542034 s, 96.7 MB/s 2023-09-13T06:03:35.275 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:03:35.275 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:03:35.344 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:03:35.423 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:03:35.424 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:03:35.424 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:35.433 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:03:35.433 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:35.486 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:03:35.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.663+0000 7fed04093640 1 Processor -- start 2023-09-13T06:03:35.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed04093640 1 -- start start 2023-09-13T06:03:35.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed04093640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecfc15b130 0x7fecfc0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:35.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed04093640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fecfc0ce180 0x7fecfc15b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:35.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed04093640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecfc0ce980 con 0x7fecfc0b04a0 2023-09-13T06:03:35.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed04093640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecfc0cec60 con 0x7fecfc0ce180 2023-09-13T06:03:35.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed04093640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc06c640 con 0x7fecfc15b130 2023-09-13T06:03:35.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed02630640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fecfc0b04a0 0x7fecfc06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55172/0 (socket says 172.21.15.130:55172) 2023-09-13T06:03:35.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed02630640 1 -- 172.21.15.130:0/3591755463 learned_addr learned my addr 172.21.15.130:0/3591755463 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:35.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed0162e640 1 --2- 172.21.15.130:0/3591755463 >> v2:172.21.15.164:3300/0 conn(0x7fecfc0ce180 0x7fecfc15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:35.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed01e2f640 1 --2- 172.21.15.130:0/3591755463 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecfc15b130 0x7fecfc0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:35.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed00e2d640 1 -- 172.21.15.130:0/3591755463 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962286675 0 0) 0x7fecfc0ce980 con 0x7fecfc0b04a0 2023-09-13T06:03:35.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed00e2d640 1 -- 172.21.15.130:0/3591755463 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece8003530 con 0x7fecfc0b04a0 2023-09-13T06:03:35.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed01e2f640 1 -- 172.21.15.130:0/3591755463 >> v2:172.21.15.164:3300/0 conn(0x7fecfc0ce180 msgr2=0x7fecfc15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:35.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed01e2f640 1 --2- 172.21.15.130:0/3591755463 >> v2:172.21.15.164:3300/0 conn(0x7fecfc0ce180 0x7fecfc15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:35.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed01e2f640 1 -- 172.21.15.130:0/3591755463 >> v1:172.21.15.130:6789/0 conn(0x7fecfc0b04a0 legacy=0x7fecfc06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:35.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed01e2f640 1 -- 172.21.15.130:0/3591755463 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc06c920 con 0x7fecfc15b130 2023-09-13T06:03:35.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.667+0000 7fed0162e640 1 --2- 172.21.15.130:0/3591755463 >> v2:172.21.15.164:3300/0 conn(0x7fecfc0ce180 0x7fecfc15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:35.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed01e2f640 1 --2- 172.21.15.130:0/3591755463 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecfc15b130 0x7fecfc0cc780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fecf80097c0 tx=0x7fecf801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeecf6ffd2e7269f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:35.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed00e2d640 1 -- 172.21.15.130:0/3591755463 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf80ac410 con 0x7fecfc15b130 2023-09-13T06:03:35.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed00e2d640 1 -- 172.21.15.130:0/3591755463 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf80ac570 con 0x7fecfc15b130 2023-09-13T06:03:35.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed00e2d640 1 -- 172.21.15.130:0/3591755463 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf80ac900 con 0x7fecfc15b130 2023-09-13T06:03:35.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed04093640 1 -- 172.21.15.130:0/3591755463 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecfc15b130 msgr2=0x7fecfc0cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:35.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed04093640 1 --2- 172.21.15.130:0/3591755463 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecfc15b130 0x7fecfc0cc780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fecf80097c0 tx=0x7fecf801c480 comp rx=0 tx=0).stop 2023-09-13T06:03:35.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed04093640 1 -- 172.21.15.130:0/3591755463 shutdown_connections 2023-09-13T06:03:35.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed04093640 1 --2- 172.21.15.130:0/3591755463 >> v2:172.21.15.164:3300/0 conn(0x7fecfc0ce180 0x7fecfc15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:35.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed04093640 1 --2- 172.21.15.130:0/3591755463 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecfc15b130 0x7fecfc0cc780 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:35.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed04093640 1 -- 172.21.15.130:0/3591755463 >> 172.21.15.130:0/3591755463 conn(0x7fecfc065990 msgr2=0x7fecfc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:35.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed04093640 1 -- 172.21.15.130:0/3591755463 shutdown_connections 2023-09-13T06:03:35.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed04093640 1 -- 172.21.15.130:0/3591755463 wait complete. 2023-09-13T06:03:35.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.671+0000 7fed04093640 1 Processor -- start 2023-09-13T06:03:35.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed04093640 1 -- start start 2023-09-13T06:03:35.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed04093640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecfc0b04a0 0x7fecfc0acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:35.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed04093640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecfc0ce180 0x7fecfc147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:35.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed04093640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecfc15b130 0x7fecfc147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:35.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed04093640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc15bd20 con 0x7fecfc0b04a0 2023-09-13T06:03:35.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed04093640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc156540 con 0x7fecfc0ce180 2023-09-13T06:03:35.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed04093640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc156820 con 0x7fecfc15b130 2023-09-13T06:03:35.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed01e2f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecfc0b04a0 0x7fecfc0acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:35.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed01e2f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecfc0b04a0 0x7fecfc0acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57286/0 (socket says 172.21.15.130:57286) 2023-09-13T06:03:35.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed01e2f640 1 -- 172.21.15.130:0/473388903 learned_addr learned my addr 172.21.15.130:0/473388903 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:35.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed0162e640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecfc0ce180 0x7fecfc147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:35.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed02630640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecfc15b130 0x7fecfc147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:35.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed01e2f640 1 -- 172.21.15.130:0/473388903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecfc15b130 msgr2=0x7fecfc147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:35.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed01e2f640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecfc15b130 0x7fecfc147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:35.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed01e2f640 1 -- 172.21.15.130:0/473388903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecfc0ce180 msgr2=0x7fecfc147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:35.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed01e2f640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecfc0ce180 0x7fecfc147850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:35.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed01e2f640 1 -- 172.21.15.130:0/473388903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec009420 con 0x7fecfc0b04a0 2023-09-13T06:03:35.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed01e2f640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecfc0b04a0 0x7fecfc0acad0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fecf80af040 tx=0x7fecf8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:35.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fecf27fc640 1 -- 172.21.15.130:0/473388903 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8006e20 con 0x7fecfc0b04a0 2023-09-13T06:03:35.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fecf27fc640 1 -- 172.21.15.130:0/473388903 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf80ace00 con 0x7fecfc0b04a0 2023-09-13T06:03:35.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed04093640 1 -- 172.21.15.130:0/473388903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf8009420 con 0x7fecfc0b04a0 2023-09-13T06:03:35.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fecf27fc640 1 -- 172.21.15.130:0/473388903 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf80b5880 con 0x7fecfc0b04a0 2023-09-13T06:03:35.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed04093640 1 -- 172.21.15.130:0/473388903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc0b0e40 con 0x7fecfc0b04a0 2023-09-13T06:03:35.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.675+0000 7fed04093640 1 -- 172.21.15.130:0/473388903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc0618a0 con 0x7fecfc0b04a0 2023-09-13T06:03:35.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.679+0000 7fecf27fc640 1 -- 172.21.15.130:0/473388903 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fecf80b3040 con 0x7fecfc0b04a0 2023-09-13T06:03:35.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.679+0000 7fecf27fc640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fece0065b20 0x7fece0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:35.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.679+0000 7fecf27fc640 1 -- 172.21.15.130:0/473388903 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fecf811cfc0 con 0x7fecfc0b04a0 2023-09-13T06:03:35.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.679+0000 7fed0162e640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fece0065b20 0x7fece0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:35.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.679+0000 7fed0162e640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fece0065b20 0x7fece0067fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fecfc15a680 tx=0x7fecec009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:35.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.683+0000 7fecf27fc640 1 -- 172.21.15.130:0/473388903 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fecf80ea8e0 con 0x7fecfc0b04a0 2023-09-13T06:03:35.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.831+0000 7fed04093640 1 -- 172.21.15.130:0/473388903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecfc15a3d0 con 0x7fecfc0b04a0 2023-09-13T06:03:35.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fecf27fc640 1 -- 172.21.15.130:0/473388903 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16641 (secure 0 0 0) 0x7fecf80b1020 con 0x7fecfc0b04a0 2023-09-13T06:03:35.838 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:35.838 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":54,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:03:31.332756+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:53.311861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:53.919645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:03:35.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 -- 172.21.15.130:0/473388903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fece0065b20 msgr2=0x7fece0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:35.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fece0065b20 0x7fece0067fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fecfc15a680 tx=0x7fecec009190 comp rx=0 tx=0).stop 2023-09-13T06:03:35.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 -- 172.21.15.130:0/473388903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecfc0b04a0 msgr2=0x7fecfc0acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:35.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecfc0b04a0 0x7fecfc0acad0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fecf80af040 tx=0x7fecf8019220 comp rx=0 tx=0).stop 2023-09-13T06:03:35.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 -- 172.21.15.130:0/473388903 shutdown_connections 2023-09-13T06:03:35.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fece0065b20 0x7fece0067fe0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:35.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecfc0ce180 0x7fecfc147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:35.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecfc15b130 0x7fecfc147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:35.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 --2- 172.21.15.130:0/473388903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecfc0b04a0 0x7fecfc0acad0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:35.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 -- 172.21.15.130:0/473388903 >> 172.21.15.130:0/473388903 conn(0x7fecfc065990 msgr2=0x7fecfc151b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:35.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 -- 172.21.15.130:0/473388903 shutdown_connections 2023-09-13T06:03:35.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.835+0000 7fed04093640 1 -- 172.21.15.130:0/473388903 wait complete. 2023-09-13T06:03:35.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:02:53.311861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:02:53.919645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:03:35.859 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:03:36.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.995+0000 7ff04b52c640 1 Processor -- start 2023-09-13T06:03:36.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.995+0000 7ff04b52c640 1 -- start start 2023-09-13T06:03:36.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff04b52c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff0441617f0 0x7ff0440cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff04b52c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0440cc880 0x7ff0440ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff04b52c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0440b2620 con 0x7ff0440ce6c0 2023-09-13T06:03:36.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff04b52c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440b1a80 con 0x7ff0441617f0 2023-09-13T06:03:36.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff04b52c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440ccce0 con 0x7ff0440cc880 2023-09-13T06:03:36.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff049ac9640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff0440ce6c0 0x7ff0440b4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55176/0 (socket says 172.21.15.130:55176) 2023-09-13T06:03:36.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff049ac9640 1 -- 172.21.15.130:0/2768617778 learned_addr learned my addr 172.21.15.130:0/2768617778 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:36.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff0492c8640 1 --2- 172.21.15.130:0/2768617778 >> v2:172.21.15.164:3300/0 conn(0x7ff0441617f0 0x7ff0440cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff048ac7640 1 --2- 172.21.15.130:0/2768617778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0440cc880 0x7ff0440ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff03bfff640 1 -- 172.21.15.130:0/2768617778 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279396991 0 0) 0x7ff0440b2620 con 0x7ff0440ce6c0 2023-09-13T06:03:36.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff03bfff640 1 -- 172.21.15.130:0/2768617778 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff030003530 con 0x7ff0440ce6c0 2023-09-13T06:03:36.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff048ac7640 1 -- 172.21.15.130:0/2768617778 >> v2:172.21.15.164:3300/0 conn(0x7ff0441617f0 msgr2=0x7ff0440cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:36.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff048ac7640 1 --2- 172.21.15.130:0/2768617778 >> v2:172.21.15.164:3300/0 conn(0x7ff0441617f0 0x7ff0440cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff048ac7640 1 -- 172.21.15.130:0/2768617778 >> v1:172.21.15.130:6789/0 conn(0x7ff0440ce6c0 legacy=0x7ff0440b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff048ac7640 1 -- 172.21.15.130:0/2768617778 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0440b2ab0 con 0x7ff0440cc880 2023-09-13T06:03:36.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:35.999+0000 7ff048ac7640 1 --2- 172.21.15.130:0/2768617778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0440cc880 0x7ff0440ce180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0340097c0 tx=0x7ff03401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fffe3ac317b8507 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff03bfff640 1 -- 172.21.15.130:0/2768617778 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0340ad660 con 0x7ff0440cc880 2023-09-13T06:03:36.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff03bfff640 1 -- 172.21.15.130:0/2768617778 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0340ad7c0 con 0x7ff0440cc880 2023-09-13T06:03:36.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff03bfff640 1 -- 172.21.15.130:0/2768617778 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0340adb30 con 0x7ff0440cc880 2023-09-13T06:03:36.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 -- 172.21.15.130:0/2768617778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0440cc880 msgr2=0x7ff0440ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 --2- 172.21.15.130:0/2768617778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0440cc880 0x7ff0440ce180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0340097c0 tx=0x7ff03401c450 comp rx=0 tx=0).stop 2023-09-13T06:03:36.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 -- 172.21.15.130:0/2768617778 shutdown_connections 2023-09-13T06:03:36.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 --2- 172.21.15.130:0/2768617778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0440cc880 0x7ff0440ce180 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 --2- 172.21.15.130:0/2768617778 >> v2:172.21.15.164:3300/0 conn(0x7ff0441617f0 0x7ff0440cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 -- 172.21.15.130:0/2768617778 >> 172.21.15.130:0/2768617778 conn(0x7ff044065990 msgr2=0x7ff044065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:36.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 -- 172.21.15.130:0/2768617778 shutdown_connections 2023-09-13T06:03:36.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 -- 172.21.15.130:0/2768617778 wait complete. 2023-09-13T06:03:36.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 Processor -- start 2023-09-13T06:03:36.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 -- start start 2023-09-13T06:03:36.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0440cc880 0x7ff04415f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0440ce6c0 0x7ff0441569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0441617f0 0x7ff044156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04415d3e0 con 0x7ff0441617f0 2023-09-13T06:03:36.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04415df60 con 0x7ff0440cc880 2023-09-13T06:03:36.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.003+0000 7ff04b52c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04415d630 con 0x7ff0440ce6c0 2023-09-13T06:03:36.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff049ac9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0441617f0 0x7ff044156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff049ac9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0441617f0 0x7ff044156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57300/0 (socket says 172.21.15.130:57300) 2023-09-13T06:03:36.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff049ac9640 1 -- 172.21.15.130:0/3488659674 learned_addr learned my addr 172.21.15.130:0/3488659674 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:36.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff048ac7640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0440ce6c0 0x7ff0441569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff0492c8640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0440cc880 0x7ff04415f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff049ac9640 1 -- 172.21.15.130:0/3488659674 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0440ce6c0 msgr2=0x7ff0441569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff049ac9640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0440ce6c0 0x7ff0441569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff049ac9640 1 -- 172.21.15.130:0/3488659674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0440cc880 msgr2=0x7ff04415f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff049ac9640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0440cc880 0x7ff04415f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff049ac9640 1 -- 172.21.15.130:0/3488659674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034009420 con 0x7ff0441617f0 2023-09-13T06:03:36.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff049ac9640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0441617f0 0x7ff044156ef0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00cb70 tx=0x7ff03c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff039ffb640 1 -- 172.21.15.130:0/3488659674 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00ad40 con 0x7ff0441617f0 2023-09-13T06:03:36.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff039ffb640 1 -- 172.21.15.130:0/3488659674 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c012400 con 0x7ff0441617f0 2023-09-13T06:03:36.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff04b52c640 1 -- 172.21.15.130:0/3488659674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04415d910 con 0x7ff0441617f0 2023-09-13T06:03:36.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff039ffb640 1 -- 172.21.15.130:0/3488659674 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00aea0 con 0x7ff0441617f0 2023-09-13T06:03:36.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff04b52c640 1 -- 172.21.15.130:0/3488659674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04415fc20 con 0x7ff0441617f0 2023-09-13T06:03:36.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff04b52c640 1 -- 172.21.15.130:0/3488659674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0440618a0 con 0x7ff0441617f0 2023-09-13T06:03:36.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.007+0000 7ff039ffb640 1 -- 172.21.15.130:0/3488659674 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff03c007070 con 0x7ff0441617f0 2023-09-13T06:03:36.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.011+0000 7ff039ffb640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff028065b20 0x7ff028067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.011+0000 7ff039ffb640 1 -- 172.21.15.130:0/3488659674 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff03c0832a0 con 0x7ff0441617f0 2023-09-13T06:03:36.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.011+0000 7ff0492c8640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff028065b20 0x7ff028067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.011+0000 7ff0492c8640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff028065b20 0x7ff028067fe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff040009ac0 tx=0x7ff040009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.015+0000 7ff039ffb640 1 -- 172.21.15.130:0/3488659674 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff03c050c60 con 0x7ff0441617f0 2023-09-13T06:03:36.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.159+0000 7ff04b52c640 1 -- 172.21.15.130:0/3488659674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff04415e0a0 con 0x7ff0441617f0 2023-09-13T06:03:36.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff039ffb640 1 -- 172.21.15.130:0/3488659674 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff03c017020 con 0x7ff0441617f0 2023-09-13T06:03:36.166 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:03:36.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 -- 172.21.15.130:0/3488659674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff028065b20 msgr2=0x7ff028067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff028065b20 0x7ff028067fe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff040009ac0 tx=0x7ff040009190 comp rx=0 tx=0).stop 2023-09-13T06:03:36.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 -- 172.21.15.130:0/3488659674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0441617f0 msgr2=0x7ff044156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0441617f0 0x7ff044156ef0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00cb70 tx=0x7ff03c00a430 comp rx=0 tx=0).stop 2023-09-13T06:03:36.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 -- 172.21.15.130:0/3488659674 shutdown_connections 2023-09-13T06:03:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff028065b20 0x7ff028067fe0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0441617f0 0x7ff044156ef0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0440ce6c0 0x7ff0441569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 --2- 172.21.15.130:0/3488659674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0440cc880 0x7ff04415f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 -- 172.21.15.130:0/3488659674 >> 172.21.15.130:0/3488659674 conn(0x7ff044065990 msgr2=0x7ff04415b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 -- 172.21.15.130:0/3488659674 shutdown_connections 2023-09-13T06:03:36.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.163+0000 7ff04b52c640 1 -- 172.21.15.130:0/3488659674 wait complete. 2023-09-13T06:03:36.186 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:03:36.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c15e6a640 1 Processor -- start 2023-09-13T06:03:36.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c15e6a640 1 -- start start 2023-09-13T06:03:36.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c15e6a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7c10144d70 0x7f7c100ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c15e6a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100b1b70 0x7f7c100b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c15e6a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c100b3120 con 0x7f7c100b2780 2023-09-13T06:03:36.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c15e6a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100b2430 con 0x7f7c10144d70 2023-09-13T06:03:36.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c15e6a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100cedb0 con 0x7f7c100b1b70 2023-09-13T06:03:36.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c0f7fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7c10144d70 0x7f7c100ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c0ffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100b1b70 0x7f7c100b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c0f7fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7c10144d70 0x7f7c100ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:55156/0 (socket says 172.21.15.130:55156) 2023-09-13T06:03:36.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c0f7fe640 1 -- 172.21.15.130:0/322966919 learned_addr learned my addr 172.21.15.130:0/322966919 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:36.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c0effd640 1 --1- 172.21.15.130:0/322966919 >> v1:172.21.15.164:6789/0 conn(0x7f7c100b2780 0x7f7c100b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:46146/0 (socket says 172.21.15.130:46146) 2023-09-13T06:03:36.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c0ffff640 1 -- 172.21.15.130:0/322966919 >> v2:172.21.15.164:3300/0 conn(0x7f7c10144d70 msgr2=0x7f7c100ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:36.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c0ffff640 1 --2- 172.21.15.130:0/322966919 >> v2:172.21.15.164:3300/0 conn(0x7f7c10144d70 0x7f7c100ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c0ffff640 1 -- 172.21.15.130:0/322966919 >> v1:172.21.15.164:6789/0 conn(0x7f7c100b2780 legacy=0x7f7c100b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c0ffff640 1 -- 172.21.15.130:0/322966919 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100b2150 con 0x7f7c100b1b70 2023-09-13T06:03:36.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c0e7fc640 1 -- 172.21.15.130:0/322966919 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142099858 0 0) 0x7f7c100b3120 con 0x7f7c100b2780 2023-09-13T06:03:36.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.323+0000 7f7c0f7fe640 1 --2- 172.21.15.130:0/322966919 >> v2:172.21.15.164:3300/0 conn(0x7f7c10144d70 0x7f7c100ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:36.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c0ffff640 1 --2- 172.21.15.130:0/322966919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100b1b70 0x7f7c100b2be0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009d90 tx=0x7f7c0801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=344896ccc2273730 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c0e7fc640 1 -- 172.21.15.130:0/322966919 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080a5900 con 0x7f7c100b1b70 2023-09-13T06:03:36.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c0e7fc640 1 -- 172.21.15.130:0/322966919 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c080a5a60 con 0x7f7c100b1b70 2023-09-13T06:03:36.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c0e7fc640 1 -- 172.21.15.130:0/322966919 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080a5df0 con 0x7f7c100b1b70 2023-09-13T06:03:36.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c15e6a640 1 -- 172.21.15.130:0/322966919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100b1b70 msgr2=0x7f7c100b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c15e6a640 1 --2- 172.21.15.130:0/322966919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100b1b70 0x7f7c100b2be0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009d90 tx=0x7f7c0801c950 comp rx=0 tx=0).stop 2023-09-13T06:03:36.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c15e6a640 1 -- 172.21.15.130:0/322966919 shutdown_connections 2023-09-13T06:03:36.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c15e6a640 1 --2- 172.21.15.130:0/322966919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100b1b70 0x7f7c100b2be0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c15e6a640 1 --2- 172.21.15.130:0/322966919 >> v2:172.21.15.164:3300/0 conn(0x7f7c10144d70 0x7f7c100ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c15e6a640 1 -- 172.21.15.130:0/322966919 >> 172.21.15.130:0/322966919 conn(0x7f7c10065990 msgr2=0x7f7c10065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:36.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c15e6a640 1 -- 172.21.15.130:0/322966919 shutdown_connections 2023-09-13T06:03:36.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.327+0000 7f7c15e6a640 1 -- 172.21.15.130:0/322966919 wait complete. 2023-09-13T06:03:36.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c15e6a640 1 Processor -- start 2023-09-13T06:03:36.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c15e6a640 1 -- start start 2023-09-13T06:03:36.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c15e6a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100b1b70 0x7f7c1013d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c15e6a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c100b2780 0x7f7c10155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c15e6a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c10144d70 0x7f7c1015cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c15e6a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10156410 con 0x7f7c100b2780 2023-09-13T06:03:36.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c15e6a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1013db20 con 0x7f7c10144d70 2023-09-13T06:03:36.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c15e6a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1013ba10 con 0x7f7c100b1b70 2023-09-13T06:03:36.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c100b2780 0x7f7c10155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c100b2780 0x7f7c10155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57310/0 (socket says 172.21.15.130:57310) 2023-09-13T06:03:36.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0effd640 1 -- 172.21.15.130:0/142728233 learned_addr learned my addr 172.21.15.130:0/142728233 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:36.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0f7fe640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100b1b70 0x7f7c1013d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0ffff640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c10144d70 0x7f7c1015cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0effd640 1 -- 172.21.15.130:0/142728233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100b1b70 msgr2=0x7f7c1013d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0effd640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100b1b70 0x7f7c1013d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0effd640 1 -- 172.21.15.130:0/142728233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c10144d70 msgr2=0x7f7c1015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0effd640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c10144d70 0x7f7c1015cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0effd640 1 -- 172.21.15.130:0/142728233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c000094d0 con 0x7f7c100b2780 2023-09-13T06:03:36.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0ffff640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c10144d70 0x7f7c1015cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:36.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c0effd640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c100b2780 0x7f7c10155ca0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7c040011f0 tx=0x7f7c0400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7bf7fff640 1 -- 172.21.15.130:0/142728233 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c040074e0 con 0x7f7c100b2780 2023-09-13T06:03:36.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7bf7fff640 1 -- 172.21.15.130:0/142728233 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04007640 con 0x7f7c100b2780 2023-09-13T06:03:36.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7bf7fff640 1 -- 172.21.15.130:0/142728233 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04004a10 con 0x7f7c100b2780 2023-09-13T06:03:36.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c15e6a640 1 -- 172.21.15.130:0/142728233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c08009a70 con 0x7f7c100b2780 2023-09-13T06:03:36.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.331+0000 7f7c15e6a640 1 -- 172.21.15.130:0/142728233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c100b03c0 con 0x7f7c100b2780 2023-09-13T06:03:36.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.335+0000 7f7c15e6a640 1 -- 172.21.15.130:0/142728233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c100618a0 con 0x7f7c100b2780 2023-09-13T06:03:36.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.335+0000 7f7bf7fff640 1 -- 172.21.15.130:0/142728233 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7c04004b70 con 0x7f7c100b2780 2023-09-13T06:03:36.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.335+0000 7f7bf7fff640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bfc065b20 0x7f7bfc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.335+0000 7f7bf7fff640 1 -- 172.21.15.130:0/142728233 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7c040825b0 con 0x7f7c100b2780 2023-09-13T06:03:36.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.335+0000 7f7c0f7fe640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bfc065b20 0x7f7bfc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.335+0000 7f7c0f7fe640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bfc065b20 0x7f7bfc067fe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7c00006cb0 tx=0x7f7c00009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.339+0000 7f7bf7fff640 1 -- 172.21.15.130:0/142728233 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7c0404fed0 con 0x7f7c100b2780 2023-09-13T06:03:36.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 -- 172.21.15.130:0/142728233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c100b51d0 con 0x7f7c100b2780 2023-09-13T06:03:36.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7bf7fff640 1 -- 172.21.15.130:0/142728233 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c040534f0 con 0x7f7c100b2780 2023-09-13T06:03:36.492 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:03:36.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 -- 172.21.15.130:0/142728233 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bfc065b20 msgr2=0x7f7bfc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bfc065b20 0x7f7bfc067fe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7c00006cb0 tx=0x7f7c00009240 comp rx=0 tx=0).stop 2023-09-13T06:03:36.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 -- 172.21.15.130:0/142728233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c100b2780 msgr2=0x7f7c10155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c100b2780 0x7f7c10155ca0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7c040011f0 tx=0x7f7c0400c9b0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 -- 172.21.15.130:0/142728233 shutdown_connections 2023-09-13T06:03:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7bfc065b20 0x7f7bfc067fe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c10144d70 0x7f7c1015cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c100b2780 0x7f7c10155ca0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 --2- 172.21.15.130:0/142728233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c100b1b70 0x7f7c1013d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 -- 172.21.15.130:0/142728233 >> 172.21.15.130:0/142728233 conn(0x7f7c10065990 msgr2=0x7f7c1006dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 -- 172.21.15.130:0/142728233 shutdown_connections 2023-09-13T06:03:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.487+0000 7f7c15e6a640 1 -- 172.21.15.130:0/142728233 wait complete. 2023-09-13T06:03:36.512 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:03:36.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.647+0000 7f8eb5e19640 1 Processor -- start 2023-09-13T06:03:36.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.647+0000 7f8eb5e19640 1 -- start start 2023-09-13T06:03:36.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eb5e19640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8eb0147030 0x7f8eb006fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eb5e19640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb006b8c0 con 0x7f8eb00ac840 2023-09-13T06:03:36.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eb5e19640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb006c160 con 0x7f8eb006d5a0 2023-09-13T06:03:36.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eb5e19640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb006da30 con 0x7f8eb0147030 2023-09-13T06:03:36.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f8eb00ac840 0x7f8eb00715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55178/0 (socket says 172.21.15.130:55178) 2023-09-13T06:03:36.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaffff640 1 -- 172.21.15.130:0/703997267 learned_addr learned my addr 172.21.15.130:0/703997267 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:36.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaf7fe640 1 --2- 172.21.15.130:0/703997267 >> v2:172.21.15.164:3300/0 conn(0x7f8eb0147030 0x7f8eb006fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114570265 0 0) 0x7f8eb006b8c0 con 0x7f8eb00ac840 2023-09-13T06:03:36.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e9c003530 con 0x7f8eb00ac840 2023-09-13T06:03:36.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176621835 0 0) 0x7f8e9c003530 con 0x7f8eb00ac840 2023-09-13T06:03:36.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 >> v2:172.21.15.164:3300/0 conn(0x7f8eb0147030 msgr2=0x7f8eb006fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:36.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 --2- 172.21.15.130:0/703997267 >> v2:172.21.15.164:3300/0 conn(0x7f8eb0147030 0x7f8eb006fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 >> v1:172.21.15.164:6789/0 conn(0x7f8eb006d5a0 legacy=0x7f8eb006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb006bb10 con 0x7f8eb00ac840 2023-09-13T06:03:36.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f8ea8001a00 con 0x7f8eb00ac840 2023-09-13T06:03:36.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 >> v1:172.21.15.130:6789/0 conn(0x7f8eb00ac840 legacy=0x7f8eb00715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 --2- 172.21.15.130:0/703997267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e9c0039f0 0x7f8e9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 --2- 172.21.15.130:0/703997267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e9c0047d0 0x7f8e9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 --2- 172.21.15.130:0/703997267 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e9c005200 0x7f8e9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb006da30 con 0x7f8e9c0047d0 2023-09-13T06:03:36.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c00c160 con 0x7f8e9c0039f0 2023-09-13T06:03:36.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c00c320 con 0x7f8e9c005200 2023-09-13T06:03:36.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaf7fe640 1 --2- 172.21.15.130:0/703997267 >> v2:172.21.15.164:3300/0 conn(0x7f8eb0147030 0x7f8eb006fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:36.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8ea7fff640 1 --2- 172.21.15.130:0/703997267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e9c0047d0 0x7f8e9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaffff640 1 --2- 172.21.15.130:0/703997267 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e9c005200 0x7f8e9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaf7fe640 1 --2- 172.21.15.130:0/703997267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e9c0039f0 0x7f8e9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8ea7fff640 1 -- 172.21.15.130:0/703997267 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e9c005200 msgr2=0x7f8e9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:36.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8ea7fff640 1 --2- 172.21.15.130:0/703997267 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e9c005200 0x7f8e9c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8ea7fff640 1 -- 172.21.15.130:0/703997267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e9c0039f0 msgr2=0x7f8e9c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:36.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8ea7fff640 1 --2- 172.21.15.130:0/703997267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e9c0039f0 0x7f8e9c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8ea7fff640 1 -- 172.21.15.130:0/703997267 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c003530 con 0x7f8e9c0047d0 2023-09-13T06:03:36.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.651+0000 7f8eaffff640 1 -- 172.21.15.130:0/703997267 reap_dead start 2023-09-13T06:03:36.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.655+0000 7f8ea7fff640 1 --2- 172.21.15.130:0/703997267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e9c0047d0 0x7f8e9c004c50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8e98001780 tx=0x7f8e9801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410546ce7ec36c7c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.655+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980050d0 con 0x7f8e9c0047d0 2023-09-13T06:03:36.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.655+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98005250 con 0x7f8e9c0047d0 2023-09-13T06:03:36.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.655+0000 7f8eaeffd640 1 -- 172.21.15.130:0/703997267 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98003600 con 0x7f8e9c0047d0 2023-09-13T06:03:36.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.655+0000 7f8eb5e19640 1 -- 172.21.15.130:0/703997267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e9c0047d0 msgr2=0x7f8e9c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.655+0000 7f8eb5e19640 1 --2- 172.21.15.130:0/703997267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e9c0047d0 0x7f8e9c004c50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8e98001780 tx=0x7f8e9801c3e0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.655+0000 7f8eb5e19640 1 -- 172.21.15.130:0/703997267 shutdown_connections 2023-09-13T06:03:36.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.655+0000 7f8eb5e19640 1 --2- 172.21.15.130:0/703997267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e9c0047d0 0x7f8e9c004c50 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.655+0000 7f8eb5e19640 1 -- 172.21.15.130:0/703997267 >> 172.21.15.130:0/703997267 conn(0x7f8eb00b0550 msgr2=0x7f8eb00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:36.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.655+0000 7f8eb5e19640 1 -- 172.21.15.130:0/703997267 shutdown_connections 2023-09-13T06:03:36.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.655+0000 7f8eb5e19640 1 -- 172.21.15.130:0/703997267 wait complete. 2023-09-13T06:03:36.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eb5e19640 1 Processor -- start 2023-09-13T06:03:36.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eb5e19640 1 -- start start 2023-09-13T06:03:36.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eb5e19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e9c0047d0 0x7f8eb0137e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eb5e19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8eb0138b90 0x7f8eb0142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eb5e19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb01385b0 0x7f8eb0143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eb5e19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0145d90 con 0x7f8eb01385b0 2023-09-13T06:03:36.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eb5e19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb01383c0 con 0x7f8e9c0047d0 2023-09-13T06:03:36.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eb5e19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb01454f0 con 0x7f8eb0138b90 2023-09-13T06:03:36.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e9c0047d0 0x7f8eb0137e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e9c0047d0 0x7f8eb0137e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:55188/0 (socket says 172.21.15.130:55188) 2023-09-13T06:03:36.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eaf7fe640 1 -- 172.21.15.130:0/3703488762 learned_addr learned my addr 172.21.15.130:0/3703488762 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:36.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eaffff640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb01385b0 0x7f8eb0143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8ea7fff640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8eb0138b90 0x7f8eb0142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eaffff640 1 -- 172.21.15.130:0/3703488762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8eb0138b90 msgr2=0x7f8eb0142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eaffff640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8eb0138b90 0x7f8eb0142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eaffff640 1 -- 172.21.15.130:0/3703488762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e9c0047d0 msgr2=0x7f8eb0137e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eaffff640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e9c0047d0 0x7f8eb0137e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eaffff640 1 -- 172.21.15.130:0/3703488762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb01457d0 con 0x7f8eb01385b0 2023-09-13T06:03:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eaf7fe640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e9c0047d0 0x7f8eb0137e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eaffff640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb01385b0 0x7f8eb0143470 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00668d0 tx=0x7f8ea8007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eacff9640 1 -- 172.21.15.130:0/3703488762 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800ab70 con 0x7f8eb01385b0 2023-09-13T06:03:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eacff9640 1 -- 172.21.15.130:0/3703488762 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea800acd0 con 0x7f8eb01385b0 2023-09-13T06:03:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eacff9640 1 -- 172.21.15.130:0/3703488762 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8013630 con 0x7f8eb01385b0 2023-09-13T06:03:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eb5e19640 1 -- 172.21.15.130:0/3703488762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb0145ab0 con 0x7f8eb01385b0 2023-09-13T06:03:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eb5e19640 1 -- 172.21.15.130:0/3703488762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb0144f60 con 0x7f8eb01385b0 2023-09-13T06:03:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.659+0000 7f8eb5e19640 1 -- 172.21.15.130:0/3703488762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb00adbe0 con 0x7f8eb01385b0 2023-09-13T06:03:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.663+0000 7f8eacff9640 1 -- 172.21.15.130:0/3703488762 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8ea8013790 con 0x7f8eb01385b0 2023-09-13T06:03:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.663+0000 7f8eacff9640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e90065b50 0x7f8e90068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.663+0000 7f8eacff9640 1 -- 172.21.15.130:0/3703488762 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8ea8083880 con 0x7f8eb01385b0 2023-09-13T06:03:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.663+0000 7f8eaf7fe640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e90065b50 0x7f8e90068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.663+0000 7f8eaf7fe640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e90065b50 0x7f8e90068010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0014620 tx=0x7f8ea0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.667+0000 7f8eacff9640 1 -- 172.21.15.130:0/3703488762 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8eb00adbe0 con 0x7f8eb01385b0 2023-09-13T06:03:36.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 -- 172.21.15.130:0/3703488762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8eb00adbe0 con 0x7f8eb01385b0 2023-09-13T06:03:36.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eacff9640 1 -- 172.21.15.130:0/3703488762 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8eb00adbe0 con 0x7f8eb01385b0 2023-09-13T06:03:36.819 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:03:36.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 -- 172.21.15.130:0/3703488762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e90065b50 msgr2=0x7f8e90068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e90065b50 0x7f8e90068010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0014620 tx=0x7f8ea0009190 comp rx=0 tx=0).stop 2023-09-13T06:03:36.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 -- 172.21.15.130:0/3703488762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb01385b0 msgr2=0x7f8eb0143470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb01385b0 0x7f8eb0143470 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00668d0 tx=0x7f8ea8007b00 comp rx=0 tx=0).stop 2023-09-13T06:03:36.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 -- 172.21.15.130:0/3703488762 shutdown_connections 2023-09-13T06:03:36.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e90065b50 0x7f8e90068010 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb01385b0 0x7f8eb0143470 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8eb0138b90 0x7f8eb0142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 --2- 172.21.15.130:0/3703488762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e9c0047d0 0x7f8eb0137e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 -- 172.21.15.130:0/3703488762 >> 172.21.15.130:0/3703488762 conn(0x7f8eb00b0550 msgr2=0x7f8eb015f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:36.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 -- 172.21.15.130:0/3703488762 shutdown_connections 2023-09-13T06:03:36.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.815+0000 7f8eb5e19640 1 -- 172.21.15.130:0/3703488762 wait complete. 2023-09-13T06:03:36.839 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:03:36.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.975+0000 7f3664456640 1 Processor -- start 2023-09-13T06:03:36.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.975+0000 7f3664456640 1 -- start start 2023-09-13T06:03:36.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.975+0000 7f3664456640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f365c15d260 0x7f365c0b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.975+0000 7f3664456640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f365c0ce1a0 0x7f365c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.975+0000 7f3664456640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c072310 con 0x7f365c0afc70 2023-09-13T06:03:36.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.975+0000 7f3664456640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c070e70 con 0x7f365c15d260 2023-09-13T06:03:36.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.975+0000 7f3664456640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c070280 con 0x7f365c0ce1a0 2023-09-13T06:03:36.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36629f3640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f365c0afc70 0x7f365c160f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55188/0 (socket says 172.21.15.130:55188) 2023-09-13T06:03:36.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36629f3640 1 -- 172.21.15.130:0/3023888312 learned_addr learned my addr 172.21.15.130:0/3023888312 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:36.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36619f1640 1 --2- 172.21.15.130:0/3023888312 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f365c0ce1a0 0x7f365c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36621f2640 1 --2- 172.21.15.130:0/3023888312 >> v2:172.21.15.164:3300/0 conn(0x7f365c15d260 0x7f365c0b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36611f0640 1 -- 172.21.15.130:0/3023888312 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356039285 0 0) 0x7f365c072310 con 0x7f365c0afc70 2023-09-13T06:03:36.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36611f0640 1 -- 172.21.15.130:0/3023888312 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3648003530 con 0x7f365c0afc70 2023-09-13T06:03:36.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36619f1640 1 -- 172.21.15.130:0/3023888312 >> v2:172.21.15.164:3300/0 conn(0x7f365c15d260 msgr2=0x7f365c0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:36.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36619f1640 1 --2- 172.21.15.130:0/3023888312 >> v2:172.21.15.164:3300/0 conn(0x7f365c15d260 0x7f365c0b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36619f1640 1 -- 172.21.15.130:0/3023888312 >> v1:172.21.15.130:6789/0 conn(0x7f365c0afc70 legacy=0x7f365c160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36619f1640 1 -- 172.21.15.130:0/3023888312 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c070540 con 0x7f365c0ce1a0 2023-09-13T06:03:36.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36619f1640 1 --2- 172.21.15.130:0/3023888312 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f365c0ce1a0 0x7f365c06d6e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f364c0097c0 tx=0x7f364c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cef18fb9ee631e87 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.979+0000 7f36611f0640 1 -- 172.21.15.130:0/3023888312 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c0ad660 con 0x7f365c0ce1a0 2023-09-13T06:03:36.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f36611f0640 1 -- 172.21.15.130:0/3023888312 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c0ad7c0 con 0x7f365c0ce1a0 2023-09-13T06:03:36.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f36611f0640 1 -- 172.21.15.130:0/3023888312 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c0adb50 con 0x7f365c0ce1a0 2023-09-13T06:03:36.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 -- 172.21.15.130:0/3023888312 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f365c0ce1a0 msgr2=0x7f365c06d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 --2- 172.21.15.130:0/3023888312 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f365c0ce1a0 0x7f365c06d6e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f364c0097c0 tx=0x7f364c01c450 comp rx=0 tx=0).stop 2023-09-13T06:03:36.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 -- 172.21.15.130:0/3023888312 shutdown_connections 2023-09-13T06:03:36.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 --2- 172.21.15.130:0/3023888312 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f365c0ce1a0 0x7f365c06d6e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 --2- 172.21.15.130:0/3023888312 >> v2:172.21.15.164:3300/0 conn(0x7f365c15d260 0x7f365c0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 -- 172.21.15.130:0/3023888312 >> 172.21.15.130:0/3023888312 conn(0x7f365c06a2f0 msgr2=0x7f365c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:36.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 -- 172.21.15.130:0/3023888312 shutdown_connections 2023-09-13T06:03:36.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 -- 172.21.15.130:0/3023888312 wait complete. 2023-09-13T06:03:36.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 Processor -- start 2023-09-13T06:03:36.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 -- start start 2023-09-13T06:03:36.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f365c0afc70 0x7f365c14e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f365c0ce1a0 0x7f365c0ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f365c15d260 0x7f365c156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c14edb0 con 0x7f365c0afc70 2023-09-13T06:03:36.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c15fc00 con 0x7f365c15d260 2023-09-13T06:03:36.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f3664456640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c15fee0 con 0x7f365c0ce1a0 2023-09-13T06:03:36.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f36621f2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f365c0afc70 0x7f365c14e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f36621f2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f365c0afc70 0x7f365c14e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57340/0 (socket says 172.21.15.130:57340) 2023-09-13T06:03:36.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.983+0000 7f36621f2640 1 -- 172.21.15.130:0/1582530586 learned_addr learned my addr 172.21.15.130:0/1582530586 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:36.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f36619f1640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f365c0ce1a0 0x7f365c0ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f36629f3640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f365c15d260 0x7f365c156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f36621f2640 1 -- 172.21.15.130:0/1582530586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f365c0ce1a0 msgr2=0x7f365c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f36621f2640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f365c0ce1a0 0x7f365c0ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f36621f2640 1 -- 172.21.15.130:0/1582530586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f365c15d260 msgr2=0x7f365c156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:36.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f36621f2640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f365c15d260 0x7f365c156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:36.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f36621f2640 1 -- 172.21.15.130:0/1582530586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c009420 con 0x7f365c0afc70 2023-09-13T06:03:36.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f36621f2640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f365c0afc70 0x7f365c14e870 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f365800e870 tx=0x7f365800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f3652ffd640 1 -- 172.21.15.130:0/1582530586 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658009510 con 0x7f365c0afc70 2023-09-13T06:03:36.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f3652ffd640 1 -- 172.21.15.130:0/1582530586 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365800eec0 con 0x7f365c0afc70 2023-09-13T06:03:36.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f3664456640 1 -- 172.21.15.130:0/1582530586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c1601c0 con 0x7f365c0afc70 2023-09-13T06:03:36.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f3652ffd640 1 -- 172.21.15.130:0/1582530586 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365800cb40 con 0x7f365c0afc70 2023-09-13T06:03:36.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f3664456640 1 -- 172.21.15.130:0/1582530586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c160780 con 0x7f365c0afc70 2023-09-13T06:03:36.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f3664456640 1 -- 172.21.15.130:0/1582530586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c0618a0 con 0x7f365c0afc70 2023-09-13T06:03:36.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f3652ffd640 1 -- 172.21.15.130:0/1582530586 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f365800cca0 con 0x7f365c0afc70 2023-09-13T06:03:36.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f3652ffd640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3640065b20 0x7f3640067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:36.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f3652ffd640 1 -- 172.21.15.130:0/1582530586 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3658083460 con 0x7f365c0afc70 2023-09-13T06:03:36.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.987+0000 7f36619f1640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3640065b20 0x7f3640067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:36.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.991+0000 7f36619f1640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3640065b20 0x7f3640067fe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f364c0af000 tx=0x7f364c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:36.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:36.991+0000 7f3652ffd640 1 -- 172.21.15.130:0/1582530586 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3658050d80 con 0x7f365c0afc70 2023-09-13T06:03:37.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.151+0000 7f3664456640 1 -- 172.21.15.130:0/1582530586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f365c0b5860 con 0x7f365c0afc70 2023-09-13T06:03:37.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.151+0000 7f3652ffd640 1 -- 172.21.15.130:0/1582530586 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f36580543a0 con 0x7f365c0afc70 2023-09-13T06:03:37.156 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:03:37.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 -- 172.21.15.130:0/1582530586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3640065b20 msgr2=0x7f3640067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3640065b20 0x7f3640067fe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f364c0af000 tx=0x7f364c008040 comp rx=0 tx=0).stop 2023-09-13T06:03:37.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 -- 172.21.15.130:0/1582530586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f365c0afc70 msgr2=0x7f365c14e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f365c0afc70 0x7f365c14e870 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f365800e870 tx=0x7f365800ec70 comp rx=0 tx=0).stop 2023-09-13T06:03:37.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 -- 172.21.15.130:0/1582530586 shutdown_connections 2023-09-13T06:03:37.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3640065b20 0x7f3640067fe0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f365c15d260 0x7f365c156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f365c0ce1a0 0x7f365c0ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 --2- 172.21.15.130:0/1582530586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f365c0afc70 0x7f365c14e870 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 -- 172.21.15.130:0/1582530586 >> 172.21.15.130:0/1582530586 conn(0x7f365c06a2f0 msgr2=0x7f365c0b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:37.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 -- 172.21.15.130:0/1582530586 shutdown_connections 2023-09-13T06:03:37.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.155+0000 7f3664456640 1 -- 172.21.15.130:0/1582530586 wait complete. 2023-09-13T06:03:37.176 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T06:03:37.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:37.177 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-13T06:03:37.282 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:03:37.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:37.283 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T06:03:37.293 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:03:37.294 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:37.304 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:03:37.304 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:37.357 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:03:37.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.491+0000 7f290dd11640 1 Processor -- start 2023-09-13T06:03:37.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.491+0000 7f290dd11640 1 -- start start 2023-09-13T06:03:37.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f290dd11640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f290815b130 0x7f29080cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f290dd11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29080ce180 0x7f290815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f290dd11640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29080ce980 con 0x7f29080b04a0 2023-09-13T06:03:37.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f290dd11640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29080cec60 con 0x7f290815b130 2023-09-13T06:03:37.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f290dd11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290806c640 con 0x7f29080ce180 2023-09-13T06:03:37.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f29077fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f290815b130 0x7f29080cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f2907fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f29080b04a0 0x7f290806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55192/0 (socket says 172.21.15.130:55192) 2023-09-13T06:03:37.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f2907fff640 1 -- 172.21.15.130:0/3689492164 learned_addr learned my addr 172.21.15.130:0/3689492164 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:37.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f28fffff640 1 --2- 172.21.15.130:0/3689492164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29080ce180 0x7f290815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f29077fe640 1 -- 172.21.15.130:0/3689492164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29080ce180 msgr2=0x7f290815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:37.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f29077fe640 1 --2- 172.21.15.130:0/3689492164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29080ce180 0x7f290815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f29077fe640 1 -- 172.21.15.130:0/3689492164 >> v1:172.21.15.130:6789/0 conn(0x7f29080b04a0 legacy=0x7f290806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f29077fe640 1 -- 172.21.15.130:0/3689492164 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290806c920 con 0x7f290815b130 2023-09-13T06:03:37.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.495+0000 7f2906ffd640 1 -- 172.21.15.130:0/3689492164 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99876680 0 0) 0x7f29080ce980 con 0x7f29080b04a0 2023-09-13T06:03:37.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f29077fe640 1 --2- 172.21.15.130:0/3689492164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290815b130 0x7f29080cc780 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f28f80097c0 tx=0x7f28f801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e15cdcf1aa0760f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:37.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f2906ffd640 1 -- 172.21.15.130:0/3689492164 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80ac410 con 0x7f290815b130 2023-09-13T06:03:37.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f2906ffd640 1 -- 172.21.15.130:0/3689492164 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f80ac570 con 0x7f290815b130 2023-09-13T06:03:37.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f2906ffd640 1 -- 172.21.15.130:0/3689492164 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80ac900 con 0x7f290815b130 2023-09-13T06:03:37.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 -- 172.21.15.130:0/3689492164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290815b130 msgr2=0x7f29080cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 --2- 172.21.15.130:0/3689492164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290815b130 0x7f29080cc780 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f28f80097c0 tx=0x7f28f801c480 comp rx=0 tx=0).stop 2023-09-13T06:03:37.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 -- 172.21.15.130:0/3689492164 shutdown_connections 2023-09-13T06:03:37.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 --2- 172.21.15.130:0/3689492164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29080ce180 0x7f290815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 --2- 172.21.15.130:0/3689492164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290815b130 0x7f29080cc780 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 -- 172.21.15.130:0/3689492164 >> 172.21.15.130:0/3689492164 conn(0x7f2908065990 msgr2=0x7f2908065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:37.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 -- 172.21.15.130:0/3689492164 shutdown_connections 2023-09-13T06:03:37.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 -- 172.21.15.130:0/3689492164 wait complete. 2023-09-13T06:03:37.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 Processor -- start 2023-09-13T06:03:37.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 -- start start 2023-09-13T06:03:37.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29080b04a0 0x7f29080af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080ce180 0x7f2908158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f290815b130 0x7f2908152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2908155960 con 0x7f29080ce180 2023-09-13T06:03:37.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2908155c40 con 0x7f290815b130 2023-09-13T06:03:37.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f290dd11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2908155f20 con 0x7f29080b04a0 2023-09-13T06:03:37.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f28fffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080ce180 0x7f2908158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f28fffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080ce180 0x7f2908158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57366/0 (socket says 172.21.15.130:57366) 2023-09-13T06:03:37.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.499+0000 7f28fffff640 1 -- 172.21.15.130:0/2631924221 learned_addr learned my addr 172.21.15.130:0/2631924221 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:37.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f2907fff640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f290815b130 0x7f2908152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f29077fe640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29080b04a0 0x7f29080af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f28fffff640 1 -- 172.21.15.130:0/2631924221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29080b04a0 msgr2=0x7f29080af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f28fffff640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29080b04a0 0x7f29080af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f28fffff640 1 -- 172.21.15.130:0/2631924221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f290815b130 msgr2=0x7f2908152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f28fffff640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f290815b130 0x7f2908152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f28fffff640 1 -- 172.21.15.130:0/2631924221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f8009420 con 0x7f29080ce180 2023-09-13T06:03:37.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f2907fff640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f290815b130 0x7f2908152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:37.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f29077fe640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29080b04a0 0x7f29080af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:37.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f28fffff640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080ce180 0x7f2908158f90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f28f000d800 tx=0x7f28f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:37.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f2904ff9640 1 -- 172.21.15.130:0/2631924221 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000b6c0 con 0x7f29080ce180 2023-09-13T06:03:37.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f2904ff9640 1 -- 172.21.15.130:0/2631924221 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f000b820 con 0x7f29080ce180 2023-09-13T06:03:37.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f2904ff9640 1 -- 172.21.15.130:0/2631924221 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000bb90 con 0x7f29080ce180 2023-09-13T06:03:37.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f290dd11640 1 -- 172.21.15.130:0/2631924221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2908156200 con 0x7f29080ce180 2023-09-13T06:03:37.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f290dd11640 1 -- 172.21.15.130:0/2631924221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2908156a00 con 0x7f29080ce180 2023-09-13T06:03:37.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f290dd11640 1 -- 172.21.15.130:0/2631924221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29080618a0 con 0x7f29080ce180 2023-09-13T06:03:37.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f2904ff9640 1 -- 172.21.15.130:0/2631924221 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f28f000bcf0 con 0x7f29080ce180 2023-09-13T06:03:37.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.503+0000 7f2904ff9640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f28e8065b50 0x7f28e8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.507+0000 7f2904ff9640 1 -- 172.21.15.130:0/2631924221 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f28f0083830 con 0x7f29080ce180 2023-09-13T06:03:37.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.507+0000 7f29077fe640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f28e8065b50 0x7f28e8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.507+0000 7f29077fe640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f28e8065b50 0x7f28e8068010 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f28f80ae000 tx=0x7f28f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:37.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.511+0000 7f2904ff9640 1 -- 172.21.15.130:0/2631924221 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f28f00511b0 con 0x7f29080ce180 2023-09-13T06:03:37.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.659+0000 7f290dd11640 1 -- 172.21.15.130:0/2631924221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f290815a7f0 con 0x7f29080ce180 2023-09-13T06:03:37.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f2904ff9640 1 -- 172.21.15.130:0/2631924221 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f28f00547d0 con 0x7f29080ce180 2023-09-13T06:03:37.666 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:37.666 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":54,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:03:31.332756+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:53.311861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:53.919645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:03:37.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 -- 172.21.15.130:0/2631924221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f28e8065b50 msgr2=0x7f28e8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f28e8065b50 0x7f28e8068010 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f28f80ae000 tx=0x7f28f8008040 comp rx=0 tx=0).stop 2023-09-13T06:03:37.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 -- 172.21.15.130:0/2631924221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080ce180 msgr2=0x7f2908158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080ce180 0x7f2908158f90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f28f000d800 tx=0x7f28f000dcc0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 -- 172.21.15.130:0/2631924221 shutdown_connections 2023-09-13T06:03:37.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f28e8065b50 0x7f28e8068010 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f290815b130 0x7f2908152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080ce180 0x7f2908158f90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 --2- 172.21.15.130:0/2631924221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29080b04a0 0x7f29080af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 -- 172.21.15.130:0/2631924221 >> 172.21.15.130:0/2631924221 conn(0x7f2908065990 msgr2=0x7f2908153760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:37.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 -- 172.21.15.130:0/2631924221 shutdown_connections 2023-09-13T06:03:37.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.663+0000 7f290dd11640 1 -- 172.21.15.130:0/2631924221 wait complete. 2023-09-13T06:03:37.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:02:53.311861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:02:53.919645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:03:37.688 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:03:37.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda38d74640 1 Processor -- start 2023-09-13T06:03:37.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda38d74640 1 -- start start 2023-09-13T06:03:37.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda38d74640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fda34157750 0x7fda34160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda38d74640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda34157b30 0x7fda3406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda38d74640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fda3406f170 0x7fda3406f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda38d74640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda340ae0d0 con 0x7fda34157750 2023-09-13T06:03:37.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda38d74640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda34161e60 con 0x7fda3406f170 2023-09-13T06:03:37.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda38d74640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda341615c0 con 0x7fda34157b30 2023-09-13T06:03:37.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda3259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fda34157750 0x7fda34160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda3259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fda34157750 0x7fda34160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57378/0 (socket says 172.21.15.130:57378) 2023-09-13T06:03:37.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda3259c640 1 -- 172.21.15.130:0/3164170106 learned_addr learned my addr 172.21.15.130:0/3164170106 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:37.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda3259c640 1 -- 172.21.15.130:0/3164170106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda34157b30 msgr2=0x7fda3406dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:37.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda3259c640 1 --2- 172.21.15.130:0/3164170106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda34157b30 0x7fda3406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda3259c640 1 -- 172.21.15.130:0/3164170106 >> v2:172.21.15.164:3300/0 conn(0x7fda3406f170 msgr2=0x7fda3406f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:37.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda32d9d640 1 --2- 172.21.15.130:0/3164170106 >> v2:172.21.15.164:3300/0 conn(0x7fda3406f170 0x7fda3406f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda3259c640 1 --2- 172.21.15.130:0/3164170106 >> v2:172.21.15.164:3300/0 conn(0x7fda3406f170 0x7fda3406f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda3259c640 1 -- 172.21.15.130:0/3164170106 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda341618a0 con 0x7fda34157750 2023-09-13T06:03:37.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.827+0000 7fda32d9d640 1 --2- 172.21.15.130:0/3164170106 >> v2:172.21.15.164:3300/0 conn(0x7fda3406f170 0x7fda3406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:37.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda3259c640 1 --2- 172.21.15.130:0/3164170106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda34157750 0x7fda34160fe0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fda340ae8a0 tx=0x7fda2401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba208225f001dd18 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:37.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda3159a640 1 -- 172.21.15.130:0/3164170106 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda240aa5f0 con 0x7fda34157750 2023-09-13T06:03:37.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda3159a640 1 -- 172.21.15.130:0/3164170106 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda240aa750 con 0x7fda34157750 2023-09-13T06:03:37.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda3159a640 1 -- 172.21.15.130:0/3164170106 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda240aaae0 con 0x7fda34157750 2023-09-13T06:03:37.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda38d74640 1 -- 172.21.15.130:0/3164170106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda34157750 msgr2=0x7fda34160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda38d74640 1 --2- 172.21.15.130:0/3164170106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda34157750 0x7fda34160fe0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fda340ae8a0 tx=0x7fda2401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda38d74640 1 -- 172.21.15.130:0/3164170106 shutdown_connections 2023-09-13T06:03:37.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda38d74640 1 --2- 172.21.15.130:0/3164170106 >> v2:172.21.15.164:3300/0 conn(0x7fda3406f170 0x7fda3406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda38d74640 1 --2- 172.21.15.130:0/3164170106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda34157b30 0x7fda3406dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda38d74640 1 --2- 172.21.15.130:0/3164170106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda34157750 0x7fda34160fe0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda38d74640 1 -- 172.21.15.130:0/3164170106 >> 172.21.15.130:0/3164170106 conn(0x7fda34065d60 msgr2=0x7fda340b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:37.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda38d74640 1 -- 172.21.15.130:0/3164170106 shutdown_connections 2023-09-13T06:03:37.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.831+0000 7fda38d74640 1 -- 172.21.15.130:0/3164170106 wait complete. 2023-09-13T06:03:37.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda38d74640 1 Processor -- start 2023-09-13T06:03:37.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda38d74640 1 -- start start 2023-09-13T06:03:37.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda38d74640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda3406f170 0x7fda341375c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda38d74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda34157750 0x7fda34137d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda38d74640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda34157b30 0x7fda34152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda38d74640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda34139080 con 0x7fda34157750 2023-09-13T06:03:37.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda38d74640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda34137b00 con 0x7fda34157b30 2023-09-13T06:03:37.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda38d74640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda341387e0 con 0x7fda3406f170 2023-09-13T06:03:37.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda31d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda34157750 0x7fda34137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda31d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda34157750 0x7fda34137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57386/0 (socket says 172.21.15.130:57386) 2023-09-13T06:03:37.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda31d9b640 1 -- 172.21.15.130:0/1912099066 learned_addr learned my addr 172.21.15.130:0/1912099066 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:37.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda3259c640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda3406f170 0x7fda341375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda32d9d640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda34157b30 0x7fda34152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda31d9b640 1 -- 172.21.15.130:0/1912099066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda3406f170 msgr2=0x7fda341375c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda31d9b640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda3406f170 0x7fda341375c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda31d9b640 1 -- 172.21.15.130:0/1912099066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda34157b30 msgr2=0x7fda34152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda31d9b640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda34157b30 0x7fda34152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda31d9b640 1 -- 172.21.15.130:0/1912099066 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240094d0 con 0x7fda34157750 2023-09-13T06:03:37.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda32d9d640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda34157b30 0x7fda34152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:37.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda31d9b640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda34157750 0x7fda34137d20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fda2800b410 tx=0x7fda2800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:37.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda22ffd640 1 -- 172.21.15.130:0/1912099066 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28011830 con 0x7fda34157750 2023-09-13T06:03:37.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda22ffd640 1 -- 172.21.15.130:0/1912099066 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda28011990 con 0x7fda34157750 2023-09-13T06:03:37.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda22ffd640 1 -- 172.21.15.130:0/1912099066 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28011d40 con 0x7fda34157750 2023-09-13T06:03:37.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda38d74640 1 -- 172.21.15.130:0/1912099066 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda34138ac0 con 0x7fda34157750 2023-09-13T06:03:37.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda38d74640 1 -- 172.21.15.130:0/1912099066 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda34155ec0 con 0x7fda34157750 2023-09-13T06:03:37.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.835+0000 7fda38d74640 1 -- 172.21.15.130:0/1912099066 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda341560e0 con 0x7fda34157750 2023-09-13T06:03:37.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.839+0000 7fda22ffd640 1 -- 172.21.15.130:0/1912099066 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fda2801a400 con 0x7fda34157750 2023-09-13T06:03:37.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.839+0000 7fda22ffd640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda14065b50 0x7fda14068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:37.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.839+0000 7fda22ffd640 1 -- 172.21.15.130:0/1912099066 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fda28083430 con 0x7fda34157750 2023-09-13T06:03:37.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.839+0000 7fda3259c640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda14065b50 0x7fda14068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:37.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.839+0000 7fda3259c640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda14065b50 0x7fda14068010 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda240ae000 tx=0x7fda240b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:37.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.843+0000 7fda22ffd640 1 -- 172.21.15.130:0/1912099066 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fda28050d30 con 0x7fda34157750 2023-09-13T06:03:37.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.991+0000 7fda38d74640 1 -- 172.21.15.130:0/1912099066 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda340618a0 con 0x7fda34157750 2023-09-13T06:03:37.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.991+0000 7fda22ffd640 1 -- 172.21.15.130:0/1912099066 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda28054350 con 0x7fda34157750 2023-09-13T06:03:37.996 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:03:37.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 -- 172.21.15.130:0/1912099066 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda14065b50 msgr2=0x7fda14068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda14065b50 0x7fda14068010 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda240ae000 tx=0x7fda240b5040 comp rx=0 tx=0).stop 2023-09-13T06:03:37.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 -- 172.21.15.130:0/1912099066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda34157750 msgr2=0x7fda34137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:37.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda34157750 0x7fda34137d20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fda2800b410 tx=0x7fda2800b8d0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 -- 172.21.15.130:0/1912099066 shutdown_connections 2023-09-13T06:03:37.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda14065b50 0x7fda14068010 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda34157b30 0x7fda34152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:37.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda34157750 0x7fda34137d20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 --2- 172.21.15.130:0/1912099066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda3406f170 0x7fda341375c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 -- 172.21.15.130:0/1912099066 >> 172.21.15.130:0/1912099066 conn(0x7fda34065d60 msgr2=0x7fda34153780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:38.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 -- 172.21.15.130:0/1912099066 shutdown_connections 2023-09-13T06:03:38.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:37.995+0000 7fda38d74640 1 -- 172.21.15.130:0/1912099066 wait complete. 2023-09-13T06:03:38.017 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:03:38.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b132cb640 1 Processor -- start 2023-09-13T06:03:38.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b132cb640 1 -- start start 2023-09-13T06:03:38.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b132cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c157b30 0x7f3b0c160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b132cb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3b0c06dba0 0x7f3b0c15e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b132cb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c06dfe0 con 0x7f3b0c157750 2023-09-13T06:03:38.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b132cb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c0ae0d0 con 0x7f3b0c06dba0 2023-09-13T06:03:38.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b132cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c161e60 con 0x7f3b0c157b30 2023-09-13T06:03:38.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b11067640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3b0c157750 0x7f3b0c06f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55204/0 (socket says 172.21.15.130:55204) 2023-09-13T06:03:38.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b11067640 1 -- 172.21.15.130:0/601705523 learned_addr learned my addr 172.21.15.130:0/601705523 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:38.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b11868640 1 --2- 172.21.15.130:0/601705523 >> v2:172.21.15.164:3300/0 conn(0x7f3b0c06dba0 0x7f3b0c15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b10866640 1 --2- 172.21.15.130:0/601705523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c157b30 0x7f3b0c160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b03fff640 1 -- 172.21.15.130:0/601705523 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173874962 0 0) 0x7f3b0c06dfe0 con 0x7f3b0c157750 2023-09-13T06:03:38.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b03fff640 1 -- 172.21.15.130:0/601705523 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af8003530 con 0x7f3b0c157750 2023-09-13T06:03:38.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b10866640 1 -- 172.21.15.130:0/601705523 >> v2:172.21.15.164:3300/0 conn(0x7f3b0c06dba0 msgr2=0x7f3b0c15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:38.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b10866640 1 --2- 172.21.15.130:0/601705523 >> v2:172.21.15.164:3300/0 conn(0x7f3b0c06dba0 0x7f3b0c15e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b10866640 1 -- 172.21.15.130:0/601705523 >> v1:172.21.15.130:6789/0 conn(0x7f3b0c157750 legacy=0x7f3b0c06f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.155+0000 7f3b10866640 1 -- 172.21.15.130:0/601705523 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c1615c0 con 0x7f3b0c157b30 2023-09-13T06:03:38.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b10866640 1 --2- 172.21.15.130:0/601705523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c157b30 0x7f3b0c160fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0097c0 tx=0x7f3afc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8345485c661050c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:38.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b03fff640 1 -- 172.21.15.130:0/601705523 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0ad660 con 0x7f3b0c157b30 2023-09-13T06:03:38.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b03fff640 1 -- 172.21.15.130:0/601705523 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc0ad7c0 con 0x7f3b0c157b30 2023-09-13T06:03:38.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b03fff640 1 -- 172.21.15.130:0/601705523 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0adb50 con 0x7f3b0c157b30 2023-09-13T06:03:38.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b132cb640 1 -- 172.21.15.130:0/601705523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c157b30 msgr2=0x7f3b0c160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b132cb640 1 --2- 172.21.15.130:0/601705523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c157b30 0x7f3b0c160fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0097c0 tx=0x7f3afc01c450 comp rx=0 tx=0).stop 2023-09-13T06:03:38.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b132cb640 1 -- 172.21.15.130:0/601705523 shutdown_connections 2023-09-13T06:03:38.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b132cb640 1 --2- 172.21.15.130:0/601705523 >> v2:172.21.15.164:3300/0 conn(0x7f3b0c06dba0 0x7f3b0c15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b132cb640 1 --2- 172.21.15.130:0/601705523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c157b30 0x7f3b0c160fe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b132cb640 1 -- 172.21.15.130:0/601705523 >> 172.21.15.130:0/601705523 conn(0x7f3b0c065d60 msgr2=0x7f3b0c0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:38.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b132cb640 1 -- 172.21.15.130:0/601705523 shutdown_connections 2023-09-13T06:03:38.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.159+0000 7f3b132cb640 1 -- 172.21.15.130:0/601705523 wait complete. 2023-09-13T06:03:38.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b132cb640 1 Processor -- start 2023-09-13T06:03:38.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b132cb640 1 -- start start 2023-09-13T06:03:38.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b132cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b0c06dba0 0x7f3b0c158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b132cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c157750 0x7f3b0c151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b132cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b0c157b30 0x7f3b0c151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b132cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0b0d90 con 0x7f3b0c157b30 2023-09-13T06:03:38.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b132cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0cd2a0 con 0x7f3b0c06dba0 2023-09-13T06:03:38.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b132cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c158b90 con 0x7f3b0c157750 2023-09-13T06:03:38.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b11868640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b0c157b30 0x7f3b0c151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b11868640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b0c157b30 0x7f3b0c151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57392/0 (socket says 172.21.15.130:57392) 2023-09-13T06:03:38.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b11868640 1 -- 172.21.15.130:0/2135611220 learned_addr learned my addr 172.21.15.130:0/2135611220 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:38.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b11067640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b0c06dba0 0x7f3b0c158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b10866640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c157750 0x7f3b0c151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b11868640 1 -- 172.21.15.130:0/2135611220 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c157750 msgr2=0x7f3b0c151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b11868640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c157750 0x7f3b0c151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b11868640 1 -- 172.21.15.130:0/2135611220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b0c06dba0 msgr2=0x7f3b0c158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b11868640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b0c06dba0 0x7f3b0c158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b11868640 1 -- 172.21.15.130:0/2135611220 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc009420 con 0x7f3b0c157b30 2023-09-13T06:03:38.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b11868640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b0c157b30 0x7f3b0c151ce0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009dd0 tx=0x7f3b0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:38.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b01ffb640 1 -- 172.21.15.130:0/2135611220 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04014480 con 0x7f3b0c157b30 2023-09-13T06:03:38.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b01ffb640 1 -- 172.21.15.130:0/2135611220 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0400f040 con 0x7f3b0c157b30 2023-09-13T06:03:38.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b01ffb640 1 -- 172.21.15.130:0/2135611220 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04014840 con 0x7f3b0c157b30 2023-09-13T06:03:38.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b132cb640 1 -- 172.21.15.130:0/2135611220 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c06fa00 con 0x7f3b0c157b30 2023-09-13T06:03:38.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b132cb640 1 -- 172.21.15.130:0/2135611220 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c159150 con 0x7f3b0c157b30 2023-09-13T06:03:38.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.163+0000 7f3b132cb640 1 -- 172.21.15.130:0/2135611220 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c0cd470 con 0x7f3b0c157b30 2023-09-13T06:03:38.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.167+0000 7f3b01ffb640 1 -- 172.21.15.130:0/2135611220 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3b040149a0 con 0x7f3b0c157b30 2023-09-13T06:03:38.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.167+0000 7f3b01ffb640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3af0065b50 0x7f3af0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.167+0000 7f3b01ffb640 1 -- 172.21.15.130:0/2135611220 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3b04083d40 con 0x7f3b0c157b30 2023-09-13T06:03:38.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.167+0000 7f3b11067640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3af0065b50 0x7f3af0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.167+0000 7f3b11067640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3af0065b50 0x7f3af0068010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b080011f0 tx=0x7f3b08007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:38.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.171+0000 7f3b01ffb640 1 -- 172.21.15.130:0/2135611220 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3b0c0cd470 con 0x7f3b0c157b30 2023-09-13T06:03:38.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 -- 172.21.15.130:0/2135611220 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b0c0cd470 con 0x7f3b0c157b30 2023-09-13T06:03:38.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b01ffb640 1 -- 172.21.15.130:0/2135611220 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b0c0cd470 con 0x7f3b0c157b30 2023-09-13T06:03:38.323 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:03:38.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 -- 172.21.15.130:0/2135611220 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3af0065b50 msgr2=0x7f3af0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3af0065b50 0x7f3af0068010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b080011f0 tx=0x7f3b08007d40 comp rx=0 tx=0).stop 2023-09-13T06:03:38.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 -- 172.21.15.130:0/2135611220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b0c157b30 msgr2=0x7f3b0c151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b0c157b30 0x7f3b0c151ce0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009dd0 tx=0x7f3b0400c490 comp rx=0 tx=0).stop 2023-09-13T06:03:38.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 -- 172.21.15.130:0/2135611220 shutdown_connections 2023-09-13T06:03:38.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3af0065b50 0x7f3af0068010 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b0c157b30 0x7f3b0c151ce0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b0c157750 0x7f3b0c151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 --2- 172.21.15.130:0/2135611220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b0c06dba0 0x7f3b0c158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 -- 172.21.15.130:0/2135611220 >> 172.21.15.130:0/2135611220 conn(0x7f3b0c065d60 msgr2=0x7f3b0c15eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:38.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 -- 172.21.15.130:0/2135611220 shutdown_connections 2023-09-13T06:03:38.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.319+0000 7f3b132cb640 1 -- 172.21.15.130:0/2135611220 wait complete. 2023-09-13T06:03:38.344 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:03:38.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c829a5640 1 Processor -- start 2023-09-13T06:03:38.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c829a5640 1 -- start start 2023-09-13T06:03:38.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c829a5640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3c7c146d40 0x7f3c7c0b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c829a5640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7c0d3a80 0x7f3c7c070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c829a5640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7c0b42a0 con 0x7f3c7c070cb0 2023-09-13T06:03:38.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c829a5640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c7c071140 con 0x7f3c7c146d40 2023-09-13T06:03:38.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c829a5640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c0b4560 con 0x7f3c7c0d3a80 2023-09-13T06:03:38.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c821a4640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3c7c070cb0 0x7f3c7c160e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55214/0 (socket says 172.21.15.130:55214) 2023-09-13T06:03:38.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c821a4640 1 -- 172.21.15.130:0/1342149043 learned_addr learned my addr 172.21.15.130:0/1342149043 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:38.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c811a2640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7c0d3a80 0x7f3c7c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c819a3640 1 --2- 172.21.15.130:0/1342149043 >> v2:172.21.15.164:3300/0 conn(0x7f3c7c146d40 0x7f3c7c0b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962392293 0 0) 0x7f3c7c0b42a0 con 0x7f3c7c070cb0 2023-09-13T06:03:38.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c68003530 con 0x7f3c7c070cb0 2023-09-13T06:03:38.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 453905537 0 0) 0x7f3c68003530 con 0x7f3c7c070cb0 2023-09-13T06:03:38.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7c0d3a80 msgr2=0x7f3c7c070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:38.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7c0d3a80 0x7f3c7c070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 >> v2:172.21.15.164:3300/0 conn(0x7f3c7c146d40 msgr2=0x7f3c7c0b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:38.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 --2- 172.21.15.130:0/1342149043 >> v2:172.21.15.164:3300/0 conn(0x7f3c7c146d40 0x7f3c7c0b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c0b4840 con 0x7f3c7c070cb0 2023-09-13T06:03:38.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f3c74001a00 con 0x7f3c7c070cb0 2023-09-13T06:03:38.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 >> v1:172.21.15.130:6789/0 conn(0x7f3c7c070cb0 legacy=0x7f3c7c160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c680039f0 0x7f3c68003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7c0d3a80 0x7f3c680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c68004d10 0x7f3c68005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c071140 con 0x7f3c680039f0 2023-09-13T06:03:38.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c0b4560 con 0x7f3c68004d10 2023-09-13T06:03:38.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6800b990 con 0x7f3c7c0d3a80 2023-09-13T06:03:38.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.483+0000 7f3c819a3640 1 --2- 172.21.15.130:0/1342149043 >> v2:172.21.15.164:3300/0 conn(0x7f3c7c146d40 0x7f3c7c0b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:38.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c819a3640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c680039f0 0x7f3c68003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c811a2640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7c0d3a80 0x7f3c680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c821a4640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c68004d10 0x7f3c68005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c819a3640 1 -- 172.21.15.130:0/1342149043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7c0d3a80 msgr2=0x7f3c680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:38.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c819a3640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7c0d3a80 0x7f3c680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c819a3640 1 -- 172.21.15.130:0/1342149043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c68004d10 msgr2=0x7f3c68005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:38.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c819a3640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c68004d10 0x7f3c68005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c819a3640 1 -- 172.21.15.130:0/1342149043 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c68003530 con 0x7f3c680039f0 2023-09-13T06:03:38.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c819a3640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c680039f0 0x7f3c68003e10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009c90 tx=0x7f3c7801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a9da74fbe5c739 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:38.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78004020 con 0x7f3c680039f0 2023-09-13T06:03:38.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c78004180 con 0x7f3c680039f0 2023-09-13T06:03:38.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.487+0000 7f3c809a1640 1 -- 172.21.15.130:0/1342149043 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c780a5800 con 0x7f3c680039f0 2023-09-13T06:03:38.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 -- 172.21.15.130:0/1342149043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c680039f0 msgr2=0x7f3c68003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 --2- 172.21.15.130:0/1342149043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c680039f0 0x7f3c68003e10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009c90 tx=0x7f3c7801cc50 comp rx=0 tx=0).stop 2023-09-13T06:03:38.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c821a4640 1 -- 172.21.15.130:0/1342149043 reap_dead start 2023-09-13T06:03:38.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 -- 172.21.15.130:0/1342149043 shutdown_connections 2023-09-13T06:03:38.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 -- 172.21.15.130:0/1342149043 >> 172.21.15.130:0/1342149043 conn(0x7f3c7c0d2f60 msgr2=0x7f3c7c0d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:38.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 -- 172.21.15.130:0/1342149043 shutdown_connections 2023-09-13T06:03:38.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 -- 172.21.15.130:0/1342149043 wait complete. 2023-09-13T06:03:38.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 Processor -- start 2023-09-13T06:03:38.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 -- start start 2023-09-13T06:03:38.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c680039f0 0x7f3c7c0d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7c154fb0 0x7f3c7c155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7c163390 0x7f3c7c163810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c153be0 con 0x7f3c7c163390 2023-09-13T06:03:38.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c155b30 con 0x7f3c7c154fb0 2023-09-13T06:03:38.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c829a5640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c15a460 con 0x7f3c680039f0 2023-09-13T06:03:38.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c821a4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7c163390 0x7f3c7c163810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c821a4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7c163390 0x7f3c7c163810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57406/0 (socket says 172.21.15.130:57406) 2023-09-13T06:03:38.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c821a4640 1 -- 172.21.15.130:0/3250683127 learned_addr learned my addr 172.21.15.130:0/3250683127 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:38.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c811a2640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7c154fb0 0x7f3c7c155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c819a3640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c680039f0 0x7f3c7c0d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c821a4640 1 -- 172.21.15.130:0/3250683127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c680039f0 msgr2=0x7f3c7c0d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c821a4640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c680039f0 0x7f3c7c0d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c821a4640 1 -- 172.21.15.130:0/3250683127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7c154fb0 msgr2=0x7f3c7c155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c821a4640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7c154fb0 0x7f3c7c155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c821a4640 1 -- 172.21.15.130:0/3250683127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c15a740 con 0x7f3c7c163390 2023-09-13T06:03:38.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.491+0000 7f3c821a4640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7c163390 0x7f3c7c163810 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0d3fd0 tx=0x7f3c740079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:38.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.495+0000 7f3c727fc640 1 -- 172.21.15.130:0/3250683127 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400ab60 con 0x7f3c7c163390 2023-09-13T06:03:38.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.495+0000 7f3c727fc640 1 -- 172.21.15.130:0/3250683127 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7400ad00 con 0x7f3c7c163390 2023-09-13T06:03:38.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.495+0000 7f3c829a5640 1 -- 172.21.15.130:0/3250683127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7c15aa20 con 0x7f3c7c163390 2023-09-13T06:03:38.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.495+0000 7f3c727fc640 1 -- 172.21.15.130:0/3250683127 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74013630 con 0x7f3c7c163390 2023-09-13T06:03:38.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.495+0000 7f3c829a5640 1 -- 172.21.15.130:0/3250683127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7c163d50 con 0x7f3c7c163390 2023-09-13T06:03:38.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.495+0000 7f3c829a5640 1 -- 172.21.15.130:0/3250683127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7c070390 con 0x7f3c7c163390 2023-09-13T06:03:38.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.495+0000 7f3c727fc640 1 -- 172.21.15.130:0/3250683127 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3c74013790 con 0x7f3c7c163390 2023-09-13T06:03:38.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.495+0000 7f3c727fc640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c60065b20 0x7f3c60067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.495+0000 7f3c727fc640 1 -- 172.21.15.130:0/3250683127 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3c74083850 con 0x7f3c7c163390 2023-09-13T06:03:38.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.495+0000 7f3c819a3640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c60065b20 0x7f3c60067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.495+0000 7f3c819a3640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c60065b20 0x7f3c60067fe0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3c780ae000 tx=0x7f3c780046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:38.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.499+0000 7f3c727fc640 1 -- 172.21.15.130:0/3250683127 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3c74051160 con 0x7f3c7c163390 2023-09-13T06:03:38.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.651+0000 7f3c829a5640 1 -- 172.21.15.130:0/3250683127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c7c0618a0 con 0x7f3c7c163390 2023-09-13T06:03:38.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.651+0000 7f3c727fc640 1 -- 172.21.15.130:0/3250683127 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3c74054780 con 0x7f3c7c163390 2023-09-13T06:03:38.656 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:03:38.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 -- 172.21.15.130:0/3250683127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c60065b20 msgr2=0x7f3c60067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c60065b20 0x7f3c60067fe0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3c780ae000 tx=0x7f3c780046d0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 -- 172.21.15.130:0/3250683127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7c163390 msgr2=0x7f3c7c163810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7c163390 0x7f3c7c163810 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0d3fd0 tx=0x7f3c740079d0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 -- 172.21.15.130:0/3250683127 shutdown_connections 2023-09-13T06:03:38.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c60065b20 0x7f3c60067fe0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7c154fb0 0x7f3c7c155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7c163390 0x7f3c7c163810 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 --2- 172.21.15.130:0/3250683127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c680039f0 0x7f3c7c0d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 -- 172.21.15.130:0/3250683127 >> 172.21.15.130:0/3250683127 conn(0x7f3c7c0d2f60 msgr2=0x7f3c7c166000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:38.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 -- 172.21.15.130:0/3250683127 shutdown_connections 2023-09-13T06:03:38.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.655+0000 7f3c829a5640 1 -- 172.21.15.130:0/3250683127 wait complete. 2023-09-13T06:03:38.677 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:03:38.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.811+0000 7f8071d74640 1 Processor -- start 2023-09-13T06:03:38.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.811+0000 7f8071d74640 1 -- start start 2023-09-13T06:03:38.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f8071d74640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 0x7f806c0ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f8071d74640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806c0afee0 con 0x7f806c0b0f40 2023-09-13T06:03:38.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f8071d74640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806c0b0180 con 0x7f806c0b1d20 2023-09-13T06:03:38.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f8071d74640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806c0aea50 con 0x7f806c157920 2023-09-13T06:03:38.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f8063fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f806c0b0f40 0x7f806c0b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55228/0 (socket says 172.21.15.130:55228) 2023-09-13T06:03:38.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f8063fff640 1 -- 172.21.15.130:0/210636323 learned_addr learned my addr 172.21.15.130:0/210636323 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:38.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f806b7fe640 1 --2- 172.21.15.130:0/210636323 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 0x7f806c0ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f806affd640 1 -- 172.21.15.130:0/210636323 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545797317 0 0) 0x7f806c0afee0 con 0x7f806c0b0f40 2023-09-13T06:03:38.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f806affd640 1 -- 172.21.15.130:0/210636323 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8058003530 con 0x7f806c0b0f40 2023-09-13T06:03:38.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f806b7fe640 1 -- 172.21.15.130:0/210636323 >> v1:172.21.15.164:6789/0 conn(0x7f806c0b1d20 legacy=0x7f806c06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f806b7fe640 1 -- 172.21.15.130:0/210636323 >> v1:172.21.15.130:6789/0 conn(0x7f806c0b0f40 legacy=0x7f806c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.815+0000 7f806b7fe640 1 -- 172.21.15.130:0/210636323 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c0b0460 con 0x7f806c157920 2023-09-13T06:03:38.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f806b7fe640 1 --2- 172.21.15.130:0/210636323 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 0x7f806c0ae190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f805c0097f0 tx=0x7f805c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b6116c298b7c1b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:38.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f806affd640 1 -- 172.21.15.130:0/210636323 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c0aa610 con 0x7f806c157920 2023-09-13T06:03:38.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f806affd640 1 -- 172.21.15.130:0/210636323 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805c0a6040 con 0x7f806c157920 2023-09-13T06:03:38.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f806affd640 1 -- 172.21.15.130:0/210636323 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c0aa990 con 0x7f806c157920 2023-09-13T06:03:38.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f8071d74640 1 -- 172.21.15.130:0/210636323 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 msgr2=0x7f806c0ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f8071d74640 1 --2- 172.21.15.130:0/210636323 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 0x7f806c0ae190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f805c0097f0 tx=0x7f805c01c490 comp rx=0 tx=0).stop 2023-09-13T06:03:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f8071d74640 1 -- 172.21.15.130:0/210636323 shutdown_connections 2023-09-13T06:03:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f8071d74640 1 --2- 172.21.15.130:0/210636323 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 0x7f806c0ae190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f8071d74640 1 -- 172.21.15.130:0/210636323 >> 172.21.15.130:0/210636323 conn(0x7f806c065990 msgr2=0x7f806c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f8071d74640 1 -- 172.21.15.130:0/210636323 shutdown_connections 2023-09-13T06:03:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f8071d74640 1 -- 172.21.15.130:0/210636323 wait complete. 2023-09-13T06:03:38.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f8071d74640 1 Processor -- start 2023-09-13T06:03:38.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.819+0000 7f8071d74640 1 -- start start 2023-09-13T06:03:38.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8071d74640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f806c0b0f40 0x7f806c0cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8071d74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f806c0b1d20 0x7f806c14de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8071d74640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 0x7f806c13a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8071d74640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c0b0b20 con 0x7f806c0b1d20 2023-09-13T06:03:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8071d74640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c14d9d0 con 0x7f806c0b0f40 2023-09-13T06:03:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8071d74640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806c1583d0 con 0x7f806c157920 2023-09-13T06:03:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8063fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f806c0b1d20 0x7f806c14de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8063fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f806c0b1d20 0x7f806c14de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57408/0 (socket says 172.21.15.130:57408) 2023-09-13T06:03:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8063fff640 1 -- 172.21.15.130:0/4141133343 learned_addr learned my addr 172.21.15.130:0/4141133343 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f806b7fe640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f806c0b0f40 0x7f806c0cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f806bfff640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 0x7f806c13a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8063fff640 1 -- 172.21.15.130:0/4141133343 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 msgr2=0x7f806c13a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8063fff640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 0x7f806c13a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8063fff640 1 -- 172.21.15.130:0/4141133343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f806c0b0f40 msgr2=0x7f806c0cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8063fff640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f806c0b0f40 0x7f806c0cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8063fff640 1 -- 172.21.15.130:0/4141133343 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805c009420 con 0x7f806c0b1d20 2023-09-13T06:03:38.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f806b7fe640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f806c0b0f40 0x7f806c0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:38.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f806bfff640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 0x7f806c13a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:38.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8063fff640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f806c0b1d20 0x7f806c14de60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f805400c500 tx=0x7f805400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:38.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8068ff9640 1 -- 172.21.15.130:0/4141133343 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054005cf0 con 0x7f806c0b1d20 2023-09-13T06:03:38.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8068ff9640 1 -- 172.21.15.130:0/4141133343 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8054005e50 con 0x7f806c0b1d20 2023-09-13T06:03:38.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8071d74640 1 -- 172.21.15.130:0/4141133343 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806c14d380 con 0x7f806c0b1d20 2023-09-13T06:03:38.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8068ff9640 1 -- 172.21.15.130:0/4141133343 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80540072f0 con 0x7f806c0b1d20 2023-09-13T06:03:38.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8071d74640 1 -- 172.21.15.130:0/4141133343 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806c14e3a0 con 0x7f806c0b1d20 2023-09-13T06:03:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.823+0000 7f8071d74640 1 -- 172.21.15.130:0/4141133343 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806c14db60 con 0x7f806c0b1d20 2023-09-13T06:03:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.827+0000 7f8068ff9640 1 -- 172.21.15.130:0/4141133343 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8054007450 con 0x7f806c0b1d20 2023-09-13T06:03:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.827+0000 7f8068ff9640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f804c065b20 0x7f804c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.827+0000 7f8068ff9640 1 -- 172.21.15.130:0/4141133343 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8054082890 con 0x7f806c0b1d20 2023-09-13T06:03:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.827+0000 7f806b7fe640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f804c065b20 0x7f804c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.827+0000 7f806b7fe640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f804c065b20 0x7f804c067fe0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f805c0ae000 tx=0x7f805c0b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.831+0000 7f8068ff9640 1 -- 172.21.15.130:0/4141133343 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8054050240 con 0x7f806c0b1d20 2023-09-13T06:03:38.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 -- 172.21.15.130:0/4141133343 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f806c0618a0 con 0x7f806c0b1d20 2023-09-13T06:03:38.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8068ff9640 1 -- 172.21.15.130:0/4141133343 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8054017080 con 0x7f806c0b1d20 2023-09-13T06:03:38.995 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:03:38.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 -- 172.21.15.130:0/4141133343 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f804c065b20 msgr2=0x7f804c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f804c065b20 0x7f804c067fe0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f805c0ae000 tx=0x7f805c0b5040 comp rx=0 tx=0).stop 2023-09-13T06:03:38.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 -- 172.21.15.130:0/4141133343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f806c0b1d20 msgr2=0x7f806c14de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:38.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f806c0b1d20 0x7f806c14de60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f805400c500 tx=0x7f805400c9c0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 -- 172.21.15.130:0/4141133343 shutdown_connections 2023-09-13T06:03:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f804c065b20 0x7f804c067fe0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f806c157920 0x7f806c13a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f806c0b1d20 0x7f806c14de60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 --2- 172.21.15.130:0/4141133343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f806c0b0f40 0x7f806c0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 -- 172.21.15.130:0/4141133343 >> 172.21.15.130:0/4141133343 conn(0x7f806c065990 msgr2=0x7f806c06ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:38.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 -- 172.21.15.130:0/4141133343 shutdown_connections 2023-09-13T06:03:38.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:38.991+0000 7f8071d74640 1 -- 172.21.15.130:0/4141133343 wait complete. 2023-09-13T06:03:39.016 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T06:03:39.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:39.017 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-13T06:03:39.076 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:03:39.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:03:39.077 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T06:03:39.088 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:03:39.088 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:39.098 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:03:39.099 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:03:39.101 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:39.140 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:03:39.141 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:03:39.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d6c00b640 1 Processor -- start 2023-09-13T06:03:39.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d6c00b640 1 -- start start 2023-09-13T06:03:39.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d6c00b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1d640d1090 0x7f1d6415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d6c00b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640b63c0 con 0x7f1d640d1750 2023-09-13T06:03:39.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d6c00b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640d0c20 con 0x7f1d64146f30 2023-09-13T06:03:39.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d6c00b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6415dea0 con 0x7f1d640d1090 2023-09-13T06:03:39.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d695a6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1d640d1090 0x7f1d6415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d69da7640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1d640d1750 0x7f1d64146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55244/0 (socket says 172.21.15.130:55244) 2023-09-13T06:03:39.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d69da7640 1 -- 172.21.15.130:0/2131519749 learned_addr learned my addr 172.21.15.130:0/2131519749 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:39.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d695a6640 1 -- 172.21.15.130:0/2131519749 >> v1:172.21.15.164:6789/0 conn(0x7f1d64146f30 legacy=0x7f1d640b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:39.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d695a6640 1 -- 172.21.15.130:0/2131519749 >> v1:172.21.15.130:6789/0 conn(0x7f1d640d1750 legacy=0x7f1d64146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.279+0000 7f1d695a6640 1 -- 172.21.15.130:0/2131519749 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640b6610 con 0x7f1d640d1090 2023-09-13T06:03:39.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.283+0000 7f1d695a6640 1 --2- 172.21.15.130:0/2131519749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d640d1090 0x7f1d6415d960 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1d540097c0 tx=0x7f1d5401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4921d5c2f42be4fb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:39.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.283+0000 7f1d68da5640 1 -- 172.21.15.130:0/2131519749 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540ad680 con 0x7f1d640d1090 2023-09-13T06:03:39.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.283+0000 7f1d68da5640 1 -- 172.21.15.130:0/2131519749 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d540ad7e0 con 0x7f1d640d1090 2023-09-13T06:03:39.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.283+0000 7f1d68da5640 1 -- 172.21.15.130:0/2131519749 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540adb70 con 0x7f1d640d1090 2023-09-13T06:03:39.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.283+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2131519749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d640d1090 msgr2=0x7f1d6415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.283+0000 7f1d6c00b640 1 --2- 172.21.15.130:0/2131519749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d640d1090 0x7f1d6415d960 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1d540097c0 tx=0x7f1d5401c380 comp rx=0 tx=0).stop 2023-09-13T06:03:39.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.283+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2131519749 shutdown_connections 2023-09-13T06:03:39.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.283+0000 7f1d6c00b640 1 --2- 172.21.15.130:0/2131519749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d640d1090 0x7f1d6415d960 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.283+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2131519749 >> 172.21.15.130:0/2131519749 conn(0x7f1d6406f170 msgr2=0x7f1d6406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:39.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.283+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2131519749 shutdown_connections 2023-09-13T06:03:39.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.283+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2131519749 wait complete. 2023-09-13T06:03:39.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6c00b640 1 Processor -- start 2023-09-13T06:03:39.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6c00b640 1 -- start start 2023-09-13T06:03:39.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6c00b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d640d1090 0x7f1d6415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6c00b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d640d1750 0x7f1d6415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6c00b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d64146f30 0x7f1d6415e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6c00b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415f610 con 0x7f1d64146f30 2023-09-13T06:03:39.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6c00b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d64155600 con 0x7f1d640d1090 2023-09-13T06:03:39.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6c00b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415d460 con 0x7f1d640d1750 2023-09-13T06:03:39.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6a5a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d64146f30 0x7f1d6415e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6a5a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d64146f30 0x7f1d6415e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57440/0 (socket says 172.21.15.130:57440) 2023-09-13T06:03:39.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6a5a8640 1 -- 172.21.15.130:0/2950946447 learned_addr learned my addr 172.21.15.130:0/2950946447 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:39.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d69da7640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d640d1090 0x7f1d6415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d695a6640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d640d1750 0x7f1d6415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6a5a8640 1 -- 172.21.15.130:0/2950946447 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d640d1750 msgr2=0x7f1d6415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6a5a8640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d640d1750 0x7f1d6415dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6a5a8640 1 -- 172.21.15.130:0/2950946447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d640d1090 msgr2=0x7f1d6415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6a5a8640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d640d1090 0x7f1d6415cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6a5a8640 1 -- 172.21.15.130:0/2950946447 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d54009420 con 0x7f1d64146f30 2023-09-13T06:03:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d695a6640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d640d1750 0x7f1d6415dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d69da7640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d640d1090 0x7f1d6415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6a5a8640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d64146f30 0x7f1d6415e530 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00b990 tx=0x7f1d5c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d5a7fc640 1 -- 172.21.15.130:0/2950946447 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00cba0 con 0x7f1d64146f30 2023-09-13T06:03:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d5a7fc640 1 -- 172.21.15.130:0/2950946447 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c00cd00 con 0x7f1d64146f30 2023-09-13T06:03:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2950946447 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d64155040 con 0x7f1d64146f30 2023-09-13T06:03:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d5a7fc640 1 -- 172.21.15.130:0/2950946447 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c014680 con 0x7f1d64146f30 2023-09-13T06:03:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2950946447 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d64157c60 con 0x7f1d64146f30 2023-09-13T06:03:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.287+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2950946447 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d640618a0 con 0x7f1d64146f30 2023-09-13T06:03:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.291+0000 7f1d5a7fc640 1 -- 172.21.15.130:0/2950946447 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1d5c01d3b0 con 0x7f1d64146f30 2023-09-13T06:03:39.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.291+0000 7f1d5a7fc640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d48065b20 0x7f1d48067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.291+0000 7f1d5a7fc640 1 -- 172.21.15.130:0/2950946447 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1d5c083220 con 0x7f1d64146f30 2023-09-13T06:03:39.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.291+0000 7f1d69da7640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d48065b20 0x7f1d48067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.291+0000 7f1d69da7640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d48065b20 0x7f1d48067fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1d60005890 tx=0x7f1d60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:39.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.295+0000 7f1d5a7fc640 1 -- 172.21.15.130:0/2950946447 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1d5c050ba0 con 0x7f1d64146f30 2023-09-13T06:03:39.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2950946447 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d640b86c0 con 0x7f1d64146f30 2023-09-13T06:03:39.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d5a7fc640 1 -- 172.21.15.130:0/2950946447 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f1d5c0541c0 con 0x7f1d64146f30 2023-09-13T06:03:39.483 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:39.484 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2126646405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2126646405},{"type":"v1","addr":"172.21.15.164:6835","nonce":2126646405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1274935773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1274935773},{"type":"v1","addr":"172.21.15.164:6834","nonce":1274935773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/4174632972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4174632972},{"type":"v1","addr":"172.21.15.130:6836","nonce":4174632972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:54.919386+0000","modified":"2023-09-13T06:02:57.960043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5613":{"gid":5613,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1098709916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1098709916},{"type":"v1","addr":"172.21.15.130:6837","nonce":1098709916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-13T06:03:39.485 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 25 2023-09-13T06:03:39.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2950946447 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d48065b20 msgr2=0x7f1d48067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d48065b20 0x7f1d48067fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1d60005890 tx=0x7f1d60009040 comp rx=0 tx=0).stop 2023-09-13T06:03:39.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2950946447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d64146f30 msgr2=0x7f1d6415e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d64146f30 0x7f1d6415e530 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00b990 tx=0x7f1d5c00be50 comp rx=0 tx=0).stop 2023-09-13T06:03:39.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2950946447 shutdown_connections 2023-09-13T06:03:39.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d48065b20 0x7f1d48067fe0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d64146f30 0x7f1d6415e530 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d640d1750 0x7f1d6415dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 --2- 172.21.15.130:0/2950946447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d640d1090 0x7f1d6415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2950946447 >> 172.21.15.130:0/2950946447 conn(0x7f1d6406f170 msgr2=0x7f1d641417b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:39.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2950946447 shutdown_connections 2023-09-13T06:03:39.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.479+0000 7f1d6c00b640 1 -- 172.21.15.130:0/2950946447 wait complete. 2023-09-13T06:03:39.503 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:03:39.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717fabd640 1 Processor -- start 2023-09-13T06:03:39.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717fabd640 1 -- start start 2023-09-13T06:03:39.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717fabd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7178144c20 0x7f71780b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717fabd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f71780d0d10 0x7f71780b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717fabd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f717806d6e0 0x7f717806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717fabd640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717806e0b0 con 0x7f71780d0d10 2023-09-13T06:03:39.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717fabd640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71780b6230 con 0x7f717806d6e0 2023-09-13T06:03:39.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717fabd640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7178145000 con 0x7f7178144c20 2023-09-13T06:03:39.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717d058640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f71780d0d10 0x7f71780b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717d058640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f71780d0d10 0x7f71780b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57448/0 (socket says 172.21.15.130:57448) 2023-09-13T06:03:39.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717d058640 1 -- 172.21.15.130:0/1490419423 learned_addr learned my addr 172.21.15.130:0/1490419423 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:39.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717d859640 1 --2- 172.21.15.130:0/1490419423 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7178144c20 0x7f71780b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717e05a640 1 --2- 172.21.15.130:0/1490419423 >> v2:172.21.15.164:3300/0 conn(0x7f717806d6e0 0x7f717806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717d058640 1 -- 172.21.15.130:0/1490419423 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7178144c20 msgr2=0x7f71780b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:39.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717d058640 1 --2- 172.21.15.130:0/1490419423 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7178144c20 0x7f71780b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717d058640 1 -- 172.21.15.130:0/1490419423 >> v2:172.21.15.164:3300/0 conn(0x7f717806d6e0 msgr2=0x7f717806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:39.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717d058640 1 --2- 172.21.15.130:0/1490419423 >> v2:172.21.15.164:3300/0 conn(0x7f717806d6e0 0x7f717806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.639+0000 7f717d058640 1 -- 172.21.15.130:0/1490419423 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71780b5620 con 0x7f71780d0d10 2023-09-13T06:03:39.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717d058640 1 --2- 172.21.15.130:0/1490419423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71780d0d10 0x7f71780b66c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f71780728d0 tx=0x7f716801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c023a7fbc98e1d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:39.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717c857640 1 -- 172.21.15.130:0/1490419423 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680aa5f0 con 0x7f71780d0d10 2023-09-13T06:03:39.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717c857640 1 -- 172.21.15.130:0/1490419423 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71680aa750 con 0x7f71780d0d10 2023-09-13T06:03:39.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717c857640 1 -- 172.21.15.130:0/1490419423 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680aaae0 con 0x7f71780d0d10 2023-09-13T06:03:39.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717fabd640 1 -- 172.21.15.130:0/1490419423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71780d0d10 msgr2=0x7f71780b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717fabd640 1 --2- 172.21.15.130:0/1490419423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71780d0d10 0x7f71780b66c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f71780728d0 tx=0x7f716801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717fabd640 1 -- 172.21.15.130:0/1490419423 shutdown_connections 2023-09-13T06:03:39.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717fabd640 1 --2- 172.21.15.130:0/1490419423 >> v2:172.21.15.164:3300/0 conn(0x7f717806d6e0 0x7f717806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717fabd640 1 --2- 172.21.15.130:0/1490419423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71780d0d10 0x7f71780b66c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717fabd640 1 --2- 172.21.15.130:0/1490419423 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7178144c20 0x7f71780b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717fabd640 1 -- 172.21.15.130:0/1490419423 >> 172.21.15.130:0/1490419423 conn(0x7f717806a2f0 msgr2=0x7f717806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:39.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717fabd640 1 -- 172.21.15.130:0/1490419423 shutdown_connections 2023-09-13T06:03:39.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717fabd640 1 -- 172.21.15.130:0/1490419423 wait complete. 2023-09-13T06:03:39.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.643+0000 7f717fabd640 1 Processor -- start 2023-09-13T06:03:39.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717fabd640 1 -- start start 2023-09-13T06:03:39.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717fabd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f717806d6e0 0x7f7178070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717fabd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71780d0d10 0x7f717813e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717fabd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7178144c20 0x7f71781574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717fabd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717813cd60 con 0x7f71780d0d10 2023-09-13T06:03:39.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717fabd640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717813cfb0 con 0x7f7178144c20 2023-09-13T06:03:39.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717fabd640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717813d290 con 0x7f717806d6e0 2023-09-13T06:03:39.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717d058640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71780d0d10 0x7f717813e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717d058640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71780d0d10 0x7f717813e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57452/0 (socket says 172.21.15.130:57452) 2023-09-13T06:03:39.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717d058640 1 -- 172.21.15.130:0/3887890021 learned_addr learned my addr 172.21.15.130:0/3887890021 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:39.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717d859640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f717806d6e0 0x7f7178070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717e05a640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7178144c20 0x7f71781574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717d058640 1 -- 172.21.15.130:0/3887890021 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f717806d6e0 msgr2=0x7f7178070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717d058640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f717806d6e0 0x7f7178070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717d058640 1 -- 172.21.15.130:0/3887890021 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7178144c20 msgr2=0x7f71781574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717d058640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7178144c20 0x7f71781574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717d058640 1 -- 172.21.15.130:0/3887890021 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680094d0 con 0x7f71780d0d10 2023-09-13T06:03:39.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717e05a640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7178144c20 0x7f71781574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:39.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717d058640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71780d0d10 0x7f717813e280 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f716801ab80 tx=0x7f716801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:39.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f716e7fc640 1 -- 172.21.15.130:0/3887890021 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680aa5f0 con 0x7f71780d0d10 2023-09-13T06:03:39.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f716e7fc640 1 -- 172.21.15.130:0/3887890021 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71680b3800 con 0x7f71780d0d10 2023-09-13T06:03:39.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f716e7fc640 1 -- 172.21.15.130:0/3887890021 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680b3b90 con 0x7f71780d0d10 2023-09-13T06:03:39.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717fabd640 1 -- 172.21.15.130:0/3887890021 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717813d570 con 0x7f71780d0d10 2023-09-13T06:03:39.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717fabd640 1 -- 172.21.15.130:0/3887890021 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717813e7c0 con 0x7f71780d0d10 2023-09-13T06:03:39.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.647+0000 7f717fabd640 1 -- 172.21.15.130:0/3887890021 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71780618a0 con 0x7f71780d0d10 2023-09-13T06:03:39.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.651+0000 7f716e7fc640 1 -- 172.21.15.130:0/3887890021 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f71680b3cf0 con 0x7f71780d0d10 2023-09-13T06:03:39.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.651+0000 7f716e7fc640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f715c065b20 0x7f715c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.651+0000 7f716e7fc640 1 -- 172.21.15.130:0/3887890021 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f71680a7070 con 0x7f71780d0d10 2023-09-13T06:03:39.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.651+0000 7f717d859640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f715c065b20 0x7f715c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.651+0000 7f717d859640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f715c065b20 0x7f715c067fe0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f717400b930 tx=0x7f7174008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:39.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.655+0000 7f716e7fc640 1 -- 172.21.15.130:0/3887890021 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f71680eb760 con 0x7f71780d0d10 2023-09-13T06:03:39.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.807+0000 7f717fabd640 1 -- 172.21.15.130:0/3887890021 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f717806de70 con 0x7f71780d0d10 2023-09-13T06:03:39.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f716e7fc640 1 -- 172.21.15.130:0/3887890021 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f71680eed80 con 0x7f71780d0d10 2023-09-13T06:03:39.814 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:39.814 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":54,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:03:31.332756+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:53.311861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:53.919645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:03:39.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 -- 172.21.15.130:0/3887890021 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f715c065b20 msgr2=0x7f715c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f715c065b20 0x7f715c067fe0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f717400b930 tx=0x7f7174008040 comp rx=0 tx=0).stop 2023-09-13T06:03:39.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 -- 172.21.15.130:0/3887890021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71780d0d10 msgr2=0x7f717813e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71780d0d10 0x7f717813e280 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f716801ab80 tx=0x7f716801ad10 comp rx=0 tx=0).stop 2023-09-13T06:03:39.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 -- 172.21.15.130:0/3887890021 shutdown_connections 2023-09-13T06:03:39.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f715c065b20 0x7f715c067fe0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7178144c20 0x7f71781574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71780d0d10 0x7f717813e280 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 --2- 172.21.15.130:0/3887890021 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f717806d6e0 0x7f7178070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 -- 172.21.15.130:0/3887890021 >> 172.21.15.130:0/3887890021 conn(0x7f717806a2f0 msgr2=0x7f7178164ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:39.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 -- 172.21.15.130:0/3887890021 shutdown_connections 2023-09-13T06:03:39.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.811+0000 7f717fabd640 1 -- 172.21.15.130:0/3887890021 wait complete. 2023-09-13T06:03:39.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:02:53.311861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:02:53.919645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:03:39.836 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:03:39.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe12c12c640 1 Processor -- start 2023-09-13T06:03:39.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe12c12c640 1 -- start start 2023-09-13T06:03:39.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe12c12c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1240cca50 0x7fe1240ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe12c12c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1240b2620 con 0x7fe1241617f0 2023-09-13T06:03:39.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe12c12c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1240b1a80 con 0x7fe1240ce6c0 2023-09-13T06:03:39.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe12c12c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240b2ab0 con 0x7fe1240cca50 2023-09-13T06:03:39.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe129ec8640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe1241617f0 0x7fe1240cc340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55248/0 (socket says 172.21.15.130:55248) 2023-09-13T06:03:39.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe129ec8640 1 -- 172.21.15.130:0/259790703 learned_addr learned my addr 172.21.15.130:0/259790703 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:39.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe1296c7640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1240cca50 0x7fe1240ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053980022 0 0) 0x7fe1240b2620 con 0x7fe1241617f0 2023-09-13T06:03:39.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe110003530 con 0x7fe1241617f0 2023-09-13T06:03:39.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002776697 0 0) 0x7fe1240b1a80 con 0x7fe1240ce6c0 2023-09-13T06:03:39.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1240b2620 con 0x7fe1240ce6c0 2023-09-13T06:03:39.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2319818000 0 0) 0x7fe110003530 con 0x7fe1241617f0 2023-09-13T06:03:39.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1240cca50 msgr2=0x7fe1240ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:39.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1240cca50 0x7fe1240ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 >> v1:172.21.15.164:6789/0 conn(0x7fe1240ce6c0 legacy=0x7fe124161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1240b1cf0 con 0x7fe1241617f0 2023-09-13T06:03:39.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fe120001680 con 0x7fe1241617f0 2023-09-13T06:03:39.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe1296c7640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1240cca50 0x7fe1240ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:39.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 >> v1:172.21.15.130:6789/0 conn(0x7fe1241617f0 legacy=0x7fe1240cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 0x7fe110003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1240cca50 0x7fe1100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe110004d10 0x7fe110005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240b2ab0 con 0x7fe110003bb0 2023-09-13T06:03:39.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11000ba70 con 0x7fe110004d10 2023-09-13T06:03:39.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11000bc30 con 0x7fe1240cca50 2023-09-13T06:03:39.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe129ec8640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 0x7fe110003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe12a6c9640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe110004d10 0x7fe110005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe1296c7640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1240cca50 0x7fe1100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe129ec8640 1 -- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1240cca50 msgr2=0x7fe1100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:39.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe129ec8640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1240cca50 0x7fe1100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe129ec8640 1 -- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe110004d10 msgr2=0x7fe110005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:39.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe129ec8640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe110004d10 0x7fe110005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.975+0000 7fe129ec8640 1 -- 172.21.15.130:0/259790703 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe114009420 con 0x7fe110003bb0 2023-09-13T06:03:39.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.979+0000 7fe129ec8640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 0x7fe110003fb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe120001ec0 tx=0x7fe12001cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846c722045c1b0a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:39.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.979+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1200058e0 con 0x7fe110003bb0 2023-09-13T06:03:39.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.979+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe120005a60 con 0x7fe110003bb0 2023-09-13T06:03:39.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.979+0000 7fe128ec6640 1 -- 172.21.15.130:0/259790703 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120005e10 con 0x7fe110003bb0 2023-09-13T06:03:39.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.979+0000 7fe12c12c640 1 -- 172.21.15.130:0/259790703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 msgr2=0x7fe110003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.979+0000 7fe12c12c640 1 --2- 172.21.15.130:0/259790703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 0x7fe110003fb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe120001ec0 tx=0x7fe12001cb70 comp rx=0 tx=0).stop 2023-09-13T06:03:39.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.979+0000 7fe12a6c9640 1 -- 172.21.15.130:0/259790703 reap_dead start 2023-09-13T06:03:39.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.979+0000 7fe12c12c640 1 -- 172.21.15.130:0/259790703 shutdown_connections 2023-09-13T06:03:39.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.979+0000 7fe12c12c640 1 -- 172.21.15.130:0/259790703 >> 172.21.15.130:0/259790703 conn(0x7fe124065990 msgr2=0x7fe124065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:39.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.979+0000 7fe12c12c640 1 -- 172.21.15.130:0/259790703 shutdown_connections 2023-09-13T06:03:39.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.979+0000 7fe12c12c640 1 -- 172.21.15.130:0/259790703 wait complete. 2023-09-13T06:03:39.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12c12c640 1 Processor -- start 2023-09-13T06:03:39.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12c12c640 1 -- start start 2023-09-13T06:03:39.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12c12c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 0x7fe12414d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12c12c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe12414df60 0x7fe1241653c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12c12c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe12406d350 0x7fe12406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:39.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12c12c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12406dd10 con 0x7fe110003bb0 2023-09-13T06:03:39.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12c12c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe124166010 con 0x7fe12414df60 2023-09-13T06:03:39.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12c12c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1241fd5c0 con 0x7fe12406d350 2023-09-13T06:03:39.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe129ec8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 0x7fe12414d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe129ec8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 0x7fe12414d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57462/0 (socket says 172.21.15.130:57462) 2023-09-13T06:03:39.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe129ec8640 1 -- 172.21.15.130:0/2861261138 learned_addr learned my addr 172.21.15.130:0/2861261138 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:39.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12a6c9640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe12406d350 0x7fe12406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe1296c7640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe12414df60 0x7fe1241653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:39.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe129ec8640 1 -- 172.21.15.130:0/2861261138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe12406d350 msgr2=0x7fe12406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe129ec8640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe12406d350 0x7fe12406d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe129ec8640 1 -- 172.21.15.130:0/2861261138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe12414df60 msgr2=0x7fe1241653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:39.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe129ec8640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe12414df60 0x7fe1241653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:39.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe129ec8640 1 -- 172.21.15.130:0/2861261138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12414dca0 con 0x7fe110003bb0 2023-09-13T06:03:39.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12a6c9640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe12406d350 0x7fe12406d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:39.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe1296c7640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe12414df60 0x7fe1241653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:39.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe129ec8640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 0x7fe12414d760 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe1200ab040 tx=0x7fe110005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:39.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe11a7fc640 1 -- 172.21.15.130:0/2861261138 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1200047f0 con 0x7fe110003bb0 2023-09-13T06:03:39.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe11a7fc640 1 -- 172.21.15.130:0/2861261138 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe120004950 con 0x7fe110003bb0 2023-09-13T06:03:39.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12c12c640 1 -- 172.21.15.130:0/2861261138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe124165d30 con 0x7fe110003bb0 2023-09-13T06:03:39.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe11a7fc640 1 -- 172.21.15.130:0/2861261138 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120004ce0 con 0x7fe110003bb0 2023-09-13T06:03:39.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.983+0000 7fe12c12c640 1 -- 172.21.15.130:0/2861261138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1241fdaf0 con 0x7fe110003bb0 2023-09-13T06:03:39.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.987+0000 7fe12c12c640 1 -- 172.21.15.130:0/2861261138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1240618a0 con 0x7fe110003bb0 2023-09-13T06:03:39.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.987+0000 7fe11a7fc640 1 -- 172.21.15.130:0/2861261138 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe1200070d0 con 0x7fe110003bb0 2023-09-13T06:03:39.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.987+0000 7fe11a7fc640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe108065b50 0x7fe108068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.987+0000 7fe11a7fc640 1 -- 172.21.15.130:0/2861261138 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe12011c970 con 0x7fe110003bb0 2023-09-13T06:03:40.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.987+0000 7fe1296c7640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe108065b50 0x7fe108068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.987+0000 7fe1296c7640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe108065b50 0x7fe108068010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe1240b03b0 tx=0x7fe114008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:40.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:39.991+0000 7fe11a7fc640 1 -- 172.21.15.130:0/2861261138 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe1200ea1e0 con 0x7fe110003bb0 2023-09-13T06:03:40.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 -- 172.21.15.130:0/2861261138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe124160fd0 con 0x7fe110003bb0 2023-09-13T06:03:40.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe11a7fc640 1 -- 172.21.15.130:0/2861261138 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1200ed800 con 0x7fe110003bb0 2023-09-13T06:03:40.148 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:03:40.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 -- 172.21.15.130:0/2861261138 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe108065b50 msgr2=0x7fe108068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe108065b50 0x7fe108068010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe1240b03b0 tx=0x7fe114008040 comp rx=0 tx=0).stop 2023-09-13T06:03:40.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 -- 172.21.15.130:0/2861261138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 msgr2=0x7fe12414d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 0x7fe12414d760 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe1200ab040 tx=0x7fe110005800 comp rx=0 tx=0).stop 2023-09-13T06:03:40.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 -- 172.21.15.130:0/2861261138 shutdown_connections 2023-09-13T06:03:40.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe108065b50 0x7fe108068010 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe12414df60 0x7fe1241653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe12406d350 0x7fe12406d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 --2- 172.21.15.130:0/2861261138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe110003bb0 0x7fe12414d760 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 -- 172.21.15.130:0/2861261138 >> 172.21.15.130:0/2861261138 conn(0x7fe124065990 msgr2=0x7fe1240ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:40.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 -- 172.21.15.130:0/2861261138 shutdown_connections 2023-09-13T06:03:40.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.143+0000 7fe12c12c640 1 -- 172.21.15.130:0/2861261138 wait complete. 2023-09-13T06:03:40.168 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:03:40.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.303+0000 7f88423ac640 1 Processor -- start 2023-09-13T06:03:40.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.303+0000 7f88423ac640 1 -- start start 2023-09-13T06:03:40.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.303+0000 7f88423ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f883c154380 0x7f883c0b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.303+0000 7f88423ac640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f883c154760 0x7f883c070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f88423ac640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c0b2690 con 0x7f883c161140 2023-09-13T06:03:40.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f88423ac640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883c161700 con 0x7f883c154760 2023-09-13T06:03:40.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f88423ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c1619e0 con 0x7f883c154380 2023-09-13T06:03:40.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f8840949640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f883c161140 0x7f883c15e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55256/0 (socket says 172.21.15.130:55256) 2023-09-13T06:03:40.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f8840949640 1 -- 172.21.15.130:0/61647558 learned_addr learned my addr 172.21.15.130:0/61647558 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:40.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f883bfff640 1 --2- 172.21.15.130:0/61647558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f883c154380 0x7f883c0b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f883b7fe640 1 --2- 172.21.15.130:0/61647558 >> v2:172.21.15.164:3300/0 conn(0x7f883c154760 0x7f883c070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f883affd640 1 -- 172.21.15.130:0/61647558 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768668868 0 0) 0x7f883c0b2690 con 0x7f883c161140 2023-09-13T06:03:40.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f883affd640 1 -- 172.21.15.130:0/61647558 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8824003530 con 0x7f883c161140 2023-09-13T06:03:40.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f883bfff640 1 -- 172.21.15.130:0/61647558 >> v2:172.21.15.164:3300/0 conn(0x7f883c154760 msgr2=0x7f883c070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:40.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f883bfff640 1 --2- 172.21.15.130:0/61647558 >> v2:172.21.15.164:3300/0 conn(0x7f883c154760 0x7f883c070670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f883bfff640 1 -- 172.21.15.130:0/61647558 >> v1:172.21.15.130:6789/0 conn(0x7f883c161140 legacy=0x7f883c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.307+0000 7f883bfff640 1 -- 172.21.15.130:0/61647558 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c161cc0 con 0x7f883c154380 2023-09-13T06:03:40.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f883bfff640 1 --2- 172.21.15.130:0/61647558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f883c154380 0x7f883c0b2a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f882c0097c0 tx=0x7f882c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75477a357a347482 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:40.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f883affd640 1 -- 172.21.15.130:0/61647558 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ab600 con 0x7f883c154380 2023-09-13T06:03:40.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f883affd640 1 -- 172.21.15.130:0/61647558 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c0a7050 con 0x7f883c154380 2023-09-13T06:03:40.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f883affd640 1 -- 172.21.15.130:0/61647558 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ab980 con 0x7f883c154380 2023-09-13T06:03:40.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 -- 172.21.15.130:0/61647558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f883c154380 msgr2=0x7f883c0b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 --2- 172.21.15.130:0/61647558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f883c154380 0x7f883c0b2a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f882c0097c0 tx=0x7f882c01c3f0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 -- 172.21.15.130:0/61647558 shutdown_connections 2023-09-13T06:03:40.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 --2- 172.21.15.130:0/61647558 >> v2:172.21.15.164:3300/0 conn(0x7f883c154760 0x7f883c070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 --2- 172.21.15.130:0/61647558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f883c154380 0x7f883c0b2a80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 -- 172.21.15.130:0/61647558 >> 172.21.15.130:0/61647558 conn(0x7f883c065990 msgr2=0x7f883c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:40.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 -- 172.21.15.130:0/61647558 shutdown_connections 2023-09-13T06:03:40.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 -- 172.21.15.130:0/61647558 wait complete. 2023-09-13T06:03:40.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 Processor -- start 2023-09-13T06:03:40.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 -- start start 2023-09-13T06:03:40.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f883c154380 0x7f883c141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f883c154760 0x7f883c149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f883c161140 0x7f883c0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c142400 con 0x7f883c154760 2023-09-13T06:03:40.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0b2220 con 0x7f883c154380 2023-09-13T06:03:40.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.311+0000 7f88423ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0b2500 con 0x7f883c161140 2023-09-13T06:03:40.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f883b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f883c154760 0x7f883c149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f883b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f883c154760 0x7f883c149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57476/0 (socket says 172.21.15.130:57476) 2023-09-13T06:03:40.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f883b7fe640 1 -- 172.21.15.130:0/2669091084 learned_addr learned my addr 172.21.15.130:0/2669091084 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:40.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f883bfff640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f883c154380 0x7f883c141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f8840949640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f883c161140 0x7f883c0b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f883b7fe640 1 -- 172.21.15.130:0/2669091084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f883c161140 msgr2=0x7f883c0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f883b7fe640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f883c161140 0x7f883c0b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f883b7fe640 1 -- 172.21.15.130:0/2669091084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f883c154380 msgr2=0x7f883c141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f883b7fe640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f883c154380 0x7f883c141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f883b7fe640 1 -- 172.21.15.130:0/2669091084 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c009420 con 0x7f883c154760 2023-09-13T06:03:40.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f883b7fe640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f883c154760 0x7f883c149270 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f883000e870 tx=0x7f883000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:40.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f8838ff9640 1 -- 172.21.15.130:0/2669091084 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830009510 con 0x7f883c154760 2023-09-13T06:03:40.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f8838ff9640 1 -- 172.21.15.130:0/2669091084 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883000eec0 con 0x7f883c154760 2023-09-13T06:03:40.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f88423ac640 1 -- 172.21.15.130:0/2669091084 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c0b27e0 con 0x7f883c154760 2023-09-13T06:03:40.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f8838ff9640 1 -- 172.21.15.130:0/2669091084 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000cb40 con 0x7f883c154760 2023-09-13T06:03:40.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f88423ac640 1 -- 172.21.15.130:0/2669091084 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c154c70 con 0x7f883c154760 2023-09-13T06:03:40.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f88423ac640 1 -- 172.21.15.130:0/2669091084 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c0618a0 con 0x7f883c154760 2023-09-13T06:03:40.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f8838ff9640 1 -- 172.21.15.130:0/2669091084 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f883000cca0 con 0x7f883c154760 2023-09-13T06:03:40.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.315+0000 7f8838ff9640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8828065b20 0x7f8828067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.319+0000 7f8838ff9640 1 -- 172.21.15.130:0/2669091084 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8830083470 con 0x7f883c154760 2023-09-13T06:03:40.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.319+0000 7f883bfff640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8828065b20 0x7f8828067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.319+0000 7f883bfff640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8828065b20 0x7f8828067fe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f882c0ad000 tx=0x7f882c0a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:40.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.323+0000 7f8838ff9640 1 -- 172.21.15.130:0/2669091084 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8830050d80 con 0x7f883c154760 2023-09-13T06:03:40.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 -- 172.21.15.130:0/2669091084 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f883c1430c0 con 0x7f883c154760 2023-09-13T06:03:40.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f8838ff9640 1 -- 172.21.15.130:0/2669091084 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88300543a0 con 0x7f883c154760 2023-09-13T06:03:40.475 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:03:40.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 -- 172.21.15.130:0/2669091084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8828065b20 msgr2=0x7f8828067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8828065b20 0x7f8828067fe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f882c0ad000 tx=0x7f882c0a4f90 comp rx=0 tx=0).stop 2023-09-13T06:03:40.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 -- 172.21.15.130:0/2669091084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f883c154760 msgr2=0x7f883c149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f883c154760 0x7f883c149270 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f883000e870 tx=0x7f883000ec70 comp rx=0 tx=0).stop 2023-09-13T06:03:40.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 -- 172.21.15.130:0/2669091084 shutdown_connections 2023-09-13T06:03:40.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8828065b20 0x7f8828067fe0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f883c161140 0x7f883c0b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f883c154760 0x7f883c149270 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 --2- 172.21.15.130:0/2669091084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f883c154380 0x7f883c141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 -- 172.21.15.130:0/2669091084 >> 172.21.15.130:0/2669091084 conn(0x7f883c065990 msgr2=0x7f883c15e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:40.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 -- 172.21.15.130:0/2669091084 shutdown_connections 2023-09-13T06:03:40.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.471+0000 7f88423ac640 1 -- 172.21.15.130:0/2669091084 wait complete. 2023-09-13T06:03:40.496 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:03:40.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0f60d8640 1 Processor -- start 2023-09-13T06:03:40.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0f60d8640 1 -- start start 2023-09-13T06:03:40.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0f60d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb0f015ae10 0x7fb0f00d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0f60d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f00d2b00 0x7fb0f01612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0f60d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f015dd40 con 0x7fb0f01617e0 2023-09-13T06:03:40.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0f60d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f015e020 con 0x7fb0f015ae10 2023-09-13T06:03:40.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0f60d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f015e300 con 0x7fb0f00d2b00 2023-09-13T06:03:40.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0ef7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb0f015ae10 0x7fb0f00d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0ef7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb0f015ae10 0x7fb0f00d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57478/0 (socket says 172.21.15.130:57478) 2023-09-13T06:03:40.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0ef7fe640 1 -- 172.21.15.130:0/3489937846 learned_addr learned my addr 172.21.15.130:0/3489937846 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:40.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0e7fff640 1 --2- 172.21.15.130:0/3489937846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f00d2b00 0x7fb0f01612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0ef7fe640 1 -- 172.21.15.130:0/3489937846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f00d2b00 msgr2=0x7fb0f01612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:40.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0ef7fe640 1 --2- 172.21.15.130:0/3489937846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f00d2b00 0x7fb0f01612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0ef7fe640 1 -- 172.21.15.130:0/3489937846 >> v1:172.21.15.164:6789/0 conn(0x7fb0f01617e0 legacy=0x7fb0f00709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:40.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.635+0000 7fb0ef7fe640 1 -- 172.21.15.130:0/3489937846 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f015e5e0 con 0x7fb0f015ae10 2023-09-13T06:03:40.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0ef7fe640 1 --2- 172.21.15.130:0/3489937846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0f015ae10 0x7fb0f00d25c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009870 tx=0x7fb0e001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284af3fc00852779 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:40.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0eeffd640 1 -- 172.21.15.130:0/3489937846 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e00ad680 con 0x7fb0f015ae10 2023-09-13T06:03:40.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0eeffd640 1 -- 172.21.15.130:0/3489937846 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e00ad7e0 con 0x7fb0f015ae10 2023-09-13T06:03:40.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0eeffd640 1 -- 172.21.15.130:0/3489937846 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e00adb70 con 0x7fb0f015ae10 2023-09-13T06:03:40.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0f60d8640 1 -- 172.21.15.130:0/3489937846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0f015ae10 msgr2=0x7fb0f00d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0f60d8640 1 --2- 172.21.15.130:0/3489937846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0f015ae10 0x7fb0f00d25c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009870 tx=0x7fb0e001c3e0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0f60d8640 1 -- 172.21.15.130:0/3489937846 shutdown_connections 2023-09-13T06:03:40.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0f60d8640 1 --2- 172.21.15.130:0/3489937846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f00d2b00 0x7fb0f01612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0f60d8640 1 --2- 172.21.15.130:0/3489937846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0f015ae10 0x7fb0f00d25c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0f60d8640 1 -- 172.21.15.130:0/3489937846 >> 172.21.15.130:0/3489937846 conn(0x7fb0f0065990 msgr2=0x7fb0f0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:40.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0f60d8640 1 -- 172.21.15.130:0/3489937846 shutdown_connections 2023-09-13T06:03:40.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.639+0000 7fb0f60d8640 1 -- 172.21.15.130:0/3489937846 wait complete. 2023-09-13T06:03:40.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0f60d8640 1 Processor -- start 2023-09-13T06:03:40.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0f60d8640 1 -- start start 2023-09-13T06:03:40.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0f60d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f00d2b00 0x7fb0f01567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0f60d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0f015ae10 0x7fb0f0155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0f60d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0f01617e0 0x7fb0f0158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0f60d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f015a6d0 con 0x7fb0f015ae10 2023-09-13T06:03:40.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0f60d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0167d70 con 0x7fb0f01617e0 2023-09-13T06:03:40.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0f60d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0150d30 con 0x7fb0f00d2b00 2023-09-13T06:03:40.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0e7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0f015ae10 0x7fb0f0155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0e7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0f015ae10 0x7fb0f0155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57482/0 (socket says 172.21.15.130:57482) 2023-09-13T06:03:40.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0e7fff640 1 -- 172.21.15.130:0/1074185049 learned_addr learned my addr 172.21.15.130:0/1074185049 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:40.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0ef7fe640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f00d2b00 0x7fb0f01567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0effff640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0f01617e0 0x7fb0f0158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0e7fff640 1 -- 172.21.15.130:0/1074185049 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f00d2b00 msgr2=0x7fb0f01567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0e7fff640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f00d2b00 0x7fb0f01567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0e7fff640 1 -- 172.21.15.130:0/1074185049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0f01617e0 msgr2=0x7fb0f0158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0e7fff640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0f01617e0 0x7fb0f0158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0e7fff640 1 -- 172.21.15.130:0/1074185049 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e00094d0 con 0x7fb0f015ae10 2023-09-13T06:03:40.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0effff640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0f01617e0 0x7fb0f0158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:40.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0e7fff640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0f015ae10 0x7fb0f0155df0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800d800 tx=0x7fb0d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:40.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0ecff9640 1 -- 172.21.15.130:0/1074185049 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800b6c0 con 0x7fb0f015ae10 2023-09-13T06:03:40.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0ecff9640 1 -- 172.21.15.130:0/1074185049 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d800b820 con 0x7fb0f015ae10 2023-09-13T06:03:40.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0ecff9640 1 -- 172.21.15.130:0/1074185049 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800bb90 con 0x7fb0f015ae10 2023-09-13T06:03:40.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0f60d8640 1 -- 172.21.15.130:0/1074185049 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f0161df0 con 0x7fb0f015ae10 2023-09-13T06:03:40.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.643+0000 7fb0f60d8640 1 -- 172.21.15.130:0/1074185049 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f015f1f0 con 0x7fb0f015ae10 2023-09-13T06:03:40.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.647+0000 7fb0f60d8640 1 -- 172.21.15.130:0/1074185049 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f0167f00 con 0x7fb0f015ae10 2023-09-13T06:03:40.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.647+0000 7fb0ecff9640 1 -- 172.21.15.130:0/1074185049 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb0d800bcf0 con 0x7fb0f015ae10 2023-09-13T06:03:40.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.647+0000 7fb0ecff9640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0d0065b20 0x7fb0d0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.647+0000 7fb0ecff9640 1 -- 172.21.15.130:0/1074185049 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb0d8083820 con 0x7fb0f015ae10 2023-09-13T06:03:40.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.647+0000 7fb0ef7fe640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0d0065b20 0x7fb0d0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.647+0000 7fb0ef7fe640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0d0065b20 0x7fb0d0067fe0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00af000 tx=0x7fb0e00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:40.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.651+0000 7fb0ecff9640 1 -- 172.21.15.130:0/1074185049 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb0d8051120 con 0x7fb0f015ae10 2023-09-13T06:03:40.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.799+0000 7fb0f60d8640 1 -- 172.21.15.130:0/1074185049 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0f00618a0 con 0x7fb0f015ae10 2023-09-13T06:03:40.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.799+0000 7fb0ecff9640 1 -- 172.21.15.130:0/1074185049 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0d8054740 con 0x7fb0f015ae10 2023-09-13T06:03:40.806 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:03:40.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 -- 172.21.15.130:0/1074185049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0d0065b20 msgr2=0x7fb0d0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0d0065b20 0x7fb0d0067fe0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00af000 tx=0x7fb0e00a7000 comp rx=0 tx=0).stop 2023-09-13T06:03:40.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 -- 172.21.15.130:0/1074185049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0f015ae10 msgr2=0x7fb0f0155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0f015ae10 0x7fb0f0155df0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800d800 tx=0x7fb0d800dcc0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 -- 172.21.15.130:0/1074185049 shutdown_connections 2023-09-13T06:03:40.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0d0065b20 0x7fb0d0067fe0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0f01617e0 0x7fb0f0158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0f015ae10 0x7fb0f0155df0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 --2- 172.21.15.130:0/1074185049 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f00d2b00 0x7fb0f01567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 -- 172.21.15.130:0/1074185049 >> 172.21.15.130:0/1074185049 conn(0x7fb0f0065990 msgr2=0x7fb0f0156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:40.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 -- 172.21.15.130:0/1074185049 shutdown_connections 2023-09-13T06:03:40.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.803+0000 7fb0f60d8640 1 -- 172.21.15.130:0/1074185049 wait complete. 2023-09-13T06:03:40.826 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:03:40.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.959+0000 7fa9d42ec640 1 Processor -- start 2023-09-13T06:03:40.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.959+0000 7fa9d42ec640 1 -- start start 2023-09-13T06:03:40.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.959+0000 7fa9d42ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9cc0ceb90 0x7fa9cc0cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d42ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9cc06fe40 con 0x7fa9cc160ec0 2023-09-13T06:03:40.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d42ec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9cc15d9e0 con 0x7fa9cc0b2da0 2023-09-13T06:03:40.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d42ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc15e660 con 0x7fa9cc0ceb90 2023-09-13T06:03:40.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d1887640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9cc0ceb90 0x7fa9cc0cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d1887640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9cc0ceb90 0x7fa9cc0cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35872/0 (socket says 172.21.15.130:35872) 2023-09-13T06:03:40.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d1887640 1 -- 172.21.15.130:0/1622246087 learned_addr learned my addr 172.21.15.130:0/1622246087 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:40.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d2889640 1 --1- 172.21.15.130:0/1622246087 >> v1:172.21.15.130:6789/0 conn(0x7fa9cc160ec0 0x7fa9cc1612d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36436/0 (socket says 172.21.15.130:36436) 2023-09-13T06:03:40.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d1887640 1 -- 172.21.15.130:0/1622246087 >> v1:172.21.15.164:6789/0 conn(0x7fa9cc0b2da0 legacy=0x7fa9cc06f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:40.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d1887640 1 -- 172.21.15.130:0/1622246087 >> v1:172.21.15.130:6789/0 conn(0x7fa9cc160ec0 legacy=0x7fa9cc1612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d1086640 1 -- 172.21.15.130:0/1622246087 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466485796 0 0) 0x7fa9cc06fe40 con 0x7fa9cc160ec0 2023-09-13T06:03:40.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d1887640 1 -- 172.21.15.130:0/1622246087 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc15dcc0 con 0x7fa9cc0ceb90 2023-09-13T06:03:40.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d1887640 1 --2- 172.21.15.130:0/1622246087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9cc0ceb90 0x7fa9cc0cf020 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009870 tx=0x7fa9bc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc33eadf785874e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:40.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d1086640 1 -- 172.21.15.130:0/1622246087 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc0a8a30 con 0x7fa9cc0ceb90 2023-09-13T06:03:40.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d1086640 1 -- 172.21.15.130:0/1622246087 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9bc0a8b90 con 0x7fa9cc0ceb90 2023-09-13T06:03:40.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.963+0000 7fa9d1086640 1 -- 172.21.15.130:0/1622246087 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc0b0440 con 0x7fa9cc0ceb90 2023-09-13T06:03:40.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1622246087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9cc0ceb90 msgr2=0x7fa9cc0cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 --2- 172.21.15.130:0/1622246087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9cc0ceb90 0x7fa9cc0cf020 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009870 tx=0x7fa9bc01ed30 comp rx=0 tx=0).stop 2023-09-13T06:03:40.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1622246087 shutdown_connections 2023-09-13T06:03:40.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 --2- 172.21.15.130:0/1622246087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9cc0ceb90 0x7fa9cc0cf020 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1622246087 >> 172.21.15.130:0/1622246087 conn(0x7fa9cc06a2f0 msgr2=0x7fa9cc06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:40.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1622246087 shutdown_connections 2023-09-13T06:03:40.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1622246087 wait complete. 2023-09-13T06:03:40.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 Processor -- start 2023-09-13T06:03:40.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 -- start start 2023-09-13T06:03:40.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9cc0b2da0 0x7fa9cc155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9cc0ceb90 0x7fa9cc0c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9cc160ec0 0x7fa9cc0c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0d0ea0 con 0x7fa9cc0b2da0 2023-09-13T06:03:40.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc156220 con 0x7fa9cc160ec0 2023-09-13T06:03:40.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d42ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc13b960 con 0x7fa9cc0ceb90 2023-09-13T06:03:40.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d2088640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9cc0b2da0 0x7fa9cc155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d2088640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9cc0b2da0 0x7fa9cc155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35874/0 (socket says 172.21.15.130:35874) 2023-09-13T06:03:40.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d2088640 1 -- 172.21.15.130:0/1436220737 learned_addr learned my addr 172.21.15.130:0/1436220737 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:40.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d1887640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9cc0ceb90 0x7fa9cc0c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d2889640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9cc160ec0 0x7fa9cc0c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d2088640 1 -- 172.21.15.130:0/1436220737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9cc0ceb90 msgr2=0x7fa9cc0c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d2088640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9cc0ceb90 0x7fa9cc0c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d2088640 1 -- 172.21.15.130:0/1436220737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9cc160ec0 msgr2=0x7fa9cc0c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:40.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d2088640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9cc160ec0 0x7fa9cc0c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:40.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d2088640 1 -- 172.21.15.130:0/1436220737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc0094d0 con 0x7fa9cc0b2da0 2023-09-13T06:03:40.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d1887640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9cc0ceb90 0x7fa9cc0c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:40.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.967+0000 7fa9d2889640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9cc160ec0 0x7fa9cc0c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:40.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.971+0000 7fa9d2088640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9cc0b2da0 0x7fa9cc155ce0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800c500 tx=0x7fa9c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:40.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.971+0000 7fa9c2ffd640 1 -- 172.21.15.130:0/1436220737 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8005220 con 0x7fa9cc0b2da0 2023-09-13T06:03:40.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.971+0000 7fa9c2ffd640 1 -- 172.21.15.130:0/1436220737 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8005380 con 0x7fa9cc0b2da0 2023-09-13T06:03:40.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.971+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1436220737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc0c2d30 con 0x7fa9cc0b2da0 2023-09-13T06:03:40.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.971+0000 7fa9c2ffd640 1 -- 172.21.15.130:0/1436220737 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8007270 con 0x7fa9cc0b2da0 2023-09-13T06:03:40.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.971+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1436220737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc0c32b0 con 0x7fa9cc0b2da0 2023-09-13T06:03:40.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.971+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1436220737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc0618a0 con 0x7fa9cc0b2da0 2023-09-13T06:03:40.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.971+0000 7fa9c2ffd640 1 -- 172.21.15.130:0/1436220737 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa9c80073d0 con 0x7fa9cc0b2da0 2023-09-13T06:03:40.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.971+0000 7fa9c2ffd640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9b0065b20 0x7fa9b0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:40.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.971+0000 7fa9c2ffd640 1 -- 172.21.15.130:0/1436220737 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa9c8082d00 con 0x7fa9cc0b2da0 2023-09-13T06:03:40.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.971+0000 7fa9d1887640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9b0065b20 0x7fa9b0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:40.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.975+0000 7fa9d1887640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9b0065b20 0x7fa9b0067fe0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc0b2000 tx=0x7fa9bc0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:40.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:40.975+0000 7fa9c2ffd640 1 -- 172.21.15.130:0/1436220737 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa9c8050580 con 0x7fa9cc0b2da0 2023-09-13T06:03:41.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1436220737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9cc0cfbd0 con 0x7fa9cc0b2da0 2023-09-13T06:03:41.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9c2ffd640 1 -- 172.21.15.130:0/1436220737 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fa9c8053ba0 con 0x7fa9cc0b2da0 2023-09-13T06:03:41.159 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:41.160 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2126646405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2126646405},{"type":"v1","addr":"172.21.15.164:6835","nonce":2126646405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1274935773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1274935773},{"type":"v1","addr":"172.21.15.164:6834","nonce":1274935773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/4174632972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4174632972},{"type":"v1","addr":"172.21.15.130:6836","nonce":4174632972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:54.919386+0000","modified":"2023-09-13T06:02:57.960043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5613":{"gid":5613,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1098709916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1098709916},{"type":"v1","addr":"172.21.15.130:6837","nonce":1098709916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-13T06:03:41.160 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 25 2023-09-13T06:03:41.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1436220737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9b0065b20 msgr2=0x7fa9b0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9b0065b20 0x7fa9b0067fe0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc0b2000 tx=0x7fa9bc0aa070 comp rx=0 tx=0).stop 2023-09-13T06:03:41.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1436220737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9cc0b2da0 msgr2=0x7fa9cc155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9cc0b2da0 0x7fa9cc155ce0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800c500 tx=0x7fa9c800c9c0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1436220737 shutdown_connections 2023-09-13T06:03:41.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9b0065b20 0x7fa9b0067fe0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9cc160ec0 0x7fa9cc0c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9cc0ceb90 0x7fa9cc0c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 --2- 172.21.15.130:0/1436220737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9cc0b2da0 0x7fa9cc155ce0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1436220737 >> 172.21.15.130:0/1436220737 conn(0x7fa9cc06a2f0 msgr2=0x7fa9cc0ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:41.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1436220737 shutdown_connections 2023-09-13T06:03:41.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.155+0000 7fa9d42ec640 1 -- 172.21.15.130:0/1436220737 wait complete. 2023-09-13T06:03:41.179 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:03:41.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.311+0000 7feba4e0b640 1 Processor -- start 2023-09-13T06:03:41.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.311+0000 7feba4e0b640 1 -- start start 2023-09-13T06:03:41.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feba4e0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba00d1750 0x7feba015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:41.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feba4e0b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba00b63c0 con 0x7feba0146f30 2023-09-13T06:03:41.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feba4e0b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba00d0c20 con 0x7feba00d1090 2023-09-13T06:03:41.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feba4e0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba015dea0 con 0x7feba00d1750 2023-09-13T06:03:41.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feb9ed9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7feba0146f30 0x7feba00b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36442/0 (socket says 172.21.15.130:36442) 2023-09-13T06:03:41.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feb9ed9d640 1 -- 172.21.15.130:0/3871768303 learned_addr learned my addr 172.21.15.130:0/3871768303 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:41.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feb9e59c640 1 --2- 172.21.15.130:0/3871768303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba00d1750 0x7feba015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:41.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feb9dd9b640 1 -- 172.21.15.130:0/3871768303 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609465828 0 0) 0x7feba00b63c0 con 0x7feba0146f30 2023-09-13T06:03:41.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feb9dd9b640 1 -- 172.21.15.130:0/3871768303 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb8c003530 con 0x7feba0146f30 2023-09-13T06:03:41.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feb9dd9b640 1 -- 172.21.15.130:0/3871768303 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418926803 0 0) 0x7feba00d0c20 con 0x7feba00d1090 2023-09-13T06:03:41.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feb9dd9b640 1 -- 172.21.15.130:0/3871768303 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feba00b63c0 con 0x7feba00d1090 2023-09-13T06:03:41.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feb9e59c640 1 -- 172.21.15.130:0/3871768303 >> v1:172.21.15.164:6789/0 conn(0x7feba00d1090 legacy=0x7feba0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feb9e59c640 1 -- 172.21.15.130:0/3871768303 >> v1:172.21.15.130:6789/0 conn(0x7feba0146f30 legacy=0x7feba00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feb9dd9b640 1 -- 172.21.15.130:0/3871768303 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2256147949 0 0) 0x7feb8c003530 con 0x7feba0146f30 2023-09-13T06:03:41.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.315+0000 7feb9e59c640 1 -- 172.21.15.130:0/3871768303 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00b6610 con 0x7feba00d1750 2023-09-13T06:03:41.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feb9e59c640 1 --2- 172.21.15.130:0/3871768303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba00d1750 0x7feba015d960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feb900097f0 tx=0x7feb9001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73163d6c25ddc383 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:41.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feb9dd9b640 1 -- 172.21.15.130:0/3871768303 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98001a00 con 0x7feba00d1750 2023-09-13T06:03:41.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feb9dd9b640 1 -- 172.21.15.130:0/3871768303 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb900a7050 con 0x7feba00d1750 2023-09-13T06:03:41.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feb9dd9b640 1 -- 172.21.15.130:0/3871768303 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900ab600 con 0x7feba00d1750 2023-09-13T06:03:41.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feba4e0b640 1 -- 172.21.15.130:0/3871768303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba00d1750 msgr2=0x7feba015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feba4e0b640 1 --2- 172.21.15.130:0/3871768303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba00d1750 0x7feba015d960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feb900097f0 tx=0x7feb9001c3b0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feba4e0b640 1 -- 172.21.15.130:0/3871768303 shutdown_connections 2023-09-13T06:03:41.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feba4e0b640 1 --2- 172.21.15.130:0/3871768303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba00d1750 0x7feba015d960 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feba4e0b640 1 -- 172.21.15.130:0/3871768303 >> 172.21.15.130:0/3871768303 conn(0x7feba006f170 msgr2=0x7feba006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:41.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feba4e0b640 1 -- 172.21.15.130:0/3871768303 shutdown_connections 2023-09-13T06:03:41.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feba4e0b640 1 -- 172.21.15.130:0/3871768303 wait complete. 2023-09-13T06:03:41.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.319+0000 7feba4e0b640 1 Processor -- start 2023-09-13T06:03:41.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feba4e0b640 1 -- start start 2023-09-13T06:03:41.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feba4e0b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feba00d1090 0x7feba015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:41.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feba4e0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba00d1750 0x7feba0157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:41.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feba4e0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba0146f30 0x7feba0157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:41.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feba4e0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba015bdc0 con 0x7feba00d1750 2023-09-13T06:03:41.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feba4e0b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba015b1b0 con 0x7feba00d1090 2023-09-13T06:03:41.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feba4e0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba015b490 con 0x7feba0146f30 2023-09-13T06:03:41.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb97fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba00d1750 0x7feba0157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:41.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb97fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba00d1750 0x7feba0157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35876/0 (socket says 172.21.15.130:35876) 2023-09-13T06:03:41.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb97fff640 1 -- 172.21.15.130:0/3739141610 learned_addr learned my addr 172.21.15.130:0/3739141610 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:41.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb9ed9d640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba0146f30 0x7feba0157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:41.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb9e59c640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feba00d1090 0x7feba015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:41.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb97fff640 1 -- 172.21.15.130:0/3739141610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba0146f30 msgr2=0x7feba0157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb97fff640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba0146f30 0x7feba0157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb97fff640 1 -- 172.21.15.130:0/3739141610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feba00d1090 msgr2=0x7feba015ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb97fff640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feba00d1090 0x7feba015ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb97fff640 1 -- 172.21.15.130:0/3739141610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009420 con 0x7feba00d1750 2023-09-13T06:03:41.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb9ed9d640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba0146f30 0x7feba0157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:41.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb97fff640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba00d1750 0x7feba0157730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c500 tx=0x7feb8800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:41.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb96ffd640 1 -- 172.21.15.130:0/3739141610 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880052d0 con 0x7feba00d1750 2023-09-13T06:03:41.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb96ffd640 1 -- 172.21.15.130:0/3739141610 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb88005450 con 0x7feba00d1750 2023-09-13T06:03:41.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feb96ffd640 1 -- 172.21.15.130:0/3739141610 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88012870 con 0x7feba00d1750 2023-09-13T06:03:41.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feba4e0b640 1 -- 172.21.15.130:0/3739141610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba015b770 con 0x7feba00d1750 2023-09-13T06:03:41.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feba4e0b640 1 -- 172.21.15.130:0/3739141610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba015f470 con 0x7feba00d1750 2023-09-13T06:03:41.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.323+0000 7feba4e0b640 1 -- 172.21.15.130:0/3739141610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba015bf70 con 0x7feba00d1750 2023-09-13T06:03:41.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.327+0000 7feb96ffd640 1 -- 172.21.15.130:0/3739141610 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7feb880129d0 con 0x7feba00d1750 2023-09-13T06:03:41.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.327+0000 7feb96ffd640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb80065b20 0x7feb80067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:41.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.327+0000 7feb96ffd640 1 -- 172.21.15.130:0/3739141610 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7feb88082fa0 con 0x7feba00d1750 2023-09-13T06:03:41.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.327+0000 7feb9e59c640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb80065b20 0x7feb80067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:41.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.327+0000 7feb9e59c640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb80065b20 0x7feb80067fe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feb900ad000 tx=0x7feb900a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:41.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.331+0000 7feb96ffd640 1 -- 172.21.15.130:0/3739141610 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7feba015bf70 con 0x7feba00d1750 2023-09-13T06:03:41.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.483+0000 7feba4e0b640 1 -- 172.21.15.130:0/3739141610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feba00618a0 con 0x7feba00d1750 2023-09-13T06:03:41.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feb96ffd640 1 -- 172.21.15.130:0/3739141610 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16641 (secure 0 0 0) 0x7feb880542b0 con 0x7feba00d1750 2023-09-13T06:03:41.491 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:41.491 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":54,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:03:31.332756+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:53.311861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:53.919645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:03:41.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 -- 172.21.15.130:0/3739141610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb80065b20 msgr2=0x7feb80067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb80065b20 0x7feb80067fe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feb900ad000 tx=0x7feb900a6000 comp rx=0 tx=0).stop 2023-09-13T06:03:41.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 -- 172.21.15.130:0/3739141610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba00d1750 msgr2=0x7feba0157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba00d1750 0x7feba0157730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c500 tx=0x7feb8800c9c0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 -- 172.21.15.130:0/3739141610 shutdown_connections 2023-09-13T06:03:41.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb80065b20 0x7feb80067fe0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feba0146f30 0x7feba0157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feba00d1750 0x7feba0157730 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 --2- 172.21.15.130:0/3739141610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feba00d1090 0x7feba015ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 -- 172.21.15.130:0/3739141610 >> 172.21.15.130:0/3739141610 conn(0x7feba006f170 msgr2=0x7feba015dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:41.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 -- 172.21.15.130:0/3739141610 shutdown_connections 2023-09-13T06:03:41.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.487+0000 7feba4e0b640 1 -- 172.21.15.130:0/3739141610 wait complete. 2023-09-13T06:03:41.512 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:03:41.513 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:03:41.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09feb11640 1 Processor -- start 2023-09-13T06:03:41.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09feb11640 1 -- start start 2023-09-13T06:03:41.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09feb11640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f09f8159f20 0x7f09f80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:41.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09feb11640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f80ccfd0 con 0x7f09f80cdfc0 2023-09-13T06:03:41.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09feb11640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f80ced90 con 0x7f09f80b1d20 2023-09-13T06:03:41.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09feb11640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f80b00f0 con 0x7f09f8159f20 2023-09-13T06:03:41.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09effff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f09f80cdfc0 0x7f09f80b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36456/0 (socket says 172.21.15.130:36456) 2023-09-13T06:03:41.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09effff640 1 -- 172.21.15.130:0/2036666200 learned_addr learned my addr 172.21.15.130:0/2036666200 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:41.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09fc8ad640 1 --2- 172.21.15.130:0/2036666200 >> v2:172.21.15.164:3300/0 conn(0x7f09f8159f20 0x7f09f80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:41.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09ef7fe640 1 -- 172.21.15.130:0/2036666200 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462479009 0 0) 0x7f09f80ccfd0 con 0x7f09f80cdfc0 2023-09-13T06:03:41.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09ef7fe640 1 -- 172.21.15.130:0/2036666200 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09e0003530 con 0x7f09f80cdfc0 2023-09-13T06:03:41.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09fc8ad640 1 -- 172.21.15.130:0/2036666200 >> v1:172.21.15.164:6789/0 conn(0x7f09f80b1d20 legacy=0x7f09f80ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09fc8ad640 1 -- 172.21.15.130:0/2036666200 >> v1:172.21.15.130:6789/0 conn(0x7f09f80cdfc0 legacy=0x7f09f80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.647+0000 7f09fc8ad640 1 -- 172.21.15.130:0/2036666200 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f80cd200 con 0x7f09f8159f20 2023-09-13T06:03:41.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.651+0000 7f09fc8ad640 1 --2- 172.21.15.130:0/2036666200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09f8159f20 0x7f09f80ce7b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f09f40097c0 tx=0x7f09f401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35190f45ac0ff600 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:41.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.651+0000 7f09ef7fe640 1 -- 172.21.15.130:0/2036666200 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40ab680 con 0x7f09f8159f20 2023-09-13T06:03:41.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.651+0000 7f09ef7fe640 1 -- 172.21.15.130:0/2036666200 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f40ab7e0 con 0x7f09f8159f20 2023-09-13T06:03:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.651+0000 7f09ef7fe640 1 -- 172.21.15.130:0/2036666200 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40abb50 con 0x7f09f8159f20 2023-09-13T06:03:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.651+0000 7f09feb11640 1 -- 172.21.15.130:0/2036666200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09f8159f20 msgr2=0x7f09f80ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.651+0000 7f09feb11640 1 --2- 172.21.15.130:0/2036666200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09f8159f20 0x7f09f80ce7b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f09f40097c0 tx=0x7f09f401c480 comp rx=0 tx=0).stop 2023-09-13T06:03:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.651+0000 7f09feb11640 1 -- 172.21.15.130:0/2036666200 shutdown_connections 2023-09-13T06:03:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.651+0000 7f09feb11640 1 --2- 172.21.15.130:0/2036666200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09f8159f20 0x7f09f80ce7b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.651+0000 7f09feb11640 1 -- 172.21.15.130:0/2036666200 >> 172.21.15.130:0/2036666200 conn(0x7f09f8065990 msgr2=0x7f09f8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:41.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.651+0000 7f09feb11640 1 -- 172.21.15.130:0/2036666200 shutdown_connections 2023-09-13T06:03:41.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.651+0000 7f09feb11640 1 -- 172.21.15.130:0/2036666200 wait complete. 2023-09-13T06:03:41.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09feb11640 1 Processor -- start 2023-09-13T06:03:41.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09feb11640 1 -- start start 2023-09-13T06:03:41.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09feb11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f80b1d20 0x7f09f814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:41.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09feb11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09f80cdfc0 0x7f09f814bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:41.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09feb11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09f8159f20 0x7f09f8157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:41.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09feb11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f814f270 con 0x7f09f80b1d20 2023-09-13T06:03:41.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09feb11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f8152b30 con 0x7f09f80cdfc0 2023-09-13T06:03:41.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09feb11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f8152e10 con 0x7f09f8159f20 2023-09-13T06:03:41.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09fc8ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f80b1d20 0x7f09f814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:41.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09fc8ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f80b1d20 0x7f09f814ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35888/0 (socket says 172.21.15.130:35888) 2023-09-13T06:03:41.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09fc8ad640 1 -- 172.21.15.130:0/4172722731 learned_addr learned my addr 172.21.15.130:0/4172722731 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:41.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09effff640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09f80cdfc0 0x7f09f814bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:41.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09fd0ae640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09f8159f20 0x7f09f8157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:41.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09fc8ad640 1 -- 172.21.15.130:0/4172722731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09f8159f20 msgr2=0x7f09f8157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09fc8ad640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09f8159f20 0x7f09f8157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09fc8ad640 1 -- 172.21.15.130:0/4172722731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09f80cdfc0 msgr2=0x7f09f814bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09fc8ad640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09f80cdfc0 0x7f09f814bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09fc8ad640 1 -- 172.21.15.130:0/4172722731 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4009420 con 0x7f09f80b1d20 2023-09-13T06:03:41.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09fd0ae640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09f8159f20 0x7f09f8157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:41.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.655+0000 7f09fc8ad640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f80b1d20 0x7f09f814ed30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f09f4019090 tx=0x7f09f401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:41.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.659+0000 7f09ed7fa640 1 -- 172.21.15.130:0/4172722731 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4004230 con 0x7f09f80b1d20 2023-09-13T06:03:41.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.659+0000 7f09ed7fa640 1 -- 172.21.15.130:0/4172722731 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f40b9070 con 0x7f09f80b1d20 2023-09-13T06:03:41.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.659+0000 7f09feb11640 1 -- 172.21.15.130:0/4172722731 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f81530f0 con 0x7f09f80b1d20 2023-09-13T06:03:41.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.659+0000 7f09ed7fa640 1 -- 172.21.15.130:0/4172722731 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4003620 con 0x7f09f80b1d20 2023-09-13T06:03:41.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.659+0000 7f09feb11640 1 -- 172.21.15.130:0/4172722731 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f81536b0 con 0x7f09f80b1d20 2023-09-13T06:03:41.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.659+0000 7f09feb11640 1 -- 172.21.15.130:0/4172722731 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f80618a0 con 0x7f09f80b1d20 2023-09-13T06:03:41.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.659+0000 7f09ed7fa640 1 -- 172.21.15.130:0/4172722731 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f09f4003780 con 0x7f09f80b1d20 2023-09-13T06:03:41.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.659+0000 7f09ed7fa640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09e4065b20 0x7f09e4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:41.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.659+0000 7f09ed7fa640 1 -- 172.21.15.130:0/4172722731 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f09f40bb070 con 0x7f09f80b1d20 2023-09-13T06:03:41.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.659+0000 7f09effff640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09e4065b20 0x7f09e4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:41.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.659+0000 7f09effff640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09e4065b20 0x7f09e4067fe0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f09f80cea90 tx=0x7f09e8007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:41.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.663+0000 7f09ed7fa640 1 -- 172.21.15.130:0/4172722731 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f09f40eba50 con 0x7f09f80b1d20 2023-09-13T06:03:41.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.839+0000 7f09feb11640 1 -- 172.21.15.130:0/4172722731 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09f806fea0 con 0x7f09f80b1d20 2023-09-13T06:03:41.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09ed7fa640 1 -- 172.21.15.130:0/4172722731 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f09f40c4070 con 0x7f09f80b1d20 2023-09-13T06:03:41.846 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:41.847 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2126646405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2126646405},{"type":"v1","addr":"172.21.15.164:6835","nonce":2126646405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1274935773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1274935773},{"type":"v1","addr":"172.21.15.164:6834","nonce":1274935773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/4174632972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4174632972},{"type":"v1","addr":"172.21.15.130:6836","nonce":4174632972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:54.919386+0000","modified":"2023-09-13T06:02:57.960043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5613":{"gid":5613,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1098709916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1098709916},{"type":"v1","addr":"172.21.15.130:6837","nonce":1098709916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-13T06:03:41.848 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 25 2023-09-13T06:03:41.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 -- 172.21.15.130:0/4172722731 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09e4065b20 msgr2=0x7f09e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09e4065b20 0x7f09e4067fe0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f09f80cea90 tx=0x7f09e8007d40 comp rx=0 tx=0).stop 2023-09-13T06:03:41.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 -- 172.21.15.130:0/4172722731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f80b1d20 msgr2=0x7f09f814ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:41.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f80b1d20 0x7f09f814ed30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f09f4019090 tx=0x7f09f401acc0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 -- 172.21.15.130:0/4172722731 shutdown_connections 2023-09-13T06:03:41.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f09e4065b20 0x7f09e4067fe0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09f80cdfc0 0x7f09f814bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09f8159f20 0x7f09f8157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 --2- 172.21.15.130:0/4172722731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f80b1d20 0x7f09f814ed30 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:41.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 -- 172.21.15.130:0/4172722731 >> 172.21.15.130:0/4172722731 conn(0x7f09f8065990 msgr2=0x7f09f80a84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:41.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 -- 172.21.15.130:0/4172722731 shutdown_connections 2023-09-13T06:03:41.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.843+0000 7f09feb11640 1 -- 172.21.15.130:0/4172722731 wait complete. 2023-09-13T06:03:41.867 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:03:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.999+0000 7fdcbbad8640 1 Processor -- start 2023-09-13T06:03:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:41.999+0000 7fdcbbad8640 1 -- start start 2023-09-13T06:03:42.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcbbad8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdcb415b130 0x7fdcb40cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcbbad8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb40ce980 con 0x7fdcb40b04a0 2023-09-13T06:03:42.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcbbad8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb40cec60 con 0x7fdcb40ce180 2023-09-13T06:03:42.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcbbad8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb406c640 con 0x7fdcb415b130 2023-09-13T06:03:42.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcb9874640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdcb415b130 0x7fdcb40cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcb9874640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdcb415b130 0x7fdcb40cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35902/0 (socket says 172.21.15.130:35902) 2023-09-13T06:03:42.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcb9874640 1 -- 172.21.15.130:0/1245865406 learned_addr learned my addr 172.21.15.130:0/1245865406 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:42.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcba075640 1 --1- 172.21.15.130:0/1245865406 >> v1:172.21.15.130:6789/0 conn(0x7fdcb40b04a0 0x7fdcb406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36460/0 (socket says 172.21.15.130:36460) 2023-09-13T06:03:42.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcb9874640 1 -- 172.21.15.130:0/1245865406 >> v1:172.21.15.164:6789/0 conn(0x7fdcb40ce180 legacy=0x7fdcb415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcb9874640 1 -- 172.21.15.130:0/1245865406 >> v1:172.21.15.130:6789/0 conn(0x7fdcb40b04a0 legacy=0x7fdcb406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcb9874640 1 -- 172.21.15.130:0/1245865406 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb406c920 con 0x7fdcb415b130 2023-09-13T06:03:42.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.003+0000 7fdcb8872640 1 -- 172.21.15.130:0/1245865406 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769263399 0 0) 0x7fdcb40ce980 con 0x7fdcb40b04a0 2023-09-13T06:03:42.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcb9874640 1 --2- 172.21.15.130:0/1245865406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb415b130 0x7fdcb40cc780 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009870 tx=0x7fdcb001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecd52eb98cc41a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:42.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcb8872640 1 -- 172.21.15.130:0/1245865406 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00a95f0 con 0x7fdcb415b130 2023-09-13T06:03:42.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcb8872640 1 -- 172.21.15.130:0/1245865406 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb00a9750 con 0x7fdcb415b130 2023-09-13T06:03:42.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcb8872640 1 -- 172.21.15.130:0/1245865406 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00a9ae0 con 0x7fdcb415b130 2023-09-13T06:03:42.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcbbad8640 1 -- 172.21.15.130:0/1245865406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb415b130 msgr2=0x7fdcb40cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcbbad8640 1 --2- 172.21.15.130:0/1245865406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb415b130 0x7fdcb40cc780 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009870 tx=0x7fdcb001c540 comp rx=0 tx=0).stop 2023-09-13T06:03:42.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcbbad8640 1 -- 172.21.15.130:0/1245865406 shutdown_connections 2023-09-13T06:03:42.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcbbad8640 1 --2- 172.21.15.130:0/1245865406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb415b130 0x7fdcb40cc780 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcbbad8640 1 -- 172.21.15.130:0/1245865406 >> 172.21.15.130:0/1245865406 conn(0x7fdcb4065990 msgr2=0x7fdcb4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcbbad8640 1 -- 172.21.15.130:0/1245865406 shutdown_connections 2023-09-13T06:03:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcbbad8640 1 -- 172.21.15.130:0/1245865406 wait complete. 2023-09-13T06:03:42.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcbbad8640 1 Processor -- start 2023-09-13T06:03:42.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcbbad8640 1 -- start start 2023-09-13T06:03:42.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.007+0000 7fdcbbad8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb40b04a0 0x7fdcb41573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcbbad8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb40ce180 0x7fdcb40ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcbbad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb415b130 0x7fdcb40acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcbbad8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb41f5c10 con 0x7fdcb40ce180 2023-09-13T06:03:42.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcbbad8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb4146740 con 0x7fdcb40b04a0 2023-09-13T06:03:42.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcbbad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb4146e30 con 0x7fdcb415b130 2023-09-13T06:03:42.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcb9073640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb40ce180 0x7fdcb40ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcb9073640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb40ce180 0x7fdcb40ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35906/0 (socket says 172.21.15.130:35906) 2023-09-13T06:03:42.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcb9073640 1 -- 172.21.15.130:0/2530156764 learned_addr learned my addr 172.21.15.130:0/2530156764 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:42.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcb9874640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb40b04a0 0x7fdcb41573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcba075640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb415b130 0x7fdcb40acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcb9073640 1 -- 172.21.15.130:0/2530156764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb415b130 msgr2=0x7fdcb40acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcb9073640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb415b130 0x7fdcb40acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcb9073640 1 -- 172.21.15.130:0/2530156764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb40b04a0 msgr2=0x7fdcb41573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcb9073640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb40b04a0 0x7fdcb41573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcb9073640 1 -- 172.21.15.130:0/2530156764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb00094d0 con 0x7fdcb40ce180 2023-09-13T06:03:42.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcb9073640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb40ce180 0x7fdcb40ac840 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c500 tx=0x7fdca400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:42.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcaa7fc640 1 -- 172.21.15.130:0/2530156764 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4005220 con 0x7fdcb40ce180 2023-09-13T06:03:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcaa7fc640 1 -- 172.21.15.130:0/2530156764 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca4005380 con 0x7fdcb40ce180 2023-09-13T06:03:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcbbad8640 1 -- 172.21.15.130:0/2530156764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb406d4e0 con 0x7fdcb40ce180 2023-09-13T06:03:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcaa7fc640 1 -- 172.21.15.130:0/2530156764 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4007270 con 0x7fdcb40ce180 2023-09-13T06:03:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcbbad8640 1 -- 172.21.15.130:0/2530156764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb40af7b0 con 0x7fdcb40ce180 2023-09-13T06:03:42.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcbbad8640 1 -- 172.21.15.130:0/2530156764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb4146bd0 con 0x7fdcb40ce180 2023-09-13T06:03:42.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcaa7fc640 1 -- 172.21.15.130:0/2530156764 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdca40073d0 con 0x7fdcb40ce180 2023-09-13T06:03:42.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.011+0000 7fdcaa7fc640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc98065b20 0x7fdc98067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.015+0000 7fdcaa7fc640 1 -- 172.21.15.130:0/2530156764 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdca4082c20 con 0x7fdcb40ce180 2023-09-13T06:03:42.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.015+0000 7fdcb9874640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc98065b20 0x7fdc98067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.015+0000 7fdcb9874640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc98065b20 0x7fdc98067fe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00ae000 tx=0x7fdcb00b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:42.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.015+0000 7fdcaa7fc640 1 -- 172.21.15.130:0/2530156764 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdca40504a0 con 0x7fdcb40ce180 2023-09-13T06:03:42.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 -- 172.21.15.130:0/2530156764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcb40b23a0 con 0x7fdcb40ce180 2023-09-13T06:03:42.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcaa7fc640 1 -- 172.21.15.130:0/2530156764 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fdca4057350 con 0x7fdcb40ce180 2023-09-13T06:03:42.207 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:42.207 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2126646405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2126646405},{"type":"v1","addr":"172.21.15.164:6835","nonce":2126646405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1274935773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1274935773},{"type":"v1","addr":"172.21.15.164:6834","nonce":1274935773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/4174632972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4174632972},{"type":"v1","addr":"172.21.15.130:6836","nonce":4174632972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:02:54.919386+0000","modified":"2023-09-13T06:02:57.960043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5613":{"gid":5613,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/1098709916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1098709916},{"type":"v1","addr":"172.21.15.130:6837","nonce":1098709916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-13T06:03:42.208 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 25 2023-09-13T06:03:42.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 -- 172.21.15.130:0/2530156764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc98065b20 msgr2=0x7fdc98067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc98065b20 0x7fdc98067fe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00ae000 tx=0x7fdcb00b3040 comp rx=0 tx=0).stop 2023-09-13T06:03:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 -- 172.21.15.130:0/2530156764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb40ce180 msgr2=0x7fdcb40ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb40ce180 0x7fdcb40ac840 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c500 tx=0x7fdca400c9c0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 -- 172.21.15.130:0/2530156764 shutdown_connections 2023-09-13T06:03:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc98065b20 0x7fdc98067fe0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb415b130 0x7fdcb40acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb40ce180 0x7fdcb40ac840 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 --2- 172.21.15.130:0/2530156764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb40b04a0 0x7fdcb41573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 -- 172.21.15.130:0/2530156764 >> 172.21.15.130:0/2530156764 conn(0x7fdcb4065990 msgr2=0x7fdcb415a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:42.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 -- 172.21.15.130:0/2530156764 shutdown_connections 2023-09-13T06:03:42.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.203+0000 7fdcbbad8640 1 -- 172.21.15.130:0/2530156764 wait complete. 2023-09-13T06:03:42.227 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:03:42.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.359+0000 7f5e48ad8640 1 Processor -- start 2023-09-13T06:03:42.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e48ad8640 1 -- start start 2023-09-13T06:03:42.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e48ad8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5e44146cf0 0x7f5e440c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e48ad8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440c4150 con 0x7f5e441610a0 2023-09-13T06:03:42.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e48ad8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440c4430 con 0x7f5e440cd170 2023-09-13T06:03:42.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e48ad8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4406f170 con 0x7f5e44146cf0 2023-09-13T06:03:42.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e3bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5e441610a0 0x7f5e440cca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36468/0 (socket says 172.21.15.130:36468) 2023-09-13T06:03:42.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e3bfff640 1 -- 172.21.15.130:0/2008416726 learned_addr learned my addr 172.21.15.130:0/2008416726 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:42.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e4259c640 1 --2- 172.21.15.130:0/2008416726 >> v2:172.21.15.164:3300/0 conn(0x7f5e44146cf0 0x7f5e440c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e41d9b640 1 -- 172.21.15.130:0/2008416726 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688869127 0 0) 0x7f5e440c4150 con 0x7f5e441610a0 2023-09-13T06:03:42.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e41d9b640 1 -- 172.21.15.130:0/2008416726 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e30003530 con 0x7f5e441610a0 2023-09-13T06:03:42.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e4259c640 1 -- 172.21.15.130:0/2008416726 >> v1:172.21.15.164:6789/0 conn(0x7f5e440cd170 legacy=0x7f5e4406f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e4259c640 1 -- 172.21.15.130:0/2008416726 >> v1:172.21.15.130:6789/0 conn(0x7f5e441610a0 legacy=0x7f5e440cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.363+0000 7f5e4259c640 1 -- 172.21.15.130:0/2008416726 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440c4710 con 0x7f5e44146cf0 2023-09-13T06:03:42.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.367+0000 7f5e4259c640 1 --2- 172.21.15.130:0/2008416726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e44146cf0 0x7f5e440c38e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5e340097c0 tx=0x7f5e3401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b724697f128544c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:42.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.367+0000 7f5e41d9b640 1 -- 172.21.15.130:0/2008416726 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340ad660 con 0x7f5e44146cf0 2023-09-13T06:03:42.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.367+0000 7f5e41d9b640 1 -- 172.21.15.130:0/2008416726 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e340ad7c0 con 0x7f5e44146cf0 2023-09-13T06:03:42.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.367+0000 7f5e41d9b640 1 -- 172.21.15.130:0/2008416726 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340adb50 con 0x7f5e44146cf0 2023-09-13T06:03:42.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.367+0000 7f5e48ad8640 1 -- 172.21.15.130:0/2008416726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e44146cf0 msgr2=0x7f5e440c38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.367+0000 7f5e48ad8640 1 --2- 172.21.15.130:0/2008416726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e44146cf0 0x7f5e440c38e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5e340097c0 tx=0x7f5e3401c450 comp rx=0 tx=0).stop 2023-09-13T06:03:42.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.367+0000 7f5e48ad8640 1 -- 172.21.15.130:0/2008416726 shutdown_connections 2023-09-13T06:03:42.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.367+0000 7f5e48ad8640 1 --2- 172.21.15.130:0/2008416726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e44146cf0 0x7f5e440c38e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.367+0000 7f5e48ad8640 1 -- 172.21.15.130:0/2008416726 >> 172.21.15.130:0/2008416726 conn(0x7f5e4406a2f0 msgr2=0x7f5e4406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:42.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.367+0000 7f5e48ad8640 1 -- 172.21.15.130:0/2008416726 shutdown_connections 2023-09-13T06:03:42.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.367+0000 7f5e48ad8640 1 -- 172.21.15.130:0/2008416726 wait complete. 2023-09-13T06:03:42.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e48ad8640 1 Processor -- start 2023-09-13T06:03:42.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e48ad8640 1 -- start start 2023-09-13T06:03:42.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e48ad8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e440cd170 0x7f5e4413cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e48ad8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e44146cf0 0x7f5e44160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e48ad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e441610a0 0x7f5e44139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e48ad8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4413b710 con 0x7f5e44146cf0 2023-09-13T06:03:42.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e48ad8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4415a1f0 con 0x7f5e440cd170 2023-09-13T06:03:42.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e48ad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4415c630 con 0x7f5e441610a0 2023-09-13T06:03:42.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e44146cf0 0x7f5e44160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e44146cf0 0x7f5e44160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35922/0 (socket says 172.21.15.130:35922) 2023-09-13T06:03:42.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3bfff640 1 -- 172.21.15.130:0/132900279 learned_addr learned my addr 172.21.15.130:0/132900279 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:42.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3bfff640 1 -- 172.21.15.130:0/132900279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e441610a0 msgr2=0x7f5e44139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3bfff640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e441610a0 0x7f5e44139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3bfff640 1 -- 172.21.15.130:0/132900279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e440cd170 msgr2=0x7f5e4413cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3bfff640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e440cd170 0x7f5e4413cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3bfff640 1 -- 172.21.15.130:0/132900279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009420 con 0x7f5e44146cf0 2023-09-13T06:03:42.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3bfff640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e44146cf0 0x7f5e44160580 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00c420 tx=0x7f5e2c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:42.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3affd640 1 -- 172.21.15.130:0/132900279 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c005cf0 con 0x7f5e44146cf0 2023-09-13T06:03:42.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3affd640 1 -- 172.21.15.130:0/132900279 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c005e50 con 0x7f5e44146cf0 2023-09-13T06:03:42.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e3affd640 1 -- 172.21.15.130:0/132900279 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0072d0 con 0x7f5e44146cf0 2023-09-13T06:03:42.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e48ad8640 1 -- 172.21.15.130:0/132900279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4415c910 con 0x7f5e44146cf0 2023-09-13T06:03:42.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e48ad8640 1 -- 172.21.15.130:0/132900279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e44160ac0 con 0x7f5e44146cf0 2023-09-13T06:03:42.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.371+0000 7f5e48ad8640 1 -- 172.21.15.130:0/132900279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e440618a0 con 0x7f5e44146cf0 2023-09-13T06:03:42.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.375+0000 7f5e3affd640 1 -- 172.21.15.130:0/132900279 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5e2c007430 con 0x7f5e44146cf0 2023-09-13T06:03:42.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.375+0000 7f5e3affd640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e24065b20 0x7f5e24067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.375+0000 7f5e3affd640 1 -- 172.21.15.130:0/132900279 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5e2c082810 con 0x7f5e44146cf0 2023-09-13T06:03:42.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.375+0000 7f5e4259c640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e24065b20 0x7f5e24067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.375+0000 7f5e4259c640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e24065b20 0x7f5e24067fe0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5e340af000 tx=0x7f5e34004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:42.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.379+0000 7f5e3affd640 1 -- 172.21.15.130:0/132900279 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5e2c0501c0 con 0x7f5e44146cf0 2023-09-13T06:03:42.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.527+0000 7f5e48ad8640 1 -- 172.21.15.130:0/132900279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e4413b850 con 0x7f5e44146cf0 2023-09-13T06:03:42.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e3affd640 1 -- 172.21.15.130:0/132900279 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f5e2c017090 con 0x7f5e44146cf0 2023-09-13T06:03:42.534 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:42.535 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":54,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:03:31.332756+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:02:53.311861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-09-13T06:02:53.919645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:03:42.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 -- 172.21.15.130:0/132900279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e24065b20 msgr2=0x7f5e24067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e24065b20 0x7f5e24067fe0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5e340af000 tx=0x7f5e34004740 comp rx=0 tx=0).stop 2023-09-13T06:03:42.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 -- 172.21.15.130:0/132900279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e44146cf0 msgr2=0x7f5e44160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e44146cf0 0x7f5e44160580 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00c420 tx=0x7f5e2c00c8e0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 -- 172.21.15.130:0/132900279 shutdown_connections 2023-09-13T06:03:42.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e24065b20 0x7f5e24067fe0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e441610a0 0x7f5e44139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e44146cf0 0x7f5e44160580 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 --2- 172.21.15.130:0/132900279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e440cd170 0x7f5e4413cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 -- 172.21.15.130:0/132900279 >> 172.21.15.130:0/132900279 conn(0x7f5e4406a2f0 msgr2=0x7f5e4415e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:42.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 -- 172.21.15.130:0/132900279 shutdown_connections 2023-09-13T06:03:42.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.531+0000 7f5e48ad8640 1 -- 172.21.15.130:0/132900279 wait complete. 2023-09-13T06:03:42.557 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T06:03:42.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a7e1fa640 1 Processor -- start 2023-09-13T06:03:42.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a7e1fa640 1 -- start start 2023-09-13T06:03:42.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a7e1fa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a780d1750 0x7f7a7815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a7e1fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a780d1090 0x7f7a78146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a7e1fa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7a780d1b30 0x7f7a78146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a7e1fa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7815dea0 con 0x7f7a780d1750 2023-09-13T06:03:42.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a7e1fa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a780b63c0 con 0x7f7a780d1b30 2023-09-13T06:03:42.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a7e1fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780d0c20 con 0x7f7a780d1090 2023-09-13T06:03:42.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a777fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a780d1750 0x7f7a7815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a777fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a780d1750 0x7f7a7815d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35936/0 (socket says 172.21.15.130:35936) 2023-09-13T06:03:42.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a777fe640 1 -- 172.21.15.130:0/4168005872 learned_addr learned my addr 172.21.15.130:0/4168005872 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:42.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a77fff640 1 --2- 172.21.15.130:0/4168005872 >> v2:172.21.15.164:3300/0 conn(0x7f7a780d1b30 0x7f7a78146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a76ffd640 1 --2- 172.21.15.130:0/4168005872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a780d1090 0x7f7a78146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a777fe640 1 -- 172.21.15.130:0/4168005872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a780d1090 msgr2=0x7f7a78146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:42.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a777fe640 1 --2- 172.21.15.130:0/4168005872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a780d1090 0x7f7a78146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a777fe640 1 -- 172.21.15.130:0/4168005872 >> v2:172.21.15.164:3300/0 conn(0x7f7a780d1b30 msgr2=0x7f7a78146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:42.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a777fe640 1 --2- 172.21.15.130:0/4168005872 >> v2:172.21.15.164:3300/0 conn(0x7f7a780d1b30 0x7f7a78146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a777fe640 1 -- 172.21.15.130:0/4168005872 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a780b6610 con 0x7f7a780d1750 2023-09-13T06:03:42.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a77fff640 1 --2- 172.21.15.130:0/4168005872 >> v2:172.21.15.164:3300/0 conn(0x7f7a780d1b30 0x7f7a78146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:42.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.695+0000 7f7a76ffd640 1 --2- 172.21.15.130:0/4168005872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a780d1090 0x7f7a78146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:42.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a777fe640 1 --2- 172.21.15.130:0/4168005872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a780d1750 0x7f7a7815d960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7a7808ba90 tx=0x7f7a6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a9c85d029ef09d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:42.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a767fc640 1 -- 172.21.15.130:0/4168005872 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680aa5f0 con 0x7f7a780d1750 2023-09-13T06:03:42.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a767fc640 1 -- 172.21.15.130:0/4168005872 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a680aa750 con 0x7f7a780d1750 2023-09-13T06:03:42.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a767fc640 1 -- 172.21.15.130:0/4168005872 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680aaae0 con 0x7f7a780d1750 2023-09-13T06:03:42.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/4168005872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a780d1750 msgr2=0x7f7a7815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a7e1fa640 1 --2- 172.21.15.130:0/4168005872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a780d1750 0x7f7a7815d960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7a7808ba90 tx=0x7f7a6801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/4168005872 shutdown_connections 2023-09-13T06:03:42.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a7e1fa640 1 --2- 172.21.15.130:0/4168005872 >> v2:172.21.15.164:3300/0 conn(0x7f7a780d1b30 0x7f7a78146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a7e1fa640 1 --2- 172.21.15.130:0/4168005872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a780d1090 0x7f7a78146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a7e1fa640 1 --2- 172.21.15.130:0/4168005872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a780d1750 0x7f7a7815d960 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/4168005872 >> 172.21.15.130:0/4168005872 conn(0x7f7a7806f170 msgr2=0x7f7a7806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:42.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/4168005872 shutdown_connections 2023-09-13T06:03:42.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.699+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/4168005872 wait complete. 2023-09-13T06:03:42.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a7e1fa640 1 Processor -- start 2023-09-13T06:03:42.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a7e1fa640 1 -- start start 2023-09-13T06:03:42.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a7e1fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a780d1090 0x7f7a7806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a7e1fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d1750 0x7f7a7806ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a7e1fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a780d1b30 0x7f7a7806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a7e1fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7806e590 con 0x7f7a780d1b30 2023-09-13T06:03:42.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a7e1fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a781442e0 con 0x7f7a780d1750 2023-09-13T06:03:42.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a7e1fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7815c770 con 0x7f7a780d1090 2023-09-13T06:03:42.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a77fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a780d1b30 0x7f7a7806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a77fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a780d1b30 0x7f7a7806b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35938/0 (socket says 172.21.15.130:35938) 2023-09-13T06:03:42.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a77fff640 1 -- 172.21.15.130:0/1146999301 learned_addr learned my addr 172.21.15.130:0/1146999301 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:42.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a777fe640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a780d1090 0x7f7a7806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a76ffd640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d1750 0x7f7a7806ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a77fff640 1 -- 172.21.15.130:0/1146999301 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a780d1090 msgr2=0x7f7a7806dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a77fff640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a780d1090 0x7f7a7806dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a77fff640 1 -- 172.21.15.130:0/1146999301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d1750 msgr2=0x7f7a7806ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a77fff640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d1750 0x7f7a7806ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a77fff640 1 -- 172.21.15.130:0/1146999301 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a680094d0 con 0x7f7a780d1b30 2023-09-13T06:03:42.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a76ffd640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d1750 0x7f7a7806ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:42.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a77fff640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a780d1b30 0x7f7a7806b0b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000cd50 tx=0x7f7a7000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:42.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a5ffff640 1 -- 172.21.15.130:0/1146999301 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000f680 con 0x7f7a780d1b30 2023-09-13T06:03:42.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a5ffff640 1 -- 172.21.15.130:0/1146999301 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7000f800 con 0x7f7a780d1b30 2023-09-13T06:03:42.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/1146999301 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7806e2b0 con 0x7f7a780d1b30 2023-09-13T06:03:42.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a5ffff640 1 -- 172.21.15.130:0/1146999301 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000fbb0 con 0x7f7a780d1b30 2023-09-13T06:03:42.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/1146999301 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a78143f00 con 0x7f7a780d1b30 2023-09-13T06:03:42.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.703+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/1146999301 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a78143a80 con 0x7f7a780d1b30 2023-09-13T06:03:42.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.707+0000 7f7a5ffff640 1 -- 172.21.15.130:0/1146999301 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7a7000b040 con 0x7f7a780d1b30 2023-09-13T06:03:42.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.707+0000 7f7a5ffff640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a64065b20 0x7f7a64067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:42.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.707+0000 7f7a5ffff640 1 -- 172.21.15.130:0/1146999301 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7a70083bd0 con 0x7f7a780d1b30 2023-09-13T06:03:42.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.707+0000 7f7a777fe640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a64065b20 0x7f7a64067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:42.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.707+0000 7f7a777fe640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a64065b20 0x7f7a64067fe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7a680ae000 tx=0x7f7a680b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:42.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.711+0000 7f7a5ffff640 1 -- 172.21.15.130:0/1146999301 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7a700515c0 con 0x7f7a780d1b30 2023-09-13T06:03:42.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.891+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/1146999301 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7a78144420 con 0x7f7a780d1b30 2023-09-13T06:03:42.895 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:03:42.891+0000 7faa00e50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T06:03:42.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a5ffff640 1 -- 172.21.15.130:0/1146999301 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7a78144420 con 0x7f7a780d1b30 2023-09-13T06:03:42.902 INFO:teuthology.orchestra.run.smithi130.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T06:03:42.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/1146999301 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a64065b20 msgr2=0x7f7a64067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a64065b20 0x7f7a64067fe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7a680ae000 tx=0x7f7a680b5040 comp rx=0 tx=0).stop 2023-09-13T06:03:42.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/1146999301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a780d1b30 msgr2=0x7f7a7806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:42.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a780d1b30 0x7f7a7806b0b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000cd50 tx=0x7f7a7000a650 comp rx=0 tx=0).stop 2023-09-13T06:03:42.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/1146999301 shutdown_connections 2023-09-13T06:03:42.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a64065b20 0x7f7a64067fe0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a780d1750 0x7f7a7806ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a780d1b30 0x7f7a7806b0b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 --2- 172.21.15.130:0/1146999301 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a780d1090 0x7f7a7806dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:42.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/1146999301 >> 172.21.15.130:0/1146999301 conn(0x7f7a7806f170 msgr2=0x7f7a780b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:42.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/1146999301 shutdown_connections 2023-09-13T06:03:42.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:42.899+0000 7f7a7e1fa640 1 -- 172.21.15.130:0/1146999301 wait complete. 2023-09-13T06:03:42.924 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T06:03:42.969 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:03:43.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.063+0000 7f997a7a3640 1 Processor -- start 2023-09-13T06:03:43.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.063+0000 7f997a7a3640 1 -- start start 2023-09-13T06:03:43.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f997a7a3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9974157ca0 0x7f997415b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:43.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f997a7a3640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997415ada0 con 0x7f99740ccf00 2023-09-13T06:03:43.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f997a7a3640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997415b770 con 0x7f99740cd3b0 2023-09-13T06:03:43.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f997a7a3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99740cdca0 con 0x7f9974157ca0 2023-09-13T06:03:43.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f9973fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9974157ca0 0x7f997415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:43.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f9973fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9974157ca0 0x7f997415b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35958/0 (socket says 172.21.15.130:35958) 2023-09-13T06:03:43.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f9973fff640 1 -- 172.21.15.130:0/1016722023 learned_addr learned my addr 172.21.15.130:0/1016722023 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:43.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f99737fe640 1 --1- 172.21.15.130:0/1016722023 >> v1:172.21.15.130:6789/0 conn(0x7f99740ccf00 0x7f99740cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36490/0 (socket says 172.21.15.130:36490) 2023-09-13T06:03:43.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f9973fff640 1 -- 172.21.15.130:0/1016722023 >> v1:172.21.15.164:6789/0 conn(0x7f99740cd3b0 legacy=0x7f997415de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:43.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f9973fff640 1 -- 172.21.15.130:0/1016722023 >> v1:172.21.15.130:6789/0 conn(0x7f99740ccf00 legacy=0x7f99740cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:43.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f9973fff640 1 -- 172.21.15.130:0/1016722023 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99740cdf80 con 0x7f9974157ca0 2023-09-13T06:03:43.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.067+0000 7f9973fff640 1 --2- 172.21.15.130:0/1016722023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9974157ca0 0x7f997415b230 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9964009870 tx=0x7f996401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dbf7822b3dac53 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:43.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f9972ffd640 1 -- 172.21.15.130:0/1016722023 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640ac630 con 0x7f9974157ca0 2023-09-13T06:03:43.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f9972ffd640 1 -- 172.21.15.130:0/1016722023 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99640ac790 con 0x7f9974157ca0 2023-09-13T06:03:43.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f9972ffd640 1 -- 172.21.15.130:0/1016722023 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640acb20 con 0x7f9974157ca0 2023-09-13T06:03:43.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 -- 172.21.15.130:0/1016722023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9974157ca0 msgr2=0x7f997415b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:43.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 --2- 172.21.15.130:0/1016722023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9974157ca0 0x7f997415b230 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9964009870 tx=0x7f996401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:03:43.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 -- 172.21.15.130:0/1016722023 shutdown_connections 2023-09-13T06:03:43.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 --2- 172.21.15.130:0/1016722023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9974157ca0 0x7f997415b230 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:43.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 -- 172.21.15.130:0/1016722023 >> 172.21.15.130:0/1016722023 conn(0x7f9974065990 msgr2=0x7f9974065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:43.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 -- 172.21.15.130:0/1016722023 shutdown_connections 2023-09-13T06:03:43.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 -- 172.21.15.130:0/1016722023 wait complete. 2023-09-13T06:03:43.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 Processor -- start 2023-09-13T06:03:43.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 -- start start 2023-09-13T06:03:43.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99740ccf00 0x7f9974163270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:43.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99740cd3b0 0x7f9974160c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:43.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9974157ca0 0x7f997414a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:43.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974161480 con 0x7f9974157ca0 2023-09-13T06:03:43.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974161760 con 0x7f99740cd3b0 2023-09-13T06:03:43.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f997a7a3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9974161a40 con 0x7f99740ccf00 2023-09-13T06:03:43.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f9978d40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9974157ca0 0x7f997414a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:43.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f9978d40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9974157ca0 0x7f997414a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35962/0 (socket says 172.21.15.130:35962) 2023-09-13T06:03:43.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.071+0000 7f9978d40640 1 -- 172.21.15.130:0/3183566620 learned_addr learned my addr 172.21.15.130:0/3183566620 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:43.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9973fff640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99740ccf00 0x7f9974163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:43.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f99737fe640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99740cd3b0 0x7f9974160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:43.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9978d40640 1 -- 172.21.15.130:0/3183566620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99740ccf00 msgr2=0x7f9974163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:43.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9978d40640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99740ccf00 0x7f9974163270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:43.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9978d40640 1 -- 172.21.15.130:0/3183566620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99740cd3b0 msgr2=0x7f9974160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:43.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9978d40640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99740cd3b0 0x7f9974160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:43.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9978d40640 1 -- 172.21.15.130:0/3183566620 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99640094d0 con 0x7f9974157ca0 2023-09-13T06:03:43.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9978d40640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9974157ca0 0x7f997414a330 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c780 tx=0x7f996c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:43.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9970ff9640 1 -- 172.21.15.130:0/3183566620 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c003d90 con 0x7f9974157ca0 2023-09-13T06:03:43.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9970ff9640 1 -- 172.21.15.130:0/3183566620 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c00ce30 con 0x7f9974157ca0 2023-09-13T06:03:43.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9970ff9640 1 -- 172.21.15.130:0/3183566620 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c005290 con 0x7f9974157ca0 2023-09-13T06:03:43.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f997a7a3640 1 -- 172.21.15.130:0/3183566620 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997415efc0 con 0x7f9974157ca0 2023-09-13T06:03:43.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f997a7a3640 1 -- 172.21.15.130:0/3183566620 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9974161d20 con 0x7f9974157ca0 2023-09-13T06:03:43.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f997a7a3640 1 -- 172.21.15.130:0/3183566620 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99740674a0 con 0x7f9974157ca0 2023-09-13T06:03:43.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9970ff9640 1 -- 172.21.15.130:0/3183566620 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f996c006b20 con 0x7f9974157ca0 2023-09-13T06:03:43.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9970ff9640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9960065b20 0x7f9960067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:43.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9970ff9640 1 -- 172.21.15.130:0/3183566620 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f996c0826e0 con 0x7f9974157ca0 2023-09-13T06:03:43.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.075+0000 7f9973fff640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9960065b20 0x7f9960067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:43.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.079+0000 7f9973fff640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9960065b20 0x7f9960067fe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f99640ae000 tx=0x7f99640a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:43.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.079+0000 7f9970ff9640 1 -- 172.21.15.130:0/3183566620 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f996c050030 con 0x7f9974157ca0 2023-09-13T06:03:43.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.259+0000 7f997a7a3640 1 -- 172.21.15.130:0/3183566620 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9974073e50 con 0x7f9974157ca0 2023-09-13T06:03:43.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f9970ff9640 1 -- 172.21.15.130:0/3183566620 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f996c053650 con 0x7f9974157ca0 2023-09-13T06:03:43.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 -- 172.21.15.130:0/3183566620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9960065b20 msgr2=0x7f9960067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:43.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9960065b20 0x7f9960067fe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f99640ae000 tx=0x7f99640a7000 comp rx=0 tx=0).stop 2023-09-13T06:03:43.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 -- 172.21.15.130:0/3183566620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9974157ca0 msgr2=0x7f997414a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:43.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9974157ca0 0x7f997414a330 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c780 tx=0x7f996c00cc40 comp rx=0 tx=0).stop 2023-09-13T06:03:43.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 -- 172.21.15.130:0/3183566620 shutdown_connections 2023-09-13T06:03:43.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9960065b20 0x7f9960067fe0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:43.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99740cd3b0 0x7f9974160c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:43.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9974157ca0 0x7f997414a330 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:43.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 --2- 172.21.15.130:0/3183566620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99740ccf00 0x7f9974163270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:43.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 -- 172.21.15.130:0/3183566620 >> 172.21.15.130:0/3183566620 conn(0x7f9974065990 msgr2=0x7f997415c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:43.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 -- 172.21.15.130:0/3183566620 shutdown_connections 2023-09-13T06:03:43.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:43.899+0000 7f997a7a3640 1 -- 172.21.15.130:0/3183566620 wait complete. 2023-09-13T06:03:43.927 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T06:03:44.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb26711640 1 Processor -- start 2023-09-13T06:03:44.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb26711640 1 -- start start 2023-09-13T06:03:44.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb26711640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7feb20144a40 0x7feb200aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:44.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb26711640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb2006d0a0 0x7feb2015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:44.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb26711640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2006d510 con 0x7feb200b0460 2023-09-13T06:03:44.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb26711640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb200b08f0 con 0x7feb2006d0a0 2023-09-13T06:03:44.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb26711640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb20144e20 con 0x7feb20144a40 2023-09-13T06:03:44.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb24cae640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb2006d0a0 0x7feb2015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:44.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb24cae640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb2006d0a0 0x7feb2015bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35972/0 (socket says 172.21.15.130:35972) 2023-09-13T06:03:44.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb24cae640 1 -- 172.21.15.130:0/2327523870 learned_addr learned my addr 172.21.15.130:0/2327523870 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:44.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb1ffff640 1 --2- 172.21.15.130:0/2327523870 >> v2:172.21.15.164:3300/0 conn(0x7feb20144a40 0x7feb200aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:44.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb24cae640 1 -- 172.21.15.130:0/2327523870 >> v2:172.21.15.164:3300/0 conn(0x7feb20144a40 msgr2=0x7feb200aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:44.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb24cae640 1 --2- 172.21.15.130:0/2327523870 >> v2:172.21.15.164:3300/0 conn(0x7feb20144a40 0x7feb200aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:44.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb24cae640 1 -- 172.21.15.130:0/2327523870 >> v1:172.21.15.130:6789/0 conn(0x7feb200b0460 legacy=0x7feb2006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:44.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb24cae640 1 -- 172.21.15.130:0/2327523870 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2006d7c0 con 0x7feb2006d0a0 2023-09-13T06:03:44.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.111+0000 7feb1effd640 1 -- 172.21.15.130:0/2327523870 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919012439 0 0) 0x7feb2006d510 con 0x7feb200b0460 2023-09-13T06:03:44.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb24cae640 1 --2- 172.21.15.130:0/2327523870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2006d0a0 0x7feb2015bd80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feb20070780 tx=0x7feb1801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e4126f815d08cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:44.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb1effd640 1 -- 172.21.15.130:0/2327523870 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb180a5860 con 0x7feb2006d0a0 2023-09-13T06:03:44.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb1effd640 1 -- 172.21.15.130:0/2327523870 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb180a59c0 con 0x7feb2006d0a0 2023-09-13T06:03:44.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb1effd640 1 -- 172.21.15.130:0/2327523870 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb180a5d50 con 0x7feb2006d0a0 2023-09-13T06:03:44.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb26711640 1 -- 172.21.15.130:0/2327523870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2006d0a0 msgr2=0x7feb2015bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:44.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb26711640 1 --2- 172.21.15.130:0/2327523870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2006d0a0 0x7feb2015bd80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feb20070780 tx=0x7feb1801c9a0 comp rx=0 tx=0).stop 2023-09-13T06:03:44.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb26711640 1 -- 172.21.15.130:0/2327523870 shutdown_connections 2023-09-13T06:03:44.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb26711640 1 --2- 172.21.15.130:0/2327523870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2006d0a0 0x7feb2015bd80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:44.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb26711640 1 --2- 172.21.15.130:0/2327523870 >> v2:172.21.15.164:3300/0 conn(0x7feb20144a40 0x7feb200aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:44.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb26711640 1 -- 172.21.15.130:0/2327523870 >> 172.21.15.130:0/2327523870 conn(0x7feb200735e0 msgr2=0x7feb20065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:44.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb26711640 1 -- 172.21.15.130:0/2327523870 shutdown_connections 2023-09-13T06:03:44.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.115+0000 7feb26711640 1 -- 172.21.15.130:0/2327523870 wait complete. 2023-09-13T06:03:44.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb26711640 1 Processor -- start 2023-09-13T06:03:44.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb26711640 1 -- start start 2023-09-13T06:03:44.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb26711640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2006d0a0 0x7feb20138910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:44.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb26711640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb200b0460 0x7feb2013bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:44.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb26711640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb20144a40 0x7feb200ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:44.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb26711640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb20138e50 con 0x7feb2006d0a0 2023-09-13T06:03:44.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb26711640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2013d380 con 0x7feb200b0460 2023-09-13T06:03:44.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb26711640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2013d5d0 con 0x7feb20144a40 2023-09-13T06:03:44.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2006d0a0 0x7feb20138910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:44.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2006d0a0 0x7feb20138910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35988/0 (socket says 172.21.15.130:35988) 2023-09-13T06:03:44.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1ffff640 1 -- 172.21.15.130:0/422560340 learned_addr learned my addr 172.21.15.130:0/422560340 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:44.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1f7fe640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb200b0460 0x7feb2013bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:44.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb24cae640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb20144a40 0x7feb200ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:44.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1ffff640 1 -- 172.21.15.130:0/422560340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb20144a40 msgr2=0x7feb200ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:44.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1ffff640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb20144a40 0x7feb200ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:44.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1ffff640 1 -- 172.21.15.130:0/422560340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb200b0460 msgr2=0x7feb2013bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:44.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1ffff640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb200b0460 0x7feb2013bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:44.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1ffff640 1 -- 172.21.15.130:0/422560340 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb18009b30 con 0x7feb2006d0a0 2023-09-13T06:03:44.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1ffff640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2006d0a0 0x7feb20138910 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7feb1000d5f0 tx=0x7feb1000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:44.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1cff9640 1 -- 172.21.15.130:0/422560340 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100125f0 con 0x7feb2006d0a0 2023-09-13T06:03:44.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1cff9640 1 -- 172.21.15.130:0/422560340 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb10012750 con 0x7feb2006d0a0 2023-09-13T06:03:44.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb1cff9640 1 -- 172.21.15.130:0/422560340 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10012ae0 con 0x7feb2006d0a0 2023-09-13T06:03:44.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb26711640 1 -- 172.21.15.130:0/422560340 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2013d8b0 con 0x7feb2006d0a0 2023-09-13T06:03:44.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.119+0000 7feb26711640 1 -- 172.21.15.130:0/422560340 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2013de70 con 0x7feb2006d0a0 2023-09-13T06:03:44.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.123+0000 7feb26711640 1 -- 172.21.15.130:0/422560340 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2013e030 con 0x7feb2006d0a0 2023-09-13T06:03:44.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.123+0000 7feb1cff9640 1 -- 172.21.15.130:0/422560340 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7feb10012c40 con 0x7feb2006d0a0 2023-09-13T06:03:44.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.123+0000 7feb1cff9640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb0c065b20 0x7feb0c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:44.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.123+0000 7feb1cff9640 1 -- 172.21.15.130:0/422560340 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5853+0+0 (secure 0 0 0) 0x7feb10083680 con 0x7feb2006d0a0 2023-09-13T06:03:44.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.123+0000 7feb1f7fe640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb0c065b20 0x7feb0c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:44.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.123+0000 7feb1f7fe640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb0c065b20 0x7feb0c067fe0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7feb200aeef0 tx=0x7feb14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:44.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.127+0000 7feb1cff9640 1 -- 172.21.15.130:0/422560340 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7feb10051080 con 0x7feb2006d0a0 2023-09-13T06:03:44.188 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:03:44.192 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:03:44.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.275+0000 7feb26711640 1 -- 172.21.15.130:0/422560340 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feb200618a0 con 0x7feb2006d0a0 2023-09-13T06:03:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.899+0000 7feb1cff9640 1 -- 172.21.15.130:0/422560340 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7feb100546a0 con 0x7feb2006d0a0 2023-09-13T06:03:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' removed 2023-09-13T06:03:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 -- 172.21.15.130:0/422560340 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb0c065b20 msgr2=0x7feb0c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb0c065b20 0x7feb0c067fe0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7feb200aeef0 tx=0x7feb14009040 comp rx=0 tx=0).stop 2023-09-13T06:03:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 -- 172.21.15.130:0/422560340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2006d0a0 msgr2=0x7feb20138910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:44.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2006d0a0 0x7feb20138910 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7feb1000d5f0 tx=0x7feb1000dab0 comp rx=0 tx=0).stop 2023-09-13T06:03:44.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 -- 172.21.15.130:0/422560340 shutdown_connections 2023-09-13T06:03:44.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb0c065b20 0x7feb0c067fe0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:44.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb200b0460 0x7feb2013bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:44.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb20144a40 0x7feb200ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:44.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 --2- 172.21.15.130:0/422560340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb2006d0a0 0x7feb20138910 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:44.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 -- 172.21.15.130:0/422560340 >> 172.21.15.130:0/422560340 conn(0x7feb200735e0 msgr2=0x7feb200ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:44.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 -- 172.21.15.130:0/422560340 shutdown_connections 2023-09-13T06:03:44.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:44.903+0000 7feb26711640 1 -- 172.21.15.130:0/422560340 wait complete. 2023-09-13T06:03:44.929 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T06:03:45.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e3567640 1 Processor -- start 2023-09-13T06:03:45.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e3567640 1 -- start start 2023-09-13T06:03:45.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e3567640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81dc0cb770 0x7f81dc0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:45.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e3567640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f81dc166040 0x7f81dc0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:45.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e3567640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f81dc0cbb50 0x7f81dc1647d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:45.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e3567640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc165380 con 0x7f81dc166040 2023-09-13T06:03:45.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e3567640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc0cea40 con 0x7f81dc0cbb50 2023-09-13T06:03:45.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e3567640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc165560 con 0x7f81dc0cb770 2023-09-13T06:03:45.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e0b02640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f81dc166040 0x7f81dc0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:45.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e0b02640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f81dc166040 0x7f81dc0ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35994/0 (socket says 172.21.15.130:35994) 2023-09-13T06:03:45.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e0b02640 1 -- 172.21.15.130:0/1716422373 learned_addr learned my addr 172.21.15.130:0/1716422373 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:45.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e1303640 1 --2- 172.21.15.130:0/1716422373 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81dc0cb770 0x7f81dc0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:45.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e1b04640 1 --2- 172.21.15.130:0/1716422373 >> v2:172.21.15.164:3300/0 conn(0x7f81dc0cbb50 0x7f81dc1647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:45.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e0b02640 1 -- 172.21.15.130:0/1716422373 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81dc0cb770 msgr2=0x7f81dc0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:45.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e0b02640 1 --2- 172.21.15.130:0/1716422373 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81dc0cb770 0x7f81dc0cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:45.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e0b02640 1 -- 172.21.15.130:0/1716422373 >> v2:172.21.15.164:3300/0 conn(0x7f81dc0cbb50 msgr2=0x7f81dc1647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:45.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e0b02640 1 --2- 172.21.15.130:0/1716422373 >> v2:172.21.15.164:3300/0 conn(0x7f81dc0cbb50 0x7f81dc1647d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:45.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e0b02640 1 -- 172.21.15.130:0/1716422373 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc165840 con 0x7f81dc166040 2023-09-13T06:03:45.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.067+0000 7f81e1b04640 1 --2- 172.21.15.130:0/1716422373 >> v2:172.21.15.164:3300/0 conn(0x7f81dc0cbb50 0x7f81dc1647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:45.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81e0b02640 1 --2- 172.21.15.130:0/1716422373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81dc166040 0x7f81dc0ce0f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f81dc066760 tx=0x7f81cc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5102bd1d51921cb9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:45.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81d3fff640 1 -- 172.21.15.130:0/1716422373 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0ab600 con 0x7f81dc166040 2023-09-13T06:03:45.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81d3fff640 1 -- 172.21.15.130:0/1716422373 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc0a7050 con 0x7f81dc166040 2023-09-13T06:03:45.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81d3fff640 1 -- 172.21.15.130:0/1716422373 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0ab980 con 0x7f81dc166040 2023-09-13T06:03:45.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81e3567640 1 -- 172.21.15.130:0/1716422373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81dc166040 msgr2=0x7f81dc0ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:45.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81e3567640 1 --2- 172.21.15.130:0/1716422373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81dc166040 0x7f81dc0ce0f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f81dc066760 tx=0x7f81cc01c500 comp rx=0 tx=0).stop 2023-09-13T06:03:45.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81e3567640 1 -- 172.21.15.130:0/1716422373 shutdown_connections 2023-09-13T06:03:45.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81e3567640 1 --2- 172.21.15.130:0/1716422373 >> v2:172.21.15.164:3300/0 conn(0x7f81dc0cbb50 0x7f81dc1647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:45.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81e3567640 1 --2- 172.21.15.130:0/1716422373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81dc166040 0x7f81dc0ce0f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:45.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81e3567640 1 --2- 172.21.15.130:0/1716422373 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81dc0cb770 0x7f81dc0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:45.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81e3567640 1 -- 172.21.15.130:0/1716422373 >> 172.21.15.130:0/1716422373 conn(0x7f81dc0735e0 msgr2=0x7f81dc065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:45.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81e3567640 1 -- 172.21.15.130:0/1716422373 shutdown_connections 2023-09-13T06:03:45.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.071+0000 7f81e3567640 1 -- 172.21.15.130:0/1716422373 wait complete. 2023-09-13T06:03:45.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e3567640 1 Processor -- start 2023-09-13T06:03:45.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e3567640 1 -- start start 2023-09-13T06:03:45.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e3567640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81dc0cb770 0x7f81dc06df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:45.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e3567640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81dc0cbb50 0x7f81dc155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:45.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e3567640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81dc166040 0x7f81dc1552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:45.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e3567640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc06c690 con 0x7f81dc166040 2023-09-13T06:03:45.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e3567640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc06c3d0 con 0x7f81dc0cbb50 2023-09-13T06:03:45.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e3567640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc15e790 con 0x7f81dc0cb770 2023-09-13T06:03:45.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e1b04640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81dc166040 0x7f81dc1552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:45.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e1b04640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81dc166040 0x7f81dc1552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36002/0 (socket says 172.21.15.130:36002) 2023-09-13T06:03:45.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e1b04640 1 -- 172.21.15.130:0/3473286973 learned_addr learned my addr 172.21.15.130:0/3473286973 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:45.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e1303640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81dc0cb770 0x7f81dc06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:45.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e0b02640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81dc0cbb50 0x7f81dc155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:45.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e1b04640 1 -- 172.21.15.130:0/3473286973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81dc0cb770 msgr2=0x7f81dc06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:45.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e1b04640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81dc0cb770 0x7f81dc06df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:45.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e1b04640 1 -- 172.21.15.130:0/3473286973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81dc0cbb50 msgr2=0x7f81dc155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:45.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e1b04640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81dc0cbb50 0x7f81dc155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:45.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e1b04640 1 -- 172.21.15.130:0/3473286973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc0094d0 con 0x7f81dc166040 2023-09-13T06:03:45.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e1b04640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81dc166040 0x7f81dc1552b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f81d400cef0 tx=0x7f81d400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:45.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81d1ffb640 1 -- 172.21.15.130:0/3473286973 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400d840 con 0x7f81dc166040 2023-09-13T06:03:45.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81d1ffb640 1 -- 172.21.15.130:0/3473286973 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d400d9c0 con 0x7f81dc166040 2023-09-13T06:03:45.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81d1ffb640 1 -- 172.21.15.130:0/3473286973 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400dd70 con 0x7f81dc166040 2023-09-13T06:03:45.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e3567640 1 -- 172.21.15.130:0/3473286973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc15def0 con 0x7f81dc166040 2023-09-13T06:03:45.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.075+0000 7f81e3567640 1 -- 172.21.15.130:0/3473286973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc15e4b0 con 0x7f81dc166040 2023-09-13T06:03:45.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.079+0000 7f81e3567640 1 -- 172.21.15.130:0/3473286973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc06c800 con 0x7f81dc166040 2023-09-13T06:03:45.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.079+0000 7f81d1ffb640 1 -- 172.21.15.130:0/3473286973 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f81d401e3b0 con 0x7f81dc166040 2023-09-13T06:03:45.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.079+0000 7f81d1ffb640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81c0065b20 0x7f81c0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:45.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.079+0000 7f81d1ffb640 1 -- 172.21.15.130:0/3473286973 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f81d4083cf0 con 0x7f81dc166040 2023-09-13T06:03:45.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.079+0000 7f81e1303640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81c0065b20 0x7f81c0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:45.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.079+0000 7f81e1303640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81c0065b20 0x7f81c0067fe0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f81d8004610 tx=0x7f81d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:45.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.083+0000 7f81d1ffb640 1 -- 172.21.15.130:0/3473286973 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f81dc06c800 con 0x7f81dc166040 2023-09-13T06:03:45.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.231+0000 7f81e3567640 1 -- 172.21.15.130:0/3473286973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f81dc06c800 con 0x7f81dc166040 2023-09-13T06:03:45.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.903+0000 7f81d1ffb640 1 -- 172.21.15.130:0/3473286973 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7f81dc06c800 con 0x7f81dc166040 2023-09-13T06:03:45.907 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' removed 2023-09-13T06:03:45.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 -- 172.21.15.130:0/3473286973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81c0065b20 msgr2=0x7f81c0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:45.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81c0065b20 0x7f81c0067fe0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f81d8004610 tx=0x7f81d8008040 comp rx=0 tx=0).stop 2023-09-13T06:03:45.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 -- 172.21.15.130:0/3473286973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81dc166040 msgr2=0x7f81dc1552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:45.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81dc166040 0x7f81dc1552b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f81d400cef0 tx=0x7f81d400a710 comp rx=0 tx=0).stop 2023-09-13T06:03:45.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 -- 172.21.15.130:0/3473286973 shutdown_connections 2023-09-13T06:03:45.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f81c0065b20 0x7f81c0067fe0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:45.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81dc0cbb50 0x7f81dc155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:45.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81dc166040 0x7f81dc1552b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:45.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 --2- 172.21.15.130:0/3473286973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81dc0cb770 0x7f81dc06df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:45.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 -- 172.21.15.130:0/3473286973 >> 172.21.15.130:0/3473286973 conn(0x7f81dc0735e0 msgr2=0x7f81dc15b240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:45.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 -- 172.21.15.130:0/3473286973 shutdown_connections 2023-09-13T06:03:45.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:45.907+0000 7f81e3567640 1 -- 172.21.15.130:0/3473286973 wait complete. 2023-09-13T06:03:45.932 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-13T06:03:46.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f500c9db640 1 Processor -- start 2023-09-13T06:03:46.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f500c9db640 1 -- start start 2023-09-13T06:03:46.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f500c9db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5008158c10 0x7f50080b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f500c9db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50080cc8e0 0x7f50080b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f500c9db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500806f7f0 con 0x7f50080b06f0 2023-09-13T06:03:46.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f500c9db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500815c230 con 0x7f50080cc8e0 2023-09-13T06:03:46.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f500c9db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080b0c50 con 0x7f5008158c10 2023-09-13T06:03:46.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f5006d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50080cc8e0 0x7f50080b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f4ffdd9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f50080b06f0 0x7f50080cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36510/0 (socket says 172.21.15.130:36510) 2023-09-13T06:03:46.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f4ffdd9b640 1 -- 172.21.15.130:0/3787684946 learned_addr learned my addr 172.21.15.130:0/3787684946 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:46.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f5006d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50080cc8e0 0x7f50080b1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36018/0 (socket says 172.21.15.130:36018) 2023-09-13T06:03:46.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f500659c640 1 --2- 172.21.15.130:0/3787684946 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5008158c10 0x7f50080b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f5006d9d640 1 -- 172.21.15.130:0/3787684946 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5008158c10 msgr2=0x7f50080b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:46.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f5006d9d640 1 --2- 172.21.15.130:0/3787684946 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5008158c10 0x7f50080b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f5006d9d640 1 -- 172.21.15.130:0/3787684946 >> v1:172.21.15.130:6789/0 conn(0x7f50080b06f0 legacy=0x7f50080cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f5006d9d640 1 -- 172.21.15.130:0/3787684946 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500815b900 con 0x7f50080cc8e0 2023-09-13T06:03:46.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.071+0000 7f5005d9b640 1 -- 172.21.15.130:0/3787684946 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648590338 0 0) 0x7f500806f7f0 con 0x7f50080b06f0 2023-09-13T06:03:46.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f5006d9d640 1 --2- 172.21.15.130:0/3787684946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50080cc8e0 0x7f50080b1580 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f50000097c0 tx=0x7f500001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3821a2f7727c77 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:46.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f5005d9b640 1 -- 172.21.15.130:0/3787684946 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50000ac620 con 0x7f50080cc8e0 2023-09-13T06:03:46.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f5005d9b640 1 -- 172.21.15.130:0/3787684946 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50000ac780 con 0x7f50080cc8e0 2023-09-13T06:03:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f5005d9b640 1 -- 172.21.15.130:0/3787684946 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50000acb10 con 0x7f50080cc8e0 2023-09-13T06:03:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f500c9db640 1 -- 172.21.15.130:0/3787684946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50080cc8e0 msgr2=0x7f50080b1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f500c9db640 1 --2- 172.21.15.130:0/3787684946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50080cc8e0 0x7f50080b1580 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f50000097c0 tx=0x7f500001c3c0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f500c9db640 1 -- 172.21.15.130:0/3787684946 shutdown_connections 2023-09-13T06:03:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f500c9db640 1 --2- 172.21.15.130:0/3787684946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50080cc8e0 0x7f50080b1580 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f500c9db640 1 --2- 172.21.15.130:0/3787684946 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5008158c10 0x7f50080b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f500c9db640 1 -- 172.21.15.130:0/3787684946 >> 172.21.15.130:0/3787684946 conn(0x7f5008065990 msgr2=0x7f5008065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:46.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f500c9db640 1 -- 172.21.15.130:0/3787684946 shutdown_connections 2023-09-13T06:03:46.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.075+0000 7f500c9db640 1 -- 172.21.15.130:0/3787684946 wait complete. 2023-09-13T06:03:46.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500c9db640 1 Processor -- start 2023-09-13T06:03:46.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500c9db640 1 -- start start 2023-09-13T06:03:46.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500c9db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50080b06f0 0x7f500815ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500c9db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50080cc8e0 0x7f50080af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500c9db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5008158c10 0x7f5008157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500c9db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008157170 con 0x7f50080cc8e0 2023-09-13T06:03:46.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500c9db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008156560 con 0x7f50080b06f0 2023-09-13T06:03:46.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500c9db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5008156840 con 0x7f5008158c10 2023-09-13T06:03:46.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4ffdd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50080cc8e0 0x7f50080af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4ffdd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50080cc8e0 0x7f50080af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36022/0 (socket says 172.21.15.130:36022) 2023-09-13T06:03:46.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4ffdd9b640 1 -- 172.21.15.130:0/297878944 learned_addr learned my addr 172.21.15.130:0/297878944 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:46.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f5006d9d640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5008158c10 0x7f5008157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500659c640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50080b06f0 0x7f500815ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4ffdd9b640 1 -- 172.21.15.130:0/297878944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5008158c10 msgr2=0x7f5008157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4ffdd9b640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5008158c10 0x7f5008157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4ffdd9b640 1 -- 172.21.15.130:0/297878944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50080b06f0 msgr2=0x7f500815ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4ffdd9b640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50080b06f0 0x7f500815ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4ffdd9b640 1 -- 172.21.15.130:0/297878944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5000009420 con 0x7f50080cc8e0 2023-09-13T06:03:46.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f5006d9d640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5008158c10 0x7f5008157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:46.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500659c640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50080b06f0 0x7f500815ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:46.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4ffdd9b640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50080cc8e0 0x7f50080af0d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c7c0 tx=0x7f4ff000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:46.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4fff7fe640 1 -- 172.21.15.130:0/297878944 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000a640 con 0x7f50080cc8e0 2023-09-13T06:03:46.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4fff7fe640 1 -- 172.21.15.130:0/297878944 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff000a7c0 con 0x7f50080cc8e0 2023-09-13T06:03:46.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f4fff7fe640 1 -- 172.21.15.130:0/297878944 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000ab70 con 0x7f50080cc8e0 2023-09-13T06:03:46.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500c9db640 1 -- 172.21.15.130:0/297878944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5008156b20 con 0x7f50080cc8e0 2023-09-13T06:03:46.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.079+0000 7f500c9db640 1 -- 172.21.15.130:0/297878944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50081543d0 con 0x7f50080cc8e0 2023-09-13T06:03:46.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.083+0000 7f500c9db640 1 -- 172.21.15.130:0/297878944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50081572e0 con 0x7f50080cc8e0 2023-09-13T06:03:46.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.083+0000 7f4fff7fe640 1 -- 172.21.15.130:0/297878944 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4ff000acd0 con 0x7f50080cc8e0 2023-09-13T06:03:46.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.083+0000 7f4fff7fe640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fe8065b50 0x7f4fe8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.083+0000 7f4fff7fe640 1 -- 172.21.15.130:0/297878944 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4ff00824d0 con 0x7f50080cc8e0 2023-09-13T06:03:46.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.083+0000 7f500659c640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fe8065b50 0x7f4fe8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.083+0000 7f500659c640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fe8065b50 0x7f4fe8068010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009840 tx=0x7f4ff8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:46.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.087+0000 7f4fff7fe640 1 -- 172.21.15.130:0/297878944 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4ff0050080 con 0x7f50080cc8e0 2023-09-13T06:03:46.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.235+0000 7f500c9db640 1 -- 172.21.15.130:0/297878944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f50080674a0 con 0x7f50080cc8e0 2023-09-13T06:03:46.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f4fff7fe640 1 -- 172.21.15.130:0/297878944 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4ff00536a0 con 0x7f50080cc8e0 2023-09-13T06:03:46.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 -- 172.21.15.130:0/297878944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fe8065b50 msgr2=0x7f4fe8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fe8065b50 0x7f4fe8068010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009840 tx=0x7f4ff8008040 comp rx=0 tx=0).stop 2023-09-13T06:03:46.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 -- 172.21.15.130:0/297878944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50080cc8e0 msgr2=0x7f50080af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50080cc8e0 0x7f50080af0d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c7c0 tx=0x7f4ff000cc80 comp rx=0 tx=0).stop 2023-09-13T06:03:46.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 -- 172.21.15.130:0/297878944 shutdown_connections 2023-09-13T06:03:46.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fe8065b50 0x7f4fe8068010 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5008158c10 0x7f5008157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50080cc8e0 0x7f50080af0d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 --2- 172.21.15.130:0/297878944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50080b06f0 0x7f500815ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 -- 172.21.15.130:0/297878944 >> 172.21.15.130:0/297878944 conn(0x7f5008065990 msgr2=0x7f5008065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:46.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 -- 172.21.15.130:0/297878944 shutdown_connections 2023-09-13T06:03:46.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.239+0000 7f500c9db640 1 -- 172.21.15.130:0/297878944 wait complete. 2023-09-13T06:03:46.264 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-09-13T06:03:46.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.395+0000 7fa97cf2c640 1 Processor -- start 2023-09-13T06:03:46.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa97cf2c640 1 -- start start 2023-09-13T06:03:46.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa97cf2c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9780b1d20 0x7fa9780ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa97cf2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9780cdfc0 0x7fa9780b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa97cf2c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780ccfd0 con 0x7fa978159f20 2023-09-13T06:03:46.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa97cf2c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780ce430 con 0x7fa9780b1d20 2023-09-13T06:03:46.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa97cf2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780b00f0 con 0x7fa9780cdfc0 2023-09-13T06:03:46.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa96dd9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9780b1d20 0x7fa9780ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa96dd9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9780b1d20 0x7fa9780ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36032/0 (socket says 172.21.15.130:36032) 2023-09-13T06:03:46.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa96dd9b640 1 -- 172.21.15.130:0/3792600538 learned_addr learned my addr 172.21.15.130:0/3792600538 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:46.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa976d9d640 1 --2- 172.21.15.130:0/3792600538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9780cdfc0 0x7fa9780b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa96dd9b640 1 -- 172.21.15.130:0/3792600538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9780cdfc0 msgr2=0x7fa9780b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:46.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa96dd9b640 1 --2- 172.21.15.130:0/3792600538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9780cdfc0 0x7fa9780b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa96dd9b640 1 -- 172.21.15.130:0/3792600538 >> v1:172.21.15.164:6789/0 conn(0x7fa978159f20 legacy=0x7fa9780b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.399+0000 7fa96dd9b640 1 -- 172.21.15.130:0/3792600538 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780ced90 con 0x7fa9780b1d20 2023-09-13T06:03:46.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa96dd9b640 1 --2- 172.21.15.130:0/3792600538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9780b1d20 0x7fa9780ce7b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa9680098a0 tx=0x7fa96801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7f13de59e8f473 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:46.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa975d9b640 1 -- 172.21.15.130:0/3792600538 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680ab610 con 0x7fa9780b1d20 2023-09-13T06:03:46.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa975d9b640 1 -- 172.21.15.130:0/3792600538 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9680ab770 con 0x7fa9780b1d20 2023-09-13T06:03:46.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa975d9b640 1 -- 172.21.15.130:0/3792600538 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680abb00 con 0x7fa9780b1d20 2023-09-13T06:03:46.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa97cf2c640 1 -- 172.21.15.130:0/3792600538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9780b1d20 msgr2=0x7fa9780ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa97cf2c640 1 --2- 172.21.15.130:0/3792600538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9780b1d20 0x7fa9780ce7b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa9680098a0 tx=0x7fa96801c520 comp rx=0 tx=0).stop 2023-09-13T06:03:46.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa97cf2c640 1 -- 172.21.15.130:0/3792600538 shutdown_connections 2023-09-13T06:03:46.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa97cf2c640 1 --2- 172.21.15.130:0/3792600538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9780cdfc0 0x7fa9780b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa97cf2c640 1 --2- 172.21.15.130:0/3792600538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9780b1d20 0x7fa9780ce7b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa97cf2c640 1 -- 172.21.15.130:0/3792600538 >> 172.21.15.130:0/3792600538 conn(0x7fa978065990 msgr2=0x7fa978065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:46.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa97cf2c640 1 -- 172.21.15.130:0/3792600538 shutdown_connections 2023-09-13T06:03:46.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa97cf2c640 1 -- 172.21.15.130:0/3792600538 wait complete. 2023-09-13T06:03:46.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.403+0000 7fa97cf2c640 1 Processor -- start 2023-09-13T06:03:46.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97cf2c640 1 -- start start 2023-09-13T06:03:46.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97cf2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9780b1d20 0x7fa9780c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97cf2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9780cdfc0 0x7fa97813faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97cf2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa978159f20 0x7fa97813c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97cf2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780ab0a0 con 0x7fa9780b1d20 2023-09-13T06:03:46.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97cf2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780aab20 con 0x7fa978159f20 2023-09-13T06:03:46.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97cf2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97813ffe0 con 0x7fa9780cdfc0 2023-09-13T06:03:46.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9780b1d20 0x7fa9780c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9780b1d20 0x7fa9780c2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36036/0 (socket says 172.21.15.130:36036) 2023-09-13T06:03:46.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97659c640 1 -- 172.21.15.130:0/2679142249 learned_addr learned my addr 172.21.15.130:0/2679142249 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:46.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa96dd9b640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9780cdfc0 0x7fa97813faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa976d9d640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa978159f20 0x7fa97813c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97659c640 1 -- 172.21.15.130:0/2679142249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9780cdfc0 msgr2=0x7fa97813faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97659c640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9780cdfc0 0x7fa97813faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97659c640 1 -- 172.21.15.130:0/2679142249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa978159f20 msgr2=0x7fa97813c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97659c640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa978159f20 0x7fa97813c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97659c640 1 -- 172.21.15.130:0/2679142249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680094d0 con 0x7fa9780b1d20 2023-09-13T06:03:46.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa976d9d640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa978159f20 0x7fa97813c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:46.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97659c640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9780b1d20 0x7fa9780c2b90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c3c0 tx=0x7fa96000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:46.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa96f7fe640 1 -- 172.21.15.130:0/2679142249 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600052d0 con 0x7fa9780b1d20 2023-09-13T06:03:46.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa96f7fe640 1 -- 172.21.15.130:0/2679142249 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa960005430 con 0x7fa9780b1d20 2023-09-13T06:03:46.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa96f7fe640 1 -- 172.21.15.130:0/2679142249 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960003840 con 0x7fa9780b1d20 2023-09-13T06:03:46.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97cf2c640 1 -- 172.21.15.130:0/2679142249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9780aadc0 con 0x7fa9780b1d20 2023-09-13T06:03:46.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97cf2c640 1 -- 172.21.15.130:0/2679142249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9780c3170 con 0x7fa9780b1d20 2023-09-13T06:03:46.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.407+0000 7fa97cf2c640 1 -- 172.21.15.130:0/2679142249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa978070f80 con 0x7fa9780b1d20 2023-09-13T06:03:46.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.411+0000 7fa96f7fe640 1 -- 172.21.15.130:0/2679142249 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa9600039a0 con 0x7fa9780b1d20 2023-09-13T06:03:46.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.411+0000 7fa96f7fe640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa958065b20 0x7fa958067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:46.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.411+0000 7fa96f7fe640 1 -- 172.21.15.130:0/2679142249 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa9600824b0 con 0x7fa9780b1d20 2023-09-13T06:03:46.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.411+0000 7fa96dd9b640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa958065b20 0x7fa958067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:46.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.411+0000 7fa96dd9b640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa958065b20 0x7fa958067fe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa9680af000 tx=0x7fa9680b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:46.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.415+0000 7fa96f7fe640 1 -- 172.21.15.130:0/2679142249 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa9600501a0 con 0x7fa9780b1d20 2023-09-13T06:03:46.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.615+0000 7fa97cf2c640 1 -- 172.21.15.130:0/2679142249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7fa9780ab1e0 con 0x7fa9780b1d20 2023-09-13T06:03:46.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.903+0000 7fa96f7fe640 1 -- 172.21.15.130:0/2679142249 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v151) v1 ==== 142+0+0 (secure 0 0 0) 0x7fa9780ab1e0 con 0x7fa9780b1d20 2023-09-13T06:03:46.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 -- 172.21.15.130:0/2679142249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa958065b20 msgr2=0x7fa958067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa958065b20 0x7fa958067fe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa9680af000 tx=0x7fa9680b6040 comp rx=0 tx=0).stop 2023-09-13T06:03:46.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 -- 172.21.15.130:0/2679142249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9780b1d20 msgr2=0x7fa9780c2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:46.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9780b1d20 0x7fa9780c2b90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c3c0 tx=0x7fa96000c880 comp rx=0 tx=0).stop 2023-09-13T06:03:46.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 -- 172.21.15.130:0/2679142249 shutdown_connections 2023-09-13T06:03:46.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa958065b20 0x7fa958067fe0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa978159f20 0x7fa97813c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9780cdfc0 0x7fa97813faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 --2- 172.21.15.130:0/2679142249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9780b1d20 0x7fa9780c2b90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:46.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 -- 172.21.15.130:0/2679142249 >> 172.21.15.130:0/2679142249 conn(0x7fa978065990 msgr2=0x7fa9781524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:46.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 -- 172.21.15.130:0/2679142249 shutdown_connections 2023-09-13T06:03:46.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:46.907+0000 7fa97cf2c640 1 -- 172.21.15.130:0/2679142249 wait complete. 2023-09-13T06:03:46.930 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-09-13T06:03:46.931 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-09-13T06:03:46.931 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:03:47.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.063+0000 7fbb7db74640 1 Processor -- start 2023-09-13T06:03:47.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.063+0000 7fbb7db74640 1 -- start start 2023-09-13T06:03:47.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb7db74640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbb780b1d20 0x7fbb780ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb7db74640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb780ccfd0 con 0x7fbb78159f20 2023-09-13T06:03:47.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb7db74640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb780ced90 con 0x7fbb780cdfc0 2023-09-13T06:03:47.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb7db74640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb780ce430 con 0x7fbb780b1d20 2023-09-13T06:03:47.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb777fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fbb78159f20 0x7fbb780b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36522/0 (socket says 172.21.15.130:36522) 2023-09-13T06:03:47.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb777fe640 1 -- 172.21.15.130:0/375442714 learned_addr learned my addr 172.21.15.130:0/375442714 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:47.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330617018 0 0) 0x7fbb780ccfd0 con 0x7fbb78159f20 2023-09-13T06:03:47.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb76ffd640 1 --2- 172.21.15.130:0/375442714 >> v2:172.21.15.164:3300/0 conn(0x7fbb780b1d20 0x7fbb780ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb60005740 con 0x7fbb78159f20 2023-09-13T06:03:47.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 367492805 0 0) 0x7fbb60005740 con 0x7fbb78159f20 2023-09-13T06:03:47.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 >> v2:172.21.15.164:3300/0 conn(0x7fbb780b1d20 msgr2=0x7fbb780ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:47.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 --2- 172.21.15.130:0/375442714 >> v2:172.21.15.164:3300/0 conn(0x7fbb780b1d20 0x7fbb780ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 >> v1:172.21.15.164:6789/0 conn(0x7fbb780cdfc0 legacy=0x7fbb780ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780cd200 con 0x7fbb78159f20 2023-09-13T06:03:47.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fbb68001680 con 0x7fbb78159f20 2023-09-13T06:03:47.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 >> v1:172.21.15.130:6789/0 conn(0x7fbb78159f20 legacy=0x7fbb780b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 --2- 172.21.15.130:0/375442714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb60005c30 0x7fbb60006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 --2- 172.21.15.130:0/375442714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb600069e0 0x7fbb60006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 --2- 172.21.15.130:0/375442714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb600073a0 0x7fbb6000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780ce430 con 0x7fbb600069e0 2023-09-13T06:03:47.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6000e2f0 con 0x7fbb60005c30 2023-09-13T06:03:47.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6000e4b0 con 0x7fbb600073a0 2023-09-13T06:03:47.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb76ffd640 1 --2- 172.21.15.130:0/375442714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb600069e0 0x7fbb60006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb777fe640 1 --2- 172.21.15.130:0/375442714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb60005c30 0x7fbb60006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb77fff640 1 --2- 172.21.15.130:0/375442714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb600073a0 0x7fbb6000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb76ffd640 1 -- 172.21.15.130:0/375442714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb600073a0 msgr2=0x7fbb6000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:47.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb76ffd640 1 --2- 172.21.15.130:0/375442714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb600073a0 0x7fbb6000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb76ffd640 1 -- 172.21.15.130:0/375442714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb60005c30 msgr2=0x7fbb60006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:47.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb76ffd640 1 --2- 172.21.15.130:0/375442714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb60005c30 0x7fbb60006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb76ffd640 1 -- 172.21.15.130:0/375442714 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb60005740 con 0x7fbb600069e0 2023-09-13T06:03:47.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.067+0000 7fbb77fff640 1 -- 172.21.15.130:0/375442714 reap_dead start 2023-09-13T06:03:47.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.071+0000 7fbb76ffd640 1 --2- 172.21.15.130:0/375442714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb600069e0 0x7fbb60006e60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009ae0 tx=0x7fbb6c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6231253688415238 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:47.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.071+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0a9420 con 0x7fbb600069e0 2023-09-13T06:03:47.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.071+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c0a9580 con 0x7fbb600069e0 2023-09-13T06:03:47.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.071+0000 7fbb767fc640 1 -- 172.21.15.130:0/375442714 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0a9930 con 0x7fbb600069e0 2023-09-13T06:03:47.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.071+0000 7fbb7db74640 1 -- 172.21.15.130:0/375442714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb600069e0 msgr2=0x7fbb60006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.071+0000 7fbb7db74640 1 --2- 172.21.15.130:0/375442714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb600069e0 0x7fbb60006e60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009ae0 tx=0x7fbb6c01ca50 comp rx=0 tx=0).stop 2023-09-13T06:03:47.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.071+0000 7fbb7db74640 1 -- 172.21.15.130:0/375442714 shutdown_connections 2023-09-13T06:03:47.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.071+0000 7fbb7db74640 1 --2- 172.21.15.130:0/375442714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb600069e0 0x7fbb60006e60 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.071+0000 7fbb7db74640 1 -- 172.21.15.130:0/375442714 >> 172.21.15.130:0/375442714 conn(0x7fbb78065990 msgr2=0x7fbb78065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:47.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.071+0000 7fbb7db74640 1 -- 172.21.15.130:0/375442714 shutdown_connections 2023-09-13T06:03:47.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.071+0000 7fbb7db74640 1 -- 172.21.15.130:0/375442714 wait complete. 2023-09-13T06:03:47.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb7db74640 1 Processor -- start 2023-09-13T06:03:47.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb7db74640 1 -- start start 2023-09-13T06:03:47.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb7db74640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb600069e0 0x7fbb78147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb7db74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb780c8990 0x7fbb780c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb7db74640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb78154020 0x7fbb780a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb7db74640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780c8500 con 0x7fbb780c8990 2023-09-13T06:03:47.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb7db74640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780c78f0 con 0x7fbb600069e0 2023-09-13T06:03:47.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb7db74640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780c7bd0 con 0x7fbb78154020 2023-09-13T06:03:47.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb76ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb780c8990 0x7fbb780c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb76ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb780c8990 0x7fbb780c6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36054/0 (socket says 172.21.15.130:36054) 2023-09-13T06:03:47.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb76ffd640 1 -- 172.21.15.130:0/912206090 learned_addr learned my addr 172.21.15.130:0/912206090 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:47.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb777fe640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb600069e0 0x7fbb78147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb77fff640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb78154020 0x7fbb780a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb76ffd640 1 -- 172.21.15.130:0/912206090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb78154020 msgr2=0x7fbb780a85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb76ffd640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb78154020 0x7fbb780a85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb76ffd640 1 -- 172.21.15.130:0/912206090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb600069e0 msgr2=0x7fbb78147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb76ffd640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb600069e0 0x7fbb78147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb76ffd640 1 -- 172.21.15.130:0/912206090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780c7eb0 con 0x7fbb780c8990 2023-09-13T06:03:47.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb77fff640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb78154020 0x7fbb780a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:47.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb76ffd640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb780c8990 0x7fbb780c6fa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c01c880 tx=0x7fbb6c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:47.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb5ffff640 1 -- 172.21.15.130:0/912206090 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0b6070 con 0x7fbb780c8990 2023-09-13T06:03:47.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb5ffff640 1 -- 172.21.15.130:0/912206090 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c0a96f0 con 0x7fbb780c8990 2023-09-13T06:03:47.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb7db74640 1 -- 172.21.15.130:0/912206090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb780c8190 con 0x7fbb780c8990 2023-09-13T06:03:47.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb5ffff640 1 -- 172.21.15.130:0/912206090 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0a9ac0 con 0x7fbb780c8990 2023-09-13T06:03:47.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.075+0000 7fbb7db74640 1 -- 172.21.15.130:0/912206090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb780c74e0 con 0x7fbb780c8990 2023-09-13T06:03:47.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.079+0000 7fbb7db74640 1 -- 172.21.15.130:0/912206090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb780c8670 con 0x7fbb780c8990 2023-09-13T06:03:47.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.079+0000 7fbb5ffff640 1 -- 172.21.15.130:0/912206090 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbb6c0ba070 con 0x7fbb780c8990 2023-09-13T06:03:47.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.079+0000 7fbb5ffff640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbb64065b20 0x7fbb64067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.079+0000 7fbb5ffff640 1 -- 172.21.15.130:0/912206090 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbb6c11cce0 con 0x7fbb780c8990 2023-09-13T06:03:47.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.079+0000 7fbb777fe640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbb64065b20 0x7fbb64067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.079+0000 7fbb777fe640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbb64065b20 0x7fbb64067fe0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbb68001ec0 tx=0x7fbb68000fb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:47.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.083+0000 7fbb5ffff640 1 -- 172.21.15.130:0/912206090 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbb6c0eaa60 con 0x7fbb780c8990 2023-09-13T06:03:47.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 -- 172.21.15.130:0/912206090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb780618a0 con 0x7fbb780c8990 2023-09-13T06:03:47.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb5ffff640 1 -- 172.21.15.130:0/912206090 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+13024 (secure 0 0 0) 0x7fbb6c0c1020 con 0x7fbb780c8990 2023-09-13T06:03:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:47.239 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":57,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:03:45.903092+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.130:6837/1098709916":"2023-09-14T06:03:42.896130+0000","172.21.15.130:6835/1098709916":"2023-09-14T06:03:42.896130+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:03:47.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 -- 172.21.15.130:0/912206090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbb64065b20 msgr2=0x7fbb64067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbb64065b20 0x7fbb64067fe0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbb68001ec0 tx=0x7fbb68000fb0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 -- 172.21.15.130:0/912206090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb780c8990 msgr2=0x7fbb780c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb780c8990 0x7fbb780c6fa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c01c880 tx=0x7fbb6c0197f0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 -- 172.21.15.130:0/912206090 shutdown_connections 2023-09-13T06:03:47.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbb64065b20 0x7fbb64067fe0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb78154020 0x7fbb780a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb780c8990 0x7fbb780c6fa0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 --2- 172.21.15.130:0/912206090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb600069e0 0x7fbb78147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 -- 172.21.15.130:0/912206090 >> 172.21.15.130:0/912206090 conn(0x7fbb78065990 msgr2=0x7fbb780705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:47.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 -- 172.21.15.130:0/912206090 shutdown_connections 2023-09-13T06:03:47.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.235+0000 7fbb7db74640 1 -- 172.21.15.130:0/912206090 wait complete. 2023-09-13T06:03:47.261 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:03:47.261 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:03:47.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.399+0000 7f83633db640 1 Processor -- start 2023-09-13T06:03:47.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.399+0000 7f83633db640 1 -- start start 2023-09-13T06:03:47.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.399+0000 7f83633db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f835c157750 0x7f835c160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.399+0000 7f83633db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f835c157b30 0x7f835c06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.399+0000 7f83633db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835c161e60 con 0x7f835c06f170 2023-09-13T06:03:47.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.399+0000 7f83633db640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835c0ae0d0 con 0x7f835c157b30 2023-09-13T06:03:47.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.399+0000 7f83633db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c1615c0 con 0x7f835c157750 2023-09-13T06:03:47.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.399+0000 7f8361978640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f835c06f170 0x7f835c15e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36538/0 (socket says 172.21.15.130:36538) 2023-09-13T06:03:47.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.399+0000 7f8361978640 1 -- 172.21.15.130:0/1490525645 learned_addr learned my addr 172.21.15.130:0/1490525645 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:47.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.399+0000 7f8361177640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f835c157750 0x7f835c160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.399+0000 7f8360976640 1 --2- 172.21.15.130:0/1490525645 >> v2:172.21.15.164:3300/0 conn(0x7f835c157b30 0x7f835c06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174548002 0 0) 0x7f835c161e60 con 0x7f835c06f170 2023-09-13T06:03:47.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8348003530 con 0x7f835c06f170 2023-09-13T06:03:47.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 562931387 0 0) 0x7f8348003530 con 0x7f835c06f170 2023-09-13T06:03:47.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f835c157750 msgr2=0x7f835c160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:47.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f835c157750 0x7f835c160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 >> v2:172.21.15.164:3300/0 conn(0x7f835c157b30 msgr2=0x7f835c06dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:47.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 --2- 172.21.15.130:0/1490525645 >> v2:172.21.15.164:3300/0 conn(0x7f835c157b30 0x7f835c06dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c1618a0 con 0x7f835c06f170 2023-09-13T06:03:47.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f8354001a00 con 0x7f835c06f170 2023-09-13T06:03:47.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8360976640 1 --2- 172.21.15.130:0/1490525645 >> v2:172.21.15.164:3300/0 conn(0x7f835c157b30 0x7f835c06dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:47.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8361177640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f835c157750 0x7f835c160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:47.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 >> v1:172.21.15.130:6789/0 conn(0x7f835c06f170 legacy=0x7f835c15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83480039f0 0x7f8348003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83480047d0 0x7f8348004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8348005190 0x7f834800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c0ae0d0 con 0x7f83480047d0 2023-09-13T06:03:47.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c1615c0 con 0x7f8348005190 2023-09-13T06:03:47.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834800bed0 con 0x7f83480039f0 2023-09-13T06:03:47.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8360976640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83480047d0 0x7f8348004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8361177640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83480039f0 0x7f8348003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8361978640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8348005190 0x7f834800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8360976640 1 -- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83480039f0 msgr2=0x7f8348003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:47.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8360976640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83480039f0 0x7f8348003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8360976640 1 -- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8348005190 msgr2=0x7f834800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:47.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8360976640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8348005190 0x7f834800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.403+0000 7f8360976640 1 -- 172.21.15.130:0/1490525645 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8348003530 con 0x7f83480047d0 2023-09-13T06:03:47.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f8360976640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83480047d0 0x7f8348004c50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f834c009ce0 tx=0x7f834c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a375d3d28dee44 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:47.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0a5800 con 0x7f83480047d0 2023-09-13T06:03:47.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c0a5960 con 0x7f83480047d0 2023-09-13T06:03:47.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f8353fff640 1 -- 172.21.15.130:0/1490525645 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0a5d50 con 0x7f83480047d0 2023-09-13T06:03:47.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 -- 172.21.15.130:0/1490525645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83480047d0 msgr2=0x7f8348004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 --2- 172.21.15.130:0/1490525645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83480047d0 0x7f8348004c50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f834c009ce0 tx=0x7f834c01cbf0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f8361978640 1 -- 172.21.15.130:0/1490525645 reap_dead start 2023-09-13T06:03:47.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 -- 172.21.15.130:0/1490525645 shutdown_connections 2023-09-13T06:03:47.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 -- 172.21.15.130:0/1490525645 >> 172.21.15.130:0/1490525645 conn(0x7f835c065d60 msgr2=0x7f835c0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:47.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 -- 172.21.15.130:0/1490525645 shutdown_connections 2023-09-13T06:03:47.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 -- 172.21.15.130:0/1490525645 wait complete. 2023-09-13T06:03:47.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 Processor -- start 2023-09-13T06:03:47.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 -- start start 2023-09-13T06:03:47.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83480047d0 0x7f835c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c159050 0x7f835c160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f835c14e160 0x7f835c14e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c15a090 con 0x7f835c159050 2023-09-13T06:03:47.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c15ae70 con 0x7f835c14e160 2023-09-13T06:03:47.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.407+0000 7f83633db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c155b50 con 0x7f83480047d0 2023-09-13T06:03:47.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8360976640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c159050 0x7f835c160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8360976640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c159050 0x7f835c160110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36074/0 (socket says 172.21.15.130:36074) 2023-09-13T06:03:47.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8360976640 1 -- 172.21.15.130:0/3070336437 learned_addr learned my addr 172.21.15.130:0/3070336437 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:47.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8361177640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83480047d0 0x7f835c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8361978640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f835c14e160 0x7f835c14e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8360976640 1 -- 172.21.15.130:0/3070336437 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83480047d0 msgr2=0x7f835c15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8360976640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83480047d0 0x7f835c15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8360976640 1 -- 172.21.15.130:0/3070336437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f835c14e160 msgr2=0x7f835c14e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8360976640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f835c14e160 0x7f835c14e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8360976640 1 -- 172.21.15.130:0/3070336437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c14eb50 con 0x7f835c159050 2023-09-13T06:03:47.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8360976640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c159050 0x7f835c160110 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f834c009ce0 tx=0x7f8348005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:47.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8351ffb640 1 -- 172.21.15.130:0/3070336437 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0be070 con 0x7f835c159050 2023-09-13T06:03:47.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8351ffb640 1 -- 172.21.15.130:0/3070336437 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c004020 con 0x7f835c159050 2023-09-13T06:03:47.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8351ffb640 1 -- 172.21.15.130:0/3070336437 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0043b0 con 0x7f835c159050 2023-09-13T06:03:47.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f83633db640 1 -- 172.21.15.130:0/3070336437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835c159510 con 0x7f835c159050 2023-09-13T06:03:47.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f83633db640 1 -- 172.21.15.130:0/3070336437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835c159ad0 con 0x7f835c159050 2023-09-13T06:03:47.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f83633db640 1 -- 172.21.15.130:0/3070336437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835c0618a0 con 0x7f835c159050 2023-09-13T06:03:47.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.411+0000 7f8351ffb640 1 -- 172.21.15.130:0/3070336437 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f834c0b4040 con 0x7f835c159050 2023-09-13T06:03:47.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.415+0000 7f8351ffb640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8340065b20 0x7f8340067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.415+0000 7f8351ffb640 1 -- 172.21.15.130:0/3070336437 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f834c11d0a0 con 0x7f835c159050 2023-09-13T06:03:47.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.415+0000 7f8361177640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8340065b20 0x7f8340067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.415+0000 7f8361177640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8340065b20 0x7f8340067fe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f835c0664d0 tx=0x7f8358009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:47.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.419+0000 7f8351ffb640 1 -- 172.21.15.130:0/3070336437 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f834c0ead10 con 0x7f835c159050 2023-09-13T06:03:47.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 -- 172.21.15.130:0/3070336437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f835c0733f0 con 0x7f835c159050 2023-09-13T06:03:47.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f8351ffb640 1 -- 172.21.15.130:0/3070336437 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f834c0b20a0 con 0x7f835c159050 2023-09-13T06:03:47.571 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:03:47.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 -- 172.21.15.130:0/3070336437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8340065b20 msgr2=0x7f8340067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8340065b20 0x7f8340067fe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f835c0664d0 tx=0x7f8358009190 comp rx=0 tx=0).stop 2023-09-13T06:03:47.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 -- 172.21.15.130:0/3070336437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c159050 msgr2=0x7f835c160110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c159050 0x7f835c160110 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f834c009ce0 tx=0x7f8348005800 comp rx=0 tx=0).stop 2023-09-13T06:03:47.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 -- 172.21.15.130:0/3070336437 shutdown_connections 2023-09-13T06:03:47.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8340065b20 0x7f8340067fe0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f835c14e160 0x7f835c14e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c159050 0x7f835c160110 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 --2- 172.21.15.130:0/3070336437 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83480047d0 0x7f835c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 -- 172.21.15.130:0/3070336437 >> 172.21.15.130:0/3070336437 conn(0x7f835c065d60 msgr2=0x7f835c0b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:47.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 -- 172.21.15.130:0/3070336437 shutdown_connections 2023-09-13T06:03:47.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.567+0000 7f83633db640 1 -- 172.21.15.130:0/3070336437 wait complete. 2023-09-13T06:03:47.591 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-09-13T06:03:47.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f700706a640 1 Processor -- start 2023-09-13T06:03:47.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f700706a640 1 -- start start 2023-09-13T06:03:47.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f700706a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70000b1d20 0x7f70000ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f700706a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f70000cdfc0 0x7f70000b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f700706a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70000ccfd0 con 0x7f7000159f20 2023-09-13T06:03:47.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f700706a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70000ce430 con 0x7f70000cdfc0 2023-09-13T06:03:47.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f700706a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70000b00f0 con 0x7f70000b1d20 2023-09-13T06:03:47.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f7004e06640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f7000159f20 0x7f70000b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36546/0 (socket says 172.21.15.130:36546) 2023-09-13T06:03:47.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f7004e06640 1 -- 172.21.15.130:0/2450068576 learned_addr learned my addr 172.21.15.130:0/2450068576 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:47.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f6ffffff640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70000b1d20 0x7f70000ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f7005607640 1 --2- 172.21.15.130:0/2450068576 >> v2:172.21.15.164:3300/0 conn(0x7f70000cdfc0 0x7f70000b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699218673 0 0) 0x7f70000ccfd0 con 0x7f7000159f20 2023-09-13T06:03:47.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.727+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff0003530 con 0x7f7000159f20 2023-09-13T06:03:47.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2656957629 0 0) 0x7f6ff0003530 con 0x7f7000159f20 2023-09-13T06:03:47.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70000b1d20 msgr2=0x7f70000ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:47.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70000b1d20 0x7f70000ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 >> v2:172.21.15.164:3300/0 conn(0x7f70000cdfc0 msgr2=0x7f70000b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:47.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 --2- 172.21.15.130:0/2450068576 >> v2:172.21.15.164:3300/0 conn(0x7f70000cdfc0 0x7f70000b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000ced90 con 0x7f7000159f20 2023-09-13T06:03:47.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f6ff4001680 con 0x7f7000159f20 2023-09-13T06:03:47.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 >> v1:172.21.15.130:6789/0 conn(0x7f7000159f20 legacy=0x7f70000b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70000b1d20 0x7f6ff00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 0x7f6ff00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ff0004d10 0x7f6ff0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70000ce430 con 0x7f6ff0003f70 2023-09-13T06:03:47.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff000b990 con 0x7f6ff0004d10 2023-09-13T06:03:47.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff000bb00 con 0x7f70000b1d20 2023-09-13T06:03:47.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6ffffff640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 0x7f6ff00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f7004e06640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70000b1d20 0x7f6ff00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f7005607640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ff0004d10 0x7f6ff0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6ffffff640 1 -- 172.21.15.130:0/2450068576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70000b1d20 msgr2=0x7f6ff00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:47.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6ffffff640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70000b1d20 0x7f6ff00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6ffffff640 1 -- 172.21.15.130:0/2450068576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ff0004d10 msgr2=0x7f6ff0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:47.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6ffffff640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ff0004d10 0x7f6ff0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6ffffff640 1 -- 172.21.15.130:0/2450068576 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff0003530 con 0x7f6ff0003f70 2023-09-13T06:03:47.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.731+0000 7f6ffffff640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 0x7f6ff00047d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009ae0 tx=0x7f6fec01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a387e7edd11e709 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:47.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0a5640 con 0x7f6ff0003f70 2023-09-13T06:03:47.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec0a57a0 con 0x7f6ff0003f70 2023-09-13T06:03:47.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f6fff7fe640 1 -- 172.21.15.130:0/2450068576 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0a5b50 con 0x7f6ff0003f70 2023-09-13T06:03:47.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 -- 172.21.15.130:0/2450068576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 msgr2=0x7f6ff00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 --2- 172.21.15.130:0/2450068576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 0x7f6ff00047d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009ae0 tx=0x7f6fec01ca50 comp rx=0 tx=0).stop 2023-09-13T06:03:47.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f7005607640 1 -- 172.21.15.130:0/2450068576 reap_dead start 2023-09-13T06:03:47.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 -- 172.21.15.130:0/2450068576 shutdown_connections 2023-09-13T06:03:47.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 -- 172.21.15.130:0/2450068576 >> 172.21.15.130:0/2450068576 conn(0x7f7000065990 msgr2=0x7f7000065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:47.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 -- 172.21.15.130:0/2450068576 shutdown_connections 2023-09-13T06:03:47.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 -- 172.21.15.130:0/2450068576 wait complete. 2023-09-13T06:03:47.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 Processor -- start 2023-09-13T06:03:47.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 -- start start 2023-09-13T06:03:47.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 0x7f70001660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f700006c8b0 0x7f70000acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7000147a80 0x7f7000147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70001675c0 con 0x7f6ff0003f70 2023-09-13T06:03:47.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7000148440 con 0x7f7000147a80 2023-09-13T06:03:47.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f700706a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70001669b0 con 0x7f700006c8b0 2023-09-13T06:03:47.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f7004e06640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 0x7f70001660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f7004e06640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 0x7f70001660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36084/0 (socket says 172.21.15.130:36084) 2023-09-13T06:03:47.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.735+0000 7f7004e06640 1 -- 172.21.15.130:0/3176491250 learned_addr learned my addr 172.21.15.130:0/3176491250 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:47.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f7005607640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7000147a80 0x7f7000147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f6ffffff640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f700006c8b0 0x7f70000acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f7004e06640 1 -- 172.21.15.130:0/3176491250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f700006c8b0 msgr2=0x7f70000acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f7004e06640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f700006c8b0 0x7f70000acaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f7004e06640 1 -- 172.21.15.130:0/3176491250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7000147a80 msgr2=0x7f7000147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:47.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f7004e06640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7000147a80 0x7f7000147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:47.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f7004e06640 1 -- 172.21.15.130:0/3176491250 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000166c90 con 0x7f6ff0003f70 2023-09-13T06:03:47.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f7005607640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7000147a80 0x7f7000147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:47.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f7004e06640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 0x7f70001660b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4012310 tx=0x7f6ff40127d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:47.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f6ffd7fa640 1 -- 172.21.15.130:0/3176491250 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4014750 con 0x7f6ff0003f70 2023-09-13T06:03:47.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f6ffd7fa640 1 -- 172.21.15.130:0/3176491250 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff40148b0 con 0x7f6ff0003f70 2023-09-13T06:03:47.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f6ffd7fa640 1 -- 172.21.15.130:0/3176491250 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4014c60 con 0x7f6ff0003f70 2023-09-13T06:03:47.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f700706a640 1 -- 172.21.15.130:0/3176491250 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7000166f70 con 0x7f6ff0003f70 2023-09-13T06:03:47.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f700706a640 1 -- 172.21.15.130:0/3176491250 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70001665f0 con 0x7f6ff0003f70 2023-09-13T06:03:47.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f700706a640 1 -- 172.21.15.130:0/3176491250 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7000166780 con 0x7f6ff0003f70 2023-09-13T06:03:47.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f6ffd7fa640 1 -- 172.21.15.130:0/3176491250 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6ff40153e0 con 0x7f6ff0003f70 2023-09-13T06:03:47.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f6ffd7fa640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fe4065b50 0x7f6fe4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:47.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.739+0000 7f6ffd7fa640 1 -- 172.21.15.130:0/3176491250 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6ff4085740 con 0x7f6ff0003f70 2023-09-13T06:03:47.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.743+0000 7f6ffffff640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fe4065b50 0x7f6fe4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:47.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.743+0000 7f6ffffff640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fe4065b50 0x7f6fe4068010 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0af000 tx=0x7f6fec0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:47.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.743+0000 7f6ffd7fa640 1 -- 172.21.15.130:0/3176491250 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6ff4053440 con 0x7f6ff0003f70 2023-09-13T06:03:47.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:47.947+0000 7f700706a640 1 -- 172.21.15.130:0/3176491250 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f70000b1690 con 0x7f6ff0003f70 2023-09-13T06:03:48.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.915+0000 7f6ffd7fa640 1 -- 172.21.15.130:0/3176491250 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v153) v1 ==== 137+0+0 (secure 0 0 0) 0x7f6ff4056a60 con 0x7f6ff0003f70 2023-09-13T06:03:48.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 -- 172.21.15.130:0/3176491250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fe4065b50 msgr2=0x7f6fe4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:48.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fe4065b50 0x7f6fe4068010 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0af000 tx=0x7f6fec0046d0 comp rx=0 tx=0).stop 2023-09-13T06:03:48.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 -- 172.21.15.130:0/3176491250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 msgr2=0x7f70001660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:48.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 0x7f70001660b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4012310 tx=0x7f6ff40127d0 comp rx=0 tx=0).stop 2023-09-13T06:03:48.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 -- 172.21.15.130:0/3176491250 shutdown_connections 2023-09-13T06:03:48.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fe4065b50 0x7f6fe4068010 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:48.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7000147a80 0x7f7000147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:48.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f700006c8b0 0x7f70000acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:48.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 --2- 172.21.15.130:0/3176491250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff0003f70 0x7f70001660b0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:48.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 -- 172.21.15.130:0/3176491250 >> 172.21.15.130:0/3176491250 conn(0x7f7000065990 msgr2=0x7f70000cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:48.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 -- 172.21.15.130:0/3176491250 shutdown_connections 2023-09-13T06:03:48.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:48.919+0000 7f700706a640 1 -- 172.21.15.130:0/3176491250 wait complete. 2023-09-13T06:03:48.946 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-09-13T06:03:49.103 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_objectstore":"memstore"} 2023-09-13T06:03:49.104 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-09-13T06:03:49.104 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-13T06:03:49.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.239+0000 7f1104774640 1 Processor -- start 2023-09-13T06:03:49.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.239+0000 7f1104774640 1 -- start start 2023-09-13T06:03:49.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1104774640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10fc15a080 0x7f10fc0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1104774640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f10fc15e650 0x7f10fc0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1104774640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10fc0b2fd0 0x7f10fc0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1104774640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc0cc850 con 0x7f10fc15e650 2023-09-13T06:03:49.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1104774640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc0b33f0 con 0x7f10fc15a080 2023-09-13T06:03:49.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1104774640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0b0330 con 0x7f10fc0b2fd0 2023-09-13T06:03:49.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1101d0f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f10fc15e650 0x7f10fc0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1101d0f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f10fc15e650 0x7f10fc0b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36090/0 (socket says 172.21.15.130:36090) 2023-09-13T06:03:49.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1101d0f640 1 -- 172.21.15.130:0/390451895 learned_addr learned my addr 172.21.15.130:0/390451895 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:49.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1102d11640 1 --2- 172.21.15.130:0/390451895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10fc0b2fd0 0x7f10fc0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1102510640 1 --2- 172.21.15.130:0/390451895 >> v2:172.21.15.164:3300/0 conn(0x7f10fc15a080 0x7f10fc0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1101d0f640 1 -- 172.21.15.130:0/390451895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10fc0b2fd0 msgr2=0x7f10fc0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:49.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1101d0f640 1 --2- 172.21.15.130:0/390451895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10fc0b2fd0 0x7f10fc0ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1101d0f640 1 -- 172.21.15.130:0/390451895 >> v2:172.21.15.164:3300/0 conn(0x7f10fc15a080 msgr2=0x7f10fc0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:49.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1101d0f640 1 --2- 172.21.15.130:0/390451895 >> v2:172.21.15.164:3300/0 conn(0x7f10fc15a080 0x7f10fc0b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.243+0000 7f1101d0f640 1 -- 172.21.15.130:0/390451895 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0cbcd0 con 0x7f10fc15e650 2023-09-13T06:03:49.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1101d0f640 1 --2- 172.21.15.130:0/390451895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc15e650 0x7f10fc0b2a90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0706b0 tx=0x7f10ec01eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428a56dc0670fa72 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:49.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f110150e640 1 -- 172.21.15.130:0/390451895 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0a79a0 con 0x7f10fc15e650 2023-09-13T06:03:49.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f110150e640 1 -- 172.21.15.130:0/390451895 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec0a7b00 con 0x7f10fc15e650 2023-09-13T06:03:49.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f110150e640 1 -- 172.21.15.130:0/390451895 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0a7e90 con 0x7f10fc15e650 2023-09-13T06:03:49.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 -- 172.21.15.130:0/390451895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc15e650 msgr2=0x7f10fc0b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 --2- 172.21.15.130:0/390451895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc15e650 0x7f10fc0b2a90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0706b0 tx=0x7f10ec01eb10 comp rx=0 tx=0).stop 2023-09-13T06:03:49.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 -- 172.21.15.130:0/390451895 shutdown_connections 2023-09-13T06:03:49.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 --2- 172.21.15.130:0/390451895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10fc0b2fd0 0x7f10fc0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 --2- 172.21.15.130:0/390451895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc15e650 0x7f10fc0b2a90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 --2- 172.21.15.130:0/390451895 >> v2:172.21.15.164:3300/0 conn(0x7f10fc15a080 0x7f10fc0b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 -- 172.21.15.130:0/390451895 >> 172.21.15.130:0/390451895 conn(0x7f10fc065990 msgr2=0x7f10fc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:49.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 -- 172.21.15.130:0/390451895 shutdown_connections 2023-09-13T06:03:49.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 -- 172.21.15.130:0/390451895 wait complete. 2023-09-13T06:03:49.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 Processor -- start 2023-09-13T06:03:49.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 -- start start 2023-09-13T06:03:49.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10fc0b2fd0 0x7f10fc140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10fc15a080 0x7f10fc150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc15e650 0x7f10fc14a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc151160 con 0x7f10fc15e650 2023-09-13T06:03:49.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.247+0000 7f1104774640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc14ee30 con 0x7f10fc0b2fd0 2023-09-13T06:03:49.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1104774640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc14f110 con 0x7f10fc15a080 2023-09-13T06:03:49.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1102d11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc15e650 0x7f10fc14a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1102d11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc15e650 0x7f10fc14a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36106/0 (socket says 172.21.15.130:36106) 2023-09-13T06:03:49.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1102d11640 1 -- 172.21.15.130:0/2362805604 learned_addr learned my addr 172.21.15.130:0/2362805604 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:49.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1102510640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10fc0b2fd0 0x7f10fc140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1101d0f640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10fc15a080 0x7f10fc150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1102d11640 1 -- 172.21.15.130:0/2362805604 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10fc15a080 msgr2=0x7f10fc150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1102d11640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10fc15a080 0x7f10fc150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1102d11640 1 -- 172.21.15.130:0/2362805604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10fc0b2fd0 msgr2=0x7f10fc140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1102d11640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10fc0b2fd0 0x7f10fc140ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1102d11640 1 -- 172.21.15.130:0/2362805604 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec00b770 con 0x7f10fc15e650 2023-09-13T06:03:49.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1102d11640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc15e650 0x7f10fc14a3b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f10f400efc0 tx=0x7f10f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:49.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f10f2ffd640 1 -- 172.21.15.130:0/2362805604 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4009ba0 con 0x7f10fc15e650 2023-09-13T06:03:49.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f10f2ffd640 1 -- 172.21.15.130:0/2362805604 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f400f040 con 0x7f10fc15e650 2023-09-13T06:03:49.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f10f2ffd640 1 -- 172.21.15.130:0/2362805604 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f40146c0 con 0x7f10fc15e650 2023-09-13T06:03:49.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1104774640 1 -- 172.21.15.130:0/2362805604 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc14f3f0 con 0x7f10fc15e650 2023-09-13T06:03:49.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1104774640 1 -- 172.21.15.130:0/2362805604 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc14f9b0 con 0x7f10fc15e650 2023-09-13T06:03:49.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f1104774640 1 -- 172.21.15.130:0/2362805604 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc14fbd0 con 0x7f10fc15e650 2023-09-13T06:03:49.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.251+0000 7f10f2ffd640 1 -- 172.21.15.130:0/2362805604 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f10f4014820 con 0x7f10fc15e650 2023-09-13T06:03:49.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.255+0000 7f10f2ffd640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10e0065b20 0x7f10e0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.255+0000 7f10f2ffd640 1 -- 172.21.15.130:0/2362805604 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f10f4083a50 con 0x7f10fc15e650 2023-09-13T06:03:49.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.255+0000 7f1102510640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10e0065b20 0x7f10e0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.255+0000 7f1102510640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10e0065b20 0x7f10e0067fe0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009a40 tx=0x7f10f8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:49.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.255+0000 7f10f2ffd640 1 -- 172.21.15.130:0/2362805604 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f10f40516b0 con 0x7f10fc15e650 2023-09-13T06:03:49.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.407+0000 7f1104774640 1 -- 172.21.15.130:0/2362805604 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f10fc0618a0 con 0x7f10fc15e650 2023-09-13T06:03:49.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.411+0000 7f10f2ffd640 1 -- 172.21.15.130:0/2362805604 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f10f4054cd0 con 0x7f10fc15e650 2023-09-13T06:03:49.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 -- 172.21.15.130:0/2362805604 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10e0065b20 msgr2=0x7f10e0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10e0065b20 0x7f10e0067fe0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009a40 tx=0x7f10f8009190 comp rx=0 tx=0).stop 2023-09-13T06:03:49.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 -- 172.21.15.130:0/2362805604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc15e650 msgr2=0x7f10fc14a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc15e650 0x7f10fc14a3b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f10f400efc0 tx=0x7f10f400c490 comp rx=0 tx=0).stop 2023-09-13T06:03:49.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 -- 172.21.15.130:0/2362805604 shutdown_connections 2023-09-13T06:03:49.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f10e0065b20 0x7f10e0067fe0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc15e650 0x7f10fc14a3b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10fc15a080 0x7f10fc150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 --2- 172.21.15.130:0/2362805604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10fc0b2fd0 0x7f10fc140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 -- 172.21.15.130:0/2362805604 >> 172.21.15.130:0/2362805604 conn(0x7f10fc065990 msgr2=0x7f10fc151360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:49.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 -- 172.21.15.130:0/2362805604 shutdown_connections 2023-09-13T06:03:49.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.415+0000 7f1104774640 1 -- 172.21.15.130:0/2362805604 wait complete. 2023-09-13T06:03:49.438 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:03:49.438 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:03:49.484 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:03:49.543 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:03:49.543 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:03:49.544 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:49.553 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:03:49.554 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:03:49.554 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:49.564 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:03:49.565 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:03:49.565 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:49.610 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:03:49.612 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:03:49.612 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:03:49.622 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:03:49.623 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-13T06:03:49.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:03:49.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f48374ec640 1 Processor -- start 2023-09-13T06:03:49.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f48374ec640 1 -- start start 2023-09-13T06:03:49.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f48374ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4830146f30 0x7f483015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f48374ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48300b63c0 con 0x7f48300d1090 2023-09-13T06:03:49.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f48374ec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48300d0c20 con 0x7f48300d1750 2023-09-13T06:03:49.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f48374ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483015dea0 con 0x7f4830146f30 2023-09-13T06:03:49.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4834a87640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f48300d1090 0x7f48300b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36554/0 (socket says 172.21.15.130:36554) 2023-09-13T06:03:49.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4834a87640 1 -- 172.21.15.130:0/2498781770 learned_addr learned my addr 172.21.15.130:0/2498781770 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:49.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4835a89640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4830146f30 0x7f483015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973769524 0 0) 0x7f48300b63c0 con 0x7f48300d1090 2023-09-13T06:03:49.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f481c003530 con 0x7f48300d1090 2023-09-13T06:03:49.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218427620 0 0) 0x7f48300d0c20 con 0x7f48300d1750 2023-09-13T06:03:49.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48300b63c0 con 0x7f48300d1750 2023-09-13T06:03:49.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3489592047 0 0) 0x7f481c003530 con 0x7f48300d1090 2023-09-13T06:03:49.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4830146f30 msgr2=0x7f483015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:49.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4830146f30 0x7f483015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 >> v1:172.21.15.164:6789/0 conn(0x7f48300d1750 legacy=0x7f4830146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48300b6610 con 0x7f48300d1090 2023-09-13T06:03:49.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f4820001680 con 0x7f48300d1090 2023-09-13T06:03:49.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 >> v1:172.21.15.130:6789/0 conn(0x7f48300d1090 legacy=0x7f48300b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f481c003bb0 0x7f481c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f481c0047d0 0x7f481c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f481c005190 0x7f481c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c00bfb0 con 0x7f481c005190 2023-09-13T06:03:49.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c00c120 con 0x7f481c0047d0 2023-09-13T06:03:49.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c00c2e0 con 0x7f481c003bb0 2023-09-13T06:03:49.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4835a89640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4830146f30 0x7f483015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:49.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4835288640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f481c003bb0 0x7f481c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4835a89640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f481c005190 0x7f481c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.787+0000 7f4834a87640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f481c0047d0 0x7f481c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f4835288640 1 -- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f481c0047d0 msgr2=0x7f481c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:49.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f4835288640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f481c0047d0 0x7f481c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f4835288640 1 -- 172.21.15.130:0/2498781770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f481c005190 msgr2=0x7f481c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:49.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f4835288640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f481c005190 0x7f481c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f4835288640 1 -- 172.21.15.130:0/2498781770 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c003530 con 0x7f481c003bb0 2023-09-13T06:03:49.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f4835a89640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f481c005190 0x7f481c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:49.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f4835288640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f481c003bb0 0x7f481c003fb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f482c0018d0 tx=0x7f482c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6fdc40140aa35d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:49.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820007ea0 con 0x7f481c003bb0 2023-09-13T06:03:49.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c0052f0 con 0x7f481c003bb0 2023-09-13T06:03:49.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f4827fff640 1 -- 172.21.15.130:0/2498781770 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c003600 con 0x7f481c003bb0 2023-09-13T06:03:49.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f48374ec640 1 -- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f481c003bb0 msgr2=0x7f481c003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f48374ec640 1 --2- 172.21.15.130:0/2498781770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f481c003bb0 0x7f481c003fb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f482c0018d0 tx=0x7f482c01c560 comp rx=0 tx=0).stop 2023-09-13T06:03:49.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.791+0000 7f4835a89640 1 -- 172.21.15.130:0/2498781770 reap_dead start 2023-09-13T06:03:49.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 -- 172.21.15.130:0/2498781770 shutdown_connections 2023-09-13T06:03:49.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 -- 172.21.15.130:0/2498781770 >> 172.21.15.130:0/2498781770 conn(0x7f483006f170 msgr2=0x7f483006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:49.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 -- 172.21.15.130:0/2498781770 shutdown_connections 2023-09-13T06:03:49.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 -- 172.21.15.130:0/2498781770 wait complete. 2023-09-13T06:03:49.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 Processor -- start 2023-09-13T06:03:49.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 -- start start 2023-09-13T06:03:49.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f481c003bb0 0x7f483013abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f483013f0f0 0x7f4830160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4830161040 0x7f483015e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4830141b60 con 0x7f4830161040 2023-09-13T06:03:49.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48301614f0 con 0x7f481c003bb0 2023-09-13T06:03:49.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4830140ee0 con 0x7f483013f0f0 2023-09-13T06:03:49.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4835a89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4830161040 0x7f483015e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4835a89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4830161040 0x7f483015e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36126/0 (socket says 172.21.15.130:36126) 2023-09-13T06:03:49.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4835a89640 1 -- 172.21.15.130:0/2371395053 learned_addr learned my addr 172.21.15.130:0/2371395053 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:49.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4835a89640 1 -- 172.21.15.130:0/2371395053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f483013f0f0 msgr2=0x7f4830160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4835a89640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f483013f0f0 0x7f4830160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4835a89640 1 -- 172.21.15.130:0/2371395053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f481c003bb0 msgr2=0x7f483013abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4835a89640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f481c003bb0 0x7f483013abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4835a89640 1 -- 172.21.15.130:0/2371395053 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48301411c0 con 0x7f4830161040 2023-09-13T06:03:49.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4835a89640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4830161040 0x7f483015e990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f481c004750 tx=0x7f482800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:49.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4825ffb640 1 -- 172.21.15.130:0/2371395053 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482800e040 con 0x7f4830161040 2023-09-13T06:03:49.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4825ffb640 1 -- 172.21.15.130:0/2371395053 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482800f040 con 0x7f4830161040 2023-09-13T06:03:49.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f4825ffb640 1 -- 172.21.15.130:0/2371395053 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828003de0 con 0x7f4830161040 2023-09-13T06:03:49.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.795+0000 7f48374ec640 1 -- 172.21.15.130:0/2371395053 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48301414a0 con 0x7f4830161040 2023-09-13T06:03:49.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.799+0000 7f48374ec640 1 -- 172.21.15.130:0/2371395053 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483013b130 con 0x7f4830161040 2023-09-13T06:03:49.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.799+0000 7f48374ec640 1 -- 172.21.15.130:0/2371395053 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48300618a0 con 0x7f4830161040 2023-09-13T06:03:49.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.799+0000 7f4825ffb640 1 -- 172.21.15.130:0/2371395053 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4828004030 con 0x7f4830161040 2023-09-13T06:03:49.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.799+0000 7f4825ffb640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4814065b50 0x7f4814068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:49.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.799+0000 7f4825ffb640 1 -- 172.21.15.130:0/2371395053 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4828083a00 con 0x7f4830161040 2023-09-13T06:03:49.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.799+0000 7f4835288640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4814065b50 0x7f4814068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:49.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.799+0000 7f4835288640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4814065b50 0x7f4814068010 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f482c0ad000 tx=0x7f482c0012e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:49.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.803+0000 7f4825ffb640 1 -- 172.21.15.130:0/2371395053 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f48280516e0 con 0x7f4830161040 2023-09-13T06:03:49.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.983+0000 7f48374ec640 1 -- 172.21.15.130:0/2371395053 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48300b86c0 con 0x7f4830161040 2023-09-13T06:03:49.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.983+0000 7f4825ffb640 1 -- 172.21.15.130:0/2371395053 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f4828023e90 con 0x7f4830161040 2023-09-13T06:03:49.988 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:49.988 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2126646405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2126646405},{"type":"v1","addr":"172.21.15.164:6835","nonce":2126646405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1274935773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1274935773},{"type":"v1","addr":"172.21.15.164:6834","nonce":1274935773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/4174632972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4174632972},{"type":"v1","addr":"172.21.15.130:6836","nonce":4174632972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5991,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/4101864227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":4101864227},{"type":"v1","addr":"172.21.15.130:6837","nonce":4101864227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[]} 2023-09-13T06:03:49.989 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 27 2023-09-13T06:03:49.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 -- 172.21.15.130:0/2371395053 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4814065b50 msgr2=0x7f4814068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4814065b50 0x7f4814068010 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f482c0ad000 tx=0x7f482c0012e0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 -- 172.21.15.130:0/2371395053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4830161040 msgr2=0x7f483015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:49.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4830161040 0x7f483015e990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f481c004750 tx=0x7f482800f640 comp rx=0 tx=0).stop 2023-09-13T06:03:49.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 -- 172.21.15.130:0/2371395053 shutdown_connections 2023-09-13T06:03:49.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4814065b50 0x7f4814068010 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4830161040 0x7f483015e990 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f483013f0f0 0x7f4830160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 --2- 172.21.15.130:0/2371395053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f481c003bb0 0x7f483013abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:49.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 -- 172.21.15.130:0/2371395053 >> 172.21.15.130:0/2371395053 conn(0x7f483006f170 msgr2=0x7f48301467c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:49.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 -- 172.21.15.130:0/2371395053 shutdown_connections 2023-09-13T06:03:49.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:49.987+0000 7f48374ec640 1 -- 172.21.15.130:0/2371395053 wait complete. 2023-09-13T06:03:50.009 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T06:03:50.009 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-13T06:03:50.010 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T06:03:50.010 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:03:50.010 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T06:03:50.010 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-13T06:03:50.011 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T06:03:50.011 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:03:50.011 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T06:03:50.011 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-13T06:03:50.012 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T06:03:50.012 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:03:50.012 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T06:03:50.013 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-13T06:03:50.013 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T06:03:50.014 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:03:50.022 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T06:03:50.022 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T06:03:50.024 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T06:03:50.024 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T06:03:50.026 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T06:03:50.026 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T06:03:50.028 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T06:03:50.028 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T06:03:50.068 INFO:tasks.ceph.mds.a:Started 2023-09-13T06:03:50.068 DEBUG:teuthology.parallel:result is None 2023-09-13T06:03:50.070 INFO:tasks.ceph.mds.c:Started 2023-09-13T06:03:50.071 DEBUG:teuthology.parallel:result is None 2023-09-13T06:03:50.080 INFO:tasks.ceph.mds.b:Started 2023-09-13T06:03:50.080 DEBUG:teuthology.parallel:result is None 2023-09-13T06:03:50.083 INFO:tasks.ceph.mds.d:Started 2023-09-13T06:03:50.083 DEBUG:teuthology.parallel:result is None 2023-09-13T06:03:50.084 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-13T06:03:50.155 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:03:50.158 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:03:50.172 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:03:50.175 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:03:50.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c5566a640 1 Processor -- start 2023-09-13T06:03:50.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c5566a640 1 -- start start 2023-09-13T06:03:50.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c5566a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8c500d2c40 0x7f8c500b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:50.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c5566a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c501439f0 con 0x7f8c500b4400 2023-09-13T06:03:50.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c5566a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c50142b00 con 0x7f8c500b8720 2023-09-13T06:03:50.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c5566a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c501407f0 con 0x7f8c500d2c40 2023-09-13T06:03:50.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c4f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f8c500b4400 0x7f8c500b4830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36584/0 (socket says 172.21.15.130:36584) 2023-09-13T06:03:50.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c4f7fe640 1 -- 172.21.15.130:0/609524330 learned_addr learned my addr 172.21.15.130:0/609524330 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:50.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c4effd640 1 --2- 172.21.15.130:0/609524330 >> v2:172.21.15.164:3300/0 conn(0x7f8c500d2c40 0x7f8c500b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:50.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c4e7fc640 1 -- 172.21.15.130:0/609524330 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987297616 0 0) 0x7f8c501439f0 con 0x7f8c500b4400 2023-09-13T06:03:50.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c4e7fc640 1 -- 172.21.15.130:0/609524330 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c3c003530 con 0x7f8c500b4400 2023-09-13T06:03:50.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c4effd640 1 -- 172.21.15.130:0/609524330 >> v1:172.21.15.164:6789/0 conn(0x7f8c500b8720 legacy=0x7f8c500b8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:50.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c4effd640 1 -- 172.21.15.130:0/609524330 >> v1:172.21.15.130:6789/0 conn(0x7f8c500b4400 legacy=0x7f8c500b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:50.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.227+0000 7f8c4effd640 1 -- 172.21.15.130:0/609524330 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c50142de0 con 0x7f8c500d2c40 2023-09-13T06:03:50.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.231+0000 7f8c4effd640 1 --2- 172.21.15.130:0/609524330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c500d2c40 0x7f8c500b6c30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c400097c0 tx=0x7f8c4001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20af853a43e9d597 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:50.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.231+0000 7f8c4e7fc640 1 -- 172.21.15.130:0/609524330 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400ac620 con 0x7f8c500d2c40 2023-09-13T06:03:50.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.231+0000 7f8c4e7fc640 1 -- 172.21.15.130:0/609524330 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c400ac780 con 0x7f8c500d2c40 2023-09-13T06:03:50.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.231+0000 7f8c4e7fc640 1 -- 172.21.15.130:0/609524330 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400acb10 con 0x7f8c500d2c40 2023-09-13T06:03:50.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.231+0000 7f8c5566a640 1 -- 172.21.15.130:0/609524330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c500d2c40 msgr2=0x7f8c500b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:50.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.231+0000 7f8c5566a640 1 --2- 172.21.15.130:0/609524330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c500d2c40 0x7f8c500b6c30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c400097c0 tx=0x7f8c4001c3c0 comp rx=0 tx=0).stop 2023-09-13T06:03:50.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.231+0000 7f8c5566a640 1 -- 172.21.15.130:0/609524330 shutdown_connections 2023-09-13T06:03:50.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.231+0000 7f8c5566a640 1 --2- 172.21.15.130:0/609524330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c500d2c40 0x7f8c500b6c30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:50.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.231+0000 7f8c5566a640 1 -- 172.21.15.130:0/609524330 >> 172.21.15.130:0/609524330 conn(0x7f8c500d3130 msgr2=0x7f8c500d3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:50.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.231+0000 7f8c5566a640 1 -- 172.21.15.130:0/609524330 shutdown_connections 2023-09-13T06:03:50.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.231+0000 7f8c5566a640 1 -- 172.21.15.130:0/609524330 wait complete. 2023-09-13T06:03:50.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c5566a640 1 Processor -- start 2023-09-13T06:03:50.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c5566a640 1 -- start start 2023-09-13T06:03:50.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c5566a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c500b4400 0x7f8c5013f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:50.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c5566a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c500b8720 0x7f8c50159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:50.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c5566a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c500d2c40 0x7f8c5015fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:50.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c5566a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5015a190 con 0x7f8c500b4400 2023-09-13T06:03:50.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c5566a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5015c500 con 0x7f8c500b8720 2023-09-13T06:03:50.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c5566a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5015ac40 con 0x7f8c500d2c40 2023-09-13T06:03:50.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c4effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c500b4400 0x7f8c5013f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:50.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c4effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c500b4400 0x7f8c5013f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36146/0 (socket says 172.21.15.130:36146) 2023-09-13T06:03:50.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c4effd640 1 -- 172.21.15.130:0/524310531 learned_addr learned my addr 172.21.15.130:0/524310531 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:50.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c4effd640 1 -- 172.21.15.130:0/524310531 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c500d2c40 msgr2=0x7f8c5015fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:50.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c4effd640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c500d2c40 0x7f8c5015fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:50.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c4effd640 1 -- 172.21.15.130:0/524310531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c500b8720 msgr2=0x7f8c50159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:50.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c47fff640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c500b8720 0x7f8c50159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:50.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c4effd640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c500b8720 0x7f8c50159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:50.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c4effd640 1 -- 172.21.15.130:0/524310531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c40009420 con 0x7f8c500b4400 2023-09-13T06:03:50.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c47fff640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c500b8720 0x7f8c50159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:50.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c4effd640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c500b4400 0x7f8c5013f8b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8c400af040 tx=0x7f8c40019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:50.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c477fe640 1 -- 172.21.15.130:0/524310531 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400b5410 con 0x7f8c500b4400 2023-09-13T06:03:50.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c477fe640 1 -- 172.21.15.130:0/524310531 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c400b5590 con 0x7f8c500b4400 2023-09-13T06:03:50.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c5566a640 1 -- 172.21.15.130:0/524310531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c50159c80 con 0x7f8c500b4400 2023-09-13T06:03:50.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c477fe640 1 -- 172.21.15.130:0/524310531 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400b5940 con 0x7f8c500b4400 2023-09-13T06:03:50.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.235+0000 7f8c5566a640 1 -- 172.21.15.130:0/524310531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5015b0d0 con 0x7f8c500b4400 2023-09-13T06:03:50.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.239+0000 7f8c5566a640 1 -- 172.21.15.130:0/524310531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c500618a0 con 0x7f8c500b4400 2023-09-13T06:03:50.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.239+0000 7f8c477fe640 1 -- 172.21.15.130:0/524310531 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8c400b3040 con 0x7f8c500b4400 2023-09-13T06:03:50.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.239+0000 7f8c477fe640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c30065b50 0x7f8c30068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:50.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.239+0000 7f8c477fe640 1 -- 172.21.15.130:0/524310531 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8c4011cfb0 con 0x7f8c500b4400 2023-09-13T06:03:50.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.239+0000 7f8c47fff640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c30065b50 0x7f8c30068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:50.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.239+0000 7f8c47fff640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c30065b50 0x7f8c30068010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8c50168510 tx=0x7f8c38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:50.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.243+0000 7f8c477fe640 1 -- 172.21.15.130:0/524310531 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8c400ead10 con 0x7f8c500b4400 2023-09-13T06:03:50.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.403+0000 7f8c5566a640 1 -- 172.21.15.130:0/524310531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8c500d3ce0 con 0x7f8c500b4400 2023-09-13T06:03:50.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c477fe640 1 -- 172.21.15.130:0/524310531 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8c400b1080 con 0x7f8c500b4400 2023-09-13T06:03:50.942 INFO:teuthology.orchestra.run.smithi130.stderr: removed all blocklist entries 2023-09-13T06:03:50.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 -- 172.21.15.130:0/524310531 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c30065b50 msgr2=0x7f8c30068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:50.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c30065b50 0x7f8c30068010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8c50168510 tx=0x7f8c38009040 comp rx=0 tx=0).stop 2023-09-13T06:03:50.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 -- 172.21.15.130:0/524310531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c500b4400 msgr2=0x7f8c5013f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:50.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c500b4400 0x7f8c5013f8b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8c400af040 tx=0x7f8c40019160 comp rx=0 tx=0).stop 2023-09-13T06:03:50.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 -- 172.21.15.130:0/524310531 shutdown_connections 2023-09-13T06:03:50.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c30065b50 0x7f8c30068010 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:50.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c500b8720 0x7f8c50159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:50.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c500d2c40 0x7f8c5015fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:50.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 --2- 172.21.15.130:0/524310531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c500b4400 0x7f8c5013f8b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:50.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 -- 172.21.15.130:0/524310531 >> 172.21.15.130:0/524310531 conn(0x7f8c500d3130 msgr2=0x7f8c50158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:50.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 -- 172.21.15.130:0/524310531 shutdown_connections 2023-09-13T06:03:50.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:50.939+0000 7f8c5566a640 1 -- 172.21.15.130:0/524310531 wait complete. 2023-09-13T06:03:50.966 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-13T06:03:51.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.099+0000 7f00f30d8640 1 Processor -- start 2023-09-13T06:03:51.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.099+0000 7f00f30d8640 1 -- start start 2023-09-13T06:03:51.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.099+0000 7f00f30d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f00ec1436e0 0x7f00ec0ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.099+0000 7f00f30d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec06f640 con 0x7f00ec0acd80 2023-09-13T06:03:51.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.099+0000 7f00f30d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec06f890 con 0x7f00ec070d60 2023-09-13T06:03:51.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.099+0000 7f00f30d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00ec06fb70 con 0x7f00ec1436e0 2023-09-13T06:03:51.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.099+0000 7f00ebfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f00ec0acd80 0x7f00ec070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:52640/0 (socket says 172.21.15.130:52640) 2023-09-13T06:03:51.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.099+0000 7f00ebfff640 1 -- 172.21.15.130:0/3007203167 learned_addr learned my addr 172.21.15.130:0/3007203167 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:51.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.099+0000 7f00f0e74640 1 --2- 172.21.15.130:0/3007203167 >> v2:172.21.15.130:3300/0 conn(0x7f00ec1436e0 0x7f00ec0ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.103+0000 7f00f0e74640 1 -- 172.21.15.130:0/3007203167 >> v1:172.21.15.164:6789/0 conn(0x7f00ec070d60 legacy=0x7f00ec160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:51.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.103+0000 7f00f0e74640 1 -- 172.21.15.130:0/3007203167 >> v1:172.21.15.130:6789/0 conn(0x7f00ec0acd80 legacy=0x7f00ec070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.103+0000 7f00f0e74640 1 -- 172.21.15.130:0/3007203167 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec06fe50 con 0x7f00ec1436e0 2023-09-13T06:03:51.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.103+0000 7f00f0e74640 1 --2- 172.21.15.130:0/3007203167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00ec1436e0 0x7f00ec0ac840 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f00e00097c0 tx=0x7f00e001c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319107ee0afbcaf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:51.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.103+0000 7f00eb7fe640 1 -- 172.21.15.130:0/3007203167 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec146e10 con 0x7f00ec1436e0 2023-09-13T06:03:51.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.103+0000 7f00eb7fe640 1 -- 172.21.15.130:0/3007203167 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e00a7050 con 0x7f00ec1436e0 2023-09-13T06:03:51.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.103+0000 7f00eb7fe640 1 -- 172.21.15.130:0/3007203167 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e00ab820 con 0x7f00ec1436e0 2023-09-13T06:03:51.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.107+0000 7f00f30d8640 1 -- 172.21.15.130:0/3007203167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00ec1436e0 msgr2=0x7f00ec0ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.107+0000 7f00f30d8640 1 --2- 172.21.15.130:0/3007203167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00ec1436e0 0x7f00ec0ac840 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f00e00097c0 tx=0x7f00e001c320 comp rx=0 tx=0).stop 2023-09-13T06:03:51.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.107+0000 7f00f30d8640 1 -- 172.21.15.130:0/3007203167 shutdown_connections 2023-09-13T06:03:51.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.107+0000 7f00f30d8640 1 --2- 172.21.15.130:0/3007203167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00ec1436e0 0x7f00ec0ac840 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.107+0000 7f00f30d8640 1 -- 172.21.15.130:0/3007203167 >> 172.21.15.130:0/3007203167 conn(0x7f00ec0b0bc0 msgr2=0x7f00ec0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:51.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.107+0000 7f00f30d8640 1 -- 172.21.15.130:0/3007203167 shutdown_connections 2023-09-13T06:03:51.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.107+0000 7f00f30d8640 1 -- 172.21.15.130:0/3007203167 wait complete. 2023-09-13T06:03:51.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.107+0000 7f00f30d8640 1 Processor -- start 2023-09-13T06:03:51.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.107+0000 7f00f30d8640 1 -- start start 2023-09-13T06:03:51.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00f30d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00ec070d60 0x7f00ec1627d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00f30d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00ec0acd80 0x7f00ec1633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00f30d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00ec1436e0 0x7f00ec1420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00f30d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec164ff0 con 0x7f00ec0acd80 2023-09-13T06:03:51.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00f30d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec15e980 con 0x7f00ec1436e0 2023-09-13T06:03:51.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00f30d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec1651d0 con 0x7f00ec070d60 2023-09-13T06:03:51.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00ebfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00ec0acd80 0x7f00ec1633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00ebfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00ec0acd80 0x7f00ec1633c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37130/0 (socket says 172.21.15.130:37130) 2023-09-13T06:03:51.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00ebfff640 1 -- 172.21.15.130:0/1349065557 learned_addr learned my addr 172.21.15.130:0/1349065557 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:51.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00f1675640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00ec1436e0 0x7f00ec1420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00f0e74640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00ec070d60 0x7f00ec1627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00ebfff640 1 -- 172.21.15.130:0/1349065557 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00ec070d60 msgr2=0x7f00ec1627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00ebfff640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00ec070d60 0x7f00ec1627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00ebfff640 1 -- 172.21.15.130:0/1349065557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00ec1436e0 msgr2=0x7f00ec1420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00ebfff640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00ec1436e0 0x7f00ec1420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00ebfff640 1 -- 172.21.15.130:0/1349065557 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e0009420 con 0x7f00ec0acd80 2023-09-13T06:03:51.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00ebfff640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00ec0acd80 0x7f00ec1633c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c4d0 tx=0x7f00d800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:51.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00e97fa640 1 -- 172.21.15.130:0/1349065557 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8005cf0 con 0x7f00ec0acd80 2023-09-13T06:03:51.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00e97fa640 1 -- 172.21.15.130:0/1349065557 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d8005e50 con 0x7f00ec0acd80 2023-09-13T06:03:51.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00f30d8640 1 -- 172.21.15.130:0/1349065557 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ec1654b0 con 0x7f00ec0acd80 2023-09-13T06:03:51.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00e97fa640 1 -- 172.21.15.130:0/1349065557 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8007270 con 0x7f00ec0acd80 2023-09-13T06:03:51.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00f30d8640 1 -- 172.21.15.130:0/1349065557 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ec162d10 con 0x7f00ec0acd80 2023-09-13T06:03:51.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.111+0000 7f00f30d8640 1 -- 172.21.15.130:0/1349065557 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ec15eac0 con 0x7f00ec0acd80 2023-09-13T06:03:51.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.115+0000 7f00e97fa640 1 -- 172.21.15.130:0/1349065557 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f00d80073d0 con 0x7f00ec0acd80 2023-09-13T06:03:51.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.115+0000 7f00e97fa640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f00d0065af0 0x7f00d0067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.115+0000 7f00e97fa640 1 -- 172.21.15.130:0/1349065557 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f00d8082450 con 0x7f00ec0acd80 2023-09-13T06:03:51.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.115+0000 7f00f0e74640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f00d0065af0 0x7f00d0067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.115+0000 7f00f0e74640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f00d0065af0 0x7f00d0067fb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f00e00ad000 tx=0x7f00e00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:51.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.119+0000 7f00e97fa640 1 -- 172.21.15.130:0/1349065557 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f00ec15eac0 con 0x7f00ec0acd80 2023-09-13T06:03:51.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.331+0000 7f00f30d8640 1 -- 172.21.15.130:0/1349065557 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f00ec15eac0 con 0x7f00ec0acd80 2023-09-13T06:03:51.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.331+0000 7f00e97fa640 1 -- 172.21.15.130:0/1349065557 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f00ec15eac0 con 0x7f00ec0acd80 2023-09-13T06:03:51.336 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:51.337 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:03:51.337 INFO:teuthology.orchestra.run.smithi130.stdout: "auth_dump": [ 2023-09-13T06:03:51.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.337 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.a", 2023-09-13T06:03:51.337 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw==", 2023-09-13T06:03:51.338 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.338 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:03:51.338 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:03:51.338 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:03:51.338 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.339 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.339 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.b", 2023-09-13T06:03:51.339 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg==", 2023-09-13T06:03:51.340 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.340 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:03:51.340 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:03:51.340 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:03:51.340 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.341 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.341 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.341 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.c", 2023-09-13T06:03:51.341 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A==", 2023-09-13T06:03:51.341 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.342 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:03:51.342 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:03:51.342 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:03:51.342 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.342 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.343 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.d", 2023-09-13T06:03:51.343 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg==", 2023-09-13T06:03:51.343 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.344 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:03:51.344 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:03:51.344 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:03:51.344 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.344 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.345 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.0", 2023-09-13T06:03:51.345 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw==", 2023-09-13T06:03:51.345 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.345 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:03:51.346 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:03:51.346 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.346 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.347 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.1", 2023-09-13T06:03:51.347 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ==", 2023-09-13T06:03:51.347 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.347 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:03:51.347 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:03:51.348 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.348 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.348 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.2", 2023-09-13T06:03:51.349 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw==", 2023-09-13T06:03:51.349 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.349 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:03:51.349 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:03:51.349 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.349 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.350 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.3", 2023-09-13T06:03:51.350 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g==", 2023-09-13T06:03:51.350 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.351 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:03:51.351 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:03:51.351 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.351 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.352 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.352 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.4", 2023-09-13T06:03:51.352 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ==", 2023-09-13T06:03:51.352 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.352 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:03:51.353 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:03:51.353 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.353 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.354 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.5", 2023-09-13T06:03:51.354 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw==", 2023-09-13T06:03:51.354 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.354 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:03:51.354 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:03:51.354 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.355 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.355 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.6", 2023-09-13T06:03:51.355 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA==", 2023-09-13T06:03:51.356 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.356 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:03:51.356 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:03:51.356 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.356 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.357 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.7", 2023-09-13T06:03:51.357 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA==", 2023-09-13T06:03:51.357 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.357 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:03:51.358 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:03:51.358 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.358 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.358 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.359 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.0", 2023-09-13T06:03:51.359 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA==", 2023-09-13T06:03:51.359 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.359 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:03:51.359 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow r", 2023-09-13T06:03:51.360 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-13T06:03:51.360 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.360 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.1", 2023-09-13T06:03:51.360 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg==", 2023-09-13T06:03:51.361 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.361 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:03:51.361 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:03:51.361 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:03:51.361 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:03:51.362 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.362 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.2", 2023-09-13T06:03:51.362 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw==", 2023-09-13T06:03:51.363 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.363 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:03:51.363 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:03:51.363 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:03:51.363 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:03:51.363 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.364 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.3", 2023-09-13T06:03:51.364 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA==", 2023-09-13T06:03:51.365 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.365 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:03:51.365 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:03:51.365 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:03:51.365 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:03:51.366 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.366 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.366 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.admin", 2023-09-13T06:03:51.366 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQANUAFl5ccJOBAAP4KJItnG8vNd5OP/63ai0g==", 2023-09-13T06:03:51.367 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.367 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:03:51.367 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:03:51.367 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:03:51.367 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.368 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.368 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.368 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.x", 2023-09-13T06:03:51.368 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ==", 2023-09-13T06:03:51.368 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.369 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:03:51.369 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:03:51.369 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.369 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.369 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:03:51.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:51.370 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.y", 2023-09-13T06:03:51.370 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA==", 2023-09-13T06:03:51.370 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:03:51.370 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:03:51.371 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:03:51.371 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:03:51.371 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.371 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:51.371 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:03:51.372 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:03:51.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 -- 172.21.15.130:0/1349065557 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f00d0065af0 msgr2=0x7f00d0067fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f00d0065af0 0x7f00d0067fb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f00e00ad000 tx=0x7f00e00a6000 comp rx=0 tx=0).stop 2023-09-13T06:03:51.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 -- 172.21.15.130:0/1349065557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00ec0acd80 msgr2=0x7f00ec1633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00ec0acd80 0x7f00ec1633c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c4d0 tx=0x7f00d800c990 comp rx=0 tx=0).stop 2023-09-13T06:03:51.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 -- 172.21.15.130:0/1349065557 shutdown_connections 2023-09-13T06:03:51.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f00d0065af0 0x7f00d0067fb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00ec1436e0 0x7f00ec1420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00ec0acd80 0x7f00ec1633c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 --2- 172.21.15.130:0/1349065557 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00ec070d60 0x7f00ec1627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 -- 172.21.15.130:0/1349065557 >> 172.21.15.130:0/1349065557 conn(0x7f00ec0b0bc0 msgr2=0x7f00ec13af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:51.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 -- 172.21.15.130:0/1349065557 shutdown_connections 2023-09-13T06:03:51.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.335+0000 7f00f30d8640 1 -- 172.21.15.130:0/1349065557 wait complete. 2023-09-13T06:03:51.376 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:03:51.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.507+0000 7f5288ffa640 1 Processor -- start 2023-09-13T06:03:51.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.507+0000 7f5288ffa640 1 -- start start 2023-09-13T06:03:51.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f5288ffa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5284159f20 0x7f52840ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f5288ffa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f52840cdfc0 0x7f52840b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f5288ffa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52840b1610 0x7f52840b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f5288ffa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52840b00f0 con 0x7f5284159f20 2023-09-13T06:03:51.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f5288ffa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52840b11d0 con 0x7f52840cdfc0 2023-09-13T06:03:51.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f5288ffa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52840b1fc0 con 0x7f52840b1610 2023-09-13T06:03:51.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f528259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5284159f20 0x7f52840ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f528259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5284159f20 0x7f52840ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37146/0 (socket says 172.21.15.130:37146) 2023-09-13T06:03:51.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f528259c640 1 -- 172.21.15.130:0/2652758057 learned_addr learned my addr 172.21.15.130:0/2652758057 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:51.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f5279d9b640 1 --2- 172.21.15.130:0/2652758057 >> v2:172.21.15.164:3300/0 conn(0x7f52840cdfc0 0x7f52840b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f5282d9d640 1 --2- 172.21.15.130:0/2652758057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52840b1610 0x7f52840b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f528259c640 1 -- 172.21.15.130:0/2652758057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52840b1610 msgr2=0x7f52840b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:51.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f528259c640 1 --2- 172.21.15.130:0/2652758057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52840b1610 0x7f52840b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f528259c640 1 -- 172.21.15.130:0/2652758057 >> v2:172.21.15.164:3300/0 conn(0x7f52840cdfc0 msgr2=0x7f52840b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:51.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f528259c640 1 --2- 172.21.15.130:0/2652758057 >> v2:172.21.15.164:3300/0 conn(0x7f52840cdfc0 0x7f52840b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f528259c640 1 -- 172.21.15.130:0/2652758057 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52840ccfd0 con 0x7f5284159f20 2023-09-13T06:03:51.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.511+0000 7f5279d9b640 1 --2- 172.21.15.130:0/2652758057 >> v2:172.21.15.164:3300/0 conn(0x7f52840cdfc0 0x7f52840b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:51.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f528259c640 1 --2- 172.21.15.130:0/2652758057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5284159f20 0x7f52840ce7b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f52840ccb10 tx=0x7f527401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dcf1e92ba8c31a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:51.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5281d9b640 1 -- 172.21.15.130:0/2652758057 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740ac630 con 0x7f5284159f20 2023-09-13T06:03:51.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5281d9b640 1 -- 172.21.15.130:0/2652758057 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740ac790 con 0x7f5284159f20 2023-09-13T06:03:51.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5281d9b640 1 -- 172.21.15.130:0/2652758057 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740acb20 con 0x7f5284159f20 2023-09-13T06:03:51.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5288ffa640 1 -- 172.21.15.130:0/2652758057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5284159f20 msgr2=0x7f52840ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5288ffa640 1 --2- 172.21.15.130:0/2652758057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5284159f20 0x7f52840ce7b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f52840ccb10 tx=0x7f527401c500 comp rx=0 tx=0).stop 2023-09-13T06:03:51.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5288ffa640 1 -- 172.21.15.130:0/2652758057 shutdown_connections 2023-09-13T06:03:51.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5288ffa640 1 --2- 172.21.15.130:0/2652758057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52840b1610 0x7f52840b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5288ffa640 1 --2- 172.21.15.130:0/2652758057 >> v2:172.21.15.164:3300/0 conn(0x7f52840cdfc0 0x7f52840b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5288ffa640 1 --2- 172.21.15.130:0/2652758057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5284159f20 0x7f52840ce7b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5288ffa640 1 -- 172.21.15.130:0/2652758057 >> 172.21.15.130:0/2652758057 conn(0x7f5284065990 msgr2=0x7f5284065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:51.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5288ffa640 1 -- 172.21.15.130:0/2652758057 shutdown_connections 2023-09-13T06:03:51.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5288ffa640 1 -- 172.21.15.130:0/2652758057 wait complete. 2023-09-13T06:03:51.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.515+0000 7f5288ffa640 1 Processor -- start 2023-09-13T06:03:51.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5288ffa640 1 -- start start 2023-09-13T06:03:51.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5288ffa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52840b1610 0x7f528414bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5288ffa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52840cdfc0 0x7f528414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5288ffa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5284159f20 0x7f5284154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5288ffa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528414d080 con 0x7f52840cdfc0 2023-09-13T06:03:51.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5288ffa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5284150d20 con 0x7f5284159f20 2023-09-13T06:03:51.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5288ffa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5284151000 con 0x7f52840b1610 2023-09-13T06:03:51.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5279d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52840cdfc0 0x7f528414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5279d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52840cdfc0 0x7f528414ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37156/0 (socket says 172.21.15.130:37156) 2023-09-13T06:03:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5279d9b640 1 -- 172.21.15.130:0/2358236308 learned_addr learned my addr 172.21.15.130:0/2358236308 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f528259c640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52840b1610 0x7f528414bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5282d9d640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5284159f20 0x7f5284154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5279d9b640 1 -- 172.21.15.130:0/2358236308 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52840b1610 msgr2=0x7f528414bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5279d9b640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52840b1610 0x7f528414bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5279d9b640 1 -- 172.21.15.130:0/2358236308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5284159f20 msgr2=0x7f5284154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5279d9b640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5284159f20 0x7f5284154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5279d9b640 1 -- 172.21.15.130:0/2358236308 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52740094d0 con 0x7f52840cdfc0 2023-09-13T06:03:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5279d9b640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52840cdfc0 0x7f528414ffb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f526c00e810 tx=0x7f526c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f527b7fe640 1 -- 172.21.15.130:0/2358236308 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c00c8d0 con 0x7f52840cdfc0 2023-09-13T06:03:51.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f527b7fe640 1 -- 172.21.15.130:0/2358236308 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c00ca30 con 0x7f52840cdfc0 2023-09-13T06:03:51.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5288ffa640 1 -- 172.21.15.130:0/2358236308 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528414ca30 con 0x7f52840cdfc0 2023-09-13T06:03:51.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f527b7fe640 1 -- 172.21.15.130:0/2358236308 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c00cde0 con 0x7f52840cdfc0 2023-09-13T06:03:51.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5288ffa640 1 -- 172.21.15.130:0/2358236308 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5284150940 con 0x7f52840cdfc0 2023-09-13T06:03:51.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.519+0000 7f5288ffa640 1 -- 172.21.15.130:0/2358236308 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528414d1f0 con 0x7f52840cdfc0 2023-09-13T06:03:51.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.523+0000 7f527b7fe640 1 -- 172.21.15.130:0/2358236308 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f526c013410 con 0x7f52840cdfc0 2023-09-13T06:03:51.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.523+0000 7f527b7fe640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5264065b20 0x7f5264067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.523+0000 7f527b7fe640 1 -- 172.21.15.130:0/2358236308 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f526c082c20 con 0x7f52840cdfc0 2023-09-13T06:03:51.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.523+0000 7f528259c640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5264065b20 0x7f5264067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.523+0000 7f528259c640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5264065b20 0x7f5264067fe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f52740ae000 tx=0x7f5274008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:51.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.527+0000 7f527b7fe640 1 -- 172.21.15.130:0/2358236308 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f526c050970 con 0x7f52840cdfc0 2023-09-13T06:03:51.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 -- 172.21.15.130:0/2358236308 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52840618a0 con 0x7f52840cdfc0 2023-09-13T06:03:51.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f527b7fe640 1 -- 172.21.15.130:0/2358236308 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+12893 (secure 0 0 0) 0x7f526c053f90 con 0x7f52840cdfc0 2023-09-13T06:03:51.683 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:51.684 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":61,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:03:50.948644+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:03:51.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 -- 172.21.15.130:0/2358236308 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5264065b20 msgr2=0x7f5264067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5264065b20 0x7f5264067fe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f52740ae000 tx=0x7f5274008040 comp rx=0 tx=0).stop 2023-09-13T06:03:51.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 -- 172.21.15.130:0/2358236308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52840cdfc0 msgr2=0x7f528414ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52840cdfc0 0x7f528414ffb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f526c00e810 tx=0x7f526c00ecd0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 -- 172.21.15.130:0/2358236308 shutdown_connections 2023-09-13T06:03:51.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5264065b20 0x7f5264067fe0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5284159f20 0x7f5284154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52840cdfc0 0x7f528414ffb0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 --2- 172.21.15.130:0/2358236308 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52840b1610 0x7f528414bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 -- 172.21.15.130:0/2358236308 >> 172.21.15.130:0/2358236308 conn(0x7f5284065990 msgr2=0x7f52840ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:51.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 -- 172.21.15.130:0/2358236308 shutdown_connections 2023-09-13T06:03:51.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.679+0000 7f5288ffa640 1 -- 172.21.15.130:0/2358236308 wait complete. 2023-09-13T06:03:51.704 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:03:51.705 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:03:51.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b34ec640 1 Processor -- start 2023-09-13T06:03:51.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b34ec640 1 -- start start 2023-09-13T06:03:51.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b34ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13ac0cca50 0x7f13ac0ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b34ec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f13ac0ce6c0 0x7f13ac161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b34ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac0b2620 con 0x7f13ac1617f0 2023-09-13T06:03:51.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b34ec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ac0b1a80 con 0x7f13ac0ce6c0 2023-09-13T06:03:51.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b34ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0b2ab0 con 0x7f13ac0cca50 2023-09-13T06:03:51.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b1288640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f13ac1617f0 0x7f13ac0cc340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:52656/0 (socket says 172.21.15.130:52656) 2023-09-13T06:03:51.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b1288640 1 -- 172.21.15.130:0/2479929491 learned_addr learned my addr 172.21.15.130:0/2479929491 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:51.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146628355 0 0) 0x7f13ac0b2620 con 0x7f13ac1617f0 2023-09-13T06:03:51.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b1a89640 1 --2- 172.21.15.130:0/2479929491 >> v2:172.21.15.164:3300/0 conn(0x7f13ac0ce6c0 0x7f13ac161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1398003530 con 0x7f13ac1617f0 2023-09-13T06:03:51.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b0a87640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13ac0cca50 0x7f13ac0ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1630564656 0 0) 0x7f1398003530 con 0x7f13ac1617f0 2023-09-13T06:03:51.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13ac0cca50 msgr2=0x7f13ac0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:51.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13ac0cca50 0x7f13ac0ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 >> v2:172.21.15.164:3300/0 conn(0x7f13ac0ce6c0 msgr2=0x7f13ac161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:51.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 --2- 172.21.15.130:0/2479929491 >> v2:172.21.15.164:3300/0 conn(0x7f13ac0ce6c0 0x7f13ac161bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac0b1cf0 con 0x7f13ac1617f0 2023-09-13T06:03:51.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f13a8001680 con 0x7f13ac1617f0 2023-09-13T06:03:51.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 >> v1:172.21.15.130:6789/0 conn(0x7f13ac1617f0 legacy=0x7f13ac0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13ac0cca50 0x7f13980039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1398003fc0 0x7f13980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1398004d10 0x7f1398005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0b1a80 con 0x7f1398003fc0 2023-09-13T06:03:51.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0b2ab0 con 0x7f1398004d10 2023-09-13T06:03:51.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139800ba10 con 0x7f13ac0cca50 2023-09-13T06:03:51.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b0a87640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1398003fc0 0x7f13980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b1288640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13ac0cca50 0x7f13980039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b1a89640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1398004d10 0x7f1398005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b0a87640 1 -- 172.21.15.130:0/2479929491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13ac0cca50 msgr2=0x7f13980039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:51.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b0a87640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13ac0cca50 0x7f13980039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b0a87640 1 -- 172.21.15.130:0/2479929491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1398004d10 msgr2=0x7f1398005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:51.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b0a87640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1398004d10 0x7f1398005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.843+0000 7f13b0a87640 1 -- 172.21.15.130:0/2479929491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398003530 con 0x7f1398003fc0 2023-09-13T06:03:51.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.847+0000 7f13b0a87640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1398003fc0 0x7f13980047d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f139c009ae0 tx=0x7f139c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9613e99112491c66 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:51.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.847+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0a5640 con 0x7f1398003fc0 2023-09-13T06:03:51.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.847+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c0a57a0 con 0x7f1398003fc0 2023-09-13T06:03:51.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.847+0000 7f13a3fff640 1 -- 172.21.15.130:0/2479929491 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0a5b50 con 0x7f1398003fc0 2023-09-13T06:03:51.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.847+0000 7f13b34ec640 1 -- 172.21.15.130:0/2479929491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1398003fc0 msgr2=0x7f13980047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.847+0000 7f13b34ec640 1 --2- 172.21.15.130:0/2479929491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1398003fc0 0x7f13980047d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f139c009ae0 tx=0x7f139c01ca50 comp rx=0 tx=0).stop 2023-09-13T06:03:51.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.847+0000 7f13b1a89640 1 -- 172.21.15.130:0/2479929491 reap_dead start 2023-09-13T06:03:51.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.847+0000 7f13b34ec640 1 -- 172.21.15.130:0/2479929491 shutdown_connections 2023-09-13T06:03:51.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.847+0000 7f13b34ec640 1 -- 172.21.15.130:0/2479929491 >> 172.21.15.130:0/2479929491 conn(0x7f13ac065990 msgr2=0x7f13ac065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:51.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.847+0000 7f13b34ec640 1 -- 172.21.15.130:0/2479929491 shutdown_connections 2023-09-13T06:03:51.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.847+0000 7f13b34ec640 1 -- 172.21.15.130:0/2479929491 wait complete. 2023-09-13T06:03:51.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b34ec640 1 Processor -- start 2023-09-13T06:03:51.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b34ec640 1 -- start start 2023-09-13T06:03:51.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b34ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1398003fc0 0x7f13ac14f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b34ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13ac15b960 0x7f13ac15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b34ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13ac06d320 0x7f13ac06d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b34ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac06dce0 con 0x7f13ac06d320 2023-09-13T06:03:51.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b34ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0a9800 con 0x7f13ac15b960 2023-09-13T06:03:51.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b34ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0a8760 con 0x7f1398003fc0 2023-09-13T06:03:51.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b1a89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13ac06d320 0x7f13ac06d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b1a89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13ac06d320 0x7f13ac06d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37172/0 (socket says 172.21.15.130:37172) 2023-09-13T06:03:51.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b1a89640 1 -- 172.21.15.130:0/1624273344 learned_addr learned my addr 172.21.15.130:0/1624273344 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:51.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b0a87640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13ac15b960 0x7f13ac15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b1288640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1398003fc0 0x7f13ac14f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b1a89640 1 -- 172.21.15.130:0/1624273344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1398003fc0 msgr2=0x7f13ac14f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b1a89640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1398003fc0 0x7f13ac14f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b1a89640 1 -- 172.21.15.130:0/1624273344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13ac15b960 msgr2=0x7f13ac15bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:51.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b1a89640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13ac15b960 0x7f13ac15bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:51.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b1a89640 1 -- 172.21.15.130:0/1624273344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac0a8a40 con 0x7f13ac06d320 2023-09-13T06:03:51.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b0a87640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13ac15b960 0x7f13ac15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:51.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b1a89640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13ac06d320 0x7f13ac06d7a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0b35e0 tx=0x7f13a40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:51.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13a1ffb640 1 -- 172.21.15.130:0/1624273344 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a400e070 con 0x7f13ac06d320 2023-09-13T06:03:51.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13a1ffb640 1 -- 172.21.15.130:0/1624273344 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4011e10 con 0x7f13ac06d320 2023-09-13T06:03:51.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13a1ffb640 1 -- 172.21.15.130:0/1624273344 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40039a0 con 0x7f13ac06d320 2023-09-13T06:03:51.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b34ec640 1 -- 172.21.15.130:0/1624273344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ac0a8d20 con 0x7f13ac06d320 2023-09-13T06:03:51.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.851+0000 7f13b34ec640 1 -- 172.21.15.130:0/1624273344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac0a92e0 con 0x7f13ac06d320 2023-09-13T06:03:51.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.855+0000 7f13b34ec640 1 -- 172.21.15.130:0/1624273344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ac0618a0 con 0x7f13ac06d320 2023-09-13T06:03:51.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.855+0000 7f13a1ffb640 1 -- 172.21.15.130:0/1624273344 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f13a4003b00 con 0x7f13ac06d320 2023-09-13T06:03:51.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.855+0000 7f13a1ffb640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1390065b20 0x7f1390067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:51.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.855+0000 7f13a1ffb640 1 -- 172.21.15.130:0/1624273344 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f13a40837f0 con 0x7f13ac06d320 2023-09-13T06:03:51.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.855+0000 7f13b1288640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1390065b20 0x7f1390067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:51.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.855+0000 7f13b1288640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1390065b20 0x7f1390067fe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f13a80078f0 tx=0x7f13a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:51.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:51.859+0000 7f13a1ffb640 1 -- 172.21.15.130:0/1624273344 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f13a4051360 con 0x7f13ac06d320 2023-09-13T06:03:52.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.011+0000 7f13b34ec640 1 -- 172.21.15.130:0/1624273344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13ac0ae4c0 con 0x7f13ac06d320 2023-09-13T06:03:52.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.011+0000 7f13a1ffb640 1 -- 172.21.15.130:0/1624273344 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13a4054980 con 0x7f13ac06d320 2023-09-13T06:03:52.018 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:03:52.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 -- 172.21.15.130:0/1624273344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1390065b20 msgr2=0x7f1390067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1390065b20 0x7f1390067fe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f13a80078f0 tx=0x7f13a8009040 comp rx=0 tx=0).stop 2023-09-13T06:03:52.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 -- 172.21.15.130:0/1624273344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13ac06d320 msgr2=0x7f13ac06d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13ac06d320 0x7f13ac06d7a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0b35e0 tx=0x7f13a40115a0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 -- 172.21.15.130:0/1624273344 shutdown_connections 2023-09-13T06:03:52.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1390065b20 0x7f1390067fe0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13ac15b960 0x7f13ac15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13ac06d320 0x7f13ac06d7a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 --2- 172.21.15.130:0/1624273344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1398003fc0 0x7f13ac14f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 -- 172.21.15.130:0/1624273344 >> 172.21.15.130:0/1624273344 conn(0x7f13ac065990 msgr2=0x7f13ac0ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:52.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 -- 172.21.15.130:0/1624273344 shutdown_connections 2023-09-13T06:03:52.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.015+0000 7f13b34ec640 1 -- 172.21.15.130:0/1624273344 wait complete. 2023-09-13T06:03:52.038 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T06:03:52.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.171+0000 7f9cb8893640 1 Processor -- start 2023-09-13T06:03:52.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.171+0000 7f9cb8893640 1 -- start start 2023-09-13T06:03:52.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb8893640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9cb4157ee0 0x7f9cb415b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb8893640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9cb40cae70 0x7f9cb415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb8893640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb415a8c0 con 0x7f9cb40b1580 2023-09-13T06:03:52.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb8893640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb415ecf0 con 0x7f9cb4157ee0 2023-09-13T06:03:52.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb8893640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb40cb3d0 con 0x7f9cb40cae70 2023-09-13T06:03:52.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9cb4157ee0 0x7f9cb415b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb2d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9cb40b1580 0x7f9cb406cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:52662/0 (socket says 172.21.15.130:52662) 2023-09-13T06:03:52.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb2d9d640 1 -- 172.21.15.130:0/4282779855 learned_addr learned my addr 172.21.15.130:0/4282779855 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:52.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cabfff640 1 --2- 172.21.15.130:0/4282779855 >> v2:172.21.15.164:3300/0 conn(0x7f9cb40cae70 0x7f9cb415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb259c640 1 -- 172.21.15.130:0/4282779855 >> v2:172.21.15.164:3300/0 conn(0x7f9cb40cae70 msgr2=0x7f9cb415e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:52.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb259c640 1 --2- 172.21.15.130:0/4282779855 >> v2:172.21.15.164:3300/0 conn(0x7f9cb40cae70 0x7f9cb415e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb259c640 1 -- 172.21.15.130:0/4282779855 >> v1:172.21.15.130:6789/0 conn(0x7f9cb40b1580 legacy=0x7f9cb406cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb259c640 1 -- 172.21.15.130:0/4282779855 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb415ab30 con 0x7f9cb4157ee0 2023-09-13T06:03:52.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.175+0000 7f9cb1d9b640 1 -- 172.21.15.130:0/4282779855 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496781181 0 0) 0x7f9cb415a8c0 con 0x7f9cb40b1580 2023-09-13T06:03:52.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb259c640 1 --2- 172.21.15.130:0/4282779855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb4157ee0 0x7f9cb415b330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40c9020 tx=0x7f9ca401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a90c6466355758 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:52.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb1d9b640 1 -- 172.21.15.130:0/4282779855 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40ab600 con 0x7f9cb4157ee0 2023-09-13T06:03:52.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb1d9b640 1 -- 172.21.15.130:0/4282779855 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca40a7050 con 0x7f9cb4157ee0 2023-09-13T06:03:52.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb1d9b640 1 -- 172.21.15.130:0/4282779855 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40ab980 con 0x7f9cb4157ee0 2023-09-13T06:03:52.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb8893640 1 -- 172.21.15.130:0/4282779855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb4157ee0 msgr2=0x7f9cb415b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb8893640 1 --2- 172.21.15.130:0/4282779855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb4157ee0 0x7f9cb415b330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40c9020 tx=0x7f9ca401c460 comp rx=0 tx=0).stop 2023-09-13T06:03:52.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb8893640 1 -- 172.21.15.130:0/4282779855 shutdown_connections 2023-09-13T06:03:52.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb8893640 1 --2- 172.21.15.130:0/4282779855 >> v2:172.21.15.164:3300/0 conn(0x7f9cb40cae70 0x7f9cb415e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb8893640 1 --2- 172.21.15.130:0/4282779855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb4157ee0 0x7f9cb415b330 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb8893640 1 -- 172.21.15.130:0/4282779855 >> 172.21.15.130:0/4282779855 conn(0x7f9cb4065ff0 msgr2=0x7f9cb40b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:52.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb8893640 1 -- 172.21.15.130:0/4282779855 shutdown_connections 2023-09-13T06:03:52.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb8893640 1 -- 172.21.15.130:0/4282779855 wait complete. 2023-09-13T06:03:52.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb8893640 1 Processor -- start 2023-09-13T06:03:52.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.179+0000 7f9cb8893640 1 -- start start 2023-09-13T06:03:52.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cb8893640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cb40b1580 0x7f9cb414c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cb8893640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb40cae70 0x7f9cb414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cb8893640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cb4157ee0 0x7f9cb41433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cb8893640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb41438e0 con 0x7f9cb40cae70 2023-09-13T06:03:52.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cb8893640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb4143d70 con 0x7f9cb40b1580 2023-09-13T06:03:52.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cb8893640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb414cda0 con 0x7f9cb4157ee0 2023-09-13T06:03:52.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cabfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb40cae70 0x7f9cb414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cabfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb40cae70 0x7f9cb414de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37190/0 (socket says 172.21.15.130:37190) 2023-09-13T06:03:52.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cabfff640 1 -- 172.21.15.130:0/197819248 learned_addr learned my addr 172.21.15.130:0/197819248 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:52.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cb259c640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cb40b1580 0x7f9cb414c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cb2d9d640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cb4157ee0 0x7f9cb41433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cabfff640 1 -- 172.21.15.130:0/197819248 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cb4157ee0 msgr2=0x7f9cb41433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cabfff640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cb4157ee0 0x7f9cb41433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cabfff640 1 -- 172.21.15.130:0/197819248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cb40b1580 msgr2=0x7f9cb414c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cabfff640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cb40b1580 0x7f9cb414c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cabfff640 1 -- 172.21.15.130:0/197819248 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009420 con 0x7f9cb40cae70 2023-09-13T06:03:52.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cabfff640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb40cae70 0x7f9cb414de40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00e900 tx=0x7f9c9c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:52.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9caaffd640 1 -- 172.21.15.130:0/197819248 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c009690 con 0x7f9cb40cae70 2023-09-13T06:03:52.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9caaffd640 1 -- 172.21.15.130:0/197819248 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c00ca00 con 0x7f9cb40cae70 2023-09-13T06:03:52.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9caaffd640 1 -- 172.21.15.130:0/197819248 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c00cd90 con 0x7f9cb40cae70 2023-09-13T06:03:52.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cb8893640 1 -- 172.21.15.130:0/197819248 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb414d080 con 0x7f9cb40cae70 2023-09-13T06:03:52.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cb8893640 1 -- 172.21.15.130:0/197819248 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb414d640 con 0x7f9cb40cae70 2023-09-13T06:03:52.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9cb8893640 1 -- 172.21.15.130:0/197819248 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb40618a0 con 0x7f9cb40cae70 2023-09-13T06:03:52.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.183+0000 7f9caaffd640 1 -- 172.21.15.130:0/197819248 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9c9c013470 con 0x7f9cb40cae70 2023-09-13T06:03:52.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.187+0000 7f9caaffd640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c94065b20 0x7f9c94067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.187+0000 7f9caaffd640 1 -- 172.21.15.130:0/197819248 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c9c0831d0 con 0x7f9cb40cae70 2023-09-13T06:03:52.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.187+0000 7f9cb259c640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c94065b20 0x7f9c94067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.187+0000 7f9cb259c640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c94065b20 0x7f9c94067fe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40ad000 tx=0x7f9ca40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:52.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.191+0000 7f9caaffd640 1 -- 172.21.15.130:0/197819248 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9c9c050e60 con 0x7f9cb40cae70 2023-09-13T06:03:52.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.339+0000 7f9cb8893640 1 -- 172.21.15.130:0/197819248 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9cb40c8e30 con 0x7f9cb40cae70 2023-09-13T06:03:52.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.339+0000 7f9caaffd640 1 -- 172.21.15.130:0/197819248 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9c9c054480 con 0x7f9cb40cae70 2023-09-13T06:03:52.345 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:52.346 INFO:teuthology.orchestra.run.smithi130.stdout:[ 2023-09-13T06:03:52.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:03:52.346 INFO:teuthology.orchestra.run.smithi130.stdout: "poolnum": 1, 2023-09-13T06:03:52.346 INFO:teuthology.orchestra.run.smithi130.stdout: "poolname": ".mgr" 2023-09-13T06:03:52.346 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:03:52.347 INFO:teuthology.orchestra.run.smithi130.stdout:] 2023-09-13T06:03:52.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 -- 172.21.15.130:0/197819248 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c94065b20 msgr2=0x7f9c94067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c94065b20 0x7f9c94067fe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40ad000 tx=0x7f9ca40a6000 comp rx=0 tx=0).stop 2023-09-13T06:03:52.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 -- 172.21.15.130:0/197819248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb40cae70 msgr2=0x7f9cb414de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb40cae70 0x7f9cb414de40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00e900 tx=0x7f9c9c00edc0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 -- 172.21.15.130:0/197819248 shutdown_connections 2023-09-13T06:03:52.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c94065b20 0x7f9c94067fe0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cb4157ee0 0x7f9cb41433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cb40cae70 0x7f9cb414de40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 --2- 172.21.15.130:0/197819248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cb40b1580 0x7f9cb414c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 -- 172.21.15.130:0/197819248 >> 172.21.15.130:0/197819248 conn(0x7f9cb4065ff0 msgr2=0x7f9cb406f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:52.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 -- 172.21.15.130:0/197819248 shutdown_connections 2023-09-13T06:03:52.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.343+0000 7f9cb8893640 1 -- 172.21.15.130:0/197819248 wait complete. 2023-09-13T06:03:52.366 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T06:03:52.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T06:03:52.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d38648640 1 Processor -- start 2023-09-13T06:03:52.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d38648640 1 -- start start 2023-09-13T06:03:52.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d38648640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d300ccc10 0x7f0d3015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d38648640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0d300b3170 0x7f0d300b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d38648640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d300ccff0 con 0x7f0d300b1ff0 2023-09-13T06:03:52.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d38648640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3015b590 con 0x7f0d300b3170 2023-09-13T06:03:52.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d38648640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300b12f0 con 0x7f0d300ccc10 2023-09-13T06:03:52.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d35be3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0d300b3170 0x7f0d300b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d36be5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0d300b1ff0 0x7f0d300cb710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:52672/0 (socket says 172.21.15.130:52672) 2023-09-13T06:03:52.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d36be5640 1 -- 172.21.15.130:0/3379642076 learned_addr learned my addr 172.21.15.130:0/3379642076 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:52.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d363e4640 1 --2- 172.21.15.130:0/3379642076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d300ccc10 0x7f0d3015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d35be3640 1 -- 172.21.15.130:0/3379642076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d300ccc10 msgr2=0x7f0d3015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:52.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d35be3640 1 --2- 172.21.15.130:0/3379642076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d300ccc10 0x7f0d3015dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d35be3640 1 -- 172.21.15.130:0/3379642076 >> v1:172.21.15.130:6789/0 conn(0x7f0d300b1ff0 legacy=0x7f0d300cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d35be3640 1 -- 172.21.15.130:0/3379642076 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3015e520 con 0x7f0d300b3170 2023-09-13T06:03:52.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d353e2640 1 -- 172.21.15.130:0/3379642076 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313310247 0 0) 0x7f0d300ccff0 con 0x7f0d300b1ff0 2023-09-13T06:03:52.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d35be3640 1 --2- 172.21.15.130:0/3379642076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d300b3170 0x7f0d300b1ab0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0d200097c0 tx=0x7f0d2001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c73e64e285c3409 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:52.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.507+0000 7f0d353e2640 1 -- 172.21.15.130:0/3379642076 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200ab650 con 0x7f0d300b3170 2023-09-13T06:03:52.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d353e2640 1 -- 172.21.15.130:0/3379642076 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d200ab7b0 con 0x7f0d300b3170 2023-09-13T06:03:52.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d353e2640 1 -- 172.21.15.130:0/3379642076 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200abb40 con 0x7f0d300b3170 2023-09-13T06:03:52.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 -- 172.21.15.130:0/3379642076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d300b3170 msgr2=0x7f0d300b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 --2- 172.21.15.130:0/3379642076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d300b3170 0x7f0d300b1ab0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0d200097c0 tx=0x7f0d2001c450 comp rx=0 tx=0).stop 2023-09-13T06:03:52.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 -- 172.21.15.130:0/3379642076 shutdown_connections 2023-09-13T06:03:52.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 --2- 172.21.15.130:0/3379642076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d300b3170 0x7f0d300b1ab0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 --2- 172.21.15.130:0/3379642076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d300ccc10 0x7f0d3015dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 -- 172.21.15.130:0/3379642076 >> 172.21.15.130:0/3379642076 conn(0x7f0d300735e0 msgr2=0x7f0d30065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:52.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 -- 172.21.15.130:0/3379642076 shutdown_connections 2023-09-13T06:03:52.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 -- 172.21.15.130:0/3379642076 wait complete. 2023-09-13T06:03:52.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 Processor -- start 2023-09-13T06:03:52.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 -- start start 2023-09-13T06:03:52.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d300b1ff0 0x7f0d3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d300b3170 0x7f0d301f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d300ccc10 0x7f0d301f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3014d3f0 con 0x7f0d300ccc10 2023-09-13T06:03:52.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3014bfa0 con 0x7f0d300b1ff0 2023-09-13T06:03:52.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.511+0000 7f0d38648640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3014b390 con 0x7f0d300b3170 2023-09-13T06:03:52.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d36be5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d300ccc10 0x7f0d301f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d36be5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d300ccc10 0x7f0d301f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37208/0 (socket says 172.21.15.130:37208) 2023-09-13T06:03:52.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d36be5640 1 -- 172.21.15.130:0/442894967 learned_addr learned my addr 172.21.15.130:0/442894967 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:52.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d363e4640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d300b1ff0 0x7f0d3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d35be3640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d300b3170 0x7f0d301f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d36be5640 1 -- 172.21.15.130:0/442894967 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d300b3170 msgr2=0x7f0d301f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d36be5640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d300b3170 0x7f0d301f85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d36be5640 1 -- 172.21.15.130:0/442894967 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d300b1ff0 msgr2=0x7f0d3006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:52.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d36be5640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d300b1ff0 0x7f0d3006c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:52.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d36be5640 1 -- 172.21.15.130:0/442894967 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20009420 con 0x7f0d300ccc10 2023-09-13T06:03:52.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d363e4640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d300b1ff0 0x7f0d3006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:52.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d35be3640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d300b3170 0x7f0d301f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:52.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d36be5640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d300ccc10 0x7f0d301f57b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c7b0 tx=0x7f0d2800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:52.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d26ffd640 1 -- 172.21.15.130:0/442894967 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2800a640 con 0x7f0d300ccc10 2023-09-13T06:03:52.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d26ffd640 1 -- 172.21.15.130:0/442894967 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2800a7c0 con 0x7f0d300ccc10 2023-09-13T06:03:52.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d26ffd640 1 -- 172.21.15.130:0/442894967 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2800ab70 con 0x7f0d300ccc10 2023-09-13T06:03:52.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d38648640 1 -- 172.21.15.130:0/442894967 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3014b670 con 0x7f0d300ccc10 2023-09-13T06:03:52.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d38648640 1 -- 172.21.15.130:0/442894967 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3014bc30 con 0x7f0d300ccc10 2023-09-13T06:03:52.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d38648640 1 -- 172.21.15.130:0/442894967 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3014c130 con 0x7f0d300ccc10 2023-09-13T06:03:52.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.515+0000 7f0d26ffd640 1 -- 172.21.15.130:0/442894967 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0d2800acd0 con 0x7f0d300ccc10 2023-09-13T06:03:52.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.519+0000 7f0d26ffd640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d14065b20 0x7f0d14067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:52.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.519+0000 7f0d26ffd640 1 -- 172.21.15.130:0/442894967 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0d28082450 con 0x7f0d300ccc10 2023-09-13T06:03:52.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.519+0000 7f0d363e4640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d14065b20 0x7f0d14067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:52.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.519+0000 7f0d363e4640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d14065b20 0x7f0d14067fe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009840 tx=0x7f0d2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:52.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.523+0000 7f0d26ffd640 1 -- 172.21.15.130:0/442894967 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0d28050050 con 0x7f0d300ccc10 2023-09-13T06:03:52.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:52.671+0000 7f0d38648640 1 -- 172.21.15.130:0/442894967 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0d300618a0 con 0x7f0d300ccc10 2023-09-13T06:03:53.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.323+0000 7f0d26ffd640 1 -- 172.21.15.130:0/442894967 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0d280180b0 con 0x7f0d300ccc10 2023-09-13T06:03:53.329 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' created 2023-09-13T06:03:53.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.327+0000 7f0d38648640 1 -- 172.21.15.130:0/442894967 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d14065b20 msgr2=0x7f0d14067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:53.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.327+0000 7f0d38648640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d14065b20 0x7f0d14067fe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009840 tx=0x7f0d2c008040 comp rx=0 tx=0).stop 2023-09-13T06:03:53.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.327+0000 7f0d38648640 1 -- 172.21.15.130:0/442894967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d300ccc10 msgr2=0x7f0d301f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:53.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.327+0000 7f0d38648640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d300ccc10 0x7f0d301f57b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c7b0 tx=0x7f0d2800cc70 comp rx=0 tx=0).stop 2023-09-13T06:03:53.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.327+0000 7f0d38648640 1 -- 172.21.15.130:0/442894967 shutdown_connections 2023-09-13T06:03:53.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.327+0000 7f0d38648640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d14065b20 0x7f0d14067fe0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:53.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.327+0000 7f0d38648640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d300ccc10 0x7f0d301f57b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:53.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.327+0000 7f0d38648640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d300b3170 0x7f0d301f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:53.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.327+0000 7f0d38648640 1 --2- 172.21.15.130:0/442894967 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d300b1ff0 0x7f0d3006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:53.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.331+0000 7f0d38648640 1 -- 172.21.15.130:0/442894967 >> 172.21.15.130:0/442894967 conn(0x7f0d300735e0 msgr2=0x7f0d3015a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:53.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.331+0000 7f0d38648640 1 -- 172.21.15.130:0/442894967 shutdown_connections 2023-09-13T06:03:53.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.331+0000 7f0d38648640 1 -- 172.21.15.130:0/442894967 wait complete. 2023-09-13T06:03:53.355 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T06:03:53.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8fa312640 1 Processor -- start 2023-09-13T06:03:53.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8fa312640 1 -- start start 2023-09-13T06:03:53.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8fa312640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe8f40709d0 0x7fe8f40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:53.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8fa312640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe8f41617b0 0x7fe8f40b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:53.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8fa312640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f40b44e0 con 0x7fe8f4070db0 2023-09-13T06:03:53.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8fa312640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f40b47c0 con 0x7fe8f40709d0 2023-09-13T06:03:53.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8fa312640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f40b4aa0 con 0x7fe8f41617b0 2023-09-13T06:03:53.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8f9310640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe8f40709d0 0x7fe8f40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:53.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8f8b0f640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe8f4070db0 0x7fe8f40b5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:52686/0 (socket says 172.21.15.130:52686) 2023-09-13T06:03:53.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8f8b0f640 1 -- 172.21.15.130:0/3281630902 learned_addr learned my addr 172.21.15.130:0/3281630902 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:53.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8f9b11640 1 --2- 172.21.15.130:0/3281630902 >> v2:172.21.15.164:3300/0 conn(0x7fe8f41617b0 0x7fe8f40b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:53.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8f9310640 1 -- 172.21.15.130:0/3281630902 >> v2:172.21.15.164:3300/0 conn(0x7fe8f41617b0 msgr2=0x7fe8f40b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:53.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8f9310640 1 --2- 172.21.15.130:0/3281630902 >> v2:172.21.15.164:3300/0 conn(0x7fe8f41617b0 0x7fe8f40b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:53.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8f9310640 1 -- 172.21.15.130:0/3281630902 >> v1:172.21.15.130:6789/0 conn(0x7fe8f4070db0 legacy=0x7fe8f40b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:53.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8f9310640 1 -- 172.21.15.130:0/3281630902 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f40b4d80 con 0x7fe8f40709d0 2023-09-13T06:03:53.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.499+0000 7fe8ebfff640 1 -- 172.21.15.130:0/3281630902 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488557614 0 0) 0x7fe8f40b44e0 con 0x7fe8f4070db0 2023-09-13T06:03:53.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8f9310640 1 --2- 172.21.15.130:0/3281630902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f40709d0 0x7fe8f40b8a10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40d0ac0 tx=0x7fe8f001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f969d1d73efbc0c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:53.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8ebfff640 1 -- 172.21.15.130:0/3281630902 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00a8950 con 0x7fe8f40709d0 2023-09-13T06:03:53.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8ebfff640 1 -- 172.21.15.130:0/3281630902 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f00a8ab0 con 0x7fe8f40709d0 2023-09-13T06:03:53.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8ebfff640 1 -- 172.21.15.130:0/3281630902 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00a8e40 con 0x7fe8f40709d0 2023-09-13T06:03:53.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8fa312640 1 -- 172.21.15.130:0/3281630902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f40709d0 msgr2=0x7fe8f40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:53.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8fa312640 1 --2- 172.21.15.130:0/3281630902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f40709d0 0x7fe8f40b8a10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40d0ac0 tx=0x7fe8f001ec50 comp rx=0 tx=0).stop 2023-09-13T06:03:53.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8fa312640 1 -- 172.21.15.130:0/3281630902 shutdown_connections 2023-09-13T06:03:53.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8fa312640 1 --2- 172.21.15.130:0/3281630902 >> v2:172.21.15.164:3300/0 conn(0x7fe8f41617b0 0x7fe8f40b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:53.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8fa312640 1 --2- 172.21.15.130:0/3281630902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f40709d0 0x7fe8f40b8a10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:53.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8fa312640 1 -- 172.21.15.130:0/3281630902 >> 172.21.15.130:0/3281630902 conn(0x7fe8f40d2f60 msgr2=0x7fe8f40d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:53.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8fa312640 1 -- 172.21.15.130:0/3281630902 shutdown_connections 2023-09-13T06:03:53.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.503+0000 7fe8fa312640 1 -- 172.21.15.130:0/3281630902 wait complete. 2023-09-13T06:03:53.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8fa312640 1 Processor -- start 2023-09-13T06:03:53.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8fa312640 1 -- start start 2023-09-13T06:03:53.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8fa312640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f40709d0 0x7fe8f4144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:53.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8fa312640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f4070db0 0x7fe8f4150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:53.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8fa312640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f41617b0 0x7fe8f4150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:53.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8fa312640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f4141280 con 0x7fe8f41617b0 2023-09-13T06:03:53.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8fa312640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f4151170 con 0x7fe8f4070db0 2023-09-13T06:03:53.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8fa312640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f4151450 con 0x7fe8f40709d0 2023-09-13T06:03:53.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f9b11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f41617b0 0x7fe8f4150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:53.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f9b11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f41617b0 0x7fe8f4150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37230/0 (socket says 172.21.15.130:37230) 2023-09-13T06:03:53.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f9b11640 1 -- 172.21.15.130:0/3442002103 learned_addr learned my addr 172.21.15.130:0/3442002103 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:53.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f9310640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f40709d0 0x7fe8f4144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:53.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f8b0f640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f4070db0 0x7fe8f4150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:53.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f9b11640 1 -- 172.21.15.130:0/3442002103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f40709d0 msgr2=0x7fe8f4144040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:53.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f9b11640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f40709d0 0x7fe8f4144040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:53.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f9b11640 1 -- 172.21.15.130:0/3442002103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f4070db0 msgr2=0x7fe8f4150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:53.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f9b11640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f4070db0 0x7fe8f4150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:53.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f9b11640 1 -- 172.21.15.130:0/3442002103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f0009420 con 0x7fe8f41617b0 2023-09-13T06:03:53.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f8b0f640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f4070db0 0x7fe8f4150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:53.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8f9b11640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f41617b0 0x7fe8f4150b40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec007e60 tx=0x7fe8ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:53.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8e9ffb640 1 -- 172.21.15.130:0/3442002103 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec014420 con 0x7fe8f41617b0 2023-09-13T06:03:53.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8e9ffb640 1 -- 172.21.15.130:0/3442002103 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ec0145a0 con 0x7fe8f41617b0 2023-09-13T06:03:53.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8e9ffb640 1 -- 172.21.15.130:0/3442002103 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec014950 con 0x7fe8f41617b0 2023-09-13T06:03:53.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8fa312640 1 -- 172.21.15.130:0/3442002103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f4151730 con 0x7fe8f41617b0 2023-09-13T06:03:53.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8fa312640 1 -- 172.21.15.130:0/3442002103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f4151cf0 con 0x7fe8f41617b0 2023-09-13T06:03:53.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.507+0000 7fe8fa312640 1 -- 172.21.15.130:0/3442002103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f4070390 con 0x7fe8f41617b0 2023-09-13T06:03:53.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.511+0000 7fe8e9ffb640 1 -- 172.21.15.130:0/3442002103 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe8ec014ab0 con 0x7fe8f41617b0 2023-09-13T06:03:53.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.511+0000 7fe8e9ffb640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8d8065b20 0x7fe8d8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:53.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.511+0000 7fe8e9ffb640 1 -- 172.21.15.130:0/3442002103 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe8ec083a00 con 0x7fe8f41617b0 2023-09-13T06:03:53.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.511+0000 7fe8f9310640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8d8065b20 0x7fe8d8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:53.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.511+0000 7fe8f9310640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8d8065b20 0x7fe8d8067fe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00b2000 tx=0x7fe8f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:53.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.515+0000 7fe8e9ffb640 1 -- 172.21.15.130:0/3442002103 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe8ec051490 con 0x7fe8f41617b0 2023-09-13T06:03:53.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:53.663+0000 7fe8fa312640 1 -- 172.21.15.130:0/3442002103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe8f40618a0 con 0x7fe8f41617b0 2023-09-13T06:03:54.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.330+0000 7fe8e9ffb640 1 -- 172.21.15.130:0/3442002103 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe8ec054ab0 con 0x7fe8f41617b0 2023-09-13T06:03:54.343 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' created 2023-09-13T06:03:54.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 -- 172.21.15.130:0/3442002103 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8d8065b20 msgr2=0x7fe8d8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:54.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8d8065b20 0x7fe8d8067fe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00b2000 tx=0x7fe8f0008040 comp rx=0 tx=0).stop 2023-09-13T06:03:54.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 -- 172.21.15.130:0/3442002103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f41617b0 msgr2=0x7fe8f4150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:54.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f41617b0 0x7fe8f4150b40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec007e60 tx=0x7fe8ec00e4b0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 -- 172.21.15.130:0/3442002103 shutdown_connections 2023-09-13T06:03:54.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8d8065b20 0x7fe8d8067fe0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f4070db0 0x7fe8f4150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f41617b0 0x7fe8f4150b40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 --2- 172.21.15.130:0/3442002103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f40709d0 0x7fe8f4144040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 -- 172.21.15.130:0/3442002103 >> 172.21.15.130:0/3442002103 conn(0x7fe8f40d2f60 msgr2=0x7fe8f40cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:54.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 -- 172.21.15.130:0/3442002103 shutdown_connections 2023-09-13T06:03:54.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.342+0000 7fe8fa312640 1 -- 172.21.15.130:0/3442002103 wait complete. 2023-09-13T06:03:54.368 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T06:03:54.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.506+0000 7f633b7ba640 1 Processor -- start 2023-09-13T06:03:54.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 -- start start 2023-09-13T06:03:54.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6334144d70 0x7f63340ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:54.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63340b2780 0x7f63340b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:54.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f63340b1460 0x7f63340b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:54.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63340b2430 con 0x7f63340b1460 2023-09-13T06:03:54.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63340cedb0 con 0x7f6334144d70 2023-09-13T06:03:54.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63340b3120 con 0x7f63340b2780 2023-09-13T06:03:54.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6339d57640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f63340b1460 0x7f63340b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:54.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6339d57640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f63340b1460 0x7f63340b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37240/0 (socket says 172.21.15.130:37240) 2023-09-13T06:03:54.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6339d57640 1 -- 172.21.15.130:0/2744872561 learned_addr learned my addr 172.21.15.130:0/2744872561 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:54.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6339556640 1 --2- 172.21.15.130:0/2744872561 >> v2:172.21.15.164:3300/0 conn(0x7f6334144d70 0x7f63340ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:54.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6338d55640 1 --2- 172.21.15.130:0/2744872561 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63340b2780 0x7f63340b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:54.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6339d57640 1 -- 172.21.15.130:0/2744872561 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63340b2780 msgr2=0x7f63340b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:54.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6339d57640 1 --2- 172.21.15.130:0/2744872561 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63340b2780 0x7f63340b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6339d57640 1 -- 172.21.15.130:0/2744872561 >> v2:172.21.15.164:3300/0 conn(0x7f6334144d70 msgr2=0x7f63340ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:54.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6339d57640 1 --2- 172.21.15.130:0/2744872561 >> v2:172.21.15.164:3300/0 conn(0x7f6334144d70 0x7f63340ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6339d57640 1 -- 172.21.15.130:0/2744872561 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340b2150 con 0x7f63340b1460 2023-09-13T06:03:54.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6339556640 1 --2- 172.21.15.130:0/2744872561 >> v2:172.21.15.164:3300/0 conn(0x7f6334144d70 0x7f63340ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:03:54.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f6339d57640 1 --2- 172.21.15.130:0/2744872561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63340b1460 0x7f63340b18f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f63340cff90 tx=0x7f632c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54e792870b175f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:54.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f632bfff640 1 -- 172.21.15.130:0/2744872561 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c0a5740 con 0x7f63340b1460 2023-09-13T06:03:54.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f632bfff640 1 -- 172.21.15.130:0/2744872561 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c0a58a0 con 0x7f63340b1460 2023-09-13T06:03:54.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f632bfff640 1 -- 172.21.15.130:0/2744872561 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c0a5c30 con 0x7f63340b1460 2023-09-13T06:03:54.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 -- 172.21.15.130:0/2744872561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63340b1460 msgr2=0x7f63340b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:54.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 --2- 172.21.15.130:0/2744872561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63340b1460 0x7f63340b18f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f63340cff90 tx=0x7f632c01c9d0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 -- 172.21.15.130:0/2744872561 shutdown_connections 2023-09-13T06:03:54.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 --2- 172.21.15.130:0/2744872561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63340b1460 0x7f63340b18f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 --2- 172.21.15.130:0/2744872561 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63340b2780 0x7f63340b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 --2- 172.21.15.130:0/2744872561 >> v2:172.21.15.164:3300/0 conn(0x7f6334144d70 0x7f63340ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 -- 172.21.15.130:0/2744872561 >> 172.21.15.130:0/2744872561 conn(0x7f6334065990 msgr2=0x7f6334065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:54.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 -- 172.21.15.130:0/2744872561 shutdown_connections 2023-09-13T06:03:54.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.510+0000 7f633b7ba640 1 -- 172.21.15.130:0/2744872561 wait complete. 2023-09-13T06:03:54.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f633b7ba640 1 Processor -- start 2023-09-13T06:03:54.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f633b7ba640 1 -- start start 2023-09-13T06:03:54.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f633b7ba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63340b1460 0x7f63340add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:54.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f633b7ba640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63340b2780 0x7f63341f9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:54.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f633b7ba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6334144d70 0x7f633413bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:54.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f633b7ba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63341f9c40 con 0x7f63340b1460 2023-09-13T06:03:54.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f633b7ba640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63340ae330 con 0x7f63340b2780 2023-09-13T06:03:54.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f633b7ba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63340ae610 con 0x7f6334144d70 2023-09-13T06:03:54.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6339556640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63340b1460 0x7f63340add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:54.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6339556640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63340b1460 0x7f63340add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37248/0 (socket says 172.21.15.130:37248) 2023-09-13T06:03:54.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6339556640 1 -- 172.21.15.130:0/558853611 learned_addr learned my addr 172.21.15.130:0/558853611 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:54.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6339d57640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6334144d70 0x7f633413bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:54.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6338d55640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63340b2780 0x7f63341f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:54.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6339556640 1 -- 172.21.15.130:0/558853611 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6334144d70 msgr2=0x7f633413bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:54.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6339556640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6334144d70 0x7f633413bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6339556640 1 -- 172.21.15.130:0/558853611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63340b2780 msgr2=0x7f63341f9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:54.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6339556640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63340b2780 0x7f63341f9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:54.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6339556640 1 -- 172.21.15.130:0/558853611 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c009b30 con 0x7f63340b1460 2023-09-13T06:03:54.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6339556640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63340b1460 0x7f63340add20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f633000c7f0 tx=0x7f633000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:54.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6329ffb640 1 -- 172.21.15.130:0/558853611 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330007820 con 0x7f63340b1460 2023-09-13T06:03:54.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6329ffb640 1 -- 172.21.15.130:0/558853611 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6330007980 con 0x7f63340b1460 2023-09-13T06:03:54.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f633b7ba640 1 -- 172.21.15.130:0/558853611 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63340ae8f0 con 0x7f63340b1460 2023-09-13T06:03:54.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f6329ffb640 1 -- 172.21.15.130:0/558853611 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330007d30 con 0x7f63340b1460 2023-09-13T06:03:54.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f633b7ba640 1 -- 172.21.15.130:0/558853611 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63340aeeb0 con 0x7f63340b1460 2023-09-13T06:03:54.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.518+0000 7f633b7ba640 1 -- 172.21.15.130:0/558853611 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6334142730 con 0x7f63340b1460 2023-09-13T06:03:54.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.522+0000 7f6329ffb640 1 -- 172.21.15.130:0/558853611 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f63300113f0 con 0x7f63340b1460 2023-09-13T06:03:54.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.522+0000 7f6329ffb640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6318065b20 0x7f6318067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:54.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.522+0000 7f6329ffb640 1 -- 172.21.15.130:0/558853611 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f63300835a0 con 0x7f63340b1460 2023-09-13T06:03:54.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.522+0000 7f6338d55640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6318065b20 0x7f6318067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:54.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.522+0000 7f6338d55640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6318065b20 0x7f6318067fe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f63340ae260 tx=0x7f6324008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:54.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.526+0000 7f6329ffb640 1 -- 172.21.15.130:0/558853611 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6334142730 con 0x7f63340b1460 2023-09-13T06:03:54.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:54.706+0000 7f633b7ba640 1 -- 172.21.15.130:0/558853611 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6334142730 con 0x7f63340b1460 2023-09-13T06:03:55.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.370+0000 7f6329ffb640 1 -- 172.21.15.130:0/558853611 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6334142730 con 0x7f63340b1460 2023-09-13T06:03:55.372 INFO:teuthology.orchestra.run.smithi130.stderr:new fs with metadata pool 8 and data pool 9 2023-09-13T06:03:55.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 -- 172.21.15.130:0/558853611 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6318065b20 msgr2=0x7f6318067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6318065b20 0x7f6318067fe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f63340ae260 tx=0x7f6324008040 comp rx=0 tx=0).stop 2023-09-13T06:03:55.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 -- 172.21.15.130:0/558853611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63340b1460 msgr2=0x7f63340add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63340b1460 0x7f63340add20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f633000c7f0 tx=0x7f633000ccb0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 -- 172.21.15.130:0/558853611 shutdown_connections 2023-09-13T06:03:55.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6318065b20 0x7f6318067fe0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63340b2780 0x7f63341f9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6334144d70 0x7f633413bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 --2- 172.21.15.130:0/558853611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63340b1460 0x7f63340add20 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 -- 172.21.15.130:0/558853611 >> 172.21.15.130:0/558853611 conn(0x7f6334065990 msgr2=0x7f63340ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:55.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 -- 172.21.15.130:0/558853611 shutdown_connections 2023-09-13T06:03:55.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.374+0000 7f633b7ba640 1 -- 172.21.15.130:0/558853611 wait complete. 2023-09-13T06:03:55.399 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:03:55.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.534+0000 7f10b1248640 1 Processor -- start 2023-09-13T06:03:55.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.534+0000 7f10b1248640 1 -- start start 2023-09-13T06:03:55.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10b1248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 0x7f10ac0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10b1248640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10ac0cdfc0 0x7f10ac0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10b1248640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac0ccfd0 con 0x7f10ac159f20 2023-09-13T06:03:55.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10b1248640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ac0ce430 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10b1248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac0b00f0 con 0x7f10ac0b1d20 2023-09-13T06:03:55.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10ab59e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10ac0cdfc0 0x7f10ac0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10a259c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 0x7f10ac0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10ab59e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10ac0cdfc0 0x7f10ac0b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:60996/0 (socket says 172.21.15.130:60996) 2023-09-13T06:03:55.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10a259c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 0x7f10ac0ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:46810/0 (socket says 172.21.15.130:46810) 2023-09-13T06:03:55.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10ab59e640 1 -- 172.21.15.130:0/3163275004 learned_addr learned my addr 172.21.15.130:0/3163275004 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:55.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10aad9d640 1 --1- 172.21.15.130:0/3163275004 >> v1:172.21.15.164:6789/0 conn(0x7f10ac159f20 0x7f10ac0b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:51564/0 (socket says 172.21.15.130:51564) 2023-09-13T06:03:55.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10a259c640 1 -- 172.21.15.130:0/3163275004 >> v2:172.21.15.164:3300/0 conn(0x7f10ac0cdfc0 msgr2=0x7f10ac0b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:55.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10a259c640 1 --2- 172.21.15.130:0/3163275004 >> v2:172.21.15.164:3300/0 conn(0x7f10ac0cdfc0 0x7f10ac0b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10a259c640 1 -- 172.21.15.130:0/3163275004 >> v1:172.21.15.164:6789/0 conn(0x7f10ac159f20 legacy=0x7f10ac0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10aa59c640 1 -- 172.21.15.130:0/3163275004 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989550020 0 0) 0x7f10ac0ccfd0 con 0x7f10ac159f20 2023-09-13T06:03:55.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.538+0000 7f10a259c640 1 -- 172.21.15.130:0/3163275004 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac0ced90 con 0x7f10ac0b1d20 2023-09-13T06:03:55.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10a259c640 1 --2- 172.21.15.130:0/3163275004 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 0x7f10ac0ce7b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f10940097c0 tx=0x7f109401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f9449bd229ac254 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:55.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10aa59c640 1 -- 172.21.15.130:0/3163275004 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10940ab600 con 0x7f10ac0b1d20 2023-09-13T06:03:55.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10aa59c640 1 -- 172.21.15.130:0/3163275004 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10940a7050 con 0x7f10ac0b1d20 2023-09-13T06:03:55.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10aa59c640 1 -- 172.21.15.130:0/3163275004 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10940ab980 con 0x7f10ac0b1d20 2023-09-13T06:03:55.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10b1248640 1 -- 172.21.15.130:0/3163275004 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 msgr2=0x7f10ac0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10b1248640 1 --2- 172.21.15.130:0/3163275004 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 0x7f10ac0ce7b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f10940097c0 tx=0x7f109401c480 comp rx=0 tx=0).stop 2023-09-13T06:03:55.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10b1248640 1 -- 172.21.15.130:0/3163275004 shutdown_connections 2023-09-13T06:03:55.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10b1248640 1 --2- 172.21.15.130:0/3163275004 >> v2:172.21.15.164:3300/0 conn(0x7f10ac0cdfc0 0x7f10ac0b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10b1248640 1 --2- 172.21.15.130:0/3163275004 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 0x7f10ac0ce7b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10b1248640 1 -- 172.21.15.130:0/3163275004 >> 172.21.15.130:0/3163275004 conn(0x7f10ac065990 msgr2=0x7f10ac065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:55.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10b1248640 1 -- 172.21.15.130:0/3163275004 shutdown_connections 2023-09-13T06:03:55.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.542+0000 7f10b1248640 1 -- 172.21.15.130:0/3163275004 wait complete. 2023-09-13T06:03:55.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10b1248640 1 Processor -- start 2023-09-13T06:03:55.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10b1248640 1 -- start start 2023-09-13T06:03:55.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10b1248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 0x7f10ac13b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10b1248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ac0cdfc0 0x7f10ac14d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10b1248640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10ac159f20 0x7f10ac150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10b1248640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac156a70 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10b1248640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac14da40 con 0x7f10ac159f20 2023-09-13T06:03:55.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10b1248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac14dd20 con 0x7f10ac0b1d20 2023-09-13T06:03:55.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ac0cdfc0 0x7f10ac14d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ac0cdfc0 0x7f10ac14d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37260/0 (socket says 172.21.15.130:37260) 2023-09-13T06:03:55.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a259c640 1 -- 172.21.15.130:0/1120237329 learned_addr learned my addr 172.21.15.130:0/1120237329 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:55.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10aad9d640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 0x7f10ac13b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10ab59e640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10ac159f20 0x7f10ac150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a259c640 1 -- 172.21.15.130:0/1120237329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 msgr2=0x7f10ac13b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a259c640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 0x7f10ac13b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a259c640 1 -- 172.21.15.130:0/1120237329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10ac159f20 msgr2=0x7f10ac150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a259c640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10ac159f20 0x7f10ac150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a259c640 1 -- 172.21.15.130:0/1120237329 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094009420 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10ab59e640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10ac159f20 0x7f10ac150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:55.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a259c640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ac0cdfc0 0x7f10ac14d010 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f10940ae040 tx=0x7f1094019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:55.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a3fff640 1 -- 172.21.15.130:0/1120237329 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10940b4430 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a3fff640 1 -- 172.21.15.130:0/1120237329 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10940b4590 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10b1248640 1 -- 172.21.15.130:0/1120237329 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ac14e000 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10a3fff640 1 -- 172.21.15.130:0/1120237329 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10940b4940 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.546+0000 7f10b1248640 1 -- 172.21.15.130:0/1120237329 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ac13bf30 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.550+0000 7f10b1248640 1 -- 172.21.15.130:0/1120237329 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ac156be0 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.550+0000 7f10a3fff640 1 -- 172.21.15.130:0/1120237329 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f10940b2040 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.550+0000 7f10a3fff640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f108c065b50 0x7f108c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.550+0000 7f10a3fff640 1 -- 172.21.15.130:0/1120237329 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f109411d180 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.550+0000 7f10aad9d640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f108c065b50 0x7f108c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.550+0000 7f10aad9d640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f108c065b50 0x7f108c068010 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f109c000f70 tx=0x7f109c007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:55.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.554+0000 7f10a3fff640 1 -- 172.21.15.130:0/1120237329 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f10940eaac0 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.706+0000 7f10b1248640 1 -- 172.21.15.130:0/1120237329 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10ac0cd7c0 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.706+0000 7f10a3fff640 1 -- 172.21.15.130:0/1120237329 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16614 (secure 0 0 0) 0x7f10940ee0e0 con 0x7f10ac0cdfc0 2023-09-13T06:03:55.708 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:55.708 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":64,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:03:54.710406+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:03:52.722728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-09-13T06:03:53.712581+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:03:55.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.706+0000 7f10b1248640 1 -- 172.21.15.130:0/1120237329 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f108c065b50 msgr2=0x7f108c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.706+0000 7f10b1248640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f108c065b50 0x7f108c068010 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f109c000f70 tx=0x7f109c007b60 comp rx=0 tx=0).stop 2023-09-13T06:03:55.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.706+0000 7f10b1248640 1 -- 172.21.15.130:0/1120237329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ac0cdfc0 msgr2=0x7f10ac14d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.706+0000 7f10b1248640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ac0cdfc0 0x7f10ac14d010 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f10940ae040 tx=0x7f1094019220 comp rx=0 tx=0).stop 2023-09-13T06:03:55.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.710+0000 7f10b1248640 1 -- 172.21.15.130:0/1120237329 shutdown_connections 2023-09-13T06:03:55.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.710+0000 7f10b1248640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f108c065b50 0x7f108c068010 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.710+0000 7f10b1248640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10ac159f20 0x7f10ac150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.710+0000 7f10b1248640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ac0cdfc0 0x7f10ac14d010 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.710+0000 7f10b1248640 1 --2- 172.21.15.130:0/1120237329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10ac0b1d20 0x7f10ac13b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.710+0000 7f10b1248640 1 -- 172.21.15.130:0/1120237329 >> 172.21.15.130:0/1120237329 conn(0x7f10ac065990 msgr2=0x7f10ac155090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:55.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.710+0000 7f10b1248640 1 -- 172.21.15.130:0/1120237329 shutdown_connections 2023-09-13T06:03:55.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.710+0000 7f10b1248640 1 -- 172.21.15.130:0/1120237329 wait complete. 2023-09-13T06:03:55.731 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:03:55.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.866+0000 7f774513d640 1 Processor -- start 2023-09-13T06:03:55.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.866+0000 7f774513d640 1 -- start start 2023-09-13T06:03:55.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f774513d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77400cc3f0 0x7f774015af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f774513d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f774006d930 0x7f77400ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f774513d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774006ddc0 con 0x7f7740157980 2023-09-13T06:03:55.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f774513d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774015b480 con 0x7f774006d930 2023-09-13T06:03:55.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f774513d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774006c890 con 0x7f77400cc3f0 2023-09-13T06:03:55.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f773f7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77400cc3f0 0x7f774015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f774493c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f774006d930 0x7f77400ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f773ffff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f7740157980 0x7f77400cbce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:51566/0 (socket says 172.21.15.130:51566) 2023-09-13T06:03:55.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f773ffff640 1 -- 172.21.15.130:0/903481940 learned_addr learned my addr 172.21.15.130:0/903481940 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:55.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f773f7fe640 1 -- 172.21.15.130:0/903481940 >> v2:172.21.15.164:3300/0 conn(0x7f774006d930 msgr2=0x7f77400ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:55.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f773f7fe640 1 --2- 172.21.15.130:0/903481940 >> v2:172.21.15.164:3300/0 conn(0x7f774006d930 0x7f77400ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f773f7fe640 1 -- 172.21.15.130:0/903481940 >> v1:172.21.15.164:6789/0 conn(0x7f7740157980 legacy=0x7f77400cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f773effd640 1 -- 172.21.15.130:0/903481940 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116406953 0 0) 0x7f774006ddc0 con 0x7f7740157980 2023-09-13T06:03:55.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.870+0000 7f773f7fe640 1 -- 172.21.15.130:0/903481940 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774006cb70 con 0x7f77400cc3f0 2023-09-13T06:03:55.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f773f7fe640 1 --2- 172.21.15.130:0/903481940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77400cc3f0 0x7f774015af40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f77340097c0 tx=0x7f773401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c24f11fc21127ea5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:55.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f773effd640 1 -- 172.21.15.130:0/903481940 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77340ad640 con 0x7f77400cc3f0 2023-09-13T06:03:55.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f773effd640 1 -- 172.21.15.130:0/903481940 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77340ad7a0 con 0x7f77400cc3f0 2023-09-13T06:03:55.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f773effd640 1 -- 172.21.15.130:0/903481940 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77340adb30 con 0x7f77400cc3f0 2023-09-13T06:03:55.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f774513d640 1 -- 172.21.15.130:0/903481940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77400cc3f0 msgr2=0x7f774015af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f774513d640 1 --2- 172.21.15.130:0/903481940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77400cc3f0 0x7f774015af40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f77340097c0 tx=0x7f773401c390 comp rx=0 tx=0).stop 2023-09-13T06:03:55.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f774513d640 1 -- 172.21.15.130:0/903481940 shutdown_connections 2023-09-13T06:03:55.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f774513d640 1 --2- 172.21.15.130:0/903481940 >> v2:172.21.15.164:3300/0 conn(0x7f774006d930 0x7f77400ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f774513d640 1 --2- 172.21.15.130:0/903481940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77400cc3f0 0x7f774015af40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f774513d640 1 -- 172.21.15.130:0/903481940 >> 172.21.15.130:0/903481940 conn(0x7f7740065b60 msgr2=0x7f77400aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:55.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f774513d640 1 -- 172.21.15.130:0/903481940 shutdown_connections 2023-09-13T06:03:55.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f774513d640 1 -- 172.21.15.130:0/903481940 wait complete. 2023-09-13T06:03:55.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f774513d640 1 Processor -- start 2023-09-13T06:03:55.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.874+0000 7f774513d640 1 -- start start 2023-09-13T06:03:55.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774513d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f774006d930 0x7f77401467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774513d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77400cc3f0 0x7f77401566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774513d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7740157980 0x7f774014b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774513d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77401f99a0 con 0x7f7740157980 2023-09-13T06:03:55.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774513d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7740146d20 con 0x7f774006d930 2023-09-13T06:03:55.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774513d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77401f8ad0 con 0x7f77400cc3f0 2023-09-13T06:03:55.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774493c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7740157980 0x7f774014b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774493c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7740157980 0x7f774014b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37268/0 (socket says 172.21.15.130:37268) 2023-09-13T06:03:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774493c640 1 -- 172.21.15.130:0/3421085484 learned_addr learned my addr 172.21.15.130:0/3421085484 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f773f7fe640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77400cc3f0 0x7f77401566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f773ffff640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f774006d930 0x7f77401467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774493c640 1 -- 172.21.15.130:0/3421085484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77400cc3f0 msgr2=0x7f77401566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774493c640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77400cc3f0 0x7f77401566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774493c640 1 -- 172.21.15.130:0/3421085484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f774006d930 msgr2=0x7f77401467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:55.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774493c640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f774006d930 0x7f77401467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:55.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774493c640 1 -- 172.21.15.130:0/3421085484 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7734009420 con 0x7f7740157980 2023-09-13T06:03:55.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774493c640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7740157980 0x7f774014b460 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7738009310 tx=0x7f773800e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:55.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f773cff9640 1 -- 172.21.15.130:0/3421085484 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738010040 con 0x7f7740157980 2023-09-13T06:03:55.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f773cff9640 1 -- 172.21.15.130:0/3421085484 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773800ebe0 con 0x7f7740157980 2023-09-13T06:03:55.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f773cff9640 1 -- 172.21.15.130:0/3421085484 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77380039a0 con 0x7f7740157980 2023-09-13T06:03:55.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774513d640 1 -- 172.21.15.130:0/3421085484 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f774015c6a0 con 0x7f7740157980 2023-09-13T06:03:55.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774513d640 1 -- 172.21.15.130:0/3421085484 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77401f9000 con 0x7f7740157980 2023-09-13T06:03:55.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f774513d640 1 -- 172.21.15.130:0/3421085484 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77400618a0 con 0x7f7740157980 2023-09-13T06:03:55.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.878+0000 7f773cff9640 1 -- 172.21.15.130:0/3421085484 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7738003b00 con 0x7f7740157980 2023-09-13T06:03:55.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.882+0000 7f773cff9640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f772c065b20 0x7f772c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:55.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.882+0000 7f773cff9640 1 -- 172.21.15.130:0/3421085484 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7738083650 con 0x7f7740157980 2023-09-13T06:03:55.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.882+0000 7f773ffff640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f772c065b20 0x7f772c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:55.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.882+0000 7f773ffff640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f772c065b20 0x7f772c067fe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7730000f70 tx=0x7f7730007240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:55.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:55.886+0000 7f773cff9640 1 -- 172.21.15.130:0/3421085484 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7738051040 con 0x7f7740157980 2023-09-13T06:03:56.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.034+0000 7f774513d640 1 -- 172.21.15.130:0/3421085484 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77400b0cb0 con 0x7f7740157980 2023-09-13T06:03:56.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.034+0000 7f773cff9640 1 -- 172.21.15.130:0/3421085484 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16614 (secure 0 0 0) 0x7f7738054660 con 0x7f7740157980 2023-09-13T06:03:56.036 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:56.036 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":64,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:03:54.710406+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:03:52.722728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-09-13T06:03:53.712581+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:03:56.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 -- 172.21.15.130:0/3421085484 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f772c065b20 msgr2=0x7f772c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:56.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f772c065b20 0x7f772c067fe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7730000f70 tx=0x7f7730007240 comp rx=0 tx=0).stop 2023-09-13T06:03:56.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 -- 172.21.15.130:0/3421085484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7740157980 msgr2=0x7f774014b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:56.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7740157980 0x7f774014b460 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7738009310 tx=0x7f773800e490 comp rx=0 tx=0).stop 2023-09-13T06:03:56.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 -- 172.21.15.130:0/3421085484 shutdown_connections 2023-09-13T06:03:56.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f772c065b20 0x7f772c067fe0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:56.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7740157980 0x7f774014b460 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77400cc3f0 0x7f77401566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 --2- 172.21.15.130:0/3421085484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f774006d930 0x7f77401467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 -- 172.21.15.130:0/3421085484 >> 172.21.15.130:0/3421085484 conn(0x7f7740065b60 msgr2=0x7f7740158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 -- 172.21.15.130:0/3421085484 shutdown_connections 2023-09-13T06:03:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.038+0000 7f774513d640 1 -- 172.21.15.130:0/3421085484 wait complete. 2023-09-13T06:03:56.058 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T06:03:56.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.198+0000 7f50b1574640 1 Processor -- start 2023-09-13T06:03:56.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.198+0000 7f50b1574640 1 -- start start 2023-09-13T06:03:56.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.198+0000 7f50b1574640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50ac154760 0x7f50ac0b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:56.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.198+0000 7f50b1574640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50ac161140 0x7f50ac15e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:56.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.198+0000 7f50b1574640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ac0b2690 con 0x7f50ac154380 2023-09-13T06:03:56.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.198+0000 7f50b1574640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ac070d80 con 0x7f50ac161140 2023-09-13T06:03:56.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.198+0000 7f50b1574640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac161700 con 0x7f50ac154760 2023-09-13T06:03:56.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.198+0000 7f50aaffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f50ac154380 0x7f50ac070670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:52702/0 (socket says 172.21.15.130:52702) 2023-09-13T06:03:56.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.198+0000 7f50aaffd640 1 -- 172.21.15.130:0/2075513363 learned_addr learned my addr 172.21.15.130:0/2075513363 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:56.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.198+0000 7f50ab7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50ac161140 0x7f50ac15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:56.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.202+0000 7f50a3fff640 1 --2- 172.21.15.130:0/2075513363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50ac154760 0x7f50ac0b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.202+0000 7f50ab7fe640 1 -- 172.21.15.130:0/2075513363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50ac154760 msgr2=0x7f50ac0b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.202+0000 7f50ab7fe640 1 --2- 172.21.15.130:0/2075513363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50ac154760 0x7f50ac0b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.202+0000 7f50ab7fe640 1 -- 172.21.15.130:0/2075513363 >> v1:172.21.15.130:6789/0 conn(0x7f50ac154380 legacy=0x7f50ac070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.202+0000 7f50ab7fe640 1 -- 172.21.15.130:0/2075513363 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ac1619e0 con 0x7f50ac161140 2023-09-13T06:03:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.202+0000 7f50aa7fc640 1 -- 172.21.15.130:0/2075513363 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163638469 0 0) 0x7f50ac0b2690 con 0x7f50ac154380 2023-09-13T06:03:56.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.202+0000 7f50ab7fe640 1 --2- 172.21.15.130:0/2075513363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50ac161140 0x7f50ac15e180 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009d90 tx=0x7f50a401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30449bbf0f887705 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:56.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.202+0000 7f50aa7fc640 1 -- 172.21.15.130:0/2075513363 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40a59a0 con 0x7f50ac161140 2023-09-13T06:03:56.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.202+0000 7f50aa7fc640 1 -- 172.21.15.130:0/2075513363 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a40a5b00 con 0x7f50ac161140 2023-09-13T06:03:56.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.202+0000 7f50aa7fc640 1 -- 172.21.15.130:0/2075513363 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40a5e90 con 0x7f50ac161140 2023-09-13T06:03:56.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 -- 172.21.15.130:0/2075513363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50ac161140 msgr2=0x7f50ac15e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:56.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 --2- 172.21.15.130:0/2075513363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50ac161140 0x7f50ac15e180 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009d90 tx=0x7f50a401c8c0 comp rx=0 tx=0).stop 2023-09-13T06:03:56.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 -- 172.21.15.130:0/2075513363 shutdown_connections 2023-09-13T06:03:56.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 --2- 172.21.15.130:0/2075513363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50ac161140 0x7f50ac15e180 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:56.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 --2- 172.21.15.130:0/2075513363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50ac154760 0x7f50ac0b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:56.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 -- 172.21.15.130:0/2075513363 >> 172.21.15.130:0/2075513363 conn(0x7f50ac065990 msgr2=0x7f50ac065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:56.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 -- 172.21.15.130:0/2075513363 shutdown_connections 2023-09-13T06:03:56.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 -- 172.21.15.130:0/2075513363 wait complete. 2023-09-13T06:03:56.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 Processor -- start 2023-09-13T06:03:56.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 -- start start 2023-09-13T06:03:56.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50ac154380 0x7f50ac1487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:56.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50ac154760 0x7f50ac149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:56.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50ac161140 0x7f50ac156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:56.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac15d630 con 0x7f50ac161140 2023-09-13T06:03:56.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac1576b0 con 0x7f50ac154380 2023-09-13T06:03:56.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50b1574640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac157990 con 0x7f50ac154760 2023-09-13T06:03:56.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50ab7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50ac161140 0x7f50ac156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:56.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50ab7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50ac161140 0x7f50ac156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37286/0 (socket says 172.21.15.130:37286) 2023-09-13T06:03:56.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50ab7fe640 1 -- 172.21.15.130:0/2769992739 learned_addr learned my addr 172.21.15.130:0/2769992739 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:56.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50aaffd640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50ac154380 0x7f50ac1487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:56.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50a3fff640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50ac154760 0x7f50ac149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:56.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50ab7fe640 1 -- 172.21.15.130:0/2769992739 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50ac154760 msgr2=0x7f50ac149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:56.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50ab7fe640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50ac154760 0x7f50ac149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:56.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50ab7fe640 1 -- 172.21.15.130:0/2769992739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50ac154380 msgr2=0x7f50ac1487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:56.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50ab7fe640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50ac154380 0x7f50ac1487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:56.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50ab7fe640 1 -- 172.21.15.130:0/2769992739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a4009a70 con 0x7f50ac161140 2023-09-13T06:03:56.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.206+0000 7f50a3fff640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50ac154760 0x7f50ac149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:56.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.210+0000 7f50ab7fe640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50ac161140 0x7f50ac156160 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f50a401af70 tx=0x7f50a4019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:56.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.210+0000 7f50a37fe640 1 -- 172.21.15.130:0/2769992739 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40a59a0 con 0x7f50ac161140 2023-09-13T06:03:56.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.210+0000 7f50a37fe640 1 -- 172.21.15.130:0/2769992739 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a4009450 con 0x7f50ac161140 2023-09-13T06:03:56.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.210+0000 7f50a37fe640 1 -- 172.21.15.130:0/2769992739 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40b7630 con 0x7f50ac161140 2023-09-13T06:03:56.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.210+0000 7f50b1574640 1 -- 172.21.15.130:0/2769992739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ac155680 con 0x7f50ac161140 2023-09-13T06:03:56.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.210+0000 7f50b1574640 1 -- 172.21.15.130:0/2769992739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ac155c40 con 0x7f50ac161140 2023-09-13T06:03:56.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.210+0000 7f50b1574640 1 -- 172.21.15.130:0/2769992739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ac155e30 con 0x7f50ac161140 2023-09-13T06:03:56.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.210+0000 7f50a37fe640 1 -- 172.21.15.130:0/2769992739 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f50a40b4050 con 0x7f50ac161140 2023-09-13T06:03:56.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.210+0000 7f50a37fe640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f508c065b20 0x7f508c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:56.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.210+0000 7f50a37fe640 1 -- 172.21.15.130:0/2769992739 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50a411e620 con 0x7f50ac161140 2023-09-13T06:03:56.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.210+0000 7f50aaffd640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f508c065b20 0x7f508c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:56.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.214+0000 7f50aaffd640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f508c065b20 0x7f508c067fe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f509c000f70 tx=0x7f509c007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:56.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.214+0000 7f50a37fe640 1 -- 172.21.15.130:0/2769992739 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f50a40ec0b0 con 0x7f50ac161140 2023-09-13T06:03:56.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:56.398+0000 7f50b1574640 1 -- 172.21.15.130:0/2769992739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f50ac0618a0 con 0x7f50ac161140 2023-09-13T06:03:56.946 INFO:tasks.ceph.mds.b.smithi164.stderr:2023-09-13T06:03:56.943+0000 7f058626d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:03:57.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.382+0000 7f50a37fe640 1 -- 172.21.15.130:0/2769992739 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7f50a40ef6d0 con 0x7f50ac161140 2023-09-13T06:03:57.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 -- 172.21.15.130:0/2769992739 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f508c065b20 msgr2=0x7f508c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:57.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f508c065b20 0x7f508c067fe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f509c000f70 tx=0x7f509c007df0 comp rx=0 tx=0).stop 2023-09-13T06:03:57.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 -- 172.21.15.130:0/2769992739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50ac161140 msgr2=0x7f50ac156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:57.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50ac161140 0x7f50ac156160 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f50a401af70 tx=0x7f50a4019660 comp rx=0 tx=0).stop 2023-09-13T06:03:57.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 -- 172.21.15.130:0/2769992739 shutdown_connections 2023-09-13T06:03:57.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f508c065b20 0x7f508c067fe0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:57.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50ac161140 0x7f50ac156160 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:57.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50ac154760 0x7f50ac149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:57.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 --2- 172.21.15.130:0/2769992739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50ac154380 0x7f50ac1487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:57.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 -- 172.21.15.130:0/2769992739 >> 172.21.15.130:0/2769992739 conn(0x7f50ac065990 msgr2=0x7f50ac0b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:57.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 -- 172.21.15.130:0/2769992739 shutdown_connections 2023-09-13T06:03:57.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.386+0000 7f50b1574640 1 -- 172.21.15.130:0/2769992739 wait complete. 2023-09-13T06:03:57.410 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T06:03:57.411 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T06:03:57.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7bacc6d640 1 Processor -- start 2023-09-13T06:03:57.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7bacc6d640 1 -- start start 2023-09-13T06:03:57.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7bacc6d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ba815a080 0x7f7ba80b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:57.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7bacc6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ba815e650 0x7f7ba80b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:57.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7bacc6d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba80cc850 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7bacc6d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba80b3420 con 0x7f7ba815a080 2023-09-13T06:03:57.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7bacc6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80b0330 con 0x7f7ba815e650 2023-09-13T06:03:57.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7ba659c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ba815a080 0x7f7ba80b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:57.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7ba6d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f7ba80b2fd0 0x7f7ba80ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:52710/0 (socket says 172.21.15.130:52710) 2023-09-13T06:03:57.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7ba6d9d640 1 -- 172.21.15.130:0/2650440419 learned_addr learned my addr 172.21.15.130:0/2650440419 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:57.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7b9dd9b640 1 --2- 172.21.15.130:0/2650440419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ba815e650 0x7f7ba80b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:57.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7ba659c640 1 -- 172.21.15.130:0/2650440419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ba815e650 msgr2=0x7f7ba80b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:57.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7ba659c640 1 --2- 172.21.15.130:0/2650440419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ba815e650 0x7f7ba80b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:57.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7ba659c640 1 -- 172.21.15.130:0/2650440419 >> v1:172.21.15.130:6789/0 conn(0x7f7ba80b2fd0 legacy=0x7f7ba80ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:57.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7ba659c640 1 -- 172.21.15.130:0/2650440419 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba80cbcd0 con 0x7f7ba815a080 2023-09-13T06:03:57.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.554+0000 7f7ba5d9b640 1 -- 172.21.15.130:0/2650440419 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389296741 0 0) 0x7f7ba0001120 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7ba659c640 1 --2- 172.21.15.130:0/2650440419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ba815a080 0x7f7ba80b1460 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f7b980097c0 tx=0x7f7b9801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9194665706ad3e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:57.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7ba5d9b640 1 -- 172.21.15.130:0/2650440419 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980ab600 con 0x7f7ba815a080 2023-09-13T06:03:57.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7ba5d9b640 1 -- 172.21.15.130:0/2650440419 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b980a7050 con 0x7f7ba815a080 2023-09-13T06:03:57.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7ba5d9b640 1 -- 172.21.15.130:0/2650440419 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980ab980 con 0x7f7ba815a080 2023-09-13T06:03:57.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7bacc6d640 1 -- 172.21.15.130:0/2650440419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ba815a080 msgr2=0x7f7ba80b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:57.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7bacc6d640 1 --2- 172.21.15.130:0/2650440419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ba815a080 0x7f7ba80b1460 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f7b980097c0 tx=0x7f7b9801c390 comp rx=0 tx=0).stop 2023-09-13T06:03:57.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7bacc6d640 1 -- 172.21.15.130:0/2650440419 shutdown_connections 2023-09-13T06:03:57.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7bacc6d640 1 --2- 172.21.15.130:0/2650440419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ba815e650 0x7f7ba80b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:57.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7bacc6d640 1 --2- 172.21.15.130:0/2650440419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ba815a080 0x7f7ba80b1460 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:57.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7bacc6d640 1 -- 172.21.15.130:0/2650440419 >> 172.21.15.130:0/2650440419 conn(0x7f7ba8065990 msgr2=0x7f7ba8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:57.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7bacc6d640 1 -- 172.21.15.130:0/2650440419 shutdown_connections 2023-09-13T06:03:57.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.558+0000 7f7bacc6d640 1 -- 172.21.15.130:0/2650440419 wait complete. 2023-09-13T06:03:57.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7bacc6d640 1 Processor -- start 2023-09-13T06:03:57.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7bacc6d640 1 -- start start 2023-09-13T06:03:57.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7bacc6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ba80b2fd0 0x7f7ba815c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:57.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7bacc6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ba815a080 0x7f7ba8132680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:57.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7bacc6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ba815e650 0x7f7ba806da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:57.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7bacc6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba815bc20 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7bacc6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba815c580 con 0x7f7ba815e650 2023-09-13T06:03:57.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7bacc6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba815b5f0 con 0x7f7ba815a080 2023-09-13T06:03:57.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7ba659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ba80b2fd0 0x7f7ba815c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:57.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7ba659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ba80b2fd0 0x7f7ba815c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37308/0 (socket says 172.21.15.130:37308) 2023-09-13T06:03:57.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7ba659c640 1 -- 172.21.15.130:0/908716372 learned_addr learned my addr 172.21.15.130:0/908716372 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:57.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7b9dd9b640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ba815a080 0x7f7ba8132680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:57.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7ba6d9d640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ba815e650 0x7f7ba806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:57.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7ba659c640 1 -- 172.21.15.130:0/908716372 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ba815a080 msgr2=0x7f7ba8132680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:57.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7ba659c640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ba815a080 0x7f7ba8132680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:57.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7ba659c640 1 -- 172.21.15.130:0/908716372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ba815e650 msgr2=0x7f7ba806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:57.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7ba659c640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ba815e650 0x7f7ba806da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:57.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7ba659c640 1 -- 172.21.15.130:0/908716372 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b98009420 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7ba6d9d640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ba815e650 0x7f7ba806da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:03:57.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7ba659c640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ba80b2fd0 0x7f7ba815c040 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7b980ae040 tx=0x7f7b9801abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:57.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7b9f7fe640 1 -- 172.21.15.130:0/908716372 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980b7650 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7b9f7fe640 1 -- 172.21.15.130:0/908716372 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b980abe90 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7b9f7fe640 1 -- 172.21.15.130:0/908716372 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980b7a10 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7bacc6d640 1 -- 172.21.15.130:0/908716372 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba8133b90 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.562+0000 7f7bacc6d640 1 -- 172.21.15.130:0/908716372 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba806e710 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.566+0000 7f7bacc6d640 1 -- 172.21.15.130:0/908716372 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba81522a0 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.566+0000 7f7b9f7fe640 1 -- 172.21.15.130:0/908716372 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7b980b7b70 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.566+0000 7f7b9f7fe640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b88065b20 0x7f7b88067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:57.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.566+0000 7f7b9f7fe640 1 -- 172.21.15.130:0/908716372 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b9811daf0 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.566+0000 7f7b9dd9b640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b88065b20 0x7f7b88067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:57.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.566+0000 7f7b9dd9b640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b88065b20 0x7f7b88067fe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7ba815d2d0 tx=0x7f7b90009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:57.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.570+0000 7f7b9f7fe640 1 -- 172.21.15.130:0/908716372 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7b980eb550 con 0x7f7ba80b2fd0 2023-09-13T06:03:57.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:57.750+0000 7f7bacc6d640 1 -- 172.21.15.130:0/908716372 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7ba80618a0 con 0x7f7ba80b2fd0 2023-09-13T06:03:58.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.382+0000 7f7b9f7fe640 1 -- 172.21.15.130:0/908716372 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7b980bb0c0 con 0x7f7ba80b2fd0 2023-09-13T06:03:58.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 -- 172.21.15.130:0/908716372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b88065b20 msgr2=0x7f7b88067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:58.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b88065b20 0x7f7b88067fe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7ba815d2d0 tx=0x7f7b90009830 comp rx=0 tx=0).stop 2023-09-13T06:03:58.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 -- 172.21.15.130:0/908716372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ba80b2fd0 msgr2=0x7f7ba815c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:58.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ba80b2fd0 0x7f7ba815c040 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7b980ae040 tx=0x7f7b9801abd0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 -- 172.21.15.130:0/908716372 shutdown_connections 2023-09-13T06:03:58.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b88065b20 0x7f7b88067fe0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ba815e650 0x7f7ba806da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ba815a080 0x7f7ba8132680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 --2- 172.21.15.130:0/908716372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ba80b2fd0 0x7f7ba815c040 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 -- 172.21.15.130:0/908716372 >> 172.21.15.130:0/908716372 conn(0x7f7ba8065990 msgr2=0x7f7ba8151360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:58.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 -- 172.21.15.130:0/908716372 shutdown_connections 2023-09-13T06:03:58.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.386+0000 7f7bacc6d640 1 -- 172.21.15.130:0/908716372 wait complete. 2023-09-13T06:03:58.407 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T06:03:58.408 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:03:58.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f636486d640 1 Processor -- start 2023-09-13T06:03:58.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f636486d640 1 -- start start 2023-09-13T06:03:58.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f636486d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f63600d1750 0x7f636015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f636486d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6360146f30 0x7f63600b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f636486d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63600b63c0 con 0x7f63600d1090 2023-09-13T06:03:58.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f636486d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636015dea0 con 0x7f63600d1750 2023-09-13T06:03:58.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f636486d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63600d0c20 con 0x7f6360146f30 2023-09-13T06:03:58.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f635e59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f63600d1750 0x7f636015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f635e59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f63600d1750 0x7f636015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37318/0 (socket says 172.21.15.130:37318) 2023-09-13T06:03:58.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f635e59c640 1 -- 172.21.15.130:0/3769915124 learned_addr learned my addr 172.21.15.130:0/3769915124 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:58.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f635e59c640 1 -- 172.21.15.130:0/3769915124 >> v2:172.21.15.164:3300/0 conn(0x7f6360146f30 msgr2=0x7f63600b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:58.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f635e59c640 1 --2- 172.21.15.130:0/3769915124 >> v2:172.21.15.164:3300/0 conn(0x7f6360146f30 0x7f63600b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f635e59c640 1 -- 172.21.15.130:0/3769915124 >> v1:172.21.15.164:6789/0 conn(0x7f63600d1090 legacy=0x7f6360146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:58.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.546+0000 7f635e59c640 1 -- 172.21.15.130:0/3769915124 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63600b6610 con 0x7f63600d1750 2023-09-13T06:03:58.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f635e59c640 1 --2- 172.21.15.130:0/3769915124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63600d1750 0x7f636015d960 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f63600d2c80 tx=0x7f635001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64067405b73e08ef server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:58.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f635dd9b640 1 -- 172.21.15.130:0/3769915124 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63500ab600 con 0x7f63600d1750 2023-09-13T06:03:58.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f635dd9b640 1 -- 172.21.15.130:0/3769915124 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63500ab760 con 0x7f63600d1750 2023-09-13T06:03:58.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f635dd9b640 1 -- 172.21.15.130:0/3769915124 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63500abaf0 con 0x7f63600d1750 2023-09-13T06:03:58.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f636486d640 1 -- 172.21.15.130:0/3769915124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63600d1750 msgr2=0x7f636015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:58.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f636486d640 1 --2- 172.21.15.130:0/3769915124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63600d1750 0x7f636015d960 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f63600d2c80 tx=0x7f635001c400 comp rx=0 tx=0).stop 2023-09-13T06:03:58.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f636486d640 1 -- 172.21.15.130:0/3769915124 shutdown_connections 2023-09-13T06:03:58.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f636486d640 1 --2- 172.21.15.130:0/3769915124 >> v2:172.21.15.164:3300/0 conn(0x7f6360146f30 0x7f63600b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f636486d640 1 --2- 172.21.15.130:0/3769915124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63600d1750 0x7f636015d960 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f636486d640 1 -- 172.21.15.130:0/3769915124 >> 172.21.15.130:0/3769915124 conn(0x7f636006f170 msgr2=0x7f636006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:58.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f636486d640 1 -- 172.21.15.130:0/3769915124 shutdown_connections 2023-09-13T06:03:58.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.550+0000 7f636486d640 1 -- 172.21.15.130:0/3769915124 wait complete. 2023-09-13T06:03:58.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f636486d640 1 Processor -- start 2023-09-13T06:03:58.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f636486d640 1 -- start start 2023-09-13T06:03:58.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f636486d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63600d1090 0x7f6360162aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f636486d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63600d1750 0x7f636015af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f636486d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6360146f30 0x7f63600b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f636486d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636015c5e0 con 0x7f63600d1750 2023-09-13T06:03:58.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f636486d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6360162fe0 con 0x7f6360146f30 2023-09-13T06:03:58.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f636486d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636015ca00 con 0x7f63600d1090 2023-09-13T06:03:58.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6357fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63600d1750 0x7f636015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6357fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63600d1750 0x7f636015af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37322/0 (socket says 172.21.15.130:37322) 2023-09-13T06:03:58.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6357fff640 1 -- 172.21.15.130:0/2107945071 learned_addr learned my addr 172.21.15.130:0/2107945071 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:58.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f635e59c640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63600d1090 0x7f6360162aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f635ed9d640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6360146f30 0x7f63600b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6357fff640 1 -- 172.21.15.130:0/2107945071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63600d1090 msgr2=0x7f6360162aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:58.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6357fff640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63600d1090 0x7f6360162aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6357fff640 1 -- 172.21.15.130:0/2107945071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6360146f30 msgr2=0x7f63600b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:58.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6357fff640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6360146f30 0x7f63600b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6357fff640 1 -- 172.21.15.130:0/2107945071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63500094d0 con 0x7f63600d1750 2023-09-13T06:03:58.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6357fff640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63600d1750 0x7f636015af40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f634800c410 tx=0x7f634800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:58.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6356ffd640 1 -- 172.21.15.130:0/2107945071 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348003600 con 0x7f63600d1750 2023-09-13T06:03:58.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6356ffd640 1 -- 172.21.15.130:0/2107945071 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6348003780 con 0x7f63600d1750 2023-09-13T06:03:58.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f6356ffd640 1 -- 172.21.15.130:0/2107945071 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348003b30 con 0x7f63600d1750 2023-09-13T06:03:58.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.554+0000 7f636486d640 1 -- 172.21.15.130:0/2107945071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63600b7e40 con 0x7f63600d1750 2023-09-13T06:03:58.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.558+0000 7f636486d640 1 -- 172.21.15.130:0/2107945071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636015b480 con 0x7f63600d1750 2023-09-13T06:03:58.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.558+0000 7f636486d640 1 -- 172.21.15.130:0/2107945071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636015c720 con 0x7f63600d1750 2023-09-13T06:03:58.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.558+0000 7f6356ffd640 1 -- 172.21.15.130:0/2107945071 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6348003c90 con 0x7f63600d1750 2023-09-13T06:03:58.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.558+0000 7f6356ffd640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6340065b20 0x7f6340067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.558+0000 7f6356ffd640 1 -- 172.21.15.130:0/2107945071 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6348082490 con 0x7f63600d1750 2023-09-13T06:03:58.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.558+0000 7f635e59c640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6340065b20 0x7f6340067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.558+0000 7f635e59c640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6340065b20 0x7f6340067fe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f63500af000 tx=0x7f63500b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:58.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.562+0000 7f6356ffd640 1 -- 172.21.15.130:0/2107945071 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f636015c720 con 0x7f63600d1750 2023-09-13T06:03:58.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.742+0000 7f636486d640 1 -- 172.21.15.130:0/2107945071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f636015c720 con 0x7f63600d1750 2023-09-13T06:03:58.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.742+0000 7f6356ffd640 1 -- 172.21.15.130:0/2107945071 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f636015c720 con 0x7f63600d1750 2023-09-13T06:03:58.744 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:58.744 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1338889971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1338889971},{"type":"v1","addr":"172.21.15.164:6835","nonce":1338889971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1298091712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1298091712},{"type":"v1","addr":"172.21.15.130:6835","nonce":1298091712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/798128577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":798128577},{"type":"v1","addr":"172.21.15.130:6837","nonce":798128577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:03:54.710730+0000","modified":"2023-09-13T06:03:57.752848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6087":{"gid":6087,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2038440053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2038440053},{"type":"v1","addr":"172.21.15.164:6833","nonce":2038440053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-09-13T06:03:58.746 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 34 2023-09-13T06:03:58.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.742+0000 7f636486d640 1 -- 172.21.15.130:0/2107945071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6340065b20 msgr2=0x7f6340067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:58.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.742+0000 7f636486d640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6340065b20 0x7f6340067fe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f63500af000 tx=0x7f63500b6040 comp rx=0 tx=0).stop 2023-09-13T06:03:58.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.742+0000 7f636486d640 1 -- 172.21.15.130:0/2107945071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63600d1750 msgr2=0x7f636015af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:58.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.742+0000 7f636486d640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63600d1750 0x7f636015af40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f634800c410 tx=0x7f634800c8d0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.746+0000 7f636486d640 1 -- 172.21.15.130:0/2107945071 shutdown_connections 2023-09-13T06:03:58.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.746+0000 7f636486d640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6340065b20 0x7f6340067fe0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.746+0000 7f636486d640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6360146f30 0x7f63600b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.746+0000 7f636486d640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63600d1750 0x7f636015af40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.746+0000 7f636486d640 1 --2- 172.21.15.130:0/2107945071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63600d1090 0x7f6360162aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.746+0000 7f636486d640 1 -- 172.21.15.130:0/2107945071 >> 172.21.15.130:0/2107945071 conn(0x7f636006f170 msgr2=0x7f636015f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:58.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.746+0000 7f636486d640 1 -- 172.21.15.130:0/2107945071 shutdown_connections 2023-09-13T06:03:58.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.746+0000 7f636486d640 1 -- 172.21.15.130:0/2107945071 wait complete. 2023-09-13T06:03:58.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:03:58.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c7d2c640 1 Processor -- start 2023-09-13T06:03:58.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c7d2c640 1 -- start start 2023-09-13T06:03:58.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c7d2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03c00d1750 0x7f03c015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c7d2c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f03c00d1090 0x7f03c0146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c7d2c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f03c00d1b30 0x7f03c0146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c7d2c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c015dea0 con 0x7f03c00d1b30 2023-09-13T06:03:58.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c7d2c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c00b63c0 con 0x7f03c00d1090 2023-09-13T06:03:58.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c7d2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00d0c20 con 0x7f03c00d1750 2023-09-13T06:03:58.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c62c9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f03c00d1b30 0x7f03c0146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c62c9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f03c00d1b30 0x7f03c0146d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37334/0 (socket says 172.21.15.130:37334) 2023-09-13T06:03:58.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c62c9640 1 -- 172.21.15.130:0/1248154782 learned_addr learned my addr 172.21.15.130:0/1248154782 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:58.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c5ac8640 1 --2- 172.21.15.130:0/1248154782 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03c00d1750 0x7f03c015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c52c7640 1 --2- 172.21.15.130:0/1248154782 >> v2:172.21.15.164:3300/0 conn(0x7f03c00d1090 0x7f03c0146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c62c9640 1 -- 172.21.15.130:0/1248154782 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03c00d1750 msgr2=0x7f03c015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:58.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c62c9640 1 --2- 172.21.15.130:0/1248154782 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03c00d1750 0x7f03c015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c62c9640 1 -- 172.21.15.130:0/1248154782 >> v2:172.21.15.164:3300/0 conn(0x7f03c00d1090 msgr2=0x7f03c0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:58.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c62c9640 1 --2- 172.21.15.130:0/1248154782 >> v2:172.21.15.164:3300/0 conn(0x7f03c00d1090 0x7f03c0146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.902+0000 7f03c62c9640 1 -- 172.21.15.130:0/1248154782 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00b6610 con 0x7f03c00d1b30 2023-09-13T06:03:58.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c62c9640 1 --2- 172.21.15.130:0/1248154782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c00d1b30 0x7f03c0146d60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f03c00b3550 tx=0x7f03b801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e679aebe639b7b77 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:58.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c4ac6640 1 -- 172.21.15.130:0/1248154782 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b80a5820 con 0x7f03c00d1b30 2023-09-13T06:03:58.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c4ac6640 1 -- 172.21.15.130:0/1248154782 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b80a5980 con 0x7f03c00d1b30 2023-09-13T06:03:58.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c4ac6640 1 -- 172.21.15.130:0/1248154782 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b80a5d10 con 0x7f03c00d1b30 2023-09-13T06:03:58.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c7d2c640 1 -- 172.21.15.130:0/1248154782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c00d1b30 msgr2=0x7f03c0146d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:58.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c7d2c640 1 --2- 172.21.15.130:0/1248154782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c00d1b30 0x7f03c0146d60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f03c00b3550 tx=0x7f03b801c9a0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c7d2c640 1 -- 172.21.15.130:0/1248154782 shutdown_connections 2023-09-13T06:03:58.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c7d2c640 1 --2- 172.21.15.130:0/1248154782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c00d1b30 0x7f03c0146d60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c7d2c640 1 --2- 172.21.15.130:0/1248154782 >> v2:172.21.15.164:3300/0 conn(0x7f03c00d1090 0x7f03c0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c7d2c640 1 --2- 172.21.15.130:0/1248154782 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03c00d1750 0x7f03c015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c7d2c640 1 -- 172.21.15.130:0/1248154782 >> 172.21.15.130:0/1248154782 conn(0x7f03c006f170 msgr2=0x7f03c006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:58.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c7d2c640 1 -- 172.21.15.130:0/1248154782 shutdown_connections 2023-09-13T06:03:58.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.906+0000 7f03c7d2c640 1 -- 172.21.15.130:0/1248154782 wait complete. 2023-09-13T06:03:58.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c7d2c640 1 Processor -- start 2023-09-13T06:03:58.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c7d2c640 1 -- start start 2023-09-13T06:03:58.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c7d2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03c00d1090 0x7f03c013ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c7d2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03c00d1750 0x7f03c00c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c7d2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c00d1b30 0x7f03c0145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c7d2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00ca720 con 0x7f03c00d1b30 2023-09-13T06:03:58.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c7d2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c013f170 con 0x7f03c00d1090 2023-09-13T06:03:58.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c7d2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00c9b10 con 0x7f03c00d1750 2023-09-13T06:03:58.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c62c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c00d1b30 0x7f03c0145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c62c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c00d1b30 0x7f03c0145220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37350/0 (socket says 172.21.15.130:37350) 2023-09-13T06:03:58.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c62c9640 1 -- 172.21.15.130:0/3583612332 learned_addr learned my addr 172.21.15.130:0/3583612332 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:58.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c5ac8640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03c00d1090 0x7f03c013ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c52c7640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03c00d1750 0x7f03c00c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c62c9640 1 -- 172.21.15.130:0/3583612332 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03c00d1750 msgr2=0x7f03c00c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:58.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c62c9640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03c00d1750 0x7f03c00c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c62c9640 1 -- 172.21.15.130:0/3583612332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03c00d1090 msgr2=0x7f03c013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:58.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c62c9640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03c00d1090 0x7f03c013ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:58.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c62c9640 1 -- 172.21.15.130:0/3583612332 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8009b30 con 0x7f03c00d1b30 2023-09-13T06:03:58.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c62c9640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c00d1b30 0x7f03c0145220 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f03b801b050 tx=0x7f03b8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:58.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03b67fc640 1 -- 172.21.15.130:0/3583612332 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b80b8670 con 0x7f03c00d1b30 2023-09-13T06:03:58.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03b67fc640 1 -- 172.21.15.130:0/3583612332 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b80b87d0 con 0x7f03c00d1b30 2023-09-13T06:03:58.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c7d2c640 1 -- 172.21.15.130:0/3583612332 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c00c9df0 con 0x7f03c00d1b30 2023-09-13T06:03:58.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03b67fc640 1 -- 172.21.15.130:0/3583612332 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b80b8b80 con 0x7f03c00d1b30 2023-09-13T06:03:58.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c7d2c640 1 -- 172.21.15.130:0/3583612332 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c00ca3b0 con 0x7f03c00d1b30 2023-09-13T06:03:58.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.910+0000 7f03c7d2c640 1 -- 172.21.15.130:0/3583612332 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c00ca8d0 con 0x7f03c00d1b30 2023-09-13T06:03:58.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.914+0000 7f03b67fc640 1 -- 172.21.15.130:0/3583612332 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f03b80b8ce0 con 0x7f03c00d1b30 2023-09-13T06:03:58.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.914+0000 7f03b67fc640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f03a4065b50 0x7f03a4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:58.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.914+0000 7f03b67fc640 1 -- 172.21.15.130:0/3583612332 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03b811e2f0 con 0x7f03c00d1b30 2023-09-13T06:03:58.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.914+0000 7f03c5ac8640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f03a4065b50 0x7f03a4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:58.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.914+0000 7f03c5ac8640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f03a4065b50 0x7f03a4068010 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f03bc006aa0 tx=0x7f03bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:58.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:58.918+0000 7f03b67fc640 1 -- 172.21.15.130:0/3583612332 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f03c00ca8d0 con 0x7f03c00d1b30 2023-09-13T06:03:59.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.066+0000 7f03c7d2c640 1 -- 172.21.15.130:0/3583612332 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03c00618a0 con 0x7f03c00d1b30 2023-09-13T06:03:59.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.066+0000 7f03b67fc640 1 -- 172.21.15.130:0/3583612332 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16601 (secure 0 0 0) 0x7f03b80ebce0 con 0x7f03c00d1b30 2023-09-13T06:03:59.068 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:59.068 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":65,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:03:56.353691+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:03:52.722728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-09-13T06:03:53.712581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:03:59.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 -- 172.21.15.130:0/3583612332 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f03a4065b50 msgr2=0x7f03a4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f03a4065b50 0x7f03a4068010 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f03bc006aa0 tx=0x7f03bc008040 comp rx=0 tx=0).stop 2023-09-13T06:03:59.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 -- 172.21.15.130:0/3583612332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c00d1b30 msgr2=0x7f03c0145220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c00d1b30 0x7f03c0145220 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f03b801b050 tx=0x7f03b8019740 comp rx=0 tx=0).stop 2023-09-13T06:03:59.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 -- 172.21.15.130:0/3583612332 shutdown_connections 2023-09-13T06:03:59.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f03a4065b50 0x7f03a4068010 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c00d1b30 0x7f03c0145220 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03c00d1750 0x7f03c00c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 --2- 172.21.15.130:0/3583612332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03c00d1090 0x7f03c013ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 -- 172.21.15.130:0/3583612332 >> 172.21.15.130:0/3583612332 conn(0x7f03c006f170 msgr2=0x7f03c01431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:59.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 -- 172.21.15.130:0/3583612332 shutdown_connections 2023-09-13T06:03:59.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.070+0000 7f03c7d2c640 1 -- 172.21.15.130:0/3583612332 wait complete. 2023-09-13T06:03:59.089 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T06:03:59.090 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:03:59.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe918e9c640 1 Processor -- start 2023-09-13T06:03:59.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe918e9c640 1 -- start start 2023-09-13T06:03:59.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe918e9c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe9140ce7b0 0x7fe9140cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe918e9c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9140ccfd0 con 0x7fe914159f20 2023-09-13T06:03:59.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe918e9c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9140ced90 con 0x7fe9140b1d20 2023-09-13T06:03:59.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe918e9c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9140b00f0 con 0x7fe9140ce7b0 2023-09-13T06:03:59.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe91259c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe914159f20 0x7fe9140b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:52714/0 (socket says 172.21.15.130:52714) 2023-09-13T06:03:59.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe91259c640 1 -- 172.21.15.130:0/4204966743 learned_addr learned my addr 172.21.15.130:0/4204966743 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:59.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe912d9d640 1 --2- 172.21.15.130:0/4204966743 >> v2:172.21.15.164:3300/0 conn(0x7fe9140ce7b0 0x7fe9140cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791765458 0 0) 0x7fe9140ccfd0 con 0x7fe914159f20 2023-09-13T06:03:59.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f4003530 con 0x7fe914159f20 2023-09-13T06:03:59.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 876696211 0 0) 0x7fe8f4003530 con 0x7fe914159f20 2023-09-13T06:03:59.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 >> v2:172.21.15.164:3300/0 conn(0x7fe9140ce7b0 msgr2=0x7fe9140cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:59.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 --2- 172.21.15.130:0/4204966743 >> v2:172.21.15.164:3300/0 conn(0x7fe9140ce7b0 0x7fe9140cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 >> v1:172.21.15.164:6789/0 conn(0x7fe9140b1d20 legacy=0x7fe9140ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9140cd200 con 0x7fe914159f20 2023-09-13T06:03:59.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fe904001680 con 0x7fe914159f20 2023-09-13T06:03:59.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 >> v1:172.21.15.130:6789/0 conn(0x7fe914159f20 legacy=0x7fe9140b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f40039f0 0x7fe8f4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f40047d0 0x7fe8f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f4005200 0x7fe8f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f400c130 con 0x7fe8f4005200 2023-09-13T06:03:59.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f400c2a0 con 0x7fe8f40039f0 2023-09-13T06:03:59.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f400e670 con 0x7fe8f40047d0 2023-09-13T06:03:59.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe912d9d640 1 --2- 172.21.15.130:0/4204966743 >> v2:172.21.15.164:3300/0 conn(0x7fe9140ce7b0 0x7fe9140cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:59.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe91259c640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f40039f0 0x7fe8f4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe909d9b640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f40047d0 0x7fe8f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.226+0000 7fe912d9d640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f4005200 0x7fe8f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe91259c640 1 -- 172.21.15.130:0/4204966743 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f40047d0 msgr2=0x7fe8f4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:59.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe91259c640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f40047d0 0x7fe8f4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe91259c640 1 -- 172.21.15.130:0/4204966743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f4005200 msgr2=0x7fe8f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:59.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe91259c640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f4005200 0x7fe8f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe91259c640 1 -- 172.21.15.130:0/4204966743 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f4003530 con 0x7fe8f40039f0 2023-09-13T06:03:59.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe912d9d640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f4005200 0x7fe8f400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:59.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe909d9b640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f40047d0 0x7fe8f4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:03:59.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe912d9d640 1 -- 172.21.15.130:0/4204966743 reap_dead start 2023-09-13T06:03:59.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe91259c640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f40039f0 0x7fe8f4003e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe90400c1c0 tx=0x7fe90401f250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e247a8e0142c9ad server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:59.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9040a8e70 con 0x7fe8f40039f0 2023-09-13T06:03:59.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9040058e0 con 0x7fe8f40039f0 2023-09-13T06:03:59.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.230+0000 7fe911d9b640 1 -- 172.21.15.130:0/4204966743 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904005d10 con 0x7fe8f40039f0 2023-09-13T06:03:59.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 -- 172.21.15.130:0/4204966743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f40039f0 msgr2=0x7fe8f4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f40039f0 0x7fe8f4003e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe90400c1c0 tx=0x7fe90401f250 comp rx=0 tx=0).stop 2023-09-13T06:03:59.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 -- 172.21.15.130:0/4204966743 shutdown_connections 2023-09-13T06:03:59.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 --2- 172.21.15.130:0/4204966743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f40039f0 0x7fe8f4003e10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 -- 172.21.15.130:0/4204966743 >> 172.21.15.130:0/4204966743 conn(0x7fe914065990 msgr2=0x7fe914065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:59.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 -- 172.21.15.130:0/4204966743 shutdown_connections 2023-09-13T06:03:59.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 -- 172.21.15.130:0/4204966743 wait complete. 2023-09-13T06:03:59.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 Processor -- start 2023-09-13T06:03:59.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 -- start start 2023-09-13T06:03:59.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f40039f0 0x7fe914150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe914155190 0x7fe9140a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe914153de0 0x7fe914154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9141547b0 con 0x7fe8f40039f0 2023-09-13T06:03:59.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9141561a0 con 0x7fe914155190 2023-09-13T06:03:59.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe918e9c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe914155620 con 0x7fe914153de0 2023-09-13T06:03:59.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe91259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f40039f0 0x7fe914150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe91259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f40039f0 0x7fe914150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37372/0 (socket says 172.21.15.130:37372) 2023-09-13T06:03:59.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.234+0000 7fe91259c640 1 -- 172.21.15.130:0/1329446802 learned_addr learned my addr 172.21.15.130:0/1329446802 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:59.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe909d9b640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe914155190 0x7fe9140a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe912d9d640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe914153de0 0x7fe914154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe91259c640 1 -- 172.21.15.130:0/1329446802 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe914153de0 msgr2=0x7fe914154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe91259c640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe914153de0 0x7fe914154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe91259c640 1 -- 172.21.15.130:0/1329446802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe914155190 msgr2=0x7fe9140a8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe91259c640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe914155190 0x7fe9140a8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe91259c640 1 -- 172.21.15.130:0/1329446802 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914155900 con 0x7fe8f40039f0 2023-09-13T06:03:59.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe91259c640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f40039f0 0x7fe914150de0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe90400c1c0 tx=0x7fe8f4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:59.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe90b7fe640 1 -- 172.21.15.130:0/1329446802 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9040b7070 con 0x7fe8f40039f0 2023-09-13T06:03:59.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe90b7fe640 1 -- 172.21.15.130:0/1329446802 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe904005b10 con 0x7fe8f40039f0 2023-09-13T06:03:59.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe90b7fe640 1 -- 172.21.15.130:0/1329446802 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904005e80 con 0x7fe8f40039f0 2023-09-13T06:03:59.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe918e9c640 1 -- 172.21.15.130:0/1329446802 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe914155be0 con 0x7fe8f40039f0 2023-09-13T06:03:59.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe918e9c640 1 -- 172.21.15.130:0/1329446802 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe914151320 con 0x7fe8f40039f0 2023-09-13T06:03:59.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe918e9c640 1 -- 172.21.15.130:0/1329446802 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9140ab260 con 0x7fe8f40039f0 2023-09-13T06:03:59.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.238+0000 7fe90b7fe640 1 -- 172.21.15.130:0/1329446802 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe904007110 con 0x7fe8f40039f0 2023-09-13T06:03:59.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.242+0000 7fe90b7fe640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8f8065b20 0x7fe8f8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.242+0000 7fe90b7fe640 1 -- 172.21.15.130:0/1329446802 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe904120290 con 0x7fe8f40039f0 2023-09-13T06:03:59.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.242+0000 7fe909d9b640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8f8065b20 0x7fe8f8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.242+0000 7fe909d9b640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8f8065b20 0x7fe8f8067fe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe9140af6d0 tx=0x7fe8fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:59.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.246+0000 7fe90b7fe640 1 -- 172.21.15.130:0/1329446802 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe9040edd20 con 0x7fe8f40039f0 2023-09-13T06:03:59.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.390+0000 7fe918e9c640 1 -- 172.21.15.130:0/1329446802 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9140cd7c0 con 0x7fe8f8065b20 2023-09-13T06:03:59.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.398+0000 7fe90b7fe640 1 -- 172.21.15.130:0/1329446802 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285181 (secure 0 0 0) 0x7fe8fc012900 con 0x7fe8f8065b20 2023-09-13T06:03:59.405 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:59.407 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:03:59.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 -- 172.21.15.130:0/1329446802 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8f8065b20 msgr2=0x7fe8f8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8f8065b20 0x7fe8f8067fe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe9140af6d0 tx=0x7fe8fc009040 comp rx=0 tx=0).stop 2023-09-13T06:03:59.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 -- 172.21.15.130:0/1329446802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f40039f0 msgr2=0x7fe914150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f40039f0 0x7fe914150de0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe90400c1c0 tx=0x7fe8f4005800 comp rx=0 tx=0).stop 2023-09-13T06:03:59.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 -- 172.21.15.130:0/1329446802 shutdown_connections 2023-09-13T06:03:59.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8f8065b20 0x7fe8f8067fe0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe914155190 0x7fe9140a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe914153de0 0x7fe914154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 --2- 172.21.15.130:0/1329446802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f40039f0 0x7fe914150de0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 -- 172.21.15.130:0/1329446802 >> 172.21.15.130:0/1329446802 conn(0x7fe914065990 msgr2=0x7fe914070780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:59.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 -- 172.21.15.130:0/1329446802 shutdown_connections 2023-09-13T06:03:59.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.402+0000 7fe918e9c640 1 -- 172.21.15.130:0/1329446802 wait complete. 2023-09-13T06:03:59.423 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2023-09-13T06:03:58.566439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3774,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558725,"statfs":{"total":1600000000,"available":1596135196,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.236786"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.358173+0000","last_change":"2023-09-13T06:03:55.364897+0000","last_active":"2023-09-13T06:03:56.358173+0000","last_peered":"2023-09-13T06:03:56.358173+0000","last_clean":"2023-09-13T06:03:56.358173+0000","last_became_active":"2023-09-13T06:03:55.364685+0000","last_became_peered":"2023-09-13T06:03:55.364685+0000","last_unstale":"2023-09-13T06:03:56.358173+0000","last_undegraded":"2023-09-13T06:03:56.358173+0000","last_fullsized":"2023-09-13T06:03:56.358173+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:04.575080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515653+0000","last_change":"2023-09-13T06:03:55.365194+0000","last_active":"2023-09-13T06:03:56.515653+0000","last_peered":"2023-09-13T06:03:56.515653+0000","last_clean":"2023-09-13T06:03:56.515653+0000","last_became_active":"2023-09-13T06:03:55.364543+0000","last_became_peered":"2023-09-13T06:03:55.364543+0000","last_unstale":"2023-09-13T06:03:56.515653+0000","last_undegraded":"2023-09-13T06:03:56.515653+0000","last_fullsized":"2023-09-13T06:03:56.515653+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:13:36.674573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.356746+0000","last_change":"2023-09-13T06:03:55.361554+0000","last_active":"2023-09-13T06:03:56.356746+0000","last_peered":"2023-09-13T06:03:56.356746+0000","last_clean":"2023-09-13T06:03:56.356746+0000","last_became_active":"2023-09-13T06:03:55.360573+0000","last_became_peered":"2023-09-13T06:03:55.360573+0000","last_unstale":"2023-09-13T06:03:56.356746+0000","last_undegraded":"2023-09-13T06:03:56.356746+0000","last_fullsized":"2023-09-13T06:03:56.356746+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:38:30.360308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514360+0000","last_change":"2023-09-13T06:03:55.370629+0000","last_active":"2023-09-13T06:03:56.514360+0000","last_peered":"2023-09-13T06:03:56.514360+0000","last_clean":"2023-09-13T06:03:56.514360+0000","last_became_active":"2023-09-13T06:03:55.369000+0000","last_became_peered":"2023-09-13T06:03:55.369000+0000","last_unstale":"2023-09-13T06:03:56.514360+0000","last_undegraded":"2023-09-13T06:03:56.514360+0000","last_fullsized":"2023-09-13T06:03:56.514360+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:30.219615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.358421+0000","last_change":"2023-09-13T06:03:55.368655+0000","last_active":"2023-09-13T06:03:56.358421+0000","last_peered":"2023-09-13T06:03:56.358421+0000","last_clean":"2023-09-13T06:03:56.358421+0000","last_became_active":"2023-09-13T06:03:55.367785+0000","last_became_peered":"2023-09-13T06:03:55.367785+0000","last_unstale":"2023-09-13T06:03:56.358421+0000","last_undegraded":"2023-09-13T06:03:56.358421+0000","last_fullsized":"2023-09-13T06:03:56.358421+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:07:16.209430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357615+0000","last_change":"2023-09-13T06:03:55.363267+0000","last_active":"2023-09-13T06:03:56.357615+0000","last_peered":"2023-09-13T06:03:56.357615+0000","last_clean":"2023-09-13T06:03:56.357615+0000","last_became_active":"2023-09-13T06:03:55.363039+0000","last_became_peered":"2023-09-13T06:03:55.363039+0000","last_unstale":"2023-09-13T06:03:56.357615+0000","last_undegraded":"2023-09-13T06:03:56.357615+0000","last_fullsized":"2023-09-13T06:03:56.357615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:53:21.634196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514413+0000","last_change":"2023-09-13T06:03:55.367231+0000","last_active":"2023-09-13T06:03:56.514413+0000","last_peered":"2023-09-13T06:03:56.514413+0000","last_clean":"2023-09-13T06:03:56.514413+0000","last_became_active":"2023-09-13T06:03:55.366961+0000","last_became_peered":"2023-09-13T06:03:55.366961+0000","last_unstale":"2023-09-13T06:03:56.514413+0000","last_undegraded":"2023-09-13T06:03:56.514413+0000","last_fullsized":"2023-09-13T06:03:56.514413+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:59:43.710764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515323+0000","last_change":"2023-09-13T06:03:55.369772+0000","last_active":"2023-09-13T06:03:56.515323+0000","last_peered":"2023-09-13T06:03:56.515323+0000","last_clean":"2023-09-13T06:03:56.515323+0000","last_became_active":"2023-09-13T06:03:55.369376+0000","last_became_peered":"2023-09-13T06:03:55.369376+0000","last_unstale":"2023-09-13T06:03:56.515323+0000","last_undegraded":"2023-09-13T06:03:56.515323+0000","last_fullsized":"2023-09-13T06:03:56.515323+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:57:15.112606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514295+0000","last_change":"2023-09-13T06:03:55.369259+0000","last_active":"2023-09-13T06:03:56.514295+0000","last_peered":"2023-09-13T06:03:56.514295+0000","last_clean":"2023-09-13T06:03:56.514295+0000","last_became_active":"2023-09-13T06:03:55.368967+0000","last_became_peered":"2023-09-13T06:03:55.368967+0000","last_unstale":"2023-09-13T06:03:56.514295+0000","last_undegraded":"2023-09-13T06:03:56.514295+0000","last_fullsized":"2023-09-13T06:03:56.514295+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:27:57.144390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515216+0000","last_change":"2023-09-13T06:03:55.367884+0000","last_active":"2023-09-13T06:03:56.515216+0000","last_peered":"2023-09-13T06:03:56.515216+0000","last_clean":"2023-09-13T06:03:56.515216+0000","last_became_active":"2023-09-13T06:03:55.367665+0000","last_became_peered":"2023-09-13T06:03:55.367665+0000","last_unstale":"2023-09-13T06:03:56.515216+0000","last_undegraded":"2023-09-13T06:03:56.515216+0000","last_fullsized":"2023-09-13T06:03:56.515216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:45:27.719801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515431+0000","last_change":"2023-09-13T06:03:55.364889+0000","last_active":"2023-09-13T06:03:56.515431+0000","last_peered":"2023-09-13T06:03:56.515431+0000","last_clean":"2023-09-13T06:03:56.515431+0000","last_became_active":"2023-09-13T06:03:55.363489+0000","last_became_peered":"2023-09-13T06:03:55.363489+0000","last_unstale":"2023-09-13T06:03:56.515431+0000","last_undegraded":"2023-09-13T06:03:56.515431+0000","last_fullsized":"2023-09-13T06:03:56.515431+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:38:18.216737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514658+0000","last_change":"2023-09-13T06:03:55.370686+0000","last_active":"2023-09-13T06:03:56.514658+0000","last_peered":"2023-09-13T06:03:56.514658+0000","last_clean":"2023-09-13T06:03:56.514658+0000","last_became_active":"2023-09-13T06:03:55.370470+0000","last_became_peered":"2023-09-13T06:03:55.370470+0000","last_unstale":"2023-09-13T06:03:56.514658+0000","last_undegraded":"2023-09-13T06:03:56.514658+0000","last_fullsized":"2023-09-13T06:03:56.514658+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:29:41.546213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514371+0000","last_change":"2023-09-13T06:03:55.368240+0000","last_active":"2023-09-13T06:03:56.514371+0000","last_peered":"2023-09-13T06:03:56.514371+0000","last_clean":"2023-09-13T06:03:56.514371+0000","last_became_active":"2023-09-13T06:03:55.367902+0000","last_became_peered":"2023-09-13T06:03:55.367902+0000","last_unstale":"2023-09-13T06:03:56.514371+0000","last_undegraded":"2023-09-13T06:03:56.514371+0000","last_fullsized":"2023-09-13T06:03:56.514371+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:53.669418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514430+0000","last_change":"2023-09-13T06:03:55.362625+0000","last_active":"2023-09-13T06:03:56.514430+0000","last_peered":"2023-09-13T06:03:56.514430+0000","last_clean":"2023-09-13T06:03:56.514430+0000","last_became_active":"2023-09-13T06:03:55.362382+0000","last_became_peered":"2023-09-13T06:03:55.362382+0000","last_unstale":"2023-09-13T06:03:56.514430+0000","last_undegraded":"2023-09-13T06:03:56.514430+0000","last_fullsized":"2023-09-13T06:03:56.514430+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:59:25.429399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515061+0000","last_change":"2023-09-13T06:03:55.363826+0000","last_active":"2023-09-13T06:03:56.515061+0000","last_peered":"2023-09-13T06:03:56.515061+0000","last_clean":"2023-09-13T06:03:56.515061+0000","last_became_active":"2023-09-13T06:03:55.363510+0000","last_became_peered":"2023-09-13T06:03:55.363510+0000","last_unstale":"2023-09-13T06:03:56.515061+0000","last_undegraded":"2023-09-13T06:03:56.515061+0000","last_fullsized":"2023-09-13T06:03:56.515061+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:04:26.698124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357805+0000","last_change":"2023-09-13T06:03:55.366707+0000","last_active":"2023-09-13T06:03:56.357805+0000","last_peered":"2023-09-13T06:03:56.357805+0000","last_clean":"2023-09-13T06:03:56.357805+0000","last_became_active":"2023-09-13T06:03:55.366160+0000","last_became_peered":"2023-09-13T06:03:55.366160+0000","last_unstale":"2023-09-13T06:03:56.357805+0000","last_undegraded":"2023-09-13T06:03:56.357805+0000","last_fullsized":"2023-09-13T06:03:56.357805+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:22.911639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515784+0000","last_change":"2023-09-13T06:03:55.370222+0000","last_active":"2023-09-13T06:03:56.515784+0000","last_peered":"2023-09-13T06:03:56.515784+0000","last_clean":"2023-09-13T06:03:56.515784+0000","last_became_active":"2023-09-13T06:03:55.368299+0000","last_became_peered":"2023-09-13T06:03:55.368299+0000","last_unstale":"2023-09-13T06:03:56.515784+0000","last_undegraded":"2023-09-13T06:03:56.515784+0000","last_fullsized":"2023-09-13T06:03:56.515784+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:09:22.244653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.356925+0000","last_change":"2023-09-13T06:03:55.361725+0000","last_active":"2023-09-13T06:03:56.356925+0000","last_peered":"2023-09-13T06:03:56.356925+0000","last_clean":"2023-09-13T06:03:56.356925+0000","last_became_active":"2023-09-13T06:03:55.360908+0000","last_became_peered":"2023-09-13T06:03:55.360908+0000","last_unstale":"2023-09-13T06:03:56.356925+0000","last_undegraded":"2023-09-13T06:03:56.356925+0000","last_fullsized":"2023-09-13T06:03:56.356925+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:53:21.634196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357998+0000","last_change":"2023-09-13T06:03:55.368014+0000","last_active":"2023-09-13T06:03:56.357998+0000","last_peered":"2023-09-13T06:03:56.357998+0000","last_clean":"2023-09-13T06:03:56.357998+0000","last_became_active":"2023-09-13T06:03:55.367416+0000","last_became_peered":"2023-09-13T06:03:55.367416+0000","last_unstale":"2023-09-13T06:03:56.357998+0000","last_undegraded":"2023-09-13T06:03:56.357998+0000","last_fullsized":"2023-09-13T06:03:56.357998+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:12.395910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515774+0000","last_change":"2023-09-13T06:03:55.367646+0000","last_active":"2023-09-13T06:03:56.515774+0000","last_peered":"2023-09-13T06:03:56.515774+0000","last_clean":"2023-09-13T06:03:56.515774+0000","last_became_active":"2023-09-13T06:03:55.367387+0000","last_became_peered":"2023-09-13T06:03:55.367387+0000","last_unstale":"2023-09-13T06:03:56.515774+0000","last_undegraded":"2023-09-13T06:03:56.515774+0000","last_fullsized":"2023-09-13T06:03:56.515774+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:31:27.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.356756+0000","last_change":"2023-09-13T06:03:55.374404+0000","last_active":"2023-09-13T06:03:56.356756+0000","last_peered":"2023-09-13T06:03:56.356756+0000","last_clean":"2023-09-13T06:03:56.356756+0000","last_became_active":"2023-09-13T06:03:55.374088+0000","last_became_peered":"2023-09-13T06:03:55.374088+0000","last_unstale":"2023-09-13T06:03:56.356756+0000","last_undegraded":"2023-09-13T06:03:56.356756+0000","last_fullsized":"2023-09-13T06:03:56.356756+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:27.714952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515905+0000","last_change":"2023-09-13T06:03:55.365068+0000","last_active":"2023-09-13T06:03:56.515905+0000","last_peered":"2023-09-13T06:03:56.515905+0000","last_clean":"2023-09-13T06:03:56.515905+0000","last_became_active":"2023-09-13T06:03:55.364220+0000","last_became_peered":"2023-09-13T06:03:55.364220+0000","last_unstale":"2023-09-13T06:03:56.515905+0000","last_undegraded":"2023-09-13T06:03:56.515905+0000","last_fullsized":"2023-09-13T06:03:56.515905+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:02:42.559094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357064+0000","last_change":"2023-09-13T06:03:55.361898+0000","last_active":"2023-09-13T06:03:56.357064+0000","last_peered":"2023-09-13T06:03:56.357064+0000","last_clean":"2023-09-13T06:03:56.357064+0000","last_became_active":"2023-09-13T06:03:55.361300+0000","last_became_peered":"2023-09-13T06:03:55.361300+0000","last_unstale":"2023-09-13T06:03:56.357064+0000","last_undegraded":"2023-09-13T06:03:56.357064+0000","last_fullsized":"2023-09-13T06:03:56.357064+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:20:18.106857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514296+0000","last_change":"2023-09-13T06:03:55.366617+0000","last_active":"2023-09-13T06:03:56.514296+0000","last_peered":"2023-09-13T06:03:56.514296+0000","last_clean":"2023-09-13T06:03:56.514296+0000","last_became_active":"2023-09-13T06:03:55.366402+0000","last_became_peered":"2023-09-13T06:03:55.366402+0000","last_unstale":"2023-09-13T06:03:56.514296+0000","last_undegraded":"2023-09-13T06:03:56.514296+0000","last_fullsized":"2023-09-13T06:03:56.514296+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:02:01.941487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.358536+0000","last_change":"2023-09-13T06:03:55.363858+0000","last_active":"2023-09-13T06:03:56.358536+0000","last_peered":"2023-09-13T06:03:56.358536+0000","last_clean":"2023-09-13T06:03:56.358536+0000","last_became_active":"2023-09-13T06:03:55.363632+0000","last_became_peered":"2023-09-13T06:03:55.363632+0000","last_unstale":"2023-09-13T06:03:56.358536+0000","last_undegraded":"2023-09-13T06:03:56.358536+0000","last_fullsized":"2023-09-13T06:03:56.358536+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:15:59.526873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514387+0000","last_change":"2023-09-13T06:03:55.374761+0000","last_active":"2023-09-13T06:03:56.514387+0000","last_peered":"2023-09-13T06:03:56.514387+0000","last_clean":"2023-09-13T06:03:56.514387+0000","last_became_active":"2023-09-13T06:03:55.372313+0000","last_became_peered":"2023-09-13T06:03:55.372313+0000","last_unstale":"2023-09-13T06:03:56.514387+0000","last_undegraded":"2023-09-13T06:03:56.514387+0000","last_fullsized":"2023-09-13T06:03:56.514387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:40:11.550968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357341+0000","last_change":"2023-09-13T06:03:55.365731+0000","last_active":"2023-09-13T06:03:56.357341+0000","last_peered":"2023-09-13T06:03:56.357341+0000","last_clean":"2023-09-13T06:03:56.357341+0000","last_became_active":"2023-09-13T06:03:55.365455+0000","last_became_peered":"2023-09-13T06:03:55.365455+0000","last_unstale":"2023-09-13T06:03:56.357341+0000","last_undegraded":"2023-09-13T06:03:56.357341+0000","last_fullsized":"2023-09-13T06:03:56.357341+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:20:15.890045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.358180+0000","last_change":"2023-09-13T06:03:55.370774+0000","last_active":"2023-09-13T06:03:56.358180+0000","last_peered":"2023-09-13T06:03:56.358180+0000","last_clean":"2023-09-13T06:03:56.358180+0000","last_became_active":"2023-09-13T06:03:55.370498+0000","last_became_peered":"2023-09-13T06:03:55.370498+0000","last_unstale":"2023-09-13T06:03:56.358180+0000","last_undegraded":"2023-09-13T06:03:56.358180+0000","last_fullsized":"2023-09-13T06:03:56.358180+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:47.359063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515009+0000","last_change":"2023-09-13T06:03:55.371985+0000","last_active":"2023-09-13T06:03:56.515009+0000","last_peered":"2023-09-13T06:03:56.515009+0000","last_clean":"2023-09-13T06:03:56.515009+0000","last_became_active":"2023-09-13T06:03:55.371743+0000","last_became_peered":"2023-09-13T06:03:55.371743+0000","last_unstale":"2023-09-13T06:03:56.515009+0000","last_undegraded":"2023-09-13T06:03:56.515009+0000","last_fullsized":"2023-09-13T06:03:56.515009+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:02:11.069093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357010+0000","last_change":"2023-09-13T06:03:55.361702+0000","last_active":"2023-09-13T06:03:56.357010+0000","last_peered":"2023-09-13T06:03:56.357010+0000","last_clean":"2023-09-13T06:03:56.357010+0000","last_became_active":"2023-09-13T06:03:55.361130+0000","last_became_peered":"2023-09-13T06:03:55.361130+0000","last_unstale":"2023-09-13T06:03:56.357010+0000","last_undegraded":"2023-09-13T06:03:56.357010+0000","last_fullsized":"2023-09-13T06:03:56.357010+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:11:00.009244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.358265+0000","last_change":"2023-09-13T06:03:55.367055+0000","last_active":"2023-09-13T06:03:56.358265+0000","last_peered":"2023-09-13T06:03:56.358265+0000","last_clean":"2023-09-13T06:03:56.358265+0000","last_became_active":"2023-09-13T06:03:55.366753+0000","last_became_peered":"2023-09-13T06:03:55.366753+0000","last_unstale":"2023-09-13T06:03:56.358265+0000","last_undegraded":"2023-09-13T06:03:56.358265+0000","last_fullsized":"2023-09-13T06:03:56.358265+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:43:37.699879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357469+0000","last_change":"2023-09-13T06:03:55.372270+0000","last_active":"2023-09-13T06:03:56.357469+0000","last_peered":"2023-09-13T06:03:56.357469+0000","last_clean":"2023-09-13T06:03:56.357469+0000","last_became_active":"2023-09-13T06:03:55.371989+0000","last_became_peered":"2023-09-13T06:03:55.371989+0000","last_unstale":"2023-09-13T06:03:56.357469+0000","last_undegraded":"2023-09-13T06:03:56.357469+0000","last_fullsized":"2023-09-13T06:03:56.357469+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:27.714952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357422+0000","last_change":"2023-09-13T06:03:55.362024+0000","last_active":"2023-09-13T06:03:56.357422+0000","last_peered":"2023-09-13T06:03:56.357422+0000","last_clean":"2023-09-13T06:03:56.357422+0000","last_became_active":"2023-09-13T06:03:55.361797+0000","last_became_peered":"2023-09-13T06:03:55.361797+0000","last_unstale":"2023-09-13T06:03:56.357422+0000","last_undegraded":"2023-09-13T06:03:56.357422+0000","last_fullsized":"2023-09-13T06:03:56.357422+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:38:30.360308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"64'4","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.383532+0000","last_change":"2023-09-13T06:03:54.344957+0000","last_active":"2023-09-13T06:03:55.383532+0000","last_peered":"2023-09-13T06:03:55.383532+0000","last_clean":"2023-09-13T06:03:55.383532+0000","last_became_active":"2023-09-13T06:03:54.344643+0000","last_became_peered":"2023-09-13T06:03:54.344643+0000","last_unstale":"2023-09-13T06:03:55.383532+0000","last_undegraded":"2023-09-13T06:03:55.383532+0000","last_fullsized":"2023-09-13T06:03:55.383532+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:40:10.543874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515110+0000","last_change":"2023-09-13T06:03:55.364320+0000","last_active":"2023-09-13T06:03:56.515110+0000","last_peered":"2023-09-13T06:03:56.515110+0000","last_clean":"2023-09-13T06:03:56.515110+0000","last_became_active":"2023-09-13T06:03:55.364075+0000","last_became_peered":"2023-09-13T06:03:55.364075+0000","last_unstale":"2023-09-13T06:03:56.515110+0000","last_undegraded":"2023-09-13T06:03:56.515110+0000","last_fullsized":"2023-09-13T06:03:56.515110+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:28:21.566684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381646+0000","last_change":"2023-09-13T06:03:54.341814+0000","last_active":"2023-09-13T06:03:55.381646+0000","last_peered":"2023-09-13T06:03:55.381646+0000","last_clean":"2023-09-13T06:03:55.381646+0000","last_became_active":"2023-09-13T06:03:54.341600+0000","last_became_peered":"2023-09-13T06:03:54.341600+0000","last_unstale":"2023-09-13T06:03:55.381646+0000","last_undegraded":"2023-09-13T06:03:55.381646+0000","last_fullsized":"2023-09-13T06:03:55.381646+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:38:26.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357925+0000","last_change":"2023-09-13T06:03:55.366906+0000","last_active":"2023-09-13T06:03:56.357925+0000","last_peered":"2023-09-13T06:03:56.357925+0000","last_clean":"2023-09-13T06:03:56.357925+0000","last_became_active":"2023-09-13T06:03:55.366480+0000","last_became_peered":"2023-09-13T06:03:55.366480+0000","last_unstale":"2023-09-13T06:03:56.357925+0000","last_undegraded":"2023-09-13T06:03:56.357925+0000","last_fullsized":"2023-09-13T06:03:56.357925+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:20:18.106857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.380843+0000","last_change":"2023-09-13T06:03:54.343948+0000","last_active":"2023-09-13T06:03:55.380843+0000","last_peered":"2023-09-13T06:03:55.380843+0000","last_clean":"2023-09-13T06:03:55.380843+0000","last_became_active":"2023-09-13T06:03:54.342820+0000","last_became_peered":"2023-09-13T06:03:54.342820+0000","last_unstale":"2023-09-13T06:03:55.380843+0000","last_undegraded":"2023-09-13T06:03:55.380843+0000","last_fullsized":"2023-09-13T06:03:55.380843+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:42:21.125876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357832+0000","last_change":"2023-09-13T06:03:55.370291+0000","last_active":"2023-09-13T06:03:56.357832+0000","last_peered":"2023-09-13T06:03:56.357832+0000","last_clean":"2023-09-13T06:03:56.357832+0000","last_became_active":"2023-09-13T06:03:55.369982+0000","last_became_peered":"2023-09-13T06:03:55.369982+0000","last_unstale":"2023-09-13T06:03:56.357832+0000","last_undegraded":"2023-09-13T06:03:56.357832+0000","last_fullsized":"2023-09-13T06:03:56.357832+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:11:00.009244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.383465+0000","last_change":"2023-09-13T06:03:54.339624+0000","last_active":"2023-09-13T06:03:55.383465+0000","last_peered":"2023-09-13T06:03:55.383465+0000","last_clean":"2023-09-13T06:03:55.383465+0000","last_became_active":"2023-09-13T06:03:54.338949+0000","last_became_peered":"2023-09-13T06:03:54.338949+0000","last_unstale":"2023-09-13T06:03:55.383465+0000","last_undegraded":"2023-09-13T06:03:55.383465+0000","last_fullsized":"2023-09-13T06:03:55.383465+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:21:12.757445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515513+0000","last_change":"2023-09-13T06:03:55.363892+0000","last_active":"2023-09-13T06:03:56.515513+0000","last_peered":"2023-09-13T06:03:56.515513+0000","last_clean":"2023-09-13T06:03:56.515513+0000","last_became_active":"2023-09-13T06:03:55.363541+0000","last_became_peered":"2023-09-13T06:03:55.363541+0000","last_unstale":"2023-09-13T06:03:56.515513+0000","last_undegraded":"2023-09-13T06:03:56.515513+0000","last_fullsized":"2023-09-13T06:03:56.515513+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:32:40.037687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381021+0000","last_change":"2023-09-13T06:03:54.340925+0000","last_active":"2023-09-13T06:03:55.381021+0000","last_peered":"2023-09-13T06:03:55.381021+0000","last_clean":"2023-09-13T06:03:55.381021+0000","last_became_active":"2023-09-13T06:03:54.340607+0000","last_became_peered":"2023-09-13T06:03:54.340607+0000","last_unstale":"2023-09-13T06:03:55.381021+0000","last_undegraded":"2023-09-13T06:03:55.381021+0000","last_fullsized":"2023-09-13T06:03:55.381021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:29.212522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.516013+0000","last_change":"2023-09-13T06:03:55.370406+0000","last_active":"2023-09-13T06:03:56.516013+0000","last_peered":"2023-09-13T06:03:56.516013+0000","last_clean":"2023-09-13T06:03:56.516013+0000","last_became_active":"2023-09-13T06:03:55.369666+0000","last_became_peered":"2023-09-13T06:03:55.369666+0000","last_unstale":"2023-09-13T06:03:56.516013+0000","last_undegraded":"2023-09-13T06:03:56.516013+0000","last_fullsized":"2023-09-13T06:03:56.516013+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:58:49.550750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.382393+0000","last_change":"2023-09-13T06:03:54.346119+0000","last_active":"2023-09-13T06:03:55.382393+0000","last_peered":"2023-09-13T06:03:55.382393+0000","last_clean":"2023-09-13T06:03:55.382393+0000","last_became_active":"2023-09-13T06:03:54.345575+0000","last_became_peered":"2023-09-13T06:03:54.345575+0000","last_unstale":"2023-09-13T06:03:55.382393+0000","last_undegraded":"2023-09-13T06:03:55.382393+0000","last_fullsized":"2023-09-13T06:03:55.382393+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:30:39.515879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515519+0000","last_change":"2023-09-13T06:03:55.366549+0000","last_active":"2023-09-13T06:03:56.515519+0000","last_peered":"2023-09-13T06:03:56.515519+0000","last_clean":"2023-09-13T06:03:56.515519+0000","last_became_active":"2023-09-13T06:03:55.366324+0000","last_became_peered":"2023-09-13T06:03:55.366324+0000","last_unstale":"2023-09-13T06:03:56.515519+0000","last_undegraded":"2023-09-13T06:03:56.515519+0000","last_fullsized":"2023-09-13T06:03:56.515519+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:35:59.747380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.366053+0000","last_change":"2023-09-13T06:03:54.340445+0000","last_active":"2023-09-13T06:03:55.366053+0000","last_peered":"2023-09-13T06:03:55.366053+0000","last_clean":"2023-09-13T06:03:55.366053+0000","last_became_active":"2023-09-13T06:03:54.340149+0000","last_became_peered":"2023-09-13T06:03:54.340149+0000","last_unstale":"2023-09-13T06:03:55.366053+0000","last_undegraded":"2023-09-13T06:03:55.366053+0000","last_fullsized":"2023-09-13T06:03:55.366053+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:33.969862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515135+0000","last_change":"2023-09-13T06:03:55.371507+0000","last_active":"2023-09-13T06:03:56.515135+0000","last_peered":"2023-09-13T06:03:56.515135+0000","last_clean":"2023-09-13T06:03:56.515135+0000","last_became_active":"2023-09-13T06:03:55.371162+0000","last_became_peered":"2023-09-13T06:03:55.371162+0000","last_unstale":"2023-09-13T06:03:56.515135+0000","last_undegraded":"2023-09-13T06:03:56.515135+0000","last_fullsized":"2023-09-13T06:03:56.515135+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:02:08.423077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.357525+0000","last_change":"2023-09-13T06:03:54.346403+0000","last_active":"2023-09-13T06:03:55.357525+0000","last_peered":"2023-09-13T06:03:55.357525+0000","last_clean":"2023-09-13T06:03:55.357525+0000","last_became_active":"2023-09-13T06:03:54.346110+0000","last_became_peered":"2023-09-13T06:03:54.346110+0000","last_unstale":"2023-09-13T06:03:55.357525+0000","last_undegraded":"2023-09-13T06:03:55.357525+0000","last_fullsized":"2023-09-13T06:03:55.357525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:05:58.863446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514644+0000","last_change":"2023-09-13T06:03:55.364585+0000","last_active":"2023-09-13T06:03:56.514644+0000","last_peered":"2023-09-13T06:03:56.514644+0000","last_clean":"2023-09-13T06:03:56.514644+0000","last_became_active":"2023-09-13T06:03:55.364344+0000","last_became_peered":"2023-09-13T06:03:55.364344+0000","last_unstale":"2023-09-13T06:03:56.514644+0000","last_undegraded":"2023-09-13T06:03:56.514644+0000","last_fullsized":"2023-09-13T06:03:56.514644+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:14.519561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.360423+0000","last_change":"2023-09-13T06:03:54.345832+0000","last_active":"2023-09-13T06:03:55.360423+0000","last_peered":"2023-09-13T06:03:55.360423+0000","last_clean":"2023-09-13T06:03:55.360423+0000","last_became_active":"2023-09-13T06:03:54.345000+0000","last_became_peered":"2023-09-13T06:03:54.345000+0000","last_unstale":"2023-09-13T06:03:55.360423+0000","last_undegraded":"2023-09-13T06:03:55.360423+0000","last_fullsized":"2023-09-13T06:03:55.360423+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:20:14.882952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.356993+0000","last_change":"2023-09-13T06:03:55.372148+0000","last_active":"2023-09-13T06:03:56.356993+0000","last_peered":"2023-09-13T06:03:56.356993+0000","last_clean":"2023-09-13T06:03:56.356993+0000","last_became_active":"2023-09-13T06:03:55.371096+0000","last_became_peered":"2023-09-13T06:03:55.371096+0000","last_unstale":"2023-09-13T06:03:56.356993+0000","last_undegraded":"2023-09-13T06:03:56.356993+0000","last_fullsized":"2023-09-13T06:03:56.356993+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:22.911639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.360023+0000","last_change":"2023-09-13T06:03:54.344789+0000","last_active":"2023-09-13T06:03:55.360023+0000","last_peered":"2023-09-13T06:03:55.360023+0000","last_clean":"2023-09-13T06:03:55.360023+0000","last_became_active":"2023-09-13T06:03:54.344031+0000","last_became_peered":"2023-09-13T06:03:54.344031+0000","last_unstale":"2023-09-13T06:03:55.360023+0000","last_undegraded":"2023-09-13T06:03:55.360023+0000","last_fullsized":"2023-09-13T06:03:55.360023+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:06:03.944618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515149+0000","last_change":"2023-09-13T06:03:55.362069+0000","last_active":"2023-09-13T06:03:56.515149+0000","last_peered":"2023-09-13T06:03:56.515149+0000","last_clean":"2023-09-13T06:03:56.515149+0000","last_became_active":"2023-09-13T06:03:55.361837+0000","last_became_peered":"2023-09-13T06:03:55.361837+0000","last_unstale":"2023-09-13T06:03:56.515149+0000","last_undegraded":"2023-09-13T06:03:56.515149+0000","last_fullsized":"2023-09-13T06:03:56.515149+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:59:14.322627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"64'3","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.384964+0000","last_change":"2023-09-13T06:03:54.341715+0000","last_active":"2023-09-13T06:03:55.384964+0000","last_peered":"2023-09-13T06:03:55.384964+0000","last_clean":"2023-09-13T06:03:55.384964+0000","last_became_active":"2023-09-13T06:03:54.341402+0000","last_became_peered":"2023-09-13T06:03:54.341402+0000","last_unstale":"2023-09-13T06:03:55.384964+0000","last_undegraded":"2023-09-13T06:03:55.384964+0000","last_fullsized":"2023-09-13T06:03:55.384964+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:50:22.948280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357215+0000","last_change":"2023-09-13T06:03:55.367232+0000","last_active":"2023-09-13T06:03:56.357215+0000","last_peered":"2023-09-13T06:03:56.357215+0000","last_clean":"2023-09-13T06:03:56.357215+0000","last_became_active":"2023-09-13T06:03:55.362201+0000","last_became_peered":"2023-09-13T06:03:55.362201+0000","last_unstale":"2023-09-13T06:03:56.357215+0000","last_undegraded":"2023-09-13T06:03:56.357215+0000","last_fullsized":"2023-09-13T06:03:56.357215+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:28:19.445704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"64'6","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.383941+0000","last_change":"2023-09-13T06:03:54.345253+0000","last_active":"2023-09-13T06:03:55.383941+0000","last_peered":"2023-09-13T06:03:55.383941+0000","last_clean":"2023-09-13T06:03:55.383941+0000","last_became_active":"2023-09-13T06:03:54.344933+0000","last_became_peered":"2023-09-13T06:03:54.344933+0000","last_unstale":"2023-09-13T06:03:55.383941+0000","last_undegraded":"2023-09-13T06:03:55.383941+0000","last_fullsized":"2023-09-13T06:03:55.383941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:46:22.745594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514527+0000","last_change":"2023-09-13T06:03:55.375102+0000","last_active":"2023-09-13T06:03:56.514527+0000","last_peered":"2023-09-13T06:03:56.514527+0000","last_clean":"2023-09-13T06:03:56.514527+0000","last_became_active":"2023-09-13T06:03:55.372635+0000","last_became_peered":"2023-09-13T06:03:55.372635+0000","last_unstale":"2023-09-13T06:03:56.514527+0000","last_undegraded":"2023-09-13T06:03:56.514527+0000","last_fullsized":"2023-09-13T06:03:56.514527+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:05:59.870540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381847+0000","last_change":"2023-09-13T06:03:54.344011+0000","last_active":"2023-09-13T06:03:55.381847+0000","last_peered":"2023-09-13T06:03:55.381847+0000","last_clean":"2023-09-13T06:03:55.381847+0000","last_became_active":"2023-09-13T06:03:54.343762+0000","last_became_peered":"2023-09-13T06:03:54.343762+0000","last_unstale":"2023-09-13T06:03:55.381847+0000","last_undegraded":"2023-09-13T06:03:55.381847+0000","last_fullsized":"2023-09-13T06:03:55.381847+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:42:52.290952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357230+0000","last_change":"2023-09-13T06:03:55.367370+0000","last_active":"2023-09-13T06:03:56.357230+0000","last_peered":"2023-09-13T06:03:56.357230+0000","last_clean":"2023-09-13T06:03:56.357230+0000","last_became_active":"2023-09-13T06:03:55.367103+0000","last_became_peered":"2023-09-13T06:03:55.367103+0000","last_unstale":"2023-09-13T06:03:56.357230+0000","last_undegraded":"2023-09-13T06:03:56.357230+0000","last_fullsized":"2023-09-13T06:03:56.357230+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:37.844088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.360896+0000","last_change":"2023-09-13T06:03:54.347550+0000","last_active":"2023-09-13T06:03:55.360896+0000","last_peered":"2023-09-13T06:03:55.360896+0000","last_clean":"2023-09-13T06:03:55.360896+0000","last_became_active":"2023-09-13T06:03:54.347324+0000","last_became_peered":"2023-09-13T06:03:54.347324+0000","last_unstale":"2023-09-13T06:03:55.360896+0000","last_undegraded":"2023-09-13T06:03:55.360896+0000","last_fullsized":"2023-09-13T06:03:55.360896+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:28:20.559591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514960+0000","last_change":"2023-09-13T06:03:55.367981+0000","last_active":"2023-09-13T06:03:56.514960+0000","last_peered":"2023-09-13T06:03:56.514960+0000","last_clean":"2023-09-13T06:03:56.514960+0000","last_became_active":"2023-09-13T06:03:55.367756+0000","last_became_peered":"2023-09-13T06:03:55.367756+0000","last_unstale":"2023-09-13T06:03:56.514960+0000","last_undegraded":"2023-09-13T06:03:56.514960+0000","last_fullsized":"2023-09-13T06:03:56.514960+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:50:23.955373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.365750+0000","last_change":"2023-09-13T06:03:54.339815+0000","last_active":"2023-09-13T06:03:55.365750+0000","last_peered":"2023-09-13T06:03:55.365750+0000","last_clean":"2023-09-13T06:03:55.365750+0000","last_became_active":"2023-09-13T06:03:54.339381+0000","last_became_peered":"2023-09-13T06:03:54.339381+0000","last_unstale":"2023-09-13T06:03:55.365750+0000","last_undegraded":"2023-09-13T06:03:55.365750+0000","last_fullsized":"2023-09-13T06:03:55.365750+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:39:43.561750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.356854+0000","last_change":"2023-09-13T06:03:55.364772+0000","last_active":"2023-09-13T06:03:56.356854+0000","last_peered":"2023-09-13T06:03:56.356854+0000","last_clean":"2023-09-13T06:03:56.356854+0000","last_became_active":"2023-09-13T06:03:55.364479+0000","last_became_peered":"2023-09-13T06:03:55.364479+0000","last_unstale":"2023-09-13T06:03:56.356854+0000","last_undegraded":"2023-09-13T06:03:56.356854+0000","last_fullsized":"2023-09-13T06:03:56.356854+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:35:09.768499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"64'8","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.384425+0000","last_change":"2023-09-13T06:03:54.344031+0000","last_active":"2023-09-13T06:03:55.384425+0000","last_peered":"2023-09-13T06:03:55.384425+0000","last_clean":"2023-09-13T06:03:55.384425+0000","last_became_active":"2023-09-13T06:03:54.343790+0000","last_became_peered":"2023-09-13T06:03:54.343790+0000","last_unstale":"2023-09-13T06:03:55.384425+0000","last_undegraded":"2023-09-13T06:03:55.384425+0000","last_fullsized":"2023-09-13T06:03:55.384425+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:42:21.125876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357377+0000","last_change":"2023-09-13T06:03:55.361874+0000","last_active":"2023-09-13T06:03:56.357377+0000","last_peered":"2023-09-13T06:03:56.357377+0000","last_clean":"2023-09-13T06:03:56.357377+0000","last_became_active":"2023-09-13T06:03:55.361465+0000","last_became_peered":"2023-09-13T06:03:55.361465+0000","last_unstale":"2023-09-13T06:03:56.357377+0000","last_undegraded":"2023-09-13T06:03:56.357377+0000","last_fullsized":"2023-09-13T06:03:56.357377+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:05:08.680418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381564+0000","last_change":"2023-09-13T06:03:54.342712+0000","last_active":"2023-09-13T06:03:55.381564+0000","last_peered":"2023-09-13T06:03:55.381564+0000","last_clean":"2023-09-13T06:03:55.381564+0000","last_became_active":"2023-09-13T06:03:54.342485+0000","last_became_peered":"2023-09-13T06:03:54.342485+0000","last_unstale":"2023-09-13T06:03:55.381564+0000","last_undegraded":"2023-09-13T06:03:55.381564+0000","last_fullsized":"2023-09-13T06:03:55.381564+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:15:40.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514504+0000","last_change":"2023-09-13T06:03:55.371041+0000","last_active":"2023-09-13T06:03:56.514504+0000","last_peered":"2023-09-13T06:03:56.514504+0000","last_clean":"2023-09-13T06:03:56.514504+0000","last_became_active":"2023-09-13T06:03:55.370320+0000","last_became_peered":"2023-09-13T06:03:55.370320+0000","last_unstale":"2023-09-13T06:03:56.514504+0000","last_undegraded":"2023-09-13T06:03:56.514504+0000","last_fullsized":"2023-09-13T06:03:56.514504+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:30:40.522973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381867+0000","last_change":"2023-09-13T06:03:54.344087+0000","last_active":"2023-09-13T06:03:55.381867+0000","last_peered":"2023-09-13T06:03:55.381867+0000","last_clean":"2023-09-13T06:03:55.381867+0000","last_became_active":"2023-09-13T06:03:54.343727+0000","last_became_peered":"2023-09-13T06:03:54.343727+0000","last_unstale":"2023-09-13T06:03:55.381867+0000","last_undegraded":"2023-09-13T06:03:55.381867+0000","last_fullsized":"2023-09-13T06:03:55.381867+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:34:22.289599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.516119+0000","last_change":"2023-09-13T06:03:55.370527+0000","last_active":"2023-09-13T06:03:56.516119+0000","last_peered":"2023-09-13T06:03:56.516119+0000","last_clean":"2023-09-13T06:03:56.516119+0000","last_became_active":"2023-09-13T06:03:55.369960+0000","last_became_peered":"2023-09-13T06:03:55.369960+0000","last_unstale":"2023-09-13T06:03:56.516119+0000","last_undegraded":"2023-09-13T06:03:56.516119+0000","last_fullsized":"2023-09-13T06:03:56.516119+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:08:38.645027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.383594+0000","last_change":"2023-09-13T06:03:54.339212+0000","last_active":"2023-09-13T06:03:55.383594+0000","last_peered":"2023-09-13T06:03:55.383594+0000","last_clean":"2023-09-13T06:03:55.383594+0000","last_became_active":"2023-09-13T06:03:54.338607+0000","last_became_peered":"2023-09-13T06:03:54.338607+0000","last_unstale":"2023-09-13T06:03:55.383594+0000","last_undegraded":"2023-09-13T06:03:55.383594+0000","last_fullsized":"2023-09-13T06:03:55.383594+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:40:13.058216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357125+0000","last_change":"2023-09-13T06:03:55.372313+0000","last_active":"2023-09-13T06:03:56.357125+0000","last_peered":"2023-09-13T06:03:56.357125+0000","last_clean":"2023-09-13T06:03:56.357125+0000","last_became_active":"2023-09-13T06:03:55.371422+0000","last_became_peered":"2023-09-13T06:03:55.371422+0000","last_unstale":"2023-09-13T06:03:56.357125+0000","last_undegraded":"2023-09-13T06:03:56.357125+0000","last_fullsized":"2023-09-13T06:03:56.357125+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:53:03.560536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.361030+0000","last_change":"2023-09-13T06:03:54.347391+0000","last_active":"2023-09-13T06:03:55.361030+0000","last_peered":"2023-09-13T06:03:55.361030+0000","last_clean":"2023-09-13T06:03:55.361030+0000","last_became_active":"2023-09-13T06:03:54.346938+0000","last_became_peered":"2023-09-13T06:03:54.346938+0000","last_unstale":"2023-09-13T06:03:55.361030+0000","last_undegraded":"2023-09-13T06:03:55.361030+0000","last_fullsized":"2023-09-13T06:03:55.361030+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:13.512467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514740+0000","last_change":"2023-09-13T06:03:55.370863+0000","last_active":"2023-09-13T06:03:56.514740+0000","last_peered":"2023-09-13T06:03:56.514740+0000","last_clean":"2023-09-13T06:03:56.514740+0000","last_became_active":"2023-09-13T06:03:55.369890+0000","last_became_peered":"2023-09-13T06:03:55.369890+0000","last_unstale":"2023-09-13T06:03:56.514740+0000","last_undegraded":"2023-09-13T06:03:56.514740+0000","last_fullsized":"2023-09-13T06:03:56.514740+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:46:23.752688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.382966+0000","last_change":"2023-09-13T06:03:54.344859+0000","last_active":"2023-09-13T06:03:55.382966+0000","last_peered":"2023-09-13T06:03:55.382966+0000","last_clean":"2023-09-13T06:03:55.382966+0000","last_became_active":"2023-09-13T06:03:54.344627+0000","last_became_peered":"2023-09-13T06:03:54.344627+0000","last_unstale":"2023-09-13T06:03:55.382966+0000","last_undegraded":"2023-09-13T06:03:55.382966+0000","last_fullsized":"2023-09-13T06:03:55.382966+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:05:07.673324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357353+0000","last_change":"2023-09-13T06:03:55.369470+0000","last_active":"2023-09-13T06:03:56.357353+0000","last_peered":"2023-09-13T06:03:56.357353+0000","last_clean":"2023-09-13T06:03:56.357353+0000","last_became_active":"2023-09-13T06:03:55.369217+0000","last_became_peered":"2023-09-13T06:03:55.369217+0000","last_unstale":"2023-09-13T06:03:56.357353+0000","last_undegraded":"2023-09-13T06:03:56.357353+0000","last_fullsized":"2023-09-13T06:03:56.357353+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:02:41.409105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.355534+0000","last_change":"2023-09-13T06:03:54.342844+0000","last_active":"2023-09-13T06:03:55.355534+0000","last_peered":"2023-09-13T06:03:55.355534+0000","last_clean":"2023-09-13T06:03:55.355534+0000","last_became_active":"2023-09-13T06:03:54.341855+0000","last_became_peered":"2023-09-13T06:03:54.341855+0000","last_unstale":"2023-09-13T06:03:55.355534+0000","last_undegraded":"2023-09-13T06:03:55.355534+0000","last_fullsized":"2023-09-13T06:03:55.355534+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:11:22.971909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357947+0000","last_change":"2023-09-13T06:03:55.368774+0000","last_active":"2023-09-13T06:03:56.357947+0000","last_peered":"2023-09-13T06:03:56.357947+0000","last_clean":"2023-09-13T06:03:56.357947+0000","last_became_active":"2023-09-13T06:03:55.368498+0000","last_became_peered":"2023-09-13T06:03:55.368498+0000","last_unstale":"2023-09-13T06:03:56.357947+0000","last_undegraded":"2023-09-13T06:03:56.357947+0000","last_fullsized":"2023-09-13T06:03:56.357947+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:53:03.560536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.372043+0000","last_change":"2023-09-13T06:03:54.347045+0000","last_active":"2023-09-13T06:03:55.372043+0000","last_peered":"2023-09-13T06:03:55.372043+0000","last_clean":"2023-09-13T06:03:55.372043+0000","last_became_active":"2023-09-13T06:03:54.346714+0000","last_became_peered":"2023-09-13T06:03:54.346714+0000","last_unstale":"2023-09-13T06:03:55.372043+0000","last_undegraded":"2023-09-13T06:03:55.372043+0000","last_fullsized":"2023-09-13T06:03:55.372043+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:43.058515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515280+0000","last_change":"2023-09-13T06:03:55.368467+0000","last_active":"2023-09-13T06:03:56.515280+0000","last_peered":"2023-09-13T06:03:56.515280+0000","last_clean":"2023-09-13T06:03:56.515280+0000","last_became_active":"2023-09-13T06:03:55.365961+0000","last_became_peered":"2023-09-13T06:03:55.365961+0000","last_unstale":"2023-09-13T06:03:56.515280+0000","last_undegraded":"2023-09-13T06:03:56.515280+0000","last_fullsized":"2023-09-13T06:03:56.515280+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:25:01.540741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381462+0000","last_change":"2023-09-13T06:03:54.342412+0000","last_active":"2023-09-13T06:03:55.381462+0000","last_peered":"2023-09-13T06:03:55.381462+0000","last_clean":"2023-09-13T06:03:55.381462+0000","last_became_active":"2023-09-13T06:03:54.342133+0000","last_became_peered":"2023-09-13T06:03:54.342133+0000","last_unstale":"2023-09-13T06:03:55.381462+0000","last_undegraded":"2023-09-13T06:03:55.381462+0000","last_fullsized":"2023-09-13T06:03:55.381462+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:15:58.519779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514823+0000","last_change":"2023-09-13T06:03:55.368665+0000","last_active":"2023-09-13T06:03:56.514823+0000","last_peered":"2023-09-13T06:03:56.514823+0000","last_clean":"2023-09-13T06:03:56.514823+0000","last_became_active":"2023-09-13T06:03:55.368427+0000","last_became_peered":"2023-09-13T06:03:55.368427+0000","last_unstale":"2023-09-13T06:03:56.514823+0000","last_undegraded":"2023-09-13T06:03:56.514823+0000","last_fullsized":"2023-09-13T06:03:56.514823+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:30:27.109145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.358102+0000","last_change":"2023-09-13T06:03:54.345970+0000","last_active":"2023-09-13T06:03:55.358102+0000","last_peered":"2023-09-13T06:03:55.358102+0000","last_clean":"2023-09-13T06:03:55.358102+0000","last_became_active":"2023-09-13T06:03:54.345190+0000","last_became_peered":"2023-09-13T06:03:54.345190+0000","last_unstale":"2023-09-13T06:03:55.358102+0000","last_undegraded":"2023-09-13T06:03:55.358102+0000","last_fullsized":"2023-09-13T06:03:55.358102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:29:40.539119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515339+0000","last_change":"2023-09-13T06:03:55.362752+0000","last_active":"2023-09-13T06:03:56.515339+0000","last_peered":"2023-09-13T06:03:56.515339+0000","last_clean":"2023-09-13T06:03:56.515339+0000","last_became_active":"2023-09-13T06:03:55.362536+0000","last_became_peered":"2023-09-13T06:03:55.362536+0000","last_unstale":"2023-09-13T06:03:56.515339+0000","last_undegraded":"2023-09-13T06:03:56.515339+0000","last_fullsized":"2023-09-13T06:03:56.515339+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:33:10.929698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.364855+0000","last_change":"2023-09-13T06:03:54.346351+0000","last_active":"2023-09-13T06:03:55.364855+0000","last_peered":"2023-09-13T06:03:55.364855+0000","last_clean":"2023-09-13T06:03:55.364855+0000","last_became_active":"2023-09-13T06:03:54.346125+0000","last_became_peered":"2023-09-13T06:03:54.346125+0000","last_unstale":"2023-09-13T06:03:55.364855+0000","last_undegraded":"2023-09-13T06:03:55.364855+0000","last_fullsized":"2023-09-13T06:03:55.364855+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:38:17.209644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357555+0000","last_change":"2023-09-13T06:03:55.375842+0000","last_active":"2023-09-13T06:03:56.357555+0000","last_peered":"2023-09-13T06:03:56.357555+0000","last_clean":"2023-09-13T06:03:56.357555+0000","last_became_active":"2023-09-13T06:03:55.375618+0000","last_became_peered":"2023-09-13T06:03:55.375618+0000","last_unstale":"2023-09-13T06:03:56.357555+0000","last_undegraded":"2023-09-13T06:03:56.357555+0000","last_fullsized":"2023-09-13T06:03:56.357555+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:35:09.768499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.364440+0000","last_change":"2023-09-13T06:03:54.338842+0000","last_active":"2023-09-13T06:03:55.364440+0000","last_peered":"2023-09-13T06:03:55.364440+0000","last_clean":"2023-09-13T06:03:55.364440+0000","last_became_active":"2023-09-13T06:03:54.338585+0000","last_became_peered":"2023-09-13T06:03:54.338585+0000","last_unstale":"2023-09-13T06:03:55.364440+0000","last_undegraded":"2023-09-13T06:03:55.364440+0000","last_fullsized":"2023-09-13T06:03:55.364440+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:58:05.145892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.516294+0000","last_change":"2023-09-13T06:03:55.365313+0000","last_active":"2023-09-13T06:03:56.516294+0000","last_peered":"2023-09-13T06:03:56.516294+0000","last_clean":"2023-09-13T06:03:56.516294+0000","last_became_active":"2023-09-13T06:03:55.364841+0000","last_became_peered":"2023-09-13T06:03:55.364841+0000","last_unstale":"2023-09-13T06:03:56.516294+0000","last_undegraded":"2023-09-13T06:03:56.516294+0000","last_fullsized":"2023-09-13T06:03:56.516294+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:09:48.240259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.355284+0000","last_change":"2023-09-13T06:03:54.339583+0000","last_active":"2023-09-13T06:03:55.355284+0000","last_peered":"2023-09-13T06:03:55.355284+0000","last_clean":"2023-09-13T06:03:55.355284+0000","last_became_active":"2023-09-13T06:03:54.338978+0000","last_became_peered":"2023-09-13T06:03:54.338978+0000","last_unstale":"2023-09-13T06:03:55.355284+0000","last_undegraded":"2023-09-13T06:03:55.355284+0000","last_fullsized":"2023-09-13T06:03:55.355284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:23:23.119259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357265+0000","last_change":"2023-09-13T06:03:55.372503+0000","last_active":"2023-09-13T06:03:56.357265+0000","last_peered":"2023-09-13T06:03:56.357265+0000","last_clean":"2023-09-13T06:03:56.357265+0000","last_became_active":"2023-09-13T06:03:55.371791+0000","last_became_peered":"2023-09-13T06:03:55.371791+0000","last_unstale":"2023-09-13T06:03:56.357265+0000","last_undegraded":"2023-09-13T06:03:56.357265+0000","last_fullsized":"2023-09-13T06:03:56.357265+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:42:53.298046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.357289+0000","last_change":"2023-09-13T06:03:54.344421+0000","last_active":"2023-09-13T06:03:55.357289+0000","last_peered":"2023-09-13T06:03:55.357289+0000","last_clean":"2023-09-13T06:03:55.357289+0000","last_became_active":"2023-09-13T06:03:54.343939+0000","last_became_peered":"2023-09-13T06:03:54.343939+0000","last_unstale":"2023-09-13T06:03:55.357289+0000","last_undegraded":"2023-09-13T06:03:55.357289+0000","last_fullsized":"2023-09-13T06:03:55.357289+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:40:10.543874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514931+0000","last_change":"2023-09-13T06:03:55.368615+0000","last_active":"2023-09-13T06:03:56.514931+0000","last_peered":"2023-09-13T06:03:56.514931+0000","last_clean":"2023-09-13T06:03:56.514931+0000","last_became_active":"2023-09-13T06:03:55.368306+0000","last_became_peered":"2023-09-13T06:03:55.368306+0000","last_unstale":"2023-09-13T06:03:56.514931+0000","last_undegraded":"2023-09-13T06:03:56.514931+0000","last_fullsized":"2023-09-13T06:03:56.514931+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:19:37.557793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.355355+0000","last_change":"2023-09-13T06:03:54.342100+0000","last_active":"2023-09-13T06:03:55.355355+0000","last_peered":"2023-09-13T06:03:55.355355+0000","last_clean":"2023-09-13T06:03:55.355355+0000","last_became_active":"2023-09-13T06:03:54.341856+0000","last_became_peered":"2023-09-13T06:03:54.341856+0000","last_unstale":"2023-09-13T06:03:55.355355+0000","last_undegraded":"2023-09-13T06:03:55.355355+0000","last_fullsized":"2023-09-13T06:03:55.355355+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:22:09.475291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515647+0000","last_change":"2023-09-13T06:03:55.369610+0000","last_active":"2023-09-13T06:03:56.515647+0000","last_peered":"2023-09-13T06:03:56.515647+0000","last_clean":"2023-09-13T06:03:56.515647+0000","last_became_active":"2023-09-13T06:03:55.369065+0000","last_became_peered":"2023-09-13T06:03:55.369065+0000","last_unstale":"2023-09-13T06:03:56.515647+0000","last_undegraded":"2023-09-13T06:03:56.515647+0000","last_fullsized":"2023-09-13T06:03:56.515647+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:34:46.212424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.360535+0000","last_change":"2023-09-13T06:03:54.349163+0000","last_active":"2023-09-13T06:03:55.360535+0000","last_peered":"2023-09-13T06:03:55.360535+0000","last_clean":"2023-09-13T06:03:55.360535+0000","last_became_active":"2023-09-13T06:03:54.348987+0000","last_became_peered":"2023-09-13T06:03:54.348987+0000","last_unstale":"2023-09-13T06:03:55.360535+0000","last_undegraded":"2023-09-13T06:03:55.360535+0000","last_fullsized":"2023-09-13T06:03:55.360535+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:01:35.045959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515902+0000","last_change":"2023-09-13T06:03:55.368807+0000","last_active":"2023-09-13T06:03:56.515902+0000","last_peered":"2023-09-13T06:03:56.515902+0000","last_clean":"2023-09-13T06:03:56.515902+0000","last_became_active":"2023-09-13T06:03:55.368589+0000","last_became_peered":"2023-09-13T06:03:55.368589+0000","last_unstale":"2023-09-13T06:03:56.515902+0000","last_undegraded":"2023-09-13T06:03:56.515902+0000","last_fullsized":"2023-09-13T06:03:56.515902+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:24:10.061467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.361442+0000","last_change":"2023-09-13T06:03:54.344752+0000","last_active":"2023-09-13T06:03:55.361442+0000","last_peered":"2023-09-13T06:03:55.361442+0000","last_clean":"2023-09-13T06:03:55.361442+0000","last_became_active":"2023-09-13T06:03:54.344320+0000","last_became_peered":"2023-09-13T06:03:54.344320+0000","last_unstale":"2023-09-13T06:03:55.361442+0000","last_undegraded":"2023-09-13T06:03:55.361442+0000","last_fullsized":"2023-09-13T06:03:55.361442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:59:13.315533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.356055+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:03:55.356055+0000","last_peered":"2023-09-13T06:03:55.356055+0000","last_clean":"2023-09-13T06:03:55.356055+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:03:55.356055+0000","last_undegraded":"2023-09-13T06:03:55.356055+0000","last_fullsized":"2023-09-13T06:03:55.356055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:14:08.145478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074566,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88800000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.752},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83499999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81200000000000006}]},{"osd":1,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.68999999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.875,"5min":1.05,"15min":1.05},"last":0.86399999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81699999999999995,"5min":1.395,"15min":1.395},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.85899999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89400000000000002,"5min":1.357,"15min":1.357},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.97599999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86399999999999999,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65900000000000003,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85899999999999999,"5min":1.018,"15min":1.018},"last":0.84399999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90800000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95099999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.94599999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.74399999999999999,"15min":0.752},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.875,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.77600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199665094,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":1.181,"15min":1.181},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55900000000000005}]},{"osd":1,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.85499999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.153,"15min":1.153},"last":0.625}]},{"osd":2,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96999999999999997,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88800000000000001,"5min":1.038,"15min":1.038},"last":0.73999999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90300000000000002,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.754},{"interface":"front","average":{"1min":0.749,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.038,"5min":1.526,"15min":1.526},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.63800000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.71499999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.50900000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.80400000000000005,"5min":0.878,"15min":0.878},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.55600000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0089999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.53700000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.74199999999999999,"15min":0.70999999999999996},"min":{"1min":0.54700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":4.3879999999999999,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.90700000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194984,"statfs":{"total":200000000,"available":199664442,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.874,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.65800000000000003,"15min":0.65000000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.59799999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.51300000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.74399999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69199999999999995,"15min":0.68700000000000006},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71299999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.78300000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.46300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.436}]},{"osd":6,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.48699999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82799999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85599999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66700000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72799999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86599999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.877,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":328,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194983,"statfs":{"total":200000000,"available":199663482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80300000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58599999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85499999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.75,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65800000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.873,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.83999999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.749}]},{"osd":3,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.54800000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.89200000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.71899999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85499999999999998,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.73199999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.61899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.01,"15min":1.01},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.80600000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.876,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89400000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.86299999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.53800000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89000000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.79200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199665038,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.54500000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42399999999999999,"15min":0.41999999999999998},"min":{"1min":0.35899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.37}]},{"osd":1,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.312},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66000000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.40200000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44800000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93600000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.70999999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54600000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.53700000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95399999999999996,"5min":1.111,"15min":1.111},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.86799999999999999,"5min":1.04,"15min":1.04},"last":0.5}]},{"osd":6,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.748,"15min":0.754},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.873,"5min":1.458,"15min":1.458},"last":0.53800000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90000000000000002,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.90500000000000003,"5min":1.27,"15min":1.27},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199665038,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.45100000000000001,"15min":0.40300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":10.401,"5min":10.401,"15min":10.401},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.45900000000000002,"15min":0.434},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.4429999999999996,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":0.46100000000000002}]},{"osd":1,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.47399999999999998,"15min":0.45400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":5.2640000000000002,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.47999999999999998,"15min":0.45800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.3369999999999997,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.0410000000000004,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.56899999999999995,"15min":0.54300000000000004},"min":{"1min":0.40300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":5.4809999999999999,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.626},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.78600000000000003,"15min":0.77200000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":4.0599999999999996,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.58999999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.81699999999999995,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":5.5289999999999999,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.746,"15min":0.72999999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.71899999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.54900000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.751,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":4.2400000000000002,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.56899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199665004,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.443,"15min":0.433},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.503},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28899999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.65900000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45000000000000001,"15min":0.45100000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.624}]},{"osd":3,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.505,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":4.0599999999999996,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80100000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.878,"5min":1.109,"15min":1.109},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.749},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1140000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76100000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.84099999999999997,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81699999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96999999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56999999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.88900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":905,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199072532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45800000000000002,"15min":0.45600000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.47499999999999998,"15min":0.46800000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.47099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.503,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.44900000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.73699999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.78300000000000003,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.70199999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.78200000000000003},"min":{"1min":0.55100000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":0.628},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.79200000000000004,"15min":0.78300000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.80700000000000005,"15min":0.80400000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.79300000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.67700000000000005}]}]}],"pool_statfs":[]}} 2023-09-13T06:03:59.431 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:03:59.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.602+0000 7fcc74ad8640 1 Processor -- start 2023-09-13T06:03:59.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc74ad8640 1 -- start start 2023-09-13T06:03:59.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc74ad8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcc700b04a0 0x7fcc700b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc74ad8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc700ccbe0 con 0x7fcc7015b130 2023-09-13T06:03:59.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc74ad8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc700ce980 con 0x7fcc700cc780 2023-09-13T06:03:59.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc74ad8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc700b0e50 con 0x7fcc700b04a0 2023-09-13T06:03:59.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc6e59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fcc7015b130 0x7fcc700ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:52726/0 (socket says 172.21.15.130:52726) 2023-09-13T06:03:59.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc6e59c640 1 -- 172.21.15.130:0/2318603312 learned_addr learned my addr 172.21.15.130:0/2318603312 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:59.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc6ed9d640 1 --2- 172.21.15.130:0/2318603312 >> v2:172.21.15.164:3300/0 conn(0x7fcc700b04a0 0x7fcc700b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc6dd9b640 1 -- 172.21.15.130:0/2318603312 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933174944 0 0) 0x7fcc700ccbe0 con 0x7fcc7015b130 2023-09-13T06:03:59.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc6dd9b640 1 -- 172.21.15.130:0/2318603312 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc5c003530 con 0x7fcc7015b130 2023-09-13T06:03:59.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc6dd9b640 1 -- 172.21.15.130:0/2318603312 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 905737219 0 0) 0x7fcc5c003530 con 0x7fcc7015b130 2023-09-13T06:03:59.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc6ed9d640 1 -- 172.21.15.130:0/2318603312 >> v1:172.21.15.164:6789/0 conn(0x7fcc700cc780 legacy=0x7fcc7015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc6ed9d640 1 -- 172.21.15.130:0/2318603312 >> v1:172.21.15.130:6789/0 conn(0x7fcc7015b130 legacy=0x7fcc700ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.606+0000 7fcc6ed9d640 1 -- 172.21.15.130:0/2318603312 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc700cec60 con 0x7fcc700b04a0 2023-09-13T06:03:59.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.610+0000 7fcc6ed9d640 1 --2- 172.21.15.130:0/2318603312 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700b04a0 0x7fcc700b0910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcc680097c0 tx=0x7fcc6801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f28818083fa716df server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:59.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.610+0000 7fcc6dd9b640 1 -- 172.21.15.130:0/2318603312 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc60001680 con 0x7fcc700b04a0 2023-09-13T06:03:59.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.610+0000 7fcc6dd9b640 1 -- 172.21.15.130:0/2318603312 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc680a7050 con 0x7fcc700b04a0 2023-09-13T06:03:59.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.610+0000 7fcc6dd9b640 1 -- 172.21.15.130:0/2318603312 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680ab620 con 0x7fcc700b04a0 2023-09-13T06:03:59.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.610+0000 7fcc74ad8640 1 -- 172.21.15.130:0/2318603312 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700b04a0 msgr2=0x7fcc700b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.610+0000 7fcc74ad8640 1 --2- 172.21.15.130:0/2318603312 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700b04a0 0x7fcc700b0910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcc680097c0 tx=0x7fcc6801c370 comp rx=0 tx=0).stop 2023-09-13T06:03:59.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.610+0000 7fcc74ad8640 1 -- 172.21.15.130:0/2318603312 shutdown_connections 2023-09-13T06:03:59.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.610+0000 7fcc74ad8640 1 --2- 172.21.15.130:0/2318603312 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700b04a0 0x7fcc700b0910 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.610+0000 7fcc74ad8640 1 -- 172.21.15.130:0/2318603312 >> 172.21.15.130:0/2318603312 conn(0x7fcc70065990 msgr2=0x7fcc70065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:59.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.610+0000 7fcc74ad8640 1 -- 172.21.15.130:0/2318603312 shutdown_connections 2023-09-13T06:03:59.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.610+0000 7fcc74ad8640 1 -- 172.21.15.130:0/2318603312 wait complete. 2023-09-13T06:03:59.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc74ad8640 1 Processor -- start 2023-09-13T06:03:59.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc74ad8640 1 -- start start 2023-09-13T06:03:59.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc74ad8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700b04a0 0x7fcc70070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc74ad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc700cc780 0x7fcc7014af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc74ad8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7015b130 0x7fcc70151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc74ad8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7014cc60 con 0x7fcc7015b130 2023-09-13T06:03:59.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc74ad8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7014d410 con 0x7fcc700b04a0 2023-09-13T06:03:59.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc74ad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc700aec60 con 0x7fcc700cc780 2023-09-13T06:03:59.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc6ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7015b130 0x7fcc70151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc6ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7015b130 0x7fcc70151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37384/0 (socket says 172.21.15.130:37384) 2023-09-13T06:03:59.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc6ed9d640 1 -- 172.21.15.130:0/155905634 learned_addr learned my addr 172.21.15.130:0/155905634 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:59.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc6e59c640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700b04a0 0x7fcc70070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc65d9b640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc700cc780 0x7fcc7014af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc6ed9d640 1 -- 172.21.15.130:0/155905634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc700cc780 msgr2=0x7fcc7014af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc6ed9d640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc700cc780 0x7fcc7014af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc6ed9d640 1 -- 172.21.15.130:0/155905634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700b04a0 msgr2=0x7fcc70070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc6ed9d640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700b04a0 0x7fcc70070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc6ed9d640 1 -- 172.21.15.130:0/155905634 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc68009420 con 0x7fcc7015b130 2023-09-13T06:03:59.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc6ed9d640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7015b130 0x7fcc70151760 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fcc680ae040 tx=0x7fcc6801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:59.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc677fe640 1 -- 172.21.15.130:0/155905634 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680abc70 con 0x7fcc7015b130 2023-09-13T06:03:59.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc677fe640 1 -- 172.21.15.130:0/155905634 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc680abdd0 con 0x7fcc7015b130 2023-09-13T06:03:59.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc677fe640 1 -- 172.21.15.130:0/155905634 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68004220 con 0x7fcc7015b130 2023-09-13T06:03:59.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc74ad8640 1 -- 172.21.15.130:0/155905634 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7014ce50 con 0x7fcc7015b130 2023-09-13T06:03:59.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.614+0000 7fcc74ad8640 1 -- 172.21.15.130:0/155905634 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc700ae8f0 con 0x7fcc7015b130 2023-09-13T06:03:59.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.618+0000 7fcc74ad8640 1 -- 172.21.15.130:0/155905634 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc700ae750 con 0x7fcc7015b130 2023-09-13T06:03:59.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.618+0000 7fcc677fe640 1 -- 172.21.15.130:0/155905634 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcc68004380 con 0x7fcc7015b130 2023-09-13T06:03:59.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.618+0000 7fcc677fe640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc50065b50 0x7fcc50068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.618+0000 7fcc677fe640 1 -- 172.21.15.130:0/155905634 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc6811d310 con 0x7fcc7015b130 2023-09-13T06:03:59.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.618+0000 7fcc6e59c640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc50065b50 0x7fcc50068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.618+0000 7fcc6e59c640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc50065b50 0x7fcc50068010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcc60000f70 tx=0x7fcc60001d70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:59.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.622+0000 7fcc677fe640 1 -- 172.21.15.130:0/155905634 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcc700ae750 con 0x7fcc7015b130 2023-09-13T06:03:59.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.766+0000 7fcc74ad8640 1 -- 172.21.15.130:0/155905634 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc7006cc00 con 0x7fcc50065b50 2023-09-13T06:03:59.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.774+0000 7fcc677fe640 1 -- 172.21.15.130:0/155905634 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285181 (secure 0 0 0) 0x7fcc6000f8e0 con 0x7fcc50065b50 2023-09-13T06:03:59.778 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:03:59.780 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:03:59.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 -- 172.21.15.130:0/155905634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc50065b50 msgr2=0x7fcc50068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc50065b50 0x7fcc50068010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcc60000f70 tx=0x7fcc60001d70 comp rx=0 tx=0).stop 2023-09-13T06:03:59.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 -- 172.21.15.130:0/155905634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7015b130 msgr2=0x7fcc70151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7015b130 0x7fcc70151760 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fcc680ae040 tx=0x7fcc6801abb0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 -- 172.21.15.130:0/155905634 shutdown_connections 2023-09-13T06:03:59.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc50065b50 0x7fcc50068010 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc7015b130 0x7fcc70151760 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc700cc780 0x7fcc7014af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 --2- 172.21.15.130:0/155905634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700b04a0 0x7fcc70070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 -- 172.21.15.130:0/155905634 >> 172.21.15.130:0/155905634 conn(0x7fcc70065990 msgr2=0x7fcc7015a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:59.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 -- 172.21.15.130:0/155905634 shutdown_connections 2023-09-13T06:03:59.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.778+0000 7fcc74ad8640 1 -- 172.21.15.130:0/155905634 wait complete. 2023-09-13T06:03:59.798 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2023-09-13T06:03:58.566439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3774,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558725,"statfs":{"total":1600000000,"available":1596135196,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.236786"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.358173+0000","last_change":"2023-09-13T06:03:55.364897+0000","last_active":"2023-09-13T06:03:56.358173+0000","last_peered":"2023-09-13T06:03:56.358173+0000","last_clean":"2023-09-13T06:03:56.358173+0000","last_became_active":"2023-09-13T06:03:55.364685+0000","last_became_peered":"2023-09-13T06:03:55.364685+0000","last_unstale":"2023-09-13T06:03:56.358173+0000","last_undegraded":"2023-09-13T06:03:56.358173+0000","last_fullsized":"2023-09-13T06:03:56.358173+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:04.575080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515653+0000","last_change":"2023-09-13T06:03:55.365194+0000","last_active":"2023-09-13T06:03:56.515653+0000","last_peered":"2023-09-13T06:03:56.515653+0000","last_clean":"2023-09-13T06:03:56.515653+0000","last_became_active":"2023-09-13T06:03:55.364543+0000","last_became_peered":"2023-09-13T06:03:55.364543+0000","last_unstale":"2023-09-13T06:03:56.515653+0000","last_undegraded":"2023-09-13T06:03:56.515653+0000","last_fullsized":"2023-09-13T06:03:56.515653+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:13:36.674573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.356746+0000","last_change":"2023-09-13T06:03:55.361554+0000","last_active":"2023-09-13T06:03:56.356746+0000","last_peered":"2023-09-13T06:03:56.356746+0000","last_clean":"2023-09-13T06:03:56.356746+0000","last_became_active":"2023-09-13T06:03:55.360573+0000","last_became_peered":"2023-09-13T06:03:55.360573+0000","last_unstale":"2023-09-13T06:03:56.356746+0000","last_undegraded":"2023-09-13T06:03:56.356746+0000","last_fullsized":"2023-09-13T06:03:56.356746+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:38:30.360308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514360+0000","last_change":"2023-09-13T06:03:55.370629+0000","last_active":"2023-09-13T06:03:56.514360+0000","last_peered":"2023-09-13T06:03:56.514360+0000","last_clean":"2023-09-13T06:03:56.514360+0000","last_became_active":"2023-09-13T06:03:55.369000+0000","last_became_peered":"2023-09-13T06:03:55.369000+0000","last_unstale":"2023-09-13T06:03:56.514360+0000","last_undegraded":"2023-09-13T06:03:56.514360+0000","last_fullsized":"2023-09-13T06:03:56.514360+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:30.219615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.358421+0000","last_change":"2023-09-13T06:03:55.368655+0000","last_active":"2023-09-13T06:03:56.358421+0000","last_peered":"2023-09-13T06:03:56.358421+0000","last_clean":"2023-09-13T06:03:56.358421+0000","last_became_active":"2023-09-13T06:03:55.367785+0000","last_became_peered":"2023-09-13T06:03:55.367785+0000","last_unstale":"2023-09-13T06:03:56.358421+0000","last_undegraded":"2023-09-13T06:03:56.358421+0000","last_fullsized":"2023-09-13T06:03:56.358421+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:07:16.209430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357615+0000","last_change":"2023-09-13T06:03:55.363267+0000","last_active":"2023-09-13T06:03:56.357615+0000","last_peered":"2023-09-13T06:03:56.357615+0000","last_clean":"2023-09-13T06:03:56.357615+0000","last_became_active":"2023-09-13T06:03:55.363039+0000","last_became_peered":"2023-09-13T06:03:55.363039+0000","last_unstale":"2023-09-13T06:03:56.357615+0000","last_undegraded":"2023-09-13T06:03:56.357615+0000","last_fullsized":"2023-09-13T06:03:56.357615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:53:21.634196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514413+0000","last_change":"2023-09-13T06:03:55.367231+0000","last_active":"2023-09-13T06:03:56.514413+0000","last_peered":"2023-09-13T06:03:56.514413+0000","last_clean":"2023-09-13T06:03:56.514413+0000","last_became_active":"2023-09-13T06:03:55.366961+0000","last_became_peered":"2023-09-13T06:03:55.366961+0000","last_unstale":"2023-09-13T06:03:56.514413+0000","last_undegraded":"2023-09-13T06:03:56.514413+0000","last_fullsized":"2023-09-13T06:03:56.514413+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:59:43.710764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515323+0000","last_change":"2023-09-13T06:03:55.369772+0000","last_active":"2023-09-13T06:03:56.515323+0000","last_peered":"2023-09-13T06:03:56.515323+0000","last_clean":"2023-09-13T06:03:56.515323+0000","last_became_active":"2023-09-13T06:03:55.369376+0000","last_became_peered":"2023-09-13T06:03:55.369376+0000","last_unstale":"2023-09-13T06:03:56.515323+0000","last_undegraded":"2023-09-13T06:03:56.515323+0000","last_fullsized":"2023-09-13T06:03:56.515323+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:57:15.112606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514295+0000","last_change":"2023-09-13T06:03:55.369259+0000","last_active":"2023-09-13T06:03:56.514295+0000","last_peered":"2023-09-13T06:03:56.514295+0000","last_clean":"2023-09-13T06:03:56.514295+0000","last_became_active":"2023-09-13T06:03:55.368967+0000","last_became_peered":"2023-09-13T06:03:55.368967+0000","last_unstale":"2023-09-13T06:03:56.514295+0000","last_undegraded":"2023-09-13T06:03:56.514295+0000","last_fullsized":"2023-09-13T06:03:56.514295+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:27:57.144390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515216+0000","last_change":"2023-09-13T06:03:55.367884+0000","last_active":"2023-09-13T06:03:56.515216+0000","last_peered":"2023-09-13T06:03:56.515216+0000","last_clean":"2023-09-13T06:03:56.515216+0000","last_became_active":"2023-09-13T06:03:55.367665+0000","last_became_peered":"2023-09-13T06:03:55.367665+0000","last_unstale":"2023-09-13T06:03:56.515216+0000","last_undegraded":"2023-09-13T06:03:56.515216+0000","last_fullsized":"2023-09-13T06:03:56.515216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:45:27.719801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515431+0000","last_change":"2023-09-13T06:03:55.364889+0000","last_active":"2023-09-13T06:03:56.515431+0000","last_peered":"2023-09-13T06:03:56.515431+0000","last_clean":"2023-09-13T06:03:56.515431+0000","last_became_active":"2023-09-13T06:03:55.363489+0000","last_became_peered":"2023-09-13T06:03:55.363489+0000","last_unstale":"2023-09-13T06:03:56.515431+0000","last_undegraded":"2023-09-13T06:03:56.515431+0000","last_fullsized":"2023-09-13T06:03:56.515431+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:38:18.216737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514658+0000","last_change":"2023-09-13T06:03:55.370686+0000","last_active":"2023-09-13T06:03:56.514658+0000","last_peered":"2023-09-13T06:03:56.514658+0000","last_clean":"2023-09-13T06:03:56.514658+0000","last_became_active":"2023-09-13T06:03:55.370470+0000","last_became_peered":"2023-09-13T06:03:55.370470+0000","last_unstale":"2023-09-13T06:03:56.514658+0000","last_undegraded":"2023-09-13T06:03:56.514658+0000","last_fullsized":"2023-09-13T06:03:56.514658+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:29:41.546213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514371+0000","last_change":"2023-09-13T06:03:55.368240+0000","last_active":"2023-09-13T06:03:56.514371+0000","last_peered":"2023-09-13T06:03:56.514371+0000","last_clean":"2023-09-13T06:03:56.514371+0000","last_became_active":"2023-09-13T06:03:55.367902+0000","last_became_peered":"2023-09-13T06:03:55.367902+0000","last_unstale":"2023-09-13T06:03:56.514371+0000","last_undegraded":"2023-09-13T06:03:56.514371+0000","last_fullsized":"2023-09-13T06:03:56.514371+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:53.669418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514430+0000","last_change":"2023-09-13T06:03:55.362625+0000","last_active":"2023-09-13T06:03:56.514430+0000","last_peered":"2023-09-13T06:03:56.514430+0000","last_clean":"2023-09-13T06:03:56.514430+0000","last_became_active":"2023-09-13T06:03:55.362382+0000","last_became_peered":"2023-09-13T06:03:55.362382+0000","last_unstale":"2023-09-13T06:03:56.514430+0000","last_undegraded":"2023-09-13T06:03:56.514430+0000","last_fullsized":"2023-09-13T06:03:56.514430+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:59:25.429399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515061+0000","last_change":"2023-09-13T06:03:55.363826+0000","last_active":"2023-09-13T06:03:56.515061+0000","last_peered":"2023-09-13T06:03:56.515061+0000","last_clean":"2023-09-13T06:03:56.515061+0000","last_became_active":"2023-09-13T06:03:55.363510+0000","last_became_peered":"2023-09-13T06:03:55.363510+0000","last_unstale":"2023-09-13T06:03:56.515061+0000","last_undegraded":"2023-09-13T06:03:56.515061+0000","last_fullsized":"2023-09-13T06:03:56.515061+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:04:26.698124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357805+0000","last_change":"2023-09-13T06:03:55.366707+0000","last_active":"2023-09-13T06:03:56.357805+0000","last_peered":"2023-09-13T06:03:56.357805+0000","last_clean":"2023-09-13T06:03:56.357805+0000","last_became_active":"2023-09-13T06:03:55.366160+0000","last_became_peered":"2023-09-13T06:03:55.366160+0000","last_unstale":"2023-09-13T06:03:56.357805+0000","last_undegraded":"2023-09-13T06:03:56.357805+0000","last_fullsized":"2023-09-13T06:03:56.357805+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:22.911639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515784+0000","last_change":"2023-09-13T06:03:55.370222+0000","last_active":"2023-09-13T06:03:56.515784+0000","last_peered":"2023-09-13T06:03:56.515784+0000","last_clean":"2023-09-13T06:03:56.515784+0000","last_became_active":"2023-09-13T06:03:55.368299+0000","last_became_peered":"2023-09-13T06:03:55.368299+0000","last_unstale":"2023-09-13T06:03:56.515784+0000","last_undegraded":"2023-09-13T06:03:56.515784+0000","last_fullsized":"2023-09-13T06:03:56.515784+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:09:22.244653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.356925+0000","last_change":"2023-09-13T06:03:55.361725+0000","last_active":"2023-09-13T06:03:56.356925+0000","last_peered":"2023-09-13T06:03:56.356925+0000","last_clean":"2023-09-13T06:03:56.356925+0000","last_became_active":"2023-09-13T06:03:55.360908+0000","last_became_peered":"2023-09-13T06:03:55.360908+0000","last_unstale":"2023-09-13T06:03:56.356925+0000","last_undegraded":"2023-09-13T06:03:56.356925+0000","last_fullsized":"2023-09-13T06:03:56.356925+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:53:21.634196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357998+0000","last_change":"2023-09-13T06:03:55.368014+0000","last_active":"2023-09-13T06:03:56.357998+0000","last_peered":"2023-09-13T06:03:56.357998+0000","last_clean":"2023-09-13T06:03:56.357998+0000","last_became_active":"2023-09-13T06:03:55.367416+0000","last_became_peered":"2023-09-13T06:03:55.367416+0000","last_unstale":"2023-09-13T06:03:56.357998+0000","last_undegraded":"2023-09-13T06:03:56.357998+0000","last_fullsized":"2023-09-13T06:03:56.357998+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:12.395910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515774+0000","last_change":"2023-09-13T06:03:55.367646+0000","last_active":"2023-09-13T06:03:56.515774+0000","last_peered":"2023-09-13T06:03:56.515774+0000","last_clean":"2023-09-13T06:03:56.515774+0000","last_became_active":"2023-09-13T06:03:55.367387+0000","last_became_peered":"2023-09-13T06:03:55.367387+0000","last_unstale":"2023-09-13T06:03:56.515774+0000","last_undegraded":"2023-09-13T06:03:56.515774+0000","last_fullsized":"2023-09-13T06:03:56.515774+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:31:27.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.356756+0000","last_change":"2023-09-13T06:03:55.374404+0000","last_active":"2023-09-13T06:03:56.356756+0000","last_peered":"2023-09-13T06:03:56.356756+0000","last_clean":"2023-09-13T06:03:56.356756+0000","last_became_active":"2023-09-13T06:03:55.374088+0000","last_became_peered":"2023-09-13T06:03:55.374088+0000","last_unstale":"2023-09-13T06:03:56.356756+0000","last_undegraded":"2023-09-13T06:03:56.356756+0000","last_fullsized":"2023-09-13T06:03:56.356756+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:27.714952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515905+0000","last_change":"2023-09-13T06:03:55.365068+0000","last_active":"2023-09-13T06:03:56.515905+0000","last_peered":"2023-09-13T06:03:56.515905+0000","last_clean":"2023-09-13T06:03:56.515905+0000","last_became_active":"2023-09-13T06:03:55.364220+0000","last_became_peered":"2023-09-13T06:03:55.364220+0000","last_unstale":"2023-09-13T06:03:56.515905+0000","last_undegraded":"2023-09-13T06:03:56.515905+0000","last_fullsized":"2023-09-13T06:03:56.515905+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:02:42.559094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357064+0000","last_change":"2023-09-13T06:03:55.361898+0000","last_active":"2023-09-13T06:03:56.357064+0000","last_peered":"2023-09-13T06:03:56.357064+0000","last_clean":"2023-09-13T06:03:56.357064+0000","last_became_active":"2023-09-13T06:03:55.361300+0000","last_became_peered":"2023-09-13T06:03:55.361300+0000","last_unstale":"2023-09-13T06:03:56.357064+0000","last_undegraded":"2023-09-13T06:03:56.357064+0000","last_fullsized":"2023-09-13T06:03:56.357064+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:20:18.106857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514296+0000","last_change":"2023-09-13T06:03:55.366617+0000","last_active":"2023-09-13T06:03:56.514296+0000","last_peered":"2023-09-13T06:03:56.514296+0000","last_clean":"2023-09-13T06:03:56.514296+0000","last_became_active":"2023-09-13T06:03:55.366402+0000","last_became_peered":"2023-09-13T06:03:55.366402+0000","last_unstale":"2023-09-13T06:03:56.514296+0000","last_undegraded":"2023-09-13T06:03:56.514296+0000","last_fullsized":"2023-09-13T06:03:56.514296+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:02:01.941487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.358536+0000","last_change":"2023-09-13T06:03:55.363858+0000","last_active":"2023-09-13T06:03:56.358536+0000","last_peered":"2023-09-13T06:03:56.358536+0000","last_clean":"2023-09-13T06:03:56.358536+0000","last_became_active":"2023-09-13T06:03:55.363632+0000","last_became_peered":"2023-09-13T06:03:55.363632+0000","last_unstale":"2023-09-13T06:03:56.358536+0000","last_undegraded":"2023-09-13T06:03:56.358536+0000","last_fullsized":"2023-09-13T06:03:56.358536+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:15:59.526873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514387+0000","last_change":"2023-09-13T06:03:55.374761+0000","last_active":"2023-09-13T06:03:56.514387+0000","last_peered":"2023-09-13T06:03:56.514387+0000","last_clean":"2023-09-13T06:03:56.514387+0000","last_became_active":"2023-09-13T06:03:55.372313+0000","last_became_peered":"2023-09-13T06:03:55.372313+0000","last_unstale":"2023-09-13T06:03:56.514387+0000","last_undegraded":"2023-09-13T06:03:56.514387+0000","last_fullsized":"2023-09-13T06:03:56.514387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:40:11.550968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357341+0000","last_change":"2023-09-13T06:03:55.365731+0000","last_active":"2023-09-13T06:03:56.357341+0000","last_peered":"2023-09-13T06:03:56.357341+0000","last_clean":"2023-09-13T06:03:56.357341+0000","last_became_active":"2023-09-13T06:03:55.365455+0000","last_became_peered":"2023-09-13T06:03:55.365455+0000","last_unstale":"2023-09-13T06:03:56.357341+0000","last_undegraded":"2023-09-13T06:03:56.357341+0000","last_fullsized":"2023-09-13T06:03:56.357341+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:20:15.890045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.358180+0000","last_change":"2023-09-13T06:03:55.370774+0000","last_active":"2023-09-13T06:03:56.358180+0000","last_peered":"2023-09-13T06:03:56.358180+0000","last_clean":"2023-09-13T06:03:56.358180+0000","last_became_active":"2023-09-13T06:03:55.370498+0000","last_became_peered":"2023-09-13T06:03:55.370498+0000","last_unstale":"2023-09-13T06:03:56.358180+0000","last_undegraded":"2023-09-13T06:03:56.358180+0000","last_fullsized":"2023-09-13T06:03:56.358180+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:47.359063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515009+0000","last_change":"2023-09-13T06:03:55.371985+0000","last_active":"2023-09-13T06:03:56.515009+0000","last_peered":"2023-09-13T06:03:56.515009+0000","last_clean":"2023-09-13T06:03:56.515009+0000","last_became_active":"2023-09-13T06:03:55.371743+0000","last_became_peered":"2023-09-13T06:03:55.371743+0000","last_unstale":"2023-09-13T06:03:56.515009+0000","last_undegraded":"2023-09-13T06:03:56.515009+0000","last_fullsized":"2023-09-13T06:03:56.515009+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:02:11.069093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357010+0000","last_change":"2023-09-13T06:03:55.361702+0000","last_active":"2023-09-13T06:03:56.357010+0000","last_peered":"2023-09-13T06:03:56.357010+0000","last_clean":"2023-09-13T06:03:56.357010+0000","last_became_active":"2023-09-13T06:03:55.361130+0000","last_became_peered":"2023-09-13T06:03:55.361130+0000","last_unstale":"2023-09-13T06:03:56.357010+0000","last_undegraded":"2023-09-13T06:03:56.357010+0000","last_fullsized":"2023-09-13T06:03:56.357010+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:11:00.009244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.358265+0000","last_change":"2023-09-13T06:03:55.367055+0000","last_active":"2023-09-13T06:03:56.358265+0000","last_peered":"2023-09-13T06:03:56.358265+0000","last_clean":"2023-09-13T06:03:56.358265+0000","last_became_active":"2023-09-13T06:03:55.366753+0000","last_became_peered":"2023-09-13T06:03:55.366753+0000","last_unstale":"2023-09-13T06:03:56.358265+0000","last_undegraded":"2023-09-13T06:03:56.358265+0000","last_fullsized":"2023-09-13T06:03:56.358265+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:43:37.699879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357469+0000","last_change":"2023-09-13T06:03:55.372270+0000","last_active":"2023-09-13T06:03:56.357469+0000","last_peered":"2023-09-13T06:03:56.357469+0000","last_clean":"2023-09-13T06:03:56.357469+0000","last_became_active":"2023-09-13T06:03:55.371989+0000","last_became_peered":"2023-09-13T06:03:55.371989+0000","last_unstale":"2023-09-13T06:03:56.357469+0000","last_undegraded":"2023-09-13T06:03:56.357469+0000","last_fullsized":"2023-09-13T06:03:56.357469+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:27.714952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357422+0000","last_change":"2023-09-13T06:03:55.362024+0000","last_active":"2023-09-13T06:03:56.357422+0000","last_peered":"2023-09-13T06:03:56.357422+0000","last_clean":"2023-09-13T06:03:56.357422+0000","last_became_active":"2023-09-13T06:03:55.361797+0000","last_became_peered":"2023-09-13T06:03:55.361797+0000","last_unstale":"2023-09-13T06:03:56.357422+0000","last_undegraded":"2023-09-13T06:03:56.357422+0000","last_fullsized":"2023-09-13T06:03:56.357422+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:38:30.360308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"64'4","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.383532+0000","last_change":"2023-09-13T06:03:54.344957+0000","last_active":"2023-09-13T06:03:55.383532+0000","last_peered":"2023-09-13T06:03:55.383532+0000","last_clean":"2023-09-13T06:03:55.383532+0000","last_became_active":"2023-09-13T06:03:54.344643+0000","last_became_peered":"2023-09-13T06:03:54.344643+0000","last_unstale":"2023-09-13T06:03:55.383532+0000","last_undegraded":"2023-09-13T06:03:55.383532+0000","last_fullsized":"2023-09-13T06:03:55.383532+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:40:10.543874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515110+0000","last_change":"2023-09-13T06:03:55.364320+0000","last_active":"2023-09-13T06:03:56.515110+0000","last_peered":"2023-09-13T06:03:56.515110+0000","last_clean":"2023-09-13T06:03:56.515110+0000","last_became_active":"2023-09-13T06:03:55.364075+0000","last_became_peered":"2023-09-13T06:03:55.364075+0000","last_unstale":"2023-09-13T06:03:56.515110+0000","last_undegraded":"2023-09-13T06:03:56.515110+0000","last_fullsized":"2023-09-13T06:03:56.515110+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:28:21.566684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381646+0000","last_change":"2023-09-13T06:03:54.341814+0000","last_active":"2023-09-13T06:03:55.381646+0000","last_peered":"2023-09-13T06:03:55.381646+0000","last_clean":"2023-09-13T06:03:55.381646+0000","last_became_active":"2023-09-13T06:03:54.341600+0000","last_became_peered":"2023-09-13T06:03:54.341600+0000","last_unstale":"2023-09-13T06:03:55.381646+0000","last_undegraded":"2023-09-13T06:03:55.381646+0000","last_fullsized":"2023-09-13T06:03:55.381646+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:38:26.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357925+0000","last_change":"2023-09-13T06:03:55.366906+0000","last_active":"2023-09-13T06:03:56.357925+0000","last_peered":"2023-09-13T06:03:56.357925+0000","last_clean":"2023-09-13T06:03:56.357925+0000","last_became_active":"2023-09-13T06:03:55.366480+0000","last_became_peered":"2023-09-13T06:03:55.366480+0000","last_unstale":"2023-09-13T06:03:56.357925+0000","last_undegraded":"2023-09-13T06:03:56.357925+0000","last_fullsized":"2023-09-13T06:03:56.357925+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:20:18.106857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.380843+0000","last_change":"2023-09-13T06:03:54.343948+0000","last_active":"2023-09-13T06:03:55.380843+0000","last_peered":"2023-09-13T06:03:55.380843+0000","last_clean":"2023-09-13T06:03:55.380843+0000","last_became_active":"2023-09-13T06:03:54.342820+0000","last_became_peered":"2023-09-13T06:03:54.342820+0000","last_unstale":"2023-09-13T06:03:55.380843+0000","last_undegraded":"2023-09-13T06:03:55.380843+0000","last_fullsized":"2023-09-13T06:03:55.380843+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:42:21.125876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357832+0000","last_change":"2023-09-13T06:03:55.370291+0000","last_active":"2023-09-13T06:03:56.357832+0000","last_peered":"2023-09-13T06:03:56.357832+0000","last_clean":"2023-09-13T06:03:56.357832+0000","last_became_active":"2023-09-13T06:03:55.369982+0000","last_became_peered":"2023-09-13T06:03:55.369982+0000","last_unstale":"2023-09-13T06:03:56.357832+0000","last_undegraded":"2023-09-13T06:03:56.357832+0000","last_fullsized":"2023-09-13T06:03:56.357832+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:11:00.009244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.383465+0000","last_change":"2023-09-13T06:03:54.339624+0000","last_active":"2023-09-13T06:03:55.383465+0000","last_peered":"2023-09-13T06:03:55.383465+0000","last_clean":"2023-09-13T06:03:55.383465+0000","last_became_active":"2023-09-13T06:03:54.338949+0000","last_became_peered":"2023-09-13T06:03:54.338949+0000","last_unstale":"2023-09-13T06:03:55.383465+0000","last_undegraded":"2023-09-13T06:03:55.383465+0000","last_fullsized":"2023-09-13T06:03:55.383465+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:21:12.757445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515513+0000","last_change":"2023-09-13T06:03:55.363892+0000","last_active":"2023-09-13T06:03:56.515513+0000","last_peered":"2023-09-13T06:03:56.515513+0000","last_clean":"2023-09-13T06:03:56.515513+0000","last_became_active":"2023-09-13T06:03:55.363541+0000","last_became_peered":"2023-09-13T06:03:55.363541+0000","last_unstale":"2023-09-13T06:03:56.515513+0000","last_undegraded":"2023-09-13T06:03:56.515513+0000","last_fullsized":"2023-09-13T06:03:56.515513+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:32:40.037687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381021+0000","last_change":"2023-09-13T06:03:54.340925+0000","last_active":"2023-09-13T06:03:55.381021+0000","last_peered":"2023-09-13T06:03:55.381021+0000","last_clean":"2023-09-13T06:03:55.381021+0000","last_became_active":"2023-09-13T06:03:54.340607+0000","last_became_peered":"2023-09-13T06:03:54.340607+0000","last_unstale":"2023-09-13T06:03:55.381021+0000","last_undegraded":"2023-09-13T06:03:55.381021+0000","last_fullsized":"2023-09-13T06:03:55.381021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:29.212522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.516013+0000","last_change":"2023-09-13T06:03:55.370406+0000","last_active":"2023-09-13T06:03:56.516013+0000","last_peered":"2023-09-13T06:03:56.516013+0000","last_clean":"2023-09-13T06:03:56.516013+0000","last_became_active":"2023-09-13T06:03:55.369666+0000","last_became_peered":"2023-09-13T06:03:55.369666+0000","last_unstale":"2023-09-13T06:03:56.516013+0000","last_undegraded":"2023-09-13T06:03:56.516013+0000","last_fullsized":"2023-09-13T06:03:56.516013+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:58:49.550750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.382393+0000","last_change":"2023-09-13T06:03:54.346119+0000","last_active":"2023-09-13T06:03:55.382393+0000","last_peered":"2023-09-13T06:03:55.382393+0000","last_clean":"2023-09-13T06:03:55.382393+0000","last_became_active":"2023-09-13T06:03:54.345575+0000","last_became_peered":"2023-09-13T06:03:54.345575+0000","last_unstale":"2023-09-13T06:03:55.382393+0000","last_undegraded":"2023-09-13T06:03:55.382393+0000","last_fullsized":"2023-09-13T06:03:55.382393+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:30:39.515879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515519+0000","last_change":"2023-09-13T06:03:55.366549+0000","last_active":"2023-09-13T06:03:56.515519+0000","last_peered":"2023-09-13T06:03:56.515519+0000","last_clean":"2023-09-13T06:03:56.515519+0000","last_became_active":"2023-09-13T06:03:55.366324+0000","last_became_peered":"2023-09-13T06:03:55.366324+0000","last_unstale":"2023-09-13T06:03:56.515519+0000","last_undegraded":"2023-09-13T06:03:56.515519+0000","last_fullsized":"2023-09-13T06:03:56.515519+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:35:59.747380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.366053+0000","last_change":"2023-09-13T06:03:54.340445+0000","last_active":"2023-09-13T06:03:55.366053+0000","last_peered":"2023-09-13T06:03:55.366053+0000","last_clean":"2023-09-13T06:03:55.366053+0000","last_became_active":"2023-09-13T06:03:54.340149+0000","last_became_peered":"2023-09-13T06:03:54.340149+0000","last_unstale":"2023-09-13T06:03:55.366053+0000","last_undegraded":"2023-09-13T06:03:55.366053+0000","last_fullsized":"2023-09-13T06:03:55.366053+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:33.969862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515135+0000","last_change":"2023-09-13T06:03:55.371507+0000","last_active":"2023-09-13T06:03:56.515135+0000","last_peered":"2023-09-13T06:03:56.515135+0000","last_clean":"2023-09-13T06:03:56.515135+0000","last_became_active":"2023-09-13T06:03:55.371162+0000","last_became_peered":"2023-09-13T06:03:55.371162+0000","last_unstale":"2023-09-13T06:03:56.515135+0000","last_undegraded":"2023-09-13T06:03:56.515135+0000","last_fullsized":"2023-09-13T06:03:56.515135+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:02:08.423077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.357525+0000","last_change":"2023-09-13T06:03:54.346403+0000","last_active":"2023-09-13T06:03:55.357525+0000","last_peered":"2023-09-13T06:03:55.357525+0000","last_clean":"2023-09-13T06:03:55.357525+0000","last_became_active":"2023-09-13T06:03:54.346110+0000","last_became_peered":"2023-09-13T06:03:54.346110+0000","last_unstale":"2023-09-13T06:03:55.357525+0000","last_undegraded":"2023-09-13T06:03:55.357525+0000","last_fullsized":"2023-09-13T06:03:55.357525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:05:58.863446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514644+0000","last_change":"2023-09-13T06:03:55.364585+0000","last_active":"2023-09-13T06:03:56.514644+0000","last_peered":"2023-09-13T06:03:56.514644+0000","last_clean":"2023-09-13T06:03:56.514644+0000","last_became_active":"2023-09-13T06:03:55.364344+0000","last_became_peered":"2023-09-13T06:03:55.364344+0000","last_unstale":"2023-09-13T06:03:56.514644+0000","last_undegraded":"2023-09-13T06:03:56.514644+0000","last_fullsized":"2023-09-13T06:03:56.514644+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:14.519561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.360423+0000","last_change":"2023-09-13T06:03:54.345832+0000","last_active":"2023-09-13T06:03:55.360423+0000","last_peered":"2023-09-13T06:03:55.360423+0000","last_clean":"2023-09-13T06:03:55.360423+0000","last_became_active":"2023-09-13T06:03:54.345000+0000","last_became_peered":"2023-09-13T06:03:54.345000+0000","last_unstale":"2023-09-13T06:03:55.360423+0000","last_undegraded":"2023-09-13T06:03:55.360423+0000","last_fullsized":"2023-09-13T06:03:55.360423+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:20:14.882952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.356993+0000","last_change":"2023-09-13T06:03:55.372148+0000","last_active":"2023-09-13T06:03:56.356993+0000","last_peered":"2023-09-13T06:03:56.356993+0000","last_clean":"2023-09-13T06:03:56.356993+0000","last_became_active":"2023-09-13T06:03:55.371096+0000","last_became_peered":"2023-09-13T06:03:55.371096+0000","last_unstale":"2023-09-13T06:03:56.356993+0000","last_undegraded":"2023-09-13T06:03:56.356993+0000","last_fullsized":"2023-09-13T06:03:56.356993+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:22.911639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.360023+0000","last_change":"2023-09-13T06:03:54.344789+0000","last_active":"2023-09-13T06:03:55.360023+0000","last_peered":"2023-09-13T06:03:55.360023+0000","last_clean":"2023-09-13T06:03:55.360023+0000","last_became_active":"2023-09-13T06:03:54.344031+0000","last_became_peered":"2023-09-13T06:03:54.344031+0000","last_unstale":"2023-09-13T06:03:55.360023+0000","last_undegraded":"2023-09-13T06:03:55.360023+0000","last_fullsized":"2023-09-13T06:03:55.360023+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:06:03.944618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515149+0000","last_change":"2023-09-13T06:03:55.362069+0000","last_active":"2023-09-13T06:03:56.515149+0000","last_peered":"2023-09-13T06:03:56.515149+0000","last_clean":"2023-09-13T06:03:56.515149+0000","last_became_active":"2023-09-13T06:03:55.361837+0000","last_became_peered":"2023-09-13T06:03:55.361837+0000","last_unstale":"2023-09-13T06:03:56.515149+0000","last_undegraded":"2023-09-13T06:03:56.515149+0000","last_fullsized":"2023-09-13T06:03:56.515149+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:59:14.322627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"64'3","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.384964+0000","last_change":"2023-09-13T06:03:54.341715+0000","last_active":"2023-09-13T06:03:55.384964+0000","last_peered":"2023-09-13T06:03:55.384964+0000","last_clean":"2023-09-13T06:03:55.384964+0000","last_became_active":"2023-09-13T06:03:54.341402+0000","last_became_peered":"2023-09-13T06:03:54.341402+0000","last_unstale":"2023-09-13T06:03:55.384964+0000","last_undegraded":"2023-09-13T06:03:55.384964+0000","last_fullsized":"2023-09-13T06:03:55.384964+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:50:22.948280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357215+0000","last_change":"2023-09-13T06:03:55.367232+0000","last_active":"2023-09-13T06:03:56.357215+0000","last_peered":"2023-09-13T06:03:56.357215+0000","last_clean":"2023-09-13T06:03:56.357215+0000","last_became_active":"2023-09-13T06:03:55.362201+0000","last_became_peered":"2023-09-13T06:03:55.362201+0000","last_unstale":"2023-09-13T06:03:56.357215+0000","last_undegraded":"2023-09-13T06:03:56.357215+0000","last_fullsized":"2023-09-13T06:03:56.357215+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:28:19.445704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"64'6","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.383941+0000","last_change":"2023-09-13T06:03:54.345253+0000","last_active":"2023-09-13T06:03:55.383941+0000","last_peered":"2023-09-13T06:03:55.383941+0000","last_clean":"2023-09-13T06:03:55.383941+0000","last_became_active":"2023-09-13T06:03:54.344933+0000","last_became_peered":"2023-09-13T06:03:54.344933+0000","last_unstale":"2023-09-13T06:03:55.383941+0000","last_undegraded":"2023-09-13T06:03:55.383941+0000","last_fullsized":"2023-09-13T06:03:55.383941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:46:22.745594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514527+0000","last_change":"2023-09-13T06:03:55.375102+0000","last_active":"2023-09-13T06:03:56.514527+0000","last_peered":"2023-09-13T06:03:56.514527+0000","last_clean":"2023-09-13T06:03:56.514527+0000","last_became_active":"2023-09-13T06:03:55.372635+0000","last_became_peered":"2023-09-13T06:03:55.372635+0000","last_unstale":"2023-09-13T06:03:56.514527+0000","last_undegraded":"2023-09-13T06:03:56.514527+0000","last_fullsized":"2023-09-13T06:03:56.514527+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:05:59.870540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381847+0000","last_change":"2023-09-13T06:03:54.344011+0000","last_active":"2023-09-13T06:03:55.381847+0000","last_peered":"2023-09-13T06:03:55.381847+0000","last_clean":"2023-09-13T06:03:55.381847+0000","last_became_active":"2023-09-13T06:03:54.343762+0000","last_became_peered":"2023-09-13T06:03:54.343762+0000","last_unstale":"2023-09-13T06:03:55.381847+0000","last_undegraded":"2023-09-13T06:03:55.381847+0000","last_fullsized":"2023-09-13T06:03:55.381847+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:42:52.290952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357230+0000","last_change":"2023-09-13T06:03:55.367370+0000","last_active":"2023-09-13T06:03:56.357230+0000","last_peered":"2023-09-13T06:03:56.357230+0000","last_clean":"2023-09-13T06:03:56.357230+0000","last_became_active":"2023-09-13T06:03:55.367103+0000","last_became_peered":"2023-09-13T06:03:55.367103+0000","last_unstale":"2023-09-13T06:03:56.357230+0000","last_undegraded":"2023-09-13T06:03:56.357230+0000","last_fullsized":"2023-09-13T06:03:56.357230+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:37.844088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.360896+0000","last_change":"2023-09-13T06:03:54.347550+0000","last_active":"2023-09-13T06:03:55.360896+0000","last_peered":"2023-09-13T06:03:55.360896+0000","last_clean":"2023-09-13T06:03:55.360896+0000","last_became_active":"2023-09-13T06:03:54.347324+0000","last_became_peered":"2023-09-13T06:03:54.347324+0000","last_unstale":"2023-09-13T06:03:55.360896+0000","last_undegraded":"2023-09-13T06:03:55.360896+0000","last_fullsized":"2023-09-13T06:03:55.360896+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:28:20.559591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514960+0000","last_change":"2023-09-13T06:03:55.367981+0000","last_active":"2023-09-13T06:03:56.514960+0000","last_peered":"2023-09-13T06:03:56.514960+0000","last_clean":"2023-09-13T06:03:56.514960+0000","last_became_active":"2023-09-13T06:03:55.367756+0000","last_became_peered":"2023-09-13T06:03:55.367756+0000","last_unstale":"2023-09-13T06:03:56.514960+0000","last_undegraded":"2023-09-13T06:03:56.514960+0000","last_fullsized":"2023-09-13T06:03:56.514960+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:50:23.955373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.365750+0000","last_change":"2023-09-13T06:03:54.339815+0000","last_active":"2023-09-13T06:03:55.365750+0000","last_peered":"2023-09-13T06:03:55.365750+0000","last_clean":"2023-09-13T06:03:55.365750+0000","last_became_active":"2023-09-13T06:03:54.339381+0000","last_became_peered":"2023-09-13T06:03:54.339381+0000","last_unstale":"2023-09-13T06:03:55.365750+0000","last_undegraded":"2023-09-13T06:03:55.365750+0000","last_fullsized":"2023-09-13T06:03:55.365750+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:39:43.561750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.356854+0000","last_change":"2023-09-13T06:03:55.364772+0000","last_active":"2023-09-13T06:03:56.356854+0000","last_peered":"2023-09-13T06:03:56.356854+0000","last_clean":"2023-09-13T06:03:56.356854+0000","last_became_active":"2023-09-13T06:03:55.364479+0000","last_became_peered":"2023-09-13T06:03:55.364479+0000","last_unstale":"2023-09-13T06:03:56.356854+0000","last_undegraded":"2023-09-13T06:03:56.356854+0000","last_fullsized":"2023-09-13T06:03:56.356854+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:35:09.768499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"64'8","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.384425+0000","last_change":"2023-09-13T06:03:54.344031+0000","last_active":"2023-09-13T06:03:55.384425+0000","last_peered":"2023-09-13T06:03:55.384425+0000","last_clean":"2023-09-13T06:03:55.384425+0000","last_became_active":"2023-09-13T06:03:54.343790+0000","last_became_peered":"2023-09-13T06:03:54.343790+0000","last_unstale":"2023-09-13T06:03:55.384425+0000","last_undegraded":"2023-09-13T06:03:55.384425+0000","last_fullsized":"2023-09-13T06:03:55.384425+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:42:21.125876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357377+0000","last_change":"2023-09-13T06:03:55.361874+0000","last_active":"2023-09-13T06:03:56.357377+0000","last_peered":"2023-09-13T06:03:56.357377+0000","last_clean":"2023-09-13T06:03:56.357377+0000","last_became_active":"2023-09-13T06:03:55.361465+0000","last_became_peered":"2023-09-13T06:03:55.361465+0000","last_unstale":"2023-09-13T06:03:56.357377+0000","last_undegraded":"2023-09-13T06:03:56.357377+0000","last_fullsized":"2023-09-13T06:03:56.357377+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:05:08.680418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381564+0000","last_change":"2023-09-13T06:03:54.342712+0000","last_active":"2023-09-13T06:03:55.381564+0000","last_peered":"2023-09-13T06:03:55.381564+0000","last_clean":"2023-09-13T06:03:55.381564+0000","last_became_active":"2023-09-13T06:03:54.342485+0000","last_became_peered":"2023-09-13T06:03:54.342485+0000","last_unstale":"2023-09-13T06:03:55.381564+0000","last_undegraded":"2023-09-13T06:03:55.381564+0000","last_fullsized":"2023-09-13T06:03:55.381564+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:15:40.434705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514504+0000","last_change":"2023-09-13T06:03:55.371041+0000","last_active":"2023-09-13T06:03:56.514504+0000","last_peered":"2023-09-13T06:03:56.514504+0000","last_clean":"2023-09-13T06:03:56.514504+0000","last_became_active":"2023-09-13T06:03:55.370320+0000","last_became_peered":"2023-09-13T06:03:55.370320+0000","last_unstale":"2023-09-13T06:03:56.514504+0000","last_undegraded":"2023-09-13T06:03:56.514504+0000","last_fullsized":"2023-09-13T06:03:56.514504+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:30:40.522973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381867+0000","last_change":"2023-09-13T06:03:54.344087+0000","last_active":"2023-09-13T06:03:55.381867+0000","last_peered":"2023-09-13T06:03:55.381867+0000","last_clean":"2023-09-13T06:03:55.381867+0000","last_became_active":"2023-09-13T06:03:54.343727+0000","last_became_peered":"2023-09-13T06:03:54.343727+0000","last_unstale":"2023-09-13T06:03:55.381867+0000","last_undegraded":"2023-09-13T06:03:55.381867+0000","last_fullsized":"2023-09-13T06:03:55.381867+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:34:22.289599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.516119+0000","last_change":"2023-09-13T06:03:55.370527+0000","last_active":"2023-09-13T06:03:56.516119+0000","last_peered":"2023-09-13T06:03:56.516119+0000","last_clean":"2023-09-13T06:03:56.516119+0000","last_became_active":"2023-09-13T06:03:55.369960+0000","last_became_peered":"2023-09-13T06:03:55.369960+0000","last_unstale":"2023-09-13T06:03:56.516119+0000","last_undegraded":"2023-09-13T06:03:56.516119+0000","last_fullsized":"2023-09-13T06:03:56.516119+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:08:38.645027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.383594+0000","last_change":"2023-09-13T06:03:54.339212+0000","last_active":"2023-09-13T06:03:55.383594+0000","last_peered":"2023-09-13T06:03:55.383594+0000","last_clean":"2023-09-13T06:03:55.383594+0000","last_became_active":"2023-09-13T06:03:54.338607+0000","last_became_peered":"2023-09-13T06:03:54.338607+0000","last_unstale":"2023-09-13T06:03:55.383594+0000","last_undegraded":"2023-09-13T06:03:55.383594+0000","last_fullsized":"2023-09-13T06:03:55.383594+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:40:13.058216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357125+0000","last_change":"2023-09-13T06:03:55.372313+0000","last_active":"2023-09-13T06:03:56.357125+0000","last_peered":"2023-09-13T06:03:56.357125+0000","last_clean":"2023-09-13T06:03:56.357125+0000","last_became_active":"2023-09-13T06:03:55.371422+0000","last_became_peered":"2023-09-13T06:03:55.371422+0000","last_unstale":"2023-09-13T06:03:56.357125+0000","last_undegraded":"2023-09-13T06:03:56.357125+0000","last_fullsized":"2023-09-13T06:03:56.357125+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:53:03.560536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.361030+0000","last_change":"2023-09-13T06:03:54.347391+0000","last_active":"2023-09-13T06:03:55.361030+0000","last_peered":"2023-09-13T06:03:55.361030+0000","last_clean":"2023-09-13T06:03:55.361030+0000","last_became_active":"2023-09-13T06:03:54.346938+0000","last_became_peered":"2023-09-13T06:03:54.346938+0000","last_unstale":"2023-09-13T06:03:55.361030+0000","last_undegraded":"2023-09-13T06:03:55.361030+0000","last_fullsized":"2023-09-13T06:03:55.361030+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:13.512467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514740+0000","last_change":"2023-09-13T06:03:55.370863+0000","last_active":"2023-09-13T06:03:56.514740+0000","last_peered":"2023-09-13T06:03:56.514740+0000","last_clean":"2023-09-13T06:03:56.514740+0000","last_became_active":"2023-09-13T06:03:55.369890+0000","last_became_peered":"2023-09-13T06:03:55.369890+0000","last_unstale":"2023-09-13T06:03:56.514740+0000","last_undegraded":"2023-09-13T06:03:56.514740+0000","last_fullsized":"2023-09-13T06:03:56.514740+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:46:23.752688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.382966+0000","last_change":"2023-09-13T06:03:54.344859+0000","last_active":"2023-09-13T06:03:55.382966+0000","last_peered":"2023-09-13T06:03:55.382966+0000","last_clean":"2023-09-13T06:03:55.382966+0000","last_became_active":"2023-09-13T06:03:54.344627+0000","last_became_peered":"2023-09-13T06:03:54.344627+0000","last_unstale":"2023-09-13T06:03:55.382966+0000","last_undegraded":"2023-09-13T06:03:55.382966+0000","last_fullsized":"2023-09-13T06:03:55.382966+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:05:07.673324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357353+0000","last_change":"2023-09-13T06:03:55.369470+0000","last_active":"2023-09-13T06:03:56.357353+0000","last_peered":"2023-09-13T06:03:56.357353+0000","last_clean":"2023-09-13T06:03:56.357353+0000","last_became_active":"2023-09-13T06:03:55.369217+0000","last_became_peered":"2023-09-13T06:03:55.369217+0000","last_unstale":"2023-09-13T06:03:56.357353+0000","last_undegraded":"2023-09-13T06:03:56.357353+0000","last_fullsized":"2023-09-13T06:03:56.357353+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:02:41.409105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.355534+0000","last_change":"2023-09-13T06:03:54.342844+0000","last_active":"2023-09-13T06:03:55.355534+0000","last_peered":"2023-09-13T06:03:55.355534+0000","last_clean":"2023-09-13T06:03:55.355534+0000","last_became_active":"2023-09-13T06:03:54.341855+0000","last_became_peered":"2023-09-13T06:03:54.341855+0000","last_unstale":"2023-09-13T06:03:55.355534+0000","last_undegraded":"2023-09-13T06:03:55.355534+0000","last_fullsized":"2023-09-13T06:03:55.355534+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:11:22.971909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357947+0000","last_change":"2023-09-13T06:03:55.368774+0000","last_active":"2023-09-13T06:03:56.357947+0000","last_peered":"2023-09-13T06:03:56.357947+0000","last_clean":"2023-09-13T06:03:56.357947+0000","last_became_active":"2023-09-13T06:03:55.368498+0000","last_became_peered":"2023-09-13T06:03:55.368498+0000","last_unstale":"2023-09-13T06:03:56.357947+0000","last_undegraded":"2023-09-13T06:03:56.357947+0000","last_fullsized":"2023-09-13T06:03:56.357947+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:53:03.560536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.372043+0000","last_change":"2023-09-13T06:03:54.347045+0000","last_active":"2023-09-13T06:03:55.372043+0000","last_peered":"2023-09-13T06:03:55.372043+0000","last_clean":"2023-09-13T06:03:55.372043+0000","last_became_active":"2023-09-13T06:03:54.346714+0000","last_became_peered":"2023-09-13T06:03:54.346714+0000","last_unstale":"2023-09-13T06:03:55.372043+0000","last_undegraded":"2023-09-13T06:03:55.372043+0000","last_fullsized":"2023-09-13T06:03:55.372043+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:43.058515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515280+0000","last_change":"2023-09-13T06:03:55.368467+0000","last_active":"2023-09-13T06:03:56.515280+0000","last_peered":"2023-09-13T06:03:56.515280+0000","last_clean":"2023-09-13T06:03:56.515280+0000","last_became_active":"2023-09-13T06:03:55.365961+0000","last_became_peered":"2023-09-13T06:03:55.365961+0000","last_unstale":"2023-09-13T06:03:56.515280+0000","last_undegraded":"2023-09-13T06:03:56.515280+0000","last_fullsized":"2023-09-13T06:03:56.515280+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:25:01.540741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.381462+0000","last_change":"2023-09-13T06:03:54.342412+0000","last_active":"2023-09-13T06:03:55.381462+0000","last_peered":"2023-09-13T06:03:55.381462+0000","last_clean":"2023-09-13T06:03:55.381462+0000","last_became_active":"2023-09-13T06:03:54.342133+0000","last_became_peered":"2023-09-13T06:03:54.342133+0000","last_unstale":"2023-09-13T06:03:55.381462+0000","last_undegraded":"2023-09-13T06:03:55.381462+0000","last_fullsized":"2023-09-13T06:03:55.381462+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:15:58.519779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514823+0000","last_change":"2023-09-13T06:03:55.368665+0000","last_active":"2023-09-13T06:03:56.514823+0000","last_peered":"2023-09-13T06:03:56.514823+0000","last_clean":"2023-09-13T06:03:56.514823+0000","last_became_active":"2023-09-13T06:03:55.368427+0000","last_became_peered":"2023-09-13T06:03:55.368427+0000","last_unstale":"2023-09-13T06:03:56.514823+0000","last_undegraded":"2023-09-13T06:03:56.514823+0000","last_fullsized":"2023-09-13T06:03:56.514823+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:30:27.109145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.358102+0000","last_change":"2023-09-13T06:03:54.345970+0000","last_active":"2023-09-13T06:03:55.358102+0000","last_peered":"2023-09-13T06:03:55.358102+0000","last_clean":"2023-09-13T06:03:55.358102+0000","last_became_active":"2023-09-13T06:03:54.345190+0000","last_became_peered":"2023-09-13T06:03:54.345190+0000","last_unstale":"2023-09-13T06:03:55.358102+0000","last_undegraded":"2023-09-13T06:03:55.358102+0000","last_fullsized":"2023-09-13T06:03:55.358102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:29:40.539119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515339+0000","last_change":"2023-09-13T06:03:55.362752+0000","last_active":"2023-09-13T06:03:56.515339+0000","last_peered":"2023-09-13T06:03:56.515339+0000","last_clean":"2023-09-13T06:03:56.515339+0000","last_became_active":"2023-09-13T06:03:55.362536+0000","last_became_peered":"2023-09-13T06:03:55.362536+0000","last_unstale":"2023-09-13T06:03:56.515339+0000","last_undegraded":"2023-09-13T06:03:56.515339+0000","last_fullsized":"2023-09-13T06:03:56.515339+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:33:10.929698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.364855+0000","last_change":"2023-09-13T06:03:54.346351+0000","last_active":"2023-09-13T06:03:55.364855+0000","last_peered":"2023-09-13T06:03:55.364855+0000","last_clean":"2023-09-13T06:03:55.364855+0000","last_became_active":"2023-09-13T06:03:54.346125+0000","last_became_peered":"2023-09-13T06:03:54.346125+0000","last_unstale":"2023-09-13T06:03:55.364855+0000","last_undegraded":"2023-09-13T06:03:55.364855+0000","last_fullsized":"2023-09-13T06:03:55.364855+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:38:17.209644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357555+0000","last_change":"2023-09-13T06:03:55.375842+0000","last_active":"2023-09-13T06:03:56.357555+0000","last_peered":"2023-09-13T06:03:56.357555+0000","last_clean":"2023-09-13T06:03:56.357555+0000","last_became_active":"2023-09-13T06:03:55.375618+0000","last_became_peered":"2023-09-13T06:03:55.375618+0000","last_unstale":"2023-09-13T06:03:56.357555+0000","last_undegraded":"2023-09-13T06:03:56.357555+0000","last_fullsized":"2023-09-13T06:03:56.357555+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:35:09.768499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.364440+0000","last_change":"2023-09-13T06:03:54.338842+0000","last_active":"2023-09-13T06:03:55.364440+0000","last_peered":"2023-09-13T06:03:55.364440+0000","last_clean":"2023-09-13T06:03:55.364440+0000","last_became_active":"2023-09-13T06:03:54.338585+0000","last_became_peered":"2023-09-13T06:03:54.338585+0000","last_unstale":"2023-09-13T06:03:55.364440+0000","last_undegraded":"2023-09-13T06:03:55.364440+0000","last_fullsized":"2023-09-13T06:03:55.364440+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:58:05.145892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.516294+0000","last_change":"2023-09-13T06:03:55.365313+0000","last_active":"2023-09-13T06:03:56.516294+0000","last_peered":"2023-09-13T06:03:56.516294+0000","last_clean":"2023-09-13T06:03:56.516294+0000","last_became_active":"2023-09-13T06:03:55.364841+0000","last_became_peered":"2023-09-13T06:03:55.364841+0000","last_unstale":"2023-09-13T06:03:56.516294+0000","last_undegraded":"2023-09-13T06:03:56.516294+0000","last_fullsized":"2023-09-13T06:03:56.516294+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:09:48.240259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.355284+0000","last_change":"2023-09-13T06:03:54.339583+0000","last_active":"2023-09-13T06:03:55.355284+0000","last_peered":"2023-09-13T06:03:55.355284+0000","last_clean":"2023-09-13T06:03:55.355284+0000","last_became_active":"2023-09-13T06:03:54.338978+0000","last_became_peered":"2023-09-13T06:03:54.338978+0000","last_unstale":"2023-09-13T06:03:55.355284+0000","last_undegraded":"2023-09-13T06:03:55.355284+0000","last_fullsized":"2023-09-13T06:03:55.355284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:23:23.119259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.357265+0000","last_change":"2023-09-13T06:03:55.372503+0000","last_active":"2023-09-13T06:03:56.357265+0000","last_peered":"2023-09-13T06:03:56.357265+0000","last_clean":"2023-09-13T06:03:56.357265+0000","last_became_active":"2023-09-13T06:03:55.371791+0000","last_became_peered":"2023-09-13T06:03:55.371791+0000","last_unstale":"2023-09-13T06:03:56.357265+0000","last_undegraded":"2023-09-13T06:03:56.357265+0000","last_fullsized":"2023-09-13T06:03:56.357265+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:42:53.298046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.357289+0000","last_change":"2023-09-13T06:03:54.344421+0000","last_active":"2023-09-13T06:03:55.357289+0000","last_peered":"2023-09-13T06:03:55.357289+0000","last_clean":"2023-09-13T06:03:55.357289+0000","last_became_active":"2023-09-13T06:03:54.343939+0000","last_became_peered":"2023-09-13T06:03:54.343939+0000","last_unstale":"2023-09-13T06:03:55.357289+0000","last_undegraded":"2023-09-13T06:03:55.357289+0000","last_fullsized":"2023-09-13T06:03:55.357289+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:40:10.543874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.514931+0000","last_change":"2023-09-13T06:03:55.368615+0000","last_active":"2023-09-13T06:03:56.514931+0000","last_peered":"2023-09-13T06:03:56.514931+0000","last_clean":"2023-09-13T06:03:56.514931+0000","last_became_active":"2023-09-13T06:03:55.368306+0000","last_became_peered":"2023-09-13T06:03:55.368306+0000","last_unstale":"2023-09-13T06:03:56.514931+0000","last_undegraded":"2023-09-13T06:03:56.514931+0000","last_fullsized":"2023-09-13T06:03:56.514931+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:19:37.557793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.355355+0000","last_change":"2023-09-13T06:03:54.342100+0000","last_active":"2023-09-13T06:03:55.355355+0000","last_peered":"2023-09-13T06:03:55.355355+0000","last_clean":"2023-09-13T06:03:55.355355+0000","last_became_active":"2023-09-13T06:03:54.341856+0000","last_became_peered":"2023-09-13T06:03:54.341856+0000","last_unstale":"2023-09-13T06:03:55.355355+0000","last_undegraded":"2023-09-13T06:03:55.355355+0000","last_fullsized":"2023-09-13T06:03:55.355355+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:22:09.475291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515647+0000","last_change":"2023-09-13T06:03:55.369610+0000","last_active":"2023-09-13T06:03:56.515647+0000","last_peered":"2023-09-13T06:03:56.515647+0000","last_clean":"2023-09-13T06:03:56.515647+0000","last_became_active":"2023-09-13T06:03:55.369065+0000","last_became_peered":"2023-09-13T06:03:55.369065+0000","last_unstale":"2023-09-13T06:03:56.515647+0000","last_undegraded":"2023-09-13T06:03:56.515647+0000","last_fullsized":"2023-09-13T06:03:56.515647+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:34:46.212424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.360535+0000","last_change":"2023-09-13T06:03:54.349163+0000","last_active":"2023-09-13T06:03:55.360535+0000","last_peered":"2023-09-13T06:03:55.360535+0000","last_clean":"2023-09-13T06:03:55.360535+0000","last_became_active":"2023-09-13T06:03:54.348987+0000","last_became_peered":"2023-09-13T06:03:54.348987+0000","last_unstale":"2023-09-13T06:03:55.360535+0000","last_undegraded":"2023-09-13T06:03:55.360535+0000","last_fullsized":"2023-09-13T06:03:55.360535+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:01:35.045959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-09-13T06:03:56.515902+0000","last_change":"2023-09-13T06:03:55.368807+0000","last_active":"2023-09-13T06:03:56.515902+0000","last_peered":"2023-09-13T06:03:56.515902+0000","last_clean":"2023-09-13T06:03:56.515902+0000","last_became_active":"2023-09-13T06:03:55.368589+0000","last_became_peered":"2023-09-13T06:03:55.368589+0000","last_unstale":"2023-09-13T06:03:56.515902+0000","last_undegraded":"2023-09-13T06:03:56.515902+0000","last_fullsized":"2023-09-13T06:03:56.515902+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:54.328079+0000","last_clean_scrub_stamp":"2023-09-13T06:03:54.328079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:24:10.061467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.361442+0000","last_change":"2023-09-13T06:03:54.344752+0000","last_active":"2023-09-13T06:03:55.361442+0000","last_peered":"2023-09-13T06:03:55.361442+0000","last_clean":"2023-09-13T06:03:55.361442+0000","last_became_active":"2023-09-13T06:03:54.344320+0000","last_became_peered":"2023-09-13T06:03:54.344320+0000","last_unstale":"2023-09-13T06:03:55.361442+0000","last_undegraded":"2023-09-13T06:03:55.361442+0000","last_fullsized":"2023-09-13T06:03:55.361442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:03:53.320985+0000","last_clean_scrub_stamp":"2023-09-13T06:03:53.320985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:59:13.315533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-09-13T06:03:55.356055+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:03:55.356055+0000","last_peered":"2023-09-13T06:03:55.356055+0000","last_clean":"2023-09-13T06:03:55.356055+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:03:55.356055+0000","last_undegraded":"2023-09-13T06:03:55.356055+0000","last_fullsized":"2023-09-13T06:03:55.356055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:14:08.145478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074566,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88800000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.752},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83499999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81200000000000006}]},{"osd":1,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.68999999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.875,"5min":1.05,"15min":1.05},"last":0.86399999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81699999999999995,"5min":1.395,"15min":1.395},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.85899999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89400000000000002,"5min":1.357,"15min":1.357},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.97599999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86399999999999999,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65900000000000003,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85899999999999999,"5min":1.018,"15min":1.018},"last":0.84399999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90800000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95099999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.94599999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.74399999999999999,"15min":0.752},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.875,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.77600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199665094,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":1.181,"15min":1.181},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55900000000000005}]},{"osd":1,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.85499999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.153,"15min":1.153},"last":0.625}]},{"osd":2,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96999999999999997,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88800000000000001,"5min":1.038,"15min":1.038},"last":0.73999999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90300000000000002,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.754},{"interface":"front","average":{"1min":0.749,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.038,"5min":1.526,"15min":1.526},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.63800000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.71499999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.50900000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.80400000000000005,"5min":0.878,"15min":0.878},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.55600000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0089999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.53700000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.74199999999999999,"15min":0.70999999999999996},"min":{"1min":0.54700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":4.3879999999999999,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.90700000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194984,"statfs":{"total":200000000,"available":199664442,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.874,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.65800000000000003,"15min":0.65000000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.59799999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.51300000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.74399999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69199999999999995,"15min":0.68700000000000006},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.66500000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71299999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.78300000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.46300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.436}]},{"osd":6,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.48699999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82799999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85599999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66700000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72799999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86599999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.877,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":328,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194983,"statfs":{"total":200000000,"available":199663482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80300000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58599999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85499999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.75,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65800000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.873,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.83999999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.749}]},{"osd":3,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.54800000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.89200000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.71899999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85499999999999998,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.73199999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.61899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.01,"15min":1.01},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.80600000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.876,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89400000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.86299999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.53800000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89000000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.79200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199665038,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.54500000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42399999999999999,"15min":0.41999999999999998},"min":{"1min":0.35899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.37}]},{"osd":1,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.312},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.32900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66000000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.40200000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44800000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93600000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.70999999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54600000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.53700000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95399999999999996,"5min":1.111,"15min":1.111},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.86799999999999999,"5min":1.04,"15min":1.04},"last":0.5}]},{"osd":6,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.748,"15min":0.754},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.873,"5min":1.458,"15min":1.458},"last":0.53800000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90000000000000002,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.90500000000000003,"5min":1.27,"15min":1.27},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199665038,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.45100000000000001,"15min":0.40300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":10.401,"5min":10.401,"15min":10.401},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.45900000000000002,"15min":0.434},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.4429999999999996,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":0.46100000000000002}]},{"osd":1,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.47399999999999998,"15min":0.45400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":5.2640000000000002,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.47999999999999998,"15min":0.45800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.3369999999999997,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.0410000000000004,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.56899999999999995,"15min":0.54300000000000004},"min":{"1min":0.40300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":5.4809999999999999,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.626},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.78600000000000003,"15min":0.77200000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":4.0599999999999996,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.58999999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.81699999999999995,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":5.5289999999999999,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.746,"15min":0.72999999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.71899999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.54900000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.751,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":4.2400000000000002,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.56899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199665004,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.443,"15min":0.433},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.503},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28899999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.65900000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45000000000000001,"15min":0.45100000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.624}]},{"osd":3,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.505,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":4.0599999999999996,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80100000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.878,"5min":1.109,"15min":1.109},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.749},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1140000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76100000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.84099999999999997,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81699999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96999999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56999999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.88900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":905,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199072532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45800000000000002,"15min":0.45600000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.47499999999999998,"15min":0.46800000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.47099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.503,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.44900000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.73699999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.78300000000000003,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.70199999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.78200000000000003},"min":{"1min":0.55100000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":0.628},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.79200000000000004,"15min":0.78300000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed Sep 13 06:03:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.80700000000000005,"15min":0.80400000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.79300000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.67700000000000005}]}]}],"pool_statfs":[]}} 2023-09-13T06:03:59.804 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T06:03:59.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-13T06:03:59.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.982+0000 7f5cb7967640 1 Processor -- start 2023-09-13T06:03:59.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.982+0000 7f5cb7967640 1 -- start start 2023-09-13T06:03:59.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb7967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5cb01617f0 0x7f5cb00cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb7967640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5cb00cc880 0x7f5cb00ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb7967640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb00b2620 con 0x7f5cb00ce6c0 2023-09-13T06:03:59.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb7967640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb00b1a80 con 0x7f5cb00cc880 2023-09-13T06:03:59.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb7967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb00ccce0 con 0x7f5cb01617f0 2023-09-13T06:03:59.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb5703640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5cb01617f0 0x7f5cb00cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb5f04640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f5cb00ce6c0 0x7f5cb00b4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:51594/0 (socket says 172.21.15.130:51594) 2023-09-13T06:03:59.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb4f02640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5cb00cc880 0x7f5cb00ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb5f04640 1 -- 172.21.15.130:0/156183264 learned_addr learned my addr 172.21.15.130:0/156183264 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:03:59.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5ca7fff640 1 -- 172.21.15.130:0/156183264 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145096838 0 0) 0x7f5cb00b2620 con 0x7f5cb00ce6c0 2023-09-13T06:03:59.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb4f02640 1 -- 172.21.15.130:0/156183264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5cb01617f0 msgr2=0x7f5cb00cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:03:59.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb4f02640 1 --2- 172.21.15.130:0/156183264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5cb01617f0 0x7f5cb00cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb4f02640 1 -- 172.21.15.130:0/156183264 >> v1:172.21.15.164:6789/0 conn(0x7f5cb00ce6c0 legacy=0x7f5cb00b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.986+0000 7f5cb4f02640 1 -- 172.21.15.130:0/156183264 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb00b2ab0 con 0x7f5cb00cc880 2023-09-13T06:03:59.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5cb4f02640 1 --2- 172.21.15.130:0/156183264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5cb00cc880 0x7f5cb00ce180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00097c0 tx=0x7f5ca001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e930a6e2cd79e64d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:03:59.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5ca7fff640 1 -- 172.21.15.130:0/156183264 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00ad660 con 0x7f5cb00cc880 2023-09-13T06:03:59.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5ca7fff640 1 -- 172.21.15.130:0/156183264 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca00ad7c0 con 0x7f5cb00cc880 2023-09-13T06:03:59.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5ca7fff640 1 -- 172.21.15.130:0/156183264 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00adb50 con 0x7f5cb00cc880 2023-09-13T06:03:59.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5cb7967640 1 -- 172.21.15.130:0/156183264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5cb00cc880 msgr2=0x7f5cb00ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5cb7967640 1 --2- 172.21.15.130:0/156183264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5cb00cc880 0x7f5cb00ce180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00097c0 tx=0x7f5ca001c450 comp rx=0 tx=0).stop 2023-09-13T06:03:59.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5cb7967640 1 -- 172.21.15.130:0/156183264 shutdown_connections 2023-09-13T06:03:59.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5cb7967640 1 --2- 172.21.15.130:0/156183264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5cb00cc880 0x7f5cb00ce180 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5cb7967640 1 --2- 172.21.15.130:0/156183264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5cb01617f0 0x7f5cb00cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5cb7967640 1 -- 172.21.15.130:0/156183264 >> 172.21.15.130:0/156183264 conn(0x7f5cb0065990 msgr2=0x7f5cb0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:03:59.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5cb7967640 1 -- 172.21.15.130:0/156183264 shutdown_connections 2023-09-13T06:03:59.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5cb7967640 1 -- 172.21.15.130:0/156183264 wait complete. 2023-09-13T06:03:59.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5cb7967640 1 Processor -- start 2023-09-13T06:03:59.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.990+0000 7f5cb7967640 1 -- start start 2023-09-13T06:03:59.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb7967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5cb00cc880 0x7f5cb0153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb7967640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cb00ce6c0 0x7f5cb006bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb7967640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5cb01617f0 0x7f5cb015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:03:59.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb7967640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb0153fb0 con 0x7f5cb00ce6c0 2023-09-13T06:03:59.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb7967640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb006c0f0 con 0x7f5cb01617f0 2023-09-13T06:03:59.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb7967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb0154260 con 0x7f5cb00cc880 2023-09-13T06:03:59.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb4f02640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cb00ce6c0 0x7f5cb006bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb4f02640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cb00ce6c0 0x7f5cb006bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37390/0 (socket says 172.21.15.130:37390) 2023-09-13T06:03:59.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb4f02640 1 -- 172.21.15.130:0/2061882189 learned_addr learned my addr 172.21.15.130:0/2061882189 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:03:59.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb5703640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5cb00cc880 0x7f5cb0153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb5f04640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5cb01617f0 0x7f5cb015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:03:59.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb4f02640 1 -- 172.21.15.130:0/2061882189 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5cb00cc880 msgr2=0x7f5cb0153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb4f02640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5cb00cc880 0x7f5cb0153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb4f02640 1 -- 172.21.15.130:0/2061882189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5cb01617f0 msgr2=0x7f5cb015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:03:59.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb4f02640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5cb01617f0 0x7f5cb015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:03:59.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb4f02640 1 -- 172.21.15.130:0/2061882189 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca0009420 con 0x7f5cb00ce6c0 2023-09-13T06:03:59.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb4f02640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cb00ce6c0 0x7f5cb006bbb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5ca001a080 tx=0x7f5ca00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:00.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5ca5ffb640 1 -- 172.21.15.130:0/2061882189 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00b6600 con 0x7f5cb00ce6c0 2023-09-13T06:04:00.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5ca5ffb640 1 -- 172.21.15.130:0/2061882189 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca00b6760 con 0x7f5cb00ce6c0 2023-09-13T06:04:00.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb7967640 1 -- 172.21.15.130:0/2061882189 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb0154540 con 0x7f5cb00ce6c0 2023-09-13T06:04:00.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5ca5ffb640 1 -- 172.21.15.130:0/2061882189 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00b6af0 con 0x7f5cb00ce6c0 2023-09-13T06:04:00.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb7967640 1 -- 172.21.15.130:0/2061882189 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb006b690 con 0x7f5cb00ce6c0 2023-09-13T06:04:00.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.994+0000 7f5cb7967640 1 -- 172.21.15.130:0/2061882189 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb006b880 con 0x7f5cb00ce6c0 2023-09-13T06:04:00.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.998+0000 7f5ca5ffb640 1 -- 172.21.15.130:0/2061882189 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5ca00b4040 con 0x7f5cb00ce6c0 2023-09-13T06:04:00.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.998+0000 7f5ca5ffb640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c94065b20 0x7f5c94067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:00.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.998+0000 7f5ca5ffb640 1 -- 172.21.15.130:0/2061882189 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ca011d1d0 con 0x7f5cb00ce6c0 2023-09-13T06:04:00.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.998+0000 7f5cb5703640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c94065b20 0x7f5c94067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:00.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:03:59.998+0000 7f5cb5703640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c94065b20 0x7f5c94067fe0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009ac0 tx=0x7f5cac009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:00.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.002+0000 7f5ca5ffb640 1 -- 172.21.15.130:0/2061882189 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5ca00eac60 con 0x7f5cb00ce6c0 2023-09-13T06:04:00.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.202+0000 7f5cb7967640 1 -- 172.21.15.130:0/2061882189 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5cb00618a0 con 0x7f5cb00ce6c0 2023-09-13T06:04:00.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.206+0000 7f5ca5ffb640 1 -- 172.21.15.130:0/2061882189 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5ca00ee280 con 0x7f5cb00ce6c0 2023-09-13T06:04:00.209 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:04:00.209 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:04:00.209 INFO:teuthology.orchestra.run.smithi130.stdout: caps mds = "allow" 2023-09-13T06:04:00.209 INFO:teuthology.orchestra.run.smithi130.stdout: caps mon = "allow r" 2023-09-13T06:04:00.209 INFO:teuthology.orchestra.run.smithi130.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-13T06:04:00.211 INFO:teuthology.orchestra.run.smithi130.stderr:updated caps for client.0 2023-09-13T06:04:00.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 -- 172.21.15.130:0/2061882189 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c94065b20 msgr2=0x7f5c94067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:00.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c94065b20 0x7f5c94067fe0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009ac0 tx=0x7f5cac009190 comp rx=0 tx=0).stop 2023-09-13T06:04:00.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 -- 172.21.15.130:0/2061882189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cb00ce6c0 msgr2=0x7f5cb006bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:00.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cb00ce6c0 0x7f5cb006bbb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5ca001a080 tx=0x7f5ca00191f0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 -- 172.21.15.130:0/2061882189 shutdown_connections 2023-09-13T06:04:00.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c94065b20 0x7f5c94067fe0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5cb01617f0 0x7f5cb015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cb00ce6c0 0x7f5cb006bbb0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 --2- 172.21.15.130:0/2061882189 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5cb00cc880 0x7f5cb0153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 -- 172.21.15.130:0/2061882189 >> 172.21.15.130:0/2061882189 conn(0x7f5cb0065990 msgr2=0x7f5cb006e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:00.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 -- 172.21.15.130:0/2061882189 shutdown_connections 2023-09-13T06:04:00.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.210+0000 7f5cb7967640 1 -- 172.21.15.130:0/2061882189 wait complete. 2023-09-13T06:04:00.229 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:04:00.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.366+0000 7f11a8256640 1 Processor -- start 2023-09-13T06:04:00.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.366+0000 7f11a8256640 1 -- start start 2023-09-13T06:04:00.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.366+0000 7f11a8256640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11a015b130 0x7f11a00cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:00.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.366+0000 7f11a8256640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11a00b04a0 0x7f11a00b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:00.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.366+0000 7f11a8256640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a00ce980 con 0x7f11a00ce180 2023-09-13T06:04:00.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.366+0000 7f11a8256640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a00b0e70 con 0x7f11a00b04a0 2023-09-13T06:04:00.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.366+0000 7f11a8256640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a00cec60 con 0x7f11a015b130 2023-09-13T06:04:00.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a67f3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11a00b04a0 0x7f11a00b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:00.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a67f3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11a00b04a0 0x7f11a00b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37404/0 (socket says 172.21.15.130:37404) 2023-09-13T06:04:00.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a67f3640 1 -- 172.21.15.130:0/2518489251 learned_addr learned my addr 172.21.15.130:0/2518489251 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:00.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a5ff2640 1 --2- 172.21.15.130:0/2518489251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11a015b130 0x7f11a00cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:00.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a67f3640 1 -- 172.21.15.130:0/2518489251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11a015b130 msgr2=0x7f11a00cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:00.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a67f3640 1 --2- 172.21.15.130:0/2518489251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11a015b130 0x7f11a00cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a67f3640 1 -- 172.21.15.130:0/2518489251 >> v1:172.21.15.164:6789/0 conn(0x7f11a00ce180 legacy=0x7f11a015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:00.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a67f3640 1 -- 172.21.15.130:0/2518489251 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a006c640 con 0x7f11a00b04a0 2023-09-13T06:04:00.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a67f3640 1 --2- 172.21.15.130:0/2518489251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a00b04a0 0x7f11a00b0930 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1198009e50 tx=0x7f119801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e37e0af542121e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:00.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a4ff0640 1 -- 172.21.15.130:0/2518489251 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11980a58e0 con 0x7f11a00b04a0 2023-09-13T06:04:00.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a4ff0640 1 -- 172.21.15.130:0/2518489251 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11980a5a40 con 0x7f11a00b04a0 2023-09-13T06:04:00.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.370+0000 7f11a4ff0640 1 -- 172.21.15.130:0/2518489251 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11980a5dd0 con 0x7f11a00b04a0 2023-09-13T06:04:00.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 -- 172.21.15.130:0/2518489251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a00b04a0 msgr2=0x7f11a00b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:00.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 --2- 172.21.15.130:0/2518489251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a00b04a0 0x7f11a00b0930 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1198009e50 tx=0x7f119801ca10 comp rx=0 tx=0).stop 2023-09-13T06:04:00.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 -- 172.21.15.130:0/2518489251 shutdown_connections 2023-09-13T06:04:00.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 --2- 172.21.15.130:0/2518489251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a00b04a0 0x7f11a00b0930 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 --2- 172.21.15.130:0/2518489251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11a015b130 0x7f11a00cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 -- 172.21.15.130:0/2518489251 >> 172.21.15.130:0/2518489251 conn(0x7f11a0065990 msgr2=0x7f11a0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:00.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 -- 172.21.15.130:0/2518489251 shutdown_connections 2023-09-13T06:04:00.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 -- 172.21.15.130:0/2518489251 wait complete. 2023-09-13T06:04:00.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 Processor -- start 2023-09-13T06:04:00.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 -- start start 2023-09-13T06:04:00.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a00b04a0 0x7f11a014ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:00.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a00ce180 0x7f11a0157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:00.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11a015b130 0x7f11a0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:00.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a014ec20 con 0x7f11a00ce180 2023-09-13T06:04:00.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a014f690 con 0x7f11a00b04a0 2023-09-13T06:04:00.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a8256640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a0158870 con 0x7f11a015b130 2023-09-13T06:04:00.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a57f1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a00ce180 0x7f11a0157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:00.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a5ff2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a00b04a0 0x7f11a014ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:00.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a5ff2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a00b04a0 0x7f11a014ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:32908/0 (socket says 172.21.15.130:32908) 2023-09-13T06:04:00.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a57f1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a00ce180 0x7f11a0157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37420/0 (socket says 172.21.15.130:37420) 2023-09-13T06:04:00.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a57f1640 1 -- 172.21.15.130:0/3082438472 learned_addr learned my addr 172.21.15.130:0/3082438472 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:00.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.374+0000 7f11a67f3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11a015b130 0x7f11a0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:00.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11a57f1640 1 -- 172.21.15.130:0/3082438472 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11a015b130 msgr2=0x7f11a0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:00.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11a57f1640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11a015b130 0x7f11a0159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11a57f1640 1 -- 172.21.15.130:0/3082438472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a00b04a0 msgr2=0x7f11a014ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:00.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11a57f1640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a00b04a0 0x7f11a014ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11a57f1640 1 -- 172.21.15.130:0/3082438472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1198009b30 con 0x7f11a00ce180 2023-09-13T06:04:00.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11a57f1640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a00ce180 0x7f11a0157f90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f119000c420 tx=0x7f119000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:00.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11967fc640 1 -- 172.21.15.130:0/3082438472 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11900052d0 con 0x7f11a00ce180 2023-09-13T06:04:00.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11967fc640 1 -- 172.21.15.130:0/3082438472 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1190005430 con 0x7f11a00ce180 2023-09-13T06:04:00.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11a8256640 1 -- 172.21.15.130:0/3082438472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a014f040 con 0x7f11a00ce180 2023-09-13T06:04:00.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11967fc640 1 -- 172.21.15.130:0/3082438472 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190007260 con 0x7f11a00ce180 2023-09-13T06:04:00.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11a8256640 1 -- 172.21.15.130:0/3082438472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a014b1c0 con 0x7f11a00ce180 2023-09-13T06:04:00.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11a8256640 1 -- 172.21.15.130:0/3082438472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a014eea0 con 0x7f11a00ce180 2023-09-13T06:04:00.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11967fc640 1 -- 172.21.15.130:0/3082438472 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f11900073c0 con 0x7f11a00ce180 2023-09-13T06:04:00.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11967fc640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1184065b50 0x7f1184068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:00.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.378+0000 7f11967fc640 1 -- 172.21.15.130:0/3082438472 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11900825e0 con 0x7f11a00ce180 2023-09-13T06:04:00.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.382+0000 7f11a5ff2640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1184065b50 0x7f1184068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:00.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.382+0000 7f11a5ff2640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1184065b50 0x7f1184068010 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f119c009ac0 tx=0x7f119c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:00.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.382+0000 7f11967fc640 1 -- 172.21.15.130:0/3082438472 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f11a014eea0 con 0x7f11a00ce180 2023-09-13T06:04:00.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.566+0000 7f11a8256640 1 -- 172.21.15.130:0/3082438472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11a014eea0 con 0x7f11a00ce180 2023-09-13T06:04:00.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.566+0000 7f11967fc640 1 -- 172.21.15.130:0/3082438472 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f11a014eea0 con 0x7f11a00ce180 2023-09-13T06:04:00.569 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:04:00.569 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1338889971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1338889971},{"type":"v1","addr":"172.21.15.164:6835","nonce":1338889971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1298091712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1298091712},{"type":"v1","addr":"172.21.15.130:6835","nonce":1298091712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/798128577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":798128577},{"type":"v1","addr":"172.21.15.130:6837","nonce":798128577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:03:54.710730+0000","modified":"2023-09-13T06:03:57.752848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6087":{"gid":6087,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2038440053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2038440053},{"type":"v1","addr":"172.21.15.164:6833","nonce":2038440053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-09-13T06:04:00.569 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 34 2023-09-13T06:04:00.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 -- 172.21.15.130:0/3082438472 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1184065b50 msgr2=0x7f1184068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:00.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1184065b50 0x7f1184068010 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f119c009ac0 tx=0x7f119c009190 comp rx=0 tx=0).stop 2023-09-13T06:04:00.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 -- 172.21.15.130:0/3082438472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a00ce180 msgr2=0x7f11a0157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:00.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a00ce180 0x7f11a0157f90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f119000c420 tx=0x7f119000c8e0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 -- 172.21.15.130:0/3082438472 shutdown_connections 2023-09-13T06:04:00.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1184065b50 0x7f1184068010 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11a015b130 0x7f11a0159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a00ce180 0x7f11a0157f90 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 --2- 172.21.15.130:0/3082438472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a00b04a0 0x7f11a014ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:00.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 -- 172.21.15.130:0/3082438472 >> 172.21.15.130:0/3082438472 conn(0x7f11a0065990 msgr2=0x7f11a00b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:00.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 -- 172.21.15.130:0/3082438472 shutdown_connections 2023-09-13T06:04:00.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:00.570+0000 7f11a8256640 1 -- 172.21.15.130:0/3082438472 wait complete. 2023-09-13T06:04:00.992 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T06:03:54.710730+0000', 'modified': '2023-09-13T06:03:57.752848+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6087}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6087': {'gid': 6087, 'name': 'b', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.164:6833/2038440053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6832', 'nonce': 2038440053}, {'type': 'v1', 'addr': '172.21.15.164:6833', 'nonce': 2038440053}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T06:04:00.993 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T06:04:00.993 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-13T06:04:01.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.130+0000 7f521faec640 1 Processor -- start 2023-09-13T06:04:01.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521faec640 1 -- start start 2023-09-13T06:04:01.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521faec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521815b130 0x7f52180cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521faec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f52180b04a0 0x7f52180b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521faec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52180ce980 con 0x7f52180ce180 2023-09-13T06:04:01.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521faec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52180b0e70 con 0x7f52180b04a0 2023-09-13T06:04:01.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521faec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52180cec60 con 0x7f521815b130 2023-09-13T06:04:01.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521d087640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f52180ce180 0x7f521815b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48192/0 (socket says 172.21.15.130:48192) 2023-09-13T06:04:01.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521d087640 1 -- 172.21.15.130:0/2401057252 learned_addr learned my addr 172.21.15.130:0/2401057252 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:04:01.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521d888640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521815b130 0x7f52180cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521e089640 1 --2- 172.21.15.130:0/2401057252 >> v2:172.21.15.164:3300/0 conn(0x7f52180b04a0 0x7f52180b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591878694 0 0) 0x7f52180ce980 con 0x7f52180ce180 2023-09-13T06:04:01.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5204003530 con 0x7f52180ce180 2023-09-13T06:04:01.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1394430750 0 0) 0x7f5204003530 con 0x7f52180ce180 2023-09-13T06:04:01.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521815b130 msgr2=0x7f52180cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521815b130 0x7f52180cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 >> v2:172.21.15.164:3300/0 conn(0x7f52180b04a0 msgr2=0x7f52180b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 --2- 172.21.15.130:0/2401057252 >> v2:172.21.15.164:3300/0 conn(0x7f52180b04a0 0x7f52180b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521806c640 con 0x7f52180ce180 2023-09-13T06:04:01.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f5208001680 con 0x7f52180ce180 2023-09-13T06:04:01.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 >> v1:172.21.15.130:6789/0 conn(0x7f52180ce180 legacy=0x7f521815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52040039f0 0x7f5204003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521815b130 0x7f52040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5204004d10 0x7f5204005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52180b0e70 con 0x7f52040039f0 2023-09-13T06:04:01.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52180cec60 con 0x7f5204004d10 2023-09-13T06:04:01.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520400b990 con 0x7f521815b130 2023-09-13T06:04:01.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521e089640 1 --2- 172.21.15.130:0/2401057252 >> v2:172.21.15.164:3300/0 conn(0x7f52180b04a0 0x7f52180b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:04:01.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521d888640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52040039f0 0x7f5204003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521d087640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521815b130 0x7f52040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521e089640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5204004d10 0x7f5204005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521d888640 1 -- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521815b130 msgr2=0x7f52040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521d888640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521815b130 0x7f52040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521d888640 1 -- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5204004d10 msgr2=0x7f5204005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521d888640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5204004d10 0x7f5204005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521d888640 1 -- 172.21.15.130:0/2401057252 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5204003530 con 0x7f52040039f0 2023-09-13T06:04:01.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.134+0000 7f521e089640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5204004d10 0x7f5204005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:04:01.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.138+0000 7f521d888640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52040039f0 0x7f5204003e10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5214009ac0 tx=0x7f521401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49acf354cce932 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:01.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.138+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52140a55d0 con 0x7f52040039f0 2023-09-13T06:04:01.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.138+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52140a5730 con 0x7f52040039f0 2023-09-13T06:04:01.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.138+0000 7f521c886640 1 -- 172.21.15.130:0/2401057252 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52140a5ac0 con 0x7f52040039f0 2023-09-13T06:04:01.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.138+0000 7f521faec640 1 -- 172.21.15.130:0/2401057252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52040039f0 msgr2=0x7f5204003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.138+0000 7f521faec640 1 --2- 172.21.15.130:0/2401057252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52040039f0 0x7f5204003e10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5214009ac0 tx=0x7f521401ca00 comp rx=0 tx=0).stop 2023-09-13T06:04:01.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.138+0000 7f521e089640 1 -- 172.21.15.130:0/2401057252 reap_dead start 2023-09-13T06:04:01.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.138+0000 7f521faec640 1 -- 172.21.15.130:0/2401057252 shutdown_connections 2023-09-13T06:04:01.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.138+0000 7f521faec640 1 -- 172.21.15.130:0/2401057252 >> 172.21.15.130:0/2401057252 conn(0x7f5218065990 msgr2=0x7f5218065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:01.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.138+0000 7f521faec640 1 -- 172.21.15.130:0/2401057252 shutdown_connections 2023-09-13T06:04:01.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.138+0000 7f521faec640 1 -- 172.21.15.130:0/2401057252 wait complete. 2023-09-13T06:04:01.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521faec640 1 Processor -- start 2023-09-13T06:04:01.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521faec640 1 -- start start 2023-09-13T06:04:01.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521faec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5218148aa0 0x7f52180c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521faec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5218148e80 0x7f5218159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521faec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5218159e50 0x7f52180c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521faec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521815a3b0 con 0x7f5218148aa0 2023-09-13T06:04:01.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521faec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521815c560 con 0x7f5218159e50 2023-09-13T06:04:01.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521faec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521815c840 con 0x7f5218148e80 2023-09-13T06:04:01.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521d888640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5218148aa0 0x7f52180c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521d888640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5218148aa0 0x7f52180c2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54536/0 (socket says 172.21.15.130:54536) 2023-09-13T06:04:01.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521d888640 1 -- 172.21.15.130:0/990716922 learned_addr learned my addr 172.21.15.130:0/990716922 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:01.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521d087640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5218148e80 0x7f5218159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521e089640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5218159e50 0x7f52180c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521d888640 1 -- 172.21.15.130:0/990716922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5218148e80 msgr2=0x7f5218159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521d888640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5218148e80 0x7f5218159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521d888640 1 -- 172.21.15.130:0/990716922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5218159e50 msgr2=0x7f52180c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521d888640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5218159e50 0x7f52180c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521d888640 1 -- 172.21.15.130:0/990716922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521815cb20 con 0x7f5218148aa0 2023-09-13T06:04:01.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521d888640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5218148aa0 0x7f52180c2b90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f521401d2a0 tx=0x7f52140197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:01.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f520e7fc640 1 -- 172.21.15.130:0/990716922 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52140a55d0 con 0x7f5218148aa0 2023-09-13T06:04:01.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f520e7fc640 1 -- 172.21.15.130:0/990716922 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521400f000 con 0x7f5218148aa0 2023-09-13T06:04:01.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521faec640 1 -- 172.21.15.130:0/990716922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521815ce00 con 0x7f5218148aa0 2023-09-13T06:04:01.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f520e7fc640 1 -- 172.21.15.130:0/990716922 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52140b8660 con 0x7f5218148aa0 2023-09-13T06:04:01.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.142+0000 7f521faec640 1 -- 172.21.15.130:0/990716922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52180c30d0 con 0x7f5218148aa0 2023-09-13T06:04:01.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f520e7fc640 1 -- 172.21.15.130:0/990716922 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f52140b4040 con 0x7f5218148aa0 2023-09-13T06:04:01.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f520e7fc640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51fc065b50 0x7f51fc068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f520e7fc640 1 -- 172.21.15.130:0/990716922 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f521411c9f0 con 0x7f5218148aa0 2023-09-13T06:04:01.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f521d087640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51fc065b50 0x7f51fc068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f5222e6d000 1 Processor -- start 2023-09-13T06:04:01.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f5222e6d000 1 -- start start 2023-09-13T06:04:01.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f521d087640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51fc065b50 0x7f51fc068010 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5208000c10 tx=0x7f5208009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:01.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f085550 0x564a7f085930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f069d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f06a2b0 0x564a7f06a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f5222e6d000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7ef031e0 con 0x564a7f085e70 2023-09-13T06:04:01.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f5222e6d000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7ee924c0 con 0x564a7f085550 2023-09-13T06:04:01.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f5222e6d000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a7ee8f9f0 con 0x564a7f06a2b0 2023-09-13T06:04:01.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f521d087640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f521d087640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f069d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54540/0 (socket says 172.21.15.130:54540) 2023-09-13T06:04:01.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f521d087640 1 -- 172.21.15.130:0/3996562970 learned_addr learned my addr 172.21.15.130:0/3996562970 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:01.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f521d888640 1 --2- 172.21.15.130:0/3996562970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f085550 0x564a7f085930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.146+0000 7f521e089640 1 --2- 172.21.15.130:0/3996562970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f06a2b0 0x564a7f06a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 -- 172.21.15.130:0/3996562970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f06a2b0 msgr2=0x564a7f06a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 --2- 172.21.15.130:0/3996562970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f06a2b0 0x564a7f06a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 -- 172.21.15.130:0/3996562970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f085550 msgr2=0x564a7f085930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 --2- 172.21.15.130:0/3996562970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f085550 0x564a7f085930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 -- 172.21.15.130:0/3996562970 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a7eb85890 con 0x564a7f085e70 2023-09-13T06:04:01.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 --2- 172.21.15.130:0/3996562970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f069d70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5208010a80 tx=0x7f520800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c21acc27d32015 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:01.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f51fb7fe640 1 -- 172.21.15.130:0/3996562970 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208014b80 con 0x564a7f085e70 2023-09-13T06:04:01.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f51fb7fe640 1 -- 172.21.15.130:0/3996562970 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5208014ce0 con 0x564a7f085e70 2023-09-13T06:04:01.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f51fb7fe640 1 -- 172.21.15.130:0/3996562970 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208021620 con 0x564a7f085e70 2023-09-13T06:04:01.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 -- 172.21.15.130:0/3996562970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 msgr2=0x564a7f069d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 --2- 172.21.15.130:0/3996562970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f069d70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5208010a80 tx=0x7f520800c000 comp rx=0 tx=0).stop 2023-09-13T06:04:01.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 -- 172.21.15.130:0/3996562970 shutdown_connections 2023-09-13T06:04:01.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 --2- 172.21.15.130:0/3996562970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f06a2b0 0x564a7f06a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 --2- 172.21.15.130:0/3996562970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f069d70 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 --2- 172.21.15.130:0/3996562970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f085550 0x564a7f085930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 -- 172.21.15.130:0/3996562970 >> 172.21.15.130:0/3996562970 conn(0x564a7f032c40 msgr2=0x564a7f041c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:01.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 -- 172.21.15.130:0/3996562970 shutdown_connections 2023-09-13T06:04:01.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 -- 172.21.15.130:0/3996562970 wait complete. 2023-09-13T06:04:01.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 -- start start 2023-09-13T06:04:01.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 Processor -- start 2023-09-13T06:04:01.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085550 0x564a7f03f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085e70 0x564a7f03f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7ee8b2e0 con 0x564a7f085550 2023-09-13T06:04:01.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7ee45fe0 con 0x564a7f06a2b0 2023-09-13T06:04:01.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a7ee45c80 con 0x564a7f085e70 2023-09-13T06:04:01.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f5222e6d000 10 client.0 _ll_register_callbacks cb 0x564a7f027260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:04:01.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085550 0x564a7f03f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085550 0x564a7f03f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54548/0 (socket says 172.21.15.130:54548) 2023-09-13T06:04:01.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 -- 172.21.15.130:0/3306276973 learned_addr learned my addr 172.21.15.130:0/3306276973 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:01.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d888640 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521e089640 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085e70 0x564a7f03f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 -- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085e70 msgr2=0x564a7f03f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085e70 0x564a7f03f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 -- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 msgr2=0x564a7f069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f069b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.150+0000 7f521d087640 1 -- 172.21.15.130:0/3306276973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520800f040 con 0x564a7f085550 2023-09-13T06:04:01.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f521e089640 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085e70 0x564a7f03f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:04:01.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f521d087640 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085550 0x564a7f03f040 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x564a7ee36ca0 tx=0x7f5208001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94654150b5dd84e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:01.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f51f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:04:01.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f51f8ff9640 1 -- 172.21.15.130:0/3306276973 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520802c830 con 0x564a7f085550 2023-09-13T06:04:01.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 -- 172.21.15.130:0/3306276973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a7ee22a50 con 0x564a7f085550 2023-09-13T06:04:01.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f51f8ff9640 1 -- 172.21.15.130:0/3306276973 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f520801c050 con 0x564a7f085550 2023-09-13T06:04:01.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f51f8ff9640 1 -- 172.21.15.130:0/3306276973 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f520802c990 con 0x564a7f085550 2023-09-13T06:04:01.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 10 client.6219 fetch_fsmap learned FSMap version 34 2023-09-13T06:04:01.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 -- 172.21.15.130:0/3306276973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x564a7ee4e210 con 0x564a7f085550 2023-09-13T06:04:01.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f51f8ff9640 1 -- 172.21.15.130:0/3306276973 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564a7ee22a50 con 0x564a7f085550 2023-09-13T06:04:01.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f51f8ff9640 1 -- 172.21.15.130:0/3306276973 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f520802caf0 con 0x564a7f085550 2023-09-13T06:04:01.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 10 client.6219 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T06:04:01.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 10 client.6219 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T06:04:01.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 20 client.6219 populate_metadata read hostname 'smithi130' 2023-09-13T06:04:01.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:6832/2038440053,v1:172.21.15.164:6833/2038440053] conn(0x564a7f03ff90 0x564a7f040370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 4 client.6219 mds_command: new command op to 6087 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T06:04:01.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 -- 172.21.15.130:0/3306276973 --> [v2:172.21.15.164:6832/2038440053,v1:172.21.15.164:6833/2038440053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a7ee42820 con 0x564a7f03ff90 2023-09-13T06:04:01.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f521d888640 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:6832/2038440053,v1:172.21.15.164:6833/2038440053] conn(0x564a7f03ff90 0x564a7f040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f521d888640 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:6832/2038440053,v1:172.21.15.164:6833/2038440053] conn(0x564a7f03ff90 0x564a7f040370 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2cad0c41777fcf4 server_cookie=88fa31431f89de6a in_seq=0 out_seq=0 2023-09-13T06:04:01.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f51f8ff9640 10 client.6219 ms_handle_connect on v2:172.21.15.164:6832/2038440053 2023-09-13T06:04:01.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f51f8ff9640 1 -- 172.21.15.130:0/3306276973 <== mds.0 v2:172.21.15.164:6832/2038440053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564a7ee42820 con 0x564a7f03ff90 2023-09-13T06:04:01.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f51f8ff9640 10 client.6219 handle_command_reply: tid=0 2023-09-13T06:04:01.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 client.6219 shutdown 2023-09-13T06:04:01.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 -- 172.21.15.130:0/3306276973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085550 msgr2=0x564a7f03f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085550 0x564a7f03f040 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x564a7ee36ca0 tx=0x7f5208001a10 comp rx=0 tx=0).stop 2023-09-13T06:04:01.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 -- 172.21.15.130:0/3306276973 shutdown_connections 2023-09-13T06:04:01.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:6832/2038440053,v1:172.21.15.164:6833/2038440053] conn(0x564a7f03ff90 0x564a7f040370 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085e70 0x564a7f03f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085550 0x564a7f03f040 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f51f8ff9640 0 client.6219 ms_handle_reset on v2:172.21.15.164:6832/2038440053 2023-09-13T06:04:01.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 --2- 172.21.15.130:0/3306276973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f069b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 -- 172.21.15.130:0/3306276973 >> 172.21.15.130:0/3306276973 conn(0x564a7f032c40 msgr2=0x564a7f06b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:01.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 -- 172.21.15.130:0/3306276973 shutdown_connections 2023-09-13T06:04:01.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 1 -- 172.21.15.130:0/3306276973 wait complete. 2023-09-13T06:04:01.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.154+0000 7f5222e6d000 20 client.6219 trim_cache size 0 max 16384 2023-09-13T06:04:01.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f5222e6d000 1 Processor -- start 2023-09-13T06:04:01.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f5222e6d000 1 -- start start 2023-09-13T06:04:01.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f03f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085550 0x564a7f03dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f03e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f5222e6d000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7eb46940 con 0x564a7f085e70 2023-09-13T06:04:01.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f5222e6d000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7ee8f2e0 con 0x564a7f06a2b0 2023-09-13T06:04:01.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f5222e6d000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a7eb861b0 con 0x564a7f085550 2023-09-13T06:04:01.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f521e089640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f03e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f521e089640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f03e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54552/0 (socket says 172.21.15.130:54552) 2023-09-13T06:04:01.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f521e089640 1 -- 172.21.15.130:0/773092007 learned_addr learned my addr 172.21.15.130:0/773092007 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:01.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f521d888640 1 --2- 172.21.15.130:0/773092007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f03f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.170+0000 7f521d087640 1 --2- 172.21.15.130:0/773092007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085550 0x564a7f03dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 -- 172.21.15.130:0/773092007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085550 msgr2=0x564a7f03dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 --2- 172.21.15.130:0/773092007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085550 0x564a7f03dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 -- 172.21.15.130:0/773092007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 msgr2=0x564a7f03f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 --2- 172.21.15.130:0/773092007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f03f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 -- 172.21.15.130:0/773092007 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a7ee344a0 con 0x564a7f085e70 2023-09-13T06:04:01.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521d888640 1 --2- 172.21.15.130:0/773092007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f03f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:04:01.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 --2- 172.21.15.130:0/773092007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f03e530 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f521806bbe0 tx=0x7f521000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de36400dfe8c1c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:01.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f51fbfff640 1 -- 172.21.15.130:0/773092007 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210019640 con 0x564a7f085e70 2023-09-13T06:04:01.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f51fbfff640 1 -- 172.21.15.130:0/773092007 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5210011040 con 0x564a7f085e70 2023-09-13T06:04:01.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f51fbfff640 1 -- 172.21.15.130:0/773092007 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52100199e0 con 0x564a7f085e70 2023-09-13T06:04:01.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 -- 172.21.15.130:0/773092007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 msgr2=0x564a7f03e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 --2- 172.21.15.130:0/773092007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f03e530 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f521806bbe0 tx=0x7f521000b040 comp rx=0 tx=0).stop 2023-09-13T06:04:01.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 -- 172.21.15.130:0/773092007 shutdown_connections 2023-09-13T06:04:01.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 --2- 172.21.15.130:0/773092007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f03e530 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 --2- 172.21.15.130:0/773092007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085550 0x564a7f03dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 --2- 172.21.15.130:0/773092007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f03f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 -- 172.21.15.130:0/773092007 >> 172.21.15.130:0/773092007 conn(0x564a7f032c40 msgr2=0x564a7f092b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:01.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 -- 172.21.15.130:0/773092007 shutdown_connections 2023-09-13T06:04:01.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 -- 172.21.15.130:0/773092007 wait complete. 2023-09-13T06:04:01.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 -- start start 2023-09-13T06:04:01.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 Processor -- start 2023-09-13T06:04:01.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f0e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085550 0x564a7f099920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f099e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7ee426c0 con 0x564a7f085e70 2023-09-13T06:04:01.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7ee93a90 con 0x564a7f06a2b0 2023-09-13T06:04:01.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a7ee886e0 con 0x564a7f085550 2023-09-13T06:04:01.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f5222e6d000 10 client.0 _ll_register_callbacks cb 0x564a7ee41ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:04:01.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f099e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f099e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54558/0 (socket says 172.21.15.130:54558) 2023-09-13T06:04:01.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 -- 172.21.15.130:0/2748853301 learned_addr learned my addr 172.21.15.130:0/2748853301 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:01.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521d087640 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085550 0x564a7f099920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521d888640 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f0e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 -- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085550 msgr2=0x564a7f099920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085550 0x564a7f099920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 -- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 msgr2=0x564a7f0e2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:01.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f0e2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521e089640 1 -- 172.21.15.130:0/2748853301 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5210009a70 con 0x564a7f085e70 2023-09-13T06:04:01.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521d087640 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085550 0x564a7f099920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:04:01.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.174+0000 7f521d888640 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f0e2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:04:01.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521e089640 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f099e60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x564a7ee31990 tx=0x7f5210004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b07c0c4081069f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:01.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f51f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:04:01.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f51f8ff9640 1 -- 172.21.15.130:0/2748853301 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210019850 con 0x564a7f085e70 2023-09-13T06:04:01.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 -- 172.21.15.130:0/2748853301 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a7ee46900 con 0x564a7f085e70 2023-09-13T06:04:01.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f51f8ff9640 1 -- 172.21.15.130:0/2748853301 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52100199b0 con 0x564a7f085e70 2023-09-13T06:04:01.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f51f8ff9640 1 -- 172.21.15.130:0/2748853301 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5210019bb0 con 0x564a7f085e70 2023-09-13T06:04:01.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 10 client.6225 fetch_fsmap learned FSMap version 34 2023-09-13T06:04:01.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 -- 172.21.15.130:0/2748853301 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x564a7eb85cc0 con 0x564a7f085e70 2023-09-13T06:04:01.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f51f8ff9640 1 -- 172.21.15.130:0/2748853301 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564a7ee46900 con 0x564a7f085e70 2023-09-13T06:04:01.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f51f8ff9640 1 -- 172.21.15.130:0/2748853301 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5210016050 con 0x564a7f085e70 2023-09-13T06:04:01.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 10 client.6225 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T06:04:01.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 10 client.6225 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T06:04:01.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 20 client.6225 populate_metadata read hostname 'smithi130' 2023-09-13T06:04:01.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:6832/2038440053,v1:172.21.15.164:6833/2038440053] conn(0x564a7f09a3a0 0x564a7f09a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 4 client.6225 mds_command: new command op to 6087 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T06:04:01.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 -- 172.21.15.130:0/2748853301 --> [v2:172.21.15.164:6832/2038440053,v1:172.21.15.164:6833/2038440053] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564a7ee842c0 con 0x564a7f09a3a0 2023-09-13T06:04:01.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521d888640 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:6832/2038440053,v1:172.21.15.164:6833/2038440053] conn(0x564a7f09a3a0 0x564a7f09a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f51f8ff9640 10 client.6225 ms_handle_connect on v2:172.21.15.164:6832/2038440053 2023-09-13T06:04:01.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521d888640 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:6832/2038440053,v1:172.21.15.164:6833/2038440053] conn(0x564a7f09a3a0 0x564a7f09a780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1510a7f99cc591e1 server_cookie=4614d6606bbaa7e1 in_seq=0 out_seq=0 2023-09-13T06:04:01.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f51f8ff9640 1 -- 172.21.15.130:0/2748853301 <== mds.0 v2:172.21.15.164:6832/2038440053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564a7ee842c0 con 0x564a7f09a3a0 2023-09-13T06:04:01.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f51f8ff9640 10 client.6225 handle_command_reply: tid=0 2023-09-13T06:04:01.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 client.6225 shutdown 2023-09-13T06:04:01.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 -- 172.21.15.130:0/2748853301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 msgr2=0x564a7f099e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f099e60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x564a7ee31990 tx=0x7f5210004ac0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 -- 172.21.15.130:0/2748853301 shutdown_connections 2023-09-13T06:04:01.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:6832/2038440053,v1:172.21.15.164:6833/2038440053] conn(0x564a7f09a3a0 0x564a7f09a780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a7f085e70 0x564a7f099e60 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x564a7f085550 0x564a7f099920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 --2- 172.21.15.130:0/2748853301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564a7f06a2b0 0x564a7f0e2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 -- 172.21.15.130:0/2748853301 >> 172.21.15.130:0/2748853301 conn(0x564a7f032c40 msgr2=0x564a7f068620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:01.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f51f8ff9640 0 client.6225 ms_handle_reset on v2:172.21.15.164:6832/2038440053 2023-09-13T06:04:01.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 -- 172.21.15.130:0/2748853301 shutdown_connections 2023-09-13T06:04:01.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 1 -- 172.21.15.130:0/2748853301 wait complete. 2023-09-13T06:04:01.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f5222e6d000 20 client.6225 trim_cache size 0 max 16384 2023-09-13T06:04:01.202 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:04:01.202 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:04:01.202 INFO:teuthology.orchestra.run.smithi130.stdout: "whoami": 0, 2023-09-13T06:04:01.202 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 6087, 2023-09-13T06:04:01.202 INFO:teuthology.orchestra.run.smithi130.stdout: "want_state": "up:active", 2023-09-13T06:04:01.203 INFO:teuthology.orchestra.run.smithi130.stdout: "state": "up:active", 2023-09-13T06:04:01.203 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs", 2023-09-13T06:04:01.203 INFO:teuthology.orchestra.run.smithi130.stdout: "rank_uptime": 5.8136923210000004, 2023-09-13T06:04:01.203 INFO:teuthology.orchestra.run.smithi130.stdout: "mdsmap_epoch": 34, 2023-09-13T06:04:01.203 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch": 65, 2023-09-13T06:04:01.204 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch_barrier": 65, 2023-09-13T06:04:01.204 INFO:teuthology.orchestra.run.smithi130.stdout: "uptime": 11.004115434999999 2023-09-13T06:04:01.204 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:04:01.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 -- 172.21.15.130:0/990716922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51fc065b50 msgr2=0x7f51fc068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51fc065b50 0x7f51fc068010 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5208000c10 tx=0x7f5208009040 comp rx=0 tx=0).stop 2023-09-13T06:04:01.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 -- 172.21.15.130:0/990716922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5218148aa0 msgr2=0x7f52180c2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5218148aa0 0x7f52180c2b90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f521401d2a0 tx=0x7f52140197a0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 -- 172.21.15.130:0/990716922 shutdown_connections 2023-09-13T06:04:01.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51fc065b50 0x7f51fc068010 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5218159e50 0x7f52180c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5218148e80 0x7f5218159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 --2- 172.21.15.130:0/990716922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5218148aa0 0x7f52180c2b90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 -- 172.21.15.130:0/990716922 >> 172.21.15.130:0/990716922 conn(0x7f5218065990 msgr2=0x7f52180ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:01.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 -- 172.21.15.130:0/990716922 shutdown_connections 2023-09-13T06:04:01.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.178+0000 7f521faec640 1 -- 172.21.15.130:0/990716922 wait complete. 2023-09-13T06:04:01.208 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:04:01.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.342+0000 7f1e417db640 1 Processor -- start 2023-09-13T06:04:01.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e417db640 1 -- start start 2023-09-13T06:04:01.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e417db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e3c0d1750 0x7f1e3c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e417db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c0b63c0 con 0x7f1e3c0d1090 2023-09-13T06:04:01.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e417db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c0d0c20 con 0x7f1e3c146f30 2023-09-13T06:04:01.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e417db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c15dea0 con 0x7f1e3c0d1750 2023-09-13T06:04:01.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e3a7fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1e3c0d1090 0x7f1e3c146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48206/0 (socket says 172.21.15.130:48206) 2023-09-13T06:04:01.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e3a7fc640 1 -- 172.21.15.130:0/709678570 learned_addr learned my addr 172.21.15.130:0/709678570 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:04:01.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e3affd640 1 --2- 172.21.15.130:0/709678570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e3c0d1750 0x7f1e3c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e39ffb640 1 -- 172.21.15.130:0/709678570 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451510432 0 0) 0x7f1e3c0b63c0 con 0x7f1e3c0d1090 2023-09-13T06:04:01.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e39ffb640 1 -- 172.21.15.130:0/709678570 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e24003530 con 0x7f1e3c0d1090 2023-09-13T06:04:01.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e39ffb640 1 -- 172.21.15.130:0/709678570 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560013913 0 0) 0x7f1e3c0d0c20 con 0x7f1e3c146f30 2023-09-13T06:04:01.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e3affd640 1 -- 172.21.15.130:0/709678570 >> v1:172.21.15.164:6789/0 conn(0x7f1e3c146f30 legacy=0x7f1e3c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e3affd640 1 -- 172.21.15.130:0/709678570 >> v1:172.21.15.130:6789/0 conn(0x7f1e3c0d1090 legacy=0x7f1e3c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.346+0000 7f1e3affd640 1 -- 172.21.15.130:0/709678570 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c0b6610 con 0x7f1e3c0d1750 2023-09-13T06:04:01.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e3affd640 1 --2- 172.21.15.130:0/709678570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e3c0d1750 0x7f1e3c15d960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0097f0 tx=0x7f1e2c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5664c8808bf22b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:01.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e39ffb640 1 -- 172.21.15.130:0/709678570 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0aa5f0 con 0x7f1e3c0d1750 2023-09-13T06:04:01.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e39ffb640 1 -- 172.21.15.130:0/709678570 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0aa750 con 0x7f1e3c0d1750 2023-09-13T06:04:01.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e39ffb640 1 -- 172.21.15.130:0/709678570 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0aaae0 con 0x7f1e3c0d1750 2023-09-13T06:04:01.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e417db640 1 -- 172.21.15.130:0/709678570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e3c0d1750 msgr2=0x7f1e3c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e417db640 1 --2- 172.21.15.130:0/709678570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e3c0d1750 0x7f1e3c15d960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0097f0 tx=0x7f1e2c01c490 comp rx=0 tx=0).stop 2023-09-13T06:04:01.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e417db640 1 -- 172.21.15.130:0/709678570 shutdown_connections 2023-09-13T06:04:01.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e417db640 1 --2- 172.21.15.130:0/709678570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e3c0d1750 0x7f1e3c15d960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e417db640 1 -- 172.21.15.130:0/709678570 >> 172.21.15.130:0/709678570 conn(0x7f1e3c06f170 msgr2=0x7f1e3c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:01.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e417db640 1 -- 172.21.15.130:0/709678570 shutdown_connections 2023-09-13T06:04:01.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e417db640 1 -- 172.21.15.130:0/709678570 wait complete. 2023-09-13T06:04:01.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.350+0000 7f1e417db640 1 Processor -- start 2023-09-13T06:04:01.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e417db640 1 -- start start 2023-09-13T06:04:01.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e417db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e3c0d1090 0x7f1e3c15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e417db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e3c0d1750 0x7f1e3c1390b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e417db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e3c146f30 0x7f1e3c13fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e417db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c13c320 con 0x7f1e3c146f30 2023-09-13T06:04:01.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e417db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c13bd60 con 0x7f1e3c0d1750 2023-09-13T06:04:01.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e417db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c13c040 con 0x7f1e3c0d1090 2023-09-13T06:04:01.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e3b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e3c146f30 0x7f1e3c13fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e3b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e3c146f30 0x7f1e3c13fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54568/0 (socket says 172.21.15.130:54568) 2023-09-13T06:04:01.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e3b7fe640 1 -- 172.21.15.130:0/3686995904 learned_addr learned my addr 172.21.15.130:0/3686995904 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:01.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e3affd640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e3c0d1090 0x7f1e3c15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e3a7fc640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e3c0d1750 0x7f1e3c1390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e3b7fe640 1 -- 172.21.15.130:0/3686995904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e3c0d1090 msgr2=0x7f1e3c15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e3b7fe640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e3c0d1090 0x7f1e3c15cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e3b7fe640 1 -- 172.21.15.130:0/3686995904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e3c0d1750 msgr2=0x7f1e3c1390b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e3b7fe640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e3c0d1750 0x7f1e3c1390b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e3b7fe640 1 -- 172.21.15.130:0/3686995904 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c009420 con 0x7f1e3c146f30 2023-09-13T06:04:01.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e3b7fe640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e3c146f30 0x7f1e3c13fe80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1e34002240 tx=0x7f1e3400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:01.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e237fe640 1 -- 172.21.15.130:0/3686995904 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34003db0 con 0x7f1e3c146f30 2023-09-13T06:04:01.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e237fe640 1 -- 172.21.15.130:0/3686995904 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3400ce30 con 0x7f1e3c146f30 2023-09-13T06:04:01.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e237fe640 1 -- 172.21.15.130:0/3686995904 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34005270 con 0x7f1e3c146f30 2023-09-13T06:04:01.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e417db640 1 -- 172.21.15.130:0/3686995904 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c1362c0 con 0x7f1e3c146f30 2023-09-13T06:04:01.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e417db640 1 -- 172.21.15.130:0/3686995904 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c1395f0 con 0x7f1e3c146f30 2023-09-13T06:04:01.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.354+0000 7f1e417db640 1 -- 172.21.15.130:0/3686995904 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c136120 con 0x7f1e3c146f30 2023-09-13T06:04:01.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.358+0000 7f1e237fe640 1 -- 172.21.15.130:0/3686995904 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1e340053d0 con 0x7f1e3c146f30 2023-09-13T06:04:01.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.358+0000 7f1e237fe640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e28065b50 0x7f1e28068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:01.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.358+0000 7f1e237fe640 1 -- 172.21.15.130:0/3686995904 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e34082a50 con 0x7f1e3c146f30 2023-09-13T06:04:01.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.358+0000 7f1e3affd640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e28065b50 0x7f1e28068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:01.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.358+0000 7f1e3affd640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e28065b50 0x7f1e28068010 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0ae000 tx=0x7f1e2c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:01.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.362+0000 7f1e237fe640 1 -- 172.21.15.130:0/3686995904 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1e3c136120 con 0x7f1e3c146f30 2023-09-13T06:04:01.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 -- 172.21.15.130:0/3686995904 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1e3c1367e0 con 0x7f1e3c146f30 2023-09-13T06:04:01.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e237fe640 1 -- 172.21.15.130:0/3686995904 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1e3c1367e0 con 0x7f1e3c146f30 2023-09-13T06:04:01.544 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:04:01.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 -- 172.21.15.130:0/3686995904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e28065b50 msgr2=0x7f1e28068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e28065b50 0x7f1e28068010 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0ae000 tx=0x7f1e2c0a7000 comp rx=0 tx=0).stop 2023-09-13T06:04:01.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 -- 172.21.15.130:0/3686995904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e3c146f30 msgr2=0x7f1e3c13fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:01.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e3c146f30 0x7f1e3c13fe80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1e34002240 tx=0x7f1e3400cbe0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 -- 172.21.15.130:0/3686995904 shutdown_connections 2023-09-13T06:04:01.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e28065b50 0x7f1e28068010 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e3c0d1750 0x7f1e3c1390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e3c146f30 0x7f1e3c13fe80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 --2- 172.21.15.130:0/3686995904 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e3c0d1090 0x7f1e3c15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:01.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 -- 172.21.15.130:0/3686995904 >> 172.21.15.130:0/3686995904 conn(0x7f1e3c06f170 msgr2=0x7f1e3c15dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:01.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 -- 172.21.15.130:0/3686995904 shutdown_connections 2023-09-13T06:04:01.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:01.542+0000 7f1e417db640 1 -- 172.21.15.130:0/3686995904 wait complete. 2023-09-13T06:04:01.564 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:04:01.565 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:04:01.565 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:04:01.565 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T06:04:01.566 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:04:01.566 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:04:01.566 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:04:01.567 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:04:01.567 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:04:01.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:01.568 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:04:01.578 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:04:01.578 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:04:01.579 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:04:01.579 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:01.579 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:04:01.579 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:01.580 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:04:01.580 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:01.580 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:04:01.580 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:04:01.580 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:01.581 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:04:01.581 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:04:01.581 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:01.581 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:04:01.581 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:01.582 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:04:01.582 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42266sec preferred_lft 42266sec 2023-09-13T06:04:01.582 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:04:01.582 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:01.583 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:04:01.583 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:01.583 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:04:01.583 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:01.584 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:04:01.584 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:01.584 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:04:01.584 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:01.584 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:04:01.585 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:01.585 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:04:01.585 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:04:01.585 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:04:01.586 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:01.586 INFO:teuthology.orchestra.run.smithi130.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:04:01.586 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:04:01.586 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:04:01.587 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:01.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:01.588 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:04:01.640 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:04:01.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:01.643 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:04:01.696 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:04:01.697 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:04:01.697 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:04:01.697 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:04:01.697 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:04:01.697 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:04:01.698 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:04:01.698 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:04:01.698 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:04:01.698 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:04:01.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:01.699 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:04:01.700 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:04:01.700 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:04:01.700 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:04:01.701 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:04:01.701 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:04:01.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:01.793 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:04:01.803 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T06:04:01.804 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:04:01.804 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:04:01.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:01.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-09-13T06:04:01.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:04:01.870 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T06:04:01.921 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:04:01.922 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:04:01.922 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:04:01.977 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:04:01.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:01.977 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:04:02.069 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:04:02.070 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:04:02.070 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:04:02.083 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:04:02.083 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:04:02.083 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:04:02.083 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:04:02.084 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:04:02.090 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:04:02.091 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:04:02.091 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:04:02.091 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:04:02.091 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:04:02.091 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:04:02.092 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:04:02.092 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:04:02.094 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:04:02.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:02.095 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:04:02.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:02.117 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:04:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:client6234 2023-09-13T06:04:02.179 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:04:02.180 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:04:02.229 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:04:02.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.410+0000 7f485b27b640 1 Processor -- start 2023-09-13T06:04:02.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.410+0000 7f485b27b640 1 -- start start 2023-09-13T06:04:02.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f485b27b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f48540ce1a0 0x7f485406d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:02.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f485b27b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48540afc70 0x7f485406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:02.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f485b27b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4854070e70 con 0x7f485415d260 2023-09-13T06:04:02.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f485b27b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4854072310 con 0x7f48540ce1a0 2023-09-13T06:04:02.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f485b27b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4854070280 con 0x7f48540afc70 2023-09-13T06:04:02.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f4858816640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f48540ce1a0 0x7f485406d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:02.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f4858816640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f48540ce1a0 0x7f485406d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:53504/0 (socket says 172.21.15.130:53504) 2023-09-13T06:04:02.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f4859818640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48540afc70 0x7f485406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:02.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f4858816640 1 -- 172.21.15.130:0/3183615553 learned_addr learned my addr 172.21.15.130:0/3183615553 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:02.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f4859017640 1 --1- 172.21.15.130:0/3183615553 >> v1:172.21.15.164:6789/0 conn(0x7f485415d260 0x7f48540b5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:39732/0 (socket says 172.21.15.130:39732) 2023-09-13T06:04:02.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f4859818640 1 -- 172.21.15.130:0/3183615553 >> v2:172.21.15.164:3300/0 conn(0x7f48540ce1a0 msgr2=0x7f485406d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:02.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f4859818640 1 --2- 172.21.15.130:0/3183615553 >> v2:172.21.15.164:3300/0 conn(0x7f48540ce1a0 0x7f485406d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:02.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f4859818640 1 -- 172.21.15.130:0/3183615553 >> v1:172.21.15.164:6789/0 conn(0x7f485415d260 legacy=0x7f48540b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:02.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f4859818640 1 -- 172.21.15.130:0/3183615553 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854070540 con 0x7f48540afc70 2023-09-13T06:04:02.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.414+0000 7f4858816640 1 --2- 172.21.15.130:0/3183615553 >> v2:172.21.15.164:3300/0 conn(0x7f48540ce1a0 0x7f485406d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:04:02.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f4859818640 1 --2- 172.21.15.130:0/3183615553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48540afc70 0x7f485406dc20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f484c009d90 tx=0x7f484c01c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0cd8a984959e2b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:02.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f484bfff640 1 -- 172.21.15.130:0/3183615553 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c0a59c0 con 0x7f48540afc70 2023-09-13T06:04:02.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f484bfff640 1 -- 172.21.15.130:0/3183615553 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c0a5b20 con 0x7f48540afc70 2023-09-13T06:04:02.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f484bfff640 1 -- 172.21.15.130:0/3183615553 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c0ad440 con 0x7f48540afc70 2023-09-13T06:04:02.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f485b27b640 1 -- 172.21.15.130:0/3183615553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48540afc70 msgr2=0x7f485406dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:02.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f485b27b640 1 --2- 172.21.15.130:0/3183615553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48540afc70 0x7f485406dc20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f484c009d90 tx=0x7f484c01c900 comp rx=0 tx=0).stop 2023-09-13T06:04:02.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f485b27b640 1 -- 172.21.15.130:0/3183615553 shutdown_connections 2023-09-13T06:04:02.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f485b27b640 1 --2- 172.21.15.130:0/3183615553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48540afc70 0x7f485406dc20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:02.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f485b27b640 1 --2- 172.21.15.130:0/3183615553 >> v2:172.21.15.164:3300/0 conn(0x7f48540ce1a0 0x7f485406d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:02.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f485b27b640 1 -- 172.21.15.130:0/3183615553 >> 172.21.15.130:0/3183615553 conn(0x7f485406a2f0 msgr2=0x7f485406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:02.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f485b27b640 1 -- 172.21.15.130:0/3183615553 shutdown_connections 2023-09-13T06:04:02.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f485b27b640 1 -- 172.21.15.130:0/3183615553 wait complete. 2023-09-13T06:04:02.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f485b27b640 1 Processor -- start 2023-09-13T06:04:02.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.418+0000 7f485b27b640 1 -- start start 2023-09-13T06:04:02.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f485b27b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48540afc70 0x7f48541f9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:02.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f485b27b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48540ce1a0 0x7f48540b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:02.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f485b27b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f485415d260 0x7f48541f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:02.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f485b27b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48541f9c40 con 0x7f48540afc70 2023-09-13T06:04:02.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f485b27b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48541f61e0 con 0x7f48540ce1a0 2023-09-13T06:04:02.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f485b27b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48541f64c0 con 0x7f485415d260 2023-09-13T06:04:02.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4859017640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48540afc70 0x7f48541f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:02.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4859017640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48540afc70 0x7f48541f9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54584/0 (socket says 172.21.15.130:54584) 2023-09-13T06:04:02.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4859017640 1 -- 172.21.15.130:0/3489320137 learned_addr learned my addr 172.21.15.130:0/3489320137 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:02.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4858816640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48540ce1a0 0x7f48540b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:02.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4859818640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f485415d260 0x7f48541f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:02.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4859017640 1 -- 172.21.15.130:0/3489320137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f485415d260 msgr2=0x7f48541f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:02.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4859017640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f485415d260 0x7f48541f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:02.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4859017640 1 -- 172.21.15.130:0/3489320137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48540ce1a0 msgr2=0x7f48540b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:02.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4859017640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48540ce1a0 0x7f48540b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:02.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4859017640 1 -- 172.21.15.130:0/3489320137 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440094d0 con 0x7f48540afc70 2023-09-13T06:04:02.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4858816640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48540ce1a0 0x7f48540b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:04:02.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4859017640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48540afc70 0x7f48541f9700 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f485000c430 tx=0x7f485000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:02.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4849ffb640 1 -- 172.21.15.130:0/3489320137 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48500074e0 con 0x7f48540afc70 2023-09-13T06:04:02.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4849ffb640 1 -- 172.21.15.130:0/3489320137 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850007640 con 0x7f48540afc70 2023-09-13T06:04:02.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f4849ffb640 1 -- 172.21.15.130:0/3489320137 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850004a10 con 0x7f48540afc70 2023-09-13T06:04:02.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f485b27b640 1 -- 172.21.15.130:0/3489320137 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c009a70 con 0x7f48540afc70 2023-09-13T06:04:02.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f485b27b640 1 -- 172.21.15.130:0/3489320137 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48541f91e0 con 0x7f48540afc70 2023-09-13T06:04:02.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.422+0000 7f485b27b640 1 -- 172.21.15.130:0/3489320137 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48541f93d0 con 0x7f48540afc70 2023-09-13T06:04:02.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.426+0000 7f4849ffb640 1 -- 172.21.15.130:0/3489320137 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4850004b70 con 0x7f48540afc70 2023-09-13T06:04:02.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.426+0000 7f4849ffb640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4838065b20 0x7f4838067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:02.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.426+0000 7f4849ffb640 1 -- 172.21.15.130:0/3489320137 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4850082d60 con 0x7f48540afc70 2023-09-13T06:04:02.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.426+0000 7f4858816640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4838065b20 0x7f4838067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:02.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.426+0000 7f4858816640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4838065b20 0x7f4838067fe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f485415f510 tx=0x7f4844008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:02.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.430+0000 7f4849ffb640 1 -- 172.21.15.130:0/3489320137 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f48500506a0 con 0x7f48540afc70 2023-09-13T06:04:02.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.610+0000 7f485b27b640 1 -- 172.21.15.130:0/3489320137 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f48540618a0 con 0x7f48540afc70 2023-09-13T06:04:02.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.610+0000 7f4849ffb640 1 -- 172.21.15.130:0/3489320137 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4850053cc0 con 0x7f48540afc70 2023-09-13T06:04:02.613 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:04:02.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 -- 172.21.15.130:0/3489320137 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4838065b20 msgr2=0x7f4838067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:02.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4838065b20 0x7f4838067fe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f485415f510 tx=0x7f4844008040 comp rx=0 tx=0).stop 2023-09-13T06:04:02.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 -- 172.21.15.130:0/3489320137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48540afc70 msgr2=0x7f48541f9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:02.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48540afc70 0x7f48541f9700 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f485000c430 tx=0x7f485000c8f0 comp rx=0 tx=0).stop 2023-09-13T06:04:02.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 -- 172.21.15.130:0/3489320137 shutdown_connections 2023-09-13T06:04:02.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4838065b20 0x7f4838067fe0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:02.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48540ce1a0 0x7f48540b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:02.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f485415d260 0x7f48541f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:02.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 --2- 172.21.15.130:0/3489320137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48540afc70 0x7f48541f9700 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:02.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 -- 172.21.15.130:0/3489320137 >> 172.21.15.130:0/3489320137 conn(0x7f485406a2f0 msgr2=0x7f48540d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:02.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 -- 172.21.15.130:0/3489320137 shutdown_connections 2023-09-13T06:04:02.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:02.614+0000 7f485b27b640 1 -- 172.21.15.130:0/3489320137 wait complete. 2023-09-13T06:04:02.633 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:04:02.633 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:04:02.634 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:04:02.634 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T06:04:02.634 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:04:02.635 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:04:02.635 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:04:02.636 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:04:02.636 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:04:02.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:02.637 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:04:02.648 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:04:02.648 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:04:02.648 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:04:02.649 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:02.649 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:04:02.649 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:02.649 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:04:02.649 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:02.650 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:04:02.650 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:04:02.650 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:02.650 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:04:02.651 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:04:02.651 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:02.651 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:04:02.651 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:02.651 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:04:02.651 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42281sec preferred_lft 42281sec 2023-09-13T06:04:02.652 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:04:02.652 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:02.652 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:04:02.652 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:02.652 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:04:02.653 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:02.653 INFO:teuthology.orchestra.run.smithi164.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:04:02.653 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:04:02.653 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:04:02.653 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:02.654 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:04:02.654 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:02.654 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:04:02.654 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:04:02.654 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:04:02.655 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:02.655 INFO:teuthology.orchestra.run.smithi164.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:04:02.655 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:04:02.655 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:04:02.655 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:04:02.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:02.657 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:04:02.725 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:04:02.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:02.727 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:04:02.779 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:04:02.779 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:04:02.779 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:04:02.780 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:04:02.780 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:04:02.780 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:04:02.780 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:04:02.780 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:04:02.781 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:04:02.781 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:04:02.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:02.782 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:04:02.782 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:04:02.782 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:04:02.783 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:04:02.783 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:04:02.783 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:04:02.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:02.876 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:04:02.887 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-13T06:04:02.888 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:04:02.888 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:04:02.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:02.889 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-09-13T06:04:02.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:04:02.953 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T06:04:03.008 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:04:03.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:04:03.009 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:04:03.059 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:04:03.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:03.060 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:04:03.154 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:04:03.155 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:04:03.155 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:04:03.170 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:04:03.170 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:04:03.170 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:04:03.170 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:04:03.171 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:04:03.178 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:04:03.178 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:04:03.178 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:04:03.179 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:04:03.179 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:04:03.179 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:04:03.179 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:04:03.179 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:04:03.182 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:04:03.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:03.183 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:04:03.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:04:03.203 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:04:03.254 INFO:teuthology.orchestra.run.smithi164.stdout:client6240 2023-09-13T06:04:03.255 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:04:03.255 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:04:03.303 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:04:03.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb9150d8640 1 Processor -- start 2023-09-13T06:04:03.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb9150d8640 1 -- start start 2023-09-13T06:04:03.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb9150d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb91015b130 0x7fb9100cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:03.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb9150d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9100b04a0 0x7fb9100b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:03.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb9150d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9100ce980 con 0x7fb9100ce180 2023-09-13T06:04:03.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb9150d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9100b0e70 con 0x7fb91015b130 2023-09-13T06:04:03.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb9150d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9100cec60 con 0x7fb9100b04a0 2023-09-13T06:04:03.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb90ed9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb91015b130 0x7fb9100cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:03.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb90f59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9100b04a0 0x7fb9100b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:03.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb90ed9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb91015b130 0x7fb9100cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:53526/0 (socket says 172.21.15.130:53526) 2023-09-13T06:04:03.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb90f59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9100b04a0 0x7fb9100b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:46204/0 (socket says 172.21.15.130:46204) 2023-09-13T06:04:03.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb90ed9d640 1 -- 172.21.15.130:0/4136264163 learned_addr learned my addr 172.21.15.130:0/4136264163 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:03.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb90ed9d640 1 -- 172.21.15.130:0/4136264163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9100b04a0 msgr2=0x7fb9100b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:04:03.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb90ed9d640 1 --2- 172.21.15.130:0/4136264163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9100b04a0 0x7fb9100b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:03.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb90ed9d640 1 -- 172.21.15.130:0/4136264163 >> v1:172.21.15.164:6789/0 conn(0x7fb9100ce180 legacy=0x7fb91015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:03.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.450+0000 7fb90ed9d640 1 -- 172.21.15.130:0/4136264163 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91006c640 con 0x7fb91015b130 2023-09-13T06:04:03.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb90ed9d640 1 --2- 172.21.15.130:0/4136264163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb91015b130 0x7fb9100cc780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb900009870 tx=0x7fb90001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52dfd3507dd9749 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:03.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb90e59c640 1 -- 172.21.15.130:0/4136264163 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9000a9400 con 0x7fb91015b130 2023-09-13T06:04:03.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb90e59c640 1 -- 172.21.15.130:0/4136264163 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9000a9560 con 0x7fb91015b130 2023-09-13T06:04:03.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb90e59c640 1 -- 172.21.15.130:0/4136264163 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9000a98f0 con 0x7fb91015b130 2023-09-13T06:04:03.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb9150d8640 1 -- 172.21.15.130:0/4136264163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb91015b130 msgr2=0x7fb9100cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:03.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb9150d8640 1 --2- 172.21.15.130:0/4136264163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb91015b130 0x7fb9100cc780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb900009870 tx=0x7fb90001c540 comp rx=0 tx=0).stop 2023-09-13T06:04:03.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb9150d8640 1 -- 172.21.15.130:0/4136264163 shutdown_connections 2023-09-13T06:04:03.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb9150d8640 1 --2- 172.21.15.130:0/4136264163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9100b04a0 0x7fb9100b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:03.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb9150d8640 1 --2- 172.21.15.130:0/4136264163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb91015b130 0x7fb9100cc780 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:03.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb9150d8640 1 -- 172.21.15.130:0/4136264163 >> 172.21.15.130:0/4136264163 conn(0x7fb910065990 msgr2=0x7fb910065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:03.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb9150d8640 1 -- 172.21.15.130:0/4136264163 shutdown_connections 2023-09-13T06:04:03.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.454+0000 7fb9150d8640 1 -- 172.21.15.130:0/4136264163 wait complete. 2023-09-13T06:04:03.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb9150d8640 1 Processor -- start 2023-09-13T06:04:03.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb9150d8640 1 -- start start 2023-09-13T06:04:03.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb9150d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9100b04a0 0x7fb910147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:03.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb9150d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9100ce180 0x7fb910154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:03.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb9150d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb91015b130 0x7fb910154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:03.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb9150d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910148240 con 0x7fb91015b130 2023-09-13T06:04:03.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb9150d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910145c90 con 0x7fb9100b04a0 2023-09-13T06:04:03.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb9150d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9100b01b0 con 0x7fb9100ce180 2023-09-13T06:04:03.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb90f59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb91015b130 0x7fb910154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:03.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb90f59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb91015b130 0x7fb910154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54592/0 (socket says 172.21.15.130:54592) 2023-09-13T06:04:03.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb90f59e640 1 -- 172.21.15.130:0/597316520 learned_addr learned my addr 172.21.15.130:0/597316520 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:04:03.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb90ed9d640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9100b04a0 0x7fb910147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:03.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb90659c640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9100ce180 0x7fb910154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:03.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb90ed9d640 1 -- 172.21.15.130:0/597316520 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9100ce180 msgr2=0x7fb910154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:03.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb90ed9d640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9100ce180 0x7fb910154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:03.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb90ed9d640 1 -- 172.21.15.130:0/597316520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb91015b130 msgr2=0x7fb910154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:03.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb90ed9d640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb91015b130 0x7fb910154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:03.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb90ed9d640 1 -- 172.21.15.130:0/597316520 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9000094d0 con 0x7fb9100b04a0 2023-09-13T06:04:03.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb90ed9d640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9100b04a0 0x7fb910147d00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb9000aa000 tx=0x7fb9000192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:03.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb907fff640 1 -- 172.21.15.130:0/597316520 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9000b1800 con 0x7fb9100b04a0 2023-09-13T06:04:03.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb907fff640 1 -- 172.21.15.130:0/597316520 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9000b5070 con 0x7fb9100b04a0 2023-09-13T06:04:03.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb9150d8640 1 -- 172.21.15.130:0/597316520 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9100af5a0 con 0x7fb9100b04a0 2023-09-13T06:04:03.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.458+0000 7fb907fff640 1 -- 172.21.15.130:0/597316520 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9000b1bc0 con 0x7fb9100b04a0 2023-09-13T06:04:03.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.462+0000 7fb9150d8640 1 -- 172.21.15.130:0/597316520 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9100afb60 con 0x7fb9100b04a0 2023-09-13T06:04:03.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.462+0000 7fb9150d8640 1 -- 172.21.15.130:0/597316520 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9100cc750 con 0x7fb9100b04a0 2023-09-13T06:04:03.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.462+0000 7fb907fff640 1 -- 172.21.15.130:0/597316520 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb9000b1d20 con 0x7fb9100b04a0 2023-09-13T06:04:03.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.462+0000 7fb907fff640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8f0065b20 0x7fb8f0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:04:03.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.462+0000 7fb907fff640 1 -- 172.21.15.130:0/597316520 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9000b7070 con 0x7fb9100b04a0 2023-09-13T06:04:03.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.462+0000 7fb90659c640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8f0065b20 0x7fb8f0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:04:03.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.462+0000 7fb90659c640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8f0065b20 0x7fb8f0067fe0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb910165c20 tx=0x7fb8f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:04:03.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.466+0000 7fb907fff640 1 -- 172.21.15.130:0/597316520 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb9000eb430 con 0x7fb9100b04a0 2023-09-13T06:04:03.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.646+0000 7fb9150d8640 1 -- 172.21.15.130:0/597316520 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9100618a0 con 0x7fb9100b04a0 2023-09-13T06:04:03.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb907fff640 1 -- 172.21.15.130:0/597316520 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fb9000a6020 con 0x7fb9100b04a0 2023-09-13T06:04:03.650 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:04:03.651 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1338889971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1338889971},{"type":"v1","addr":"172.21.15.164:6835","nonce":1338889971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1298091712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1298091712},{"type":"v1","addr":"172.21.15.130:6835","nonce":1298091712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/798128577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":798128577},{"type":"v1","addr":"172.21.15.130:6837","nonce":798128577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:03:54.710730+0000","modified":"2023-09-13T06:03:57.752848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6087":{"gid":6087,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2038440053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2038440053},{"type":"v1","addr":"172.21.15.164:6833","nonce":2038440053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-09-13T06:04:03.651 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 34 2023-09-13T06:04:03.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 -- 172.21.15.130:0/597316520 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8f0065b20 msgr2=0x7fb8f0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:03.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8f0065b20 0x7fb8f0067fe0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb910165c20 tx=0x7fb8f8009040 comp rx=0 tx=0).stop 2023-09-13T06:04:03.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 -- 172.21.15.130:0/597316520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9100b04a0 msgr2=0x7fb910147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:04:03.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9100b04a0 0x7fb910147d00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb9000aa000 tx=0x7fb9000192e0 comp rx=0 tx=0).stop 2023-09-13T06:04:03.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 -- 172.21.15.130:0/597316520 shutdown_connections 2023-09-13T06:04:03.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8f0065b20 0x7fb8f0067fe0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:03.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb91015b130 0x7fb910154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:03.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9100ce180 0x7fb910154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:03.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 --2- 172.21.15.130:0/597316520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9100b04a0 0x7fb910147d00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:04:03.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 -- 172.21.15.130:0/597316520 >> 172.21.15.130:0/597316520 conn(0x7fb910065990 msgr2=0x7fb9100cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:04:03.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 -- 172.21.15.130:0/597316520 shutdown_connections 2023-09-13T06:04:03.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:04:03.650+0000 7fb9150d8640 1 -- 172.21.15.130:0/597316520 wait complete. 2023-09-13T06:04:03.671 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-09-13T06:04:03.827 INFO:teuthology.orchestra.run.smithi164.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":6087,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4462081120000008,"mdsmap_epoch":34,"osdmap_epoch":65,"osdmap_epoch_barrier":65,"uptime":13.636633142999999} 2023-09-13T06:04:03.828 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 6087, "mdsmap_epoch": 34, "osdmap_epoch": 65, "osdmap_epoch_barrier": 65, "rank_uptime": 8.446208112, "state": "up:active", "uptime": 13.636633143, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:04:03.829 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-13T06:04:03.983 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_mon_report_interval":"5"} 2023-09-13T06:04:03.983 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-13T06:04:03.984 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-09-13T06:04:04.135 INFO:teuthology.orchestra.run.smithi130.stdout:{"mon_tick_interval":"5"} 2023-09-13T06:04:04.135 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-09-13T06:04:04.136 INFO:tasks.cephfs.test_full:pool capacity 557082176, 531MB should be enough to fill it 2023-09-13T06:04:04.136 DEBUG:teuthology.orchestra.run.smithi130:> stdin-killer -- python3 -c ' 2023-09-13T06:04:04.137 DEBUG:teuthology.orchestra.run.smithi130:> import time 2023-09-13T06:04:04.137 DEBUG:teuthology.orchestra.run.smithi130:> import datetime 2023-09-13T06:04:04.137 DEBUG:teuthology.orchestra.run.smithi130:> import subprocess 2023-09-13T06:04:04.138 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-09-13T06:04:04.138 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:04:04.138 DEBUG:teuthology.orchestra.run.smithi130:> # Write some buffered data through before going full, all should be well 2023-09-13T06:04:04.139 DEBUG:teuthology.orchestra.run.smithi130:> print("writing some data through which we expect to succeed") 2023-09-13T06:04:04.139 DEBUG:teuthology.orchestra.run.smithi130:> bytes = 0 2023-09-13T06:04:04.139 DEBUG:teuthology.orchestra.run.smithi130:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-09-13T06:04:04.140 DEBUG:teuthology.orchestra.run.smithi130:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-09-13T06:04:04.140 DEBUG:teuthology.orchestra.run.smithi130:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-09-13T06:04:04.140 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(f) 2023-09-13T06:04:04.141 DEBUG:teuthology.orchestra.run.smithi130:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-09-13T06:04:04.141 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:04:04.141 DEBUG:teuthology.orchestra.run.smithi130:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-09-13T06:04:04.142 DEBUG:teuthology.orchestra.run.smithi130:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-09-13T06:04:04.142 DEBUG:teuthology.orchestra.run.smithi130:> # buffered IO, the error should always only appear from fsync and not 2023-09-13T06:04:04.142 DEBUG:teuthology.orchestra.run.smithi130:> # from write 2023-09-13T06:04:04.143 DEBUG:teuthology.orchestra.run.smithi130:> full = False 2023-09-13T06:04:04.143 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:04:04.143 DEBUG:teuthology.orchestra.run.smithi130:> for n in range(0, int(531 * 0.9)): 2023-09-13T06:04:04.144 DEBUG:teuthology.orchestra.run.smithi130:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-13T06:04:04.144 DEBUG:teuthology.orchestra.run.smithi130:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-09-13T06:04:04.144 DEBUG:teuthology.orchestra.run.smithi130:> print("done writing {0} bytes".format(bytes)) 2023-09-13T06:04:04.145 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:04:04.145 DEBUG:teuthology.orchestra.run.smithi130:> # OK, now we should sneak in under the full condition 2023-09-13T06:04:04.146 DEBUG:teuthology.orchestra.run.smithi130:> # due to the time it takes the OSDs to report to the 2023-09-13T06:04:04.146 DEBUG:teuthology.orchestra.run.smithi130:> # mons, and get a successful fsync on our full-making data 2023-09-13T06:04:04.146 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(f) 2023-09-13T06:04:04.147 DEBUG:teuthology.orchestra.run.smithi130:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-09-13T06:04:04.147 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:04:04.147 DEBUG:teuthology.orchestra.run.smithi130:> # buffered write, add more dirty data to the buffer 2023-09-13T06:04:04.148 DEBUG:teuthology.orchestra.run.smithi130:> print("starting buffered write") 2023-09-13T06:04:04.148 DEBUG:teuthology.orchestra.run.smithi130:> try: 2023-09-13T06:04:04.148 DEBUG:teuthology.orchestra.run.smithi130:> for n in range(0, int(531 * 0.2)): 2023-09-13T06:04:04.148 DEBUG:teuthology.orchestra.run.smithi130:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-13T06:04:04.149 DEBUG:teuthology.orchestra.run.smithi130:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-09-13T06:04:04.149 DEBUG:teuthology.orchestra.run.smithi130:> time.sleep(15.0) 2023-09-13T06:04:04.149 DEBUG:teuthology.orchestra.run.smithi130:> except OSError: 2023-09-13T06:04:04.150 DEBUG:teuthology.orchestra.run.smithi130:> pass; 2023-09-13T06:04:04.150 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:04:04.150 DEBUG:teuthology.orchestra.run.smithi130:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-09-13T06:04:04.151 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:04:04.151 DEBUG:teuthology.orchestra.run.smithi130:> # Wait long enough for a background flush that should fail 2023-09-13T06:04:04.151 DEBUG:teuthology.orchestra.run.smithi130:> time.sleep(30) 2023-09-13T06:04:04.152 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:04:04.152 DEBUG:teuthology.orchestra.run.smithi130:> if False: 2023-09-13T06:04:04.152 DEBUG:teuthology.orchestra.run.smithi130:> # ...and check that the failed background flush is reflected in fclose 2023-09-13T06:04:04.153 DEBUG:teuthology.orchestra.run.smithi130:> try: 2023-09-13T06:04:04.153 DEBUG:teuthology.orchestra.run.smithi130:> os.close(f) 2023-09-13T06:04:04.153 DEBUG:teuthology.orchestra.run.smithi130:> except OSError: 2023-09-13T06:04:04.154 DEBUG:teuthology.orchestra.run.smithi130:> print("close() returned an error as expected") 2023-09-13T06:04:04.154 DEBUG:teuthology.orchestra.run.smithi130:> else: 2023-09-13T06:04:04.154 DEBUG:teuthology.orchestra.run.smithi130:> raise RuntimeError("close() failed to raise error") 2023-09-13T06:04:04.155 DEBUG:teuthology.orchestra.run.smithi130:> else: 2023-09-13T06:04:04.155 DEBUG:teuthology.orchestra.run.smithi130:> # The kernel cephfs client does not raise errors on fclose 2023-09-13T06:04:04.155 DEBUG:teuthology.orchestra.run.smithi130:> os.close(f) 2023-09-13T06:04:04.156 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:04:04.156 DEBUG:teuthology.orchestra.run.smithi130:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-09-13T06:04:04.156 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-09-13T06:04:05.357 INFO:teuthology.orchestra.run.smithi130.stdout:writing some data through which we expect to succeed 2023-09-13T06:04:05.358 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-09-13T06:04:05.358 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-09-13T06:04:05.358 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-09-13T06:04:05.359 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-09-13T06:04:05.359 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-09-13T06:04:05.359 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-09-13T06:04:05.359 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-09-13T06:04:05.359 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-09-13T06:04:05.360 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-09-13T06:04:05.360 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-09-13T06:04:05.360 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-09-13T06:04:05.360 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-09-13T06:04:05.360 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-09-13T06:04:05.361 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-09-13T06:04:05.361 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-09-13T06:04:05.361 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-09-13T06:04:05.361 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-09-13T06:04:05.362 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-09-13T06:04:05.362 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-09-13T06:04:05.362 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-09-13T06:04:05.362 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-09-13T06:04:05.362 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-09-13T06:04:05.363 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-09-13T06:04:05.363 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-09-13T06:04:05.363 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-09-13T06:04:05.363 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-09-13T06:04:05.363 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-09-13T06:04:05.364 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-09-13T06:04:05.364 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-09-13T06:04:05.364 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-09-13T06:04:05.364 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-09-13T06:04:05.364 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-09-13T06:04:05.365 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-09-13T06:04:05.365 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-09-13T06:04:05.365 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-09-13T06:04:05.365 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-09-13T06:04:05.365 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-09-13T06:04:05.366 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-09-13T06:04:05.366 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-09-13T06:04:05.366 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-09-13T06:04:05.366 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-09-13T06:04:05.366 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-09-13T06:04:05.367 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-09-13T06:04:05.367 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-09-13T06:04:05.368 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-09-13T06:04:05.368 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-09-13T06:04:05.368 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-09-13T06:04:05.368 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-09-13T06:04:05.368 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-09-13T06:04:05.369 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-09-13T06:04:05.369 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-09-13T06:04:05.369 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-09-13T06:04:05.369 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-09-13T06:04:05.369 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-09-13T06:04:05.370 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-09-13T06:04:05.370 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-09-13T06:04:05.370 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-09-13T06:04:05.370 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-09-13T06:04:05.371 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-09-13T06:04:05.371 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-09-13T06:04:05.371 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-09-13T06:04:05.371 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-09-13T06:04:05.372 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-09-13T06:04:05.372 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-09-13T06:04:05.372 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-09-13T06:04:05.372 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-09-13T06:04:05.372 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-09-13T06:04:05.373 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-09-13T06:04:05.373 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-09-13T06:04:05.373 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-09-13T06:04:05.373 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-09-13T06:04:05.373 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-09-13T06:04:05.374 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-09-13T06:04:05.374 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-09-13T06:04:05.374 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-09-13T06:04:05.374 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-09-13T06:04:05.374 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-09-13T06:04:05.375 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-09-13T06:04:05.375 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-09-13T06:04:05.375 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-09-13T06:04:05.375 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-09-13T06:04:05.375 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-09-13T06:04:05.376 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-09-13T06:04:05.376 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-09-13T06:04:05.376 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-09-13T06:04:05.376 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-09-13T06:04:05.376 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-09-13T06:04:05.377 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-09-13T06:04:05.377 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-09-13T06:04:05.377 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-09-13T06:04:05.377 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-09-13T06:04:05.377 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-09-13T06:04:05.378 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-09-13T06:04:05.378 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-09-13T06:04:05.378 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-09-13T06:04:05.378 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-09-13T06:04:05.379 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-09-13T06:04:05.379 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-09-13T06:04:05.379 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-09-13T06:04:05.379 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-09-13T06:04:05.380 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-09-13T06:04:05.380 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-09-13T06:04:05.380 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-09-13T06:04:05.380 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-09-13T06:04:05.380 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-09-13T06:04:05.381 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-09-13T06:04:05.381 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-09-13T06:04:05.381 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-09-13T06:04:05.381 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-09-13T06:04:05.381 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-09-13T06:04:05.382 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-09-13T06:04:05.382 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-09-13T06:04:05.382 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-09-13T06:04:05.382 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-09-13T06:04:05.383 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-09-13T06:04:05.383 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-09-13T06:04:05.383 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-09-13T06:04:05.383 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-09-13T06:04:05.383 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-09-13T06:04:05.384 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-09-13T06:04:05.384 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-09-13T06:04:05.384 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-09-13T06:04:05.384 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-09-13T06:04:05.384 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-09-13T06:04:05.384 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-09-13T06:04:05.385 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-09-13T06:04:05.385 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-09-13T06:04:05.385 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-09-13T06:04:05.385 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-09-13T06:04:05.385 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-09-13T06:04:05.386 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-09-13T06:04:05.386 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-09-13T06:04:05.386 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-09-13T06:04:05.386 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-09-13T06:04:05.386 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-09-13T06:04:05.387 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-09-13T06:04:05.387 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-09-13T06:04:05.387 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-09-13T06:04:05.387 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-09-13T06:04:05.387 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-09-13T06:04:05.388 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-09-13T06:04:05.388 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-09-13T06:04:05.388 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-09-13T06:04:05.388 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-09-13T06:04:05.388 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-09-13T06:04:05.388 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-09-13T06:04:05.389 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-09-13T06:04:05.389 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-09-13T06:04:05.389 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-09-13T06:04:05.389 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-09-13T06:04:05.389 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-09-13T06:04:05.390 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-09-13T06:04:05.390 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-09-13T06:04:05.390 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-09-13T06:04:05.390 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-09-13T06:04:05.521 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-09-13T06:04:05.522 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-09-13T06:04:05.522 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-09-13T06:04:05.522 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-09-13T06:04:05.522 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-09-13T06:04:05.523 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-09-13T06:04:05.523 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-09-13T06:04:05.523 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-09-13T06:04:05.523 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-09-13T06:04:05.524 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-09-13T06:04:05.524 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-09-13T06:04:05.524 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-09-13T06:04:05.525 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-09-13T06:04:05.525 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-09-13T06:04:05.526 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-09-13T06:04:05.526 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-09-13T06:04:05.526 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-09-13T06:04:05.527 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-09-13T06:04:05.527 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-09-13T06:04:05.527 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-09-13T06:04:05.528 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-09-13T06:04:05.528 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-09-13T06:04:05.528 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-09-13T06:04:05.528 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-09-13T06:04:05.529 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-09-13T06:04:05.529 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-09-13T06:04:05.529 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-09-13T06:04:05.529 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-09-13T06:04:05.529 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-09-13T06:04:05.530 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-09-13T06:04:05.530 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-09-13T06:04:05.530 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-09-13T06:04:05.530 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-09-13T06:04:05.530 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-09-13T06:04:05.531 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-09-13T06:04:05.531 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-09-13T06:04:05.531 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-09-13T06:04:05.532 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-09-13T06:04:05.532 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-09-13T06:04:05.532 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-09-13T06:04:05.532 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-09-13T06:04:05.532 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-09-13T06:04:05.533 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-09-13T06:04:05.533 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-09-13T06:04:05.533 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-09-13T06:04:05.533 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-09-13T06:04:05.534 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-09-13T06:04:05.534 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-09-13T06:04:05.534 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-09-13T06:04:05.534 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-09-13T06:04:05.534 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-09-13T06:04:05.535 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-09-13T06:04:05.535 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-09-13T06:04:05.535 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-09-13T06:04:05.535 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-09-13T06:04:05.536 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-09-13T06:04:05.536 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-09-13T06:04:05.536 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-09-13T06:04:05.536 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-09-13T06:04:05.536 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-09-13T06:04:05.537 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-09-13T06:04:05.537 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-09-13T06:04:05.537 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-09-13T06:04:05.537 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-09-13T06:04:05.537 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-09-13T06:04:05.538 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-09-13T06:04:05.538 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-09-13T06:04:05.538 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-09-13T06:04:05.538 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-09-13T06:04:05.538 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-09-13T06:04:05.539 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-09-13T06:04:05.539 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-09-13T06:04:05.539 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-09-13T06:04:05.539 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-09-13T06:04:05.539 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-09-13T06:04:05.540 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-09-13T06:04:05.540 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-09-13T06:04:05.540 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-09-13T06:04:05.540 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-09-13T06:04:05.540 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-09-13T06:04:05.541 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-09-13T06:04:05.541 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-09-13T06:04:05.541 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-09-13T06:04:05.541 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-09-13T06:04:05.542 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-09-13T06:04:05.542 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-09-13T06:04:05.542 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-09-13T06:04:05.542 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-09-13T06:04:05.542 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-09-13T06:04:05.542 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-09-13T06:04:05.543 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-09-13T06:04:05.544 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-09-13T06:04:05.544 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-09-13T06:04:05.545 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-09-13T06:04:05.545 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-09-13T06:04:05.545 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-09-13T06:04:05.545 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-09-13T06:04:05.545 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-09-13T06:04:05.546 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-09-13T06:04:05.546 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-09-13T06:04:05.546 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-09-13T06:04:05.546 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-09-13T06:04:05.549 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-09-13T06:04:05.549 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-09-13T06:04:05.549 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-09-13T06:04:05.550 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-09-13T06:04:05.550 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-09-13T06:04:05.550 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-09-13T06:04:05.550 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-09-13T06:04:05.550 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-09-13T06:04:05.551 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-09-13T06:04:05.551 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-09-13T06:04:05.551 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-09-13T06:04:05.551 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-09-13T06:04:05.551 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-09-13T06:04:05.551 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-09-13T06:04:05.552 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-09-13T06:04:05.552 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-09-13T06:04:05.552 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-09-13T06:04:05.552 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-09-13T06:04:05.552 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-09-13T06:04:05.553 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-09-13T06:04:05.553 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-09-13T06:04:05.553 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-09-13T06:04:05.553 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-09-13T06:04:05.553 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-09-13T06:04:05.554 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-09-13T06:04:05.554 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-09-13T06:04:05.554 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-09-13T06:04:05.554 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-09-13T06:04:05.554 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-09-13T06:04:05.554 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-09-13T06:04:05.555 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-09-13T06:04:05.555 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-09-13T06:04:05.555 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-09-13T06:04:05.555 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-09-13T06:04:05.555 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-09-13T06:04:05.556 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-09-13T06:04:05.556 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-09-13T06:04:05.556 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-09-13T06:04:05.556 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-09-13T06:04:05.556 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-09-13T06:04:05.556 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-09-13T06:04:05.557 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-09-13T06:04:05.557 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-09-13T06:04:05.557 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-09-13T06:04:05.557 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-09-13T06:04:05.557 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-09-13T06:04:05.558 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-09-13T06:04:05.558 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-09-13T06:04:05.558 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-09-13T06:04:05.558 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-09-13T06:04:05.558 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-09-13T06:04:05.559 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-09-13T06:04:05.683 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-09-13T06:04:05.684 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-09-13T06:04:05.684 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-09-13T06:04:05.684 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-09-13T06:04:05.684 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-09-13T06:04:05.685 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-09-13T06:04:05.685 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-09-13T06:04:05.685 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-09-13T06:04:05.685 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-09-13T06:04:05.685 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-09-13T06:04:05.686 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-09-13T06:04:05.686 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-09-13T06:04:05.686 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-09-13T06:04:05.686 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-09-13T06:04:05.686 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-09-13T06:04:05.687 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-09-13T06:04:05.687 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-09-13T06:04:05.687 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-09-13T06:04:05.687 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-09-13T06:04:05.687 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-09-13T06:04:05.687 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-09-13T06:04:05.688 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-09-13T06:04:05.688 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-09-13T06:04:05.688 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-09-13T06:04:05.688 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-09-13T06:04:05.688 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-09-13T06:04:05.689 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-09-13T06:04:05.689 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-09-13T06:04:05.689 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-09-13T06:04:05.689 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-09-13T06:04:05.689 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-09-13T06:04:05.690 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-09-13T06:04:05.690 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-09-13T06:04:05.690 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-09-13T06:04:05.690 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-09-13T06:04:05.690 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-09-13T06:04:05.690 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-09-13T06:04:05.691 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-09-13T06:04:05.691 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-09-13T06:04:05.691 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-09-13T06:04:05.691 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-09-13T06:04:05.691 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-09-13T06:04:05.692 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-09-13T06:04:05.692 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-09-13T06:04:05.692 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-09-13T06:04:05.692 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-09-13T06:04:05.692 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-09-13T06:04:05.693 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-09-13T06:04:05.693 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-09-13T06:04:05.693 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-09-13T06:04:05.693 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-09-13T06:04:05.694 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-09-13T06:04:05.694 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-09-13T06:04:05.694 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-09-13T06:04:05.694 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-09-13T06:04:05.694 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-09-13T06:04:05.694 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-09-13T06:04:05.695 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-09-13T06:04:05.695 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-09-13T06:04:05.695 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-09-13T06:04:05.695 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-09-13T06:04:05.695 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-09-13T06:04:05.696 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-09-13T06:04:05.696 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-09-13T06:04:05.696 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-09-13T06:04:05.696 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-09-13T06:04:05.696 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-09-13T06:04:05.697 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-09-13T06:04:05.697 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-09-13T06:04:05.697 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-09-13T06:04:05.697 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-09-13T06:04:05.697 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-09-13T06:04:05.697 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-09-13T06:04:05.698 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-09-13T06:04:05.698 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-09-13T06:04:05.698 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-09-13T06:04:05.698 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-09-13T06:04:05.698 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-09-13T06:04:05.699 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-09-13T06:04:05.699 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-09-13T06:04:05.699 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-09-13T06:04:05.699 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-09-13T06:04:05.699 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-09-13T06:04:05.700 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-09-13T06:04:05.700 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-09-13T06:04:05.700 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-09-13T06:04:05.700 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-09-13T06:04:05.700 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-09-13T06:04:05.700 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-09-13T06:04:05.701 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-09-13T06:04:05.701 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-09-13T06:04:05.701 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-09-13T06:04:05.701 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-09-13T06:04:05.701 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-09-13T06:04:05.702 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-09-13T06:04:05.702 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-09-13T06:04:05.702 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-09-13T06:04:05.702 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-09-13T06:04:05.702 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-09-13T06:04:05.702 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-09-13T06:04:05.703 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-09-13T06:04:05.703 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-09-13T06:04:05.703 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-09-13T06:04:05.703 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-09-13T06:04:05.703 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-09-13T06:04:05.704 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-09-13T06:04:05.704 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-09-13T06:04:05.704 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-09-13T06:04:05.704 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-09-13T06:04:05.704 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-09-13T06:04:05.704 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-09-13T06:04:05.705 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-09-13T06:04:05.705 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-09-13T06:04:05.705 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-09-13T06:04:05.705 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-09-13T06:04:05.705 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-09-13T06:04:05.706 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-09-13T06:04:05.706 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-09-13T06:04:05.706 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-09-13T06:04:05.706 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-09-13T06:04:05.706 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-09-13T06:04:05.707 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-09-13T06:04:05.707 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-09-13T06:04:05.707 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-09-13T06:04:05.707 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-09-13T06:04:05.707 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-09-13T06:04:05.708 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-09-13T06:04:05.708 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-09-13T06:04:05.708 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-09-13T06:04:05.708 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-09-13T06:04:05.708 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-09-13T06:04:05.709 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-09-13T06:04:05.709 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-09-13T06:04:05.709 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-09-13T06:04:05.709 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-09-13T06:04:05.709 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-09-13T06:04:05.710 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-09-13T06:04:05.710 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-09-13T06:04:05.710 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-09-13T06:04:05.710 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-09-13T06:04:05.711 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-09-13T06:04:05.711 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-09-13T06:04:05.711 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-09-13T06:04:05.711 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-09-13T06:04:05.711 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-09-13T06:04:05.711 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-09-13T06:04:05.712 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-09-13T06:04:05.712 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-09-13T06:04:05.712 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-09-13T06:04:05.712 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-09-13T06:04:05.713 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-09-13T06:04:05.713 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-09-13T06:04:05.713 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-09-13T06:04:05.713 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-09-13T06:04:10.925 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:04:10.922+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-09-13T06:04:14.472 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:04:14.476 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:04:17.323 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:04:17.322+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-09-13T06:04:44.804 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:04:44.808 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:05:07.575 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-09-13T06:05:07.576 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-09-13T06:05:07.576 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-09-13T06:05:07.576 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-09-13T06:05:07.576 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-09-13T06:05:07.577 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-09-13T06:05:07.577 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-09-13T06:05:07.577 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-09-13T06:05:07.577 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-09-13T06:05:07.577 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-09-13T06:05:07.578 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-09-13T06:05:07.578 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-09-13T06:05:07.578 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-09-13T06:05:07.579 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-09-13T06:05:07.579 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-09-13T06:05:07.579 INFO:teuthology.orchestra.run.smithi130.stdout:done writing 500695040 bytes 2023-09-13T06:05:07.579 INFO:teuthology.orchestra.run.smithi130.stdout:successfully fsync'ed prior to getting full state reported 2023-09-13T06:05:07.580 INFO:teuthology.orchestra.run.smithi130.stdout:starting buffered write 2023-09-13T06:05:07.580 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:05:07.580 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:05:07.580 INFO:teuthology.orchestra.run.smithi130.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-09-13T06:05:07.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-13T06:05:07.587 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:05:07.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:05:07.644 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:05:07.702 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:05:07.703 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:05:07.703 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:07.712 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:05:07.713 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:07.761 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:07.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f1960e48640 1 Processor -- start 2023-09-13T06:05:07.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f1960e48640 1 -- start start 2023-09-13T06:05:07.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f1960e48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0d1750 0x7f195c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:07.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f1960e48640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f195c146f30 0x7f195c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:07.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f1960e48640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0b63c0 con 0x7f195c0d1090 2023-09-13T06:05:07.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f1960e48640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c15dea0 con 0x7f195c146f30 2023-09-13T06:05:07.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f1960e48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0d0c20 con 0x7f195c0d1750 2023-09-13T06:05:07.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f195ad9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f195c146f30 0x7f195c0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:07.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f195a59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0d1750 0x7f195c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:07.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f1951d9b640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f195c0d1090 0x7f195c146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:53950/0 (socket says 172.21.15.130:53950) 2023-09-13T06:05:07.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f1951d9b640 1 -- 172.21.15.130:0/1310213650 learned_addr learned my addr 172.21.15.130:0/1310213650 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:07.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f195ad9d640 1 --2- 172.21.15.130:0/1310213650 >> v2:172.21.15.164:3300/0 conn(0x7f195c146f30 0x7f195c0b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:41682/0 (socket says 172.21.15.130:41682) 2023-09-13T06:05:07.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f195a59c640 1 -- 172.21.15.130:0/1310213650 >> v2:172.21.15.164:3300/0 conn(0x7f195c146f30 msgr2=0x7f195c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:07.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f195a59c640 1 --2- 172.21.15.130:0/1310213650 >> v2:172.21.15.164:3300/0 conn(0x7f195c146f30 0x7f195c0b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:07.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f195a59c640 1 -- 172.21.15.130:0/1310213650 >> v1:172.21.15.164:6789/0 conn(0x7f195c0d1090 legacy=0x7f195c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:07.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f195a59c640 1 -- 172.21.15.130:0/1310213650 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0b6610 con 0x7f195c0d1750 2023-09-13T06:05:07.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.942+0000 7f195ad9d640 1 --2- 172.21.15.130:0/1310213650 >> v2:172.21.15.164:3300/0 conn(0x7f195c146f30 0x7f195c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:05:07.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f195a59c640 1 --2- 172.21.15.130:0/1310213650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0d1750 0x7f195c15d960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f19440097c0 tx=0x7f194401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b85b56000773db1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:07.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f1959d9b640 1 -- 172.21.15.130:0/1310213650 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19440ab650 con 0x7f195c0d1750 2023-09-13T06:05:07.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f1959d9b640 1 -- 172.21.15.130:0/1310213650 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19440ab7b0 con 0x7f195c0d1750 2023-09-13T06:05:07.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f1959d9b640 1 -- 172.21.15.130:0/1310213650 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19440abb40 con 0x7f195c0d1750 2023-09-13T06:05:07.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f1960e48640 1 -- 172.21.15.130:0/1310213650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0d1750 msgr2=0x7f195c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:07.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f1960e48640 1 --2- 172.21.15.130:0/1310213650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0d1750 0x7f195c15d960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f19440097c0 tx=0x7f194401c450 comp rx=0 tx=0).stop 2023-09-13T06:05:07.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f1960e48640 1 -- 172.21.15.130:0/1310213650 shutdown_connections 2023-09-13T06:05:07.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f1960e48640 1 --2- 172.21.15.130:0/1310213650 >> v2:172.21.15.164:3300/0 conn(0x7f195c146f30 0x7f195c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:07.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f1960e48640 1 --2- 172.21.15.130:0/1310213650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0d1750 0x7f195c15d960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:07.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f1960e48640 1 -- 172.21.15.130:0/1310213650 >> 172.21.15.130:0/1310213650 conn(0x7f195c06f170 msgr2=0x7f195c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:07.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f1960e48640 1 -- 172.21.15.130:0/1310213650 shutdown_connections 2023-09-13T06:05:07.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.946+0000 7f1960e48640 1 -- 172.21.15.130:0/1310213650 wait complete. 2023-09-13T06:05:07.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f1960e48640 1 Processor -- start 2023-09-13T06:05:07.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f1960e48640 1 -- start start 2023-09-13T06:05:07.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f1960e48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0d1090 0x7f195c15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:07.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f1960e48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f195c0d1750 0x7f195c145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:07.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f1960e48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c146f30 0x7f195c163a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:07.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f1960e48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c15bdd0 con 0x7f195c146f30 2023-09-13T06:05:07.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f1960e48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c15c390 con 0x7f195c0d1750 2023-09-13T06:05:07.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f1960e48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c15b1d0 con 0x7f195c0d1090 2023-09-13T06:05:07.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f195ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c146f30 0x7f195c163a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:07.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f195a59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0d1090 0x7f195c15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:07.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f195ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c146f30 0x7f195c163a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38972/0 (socket says 172.21.15.130:38972) 2023-09-13T06:05:07.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f195ad9d640 1 -- 172.21.15.130:0/1727093763 learned_addr learned my addr 172.21.15.130:0/1727093763 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:07.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f1951d9b640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f195c0d1750 0x7f195c145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:07.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f195ad9d640 1 -- 172.21.15.130:0/1727093763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0d1090 msgr2=0x7f195c15ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:07.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f195ad9d640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0d1090 0x7f195c15ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:07.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f195ad9d640 1 -- 172.21.15.130:0/1727093763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f195c0d1750 msgr2=0x7f195c145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:07.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f195ad9d640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f195c0d1750 0x7f195c145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:07.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f195ad9d640 1 -- 172.21.15.130:0/1727093763 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1954009a70 con 0x7f195c146f30 2023-09-13T06:05:07.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f195ad9d640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c146f30 0x7f195c163a70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1954009e60 tx=0x7f195400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:07.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f19537fe640 1 -- 172.21.15.130:0/1727093763 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954009cd0 con 0x7f195c146f30 2023-09-13T06:05:07.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f19537fe640 1 -- 172.21.15.130:0/1727093763 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195400f040 con 0x7f195c146f30 2023-09-13T06:05:07.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.950+0000 7f19537fe640 1 -- 172.21.15.130:0/1727093763 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540039a0 con 0x7f195c146f30 2023-09-13T06:05:07.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.954+0000 7f1960e48640 1 -- 172.21.15.130:0/1727093763 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1944009420 con 0x7f195c146f30 2023-09-13T06:05:07.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.954+0000 7f1960e48640 1 -- 172.21.15.130:0/1727093763 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c0b7e40 con 0x7f195c146f30 2023-09-13T06:05:07.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.954+0000 7f1960e48640 1 -- 172.21.15.130:0/1727093763 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c0618a0 con 0x7f195c146f30 2023-09-13T06:05:07.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.954+0000 7f19537fe640 1 -- 172.21.15.130:0/1727093763 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1954014480 con 0x7f195c146f30 2023-09-13T06:05:07.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.954+0000 7f19537fe640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f193c065b20 0x7f193c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:07.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.954+0000 7f19537fe640 1 -- 172.21.15.130:0/1727093763 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1954083e50 con 0x7f195c146f30 2023-09-13T06:05:07.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.954+0000 7f195a59c640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f193c065b20 0x7f193c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:07.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.954+0000 7f19537fe640 1 -- 172.21.15.130:0/1727093763 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f193c06d650 con 0x7f195c146f30 2023-09-13T06:05:07.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.954+0000 7f195a59c640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f193c065b20 0x7f193c067fe0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f19440af000 tx=0x7f19440a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:07.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:07.958+0000 7f19537fe640 1 -- 172.21.15.130:0/1727093763 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1954051730 con 0x7f195c146f30 2023-09-13T06:05:08.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.106+0000 7f1960e48640 1 -- 172.21.15.130:0/1727093763 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f195c15c4d0 con 0x7f195c146f30 2023-09-13T06:05:08.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.106+0000 7f19537fe640 1 -- 172.21.15.130:0/1727093763 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16659 (secure 0 0 0) 0x7f1954018020 con 0x7f195c146f30 2023-09-13T06:05:08.109 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:08.109 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":69,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:04:13.325878+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:03:52.722728+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-09-13T06:03:53.712581+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:08.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 -- 172.21.15.130:0/1727093763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f193c065b20 msgr2=0x7f193c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f193c065b20 0x7f193c067fe0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f19440af000 tx=0x7f19440a7000 comp rx=0 tx=0).stop 2023-09-13T06:05:08.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 -- 172.21.15.130:0/1727093763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c146f30 msgr2=0x7f195c163a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c146f30 0x7f195c163a70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1954009e60 tx=0x7f195400c490 comp rx=0 tx=0).stop 2023-09-13T06:05:08.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 -- 172.21.15.130:0/1727093763 shutdown_connections 2023-09-13T06:05:08.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f193c065b20 0x7f193c067fe0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f195c0d1750 0x7f195c145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c146f30 0x7f195c163a70 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 --2- 172.21.15.130:0/1727093763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f195c0d1090 0x7f195c15ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 -- 172.21.15.130:0/1727093763 >> 172.21.15.130:0/1727093763 conn(0x7f195c06f170 msgr2=0x7f195c15fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:08.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 -- 172.21.15.130:0/1727093763 shutdown_connections 2023-09-13T06:05:08.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.110+0000 7f1960e48640 1 -- 172.21.15.130:0/1727093763 wait complete. 2023-09-13T06:05:08.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:03:52.722728+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:03:53.712581+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:05:08.131 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:05:08.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.270+0000 7f9ddf4d8640 1 Processor -- start 2023-09-13T06:05:08.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.270+0000 7f9ddf4d8640 1 -- start start 2023-09-13T06:05:08.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddf4d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9dd8157750 0x7f9dd8160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddf4d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dd8157b30 0x7f9dd806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddf4d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd8161e60 con 0x7f9dd806f170 2023-09-13T06:05:08.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddf4d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd80ae0d0 con 0x7f9dd8157750 2023-09-13T06:05:08.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddf4d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd81615c0 con 0x7f9dd8157b30 2023-09-13T06:05:08.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddd274640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9dd8157750 0x7f9dd8160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddda75640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9dd806f170 0x7f9dd815e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39250/0 (socket says 172.21.15.130:39250) 2023-09-13T06:05:08.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddda75640 1 -- 172.21.15.130:0/2639073679 learned_addr learned my addr 172.21.15.130:0/2639073679 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:08.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddd274640 1 -- 172.21.15.130:0/2639073679 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dd8157b30 msgr2=0x7f9dd806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:08.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddd274640 1 --2- 172.21.15.130:0/2639073679 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dd8157b30 0x7f9dd806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddd274640 1 -- 172.21.15.130:0/2639073679 >> v1:172.21.15.130:6789/0 conn(0x7f9dd806f170 legacy=0x7f9dd815e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9ddd274640 1 -- 172.21.15.130:0/2639073679 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd81618a0 con 0x7f9dd8157750 2023-09-13T06:05:08.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.274+0000 7f9dcffff640 1 -- 172.21.15.130:0/2639073679 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443852532 0 0) 0x7f9dd8161e60 con 0x7f9dd806f170 2023-09-13T06:05:08.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9ddd274640 1 --2- 172.21.15.130:0/2639073679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd8157750 0x7f9dd8160fe0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40097c0 tx=0x7f9dd401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473e3a9a6ffb4fd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:08.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9dcffff640 1 -- 172.21.15.130:0/2639073679 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40ab670 con 0x7f9dd8157750 2023-09-13T06:05:08.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9dcffff640 1 -- 172.21.15.130:0/2639073679 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd40ab7d0 con 0x7f9dd8157750 2023-09-13T06:05:08.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9dcffff640 1 -- 172.21.15.130:0/2639073679 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40abb60 con 0x7f9dd8157750 2023-09-13T06:05:08.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2639073679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd8157750 msgr2=0x7f9dd8160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9ddf4d8640 1 --2- 172.21.15.130:0/2639073679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd8157750 0x7f9dd8160fe0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40097c0 tx=0x7f9dd401c450 comp rx=0 tx=0).stop 2023-09-13T06:05:08.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2639073679 shutdown_connections 2023-09-13T06:05:08.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9ddf4d8640 1 --2- 172.21.15.130:0/2639073679 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dd8157b30 0x7f9dd806dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9ddf4d8640 1 --2- 172.21.15.130:0/2639073679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd8157750 0x7f9dd8160fe0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2639073679 >> 172.21.15.130:0/2639073679 conn(0x7f9dd8065d60 msgr2=0x7f9dd80b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:08.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2639073679 shutdown_connections 2023-09-13T06:05:08.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2639073679 wait complete. 2023-09-13T06:05:08.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9ddf4d8640 1 Processor -- start 2023-09-13T06:05:08.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.278+0000 7f9ddf4d8640 1 -- start start 2023-09-13T06:05:08.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddf4d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd806f170 0x7f9dd815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddf4d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9dd8157750 0x7f9dd8157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddf4d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dd8157b30 0x7f9dd813aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddf4d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd813cea0 con 0x7f9dd806f170 2023-09-13T06:05:08.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddf4d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8158520 con 0x7f9dd8157750 2023-09-13T06:05:08.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddf4d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd813c220 con 0x7f9dd8157b30 2023-09-13T06:05:08.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddd274640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd806f170 0x7f9dd815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddd274640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd806f170 0x7f9dd815feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38988/0 (socket says 172.21.15.130:38988) 2023-09-13T06:05:08.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddd274640 1 -- 172.21.15.130:0/2540788552 learned_addr learned my addr 172.21.15.130:0/2540788552 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:08.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddd274640 1 -- 172.21.15.130:0/2540788552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dd8157b30 msgr2=0x7f9dd813aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddca73640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9dd8157750 0x7f9dd8157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddd274640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dd8157b30 0x7f9dd813aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddd274640 1 -- 172.21.15.130:0/2540788552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9dd8157750 msgr2=0x7f9dd8157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddd274640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9dd8157750 0x7f9dd8157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddd274640 1 -- 172.21.15.130:0/2540788552 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4009420 con 0x7f9dd806f170 2023-09-13T06:05:08.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddca73640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9dd8157750 0x7f9dd8157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:08.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddd274640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd806f170 0x7f9dd815feb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40ad040 tx=0x7f9dd401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:08.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9dcdffb640 1 -- 172.21.15.130:0/2540788552 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40b5810 con 0x7f9dd806f170 2023-09-13T06:05:08.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9dcdffb640 1 -- 172.21.15.130:0/2540788552 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd40b5990 con 0x7f9dd806f170 2023-09-13T06:05:08.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9dcdffb640 1 -- 172.21.15.130:0/2540788552 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40b5d40 con 0x7f9dd806f170 2023-09-13T06:05:08.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2540788552 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd813c500 con 0x7f9dd806f170 2023-09-13T06:05:08.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2540788552 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd813cac0 con 0x7f9dd806f170 2023-09-13T06:05:08.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.282+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2540788552 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd80618a0 con 0x7f9dd806f170 2023-09-13T06:05:08.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.286+0000 7f9dcdffb640 1 -- 172.21.15.130:0/2540788552 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9dd40b4390 con 0x7f9dd806f170 2023-09-13T06:05:08.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.286+0000 7f9dcdffb640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dbc065b20 0x7f9dbc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.286+0000 7f9dcdffb640 1 -- 172.21.15.130:0/2540788552 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9dd411dff0 con 0x7f9dd806f170 2023-09-13T06:05:08.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.286+0000 7f9ddca73640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dbc065b20 0x7f9dbc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.286+0000 7f9dcdffb640 1 -- 172.21.15.130:0/2540788552 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f9dbc06d650 con 0x7f9dd806f170 2023-09-13T06:05:08.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.286+0000 7f9ddca73640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dbc065b20 0x7f9dbc067fe0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9dd81547d0 tx=0x7f9dc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:08.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.290+0000 7f9dcdffb640 1 -- 172.21.15.130:0/2540788552 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9dd40eba70 con 0x7f9dd806f170 2023-09-13T06:05:08.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.438+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2540788552 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9dd815d840 con 0x7f9dd806f170 2023-09-13T06:05:08.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.438+0000 7f9dcdffb640 1 -- 172.21.15.130:0/2540788552 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9dd40ef090 con 0x7f9dd806f170 2023-09-13T06:05:08.440 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:05:08.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2540788552 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dbc065b20 msgr2=0x7f9dbc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dbc065b20 0x7f9dbc067fe0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9dd81547d0 tx=0x7f9dc8008040 comp rx=0 tx=0).stop 2023-09-13T06:05:08.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2540788552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd806f170 msgr2=0x7f9dd815feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd806f170 0x7f9dd815feb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40ad040 tx=0x7f9dd401ac90 comp rx=0 tx=0).stop 2023-09-13T06:05:08.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2540788552 shutdown_connections 2023-09-13T06:05:08.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9dbc065b20 0x7f9dbc067fe0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9dd8157750 0x7f9dd8157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dd8157b30 0x7f9dd813aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 --2- 172.21.15.130:0/2540788552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd806f170 0x7f9dd815feb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2540788552 >> 172.21.15.130:0/2540788552 conn(0x7f9dd8065d60 msgr2=0x7f9dd81604d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:08.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2540788552 shutdown_connections 2023-09-13T06:05:08.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.442+0000 7f9ddf4d8640 1 -- 172.21.15.130:0/2540788552 wait complete. 2023-09-13T06:05:08.460 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:05:08.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f814e2d8640 1 Processor -- start 2023-09-13T06:05:08.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f814e2d8640 1 -- start start 2023-09-13T06:05:08.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f814e2d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f814815ae10 0x7f81480d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f814e2d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81481619b0 0x7f81480cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f814e2d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814815dd40 con 0x7f81480d2b00 2023-09-13T06:05:08.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f814e2d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8148161e40 con 0x7f814815ae10 2023-09-13T06:05:08.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f814e2d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814815e020 con 0x7f81481619b0 2023-09-13T06:05:08.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f81477fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f81480d2b00 0x7f81481612a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39258/0 (socket says 172.21.15.130:39258) 2023-09-13T06:05:08.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f81477fe640 1 -- 172.21.15.130:0/296050236 learned_addr learned my addr 172.21.15.130:0/296050236 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:08.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8147fff640 1 --2- 172.21.15.130:0/296050236 >> v2:172.21.15.164:3300/0 conn(0x7f814815ae10 0x7f81480d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380688171 0 0) 0x7f814815dd40 con 0x7f81480d2b00 2023-09-13T06:05:08.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8130003530 con 0x7f81480d2b00 2023-09-13T06:05:08.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f814c875640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81481619b0 0x7f81480cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3203154671 0 0) 0x7f8130003530 con 0x7f81480d2b00 2023-09-13T06:05:08.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81481619b0 msgr2=0x7f81480cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:08.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81481619b0 0x7f81480cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 >> v2:172.21.15.164:3300/0 conn(0x7f814815ae10 msgr2=0x7f81480d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:08.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 --2- 172.21.15.130:0/296050236 >> v2:172.21.15.164:3300/0 conn(0x7f814815ae10 0x7f81480d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814815e300 con 0x7f81480d2b00 2023-09-13T06:05:08.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f813c001680 con 0x7f81480d2b00 2023-09-13T06:05:08.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 >> v1:172.21.15.130:6789/0 conn(0x7f81480d2b00 legacy=0x7f81481612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81300039f0 0x7f8130003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81481619b0 0x7f81300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8130004d10 0x7f8130005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148161e40 con 0x7f8130004d10 2023-09-13T06:05:08.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814815e020 con 0x7f81300039f0 2023-09-13T06:05:08.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.602+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813000bac0 con 0x7f81481619b0 2023-09-13T06:05:08.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f814c875640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8130004d10 0x7f8130005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f8147fff640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81300039f0 0x7f8130003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f81477fe640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81481619b0 0x7f81300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f814c875640 1 -- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81481619b0 msgr2=0x7f81300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:08.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f814c875640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81481619b0 0x7f81300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f814c875640 1 -- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81300039f0 msgr2=0x7f8130003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:08.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f814c875640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81300039f0 0x7f8130003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f814c875640 1 -- 172.21.15.130:0/296050236 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130003530 con 0x7f8130004d10 2023-09-13T06:05:08.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f81477fe640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81481619b0 0x7f81300047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:08.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f814c875640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8130004d10 0x7f8130005190 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8140009fc0 tx=0x7f814001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edca2227abebdbf7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:08.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81400a5c40 con 0x7f8130004d10 2023-09-13T06:05:08.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814000f040 con 0x7f8130004d10 2023-09-13T06:05:08.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.606+0000 7f8146ffd640 1 -- 172.21.15.130:0/296050236 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81400ad440 con 0x7f8130004d10 2023-09-13T06:05:08.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 -- 172.21.15.130:0/296050236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8130004d10 msgr2=0x7f8130005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 --2- 172.21.15.130:0/296050236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8130004d10 0x7f8130005190 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8140009fc0 tx=0x7f814001cc30 comp rx=0 tx=0).stop 2023-09-13T06:05:08.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814c875640 1 -- 172.21.15.130:0/296050236 reap_dead start 2023-09-13T06:05:08.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 -- 172.21.15.130:0/296050236 shutdown_connections 2023-09-13T06:05:08.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 -- 172.21.15.130:0/296050236 >> 172.21.15.130:0/296050236 conn(0x7f8148065990 msgr2=0x7f8148065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:08.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 -- 172.21.15.130:0/296050236 shutdown_connections 2023-09-13T06:05:08.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 -- 172.21.15.130:0/296050236 wait complete. 2023-09-13T06:05:08.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 Processor -- start 2023-09-13T06:05:08.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 -- start start 2023-09-13T06:05:08.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8130004d10 0x7f81481648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8148148960 0x7f8148148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8148162020 0x7f81481624a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148149320 con 0x7f8148148960 2023-09-13T06:05:08.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148165530 con 0x7f8130004d10 2023-09-13T06:05:08.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f814e2d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8148162ce0 con 0x7f8148162020 2023-09-13T06:05:08.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f81477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8148148960 0x7f8148148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f81477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8148148960 0x7f8148148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38998/0 (socket says 172.21.15.130:38998) 2023-09-13T06:05:08.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f81477fe640 1 -- 172.21.15.130:0/339834403 learned_addr learned my addr 172.21.15.130:0/339834403 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:08.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f81477fe640 1 -- 172.21.15.130:0/339834403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8148162020 msgr2=0x7f81481624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f81477fe640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8148162020 0x7f81481624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f8147fff640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8130004d10 0x7f81481648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f81477fe640 1 -- 172.21.15.130:0/339834403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8130004d10 msgr2=0x7f81481648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f81477fe640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8130004d10 0x7f81481648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.610+0000 7f81477fe640 1 -- 172.21.15.130:0/339834403 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148162fc0 con 0x7f8148148960 2023-09-13T06:05:08.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f8147fff640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8130004d10 0x7f81481648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:08.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f81477fe640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8148148960 0x7f8148148de0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f813c001210 tx=0x7f813c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:08.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f8144ff9640 1 -- 172.21.15.130:0/339834403 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c00c6c0 con 0x7f8148148960 2023-09-13T06:05:08.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f8144ff9640 1 -- 172.21.15.130:0/339834403 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c00c840 con 0x7f8148148960 2023-09-13T06:05:08.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f8144ff9640 1 -- 172.21.15.130:0/339834403 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c00cbf0 con 0x7f8148148960 2023-09-13T06:05:08.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f814e2d8640 1 -- 172.21.15.130:0/339834403 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81481632a0 con 0x7f8148148960 2023-09-13T06:05:08.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f814e2d8640 1 -- 172.21.15.130:0/339834403 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8148163860 con 0x7f8148148960 2023-09-13T06:05:08.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f814e2d8640 1 -- 172.21.15.130:0/339834403 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81480618a0 con 0x7f8148148960 2023-09-13T06:05:08.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f8144ff9640 1 -- 172.21.15.130:0/339834403 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f813c01d460 con 0x7f8148148960 2023-09-13T06:05:08.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f8144ff9640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8134065b50 0x7f8134068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f8144ff9640 1 -- 172.21.15.130:0/339834403 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f813c0833f0 con 0x7f8148148960 2023-09-13T06:05:08.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f8147fff640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8134065b50 0x7f8134068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.614+0000 7f8144ff9640 1 -- 172.21.15.130:0/339834403 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f813406d680 con 0x7f8148148960 2023-09-13T06:05:08.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.618+0000 7f8147fff640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8134065b50 0x7f8134068010 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8138009a60 tx=0x7f8138008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:08.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.618+0000 7f8144ff9640 1 -- 172.21.15.130:0/339834403 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f813c050d40 con 0x7f8148148960 2023-09-13T06:05:08.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.766+0000 7f814e2d8640 1 -- 172.21.15.130:0/339834403 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f814815a3a0 con 0x7f8148148960 2023-09-13T06:05:08.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.766+0000 7f8144ff9640 1 -- 172.21.15.130:0/339834403 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f813c054360 con 0x7f8148148960 2023-09-13T06:05:08.768 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:05:08.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 -- 172.21.15.130:0/339834403 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8134065b50 msgr2=0x7f8134068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8134065b50 0x7f8134068010 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8138009a60 tx=0x7f8138008040 comp rx=0 tx=0).stop 2023-09-13T06:05:08.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 -- 172.21.15.130:0/339834403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8148148960 msgr2=0x7f8148148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8148148960 0x7f8148148de0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f813c001210 tx=0x7f813c00eb90 comp rx=0 tx=0).stop 2023-09-13T06:05:08.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 -- 172.21.15.130:0/339834403 shutdown_connections 2023-09-13T06:05:08.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8134065b50 0x7f8134068010 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8148162020 0x7f81481624a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8148148960 0x7f8148148de0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 --2- 172.21.15.130:0/339834403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8130004d10 0x7f81481648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 -- 172.21.15.130:0/339834403 >> 172.21.15.130:0/339834403 conn(0x7f8148065990 msgr2=0x7f8148159860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:08.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 -- 172.21.15.130:0/339834403 shutdown_connections 2023-09-13T06:05:08.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.770+0000 7f814e2d8640 1 -- 172.21.15.130:0/339834403 wait complete. 2023-09-13T06:05:08.789 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:05:08.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6dab9db640 1 Processor -- start 2023-09-13T06:05:08.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6dab9db640 1 -- start start 2023-09-13T06:05:08.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6dab9db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6da40b2e90 0x7f6da40ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6dab9db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6da40b1460 0x7f6da40b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6dab9db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da40b2150 con 0x7f6da4144d70 2023-09-13T06:05:08.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6dab9db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da40b2430 con 0x7f6da40b2e90 2023-09-13T06:05:08.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6dab9db640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da40cedb0 con 0x7f6da40b1460 2023-09-13T06:05:08.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6da8f76640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6da40b2e90 0x7f6da40ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6da9777640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6da4144d70 0x7f6da40b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39260/0 (socket says 172.21.15.130:39260) 2023-09-13T06:05:08.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6da9777640 1 -- 172.21.15.130:0/1338675026 learned_addr learned my addr 172.21.15.130:0/1338675026 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:08.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6da9f78640 1 --2- 172.21.15.130:0/1338675026 >> v2:172.21.15.164:3300/0 conn(0x7f6da40b1460 0x7f6da40b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6da8f76640 1 -- 172.21.15.130:0/1338675026 >> v2:172.21.15.164:3300/0 conn(0x7f6da40b1460 msgr2=0x7f6da40b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:08.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6da8f76640 1 --2- 172.21.15.130:0/1338675026 >> v2:172.21.15.164:3300/0 conn(0x7f6da40b1460 0x7f6da40b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6da8f76640 1 -- 172.21.15.130:0/1338675026 >> v1:172.21.15.130:6789/0 conn(0x7f6da4144d70 legacy=0x7f6da40b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6da8f76640 1 -- 172.21.15.130:0/1338675026 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da40cdd90 con 0x7f6da40b2e90 2023-09-13T06:05:08.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6d9bfff640 1 -- 172.21.15.130:0/1338675026 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156058153 0 0) 0x7f6da40b2150 con 0x7f6da4144d70 2023-09-13T06:05:08.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.930+0000 7f6da9f78640 1 --2- 172.21.15.130:0/1338675026 >> v2:172.21.15.164:3300/0 conn(0x7f6da40b1460 0x7f6da40b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:08.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6da8f76640 1 --2- 172.21.15.130:0/1338675026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da40b2e90 0x7f6da40ce870 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6da40668f0 tx=0x7f6d9401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53f5d77712885dc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:08.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6d9bfff640 1 -- 172.21.15.130:0/1338675026 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94004230 con 0x7f6da40b2e90 2023-09-13T06:05:08.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6d9bfff640 1 -- 172.21.15.130:0/1338675026 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d940a7050 con 0x7f6da40b2e90 2023-09-13T06:05:08.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6d9bfff640 1 -- 172.21.15.130:0/1338675026 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94003620 con 0x7f6da40b2e90 2023-09-13T06:05:08.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6dab9db640 1 -- 172.21.15.130:0/1338675026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da40b2e90 msgr2=0x7f6da40ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6dab9db640 1 --2- 172.21.15.130:0/1338675026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da40b2e90 0x7f6da40ce870 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6da40668f0 tx=0x7f6d9401c460 comp rx=0 tx=0).stop 2023-09-13T06:05:08.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6dab9db640 1 -- 172.21.15.130:0/1338675026 shutdown_connections 2023-09-13T06:05:08.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6dab9db640 1 --2- 172.21.15.130:0/1338675026 >> v2:172.21.15.164:3300/0 conn(0x7f6da40b1460 0x7f6da40b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6dab9db640 1 --2- 172.21.15.130:0/1338675026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da40b2e90 0x7f6da40ce870 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6dab9db640 1 -- 172.21.15.130:0/1338675026 >> 172.21.15.130:0/1338675026 conn(0x7f6da4065990 msgr2=0x7f6da4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:08.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6dab9db640 1 -- 172.21.15.130:0/1338675026 shutdown_connections 2023-09-13T06:05:08.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.934+0000 7f6dab9db640 1 -- 172.21.15.130:0/1338675026 wait complete. 2023-09-13T06:05:08.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6dab9db640 1 Processor -- start 2023-09-13T06:05:08.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6dab9db640 1 -- start start 2023-09-13T06:05:08.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6dab9db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6da40b1460 0x7f6da4136a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6dab9db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6da40b2e90 0x7f6da41563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6dab9db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da4144d70 0x7f6da406b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6dab9db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4156900 con 0x7f6da4144d70 2023-09-13T06:05:08.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6dab9db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40acb80 con 0x7f6da40b1460 2023-09-13T06:05:08.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6dab9db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40ace60 con 0x7f6da40b2e90 2023-09-13T06:05:08.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6da9f78640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da4144d70 0x7f6da406b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6da9f78640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da4144d70 0x7f6da406b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39016/0 (socket says 172.21.15.130:39016) 2023-09-13T06:05:08.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6da9f78640 1 -- 172.21.15.130:0/3916932527 learned_addr learned my addr 172.21.15.130:0/3916932527 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:08.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6da9777640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6da40b1460 0x7f6da4136a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6da8f76640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6da40b2e90 0x7f6da41563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6da9f78640 1 -- 172.21.15.130:0/3916932527 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6da40b2e90 msgr2=0x7f6da41563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6da9f78640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6da40b2e90 0x7f6da41563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6da9f78640 1 -- 172.21.15.130:0/3916932527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6da40b1460 msgr2=0x7f6da4136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:08.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6da9f78640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6da40b1460 0x7f6da4136a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:08.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6da9f78640 1 -- 172.21.15.130:0/3916932527 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d94009420 con 0x7f6da4144d70 2023-09-13T06:05:08.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6da9f78640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da4144d70 0x7f6da406b360 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00cef0 tx=0x7f6d9c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:08.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6d99ffb640 1 -- 172.21.15.130:0/3916932527 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00d840 con 0x7f6da4144d70 2023-09-13T06:05:08.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6d99ffb640 1 -- 172.21.15.130:0/3916932527 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c00d9c0 con 0x7f6da4144d70 2023-09-13T06:05:08.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6d99ffb640 1 -- 172.21.15.130:0/3916932527 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00dd70 con 0x7f6da4144d70 2023-09-13T06:05:08.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6dab9db640 1 -- 172.21.15.130:0/3916932527 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da40cbb60 con 0x7f6da4144d70 2023-09-13T06:05:08.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6dab9db640 1 -- 172.21.15.130:0/3916932527 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da40cc120 con 0x7f6da4144d70 2023-09-13T06:05:08.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.938+0000 7f6dab9db640 1 -- 172.21.15.130:0/3916932527 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da40cc310 con 0x7f6da4144d70 2023-09-13T06:05:08.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.942+0000 7f6d99ffb640 1 -- 172.21.15.130:0/3916932527 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6d9c01d360 con 0x7f6da4144d70 2023-09-13T06:05:08.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.942+0000 7f6d99ffb640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6d88065b50 0x7f6d88068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:08.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.942+0000 7f6d99ffb640 1 -- 172.21.15.130:0/3916932527 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d9c083d30 con 0x7f6da4144d70 2023-09-13T06:05:08.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.942+0000 7f6da9777640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6d88065b50 0x7f6d88068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:08.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.942+0000 7f6d99ffb640 1 -- 172.21.15.130:0/3916932527 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f6d8806d680 con 0x7f6da4144d70 2023-09-13T06:05:08.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.942+0000 7f6da9777640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6d88065b50 0x7f6d88068010 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6da0000f70 tx=0x7f6da0007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:08.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:08.946+0000 7f6d99ffb640 1 -- 172.21.15.130:0/3916932527 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6d9c01a060 con 0x7f6da4144d70 2023-09-13T06:05:09.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.094+0000 7f6dab9db640 1 -- 172.21.15.130:0/3916932527 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6da40618a0 con 0x7f6da4144d70 2023-09-13T06:05:09.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.094+0000 7f6d99ffb640 1 -- 172.21.15.130:0/3916932527 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d9c051730 con 0x7f6da4144d70 2023-09-13T06:05:09.096 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:05:09.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 -- 172.21.15.130:0/3916932527 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6d88065b50 msgr2=0x7f6d88068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6d88065b50 0x7f6d88068010 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6da0000f70 tx=0x7f6da0007c10 comp rx=0 tx=0).stop 2023-09-13T06:05:09.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 -- 172.21.15.130:0/3916932527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da4144d70 msgr2=0x7f6da406b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da4144d70 0x7f6da406b360 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00cef0 tx=0x7f6d9c00a710 comp rx=0 tx=0).stop 2023-09-13T06:05:09.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 -- 172.21.15.130:0/3916932527 shutdown_connections 2023-09-13T06:05:09.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6d88065b50 0x7f6d88068010 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da4144d70 0x7f6da406b360 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6da40b2e90 0x7f6da41563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 --2- 172.21.15.130:0/3916932527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6da40b1460 0x7f6da4136a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 -- 172.21.15.130:0/3916932527 >> 172.21.15.130:0/3916932527 conn(0x7f6da4065990 msgr2=0x7f6da413fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:09.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 -- 172.21.15.130:0/3916932527 shutdown_connections 2023-09-13T06:05:09.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.098+0000 7f6dab9db640 1 -- 172.21.15.130:0/3916932527 wait complete. 2023-09-13T06:05:09.117 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:05:09.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.254+0000 7f33bca07640 1 Processor -- start 2023-09-13T06:05:09.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.254+0000 7f33bca07640 1 -- start start 2023-09-13T06:05:09.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.254+0000 7f33bca07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33b815d260 0x7f33b80b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.254+0000 7f33bca07640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b8070e70 con 0x7f33b80ce1a0 2023-09-13T06:05:09.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.254+0000 7f33bca07640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b8070280 con 0x7f33b806ddf0 2023-09-13T06:05:09.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.254+0000 7f33bca07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8070540 con 0x7f33b815d260 2023-09-13T06:05:09.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33add9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f33b80ce1a0 0x7f33b806d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39274/0 (socket says 172.21.15.130:39274) 2023-09-13T06:05:09.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33add9b640 1 -- 172.21.15.130:0/3772359042 learned_addr learned my addr 172.21.15.130:0/3772359042 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:09.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b659c640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33b815d260 0x7f33b80b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544407860 0 0) 0x7f33b8070e70 con 0x7f33b80ce1a0 2023-09-13T06:05:09.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a4003530 con 0x7f33b80ce1a0 2023-09-13T06:05:09.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1623047782 0 0) 0x7f33a4003530 con 0x7f33b80ce1a0 2023-09-13T06:05:09.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33b815d260 msgr2=0x7f33b80b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:09.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33b815d260 0x7f33b80b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 >> v1:172.21.15.164:6789/0 conn(0x7f33b806ddf0 legacy=0x7f33b8071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b8070820 con 0x7f33b80ce1a0 2023-09-13T06:05:09.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f33a0001680 con 0x7f33b80ce1a0 2023-09-13T06:05:09.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 >> v1:172.21.15.130:6789/0 conn(0x7f33b80ce1a0 legacy=0x7f33b806d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a4003a20 0x7f33a4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33a40047d0 0x7f33a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a4005190 0x7f33a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8070540 con 0x7f33a4003a20 2023-09-13T06:05:09.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a400c0c0 con 0x7f33a40047d0 2023-09-13T06:05:09.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a400c280 con 0x7f33a4005190 2023-09-13T06:05:09.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b659c640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33b815d260 0x7f33b80b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:05:09.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33add9b640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33a40047d0 0x7f33a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b6d9d640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a4005190 0x7f33a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b659c640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a4003a20 0x7f33a4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33add9b640 1 -- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a4005190 msgr2=0x7f33a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:09.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33add9b640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a4005190 0x7f33a400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33add9b640 1 -- 172.21.15.130:0/3772359042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a4003a20 msgr2=0x7f33a4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:09.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33add9b640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a4003a20 0x7f33a4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33add9b640 1 -- 172.21.15.130:0/3772359042 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a4003530 con 0x7f33a40047d0 2023-09-13T06:05:09.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b659c640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a4003a20 0x7f33a4003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:05:09.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.258+0000 7f33b6d9d640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a4005190 0x7f33a400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:05:09.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33add9b640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33a40047d0 0x7f33a4004c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f33b80ce5a0 tx=0x7f33a001cb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b5eef2c5dd63c46 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:09.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0005ae0 con 0x7f33a40047d0 2023-09-13T06:05:09.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a0005c40 con 0x7f33a40047d0 2023-09-13T06:05:09.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33b5d9b640 1 -- 172.21.15.130:0/3772359042 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a00a5810 con 0x7f33a40047d0 2023-09-13T06:05:09.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33bca07640 1 -- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33a40047d0 msgr2=0x7f33a4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33bca07640 1 --2- 172.21.15.130:0/3772359042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33a40047d0 0x7f33a4004c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f33b80ce5a0 tx=0x7f33a001cb10 comp rx=0 tx=0).stop 2023-09-13T06:05:09.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33b6d9d640 1 -- 172.21.15.130:0/3772359042 reap_dead start 2023-09-13T06:05:09.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33bca07640 1 -- 172.21.15.130:0/3772359042 shutdown_connections 2023-09-13T06:05:09.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33bca07640 1 -- 172.21.15.130:0/3772359042 >> 172.21.15.130:0/3772359042 conn(0x7f33b806a2f0 msgr2=0x7f33b806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:09.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33bca07640 1 -- 172.21.15.130:0/3772359042 shutdown_connections 2023-09-13T06:05:09.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33bca07640 1 -- 172.21.15.130:0/3772359042 wait complete. 2023-09-13T06:05:09.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33bca07640 1 Processor -- start 2023-09-13T06:05:09.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.262+0000 7f33bca07640 1 -- start start 2023-09-13T06:05:09.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33bca07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40047d0 0x7f33b80b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33bca07640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b815bb90 0x7f33b814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33bca07640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33b815c010 0x7f33b815fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33bca07640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81506a0 con 0x7f33b815bb90 2023-09-13T06:05:09.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33bca07640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8150980 con 0x7f33b815c010 2023-09-13T06:05:09.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33bca07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8150c60 con 0x7f33a40047d0 2023-09-13T06:05:09.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33add9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b815bb90 0x7f33b814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33add9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b815bb90 0x7f33b814fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39032/0 (socket says 172.21.15.130:39032) 2023-09-13T06:05:09.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33add9b640 1 -- 172.21.15.130:0/2359957652 learned_addr learned my addr 172.21.15.130:0/2359957652 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:09.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33b659c640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40047d0 0x7f33b80b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33b6d9d640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33b815c010 0x7f33b815fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33add9b640 1 -- 172.21.15.130:0/2359957652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40047d0 msgr2=0x7f33b80b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33add9b640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40047d0 0x7f33b80b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33add9b640 1 -- 172.21.15.130:0/2359957652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33b815c010 msgr2=0x7f33b815fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33add9b640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33b815c010 0x7f33b815fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33add9b640 1 -- 172.21.15.130:0/2359957652 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b8150f40 con 0x7f33b815bb90 2023-09-13T06:05:09.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33add9b640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b815bb90 0x7f33b814fc70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f33a001c940 tx=0x7f33a4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:09.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33af7fe640 1 -- 172.21.15.130:0/2359957652 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a00b4070 con 0x7f33b815bb90 2023-09-13T06:05:09.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33af7fe640 1 -- 172.21.15.130:0/2359957652 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a00a5810 con 0x7f33b815bb90 2023-09-13T06:05:09.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33af7fe640 1 -- 172.21.15.130:0/2359957652 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a00a5b80 con 0x7f33b815bb90 2023-09-13T06:05:09.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33bca07640 1 -- 172.21.15.130:0/2359957652 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b8151220 con 0x7f33b815bb90 2023-09-13T06:05:09.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33bca07640 1 -- 172.21.15.130:0/2359957652 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b81501b0 con 0x7f33b815bb90 2023-09-13T06:05:09.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.266+0000 7f33bca07640 1 -- 172.21.15.130:0/2359957652 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b80618a0 con 0x7f33b815bb90 2023-09-13T06:05:09.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.270+0000 7f33af7fe640 1 -- 172.21.15.130:0/2359957652 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f33a00a5ce0 con 0x7f33b815bb90 2023-09-13T06:05:09.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.270+0000 7f33af7fe640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3398065b50 0x7f3398068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.270+0000 7f33af7fe640 1 -- 172.21.15.130:0/2359957652 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33a011c940 con 0x7f33b815bb90 2023-09-13T06:05:09.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.270+0000 7f33b659c640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3398065b50 0x7f3398068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.270+0000 7f33af7fe640 1 -- 172.21.15.130:0/2359957652 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f339806d680 con 0x7f33b815bb90 2023-09-13T06:05:09.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.270+0000 7f33b659c640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3398065b50 0x7f3398068010 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f33a80097c0 tx=0x7f33a8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:09.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.274+0000 7f33af7fe640 1 -- 172.21.15.130:0/2359957652 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f33a00be060 con 0x7f33b815bb90 2023-09-13T06:05:09.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.434+0000 7f33bca07640 1 -- 172.21.15.130:0/2359957652 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f33b80cf7a0 con 0x7f33b815bb90 2023-09-13T06:05:09.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.434+0000 7f33af7fe640 1 -- 172.21.15.130:0/2359957652 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f33a00ea330 con 0x7f33b815bb90 2023-09-13T06:05:09.437 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:05:09.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 -- 172.21.15.130:0/2359957652 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3398065b50 msgr2=0x7f3398068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3398065b50 0x7f3398068010 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f33a80097c0 tx=0x7f33a8009190 comp rx=0 tx=0).stop 2023-09-13T06:05:09.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 -- 172.21.15.130:0/2359957652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b815bb90 msgr2=0x7f33b814fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b815bb90 0x7f33b814fc70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f33a001c940 tx=0x7f33a4005800 comp rx=0 tx=0).stop 2023-09-13T06:05:09.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 -- 172.21.15.130:0/2359957652 shutdown_connections 2023-09-13T06:05:09.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3398065b50 0x7f3398068010 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33b815c010 0x7f33b815fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b815bb90 0x7f33b814fc70 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 --2- 172.21.15.130:0/2359957652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40047d0 0x7f33b80b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 -- 172.21.15.130:0/2359957652 >> 172.21.15.130:0/2359957652 conn(0x7f33b806a2f0 msgr2=0x7f33b80cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:09.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 -- 172.21.15.130:0/2359957652 shutdown_connections 2023-09-13T06:05:09.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.438+0000 7f33bca07640 1 -- 172.21.15.130:0/2359957652 wait complete. 2023-09-13T06:05:09.457 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T06:05:09.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:09.458 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-13T06:05:09.525 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:05:09.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:09.526 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T06:05:09.536 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:05:09.536 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:09.547 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:05:09.548 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:09.600 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:09.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c86e34640 1 Processor -- start 2023-09-13T06:05:09.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c86e34640 1 -- start start 2023-09-13T06:05:09.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c86e34640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3c800b2da0 0x7f3c8006f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c86e34640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8015d9e0 con 0x7f3c8006fc70 2023-09-13T06:05:09.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c86e34640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8015dcc0 con 0x7f3c800cf2a0 2023-09-13T06:05:09.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c86e34640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8015e660 con 0x7f3c800b2da0 2023-09-13T06:05:09.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c77fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3c8006fc70 0x7f3c800ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39286/0 (socket says 172.21.15.130:39286) 2023-09-13T06:05:09.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c77fff640 1 -- 172.21.15.130:0/1694935646 learned_addr learned my addr 172.21.15.130:0/1694935646 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:09.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c84bd0640 1 --2- 172.21.15.130:0/1694935646 >> v2:172.21.15.130:3300/0 conn(0x7f3c800b2da0 0x7f3c8006f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c777fe640 1 -- 172.21.15.130:0/1694935646 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894023438 0 0) 0x7f3c8015d9e0 con 0x7f3c8006fc70 2023-09-13T06:05:09.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c777fe640 1 -- 172.21.15.130:0/1694935646 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c68003530 con 0x7f3c8006fc70 2023-09-13T06:05:09.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c84bd0640 1 -- 172.21.15.130:0/1694935646 >> v1:172.21.15.164:6789/0 conn(0x7f3c800cf2a0 legacy=0x7f3c80160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c84bd0640 1 -- 172.21.15.130:0/1694935646 >> v1:172.21.15.130:6789/0 conn(0x7f3c8006fc70 legacy=0x7f3c800ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.738+0000 7f3c84bd0640 1 -- 172.21.15.130:0/1694935646 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8015dfa0 con 0x7f3c800b2da0 2023-09-13T06:05:09.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.742+0000 7f3c84bd0640 1 --2- 172.21.15.130:0/1694935646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c800b2da0 0x7f3c8006f730 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0097c0 tx=0x7f3c7c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3c0bdeed72615a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:09.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.742+0000 7f3c777fe640 1 -- 172.21.15.130:0/1694935646 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0a8970 con 0x7f3c800b2da0 2023-09-13T06:05:09.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.742+0000 7f3c777fe640 1 -- 172.21.15.130:0/1694935646 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c0a8ad0 con 0x7f3c800b2da0 2023-09-13T06:05:09.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.742+0000 7f3c777fe640 1 -- 172.21.15.130:0/1694935646 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0a8e60 con 0x7f3c800b2da0 2023-09-13T06:05:09.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.742+0000 7f3c86e34640 1 -- 172.21.15.130:0/1694935646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c800b2da0 msgr2=0x7f3c8006f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.742+0000 7f3c86e34640 1 --2- 172.21.15.130:0/1694935646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c800b2da0 0x7f3c8006f730 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0097c0 tx=0x7f3c7c01ec70 comp rx=0 tx=0).stop 2023-09-13T06:05:09.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.742+0000 7f3c86e34640 1 -- 172.21.15.130:0/1694935646 shutdown_connections 2023-09-13T06:05:09.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.742+0000 7f3c86e34640 1 --2- 172.21.15.130:0/1694935646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c800b2da0 0x7f3c8006f730 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.742+0000 7f3c86e34640 1 -- 172.21.15.130:0/1694935646 >> 172.21.15.130:0/1694935646 conn(0x7f3c8006a2f0 msgr2=0x7f3c8006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:09.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.742+0000 7f3c86e34640 1 -- 172.21.15.130:0/1694935646 shutdown_connections 2023-09-13T06:05:09.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.742+0000 7f3c86e34640 1 -- 172.21.15.130:0/1694935646 wait complete. 2023-09-13T06:05:09.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c86e34640 1 Processor -- start 2023-09-13T06:05:09.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c86e34640 1 -- start start 2023-09-13T06:05:09.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c86e34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c8006fc70 0x7f3c8013ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c86e34640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c800b2da0 0x7f3c801f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c86e34640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c800cf2a0 0x7f3c80143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c86e34640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8013f440 con 0x7f3c8006fc70 2023-09-13T06:05:09.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c86e34640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c801449e0 con 0x7f3c800cf2a0 2023-09-13T06:05:09.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c86e34640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c80144cc0 con 0x7f3c800b2da0 2023-09-13T06:05:09.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c84bd0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c8006fc70 0x7f3c8013ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c84bd0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c8006fc70 0x7f3c8013ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39052/0 (socket says 172.21.15.130:39052) 2023-09-13T06:05:09.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c84bd0640 1 -- 172.21.15.130:0/4255152402 learned_addr learned my addr 172.21.15.130:0/4255152402 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:09.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c77fff640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c800b2da0 0x7f3c801f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c853d1640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c800cf2a0 0x7f3c80143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c84bd0640 1 -- 172.21.15.130:0/4255152402 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c800b2da0 msgr2=0x7f3c801f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c84bd0640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c800b2da0 0x7f3c801f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c84bd0640 1 -- 172.21.15.130:0/4255152402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c800cf2a0 msgr2=0x7f3c80143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c84bd0640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c800cf2a0 0x7f3c80143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c84bd0640 1 -- 172.21.15.130:0/4255152402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c009420 con 0x7f3c8006fc70 2023-09-13T06:05:09.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c84bd0640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c8006fc70 0x7f3c8013ef00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0b3040 tx=0x7f3c7c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:09.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c757fa640 1 -- 172.21.15.130:0/4255152402 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0b9630 con 0x7f3c8006fc70 2023-09-13T06:05:09.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c757fa640 1 -- 172.21.15.130:0/4255152402 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c0b97b0 con 0x7f3c8006fc70 2023-09-13T06:05:09.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c757fa640 1 -- 172.21.15.130:0/4255152402 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0b9b60 con 0x7f3c8006fc70 2023-09-13T06:05:09.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c86e34640 1 -- 172.21.15.130:0/4255152402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c80144fa0 con 0x7f3c8006fc70 2023-09-13T06:05:09.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.746+0000 7f3c86e34640 1 -- 172.21.15.130:0/4255152402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c801424b0 con 0x7f3c8006fc70 2023-09-13T06:05:09.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.750+0000 7f3c86e34640 1 -- 172.21.15.130:0/4255152402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c801426a0 con 0x7f3c8006fc70 2023-09-13T06:05:09.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.750+0000 7f3c757fa640 1 -- 172.21.15.130:0/4255152402 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3c7c0b7040 con 0x7f3c8006fc70 2023-09-13T06:05:09.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.750+0000 7f3c757fa640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c6c065b20 0x7f3c6c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:09.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.750+0000 7f3c757fa640 1 -- 172.21.15.130:0/4255152402 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c7c121240 con 0x7f3c8006fc70 2023-09-13T06:05:09.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.750+0000 7f3c77fff640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c6c065b20 0x7f3c6c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:09.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.750+0000 7f3c757fa640 1 -- 172.21.15.130:0/4255152402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f3c6c06d650 con 0x7f3c8006fc70 2023-09-13T06:05:09.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.750+0000 7f3c77fff640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c6c065b20 0x7f3c6c067fe0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3c8015d2f0 tx=0x7f3c70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:09.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.754+0000 7f3c757fa640 1 -- 172.21.15.130:0/4255152402 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3c7c0b5020 con 0x7f3c8006fc70 2023-09-13T06:05:09.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.902+0000 7f3c86e34640 1 -- 172.21.15.130:0/4255152402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c800618a0 con 0x7f3c8006fc70 2023-09-13T06:05:09.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c757fa640 1 -- 172.21.15.130:0/4255152402 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16659 (secure 0 0 0) 0x7f3c7c0eeb80 con 0x7f3c8006fc70 2023-09-13T06:05:09.905 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:09.906 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":69,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:04:13.325878+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:03:52.722728+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-09-13T06:03:53.712581+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:09.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 -- 172.21.15.130:0/4255152402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c6c065b20 msgr2=0x7f3c6c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c6c065b20 0x7f3c6c067fe0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3c8015d2f0 tx=0x7f3c70009040 comp rx=0 tx=0).stop 2023-09-13T06:05:09.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 -- 172.21.15.130:0/4255152402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c8006fc70 msgr2=0x7f3c8013ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:09.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c8006fc70 0x7f3c8013ef00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0b3040 tx=0x7f3c7c01ba10 comp rx=0 tx=0).stop 2023-09-13T06:05:09.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 -- 172.21.15.130:0/4255152402 shutdown_connections 2023-09-13T06:05:09.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c6c065b20 0x7f3c6c067fe0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c800cf2a0 0x7f3c80143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c800b2da0 0x7f3c801f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 --2- 172.21.15.130:0/4255152402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c8006fc70 0x7f3c8013ef00 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:09.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 -- 172.21.15.130:0/4255152402 >> 172.21.15.130:0/4255152402 conn(0x7f3c8006a2f0 msgr2=0x7f3c800c4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:09.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 -- 172.21.15.130:0/4255152402 shutdown_connections 2023-09-13T06:05:09.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:09.906+0000 7f3c86e34640 1 -- 172.21.15.130:0/4255152402 wait complete. 2023-09-13T06:05:09.927 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:03:52.722728+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:03:53.712581+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:05:09.928 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:05:10.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.066+0000 7f5425f2c640 1 Processor -- start 2023-09-13T06:05:10.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f5425f2c640 1 -- start start 2023-09-13T06:05:10.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f5425f2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f542015a080 0x7f54200b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f5425f2c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f54200b31a0 0x7f54200ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f5425f2c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54200cc850 con 0x7f542015e650 2023-09-13T06:05:10.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f5425f2c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54200b0330 con 0x7f54200b31a0 2023-09-13T06:05:10.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f5425f2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54200cbcd0 con 0x7f542015a080 2023-09-13T06:05:10.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f541ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f54200b31a0 0x7f54200ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f541ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f54200b31a0 0x7f54200ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39058/0 (socket says 172.21.15.130:39058) 2023-09-13T06:05:10.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f541ffff640 1 -- 172.21.15.130:0/3100336305 learned_addr learned my addr 172.21.15.130:0/3100336305 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:10.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f541f7fe640 1 --2- 172.21.15.130:0/3100336305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f542015a080 0x7f54200b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f541ffff640 1 -- 172.21.15.130:0/3100336305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f542015a080 msgr2=0x7f54200b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:10.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f541ffff640 1 --2- 172.21.15.130:0/3100336305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f542015a080 0x7f54200b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f541ffff640 1 -- 172.21.15.130:0/3100336305 >> v1:172.21.15.164:6789/0 conn(0x7f542015e650 legacy=0x7f54200b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f541ffff640 1 -- 172.21.15.130:0/3100336305 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54200cbfb0 con 0x7f54200b31a0 2023-09-13T06:05:10.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.070+0000 7f541f7fe640 1 --2- 172.21.15.130:0/3100336305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f542015a080 0x7f54200b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:10.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f541ffff640 1 --2- 172.21.15.130:0/3100336305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54200b31a0 0x7f54200ccfe0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f541800d150 tx=0x7f541801eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3dd12777e7718d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:10.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f541e7fc640 1 -- 172.21.15.130:0/3100336305 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800b0d0 con 0x7f54200b31a0 2023-09-13T06:05:10.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f541e7fc640 1 -- 172.21.15.130:0/3100336305 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541800b230 con 0x7f54200b31a0 2023-09-13T06:05:10.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f541e7fc640 1 -- 172.21.15.130:0/3100336305 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54180a7a20 con 0x7f54200b31a0 2023-09-13T06:05:10.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f5425f2c640 1 -- 172.21.15.130:0/3100336305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54200b31a0 msgr2=0x7f54200ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f5425f2c640 1 --2- 172.21.15.130:0/3100336305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54200b31a0 0x7f54200ccfe0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f541800d150 tx=0x7f541801eb50 comp rx=0 tx=0).stop 2023-09-13T06:05:10.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f5425f2c640 1 -- 172.21.15.130:0/3100336305 shutdown_connections 2023-09-13T06:05:10.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f5425f2c640 1 --2- 172.21.15.130:0/3100336305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54200b31a0 0x7f54200ccfe0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f5425f2c640 1 --2- 172.21.15.130:0/3100336305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f542015a080 0x7f54200b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f5425f2c640 1 -- 172.21.15.130:0/3100336305 >> 172.21.15.130:0/3100336305 conn(0x7f5420065990 msgr2=0x7f5420065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:10.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f5425f2c640 1 -- 172.21.15.130:0/3100336305 shutdown_connections 2023-09-13T06:05:10.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f5425f2c640 1 -- 172.21.15.130:0/3100336305 wait complete. 2023-09-13T06:05:10.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f5425f2c640 1 Processor -- start 2023-09-13T06:05:10.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.074+0000 7f5425f2c640 1 -- start start 2023-09-13T06:05:10.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5425f2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54200b31a0 0x7f542015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5425f2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015a080 0x7f542014f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5425f2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f542015e650 0x7f542014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5425f2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5420150560 con 0x7f542015a080 2023-09-13T06:05:10.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5425f2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542014f6b0 con 0x7f54200b31a0 2023-09-13T06:05:10.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5425f2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542014f950 con 0x7f542015e650 2023-09-13T06:05:10.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f541effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015a080 0x7f542014f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f541effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015a080 0x7f542014f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39072/0 (socket says 172.21.15.130:39072) 2023-09-13T06:05:10.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f541effd640 1 -- 172.21.15.130:0/828215389 learned_addr learned my addr 172.21.15.130:0/828215389 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:10.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f541ffff640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f542015e650 0x7f542014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f541f7fe640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54200b31a0 0x7f542015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f541effd640 1 -- 172.21.15.130:0/828215389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f542015e650 msgr2=0x7f542014cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f541effd640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f542015e650 0x7f542014cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f541effd640 1 -- 172.21.15.130:0/828215389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54200b31a0 msgr2=0x7f542015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f541effd640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54200b31a0 0x7f542015dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f541effd640 1 -- 172.21.15.130:0/828215389 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541800bd40 con 0x7f542015a080 2023-09-13T06:05:10.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f541effd640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015a080 0x7f542014f170 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f541400c3a0 tx=0x7f541400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:10.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5407fff640 1 -- 172.21.15.130:0/828215389 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54140052d0 con 0x7f542015a080 2023-09-13T06:05:10.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5407fff640 1 -- 172.21.15.130:0/828215389 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414005450 con 0x7f542015a080 2023-09-13T06:05:10.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5425f2c640 1 -- 172.21.15.130:0/828215389 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542014fc30 con 0x7f542015a080 2023-09-13T06:05:10.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5407fff640 1 -- 172.21.15.130:0/828215389 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414003860 con 0x7f542015a080 2023-09-13T06:05:10.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5425f2c640 1 -- 172.21.15.130:0/828215389 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54201501f0 con 0x7f542015a080 2023-09-13T06:05:10.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5425f2c640 1 -- 172.21.15.130:0/828215389 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54201503b0 con 0x7f542015a080 2023-09-13T06:05:10.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.078+0000 7f5407fff640 1 -- 172.21.15.130:0/828215389 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f54140039c0 con 0x7f542015a080 2023-09-13T06:05:10.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.082+0000 7f5407fff640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f540c065b20 0x7f540c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.082+0000 7f5407fff640 1 -- 172.21.15.130:0/828215389 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54140825e0 con 0x7f542015a080 2023-09-13T06:05:10.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.082+0000 7f5407fff640 1 -- 172.21.15.130:0/828215389 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f540c06d650 con 0x7f542015a080 2023-09-13T06:05:10.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.082+0000 7f541f7fe640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f540c065b20 0x7f540c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.082+0000 7f541f7fe640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f540c065b20 0x7f540c067fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5410006e90 tx=0x7f5410008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:10.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.086+0000 7f5407fff640 1 -- 172.21.15.130:0/828215389 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f541404ffd0 con 0x7f542015a080 2023-09-13T06:05:10.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.234+0000 7f5425f2c640 1 -- 172.21.15.130:0/828215389 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54200cc850 con 0x7f542015a080 2023-09-13T06:05:10.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.234+0000 7f5407fff640 1 -- 172.21.15.130:0/828215389 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54200cc850 con 0x7f542015a080 2023-09-13T06:05:10.236 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:05:10.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 -- 172.21.15.130:0/828215389 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f540c065b20 msgr2=0x7f540c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f540c065b20 0x7f540c067fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5410006e90 tx=0x7f5410008040 comp rx=0 tx=0).stop 2023-09-13T06:05:10.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 -- 172.21.15.130:0/828215389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015a080 msgr2=0x7f542014f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015a080 0x7f542014f170 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f541400c3a0 tx=0x7f541400c860 comp rx=0 tx=0).stop 2023-09-13T06:05:10.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 -- 172.21.15.130:0/828215389 shutdown_connections 2023-09-13T06:05:10.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f540c065b20 0x7f540c067fe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f542015e650 0x7f542014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015a080 0x7f542014f170 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 --2- 172.21.15.130:0/828215389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54200b31a0 0x7f542015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 -- 172.21.15.130:0/828215389 >> 172.21.15.130:0/828215389 conn(0x7f5420065990 msgr2=0x7f5420065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:10.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 -- 172.21.15.130:0/828215389 shutdown_connections 2023-09-13T06:05:10.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.238+0000 7f5425f2c640 1 -- 172.21.15.130:0/828215389 wait complete. 2023-09-13T06:05:10.257 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:05:10.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.398+0000 7f510f86a640 1 Processor -- start 2023-09-13T06:05:10.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.398+0000 7f510f86a640 1 -- start start 2023-09-13T06:05:10.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.398+0000 7f510f86a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51081617f0 0x7f51080cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.398+0000 7f510f86a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f51080cc880 0x7f51080ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.398+0000 7f510f86a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51080b2620 con 0x7f51080ce6c0 2023-09-13T06:05:10.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.398+0000 7f510f86a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51080b1a80 con 0x7f51080cc880 2023-09-13T06:05:10.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.398+0000 7f510f86a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51080ccce0 con 0x7f51081617f0 2023-09-13T06:05:10.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.398+0000 7f510ce05640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f51080cc880 0x7f51080ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.398+0000 7f510ce05640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f51080cc880 0x7f51080ce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39084/0 (socket says 172.21.15.130:39084) 2023-09-13T06:05:10.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.398+0000 7f510ce05640 1 -- 172.21.15.130:0/2860912637 learned_addr learned my addr 172.21.15.130:0/2860912637 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:10.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.398+0000 7f510d606640 1 --2- 172.21.15.130:0/2860912637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51081617f0 0x7f51080cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510ce05640 1 -- 172.21.15.130:0/2860912637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51081617f0 msgr2=0x7f51080cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:10.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510ce05640 1 --2- 172.21.15.130:0/2860912637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51081617f0 0x7f51080cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510ce05640 1 -- 172.21.15.130:0/2860912637 >> v1:172.21.15.164:6789/0 conn(0x7f51080ce6c0 legacy=0x7f51080b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:10.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510ce05640 1 -- 172.21.15.130:0/2860912637 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51080b2ab0 con 0x7f51080cc880 2023-09-13T06:05:10.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510d606640 1 --2- 172.21.15.130:0/2860912637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51081617f0 0x7f51080cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:10.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510ce05640 1 --2- 172.21.15.130:0/2860912637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080cc880 0x7f51080ce180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009870 tx=0x7f50f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca30aadf59bf593 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:10.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f50fffff640 1 -- 172.21.15.130:0/2860912637 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f80ac600 con 0x7f51080cc880 2023-09-13T06:05:10.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f50fffff640 1 -- 172.21.15.130:0/2860912637 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f80a8050 con 0x7f51080cc880 2023-09-13T06:05:10.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f50fffff640 1 -- 172.21.15.130:0/2860912637 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f80ac980 con 0x7f51080cc880 2023-09-13T06:05:10.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510f86a640 1 -- 172.21.15.130:0/2860912637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080cc880 msgr2=0x7f51080ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510f86a640 1 --2- 172.21.15.130:0/2860912637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080cc880 0x7f51080ce180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009870 tx=0x7f50f801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510f86a640 1 -- 172.21.15.130:0/2860912637 shutdown_connections 2023-09-13T06:05:10.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510f86a640 1 --2- 172.21.15.130:0/2860912637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080cc880 0x7f51080ce180 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510f86a640 1 --2- 172.21.15.130:0/2860912637 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51081617f0 0x7f51080cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.402+0000 7f510f86a640 1 -- 172.21.15.130:0/2860912637 >> 172.21.15.130:0/2860912637 conn(0x7f5108065990 msgr2=0x7f5108065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:10.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510f86a640 1 -- 172.21.15.130:0/2860912637 shutdown_connections 2023-09-13T06:05:10.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510f86a640 1 -- 172.21.15.130:0/2860912637 wait complete. 2023-09-13T06:05:10.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510f86a640 1 Processor -- start 2023-09-13T06:05:10.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510f86a640 1 -- start start 2023-09-13T06:05:10.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510f86a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080cc880 0x7f510814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510f86a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51080ce6c0 0x7f510814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510f86a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51081617f0 0x7f510815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510f86a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510815d400 con 0x7f51080cc880 2023-09-13T06:05:10.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510f86a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5108159150 con 0x7f51080ce6c0 2023-09-13T06:05:10.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510f86a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510814d830 con 0x7f51081617f0 2023-09-13T06:05:10.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510d606640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080cc880 0x7f510814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510d606640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080cc880 0x7f510814e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39092/0 (socket says 172.21.15.130:39092) 2023-09-13T06:05:10.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510d606640 1 -- 172.21.15.130:0/1781994506 learned_addr learned my addr 172.21.15.130:0/1781994506 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:10.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510ce05640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51080ce6c0 0x7f510814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510de07640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51081617f0 0x7f510815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510d606640 1 -- 172.21.15.130:0/1781994506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51081617f0 msgr2=0x7f510815cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510d606640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51081617f0 0x7f510815cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510d606640 1 -- 172.21.15.130:0/1781994506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51080ce6c0 msgr2=0x7f510814c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510d606640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51080ce6c0 0x7f510814c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510d606640 1 -- 172.21.15.130:0/1781994506 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f80094d0 con 0x7f51080cc880 2023-09-13T06:05:10.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.406+0000 7f510d606640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080cc880 0x7f510814e330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f510400c7f0 tx=0x7f510400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:10.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f50fdffb640 1 -- 172.21.15.130:0/1781994506 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104007820 con 0x7f51080cc880 2023-09-13T06:05:10.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f50fdffb640 1 -- 172.21.15.130:0/1781994506 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5104007980 con 0x7f51080cc880 2023-09-13T06:05:10.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f50fdffb640 1 -- 172.21.15.130:0/1781994506 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104007d30 con 0x7f51080cc880 2023-09-13T06:05:10.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f510f86a640 1 -- 172.21.15.130:0/1781994506 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510814db10 con 0x7f51080cc880 2023-09-13T06:05:10.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f510f86a640 1 -- 172.21.15.130:0/1781994506 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510814e0d0 con 0x7f51080cc880 2023-09-13T06:05:10.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f510f86a640 1 -- 172.21.15.130:0/1781994506 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51080618a0 con 0x7f51080cc880 2023-09-13T06:05:10.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f50fdffb640 1 -- 172.21.15.130:0/1781994506 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f51040113f0 con 0x7f51080cc880 2023-09-13T06:05:10.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f50fdffb640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f50ec065b20 0x7f50ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f50fdffb640 1 -- 172.21.15.130:0/1781994506 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5104083540 con 0x7f51080cc880 2023-09-13T06:05:10.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f510ce05640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f50ec065b20 0x7f50ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f50fdffb640 1 -- 172.21.15.130:0/1781994506 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f50ec06d650 con 0x7f51080cc880 2023-09-13T06:05:10.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.410+0000 7f510ce05640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f50ec065b20 0x7f50ec067fe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f50f80ae000 tx=0x7f50f80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:10.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.414+0000 7f50fdffb640 1 -- 172.21.15.130:0/1781994506 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5104050f30 con 0x7f51080cc880 2023-09-13T06:05:10.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 -- 172.21.15.130:0/1781994506 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f510806e890 con 0x7f51080cc880 2023-09-13T06:05:10.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f50fdffb640 1 -- 172.21.15.130:0/1781994506 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f510401f0a0 con 0x7f51080cc880 2023-09-13T06:05:10.643 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:05:10.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 -- 172.21.15.130:0/1781994506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f50ec065b20 msgr2=0x7f50ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f50ec065b20 0x7f50ec067fe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f50f80ae000 tx=0x7f50f80a7000 comp rx=0 tx=0).stop 2023-09-13T06:05:10.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 -- 172.21.15.130:0/1781994506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080cc880 msgr2=0x7f510814e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080cc880 0x7f510814e330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f510400c7f0 tx=0x7f510400ccb0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 -- 172.21.15.130:0/1781994506 shutdown_connections 2023-09-13T06:05:10.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f50ec065b20 0x7f50ec067fe0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51080ce6c0 0x7f510814c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51081617f0 0x7f510815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 --2- 172.21.15.130:0/1781994506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080cc880 0x7f510814e330 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 -- 172.21.15.130:0/1781994506 >> 172.21.15.130:0/1781994506 conn(0x7f5108065990 msgr2=0x7f51080ad5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:10.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 -- 172.21.15.130:0/1781994506 shutdown_connections 2023-09-13T06:05:10.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.642+0000 7f510f86a640 1 -- 172.21.15.130:0/1781994506 wait complete. 2023-09-13T06:05:10.663 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:05:10.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.802+0000 7f9b5e111640 1 Processor -- start 2023-09-13T06:05:10.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.802+0000 7f9b5e111640 1 -- start start 2023-09-13T06:05:10.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b5e111640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9b580b2c30 0x7f9b580acf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b5e111640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5815e800 con 0x7f9b580b20a0 2023-09-13T06:05:10.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b5e111640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5815d990 con 0x7f9b580b08a0 2023-09-13T06:05:10.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b5e111640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5815dbf0 con 0x7f9b580b2c30 2023-09-13T06:05:10.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b57fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9b580b2c30 0x7f9b580acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b56ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9b580b20a0 0x7f9b580b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39288/0 (socket says 172.21.15.130:39288) 2023-09-13T06:05:10.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b56ffd640 1 -- 172.21.15.130:0/997697238 learned_addr learned my addr 172.21.15.130:0/997697238 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:10.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b567fc640 1 -- 172.21.15.130:0/997697238 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150545616 0 0) 0x7f9b5815d990 con 0x7f9b580b08a0 2023-09-13T06:05:10.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b57fff640 1 -- 172.21.15.130:0/997697238 >> v1:172.21.15.164:6789/0 conn(0x7f9b580b08a0 legacy=0x7f9b580b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b57fff640 1 -- 172.21.15.130:0/997697238 >> v1:172.21.15.130:6789/0 conn(0x7f9b580b20a0 legacy=0x7f9b580b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b57fff640 1 -- 172.21.15.130:0/997697238 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5815ded0 con 0x7f9b580b2c30 2023-09-13T06:05:10.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.806+0000 7f9b57fff640 1 --2- 172.21.15.130:0/997697238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b580b2c30 0x7f9b580acf10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009d90 tx=0x7f9b5001c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebee20d10da4338e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:10.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b567fc640 1 -- 172.21.15.130:0/997697238 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b500a5840 con 0x7f9b580b2c30 2023-09-13T06:05:10.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b567fc640 1 -- 172.21.15.130:0/997697238 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b500a59a0 con 0x7f9b580b2c30 2023-09-13T06:05:10.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b567fc640 1 -- 172.21.15.130:0/997697238 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b500a5d30 con 0x7f9b580b2c30 2023-09-13T06:05:10.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 -- 172.21.15.130:0/997697238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b580b2c30 msgr2=0x7f9b580acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 --2- 172.21.15.130:0/997697238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b580b2c30 0x7f9b580acf10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009d90 tx=0x7f9b5001c7e0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 -- 172.21.15.130:0/997697238 shutdown_connections 2023-09-13T06:05:10.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 --2- 172.21.15.130:0/997697238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b580b2c30 0x7f9b580acf10 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 -- 172.21.15.130:0/997697238 >> 172.21.15.130:0/997697238 conn(0x7f9b58065990 msgr2=0x7f9b58065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:10.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 -- 172.21.15.130:0/997697238 shutdown_connections 2023-09-13T06:05:10.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 -- 172.21.15.130:0/997697238 wait complete. 2023-09-13T06:05:10.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 Processor -- start 2023-09-13T06:05:10.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 -- start start 2023-09-13T06:05:10.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b580b08a0 0x7f9b5806b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b580b20a0 0x7f9b580ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b580b2c30 0x7f9b580cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b581577d0 con 0x7f9b580b2c30 2023-09-13T06:05:10.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b581f7040 con 0x7f9b580b08a0 2023-09-13T06:05:10.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b5e111640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b581f7320 con 0x7f9b580b20a0 2023-09-13T06:05:10.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b57fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b580b2c30 0x7f9b580cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b57fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b580b2c30 0x7f9b580cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39104/0 (socket says 172.21.15.130:39104) 2023-09-13T06:05:10.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.810+0000 7f9b57fff640 1 -- 172.21.15.130:0/2516070975 learned_addr learned my addr 172.21.15.130:0/2516070975 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:10.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b577fe640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b580b08a0 0x7f9b5806b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b56ffd640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b580b20a0 0x7f9b580ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b57fff640 1 -- 172.21.15.130:0/2516070975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b580b20a0 msgr2=0x7f9b580ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b57fff640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b580b20a0 0x7f9b580ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b57fff640 1 -- 172.21.15.130:0/2516070975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b580b08a0 msgr2=0x7f9b5806b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b57fff640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b580b08a0 0x7f9b5806b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b57fff640 1 -- 172.21.15.130:0/2516070975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b50009a70 con 0x7f9b580b2c30 2023-09-13T06:05:10.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b56ffd640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b580b20a0 0x7f9b580ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:10.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b57fff640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b580b2c30 0x7f9b580cd080 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9b500b0040 tx=0x7f9b50019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:10.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b3ffff640 1 -- 172.21.15.130:0/2516070975 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b500adb80 con 0x7f9b580b2c30 2023-09-13T06:05:10.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b3ffff640 1 -- 172.21.15.130:0/2516070975 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b500adce0 con 0x7f9b580b2c30 2023-09-13T06:05:10.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b5e111640 1 -- 172.21.15.130:0/2516070975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b581f7600 con 0x7f9b580b2c30 2023-09-13T06:05:10.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b3ffff640 1 -- 172.21.15.130:0/2516070975 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b500b7630 con 0x7f9b580b2c30 2023-09-13T06:05:10.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b5e111640 1 -- 172.21.15.130:0/2516070975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b58150690 con 0x7f9b580b2c30 2023-09-13T06:05:10.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b5e111640 1 -- 172.21.15.130:0/2516070975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b58157940 con 0x7f9b580b2c30 2023-09-13T06:05:10.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b3ffff640 1 -- 172.21.15.130:0/2516070975 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9b500b4050 con 0x7f9b580b2c30 2023-09-13T06:05:10.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b3ffff640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9b44065b20 0x7f9b44067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:10.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b3ffff640 1 -- 172.21.15.130:0/2516070975 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b5011e570 con 0x7f9b580b2c30 2023-09-13T06:05:10.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b577fe640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9b44065b20 0x7f9b44067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:10.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.814+0000 7f9b3ffff640 1 -- 172.21.15.130:0/2516070975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f9b4406d650 con 0x7f9b580b2c30 2023-09-13T06:05:10.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.818+0000 7f9b577fe640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9b44065b20 0x7f9b44067fe0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9b48007fd0 tx=0x7f9b48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:10.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.818+0000 7f9b3ffff640 1 -- 172.21.15.130:0/2516070975 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9b500b2060 con 0x7f9b580b2c30 2023-09-13T06:05:10.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.966+0000 7f9b5e111640 1 -- 172.21.15.130:0/2516070975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b580618a0 con 0x7f9b580b2c30 2023-09-13T06:05:10.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.966+0000 7f9b3ffff640 1 -- 172.21.15.130:0/2516070975 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b58157940 con 0x7f9b580b2c30 2023-09-13T06:05:10.969 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:05:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 -- 172.21.15.130:0/2516070975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9b44065b20 msgr2=0x7f9b44067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9b44065b20 0x7f9b44067fe0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9b48007fd0 tx=0x7f9b48009040 comp rx=0 tx=0).stop 2023-09-13T06:05:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 -- 172.21.15.130:0/2516070975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b580b2c30 msgr2=0x7f9b580cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b580b2c30 0x7f9b580cd080 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9b500b0040 tx=0x7f9b50019580 comp rx=0 tx=0).stop 2023-09-13T06:05:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 -- 172.21.15.130:0/2516070975 shutdown_connections 2023-09-13T06:05:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9b44065b20 0x7f9b44067fe0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b580b2c30 0x7f9b580cd080 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b580b20a0 0x7f9b580ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 --2- 172.21.15.130:0/2516070975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b580b08a0 0x7f9b5806b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 -- 172.21.15.130:0/2516070975 >> 172.21.15.130:0/2516070975 conn(0x7f9b58065990 msgr2=0x7f9b58065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:10.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 -- 172.21.15.130:0/2516070975 shutdown_connections 2023-09-13T06:05:10.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:10.970+0000 7f9b5e111640 1 -- 172.21.15.130:0/2516070975 wait complete. 2023-09-13T06:05:10.990 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:05:11.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.126+0000 7f6743bdb640 1 Processor -- start 2023-09-13T06:05:11.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.126+0000 7f6743bdb640 1 -- start start 2023-09-13T06:05:11.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6743bdb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f673c0ce7b0 0x7f673c0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6743bdb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673c0ccfd0 con 0x7f673c159f20 2023-09-13T06:05:11.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6743bdb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673c0ced90 con 0x7f673c0b1d20 2023-09-13T06:05:11.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6743bdb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c0b00f0 con 0x7f673c0ce7b0 2023-09-13T06:05:11.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6741977640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f673c159f20 0x7f673c0b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50690/0 (socket says 172.21.15.130:50690) 2023-09-13T06:05:11.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6741977640 1 -- 172.21.15.130:0/2871849871 learned_addr learned my addr 172.21.15.130:0/2871849871 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:11.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6742178640 1 --2- 172.21.15.130:0/2871849871 >> v2:172.21.15.130:3300/0 conn(0x7f673c0ce7b0 0x7f673c0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6740975640 1 -- 172.21.15.130:0/2871849871 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422114862 0 0) 0x7f673c0ccfd0 con 0x7f673c159f20 2023-09-13T06:05:11.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6740975640 1 -- 172.21.15.130:0/2871849871 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6728003530 con 0x7f673c159f20 2023-09-13T06:05:11.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6742178640 1 -- 172.21.15.130:0/2871849871 >> v1:172.21.15.164:6789/0 conn(0x7f673c0b1d20 legacy=0x7f673c0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6742178640 1 -- 172.21.15.130:0/2871849871 >> v1:172.21.15.130:6789/0 conn(0x7f673c159f20 legacy=0x7f673c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6740975640 1 -- 172.21.15.130:0/2871849871 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052517792 0 0) 0x7f673c0ced90 con 0x7f673c0b1d20 2023-09-13T06:05:11.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.130+0000 7f6742178640 1 -- 172.21.15.130:0/2871849871 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c0cd200 con 0x7f673c0ce7b0 2023-09-13T06:05:11.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6742178640 1 --2- 172.21.15.130:0/2871849871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f673c0ce7b0 0x7f673c0cdfc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6734009dc0 tx=0x7f673401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbf2bf0f8c0bd6e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:11.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6740975640 1 -- 172.21.15.130:0/2871849871 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67340a5930 con 0x7f673c0ce7b0 2023-09-13T06:05:11.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6740975640 1 -- 172.21.15.130:0/2871849871 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67340a5a90 con 0x7f673c0ce7b0 2023-09-13T06:05:11.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6740975640 1 -- 172.21.15.130:0/2871849871 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67340a5e20 con 0x7f673c0ce7b0 2023-09-13T06:05:11.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6743bdb640 1 -- 172.21.15.130:0/2871849871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f673c0ce7b0 msgr2=0x7f673c0cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6743bdb640 1 --2- 172.21.15.130:0/2871849871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f673c0ce7b0 0x7f673c0cdfc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6734009dc0 tx=0x7f673401c870 comp rx=0 tx=0).stop 2023-09-13T06:05:11.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6743bdb640 1 -- 172.21.15.130:0/2871849871 shutdown_connections 2023-09-13T06:05:11.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6743bdb640 1 --2- 172.21.15.130:0/2871849871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f673c0ce7b0 0x7f673c0cdfc0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6743bdb640 1 -- 172.21.15.130:0/2871849871 >> 172.21.15.130:0/2871849871 conn(0x7f673c065990 msgr2=0x7f673c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:11.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6743bdb640 1 -- 172.21.15.130:0/2871849871 shutdown_connections 2023-09-13T06:05:11.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6743bdb640 1 -- 172.21.15.130:0/2871849871 wait complete. 2023-09-13T06:05:11.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6743bdb640 1 Processor -- start 2023-09-13T06:05:11.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.134+0000 7f6743bdb640 1 -- start start 2023-09-13T06:05:11.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6743bdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f673c0b1d20 0x7f673c14c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6743bdb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f673c0ce7b0 0x7f673c145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6743bdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f673c159f20 0x7f673c14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6743bdb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c149c90 con 0x7f673c0b1d20 2023-09-13T06:05:11.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6743bdb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c14c9a0 con 0x7f673c0ce7b0 2023-09-13T06:05:11.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6743bdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c1499b0 con 0x7f673c159f20 2023-09-13T06:05:11.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6741977640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f673c0b1d20 0x7f673c14c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6741977640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f673c0b1d20 0x7f673c14c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59608/0 (socket says 172.21.15.130:59608) 2023-09-13T06:05:11.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6741977640 1 -- 172.21.15.130:0/1800796307 learned_addr learned my addr 172.21.15.130:0/1800796307 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:11.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6742178640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f673c159f20 0x7f673c14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6741176640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f673c0ce7b0 0x7f673c145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6741977640 1 -- 172.21.15.130:0/1800796307 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f673c159f20 msgr2=0x7f673c14f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6741977640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f673c159f20 0x7f673c14f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6741977640 1 -- 172.21.15.130:0/1800796307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f673c0ce7b0 msgr2=0x7f673c145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6741977640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f673c0ce7b0 0x7f673c145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6741977640 1 -- 172.21.15.130:0/1800796307 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734009a70 con 0x7f673c0b1d20 2023-09-13T06:05:11.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6742178640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f673c159f20 0x7f673c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:11.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6741176640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f673c0ce7b0 0x7f673c145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:11.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6741977640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f673c0b1d20 0x7f673c14c460 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f673800c450 tx=0x7f673800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:11.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f67327fc640 1 -- 172.21.15.130:0/1800796307 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738005cf0 con 0x7f673c0b1d20 2023-09-13T06:05:11.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f67327fc640 1 -- 172.21.15.130:0/1800796307 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6738005e50 con 0x7f673c0b1d20 2023-09-13T06:05:11.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6743bdb640 1 -- 172.21.15.130:0/1800796307 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673c06b5d0 con 0x7f673c0b1d20 2023-09-13T06:05:11.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f67327fc640 1 -- 172.21.15.130:0/1800796307 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738007290 con 0x7f673c0b1d20 2023-09-13T06:05:11.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6743bdb640 1 -- 172.21.15.130:0/1800796307 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c06bb90 con 0x7f673c0b1d20 2023-09-13T06:05:11.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f6743bdb640 1 -- 172.21.15.130:0/1800796307 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673c06b430 con 0x7f673c0b1d20 2023-09-13T06:05:11.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.138+0000 7f67327fc640 1 -- 172.21.15.130:0/1800796307 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f67380073f0 con 0x7f673c0b1d20 2023-09-13T06:05:11.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.142+0000 7f67327fc640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6720065b20 0x7f6720067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.142+0000 7f67327fc640 1 -- 172.21.15.130:0/1800796307 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67380828c0 con 0x7f673c0b1d20 2023-09-13T06:05:11.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.142+0000 7f6741176640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6720065b20 0x7f6720067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.142+0000 7f67327fc640 1 -- 172.21.15.130:0/1800796307 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f672006d650 con 0x7f673c0b1d20 2023-09-13T06:05:11.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.142+0000 7f6741176640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6720065b20 0x7f6720067fe0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f673c1521d0 tx=0x7f672c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:11.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.146+0000 7f67327fc640 1 -- 172.21.15.130:0/1800796307 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6738017070 con 0x7f673c0b1d20 2023-09-13T06:05:11.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.302+0000 7f6743bdb640 1 -- 172.21.15.130:0/1800796307 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f673c0618a0 con 0x7f673c0b1d20 2023-09-13T06:05:11.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.302+0000 7f67327fc640 1 -- 172.21.15.130:0/1800796307 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6738082030 con 0x7f673c0b1d20 2023-09-13T06:05:11.305 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:05:11.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 -- 172.21.15.130:0/1800796307 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6720065b20 msgr2=0x7f6720067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6720065b20 0x7f6720067fe0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f673c1521d0 tx=0x7f672c009040 comp rx=0 tx=0).stop 2023-09-13T06:05:11.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 -- 172.21.15.130:0/1800796307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f673c0b1d20 msgr2=0x7f673c14c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f673c0b1d20 0x7f673c14c460 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f673800c450 tx=0x7f673800c910 comp rx=0 tx=0).stop 2023-09-13T06:05:11.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 -- 172.21.15.130:0/1800796307 shutdown_connections 2023-09-13T06:05:11.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6720065b20 0x7f6720067fe0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f673c0ce7b0 0x7f673c145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f673c159f20 0x7f673c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 --2- 172.21.15.130:0/1800796307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f673c0b1d20 0x7f673c14c460 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 -- 172.21.15.130:0/1800796307 >> 172.21.15.130:0/1800796307 conn(0x7f673c065990 msgr2=0x7f673c0b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:11.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 -- 172.21.15.130:0/1800796307 shutdown_connections 2023-09-13T06:05:11.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.306+0000 7f6743bdb640 1 -- 172.21.15.130:0/1800796307 wait complete. 2023-09-13T06:05:11.326 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T06:05:11.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:11.327 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-13T06:05:11.379 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:05:11.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:11.380 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T06:05:11.390 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:05:11.391 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:11.400 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:05:11.400 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:05:11.401 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:11.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:05:11.440 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:05:11.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422f648640 1 Processor -- start 2023-09-13T06:05:11.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422f648640 1 -- start start 2023-09-13T06:05:11.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422f648640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4228146d40 0x7f422806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422f648640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4228072030 0x7f422806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422f648640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4228070f90 con 0x7f4228070280 2023-09-13T06:05:11.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422f648640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42280cf140 con 0x7f4228146d40 2023-09-13T06:05:11.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422f648640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4228071270 con 0x7f4228072030 2023-09-13T06:05:11.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422dbe5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4228070280 0x7f42280706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50706/0 (socket says 172.21.15.130:50706) 2023-09-13T06:05:11.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422dbe5640 1 -- 172.21.15.130:0/4172287196 learned_addr learned my addr 172.21.15.130:0/4172287196 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:11.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422cbe3640 1 --2- 172.21.15.130:0/4172287196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4228072030 0x7f422806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422d3e4640 1 --2- 172.21.15.130:0/4172287196 >> v2:172.21.15.164:3300/0 conn(0x7f4228146d40 0x7f422806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f421ffff640 1 -- 172.21.15.130:0/4172287196 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746657785 0 0) 0x7f4228070f90 con 0x7f4228070280 2023-09-13T06:05:11.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f421ffff640 1 -- 172.21.15.130:0/4172287196 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4214003530 con 0x7f4228070280 2023-09-13T06:05:11.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422cbe3640 1 -- 172.21.15.130:0/4172287196 >> v2:172.21.15.164:3300/0 conn(0x7f4228146d40 msgr2=0x7f422806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:11.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422cbe3640 1 --2- 172.21.15.130:0/4172287196 >> v2:172.21.15.164:3300/0 conn(0x7f4228146d40 0x7f422806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422cbe3640 1 -- 172.21.15.130:0/4172287196 >> v1:172.21.15.130:6789/0 conn(0x7f4228070280 legacy=0x7f42280706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422cbe3640 1 -- 172.21.15.130:0/4172287196 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228071550 con 0x7f4228072030 2023-09-13T06:05:11.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.577+0000 7f422d3e4640 1 --2- 172.21.15.130:0/4172287196 >> v2:172.21.15.164:3300/0 conn(0x7f4228146d40 0x7f422806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:05:11.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f422cbe3640 1 --2- 172.21.15.130:0/4172287196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4228072030 0x7f422806dcd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f42180097c0 tx=0x7f421801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17ccc52eaa1866a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:11.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f421ffff640 1 -- 172.21.15.130:0/4172287196 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180ab650 con 0x7f4228072030 2023-09-13T06:05:11.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f421ffff640 1 -- 172.21.15.130:0/4172287196 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42180ab7b0 con 0x7f4228072030 2023-09-13T06:05:11.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f421ffff640 1 -- 172.21.15.130:0/4172287196 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180abb40 con 0x7f4228072030 2023-09-13T06:05:11.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f422f648640 1 -- 172.21.15.130:0/4172287196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4228072030 msgr2=0x7f422806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f422f648640 1 --2- 172.21.15.130:0/4172287196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4228072030 0x7f422806dcd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f42180097c0 tx=0x7f421801c450 comp rx=0 tx=0).stop 2023-09-13T06:05:11.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f422f648640 1 -- 172.21.15.130:0/4172287196 shutdown_connections 2023-09-13T06:05:11.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f422f648640 1 --2- 172.21.15.130:0/4172287196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4228072030 0x7f422806dcd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f422f648640 1 --2- 172.21.15.130:0/4172287196 >> v2:172.21.15.164:3300/0 conn(0x7f4228146d40 0x7f422806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f422f648640 1 -- 172.21.15.130:0/4172287196 >> 172.21.15.130:0/4172287196 conn(0x7f422806a2f0 msgr2=0x7f422806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:11.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f422f648640 1 -- 172.21.15.130:0/4172287196 shutdown_connections 2023-09-13T06:05:11.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.581+0000 7f422f648640 1 -- 172.21.15.130:0/4172287196 wait complete. 2023-09-13T06:05:11.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422f648640 1 Processor -- start 2023-09-13T06:05:11.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422f648640 1 -- start start 2023-09-13T06:05:11.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422f648640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4228070280 0x7f42281f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422f648640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4228072030 0x7f4228160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422f648640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4228146d40 0x7f42280cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422f648640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42281f8ff0 con 0x7f4228072030 2023-09-13T06:05:11.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422f648640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422813c2b0 con 0x7f4228146d40 2023-09-13T06:05:11.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422f648640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422813bcf0 con 0x7f4228070280 2023-09-13T06:05:11.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422cbe3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4228072030 0x7f4228160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422cbe3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4228072030 0x7f4228160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59612/0 (socket says 172.21.15.130:59612) 2023-09-13T06:05:11.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422cbe3640 1 -- 172.21.15.130:0/1481145075 learned_addr learned my addr 172.21.15.130:0/1481145075 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:11.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422d3e4640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4228070280 0x7f42281f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422dbe5640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4228146d40 0x7f42280cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422cbe3640 1 -- 172.21.15.130:0/1481145075 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4228070280 msgr2=0x7f42281f9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422cbe3640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4228070280 0x7f42281f9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422cbe3640 1 -- 172.21.15.130:0/1481145075 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4228146d40 msgr2=0x7f42280cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422cbe3640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4228146d40 0x7f42280cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422cbe3640 1 -- 172.21.15.130:0/1481145075 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224009420 con 0x7f4228072030 2023-09-13T06:05:11.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422cbe3640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4228072030 0x7f4228160390 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f42180ad040 tx=0x7f421801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:11.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f421dffb640 1 -- 172.21.15.130:0/1481145075 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180bf610 con 0x7f4228072030 2023-09-13T06:05:11.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f421dffb640 1 -- 172.21.15.130:0/1481145075 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42180bf7b0 con 0x7f4228072030 2023-09-13T06:05:11.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f421dffb640 1 -- 172.21.15.130:0/1481145075 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180bfb60 con 0x7f4228072030 2023-09-13T06:05:11.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422f648640 1 -- 172.21.15.130:0/1481145075 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4218009420 con 0x7f4228072030 2023-09-13T06:05:11.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.585+0000 7f422f648640 1 -- 172.21.15.130:0/1481145075 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42281f8c80 con 0x7f4228072030 2023-09-13T06:05:11.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.589+0000 7f422f648640 1 -- 172.21.15.130:0/1481145075 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42281f9160 con 0x7f4228072030 2023-09-13T06:05:11.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.589+0000 7f421dffb640 1 -- 172.21.15.130:0/1481145075 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f42180b5400 con 0x7f4228072030 2023-09-13T06:05:11.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.589+0000 7f421dffb640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f420c065b20 0x7f420c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.589+0000 7f421dffb640 1 -- 172.21.15.130:0/1481145075 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f421811dc30 con 0x7f4228072030 2023-09-13T06:05:11.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.589+0000 7f422d3e4640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f420c065b20 0x7f420c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.589+0000 7f421dffb640 1 -- 172.21.15.130:0/1481145075 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f420c06d650 con 0x7f4228072030 2023-09-13T06:05:11.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.589+0000 7f422d3e4640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f420c065b20 0x7f420c067fe0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4228141850 tx=0x7f4224009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:11.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.593+0000 7f421dffb640 1 -- 172.21.15.130:0/1481145075 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f42180eb630 con 0x7f4228072030 2023-09-13T06:05:11.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 -- 172.21.15.130:0/1481145075 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42280618a0 con 0x7f4228072030 2023-09-13T06:05:11.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f421dffb640 1 -- 172.21.15.130:0/1481145075 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f42180eec50 con 0x7f4228072030 2023-09-13T06:05:11.774 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:11.775 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1338889971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1338889971},{"type":"v1","addr":"172.21.15.164:6835","nonce":1338889971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1298091712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1298091712},{"type":"v1","addr":"172.21.15.130:6835","nonce":1298091712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/798128577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":798128577},{"type":"v1","addr":"172.21.15.130:6837","nonce":798128577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:03:54.710730+0000","modified":"2023-09-13T06:03:57.752848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6087":{"gid":6087,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2038440053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2038440053},{"type":"v1","addr":"172.21.15.164:6833","nonce":2038440053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-09-13T06:05:11.775 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 34 2023-09-13T06:05:11.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 -- 172.21.15.130:0/1481145075 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f420c065b20 msgr2=0x7f420c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f420c065b20 0x7f420c067fe0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4228141850 tx=0x7f4224009190 comp rx=0 tx=0).stop 2023-09-13T06:05:11.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 -- 172.21.15.130:0/1481145075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4228072030 msgr2=0x7f4228160390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4228072030 0x7f4228160390 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f42180ad040 tx=0x7f421801ac90 comp rx=0 tx=0).stop 2023-09-13T06:05:11.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 -- 172.21.15.130:0/1481145075 shutdown_connections 2023-09-13T06:05:11.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f420c065b20 0x7f420c067fe0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4228146d40 0x7f42280cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4228072030 0x7f4228160390 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 --2- 172.21.15.130:0/1481145075 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4228070280 0x7f42281f9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 -- 172.21.15.130:0/1481145075 >> 172.21.15.130:0/1481145075 conn(0x7f422806a2f0 msgr2=0x7f42280b5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:11.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 -- 172.21.15.130:0/1481145075 shutdown_connections 2023-09-13T06:05:11.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.773+0000 7f422f648640 1 -- 172.21.15.130:0/1481145075 wait complete. 2023-09-13T06:05:11.795 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:11.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.929+0000 7f9adcf2c640 1 Processor -- start 2023-09-13T06:05:11.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.929+0000 7f9adcf2c640 1 -- start start 2023-09-13T06:05:11.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9adcf2c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9ad8159f20 0x7f9ad80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9adcf2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ad80cdfc0 0x7f9ad80b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9adcf2c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad80ccfd0 con 0x7f9ad80b1610 2023-09-13T06:05:11.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9adcf2c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad80b00f0 con 0x7f9ad8159f20 2023-09-13T06:05:11.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9adcf2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80ce420 con 0x7f9ad80cdfc0 2023-09-13T06:05:11.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9acdd9b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ad80cdfc0 0x7f9ad80b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9ad659c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9ad8159f20 0x7f9ad80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9ad659c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9ad8159f20 0x7f9ad80ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:43100/0 (socket says 172.21.15.130:43100) 2023-09-13T06:05:11.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9ad659c640 1 -- 172.21.15.130:0/763870086 learned_addr learned my addr 172.21.15.130:0/763870086 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:11.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9ad659c640 1 -- 172.21.15.130:0/763870086 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ad80cdfc0 msgr2=0x7f9ad80b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:11.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9ad659c640 1 --2- 172.21.15.130:0/763870086 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ad80cdfc0 0x7f9ad80b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9ad659c640 1 -- 172.21.15.130:0/763870086 >> v1:172.21.15.164:6789/0 conn(0x7f9ad80b1610 legacy=0x7f9ad80ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.933+0000 7f9ad659c640 1 -- 172.21.15.130:0/763870086 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80ced90 con 0x7f9ad8159f20 2023-09-13T06:05:11.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9ad659c640 1 --2- 172.21.15.130:0/763870086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ad8159f20 0x7f9ad80ce7b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009870 tx=0x7f9ac801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6794588cda7038f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:11.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9ad5d9b640 1 -- 172.21.15.130:0/763870086 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80a7070 con 0x7f9ad8159f20 2023-09-13T06:05:11.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9ad5d9b640 1 -- 172.21.15.130:0/763870086 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac80ab430 con 0x7f9ad8159f20 2023-09-13T06:05:11.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9ad5d9b640 1 -- 172.21.15.130:0/763870086 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80ab7c0 con 0x7f9ad8159f20 2023-09-13T06:05:11.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 -- 172.21.15.130:0/763870086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ad8159f20 msgr2=0x7f9ad80ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 --2- 172.21.15.130:0/763870086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ad8159f20 0x7f9ad80ce7b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009870 tx=0x7f9ac801c540 comp rx=0 tx=0).stop 2023-09-13T06:05:11.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 -- 172.21.15.130:0/763870086 shutdown_connections 2023-09-13T06:05:11.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 --2- 172.21.15.130:0/763870086 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ad80cdfc0 0x7f9ad80b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 --2- 172.21.15.130:0/763870086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ad8159f20 0x7f9ad80ce7b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 -- 172.21.15.130:0/763870086 >> 172.21.15.130:0/763870086 conn(0x7f9ad8065990 msgr2=0x7f9ad8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:11.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 -- 172.21.15.130:0/763870086 shutdown_connections 2023-09-13T06:05:11.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 -- 172.21.15.130:0/763870086 wait complete. 2023-09-13T06:05:11.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 Processor -- start 2023-09-13T06:05:11.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 -- start start 2023-09-13T06:05:11.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ad80b1610 0x7f9ad81531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ad80cdfc0 0x7f9ad80c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ad8159f20 0x7f9ad814ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80c3870 con 0x7f9ad8159f20 2023-09-13T06:05:11.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80ab6c0 con 0x7f9ad80b1610 2023-09-13T06:05:11.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.937+0000 7f9adcf2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80aab40 con 0x7f9ad80cdfc0 2023-09-13T06:05:11.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9ad659c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ad80b1610 0x7f9ad81531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9ad6d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ad8159f20 0x7f9ad814ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9ad659c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ad80b1610 0x7f9ad81531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:43116/0 (socket says 172.21.15.130:43116) 2023-09-13T06:05:11.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9acdd9b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ad80cdfc0 0x7f9ad80c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9ad659c640 1 -- 172.21.15.130:0/4061158992 learned_addr learned my addr 172.21.15.130:0/4061158992 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:11.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9ad659c640 1 -- 172.21.15.130:0/4061158992 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ad80cdfc0 msgr2=0x7f9ad80c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9ad659c640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ad80cdfc0 0x7f9ad80c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9ad659c640 1 -- 172.21.15.130:0/4061158992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ad8159f20 msgr2=0x7f9ad814ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:11.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9ad659c640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ad8159f20 0x7f9ad814ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:11.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9ad659c640 1 -- 172.21.15.130:0/4061158992 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac80094d0 con 0x7f9ad80b1610 2023-09-13T06:05:11.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9ad659c640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ad80b1610 0x7f9ad81531c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80ad040 tx=0x7f9ac80192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:11.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9acf7fe640 1 -- 172.21.15.130:0/4061158992 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80b4620 con 0x7f9ad80b1610 2023-09-13T06:05:11.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9acf7fe640 1 -- 172.21.15.130:0/4061158992 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac80b4780 con 0x7f9ad80b1610 2023-09-13T06:05:11.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9acf7fe640 1 -- 172.21.15.130:0/4061158992 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80b4b30 con 0x7f9ad80b1610 2023-09-13T06:05:11.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9adcf2c640 1 -- 172.21.15.130:0/4061158992 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad80aae20 con 0x7f9ad80b1610 2023-09-13T06:05:11.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9adcf2c640 1 -- 172.21.15.130:0/4061158992 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad80ab3e0 con 0x7f9ad80b1610 2023-09-13T06:05:11.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9adcf2c640 1 -- 172.21.15.130:0/4061158992 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad80abb10 con 0x7f9ad80b1610 2023-09-13T06:05:11.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.941+0000 7f9acf7fe640 1 -- 172.21.15.130:0/4061158992 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9ac80b4c90 con 0x7f9ad80b1610 2023-09-13T06:05:11.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.945+0000 7f9acf7fe640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ab8065b20 0x7f9ab8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:11.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.945+0000 7f9acf7fe640 1 -- 172.21.15.130:0/4061158992 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ac811d840 con 0x7f9ad80b1610 2023-09-13T06:05:11.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.945+0000 7f9acdd9b640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ab8065b20 0x7f9ab8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:11.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.945+0000 7f9acf7fe640 1 -- 172.21.15.130:0/4061158992 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f9ab806d650 con 0x7f9ad80b1610 2023-09-13T06:05:11.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.945+0000 7f9acdd9b640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ab8065b20 0x7f9ab8067fe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9ad81517f0 tx=0x7f9ac0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:11.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:11.949+0000 7f9acf7fe640 1 -- 172.21.15.130:0/4061158992 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9ac80ba060 con 0x7f9ad80b1610 2023-09-13T06:05:12.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.097+0000 7f9adcf2c640 1 -- 172.21.15.130:0/4061158992 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ad80abb10 con 0x7f9ad80b1610 2023-09-13T06:05:12.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9acf7fe640 1 -- 172.21.15.130:0/4061158992 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16659 (secure 0 0 0) 0x7f9ad80abb10 con 0x7f9ad80b1610 2023-09-13T06:05:12.102 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:12.102 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":69,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:04:13.325878+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:03:52.722728+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-09-13T06:03:53.712581+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 -- 172.21.15.130:0/4061158992 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ab8065b20 msgr2=0x7f9ab8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ab8065b20 0x7f9ab8067fe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9ad81517f0 tx=0x7f9ac0009190 comp rx=0 tx=0).stop 2023-09-13T06:05:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 -- 172.21.15.130:0/4061158992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ad80b1610 msgr2=0x7f9ad81531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ad80b1610 0x7f9ad81531c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80ad040 tx=0x7f9ac80192e0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 -- 172.21.15.130:0/4061158992 shutdown_connections 2023-09-13T06:05:12.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ab8065b20 0x7f9ab8067fe0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ad8159f20 0x7f9ad814ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ad80cdfc0 0x7f9ad80c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 --2- 172.21.15.130:0/4061158992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ad80b1610 0x7f9ad81531c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 -- 172.21.15.130:0/4061158992 >> 172.21.15.130:0/4061158992 conn(0x7f9ad8065990 msgr2=0x7f9ad806c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:12.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 -- 172.21.15.130:0/4061158992 shutdown_connections 2023-09-13T06:05:12.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.101+0000 7f9adcf2c640 1 -- 172.21.15.130:0/4061158992 wait complete. 2023-09-13T06:05:12.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:03:52.722728+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:03:53.712581+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:05:12.124 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:05:12.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.261+0000 7faf15340640 1 Processor -- start 2023-09-13T06:05:12.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.261+0000 7faf15340640 1 -- start start 2023-09-13T06:05:12.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf15340640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faf100d3810 0x7faf100d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf15340640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf100d1930 0x7faf1015da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf15340640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf10147150 con 0x7faf10146d70 2023-09-13T06:05:12.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf15340640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf100d3c70 con 0x7faf100d3810 2023-09-13T06:05:12.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf15340640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf100d1dc0 con 0x7faf100d1930 2023-09-13T06:05:12.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf0effd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7faf10146d70 0x7faf100b6b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50722/0 (socket says 172.21.15.130:50722) 2023-09-13T06:05:12.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf0effd640 1 -- 172.21.15.130:0/3164748866 learned_addr learned my addr 172.21.15.130:0/3164748866 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:12.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf067fc640 1 --2- 172.21.15.130:0/3164748866 >> v2:172.21.15.130:3300/0 conn(0x7faf100d3810 0x7faf100d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf0f7fe640 1 --2- 172.21.15.130:0/3164748866 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf100d1930 0x7faf1015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf0e7fc640 1 -- 172.21.15.130:0/3164748866 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677748695 0 0) 0x7faf10147150 con 0x7faf10146d70 2023-09-13T06:05:12.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf0e7fc640 1 -- 172.21.15.130:0/3164748866 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faefc003530 con 0x7faf10146d70 2023-09-13T06:05:12.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf067fc640 1 -- 172.21.15.130:0/3164748866 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf100d1930 msgr2=0x7faf1015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:12.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf067fc640 1 --2- 172.21.15.130:0/3164748866 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf100d1930 0x7faf1015da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf067fc640 1 -- 172.21.15.130:0/3164748866 >> v1:172.21.15.130:6789/0 conn(0x7faf10146d70 legacy=0x7faf100b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf067fc640 1 -- 172.21.15.130:0/3164748866 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf100d2770 con 0x7faf100d3810 2023-09-13T06:05:12.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.265+0000 7faf0f7fe640 1 --2- 172.21.15.130:0/3164748866 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf100d1930 0x7faf1015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:12.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf067fc640 1 --2- 172.21.15.130:0/3164748866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf100d3810 0x7faf100d13f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7faf000097c0 tx=0x7faf0001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebde47d2ed058012 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:12.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf0e7fc640 1 -- 172.21.15.130:0/3164748866 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf000ab450 con 0x7faf100d3810 2023-09-13T06:05:12.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf0e7fc640 1 -- 172.21.15.130:0/3164748866 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf000ab5b0 con 0x7faf100d3810 2023-09-13T06:05:12.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf0e7fc640 1 -- 172.21.15.130:0/3164748866 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf000ab940 con 0x7faf100d3810 2023-09-13T06:05:12.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf15340640 1 -- 172.21.15.130:0/3164748866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf100d3810 msgr2=0x7faf100d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf15340640 1 --2- 172.21.15.130:0/3164748866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf100d3810 0x7faf100d13f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7faf000097c0 tx=0x7faf0001c450 comp rx=0 tx=0).stop 2023-09-13T06:05:12.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf15340640 1 -- 172.21.15.130:0/3164748866 shutdown_connections 2023-09-13T06:05:12.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf15340640 1 --2- 172.21.15.130:0/3164748866 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf100d1930 0x7faf1015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf15340640 1 --2- 172.21.15.130:0/3164748866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf100d3810 0x7faf100d13f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf15340640 1 -- 172.21.15.130:0/3164748866 >> 172.21.15.130:0/3164748866 conn(0x7faf1006f170 msgr2=0x7faf1006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:12.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf15340640 1 -- 172.21.15.130:0/3164748866 shutdown_connections 2023-09-13T06:05:12.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf15340640 1 -- 172.21.15.130:0/3164748866 wait complete. 2023-09-13T06:05:12.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf15340640 1 Processor -- start 2023-09-13T06:05:12.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.269+0000 7faf15340640 1 -- start start 2023-09-13T06:05:12.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf15340640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf100d1930 0x7faf10156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf15340640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf100d3810 0x7faf1013f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf15340640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf10146d70 0x7faf1015fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf15340640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10158990 con 0x7faf100d3810 2023-09-13T06:05:12.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf15340640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10158e20 con 0x7faf10146d70 2023-09-13T06:05:12.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf15340640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf101568b0 con 0x7faf100d1930 2023-09-13T06:05:12.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf067fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf100d3810 0x7faf1013f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf067fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf100d3810 0x7faf1013f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59636/0 (socket says 172.21.15.130:59636) 2023-09-13T06:05:12.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf067fc640 1 -- 172.21.15.130:0/667966998 learned_addr learned my addr 172.21.15.130:0/667966998 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:12.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf0effd640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf100d1930 0x7faf10156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf0f7fe640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf10146d70 0x7faf1015fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf067fc640 1 -- 172.21.15.130:0/667966998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf100d1930 msgr2=0x7faf10156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf067fc640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf100d1930 0x7faf10156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf067fc640 1 -- 172.21.15.130:0/667966998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf10146d70 msgr2=0x7faf1015fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf067fc640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf10146d70 0x7faf1015fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf067fc640 1 -- 172.21.15.130:0/667966998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf00009420 con 0x7faf100d3810 2023-09-13T06:05:12.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf0f7fe640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf10146d70 0x7faf1015fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:12.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf067fc640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf100d3810 0x7faf1013f1e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7faf000ad040 tx=0x7faf0001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:12.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf07fff640 1 -- 172.21.15.130:0/667966998 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf000b5810 con 0x7faf100d3810 2023-09-13T06:05:12.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf07fff640 1 -- 172.21.15.130:0/667966998 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf000b59b0 con 0x7faf100d3810 2023-09-13T06:05:12.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf15340640 1 -- 172.21.15.130:0/667966998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1013f720 con 0x7faf100d3810 2023-09-13T06:05:12.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf07fff640 1 -- 172.21.15.130:0/667966998 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf000b5d60 con 0x7faf100d3810 2023-09-13T06:05:12.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf15340640 1 -- 172.21.15.130:0/667966998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf10158060 con 0x7faf100d3810 2023-09-13T06:05:12.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf15340640 1 -- 172.21.15.130:0/667966998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf100618a0 con 0x7faf100d3810 2023-09-13T06:05:12.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.273+0000 7faf07fff640 1 -- 172.21.15.130:0/667966998 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7faf000c83f0 con 0x7faf100d3810 2023-09-13T06:05:12.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.277+0000 7faf07fff640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faef0065b20 0x7faef0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.277+0000 7faf07fff640 1 -- 172.21.15.130:0/667966998 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf0011e110 con 0x7faf100d3810 2023-09-13T06:05:12.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.277+0000 7faf0effd640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faef0065b20 0x7faef0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.277+0000 7faf07fff640 1 -- 172.21.15.130:0/667966998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7faef006d650 con 0x7faf100d3810 2023-09-13T06:05:12.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.277+0000 7faf0effd640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faef0065b20 0x7faef0067fe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faef80011f0 tx=0x7faef8007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:12.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.281+0000 7faf07fff640 1 -- 172.21.15.130:0/667966998 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7faf000ebb90 con 0x7faf100d3810 2023-09-13T06:05:12.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.365+0000 7faf07fff640 1 -- 172.21.15.130:0/667966998 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(70..70 src has 1..70) v4 ==== 296+0+0 (secure 0 0 0) 0x7faf000ef850 con 0x7faf100d3810 2023-09-13T06:05:12.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.365+0000 7faf07fff640 1 -- 172.21.15.130:0/667966998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7faef006de90 con 0x7faf100d3810 2023-09-13T06:05:12.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.437+0000 7faf15340640 1 -- 172.21.15.130:0/667966998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf100667b0 con 0x7faf100d3810 2023-09-13T06:05:12.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.437+0000 7faf07fff640 1 -- 172.21.15.130:0/667966998 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf00006e20 con 0x7faf100d3810 2023-09-13T06:05:12.441 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:05:12.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 -- 172.21.15.130:0/667966998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faef0065b20 msgr2=0x7faef0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faef0065b20 0x7faef0067fe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faef80011f0 tx=0x7faef8007d40 comp rx=0 tx=0).stop 2023-09-13T06:05:12.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 -- 172.21.15.130:0/667966998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf100d3810 msgr2=0x7faf1013f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf100d3810 0x7faf1013f1e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7faf000ad040 tx=0x7faf0001ac90 comp rx=0 tx=0).stop 2023-09-13T06:05:12.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 -- 172.21.15.130:0/667966998 shutdown_connections 2023-09-13T06:05:12.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faef0065b20 0x7faef0067fe0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf10146d70 0x7faf1015fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf100d3810 0x7faf1013f1e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 --2- 172.21.15.130:0/667966998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf100d1930 0x7faf10156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 -- 172.21.15.130:0/667966998 >> 172.21.15.130:0/667966998 conn(0x7faf1006f170 msgr2=0x7faf1015d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:12.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 -- 172.21.15.130:0/667966998 shutdown_connections 2023-09-13T06:05:12.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.441+0000 7faf15340640 1 -- 172.21.15.130:0/667966998 wait complete. 2023-09-13T06:05:12.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:05:12.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea958f640 1 Processor -- start 2023-09-13T06:05:12.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea958f640 1 -- start start 2023-09-13T06:05:12.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea958f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ea415ae10 0x7f0ea40d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea958f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0ea40d2b00 0x7f0ea41612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea958f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0ea41617e0 0x7f0ea40709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea958f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea415dd40 con 0x7f0ea41617e0 2023-09-13T06:05:12.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea958f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea415e020 con 0x7f0ea40d2b00 2023-09-13T06:05:12.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea958f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea415e300 con 0x7f0ea415ae10 2023-09-13T06:05:12.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea37fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0ea41617e0 0x7f0ea40709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea37fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0ea41617e0 0x7f0ea40709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59638/0 (socket says 172.21.15.130:59638) 2023-09-13T06:05:12.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea37fe640 1 -- 172.21.15.130:0/214213304 learned_addr learned my addr 172.21.15.130:0/214213304 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:12.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea2ffd640 1 --2- 172.21.15.130:0/214213304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ea415ae10 0x7f0ea40d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0e9a7fc640 1 --2- 172.21.15.130:0/214213304 >> v2:172.21.15.164:3300/0 conn(0x7f0ea40d2b00 0x7f0ea41612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea37fe640 1 -- 172.21.15.130:0/214213304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ea415ae10 msgr2=0x7f0ea40d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:12.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea37fe640 1 --2- 172.21.15.130:0/214213304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ea415ae10 0x7f0ea40d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea37fe640 1 -- 172.21.15.130:0/214213304 >> v2:172.21.15.164:3300/0 conn(0x7f0ea40d2b00 msgr2=0x7f0ea41612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:12.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea37fe640 1 --2- 172.21.15.130:0/214213304 >> v2:172.21.15.164:3300/0 conn(0x7f0ea40d2b00 0x7f0ea41612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.605+0000 7f0ea37fe640 1 -- 172.21.15.130:0/214213304 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea415e5e0 con 0x7f0ea41617e0 2023-09-13T06:05:12.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea37fe640 1 --2- 172.21.15.130:0/214213304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea41617e0 0x7f0ea40709c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40d4370 tx=0x7f0e9c01c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc8d3563634d748 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:12.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea27fc640 1 -- 172.21.15.130:0/214213304 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c0ab600 con 0x7f0ea41617e0 2023-09-13T06:05:12.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea27fc640 1 -- 172.21.15.130:0/214213304 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c0a7050 con 0x7f0ea41617e0 2023-09-13T06:05:12.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea27fc640 1 -- 172.21.15.130:0/214213304 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c0ab980 con 0x7f0ea41617e0 2023-09-13T06:05:12.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea958f640 1 -- 172.21.15.130:0/214213304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea41617e0 msgr2=0x7f0ea40709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea958f640 1 --2- 172.21.15.130:0/214213304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea41617e0 0x7f0ea40709c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40d4370 tx=0x7f0e9c01c120 comp rx=0 tx=0).stop 2023-09-13T06:05:12.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea958f640 1 -- 172.21.15.130:0/214213304 shutdown_connections 2023-09-13T06:05:12.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea958f640 1 --2- 172.21.15.130:0/214213304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea41617e0 0x7f0ea40709c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea958f640 1 --2- 172.21.15.130:0/214213304 >> v2:172.21.15.164:3300/0 conn(0x7f0ea40d2b00 0x7f0ea41612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea958f640 1 --2- 172.21.15.130:0/214213304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ea415ae10 0x7f0ea40d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea958f640 1 -- 172.21.15.130:0/214213304 >> 172.21.15.130:0/214213304 conn(0x7f0ea4065990 msgr2=0x7f0ea4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:12.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea958f640 1 -- 172.21.15.130:0/214213304 shutdown_connections 2023-09-13T06:05:12.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.609+0000 7f0ea958f640 1 -- 172.21.15.130:0/214213304 wait complete. 2023-09-13T06:05:12.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea958f640 1 Processor -- start 2023-09-13T06:05:12.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea958f640 1 -- start start 2023-09-13T06:05:12.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea958f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ea40d2b00 0x7f0ea40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea958f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ea415ae10 0x7f0ea41529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea958f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea41617e0 0x7f0ea415fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea958f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea4159800 con 0x7f0ea41617e0 2023-09-13T06:05:12.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea958f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea4158bf0 con 0x7f0ea40d2b00 2023-09-13T06:05:12.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea958f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea4158ed0 con 0x7f0ea415ae10 2023-09-13T06:05:12.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea41617e0 0x7f0ea415fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea41617e0 0x7f0ea415fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59650/0 (socket says 172.21.15.130:59650) 2023-09-13T06:05:12.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea37fe640 1 -- 172.21.15.130:0/3556761090 learned_addr learned my addr 172.21.15.130:0/3556761090 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:12.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea2ffd640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ea40d2b00 0x7f0ea40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0e9a7fc640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ea415ae10 0x7f0ea41529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea37fe640 1 -- 172.21.15.130:0/3556761090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ea415ae10 msgr2=0x7f0ea41529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea37fe640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ea415ae10 0x7f0ea41529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea37fe640 1 -- 172.21.15.130:0/3556761090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ea40d2b00 msgr2=0x7f0ea40d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea37fe640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ea40d2b00 0x7f0ea40d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea37fe640 1 -- 172.21.15.130:0/3556761090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c0094d0 con 0x7f0ea41617e0 2023-09-13T06:05:12.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0e9a7fc640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ea415ae10 0x7f0ea41529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:12.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea37fe640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea41617e0 0x7f0ea415fb70 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0ae040 tx=0x7f0e9c018ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:12.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0e9bfff640 1 -- 172.21.15.130:0/3556761090 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c0abe30 con 0x7f0ea41617e0 2023-09-13T06:05:12.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0e9bfff640 1 -- 172.21.15.130:0/3556761090 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c0b4440 con 0x7f0ea41617e0 2023-09-13T06:05:12.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0e9bfff640 1 -- 172.21.15.130:0/3556761090 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c0b47b0 con 0x7f0ea41617e0 2023-09-13T06:05:12.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea958f640 1 -- 172.21.15.130:0/3556761090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea4161df0 con 0x7f0ea41617e0 2023-09-13T06:05:12.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea958f640 1 -- 172.21.15.130:0/3556761090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea4159490 con 0x7f0ea41617e0 2023-09-13T06:05:12.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.613+0000 7f0ea958f640 1 -- 172.21.15.130:0/3556761090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea41599b0 con 0x7f0ea41617e0 2023-09-13T06:05:12.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.617+0000 7f0e9bfff640 1 -- 172.21.15.130:0/3556761090 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0e9c0b2070 con 0x7f0ea41617e0 2023-09-13T06:05:12.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.617+0000 7f0e9bfff640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e84065b50 0x7f0e84068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.617+0000 7f0e9bfff640 1 -- 172.21.15.130:0/3556761090 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e9c11d130 con 0x7f0ea41617e0 2023-09-13T06:05:12.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.617+0000 7f0e9bfff640 1 -- 172.21.15.130:0/3556761090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f0e8406d680 con 0x7f0ea41617e0 2023-09-13T06:05:12.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.617+0000 7f0ea2ffd640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e84065b50 0x7f0e84068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.617+0000 7f0ea2ffd640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e84065b50 0x7f0e84068010 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009b60 tx=0x7f0e94009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:12.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.621+0000 7f0e9bfff640 1 -- 172.21.15.130:0/3556761090 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0e9c0b0070 con 0x7f0ea41617e0 2023-09-13T06:05:12.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.769+0000 7f0ea958f640 1 -- 172.21.15.130:0/3556761090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ea40618a0 con 0x7f0ea41617e0 2023-09-13T06:05:12.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.769+0000 7f0e9bfff640 1 -- 172.21.15.130:0/3556761090 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ea41599b0 con 0x7f0ea41617e0 2023-09-13T06:05:12.771 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:05:12.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.769+0000 7f0ea958f640 1 -- 172.21.15.130:0/3556761090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e84065b50 msgr2=0x7f0e84068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.769+0000 7f0ea958f640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e84065b50 0x7f0e84068010 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009b60 tx=0x7f0e94009190 comp rx=0 tx=0).stop 2023-09-13T06:05:12.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.769+0000 7f0ea958f640 1 -- 172.21.15.130:0/3556761090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea41617e0 msgr2=0x7f0ea415fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.769+0000 7f0ea958f640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea41617e0 0x7f0ea415fb70 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0ae040 tx=0x7f0e9c018ec0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.773+0000 7f0ea958f640 1 -- 172.21.15.130:0/3556761090 shutdown_connections 2023-09-13T06:05:12.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.773+0000 7f0ea958f640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e84065b50 0x7f0e84068010 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.773+0000 7f0ea958f640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea41617e0 0x7f0ea415fb70 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.773+0000 7f0ea958f640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ea415ae10 0x7f0ea41529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.773+0000 7f0ea958f640 1 --2- 172.21.15.130:0/3556761090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ea40d2b00 0x7f0ea40d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.773+0000 7f0ea958f640 1 -- 172.21.15.130:0/3556761090 >> 172.21.15.130:0/3556761090 conn(0x7f0ea4065990 msgr2=0x7f0ea40b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:12.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.773+0000 7f0ea958f640 1 -- 172.21.15.130:0/3556761090 shutdown_connections 2023-09-13T06:05:12.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.773+0000 7f0ea958f640 1 -- 172.21.15.130:0/3556761090 wait complete. 2023-09-13T06:05:12.793 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:05:12.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.929+0000 7f1f4a49e640 1 Processor -- start 2023-09-13T06:05:12.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.929+0000 7f1f4a49e640 1 -- start start 2023-09-13T06:05:12.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.933+0000 7f1f4a49e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1f440b1b70 0x7f1f440ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.933+0000 7f1f4a49e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f440b2150 con 0x7f1f440b2e90 2023-09-13T06:05:12.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.933+0000 7f1f4a49e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f440cdd90 con 0x7f1f44144d70 2023-09-13T06:05:12.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.933+0000 7f1f4a49e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f440b2430 con 0x7f1f440b1b70 2023-09-13T06:05:12.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.933+0000 7f1f437fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1f440b2e90 0x7f1f440b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50738/0 (socket says 172.21.15.130:50738) 2023-09-13T06:05:12.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.933+0000 7f1f437fe640 1 -- 172.21.15.130:0/1968204929 learned_addr learned my addr 172.21.15.130:0/1968204929 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:12.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.933+0000 7f1f48a3b640 1 --2- 172.21.15.130:0/1968204929 >> v2:172.21.15.130:3300/0 conn(0x7f1f440b1b70 0x7f1f440ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.933+0000 7f1f48a3b640 1 -- 172.21.15.130:0/1968204929 >> v1:172.21.15.164:6789/0 conn(0x7f1f44144d70 legacy=0x7f1f440b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.933+0000 7f1f48a3b640 1 -- 172.21.15.130:0/1968204929 >> v1:172.21.15.130:6789/0 conn(0x7f1f440b2e90 legacy=0x7f1f440b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.933+0000 7f1f48a3b640 1 -- 172.21.15.130:0/1968204929 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f440ce070 con 0x7f1f440b1b70 2023-09-13T06:05:12.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.933+0000 7f1f42ffd640 1 -- 172.21.15.130:0/1968204929 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012277686 0 0) 0x7f1f440b2150 con 0x7f1f440b2e90 2023-09-13T06:05:12.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f48a3b640 1 --2- 172.21.15.130:0/1968204929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b1b70 0x7f1f440ce870 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009d90 tx=0x7f1f3c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1907b0352b64ab4b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:12.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f42ffd640 1 -- 172.21.15.130:0/1968204929 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0a5810 con 0x7f1f440b1b70 2023-09-13T06:05:12.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f42ffd640 1 -- 172.21.15.130:0/1968204929 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c0a5970 con 0x7f1f440b1b70 2023-09-13T06:05:12.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f42ffd640 1 -- 172.21.15.130:0/1968204929 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0a5d00 con 0x7f1f440b1b70 2023-09-13T06:05:12.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f4a49e640 1 -- 172.21.15.130:0/1968204929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b1b70 msgr2=0x7f1f440ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f4a49e640 1 --2- 172.21.15.130:0/1968204929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b1b70 0x7f1f440ce870 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009d90 tx=0x7f1f3c01c950 comp rx=0 tx=0).stop 2023-09-13T06:05:12.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f4a49e640 1 -- 172.21.15.130:0/1968204929 shutdown_connections 2023-09-13T06:05:12.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f4a49e640 1 --2- 172.21.15.130:0/1968204929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b1b70 0x7f1f440ce870 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f4a49e640 1 -- 172.21.15.130:0/1968204929 >> 172.21.15.130:0/1968204929 conn(0x7f1f44065990 msgr2=0x7f1f44065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:12.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f4a49e640 1 -- 172.21.15.130:0/1968204929 shutdown_connections 2023-09-13T06:05:12.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f4a49e640 1 -- 172.21.15.130:0/1968204929 wait complete. 2023-09-13T06:05:12.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f4a49e640 1 Processor -- start 2023-09-13T06:05:12.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.937+0000 7f1f4a49e640 1 -- start start 2023-09-13T06:05:12.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f4a49e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b1b70 0x7f1f44140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f4a49e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f440b2e90 0x7f1f440adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f4a49e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f44144d70 0x7f1f440ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f4a49e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441597e0 con 0x7f1f440b1b70 2023-09-13T06:05:12.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f4a49e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f44159ac0 con 0x7f1f440b2e90 2023-09-13T06:05:12.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f4a49e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f44159da0 con 0x7f1f44144d70 2023-09-13T06:05:12.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f43fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b1b70 0x7f1f44140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f43fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b1b70 0x7f1f44140bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59662/0 (socket says 172.21.15.130:59662) 2023-09-13T06:05:12.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f43fff640 1 -- 172.21.15.130:0/2697414560 learned_addr learned my addr 172.21.15.130:0/2697414560 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:12.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f437fe640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f440b2e90 0x7f1f440adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f43fff640 1 -- 172.21.15.130:0/2697414560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f44144d70 msgr2=0x7f1f440ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f43fff640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f44144d70 0x7f1f440ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f43fff640 1 -- 172.21.15.130:0/2697414560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f440b2e90 msgr2=0x7f1f440adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:12.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f43fff640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f440b2e90 0x7f1f440adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:12.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f43fff640 1 -- 172.21.15.130:0/2697414560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c009a70 con 0x7f1f440b1b70 2023-09-13T06:05:12.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f437fe640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f440b2e90 0x7f1f440adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:12.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f43fff640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b1b70 0x7f1f44140bb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400c3c0 tx=0x7f1f3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:12.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f40ff9640 1 -- 172.21.15.130:0/2697414560 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340052d0 con 0x7f1f440b1b70 2023-09-13T06:05:12.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f40ff9640 1 -- 172.21.15.130:0/2697414560 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f34005430 con 0x7f1f440b1b70 2023-09-13T06:05:12.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f40ff9640 1 -- 172.21.15.130:0/2697414560 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34003840 con 0x7f1f440b1b70 2023-09-13T06:05:12.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f4a49e640 1 -- 172.21.15.130:0/2697414560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4415a080 con 0x7f1f440b1b70 2023-09-13T06:05:12.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f4a49e640 1 -- 172.21.15.130:0/2697414560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f44141400 con 0x7f1f440b1b70 2023-09-13T06:05:12.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f4a49e640 1 -- 172.21.15.130:0/2697414560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4415a2c0 con 0x7f1f440b1b70 2023-09-13T06:05:12.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.941+0000 7f1f40ff9640 1 -- 172.21.15.130:0/2697414560 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1f340039a0 con 0x7f1f440b1b70 2023-09-13T06:05:12.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.945+0000 7f1f40ff9640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f30065b20 0x7f1f30067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:12.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.945+0000 7f1f40ff9640 1 -- 172.21.15.130:0/2697414560 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f34082830 con 0x7f1f440b1b70 2023-09-13T06:05:12.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.945+0000 7f1f437fe640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f30065b20 0x7f1f30067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:12.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.945+0000 7f1f40ff9640 1 -- 172.21.15.130:0/2697414560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f1f3006d650 con 0x7f1f440b1b70 2023-09-13T06:05:12.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.945+0000 7f1f437fe640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f30065b20 0x7f1f30067fe0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f4406be60 tx=0x7f1f38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:12.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:12.949+0000 7f1f40ff9640 1 -- 172.21.15.130:0/2697414560 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1f34017060 con 0x7f1f440b1b70 2023-09-13T06:05:13.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.093+0000 7f1f4a49e640 1 -- 172.21.15.130:0/2697414560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f44159920 con 0x7f1f440b1b70 2023-09-13T06:05:13.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.093+0000 7f1f40ff9640 1 -- 172.21.15.130:0/2697414560 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f44159920 con 0x7f1f440b1b70 2023-09-13T06:05:13.097 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:05:13.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 -- 172.21.15.130:0/2697414560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f30065b20 msgr2=0x7f1f30067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f30065b20 0x7f1f30067fe0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f4406be60 tx=0x7f1f38009040 comp rx=0 tx=0).stop 2023-09-13T06:05:13.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 -- 172.21.15.130:0/2697414560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b1b70 msgr2=0x7f1f44140bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b1b70 0x7f1f44140bb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400c3c0 tx=0x7f1f3400c880 comp rx=0 tx=0).stop 2023-09-13T06:05:13.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 -- 172.21.15.130:0/2697414560 shutdown_connections 2023-09-13T06:05:13.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f30065b20 0x7f1f30067fe0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f440b2e90 0x7f1f440adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f44144d70 0x7f1f440ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 --2- 172.21.15.130:0/2697414560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b1b70 0x7f1f44140bb0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 -- 172.21.15.130:0/2697414560 >> 172.21.15.130:0/2697414560 conn(0x7f1f44065990 msgr2=0x7f1f44143f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:13.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 -- 172.21.15.130:0/2697414560 shutdown_connections 2023-09-13T06:05:13.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.097+0000 7f1f4a49e640 1 -- 172.21.15.130:0/2697414560 wait complete. 2023-09-13T06:05:13.118 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:05:13.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.253+0000 7ff531e6d640 1 Processor -- start 2023-09-13T06:05:13.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.257+0000 7ff531e6d640 1 -- start start 2023-09-13T06:05:13.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.257+0000 7ff531e6d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff52c0d1750 0x7ff52c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.257+0000 7ff531e6d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c0b63c0 con 0x7ff52c146f30 2023-09-13T06:05:13.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.257+0000 7ff531e6d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c0d0c20 con 0x7ff52c0d1090 2023-09-13T06:05:13.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.257+0000 7ff531e6d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c15dea0 con 0x7ff52c0d1750 2023-09-13T06:05:13.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.257+0000 7ff52bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff52c146f30 0x7ff52c0b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50740/0 (socket says 172.21.15.130:50740) 2023-09-13T06:05:13.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.257+0000 7ff52bfff640 1 -- 172.21.15.130:0/3245396609 learned_addr learned my addr 172.21.15.130:0/3245396609 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:13.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.257+0000 7ff52b7fe640 1 --2- 172.21.15.130:0/3245396609 >> v2:172.21.15.130:3300/0 conn(0x7ff52c0d1750 0x7ff52c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.257+0000 7ff52b7fe640 1 -- 172.21.15.130:0/3245396609 >> v1:172.21.15.164:6789/0 conn(0x7ff52c0d1090 legacy=0x7ff52c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:13.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.257+0000 7ff52b7fe640 1 -- 172.21.15.130:0/3245396609 >> v1:172.21.15.130:6789/0 conn(0x7ff52c146f30 legacy=0x7ff52c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.257+0000 7ff52b7fe640 1 -- 172.21.15.130:0/3245396609 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c0b6610 con 0x7ff52c0d1750 2023-09-13T06:05:13.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff52b7fe640 1 --2- 172.21.15.130:0/3245396609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c0d1750 0x7ff52c15d960 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0097c0 tx=0x7ff51c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9816a5558d64f48 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:13.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff52a7fc640 1 -- 172.21.15.130:0/3245396609 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0ad680 con 0x7ff52c0d1750 2023-09-13T06:05:13.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff52a7fc640 1 -- 172.21.15.130:0/3245396609 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c0ad7e0 con 0x7ff52c0d1750 2023-09-13T06:05:13.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff52a7fc640 1 -- 172.21.15.130:0/3245396609 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0adb70 con 0x7ff52c0d1750 2023-09-13T06:05:13.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff531e6d640 1 -- 172.21.15.130:0/3245396609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c0d1750 msgr2=0x7ff52c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff531e6d640 1 --2- 172.21.15.130:0/3245396609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c0d1750 0x7ff52c15d960 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0097c0 tx=0x7ff51c01c380 comp rx=0 tx=0).stop 2023-09-13T06:05:13.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff531e6d640 1 -- 172.21.15.130:0/3245396609 shutdown_connections 2023-09-13T06:05:13.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff531e6d640 1 --2- 172.21.15.130:0/3245396609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c0d1750 0x7ff52c15d960 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff531e6d640 1 -- 172.21.15.130:0/3245396609 >> 172.21.15.130:0/3245396609 conn(0x7ff52c06f170 msgr2=0x7ff52c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:13.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff531e6d640 1 -- 172.21.15.130:0/3245396609 shutdown_connections 2023-09-13T06:05:13.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff531e6d640 1 -- 172.21.15.130:0/3245396609 wait complete. 2023-09-13T06:05:13.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.261+0000 7ff531e6d640 1 Processor -- start 2023-09-13T06:05:13.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff531e6d640 1 -- start start 2023-09-13T06:05:13.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff531e6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c0d1090 0x7ff52c1440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff531e6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff52c0d1750 0x7ff52c15b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff531e6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff52c146f30 0x7ff52c15bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff531e6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c15d090 con 0x7ff52c0d1090 2023-09-13T06:05:13.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff531e6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c143960 con 0x7ff52c146f30 2023-09-13T06:05:13.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff531e6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c15d4b0 con 0x7ff52c0d1750 2023-09-13T06:05:13.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff52b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c0d1090 0x7ff52c1440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff52b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c0d1090 0x7ff52c1440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59692/0 (socket says 172.21.15.130:59692) 2023-09-13T06:05:13.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff52b7fe640 1 -- 172.21.15.130:0/623940807 learned_addr learned my addr 172.21.15.130:0/623940807 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:13.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff52b7fe640 1 -- 172.21.15.130:0/623940807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff52c0d1750 msgr2=0x7ff52c15b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff52b7fe640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff52c0d1750 0x7ff52c15b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff52b7fe640 1 -- 172.21.15.130:0/623940807 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff52c146f30 msgr2=0x7ff52c15bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff52b7fe640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff52c146f30 0x7ff52c15bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff52b7fe640 1 -- 172.21.15.130:0/623940807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c009420 con 0x7ff52c0d1090 2023-09-13T06:05:13.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff52b7fe640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c0d1090 0x7ff52c1440d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff51c018f90 tx=0x7ff51c01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:13.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff513fff640 1 -- 172.21.15.130:0/623940807 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0ade60 con 0x7ff52c0d1090 2023-09-13T06:05:13.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff513fff640 1 -- 172.21.15.130:0/623940807 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c0b8420 con 0x7ff52c0d1090 2023-09-13T06:05:13.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff531e6d640 1 -- 172.21.15.130:0/623940807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52c15c410 con 0x7ff52c0d1090 2023-09-13T06:05:13.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff513fff640 1 -- 172.21.15.130:0/623940807 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0b87d0 con 0x7ff52c0d1090 2023-09-13T06:05:13.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff531e6d640 1 -- 172.21.15.130:0/623940807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52c15c9d0 con 0x7ff52c0d1090 2023-09-13T06:05:13.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff531e6d640 1 -- 172.21.15.130:0/623940807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52c15d1d0 con 0x7ff52c0d1090 2023-09-13T06:05:13.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.265+0000 7ff513fff640 1 -- 172.21.15.130:0/623940807 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff51c0b4040 con 0x7ff52c0d1090 2023-09-13T06:05:13.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.269+0000 7ff513fff640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff518065b20 0x7ff518067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.269+0000 7ff513fff640 1 -- 172.21.15.130:0/623940807 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff51c11d960 con 0x7ff52c0d1090 2023-09-13T06:05:13.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.269+0000 7ff52affd640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff518065b20 0x7ff518067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.269+0000 7ff513fff640 1 -- 172.21.15.130:0/623940807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7ff51806d650 con 0x7ff52c0d1090 2023-09-13T06:05:13.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.269+0000 7ff52affd640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff518065b20 0x7ff518067fe0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff52c169220 tx=0x7ff5200079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:13.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.273+0000 7ff513fff640 1 -- 172.21.15.130:0/623940807 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff52c15d1d0 con 0x7ff52c0d1090 2023-09-13T06:05:13.367 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:05:13.365+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-09-13T06:05:13.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.373+0000 7ff513fff640 1 -- 172.21.15.130:0/623940807 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(71..71 src has 1..71) v4 ==== 304+0+0 (secure 0 0 0) 0x7ff51c0ef820 con 0x7ff52c0d1090 2023-09-13T06:05:13.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.373+0000 7ff513fff640 1 -- 172.21.15.130:0/623940807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7ff51806de90 con 0x7ff52c0d1090 2023-09-13T06:05:13.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.457+0000 7ff531e6d640 1 -- 172.21.15.130:0/623940807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff52c15d1d0 con 0x7ff52c0d1090 2023-09-13T06:05:13.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.457+0000 7ff513fff640 1 -- 172.21.15.130:0/623940807 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4922 (secure 0 0 0) 0x7ff52c15d1d0 con 0x7ff52c0d1090 2023-09-13T06:05:13.460 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:13.461 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1338889971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1338889971},{"type":"v1","addr":"172.21.15.164:6835","nonce":1338889971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1298091712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1298091712},{"type":"v1","addr":"172.21.15.130:6835","nonce":1298091712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/798128577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":798128577},{"type":"v1","addr":"172.21.15.130:6837","nonce":798128577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:03:54.710730+0000","modified":"2023-09-13T06:03:57.752848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6087":{"gid":6087,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2038440053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2038440053},{"type":"v1","addr":"172.21.15.164:6833","nonce":2038440053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-09-13T06:05:13.461 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 34 2023-09-13T06:05:13.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 -- 172.21.15.130:0/623940807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff518065b20 msgr2=0x7ff518067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff518065b20 0x7ff518067fe0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff52c169220 tx=0x7ff5200079c0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 -- 172.21.15.130:0/623940807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c0d1090 msgr2=0x7ff52c1440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c0d1090 0x7ff52c1440d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff51c018f90 tx=0x7ff51c01abc0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 -- 172.21.15.130:0/623940807 shutdown_connections 2023-09-13T06:05:13.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff518065b20 0x7ff518067fe0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff52c146f30 0x7ff52c15bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff52c0d1750 0x7ff52c15b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 --2- 172.21.15.130:0/623940807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c0d1090 0x7ff52c1440d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 -- 172.21.15.130:0/623940807 >> 172.21.15.130:0/623940807 conn(0x7ff52c06f170 msgr2=0x7ff52c0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:13.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 -- 172.21.15.130:0/623940807 shutdown_connections 2023-09-13T06:05:13.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.461+0000 7ff531e6d640 1 -- 172.21.15.130:0/623940807 wait complete. 2023-09-13T06:05:13.481 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:13.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.617+0000 7fa77f2d8640 1 Processor -- start 2023-09-13T06:05:13.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77f2d8640 1 -- start start 2023-09-13T06:05:13.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77f2d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa7780d1750 0x7fa77815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77f2d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa7780d1090 0x7fa778146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77f2d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7780d1b30 0x7fa778146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77f2d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77815dea0 con 0x7fa7780d1750 2023-09-13T06:05:13.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77f2d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7780b63c0 con 0x7fa7780d1090 2023-09-13T06:05:13.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77f2d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780d0c20 con 0x7fa7780d1b30 2023-09-13T06:05:13.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77d074640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa7780d1750 0x7fa77815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77d074640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa7780d1750 0x7fa77815d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59698/0 (socket says 172.21.15.130:59698) 2023-09-13T06:05:13.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77d074640 1 -- 172.21.15.130:0/722223206 learned_addr learned my addr 172.21.15.130:0/722223206 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:13.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77c873640 1 --2- 172.21.15.130:0/722223206 >> v2:172.21.15.164:3300/0 conn(0x7fa7780d1090 0x7fa778146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77d875640 1 --2- 172.21.15.130:0/722223206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7780d1b30 0x7fa778146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77d074640 1 -- 172.21.15.130:0/722223206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7780d1b30 msgr2=0x7fa778146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:13.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77d074640 1 --2- 172.21.15.130:0/722223206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7780d1b30 0x7fa778146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77d074640 1 -- 172.21.15.130:0/722223206 >> v2:172.21.15.164:3300/0 conn(0x7fa7780d1090 msgr2=0x7fa778146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:13.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77d074640 1 --2- 172.21.15.130:0/722223206 >> v2:172.21.15.164:3300/0 conn(0x7fa7780d1090 0x7fa778146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.621+0000 7fa77d074640 1 -- 172.21.15.130:0/722223206 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780b6610 con 0x7fa7780d1750 2023-09-13T06:05:13.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77d074640 1 --2- 172.21.15.130:0/722223206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7780d1750 0x7fa77815d960 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa7780c8360 tx=0x7fa77401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d682078e8b778736 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:13.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa76ffff640 1 -- 172.21.15.130:0/722223206 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740aa5f0 con 0x7fa7780d1750 2023-09-13T06:05:13.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa76ffff640 1 -- 172.21.15.130:0/722223206 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7740aa750 con 0x7fa7780d1750 2023-09-13T06:05:13.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa76ffff640 1 -- 172.21.15.130:0/722223206 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740aaae0 con 0x7fa7780d1750 2023-09-13T06:05:13.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77f2d8640 1 -- 172.21.15.130:0/722223206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7780d1750 msgr2=0x7fa77815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77f2d8640 1 --2- 172.21.15.130:0/722223206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7780d1750 0x7fa77815d960 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa7780c8360 tx=0x7fa77401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77f2d8640 1 -- 172.21.15.130:0/722223206 shutdown_connections 2023-09-13T06:05:13.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77f2d8640 1 --2- 172.21.15.130:0/722223206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7780d1b30 0x7fa778146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77f2d8640 1 --2- 172.21.15.130:0/722223206 >> v2:172.21.15.164:3300/0 conn(0x7fa7780d1090 0x7fa778146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77f2d8640 1 --2- 172.21.15.130:0/722223206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7780d1750 0x7fa77815d960 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77f2d8640 1 -- 172.21.15.130:0/722223206 >> 172.21.15.130:0/722223206 conn(0x7fa77806f170 msgr2=0x7fa77806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:13.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77f2d8640 1 -- 172.21.15.130:0/722223206 shutdown_connections 2023-09-13T06:05:13.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77f2d8640 1 -- 172.21.15.130:0/722223206 wait complete. 2023-09-13T06:05:13.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77f2d8640 1 Processor -- start 2023-09-13T06:05:13.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.625+0000 7fa77f2d8640 1 -- start start 2023-09-13T06:05:13.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77f2d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7780d1090 0x7fa7781661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77f2d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7780d1750 0x7fa77815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77f2d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7780d1b30 0x7fa7781465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77f2d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa778167530 con 0x7fa7780d1090 2023-09-13T06:05:13.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77f2d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa778167d00 con 0x7fa7780d1750 2023-09-13T06:05:13.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77f2d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7781668b0 con 0x7fa7780d1b30 2023-09-13T06:05:13.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77d074640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7780d1090 0x7fa7781661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77d074640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7780d1090 0x7fa7781661b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59700/0 (socket says 172.21.15.130:59700) 2023-09-13T06:05:13.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77d074640 1 -- 172.21.15.130:0/2146504157 learned_addr learned my addr 172.21.15.130:0/2146504157 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:13.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77c873640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7780d1750 0x7fa77815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77d875640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7780d1b30 0x7fa7781465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77d074640 1 -- 172.21.15.130:0/2146504157 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7780d1b30 msgr2=0x7fa7781465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77d074640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7780d1b30 0x7fa7781465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77d074640 1 -- 172.21.15.130:0/2146504157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7780d1750 msgr2=0x7fa77815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77d074640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7780d1750 0x7fa77815cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77d074640 1 -- 172.21.15.130:0/2146504157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7740094d0 con 0x7fa7780d1090 2023-09-13T06:05:13.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77d875640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7780d1b30 0x7fa7781465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:13.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77d074640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7780d1090 0x7fa7781661b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa7740ac040 tx=0x7fa77401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:13.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa76dffb640 1 -- 172.21.15.130:0/2146504157 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740aa5f0 con 0x7fa7780d1090 2023-09-13T06:05:13.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa76dffb640 1 -- 172.21.15.130:0/2146504157 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7740b3800 con 0x7fa7780d1090 2023-09-13T06:05:13.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa76dffb640 1 -- 172.21.15.130:0/2146504157 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740b3bb0 con 0x7fa7780d1090 2023-09-13T06:05:13.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77f2d8640 1 -- 172.21.15.130:0/2146504157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa778166b90 con 0x7fa7780d1090 2023-09-13T06:05:13.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77f2d8640 1 -- 172.21.15.130:0/2146504157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa778167150 con 0x7fa7780d1090 2023-09-13T06:05:13.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.629+0000 7fa77f2d8640 1 -- 172.21.15.130:0/2146504157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7780618a0 con 0x7fa7780d1090 2023-09-13T06:05:13.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.633+0000 7fa76dffb640 1 -- 172.21.15.130:0/2146504157 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa7740b3d10 con 0x7fa7780d1090 2023-09-13T06:05:13.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.633+0000 7fa76dffb640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa75c065b50 0x7fa75c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.633+0000 7fa76dffb640 1 -- 172.21.15.130:0/2146504157 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7740a7070 con 0x7fa7780d1090 2023-09-13T06:05:13.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.633+0000 7fa76dffb640 1 -- 172.21.15.130:0/2146504157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7fa75c06d680 con 0x7fa7780d1090 2023-09-13T06:05:13.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.633+0000 7fa77c873640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa75c065b50 0x7fa75c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.633+0000 7fa77c873640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa75c065b50 0x7fa75c068010 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa77813ea80 tx=0x7fa768008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:13.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.637+0000 7fa76dffb640 1 -- 172.21.15.130:0/2146504157 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa7740c3060 con 0x7fa7780d1090 2023-09-13T06:05:13.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.793+0000 7fa77f2d8640 1 -- 172.21.15.130:0/2146504157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7780b86c0 con 0x7fa7780d1090 2023-09-13T06:05:13.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.793+0000 7fa76dffb640 1 -- 172.21.15.130:0/2146504157 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16630 (secure 0 0 0) 0x7fa7740eb380 con 0x7fa7780d1090 2023-09-13T06:05:13.797 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:13.797 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":71,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:05:13.369338+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:03:52.722728+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-09-13T06:03:53.712581+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:13.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 -- 172.21.15.130:0/2146504157 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa75c065b50 msgr2=0x7fa75c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa75c065b50 0x7fa75c068010 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa77813ea80 tx=0x7fa768008040 comp rx=0 tx=0).stop 2023-09-13T06:05:13.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 -- 172.21.15.130:0/2146504157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7780d1090 msgr2=0x7fa7781661b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7780d1090 0x7fa7781661b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa7740ac040 tx=0x7fa77401ad10 comp rx=0 tx=0).stop 2023-09-13T06:05:13.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 -- 172.21.15.130:0/2146504157 shutdown_connections 2023-09-13T06:05:13.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa75c065b50 0x7fa75c068010 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7780d1750 0x7fa77815cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7780d1b30 0x7fa7781465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 --2- 172.21.15.130:0/2146504157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7780d1090 0x7fa7781661b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 -- 172.21.15.130:0/2146504157 >> 172.21.15.130:0/2146504157 conn(0x7fa77806f170 msgr2=0x7fa77815f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:13.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 -- 172.21.15.130:0/2146504157 shutdown_connections 2023-09-13T06:05:13.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.797+0000 7fa77f2d8640 1 -- 172.21.15.130:0/2146504157 wait complete. 2023-09-13T06:05:13.819 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:05:13.819 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:05:13.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.953+0000 7f0fb4648640 1 Processor -- start 2023-09-13T06:05:13.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb4648640 1 -- start start 2023-09-13T06:05:13.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb4648640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0fac0d1750 0x7f0fac15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb4648640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0fac0d1090 0x7f0fac146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb4648640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac0b63c0 con 0x7f0fac0d1b30 2023-09-13T06:05:13.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb4648640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac15dea0 con 0x7f0fac0d1750 2023-09-13T06:05:13.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb4648640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac0d0c20 con 0x7f0fac0d1090 2023-09-13T06:05:13.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb2be5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0fac0d1b30 0x7f0fac0b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50750/0 (socket says 172.21.15.130:50750) 2023-09-13T06:05:13.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb2be5640 1 -- 172.21.15.130:0/2617524623 learned_addr learned my addr 172.21.15.130:0/2617524623 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:13.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb23e4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0fac0d1750 0x7f0fac15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb1be3640 1 --2- 172.21.15.130:0/2617524623 >> v2:172.21.15.164:3300/0 conn(0x7f0fac0d1090 0x7f0fac146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb13e2640 1 -- 172.21.15.130:0/2617524623 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538386695 0 0) 0x7f0fac0b63c0 con 0x7f0fac0d1b30 2023-09-13T06:05:13.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb13e2640 1 -- 172.21.15.130:0/2617524623 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f98003530 con 0x7f0fac0d1b30 2023-09-13T06:05:13.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb23e4640 1 -- 172.21.15.130:0/2617524623 >> v2:172.21.15.164:3300/0 conn(0x7f0fac0d1090 msgr2=0x7f0fac146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:13.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb23e4640 1 --2- 172.21.15.130:0/2617524623 >> v2:172.21.15.164:3300/0 conn(0x7f0fac0d1090 0x7f0fac146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb23e4640 1 -- 172.21.15.130:0/2617524623 >> v1:172.21.15.130:6789/0 conn(0x7f0fac0d1b30 legacy=0x7f0fac0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb23e4640 1 -- 172.21.15.130:0/2617524623 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0b6610 con 0x7f0fac0d1750 2023-09-13T06:05:13.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.957+0000 7f0fb1be3640 1 --2- 172.21.15.130:0/2617524623 >> v2:172.21.15.164:3300/0 conn(0x7f0fac0d1090 0x7f0fac146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:13.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb23e4640 1 --2- 172.21.15.130:0/2617524623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fac0d1750 0x7f0fac15d960 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0c8360 tx=0x7f0fa801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334ef9223e516367 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:13.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb13e2640 1 -- 172.21.15.130:0/2617524623 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa80a7070 con 0x7f0fac0d1750 2023-09-13T06:05:13.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb13e2640 1 -- 172.21.15.130:0/2617524623 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa80ab430 con 0x7f0fac0d1750 2023-09-13T06:05:13.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb13e2640 1 -- 172.21.15.130:0/2617524623 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa80ab7c0 con 0x7f0fac0d1750 2023-09-13T06:05:13.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb4648640 1 -- 172.21.15.130:0/2617524623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fac0d1750 msgr2=0x7f0fac15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb4648640 1 --2- 172.21.15.130:0/2617524623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fac0d1750 0x7f0fac15d960 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0c8360 tx=0x7f0fa801c430 comp rx=0 tx=0).stop 2023-09-13T06:05:13.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb4648640 1 -- 172.21.15.130:0/2617524623 shutdown_connections 2023-09-13T06:05:13.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb4648640 1 --2- 172.21.15.130:0/2617524623 >> v2:172.21.15.164:3300/0 conn(0x7f0fac0d1090 0x7f0fac146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb4648640 1 --2- 172.21.15.130:0/2617524623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fac0d1750 0x7f0fac15d960 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb4648640 1 -- 172.21.15.130:0/2617524623 >> 172.21.15.130:0/2617524623 conn(0x7f0fac06f170 msgr2=0x7f0fac06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:13.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb4648640 1 -- 172.21.15.130:0/2617524623 shutdown_connections 2023-09-13T06:05:13.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb4648640 1 -- 172.21.15.130:0/2617524623 wait complete. 2023-09-13T06:05:13.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.961+0000 7f0fb4648640 1 Processor -- start 2023-09-13T06:05:13.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb4648640 1 -- start start 2023-09-13T06:05:13.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb4648640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fac0d1090 0x7f0fac139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb4648640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0fac0d1750 0x7f0fac13af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb4648640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fac0d1b30 0x7f0fac0b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb4648640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac13ca10 con 0x7f0fac0d1b30 2023-09-13T06:05:13.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb4648640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac13b860 con 0x7f0fac0d1090 2023-09-13T06:05:13.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb4648640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac13bb40 con 0x7f0fac0d1750 2023-09-13T06:05:13.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb2be5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fac0d1b30 0x7f0fac0b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb2be5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fac0d1b30 0x7f0fac0b7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59718/0 (socket says 172.21.15.130:59718) 2023-09-13T06:05:13.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb2be5640 1 -- 172.21.15.130:0/3444858497 learned_addr learned my addr 172.21.15.130:0/3444858497 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:13.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb23e4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fac0d1090 0x7f0fac139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb1be3640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0fac0d1750 0x7f0fac13af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb2be5640 1 -- 172.21.15.130:0/3444858497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0fac0d1750 msgr2=0x7f0fac13af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb2be5640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0fac0d1750 0x7f0fac13af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb2be5640 1 -- 172.21.15.130:0/3444858497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fac0d1090 msgr2=0x7f0fac139700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:13.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb2be5640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fac0d1090 0x7f0fac139700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:13.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb2be5640 1 -- 172.21.15.130:0/3444858497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa8009420 con 0x7f0fac0d1b30 2023-09-13T06:05:13.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb1be3640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0fac0d1750 0x7f0fac13af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:13.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb2be5640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fac0d1b30 0x7f0fac0b7af0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400cb40 tx=0x7f0fa400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:13.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fa2ffd640 1 -- 172.21.15.130:0/3444858497 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400aca0 con 0x7f0fac0d1b30 2023-09-13T06:05:13.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fa2ffd640 1 -- 172.21.15.130:0/3444858497 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400ae00 con 0x7f0fac0d1b30 2023-09-13T06:05:13.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fa2ffd640 1 -- 172.21.15.130:0/3444858497 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4012620 con 0x7f0fac0d1b30 2023-09-13T06:05:13.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb4648640 1 -- 172.21.15.130:0/3444858497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac13be20 con 0x7f0fac0d1b30 2023-09-13T06:05:13.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb4648640 1 -- 172.21.15.130:0/3444858497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac13b450 con 0x7f0fac0d1b30 2023-09-13T06:05:13.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.965+0000 7f0fb4648640 1 -- 172.21.15.130:0/3444858497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac13cb50 con 0x7f0fac0d1b30 2023-09-13T06:05:13.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.969+0000 7f0fa2ffd640 1 -- 172.21.15.130:0/3444858497 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0fa4007070 con 0x7f0fac0d1b30 2023-09-13T06:05:13.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.969+0000 7f0fa2ffd640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f90065b20 0x7f0f90067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:13.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.969+0000 7f0fa2ffd640 1 -- 172.21.15.130:0/3444858497 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fa40832d0 con 0x7f0fac0d1b30 2023-09-13T06:05:13.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.969+0000 7f0fa2ffd640 1 -- 172.21.15.130:0/3444858497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f0f9006d650 con 0x7f0fac0d1b30 2023-09-13T06:05:13.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.969+0000 7f0fb23e4640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f90065b20 0x7f0f90067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:13.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.969+0000 7f0fb23e4640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f90065b20 0x7f0f90067fe0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80af000 tx=0x7f0fa80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:13.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:13.973+0000 7f0fa2ffd640 1 -- 172.21.15.130:0/3444858497 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0fa4017060 con 0x7f0fac0d1b30 2023-09-13T06:05:14.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.149+0000 7f0fb4648640 1 -- 172.21.15.130:0/3444858497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fac0618a0 con 0x7f0fac0d1b30 2023-09-13T06:05:14.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.149+0000 7f0fa2ffd640 1 -- 172.21.15.130:0/3444858497 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f0fac13cb50 con 0x7f0fac0d1b30 2023-09-13T06:05:14.153 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:14.153 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1338889971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1338889971},{"type":"v1","addr":"172.21.15.164:6835","nonce":1338889971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1298091712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1298091712},{"type":"v1","addr":"172.21.15.130:6835","nonce":1298091712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/798128577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":798128577},{"type":"v1","addr":"172.21.15.130:6837","nonce":798128577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:03:54.710730+0000","modified":"2023-09-13T06:03:57.752848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6087":{"gid":6087,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2038440053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2038440053},{"type":"v1","addr":"172.21.15.164:6833","nonce":2038440053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-09-13T06:05:14.154 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 34 2023-09-13T06:05:14.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 -- 172.21.15.130:0/3444858497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f90065b20 msgr2=0x7f0f90067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f90065b20 0x7f0f90067fe0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80af000 tx=0x7f0fa80a7000 comp rx=0 tx=0).stop 2023-09-13T06:05:14.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 -- 172.21.15.130:0/3444858497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fac0d1b30 msgr2=0x7f0fac0b7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fac0d1b30 0x7f0fac0b7af0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400cb40 tx=0x7f0fa400a060 comp rx=0 tx=0).stop 2023-09-13T06:05:14.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 -- 172.21.15.130:0/3444858497 shutdown_connections 2023-09-13T06:05:14.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f90065b20 0x7f0f90067fe0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fac0d1b30 0x7f0fac0b7af0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0fac0d1750 0x7f0fac13af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 --2- 172.21.15.130:0/3444858497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fac0d1090 0x7f0fac139700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 -- 172.21.15.130:0/3444858497 >> 172.21.15.130:0/3444858497 conn(0x7f0fac06f170 msgr2=0x7f0fac15fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:14.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 -- 172.21.15.130:0/3444858497 shutdown_connections 2023-09-13T06:05:14.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.153+0000 7f0fb4648640 1 -- 172.21.15.130:0/3444858497 wait complete. 2023-09-13T06:05:14.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:05:14.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.309+0000 7f272f234640 1 Processor -- start 2023-09-13T06:05:14.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.309+0000 7f272f234640 1 -- start start 2023-09-13T06:05:14.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f272f234640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2728159f20 0x7f27280ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:14.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f272f234640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f27280cdfc0 0x7f27280b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:14.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f272f234640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280ccfd0 con 0x7f27280b1610 2023-09-13T06:05:14.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f272f234640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27280b00f0 con 0x7f27280cdfc0 2023-09-13T06:05:14.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f272f234640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27280b11d0 con 0x7f2728159f20 2023-09-13T06:05:14.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f2727fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f27280cdfc0 0x7f27280b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:14.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f2727fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f27280cdfc0 0x7f27280b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59730/0 (socket says 172.21.15.130:59730) 2023-09-13T06:05:14.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f2727fff640 1 -- 172.21.15.130:0/2720052379 learned_addr learned my addr 172.21.15.130:0/2720052379 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:14.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f272cfd0640 1 --2- 172.21.15.130:0/2720052379 >> v2:172.21.15.164:3300/0 conn(0x7f2728159f20 0x7f27280ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:14.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f2727fff640 1 -- 172.21.15.130:0/2720052379 >> v2:172.21.15.164:3300/0 conn(0x7f2728159f20 msgr2=0x7f27280ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:14.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f2727fff640 1 --2- 172.21.15.130:0/2720052379 >> v2:172.21.15.164:3300/0 conn(0x7f2728159f20 0x7f27280ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f2727fff640 1 -- 172.21.15.130:0/2720052379 >> v1:172.21.15.164:6789/0 conn(0x7f27280b1610 legacy=0x7f27280ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:14.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.313+0000 7f2727fff640 1 -- 172.21.15.130:0/2720052379 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27280ced90 con 0x7f27280cdfc0 2023-09-13T06:05:14.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f2727fff640 1 --2- 172.21.15.130:0/2720052379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27280cdfc0 0x7f27280b0c90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f27280b2660 tx=0x7f271401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7d5977610461eb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:14.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f27277fe640 1 -- 172.21.15.130:0/2720052379 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27140ab670 con 0x7f27280cdfc0 2023-09-13T06:05:14.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f27277fe640 1 -- 172.21.15.130:0/2720052379 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27140ab7d0 con 0x7f27280cdfc0 2023-09-13T06:05:14.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f27277fe640 1 -- 172.21.15.130:0/2720052379 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27140abb60 con 0x7f27280cdfc0 2023-09-13T06:05:14.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f272f234640 1 -- 172.21.15.130:0/2720052379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27280cdfc0 msgr2=0x7f27280b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f272f234640 1 --2- 172.21.15.130:0/2720052379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27280cdfc0 0x7f27280b0c90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f27280b2660 tx=0x7f271401c470 comp rx=0 tx=0).stop 2023-09-13T06:05:14.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f272f234640 1 -- 172.21.15.130:0/2720052379 shutdown_connections 2023-09-13T06:05:14.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f272f234640 1 --2- 172.21.15.130:0/2720052379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27280cdfc0 0x7f27280b0c90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f272f234640 1 --2- 172.21.15.130:0/2720052379 >> v2:172.21.15.164:3300/0 conn(0x7f2728159f20 0x7f27280ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f272f234640 1 -- 172.21.15.130:0/2720052379 >> 172.21.15.130:0/2720052379 conn(0x7f2728065990 msgr2=0x7f2728065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:14.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f272f234640 1 -- 172.21.15.130:0/2720052379 shutdown_connections 2023-09-13T06:05:14.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f272f234640 1 -- 172.21.15.130:0/2720052379 wait complete. 2023-09-13T06:05:14.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f272f234640 1 Processor -- start 2023-09-13T06:05:14.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.317+0000 7f272f234640 1 -- start start 2023-09-13T06:05:14.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272f234640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27280b1610 0x7f2728168890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:14.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272f234640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27280cdfc0 0x7f2728150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:14.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272f234640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2728159f20 0x7f2728167a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:14.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272f234640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272814dde0 con 0x7f27280cdfc0 2023-09-13T06:05:14.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272f234640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2728167fb0 con 0x7f2728159f20 2023-09-13T06:05:14.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272f234640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2728166cb0 con 0x7f27280b1610 2023-09-13T06:05:14.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f2727fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27280cdfc0 0x7f2728150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:14.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f2727fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27280cdfc0 0x7f2728150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59736/0 (socket says 172.21.15.130:59736) 2023-09-13T06:05:14.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f2727fff640 1 -- 172.21.15.130:0/1477532528 learned_addr learned my addr 172.21.15.130:0/1477532528 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:14.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272cfd0640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27280b1610 0x7f2728168890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:14.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272d7d1640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2728159f20 0x7f2728167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:14.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f2727fff640 1 -- 172.21.15.130:0/1477532528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27280b1610 msgr2=0x7f2728168890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f2727fff640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27280b1610 0x7f2728168890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f2727fff640 1 -- 172.21.15.130:0/1477532528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2728159f20 msgr2=0x7f2728167a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f2727fff640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2728159f20 0x7f2728167a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f2727fff640 1 -- 172.21.15.130:0/1477532528 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140094d0 con 0x7f27280cdfc0 2023-09-13T06:05:14.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272cfd0640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27280b1610 0x7f2728168890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:14.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f2727fff640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27280cdfc0 0x7f2728150dd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f27140ad040 tx=0x7f271401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:14.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f27257fa640 1 -- 172.21.15.130:0/1477532528 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27140b4800 con 0x7f27280cdfc0 2023-09-13T06:05:14.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f27257fa640 1 -- 172.21.15.130:0/1477532528 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27140b4960 con 0x7f27280cdfc0 2023-09-13T06:05:14.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f27257fa640 1 -- 172.21.15.130:0/1477532528 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27140b4d10 con 0x7f27280cdfc0 2023-09-13T06:05:14.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272f234640 1 -- 172.21.15.130:0/1477532528 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27280b1fb0 con 0x7f27280cdfc0 2023-09-13T06:05:14.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272f234640 1 -- 172.21.15.130:0/1477532528 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2728167270 con 0x7f27280cdfc0 2023-09-13T06:05:14.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f272f234640 1 -- 172.21.15.130:0/1477532528 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27280618a0 con 0x7f27280cdfc0 2023-09-13T06:05:14.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.321+0000 7f27257fa640 1 -- 172.21.15.130:0/1477532528 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f27140b3380 con 0x7f27280cdfc0 2023-09-13T06:05:14.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.325+0000 7f27257fa640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f270c065b20 0x7f270c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:14.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.325+0000 7f27257fa640 1 -- 172.21.15.130:0/1477532528 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f271411da40 con 0x7f27280cdfc0 2023-09-13T06:05:14.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.325+0000 7f27257fa640 1 -- 172.21.15.130:0/1477532528 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f270c06d650 con 0x7f27280cdfc0 2023-09-13T06:05:14.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.325+0000 7f272cfd0640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f270c065b20 0x7f270c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:14.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.325+0000 7f272cfd0640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f270c065b20 0x7f270c067fe0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2728150d60 tx=0x7f271c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:14.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.329+0000 7f27257fa640 1 -- 172.21.15.130:0/1477532528 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f27140eb4c0 con 0x7f27280cdfc0 2023-09-13T06:05:14.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.373+0000 7f27257fa640 1 -- 172.21.15.130:0/1477532528 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(72..72 src has 1..72) v4 ==== 296+0+0 (secure 0 0 0) 0x7f27140ef180 con 0x7f27280cdfc0 2023-09-13T06:05:14.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.373+0000 7f27257fa640 1 -- 172.21.15.130:0/1477532528 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f270c06df00 con 0x7f27280cdfc0 2023-09-13T06:05:14.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 -- 172.21.15.130:0/1477532528 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f272806d830 con 0x7f27280cdfc0 2023-09-13T06:05:14.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f27257fa640 1 -- 172.21.15.130:0/1477532528 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f27140c4070 con 0x7f27280cdfc0 2023-09-13T06:05:14.515 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:14.515 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1338889971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1338889971},{"type":"v1","addr":"172.21.15.164:6835","nonce":1338889971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1298091712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1298091712},{"type":"v1","addr":"172.21.15.130:6835","nonce":1298091712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/798128577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":798128577},{"type":"v1","addr":"172.21.15.130:6837","nonce":798128577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:03:54.710730+0000","modified":"2023-09-13T06:03:57.752848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6087":{"gid":6087,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2038440053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2038440053},{"type":"v1","addr":"172.21.15.164:6833","nonce":2038440053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-09-13T06:05:14.516 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 34 2023-09-13T06:05:14.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 -- 172.21.15.130:0/1477532528 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f270c065b20 msgr2=0x7f270c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f270c065b20 0x7f270c067fe0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2728150d60 tx=0x7f271c008040 comp rx=0 tx=0).stop 2023-09-13T06:05:14.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 -- 172.21.15.130:0/1477532528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27280cdfc0 msgr2=0x7f2728150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27280cdfc0 0x7f2728150dd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f27140ad040 tx=0x7f271401acb0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 -- 172.21.15.130:0/1477532528 shutdown_connections 2023-09-13T06:05:14.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f270c065b20 0x7f270c067fe0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2728159f20 0x7f2728167a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27280cdfc0 0x7f2728150dd0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 --2- 172.21.15.130:0/1477532528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27280b1610 0x7f2728168890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 -- 172.21.15.130:0/1477532528 >> 172.21.15.130:0/1477532528 conn(0x7f2728065990 msgr2=0x7f272806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:14.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 -- 172.21.15.130:0/1477532528 shutdown_connections 2023-09-13T06:05:14.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.513+0000 7f272f234640 1 -- 172.21.15.130:0/1477532528 wait complete. 2023-09-13T06:05:14.535 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:14.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e90fac640 1 Processor -- start 2023-09-13T06:05:14.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e90fac640 1 -- start start 2023-09-13T06:05:14.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e90fac640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1e8c0cc780 0x7f1e8c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:14.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e90fac640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c0ccbe0 con 0x7f1e8c0b04a0 2023-09-13T06:05:14.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e90fac640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c0ce980 con 0x7f1e8c15b130 2023-09-13T06:05:14.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e90fac640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c0cec60 con 0x7f1e8c0cc780 2023-09-13T06:05:14.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e8ad9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1e8c0b04a0 0x7f1e8c06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50754/0 (socket says 172.21.15.130:50754) 2023-09-13T06:05:14.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e8ad9d640 1 -- 172.21.15.130:0/243748698 learned_addr learned my addr 172.21.15.130:0/243748698 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:14.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e81d9b640 1 --2- 172.21.15.130:0/243748698 >> v2:172.21.15.164:3300/0 conn(0x7f1e8c0cc780 0x7f1e8c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:14.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e89d9b640 1 -- 172.21.15.130:0/243748698 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440336682 0 0) 0x7f1e8c0ccbe0 con 0x7f1e8c0b04a0 2023-09-13T06:05:14.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e89d9b640 1 -- 172.21.15.130:0/243748698 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e78003530 con 0x7f1e8c0b04a0 2023-09-13T06:05:14.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e81d9b640 1 -- 172.21.15.130:0/243748698 >> v1:172.21.15.164:6789/0 conn(0x7f1e8c15b130 legacy=0x7f1e8c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e81d9b640 1 -- 172.21.15.130:0/243748698 >> v1:172.21.15.130:6789/0 conn(0x7f1e8c0b04a0 legacy=0x7f1e8c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.673+0000 7f1e81d9b640 1 -- 172.21.15.130:0/243748698 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c06c640 con 0x7f1e8c0cc780 2023-09-13T06:05:14.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.677+0000 7f1e81d9b640 1 --2- 172.21.15.130:0/243748698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c0cc780 0x7f1e8c15b510 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1e740097c0 tx=0x7f1e7401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f22b6537b55a7315 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:14.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.677+0000 7f1e89d9b640 1 -- 172.21.15.130:0/243748698 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740ab620 con 0x7f1e8c0cc780 2023-09-13T06:05:14.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.677+0000 7f1e89d9b640 1 -- 172.21.15.130:0/243748698 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e740ab780 con 0x7f1e8c0cc780 2023-09-13T06:05:14.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.677+0000 7f1e89d9b640 1 -- 172.21.15.130:0/243748698 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740abb10 con 0x7f1e8c0cc780 2023-09-13T06:05:14.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.677+0000 7f1e90fac640 1 -- 172.21.15.130:0/243748698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c0cc780 msgr2=0x7f1e8c15b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.677+0000 7f1e90fac640 1 --2- 172.21.15.130:0/243748698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c0cc780 0x7f1e8c15b510 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1e740097c0 tx=0x7f1e7401c450 comp rx=0 tx=0).stop 2023-09-13T06:05:14.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.677+0000 7f1e90fac640 1 -- 172.21.15.130:0/243748698 shutdown_connections 2023-09-13T06:05:14.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.677+0000 7f1e90fac640 1 --2- 172.21.15.130:0/243748698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c0cc780 0x7f1e8c15b510 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.677+0000 7f1e90fac640 1 -- 172.21.15.130:0/243748698 >> 172.21.15.130:0/243748698 conn(0x7f1e8c065990 msgr2=0x7f1e8c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:14.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.677+0000 7f1e90fac640 1 -- 172.21.15.130:0/243748698 shutdown_connections 2023-09-13T06:05:14.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.677+0000 7f1e90fac640 1 -- 172.21.15.130:0/243748698 wait complete. 2023-09-13T06:05:14.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e90fac640 1 Processor -- start 2023-09-13T06:05:14.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e90fac640 1 -- start start 2023-09-13T06:05:14.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e90fac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e8c0b04a0 0x7f1e8c1442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:14.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e90fac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c0cc780 0x7f1e8c14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:14.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e90fac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e8c15b130 0x7f1e8c14f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:14.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e90fac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c148b90 con 0x7f1e8c15b130 2023-09-13T06:05:14.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e90fac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c14c4e0 con 0x7f1e8c0cc780 2023-09-13T06:05:14.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e90fac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c151950 con 0x7f1e8c0b04a0 2023-09-13T06:05:14.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e8ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e8c15b130 0x7f1e8c14f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:14.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e8ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e8c15b130 0x7f1e8c14f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59744/0 (socket says 172.21.15.130:59744) 2023-09-13T06:05:14.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e8ad9d640 1 -- 172.21.15.130:0/4289666918 learned_addr learned my addr 172.21.15.130:0/4289666918 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:14.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e81d9b640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c0cc780 0x7f1e8c14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:14.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e8a59c640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e8c0b04a0 0x7f1e8c1442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:14.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e8ad9d640 1 -- 172.21.15.130:0/4289666918 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e8c0b04a0 msgr2=0x7f1e8c1442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e8ad9d640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e8c0b04a0 0x7f1e8c1442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e8ad9d640 1 -- 172.21.15.130:0/4289666918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c0cc780 msgr2=0x7f1e8c14f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e8ad9d640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c0cc780 0x7f1e8c14f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e8ad9d640 1 -- 172.21.15.130:0/4289666918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74009420 con 0x7f1e8c15b130 2023-09-13T06:05:14.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e81d9b640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c0cc780 0x7f1e8c14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:14.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e8a59c640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e8c0b04a0 0x7f1e8c1442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:14.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e8ad9d640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e8c15b130 0x7f1e8c14f9f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400caa0 tx=0x7f1e8400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:14.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e837fe640 1 -- 172.21.15.130:0/4289666918 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8400ac00 con 0x7f1e8c15b130 2023-09-13T06:05:14.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e837fe640 1 -- 172.21.15.130:0/4289666918 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8400ad60 con 0x7f1e8c15b130 2023-09-13T06:05:14.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e837fe640 1 -- 172.21.15.130:0/4289666918 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84012620 con 0x7f1e8c15b130 2023-09-13T06:05:14.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.681+0000 7f1e90fac640 1 -- 172.21.15.130:0/4289666918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c0b0e40 con 0x7f1e8c15b130 2023-09-13T06:05:14.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.685+0000 7f1e90fac640 1 -- 172.21.15.130:0/4289666918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c148540 con 0x7f1e8c15b130 2023-09-13T06:05:14.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.685+0000 7f1e90fac640 1 -- 172.21.15.130:0/4289666918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c0618a0 con 0x7f1e8c15b130 2023-09-13T06:05:14.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.685+0000 7f1e837fe640 1 -- 172.21.15.130:0/4289666918 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1e84007070 con 0x7f1e8c15b130 2023-09-13T06:05:14.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.685+0000 7f1e837fe640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e6c065b20 0x7f1e6c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:14.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.685+0000 7f1e837fe640 1 -- 172.21.15.130:0/4289666918 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e840832e0 con 0x7f1e8c15b130 2023-09-13T06:05:14.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.685+0000 7f1e8a59c640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e6c065b20 0x7f1e6c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:14.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.685+0000 7f1e837fe640 1 -- 172.21.15.130:0/4289666918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f1e6c06d650 con 0x7f1e8c15b130 2023-09-13T06:05:14.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.685+0000 7f1e8a59c640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e6c065b20 0x7f1e6c067fe0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c000f70 tx=0x7f1e7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:14.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.689+0000 7f1e837fe640 1 -- 172.21.15.130:0/4289666918 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1e84017060 con 0x7f1e8c15b130 2023-09-13T06:05:14.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.837+0000 7f1e90fac640 1 -- 172.21.15.130:0/4289666918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e8c148cd0 con 0x7f1e8c15b130 2023-09-13T06:05:14.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.837+0000 7f1e837fe640 1 -- 172.21.15.130:0/4289666918 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16623 (secure 0 0 0) 0x7f1e84050b90 con 0x7f1e8c15b130 2023-09-13T06:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:14.841 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":72,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:05:14.375894+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:03:52.722728+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-09-13T06:03:53.712581+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:14.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 -- 172.21.15.130:0/4289666918 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e6c065b20 msgr2=0x7f1e6c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e6c065b20 0x7f1e6c067fe0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c000f70 tx=0x7f1e7c009040 comp rx=0 tx=0).stop 2023-09-13T06:05:14.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 -- 172.21.15.130:0/4289666918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e8c15b130 msgr2=0x7f1e8c14f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:14.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e8c15b130 0x7f1e8c14f9f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400caa0 tx=0x7f1e8400cf60 comp rx=0 tx=0).stop 2023-09-13T06:05:14.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 -- 172.21.15.130:0/4289666918 shutdown_connections 2023-09-13T06:05:14.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e6c065b20 0x7f1e6c067fe0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e8c0cc780 0x7f1e8c14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e8c15b130 0x7f1e8c14f9f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 --2- 172.21.15.130:0/4289666918 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e8c0b04a0 0x7f1e8c1442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:14.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 -- 172.21.15.130:0/4289666918 >> 172.21.15.130:0/4289666918 conn(0x7f1e8c065990 msgr2=0x7f1e8c0b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:14.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 -- 172.21.15.130:0/4289666918 shutdown_connections 2023-09-13T06:05:14.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:14.841+0000 7f1e90fac640 1 -- 172.21.15.130:0/4289666918 wait complete. 2023-09-13T06:05:14.861 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:05:14.863 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T06:05:14.907 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:05:15.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.041+0000 7f44e4311640 1 Processor -- start 2023-09-13T06:05:15.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e4311640 1 -- start start 2023-09-13T06:05:15.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e4311640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f44dc0cc780 0x7f44dc15b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e4311640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f44dc0b04a0 0x7f44dc0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e4311640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44dc0ccbe0 con 0x7f44dc15b130 2023-09-13T06:05:15.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e4311640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44dc0b0e50 con 0x7f44dc0cc780 2023-09-13T06:05:15.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e4311640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44dc0ce980 con 0x7f44dc0b04a0 2023-09-13T06:05:15.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e18ac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f44dc0cc780 0x7f44dc15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e18ac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f44dc0cc780 0x7f44dc15b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59756/0 (socket says 172.21.15.130:59756) 2023-09-13T06:05:15.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e18ac640 1 -- 172.21.15.130:0/838348623 learned_addr learned my addr 172.21.15.130:0/838348623 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:15.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e28ae640 1 --2- 172.21.15.130:0/838348623 >> v2:172.21.15.164:3300/0 conn(0x7f44dc0b04a0 0x7f44dc0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e18ac640 1 -- 172.21.15.130:0/838348623 >> v2:172.21.15.164:3300/0 conn(0x7f44dc0b04a0 msgr2=0x7f44dc0b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:15.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e18ac640 1 --2- 172.21.15.130:0/838348623 >> v2:172.21.15.164:3300/0 conn(0x7f44dc0b04a0 0x7f44dc0b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e18ac640 1 -- 172.21.15.130:0/838348623 >> v1:172.21.15.164:6789/0 conn(0x7f44dc15b130 legacy=0x7f44dc0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:15.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.045+0000 7f44e18ac640 1 -- 172.21.15.130:0/838348623 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc0cec60 con 0x7f44dc0cc780 2023-09-13T06:05:15.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e18ac640 1 --2- 172.21.15.130:0/838348623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44dc0cc780 0x7f44dc15b510 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0b28c0 tx=0x7f44cc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47d64e736e51c48 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:15.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e10ab640 1 -- 172.21.15.130:0/838348623 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0aa5f0 con 0x7f44dc0cc780 2023-09-13T06:05:15.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e10ab640 1 -- 172.21.15.130:0/838348623 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc0aa750 con 0x7f44dc0cc780 2023-09-13T06:05:15.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e10ab640 1 -- 172.21.15.130:0/838348623 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0aaae0 con 0x7f44dc0cc780 2023-09-13T06:05:15.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e4311640 1 -- 172.21.15.130:0/838348623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44dc0cc780 msgr2=0x7f44dc15b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:15.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e4311640 1 --2- 172.21.15.130:0/838348623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44dc0cc780 0x7f44dc15b510 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0b28c0 tx=0x7f44cc01c490 comp rx=0 tx=0).stop 2023-09-13T06:05:15.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e4311640 1 -- 172.21.15.130:0/838348623 shutdown_connections 2023-09-13T06:05:15.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e4311640 1 --2- 172.21.15.130:0/838348623 >> v2:172.21.15.164:3300/0 conn(0x7f44dc0b04a0 0x7f44dc0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e4311640 1 --2- 172.21.15.130:0/838348623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44dc0cc780 0x7f44dc15b510 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e4311640 1 -- 172.21.15.130:0/838348623 >> 172.21.15.130:0/838348623 conn(0x7f44dc065990 msgr2=0x7f44dc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:15.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e4311640 1 -- 172.21.15.130:0/838348623 shutdown_connections 2023-09-13T06:05:15.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e4311640 1 -- 172.21.15.130:0/838348623 wait complete. 2023-09-13T06:05:15.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e4311640 1 Processor -- start 2023-09-13T06:05:15.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.049+0000 7f44e4311640 1 -- start start 2023-09-13T06:05:15.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e4311640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44dc0b04a0 0x7f44dc14d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e4311640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44dc0cc780 0x7f44dc1f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e4311640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44dc15b130 0x7f44dc1f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e4311640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc0b0330 con 0x7f44dc0b04a0 2023-09-13T06:05:15.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e4311640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc152bd0 con 0x7f44dc15b130 2023-09-13T06:05:15.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e4311640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc152eb0 con 0x7f44dc0cc780 2023-09-13T06:05:15.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e20ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44dc0b04a0 0x7f44dc14d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e20ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44dc0b04a0 0x7f44dc14d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59762/0 (socket says 172.21.15.130:59762) 2023-09-13T06:05:15.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e20ad640 1 -- 172.21.15.130:0/3469583756 learned_addr learned my addr 172.21.15.130:0/3469583756 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:15.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e28ae640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44dc15b130 0x7f44dc1f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e18ac640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44dc0cc780 0x7f44dc1f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e20ad640 1 -- 172.21.15.130:0/3469583756 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44dc0cc780 msgr2=0x7f44dc1f86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:15.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e20ad640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44dc0cc780 0x7f44dc1f86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e20ad640 1 -- 172.21.15.130:0/3469583756 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44dc15b130 msgr2=0x7f44dc1f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:15.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e20ad640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44dc15b130 0x7f44dc1f8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e20ad640 1 -- 172.21.15.130:0/3469583756 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc0094d0 con 0x7f44dc0b04a0 2023-09-13T06:05:15.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e18ac640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44dc0cc780 0x7f44dc1f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:15.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e20ad640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44dc0b04a0 0x7f44dc14d5c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f44d800b410 tx=0x7f44d800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:15.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44d2ffd640 1 -- 172.21.15.130:0/3469583756 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8004020 con 0x7f44dc0b04a0 2023-09-13T06:05:15.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44d2ffd640 1 -- 172.21.15.130:0/3469583756 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d8004180 con 0x7f44dc0b04a0 2023-09-13T06:05:15.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e4311640 1 -- 172.21.15.130:0/3469583756 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44dc153190 con 0x7f44dc0b04a0 2023-09-13T06:05:15.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44d2ffd640 1 -- 172.21.15.130:0/3469583756 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8011630 con 0x7f44dc0b04a0 2023-09-13T06:05:15.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e4311640 1 -- 172.21.15.130:0/3469583756 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44dc153750 con 0x7f44dc0b04a0 2023-09-13T06:05:15.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.053+0000 7f44e4311640 1 -- 172.21.15.130:0/3469583756 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44dc0618a0 con 0x7f44dc0b04a0 2023-09-13T06:05:15.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.057+0000 7f44d2ffd640 1 -- 172.21.15.130:0/3469583756 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f44d8011790 con 0x7f44dc0b04a0 2023-09-13T06:05:15.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.057+0000 7f44d2ffd640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f44c0065b50 0x7f44c0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.057+0000 7f44d2ffd640 1 -- 172.21.15.130:0/3469583756 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44d8082fe0 con 0x7f44dc0b04a0 2023-09-13T06:05:15.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.057+0000 7f44e18ac640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f44c0065b50 0x7f44c0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.057+0000 7f44d2ffd640 1 -- 172.21.15.130:0/3469583756 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f44c006d680 con 0x7f44dc0b04a0 2023-09-13T06:05:15.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.057+0000 7f44e18ac640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f44c0065b50 0x7f44c0068010 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0ae000 tx=0x7f44cc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:15.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.061+0000 7f44d2ffd640 1 -- 172.21.15.130:0/3469583756 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f44d8015020 con 0x7f44dc0b04a0 2023-09-13T06:05:15.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.241+0000 7f44e4311640 1 -- 172.21.15.130:0/3469583756 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f44dc0cbfd0 con 0x7f44dc0b04a0 2023-09-13T06:05:15.242 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:05:15.241+0000 7faa00e50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T06:05:15.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.241+0000 7f44d2ffd640 1 -- 172.21.15.130:0/3469583756 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(73..73 src has 1..73) v4 ==== 1554+0+0 (secure 0 0 0) 0x7f44d8054cb0 con 0x7f44dc0b04a0 2023-09-13T06:05:15.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.241+0000 7f44d2ffd640 1 -- 172.21.15.130:0/3469583756 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f44c006e940 con 0x7f44dc0b04a0 2023-09-13T06:05:15.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.245+0000 7f44d2ffd640 1 -- 172.21.15.130:0/3469583756 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7f44d80508f0 con 0x7f44dc0b04a0 2023-09-13T06:05:15.248 INFO:teuthology.orchestra.run.smithi130.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T06:05:15.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 -- 172.21.15.130:0/3469583756 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f44c0065b50 msgr2=0x7f44c0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:15.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f44c0065b50 0x7f44c0068010 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0ae000 tx=0x7f44cc0a7000 comp rx=0 tx=0).stop 2023-09-13T06:05:15.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 -- 172.21.15.130:0/3469583756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44dc0b04a0 msgr2=0x7f44dc14d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:15.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44dc0b04a0 0x7f44dc14d5c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f44d800b410 tx=0x7f44d800b8d0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 -- 172.21.15.130:0/3469583756 shutdown_connections 2023-09-13T06:05:15.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f44c0065b50 0x7f44c0068010 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44dc15b130 0x7f44dc1f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44dc0cc780 0x7f44dc1f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 --2- 172.21.15.130:0/3469583756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44dc0b04a0 0x7f44dc14d5c0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 -- 172.21.15.130:0/3469583756 >> 172.21.15.130:0/3469583756 conn(0x7f44dc065990 msgr2=0x7f44dc15a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:15.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 -- 172.21.15.130:0/3469583756 shutdown_connections 2023-09-13T06:05:15.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.249+0000 7f44e4311640 1 -- 172.21.15.130:0/3469583756 wait complete. 2023-09-13T06:05:15.270 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T06:05:15.315 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:05:15.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.413+0000 7f0ca42f3640 1 Processor -- start 2023-09-13T06:05:15.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.413+0000 7f0ca42f3640 1 -- start start 2023-09-13T06:05:15.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca42f3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0c9c157ca0 0x7f0c9c15b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca42f3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c9c0ccf00 0x7f0c9c0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca42f3640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0c9c0cd380 0x7f0c9c0cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca42f3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c15ada0 con 0x7f0c9c157ca0 2023-09-13T06:05:15.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca42f3640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c15b770 con 0x7f0c9c0cd380 2023-09-13T06:05:15.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca42f3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0cdca0 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca208f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0c9c157ca0 0x7f0c9c15b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca208f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0c9c157ca0 0x7f0c9c15b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59766/0 (socket says 172.21.15.130:59766) 2023-09-13T06:05:15.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca208f640 1 -- 172.21.15.130:0/751296659 learned_addr learned my addr 172.21.15.130:0/751296659 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:15.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca188e640 1 --2- 172.21.15.130:0/751296659 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c9c0ccf00 0x7f0c9c0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca2890640 1 --2- 172.21.15.130:0/751296659 >> v2:172.21.15.164:3300/0 conn(0x7f0c9c0cd380 0x7f0c9c0cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca208f640 1 -- 172.21.15.130:0/751296659 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c9c0ccf00 msgr2=0x7f0c9c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:15.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca208f640 1 --2- 172.21.15.130:0/751296659 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c9c0ccf00 0x7f0c9c0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca208f640 1 -- 172.21.15.130:0/751296659 >> v2:172.21.15.164:3300/0 conn(0x7f0c9c0cd380 msgr2=0x7f0c9c0cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:15.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca208f640 1 --2- 172.21.15.130:0/751296659 >> v2:172.21.15.164:3300/0 conn(0x7f0c9c0cd380 0x7f0c9c0cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca208f640 1 -- 172.21.15.130:0/751296659 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c0cdf80 con 0x7f0c9c157ca0 2023-09-13T06:05:15.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca188e640 1 --2- 172.21.15.130:0/751296659 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c9c0ccf00 0x7f0c9c0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:15.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca2890640 1 --2- 172.21.15.130:0/751296659 >> v2:172.21.15.164:3300/0 conn(0x7f0c9c0cd380 0x7f0c9c0cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:15.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.417+0000 7f0ca208f640 1 --2- 172.21.15.130:0/751296659 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c9c157ca0 0x7f0c9c15b230 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c15eea0 tx=0x7f0c9801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c448002714e75a19 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:15.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca108d640 1 -- 172.21.15.130:0/751296659 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980aa5f0 con 0x7f0c9c157ca0 2023-09-13T06:05:15.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca108d640 1 -- 172.21.15.130:0/751296659 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c980aa750 con 0x7f0c9c157ca0 2023-09-13T06:05:15.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca108d640 1 -- 172.21.15.130:0/751296659 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980aaae0 con 0x7f0c9c157ca0 2023-09-13T06:05:15.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 -- 172.21.15.130:0/751296659 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c9c157ca0 msgr2=0x7f0c9c15b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:15.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 --2- 172.21.15.130:0/751296659 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c9c157ca0 0x7f0c9c15b230 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c15eea0 tx=0x7f0c9801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 -- 172.21.15.130:0/751296659 shutdown_connections 2023-09-13T06:05:15.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 --2- 172.21.15.130:0/751296659 >> v2:172.21.15.164:3300/0 conn(0x7f0c9c0cd380 0x7f0c9c0cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 --2- 172.21.15.130:0/751296659 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c9c0ccf00 0x7f0c9c0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 --2- 172.21.15.130:0/751296659 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c9c157ca0 0x7f0c9c15b230 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 -- 172.21.15.130:0/751296659 >> 172.21.15.130:0/751296659 conn(0x7f0c9c065990 msgr2=0x7f0c9c065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:15.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 -- 172.21.15.130:0/751296659 shutdown_connections 2023-09-13T06:05:15.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 -- 172.21.15.130:0/751296659 wait complete. 2023-09-13T06:05:15.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 Processor -- start 2023-09-13T06:05:15.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 -- start start 2023-09-13T06:05:15.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c9c0ccf00 0x7f0c9c1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c9c0cd380 0x7f0c9c141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c9c157ca0 0x7f0c9c154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c153520 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c1546d0 con 0x7f0c9c157ca0 2023-09-13T06:05:15.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca42f3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c152910 con 0x7f0c9c0cd380 2023-09-13T06:05:15.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.421+0000 7f0ca208f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c9c0ccf00 0x7f0c9c1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca208f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c9c0ccf00 0x7f0c9c1539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59772/0 (socket says 172.21.15.130:59772) 2023-09-13T06:05:15.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca208f640 1 -- 172.21.15.130:0/1141803730 learned_addr learned my addr 172.21.15.130:0/1141803730 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:15.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca188e640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c9c0cd380 0x7f0c9c141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca2890640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c9c157ca0 0x7f0c9c154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca208f640 1 -- 172.21.15.130:0/1141803730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c9c0cd380 msgr2=0x7f0c9c141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:15.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca208f640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c9c0cd380 0x7f0c9c141a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca208f640 1 -- 172.21.15.130:0/1141803730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c9c157ca0 msgr2=0x7f0c9c154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:15.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca208f640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c9c157ca0 0x7f0c9c154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:15.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca208f640 1 -- 172.21.15.130:0/1141803730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c980094d0 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca2890640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c9c157ca0 0x7f0c9c154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:15.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca208f640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c9c0ccf00 0x7f0c9c1539b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0c980ac040 tx=0x7f0c9801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:15.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0c92ffd640 1 -- 172.21.15.130:0/1141803730 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980b3800 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0c92ffd640 1 -- 172.21.15.130:0/1141803730 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c980b3980 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca42f3640 1 -- 172.21.15.130:0/1141803730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c152bf0 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0c92ffd640 1 -- 172.21.15.130:0/1141803730 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980b3d30 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca42f3640 1 -- 172.21.15.130:0/1141803730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c1531b0 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca42f3640 1 -- 172.21.15.130:0/1141803730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c0cd7b0 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0c92ffd640 1 -- 172.21.15.130:0/1141803730 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0c980c6390 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0c92ffd640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c80065b20 0x7f0c80067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:15.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0c92ffd640 1 -- 172.21.15.130:0/1141803730 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0c980a7070 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.425+0000 7f0ca188e640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c80065b20 0x7f0c80067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:15.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.429+0000 7f0ca188e640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c80065b20 0x7f0c80067fe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c163a10 tx=0x7f0c8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:15.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.429+0000 7f0c92ffd640 1 -- 172.21.15.130:0/1141803730 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0c980eb660 con 0x7f0c9c0ccf00 2023-09-13T06:05:15.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:15.613+0000 7f0ca42f3640 1 -- 172.21.15.130:0/1141803730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0c9c0674a0 con 0x7f0c9c0ccf00 2023-09-13T06:05:16.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.245+0000 7f0c92ffd640 1 -- 172.21.15.130:0/1141803730 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0c980eec80 con 0x7f0c9c0ccf00 2023-09-13T06:05:16.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 -- 172.21.15.130:0/1141803730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c80065b20 msgr2=0x7f0c80067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:16.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c80065b20 0x7f0c80067fe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c163a10 tx=0x7f0c8c008040 comp rx=0 tx=0).stop 2023-09-13T06:05:16.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 -- 172.21.15.130:0/1141803730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c9c0ccf00 msgr2=0x7f0c9c1539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:16.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c9c0ccf00 0x7f0c9c1539b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0c980ac040 tx=0x7f0c9801ad10 comp rx=0 tx=0).stop 2023-09-13T06:05:16.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 -- 172.21.15.130:0/1141803730 shutdown_connections 2023-09-13T06:05:16.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c80065b20 0x7f0c80067fe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:16.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c9c157ca0 0x7f0c9c154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:16.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c9c0cd380 0x7f0c9c141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:16.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 --2- 172.21.15.130:0/1141803730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c9c0ccf00 0x7f0c9c1539b0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:16.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 -- 172.21.15.130:0/1141803730 >> 172.21.15.130:0/1141803730 conn(0x7f0c9c065990 msgr2=0x7f0c9c15d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:16.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 -- 172.21.15.130:0/1141803730 shutdown_connections 2023-09-13T06:05:16.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.249+0000 7f0ca42f3640 1 -- 172.21.15.130:0/1141803730 wait complete. 2023-09-13T06:05:16.273 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T06:05:16.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.417+0000 7f025800b640 1 Processor -- start 2023-09-13T06:05:16.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.417+0000 7f025800b640 1 -- start start 2023-09-13T06:05:16.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.417+0000 7f025800b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f02500ccc10 0x7f025015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:16.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f025800b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f02500cb710 0x7f02500cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:16.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f025800b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02500ccff0 con 0x7f02500b3170 2023-09-13T06:05:16.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f025800b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025015b590 con 0x7f02500ccc10 2023-09-13T06:05:16.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f025800b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02500b12f0 con 0x7f02500cb710 2023-09-13T06:05:16.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f0255da7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f02500ccc10 0x7f025015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:16.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f0255da7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f02500ccc10 0x7f025015dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59774/0 (socket says 172.21.15.130:59774) 2023-09-13T06:05:16.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f0255da7640 1 -- 172.21.15.130:0/3536048601 learned_addr learned my addr 172.21.15.130:0/3536048601 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:16.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f02565a8640 1 --2- 172.21.15.130:0/3536048601 >> v2:172.21.15.164:3300/0 conn(0x7f02500cb710 0x7f02500cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:16.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f0255da7640 1 -- 172.21.15.130:0/3536048601 >> v2:172.21.15.164:3300/0 conn(0x7f02500cb710 msgr2=0x7f02500cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:16.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f0255da7640 1 --2- 172.21.15.130:0/3536048601 >> v2:172.21.15.164:3300/0 conn(0x7f02500cb710 0x7f02500cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:16.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f0255da7640 1 -- 172.21.15.130:0/3536048601 >> v1:172.21.15.164:6789/0 conn(0x7f02500b3170 legacy=0x7f02500b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:16.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f0255da7640 1 -- 172.21.15.130:0/3536048601 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025015e520 con 0x7f02500ccc10 2023-09-13T06:05:16.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f0255da7640 1 --2- 172.21.15.130:0/3536048601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02500ccc10 0x7f025015dcd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f025006e8f0 tx=0x7f024c01e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b7fc6b755d58fa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:16.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f0254da5640 1 -- 172.21.15.130:0/3536048601 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0aa630 con 0x7f02500ccc10 2023-09-13T06:05:16.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.421+0000 7f0254da5640 1 -- 172.21.15.130:0/3536048601 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c0aa790 con 0x7f02500ccc10 2023-09-13T06:05:16.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f0254da5640 1 -- 172.21.15.130:0/3536048601 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0aab20 con 0x7f02500ccc10 2023-09-13T06:05:16.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 -- 172.21.15.130:0/3536048601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02500ccc10 msgr2=0x7f025015dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:16.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 --2- 172.21.15.130:0/3536048601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02500ccc10 0x7f025015dcd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f025006e8f0 tx=0x7f024c01e710 comp rx=0 tx=0).stop 2023-09-13T06:05:16.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 -- 172.21.15.130:0/3536048601 shutdown_connections 2023-09-13T06:05:16.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 --2- 172.21.15.130:0/3536048601 >> v2:172.21.15.164:3300/0 conn(0x7f02500cb710 0x7f02500cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:16.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 --2- 172.21.15.130:0/3536048601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02500ccc10 0x7f025015dcd0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:16.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 -- 172.21.15.130:0/3536048601 >> 172.21.15.130:0/3536048601 conn(0x7f02500735e0 msgr2=0x7f0250065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:16.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 -- 172.21.15.130:0/3536048601 shutdown_connections 2023-09-13T06:05:16.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 -- 172.21.15.130:0/3536048601 wait complete. 2023-09-13T06:05:16.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 Processor -- start 2023-09-13T06:05:16.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 -- start start 2023-09-13T06:05:16.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02500b3170 0x7f0250144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:16.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02500cb710 0x7f0250153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:16.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02500ccc10 0x7f025006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:16.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025006d1e0 con 0x7f02500cb710 2023-09-13T06:05:16.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0250152110 con 0x7f02500ccc10 2023-09-13T06:05:16.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f025800b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0250152f90 con 0x7f02500b3170 2023-09-13T06:05:16.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f02555a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02500cb710 0x7f0250153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:16.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f02555a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02500cb710 0x7f0250153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59790/0 (socket says 172.21.15.130:59790) 2023-09-13T06:05:16.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f02555a6640 1 -- 172.21.15.130:0/1676250942 learned_addr learned my addr 172.21.15.130:0/1676250942 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:16.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f0255da7640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02500b3170 0x7f0250144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:16.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.425+0000 7f02565a8640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02500ccc10 0x7f025006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:16.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02555a6640 1 -- 172.21.15.130:0/1676250942 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02500b3170 msgr2=0x7f0250144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:16.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02555a6640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02500b3170 0x7f0250144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:16.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02555a6640 1 -- 172.21.15.130:0/1676250942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02500ccc10 msgr2=0x7f025006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:16.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02555a6640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02500ccc10 0x7f025006c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:16.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02555a6640 1 -- 172.21.15.130:0/1676250942 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c0094d0 con 0x7f02500cb710 2023-09-13T06:05:16.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02555a6640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02500cb710 0x7f0250153d50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f024000c500 tx=0x7f024000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:16.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02467fc640 1 -- 172.21.15.130:0/1676250942 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240005220 con 0x7f02500cb710 2023-09-13T06:05:16.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02467fc640 1 -- 172.21.15.130:0/1676250942 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0240005380 con 0x7f02500cb710 2023-09-13T06:05:16.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02467fc640 1 -- 172.21.15.130:0/1676250942 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240007270 con 0x7f02500cb710 2023-09-13T06:05:16.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f025800b640 1 -- 172.21.15.130:0/1676250942 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0250153270 con 0x7f02500cb710 2023-09-13T06:05:16.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f025800b640 1 -- 172.21.15.130:0/1676250942 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0250153830 con 0x7f02500cb710 2023-09-13T06:05:16.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f025800b640 1 -- 172.21.15.130:0/1676250942 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02500618a0 con 0x7f02500cb710 2023-09-13T06:05:16.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02467fc640 1 -- 172.21.15.130:0/1676250942 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f02400073d0 con 0x7f02500cb710 2023-09-13T06:05:16.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02467fc640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0234065b20 0x7f0234067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:16.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f02467fc640 1 -- 172.21.15.130:0/1676250942 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0240082bf0 con 0x7f02500cb710 2023-09-13T06:05:16.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.429+0000 7f0255da7640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0234065b20 0x7f0234067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:16.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.433+0000 7f0255da7640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0234065b20 0x7f0234067fe0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f024c0b1000 tx=0x7f024c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:16.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.433+0000 7f02467fc640 1 -- 172.21.15.130:0/1676250942 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0240050500 con 0x7f02500cb710 2023-09-13T06:05:16.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:16.581+0000 7f025800b640 1 -- 172.21.15.130:0/1676250942 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0250164c10 con 0x7f02500cb710 2023-09-13T06:05:17.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.397+0000 7f02467fc640 1 -- 172.21.15.130:0/1676250942 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0240053b20 con 0x7f02500cb710 2023-09-13T06:05:17.400 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' removed 2023-09-13T06:05:17.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 -- 172.21.15.130:0/1676250942 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0234065b20 msgr2=0x7f0234067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:17.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0234065b20 0x7f0234067fe0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f024c0b1000 tx=0x7f024c009040 comp rx=0 tx=0).stop 2023-09-13T06:05:17.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 -- 172.21.15.130:0/1676250942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02500cb710 msgr2=0x7f0250153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:17.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02500cb710 0x7f0250153d50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f024000c500 tx=0x7f024000c9c0 comp rx=0 tx=0).stop 2023-09-13T06:05:17.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 -- 172.21.15.130:0/1676250942 shutdown_connections 2023-09-13T06:05:17.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0234065b20 0x7f0234067fe0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:17.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02500ccc10 0x7f025006c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:17.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02500cb710 0x7f0250153d50 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:17.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 --2- 172.21.15.130:0/1676250942 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02500b3170 0x7f0250144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:17.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 -- 172.21.15.130:0/1676250942 >> 172.21.15.130:0/1676250942 conn(0x7f02500735e0 msgr2=0x7f0250159a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:17.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 -- 172.21.15.130:0/1676250942 shutdown_connections 2023-09-13T06:05:17.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.401+0000 7f025800b640 1 -- 172.21.15.130:0/1676250942 wait complete. 2023-09-13T06:05:17.425 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T06:05:17.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.569+0000 7f69c5d67640 1 Processor -- start 2023-09-13T06:05:17.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.569+0000 7f69c5d67640 1 -- start start 2023-09-13T06:05:17.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.569+0000 7f69c5d67640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f69c00b3170 0x7f69c00b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:17.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.569+0000 7f69c5d67640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c00ccff0 con 0x7f69c00b1ff0 2023-09-13T06:05:17.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.569+0000 7f69c5d67640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c015b590 con 0x7f69c00ccc10 2023-09-13T06:05:17.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.569+0000 7f69c5d67640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c00b12f0 con 0x7f69c00b3170 2023-09-13T06:05:17.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.573+0000 7f69beffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f69c00b3170 0x7f69c00b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:17.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.573+0000 7f69beffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f69c00b3170 0x7f69c00b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59798/0 (socket says 172.21.15.130:59798) 2023-09-13T06:05:17.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.573+0000 7f69beffd640 1 -- 172.21.15.130:0/1824210773 learned_addr learned my addr 172.21.15.130:0/1824210773 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:17.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.573+0000 7f69beffd640 1 -- 172.21.15.130:0/1824210773 >> v1:172.21.15.164:6789/0 conn(0x7f69c00ccc10 legacy=0x7f69c015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:17.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.573+0000 7f69beffd640 1 -- 172.21.15.130:0/1824210773 >> v1:172.21.15.130:6789/0 conn(0x7f69c00b1ff0 legacy=0x7f69c00cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:17.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.573+0000 7f69beffd640 1 -- 172.21.15.130:0/1824210773 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c015e520 con 0x7f69c00b3170 2023-09-13T06:05:17.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.573+0000 7f69be7fc640 1 -- 172.21.15.130:0/1824210773 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724856386 0 0) 0x7f69c00ccff0 con 0x7f69c00b1ff0 2023-09-13T06:05:17.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.573+0000 7f69beffd640 1 --2- 172.21.15.130:0/1824210773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69c00b3170 0x7f69c00b1ab0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009870 tx=0x7f69b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb14cc32388ffa5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:17.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.573+0000 7f69be7fc640 1 -- 172.21.15.130:0/1824210773 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40aa430 con 0x7f69c00b3170 2023-09-13T06:05:17.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.573+0000 7f69be7fc640 1 -- 172.21.15.130:0/1824210773 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b40aa590 con 0x7f69c00b3170 2023-09-13T06:05:17.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.573+0000 7f69be7fc640 1 -- 172.21.15.130:0/1824210773 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40aa920 con 0x7f69c00b3170 2023-09-13T06:05:17.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 -- 172.21.15.130:0/1824210773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69c00b3170 msgr2=0x7f69c00b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:17.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 --2- 172.21.15.130:0/1824210773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69c00b3170 0x7f69c00b1ab0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009870 tx=0x7f69b401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:05:17.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 -- 172.21.15.130:0/1824210773 shutdown_connections 2023-09-13T06:05:17.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 --2- 172.21.15.130:0/1824210773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69c00b3170 0x7f69c00b1ab0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:17.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 -- 172.21.15.130:0/1824210773 >> 172.21.15.130:0/1824210773 conn(0x7f69c00735e0 msgr2=0x7f69c0065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:17.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 -- 172.21.15.130:0/1824210773 shutdown_connections 2023-09-13T06:05:17.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 -- 172.21.15.130:0/1824210773 wait complete. 2023-09-13T06:05:17.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 Processor -- start 2023-09-13T06:05:17.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 -- start start 2023-09-13T06:05:17.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69c00b1ff0 0x7f69c00b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:17.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69c00b3170 0x7f69c01502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:17.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69c00ccc10 0x7f69c006b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:17.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c00adeb0 con 0x7f69c00b3170 2023-09-13T06:05:17.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c00af590 con 0x7f69c00ccc10 2023-09-13T06:05:17.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69c5d67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c015c320 con 0x7f69c00b1ff0 2023-09-13T06:05:17.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69beffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69c00b3170 0x7f69c01502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:17.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69beffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69c00b3170 0x7f69c01502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59808/0 (socket says 172.21.15.130:59808) 2023-09-13T06:05:17.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69beffd640 1 -- 172.21.15.130:0/753087498 learned_addr learned my addr 172.21.15.130:0/753087498 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:17.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69bffff640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69c00ccc10 0x7f69c006b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:17.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69bf7fe640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69c00b1ff0 0x7f69c00b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:17.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69beffd640 1 -- 172.21.15.130:0/753087498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69c00b1ff0 msgr2=0x7f69c00b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:17.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69beffd640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69c00b1ff0 0x7f69c00b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:17.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69beffd640 1 -- 172.21.15.130:0/753087498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69c00ccc10 msgr2=0x7f69c006b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:17.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69beffd640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69c00ccc10 0x7f69c006b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:17.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.577+0000 7f69beffd640 1 -- 172.21.15.130:0/753087498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40094d0 con 0x7f69c00b3170 2023-09-13T06:05:17.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.581+0000 7f69beffd640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69c00b3170 0x7f69c01502f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f69b40ac040 tx=0x7f69b401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:17.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.581+0000 7f69a7fff640 1 -- 172.21.15.130:0/753087498 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40b38c0 con 0x7f69c00b3170 2023-09-13T06:05:17.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.581+0000 7f69a7fff640 1 -- 172.21.15.130:0/753087498 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b40b3a40 con 0x7f69c00b3170 2023-09-13T06:05:17.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.581+0000 7f69a7fff640 1 -- 172.21.15.130:0/753087498 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40b3df0 con 0x7f69c00b3170 2023-09-13T06:05:17.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.581+0000 7f69c5d67640 1 -- 172.21.15.130:0/753087498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c00ae100 con 0x7f69c00b3170 2023-09-13T06:05:17.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.581+0000 7f69c5d67640 1 -- 172.21.15.130:0/753087498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c015c5e0 con 0x7f69c00b3170 2023-09-13T06:05:17.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.581+0000 7f69c5d67640 1 -- 172.21.15.130:0/753087498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c015c7d0 con 0x7f69c00b3170 2023-09-13T06:05:17.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.581+0000 7f69a7fff640 1 -- 172.21.15.130:0/753087498 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f69b40b2380 con 0x7f69c00b3170 2023-09-13T06:05:17.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.581+0000 7f69a7fff640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f69ac065b50 0x7f69ac068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:17.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.581+0000 7f69a7fff640 1 -- 172.21.15.130:0/753087498 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f69b411d7d0 con 0x7f69c00b3170 2023-09-13T06:05:17.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.581+0000 7f69bf7fe640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f69ac065b50 0x7f69ac068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:17.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.585+0000 7f69bf7fe640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f69ac065b50 0x7f69ac068010 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f69c0065b00 tx=0x7f69b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:17.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.585+0000 7f69a7fff640 1 -- 172.21.15.130:0/753087498 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f69b40eb320 con 0x7f69c00b3170 2023-09-13T06:05:17.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:17.737+0000 7f69c5d67640 1 -- 172.21.15.130:0/753087498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f69c00618a0 con 0x7f69c00b3170 2023-09-13T06:05:18.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.401+0000 7f69a7fff640 1 -- 172.21.15.130:0/753087498 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7f69b40ee940 con 0x7f69c00b3170 2023-09-13T06:05:18.403 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' removed 2023-09-13T06:05:18.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 -- 172.21.15.130:0/753087498 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f69ac065b50 msgr2=0x7f69ac068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f69ac065b50 0x7f69ac068010 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f69c0065b00 tx=0x7f69b0008040 comp rx=0 tx=0).stop 2023-09-13T06:05:18.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 -- 172.21.15.130:0/753087498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69c00b3170 msgr2=0x7f69c01502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69c00b3170 0x7f69c01502f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f69b40ac040 tx=0x7f69b401ad10 comp rx=0 tx=0).stop 2023-09-13T06:05:18.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 -- 172.21.15.130:0/753087498 shutdown_connections 2023-09-13T06:05:18.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f69ac065b50 0x7f69ac068010 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69c00ccc10 0x7f69c006b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69c00b3170 0x7f69c01502f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 --2- 172.21.15.130:0/753087498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69c00b1ff0 0x7f69c00b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 -- 172.21.15.130:0/753087498 >> 172.21.15.130:0/753087498 conn(0x7f69c00735e0 msgr2=0x7f69c00b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:18.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 -- 172.21.15.130:0/753087498 shutdown_connections 2023-09-13T06:05:18.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.405+0000 7f69c5d67640 1 -- 172.21.15.130:0/753087498 wait complete. 2023-09-13T06:05:18.429 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-13T06:05:18.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5ae5019640 1 Processor -- start 2023-09-13T06:05:18.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5ae5019640 1 -- start start 2023-09-13T06:05:18.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5ae5019640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5ae00ccf00 0x7f5ae00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5ae5019640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae015ada0 con 0x7f5ae00cd390 2023-09-13T06:05:18.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5ae5019640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae00cdca0 con 0x7f5ae0157ca0 2023-09-13T06:05:18.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5ae5019640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae00cdf80 con 0x7f5ae00ccf00 2023-09-13T06:05:18.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5adf59e640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5ae00cd390 0x7f5ae015de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50770/0 (socket says 172.21.15.130:50770) 2023-09-13T06:05:18.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5adf59e640 1 -- 172.21.15.130:0/3802176272 learned_addr learned my addr 172.21.15.130:0/3802176272 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:18.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5ade59c640 1 --2- 172.21.15.130:0/3802176272 >> v2:172.21.15.164:3300/0 conn(0x7f5ae00ccf00 0x7f5ae00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529993970 0 0) 0x7f5ae015ada0 con 0x7f5ae00cd390 2023-09-13T06:05:18.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac8003530 con 0x7f5ae00cd390 2023-09-13T06:05:18.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2160974700 0 0) 0x7f5ac8003530 con 0x7f5ae00cd390 2023-09-13T06:05:18.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 >> v2:172.21.15.164:3300/0 conn(0x7f5ae00ccf00 msgr2=0x7f5ae00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:18.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 --2- 172.21.15.130:0/3802176272 >> v2:172.21.15.164:3300/0 conn(0x7f5ae00ccf00 0x7f5ae00cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 >> v1:172.21.15.164:6789/0 conn(0x7f5ae0157ca0 legacy=0x7f5ae015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae00ce260 con 0x7f5ae00cd390 2023-09-13T06:05:18.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f5ad8001a00 con 0x7f5ae00cd390 2023-09-13T06:05:18.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 >> v1:172.21.15.130:6789/0 conn(0x7f5ae00cd390 legacy=0x7f5ae015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 0x7f5ac8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ac80047d0 0x7f5ac8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac8005190 0x7f5ac800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00cdf80 con 0x7f5ac8003980 2023-09-13T06:05:18.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac800c030 con 0x7f5ac80047d0 2023-09-13T06:05:18.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac800c1f0 con 0x7f5ac8005190 2023-09-13T06:05:18.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5aded9d640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 0x7f5ac8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5ade59c640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ac80047d0 0x7f5ac8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5adf59e640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac8005190 0x7f5ac800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5aded9d640 1 -- 172.21.15.130:0/3802176272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac8005190 msgr2=0x7f5ac800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:18.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5aded9d640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac8005190 0x7f5ac800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5aded9d640 1 -- 172.21.15.130:0/3802176272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ac80047d0 msgr2=0x7f5ac8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:18.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5aded9d640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ac80047d0 0x7f5ac8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5aded9d640 1 -- 172.21.15.130:0/3802176272 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac8003530 con 0x7f5ac8003980 2023-09-13T06:05:18.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5adf59e640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac8005190 0x7f5ac800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:18.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.573+0000 7f5adf59e640 1 -- 172.21.15.130:0/3802176272 reap_dead start 2023-09-13T06:05:18.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.577+0000 7f5aded9d640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 0x7f5ac8003da0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0001360 tx=0x7f5ad001e5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdf4abb99cc4e4a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:18.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.577+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00052d0 con 0x7f5ac8003980 2023-09-13T06:05:18.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.577+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad0005450 con 0x7f5ac8003980 2023-09-13T06:05:18.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.577+0000 7f5addd9b640 1 -- 172.21.15.130:0/3802176272 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0003840 con 0x7f5ac8003980 2023-09-13T06:05:18.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.577+0000 7f5ae5019640 1 -- 172.21.15.130:0/3802176272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 msgr2=0x7f5ac8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.577+0000 7f5ae5019640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 0x7f5ac8003da0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0001360 tx=0x7f5ad001e5c0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.577+0000 7f5ae5019640 1 -- 172.21.15.130:0/3802176272 shutdown_connections 2023-09-13T06:05:18.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.577+0000 7f5ae5019640 1 --2- 172.21.15.130:0/3802176272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 0x7f5ac8003da0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.577+0000 7f5ae5019640 1 -- 172.21.15.130:0/3802176272 >> 172.21.15.130:0/3802176272 conn(0x7f5ae0065990 msgr2=0x7f5ae0065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:18.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.577+0000 7f5ae5019640 1 -- 172.21.15.130:0/3802176272 shutdown_connections 2023-09-13T06:05:18.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.577+0000 7f5ae5019640 1 -- 172.21.15.130:0/3802176272 wait complete. 2023-09-13T06:05:18.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5ae5019640 1 Processor -- start 2023-09-13T06:05:18.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5ae5019640 1 -- start start 2023-09-13T06:05:18.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5ae5019640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 0x7f5ae0149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5ae5019640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ae0153a60 0x7f5ae00aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5ae5019640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ae01592e0 0x7f5ae0159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5ae5019640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae0159ca0 con 0x7f5ac8003980 2023-09-13T06:05:18.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5ae5019640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00acf20 con 0x7f5ae0153a60 2023-09-13T06:05:18.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5ae5019640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00ad3b0 con 0x7f5ae01592e0 2023-09-13T06:05:18.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5aded9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 0x7f5ae0149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5aded9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 0x7f5ae0149aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59818/0 (socket says 172.21.15.130:59818) 2023-09-13T06:05:18.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5aded9d640 1 -- 172.21.15.130:0/4251172444 learned_addr learned my addr 172.21.15.130:0/4251172444 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:18.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5adf59e640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ae01592e0 0x7f5ae0159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5ade59c640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ae0153a60 0x7f5ae00aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5aded9d640 1 -- 172.21.15.130:0/4251172444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ae01592e0 msgr2=0x7f5ae0159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5aded9d640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ae01592e0 0x7f5ae0159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5aded9d640 1 -- 172.21.15.130:0/4251172444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ae0153a60 msgr2=0x7f5ae00aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5aded9d640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ae0153a60 0x7f5ae00aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5aded9d640 1 -- 172.21.15.130:0/4251172444 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae00ac310 con 0x7f5ac8003980 2023-09-13T06:05:18.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.581+0000 7f5aded9d640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 0x7f5ae0149aa0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0005040 tx=0x7f5ac8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:18.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.585+0000 7f5ac77fe640 1 -- 172.21.15.130:0/4251172444 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0007a40 con 0x7f5ac8003980 2023-09-13T06:05:18.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.585+0000 7f5ac77fe640 1 -- 172.21.15.130:0/4251172444 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad00050d0 con 0x7f5ac8003980 2023-09-13T06:05:18.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.585+0000 7f5ae5019640 1 -- 172.21.15.130:0/4251172444 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae00ac5f0 con 0x7f5ac8003980 2023-09-13T06:05:18.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.585+0000 7f5ac77fe640 1 -- 172.21.15.130:0/4251172444 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0007030 con 0x7f5ac8003980 2023-09-13T06:05:18.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.585+0000 7f5ae5019640 1 -- 172.21.15.130:0/4251172444 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae00acbb0 con 0x7f5ac8003980 2023-09-13T06:05:18.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.585+0000 7f5ae5019640 1 -- 172.21.15.130:0/4251172444 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae00674a0 con 0x7f5ac8003980 2023-09-13T06:05:18.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.585+0000 7f5ac77fe640 1 -- 172.21.15.130:0/4251172444 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5ad00b4050 con 0x7f5ac8003980 2023-09-13T06:05:18.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.585+0000 7f5ac77fe640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5acc065ba0 0x7f5acc068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.585+0000 7f5ac77fe640 1 -- 172.21.15.130:0/4251172444 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5ad011e720 con 0x7f5ac8003980 2023-09-13T06:05:18.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.585+0000 7f5ade59c640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5acc065ba0 0x7f5acc068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.585+0000 7f5ade59c640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5acc065ba0 0x7f5acc068060 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009b80 tx=0x7f5ad4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:18.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.589+0000 7f5ac77fe640 1 -- 172.21.15.130:0/4251172444 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5ad00ec490 con 0x7f5ac8003980 2023-09-13T06:05:18.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.741+0000 7f5ae5019640 1 -- 172.21.15.130:0/4251172444 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5ae0159ca0 con 0x7f5ac8003980 2023-09-13T06:05:18.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.745+0000 7f5ac77fe640 1 -- 172.21.15.130:0/4251172444 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5ad00efab0 con 0x7f5ac8003980 2023-09-13T06:05:18.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 -- 172.21.15.130:0/4251172444 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5acc065ba0 msgr2=0x7f5acc068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5acc065ba0 0x7f5acc068060 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009b80 tx=0x7f5ad4009190 comp rx=0 tx=0).stop 2023-09-13T06:05:18.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 -- 172.21.15.130:0/4251172444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 msgr2=0x7f5ae0149aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 0x7f5ae0149aa0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0005040 tx=0x7f5ac8005800 comp rx=0 tx=0).stop 2023-09-13T06:05:18.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 -- 172.21.15.130:0/4251172444 shutdown_connections 2023-09-13T06:05:18.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5acc065ba0 0x7f5acc068060 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ae0153a60 0x7f5ae00aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ae01592e0 0x7f5ae0159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 --2- 172.21.15.130:0/4251172444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac8003980 0x7f5ae0149aa0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 -- 172.21.15.130:0/4251172444 >> 172.21.15.130:0/4251172444 conn(0x7f5ae0065990 msgr2=0x7f5ae00704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:18.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 -- 172.21.15.130:0/4251172444 shutdown_connections 2023-09-13T06:05:18.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.749+0000 7f5ae5019640 1 -- 172.21.15.130:0/4251172444 wait complete. 2023-09-13T06:05:18.769 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-09-13T06:05:18.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f021f9db640 1 Processor -- start 2023-09-13T06:05:18.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f021f9db640 1 -- start start 2023-09-13T06:05:18.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f021f9db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f02180cc780 0x7f021815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f021f9db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02180ccbe0 con 0x7f021815b130 2023-09-13T06:05:18.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f021f9db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02180ce980 con 0x7f02180b04a0 2023-09-13T06:05:18.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f021f9db640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02180cec60 con 0x7f02180cc780 2023-09-13T06:05:18.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f021d777640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f021815b130 0x7f02180ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50776/0 (socket says 172.21.15.130:50776) 2023-09-13T06:05:18.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f021d777640 1 -- 172.21.15.130:0/1002291731 learned_addr learned my addr 172.21.15.130:0/1002291731 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:18.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f021cf76640 1 --2- 172.21.15.130:0/1002291731 >> v2:172.21.15.164:3300/0 conn(0x7f02180cc780 0x7f021815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253209301 0 0) 0x7f02180ccbe0 con 0x7f021815b130 2023-09-13T06:05:18.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0204003530 con 0x7f021815b130 2023-09-13T06:05:18.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1833556619 0 0) 0x7f0204003530 con 0x7f021815b130 2023-09-13T06:05:18.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 >> v2:172.21.15.164:3300/0 conn(0x7f02180cc780 msgr2=0x7f021815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:18.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 --2- 172.21.15.130:0/1002291731 >> v2:172.21.15.164:3300/0 conn(0x7f02180cc780 0x7f021815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 >> v1:172.21.15.164:6789/0 conn(0x7f02180b04a0 legacy=0x7f021806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021806c640 con 0x7f021815b130 2023-09-13T06:05:18.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f0214001680 con 0x7f021815b130 2023-09-13T06:05:18.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 >> v1:172.21.15.130:6789/0 conn(0x7f021815b130 legacy=0x7f02180ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02040039f0 0x7f0204003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02040047d0 0x7f0204004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0204005190 0x7f020400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02180cec60 con 0x7f02040047d0 2023-09-13T06:05:18.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020400c060 con 0x7f02040039f0 2023-09-13T06:05:18.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020400c220 con 0x7f0204005190 2023-09-13T06:05:18.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.905+0000 7f021cf76640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02040047d0 0x7f0204004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021d777640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02040039f0 0x7f0204003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021df78640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0204005190 0x7f020400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021cf76640 1 -- 172.21.15.130:0/1002291731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0204005190 msgr2=0x7f020400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:18.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021cf76640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0204005190 0x7f020400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021cf76640 1 -- 172.21.15.130:0/1002291731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02040039f0 msgr2=0x7f0204003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:18.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021cf76640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02040039f0 0x7f0204003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021cf76640 1 -- 172.21.15.130:0/1002291731 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204003530 con 0x7f02040047d0 2023-09-13T06:05:18.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021d777640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02040039f0 0x7f0204003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:18.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021df78640 1 -- 172.21.15.130:0/1002291731 reap_dead start 2023-09-13T06:05:18.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021cf76640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02040047d0 0x7f0204004c50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0208009ae0 tx=0x7f020801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ac9abb35167dea server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:18.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02080a5640 con 0x7f02040047d0 2023-09-13T06:05:18.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02080a57a0 con 0x7f02040047d0 2023-09-13T06:05:18.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f020ffff640 1 -- 172.21.15.130:0/1002291731 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02080a5b50 con 0x7f02040047d0 2023-09-13T06:05:18.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021f9db640 1 -- 172.21.15.130:0/1002291731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02040047d0 msgr2=0x7f0204004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.909+0000 7f021f9db640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02040047d0 0x7f0204004c50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0208009ae0 tx=0x7f020801ca50 comp rx=0 tx=0).stop 2023-09-13T06:05:18.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 -- 172.21.15.130:0/1002291731 shutdown_connections 2023-09-13T06:05:18.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 --2- 172.21.15.130:0/1002291731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02040047d0 0x7f0204004c50 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 -- 172.21.15.130:0/1002291731 >> 172.21.15.130:0/1002291731 conn(0x7f0218065990 msgr2=0x7f0218065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:18.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 -- 172.21.15.130:0/1002291731 shutdown_connections 2023-09-13T06:05:18.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 -- 172.21.15.130:0/1002291731 wait complete. 2023-09-13T06:05:18.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 Processor -- start 2023-09-13T06:05:18.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 -- start start 2023-09-13T06:05:18.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02040047d0 0x7f0218147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f021815d640 0x7f02181e31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021815c560 0x7f021815ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021815cf50 con 0x7f021815c560 2023-09-13T06:05:18.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02181f0800 con 0x7f02040047d0 2023-09-13T06:05:18.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021f9db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0218147ff0 con 0x7f021815d640 2023-09-13T06:05:18.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021df78640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021815c560 0x7f021815ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021df78640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021815c560 0x7f021815ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59842/0 (socket says 172.21.15.130:59842) 2023-09-13T06:05:18.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021df78640 1 -- 172.21.15.130:0/3918002164 learned_addr learned my addr 172.21.15.130:0/3918002164 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:18.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021d777640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02040047d0 0x7f0218147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021cf76640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f021815d640 0x7f02181e31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021df78640 1 -- 172.21.15.130:0/3918002164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f021815d640 msgr2=0x7f02181e31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021df78640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f021815d640 0x7f02181e31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021df78640 1 -- 172.21.15.130:0/3918002164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02040047d0 msgr2=0x7f0218147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:18.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021df78640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02040047d0 0x7f0218147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:18.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021df78640 1 -- 172.21.15.130:0/3918002164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02181e3ac0 con 0x7f021815c560 2023-09-13T06:05:18.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021cf76640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f021815d640 0x7f02181e31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:18.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.913+0000 7f021df78640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021815c560 0x7f021815ca10 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f021806bc10 tx=0x7f0210011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:18.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.917+0000 7f020dffb640 1 -- 172.21.15.130:0/3918002164 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000fc50 con 0x7f021815c560 2023-09-13T06:05:18.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.917+0000 7f020dffb640 1 -- 172.21.15.130:0/3918002164 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021000fdb0 con 0x7f021815c560 2023-09-13T06:05:18.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.917+0000 7f021f9db640 1 -- 172.21.15.130:0/3918002164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02181e3da0 con 0x7f021815c560 2023-09-13T06:05:18.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.917+0000 7f020dffb640 1 -- 172.21.15.130:0/3918002164 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210015650 con 0x7f021815c560 2023-09-13T06:05:18.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.917+0000 7f021f9db640 1 -- 172.21.15.130:0/3918002164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02181f0a50 con 0x7f021815c560 2023-09-13T06:05:18.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.917+0000 7f021f9db640 1 -- 172.21.15.130:0/3918002164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02181f0c40 con 0x7f021815c560 2023-09-13T06:05:18.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.917+0000 7f020dffb640 1 -- 172.21.15.130:0/3918002164 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f02100157b0 con 0x7f021815c560 2023-09-13T06:05:18.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.917+0000 7f020dffb640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01fc065b20 0x7f01fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:18.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.917+0000 7f020dffb640 1 -- 172.21.15.130:0/3918002164 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f02100864c0 con 0x7f021815c560 2023-09-13T06:05:18.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.917+0000 7f021d777640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01fc065b20 0x7f01fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:18.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.921+0000 7f021d777640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01fc065b20 0x7f01fc067fe0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0214001ec0 tx=0x7f0214007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:18.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:18.921+0000 7f020dffb640 1 -- 172.21.15.130:0/3918002164 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0210054070 con 0x7f021815c560 2023-09-13T06:05:19.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.121+0000 7f021f9db640 1 -- 172.21.15.130:0/3918002164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f02180618a0 con 0x7f021815c560 2023-09-13T06:05:19.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.405+0000 7f020dffb640 1 -- 172.21.15.130:0/3918002164 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v216) v1 ==== 134+0+0 (secure 0 0 0) 0x7f0210057690 con 0x7f021815c560 2023-09-13T06:05:19.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 -- 172.21.15.130:0/3918002164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01fc065b20 msgr2=0x7f01fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01fc065b20 0x7f01fc067fe0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0214001ec0 tx=0x7f0214007040 comp rx=0 tx=0).stop 2023-09-13T06:05:19.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 -- 172.21.15.130:0/3918002164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021815c560 msgr2=0x7f021815ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021815c560 0x7f021815ca10 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f021806bc10 tx=0x7f0210011f90 comp rx=0 tx=0).stop 2023-09-13T06:05:19.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 -- 172.21.15.130:0/3918002164 shutdown_connections 2023-09-13T06:05:19.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01fc065b20 0x7f01fc067fe0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021815c560 0x7f021815ca10 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f021815d640 0x7f02181e31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 --2- 172.21.15.130:0/3918002164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02040047d0 0x7f0218147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 -- 172.21.15.130:0/3918002164 >> 172.21.15.130:0/3918002164 conn(0x7f0218065990 msgr2=0x7f02180cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:19.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 -- 172.21.15.130:0/3918002164 shutdown_connections 2023-09-13T06:05:19.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.409+0000 7f021f9db640 1 -- 172.21.15.130:0/3918002164 wait complete. 2023-09-13T06:05:19.430 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-09-13T06:05:19.431 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-09-13T06:05:19.431 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-09-13T06:05:19.432 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:19.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.565+0000 7f2d4e27b640 1 Processor -- start 2023-09-13T06:05:19.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.565+0000 7f2d4e27b640 1 -- start start 2023-09-13T06:05:19.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d4e27b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d48159f20 0x7f2d480ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:19.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d4e27b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2d480cdfc0 0x7f2d480b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:19.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d4e27b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d480ccfd0 con 0x7f2d480b1610 2023-09-13T06:05:19.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d4e27b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d480b00f0 con 0x7f2d480cdfc0 2023-09-13T06:05:19.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d4e27b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480ce420 con 0x7f2d48159f20 2023-09-13T06:05:19.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d477fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2d480cdfc0 0x7f2d480b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:19.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d477fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2d480cdfc0 0x7f2d480b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59848/0 (socket says 172.21.15.130:59848) 2023-09-13T06:05:19.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d477fe640 1 -- 172.21.15.130:0/3745657154 learned_addr learned my addr 172.21.15.130:0/3745657154 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:19.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d47fff640 1 --2- 172.21.15.130:0/3745657154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d48159f20 0x7f2d480ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:19.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d477fe640 1 -- 172.21.15.130:0/3745657154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d48159f20 msgr2=0x7f2d480ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:19.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d477fe640 1 --2- 172.21.15.130:0/3745657154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d48159f20 0x7f2d480ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d477fe640 1 -- 172.21.15.130:0/3745657154 >> v1:172.21.15.164:6789/0 conn(0x7f2d480b1610 legacy=0x7f2d480ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.569+0000 7f2d477fe640 1 -- 172.21.15.130:0/3745657154 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d480ced90 con 0x7f2d480cdfc0 2023-09-13T06:05:19.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d477fe640 1 --2- 172.21.15.130:0/3745657154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d480cdfc0 0x7f2d480b0c90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009870 tx=0x7f2d3c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf614c94bc78b4b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:19.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d46ffd640 1 -- 172.21.15.130:0/3745657154 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0a7070 con 0x7f2d480cdfc0 2023-09-13T06:05:19.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d46ffd640 1 -- 172.21.15.130:0/3745657154 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0ab430 con 0x7f2d480cdfc0 2023-09-13T06:05:19.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d46ffd640 1 -- 172.21.15.130:0/3745657154 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0ab7c0 con 0x7f2d480cdfc0 2023-09-13T06:05:19.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3745657154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d480cdfc0 msgr2=0x7f2d480b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d4e27b640 1 --2- 172.21.15.130:0/3745657154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d480cdfc0 0x7f2d480b0c90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009870 tx=0x7f2d3c01c540 comp rx=0 tx=0).stop 2023-09-13T06:05:19.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3745657154 shutdown_connections 2023-09-13T06:05:19.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d4e27b640 1 --2- 172.21.15.130:0/3745657154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d480cdfc0 0x7f2d480b0c90 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d4e27b640 1 --2- 172.21.15.130:0/3745657154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d48159f20 0x7f2d480ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3745657154 >> 172.21.15.130:0/3745657154 conn(0x7f2d48065990 msgr2=0x7f2d48065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:19.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3745657154 shutdown_connections 2023-09-13T06:05:19.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3745657154 wait complete. 2023-09-13T06:05:19.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d4e27b640 1 Processor -- start 2023-09-13T06:05:19.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.573+0000 7f2d4e27b640 1 -- start start 2023-09-13T06:05:19.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d4e27b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d480b1610 0x7f2d48149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:19.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d4e27b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d480cdfc0 0x7f2d48147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:19.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d4e27b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d48159f20 0x7f2d48070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:19.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d4e27b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d48149a50 con 0x7f2d480cdfc0 2023-09-13T06:05:19.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d4e27b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d48149c30 con 0x7f2d480b1610 2023-09-13T06:05:19.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d4e27b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d48149f10 con 0x7f2d48159f20 2023-09-13T06:05:19.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d480cdfc0 0x7f2d48147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:19.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d480cdfc0 0x7f2d48147500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59862/0 (socket says 172.21.15.130:59862) 2023-09-13T06:05:19.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d477fe640 1 -- 172.21.15.130:0/3035436419 learned_addr learned my addr 172.21.15.130:0/3035436419 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:19.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d47fff640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d480b1610 0x7f2d48149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:19.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d4c818640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d48159f20 0x7f2d48070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:19.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d477fe640 1 -- 172.21.15.130:0/3035436419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d48159f20 msgr2=0x7f2d48070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d477fe640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d48159f20 0x7f2d48070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d477fe640 1 -- 172.21.15.130:0/3035436419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d480b1610 msgr2=0x7f2d48149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d477fe640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d480b1610 0x7f2d48149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d477fe640 1 -- 172.21.15.130:0/3035436419 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0094d0 con 0x7f2d480cdfc0 2023-09-13T06:05:19.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d4c818640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d48159f20 0x7f2d48070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:19.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d477fe640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d480cdfc0 0x7f2d48147500 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c01a170 tx=0x7f2d3c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:19.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d44ff9640 1 -- 172.21.15.130:0/3035436419 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0ba070 con 0x7f2d480cdfc0 2023-09-13T06:05:19.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d44ff9640 1 -- 172.21.15.130:0/3035436419 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0abe30 con 0x7f2d480cdfc0 2023-09-13T06:05:19.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d44ff9640 1 -- 172.21.15.130:0/3035436419 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0b4870 con 0x7f2d480cdfc0 2023-09-13T06:05:19.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3035436419 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4814a1f0 con 0x7f2d480cdfc0 2023-09-13T06:05:19.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3035436419 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d48144ac0 con 0x7f2d480cdfc0 2023-09-13T06:05:19.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3035436419 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d480618a0 con 0x7f2d480cdfc0 2023-09-13T06:05:19.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.577+0000 7f2d44ff9640 1 -- 172.21.15.130:0/3035436419 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2d3c0b49d0 con 0x7f2d480cdfc0 2023-09-13T06:05:19.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.581+0000 7f2d44ff9640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d34065b20 0x7f2d34067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:19.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.581+0000 7f2d44ff9640 1 -- 172.21.15.130:0/3035436419 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2d3c11ca90 con 0x7f2d480cdfc0 2023-09-13T06:05:19.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.581+0000 7f2d47fff640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d34065b20 0x7f2d34067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:19.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.581+0000 7f2d47fff640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d34065b20 0x7f2d34067fe0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2d380079c0 tx=0x7f2d38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:19.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.585+0000 7f2d44ff9640 1 -- 172.21.15.130:0/3035436419 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2d3c0ea640 con 0x7f2d480cdfc0 2023-09-13T06:05:19.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.737+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3035436419 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d480cd850 con 0x7f2d480cdfc0 2023-09-13T06:05:19.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.737+0000 7f2d44ff9640 1 -- 172.21.15.130:0/3035436419 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+13024 (secure 0 0 0) 0x7f2d3c0edc60 con 0x7f2d480cdfc0 2023-09-13T06:05:19.739 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:19.740 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":75,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:05:18.394269+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:6833/2038440053":"2023-09-14T06:05:15.243374+0000","172.21.15.164:6832/2038440053":"2023-09-14T06:05:15.243374+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:19.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3035436419 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d34065b20 msgr2=0x7f2d34067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d34065b20 0x7f2d34067fe0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2d380079c0 tx=0x7f2d38008040 comp rx=0 tx=0).stop 2023-09-13T06:05:19.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3035436419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d480cdfc0 msgr2=0x7f2d48147500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d480cdfc0 0x7f2d48147500 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c01a170 tx=0x7f2d3c0192e0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3035436419 shutdown_connections 2023-09-13T06:05:19.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d34065b20 0x7f2d34067fe0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d48159f20 0x7f2d48070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d480cdfc0 0x7f2d48147500 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 --2- 172.21.15.130:0/3035436419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d480b1610 0x7f2d48149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3035436419 >> 172.21.15.130:0/3035436419 conn(0x7f2d48065990 msgr2=0x7f2d48158530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:19.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3035436419 shutdown_connections 2023-09-13T06:05:19.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.741+0000 7f2d4e27b640 1 -- 172.21.15.130:0/3035436419 wait complete. 2023-09-13T06:05:19.760 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:05:19.761 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:05:19.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f8936382640 1 Processor -- start 2023-09-13T06:05:19.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f8936382640 1 -- start start 2023-09-13T06:05:19.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f8936382640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f89300b1460 0x7f89300b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:19.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f8936382640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300cc850 con 0x7f893015a080 2023-09-13T06:05:19.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f8936382640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300b3420 con 0x7f89300b2fd0 2023-09-13T06:05:19.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f8936382640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89300b0330 con 0x7f89300b1460 2023-09-13T06:05:19.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f892f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f89300b1460 0x7f89300b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:19.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f892ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f893015a080 0x7f893015e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50780/0 (socket says 172.21.15.130:50780) 2023-09-13T06:05:19.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f892f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f89300b1460 0x7f89300b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59864/0 (socket says 172.21.15.130:59864) 2023-09-13T06:05:19.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f892ffff640 1 -- 172.21.15.130:0/3015045841 learned_addr learned my addr 172.21.15.130:0/3015045841 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:19.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f892f7fe640 1 -- 172.21.15.130:0/3015045841 >> v1:172.21.15.164:6789/0 conn(0x7f89300b2fd0 legacy=0x7f89300ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f892f7fe640 1 -- 172.21.15.130:0/3015045841 >> v1:172.21.15.130:6789/0 conn(0x7f893015a080 legacy=0x7f893015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.901+0000 7f892f7fe640 1 -- 172.21.15.130:0/3015045841 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300cbcd0 con 0x7f89300b1460 2023-09-13T06:05:19.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.905+0000 7f892f7fe640 1 --2- 172.21.15.130:0/3015045841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89300b1460 0x7f89300b2a90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f892400ba60 tx=0x7f892401ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b64cb845f4edbb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:19.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.905+0000 7f892effd640 1 -- 172.21.15.130:0/3015045841 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89240a7aa0 con 0x7f89300b1460 2023-09-13T06:05:19.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.905+0000 7f892effd640 1 -- 172.21.15.130:0/3015045841 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89240a7c00 con 0x7f89300b1460 2023-09-13T06:05:19.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.905+0000 7f892effd640 1 -- 172.21.15.130:0/3015045841 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89240af440 con 0x7f89300b1460 2023-09-13T06:05:19.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.905+0000 7f8936382640 1 -- 172.21.15.130:0/3015045841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89300b1460 msgr2=0x7f89300b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.905+0000 7f8936382640 1 --2- 172.21.15.130:0/3015045841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89300b1460 0x7f89300b2a90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f892400ba60 tx=0x7f892401ea60 comp rx=0 tx=0).stop 2023-09-13T06:05:19.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.905+0000 7f8936382640 1 -- 172.21.15.130:0/3015045841 shutdown_connections 2023-09-13T06:05:19.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.905+0000 7f8936382640 1 --2- 172.21.15.130:0/3015045841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89300b1460 0x7f89300b2a90 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.905+0000 7f8936382640 1 -- 172.21.15.130:0/3015045841 >> 172.21.15.130:0/3015045841 conn(0x7f8930065990 msgr2=0x7f8930065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:19.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.905+0000 7f8936382640 1 -- 172.21.15.130:0/3015045841 shutdown_connections 2023-09-13T06:05:19.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.905+0000 7f8936382640 1 -- 172.21.15.130:0/3015045841 wait complete. 2023-09-13T06:05:19.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f8936382640 1 Processor -- start 2023-09-13T06:05:19.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f8936382640 1 -- start start 2023-09-13T06:05:19.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f8936382640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89300b1460 0x7f893014f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:19.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f8936382640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89300b2fd0 0x7f8930153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:19.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f8936382640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f893015a080 0x7f893015cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:19.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f8936382640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893015c920 con 0x7f89300b2fd0 2023-09-13T06:05:19.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f8936382640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8930150880 con 0x7f893015a080 2023-09-13T06:05:19.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f8936382640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893015bca0 con 0x7f89300b1460 2023-09-13T06:05:19.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89300b2fd0 0x7f8930153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:19.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89300b2fd0 0x7f8930153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59878/0 (socket says 172.21.15.130:59878) 2023-09-13T06:05:19.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892f7fe640 1 -- 172.21.15.130:0/1739335871 learned_addr learned my addr 172.21.15.130:0/1739335871 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:19.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892ffff640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89300b1460 0x7f893014f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:19.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f893491f640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f893015a080 0x7f893015cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:19.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892f7fe640 1 -- 172.21.15.130:0/1739335871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89300b1460 msgr2=0x7f893014f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892f7fe640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89300b1460 0x7f893014f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892f7fe640 1 -- 172.21.15.130:0/1739335871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f893015a080 msgr2=0x7f893015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:19.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892f7fe640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f893015a080 0x7f893015cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:19.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892f7fe640 1 -- 172.21.15.130:0/1739335871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892400b6c0 con 0x7f89300b2fd0 2023-09-13T06:05:19.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892f7fe640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89300b2fd0 0x7f8930153ba0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f892401b670 tx=0x7f892401b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:19.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892cff9640 1 -- 172.21.15.130:0/1739335871 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89240b8660 con 0x7f89300b2fd0 2023-09-13T06:05:19.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892cff9640 1 -- 172.21.15.130:0/1739335871 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89240b87e0 con 0x7f89300b2fd0 2023-09-13T06:05:19.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f892cff9640 1 -- 172.21.15.130:0/1739335871 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89240b8b90 con 0x7f89300b2fd0 2023-09-13T06:05:19.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f8936382640 1 -- 172.21.15.130:0/1739335871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893015bf80 con 0x7f89300b2fd0 2023-09-13T06:05:19.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.909+0000 7f8936382640 1 -- 172.21.15.130:0/1739335871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893015c540 con 0x7f89300b2fd0 2023-09-13T06:05:19.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.913+0000 7f8936382640 1 -- 172.21.15.130:0/1739335871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893015ca60 con 0x7f89300b2fd0 2023-09-13T06:05:19.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.913+0000 7f892cff9640 1 -- 172.21.15.130:0/1739335871 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f89240b6070 con 0x7f89300b2fd0 2023-09-13T06:05:19.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.913+0000 7f892cff9640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f891c065b20 0x7f891c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:19.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.913+0000 7f892cff9640 1 -- 172.21.15.130:0/1739335871 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f892411e070 con 0x7f89300b2fd0 2023-09-13T06:05:19.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.913+0000 7f892ffff640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f891c065b20 0x7f891c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:19.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.913+0000 7f892ffff640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f891c065b20 0x7f891c067fe0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8920005890 tx=0x7f8920009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:19.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:19.917+0000 7f892cff9640 1 -- 172.21.15.130:0/1739335871 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f892414edb0 con 0x7f89300b2fd0 2023-09-13T06:05:20.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.069+0000 7f8936382640 1 -- 172.21.15.130:0/1739335871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89300618a0 con 0x7f89300b2fd0 2023-09-13T06:05:20.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.069+0000 7f892cff9640 1 -- 172.21.15.130:0/1739335871 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89240b4020 con 0x7f89300b2fd0 2023-09-13T06:05:20.073 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:05:20.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 -- 172.21.15.130:0/1739335871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f891c065b20 msgr2=0x7f891c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:20.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f891c065b20 0x7f891c067fe0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8920005890 tx=0x7f8920009040 comp rx=0 tx=0).stop 2023-09-13T06:05:20.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 -- 172.21.15.130:0/1739335871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89300b2fd0 msgr2=0x7f8930153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:20.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89300b2fd0 0x7f8930153ba0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f892401b670 tx=0x7f892401b800 comp rx=0 tx=0).stop 2023-09-13T06:05:20.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 -- 172.21.15.130:0/1739335871 shutdown_connections 2023-09-13T06:05:20.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f891c065b20 0x7f891c067fe0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:20.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f893015a080 0x7f893015cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:20.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89300b2fd0 0x7f8930153ba0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:20.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 --2- 172.21.15.130:0/1739335871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89300b1460 0x7f893014f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:20.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 -- 172.21.15.130:0/1739335871 >> 172.21.15.130:0/1739335871 conn(0x7f8930065990 msgr2=0x7f8930065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:20.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 -- 172.21.15.130:0/1739335871 shutdown_connections 2023-09-13T06:05:20.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.073+0000 7f8936382640 1 -- 172.21.15.130:0/1739335871 wait complete. 2023-09-13T06:05:20.094 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-09-13T06:05:20.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.229+0000 7f16baad8640 1 Processor -- start 2023-09-13T06:05:20.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.229+0000 7f16baad8640 1 -- start start 2023-09-13T06:05:20.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.229+0000 7f16baad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16b40cc780 0x7f16b415b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:20.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.229+0000 7f16baad8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f16b40b04a0 0x7f16b40b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:20.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.229+0000 7f16baad8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b40ccbe0 con 0x7f16b415b130 2023-09-13T06:05:20.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.229+0000 7f16baad8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b40b0e70 con 0x7f16b40b04a0 2023-09-13T06:05:20.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.229+0000 7f16baad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40ce980 con 0x7f16b40cc780 2023-09-13T06:05:20.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16abfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16b40cc780 0x7f16b415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:20.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16b9075640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f16b40b04a0 0x7f16b40b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:20.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16b9075640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f16b40b04a0 0x7f16b40b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:43384/0 (socket says 172.21.15.130:43384) 2023-09-13T06:05:20.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16b9075640 1 -- 172.21.15.130:0/801158593 learned_addr learned my addr 172.21.15.130:0/801158593 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:20.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16abfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16b40cc780 0x7f16b415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:40586/0 (socket says 172.21.15.130:40586) 2023-09-13T06:05:20.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16b9075640 1 -- 172.21.15.130:0/801158593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16b40cc780 msgr2=0x7f16b415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:20.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16b9075640 1 --2- 172.21.15.130:0/801158593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16b40cc780 0x7f16b415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:20.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16b9075640 1 -- 172.21.15.130:0/801158593 >> v1:172.21.15.164:6789/0 conn(0x7f16b415b130 legacy=0x7f16b40ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:20.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16b9075640 1 -- 172.21.15.130:0/801158593 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b40cec60 con 0x7f16b40b04a0 2023-09-13T06:05:20.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16b9075640 1 --2- 172.21.15.130:0/801158593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b40b04a0 0x7f16b40b0930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f16ac009e50 tx=0x7f16ac01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f800ac87087ec48c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:20.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16ab7fe640 1 -- 172.21.15.130:0/801158593 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac0a58a0 con 0x7f16b40b04a0 2023-09-13T06:05:20.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16ab7fe640 1 -- 172.21.15.130:0/801158593 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ac0a5a00 con 0x7f16b40b04a0 2023-09-13T06:05:20.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.233+0000 7f16ab7fe640 1 -- 172.21.15.130:0/801158593 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac0a5d90 con 0x7f16b40b04a0 2023-09-13T06:05:20.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 -- 172.21.15.130:0/801158593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b40b04a0 msgr2=0x7f16b40b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:20.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 --2- 172.21.15.130:0/801158593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b40b04a0 0x7f16b40b0930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f16ac009e50 tx=0x7f16ac01c9e0 comp rx=0 tx=0).stop 2023-09-13T06:05:20.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 -- 172.21.15.130:0/801158593 shutdown_connections 2023-09-13T06:05:20.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 --2- 172.21.15.130:0/801158593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b40b04a0 0x7f16b40b0930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:20.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 --2- 172.21.15.130:0/801158593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16b40cc780 0x7f16b415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:20.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 -- 172.21.15.130:0/801158593 >> 172.21.15.130:0/801158593 conn(0x7f16b4065990 msgr2=0x7f16b4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:20.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 -- 172.21.15.130:0/801158593 shutdown_connections 2023-09-13T06:05:20.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 -- 172.21.15.130:0/801158593 wait complete. 2023-09-13T06:05:20.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 Processor -- start 2023-09-13T06:05:20.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 -- start start 2023-09-13T06:05:20.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16b40b04a0 0x7f16b41517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:20.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b40cc780 0x7f16b41f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:20.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16b415b130 0x7f16b40ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:20.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b4150af0 con 0x7f16b40b04a0 2023-09-13T06:05:20.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b41f9580 con 0x7f16b40cc780 2023-09-13T06:05:20.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16baad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b406fbf0 con 0x7f16b415b130 2023-09-13T06:05:20.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16b8874640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16b40b04a0 0x7f16b41517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:20.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16b8874640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16b40b04a0 0x7f16b41517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59880/0 (socket says 172.21.15.130:59880) 2023-09-13T06:05:20.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16b8874640 1 -- 172.21.15.130:0/509020787 learned_addr learned my addr 172.21.15.130:0/509020787 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:20.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16abfff640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b40cc780 0x7f16b41f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:20.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.237+0000 7f16b9075640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16b415b130 0x7f16b40ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:20.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16b8874640 1 -- 172.21.15.130:0/509020787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16b415b130 msgr2=0x7f16b40ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:20.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16b8874640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16b415b130 0x7f16b40ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:20.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16b8874640 1 -- 172.21.15.130:0/509020787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b40cc780 msgr2=0x7f16b41f9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:20.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16b8874640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b40cc780 0x7f16b41f9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:20.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16b8874640 1 -- 172.21.15.130:0/509020787 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac009b30 con 0x7f16b40b04a0 2023-09-13T06:05:20.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16b8874640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16b40b04a0 0x7f16b41517a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f16b000c3c0 tx=0x7f16b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:20.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16a97fa640 1 -- 172.21.15.130:0/509020787 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b00052d0 con 0x7f16b40b04a0 2023-09-13T06:05:20.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16a97fa640 1 -- 172.21.15.130:0/509020787 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b0005430 con 0x7f16b40b04a0 2023-09-13T06:05:20.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16a97fa640 1 -- 172.21.15.130:0/509020787 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0003840 con 0x7f16b40b04a0 2023-09-13T06:05:20.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16baad8640 1 -- 172.21.15.130:0/509020787 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b406f670 con 0x7f16b40b04a0 2023-09-13T06:05:20.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16baad8640 1 -- 172.21.15.130:0/509020787 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b406f910 con 0x7f16b40b04a0 2023-09-13T06:05:20.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16baad8640 1 -- 172.21.15.130:0/509020787 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b40618a0 con 0x7f16b40b04a0 2023-09-13T06:05:20.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16a97fa640 1 -- 172.21.15.130:0/509020787 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f16b00039a0 con 0x7f16b40b04a0 2023-09-13T06:05:20.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16a97fa640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f16a0065b20 0x7f16a0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:20.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16a97fa640 1 -- 172.21.15.130:0/509020787 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f16b00824e0 con 0x7f16b40b04a0 2023-09-13T06:05:20.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.241+0000 7f16abfff640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f16a0065b20 0x7f16a0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:20.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.245+0000 7f16abfff640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f16a0065b20 0x7f16a0067fe0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f16b40ce7e0 tx=0x7f16a4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:20.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.245+0000 7f16a97fa640 1 -- 172.21.15.130:0/509020787 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f16b0050140 con 0x7f16b40b04a0 2023-09-13T06:05:20.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:20.449+0000 7f16baad8640 1 -- 172.21.15.130:0/509020787 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f16b40ce530 con 0x7f16b40b04a0 2023-09-13T06:05:21.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.413+0000 7f16a97fa640 1 -- 172.21.15.130:0/509020787 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v218) v1 ==== 136+0+0 (secure 0 0 0) 0x7f16b0053760 con 0x7f16b40b04a0 2023-09-13T06:05:21.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 -- 172.21.15.130:0/509020787 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f16a0065b20 msgr2=0x7f16a0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:21.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f16a0065b20 0x7f16a0067fe0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f16b40ce7e0 tx=0x7f16a4009190 comp rx=0 tx=0).stop 2023-09-13T06:05:21.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 -- 172.21.15.130:0/509020787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16b40b04a0 msgr2=0x7f16b41517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:21.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16b40b04a0 0x7f16b41517a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f16b000c3c0 tx=0x7f16b000c880 comp rx=0 tx=0).stop 2023-09-13T06:05:21.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 -- 172.21.15.130:0/509020787 shutdown_connections 2023-09-13T06:05:21.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f16a0065b20 0x7f16a0067fe0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16b40cc780 0x7f16b41f9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16b415b130 0x7f16b40ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 --2- 172.21.15.130:0/509020787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16b40b04a0 0x7f16b41517a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 -- 172.21.15.130:0/509020787 >> 172.21.15.130:0/509020787 conn(0x7f16b4065990 msgr2=0x7f16b40b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:21.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 -- 172.21.15.130:0/509020787 shutdown_connections 2023-09-13T06:05:21.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.417+0000 7f16baad8640 1 -- 172.21.15.130:0/509020787 wait complete. 2023-09-13T06:05:21.442 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-09-13T06:05:21.601 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_objectstore":"memstore"} 2023-09-13T06:05:21.602 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-09-13T06:05:21.602 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-13T06:05:21.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11fe93640 1 Processor -- start 2023-09-13T06:05:21.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11fe93640 1 -- start start 2023-09-13T06:05:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11fe93640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa1180cca50 0x7fa1180ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11fe93640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa1180ce6c0 0x7fa118161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11fe93640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1180b2620 con 0x7fa1181617f0 2023-09-13T06:05:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11fe93640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1180b1a80 con 0x7fa1180ce6c0 2023-09-13T06:05:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11fe93640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1180b2ab0 con 0x7fa1180cca50 2023-09-13T06:05:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11e430640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa1180ce6c0 0x7fa118161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11e430640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa1180ce6c0 0x7fa118161bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54500/0 (socket says 172.21.15.130:54500) 2023-09-13T06:05:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11e430640 1 -- 172.21.15.130:0/3088595656 learned_addr learned my addr 172.21.15.130:0/3088595656 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11d42e640 1 --2- 172.21.15.130:0/3088595656 >> v2:172.21.15.164:3300/0 conn(0x7fa1180cca50 0x7fa1180ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:21.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11e430640 1 -- 172.21.15.130:0/3088595656 >> v2:172.21.15.164:3300/0 conn(0x7fa1180cca50 msgr2=0x7fa1180ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:21.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11e430640 1 --2- 172.21.15.130:0/3088595656 >> v2:172.21.15.164:3300/0 conn(0x7fa1180cca50 0x7fa1180ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11e430640 1 -- 172.21.15.130:0/3088595656 >> v1:172.21.15.164:6789/0 conn(0x7fa1181617f0 legacy=0x7fa1180cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:21.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11e430640 1 -- 172.21.15.130:0/3088595656 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1180b1cf0 con 0x7fa1180ce6c0 2023-09-13T06:05:21.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.741+0000 7fa11d42e640 1 --2- 172.21.15.130:0/3088595656 >> v2:172.21.15.164:3300/0 conn(0x7fa1180cca50 0x7fa1180ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:21.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11e430640 1 --2- 172.21.15.130:0/3088595656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1180ce6c0 0x7fa118161bd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa1180ceeb0 tx=0x7fa11001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e6dad156b8124 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:21.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11cc2d640 1 -- 172.21.15.130:0/3088595656 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1100a5860 con 0x7fa1180ce6c0 2023-09-13T06:05:21.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11cc2d640 1 -- 172.21.15.130:0/3088595656 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1100a59c0 con 0x7fa1180ce6c0 2023-09-13T06:05:21.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11cc2d640 1 -- 172.21.15.130:0/3088595656 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1100a5d50 con 0x7fa1180ce6c0 2023-09-13T06:05:21.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11fe93640 1 -- 172.21.15.130:0/3088595656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1180ce6c0 msgr2=0x7fa118161bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:21.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11fe93640 1 --2- 172.21.15.130:0/3088595656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1180ce6c0 0x7fa118161bd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa1180ceeb0 tx=0x7fa11001c9a0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11fe93640 1 -- 172.21.15.130:0/3088595656 shutdown_connections 2023-09-13T06:05:21.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11fe93640 1 --2- 172.21.15.130:0/3088595656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1180ce6c0 0x7fa118161bd0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11fe93640 1 --2- 172.21.15.130:0/3088595656 >> v2:172.21.15.164:3300/0 conn(0x7fa1180cca50 0x7fa1180ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11fe93640 1 -- 172.21.15.130:0/3088595656 >> 172.21.15.130:0/3088595656 conn(0x7fa118065990 msgr2=0x7fa118065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:21.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11fe93640 1 -- 172.21.15.130:0/3088595656 shutdown_connections 2023-09-13T06:05:21.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.745+0000 7fa11fe93640 1 -- 172.21.15.130:0/3088595656 wait complete. 2023-09-13T06:05:21.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11fe93640 1 Processor -- start 2023-09-13T06:05:21.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11fe93640 1 -- start start 2023-09-13T06:05:21.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11fe93640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1180cca50 0x7fa118153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:21.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11fe93640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1180ce6c0 0x7fa11806b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:21.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11fe93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1181617f0 0x7fa1181410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:21.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11fe93640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11806b9a0 con 0x7fa1181617f0 2023-09-13T06:05:21.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11fe93640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa118141600 con 0x7fa1180cca50 2023-09-13T06:05:21.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11fe93640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa118153cf0 con 0x7fa1180ce6c0 2023-09-13T06:05:21.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11e430640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1181617f0 0x7fa1181410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:21.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11e430640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1181617f0 0x7fa1181410c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54510/0 (socket says 172.21.15.130:54510) 2023-09-13T06:05:21.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11e430640 1 -- 172.21.15.130:0/2584680188 learned_addr learned my addr 172.21.15.130:0/2584680188 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:21.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11d42e640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1180ce6c0 0x7fa11806b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:21.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11dc2f640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1180cca50 0x7fa118153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:21.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11e430640 1 -- 172.21.15.130:0/2584680188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1180ce6c0 msgr2=0x7fa11806b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:21.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11e430640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1180ce6c0 0x7fa11806b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11e430640 1 -- 172.21.15.130:0/2584680188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1180cca50 msgr2=0x7fa118153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:21.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11e430640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1180cca50 0x7fa118153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11e430640 1 -- 172.21.15.130:0/2584680188 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110009b30 con 0x7fa1181617f0 2023-09-13T06:05:21.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11dc2f640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1180cca50 0x7fa118153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:21.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11e430640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1181617f0 0x7fa1181410c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa1100af040 tx=0x7fa110019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:21.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa10e7fc640 1 -- 172.21.15.130:0/2584680188 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1100b8670 con 0x7fa1181617f0 2023-09-13T06:05:21.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa10e7fc640 1 -- 172.21.15.130:0/2584680188 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1100b8810 con 0x7fa1181617f0 2023-09-13T06:05:21.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa10e7fc640 1 -- 172.21.15.130:0/2584680188 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1100b8bc0 con 0x7fa1181617f0 2023-09-13T06:05:21.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.749+0000 7fa11fe93640 1 -- 172.21.15.130:0/2584680188 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa118153fd0 con 0x7fa1181617f0 2023-09-13T06:05:21.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.753+0000 7fa11fe93640 1 -- 172.21.15.130:0/2584680188 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa118154590 con 0x7fa1181617f0 2023-09-13T06:05:21.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.753+0000 7fa11fe93640 1 -- 172.21.15.130:0/2584680188 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1180618a0 con 0x7fa1181617f0 2023-09-13T06:05:21.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.753+0000 7fa10e7fc640 1 -- 172.21.15.130:0/2584680188 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa1100b8d20 con 0x7fa1181617f0 2023-09-13T06:05:21.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.753+0000 7fa10e7fc640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa0fc065b20 0x7fa0fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:21.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.753+0000 7fa10e7fc640 1 -- 172.21.15.130:0/2584680188 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa11011e5c0 con 0x7fa1181617f0 2023-09-13T06:05:21.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.753+0000 7fa11dc2f640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa0fc065b20 0x7fa0fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:21.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.753+0000 7fa11dc2f640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa0fc065b20 0x7fa0fc067fe0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa114000f70 tx=0x7fa114009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:21.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.757+0000 7fa10e7fc640 1 -- 172.21.15.130:0/2584680188 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa1100ec220 con 0x7fa1181617f0 2023-09-13T06:05:21.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.909+0000 7fa11fe93640 1 -- 172.21.15.130:0/2584680188 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa1180b07d0 con 0x7fa1181617f0 2023-09-13T06:05:21.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa10e7fc640 1 -- 172.21.15.130:0/2584680188 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa1100ef840 con 0x7fa1181617f0 2023-09-13T06:05:21.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 -- 172.21.15.130:0/2584680188 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa0fc065b20 msgr2=0x7fa0fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa0fc065b20 0x7fa0fc067fe0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa114000f70 tx=0x7fa114009040 comp rx=0 tx=0).stop 2023-09-13T06:05:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 -- 172.21.15.130:0/2584680188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1181617f0 msgr2=0x7fa1181410c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1181617f0 0x7fa1181410c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa1100af040 tx=0x7fa110019740 comp rx=0 tx=0).stop 2023-09-13T06:05:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 -- 172.21.15.130:0/2584680188 shutdown_connections 2023-09-13T06:05:21.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa0fc065b20 0x7fa0fc067fe0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1181617f0 0x7fa1181410c0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1180ce6c0 0x7fa11806b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 --2- 172.21.15.130:0/2584680188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1180cca50 0x7fa118153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:21.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 -- 172.21.15.130:0/2584680188 >> 172.21.15.130:0/2584680188 conn(0x7fa118065990 msgr2=0x7fa11815a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:21.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 -- 172.21.15.130:0/2584680188 shutdown_connections 2023-09-13T06:05:21.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:21.913+0000 7fa11fe93640 1 -- 172.21.15.130:0/2584680188 wait complete. 2023-09-13T06:05:21.935 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:05:21.936 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:05:22.008 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:05:22.074 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:05:22.075 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:05:22.075 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:22.084 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:05:22.085 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:05:22.085 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:22.094 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:05:22.095 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:05:22.095 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:22.133 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:05:22.134 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:05:22.134 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:22.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:05:22.151 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-13T06:05:22.152 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:05:22.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53b0f9f640 1 Processor -- start 2023-09-13T06:05:22.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53b0f9f640 1 -- start start 2023-09-13T06:05:22.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53b0f9f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac0cc780 0x7f53ac15b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53b0f9f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac0ccbe0 con 0x7f53ac15b130 2023-09-13T06:05:22.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53b0f9f640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac0ce980 con 0x7f53ac0b04a0 2023-09-13T06:05:22.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53b0f9f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0cec60 con 0x7f53ac0cc780 2023-09-13T06:05:22.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53aa59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f53ac15b130 0x7f53ac0ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39608/0 (socket says 172.21.15.130:39608) 2023-09-13T06:05:22.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53aa59c640 1 -- 172.21.15.130:0/2475617471 learned_addr learned my addr 172.21.15.130:0/2475617471 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:22.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a9d9b640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac0cc780 0x7f53ac15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651554704 0 0) 0x7f53ac0ccbe0 con 0x7f53ac15b130 2023-09-13T06:05:22.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5394003530 con 0x7f53ac15b130 2023-09-13T06:05:22.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057382563 0 0) 0x7f53ac0ce980 con 0x7f53ac0b04a0 2023-09-13T06:05:22.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53ac0ccbe0 con 0x7f53ac0b04a0 2023-09-13T06:05:22.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2511942972 0 0) 0x7f5394003530 con 0x7f53ac15b130 2023-09-13T06:05:22.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac0cc780 msgr2=0x7f53ac15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:22.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac0cc780 0x7f53ac15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 >> v1:172.21.15.164:6789/0 conn(0x7f53ac0b04a0 legacy=0x7f53ac06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac06c640 con 0x7f53ac15b130 2023-09-13T06:05:22.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f539c001680 con 0x7f53ac15b130 2023-09-13T06:05:22.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 >> v1:172.21.15.130:6789/0 conn(0x7f53ac15b130 legacy=0x7f53ac0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac0cc780 0x7f5394003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5394004160 0x7f53940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 0x7f5394005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0cec60 con 0x7f5394004d10 2023-09-13T06:05:22.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539400bb20 con 0x7f5394004160 2023-09-13T06:05:22.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539400bce0 con 0x7f53ac0cc780 2023-09-13T06:05:22.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53aad9d640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 0x7f5394005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53aa59c640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac0cc780 0x7f5394003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53a9d9b640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5394004160 0x7f53940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53aad9d640 1 -- 172.21.15.130:0/2475617471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac0cc780 msgr2=0x7f5394003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:22.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53aad9d640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac0cc780 0x7f5394003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53aad9d640 1 -- 172.21.15.130:0/2475617471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5394004160 msgr2=0x7f53940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:22.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53aad9d640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5394004160 0x7f53940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.313+0000 7f53aad9d640 1 -- 172.21.15.130:0/2475617471 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5394003530 con 0x7f5394004d10 2023-09-13T06:05:22.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.317+0000 7f53aad9d640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 0x7f5394005190 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f53a4001fd0 tx=0x7f53a401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb7d8e5bf24d3dc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:22.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.317+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a4003b80 con 0x7f5394004d10 2023-09-13T06:05:22.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.317+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a4003d00 con 0x7f5394004d10 2023-09-13T06:05:22.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.317+0000 7f53a959a640 1 -- 172.21.15.130:0/2475617471 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a4005310 con 0x7f5394004d10 2023-09-13T06:05:22.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.317+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2475617471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 msgr2=0x7f5394005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.317+0000 7f53b0f9f640 1 --2- 172.21.15.130:0/2475617471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 0x7f5394005190 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f53a4001fd0 tx=0x7f53a401c8e0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.317+0000 7f53aad9d640 1 -- 172.21.15.130:0/2475617471 reap_dead start 2023-09-13T06:05:22.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.317+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2475617471 shutdown_connections 2023-09-13T06:05:22.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.317+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2475617471 >> 172.21.15.130:0/2475617471 conn(0x7f53ac065990 msgr2=0x7f53ac065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:22.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.317+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2475617471 shutdown_connections 2023-09-13T06:05:22.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.317+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2475617471 wait complete. 2023-09-13T06:05:22.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53b0f9f640 1 Processor -- start 2023-09-13T06:05:22.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53b0f9f640 1 -- start start 2023-09-13T06:05:22.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53b0f9f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 0x7f53ac156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53b0f9f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53ac146c60 0x7f53ac154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53b0f9f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac158980 0x7f53ac158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53b0f9f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac159340 con 0x7f5394004d10 2023-09-13T06:05:22.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53b0f9f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac155510 con 0x7f53ac146c60 2023-09-13T06:05:22.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53b0f9f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac1470e0 con 0x7f53ac158980 2023-09-13T06:05:22.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53aa59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 0x7f53ac156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53aa59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 0x7f53ac156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54520/0 (socket says 172.21.15.130:54520) 2023-09-13T06:05:22.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53aa59c640 1 -- 172.21.15.130:0/2637397292 learned_addr learned my addr 172.21.15.130:0/2637397292 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:22.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53aad9d640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac158980 0x7f53ac158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53a9d9b640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53ac146c60 0x7f53ac154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53aa59c640 1 -- 172.21.15.130:0/2637397292 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac158980 msgr2=0x7f53ac158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53aa59c640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac158980 0x7f53ac158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53aa59c640 1 -- 172.21.15.130:0/2637397292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53ac146c60 msgr2=0x7f53ac154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53aa59c640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53ac146c60 0x7f53ac154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53aa59c640 1 -- 172.21.15.130:0/2637397292 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac155770 con 0x7f5394004d10 2023-09-13T06:05:22.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53a9d9b640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53ac146c60 0x7f53ac154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:22.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53aa59c640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 0x7f53ac156fa0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f539c0124c0 tx=0x7f539c012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:22.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f539affd640 1 -- 172.21.15.130:0/2637397292 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c014810 con 0x7f5394004d10 2023-09-13T06:05:22.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f539affd640 1 -- 172.21.15.130:0/2637397292 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c014970 con 0x7f5394004d10 2023-09-13T06:05:22.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2637397292 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac155a50 con 0x7f5394004d10 2023-09-13T06:05:22.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f539affd640 1 -- 172.21.15.130:0/2637397292 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c014d20 con 0x7f5394004d10 2023-09-13T06:05:22.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.321+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2637397292 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac156010 con 0x7f5394004d10 2023-09-13T06:05:22.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.325+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2637397292 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac0618a0 con 0x7f5394004d10 2023-09-13T06:05:22.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.325+0000 7f539affd640 1 -- 172.21.15.130:0/2637397292 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f539c0153e0 con 0x7f5394004d10 2023-09-13T06:05:22.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.325+0000 7f539affd640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 0x7f538c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.325+0000 7f539affd640 1 -- 172.21.15.130:0/2637397292 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f539c085ca0 con 0x7f5394004d10 2023-09-13T06:05:22.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.325+0000 7f53a9d9b640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 0x7f538c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.325+0000 7f53a9d9b640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 0x7f538c067fe0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f53ac1596b0 tx=0x7f53a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:22.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.329+0000 7f539affd640 1 -- 172.21.15.130:0/2637397292 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f539c0538f0 con 0x7f5394004d10 2023-09-13T06:05:22.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.509+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2637397292 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53ac15e160 con 0x7f5394004d10 2023-09-13T06:05:22.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.509+0000 7f539affd640 1 -- 172.21.15.130:0/2637397292 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f539c01c020 con 0x7f5394004d10 2023-09-13T06:05:22.513 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:22.513 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1338889971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1338889971},{"type":"v1","addr":"172.21.15.164:6835","nonce":1338889971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":5603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/442316078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":442316078},{"type":"v1","addr":"172.21.15.164:6833","nonce":442316078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":6072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1298091712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1298091712},{"type":"v1","addr":"172.21.15.130:6835","nonce":1298091712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/798128577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":798128577},{"type":"v1","addr":"172.21.15.130:6837","nonce":798128577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[]} 2023-09-13T06:05:22.514 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 36 2023-09-13T06:05:22.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2637397292 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 msgr2=0x7f538c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 0x7f538c067fe0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f53ac1596b0 tx=0x7f53a0008040 comp rx=0 tx=0).stop 2023-09-13T06:05:22.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2637397292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 msgr2=0x7f53ac156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 0x7f53ac156fa0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f539c0124c0 tx=0x7f539c012980 comp rx=0 tx=0).stop 2023-09-13T06:05:22.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2637397292 shutdown_connections 2023-09-13T06:05:22.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 0x7f538c067fe0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53ac146c60 0x7f53ac154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53ac158980 0x7f53ac158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 --2- 172.21.15.130:0/2637397292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394004d10 0x7f53ac156fa0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2637397292 >> 172.21.15.130:0/2637397292 conn(0x7f53ac065990 msgr2=0x7f53ac15a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:22.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2637397292 shutdown_connections 2023-09-13T06:05:22.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.513+0000 7f53b0f9f640 1 -- 172.21.15.130:0/2637397292 wait complete. 2023-09-13T06:05:22.533 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T06:05:22.534 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-13T06:05:22.534 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T06:05:22.534 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:05:22.535 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T06:05:22.535 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-13T06:05:22.535 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T06:05:22.536 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:05:22.536 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T06:05:22.536 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-13T06:05:22.536 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T06:05:22.537 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:05:22.537 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T06:05:22.537 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-13T06:05:22.537 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T06:05:22.538 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:05:22.547 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T06:05:22.547 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T06:05:22.549 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T06:05:22.549 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T06:05:22.551 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T06:05:22.552 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T06:05:22.552 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T06:05:22.553 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T06:05:22.599 INFO:tasks.ceph.mds.a:Started 2023-09-13T06:05:22.600 DEBUG:teuthology.parallel:result is None 2023-09-13T06:05:22.602 INFO:tasks.ceph.mds.c:Started 2023-09-13T06:05:22.602 DEBUG:teuthology.parallel:result is None 2023-09-13T06:05:22.604 INFO:tasks.ceph.mds.b:Started 2023-09-13T06:05:22.604 DEBUG:teuthology.parallel:result is None 2023-09-13T06:05:22.606 INFO:tasks.ceph.mds.d:Started 2023-09-13T06:05:22.606 DEBUG:teuthology.parallel:result is None 2023-09-13T06:05:22.607 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-13T06:05:22.690 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:05:22.691 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:05:22.696 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:05:22.696 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:05:22.698 INFO:tasks.ceph.mds.b.smithi164.stderr:2023-09-13T06:05:22.694+0000 7f2509f73640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-09-13T06:05:22.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.749+0000 7f5447b67640 1 Processor -- start 2023-09-13T06:05:22.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.749+0000 7f5447b67640 1 -- start start 2023-09-13T06:05:22.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5447b67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5440146f30 0x7f544015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5447b67640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54400b63c0 con 0x7f54400d1750 2023-09-13T06:05:22.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5447b67640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54400d0c20 con 0x7f54400d1090 2023-09-13T06:05:22.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5447b67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544015dea0 con 0x7f5440146f30 2023-09-13T06:05:22.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5445903640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f54400d1750 0x7f5440146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39636/0 (socket says 172.21.15.130:39636) 2023-09-13T06:05:22.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5445903640 1 -- 172.21.15.130:0/2791838519 learned_addr learned my addr 172.21.15.130:0/2791838519 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:22.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5446104640 1 --2- 172.21.15.130:0/2791838519 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5440146f30 0x7f544015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5444901640 1 -- 172.21.15.130:0/2791838519 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446865972 0 0) 0x7f54400b63c0 con 0x7f54400d1750 2023-09-13T06:05:22.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5444901640 1 -- 172.21.15.130:0/2791838519 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f542c003530 con 0x7f54400d1750 2023-09-13T06:05:22.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5444901640 1 -- 172.21.15.130:0/2791838519 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590982916 0 0) 0x7f54400d0c20 con 0x7f54400d1090 2023-09-13T06:05:22.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5444901640 1 -- 172.21.15.130:0/2791838519 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54400b63c0 con 0x7f54400d1090 2023-09-13T06:05:22.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5446104640 1 -- 172.21.15.130:0/2791838519 >> v1:172.21.15.164:6789/0 conn(0x7f54400d1090 legacy=0x7f54400b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5446104640 1 -- 172.21.15.130:0/2791838519 >> v1:172.21.15.130:6789/0 conn(0x7f54400d1750 legacy=0x7f5440146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.753+0000 7f5446104640 1 -- 172.21.15.130:0/2791838519 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400b6610 con 0x7f5440146f30 2023-09-13T06:05:22.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5446104640 1 --2- 172.21.15.130:0/2791838519 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5440146f30 0x7f544015d960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5438009dc0 tx=0x7f543801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=170415f4be6b1115 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:22.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5444901640 1 -- 172.21.15.130:0/2791838519 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54380a5a00 con 0x7f5440146f30 2023-09-13T06:05:22.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5444901640 1 -- 172.21.15.130:0/2791838519 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54380a5b60 con 0x7f5440146f30 2023-09-13T06:05:22.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5444901640 1 -- 172.21.15.130:0/2791838519 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54380ad440 con 0x7f5440146f30 2023-09-13T06:05:22.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5447b67640 1 -- 172.21.15.130:0/2791838519 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5440146f30 msgr2=0x7f544015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5447b67640 1 --2- 172.21.15.130:0/2791838519 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5440146f30 0x7f544015d960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5438009dc0 tx=0x7f543801c940 comp rx=0 tx=0).stop 2023-09-13T06:05:22.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5447b67640 1 -- 172.21.15.130:0/2791838519 shutdown_connections 2023-09-13T06:05:22.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5447b67640 1 --2- 172.21.15.130:0/2791838519 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5440146f30 0x7f544015d960 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5447b67640 1 -- 172.21.15.130:0/2791838519 >> 172.21.15.130:0/2791838519 conn(0x7f544006f170 msgr2=0x7f544006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5447b67640 1 -- 172.21.15.130:0/2791838519 shutdown_connections 2023-09-13T06:05:22.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5447b67640 1 -- 172.21.15.130:0/2791838519 wait complete. 2023-09-13T06:05:22.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5447b67640 1 Processor -- start 2023-09-13T06:05:22.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.757+0000 7f5447b67640 1 -- start start 2023-09-13T06:05:22.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5447b67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54400d1090 0x7f544013d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5447b67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54400d1750 0x7f544013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5447b67640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5440146f30 0x7f5440142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5447b67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544013f250 con 0x7f54400d1750 2023-09-13T06:05:22.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5447b67640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544013f4d0 con 0x7f5440146f30 2023-09-13T06:05:22.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5447b67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544013f7b0 con 0x7f54400d1090 2023-09-13T06:05:22.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5445102640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54400d1750 0x7f544013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5445102640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54400d1750 0x7f544013ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54552/0 (socket says 172.21.15.130:54552) 2023-09-13T06:05:22.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5445102640 1 -- 172.21.15.130:0/235033879 learned_addr learned my addr 172.21.15.130:0/235033879 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:22.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5445903640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54400d1090 0x7f544013d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5446104640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5440146f30 0x7f5440142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5445102640 1 -- 172.21.15.130:0/235033879 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54400d1090 msgr2=0x7f544013d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5445102640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54400d1090 0x7f544013d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5445102640 1 -- 172.21.15.130:0/235033879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5440146f30 msgr2=0x7f5440142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:22.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5445102640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5440146f30 0x7f5440142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:22.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5445102640 1 -- 172.21.15.130:0/235033879 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438009a70 con 0x7f54400d1750 2023-09-13T06:05:22.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5446104640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5440146f30 0x7f5440142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:22.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5445102640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54400d1750 0x7f544013ed10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f543000c500 tx=0x7f543000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:22.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f54367fc640 1 -- 172.21.15.130:0/235033879 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54300052d0 con 0x7f54400d1750 2023-09-13T06:05:22.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f54367fc640 1 -- 172.21.15.130:0/235033879 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5430005430 con 0x7f54400d1750 2023-09-13T06:05:22.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f54367fc640 1 -- 172.21.15.130:0/235033879 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430012870 con 0x7f54400d1750 2023-09-13T06:05:22.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5447b67640 1 -- 172.21.15.130:0/235033879 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544013fa90 con 0x7f54400d1750 2023-09-13T06:05:22.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5447b67640 1 -- 172.21.15.130:0/235033879 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5440140050 con 0x7f54400d1750 2023-09-13T06:05:22.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f5447b67640 1 -- 172.21.15.130:0/235033879 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5440140240 con 0x7f54400d1750 2023-09-13T06:05:22.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.761+0000 7f54367fc640 1 -- 172.21.15.130:0/235033879 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f54300129d0 con 0x7f54400d1750 2023-09-13T06:05:22.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.765+0000 7f54367fc640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5424065b50 0x7f5424068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:22.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.765+0000 7f54367fc640 1 -- 172.21.15.130:0/235033879 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5430082c00 con 0x7f54400d1750 2023-09-13T06:05:22.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.765+0000 7f5445903640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5424065b50 0x7f5424068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:22.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.765+0000 7f5445903640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5424065b50 0x7f5424068010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f543c000f70 tx=0x7f543c007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:22.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.769+0000 7f54367fc640 1 -- 172.21.15.130:0/235033879 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f54300507c0 con 0x7f54400d1750 2023-09-13T06:05:22.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:22.925+0000 7f5447b67640 1 -- 172.21.15.130:0/235033879 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f54400618a0 con 0x7f54400d1750 2023-09-13T06:05:23.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f54367fc640 1 -- 172.21.15.130:0/235033879 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5430053de0 con 0x7f54400d1750 2023-09-13T06:05:23.437 INFO:teuthology.orchestra.run.smithi130.stderr: removed all blocklist entries 2023-09-13T06:05:23.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 -- 172.21.15.130:0/235033879 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5424065b50 msgr2=0x7f5424068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:23.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5424065b50 0x7f5424068010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f543c000f70 tx=0x7f543c007d40 comp rx=0 tx=0).stop 2023-09-13T06:05:23.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 -- 172.21.15.130:0/235033879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54400d1750 msgr2=0x7f544013ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:23.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54400d1750 0x7f544013ed10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f543000c500 tx=0x7f543000c9c0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 -- 172.21.15.130:0/235033879 shutdown_connections 2023-09-13T06:05:23.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5424065b50 0x7f5424068010 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5440146f30 0x7f5440142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54400d1750 0x7f544013ed10 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 --2- 172.21.15.130:0/235033879 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54400d1090 0x7f544013d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 -- 172.21.15.130:0/235033879 >> 172.21.15.130:0/235033879 conn(0x7f544006f170 msgr2=0x7f54400cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:23.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 -- 172.21.15.130:0/235033879 shutdown_connections 2023-09-13T06:05:23.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.437+0000 7f5447b67640 1 -- 172.21.15.130:0/235033879 wait complete. 2023-09-13T06:05:23.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-13T06:05:23.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb33806d640 1 Processor -- start 2023-09-13T06:05:23.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb33806d640 1 -- start start 2023-09-13T06:05:23.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb33806d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb3300d1090 0x7fb33015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:23.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb33806d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3300b63c0 con 0x7fb330146f30 2023-09-13T06:05:23.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb33806d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3300d0c20 con 0x7fb3300d1750 2023-09-13T06:05:23.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb33806d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33015dea0 con 0x7fb3300d1090 2023-09-13T06:05:23.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb335608640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb3300d1090 0x7fb33015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:23.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb335608640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb3300d1090 0x7fb33015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54560/0 (socket says 172.21.15.130:54560) 2023-09-13T06:05:23.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb33660a640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb330146f30 0x7fb3300b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39648/0 (socket says 172.21.15.130:39648) 2023-09-13T06:05:23.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb335608640 1 -- 172.21.15.130:0/2215324803 learned_addr learned my addr 172.21.15.130:0/2215324803 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:23.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb335608640 1 -- 172.21.15.130:0/2215324803 >> v1:172.21.15.164:6789/0 conn(0x7fb3300d1750 legacy=0x7fb330146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:23.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb335608640 1 -- 172.21.15.130:0/2215324803 >> v1:172.21.15.130:6789/0 conn(0x7fb330146f30 legacy=0x7fb3300b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:23.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb335608640 1 -- 172.21.15.130:0/2215324803 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3300b6610 con 0x7fb3300d1090 2023-09-13T06:05:23.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.601+0000 7fb334e07640 1 -- 172.21.15.130:0/2215324803 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879046501 0 0) 0x7fb3300b63c0 con 0x7fb330146f30 2023-09-13T06:05:23.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.605+0000 7fb335608640 1 --2- 172.21.15.130:0/2215324803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3300d1090 0x7fb33015d960 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb320009870 tx=0x7fb32001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493ac6b6beae25f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:23.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.605+0000 7fb334e07640 1 -- 172.21.15.130:0/2215324803 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3200ab640 con 0x7fb3300d1090 2023-09-13T06:05:23.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.605+0000 7fb334e07640 1 -- 172.21.15.130:0/2215324803 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3200a7070 con 0x7fb3300d1090 2023-09-13T06:05:23.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.605+0000 7fb334e07640 1 -- 172.21.15.130:0/2215324803 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3200ab9c0 con 0x7fb3300d1090 2023-09-13T06:05:23.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.605+0000 7fb33806d640 1 -- 172.21.15.130:0/2215324803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3300d1090 msgr2=0x7fb33015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:23.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.605+0000 7fb33806d640 1 --2- 172.21.15.130:0/2215324803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3300d1090 0x7fb33015d960 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb320009870 tx=0x7fb32001c440 comp rx=0 tx=0).stop 2023-09-13T06:05:23.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.605+0000 7fb33806d640 1 -- 172.21.15.130:0/2215324803 shutdown_connections 2023-09-13T06:05:23.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.605+0000 7fb33806d640 1 --2- 172.21.15.130:0/2215324803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3300d1090 0x7fb33015d960 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.605+0000 7fb33806d640 1 -- 172.21.15.130:0/2215324803 >> 172.21.15.130:0/2215324803 conn(0x7fb33006f170 msgr2=0x7fb33006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:23.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.605+0000 7fb33806d640 1 -- 172.21.15.130:0/2215324803 shutdown_connections 2023-09-13T06:05:23.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.605+0000 7fb33806d640 1 -- 172.21.15.130:0/2215324803 wait complete. 2023-09-13T06:05:23.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33806d640 1 Processor -- start 2023-09-13T06:05:23.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33806d640 1 -- start start 2023-09-13T06:05:23.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33806d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3300d1090 0x7fb33013cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:23.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33806d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3300d1750 0x7fb33015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:23.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33806d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb330146f30 0x7fb33015e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:23.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33806d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3301451b0 con 0x7fb3300d1750 2023-09-13T06:05:23.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33806d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb330144110 con 0x7fb3300d1090 2023-09-13T06:05:23.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33806d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3301443f0 con 0x7fb330146f30 2023-09-13T06:05:23.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb335608640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3300d1750 0x7fb33015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:23.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb335608640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3300d1750 0x7fb33015dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54576/0 (socket says 172.21.15.130:54576) 2023-09-13T06:05:23.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb335608640 1 -- 172.21.15.130:0/2059413203 learned_addr learned my addr 172.21.15.130:0/2059413203 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:23.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb335e09640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3300d1090 0x7fb33013cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:23.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33660a640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb330146f30 0x7fb33015e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:23.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb335608640 1 -- 172.21.15.130:0/2059413203 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb330146f30 msgr2=0x7fb33015e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:23.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb335608640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb330146f30 0x7fb33015e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb335608640 1 -- 172.21.15.130:0/2059413203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3300d1090 msgr2=0x7fb33013cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:23.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb335608640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3300d1090 0x7fb33013cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb335608640 1 -- 172.21.15.130:0/2059413203 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3200094d0 con 0x7fb3300d1750 2023-09-13T06:05:23.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33660a640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb330146f30 0x7fb33015e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:23.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb335608640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3300d1750 0x7fb33015dff0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb3200ad040 tx=0x7fb32001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:23.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb3267fc640 1 -- 172.21.15.130:0/2059413203 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3200be5f0 con 0x7fb3300d1750 2023-09-13T06:05:23.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb3267fc640 1 -- 172.21.15.130:0/2059413203 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3200be750 con 0x7fb3300d1750 2023-09-13T06:05:23.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb3267fc640 1 -- 172.21.15.130:0/2059413203 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3200beb00 con 0x7fb3300d1750 2023-09-13T06:05:23.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33806d640 1 -- 172.21.15.130:0/2059413203 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3301446d0 con 0x7fb3300d1750 2023-09-13T06:05:23.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.609+0000 7fb33806d640 1 -- 172.21.15.130:0/2059413203 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb330144c90 con 0x7fb3300d1750 2023-09-13T06:05:23.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.613+0000 7fb33806d640 1 -- 172.21.15.130:0/2059413203 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb330144e80 con 0x7fb3300d1750 2023-09-13T06:05:23.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.613+0000 7fb3267fc640 1 -- 172.21.15.130:0/2059413203 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb3200b43f0 con 0x7fb3300d1750 2023-09-13T06:05:23.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.613+0000 7fb3267fc640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb314065b20 0x7fb314067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:23.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.613+0000 7fb3267fc640 1 -- 172.21.15.130:0/2059413203 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb32011d610 con 0x7fb3300d1750 2023-09-13T06:05:23.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.613+0000 7fb335e09640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb314065b20 0x7fb314067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:23.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.613+0000 7fb335e09640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb314065b20 0x7fb314067fe0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb32c004e30 tx=0x7fb32c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:23.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.617+0000 7fb3267fc640 1 -- 172.21.15.130:0/2059413203 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb3200eb2c0 con 0x7fb3300d1750 2023-09-13T06:05:23.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 -- 172.21.15.130:0/2059413203 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb3300618a0 con 0x7fb3300d1750 2023-09-13T06:05:23.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb3267fc640 1 -- 172.21.15.130:0/2059413203 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb3200ee8e0 con 0x7fb3300d1750 2023-09-13T06:05:23.819 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:23.819 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:05:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "auth_dump": [ 2023-09-13T06:05:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.a", 2023-09-13T06:05:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw==", 2023-09-13T06:05:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:05:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:05:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:05:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.821 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.b", 2023-09-13T06:05:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg==", 2023-09-13T06:05:23.822 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:05:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:05:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:05:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.c", 2023-09-13T06:05:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A==", 2023-09-13T06:05:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.824 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:05:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:05:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:05:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.d", 2023-09-13T06:05:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg==", 2023-09-13T06:05:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.826 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.0", 2023-09-13T06:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw==", 2023-09-13T06:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:05:23.828 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.1", 2023-09-13T06:05:23.829 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ==", 2023-09-13T06:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.830 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.2", 2023-09-13T06:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw==", 2023-09-13T06:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.831 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.3", 2023-09-13T06:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g==", 2023-09-13T06:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:05:23.833 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.4", 2023-09-13T06:05:23.834 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ==", 2023-09-13T06:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.835 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.5", 2023-09-13T06:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw==", 2023-09-13T06:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.836 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.837 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.6", 2023-09-13T06:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA==", 2023-09-13T06:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:05:23.838 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.7", 2023-09-13T06:05:23.839 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA==", 2023-09-13T06:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.0", 2023-09-13T06:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA==", 2023-09-13T06:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.841 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow r", 2023-09-13T06:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-13T06:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.1", 2023-09-13T06:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg==", 2023-09-13T06:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:05:23.843 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.844 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.2", 2023-09-13T06:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw==", 2023-09-13T06:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:05:23.845 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.846 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.3", 2023-09-13T06:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA==", 2023-09-13T06:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:05:23.847 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.admin", 2023-09-13T06:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQANUAFl5ccJOBAAP4KJItnG8vNd5OP/63ai0g==", 2023-09-13T06:05:23.848 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:05:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:05:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:05:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.849 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.x", 2023-09-13T06:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ==", 2023-09-13T06:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.850 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:05:23.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:23.852 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.y", 2023-09-13T06:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA==", 2023-09-13T06:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:05:23.853 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:05:23.854 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:05:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 -- 172.21.15.130:0/2059413203 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb314065b20 msgr2=0x7fb314067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb314065b20 0x7fb314067fe0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb32c004e30 tx=0x7fb32c009040 comp rx=0 tx=0).stop 2023-09-13T06:05:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 -- 172.21.15.130:0/2059413203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3300d1750 msgr2=0x7fb33015dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3300d1750 0x7fb33015dff0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb3200ad040 tx=0x7fb32001ac80 comp rx=0 tx=0).stop 2023-09-13T06:05:23.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 -- 172.21.15.130:0/2059413203 shutdown_connections 2023-09-13T06:05:23.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb314065b20 0x7fb314067fe0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb330146f30 0x7fb33015e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3300d1750 0x7fb33015dff0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 --2- 172.21.15.130:0/2059413203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3300d1090 0x7fb33013cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:23.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 -- 172.21.15.130:0/2059413203 >> 172.21.15.130:0/2059413203 conn(0x7fb33006f170 msgr2=0x7fb3300703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:23.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 -- 172.21.15.130:0/2059413203 shutdown_connections 2023-09-13T06:05:23.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.817+0000 7fb33806d640 1 -- 172.21.15.130:0/2059413203 wait complete. 2023-09-13T06:05:23.858 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:23.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.993+0000 7f760a14d640 1 Processor -- start 2023-09-13T06:05:23.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.993+0000 7f760a14d640 1 -- start start 2023-09-13T06:05:23.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f760a14d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f760415d5f0 0x7f76040cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:23.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f760a14d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f76040ae170 0x7f76040cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:23.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f760a14d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76040cce60 con 0x7f760415d9d0 2023-09-13T06:05:23.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f760a14d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76040cd140 con 0x7f76040ae170 2023-09-13T06:05:23.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f760a14d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76040cd420 con 0x7f760415d5f0 2023-09-13T06:05:23.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f76037fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f760415d5f0 0x7f76040cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:23.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f7602ffd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f76040ae170 0x7f76040cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:23.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f76037fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f760415d5f0 0x7f76040cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:33154/0 (socket says 172.21.15.130:33154) 2023-09-13T06:05:23.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f76037fe640 1 -- 172.21.15.130:0/2430289268 learned_addr learned my addr 172.21.15.130:0/2430289268 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:23.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f76037fe640 1 -- 172.21.15.130:0/2430289268 >> v2:172.21.15.164:3300/0 conn(0x7f76040ae170 msgr2=0x7f76040cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:23.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f76037fe640 1 --2- 172.21.15.130:0/2430289268 >> v2:172.21.15.164:3300/0 conn(0x7f76040ae170 0x7f76040cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f76037fe640 1 -- 172.21.15.130:0/2430289268 >> v1:172.21.15.164:6789/0 conn(0x7f760415d9d0 legacy=0x7f76041591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f76037fe640 1 -- 172.21.15.130:0/2430289268 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040cd700 con 0x7f760415d5f0 2023-09-13T06:05:24.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:23.997+0000 7f76037fe640 1 --2- 172.21.15.130:0/2430289268 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f760415d5f0 0x7f76040cc7f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f75f400aa10 tx=0x7f75f401d880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19cddcc9cdb8c95 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:24.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f76027fc640 1 -- 172.21.15.130:0/2430289268 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40a67e0 con 0x7f760415d5f0 2023-09-13T06:05:24.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f76027fc640 1 -- 172.21.15.130:0/2430289268 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f40a6940 con 0x7f760415d5f0 2023-09-13T06:05:24.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f76027fc640 1 -- 172.21.15.130:0/2430289268 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40a6cd0 con 0x7f760415d5f0 2023-09-13T06:05:24.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 -- 172.21.15.130:0/2430289268 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f760415d5f0 msgr2=0x7f76040cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 --2- 172.21.15.130:0/2430289268 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f760415d5f0 0x7f76040cc7f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f75f400aa10 tx=0x7f75f401d880 comp rx=0 tx=0).stop 2023-09-13T06:05:24.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 -- 172.21.15.130:0/2430289268 shutdown_connections 2023-09-13T06:05:24.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 --2- 172.21.15.130:0/2430289268 >> v2:172.21.15.164:3300/0 conn(0x7f76040ae170 0x7f76040cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 --2- 172.21.15.130:0/2430289268 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f760415d5f0 0x7f76040cc7f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 -- 172.21.15.130:0/2430289268 >> 172.21.15.130:0/2430289268 conn(0x7f7604065990 msgr2=0x7f7604065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:24.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 -- 172.21.15.130:0/2430289268 shutdown_connections 2023-09-13T06:05:24.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 -- 172.21.15.130:0/2430289268 wait complete. 2023-09-13T06:05:24.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 Processor -- start 2023-09-13T06:05:24.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 -- start start 2023-09-13T06:05:24.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f76040ae170 0x7f7604145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760415d5f0 0x7f760406f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f760415d9d0 0x7f760406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760414f310 con 0x7f760415d5f0 2023-09-13T06:05:24.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7604147b90 con 0x7f760415d9d0 2023-09-13T06:05:24.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.001+0000 7f760a14d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7604147e70 con 0x7f76040ae170 2023-09-13T06:05:24.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f7602ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760415d5f0 0x7f760406f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f7602ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760415d5f0 0x7f760406f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54586/0 (socket says 172.21.15.130:54586) 2023-09-13T06:05:24.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f7602ffd640 1 -- 172.21.15.130:0/134460204 learned_addr learned my addr 172.21.15.130:0/134460204 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:24.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f76037fe640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f76040ae170 0x7f7604145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f7603fff640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f760415d9d0 0x7f760406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f7602ffd640 1 -- 172.21.15.130:0/134460204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f76040ae170 msgr2=0x7f7604145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f7602ffd640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f76040ae170 0x7f7604145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f7602ffd640 1 -- 172.21.15.130:0/134460204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f760415d9d0 msgr2=0x7f760406fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f7602ffd640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f760415d9d0 0x7f760406fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f7602ffd640 1 -- 172.21.15.130:0/134460204 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f400a670 con 0x7f760415d5f0 2023-09-13T06:05:24.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f7602ffd640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760415d5f0 0x7f760406f8a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f75f800e900 tx=0x7f75f800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:24.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f75ebfff640 1 -- 172.21.15.130:0/134460204 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8009690 con 0x7f760415d5f0 2023-09-13T06:05:24.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f75ebfff640 1 -- 172.21.15.130:0/134460204 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f800ca00 con 0x7f760415d5f0 2023-09-13T06:05:24.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f75ebfff640 1 -- 172.21.15.130:0/134460204 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f800cdb0 con 0x7f760415d5f0 2023-09-13T06:05:24.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f760a14d640 1 -- 172.21.15.130:0/134460204 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7604148150 con 0x7f760415d5f0 2023-09-13T06:05:24.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f760a14d640 1 -- 172.21.15.130:0/134460204 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760415b640 con 0x7f760415d5f0 2023-09-13T06:05:24.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f760a14d640 1 -- 172.21.15.130:0/134460204 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760414f4c0 con 0x7f760415d5f0 2023-09-13T06:05:24.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.005+0000 7f75ebfff640 1 -- 172.21.15.130:0/134460204 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f75f8013470 con 0x7f760415d5f0 2023-09-13T06:05:24.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.009+0000 7f75ebfff640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75f0065b50 0x7f75f0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.009+0000 7f75ebfff640 1 -- 172.21.15.130:0/134460204 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f75f80831b0 con 0x7f760415d5f0 2023-09-13T06:05:24.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.009+0000 7f76037fe640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75f0065b50 0x7f75f0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.009+0000 7f76037fe640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75f0065b50 0x7f75f0068010 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f75f40b0000 tx=0x7f75f40a8070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:24.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.013+0000 7f75ebfff640 1 -- 172.21.15.130:0/134460204 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f760414f4c0 con 0x7f760415d5f0 2023-09-13T06:05:24.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.161+0000 7f760a14d640 1 -- 172.21.15.130:0/134460204 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76040618a0 con 0x7f760415d5f0 2023-09-13T06:05:24.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.161+0000 7f75ebfff640 1 -- 172.21.15.130:0/134460204 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+12893 (secure 0 0 0) 0x7f75f8050e70 con 0x7f760415d5f0 2023-09-13T06:05:24.164 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:24.165 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":79,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:05:23.447272+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:24.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 -- 172.21.15.130:0/134460204 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75f0065b50 msgr2=0x7f75f0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75f0065b50 0x7f75f0068010 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f75f40b0000 tx=0x7f75f40a8070 comp rx=0 tx=0).stop 2023-09-13T06:05:24.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 -- 172.21.15.130:0/134460204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760415d5f0 msgr2=0x7f760406f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760415d5f0 0x7f760406f8a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f75f800e900 tx=0x7f75f800edc0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 -- 172.21.15.130:0/134460204 shutdown_connections 2023-09-13T06:05:24.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75f0065b50 0x7f75f0068010 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f760415d9d0 0x7f760406fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760415d5f0 0x7f760406f8a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 --2- 172.21.15.130:0/134460204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f76040ae170 0x7f7604145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 -- 172.21.15.130:0/134460204 >> 172.21.15.130:0/134460204 conn(0x7f7604065990 msgr2=0x7f760406c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:24.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 -- 172.21.15.130:0/134460204 shutdown_connections 2023-09-13T06:05:24.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.165+0000 7f760a14d640 1 -- 172.21.15.130:0/134460204 wait complete. 2023-09-13T06:05:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:05:24.186 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:05:24.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.325+0000 7f8497dfa640 1 Processor -- start 2023-09-13T06:05:24.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.325+0000 7f8497dfa640 1 -- start start 2023-09-13T06:05:24.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.325+0000 7f8497dfa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8490144d70 0x7f84900ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.325+0000 7f8497dfa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84900b2780 0x7f84900b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.325+0000 7f8497dfa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f84900b1460 0x7f84900b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.325+0000 7f8497dfa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84900b2430 con 0x7f84900b1460 2023-09-13T06:05:24.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.325+0000 7f8497dfa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84900cedb0 con 0x7f8490144d70 2023-09-13T06:05:24.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.325+0000 7f8497dfa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84900b3120 con 0x7f84900b2780 2023-09-13T06:05:24.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.325+0000 7f8496397640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f84900b1460 0x7f84900b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.325+0000 7f8496397640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f84900b1460 0x7f84900b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54590/0 (socket says 172.21.15.130:54590) 2023-09-13T06:05:24.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.325+0000 7f8496397640 1 -- 172.21.15.130:0/1506817606 learned_addr learned my addr 172.21.15.130:0/1506817606 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:24.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8495b96640 1 --2- 172.21.15.130:0/1506817606 >> v2:172.21.15.164:3300/0 conn(0x7f8490144d70 0x7f84900ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8495395640 1 --2- 172.21.15.130:0/1506817606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84900b2780 0x7f84900b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8496397640 1 -- 172.21.15.130:0/1506817606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84900b2780 msgr2=0x7f84900b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:24.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8496397640 1 --2- 172.21.15.130:0/1506817606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84900b2780 0x7f84900b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8496397640 1 -- 172.21.15.130:0/1506817606 >> v2:172.21.15.164:3300/0 conn(0x7f8490144d70 msgr2=0x7f84900ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:24.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8496397640 1 --2- 172.21.15.130:0/1506817606 >> v2:172.21.15.164:3300/0 conn(0x7f8490144d70 0x7f84900ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8496397640 1 -- 172.21.15.130:0/1506817606 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900b2150 con 0x7f84900b1460 2023-09-13T06:05:24.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8495395640 1 --2- 172.21.15.130:0/1506817606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84900b2780 0x7f84900b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:24.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8496397640 1 --2- 172.21.15.130:0/1506817606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84900b1460 0x7f84900b18f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f84900cff90 tx=0x7f848801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a75db32753e9e14 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:24.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8494b94640 1 -- 172.21.15.130:0/1506817606 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880a5740 con 0x7f84900b1460 2023-09-13T06:05:24.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8494b94640 1 -- 172.21.15.130:0/1506817606 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84880a58a0 con 0x7f84900b1460 2023-09-13T06:05:24.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8494b94640 1 -- 172.21.15.130:0/1506817606 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880a5c30 con 0x7f84900b1460 2023-09-13T06:05:24.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8497dfa640 1 -- 172.21.15.130:0/1506817606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84900b1460 msgr2=0x7f84900b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8497dfa640 1 --2- 172.21.15.130:0/1506817606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84900b1460 0x7f84900b18f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f84900cff90 tx=0x7f848801c9d0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8497dfa640 1 -- 172.21.15.130:0/1506817606 shutdown_connections 2023-09-13T06:05:24.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8497dfa640 1 --2- 172.21.15.130:0/1506817606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84900b1460 0x7f84900b18f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8497dfa640 1 --2- 172.21.15.130:0/1506817606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84900b2780 0x7f84900b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8497dfa640 1 --2- 172.21.15.130:0/1506817606 >> v2:172.21.15.164:3300/0 conn(0x7f8490144d70 0x7f84900ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.329+0000 7f8497dfa640 1 -- 172.21.15.130:0/1506817606 >> 172.21.15.130:0/1506817606 conn(0x7f8490065990 msgr2=0x7f8490065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:24.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8497dfa640 1 -- 172.21.15.130:0/1506817606 shutdown_connections 2023-09-13T06:05:24.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8497dfa640 1 -- 172.21.15.130:0/1506817606 wait complete. 2023-09-13T06:05:24.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8497dfa640 1 Processor -- start 2023-09-13T06:05:24.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8497dfa640 1 -- start start 2023-09-13T06:05:24.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8497dfa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84900b1460 0x7f849015d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8497dfa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84900b2780 0x7f84900af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8497dfa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8490144d70 0x7f84900af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8497dfa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849015dca0 con 0x7f8490144d70 2023-09-13T06:05:24.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8497dfa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900ccc30 con 0x7f84900b1460 2023-09-13T06:05:24.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8497dfa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84900ccf10 con 0x7f84900b2780 2023-09-13T06:05:24.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8496397640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8490144d70 0x7f84900af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8496397640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8490144d70 0x7f84900af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54596/0 (socket says 172.21.15.130:54596) 2023-09-13T06:05:24.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8496397640 1 -- 172.21.15.130:0/2490153306 learned_addr learned my addr 172.21.15.130:0/2490153306 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:24.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8495b96640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84900b1460 0x7f849015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8495395640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84900b2780 0x7f84900af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8496397640 1 -- 172.21.15.130:0/2490153306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84900b2780 msgr2=0x7f84900af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8496397640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84900b2780 0x7f84900af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8496397640 1 -- 172.21.15.130:0/2490153306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84900b1460 msgr2=0x7f849015d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8496397640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84900b1460 0x7f849015d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8496397640 1 -- 172.21.15.130:0/2490153306 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488009b30 con 0x7f8490144d70 2023-09-13T06:05:24.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.333+0000 7f8496397640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8490144d70 0x7f84900af7d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f848801b080 tx=0x7f8488019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:24.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.337+0000 7f84867fc640 1 -- 172.21.15.130:0/2490153306 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880b8670 con 0x7f8490144d70 2023-09-13T06:05:24.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.337+0000 7f84867fc640 1 -- 172.21.15.130:0/2490153306 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84880b87d0 con 0x7f8490144d70 2023-09-13T06:05:24.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.337+0000 7f84867fc640 1 -- 172.21.15.130:0/2490153306 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880b8b80 con 0x7f8490144d70 2023-09-13T06:05:24.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.337+0000 7f8497dfa640 1 -- 172.21.15.130:0/2490153306 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84900cd1f0 con 0x7f8490144d70 2023-09-13T06:05:24.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.337+0000 7f8497dfa640 1 -- 172.21.15.130:0/2490153306 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84900cd7b0 con 0x7f8490144d70 2023-09-13T06:05:24.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.337+0000 7f8497dfa640 1 -- 172.21.15.130:0/2490153306 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849013fc70 con 0x7f8490144d70 2023-09-13T06:05:24.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.337+0000 7f84867fc640 1 -- 172.21.15.130:0/2490153306 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f84880b8ce0 con 0x7f8490144d70 2023-09-13T06:05:24.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.337+0000 7f84867fc640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8474065b20 0x7f8474067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.337+0000 7f84867fc640 1 -- 172.21.15.130:0/2490153306 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f848811e4d0 con 0x7f8490144d70 2023-09-13T06:05:24.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.337+0000 7f8495b96640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8474065b20 0x7f8474067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.337+0000 7f8495b96640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8474065b20 0x7f8474067fe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f849015e320 tx=0x7f848c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:24.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.341+0000 7f84867fc640 1 -- 172.21.15.130:0/2490153306 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f84880ec2a0 con 0x7f8490144d70 2023-09-13T06:05:24.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.493+0000 7f8497dfa640 1 -- 172.21.15.130:0/2490153306 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84900618a0 con 0x7f8490144d70 2023-09-13T06:05:24.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.493+0000 7f84867fc640 1 -- 172.21.15.130:0/2490153306 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84880ef8c0 con 0x7f8490144d70 2023-09-13T06:05:24.497 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:05:24.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 -- 172.21.15.130:0/2490153306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8474065b20 msgr2=0x7f8474067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8474065b20 0x7f8474067fe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f849015e320 tx=0x7f848c008040 comp rx=0 tx=0).stop 2023-09-13T06:05:24.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 -- 172.21.15.130:0/2490153306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8490144d70 msgr2=0x7f84900af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8490144d70 0x7f84900af7d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f848801b080 tx=0x7f8488019770 comp rx=0 tx=0).stop 2023-09-13T06:05:24.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 -- 172.21.15.130:0/2490153306 shutdown_connections 2023-09-13T06:05:24.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8474065b20 0x7f8474067fe0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8490144d70 0x7f84900af7d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84900b2780 0x7f84900af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 --2- 172.21.15.130:0/2490153306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84900b1460 0x7f849015d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 -- 172.21.15.130:0/2490153306 >> 172.21.15.130:0/2490153306 conn(0x7f8490065990 msgr2=0x7f849013ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:24.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 -- 172.21.15.130:0/2490153306 shutdown_connections 2023-09-13T06:05:24.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.497+0000 7f8497dfa640 1 -- 172.21.15.130:0/2490153306 wait complete. 2023-09-13T06:05:24.518 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T06:05:24.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.653+0000 7ff2f0540640 1 Processor -- start 2023-09-13T06:05:24.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.653+0000 7ff2f0540640 1 -- start start 2023-09-13T06:05:24.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2f0540640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff2e81436e0 0x7ff2e80ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2f0540640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff2e80acd80 0x7ff2e8070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2f0540640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e806f640 con 0x7ff2e8146540 2023-09-13T06:05:24.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2f0540640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e806f890 con 0x7ff2e80acd80 2023-09-13T06:05:24.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2f0540640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e806fb70 con 0x7ff2e81436e0 2023-09-13T06:05:24.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2edadb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff2e80acd80 0x7ff2e8070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2eeadd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff2e8146540 0x7ff2e8160eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39650/0 (socket says 172.21.15.130:39650) 2023-09-13T06:05:24.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2edadb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff2e80acd80 0x7ff2e8070650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54602/0 (socket says 172.21.15.130:54602) 2023-09-13T06:05:24.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2eeadd640 1 -- 172.21.15.130:0/3775798129 learned_addr learned my addr 172.21.15.130:0/3775798129 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:24.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2ee2dc640 1 --2- 172.21.15.130:0/3775798129 >> v2:172.21.15.164:3300/0 conn(0x7ff2e81436e0 0x7ff2e80ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2edadb640 1 -- 172.21.15.130:0/3775798129 >> v2:172.21.15.164:3300/0 conn(0x7ff2e81436e0 msgr2=0x7ff2e80ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:24.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2edadb640 1 --2- 172.21.15.130:0/3775798129 >> v2:172.21.15.164:3300/0 conn(0x7ff2e81436e0 0x7ff2e80ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2edadb640 1 -- 172.21.15.130:0/3775798129 >> v1:172.21.15.130:6789/0 conn(0x7ff2e8146540 legacy=0x7ff2e8160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.657+0000 7ff2edadb640 1 -- 172.21.15.130:0/3775798129 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e806fe50 con 0x7ff2e80acd80 2023-09-13T06:05:24.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2edadb640 1 --2- 172.21.15.130:0/3775798129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e80acd80 0x7ff2e8070650 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff2e806e9f0 tx=0x7ff2d801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85447e48926ffbf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:24.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2ed2da640 1 -- 172.21.15.130:0/3775798129 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80ab600 con 0x7ff2e80acd80 2023-09-13T06:05:24.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2ed2da640 1 -- 172.21.15.130:0/3775798129 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d80a7050 con 0x7ff2e80acd80 2023-09-13T06:05:24.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2ed2da640 1 -- 172.21.15.130:0/3775798129 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80ab980 con 0x7ff2e80acd80 2023-09-13T06:05:24.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2f0540640 1 -- 172.21.15.130:0/3775798129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e80acd80 msgr2=0x7ff2e8070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2f0540640 1 --2- 172.21.15.130:0/3775798129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e80acd80 0x7ff2e8070650 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff2e806e9f0 tx=0x7ff2d801c340 comp rx=0 tx=0).stop 2023-09-13T06:05:24.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2f0540640 1 -- 172.21.15.130:0/3775798129 shutdown_connections 2023-09-13T06:05:24.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2f0540640 1 --2- 172.21.15.130:0/3775798129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e80acd80 0x7ff2e8070650 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2f0540640 1 --2- 172.21.15.130:0/3775798129 >> v2:172.21.15.164:3300/0 conn(0x7ff2e81436e0 0x7ff2e80ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2f0540640 1 -- 172.21.15.130:0/3775798129 >> 172.21.15.130:0/3775798129 conn(0x7ff2e80b0bc0 msgr2=0x7ff2e80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:24.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2f0540640 1 -- 172.21.15.130:0/3775798129 shutdown_connections 2023-09-13T06:05:24.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2f0540640 1 -- 172.21.15.130:0/3775798129 wait complete. 2023-09-13T06:05:24.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2f0540640 1 Processor -- start 2023-09-13T06:05:24.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.661+0000 7ff2f0540640 1 -- start start 2023-09-13T06:05:24.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2f0540640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2e80acd80 0x7ff2e81441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2f0540640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e81436e0 0x7ff2e813dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2f0540640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2e8146540 0x7ff2e80ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2f0540640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8145430 con 0x7ff2e81436e0 2023-09-13T06:05:24.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2f0540640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8144720 con 0x7ff2e80acd80 2023-09-13T06:05:24.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2f0540640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e815f740 con 0x7ff2e8146540 2023-09-13T06:05:24.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2edadb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e81436e0 0x7ff2e813dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2edadb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e81436e0 0x7ff2e813dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54604/0 (socket says 172.21.15.130:54604) 2023-09-13T06:05:24.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2edadb640 1 -- 172.21.15.130:0/634018758 learned_addr learned my addr 172.21.15.130:0/634018758 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:24.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2ee2dc640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2e80acd80 0x7ff2e81441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2eeadd640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2e8146540 0x7ff2e80ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2edadb640 1 -- 172.21.15.130:0/634018758 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2e8146540 msgr2=0x7ff2e80ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2edadb640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2e8146540 0x7ff2e80ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2edadb640 1 -- 172.21.15.130:0/634018758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2e80acd80 msgr2=0x7ff2e81441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2edadb640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2e80acd80 0x7ff2e81441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2edadb640 1 -- 172.21.15.130:0/634018758 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8009420 con 0x7ff2e81436e0 2023-09-13T06:05:24.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2edadb640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e81436e0 0x7ff2e813dc00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80ae040 tx=0x7ff2d80190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:24.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2deffd640 1 -- 172.21.15.130:0/634018758 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80b4840 con 0x7ff2e81436e0 2023-09-13T06:05:24.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2deffd640 1 -- 172.21.15.130:0/634018758 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d80b49c0 con 0x7ff2e81436e0 2023-09-13T06:05:24.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2deffd640 1 -- 172.21.15.130:0/634018758 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80b4d70 con 0x7ff2e81436e0 2023-09-13T06:05:24.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2f0540640 1 -- 172.21.15.130:0/634018758 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e815f9e0 con 0x7ff2e81436e0 2023-09-13T06:05:24.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2f0540640 1 -- 172.21.15.130:0/634018758 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e815ffa0 con 0x7ff2e81436e0 2023-09-13T06:05:24.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2f0540640 1 -- 172.21.15.130:0/634018758 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e8160190 con 0x7ff2e81436e0 2023-09-13T06:05:24.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.665+0000 7ff2deffd640 1 -- 172.21.15.130:0/634018758 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff2d80b2040 con 0x7ff2e81436e0 2023-09-13T06:05:24.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.669+0000 7ff2deffd640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff2cc065b20 0x7ff2cc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.669+0000 7ff2deffd640 1 -- 172.21.15.130:0/634018758 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff2d811d3f0 con 0x7ff2e81436e0 2023-09-13T06:05:24.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.669+0000 7ff2ee2dc640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff2cc065b20 0x7ff2cc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.669+0000 7ff2ee2dc640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff2cc065b20 0x7ff2cc067fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8143100 tx=0x7ff2e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:24.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.673+0000 7ff2deffd640 1 -- 172.21.15.130:0/634018758 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff2d80eaff0 con 0x7ff2e81436e0 2023-09-13T06:05:24.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 -- 172.21.15.130:0/634018758 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff2e80618a0 con 0x7ff2e81436e0 2023-09-13T06:05:24.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2deffd640 1 -- 172.21.15.130:0/634018758 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff2d80b0060 con 0x7ff2e81436e0 2023-09-13T06:05:24.823 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:24.823 INFO:teuthology.orchestra.run.smithi130.stdout:[ 2023-09-13T06:05:24.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:05:24.824 INFO:teuthology.orchestra.run.smithi130.stdout: "poolnum": 1, 2023-09-13T06:05:24.824 INFO:teuthology.orchestra.run.smithi130.stdout: "poolname": ".mgr" 2023-09-13T06:05:24.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:05:24.824 INFO:teuthology.orchestra.run.smithi130.stdout:] 2023-09-13T06:05:24.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 -- 172.21.15.130:0/634018758 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff2cc065b20 msgr2=0x7ff2cc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff2cc065b20 0x7ff2cc067fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8143100 tx=0x7ff2e4008040 comp rx=0 tx=0).stop 2023-09-13T06:05:24.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 -- 172.21.15.130:0/634018758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e81436e0 msgr2=0x7ff2e813dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e81436e0 0x7ff2e813dc00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80ae040 tx=0x7ff2d80190e0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 -- 172.21.15.130:0/634018758 shutdown_connections 2023-09-13T06:05:24.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff2cc065b20 0x7ff2cc067fe0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2e8146540 0x7ff2e80ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e81436e0 0x7ff2e813dc00 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 --2- 172.21.15.130:0/634018758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2e80acd80 0x7ff2e81441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 -- 172.21.15.130:0/634018758 >> 172.21.15.130:0/634018758 conn(0x7ff2e80b0bc0 msgr2=0x7ff2e80b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:24.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 -- 172.21.15.130:0/634018758 shutdown_connections 2023-09-13T06:05:24.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.821+0000 7ff2f0540640 1 -- 172.21.15.130:0/634018758 wait complete. 2023-09-13T06:05:24.844 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T06:05:24.844 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T06:05:24.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.985+0000 7fdb49740640 1 Processor -- start 2023-09-13T06:05:24.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.985+0000 7fdb49740640 1 -- start start 2023-09-13T06:05:24.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.985+0000 7fdb49740640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdb44160de0 0x7fdb44143460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.985+0000 7fdb49740640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdb4406f530 0x7fdb4406f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.985+0000 7fdb49740640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb441439a0 con 0x7fdb440d0c10 2023-09-13T06:05:24.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.985+0000 7fdb49740640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb44140740 con 0x7fdb44160de0 2023-09-13T06:05:24.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.985+0000 7fdb49740640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4415d900 con 0x7fdb4406f530 2023-09-13T06:05:24.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.985+0000 7fdb3a7fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdb44160de0 0x7fdb44143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb3a7fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdb44160de0 0x7fdb44143460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54620/0 (socket says 172.21.15.130:54620) 2023-09-13T06:05:24.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.985+0000 7fdb42ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fdb440d0c10 0x7fdb440b6f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39654/0 (socket says 172.21.15.130:39654) 2023-09-13T06:05:24.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb3a7fc640 1 -- 172.21.15.130:0/1891388146 learned_addr learned my addr 172.21.15.130:0/1891388146 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:24.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb437fe640 1 --2- 172.21.15.130:0/1891388146 >> v2:172.21.15.164:3300/0 conn(0x7fdb4406f530 0x7fdb4406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:24.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb3a7fc640 1 -- 172.21.15.130:0/1891388146 >> v2:172.21.15.164:3300/0 conn(0x7fdb4406f530 msgr2=0x7fdb4406f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:24.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb427fc640 1 -- 172.21.15.130:0/1891388146 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867945453 0 0) 0x7fdb2c001120 con 0x7fdb440d0c10 2023-09-13T06:05:24.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb3a7fc640 1 --2- 172.21.15.130:0/1891388146 >> v2:172.21.15.164:3300/0 conn(0x7fdb4406f530 0x7fdb4406f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb3a7fc640 1 -- 172.21.15.130:0/1891388146 >> v1:172.21.15.130:6789/0 conn(0x7fdb440d0c10 legacy=0x7fdb440b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb3a7fc640 1 -- 172.21.15.130:0/1891388146 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4406fe80 con 0x7fdb44160de0 2023-09-13T06:05:24.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb437fe640 1 --2- 172.21.15.130:0/1891388146 >> v2:172.21.15.164:3300/0 conn(0x7fdb4406f530 0x7fdb4406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:24.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb3a7fc640 1 --2- 172.21.15.130:0/1891388146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb44160de0 0x7fdb44143460 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fdb440b6810 tx=0x7fdb3401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102ed11ca28a59fd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:24.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb427fc640 1 -- 172.21.15.130:0/1891388146 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340ab600 con 0x7fdb44160de0 2023-09-13T06:05:24.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb427fc640 1 -- 172.21.15.130:0/1891388146 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb340a7050 con 0x7fdb44160de0 2023-09-13T06:05:24.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.989+0000 7fdb427fc640 1 -- 172.21.15.130:0/1891388146 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340ab980 con 0x7fdb44160de0 2023-09-13T06:05:24.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 -- 172.21.15.130:0/1891388146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb44160de0 msgr2=0x7fdb44143460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:24.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 --2- 172.21.15.130:0/1891388146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb44160de0 0x7fdb44143460 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fdb440b6810 tx=0x7fdb3401c500 comp rx=0 tx=0).stop 2023-09-13T06:05:24.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 -- 172.21.15.130:0/1891388146 shutdown_connections 2023-09-13T06:05:24.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 --2- 172.21.15.130:0/1891388146 >> v2:172.21.15.164:3300/0 conn(0x7fdb4406f530 0x7fdb4406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 --2- 172.21.15.130:0/1891388146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb44160de0 0x7fdb44143460 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:24.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 -- 172.21.15.130:0/1891388146 >> 172.21.15.130:0/1891388146 conn(0x7fdb44065990 msgr2=0x7fdb44065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:24.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 -- 172.21.15.130:0/1891388146 shutdown_connections 2023-09-13T06:05:24.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 -- 172.21.15.130:0/1891388146 wait complete. 2023-09-13T06:05:24.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 Processor -- start 2023-09-13T06:05:24.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 -- start start 2023-09-13T06:05:24.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb4406f530 0x7fdb44154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb440d0c10 0x7fdb44138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb44160de0 0x7fdb441534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:24.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb44156130 con 0x7fdb440d0c10 2023-09-13T06:05:24.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4413daa0 con 0x7fdb44160de0 2023-09-13T06:05:25.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb49740640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb44142d50 con 0x7fdb4406f530 2023-09-13T06:05:25.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb3a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb440d0c10 0x7fdb44138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:25.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb3a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb440d0c10 0x7fdb44138b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54624/0 (socket says 172.21.15.130:54624) 2023-09-13T06:05:25.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb3a7fc640 1 -- 172.21.15.130:0/402396740 learned_addr learned my addr 172.21.15.130:0/402396740 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:25.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb42ffd640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb4406f530 0x7fdb44154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:25.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb437fe640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb44160de0 0x7fdb441534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:25.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb3a7fc640 1 -- 172.21.15.130:0/402396740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb4406f530 msgr2=0x7fdb44154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:25.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb3a7fc640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb4406f530 0x7fdb44154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb3a7fc640 1 -- 172.21.15.130:0/402396740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb44160de0 msgr2=0x7fdb441534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:25.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb3a7fc640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb44160de0 0x7fdb441534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.993+0000 7fdb3a7fc640 1 -- 172.21.15.130:0/402396740 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb340094d0 con 0x7fdb440d0c10 2023-09-13T06:05:25.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.997+0000 7fdb3a7fc640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb440d0c10 0x7fdb44138b70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fdb340ae040 tx=0x7fdb340192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:25.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.997+0000 7fdb3bfff640 1 -- 172.21.15.130:0/402396740 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340b3890 con 0x7fdb440d0c10 2023-09-13T06:05:25.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.997+0000 7fdb3bfff640 1 -- 172.21.15.130:0/402396740 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb340b39f0 con 0x7fdb440d0c10 2023-09-13T06:05:25.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.997+0000 7fdb49740640 1 -- 172.21.15.130:0/402396740 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb44142ff0 con 0x7fdb440d0c10 2023-09-13T06:05:25.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.997+0000 7fdb3bfff640 1 -- 172.21.15.130:0/402396740 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340b3d80 con 0x7fdb440d0c10 2023-09-13T06:05:25.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.997+0000 7fdb49740640 1 -- 172.21.15.130:0/402396740 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb441435b0 con 0x7fdb440d0c10 2023-09-13T06:05:25.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.997+0000 7fdb49740640 1 -- 172.21.15.130:0/402396740 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb44160be0 con 0x7fdb440d0c10 2023-09-13T06:05:25.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.997+0000 7fdb3bfff640 1 -- 172.21.15.130:0/402396740 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdb340b2070 con 0x7fdb440d0c10 2023-09-13T06:05:25.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.997+0000 7fdb3bfff640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdb24065b20 0x7fdb24067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:25.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.997+0000 7fdb3bfff640 1 -- 172.21.15.130:0/402396740 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdb3411d1d0 con 0x7fdb440d0c10 2023-09-13T06:05:25.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:24.997+0000 7fdb42ffd640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdb24065b20 0x7fdb24067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:25.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.001+0000 7fdb42ffd640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdb24065b20 0x7fdb24067fe0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c007fd0 tx=0x7fdb2c0079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:25.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.001+0000 7fdb3bfff640 1 -- 172.21.15.130:0/402396740 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdb340eaf00 con 0x7fdb440d0c10 2023-09-13T06:05:25.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.149+0000 7fdb49740640 1 -- 172.21.15.130:0/402396740 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdb440618a0 con 0x7fdb440d0c10 2023-09-13T06:05:25.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.445+0000 7fdb3bfff640 1 -- 172.21.15.130:0/402396740 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdb340ee520 con 0x7fdb440d0c10 2023-09-13T06:05:25.446 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' created 2023-09-13T06:05:25.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 -- 172.21.15.130:0/402396740 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdb24065b20 msgr2=0x7fdb24067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:25.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdb24065b20 0x7fdb24067fe0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c007fd0 tx=0x7fdb2c0079c0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 -- 172.21.15.130:0/402396740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb440d0c10 msgr2=0x7fdb44138b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:25.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb440d0c10 0x7fdb44138b70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fdb340ae040 tx=0x7fdb340192a0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 -- 172.21.15.130:0/402396740 shutdown_connections 2023-09-13T06:05:25.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdb24065b20 0x7fdb24067fe0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb44160de0 0x7fdb441534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb440d0c10 0x7fdb44138b70 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 --2- 172.21.15.130:0/402396740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb4406f530 0x7fdb44154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 -- 172.21.15.130:0/402396740 >> 172.21.15.130:0/402396740 conn(0x7fdb44065990 msgr2=0x7fdb4413cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:25.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 -- 172.21.15.130:0/402396740 shutdown_connections 2023-09-13T06:05:25.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.449+0000 7fdb49740640 1 -- 172.21.15.130:0/402396740 wait complete. 2023-09-13T06:05:25.470 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T06:05:25.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.613+0000 7fc38e5db640 1 Processor -- start 2023-09-13T06:05:25.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.613+0000 7fc38e5db640 1 -- start start 2023-09-13T06:05:25.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.613+0000 7fc38e5db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc388154380 0x7fc3880b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:25.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.613+0000 7fc38e5db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc388154760 0x7fc388070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:25.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.613+0000 7fc38e5db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc388161140 0x7fc38815e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:25.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.613+0000 7fc38e5db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3880b2690 con 0x7fc388154760 2023-09-13T06:05:25.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.613+0000 7fc38e5db640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc388161700 con 0x7fc388154380 2023-09-13T06:05:25.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.613+0000 7fc38e5db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3881619e0 con 0x7fc388161140 2023-09-13T06:05:25.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.613+0000 7fc3877fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc388154760 0x7fc388070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:25.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.613+0000 7fc3877fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc388154760 0x7fc388070670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54628/0 (socket says 172.21.15.130:54628) 2023-09-13T06:05:25.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.613+0000 7fc3877fe640 1 -- 172.21.15.130:0/3720190975 learned_addr learned my addr 172.21.15.130:0/3720190975 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:25.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.617+0000 7fc38cb78640 1 --2- 172.21.15.130:0/3720190975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc388161140 0x7fc38815e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:25.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.617+0000 7fc387fff640 1 --2- 172.21.15.130:0/3720190975 >> v2:172.21.15.164:3300/0 conn(0x7fc388154380 0x7fc3880b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:25.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.617+0000 7fc3877fe640 1 -- 172.21.15.130:0/3720190975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc388161140 msgr2=0x7fc38815e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:25.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.617+0000 7fc3877fe640 1 --2- 172.21.15.130:0/3720190975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc388161140 0x7fc38815e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.617+0000 7fc3877fe640 1 -- 172.21.15.130:0/3720190975 >> v2:172.21.15.164:3300/0 conn(0x7fc388154380 msgr2=0x7fc3880b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:25.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.617+0000 7fc3877fe640 1 --2- 172.21.15.130:0/3720190975 >> v2:172.21.15.164:3300/0 conn(0x7fc388154380 0x7fc3880b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.617+0000 7fc3877fe640 1 -- 172.21.15.130:0/3720190975 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388161cc0 con 0x7fc388154760 2023-09-13T06:05:25.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.617+0000 7fc3877fe640 1 --2- 172.21.15.130:0/3720190975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc388154760 0x7fc388070670 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc388069f90 tx=0x7fc37c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aeeec75ec13162a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:25.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.617+0000 7fc386ffd640 1 -- 172.21.15.130:0/3720190975 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c0ac630 con 0x7fc388154760 2023-09-13T06:05:25.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.617+0000 7fc386ffd640 1 -- 172.21.15.130:0/3720190975 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c0ac790 con 0x7fc388154760 2023-09-13T06:05:25.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.617+0000 7fc386ffd640 1 -- 172.21.15.130:0/3720190975 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c0acb20 con 0x7fc388154760 2023-09-13T06:05:25.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 -- 172.21.15.130:0/3720190975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc388154760 msgr2=0x7fc388070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:25.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 --2- 172.21.15.130:0/3720190975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc388154760 0x7fc388070670 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc388069f90 tx=0x7fc37c01c500 comp rx=0 tx=0).stop 2023-09-13T06:05:25.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 -- 172.21.15.130:0/3720190975 shutdown_connections 2023-09-13T06:05:25.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 --2- 172.21.15.130:0/3720190975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc388161140 0x7fc38815e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 --2- 172.21.15.130:0/3720190975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc388154760 0x7fc388070670 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 --2- 172.21.15.130:0/3720190975 >> v2:172.21.15.164:3300/0 conn(0x7fc388154380 0x7fc3880b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 -- 172.21.15.130:0/3720190975 >> 172.21.15.130:0/3720190975 conn(0x7fc388065990 msgr2=0x7fc388065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:25.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 -- 172.21.15.130:0/3720190975 shutdown_connections 2023-09-13T06:05:25.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 -- 172.21.15.130:0/3720190975 wait complete. 2023-09-13T06:05:25.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 Processor -- start 2023-09-13T06:05:25.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 -- start start 2023-09-13T06:05:25.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc388154380 0x7fc388147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:25.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc388154760 0x7fc38814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:25.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc388161140 0x7fc38815f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:25.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc388153e90 con 0x7fc388154380 2023-09-13T06:05:25.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38814bb00 con 0x7fc388154760 2023-09-13T06:05:25.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38e5db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38814bde0 con 0x7fc388161140 2023-09-13T06:05:25.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc387fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc388154380 0x7fc388147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:25.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc387fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc388154380 0x7fc388147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54630/0 (socket says 172.21.15.130:54630) 2023-09-13T06:05:25.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc387fff640 1 -- 172.21.15.130:0/2056967146 learned_addr learned my addr 172.21.15.130:0/2056967146 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:25.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc38cb78640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc388161140 0x7fc38815f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:25.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc3877fe640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc388154760 0x7fc38814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:25.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc387fff640 1 -- 172.21.15.130:0/2056967146 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc388161140 msgr2=0x7fc38815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:25.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc387fff640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc388161140 0x7fc38815f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc387fff640 1 -- 172.21.15.130:0/2056967146 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc388154760 msgr2=0x7fc38814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:25.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc387fff640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc388154760 0x7fc38814f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:25.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.621+0000 7fc387fff640 1 -- 172.21.15.130:0/2056967146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0094d0 con 0x7fc388154380 2023-09-13T06:05:25.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.625+0000 7fc387fff640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc388154380 0x7fc388147c90 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc37800d800 tx=0x7fc37800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:25.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.625+0000 7fc384ff9640 1 -- 172.21.15.130:0/2056967146 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3780096a0 con 0x7fc388154380 2023-09-13T06:05:25.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.625+0000 7fc384ff9640 1 -- 172.21.15.130:0/2056967146 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc378009800 con 0x7fc388154380 2023-09-13T06:05:25.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.625+0000 7fc38e5db640 1 -- 172.21.15.130:0/2056967146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc388153b20 con 0x7fc388154380 2023-09-13T06:05:25.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.625+0000 7fc384ff9640 1 -- 172.21.15.130:0/2056967146 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378009990 con 0x7fc388154380 2023-09-13T06:05:25.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.625+0000 7fc38e5db640 1 -- 172.21.15.130:0/2056967146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38814fea0 con 0x7fc388154380 2023-09-13T06:05:25.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.625+0000 7fc38e5db640 1 -- 172.21.15.130:0/2056967146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc388153980 con 0x7fc388154380 2023-09-13T06:05:25.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.625+0000 7fc384ff9640 1 -- 172.21.15.130:0/2056967146 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc378009af0 con 0x7fc388154380 2023-09-13T06:05:25.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.625+0000 7fc384ff9640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc374065b20 0x7fc374067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:25.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.625+0000 7fc384ff9640 1 -- 172.21.15.130:0/2056967146 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc378083b00 con 0x7fc388154380 2023-09-13T06:05:25.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.625+0000 7fc3877fe640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc374065b20 0x7fc374067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:25.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.629+0000 7fc3877fe640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc374065b20 0x7fc374067fe0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0ae000 tx=0x7fc37c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:25.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.629+0000 7fc384ff9640 1 -- 172.21.15.130:0/2056967146 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc378051810 con 0x7fc388154380 2023-09-13T06:05:25.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:25.777+0000 7fc38e5db640 1 -- 172.21.15.130:0/2056967146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc388153980 con 0x7fc388154380 2023-09-13T06:05:26.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.457+0000 7fc384ff9640 1 -- 172.21.15.130:0/2056967146 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc388153980 con 0x7fc388154380 2023-09-13T06:05:26.465 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' created 2023-09-13T06:05:26.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 -- 172.21.15.130:0/2056967146 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc374065b20 msgr2=0x7fc374067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:26.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc374065b20 0x7fc374067fe0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0ae000 tx=0x7fc37c008040 comp rx=0 tx=0).stop 2023-09-13T06:05:26.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 -- 172.21.15.130:0/2056967146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc388154380 msgr2=0x7fc388147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:26.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc388154380 0x7fc388147c90 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc37800d800 tx=0x7fc37800dcc0 comp rx=0 tx=0).stop 2023-09-13T06:05:26.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 -- 172.21.15.130:0/2056967146 shutdown_connections 2023-09-13T06:05:26.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc374065b20 0x7fc374067fe0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:26.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc388154760 0x7fc38814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:26.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc388161140 0x7fc38815f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:26.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 --2- 172.21.15.130:0/2056967146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc388154380 0x7fc388147c90 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:26.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 -- 172.21.15.130:0/2056967146 >> 172.21.15.130:0/2056967146 conn(0x7fc388065990 msgr2=0x7fc3880719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:26.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 -- 172.21.15.130:0/2056967146 shutdown_connections 2023-09-13T06:05:26.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.469+0000 7fc38e5db640 1 -- 172.21.15.130:0/2056967146 wait complete. 2023-09-13T06:05:26.494 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T06:05:26.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1bc9fa640 1 Processor -- start 2023-09-13T06:05:26.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1bc9fa640 1 -- start start 2023-09-13T06:05:26.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1bc9fa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe1b80d2cd0 0x7fe1b81612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:26.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1bc9fa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b815dd40 con 0x7fe1b81617e0 2023-09-13T06:05:26.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1bc9fa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b815e020 con 0x7fe1b815ae10 2023-09-13T06:05:26.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1bc9fa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b815e300 con 0x7fe1b80d2cd0 2023-09-13T06:05:26.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1add9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe1b80d2cd0 0x7fe1b81612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:26.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1add9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe1b80d2cd0 0x7fe1b81612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54634/0 (socket says 172.21.15.130:54634) 2023-09-13T06:05:26.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1b6d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe1b81617e0 0x7fe1b80cfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39660/0 (socket says 172.21.15.130:39660) 2023-09-13T06:05:26.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1add9b640 1 -- 172.21.15.130:0/2624953400 learned_addr learned my addr 172.21.15.130:0/2624953400 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:26.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1add9b640 1 -- 172.21.15.130:0/2624953400 >> v1:172.21.15.164:6789/0 conn(0x7fe1b815ae10 legacy=0x7fe1b80d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:26.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1add9b640 1 -- 172.21.15.130:0/2624953400 >> v1:172.21.15.130:6789/0 conn(0x7fe1b81617e0 legacy=0x7fe1b80cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:26.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.637+0000 7fe1add9b640 1 -- 172.21.15.130:0/2624953400 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b815e5e0 con 0x7fe1b80d2cd0 2023-09-13T06:05:26.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.641+0000 7fe1add9b640 1 --2- 172.21.15.130:0/2624953400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1b80d2cd0 0x7fe1b81612a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009870 tx=0x7fe1a001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcdb5c7957f6a48 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:26.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.641+0000 7fe1b5d9b640 1 -- 172.21.15.130:0/2624953400 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8161e20 con 0x7fe1b80d2cd0 2023-09-13T06:05:26.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.641+0000 7fe1b5d9b640 1 -- 172.21.15.130:0/2624953400 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a00ab600 con 0x7fe1b80d2cd0 2023-09-13T06:05:26.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.641+0000 7fe1b5d9b640 1 -- 172.21.15.130:0/2624953400 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00ab990 con 0x7fe1b80d2cd0 2023-09-13T06:05:26.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.641+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2624953400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1b80d2cd0 msgr2=0x7fe1b81612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:26.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.641+0000 7fe1bc9fa640 1 --2- 172.21.15.130:0/2624953400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1b80d2cd0 0x7fe1b81612a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009870 tx=0x7fe1a001c3e0 comp rx=0 tx=0).stop 2023-09-13T06:05:26.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.641+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2624953400 shutdown_connections 2023-09-13T06:05:26.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.641+0000 7fe1bc9fa640 1 --2- 172.21.15.130:0/2624953400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1b80d2cd0 0x7fe1b81612a0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:26.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.641+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2624953400 >> 172.21.15.130:0/2624953400 conn(0x7fe1b8065990 msgr2=0x7fe1b8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:26.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.641+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2624953400 shutdown_connections 2023-09-13T06:05:26.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.641+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2624953400 wait complete. 2023-09-13T06:05:26.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1bc9fa640 1 Processor -- start 2023-09-13T06:05:26.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1bc9fa640 1 -- start start 2023-09-13T06:05:26.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1bc9fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1b80d2cd0 0x7fe1b8152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:26.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1bc9fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1b815ae10 0x7fe1b81526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:26.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1bc9fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1b81617e0 0x7fe1b80b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:26.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1bc9fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b8156d60 con 0x7fe1b815ae10 2023-09-13T06:05:26.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1bc9fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b8157570 con 0x7fe1b81617e0 2023-09-13T06:05:26.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1bc9fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b8156fb0 con 0x7fe1b80d2cd0 2023-09-13T06:05:26.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1add9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1b815ae10 0x7fe1b81526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:26.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1add9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1b815ae10 0x7fe1b81526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54644/0 (socket says 172.21.15.130:54644) 2023-09-13T06:05:26.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1add9b640 1 -- 172.21.15.130:0/2142962587 learned_addr learned my addr 172.21.15.130:0/2142962587 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:26.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1b659c640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1b80d2cd0 0x7fe1b8152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:26.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1add9b640 1 -- 172.21.15.130:0/2142962587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1b80d2cd0 msgr2=0x7fe1b8152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:26.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1b6d9d640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1b81617e0 0x7fe1b80b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:26.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1add9b640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1b80d2cd0 0x7fe1b8152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:26.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1add9b640 1 -- 172.21.15.130:0/2142962587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1b81617e0 msgr2=0x7fe1b80b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:26.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1add9b640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1b81617e0 0x7fe1b80b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:26.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1add9b640 1 -- 172.21.15.130:0/2142962587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a00094d0 con 0x7fe1b815ae10 2023-09-13T06:05:26.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1b659c640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1b80d2cd0 0x7fe1b8152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:26.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1b6d9d640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1b81617e0 0x7fe1b80b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:26.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1add9b640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1b815ae10 0x7fe1b81526b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00ad040 tx=0x7fe1a001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:26.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1af7fe640 1 -- 172.21.15.130:0/2142962587 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00b4800 con 0x7fe1b815ae10 2023-09-13T06:05:26.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1af7fe640 1 -- 172.21.15.130:0/2142962587 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a00b4980 con 0x7fe1b815ae10 2023-09-13T06:05:26.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1af7fe640 1 -- 172.21.15.130:0/2142962587 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00b4d30 con 0x7fe1b815ae10 2023-09-13T06:05:26.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2142962587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b8157290 con 0x7fe1b815ae10 2023-09-13T06:05:26.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.645+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2142962587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b81580d0 con 0x7fe1b815ae10 2023-09-13T06:05:26.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.649+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2142962587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b80618a0 con 0x7fe1b815ae10 2023-09-13T06:05:26.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.649+0000 7fe1af7fe640 1 -- 172.21.15.130:0/2142962587 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe1a00b3380 con 0x7fe1b815ae10 2023-09-13T06:05:26.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.649+0000 7fe1af7fe640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe198065b20 0x7fe198067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:26.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.649+0000 7fe1af7fe640 1 -- 172.21.15.130:0/2142962587 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe1a011da10 con 0x7fe1b815ae10 2023-09-13T06:05:26.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.649+0000 7fe1b659c640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe198065b20 0x7fe198067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:26.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.649+0000 7fe1b659c640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe198065b20 0x7fe198067fe0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe1b815c430 tx=0x7fe1a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:26.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.653+0000 7fe1af7fe640 1 -- 172.21.15.130:0/2142962587 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe1a00eb3d0 con 0x7fe1b815ae10 2023-09-13T06:05:26.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:26.833+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2142962587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe1b80d1950 con 0x7fe1b815ae10 2023-09-13T06:05:27.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.465+0000 7fe1af7fe640 1 -- 172.21.15.130:0/2142962587 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v39) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe1a00ee9f0 con 0x7fe1b815ae10 2023-09-13T06:05:27.467 INFO:teuthology.orchestra.run.smithi130.stderr:new fs with metadata pool 10 and data pool 11 2023-09-13T06:05:27.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2142962587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe198065b20 msgr2=0x7fe198067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe198065b20 0x7fe198067fe0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe1b815c430 tx=0x7fe1a8009040 comp rx=0 tx=0).stop 2023-09-13T06:05:27.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2142962587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1b815ae10 msgr2=0x7fe1b81526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1b815ae10 0x7fe1b81526b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00ad040 tx=0x7fe1a001ac20 comp rx=0 tx=0).stop 2023-09-13T06:05:27.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2142962587 shutdown_connections 2023-09-13T06:05:27.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe198065b20 0x7fe198067fe0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1b81617e0 0x7fe1b80b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1b815ae10 0x7fe1b81526b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 --2- 172.21.15.130:0/2142962587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1b80d2cd0 0x7fe1b8152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2142962587 >> 172.21.15.130:0/2142962587 conn(0x7fe1b8065990 msgr2=0x7fe1b80cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:27.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2142962587 shutdown_connections 2023-09-13T06:05:27.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.469+0000 7fe1bc9fa640 1 -- 172.21.15.130:0/2142962587 wait complete. 2023-09-13T06:05:27.493 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:27.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.629+0000 7fb72aea1640 1 Processor -- start 2023-09-13T06:05:27.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.629+0000 7fb72aea1640 1 -- start start 2023-09-13T06:05:27.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72aea1640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb724146eb0 0x7fb7240b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72aea1640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb724161100 0x7fb724161520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72aea1640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb724071440 con 0x7fb7240b4120 2023-09-13T06:05:27.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72aea1640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7240706a0 con 0x7fb724161100 2023-09-13T06:05:27.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72aea1640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb724161a60 con 0x7fb724146eb0 2023-09-13T06:05:27.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72969e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb724161100 0x7fb724161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb729e9f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb724146eb0 0x7fb7240b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72969e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb724161100 0x7fb724161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:36194/0 (socket says 172.21.15.130:36194) 2023-09-13T06:05:27.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb729e9f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb724146eb0 0x7fb7240b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:33230/0 (socket says 172.21.15.130:33230) 2023-09-13T06:05:27.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72969e640 1 -- 172.21.15.130:0/80474073 learned_addr learned my addr 172.21.15.130:0/80474073 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:27.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72969e640 1 -- 172.21.15.130:0/80474073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb724146eb0 msgr2=0x7fb7240b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:27.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72969e640 1 --2- 172.21.15.130:0/80474073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb724146eb0 0x7fb7240b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72969e640 1 -- 172.21.15.130:0/80474073 >> v1:172.21.15.164:6789/0 conn(0x7fb7240b4120 legacy=0x7fb7240b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb72969e640 1 -- 172.21.15.130:0/80474073 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb724147290 con 0x7fb724161100 2023-09-13T06:05:27.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.633+0000 7fb729e9f640 1 --2- 172.21.15.130:0/80474073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb724146eb0 0x7fb7240b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:05:27.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb72969e640 1 --2- 172.21.15.130:0/80474073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb724161100 0x7fb724161520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb714009870 tx=0x7fb71401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c988715b1375b49 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:27.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb728e9d640 1 -- 172.21.15.130:0/80474073 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7140ab620 con 0x7fb724161100 2023-09-13T06:05:27.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb728e9d640 1 -- 172.21.15.130:0/80474073 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7140ab780 con 0x7fb724161100 2023-09-13T06:05:27.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb728e9d640 1 -- 172.21.15.130:0/80474073 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7140abb10 con 0x7fb724161100 2023-09-13T06:05:27.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb72aea1640 1 -- 172.21.15.130:0/80474073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb724161100 msgr2=0x7fb724161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb72aea1640 1 --2- 172.21.15.130:0/80474073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb724161100 0x7fb724161520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb714009870 tx=0x7fb71401c510 comp rx=0 tx=0).stop 2023-09-13T06:05:27.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb72aea1640 1 -- 172.21.15.130:0/80474073 shutdown_connections 2023-09-13T06:05:27.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb72aea1640 1 --2- 172.21.15.130:0/80474073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb724161100 0x7fb724161520 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb72aea1640 1 --2- 172.21.15.130:0/80474073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb724146eb0 0x7fb7240b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb72aea1640 1 -- 172.21.15.130:0/80474073 >> 172.21.15.130:0/80474073 conn(0x7fb7240cdd10 msgr2=0x7fb7240ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:27.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb72aea1640 1 -- 172.21.15.130:0/80474073 shutdown_connections 2023-09-13T06:05:27.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb72aea1640 1 -- 172.21.15.130:0/80474073 wait complete. 2023-09-13T06:05:27.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb72aea1640 1 Processor -- start 2023-09-13T06:05:27.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.637+0000 7fb72aea1640 1 -- start start 2023-09-13T06:05:27.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72aea1640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7240b4120 0x7fb7240cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72aea1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb724146eb0 0x7fb7240ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72aea1640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb724161100 0x7fb72415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72aea1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7240cb040 con 0x7fb724146eb0 2023-09-13T06:05:27.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72aea1640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7240cb300 con 0x7fb724161100 2023-09-13T06:05:27.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72aea1640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7240cb5e0 con 0x7fb7240b4120 2023-09-13T06:05:27.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72969e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb724146eb0 0x7fb7240ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72969e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb724146eb0 0x7fb7240ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54652/0 (socket says 172.21.15.130:54652) 2023-09-13T06:05:27.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72969e640 1 -- 172.21.15.130:0/2891159349 learned_addr learned my addr 172.21.15.130:0/2891159349 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:27.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb729e9f640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7240b4120 0x7fb7240cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72a6a0640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb724161100 0x7fb72415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72969e640 1 -- 172.21.15.130:0/2891159349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7240b4120 msgr2=0x7fb7240cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72969e640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7240b4120 0x7fb7240cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72969e640 1 -- 172.21.15.130:0/2891159349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb724161100 msgr2=0x7fb72415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72969e640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb724161100 0x7fb72415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72969e640 1 -- 172.21.15.130:0/2891159349 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720009420 con 0x7fb724146eb0 2023-09-13T06:05:27.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72969e640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb724146eb0 0x7fb7240ce620 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb7140ad040 tx=0x7fb71401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:27.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb71a7fc640 1 -- 172.21.15.130:0/2891159349 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7140be3f0 con 0x7fb724146eb0 2023-09-13T06:05:27.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb71a7fc640 1 -- 172.21.15.130:0/2891159349 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7140be570 con 0x7fb724146eb0 2023-09-13T06:05:27.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb71a7fc640 1 -- 172.21.15.130:0/2891159349 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7140be920 con 0x7fb724146eb0 2023-09-13T06:05:27.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72aea1640 1 -- 172.21.15.130:0/2891159349 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7140094d0 con 0x7fb724146eb0 2023-09-13T06:05:27.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72aea1640 1 -- 172.21.15.130:0/2891159349 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7240cbba0 con 0x7fb724146eb0 2023-09-13T06:05:27.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb72aea1640 1 -- 172.21.15.130:0/2891159349 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7240cbd90 con 0x7fb724146eb0 2023-09-13T06:05:27.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.641+0000 7fb71a7fc640 1 -- 172.21.15.130:0/2891159349 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb7140b43f0 con 0x7fb724146eb0 2023-09-13T06:05:27.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.645+0000 7fb71a7fc640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb708065b20 0x7fb708067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.645+0000 7fb71a7fc640 1 -- 172.21.15.130:0/2891159349 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb71411d5f0 con 0x7fb724146eb0 2023-09-13T06:05:27.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.645+0000 7fb729e9f640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb708065b20 0x7fb708067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.645+0000 7fb729e9f640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb708065b20 0x7fb708067fe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb72413f560 tx=0x7fb720008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:27.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.649+0000 7fb71a7fc640 1 -- 172.21.15.130:0/2891159349 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb7140eafe0 con 0x7fb724146eb0 2023-09-13T06:05:27.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.797+0000 7fb72aea1640 1 -- 172.21.15.130:0/2891159349 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7240618a0 con 0x7fb724146eb0 2023-09-13T06:05:27.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb71a7fc640 1 -- 172.21.15.130:0/2891159349 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fb7140ee600 con 0x7fb724146eb0 2023-09-13T06:05:27.802 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:27.802 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":82,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:05:26.836995+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:05:25.196040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-09-13T06:05:25.825807+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:27.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 -- 172.21.15.130:0/2891159349 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb708065b20 msgr2=0x7fb708067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb708065b20 0x7fb708067fe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb72413f560 tx=0x7fb720008040 comp rx=0 tx=0).stop 2023-09-13T06:05:27.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 -- 172.21.15.130:0/2891159349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb724146eb0 msgr2=0x7fb7240ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb724146eb0 0x7fb7240ce620 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb7140ad040 tx=0x7fb71401ad50 comp rx=0 tx=0).stop 2023-09-13T06:05:27.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 -- 172.21.15.130:0/2891159349 shutdown_connections 2023-09-13T06:05:27.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb708065b20 0x7fb708067fe0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb724161100 0x7fb72415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb724146eb0 0x7fb7240ce620 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 --2- 172.21.15.130:0/2891159349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7240b4120 0x7fb7240cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 -- 172.21.15.130:0/2891159349 >> 172.21.15.130:0/2891159349 conn(0x7fb7240cdd10 msgr2=0x7fb72415fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:27.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 -- 172.21.15.130:0/2891159349 shutdown_connections 2023-09-13T06:05:27.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.801+0000 7fb72aea1640 1 -- 172.21.15.130:0/2891159349 wait complete. 2023-09-13T06:05:27.822 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:27.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.957+0000 7f8eee982640 1 Processor -- start 2023-09-13T06:05:27.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.957+0000 7f8eee982640 1 -- start start 2023-09-13T06:05:27.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eee982640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ee81597d0 0x7f8ee806c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eee982640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8ee80ce0b0 0x7f8ee806f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eee982640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee806cc40 con 0x7f8ee806c7e0 2023-09-13T06:05:27.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eee982640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee806d120 con 0x7f8ee80ce0b0 2023-09-13T06:05:27.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eee982640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8159bb0 con 0x7f8ee81597d0 2023-09-13T06:05:27.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eecf1f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8ee80ce0b0 0x7f8ee806f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eecf1f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8ee80ce0b0 0x7f8ee806f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54668/0 (socket says 172.21.15.130:54668) 2023-09-13T06:05:27.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eecf1f640 1 -- 172.21.15.130:0/1484309984 learned_addr learned my addr 172.21.15.130:0/1484309984 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:27.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8ee7fff640 1 --2- 172.21.15.130:0/1484309984 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ee81597d0 0x7f8ee806c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eecf1f640 1 -- 172.21.15.130:0/1484309984 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ee81597d0 msgr2=0x7f8ee806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:27.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eecf1f640 1 --2- 172.21.15.130:0/1484309984 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ee81597d0 0x7f8ee806c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eecf1f640 1 -- 172.21.15.130:0/1484309984 >> v1:172.21.15.164:6789/0 conn(0x7f8ee806c7e0 legacy=0x7f8ee80cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.961+0000 7f8eecf1f640 1 -- 172.21.15.130:0/1484309984 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee80ce640 con 0x7f8ee80ce0b0 2023-09-13T06:05:27.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8eecf1f640 1 --2- 172.21.15.130:0/1484309984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ee80ce0b0 0x7f8ee806f200 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0009e50 tx=0x7f8ee001da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b2cbc299f416aa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:27.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8ee6ffd640 1 -- 172.21.15.130:0/1484309984 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00a68a0 con 0x7f8ee80ce0b0 2023-09-13T06:05:27.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8ee6ffd640 1 -- 172.21.15.130:0/1484309984 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee00a6a00 con 0x7f8ee80ce0b0 2023-09-13T06:05:27.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8ee6ffd640 1 -- 172.21.15.130:0/1484309984 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00a6d90 con 0x7f8ee80ce0b0 2023-09-13T06:05:27.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8eee982640 1 -- 172.21.15.130:0/1484309984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ee80ce0b0 msgr2=0x7f8ee806f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8eee982640 1 --2- 172.21.15.130:0/1484309984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ee80ce0b0 0x7f8ee806f200 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0009e50 tx=0x7f8ee001da60 comp rx=0 tx=0).stop 2023-09-13T06:05:27.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8eee982640 1 -- 172.21.15.130:0/1484309984 shutdown_connections 2023-09-13T06:05:27.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8eee982640 1 --2- 172.21.15.130:0/1484309984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ee80ce0b0 0x7f8ee806f200 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8eee982640 1 --2- 172.21.15.130:0/1484309984 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ee81597d0 0x7f8ee806c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8eee982640 1 -- 172.21.15.130:0/1484309984 >> 172.21.15.130:0/1484309984 conn(0x7f8ee80b0bc0 msgr2=0x7f8ee80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:27.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8eee982640 1 -- 172.21.15.130:0/1484309984 shutdown_connections 2023-09-13T06:05:27.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8eee982640 1 -- 172.21.15.130:0/1484309984 wait complete. 2023-09-13T06:05:27.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8eee982640 1 Processor -- start 2023-09-13T06:05:27.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.965+0000 7f8eee982640 1 -- start start 2023-09-13T06:05:27.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eee982640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ee806c7e0 0x7f8ee814f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eee982640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ee80ce0b0 0x7f8ee81504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eee982640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ee81597d0 0x7f8ee814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eee982640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee81500c0 con 0x7f8ee81597d0 2023-09-13T06:05:27.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eee982640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee81539d0 con 0x7f8ee806c7e0 2023-09-13T06:05:27.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eee982640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8150a20 con 0x7f8ee80ce0b0 2023-09-13T06:05:27.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eecf1f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ee81597d0 0x7f8ee814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eecf1f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ee81597d0 0x7f8ee814e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54670/0 (socket says 172.21.15.130:54670) 2023-09-13T06:05:27.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eecf1f640 1 -- 172.21.15.130:0/1390436690 learned_addr learned my addr 172.21.15.130:0/1390436690 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:27.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8ee7fff640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ee806c7e0 0x7f8ee814f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8ee77fe640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ee80ce0b0 0x7f8ee81504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eecf1f640 1 -- 172.21.15.130:0/1390436690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ee80ce0b0 msgr2=0x7f8ee81504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eecf1f640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ee80ce0b0 0x7f8ee81504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eecf1f640 1 -- 172.21.15.130:0/1390436690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ee806c7e0 msgr2=0x7f8ee814f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:27.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eecf1f640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ee806c7e0 0x7f8ee814f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:27.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eecf1f640 1 -- 172.21.15.130:0/1390436690 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee0009b30 con 0x7f8ee81597d0 2023-09-13T06:05:27.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eecf1f640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ee81597d0 0x7f8ee814e3b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8ee001b690 tx=0x7f8ee001c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:27.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8ee4ff9640 1 -- 172.21.15.130:0/1390436690 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00b8600 con 0x7f8ee81597d0 2023-09-13T06:05:27.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8ee4ff9640 1 -- 172.21.15.130:0/1390436690 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee00b8760 con 0x7f8ee81597d0 2023-09-13T06:05:27.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eee982640 1 -- 172.21.15.130:0/1390436690 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee815c580 con 0x7f8ee81597d0 2023-09-13T06:05:27.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8ee4ff9640 1 -- 172.21.15.130:0/1390436690 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00b8b10 con 0x7f8ee81597d0 2023-09-13T06:05:27.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eee982640 1 -- 172.21.15.130:0/1390436690 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee815c070 con 0x7f8ee81597d0 2023-09-13T06:05:27.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8eee982640 1 -- 172.21.15.130:0/1390436690 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee8150200 con 0x7f8ee81597d0 2023-09-13T06:05:27.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.969+0000 7f8ee4ff9640 1 -- 172.21.15.130:0/1390436690 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8ee00b8c70 con 0x7f8ee81597d0 2023-09-13T06:05:27.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.973+0000 7f8ee4ff9640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8ed4065af0 0x7f8ed4067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:27.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.973+0000 7f8ee4ff9640 1 -- 172.21.15.130:0/1390436690 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ee011e290 con 0x7f8ee81597d0 2023-09-13T06:05:27.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.973+0000 7f8ee7fff640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8ed4065af0 0x7f8ed4067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:27.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.973+0000 7f8ee7fff640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8ed4065af0 0x7f8ed4067fb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009ac0 tx=0x7f8ed8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:27.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:27.977+0000 7f8ee4ff9640 1 -- 172.21.15.130:0/1390436690 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8ee8150200 con 0x7f8ee81597d0 2023-09-13T06:05:28.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.125+0000 7f8eee982640 1 -- 172.21.15.130:0/1390436690 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ee8150200 con 0x7f8ee81597d0 2023-09-13T06:05:28.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8ee4ff9640 1 -- 172.21.15.130:0/1390436690 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f8ee8150200 con 0x7f8ee81597d0 2023-09-13T06:05:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:28.131 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":82,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:05:26.836995+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:05:25.196040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-09-13T06:05:25.825807+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:28.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 -- 172.21.15.130:0/1390436690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8ed4065af0 msgr2=0x7f8ed4067fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:28.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8ed4065af0 0x7f8ed4067fb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009ac0 tx=0x7f8ed8009190 comp rx=0 tx=0).stop 2023-09-13T06:05:28.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 -- 172.21.15.130:0/1390436690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ee81597d0 msgr2=0x7f8ee814e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:28.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ee81597d0 0x7f8ee814e3b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8ee001b690 tx=0x7f8ee001c2a0 comp rx=0 tx=0).stop 2023-09-13T06:05:28.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 -- 172.21.15.130:0/1390436690 shutdown_connections 2023-09-13T06:05:28.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8ed4065af0 0x7f8ed4067fb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:28.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ee81597d0 0x7f8ee814e3b0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:28.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ee80ce0b0 0x7f8ee81504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:28.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 --2- 172.21.15.130:0/1390436690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ee806c7e0 0x7f8ee814f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:28.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 -- 172.21.15.130:0/1390436690 >> 172.21.15.130:0/1390436690 conn(0x7f8ee80b0bc0 msgr2=0x7f8ee8070410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:28.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 -- 172.21.15.130:0/1390436690 shutdown_connections 2023-09-13T06:05:28.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.129+0000 7f8eee982640 1 -- 172.21.15.130:0/1390436690 wait complete. 2023-09-13T06:05:28.153 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T06:05:28.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.293+0000 7f4bb5d11640 1 Processor -- start 2023-09-13T06:05:28.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.293+0000 7f4bb5d11640 1 -- start start 2023-09-13T06:05:28.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.293+0000 7f4bb5d11640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4bb00b1460 0x7f4bb00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:28.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.293+0000 7f4bb5d11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bb00b2fd0 0x7f4bb00ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:28.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4bb5d11640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb00cc850 con 0x7f4bb015a080 2023-09-13T06:05:28.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4bb5d11640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb00b3420 con 0x7f4bb00b1460 2023-09-13T06:05:28.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4bb5d11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00b0330 con 0x7f4bb00b2fd0 2023-09-13T06:05:28.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baf7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4bb015a080 0x7f4bb015e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39672/0 (socket says 172.21.15.130:39672) 2023-09-13T06:05:28.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baf7fe640 1 -- 172.21.15.130:0/329070559 learned_addr learned my addr 172.21.15.130:0/329070559 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:28.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901770860 0 0) 0x7f4ba0001120 con 0x7f4bb015a080 2023-09-13T06:05:28.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baffff640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bb00b2fd0 0x7f4bb00ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:28.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b9c005740 con 0x7f4bb015a080 2023-09-13T06:05:28.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4ba7fff640 1 --2- 172.21.15.130:0/329070559 >> v2:172.21.15.164:3300/0 conn(0x7f4bb00b1460 0x7f4bb00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:28.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4240358625 0 0) 0x7f4b9c005740 con 0x7f4bb015a080 2023-09-13T06:05:28.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bb00b2fd0 msgr2=0x7f4bb00ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:28.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bb00b2fd0 0x7f4bb00ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:28.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 >> v2:172.21.15.164:3300/0 conn(0x7f4bb00b1460 msgr2=0x7f4bb00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:28.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 --2- 172.21.15.130:0/329070559 >> v2:172.21.15.164:3300/0 conn(0x7f4bb00b1460 0x7f4bb00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:28.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb00cbcd0 con 0x7f4bb015a080 2023-09-13T06:05:28.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f4ba0001830 con 0x7f4bb015a080 2023-09-13T06:05:28.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 >> v1:172.21.15.130:6789/0 conn(0x7f4bb015a080 legacy=0x7f4bb015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:28.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bb00b2fd0 0x7f4b9c005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:28.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b9c006180 0x7f4b9c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:28.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b9c006f20 0x7f4b9c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:28.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00b3420 con 0x7f4b9c006180 2023-09-13T06:05:28.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00b0330 con 0x7f4b9c006f20 2023-09-13T06:05:28.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c00dc50 con 0x7f4bb00b2fd0 2023-09-13T06:05:28.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4ba7fff640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b9c006180 0x7f4b9c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:28.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baffff640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b9c006f20 0x7f4b9c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:28.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baf7fe640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bb00b2fd0 0x7f4b9c005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:28.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4ba7fff640 1 -- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bb00b2fd0 msgr2=0x7f4b9c005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:28.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4ba7fff640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bb00b2fd0 0x7f4b9c005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:28.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4ba7fff640 1 -- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b9c006f20 msgr2=0x7f4b9c0073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:28.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4ba7fff640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b9c006f20 0x7f4b9c0073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:28.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4ba7fff640 1 -- 172.21.15.130:0/329070559 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c005740 con 0x7f4b9c006180 2023-09-13T06:05:28.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.297+0000 7f4baf7fe640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bb00b2fd0 0x7f4b9c005c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:28.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4ba7fff640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b9c006180 0x7f4b9c0069e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009ae0 tx=0x7f4b9801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de40f4ff7c41617 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:28.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980a5540 con 0x7f4b9c006180 2023-09-13T06:05:28.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b980a56a0 con 0x7f4b9c006180 2023-09-13T06:05:28.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4baeffd640 1 -- 172.21.15.130:0/329070559 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980a5a50 con 0x7f4b9c006180 2023-09-13T06:05:28.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4bb5d11640 1 -- 172.21.15.130:0/329070559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b9c006180 msgr2=0x7f4b9c0069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:28.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4bb5d11640 1 --2- 172.21.15.130:0/329070559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b9c006180 0x7f4b9c0069e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009ae0 tx=0x7f4b9801ca60 comp rx=0 tx=0).stop 2023-09-13T06:05:28.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4baffff640 1 -- 172.21.15.130:0/329070559 reap_dead start 2023-09-13T06:05:28.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4bb5d11640 1 -- 172.21.15.130:0/329070559 shutdown_connections 2023-09-13T06:05:28.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4bb5d11640 1 -- 172.21.15.130:0/329070559 >> 172.21.15.130:0/329070559 conn(0x7f4bb0065990 msgr2=0x7f4bb0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:28.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4bb5d11640 1 -- 172.21.15.130:0/329070559 shutdown_connections 2023-09-13T06:05:28.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4bb5d11640 1 -- 172.21.15.130:0/329070559 wait complete. 2023-09-13T06:05:28.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4bb5d11640 1 Processor -- start 2023-09-13T06:05:28.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.301+0000 7f4bb5d11640 1 -- start start 2023-09-13T06:05:28.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bb5d11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4b9c006180 0x7f4bb0152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:28.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bb5d11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bb01f91d0 0x7f4bb01f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:28.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bb5d11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bb01f6310 0x7f4bb01f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:28.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bb5d11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01fa1c0 con 0x7f4bb01f6310 2023-09-13T06:05:28.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bb5d11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01f5b90 con 0x7f4bb01f91d0 2023-09-13T06:05:28.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bb5d11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01f9650 con 0x7f4b9c006180 2023-09-13T06:05:28.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4baffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bb01f6310 0x7f4bb01f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:28.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4baffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bb01f6310 0x7f4bb01f67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54686/0 (socket says 172.21.15.130:54686) 2023-09-13T06:05:28.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4baffff640 1 -- 172.21.15.130:0/2519786273 learned_addr learned my addr 172.21.15.130:0/2519786273 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:28.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4ba7fff640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bb01f91d0 0x7f4bb01f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:28.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4baffff640 1 -- 172.21.15.130:0/2519786273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4b9c006180 msgr2=0x7f4bb0152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:28.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4baf7fe640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4b9c006180 0x7f4bb0152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:28.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4baffff640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4b9c006180 0x7f4bb0152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:28.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4baffff640 1 -- 172.21.15.130:0/2519786273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bb01f91d0 msgr2=0x7f4bb01f3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:28.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4baffff640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bb01f91d0 0x7f4bb01f3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:28.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4baffff640 1 -- 172.21.15.130:0/2519786273 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb01f9920 con 0x7f4bb01f6310 2023-09-13T06:05:28.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4ba7fff640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bb01f91d0 0x7f4bb01f3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:28.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4baf7fe640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4b9c006180 0x7f4bb0152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:28.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4baffff640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bb01f6310 0x7f4bb01f67c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00d0000 tx=0x7f4ba800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:28.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bacff9640 1 -- 172.21.15.130:0/2519786273 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800e040 con 0x7f4bb01f6310 2023-09-13T06:05:28.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bacff9640 1 -- 172.21.15.130:0/2519786273 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba800f040 con 0x7f4bb01f6310 2023-09-13T06:05:28.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bacff9640 1 -- 172.21.15.130:0/2519786273 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8015430 con 0x7f4bb01f6310 2023-09-13T06:05:28.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bb5d11640 1 -- 172.21.15.130:0/2519786273 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb01f9c00 con 0x7f4bb01f6310 2023-09-13T06:05:28.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bb5d11640 1 -- 172.21.15.130:0/2519786273 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb01f5df0 con 0x7f4bb01f6310 2023-09-13T06:05:28.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bb5d11640 1 -- 172.21.15.130:0/2519786273 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb01f6010 con 0x7f4bb01f6310 2023-09-13T06:05:28.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.305+0000 7f4bacff9640 1 -- 172.21.15.130:0/2519786273 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4ba8015590 con 0x7f4bb01f6310 2023-09-13T06:05:28.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.309+0000 7f4bacff9640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4b90065b20 0x7f4b90067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:28.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.309+0000 7f4bacff9640 1 -- 172.21.15.130:0/2519786273 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ba8083990 con 0x7f4bb01f6310 2023-09-13T06:05:28.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.309+0000 7f4baf7fe640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4b90065b20 0x7f4b90067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:28.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.309+0000 7f4baf7fe640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4b90065b20 0x7f4b90067fe0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00ae040 tx=0x7f4ba0000f00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:28.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.313+0000 7f4bacff9640 1 -- 172.21.15.130:0/2519786273 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4ba80512e0 con 0x7f4bb01f6310 2023-09-13T06:05:28.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:28.497+0000 7f4bb5d11640 1 -- 172.21.15.130:0/2519786273 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4bb00618a0 con 0x7f4bb01f6310 2023-09-13T06:05:29.435 INFO:tasks.ceph.mds.a.smithi130.stderr:2023-09-13T06:05:29.433+0000 7f290104b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:05:29.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.489+0000 7f4bacff9640 1 -- 172.21.15.130:0/2519786273 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4ba8054900 con 0x7f4bb01f6310 2023-09-13T06:05:29.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 -- 172.21.15.130:0/2519786273 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4b90065b20 msgr2=0x7f4b90067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:29.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4b90065b20 0x7f4b90067fe0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00ae040 tx=0x7f4ba0000f00 comp rx=0 tx=0).stop 2023-09-13T06:05:29.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 -- 172.21.15.130:0/2519786273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bb01f6310 msgr2=0x7f4bb01f67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:29.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bb01f6310 0x7f4bb01f67c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00d0000 tx=0x7f4ba800f580 comp rx=0 tx=0).stop 2023-09-13T06:05:29.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 -- 172.21.15.130:0/2519786273 shutdown_connections 2023-09-13T06:05:29.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4b90065b20 0x7f4b90067fe0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:29.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bb01f91d0 0x7f4bb01f3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:29.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bb01f6310 0x7f4bb01f67c0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:29.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 --2- 172.21.15.130:0/2519786273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4b9c006180 0x7f4bb0152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:29.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 -- 172.21.15.130:0/2519786273 >> 172.21.15.130:0/2519786273 conn(0x7f4bb0065990 msgr2=0x7f4bb00b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:29.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 -- 172.21.15.130:0/2519786273 shutdown_connections 2023-09-13T06:05:29.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.493+0000 7f4bb5d11640 1 -- 172.21.15.130:0/2519786273 wait complete. 2023-09-13T06:05:29.517 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T06:05:29.517 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T06:05:29.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.661+0000 7f168ffd2640 1 Processor -- start 2023-09-13T06:05:29.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.661+0000 7f168ffd2640 1 -- start start 2023-09-13T06:05:29.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.661+0000 7f168ffd2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1688144d70 0x7f16880ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:29.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.661+0000 7f168ffd2640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f16880b2780 0x7f16880b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:29.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.661+0000 7f168ffd2640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16880b3120 con 0x7f16880b1460 2023-09-13T06:05:29.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.661+0000 7f168ffd2640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16880b2430 con 0x7f16880b2780 2023-09-13T06:05:29.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.661+0000 7f168ffd2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16880cedb0 con 0x7f1688144d70 2023-09-13T06:05:29.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168e56f640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f16880b1460 0x7f16880b18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39684/0 (socket says 172.21.15.130:39684) 2023-09-13T06:05:29.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168e56f640 1 -- 172.21.15.130:0/4099887533 learned_addr learned my addr 172.21.15.130:0/4099887533 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:29.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168d56d640 1 --2- 172.21.15.130:0/4099887533 >> v2:172.21.15.164:3300/0 conn(0x7f16880b2780 0x7f16880b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:29.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168dd6e640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1688144d70 0x7f16880ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:29.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127079671 0 0) 0x7f16880b3120 con 0x7f16880b1460 2023-09-13T06:05:29.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1674003530 con 0x7f16880b1460 2023-09-13T06:05:29.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1724804543 0 0) 0x7f1674003530 con 0x7f16880b1460 2023-09-13T06:05:29.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1688144d70 msgr2=0x7f16880ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:29.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1688144d70 0x7f16880ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:29.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 >> v2:172.21.15.164:3300/0 conn(0x7f16880b2780 msgr2=0x7f16880b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:29.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 --2- 172.21.15.130:0/4099887533 >> v2:172.21.15.164:3300/0 conn(0x7f16880b2780 0x7f16880b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:29.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16880b2150 con 0x7f16880b1460 2023-09-13T06:05:29.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f1680001a00 con 0x7f16880b1460 2023-09-13T06:05:29.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 >> v1:172.21.15.130:6789/0 conn(0x7f16880b1460 legacy=0x7f16880b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:29.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1688144d70 0x7f16740039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:29.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1674003f70 0x7f16740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:29.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 0x7f1674005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:29.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16880b2430 con 0x7f1674004d10 2023-09-13T06:05:29.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167400b990 con 0x7f1674003f70 2023-09-13T06:05:29.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167400bb00 con 0x7f1688144d70 2023-09-13T06:05:29.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168e56f640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 0x7f1674005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:29.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168dd6e640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1688144d70 0x7f16740039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:29.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168d56d640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1674003f70 0x7f16740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:29.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168e56f640 1 -- 172.21.15.130:0/4099887533 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1688144d70 msgr2=0x7f16740039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:29.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168e56f640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1688144d70 0x7f16740039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:29.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168e56f640 1 -- 172.21.15.130:0/4099887533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1674003f70 msgr2=0x7f16740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:29.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168e56f640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1674003f70 0x7f16740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:29.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.665+0000 7f168e56f640 1 -- 172.21.15.130:0/4099887533 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1674003530 con 0x7f1674004d10 2023-09-13T06:05:29.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168e56f640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 0x7f1674005190 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f168000a860 tx=0x7f168001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb96b1fc56b69e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:29.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16800ad630 con 0x7f1674004d10 2023-09-13T06:05:29.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16800a8070 con 0x7f1674004d10 2023-09-13T06:05:29.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168cd6c640 1 -- 172.21.15.130:0/4099887533 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16800ada30 con 0x7f1674004d10 2023-09-13T06:05:29.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168ffd2640 1 -- 172.21.15.130:0/4099887533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 msgr2=0x7f1674005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:29.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168ffd2640 1 --2- 172.21.15.130:0/4099887533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 0x7f1674005190 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f168000a860 tx=0x7f168001d360 comp rx=0 tx=0).stop 2023-09-13T06:05:29.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168e56f640 1 -- 172.21.15.130:0/4099887533 reap_dead start 2023-09-13T06:05:29.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168ffd2640 1 -- 172.21.15.130:0/4099887533 shutdown_connections 2023-09-13T06:05:29.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168ffd2640 1 -- 172.21.15.130:0/4099887533 >> 172.21.15.130:0/4099887533 conn(0x7f1688065990 msgr2=0x7f1688065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:29.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168ffd2640 1 -- 172.21.15.130:0/4099887533 shutdown_connections 2023-09-13T06:05:29.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168ffd2640 1 -- 172.21.15.130:0/4099887533 wait complete. 2023-09-13T06:05:29.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168ffd2640 1 Processor -- start 2023-09-13T06:05:29.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.669+0000 7f168ffd2640 1 -- start start 2023-09-13T06:05:29.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168ffd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 0x7f1688137f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:29.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168ffd2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f168815cb80 0x7f168813e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:29.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168ffd2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f168815b2b0 0x7f168813a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:29.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168ffd2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16881386c0 con 0x7f1674004d10 2023-09-13T06:05:29.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168ffd2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168813e5e0 con 0x7f168815cb80 2023-09-13T06:05:29.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168ffd2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16881388a0 con 0x7f168815b2b0 2023-09-13T06:05:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168dd6e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 0x7f1688137f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168dd6e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 0x7f1688137f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54704/0 (socket says 172.21.15.130:54704) 2023-09-13T06:05:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168dd6e640 1 -- 172.21.15.130:0/100132155 learned_addr learned my addr 172.21.15.130:0/100132155 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168d56d640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f168815cb80 0x7f168813e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168e56f640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f168815b2b0 0x7f168813a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168dd6e640 1 -- 172.21.15.130:0/100132155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f168815b2b0 msgr2=0x7f168813a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:29.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168dd6e640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f168815b2b0 0x7f168813a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:29.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168dd6e640 1 -- 172.21.15.130:0/100132155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f168815cb80 msgr2=0x7f168813e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:29.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168dd6e640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f168815cb80 0x7f168813e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:29.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168dd6e640 1 -- 172.21.15.130:0/100132155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1688138b80 con 0x7f1674004d10 2023-09-13T06:05:29.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168dd6e640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 0x7f1688137f40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f16840119d0 tx=0x7f1684011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:29.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f167e7fc640 1 -- 172.21.15.130:0/100132155 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400faf0 con 0x7f1674004d10 2023-09-13T06:05:29.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f167e7fc640 1 -- 172.21.15.130:0/100132155 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168400fc50 con 0x7f1674004d10 2023-09-13T06:05:29.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f167e7fc640 1 -- 172.21.15.130:0/100132155 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684014440 con 0x7f1674004d10 2023-09-13T06:05:29.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168ffd2640 1 -- 172.21.15.130:0/100132155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168815c660 con 0x7f1674004d10 2023-09-13T06:05:29.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168ffd2640 1 -- 172.21.15.130:0/100132155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168815b730 con 0x7f1674004d10 2023-09-13T06:05:29.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f168ffd2640 1 -- 172.21.15.130:0/100132155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16880618a0 con 0x7f1674004d10 2023-09-13T06:05:29.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.673+0000 7f167e7fc640 1 -- 172.21.15.130:0/100132155 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f16840145a0 con 0x7f1674004d10 2023-09-13T06:05:29.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.677+0000 7f167e7fc640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f166c065b50 0x7f166c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:29.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.677+0000 7f167e7fc640 1 -- 172.21.15.130:0/100132155 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16840839d0 con 0x7f1674004d10 2023-09-13T06:05:29.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.677+0000 7f168d56d640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f166c065b50 0x7f166c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:29.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.677+0000 7f168d56d640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f166c065b50 0x7f166c068010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f168806cff0 tx=0x7f1678009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:29.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.681+0000 7f167e7fc640 1 -- 172.21.15.130:0/100132155 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f16840513d0 con 0x7f1674004d10 2023-09-13T06:05:29.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:29.857+0000 7f168ffd2640 1 -- 172.21.15.130:0/100132155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f16881448d0 con 0x7f1674004d10 2023-09-13T06:05:30.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.489+0000 7f167e7fc640 1 -- 172.21.15.130:0/100132155 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7f16840220c0 con 0x7f1674004d10 2023-09-13T06:05:30.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 -- 172.21.15.130:0/100132155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f166c065b50 msgr2=0x7f166c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:30.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f166c065b50 0x7f166c068010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f168806cff0 tx=0x7f1678009190 comp rx=0 tx=0).stop 2023-09-13T06:05:30.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 -- 172.21.15.130:0/100132155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 msgr2=0x7f1688137f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:30.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 0x7f1688137f40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f16840119d0 tx=0x7f1684011dd0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 -- 172.21.15.130:0/100132155 shutdown_connections 2023-09-13T06:05:30.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f166c065b50 0x7f166c068010 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f168815cb80 0x7f168813e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f168815b2b0 0x7f168813a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 --2- 172.21.15.130:0/100132155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1674004d10 0x7f1688137f40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 -- 172.21.15.130:0/100132155 >> 172.21.15.130:0/100132155 conn(0x7f1688065990 msgr2=0x7f16880b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:30.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 -- 172.21.15.130:0/100132155 shutdown_connections 2023-09-13T06:05:30.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.493+0000 7f168ffd2640 1 -- 172.21.15.130:0/100132155 wait complete. 2023-09-13T06:05:30.517 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T06:05:30.517 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:05:30.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e7ccb640 1 Processor -- start 2023-09-13T06:05:30.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e7ccb640 1 -- start start 2023-09-13T06:05:30.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e7ccb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f98e0070180 0x7f98e0070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:30.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e7ccb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f98e00cfda0 0x7f98e00d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:30.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e7ccb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e0146d70 con 0x7f98e0160790 2023-09-13T06:05:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e7ccb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e0070b50 con 0x7f98e0070180 2023-09-13T06:05:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e7ccb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e0161a40 con 0x7f98e00cfda0 2023-09-13T06:05:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e5266640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f98e0070180 0x7f98e0070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:30.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e5a67640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f98e0160790 0x7f98e00b6f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:39700/0 (socket says 172.21.15.130:39700) 2023-09-13T06:05:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e5a67640 1 -- 172.21.15.130:0/4282948996 learned_addr learned my addr 172.21.15.130:0/4282948996 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e6268640 1 --2- 172.21.15.130:0/4282948996 >> v2:172.21.15.164:3300/0 conn(0x7f98e00cfda0 0x7f98e00d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e5266640 1 -- 172.21.15.130:0/4282948996 >> v2:172.21.15.164:3300/0 conn(0x7f98e00cfda0 msgr2=0x7f98e00d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e5266640 1 --2- 172.21.15.130:0/4282948996 >> v2:172.21.15.164:3300/0 conn(0x7f98e00cfda0 0x7f98e00d0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e5266640 1 -- 172.21.15.130:0/4282948996 >> v1:172.21.15.130:6789/0 conn(0x7f98e0160790 legacy=0x7f98e00b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:30.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e5266640 1 -- 172.21.15.130:0/4282948996 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0161d20 con 0x7f98e0070180 2023-09-13T06:05:30.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.657+0000 7f98e4a65640 1 -- 172.21.15.130:0/4282948996 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308512454 0 0) 0x7f98e0146d70 con 0x7f98e0160790 2023-09-13T06:05:30.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e5266640 1 --2- 172.21.15.130:0/4282948996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98e0070180 0x7f98e0070610 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f98d00097c0 tx=0x7f98d001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28758a09d79d700b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:30.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e4a65640 1 -- 172.21.15.130:0/4282948996 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00ad680 con 0x7f98e0070180 2023-09-13T06:05:30.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e4a65640 1 -- 172.21.15.130:0/4282948996 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d00ad7e0 con 0x7f98e0070180 2023-09-13T06:05:30.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e4a65640 1 -- 172.21.15.130:0/4282948996 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00adb70 con 0x7f98e0070180 2023-09-13T06:05:30.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e7ccb640 1 -- 172.21.15.130:0/4282948996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98e0070180 msgr2=0x7f98e0070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:30.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e7ccb640 1 --2- 172.21.15.130:0/4282948996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98e0070180 0x7f98e0070610 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f98d00097c0 tx=0x7f98d001c380 comp rx=0 tx=0).stop 2023-09-13T06:05:30.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e7ccb640 1 -- 172.21.15.130:0/4282948996 shutdown_connections 2023-09-13T06:05:30.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e7ccb640 1 --2- 172.21.15.130:0/4282948996 >> v2:172.21.15.164:3300/0 conn(0x7f98e00cfda0 0x7f98e00d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e7ccb640 1 --2- 172.21.15.130:0/4282948996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98e0070180 0x7f98e0070610 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e7ccb640 1 -- 172.21.15.130:0/4282948996 >> 172.21.15.130:0/4282948996 conn(0x7f98e00d33a0 msgr2=0x7f98e00d37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:30.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e7ccb640 1 -- 172.21.15.130:0/4282948996 shutdown_connections 2023-09-13T06:05:30.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.661+0000 7f98e7ccb640 1 -- 172.21.15.130:0/4282948996 wait complete. 2023-09-13T06:05:30.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e7ccb640 1 Processor -- start 2023-09-13T06:05:30.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e7ccb640 1 -- start start 2023-09-13T06:05:30.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e7ccb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98e0070180 0x7f98e00b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e7ccb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98e00cfda0 0x7f98e0164f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e7ccb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98e0160790 0x7f98e015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e7ccb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0162000 con 0x7f98e0070180 2023-09-13T06:05:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e7ccb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e01622a0 con 0x7f98e0160790 2023-09-13T06:05:30.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e7ccb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0162580 con 0x7f98e00cfda0 2023-09-13T06:05:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e5a67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98e0070180 0x7f98e00b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e5a67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98e0070180 0x7f98e00b7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54722/0 (socket says 172.21.15.130:54722) 2023-09-13T06:05:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e5a67640 1 -- 172.21.15.130:0/1623101503 learned_addr learned my addr 172.21.15.130:0/1623101503 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e6268640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98e0160790 0x7f98e015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:30.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e5266640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98e00cfda0 0x7f98e0164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e5a67640 1 -- 172.21.15.130:0/1623101503 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98e00cfda0 msgr2=0x7f98e0164f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e5a67640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98e00cfda0 0x7f98e0164f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e5a67640 1 -- 172.21.15.130:0/1623101503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98e0160790 msgr2=0x7f98e015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e5a67640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98e0160790 0x7f98e015b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e5a67640 1 -- 172.21.15.130:0/1623101503 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d0009420 con 0x7f98e0070180 2023-09-13T06:05:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e6268640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98e0160790 0x7f98e015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e5a67640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98e0070180 0x7f98e00b7d20 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f98dc001570 tx=0x7f98dc00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98d67fc640 1 -- 172.21.15.130:0/1623101503 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00a640 con 0x7f98e0070180 2023-09-13T06:05:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98d67fc640 1 -- 172.21.15.130:0/1623101503 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc00a7c0 con 0x7f98e0070180 2023-09-13T06:05:30.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98d67fc640 1 -- 172.21.15.130:0/1623101503 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00ab70 con 0x7f98e0070180 2023-09-13T06:05:30.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e7ccb640 1 -- 172.21.15.130:0/1623101503 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e0162860 con 0x7f98e0070180 2023-09-13T06:05:30.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e7ccb640 1 -- 172.21.15.130:0/1623101503 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e00b8260 con 0x7f98e0070180 2023-09-13T06:05:30.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.665+0000 7f98e7ccb640 1 -- 172.21.15.130:0/1623101503 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e00618a0 con 0x7f98e0070180 2023-09-13T06:05:30.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.669+0000 7f98d67fc640 1 -- 172.21.15.130:0/1623101503 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f98dc00acd0 con 0x7f98e0070180 2023-09-13T06:05:30.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.669+0000 7f98d67fc640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f98c4065b50 0x7f98c4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:30.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.669+0000 7f98d67fc640 1 -- 172.21.15.130:0/1623101503 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98dc0827f0 con 0x7f98e0070180 2023-09-13T06:05:30.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.669+0000 7f98e5266640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f98c4065b50 0x7f98c4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:30.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.669+0000 7f98e5266640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f98c4065b50 0x7f98c4068010 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f98d00af000 tx=0x7f98d00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:30.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.673+0000 7f98d67fc640 1 -- 172.21.15.130:0/1623101503 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f98dc050150 con 0x7f98e0070180 2023-09-13T06:05:30.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.853+0000 7f98e7ccb640 1 -- 172.21.15.130:0/1623101503 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98e0143930 con 0x7f98e0070180 2023-09-13T06:05:30.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.853+0000 7f98d67fc640 1 -- 172.21.15.130:0/1623101503 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f98dc018090 con 0x7f98e0070180 2023-09-13T06:05:30.856 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:30.856 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2267621007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2267621007},{"type":"v1","addr":"172.21.15.164:6834","nonce":2267621007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5663,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/658594571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":658594571},{"type":"v1","addr":"172.21.15.164:6835","nonce":658594571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6474,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1441650800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1441650800},{"type":"v1","addr":"172.21.15.130:6836","nonce":1441650800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:05:26.837419+0000","modified":"2023-09-13T06:05:29.861380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6477},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6477":{"gid":6477,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/428674793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":428674793},{"type":"v1","addr":"172.21.15.130:6837","nonce":428674793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-09-13T06:05:30.857 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 43 2023-09-13T06:05:30.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 -- 172.21.15.130:0/1623101503 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f98c4065b50 msgr2=0x7f98c4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:30.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f98c4065b50 0x7f98c4068010 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f98d00af000 tx=0x7f98d00a7000 comp rx=0 tx=0).stop 2023-09-13T06:05:30.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 -- 172.21.15.130:0/1623101503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98e0070180 msgr2=0x7f98e00b7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:30.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98e0070180 0x7f98e00b7d20 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f98dc001570 tx=0x7f98dc00cd20 comp rx=0 tx=0).stop 2023-09-13T06:05:30.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 -- 172.21.15.130:0/1623101503 shutdown_connections 2023-09-13T06:05:30.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f98c4065b50 0x7f98c4068010 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98e0160790 0x7f98e015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98e00cfda0 0x7f98e0164f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 --2- 172.21.15.130:0/1623101503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98e0070180 0x7f98e00b7d20 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:30.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 -- 172.21.15.130:0/1623101503 >> 172.21.15.130:0/1623101503 conn(0x7f98e00d33a0 msgr2=0x7f98e015fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:30.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 -- 172.21.15.130:0/1623101503 shutdown_connections 2023-09-13T06:05:30.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:30.857+0000 7f98e7ccb640 1 -- 172.21.15.130:0/1623101503 wait complete. 2023-09-13T06:05:30.877 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:31.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e87774640 1 Processor -- start 2023-09-13T06:05:31.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e87774640 1 -- start start 2023-09-13T06:05:31.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e87774640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0e8015b130 0x7f0e800cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e87774640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e800ce980 con 0x7f0e800b04a0 2023-09-13T06:05:31.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e87774640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e800cec60 con 0x7f0e800ce180 2023-09-13T06:05:31.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e87774640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8006c640 con 0x7f0e8015b130 2023-09-13T06:05:31.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e85d11640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0e800b04a0 0x7f0e8006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42890/0 (socket says 172.21.15.130:42890) 2023-09-13T06:05:31.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e85d11640 1 -- 172.21.15.130:0/3501898785 learned_addr learned my addr 172.21.15.130:0/3501898785 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:31.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e85510640 1 --2- 172.21.15.130:0/3501898785 >> v2:172.21.15.164:3300/0 conn(0x7f0e8015b130 0x7f0e800cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460720439 0 0) 0x7f0e800ce980 con 0x7f0e800b04a0 2023-09-13T06:05:31.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e6c003530 con 0x7f0e800b04a0 2023-09-13T06:05:31.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 250716578 0 0) 0x7f0e6c003530 con 0x7f0e800b04a0 2023-09-13T06:05:31.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 >> v2:172.21.15.164:3300/0 conn(0x7f0e8015b130 msgr2=0x7f0e800cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:31.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 --2- 172.21.15.130:0/3501898785 >> v2:172.21.15.164:3300/0 conn(0x7f0e8015b130 0x7f0e800cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 >> v1:172.21.15.164:6789/0 conn(0x7f0e800ce180 legacy=0x7f0e8015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8006c920 con 0x7f0e800b04a0 2023-09-13T06:05:31.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f0e78001a00 con 0x7f0e800b04a0 2023-09-13T06:05:31.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 >> v1:172.21.15.130:6789/0 conn(0x7f0e800b04a0 legacy=0x7f0e8006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e6c0039f0 0x7f0e6c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e6c0047d0 0x7f0e6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e6c005190 0x7f0e6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8006c640 con 0x7f0e6c0039f0 2023-09-13T06:05:31.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c00c0c0 con 0x7f0e6c005190 2023-09-13T06:05:31.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.013+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c00c280 con 0x7f0e6c0047d0 2023-09-13T06:05:31.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e85510640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e6c0039f0 0x7f0e6c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e84d0f640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e6c0047d0 0x7f0e6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e85d11640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e6c005190 0x7f0e6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e85510640 1 -- 172.21.15.130:0/3501898785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e6c0047d0 msgr2=0x7f0e6c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:31.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e85510640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e6c0047d0 0x7f0e6c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e85510640 1 -- 172.21.15.130:0/3501898785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e6c005190 msgr2=0x7f0e6c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:31.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e85510640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e6c005190 0x7f0e6c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e85510640 1 -- 172.21.15.130:0/3501898785 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c003530 con 0x7f0e6c0039f0 2023-09-13T06:05:31.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e85d11640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e6c005190 0x7f0e6c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:31.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e85d11640 1 -- 172.21.15.130:0/3501898785 reap_dead start 2023-09-13T06:05:31.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e85510640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e6c0039f0 0x7f0e6c003e10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c009ae0 tx=0x7f0e7c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ae9c97609c361d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:31.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0a55f0 con 0x7f0e6c0039f0 2023-09-13T06:05:31.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c0a5750 con 0x7f0e6c0039f0 2023-09-13T06:05:31.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e77fff640 1 -- 172.21.15.130:0/3501898785 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0a5b00 con 0x7f0e6c0039f0 2023-09-13T06:05:31.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e87774640 1 -- 172.21.15.130:0/3501898785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e6c0039f0 msgr2=0x7f0e6c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.017+0000 7f0e87774640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e6c0039f0 0x7f0e6c003e10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c009ae0 tx=0x7f0e7c01ca20 comp rx=0 tx=0).stop 2023-09-13T06:05:31.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 -- 172.21.15.130:0/3501898785 shutdown_connections 2023-09-13T06:05:31.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 --2- 172.21.15.130:0/3501898785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e6c0039f0 0x7f0e6c003e10 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 -- 172.21.15.130:0/3501898785 >> 172.21.15.130:0/3501898785 conn(0x7f0e80065990 msgr2=0x7f0e80065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:31.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 -- 172.21.15.130:0/3501898785 shutdown_connections 2023-09-13T06:05:31.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 -- 172.21.15.130:0/3501898785 wait complete. 2023-09-13T06:05:31.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 Processor -- start 2023-09-13T06:05:31.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 -- start start 2023-09-13T06:05:31.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e6c0039f0 0x7f0e800a8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e80156d20 0x7f0e8014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e800aa740 0x7f0e800aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800ab110 con 0x7f0e80156d20 2023-09-13T06:05:31.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800a9200 con 0x7f0e6c0039f0 2023-09-13T06:05:31.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800a94e0 con 0x7f0e800aa740 2023-09-13T06:05:31.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e84d0f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e80156d20 0x7f0e8014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e84d0f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e80156d20 0x7f0e8014aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40422/0 (socket says 172.21.15.130:40422) 2023-09-13T06:05:31.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e84d0f640 1 -- 172.21.15.130:0/3006993709 learned_addr learned my addr 172.21.15.130:0/3006993709 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:31.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e84d0f640 1 -- 172.21.15.130:0/3006993709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e800aa740 msgr2=0x7f0e800aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e84d0f640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e800aa740 0x7f0e800aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e84d0f640 1 -- 172.21.15.130:0/3006993709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e6c0039f0 msgr2=0x7f0e800a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e84d0f640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e6c0039f0 0x7f0e800a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e84d0f640 1 -- 172.21.15.130:0/3006993709 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800a97c0 con 0x7f0e80156d20 2023-09-13T06:05:31.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e84d0f640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e80156d20 0x7f0e8014aa50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000f820 tx=0x7f0e7000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:31.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e75ffb640 1 -- 172.21.15.130:0/3006993709 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70001cf0 con 0x7f0e80156d20 2023-09-13T06:05:31.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e75ffb640 1 -- 172.21.15.130:0/3006993709 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e700052e0 con 0x7f0e80156d20 2023-09-13T06:05:31.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e75ffb640 1 -- 172.21.15.130:0/3006993709 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7000d8d0 con 0x7f0e80156d20 2023-09-13T06:05:31.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.021+0000 7f0e87774640 1 -- 172.21.15.130:0/3006993709 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e800a9aa0 con 0x7f0e80156d20 2023-09-13T06:05:31.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.025+0000 7f0e87774640 1 -- 172.21.15.130:0/3006993709 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e800a8e40 con 0x7f0e80156d20 2023-09-13T06:05:31.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.025+0000 7f0e87774640 1 -- 172.21.15.130:0/3006993709 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e800618a0 con 0x7f0e80156d20 2023-09-13T06:05:31.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.025+0000 7f0e75ffb640 1 -- 172.21.15.130:0/3006993709 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0e7000da30 con 0x7f0e80156d20 2023-09-13T06:05:31.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.025+0000 7f0e75ffb640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e64065b50 0x7f0e64068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.025+0000 7f0e75ffb640 1 -- 172.21.15.130:0/3006993709 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e70083260 con 0x7f0e80156d20 2023-09-13T06:05:31.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.025+0000 7f0e85510640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e64065b50 0x7f0e64068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.025+0000 7f0e85510640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e64065b50 0x7f0e64068010 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0af000 tx=0x7f0e7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:31.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.029+0000 7f0e75ffb640 1 -- 172.21.15.130:0/3006993709 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0e70050b10 con 0x7f0e80156d20 2023-09-13T06:05:31.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 -- 172.21.15.130:0/3006993709 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e800a9f50 con 0x7f0e80156d20 2023-09-13T06:05:31.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e75ffb640 1 -- 172.21.15.130:0/3006993709 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16604 (secure 0 0 0) 0x7f0e70054130 con 0x7f0e80156d20 2023-09-13T06:05:31.182 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:31.183 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":83,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:05:28.345769+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:05:25.196040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-09-13T06:05:25.825807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:31.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 -- 172.21.15.130:0/3006993709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e64065b50 msgr2=0x7f0e64068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e64065b50 0x7f0e64068010 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0af000 tx=0x7f0e7c008040 comp rx=0 tx=0).stop 2023-09-13T06:05:31.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 -- 172.21.15.130:0/3006993709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e80156d20 msgr2=0x7f0e8014aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e80156d20 0x7f0e8014aa50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000f820 tx=0x7f0e7000fce0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 -- 172.21.15.130:0/3006993709 shutdown_connections 2023-09-13T06:05:31.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e64065b50 0x7f0e64068010 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e800aa740 0x7f0e800aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e80156d20 0x7f0e8014aa50 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 --2- 172.21.15.130:0/3006993709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e6c0039f0 0x7f0e800a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 -- 172.21.15.130:0/3006993709 >> 172.21.15.130:0/3006993709 conn(0x7f0e80065990 msgr2=0x7f0e80158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:31.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 -- 172.21.15.130:0/3006993709 shutdown_connections 2023-09-13T06:05:31.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.181+0000 7f0e87774640 1 -- 172.21.15.130:0/3006993709 wait complete. 2023-09-13T06:05:31.204 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T06:05:31.204 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:05:31.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.341+0000 7fa9e12ec640 1 Processor -- start 2023-09-13T06:05:31.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.341+0000 7fa9e12ec640 1 -- start start 2023-09-13T06:05:31.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9e12ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9dc0d1750 0x7fa9dc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9e12ec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa9dc0d1090 0x7fa9dc146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9e12ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9dc0d1b30 0x7fa9dc146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9e12ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc15dea0 con 0x7fa9dc0d1750 2023-09-13T06:05:31.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9e12ec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0b63c0 con 0x7fa9dc0d1090 2023-09-13T06:05:31.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9e12ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0d0c20 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9daffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9dc0d1750 0x7fa9dc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9daffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9dc0d1750 0x7fa9dc15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40438/0 (socket says 172.21.15.130:40438) 2023-09-13T06:05:31.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9daffd640 1 -- 172.21.15.130:0/1902425593 learned_addr learned my addr 172.21.15.130:0/1902425593 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:31.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9db7fe640 1 --2- 172.21.15.130:0/1902425593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9dc0d1b30 0x7fa9dc146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9daffd640 1 -- 172.21.15.130:0/1902425593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9dc0d1b30 msgr2=0x7fa9dc146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:31.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9daffd640 1 --2- 172.21.15.130:0/1902425593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9dc0d1b30 0x7fa9dc146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9d3fff640 1 --2- 172.21.15.130:0/1902425593 >> v2:172.21.15.164:3300/0 conn(0x7fa9dc0d1090 0x7fa9dc146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9daffd640 1 -- 172.21.15.130:0/1902425593 >> v2:172.21.15.164:3300/0 conn(0x7fa9dc0d1090 msgr2=0x7fa9dc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:31.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9daffd640 1 --2- 172.21.15.130:0/1902425593 >> v2:172.21.15.164:3300/0 conn(0x7fa9dc0d1090 0x7fa9dc146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9daffd640 1 -- 172.21.15.130:0/1902425593 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc0b6610 con 0x7fa9dc0d1750 2023-09-13T06:05:31.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9db7fe640 1 --2- 172.21.15.130:0/1902425593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9dc0d1b30 0x7fa9dc146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:31.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9d3fff640 1 --2- 172.21.15.130:0/1902425593 >> v2:172.21.15.164:3300/0 conn(0x7fa9dc0d1090 0x7fa9dc146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:31.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.345+0000 7fa9daffd640 1 --2- 172.21.15.130:0/1902425593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9dc0d1750 0x7fa9dc15d960 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0c8360 tx=0x7fa9cc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacba4c5143232ec server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:31.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9da7fc640 1 -- 172.21.15.130:0/1902425593 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0aa5f0 con 0x7fa9dc0d1750 2023-09-13T06:05:31.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9da7fc640 1 -- 172.21.15.130:0/1902425593 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc0aa750 con 0x7fa9dc0d1750 2023-09-13T06:05:31.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9da7fc640 1 -- 172.21.15.130:0/1902425593 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0aaae0 con 0x7fa9dc0d1750 2023-09-13T06:05:31.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 -- 172.21.15.130:0/1902425593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9dc0d1750 msgr2=0x7fa9dc15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 --2- 172.21.15.130:0/1902425593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9dc0d1750 0x7fa9dc15d960 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0c8360 tx=0x7fa9cc01c4d0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 -- 172.21.15.130:0/1902425593 shutdown_connections 2023-09-13T06:05:31.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 --2- 172.21.15.130:0/1902425593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9dc0d1b30 0x7fa9dc146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 --2- 172.21.15.130:0/1902425593 >> v2:172.21.15.164:3300/0 conn(0x7fa9dc0d1090 0x7fa9dc146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 --2- 172.21.15.130:0/1902425593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9dc0d1750 0x7fa9dc15d960 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 -- 172.21.15.130:0/1902425593 >> 172.21.15.130:0/1902425593 conn(0x7fa9dc06f170 msgr2=0x7fa9dc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:31.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 -- 172.21.15.130:0/1902425593 shutdown_connections 2023-09-13T06:05:31.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 -- 172.21.15.130:0/1902425593 wait complete. 2023-09-13T06:05:31.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 Processor -- start 2023-09-13T06:05:31.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 -- start start 2023-09-13T06:05:31.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9dc0d1090 0x7fa9dc167a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9dc0d1750 0x7fa9dc13cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9dc0d1b30 0x7fa9dc13d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc13b600 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc168160 con 0x7fa9dc0d1090 2023-09-13T06:05:31.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9e12ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc13c5f0 con 0x7fa9dc0d1750 2023-09-13T06:05:31.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.349+0000 7fa9db7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9dc0d1b30 0x7fa9dc13d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9db7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9dc0d1b30 0x7fa9dc13d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40446/0 (socket says 172.21.15.130:40446) 2023-09-13T06:05:31.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9db7fe640 1 -- 172.21.15.130:0/2899949570 learned_addr learned my addr 172.21.15.130:0/2899949570 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:31.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9daffd640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9dc0d1090 0x7fa9dc167a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9d3fff640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9dc0d1750 0x7fa9dc13cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9db7fe640 1 -- 172.21.15.130:0/2899949570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9dc0d1750 msgr2=0x7fa9dc13cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9db7fe640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9dc0d1750 0x7fa9dc13cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9db7fe640 1 -- 172.21.15.130:0/2899949570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9dc0d1090 msgr2=0x7fa9dc167a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9db7fe640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9dc0d1090 0x7fa9dc167a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9db7fe640 1 -- 172.21.15.130:0/2899949570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc0094d0 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9daffd640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9dc0d1090 0x7fa9dc167a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:31.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9db7fe640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9dc0d1b30 0x7fa9dc13d140 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400cd50 tx=0x7fa9d400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:31.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9d37fe640 1 -- 172.21.15.130:0/2899949570 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400f680 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9d37fe640 1 -- 172.21.15.130:0/2899949570 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d400f800 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9d37fe640 1 -- 172.21.15.130:0/2899949570 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400fbb0 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9e12ec640 1 -- 172.21.15.130:0/2899949570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc0b5c90 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9e12ec640 1 -- 172.21.15.130:0/2899949570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc13bb10 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9e12ec640 1 -- 172.21.15.130:0/2899949570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc0618a0 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9d37fe640 1 -- 172.21.15.130:0/2899949570 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa9d400b040 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9d37fe640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9bc065b50 0x7fa9bc068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.353+0000 7fa9d37fe640 1 -- 172.21.15.130:0/2899949570 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9d4083d40 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.357+0000 7fa9daffd640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9bc065b50 0x7fa9bc068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.357+0000 7fa9daffd640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9bc065b50 0x7fa9bc068010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0ae000 tx=0x7fa9cc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:31.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.357+0000 7fa9d37fe640 1 -- 172.21.15.130:0/2899949570 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa9d4051690 con 0x7fa9dc0d1b30 2023-09-13T06:05:31.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.505+0000 7fa9e12ec640 1 -- 172.21.15.130:0/2899949570 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9dc0b7900 con 0x7fa9bc065b50 2023-09-13T06:05:31.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.513+0000 7fa9d37fe640 1 -- 172.21.15.130:0/2899949570 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284734 (secure 0 0 0) 0x7fa9cc0aa4b0 con 0x7fa9bc065b50 2023-09-13T06:05:31.518 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:31.520 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:05:31.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 -- 172.21.15.130:0/2899949570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9bc065b50 msgr2=0x7fa9bc068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9bc065b50 0x7fa9bc068010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0ae000 tx=0x7fa9cc0a7000 comp rx=0 tx=0).stop 2023-09-13T06:05:31.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 -- 172.21.15.130:0/2899949570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9dc0d1b30 msgr2=0x7fa9dc13d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9dc0d1b30 0x7fa9dc13d140 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400cd50 tx=0x7fa9d400a650 comp rx=0 tx=0).stop 2023-09-13T06:05:31.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 -- 172.21.15.130:0/2899949570 shutdown_connections 2023-09-13T06:05:31.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa9bc065b50 0x7fa9bc068010 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9dc0d1b30 0x7fa9dc13d140 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9dc0d1750 0x7fa9dc13cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 --2- 172.21.15.130:0/2899949570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9dc0d1090 0x7fa9dc167a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 -- 172.21.15.130:0/2899949570 >> 172.21.15.130:0/2899949570 conn(0x7fa9dc06f170 msgr2=0x7fa9dc1465f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:31.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 -- 172.21.15.130:0/2899949570 shutdown_connections 2023-09-13T06:05:31.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.517+0000 7fa9e12ec640 1 -- 172.21.15.130:0/2899949570 wait complete. 2023-09-13T06:05:31.537 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2023-09-13T06:05:30.588535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4569,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557930,"statfs":{"total":1600000000,"available":1595320324,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.141133"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350671+0000","last_change":"2023-09-13T06:05:27.360021+0000","last_active":"2023-09-13T06:05:28.350671+0000","last_peered":"2023-09-13T06:05:28.350671+0000","last_clean":"2023-09-13T06:05:28.350671+0000","last_became_active":"2023-09-13T06:05:27.359642+0000","last_became_peered":"2023-09-13T06:05:27.359642+0000","last_unstale":"2023-09-13T06:05:28.350671+0000","last_undegraded":"2023-09-13T06:05:28.350671+0000","last_fullsized":"2023-09-13T06:05:28.350671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:00:06.532967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.362028+0000","last_change":"2023-09-13T06:05:27.361953+0000","last_active":"2023-09-13T06:05:27.362028+0000","last_peered":"2023-09-13T06:05:27.362028+0000","last_clean":"2023-09-13T06:05:27.362028+0000","last_became_active":"2023-09-13T06:05:27.361718+0000","last_became_peered":"2023-09-13T06:05:27.361718+0000","last_unstale":"2023-09-13T06:05:27.362028+0000","last_undegraded":"2023-09-13T06:05:27.362028+0000","last_fullsized":"2023-09-13T06:05:27.362028+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:04.507699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.355063+0000","last_change":"2023-09-13T06:05:27.354813+0000","last_active":"2023-09-13T06:05:27.355063+0000","last_peered":"2023-09-13T06:05:27.355063+0000","last_clean":"2023-09-13T06:05:27.355063+0000","last_became_active":"2023-09-13T06:05:27.354583+0000","last_became_peered":"2023-09-13T06:05:27.354583+0000","last_unstale":"2023-09-13T06:05:27.355063+0000","last_undegraded":"2023-09-13T06:05:27.355063+0000","last_fullsized":"2023-09-13T06:05:27.355063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:00:32.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.364790+0000","last_change":"2023-09-13T06:05:27.364743+0000","last_active":"2023-09-13T06:05:27.364790+0000","last_peered":"2023-09-13T06:05:27.364790+0000","last_clean":"2023-09-13T06:05:27.364790+0000","last_became_active":"2023-09-13T06:05:27.364594+0000","last_became_peered":"2023-09-13T06:05:27.364594+0000","last_unstale":"2023-09-13T06:05:27.364790+0000","last_undegraded":"2023-09-13T06:05:27.364790+0000","last_fullsized":"2023-09-13T06:05:27.364790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:12:02.911377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.361426+0000","last_change":"2023-09-13T06:05:27.361066+0000","last_active":"2023-09-13T06:05:27.361426+0000","last_peered":"2023-09-13T06:05:27.361426+0000","last_clean":"2023-09-13T06:05:27.361426+0000","last_became_active":"2023-09-13T06:05:27.360711+0000","last_became_peered":"2023-09-13T06:05:27.360711+0000","last_unstale":"2023-09-13T06:05:27.361426+0000","last_undegraded":"2023-09-13T06:05:27.361426+0000","last_fullsized":"2023-09-13T06:05:27.361426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:15.405410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.368013+0000","last_change":"2023-09-13T06:05:27.367915+0000","last_active":"2023-09-13T06:05:27.368013+0000","last_peered":"2023-09-13T06:05:27.368013+0000","last_clean":"2023-09-13T06:05:27.368013+0000","last_became_active":"2023-09-13T06:05:27.366765+0000","last_became_peered":"2023-09-13T06:05:27.366765+0000","last_unstale":"2023-09-13T06:05:27.368013+0000","last_undegraded":"2023-09-13T06:05:27.368013+0000","last_fullsized":"2023-09-13T06:05:27.368013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:23.346818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350647+0000","last_change":"2023-09-13T06:05:27.353644+0000","last_active":"2023-09-13T06:05:28.350647+0000","last_peered":"2023-09-13T06:05:28.350647+0000","last_clean":"2023-09-13T06:05:28.350647+0000","last_became_active":"2023-09-13T06:05:27.353001+0000","last_became_peered":"2023-09-13T06:05:27.353001+0000","last_unstale":"2023-09-13T06:05:28.350647+0000","last_undegraded":"2023-09-13T06:05:28.350647+0000","last_fullsized":"2023-09-13T06:05:28.350647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:24:33.712314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.365329+0000","last_change":"2023-09-13T06:05:27.365108+0000","last_active":"2023-09-13T06:05:27.365329+0000","last_peered":"2023-09-13T06:05:27.365329+0000","last_clean":"2023-09-13T06:05:27.365329+0000","last_became_active":"2023-09-13T06:05:27.363212+0000","last_became_peered":"2023-09-13T06:05:27.363212+0000","last_unstale":"2023-09-13T06:05:27.365329+0000","last_undegraded":"2023-09-13T06:05:27.365329+0000","last_fullsized":"2023-09-13T06:05:27.365329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:10:51.869942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.357438+0000","last_change":"2023-09-13T06:05:27.357370+0000","last_active":"2023-09-13T06:05:27.357438+0000","last_peered":"2023-09-13T06:05:27.357438+0000","last_clean":"2023-09-13T06:05:27.357438+0000","last_became_active":"2023-09-13T06:05:27.357141+0000","last_became_peered":"2023-09-13T06:05:27.357141+0000","last_unstale":"2023-09-13T06:05:27.357438+0000","last_undegraded":"2023-09-13T06:05:27.357438+0000","last_fullsized":"2023-09-13T06:05:27.357438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:17:33.419846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.358692+0000","last_change":"2023-09-13T06:05:27.358545+0000","last_active":"2023-09-13T06:05:27.358692+0000","last_peered":"2023-09-13T06:05:27.358692+0000","last_clean":"2023-09-13T06:05:27.358692+0000","last_became_active":"2023-09-13T06:05:27.358192+0000","last_became_peered":"2023-09-13T06:05:27.358192+0000","last_unstale":"2023-09-13T06:05:27.358692+0000","last_undegraded":"2023-09-13T06:05:27.358692+0000","last_fullsized":"2023-09-13T06:05:27.358692+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:14.021115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350870+0000","last_change":"2023-09-13T06:05:27.352545+0000","last_active":"2023-09-13T06:05:28.350870+0000","last_peered":"2023-09-13T06:05:28.350870+0000","last_clean":"2023-09-13T06:05:28.350870+0000","last_became_active":"2023-09-13T06:05:27.352289+0000","last_became_peered":"2023-09-13T06:05:27.352289+0000","last_unstale":"2023-09-13T06:05:28.350870+0000","last_undegraded":"2023-09-13T06:05:28.350870+0000","last_fullsized":"2023-09-13T06:05:28.350870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:55:40.814679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.359176+0000","last_change":"2023-09-13T06:05:27.359044+0000","last_active":"2023-09-13T06:05:27.359176+0000","last_peered":"2023-09-13T06:05:27.359176+0000","last_clean":"2023-09-13T06:05:27.359176+0000","last_became_active":"2023-09-13T06:05:27.358670+0000","last_became_peered":"2023-09-13T06:05:27.358670+0000","last_unstale":"2023-09-13T06:05:27.359176+0000","last_undegraded":"2023-09-13T06:05:27.359176+0000","last_fullsized":"2023-09-13T06:05:27.359176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:31.789839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349710+0000","last_change":"2023-09-13T06:05:27.362989+0000","last_active":"2023-09-13T06:05:28.349710+0000","last_peered":"2023-09-13T06:05:28.349710+0000","last_clean":"2023-09-13T06:05:28.349710+0000","last_became_active":"2023-09-13T06:05:27.362228+0000","last_became_peered":"2023-09-13T06:05:27.362228+0000","last_unstale":"2023-09-13T06:05:28.349710+0000","last_undegraded":"2023-09-13T06:05:28.349710+0000","last_fullsized":"2023-09-13T06:05:28.349710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:15.971439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.358781+0000","last_change":"2023-09-13T06:05:27.358689+0000","last_active":"2023-09-13T06:05:27.358781+0000","last_peered":"2023-09-13T06:05:27.358781+0000","last_clean":"2023-09-13T06:05:27.358781+0000","last_became_active":"2023-09-13T06:05:27.358383+0000","last_became_peered":"2023-09-13T06:05:27.358383+0000","last_unstale":"2023-09-13T06:05:27.358781+0000","last_undegraded":"2023-09-13T06:05:27.358781+0000","last_fullsized":"2023-09-13T06:05:27.358781+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:56:46.681610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349679+0000","last_change":"2023-09-13T06:05:27.359100+0000","last_active":"2023-09-13T06:05:28.349679+0000","last_peered":"2023-09-13T06:05:28.349679+0000","last_clean":"2023-09-13T06:05:28.349679+0000","last_became_active":"2023-09-13T06:05:27.358853+0000","last_became_peered":"2023-09-13T06:05:27.358853+0000","last_unstale":"2023-09-13T06:05:28.349679+0000","last_undegraded":"2023-09-13T06:05:28.349679+0000","last_fullsized":"2023-09-13T06:05:28.349679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:47:05.034676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.366828+0000","last_change":"2023-09-13T06:05:27.366746+0000","last_active":"2023-09-13T06:05:27.366828+0000","last_peered":"2023-09-13T06:05:27.366828+0000","last_clean":"2023-09-13T06:05:27.366828+0000","last_became_active":"2023-09-13T06:05:27.366503+0000","last_became_peered":"2023-09-13T06:05:27.366503+0000","last_unstale":"2023-09-13T06:05:27.366828+0000","last_undegraded":"2023-09-13T06:05:27.366828+0000","last_fullsized":"2023-09-13T06:05:27.366828+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:09:49.667951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.362207+0000","last_change":"2023-09-13T06:05:27.362149+0000","last_active":"2023-09-13T06:05:27.362207+0000","last_peered":"2023-09-13T06:05:27.362207+0000","last_clean":"2023-09-13T06:05:27.362207+0000","last_became_active":"2023-09-13T06:05:27.361659+0000","last_became_peered":"2023-09-13T06:05:27.361659+0000","last_unstale":"2023-09-13T06:05:27.362207+0000","last_undegraded":"2023-09-13T06:05:27.362207+0000","last_fullsized":"2023-09-13T06:05:27.362207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:44:51.986631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.363191+0000","last_change":"2023-09-13T06:05:27.363066+0000","last_active":"2023-09-13T06:05:27.363191+0000","last_peered":"2023-09-13T06:05:27.363191+0000","last_clean":"2023-09-13T06:05:27.363191+0000","last_became_active":"2023-09-13T06:05:27.362773+0000","last_became_peered":"2023-09-13T06:05:27.362773+0000","last_unstale":"2023-09-13T06:05:27.363191+0000","last_undegraded":"2023-09-13T06:05:27.363191+0000","last_fullsized":"2023-09-13T06:05:27.363191+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:04.507699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.365913+0000","last_change":"2023-09-13T06:05:27.365823+0000","last_active":"2023-09-13T06:05:27.365913+0000","last_peered":"2023-09-13T06:05:27.365913+0000","last_clean":"2023-09-13T06:05:27.365913+0000","last_became_active":"2023-09-13T06:05:27.364922+0000","last_became_peered":"2023-09-13T06:05:27.364922+0000","last_unstale":"2023-09-13T06:05:27.365913+0000","last_undegraded":"2023-09-13T06:05:27.365913+0000","last_fullsized":"2023-09-13T06:05:27.365913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:15:46.752809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349793+0000","last_change":"2023-09-13T06:05:27.356613+0000","last_active":"2023-09-13T06:05:28.349793+0000","last_peered":"2023-09-13T06:05:28.349793+0000","last_clean":"2023-09-13T06:05:28.349793+0000","last_became_active":"2023-09-13T06:05:27.356403+0000","last_became_peered":"2023-09-13T06:05:27.356403+0000","last_unstale":"2023-09-13T06:05:28.349793+0000","last_undegraded":"2023-09-13T06:05:28.349793+0000","last_fullsized":"2023-09-13T06:05:28.349793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:04:13.592398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356451+0000","last_change":"2023-09-13T06:05:27.355823+0000","last_active":"2023-09-13T06:05:27.356451+0000","last_peered":"2023-09-13T06:05:27.356451+0000","last_clean":"2023-09-13T06:05:27.356451+0000","last_became_active":"2023-09-13T06:05:27.355079+0000","last_became_peered":"2023-09-13T06:05:27.355079+0000","last_unstale":"2023-09-13T06:05:27.356451+0000","last_undegraded":"2023-09-13T06:05:27.356451+0000","last_fullsized":"2023-09-13T06:05:27.356451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:23:32.926583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.359870+0000","last_change":"2023-09-13T06:05:27.359785+0000","last_active":"2023-09-13T06:05:27.359870+0000","last_peered":"2023-09-13T06:05:27.359870+0000","last_clean":"2023-09-13T06:05:27.359870+0000","last_became_active":"2023-09-13T06:05:27.359161+0000","last_became_peered":"2023-09-13T06:05:27.359161+0000","last_unstale":"2023-09-13T06:05:27.359870+0000","last_undegraded":"2023-09-13T06:05:27.359870+0000","last_fullsized":"2023-09-13T06:05:27.359870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:18:07.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350941+0000","last_change":"2023-09-13T06:05:27.357457+0000","last_active":"2023-09-13T06:05:28.350941+0000","last_peered":"2023-09-13T06:05:28.350941+0000","last_clean":"2023-09-13T06:05:28.350941+0000","last_became_active":"2023-09-13T06:05:27.357097+0000","last_became_peered":"2023-09-13T06:05:27.357097+0000","last_unstale":"2023-09-13T06:05:28.350941+0000","last_undegraded":"2023-09-13T06:05:28.350941+0000","last_fullsized":"2023-09-13T06:05:28.350941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:00:08.334659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350125+0000","last_change":"2023-09-13T06:05:27.364824+0000","last_active":"2023-09-13T06:05:28.350125+0000","last_peered":"2023-09-13T06:05:28.350125+0000","last_clean":"2023-09-13T06:05:28.350125+0000","last_became_active":"2023-09-13T06:05:27.364472+0000","last_became_peered":"2023-09-13T06:05:27.364472+0000","last_unstale":"2023-09-13T06:05:28.350125+0000","last_undegraded":"2023-09-13T06:05:28.350125+0000","last_fullsized":"2023-09-13T06:05:28.350125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:38:41.435753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.357513+0000","last_change":"2023-09-13T06:05:27.357375+0000","last_active":"2023-09-13T06:05:27.357513+0000","last_peered":"2023-09-13T06:05:27.357513+0000","last_clean":"2023-09-13T06:05:27.357513+0000","last_became_active":"2023-09-13T06:05:27.356981+0000","last_became_peered":"2023-09-13T06:05:27.356981+0000","last_unstale":"2023-09-13T06:05:27.357513+0000","last_undegraded":"2023-09-13T06:05:27.357513+0000","last_fullsized":"2023-09-13T06:05:27.357513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:09:33.398046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350170+0000","last_change":"2023-09-13T06:05:27.368223+0000","last_active":"2023-09-13T06:05:28.350170+0000","last_peered":"2023-09-13T06:05:28.350170+0000","last_clean":"2023-09-13T06:05:28.350170+0000","last_became_active":"2023-09-13T06:05:27.367954+0000","last_became_peered":"2023-09-13T06:05:27.367954+0000","last_unstale":"2023-09-13T06:05:28.350170+0000","last_undegraded":"2023-09-13T06:05:28.350170+0000","last_fullsized":"2023-09-13T06:05:28.350170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:57:02.847923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.359754+0000","last_change":"2023-09-13T06:05:27.359685+0000","last_active":"2023-09-13T06:05:27.359754+0000","last_peered":"2023-09-13T06:05:27.359754+0000","last_clean":"2023-09-13T06:05:27.359754+0000","last_became_active":"2023-09-13T06:05:27.358348+0000","last_became_peered":"2023-09-13T06:05:27.358348+0000","last_unstale":"2023-09-13T06:05:27.359754+0000","last_undegraded":"2023-09-13T06:05:27.359754+0000","last_fullsized":"2023-09-13T06:05:27.359754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:35:18.288727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.358408+0000","last_change":"2023-09-13T06:05:27.358255+0000","last_active":"2023-09-13T06:05:27.358408+0000","last_peered":"2023-09-13T06:05:27.358408+0000","last_clean":"2023-09-13T06:05:27.358408+0000","last_became_active":"2023-09-13T06:05:27.357988+0000","last_became_peered":"2023-09-13T06:05:27.357988+0000","last_unstale":"2023-09-13T06:05:27.358408+0000","last_undegraded":"2023-09-13T06:05:27.358408+0000","last_fullsized":"2023-09-13T06:05:27.358408+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:37:17.038758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.358636+0000","last_change":"2023-09-13T06:05:27.358379+0000","last_active":"2023-09-13T06:05:27.358636+0000","last_peered":"2023-09-13T06:05:27.358636+0000","last_clean":"2023-09-13T06:05:27.358636+0000","last_became_active":"2023-09-13T06:05:27.357979+0000","last_became_peered":"2023-09-13T06:05:27.357979+0000","last_unstale":"2023-09-13T06:05:27.358636+0000","last_undegraded":"2023-09-13T06:05:27.358636+0000","last_fullsized":"2023-09-13T06:05:27.358636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:12:19.237414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350328+0000","last_change":"2023-09-13T06:05:27.358517+0000","last_active":"2023-09-13T06:05:28.350328+0000","last_peered":"2023-09-13T06:05:28.350328+0000","last_clean":"2023-09-13T06:05:28.350328+0000","last_became_active":"2023-09-13T06:05:27.358230+0000","last_became_peered":"2023-09-13T06:05:27.358230+0000","last_unstale":"2023-09-13T06:05:28.350328+0000","last_undegraded":"2023-09-13T06:05:28.350328+0000","last_fullsized":"2023-09-13T06:05:28.350328+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:37:14.052358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350325+0000","last_change":"2023-09-13T06:05:27.357967+0000","last_active":"2023-09-13T06:05:28.350325+0000","last_peered":"2023-09-13T06:05:28.350325+0000","last_clean":"2023-09-13T06:05:28.350325+0000","last_became_active":"2023-09-13T06:05:27.357696+0000","last_became_peered":"2023-09-13T06:05:27.357696+0000","last_unstale":"2023-09-13T06:05:28.350325+0000","last_undegraded":"2023-09-13T06:05:28.350325+0000","last_fullsized":"2023-09-13T06:05:28.350325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:05:24.759302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.361205+0000","last_change":"2023-09-13T06:05:27.361128+0000","last_active":"2023-09-13T06:05:27.361205+0000","last_peered":"2023-09-13T06:05:27.361205+0000","last_clean":"2023-09-13T06:05:27.361205+0000","last_became_active":"2023-09-13T06:05:27.360311+0000","last_became_peered":"2023-09-13T06:05:27.360311+0000","last_unstale":"2023-09-13T06:05:27.361205+0000","last_undegraded":"2023-09-13T06:05:27.361205+0000","last_fullsized":"2023-09-13T06:05:27.361205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:32:40.485306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350330+0000","last_change":"2023-09-13T06:05:27.364651+0000","last_active":"2023-09-13T06:05:28.350330+0000","last_peered":"2023-09-13T06:05:28.350330+0000","last_clean":"2023-09-13T06:05:28.350330+0000","last_became_active":"2023-09-13T06:05:27.364145+0000","last_became_peered":"2023-09-13T06:05:27.364145+0000","last_unstale":"2023-09-13T06:05:28.350330+0000","last_undegraded":"2023-09-13T06:05:28.350330+0000","last_fullsized":"2023-09-13T06:05:28.350330+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:59:14.283896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"82'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.351045+0000","last_change":"2023-09-13T06:05:26.467752+0000","last_active":"2023-09-13T06:05:28.351045+0000","last_peered":"2023-09-13T06:05:28.351045+0000","last_clean":"2023-09-13T06:05:28.351045+0000","last_became_active":"2023-09-13T06:05:26.467523+0000","last_became_peered":"2023-09-13T06:05:26.467523+0000","last_unstale":"2023-09-13T06:05:28.351045+0000","last_undegraded":"2023-09-13T06:05:28.351045+0000","last_fullsized":"2023-09-13T06:05:28.351045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:14.960412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.361481+0000","last_change":"2023-09-13T06:05:27.361323+0000","last_active":"2023-09-13T06:05:27.361481+0000","last_peered":"2023-09-13T06:05:27.361481+0000","last_clean":"2023-09-13T06:05:27.361481+0000","last_became_active":"2023-09-13T06:05:27.361060+0000","last_became_peered":"2023-09-13T06:05:27.361060+0000","last_unstale":"2023-09-13T06:05:27.361481+0000","last_undegraded":"2023-09-13T06:05:27.361481+0000","last_fullsized":"2023-09-13T06:05:27.361481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:42:16.273552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"82'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349606+0000","last_change":"2023-09-13T06:05:26.469217+0000","last_active":"2023-09-13T06:05:28.349606+0000","last_peered":"2023-09-13T06:05:28.349606+0000","last_clean":"2023-09-13T06:05:28.349606+0000","last_became_active":"2023-09-13T06:05:26.468997+0000","last_became_peered":"2023-09-13T06:05:26.468997+0000","last_unstale":"2023-09-13T06:05:28.349606+0000","last_undegraded":"2023-09-13T06:05:28.349606+0000","last_fullsized":"2023-09-13T06:05:28.349606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:05:40.447720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.368290+0000","last_change":"2023-09-13T06:05:27.368219+0000","last_active":"2023-09-13T06:05:27.368290+0000","last_peered":"2023-09-13T06:05:27.368290+0000","last_clean":"2023-09-13T06:05:27.368290+0000","last_became_active":"2023-09-13T06:05:27.367201+0000","last_became_peered":"2023-09-13T06:05:27.367201+0000","last_unstale":"2023-09-13T06:05:27.368290+0000","last_undegraded":"2023-09-13T06:05:27.368290+0000","last_fullsized":"2023-09-13T06:05:27.368290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:32.319310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.474323+0000","last_change":"2023-09-13T06:05:26.474798+0000","last_active":"2023-09-13T06:05:27.474323+0000","last_peered":"2023-09-13T06:05:27.474323+0000","last_clean":"2023-09-13T06:05:27.474323+0000","last_became_active":"2023-09-13T06:05:26.474100+0000","last_became_peered":"2023-09-13T06:05:26.474100+0000","last_unstale":"2023-09-13T06:05:27.474323+0000","last_undegraded":"2023-09-13T06:05:27.474323+0000","last_fullsized":"2023-09-13T06:05:27.474323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:31:29.286992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350435+0000","last_change":"2023-09-13T06:05:27.356534+0000","last_active":"2023-09-13T06:05:28.350435+0000","last_peered":"2023-09-13T06:05:28.350435+0000","last_clean":"2023-09-13T06:05:28.350435+0000","last_became_active":"2023-09-13T06:05:27.355843+0000","last_became_peered":"2023-09-13T06:05:27.355843+0000","last_unstale":"2023-09-13T06:05:28.350435+0000","last_undegraded":"2023-09-13T06:05:28.350435+0000","last_fullsized":"2023-09-13T06:05:28.350435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:36:01.197910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.474108+0000","last_change":"2023-09-13T06:05:26.475267+0000","last_active":"2023-09-13T06:05:27.474108+0000","last_peered":"2023-09-13T06:05:27.474108+0000","last_clean":"2023-09-13T06:05:27.474108+0000","last_became_active":"2023-09-13T06:05:26.474620+0000","last_became_peered":"2023-09-13T06:05:26.474620+0000","last_unstale":"2023-09-13T06:05:27.474108+0000","last_undegraded":"2023-09-13T06:05:27.474108+0000","last_fullsized":"2023-09-13T06:05:27.474108+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:32:15.435326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350111+0000","last_change":"2023-09-13T06:05:27.354458+0000","last_active":"2023-09-13T06:05:28.350111+0000","last_peered":"2023-09-13T06:05:28.350111+0000","last_clean":"2023-09-13T06:05:28.350111+0000","last_became_active":"2023-09-13T06:05:27.354219+0000","last_became_peered":"2023-09-13T06:05:27.354219+0000","last_unstale":"2023-09-13T06:05:28.350111+0000","last_undegraded":"2023-09-13T06:05:28.350111+0000","last_fullsized":"2023-09-13T06:05:28.350111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:35:02.150319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.474839+0000","last_change":"2023-09-13T06:05:26.466144+0000","last_active":"2023-09-13T06:05:27.474839+0000","last_peered":"2023-09-13T06:05:27.474839+0000","last_clean":"2023-09-13T06:05:27.474839+0000","last_became_active":"2023-09-13T06:05:26.464367+0000","last_became_peered":"2023-09-13T06:05:26.464367+0000","last_unstale":"2023-09-13T06:05:27.474839+0000","last_undegraded":"2023-09-13T06:05:27.474839+0000","last_fullsized":"2023-09-13T06:05:27.474839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:04.423292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.357494+0000","last_change":"2023-09-13T06:05:27.357342+0000","last_active":"2023-09-13T06:05:27.357494+0000","last_peered":"2023-09-13T06:05:27.357494+0000","last_clean":"2023-09-13T06:05:27.357494+0000","last_became_active":"2023-09-13T06:05:27.357084+0000","last_became_peered":"2023-09-13T06:05:27.357084+0000","last_unstale":"2023-09-13T06:05:27.357494+0000","last_undegraded":"2023-09-13T06:05:27.357494+0000","last_fullsized":"2023-09-13T06:05:27.357494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:44:48.628408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.473100+0000","last_change":"2023-09-13T06:05:26.475711+0000","last_active":"2023-09-13T06:05:27.473100+0000","last_peered":"2023-09-13T06:05:27.473100+0000","last_clean":"2023-09-13T06:05:27.473100+0000","last_became_active":"2023-09-13T06:05:26.475460+0000","last_became_peered":"2023-09-13T06:05:26.475460+0000","last_unstale":"2023-09-13T06:05:27.473100+0000","last_undegraded":"2023-09-13T06:05:27.473100+0000","last_fullsized":"2023-09-13T06:05:27.473100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:43:12.166804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.360631+0000","last_change":"2023-09-13T06:05:27.360494+0000","last_active":"2023-09-13T06:05:27.360631+0000","last_peered":"2023-09-13T06:05:27.360631+0000","last_clean":"2023-09-13T06:05:27.360631+0000","last_became_active":"2023-09-13T06:05:27.360109+0000","last_became_peered":"2023-09-13T06:05:27.360109+0000","last_unstale":"2023-09-13T06:05:27.360631+0000","last_undegraded":"2023-09-13T06:05:27.360631+0000","last_fullsized":"2023-09-13T06:05:27.360631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:39:09.312625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.353347+0000","last_change":"2023-09-13T06:05:26.466855+0000","last_active":"2023-09-13T06:05:27.353347+0000","last_peered":"2023-09-13T06:05:27.353347+0000","last_clean":"2023-09-13T06:05:27.353347+0000","last_became_active":"2023-09-13T06:05:26.466636+0000","last_became_peered":"2023-09-13T06:05:26.466636+0000","last_unstale":"2023-09-13T06:05:27.353347+0000","last_undegraded":"2023-09-13T06:05:27.353347+0000","last_fullsized":"2023-09-13T06:05:27.353347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:16:39.487588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349555+0000","last_change":"2023-09-13T06:05:27.357384+0000","last_active":"2023-09-13T06:05:28.349555+0000","last_peered":"2023-09-13T06:05:28.349555+0000","last_clean":"2023-09-13T06:05:28.349555+0000","last_became_active":"2023-09-13T06:05:27.357163+0000","last_became_peered":"2023-09-13T06:05:27.357163+0000","last_unstale":"2023-09-13T06:05:28.349555+0000","last_undegraded":"2023-09-13T06:05:28.349555+0000","last_fullsized":"2023-09-13T06:05:28.349555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:34:37.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356343+0000","last_change":"2023-09-13T06:05:26.470311+0000","last_active":"2023-09-13T06:05:27.356343+0000","last_peered":"2023-09-13T06:05:27.356343+0000","last_clean":"2023-09-13T06:05:27.356343+0000","last_became_active":"2023-09-13T06:05:26.469860+0000","last_became_peered":"2023-09-13T06:05:26.469860+0000","last_unstale":"2023-09-13T06:05:27.356343+0000","last_undegraded":"2023-09-13T06:05:27.356343+0000","last_fullsized":"2023-09-13T06:05:27.356343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:27:02.927808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350769+0000","last_change":"2023-09-13T06:05:27.352692+0000","last_active":"2023-09-13T06:05:28.350769+0000","last_peered":"2023-09-13T06:05:28.350769+0000","last_clean":"2023-09-13T06:05:28.350769+0000","last_became_active":"2023-09-13T06:05:27.352388+0000","last_became_peered":"2023-09-13T06:05:27.352388+0000","last_unstale":"2023-09-13T06:05:28.350769+0000","last_undegraded":"2023-09-13T06:05:28.350769+0000","last_fullsized":"2023-09-13T06:05:28.350769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:23:05.172625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.351620+0000","last_change":"2023-09-13T06:05:26.473675+0000","last_active":"2023-09-13T06:05:27.351620+0000","last_peered":"2023-09-13T06:05:27.351620+0000","last_clean":"2023-09-13T06:05:27.351620+0000","last_became_active":"2023-09-13T06:05:26.471967+0000","last_became_peered":"2023-09-13T06:05:26.471967+0000","last_unstale":"2023-09-13T06:05:27.351620+0000","last_undegraded":"2023-09-13T06:05:27.351620+0000","last_fullsized":"2023-09-13T06:05:27.351620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:50:34.830681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350949+0000","last_change":"2023-09-13T06:05:27.367319+0000","last_active":"2023-09-13T06:05:28.350949+0000","last_peered":"2023-09-13T06:05:28.350949+0000","last_clean":"2023-09-13T06:05:28.350949+0000","last_became_active":"2023-09-13T06:05:27.367089+0000","last_became_peered":"2023-09-13T06:05:27.367089+0000","last_unstale":"2023-09-13T06:05:28.350949+0000","last_undegraded":"2023-09-13T06:05:28.350949+0000","last_fullsized":"2023-09-13T06:05:28.350949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:36.930487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.357658+0000","last_change":"2023-09-13T06:05:26.473205+0000","last_active":"2023-09-13T06:05:27.357658+0000","last_peered":"2023-09-13T06:05:27.357658+0000","last_clean":"2023-09-13T06:05:27.357658+0000","last_became_active":"2023-09-13T06:05:26.472790+0000","last_became_peered":"2023-09-13T06:05:26.472790+0000","last_unstale":"2023-09-13T06:05:27.357658+0000","last_undegraded":"2023-09-13T06:05:27.357658+0000","last_fullsized":"2023-09-13T06:05:27.357658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:12:01.900350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.365508+0000","last_change":"2023-09-13T06:05:27.365424+0000","last_active":"2023-09-13T06:05:27.365508+0000","last_peered":"2023-09-13T06:05:27.365508+0000","last_clean":"2023-09-13T06:05:27.365508+0000","last_became_active":"2023-09-13T06:05:27.363659+0000","last_became_peered":"2023-09-13T06:05:27.363659+0000","last_unstale":"2023-09-13T06:05:27.365508+0000","last_undegraded":"2023-09-13T06:05:27.365508+0000","last_fullsized":"2023-09-13T06:05:27.365508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:59:38.967913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"82'3","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.474746+0000","last_change":"2023-09-13T06:05:26.472761+0000","last_active":"2023-09-13T06:05:27.474746+0000","last_peered":"2023-09-13T06:05:27.474746+0000","last_clean":"2023-09-13T06:05:27.474746+0000","last_became_active":"2023-09-13T06:05:26.472443+0000","last_became_peered":"2023-09-13T06:05:26.472443+0000","last_unstale":"2023-09-13T06:05:27.474746+0000","last_undegraded":"2023-09-13T06:05:27.474746+0000","last_fullsized":"2023-09-13T06:05:27.474746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:54:21.099244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.360077+0000","last_change":"2023-09-13T06:05:27.359950+0000","last_active":"2023-09-13T06:05:27.360077+0000","last_peered":"2023-09-13T06:05:27.360077+0000","last_clean":"2023-09-13T06:05:27.360077+0000","last_became_active":"2023-09-13T06:05:27.359572+0000","last_became_peered":"2023-09-13T06:05:27.359572+0000","last_unstale":"2023-09-13T06:05:27.360077+0000","last_undegraded":"2023-09-13T06:05:27.360077+0000","last_fullsized":"2023-09-13T06:05:27.360077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:02.437742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"82'6","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.476094+0000","last_change":"2023-09-13T06:05:26.469481+0000","last_active":"2023-09-13T06:05:27.476094+0000","last_peered":"2023-09-13T06:05:27.476094+0000","last_clean":"2023-09-13T06:05:27.476094+0000","last_became_active":"2023-09-13T06:05:26.469262+0000","last_became_peered":"2023-09-13T06:05:26.469262+0000","last_unstale":"2023-09-13T06:05:27.476094+0000","last_undegraded":"2023-09-13T06:05:27.476094+0000","last_fullsized":"2023-09-13T06:05:27.476094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:10:50.858915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.351031+0000","last_change":"2023-09-13T06:05:27.359872+0000","last_active":"2023-09-13T06:05:28.351031+0000","last_peered":"2023-09-13T06:05:28.351031+0000","last_clean":"2023-09-13T06:05:28.351031+0000","last_became_active":"2023-09-13T06:05:27.359307+0000","last_became_peered":"2023-09-13T06:05:27.359307+0000","last_unstale":"2023-09-13T06:05:28.351031+0000","last_undegraded":"2023-09-13T06:05:28.351031+0000","last_fullsized":"2023-09-13T06:05:28.351031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:33:17.627846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.475047+0000","last_change":"2023-09-13T06:05:26.468281+0000","last_active":"2023-09-13T06:05:27.475047+0000","last_peered":"2023-09-13T06:05:27.475047+0000","last_clean":"2023-09-13T06:05:27.475047+0000","last_became_active":"2023-09-13T06:05:26.468047+0000","last_became_peered":"2023-09-13T06:05:26.468047+0000","last_unstale":"2023-09-13T06:05:27.475047+0000","last_undegraded":"2023-09-13T06:05:27.475047+0000","last_fullsized":"2023-09-13T06:05:27.475047+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:15:45.741782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350455+0000","last_change":"2023-09-13T06:05:27.354142+0000","last_active":"2023-09-13T06:05:28.350455+0000","last_peered":"2023-09-13T06:05:28.350455+0000","last_clean":"2023-09-13T06:05:28.350455+0000","last_became_active":"2023-09-13T06:05:27.353878+0000","last_became_peered":"2023-09-13T06:05:27.353878+0000","last_unstale":"2023-09-13T06:05:28.350455+0000","last_undegraded":"2023-09-13T06:05:28.350455+0000","last_fullsized":"2023-09-13T06:05:28.350455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:31:28.081892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.365978+0000","last_change":"2023-09-13T06:05:26.474376+0000","last_active":"2023-09-13T06:05:27.365978+0000","last_peered":"2023-09-13T06:05:27.365978+0000","last_clean":"2023-09-13T06:05:27.365978+0000","last_became_active":"2023-09-13T06:05:26.474065+0000","last_became_peered":"2023-09-13T06:05:26.474065+0000","last_unstale":"2023-09-13T06:05:27.365978+0000","last_undegraded":"2023-09-13T06:05:27.365978+0000","last_fullsized":"2023-09-13T06:05:27.365978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:33:13.565023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349829+0000","last_change":"2023-09-13T06:05:27.362480+0000","last_active":"2023-09-13T06:05:28.349829+0000","last_peered":"2023-09-13T06:05:28.349829+0000","last_clean":"2023-09-13T06:05:28.349829+0000","last_became_active":"2023-09-13T06:05:27.361855+0000","last_became_peered":"2023-09-13T06:05:27.361855+0000","last_unstale":"2023-09-13T06:05:28.349829+0000","last_undegraded":"2023-09-13T06:05:28.349829+0000","last_fullsized":"2023-09-13T06:05:28.349829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:38:41.435753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350977+0000","last_change":"2023-09-13T06:05:26.472351+0000","last_active":"2023-09-13T06:05:28.350977+0000","last_peered":"2023-09-13T06:05:28.350977+0000","last_clean":"2023-09-13T06:05:28.350977+0000","last_became_active":"2023-09-13T06:05:26.471551+0000","last_became_peered":"2023-09-13T06:05:26.471551+0000","last_unstale":"2023-09-13T06:05:28.350977+0000","last_undegraded":"2023-09-13T06:05:28.350977+0000","last_fullsized":"2023-09-13T06:05:28.350977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:31:29.286992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.362060+0000","last_change":"2023-09-13T06:05:27.362002+0000","last_active":"2023-09-13T06:05:27.362060+0000","last_peered":"2023-09-13T06:05:27.362060+0000","last_clean":"2023-09-13T06:05:27.362060+0000","last_became_active":"2023-09-13T06:05:27.361378+0000","last_became_peered":"2023-09-13T06:05:27.361378+0000","last_unstale":"2023-09-13T06:05:27.362060+0000","last_undegraded":"2023-09-13T06:05:27.362060+0000","last_fullsized":"2023-09-13T06:05:27.362060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:03:35.142313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.475271+0000","last_change":"2023-09-13T06:05:26.467559+0000","last_active":"2023-09-13T06:05:27.475271+0000","last_peered":"2023-09-13T06:05:27.475271+0000","last_clean":"2023-09-13T06:05:27.475271+0000","last_became_active":"2023-09-13T06:05:26.467028+0000","last_became_peered":"2023-09-13T06:05:26.467028+0000","last_unstale":"2023-09-13T06:05:27.475271+0000","last_undegraded":"2023-09-13T06:05:27.475271+0000","last_fullsized":"2023-09-13T06:05:27.475271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:07.137623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356470+0000","last_change":"2023-09-13T06:05:27.355872+0000","last_active":"2023-09-13T06:05:27.356470+0000","last_peered":"2023-09-13T06:05:27.356470+0000","last_clean":"2023-09-13T06:05:27.356470+0000","last_became_active":"2023-09-13T06:05:27.355619+0000","last_became_peered":"2023-09-13T06:05:27.355619+0000","last_unstale":"2023-09-13T06:05:27.356470+0000","last_undegraded":"2023-09-13T06:05:27.356470+0000","last_fullsized":"2023-09-13T06:05:27.356470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:47:36.398956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.473369+0000","last_change":"2023-09-13T06:05:26.471585+0000","last_active":"2023-09-13T06:05:27.473369+0000","last_peered":"2023-09-13T06:05:27.473369+0000","last_clean":"2023-09-13T06:05:27.473369+0000","last_became_active":"2023-09-13T06:05:26.471240+0000","last_became_peered":"2023-09-13T06:05:26.471240+0000","last_unstale":"2023-09-13T06:05:27.473369+0000","last_undegraded":"2023-09-13T06:05:27.473369+0000","last_fullsized":"2023-09-13T06:05:27.473369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:32:28.350904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350470+0000","last_change":"2023-09-13T06:05:27.354619+0000","last_active":"2023-09-13T06:05:28.350470+0000","last_peered":"2023-09-13T06:05:28.350470+0000","last_clean":"2023-09-13T06:05:28.350470+0000","last_became_active":"2023-09-13T06:05:27.354383+0000","last_became_peered":"2023-09-13T06:05:27.354383+0000","last_unstale":"2023-09-13T06:05:28.350470+0000","last_undegraded":"2023-09-13T06:05:28.350470+0000","last_fullsized":"2023-09-13T06:05:28.350470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:04:43.070819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.474631+0000","last_change":"2023-09-13T06:05:26.475016+0000","last_active":"2023-09-13T06:05:27.474631+0000","last_peered":"2023-09-13T06:05:27.474631+0000","last_clean":"2023-09-13T06:05:27.474631+0000","last_became_active":"2023-09-13T06:05:26.474433+0000","last_became_peered":"2023-09-13T06:05:26.474433+0000","last_unstale":"2023-09-13T06:05:27.474631+0000","last_undegraded":"2023-09-13T06:05:27.474631+0000","last_fullsized":"2023-09-13T06:05:27.474631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:33:38.087636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.359159+0000","last_change":"2023-09-13T06:05:27.358888+0000","last_active":"2023-09-13T06:05:27.359159+0000","last_peered":"2023-09-13T06:05:27.359159+0000","last_clean":"2023-09-13T06:05:27.359159+0000","last_became_active":"2023-09-13T06:05:27.358341+0000","last_became_peered":"2023-09-13T06:05:27.358341+0000","last_unstale":"2023-09-13T06:05:27.359159+0000","last_undegraded":"2023-09-13T06:05:27.359159+0000","last_fullsized":"2023-09-13T06:05:27.359159+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:59:38.967913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.473785+0000","last_change":"2023-09-13T06:05:26.475415+0000","last_active":"2023-09-13T06:05:27.473785+0000","last_peered":"2023-09-13T06:05:27.473785+0000","last_clean":"2023-09-13T06:05:27.473785+0000","last_became_active":"2023-09-13T06:05:26.474904+0000","last_became_peered":"2023-09-13T06:05:26.474904+0000","last_unstale":"2023-09-13T06:05:27.473785+0000","last_undegraded":"2023-09-13T06:05:27.473785+0000","last_fullsized":"2023-09-13T06:05:27.473785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:30:57.985703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.360649+0000","last_change":"2023-09-13T06:05:27.360528+0000","last_active":"2023-09-13T06:05:27.360649+0000","last_peered":"2023-09-13T06:05:27.360649+0000","last_clean":"2023-09-13T06:05:27.360649+0000","last_became_active":"2023-09-13T06:05:27.360156+0000","last_became_peered":"2023-09-13T06:05:27.360156+0000","last_unstale":"2023-09-13T06:05:27.360649+0000","last_undegraded":"2023-09-13T06:05:27.360649+0000","last_fullsized":"2023-09-13T06:05:27.360649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:01:42.605394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350501+0000","last_change":"2023-09-13T06:05:26.470497+0000","last_active":"2023-09-13T06:05:28.350501+0000","last_peered":"2023-09-13T06:05:28.350501+0000","last_clean":"2023-09-13T06:05:28.350501+0000","last_became_active":"2023-09-13T06:05:26.470273+0000","last_became_peered":"2023-09-13T06:05:26.470273+0000","last_unstale":"2023-09-13T06:05:28.350501+0000","last_undegraded":"2023-09-13T06:05:28.350501+0000","last_fullsized":"2023-09-13T06:05:28.350501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:26:23.781646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356023+0000","last_change":"2023-09-13T06:05:27.355950+0000","last_active":"2023-09-13T06:05:27.356023+0000","last_peered":"2023-09-13T06:05:27.356023+0000","last_clean":"2023-09-13T06:05:27.356023+0000","last_became_active":"2023-09-13T06:05:27.355698+0000","last_became_peered":"2023-09-13T06:05:27.355698+0000","last_unstale":"2023-09-13T06:05:27.356023+0000","last_undegraded":"2023-09-13T06:05:27.356023+0000","last_fullsized":"2023-09-13T06:05:27.356023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:53:57.825264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.362535+0000","last_change":"2023-09-13T06:05:26.475644+0000","last_active":"2023-09-13T06:05:27.362535+0000","last_peered":"2023-09-13T06:05:27.362535+0000","last_clean":"2023-09-13T06:05:27.362535+0000","last_became_active":"2023-09-13T06:05:26.475379+0000","last_became_peered":"2023-09-13T06:05:26.475379+0000","last_unstale":"2023-09-13T06:05:27.362535+0000","last_undegraded":"2023-09-13T06:05:27.362535+0000","last_fullsized":"2023-09-13T06:05:27.362535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:21:57.185473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.368821+0000","last_change":"2023-09-13T06:05:27.368767+0000","last_active":"2023-09-13T06:05:27.368821+0000","last_peered":"2023-09-13T06:05:27.368821+0000","last_clean":"2023-09-13T06:05:27.368821+0000","last_became_active":"2023-09-13T06:05:27.368554+0000","last_became_peered":"2023-09-13T06:05:27.368554+0000","last_unstale":"2023-09-13T06:05:27.368821+0000","last_undegraded":"2023-09-13T06:05:27.368821+0000","last_fullsized":"2023-09-13T06:05:27.368821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:12.814211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350540+0000","last_change":"2023-09-13T06:05:26.470504+0000","last_active":"2023-09-13T06:05:28.350540+0000","last_peered":"2023-09-13T06:05:28.350540+0000","last_clean":"2023-09-13T06:05:28.350540+0000","last_became_active":"2023-09-13T06:05:26.470270+0000","last_became_peered":"2023-09-13T06:05:26.470270+0000","last_unstale":"2023-09-13T06:05:28.350540+0000","last_undegraded":"2023-09-13T06:05:28.350540+0000","last_fullsized":"2023-09-13T06:05:28.350540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:50:34.830681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.360598+0000","last_change":"2023-09-13T06:05:27.360495+0000","last_active":"2023-09-13T06:05:27.360598+0000","last_peered":"2023-09-13T06:05:27.360598+0000","last_clean":"2023-09-13T06:05:27.360598+0000","last_became_active":"2023-09-13T06:05:27.360193+0000","last_became_peered":"2023-09-13T06:05:27.360193+0000","last_unstale":"2023-09-13T06:05:27.360598+0000","last_undegraded":"2023-09-13T06:05:27.360598+0000","last_fullsized":"2023-09-13T06:05:27.360598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:48:09.947341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349575+0000","last_change":"2023-09-13T06:05:26.466376+0000","last_active":"2023-09-13T06:05:28.349575+0000","last_peered":"2023-09-13T06:05:28.349575+0000","last_clean":"2023-09-13T06:05:28.349575+0000","last_became_active":"2023-09-13T06:05:26.466158+0000","last_became_peered":"2023-09-13T06:05:26.466158+0000","last_unstale":"2023-09-13T06:05:28.349575+0000","last_undegraded":"2023-09-13T06:05:28.349575+0000","last_fullsized":"2023-09-13T06:05:28.349575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:44:30.261384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349948+0000","last_change":"2023-09-13T06:05:27.359073+0000","last_active":"2023-09-13T06:05:28.349948+0000","last_peered":"2023-09-13T06:05:28.349948+0000","last_clean":"2023-09-13T06:05:28.349948+0000","last_became_active":"2023-09-13T06:05:27.358833+0000","last_became_peered":"2023-09-13T06:05:27.358833+0000","last_unstale":"2023-09-13T06:05:28.349948+0000","last_undegraded":"2023-09-13T06:05:28.349948+0000","last_fullsized":"2023-09-13T06:05:28.349948+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:59:14.283896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.473403+0000","last_change":"2023-09-13T06:05:26.473046+0000","last_active":"2023-09-13T06:05:27.473403+0000","last_peered":"2023-09-13T06:05:27.473403+0000","last_clean":"2023-09-13T06:05:27.473403+0000","last_became_active":"2023-09-13T06:05:26.472462+0000","last_became_peered":"2023-09-13T06:05:26.472462+0000","last_unstale":"2023-09-13T06:05:27.473403+0000","last_undegraded":"2023-09-13T06:05:27.473403+0000","last_fullsized":"2023-09-13T06:05:27.473403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:06:22.340078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350891+0000","last_change":"2023-09-13T06:05:27.353786+0000","last_active":"2023-09-13T06:05:28.350891+0000","last_peered":"2023-09-13T06:05:28.350891+0000","last_clean":"2023-09-13T06:05:28.350891+0000","last_became_active":"2023-09-13T06:05:27.353402+0000","last_became_peered":"2023-09-13T06:05:27.353402+0000","last_unstale":"2023-09-13T06:05:28.350891+0000","last_undegraded":"2023-09-13T06:05:28.350891+0000","last_fullsized":"2023-09-13T06:05:28.350891+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:00:49.908994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350305+0000","last_change":"2023-09-13T06:05:26.471814+0000","last_active":"2023-09-13T06:05:28.350305+0000","last_peered":"2023-09-13T06:05:28.350305+0000","last_clean":"2023-09-13T06:05:28.350305+0000","last_became_active":"2023-09-13T06:05:26.471557+0000","last_became_peered":"2023-09-13T06:05:26.471557+0000","last_unstale":"2023-09-13T06:05:28.350305+0000","last_undegraded":"2023-09-13T06:05:28.350305+0000","last_fullsized":"2023-09-13T06:05:28.350305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:47:35.387929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350583+0000","last_change":"2023-09-13T06:05:27.361273+0000","last_active":"2023-09-13T06:05:28.350583+0000","last_peered":"2023-09-13T06:05:28.350583+0000","last_clean":"2023-09-13T06:05:28.350583+0000","last_became_active":"2023-09-13T06:05:27.361005+0000","last_became_peered":"2023-09-13T06:05:27.361005+0000","last_unstale":"2023-09-13T06:05:28.350583+0000","last_undegraded":"2023-09-13T06:05:28.350583+0000","last_fullsized":"2023-09-13T06:05:28.350583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:18:21.549384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356372+0000","last_change":"2023-09-13T06:05:26.469137+0000","last_active":"2023-09-13T06:05:27.356372+0000","last_peered":"2023-09-13T06:05:27.356372+0000","last_clean":"2023-09-13T06:05:27.356372+0000","last_became_active":"2023-09-13T06:05:26.468831+0000","last_became_peered":"2023-09-13T06:05:26.468831+0000","last_unstale":"2023-09-13T06:05:27.356372+0000","last_undegraded":"2023-09-13T06:05:27.356372+0000","last_fullsized":"2023-09-13T06:05:27.356372+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:10.454467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350612+0000","last_change":"2023-09-13T06:05:27.356773+0000","last_active":"2023-09-13T06:05:28.350612+0000","last_peered":"2023-09-13T06:05:28.350612+0000","last_clean":"2023-09-13T06:05:28.350612+0000","last_became_active":"2023-09-13T06:05:27.356537+0000","last_became_peered":"2023-09-13T06:05:27.356537+0000","last_unstale":"2023-09-13T06:05:28.350612+0000","last_undegraded":"2023-09-13T06:05:28.350612+0000","last_fullsized":"2023-09-13T06:05:28.350612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:53:39.923689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349877+0000","last_change":"2023-09-13T06:05:26.472701+0000","last_active":"2023-09-13T06:05:28.349877+0000","last_peered":"2023-09-13T06:05:28.349877+0000","last_clean":"2023-09-13T06:05:28.349877+0000","last_became_active":"2023-09-13T06:05:26.472486+0000","last_became_peered":"2023-09-13T06:05:26.472486+0000","last_unstale":"2023-09-13T06:05:28.349877+0000","last_undegraded":"2023-09-13T06:05:28.349877+0000","last_fullsized":"2023-09-13T06:05:28.349877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:16:53.221236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.361931+0000","last_change":"2023-09-13T06:05:27.361867+0000","last_active":"2023-09-13T06:05:27.361931+0000","last_peered":"2023-09-13T06:05:27.361931+0000","last_clean":"2023-09-13T06:05:27.361931+0000","last_became_active":"2023-09-13T06:05:27.361102+0000","last_became_peered":"2023-09-13T06:05:27.361102+0000","last_unstale":"2023-09-13T06:05:27.361931+0000","last_undegraded":"2023-09-13T06:05:27.361931+0000","last_fullsized":"2023-09-13T06:05:27.361931+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:52.151872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356135+0000","last_change":"2023-09-13T06:05:26.470087+0000","last_active":"2023-09-13T06:05:27.356135+0000","last_peered":"2023-09-13T06:05:27.356135+0000","last_clean":"2023-09-13T06:05:27.356135+0000","last_became_active":"2023-09-13T06:05:26.469850+0000","last_became_peered":"2023-09-13T06:05:26.469850+0000","last_unstale":"2023-09-13T06:05:27.356135+0000","last_undegraded":"2023-09-13T06:05:27.356135+0000","last_fullsized":"2023-09-13T06:05:27.356135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:46:39.794400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.367669+0000","last_change":"2023-09-13T06:05:27.367583+0000","last_active":"2023-09-13T06:05:27.367669+0000","last_peered":"2023-09-13T06:05:27.367669+0000","last_clean":"2023-09-13T06:05:27.367669+0000","last_became_active":"2023-09-13T06:05:27.366405+0000","last_became_peered":"2023-09-13T06:05:27.366405+0000","last_unstale":"2023-09-13T06:05:27.367669+0000","last_undegraded":"2023-09-13T06:05:27.367669+0000","last_fullsized":"2023-09-13T06:05:27.367669+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:37:42.806113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.352367+0000","last_change":"2023-09-13T06:05:26.471703+0000","last_active":"2023-09-13T06:05:27.352367+0000","last_peered":"2023-09-13T06:05:27.352367+0000","last_clean":"2023-09-13T06:05:27.352367+0000","last_became_active":"2023-09-13T06:05:26.471429+0000","last_became_peered":"2023-09-13T06:05:26.471429+0000","last_unstale":"2023-09-13T06:05:27.352367+0000","last_undegraded":"2023-09-13T06:05:27.352367+0000","last_fullsized":"2023-09-13T06:05:27.352367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:32:39.474279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.357516+0000","last_change":"2023-09-13T06:05:27.357247+0000","last_active":"2023-09-13T06:05:27.357516+0000","last_peered":"2023-09-13T06:05:27.357516+0000","last_clean":"2023-09-13T06:05:27.357516+0000","last_became_active":"2023-09-13T06:05:27.357022+0000","last_became_peered":"2023-09-13T06:05:27.357022+0000","last_unstale":"2023-09-13T06:05:27.357516+0000","last_undegraded":"2023-09-13T06:05:27.357516+0000","last_fullsized":"2023-09-13T06:05:27.357516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:06:23.351105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.351857+0000","last_change":"2023-09-13T06:05:26.467708+0000","last_active":"2023-09-13T06:05:27.351857+0000","last_peered":"2023-09-13T06:05:27.351857+0000","last_clean":"2023-09-13T06:05:27.351857+0000","last_became_active":"2023-09-13T06:05:26.467327+0000","last_became_peered":"2023-09-13T06:05:26.467327+0000","last_unstale":"2023-09-13T06:05:27.351857+0000","last_undegraded":"2023-09-13T06:05:27.351857+0000","last_fullsized":"2023-09-13T06:05:27.351857+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:06:48.088128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.361496+0000","last_change":"2023-09-13T06:05:27.361418+0000","last_active":"2023-09-13T06:05:27.361496+0000","last_peered":"2023-09-13T06:05:27.361496+0000","last_clean":"2023-09-13T06:05:27.361496+0000","last_became_active":"2023-09-13T06:05:27.361166+0000","last_became_peered":"2023-09-13T06:05:27.361166+0000","last_unstale":"2023-09-13T06:05:27.361496+0000","last_undegraded":"2023-09-13T06:05:27.361496+0000","last_fullsized":"2023-09-13T06:05:27.361496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:16:40.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.362684+0000","last_change":"2023-09-13T06:05:26.473600+0000","last_active":"2023-09-13T06:05:27.362684+0000","last_peered":"2023-09-13T06:05:27.362684+0000","last_clean":"2023-09-13T06:05:27.362684+0000","last_became_active":"2023-09-13T06:05:26.473205+0000","last_became_peered":"2023-09-13T06:05:26.473205+0000","last_unstale":"2023-09-13T06:05:27.362684+0000","last_undegraded":"2023-09-13T06:05:27.362684+0000","last_fullsized":"2023-09-13T06:05:27.362684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:21:38.693246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.364319+0000","last_change":"2023-09-13T06:05:27.364252+0000","last_active":"2023-09-13T06:05:27.364319+0000","last_peered":"2023-09-13T06:05:27.364319+0000","last_clean":"2023-09-13T06:05:27.364319+0000","last_became_active":"2023-09-13T06:05:27.363985+0000","last_became_peered":"2023-09-13T06:05:27.363985+0000","last_unstale":"2023-09-13T06:05:27.364319+0000","last_undegraded":"2023-09-13T06:05:27.364319+0000","last_fullsized":"2023-09-13T06:05:27.364319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:40.185384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.473637+0000","last_change":"2023-09-13T06:05:26.473439+0000","last_active":"2023-09-13T06:05:27.473637+0000","last_peered":"2023-09-13T06:05:27.473637+0000","last_clean":"2023-09-13T06:05:27.473637+0000","last_became_active":"2023-09-13T06:05:26.473210+0000","last_became_peered":"2023-09-13T06:05:26.473210+0000","last_unstale":"2023-09-13T06:05:27.473637+0000","last_undegraded":"2023-09-13T06:05:27.473637+0000","last_fullsized":"2023-09-13T06:05:27.473637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:57:53.846169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":235,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.349236+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:05:27.349236+0000","last_peered":"2023-09-13T06:05:27.349236+0000","last_clean":"2023-09-13T06:05:27.349236+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:05:27.349236+0000","last_undegraded":"2023-09-13T06:05:27.349236+0000","last_fullsized":"2023-09-13T06:05:27.349236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:04:41.431338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1003,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194308,"statfs":{"total":200000000,"available":198972251,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.58599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98799999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.57399999999999995,"5min":0.375,"15min":0.375},"max":{"1min":0.91100000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78700000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.53100000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.60699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94099999999999995,"5min":1.05,"15min":1.05},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.59599999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.96599999999999997,"5min":1.395,"15min":1.395},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.50800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.93100000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.92100000000000004,"5min":1.357,"15min":1.357},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0129999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89500000000000002,"5min":1.018,"15min":1.018},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.67800000000000005},"min":{"1min":0.47499999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.875,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.501,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91000000000000003,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.83899999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.53200000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.873,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89100000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.56699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":426,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199563143,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96199999999999997,"5min":1.181,"15min":1.181},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.52100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85399999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.55800000000000005,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.99299999999999999,"5min":1.153,"15min":1.153},"last":0.57599999999999996}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.75,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94199999999999995,"5min":1.085,"15min":1.085},"last":0.54900000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.627},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.78700000000000003},"min":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.97099999999999997,"5min":1.526,"15min":1.526},"last":0.84299999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79100000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63800000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.877,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.73199999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.62},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89400000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85399999999999998,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76200000000000001,"15min":0.71599999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.022,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94699999999999995,"5min":1.133,"15min":1.133},"last":0.76000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":426,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199563145,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.53500000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81599999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68500000000000005,"15min":0.65900000000000003},"min":{"1min":0.60599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88400000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.76000000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69899999999999995,"15min":0.68700000000000006},"min":{"1min":0.51000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85199999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69199999999999995,"15min":0.67800000000000005},"min":{"1min":0.58499999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.64100000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.53300000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93300000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85399999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.73899999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71299999999999997,"15min":0.70799999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92300000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54000000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.435,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89900000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.45900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.93600000000000005,"5min":1.054,"15min":1.054},"last":0.51500000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67000000000000004,"15min":0.68100000000000005},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89100000000000001,"5min":0.997,"15min":0.997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.51900000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83799999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56200000000000006}]},{"osd":7,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.879,"5min":1.026,"15min":1.026},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":426,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199563165,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64600000000000002,"15min":0.64100000000000001},"min":{"1min":0.45800000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.432},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":1.05,"15min":1.05},"last":0.67700000000000005}]},{"osd":1,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67500000000000004,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.872,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.51300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92100000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61199999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.627},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.87,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54500000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88300000000000001,"5min":1.01,"15min":1.01},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.46999999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88900000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70099999999999996,"15min":0.68899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71799999999999997,"15min":0.71099999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52100000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.92000000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":426,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199563123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.29899999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61899999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.317},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66400000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42899999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42999999999999999,"15min":0.42499999999999999},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.45600000000000002},"min":{"1min":0.35899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.626,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.505,"15min":0.501},"min":{"1min":0.41199999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.439,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70799999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45100000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0229999999999999,"5min":1.284,"15min":1.284},"last":0.497},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.72599999999999998,"15min":0.71599999999999997},"min":{"1min":0.58199999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.53900000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.65100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.042,"5min":1.111,"15min":1.111},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.61299999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93300000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.56399999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.746,"15min":0.754},"min":{"1min":0.63200000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.995,"5min":1.458,"15min":1.458},"last":0.60999999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.65000000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0589999999999999,"5min":1.383,"15min":1.383},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.753,"15min":0.76500000000000001},"min":{"1min":0.63500000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.99199999999999999,"5min":1.27,"15min":1.27},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":428,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194884,"statfs":{"total":200000000,"available":199561623,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.40799999999999997},"min":{"1min":0.32600000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53700000000000003,"5min":10.401,"15min":10.401},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.46700000000000003,"15min":0.437},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":0.41999999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48199999999999998,"15min":0.45700000000000002},"min":{"1min":0.379,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60599999999999998,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.499,"15min":0.46500000000000002},"min":{"1min":0.39600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56499999999999995,"15min":0.52500000000000002},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58899999999999997,"15min":0.54900000000000004},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82399999999999995,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":0.439}]},{"osd":4,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.77300000000000002},"min":{"1min":0.59999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0680000000000001,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.054,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.77200000000000002}]},{"osd":5,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78400000000000003,"15min":0.77600000000000002},"min":{"1min":0.58499999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.026,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.79800000000000004},"min":{"1min":0.67900000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.032,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.84499999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.753,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0980000000000001,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.89500000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.754,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0489999999999999,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.628,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":428,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194883,"statfs":{"total":200000000,"available":199561007,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45400000000000001,"15min":0.436},"min":{"1min":0.307,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66200000000000003,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.34100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68400000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.35899999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.45800000000000002},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63600000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.40400000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.497},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51800000000000002,"15min":0.48599999999999999},"min":{"1min":0.40699999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68500000000000005,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.47399999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73199999999999998,"15min":0.72899999999999998},"min":{"1min":0.59599999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.016,"5min":1.089,"15min":1.089},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95499999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.0349999999999999,"5min":1.109,"15min":1.109},"last":0.627},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.55900000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59099999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97199999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.58799999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97399999999999998,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.63400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.75900000000000001,"15min":0.76600000000000001},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.075,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.52800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1003,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194309,"statfs":{"total":200000000,"available":198972867,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65400000000000003,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.376},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49199999999999999,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.753,"5min":2.294,"15min":2.294},"last":0.47899999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.495},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78200000000000003,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.433},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.29899999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57199999999999995,"5min":2.056,"15min":2.056},"last":0.61699999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76600000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.503}]},{"osd":4,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.052,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.67600000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58099999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97299999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.754},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.55100000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0980000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.68999999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.78500000000000003,"15min":0.78200000000000003},"min":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1240000000000001,"5min":2.415,"15min":2.415},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.079,"5min":2.347,"15min":2.347},"last":0.85599999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79600000000000004,"15min":0.80000000000000004},"min":{"1min":0.63200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0800000000000001,"5min":2.367,"15min":2.367},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.77700000000000002}]}]}],"pool_statfs":[]}} 2023-09-13T06:05:31.544 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:05:31.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1738b10640 1 Processor -- start 2023-09-13T06:05:31.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1738b10640 1 -- start start 2023-09-13T06:05:31.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1738b10640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f17340d1090 0x7f173415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1738b10640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1734146f30 0x7f17340b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1738b10640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17340b63c0 con 0x7f17340d1750 2023-09-13T06:05:31.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1738b10640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173415dea0 con 0x7f17340d1090 2023-09-13T06:05:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1738b10640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17340d0c20 con 0x7f1734146f30 2023-09-13T06:05:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f173259c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f17340d1750 0x7f1734146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42894/0 (socket says 172.21.15.130:42894) 2023-09-13T06:05:31.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f173259c640 1 -- 172.21.15.130:0/661092652 learned_addr learned my addr 172.21.15.130:0/661092652 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1729d9b640 1 --2- 172.21.15.130:0/661092652 >> v2:172.21.15.130:3300/0 conn(0x7f17340d1090 0x7f173415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1729d9b640 1 -- 172.21.15.130:0/661092652 >> v2:172.21.15.164:3300/0 conn(0x7f1734146f30 msgr2=0x7f17340b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1732d9d640 1 --2- 172.21.15.130:0/661092652 >> v2:172.21.15.164:3300/0 conn(0x7f1734146f30 0x7f17340b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1731d9b640 1 -- 172.21.15.130:0/661092652 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052946451 0 0) 0x7f17340b63c0 con 0x7f17340d1750 2023-09-13T06:05:31.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1729d9b640 1 --2- 172.21.15.130:0/661092652 >> v2:172.21.15.164:3300/0 conn(0x7f1734146f30 0x7f17340b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1729d9b640 1 -- 172.21.15.130:0/661092652 >> v1:172.21.15.130:6789/0 conn(0x7f17340d1750 legacy=0x7f1734146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1729d9b640 1 -- 172.21.15.130:0/661092652 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17340b6610 con 0x7f17340d1090 2023-09-13T06:05:31.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.717+0000 7f1732d9d640 1 --2- 172.21.15.130:0/661092652 >> v2:172.21.15.164:3300/0 conn(0x7f1734146f30 0x7f17340b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:31.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1729d9b640 1 --2- 172.21.15.130:0/661092652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17340d1090 0x7f173415d960 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f17340d2c80 tx=0x7f171c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2f24a74f651e2a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:31.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1731d9b640 1 -- 172.21.15.130:0/661092652 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0ac600 con 0x7f17340d1090 2023-09-13T06:05:31.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1731d9b640 1 -- 172.21.15.130:0/661092652 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c0a8050 con 0x7f17340d1090 2023-09-13T06:05:31.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1731d9b640 1 -- 172.21.15.130:0/661092652 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0ac980 con 0x7f17340d1090 2023-09-13T06:05:31.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1738b10640 1 -- 172.21.15.130:0/661092652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17340d1090 msgr2=0x7f173415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1738b10640 1 --2- 172.21.15.130:0/661092652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17340d1090 0x7f173415d960 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f17340d2c80 tx=0x7f171c01c3a0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1738b10640 1 -- 172.21.15.130:0/661092652 shutdown_connections 2023-09-13T06:05:31.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1738b10640 1 --2- 172.21.15.130:0/661092652 >> v2:172.21.15.164:3300/0 conn(0x7f1734146f30 0x7f17340b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1738b10640 1 --2- 172.21.15.130:0/661092652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17340d1090 0x7f173415d960 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1738b10640 1 -- 172.21.15.130:0/661092652 >> 172.21.15.130:0/661092652 conn(0x7f173406f170 msgr2=0x7f173406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:31.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1738b10640 1 -- 172.21.15.130:0/661092652 shutdown_connections 2023-09-13T06:05:31.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.721+0000 7f1738b10640 1 -- 172.21.15.130:0/661092652 wait complete. 2023-09-13T06:05:31.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1738b10640 1 Processor -- start 2023-09-13T06:05:31.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1738b10640 1 -- start start 2023-09-13T06:05:31.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1738b10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17340d1090 0x7f173415b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1738b10640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17340d1750 0x7f173415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1738b10640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1734146f30 0x7f173415c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1738b10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1734143dc0 con 0x7f17340d1090 2023-09-13T06:05:31.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1738b10640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17341678b0 con 0x7f17340d1750 2023-09-13T06:05:31.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1738b10640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1734167b90 con 0x7f1734146f30 2023-09-13T06:05:31.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f173259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17340d1090 0x7f173415b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f173259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17340d1090 0x7f173415b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40454/0 (socket says 172.21.15.130:40454) 2023-09-13T06:05:31.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f173259c640 1 -- 172.21.15.130:0/103966159 learned_addr learned my addr 172.21.15.130:0/103966159 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:31.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1732d9d640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1734146f30 0x7f173415c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1729d9b640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17340d1750 0x7f173415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f173259c640 1 -- 172.21.15.130:0/103966159 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1734146f30 msgr2=0x7f173415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f173259c640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1734146f30 0x7f173415c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f173259c640 1 -- 172.21.15.130:0/103966159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17340d1750 msgr2=0x7f173415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f173259c640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17340d1750 0x7f173415bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f173259c640 1 -- 172.21.15.130:0/103966159 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c009420 con 0x7f17340d1090 2023-09-13T06:05:31.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1732d9d640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1734146f30 0x7f173415c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:31.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1729d9b640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17340d1750 0x7f173415bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:31.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f173259c640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17340d1090 0x7f173415b820 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f17240011f0 tx=0x7f172400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:31.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f172b7fe640 1 -- 172.21.15.130:0/103966159 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17240074e0 con 0x7f17340d1090 2023-09-13T06:05:31.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f172b7fe640 1 -- 172.21.15.130:0/103966159 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1724007640 con 0x7f17340d1090 2023-09-13T06:05:31.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f172b7fe640 1 -- 172.21.15.130:0/103966159 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724004a10 con 0x7f17340d1090 2023-09-13T06:05:31.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1738b10640 1 -- 172.21.15.130:0/103966159 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17340b7e40 con 0x7f17340d1090 2023-09-13T06:05:31.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.725+0000 7f1738b10640 1 -- 172.21.15.130:0/103966159 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1734167e70 con 0x7f17340d1090 2023-09-13T06:05:31.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.729+0000 7f1738b10640 1 -- 172.21.15.130:0/103966159 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17340618a0 con 0x7f17340d1090 2023-09-13T06:05:31.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.729+0000 7f172b7fe640 1 -- 172.21.15.130:0/103966159 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1724004b70 con 0x7f17340d1090 2023-09-13T06:05:31.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.729+0000 7f172b7fe640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1714065b20 0x7f1714067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:31.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.729+0000 7f172b7fe640 1 -- 172.21.15.130:0/103966159 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1724082670 con 0x7f17340d1090 2023-09-13T06:05:31.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.729+0000 7f1729d9b640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1714065b20 0x7f1714067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:31.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.729+0000 7f1729d9b640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1714065b20 0x7f1714067fe0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f171c0ae000 tx=0x7f171c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:31.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.733+0000 7f172b7fe640 1 -- 172.21.15.130:0/103966159 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f172404ff20 con 0x7f17340d1090 2023-09-13T06:05:31.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.877+0000 7f1738b10640 1 -- 172.21.15.130:0/103966159 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f173416a320 con 0x7f1714065b20 2023-09-13T06:05:31.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.885+0000 7f172b7fe640 1 -- 172.21.15.130:0/103966159 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284734 (secure 0 0 0) 0x7f171c0b7420 con 0x7f1714065b20 2023-09-13T06:05:31.889 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:31.891 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:05:31.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 -- 172.21.15.130:0/103966159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1714065b20 msgr2=0x7f1714067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1714065b20 0x7f1714067fe0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f171c0ae000 tx=0x7f171c008040 comp rx=0 tx=0).stop 2023-09-13T06:05:31.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 -- 172.21.15.130:0/103966159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17340d1090 msgr2=0x7f173415b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:31.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17340d1090 0x7f173415b820 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f17240011f0 tx=0x7f172400c9b0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 -- 172.21.15.130:0/103966159 shutdown_connections 2023-09-13T06:05:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1714065b20 0x7f1714067fe0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17340d1750 0x7f173415bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1734146f30 0x7f173415c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 --2- 172.21.15.130:0/103966159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17340d1090 0x7f173415b820 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 -- 172.21.15.130:0/103966159 >> 172.21.15.130:0/103966159 conn(0x7f173406f170 msgr2=0x7f173406f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:31.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 -- 172.21.15.130:0/103966159 shutdown_connections 2023-09-13T06:05:31.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:31.889+0000 7f1738b10640 1 -- 172.21.15.130:0/103966159 wait complete. 2023-09-13T06:05:31.909 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2023-09-13T06:05:30.588535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4569,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557930,"statfs":{"total":1600000000,"available":1595320324,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.141133"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350671+0000","last_change":"2023-09-13T06:05:27.360021+0000","last_active":"2023-09-13T06:05:28.350671+0000","last_peered":"2023-09-13T06:05:28.350671+0000","last_clean":"2023-09-13T06:05:28.350671+0000","last_became_active":"2023-09-13T06:05:27.359642+0000","last_became_peered":"2023-09-13T06:05:27.359642+0000","last_unstale":"2023-09-13T06:05:28.350671+0000","last_undegraded":"2023-09-13T06:05:28.350671+0000","last_fullsized":"2023-09-13T06:05:28.350671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:00:06.532967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.362028+0000","last_change":"2023-09-13T06:05:27.361953+0000","last_active":"2023-09-13T06:05:27.362028+0000","last_peered":"2023-09-13T06:05:27.362028+0000","last_clean":"2023-09-13T06:05:27.362028+0000","last_became_active":"2023-09-13T06:05:27.361718+0000","last_became_peered":"2023-09-13T06:05:27.361718+0000","last_unstale":"2023-09-13T06:05:27.362028+0000","last_undegraded":"2023-09-13T06:05:27.362028+0000","last_fullsized":"2023-09-13T06:05:27.362028+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:04.507699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.355063+0000","last_change":"2023-09-13T06:05:27.354813+0000","last_active":"2023-09-13T06:05:27.355063+0000","last_peered":"2023-09-13T06:05:27.355063+0000","last_clean":"2023-09-13T06:05:27.355063+0000","last_became_active":"2023-09-13T06:05:27.354583+0000","last_became_peered":"2023-09-13T06:05:27.354583+0000","last_unstale":"2023-09-13T06:05:27.355063+0000","last_undegraded":"2023-09-13T06:05:27.355063+0000","last_fullsized":"2023-09-13T06:05:27.355063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:00:32.585637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.364790+0000","last_change":"2023-09-13T06:05:27.364743+0000","last_active":"2023-09-13T06:05:27.364790+0000","last_peered":"2023-09-13T06:05:27.364790+0000","last_clean":"2023-09-13T06:05:27.364790+0000","last_became_active":"2023-09-13T06:05:27.364594+0000","last_became_peered":"2023-09-13T06:05:27.364594+0000","last_unstale":"2023-09-13T06:05:27.364790+0000","last_undegraded":"2023-09-13T06:05:27.364790+0000","last_fullsized":"2023-09-13T06:05:27.364790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:12:02.911377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.361426+0000","last_change":"2023-09-13T06:05:27.361066+0000","last_active":"2023-09-13T06:05:27.361426+0000","last_peered":"2023-09-13T06:05:27.361426+0000","last_clean":"2023-09-13T06:05:27.361426+0000","last_became_active":"2023-09-13T06:05:27.360711+0000","last_became_peered":"2023-09-13T06:05:27.360711+0000","last_unstale":"2023-09-13T06:05:27.361426+0000","last_undegraded":"2023-09-13T06:05:27.361426+0000","last_fullsized":"2023-09-13T06:05:27.361426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:15.405410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.368013+0000","last_change":"2023-09-13T06:05:27.367915+0000","last_active":"2023-09-13T06:05:27.368013+0000","last_peered":"2023-09-13T06:05:27.368013+0000","last_clean":"2023-09-13T06:05:27.368013+0000","last_became_active":"2023-09-13T06:05:27.366765+0000","last_became_peered":"2023-09-13T06:05:27.366765+0000","last_unstale":"2023-09-13T06:05:27.368013+0000","last_undegraded":"2023-09-13T06:05:27.368013+0000","last_fullsized":"2023-09-13T06:05:27.368013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:23.346818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350647+0000","last_change":"2023-09-13T06:05:27.353644+0000","last_active":"2023-09-13T06:05:28.350647+0000","last_peered":"2023-09-13T06:05:28.350647+0000","last_clean":"2023-09-13T06:05:28.350647+0000","last_became_active":"2023-09-13T06:05:27.353001+0000","last_became_peered":"2023-09-13T06:05:27.353001+0000","last_unstale":"2023-09-13T06:05:28.350647+0000","last_undegraded":"2023-09-13T06:05:28.350647+0000","last_fullsized":"2023-09-13T06:05:28.350647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:24:33.712314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.365329+0000","last_change":"2023-09-13T06:05:27.365108+0000","last_active":"2023-09-13T06:05:27.365329+0000","last_peered":"2023-09-13T06:05:27.365329+0000","last_clean":"2023-09-13T06:05:27.365329+0000","last_became_active":"2023-09-13T06:05:27.363212+0000","last_became_peered":"2023-09-13T06:05:27.363212+0000","last_unstale":"2023-09-13T06:05:27.365329+0000","last_undegraded":"2023-09-13T06:05:27.365329+0000","last_fullsized":"2023-09-13T06:05:27.365329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:10:51.869942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.357438+0000","last_change":"2023-09-13T06:05:27.357370+0000","last_active":"2023-09-13T06:05:27.357438+0000","last_peered":"2023-09-13T06:05:27.357438+0000","last_clean":"2023-09-13T06:05:27.357438+0000","last_became_active":"2023-09-13T06:05:27.357141+0000","last_became_peered":"2023-09-13T06:05:27.357141+0000","last_unstale":"2023-09-13T06:05:27.357438+0000","last_undegraded":"2023-09-13T06:05:27.357438+0000","last_fullsized":"2023-09-13T06:05:27.357438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:17:33.419846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.358692+0000","last_change":"2023-09-13T06:05:27.358545+0000","last_active":"2023-09-13T06:05:27.358692+0000","last_peered":"2023-09-13T06:05:27.358692+0000","last_clean":"2023-09-13T06:05:27.358692+0000","last_became_active":"2023-09-13T06:05:27.358192+0000","last_became_peered":"2023-09-13T06:05:27.358192+0000","last_unstale":"2023-09-13T06:05:27.358692+0000","last_undegraded":"2023-09-13T06:05:27.358692+0000","last_fullsized":"2023-09-13T06:05:27.358692+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:14.021115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350870+0000","last_change":"2023-09-13T06:05:27.352545+0000","last_active":"2023-09-13T06:05:28.350870+0000","last_peered":"2023-09-13T06:05:28.350870+0000","last_clean":"2023-09-13T06:05:28.350870+0000","last_became_active":"2023-09-13T06:05:27.352289+0000","last_became_peered":"2023-09-13T06:05:27.352289+0000","last_unstale":"2023-09-13T06:05:28.350870+0000","last_undegraded":"2023-09-13T06:05:28.350870+0000","last_fullsized":"2023-09-13T06:05:28.350870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:55:40.814679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.359176+0000","last_change":"2023-09-13T06:05:27.359044+0000","last_active":"2023-09-13T06:05:27.359176+0000","last_peered":"2023-09-13T06:05:27.359176+0000","last_clean":"2023-09-13T06:05:27.359176+0000","last_became_active":"2023-09-13T06:05:27.358670+0000","last_became_peered":"2023-09-13T06:05:27.358670+0000","last_unstale":"2023-09-13T06:05:27.359176+0000","last_undegraded":"2023-09-13T06:05:27.359176+0000","last_fullsized":"2023-09-13T06:05:27.359176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:31.789839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349710+0000","last_change":"2023-09-13T06:05:27.362989+0000","last_active":"2023-09-13T06:05:28.349710+0000","last_peered":"2023-09-13T06:05:28.349710+0000","last_clean":"2023-09-13T06:05:28.349710+0000","last_became_active":"2023-09-13T06:05:27.362228+0000","last_became_peered":"2023-09-13T06:05:27.362228+0000","last_unstale":"2023-09-13T06:05:28.349710+0000","last_undegraded":"2023-09-13T06:05:28.349710+0000","last_fullsized":"2023-09-13T06:05:28.349710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:15.971439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.358781+0000","last_change":"2023-09-13T06:05:27.358689+0000","last_active":"2023-09-13T06:05:27.358781+0000","last_peered":"2023-09-13T06:05:27.358781+0000","last_clean":"2023-09-13T06:05:27.358781+0000","last_became_active":"2023-09-13T06:05:27.358383+0000","last_became_peered":"2023-09-13T06:05:27.358383+0000","last_unstale":"2023-09-13T06:05:27.358781+0000","last_undegraded":"2023-09-13T06:05:27.358781+0000","last_fullsized":"2023-09-13T06:05:27.358781+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:56:46.681610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349679+0000","last_change":"2023-09-13T06:05:27.359100+0000","last_active":"2023-09-13T06:05:28.349679+0000","last_peered":"2023-09-13T06:05:28.349679+0000","last_clean":"2023-09-13T06:05:28.349679+0000","last_became_active":"2023-09-13T06:05:27.358853+0000","last_became_peered":"2023-09-13T06:05:27.358853+0000","last_unstale":"2023-09-13T06:05:28.349679+0000","last_undegraded":"2023-09-13T06:05:28.349679+0000","last_fullsized":"2023-09-13T06:05:28.349679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:47:05.034676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.366828+0000","last_change":"2023-09-13T06:05:27.366746+0000","last_active":"2023-09-13T06:05:27.366828+0000","last_peered":"2023-09-13T06:05:27.366828+0000","last_clean":"2023-09-13T06:05:27.366828+0000","last_became_active":"2023-09-13T06:05:27.366503+0000","last_became_peered":"2023-09-13T06:05:27.366503+0000","last_unstale":"2023-09-13T06:05:27.366828+0000","last_undegraded":"2023-09-13T06:05:27.366828+0000","last_fullsized":"2023-09-13T06:05:27.366828+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:09:49.667951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.362207+0000","last_change":"2023-09-13T06:05:27.362149+0000","last_active":"2023-09-13T06:05:27.362207+0000","last_peered":"2023-09-13T06:05:27.362207+0000","last_clean":"2023-09-13T06:05:27.362207+0000","last_became_active":"2023-09-13T06:05:27.361659+0000","last_became_peered":"2023-09-13T06:05:27.361659+0000","last_unstale":"2023-09-13T06:05:27.362207+0000","last_undegraded":"2023-09-13T06:05:27.362207+0000","last_fullsized":"2023-09-13T06:05:27.362207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:44:51.986631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.363191+0000","last_change":"2023-09-13T06:05:27.363066+0000","last_active":"2023-09-13T06:05:27.363191+0000","last_peered":"2023-09-13T06:05:27.363191+0000","last_clean":"2023-09-13T06:05:27.363191+0000","last_became_active":"2023-09-13T06:05:27.362773+0000","last_became_peered":"2023-09-13T06:05:27.362773+0000","last_unstale":"2023-09-13T06:05:27.363191+0000","last_undegraded":"2023-09-13T06:05:27.363191+0000","last_fullsized":"2023-09-13T06:05:27.363191+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:04.507699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.365913+0000","last_change":"2023-09-13T06:05:27.365823+0000","last_active":"2023-09-13T06:05:27.365913+0000","last_peered":"2023-09-13T06:05:27.365913+0000","last_clean":"2023-09-13T06:05:27.365913+0000","last_became_active":"2023-09-13T06:05:27.364922+0000","last_became_peered":"2023-09-13T06:05:27.364922+0000","last_unstale":"2023-09-13T06:05:27.365913+0000","last_undegraded":"2023-09-13T06:05:27.365913+0000","last_fullsized":"2023-09-13T06:05:27.365913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:15:46.752809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349793+0000","last_change":"2023-09-13T06:05:27.356613+0000","last_active":"2023-09-13T06:05:28.349793+0000","last_peered":"2023-09-13T06:05:28.349793+0000","last_clean":"2023-09-13T06:05:28.349793+0000","last_became_active":"2023-09-13T06:05:27.356403+0000","last_became_peered":"2023-09-13T06:05:27.356403+0000","last_unstale":"2023-09-13T06:05:28.349793+0000","last_undegraded":"2023-09-13T06:05:28.349793+0000","last_fullsized":"2023-09-13T06:05:28.349793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:04:13.592398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356451+0000","last_change":"2023-09-13T06:05:27.355823+0000","last_active":"2023-09-13T06:05:27.356451+0000","last_peered":"2023-09-13T06:05:27.356451+0000","last_clean":"2023-09-13T06:05:27.356451+0000","last_became_active":"2023-09-13T06:05:27.355079+0000","last_became_peered":"2023-09-13T06:05:27.355079+0000","last_unstale":"2023-09-13T06:05:27.356451+0000","last_undegraded":"2023-09-13T06:05:27.356451+0000","last_fullsized":"2023-09-13T06:05:27.356451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:23:32.926583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.359870+0000","last_change":"2023-09-13T06:05:27.359785+0000","last_active":"2023-09-13T06:05:27.359870+0000","last_peered":"2023-09-13T06:05:27.359870+0000","last_clean":"2023-09-13T06:05:27.359870+0000","last_became_active":"2023-09-13T06:05:27.359161+0000","last_became_peered":"2023-09-13T06:05:27.359161+0000","last_unstale":"2023-09-13T06:05:27.359870+0000","last_undegraded":"2023-09-13T06:05:27.359870+0000","last_fullsized":"2023-09-13T06:05:27.359870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:18:07.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350941+0000","last_change":"2023-09-13T06:05:27.357457+0000","last_active":"2023-09-13T06:05:28.350941+0000","last_peered":"2023-09-13T06:05:28.350941+0000","last_clean":"2023-09-13T06:05:28.350941+0000","last_became_active":"2023-09-13T06:05:27.357097+0000","last_became_peered":"2023-09-13T06:05:27.357097+0000","last_unstale":"2023-09-13T06:05:28.350941+0000","last_undegraded":"2023-09-13T06:05:28.350941+0000","last_fullsized":"2023-09-13T06:05:28.350941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:00:08.334659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350125+0000","last_change":"2023-09-13T06:05:27.364824+0000","last_active":"2023-09-13T06:05:28.350125+0000","last_peered":"2023-09-13T06:05:28.350125+0000","last_clean":"2023-09-13T06:05:28.350125+0000","last_became_active":"2023-09-13T06:05:27.364472+0000","last_became_peered":"2023-09-13T06:05:27.364472+0000","last_unstale":"2023-09-13T06:05:28.350125+0000","last_undegraded":"2023-09-13T06:05:28.350125+0000","last_fullsized":"2023-09-13T06:05:28.350125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:38:41.435753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.357513+0000","last_change":"2023-09-13T06:05:27.357375+0000","last_active":"2023-09-13T06:05:27.357513+0000","last_peered":"2023-09-13T06:05:27.357513+0000","last_clean":"2023-09-13T06:05:27.357513+0000","last_became_active":"2023-09-13T06:05:27.356981+0000","last_became_peered":"2023-09-13T06:05:27.356981+0000","last_unstale":"2023-09-13T06:05:27.357513+0000","last_undegraded":"2023-09-13T06:05:27.357513+0000","last_fullsized":"2023-09-13T06:05:27.357513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:09:33.398046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350170+0000","last_change":"2023-09-13T06:05:27.368223+0000","last_active":"2023-09-13T06:05:28.350170+0000","last_peered":"2023-09-13T06:05:28.350170+0000","last_clean":"2023-09-13T06:05:28.350170+0000","last_became_active":"2023-09-13T06:05:27.367954+0000","last_became_peered":"2023-09-13T06:05:27.367954+0000","last_unstale":"2023-09-13T06:05:28.350170+0000","last_undegraded":"2023-09-13T06:05:28.350170+0000","last_fullsized":"2023-09-13T06:05:28.350170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:57:02.847923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.359754+0000","last_change":"2023-09-13T06:05:27.359685+0000","last_active":"2023-09-13T06:05:27.359754+0000","last_peered":"2023-09-13T06:05:27.359754+0000","last_clean":"2023-09-13T06:05:27.359754+0000","last_became_active":"2023-09-13T06:05:27.358348+0000","last_became_peered":"2023-09-13T06:05:27.358348+0000","last_unstale":"2023-09-13T06:05:27.359754+0000","last_undegraded":"2023-09-13T06:05:27.359754+0000","last_fullsized":"2023-09-13T06:05:27.359754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:35:18.288727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.358408+0000","last_change":"2023-09-13T06:05:27.358255+0000","last_active":"2023-09-13T06:05:27.358408+0000","last_peered":"2023-09-13T06:05:27.358408+0000","last_clean":"2023-09-13T06:05:27.358408+0000","last_became_active":"2023-09-13T06:05:27.357988+0000","last_became_peered":"2023-09-13T06:05:27.357988+0000","last_unstale":"2023-09-13T06:05:27.358408+0000","last_undegraded":"2023-09-13T06:05:27.358408+0000","last_fullsized":"2023-09-13T06:05:27.358408+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:37:17.038758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.358636+0000","last_change":"2023-09-13T06:05:27.358379+0000","last_active":"2023-09-13T06:05:27.358636+0000","last_peered":"2023-09-13T06:05:27.358636+0000","last_clean":"2023-09-13T06:05:27.358636+0000","last_became_active":"2023-09-13T06:05:27.357979+0000","last_became_peered":"2023-09-13T06:05:27.357979+0000","last_unstale":"2023-09-13T06:05:27.358636+0000","last_undegraded":"2023-09-13T06:05:27.358636+0000","last_fullsized":"2023-09-13T06:05:27.358636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:12:19.237414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350328+0000","last_change":"2023-09-13T06:05:27.358517+0000","last_active":"2023-09-13T06:05:28.350328+0000","last_peered":"2023-09-13T06:05:28.350328+0000","last_clean":"2023-09-13T06:05:28.350328+0000","last_became_active":"2023-09-13T06:05:27.358230+0000","last_became_peered":"2023-09-13T06:05:27.358230+0000","last_unstale":"2023-09-13T06:05:28.350328+0000","last_undegraded":"2023-09-13T06:05:28.350328+0000","last_fullsized":"2023-09-13T06:05:28.350328+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:37:14.052358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350325+0000","last_change":"2023-09-13T06:05:27.357967+0000","last_active":"2023-09-13T06:05:28.350325+0000","last_peered":"2023-09-13T06:05:28.350325+0000","last_clean":"2023-09-13T06:05:28.350325+0000","last_became_active":"2023-09-13T06:05:27.357696+0000","last_became_peered":"2023-09-13T06:05:27.357696+0000","last_unstale":"2023-09-13T06:05:28.350325+0000","last_undegraded":"2023-09-13T06:05:28.350325+0000","last_fullsized":"2023-09-13T06:05:28.350325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:05:24.759302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.361205+0000","last_change":"2023-09-13T06:05:27.361128+0000","last_active":"2023-09-13T06:05:27.361205+0000","last_peered":"2023-09-13T06:05:27.361205+0000","last_clean":"2023-09-13T06:05:27.361205+0000","last_became_active":"2023-09-13T06:05:27.360311+0000","last_became_peered":"2023-09-13T06:05:27.360311+0000","last_unstale":"2023-09-13T06:05:27.361205+0000","last_undegraded":"2023-09-13T06:05:27.361205+0000","last_fullsized":"2023-09-13T06:05:27.361205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:32:40.485306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350330+0000","last_change":"2023-09-13T06:05:27.364651+0000","last_active":"2023-09-13T06:05:28.350330+0000","last_peered":"2023-09-13T06:05:28.350330+0000","last_clean":"2023-09-13T06:05:28.350330+0000","last_became_active":"2023-09-13T06:05:27.364145+0000","last_became_peered":"2023-09-13T06:05:27.364145+0000","last_unstale":"2023-09-13T06:05:28.350330+0000","last_undegraded":"2023-09-13T06:05:28.350330+0000","last_fullsized":"2023-09-13T06:05:28.350330+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:59:14.283896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"82'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.351045+0000","last_change":"2023-09-13T06:05:26.467752+0000","last_active":"2023-09-13T06:05:28.351045+0000","last_peered":"2023-09-13T06:05:28.351045+0000","last_clean":"2023-09-13T06:05:28.351045+0000","last_became_active":"2023-09-13T06:05:26.467523+0000","last_became_peered":"2023-09-13T06:05:26.467523+0000","last_unstale":"2023-09-13T06:05:28.351045+0000","last_undegraded":"2023-09-13T06:05:28.351045+0000","last_fullsized":"2023-09-13T06:05:28.351045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:14.960412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.361481+0000","last_change":"2023-09-13T06:05:27.361323+0000","last_active":"2023-09-13T06:05:27.361481+0000","last_peered":"2023-09-13T06:05:27.361481+0000","last_clean":"2023-09-13T06:05:27.361481+0000","last_became_active":"2023-09-13T06:05:27.361060+0000","last_became_peered":"2023-09-13T06:05:27.361060+0000","last_unstale":"2023-09-13T06:05:27.361481+0000","last_undegraded":"2023-09-13T06:05:27.361481+0000","last_fullsized":"2023-09-13T06:05:27.361481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:42:16.273552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"82'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349606+0000","last_change":"2023-09-13T06:05:26.469217+0000","last_active":"2023-09-13T06:05:28.349606+0000","last_peered":"2023-09-13T06:05:28.349606+0000","last_clean":"2023-09-13T06:05:28.349606+0000","last_became_active":"2023-09-13T06:05:26.468997+0000","last_became_peered":"2023-09-13T06:05:26.468997+0000","last_unstale":"2023-09-13T06:05:28.349606+0000","last_undegraded":"2023-09-13T06:05:28.349606+0000","last_fullsized":"2023-09-13T06:05:28.349606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:05:40.447720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.368290+0000","last_change":"2023-09-13T06:05:27.368219+0000","last_active":"2023-09-13T06:05:27.368290+0000","last_peered":"2023-09-13T06:05:27.368290+0000","last_clean":"2023-09-13T06:05:27.368290+0000","last_became_active":"2023-09-13T06:05:27.367201+0000","last_became_peered":"2023-09-13T06:05:27.367201+0000","last_unstale":"2023-09-13T06:05:27.368290+0000","last_undegraded":"2023-09-13T06:05:27.368290+0000","last_fullsized":"2023-09-13T06:05:27.368290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:32.319310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.474323+0000","last_change":"2023-09-13T06:05:26.474798+0000","last_active":"2023-09-13T06:05:27.474323+0000","last_peered":"2023-09-13T06:05:27.474323+0000","last_clean":"2023-09-13T06:05:27.474323+0000","last_became_active":"2023-09-13T06:05:26.474100+0000","last_became_peered":"2023-09-13T06:05:26.474100+0000","last_unstale":"2023-09-13T06:05:27.474323+0000","last_undegraded":"2023-09-13T06:05:27.474323+0000","last_fullsized":"2023-09-13T06:05:27.474323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:31:29.286992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350435+0000","last_change":"2023-09-13T06:05:27.356534+0000","last_active":"2023-09-13T06:05:28.350435+0000","last_peered":"2023-09-13T06:05:28.350435+0000","last_clean":"2023-09-13T06:05:28.350435+0000","last_became_active":"2023-09-13T06:05:27.355843+0000","last_became_peered":"2023-09-13T06:05:27.355843+0000","last_unstale":"2023-09-13T06:05:28.350435+0000","last_undegraded":"2023-09-13T06:05:28.350435+0000","last_fullsized":"2023-09-13T06:05:28.350435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:36:01.197910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.474108+0000","last_change":"2023-09-13T06:05:26.475267+0000","last_active":"2023-09-13T06:05:27.474108+0000","last_peered":"2023-09-13T06:05:27.474108+0000","last_clean":"2023-09-13T06:05:27.474108+0000","last_became_active":"2023-09-13T06:05:26.474620+0000","last_became_peered":"2023-09-13T06:05:26.474620+0000","last_unstale":"2023-09-13T06:05:27.474108+0000","last_undegraded":"2023-09-13T06:05:27.474108+0000","last_fullsized":"2023-09-13T06:05:27.474108+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:32:15.435326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350111+0000","last_change":"2023-09-13T06:05:27.354458+0000","last_active":"2023-09-13T06:05:28.350111+0000","last_peered":"2023-09-13T06:05:28.350111+0000","last_clean":"2023-09-13T06:05:28.350111+0000","last_became_active":"2023-09-13T06:05:27.354219+0000","last_became_peered":"2023-09-13T06:05:27.354219+0000","last_unstale":"2023-09-13T06:05:28.350111+0000","last_undegraded":"2023-09-13T06:05:28.350111+0000","last_fullsized":"2023-09-13T06:05:28.350111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:35:02.150319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.474839+0000","last_change":"2023-09-13T06:05:26.466144+0000","last_active":"2023-09-13T06:05:27.474839+0000","last_peered":"2023-09-13T06:05:27.474839+0000","last_clean":"2023-09-13T06:05:27.474839+0000","last_became_active":"2023-09-13T06:05:26.464367+0000","last_became_peered":"2023-09-13T06:05:26.464367+0000","last_unstale":"2023-09-13T06:05:27.474839+0000","last_undegraded":"2023-09-13T06:05:27.474839+0000","last_fullsized":"2023-09-13T06:05:27.474839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:04.423292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.357494+0000","last_change":"2023-09-13T06:05:27.357342+0000","last_active":"2023-09-13T06:05:27.357494+0000","last_peered":"2023-09-13T06:05:27.357494+0000","last_clean":"2023-09-13T06:05:27.357494+0000","last_became_active":"2023-09-13T06:05:27.357084+0000","last_became_peered":"2023-09-13T06:05:27.357084+0000","last_unstale":"2023-09-13T06:05:27.357494+0000","last_undegraded":"2023-09-13T06:05:27.357494+0000","last_fullsized":"2023-09-13T06:05:27.357494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:44:48.628408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.473100+0000","last_change":"2023-09-13T06:05:26.475711+0000","last_active":"2023-09-13T06:05:27.473100+0000","last_peered":"2023-09-13T06:05:27.473100+0000","last_clean":"2023-09-13T06:05:27.473100+0000","last_became_active":"2023-09-13T06:05:26.475460+0000","last_became_peered":"2023-09-13T06:05:26.475460+0000","last_unstale":"2023-09-13T06:05:27.473100+0000","last_undegraded":"2023-09-13T06:05:27.473100+0000","last_fullsized":"2023-09-13T06:05:27.473100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:43:12.166804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.360631+0000","last_change":"2023-09-13T06:05:27.360494+0000","last_active":"2023-09-13T06:05:27.360631+0000","last_peered":"2023-09-13T06:05:27.360631+0000","last_clean":"2023-09-13T06:05:27.360631+0000","last_became_active":"2023-09-13T06:05:27.360109+0000","last_became_peered":"2023-09-13T06:05:27.360109+0000","last_unstale":"2023-09-13T06:05:27.360631+0000","last_undegraded":"2023-09-13T06:05:27.360631+0000","last_fullsized":"2023-09-13T06:05:27.360631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:39:09.312625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.353347+0000","last_change":"2023-09-13T06:05:26.466855+0000","last_active":"2023-09-13T06:05:27.353347+0000","last_peered":"2023-09-13T06:05:27.353347+0000","last_clean":"2023-09-13T06:05:27.353347+0000","last_became_active":"2023-09-13T06:05:26.466636+0000","last_became_peered":"2023-09-13T06:05:26.466636+0000","last_unstale":"2023-09-13T06:05:27.353347+0000","last_undegraded":"2023-09-13T06:05:27.353347+0000","last_fullsized":"2023-09-13T06:05:27.353347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:16:39.487588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349555+0000","last_change":"2023-09-13T06:05:27.357384+0000","last_active":"2023-09-13T06:05:28.349555+0000","last_peered":"2023-09-13T06:05:28.349555+0000","last_clean":"2023-09-13T06:05:28.349555+0000","last_became_active":"2023-09-13T06:05:27.357163+0000","last_became_peered":"2023-09-13T06:05:27.357163+0000","last_unstale":"2023-09-13T06:05:28.349555+0000","last_undegraded":"2023-09-13T06:05:28.349555+0000","last_fullsized":"2023-09-13T06:05:28.349555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:34:37.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356343+0000","last_change":"2023-09-13T06:05:26.470311+0000","last_active":"2023-09-13T06:05:27.356343+0000","last_peered":"2023-09-13T06:05:27.356343+0000","last_clean":"2023-09-13T06:05:27.356343+0000","last_became_active":"2023-09-13T06:05:26.469860+0000","last_became_peered":"2023-09-13T06:05:26.469860+0000","last_unstale":"2023-09-13T06:05:27.356343+0000","last_undegraded":"2023-09-13T06:05:27.356343+0000","last_fullsized":"2023-09-13T06:05:27.356343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:27:02.927808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350769+0000","last_change":"2023-09-13T06:05:27.352692+0000","last_active":"2023-09-13T06:05:28.350769+0000","last_peered":"2023-09-13T06:05:28.350769+0000","last_clean":"2023-09-13T06:05:28.350769+0000","last_became_active":"2023-09-13T06:05:27.352388+0000","last_became_peered":"2023-09-13T06:05:27.352388+0000","last_unstale":"2023-09-13T06:05:28.350769+0000","last_undegraded":"2023-09-13T06:05:28.350769+0000","last_fullsized":"2023-09-13T06:05:28.350769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:23:05.172625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.351620+0000","last_change":"2023-09-13T06:05:26.473675+0000","last_active":"2023-09-13T06:05:27.351620+0000","last_peered":"2023-09-13T06:05:27.351620+0000","last_clean":"2023-09-13T06:05:27.351620+0000","last_became_active":"2023-09-13T06:05:26.471967+0000","last_became_peered":"2023-09-13T06:05:26.471967+0000","last_unstale":"2023-09-13T06:05:27.351620+0000","last_undegraded":"2023-09-13T06:05:27.351620+0000","last_fullsized":"2023-09-13T06:05:27.351620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:50:34.830681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350949+0000","last_change":"2023-09-13T06:05:27.367319+0000","last_active":"2023-09-13T06:05:28.350949+0000","last_peered":"2023-09-13T06:05:28.350949+0000","last_clean":"2023-09-13T06:05:28.350949+0000","last_became_active":"2023-09-13T06:05:27.367089+0000","last_became_peered":"2023-09-13T06:05:27.367089+0000","last_unstale":"2023-09-13T06:05:28.350949+0000","last_undegraded":"2023-09-13T06:05:28.350949+0000","last_fullsized":"2023-09-13T06:05:28.350949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:36.930487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.357658+0000","last_change":"2023-09-13T06:05:26.473205+0000","last_active":"2023-09-13T06:05:27.357658+0000","last_peered":"2023-09-13T06:05:27.357658+0000","last_clean":"2023-09-13T06:05:27.357658+0000","last_became_active":"2023-09-13T06:05:26.472790+0000","last_became_peered":"2023-09-13T06:05:26.472790+0000","last_unstale":"2023-09-13T06:05:27.357658+0000","last_undegraded":"2023-09-13T06:05:27.357658+0000","last_fullsized":"2023-09-13T06:05:27.357658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:12:01.900350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.365508+0000","last_change":"2023-09-13T06:05:27.365424+0000","last_active":"2023-09-13T06:05:27.365508+0000","last_peered":"2023-09-13T06:05:27.365508+0000","last_clean":"2023-09-13T06:05:27.365508+0000","last_became_active":"2023-09-13T06:05:27.363659+0000","last_became_peered":"2023-09-13T06:05:27.363659+0000","last_unstale":"2023-09-13T06:05:27.365508+0000","last_undegraded":"2023-09-13T06:05:27.365508+0000","last_fullsized":"2023-09-13T06:05:27.365508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:59:38.967913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"82'3","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.474746+0000","last_change":"2023-09-13T06:05:26.472761+0000","last_active":"2023-09-13T06:05:27.474746+0000","last_peered":"2023-09-13T06:05:27.474746+0000","last_clean":"2023-09-13T06:05:27.474746+0000","last_became_active":"2023-09-13T06:05:26.472443+0000","last_became_peered":"2023-09-13T06:05:26.472443+0000","last_unstale":"2023-09-13T06:05:27.474746+0000","last_undegraded":"2023-09-13T06:05:27.474746+0000","last_fullsized":"2023-09-13T06:05:27.474746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:54:21.099244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.360077+0000","last_change":"2023-09-13T06:05:27.359950+0000","last_active":"2023-09-13T06:05:27.360077+0000","last_peered":"2023-09-13T06:05:27.360077+0000","last_clean":"2023-09-13T06:05:27.360077+0000","last_became_active":"2023-09-13T06:05:27.359572+0000","last_became_peered":"2023-09-13T06:05:27.359572+0000","last_unstale":"2023-09-13T06:05:27.360077+0000","last_undegraded":"2023-09-13T06:05:27.360077+0000","last_fullsized":"2023-09-13T06:05:27.360077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:02.437742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"82'6","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.476094+0000","last_change":"2023-09-13T06:05:26.469481+0000","last_active":"2023-09-13T06:05:27.476094+0000","last_peered":"2023-09-13T06:05:27.476094+0000","last_clean":"2023-09-13T06:05:27.476094+0000","last_became_active":"2023-09-13T06:05:26.469262+0000","last_became_peered":"2023-09-13T06:05:26.469262+0000","last_unstale":"2023-09-13T06:05:27.476094+0000","last_undegraded":"2023-09-13T06:05:27.476094+0000","last_fullsized":"2023-09-13T06:05:27.476094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:10:50.858915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.351031+0000","last_change":"2023-09-13T06:05:27.359872+0000","last_active":"2023-09-13T06:05:28.351031+0000","last_peered":"2023-09-13T06:05:28.351031+0000","last_clean":"2023-09-13T06:05:28.351031+0000","last_became_active":"2023-09-13T06:05:27.359307+0000","last_became_peered":"2023-09-13T06:05:27.359307+0000","last_unstale":"2023-09-13T06:05:28.351031+0000","last_undegraded":"2023-09-13T06:05:28.351031+0000","last_fullsized":"2023-09-13T06:05:28.351031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:33:17.627846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.475047+0000","last_change":"2023-09-13T06:05:26.468281+0000","last_active":"2023-09-13T06:05:27.475047+0000","last_peered":"2023-09-13T06:05:27.475047+0000","last_clean":"2023-09-13T06:05:27.475047+0000","last_became_active":"2023-09-13T06:05:26.468047+0000","last_became_peered":"2023-09-13T06:05:26.468047+0000","last_unstale":"2023-09-13T06:05:27.475047+0000","last_undegraded":"2023-09-13T06:05:27.475047+0000","last_fullsized":"2023-09-13T06:05:27.475047+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:15:45.741782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350455+0000","last_change":"2023-09-13T06:05:27.354142+0000","last_active":"2023-09-13T06:05:28.350455+0000","last_peered":"2023-09-13T06:05:28.350455+0000","last_clean":"2023-09-13T06:05:28.350455+0000","last_became_active":"2023-09-13T06:05:27.353878+0000","last_became_peered":"2023-09-13T06:05:27.353878+0000","last_unstale":"2023-09-13T06:05:28.350455+0000","last_undegraded":"2023-09-13T06:05:28.350455+0000","last_fullsized":"2023-09-13T06:05:28.350455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:31:28.081892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.365978+0000","last_change":"2023-09-13T06:05:26.474376+0000","last_active":"2023-09-13T06:05:27.365978+0000","last_peered":"2023-09-13T06:05:27.365978+0000","last_clean":"2023-09-13T06:05:27.365978+0000","last_became_active":"2023-09-13T06:05:26.474065+0000","last_became_peered":"2023-09-13T06:05:26.474065+0000","last_unstale":"2023-09-13T06:05:27.365978+0000","last_undegraded":"2023-09-13T06:05:27.365978+0000","last_fullsized":"2023-09-13T06:05:27.365978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:33:13.565023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349829+0000","last_change":"2023-09-13T06:05:27.362480+0000","last_active":"2023-09-13T06:05:28.349829+0000","last_peered":"2023-09-13T06:05:28.349829+0000","last_clean":"2023-09-13T06:05:28.349829+0000","last_became_active":"2023-09-13T06:05:27.361855+0000","last_became_peered":"2023-09-13T06:05:27.361855+0000","last_unstale":"2023-09-13T06:05:28.349829+0000","last_undegraded":"2023-09-13T06:05:28.349829+0000","last_fullsized":"2023-09-13T06:05:28.349829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:38:41.435753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350977+0000","last_change":"2023-09-13T06:05:26.472351+0000","last_active":"2023-09-13T06:05:28.350977+0000","last_peered":"2023-09-13T06:05:28.350977+0000","last_clean":"2023-09-13T06:05:28.350977+0000","last_became_active":"2023-09-13T06:05:26.471551+0000","last_became_peered":"2023-09-13T06:05:26.471551+0000","last_unstale":"2023-09-13T06:05:28.350977+0000","last_undegraded":"2023-09-13T06:05:28.350977+0000","last_fullsized":"2023-09-13T06:05:28.350977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:31:29.286992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.362060+0000","last_change":"2023-09-13T06:05:27.362002+0000","last_active":"2023-09-13T06:05:27.362060+0000","last_peered":"2023-09-13T06:05:27.362060+0000","last_clean":"2023-09-13T06:05:27.362060+0000","last_became_active":"2023-09-13T06:05:27.361378+0000","last_became_peered":"2023-09-13T06:05:27.361378+0000","last_unstale":"2023-09-13T06:05:27.362060+0000","last_undegraded":"2023-09-13T06:05:27.362060+0000","last_fullsized":"2023-09-13T06:05:27.362060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:03:35.142313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.475271+0000","last_change":"2023-09-13T06:05:26.467559+0000","last_active":"2023-09-13T06:05:27.475271+0000","last_peered":"2023-09-13T06:05:27.475271+0000","last_clean":"2023-09-13T06:05:27.475271+0000","last_became_active":"2023-09-13T06:05:26.467028+0000","last_became_peered":"2023-09-13T06:05:26.467028+0000","last_unstale":"2023-09-13T06:05:27.475271+0000","last_undegraded":"2023-09-13T06:05:27.475271+0000","last_fullsized":"2023-09-13T06:05:27.475271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:07.137623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356470+0000","last_change":"2023-09-13T06:05:27.355872+0000","last_active":"2023-09-13T06:05:27.356470+0000","last_peered":"2023-09-13T06:05:27.356470+0000","last_clean":"2023-09-13T06:05:27.356470+0000","last_became_active":"2023-09-13T06:05:27.355619+0000","last_became_peered":"2023-09-13T06:05:27.355619+0000","last_unstale":"2023-09-13T06:05:27.356470+0000","last_undegraded":"2023-09-13T06:05:27.356470+0000","last_fullsized":"2023-09-13T06:05:27.356470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:47:36.398956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.473369+0000","last_change":"2023-09-13T06:05:26.471585+0000","last_active":"2023-09-13T06:05:27.473369+0000","last_peered":"2023-09-13T06:05:27.473369+0000","last_clean":"2023-09-13T06:05:27.473369+0000","last_became_active":"2023-09-13T06:05:26.471240+0000","last_became_peered":"2023-09-13T06:05:26.471240+0000","last_unstale":"2023-09-13T06:05:27.473369+0000","last_undegraded":"2023-09-13T06:05:27.473369+0000","last_fullsized":"2023-09-13T06:05:27.473369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:32:28.350904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350470+0000","last_change":"2023-09-13T06:05:27.354619+0000","last_active":"2023-09-13T06:05:28.350470+0000","last_peered":"2023-09-13T06:05:28.350470+0000","last_clean":"2023-09-13T06:05:28.350470+0000","last_became_active":"2023-09-13T06:05:27.354383+0000","last_became_peered":"2023-09-13T06:05:27.354383+0000","last_unstale":"2023-09-13T06:05:28.350470+0000","last_undegraded":"2023-09-13T06:05:28.350470+0000","last_fullsized":"2023-09-13T06:05:28.350470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:04:43.070819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.474631+0000","last_change":"2023-09-13T06:05:26.475016+0000","last_active":"2023-09-13T06:05:27.474631+0000","last_peered":"2023-09-13T06:05:27.474631+0000","last_clean":"2023-09-13T06:05:27.474631+0000","last_became_active":"2023-09-13T06:05:26.474433+0000","last_became_peered":"2023-09-13T06:05:26.474433+0000","last_unstale":"2023-09-13T06:05:27.474631+0000","last_undegraded":"2023-09-13T06:05:27.474631+0000","last_fullsized":"2023-09-13T06:05:27.474631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:33:38.087636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.359159+0000","last_change":"2023-09-13T06:05:27.358888+0000","last_active":"2023-09-13T06:05:27.359159+0000","last_peered":"2023-09-13T06:05:27.359159+0000","last_clean":"2023-09-13T06:05:27.359159+0000","last_became_active":"2023-09-13T06:05:27.358341+0000","last_became_peered":"2023-09-13T06:05:27.358341+0000","last_unstale":"2023-09-13T06:05:27.359159+0000","last_undegraded":"2023-09-13T06:05:27.359159+0000","last_fullsized":"2023-09-13T06:05:27.359159+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:59:38.967913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.473785+0000","last_change":"2023-09-13T06:05:26.475415+0000","last_active":"2023-09-13T06:05:27.473785+0000","last_peered":"2023-09-13T06:05:27.473785+0000","last_clean":"2023-09-13T06:05:27.473785+0000","last_became_active":"2023-09-13T06:05:26.474904+0000","last_became_peered":"2023-09-13T06:05:26.474904+0000","last_unstale":"2023-09-13T06:05:27.473785+0000","last_undegraded":"2023-09-13T06:05:27.473785+0000","last_fullsized":"2023-09-13T06:05:27.473785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:30:57.985703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.360649+0000","last_change":"2023-09-13T06:05:27.360528+0000","last_active":"2023-09-13T06:05:27.360649+0000","last_peered":"2023-09-13T06:05:27.360649+0000","last_clean":"2023-09-13T06:05:27.360649+0000","last_became_active":"2023-09-13T06:05:27.360156+0000","last_became_peered":"2023-09-13T06:05:27.360156+0000","last_unstale":"2023-09-13T06:05:27.360649+0000","last_undegraded":"2023-09-13T06:05:27.360649+0000","last_fullsized":"2023-09-13T06:05:27.360649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:01:42.605394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350501+0000","last_change":"2023-09-13T06:05:26.470497+0000","last_active":"2023-09-13T06:05:28.350501+0000","last_peered":"2023-09-13T06:05:28.350501+0000","last_clean":"2023-09-13T06:05:28.350501+0000","last_became_active":"2023-09-13T06:05:26.470273+0000","last_became_peered":"2023-09-13T06:05:26.470273+0000","last_unstale":"2023-09-13T06:05:28.350501+0000","last_undegraded":"2023-09-13T06:05:28.350501+0000","last_fullsized":"2023-09-13T06:05:28.350501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:26:23.781646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356023+0000","last_change":"2023-09-13T06:05:27.355950+0000","last_active":"2023-09-13T06:05:27.356023+0000","last_peered":"2023-09-13T06:05:27.356023+0000","last_clean":"2023-09-13T06:05:27.356023+0000","last_became_active":"2023-09-13T06:05:27.355698+0000","last_became_peered":"2023-09-13T06:05:27.355698+0000","last_unstale":"2023-09-13T06:05:27.356023+0000","last_undegraded":"2023-09-13T06:05:27.356023+0000","last_fullsized":"2023-09-13T06:05:27.356023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:53:57.825264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.362535+0000","last_change":"2023-09-13T06:05:26.475644+0000","last_active":"2023-09-13T06:05:27.362535+0000","last_peered":"2023-09-13T06:05:27.362535+0000","last_clean":"2023-09-13T06:05:27.362535+0000","last_became_active":"2023-09-13T06:05:26.475379+0000","last_became_peered":"2023-09-13T06:05:26.475379+0000","last_unstale":"2023-09-13T06:05:27.362535+0000","last_undegraded":"2023-09-13T06:05:27.362535+0000","last_fullsized":"2023-09-13T06:05:27.362535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:21:57.185473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.368821+0000","last_change":"2023-09-13T06:05:27.368767+0000","last_active":"2023-09-13T06:05:27.368821+0000","last_peered":"2023-09-13T06:05:27.368821+0000","last_clean":"2023-09-13T06:05:27.368821+0000","last_became_active":"2023-09-13T06:05:27.368554+0000","last_became_peered":"2023-09-13T06:05:27.368554+0000","last_unstale":"2023-09-13T06:05:27.368821+0000","last_undegraded":"2023-09-13T06:05:27.368821+0000","last_fullsized":"2023-09-13T06:05:27.368821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:12.814211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350540+0000","last_change":"2023-09-13T06:05:26.470504+0000","last_active":"2023-09-13T06:05:28.350540+0000","last_peered":"2023-09-13T06:05:28.350540+0000","last_clean":"2023-09-13T06:05:28.350540+0000","last_became_active":"2023-09-13T06:05:26.470270+0000","last_became_peered":"2023-09-13T06:05:26.470270+0000","last_unstale":"2023-09-13T06:05:28.350540+0000","last_undegraded":"2023-09-13T06:05:28.350540+0000","last_fullsized":"2023-09-13T06:05:28.350540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:50:34.830681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.360598+0000","last_change":"2023-09-13T06:05:27.360495+0000","last_active":"2023-09-13T06:05:27.360598+0000","last_peered":"2023-09-13T06:05:27.360598+0000","last_clean":"2023-09-13T06:05:27.360598+0000","last_became_active":"2023-09-13T06:05:27.360193+0000","last_became_peered":"2023-09-13T06:05:27.360193+0000","last_unstale":"2023-09-13T06:05:27.360598+0000","last_undegraded":"2023-09-13T06:05:27.360598+0000","last_fullsized":"2023-09-13T06:05:27.360598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:48:09.947341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349575+0000","last_change":"2023-09-13T06:05:26.466376+0000","last_active":"2023-09-13T06:05:28.349575+0000","last_peered":"2023-09-13T06:05:28.349575+0000","last_clean":"2023-09-13T06:05:28.349575+0000","last_became_active":"2023-09-13T06:05:26.466158+0000","last_became_peered":"2023-09-13T06:05:26.466158+0000","last_unstale":"2023-09-13T06:05:28.349575+0000","last_undegraded":"2023-09-13T06:05:28.349575+0000","last_fullsized":"2023-09-13T06:05:28.349575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:44:30.261384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349948+0000","last_change":"2023-09-13T06:05:27.359073+0000","last_active":"2023-09-13T06:05:28.349948+0000","last_peered":"2023-09-13T06:05:28.349948+0000","last_clean":"2023-09-13T06:05:28.349948+0000","last_became_active":"2023-09-13T06:05:27.358833+0000","last_became_peered":"2023-09-13T06:05:27.358833+0000","last_unstale":"2023-09-13T06:05:28.349948+0000","last_undegraded":"2023-09-13T06:05:28.349948+0000","last_fullsized":"2023-09-13T06:05:28.349948+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:59:14.283896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.473403+0000","last_change":"2023-09-13T06:05:26.473046+0000","last_active":"2023-09-13T06:05:27.473403+0000","last_peered":"2023-09-13T06:05:27.473403+0000","last_clean":"2023-09-13T06:05:27.473403+0000","last_became_active":"2023-09-13T06:05:26.472462+0000","last_became_peered":"2023-09-13T06:05:26.472462+0000","last_unstale":"2023-09-13T06:05:27.473403+0000","last_undegraded":"2023-09-13T06:05:27.473403+0000","last_fullsized":"2023-09-13T06:05:27.473403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:06:22.340078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350891+0000","last_change":"2023-09-13T06:05:27.353786+0000","last_active":"2023-09-13T06:05:28.350891+0000","last_peered":"2023-09-13T06:05:28.350891+0000","last_clean":"2023-09-13T06:05:28.350891+0000","last_became_active":"2023-09-13T06:05:27.353402+0000","last_became_peered":"2023-09-13T06:05:27.353402+0000","last_unstale":"2023-09-13T06:05:28.350891+0000","last_undegraded":"2023-09-13T06:05:28.350891+0000","last_fullsized":"2023-09-13T06:05:28.350891+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:00:49.908994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350305+0000","last_change":"2023-09-13T06:05:26.471814+0000","last_active":"2023-09-13T06:05:28.350305+0000","last_peered":"2023-09-13T06:05:28.350305+0000","last_clean":"2023-09-13T06:05:28.350305+0000","last_became_active":"2023-09-13T06:05:26.471557+0000","last_became_peered":"2023-09-13T06:05:26.471557+0000","last_unstale":"2023-09-13T06:05:28.350305+0000","last_undegraded":"2023-09-13T06:05:28.350305+0000","last_fullsized":"2023-09-13T06:05:28.350305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:47:35.387929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350583+0000","last_change":"2023-09-13T06:05:27.361273+0000","last_active":"2023-09-13T06:05:28.350583+0000","last_peered":"2023-09-13T06:05:28.350583+0000","last_clean":"2023-09-13T06:05:28.350583+0000","last_became_active":"2023-09-13T06:05:27.361005+0000","last_became_peered":"2023-09-13T06:05:27.361005+0000","last_unstale":"2023-09-13T06:05:28.350583+0000","last_undegraded":"2023-09-13T06:05:28.350583+0000","last_fullsized":"2023-09-13T06:05:28.350583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:18:21.549384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356372+0000","last_change":"2023-09-13T06:05:26.469137+0000","last_active":"2023-09-13T06:05:27.356372+0000","last_peered":"2023-09-13T06:05:27.356372+0000","last_clean":"2023-09-13T06:05:27.356372+0000","last_became_active":"2023-09-13T06:05:26.468831+0000","last_became_peered":"2023-09-13T06:05:26.468831+0000","last_unstale":"2023-09-13T06:05:27.356372+0000","last_undegraded":"2023-09-13T06:05:27.356372+0000","last_fullsized":"2023-09-13T06:05:27.356372+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:10.454467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.350612+0000","last_change":"2023-09-13T06:05:27.356773+0000","last_active":"2023-09-13T06:05:28.350612+0000","last_peered":"2023-09-13T06:05:28.350612+0000","last_clean":"2023-09-13T06:05:28.350612+0000","last_became_active":"2023-09-13T06:05:27.356537+0000","last_became_peered":"2023-09-13T06:05:27.356537+0000","last_unstale":"2023-09-13T06:05:28.350612+0000","last_undegraded":"2023-09-13T06:05:28.350612+0000","last_fullsized":"2023-09-13T06:05:28.350612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:53:39.923689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T06:05:28.349877+0000","last_change":"2023-09-13T06:05:26.472701+0000","last_active":"2023-09-13T06:05:28.349877+0000","last_peered":"2023-09-13T06:05:28.349877+0000","last_clean":"2023-09-13T06:05:28.349877+0000","last_became_active":"2023-09-13T06:05:26.472486+0000","last_became_peered":"2023-09-13T06:05:26.472486+0000","last_unstale":"2023-09-13T06:05:28.349877+0000","last_undegraded":"2023-09-13T06:05:28.349877+0000","last_fullsized":"2023-09-13T06:05:28.349877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:16:53.221236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.361931+0000","last_change":"2023-09-13T06:05:27.361867+0000","last_active":"2023-09-13T06:05:27.361931+0000","last_peered":"2023-09-13T06:05:27.361931+0000","last_clean":"2023-09-13T06:05:27.361931+0000","last_became_active":"2023-09-13T06:05:27.361102+0000","last_became_peered":"2023-09-13T06:05:27.361102+0000","last_unstale":"2023-09-13T06:05:27.361931+0000","last_undegraded":"2023-09-13T06:05:27.361931+0000","last_fullsized":"2023-09-13T06:05:27.361931+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:52.151872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.356135+0000","last_change":"2023-09-13T06:05:26.470087+0000","last_active":"2023-09-13T06:05:27.356135+0000","last_peered":"2023-09-13T06:05:27.356135+0000","last_clean":"2023-09-13T06:05:27.356135+0000","last_became_active":"2023-09-13T06:05:26.469850+0000","last_became_peered":"2023-09-13T06:05:26.469850+0000","last_unstale":"2023-09-13T06:05:27.356135+0000","last_undegraded":"2023-09-13T06:05:27.356135+0000","last_fullsized":"2023-09-13T06:05:27.356135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:46:39.794400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.367669+0000","last_change":"2023-09-13T06:05:27.367583+0000","last_active":"2023-09-13T06:05:27.367669+0000","last_peered":"2023-09-13T06:05:27.367669+0000","last_clean":"2023-09-13T06:05:27.367669+0000","last_became_active":"2023-09-13T06:05:27.366405+0000","last_became_peered":"2023-09-13T06:05:27.366405+0000","last_unstale":"2023-09-13T06:05:27.367669+0000","last_undegraded":"2023-09-13T06:05:27.367669+0000","last_fullsized":"2023-09-13T06:05:27.367669+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:37:42.806113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.352367+0000","last_change":"2023-09-13T06:05:26.471703+0000","last_active":"2023-09-13T06:05:27.352367+0000","last_peered":"2023-09-13T06:05:27.352367+0000","last_clean":"2023-09-13T06:05:27.352367+0000","last_became_active":"2023-09-13T06:05:26.471429+0000","last_became_peered":"2023-09-13T06:05:26.471429+0000","last_unstale":"2023-09-13T06:05:27.352367+0000","last_undegraded":"2023-09-13T06:05:27.352367+0000","last_fullsized":"2023-09-13T06:05:27.352367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:32:39.474279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.357516+0000","last_change":"2023-09-13T06:05:27.357247+0000","last_active":"2023-09-13T06:05:27.357516+0000","last_peered":"2023-09-13T06:05:27.357516+0000","last_clean":"2023-09-13T06:05:27.357516+0000","last_became_active":"2023-09-13T06:05:27.357022+0000","last_became_peered":"2023-09-13T06:05:27.357022+0000","last_unstale":"2023-09-13T06:05:27.357516+0000","last_undegraded":"2023-09-13T06:05:27.357516+0000","last_fullsized":"2023-09-13T06:05:27.357516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:06:23.351105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.351857+0000","last_change":"2023-09-13T06:05:26.467708+0000","last_active":"2023-09-13T06:05:27.351857+0000","last_peered":"2023-09-13T06:05:27.351857+0000","last_clean":"2023-09-13T06:05:27.351857+0000","last_became_active":"2023-09-13T06:05:26.467327+0000","last_became_peered":"2023-09-13T06:05:26.467327+0000","last_unstale":"2023-09-13T06:05:27.351857+0000","last_undegraded":"2023-09-13T06:05:27.351857+0000","last_fullsized":"2023-09-13T06:05:27.351857+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:06:48.088128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.361496+0000","last_change":"2023-09-13T06:05:27.361418+0000","last_active":"2023-09-13T06:05:27.361496+0000","last_peered":"2023-09-13T06:05:27.361496+0000","last_clean":"2023-09-13T06:05:27.361496+0000","last_became_active":"2023-09-13T06:05:27.361166+0000","last_became_peered":"2023-09-13T06:05:27.361166+0000","last_unstale":"2023-09-13T06:05:27.361496+0000","last_undegraded":"2023-09-13T06:05:27.361496+0000","last_fullsized":"2023-09-13T06:05:27.361496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:16:40.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.362684+0000","last_change":"2023-09-13T06:05:26.473600+0000","last_active":"2023-09-13T06:05:27.362684+0000","last_peered":"2023-09-13T06:05:27.362684+0000","last_clean":"2023-09-13T06:05:27.362684+0000","last_became_active":"2023-09-13T06:05:26.473205+0000","last_became_peered":"2023-09-13T06:05:26.473205+0000","last_unstale":"2023-09-13T06:05:27.362684+0000","last_undegraded":"2023-09-13T06:05:27.362684+0000","last_fullsized":"2023-09-13T06:05:27.362684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:21:38.693246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.364319+0000","last_change":"2023-09-13T06:05:27.364252+0000","last_active":"2023-09-13T06:05:27.364319+0000","last_peered":"2023-09-13T06:05:27.364319+0000","last_clean":"2023-09-13T06:05:27.364319+0000","last_became_active":"2023-09-13T06:05:27.363985+0000","last_became_peered":"2023-09-13T06:05:27.363985+0000","last_unstale":"2023-09-13T06:05:27.364319+0000","last_undegraded":"2023-09-13T06:05:27.364319+0000","last_fullsized":"2023-09-13T06:05:27.364319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:26.446826+0000","last_clean_scrub_stamp":"2023-09-13T06:05:26.446826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:40.185384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.473637+0000","last_change":"2023-09-13T06:05:26.473439+0000","last_active":"2023-09-13T06:05:27.473637+0000","last_peered":"2023-09-13T06:05:27.473637+0000","last_clean":"2023-09-13T06:05:27.473637+0000","last_became_active":"2023-09-13T06:05:26.473210+0000","last_became_peered":"2023-09-13T06:05:26.473210+0000","last_unstale":"2023-09-13T06:05:27.473637+0000","last_undegraded":"2023-09-13T06:05:27.473637+0000","last_fullsized":"2023-09-13T06:05:27.473637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:05:25.435799+0000","last_clean_scrub_stamp":"2023-09-13T06:05:25.435799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:57:53.846169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":235,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-13T06:05:27.349236+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:05:27.349236+0000","last_peered":"2023-09-13T06:05:27.349236+0000","last_clean":"2023-09-13T06:05:27.349236+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:05:27.349236+0000","last_undegraded":"2023-09-13T06:05:27.349236+0000","last_fullsized":"2023-09-13T06:05:27.349236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:04:41.431338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1003,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194308,"statfs":{"total":200000000,"available":198972251,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.58599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98799999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.57399999999999995,"5min":0.375,"15min":0.375},"max":{"1min":0.91100000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78700000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.53100000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.60699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94099999999999995,"5min":1.05,"15min":1.05},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.59599999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.96599999999999997,"5min":1.395,"15min":1.395},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.50800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.93100000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.92100000000000004,"5min":1.357,"15min":1.357},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0129999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89500000000000002,"5min":1.018,"15min":1.018},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.67800000000000005},"min":{"1min":0.47499999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.875,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.501,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91000000000000003,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.83899999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.53200000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.873,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89100000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.56699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":426,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199563143,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96199999999999997,"5min":1.181,"15min":1.181},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.52100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85399999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.55800000000000005,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.99299999999999999,"5min":1.153,"15min":1.153},"last":0.57599999999999996}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.75,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94199999999999995,"5min":1.085,"15min":1.085},"last":0.54900000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.627},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.78700000000000003},"min":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.97099999999999997,"5min":1.526,"15min":1.526},"last":0.84299999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79100000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63800000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.877,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.73199999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.62},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89400000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85399999999999998,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76200000000000001,"15min":0.71599999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.022,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94699999999999995,"5min":1.133,"15min":1.133},"last":0.76000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":426,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199563145,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.53500000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81599999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68500000000000005,"15min":0.65900000000000003},"min":{"1min":0.60599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88400000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.76000000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69899999999999995,"15min":0.68700000000000006},"min":{"1min":0.51000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85199999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69199999999999995,"15min":0.67800000000000005},"min":{"1min":0.58499999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.64100000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.53300000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93300000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85399999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.73899999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71299999999999997,"15min":0.70799999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92300000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54000000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.435,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89900000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.45900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.93600000000000005,"5min":1.054,"15min":1.054},"last":0.51500000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67000000000000004,"15min":0.68100000000000005},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89100000000000001,"5min":0.997,"15min":0.997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.51900000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83799999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56200000000000006}]},{"osd":7,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.879,"5min":1.026,"15min":1.026},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":426,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199563165,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64600000000000002,"15min":0.64100000000000001},"min":{"1min":0.45800000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.432},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":1.05,"15min":1.05},"last":0.67700000000000005}]},{"osd":1,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67500000000000004,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.872,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.51300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92100000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61199999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.627},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.87,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54500000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88300000000000001,"5min":1.01,"15min":1.01},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.46999999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88900000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70099999999999996,"15min":0.68899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71799999999999997,"15min":0.71099999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52100000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.92000000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":426,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199563123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.29899999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61899999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.317},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66400000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42899999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42999999999999999,"15min":0.42499999999999999},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.45600000000000002},"min":{"1min":0.35899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.626,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.505,"15min":0.501},"min":{"1min":0.41199999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.439,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70799999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45100000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0229999999999999,"5min":1.284,"15min":1.284},"last":0.497},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.72599999999999998,"15min":0.71599999999999997},"min":{"1min":0.58199999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.53900000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.65100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.042,"5min":1.111,"15min":1.111},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.61299999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93300000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.56399999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.746,"15min":0.754},"min":{"1min":0.63200000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.995,"5min":1.458,"15min":1.458},"last":0.60999999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.65000000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0589999999999999,"5min":1.383,"15min":1.383},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.753,"15min":0.76500000000000001},"min":{"1min":0.63500000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.99199999999999999,"5min":1.27,"15min":1.27},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":428,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194884,"statfs":{"total":200000000,"available":199561623,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.40799999999999997},"min":{"1min":0.32600000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53700000000000003,"5min":10.401,"15min":10.401},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.46700000000000003,"15min":0.437},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":0.41999999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48199999999999998,"15min":0.45700000000000002},"min":{"1min":0.379,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60599999999999998,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.499,"15min":0.46500000000000002},"min":{"1min":0.39600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56499999999999995,"15min":0.52500000000000002},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58899999999999997,"15min":0.54900000000000004},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82399999999999995,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":0.439}]},{"osd":4,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.77300000000000002},"min":{"1min":0.59999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0680000000000001,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.054,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.77200000000000002}]},{"osd":5,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78400000000000003,"15min":0.77600000000000002},"min":{"1min":0.58499999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.026,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.79800000000000004},"min":{"1min":0.67900000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.032,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.84499999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.753,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0980000000000001,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.89500000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.754,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0489999999999999,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.628,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":428,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194883,"statfs":{"total":200000000,"available":199561007,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45400000000000001,"15min":0.436},"min":{"1min":0.307,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66200000000000003,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.34100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68400000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.35899999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.45800000000000002},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63600000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.40400000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.497},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51800000000000002,"15min":0.48599999999999999},"min":{"1min":0.40699999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68500000000000005,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.47399999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73199999999999998,"15min":0.72899999999999998},"min":{"1min":0.59599999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.016,"5min":1.089,"15min":1.089},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95499999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.0349999999999999,"5min":1.109,"15min":1.109},"last":0.627},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.55900000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59099999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97199999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.58799999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97399999999999998,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.63400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.75900000000000001,"15min":0.76600000000000001},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.075,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.52800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1003,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194309,"statfs":{"total":200000000,"available":198972867,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65400000000000003,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.376},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49199999999999999,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.753,"5min":2.294,"15min":2.294},"last":0.47899999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.495},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78200000000000003,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.433},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.29899999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57199999999999995,"5min":2.056,"15min":2.056},"last":0.61699999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76600000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.503}]},{"osd":4,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.052,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.67600000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58099999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97299999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.754},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.55100000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0980000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.68999999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.78500000000000003,"15min":0.78200000000000003},"min":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1240000000000001,"5min":2.415,"15min":2.415},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.079,"5min":2.347,"15min":2.347},"last":0.85599999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79600000000000004,"15min":0.80000000000000004},"min":{"1min":0.63200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0800000000000001,"5min":2.367,"15min":2.367},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.77700000000000002}]}]}],"pool_statfs":[]}} 2023-09-13T06:05:31.915 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T06:05:31.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-13T06:05:32.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.093+0000 7f6cc1c19640 1 Processor -- start 2023-09-13T06:05:32.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.093+0000 7f6cc1c19640 1 -- start start 2023-09-13T06:05:32.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.097+0000 7f6cc1c19640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6cbc15a080 0x7f6cbc0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.097+0000 7f6cc1c19640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc0cc850 con 0x7f6cbc15e650 2023-09-13T06:05:32.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.097+0000 7f6cc1c19640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc0b0330 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.097+0000 7f6cc1c19640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cbc0cbcd0 con 0x7f6cbc15a080 2023-09-13T06:05:32.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.097+0000 7f6cbb7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6cbc15a080 0x7f6cbc0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.097+0000 7f6cbb7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6cbc15a080 0x7f6cbc0b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40468/0 (socket says 172.21.15.130:40468) 2023-09-13T06:05:32.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.097+0000 7f6cb3fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6cbc15e650 0x7f6cbc0b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42904/0 (socket says 172.21.15.130:42904) 2023-09-13T06:05:32.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.097+0000 7f6cbb7fe640 1 -- 172.21.15.130:0/635122604 learned_addr learned my addr 172.21.15.130:0/635122604 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:32.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.097+0000 7f6cbb7fe640 1 -- 172.21.15.130:0/635122604 >> v1:172.21.15.164:6789/0 conn(0x7f6cbc0b31a0 legacy=0x7f6cbc0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:32.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.097+0000 7f6cbb7fe640 1 -- 172.21.15.130:0/635122604 >> v1:172.21.15.130:6789/0 conn(0x7f6cbc15e650 legacy=0x7f6cbc0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:32.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.097+0000 7f6cbb7fe640 1 -- 172.21.15.130:0/635122604 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc0cbfb0 con 0x7f6cbc15a080 2023-09-13T06:05:32.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cbb7fe640 1 --2- 172.21.15.130:0/635122604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cbc15a080 0x7f6cbc0b1460 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00bb10 tx=0x7f6cac01eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f981c2d5863bf4d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:32.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cbaffd640 1 -- 172.21.15.130:0/635122604 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0a7b60 con 0x7f6cbc15a080 2023-09-13T06:05:32.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cbaffd640 1 -- 172.21.15.130:0/635122604 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac0a7cc0 con 0x7f6cbc15a080 2023-09-13T06:05:32.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cbaffd640 1 -- 172.21.15.130:0/635122604 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0af660 con 0x7f6cbc15a080 2023-09-13T06:05:32.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cc1c19640 1 -- 172.21.15.130:0/635122604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cbc15a080 msgr2=0x7f6cbc0b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:32.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cc1c19640 1 --2- 172.21.15.130:0/635122604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cbc15a080 0x7f6cbc0b1460 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00bb10 tx=0x7f6cac01eae0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cc1c19640 1 -- 172.21.15.130:0/635122604 shutdown_connections 2023-09-13T06:05:32.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cc1c19640 1 --2- 172.21.15.130:0/635122604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cbc15a080 0x7f6cbc0b1460 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cc1c19640 1 -- 172.21.15.130:0/635122604 >> 172.21.15.130:0/635122604 conn(0x7f6cbc065990 msgr2=0x7f6cbc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:32.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cc1c19640 1 -- 172.21.15.130:0/635122604 shutdown_connections 2023-09-13T06:05:32.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cc1c19640 1 -- 172.21.15.130:0/635122604 wait complete. 2023-09-13T06:05:32.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cc1c19640 1 Processor -- start 2023-09-13T06:05:32.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.101+0000 7f6cc1c19640 1 -- start start 2023-09-13T06:05:32.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cc1c19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cbc0b31a0 0x7f6cbc06bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cc1c19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cbc15a080 0x7f6cbc146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cc1c19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cbc15e650 0x7f6cbc1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cc1c19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc1477e0 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cc1c19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc136480 con 0x7f6cbc15e650 2023-09-13T06:05:32.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cc1c19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc1366f0 con 0x7f6cbc15a080 2023-09-13T06:05:32.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cbb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cbc0b31a0 0x7f6cbc06bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cbb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cbc0b31a0 0x7f6cbc06bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40480/0 (socket says 172.21.15.130:40480) 2023-09-13T06:05:32.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cbb7fe640 1 -- 172.21.15.130:0/681950309 learned_addr learned my addr 172.21.15.130:0/681950309 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cbb7fe640 1 -- 172.21.15.130:0/681950309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cbc15a080 msgr2=0x7f6cbc146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cb3fff640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cbc15a080 0x7f6cbc146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cbbfff640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cbc15e650 0x7f6cbc1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cbb7fe640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cbc15a080 0x7f6cbc146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cbb7fe640 1 -- 172.21.15.130:0/681950309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cbc15e650 msgr2=0x7f6cbc1472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cbb7fe640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cbc15e650 0x7f6cbc1472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cbb7fe640 1 -- 172.21.15.130:0/681950309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac00b770 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cb3fff640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cbc15a080 0x7f6cbc146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:32.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cbbfff640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cbc15e650 0x7f6cbc1472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:32.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cbb7fe640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cbc0b31a0 0x7f6cbc06bb30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00b2c0 tx=0x7f6cac01d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:32.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cb8ff9640 1 -- 172.21.15.130:0/681950309 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0ba480 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cb8ff9640 1 -- 172.21.15.130:0/681950309 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac0ba600 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cb8ff9640 1 -- 172.21.15.130:0/681950309 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0ba9b0 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cc1c19640 1 -- 172.21.15.130:0/681950309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc1369d0 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cc1c19640 1 -- 172.21.15.130:0/681950309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc136f90 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cc1c19640 1 -- 172.21.15.130:0/681950309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc15ea60 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.105+0000 7f6cb8ff9640 1 -- 172.21.15.130:0/681950309 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6cac0bab10 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.109+0000 7f6cb8ff9640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c9c065b20 0x7f6c9c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.109+0000 7f6cb8ff9640 1 -- 172.21.15.130:0/681950309 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cac11e9d0 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.109+0000 7f6cb3fff640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c9c065b20 0x7f6c9c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.109+0000 7f6cb3fff640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c9c065b20 0x7f6c9c067fe0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc15e5f0 tx=0x7f6ca4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:32.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.113+0000 7f6cb8ff9640 1 -- 172.21.15.130:0/681950309 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6cbc15ea60 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.309+0000 7f6cc1c19640 1 -- 172.21.15.130:0/681950309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6cbc15ea60 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.313+0000 7f6cb8ff9640 1 -- 172.21.15.130:0/681950309 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6cbc15ea60 con 0x7f6cbc0b31a0 2023-09-13T06:05:32.317 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:05:32.317 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:05:32.317 INFO:teuthology.orchestra.run.smithi130.stdout: caps mds = "allow" 2023-09-13T06:05:32.318 INFO:teuthology.orchestra.run.smithi130.stdout: caps mon = "allow r" 2023-09-13T06:05:32.318 INFO:teuthology.orchestra.run.smithi130.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-13T06:05:32.319 INFO:teuthology.orchestra.run.smithi130.stderr:updated caps for client.0 2023-09-13T06:05:32.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 -- 172.21.15.130:0/681950309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c9c065b20 msgr2=0x7f6c9c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:32.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c9c065b20 0x7f6c9c067fe0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc15e5f0 tx=0x7f6ca4009040 comp rx=0 tx=0).stop 2023-09-13T06:05:32.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 -- 172.21.15.130:0/681950309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cbc0b31a0 msgr2=0x7f6cbc06bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:32.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cbc0b31a0 0x7f6cbc06bb30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00b2c0 tx=0x7f6cac01d320 comp rx=0 tx=0).stop 2023-09-13T06:05:32.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 -- 172.21.15.130:0/681950309 shutdown_connections 2023-09-13T06:05:32.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c9c065b20 0x7f6c9c067fe0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cbc15e650 0x7f6cbc1472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cbc15a080 0x7f6cbc146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 --2- 172.21.15.130:0/681950309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cbc0b31a0 0x7f6cbc06bb30 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 -- 172.21.15.130:0/681950309 >> 172.21.15.130:0/681950309 conn(0x7f6cbc065990 msgr2=0x7f6cbc0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:32.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 -- 172.21.15.130:0/681950309 shutdown_connections 2023-09-13T06:05:32.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.317+0000 7f6cc1c19640 1 -- 172.21.15.130:0/681950309 wait complete. 2023-09-13T06:05:32.338 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:05:32.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.473+0000 7fa4d38cb640 1 Processor -- start 2023-09-13T06:05:32.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.473+0000 7fa4d38cb640 1 -- start start 2023-09-13T06:05:32.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d38cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4cc15b130 0x7fa4cc0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d38cb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa4cc0ce180 0x7fa4cc15b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d38cb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4cc0b04a0 0x7fa4cc0b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d38cb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4cc0b0e70 con 0x7fa4cc0b04a0 2023-09-13T06:05:32.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d38cb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4cc0ce980 con 0x7fa4cc0ce180 2023-09-13T06:05:32.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d38cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0cec60 con 0x7fa4cc15b130 2023-09-13T06:05:32.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d1e68640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4cc0b04a0 0x7fa4cc0b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d1e68640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4cc0b04a0 0x7fa4cc0b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40486/0 (socket says 172.21.15.130:40486) 2023-09-13T06:05:32.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d1e68640 1 -- 172.21.15.130:0/3641848774 learned_addr learned my addr 172.21.15.130:0/3641848774 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:32.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d1667640 1 --2- 172.21.15.130:0/3641848774 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4cc15b130 0x7fa4cc0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d0e66640 1 --2- 172.21.15.130:0/3641848774 >> v2:172.21.15.164:3300/0 conn(0x7fa4cc0ce180 0x7fa4cc15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d1e68640 1 -- 172.21.15.130:0/3641848774 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4cc15b130 msgr2=0x7fa4cc0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:32.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d1e68640 1 --2- 172.21.15.130:0/3641848774 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4cc15b130 0x7fa4cc0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d1e68640 1 -- 172.21.15.130:0/3641848774 >> v2:172.21.15.164:3300/0 conn(0x7fa4cc0ce180 msgr2=0x7fa4cc15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:32.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d1e68640 1 --2- 172.21.15.130:0/3641848774 >> v2:172.21.15.164:3300/0 conn(0x7fa4cc0ce180 0x7fa4cc15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d1e68640 1 -- 172.21.15.130:0/3641848774 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc06c640 con 0x7fa4cc0b04a0 2023-09-13T06:05:32.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.477+0000 7fa4d1667640 1 --2- 172.21.15.130:0/3641848774 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4cc15b130 0x7fa4cc0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:32.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d1e68640 1 --2- 172.21.15.130:0/3641848774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4cc0b04a0 0x7fa4cc0b0930 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0b27a0 tx=0x7fa4c401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad54b2adf1ed6f48 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:32.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4c3fff640 1 -- 172.21.15.130:0/3641848774 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40a5850 con 0x7fa4cc0b04a0 2023-09-13T06:05:32.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4c3fff640 1 -- 172.21.15.130:0/3641848774 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c40a59b0 con 0x7fa4cc0b04a0 2023-09-13T06:05:32.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4c3fff640 1 -- 172.21.15.130:0/3641848774 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40a5d40 con 0x7fa4cc0b04a0 2023-09-13T06:05:32.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d38cb640 1 -- 172.21.15.130:0/3641848774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4cc0b04a0 msgr2=0x7fa4cc0b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:32.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d38cb640 1 --2- 172.21.15.130:0/3641848774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4cc0b04a0 0x7fa4cc0b0930 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0b27a0 tx=0x7fa4c401c9d0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d38cb640 1 -- 172.21.15.130:0/3641848774 shutdown_connections 2023-09-13T06:05:32.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d38cb640 1 --2- 172.21.15.130:0/3641848774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4cc0b04a0 0x7fa4cc0b0930 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d38cb640 1 --2- 172.21.15.130:0/3641848774 >> v2:172.21.15.164:3300/0 conn(0x7fa4cc0ce180 0x7fa4cc15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d38cb640 1 --2- 172.21.15.130:0/3641848774 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4cc15b130 0x7fa4cc0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d38cb640 1 -- 172.21.15.130:0/3641848774 >> 172.21.15.130:0/3641848774 conn(0x7fa4cc065990 msgr2=0x7fa4cc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:32.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d38cb640 1 -- 172.21.15.130:0/3641848774 shutdown_connections 2023-09-13T06:05:32.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d38cb640 1 -- 172.21.15.130:0/3641848774 wait complete. 2023-09-13T06:05:32.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d38cb640 1 Processor -- start 2023-09-13T06:05:32.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.481+0000 7fa4d38cb640 1 -- start start 2023-09-13T06:05:32.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d38cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4cc0b04a0 0x7fa4cc13f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d38cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4cc0ce180 0x7fa4cc0ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d38cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4cc15b130 0x7fa4cc158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d38cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0afba0 con 0x7fa4cc0ce180 2023-09-13T06:05:32.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d38cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc151660 con 0x7fa4cc0b04a0 2023-09-13T06:05:32.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d38cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc150d30 con 0x7fa4cc15b130 2023-09-13T06:05:32.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d0e66640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4cc0ce180 0x7fa4cc0ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d0e66640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4cc0ce180 0x7fa4cc0ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40488/0 (socket says 172.21.15.130:40488) 2023-09-13T06:05:32.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d0e66640 1 -- 172.21.15.130:0/4192313729 learned_addr learned my addr 172.21.15.130:0/4192313729 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:32.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d1667640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4cc0b04a0 0x7fa4cc13f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d1e68640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4cc15b130 0x7fa4cc158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d0e66640 1 -- 172.21.15.130:0/4192313729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4cc15b130 msgr2=0x7fa4cc158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:32.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d0e66640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4cc15b130 0x7fa4cc158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d0e66640 1 -- 172.21.15.130:0/4192313729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4cc0b04a0 msgr2=0x7fa4cc13f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:32.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d0e66640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4cc0b04a0 0x7fa4cc13f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d0e66640 1 -- 172.21.15.130:0/4192313729 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4009b30 con 0x7fa4cc0ce180 2023-09-13T06:05:32.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d0e66640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4cc0ce180 0x7fa4cc0ca570 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00e8b0 tx=0x7fa4bc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:32.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4c1ffb640 1 -- 172.21.15.130:0/4192313729 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc00c940 con 0x7fa4cc0ce180 2023-09-13T06:05:32.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4c1ffb640 1 -- 172.21.15.130:0/4192313729 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc00caa0 con 0x7fa4cc0ce180 2023-09-13T06:05:32.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4c1ffb640 1 -- 172.21.15.130:0/4192313729 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc00ce30 con 0x7fa4cc0ce180 2023-09-13T06:05:32.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d38cb640 1 -- 172.21.15.130:0/4192313729 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc151010 con 0x7fa4cc0ce180 2023-09-13T06:05:32.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d38cb640 1 -- 172.21.15.130:0/4192313729 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc13fc10 con 0x7fa4cc0ce180 2023-09-13T06:05:32.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4d38cb640 1 -- 172.21.15.130:0/4192313729 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4cc0618a0 con 0x7fa4cc0ce180 2023-09-13T06:05:32.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.485+0000 7fa4c1ffb640 1 -- 172.21.15.130:0/4192313729 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa4bc013470 con 0x7fa4cc0ce180 2023-09-13T06:05:32.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.489+0000 7fa4c1ffb640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4b0065b50 0x7fa4b0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:32.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.489+0000 7fa4c1ffb640 1 -- 172.21.15.130:0/4192313729 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4bc0834d0 con 0x7fa4cc0ce180 2023-09-13T06:05:32.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.489+0000 7fa4d1667640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4b0065b50 0x7fa4b0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:32.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.489+0000 7fa4d1667640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4b0065b50 0x7fa4b0068010 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80045f0 tx=0x7fa4c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:32.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.493+0000 7fa4c1ffb640 1 -- 172.21.15.130:0/4192313729 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa4bc050e30 con 0x7fa4cc0ce180 2023-09-13T06:05:32.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.673+0000 7fa4d38cb640 1 -- 172.21.15.130:0/4192313729 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4cc0732b0 con 0x7fa4cc0ce180 2023-09-13T06:05:32.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.673+0000 7fa4c1ffb640 1 -- 172.21.15.130:0/4192313729 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fa4bc054450 con 0x7fa4cc0ce180 2023-09-13T06:05:32.680 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:32.680 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2267621007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2267621007},{"type":"v1","addr":"172.21.15.164:6834","nonce":2267621007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5663,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/658594571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":658594571},{"type":"v1","addr":"172.21.15.164:6835","nonce":658594571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6474,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1441650800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1441650800},{"type":"v1","addr":"172.21.15.130:6836","nonce":1441650800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:05:26.837419+0000","modified":"2023-09-13T06:05:29.861380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6477},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6477":{"gid":6477,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/428674793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":428674793},{"type":"v1","addr":"172.21.15.130:6837","nonce":428674793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-09-13T06:05:32.683 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 43 2023-09-13T06:05:32.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 -- 172.21.15.130:0/4192313729 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4b0065b50 msgr2=0x7fa4b0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:32.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4b0065b50 0x7fa4b0068010 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80045f0 tx=0x7fa4c8008040 comp rx=0 tx=0).stop 2023-09-13T06:05:32.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 -- 172.21.15.130:0/4192313729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4cc0ce180 msgr2=0x7fa4cc0ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:32.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4cc0ce180 0x7fa4cc0ca570 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00e8b0 tx=0x7fa4bc00ed70 comp rx=0 tx=0).stop 2023-09-13T06:05:32.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 -- 172.21.15.130:0/4192313729 shutdown_connections 2023-09-13T06:05:32.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4b0065b50 0x7fa4b0068010 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4cc15b130 0x7fa4cc158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4cc0ce180 0x7fa4cc0ca570 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 --2- 172.21.15.130:0/4192313729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4cc0b04a0 0x7fa4cc13f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:32.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 -- 172.21.15.130:0/4192313729 >> 172.21.15.130:0/4192313729 conn(0x7fa4cc065990 msgr2=0x7fa4cc070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:32.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 -- 172.21.15.130:0/4192313729 shutdown_connections 2023-09-13T06:05:32.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:32.677+0000 7fa4d38cb640 1 -- 172.21.15.130:0/4192313729 wait complete. 2023-09-13T06:05:33.101 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T06:05:26.837419+0000', 'modified': '2023-09-13T06:05:29.861380+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6477}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6477': {'gid': 6477, 'name': 'a', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6837/428674793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6835', 'nonce': 428674793}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 428674793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T06:05:33.101 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T06:05:33.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-13T06:05:33.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.241+0000 7fc4a1911640 1 Processor -- start 2023-09-13T06:05:33.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.241+0000 7fc4a1911640 1 -- start start 2023-09-13T06:05:33.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.241+0000 7fc4a1911640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc49c0d1750 0x7fc49c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.241+0000 7fc4a1911640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc49c0d1090 0x7fc49c146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.241+0000 7fc4a1911640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49c0b63c0 con 0x7fc49c0d1b30 2023-09-13T06:05:33.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.241+0000 7fc4a1911640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c15dea0 con 0x7fc49c0d1750 2023-09-13T06:05:33.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.241+0000 7fc4a1911640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c0d0c20 con 0x7fc49c0d1090 2023-09-13T06:05:33.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.241+0000 7fc49affd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc49c0d1750 0x7fc49c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.241+0000 7fc49b7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc49c0d1b30 0x7fc49c0b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42916/0 (socket says 172.21.15.130:42916) 2023-09-13T06:05:33.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.241+0000 7fc49b7fe640 1 -- 172.21.15.130:0/3143509261 learned_addr learned my addr 172.21.15.130:0/3143509261 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:33.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc493fff640 1 --2- 172.21.15.130:0/3143509261 >> v2:172.21.15.164:3300/0 conn(0x7fc49c0d1090 0x7fc49c146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc49affd640 1 -- 172.21.15.130:0/3143509261 >> v2:172.21.15.164:3300/0 conn(0x7fc49c0d1090 msgr2=0x7fc49c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:33.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc49affd640 1 --2- 172.21.15.130:0/3143509261 >> v2:172.21.15.164:3300/0 conn(0x7fc49c0d1090 0x7fc49c146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc49affd640 1 -- 172.21.15.130:0/3143509261 >> v1:172.21.15.130:6789/0 conn(0x7fc49c0d1b30 legacy=0x7fc49c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc49affd640 1 -- 172.21.15.130:0/3143509261 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c0b6610 con 0x7fc49c0d1750 2023-09-13T06:05:33.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc493fff640 1 --2- 172.21.15.130:0/3143509261 >> v2:172.21.15.164:3300/0 conn(0x7fc49c0d1090 0x7fc49c146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:33.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc49affd640 1 --2- 172.21.15.130:0/3143509261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc49c0d1750 0x7fc49c15d960 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0c8360 tx=0x7fc48c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1266dc057452be9e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:33.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc49a7fc640 1 -- 172.21.15.130:0/3143509261 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0a7070 con 0x7fc49c0d1750 2023-09-13T06:05:33.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc49a7fc640 1 -- 172.21.15.130:0/3143509261 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c0ab430 con 0x7fc49c0d1750 2023-09-13T06:05:33.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc49a7fc640 1 -- 172.21.15.130:0/3143509261 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0ab7c0 con 0x7fc49c0d1750 2023-09-13T06:05:33.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc4a1911640 1 -- 172.21.15.130:0/3143509261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc49c0d1750 msgr2=0x7fc49c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc4a1911640 1 --2- 172.21.15.130:0/3143509261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc49c0d1750 0x7fc49c15d960 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0c8360 tx=0x7fc48c01c430 comp rx=0 tx=0).stop 2023-09-13T06:05:33.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc4a1911640 1 -- 172.21.15.130:0/3143509261 shutdown_connections 2023-09-13T06:05:33.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc4a1911640 1 --2- 172.21.15.130:0/3143509261 >> v2:172.21.15.164:3300/0 conn(0x7fc49c0d1090 0x7fc49c146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc4a1911640 1 --2- 172.21.15.130:0/3143509261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc49c0d1750 0x7fc49c15d960 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.245+0000 7fc4a1911640 1 -- 172.21.15.130:0/3143509261 >> 172.21.15.130:0/3143509261 conn(0x7fc49c06f170 msgr2=0x7fc49c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:33.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc4a1911640 1 -- 172.21.15.130:0/3143509261 shutdown_connections 2023-09-13T06:05:33.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc4a1911640 1 -- 172.21.15.130:0/3143509261 wait complete. 2023-09-13T06:05:33.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc4a1911640 1 Processor -- start 2023-09-13T06:05:33.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc4a1911640 1 -- start start 2023-09-13T06:05:33.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc4a1911640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc49c0d1090 0x7fc49c139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc4a1911640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc49c0d1750 0x7fc49c13a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc4a1911640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc49c0d1b30 0x7fc49c141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc4a1911640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c141000 con 0x7fc49c0d1750 2023-09-13T06:05:33.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc4a1911640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c140130 con 0x7fc49c0d1b30 2023-09-13T06:05:33.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc4a1911640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c140380 con 0x7fc49c0d1090 2023-09-13T06:05:33.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc493fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc49c0d1750 0x7fc49c13a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc493fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc49c0d1750 0x7fc49c13a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40498/0 (socket says 172.21.15.130:40498) 2023-09-13T06:05:33.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc493fff640 1 -- 172.21.15.130:0/352698232 learned_addr learned my addr 172.21.15.130:0/352698232 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:33.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc49affd640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc49c0d1090 0x7fc49c139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc49b7fe640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc49c0d1b30 0x7fc49c141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc493fff640 1 -- 172.21.15.130:0/352698232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc49c0d1090 msgr2=0x7fc49c139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc493fff640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc49c0d1090 0x7fc49c139ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc493fff640 1 -- 172.21.15.130:0/352698232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc49c0d1b30 msgr2=0x7fc49c141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc493fff640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc49c0d1b30 0x7fc49c141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc493fff640 1 -- 172.21.15.130:0/352698232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c009420 con 0x7fc49c0d1750 2023-09-13T06:05:33.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc493fff640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc49c0d1750 0x7fc49c13a2a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc48400c7f0 tx=0x7fc48400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:33.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc498ff9640 1 -- 172.21.15.130:0/352698232 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484007820 con 0x7fc49c0d1750 2023-09-13T06:05:33.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc498ff9640 1 -- 172.21.15.130:0/352698232 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc484007980 con 0x7fc49c0d1750 2023-09-13T06:05:33.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc498ff9640 1 -- 172.21.15.130:0/352698232 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484007cf0 con 0x7fc49c0d1750 2023-09-13T06:05:33.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.249+0000 7fc4a1911640 1 -- 172.21.15.130:0/352698232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c140660 con 0x7fc49c0d1750 2023-09-13T06:05:33.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.253+0000 7fc4a1911640 1 -- 172.21.15.130:0/352698232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c140c20 con 0x7fc49c0d1750 2023-09-13T06:05:33.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.253+0000 7fc498ff9640 1 -- 172.21.15.130:0/352698232 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc4840113f0 con 0x7fc49c0d1750 2023-09-13T06:05:33.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.253+0000 7fc498ff9640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc47c065b20 0x7fc47c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.253+0000 7fc498ff9640 1 -- 172.21.15.130:0/352698232 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc484083640 con 0x7fc49c0d1750 2023-09-13T06:05:33.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.253+0000 7fc49affd640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc47c065b20 0x7fc47c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.253+0000 7fc4a4c7f000 1 Processor -- start 2023-09-13T06:05:33.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.253+0000 7fc4a4c7f000 1 -- start start 2023-09-13T06:05:33.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.253+0000 7fc49affd640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc47c065b20 0x7fc47c067fe0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0af000 tx=0x7fc48c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:33.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a1b550 0x55ca63a1b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca63a1be70 0x55ca639ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a00690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca638991e0 con 0x55ca63a002b0 2023-09-13T06:05:33.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca638284c0 con 0x55ca63a1be70 2023-09-13T06:05:33.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca638259f0 con 0x55ca63a1b550 2023-09-13T06:05:33.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a00690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc49affd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a1b550 0x55ca63a1b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a00690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40508/0 (socket says 172.21.15.130:40508) 2023-09-13T06:05:33.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1184823959 learned_addr learned my addr 172.21.15.130:0/1184823959 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:33.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc493fff640 1 --2- 172.21.15.130:0/1184823959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca63a1be70 0x55ca639ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1184823959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a1b550 msgr2=0x55ca63a1b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:33.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc49b7fe640 1 --2- 172.21.15.130:0/1184823959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a1b550 0x55ca63a1b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1184823959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca63a1be70 msgr2=0x55ca639ffd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:33.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc49b7fe640 1 --2- 172.21.15.130:0/1184823959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca63a1be70 0x55ca639ffd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1184823959 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca6351b890 con 0x55ca63a002b0 2023-09-13T06:05:33.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc49b7fe640 1 --2- 172.21.15.130:0/1184823959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a00690 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc494001fd0 tx=0x7fc49400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2cf405bfddb1752 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:33.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4917fa640 1 -- 172.21.15.130:0/1184823959 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49400ee50 con 0x55ca63a002b0 2023-09-13T06:05:33.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4917fa640 1 -- 172.21.15.130:0/1184823959 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc494014480 con 0x55ca63a002b0 2023-09-13T06:05:33.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4917fa640 1 -- 172.21.15.130:0/1184823959 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4940147f0 con 0x55ca63a002b0 2023-09-13T06:05:33.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1184823959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 msgr2=0x55ca63a00690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1184823959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a00690 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc494001fd0 tx=0x7fc49400e530 comp rx=0 tx=0).stop 2023-09-13T06:05:33.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1184823959 shutdown_connections 2023-09-13T06:05:33.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1184823959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca63a1be70 0x55ca639ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1184823959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a00690 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1184823959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a1b550 0x55ca63a1b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1184823959 >> 172.21.15.130:0/1184823959 conn(0x55ca639c8c40 msgr2=0x55ca639d7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:33.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1184823959 shutdown_connections 2023-09-13T06:05:33.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1184823959 wait complete. 2023-09-13T06:05:33.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 -- start start 2023-09-13T06:05:33.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.257+0000 7fc4a4c7f000 1 Processor -- start 2023-09-13T06:05:33.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a002b0 0x55ca639ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca63a1b550 0x55ca639d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1be70 0x55ca639d5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca638212e0 con 0x55ca63a1be70 2023-09-13T06:05:33.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca637dbfe0 con 0x55ca63a1b550 2023-09-13T06:05:33.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca637dbc80 con 0x55ca63a002b0 2023-09-13T06:05:33.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 10 client.0 _ll_register_callbacks cb 0x55ca639bd260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:05:33.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1be70 0x55ca639d5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1be70 0x55ca639d5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40524/0 (socket says 172.21.15.130:40524) 2023-09-13T06:05:33.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1087836256 learned_addr learned my addr 172.21.15.130:0/1087836256 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:33.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc493fff640 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca63a1b550 0x55ca639d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49affd640 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a002b0 0x55ca639ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1087836256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a002b0 msgr2=0x55ca639ffd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:33.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49b7fe640 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a002b0 0x55ca639ffd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1087836256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca63a1b550 msgr2=0x55ca639d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:33.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49b7fe640 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca63a1b550 0x55ca639d5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1087836256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49400f040 con 0x55ca63a1be70 2023-09-13T06:05:33.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49b7fe640 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1be70 0x55ca639d5670 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc494000f90 tx=0x7fc494001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec6bfb93991d6f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:33.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc47a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:05:33.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1087836256 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494001c40 con 0x55ca63a1be70 2023-09-13T06:05:33.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1087836256 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc49400ee50 con 0x55ca63a1be70 2023-09-13T06:05:33.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1087836256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca637b8a50 con 0x55ca63a1be70 2023-09-13T06:05:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1087836256 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc494014a40 con 0x55ca63a1be70 2023-09-13T06:05:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 10 client.6621 fetch_fsmap learned FSMap version 43 2023-09-13T06:05:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1087836256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55ca637e4210 con 0x55ca63a1be70 2023-09-13T06:05:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1087836256 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca637b8a50 con 0x55ca63a1be70 2023-09-13T06:05:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1087836256 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc494014ba0 con 0x55ca63a1be70 2023-09-13T06:05:33.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 10 client.6621 fetch_fsmap finished waiting for FSMap version 43 2023-09-13T06:05:33.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 10 client.6621 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-13T06:05:33.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 20 client.6621 populate_metadata read hostname 'smithi130' 2023-09-13T06:05:33.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.130:6835/428674793,v1:172.21.15.130:6837/428674793] conn(0x55ca639d63e0 0x55ca63a2d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 4 client.6621 mds_command: new command op to 6477 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T06:05:33.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1087836256 --> [v2:172.21.15.130:6835/428674793,v1:172.21.15.130:6837/428674793] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca637d8820 con 0x55ca639d63e0 2023-09-13T06:05:33.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49affd640 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.130:6835/428674793,v1:172.21.15.130:6837/428674793] conn(0x55ca639d63e0 0x55ca63a2d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc47a7fc640 10 client.6621 ms_handle_connect on v2:172.21.15.130:6835/428674793 2023-09-13T06:05:33.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.261+0000 7fc49affd640 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.130:6835/428674793,v1:172.21.15.130:6837/428674793] conn(0x55ca639d63e0 0x55ca63a2d600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8be47d12dc0f3b88 server_cookie=5d02823c2b6000fe in_seq=0 out_seq=0 2023-09-13T06:05:33.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1087836256 <== mds.0 v2:172.21.15.130:6835/428674793 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ca637d8820 con 0x55ca639d63e0 2023-09-13T06:05:33.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc47a7fc640 10 client.6621 handle_command_reply: tid=0 2023-09-13T06:05:33.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 1 client.6621 shutdown 2023-09-13T06:05:33.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1087836256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1be70 msgr2=0x55ca639d5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1be70 0x55ca639d5670 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc494000f90 tx=0x7fc494001260 comp rx=0 tx=0).stop 2023-09-13T06:05:33.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1087836256 shutdown_connections 2023-09-13T06:05:33.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.130:6835/428674793,v1:172.21.15.130:6837/428674793] conn(0x55ca639d63e0 0x55ca63a2d600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca63a1b550 0x55ca639d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1be70 0x55ca639d5670 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1087836256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a002b0 0x55ca639ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc47a7fc640 0 client.6621 ms_handle_reset on v2:172.21.15.130:6835/428674793 2023-09-13T06:05:33.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1087836256 >> 172.21.15.130:0/1087836256 conn(0x55ca639c8c40 msgr2=0x55ca63a01130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:33.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1087836256 shutdown_connections 2023-09-13T06:05:33.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1087836256 wait complete. 2023-09-13T06:05:33.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.265+0000 7fc4a4c7f000 20 client.6621 trim_cache size 0 max 16384 2023-09-13T06:05:33.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.277+0000 7fc4a4c7f000 1 Processor -- start 2023-09-13T06:05:33.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.277+0000 7fc4a4c7f000 1 -- start start 2023-09-13T06:05:33.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca639c8c40 0x55ca639fed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a002b0 0x55ca639ff270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1b550 0x55ca63a2b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca634dc940 con 0x55ca63a1b550 2023-09-13T06:05:33.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca639fffc0 con 0x55ca639c8c40 2023-09-13T06:05:33.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca637d86c0 con 0x55ca63a002b0 2023-09-13T06:05:33.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1b550 0x55ca63a2b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1b550 0x55ca63a2b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40532/0 (socket says 172.21.15.130:40532) 2023-09-13T06:05:33.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1953932563 learned_addr learned my addr 172.21.15.130:0/1953932563 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:33.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc493fff640 1 --2- 172.21.15.130:0/1953932563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a002b0 0x55ca639ff270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc49affd640 1 --2- 172.21.15.130:0/1953932563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca639c8c40 0x55ca639fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1953932563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a002b0 msgr2=0x55ca639ff270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:33.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc49b7fe640 1 --2- 172.21.15.130:0/1953932563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a002b0 0x55ca639ff270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1953932563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca639c8c40 msgr2=0x55ca639fed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:33.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc49b7fe640 1 --2- 172.21.15.130:0/1953932563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca639c8c40 0x55ca639fed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc49b7fe640 1 -- 172.21.15.130:0/1953932563 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca637ca4a0 con 0x55ca63a1b550 2023-09-13T06:05:33.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc49affd640 1 --2- 172.21.15.130:0/1953932563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca639c8c40 0x55ca639fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:33.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc49b7fe640 1 --2- 172.21.15.130:0/1953932563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1b550 0x55ca63a2b5f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc494005c10 tx=0x7fc49401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea7288ae6144e0e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:33.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc491ffb640 1 -- 172.21.15.130:0/1953932563 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494014690 con 0x55ca63a1b550 2023-09-13T06:05:33.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc491ffb640 1 -- 172.21.15.130:0/1953932563 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49400ee50 con 0x55ca63a1b550 2023-09-13T06:05:33.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc491ffb640 1 -- 172.21.15.130:0/1953932563 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494014a40 con 0x55ca63a1b550 2023-09-13T06:05:33.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1953932563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1b550 msgr2=0x55ca63a2b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1953932563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1b550 0x55ca63a2b5f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc494005c10 tx=0x7fc49401f000 comp rx=0 tx=0).stop 2023-09-13T06:05:33.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1953932563 shutdown_connections 2023-09-13T06:05:33.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1953932563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a1b550 0x55ca63a2b5f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1953932563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a002b0 0x55ca639ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1953932563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca639c8c40 0x55ca639fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1953932563 >> 172.21.15.130:0/1953932563 conn(0x55ca639d73e0 msgr2=0x55ca639fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:33.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1953932563 shutdown_connections 2023-09-13T06:05:33.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1953932563 wait complete. 2023-09-13T06:05:33.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 -- start start 2023-09-13T06:05:33.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.281+0000 7fc4a4c7f000 1 Processor -- start 2023-09-13T06:05:33.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca639c8c40 0x55ca63a2e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a792b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a1b550 0x55ca63a797f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca638252e0 con 0x55ca63a002b0 2023-09-13T06:05:33.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6381e6e0 con 0x55ca639c8c40 2023-09-13T06:05:33.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca639d7e70 con 0x55ca63a1b550 2023-09-13T06:05:33.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 10 client.0 _ll_register_callbacks cb 0x55ca637d7ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:05:33.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc493fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc493fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a792b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40538/0 (socket says 172.21.15.130:40538) 2023-09-13T06:05:33.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc493fff640 1 -- 172.21.15.130:0/1076584053 learned_addr learned my addr 172.21.15.130:0/1076584053 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:33.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc49b7fe640 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a1b550 0x55ca63a797f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc49affd640 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca639c8c40 0x55ca63a2e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc493fff640 1 -- 172.21.15.130:0/1076584053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a1b550 msgr2=0x55ca63a797f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:33.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc493fff640 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a1b550 0x55ca63a797f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc493fff640 1 -- 172.21.15.130:0/1076584053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca639c8c40 msgr2=0x55ca63a2e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:33.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc493fff640 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca639c8c40 0x55ca63a2e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc493fff640 1 -- 172.21.15.130:0/1076584053 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca637e4210 con 0x55ca63a002b0 2023-09-13T06:05:33.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc493fff640 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a792b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fc48405c6f0 tx=0x7fc484054c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66774230a593997 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:33.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc47a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:05:33.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1076584053 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48405c990 con 0x55ca63a002b0 2023-09-13T06:05:33.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1076584053 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc48405cc20 con 0x55ca63a002b0 2023-09-13T06:05:33.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1076584053 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca637dc900 con 0x55ca63a002b0 2023-09-13T06:05:33.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1076584053 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc484050a30 con 0x55ca63a002b0 2023-09-13T06:05:33.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 10 client.6627 fetch_fsmap learned FSMap version 43 2023-09-13T06:05:33.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1076584053 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55ca6351bcc0 con 0x55ca63a002b0 2023-09-13T06:05:33.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1076584053 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca637dc900 con 0x55ca63a002b0 2023-09-13T06:05:33.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1076584053 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc484050b90 con 0x55ca63a002b0 2023-09-13T06:05:33.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 10 client.6627 fetch_fsmap finished waiting for FSMap version 43 2023-09-13T06:05:33.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 10 client.6627 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-13T06:05:33.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 20 client.6627 populate_metadata read hostname 'smithi130' 2023-09-13T06:05:33.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.130:6835/428674793,v1:172.21.15.130:6837/428674793] conn(0x55ca63a1be70 0x55ca63a36e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 4 client.6627 mds_command: new command op to 6477 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T06:05:33.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1076584053 --> [v2:172.21.15.130:6835/428674793,v1:172.21.15.130:6837/428674793] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ca6381a2c0 con 0x55ca63a1be70 2023-09-13T06:05:33.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc49affd640 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.130:6835/428674793,v1:172.21.15.130:6837/428674793] conn(0x55ca63a1be70 0x55ca63a36e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc49affd640 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.130:6835/428674793,v1:172.21.15.130:6837/428674793] conn(0x55ca63a1be70 0x55ca63a36e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=602f5bbf89a52ec3 server_cookie=3fe4c6ba89d3e7e5 in_seq=0 out_seq=0 2023-09-13T06:05:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc47a7fc640 10 client.6627 ms_handle_connect on v2:172.21.15.130:6835/428674793 2023-09-13T06:05:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc47a7fc640 1 -- 172.21.15.130:0/1076584053 <== mds.0 v2:172.21.15.130:6835/428674793 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55ca6381a2c0 con 0x55ca63a1be70 2023-09-13T06:05:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc47a7fc640 10 client.6627 handle_command_reply: tid=0 2023-09-13T06:05:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 client.6627 shutdown 2023-09-13T06:05:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1076584053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 msgr2=0x55ca63a792b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a792b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fc48405c6f0 tx=0x7fc484054c40 comp rx=0 tx=0).stop 2023-09-13T06:05:33.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1076584053 shutdown_connections 2023-09-13T06:05:33.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.130:6835/428674793,v1:172.21.15.130:6837/428674793] conn(0x55ca63a1be70 0x55ca63a36e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55ca63a1b550 0x55ca63a797f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca63a002b0 0x55ca63a792b0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc47a7fc640 0 client.6627 ms_handle_reset on v2:172.21.15.130:6835/428674793 2023-09-13T06:05:33.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 --2- 172.21.15.130:0/1076584053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ca639c8c40 0x55ca63a2e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1076584053 >> 172.21.15.130:0/1076584053 conn(0x55ca639d73e0 msgr2=0x55ca639fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:33.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1076584053 shutdown_connections 2023-09-13T06:05:33.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.285+0000 7fc4a4c7f000 1 -- 172.21.15.130:0/1076584053 wait complete. 2023-09-13T06:05:33.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a4c7f000 20 client.6627 trim_cache size 0 max 16384 2023-09-13T06:05:33.306 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:05:33.306 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:05:33.306 INFO:teuthology.orchestra.run.smithi130.stdout: "whoami": 0, 2023-09-13T06:05:33.307 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 6477, 2023-09-13T06:05:33.307 INFO:teuthology.orchestra.run.smithi130.stdout: "want_state": "up:active", 2023-09-13T06:05:33.307 INFO:teuthology.orchestra.run.smithi130.stdout: "state": "up:active", 2023-09-13T06:05:33.307 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs", 2023-09-13T06:05:33.307 INFO:teuthology.orchestra.run.smithi130.stdout: "rank_uptime": 5.8244058269999996, 2023-09-13T06:05:33.308 INFO:teuthology.orchestra.run.smithi130.stdout: "mdsmap_epoch": 43, 2023-09-13T06:05:33.308 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch": 83, 2023-09-13T06:05:33.308 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch_barrier": 83, 2023-09-13T06:05:33.308 INFO:teuthology.orchestra.run.smithi130.stdout: "uptime": 10.594862244 2023-09-13T06:05:33.308 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:05:33.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 -- 172.21.15.130:0/352698232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc47c065b20 msgr2=0x7fc47c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc47c065b20 0x7fc47c067fe0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0af000 tx=0x7fc48c0a7000 comp rx=0 tx=0).stop 2023-09-13T06:05:33.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 -- 172.21.15.130:0/352698232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc49c0d1750 msgr2=0x7fc49c13a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc49c0d1750 0x7fc49c13a2a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc48400c7f0 tx=0x7fc48400ccb0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 -- 172.21.15.130:0/352698232 shutdown_connections 2023-09-13T06:05:33.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc47c065b20 0x7fc47c067fe0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc49c0d1b30 0x7fc49c141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc49c0d1750 0x7fc49c13a2a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 --2- 172.21.15.130:0/352698232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc49c0d1090 0x7fc49c139ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 -- 172.21.15.130:0/352698232 >> 172.21.15.130:0/352698232 conn(0x7fc49c06f170 msgr2=0x7fc49c13f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:33.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 -- 172.21.15.130:0/352698232 shutdown_connections 2023-09-13T06:05:33.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.289+0000 7fc4a1911640 1 -- 172.21.15.130:0/352698232 wait complete. 2023-09-13T06:05:33.313 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:05:33.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.449+0000 7f56e080b640 1 Processor -- start 2023-09-13T06:05:33.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.449+0000 7f56e080b640 1 -- start start 2023-09-13T06:05:33.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56e080b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f56dc15d260 0x7f56dc0b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56e080b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f56dc06ddf0 0x7f56dc071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56e080b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc070e70 con 0x7f56dc0ce1a0 2023-09-13T06:05:33.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56e080b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56dc070280 con 0x7f56dc06ddf0 2023-09-13T06:05:33.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56e080b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56dc070540 con 0x7f56dc15d260 2023-09-13T06:05:33.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56dad9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f56dc06ddf0 0x7f56dc071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56dad9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f56dc06ddf0 0x7f56dc071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40548/0 (socket says 172.21.15.130:40548) 2023-09-13T06:05:33.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56dad9d640 1 -- 172.21.15.130:0/2643483012 learned_addr learned my addr 172.21.15.130:0/2643483012 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:33.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56da59c640 1 --2- 172.21.15.130:0/2643483012 >> v2:172.21.15.164:3300/0 conn(0x7f56dc15d260 0x7f56dc0b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56dad9d640 1 -- 172.21.15.130:0/2643483012 >> v2:172.21.15.164:3300/0 conn(0x7f56dc15d260 msgr2=0x7f56dc0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:33.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56dad9d640 1 --2- 172.21.15.130:0/2643483012 >> v2:172.21.15.164:3300/0 conn(0x7f56dc15d260 0x7f56dc0b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56dad9d640 1 -- 172.21.15.130:0/2643483012 >> v1:172.21.15.130:6789/0 conn(0x7f56dc0ce1a0 legacy=0x7f56dc06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56dad9d640 1 -- 172.21.15.130:0/2643483012 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc070820 con 0x7f56dc06ddf0 2023-09-13T06:05:33.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.453+0000 7f56da59c640 1 --2- 172.21.15.130:0/2643483012 >> v2:172.21.15.164:3300/0 conn(0x7f56dc15d260 0x7f56dc0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:33.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56dad9d640 1 --2- 172.21.15.130:0/2643483012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56dc06ddf0 0x7f56dc071300 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0b3b00 tx=0x7f56d401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89fddd6acbef650 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:33.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56d959a640 1 -- 172.21.15.130:0/2643483012 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d40a5840 con 0x7f56dc06ddf0 2023-09-13T06:05:33.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56d959a640 1 -- 172.21.15.130:0/2643483012 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d40a59a0 con 0x7f56dc06ddf0 2023-09-13T06:05:33.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56d959a640 1 -- 172.21.15.130:0/2643483012 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d40a5d30 con 0x7f56dc06ddf0 2023-09-13T06:05:33.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56e080b640 1 -- 172.21.15.130:0/2643483012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56dc06ddf0 msgr2=0x7f56dc071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56e080b640 1 --2- 172.21.15.130:0/2643483012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56dc06ddf0 0x7f56dc071300 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0b3b00 tx=0x7f56d401c9a0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56e080b640 1 -- 172.21.15.130:0/2643483012 shutdown_connections 2023-09-13T06:05:33.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56e080b640 1 --2- 172.21.15.130:0/2643483012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56dc06ddf0 0x7f56dc071300 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56e080b640 1 --2- 172.21.15.130:0/2643483012 >> v2:172.21.15.164:3300/0 conn(0x7f56dc15d260 0x7f56dc0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56e080b640 1 -- 172.21.15.130:0/2643483012 >> 172.21.15.130:0/2643483012 conn(0x7f56dc06a2f0 msgr2=0x7f56dc06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:33.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56e080b640 1 -- 172.21.15.130:0/2643483012 shutdown_connections 2023-09-13T06:05:33.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56e080b640 1 -- 172.21.15.130:0/2643483012 wait complete. 2023-09-13T06:05:33.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56e080b640 1 Processor -- start 2023-09-13T06:05:33.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.457+0000 7f56e080b640 1 -- start start 2023-09-13T06:05:33.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56e080b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56dc06ddf0 0x7f56dc156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56e080b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56dc0ce1a0 0x7f56dc14ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56e080b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56dc15d260 0x7f56dc157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56e080b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc156e20 con 0x7f56dc15d260 2023-09-13T06:05:33.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56e080b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc158240 con 0x7f56dc0ce1a0 2023-09-13T06:05:33.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56e080b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc158520 con 0x7f56dc06ddf0 2023-09-13T06:05:33.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56dad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56dc15d260 0x7f56dc157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56dad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56dc15d260 0x7f56dc157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40562/0 (socket says 172.21.15.130:40562) 2023-09-13T06:05:33.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56dad9d640 1 -- 172.21.15.130:0/1573119654 learned_addr learned my addr 172.21.15.130:0/1573119654 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:33.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56da59c640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56dc06ddf0 0x7f56dc156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56d9d9b640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56dc0ce1a0 0x7f56dc14ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56dad9d640 1 -- 172.21.15.130:0/1573119654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56dc06ddf0 msgr2=0x7f56dc156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56dad9d640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56dc06ddf0 0x7f56dc156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56dad9d640 1 -- 172.21.15.130:0/1573119654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56dc0ce1a0 msgr2=0x7f56dc14ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56dad9d640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56dc0ce1a0 0x7f56dc14ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56dad9d640 1 -- 172.21.15.130:0/1573119654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4009b30 con 0x7f56dc15d260 2023-09-13T06:05:33.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56dad9d640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56dc15d260 0x7f56dc157510 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f56d40af040 tx=0x7f56d4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:33.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56caffd640 1 -- 172.21.15.130:0/1573119654 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d40b8670 con 0x7f56dc15d260 2023-09-13T06:05:33.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56caffd640 1 -- 172.21.15.130:0/1573119654 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d40b87d0 con 0x7f56dc15d260 2023-09-13T06:05:33.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56e080b640 1 -- 172.21.15.130:0/1573119654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc158800 con 0x7f56dc15d260 2023-09-13T06:05:33.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56caffd640 1 -- 172.21.15.130:0/1573119654 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d40b8b80 con 0x7f56dc15d260 2023-09-13T06:05:33.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56e080b640 1 -- 172.21.15.130:0/1573119654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc150ef0 con 0x7f56dc15d260 2023-09-13T06:05:33.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56e080b640 1 -- 172.21.15.130:0/1573119654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc0618a0 con 0x7f56dc15d260 2023-09-13T06:05:33.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.461+0000 7f56caffd640 1 -- 172.21.15.130:0/1573119654 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f56d40b8ce0 con 0x7f56dc15d260 2023-09-13T06:05:33.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.465+0000 7f56caffd640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f56bc065b20 0x7f56bc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:33.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.465+0000 7f56caffd640 1 -- 172.21.15.130:0/1573119654 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56d411e9a0 con 0x7f56dc15d260 2023-09-13T06:05:33.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.465+0000 7f56da59c640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f56bc065b20 0x7f56bc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:33.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.465+0000 7f56da59c640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f56bc065b20 0x7f56bc067fe0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00ba10 tx=0x7f56cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:33.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.469+0000 7f56caffd640 1 -- 172.21.15.130:0/1573119654 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f56d40ec3a0 con 0x7f56dc15d260 2023-09-13T06:05:33.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.649+0000 7f56e080b640 1 -- 172.21.15.130:0/1573119654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f56dc158cb0 con 0x7f56dc15d260 2023-09-13T06:05:33.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.649+0000 7f56caffd640 1 -- 172.21.15.130:0/1573119654 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f56d40ef9c0 con 0x7f56dc15d260 2023-09-13T06:05:33.652 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:05:33.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 -- 172.21.15.130:0/1573119654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f56bc065b20 msgr2=0x7f56bc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f56bc065b20 0x7f56bc067fe0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00ba10 tx=0x7f56cc008040 comp rx=0 tx=0).stop 2023-09-13T06:05:33.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 -- 172.21.15.130:0/1573119654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56dc15d260 msgr2=0x7f56dc157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:33.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56dc15d260 0x7f56dc157510 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f56d40af040 tx=0x7f56d4019740 comp rx=0 tx=0).stop 2023-09-13T06:05:33.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 -- 172.21.15.130:0/1573119654 shutdown_connections 2023-09-13T06:05:33.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f56bc065b20 0x7f56bc067fe0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56dc0ce1a0 0x7f56dc14ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56dc15d260 0x7f56dc157510 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 --2- 172.21.15.130:0/1573119654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56dc06ddf0 0x7f56dc156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:33.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 -- 172.21.15.130:0/1573119654 >> 172.21.15.130:0/1573119654 conn(0x7f56dc06a2f0 msgr2=0x7f56dc0d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:33.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 -- 172.21.15.130:0/1573119654 shutdown_connections 2023-09-13T06:05:33.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:33.653+0000 7f56e080b640 1 -- 172.21.15.130:0/1573119654 wait complete. 2023-09-13T06:05:33.673 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:05:33.674 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:05:33.674 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:05:33.674 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T06:05:33.675 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:05:33.675 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:05:33.675 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:05:33.676 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:05:33.676 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:05:33.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:33.677 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:05:33.688 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:05:33.688 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:05:33.688 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:05:33.688 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:33.688 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:05:33.689 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:33.689 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:05:33.689 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:33.689 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:05:33.689 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:05:33.690 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:33.690 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:05:33.690 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:05:33.690 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:33.690 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:05:33.691 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:33.691 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:05:33.691 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42174sec preferred_lft 42174sec 2023-09-13T06:05:33.691 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:05:33.691 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:33.692 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:05:33.692 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:33.692 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:05:33.692 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:33.692 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:05:33.692 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:33.693 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:05:33.693 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:33.693 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:05:33.693 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:33.693 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:05:33.693 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:05:33.694 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:05:33.694 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:33.694 INFO:teuthology.orchestra.run.smithi130.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:05:33.694 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:05:33.694 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:05:33.695 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:33.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:33.695 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:05:33.752 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:05:33.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:33.755 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:05:33.808 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:05:33.809 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:05:33.809 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:05:33.809 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:05:33.809 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:05:33.809 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:05:33.810 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:05:33.810 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:05:33.810 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:05:33.810 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:05:33.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:33.811 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:05:33.812 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:05:33.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:05:33.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:05:33.813 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:05:33.813 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:05:33.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:33.904 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:05:33.914 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T06:05:33.914 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:05:33.914 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:05:33.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:33.915 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-09-13T06:05:33.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:05:33.978 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T06:05:34.029 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:05:34.030 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:05:34.030 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:05:34.084 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:05:34.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:34.085 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:05:34.174 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:05:34.175 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:05:34.175 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:05:34.189 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:05:34.190 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:05:34.190 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:05:34.190 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:05:34.190 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:05:34.196 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:05:34.197 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:05:34.197 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:05:34.197 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:05:34.197 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:05:34.198 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:05:34.198 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:05:34.198 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:05:34.200 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:05:34.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:34.201 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:05:34.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:34.223 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:05:34.281 INFO:teuthology.orchestra.run.smithi130.stdout:client5744 2023-09-13T06:05:34.282 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:05:34.283 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:34.333 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:05:34.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84ce448640 1 Processor -- start 2023-09-13T06:05:34.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84ce448640 1 -- start start 2023-09-13T06:05:34.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84ce448640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f84c80d1750 0x7f84c815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:34.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84ce448640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f84c80d1090 0x7f84c8146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:34.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84ce448640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c80b63c0 con 0x7f84c80d1b30 2023-09-13T06:05:34.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84ce448640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c815dea0 con 0x7f84c80d1090 2023-09-13T06:05:34.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84ce448640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c80d0c20 con 0x7f84c80d1750 2023-09-13T06:05:34.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84c77fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f84c80d1090 0x7f84c8146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:34.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84cc9e5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f84c80d1b30 0x7f84c80b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42942/0 (socket says 172.21.15.130:42942) 2023-09-13T06:05:34.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84cc9e5640 1 -- 172.21.15.130:0/3323187063 learned_addr learned my addr 172.21.15.130:0/3323187063 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:05:34.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84c7fff640 1 --2- 172.21.15.130:0/3323187063 >> v2:172.21.15.164:3300/0 conn(0x7f84c80d1750 0x7f84c815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:34.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84c77fe640 1 -- 172.21.15.130:0/3323187063 >> v2:172.21.15.164:3300/0 conn(0x7f84c80d1750 msgr2=0x7f84c815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:34.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84c77fe640 1 --2- 172.21.15.130:0/3323187063 >> v2:172.21.15.164:3300/0 conn(0x7f84c80d1750 0x7f84c815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:34.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84c77fe640 1 -- 172.21.15.130:0/3323187063 >> v1:172.21.15.130:6789/0 conn(0x7f84c80d1b30 legacy=0x7f84c80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:34.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84c77fe640 1 -- 172.21.15.130:0/3323187063 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c80b6610 con 0x7f84c80d1090 2023-09-13T06:05:34.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.517+0000 7f84c7fff640 1 --2- 172.21.15.130:0/3323187063 >> v2:172.21.15.164:3300/0 conn(0x7f84c80d1750 0x7f84c815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:34.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84c77fe640 1 --2- 172.21.15.130:0/3323187063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84c80d1090 0x7f84c8146820 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f84c8073cd0 tx=0x7f84bc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a73c6d224383e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:34.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84c6ffd640 1 -- 172.21.15.130:0/3323187063 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0a7070 con 0x7f84c80d1090 2023-09-13T06:05:34.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84c6ffd640 1 -- 172.21.15.130:0/3323187063 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc0ab430 con 0x7f84c80d1090 2023-09-13T06:05:34.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84c6ffd640 1 -- 172.21.15.130:0/3323187063 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0ab7c0 con 0x7f84c80d1090 2023-09-13T06:05:34.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84ce448640 1 -- 172.21.15.130:0/3323187063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84c80d1090 msgr2=0x7f84c8146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:34.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84ce448640 1 --2- 172.21.15.130:0/3323187063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84c80d1090 0x7f84c8146820 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f84c8073cd0 tx=0x7f84bc01c430 comp rx=0 tx=0).stop 2023-09-13T06:05:34.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84ce448640 1 -- 172.21.15.130:0/3323187063 shutdown_connections 2023-09-13T06:05:34.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84ce448640 1 --2- 172.21.15.130:0/3323187063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84c80d1090 0x7f84c8146820 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:34.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84ce448640 1 --2- 172.21.15.130:0/3323187063 >> v2:172.21.15.164:3300/0 conn(0x7f84c80d1750 0x7f84c815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:34.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84ce448640 1 -- 172.21.15.130:0/3323187063 >> 172.21.15.130:0/3323187063 conn(0x7f84c806f170 msgr2=0x7f84c806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:34.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84ce448640 1 -- 172.21.15.130:0/3323187063 shutdown_connections 2023-09-13T06:05:34.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84ce448640 1 -- 172.21.15.130:0/3323187063 wait complete. 2023-09-13T06:05:34.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84ce448640 1 Processor -- start 2023-09-13T06:05:34.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.521+0000 7f84ce448640 1 -- start start 2023-09-13T06:05:34.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84ce448640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84c80d1090 0x7f84c813d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:34.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84ce448640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84c80d1750 0x7f84c813acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:34.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84ce448640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84c80d1b30 0x7f84c815be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:34.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84ce448640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c81437b0 con 0x7f84c80d1090 2023-09-13T06:05:34.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84ce448640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c815fa80 con 0x7f84c80d1750 2023-09-13T06:05:34.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84ce448640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c815fd60 con 0x7f84c80d1b30 2023-09-13T06:05:34.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84c80d1090 0x7f84c813d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:34.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84c80d1090 0x7f84c813d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40566/0 (socket says 172.21.15.130:40566) 2023-09-13T06:05:34.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c7fff640 1 -- 172.21.15.130:0/827247896 learned_addr learned my addr 172.21.15.130:0/827247896 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:34.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c77fe640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84c80d1750 0x7f84c813acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:34.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84cc9e5640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84c80d1b30 0x7f84c815be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:34.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c7fff640 1 -- 172.21.15.130:0/827247896 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84c80d1b30 msgr2=0x7f84c815be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:34.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c7fff640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84c80d1b30 0x7f84c815be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:34.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c7fff640 1 -- 172.21.15.130:0/827247896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84c80d1750 msgr2=0x7f84c813acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:34.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c7fff640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84c80d1750 0x7f84c813acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:34.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c7fff640 1 -- 172.21.15.130:0/827247896 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc009420 con 0x7f84c80d1090 2023-09-13T06:05:34.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c7fff640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84c80d1090 0x7f84c813d970 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f84b800e810 tx=0x7f84b800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:34.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c4ff9640 1 -- 172.21.15.130:0/827247896 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b800c8d0 con 0x7f84c80d1090 2023-09-13T06:05:34.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c4ff9640 1 -- 172.21.15.130:0/827247896 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b800ca30 con 0x7f84c80d1090 2023-09-13T06:05:34.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84c4ff9640 1 -- 172.21.15.130:0/827247896 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b800cdc0 con 0x7f84c80d1090 2023-09-13T06:05:34.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84ce448640 1 -- 172.21.15.130:0/827247896 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c8160040 con 0x7f84c80d1090 2023-09-13T06:05:34.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84ce448640 1 -- 172.21.15.130:0/827247896 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c813deb0 con 0x7f84c80d1090 2023-09-13T06:05:34.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.525+0000 7f84ce448640 1 -- 172.21.15.130:0/827247896 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c80707d0 con 0x7f84c80d1090 2023-09-13T06:05:34.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.529+0000 7f84c4ff9640 1 -- 172.21.15.130:0/827247896 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f84b8013410 con 0x7f84c80d1090 2023-09-13T06:05:34.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.529+0000 7f84c4ff9640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84b4065b20 0x7f84b4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:34.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.529+0000 7f84c4ff9640 1 -- 172.21.15.130:0/827247896 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84b8083080 con 0x7f84c80d1090 2023-09-13T06:05:34.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.529+0000 7f84c77fe640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84b4065b20 0x7f84b4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:34.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.529+0000 7f84c77fe640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84b4065b20 0x7f84b4067fe0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0af000 tx=0x7f84bc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:34.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.533+0000 7f84c4ff9640 1 -- 172.21.15.130:0/827247896 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f84b8050a80 con 0x7f84c80d1090 2023-09-13T06:05:34.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.713+0000 7f84ce448640 1 -- 172.21.15.130:0/827247896 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f84c81604f0 con 0x7f84c80d1090 2023-09-13T06:05:34.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.713+0000 7f84c4ff9640 1 -- 172.21.15.130:0/827247896 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f84b8009480 con 0x7f84c80d1090 2023-09-13T06:05:34.716 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:05:34.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 -- 172.21.15.130:0/827247896 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84b4065b20 msgr2=0x7f84b4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:34.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84b4065b20 0x7f84b4067fe0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0af000 tx=0x7f84bc0a7000 comp rx=0 tx=0).stop 2023-09-13T06:05:34.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 -- 172.21.15.130:0/827247896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84c80d1090 msgr2=0x7f84c813d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:34.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84c80d1090 0x7f84c813d970 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f84b800e810 tx=0x7f84b800ecd0 comp rx=0 tx=0).stop 2023-09-13T06:05:34.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 -- 172.21.15.130:0/827247896 shutdown_connections 2023-09-13T06:05:34.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f84b4065b20 0x7f84b4067fe0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:34.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84c80d1750 0x7f84c813acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:34.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84c80d1b30 0x7f84c815be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:34.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 --2- 172.21.15.130:0/827247896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84c80d1090 0x7f84c813d970 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:34.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 -- 172.21.15.130:0/827247896 >> 172.21.15.130:0/827247896 conn(0x7f84c806f170 msgr2=0x7f84c8145d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:34.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 -- 172.21.15.130:0/827247896 shutdown_connections 2023-09-13T06:05:34.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:34.717+0000 7f84ce448640 1 -- 172.21.15.130:0/827247896 wait complete. 2023-09-13T06:05:34.737 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:05:34.737 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:05:34.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:05:34.738 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T06:05:34.738 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:05:34.738 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:05:34.739 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:05:34.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:05:34.739 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:05:34.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:34.740 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:05:34.751 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:05:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:05:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:05:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:05:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:34.753 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:05:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:05:34.754 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:05:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:05:34.754 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:05:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:34.755 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:05:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:05:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42189sec preferred_lft 42189sec 2023-09-13T06:05:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:05:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:34.756 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:05:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:05:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:34.757 INFO:teuthology.orchestra.run.smithi164.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:05:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:05:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:05:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:05:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:34.758 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:05:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:05:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:05:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:34.759 INFO:teuthology.orchestra.run.smithi164.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:05:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:05:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:05:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:05:34.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:34.761 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:05:34.823 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:05:34.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:34.827 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:05:34.878 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:05:34.879 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:05:34.879 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:05:34.879 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:05:34.879 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:05:34.880 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:05:34.880 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:05:34.880 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:05:34.880 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:05:34.880 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:05:34.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:34.881 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:05:34.882 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:05:34.882 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:05:34.882 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:05:34.883 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:05:34.883 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:05:34.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:34.980 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:05:34.990 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-13T06:05:34.990 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:05:34.991 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:05:34.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:34.992 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-09-13T06:05:35.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:05:35.055 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T06:05:35.107 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:05:35.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:05:35.108 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:05:35.158 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:05:35.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:35.159 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:05:35.254 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:05:35.254 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:05:35.254 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:05:35.269 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:05:35.269 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:05:35.270 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:05:35.270 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:05:35.270 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:05:35.277 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:05:35.277 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:05:35.277 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:05:35.277 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:05:35.278 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:05:35.278 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:05:35.278 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:05:35.278 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:05:35.280 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:05:35.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:35.281 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:05:35.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:35.303 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:05:35.353 INFO:teuthology.orchestra.run.smithi164.stdout:client5750 2023-09-13T06:05:35.354 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:05:35.354 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:35.403 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:05:35.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.545+0000 7f2146996640 1 Processor -- start 2023-09-13T06:05:35.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.545+0000 7f2146996640 1 -- start start 2023-09-13T06:05:35.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.545+0000 7f2146996640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2140159f20 0x7f21400ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:35.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.545+0000 7f2146996640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21400ccfd0 con 0x7f21400b1d20 2023-09-13T06:05:35.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.545+0000 7f2146996640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21400ced90 con 0x7f21400cdfc0 2023-09-13T06:05:35.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.545+0000 7f2146996640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21400b00f0 con 0x7f2140159f20 2023-09-13T06:05:35.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.545+0000 7f213ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2140159f20 0x7f21400ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:35.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.549+0000 7f213ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2140159f20 0x7f21400ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40582/0 (socket says 172.21.15.130:40582) 2023-09-13T06:05:35.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.549+0000 7f2144f33640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f21400b1d20 0x7f21400ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42952/0 (socket says 172.21.15.130:42952) 2023-09-13T06:05:35.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.549+0000 7f213ffff640 1 -- 172.21.15.130:0/1534704430 learned_addr learned my addr 172.21.15.130:0/1534704430 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:35.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.549+0000 7f213ffff640 1 -- 172.21.15.130:0/1534704430 >> v1:172.21.15.164:6789/0 conn(0x7f21400cdfc0 legacy=0x7f21400b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:35.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.549+0000 7f213ffff640 1 -- 172.21.15.130:0/1534704430 >> v1:172.21.15.130:6789/0 conn(0x7f21400b1d20 legacy=0x7f21400ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:35.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.549+0000 7f213ffff640 1 -- 172.21.15.130:0/1534704430 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21400cd200 con 0x7f2140159f20 2023-09-13T06:05:35.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.549+0000 7f213effd640 1 -- 172.21.15.130:0/1534704430 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043773205 0 0) 0x7f21400ccfd0 con 0x7f21400b1d20 2023-09-13T06:05:35.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.549+0000 7f213ffff640 1 --2- 172.21.15.130:0/1534704430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2140159f20 0x7f21400ce7b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2130009870 tx=0x7f213001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2380024cc460fc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:35.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.549+0000 7f213effd640 1 -- 172.21.15.130:0/1534704430 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21300a9400 con 0x7f2140159f20 2023-09-13T06:05:35.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.549+0000 7f213effd640 1 -- 172.21.15.130:0/1534704430 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21300a9560 con 0x7f2140159f20 2023-09-13T06:05:35.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.549+0000 7f213effd640 1 -- 172.21.15.130:0/1534704430 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21300a98f0 con 0x7f2140159f20 2023-09-13T06:05:35.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 -- 172.21.15.130:0/1534704430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2140159f20 msgr2=0x7f21400ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:35.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 --2- 172.21.15.130:0/1534704430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2140159f20 0x7f21400ce7b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2130009870 tx=0x7f213001c540 comp rx=0 tx=0).stop 2023-09-13T06:05:35.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 -- 172.21.15.130:0/1534704430 shutdown_connections 2023-09-13T06:05:35.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 --2- 172.21.15.130:0/1534704430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2140159f20 0x7f21400ce7b0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:35.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 -- 172.21.15.130:0/1534704430 >> 172.21.15.130:0/1534704430 conn(0x7f2140065990 msgr2=0x7f2140065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:35.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 -- 172.21.15.130:0/1534704430 shutdown_connections 2023-09-13T06:05:35.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 -- 172.21.15.130:0/1534704430 wait complete. 2023-09-13T06:05:35.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 Processor -- start 2023-09-13T06:05:35.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 -- start start 2023-09-13T06:05:35.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21400b1d20 0x7f2140137a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:35.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21400cdfc0 0x7f21401694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:35.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2140159f20 0x7f21400ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:35.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2140146710 con 0x7f21400b1d20 2023-09-13T06:05:35.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2140146390 con 0x7f2140159f20 2023-09-13T06:05:35.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2146996640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21401478f0 con 0x7f21400cdfc0 2023-09-13T06:05:35.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f213ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21400b1d20 0x7f2140137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:35.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f213ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21400b1d20 0x7f2140137a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40584/0 (socket says 172.21.15.130:40584) 2023-09-13T06:05:35.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f213ffff640 1 -- 172.21.15.130:0/2131670168 learned_addr learned my addr 172.21.15.130:0/2131670168 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:35.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2144f33640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2140159f20 0x7f21400ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:35.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f213f7fe640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21400cdfc0 0x7f21401694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:35.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f213ffff640 1 -- 172.21.15.130:0/2131670168 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21400cdfc0 msgr2=0x7f21401694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:35.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f213ffff640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21400cdfc0 0x7f21401694e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:35.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f213ffff640 1 -- 172.21.15.130:0/2131670168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2140159f20 msgr2=0x7f21400ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:35.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f213ffff640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2140159f20 0x7f21400ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:35.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f213ffff640 1 -- 172.21.15.130:0/2131670168 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21300094d0 con 0x7f21400b1d20 2023-09-13T06:05:35.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f2144f33640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2140159f20 0x7f21400ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:35.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.553+0000 7f213f7fe640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21400cdfc0 0x7f21401694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:35.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.557+0000 7f213ffff640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21400b1d20 0x7f2140137a70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f213001a170 tx=0x7f21300192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:35.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.557+0000 7f213cff9640 1 -- 172.21.15.130:0/2131670168 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21300b1800 con 0x7f21400b1d20 2023-09-13T06:05:35.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.557+0000 7f213cff9640 1 -- 172.21.15.130:0/2131670168 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21300b5070 con 0x7f21400b1d20 2023-09-13T06:05:35.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.557+0000 7f213cff9640 1 -- 172.21.15.130:0/2131670168 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21300b1ba0 con 0x7f21400b1d20 2023-09-13T06:05:35.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.557+0000 7f2146996640 1 -- 172.21.15.130:0/2131670168 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2140147bd0 con 0x7f21400b1d20 2023-09-13T06:05:35.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.557+0000 7f2146996640 1 -- 172.21.15.130:0/2131670168 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2140137fb0 con 0x7f21400b1d20 2023-09-13T06:05:35.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.557+0000 7f2146996640 1 -- 172.21.15.130:0/2131670168 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21401480f0 con 0x7f21400b1d20 2023-09-13T06:05:35.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.557+0000 7f213cff9640 1 -- 172.21.15.130:0/2131670168 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f21300b1d00 con 0x7f21400b1d20 2023-09-13T06:05:35.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.557+0000 7f213cff9640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f212c065b20 0x7f212c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:35.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.557+0000 7f213cff9640 1 -- 172.21.15.130:0/2131670168 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21300b7070 con 0x7f21400b1d20 2023-09-13T06:05:35.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.557+0000 7f213f7fe640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f212c065b20 0x7f212c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:35.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.561+0000 7f213f7fe640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f212c065b20 0x7f212c067fe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2140151830 tx=0x7f2134009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:35.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.561+0000 7f213cff9640 1 -- 172.21.15.130:0/2131670168 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f21300eb450 con 0x7f21400b1d20 2023-09-13T06:05:35.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.741+0000 7f2146996640 1 -- 172.21.15.130:0/2131670168 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21400618a0 con 0x7f21400b1d20 2023-09-13T06:05:35.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.741+0000 7f213cff9640 1 -- 172.21.15.130:0/2131670168 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f21300a6030 con 0x7f21400b1d20 2023-09-13T06:05:35.744 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:35.744 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2267621007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2267621007},{"type":"v1","addr":"172.21.15.164:6834","nonce":2267621007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5663,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/658594571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":658594571},{"type":"v1","addr":"172.21.15.164:6835","nonce":658594571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6474,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1441650800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1441650800},{"type":"v1","addr":"172.21.15.130:6836","nonce":1441650800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:05:26.837419+0000","modified":"2023-09-13T06:05:29.861380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6477},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6477":{"gid":6477,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/428674793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":428674793},{"type":"v1","addr":"172.21.15.130:6837","nonce":428674793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-09-13T06:05:35.745 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 43 2023-09-13T06:05:35.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 -- 172.21.15.130:0/2131670168 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f212c065b20 msgr2=0x7f212c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:35.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f212c065b20 0x7f212c067fe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2140151830 tx=0x7f2134009040 comp rx=0 tx=0).stop 2023-09-13T06:05:35.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 -- 172.21.15.130:0/2131670168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21400b1d20 msgr2=0x7f2140137a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:35.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21400b1d20 0x7f2140137a70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f213001a170 tx=0x7f21300192e0 comp rx=0 tx=0).stop 2023-09-13T06:05:35.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 -- 172.21.15.130:0/2131670168 shutdown_connections 2023-09-13T06:05:35.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f212c065b20 0x7f212c067fe0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:35.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2140159f20 0x7f21400ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:35.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21400cdfc0 0x7f21401694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:35.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 --2- 172.21.15.130:0/2131670168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21400b1d20 0x7f2140137a70 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:35.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 -- 172.21.15.130:0/2131670168 >> 172.21.15.130:0/2131670168 conn(0x7f2140065990 msgr2=0x7f21400b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:35.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 -- 172.21.15.130:0/2131670168 shutdown_connections 2023-09-13T06:05:35.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:35.745+0000 7f2146996640 1 -- 172.21.15.130:0/2131670168 wait complete. 2023-09-13T06:05:35.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-09-13T06:05:35.922 INFO:teuthology.orchestra.run.smithi130.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":6477,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4428336149999996,"mdsmap_epoch":43,"osdmap_epoch":83,"osdmap_epoch_barrier":83,"uptime":13.213292121} 2023-09-13T06:05:35.923 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 6477, "mdsmap_epoch": 43, "osdmap_epoch": 83, "osdmap_epoch_barrier": 83, "rank_uptime": 8.442833615, "state": "up:active", "uptime": 13.213292121, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:05:35.923 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-13T06:05:36.080 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_mon_report_interval":"5"} 2023-09-13T06:05:36.080 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-13T06:05:36.081 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-09-13T06:05:36.229 INFO:teuthology.orchestra.run.smithi130.stdout:{"mon_tick_interval":"5"} 2023-09-13T06:05:36.230 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-09-13T06:05:36.230 INFO:tasks.cephfs.test_full:pool capacity 557082176, 531MB should be enough to fill it 2023-09-13T06:05:36.230 DEBUG:teuthology.orchestra.run.smithi130:> stdin-killer -- python3 -c ' 2023-09-13T06:05:36.231 DEBUG:teuthology.orchestra.run.smithi130:> import time 2023-09-13T06:05:36.231 DEBUG:teuthology.orchestra.run.smithi130:> import datetime 2023-09-13T06:05:36.232 DEBUG:teuthology.orchestra.run.smithi130:> import subprocess 2023-09-13T06:05:36.232 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-09-13T06:05:36.232 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:05:36.232 DEBUG:teuthology.orchestra.run.smithi130:> # Write some buffered data through before going full, all should be well 2023-09-13T06:05:36.233 DEBUG:teuthology.orchestra.run.smithi130:> print("writing some data through which we expect to succeed") 2023-09-13T06:05:36.233 DEBUG:teuthology.orchestra.run.smithi130:> bytes = 0 2023-09-13T06:05:36.233 DEBUG:teuthology.orchestra.run.smithi130:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-09-13T06:05:36.234 DEBUG:teuthology.orchestra.run.smithi130:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-09-13T06:05:36.234 DEBUG:teuthology.orchestra.run.smithi130:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-09-13T06:05:36.235 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(f) 2023-09-13T06:05:36.235 DEBUG:teuthology.orchestra.run.smithi130:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-09-13T06:05:36.235 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:05:36.235 DEBUG:teuthology.orchestra.run.smithi130:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-09-13T06:05:36.236 DEBUG:teuthology.orchestra.run.smithi130:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-09-13T06:05:36.236 DEBUG:teuthology.orchestra.run.smithi130:> # buffered IO, the error should always only appear from fsync and not 2023-09-13T06:05:36.236 DEBUG:teuthology.orchestra.run.smithi130:> # from write 2023-09-13T06:05:36.237 DEBUG:teuthology.orchestra.run.smithi130:> full = False 2023-09-13T06:05:36.237 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:05:36.237 DEBUG:teuthology.orchestra.run.smithi130:> for n in range(0, int(531 * 1.1)): 2023-09-13T06:05:36.238 DEBUG:teuthology.orchestra.run.smithi130:> try: 2023-09-13T06:05:36.238 DEBUG:teuthology.orchestra.run.smithi130:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-13T06:05:36.238 DEBUG:teuthology.orchestra.run.smithi130:> print("wrote bytes via buffered write, moving on to fsync") 2023-09-13T06:05:36.239 DEBUG:teuthology.orchestra.run.smithi130:> except OSError as e: 2023-09-13T06:05:36.239 DEBUG:teuthology.orchestra.run.smithi130:> if False: 2023-09-13T06:05:36.239 DEBUG:teuthology.orchestra.run.smithi130:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-09-13T06:05:36.240 DEBUG:teuthology.orchestra.run.smithi130:> raise 2023-09-13T06:05:36.240 DEBUG:teuthology.orchestra.run.smithi130:> else: 2023-09-13T06:05:36.240 DEBUG:teuthology.orchestra.run.smithi130:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-13T06:05:36.241 DEBUG:teuthology.orchestra.run.smithi130:> full = True 2023-09-13T06:05:36.241 DEBUG:teuthology.orchestra.run.smithi130:> break 2023-09-13T06:05:36.241 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:05:36.242 DEBUG:teuthology.orchestra.run.smithi130:> try: 2023-09-13T06:05:36.242 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(f) 2023-09-13T06:05:36.242 DEBUG:teuthology.orchestra.run.smithi130:> print("fsync'"'"'ed successfully") 2023-09-13T06:05:36.243 DEBUG:teuthology.orchestra.run.smithi130:> except OSError as e: 2023-09-13T06:05:36.243 DEBUG:teuthology.orchestra.run.smithi130:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-13T06:05:36.243 DEBUG:teuthology.orchestra.run.smithi130:> full = True 2023-09-13T06:05:36.244 DEBUG:teuthology.orchestra.run.smithi130:> break 2023-09-13T06:05:36.244 DEBUG:teuthology.orchestra.run.smithi130:> else: 2023-09-13T06:05:36.244 DEBUG:teuthology.orchestra.run.smithi130:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-13T06:05:36.245 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:05:36.245 DEBUG:teuthology.orchestra.run.smithi130:> if n > 531 * 0.9: 2023-09-13T06:05:36.245 DEBUG:teuthology.orchestra.run.smithi130:> # Be cautious in the last region where we expect to hit 2023-09-13T06:05:36.246 DEBUG:teuthology.orchestra.run.smithi130:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-09-13T06:05:36.246 DEBUG:teuthology.orchestra.run.smithi130:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-09-13T06:05:36.246 DEBUG:teuthology.orchestra.run.smithi130:> time.sleep(15.0) 2023-09-13T06:05:36.247 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:05:36.247 DEBUG:teuthology.orchestra.run.smithi130:> if not full: 2023-09-13T06:05:36.247 DEBUG:teuthology.orchestra.run.smithi130:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-09-13T06:05:36.248 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:05:36.248 DEBUG:teuthology.orchestra.run.smithi130:> # close() should not raise an error because we already caught it in 2023-09-13T06:05:36.248 DEBUG:teuthology.orchestra.run.smithi130:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-09-13T06:05:36.249 DEBUG:teuthology.orchestra.run.smithi130:> # since then because all IOs got cancelled on the full flag. 2023-09-13T06:05:36.249 DEBUG:teuthology.orchestra.run.smithi130:> print("calling close") 2023-09-13T06:05:36.249 DEBUG:teuthology.orchestra.run.smithi130:> os.close(f) 2023-09-13T06:05:36.250 DEBUG:teuthology.orchestra.run.smithi130:> print("close() did not raise error") 2023-09-13T06:05:36.250 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:05:36.250 DEBUG:teuthology.orchestra.run.smithi130:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-09-13T06:05:36.251 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-09-13T06:05:38.464 INFO:teuthology.orchestra.run.smithi130.stdout:writing some data through which we expect to succeed 2023-09-13T06:05:38.465 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-09-13T06:05:38.465 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.465 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.466 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 1.00 MB 2023-09-13T06:05:38.466 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.466 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.466 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 2.00 MB 2023-09-13T06:05:38.466 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.467 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.467 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 3.00 MB 2023-09-13T06:05:38.467 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.467 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.467 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 4.00 MB 2023-09-13T06:05:38.468 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.468 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.468 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 5.00 MB 2023-09-13T06:05:38.468 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.468 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.469 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 6.00 MB 2023-09-13T06:05:38.469 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.469 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.469 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 7.00 MB 2023-09-13T06:05:38.469 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.469 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.470 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 8.00 MB 2023-09-13T06:05:38.470 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.470 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.470 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 9.00 MB 2023-09-13T06:05:38.470 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.471 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.471 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 10.00 MB 2023-09-13T06:05:38.471 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.471 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.472 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 11.00 MB 2023-09-13T06:05:38.472 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.472 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.472 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 12.00 MB 2023-09-13T06:05:38.472 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.472 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.473 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 13.00 MB 2023-09-13T06:05:38.473 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.473 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.473 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 14.00 MB 2023-09-13T06:05:38.473 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.474 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.474 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 15.00 MB 2023-09-13T06:05:38.474 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.474 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.474 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 16.00 MB 2023-09-13T06:05:38.475 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.475 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.475 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 17.00 MB 2023-09-13T06:05:38.475 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.476 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.476 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 18.00 MB 2023-09-13T06:05:38.476 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.476 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.476 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 19.00 MB 2023-09-13T06:05:38.477 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.477 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.477 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 20.00 MB 2023-09-13T06:05:38.477 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.477 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.477 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 21.00 MB 2023-09-13T06:05:38.478 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.478 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.478 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 22.00 MB 2023-09-13T06:05:38.478 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.479 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.479 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 23.00 MB 2023-09-13T06:05:38.479 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.479 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.479 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 24.00 MB 2023-09-13T06:05:38.480 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.480 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.480 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 25.00 MB 2023-09-13T06:05:38.480 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.480 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.481 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 26.00 MB 2023-09-13T06:05:38.481 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.481 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.481 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 27.00 MB 2023-09-13T06:05:38.481 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.482 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.482 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 28.00 MB 2023-09-13T06:05:38.482 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.482 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.482 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 29.00 MB 2023-09-13T06:05:38.483 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.483 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.483 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 30.00 MB 2023-09-13T06:05:38.483 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.483 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.483 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 31.00 MB 2023-09-13T06:05:38.484 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.484 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.484 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 32.00 MB 2023-09-13T06:05:38.484 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.484 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.485 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 33.00 MB 2023-09-13T06:05:38.485 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.485 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.485 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 34.00 MB 2023-09-13T06:05:38.485 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.485 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.486 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 35.00 MB 2023-09-13T06:05:38.486 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.486 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.486 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 36.00 MB 2023-09-13T06:05:38.486 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.487 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.487 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 37.00 MB 2023-09-13T06:05:38.487 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.487 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.487 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 38.00 MB 2023-09-13T06:05:38.488 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.488 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.488 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 39.00 MB 2023-09-13T06:05:38.488 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.488 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.489 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 40.00 MB 2023-09-13T06:05:38.489 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.489 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.489 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 41.00 MB 2023-09-13T06:05:38.489 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.489 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.490 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 42.00 MB 2023-09-13T06:05:38.490 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.490 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.490 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 43.00 MB 2023-09-13T06:05:38.490 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.491 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.491 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 44.00 MB 2023-09-13T06:05:38.491 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.491 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.491 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 45.00 MB 2023-09-13T06:05:38.492 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.492 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.492 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 46.00 MB 2023-09-13T06:05:38.492 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.492 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.493 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 47.00 MB 2023-09-13T06:05:38.493 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.493 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.493 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 48.00 MB 2023-09-13T06:05:38.493 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.494 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.494 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 49.00 MB 2023-09-13T06:05:38.494 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.494 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.494 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 50.00 MB 2023-09-13T06:05:38.495 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.495 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.495 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 51.00 MB 2023-09-13T06:05:38.495 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.495 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.495 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 52.00 MB 2023-09-13T06:05:38.496 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.496 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.496 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 53.00 MB 2023-09-13T06:05:38.496 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.496 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.497 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 54.00 MB 2023-09-13T06:05:38.497 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.497 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.497 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 55.00 MB 2023-09-13T06:05:38.497 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.498 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.498 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 56.00 MB 2023-09-13T06:05:38.498 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.498 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.498 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 57.00 MB 2023-09-13T06:05:38.499 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.499 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.499 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 58.00 MB 2023-09-13T06:05:38.499 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.499 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.499 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 59.00 MB 2023-09-13T06:05:38.500 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.500 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.500 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 60.00 MB 2023-09-13T06:05:38.500 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.500 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.501 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 61.00 MB 2023-09-13T06:05:38.501 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.501 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.501 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 62.00 MB 2023-09-13T06:05:38.501 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.502 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.502 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 63.00 MB 2023-09-13T06:05:38.502 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.502 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.502 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 64.00 MB 2023-09-13T06:05:38.503 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.503 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.503 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 65.00 MB 2023-09-13T06:05:38.503 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.503 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.504 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 66.00 MB 2023-09-13T06:05:38.504 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.504 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.504 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 67.00 MB 2023-09-13T06:05:38.504 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.505 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.505 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 68.00 MB 2023-09-13T06:05:38.505 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.505 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.505 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 69.00 MB 2023-09-13T06:05:38.506 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.506 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.506 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 70.00 MB 2023-09-13T06:05:38.506 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.506 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.507 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 71.00 MB 2023-09-13T06:05:38.507 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.507 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.507 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 72.00 MB 2023-09-13T06:05:38.507 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.508 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.508 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 73.00 MB 2023-09-13T06:05:38.508 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.508 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.508 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 74.00 MB 2023-09-13T06:05:38.508 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.509 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.509 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 75.00 MB 2023-09-13T06:05:38.509 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.509 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.509 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 76.00 MB 2023-09-13T06:05:38.510 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.510 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.510 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 77.00 MB 2023-09-13T06:05:38.510 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.510 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.511 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 78.00 MB 2023-09-13T06:05:38.511 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.511 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.511 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 79.00 MB 2023-09-13T06:05:38.511 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:38.511 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:38.512 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 80.00 MB 2023-09-13T06:05:39.198 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.199 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.199 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 81.00 MB 2023-09-13T06:05:39.199 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.199 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.199 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 82.00 MB 2023-09-13T06:05:39.200 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.200 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.200 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 83.00 MB 2023-09-13T06:05:39.200 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.200 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.201 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 84.00 MB 2023-09-13T06:05:39.201 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.201 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.201 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 85.00 MB 2023-09-13T06:05:39.201 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.202 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.202 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 86.00 MB 2023-09-13T06:05:39.202 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.202 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.202 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 87.00 MB 2023-09-13T06:05:39.202 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.203 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.203 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 88.00 MB 2023-09-13T06:05:39.203 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.203 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.203 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 89.00 MB 2023-09-13T06:05:39.204 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.204 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.204 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 90.00 MB 2023-09-13T06:05:39.204 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.204 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.204 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 91.00 MB 2023-09-13T06:05:39.205 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.205 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.205 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 92.00 MB 2023-09-13T06:05:39.205 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.205 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.205 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 93.00 MB 2023-09-13T06:05:39.206 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.206 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.206 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 94.00 MB 2023-09-13T06:05:39.206 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.206 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.207 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 95.00 MB 2023-09-13T06:05:39.207 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.207 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.207 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 96.00 MB 2023-09-13T06:05:39.207 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.208 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.208 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 97.00 MB 2023-09-13T06:05:39.208 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.208 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.208 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 98.00 MB 2023-09-13T06:05:39.208 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.209 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.209 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 99.00 MB 2023-09-13T06:05:39.209 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.209 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.209 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 100.00 MB 2023-09-13T06:05:39.210 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.210 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.210 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 101.00 MB 2023-09-13T06:05:39.210 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.210 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.211 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 102.00 MB 2023-09-13T06:05:39.211 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.211 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.211 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 103.00 MB 2023-09-13T06:05:39.211 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.212 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.212 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 104.00 MB 2023-09-13T06:05:39.212 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.212 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.212 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 105.00 MB 2023-09-13T06:05:39.213 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.213 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.213 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 106.00 MB 2023-09-13T06:05:39.213 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.213 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.213 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 107.00 MB 2023-09-13T06:05:39.214 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.214 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.214 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 108.00 MB 2023-09-13T06:05:39.214 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.214 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.215 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 109.00 MB 2023-09-13T06:05:39.215 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.215 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.215 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 110.00 MB 2023-09-13T06:05:39.215 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.216 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.216 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 111.00 MB 2023-09-13T06:05:39.216 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.217 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.217 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 112.00 MB 2023-09-13T06:05:39.217 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.217 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.217 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 113.00 MB 2023-09-13T06:05:39.218 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.218 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.218 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 114.00 MB 2023-09-13T06:05:39.218 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.219 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.219 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 115.00 MB 2023-09-13T06:05:39.219 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.219 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.219 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 116.00 MB 2023-09-13T06:05:39.220 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.220 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.220 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 117.00 MB 2023-09-13T06:05:39.220 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.220 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.221 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 118.00 MB 2023-09-13T06:05:39.221 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.221 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.221 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 119.00 MB 2023-09-13T06:05:39.221 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.222 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.222 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 120.00 MB 2023-09-13T06:05:39.222 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.222 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.222 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 121.00 MB 2023-09-13T06:05:39.223 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.223 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.223 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 122.00 MB 2023-09-13T06:05:39.223 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.223 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.223 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 123.00 MB 2023-09-13T06:05:39.224 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.224 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.224 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 124.00 MB 2023-09-13T06:05:39.224 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.224 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.225 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 125.00 MB 2023-09-13T06:05:39.225 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.225 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.225 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 126.00 MB 2023-09-13T06:05:39.225 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.226 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.226 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 127.00 MB 2023-09-13T06:05:39.226 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.226 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.226 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 128.00 MB 2023-09-13T06:05:39.227 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.227 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.227 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 129.00 MB 2023-09-13T06:05:39.227 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.227 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.228 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 130.00 MB 2023-09-13T06:05:39.228 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.228 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.228 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 131.00 MB 2023-09-13T06:05:39.228 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.229 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.229 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 132.00 MB 2023-09-13T06:05:39.229 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.229 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.229 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 133.00 MB 2023-09-13T06:05:39.230 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.230 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.230 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 134.00 MB 2023-09-13T06:05:39.230 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.230 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.230 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 135.00 MB 2023-09-13T06:05:39.231 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.231 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.231 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 136.00 MB 2023-09-13T06:05:39.231 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.231 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.232 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 137.00 MB 2023-09-13T06:05:39.232 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.232 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.232 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 138.00 MB 2023-09-13T06:05:39.232 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.233 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.233 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 139.00 MB 2023-09-13T06:05:39.233 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.233 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.233 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 140.00 MB 2023-09-13T06:05:39.233 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.234 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.234 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 141.00 MB 2023-09-13T06:05:39.234 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.234 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.234 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 142.00 MB 2023-09-13T06:05:39.235 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.235 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.235 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 143.00 MB 2023-09-13T06:05:39.235 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.235 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.236 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 144.00 MB 2023-09-13T06:05:39.236 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.236 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.236 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 145.00 MB 2023-09-13T06:05:39.236 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.237 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.237 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 146.00 MB 2023-09-13T06:05:39.237 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.237 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.237 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 147.00 MB 2023-09-13T06:05:39.238 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.238 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.238 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 148.00 MB 2023-09-13T06:05:39.238 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.238 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.239 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 149.00 MB 2023-09-13T06:05:39.239 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.239 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.239 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 150.00 MB 2023-09-13T06:05:39.239 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.240 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.240 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 151.00 MB 2023-09-13T06:05:39.240 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.240 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.240 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 152.00 MB 2023-09-13T06:05:39.241 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.241 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.241 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 153.00 MB 2023-09-13T06:05:39.241 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.241 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.241 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 154.00 MB 2023-09-13T06:05:39.242 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.242 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.242 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 155.00 MB 2023-09-13T06:05:39.242 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.242 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.243 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 156.00 MB 2023-09-13T06:05:39.243 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.243 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.243 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 157.00 MB 2023-09-13T06:05:39.243 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.244 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.244 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 158.00 MB 2023-09-13T06:05:39.244 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.244 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.244 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 159.00 MB 2023-09-13T06:05:39.245 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.245 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.245 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 160.00 MB 2023-09-13T06:05:39.245 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.924 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.924 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 161.00 MB 2023-09-13T06:05:39.925 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.925 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.925 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 162.00 MB 2023-09-13T06:05:39.925 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.925 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.926 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 163.00 MB 2023-09-13T06:05:39.926 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.926 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.926 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 164.00 MB 2023-09-13T06:05:39.926 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.927 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.927 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 165.00 MB 2023-09-13T06:05:39.927 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.927 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.927 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 166.00 MB 2023-09-13T06:05:39.928 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.928 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.928 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 167.00 MB 2023-09-13T06:05:39.928 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.928 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.928 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 168.00 MB 2023-09-13T06:05:39.929 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.929 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.929 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 169.00 MB 2023-09-13T06:05:39.929 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.929 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.930 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 170.00 MB 2023-09-13T06:05:39.930 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.930 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.930 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 171.00 MB 2023-09-13T06:05:39.930 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.931 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.931 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 172.00 MB 2023-09-13T06:05:39.931 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.931 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.931 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 173.00 MB 2023-09-13T06:05:39.931 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.932 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.932 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 174.00 MB 2023-09-13T06:05:39.932 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.932 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.932 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 175.00 MB 2023-09-13T06:05:39.933 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.933 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.933 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 176.00 MB 2023-09-13T06:05:39.933 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.933 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.933 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 177.00 MB 2023-09-13T06:05:39.934 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.934 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.934 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 178.00 MB 2023-09-13T06:05:39.934 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.934 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.935 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 179.00 MB 2023-09-13T06:05:39.935 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.935 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.935 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 180.00 MB 2023-09-13T06:05:39.935 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.936 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.936 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 181.00 MB 2023-09-13T06:05:39.936 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.936 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.936 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 182.00 MB 2023-09-13T06:05:39.937 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.937 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.937 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 183.00 MB 2023-09-13T06:05:39.937 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.937 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.937 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 184.00 MB 2023-09-13T06:05:39.938 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.938 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.938 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 185.00 MB 2023-09-13T06:05:39.938 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.938 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.939 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 186.00 MB 2023-09-13T06:05:39.939 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.939 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.939 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 187.00 MB 2023-09-13T06:05:39.939 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.939 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.940 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 188.00 MB 2023-09-13T06:05:39.940 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.940 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.940 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 189.00 MB 2023-09-13T06:05:39.940 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.941 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.941 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 190.00 MB 2023-09-13T06:05:39.941 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.941 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.941 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 191.00 MB 2023-09-13T06:05:39.941 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.942 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.942 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 192.00 MB 2023-09-13T06:05:39.942 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.942 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.942 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 193.00 MB 2023-09-13T06:05:39.943 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.943 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.943 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 194.00 MB 2023-09-13T06:05:39.943 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.943 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.944 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 195.00 MB 2023-09-13T06:05:39.944 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.944 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.944 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 196.00 MB 2023-09-13T06:05:39.944 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.944 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.945 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 197.00 MB 2023-09-13T06:05:39.945 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.945 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.945 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 198.00 MB 2023-09-13T06:05:39.945 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.946 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.946 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 199.00 MB 2023-09-13T06:05:39.946 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.946 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.946 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 200.00 MB 2023-09-13T06:05:39.947 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.947 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.947 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 201.00 MB 2023-09-13T06:05:39.947 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.947 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.948 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 202.00 MB 2023-09-13T06:05:39.948 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.948 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.948 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 203.00 MB 2023-09-13T06:05:39.948 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.948 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.949 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 204.00 MB 2023-09-13T06:05:39.949 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.949 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.949 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 205.00 MB 2023-09-13T06:05:39.949 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.950 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.950 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 206.00 MB 2023-09-13T06:05:39.950 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.950 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.950 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 207.00 MB 2023-09-13T06:05:39.951 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.951 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.951 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 208.00 MB 2023-09-13T06:05:39.951 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.951 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.952 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 209.00 MB 2023-09-13T06:05:39.952 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.952 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.952 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 210.00 MB 2023-09-13T06:05:39.952 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.952 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.953 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 211.00 MB 2023-09-13T06:05:39.953 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.953 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.953 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 212.00 MB 2023-09-13T06:05:39.953 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.954 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.954 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 213.00 MB 2023-09-13T06:05:39.954 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.954 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.954 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 214.00 MB 2023-09-13T06:05:39.955 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.955 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.955 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 215.00 MB 2023-09-13T06:05:39.955 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.955 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.955 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 216.00 MB 2023-09-13T06:05:39.956 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.956 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.956 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 217.00 MB 2023-09-13T06:05:39.956 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.956 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.957 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 218.00 MB 2023-09-13T06:05:39.957 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.957 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.957 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 219.00 MB 2023-09-13T06:05:39.957 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.957 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.958 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 220.00 MB 2023-09-13T06:05:39.958 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.958 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.958 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 221.00 MB 2023-09-13T06:05:39.958 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.959 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.959 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 222.00 MB 2023-09-13T06:05:39.959 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.959 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.959 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 223.00 MB 2023-09-13T06:05:39.960 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.960 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.960 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 224.00 MB 2023-09-13T06:05:39.960 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.960 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.960 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 225.00 MB 2023-09-13T06:05:39.961 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.961 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.961 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 226.00 MB 2023-09-13T06:05:39.961 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.961 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.962 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 227.00 MB 2023-09-13T06:05:39.962 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.962 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.962 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 228.00 MB 2023-09-13T06:05:39.962 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.963 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.963 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 229.00 MB 2023-09-13T06:05:39.963 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.963 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.963 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 230.00 MB 2023-09-13T06:05:39.963 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.964 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.964 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 231.00 MB 2023-09-13T06:05:39.964 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.964 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.964 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 232.00 MB 2023-09-13T06:05:39.965 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.965 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.965 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 233.00 MB 2023-09-13T06:05:39.965 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.965 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.965 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 234.00 MB 2023-09-13T06:05:39.966 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.966 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.966 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 235.00 MB 2023-09-13T06:05:39.966 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.966 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.967 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 236.00 MB 2023-09-13T06:05:39.967 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.967 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.967 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 237.00 MB 2023-09-13T06:05:39.967 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.967 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.968 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 238.00 MB 2023-09-13T06:05:39.968 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.968 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.968 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 239.00 MB 2023-09-13T06:05:39.968 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.969 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:39.969 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 240.00 MB 2023-09-13T06:05:39.969 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:39.969 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.700 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 241.00 MB 2023-09-13T06:05:40.701 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.701 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.701 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 242.00 MB 2023-09-13T06:05:40.701 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.701 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.701 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 243.00 MB 2023-09-13T06:05:40.702 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.702 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.702 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 244.00 MB 2023-09-13T06:05:40.702 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.702 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.703 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 245.00 MB 2023-09-13T06:05:40.703 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.703 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.703 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 246.00 MB 2023-09-13T06:05:40.703 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.704 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.704 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 247.00 MB 2023-09-13T06:05:40.704 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.704 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.704 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 248.00 MB 2023-09-13T06:05:40.705 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.705 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.705 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 249.00 MB 2023-09-13T06:05:40.705 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.705 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.706 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 250.00 MB 2023-09-13T06:05:40.706 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.706 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.706 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 251.00 MB 2023-09-13T06:05:40.706 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.707 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.707 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 252.00 MB 2023-09-13T06:05:40.707 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.707 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.708 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 253.00 MB 2023-09-13T06:05:40.708 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.708 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.708 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 254.00 MB 2023-09-13T06:05:40.708 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.708 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.709 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 255.00 MB 2023-09-13T06:05:40.709 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.709 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.709 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 256.00 MB 2023-09-13T06:05:40.710 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.710 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.710 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 257.00 MB 2023-09-13T06:05:40.710 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.710 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.710 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 258.00 MB 2023-09-13T06:05:40.711 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.711 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.711 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 259.00 MB 2023-09-13T06:05:40.711 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.711 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.712 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 260.00 MB 2023-09-13T06:05:40.712 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.712 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.712 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 261.00 MB 2023-09-13T06:05:40.712 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.712 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.713 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 262.00 MB 2023-09-13T06:05:40.713 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.713 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.713 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 263.00 MB 2023-09-13T06:05:40.713 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.714 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.714 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 264.00 MB 2023-09-13T06:05:40.714 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.714 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.714 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 265.00 MB 2023-09-13T06:05:40.715 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.715 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.715 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 266.00 MB 2023-09-13T06:05:40.715 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.715 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.715 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 267.00 MB 2023-09-13T06:05:40.716 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.716 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.716 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 268.00 MB 2023-09-13T06:05:40.716 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.716 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.716 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 269.00 MB 2023-09-13T06:05:40.717 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.717 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.717 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 270.00 MB 2023-09-13T06:05:40.717 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.717 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.718 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 271.00 MB 2023-09-13T06:05:40.718 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.718 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.718 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 272.00 MB 2023-09-13T06:05:40.718 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.719 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.719 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 273.00 MB 2023-09-13T06:05:40.719 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.719 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.719 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 274.00 MB 2023-09-13T06:05:40.719 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.720 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.720 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 275.00 MB 2023-09-13T06:05:40.720 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.720 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.720 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 276.00 MB 2023-09-13T06:05:40.720 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.721 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.721 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 277.00 MB 2023-09-13T06:05:40.721 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.721 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.721 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 278.00 MB 2023-09-13T06:05:40.721 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.722 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.722 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 279.00 MB 2023-09-13T06:05:40.722 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.722 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.722 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 280.00 MB 2023-09-13T06:05:40.723 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.723 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.723 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 281.00 MB 2023-09-13T06:05:40.723 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.723 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.723 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 282.00 MB 2023-09-13T06:05:40.724 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.724 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.724 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 283.00 MB 2023-09-13T06:05:40.724 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.724 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.725 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 284.00 MB 2023-09-13T06:05:40.725 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.725 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.725 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 285.00 MB 2023-09-13T06:05:40.725 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.725 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.726 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 286.00 MB 2023-09-13T06:05:40.726 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.726 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.726 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 287.00 MB 2023-09-13T06:05:40.726 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.726 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.727 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 288.00 MB 2023-09-13T06:05:40.727 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.727 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.727 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 289.00 MB 2023-09-13T06:05:40.727 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.728 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.728 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 290.00 MB 2023-09-13T06:05:40.728 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.728 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.728 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 291.00 MB 2023-09-13T06:05:40.729 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.729 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.729 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 292.00 MB 2023-09-13T06:05:40.729 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.729 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.729 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 293.00 MB 2023-09-13T06:05:40.730 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.730 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.730 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 294.00 MB 2023-09-13T06:05:40.730 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.730 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.730 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 295.00 MB 2023-09-13T06:05:40.731 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.731 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.731 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 296.00 MB 2023-09-13T06:05:40.731 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.731 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.732 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 297.00 MB 2023-09-13T06:05:40.732 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.732 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.732 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 298.00 MB 2023-09-13T06:05:40.732 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.733 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.733 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 299.00 MB 2023-09-13T06:05:40.733 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.733 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.733 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 300.00 MB 2023-09-13T06:05:40.733 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.734 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.734 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 301.00 MB 2023-09-13T06:05:40.734 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.734 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.734 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 302.00 MB 2023-09-13T06:05:40.735 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.735 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.735 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 303.00 MB 2023-09-13T06:05:40.735 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.735 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.735 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 304.00 MB 2023-09-13T06:05:40.736 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.736 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.736 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 305.00 MB 2023-09-13T06:05:40.736 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.736 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.736 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 306.00 MB 2023-09-13T06:05:40.737 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.737 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.737 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 307.00 MB 2023-09-13T06:05:40.737 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.737 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.738 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 308.00 MB 2023-09-13T06:05:40.738 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.738 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.738 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 309.00 MB 2023-09-13T06:05:40.738 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.739 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.739 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 310.00 MB 2023-09-13T06:05:40.739 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.739 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.739 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 311.00 MB 2023-09-13T06:05:40.739 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.740 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.740 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 312.00 MB 2023-09-13T06:05:40.740 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.740 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.740 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 313.00 MB 2023-09-13T06:05:40.740 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.741 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.741 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 314.00 MB 2023-09-13T06:05:40.741 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.741 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.741 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 315.00 MB 2023-09-13T06:05:40.741 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.742 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.742 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 316.00 MB 2023-09-13T06:05:40.742 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.742 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.742 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 317.00 MB 2023-09-13T06:05:40.742 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.743 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.743 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 318.00 MB 2023-09-13T06:05:40.743 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.743 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.743 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 319.00 MB 2023-09-13T06:05:40.743 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.744 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.744 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 320.00 MB 2023-09-13T06:05:40.744 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:40.744 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:40.744 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 321.00 MB 2023-09-13T06:05:41.503 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.504 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.504 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 322.00 MB 2023-09-13T06:05:41.504 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.504 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.504 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 323.00 MB 2023-09-13T06:05:41.505 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.505 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.505 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 324.00 MB 2023-09-13T06:05:41.505 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.505 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.506 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 325.00 MB 2023-09-13T06:05:41.506 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.506 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.506 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 326.00 MB 2023-09-13T06:05:41.506 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.507 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.507 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 327.00 MB 2023-09-13T06:05:41.507 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.507 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.507 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 328.00 MB 2023-09-13T06:05:41.508 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.508 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.508 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 329.00 MB 2023-09-13T06:05:41.508 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.508 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.509 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 330.00 MB 2023-09-13T06:05:41.509 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.509 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.509 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 331.00 MB 2023-09-13T06:05:41.509 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.509 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.510 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 332.00 MB 2023-09-13T06:05:41.510 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.510 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.510 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 333.00 MB 2023-09-13T06:05:41.510 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.511 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.511 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 334.00 MB 2023-09-13T06:05:41.511 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.511 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.511 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 335.00 MB 2023-09-13T06:05:41.512 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.512 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.512 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 336.00 MB 2023-09-13T06:05:41.512 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.512 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.513 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 337.00 MB 2023-09-13T06:05:41.513 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.513 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.513 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 338.00 MB 2023-09-13T06:05:41.513 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.514 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.514 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 339.00 MB 2023-09-13T06:05:41.514 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.514 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.514 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 340.00 MB 2023-09-13T06:05:41.514 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.515 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.515 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 341.00 MB 2023-09-13T06:05:41.515 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.515 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.515 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 342.00 MB 2023-09-13T06:05:41.516 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.516 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.516 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 343.00 MB 2023-09-13T06:05:41.516 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.516 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.517 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 344.00 MB 2023-09-13T06:05:41.517 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.517 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.517 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 345.00 MB 2023-09-13T06:05:41.518 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.518 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.518 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 346.00 MB 2023-09-13T06:05:41.518 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.518 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.519 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 347.00 MB 2023-09-13T06:05:41.519 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.519 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.519 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 348.00 MB 2023-09-13T06:05:41.520 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.520 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.520 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 349.00 MB 2023-09-13T06:05:41.520 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.520 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.521 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 350.00 MB 2023-09-13T06:05:41.521 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.521 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.521 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 351.00 MB 2023-09-13T06:05:41.521 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.522 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.522 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 352.00 MB 2023-09-13T06:05:41.522 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.523 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.523 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 353.00 MB 2023-09-13T06:05:41.523 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.523 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.524 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 354.00 MB 2023-09-13T06:05:41.524 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.524 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.524 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 355.00 MB 2023-09-13T06:05:41.525 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.525 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.525 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 356.00 MB 2023-09-13T06:05:41.525 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.525 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.526 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 357.00 MB 2023-09-13T06:05:41.526 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.526 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.527 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 358.00 MB 2023-09-13T06:05:41.527 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.527 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.527 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 359.00 MB 2023-09-13T06:05:41.528 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.528 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.528 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 360.00 MB 2023-09-13T06:05:41.528 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.529 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.529 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 361.00 MB 2023-09-13T06:05:41.529 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.529 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.530 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 362.00 MB 2023-09-13T06:05:41.530 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.530 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.530 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 363.00 MB 2023-09-13T06:05:41.531 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.531 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.531 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 364.00 MB 2023-09-13T06:05:41.531 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.532 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.532 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 365.00 MB 2023-09-13T06:05:41.532 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.533 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.533 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 366.00 MB 2023-09-13T06:05:41.533 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.533 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.533 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 367.00 MB 2023-09-13T06:05:41.534 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.534 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.534 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 368.00 MB 2023-09-13T06:05:41.534 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.534 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.535 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 369.00 MB 2023-09-13T06:05:41.535 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.535 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.535 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 370.00 MB 2023-09-13T06:05:41.535 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.535 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.536 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 371.00 MB 2023-09-13T06:05:41.536 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.536 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.536 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 372.00 MB 2023-09-13T06:05:41.536 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.537 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.537 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 373.00 MB 2023-09-13T06:05:41.537 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.537 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.537 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 374.00 MB 2023-09-13T06:05:41.538 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.538 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.538 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 375.00 MB 2023-09-13T06:05:41.538 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.538 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.539 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 376.00 MB 2023-09-13T06:05:41.539 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.539 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.539 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 377.00 MB 2023-09-13T06:05:41.539 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.539 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.540 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 378.00 MB 2023-09-13T06:05:41.540 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.540 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.540 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 379.00 MB 2023-09-13T06:05:41.540 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.541 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.541 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 380.00 MB 2023-09-13T06:05:41.541 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.541 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.541 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 381.00 MB 2023-09-13T06:05:41.542 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.542 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.542 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 382.00 MB 2023-09-13T06:05:41.542 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.542 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.542 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 383.00 MB 2023-09-13T06:05:41.543 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.543 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.543 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 384.00 MB 2023-09-13T06:05:41.543 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.543 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.544 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 385.00 MB 2023-09-13T06:05:41.544 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.544 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.544 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 386.00 MB 2023-09-13T06:05:41.544 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.544 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.545 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 387.00 MB 2023-09-13T06:05:41.545 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.545 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.545 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 388.00 MB 2023-09-13T06:05:41.545 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.546 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.546 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 389.00 MB 2023-09-13T06:05:41.546 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.546 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.546 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 390.00 MB 2023-09-13T06:05:41.547 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.547 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.547 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 391.00 MB 2023-09-13T06:05:41.547 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.547 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.548 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 392.00 MB 2023-09-13T06:05:41.548 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.548 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.548 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 393.00 MB 2023-09-13T06:05:41.548 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.548 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.549 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 394.00 MB 2023-09-13T06:05:41.549 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.549 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.549 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 395.00 MB 2023-09-13T06:05:41.549 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.550 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.550 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 396.00 MB 2023-09-13T06:05:41.550 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.550 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.550 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 397.00 MB 2023-09-13T06:05:41.551 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.551 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.551 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 398.00 MB 2023-09-13T06:05:41.551 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.551 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.551 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 399.00 MB 2023-09-13T06:05:41.552 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.552 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.552 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 400.00 MB 2023-09-13T06:05:41.552 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:41.552 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:41.553 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 401.00 MB 2023-09-13T06:05:42.268 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:05:42.265+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-09-13T06:05:44.958 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:05:44.962 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:05:47.345 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:05:47.345+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-09-13T06:05:52.347 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:05:52.345+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-09-13T06:05:57.300 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.300 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.300 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 402.00 MB 2023-09-13T06:05:57.301 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.301 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.301 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 403.00 MB 2023-09-13T06:05:57.301 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.301 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.301 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 404.00 MB 2023-09-13T06:05:57.302 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.302 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.302 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 405.00 MB 2023-09-13T06:05:57.302 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.302 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.303 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 406.00 MB 2023-09-13T06:05:57.303 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.303 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.303 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 407.00 MB 2023-09-13T06:05:57.303 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.303 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.304 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 408.00 MB 2023-09-13T06:05:57.304 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.304 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.304 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 409.00 MB 2023-09-13T06:05:57.304 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.304 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.305 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 410.00 MB 2023-09-13T06:05:57.305 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.305 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.305 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 411.00 MB 2023-09-13T06:05:57.305 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.305 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.306 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 412.00 MB 2023-09-13T06:05:57.306 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.306 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.306 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 413.00 MB 2023-09-13T06:05:57.306 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.307 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.307 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 414.00 MB 2023-09-13T06:05:57.307 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.307 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.307 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 415.00 MB 2023-09-13T06:05:57.307 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.308 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.308 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 416.00 MB 2023-09-13T06:05:57.308 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.308 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.308 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 417.00 MB 2023-09-13T06:05:57.308 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.309 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.309 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 418.00 MB 2023-09-13T06:05:57.309 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.309 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.309 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 419.00 MB 2023-09-13T06:05:57.309 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.310 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.310 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 420.00 MB 2023-09-13T06:05:57.310 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.310 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.311 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 421.00 MB 2023-09-13T06:05:57.311 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.311 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.311 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 422.00 MB 2023-09-13T06:05:57.311 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.312 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.312 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 423.00 MB 2023-09-13T06:05:57.312 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.312 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.312 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 424.00 MB 2023-09-13T06:05:57.312 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.313 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.313 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 425.00 MB 2023-09-13T06:05:57.313 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.313 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.313 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 426.00 MB 2023-09-13T06:05:57.314 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.314 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.314 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 427.00 MB 2023-09-13T06:05:57.314 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.314 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.315 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 428.00 MB 2023-09-13T06:05:57.315 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.315 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.315 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 429.00 MB 2023-09-13T06:05:57.315 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.315 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.316 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 430.00 MB 2023-09-13T06:05:57.316 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.316 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.316 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 431.00 MB 2023-09-13T06:05:57.316 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.316 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.317 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 432.00 MB 2023-09-13T06:05:57.317 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.317 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.317 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 433.00 MB 2023-09-13T06:05:57.317 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.317 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.318 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 434.00 MB 2023-09-13T06:05:57.318 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.318 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.318 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 435.00 MB 2023-09-13T06:05:57.318 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.319 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.319 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 436.00 MB 2023-09-13T06:05:57.319 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.319 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.319 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 437.00 MB 2023-09-13T06:05:57.319 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.320 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.320 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 438.00 MB 2023-09-13T06:05:57.320 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.320 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.320 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 439.00 MB 2023-09-13T06:05:57.321 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.321 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.321 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 440.00 MB 2023-09-13T06:05:57.321 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.321 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.321 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 441.00 MB 2023-09-13T06:05:57.322 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.322 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.322 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 442.00 MB 2023-09-13T06:05:57.322 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.322 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.323 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 443.00 MB 2023-09-13T06:05:57.323 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.323 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.323 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 444.00 MB 2023-09-13T06:05:57.323 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.323 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.324 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 445.00 MB 2023-09-13T06:05:57.324 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.324 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.324 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 446.00 MB 2023-09-13T06:05:57.325 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.325 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.325 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 447.00 MB 2023-09-13T06:05:57.325 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.325 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.326 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 448.00 MB 2023-09-13T06:05:57.326 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.326 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.326 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 449.00 MB 2023-09-13T06:05:57.326 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.327 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.327 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 450.00 MB 2023-09-13T06:05:57.327 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.327 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.327 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 451.00 MB 2023-09-13T06:05:57.327 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.328 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.328 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 452.00 MB 2023-09-13T06:05:57.328 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.328 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.328 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 453.00 MB 2023-09-13T06:05:57.329 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.329 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.329 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 454.00 MB 2023-09-13T06:05:57.329 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.329 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.330 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 455.00 MB 2023-09-13T06:05:57.330 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.330 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.330 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 456.00 MB 2023-09-13T06:05:57.330 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.330 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.331 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 457.00 MB 2023-09-13T06:05:57.331 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.331 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.331 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 458.00 MB 2023-09-13T06:05:57.331 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.331 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.332 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 459.00 MB 2023-09-13T06:05:57.332 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.332 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.332 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 460.00 MB 2023-09-13T06:05:57.332 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.333 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.333 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 461.00 MB 2023-09-13T06:05:57.333 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.333 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.333 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 462.00 MB 2023-09-13T06:05:57.334 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.334 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.334 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 463.00 MB 2023-09-13T06:05:57.334 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.334 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.334 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 464.00 MB 2023-09-13T06:05:57.335 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.335 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.335 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 465.00 MB 2023-09-13T06:05:57.335 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.335 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.336 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 466.00 MB 2023-09-13T06:05:57.336 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.336 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.336 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 467.00 MB 2023-09-13T06:05:57.336 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.336 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.337 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 468.00 MB 2023-09-13T06:05:57.337 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.337 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.337 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 469.00 MB 2023-09-13T06:05:57.337 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.338 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.338 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 470.00 MB 2023-09-13T06:05:57.338 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.338 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.338 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 471.00 MB 2023-09-13T06:05:57.338 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.339 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.339 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 472.00 MB 2023-09-13T06:05:57.339 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.339 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.339 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 473.00 MB 2023-09-13T06:05:57.340 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.340 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.340 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 474.00 MB 2023-09-13T06:05:57.340 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.340 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.341 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 475.00 MB 2023-09-13T06:05:57.341 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.341 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.341 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 476.00 MB 2023-09-13T06:05:57.341 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.341 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.342 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 477.00 MB 2023-09-13T06:05:57.342 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.342 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.342 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 478.00 MB 2023-09-13T06:05:57.342 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:05:57.343 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:05:57.343 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 479.00 MB 2023-09-13T06:05:57.343 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:05:57.343 INFO:teuthology.orchestra.run.smithi130.stdout:Reached fullness after 479.00 MB 2023-09-13T06:05:57.343 INFO:teuthology.orchestra.run.smithi130.stdout:calling close 2023-09-13T06:05:57.343 INFO:teuthology.orchestra.run.smithi130.stdout:close() did not raise error 2023-09-13T06:05:57.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-13T06:05:57.345 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:05:57.346 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:05:57.400 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:05:57.465 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:05:57.466 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:05:57.466 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:57.476 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:05:57.477 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:57.530 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:57.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.717+0000 7fbefbb2c640 1 Processor -- start 2023-09-13T06:05:57.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.717+0000 7fbefbb2c640 1 -- start start 2023-09-13T06:05:57.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.717+0000 7fbefbb2c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbef40b2da0 0x7fbef406f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:57.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.717+0000 7fbefbb2c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbef40cf2a0 0x7fbef4160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:57.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.717+0000 7fbefbb2c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef415d9e0 con 0x7fbef406fc70 2023-09-13T06:05:57.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.717+0000 7fbefbb2c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef415e660 con 0x7fbef40b2da0 2023-09-13T06:05:57.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.717+0000 7fbefbb2c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef415dcc0 con 0x7fbef40cf2a0 2023-09-13T06:05:57.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.717+0000 7fbef98c8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbef40b2da0 0x7fbef406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:57.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.717+0000 7fbef98c8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbef40b2da0 0x7fbef406f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45120/0 (socket says 172.21.15.130:45120) 2023-09-13T06:05:57.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.717+0000 7fbef98c8640 1 -- 172.21.15.130:0/1933899852 learned_addr learned my addr 172.21.15.130:0/1933899852 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:57.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.721+0000 7fbef98c8640 1 -- 172.21.15.130:0/1933899852 >> v2:172.21.15.164:3300/0 conn(0x7fbef40cf2a0 msgr2=0x7fbef4160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:57.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.721+0000 7fbef98c8640 1 --2- 172.21.15.130:0/1933899852 >> v2:172.21.15.164:3300/0 conn(0x7fbef40cf2a0 0x7fbef4160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:57.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.721+0000 7fbef98c8640 1 -- 172.21.15.130:0/1933899852 >> v1:172.21.15.164:6789/0 conn(0x7fbef406fc70 legacy=0x7fbef40ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:57.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.721+0000 7fbef98c8640 1 -- 172.21.15.130:0/1933899852 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef415dfa0 con 0x7fbef40b2da0 2023-09-13T06:05:57.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.721+0000 7fbef98c8640 1 --2- 172.21.15.130:0/1933899852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef40b2da0 0x7fbef406f730 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fbef40cfb70 tx=0x7fbef001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcdc11c074bd860 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:57.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.721+0000 7fbef88c6640 1 -- 172.21.15.130:0/1933899852 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00a89b0 con 0x7fbef40b2da0 2023-09-13T06:05:57.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.721+0000 7fbef88c6640 1 -- 172.21.15.130:0/1933899852 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef00a8b10 con 0x7fbef40b2da0 2023-09-13T06:05:57.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.721+0000 7fbef88c6640 1 -- 172.21.15.130:0/1933899852 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00a8ea0 con 0x7fbef40b2da0 2023-09-13T06:05:57.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 -- 172.21.15.130:0/1933899852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef40b2da0 msgr2=0x7fbef406f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:57.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 --2- 172.21.15.130:0/1933899852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef40b2da0 0x7fbef406f730 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fbef40cfb70 tx=0x7fbef001ecb0 comp rx=0 tx=0).stop 2023-09-13T06:05:57.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 -- 172.21.15.130:0/1933899852 shutdown_connections 2023-09-13T06:05:57.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 --2- 172.21.15.130:0/1933899852 >> v2:172.21.15.164:3300/0 conn(0x7fbef40cf2a0 0x7fbef4160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:57.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 --2- 172.21.15.130:0/1933899852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef40b2da0 0x7fbef406f730 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:57.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 -- 172.21.15.130:0/1933899852 >> 172.21.15.130:0/1933899852 conn(0x7fbef406a2f0 msgr2=0x7fbef406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:57.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 -- 172.21.15.130:0/1933899852 shutdown_connections 2023-09-13T06:05:57.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 -- 172.21.15.130:0/1933899852 wait complete. 2023-09-13T06:05:57.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 Processor -- start 2023-09-13T06:05:57.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 -- start start 2023-09-13T06:05:57.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbef406fc70 0x7fbef413ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:57.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbef40b2da0 0x7fbef40cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:57.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef40cf2a0 0x7fbef40d0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:57.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef41f4e30 con 0x7fbef40cf2a0 2023-09-13T06:05:57.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef41f5110 con 0x7fbef406fc70 2023-09-13T06:05:57.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefbb2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef41f53f0 con 0x7fbef40b2da0 2023-09-13T06:05:57.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefa0c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef40cf2a0 0x7fbef40d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:57.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefa0c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef40cf2a0 0x7fbef40d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45134/0 (socket says 172.21.15.130:45134) 2023-09-13T06:05:57.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefa0c9640 1 -- 172.21.15.130:0/3069413940 learned_addr learned my addr 172.21.15.130:0/3069413940 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:57.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbef98c8640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbef406fc70 0x7fbef413ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:57.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbef90c7640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbef40b2da0 0x7fbef40cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:57.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefa0c9640 1 -- 172.21.15.130:0/3069413940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbef40b2da0 msgr2=0x7fbef40cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:57.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefa0c9640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbef40b2da0 0x7fbef40cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:57.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefa0c9640 1 -- 172.21.15.130:0/3069413940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbef406fc70 msgr2=0x7fbef413ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:57.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefa0c9640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbef406fc70 0x7fbef413ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:57.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefa0c9640 1 -- 172.21.15.130:0/3069413940 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef00094d0 con 0x7fbef40cf2a0 2023-09-13T06:05:57.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbef90c7640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbef40b2da0 0x7fbef40cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:57.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.725+0000 7fbefa0c9640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef40cf2a0 0x7fbef40d0330 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00b970 tx=0x7fbeec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:57.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.729+0000 7fbeea7fc640 1 -- 172.21.15.130:0/3069413940 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00cae0 con 0x7fbef40cf2a0 2023-09-13T06:05:57.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.729+0000 7fbeea7fc640 1 -- 172.21.15.130:0/3069413940 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec00cc60 con 0x7fbef40cf2a0 2023-09-13T06:05:57.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.729+0000 7fbeea7fc640 1 -- 172.21.15.130:0/3069413940 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec014440 con 0x7fbef40cf2a0 2023-09-13T06:05:57.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.729+0000 7fbefbb2c640 1 -- 172.21.15.130:0/3069413940 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef41f56d0 con 0x7fbef40cf2a0 2023-09-13T06:05:57.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.729+0000 7fbefbb2c640 1 -- 172.21.15.130:0/3069413940 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef413f190 con 0x7fbef40cf2a0 2023-09-13T06:05:57.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.729+0000 7fbefbb2c640 1 -- 172.21.15.130:0/3069413940 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef40618a0 con 0x7fbef40cf2a0 2023-09-13T06:05:57.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.729+0000 7fbeea7fc640 1 -- 172.21.15.130:0/3069413940 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbeec01d3b0 con 0x7fbef40cf2a0 2023-09-13T06:05:57.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.729+0000 7fbeea7fc640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbed8065b20 0x7fbed8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:57.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.729+0000 7fbeea7fc640 1 -- 172.21.15.130:0/3069413940 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbeec083180 con 0x7fbef40cf2a0 2023-09-13T06:05:57.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.729+0000 7fbeea7fc640 1 -- 172.21.15.130:0/3069413940 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7fbed806d650 con 0x7fbef40cf2a0 2023-09-13T06:05:57.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.729+0000 7fbef98c8640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbed8065b20 0x7fbed8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:57.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.733+0000 7fbef98c8640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbed8065b20 0x7fbed8067fe0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbef00b2000 tx=0x7fbef0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:57.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.733+0000 7fbeea7fc640 1 -- 172.21.15.130:0/3069413940 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbeec019060 con 0x7fbef40cf2a0 2023-09-13T06:05:57.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.885+0000 7fbefbb2c640 1 -- 172.21.15.130:0/3069413940 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbef41f5b80 con 0x7fbef40cf2a0 2023-09-13T06:05:57.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.885+0000 7fbeea7fc640 1 -- 172.21.15.130:0/3069413940 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16647 (secure 0 0 0) 0x7fbeec050b70 con 0x7fbef40cf2a0 2023-09-13T06:05:57.889 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:57.889 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":87,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:05:47.420354+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:05:25.196040+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-09-13T06:05:25.825807+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:57.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 -- 172.21.15.130:0/3069413940 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbed8065b20 msgr2=0x7fbed8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:57.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbed8065b20 0x7fbed8067fe0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbef00b2000 tx=0x7fbef0008040 comp rx=0 tx=0).stop 2023-09-13T06:05:57.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 -- 172.21.15.130:0/3069413940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef40cf2a0 msgr2=0x7fbef40d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:57.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef40cf2a0 0x7fbef40d0330 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00b970 tx=0x7fbeec00be30 comp rx=0 tx=0).stop 2023-09-13T06:05:57.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 -- 172.21.15.130:0/3069413940 shutdown_connections 2023-09-13T06:05:57.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbed8065b20 0x7fbed8067fe0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:57.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef40cf2a0 0x7fbef40d0330 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:57.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbef40b2da0 0x7fbef40cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:57.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 --2- 172.21.15.130:0/3069413940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbef406fc70 0x7fbef413ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:57.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 -- 172.21.15.130:0/3069413940 >> 172.21.15.130:0/3069413940 conn(0x7fbef406a2f0 msgr2=0x7fbef4140cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:57.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 -- 172.21.15.130:0/3069413940 shutdown_connections 2023-09-13T06:05:57.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:57.889+0000 7fbefbb2c640 1 -- 172.21.15.130:0/3069413940 wait complete. 2023-09-13T06:05:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:05:25.196040+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:05:25.825807+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:05:57.913 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:05:58.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9ad32c640 1 Processor -- start 2023-09-13T06:05:58.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9ad32c640 1 -- start start 2023-09-13T06:05:58.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9ad32c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9a8144d70 0x7ff9a80ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9ad32c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80b2780 0x7ff9a80b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9ad32c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a80b3120 con 0x7ff9a80b1460 2023-09-13T06:05:58.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9ad32c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a80b2430 con 0x7ff9a8144d70 2023-09-13T06:05:58.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9ad32c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80cedb0 con 0x7ff9a80b2780 2023-09-13T06:05:58.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9a6ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9a8144d70 0x7ff9a80ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9a6ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9a8144d70 0x7ff9a80ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45142/0 (socket says 172.21.15.130:45142) 2023-09-13T06:05:58.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9a6ffd640 1 -- 172.21.15.130:0/3553522536 learned_addr learned my addr 172.21.15.130:0/3553522536 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:58.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9a67fc640 1 --2- 172.21.15.130:0/3553522536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80b2780 0x7ff9a80b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9a6ffd640 1 -- 172.21.15.130:0/3553522536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80b2780 msgr2=0x7ff9a80b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:58.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9a6ffd640 1 --2- 172.21.15.130:0/3553522536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80b2780 0x7ff9a80b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9a6ffd640 1 -- 172.21.15.130:0/3553522536 >> v1:172.21.15.164:6789/0 conn(0x7ff9a80b1460 legacy=0x7ff9a80b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.053+0000 7ff9a6ffd640 1 -- 172.21.15.130:0/3553522536 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80b2150 con 0x7ff9a8144d70 2023-09-13T06:05:58.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9a6ffd640 1 --2- 172.21.15.130:0/3553522536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a8144d70 0x7ff9a80ce870 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff998009870 tx=0x7ff99801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7075e622d76a08 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:58.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9a5ffb640 1 -- 172.21.15.130:0/3553522536 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980a7070 con 0x7ff9a8144d70 2023-09-13T06:05:58.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9a5ffb640 1 -- 172.21.15.130:0/3553522536 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9980ab430 con 0x7ff9a8144d70 2023-09-13T06:05:58.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9a5ffb640 1 -- 172.21.15.130:0/3553522536 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980ab7c0 con 0x7ff9a8144d70 2023-09-13T06:05:58.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3553522536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a8144d70 msgr2=0x7ff9a80ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9ad32c640 1 --2- 172.21.15.130:0/3553522536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a8144d70 0x7ff9a80ce870 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff998009870 tx=0x7ff99801c540 comp rx=0 tx=0).stop 2023-09-13T06:05:58.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3553522536 shutdown_connections 2023-09-13T06:05:58.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9ad32c640 1 --2- 172.21.15.130:0/3553522536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80b2780 0x7ff9a80b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9ad32c640 1 --2- 172.21.15.130:0/3553522536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a8144d70 0x7ff9a80ce870 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3553522536 >> 172.21.15.130:0/3553522536 conn(0x7ff9a8065990 msgr2=0x7ff9a8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:58.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3553522536 shutdown_connections 2023-09-13T06:05:58.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.057+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3553522536 wait complete. 2023-09-13T06:05:58.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9ad32c640 1 Processor -- start 2023-09-13T06:05:58.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9ad32c640 1 -- start start 2023-09-13T06:05:58.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9ad32c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a80b1460 0x7ff9a806b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9ad32c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80b2780 0x7ff9a813b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9ad32c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a8144d70 0x7ff9a813bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9ad32c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a8157570 con 0x7ff9a80b1460 2023-09-13T06:05:58.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9ad32c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a813c070 con 0x7ff9a8144d70 2023-09-13T06:05:58.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9ad32c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a8157810 con 0x7ff9a80b2780 2023-09-13T06:05:58.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a80b1460 0x7ff9a806b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a80b1460 0x7ff9a806b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45144/0 (socket says 172.21.15.130:45144) 2023-09-13T06:05:58.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a6ffd640 1 -- 172.21.15.130:0/3070757780 learned_addr learned my addr 172.21.15.130:0/3070757780 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:58.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a67fc640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80b2780 0x7ff9a813b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a77fe640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a8144d70 0x7ff9a813bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a6ffd640 1 -- 172.21.15.130:0/3070757780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80b2780 msgr2=0x7ff9a813b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a6ffd640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80b2780 0x7ff9a813b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a6ffd640 1 -- 172.21.15.130:0/3070757780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a8144d70 msgr2=0x7ff9a813bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a6ffd640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a8144d70 0x7ff9a813bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a6ffd640 1 -- 172.21.15.130:0/3070757780 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9980094d0 con 0x7ff9a80b1460 2023-09-13T06:05:58.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a67fc640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80b2780 0x7ff9a813b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:58.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9a6ffd640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a80b1460 0x7ff9a806b570 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ff9980ad040 tx=0x7ff9980192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:58.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff98f7fe640 1 -- 172.21.15.130:0/3070757780 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980bc070 con 0x7ff9a80b1460 2023-09-13T06:05:58.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff98f7fe640 1 -- 172.21.15.130:0/3070757780 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9980b4420 con 0x7ff9a80b1460 2023-09-13T06:05:58.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3070757780 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a8157af0 con 0x7ff9a80b1460 2023-09-13T06:05:58.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff98f7fe640 1 -- 172.21.15.130:0/3070757780 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980b47f0 con 0x7ff9a80b1460 2023-09-13T06:05:58.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.061+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3070757780 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a80b0df0 con 0x7ff9a80b1460 2023-09-13T06:05:58.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.065+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3070757780 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a80618a0 con 0x7ff9a80b1460 2023-09-13T06:05:58.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.065+0000 7ff98f7fe640 1 -- 172.21.15.130:0/3070757780 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff9980b4950 con 0x7ff9a80b1460 2023-09-13T06:05:58.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.065+0000 7ff98f7fe640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff994065b20 0x7ff994067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.065+0000 7ff98f7fe640 1 -- 172.21.15.130:0/3070757780 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff99811cba0 con 0x7ff9a80b1460 2023-09-13T06:05:58.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.065+0000 7ff9a67fc640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff994065b20 0x7ff994067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.065+0000 7ff98f7fe640 1 -- 172.21.15.130:0/3070757780 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7ff99406d650 con 0x7ff9a80b1460 2023-09-13T06:05:58.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.065+0000 7ff9a67fc640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff994065b20 0x7ff994067fe0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8151bb0 tx=0x7ff99c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:58.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.069+0000 7ff98f7fe640 1 -- 172.21.15.130:0/3070757780 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff9980ea580 con 0x7ff9a80b1460 2023-09-13T06:05:58.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3070757780 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9a8157fa0 con 0x7ff9a80b1460 2023-09-13T06:05:58.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff98f7fe640 1 -- 172.21.15.130:0/3070757780 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9980edba0 con 0x7ff9a80b1460 2023-09-13T06:05:58.219 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:05:58.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3070757780 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff994065b20 msgr2=0x7ff994067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff9ad32c640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff994065b20 0x7ff994067fe0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8151bb0 tx=0x7ff99c008040 comp rx=0 tx=0).stop 2023-09-13T06:05:58.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3070757780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a80b1460 msgr2=0x7ff9a806b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff9ad32c640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a80b1460 0x7ff9a806b570 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ff9980ad040 tx=0x7ff9980192e0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3070757780 shutdown_connections 2023-09-13T06:05:58.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff9ad32c640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff994065b20 0x7ff994067fe0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff9ad32c640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a8144d70 0x7ff9a813bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff9ad32c640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a80b2780 0x7ff9a813b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff9ad32c640 1 --2- 172.21.15.130:0/3070757780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a80b1460 0x7ff9a806b570 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.217+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3070757780 >> 172.21.15.130:0/3070757780 conn(0x7ff9a8065990 msgr2=0x7ff9a81421d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:58.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.221+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3070757780 shutdown_connections 2023-09-13T06:05:58.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.221+0000 7ff9ad32c640 1 -- 172.21.15.130:0/3070757780 wait complete. 2023-09-13T06:05:58.240 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:05:58.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42ed4d640 1 Processor -- start 2023-09-13T06:05:58.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42ed4d640 1 -- start start 2023-09-13T06:05:58.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42ed4d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe4281617f0 0x7fe4280cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42ed4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4280cc880 0x7fe4280ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42ed4d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4280b2620 con 0x7fe4280ce6c0 2023-09-13T06:05:58.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42ed4d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4280b1a80 con 0x7fe4281617f0 2023-09-13T06:05:58.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42ed4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280ccce0 con 0x7fe4280cc880 2023-09-13T06:05:58.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42cae9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe4281617f0 0x7fe4280cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42cae9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe4281617f0 0x7fe4280cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45160/0 (socket says 172.21.15.130:45160) 2023-09-13T06:05:58.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42cae9640 1 -- 172.21.15.130:0/2310742894 learned_addr learned my addr 172.21.15.130:0/2310742894 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:58.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42cae9640 1 -- 172.21.15.130:0/2310742894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4280cc880 msgr2=0x7fe4280ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:58.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe427fff640 1 --2- 172.21.15.130:0/2310742894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4280cc880 0x7fe4280ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42cae9640 1 --2- 172.21.15.130:0/2310742894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4280cc880 0x7fe4280ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42cae9640 1 -- 172.21.15.130:0/2310742894 >> v1:172.21.15.164:6789/0 conn(0x7fe4280ce6c0 legacy=0x7fe4280b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:58.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe42cae9640 1 -- 172.21.15.130:0/2310742894 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280b2ab0 con 0x7fe4281617f0 2023-09-13T06:05:58.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.381+0000 7fe427fff640 1 --2- 172.21.15.130:0/2310742894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4280cc880 0x7fe4280ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:58.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe42cae9640 1 --2- 172.21.15.130:0/2310742894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4281617f0 0x7fe4280cc340 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009870 tx=0x7fe41c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647546a38d0dc50d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:58.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe4277fe640 1 -- 172.21.15.130:0/2310742894 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0ac600 con 0x7fe4281617f0 2023-09-13T06:05:58.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe4277fe640 1 -- 172.21.15.130:0/2310742894 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c0a8050 con 0x7fe4281617f0 2023-09-13T06:05:58.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe4277fe640 1 -- 172.21.15.130:0/2310742894 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0ac980 con 0x7fe4281617f0 2023-09-13T06:05:58.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe42ed4d640 1 -- 172.21.15.130:0/2310742894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4281617f0 msgr2=0x7fe4280cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe42ed4d640 1 --2- 172.21.15.130:0/2310742894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4281617f0 0x7fe4280cc340 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009870 tx=0x7fe41c01c4d0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe42ed4d640 1 -- 172.21.15.130:0/2310742894 shutdown_connections 2023-09-13T06:05:58.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe42ed4d640 1 --2- 172.21.15.130:0/2310742894 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4280cc880 0x7fe4280ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe42ed4d640 1 --2- 172.21.15.130:0/2310742894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4281617f0 0x7fe4280cc340 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe42ed4d640 1 -- 172.21.15.130:0/2310742894 >> 172.21.15.130:0/2310742894 conn(0x7fe428065990 msgr2=0x7fe428065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:58.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe42ed4d640 1 -- 172.21.15.130:0/2310742894 shutdown_connections 2023-09-13T06:05:58.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.385+0000 7fe42ed4d640 1 -- 172.21.15.130:0/2310742894 wait complete. 2023-09-13T06:05:58.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42ed4d640 1 Processor -- start 2023-09-13T06:05:58.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42ed4d640 1 -- start start 2023-09-13T06:05:58.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42ed4d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280cc880 0x7fe42814c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42ed4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4280ce6c0 0x7fe4281514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42ed4d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4281617f0 0x7fe4281519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42ed4d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42814e3c0 con 0x7fe4280cc880 2023-09-13T06:05:58.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42ed4d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42814d670 con 0x7fe4281617f0 2023-09-13T06:05:58.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42ed4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42814d950 con 0x7fe4280ce6c0 2023-09-13T06:05:58.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42cae9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280cc880 0x7fe42814c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42cae9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280cc880 0x7fe42814c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45168/0 (socket says 172.21.15.130:45168) 2023-09-13T06:05:58.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42cae9640 1 -- 172.21.15.130:0/1281346973 learned_addr learned my addr 172.21.15.130:0/1281346973 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:58.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe427fff640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4280ce6c0 0x7fe4281514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42d2ea640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4281617f0 0x7fe4281519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42cae9640 1 -- 172.21.15.130:0/1281346973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4280ce6c0 msgr2=0x7fe4281514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42cae9640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4280ce6c0 0x7fe4281514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42cae9640 1 -- 172.21.15.130:0/1281346973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4281617f0 msgr2=0x7fe4281519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42cae9640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4281617f0 0x7fe4281519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42cae9640 1 -- 172.21.15.130:0/1281346973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0094d0 con 0x7fe4280cc880 2023-09-13T06:05:58.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42cae9640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280cc880 0x7fe42814c300 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe41c01cd70 tx=0x7fe41c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:58.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe4257fa640 1 -- 172.21.15.130:0/1281346973 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0b7620 con 0x7fe4280cc880 2023-09-13T06:05:58.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe4257fa640 1 -- 172.21.15.130:0/1281346973 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c0b77a0 con 0x7fe4280cc880 2023-09-13T06:05:58.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe4257fa640 1 -- 172.21.15.130:0/1281346973 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0b7b50 con 0x7fe4280cc880 2023-09-13T06:05:58.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42ed4d640 1 -- 172.21.15.130:0/1281346973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42814dc30 con 0x7fe4280cc880 2023-09-13T06:05:58.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.389+0000 7fe42ed4d640 1 -- 172.21.15.130:0/1281346973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42814df10 con 0x7fe4280cc880 2023-09-13T06:05:58.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.393+0000 7fe42ed4d640 1 -- 172.21.15.130:0/1281346973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4280618a0 con 0x7fe4280cc880 2023-09-13T06:05:58.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.393+0000 7fe4257fa640 1 -- 172.21.15.130:0/1281346973 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe41c0b3040 con 0x7fe4280cc880 2023-09-13T06:05:58.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.393+0000 7fe4257fa640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe40c065b20 0x7fe40c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.393+0000 7fe4257fa640 1 -- 172.21.15.130:0/1281346973 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe41c11d740 con 0x7fe4280cc880 2023-09-13T06:05:58.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.393+0000 7fe427fff640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe40c065b20 0x7fe40c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.393+0000 7fe4257fa640 1 -- 172.21.15.130:0/1281346973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7fe40c06d650 con 0x7fe4280cc880 2023-09-13T06:05:58.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.393+0000 7fe427fff640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe40c065b20 0x7fe40c067fe0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe42814edc0 tx=0x7fe414008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:58.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.397+0000 7fe4257fa640 1 -- 172.21.15.130:0/1281346973 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe41c0eb0b0 con 0x7fe4280cc880 2023-09-13T06:05:58.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.545+0000 7fe42ed4d640 1 -- 172.21.15.130:0/1281346973 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4281589a0 con 0x7fe4280cc880 2023-09-13T06:05:58.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.545+0000 7fe4257fa640 1 -- 172.21.15.130:0/1281346973 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe41c0b1020 con 0x7fe4280cc880 2023-09-13T06:05:58.549 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:05:58.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 -- 172.21.15.130:0/1281346973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe40c065b20 msgr2=0x7fe40c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe40c065b20 0x7fe40c067fe0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe42814edc0 tx=0x7fe414008040 comp rx=0 tx=0).stop 2023-09-13T06:05:58.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 -- 172.21.15.130:0/1281346973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280cc880 msgr2=0x7fe42814c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280cc880 0x7fe42814c300 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe41c01cd70 tx=0x7fe41c01ad10 comp rx=0 tx=0).stop 2023-09-13T06:05:58.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 -- 172.21.15.130:0/1281346973 shutdown_connections 2023-09-13T06:05:58.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe40c065b20 0x7fe40c067fe0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4281617f0 0x7fe4281519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4280ce6c0 0x7fe4281514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 --2- 172.21.15.130:0/1281346973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280cc880 0x7fe42814c300 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 -- 172.21.15.130:0/1281346973 >> 172.21.15.130:0/1281346973 conn(0x7fe428065990 msgr2=0x7fe4280af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:58.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 -- 172.21.15.130:0/1281346973 shutdown_connections 2023-09-13T06:05:58.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.549+0000 7fe42ed4d640 1 -- 172.21.15.130:0/1281346973 wait complete. 2023-09-13T06:05:58.570 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:05:58.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57bd048640 1 Processor -- start 2023-09-13T06:05:58.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57bd048640 1 -- start start 2023-09-13T06:05:58.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57bd048640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f57b80b1b70 0x7f57b80ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57bd048640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b80b2150 con 0x7f57b8144d70 2023-09-13T06:05:58.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57bd048640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b80cdd90 con 0x7f57b80b2e90 2023-09-13T06:05:58.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57bd048640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b80b2430 con 0x7f57b80b1b70 2023-09-13T06:05:58.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57b759e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f57b80b1b70 0x7f57b80ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57b759e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f57b80b1b70 0x7f57b80ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45182/0 (socket says 172.21.15.130:45182) 2023-09-13T06:05:58.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57b759e640 1 -- 172.21.15.130:0/2943707267 learned_addr learned my addr 172.21.15.130:0/2943707267 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:58.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57b6d9d640 1 --1- 172.21.15.130:0/2943707267 >> v1:172.21.15.130:6789/0 conn(0x7f57b8144d70 0x7f57b80b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:45098/0 (socket says 172.21.15.130:45098) 2023-09-13T06:05:58.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57b759e640 1 -- 172.21.15.130:0/2943707267 >> v1:172.21.15.164:6789/0 conn(0x7f57b80b2e90 legacy=0x7f57b80b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:58.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57b759e640 1 -- 172.21.15.130:0/2943707267 >> v1:172.21.15.130:6789/0 conn(0x7f57b8144d70 legacy=0x7f57b80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57b759e640 1 -- 172.21.15.130:0/2943707267 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b80ce070 con 0x7f57b80b1b70 2023-09-13T06:05:58.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.713+0000 7f57b659c640 1 -- 172.21.15.130:0/2943707267 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989884361 0 0) 0x7f57b80b2150 con 0x7f57b8144d70 2023-09-13T06:05:58.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57b759e640 1 --2- 172.21.15.130:0/2943707267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57b80b1b70 0x7f57b80ce870 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009e50 tx=0x7f57b001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f130c4ebaf5165 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:58.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57b659c640 1 -- 172.21.15.130:0/2943707267 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00a5690 con 0x7f57b80b1b70 2023-09-13T06:05:58.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57b659c640 1 -- 172.21.15.130:0/2943707267 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b00a57f0 con 0x7f57b80b1b70 2023-09-13T06:05:58.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57b659c640 1 -- 172.21.15.130:0/2943707267 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00a5b80 con 0x7f57b80b1b70 2023-09-13T06:05:58.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57bd048640 1 -- 172.21.15.130:0/2943707267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57b80b1b70 msgr2=0x7f57b80ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57bd048640 1 --2- 172.21.15.130:0/2943707267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57b80b1b70 0x7f57b80ce870 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009e50 tx=0x7f57b001c9d0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57bd048640 1 -- 172.21.15.130:0/2943707267 shutdown_connections 2023-09-13T06:05:58.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57bd048640 1 --2- 172.21.15.130:0/2943707267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57b80b1b70 0x7f57b80ce870 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57bd048640 1 -- 172.21.15.130:0/2943707267 >> 172.21.15.130:0/2943707267 conn(0x7f57b8065990 msgr2=0x7f57b8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:58.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57bd048640 1 -- 172.21.15.130:0/2943707267 shutdown_connections 2023-09-13T06:05:58.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57bd048640 1 -- 172.21.15.130:0/2943707267 wait complete. 2023-09-13T06:05:58.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57bd048640 1 Processor -- start 2023-09-13T06:05:58.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.717+0000 7f57bd048640 1 -- start start 2023-09-13T06:05:58.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57bd048640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57b80b1b70 0x7f57b81379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57bd048640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57b80b2e90 0x7f57b8137ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57bd048640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57b8144d70 0x7f57b815c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57bd048640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b813fe00 con 0x7f57b80b2e90 2023-09-13T06:05:58.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57bd048640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8159eb0 con 0x7f57b80b1b70 2023-09-13T06:05:58.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57bd048640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80aedf0 con 0x7f57b8144d70 2023-09-13T06:05:58.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57affff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57b80b2e90 0x7f57b8137ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57affff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57b80b2e90 0x7f57b8137ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45188/0 (socket says 172.21.15.130:45188) 2023-09-13T06:05:58.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57affff640 1 -- 172.21.15.130:0/801746873 learned_addr learned my addr 172.21.15.130:0/801746873 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:58.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57b759e640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57b8144d70 0x7f57b815c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57b6d9d640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57b80b1b70 0x7f57b81379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57affff640 1 -- 172.21.15.130:0/801746873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57b8144d70 msgr2=0x7f57b815c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57affff640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57b8144d70 0x7f57b815c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57affff640 1 -- 172.21.15.130:0/801746873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57b80b1b70 msgr2=0x7f57b81379a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57affff640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57b80b1b70 0x7f57b81379a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57affff640 1 -- 172.21.15.130:0/801746873 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0009b30 con 0x7f57b80b2e90 2023-09-13T06:05:58.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57affff640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57b80b2e90 0x7f57b8137ee0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f57a000c490 tx=0x7f57a0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:58.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57af7fe640 1 -- 172.21.15.130:0/801746873 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0003600 con 0x7f57b80b2e90 2023-09-13T06:05:58.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57af7fe640 1 -- 172.21.15.130:0/801746873 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0003780 con 0x7f57b80b2e90 2023-09-13T06:05:58.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57af7fe640 1 -- 172.21.15.130:0/801746873 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0003b30 con 0x7f57b80b2e90 2023-09-13T06:05:58.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57bd048640 1 -- 172.21.15.130:0/801746873 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b80af0d0 con 0x7f57b80b2e90 2023-09-13T06:05:58.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57bd048640 1 -- 172.21.15.130:0/801746873 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b8159b40 con 0x7f57b80b2e90 2023-09-13T06:05:58.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.721+0000 7f57bd048640 1 -- 172.21.15.130:0/801746873 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b815a020 con 0x7f57b80b2e90 2023-09-13T06:05:58.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.725+0000 7f57af7fe640 1 -- 172.21.15.130:0/801746873 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f57a0003c90 con 0x7f57b80b2e90 2023-09-13T06:05:58.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.725+0000 7f57af7fe640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5798065b20 0x7f5798067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:58.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.725+0000 7f57af7fe640 1 -- 172.21.15.130:0/801746873 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57a0082540 con 0x7f57b80b2e90 2023-09-13T06:05:58.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.725+0000 7f57b6d9d640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5798065b20 0x7f5798067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:58.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.725+0000 7f57af7fe640 1 -- 172.21.15.130:0/801746873 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7f579806d650 con 0x7f57b80b2e90 2023-09-13T06:05:58.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.725+0000 7f57b6d9d640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5798065b20 0x7f5798067fe0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f57a8000f70 tx=0x7f57a8007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:58.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.729+0000 7f57af7fe640 1 -- 172.21.15.130:0/801746873 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f57a004fdf0 con 0x7f57b80b2e90 2023-09-13T06:05:58.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57bd048640 1 -- 172.21.15.130:0/801746873 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f57b80618a0 con 0x7f57b80b2e90 2023-09-13T06:05:58.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57af7fe640 1 -- 172.21.15.130:0/801746873 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f57a0017020 con 0x7f57b80b2e90 2023-09-13T06:05:58.879 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:05:58.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57bd048640 1 -- 172.21.15.130:0/801746873 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5798065b20 msgr2=0x7f5798067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57bd048640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5798065b20 0x7f5798067fe0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f57a8000f70 tx=0x7f57a8007c10 comp rx=0 tx=0).stop 2023-09-13T06:05:58.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57bd048640 1 -- 172.21.15.130:0/801746873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57b80b2e90 msgr2=0x7f57b8137ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:58.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57bd048640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57b80b2e90 0x7f57b8137ee0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f57a000c490 tx=0x7f57a0001e80 comp rx=0 tx=0).stop 2023-09-13T06:05:58.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57bd048640 1 -- 172.21.15.130:0/801746873 shutdown_connections 2023-09-13T06:05:58.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57bd048640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5798065b20 0x7f5798067fe0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57bd048640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57b8144d70 0x7f57b815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57bd048640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57b80b2e90 0x7f57b8137ee0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57bd048640 1 --2- 172.21.15.130:0/801746873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57b80b1b70 0x7f57b81379a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:58.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.877+0000 7f57bd048640 1 -- 172.21.15.130:0/801746873 >> 172.21.15.130:0/801746873 conn(0x7f57b8065990 msgr2=0x7f57b8143380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:58.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.881+0000 7f57bd048640 1 -- 172.21.15.130:0/801746873 shutdown_connections 2023-09-13T06:05:58.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:58.881+0000 7f57bd048640 1 -- 172.21.15.130:0/801746873 wait complete. 2023-09-13T06:05:58.900 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:05:59.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.037+0000 7f3eed46d640 1 Processor -- start 2023-09-13T06:05:59.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.037+0000 7f3eed46d640 1 -- start start 2023-09-13T06:05:59.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.037+0000 7f3eed46d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 0x7f3ee80cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.037+0000 7f3eed46d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3ee80ce180 0x7f3ee815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.037+0000 7f3eed46d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3ee80b04a0 0x7f3ee80b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3eed46d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee80b0e70 con 0x7f3ee80ce180 2023-09-13T06:05:59.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3eed46d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee80ce980 con 0x7f3ee80b04a0 2023-09-13T06:05:59.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3eed46d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee80cec60 con 0x7f3ee815b130 2023-09-13T06:05:59.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ede7fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3ee80ce180 0x7f3ee815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ede7fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3ee80ce180 0x7f3ee815b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45196/0 (socket says 172.21.15.130:45196) 2023-09-13T06:05:59.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ede7fc640 1 -- 172.21.15.130:0/1445473549 learned_addr learned my addr 172.21.15.130:0/1445473549 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:59.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ede7fc640 1 -- 172.21.15.130:0/1445473549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 msgr2=0x7f3ee80cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:59.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ee6ffd640 1 --2- 172.21.15.130:0/1445473549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 0x7f3ee80cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ee77fe640 1 --2- 172.21.15.130:0/1445473549 >> v2:172.21.15.164:3300/0 conn(0x7f3ee80b04a0 0x7f3ee80b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ede7fc640 1 --2- 172.21.15.130:0/1445473549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 0x7f3ee80cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ede7fc640 1 -- 172.21.15.130:0/1445473549 >> v2:172.21.15.164:3300/0 conn(0x7f3ee80b04a0 msgr2=0x7f3ee80b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:59.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ede7fc640 1 --2- 172.21.15.130:0/1445473549 >> v2:172.21.15.164:3300/0 conn(0x7f3ee80b04a0 0x7f3ee80b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ede7fc640 1 -- 172.21.15.130:0/1445473549 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee806c640 con 0x7f3ee80ce180 2023-09-13T06:05:59.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ee77fe640 1 --2- 172.21.15.130:0/1445473549 >> v2:172.21.15.164:3300/0 conn(0x7f3ee80b04a0 0x7f3ee80b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:59.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ee6ffd640 1 --2- 172.21.15.130:0/1445473549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 0x7f3ee80cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:05:59.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ede7fc640 1 --2- 172.21.15.130:0/1445473549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ee80ce180 0x7f3ee815b510 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80cce60 tx=0x7f3ed001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbcda883c6efc4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:59.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ee67fc640 1 -- 172.21.15.130:0/1445473549 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00aa620 con 0x7f3ee80ce180 2023-09-13T06:05:59.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ee67fc640 1 -- 172.21.15.130:0/1445473549 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed00aa780 con 0x7f3ee80ce180 2023-09-13T06:05:59.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.041+0000 7f3ee67fc640 1 -- 172.21.15.130:0/1445473549 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00aab10 con 0x7f3ee80ce180 2023-09-13T06:05:59.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 -- 172.21.15.130:0/1445473549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ee80ce180 msgr2=0x7f3ee815b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 --2- 172.21.15.130:0/1445473549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ee80ce180 0x7f3ee815b510 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80cce60 tx=0x7f3ed001c500 comp rx=0 tx=0).stop 2023-09-13T06:05:59.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 -- 172.21.15.130:0/1445473549 shutdown_connections 2023-09-13T06:05:59.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 --2- 172.21.15.130:0/1445473549 >> v2:172.21.15.164:3300/0 conn(0x7f3ee80b04a0 0x7f3ee80b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 --2- 172.21.15.130:0/1445473549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ee80ce180 0x7f3ee815b510 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 --2- 172.21.15.130:0/1445473549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 0x7f3ee80cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 -- 172.21.15.130:0/1445473549 >> 172.21.15.130:0/1445473549 conn(0x7f3ee8065990 msgr2=0x7f3ee8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:59.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 -- 172.21.15.130:0/1445473549 shutdown_connections 2023-09-13T06:05:59.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 -- 172.21.15.130:0/1445473549 wait complete. 2023-09-13T06:05:59.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 Processor -- start 2023-09-13T06:05:59.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 -- start start 2023-09-13T06:05:59.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ee80b04a0 0x7f3ee8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ee80ce180 0x7f3ee80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 0x7f3ee8070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee8156ac0 con 0x7f3ee80ce180 2023-09-13T06:05:59.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee8157c60 con 0x7f3ee80b04a0 2023-09-13T06:05:59.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3eed46d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee81441a0 con 0x7f3ee815b130 2023-09-13T06:05:59.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3ede7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ee80ce180 0x7f3ee80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3ede7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ee80ce180 0x7f3ee80702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45210/0 (socket says 172.21.15.130:45210) 2023-09-13T06:05:59.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3ede7fc640 1 -- 172.21.15.130:0/2968817370 learned_addr learned my addr 172.21.15.130:0/2968817370 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:59.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3ee6ffd640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ee80b04a0 0x7f3ee8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.045+0000 7f3ee77fe640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 0x7f3ee8070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3ede7fc640 1 -- 172.21.15.130:0/2968817370 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 msgr2=0x7f3ee8070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3ede7fc640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 0x7f3ee8070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3ede7fc640 1 -- 172.21.15.130:0/2968817370 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ee80b04a0 msgr2=0x7f3ee8157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3ede7fc640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ee80b04a0 0x7f3ee8157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3ede7fc640 1 -- 172.21.15.130:0/2968817370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed00094d0 con 0x7f3ee80ce180 2023-09-13T06:05:59.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3ee77fe640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 0x7f3ee8070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:05:59.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3ede7fc640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ee80ce180 0x7f3ee80702f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00ac040 tx=0x7f3ed001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:59.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3edffff640 1 -- 172.21.15.130:0/2968817370 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00bd5f0 con 0x7f3ee80ce180 2023-09-13T06:05:59.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3edffff640 1 -- 172.21.15.130:0/2968817370 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed00bd750 con 0x7f3ee80ce180 2023-09-13T06:05:59.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3edffff640 1 -- 172.21.15.130:0/2968817370 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00bdb00 con 0x7f3ee80ce180 2023-09-13T06:05:59.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3eed46d640 1 -- 172.21.15.130:0/2968817370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee8157340 con 0x7f3ee80ce180 2023-09-13T06:05:59.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3eed46d640 1 -- 172.21.15.130:0/2968817370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee81567e0 con 0x7f3ee80ce180 2023-09-13T06:05:59.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3eed46d640 1 -- 172.21.15.130:0/2968817370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee80618a0 con 0x7f3ee80ce180 2023-09-13T06:05:59.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3edffff640 1 -- 172.21.15.130:0/2968817370 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3ed00b33f0 con 0x7f3ee80ce180 2023-09-13T06:05:59.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3edffff640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ec8065b20 0x7f3ec8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.049+0000 7f3edffff640 1 -- 172.21.15.130:0/2968817370 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ed011de00 con 0x7f3ee80ce180 2023-09-13T06:05:59.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.053+0000 7f3ee6ffd640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ec8065b20 0x7f3ec8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.053+0000 7f3edffff640 1 -- 172.21.15.130:0/2968817370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7f3ec806d650 con 0x7f3ee80ce180 2023-09-13T06:05:59.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.053+0000 7f3ee6ffd640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ec8065b20 0x7f3ec8067fe0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8006fd0 tx=0x7f3ed8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:59.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.053+0000 7f3edffff640 1 -- 172.21.15.130:0/2968817370 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3ed00eb880 con 0x7f3ee80ce180 2023-09-13T06:05:59.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 -- 172.21.15.130:0/2968817370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ee806fa30 con 0x7f3ee80ce180 2023-09-13T06:05:59.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3edffff640 1 -- 172.21.15.130:0/2968817370 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ed00c3030 con 0x7f3ee80ce180 2023-09-13T06:05:59.215 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:05:59.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 -- 172.21.15.130:0/2968817370 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ec8065b20 msgr2=0x7f3ec8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ec8065b20 0x7f3ec8067fe0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8006fd0 tx=0x7f3ed8008040 comp rx=0 tx=0).stop 2023-09-13T06:05:59.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 -- 172.21.15.130:0/2968817370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ee80ce180 msgr2=0x7f3ee80702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ee80ce180 0x7f3ee80702f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00ac040 tx=0x7f3ed001ad40 comp rx=0 tx=0).stop 2023-09-13T06:05:59.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 -- 172.21.15.130:0/2968817370 shutdown_connections 2023-09-13T06:05:59.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3ec8065b20 0x7f3ec8067fe0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ee815b130 0x7f3ee8070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ee80ce180 0x7f3ee80702f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 --2- 172.21.15.130:0/2968817370 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ee80b04a0 0x7f3ee8157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 -- 172.21.15.130:0/2968817370 >> 172.21.15.130:0/2968817370 conn(0x7f3ee8065990 msgr2=0x7f3ee81654c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:59.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 -- 172.21.15.130:0/2968817370 shutdown_connections 2023-09-13T06:05:59.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.213+0000 7f3eed46d640 1 -- 172.21.15.130:0/2968817370 wait complete. 2023-09-13T06:05:59.236 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T06:05:59.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:59.237 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-13T06:05:59.305 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:05:59.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:05:59.306 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T06:05:59.316 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:05:59.316 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:59.327 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:05:59.327 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:05:59.380 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:05:59.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.533+0000 7ff6b7c93640 1 Processor -- start 2023-09-13T06:05:59.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b7c93640 1 -- start start 2023-09-13T06:05:59.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b7c93640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff6b00d1750 0x7ff6b015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b7c93640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff6b00d1090 0x7ff6b0146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b7c93640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b00b63c0 con 0x7ff6b00d1b30 2023-09-13T06:05:59.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b7c93640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b015dea0 con 0x7ff6b00d1090 2023-09-13T06:05:59.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b7c93640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b00d0c20 con 0x7ff6b00d1750 2023-09-13T06:05:59.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b5a2f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff6b00d1750 0x7ff6b015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b5a2f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff6b00d1750 0x7ff6b015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:45080/0 (socket says 172.21.15.130:45080) 2023-09-13T06:05:59.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b5a2f640 1 -- 172.21.15.130:0/435300538 learned_addr learned my addr 172.21.15.130:0/435300538 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:59.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b522e640 1 --2- 172.21.15.130:0/435300538 >> v2:172.21.15.130:3300/0 conn(0x7ff6b00d1090 0x7ff6b0146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b4a2d640 1 -- 172.21.15.130:0/435300538 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884932986 0 0) 0x7ff6b00b63c0 con 0x7ff6b00d1b30 2023-09-13T06:05:59.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b4a2d640 1 -- 172.21.15.130:0/435300538 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff69c003530 con 0x7ff6b00d1b30 2023-09-13T06:05:59.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b5a2f640 1 -- 172.21.15.130:0/435300538 >> v2:172.21.15.130:3300/0 conn(0x7ff6b00d1090 msgr2=0x7ff6b0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:59.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b5a2f640 1 --2- 172.21.15.130:0/435300538 >> v2:172.21.15.130:3300/0 conn(0x7ff6b00d1090 0x7ff6b0146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b5a2f640 1 -- 172.21.15.130:0/435300538 >> v1:172.21.15.164:6789/0 conn(0x7ff6b00d1b30 legacy=0x7ff6b00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.537+0000 7ff6b5a2f640 1 -- 172.21.15.130:0/435300538 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00b6610 con 0x7ff6b00d1750 2023-09-13T06:05:59.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b5a2f640 1 --2- 172.21.15.130:0/435300538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b00d1750 0x7ff6b015d960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0073cd0 tx=0x7ff6ac01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e777f4d0caf73555 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:59.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b4a2d640 1 -- 172.21.15.130:0/435300538 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0aa430 con 0x7ff6b00d1750 2023-09-13T06:05:59.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b4a2d640 1 -- 172.21.15.130:0/435300538 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac0aa590 con 0x7ff6b00d1750 2023-09-13T06:05:59.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b4a2d640 1 -- 172.21.15.130:0/435300538 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0aa920 con 0x7ff6b00d1750 2023-09-13T06:05:59.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b7c93640 1 -- 172.21.15.130:0/435300538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b00d1750 msgr2=0x7ff6b015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b7c93640 1 --2- 172.21.15.130:0/435300538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b00d1750 0x7ff6b015d960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0073cd0 tx=0x7ff6ac01c4d0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b7c93640 1 -- 172.21.15.130:0/435300538 shutdown_connections 2023-09-13T06:05:59.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b7c93640 1 --2- 172.21.15.130:0/435300538 >> v2:172.21.15.130:3300/0 conn(0x7ff6b00d1090 0x7ff6b0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b7c93640 1 --2- 172.21.15.130:0/435300538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b00d1750 0x7ff6b015d960 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b7c93640 1 -- 172.21.15.130:0/435300538 >> 172.21.15.130:0/435300538 conn(0x7ff6b006f170 msgr2=0x7ff6b006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:59.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b7c93640 1 -- 172.21.15.130:0/435300538 shutdown_connections 2023-09-13T06:05:59.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.545+0000 7ff6b7c93640 1 -- 172.21.15.130:0/435300538 wait complete. 2023-09-13T06:05:59.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b7c93640 1 Processor -- start 2023-09-13T06:05:59.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b7c93640 1 -- start start 2023-09-13T06:05:59.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b7c93640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b00d1090 0x7ff6b006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b7c93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b00d1750 0x7ff6b00b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b7c93640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b00d1b30 0x7ff6b00b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b7c93640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b006de50 con 0x7ff6b00d1750 2023-09-13T06:05:59.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b7c93640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b006e130 con 0x7ff6b00d1090 2023-09-13T06:05:59.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b7c93640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b006e410 con 0x7ff6b00d1b30 2023-09-13T06:05:59.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b5a2f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b00d1090 0x7ff6b006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b522e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b00d1750 0x7ff6b00b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b5a2f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b00d1090 0x7ff6b006d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:45096/0 (socket says 172.21.15.130:45096) 2023-09-13T06:05:59.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b5a2f640 1 -- 172.21.15.130:0/2343528174 learned_addr learned my addr 172.21.15.130:0/2343528174 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:59.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.549+0000 7ff6b6230640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b00d1b30 0x7ff6b00b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6b522e640 1 -- 172.21.15.130:0/2343528174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b00d1b30 msgr2=0x7ff6b00b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6b522e640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b00d1b30 0x7ff6b00b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6b522e640 1 -- 172.21.15.130:0/2343528174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b00d1090 msgr2=0x7ff6b006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6b522e640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b00d1090 0x7ff6b006d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6b522e640 1 -- 172.21.15.130:0/2343528174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0094d0 con 0x7ff6b00d1750 2023-09-13T06:05:59.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6b5a2f640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b00d1090 0x7ff6b006d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:05:59.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6b522e640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b00d1750 0x7ff6b00b59b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000e840 tx=0x7ff6a000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:59.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6a67fc640 1 -- 172.21.15.130:0/2343528174 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000c730 con 0x7ff6b00d1750 2023-09-13T06:05:59.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6a67fc640 1 -- 172.21.15.130:0/2343528174 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a000c890 con 0x7ff6b00d1750 2023-09-13T06:05:59.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6a67fc640 1 -- 172.21.15.130:0/2343528174 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000cc20 con 0x7ff6b00d1750 2023-09-13T06:05:59.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6b7c93640 1 -- 172.21.15.130:0/2343528174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b0137f70 con 0x7ff6b00d1750 2023-09-13T06:05:59.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6b7c93640 1 -- 172.21.15.130:0/2343528174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b006db40 con 0x7ff6b00d1750 2023-09-13T06:05:59.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.553+0000 7ff6b7c93640 1 -- 172.21.15.130:0/2343528174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b0138100 con 0x7ff6b00d1750 2023-09-13T06:05:59.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.557+0000 7ff6a67fc640 1 -- 172.21.15.130:0/2343528174 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff6a0013470 con 0x7ff6b00d1750 2023-09-13T06:05:59.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.557+0000 7ff6a67fc640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff694065b20 0x7ff694067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.557+0000 7ff6a67fc640 1 -- 172.21.15.130:0/2343528174 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6a0083350 con 0x7ff6b00d1750 2023-09-13T06:05:59.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.557+0000 7ff6b5a2f640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff694065b20 0x7ff694067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.557+0000 7ff6a67fc640 1 -- 172.21.15.130:0/2343528174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7ff69406d650 con 0x7ff6b00d1750 2023-09-13T06:05:59.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.561+0000 7ff6b5a2f640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff694065b20 0x7ff694067fe0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac01c510 tx=0x7ff6ac0b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:59.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.565+0000 7ff6a67fc640 1 -- 172.21.15.130:0/2343528174 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff6a0050cb0 con 0x7ff6b00d1750 2023-09-13T06:05:59.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.757+0000 7ff6b7c93640 1 -- 172.21.15.130:0/2343528174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6b00618a0 con 0x7ff6b00d1750 2023-09-13T06:05:59.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.757+0000 7ff6a67fc640 1 -- 172.21.15.130:0/2343528174 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16647 (secure 0 0 0) 0x7ff6a0021090 con 0x7ff6b00d1750 2023-09-13T06:05:59.759 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:05:59.760 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":87,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:05:47.420354+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:05:25.196040+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-09-13T06:05:25.825807+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:05:59.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.757+0000 7ff6b7c93640 1 -- 172.21.15.130:0/2343528174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff694065b20 msgr2=0x7ff694067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.761+0000 7ff6b7c93640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff694065b20 0x7ff694067fe0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac01c510 tx=0x7ff6ac0b5040 comp rx=0 tx=0).stop 2023-09-13T06:05:59.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.761+0000 7ff6b7c93640 1 -- 172.21.15.130:0/2343528174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b00d1750 msgr2=0x7ff6b00b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.761+0000 7ff6b7c93640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b00d1750 0x7ff6b00b59b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000e840 tx=0x7ff6a000ed00 comp rx=0 tx=0).stop 2023-09-13T06:05:59.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.761+0000 7ff6b7c93640 1 -- 172.21.15.130:0/2343528174 shutdown_connections 2023-09-13T06:05:59.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.761+0000 7ff6b7c93640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff694065b20 0x7ff694067fe0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.761+0000 7ff6b7c93640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6b00d1b30 0x7ff6b00b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.761+0000 7ff6b7c93640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b00d1750 0x7ff6b00b59b0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.761+0000 7ff6b7c93640 1 --2- 172.21.15.130:0/2343528174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6b00d1090 0x7ff6b006d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.761+0000 7ff6b7c93640 1 -- 172.21.15.130:0/2343528174 >> 172.21.15.130:0/2343528174 conn(0x7ff6b006f170 msgr2=0x7ff6b00b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:59.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.761+0000 7ff6b7c93640 1 -- 172.21.15.130:0/2343528174 shutdown_connections 2023-09-13T06:05:59.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.761+0000 7ff6b7c93640 1 -- 172.21.15.130:0/2343528174 wait complete. 2023-09-13T06:05:59.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:05:25.196040+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:05:25.825807+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:05:59.781 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:05:59.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca99e0b640 1 Processor -- start 2023-09-13T06:05:59.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca99e0b640 1 -- start start 2023-09-13T06:05:59.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca99e0b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fca940d2cd0 0x7fca941612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca99e0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca941617e0 0x7fca940cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca99e0b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9415dd40 con 0x7fca9415ae10 2023-09-13T06:05:59.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca99e0b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9415e020 con 0x7fca940d2cd0 2023-09-13T06:05:59.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca99e0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9415e300 con 0x7fca941617e0 2023-09-13T06:05:59.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca8bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fca940d2cd0 0x7fca941612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca8bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fca940d2cd0 0x7fca941612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45234/0 (socket says 172.21.15.130:45234) 2023-09-13T06:05:59.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca8bfff640 1 -- 172.21.15.130:0/4018041507 learned_addr learned my addr 172.21.15.130:0/4018041507 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:59.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca93fff640 1 --2- 172.21.15.130:0/4018041507 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca941617e0 0x7fca940cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca8bfff640 1 -- 172.21.15.130:0/4018041507 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca941617e0 msgr2=0x7fca940cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:05:59.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca8bfff640 1 --2- 172.21.15.130:0/4018041507 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca941617e0 0x7fca940cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca8bfff640 1 -- 172.21.15.130:0/4018041507 >> v1:172.21.15.164:6789/0 conn(0x7fca9415ae10 legacy=0x7fca940d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.921+0000 7fca8bfff640 1 -- 172.21.15.130:0/4018041507 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9415e5e0 con 0x7fca940d2cd0 2023-09-13T06:05:59.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca8bfff640 1 --2- 172.21.15.130:0/4018041507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca940d2cd0 0x7fca941612a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009870 tx=0x7fca7c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41901cbf325f560f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:59.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca92ffd640 1 -- 172.21.15.130:0/4018041507 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0aa430 con 0x7fca940d2cd0 2023-09-13T06:05:59.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca92ffd640 1 -- 172.21.15.130:0/4018041507 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c0aa590 con 0x7fca940d2cd0 2023-09-13T06:05:59.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca92ffd640 1 -- 172.21.15.130:0/4018041507 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0aa920 con 0x7fca940d2cd0 2023-09-13T06:05:59.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca99e0b640 1 -- 172.21.15.130:0/4018041507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca940d2cd0 msgr2=0x7fca941612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca99e0b640 1 --2- 172.21.15.130:0/4018041507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca940d2cd0 0x7fca941612a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009870 tx=0x7fca7c01c4b0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca99e0b640 1 -- 172.21.15.130:0/4018041507 shutdown_connections 2023-09-13T06:05:59.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca99e0b640 1 --2- 172.21.15.130:0/4018041507 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca941617e0 0x7fca940cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca99e0b640 1 --2- 172.21.15.130:0/4018041507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca940d2cd0 0x7fca941612a0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca99e0b640 1 -- 172.21.15.130:0/4018041507 >> 172.21.15.130:0/4018041507 conn(0x7fca94065990 msgr2=0x7fca94065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:05:59.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca99e0b640 1 -- 172.21.15.130:0/4018041507 shutdown_connections 2023-09-13T06:05:59.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.925+0000 7fca99e0b640 1 -- 172.21.15.130:0/4018041507 wait complete. 2023-09-13T06:05:59.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca99e0b640 1 Processor -- start 2023-09-13T06:05:59.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca99e0b640 1 -- start start 2023-09-13T06:05:59.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca99e0b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca940d2cd0 0x7fca941569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca99e0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9415ae10 0x7fca9415bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca99e0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca941617e0 0x7fca940d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca99e0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9415cae0 con 0x7fca9415ae10 2023-09-13T06:05:59.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca99e0b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca94155be0 con 0x7fca940d2cd0 2023-09-13T06:05:59.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca99e0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca94155ec0 con 0x7fca941617e0 2023-09-13T06:05:59.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca8bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9415ae10 0x7fca9415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca8bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9415ae10 0x7fca9415bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45242/0 (socket says 172.21.15.130:45242) 2023-09-13T06:05:59.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca8bfff640 1 -- 172.21.15.130:0/478751183 learned_addr learned my addr 172.21.15.130:0/478751183 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:05:59.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca93fff640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca941617e0 0x7fca940d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca937fe640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca940d2cd0 0x7fca941569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca8bfff640 1 -- 172.21.15.130:0/478751183 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca941617e0 msgr2=0x7fca940d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca8bfff640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca941617e0 0x7fca940d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca8bfff640 1 -- 172.21.15.130:0/478751183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca940d2cd0 msgr2=0x7fca941569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:05:59.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca8bfff640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca940d2cd0 0x7fca941569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:05:59.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca8bfff640 1 -- 172.21.15.130:0/478751183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0094d0 con 0x7fca9415ae10 2023-09-13T06:05:59.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca8bfff640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9415ae10 0x7fca9415bfe0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0ac040 tx=0x7fca7c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:59.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca90ff9640 1 -- 172.21.15.130:0/478751183 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0b3800 con 0x7fca9415ae10 2023-09-13T06:05:59.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca90ff9640 1 -- 172.21.15.130:0/478751183 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c0b3960 con 0x7fca9415ae10 2023-09-13T06:05:59.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca99e0b640 1 -- 172.21.15.130:0/478751183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca941561a0 con 0x7fca9415ae10 2023-09-13T06:05:59.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca90ff9640 1 -- 172.21.15.130:0/478751183 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0b3d10 con 0x7fca9415ae10 2023-09-13T06:05:59.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.929+0000 7fca99e0b640 1 -- 172.21.15.130:0/478751183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca94152890 con 0x7fca9415ae10 2023-09-13T06:05:59.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.933+0000 7fca99e0b640 1 -- 172.21.15.130:0/478751183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca940618a0 con 0x7fca9415ae10 2023-09-13T06:05:59.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.933+0000 7fca90ff9640 1 -- 172.21.15.130:0/478751183 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fca7c0b2380 con 0x7fca9415ae10 2023-09-13T06:05:59.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.933+0000 7fca90ff9640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca74065b20 0x7fca74067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:05:59.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.933+0000 7fca90ff9640 1 -- 172.21.15.130:0/478751183 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca7c11d950 con 0x7fca9415ae10 2023-09-13T06:05:59.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.933+0000 7fca937fe640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca74065b20 0x7fca74067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:05:59.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.933+0000 7fca90ff9640 1 -- 172.21.15.130:0/478751183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7fca7406d650 con 0x7fca9415ae10 2023-09-13T06:05:59.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.933+0000 7fca937fe640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca74065b20 0x7fca74067fe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca941f8e10 tx=0x7fca84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:05:59.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:05:59.937+0000 7fca90ff9640 1 -- 172.21.15.130:0/478751183 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fca7c0eb340 con 0x7fca9415ae10 2023-09-13T06:06:00.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.085+0000 7fca99e0b640 1 -- 172.21.15.130:0/478751183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca9415cc20 con 0x7fca9415ae10 2023-09-13T06:06:00.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca90ff9640 1 -- 172.21.15.130:0/478751183 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca7c0c3030 con 0x7fca9415ae10 2023-09-13T06:06:00.090 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:06:00.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 -- 172.21.15.130:0/478751183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca74065b20 msgr2=0x7fca74067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca74065b20 0x7fca74067fe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca941f8e10 tx=0x7fca84009040 comp rx=0 tx=0).stop 2023-09-13T06:06:00.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 -- 172.21.15.130:0/478751183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9415ae10 msgr2=0x7fca9415bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9415ae10 0x7fca9415bfe0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0ac040 tx=0x7fca7c01acf0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 -- 172.21.15.130:0/478751183 shutdown_connections 2023-09-13T06:06:00.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fca74065b20 0x7fca74067fe0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fca941617e0 0x7fca940d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9415ae10 0x7fca9415bfe0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 --2- 172.21.15.130:0/478751183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca940d2cd0 0x7fca941569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 -- 172.21.15.130:0/478751183 >> 172.21.15.130:0/478751183 conn(0x7fca94065990 msgr2=0x7fca94065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:00.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 -- 172.21.15.130:0/478751183 shutdown_connections 2023-09-13T06:06:00.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.089+0000 7fca99e0b640 1 -- 172.21.15.130:0/478751183 wait complete. 2023-09-13T06:06:00.111 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:06:00.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.249+0000 7faebd8f7640 1 Processor -- start 2023-09-13T06:06:00.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.249+0000 7faebd8f7640 1 -- start start 2023-09-13T06:06:00.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd8f7640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7faeb80b6e40 0x7faeb80b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd8f7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faeb80b4120 0x7faeb80b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd8f7640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80b3000 con 0x7faeb80b6a60 2023-09-13T06:06:00.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd8f7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80b4af0 con 0x7faeb80b4120 2023-09-13T06:06:00.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd8f7640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb8161c80 con 0x7faeb80b6e40 2023-09-13T06:06:00.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd0f6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faeb80b4120 0x7faeb80b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd0f6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faeb80b4120 0x7faeb80b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45252/0 (socket says 172.21.15.130:45252) 2023-09-13T06:06:00.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd0f6640 1 -- 172.21.15.130:0/3371297975 learned_addr learned my addr 172.21.15.130:0/3371297975 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:00.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faeaffff640 1 --2- 172.21.15.130:0/3371297975 >> v2:172.21.15.164:3300/0 conn(0x7faeb80b6e40 0x7faeb80b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd0f6640 1 -- 172.21.15.130:0/3371297975 >> v2:172.21.15.164:3300/0 conn(0x7faeb80b6e40 msgr2=0x7faeb80b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:00.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd0f6640 1 --2- 172.21.15.130:0/3371297975 >> v2:172.21.15.164:3300/0 conn(0x7faeb80b6e40 0x7faeb80b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd0f6640 1 -- 172.21.15.130:0/3371297975 >> v1:172.21.15.164:6789/0 conn(0x7faeb80b6a60 legacy=0x7faeb80b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faebd0f6640 1 -- 172.21.15.130:0/3371297975 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb8161100 con 0x7faeb80b4120 2023-09-13T06:06:00.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.253+0000 7faeaffff640 1 --2- 172.21.15.130:0/3371297975 >> v2:172.21.15.164:3300/0 conn(0x7faeb80b6e40 0x7faeb80b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:00.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd0f6640 1 --2- 172.21.15.130:0/3371297975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80b4120 0x7faeb80b45b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7faeb8066eb0 tx=0x7faeb001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212c33f0b55bba58 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:00.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faeaf7fe640 1 -- 172.21.15.130:0/3371297975 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00a5780 con 0x7faeb80b4120 2023-09-13T06:06:00.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faeaf7fe640 1 -- 172.21.15.130:0/3371297975 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb00a58e0 con 0x7faeb80b4120 2023-09-13T06:06:00.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faeaf7fe640 1 -- 172.21.15.130:0/3371297975 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00a5c70 con 0x7faeb80b4120 2023-09-13T06:06:00.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 -- 172.21.15.130:0/3371297975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80b4120 msgr2=0x7faeb80b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 --2- 172.21.15.130:0/3371297975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80b4120 0x7faeb80b45b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7faeb8066eb0 tx=0x7faeb001c9d0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 -- 172.21.15.130:0/3371297975 shutdown_connections 2023-09-13T06:06:00.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 --2- 172.21.15.130:0/3371297975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80b4120 0x7faeb80b45b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 --2- 172.21.15.130:0/3371297975 >> v2:172.21.15.164:3300/0 conn(0x7faeb80b6e40 0x7faeb80b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 -- 172.21.15.130:0/3371297975 >> 172.21.15.130:0/3371297975 conn(0x7faeb8065990 msgr2=0x7faeb8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:00.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 -- 172.21.15.130:0/3371297975 shutdown_connections 2023-09-13T06:06:00.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 -- 172.21.15.130:0/3371297975 wait complete. 2023-09-13T06:06:00.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 Processor -- start 2023-09-13T06:06:00.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 -- start start 2023-09-13T06:06:00.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80b4120 0x7faeb813c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faeb80b6a60 0x7faeb8071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faeb80b6e40 0x7faeb8071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80cd150 con 0x7faeb80b4120 2023-09-13T06:06:00.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81548f0 con 0x7faeb80b6e40 2023-09-13T06:06:00.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.257+0000 7faebd8f7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8154bd0 con 0x7faeb80b6a60 2023-09-13T06:06:00.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebc8f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80b4120 0x7faeb813c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebc8f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80b4120 0x7faeb813c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45266/0 (socket says 172.21.15.130:45266) 2023-09-13T06:06:00.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebc8f5640 1 -- 172.21.15.130:0/3420762750 learned_addr learned my addr 172.21.15.130:0/3420762750 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:00.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebd0f6640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faeb80b6e40 0x7faeb8071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faeaffff640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faeb80b6a60 0x7faeb8071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebc8f5640 1 -- 172.21.15.130:0/3420762750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faeb80b6a60 msgr2=0x7faeb8071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebc8f5640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faeb80b6a60 0x7faeb8071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebc8f5640 1 -- 172.21.15.130:0/3420762750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faeb80b6e40 msgr2=0x7faeb8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebc8f5640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faeb80b6e40 0x7faeb8071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebc8f5640 1 -- 172.21.15.130:0/3420762750 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb0009b30 con 0x7faeb80b4120 2023-09-13T06:06:00.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebc8f5640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80b4120 0x7faeb813c1a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c3c0 tx=0x7faeb400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:00.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faead7fa640 1 -- 172.21.15.130:0/3420762750 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40052d0 con 0x7faeb80b4120 2023-09-13T06:06:00.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faead7fa640 1 -- 172.21.15.130:0/3420762750 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4005430 con 0x7faeb80b4120 2023-09-13T06:06:00.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faead7fa640 1 -- 172.21.15.130:0/3420762750 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4003840 con 0x7faeb80b4120 2023-09-13T06:06:00.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebd8f7640 1 -- 172.21.15.130:0/3420762750 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb8154eb0 con 0x7faeb80b4120 2023-09-13T06:06:00.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebd8f7640 1 -- 172.21.15.130:0/3420762750 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb8155470 con 0x7faeb80b4120 2023-09-13T06:06:00.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faebd8f7640 1 -- 172.21.15.130:0/3420762750 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb80618a0 con 0x7faeb80b4120 2023-09-13T06:06:00.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.261+0000 7faead7fa640 1 -- 172.21.15.130:0/3420762750 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7faeb40039a0 con 0x7faeb80b4120 2023-09-13T06:06:00.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.265+0000 7faead7fa640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faea4065b20 0x7faea4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.265+0000 7faead7fa640 1 -- 172.21.15.130:0/3420762750 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faeb4082580 con 0x7faeb80b4120 2023-09-13T06:06:00.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.265+0000 7faeaffff640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faea4065b20 0x7faea4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.265+0000 7faead7fa640 1 -- 172.21.15.130:0/3420762750 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7faea406d650 con 0x7faeb80b4120 2023-09-13T06:06:00.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.265+0000 7faeaffff640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faea4065b20 0x7faea4067fe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faeb8168440 tx=0x7faea8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:00.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.269+0000 7faead7fa640 1 -- 172.21.15.130:0/3420762750 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7faeb4050010 con 0x7faeb80b4120 2023-09-13T06:06:00.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.417+0000 7faebd8f7640 1 -- 172.21.15.130:0/3420762750 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faeb80b3000 con 0x7faeb80b4120 2023-09-13T06:06:00.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.417+0000 7faead7fa640 1 -- 172.21.15.130:0/3420762750 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7faeb80b3000 con 0x7faeb80b4120 2023-09-13T06:06:00.419 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:06:00.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.417+0000 7faebd8f7640 1 -- 172.21.15.130:0/3420762750 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faea4065b20 msgr2=0x7faea4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.417+0000 7faebd8f7640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faea4065b20 0x7faea4067fe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faeb8168440 tx=0x7faea8008040 comp rx=0 tx=0).stop 2023-09-13T06:06:00.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.417+0000 7faebd8f7640 1 -- 172.21.15.130:0/3420762750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80b4120 msgr2=0x7faeb813c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.417+0000 7faebd8f7640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80b4120 0x7faeb813c1a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c3c0 tx=0x7faeb400c880 comp rx=0 tx=0).stop 2023-09-13T06:06:00.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.421+0000 7faebd8f7640 1 -- 172.21.15.130:0/3420762750 shutdown_connections 2023-09-13T06:06:00.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.421+0000 7faebd8f7640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faea4065b20 0x7faea4067fe0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.421+0000 7faebd8f7640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faeb80b6e40 0x7faeb8071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.421+0000 7faebd8f7640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faeb80b6a60 0x7faeb8071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.421+0000 7faebd8f7640 1 --2- 172.21.15.130:0/3420762750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80b4120 0x7faeb813c1a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.421+0000 7faebd8f7640 1 -- 172.21.15.130:0/3420762750 >> 172.21.15.130:0/3420762750 conn(0x7faeb8065990 msgr2=0x7faeb80b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:00.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.421+0000 7faebd8f7640 1 -- 172.21.15.130:0/3420762750 shutdown_connections 2023-09-13T06:06:00.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.421+0000 7faebd8f7640 1 -- 172.21.15.130:0/3420762750 wait complete. 2023-09-13T06:06:00.440 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:06:00.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.577+0000 7fa767fdb640 1 Processor -- start 2023-09-13T06:06:00.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa767fdb640 1 -- start start 2023-09-13T06:06:00.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa767fdb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa760157750 0x7fa760160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa767fdb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa760157b30 0x7fa76006dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa767fdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76006f170 0x7fa76006f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa767fdb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7600ae0d0 con 0x7fa760157750 2023-09-13T06:06:00.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa767fdb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa760161e60 con 0x7fa760157b30 2023-09-13T06:06:00.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa767fdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7601615c0 con 0x7fa76006f170 2023-09-13T06:06:00.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa765d77640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa760157750 0x7fa760160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa765d77640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa760157750 0x7fa760160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45272/0 (socket says 172.21.15.130:45272) 2023-09-13T06:06:00.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa765d77640 1 -- 172.21.15.130:0/3606153935 learned_addr learned my addr 172.21.15.130:0/3606153935 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:00.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa765d77640 1 -- 172.21.15.130:0/3606153935 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76006f170 msgr2=0x7fa76006f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:00.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa766578640 1 --2- 172.21.15.130:0/3606153935 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76006f170 0x7fa76006f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa765576640 1 --2- 172.21.15.130:0/3606153935 >> v2:172.21.15.164:3300/0 conn(0x7fa760157b30 0x7fa76006dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa765d77640 1 --2- 172.21.15.130:0/3606153935 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76006f170 0x7fa76006f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa765d77640 1 -- 172.21.15.130:0/3606153935 >> v2:172.21.15.164:3300/0 conn(0x7fa760157b30 msgr2=0x7fa76006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:00.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa765d77640 1 --2- 172.21.15.130:0/3606153935 >> v2:172.21.15.164:3300/0 conn(0x7fa760157b30 0x7fa76006dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa765d77640 1 -- 172.21.15.130:0/3606153935 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7601618a0 con 0x7fa760157750 2023-09-13T06:06:00.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa766578640 1 --2- 172.21.15.130:0/3606153935 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76006f170 0x7fa76006f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:00.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.581+0000 7fa765576640 1 --2- 172.21.15.130:0/3606153935 >> v2:172.21.15.164:3300/0 conn(0x7fa760157b30 0x7fa76006dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:00.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa765d77640 1 --2- 172.21.15.130:0/3606153935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760157750 0x7fa760160fe0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa7600b3080 tx=0x7fa75c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1f8ff265cb84d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:00.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa764d75640 1 -- 172.21.15.130:0/3606153935 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0aa5f0 con 0x7fa760157750 2023-09-13T06:06:00.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa764d75640 1 -- 172.21.15.130:0/3606153935 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0aa750 con 0x7fa760157750 2023-09-13T06:06:00.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa764d75640 1 -- 172.21.15.130:0/3606153935 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0aaae0 con 0x7fa760157750 2023-09-13T06:06:00.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa767fdb640 1 -- 172.21.15.130:0/3606153935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760157750 msgr2=0x7fa760160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa767fdb640 1 --2- 172.21.15.130:0/3606153935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760157750 0x7fa760160fe0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa7600b3080 tx=0x7fa75c01c4d0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa767fdb640 1 -- 172.21.15.130:0/3606153935 shutdown_connections 2023-09-13T06:06:00.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa767fdb640 1 --2- 172.21.15.130:0/3606153935 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76006f170 0x7fa76006f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa767fdb640 1 --2- 172.21.15.130:0/3606153935 >> v2:172.21.15.164:3300/0 conn(0x7fa760157b30 0x7fa76006dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa767fdb640 1 --2- 172.21.15.130:0/3606153935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760157750 0x7fa760160fe0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa767fdb640 1 -- 172.21.15.130:0/3606153935 >> 172.21.15.130:0/3606153935 conn(0x7fa760065d60 msgr2=0x7fa7600b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:00.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa767fdb640 1 -- 172.21.15.130:0/3606153935 shutdown_connections 2023-09-13T06:06:00.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa767fdb640 1 -- 172.21.15.130:0/3606153935 wait complete. 2023-09-13T06:06:00.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa767fdb640 1 Processor -- start 2023-09-13T06:06:00.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.585+0000 7fa767fdb640 1 -- start start 2023-09-13T06:06:00.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa767fdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76006f170 0x7fa76014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa767fdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760157750 0x7fa7601553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa767fdb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa760157b30 0x7fa76015fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa767fdb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76014f430 con 0x7fa760157750 2023-09-13T06:06:00.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa767fdb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76014e7b0 con 0x7fa760157b30 2023-09-13T06:06:00.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa767fdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76014ea90 con 0x7fa76006f170 2023-09-13T06:06:00.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa765576640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760157750 0x7fa7601553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa765576640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760157750 0x7fa7601553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45278/0 (socket says 172.21.15.130:45278) 2023-09-13T06:06:00.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa765576640 1 -- 172.21.15.130:0/3449894000 learned_addr learned my addr 172.21.15.130:0/3449894000 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:00.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa765d77640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76006f170 0x7fa76014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa766578640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa760157b30 0x7fa76015fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa765576640 1 -- 172.21.15.130:0/3449894000 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76006f170 msgr2=0x7fa76014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa765576640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76006f170 0x7fa76014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa765576640 1 -- 172.21.15.130:0/3449894000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa760157b30 msgr2=0x7fa76015fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa765576640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa760157b30 0x7fa76015fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa765576640 1 -- 172.21.15.130:0/3449894000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c0094d0 con 0x7fa760157750 2023-09-13T06:06:00.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa765576640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760157750 0x7fa7601553d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa75000c7f0 tx=0x7fa75000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:00.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa7567fc640 1 -- 172.21.15.130:0/3449894000 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750007820 con 0x7fa760157750 2023-09-13T06:06:00.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa7567fc640 1 -- 172.21.15.130:0/3449894000 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa750007980 con 0x7fa760157750 2023-09-13T06:06:00.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa7567fc640 1 -- 172.21.15.130:0/3449894000 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750007d30 con 0x7fa760157750 2023-09-13T06:06:00.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa767fdb640 1 -- 172.21.15.130:0/3449894000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76014ed70 con 0x7fa760157750 2023-09-13T06:06:00.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa767fdb640 1 -- 172.21.15.130:0/3449894000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76014e4a0 con 0x7fa760157750 2023-09-13T06:06:00.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa767fdb640 1 -- 172.21.15.130:0/3449894000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7600618a0 con 0x7fa760157750 2023-09-13T06:06:00.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.589+0000 7fa7567fc640 1 -- 172.21.15.130:0/3449894000 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa7500113f0 con 0x7fa760157750 2023-09-13T06:06:00.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.593+0000 7fa7567fc640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa744065b50 0x7fa744068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.593+0000 7fa7567fc640 1 -- 172.21.15.130:0/3449894000 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa750083350 con 0x7fa760157750 2023-09-13T06:06:00.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.593+0000 7fa765d77640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa744065b50 0x7fa744068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.593+0000 7fa7567fc640 1 -- 172.21.15.130:0/3449894000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7fa74406d680 con 0x7fa760157750 2023-09-13T06:06:00.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.593+0000 7fa765d77640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa744065b50 0x7fa744068010 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0ae000 tx=0x7fa75c0b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:00.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.597+0000 7fa7567fc640 1 -- 172.21.15.130:0/3449894000 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa750050d40 con 0x7fa760157750 2023-09-13T06:06:00.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.741+0000 7fa767fdb640 1 -- 172.21.15.130:0/3449894000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7600733f0 con 0x7fa760157750 2023-09-13T06:06:00.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.741+0000 7fa7567fc640 1 -- 172.21.15.130:0/3449894000 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa75001f020 con 0x7fa760157750 2023-09-13T06:06:00.745 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:06:00.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 -- 172.21.15.130:0/3449894000 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa744065b50 msgr2=0x7fa744068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa744065b50 0x7fa744068010 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0ae000 tx=0x7fa75c0b5040 comp rx=0 tx=0).stop 2023-09-13T06:06:00.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 -- 172.21.15.130:0/3449894000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760157750 msgr2=0x7fa7601553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760157750 0x7fa7601553d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa75000c7f0 tx=0x7fa75000ccb0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 -- 172.21.15.130:0/3449894000 shutdown_connections 2023-09-13T06:06:00.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa744065b50 0x7fa744068010 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa760157b30 0x7fa76015fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760157750 0x7fa7601553d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 --2- 172.21.15.130:0/3449894000 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa76006f170 0x7fa76014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 -- 172.21.15.130:0/3449894000 >> 172.21.15.130:0/3449894000 conn(0x7fa760065d60 msgr2=0x7fa760070730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:00.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 -- 172.21.15.130:0/3449894000 shutdown_connections 2023-09-13T06:06:00.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.745+0000 7fa767fdb640 1 -- 172.21.15.130:0/3449894000 wait complete. 2023-09-13T06:06:00.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:06:00.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.901+0000 7effc52d8640 1 Processor -- start 2023-09-13T06:06:00.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.901+0000 7effc52d8640 1 -- start start 2023-09-13T06:06:00.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effc52d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7effc015d5f0 0x7effc00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effc52d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7effc00ae170 0x7effc00cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effc52d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc00cce60 con 0x7effc015d9d0 2023-09-13T06:06:00.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effc52d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc00cd140 con 0x7effc00ae170 2023-09-13T06:06:00.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effc52d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc00cd420 con 0x7effc015d5f0 2023-09-13T06:06:00.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effb67fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7effc00ae170 0x7effc00cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effb67fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7effc00ae170 0x7effc00cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54278/0 (socket says 172.21.15.130:54278) 2023-09-13T06:06:00.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effbeffd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7effc015d5f0 0x7effc00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effb67fc640 1 -- 172.21.15.130:0/3925117559 learned_addr learned my addr 172.21.15.130:0/3925117559 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:00.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effb67fc640 1 -- 172.21.15.130:0/3925117559 >> v2:172.21.15.164:3300/0 conn(0x7effc015d5f0 msgr2=0x7effc00cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:00.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effb67fc640 1 --2- 172.21.15.130:0/3925117559 >> v2:172.21.15.164:3300/0 conn(0x7effc015d5f0 0x7effc00cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effb67fc640 1 -- 172.21.15.130:0/3925117559 >> v1:172.21.15.164:6789/0 conn(0x7effc015d9d0 legacy=0x7effc01591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.905+0000 7effb67fc640 1 -- 172.21.15.130:0/3925117559 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00cd700 con 0x7effc00ae170 2023-09-13T06:06:00.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effb67fc640 1 --2- 172.21.15.130:0/3925117559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effc00ae170 0x7effc00cb040 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7effc00b2910 tx=0x7effa801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3c6b04d23cdcea server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:00.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effbe7fc640 1 -- 172.21.15.130:0/3925117559 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa80ab600 con 0x7effc00ae170 2023-09-13T06:06:00.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effbe7fc640 1 -- 172.21.15.130:0/3925117559 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa80a7050 con 0x7effc00ae170 2023-09-13T06:06:00.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effbe7fc640 1 -- 172.21.15.130:0/3925117559 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa80ab980 con 0x7effc00ae170 2023-09-13T06:06:00.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effc52d8640 1 -- 172.21.15.130:0/3925117559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effc00ae170 msgr2=0x7effc00cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effc52d8640 1 --2- 172.21.15.130:0/3925117559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effc00ae170 0x7effc00cb040 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7effc00b2910 tx=0x7effa801c470 comp rx=0 tx=0).stop 2023-09-13T06:06:00.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effc52d8640 1 -- 172.21.15.130:0/3925117559 shutdown_connections 2023-09-13T06:06:00.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effc52d8640 1 --2- 172.21.15.130:0/3925117559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effc00ae170 0x7effc00cb040 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effc52d8640 1 --2- 172.21.15.130:0/3925117559 >> v2:172.21.15.164:3300/0 conn(0x7effc015d5f0 0x7effc00cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effc52d8640 1 -- 172.21.15.130:0/3925117559 >> 172.21.15.130:0/3925117559 conn(0x7effc0065990 msgr2=0x7effc0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:00.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effc52d8640 1 -- 172.21.15.130:0/3925117559 shutdown_connections 2023-09-13T06:06:00.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effc52d8640 1 -- 172.21.15.130:0/3925117559 wait complete. 2023-09-13T06:06:00.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effc52d8640 1 Processor -- start 2023-09-13T06:06:00.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effc52d8640 1 -- start start 2023-09-13T06:06:00.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.909+0000 7effc52d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effc00ae170 0x7effc015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effc52d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effc015d5f0 0x7effc006c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effc52d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effc015d9d0 0x7effc013eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effc52d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc015b430 con 0x7effc00ae170 2023-09-13T06:06:00.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effc52d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc006cb80 con 0x7effc015d9d0 2023-09-13T06:06:00.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effc52d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc013f380 con 0x7effc015d5f0 2023-09-13T06:06:00.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effbeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effc00ae170 0x7effc015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effbeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effc00ae170 0x7effc015a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54288/0 (socket says 172.21.15.130:54288) 2023-09-13T06:06:00.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effbeffd640 1 -- 172.21.15.130:0/1046892932 learned_addr learned my addr 172.21.15.130:0/1046892932 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effbf7fe640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effc015d9d0 0x7effc013eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effb67fc640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effc015d5f0 0x7effc006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effbeffd640 1 -- 172.21.15.130:0/1046892932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effc015d5f0 msgr2=0x7effc006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effbeffd640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effc015d5f0 0x7effc006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effbeffd640 1 -- 172.21.15.130:0/1046892932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effc015d9d0 msgr2=0x7effc013eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effbeffd640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effc015d9d0 0x7effc013eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:00.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effbeffd640 1 -- 172.21.15.130:0/1046892932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80094d0 con 0x7effc00ae170 2023-09-13T06:06:00.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effb67fc640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effc015d5f0 0x7effc006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:00.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effbeffd640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effc00ae170 0x7effc015a820 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7effb000e910 tx=0x7effb000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:00.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effb7fff640 1 -- 172.21.15.130:0/1046892932 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb000a7b0 con 0x7effc00ae170 2023-09-13T06:06:00.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effb7fff640 1 -- 172.21.15.130:0/1046892932 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb000cbe0 con 0x7effc00ae170 2023-09-13T06:06:00.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effc52d8640 1 -- 172.21.15.130:0/1046892932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc013f940 con 0x7effc00ae170 2023-09-13T06:06:00.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effb7fff640 1 -- 172.21.15.130:0/1046892932 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00113f0 con 0x7effc00ae170 2023-09-13T06:06:00.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effc52d8640 1 -- 172.21.15.130:0/1046892932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc015b150 con 0x7effc00ae170 2023-09-13T06:06:00.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effc52d8640 1 -- 172.21.15.130:0/1046892932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc00b0780 con 0x7effc00ae170 2023-09-13T06:06:00.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.913+0000 7effb7fff640 1 -- 172.21.15.130:0/1046892932 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7effb0011550 con 0x7effc00ae170 2023-09-13T06:06:00.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.917+0000 7effb7fff640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7effa0065b50 0x7effa0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:00.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.917+0000 7effb7fff640 1 -- 172.21.15.130:0/1046892932 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effb0083400 con 0x7effc00ae170 2023-09-13T06:06:00.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.917+0000 7effb67fc640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7effa0065b50 0x7effa0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:00.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.917+0000 7effb7fff640 1 -- 172.21.15.130:0/1046892932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7effa006d680 con 0x7effc00ae170 2023-09-13T06:06:00.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.917+0000 7effb67fc640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7effa0065b50 0x7effa0068010 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7effa80ad000 tx=0x7effa80a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:00.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:00.917+0000 7effb7fff640 1 -- 172.21.15.130:0/1046892932 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7effb0016060 con 0x7effc00ae170 2023-09-13T06:06:01.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.077+0000 7effc52d8640 1 -- 172.21.15.130:0/1046892932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7effc00618a0 con 0x7effc00ae170 2023-09-13T06:06:01.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.077+0000 7effb7fff640 1 -- 172.21.15.130:0/1046892932 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) v1 ==== 80+0+0 (secure 0 0 0) 0x7effb0016020 con 0x7effc00ae170 2023-09-13T06:06:01.080 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:06:01.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 -- 172.21.15.130:0/1046892932 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7effa0065b50 msgr2=0x7effa0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7effa0065b50 0x7effa0068010 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7effa80ad000 tx=0x7effa80a4f90 comp rx=0 tx=0).stop 2023-09-13T06:06:01.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 -- 172.21.15.130:0/1046892932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effc00ae170 msgr2=0x7effc015a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effc00ae170 0x7effc015a820 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7effb000e910 tx=0x7effb000ed10 comp rx=0 tx=0).stop 2023-09-13T06:06:01.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 -- 172.21.15.130:0/1046892932 shutdown_connections 2023-09-13T06:06:01.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7effa0065b50 0x7effa0068010 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effc015d9d0 0x7effc013eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effc015d5f0 0x7effc006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 --2- 172.21.15.130:0/1046892932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effc00ae170 0x7effc015a820 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 -- 172.21.15.130:0/1046892932 >> 172.21.15.130:0/1046892932 conn(0x7effc0065990 msgr2=0x7effc0152ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:01.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 -- 172.21.15.130:0/1046892932 shutdown_connections 2023-09-13T06:06:01.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.081+0000 7effc52d8640 1 -- 172.21.15.130:0/1046892932 wait complete. 2023-09-13T06:06:01.100 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T06:06:01.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:01.101 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-13T06:06:01.154 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:06:01.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:01.155 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T06:06:01.165 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:01.165 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:01.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:06:01.175 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:06:01.176 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:01.214 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:06:01.215 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:01.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e2c782640 1 Processor -- start 2023-09-13T06:06:01.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e2c782640 1 -- start start 2023-09-13T06:06:01.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e2c782640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8e240d1750 0x7f8e2415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e2c782640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8e240d1090 0x7f8e24146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e2c782640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e240d1b30 0x7f8e24146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e2c782640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2415dea0 con 0x7f8e240d1090 2023-09-13T06:06:01.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e2c782640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e240b63c0 con 0x7f8e240d1750 2023-09-13T06:06:01.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e2c782640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240d0c20 con 0x7f8e240d1b30 2023-09-13T06:06:01.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e29d1d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8e240d1090 0x7f8e24146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e29d1d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8e240d1090 0x7f8e24146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54296/0 (socket says 172.21.15.130:54296) 2023-09-13T06:06:01.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e29d1d640 1 -- 172.21.15.130:0/992482861 learned_addr learned my addr 172.21.15.130:0/992482861 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:01.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e2a51e640 1 --2- 172.21.15.130:0/992482861 >> v2:172.21.15.164:3300/0 conn(0x7f8e240d1750 0x7f8e2415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e2ad1f640 1 --2- 172.21.15.130:0/992482861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e240d1b30 0x7f8e24146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e29d1d640 1 -- 172.21.15.130:0/992482861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e240d1b30 msgr2=0x7f8e24146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:01.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e29d1d640 1 --2- 172.21.15.130:0/992482861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e240d1b30 0x7f8e24146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e29d1d640 1 -- 172.21.15.130:0/992482861 >> v2:172.21.15.164:3300/0 conn(0x7f8e240d1750 msgr2=0x7f8e2415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:01.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e29d1d640 1 --2- 172.21.15.130:0/992482861 >> v2:172.21.15.164:3300/0 conn(0x7f8e240d1750 0x7f8e2415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.353+0000 7f8e29d1d640 1 -- 172.21.15.130:0/992482861 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240b6610 con 0x7f8e240d1090 2023-09-13T06:06:01.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e29d1d640 1 --2- 172.21.15.130:0/992482861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e240d1090 0x7f8e24146820 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8e24073cd0 tx=0x7f8e1401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3b3d3f37794fac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:01.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2951c640 1 -- 172.21.15.130:0/992482861 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140aa5f0 con 0x7f8e240d1090 2023-09-13T06:06:01.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2951c640 1 -- 172.21.15.130:0/992482861 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e140aa750 con 0x7f8e240d1090 2023-09-13T06:06:01.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2951c640 1 -- 172.21.15.130:0/992482861 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140aaae0 con 0x7f8e240d1090 2023-09-13T06:06:01.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2c782640 1 -- 172.21.15.130:0/992482861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e240d1090 msgr2=0x7f8e24146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2c782640 1 --2- 172.21.15.130:0/992482861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e240d1090 0x7f8e24146820 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8e24073cd0 tx=0x7f8e1401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2c782640 1 -- 172.21.15.130:0/992482861 shutdown_connections 2023-09-13T06:06:01.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2c782640 1 --2- 172.21.15.130:0/992482861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e240d1b30 0x7f8e24146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2c782640 1 --2- 172.21.15.130:0/992482861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e240d1090 0x7f8e24146820 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2c782640 1 --2- 172.21.15.130:0/992482861 >> v2:172.21.15.164:3300/0 conn(0x7f8e240d1750 0x7f8e2415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2c782640 1 -- 172.21.15.130:0/992482861 >> 172.21.15.130:0/992482861 conn(0x7f8e2406f170 msgr2=0x7f8e2406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:01.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2c782640 1 -- 172.21.15.130:0/992482861 shutdown_connections 2023-09-13T06:06:01.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.357+0000 7f8e2c782640 1 -- 172.21.15.130:0/992482861 wait complete. 2023-09-13T06:06:01.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2c782640 1 Processor -- start 2023-09-13T06:06:01.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2c782640 1 -- start start 2023-09-13T06:06:01.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2c782640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e240d1090 0x7f8e24141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2c782640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e240d1750 0x7f8e2415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2c782640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e240d1b30 0x7f8e240cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2c782640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24141960 con 0x7f8e240d1b30 2023-09-13T06:06:01.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2c782640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240ca210 con 0x7f8e240d1090 2023-09-13T06:06:01.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2c782640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240ce020 con 0x7f8e240d1750 2023-09-13T06:06:01.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2ad1f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e240d1b30 0x7f8e240cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2a51e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e240d1090 0x7f8e24141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2ad1f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e240d1b30 0x7f8e240cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54310/0 (socket says 172.21.15.130:54310) 2023-09-13T06:06:01.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2ad1f640 1 -- 172.21.15.130:0/1367035595 learned_addr learned my addr 172.21.15.130:0/1367035595 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:01.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e29d1d640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e240d1750 0x7f8e2415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2ad1f640 1 -- 172.21.15.130:0/1367035595 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e240d1750 msgr2=0x7f8e2415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2ad1f640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e240d1750 0x7f8e2415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2ad1f640 1 -- 172.21.15.130:0/1367035595 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e240d1090 msgr2=0x7f8e24141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2ad1f640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e240d1090 0x7f8e24141ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2ad1f640 1 -- 172.21.15.130:0/1367035595 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e140094d0 con 0x7f8e240d1b30 2023-09-13T06:06:01.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2ad1f640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e240d1b30 0x7f8e240cd310 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c007e90 tx=0x7f8e1c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:01.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e1affd640 1 -- 172.21.15.130:0/1367035595 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c014420 con 0x7f8e240d1b30 2023-09-13T06:06:01.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e1affd640 1 -- 172.21.15.130:0/1367035595 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c014580 con 0x7f8e240d1b30 2023-09-13T06:06:01.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e1affd640 1 -- 172.21.15.130:0/1367035595 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c014930 con 0x7f8e240d1b30 2023-09-13T06:06:01.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2c782640 1 -- 172.21.15.130:0/1367035595 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e240ca460 con 0x7f8e240d1b30 2023-09-13T06:06:01.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2c782640 1 -- 172.21.15.130:0/1367035595 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e240caa20 con 0x7f8e240d1b30 2023-09-13T06:06:01.369 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:06:01.361+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-09-13T06:06:01.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.361+0000 7f8e2c782640 1 -- 172.21.15.130:0/1367035595 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e240618a0 con 0x7f8e240d1b30 2023-09-13T06:06:01.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.365+0000 7f8e1affd640 1 -- 172.21.15.130:0/1367035595 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8e1c014a90 con 0x7f8e240d1b30 2023-09-13T06:06:01.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.365+0000 7f8e1affd640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e08065b50 0x7f8e08068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.365+0000 7f8e1affd640 1 -- 172.21.15.130:0/1367035595 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e1c084890 con 0x7f8e240d1b30 2023-09-13T06:06:01.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.365+0000 7f8e2a51e640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e08065b50 0x7f8e08068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.365+0000 7f8e1affd640 1 -- 172.21.15.130:0/1367035595 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7f8e0806d680 con 0x7f8e240d1b30 2023-09-13T06:06:01.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.365+0000 7f8e2a51e640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e08065b50 0x7f8e08068010 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8e200045f0 tx=0x7f8e20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:01.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.369+0000 7f8e1affd640 1 -- 172.21.15.130:0/1367035595 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8e1c052300 con 0x7f8e240d1b30 2023-09-13T06:06:01.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.373+0000 7f8e1affd640 1 -- 172.21.15.130:0/1367035595 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(88..88 src has 1..88) v4 ==== 296+0+0 (secure 0 0 0) 0x7f8e1c055fc0 con 0x7f8e240d1b30 2023-09-13T06:06:01.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.373+0000 7f8e1affd640 1 -- 172.21.15.130:0/1367035595 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f8e0806def0 con 0x7f8e240d1b30 2023-09-13T06:06:01.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.549+0000 7f8e2c782640 1 -- 172.21.15.130:0/1367035595 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e240b86c0 con 0x7f8e240d1b30 2023-09-13T06:06:01.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.549+0000 7f8e1affd640 1 -- 172.21.15.130:0/1367035595 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f8e1c055920 con 0x7f8e240d1b30 2023-09-13T06:06:01.553 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:01.553 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2267621007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2267621007},{"type":"v1","addr":"172.21.15.164:6834","nonce":2267621007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5663,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/658594571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":658594571},{"type":"v1","addr":"172.21.15.164:6835","nonce":658594571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6474,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1441650800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1441650800},{"type":"v1","addr":"172.21.15.130:6836","nonce":1441650800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:05:26.837419+0000","modified":"2023-09-13T06:05:29.861380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6477},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6477":{"gid":6477,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/428674793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":428674793},{"type":"v1","addr":"172.21.15.130:6837","nonce":428674793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-09-13T06:06:01.555 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 43 2023-09-13T06:06:01.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 -- 172.21.15.130:0/1367035595 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e08065b50 msgr2=0x7f8e08068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e08065b50 0x7f8e08068010 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8e200045f0 tx=0x7f8e20008040 comp rx=0 tx=0).stop 2023-09-13T06:06:01.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 -- 172.21.15.130:0/1367035595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e240d1b30 msgr2=0x7f8e240cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e240d1b30 0x7f8e240cd310 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c007e90 tx=0x7f8e1c00e4b0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 -- 172.21.15.130:0/1367035595 shutdown_connections 2023-09-13T06:06:01.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e08065b50 0x7f8e08068010 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e240d1b30 0x7f8e240cd310 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e240d1750 0x7f8e2415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 --2- 172.21.15.130:0/1367035595 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e240d1090 0x7f8e24141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 -- 172.21.15.130:0/1367035595 >> 172.21.15.130:0/1367035595 conn(0x7f8e2406f170 msgr2=0x7f8e241465f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:01.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 -- 172.21.15.130:0/1367035595 shutdown_connections 2023-09-13T06:06:01.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.553+0000 7f8e2c782640 1 -- 172.21.15.130:0/1367035595 wait complete. 2023-09-13T06:06:01.574 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:01.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.709+0000 7fe40a711640 1 Processor -- start 2023-09-13T06:06:01.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe40a711640 1 -- start start 2023-09-13T06:06:01.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe40a711640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe4040b1d20 0x7fe4040ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe40a711640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe4040cdfc0 0x7fe4040b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe40a711640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4040ccfd0 con 0x7fe404159f20 2023-09-13T06:06:01.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe40a711640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4040ce430 con 0x7fe4040cdfc0 2023-09-13T06:06:01.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe40a711640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4040b00f0 con 0x7fe4040b1d20 2023-09-13T06:06:01.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe408cae640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe4040cdfc0 0x7fe4040b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe403fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe404159f20 0x7fe4040b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:44234/0 (socket says 172.21.15.130:44234) 2023-09-13T06:06:01.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe403fff640 1 -- 172.21.15.130:0/84817379 learned_addr learned my addr 172.21.15.130:0/84817379 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:01.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe4037fe640 1 --2- 172.21.15.130:0/84817379 >> v2:172.21.15.164:3300/0 conn(0x7fe4040b1d20 0x7fe4040ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe408cae640 1 -- 172.21.15.130:0/84817379 >> v2:172.21.15.164:3300/0 conn(0x7fe4040b1d20 msgr2=0x7fe4040ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:01.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe408cae640 1 --2- 172.21.15.130:0/84817379 >> v2:172.21.15.164:3300/0 conn(0x7fe4040b1d20 0x7fe4040ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe408cae640 1 -- 172.21.15.130:0/84817379 >> v1:172.21.15.130:6789/0 conn(0x7fe404159f20 legacy=0x7fe4040b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe408cae640 1 -- 172.21.15.130:0/84817379 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4040ced90 con 0x7fe4040cdfc0 2023-09-13T06:06:01.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.713+0000 7fe4037fe640 1 --2- 172.21.15.130:0/84817379 >> v2:172.21.15.164:3300/0 conn(0x7fe4040b1d20 0x7fe4040ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:01.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe408cae640 1 --2- 172.21.15.130:0/84817379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4040cdfc0 0x7fe4040b0c90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc009d90 tx=0x7fe3fc01ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18711fcef3fa798f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:01.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe402ffd640 1 -- 172.21.15.130:0/84817379 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0a7b30 con 0x7fe4040cdfc0 2023-09-13T06:06:01.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe402ffd640 1 -- 172.21.15.130:0/84817379 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc0a7c90 con 0x7fe4040cdfc0 2023-09-13T06:06:01.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe402ffd640 1 -- 172.21.15.130:0/84817379 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0af440 con 0x7fe4040cdfc0 2023-09-13T06:06:01.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe40a711640 1 -- 172.21.15.130:0/84817379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4040cdfc0 msgr2=0x7fe4040b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe40a711640 1 --2- 172.21.15.130:0/84817379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4040cdfc0 0x7fe4040b0c90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc009d90 tx=0x7fe3fc01ea60 comp rx=0 tx=0).stop 2023-09-13T06:06:01.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe40a711640 1 -- 172.21.15.130:0/84817379 shutdown_connections 2023-09-13T06:06:01.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe40a711640 1 --2- 172.21.15.130:0/84817379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4040cdfc0 0x7fe4040b0c90 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe40a711640 1 --2- 172.21.15.130:0/84817379 >> v2:172.21.15.164:3300/0 conn(0x7fe4040b1d20 0x7fe4040ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe40a711640 1 -- 172.21.15.130:0/84817379 >> 172.21.15.130:0/84817379 conn(0x7fe404065990 msgr2=0x7fe404065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:01.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe40a711640 1 -- 172.21.15.130:0/84817379 shutdown_connections 2023-09-13T06:06:01.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe40a711640 1 -- 172.21.15.130:0/84817379 wait complete. 2023-09-13T06:06:01.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe40a711640 1 Processor -- start 2023-09-13T06:06:01.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.717+0000 7fe40a711640 1 -- start start 2023-09-13T06:06:01.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe40a711640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4040b1d20 0x7fe404151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe40a711640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4040cdfc0 0x7fe4040cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe40a711640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe404159f20 0x7fe4040cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe40a711640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4041f5e00 con 0x7fe404159f20 2023-09-13T06:06:01.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe40a711640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4041f6290 con 0x7fe4040cdfc0 2023-09-13T06:06:01.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe40a711640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4041f9850 con 0x7fe4040b1d20 2023-09-13T06:06:01.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe408cae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe404159f20 0x7fe4040cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe408cae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe404159f20 0x7fe4040cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54330/0 (socket says 172.21.15.130:54330) 2023-09-13T06:06:01.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe408cae640 1 -- 172.21.15.130:0/2596321979 learned_addr learned my addr 172.21.15.130:0/2596321979 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:01.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe403fff640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4040b1d20 0x7fe404151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe4037fe640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4040cdfc0 0x7fe4040cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe408cae640 1 -- 172.21.15.130:0/2596321979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4040b1d20 msgr2=0x7fe404151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe408cae640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4040b1d20 0x7fe404151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe408cae640 1 -- 172.21.15.130:0/2596321979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4040cdfc0 msgr2=0x7fe4040cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe408cae640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4040cdfc0 0x7fe4040cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe408cae640 1 -- 172.21.15.130:0/2596321979 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc009a70 con 0x7fe404159f20 2023-09-13T06:06:01.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe408cae640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe404159f20 0x7fe4040cf480 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0b2040 tx=0x7fe3fc01b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:01.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe400ff9640 1 -- 172.21.15.130:0/2596321979 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0a7930 con 0x7fe404159f20 2023-09-13T06:06:01.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe400ff9640 1 -- 172.21.15.130:0/2596321979 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc0a7a90 con 0x7fe404159f20 2023-09-13T06:06:01.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe400ff9640 1 -- 172.21.15.130:0/2596321979 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0afdd0 con 0x7fe404159f20 2023-09-13T06:06:01.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe40a711640 1 -- 172.21.15.130:0/2596321979 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4041f54d0 con 0x7fe404159f20 2023-09-13T06:06:01.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe40a711640 1 -- 172.21.15.130:0/2596321979 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4041f5a90 con 0x7fe404159f20 2023-09-13T06:06:01.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.721+0000 7fe40a711640 1 -- 172.21.15.130:0/2596321979 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4041f5f70 con 0x7fe404159f20 2023-09-13T06:06:01.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.725+0000 7fe400ff9640 1 -- 172.21.15.130:0/2596321979 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe3fc0b6070 con 0x7fe404159f20 2023-09-13T06:06:01.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.725+0000 7fe400ff9640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe3f0065b20 0x7fe3f0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:01.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.725+0000 7fe400ff9640 1 -- 172.21.15.130:0/2596321979 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3fc11ddc0 con 0x7fe404159f20 2023-09-13T06:06:01.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.725+0000 7fe403fff640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe3f0065b20 0x7fe3f0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:01.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.725+0000 7fe400ff9640 1 -- 172.21.15.130:0/2596321979 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7fe3f006d650 con 0x7fe404159f20 2023-09-13T06:06:01.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.725+0000 7fe403fff640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe3f0065b20 0x7fe3f0067fe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4005890 tx=0x7fe3f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:01.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.729+0000 7fe400ff9640 1 -- 172.21.15.130:0/2596321979 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe3fc0eb7c0 con 0x7fe404159f20 2023-09-13T06:06:01.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.877+0000 7fe40a711640 1 -- 172.21.15.130:0/2596321979 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4040cd850 con 0x7fe404159f20 2023-09-13T06:06:01.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.877+0000 7fe400ff9640 1 -- 172.21.15.130:0/2596321979 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16640 (secure 0 0 0) 0x7fe3fc0bc030 con 0x7fe404159f20 2023-09-13T06:06:01.881 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:01.881 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":88,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:01.366264+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:05:25.196040+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-09-13T06:05:25.825807+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:01.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 -- 172.21.15.130:0/2596321979 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe3f0065b20 msgr2=0x7fe3f0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe3f0065b20 0x7fe3f0067fe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4005890 tx=0x7fe3f4009040 comp rx=0 tx=0).stop 2023-09-13T06:06:01.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 -- 172.21.15.130:0/2596321979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe404159f20 msgr2=0x7fe4040cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:01.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe404159f20 0x7fe4040cf480 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0b2040 tx=0x7fe3fc01b800 comp rx=0 tx=0).stop 2023-09-13T06:06:01.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 -- 172.21.15.130:0/2596321979 shutdown_connections 2023-09-13T06:06:01.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe3f0065b20 0x7fe3f0067fe0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4040cdfc0 0x7fe4040cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe404159f20 0x7fe4040cf480 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 --2- 172.21.15.130:0/2596321979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4040b1d20 0x7fe404151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:01.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 -- 172.21.15.130:0/2596321979 >> 172.21.15.130:0/2596321979 conn(0x7fe404065990 msgr2=0x7fe4040b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:01.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 -- 172.21.15.130:0/2596321979 shutdown_connections 2023-09-13T06:06:01.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:01.881+0000 7fe40a711640 1 -- 172.21.15.130:0/2596321979 wait complete. 2023-09-13T06:06:01.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:05:25.196040+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:05:25.825807+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:06:01.903 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:06:02.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.041+0000 7fa5006ec640 1 Processor -- start 2023-09-13T06:06:02.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.041+0000 7fa5006ec640 1 -- start start 2023-09-13T06:06:02.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa5006ec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa4f815a080 0x7fa4f80b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa5006ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4f80b31a0 0x7fa4f80ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa5006ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f80cc850 con 0x7fa4f815e650 2023-09-13T06:06:02.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa5006ec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f80b0330 con 0x7fa4f815a080 2023-09-13T06:06:02.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa5006ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80cbcd0 con 0x7fa4f80b31a0 2023-09-13T06:06:02.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fdc87640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa4f815e650 0x7fa4f80b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:44236/0 (socket says 172.21.15.130:44236) 2023-09-13T06:06:02.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fdc87640 1 -- 172.21.15.130:0/2814559121 learned_addr learned my addr 172.21.15.130:0/2814559121 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:02.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fe488640 1 --2- 172.21.15.130:0/2814559121 >> v2:172.21.15.164:3300/0 conn(0x7fa4f815a080 0x7fa4f80b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fec89640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4f80b31a0 0x7fa4f80ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988648487 0 0) 0x7fa4e8001120 con 0x7fa4f815e650 2023-09-13T06:06:02.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4e4003530 con 0x7fa4f815e650 2023-09-13T06:06:02.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2592591443 0 0) 0x7fa4e4003530 con 0x7fa4f815e650 2023-09-13T06:06:02.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4f80b31a0 msgr2=0x7fa4f80ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:02.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4f80b31a0 0x7fa4f80ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 >> v2:172.21.15.164:3300/0 conn(0x7fa4f815a080 msgr2=0x7fa4f80b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:02.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 --2- 172.21.15.130:0/2814559121 >> v2:172.21.15.164:3300/0 conn(0x7fa4f815a080 0x7fa4f80b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80cbfb0 con 0x7fa4f815e650 2023-09-13T06:06:02.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fa4e8001830 con 0x7fa4f815e650 2023-09-13T06:06:02.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 >> v1:172.21.15.130:6789/0 conn(0x7fa4f815e650 legacy=0x7fa4f80b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4f80b31a0 0x7fa4e40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e4003f70 0x7fa4e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4e4004d10 0x7fa4e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80b0330 con 0x7fa4e4004d10 2023-09-13T06:06:02.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80cbcd0 con 0x7fa4e4003f70 2023-09-13T06:06:02.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e400ba40 con 0x7fa4f80b31a0 2023-09-13T06:06:02.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fec89640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4e4004d10 0x7fa4e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fe488640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4f80b31a0 0x7fa4e40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fdc87640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e4003f70 0x7fa4e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fec89640 1 -- 172.21.15.130:0/2814559121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4f80b31a0 msgr2=0x7fa4e40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:02.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fec89640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4f80b31a0 0x7fa4e40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fec89640 1 -- 172.21.15.130:0/2814559121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e4003f70 msgr2=0x7fa4e40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:02.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fec89640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4e4003f70 0x7fa4e40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.045+0000 7fa4fec89640 1 -- 172.21.15.130:0/2814559121 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e4003530 con 0x7fa4e4004d10 2023-09-13T06:06:02.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.049+0000 7fa4fec89640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4e4004d10 0x7fa4e4005190 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009fc0 tx=0x7fa4f001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6260ede00da5de server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:02.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.049+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00a5c70 con 0x7fa4e4004d10 2023-09-13T06:06:02.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.049+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f000f040 con 0x7fa4e4004d10 2023-09-13T06:06:02.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.049+0000 7fa4fd486640 1 -- 172.21.15.130:0/2814559121 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00ad440 con 0x7fa4e4004d10 2023-09-13T06:06:02.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.049+0000 7fa5006ec640 1 -- 172.21.15.130:0/2814559121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4e4004d10 msgr2=0x7fa4e4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.049+0000 7fa5006ec640 1 --2- 172.21.15.130:0/2814559121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4e4004d10 0x7fa4e4005190 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009fc0 tx=0x7fa4f001cc60 comp rx=0 tx=0).stop 2023-09-13T06:06:02.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.049+0000 7fa4fec89640 1 -- 172.21.15.130:0/2814559121 reap_dead start 2023-09-13T06:06:02.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.049+0000 7fa5006ec640 1 -- 172.21.15.130:0/2814559121 shutdown_connections 2023-09-13T06:06:02.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.049+0000 7fa5006ec640 1 -- 172.21.15.130:0/2814559121 >> 172.21.15.130:0/2814559121 conn(0x7fa4f8065990 msgr2=0x7fa4f8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:02.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.049+0000 7fa5006ec640 1 -- 172.21.15.130:0/2814559121 shutdown_connections 2023-09-13T06:06:02.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.049+0000 7fa5006ec640 1 -- 172.21.15.130:0/2814559121 wait complete. 2023-09-13T06:06:02.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa5006ec640 1 Processor -- start 2023-09-13T06:06:02.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa5006ec640 1 -- start start 2023-09-13T06:06:02.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa5006ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4e4004d10 0x7fa4f8145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa5006ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4f81ef0e0 0x7fa4f80b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa5006ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b21d0 0x7fa4f8158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa5006ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80b2660 con 0x7fa4f80b21d0 2023-09-13T06:06:02.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa5006ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8145a70 con 0x7fa4f81ef0e0 2023-09-13T06:06:02.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa5006ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f81eec50 con 0x7fa4e4004d10 2023-09-13T06:06:02.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4fec89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b21d0 0x7fa4f8158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4fec89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b21d0 0x7fa4f8158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54346/0 (socket says 172.21.15.130:54346) 2023-09-13T06:06:02.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4fec89640 1 -- 172.21.15.130:0/367084965 learned_addr learned my addr 172.21.15.130:0/367084965 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:02.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4fdc87640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4f81ef0e0 0x7fa4f80b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4fe488640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4e4004d10 0x7fa4f8145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4fec89640 1 -- 172.21.15.130:0/367084965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4e4004d10 msgr2=0x7fa4f8145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4fec89640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4e4004d10 0x7fa4f8145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4fec89640 1 -- 172.21.15.130:0/367084965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4f81ef0e0 msgr2=0x7fa4f80b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4fec89640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4f81ef0e0 0x7fa4f80b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4fec89640 1 -- 172.21.15.130:0/367084965 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f81ee340 con 0x7fa4f80b21d0 2023-09-13T06:06:02.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4fec89640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b21d0 0x7fa4f8158ab0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00b0040 tx=0x7fa4f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:02.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4eeffd640 1 -- 172.21.15.130:0/367084965 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00bc070 con 0x7fa4f80b21d0 2023-09-13T06:06:02.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4eeffd640 1 -- 172.21.15.130:0/367084965 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f00039a0 con 0x7fa4f80b21d0 2023-09-13T06:06:02.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa5006ec640 1 -- 172.21.15.130:0/367084965 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f8159720 con 0x7fa4f80b21d0 2023-09-13T06:06:02.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa4eeffd640 1 -- 172.21.15.130:0/367084965 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0003b30 con 0x7fa4f80b21d0 2023-09-13T06:06:02.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa5006ec640 1 -- 172.21.15.130:0/367084965 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f81ee8e0 con 0x7fa4f80b21d0 2023-09-13T06:06:02.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.053+0000 7fa5006ec640 1 -- 172.21.15.130:0/367084965 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f815eac0 con 0x7fa4f80b21d0 2023-09-13T06:06:02.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.057+0000 7fa4eeffd640 1 -- 172.21.15.130:0/367084965 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa4f00b4040 con 0x7fa4f80b21d0 2023-09-13T06:06:02.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.057+0000 7fa4eeffd640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4dc065b20 0x7fa4dc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.057+0000 7fa4eeffd640 1 -- 172.21.15.130:0/367084965 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4f011ce00 con 0x7fa4f80b21d0 2023-09-13T06:06:02.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.057+0000 7fa4fe488640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4dc065b20 0x7fa4dc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.057+0000 7fa4eeffd640 1 -- 172.21.15.130:0/367084965 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7fa4dc06d650 con 0x7fa4f80b21d0 2023-09-13T06:06:02.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.057+0000 7fa4fe488640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4dc065b20 0x7fa4dc067fe0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400bf00 tx=0x7fa4f4013040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:02.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.061+0000 7fa4eeffd640 1 -- 172.21.15.130:0/367084965 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa4f00b2020 con 0x7fa4f80b21d0 2023-09-13T06:06:02.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.209+0000 7fa5006ec640 1 -- 172.21.15.130:0/367084965 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4f80618a0 con 0x7fa4f80b21d0 2023-09-13T06:06:02.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.209+0000 7fa4eeffd640 1 -- 172.21.15.130:0/367084965 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa4f00ea9d0 con 0x7fa4f80b21d0 2023-09-13T06:06:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:06:02.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 -- 172.21.15.130:0/367084965 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4dc065b20 msgr2=0x7fa4dc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4dc065b20 0x7fa4dc067fe0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400bf00 tx=0x7fa4f4013040 comp rx=0 tx=0).stop 2023-09-13T06:06:02.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 -- 172.21.15.130:0/367084965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b21d0 msgr2=0x7fa4f8158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b21d0 0x7fa4f8158ab0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00b0040 tx=0x7fa4f0009750 comp rx=0 tx=0).stop 2023-09-13T06:06:02.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 -- 172.21.15.130:0/367084965 shutdown_connections 2023-09-13T06:06:02.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4dc065b20 0x7fa4dc067fe0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4f81ef0e0 0x7fa4f80b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b21d0 0x7fa4f8158ab0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 --2- 172.21.15.130:0/367084965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4e4004d10 0x7fa4f8145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 -- 172.21.15.130:0/367084965 >> 172.21.15.130:0/367084965 conn(0x7fa4f8065990 msgr2=0x7fa4f8153840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:02.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 -- 172.21.15.130:0/367084965 shutdown_connections 2023-09-13T06:06:02.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.213+0000 7fa5006ec640 1 -- 172.21.15.130:0/367084965 wait complete. 2023-09-13T06:06:02.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:06:02.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.373+0000 7f2dfaf40640 1 Processor -- start 2023-09-13T06:06:02.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.373+0000 7f2dfaf40640 1 -- start start 2023-09-13T06:06:02.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2dfaf40640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2df415a080 0x7f2df40b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2dfaf40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2df415e650 0x7f2df40b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2dfaf40640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df40cc850 con 0x7f2df40b2fd0 2023-09-13T06:06:02.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2dfaf40640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df40b3420 con 0x7f2df415a080 2023-09-13T06:06:02.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2dfaf40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40b0330 con 0x7f2df415e650 2023-09-13T06:06:02.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2df8cdc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2df415a080 0x7f2df40b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2debfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2df415e650 0x7f2df40b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2df8cdc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2df415a080 0x7f2df40b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54348/0 (socket says 172.21.15.130:54348) 2023-09-13T06:06:02.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2df8cdc640 1 -- 172.21.15.130:0/3011011975 learned_addr learned my addr 172.21.15.130:0/3011011975 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:02.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2df8cdc640 1 -- 172.21.15.130:0/3011011975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2df415e650 msgr2=0x7f2df40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:02.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2df8cdc640 1 --2- 172.21.15.130:0/3011011975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2df415e650 0x7f2df40b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2df8cdc640 1 -- 172.21.15.130:0/3011011975 >> v1:172.21.15.164:6789/0 conn(0x7f2df40b2fd0 legacy=0x7f2df40ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.377+0000 7f2df8cdc640 1 -- 172.21.15.130:0/3011011975 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df40cbcd0 con 0x7f2df415a080 2023-09-13T06:06:02.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2df8cdc640 1 --2- 172.21.15.130:0/3011011975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2df415a080 0x7f2df40b1460 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009870 tx=0x7f2df001e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c14ee64f40b48b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:02.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2deb7fe640 1 -- 172.21.15.130:0/3011011975 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df00b2600 con 0x7f2df415a080 2023-09-13T06:06:02.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2deb7fe640 1 -- 172.21.15.130:0/3011011975 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df00b2760 con 0x7f2df415a080 2023-09-13T06:06:02.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2deb7fe640 1 -- 172.21.15.130:0/3011011975 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df00b2af0 con 0x7f2df415a080 2023-09-13T06:06:02.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2dfaf40640 1 -- 172.21.15.130:0/3011011975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2df415a080 msgr2=0x7f2df40b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2dfaf40640 1 --2- 172.21.15.130:0/3011011975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2df415a080 0x7f2df40b1460 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009870 tx=0x7f2df001e660 comp rx=0 tx=0).stop 2023-09-13T06:06:02.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2dfaf40640 1 -- 172.21.15.130:0/3011011975 shutdown_connections 2023-09-13T06:06:02.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2dfaf40640 1 --2- 172.21.15.130:0/3011011975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2df415e650 0x7f2df40b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2dfaf40640 1 --2- 172.21.15.130:0/3011011975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2df415a080 0x7f2df40b1460 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2dfaf40640 1 -- 172.21.15.130:0/3011011975 >> 172.21.15.130:0/3011011975 conn(0x7f2df4065990 msgr2=0x7f2df4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:02.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2dfaf40640 1 -- 172.21.15.130:0/3011011975 shutdown_connections 2023-09-13T06:06:02.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2dfaf40640 1 -- 172.21.15.130:0/3011011975 wait complete. 2023-09-13T06:06:02.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2dfaf40640 1 Processor -- start 2023-09-13T06:06:02.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.381+0000 7f2dfaf40640 1 -- start start 2023-09-13T06:06:02.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2dfaf40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2df40b2fd0 0x7f2df414f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2dfaf40640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2df415a080 0x7f2df4152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2dfaf40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2df415e650 0x7f2df4150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2dfaf40640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df414f8c0 con 0x7f2df415e650 2023-09-13T06:06:02.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2dfaf40640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df406c550 con 0x7f2df415a080 2023-09-13T06:06:02.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2dfaf40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4156f10 con 0x7f2df40b2fd0 2023-09-13T06:06:02.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2df94dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2df415e650 0x7f2df4150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2df8cdc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2df40b2fd0 0x7f2df414f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2df94dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2df415e650 0x7f2df4150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54358/0 (socket says 172.21.15.130:54358) 2023-09-13T06:06:02.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2df94dd640 1 -- 172.21.15.130:0/2558339770 learned_addr learned my addr 172.21.15.130:0/2558339770 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:02.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2debfff640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2df415a080 0x7f2df4152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2df94dd640 1 -- 172.21.15.130:0/2558339770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2df40b2fd0 msgr2=0x7f2df414f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2df94dd640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2df40b2fd0 0x7f2df414f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2df94dd640 1 -- 172.21.15.130:0/2558339770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2df415a080 msgr2=0x7f2df4152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2df94dd640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2df415a080 0x7f2df4152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2df94dd640 1 -- 172.21.15.130:0/2558339770 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df00094d0 con 0x7f2df415e650 2023-09-13T06:06:02.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2debfff640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2df415a080 0x7f2df4152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:02.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2df94dd640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2df415e650 0x7f2df4150b10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c770 tx=0x7f2dec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:02.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2de97fa640 1 -- 172.21.15.130:0/2558339770 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec003b80 con 0x7f2df415e650 2023-09-13T06:06:02.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2de97fa640 1 -- 172.21.15.130:0/2558339770 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec003ce0 con 0x7f2df415e650 2023-09-13T06:06:02.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2dfaf40640 1 -- 172.21.15.130:0/2558339770 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df41571f0 con 0x7f2df415e650 2023-09-13T06:06:02.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2de97fa640 1 -- 172.21.15.130:0/2558339770 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec00aa90 con 0x7f2df415e650 2023-09-13T06:06:02.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2dfaf40640 1 -- 172.21.15.130:0/2558339770 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df4152ac0 con 0x7f2df415e650 2023-09-13T06:06:02.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.385+0000 7f2dfaf40640 1 -- 172.21.15.130:0/2558339770 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df40618a0 con 0x7f2df415e650 2023-09-13T06:06:02.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.389+0000 7f2de97fa640 1 -- 172.21.15.130:0/2558339770 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2dec00abf0 con 0x7f2df415e650 2023-09-13T06:06:02.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.389+0000 7f2de97fa640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2de0065b50 0x7f2de0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.389+0000 7f2de97fa640 1 -- 172.21.15.130:0/2558339770 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2dec082f50 con 0x7f2df415e650 2023-09-13T06:06:02.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.389+0000 7f2df8cdc640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2de0065b50 0x7f2de0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.389+0000 7f2de97fa640 1 -- 172.21.15.130:0/2558339770 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f2de006d680 con 0x7f2df415e650 2023-09-13T06:06:02.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.389+0000 7f2df8cdc640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2de0065b50 0x7f2de0068010 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2df00b1000 tx=0x7f2df00a9000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:02.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.393+0000 7f2de97fa640 1 -- 172.21.15.130:0/2558339770 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2dec050800 con 0x7f2df415e650 2023-09-13T06:06:02.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.537+0000 7f2dfaf40640 1 -- 172.21.15.130:0/2558339770 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2df40cc850 con 0x7f2df415e650 2023-09-13T06:06:02.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2de97fa640 1 -- 172.21.15.130:0/2558339770 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2df40cc850 con 0x7f2df415e650 2023-09-13T06:06:02.541 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:06:02.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 -- 172.21.15.130:0/2558339770 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2de0065b50 msgr2=0x7f2de0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2de0065b50 0x7f2de0068010 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2df00b1000 tx=0x7f2df00a9000 comp rx=0 tx=0).stop 2023-09-13T06:06:02.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 -- 172.21.15.130:0/2558339770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2df415e650 msgr2=0x7f2df4150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2df415e650 0x7f2df4150b10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c770 tx=0x7f2dec00cc30 comp rx=0 tx=0).stop 2023-09-13T06:06:02.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 -- 172.21.15.130:0/2558339770 shutdown_connections 2023-09-13T06:06:02.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2de0065b50 0x7f2de0068010 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2df415a080 0x7f2df4152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2df415e650 0x7f2df4150b10 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 --2- 172.21.15.130:0/2558339770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2df40b2fd0 0x7f2df414f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 -- 172.21.15.130:0/2558339770 >> 172.21.15.130:0/2558339770 conn(0x7f2df4065990 msgr2=0x7f2df40ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:02.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 -- 172.21.15.130:0/2558339770 shutdown_connections 2023-09-13T06:06:02.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.541+0000 7f2dfaf40640 1 -- 172.21.15.130:0/2558339770 wait complete. 2023-09-13T06:06:02.562 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:06:02.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f274b4ec640 1 Processor -- start 2023-09-13T06:06:02.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f274b4ec640 1 -- start start 2023-09-13T06:06:02.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f274b4ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27440d0d10 0x7f27441619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f274b4ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274415dd40 con 0x7f274415ae10 2023-09-13T06:06:02.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f274b4ec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274415e020 con 0x7f27440d2cd0 2023-09-13T06:06:02.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f274b4ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274415e300 con 0x7f27440d0d10 2023-09-13T06:06:02.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f2749288640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f274415ae10 0x7f27440d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:44240/0 (socket says 172.21.15.130:44240) 2023-09-13T06:06:02.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f2749288640 1 -- 172.21.15.130:0/734814272 learned_addr learned my addr 172.21.15.130:0/734814272 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:02.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f2749a89640 1 --2- 172.21.15.130:0/734814272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27440d0d10 0x7f27441619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f273bfff640 1 -- 172.21.15.130:0/734814272 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419675601 0 0) 0x7f274415dd40 con 0x7f274415ae10 2023-09-13T06:06:02.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f273bfff640 1 -- 172.21.15.130:0/734814272 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2730003530 con 0x7f274415ae10 2023-09-13T06:06:02.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f273bfff640 1 -- 172.21.15.130:0/734814272 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946012421 0 0) 0x7f274415e020 con 0x7f27440d2cd0 2023-09-13T06:06:02.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f273bfff640 1 -- 172.21.15.130:0/734814272 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f274415dd40 con 0x7f27440d2cd0 2023-09-13T06:06:02.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f2749a89640 1 -- 172.21.15.130:0/734814272 >> v1:172.21.15.164:6789/0 conn(0x7f27440d2cd0 legacy=0x7f27441612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f2749a89640 1 -- 172.21.15.130:0/734814272 >> v1:172.21.15.130:6789/0 conn(0x7f274415ae10 legacy=0x7f27440d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.705+0000 7f2749a89640 1 -- 172.21.15.130:0/734814272 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274415e5e0 con 0x7f27440d0d10 2023-09-13T06:06:02.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.709+0000 7f2749a89640 1 --2- 172.21.15.130:0/734814272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27440d0d10 0x7f27441619b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f273c009dc0 tx=0x7f273c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d244388fb0c06bd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:02.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.709+0000 7f273bfff640 1 -- 172.21.15.130:0/734814272 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c0a59c0 con 0x7f27440d0d10 2023-09-13T06:06:02.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.709+0000 7f273bfff640 1 -- 172.21.15.130:0/734814272 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c0a5b20 con 0x7f27440d0d10 2023-09-13T06:06:02.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.709+0000 7f273bfff640 1 -- 172.21.15.130:0/734814272 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c0ad440 con 0x7f27440d0d10 2023-09-13T06:06:02.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.709+0000 7f274b4ec640 1 -- 172.21.15.130:0/734814272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27440d0d10 msgr2=0x7f27441619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.709+0000 7f274b4ec640 1 --2- 172.21.15.130:0/734814272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27440d0d10 0x7f27441619b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f273c009dc0 tx=0x7f273c01c8e0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.709+0000 7f274b4ec640 1 -- 172.21.15.130:0/734814272 shutdown_connections 2023-09-13T06:06:02.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.709+0000 7f274b4ec640 1 --2- 172.21.15.130:0/734814272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27440d0d10 0x7f27441619b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.709+0000 7f274b4ec640 1 -- 172.21.15.130:0/734814272 >> 172.21.15.130:0/734814272 conn(0x7f2744065990 msgr2=0x7f2744065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:02.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.709+0000 7f274b4ec640 1 -- 172.21.15.130:0/734814272 shutdown_connections 2023-09-13T06:06:02.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.709+0000 7f274b4ec640 1 -- 172.21.15.130:0/734814272 wait complete. 2023-09-13T06:06:02.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f274b4ec640 1 Processor -- start 2023-09-13T06:06:02.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f274b4ec640 1 -- start start 2023-09-13T06:06:02.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f274b4ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27440d0d10 0x7f274414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f274b4ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27440d2cd0 0x7f27440b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f274b4ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f274415ae10 0x7f27440b7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f274b4ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2744155ef0 con 0x7f27440d2cd0 2023-09-13T06:06:02.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f274b4ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27441561d0 con 0x7f27440d0d10 2023-09-13T06:06:02.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f274b4ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27441564b0 con 0x7f274415ae10 2023-09-13T06:06:02.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2748a87640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27440d2cd0 0x7f27440b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2748a87640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27440d2cd0 0x7f27440b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54360/0 (socket says 172.21.15.130:54360) 2023-09-13T06:06:02.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2748a87640 1 -- 172.21.15.130:0/4134334649 learned_addr learned my addr 172.21.15.130:0/4134334649 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:02.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2749a89640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f274415ae10 0x7f27440b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2749288640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27440d0d10 0x7f274414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2748a87640 1 -- 172.21.15.130:0/4134334649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f274415ae10 msgr2=0x7f27440b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2748a87640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f274415ae10 0x7f27440b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2748a87640 1 -- 172.21.15.130:0/4134334649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27440d0d10 msgr2=0x7f274414d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2748a87640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27440d0d10 0x7f274414d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2748a87640 1 -- 172.21.15.130:0/4134334649 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c009a70 con 0x7f27440d2cd0 2023-09-13T06:06:02.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2749a89640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f274415ae10 0x7f27440b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:02.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2748a87640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27440d2cd0 0x7f27440b7110 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f273400c490 tx=0x7f273400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:02.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2739ffb640 1 -- 172.21.15.130:0/4134334649 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340052d0 con 0x7f27440d2cd0 2023-09-13T06:06:02.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f274b4ec640 1 -- 172.21.15.130:0/4134334649 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2744156790 con 0x7f27440d2cd0 2023-09-13T06:06:02.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2739ffb640 1 -- 172.21.15.130:0/4134334649 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2734005430 con 0x7f27440d2cd0 2023-09-13T06:06:02.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.713+0000 7f2739ffb640 1 -- 172.21.15.130:0/4134334649 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734012870 con 0x7f27440d2cd0 2023-09-13T06:06:02.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.717+0000 7f274b4ec640 1 -- 172.21.15.130:0/4134334649 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2744155b30 con 0x7f27440d2cd0 2023-09-13T06:06:02.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.717+0000 7f274b4ec640 1 -- 172.21.15.130:0/4134334649 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27440618a0 con 0x7f27440d2cd0 2023-09-13T06:06:02.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.717+0000 7f2739ffb640 1 -- 172.21.15.130:0/4134334649 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f27340129d0 con 0x7f27440d2cd0 2023-09-13T06:06:02.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.717+0000 7f2739ffb640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2728065b20 0x7f2728067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:02.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.717+0000 7f2739ffb640 1 -- 172.21.15.130:0/4134334649 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2734082fd0 con 0x7f27440d2cd0 2023-09-13T06:06:02.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.717+0000 7f2749288640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2728065b20 0x7f2728067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:02.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.717+0000 7f2739ffb640 1 -- 172.21.15.130:0/4134334649 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f272806d650 con 0x7f27440d2cd0 2023-09-13T06:06:02.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.717+0000 7f2749288640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2728065b20 0x7f2728067fe0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f27400011f0 tx=0x7f2740009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:02.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.721+0000 7f2739ffb640 1 -- 172.21.15.130:0/4134334649 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2734050800 con 0x7f27440d2cd0 2023-09-13T06:06:02.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.869+0000 7f274b4ec640 1 -- 172.21.15.130:0/4134334649 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2744156c40 con 0x7f27440d2cd0 2023-09-13T06:06:02.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f2739ffb640 1 -- 172.21.15.130:0/4134334649 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2734053e20 con 0x7f27440d2cd0 2023-09-13T06:06:02.874 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:06:02.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 -- 172.21.15.130:0/4134334649 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2728065b20 msgr2=0x7f2728067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2728065b20 0x7f2728067fe0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f27400011f0 tx=0x7f2740009040 comp rx=0 tx=0).stop 2023-09-13T06:06:02.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 -- 172.21.15.130:0/4134334649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27440d2cd0 msgr2=0x7f27440b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:02.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27440d2cd0 0x7f27440b7110 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f273400c490 tx=0x7f273400c950 comp rx=0 tx=0).stop 2023-09-13T06:06:02.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 -- 172.21.15.130:0/4134334649 shutdown_connections 2023-09-13T06:06:02.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2728065b20 0x7f2728067fe0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f274415ae10 0x7f27440b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27440d2cd0 0x7f27440b7110 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 --2- 172.21.15.130:0/4134334649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27440d0d10 0x7f274414d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:02.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 -- 172.21.15.130:0/4134334649 >> 172.21.15.130:0/4134334649 conn(0x7f2744065990 msgr2=0x7f27440cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:02.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 -- 172.21.15.130:0/4134334649 shutdown_connections 2023-09-13T06:06:02.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:02.873+0000 7f274b4ec640 1 -- 172.21.15.130:0/4134334649 wait complete. 2023-09-13T06:06:02.894 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:03.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.029+0000 7f95fd582640 1 Processor -- start 2023-09-13T06:06:03.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.029+0000 7f95fd582640 1 -- start start 2023-09-13T06:06:03.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.033+0000 7f95fd582640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f95f80d1090 0x7f95f815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.033+0000 7f95fd582640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f80b63c0 con 0x7f95f8146f30 2023-09-13T06:06:03.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.033+0000 7f95fd582640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f80d0c20 con 0x7f95f80d1750 2023-09-13T06:06:03.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.033+0000 7f95fd582640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f815dea0 con 0x7f95f80d1090 2023-09-13T06:06:03.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.033+0000 7f95ee7fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f95f80d1090 0x7f95f815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.033+0000 7f95f77fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f95f8146f30 0x7f95f80b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:44252/0 (socket says 172.21.15.130:44252) 2023-09-13T06:06:03.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.033+0000 7f95f77fe640 1 -- 172.21.15.130:0/1528550755 learned_addr learned my addr 172.21.15.130:0/1528550755 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:03.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.033+0000 7f95ee7fc640 1 -- 172.21.15.130:0/1528550755 >> v1:172.21.15.164:6789/0 conn(0x7f95f80d1750 legacy=0x7f95f8146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.033+0000 7f95ee7fc640 1 -- 172.21.15.130:0/1528550755 >> v1:172.21.15.130:6789/0 conn(0x7f95f8146f30 legacy=0x7f95f80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.033+0000 7f95f67fc640 1 -- 172.21.15.130:0/1528550755 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082902136 0 0) 0x7f95f80b63c0 con 0x7f95f8146f30 2023-09-13T06:06:03.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.033+0000 7f95ee7fc640 1 -- 172.21.15.130:0/1528550755 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80b6610 con 0x7f95f80d1090 2023-09-13T06:06:03.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95ee7fc640 1 --2- 172.21.15.130:0/1528550755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80d1090 0x7f95f815d960 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009d90 tx=0x7f95e001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd39a3ee71c473d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:03.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95f67fc640 1 -- 172.21.15.130:0/1528550755 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e00a5950 con 0x7f95f80d1090 2023-09-13T06:06:03.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95f67fc640 1 -- 172.21.15.130:0/1528550755 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e00a5ab0 con 0x7f95f80d1090 2023-09-13T06:06:03.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95f67fc640 1 -- 172.21.15.130:0/1528550755 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e00a5e40 con 0x7f95f80d1090 2023-09-13T06:06:03.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95fd582640 1 -- 172.21.15.130:0/1528550755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80d1090 msgr2=0x7f95f815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95fd582640 1 --2- 172.21.15.130:0/1528550755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80d1090 0x7f95f815d960 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009d90 tx=0x7f95e001c890 comp rx=0 tx=0).stop 2023-09-13T06:06:03.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95fd582640 1 -- 172.21.15.130:0/1528550755 shutdown_connections 2023-09-13T06:06:03.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95fd582640 1 --2- 172.21.15.130:0/1528550755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80d1090 0x7f95f815d960 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95fd582640 1 -- 172.21.15.130:0/1528550755 >> 172.21.15.130:0/1528550755 conn(0x7f95f806f170 msgr2=0x7f95f806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:03.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95fd582640 1 -- 172.21.15.130:0/1528550755 shutdown_connections 2023-09-13T06:06:03.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95fd582640 1 -- 172.21.15.130:0/1528550755 wait complete. 2023-09-13T06:06:03.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95fd582640 1 Processor -- start 2023-09-13T06:06:03.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.037+0000 7f95fd582640 1 -- start start 2023-09-13T06:06:03.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95fd582640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80d1090 0x7f95f813b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95fd582640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95f80d1750 0x7f95f8159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95fd582640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95f8146f30 0x7f95f813cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95fd582640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f81432b0 con 0x7f95f80d1090 2023-09-13T06:06:03.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95fd582640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f815a300 con 0x7f95f80d1750 2023-09-13T06:06:03.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95fd582640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f81426a0 con 0x7f95f8146f30 2023-09-13T06:06:03.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95f6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80d1090 0x7f95f813b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95f6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80d1090 0x7f95f813b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54382/0 (socket says 172.21.15.130:54382) 2023-09-13T06:06:03.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95f6ffd640 1 -- 172.21.15.130:0/883856499 learned_addr learned my addr 172.21.15.130:0/883856499 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:03.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95f77fe640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95f8146f30 0x7f95f813cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95f6ffd640 1 -- 172.21.15.130:0/883856499 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95f8146f30 msgr2=0x7f95f813cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95ee7fc640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95f80d1750 0x7f95f8159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95f6ffd640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95f8146f30 0x7f95f813cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95f6ffd640 1 -- 172.21.15.130:0/883856499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95f80d1750 msgr2=0x7f95f8159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95f6ffd640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95f80d1750 0x7f95f8159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95f6ffd640 1 -- 172.21.15.130:0/883856499 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e0009a70 con 0x7f95f80d1090 2023-09-13T06:06:03.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95f77fe640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95f8146f30 0x7f95f813cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:03.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95ee7fc640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95f80d1750 0x7f95f8159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:03.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95f6ffd640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80d1090 0x7f95f813b4a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f95e800c530 tx=0x7f95e800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:03.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95effff640 1 -- 172.21.15.130:0/883856499 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8005220 con 0x7f95f80d1090 2023-09-13T06:06:03.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95effff640 1 -- 172.21.15.130:0/883856499 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e8005380 con 0x7f95f80d1090 2023-09-13T06:06:03.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95effff640 1 -- 172.21.15.130:0/883856499 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8007270 con 0x7f95f80d1090 2023-09-13T06:06:03.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95fd582640 1 -- 172.21.15.130:0/883856499 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f8142980 con 0x7f95f80d1090 2023-09-13T06:06:03.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95fd582640 1 -- 172.21.15.130:0/883856499 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f8142f40 con 0x7f95f80d1090 2023-09-13T06:06:03.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95fd582640 1 -- 172.21.15.130:0/883856499 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f80618a0 con 0x7f95f80d1090 2023-09-13T06:06:03.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95effff640 1 -- 172.21.15.130:0/883856499 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f95e80073d0 con 0x7f95f80d1090 2023-09-13T06:06:03.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.041+0000 7f95effff640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95d8065b20 0x7f95d8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.045+0000 7f95effff640 1 -- 172.21.15.130:0/883856499 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95e8082b50 con 0x7f95f80d1090 2023-09-13T06:06:03.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.045+0000 7f95ee7fc640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95d8065b20 0x7f95d8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.045+0000 7f95effff640 1 -- 172.21.15.130:0/883856499 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f95d806d650 con 0x7f95f80d1090 2023-09-13T06:06:03.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.045+0000 7f95ee7fc640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95d8065b20 0x7f95d8067fe0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f95e00af000 tx=0x7f95e00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:03.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.045+0000 7f95effff640 1 -- 172.21.15.130:0/883856499 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f95e8050530 con 0x7f95f80d1090 2023-09-13T06:06:03.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 -- 172.21.15.130:0/883856499 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95f80b86c0 con 0x7f95f80d1090 2023-09-13T06:06:03.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95effff640 1 -- 172.21.15.130:0/883856499 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f95e8053b50 con 0x7f95f80d1090 2023-09-13T06:06:03.230 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:03.230 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2267621007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2267621007},{"type":"v1","addr":"172.21.15.164:6834","nonce":2267621007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5663,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/658594571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":658594571},{"type":"v1","addr":"172.21.15.164:6835","nonce":658594571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6474,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1441650800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1441650800},{"type":"v1","addr":"172.21.15.130:6836","nonce":1441650800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:05:26.837419+0000","modified":"2023-09-13T06:05:29.861380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6477},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6477":{"gid":6477,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/428674793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":428674793},{"type":"v1","addr":"172.21.15.130:6837","nonce":428674793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-09-13T06:06:03.231 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 43 2023-09-13T06:06:03.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 -- 172.21.15.130:0/883856499 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95d8065b20 msgr2=0x7f95d8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95d8065b20 0x7f95d8067fe0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f95e00af000 tx=0x7f95e00a7070 comp rx=0 tx=0).stop 2023-09-13T06:06:03.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 -- 172.21.15.130:0/883856499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80d1090 msgr2=0x7f95f813b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80d1090 0x7f95f813b4a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f95e800c530 tx=0x7f95e800c9f0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 -- 172.21.15.130:0/883856499 shutdown_connections 2023-09-13T06:06:03.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f95d8065b20 0x7f95d8067fe0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95f80d1750 0x7f95f8159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f95f8146f30 0x7f95f813cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 --2- 172.21.15.130:0/883856499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80d1090 0x7f95f813b4a0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 -- 172.21.15.130:0/883856499 >> 172.21.15.130:0/883856499 conn(0x7f95f806f170 msgr2=0x7f95f80cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:03.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 -- 172.21.15.130:0/883856499 shutdown_connections 2023-09-13T06:06:03.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.229+0000 7f95fd582640 1 -- 172.21.15.130:0/883856499 wait complete. 2023-09-13T06:06:03.251 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:03.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.389+0000 7fcf1c6d8640 1 Processor -- start 2023-09-13T06:06:03.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.389+0000 7fcf1c6d8640 1 -- start start 2023-09-13T06:06:03.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.389+0000 7fcf1c6d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcf14157980 0x7fcf140b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.389+0000 7fcf1c6d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf14161390 con 0x7fcf14160e60 2023-09-13T06:06:03.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.389+0000 7fcf1c6d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf14161670 con 0x7fcf141575a0 2023-09-13T06:06:03.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.389+0000 7fcf1c6d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf140ae170 con 0x7fcf14157980 2023-09-13T06:06:03.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.389+0000 7fcf19c73640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fcf14160e60 0x7fcf140aff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:44258/0 (socket says 172.21.15.130:44258) 2023-09-13T06:06:03.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.393+0000 7fcf19c73640 1 -- 172.21.15.130:0/4123928107 learned_addr learned my addr 172.21.15.130:0/4123928107 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:03.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.393+0000 7fcf1ac75640 1 --2- 172.21.15.130:0/4123928107 >> v2:172.21.15.130:3300/0 conn(0x7fcf14157980 0x7fcf140b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.393+0000 7fcf19472640 1 -- 172.21.15.130:0/4123928107 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865676274 0 0) 0x7fcf14161390 con 0x7fcf14160e60 2023-09-13T06:06:03.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.393+0000 7fcf19472640 1 -- 172.21.15.130:0/4123928107 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf00003530 con 0x7fcf14160e60 2023-09-13T06:06:03.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.393+0000 7fcf1ac75640 1 -- 172.21.15.130:0/4123928107 >> v1:172.21.15.164:6789/0 conn(0x7fcf141575a0 legacy=0x7fcf14143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:03.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.393+0000 7fcf1ac75640 1 -- 172.21.15.130:0/4123928107 >> v1:172.21.15.130:6789/0 conn(0x7fcf14160e60 legacy=0x7fcf140aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.393+0000 7fcf1ac75640 1 -- 172.21.15.130:0/4123928107 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14161950 con 0x7fcf14157980 2023-09-13T06:06:03.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.393+0000 7fcf1ac75640 1 --2- 172.21.15.130:0/4123928107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf14157980 0x7fcf140b1610 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009d90 tx=0x7fcf0c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b18a350d0d61df server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:03.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.393+0000 7fcf19472640 1 -- 172.21.15.130:0/4123928107 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c0a5740 con 0x7fcf14157980 2023-09-13T06:06:03.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.393+0000 7fcf19472640 1 -- 172.21.15.130:0/4123928107 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c0a58a0 con 0x7fcf14157980 2023-09-13T06:06:03.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.393+0000 7fcf19472640 1 -- 172.21.15.130:0/4123928107 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c0a5c30 con 0x7fcf14157980 2023-09-13T06:06:03.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/4123928107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf14157980 msgr2=0x7fcf140b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 --2- 172.21.15.130:0/4123928107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf14157980 0x7fcf140b1610 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009d90 tx=0x7fcf0c01c880 comp rx=0 tx=0).stop 2023-09-13T06:06:03.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/4123928107 shutdown_connections 2023-09-13T06:06:03.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 --2- 172.21.15.130:0/4123928107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf14157980 0x7fcf140b1610 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/4123928107 >> 172.21.15.130:0/4123928107 conn(0x7fcf14065990 msgr2=0x7fcf14065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:03.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/4123928107 shutdown_connections 2023-09-13T06:06:03.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/4123928107 wait complete. 2023-09-13T06:06:03.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 Processor -- start 2023-09-13T06:06:03.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 -- start start 2023-09-13T06:06:03.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf141575a0 0x7fcf1413bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf14157980 0x7fcf141600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf14160e60 0x7fcf1406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140cd440 con 0x7fcf141575a0 2023-09-13T06:06:03.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf14157f60 con 0x7fcf14157980 2023-09-13T06:06:03.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1c6d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1413c310 con 0x7fcf14160e60 2023-09-13T06:06:03.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1a474640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf141575a0 0x7fcf1413bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1a474640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf141575a0 0x7fcf1413bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54394/0 (socket says 172.21.15.130:54394) 2023-09-13T06:06:03.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1a474640 1 -- 172.21.15.130:0/3623298664 learned_addr learned my addr 172.21.15.130:0/3623298664 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:03.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf19c73640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf14157980 0x7fcf141600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1ac75640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf14160e60 0x7fcf1406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1a474640 1 -- 172.21.15.130:0/3623298664 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf14160e60 msgr2=0x7fcf1406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.397+0000 7fcf1a474640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf14160e60 0x7fcf1406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf1a474640 1 -- 172.21.15.130:0/3623298664 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf14157980 msgr2=0x7fcf141600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf1a474640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf14157980 0x7fcf141600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf1a474640 1 -- 172.21.15.130:0/3623298664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c009a70 con 0x7fcf141575a0 2023-09-13T06:06:03.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf1ac75640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf14160e60 0x7fcf1406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:03.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf1a474640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf141575a0 0x7fcf1413bdd0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000b440 tx=0x7fcf1000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:03.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf0affd640 1 -- 172.21.15.130:0/3623298664 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10011890 con 0x7fcf141575a0 2023-09-13T06:06:03.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf0affd640 1 -- 172.21.15.130:0/3623298664 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10011a10 con 0x7fcf141575a0 2023-09-13T06:06:03.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf0affd640 1 -- 172.21.15.130:0/3623298664 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10011dc0 con 0x7fcf141575a0 2023-09-13T06:06:03.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/3623298664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf140cd690 con 0x7fcf141575a0 2023-09-13T06:06:03.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/3623298664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf140cdc50 con 0x7fcf141575a0 2023-09-13T06:06:03.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/3623298664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf141580f0 con 0x7fcf141575a0 2023-09-13T06:06:03.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf0affd640 1 -- 172.21.15.130:0/3623298664 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcf1001a400 con 0x7fcf141575a0 2023-09-13T06:06:03.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf0affd640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcef8065b20 0x7fcef8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf0affd640 1 -- 172.21.15.130:0/3623298664 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf100835f0 con 0x7fcf141575a0 2023-09-13T06:06:03.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf19c73640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcef8065b20 0x7fcef8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.401+0000 7fcf0affd640 1 -- 172.21.15.130:0/3623298664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7fcef806d650 con 0x7fcf141575a0 2023-09-13T06:06:03.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.405+0000 7fcf19c73640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcef8065b20 0x7fcef8067fe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcf140ae8e0 tx=0x7fcf04007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:03.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.405+0000 7fcf0affd640 1 -- 172.21.15.130:0/3623298664 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcf10015060 con 0x7fcf141575a0 2023-09-13T06:06:03.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.557+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/3623298664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf140618a0 con 0x7fcf141575a0 2023-09-13T06:06:03.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.557+0000 7fcf0affd640 1 -- 172.21.15.130:0/3623298664 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16626 (secure 0 0 0) 0x7fcf10050ea0 con 0x7fcf141575a0 2023-09-13T06:06:03.561 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:03.561 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":89,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:03.378803+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:05:25.196040+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-09-13T06:05:25.825807+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:03.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/3623298664 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcef8065b20 msgr2=0x7fcef8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcef8065b20 0x7fcef8067fe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcf140ae8e0 tx=0x7fcf04007d40 comp rx=0 tx=0).stop 2023-09-13T06:06:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/3623298664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf141575a0 msgr2=0x7fcf1413bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf141575a0 0x7fcf1413bdd0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000b440 tx=0x7fcf1000b900 comp rx=0 tx=0).stop 2023-09-13T06:06:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/3623298664 shutdown_connections 2023-09-13T06:06:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcef8065b20 0x7fcef8067fe0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf14157980 0x7fcf141600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf14160e60 0x7fcf1406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 --2- 172.21.15.130:0/3623298664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf141575a0 0x7fcf1413bdd0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/3623298664 >> 172.21.15.130:0/3623298664 conn(0x7fcf14065990 msgr2=0x7fcf14070570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/3623298664 shutdown_connections 2023-09-13T06:06:03.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.561+0000 7fcf1c6d8640 1 -- 172.21.15.130:0/3623298664 wait complete. 2023-09-13T06:06:03.587 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:06:03.589 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:03.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.729+0000 7f9492d11640 1 Processor -- start 2023-09-13T06:06:03.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.729+0000 7f9492d11640 1 -- start start 2023-09-13T06:06:03.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.729+0000 7f9492d11640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f948c1436e0 0x7f948c0ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.729+0000 7f9492d11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f948c0acd80 0x7f948c070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.729+0000 7f9492d11640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f948c146540 0x7f948c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.729+0000 7f9492d11640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c06f640 con 0x7f948c1436e0 2023-09-13T06:06:03.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.729+0000 7f9492d11640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c06f890 con 0x7f948c146540 2023-09-13T06:06:03.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.729+0000 7f9492d11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c06fb70 con 0x7f948c0acd80 2023-09-13T06:06:03.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f9490aad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f948c1436e0 0x7f948c0ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f9490aad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f948c1436e0 0x7f948c0ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54400/0 (socket says 172.21.15.130:54400) 2023-09-13T06:06:03.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f9490aad640 1 -- 172.21.15.130:0/1878736653 learned_addr learned my addr 172.21.15.130:0/1878736653 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:03.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f94912ae640 1 --2- 172.21.15.130:0/1878736653 >> v2:172.21.15.164:3300/0 conn(0x7f948c146540 0x7f948c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f9483fff640 1 --2- 172.21.15.130:0/1878736653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f948c0acd80 0x7f948c070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f9490aad640 1 -- 172.21.15.130:0/1878736653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f948c0acd80 msgr2=0x7f948c070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:03.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f9490aad640 1 --2- 172.21.15.130:0/1878736653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f948c0acd80 0x7f948c070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f9490aad640 1 -- 172.21.15.130:0/1878736653 >> v2:172.21.15.164:3300/0 conn(0x7f948c146540 msgr2=0x7f948c070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:03.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f9490aad640 1 --2- 172.21.15.130:0/1878736653 >> v2:172.21.15.164:3300/0 conn(0x7f948c146540 0x7f948c070b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f9490aad640 1 -- 172.21.15.130:0/1878736653 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c06fe50 con 0x7f948c1436e0 2023-09-13T06:06:03.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f94912ae640 1 --2- 172.21.15.130:0/1878736653 >> v2:172.21.15.164:3300/0 conn(0x7f948c146540 0x7f948c070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:03.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f9483fff640 1 --2- 172.21.15.130:0/1878736653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f948c0acd80 0x7f948c070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:03.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f9490aad640 1 --2- 172.21.15.130:0/1878736653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f948c1436e0 0x7f948c0ac840 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f948c06bd60 tx=0x7f948801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed30fb22a0cab6f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:03.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f94837fe640 1 -- 172.21.15.130:0/1878736653 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c146e10 con 0x7f948c1436e0 2023-09-13T06:06:03.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f94837fe640 1 -- 172.21.15.130:0/1878736653 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94880a7050 con 0x7f948c1436e0 2023-09-13T06:06:03.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.733+0000 7f94837fe640 1 -- 172.21.15.130:0/1878736653 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880ab820 con 0x7f948c1436e0 2023-09-13T06:06:03.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 -- 172.21.15.130:0/1878736653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f948c1436e0 msgr2=0x7f948c0ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 --2- 172.21.15.130:0/1878736653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f948c1436e0 0x7f948c0ac840 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f948c06bd60 tx=0x7f948801c3e0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 -- 172.21.15.130:0/1878736653 shutdown_connections 2023-09-13T06:06:03.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 --2- 172.21.15.130:0/1878736653 >> v2:172.21.15.164:3300/0 conn(0x7f948c146540 0x7f948c070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 --2- 172.21.15.130:0/1878736653 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f948c0acd80 0x7f948c070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 --2- 172.21.15.130:0/1878736653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f948c1436e0 0x7f948c0ac840 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 -- 172.21.15.130:0/1878736653 >> 172.21.15.130:0/1878736653 conn(0x7f948c0b0bc0 msgr2=0x7f948c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:03.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 -- 172.21.15.130:0/1878736653 shutdown_connections 2023-09-13T06:06:03.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 -- 172.21.15.130:0/1878736653 wait complete. 2023-09-13T06:06:03.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 Processor -- start 2023-09-13T06:06:03.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 -- start start 2023-09-13T06:06:03.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f948c0acd80 0x7f948c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f948c1436e0 0x7f948c162050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f948c146540 0x7f948c15f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c15d840 con 0x7f948c0acd80 2023-09-13T06:06:03.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c15e010 con 0x7f948c146540 2023-09-13T06:06:03.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9492d11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c1645d0 con 0x7f948c1436e0 2023-09-13T06:06:03.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9490aad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f948c0acd80 0x7f948c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9490aad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f948c0acd80 0x7f948c15cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54412/0 (socket says 172.21.15.130:54412) 2023-09-13T06:06:03.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9490aad640 1 -- 172.21.15.130:0/545628395 learned_addr learned my addr 172.21.15.130:0/545628395 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:03.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f94912ae640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f948c146540 0x7f948c15f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9483fff640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f948c1436e0 0x7f948c162050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.737+0000 7f9490aad640 1 -- 172.21.15.130:0/545628395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f948c1436e0 msgr2=0x7f948c162050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f9490aad640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f948c1436e0 0x7f948c162050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f9490aad640 1 -- 172.21.15.130:0/545628395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f948c146540 msgr2=0x7f948c15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f9490aad640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f948c146540 0x7f948c15f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f9490aad640 1 -- 172.21.15.130:0/545628395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880094d0 con 0x7f948c0acd80 2023-09-13T06:06:03.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f9490aad640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f948c0acd80 0x7f948c15cb70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f94880ae040 tx=0x7f9488019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:03.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f94817fa640 1 -- 172.21.15.130:0/545628395 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880b37d0 con 0x7f948c0acd80 2023-09-13T06:06:03.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f94817fa640 1 -- 172.21.15.130:0/545628395 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94880b3930 con 0x7f948c0acd80 2023-09-13T06:06:03.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f9492d11640 1 -- 172.21.15.130:0/545628395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c15da50 con 0x7f948c0acd80 2023-09-13T06:06:03.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f94817fa640 1 -- 172.21.15.130:0/545628395 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880b3ce0 con 0x7f948c0acd80 2023-09-13T06:06:03.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f9492d11640 1 -- 172.21.15.130:0/545628395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c164870 con 0x7f948c0acd80 2023-09-13T06:06:03.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f9492d11640 1 -- 172.21.15.130:0/545628395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c164410 con 0x7f948c0acd80 2023-09-13T06:06:03.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f94817fa640 1 -- 172.21.15.130:0/545628395 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f94880b2070 con 0x7f948c0acd80 2023-09-13T06:06:03.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f94817fa640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9478065b20 0x7f9478067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:03.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f94817fa640 1 -- 172.21.15.130:0/545628395 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f948811d6d0 con 0x7f948c0acd80 2023-09-13T06:06:03.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f9483fff640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9478065b20 0x7f9478067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:03.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.741+0000 7f94817fa640 1 -- 172.21.15.130:0/545628395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f947806d650 con 0x7f948c0acd80 2023-09-13T06:06:03.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.745+0000 7f9483fff640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9478065b20 0x7f9478067fe0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f948c0afe30 tx=0x7f947c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:03.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.745+0000 7f94817fa640 1 -- 172.21.15.130:0/545628395 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f94880eaf80 con 0x7f948c0acd80 2023-09-13T06:06:03.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.925+0000 7f9492d11640 1 -- 172.21.15.130:0/545628395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f948c164a60 con 0x7f948c0acd80 2023-09-13T06:06:03.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.925+0000 7f94817fa640 1 -- 172.21.15.130:0/545628395 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f94880b0090 con 0x7f948c0acd80 2023-09-13T06:06:03.929 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:03.929 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2267621007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2267621007},{"type":"v1","addr":"172.21.15.164:6834","nonce":2267621007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5663,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/658594571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":658594571},{"type":"v1","addr":"172.21.15.164:6835","nonce":658594571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6474,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1441650800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1441650800},{"type":"v1","addr":"172.21.15.130:6836","nonce":1441650800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:05:26.837419+0000","modified":"2023-09-13T06:05:29.861380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6477},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6477":{"gid":6477,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/428674793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":428674793},{"type":"v1","addr":"172.21.15.130:6837","nonce":428674793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-09-13T06:06:03.929 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 43 2023-09-13T06:06:03.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 -- 172.21.15.130:0/545628395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9478065b20 msgr2=0x7f9478067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9478065b20 0x7f9478067fe0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f948c0afe30 tx=0x7f947c008040 comp rx=0 tx=0).stop 2023-09-13T06:06:03.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 -- 172.21.15.130:0/545628395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f948c0acd80 msgr2=0x7f948c15cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:03.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f948c0acd80 0x7f948c15cb70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f94880ae040 tx=0x7f9488019180 comp rx=0 tx=0).stop 2023-09-13T06:06:03.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 -- 172.21.15.130:0/545628395 shutdown_connections 2023-09-13T06:06:03.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9478065b20 0x7f9478067fe0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f948c146540 0x7f948c15f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f948c1436e0 0x7f948c162050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 --2- 172.21.15.130:0/545628395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f948c0acd80 0x7f948c15cb70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:03.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 -- 172.21.15.130:0/545628395 >> 172.21.15.130:0/545628395 conn(0x7f948c0b0bc0 msgr2=0x7f948c0b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:03.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 -- 172.21.15.130:0/545628395 shutdown_connections 2023-09-13T06:06:03.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:03.929+0000 7f9492d11640 1 -- 172.21.15.130:0/545628395 wait complete. 2023-09-13T06:06:03.949 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:04.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.089+0000 7fa50abdb640 1 Processor -- start 2023-09-13T06:06:04.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.089+0000 7fa50abdb640 1 -- start start 2023-09-13T06:06:04.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.089+0000 7fa50abdb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa504157920 0x7fa5040ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.089+0000 7fa50abdb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa5040b0f40 0x7fa5040b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.089+0000 7fa50abdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa50415e560 0x7fa5040b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.089+0000 7fa50abdb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5040aea50 con 0x7fa504157920 2023-09-13T06:06:04.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.089+0000 7fa50abdb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5040b0b20 con 0x7fa5040b0f40 2023-09-13T06:06:04.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.089+0000 7fa50abdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040afee0 con 0x7fa50415e560 2023-09-13T06:06:04.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa508977640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa504157920 0x7fa5040ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa508977640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa504157920 0x7fa5040ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54422/0 (socket says 172.21.15.130:54422) 2023-09-13T06:06:04.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa508977640 1 -- 172.21.15.130:0/2300481736 learned_addr learned my addr 172.21.15.130:0/2300481736 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:04.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa509178640 1 --2- 172.21.15.130:0/2300481736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa50415e560 0x7fa5040b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa503fff640 1 --2- 172.21.15.130:0/2300481736 >> v2:172.21.15.164:3300/0 conn(0x7fa5040b0f40 0x7fa5040b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa508977640 1 -- 172.21.15.130:0/2300481736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa50415e560 msgr2=0x7fa5040b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:04.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa508977640 1 --2- 172.21.15.130:0/2300481736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa50415e560 0x7fa5040b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa508977640 1 -- 172.21.15.130:0/2300481736 >> v2:172.21.15.164:3300/0 conn(0x7fa5040b0f40 msgr2=0x7fa5040b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:04.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa508977640 1 --2- 172.21.15.130:0/2300481736 >> v2:172.21.15.164:3300/0 conn(0x7fa5040b0f40 0x7fa5040b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa508977640 1 -- 172.21.15.130:0/2300481736 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5040b0180 con 0x7fa504157920 2023-09-13T06:06:04.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa503fff640 1 --2- 172.21.15.130:0/2300481736 >> v2:172.21.15.164:3300/0 conn(0x7fa5040b0f40 0x7fa5040b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:04.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa508977640 1 --2- 172.21.15.130:0/2300481736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa504157920 0x7fa5040ae190 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa50406e070 tx=0x7fa4f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2550d7312a71f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:04.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa5037fe640 1 -- 172.21.15.130:0/2300481736 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80aa5f0 con 0x7fa504157920 2023-09-13T06:06:04.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.093+0000 7fa5037fe640 1 -- 172.21.15.130:0/2300481736 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f80aa750 con 0x7fa504157920 2023-09-13T06:06:04.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa5037fe640 1 -- 172.21.15.130:0/2300481736 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80aaae0 con 0x7fa504157920 2023-09-13T06:06:04.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 -- 172.21.15.130:0/2300481736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa504157920 msgr2=0x7fa5040ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 --2- 172.21.15.130:0/2300481736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa504157920 0x7fa5040ae190 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa50406e070 tx=0x7fa4f801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 -- 172.21.15.130:0/2300481736 shutdown_connections 2023-09-13T06:06:04.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 --2- 172.21.15.130:0/2300481736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa50415e560 0x7fa5040b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 --2- 172.21.15.130:0/2300481736 >> v2:172.21.15.164:3300/0 conn(0x7fa5040b0f40 0x7fa5040b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 --2- 172.21.15.130:0/2300481736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa504157920 0x7fa5040ae190 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 -- 172.21.15.130:0/2300481736 >> 172.21.15.130:0/2300481736 conn(0x7fa504065990 msgr2=0x7fa504065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:04.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 -- 172.21.15.130:0/2300481736 shutdown_connections 2023-09-13T06:06:04.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 -- 172.21.15.130:0/2300481736 wait complete. 2023-09-13T06:06:04.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 Processor -- start 2023-09-13T06:06:04.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 -- start start 2023-09-13T06:06:04.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5040b0f40 0x7fa504149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa504157920 0x7fa5041525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa50415e560 0x7fa50406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa504153350 con 0x7fa504157920 2023-09-13T06:06:04.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa504153070 con 0x7fa50415e560 2023-09-13T06:06:04.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa50abdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50414f020 con 0x7fa5040b0f40 2023-09-13T06:06:04.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa503fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa504157920 0x7fa5041525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa503fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa504157920 0x7fa5041525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54434/0 (socket says 172.21.15.130:54434) 2023-09-13T06:06:04.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa508977640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5040b0f40 0x7fa504149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.097+0000 7fa503fff640 1 -- 172.21.15.130:0/48126881 learned_addr learned my addr 172.21.15.130:0/48126881 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:04.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa509178640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa50415e560 0x7fa50406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa503fff640 1 -- 172.21.15.130:0/48126881 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5040b0f40 msgr2=0x7fa504149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa503fff640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5040b0f40 0x7fa504149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa503fff640 1 -- 172.21.15.130:0/48126881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa50415e560 msgr2=0x7fa50406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa503fff640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa50415e560 0x7fa50406ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa503fff640 1 -- 172.21.15.130:0/48126881 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80094d0 con 0x7fa504157920 2023-09-13T06:06:04.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa508977640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5040b0f40 0x7fa504149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:04.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa503fff640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa504157920 0x7fa5041525b0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000e810 tx=0x7fa4f000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:04.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa5017fa640 1 -- 172.21.15.130:0/48126881 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0004030 con 0x7fa504157920 2023-09-13T06:06:04.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa5017fa640 1 -- 172.21.15.130:0/48126881 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f0004190 con 0x7fa504157920 2023-09-13T06:06:04.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa5017fa640 1 -- 172.21.15.130:0/48126881 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0004520 con 0x7fa504157920 2023-09-13T06:06:04.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa50abdb640 1 -- 172.21.15.130:0/48126881 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50414f300 con 0x7fa504157920 2023-09-13T06:06:04.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa50abdb640 1 -- 172.21.15.130:0/48126881 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa504149d00 con 0x7fa504157920 2023-09-13T06:06:04.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa50abdb640 1 -- 172.21.15.130:0/48126881 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50414ee80 con 0x7fa504157920 2023-09-13T06:06:04.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa5017fa640 1 -- 172.21.15.130:0/48126881 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa4f000c6d0 con 0x7fa504157920 2023-09-13T06:06:04.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa5017fa640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4e8065b20 0x7fa4e8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.101+0000 7fa5017fa640 1 -- 172.21.15.130:0/48126881 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4f0082db0 con 0x7fa504157920 2023-09-13T06:06:04.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.105+0000 7fa508977640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4e8065b20 0x7fa4e8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.105+0000 7fa5017fa640 1 -- 172.21.15.130:0/48126881 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7fa4e806d650 con 0x7fa504157920 2023-09-13T06:06:04.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.105+0000 7fa508977640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4e8065b20 0x7fa4e8067fe0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80ae000 tx=0x7fa4f80b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:04.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.105+0000 7fa5017fa640 1 -- 172.21.15.130:0/48126881 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa50414ee80 con 0x7fa504157920 2023-09-13T06:06:04.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.285+0000 7fa50abdb640 1 -- 172.21.15.130:0/48126881 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa50414ee80 con 0x7fa504157920 2023-09-13T06:06:04.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.285+0000 7fa5017fa640 1 -- 172.21.15.130:0/48126881 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fa50414ee80 con 0x7fa504157920 2023-09-13T06:06:04.289 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:04.290 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2267621007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2267621007},{"type":"v1","addr":"172.21.15.164:6834","nonce":2267621007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5663,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/658594571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":658594571},{"type":"v1","addr":"172.21.15.164:6835","nonce":658594571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6474,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1441650800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1441650800},{"type":"v1","addr":"172.21.15.130:6836","nonce":1441650800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:05:26.837419+0000","modified":"2023-09-13T06:05:29.861380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6477},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6477":{"gid":6477,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/428674793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":428674793},{"type":"v1","addr":"172.21.15.130:6837","nonce":428674793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-09-13T06:06:04.290 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 43 2023-09-13T06:06:04.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 -- 172.21.15.130:0/48126881 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4e8065b20 msgr2=0x7fa4e8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4e8065b20 0x7fa4e8067fe0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80ae000 tx=0x7fa4f80b5040 comp rx=0 tx=0).stop 2023-09-13T06:06:04.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 -- 172.21.15.130:0/48126881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa504157920 msgr2=0x7fa5041525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa504157920 0x7fa5041525b0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000e810 tx=0x7fa4f000ecd0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 -- 172.21.15.130:0/48126881 shutdown_connections 2023-09-13T06:06:04.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa4e8065b20 0x7fa4e8067fe0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa50415e560 0x7fa50406ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa504157920 0x7fa5041525b0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 --2- 172.21.15.130:0/48126881 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5040b0f40 0x7fa504149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 -- 172.21.15.130:0/48126881 >> 172.21.15.130:0/48126881 conn(0x7fa504065990 msgr2=0x7fa5040ad480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:04.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 -- 172.21.15.130:0/48126881 shutdown_connections 2023-09-13T06:06:04.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.289+0000 7fa50abdb640 1 -- 172.21.15.130:0/48126881 wait complete. 2023-09-13T06:06:04.310 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:04.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.449+0000 7fe811a19640 1 Processor -- start 2023-09-13T06:06:04.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe811a19640 1 -- start start 2023-09-13T06:06:04.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe811a19640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe80c0ae170 0x7fe80c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe811a19640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe80c15d9d0 0x7fe80c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe811a19640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0cce60 con 0x7fe80c15d5f0 2023-09-13T06:06:04.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe811a19640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0cd140 con 0x7fe80c15d9d0 2023-09-13T06:06:04.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe811a19640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0cd420 con 0x7fe80c0ae170 2023-09-13T06:06:04.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe80affd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe80c15d5f0 0x7fe80c1591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:44274/0 (socket says 172.21.15.130:44274) 2023-09-13T06:06:04.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe80affd640 1 -- 172.21.15.130:0/3244120995 learned_addr learned my addr 172.21.15.130:0/3244120995 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:04.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe80b7fe640 1 --2- 172.21.15.130:0/3244120995 >> v2:172.21.15.130:3300/0 conn(0x7fe80c15d9d0 0x7fe80c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe80b7fe640 1 -- 172.21.15.130:0/3244120995 >> v2:172.21.15.164:3300/0 conn(0x7fe80c0ae170 msgr2=0x7fe80c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:04.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe8027fc640 1 --2- 172.21.15.130:0/3244120995 >> v2:172.21.15.164:3300/0 conn(0x7fe80c0ae170 0x7fe80c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe80b7fe640 1 --2- 172.21.15.130:0/3244120995 >> v2:172.21.15.164:3300/0 conn(0x7fe80c0ae170 0x7fe80c0cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe80b7fe640 1 -- 172.21.15.130:0/3244120995 >> v1:172.21.15.130:6789/0 conn(0x7fe80c15d5f0 legacy=0x7fe80c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe80b7fe640 1 -- 172.21.15.130:0/3244120995 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0cd700 con 0x7fe80c15d9d0 2023-09-13T06:06:04.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe80a7fc640 1 -- 172.21.15.130:0/3244120995 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903528131 0 0) 0x7fe80c0cce60 con 0x7fe80c15d5f0 2023-09-13T06:06:04.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.453+0000 7fe8027fc640 1 --2- 172.21.15.130:0/3244120995 >> v2:172.21.15.164:3300/0 conn(0x7fe80c0ae170 0x7fe80c0cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:04.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe80b7fe640 1 --2- 172.21.15.130:0/3244120995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe80c15d9d0 0x7fe80c0cb040 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0adb30 tx=0x7fe80401d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498024fcd1f9387a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:04.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe80a7fc640 1 -- 172.21.15.130:0/3244120995 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040a6900 con 0x7fe80c15d9d0 2023-09-13T06:06:04.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe80a7fc640 1 -- 172.21.15.130:0/3244120995 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8040a6a60 con 0x7fe80c15d9d0 2023-09-13T06:06:04.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe80a7fc640 1 -- 172.21.15.130:0/3244120995 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040a6df0 con 0x7fe80c15d9d0 2023-09-13T06:06:04.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe811a19640 1 -- 172.21.15.130:0/3244120995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe80c15d9d0 msgr2=0x7fe80c0cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe811a19640 1 --2- 172.21.15.130:0/3244120995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe80c15d9d0 0x7fe80c0cb040 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0adb30 tx=0x7fe80401d990 comp rx=0 tx=0).stop 2023-09-13T06:06:04.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe811a19640 1 -- 172.21.15.130:0/3244120995 shutdown_connections 2023-09-13T06:06:04.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe811a19640 1 --2- 172.21.15.130:0/3244120995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe80c15d9d0 0x7fe80c0cb040 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe811a19640 1 --2- 172.21.15.130:0/3244120995 >> v2:172.21.15.164:3300/0 conn(0x7fe80c0ae170 0x7fe80c0cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe811a19640 1 -- 172.21.15.130:0/3244120995 >> 172.21.15.130:0/3244120995 conn(0x7fe80c065990 msgr2=0x7fe80c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:04.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe811a19640 1 -- 172.21.15.130:0/3244120995 shutdown_connections 2023-09-13T06:06:04.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe811a19640 1 -- 172.21.15.130:0/3244120995 wait complete. 2023-09-13T06:06:04.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe811a19640 1 Processor -- start 2023-09-13T06:06:04.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.457+0000 7fe811a19640 1 -- start start 2023-09-13T06:06:04.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe811a19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80c0ae170 0x7fe80c13dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe811a19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe80c15d5f0 0x7fe80c154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe811a19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe80c15d9d0 0x7fe80c154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe811a19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c1534c0 con 0x7fe80c15d9d0 2023-09-13T06:06:04.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe811a19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c13e2a0 con 0x7fe80c0ae170 2023-09-13T06:06:04.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe811a19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c153710 con 0x7fe80c15d5f0 2023-09-13T06:06:04.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe80b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe80c15d9d0 0x7fe80c154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe80b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe80c15d9d0 0x7fe80c154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54460/0 (socket says 172.21.15.130:54460) 2023-09-13T06:06:04.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe80b7fe640 1 -- 172.21.15.130:0/2336832154 learned_addr learned my addr 172.21.15.130:0/2336832154 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:04.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe80affd640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80c0ae170 0x7fe80c13dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe8027fc640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe80c15d5f0 0x7fe80c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe80b7fe640 1 -- 172.21.15.130:0/2336832154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe80c15d5f0 msgr2=0x7fe80c154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe80b7fe640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe80c15d5f0 0x7fe80c154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe80b7fe640 1 -- 172.21.15.130:0/2336832154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80c0ae170 msgr2=0x7fe80c13dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe80b7fe640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80c0ae170 0x7fe80c13dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe80b7fe640 1 -- 172.21.15.130:0/2336832154 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804009a70 con 0x7fe80c15d9d0 2023-09-13T06:06:04.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe8027fc640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe80c15d5f0 0x7fe80c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:04.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe80b7fe640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe80c15d9d0 0x7fe80c154ec0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe80401a5a0 tx=0x7fe80401c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:04.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe808ff9640 1 -- 172.21.15.130:0/2336832154 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040ae9d0 con 0x7fe80c15d9d0 2023-09-13T06:06:04.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe808ff9640 1 -- 172.21.15.130:0/2336832154 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8040aeb30 con 0x7fe80c15d9d0 2023-09-13T06:06:04.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe811a19640 1 -- 172.21.15.130:0/2336832154 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c1539f0 con 0x7fe80c15d9d0 2023-09-13T06:06:04.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe808ff9640 1 -- 172.21.15.130:0/2336832154 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040b9420 con 0x7fe80c15d9d0 2023-09-13T06:06:04.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe811a19640 1 -- 172.21.15.130:0/2336832154 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c153fb0 con 0x7fe80c15d9d0 2023-09-13T06:06:04.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe811a19640 1 -- 172.21.15.130:0/2336832154 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c0618a0 con 0x7fe80c15d9d0 2023-09-13T06:06:04.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.461+0000 7fe808ff9640 1 -- 172.21.15.130:0/2336832154 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe8040b5040 con 0x7fe80c15d9d0 2023-09-13T06:06:04.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.465+0000 7fe808ff9640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe7ec065b20 0x7fe7ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.465+0000 7fe808ff9640 1 -- 172.21.15.130:0/2336832154 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe80411e500 con 0x7fe80c15d9d0 2023-09-13T06:06:04.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.465+0000 7fe80affd640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe7ec065b20 0x7fe7ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.465+0000 7fe80affd640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe7ec065b20 0x7fe7ec067fe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc000f70 tx=0x7fe7fc007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:04.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.469+0000 7fe808ff9640 1 -- 172.21.15.130:0/2336832154 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe8040ebd20 con 0x7fe80c15d9d0 2023-09-13T06:06:04.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 -- 172.21.15.130:0/2336832154 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe80c0cbaf0 con 0x7fe80c15d9d0 2023-09-13T06:06:04.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe808ff9640 1 -- 172.21.15.130:0/2336832154 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16604 (secure 0 0 0) 0x7fe8040ef340 con 0x7fe80c15d9d0 2023-09-13T06:06:04.622 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:04.623 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":90,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:04.389999+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:05:25.196040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-09-13T06:05:25.825807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 -- 172.21.15.130:0/2336832154 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe7ec065b20 msgr2=0x7fe7ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe7ec065b20 0x7fe7ec067fe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc000f70 tx=0x7fe7fc007b60 comp rx=0 tx=0).stop 2023-09-13T06:06:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 -- 172.21.15.130:0/2336832154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe80c15d9d0 msgr2=0x7fe80c154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe80c15d9d0 0x7fe80c154ec0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe80401a5a0 tx=0x7fe80401c1d0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 -- 172.21.15.130:0/2336832154 shutdown_connections 2023-09-13T06:06:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe7ec065b20 0x7fe7ec067fe0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe80c15d9d0 0x7fe80c154ec0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe80c15d5f0 0x7fe80c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 --2- 172.21.15.130:0/2336832154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe80c0ae170 0x7fe80c13dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 -- 172.21.15.130:0/2336832154 >> 172.21.15.130:0/2336832154 conn(0x7fe80c065990 msgr2=0x7fe80c158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 -- 172.21.15.130:0/2336832154 shutdown_connections 2023-09-13T06:06:04.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.621+0000 7fe811a19640 1 -- 172.21.15.130:0/2336832154 wait complete. 2023-09-13T06:06:04.644 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T06:06:04.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.781+0000 7f877e359640 1 Processor -- start 2023-09-13T06:06:04.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.781+0000 7f877e359640 1 -- start start 2023-09-13T06:06:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877e359640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8778159f20 0x7f87780ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877e359640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f87780b1d20 0x7f87780b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877e359640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87780ccfd0 con 0x7f87780cdfc0 2023-09-13T06:06:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877e359640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87780b00f0 con 0x7f87780b1d20 2023-09-13T06:06:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877e359640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87780ce420 con 0x7f8778159f20 2023-09-13T06:06:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877c8f6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f87780b1d20 0x7f87780b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f87777fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f87780cdfc0 0x7f87780b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:44284/0 (socket says 172.21.15.130:44284) 2023-09-13T06:06:04.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877c8f6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f87780b1d20 0x7f87780b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54472/0 (socket says 172.21.15.130:54472) 2023-09-13T06:06:04.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f87777fe640 1 -- 172.21.15.130:0/992504188 learned_addr learned my addr 172.21.15.130:0/992504188 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:04.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f8777fff640 1 --2- 172.21.15.130:0/992504188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8778159f20 0x7f87780ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877c8f6640 1 -- 172.21.15.130:0/992504188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8778159f20 msgr2=0x7f87780ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:04.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877c8f6640 1 --2- 172.21.15.130:0/992504188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8778159f20 0x7f87780ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877c8f6640 1 -- 172.21.15.130:0/992504188 >> v1:172.21.15.130:6789/0 conn(0x7f87780cdfc0 legacy=0x7f87780b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877c8f6640 1 -- 172.21.15.130:0/992504188 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780ced90 con 0x7f87780b1d20 2023-09-13T06:06:04.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f8777fff640 1 --2- 172.21.15.130:0/992504188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8778159f20 0x7f87780ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:04.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f877c8f6640 1 --2- 172.21.15.130:0/992504188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87780b1d20 0x7f87780b0c90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8770009d90 tx=0x7f877001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c514a68e893ee1c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:04.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f8776ffd640 1 -- 172.21.15.130:0/992504188 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700a5900 con 0x7f87780b1d20 2023-09-13T06:06:04.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f8776ffd640 1 -- 172.21.15.130:0/992504188 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87700a5a60 con 0x7f87780b1d20 2023-09-13T06:06:04.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.785+0000 7f8776ffd640 1 -- 172.21.15.130:0/992504188 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700a5df0 con 0x7f87780b1d20 2023-09-13T06:06:04.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 -- 172.21.15.130:0/992504188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87780b1d20 msgr2=0x7f87780b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 --2- 172.21.15.130:0/992504188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87780b1d20 0x7f87780b0c90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8770009d90 tx=0x7f877001c950 comp rx=0 tx=0).stop 2023-09-13T06:06:04.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 -- 172.21.15.130:0/992504188 shutdown_connections 2023-09-13T06:06:04.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 --2- 172.21.15.130:0/992504188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87780b1d20 0x7f87780b0c90 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 --2- 172.21.15.130:0/992504188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8778159f20 0x7f87780ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 -- 172.21.15.130:0/992504188 >> 172.21.15.130:0/992504188 conn(0x7f8778065990 msgr2=0x7f8778065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:04.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 -- 172.21.15.130:0/992504188 shutdown_connections 2023-09-13T06:06:04.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 -- 172.21.15.130:0/992504188 wait complete. 2023-09-13T06:06:04.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 Processor -- start 2023-09-13T06:06:04.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 -- start start 2023-09-13T06:06:04.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87780b1d20 0x7f877813f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87780cdfc0 0x7f877814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8778159f20 0x7f87781579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87780ad550 con 0x7f8778159f20 2023-09-13T06:06:04.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87780ad270 con 0x7f87780cdfc0 2023-09-13T06:06:04.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877e359640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877814de00 con 0x7f87780b1d20 2023-09-13T06:06:04.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.789+0000 7f877c8f6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8778159f20 0x7f87781579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f877c8f6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8778159f20 0x7f87781579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54480/0 (socket says 172.21.15.130:54480) 2023-09-13T06:06:04.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f877c8f6640 1 -- 172.21.15.130:0/3096674192 learned_addr learned my addr 172.21.15.130:0/3096674192 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:04.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f87777fe640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87780cdfc0 0x7f877814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f8777fff640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87780b1d20 0x7f877813f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f877c8f6640 1 -- 172.21.15.130:0/3096674192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87780b1d20 msgr2=0x7f877813f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f877c8f6640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87780b1d20 0x7f877813f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f877c8f6640 1 -- 172.21.15.130:0/3096674192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87780cdfc0 msgr2=0x7f877814e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f877c8f6640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87780cdfc0 0x7f877814e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f877c8f6640 1 -- 172.21.15.130:0/3096674192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8770009a70 con 0x7f8778159f20 2023-09-13T06:06:04.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f877c8f6640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8778159f20 0x7f87781579a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f87700b0040 tx=0x7f87700196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:04.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f8774ff9640 1 -- 172.21.15.130:0/3096674192 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700b9860 con 0x7f8778159f20 2023-09-13T06:06:04.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f8774ff9640 1 -- 172.21.15.130:0/3096674192 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87700a58f0 con 0x7f8778159f20 2023-09-13T06:06:04.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f8774ff9640 1 -- 172.21.15.130:0/3096674192 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700b9c00 con 0x7f8778159f20 2023-09-13T06:06:04.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f877e359640 1 -- 172.21.15.130:0/3096674192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877814e0e0 con 0x7f8778159f20 2023-09-13T06:06:04.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f877e359640 1 -- 172.21.15.130:0/3096674192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877813ff00 con 0x7f8778159f20 2023-09-13T06:06:04.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f877e359640 1 -- 172.21.15.130:0/3096674192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87780618a0 con 0x7f8778159f20 2023-09-13T06:06:04.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f8774ff9640 1 -- 172.21.15.130:0/3096674192 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f87700ad440 con 0x7f8778159f20 2023-09-13T06:06:04.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f8774ff9640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8764065b20 0x7f8764067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:04.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f8774ff9640 1 -- 172.21.15.130:0/3096674192 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f877011e7c0 con 0x7f8778159f20 2023-09-13T06:06:04.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.793+0000 7f8777fff640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8764065b20 0x7f8764067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:04.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.797+0000 7f8777fff640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8764065b20 0x7f8764067fe0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f876800b930 tx=0x7f8768008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:04.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.797+0000 7f8774ff9640 1 -- 172.21.15.130:0/3096674192 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f87700ec070 con 0x7f8778159f20 2023-09-13T06:06:04.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.977+0000 7f877e359640 1 -- 172.21.15.130:0/3096674192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f877814e590 con 0x7f8778159f20 2023-09-13T06:06:04.979 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:06:04.977+0000 7faa00e50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T06:06:04.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.981+0000 7f8774ff9640 1 -- 172.21.15.130:0/3096674192 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7f87700ef690 con 0x7f8778159f20 2023-09-13T06:06:04.985 INFO:teuthology.orchestra.run.smithi130.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T06:06:04.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 -- 172.21.15.130:0/3096674192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8764065b20 msgr2=0x7f8764067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8764065b20 0x7f8764067fe0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f876800b930 tx=0x7f8768008040 comp rx=0 tx=0).stop 2023-09-13T06:06:04.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 -- 172.21.15.130:0/3096674192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8778159f20 msgr2=0x7f87781579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:04.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8778159f20 0x7f87781579a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f87700b0040 tx=0x7f87700196f0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 -- 172.21.15.130:0/3096674192 shutdown_connections 2023-09-13T06:06:04.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8764065b20 0x7f8764067fe0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87780cdfc0 0x7f877814e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8778159f20 0x7f87781579a0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 --2- 172.21.15.130:0/3096674192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87780b1d20 0x7f877813f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:04.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 -- 172.21.15.130:0/3096674192 >> 172.21.15.130:0/3096674192 conn(0x7f8778065990 msgr2=0x7f877806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:04.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 -- 172.21.15.130:0/3096674192 shutdown_connections 2023-09-13T06:06:04.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:04.985+0000 7f877e359640 1 -- 172.21.15.130:0/3096674192 wait complete. 2023-09-13T06:06:05.007 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T06:06:05.050 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:06:05.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff7036ec640 1 Processor -- start 2023-09-13T06:06:05.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff7036ec640 1 -- start start 2023-09-13T06:06:05.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff7036ec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff6fc162c10 0x7ff6fc1660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:05.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff7036ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff6fc0ce080 0x7ff6fc0ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:05.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff7036ec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0b0cc0 con 0x7ff6fc1619d0 2023-09-13T06:06:05.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff7036ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc161db0 con 0x7ff6fc0ce080 2023-09-13T06:06:05.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff7036ec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0b09e0 con 0x7ff6fc162c10 2023-09-13T06:06:05.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff701c89640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff6fc0ce080 0x7ff6fc0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:05.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff701c89640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff6fc0ce080 0x7ff6fc0ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54512/0 (socket says 172.21.15.130:54512) 2023-09-13T06:06:05.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff701c89640 1 -- 172.21.15.130:0/1001466335 learned_addr learned my addr 172.21.15.130:0/1001466335 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:05.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff700c87640 1 --2- 172.21.15.130:0/1001466335 >> v2:172.21.15.164:3300/0 conn(0x7ff6fc162c10 0x7ff6fc1660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:05.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff701c89640 1 -- 172.21.15.130:0/1001466335 >> v2:172.21.15.164:3300/0 conn(0x7ff6fc162c10 msgr2=0x7ff6fc1660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:05.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff701c89640 1 --2- 172.21.15.130:0/1001466335 >> v2:172.21.15.164:3300/0 conn(0x7ff6fc162c10 0x7ff6fc1660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:05.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff701c89640 1 -- 172.21.15.130:0/1001466335 >> v1:172.21.15.164:6789/0 conn(0x7ff6fc1619d0 legacy=0x7ff6fc0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:05.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.149+0000 7ff701c89640 1 -- 172.21.15.130:0/1001466335 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc165600 con 0x7ff6fc0ce080 2023-09-13T06:06:05.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff701c89640 1 --2- 172.21.15.130:0/1001466335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc0ce080 0x7ff6fc0ce4b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0b2640 tx=0x7ff6f401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9338212747332e79 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:05.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff6f3fff640 1 -- 172.21.15.130:0/1001466335 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40a57d0 con 0x7ff6fc0ce080 2023-09-13T06:06:05.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff6f3fff640 1 -- 172.21.15.130:0/1001466335 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f40a5930 con 0x7ff6fc0ce080 2023-09-13T06:06:05.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff6f3fff640 1 -- 172.21.15.130:0/1001466335 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40a5cc0 con 0x7ff6fc0ce080 2023-09-13T06:06:05.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff7036ec640 1 -- 172.21.15.130:0/1001466335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc0ce080 msgr2=0x7ff6fc0ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:05.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff7036ec640 1 --2- 172.21.15.130:0/1001466335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc0ce080 0x7ff6fc0ce4b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0b2640 tx=0x7ff6f401c910 comp rx=0 tx=0).stop 2023-09-13T06:06:05.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff7036ec640 1 -- 172.21.15.130:0/1001466335 shutdown_connections 2023-09-13T06:06:05.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff7036ec640 1 --2- 172.21.15.130:0/1001466335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc0ce080 0x7ff6fc0ce4b0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:05.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff7036ec640 1 --2- 172.21.15.130:0/1001466335 >> v2:172.21.15.164:3300/0 conn(0x7ff6fc162c10 0x7ff6fc1660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:05.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff7036ec640 1 -- 172.21.15.130:0/1001466335 >> 172.21.15.130:0/1001466335 conn(0x7ff6fc065990 msgr2=0x7ff6fc065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:05.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff7036ec640 1 -- 172.21.15.130:0/1001466335 shutdown_connections 2023-09-13T06:06:05.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff7036ec640 1 -- 172.21.15.130:0/1001466335 wait complete. 2023-09-13T06:06:05.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.153+0000 7ff7036ec640 1 Processor -- start 2023-09-13T06:06:05.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff7036ec640 1 -- start start 2023-09-13T06:06:05.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff7036ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6fc0ce080 0x7ff6fc164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:05.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff7036ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc1619d0 0x7ff6fc163a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:05.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff7036ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc162c10 0x7ff6fc1515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:05.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff7036ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc165480 con 0x7ff6fc1619d0 2023-09-13T06:06:05.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff7036ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0b0180 con 0x7ff6fc162c10 2023-09-13T06:06:05.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff7036ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc1531c0 con 0x7ff6fc0ce080 2023-09-13T06:06:05.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff700c87640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc1619d0 0x7ff6fc163a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:05.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff700c87640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc1619d0 0x7ff6fc163a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54516/0 (socket says 172.21.15.130:54516) 2023-09-13T06:06:05.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff700c87640 1 -- 172.21.15.130:0/4181424409 learned_addr learned my addr 172.21.15.130:0/4181424409 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:05.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff701488640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6fc0ce080 0x7ff6fc164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:05.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff701c89640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc162c10 0x7ff6fc1515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff700c87640 1 -- 172.21.15.130:0/4181424409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6fc0ce080 msgr2=0x7ff6fc164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff700c87640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6fc0ce080 0x7ff6fc164f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff700c87640 1 -- 172.21.15.130:0/4181424409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc162c10 msgr2=0x7ff6fc1515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff700c87640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc162c10 0x7ff6fc1515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff700c87640 1 -- 172.21.15.130:0/4181424409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4009b30 con 0x7ff6fc1619d0 2023-09-13T06:06:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff700c87640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc1619d0 0x7ff6fc163a90 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00e870 tx=0x7ff6ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff6f1ffb640 1 -- 172.21.15.130:0/4181424409 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec009510 con 0x7ff6fc1619d0 2023-09-13T06:06:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff6f1ffb640 1 -- 172.21.15.130:0/4181424409 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00eec0 con 0x7ff6fc1619d0 2023-09-13T06:06:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff7036ec640 1 -- 172.21.15.130:0/4181424409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc155750 con 0x7ff6fc1619d0 2023-09-13T06:06:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff6f1ffb640 1 -- 172.21.15.130:0/4181424409 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00cb40 con 0x7ff6fc1619d0 2023-09-13T06:06:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff7036ec640 1 -- 172.21.15.130:0/4181424409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc0b03d0 con 0x7ff6fc1619d0 2023-09-13T06:06:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.157+0000 7ff7036ec640 1 -- 172.21.15.130:0/4181424409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc157d80 con 0x7ff6fc1619d0 2023-09-13T06:06:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.161+0000 7ff6f1ffb640 1 -- 172.21.15.130:0/4181424409 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff6ec00cca0 con 0x7ff6fc1619d0 2023-09-13T06:06:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.161+0000 7ff6f1ffb640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff6e0065b20 0x7ff6e0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.161+0000 7ff6f1ffb640 1 -- 172.21.15.130:0/4181424409 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff6ec0833f0 con 0x7ff6fc1619d0 2023-09-13T06:06:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.161+0000 7ff701488640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff6e0065b20 0x7ff6e0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.161+0000 7ff701488640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff6e0065b20 0x7ff6e0067fe0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8007fd0 tx=0x7ff6f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:05.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.165+0000 7ff6f1ffb640 1 -- 172.21.15.130:0/4181424409 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff6fc157d80 con 0x7ff6fc1619d0 2023-09-13T06:06:05.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.345+0000 7ff7036ec640 1 -- 172.21.15.130:0/4181424409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff6fc157d80 con 0x7ff6fc1619d0 2023-09-13T06:06:05.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff6f1ffb640 1 -- 172.21.15.130:0/4181424409 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff6fc157d80 con 0x7ff6fc1619d0 2023-09-13T06:06:05.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 -- 172.21.15.130:0/4181424409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff6e0065b20 msgr2=0x7ff6e0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:05.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff6e0065b20 0x7ff6e0067fe0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8007fd0 tx=0x7ff6f8009040 comp rx=0 tx=0).stop 2023-09-13T06:06:05.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 -- 172.21.15.130:0/4181424409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc1619d0 msgr2=0x7ff6fc163a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:05.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc1619d0 0x7ff6fc163a90 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00e870 tx=0x7ff6ec00ec70 comp rx=0 tx=0).stop 2023-09-13T06:06:05.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 -- 172.21.15.130:0/4181424409 shutdown_connections 2023-09-13T06:06:05.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff6e0065b20 0x7ff6e0067fe0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:05.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6fc162c10 0x7ff6fc1515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:05.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6fc1619d0 0x7ff6fc163a90 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:05.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 --2- 172.21.15.130:0/4181424409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6fc0ce080 0x7ff6fc164f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:05.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 -- 172.21.15.130:0/4181424409 >> 172.21.15.130:0/4181424409 conn(0x7ff6fc065990 msgr2=0x7ff6fc161ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:05.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 -- 172.21.15.130:0/4181424409 shutdown_connections 2023-09-13T06:06:05.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:05.985+0000 7ff7036ec640 1 -- 172.21.15.130:0/4181424409 wait complete. 2023-09-13T06:06:06.009 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T06:06:06.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.197+0000 7f58e32ec640 1 Processor -- start 2023-09-13T06:06:06.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.197+0000 7f58e32ec640 1 -- start start 2023-09-13T06:06:06.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e32ec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f58dc0cb770 0x7f58dc0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:06.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e32ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f58dc0cbb50 0x7f58dc1647d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:06.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e32ec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58dc0ce800 con 0x7f58dc166040 2023-09-13T06:06:06.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e32ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58dc165380 con 0x7f58dc0cbb50 2023-09-13T06:06:06.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e32ec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58dc0cea40 con 0x7f58dc0cb770 2023-09-13T06:06:06.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e1889640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f58dc0cbb50 0x7f58dc1647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:06.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e1889640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f58dc0cbb50 0x7f58dc1647d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54528/0 (socket says 172.21.15.130:54528) 2023-09-13T06:06:06.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e1889640 1 -- 172.21.15.130:0/186842175 learned_addr learned my addr 172.21.15.130:0/186842175 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:06.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e1088640 1 --2- 172.21.15.130:0/186842175 >> v2:172.21.15.164:3300/0 conn(0x7f58dc0cb770 0x7f58dc0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:06.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e1889640 1 -- 172.21.15.130:0/186842175 >> v2:172.21.15.164:3300/0 conn(0x7f58dc0cb770 msgr2=0x7f58dc0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:06.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e1889640 1 --2- 172.21.15.130:0/186842175 >> v2:172.21.15.164:3300/0 conn(0x7f58dc0cb770 0x7f58dc0cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:06.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e1889640 1 -- 172.21.15.130:0/186842175 >> v1:172.21.15.164:6789/0 conn(0x7f58dc166040 legacy=0x7f58dc0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:06.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.201+0000 7f58e1889640 1 -- 172.21.15.130:0/186842175 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc165560 con 0x7f58dc0cbb50 2023-09-13T06:06:06.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e1889640 1 --2- 172.21.15.130:0/186842175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58dc0cbb50 0x7f58dc1647d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f58dc070730 tx=0x7f58d401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21de699f9a57cca5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:06.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58d3fff640 1 -- 172.21.15.130:0/186842175 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d40a5690 con 0x7f58dc0cbb50 2023-09-13T06:06:06.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58d3fff640 1 -- 172.21.15.130:0/186842175 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d40a57f0 con 0x7f58dc0cbb50 2023-09-13T06:06:06.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58d3fff640 1 -- 172.21.15.130:0/186842175 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d40a5b80 con 0x7f58dc0cbb50 2023-09-13T06:06:06.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 -- 172.21.15.130:0/186842175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58dc0cbb50 msgr2=0x7f58dc1647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:06.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 --2- 172.21.15.130:0/186842175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58dc0cbb50 0x7f58dc1647d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f58dc070730 tx=0x7f58d401c9d0 comp rx=0 tx=0).stop 2023-09-13T06:06:06.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 -- 172.21.15.130:0/186842175 shutdown_connections 2023-09-13T06:06:06.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 --2- 172.21.15.130:0/186842175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58dc0cbb50 0x7f58dc1647d0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:06.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 --2- 172.21.15.130:0/186842175 >> v2:172.21.15.164:3300/0 conn(0x7f58dc0cb770 0x7f58dc0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:06.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 -- 172.21.15.130:0/186842175 >> 172.21.15.130:0/186842175 conn(0x7f58dc0735e0 msgr2=0x7f58dc065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:06.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 -- 172.21.15.130:0/186842175 shutdown_connections 2023-09-13T06:06:06.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 -- 172.21.15.130:0/186842175 wait complete. 2023-09-13T06:06:06.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 Processor -- start 2023-09-13T06:06:06.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 -- start start 2023-09-13T06:06:06.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58dc0cb770 0x7f58dc0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:06.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58dc0cbb50 0x7f58dc14e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:06.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58dc166040 0x7f58dc14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:06.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc0b0790 con 0x7f58dc166040 2023-09-13T06:06:06.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc06bd10 con 0x7f58dc0cbb50 2023-09-13T06:06:06.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e32ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc14e6a0 con 0x7f58dc0cb770 2023-09-13T06:06:06.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.205+0000 7f58e1889640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58dc166040 0x7f58dc14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:06.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e1889640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58dc166040 0x7f58dc14d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54538/0 (socket says 172.21.15.130:54538) 2023-09-13T06:06:06.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e1889640 1 -- 172.21.15.130:0/2854618106 learned_addr learned my addr 172.21.15.130:0/2854618106 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:06.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e1088640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58dc0cb770 0x7f58dc0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:06.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e0887640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58dc0cbb50 0x7f58dc14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:06.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e1889640 1 -- 172.21.15.130:0/2854618106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58dc0cb770 msgr2=0x7f58dc0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:06.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e1889640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58dc0cb770 0x7f58dc0af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:06.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e1889640 1 -- 172.21.15.130:0/2854618106 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58dc0cbb50 msgr2=0x7f58dc14e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:06.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e1889640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58dc0cbb50 0x7f58dc14e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:06.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e1889640 1 -- 172.21.15.130:0/2854618106 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d4009b30 con 0x7f58dc166040 2023-09-13T06:06:06.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e1889640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58dc166040 0x7f58dc14d720 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f58d40af040 tx=0x7f58d4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:06.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58d1ffb640 1 -- 172.21.15.130:0/2854618106 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d40b8670 con 0x7f58dc166040 2023-09-13T06:06:06.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58d1ffb640 1 -- 172.21.15.130:0/2854618106 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d40b87d0 con 0x7f58dc166040 2023-09-13T06:06:06.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58d1ffb640 1 -- 172.21.15.130:0/2854618106 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d40b8b80 con 0x7f58dc166040 2023-09-13T06:06:06.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e32ec640 1 -- 172.21.15.130:0/2854618106 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58dc06e330 con 0x7f58dc166040 2023-09-13T06:06:06.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e32ec640 1 -- 172.21.15.130:0/2854618106 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58dc0b01d0 con 0x7f58dc166040 2023-09-13T06:06:06.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58e32ec640 1 -- 172.21.15.130:0/2854618106 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58dc06bae0 con 0x7f58dc166040 2023-09-13T06:06:06.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58d1ffb640 1 -- 172.21.15.130:0/2854618106 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f58d40b8ce0 con 0x7f58dc166040 2023-09-13T06:06:06.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.209+0000 7f58d1ffb640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58c0065b20 0x7f58c0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:06.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.213+0000 7f58d1ffb640 1 -- 172.21.15.130:0/2854618106 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f58d411e5d0 con 0x7f58dc166040 2023-09-13T06:06:06.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.213+0000 7f58e1088640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58c0065b20 0x7f58c0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:06.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.213+0000 7f58e1088640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58c0065b20 0x7f58c0067fe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009b60 tx=0x7f58d8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:06.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.213+0000 7f58d1ffb640 1 -- 172.21.15.130:0/2854618106 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f58dc06bae0 con 0x7f58dc166040 2023-09-13T06:06:06.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.361+0000 7f58e32ec640 1 -- 172.21.15.130:0/2854618106 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f58dc06bec0 con 0x7f58dc166040 2023-09-13T06:06:06.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58d1ffb640 1 -- 172.21.15.130:0/2854618106 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) v1 ==== 181+0+0 (secure 0 0 0) 0x7f58dc06bec0 con 0x7f58dc166040 2023-09-13T06:06:06.989 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' removed 2023-09-13T06:06:06.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 -- 172.21.15.130:0/2854618106 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58c0065b20 msgr2=0x7f58c0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:06.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58c0065b20 0x7f58c0067fe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009b60 tx=0x7f58d8009190 comp rx=0 tx=0).stop 2023-09-13T06:06:06.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 -- 172.21.15.130:0/2854618106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58dc166040 msgr2=0x7f58dc14d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:06.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58dc166040 0x7f58dc14d720 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f58d40af040 tx=0x7f58d4019770 comp rx=0 tx=0).stop 2023-09-13T06:06:06.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 -- 172.21.15.130:0/2854618106 shutdown_connections 2023-09-13T06:06:06.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f58c0065b20 0x7f58c0067fe0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:06.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58dc0cbb50 0x7f58dc14e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:06.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58dc166040 0x7f58dc14d720 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:06.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 --2- 172.21.15.130:0/2854618106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58dc0cb770 0x7f58dc0af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:06.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 -- 172.21.15.130:0/2854618106 >> 172.21.15.130:0/2854618106 conn(0x7f58dc0735e0 msgr2=0x7f58dc15e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:06.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 -- 172.21.15.130:0/2854618106 shutdown_connections 2023-09-13T06:06:06.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:06.989+0000 7f58e32ec640 1 -- 172.21.15.130:0/2854618106 wait complete. 2023-09-13T06:06:07.012 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T06:06:07.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.153+0000 7fea4f3db640 1 Processor -- start 2023-09-13T06:06:07.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.153+0000 7fea4f3db640 1 -- start start 2023-09-13T06:06:07.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.153+0000 7fea4f3db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fea48144a40 0x7fea480aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:07.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.153+0000 7fea4f3db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4806d510 con 0x7fea4806d0a0 2023-09-13T06:06:07.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.153+0000 7fea4f3db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4806d7c0 con 0x7fea480b0460 2023-09-13T06:06:07.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.153+0000 7fea4f3db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea480b08f0 con 0x7fea48144a40 2023-09-13T06:06:07.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.153+0000 7fea4d177640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fea48144a40 0x7fea480aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:07.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.153+0000 7fea4d978640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fea4806d0a0 0x7fea4815bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:44302/0 (socket says 172.21.15.130:44302) 2023-09-13T06:06:07.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.153+0000 7fea4d978640 1 -- 172.21.15.130:0/2170919269 learned_addr learned my addr 172.21.15.130:0/2170919269 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:07.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea4d177640 1 -- 172.21.15.130:0/2170919269 >> v1:172.21.15.164:6789/0 conn(0x7fea480b0460 legacy=0x7fea4806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:07.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea4d177640 1 -- 172.21.15.130:0/2170919269 >> v1:172.21.15.130:6789/0 conn(0x7fea4806d0a0 legacy=0x7fea4815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:07.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea4d177640 1 -- 172.21.15.130:0/2170919269 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4806daa0 con 0x7fea48144a40 2023-09-13T06:06:07.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea3ffff640 1 -- 172.21.15.130:0/2170919269 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046868068 0 0) 0x7fea4806d510 con 0x7fea4806d0a0 2023-09-13T06:06:07.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea4d177640 1 --2- 172.21.15.130:0/2170919269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea48144a40 0x7fea480aff20 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fea440097c0 tx=0x7fea4401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce11d076af09d50 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:07.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea3ffff640 1 -- 172.21.15.130:0/2170919269 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea440ab600 con 0x7fea48144a40 2023-09-13T06:06:07.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea3ffff640 1 -- 172.21.15.130:0/2170919269 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea440a7050 con 0x7fea48144a40 2023-09-13T06:06:07.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea3ffff640 1 -- 172.21.15.130:0/2170919269 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea440ab980 con 0x7fea48144a40 2023-09-13T06:06:07.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea4f3db640 1 -- 172.21.15.130:0/2170919269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea48144a40 msgr2=0x7fea480aff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:07.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea4f3db640 1 --2- 172.21.15.130:0/2170919269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea48144a40 0x7fea480aff20 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fea440097c0 tx=0x7fea4401c440 comp rx=0 tx=0).stop 2023-09-13T06:06:07.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea4f3db640 1 -- 172.21.15.130:0/2170919269 shutdown_connections 2023-09-13T06:06:07.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea4f3db640 1 --2- 172.21.15.130:0/2170919269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea48144a40 0x7fea480aff20 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:07.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.157+0000 7fea4f3db640 1 -- 172.21.15.130:0/2170919269 >> 172.21.15.130:0/2170919269 conn(0x7fea480735e0 msgr2=0x7fea48065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:07.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4f3db640 1 -- 172.21.15.130:0/2170919269 shutdown_connections 2023-09-13T06:06:07.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4f3db640 1 -- 172.21.15.130:0/2170919269 wait complete. 2023-09-13T06:06:07.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4f3db640 1 Processor -- start 2023-09-13T06:06:07.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4f3db640 1 -- start start 2023-09-13T06:06:07.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4f3db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fea4806d0a0 0x7fea480af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:07.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4f3db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea480b0460 0x7fea48149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:07.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4f3db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea48144a40 0x7fea481499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:07.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4f3db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea481422d0 con 0x7fea480b0460 2023-09-13T06:06:07.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4f3db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea48149ef0 con 0x7fea48144a40 2023-09-13T06:06:07.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4f3db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea481f67f0 con 0x7fea4806d0a0 2023-09-13T06:06:07.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4c976640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea480b0460 0x7fea48149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:07.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4c976640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea480b0460 0x7fea48149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54562/0 (socket says 172.21.15.130:54562) 2023-09-13T06:06:07.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4c976640 1 -- 172.21.15.130:0/281824014 learned_addr learned my addr 172.21.15.130:0/281824014 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:07.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4d177640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fea4806d0a0 0x7fea480af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:07.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4d978640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea48144a40 0x7fea481499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:07.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4c976640 1 -- 172.21.15.130:0/281824014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fea4806d0a0 msgr2=0x7fea480af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:07.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4c976640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fea4806d0a0 0x7fea480af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:07.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4c976640 1 -- 172.21.15.130:0/281824014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea48144a40 msgr2=0x7fea481499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:07.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4c976640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea48144a40 0x7fea481499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:07.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4c976640 1 -- 172.21.15.130:0/281824014 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea44009420 con 0x7fea480b0460 2023-09-13T06:06:07.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4d978640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea48144a40 0x7fea481499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:07.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.161+0000 7fea4c976640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea480b0460 0x7fea48149470 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fea3800c450 tx=0x7fea3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:07.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.165+0000 7fea3dffb640 1 -- 172.21.15.130:0/281824014 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38012830 con 0x7fea480b0460 2023-09-13T06:06:07.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.165+0000 7fea3dffb640 1 -- 172.21.15.130:0/281824014 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea380129b0 con 0x7fea480b0460 2023-09-13T06:06:07.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.165+0000 7fea3dffb640 1 -- 172.21.15.130:0/281824014 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38012d60 con 0x7fea480b0460 2023-09-13T06:06:07.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.165+0000 7fea4f3db640 1 -- 172.21.15.130:0/281824014 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea481f6a00 con 0x7fea480b0460 2023-09-13T06:06:07.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.165+0000 7fea4f3db640 1 -- 172.21.15.130:0/281824014 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea481f6fc0 con 0x7fea480b0460 2023-09-13T06:06:07.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.165+0000 7fea4f3db640 1 -- 172.21.15.130:0/281824014 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea480618a0 con 0x7fea480b0460 2023-09-13T06:06:07.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.165+0000 7fea3dffb640 1 -- 172.21.15.130:0/281824014 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fea3801c460 con 0x7fea480b0460 2023-09-13T06:06:07.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.165+0000 7fea3dffb640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fea2c065b20 0x7fea2c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:07.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.165+0000 7fea3dffb640 1 -- 172.21.15.130:0/281824014 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fea38082fc0 con 0x7fea480b0460 2023-09-13T06:06:07.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.165+0000 7fea4d177640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fea2c065b20 0x7fea2c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:07.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.165+0000 7fea4d177640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fea2c065b20 0x7fea2c067fe0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fea440ad000 tx=0x7fea440a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:07.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.169+0000 7fea3dffb640 1 -- 172.21.15.130:0/281824014 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fea38050a60 con 0x7fea480b0460 2023-09-13T06:06:07.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.317+0000 7fea4f3db640 1 -- 172.21.15.130:0/281824014 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fea48065a30 con 0x7fea480b0460 2023-09-13T06:06:07.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea3dffb640 1 -- 172.21.15.130:0/281824014 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) v1 ==== 169+0+0 (secure 0 0 0) 0x7fea38054080 con 0x7fea480b0460 2023-09-13T06:06:07.994 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' removed 2023-09-13T06:06:07.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 -- 172.21.15.130:0/281824014 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fea2c065b20 msgr2=0x7fea2c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:07.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fea2c065b20 0x7fea2c067fe0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fea440ad000 tx=0x7fea440a6000 comp rx=0 tx=0).stop 2023-09-13T06:06:07.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 -- 172.21.15.130:0/281824014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea480b0460 msgr2=0x7fea48149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:07.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea480b0460 0x7fea48149470 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fea3800c450 tx=0x7fea3800c910 comp rx=0 tx=0).stop 2023-09-13T06:06:07.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 -- 172.21.15.130:0/281824014 shutdown_connections 2023-09-13T06:06:07.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fea2c065b20 0x7fea2c067fe0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:07.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea48144a40 0x7fea481499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:07.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea480b0460 0x7fea48149470 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:07.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 --2- 172.21.15.130:0/281824014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fea4806d0a0 0x7fea480af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:07.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 -- 172.21.15.130:0/281824014 >> 172.21.15.130:0/281824014 conn(0x7fea480735e0 msgr2=0x7fea480a8430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:07.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 -- 172.21.15.130:0/281824014 shutdown_connections 2023-09-13T06:06:07.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:07.993+0000 7fea4f3db640 1 -- 172.21.15.130:0/281824014 wait complete. 2023-09-13T06:06:08.017 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-13T06:06:08.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d37e0b640 1 Processor -- start 2023-09-13T06:06:08.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d37e0b640 1 -- start start 2023-09-13T06:06:08.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d37e0b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d301619d0 0x7f7d301660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d37e0b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7d300ce080 0x7f7d300ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d37e0b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d300b0cc0 con 0x7f7d30162c10 2023-09-13T06:06:08.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d37e0b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d30161db0 con 0x7f7d301619d0 2023-09-13T06:06:08.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d37e0b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d300b09e0 con 0x7f7d300ce080 2023-09-13T06:06:08.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d35ba7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d301619d0 0x7f7d301660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:08.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d35ba7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d301619d0 0x7f7d301660e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54578/0 (socket says 172.21.15.130:54578) 2023-09-13T06:06:08.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d35ba7640 1 -- 172.21.15.130:0/4032988320 learned_addr learned my addr 172.21.15.130:0/4032988320 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:08.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d35ba7640 1 -- 172.21.15.130:0/4032988320 >> v2:172.21.15.164:3300/0 conn(0x7f7d300ce080 msgr2=0x7f7d300ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:08.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d35ba7640 1 --2- 172.21.15.130:0/4032988320 >> v2:172.21.15.164:3300/0 conn(0x7f7d300ce080 0x7f7d300ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d35ba7640 1 -- 172.21.15.130:0/4032988320 >> v1:172.21.15.164:6789/0 conn(0x7f7d30162c10 legacy=0x7f7d300b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:08.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.157+0000 7f7d35ba7640 1 -- 172.21.15.130:0/4032988320 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d30165600 con 0x7f7d301619d0 2023-09-13T06:06:08.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d35ba7640 1 --2- 172.21.15.130:0/4032988320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d301619d0 0x7f7d301660e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f7d3006b570 tx=0x7f7d2c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994ab9eb0cbf67b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:08.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d34ba5640 1 -- 172.21.15.130:0/4032988320 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0ab600 con 0x7f7d301619d0 2023-09-13T06:06:08.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d34ba5640 1 -- 172.21.15.130:0/4032988320 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c0ab760 con 0x7f7d301619d0 2023-09-13T06:06:08.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d34ba5640 1 -- 172.21.15.130:0/4032988320 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0abaf0 con 0x7f7d301619d0 2023-09-13T06:06:08.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d37e0b640 1 -- 172.21.15.130:0/4032988320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d301619d0 msgr2=0x7f7d301660e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:08.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d37e0b640 1 --2- 172.21.15.130:0/4032988320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d301619d0 0x7f7d301660e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f7d3006b570 tx=0x7f7d2c01c400 comp rx=0 tx=0).stop 2023-09-13T06:06:08.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d37e0b640 1 -- 172.21.15.130:0/4032988320 shutdown_connections 2023-09-13T06:06:08.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d37e0b640 1 --2- 172.21.15.130:0/4032988320 >> v2:172.21.15.164:3300/0 conn(0x7f7d300ce080 0x7f7d300ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d37e0b640 1 --2- 172.21.15.130:0/4032988320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d301619d0 0x7f7d301660e0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d37e0b640 1 -- 172.21.15.130:0/4032988320 >> 172.21.15.130:0/4032988320 conn(0x7f7d30065990 msgr2=0x7f7d30065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:08.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d37e0b640 1 -- 172.21.15.130:0/4032988320 shutdown_connections 2023-09-13T06:06:08.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.161+0000 7f7d37e0b640 1 -- 172.21.15.130:0/4032988320 wait complete. 2023-09-13T06:06:08.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d37e0b640 1 Processor -- start 2023-09-13T06:06:08.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d37e0b640 1 -- start start 2023-09-13T06:06:08.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d37e0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d300ce080 0x7f7d3006d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d37e0b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d301619d0 0x7f7d3014a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d37e0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30162c10 0x7f7d30150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d37e0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30149090 con 0x7f7d30162c10 2023-09-13T06:06:08.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d37e0b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3014ab30 con 0x7f7d301619d0 2023-09-13T06:06:08.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d37e0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3014ae10 con 0x7f7d300ce080 2023-09-13T06:06:08.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d363a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30162c10 0x7f7d30150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:08.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d363a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30162c10 0x7f7d30150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54582/0 (socket says 172.21.15.130:54582) 2023-09-13T06:06:08.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d35ba7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d300ce080 0x7f7d3006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:08.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d363a8640 1 -- 172.21.15.130:0/1927502274 learned_addr learned my addr 172.21.15.130:0/1927502274 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:08.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d353a6640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d301619d0 0x7f7d3014a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:08.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d363a8640 1 -- 172.21.15.130:0/1927502274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d300ce080 msgr2=0x7f7d3006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:08.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d363a8640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d300ce080 0x7f7d3006d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d363a8640 1 -- 172.21.15.130:0/1927502274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d301619d0 msgr2=0x7f7d3014a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:08.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d363a8640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d301619d0 0x7f7d3014a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d363a8640 1 -- 172.21.15.130:0/1927502274 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c0094d0 con 0x7f7d30162c10 2023-09-13T06:06:08.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d363a8640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30162c10 0x7f7d30150010 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800b970 tx=0x7f7d2800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:08.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d267fc640 1 -- 172.21.15.130:0/1927502274 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800cb40 con 0x7f7d30162c10 2023-09-13T06:06:08.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d267fc640 1 -- 172.21.15.130:0/1927502274 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2800ccc0 con 0x7f7d30162c10 2023-09-13T06:06:08.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d267fc640 1 -- 172.21.15.130:0/1927502274 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28014680 con 0x7f7d30162c10 2023-09-13T06:06:08.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d37e0b640 1 -- 172.21.15.130:0/1927502274 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3014b0f0 con 0x7f7d30162c10 2023-09-13T06:06:08.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d37e0b640 1 -- 172.21.15.130:0/1927502274 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d30147810 con 0x7f7d30162c10 2023-09-13T06:06:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.165+0000 7f7d37e0b640 1 -- 172.21.15.130:0/1927502274 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3014b610 con 0x7f7d30162c10 2023-09-13T06:06:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.169+0000 7f7d267fc640 1 -- 172.21.15.130:0/1927502274 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7d2801d3b0 con 0x7f7d30162c10 2023-09-13T06:06:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.169+0000 7f7d267fc640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d14065b50 0x7f7d14068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.169+0000 7f7d267fc640 1 -- 172.21.15.130:0/1927502274 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7d28082e30 con 0x7f7d30162c10 2023-09-13T06:06:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.169+0000 7f7d35ba7640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d14065b50 0x7f7d14068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:08.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.169+0000 7f7d35ba7640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d14065b50 0x7f7d14068010 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0af000 tx=0x7f7d2c0b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:08.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.173+0000 7f7d267fc640 1 -- 172.21.15.130:0/1927502274 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7d28050b20 con 0x7f7d30162c10 2023-09-13T06:06:08.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.321+0000 7f7d37e0b640 1 -- 172.21.15.130:0/1927502274 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7d300674a0 con 0x7f7d30162c10 2023-09-13T06:06:08.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d267fc640 1 -- 172.21.15.130:0/1927502274 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7d280190a0 con 0x7f7d30162c10 2023-09-13T06:06:08.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 -- 172.21.15.130:0/1927502274 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d14065b50 msgr2=0x7f7d14068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:08.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d14065b50 0x7f7d14068010 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0af000 tx=0x7f7d2c0b6040 comp rx=0 tx=0).stop 2023-09-13T06:06:08.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 -- 172.21.15.130:0/1927502274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30162c10 msgr2=0x7f7d30150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:08.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30162c10 0x7f7d30150010 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800b970 tx=0x7f7d2800be30 comp rx=0 tx=0).stop 2023-09-13T06:06:08.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 -- 172.21.15.130:0/1927502274 shutdown_connections 2023-09-13T06:06:08.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d14065b50 0x7f7d14068010 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d301619d0 0x7f7d3014a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30162c10 0x7f7d30150010 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 --2- 172.21.15.130:0/1927502274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d300ce080 0x7f7d3006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 -- 172.21.15.130:0/1927502274 >> 172.21.15.130:0/1927502274 conn(0x7f7d30065990 msgr2=0x7f7d301511b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:08.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 -- 172.21.15.130:0/1927502274 shutdown_connections 2023-09-13T06:06:08.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.329+0000 7f7d37e0b640 1 -- 172.21.15.130:0/1927502274 wait complete. 2023-09-13T06:06:08.350 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-09-13T06:06:08.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.485+0000 7f4175834640 1 Processor -- start 2023-09-13T06:06:08.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.485+0000 7f4175834640 1 -- start start 2023-09-13T06:06:08.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f4175834640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f41700d1090 0x7f417015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f4175834640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4170146f30 0x7f41700b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f4175834640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41700b63c0 con 0x7f41700d1750 2023-09-13T06:06:08.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f4175834640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417015dea0 con 0x7f41700d1090 2023-09-13T06:06:08.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f4175834640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41700d0c20 con 0x7f4170146f30 2023-09-13T06:06:08.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f416f7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4170146f30 0x7f41700b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:08.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f4167fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f41700d1090 0x7f417015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:08.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f416f7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4170146f30 0x7f41700b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:44008/0 (socket says 172.21.15.130:44008) 2023-09-13T06:06:08.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f416f7fe640 1 -- 172.21.15.130:0/3249550530 learned_addr learned my addr 172.21.15.130:0/3249550530 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:08.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f4167fff640 1 -- 172.21.15.130:0/3249550530 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4170146f30 msgr2=0x7f41700b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:08.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f4167fff640 1 --2- 172.21.15.130:0/3249550530 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4170146f30 0x7f41700b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f4167fff640 1 -- 172.21.15.130:0/3249550530 >> v1:172.21.15.164:6789/0 conn(0x7f41700d1750 legacy=0x7f4170146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:08.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.489+0000 7f4167fff640 1 -- 172.21.15.130:0/3249550530 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41700b6610 con 0x7f41700d1090 2023-09-13T06:06:08.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f4167fff640 1 --2- 172.21.15.130:0/3249550530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41700d1090 0x7f417015d960 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f41580097c0 tx=0x7f415801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a828bbae73d3459f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:08.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f416e7fc640 1 -- 172.21.15.130:0/3249550530 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580ab650 con 0x7f41700d1090 2023-09-13T06:06:08.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f416e7fc640 1 -- 172.21.15.130:0/3249550530 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41580ab7b0 con 0x7f41700d1090 2023-09-13T06:06:08.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f416e7fc640 1 -- 172.21.15.130:0/3249550530 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580abb40 con 0x7f41700d1090 2023-09-13T06:06:08.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f4175834640 1 -- 172.21.15.130:0/3249550530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41700d1090 msgr2=0x7f417015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:08.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f4175834640 1 --2- 172.21.15.130:0/3249550530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41700d1090 0x7f417015d960 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f41580097c0 tx=0x7f415801c450 comp rx=0 tx=0).stop 2023-09-13T06:06:08.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f4175834640 1 -- 172.21.15.130:0/3249550530 shutdown_connections 2023-09-13T06:06:08.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f4175834640 1 --2- 172.21.15.130:0/3249550530 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4170146f30 0x7f41700b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f4175834640 1 --2- 172.21.15.130:0/3249550530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41700d1090 0x7f417015d960 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f4175834640 1 -- 172.21.15.130:0/3249550530 >> 172.21.15.130:0/3249550530 conn(0x7f417006f170 msgr2=0x7f417006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:08.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f4175834640 1 -- 172.21.15.130:0/3249550530 shutdown_connections 2023-09-13T06:06:08.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f4175834640 1 -- 172.21.15.130:0/3249550530 wait complete. 2023-09-13T06:06:08.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f4175834640 1 Processor -- start 2023-09-13T06:06:08.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.493+0000 7f4175834640 1 -- start start 2023-09-13T06:06:08.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f4175834640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41700d1090 0x7f4170164110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f4175834640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41700d1750 0x7f417013eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f4175834640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4170146f30 0x7f4170162090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f4175834640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417015b870 con 0x7f41700d1090 2023-09-13T06:06:08.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f4175834640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4170164650 con 0x7f4170146f30 2023-09-13T06:06:08.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f4175834640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417015abf0 con 0x7f41700d1750 2023-09-13T06:06:08.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41700d1090 0x7f4170164110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:08.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41700d1090 0x7f4170164110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54598/0 (socket says 172.21.15.130:54598) 2023-09-13T06:06:08.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416effd640 1 -- 172.21.15.130:0/4075993636 learned_addr learned my addr 172.21.15.130:0/4075993636 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:08.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f4167fff640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41700d1750 0x7f417013eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:08.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416f7fe640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4170146f30 0x7f4170162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:08.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416effd640 1 -- 172.21.15.130:0/4075993636 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41700d1750 msgr2=0x7f417013eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:08.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416effd640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41700d1750 0x7f417013eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416effd640 1 -- 172.21.15.130:0/4075993636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4170146f30 msgr2=0x7f4170162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:08.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416effd640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4170146f30 0x7f4170162090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416effd640 1 -- 172.21.15.130:0/4075993636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4158009420 con 0x7f41700d1090 2023-09-13T06:06:08.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f4167fff640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41700d1750 0x7f417013eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:08.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416effd640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41700d1090 0x7f4170164110 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f416000c500 tx=0x7f416000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:08.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416cff9640 1 -- 172.21.15.130:0/4075993636 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160005220 con 0x7f41700d1090 2023-09-13T06:06:08.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416cff9640 1 -- 172.21.15.130:0/4075993636 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4160005380 con 0x7f41700d1090 2023-09-13T06:06:08.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f4175834640 1 -- 172.21.15.130:0/4075993636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41700b7e40 con 0x7f41700d1090 2023-09-13T06:06:08.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416cff9640 1 -- 172.21.15.130:0/4075993636 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160007270 con 0x7f41700d1090 2023-09-13T06:06:08.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f4175834640 1 -- 172.21.15.130:0/4075993636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417015b1b0 con 0x7f41700d1090 2023-09-13T06:06:08.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f4175834640 1 -- 172.21.15.130:0/4075993636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41700618a0 con 0x7f41700d1090 2023-09-13T06:06:08.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.497+0000 7f416cff9640 1 -- 172.21.15.130:0/4075993636 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f41600073d0 con 0x7f41700d1090 2023-09-13T06:06:08.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.501+0000 7f416cff9640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4150065b20 0x7f4150067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:08.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.501+0000 7f416cff9640 1 -- 172.21.15.130:0/4075993636 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f41600824f0 con 0x7f41700d1090 2023-09-13T06:06:08.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.501+0000 7f4167fff640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4150065b20 0x7f4150067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:08.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.501+0000 7f4167fff640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4150065b20 0x7f4150067fe0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f41580af000 tx=0x7f41580a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:08.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.505+0000 7f416cff9640 1 -- 172.21.15.130:0/4075993636 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4160050160 con 0x7f41700d1090 2023-09-13T06:06:08.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.705+0000 7f4175834640 1 -- 172.21.15.130:0/4075993636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f41700b86c0 con 0x7f41700d1090 2023-09-13T06:06:08.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f416cff9640 1 -- 172.21.15.130:0/4075993636 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v260) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4160053780 con 0x7f41700d1090 2023-09-13T06:06:08.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 -- 172.21.15.130:0/4075993636 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4150065b20 msgr2=0x7f4150067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:08.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4150065b20 0x7f4150067fe0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f41580af000 tx=0x7f41580a7000 comp rx=0 tx=0).stop 2023-09-13T06:06:08.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 -- 172.21.15.130:0/4075993636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41700d1090 msgr2=0x7f4170164110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:08.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41700d1090 0x7f4170164110 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f416000c500 tx=0x7f416000c9c0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 -- 172.21.15.130:0/4075993636 shutdown_connections 2023-09-13T06:06:08.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4150065b20 0x7f4150067fe0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4170146f30 0x7f4170162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41700d1750 0x7f417013eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 --2- 172.21.15.130:0/4075993636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41700d1090 0x7f4170164110 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:08.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 -- 172.21.15.130:0/4075993636 >> 172.21.15.130:0/4075993636 conn(0x7f417006f170 msgr2=0x7f417006f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:08.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 -- 172.21.15.130:0/4075993636 shutdown_connections 2023-09-13T06:06:08.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:08.993+0000 7f4175834640 1 -- 172.21.15.130:0/4075993636 wait complete. 2023-09-13T06:06:09.016 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-09-13T06:06:09.016 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-09-13T06:06:09.017 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:09.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b3111640 1 Processor -- start 2023-09-13T06:06:09.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b3111640 1 -- start start 2023-09-13T06:06:09.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b3111640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61ac15b130 0x7f61ac0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b3111640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f61ac0ce180 0x7f61ac15b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b3111640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f61ac0b04a0 0x7f61ac0b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b3111640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac0b0e70 con 0x7f61ac0b04a0 2023-09-13T06:06:09.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b3111640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac0ce980 con 0x7f61ac0ce180 2023-09-13T06:06:09.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b3111640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0cec60 con 0x7f61ac15b130 2023-09-13T06:06:09.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b16ae640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f61ac0b04a0 0x7f61ac0b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b16ae640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f61ac0b04a0 0x7f61ac0b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54606/0 (socket says 172.21.15.130:54606) 2023-09-13T06:06:09.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b16ae640 1 -- 172.21.15.130:0/1306052326 learned_addr learned my addr 172.21.15.130:0/1306052326 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:09.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b16ae640 1 -- 172.21.15.130:0/1306052326 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61ac15b130 msgr2=0x7f61ac0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:09.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b0ead640 1 --2- 172.21.15.130:0/1306052326 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61ac15b130 0x7f61ac0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61a3fff640 1 --2- 172.21.15.130:0/1306052326 >> v2:172.21.15.164:3300/0 conn(0x7f61ac0ce180 0x7f61ac15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b16ae640 1 --2- 172.21.15.130:0/1306052326 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61ac15b130 0x7f61ac0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b16ae640 1 -- 172.21.15.130:0/1306052326 >> v2:172.21.15.164:3300/0 conn(0x7f61ac0ce180 msgr2=0x7f61ac15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:09.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.153+0000 7f61b16ae640 1 --2- 172.21.15.130:0/1306052326 >> v2:172.21.15.164:3300/0 conn(0x7f61ac0ce180 0x7f61ac15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b16ae640 1 -- 172.21.15.130:0/1306052326 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac06c640 con 0x7f61ac0b04a0 2023-09-13T06:06:09.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b0ead640 1 --2- 172.21.15.130:0/1306052326 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61ac15b130 0x7f61ac0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:09.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61a3fff640 1 --2- 172.21.15.130:0/1306052326 >> v2:172.21.15.164:3300/0 conn(0x7f61ac0ce180 0x7f61ac15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:09.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b16ae640 1 --2- 172.21.15.130:0/1306052326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61ac0b04a0 0x7f61ac0b0930 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0b27a0 tx=0x7f61a401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6001d9e4b30a9446 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:09.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61a37fe640 1 -- 172.21.15.130:0/1306052326 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40a5850 con 0x7f61ac0b04a0 2023-09-13T06:06:09.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61a37fe640 1 -- 172.21.15.130:0/1306052326 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a40a59b0 con 0x7f61ac0b04a0 2023-09-13T06:06:09.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61a37fe640 1 -- 172.21.15.130:0/1306052326 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40a5d40 con 0x7f61ac0b04a0 2023-09-13T06:06:09.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b3111640 1 -- 172.21.15.130:0/1306052326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61ac0b04a0 msgr2=0x7f61ac0b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b3111640 1 --2- 172.21.15.130:0/1306052326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61ac0b04a0 0x7f61ac0b0930 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0b27a0 tx=0x7f61a401c9d0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b3111640 1 -- 172.21.15.130:0/1306052326 shutdown_connections 2023-09-13T06:06:09.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b3111640 1 --2- 172.21.15.130:0/1306052326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61ac0b04a0 0x7f61ac0b0930 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b3111640 1 --2- 172.21.15.130:0/1306052326 >> v2:172.21.15.164:3300/0 conn(0x7f61ac0ce180 0x7f61ac15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b3111640 1 --2- 172.21.15.130:0/1306052326 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61ac15b130 0x7f61ac0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b3111640 1 -- 172.21.15.130:0/1306052326 >> 172.21.15.130:0/1306052326 conn(0x7f61ac065990 msgr2=0x7f61ac065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:09.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b3111640 1 -- 172.21.15.130:0/1306052326 shutdown_connections 2023-09-13T06:06:09.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.157+0000 7f61b3111640 1 -- 172.21.15.130:0/1306052326 wait complete. 2023-09-13T06:06:09.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61b3111640 1 Processor -- start 2023-09-13T06:06:09.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61b3111640 1 -- start start 2023-09-13T06:06:09.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61b3111640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61ac0b04a0 0x7f61ac153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61b3111640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61ac0ce180 0x7f61ac0a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61b3111640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61ac15b130 0x7f61ac0ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61b3111640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0a95b0 con 0x7f61ac0ce180 2023-09-13T06:06:09.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61b3111640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0ad300 con 0x7f61ac15b130 2023-09-13T06:06:09.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61b3111640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0a85d0 con 0x7f61ac0b04a0 2023-09-13T06:06:09.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61ac0ce180 0x7f61ac0a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61ac0ce180 0x7f61ac0a9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54614/0 (socket says 172.21.15.130:54614) 2023-09-13T06:06:09.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a3fff640 1 -- 172.21.15.130:0/86878863 learned_addr learned my addr 172.21.15.130:0/86878863 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:09.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61b16ae640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61ac15b130 0x7f61ac0ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61b0ead640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61ac0b04a0 0x7f61ac153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a3fff640 1 -- 172.21.15.130:0/86878863 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61ac0b04a0 msgr2=0x7f61ac153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a3fff640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61ac0b04a0 0x7f61ac153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a3fff640 1 -- 172.21.15.130:0/86878863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61ac15b130 msgr2=0x7f61ac0ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a3fff640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61ac15b130 0x7f61ac0ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a3fff640 1 -- 172.21.15.130:0/86878863 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009b30 con 0x7f61ac0ce180 2023-09-13T06:06:09.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a3fff640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61ac0ce180 0x7f61ac0a9070 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f619c00c7f0 tx=0x7f619c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:09.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a17fa640 1 -- 172.21.15.130:0/86878863 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c00cea0 con 0x7f61ac0ce180 2023-09-13T06:06:09.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a17fa640 1 -- 172.21.15.130:0/86878863 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c007a30 con 0x7f61ac0ce180 2023-09-13T06:06:09.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61a17fa640 1 -- 172.21.15.130:0/86878863 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c007dc0 con 0x7f61ac0ce180 2023-09-13T06:06:09.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.161+0000 7f61b3111640 1 -- 172.21.15.130:0/86878863 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac0ad020 con 0x7f61ac0ce180 2023-09-13T06:06:09.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.165+0000 7f61b3111640 1 -- 172.21.15.130:0/86878863 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac0a8b50 con 0x7f61ac0ce180 2023-09-13T06:06:09.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.165+0000 7f61b3111640 1 -- 172.21.15.130:0/86878863 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ac0a8430 con 0x7f61ac0ce180 2023-09-13T06:06:09.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.165+0000 7f61a17fa640 1 -- 172.21.15.130:0/86878863 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f619c0113f0 con 0x7f61ac0ce180 2023-09-13T06:06:09.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.165+0000 7f61a17fa640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6198065b20 0x7f6198067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.165+0000 7f61a17fa640 1 -- 172.21.15.130:0/86878863 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f619c083120 con 0x7f61ac0ce180 2023-09-13T06:06:09.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.165+0000 7f61b0ead640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6198065b20 0x7f6198067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.165+0000 7f61b0ead640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6198065b20 0x7f6198067fe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006fd0 tx=0x7f61a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:09.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.169+0000 7f61a17fa640 1 -- 172.21.15.130:0/86878863 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f61ac0a8430 con 0x7f61ac0ce180 2023-09-13T06:06:09.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.317+0000 7f61b3111640 1 -- 172.21.15.130:0/86878863 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61ac0a8430 con 0x7f61ac0ce180 2023-09-13T06:06:09.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61a17fa640 1 -- 172.21.15.130:0/86878863 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+13023 (secure 0 0 0) 0x7f61ac0a8430 con 0x7f61ac0ce180 2023-09-13T06:06:09.321 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:09.322 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":93,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:07.987347+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.130:6837/428674793":"2023-09-14T06:06:04.980688+0000","172.21.15.130:6835/428674793":"2023-09-14T06:06:04.980688+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:09.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 -- 172.21.15.130:0/86878863 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6198065b20 msgr2=0x7f6198067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6198065b20 0x7f6198067fe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006fd0 tx=0x7f61a8008040 comp rx=0 tx=0).stop 2023-09-13T06:06:09.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 -- 172.21.15.130:0/86878863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61ac0ce180 msgr2=0x7f61ac0a9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61ac0ce180 0x7f61ac0a9070 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f619c00c7f0 tx=0x7f619c00ccb0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 -- 172.21.15.130:0/86878863 shutdown_connections 2023-09-13T06:06:09.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6198065b20 0x7f6198067fe0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61ac15b130 0x7f61ac0ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61ac0ce180 0x7f61ac0a9070 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 --2- 172.21.15.130:0/86878863 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61ac0b04a0 0x7f61ac153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 -- 172.21.15.130:0/86878863 >> 172.21.15.130:0/86878863 conn(0x7f61ac065990 msgr2=0x7f61ac0caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:09.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 -- 172.21.15.130:0/86878863 shutdown_connections 2023-09-13T06:06:09.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.321+0000 7f61b3111640 1 -- 172.21.15.130:0/86878863 wait complete. 2023-09-13T06:06:09.343 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:06:09.344 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:06:09.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.489+0000 7fa5f3367640 1 Processor -- start 2023-09-13T06:06:09.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.489+0000 7fa5f3367640 1 -- start start 2023-09-13T06:06:09.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.489+0000 7fa5f3367640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa5ec0b2e90 0x7fa5ec0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5f3367640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec0b2150 con 0x7fa5ec144d70 2023-09-13T06:06:09.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5f3367640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec0cdd90 con 0x7fa5ec0b1460 2023-09-13T06:06:09.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5f3367640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec0b2430 con 0x7fa5ec0b2e90 2023-09-13T06:06:09.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5f0902640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa5ec0b2e90 0x7fa5ec0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5f1103640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa5ec144d70 0x7fa5ec0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:44318/0 (socket says 172.21.15.130:44318) 2023-09-13T06:06:09.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5f1103640 1 -- 172.21.15.130:0/2297484378 learned_addr learned my addr 172.21.15.130:0/2297484378 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:09.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5f0902640 1 --2- 172.21.15.130:0/2297484378 >> v2:172.21.15.130:3300/0 conn(0x7fa5ec0b2e90 0x7fa5ec0ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54622/0 (socket says 172.21.15.130:54622) 2023-09-13T06:06:09.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5f0902640 1 -- 172.21.15.130:0/2297484378 >> v1:172.21.15.164:6789/0 conn(0x7fa5ec0b1460 legacy=0x7fa5ec0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:09.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5f0902640 1 -- 172.21.15.130:0/2297484378 >> v1:172.21.15.130:6789/0 conn(0x7fa5ec144d70 legacy=0x7fa5ec0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5f0902640 1 -- 172.21.15.130:0/2297484378 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec0ce070 con 0x7fa5ec0b2e90 2023-09-13T06:06:09.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5e3fff640 1 -- 172.21.15.130:0/2297484378 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257903266 0 0) 0x7fa5ec0b2150 con 0x7fa5ec144d70 2023-09-13T06:06:09.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5f0902640 1 --2- 172.21.15.130:0/2297484378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ec0b2e90 0x7fa5ec0ce870 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0097c0 tx=0x7fa5dc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5021fc1c0dd68ce3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:09.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5e3fff640 1 -- 172.21.15.130:0/2297484378 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0ab600 con 0x7fa5ec0b2e90 2023-09-13T06:06:09.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5e3fff640 1 -- 172.21.15.130:0/2297484378 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc0a7050 con 0x7fa5ec0b2e90 2023-09-13T06:06:09.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.493+0000 7fa5e3fff640 1 -- 172.21.15.130:0/2297484378 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0ab980 con 0x7fa5ec0b2e90 2023-09-13T06:06:09.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 -- 172.21.15.130:0/2297484378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ec0b2e90 msgr2=0x7fa5ec0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 --2- 172.21.15.130:0/2297484378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ec0b2e90 0x7fa5ec0ce870 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0097c0 tx=0x7fa5dc01c440 comp rx=0 tx=0).stop 2023-09-13T06:06:09.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 -- 172.21.15.130:0/2297484378 shutdown_connections 2023-09-13T06:06:09.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 --2- 172.21.15.130:0/2297484378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ec0b2e90 0x7fa5ec0ce870 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 -- 172.21.15.130:0/2297484378 >> 172.21.15.130:0/2297484378 conn(0x7fa5ec065990 msgr2=0x7fa5ec065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:09.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 -- 172.21.15.130:0/2297484378 shutdown_connections 2023-09-13T06:06:09.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 -- 172.21.15.130:0/2297484378 wait complete. 2023-09-13T06:06:09.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 Processor -- start 2023-09-13T06:06:09.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 -- start start 2023-09-13T06:06:09.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5ec0b1460 0x7fa5ec12d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5ec0b2e90 0x7fa5ec12f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ec144d70 0x7fa5ec12ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec12fe00 con 0x7fa5ec144d70 2023-09-13T06:06:09.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec12f490 con 0x7fa5ec0b1460 2023-09-13T06:06:09.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f3367640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec128000 con 0x7fa5ec0b2e90 2023-09-13T06:06:09.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f1904640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ec144d70 0x7fa5ec12ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f1904640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ec144d70 0x7fa5ec12ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54626/0 (socket says 172.21.15.130:54626) 2023-09-13T06:06:09.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f1904640 1 -- 172.21.15.130:0/2586077806 learned_addr learned my addr 172.21.15.130:0/2586077806 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:09.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f0902640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5ec0b2e90 0x7fa5ec12f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f1103640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5ec0b1460 0x7fa5ec12d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f1904640 1 -- 172.21.15.130:0/2586077806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5ec0b2e90 msgr2=0x7fa5ec12f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f1904640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5ec0b2e90 0x7fa5ec12f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f1904640 1 -- 172.21.15.130:0/2586077806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5ec0b1460 msgr2=0x7fa5ec12d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f1904640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5ec0b1460 0x7fa5ec12d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f1904640 1 -- 172.21.15.130:0/2586077806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc009420 con 0x7fa5ec144d70 2023-09-13T06:06:09.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.497+0000 7fa5f1103640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5ec0b1460 0x7fa5ec12d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:09.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.501+0000 7fa5f1904640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ec144d70 0x7fa5ec12ef50 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400c780 tx=0x7fa5e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:09.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.501+0000 7fa5e1ffb640 1 -- 172.21.15.130:0/2586077806 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4004b70 con 0x7fa5ec144d70 2023-09-13T06:06:09.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.501+0000 7fa5e1ffb640 1 -- 172.21.15.130:0/2586077806 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e400ce90 con 0x7fa5ec144d70 2023-09-13T06:06:09.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.501+0000 7fa5e1ffb640 1 -- 172.21.15.130:0/2586077806 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400a850 con 0x7fa5ec144d70 2023-09-13T06:06:09.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.501+0000 7fa5f3367640 1 -- 172.21.15.130:0/2586077806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec1282e0 con 0x7fa5ec144d70 2023-09-13T06:06:09.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.501+0000 7fa5f3367640 1 -- 172.21.15.130:0/2586077806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec1288a0 con 0x7fa5ec144d70 2023-09-13T06:06:09.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.501+0000 7fa5f3367640 1 -- 172.21.15.130:0/2586077806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec0618a0 con 0x7fa5ec144d70 2023-09-13T06:06:09.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.501+0000 7fa5e1ffb640 1 -- 172.21.15.130:0/2586077806 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa5e400a9b0 con 0x7fa5ec144d70 2023-09-13T06:06:09.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.501+0000 7fa5e1ffb640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5d0065b20 0x7fa5d0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.501+0000 7fa5e1ffb640 1 -- 172.21.15.130:0/2586077806 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa5e4083110 con 0x7fa5ec144d70 2023-09-13T06:06:09.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.501+0000 7fa5f1103640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5d0065b20 0x7fa5d0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.505+0000 7fa5f1103640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5d0065b20 0x7fa5d0067fe0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8000f70 tx=0x7fa5e8007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:09.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.505+0000 7fa5e1ffb640 1 -- 172.21.15.130:0/2586077806 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa5e4050d50 con 0x7fa5ec144d70 2023-09-13T06:06:09.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 -- 172.21.15.130:0/2586077806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5ec0b3910 con 0x7fa5ec144d70 2023-09-13T06:06:09.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5e1ffb640 1 -- 172.21.15.130:0/2586077806 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5e4054370 con 0x7fa5ec144d70 2023-09-13T06:06:09.658 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:06:09.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 -- 172.21.15.130:0/2586077806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5d0065b20 msgr2=0x7fa5d0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5d0065b20 0x7fa5d0067fe0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8000f70 tx=0x7fa5e8007cd0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 -- 172.21.15.130:0/2586077806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ec144d70 msgr2=0x7fa5ec12ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ec144d70 0x7fa5ec12ef50 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400c780 tx=0x7fa5e400cc40 comp rx=0 tx=0).stop 2023-09-13T06:06:09.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 -- 172.21.15.130:0/2586077806 shutdown_connections 2023-09-13T06:06:09.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa5d0065b20 0x7fa5d0067fe0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ec144d70 0x7fa5ec12ef50 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5ec0b2e90 0x7fa5ec12f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 --2- 172.21.15.130:0/2586077806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5ec0b1460 0x7fa5ec12d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 -- 172.21.15.130:0/2586077806 >> 172.21.15.130:0/2586077806 conn(0x7fa5ec065990 msgr2=0x7fa5ec143380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:09.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 -- 172.21.15.130:0/2586077806 shutdown_connections 2023-09-13T06:06:09.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.657+0000 7fa5f3367640 1 -- 172.21.15.130:0/2586077806 wait complete. 2023-09-13T06:06:09.679 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-09-13T06:06:09.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.813+0000 7f9f18d11640 1 Processor -- start 2023-09-13T06:06:09.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f18d11640 1 -- start start 2023-09-13T06:06:09.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f18d11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f140cc780 0x7f9f1415b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f18d11640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9f140b04a0 0x7f9f140b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f18d11640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f140ccbe0 con 0x7f9f1415b130 2023-09-13T06:06:09.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f18d11640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f140b0e70 con 0x7f9f140b04a0 2023-09-13T06:06:09.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f18d11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140ce980 con 0x7f9f140cc780 2023-09-13T06:06:09.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f12d9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9f140b04a0 0x7f9f140b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f09d9b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f140cc780 0x7f9f1415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f12d9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9f140b04a0 0x7f9f140b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:44714/0 (socket says 172.21.15.130:44714) 2023-09-13T06:06:09.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f12d9d640 1 -- 172.21.15.130:0/4074239585 learned_addr learned my addr 172.21.15.130:0/4074239585 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:09.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f1259c640 1 --1- 172.21.15.130:0/4074239585 >> v1:172.21.15.164:6789/0 conn(0x7f9f1415b130 0x7f9f140ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:35774/0 (socket says 172.21.15.130:35774) 2023-09-13T06:06:09.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f12d9d640 1 -- 172.21.15.130:0/4074239585 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f140cc780 msgr2=0x7f9f1415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:09.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f12d9d640 1 --2- 172.21.15.130:0/4074239585 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f140cc780 0x7f9f1415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f12d9d640 1 -- 172.21.15.130:0/4074239585 >> v1:172.21.15.164:6789/0 conn(0x7f9f1415b130 legacy=0x7f9f140ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f12d9d640 1 -- 172.21.15.130:0/4074239585 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f140cec60 con 0x7f9f140b04a0 2023-09-13T06:06:09.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.817+0000 7f9f09d9b640 1 --2- 172.21.15.130:0/4074239585 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f140cc780 0x7f9f1415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:09.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f12d9d640 1 --2- 172.21.15.130:0/4074239585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f140b04a0 0x7f9f140b0930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009e50 tx=0x7f9f0c01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8038bad718045637 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:09.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f11d9b640 1 -- 172.21.15.130:0/4074239585 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0a58a0 con 0x7f9f140b04a0 2023-09-13T06:06:09.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f11d9b640 1 -- 172.21.15.130:0/4074239585 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c0a5a00 con 0x7f9f140b04a0 2023-09-13T06:06:09.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f11d9b640 1 -- 172.21.15.130:0/4074239585 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0a5d90 con 0x7f9f140b04a0 2023-09-13T06:06:09.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f18d11640 1 -- 172.21.15.130:0/4074239585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f140b04a0 msgr2=0x7f9f140b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f18d11640 1 --2- 172.21.15.130:0/4074239585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f140b04a0 0x7f9f140b0930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009e50 tx=0x7f9f0c01c9e0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f18d11640 1 -- 172.21.15.130:0/4074239585 shutdown_connections 2023-09-13T06:06:09.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f18d11640 1 --2- 172.21.15.130:0/4074239585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f140b04a0 0x7f9f140b0930 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f18d11640 1 --2- 172.21.15.130:0/4074239585 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f140cc780 0x7f9f1415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f18d11640 1 -- 172.21.15.130:0/4074239585 >> 172.21.15.130:0/4074239585 conn(0x7f9f14065990 msgr2=0x7f9f14065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:09.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f18d11640 1 -- 172.21.15.130:0/4074239585 shutdown_connections 2023-09-13T06:06:09.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.821+0000 7f9f18d11640 1 -- 172.21.15.130:0/4074239585 wait complete. 2023-09-13T06:06:09.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f18d11640 1 Processor -- start 2023-09-13T06:06:09.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f18d11640 1 -- start start 2023-09-13T06:06:09.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f18d11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f140b04a0 0x7f9f141517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f18d11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f140cc780 0x7f9f141f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f18d11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f1415b130 0x7f9f140ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f18d11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f14150af0 con 0x7f9f140cc780 2023-09-13T06:06:09.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f18d11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f141f9580 con 0x7f9f140b04a0 2023-09-13T06:06:09.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f18d11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1406fbf0 con 0x7f9f1415b130 2023-09-13T06:06:09.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f09d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f140cc780 0x7f9f141f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f09d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f140cc780 0x7f9f141f9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54638/0 (socket says 172.21.15.130:54638) 2023-09-13T06:06:09.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f09d9b640 1 -- 172.21.15.130:0/502507549 learned_addr learned my addr 172.21.15.130:0/502507549 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:09.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f1259c640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f140b04a0 0x7f9f141517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f12d9d640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f1415b130 0x7f9f140ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f09d9b640 1 -- 172.21.15.130:0/502507549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f1415b130 msgr2=0x7f9f140ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f09d9b640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f1415b130 0x7f9f140ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f09d9b640 1 -- 172.21.15.130:0/502507549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f140b04a0 msgr2=0x7f9f141517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:09.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f09d9b640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f140b04a0 0x7f9f141517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:09.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f09d9b640 1 -- 172.21.15.130:0/502507549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc009420 con 0x7f9f140cc780 2023-09-13T06:06:09.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f09d9b640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f140cc780 0x7f9f141f9040 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00ebe0 tx=0x7f9efc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:09.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f0b7fe640 1 -- 172.21.15.130:0/502507549 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00eee0 con 0x7f9f140cc780 2023-09-13T06:06:09.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f0b7fe640 1 -- 172.21.15.130:0/502507549 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc00cc30 con 0x7f9f140cc780 2023-09-13T06:06:09.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f0b7fe640 1 -- 172.21.15.130:0/502507549 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc013470 con 0x7f9f140cc780 2023-09-13T06:06:09.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f18d11640 1 -- 172.21.15.130:0/502507549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c009b30 con 0x7f9f140cc780 2023-09-13T06:06:09.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f18d11640 1 -- 172.21.15.130:0/502507549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f14150d00 con 0x7f9f140cc780 2023-09-13T06:06:09.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.825+0000 7f9f18d11640 1 -- 172.21.15.130:0/502507549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f140618a0 con 0x7f9f140cc780 2023-09-13T06:06:09.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.829+0000 7f9f0b7fe640 1 -- 172.21.15.130:0/502507549 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9efc0135d0 con 0x7f9f140cc780 2023-09-13T06:06:09.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.829+0000 7f9f0b7fe640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ef4065b20 0x7f9ef4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:09.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.829+0000 7f9f0b7fe640 1 -- 172.21.15.130:0/502507549 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9efc0833b0 con 0x7f9f140cc780 2023-09-13T06:06:09.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.829+0000 7f9f1259c640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ef4065b20 0x7f9ef4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:09.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.829+0000 7f9f1259c640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ef4065b20 0x7f9ef4067fe0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9f04000f70 tx=0x7f9f04007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:09.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:09.833+0000 7f9f0b7fe640 1 -- 172.21.15.130:0/502507549 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9efc050f60 con 0x7f9f140cc780 2023-09-13T06:06:10.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:10.033+0000 7f9f18d11640 1 -- 172.21.15.130:0/502507549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f9f1406f910 con 0x7f9f140cc780 2023-09-13T06:06:11.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f0b7fe640 1 -- 172.21.15.130:0/502507549 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v262) v1 ==== 140+0+0 (secure 0 0 0) 0x7f9efc054580 con 0x7f9f140cc780 2023-09-13T06:06:11.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 -- 172.21.15.130:0/502507549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ef4065b20 msgr2=0x7f9ef4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ef4065b20 0x7f9ef4067fe0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9f04000f70 tx=0x7f9f04007c90 comp rx=0 tx=0).stop 2023-09-13T06:06:11.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 -- 172.21.15.130:0/502507549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f140cc780 msgr2=0x7f9f141f9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f140cc780 0x7f9f141f9040 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00ebe0 tx=0x7f9efc00c520 comp rx=0 tx=0).stop 2023-09-13T06:06:11.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 -- 172.21.15.130:0/502507549 shutdown_connections 2023-09-13T06:06:11.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ef4065b20 0x7f9ef4067fe0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f1415b130 0x7f9f140ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f140cc780 0x7f9f141f9040 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 --2- 172.21.15.130:0/502507549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f140b04a0 0x7f9f141517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 -- 172.21.15.130:0/502507549 >> 172.21.15.130:0/502507549 conn(0x7f9f14065990 msgr2=0x7f9f140b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:11.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 -- 172.21.15.130:0/502507549 shutdown_connections 2023-09-13T06:06:11.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.005+0000 7f9f18d11640 1 -- 172.21.15.130:0/502507549 wait complete. 2023-09-13T06:06:11.032 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-09-13T06:06:11.190 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_objectstore":"memstore"} 2023-09-13T06:06:11.191 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-09-13T06:06:11.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-13T06:06:11.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.329+0000 7f3507f59640 1 Processor -- start 2023-09-13T06:06:11.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.329+0000 7f3507f59640 1 -- start start 2023-09-13T06:06:11.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.329+0000 7f3507f59640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35000b2e90 0x7f35000ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.329+0000 7f3507f59640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f35000b1460 0x7f35000b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.329+0000 7f3507f59640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35000b2150 con 0x7f3500144d70 2023-09-13T06:06:11.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.329+0000 7f3507f59640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35000b2430 con 0x7f35000b1460 2023-09-13T06:06:11.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.329+0000 7f3507f59640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35000cedb0 con 0x7f35000b2e90 2023-09-13T06:06:11.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.329+0000 7f35064f6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f35000b1460 0x7f35000b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.329+0000 7f35064f6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f35000b1460 0x7f35000b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34060/0 (socket says 172.21.15.130:34060) 2023-09-13T06:06:11.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.329+0000 7f35064f6640 1 -- 172.21.15.130:0/2208299403 learned_addr learned my addr 172.21.15.130:0/2208299403 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:11.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f35054f4640 1 --2- 172.21.15.130:0/2208299403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35000b2e90 0x7f35000ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f35064f6640 1 -- 172.21.15.130:0/2208299403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35000b2e90 msgr2=0x7f35000ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:11.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f35064f6640 1 --2- 172.21.15.130:0/2208299403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35000b2e90 0x7f35000ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f35064f6640 1 -- 172.21.15.130:0/2208299403 >> v1:172.21.15.164:6789/0 conn(0x7f3500144d70 legacy=0x7f35000b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f35064f6640 1 -- 172.21.15.130:0/2208299403 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35000cdd90 con 0x7f35000b1460 2023-09-13T06:06:11.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f35064f6640 1 --2- 172.21.15.130:0/2208299403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35000b1460 0x7f35000b18f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009e50 tx=0x7f34f801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174fea1ba1e61803 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:11.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f3504cf3640 1 -- 172.21.15.130:0/2208299403 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80a57d0 con 0x7f35000b1460 2023-09-13T06:06:11.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f3504cf3640 1 -- 172.21.15.130:0/2208299403 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f80a5930 con 0x7f35000b1460 2023-09-13T06:06:11.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f3504cf3640 1 -- 172.21.15.130:0/2208299403 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80a5cc0 con 0x7f35000b1460 2023-09-13T06:06:11.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f3507f59640 1 -- 172.21.15.130:0/2208299403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35000b1460 msgr2=0x7f35000b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f3507f59640 1 --2- 172.21.15.130:0/2208299403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35000b1460 0x7f35000b18f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009e50 tx=0x7f34f801ca10 comp rx=0 tx=0).stop 2023-09-13T06:06:11.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f3507f59640 1 -- 172.21.15.130:0/2208299403 shutdown_connections 2023-09-13T06:06:11.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f3507f59640 1 --2- 172.21.15.130:0/2208299403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35000b1460 0x7f35000b18f0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f3507f59640 1 --2- 172.21.15.130:0/2208299403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35000b2e90 0x7f35000ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.333+0000 7f3507f59640 1 -- 172.21.15.130:0/2208299403 >> 172.21.15.130:0/2208299403 conn(0x7f3500065990 msgr2=0x7f3500065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:11.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f3507f59640 1 -- 172.21.15.130:0/2208299403 shutdown_connections 2023-09-13T06:06:11.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f3507f59640 1 -- 172.21.15.130:0/2208299403 wait complete. 2023-09-13T06:06:11.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f3507f59640 1 Processor -- start 2023-09-13T06:06:11.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f3507f59640 1 -- start start 2023-09-13T06:06:11.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f3507f59640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35000b1460 0x7f3500138b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f3507f59640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35000b2e90 0x7f35001f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f3507f59640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3500144d70 0x7f35000ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f3507f59640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000aeb70 con 0x7f3500144d70 2023-09-13T06:06:11.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f3507f59640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000adef0 con 0x7f35000b2e90 2023-09-13T06:06:11.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f3507f59640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35000ae1d0 con 0x7f35000b1460 2023-09-13T06:06:11.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f35064f6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3500144d70 0x7f35000ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f35064f6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3500144d70 0x7f35000ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34062/0 (socket says 172.21.15.130:34062) 2023-09-13T06:06:11.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f35064f6640 1 -- 172.21.15.130:0/3425786135 learned_addr learned my addr 172.21.15.130:0/3425786135 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:11.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f35054f4640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35000b2e90 0x7f35001f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f3505cf5640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35000b1460 0x7f3500138b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f35064f6640 1 -- 172.21.15.130:0/3425786135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35000b1460 msgr2=0x7f3500138b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f35064f6640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35000b1460 0x7f3500138b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f35064f6640 1 -- 172.21.15.130:0/3425786135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35000b2e90 msgr2=0x7f35001f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f35064f6640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35000b2e90 0x7f35001f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f35064f6640 1 -- 172.21.15.130:0/3425786135 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f8009b30 con 0x7f3500144d70 2023-09-13T06:06:11.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f35054f4640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35000b2e90 0x7f35001f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:11.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.337+0000 7f35064f6640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3500144d70 0x7f35000ccb60 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f34f80af040 tx=0x7f34f80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:11.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.341+0000 7f34f67fc640 1 -- 172.21.15.130:0/3425786135 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80b8670 con 0x7f3500144d70 2023-09-13T06:06:11.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.341+0000 7f34f67fc640 1 -- 172.21.15.130:0/3425786135 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f80b87d0 con 0x7f3500144d70 2023-09-13T06:06:11.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.341+0000 7f3507f59640 1 -- 172.21.15.130:0/3425786135 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35000ae4b0 con 0x7f3500144d70 2023-09-13T06:06:11.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.341+0000 7f34f67fc640 1 -- 172.21.15.130:0/3425786135 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80b8b80 con 0x7f3500144d70 2023-09-13T06:06:11.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.341+0000 7f3507f59640 1 -- 172.21.15.130:0/3425786135 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3500139080 con 0x7f3500144d70 2023-09-13T06:06:11.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.341+0000 7f3507f59640 1 -- 172.21.15.130:0/3425786135 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35000aecb0 con 0x7f3500144d70 2023-09-13T06:06:11.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.341+0000 7f34f67fc640 1 -- 172.21.15.130:0/3425786135 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f34f80b8ce0 con 0x7f3500144d70 2023-09-13T06:06:11.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.341+0000 7f34f67fc640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f34e4065b20 0x7f34e4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.341+0000 7f34f67fc640 1 -- 172.21.15.130:0/3425786135 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f34f811e7d0 con 0x7f3500144d70 2023-09-13T06:06:11.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.341+0000 7f3505cf5640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f34e4065b20 0x7f34e4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.341+0000 7f3505cf5640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f34e4065b20 0x7f34e4067fe0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f34fc000f70 tx=0x7f34fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:11.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.345+0000 7f34f67fc640 1 -- 172.21.15.130:0/3425786135 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f35000aecb0 con 0x7f3500144d70 2023-09-13T06:06:11.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.493+0000 7f3507f59640 1 -- 172.21.15.130:0/3425786135 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f35000aee90 con 0x7f3500144d70 2023-09-13T06:06:11.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.497+0000 7f34f67fc640 1 -- 172.21.15.130:0/3425786135 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f35000aee90 con 0x7f3500144d70 2023-09-13T06:06:11.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 -- 172.21.15.130:0/3425786135 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f34e4065b20 msgr2=0x7f34e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f34e4065b20 0x7f34e4067fe0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f34fc000f70 tx=0x7f34fc009040 comp rx=0 tx=0).stop 2023-09-13T06:06:11.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 -- 172.21.15.130:0/3425786135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3500144d70 msgr2=0x7f35000ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3500144d70 0x7f35000ccb60 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f34f80af040 tx=0x7f34f80197b0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 -- 172.21.15.130:0/3425786135 shutdown_connections 2023-09-13T06:06:11.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f34e4065b20 0x7f34e4067fe0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35000b2e90 0x7f35001f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3500144d70 0x7f35000ccb60 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 --2- 172.21.15.130:0/3425786135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35000b1460 0x7f3500138b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 -- 172.21.15.130:0/3425786135 >> 172.21.15.130:0/3425786135 conn(0x7f3500065990 msgr2=0x7f35000ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:11.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 -- 172.21.15.130:0/3425786135 shutdown_connections 2023-09-13T06:06:11.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.501+0000 7f3507f59640 1 -- 172.21.15.130:0/3425786135 wait complete. 2023-09-13T06:06:11.521 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:06:11.522 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:06:11.588 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:06:11.649 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:06:11.650 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:11.650 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:11.659 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:06:11.660 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:06:11.660 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:11.671 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:06:11.672 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:11.672 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:11.712 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:06:11.713 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:06:11.713 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:11.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:06:11.724 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-13T06:06:11.724 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:11.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.889+0000 7f698b39f640 1 Processor -- start 2023-09-13T06:06:11.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.889+0000 7f698b39f640 1 -- start start 2023-09-13T06:06:11.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698b39f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6984159f20 0x7f69840ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698b39f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f69840cdfc0 0x7f69840b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698b39f640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69840ccfd0 con 0x7f69840b1610 2023-09-13T06:06:11.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698b39f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69840b00f0 con 0x7f69840cdfc0 2023-09-13T06:06:11.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698b39f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69840ce420 con 0x7f6984159f20 2023-09-13T06:06:11.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698893a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f69840cdfc0 0x7f69840b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698913b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6984159f20 0x7f69840ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698993c640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f69840b1610 0x7f69840ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:42842/0 (socket says 172.21.15.130:42842) 2023-09-13T06:06:11.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698993c640 1 -- 172.21.15.130:0/3904226307 learned_addr learned my addr 172.21.15.130:0/3904226307 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:11.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698913b640 1 -- 172.21.15.130:0/3904226307 >> v2:172.21.15.164:3300/0 conn(0x7f69840cdfc0 msgr2=0x7f69840b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:11.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698913b640 1 --2- 172.21.15.130:0/3904226307 >> v2:172.21.15.164:3300/0 conn(0x7f69840cdfc0 0x7f69840b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698913b640 1 -- 172.21.15.130:0/3904226307 >> v1:172.21.15.164:6789/0 conn(0x7f69840b1610 legacy=0x7f69840ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698913b640 1 -- 172.21.15.130:0/3904226307 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69840ced90 con 0x7f6984159f20 2023-09-13T06:06:11.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.893+0000 7f698893a640 1 --2- 172.21.15.130:0/3904226307 >> v2:172.21.15.164:3300/0 conn(0x7f69840cdfc0 0x7f69840b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:11.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f698913b640 1 --2- 172.21.15.130:0/3904226307 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6984159f20 0x7f69840ce7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f69800097c0 tx=0x7f698001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d00a39855e6756fa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:11.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f697bfff640 1 -- 172.21.15.130:0/3904226307 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69800ab600 con 0x7f6984159f20 2023-09-13T06:06:11.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f697bfff640 1 -- 172.21.15.130:0/3904226307 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69800a7050 con 0x7f6984159f20 2023-09-13T06:06:11.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f697bfff640 1 -- 172.21.15.130:0/3904226307 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69800ab980 con 0x7f6984159f20 2023-09-13T06:06:11.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f698b39f640 1 -- 172.21.15.130:0/3904226307 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6984159f20 msgr2=0x7f69840ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f698b39f640 1 --2- 172.21.15.130:0/3904226307 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6984159f20 0x7f69840ce7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f69800097c0 tx=0x7f698001c480 comp rx=0 tx=0).stop 2023-09-13T06:06:11.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f698b39f640 1 -- 172.21.15.130:0/3904226307 shutdown_connections 2023-09-13T06:06:11.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f698b39f640 1 --2- 172.21.15.130:0/3904226307 >> v2:172.21.15.164:3300/0 conn(0x7f69840cdfc0 0x7f69840b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f698b39f640 1 --2- 172.21.15.130:0/3904226307 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6984159f20 0x7f69840ce7b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f698b39f640 1 -- 172.21.15.130:0/3904226307 >> 172.21.15.130:0/3904226307 conn(0x7f6984065990 msgr2=0x7f6984065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:11.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f698b39f640 1 -- 172.21.15.130:0/3904226307 shutdown_connections 2023-09-13T06:06:11.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f698b39f640 1 -- 172.21.15.130:0/3904226307 wait complete. 2023-09-13T06:06:11.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f698b39f640 1 Processor -- start 2023-09-13T06:06:11.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.897+0000 7f698b39f640 1 -- start start 2023-09-13T06:06:11.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698b39f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69840b1610 0x7f698414aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698b39f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69840cdfc0 0x7f698414b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698b39f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6984159f20 0x7f698414f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698b39f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698414b020 con 0x7f69840b1610 2023-09-13T06:06:11.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698b39f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698414ce80 con 0x7f6984159f20 2023-09-13T06:06:11.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698b39f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698414ba80 con 0x7f69840cdfc0 2023-09-13T06:06:11.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698913b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69840b1610 0x7f698414aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698913b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69840b1610 0x7f698414aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34072/0 (socket says 172.21.15.130:34072) 2023-09-13T06:06:11.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698913b640 1 -- 172.21.15.130:0/3389195491 learned_addr learned my addr 172.21.15.130:0/3389195491 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:11.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698993c640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6984159f20 0x7f698414f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698893a640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69840cdfc0 0x7f698414b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698913b640 1 -- 172.21.15.130:0/3389195491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69840cdfc0 msgr2=0x7f698414b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698913b640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69840cdfc0 0x7f698414b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698913b640 1 -- 172.21.15.130:0/3389195491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6984159f20 msgr2=0x7f698414f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:11.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698913b640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6984159f20 0x7f698414f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:11.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698913b640 1 -- 172.21.15.130:0/3389195491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6974009420 con 0x7f69840b1610 2023-09-13T06:06:11.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698913b640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69840b1610 0x7f698414aae0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f698001a0b0 tx=0x7f6980019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:11.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f6979ffb640 1 -- 172.21.15.130:0/3389195491 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69800b4400 con 0x7f69840b1610 2023-09-13T06:06:11.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f6979ffb640 1 -- 172.21.15.130:0/3389195491 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69800b4580 con 0x7f69840b1610 2023-09-13T06:06:11.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698b39f640 1 -- 172.21.15.130:0/3389195491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6980009420 con 0x7f69840b1610 2023-09-13T06:06:11.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f6979ffb640 1 -- 172.21.15.130:0/3389195491 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69800b4930 con 0x7f69840b1610 2023-09-13T06:06:11.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698b39f640 1 -- 172.21.15.130:0/3389195491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698414c040 con 0x7f69840b1610 2023-09-13T06:06:11.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.901+0000 7f698b39f640 1 -- 172.21.15.130:0/3389195491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698406dac0 con 0x7f69840b1610 2023-09-13T06:06:11.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.905+0000 7f6979ffb640 1 -- 172.21.15.130:0/3389195491 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f69800b2040 con 0x7f69840b1610 2023-09-13T06:06:11.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.905+0000 7f6979ffb640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6968065b20 0x7f6968067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:11.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.905+0000 7f6979ffb640 1 -- 172.21.15.130:0/3389195491 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f698011ce10 con 0x7f69840b1610 2023-09-13T06:06:11.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.905+0000 7f698893a640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6968065b20 0x7f6968067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:11.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.905+0000 7f698893a640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6968065b20 0x7f6968067fe0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69840cb6d0 tx=0x7f6974009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:11.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:11.909+0000 7f6979ffb640 1 -- 172.21.15.130:0/3389195491 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f69800eaba0 con 0x7f69840b1610 2023-09-13T06:06:12.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 -- 172.21.15.130:0/3389195491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69840cd7c0 con 0x7f69840b1610 2023-09-13T06:06:12.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f6979ffb640 1 -- 172.21.15.130:0/3389195491 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f69800bb090 con 0x7f69840b1610 2023-09-13T06:06:12.102 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:12.102 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5660,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2267621007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2267621007},{"type":"v1","addr":"172.21.15.164:6834","nonce":2267621007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5663,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/658594571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":658594571},{"type":"v1","addr":"172.21.15.164:6835","nonce":658594571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6474,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1441650800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1441650800},{"type":"v1","addr":"172.21.15.130:6836","nonce":1441650800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37},{"gid":6807,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/4039700612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":4039700612},{"type":"v1","addr":"172.21.15.130:6837","nonce":4039700612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[]} 2023-09-13T06:06:12.103 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 45 2023-09-13T06:06:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 -- 172.21.15.130:0/3389195491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6968065b20 msgr2=0x7f6968067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6968065b20 0x7f6968067fe0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69840cb6d0 tx=0x7f6974009190 comp rx=0 tx=0).stop 2023-09-13T06:06:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 -- 172.21.15.130:0/3389195491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69840b1610 msgr2=0x7f698414aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69840b1610 0x7f698414aae0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f698001a0b0 tx=0x7f6980019220 comp rx=0 tx=0).stop 2023-09-13T06:06:12.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 -- 172.21.15.130:0/3389195491 shutdown_connections 2023-09-13T06:06:12.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6968065b20 0x7f6968067fe0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:12.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6984159f20 0x7f698414f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:12.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69840cdfc0 0x7f698414b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:12.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 --2- 172.21.15.130:0/3389195491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69840b1610 0x7f698414aae0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:12.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 -- 172.21.15.130:0/3389195491 >> 172.21.15.130:0/3389195491 conn(0x7f6984065990 msgr2=0x7f69841565b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:12.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 -- 172.21.15.130:0/3389195491 shutdown_connections 2023-09-13T06:06:12.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.101+0000 7f698b39f640 1 -- 172.21.15.130:0/3389195491 wait complete. 2023-09-13T06:06:12.123 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T06:06:12.123 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-13T06:06:12.123 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T06:06:12.123 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:06:12.124 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T06:06:12.124 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-13T06:06:12.124 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T06:06:12.125 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:06:12.125 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T06:06:12.125 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-13T06:06:12.125 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T06:06:12.126 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:06:12.126 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T06:06:12.126 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-13T06:06:12.127 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T06:06:12.127 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:06:12.138 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T06:06:12.139 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T06:06:12.140 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T06:06:12.140 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T06:06:12.141 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T06:06:12.142 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T06:06:12.143 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T06:06:12.143 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T06:06:12.185 INFO:tasks.ceph.mds.b:Started 2023-09-13T06:06:12.185 DEBUG:teuthology.parallel:result is None 2023-09-13T06:06:12.187 INFO:tasks.ceph.mds.d:Started 2023-09-13T06:06:12.188 DEBUG:teuthology.parallel:result is None 2023-09-13T06:06:12.188 INFO:tasks.ceph.mds.a:Started 2023-09-13T06:06:12.189 DEBUG:teuthology.parallel:result is None 2023-09-13T06:06:12.189 INFO:tasks.ceph.mds.c:Started 2023-09-13T06:06:12.190 DEBUG:teuthology.parallel:result is None 2023-09-13T06:06:12.190 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-13T06:06:12.277 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:06:12.277 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:06:12.278 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:06:12.279 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:06:12.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.333+0000 7fdd01f96640 1 Processor -- start 2023-09-13T06:06:12.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.333+0000 7fdd01f96640 1 -- start start 2023-09-13T06:06:12.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdd01f96640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1750 0x7fdcfc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:12.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdd01f96640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdcfc0d1090 0x7fdcfc146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:12.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdd01f96640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc0b63c0 con 0x7fdcfc0d1b30 2023-09-13T06:06:12.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdd01f96640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc15dea0 con 0x7fdcfc0d1090 2023-09-13T06:06:12.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdd01f96640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0d0c20 con 0x7fdcfc0d1750 2023-09-13T06:06:12.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdcfb7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1750 0x7fdcfc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:12.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdcfb7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1750 0x7fdcfc15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:48870/0 (socket says 172.21.15.130:48870) 2023-09-13T06:06:12.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdcfb7fe640 1 -- 172.21.15.130:0/3950693324 learned_addr learned my addr 172.21.15.130:0/3950693324 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:12.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdcfaffd640 1 --2- 172.21.15.130:0/3950693324 >> v2:172.21.15.164:3300/0 conn(0x7fdcfc0d1090 0x7fdcfc146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:12.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdcfb7fe640 1 -- 172.21.15.130:0/3950693324 >> v2:172.21.15.164:3300/0 conn(0x7fdcfc0d1090 msgr2=0x7fdcfc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:12.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdcfb7fe640 1 --2- 172.21.15.130:0/3950693324 >> v2:172.21.15.164:3300/0 conn(0x7fdcfc0d1090 0x7fdcfc146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:12.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdcfb7fe640 1 -- 172.21.15.130:0/3950693324 >> v1:172.21.15.164:6789/0 conn(0x7fdcfc0d1b30 legacy=0x7fdcfc0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:12.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdcfb7fe640 1 -- 172.21.15.130:0/3950693324 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0b6610 con 0x7fdcfc0d1750 2023-09-13T06:06:12.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.337+0000 7fdcfaffd640 1 --2- 172.21.15.130:0/3950693324 >> v2:172.21.15.164:3300/0 conn(0x7fdcfc0d1090 0x7fdcfc146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:12.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdcfb7fe640 1 --2- 172.21.15.130:0/3950693324 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1750 0x7fdcfc15d960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009870 tx=0x7fdcec01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3500fa17d2434c9b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:12.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdcfa7fc640 1 -- 172.21.15.130:0/3950693324 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0aa670 con 0x7fdcfc0d1750 2023-09-13T06:06:12.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdcfa7fc640 1 -- 172.21.15.130:0/3950693324 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec0aa7d0 con 0x7fdcfc0d1750 2023-09-13T06:06:12.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdcfa7fc640 1 -- 172.21.15.130:0/3950693324 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0aab60 con 0x7fdcfc0d1750 2023-09-13T06:06:12.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdd01f96640 1 -- 172.21.15.130:0/3950693324 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1750 msgr2=0x7fdcfc15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:12.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdd01f96640 1 --2- 172.21.15.130:0/3950693324 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1750 0x7fdcfc15d960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009870 tx=0x7fdcec01c510 comp rx=0 tx=0).stop 2023-09-13T06:06:12.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdd01f96640 1 -- 172.21.15.130:0/3950693324 shutdown_connections 2023-09-13T06:06:12.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdd01f96640 1 --2- 172.21.15.130:0/3950693324 >> v2:172.21.15.164:3300/0 conn(0x7fdcfc0d1090 0x7fdcfc146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:12.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdd01f96640 1 --2- 172.21.15.130:0/3950693324 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1750 0x7fdcfc15d960 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:12.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdd01f96640 1 -- 172.21.15.130:0/3950693324 >> 172.21.15.130:0/3950693324 conn(0x7fdcfc06f170 msgr2=0x7fdcfc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:12.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdd01f96640 1 -- 172.21.15.130:0/3950693324 shutdown_connections 2023-09-13T06:06:12.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdd01f96640 1 -- 172.21.15.130:0/3950693324 wait complete. 2023-09-13T06:06:12.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdd01f96640 1 Processor -- start 2023-09-13T06:06:12.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.341+0000 7fdd01f96640 1 -- start start 2023-09-13T06:06:12.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdd01f96640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc0d1090 0x7fdcfc13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:12.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdd01f96640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcfc0d1750 0x7fdcfc164df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:12.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdd01f96640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1b30 0x7fdcfc1f9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:12.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdd01f96640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc162350 con 0x7fdcfc0d1750 2023-09-13T06:06:12.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdd01f96640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc168000 con 0x7fdcfc0d1090 2023-09-13T06:06:12.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdd01f96640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc1404f0 con 0x7fdcfc0d1b30 2023-09-13T06:06:12.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdcfaffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcfc0d1750 0x7fdcfc164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:12.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdcfb7fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc0d1090 0x7fdcfc13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:12.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdcfaffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcfc0d1750 0x7fdcfc164df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34122/0 (socket says 172.21.15.130:34122) 2023-09-13T06:06:12.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdcfaffd640 1 -- 172.21.15.130:0/2045189368 learned_addr learned my addr 172.21.15.130:0/2045189368 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:12.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdcfbfff640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1b30 0x7fdcfc1f9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:12.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdcfb7fe640 1 -- 172.21.15.130:0/2045189368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1b30 msgr2=0x7fdcfc1f9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:12.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdcfb7fe640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1b30 0x7fdcfc1f9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:12.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdcfb7fe640 1 -- 172.21.15.130:0/2045189368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcfc0d1750 msgr2=0x7fdcfc164df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:12.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdcfb7fe640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcfc0d1750 0x7fdcfc164df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:12.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdcfb7fe640 1 -- 172.21.15.130:0/2045189368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec0094d0 con 0x7fdcfc0d1090 2023-09-13T06:06:12.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdcfb7fe640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc0d1090 0x7fdcfc13fe60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0ab000 tx=0x7fdcec01ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:12.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdce3fff640 1 -- 172.21.15.130:0/2045189368 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0b3800 con 0x7fdcfc0d1090 2023-09-13T06:06:12.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdce3fff640 1 -- 172.21.15.130:0/2045189368 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec0b3980 con 0x7fdcfc0d1090 2023-09-13T06:06:12.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdce3fff640 1 -- 172.21.15.130:0/2045189368 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0b3d30 con 0x7fdcfc0d1090 2023-09-13T06:06:12.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdd01f96640 1 -- 172.21.15.130:0/2045189368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc1407d0 con 0x7fdcfc0d1090 2023-09-13T06:06:12.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdd01f96640 1 -- 172.21.15.130:0/2045189368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc140d90 con 0x7fdcfc0d1090 2023-09-13T06:06:12.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.345+0000 7fdd01f96640 1 -- 172.21.15.130:0/2045189368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc0618a0 con 0x7fdcfc0d1090 2023-09-13T06:06:12.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.349+0000 7fdce3fff640 1 -- 172.21.15.130:0/2045189368 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdcec0059a0 con 0x7fdcfc0d1090 2023-09-13T06:06:12.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.349+0000 7fdce3fff640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdce8065b20 0x7fdce8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:12.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.349+0000 7fdce3fff640 1 -- 172.21.15.130:0/2045189368 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdcec11da50 con 0x7fdcfc0d1090 2023-09-13T06:06:12.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.349+0000 7fdcfaffd640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdce8065b20 0x7fdce8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:12.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.349+0000 7fdcfaffd640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdce8065b20 0x7fdce8067fe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc1f9d80 tx=0x7fdcf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:12.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.353+0000 7fdce3fff640 1 -- 172.21.15.130:0/2045189368 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdcec0eb6a0 con 0x7fdcfc0d1090 2023-09-13T06:06:12.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:12.521+0000 7fdd01f96640 1 -- 172.21.15.130:0/2045189368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdcfc0b86c0 con 0x7fdcfc0d1090 2023-09-13T06:06:13.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdce3fff640 1 -- 172.21.15.130:0/2045189368 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v98) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdcec0c3070 con 0x7fdcfc0d1090 2023-09-13T06:06:13.390 INFO:teuthology.orchestra.run.smithi130.stderr: removed all blocklist entries 2023-09-13T06:06:13.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 -- 172.21.15.130:0/2045189368 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdce8065b20 msgr2=0x7fdce8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdce8065b20 0x7fdce8067fe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc1f9d80 tx=0x7fdcf0008040 comp rx=0 tx=0).stop 2023-09-13T06:06:13.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 -- 172.21.15.130:0/2045189368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc0d1090 msgr2=0x7fdcfc13fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc0d1090 0x7fdcfc13fe60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0ab000 tx=0x7fdcec01ad50 comp rx=0 tx=0).stop 2023-09-13T06:06:13.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 -- 172.21.15.130:0/2045189368 shutdown_connections 2023-09-13T06:06:13.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdce8065b20 0x7fdce8067fe0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcfc0d1b30 0x7fdcfc1f9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcfc0d1750 0x7fdcfc164df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 --2- 172.21.15.130:0/2045189368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcfc0d1090 0x7fdcfc13fe60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 -- 172.21.15.130:0/2045189368 >> 172.21.15.130:0/2045189368 conn(0x7fdcfc06f170 msgr2=0x7fdcfc145ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:13.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 -- 172.21.15.130:0/2045189368 shutdown_connections 2023-09-13T06:06:13.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.389+0000 7fdd01f96640 1 -- 172.21.15.130:0/2045189368 wait complete. 2023-09-13T06:06:13.415 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-13T06:06:13.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.553+0000 7fc9d58cb640 1 Processor -- start 2023-09-13T06:06:13.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.553+0000 7fc9d58cb640 1 -- start start 2023-09-13T06:06:13.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9d58cb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc9d00d1750 0x7fc9d015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:13.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9d58cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1090 0x7fc9d0146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:13.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9d58cb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00b63c0 con 0x7fc9d00d1b30 2023-09-13T06:06:13.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9d58cb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d015dea0 con 0x7fc9d00d1750 2023-09-13T06:06:13.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9d58cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00d0c20 con 0x7fc9d00d1090 2023-09-13T06:06:13.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9ceffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc9d00d1750 0x7fc9d015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:13.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9cf7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc9d00d1b30 0x7fc9d00b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55334/0 (socket says 172.21.15.130:55334) 2023-09-13T06:06:13.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9ceffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc9d00d1750 0x7fc9d015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34130/0 (socket says 172.21.15.130:34130) 2023-09-13T06:06:13.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9cf7fe640 1 -- 172.21.15.130:0/3648889218 learned_addr learned my addr 172.21.15.130:0/3648889218 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:13.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9c67fc640 1 --2- 172.21.15.130:0/3648889218 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1090 0x7fc9d0146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:13.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9ceffd640 1 -- 172.21.15.130:0/3648889218 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1090 msgr2=0x7fc9d0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:13.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9ceffd640 1 --2- 172.21.15.130:0/3648889218 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1090 0x7fc9d0146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9ceffd640 1 -- 172.21.15.130:0/3648889218 >> v1:172.21.15.130:6789/0 conn(0x7fc9d00d1b30 legacy=0x7fc9d00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9ceffd640 1 -- 172.21.15.130:0/3648889218 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d00b6610 con 0x7fc9d00d1750 2023-09-13T06:06:13.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.557+0000 7fc9c67fc640 1 --2- 172.21.15.130:0/3648889218 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1090 0x7fc9d0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:13.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9ceffd640 1 --2- 172.21.15.130:0/3648889218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d00d1750 0x7fc9d015d960 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00097c0 tx=0x7fc9c001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919bde75d9e71103 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:13.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9ce7fc640 1 -- 172.21.15.130:0/3648889218 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00ab650 con 0x7fc9d00d1750 2023-09-13T06:06:13.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9ce7fc640 1 -- 172.21.15.130:0/3648889218 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c00ab7b0 con 0x7fc9d00d1750 2023-09-13T06:06:13.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9ce7fc640 1 -- 172.21.15.130:0/3648889218 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00abb40 con 0x7fc9d00d1750 2023-09-13T06:06:13.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9d58cb640 1 -- 172.21.15.130:0/3648889218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d00d1750 msgr2=0x7fc9d015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9d58cb640 1 --2- 172.21.15.130:0/3648889218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d00d1750 0x7fc9d015d960 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00097c0 tx=0x7fc9c001c450 comp rx=0 tx=0).stop 2023-09-13T06:06:13.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9d58cb640 1 -- 172.21.15.130:0/3648889218 shutdown_connections 2023-09-13T06:06:13.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9d58cb640 1 --2- 172.21.15.130:0/3648889218 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1090 0x7fc9d0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9d58cb640 1 --2- 172.21.15.130:0/3648889218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d00d1750 0x7fc9d015d960 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9d58cb640 1 -- 172.21.15.130:0/3648889218 >> 172.21.15.130:0/3648889218 conn(0x7fc9d006f170 msgr2=0x7fc9d006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:13.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9d58cb640 1 -- 172.21.15.130:0/3648889218 shutdown_connections 2023-09-13T06:06:13.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9d58cb640 1 -- 172.21.15.130:0/3648889218 wait complete. 2023-09-13T06:06:13.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9d58cb640 1 Processor -- start 2023-09-13T06:06:13.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.561+0000 7fc9d58cb640 1 -- start start 2023-09-13T06:06:13.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9d58cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d00d1090 0x7fc9d00b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:13.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9d58cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d00d1750 0x7fc9d015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:13.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9d58cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1b30 0x7fc9d013e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:13.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9d58cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b4910 con 0x7fc9d00d1750 2023-09-13T06:06:13.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9d58cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b4bf0 con 0x7fc9d00d1090 2023-09-13T06:06:13.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9d58cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b4ed0 con 0x7fc9d00d1b30 2023-09-13T06:06:13.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9c67fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d00d1750 0x7fc9d015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:13.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9c67fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d00d1750 0x7fc9d015aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34142/0 (socket says 172.21.15.130:34142) 2023-09-13T06:06:13.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9c67fc640 1 -- 172.21.15.130:0/2573655114 learned_addr learned my addr 172.21.15.130:0/2573655114 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:13.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9ceffd640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d00d1090 0x7fc9d00b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:13.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9cf7fe640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1b30 0x7fc9d013e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:13.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9c67fc640 1 -- 172.21.15.130:0/2573655114 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1b30 msgr2=0x7fc9d013e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9c67fc640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1b30 0x7fc9d013e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9c67fc640 1 -- 172.21.15.130:0/2573655114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d00d1090 msgr2=0x7fc9d00b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9c67fc640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d00d1090 0x7fc9d00b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9c67fc640 1 -- 172.21.15.130:0/2573655114 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0009420 con 0x7fc9d00d1750 2023-09-13T06:06:13.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9ceffd640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d00d1090 0x7fc9d00b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:13.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9cf7fe640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1b30 0x7fc9d013e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:13.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9c67fc640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d00d1750 0x7fc9d015aa30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800c7c0 tx=0x7fc9b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:13.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9ccff9640 1 -- 172.21.15.130:0/2573655114 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8007a30 con 0x7fc9d00d1750 2023-09-13T06:06:13.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9ccff9640 1 -- 172.21.15.130:0/2573655114 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8007b90 con 0x7fc9d00d1750 2023-09-13T06:06:13.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9ccff9640 1 -- 172.21.15.130:0/2573655114 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800ce70 con 0x7fc9d00d1750 2023-09-13T06:06:13.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9d58cb640 1 -- 172.21.15.130:0/2573655114 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d00b51b0 con 0x7fc9d00d1750 2023-09-13T06:06:13.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9d58cb640 1 -- 172.21.15.130:0/2573655114 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d00b4570 con 0x7fc9d00d1750 2023-09-13T06:06:13.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9d58cb640 1 -- 172.21.15.130:0/2573655114 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d00618a0 con 0x7fc9d00d1750 2023-09-13T06:06:13.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.565+0000 7fc9ccff9640 1 -- 172.21.15.130:0/2573655114 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc9b80113f0 con 0x7fc9d00d1750 2023-09-13T06:06:13.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.569+0000 7fc9ccff9640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9b0065b20 0x7fc9b0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:13.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.569+0000 7fc9ccff9640 1 -- 172.21.15.130:0/2573655114 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc9b8083510 con 0x7fc9d00d1750 2023-09-13T06:06:13.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.569+0000 7fc9ceffd640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9b0065b20 0x7fc9b0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:13.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.569+0000 7fc9ceffd640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9b0065b20 0x7fc9b0067fe0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00af000 tx=0x7fc9c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:13.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.573+0000 7fc9ccff9640 1 -- 172.21.15.130:0/2573655114 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc9b8051110 con 0x7fc9d00d1750 2023-09-13T06:06:13.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.769+0000 7fc9d58cb640 1 -- 172.21.15.130:0/2573655114 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc9d00b5660 con 0x7fc9d00d1750 2023-09-13T06:06:13.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.769+0000 7fc9ccff9640 1 -- 172.21.15.130:0/2573655114 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc9b8054730 con 0x7fc9d00d1750 2023-09-13T06:06:13.772 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:13.772 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:06:13.773 INFO:teuthology.orchestra.run.smithi130.stdout: "auth_dump": [ 2023-09-13T06:06:13.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.773 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.a", 2023-09-13T06:06:13.773 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw==", 2023-09-13T06:06:13.773 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.774 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:06:13.774 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:06:13.774 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:06:13.774 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.774 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.775 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.b", 2023-09-13T06:06:13.775 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg==", 2023-09-13T06:06:13.775 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.775 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:06:13.776 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:06:13.776 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:06:13.776 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.776 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.777 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.c", 2023-09-13T06:06:13.777 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A==", 2023-09-13T06:06:13.777 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.777 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:06:13.778 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:06:13.778 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:06:13.778 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.778 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.779 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.d", 2023-09-13T06:06:13.779 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg==", 2023-09-13T06:06:13.779 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.779 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:06:13.779 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:06:13.780 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:06:13.780 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.780 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.781 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.0", 2023-09-13T06:06:13.781 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw==", 2023-09-13T06:06:13.781 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.781 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:06:13.781 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:06:13.782 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.782 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.782 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.1", 2023-09-13T06:06:13.783 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ==", 2023-09-13T06:06:13.783 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.783 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:06:13.783 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:06:13.783 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.783 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.784 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.2", 2023-09-13T06:06:13.784 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw==", 2023-09-13T06:06:13.784 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.785 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:06:13.785 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:06:13.785 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.785 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.786 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.3", 2023-09-13T06:06:13.786 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g==", 2023-09-13T06:06:13.786 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.786 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:06:13.787 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:06:13.787 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.787 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.787 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.4", 2023-09-13T06:06:13.788 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ==", 2023-09-13T06:06:13.788 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.788 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:06:13.788 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:06:13.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.789 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.789 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.5", 2023-09-13T06:06:13.789 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw==", 2023-09-13T06:06:13.790 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.790 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:06:13.790 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:06:13.790 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.790 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.791 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.6", 2023-09-13T06:06:13.791 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA==", 2023-09-13T06:06:13.791 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.792 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:06:13.792 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:06:13.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.792 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.793 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.7", 2023-09-13T06:06:13.793 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA==", 2023-09-13T06:06:13.793 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.793 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:06:13.794 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:06:13.794 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.794 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.795 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.0", 2023-09-13T06:06:13.795 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA==", 2023-09-13T06:06:13.795 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.795 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:06:13.795 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow r", 2023-09-13T06:06:13.795 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-13T06:06:13.796 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.796 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.1", 2023-09-13T06:06:13.796 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg==", 2023-09-13T06:06:13.797 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.797 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:06:13.797 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:06:13.797 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:06:13.797 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:06:13.798 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.798 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.2", 2023-09-13T06:06:13.798 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw==", 2023-09-13T06:06:13.799 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.799 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:06:13.799 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:06:13.799 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:06:13.799 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:06:13.799 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.800 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.3", 2023-09-13T06:06:13.800 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA==", 2023-09-13T06:06:13.800 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.801 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:06:13.801 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:06:13.801 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:06:13.801 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:06:13.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.802 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.admin", 2023-09-13T06:06:13.802 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQANUAFl5ccJOBAAP4KJItnG8vNd5OP/63ai0g==", 2023-09-13T06:06:13.802 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.802 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:06:13.803 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:06:13.803 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:06:13.803 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.804 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.x", 2023-09-13T06:06:13.804 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ==", 2023-09-13T06:06:13.804 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.804 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:06:13.805 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:06:13.805 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.805 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:13.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:13.805 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.y", 2023-09-13T06:06:13.806 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA==", 2023-09-13T06:06:13.806 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:06:13.806 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:06:13.806 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:06:13.806 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:06:13.807 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.807 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:13.807 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:13.807 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:06:13.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 -- 172.21.15.130:0/2573655114 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9b0065b20 msgr2=0x7fc9b0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9b0065b20 0x7fc9b0067fe0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00af000 tx=0x7fc9c0008040 comp rx=0 tx=0).stop 2023-09-13T06:06:13.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 -- 172.21.15.130:0/2573655114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d00d1750 msgr2=0x7fc9d015aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d00d1750 0x7fc9d015aa30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800c7c0 tx=0x7fc9b800cc80 comp rx=0 tx=0).stop 2023-09-13T06:06:13.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 -- 172.21.15.130:0/2573655114 shutdown_connections 2023-09-13T06:06:13.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9b0065b20 0x7fc9b0067fe0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d00d1b30 0x7fc9d013e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d00d1750 0x7fc9d015aa30 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 --2- 172.21.15.130:0/2573655114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d00d1090 0x7fc9d00b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 -- 172.21.15.130:0/2573655114 >> 172.21.15.130:0/2573655114 conn(0x7fc9d006f170 msgr2=0x7fc9d015dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:13.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 -- 172.21.15.130:0/2573655114 shutdown_connections 2023-09-13T06:06:13.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.773+0000 7fc9d58cb640 1 -- 172.21.15.130:0/2573655114 wait complete. 2023-09-13T06:06:13.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:13.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f7272048640 1 Processor -- start 2023-09-13T06:06:13.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f7272048640 1 -- start start 2023-09-13T06:06:13.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f7272048640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f726c146f30 0x7f726c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:13.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f7272048640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c0b63c0 con 0x7f726c0d1090 2023-09-13T06:06:13.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f7272048640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c0d0c20 con 0x7f726c0d1750 2023-09-13T06:06:13.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f7272048640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c15dea0 con 0x7f726c146f30 2023-09-13T06:06:13.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f7263fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f726c0d1090 0x7f726c0b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55340/0 (socket says 172.21.15.130:55340) 2023-09-13T06:06:13.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f7263fff640 1 -- 172.21.15.130:0/850882273 learned_addr learned my addr 172.21.15.130:0/850882273 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:13.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f726b7fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f726c0d1750 0x7f726c146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:42868/0 (socket says 172.21.15.130:42868) 2023-09-13T06:06:13.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f726bfff640 1 --2- 172.21.15.130:0/850882273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f726c146f30 0x7f726c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:13.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f726affd640 1 -- 172.21.15.130:0/850882273 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991664001 0 0) 0x7f726c0b63c0 con 0x7f726c0d1090 2023-09-13T06:06:13.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f726affd640 1 -- 172.21.15.130:0/850882273 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7258003530 con 0x7f726c0d1090 2023-09-13T06:06:13.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f726affd640 1 -- 172.21.15.130:0/850882273 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981748567 0 0) 0x7f726c0d0c20 con 0x7f726c0d1750 2023-09-13T06:06:13.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f726affd640 1 -- 172.21.15.130:0/850882273 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f726c0b63c0 con 0x7f726c0d1750 2023-09-13T06:06:13.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f726bfff640 1 -- 172.21.15.130:0/850882273 >> v1:172.21.15.164:6789/0 conn(0x7f726c0d1750 legacy=0x7f726c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f726bfff640 1 -- 172.21.15.130:0/850882273 >> v1:172.21.15.130:6789/0 conn(0x7f726c0d1090 legacy=0x7f726c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.949+0000 7f726bfff640 1 -- 172.21.15.130:0/850882273 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0b6610 con 0x7f726c146f30 2023-09-13T06:06:13.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.953+0000 7f726bfff640 1 --2- 172.21.15.130:0/850882273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f726c146f30 0x7f726c15d960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7264009dc0 tx=0x7f726401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8990f353706c694a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:13.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.953+0000 7f726affd640 1 -- 172.21.15.130:0/850882273 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640a5a00 con 0x7f726c146f30 2023-09-13T06:06:13.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.953+0000 7f726affd640 1 -- 172.21.15.130:0/850882273 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72640a5b60 con 0x7f726c146f30 2023-09-13T06:06:13.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.953+0000 7f726affd640 1 -- 172.21.15.130:0/850882273 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640ad440 con 0x7f726c146f30 2023-09-13T06:06:13.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.953+0000 7f7272048640 1 -- 172.21.15.130:0/850882273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f726c146f30 msgr2=0x7f726c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.953+0000 7f7272048640 1 --2- 172.21.15.130:0/850882273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f726c146f30 0x7f726c15d960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7264009dc0 tx=0x7f726401c940 comp rx=0 tx=0).stop 2023-09-13T06:06:13.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.953+0000 7f7272048640 1 -- 172.21.15.130:0/850882273 shutdown_connections 2023-09-13T06:06:13.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.953+0000 7f7272048640 1 --2- 172.21.15.130:0/850882273 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f726c146f30 0x7f726c15d960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.953+0000 7f7272048640 1 -- 172.21.15.130:0/850882273 >> 172.21.15.130:0/850882273 conn(0x7f726c06f170 msgr2=0x7f726c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:13.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.953+0000 7f7272048640 1 -- 172.21.15.130:0/850882273 shutdown_connections 2023-09-13T06:06:13.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.953+0000 7f7272048640 1 -- 172.21.15.130:0/850882273 wait complete. 2023-09-13T06:06:13.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7272048640 1 Processor -- start 2023-09-13T06:06:13.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7272048640 1 -- start start 2023-09-13T06:06:13.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7272048640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f726c0d1090 0x7f726c13a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:13.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7272048640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f726c0d1750 0x7f726c143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:13.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7272048640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f726c146f30 0x7f726c13ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:13.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7272048640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c13c250 con 0x7f726c0d1750 2023-09-13T06:06:13.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7272048640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c13c530 con 0x7f726c0d1090 2023-09-13T06:06:13.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7272048640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c13c810 con 0x7f726c146f30 2023-09-13T06:06:13.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7263fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f726c0d1750 0x7f726c143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:13.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7263fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f726c0d1750 0x7f726c143f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34144/0 (socket says 172.21.15.130:34144) 2023-09-13T06:06:13.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7263fff640 1 -- 172.21.15.130:0/3187196446 learned_addr learned my addr 172.21.15.130:0/3187196446 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:13.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f726bfff640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f726c146f30 0x7f726c13ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:13.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f726b7fe640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f726c0d1090 0x7f726c13a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:13.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7263fff640 1 -- 172.21.15.130:0/3187196446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f726c146f30 msgr2=0x7f726c13ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7263fff640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f726c146f30 0x7f726c13ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7263fff640 1 -- 172.21.15.130:0/3187196446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f726c0d1090 msgr2=0x7f726c13a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:13.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7263fff640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f726c0d1090 0x7f726c13a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:13.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7263fff640 1 -- 172.21.15.130:0/3187196446 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009a70 con 0x7f726c0d1750 2023-09-13T06:06:13.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7263fff640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f726c0d1750 0x7f726c143f20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7254005890 tx=0x7f725400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:13.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7268ff9640 1 -- 172.21.15.130:0/3187196446 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254005cf0 con 0x7f726c0d1750 2023-09-13T06:06:13.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7268ff9640 1 -- 172.21.15.130:0/3187196446 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254005e50 con 0x7f726c0d1750 2023-09-13T06:06:13.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7268ff9640 1 -- 172.21.15.130:0/3187196446 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72540072b0 con 0x7f726c0d1750 2023-09-13T06:06:13.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7272048640 1 -- 172.21.15.130:0/3187196446 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c13caf0 con 0x7f726c0d1750 2023-09-13T06:06:13.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.957+0000 7f7272048640 1 -- 172.21.15.130:0/3187196446 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c13bf40 con 0x7f726c0d1750 2023-09-13T06:06:13.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.961+0000 7f7272048640 1 -- 172.21.15.130:0/3187196446 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c13d010 con 0x7f726c0d1750 2023-09-13T06:06:13.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.961+0000 7f7268ff9640 1 -- 172.21.15.130:0/3187196446 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7254007410 con 0x7f726c0d1750 2023-09-13T06:06:13.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.961+0000 7f7268ff9640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f724c065b50 0x7f724c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:13.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.961+0000 7f7268ff9640 1 -- 172.21.15.130:0/3187196446 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7254082520 con 0x7f726c0d1750 2023-09-13T06:06:13.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.961+0000 7f726b7fe640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f724c065b50 0x7f724c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:13.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.961+0000 7f726b7fe640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f724c065b50 0x7f724c068010 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f725c0011f0 tx=0x7f725c007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:13.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:13.965+0000 7f7268ff9640 1 -- 172.21.15.130:0/3187196446 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f726c13d010 con 0x7f726c0d1750 2023-09-13T06:06:14.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 -- 172.21.15.130:0/3187196446 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f726c13d010 con 0x7f726c0d1750 2023-09-13T06:06:14.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7268ff9640 1 -- 172.21.15.130:0/3187196446 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+12894 (secure 0 0 0) 0x7f726c13d010 con 0x7f726c0d1750 2023-09-13T06:06:14.118 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:14.119 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":98,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:13.378022+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:14.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 -- 172.21.15.130:0/3187196446 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f724c065b50 msgr2=0x7f724c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f724c065b50 0x7f724c068010 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f725c0011f0 tx=0x7f725c007d40 comp rx=0 tx=0).stop 2023-09-13T06:06:14.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 -- 172.21.15.130:0/3187196446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f726c0d1750 msgr2=0x7f726c143f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f726c0d1750 0x7f726c143f20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7254005890 tx=0x7f725400c960 comp rx=0 tx=0).stop 2023-09-13T06:06:14.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 -- 172.21.15.130:0/3187196446 shutdown_connections 2023-09-13T06:06:14.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f724c065b50 0x7f724c068010 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f726c146f30 0x7f726c13ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f726c0d1750 0x7f726c143f20 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 --2- 172.21.15.130:0/3187196446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f726c0d1090 0x7f726c13a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 -- 172.21.15.130:0/3187196446 >> 172.21.15.130:0/3187196446 conn(0x7f726c06f170 msgr2=0x7f726c0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:14.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 -- 172.21.15.130:0/3187196446 shutdown_connections 2023-09-13T06:06:14.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.117+0000 7f7272048640 1 -- 172.21.15.130:0/3187196446 wait complete. 2023-09-13T06:06:14.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:06:14.140 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:06:14.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce5e419640 1 Processor -- start 2023-09-13T06:06:14.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce5e419640 1 -- start start 2023-09-13T06:06:14.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce5e419640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fce58154380 0x7fce580b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce5e419640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fce58161140 0x7fce5815e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce5e419640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce580b2690 con 0x7fce58154760 2023-09-13T06:06:14.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce5e419640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce58070d80 con 0x7fce58154380 2023-09-13T06:06:14.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce5e419640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce58161700 con 0x7fce58161140 2023-09-13T06:06:14.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce57fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fce58154380 0x7fce580b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce57fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fce58154380 0x7fce580b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34152/0 (socket says 172.21.15.130:34152) 2023-09-13T06:06:14.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce57fff640 1 -- 172.21.15.130:0/688778811 learned_addr learned my addr 172.21.15.130:0/688778811 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:14.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce5c9b6640 1 --2- 172.21.15.130:0/688778811 >> v2:172.21.15.164:3300/0 conn(0x7fce58161140 0x7fce5815e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce57fff640 1 -- 172.21.15.130:0/688778811 >> v2:172.21.15.164:3300/0 conn(0x7fce58161140 msgr2=0x7fce5815e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:14.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce57fff640 1 --2- 172.21.15.130:0/688778811 >> v2:172.21.15.164:3300/0 conn(0x7fce58161140 0x7fce5815e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce57fff640 1 -- 172.21.15.130:0/688778811 >> v1:172.21.15.164:6789/0 conn(0x7fce58154760 legacy=0x7fce58070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:14.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce57fff640 1 -- 172.21.15.130:0/688778811 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce581619e0 con 0x7fce58154380 2023-09-13T06:06:14.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.281+0000 7fce5c9b6640 1 --2- 172.21.15.130:0/688778811 >> v2:172.21.15.164:3300/0 conn(0x7fce58161140 0x7fce5815e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:14.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce57fff640 1 --2- 172.21.15.130:0/688778811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce58154380 0x7fce580b2a80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fce581581c0 tx=0x7fce4801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85574646346d301 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:14.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce56ffd640 1 -- 172.21.15.130:0/688778811 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce480ac630 con 0x7fce58154380 2023-09-13T06:06:14.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce56ffd640 1 -- 172.21.15.130:0/688778811 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce480ac790 con 0x7fce58154380 2023-09-13T06:06:14.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce56ffd640 1 -- 172.21.15.130:0/688778811 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce480acb20 con 0x7fce58154380 2023-09-13T06:06:14.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce5e419640 1 -- 172.21.15.130:0/688778811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce58154380 msgr2=0x7fce580b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce5e419640 1 --2- 172.21.15.130:0/688778811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce58154380 0x7fce580b2a80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fce581581c0 tx=0x7fce4801c4c0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce5e419640 1 -- 172.21.15.130:0/688778811 shutdown_connections 2023-09-13T06:06:14.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce5e419640 1 --2- 172.21.15.130:0/688778811 >> v2:172.21.15.164:3300/0 conn(0x7fce58161140 0x7fce5815e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce5e419640 1 --2- 172.21.15.130:0/688778811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce58154380 0x7fce580b2a80 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce5e419640 1 -- 172.21.15.130:0/688778811 >> 172.21.15.130:0/688778811 conn(0x7fce58065990 msgr2=0x7fce58065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:14.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce5e419640 1 -- 172.21.15.130:0/688778811 shutdown_connections 2023-09-13T06:06:14.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.285+0000 7fce5e419640 1 -- 172.21.15.130:0/688778811 wait complete. 2023-09-13T06:06:14.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce5e419640 1 Processor -- start 2023-09-13T06:06:14.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce5e419640 1 -- start start 2023-09-13T06:06:14.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce5e419640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce58154380 0x7fce58142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce5e419640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce58154760 0x7fce5814b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce5e419640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce58161140 0x7fce5814b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce5e419640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5815c330 con 0x7fce58154380 2023-09-13T06:06:14.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce5e419640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5815c610 con 0x7fce58154760 2023-09-13T06:06:14.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce5e419640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5815c8f0 con 0x7fce58161140 2023-09-13T06:06:14.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce57fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce58154380 0x7fce58142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce57fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce58154380 0x7fce58142450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34168/0 (socket says 172.21.15.130:34168) 2023-09-13T06:06:14.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce57fff640 1 -- 172.21.15.130:0/3449543788 learned_addr learned my addr 172.21.15.130:0/3449543788 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:14.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce577fe640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce58154760 0x7fce5814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce5c9b6640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce58161140 0x7fce5814b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce57fff640 1 -- 172.21.15.130:0/3449543788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce58161140 msgr2=0x7fce5814b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce57fff640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce58161140 0x7fce5814b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce57fff640 1 -- 172.21.15.130:0/3449543788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce58154760 msgr2=0x7fce5814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce57fff640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce58154760 0x7fce5814b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce57fff640 1 -- 172.21.15.130:0/3449543788 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce480094d0 con 0x7fce58154380 2023-09-13T06:06:14.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce577fe640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce58154760 0x7fce5814b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:14.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce57fff640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce58154380 0x7fce58142450 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fce480af040 tx=0x7fce48019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:14.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce54ff9640 1 -- 172.21.15.130:0/3449543788 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce480ab860 con 0x7fce58154380 2023-09-13T06:06:14.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce54ff9640 1 -- 172.21.15.130:0/3449543788 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce480ab9e0 con 0x7fce58154380 2023-09-13T06:06:14.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce54ff9640 1 -- 172.21.15.130:0/3449543788 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce480abd90 con 0x7fce58154380 2023-09-13T06:06:14.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce5e419640 1 -- 172.21.15.130:0/3449543788 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5815cbd0 con 0x7fce58154380 2023-09-13T06:06:14.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.289+0000 7fce5e419640 1 -- 172.21.15.130:0/3449543788 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce58142990 con 0x7fce58154380 2023-09-13T06:06:14.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.293+0000 7fce5e419640 1 -- 172.21.15.130:0/3449543788 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce580618a0 con 0x7fce58154380 2023-09-13T06:06:14.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.293+0000 7fce54ff9640 1 -- 172.21.15.130:0/3449543788 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fce480b3070 con 0x7fce58154380 2023-09-13T06:06:14.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.293+0000 7fce54ff9640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce44065b50 0x7fce44068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.293+0000 7fce54ff9640 1 -- 172.21.15.130:0/3449543788 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce4811d8f0 con 0x7fce58154380 2023-09-13T06:06:14.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.293+0000 7fce577fe640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce44065b50 0x7fce44068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.293+0000 7fce577fe640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce44065b50 0x7fce44068010 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fce5815d490 tx=0x7fce4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:14.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.297+0000 7fce54ff9640 1 -- 172.21.15.130:0/3449543788 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fce480eb610 con 0x7fce58154380 2023-09-13T06:06:14.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.445+0000 7fce5e419640 1 -- 172.21.15.130:0/3449543788 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce5815c470 con 0x7fce58154380 2023-09-13T06:06:14.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.445+0000 7fce54ff9640 1 -- 172.21.15.130:0/3449543788 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce5815c470 con 0x7fce58154380 2023-09-13T06:06:14.448 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:06:14.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 -- 172.21.15.130:0/3449543788 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce44065b50 msgr2=0x7fce44068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce44065b50 0x7fce44068010 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fce5815d490 tx=0x7fce4c009040 comp rx=0 tx=0).stop 2023-09-13T06:06:14.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 -- 172.21.15.130:0/3449543788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce58154380 msgr2=0x7fce58142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce58154380 0x7fce58142450 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fce480af040 tx=0x7fce48019260 comp rx=0 tx=0).stop 2023-09-13T06:06:14.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 -- 172.21.15.130:0/3449543788 shutdown_connections 2023-09-13T06:06:14.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce44065b50 0x7fce44068010 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce58154760 0x7fce5814b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce58161140 0x7fce5814b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 --2- 172.21.15.130:0/3449543788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce58154380 0x7fce58142450 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 -- 172.21.15.130:0/3449543788 >> 172.21.15.130:0/3449543788 conn(0x7fce58065990 msgr2=0x7fce58160670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:14.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 -- 172.21.15.130:0/3449543788 shutdown_connections 2023-09-13T06:06:14.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.449+0000 7fce5e419640 1 -- 172.21.15.130:0/3449543788 wait complete. 2023-09-13T06:06:14.469 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T06:06:14.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.605+0000 7f3953ed8640 1 Processor -- start 2023-09-13T06:06:14.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.605+0000 7f3953ed8640 1 -- start start 2023-09-13T06:06:14.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.605+0000 7f3953ed8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f394c157920 0x7f394c0ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.605+0000 7f3953ed8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f394c0b1d20 0x7f394c06b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.605+0000 7f3953ed8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c0afee0 con 0x7f394c0b0f40 2023-09-13T06:06:14.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.605+0000 7f3953ed8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c0aea50 con 0x7f394c0b1d20 2023-09-13T06:06:14.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.605+0000 7f3953ed8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0b0b20 con 0x7f394c157920 2023-09-13T06:06:14.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.605+0000 7f3951473640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f394c0b0f40 0x7f394c0b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:42888/0 (socket says 172.21.15.130:42888) 2023-09-13T06:06:14.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.605+0000 7f3951473640 1 -- 172.21.15.130:0/3005143566 learned_addr learned my addr 172.21.15.130:0/3005143566 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:14.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.605+0000 7f3952475640 1 --2- 172.21.15.130:0/3005143566 >> v2:172.21.15.164:3300/0 conn(0x7f394c0b1d20 0x7f394c06b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.605+0000 7f3951c74640 1 --2- 172.21.15.130:0/3005143566 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f394c157920 0x7f394c0ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.609+0000 7f3950c72640 1 -- 172.21.15.130:0/3005143566 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779137451 0 0) 0x7f394c0afee0 con 0x7f394c0b0f40 2023-09-13T06:06:14.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.609+0000 7f3950c72640 1 -- 172.21.15.130:0/3005143566 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3938003530 con 0x7f394c0b0f40 2023-09-13T06:06:14.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.609+0000 7f3952475640 1 -- 172.21.15.130:0/3005143566 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f394c157920 msgr2=0x7f394c0ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:14.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.609+0000 7f3952475640 1 --2- 172.21.15.130:0/3005143566 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f394c157920 0x7f394c0ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.609+0000 7f3952475640 1 -- 172.21.15.130:0/3005143566 >> v1:172.21.15.164:6789/0 conn(0x7f394c0b0f40 legacy=0x7f394c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.609+0000 7f3952475640 1 -- 172.21.15.130:0/3005143566 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c0b0180 con 0x7f394c0b1d20 2023-09-13T06:06:14.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.609+0000 7f3951c74640 1 --2- 172.21.15.130:0/3005143566 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f394c157920 0x7f394c0ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:14.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.609+0000 7f3952475640 1 --2- 172.21.15.130:0/3005143566 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f394c0b1d20 0x7f394c06b9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3944009d90 tx=0x7f394401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a6145f4e6eaf488 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:14.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.609+0000 7f3950c72640 1 -- 172.21.15.130:0/3005143566 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440a59e0 con 0x7f394c0b1d20 2023-09-13T06:06:14.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.609+0000 7f3950c72640 1 -- 172.21.15.130:0/3005143566 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39440a5b40 con 0x7f394c0b1d20 2023-09-13T06:06:14.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.609+0000 7f3950c72640 1 -- 172.21.15.130:0/3005143566 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440ad440 con 0x7f394c0b1d20 2023-09-13T06:06:14.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 -- 172.21.15.130:0/3005143566 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f394c0b1d20 msgr2=0x7f394c06b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 --2- 172.21.15.130:0/3005143566 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f394c0b1d20 0x7f394c06b9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3944009d90 tx=0x7f394401c920 comp rx=0 tx=0).stop 2023-09-13T06:06:14.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 -- 172.21.15.130:0/3005143566 shutdown_connections 2023-09-13T06:06:14.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 --2- 172.21.15.130:0/3005143566 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f394c0b1d20 0x7f394c06b9c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 --2- 172.21.15.130:0/3005143566 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f394c157920 0x7f394c0ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 -- 172.21.15.130:0/3005143566 >> 172.21.15.130:0/3005143566 conn(0x7f394c065990 msgr2=0x7f394c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:14.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 -- 172.21.15.130:0/3005143566 shutdown_connections 2023-09-13T06:06:14.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 -- 172.21.15.130:0/3005143566 wait complete. 2023-09-13T06:06:14.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 Processor -- start 2023-09-13T06:06:14.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 -- start start 2023-09-13T06:06:14.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f394c0b0f40 0x7f394c149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f394c0b1d20 0x7f394c1462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f394c157920 0x7f394c14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c14fbc0 con 0x7f394c0b0f40 2023-09-13T06:06:14.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c14e1c0 con 0x7f394c157920 2023-09-13T06:06:14.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3953ed8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c14e4a0 con 0x7f394c0b1d20 2023-09-13T06:06:14.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3951c74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f394c0b0f40 0x7f394c149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3951c74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f394c0b0f40 0x7f394c149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34172/0 (socket says 172.21.15.130:34172) 2023-09-13T06:06:14.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3951c74640 1 -- 172.21.15.130:0/766871672 learned_addr learned my addr 172.21.15.130:0/766871672 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:14.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3952475640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f394c157920 0x7f394c14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3951473640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f394c0b1d20 0x7f394c1462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3951c74640 1 -- 172.21.15.130:0/766871672 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f394c0b1d20 msgr2=0x7f394c1462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3951c74640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f394c0b1d20 0x7f394c1462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3951c74640 1 -- 172.21.15.130:0/766871672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f394c157920 msgr2=0x7f394c14f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3951c74640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f394c157920 0x7f394c14f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.613+0000 7f3951c74640 1 -- 172.21.15.130:0/766871672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3948009420 con 0x7f394c0b0f40 2023-09-13T06:06:14.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.617+0000 7f3951c74640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f394c0b0f40 0x7f394c149820 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f394800e980 tx=0x7f394800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:14.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.617+0000 7f39427fc640 1 -- 172.21.15.130:0/766871672 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394800ca00 con 0x7f394c0b0f40 2023-09-13T06:06:14.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.617+0000 7f39427fc640 1 -- 172.21.15.130:0/766871672 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394800cb60 con 0x7f394c0b0f40 2023-09-13T06:06:14.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.617+0000 7f3953ed8640 1 -- 172.21.15.130:0/766871672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3944009a70 con 0x7f394c0b0f40 2023-09-13T06:06:14.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.617+0000 7f39427fc640 1 -- 172.21.15.130:0/766871672 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948013470 con 0x7f394c0b0f40 2023-09-13T06:06:14.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.617+0000 7f3953ed8640 1 -- 172.21.15.130:0/766871672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c14ea60 con 0x7f394c0b0f40 2023-09-13T06:06:14.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.617+0000 7f3953ed8640 1 -- 172.21.15.130:0/766871672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c0618a0 con 0x7f394c0b0f40 2023-09-13T06:06:14.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.617+0000 7f39427fc640 1 -- 172.21.15.130:0/766871672 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f39480135d0 con 0x7f394c0b0f40 2023-09-13T06:06:14.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.617+0000 7f39427fc640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3930065b20 0x7f3930067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.617+0000 7f39427fc640 1 -- 172.21.15.130:0/766871672 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f39480831e0 con 0x7f394c0b0f40 2023-09-13T06:06:14.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.617+0000 7f3951473640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3930065b20 0x7f3930067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.621+0000 7f3951473640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3930065b20 0x7f3930067fe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f393c007fd0 tx=0x7f393c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:14.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.621+0000 7f39427fc640 1 -- 172.21.15.130:0/766871672 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3948050f20 con 0x7f394c0b0f40 2023-09-13T06:06:14.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.769+0000 7f3953ed8640 1 -- 172.21.15.130:0/766871672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f394c14dde0 con 0x7f394c0b0f40 2023-09-13T06:06:14.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.769+0000 7f39427fc640 1 -- 172.21.15.130:0/766871672 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v98) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3948054540 con 0x7f394c0b0f40 2023-09-13T06:06:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:14.773 INFO:teuthology.orchestra.run.smithi130.stdout:[ 2023-09-13T06:06:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: "poolnum": 1, 2023-09-13T06:06:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: "poolname": ".mgr" 2023-09-13T06:06:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:14.774 INFO:teuthology.orchestra.run.smithi130.stdout:] 2023-09-13T06:06:14.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 -- 172.21.15.130:0/766871672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3930065b20 msgr2=0x7f3930067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3930065b20 0x7f3930067fe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f393c007fd0 tx=0x7f393c009040 comp rx=0 tx=0).stop 2023-09-13T06:06:14.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 -- 172.21.15.130:0/766871672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f394c0b0f40 msgr2=0x7f394c149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f394c0b0f40 0x7f394c149820 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f394800e980 tx=0x7f394800ee40 comp rx=0 tx=0).stop 2023-09-13T06:06:14.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 -- 172.21.15.130:0/766871672 shutdown_connections 2023-09-13T06:06:14.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3930065b20 0x7f3930067fe0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f394c157920 0x7f394c14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f394c0b1d20 0x7f394c1462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 --2- 172.21.15.130:0/766871672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f394c0b0f40 0x7f394c149820 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 -- 172.21.15.130:0/766871672 >> 172.21.15.130:0/766871672 conn(0x7f394c065990 msgr2=0x7f394c15ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:14.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 -- 172.21.15.130:0/766871672 shutdown_connections 2023-09-13T06:06:14.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.773+0000 7f3953ed8640 1 -- 172.21.15.130:0/766871672 wait complete. 2023-09-13T06:06:14.793 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T06:06:14.794 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T06:06:14.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.933+0000 7feb74a07640 1 Processor -- start 2023-09-13T06:06:14.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.933+0000 7feb74a07640 1 -- start start 2023-09-13T06:06:14.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb74a07640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb7015d3f0 0x7feb700c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb74a07640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7feb700cd0d0 0x7feb700cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb74a07640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb700cbf10 con 0x7feb70071fa0 2023-09-13T06:06:14.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb74a07640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb700cc820 con 0x7feb7015d3f0 2023-09-13T06:06:14.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb74a07640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb70161cf0 con 0x7feb700cd0d0 2023-09-13T06:06:14.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb6e59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb7015d3f0 0x7feb700c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb6e59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb7015d3f0 0x7feb700c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34180/0 (socket says 172.21.15.130:34180) 2023-09-13T06:06:14.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb6e59c640 1 -- 172.21.15.130:0/1520207307 learned_addr learned my addr 172.21.15.130:0/1520207307 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:14.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb65d9b640 1 --2- 172.21.15.130:0/1520207307 >> v2:172.21.15.164:3300/0 conn(0x7feb700cd0d0 0x7feb700cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb6e59c640 1 -- 172.21.15.130:0/1520207307 >> v2:172.21.15.164:3300/0 conn(0x7feb700cd0d0 msgr2=0x7feb700cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:14.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb6e59c640 1 --2- 172.21.15.130:0/1520207307 >> v2:172.21.15.164:3300/0 conn(0x7feb700cd0d0 0x7feb700cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb6e59c640 1 -- 172.21.15.130:0/1520207307 >> v1:172.21.15.130:6789/0 conn(0x7feb70071fa0 legacy=0x7feb700acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb6e59c640 1 -- 172.21.15.130:0/1520207307 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb700cc160 con 0x7feb7015d3f0 2023-09-13T06:06:14.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb6dd9b640 1 -- 172.21.15.130:0/1520207307 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347332483 0 0) 0x7feb700cbf10 con 0x7feb70071fa0 2023-09-13T06:06:14.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.937+0000 7feb65d9b640 1 --2- 172.21.15.130:0/1520207307 >> v2:172.21.15.164:3300/0 conn(0x7feb700cd0d0 0x7feb700cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:14.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb6e59c640 1 --2- 172.21.15.130:0/1520207307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb7015d3f0 0x7feb700c9ce0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feb700b13c0 tx=0x7feb6001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb45049253846ad server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:14.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb6dd9b640 1 -- 172.21.15.130:0/1520207307 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600ab640 con 0x7feb7015d3f0 2023-09-13T06:06:14.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb6dd9b640 1 -- 172.21.15.130:0/1520207307 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb600a7070 con 0x7feb7015d3f0 2023-09-13T06:06:14.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb6dd9b640 1 -- 172.21.15.130:0/1520207307 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600ab9c0 con 0x7feb7015d3f0 2023-09-13T06:06:14.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb74a07640 1 -- 172.21.15.130:0/1520207307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb7015d3f0 msgr2=0x7feb700c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb74a07640 1 --2- 172.21.15.130:0/1520207307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb7015d3f0 0x7feb700c9ce0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feb700b13c0 tx=0x7feb6001c440 comp rx=0 tx=0).stop 2023-09-13T06:06:14.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb74a07640 1 -- 172.21.15.130:0/1520207307 shutdown_connections 2023-09-13T06:06:14.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb74a07640 1 --2- 172.21.15.130:0/1520207307 >> v2:172.21.15.164:3300/0 conn(0x7feb700cd0d0 0x7feb700cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb74a07640 1 --2- 172.21.15.130:0/1520207307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb7015d3f0 0x7feb700c9ce0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb74a07640 1 -- 172.21.15.130:0/1520207307 >> 172.21.15.130:0/1520207307 conn(0x7feb70065b60 msgr2=0x7feb70065f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:14.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb74a07640 1 -- 172.21.15.130:0/1520207307 shutdown_connections 2023-09-13T06:06:14.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb74a07640 1 -- 172.21.15.130:0/1520207307 wait complete. 2023-09-13T06:06:14.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb74a07640 1 Processor -- start 2023-09-13T06:06:14.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.941+0000 7feb74a07640 1 -- start start 2023-09-13T06:06:14.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb74a07640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70071fa0 0x7feb701528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb74a07640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb700cd0d0 0x7feb70155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb74a07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb7015d3f0 0x7feb70155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb74a07640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c53b0 con 0x7feb70071fa0 2023-09-13T06:06:14.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb74a07640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c4730 con 0x7feb700cd0d0 2023-09-13T06:06:14.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb74a07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c4a10 con 0x7feb7015d3f0 2023-09-13T06:06:14.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb6e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70071fa0 0x7feb701528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb6e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70071fa0 0x7feb701528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34196/0 (socket says 172.21.15.130:34196) 2023-09-13T06:06:14.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb6e59c640 1 -- 172.21.15.130:0/3120133911 learned_addr learned my addr 172.21.15.130:0/3120133911 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:14.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb6ed9d640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb7015d3f0 0x7feb70155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb65d9b640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb700cd0d0 0x7feb70155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb6e59c640 1 -- 172.21.15.130:0/3120133911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb7015d3f0 msgr2=0x7feb70155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb6e59c640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb7015d3f0 0x7feb70155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb6e59c640 1 -- 172.21.15.130:0/3120133911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb700cd0d0 msgr2=0x7feb70155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:14.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb6e59c640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb700cd0d0 0x7feb70155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:14.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb6e59c640 1 -- 172.21.15.130:0/3120133911 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb600094d0 con 0x7feb70071fa0 2023-09-13T06:06:14.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb6e59c640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70071fa0 0x7feb701528b0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7feb60019050 tx=0x7feb6001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:14.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb677fe640 1 -- 172.21.15.130:0/3120133911 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600be3f0 con 0x7feb70071fa0 2023-09-13T06:06:14.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb677fe640 1 -- 172.21.15.130:0/3120133911 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb600be570 con 0x7feb70071fa0 2023-09-13T06:06:14.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb677fe640 1 -- 172.21.15.130:0/3120133911 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600be920 con 0x7feb70071fa0 2023-09-13T06:06:14.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb74a07640 1 -- 172.21.15.130:0/3120133911 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb700c4cf0 con 0x7feb70071fa0 2023-09-13T06:06:14.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb74a07640 1 -- 172.21.15.130:0/3120133911 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb700c3b40 con 0x7feb70071fa0 2023-09-13T06:06:14.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb74a07640 1 -- 172.21.15.130:0/3120133911 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb700618a0 con 0x7feb70071fa0 2023-09-13T06:06:14.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.945+0000 7feb677fe640 1 -- 172.21.15.130:0/3120133911 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7feb600b43f0 con 0x7feb70071fa0 2023-09-13T06:06:14.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.949+0000 7feb677fe640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb50065b20 0x7feb50067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:14.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.949+0000 7feb677fe640 1 -- 172.21.15.130:0/3120133911 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb6011d0a0 con 0x7feb70071fa0 2023-09-13T06:06:14.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.949+0000 7feb65d9b640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb50065b20 0x7feb50067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:14.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.949+0000 7feb65d9b640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb50065b20 0x7feb50067fe0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7feb70154f80 tx=0x7feb58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:14.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:14.953+0000 7feb677fe640 1 -- 172.21.15.130:0/3120133911 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7feb600eadf0 con 0x7feb70071fa0 2023-09-13T06:06:15.039 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:06:15.044 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:06:15.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:15.105+0000 7feb74a07640 1 -- 172.21.15.130:0/3120133911 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feb700b2300 con 0x7feb70071fa0 2023-09-13T06:06:16.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.033+0000 7feb677fe640 1 -- 172.21.15.130:0/3120133911 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v99) v1 ==== 138+0+0 (secure 0 0 0) 0x7feb600ee410 con 0x7feb70071fa0 2023-09-13T06:06:16.035 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' created 2023-09-13T06:06:16.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 -- 172.21.15.130:0/3120133911 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb50065b20 msgr2=0x7feb50067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:16.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb50065b20 0x7feb50067fe0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7feb70154f80 tx=0x7feb58008040 comp rx=0 tx=0).stop 2023-09-13T06:06:16.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 -- 172.21.15.130:0/3120133911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70071fa0 msgr2=0x7feb701528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:16.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70071fa0 0x7feb701528b0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7feb60019050 tx=0x7feb6001ac80 comp rx=0 tx=0).stop 2023-09-13T06:06:16.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 -- 172.21.15.130:0/3120133911 shutdown_connections 2023-09-13T06:06:16.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb50065b20 0x7feb50067fe0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:16.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb700cd0d0 0x7feb70155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:16.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb7015d3f0 0x7feb70155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:16.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 --2- 172.21.15.130:0/3120133911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb70071fa0 0x7feb701528b0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:16.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 -- 172.21.15.130:0/3120133911 >> 172.21.15.130:0/3120133911 conn(0x7feb70065b60 msgr2=0x7feb700acf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:16.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 -- 172.21.15.130:0/3120133911 shutdown_connections 2023-09-13T06:06:16.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.037+0000 7feb74a07640 1 -- 172.21.15.130:0/3120133911 wait complete. 2023-09-13T06:06:16.063 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T06:06:16.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a8d4d640 1 Processor -- start 2023-09-13T06:06:16.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a8d4d640 1 -- start start 2023-09-13T06:06:16.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a8d4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1a415a080 0x7fe1a40b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:16.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a8d4d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe1a40b31a0 0x7fe1a40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:16.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a8d4d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40cc850 con 0x7fe1a415e650 2023-09-13T06:06:16.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a8d4d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a40b0330 con 0x7fe1a40b31a0 2023-09-13T06:06:16.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a8d4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40cbcd0 con 0x7fe1a415a080 2023-09-13T06:06:16.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a2d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe1a40b31a0 0x7fe1a40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:16.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a2d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe1a40b31a0 0x7fe1a40ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34198/0 (socket says 172.21.15.130:34198) 2023-09-13T06:06:16.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a2d9d640 1 -- 172.21.15.130:0/1220226998 learned_addr learned my addr 172.21.15.130:0/1220226998 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:16.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a259c640 1 --2- 172.21.15.130:0/1220226998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1a415a080 0x7fe1a40b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:16.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a2d9d640 1 -- 172.21.15.130:0/1220226998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1a415a080 msgr2=0x7fe1a40b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:16.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a2d9d640 1 --2- 172.21.15.130:0/1220226998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1a415a080 0x7fe1a40b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:16.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a2d9d640 1 -- 172.21.15.130:0/1220226998 >> v1:172.21.15.164:6789/0 conn(0x7fe1a415e650 legacy=0x7fe1a40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:16.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.253+0000 7fe1a2d9d640 1 -- 172.21.15.130:0/1220226998 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40cbfb0 con 0x7fe1a40b31a0 2023-09-13T06:06:16.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a2d9d640 1 --2- 172.21.15.130:0/1220226998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1a40b31a0 0x7fe1a40ccfe0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009870 tx=0x7fe19c01e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eda22284a895cfa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:16.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a1d9b640 1 -- 172.21.15.130:0/1220226998 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0a8460 con 0x7fe1a40b31a0 2023-09-13T06:06:16.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a1d9b640 1 -- 172.21.15.130:0/1220226998 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c0a85c0 con 0x7fe1a40b31a0 2023-09-13T06:06:16.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a1d9b640 1 -- 172.21.15.130:0/1220226998 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0a8950 con 0x7fe1a40b31a0 2023-09-13T06:06:16.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/1220226998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1a40b31a0 msgr2=0x7fe1a40ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:16.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a8d4d640 1 --2- 172.21.15.130:0/1220226998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1a40b31a0 0x7fe1a40ccfe0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009870 tx=0x7fe19c01e690 comp rx=0 tx=0).stop 2023-09-13T06:06:16.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/1220226998 shutdown_connections 2023-09-13T06:06:16.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a8d4d640 1 --2- 172.21.15.130:0/1220226998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1a40b31a0 0x7fe1a40ccfe0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:16.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a8d4d640 1 --2- 172.21.15.130:0/1220226998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1a415a080 0x7fe1a40b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:16.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/1220226998 >> 172.21.15.130:0/1220226998 conn(0x7fe1a4065990 msgr2=0x7fe1a4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:16.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/1220226998 shutdown_connections 2023-09-13T06:06:16.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.257+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/1220226998 wait complete. 2023-09-13T06:06:16.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a8d4d640 1 Processor -- start 2023-09-13T06:06:16.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a8d4d640 1 -- start start 2023-09-13T06:06:16.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a8d4d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40b31a0 0x7fe1a415d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:16.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a8d4d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1a415a080 0x7fe1a4144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:16.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a8d4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1a415e650 0x7fe1a40ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:16.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a8d4d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4144f40 con 0x7fe1a415a080 2023-09-13T06:06:16.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a8d4d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a406c400 con 0x7fe1a40b31a0 2023-09-13T06:06:16.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a8d4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4153ea0 con 0x7fe1a415e650 2023-09-13T06:06:16.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe199d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1a415a080 0x7fe1a4144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:16.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe199d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1a415a080 0x7fe1a4144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34202/0 (socket says 172.21.15.130:34202) 2023-09-13T06:06:16.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe199d9b640 1 -- 172.21.15.130:0/899398256 learned_addr learned my addr 172.21.15.130:0/899398256 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:16.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a2d9d640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1a415e650 0x7fe1a40ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:16.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a259c640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40b31a0 0x7fe1a415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:16.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe199d9b640 1 -- 172.21.15.130:0/899398256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1a415e650 msgr2=0x7fe1a40ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:16.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe199d9b640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1a415e650 0x7fe1a40ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:16.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe199d9b640 1 -- 172.21.15.130:0/899398256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40b31a0 msgr2=0x7fe1a415d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:16.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe199d9b640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40b31a0 0x7fe1a415d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:16.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe199d9b640 1 -- 172.21.15.130:0/899398256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c0094d0 con 0x7fe1a415a080 2023-09-13T06:06:16.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe199d9b640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1a415a080 0x7fe1a4144a00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c730 tx=0x7fe18c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:16.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe19b7fe640 1 -- 172.21.15.130:0/899398256 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c003ba0 con 0x7fe1a415a080 2023-09-13T06:06:16.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe19b7fe640 1 -- 172.21.15.130:0/899398256 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c003d00 con 0x7fe1a415a080 2023-09-13T06:06:16.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe19b7fe640 1 -- 172.21.15.130:0/899398256 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c00aa90 con 0x7fe1a415a080 2023-09-13T06:06:16.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/899398256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a4154180 con 0x7fe1a415a080 2023-09-13T06:06:16.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.261+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/899398256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a41534f0 con 0x7fe1a415a080 2023-09-13T06:06:16.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.265+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/899398256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a406c5d0 con 0x7fe1a415a080 2023-09-13T06:06:16.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.265+0000 7fe19b7fe640 1 -- 172.21.15.130:0/899398256 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe18c00abf0 con 0x7fe1a415a080 2023-09-13T06:06:16.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.265+0000 7fe19b7fe640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe184065b20 0x7fe184067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:16.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.265+0000 7fe19b7fe640 1 -- 172.21.15.130:0/899398256 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe18c083520 con 0x7fe1a415a080 2023-09-13T06:06:16.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.265+0000 7fe1a259c640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe184065b20 0x7fe184067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:16.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.269+0000 7fe1a259c640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe184065b20 0x7fe184067fe0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe194009b60 tx=0x7fe194009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:16.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.269+0000 7fe19b7fe640 1 -- 172.21.15.130:0/899398256 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe18c051170 con 0x7fe1a415a080 2023-09-13T06:06:16.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:16.421+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/899398256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe1a40cc850 con 0x7fe1a415a080 2023-09-13T06:06:17.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.041+0000 7fe19b7fe640 1 -- 172.21.15.130:0/899398256 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v100) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe1a40cc850 con 0x7fe1a415a080 2023-09-13T06:06:17.044 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' created 2023-09-13T06:06:17.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/899398256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe184065b20 msgr2=0x7fe184067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:17.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe184065b20 0x7fe184067fe0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe194009b60 tx=0x7fe194009190 comp rx=0 tx=0).stop 2023-09-13T06:06:17.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/899398256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1a415a080 msgr2=0x7fe1a4144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:17.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1a415a080 0x7fe1a4144a00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c730 tx=0x7fe18c00cbf0 comp rx=0 tx=0).stop 2023-09-13T06:06:17.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/899398256 shutdown_connections 2023-09-13T06:06:17.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe184065b20 0x7fe184067fe0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:17.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1a415e650 0x7fe1a40ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:17.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1a415a080 0x7fe1a4144a00 secure :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c730 tx=0x7fe18c00cbf0 comp rx=0 tx=0).stop 2023-09-13T06:06:17.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 --2- 172.21.15.130:0/899398256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1a40b31a0 0x7fe1a415d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:17.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/899398256 >> 172.21.15.130:0/899398256 conn(0x7fe1a4065990 msgr2=0x7fe1a40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:17.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/899398256 shutdown_connections 2023-09-13T06:06:17.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.053+0000 7fe1a8d4d640 1 -- 172.21.15.130:0/899398256 wait complete. 2023-09-13T06:06:17.078 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T06:06:17.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.217+0000 7fbcbaf82640 1 Processor -- start 2023-09-13T06:06:17.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.217+0000 7fbcbaf82640 1 -- start start 2023-09-13T06:06:17.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.217+0000 7fbcbaf82640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbcb4157b30 0x7fbcb4160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:17.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcbaf82640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcb406dba0 0x7fbcb415e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:17.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcbaf82640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb406dfe0 con 0x7fbcb4157750 2023-09-13T06:06:17.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcbaf82640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb40ae0d0 con 0x7fbcb4157b30 2023-09-13T06:06:17.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcbaf82640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4161e60 con 0x7fbcb406dba0 2023-09-13T06:06:17.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcabfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbcb4157b30 0x7fbcb4160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:17.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcabfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbcb4157b30 0x7fbcb4160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34208/0 (socket says 172.21.15.130:34208) 2023-09-13T06:06:17.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcabfff640 1 -- 172.21.15.130:0/124225216 learned_addr learned my addr 172.21.15.130:0/124225216 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:17.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcb951f640 1 --2- 172.21.15.130:0/124225216 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcb406dba0 0x7fbcb415e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:17.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcabfff640 1 -- 172.21.15.130:0/124225216 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcb406dba0 msgr2=0x7fbcb415e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:17.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcabfff640 1 --2- 172.21.15.130:0/124225216 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcb406dba0 0x7fbcb415e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:17.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcabfff640 1 -- 172.21.15.130:0/124225216 >> v1:172.21.15.130:6789/0 conn(0x7fbcb4157750 legacy=0x7fbcb406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:17.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcabfff640 1 -- 172.21.15.130:0/124225216 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb41615c0 con 0x7fbcb4157b30 2023-09-13T06:06:17.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcabfff640 1 --2- 172.21.15.130:0/124225216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcb4157b30 0x7fbcb4160fe0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009870 tx=0x7fbca401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0428d128171076e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:17.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcab7fe640 1 -- 172.21.15.130:0/124225216 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40ab620 con 0x7fbcb4157b30 2023-09-13T06:06:17.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcab7fe640 1 -- 172.21.15.130:0/124225216 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca40ab780 con 0x7fbcb4157b30 2023-09-13T06:06:17.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.221+0000 7fbcab7fe640 1 -- 172.21.15.130:0/124225216 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40abb10 con 0x7fbcb4157b30 2023-09-13T06:06:17.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 -- 172.21.15.130:0/124225216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcb4157b30 msgr2=0x7fbcb4160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:17.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 --2- 172.21.15.130:0/124225216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcb4157b30 0x7fbcb4160fe0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009870 tx=0x7fbca401c510 comp rx=0 tx=0).stop 2023-09-13T06:06:17.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 -- 172.21.15.130:0/124225216 shutdown_connections 2023-09-13T06:06:17.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 --2- 172.21.15.130:0/124225216 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcb406dba0 0x7fbcb415e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:17.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 --2- 172.21.15.130:0/124225216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcb4157b30 0x7fbcb4160fe0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:17.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 -- 172.21.15.130:0/124225216 >> 172.21.15.130:0/124225216 conn(0x7fbcb4065d60 msgr2=0x7fbcb40b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:17.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 -- 172.21.15.130:0/124225216 shutdown_connections 2023-09-13T06:06:17.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 -- 172.21.15.130:0/124225216 wait complete. 2023-09-13T06:06:17.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 Processor -- start 2023-09-13T06:06:17.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 -- start start 2023-09-13T06:06:17.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcb406dba0 0x7fbcb41393b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:17.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcb4157750 0x7fbcb414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:17.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcb4157b30 0x7fbcb4157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:17.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb41550d0 con 0x7fbcb4157750 2023-09-13T06:06:17.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb414f130 con 0x7fbcb406dba0 2023-09-13T06:06:17.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcbaf82640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb414e890 con 0x7fbcb4157b30 2023-09-13T06:06:17.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcb4157750 0x7fbcb414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:17.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcb4157750 0x7fbcb414de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34222/0 (socket says 172.21.15.130:34222) 2023-09-13T06:06:17.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcabfff640 1 -- 172.21.15.130:0/3971163177 learned_addr learned my addr 172.21.15.130:0/3971163177 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:17.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcb951f640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcb4157b30 0x7fbcb4157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:17.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.225+0000 7fbcb8d1e640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcb406dba0 0x7fbcb41393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:17.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbcabfff640 1 -- 172.21.15.130:0/3971163177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcb4157b30 msgr2=0x7fbcb4157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:17.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbcabfff640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcb4157b30 0x7fbcb4157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:17.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbcabfff640 1 -- 172.21.15.130:0/3971163177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcb406dba0 msgr2=0x7fbcb41393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:17.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbcabfff640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcb406dba0 0x7fbcb41393b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:17.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbcabfff640 1 -- 172.21.15.130:0/3971163177 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca40094d0 con 0x7fbcb4157750 2023-09-13T06:06:17.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbcabfff640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcb4157750 0x7fbcb414de40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fbca401a140 tx=0x7fbca401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:17.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbca97fa640 1 -- 172.21.15.130:0/3971163177 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40be3f0 con 0x7fbcb4157750 2023-09-13T06:06:17.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbca97fa640 1 -- 172.21.15.130:0/3971163177 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca40be550 con 0x7fbcb4157750 2023-09-13T06:06:17.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbcbaf82640 1 -- 172.21.15.130:0/3971163177 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb406fa00 con 0x7fbcb4157750 2023-09-13T06:06:17.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbca97fa640 1 -- 172.21.15.130:0/3971163177 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40be900 con 0x7fbcb4157750 2023-09-13T06:06:17.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbcbaf82640 1 -- 172.21.15.130:0/3971163177 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb414ee50 con 0x7fbcb4157750 2023-09-13T06:06:17.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbcbaf82640 1 -- 172.21.15.130:0/3971163177 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb40618a0 con 0x7fbcb4157750 2023-09-13T06:06:17.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbca97fa640 1 -- 172.21.15.130:0/3971163177 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbca40b43f0 con 0x7fbcb4157750 2023-09-13T06:06:17.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbca97fa640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbca0065b20 0x7fbca0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:17.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbca97fa640 1 -- 172.21.15.130:0/3971163177 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbca411d560 con 0x7fbcb4157750 2023-09-13T06:06:17.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.229+0000 7fbcb8d1e640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbca0065b20 0x7fbca0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:17.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.233+0000 7fbcb8d1e640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbca0065b20 0x7fbca0067fe0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0000f70 tx=0x7fbcb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:17.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.237+0000 7fbca97fa640 1 -- 172.21.15.130:0/3971163177 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbca40eaf20 con 0x7fbcb4157750 2023-09-13T06:06:17.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:17.417+0000 7fbcbaf82640 1 -- 172.21.15.130:0/3971163177 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbcb4168150 con 0x7fbcb4157750 2023-09-13T06:06:18.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.357+0000 7fbca97fa640 1 -- 172.21.15.130:0/3971163177 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v47) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbca40ee540 con 0x7fbcb4157750 2023-09-13T06:06:18.361 INFO:teuthology.orchestra.run.smithi130.stderr:new fs with metadata pool 12 and data pool 13 2023-09-13T06:06:18.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.361+0000 7fbcbaf82640 1 -- 172.21.15.130:0/3971163177 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbca0065b20 msgr2=0x7fbca0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.361+0000 7fbcbaf82640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbca0065b20 0x7fbca0067fe0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0000f70 tx=0x7fbcb0009040 comp rx=0 tx=0).stop 2023-09-13T06:06:18.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.361+0000 7fbcbaf82640 1 -- 172.21.15.130:0/3971163177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcb4157750 msgr2=0x7fbcb414de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.361+0000 7fbcbaf82640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcb4157750 0x7fbcb414de40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fbca401a140 tx=0x7fbca401ad50 comp rx=0 tx=0).stop 2023-09-13T06:06:18.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.361+0000 7fbcbaf82640 1 -- 172.21.15.130:0/3971163177 shutdown_connections 2023-09-13T06:06:18.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.361+0000 7fbcbaf82640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbca0065b20 0x7fbca0067fe0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.361+0000 7fbcbaf82640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcb4157b30 0x7fbcb4157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.361+0000 7fbcbaf82640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcb4157750 0x7fbcb414de40 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.361+0000 7fbcbaf82640 1 --2- 172.21.15.130:0/3971163177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcb406dba0 0x7fbcb41393b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.361+0000 7fbcbaf82640 1 -- 172.21.15.130:0/3971163177 >> 172.21.15.130:0/3971163177 conn(0x7fbcb4065d60 msgr2=0x7fbcb4151ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:18.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.365+0000 7fbcbaf82640 1 -- 172.21.15.130:0/3971163177 shutdown_connections 2023-09-13T06:06:18.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.365+0000 7fbcbaf82640 1 -- 172.21.15.130:0/3971163177 wait complete. 2023-09-13T06:06:18.390 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:18.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1eec89e640 1 Processor -- start 2023-09-13T06:06:18.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1eec89e640 1 -- start start 2023-09-13T06:06:18.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1eec89e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee806bcb0 0x7f1ee806c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1eec89e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1ee80ac8d0 0x7f1ee80acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1eec89e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee8161030 con 0x7f1ee80b1a40 2023-09-13T06:06:18.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1eec89e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee8161cb0 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1eec89e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee8161310 con 0x7f1ee806bcb0 2023-09-13T06:06:18.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1ee6d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1ee80ac8d0 0x7f1ee80acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1ee659c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1ee80b1a40 0x7f1ee80b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55374/0 (socket says 172.21.15.130:55374) 2023-09-13T06:06:18.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1ee6d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1ee80ac8d0 0x7f1ee80acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34224/0 (socket says 172.21.15.130:34224) 2023-09-13T06:06:18.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1ee659c640 1 -- 172.21.15.130:0/2845114939 learned_addr learned my addr 172.21.15.130:0/2845114939 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:18.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.529+0000 7f1edffff640 1 --2- 172.21.15.130:0/2845114939 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee806bcb0 0x7f1ee806c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1ee6d9d640 1 -- 172.21.15.130:0/2845114939 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee806bcb0 msgr2=0x7f1ee806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:18.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1ee6d9d640 1 --2- 172.21.15.130:0/2845114939 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee806bcb0 0x7f1ee806c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1ee6d9d640 1 -- 172.21.15.130:0/2845114939 >> v1:172.21.15.130:6789/0 conn(0x7f1ee80b1a40 legacy=0x7f1ee80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1ee6d9d640 1 -- 172.21.15.130:0/2845114939 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee81615f0 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1ee5d9b640 1 -- 172.21.15.130:0/2845114939 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666077564 0 0) 0x7f1ee8161030 con 0x7f1ee80b1a40 2023-09-13T06:06:18.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1ee6d9d640 1 --2- 172.21.15.130:0/2845114939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ee80ac8d0 0x7f1ee80acd60 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009d90 tx=0x7f1ee001c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05c2e14a63c9184 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:18.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1ee5d9b640 1 -- 172.21.15.130:0/2845114939 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00a5860 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1ee5d9b640 1 -- 172.21.15.130:0/2845114939 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee00a59c0 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1ee5d9b640 1 -- 172.21.15.130:0/2845114939 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00a5d50 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1eec89e640 1 -- 172.21.15.130:0/2845114939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ee80ac8d0 msgr2=0x7f1ee80acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1eec89e640 1 --2- 172.21.15.130:0/2845114939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ee80ac8d0 0x7f1ee80acd60 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009d90 tx=0x7f1ee001c800 comp rx=0 tx=0).stop 2023-09-13T06:06:18.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1eec89e640 1 -- 172.21.15.130:0/2845114939 shutdown_connections 2023-09-13T06:06:18.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1eec89e640 1 --2- 172.21.15.130:0/2845114939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ee80ac8d0 0x7f1ee80acd60 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1eec89e640 1 --2- 172.21.15.130:0/2845114939 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee806bcb0 0x7f1ee806c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1eec89e640 1 -- 172.21.15.130:0/2845114939 >> 172.21.15.130:0/2845114939 conn(0x7f1ee806e5c0 msgr2=0x7f1ee8065960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:18.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1eec89e640 1 -- 172.21.15.130:0/2845114939 shutdown_connections 2023-09-13T06:06:18.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.533+0000 7f1eec89e640 1 -- 172.21.15.130:0/2845114939 wait complete. 2023-09-13T06:06:18.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1eec89e640 1 Processor -- start 2023-09-13T06:06:18.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1eec89e640 1 -- start start 2023-09-13T06:06:18.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1eec89e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ee806bcb0 0x7f1ee813e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1eec89e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ee80ac8d0 0x7f1ee8139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1eec89e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80b1a40 0x7f1ee806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1eec89e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee813a120 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1eec89e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee813f320 con 0x7f1ee806bcb0 2023-09-13T06:06:18.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1eec89e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee813e710 con 0x7f1ee80b1a40 2023-09-13T06:06:18.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ee80ac8d0 0x7f1ee8139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ee80ac8d0 0x7f1ee8139be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34228/0 (socket says 172.21.15.130:34228) 2023-09-13T06:06:18.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edffff640 1 -- 172.21.15.130:0/3377606613 learned_addr learned my addr 172.21.15.130:0/3377606613 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:18.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1ee6d9d640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80b1a40 0x7f1ee806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1ee659c640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ee806bcb0 0x7f1ee813e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edffff640 1 -- 172.21.15.130:0/3377606613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80b1a40 msgr2=0x7f1ee806f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edffff640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80b1a40 0x7f1ee806f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edffff640 1 -- 172.21.15.130:0/3377606613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ee806bcb0 msgr2=0x7f1ee813e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edffff640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ee806bcb0 0x7f1ee813e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edffff640 1 -- 172.21.15.130:0/3377606613 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee0009a70 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1ee6d9d640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80b1a40 0x7f1ee806f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:18.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1ee659c640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ee806bcb0 0x7f1ee813e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:18.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edffff640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ee80ac8d0 0x7f1ee8139be0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000e930 tx=0x7f1ed000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:18.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edeffd640 1 -- 172.21.15.130:0/3377606613 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0009690 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edeffd640 1 -- 172.21.15.130:0/3377606613 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed000ca00 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1edeffd640 1 -- 172.21.15.130:0/3377606613 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed000cd70 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.537+0000 7f1eec89e640 1 -- 172.21.15.130:0/3377606613 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee813e9f0 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.541+0000 7f1eec89e640 1 -- 172.21.15.130:0/3377606613 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee813efb0 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.541+0000 7f1eec89e640 1 -- 172.21.15.130:0/3377606613 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee813f4d0 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.541+0000 7f1edeffd640 1 -- 172.21.15.130:0/3377606613 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1ed0013470 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.541+0000 7f1edeffd640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ec8065b20 0x7f1ec8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.541+0000 7f1edeffd640 1 -- 172.21.15.130:0/3377606613 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ed0083630 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.541+0000 7f1ee659c640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ec8065b20 0x7f1ec8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.541+0000 7f1ee659c640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ec8065b20 0x7f1ec8067fe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8007fd0 tx=0x7f1ed8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:18.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.545+0000 7f1edeffd640 1 -- 172.21.15.130:0/3377606613 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1ee813f4d0 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.705+0000 7f1eec89e640 1 -- 172.21.15.130:0/3377606613 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ee813f490 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.705+0000 7f1edeffd640 1 -- 172.21.15.130:0/3377606613 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16620 (secure 0 0 0) 0x7f1ed0050f20 con 0x7f1ee80ac8d0 2023-09-13T06:06:18.708 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:18.708 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":101,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:17.421023+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:06:15.152093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-09-13T06:06:16.467343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:18.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 -- 172.21.15.130:0/3377606613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ec8065b20 msgr2=0x7f1ec8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ec8065b20 0x7f1ec8067fe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8007fd0 tx=0x7f1ed8009040 comp rx=0 tx=0).stop 2023-09-13T06:06:18.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 -- 172.21.15.130:0/3377606613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ee80ac8d0 msgr2=0x7f1ee8139be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ee80ac8d0 0x7f1ee8139be0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000e930 tx=0x7f1ed000edf0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 -- 172.21.15.130:0/3377606613 shutdown_connections 2023-09-13T06:06:18.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ec8065b20 0x7f1ec8067fe0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80b1a40 0x7f1ee806f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ee80ac8d0 0x7f1ee8139be0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 --2- 172.21.15.130:0/3377606613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ee806bcb0 0x7f1ee813e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 -- 172.21.15.130:0/3377606613 >> 172.21.15.130:0/3377606613 conn(0x7f1ee806e5c0 msgr2=0x7f1ee815b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:18.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 -- 172.21.15.130:0/3377606613 shutdown_connections 2023-09-13T06:06:18.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.709+0000 7f1eec89e640 1 -- 172.21.15.130:0/3377606613 wait complete. 2023-09-13T06:06:18.730 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:18.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.865+0000 7f27d7656640 1 Processor -- start 2023-09-13T06:06:18.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.865+0000 7f27d7656640 1 -- start start 2023-09-13T06:06:18.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d7656640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f27d00b1d20 0x7f27d00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d7656640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00cdfc0 0x7f27d00b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d7656640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d00ccfd0 con 0x7f27d0159f20 2023-09-13T06:06:18.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d7656640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00ce430 con 0x7f27d00b1d20 2023-09-13T06:06:18.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d7656640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00b00f0 con 0x7f27d00cdfc0 2023-09-13T06:06:18.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d5bf3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00cdfc0 0x7f27d00b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d5bf3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00cdfc0 0x7f27d00b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:48980/0 (socket says 172.21.15.130:48980) 2023-09-13T06:06:18.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d53f2640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f27d0159f20 0x7f27d00b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:42902/0 (socket says 172.21.15.130:42902) 2023-09-13T06:06:18.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d5bf3640 1 -- 172.21.15.130:0/2782417564 learned_addr learned my addr 172.21.15.130:0/2782417564 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:18.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d4bf1640 1 --2- 172.21.15.130:0/2782417564 >> v2:172.21.15.164:3300/0 conn(0x7f27d00b1d20 0x7f27d00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27c7fff640 1 -- 172.21.15.130:0/2782417564 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253992701 0 0) 0x7f27d00ccfd0 con 0x7f27d0159f20 2023-09-13T06:06:18.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27c7fff640 1 -- 172.21.15.130:0/2782417564 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27bc003530 con 0x7f27d0159f20 2023-09-13T06:06:18.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d5bf3640 1 -- 172.21.15.130:0/2782417564 >> v2:172.21.15.164:3300/0 conn(0x7f27d00b1d20 msgr2=0x7f27d00ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:18.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d5bf3640 1 --2- 172.21.15.130:0/2782417564 >> v2:172.21.15.164:3300/0 conn(0x7f27d00b1d20 0x7f27d00ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d5bf3640 1 -- 172.21.15.130:0/2782417564 >> v1:172.21.15.164:6789/0 conn(0x7f27d0159f20 legacy=0x7f27d00b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d5bf3640 1 -- 172.21.15.130:0/2782417564 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00ced90 con 0x7f27d00cdfc0 2023-09-13T06:06:18.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.869+0000 7f27d4bf1640 1 --2- 172.21.15.130:0/2782417564 >> v2:172.21.15.164:3300/0 conn(0x7f27d00b1d20 0x7f27d00ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:18.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27d5bf3640 1 --2- 172.21.15.130:0/2782417564 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00cdfc0 0x7f27d00b0c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f27c800d180 tx=0x7f27c801ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82f37eccf447e020 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:18.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27c7fff640 1 -- 172.21.15.130:0/2782417564 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800b2d0 con 0x7f27d00cdfc0 2023-09-13T06:06:18.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27c7fff640 1 -- 172.21.15.130:0/2782417564 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c800b430 con 0x7f27d00cdfc0 2023-09-13T06:06:18.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27c7fff640 1 -- 172.21.15.130:0/2782417564 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80a7bd0 con 0x7f27d00cdfc0 2023-09-13T06:06:18.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27d7656640 1 -- 172.21.15.130:0/2782417564 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00cdfc0 msgr2=0x7f27d00b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27d7656640 1 --2- 172.21.15.130:0/2782417564 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00cdfc0 0x7f27d00b0c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f27c800d180 tx=0x7f27c801ebf0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27d7656640 1 -- 172.21.15.130:0/2782417564 shutdown_connections 2023-09-13T06:06:18.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27d7656640 1 --2- 172.21.15.130:0/2782417564 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00cdfc0 0x7f27d00b0c90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27d7656640 1 --2- 172.21.15.130:0/2782417564 >> v2:172.21.15.164:3300/0 conn(0x7f27d00b1d20 0x7f27d00ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27d7656640 1 -- 172.21.15.130:0/2782417564 >> 172.21.15.130:0/2782417564 conn(0x7f27d0065990 msgr2=0x7f27d0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:18.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27d7656640 1 -- 172.21.15.130:0/2782417564 shutdown_connections 2023-09-13T06:06:18.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27d7656640 1 -- 172.21.15.130:0/2782417564 wait complete. 2023-09-13T06:06:18.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27d7656640 1 Processor -- start 2023-09-13T06:06:18.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.873+0000 7f27d7656640 1 -- start start 2023-09-13T06:06:18.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d7656640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00b1d20 0x7f27d013ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d7656640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d00cdfc0 0x7f27d0150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d7656640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27d0159f20 0x7f27d006bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d7656640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0157af0 con 0x7f27d0159f20 2023-09-13T06:06:18.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d7656640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0151040 con 0x7f27d00cdfc0 2023-09-13T06:06:18.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d7656640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0151270 con 0x7f27d00b1d20 2023-09-13T06:06:18.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d5bf3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27d0159f20 0x7f27d006bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d53f2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00b1d20 0x7f27d013ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d5bf3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27d0159f20 0x7f27d006bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34230/0 (socket says 172.21.15.130:34230) 2023-09-13T06:06:18.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d5bf3640 1 -- 172.21.15.130:0/3565947108 learned_addr learned my addr 172.21.15.130:0/3565947108 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:18.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d4bf1640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d00cdfc0 0x7f27d0150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d5bf3640 1 -- 172.21.15.130:0/3565947108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00b1d20 msgr2=0x7f27d013ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d5bf3640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00b1d20 0x7f27d013ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d5bf3640 1 -- 172.21.15.130:0/3565947108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d00cdfc0 msgr2=0x7f27d0150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:18.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d5bf3640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d00cdfc0 0x7f27d0150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d5bf3640 1 -- 172.21.15.130:0/3565947108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c0009420 con 0x7f27d0159f20 2023-09-13T06:06:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d5bf3640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27d0159f20 0x7f27d006bb30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f27c80b1040 tx=0x7f27c801b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27c5ffb640 1 -- 172.21.15.130:0/3565947108 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8009800 con 0x7f27d0159f20 2023-09-13T06:06:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27c5ffb640 1 -- 172.21.15.130:0/3565947108 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c8009960 con 0x7f27d0159f20 2023-09-13T06:06:18.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d7656640 1 -- 172.21.15.130:0/3565947108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c800bd40 con 0x7f27d0159f20 2023-09-13T06:06:18.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27c5ffb640 1 -- 172.21.15.130:0/3565947108 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8009d10 con 0x7f27d0159f20 2023-09-13T06:06:18.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d7656640 1 -- 172.21.15.130:0/3565947108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d0151830 con 0x7f27d0159f20 2023-09-13T06:06:18.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27d7656640 1 -- 172.21.15.130:0/3565947108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d00618a0 con 0x7f27d0159f20 2023-09-13T06:06:18.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.877+0000 7f27c5ffb640 1 -- 172.21.15.130:0/3565947108 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f27c80ba470 con 0x7f27d0159f20 2023-09-13T06:06:18.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.881+0000 7f27c5ffb640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27b4065b20 0x7f27b4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.881+0000 7f27c5ffb640 1 -- 172.21.15.130:0/3565947108 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27c81207c0 con 0x7f27d0159f20 2023-09-13T06:06:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.881+0000 7f27d53f2640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27b4065b20 0x7f27b4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.881+0000 7f27d53f2640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27b4065b20 0x7f27b4067fe0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0011f0 tx=0x7f27cc007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:18.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:18.885+0000 7f27c5ffb640 1 -- 172.21.15.130:0/3565947108 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f27c80ee240 con 0x7f27d0159f20 2023-09-13T06:06:19.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.033+0000 7f27d7656640 1 -- 172.21.15.130:0/3565947108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27d00700c0 con 0x7f27d0159f20 2023-09-13T06:06:19.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.033+0000 7f27c5ffb640 1 -- 172.21.15.130:0/3565947108 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16620 (secure 0 0 0) 0x7f27c800b720 con 0x7f27d0159f20 2023-09-13T06:06:19.036 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:19.036 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":101,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:17.421023+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:06:15.152093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-09-13T06:06:16.467343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:19.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 -- 172.21.15.130:0/3565947108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27b4065b20 msgr2=0x7f27b4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:19.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27b4065b20 0x7f27b4067fe0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0011f0 tx=0x7f27cc007d40 comp rx=0 tx=0).stop 2023-09-13T06:06:19.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 -- 172.21.15.130:0/3565947108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27d0159f20 msgr2=0x7f27d006bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:19.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27d0159f20 0x7f27d006bb30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f27c80b1040 tx=0x7f27c801b990 comp rx=0 tx=0).stop 2023-09-13T06:06:19.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 -- 172.21.15.130:0/3565947108 shutdown_connections 2023-09-13T06:06:19.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27b4065b20 0x7f27b4067fe0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:19.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27d00cdfc0 0x7f27d0150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:19.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27d0159f20 0x7f27d006bb30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:19.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 --2- 172.21.15.130:0/3565947108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27d00b1d20 0x7f27d013ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:19.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 -- 172.21.15.130:0/3565947108 >> 172.21.15.130:0/3565947108 conn(0x7f27d0065990 msgr2=0x7f27d006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:19.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 -- 172.21.15.130:0/3565947108 shutdown_connections 2023-09-13T06:06:19.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.037+0000 7f27d7656640 1 -- 172.21.15.130:0/3565947108 wait complete. 2023-09-13T06:06:19.060 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T06:06:19.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b8bdb640 1 Processor -- start 2023-09-13T06:06:19.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b8bdb640 1 -- start start 2023-09-13T06:06:19.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b8bdb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f01b4144d70 0x7f01b40ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:19.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b8bdb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f01b40b1b70 0x7f01b40b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:19.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b8bdb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b40b3120 con 0x7f01b40b2780 2023-09-13T06:06:19.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b8bdb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b40b2430 con 0x7f01b4144d70 2023-09-13T06:06:19.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b8bdb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b40cedb0 con 0x7f01b40b1b70 2023-09-13T06:06:19.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f01b4144d70 0x7f01b40ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:19.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f01b4144d70 0x7f01b40ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34246/0 (socket says 172.21.15.130:34246) 2023-09-13T06:06:19.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b259c640 1 -- 172.21.15.130:0/1973265714 learned_addr learned my addr 172.21.15.130:0/1973265714 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:19.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01a9d9b640 1 --1- 172.21.15.130:0/1973265714 >> v1:172.21.15.130:6789/0 conn(0x7f01b40b2780 0x7f01b40b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55382/0 (socket says 172.21.15.130:55382) 2023-09-13T06:06:19.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b2d9d640 1 --2- 172.21.15.130:0/1973265714 >> v2:172.21.15.164:3300/0 conn(0x7f01b40b1b70 0x7f01b40b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:19.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b259c640 1 -- 172.21.15.130:0/1973265714 >> v2:172.21.15.164:3300/0 conn(0x7f01b40b1b70 msgr2=0x7f01b40b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:19.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b259c640 1 --2- 172.21.15.130:0/1973265714 >> v2:172.21.15.164:3300/0 conn(0x7f01b40b1b70 0x7f01b40b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:19.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b259c640 1 -- 172.21.15.130:0/1973265714 >> v1:172.21.15.130:6789/0 conn(0x7f01b40b2780 legacy=0x7f01b40b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:19.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b259c640 1 -- 172.21.15.130:0/1973265714 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b40b2150 con 0x7f01b4144d70 2023-09-13T06:06:19.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.201+0000 7f01b1d9b640 1 -- 172.21.15.130:0/1973265714 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342821129 0 0) 0x7f01b40b3120 con 0x7f01b40b2780 2023-09-13T06:06:19.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b259c640 1 --2- 172.21.15.130:0/1973265714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01b4144d70 0x7f01b40ce870 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f01b40668f0 tx=0x7f01a401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e0a78ca6aef786 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:19.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b1d9b640 1 -- 172.21.15.130:0/1973265714 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40ab600 con 0x7f01b4144d70 2023-09-13T06:06:19.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b1d9b640 1 -- 172.21.15.130:0/1973265714 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a40a7050 con 0x7f01b4144d70 2023-09-13T06:06:19.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b1d9b640 1 -- 172.21.15.130:0/1973265714 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40ab980 con 0x7f01b4144d70 2023-09-13T06:06:19.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b8bdb640 1 -- 172.21.15.130:0/1973265714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01b4144d70 msgr2=0x7f01b40ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:19.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b8bdb640 1 --2- 172.21.15.130:0/1973265714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01b4144d70 0x7f01b40ce870 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f01b40668f0 tx=0x7f01a401c500 comp rx=0 tx=0).stop 2023-09-13T06:06:19.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b8bdb640 1 -- 172.21.15.130:0/1973265714 shutdown_connections 2023-09-13T06:06:19.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b8bdb640 1 --2- 172.21.15.130:0/1973265714 >> v2:172.21.15.164:3300/0 conn(0x7f01b40b1b70 0x7f01b40b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:19.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b8bdb640 1 --2- 172.21.15.130:0/1973265714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01b4144d70 0x7f01b40ce870 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:19.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b8bdb640 1 -- 172.21.15.130:0/1973265714 >> 172.21.15.130:0/1973265714 conn(0x7f01b4065990 msgr2=0x7f01b4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:19.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b8bdb640 1 -- 172.21.15.130:0/1973265714 shutdown_connections 2023-09-13T06:06:19.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.205+0000 7f01b8bdb640 1 -- 172.21.15.130:0/1973265714 wait complete. 2023-09-13T06:06:19.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b8bdb640 1 Processor -- start 2023-09-13T06:06:19.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b8bdb640 1 -- start start 2023-09-13T06:06:19.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b8bdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01b40b1b70 0x7f01b413b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:19.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b8bdb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01b40b2780 0x7f01b4155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:19.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b8bdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01b4144d70 0x7f01b41f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:19.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b8bdb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b41f6330 con 0x7f01b40b1b70 2023-09-13T06:06:19.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b8bdb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b41f5480 con 0x7f01b40b2780 2023-09-13T06:06:19.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b8bdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b41f56b0 con 0x7f01b4144d70 2023-09-13T06:06:19.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01b40b1b70 0x7f01b413b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:19.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01b40b1b70 0x7f01b413b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34260/0 (socket says 172.21.15.130:34260) 2023-09-13T06:06:19.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b259c640 1 -- 172.21.15.130:0/2297271405 learned_addr learned my addr 172.21.15.130:0/2297271405 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:19.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b2d9d640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01b4144d70 0x7f01b41f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:19.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01a9d9b640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01b40b2780 0x7f01b4155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:19.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b259c640 1 -- 172.21.15.130:0/2297271405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01b4144d70 msgr2=0x7f01b41f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:19.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b259c640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01b4144d70 0x7f01b41f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:19.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b259c640 1 -- 172.21.15.130:0/2297271405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01b40b2780 msgr2=0x7f01b4155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:19.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b259c640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01b40b2780 0x7f01b4155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:19.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b259c640 1 -- 172.21.15.130:0/2297271405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40094d0 con 0x7f01b40b1b70 2023-09-13T06:06:19.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.209+0000 7f01b259c640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01b40b1b70 0x7f01b413b0d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f01a40ae040 tx=0x7f01a401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:19.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.213+0000 7f01ab7fe640 1 -- 172.21.15.130:0/2297271405 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40b6620 con 0x7f01b40b1b70 2023-09-13T06:06:19.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.213+0000 7f01ab7fe640 1 -- 172.21.15.130:0/2297271405 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a40b67a0 con 0x7f01b40b1b70 2023-09-13T06:06:19.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.213+0000 7f01ab7fe640 1 -- 172.21.15.130:0/2297271405 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40b6b50 con 0x7f01b40b1b70 2023-09-13T06:06:19.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.213+0000 7f01b8bdb640 1 -- 172.21.15.130:0/2297271405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b41f5990 con 0x7f01b40b1b70 2023-09-13T06:06:19.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.213+0000 7f01b8bdb640 1 -- 172.21.15.130:0/2297271405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b41f5f50 con 0x7f01b40b1b70 2023-09-13T06:06:19.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.213+0000 7f01b8bdb640 1 -- 172.21.15.130:0/2297271405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b40618a0 con 0x7f01b40b1b70 2023-09-13T06:06:19.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.213+0000 7f01ab7fe640 1 -- 172.21.15.130:0/2297271405 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f01a40b2040 con 0x7f01b40b1b70 2023-09-13T06:06:19.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.213+0000 7f01ab7fe640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0194065b20 0x7f0194067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:19.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.213+0000 7f01ab7fe640 1 -- 172.21.15.130:0/2297271405 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01a411d6e0 con 0x7f01b40b1b70 2023-09-13T06:06:19.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.213+0000 7f01a9d9b640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0194065b20 0x7f0194067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:19.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.213+0000 7f01a9d9b640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0194065b20 0x7f0194067fe0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01b4144070 tx=0x7f019c007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:19.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.217+0000 7f01ab7fe640 1 -- 172.21.15.130:0/2297271405 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f01a40eb020 con 0x7f01b40b1b70 2023-09-13T06:06:19.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:19.401+0000 7f01b8bdb640 1 -- 172.21.15.130:0/2297271405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f01b415a450 con 0x7f01b40b1b70 2023-09-13T06:06:20.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.373+0000 7f01ab7fe640 1 -- 172.21.15.130:0/2297271405 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7f01a40ee640 con 0x7f01b40b1b70 2023-09-13T06:06:20.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 -- 172.21.15.130:0/2297271405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0194065b20 msgr2=0x7f0194067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:20.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0194065b20 0x7f0194067fe0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01b4144070 tx=0x7f019c007b60 comp rx=0 tx=0).stop 2023-09-13T06:06:20.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 -- 172.21.15.130:0/2297271405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01b40b1b70 msgr2=0x7f01b413b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:20.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01b40b1b70 0x7f01b413b0d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f01a40ae040 tx=0x7f01a401ad40 comp rx=0 tx=0).stop 2023-09-13T06:06:20.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 -- 172.21.15.130:0/2297271405 shutdown_connections 2023-09-13T06:06:20.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0194065b20 0x7f0194067fe0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:20.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01b40b2780 0x7f01b4155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:20.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01b4144d70 0x7f01b41f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:20.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 --2- 172.21.15.130:0/2297271405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01b40b1b70 0x7f01b413b0d0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:20.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 -- 172.21.15.130:0/2297271405 >> 172.21.15.130:0/2297271405 conn(0x7f01b4065990 msgr2=0x7f01b41568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:20.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 -- 172.21.15.130:0/2297271405 shutdown_connections 2023-09-13T06:06:20.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.377+0000 7f01b8bdb640 1 -- 172.21.15.130:0/2297271405 wait complete. 2023-09-13T06:06:20.402 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T06:06:20.402 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T06:06:20.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.545+0000 7f0d4532c640 1 Processor -- start 2023-09-13T06:06:20.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d4532c640 1 -- start start 2023-09-13T06:06:20.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d4532c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0d4015a080 0x7f0d400b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:20.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d4532c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0d4015e650 0x7f0d400b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:20.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d4532c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d400cc850 con 0x7f0d400b2fd0 2023-09-13T06:06:20.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d4532c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d400b33f0 con 0x7f0d4015e650 2023-09-13T06:06:20.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d4532c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d400b0330 con 0x7f0d4015a080 2023-09-13T06:06:20.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d37fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0d4015e650 0x7f0d400b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:20.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d3f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0d400b2fd0 0x7f0d400ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55386/0 (socket says 172.21.15.130:55386) 2023-09-13T06:06:20.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d3f7fe640 1 -- 172.21.15.130:0/153080255 learned_addr learned my addr 172.21.15.130:0/153080255 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:20.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d3effd640 1 --2- 172.21.15.130:0/153080255 >> v2:172.21.15.164:3300/0 conn(0x7f0d4015a080 0x7f0d400b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:20.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d37fff640 1 -- 172.21.15.130:0/153080255 >> v2:172.21.15.164:3300/0 conn(0x7f0d4015a080 msgr2=0x7f0d400b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:20.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d37fff640 1 --2- 172.21.15.130:0/153080255 >> v2:172.21.15.164:3300/0 conn(0x7f0d4015a080 0x7f0d400b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:20.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d37fff640 1 -- 172.21.15.130:0/153080255 >> v1:172.21.15.130:6789/0 conn(0x7f0d400b2fd0 legacy=0x7f0d400ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:20.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d37fff640 1 -- 172.21.15.130:0/153080255 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d400cbcd0 con 0x7f0d4015e650 2023-09-13T06:06:20.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d3effd640 1 --2- 172.21.15.130:0/153080255 >> v2:172.21.15.164:3300/0 conn(0x7f0d4015a080 0x7f0d400b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:20.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.549+0000 7f0d3e7fc640 1 -- 172.21.15.130:0/153080255 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838932997 0 0) 0x7f0d380014a0 con 0x7f0d400b2fd0 2023-09-13T06:06:20.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d37fff640 1 --2- 172.21.15.130:0/153080255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d4015e650 0x7f0d400b2a90 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0d400706b0 tx=0x7f0d2801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeca513a8e372c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:20.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d3e7fc640 1 -- 172.21.15.130:0/153080255 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d280ab600 con 0x7f0d4015e650 2023-09-13T06:06:20.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d3e7fc640 1 -- 172.21.15.130:0/153080255 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d280a7050 con 0x7f0d4015e650 2023-09-13T06:06:20.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d3e7fc640 1 -- 172.21.15.130:0/153080255 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d280ab980 con 0x7f0d4015e650 2023-09-13T06:06:20.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d4532c640 1 -- 172.21.15.130:0/153080255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d4015e650 msgr2=0x7f0d400b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:20.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d4532c640 1 --2- 172.21.15.130:0/153080255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d4015e650 0x7f0d400b2a90 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0d400706b0 tx=0x7f0d2801c370 comp rx=0 tx=0).stop 2023-09-13T06:06:20.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d4532c640 1 -- 172.21.15.130:0/153080255 shutdown_connections 2023-09-13T06:06:20.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d4532c640 1 --2- 172.21.15.130:0/153080255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d4015e650 0x7f0d400b2a90 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:20.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d4532c640 1 --2- 172.21.15.130:0/153080255 >> v2:172.21.15.164:3300/0 conn(0x7f0d4015a080 0x7f0d400b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:20.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d4532c640 1 -- 172.21.15.130:0/153080255 >> 172.21.15.130:0/153080255 conn(0x7f0d40065990 msgr2=0x7f0d40065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:20.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d4532c640 1 -- 172.21.15.130:0/153080255 shutdown_connections 2023-09-13T06:06:20.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d4532c640 1 -- 172.21.15.130:0/153080255 wait complete. 2023-09-13T06:06:20.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d4532c640 1 Processor -- start 2023-09-13T06:06:20.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.553+0000 7f0d4532c640 1 -- start start 2023-09-13T06:06:20.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d4532c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d400b2fd0 0x7f0d4013da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:20.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d4532c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d4015a080 0x7f0d400cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:20.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d4532c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d4015e650 0x7f0d400cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:20.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d4532c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d401f9ce0 con 0x7f0d4015e650 2023-09-13T06:06:20.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d4532c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40154460 con 0x7f0d4015a080 2023-09-13T06:06:20.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d4532c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40154740 con 0x7f0d400b2fd0 2023-09-13T06:06:20.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d3f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d4015e650 0x7f0d400cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:20.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d3f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d4015e650 0x7f0d400cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34276/0 (socket says 172.21.15.130:34276) 2023-09-13T06:06:20.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d3f7fe640 1 -- 172.21.15.130:0/55691057 learned_addr learned my addr 172.21.15.130:0/55691057 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:20.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d37fff640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d4015a080 0x7f0d400cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:20.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d3effd640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d400b2fd0 0x7f0d4013da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:20.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d3f7fe640 1 -- 172.21.15.130:0/55691057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d400b2fd0 msgr2=0x7f0d4013da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:20.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d3f7fe640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d400b2fd0 0x7f0d4013da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:20.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d3f7fe640 1 -- 172.21.15.130:0/55691057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d4015a080 msgr2=0x7f0d400cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:20.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d3f7fe640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d4015a080 0x7f0d400cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:20.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d3f7fe640 1 -- 172.21.15.130:0/55691057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d28009420 con 0x7f0d4015e650 2023-09-13T06:06:20.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d3effd640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d400b2fd0 0x7f0d4013da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:20.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d3f7fe640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d4015e650 0x7f0d400cf440 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800c7e0 tx=0x7f0d3800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:20.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d377fe640 1 -- 172.21.15.130:0/55691057 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3800a640 con 0x7f0d4015e650 2023-09-13T06:06:20.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d377fe640 1 -- 172.21.15.130:0/55691057 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3800a7c0 con 0x7f0d4015e650 2023-09-13T06:06:20.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d377fe640 1 -- 172.21.15.130:0/55691057 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3800abb0 con 0x7f0d4015e650 2023-09-13T06:06:20.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d4532c640 1 -- 172.21.15.130:0/55691057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d40154a20 con 0x7f0d4015e650 2023-09-13T06:06:20.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d4532c640 1 -- 172.21.15.130:0/55691057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4013df40 con 0x7f0d4015e650 2023-09-13T06:06:20.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d4532c640 1 -- 172.21.15.130:0/55691057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d400618a0 con 0x7f0d4015e650 2023-09-13T06:06:20.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.557+0000 7f0d377fe640 1 -- 172.21.15.130:0/55691057 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0d3800ad10 con 0x7f0d4015e650 2023-09-13T06:06:20.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.561+0000 7f0d377fe640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 0x7f0d20067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:20.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.561+0000 7f0d377fe640 1 -- 172.21.15.130:0/55691057 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d38082690 con 0x7f0d4015e650 2023-09-13T06:06:20.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.561+0000 7f0d3effd640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 0x7f0d20067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:20.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.561+0000 7f0d3effd640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 0x7f0d20067fe0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0d30006fd0 tx=0x7f0d30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:20.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.565+0000 7f0d377fe640 1 -- 172.21.15.130:0/55691057 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0d38050080 con 0x7f0d4015e650 2023-09-13T06:06:20.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:20.745+0000 7f0d4532c640 1 -- 172.21.15.130:0/55691057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0d400cc850 con 0x7f0d4015e650 2023-09-13T06:06:21.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d377fe640 1 -- 172.21.15.130:0/55691057 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0d400cc850 con 0x7f0d4015e650 2023-09-13T06:06:21.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 -- 172.21.15.130:0/55691057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 msgr2=0x7f0d20067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 0x7f0d20067fe0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0d30006fd0 tx=0x7f0d30008040 comp rx=0 tx=0).stop 2023-09-13T06:06:21.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 -- 172.21.15.130:0/55691057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d4015e650 msgr2=0x7f0d400cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d4015e650 0x7f0d400cf440 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800c7e0 tx=0x7f0d3800cca0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 -- 172.21.15.130:0/55691057 shutdown_connections 2023-09-13T06:06:21.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0d20065b20 0x7f0d20067fe0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d4015a080 0x7f0d400cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d4015e650 0x7f0d400cf440 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 --2- 172.21.15.130:0/55691057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d400b2fd0 0x7f0d4013da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 -- 172.21.15.130:0/55691057 >> 172.21.15.130:0/55691057 conn(0x7f0d40065990 msgr2=0x7f0d40156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:21.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 -- 172.21.15.130:0/55691057 shutdown_connections 2023-09-13T06:06:21.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.381+0000 7f0d4532c640 1 -- 172.21.15.130:0/55691057 wait complete. 2023-09-13T06:06:21.405 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T06:06:21.406 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:21.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfb5ed8640 1 Processor -- start 2023-09-13T06:06:21.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfb5ed8640 1 -- start start 2023-09-13T06:06:21.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfb5ed8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdfb00d1750 0x7fdfb015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfb5ed8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 0x7fdfb00b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfb5ed8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb00b63c0 con 0x7fdfb00d1090 2023-09-13T06:06:21.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfb5ed8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb015dea0 con 0x7fdfb00d1750 2023-09-13T06:06:21.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfb5ed8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb00d0c20 con 0x7fdfb0146f30 2023-09-13T06:06:21.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 0x7fdfb00b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 0x7fdfb00b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:44560/0 (socket says 172.21.15.130:44560) 2023-09-13T06:06:21.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfaffff640 1 -- 172.21.15.130:0/3610096955 learned_addr learned my addr 172.21.15.130:0/3610096955 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:21.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfaeffd640 1 --1- 172.21.15.130:0/3610096955 >> v1:172.21.15.164:6789/0 conn(0x7fdfb00d1090 0x7fdfb0146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:45414/0 (socket says 172.21.15.130:45414) 2023-09-13T06:06:21.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfaf7fe640 1 --2- 172.21.15.130:0/3610096955 >> v2:172.21.15.164:3300/0 conn(0x7fdfb00d1750 0x7fdfb015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfae7fc640 1 -- 172.21.15.130:0/3610096955 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543887127 0 0) 0x7fdfb00b63c0 con 0x7fdfb00d1090 2023-09-13T06:06:21.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfaffff640 1 -- 172.21.15.130:0/3610096955 >> v2:172.21.15.164:3300/0 conn(0x7fdfb00d1750 msgr2=0x7fdfb015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:21.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfaffff640 1 --2- 172.21.15.130:0/3610096955 >> v2:172.21.15.164:3300/0 conn(0x7fdfb00d1750 0x7fdfb015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfaffff640 1 -- 172.21.15.130:0/3610096955 >> v1:172.21.15.164:6789/0 conn(0x7fdfb00d1090 legacy=0x7fdfb0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.545+0000 7fdfaffff640 1 -- 172.21.15.130:0/3610096955 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00b6610 con 0x7fdfb0146f30 2023-09-13T06:06:21.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfaffff640 1 --2- 172.21.15.130:0/3610096955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 0x7fdfb00b70f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009e50 tx=0x7fdfa801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b744c96c2cf7880b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:21.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfae7fc640 1 -- 172.21.15.130:0/3610096955 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80a58a0 con 0x7fdfb0146f30 2023-09-13T06:06:21.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfae7fc640 1 -- 172.21.15.130:0/3610096955 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa80a5a00 con 0x7fdfb0146f30 2023-09-13T06:06:21.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfae7fc640 1 -- 172.21.15.130:0/3610096955 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80a5d90 con 0x7fdfb0146f30 2023-09-13T06:06:21.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3610096955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 msgr2=0x7fdfb00b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfb5ed8640 1 --2- 172.21.15.130:0/3610096955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 0x7fdfb00b70f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009e50 tx=0x7fdfa801c9e0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3610096955 shutdown_connections 2023-09-13T06:06:21.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfb5ed8640 1 --2- 172.21.15.130:0/3610096955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 0x7fdfb00b70f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfb5ed8640 1 --2- 172.21.15.130:0/3610096955 >> v2:172.21.15.164:3300/0 conn(0x7fdfb00d1750 0x7fdfb015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3610096955 >> 172.21.15.130:0/3610096955 conn(0x7fdfb006f170 msgr2=0x7fdfb006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:21.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3610096955 shutdown_connections 2023-09-13T06:06:21.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.549+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3610096955 wait complete. 2023-09-13T06:06:21.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfb5ed8640 1 Processor -- start 2023-09-13T06:06:21.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfb5ed8640 1 -- start start 2023-09-13T06:06:21.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfb5ed8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfb00d1090 0x7fdfb015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfb5ed8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfb00d1750 0x7fdfb015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfb5ed8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 0x7fdfb013d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfb5ed8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0137650 con 0x7fdfb00d1750 2023-09-13T06:06:21.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfb5ed8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb015c030 con 0x7fdfb00d1090 2023-09-13T06:06:21.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfb5ed8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb015c310 con 0x7fdfb0146f30 2023-09-13T06:06:21.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfaeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfb00d1750 0x7fdfb015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfaeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfb00d1750 0x7fdfb015b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35926/0 (socket says 172.21.15.130:35926) 2023-09-13T06:06:21.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfaeffd640 1 -- 172.21.15.130:0/3229823011 learned_addr learned my addr 172.21.15.130:0/3229823011 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:21.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfaf7fe640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfb00d1090 0x7fdfb015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfaffff640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 0x7fdfb013d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfaeffd640 1 -- 172.21.15.130:0/3229823011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 msgr2=0x7fdfb013d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfaeffd640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 0x7fdfb013d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfaeffd640 1 -- 172.21.15.130:0/3229823011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfb00d1090 msgr2=0x7fdfb015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfaeffd640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfb00d1090 0x7fdfb015aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfaeffd640 1 -- 172.21.15.130:0/3229823011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8009b30 con 0x7fdfb00d1750 2023-09-13T06:06:21.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfaeffd640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfb00d1750 0x7fdfb015b6c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400c4b0 tx=0x7fdfa400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:21.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdf97fff640 1 -- 172.21.15.130:0/3229823011 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa40074e0 con 0x7fdfb00d1750 2023-09-13T06:06:21.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3229823011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb00b7e40 con 0x7fdfb00d1750 2023-09-13T06:06:21.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdf97fff640 1 -- 172.21.15.130:0/3229823011 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa4007660 con 0x7fdfb00d1750 2023-09-13T06:06:21.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdf97fff640 1 -- 172.21.15.130:0/3229823011 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4004a30 con 0x7fdfb00d1750 2023-09-13T06:06:21.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.553+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3229823011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb015c8d0 con 0x7fdfb00d1750 2023-09-13T06:06:21.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.557+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3229823011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb0137790 con 0x7fdfb00d1750 2023-09-13T06:06:21.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.557+0000 7fdf97fff640 1 -- 172.21.15.130:0/3229823011 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdfa4004b90 con 0x7fdfb00d1750 2023-09-13T06:06:21.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.557+0000 7fdf97fff640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf9c065b20 0x7fdf9c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.557+0000 7fdf97fff640 1 -- 172.21.15.130:0/3229823011 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfa4082570 con 0x7fdfb00d1750 2023-09-13T06:06:21.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.557+0000 7fdfaf7fe640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf9c065b20 0x7fdf9c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.557+0000 7fdfaf7fe640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf9c065b20 0x7fdf9c067fe0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009b60 tx=0x7fdfa0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:21.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.561+0000 7fdf97fff640 1 -- 172.21.15.130:0/3229823011 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdfb0137790 con 0x7fdfb00d1750 2023-09-13T06:06:21.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3229823011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfb0137790 con 0x7fdfb00d1750 2023-09-13T06:06:21.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdf97fff640 1 -- 172.21.15.130:0/3229823011 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4924 (secure 0 0 0) 0x7fdfb0137790 con 0x7fdfb00d1750 2023-09-13T06:06:21.746 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:21.746 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3211692360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3211692360},{"type":"v1","addr":"172.21.15.164:6834","nonce":3211692360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2453731046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2453731046},{"type":"v1","addr":"172.21.15.130:6835","nonce":2453731046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2896649577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2896649577},{"type":"v1","addr":"172.21.15.164:6835","nonce":2896649577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:06:17.421334+0000","modified":"2023-09-13T06:06:20.748001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6888":{"gid":6888,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/878642631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":878642631},{"type":"v1","addr":"172.21.15.130:6837","nonce":878642631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-09-13T06:06:21.747 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 51 2023-09-13T06:06:21.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3229823011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf9c065b20 msgr2=0x7fdf9c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf9c065b20 0x7fdf9c067fe0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009b60 tx=0x7fdfa0009190 comp rx=0 tx=0).stop 2023-09-13T06:06:21.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3229823011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfb00d1750 msgr2=0x7fdfb015b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfb00d1750 0x7fdfb015b6c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400c4b0 tx=0x7fdfa400c970 comp rx=0 tx=0).stop 2023-09-13T06:06:21.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3229823011 shutdown_connections 2023-09-13T06:06:21.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf9c065b20 0x7fdf9c067fe0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfb0146f30 0x7fdfb013d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfb00d1750 0x7fdfb015b6c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 --2- 172.21.15.130:0/3229823011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfb00d1090 0x7fdfb015aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3229823011 >> 172.21.15.130:0/3229823011 conn(0x7fdfb006f170 msgr2=0x7fdfb00b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:21.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3229823011 shutdown_connections 2023-09-13T06:06:21.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.745+0000 7fdfb5ed8640 1 -- 172.21.15.130:0/3229823011 wait complete. 2023-09-13T06:06:21.767 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:21.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.901+0000 7f023b248640 1 Processor -- start 2023-09-13T06:06:21.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.901+0000 7f023b248640 1 -- start start 2023-09-13T06:06:21.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f023b248640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0234157920 0x7f02340ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f023b248640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f02340b1d20 0x7f023406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f023b248640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02340afee0 con 0x7f02340b0f40 2023-09-13T06:06:21.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f023b248640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02340aea50 con 0x7f0234157920 2023-09-13T06:06:21.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f023b248640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02340b0b20 con 0x7f02340b1d20 2023-09-13T06:06:21.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f0238fe4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0234157920 0x7f02340ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f0238fe4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0234157920 0x7f02340ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35934/0 (socket says 172.21.15.130:35934) 2023-09-13T06:06:21.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f0238fe4640 1 -- 172.21.15.130:0/2687924467 learned_addr learned my addr 172.21.15.130:0/2687924467 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:21.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f02397e5640 1 --2- 172.21.15.130:0/2687924467 >> v2:172.21.15.164:3300/0 conn(0x7f02340b1d20 0x7f023406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f0238fe4640 1 -- 172.21.15.130:0/2687924467 >> v2:172.21.15.164:3300/0 conn(0x7f02340b1d20 msgr2=0x7f023406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:21.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f0238fe4640 1 --2- 172.21.15.130:0/2687924467 >> v2:172.21.15.164:3300/0 conn(0x7f02340b1d20 0x7f023406b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f022b7fe640 1 -- 172.21.15.130:0/2687924467 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539961532 0 0) 0x7f02340afee0 con 0x7f02340b0f40 2023-09-13T06:06:21.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f0238fe4640 1 -- 172.21.15.130:0/2687924467 >> v1:172.21.15.164:6789/0 conn(0x7f02340b0f40 legacy=0x7f02340b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.905+0000 7f0238fe4640 1 -- 172.21.15.130:0/2687924467 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02340b0180 con 0x7f0234157920 2023-09-13T06:06:21.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f0238fe4640 1 --2- 172.21.15.130:0/2687924467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0234157920 0x7f02340ae190 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f02340adca0 tx=0x7f023001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f08809bb246171d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:21.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f022b7fe640 1 -- 172.21.15.130:0/2687924467 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300aa430 con 0x7f0234157920 2023-09-13T06:06:21.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f022b7fe640 1 -- 172.21.15.130:0/2687924467 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02300aa590 con 0x7f0234157920 2023-09-13T06:06:21.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f022b7fe640 1 -- 172.21.15.130:0/2687924467 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300aa920 con 0x7f0234157920 2023-09-13T06:06:21.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f023b248640 1 -- 172.21.15.130:0/2687924467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0234157920 msgr2=0x7f02340ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f023b248640 1 --2- 172.21.15.130:0/2687924467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0234157920 0x7f02340ae190 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f02340adca0 tx=0x7f023001c4d0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f023b248640 1 -- 172.21.15.130:0/2687924467 shutdown_connections 2023-09-13T06:06:21.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f023b248640 1 --2- 172.21.15.130:0/2687924467 >> v2:172.21.15.164:3300/0 conn(0x7f02340b1d20 0x7f023406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f023b248640 1 --2- 172.21.15.130:0/2687924467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0234157920 0x7f02340ae190 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f023b248640 1 -- 172.21.15.130:0/2687924467 >> 172.21.15.130:0/2687924467 conn(0x7f0234065990 msgr2=0x7f0234065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:21.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f023b248640 1 -- 172.21.15.130:0/2687924467 shutdown_connections 2023-09-13T06:06:21.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f023b248640 1 -- 172.21.15.130:0/2687924467 wait complete. 2023-09-13T06:06:21.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f023b248640 1 Processor -- start 2023-09-13T06:06:21.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.909+0000 7f023b248640 1 -- start start 2023-09-13T06:06:21.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f023b248640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02340b0f40 0x7f02341f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f023b248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02340b1d20 0x7f0234137a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f023b248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0234157920 0x7f023406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f023b248640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0234151c60 con 0x7f02340b1d20 2023-09-13T06:06:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f023b248640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0234151630 con 0x7f02340b0f40 2023-09-13T06:06:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f023b248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0234156720 con 0x7f0234157920 2023-09-13T06:06:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f022bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02340b1d20 0x7f0234137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f022bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02340b1d20 0x7f0234137a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35946/0 (socket says 172.21.15.130:35946) 2023-09-13T06:06:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f022bfff640 1 -- 172.21.15.130:0/2984607200 learned_addr learned my addr 172.21.15.130:0/2984607200 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:21.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f0238fe4640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02340b0f40 0x7f02341f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f02397e5640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0234157920 0x7f023406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f022bfff640 1 -- 172.21.15.130:0/2984607200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0234157920 msgr2=0x7f023406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f022bfff640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0234157920 0x7f023406fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f022bfff640 1 -- 172.21.15.130:0/2984607200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02340b0f40 msgr2=0x7f02341f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:21.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f022bfff640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02340b0f40 0x7f02341f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:21.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f022bfff640 1 -- 172.21.15.130:0/2984607200 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300094d0 con 0x7f02340b1d20 2023-09-13T06:06:21.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f022bfff640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02340b1d20 0x7f0234137a50 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f022400c500 tx=0x7f022400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:21.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f02297fa640 1 -- 172.21.15.130:0/2984607200 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224003600 con 0x7f02340b1d20 2023-09-13T06:06:21.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f02297fa640 1 -- 172.21.15.130:0/2984607200 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0224003760 con 0x7f02340b1d20 2023-09-13T06:06:21.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f023b248640 1 -- 172.21.15.130:0/2984607200 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023415a980 con 0x7f02340b1d20 2023-09-13T06:06:21.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f02297fa640 1 -- 172.21.15.130:0/2984607200 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224003b10 con 0x7f02340b1d20 2023-09-13T06:06:21.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f023b248640 1 -- 172.21.15.130:0/2984607200 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0234151880 con 0x7f02340b1d20 2023-09-13T06:06:21.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f023b248640 1 -- 172.21.15.130:0/2984607200 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0234151da0 con 0x7f02340b1d20 2023-09-13T06:06:21.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.913+0000 7f02297fa640 1 -- 172.21.15.130:0/2984607200 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0224003c70 con 0x7f02340b1d20 2023-09-13T06:06:21.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.917+0000 7f02297fa640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0220065b20 0x7f0220067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:21.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.917+0000 7f02297fa640 1 -- 172.21.15.130:0/2984607200 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02240828b0 con 0x7f02340b1d20 2023-09-13T06:06:21.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.917+0000 7f0238fe4640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0220065b20 0x7f0220067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:21.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.917+0000 7f0238fe4640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0220065b20 0x7f0220067fe0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f02300ae000 tx=0x7f02300a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:21.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:21.921+0000 7f02297fa640 1 -- 172.21.15.130:0/2984607200 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0234151da0 con 0x7f02340b1d20 2023-09-13T06:06:22.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.069+0000 7f023b248640 1 -- 172.21.15.130:0/2984607200 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0234151da0 con 0x7f02340b1d20 2023-09-13T06:06:22.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.069+0000 7f02297fa640 1 -- 172.21.15.130:0/2984607200 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16607 (secure 0 0 0) 0x7f0234151da0 con 0x7f02340b1d20 2023-09-13T06:06:22.072 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:22.072 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":102,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:19.045507+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:06:15.152093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-09-13T06:06:16.467343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:22.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 -- 172.21.15.130:0/2984607200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0220065b20 msgr2=0x7f0220067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0220065b20 0x7f0220067fe0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f02300ae000 tx=0x7f02300a7000 comp rx=0 tx=0).stop 2023-09-13T06:06:22.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 -- 172.21.15.130:0/2984607200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02340b1d20 msgr2=0x7f0234137a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02340b1d20 0x7f0234137a50 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f022400c500 tx=0x7f022400c9c0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 -- 172.21.15.130:0/2984607200 shutdown_connections 2023-09-13T06:06:22.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0220065b20 0x7f0220067fe0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0234157920 0x7f023406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02340b1d20 0x7f0234137a50 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 --2- 172.21.15.130:0/2984607200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02340b0f40 0x7f02341f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 -- 172.21.15.130:0/2984607200 >> 172.21.15.130:0/2984607200 conn(0x7f0234065990 msgr2=0x7f0234150ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:22.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 -- 172.21.15.130:0/2984607200 shutdown_connections 2023-09-13T06:06:22.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.073+0000 7f023b248640 1 -- 172.21.15.130:0/2984607200 wait complete. 2023-09-13T06:06:22.093 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T06:06:22.094 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:06:22.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.229+0000 7f17820ec640 1 Processor -- start 2023-09-13T06:06:22.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.229+0000 7f17820ec640 1 -- start start 2023-09-13T06:06:22.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f17820ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c15d5f0 0x7f177c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f17820ec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f177c15d9d0 0x7f177c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f17820ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c0cce60 con 0x7f177c0ae170 2023-09-13T06:06:22.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f17820ec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c0cd140 con 0x7f177c15d9d0 2023-09-13T06:06:22.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f17820ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0cd420 con 0x7f177c15d5f0 2023-09-13T06:06:22.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177affd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f177c0ae170 0x7f177c1591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43774/0 (socket says 172.21.15.130:43774) 2023-09-13T06:06:22.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177affd640 1 -- 172.21.15.130:0/180192062 learned_addr learned my addr 172.21.15.130:0/180192062 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:22.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949807085 0 0) 0x7f177c0cce60 con 0x7f177c0ae170 2023-09-13T06:06:22.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1764003450 con 0x7f177c0ae170 2023-09-13T06:06:22.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177b7fe640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c15d5f0 0x7f177c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177bfff640 1 --2- 172.21.15.130:0/180192062 >> v2:172.21.15.164:3300/0 conn(0x7f177c15d9d0 0x7f177c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3336653809 0 0) 0x7f1764003450 con 0x7f177c0ae170 2023-09-13T06:06:22.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c15d5f0 msgr2=0x7f177c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:22.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c15d5f0 0x7f177c0cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 >> v2:172.21.15.164:3300/0 conn(0x7f177c15d9d0 msgr2=0x7f177c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:22.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 --2- 172.21.15.130:0/180192062 >> v2:172.21.15.164:3300/0 conn(0x7f177c15d9d0 0x7f177c0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c0cd700 con 0x7f177c0ae170 2023-09-13T06:06:22.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f1770001680 con 0x7f177c0ae170 2023-09-13T06:06:22.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 >> v1:172.21.15.130:6789/0 conn(0x7f177c0ae170 legacy=0x7f177c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c15d5f0 0x7f1764003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1764004060 0x7f176400a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f176400ae70 0x7f176400d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0cd140 con 0x7f1764004060 2023-09-13T06:06:22.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0cd420 con 0x7f176400ae70 2023-09-13T06:06:22.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176400dc60 con 0x7f177c15d5f0 2023-09-13T06:06:22.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177affd640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1764004060 0x7f176400a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177bfff640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f176400ae70 0x7f176400d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177b7fe640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c15d5f0 0x7f1764003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177affd640 1 -- 172.21.15.130:0/180192062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c15d5f0 msgr2=0x7f1764003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:22.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177affd640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c15d5f0 0x7f1764003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177affd640 1 -- 172.21.15.130:0/180192062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f176400ae70 msgr2=0x7f176400d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:22.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177affd640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f176400ae70 0x7f176400d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.233+0000 7f177affd640 1 -- 172.21.15.130:0/180192062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1764003450 con 0x7f1764004060 2023-09-13T06:06:22.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.237+0000 7f177affd640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1764004060 0x7f176400a870 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f177000c210 tx=0x7f177001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c7bbec0ae7d84d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:22.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.237+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700058e0 con 0x7f1764004060 2023-09-13T06:06:22.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.237+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1770005a40 con 0x7f1764004060 2023-09-13T06:06:22.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.237+0000 7f177a7fc640 1 -- 172.21.15.130:0/180192062 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770005e50 con 0x7f1764004060 2023-09-13T06:06:22.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.237+0000 7f17820ec640 1 -- 172.21.15.130:0/180192062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1764004060 msgr2=0x7f176400a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.237+0000 7f17820ec640 1 --2- 172.21.15.130:0/180192062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1764004060 0x7f176400a870 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f177000c210 tx=0x7f177001cc40 comp rx=0 tx=0).stop 2023-09-13T06:06:22.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.237+0000 7f177bfff640 1 -- 172.21.15.130:0/180192062 reap_dead start 2023-09-13T06:06:22.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.237+0000 7f17820ec640 1 -- 172.21.15.130:0/180192062 shutdown_connections 2023-09-13T06:06:22.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.237+0000 7f17820ec640 1 -- 172.21.15.130:0/180192062 >> 172.21.15.130:0/180192062 conn(0x7f177c065990 msgr2=0x7f177c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:22.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.237+0000 7f17820ec640 1 -- 172.21.15.130:0/180192062 shutdown_connections 2023-09-13T06:06:22.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.237+0000 7f17820ec640 1 -- 172.21.15.130:0/180192062 wait complete. 2023-09-13T06:06:22.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f17820ec640 1 Processor -- start 2023-09-13T06:06:22.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f17820ec640 1 -- start start 2023-09-13T06:06:22.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f17820ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1764004060 0x7f177c149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f17820ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c14e780 0x7f177c153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f17820ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f177c14ec00 0x7f177c154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f17820ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c15ac70 con 0x7f177c14ec00 2023-09-13T06:06:22.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f17820ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c15af50 con 0x7f1764004060 2023-09-13T06:06:22.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f17820ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c15b230 con 0x7f177c14e780 2023-09-13T06:06:22.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f177bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f177c14ec00 0x7f177c154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f177bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f177c14ec00 0x7f177c154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35972/0 (socket says 172.21.15.130:35972) 2023-09-13T06:06:22.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f177bfff640 1 -- 172.21.15.130:0/1713007847 learned_addr learned my addr 172.21.15.130:0/1713007847 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:22.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f177affd640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c14e780 0x7f177c153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f177b7fe640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1764004060 0x7f177c149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f177bfff640 1 -- 172.21.15.130:0/1713007847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c14e780 msgr2=0x7f177c153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f177bfff640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c14e780 0x7f177c153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f177bfff640 1 -- 172.21.15.130:0/1713007847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1764004060 msgr2=0x7f177c149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f177bfff640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1764004060 0x7f177c149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f177bfff640 1 -- 172.21.15.130:0/1713007847 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c15b510 con 0x7f177c14ec00 2023-09-13T06:06:22.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f177bfff640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f177c14ec00 0x7f177c154240 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f177c0b0dd0 tx=0x7f1774011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:22.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f1763fff640 1 -- 172.21.15.130:0/1713007847 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400e040 con 0x7f177c14ec00 2023-09-13T06:06:22.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f1763fff640 1 -- 172.21.15.130:0/1713007847 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177400f040 con 0x7f177c14ec00 2023-09-13T06:06:22.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f1763fff640 1 -- 172.21.15.130:0/1713007847 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400fe30 con 0x7f177c14ec00 2023-09-13T06:06:22.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f17820ec640 1 -- 172.21.15.130:0/1713007847 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c15b7f0 con 0x7f177c14ec00 2023-09-13T06:06:22.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f17820ec640 1 -- 172.21.15.130:0/1713007847 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c149f80 con 0x7f177c14ec00 2023-09-13T06:06:22.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.241+0000 7f17820ec640 1 -- 172.21.15.130:0/1713007847 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c0618a0 con 0x7f177c14ec00 2023-09-13T06:06:22.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.245+0000 7f1763fff640 1 -- 172.21.15.130:0/1713007847 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1774015430 con 0x7f177c14ec00 2023-09-13T06:06:22.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.245+0000 7f1763fff640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1768065b20 0x7f1768067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.245+0000 7f1763fff640 1 -- 172.21.15.130:0/1713007847 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17740838c0 con 0x7f177c14ec00 2023-09-13T06:06:22.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.245+0000 7f177b7fe640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1768065b20 0x7f1768067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.245+0000 7f177b7fe640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1768065b20 0x7f1768067fe0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f176c009a80 tx=0x7f176c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:22.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.249+0000 7f1763fff640 1 -- 172.21.15.130:0/1713007847 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f17740511f0 con 0x7f177c14ec00 2023-09-13T06:06:22.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.397+0000 7f17820ec640 1 -- 172.21.15.130:0/1713007847 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f177c06d690 con 0x7f1768065b20 2023-09-13T06:06:22.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.405+0000 7f1763fff640 1 -- 172.21.15.130:0/1713007847 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285066 (secure 0 0 0) 0x7f177c06d690 con 0x7f1768065b20 2023-09-13T06:06:22.409 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:22.411 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:06:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 -- 172.21.15.130:0/1713007847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1768065b20 msgr2=0x7f1768067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1768065b20 0x7f1768067fe0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f176c009a80 tx=0x7f176c009190 comp rx=0 tx=0).stop 2023-09-13T06:06:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 -- 172.21.15.130:0/1713007847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f177c14ec00 msgr2=0x7f177c154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f177c14ec00 0x7f177c154240 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f177c0b0dd0 tx=0x7f1774011f10 comp rx=0 tx=0).stop 2023-09-13T06:06:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 -- 172.21.15.130:0/1713007847 shutdown_connections 2023-09-13T06:06:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1768065b20 0x7f1768067fe0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f177c14ec00 0x7f177c154240 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f177c14e780 0x7f177c153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 --2- 172.21.15.130:0/1713007847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1764004060 0x7f177c149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 -- 172.21.15.130:0/1713007847 >> 172.21.15.130:0/1713007847 conn(0x7f177c065990 msgr2=0x7f177c0cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:22.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 -- 172.21.15.130:0/1713007847 shutdown_connections 2023-09-13T06:06:22.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.409+0000 7f17820ec640 1 -- 172.21.15.130:0/1713007847 wait complete. 2023-09-13T06:06:22.429 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2023-09-13T06:06:20.599271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557090,"statfs":{"total":1600000000,"available":1594460633,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.560245"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063481+0000","last_change":"2023-09-13T06:06:18.062659+0000","last_active":"2023-09-13T06:06:18.063481+0000","last_peered":"2023-09-13T06:06:18.063481+0000","last_clean":"2023-09-13T06:06:18.063481+0000","last_became_active":"2023-09-13T06:06:18.061829+0000","last_became_peered":"2023-09-13T06:06:18.061829+0000","last_unstale":"2023-09-13T06:06:18.063481+0000","last_undegraded":"2023-09-13T06:06:18.063481+0000","last_fullsized":"2023-09-13T06:06:18.063481+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:10.813353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063252+0000","last_change":"2023-09-13T06:06:18.063127+0000","last_active":"2023-09-13T06:06:18.063252+0000","last_peered":"2023-09-13T06:06:18.063252+0000","last_clean":"2023-09-13T06:06:18.063252+0000","last_became_active":"2023-09-13T06:06:18.062874+0000","last_became_peered":"2023-09-13T06:06:18.062874+0000","last_unstale":"2023-09-13T06:06:18.063252+0000","last_undegraded":"2023-09-13T06:06:18.063252+0000","last_fullsized":"2023-09-13T06:06:18.063252+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:20.025713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063226+0000","last_change":"2023-09-13T06:06:18.062727+0000","last_active":"2023-09-13T06:06:18.063226+0000","last_peered":"2023-09-13T06:06:18.063226+0000","last_clean":"2023-09-13T06:06:18.063226+0000","last_became_active":"2023-09-13T06:06:18.062497+0000","last_became_peered":"2023-09-13T06:06:18.062497+0000","last_unstale":"2023-09-13T06:06:18.063226+0000","last_undegraded":"2023-09-13T06:06:18.063226+0000","last_fullsized":"2023-09-13T06:06:18.063226+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:18:51.630143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062018+0000","last_change":"2023-09-13T06:06:18.060711+0000","last_active":"2023-09-13T06:06:18.062018+0000","last_peered":"2023-09-13T06:06:18.062018+0000","last_clean":"2023-09-13T06:06:18.062018+0000","last_became_active":"2023-09-13T06:06:18.059991+0000","last_became_peered":"2023-09-13T06:06:18.059991+0000","last_unstale":"2023-09-13T06:06:18.062018+0000","last_undegraded":"2023-09-13T06:06:18.062018+0000","last_fullsized":"2023-09-13T06:06:18.062018+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:00:58.922188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056786+0000","last_change":"2023-09-13T06:06:18.054259+0000","last_active":"2023-09-13T06:06:18.056786+0000","last_peered":"2023-09-13T06:06:18.056786+0000","last_clean":"2023-09-13T06:06:18.056786+0000","last_became_active":"2023-09-13T06:06:18.054039+0000","last_became_peered":"2023-09-13T06:06:18.054039+0000","last_unstale":"2023-09-13T06:06:18.056786+0000","last_undegraded":"2023-09-13T06:06:18.056786+0000","last_fullsized":"2023-09-13T06:06:18.056786+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:05.661998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.064800+0000","last_change":"2023-09-13T06:06:18.064729+0000","last_active":"2023-09-13T06:06:18.064800+0000","last_peered":"2023-09-13T06:06:18.064800+0000","last_clean":"2023-09-13T06:06:18.064800+0000","last_became_active":"2023-09-13T06:06:18.064294+0000","last_became_peered":"2023-09-13T06:06:18.064294+0000","last_unstale":"2023-09-13T06:06:18.064800+0000","last_undegraded":"2023-09-13T06:06:18.064800+0000","last_fullsized":"2023-09-13T06:06:18.064800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:59:44.004971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055747+0000","last_change":"2023-09-13T06:06:18.055649+0000","last_active":"2023-09-13T06:06:18.055747+0000","last_peered":"2023-09-13T06:06:18.055747+0000","last_clean":"2023-09-13T06:06:18.055747+0000","last_became_active":"2023-09-13T06:06:18.055433+0000","last_became_peered":"2023-09-13T06:06:18.055433+0000","last_unstale":"2023-09-13T06:06:18.055747+0000","last_undegraded":"2023-09-13T06:06:18.055747+0000","last_fullsized":"2023-09-13T06:06:18.055747+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:32:27.254317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.064311+0000","last_change":"2023-09-13T06:06:18.064201+0000","last_active":"2023-09-13T06:06:18.064311+0000","last_peered":"2023-09-13T06:06:18.064311+0000","last_clean":"2023-09-13T06:06:18.064311+0000","last_became_active":"2023-09-13T06:06:18.063944+0000","last_became_peered":"2023-09-13T06:06:18.063944+0000","last_unstale":"2023-09-13T06:06:18.064311+0000","last_undegraded":"2023-09-13T06:06:18.064311+0000","last_fullsized":"2023-09-13T06:06:18.064311+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:10.813353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062045+0000","last_change":"2023-09-13T06:06:18.061968+0000","last_active":"2023-09-13T06:06:18.062045+0000","last_peered":"2023-09-13T06:06:18.062045+0000","last_clean":"2023-09-13T06:06:18.062045+0000","last_became_active":"2023-09-13T06:06:18.061406+0000","last_became_peered":"2023-09-13T06:06:18.061406+0000","last_unstale":"2023-09-13T06:06:18.062045+0000","last_undegraded":"2023-09-13T06:06:18.062045+0000","last_fullsized":"2023-09-13T06:06:18.062045+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:46:57.534039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060981+0000","last_change":"2023-09-13T06:06:18.060385+0000","last_active":"2023-09-13T06:06:18.060981+0000","last_peered":"2023-09-13T06:06:18.060981+0000","last_clean":"2023-09-13T06:06:18.060981+0000","last_became_active":"2023-09-13T06:06:18.059740+0000","last_became_peered":"2023-09-13T06:06:18.059740+0000","last_unstale":"2023-09-13T06:06:18.060981+0000","last_undegraded":"2023-09-13T06:06:18.060981+0000","last_fullsized":"2023-09-13T06:06:18.060981+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:58:01.780195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.058201+0000","last_change":"2023-09-13T06:06:18.058002+0000","last_active":"2023-09-13T06:06:18.058201+0000","last_peered":"2023-09-13T06:06:18.058201+0000","last_clean":"2023-09-13T06:06:18.058201+0000","last_became_active":"2023-09-13T06:06:18.057612+0000","last_became_peered":"2023-09-13T06:06:18.057612+0000","last_unstale":"2023-09-13T06:06:18.058201+0000","last_undegraded":"2023-09-13T06:06:18.058201+0000","last_fullsized":"2023-09-13T06:06:18.058201+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:01:23.173166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063498+0000","last_change":"2023-09-13T06:06:18.063400+0000","last_active":"2023-09-13T06:06:18.063498+0000","last_peered":"2023-09-13T06:06:18.063498+0000","last_clean":"2023-09-13T06:06:18.063498+0000","last_became_active":"2023-09-13T06:06:18.063003+0000","last_became_peered":"2023-09-13T06:06:18.063003+0000","last_unstale":"2023-09-13T06:06:18.063498+0000","last_undegraded":"2023-09-13T06:06:18.063498+0000","last_fullsized":"2023-09-13T06:06:18.063498+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:10.371933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.050152+0000","last_change":"2023-09-13T06:06:18.050072+0000","last_active":"2023-09-13T06:06:18.050152+0000","last_peered":"2023-09-13T06:06:18.050152+0000","last_clean":"2023-09-13T06:06:18.050152+0000","last_became_active":"2023-09-13T06:06:18.049829+0000","last_became_peered":"2023-09-13T06:06:18.049829+0000","last_unstale":"2023-09-13T06:06:18.050152+0000","last_undegraded":"2023-09-13T06:06:18.050152+0000","last_fullsized":"2023-09-13T06:06:18.050152+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:25.816385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062002+0000","last_change":"2023-09-13T06:06:18.060580+0000","last_active":"2023-09-13T06:06:18.062002+0000","last_peered":"2023-09-13T06:06:18.062002+0000","last_clean":"2023-09-13T06:06:18.062002+0000","last_became_active":"2023-09-13T06:06:18.059600+0000","last_became_peered":"2023-09-13T06:06:18.059600+0000","last_unstale":"2023-09-13T06:06:18.062002+0000","last_undegraded":"2023-09-13T06:06:18.062002+0000","last_fullsized":"2023-09-13T06:06:18.062002+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:42:10.193900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055677+0000","last_change":"2023-09-13T06:06:18.055593+0000","last_active":"2023-09-13T06:06:18.055677+0000","last_peered":"2023-09-13T06:06:18.055677+0000","last_clean":"2023-09-13T06:06:18.055677+0000","last_became_active":"2023-09-13T06:06:18.055371+0000","last_became_peered":"2023-09-13T06:06:18.055371+0000","last_unstale":"2023-09-13T06:06:18.055677+0000","last_undegraded":"2023-09-13T06:06:18.055677+0000","last_fullsized":"2023-09-13T06:06:18.055677+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:19:53.027170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.059694+0000","last_change":"2023-09-13T06:06:18.059615+0000","last_active":"2023-09-13T06:06:18.059694+0000","last_peered":"2023-09-13T06:06:18.059694+0000","last_clean":"2023-09-13T06:06:18.059694+0000","last_became_active":"2023-09-13T06:06:18.059318+0000","last_became_peered":"2023-09-13T06:06:18.059318+0000","last_unstale":"2023-09-13T06:06:18.059694+0000","last_undegraded":"2023-09-13T06:06:18.059694+0000","last_fullsized":"2023-09-13T06:06:18.059694+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:10.371933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.051611+0000","last_change":"2023-09-13T06:06:18.051553+0000","last_active":"2023-09-13T06:06:18.051611+0000","last_peered":"2023-09-13T06:06:18.051611+0000","last_clean":"2023-09-13T06:06:18.051611+0000","last_became_active":"2023-09-13T06:06:18.051160+0000","last_became_peered":"2023-09-13T06:06:18.051160+0000","last_unstale":"2023-09-13T06:06:18.051611+0000","last_undegraded":"2023-09-13T06:06:18.051611+0000","last_fullsized":"2023-09-13T06:06:18.051611+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:43.124855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063111+0000","last_change":"2023-09-13T06:06:18.063045+0000","last_active":"2023-09-13T06:06:18.063111+0000","last_peered":"2023-09-13T06:06:18.063111+0000","last_clean":"2023-09-13T06:06:18.063111+0000","last_became_active":"2023-09-13T06:06:18.062815+0000","last_became_peered":"2023-09-13T06:06:18.062815+0000","last_unstale":"2023-09-13T06:06:18.063111+0000","last_undegraded":"2023-09-13T06:06:18.063111+0000","last_fullsized":"2023-09-13T06:06:18.063111+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:03:11.619284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.061782+0000","last_change":"2023-09-13T06:06:18.061436+0000","last_active":"2023-09-13T06:06:18.061782+0000","last_peered":"2023-09-13T06:06:18.061782+0000","last_clean":"2023-09-13T06:06:18.061782+0000","last_became_active":"2023-09-13T06:06:18.060484+0000","last_became_peered":"2023-09-13T06:06:18.060484+0000","last_unstale":"2023-09-13T06:06:18.061782+0000","last_undegraded":"2023-09-13T06:06:18.061782+0000","last_fullsized":"2023-09-13T06:06:18.061782+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:22:31.571804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.058120+0000","last_change":"2023-09-13T06:06:18.057828+0000","last_active":"2023-09-13T06:06:18.058120+0000","last_peered":"2023-09-13T06:06:18.058120+0000","last_clean":"2023-09-13T06:06:18.058120+0000","last_became_active":"2023-09-13T06:06:18.056758+0000","last_became_peered":"2023-09-13T06:06:18.056758+0000","last_unstale":"2023-09-13T06:06:18.058120+0000","last_undegraded":"2023-09-13T06:06:18.058120+0000","last_fullsized":"2023-09-13T06:06:18.058120+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:56:31.402208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055515+0000","last_change":"2023-09-13T06:06:18.055362+0000","last_active":"2023-09-13T06:06:18.055515+0000","last_peered":"2023-09-13T06:06:18.055515+0000","last_clean":"2023-09-13T06:06:18.055515+0000","last_became_active":"2023-09-13T06:06:18.054975+0000","last_became_peered":"2023-09-13T06:06:18.054975+0000","last_unstale":"2023-09-13T06:06:18.055515+0000","last_undegraded":"2023-09-13T06:06:18.055515+0000","last_fullsized":"2023-09-13T06:06:18.055515+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:03:27.518016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055939+0000","last_change":"2023-09-13T06:06:18.055875+0000","last_active":"2023-09-13T06:06:18.055939+0000","last_peered":"2023-09-13T06:06:18.055939+0000","last_clean":"2023-09-13T06:06:18.055939+0000","last_became_active":"2023-09-13T06:06:18.055638+0000","last_became_peered":"2023-09-13T06:06:18.055638+0000","last_unstale":"2023-09-13T06:06:18.055939+0000","last_undegraded":"2023-09-13T06:06:18.055939+0000","last_fullsized":"2023-09-13T06:06:18.055939+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:56.021848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.064003+0000","last_change":"2023-09-13T06:06:18.063917+0000","last_active":"2023-09-13T06:06:18.064003+0000","last_peered":"2023-09-13T06:06:18.064003+0000","last_clean":"2023-09-13T06:06:18.064003+0000","last_became_active":"2023-09-13T06:06:18.062380+0000","last_became_peered":"2023-09-13T06:06:18.062380+0000","last_unstale":"2023-09-13T06:06:18.064003+0000","last_undegraded":"2023-09-13T06:06:18.064003+0000","last_fullsized":"2023-09-13T06:06:18.064003+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:53:46.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.057045+0000","last_change":"2023-09-13T06:06:18.056263+0000","last_active":"2023-09-13T06:06:18.057045+0000","last_peered":"2023-09-13T06:06:18.057045+0000","last_clean":"2023-09-13T06:06:18.057045+0000","last_became_active":"2023-09-13T06:06:18.055998+0000","last_became_peered":"2023-09-13T06:06:18.055998+0000","last_unstale":"2023-09-13T06:06:18.057045+0000","last_undegraded":"2023-09-13T06:06:18.057045+0000","last_fullsized":"2023-09-13T06:06:18.057045+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:11:28.908490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060844+0000","last_change":"2023-09-13T06:06:18.060528+0000","last_active":"2023-09-13T06:06:18.060844+0000","last_peered":"2023-09-13T06:06:18.060844+0000","last_clean":"2023-09-13T06:06:18.060844+0000","last_became_active":"2023-09-13T06:06:18.059977+0000","last_became_peered":"2023-09-13T06:06:18.059977+0000","last_unstale":"2023-09-13T06:06:18.060844+0000","last_undegraded":"2023-09-13T06:06:18.060844+0000","last_fullsized":"2023-09-13T06:06:18.060844+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:55:12.697800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055363+0000","last_change":"2023-09-13T06:06:18.055216+0000","last_active":"2023-09-13T06:06:18.055363+0000","last_peered":"2023-09-13T06:06:18.055363+0000","last_clean":"2023-09-13T06:06:18.055363+0000","last_became_active":"2023-09-13T06:06:18.054987+0000","last_became_peered":"2023-09-13T06:06:18.054987+0000","last_unstale":"2023-09-13T06:06:18.055363+0000","last_undegraded":"2023-09-13T06:06:18.055363+0000","last_fullsized":"2023-09-13T06:06:18.055363+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:15:46.787976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.057441+0000","last_change":"2023-09-13T06:06:18.057330+0000","last_active":"2023-09-13T06:06:18.057441+0000","last_peered":"2023-09-13T06:06:18.057441+0000","last_clean":"2023-09-13T06:06:18.057441+0000","last_became_active":"2023-09-13T06:06:18.056821+0000","last_became_peered":"2023-09-13T06:06:18.056821+0000","last_unstale":"2023-09-13T06:06:18.057441+0000","last_undegraded":"2023-09-13T06:06:18.057441+0000","last_fullsized":"2023-09-13T06:06:18.057441+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:50:21.600983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063734+0000","last_change":"2023-09-13T06:06:18.063644+0000","last_active":"2023-09-13T06:06:18.063734+0000","last_peered":"2023-09-13T06:06:18.063734+0000","last_clean":"2023-09-13T06:06:18.063734+0000","last_became_active":"2023-09-13T06:06:18.062021+0000","last_became_peered":"2023-09-13T06:06:18.062021+0000","last_unstale":"2023-09-13T06:06:18.063734+0000","last_undegraded":"2023-09-13T06:06:18.063734+0000","last_fullsized":"2023-09-13T06:06:18.063734+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:18:58.091970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060810+0000","last_change":"2023-09-13T06:06:18.060233+0000","last_active":"2023-09-13T06:06:18.060810+0000","last_peered":"2023-09-13T06:06:18.060810+0000","last_clean":"2023-09-13T06:06:18.060810+0000","last_became_active":"2023-09-13T06:06:18.059797+0000","last_became_peered":"2023-09-13T06:06:18.059797+0000","last_unstale":"2023-09-13T06:06:18.060810+0000","last_undegraded":"2023-09-13T06:06:18.060810+0000","last_fullsized":"2023-09-13T06:06:18.060810+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:52:10.005262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060864+0000","last_change":"2023-09-13T06:06:18.060674+0000","last_active":"2023-09-13T06:06:18.060864+0000","last_peered":"2023-09-13T06:06:18.060864+0000","last_clean":"2023-09-13T06:06:18.060864+0000","last_became_active":"2023-09-13T06:06:18.060301+0000","last_became_peered":"2023-09-13T06:06:18.060301+0000","last_unstale":"2023-09-13T06:06:18.060864+0000","last_undegraded":"2023-09-13T06:06:18.060864+0000","last_fullsized":"2023-09-13T06:06:18.060864+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:36:08.876256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.053731+0000","last_change":"2023-09-13T06:06:18.053622+0000","last_active":"2023-09-13T06:06:18.053731+0000","last_peered":"2023-09-13T06:06:18.053731+0000","last_clean":"2023-09-13T06:06:18.053731+0000","last_became_active":"2023-09-13T06:06:18.053196+0000","last_became_peered":"2023-09-13T06:06:18.053196+0000","last_unstale":"2023-09-13T06:06:18.053731+0000","last_undegraded":"2023-09-13T06:06:18.053731+0000","last_fullsized":"2023-09-13T06:06:18.053731+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:05:09.646048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060963+0000","last_change":"2023-09-13T06:06:18.060246+0000","last_active":"2023-09-13T06:06:18.060963+0000","last_peered":"2023-09-13T06:06:18.060963+0000","last_clean":"2023-09-13T06:06:18.060963+0000","last_became_active":"2023-09-13T06:06:18.059919+0000","last_became_peered":"2023-09-13T06:06:18.059919+0000","last_unstale":"2023-09-13T06:06:18.060963+0000","last_undegraded":"2023-09-13T06:06:18.060963+0000","last_fullsized":"2023-09-13T06:06:18.060963+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:13:51.034064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062215+0000","last_change":"2023-09-13T06:06:18.062062+0000","last_active":"2023-09-13T06:06:18.062215+0000","last_peered":"2023-09-13T06:06:18.062215+0000","last_clean":"2023-09-13T06:06:18.062215+0000","last_became_active":"2023-09-13T06:06:18.061830+0000","last_became_peered":"2023-09-13T06:06:18.061830+0000","last_unstale":"2023-09-13T06:06:18.062215+0000","last_undegraded":"2023-09-13T06:06:18.062215+0000","last_fullsized":"2023-09-13T06:06:18.062215+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:53:46.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"101'4","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.371367+0000","last_change":"2023-09-13T06:06:17.059440+0000","last_active":"2023-09-13T06:06:18.371367+0000","last_peered":"2023-09-13T06:06:18.371367+0000","last_clean":"2023-09-13T06:06:18.371367+0000","last_became_active":"2023-09-13T06:06:17.058938+0000","last_became_peered":"2023-09-13T06:06:17.058938+0000","last_unstale":"2023-09-13T06:06:18.371367+0000","last_undegraded":"2023-09-13T06:06:18.371367+0000","last_fullsized":"2023-09-13T06:06:18.371367+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:34:50.211690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062360+0000","last_change":"2023-09-13T06:06:18.061754+0000","last_active":"2023-09-13T06:06:18.062360+0000","last_peered":"2023-09-13T06:06:18.062360+0000","last_clean":"2023-09-13T06:06:18.062360+0000","last_became_active":"2023-09-13T06:06:18.061106+0000","last_became_peered":"2023-09-13T06:06:18.061106+0000","last_unstale":"2023-09-13T06:06:18.062360+0000","last_undegraded":"2023-09-13T06:06:18.062360+0000","last_fullsized":"2023-09-13T06:06:18.062360+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:48.988716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"101'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.369679+0000","last_change":"2023-09-13T06:06:17.050475+0000","last_active":"2023-09-13T06:06:18.369679+0000","last_peered":"2023-09-13T06:06:18.369679+0000","last_clean":"2023-09-13T06:06:18.369679+0000","last_became_active":"2023-09-13T06:06:17.050232+0000","last_became_peered":"2023-09-13T06:06:17.050232+0000","last_unstale":"2023-09-13T06:06:18.369679+0000","last_undegraded":"2023-09-13T06:06:18.369679+0000","last_fullsized":"2023-09-13T06:06:18.369679+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:33.037700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062380+0000","last_change":"2023-09-13T06:06:18.062150+0000","last_active":"2023-09-13T06:06:18.062380+0000","last_peered":"2023-09-13T06:06:18.062380+0000","last_clean":"2023-09-13T06:06:18.062380+0000","last_became_active":"2023-09-13T06:06:18.061486+0000","last_became_peered":"2023-09-13T06:06:18.061486+0000","last_unstale":"2023-09-13T06:06:18.062380+0000","last_undegraded":"2023-09-13T06:06:18.062380+0000","last_fullsized":"2023-09-13T06:06:18.062380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:45:17.252173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.371150+0000","last_change":"2023-09-13T06:06:17.053581+0000","last_active":"2023-09-13T06:06:18.371150+0000","last_peered":"2023-09-13T06:06:18.371150+0000","last_clean":"2023-09-13T06:06:18.371150+0000","last_became_active":"2023-09-13T06:06:17.053332+0000","last_became_peered":"2023-09-13T06:06:17.053332+0000","last_unstale":"2023-09-13T06:06:18.371150+0000","last_undegraded":"2023-09-13T06:06:18.371150+0000","last_fullsized":"2023-09-13T06:06:18.371150+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:52:14.089111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.052733+0000","last_change":"2023-09-13T06:06:18.052516+0000","last_active":"2023-09-13T06:06:18.052733+0000","last_peered":"2023-09-13T06:06:18.052733+0000","last_clean":"2023-09-13T06:06:18.052733+0000","last_became_active":"2023-09-13T06:06:18.052276+0000","last_became_peered":"2023-09-13T06:06:18.052276+0000","last_unstale":"2023-09-13T06:06:18.052733+0000","last_undegraded":"2023-09-13T06:06:18.052733+0000","last_fullsized":"2023-09-13T06:06:18.052733+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:59:19.170791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.371621+0000","last_change":"2023-09-13T06:06:17.054484+0000","last_active":"2023-09-13T06:06:18.371621+0000","last_peered":"2023-09-13T06:06:18.371621+0000","last_clean":"2023-09-13T06:06:18.371621+0000","last_became_active":"2023-09-13T06:06:17.053894+0000","last_became_peered":"2023-09-13T06:06:17.053894+0000","last_unstale":"2023-09-13T06:06:18.371621+0000","last_undegraded":"2023-09-13T06:06:18.371621+0000","last_fullsized":"2023-09-13T06:06:18.371621+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:48:43.295068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060880+0000","last_change":"2023-09-13T06:06:18.060749+0000","last_active":"2023-09-13T06:06:18.060880+0000","last_peered":"2023-09-13T06:06:18.060880+0000","last_clean":"2023-09-13T06:06:18.060880+0000","last_became_active":"2023-09-13T06:06:18.060495+0000","last_became_peered":"2023-09-13T06:06:18.060495+0000","last_unstale":"2023-09-13T06:06:18.060880+0000","last_undegraded":"2023-09-13T06:06:18.060880+0000","last_fullsized":"2023-09-13T06:06:18.060880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:01:55.637429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"101'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.369082+0000","last_change":"2023-09-13T06:06:17.050630+0000","last_active":"2023-09-13T06:06:18.369082+0000","last_peered":"2023-09-13T06:06:18.369082+0000","last_clean":"2023-09-13T06:06:18.369082+0000","last_became_active":"2023-09-13T06:06:17.050401+0000","last_became_peered":"2023-09-13T06:06:17.050401+0000","last_unstale":"2023-09-13T06:06:18.369082+0000","last_undegraded":"2023-09-13T06:06:18.369082+0000","last_fullsized":"2023-09-13T06:06:18.369082+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:33:49.270394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.051470+0000","last_change":"2023-09-13T06:06:18.051397+0000","last_active":"2023-09-13T06:06:18.051470+0000","last_peered":"2023-09-13T06:06:18.051470+0000","last_clean":"2023-09-13T06:06:18.051470+0000","last_became_active":"2023-09-13T06:06:18.050829+0000","last_became_peered":"2023-09-13T06:06:18.050829+0000","last_unstale":"2023-09-13T06:06:18.051470+0000","last_undegraded":"2023-09-13T06:06:18.051470+0000","last_fullsized":"2023-09-13T06:06:18.051470+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:19:54.833147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"101'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.368936+0000","last_change":"2023-09-13T06:06:17.052802+0000","last_active":"2023-09-13T06:06:18.368936+0000","last_peered":"2023-09-13T06:06:18.368936+0000","last_clean":"2023-09-13T06:06:18.368936+0000","last_became_active":"2023-09-13T06:06:17.052406+0000","last_became_peered":"2023-09-13T06:06:17.052406+0000","last_unstale":"2023-09-13T06:06:18.368936+0000","last_undegraded":"2023-09-13T06:06:18.368936+0000","last_fullsized":"2023-09-13T06:06:18.368936+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:48.408244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056633+0000","last_change":"2023-09-13T06:06:18.056449+0000","last_active":"2023-09-13T06:06:18.056633+0000","last_peered":"2023-09-13T06:06:18.056633+0000","last_clean":"2023-09-13T06:06:18.056633+0000","last_became_active":"2023-09-13T06:06:18.055686+0000","last_became_peered":"2023-09-13T06:06:18.055686+0000","last_unstale":"2023-09-13T06:06:18.056633+0000","last_undegraded":"2023-09-13T06:06:18.056633+0000","last_fullsized":"2023-09-13T06:06:18.056633+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:16:54.176283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.051476+0000","last_change":"2023-09-13T06:06:17.058153+0000","last_active":"2023-09-13T06:06:18.051476+0000","last_peered":"2023-09-13T06:06:18.051476+0000","last_clean":"2023-09-13T06:06:18.051476+0000","last_became_active":"2023-09-13T06:06:17.057926+0000","last_became_peered":"2023-09-13T06:06:17.057926+0000","last_unstale":"2023-09-13T06:06:18.051476+0000","last_undegraded":"2023-09-13T06:06:18.051476+0000","last_fullsized":"2023-09-13T06:06:18.051476+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:00:29.343291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055251+0000","last_change":"2023-09-13T06:06:18.054818+0000","last_active":"2023-09-13T06:06:18.055251+0000","last_peered":"2023-09-13T06:06:18.055251+0000","last_clean":"2023-09-13T06:06:18.055251+0000","last_became_active":"2023-09-13T06:06:18.054541+0000","last_became_peered":"2023-09-13T06:06:18.054541+0000","last_unstale":"2023-09-13T06:06:18.055251+0000","last_undegraded":"2023-09-13T06:06:18.055251+0000","last_fullsized":"2023-09-13T06:06:18.055251+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.742026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.054008+0000","last_change":"2023-09-13T06:06:17.054352+0000","last_active":"2023-09-13T06:06:18.054008+0000","last_peered":"2023-09-13T06:06:18.054008+0000","last_clean":"2023-09-13T06:06:18.054008+0000","last_became_active":"2023-09-13T06:06:17.053763+0000","last_became_peered":"2023-09-13T06:06:17.053763+0000","last_unstale":"2023-09-13T06:06:18.054008+0000","last_undegraded":"2023-09-13T06:06:18.054008+0000","last_fullsized":"2023-09-13T06:06:18.054008+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:28:02.392833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056175+0000","last_change":"2023-09-13T06:06:18.056114+0000","last_active":"2023-09-13T06:06:18.056175+0000","last_peered":"2023-09-13T06:06:18.056175+0000","last_clean":"2023-09-13T06:06:18.056175+0000","last_became_active":"2023-09-13T06:06:18.055899+0000","last_became_peered":"2023-09-13T06:06:18.055899+0000","last_unstale":"2023-09-13T06:06:18.056175+0000","last_undegraded":"2023-09-13T06:06:18.056175+0000","last_fullsized":"2023-09-13T06:06:18.056175+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:55.805689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055769+0000","last_change":"2023-09-13T06:06:17.056167+0000","last_active":"2023-09-13T06:06:18.055769+0000","last_peered":"2023-09-13T06:06:18.055769+0000","last_clean":"2023-09-13T06:06:18.055769+0000","last_became_active":"2023-09-13T06:06:17.055903+0000","last_became_peered":"2023-09-13T06:06:17.055903+0000","last_unstale":"2023-09-13T06:06:18.055769+0000","last_undegraded":"2023-09-13T06:06:18.055769+0000","last_fullsized":"2023-09-13T06:06:18.055769+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:46:56.525132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.064635+0000","last_change":"2023-09-13T06:06:18.064538+0000","last_active":"2023-09-13T06:06:18.064635+0000","last_peered":"2023-09-13T06:06:18.064635+0000","last_clean":"2023-09-13T06:06:18.064635+0000","last_became_active":"2023-09-13T06:06:18.063959+0000","last_became_peered":"2023-09-13T06:06:18.063959+0000","last_unstale":"2023-09-13T06:06:18.064635+0000","last_undegraded":"2023-09-13T06:06:18.064635+0000","last_fullsized":"2023-09-13T06:06:18.064635+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:45:17.252173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056564+0000","last_change":"2023-09-13T06:06:17.057632+0000","last_active":"2023-09-13T06:06:18.056564+0000","last_peered":"2023-09-13T06:06:18.056564+0000","last_clean":"2023-09-13T06:06:18.056564+0000","last_became_active":"2023-09-13T06:06:17.057312+0000","last_became_peered":"2023-09-13T06:06:17.057312+0000","last_unstale":"2023-09-13T06:06:18.056564+0000","last_undegraded":"2023-09-13T06:06:18.056564+0000","last_fullsized":"2023-09-13T06:06:18.056564+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:04.653091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.061800+0000","last_change":"2023-09-13T06:06:18.061633+0000","last_active":"2023-09-13T06:06:18.061800+0000","last_peered":"2023-09-13T06:06:18.061800+0000","last_clean":"2023-09-13T06:06:18.061800+0000","last_became_active":"2023-09-13T06:06:18.061216+0000","last_became_peered":"2023-09-13T06:06:18.061216+0000","last_unstale":"2023-09-13T06:06:18.061800+0000","last_undegraded":"2023-09-13T06:06:18.061800+0000","last_fullsized":"2023-09-13T06:06:18.061800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:56:50.524977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"101'3","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.370335+0000","last_change":"2023-09-13T06:06:17.059158+0000","last_active":"2023-09-13T06:06:18.370335+0000","last_peered":"2023-09-13T06:06:18.370335+0000","last_clean":"2023-09-13T06:06:18.370335+0000","last_became_active":"2023-09-13T06:06:17.056292+0000","last_became_peered":"2023-09-13T06:06:17.056292+0000","last_unstale":"2023-09-13T06:06:18.370335+0000","last_undegraded":"2023-09-13T06:06:18.370335+0000","last_fullsized":"2023-09-13T06:06:18.370335+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:22.943817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.052882+0000","last_change":"2023-09-13T06:06:18.052312+0000","last_active":"2023-09-13T06:06:18.052882+0000","last_peered":"2023-09-13T06:06:18.052882+0000","last_clean":"2023-09-13T06:06:18.052882+0000","last_became_active":"2023-09-13T06:06:18.052041+0000","last_became_peered":"2023-09-13T06:06:18.052041+0000","last_unstale":"2023-09-13T06:06:18.052882+0000","last_undegraded":"2023-09-13T06:06:18.052882+0000","last_fullsized":"2023-09-13T06:06:18.052882+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:42:17.342534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"101'6","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.372155+0000","last_change":"2023-09-13T06:06:17.056318+0000","last_active":"2023-09-13T06:06:18.372155+0000","last_peered":"2023-09-13T06:06:18.372155+0000","last_clean":"2023-09-13T06:06:18.372155+0000","last_became_active":"2023-09-13T06:06:17.055859+0000","last_became_peered":"2023-09-13T06:06:17.055859+0000","last_unstale":"2023-09-13T06:06:18.372155+0000","last_undegraded":"2023-09-13T06:06:18.372155+0000","last_fullsized":"2023-09-13T06:06:18.372155+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:09.363026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060660+0000","last_change":"2023-09-13T06:06:18.060593+0000","last_active":"2023-09-13T06:06:18.060660+0000","last_peered":"2023-09-13T06:06:18.060660+0000","last_clean":"2023-09-13T06:06:18.060660+0000","last_became_active":"2023-09-13T06:06:18.057843+0000","last_became_peered":"2023-09-13T06:06:18.057843+0000","last_unstale":"2023-09-13T06:06:18.060660+0000","last_undegraded":"2023-09-13T06:06:18.060660+0000","last_fullsized":"2023-09-13T06:06:18.060660+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:47:49.294562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.372008+0000","last_change":"2023-09-13T06:06:17.054215+0000","last_active":"2023-09-13T06:06:18.372008+0000","last_peered":"2023-09-13T06:06:18.372008+0000","last_clean":"2023-09-13T06:06:18.372008+0000","last_became_active":"2023-09-13T06:06:17.053422+0000","last_became_peered":"2023-09-13T06:06:17.053422+0000","last_unstale":"2023-09-13T06:06:18.372008+0000","last_undegraded":"2023-09-13T06:06:18.372008+0000","last_fullsized":"2023-09-13T06:06:18.372008+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:48:59.525963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056685+0000","last_change":"2023-09-13T06:06:18.056596+0000","last_active":"2023-09-13T06:06:18.056685+0000","last_peered":"2023-09-13T06:06:18.056685+0000","last_clean":"2023-09-13T06:06:18.056685+0000","last_became_active":"2023-09-13T06:06:18.056075+0000","last_became_peered":"2023-09-13T06:06:18.056075+0000","last_unstale":"2023-09-13T06:06:18.056685+0000","last_undegraded":"2023-09-13T06:06:18.056685+0000","last_fullsized":"2023-09-13T06:06:18.056685+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:14:41.496676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.052928+0000","last_change":"2023-09-13T06:06:17.055189+0000","last_active":"2023-09-13T06:06:18.052928+0000","last_peered":"2023-09-13T06:06:18.052928+0000","last_clean":"2023-09-13T06:06:18.052928+0000","last_became_active":"2023-09-13T06:06:17.054959+0000","last_became_peered":"2023-09-13T06:06:17.054959+0000","last_unstale":"2023-09-13T06:06:18.052928+0000","last_undegraded":"2023-09-13T06:06:18.052928+0000","last_fullsized":"2023-09-13T06:06:18.052928+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:36.726560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.058142+0000","last_change":"2023-09-13T06:06:18.057276+0000","last_active":"2023-09-13T06:06:18.058142+0000","last_peered":"2023-09-13T06:06:18.058142+0000","last_clean":"2023-09-13T06:06:18.058142+0000","last_became_active":"2023-09-13T06:06:18.057047+0000","last_became_peered":"2023-09-13T06:06:18.057047+0000","last_unstale":"2023-09-13T06:06:18.058142+0000","last_undegraded":"2023-09-13T06:06:18.058142+0000","last_fullsized":"2023-09-13T06:06:18.058142+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:05:30.772913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.057400+0000","last_change":"2023-09-13T06:06:17.057382+0000","last_active":"2023-09-13T06:06:18.057400+0000","last_peered":"2023-09-13T06:06:18.057400+0000","last_clean":"2023-09-13T06:06:18.057400+0000","last_became_active":"2023-09-13T06:06:17.057167+0000","last_became_peered":"2023-09-13T06:06:17.057167+0000","last_unstale":"2023-09-13T06:06:18.057400+0000","last_undegraded":"2023-09-13T06:06:18.057400+0000","last_fullsized":"2023-09-13T06:06:18.057400+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:58:00.771288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.061796+0000","last_change":"2023-09-13T06:06:18.061659+0000","last_active":"2023-09-13T06:06:18.061796+0000","last_peered":"2023-09-13T06:06:18.061796+0000","last_clean":"2023-09-13T06:06:18.061796+0000","last_became_active":"2023-09-13T06:06:18.061430+0000","last_became_peered":"2023-09-13T06:06:18.061430+0000","last_unstale":"2023-09-13T06:06:18.061796+0000","last_undegraded":"2023-09-13T06:06:18.061796+0000","last_fullsized":"2023-09-13T06:06:18.061796+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:54:48.412793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"101'8","reported_seq":19,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.372163+0000","last_change":"2023-09-13T06:06:17.051424+0000","last_active":"2023-09-13T06:06:18.372163+0000","last_peered":"2023-09-13T06:06:18.372163+0000","last_clean":"2023-09-13T06:06:18.372163+0000","last_became_active":"2023-09-13T06:06:17.050544+0000","last_became_peered":"2023-09-13T06:06:17.050544+0000","last_unstale":"2023-09-13T06:06:18.372163+0000","last_undegraded":"2023-09-13T06:06:18.372163+0000","last_fullsized":"2023-09-13T06:06:18.372163+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:17:49.298252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063306+0000","last_change":"2023-09-13T06:06:18.063214+0000","last_active":"2023-09-13T06:06:18.063306+0000","last_peered":"2023-09-13T06:06:18.063306+0000","last_clean":"2023-09-13T06:06:18.063306+0000","last_became_active":"2023-09-13T06:06:18.062938+0000","last_became_peered":"2023-09-13T06:06:18.062938+0000","last_unstale":"2023-09-13T06:06:18.063306+0000","last_undegraded":"2023-09-13T06:06:18.063306+0000","last_fullsized":"2023-09-13T06:06:18.063306+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:01:03.615177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"101'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.368198+0000","last_change":"2023-09-13T06:06:17.058384+0000","last_active":"2023-09-13T06:06:18.368198+0000","last_peered":"2023-09-13T06:06:18.368198+0000","last_clean":"2023-09-13T06:06:18.368198+0000","last_became_active":"2023-09-13T06:06:17.057990+0000","last_became_peered":"2023-09-13T06:06:17.057990+0000","last_unstale":"2023-09-13T06:06:18.368198+0000","last_undegraded":"2023-09-13T06:06:18.368198+0000","last_fullsized":"2023-09-13T06:06:18.368198+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:42.115948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060208+0000","last_change":"2023-09-13T06:06:18.059328+0000","last_active":"2023-09-13T06:06:18.060208+0000","last_peered":"2023-09-13T06:06:18.060208+0000","last_clean":"2023-09-13T06:06:18.060208+0000","last_became_active":"2023-09-13T06:06:18.058876+0000","last_became_peered":"2023-09-13T06:06:18.058876+0000","last_unstale":"2023-09-13T06:06:18.060208+0000","last_undegraded":"2023-09-13T06:06:18.060208+0000","last_fullsized":"2023-09-13T06:06:18.060208+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:13:28.156878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.371821+0000","last_change":"2023-09-13T06:06:17.052314+0000","last_active":"2023-09-13T06:06:18.371821+0000","last_peered":"2023-09-13T06:06:18.371821+0000","last_clean":"2023-09-13T06:06:18.371821+0000","last_became_active":"2023-09-13T06:06:17.052080+0000","last_became_peered":"2023-09-13T06:06:17.052080+0000","last_unstale":"2023-09-13T06:06:18.371821+0000","last_undegraded":"2023-09-13T06:06:18.371821+0000","last_fullsized":"2023-09-13T06:06:18.371821+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:29:23.794752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056769+0000","last_change":"2023-09-13T06:06:18.054223+0000","last_active":"2023-09-13T06:06:18.056769+0000","last_peered":"2023-09-13T06:06:18.056769+0000","last_clean":"2023-09-13T06:06:18.056769+0000","last_became_active":"2023-09-13T06:06:18.053942+0000","last_became_peered":"2023-09-13T06:06:18.053942+0000","last_unstale":"2023-09-13T06:06:18.056769+0000","last_undegraded":"2023-09-13T06:06:18.056769+0000","last_fullsized":"2023-09-13T06:06:18.056769+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:35:09.588116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.049904+0000","last_change":"2023-09-13T06:06:17.058073+0000","last_active":"2023-09-13T06:06:18.049904+0000","last_peered":"2023-09-13T06:06:18.049904+0000","last_clean":"2023-09-13T06:06:18.049904+0000","last_became_active":"2023-09-13T06:06:17.057844+0000","last_became_peered":"2023-09-13T06:06:17.057844+0000","last_unstale":"2023-09-13T06:06:18.049904+0000","last_undegraded":"2023-09-13T06:06:18.049904+0000","last_fullsized":"2023-09-13T06:06:18.049904+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:17:16.331315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062033+0000","last_change":"2023-09-13T06:06:18.060877+0000","last_active":"2023-09-13T06:06:18.062033+0000","last_peered":"2023-09-13T06:06:18.062033+0000","last_clean":"2023-09-13T06:06:18.062033+0000","last_became_active":"2023-09-13T06:06:18.060339+0000","last_became_peered":"2023-09-13T06:06:18.060339+0000","last_unstale":"2023-09-13T06:06:18.062033+0000","last_undegraded":"2023-09-13T06:06:18.062033+0000","last_fullsized":"2023-09-13T06:06:18.062033+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:24:19.186610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.370264+0000","last_change":"2023-09-13T06:06:17.057504+0000","last_active":"2023-09-13T06:06:18.370264+0000","last_peered":"2023-09-13T06:06:18.370264+0000","last_clean":"2023-09-13T06:06:18.370264+0000","last_became_active":"2023-09-13T06:06:17.057276+0000","last_became_peered":"2023-09-13T06:06:17.057276+0000","last_unstale":"2023-09-13T06:06:18.370264+0000","last_undegraded":"2023-09-13T06:06:18.370264+0000","last_fullsized":"2023-09-13T06:06:18.370264+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:25:28.957256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.059012+0000","last_change":"2023-09-13T06:06:18.058880+0000","last_active":"2023-09-13T06:06:18.059012+0000","last_peered":"2023-09-13T06:06:18.059012+0000","last_clean":"2023-09-13T06:06:18.059012+0000","last_became_active":"2023-09-13T06:06:18.058611+0000","last_became_peered":"2023-09-13T06:06:18.058611+0000","last_unstale":"2023-09-13T06:06:18.059012+0000","last_undegraded":"2023-09-13T06:06:18.059012+0000","last_fullsized":"2023-09-13T06:06:18.059012+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:18:58.091970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.049926+0000","last_change":"2023-09-13T06:06:17.051897+0000","last_active":"2023-09-13T06:06:18.049926+0000","last_peered":"2023-09-13T06:06:18.049926+0000","last_clean":"2023-09-13T06:06:18.049926+0000","last_became_active":"2023-09-13T06:06:17.051672+0000","last_became_peered":"2023-09-13T06:06:17.051672+0000","last_unstale":"2023-09-13T06:06:18.049926+0000","last_undegraded":"2023-09-13T06:06:18.049926+0000","last_fullsized":"2023-09-13T06:06:18.049926+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:29.100478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062056+0000","last_change":"2023-09-13T06:06:18.061923+0000","last_active":"2023-09-13T06:06:18.062056+0000","last_peered":"2023-09-13T06:06:18.062056+0000","last_clean":"2023-09-13T06:06:18.062056+0000","last_became_active":"2023-09-13T06:06:18.061688+0000","last_became_peered":"2023-09-13T06:06:18.061688+0000","last_unstale":"2023-09-13T06:06:18.062056+0000","last_undegraded":"2023-09-13T06:06:18.062056+0000","last_fullsized":"2023-09-13T06:06:18.062056+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:06:15.097483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.048977+0000","last_change":"2023-09-13T06:06:17.057670+0000","last_active":"2023-09-13T06:06:18.048977+0000","last_peered":"2023-09-13T06:06:18.048977+0000","last_clean":"2023-09-13T06:06:18.048977+0000","last_became_active":"2023-09-13T06:06:17.057167+0000","last_became_peered":"2023-09-13T06:06:17.057167+0000","last_unstale":"2023-09-13T06:06:18.048977+0000","last_undegraded":"2023-09-13T06:06:18.048977+0000","last_fullsized":"2023-09-13T06:06:18.048977+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:34:07.206469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.059739+0000","last_change":"2023-09-13T06:06:18.059666+0000","last_active":"2023-09-13T06:06:18.059739+0000","last_peered":"2023-09-13T06:06:18.059739+0000","last_clean":"2023-09-13T06:06:18.059739+0000","last_became_active":"2023-09-13T06:06:18.059406+0000","last_became_peered":"2023-09-13T06:06:18.059406+0000","last_unstale":"2023-09-13T06:06:18.059739+0000","last_undegraded":"2023-09-13T06:06:18.059739+0000","last_fullsized":"2023-09-13T06:06:18.059739+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:13:28.156878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.053057+0000","last_change":"2023-09-13T06:06:17.058325+0000","last_active":"2023-09-13T06:06:18.053057+0000","last_peered":"2023-09-13T06:06:18.053057+0000","last_clean":"2023-09-13T06:06:18.053057+0000","last_became_active":"2023-09-13T06:06:17.057853+0000","last_became_peered":"2023-09-13T06:06:17.057853+0000","last_unstale":"2023-09-13T06:06:18.053057+0000","last_undegraded":"2023-09-13T06:06:18.053057+0000","last_fullsized":"2023-09-13T06:06:18.053057+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:57:37.986408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060929+0000","last_change":"2023-09-13T06:06:18.060792+0000","last_active":"2023-09-13T06:06:18.060929+0000","last_peered":"2023-09-13T06:06:18.060929+0000","last_clean":"2023-09-13T06:06:18.060929+0000","last_became_active":"2023-09-13T06:06:18.060525+0000","last_became_peered":"2023-09-13T06:06:18.060525+0000","last_unstale":"2023-09-13T06:06:18.060929+0000","last_undegraded":"2023-09-13T06:06:18.060929+0000","last_fullsized":"2023-09-13T06:06:18.060929+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:34:51.220597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.371016+0000","last_change":"2023-09-13T06:06:17.052625+0000","last_active":"2023-09-13T06:06:18.371016+0000","last_peered":"2023-09-13T06:06:18.371016+0000","last_clean":"2023-09-13T06:06:18.371016+0000","last_became_active":"2023-09-13T06:06:17.052404+0000","last_became_peered":"2023-09-13T06:06:17.052404+0000","last_unstale":"2023-09-13T06:06:18.371016+0000","last_undegraded":"2023-09-13T06:06:18.371016+0000","last_fullsized":"2023-09-13T06:06:18.371016+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:53:43.240890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062196+0000","last_change":"2023-09-13T06:06:18.061251+0000","last_active":"2023-09-13T06:06:18.062196+0000","last_peered":"2023-09-13T06:06:18.062196+0000","last_clean":"2023-09-13T06:06:18.062196+0000","last_became_active":"2023-09-13T06:06:18.061025+0000","last_became_peered":"2023-09-13T06:06:18.061025+0000","last_unstale":"2023-09-13T06:06:18.062196+0000","last_undegraded":"2023-09-13T06:06:18.062196+0000","last_fullsized":"2023-09-13T06:06:18.062196+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:28:15.406196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.054868+0000","last_change":"2023-09-13T06:06:17.052035+0000","last_active":"2023-09-13T06:06:18.054868+0000","last_peered":"2023-09-13T06:06:18.054868+0000","last_clean":"2023-09-13T06:06:18.054868+0000","last_became_active":"2023-09-13T06:06:17.051777+0000","last_became_peered":"2023-09-13T06:06:17.051777+0000","last_unstale":"2023-09-13T06:06:18.054868+0000","last_undegraded":"2023-09-13T06:06:18.054868+0000","last_fullsized":"2023-09-13T06:06:18.054868+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:21:59.102968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060996+0000","last_change":"2023-09-13T06:06:18.060585+0000","last_active":"2023-09-13T06:06:18.060996+0000","last_peered":"2023-09-13T06:06:18.060996+0000","last_clean":"2023-09-13T06:06:18.060996+0000","last_became_active":"2023-09-13T06:06:18.060104+0000","last_became_peered":"2023-09-13T06:06:18.060104+0000","last_unstale":"2023-09-13T06:06:18.060996+0000","last_undegraded":"2023-09-13T06:06:18.060996+0000","last_fullsized":"2023-09-13T06:06:18.060996+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:59:44.004971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.057878+0000","last_change":"2023-09-13T06:06:17.056353+0000","last_active":"2023-09-13T06:06:18.057878+0000","last_peered":"2023-09-13T06:06:18.057878+0000","last_clean":"2023-09-13T06:06:18.057878+0000","last_became_active":"2023-09-13T06:06:17.056115+0000","last_became_peered":"2023-09-13T06:06:17.056115+0000","last_unstale":"2023-09-13T06:06:18.057878+0000","last_undegraded":"2023-09-13T06:06:18.057878+0000","last_fullsized":"2023-09-13T06:06:18.057878+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:05:08.637141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.052911+0000","last_change":"2023-09-13T06:06:18.052597+0000","last_active":"2023-09-13T06:06:18.052911+0000","last_peered":"2023-09-13T06:06:18.052911+0000","last_clean":"2023-09-13T06:06:18.052911+0000","last_became_active":"2023-09-13T06:06:18.052367+0000","last_became_peered":"2023-09-13T06:06:18.052367+0000","last_unstale":"2023-09-13T06:06:18.052911+0000","last_undegraded":"2023-09-13T06:06:18.052911+0000","last_fullsized":"2023-09-13T06:06:18.052911+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:23.952724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056257+0000","last_change":"2023-09-13T06:06:17.058551+0000","last_active":"2023-09-13T06:06:18.056257+0000","last_peered":"2023-09-13T06:06:18.056257+0000","last_clean":"2023-09-13T06:06:18.056257+0000","last_became_active":"2023-09-13T06:06:17.056455+0000","last_became_peered":"2023-09-13T06:06:17.056455+0000","last_unstale":"2023-09-13T06:06:18.056257+0000","last_undegraded":"2023-09-13T06:06:18.056257+0000","last_fullsized":"2023-09-13T06:06:18.056257+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:42:16.333627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063539+0000","last_change":"2023-09-13T06:06:18.063340+0000","last_active":"2023-09-13T06:06:18.063539+0000","last_peered":"2023-09-13T06:06:18.063539+0000","last_clean":"2023-09-13T06:06:18.063539+0000","last_became_active":"2023-09-13T06:06:18.062281+0000","last_became_peered":"2023-09-13T06:06:18.062281+0000","last_unstale":"2023-09-13T06:06:18.063539+0000","last_undegraded":"2023-09-13T06:06:18.063539+0000","last_fullsized":"2023-09-13T06:06:18.063539+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:48.988716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.051780+0000","last_change":"2023-09-13T06:06:17.054633+0000","last_active":"2023-09-13T06:06:18.051780+0000","last_peered":"2023-09-13T06:06:18.051780+0000","last_clean":"2023-09-13T06:06:18.051780+0000","last_became_active":"2023-09-13T06:06:17.054239+0000","last_became_peered":"2023-09-13T06:06:17.054239+0000","last_unstale":"2023-09-13T06:06:18.051780+0000","last_undegraded":"2023-09-13T06:06:18.051780+0000","last_fullsized":"2023-09-13T06:06:18.051780+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:23:08.656035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060791+0000","last_change":"2023-09-13T06:06:18.060729+0000","last_active":"2023-09-13T06:06:18.060791+0000","last_peered":"2023-09-13T06:06:18.060791+0000","last_clean":"2023-09-13T06:06:18.060791+0000","last_became_active":"2023-09-13T06:06:18.060179+0000","last_became_peered":"2023-09-13T06:06:18.060179+0000","last_unstale":"2023-09-13T06:06:18.060791+0000","last_undegraded":"2023-09-13T06:06:18.060791+0000","last_fullsized":"2023-09-13T06:06:18.060791+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:15:58.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.047612+0000","last_change":"2023-09-13T06:06:17.051094+0000","last_active":"2023-09-13T06:06:18.047612+0000","last_peered":"2023-09-13T06:06:18.047612+0000","last_clean":"2023-09-13T06:06:18.047612+0000","last_became_active":"2023-09-13T06:06:17.050858+0000","last_became_peered":"2023-09-13T06:06:17.050858+0000","last_unstale":"2023-09-13T06:06:18.047612+0000","last_undegraded":"2023-09-13T06:06:18.047612+0000","last_fullsized":"2023-09-13T06:06:18.047612+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:52:18.008973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.059246+0000","last_change":"2023-09-13T06:06:18.059054+0000","last_active":"2023-09-13T06:06:18.059246+0000","last_peered":"2023-09-13T06:06:18.059246+0000","last_clean":"2023-09-13T06:06:18.059246+0000","last_became_active":"2023-09-13T06:06:18.058783+0000","last_became_peered":"2023-09-13T06:06:18.058783+0000","last_unstale":"2023-09-13T06:06:18.059246+0000","last_undegraded":"2023-09-13T06:06:18.059246+0000","last_fullsized":"2023-09-13T06:06:18.059246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:44:03.002500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060766+0000","last_change":"2023-09-13T06:06:17.059338+0000","last_active":"2023-09-13T06:06:18.060766+0000","last_peered":"2023-09-13T06:06:18.060766+0000","last_clean":"2023-09-13T06:06:18.060766+0000","last_became_active":"2023-09-13T06:06:17.058656+0000","last_became_peered":"2023-09-13T06:06:17.058656+0000","last_unstale":"2023-09-13T06:06:18.060766+0000","last_undegraded":"2023-09-13T06:06:18.060766+0000","last_fullsized":"2023-09-13T06:06:18.060766+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:48.408244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063461+0000","last_change":"2023-09-13T06:06:18.062635+0000","last_active":"2023-09-13T06:06:18.063461+0000","last_peered":"2023-09-13T06:06:18.063461+0000","last_clean":"2023-09-13T06:06:18.063461+0000","last_became_active":"2023-09-13T06:06:18.061508+0000","last_became_peered":"2023-09-13T06:06:18.061508+0000","last_unstale":"2023-09-13T06:06:18.063461+0000","last_undegraded":"2023-09-13T06:06:18.063461+0000","last_fullsized":"2023-09-13T06:06:18.063461+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:29:34.174674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.047108+0000","last_change":"2023-09-13T06:06:17.057224+0000","last_active":"2023-09-13T06:06:18.047108+0000","last_peered":"2023-09-13T06:06:18.047108+0000","last_clean":"2023-09-13T06:06:18.047108+0000","last_became_active":"2023-09-13T06:06:17.056989+0000","last_became_peered":"2023-09-13T06:06:17.056989+0000","last_unstale":"2023-09-13T06:06:18.047108+0000","last_undegraded":"2023-09-13T06:06:18.047108+0000","last_fullsized":"2023-09-13T06:06:18.047108+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:11:50.227377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.059667+0000","last_change":"2023-09-13T06:06:18.059379+0000","last_active":"2023-09-13T06:06:18.059667+0000","last_peered":"2023-09-13T06:06:18.059667+0000","last_clean":"2023-09-13T06:06:18.059667+0000","last_became_active":"2023-09-13T06:06:18.059170+0000","last_became_peered":"2023-09-13T06:06:18.059170+0000","last_unstale":"2023-09-13T06:06:18.059667+0000","last_undegraded":"2023-09-13T06:06:18.059667+0000","last_fullsized":"2023-09-13T06:06:18.059667+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:13:09.824943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"101'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.368252+0000","last_change":"2023-09-13T06:06:17.054073+0000","last_active":"2023-09-13T06:06:18.368252+0000","last_peered":"2023-09-13T06:06:18.368252+0000","last_clean":"2023-09-13T06:06:18.368252+0000","last_became_active":"2023-09-13T06:06:17.053841+0000","last_became_peered":"2023-09-13T06:06:17.053841+0000","last_unstale":"2023-09-13T06:06:18.368252+0000","last_undegraded":"2023-09-13T06:06:18.368252+0000","last_fullsized":"2023-09-13T06:06:18.368252+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:16:47.406138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":255,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-09-13T06:06:17.047051+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:06:17.047051+0000","last_peered":"2023-09-13T06:06:17.047051+0000","last_clean":"2023-09-13T06:06:17.047051+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:06:17.047051+0000","last_undegraded":"2023-09-13T06:06:17.047051+0000","last_fullsized":"2023-09-13T06:06:17.047051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:47.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194206,"statfs":{"total":200000000,"available":198867348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.58599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98799999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.57399999999999995,"5min":0.375,"15min":0.375},"max":{"1min":0.91100000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61299999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.53100000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.60699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94099999999999995,"5min":1.05,"15min":1.05},"last":0.69999999999999996}]},{"osd":2,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.59599999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.96599999999999997,"5min":1.395,"15min":1.395},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.50800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.93100000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68200000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.92100000000000004,"5min":1.357,"15min":1.357},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0129999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89500000000000002,"5min":1.018,"15min":1.018},"last":0.79500000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.67800000000000005},"min":{"1min":0.47499999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.875,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.501,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91000000000000003,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.53200000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.873,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89100000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.66500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96199999999999997,"5min":1.181,"15min":1.181},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.52100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":0.78400000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85399999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.55800000000000005,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.99299999999999999,"5min":1.153,"15min":1.153},"last":0.84899999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.63},{"interface":"front","average":{"1min":0.75,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94199999999999995,"5min":1.085,"15min":1.085},"last":0.71399999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.78700000000000003},"min":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.97099999999999997,"5min":1.526,"15min":1.526},"last":0.68799999999999994}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79100000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63800000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.877,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.83099999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.62},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89400000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85399999999999998,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76200000000000001,"15min":0.71599999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.022,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94699999999999995,"5min":1.133,"15min":1.133},"last":0.81399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.53500000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81599999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68500000000000005,"15min":0.65900000000000003},"min":{"1min":0.60599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88400000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.82799999999999996}]},{"osd":1,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69899999999999995,"15min":0.68700000000000006},"min":{"1min":0.51000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85199999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69199999999999995,"15min":0.67800000000000005},"min":{"1min":0.58499999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.874}]},{"osd":2,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.53300000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93300000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.749},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85399999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.84499999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71299999999999997,"15min":0.70799999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92300000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81699999999999995}]},{"osd":4,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.435,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89900000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.45900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.93600000000000005,"5min":1.054,"15min":1.054},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67000000000000004,"15min":0.68100000000000005},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89100000000000001,"5min":0.997,"15min":0.997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.51900000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83799999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.879,"5min":1.026,"15min":1.026},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64600000000000002,"15min":0.64100000000000001},"min":{"1min":0.45800000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":1.05,"15min":1.05},"last":0.97999999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67500000000000004,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.872,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.752},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.51300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92100000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.84499999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.87,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.95599999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88300000000000001,"5min":1.01,"15min":1.01},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.0960000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88900000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70099999999999996,"15min":0.68899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.123}]},{"osd":7,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71799999999999997,"15min":0.71099999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":1.26},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52100000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.92000000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":1.2390000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.29899999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61899999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66400000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.37}]},{"osd":1,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42999999999999999,"15min":0.42499999999999999},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.45600000000000002},"min":{"1min":0.35899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.626,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.68400000000000005}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.505,"15min":0.501},"min":{"1min":0.41199999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.439,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70799999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0229999999999999,"5min":1.284,"15min":1.284},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.72599999999999998,"15min":0.71599999999999997},"min":{"1min":0.58199999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.65100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.042,"5min":1.111,"15min":1.111},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.61299999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93300000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.61399999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.746,"15min":0.754},"min":{"1min":0.63200000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.995,"5min":1.458,"15min":1.458},"last":0.77300000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.65000000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0589999999999999,"5min":1.383,"15min":1.383},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.753,"15min":0.76500000000000001},"min":{"1min":0.63500000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.99199999999999999,"5min":1.27,"15min":1.27},"last":0.63300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194776,"statfs":{"total":200000000,"available":199450941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.40799999999999997},"min":{"1min":0.32600000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53700000000000003,"5min":10.401,"15min":10.401},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.46700000000000003,"15min":0.437},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":0.35999999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48199999999999998,"15min":0.45700000000000002},"min":{"1min":0.379,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60599999999999998,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.499,"15min":0.46500000000000002},"min":{"1min":0.39600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56499999999999995,"15min":0.52500000000000002},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58899999999999997,"15min":0.54900000000000004},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82399999999999995,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.77300000000000002},"min":{"1min":0.59999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0680000000000001,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.054,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.94599999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78400000000000003,"15min":0.77600000000000002},"min":{"1min":0.58499999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.026,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.79800000000000004},"min":{"1min":0.67900000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.032,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.872}]},{"osd":6,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.753,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0980000000000001,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.749}]},{"osd":7,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.754,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0489999999999999,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.628,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.92700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194776,"statfs":{"total":200000000,"available":199450941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45400000000000001,"15min":0.436},"min":{"1min":0.307,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66200000000000003,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.496},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.34100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68400000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42199999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.45800000000000002},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63600000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.66400000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51800000000000002,"15min":0.48599999999999999},"min":{"1min":0.40699999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68500000000000005,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73199999999999998,"15min":0.72899999999999998},"min":{"1min":0.59599999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.016,"5min":1.089,"15min":1.089},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95499999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.72099999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.0349999999999999,"5min":1.109,"15min":1.109},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.55900000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59099999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97199999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.58799999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97399999999999998,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.63400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.75900000000000001,"15min":0.76600000000000001},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.075,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1112,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194199,"statfs":{"total":200000000,"available":198860539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65400000000000003,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49199999999999999,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.753,"5min":2.294,"15min":2.294},"last":0.42699999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.495},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78200000000000003,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.29899999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57199999999999995,"5min":2.056,"15min":2.056},"last":0.29999999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76600000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.38800000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.746},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.052,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58099999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97299999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.55100000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0980000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.71699999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.78500000000000003,"15min":0.78200000000000003},"min":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1240000000000001,"5min":2.415,"15min":2.415},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.079,"5min":2.347,"15min":2.347},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79600000000000004,"15min":0.80000000000000004},"min":{"1min":0.63200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0800000000000001,"5min":2.367,"15min":2.367},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.78900000000000003}]}]}],"pool_statfs":[]}} 2023-09-13T06:06:22.437 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:06:22.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.609+0000 7fb8cc40b640 1 Processor -- start 2023-09-13T06:06:22.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.609+0000 7fb8cc40b640 1 -- start start 2023-09-13T06:06:22.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8cc40b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb8c40ce1a0 0x7fb8c406d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8cc40b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c4070e70 con 0x7fb8c415d260 2023-09-13T06:06:22.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8cc40b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c4070280 con 0x7fb8c40afc70 2023-09-13T06:06:22.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8cc40b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c4070540 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8c99a6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb8c40ce1a0 0x7fb8c406d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8c99a6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb8c40ce1a0 0x7fb8c406d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35976/0 (socket says 172.21.15.130:35976) 2023-09-13T06:06:22.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8c99a6640 1 -- 172.21.15.130:0/4161985840 learned_addr learned my addr 172.21.15.130:0/4161985840 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:22.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8ca1a7640 1 --1- 172.21.15.130:0/4161985840 >> v1:172.21.15.130:6789/0 conn(0x7fb8c415d260 0x7fb8c40b5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43786/0 (socket says 172.21.15.130:43786) 2023-09-13T06:06:22.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8c99a6640 1 -- 172.21.15.130:0/4161985840 >> v1:172.21.15.164:6789/0 conn(0x7fb8c40afc70 legacy=0x7fb8c4071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:22.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8c99a6640 1 -- 172.21.15.130:0/4161985840 >> v1:172.21.15.130:6789/0 conn(0x7fb8c415d260 legacy=0x7fb8c40b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8c99a6640 1 -- 172.21.15.130:0/4161985840 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c4070820 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8c91a5640 1 -- 172.21.15.130:0/4161985840 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780309404 0 0) 0x7fb8c4070e70 con 0x7fb8c415d260 2023-09-13T06:06:22.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.613+0000 7fb8c99a6640 1 --2- 172.21.15.130:0/4161985840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c40ce1a0 0x7fb8c406d6e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009870 tx=0x7fb8b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bf1a6387c123c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:22.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8c91a5640 1 -- 172.21.15.130:0/4161985840 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40ac640 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8c91a5640 1 -- 172.21.15.130:0/4161985840 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b40ac7a0 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8c91a5640 1 -- 172.21.15.130:0/4161985840 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40acb30 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 -- 172.21.15.130:0/4161985840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c40ce1a0 msgr2=0x7fb8c406d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 --2- 172.21.15.130:0/4161985840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c40ce1a0 0x7fb8c406d6e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009870 tx=0x7fb8b401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 -- 172.21.15.130:0/4161985840 shutdown_connections 2023-09-13T06:06:22.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 --2- 172.21.15.130:0/4161985840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c40ce1a0 0x7fb8c406d6e0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 -- 172.21.15.130:0/4161985840 >> 172.21.15.130:0/4161985840 conn(0x7fb8c406a2f0 msgr2=0x7fb8c406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:22.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 -- 172.21.15.130:0/4161985840 shutdown_connections 2023-09-13T06:06:22.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 -- 172.21.15.130:0/4161985840 wait complete. 2023-09-13T06:06:22.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 Processor -- start 2023-09-13T06:06:22.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 -- start start 2023-09-13T06:06:22.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8c40afc70 0x7fb8c413fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c40ce1a0 0x7fb8c4155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8c415d260 0x7fb8c40b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c415f6d0 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c415f970 con 0x7fb8c40afc70 2023-09-13T06:06:22.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8cc40b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c415fc50 con 0x7fb8c415d260 2023-09-13T06:06:22.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8c99a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c40ce1a0 0x7fb8c4155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8c99a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c40ce1a0 0x7fb8c4155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35980/0 (socket says 172.21.15.130:35980) 2023-09-13T06:06:22.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8c99a6640 1 -- 172.21.15.130:0/1105268725 learned_addr learned my addr 172.21.15.130:0/1105268725 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:22.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8ca1a7640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8c40afc70 0x7fb8c413fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.617+0000 7fb8ca9a8640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8c415d260 0x7fb8c40b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8c99a6640 1 -- 172.21.15.130:0/1105268725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8c415d260 msgr2=0x7fb8c40b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8c99a6640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8c415d260 0x7fb8c40b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8c99a6640 1 -- 172.21.15.130:0/1105268725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8c40afc70 msgr2=0x7fb8c413fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8c99a6640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8c40afc70 0x7fb8c413fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8c99a6640 1 -- 172.21.15.130:0/1105268725 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40094d0 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8ca9a8640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8c415d260 0x7fb8c40b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:22.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8c99a6640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c40ce1a0 0x7fb8c4155980 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40af040 tx=0x7fb8b4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:22.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8baffd640 1 -- 172.21.15.130:0/1105268725 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40b5830 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8baffd640 1 -- 172.21.15.130:0/1105268725 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b40b59b0 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8cc40b640 1 -- 172.21.15.130:0/1105268725 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c415ff30 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8baffd640 1 -- 172.21.15.130:0/1105268725 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40b5d60 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8cc40b640 1 -- 172.21.15.130:0/1105268725 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c4160730 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8cc40b640 1 -- 172.21.15.130:0/1105268725 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c40618a0 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8baffd640 1 -- 172.21.15.130:0/1105268725 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb8b40b3070 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8baffd640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8a8065b20 0x7fb8a8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8baffd640 1 -- 172.21.15.130:0/1105268725 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8b411ded0 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.621+0000 7fb8ca1a7640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8a8065b20 0x7fb8a8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.625+0000 7fb8ca1a7640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8a8065b20 0x7fb8a8067fe0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000f70 tx=0x7fb8c0007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:22.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.625+0000 7fb8baffd640 1 -- 172.21.15.130:0/1105268725 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb8b40eb780 con 0x7fb8c40ce1a0 2023-09-13T06:06:22.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.773+0000 7fb8cc40b640 1 -- 172.21.15.130:0/1105268725 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8c415fae0 con 0x7fb8a8065b20 2023-09-13T06:06:22.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.781+0000 7fb8baffd640 1 -- 172.21.15.130:0/1105268725 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285066 (secure 0 0 0) 0x7fb8c415fae0 con 0x7fb8a8065b20 2023-09-13T06:06:22.785 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:22.786 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:06:22.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 -- 172.21.15.130:0/1105268725 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8a8065b20 msgr2=0x7fb8a8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8a8065b20 0x7fb8a8067fe0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000f70 tx=0x7fb8c0007c10 comp rx=0 tx=0).stop 2023-09-13T06:06:22.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 -- 172.21.15.130:0/1105268725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c40ce1a0 msgr2=0x7fb8c4155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c40ce1a0 0x7fb8c4155980 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40af040 tx=0x7fb8b4019270 comp rx=0 tx=0).stop 2023-09-13T06:06:22.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 -- 172.21.15.130:0/1105268725 shutdown_connections 2023-09-13T06:06:22.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8a8065b20 0x7fb8a8067fe0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8c415d260 0x7fb8c40b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c40ce1a0 0x7fb8c4155980 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 --2- 172.21.15.130:0/1105268725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8c40afc70 0x7fb8c413fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 -- 172.21.15.130:0/1105268725 >> 172.21.15.130:0/1105268725 conn(0x7fb8c406a2f0 msgr2=0x7fb8c40cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:22.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 -- 172.21.15.130:0/1105268725 shutdown_connections 2023-09-13T06:06:22.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.785+0000 7fb8cc40b640 1 -- 172.21.15.130:0/1105268725 wait complete. 2023-09-13T06:06:22.805 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2023-09-13T06:06:22.599557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557090,"statfs":{"total":1600000000,"available":1594460633,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001034"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063481+0000","last_change":"2023-09-13T06:06:18.062659+0000","last_active":"2023-09-13T06:06:18.063481+0000","last_peered":"2023-09-13T06:06:18.063481+0000","last_clean":"2023-09-13T06:06:18.063481+0000","last_became_active":"2023-09-13T06:06:18.061829+0000","last_became_peered":"2023-09-13T06:06:18.061829+0000","last_unstale":"2023-09-13T06:06:18.063481+0000","last_undegraded":"2023-09-13T06:06:18.063481+0000","last_fullsized":"2023-09-13T06:06:18.063481+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:10.813353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063252+0000","last_change":"2023-09-13T06:06:18.063127+0000","last_active":"2023-09-13T06:06:18.063252+0000","last_peered":"2023-09-13T06:06:18.063252+0000","last_clean":"2023-09-13T06:06:18.063252+0000","last_became_active":"2023-09-13T06:06:18.062874+0000","last_became_peered":"2023-09-13T06:06:18.062874+0000","last_unstale":"2023-09-13T06:06:18.063252+0000","last_undegraded":"2023-09-13T06:06:18.063252+0000","last_fullsized":"2023-09-13T06:06:18.063252+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:20.025713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063226+0000","last_change":"2023-09-13T06:06:18.062727+0000","last_active":"2023-09-13T06:06:18.063226+0000","last_peered":"2023-09-13T06:06:18.063226+0000","last_clean":"2023-09-13T06:06:18.063226+0000","last_became_active":"2023-09-13T06:06:18.062497+0000","last_became_peered":"2023-09-13T06:06:18.062497+0000","last_unstale":"2023-09-13T06:06:18.063226+0000","last_undegraded":"2023-09-13T06:06:18.063226+0000","last_fullsized":"2023-09-13T06:06:18.063226+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:18:51.630143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062018+0000","last_change":"2023-09-13T06:06:18.060711+0000","last_active":"2023-09-13T06:06:18.062018+0000","last_peered":"2023-09-13T06:06:18.062018+0000","last_clean":"2023-09-13T06:06:18.062018+0000","last_became_active":"2023-09-13T06:06:18.059991+0000","last_became_peered":"2023-09-13T06:06:18.059991+0000","last_unstale":"2023-09-13T06:06:18.062018+0000","last_undegraded":"2023-09-13T06:06:18.062018+0000","last_fullsized":"2023-09-13T06:06:18.062018+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:00:58.922188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056786+0000","last_change":"2023-09-13T06:06:18.054259+0000","last_active":"2023-09-13T06:06:18.056786+0000","last_peered":"2023-09-13T06:06:18.056786+0000","last_clean":"2023-09-13T06:06:18.056786+0000","last_became_active":"2023-09-13T06:06:18.054039+0000","last_became_peered":"2023-09-13T06:06:18.054039+0000","last_unstale":"2023-09-13T06:06:18.056786+0000","last_undegraded":"2023-09-13T06:06:18.056786+0000","last_fullsized":"2023-09-13T06:06:18.056786+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:05.661998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.064800+0000","last_change":"2023-09-13T06:06:18.064729+0000","last_active":"2023-09-13T06:06:18.064800+0000","last_peered":"2023-09-13T06:06:18.064800+0000","last_clean":"2023-09-13T06:06:18.064800+0000","last_became_active":"2023-09-13T06:06:18.064294+0000","last_became_peered":"2023-09-13T06:06:18.064294+0000","last_unstale":"2023-09-13T06:06:18.064800+0000","last_undegraded":"2023-09-13T06:06:18.064800+0000","last_fullsized":"2023-09-13T06:06:18.064800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:59:44.004971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055747+0000","last_change":"2023-09-13T06:06:18.055649+0000","last_active":"2023-09-13T06:06:18.055747+0000","last_peered":"2023-09-13T06:06:18.055747+0000","last_clean":"2023-09-13T06:06:18.055747+0000","last_became_active":"2023-09-13T06:06:18.055433+0000","last_became_peered":"2023-09-13T06:06:18.055433+0000","last_unstale":"2023-09-13T06:06:18.055747+0000","last_undegraded":"2023-09-13T06:06:18.055747+0000","last_fullsized":"2023-09-13T06:06:18.055747+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:32:27.254317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.064311+0000","last_change":"2023-09-13T06:06:18.064201+0000","last_active":"2023-09-13T06:06:18.064311+0000","last_peered":"2023-09-13T06:06:18.064311+0000","last_clean":"2023-09-13T06:06:18.064311+0000","last_became_active":"2023-09-13T06:06:18.063944+0000","last_became_peered":"2023-09-13T06:06:18.063944+0000","last_unstale":"2023-09-13T06:06:18.064311+0000","last_undegraded":"2023-09-13T06:06:18.064311+0000","last_fullsized":"2023-09-13T06:06:18.064311+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:10.813353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062045+0000","last_change":"2023-09-13T06:06:18.061968+0000","last_active":"2023-09-13T06:06:18.062045+0000","last_peered":"2023-09-13T06:06:18.062045+0000","last_clean":"2023-09-13T06:06:18.062045+0000","last_became_active":"2023-09-13T06:06:18.061406+0000","last_became_peered":"2023-09-13T06:06:18.061406+0000","last_unstale":"2023-09-13T06:06:18.062045+0000","last_undegraded":"2023-09-13T06:06:18.062045+0000","last_fullsized":"2023-09-13T06:06:18.062045+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:46:57.534039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060981+0000","last_change":"2023-09-13T06:06:18.060385+0000","last_active":"2023-09-13T06:06:18.060981+0000","last_peered":"2023-09-13T06:06:18.060981+0000","last_clean":"2023-09-13T06:06:18.060981+0000","last_became_active":"2023-09-13T06:06:18.059740+0000","last_became_peered":"2023-09-13T06:06:18.059740+0000","last_unstale":"2023-09-13T06:06:18.060981+0000","last_undegraded":"2023-09-13T06:06:18.060981+0000","last_fullsized":"2023-09-13T06:06:18.060981+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:58:01.780195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.058201+0000","last_change":"2023-09-13T06:06:18.058002+0000","last_active":"2023-09-13T06:06:18.058201+0000","last_peered":"2023-09-13T06:06:18.058201+0000","last_clean":"2023-09-13T06:06:18.058201+0000","last_became_active":"2023-09-13T06:06:18.057612+0000","last_became_peered":"2023-09-13T06:06:18.057612+0000","last_unstale":"2023-09-13T06:06:18.058201+0000","last_undegraded":"2023-09-13T06:06:18.058201+0000","last_fullsized":"2023-09-13T06:06:18.058201+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:01:23.173166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063498+0000","last_change":"2023-09-13T06:06:18.063400+0000","last_active":"2023-09-13T06:06:18.063498+0000","last_peered":"2023-09-13T06:06:18.063498+0000","last_clean":"2023-09-13T06:06:18.063498+0000","last_became_active":"2023-09-13T06:06:18.063003+0000","last_became_peered":"2023-09-13T06:06:18.063003+0000","last_unstale":"2023-09-13T06:06:18.063498+0000","last_undegraded":"2023-09-13T06:06:18.063498+0000","last_fullsized":"2023-09-13T06:06:18.063498+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:10.371933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.050152+0000","last_change":"2023-09-13T06:06:18.050072+0000","last_active":"2023-09-13T06:06:18.050152+0000","last_peered":"2023-09-13T06:06:18.050152+0000","last_clean":"2023-09-13T06:06:18.050152+0000","last_became_active":"2023-09-13T06:06:18.049829+0000","last_became_peered":"2023-09-13T06:06:18.049829+0000","last_unstale":"2023-09-13T06:06:18.050152+0000","last_undegraded":"2023-09-13T06:06:18.050152+0000","last_fullsized":"2023-09-13T06:06:18.050152+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:25.816385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062002+0000","last_change":"2023-09-13T06:06:18.060580+0000","last_active":"2023-09-13T06:06:18.062002+0000","last_peered":"2023-09-13T06:06:18.062002+0000","last_clean":"2023-09-13T06:06:18.062002+0000","last_became_active":"2023-09-13T06:06:18.059600+0000","last_became_peered":"2023-09-13T06:06:18.059600+0000","last_unstale":"2023-09-13T06:06:18.062002+0000","last_undegraded":"2023-09-13T06:06:18.062002+0000","last_fullsized":"2023-09-13T06:06:18.062002+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:42:10.193900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055677+0000","last_change":"2023-09-13T06:06:18.055593+0000","last_active":"2023-09-13T06:06:18.055677+0000","last_peered":"2023-09-13T06:06:18.055677+0000","last_clean":"2023-09-13T06:06:18.055677+0000","last_became_active":"2023-09-13T06:06:18.055371+0000","last_became_peered":"2023-09-13T06:06:18.055371+0000","last_unstale":"2023-09-13T06:06:18.055677+0000","last_undegraded":"2023-09-13T06:06:18.055677+0000","last_fullsized":"2023-09-13T06:06:18.055677+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:19:53.027170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.059694+0000","last_change":"2023-09-13T06:06:18.059615+0000","last_active":"2023-09-13T06:06:18.059694+0000","last_peered":"2023-09-13T06:06:18.059694+0000","last_clean":"2023-09-13T06:06:18.059694+0000","last_became_active":"2023-09-13T06:06:18.059318+0000","last_became_peered":"2023-09-13T06:06:18.059318+0000","last_unstale":"2023-09-13T06:06:18.059694+0000","last_undegraded":"2023-09-13T06:06:18.059694+0000","last_fullsized":"2023-09-13T06:06:18.059694+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:10.371933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.051611+0000","last_change":"2023-09-13T06:06:18.051553+0000","last_active":"2023-09-13T06:06:18.051611+0000","last_peered":"2023-09-13T06:06:18.051611+0000","last_clean":"2023-09-13T06:06:18.051611+0000","last_became_active":"2023-09-13T06:06:18.051160+0000","last_became_peered":"2023-09-13T06:06:18.051160+0000","last_unstale":"2023-09-13T06:06:18.051611+0000","last_undegraded":"2023-09-13T06:06:18.051611+0000","last_fullsized":"2023-09-13T06:06:18.051611+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:43.124855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063111+0000","last_change":"2023-09-13T06:06:18.063045+0000","last_active":"2023-09-13T06:06:18.063111+0000","last_peered":"2023-09-13T06:06:18.063111+0000","last_clean":"2023-09-13T06:06:18.063111+0000","last_became_active":"2023-09-13T06:06:18.062815+0000","last_became_peered":"2023-09-13T06:06:18.062815+0000","last_unstale":"2023-09-13T06:06:18.063111+0000","last_undegraded":"2023-09-13T06:06:18.063111+0000","last_fullsized":"2023-09-13T06:06:18.063111+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:03:11.619284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.061782+0000","last_change":"2023-09-13T06:06:18.061436+0000","last_active":"2023-09-13T06:06:18.061782+0000","last_peered":"2023-09-13T06:06:18.061782+0000","last_clean":"2023-09-13T06:06:18.061782+0000","last_became_active":"2023-09-13T06:06:18.060484+0000","last_became_peered":"2023-09-13T06:06:18.060484+0000","last_unstale":"2023-09-13T06:06:18.061782+0000","last_undegraded":"2023-09-13T06:06:18.061782+0000","last_fullsized":"2023-09-13T06:06:18.061782+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:22:31.571804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.058120+0000","last_change":"2023-09-13T06:06:18.057828+0000","last_active":"2023-09-13T06:06:18.058120+0000","last_peered":"2023-09-13T06:06:18.058120+0000","last_clean":"2023-09-13T06:06:18.058120+0000","last_became_active":"2023-09-13T06:06:18.056758+0000","last_became_peered":"2023-09-13T06:06:18.056758+0000","last_unstale":"2023-09-13T06:06:18.058120+0000","last_undegraded":"2023-09-13T06:06:18.058120+0000","last_fullsized":"2023-09-13T06:06:18.058120+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:56:31.402208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055515+0000","last_change":"2023-09-13T06:06:18.055362+0000","last_active":"2023-09-13T06:06:18.055515+0000","last_peered":"2023-09-13T06:06:18.055515+0000","last_clean":"2023-09-13T06:06:18.055515+0000","last_became_active":"2023-09-13T06:06:18.054975+0000","last_became_peered":"2023-09-13T06:06:18.054975+0000","last_unstale":"2023-09-13T06:06:18.055515+0000","last_undegraded":"2023-09-13T06:06:18.055515+0000","last_fullsized":"2023-09-13T06:06:18.055515+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:03:27.518016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055939+0000","last_change":"2023-09-13T06:06:18.055875+0000","last_active":"2023-09-13T06:06:18.055939+0000","last_peered":"2023-09-13T06:06:18.055939+0000","last_clean":"2023-09-13T06:06:18.055939+0000","last_became_active":"2023-09-13T06:06:18.055638+0000","last_became_peered":"2023-09-13T06:06:18.055638+0000","last_unstale":"2023-09-13T06:06:18.055939+0000","last_undegraded":"2023-09-13T06:06:18.055939+0000","last_fullsized":"2023-09-13T06:06:18.055939+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:56.021848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.064003+0000","last_change":"2023-09-13T06:06:18.063917+0000","last_active":"2023-09-13T06:06:18.064003+0000","last_peered":"2023-09-13T06:06:18.064003+0000","last_clean":"2023-09-13T06:06:18.064003+0000","last_became_active":"2023-09-13T06:06:18.062380+0000","last_became_peered":"2023-09-13T06:06:18.062380+0000","last_unstale":"2023-09-13T06:06:18.064003+0000","last_undegraded":"2023-09-13T06:06:18.064003+0000","last_fullsized":"2023-09-13T06:06:18.064003+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:53:46.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.057045+0000","last_change":"2023-09-13T06:06:18.056263+0000","last_active":"2023-09-13T06:06:18.057045+0000","last_peered":"2023-09-13T06:06:18.057045+0000","last_clean":"2023-09-13T06:06:18.057045+0000","last_became_active":"2023-09-13T06:06:18.055998+0000","last_became_peered":"2023-09-13T06:06:18.055998+0000","last_unstale":"2023-09-13T06:06:18.057045+0000","last_undegraded":"2023-09-13T06:06:18.057045+0000","last_fullsized":"2023-09-13T06:06:18.057045+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:11:28.908490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060844+0000","last_change":"2023-09-13T06:06:18.060528+0000","last_active":"2023-09-13T06:06:18.060844+0000","last_peered":"2023-09-13T06:06:18.060844+0000","last_clean":"2023-09-13T06:06:18.060844+0000","last_became_active":"2023-09-13T06:06:18.059977+0000","last_became_peered":"2023-09-13T06:06:18.059977+0000","last_unstale":"2023-09-13T06:06:18.060844+0000","last_undegraded":"2023-09-13T06:06:18.060844+0000","last_fullsized":"2023-09-13T06:06:18.060844+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:55:12.697800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055363+0000","last_change":"2023-09-13T06:06:18.055216+0000","last_active":"2023-09-13T06:06:18.055363+0000","last_peered":"2023-09-13T06:06:18.055363+0000","last_clean":"2023-09-13T06:06:18.055363+0000","last_became_active":"2023-09-13T06:06:18.054987+0000","last_became_peered":"2023-09-13T06:06:18.054987+0000","last_unstale":"2023-09-13T06:06:18.055363+0000","last_undegraded":"2023-09-13T06:06:18.055363+0000","last_fullsized":"2023-09-13T06:06:18.055363+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:15:46.787976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.057441+0000","last_change":"2023-09-13T06:06:18.057330+0000","last_active":"2023-09-13T06:06:18.057441+0000","last_peered":"2023-09-13T06:06:18.057441+0000","last_clean":"2023-09-13T06:06:18.057441+0000","last_became_active":"2023-09-13T06:06:18.056821+0000","last_became_peered":"2023-09-13T06:06:18.056821+0000","last_unstale":"2023-09-13T06:06:18.057441+0000","last_undegraded":"2023-09-13T06:06:18.057441+0000","last_fullsized":"2023-09-13T06:06:18.057441+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:50:21.600983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063734+0000","last_change":"2023-09-13T06:06:18.063644+0000","last_active":"2023-09-13T06:06:18.063734+0000","last_peered":"2023-09-13T06:06:18.063734+0000","last_clean":"2023-09-13T06:06:18.063734+0000","last_became_active":"2023-09-13T06:06:18.062021+0000","last_became_peered":"2023-09-13T06:06:18.062021+0000","last_unstale":"2023-09-13T06:06:18.063734+0000","last_undegraded":"2023-09-13T06:06:18.063734+0000","last_fullsized":"2023-09-13T06:06:18.063734+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:18:58.091970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060810+0000","last_change":"2023-09-13T06:06:18.060233+0000","last_active":"2023-09-13T06:06:18.060810+0000","last_peered":"2023-09-13T06:06:18.060810+0000","last_clean":"2023-09-13T06:06:18.060810+0000","last_became_active":"2023-09-13T06:06:18.059797+0000","last_became_peered":"2023-09-13T06:06:18.059797+0000","last_unstale":"2023-09-13T06:06:18.060810+0000","last_undegraded":"2023-09-13T06:06:18.060810+0000","last_fullsized":"2023-09-13T06:06:18.060810+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:52:10.005262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060864+0000","last_change":"2023-09-13T06:06:18.060674+0000","last_active":"2023-09-13T06:06:18.060864+0000","last_peered":"2023-09-13T06:06:18.060864+0000","last_clean":"2023-09-13T06:06:18.060864+0000","last_became_active":"2023-09-13T06:06:18.060301+0000","last_became_peered":"2023-09-13T06:06:18.060301+0000","last_unstale":"2023-09-13T06:06:18.060864+0000","last_undegraded":"2023-09-13T06:06:18.060864+0000","last_fullsized":"2023-09-13T06:06:18.060864+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:36:08.876256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.053731+0000","last_change":"2023-09-13T06:06:18.053622+0000","last_active":"2023-09-13T06:06:18.053731+0000","last_peered":"2023-09-13T06:06:18.053731+0000","last_clean":"2023-09-13T06:06:18.053731+0000","last_became_active":"2023-09-13T06:06:18.053196+0000","last_became_peered":"2023-09-13T06:06:18.053196+0000","last_unstale":"2023-09-13T06:06:18.053731+0000","last_undegraded":"2023-09-13T06:06:18.053731+0000","last_fullsized":"2023-09-13T06:06:18.053731+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:05:09.646048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060963+0000","last_change":"2023-09-13T06:06:18.060246+0000","last_active":"2023-09-13T06:06:18.060963+0000","last_peered":"2023-09-13T06:06:18.060963+0000","last_clean":"2023-09-13T06:06:18.060963+0000","last_became_active":"2023-09-13T06:06:18.059919+0000","last_became_peered":"2023-09-13T06:06:18.059919+0000","last_unstale":"2023-09-13T06:06:18.060963+0000","last_undegraded":"2023-09-13T06:06:18.060963+0000","last_fullsized":"2023-09-13T06:06:18.060963+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:13:51.034064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062215+0000","last_change":"2023-09-13T06:06:18.062062+0000","last_active":"2023-09-13T06:06:18.062215+0000","last_peered":"2023-09-13T06:06:18.062215+0000","last_clean":"2023-09-13T06:06:18.062215+0000","last_became_active":"2023-09-13T06:06:18.061830+0000","last_became_peered":"2023-09-13T06:06:18.061830+0000","last_unstale":"2023-09-13T06:06:18.062215+0000","last_undegraded":"2023-09-13T06:06:18.062215+0000","last_fullsized":"2023-09-13T06:06:18.062215+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:53:46.406999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"101'4","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.371367+0000","last_change":"2023-09-13T06:06:17.059440+0000","last_active":"2023-09-13T06:06:18.371367+0000","last_peered":"2023-09-13T06:06:18.371367+0000","last_clean":"2023-09-13T06:06:18.371367+0000","last_became_active":"2023-09-13T06:06:17.058938+0000","last_became_peered":"2023-09-13T06:06:17.058938+0000","last_unstale":"2023-09-13T06:06:18.371367+0000","last_undegraded":"2023-09-13T06:06:18.371367+0000","last_fullsized":"2023-09-13T06:06:18.371367+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:34:50.211690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062360+0000","last_change":"2023-09-13T06:06:18.061754+0000","last_active":"2023-09-13T06:06:18.062360+0000","last_peered":"2023-09-13T06:06:18.062360+0000","last_clean":"2023-09-13T06:06:18.062360+0000","last_became_active":"2023-09-13T06:06:18.061106+0000","last_became_peered":"2023-09-13T06:06:18.061106+0000","last_unstale":"2023-09-13T06:06:18.062360+0000","last_undegraded":"2023-09-13T06:06:18.062360+0000","last_fullsized":"2023-09-13T06:06:18.062360+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:48.988716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"101'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.369679+0000","last_change":"2023-09-13T06:06:17.050475+0000","last_active":"2023-09-13T06:06:18.369679+0000","last_peered":"2023-09-13T06:06:18.369679+0000","last_clean":"2023-09-13T06:06:18.369679+0000","last_became_active":"2023-09-13T06:06:17.050232+0000","last_became_peered":"2023-09-13T06:06:17.050232+0000","last_unstale":"2023-09-13T06:06:18.369679+0000","last_undegraded":"2023-09-13T06:06:18.369679+0000","last_fullsized":"2023-09-13T06:06:18.369679+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:53:33.037700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062380+0000","last_change":"2023-09-13T06:06:18.062150+0000","last_active":"2023-09-13T06:06:18.062380+0000","last_peered":"2023-09-13T06:06:18.062380+0000","last_clean":"2023-09-13T06:06:18.062380+0000","last_became_active":"2023-09-13T06:06:18.061486+0000","last_became_peered":"2023-09-13T06:06:18.061486+0000","last_unstale":"2023-09-13T06:06:18.062380+0000","last_undegraded":"2023-09-13T06:06:18.062380+0000","last_fullsized":"2023-09-13T06:06:18.062380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:45:17.252173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.371150+0000","last_change":"2023-09-13T06:06:17.053581+0000","last_active":"2023-09-13T06:06:18.371150+0000","last_peered":"2023-09-13T06:06:18.371150+0000","last_clean":"2023-09-13T06:06:18.371150+0000","last_became_active":"2023-09-13T06:06:17.053332+0000","last_became_peered":"2023-09-13T06:06:17.053332+0000","last_unstale":"2023-09-13T06:06:18.371150+0000","last_undegraded":"2023-09-13T06:06:18.371150+0000","last_fullsized":"2023-09-13T06:06:18.371150+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:52:14.089111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.052733+0000","last_change":"2023-09-13T06:06:18.052516+0000","last_active":"2023-09-13T06:06:18.052733+0000","last_peered":"2023-09-13T06:06:18.052733+0000","last_clean":"2023-09-13T06:06:18.052733+0000","last_became_active":"2023-09-13T06:06:18.052276+0000","last_became_peered":"2023-09-13T06:06:18.052276+0000","last_unstale":"2023-09-13T06:06:18.052733+0000","last_undegraded":"2023-09-13T06:06:18.052733+0000","last_fullsized":"2023-09-13T06:06:18.052733+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:59:19.170791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.371621+0000","last_change":"2023-09-13T06:06:17.054484+0000","last_active":"2023-09-13T06:06:18.371621+0000","last_peered":"2023-09-13T06:06:18.371621+0000","last_clean":"2023-09-13T06:06:18.371621+0000","last_became_active":"2023-09-13T06:06:17.053894+0000","last_became_peered":"2023-09-13T06:06:17.053894+0000","last_unstale":"2023-09-13T06:06:18.371621+0000","last_undegraded":"2023-09-13T06:06:18.371621+0000","last_fullsized":"2023-09-13T06:06:18.371621+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:48:43.295068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060880+0000","last_change":"2023-09-13T06:06:18.060749+0000","last_active":"2023-09-13T06:06:18.060880+0000","last_peered":"2023-09-13T06:06:18.060880+0000","last_clean":"2023-09-13T06:06:18.060880+0000","last_became_active":"2023-09-13T06:06:18.060495+0000","last_became_peered":"2023-09-13T06:06:18.060495+0000","last_unstale":"2023-09-13T06:06:18.060880+0000","last_undegraded":"2023-09-13T06:06:18.060880+0000","last_fullsized":"2023-09-13T06:06:18.060880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:01:55.637429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"101'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.369082+0000","last_change":"2023-09-13T06:06:17.050630+0000","last_active":"2023-09-13T06:06:18.369082+0000","last_peered":"2023-09-13T06:06:18.369082+0000","last_clean":"2023-09-13T06:06:18.369082+0000","last_became_active":"2023-09-13T06:06:17.050401+0000","last_became_peered":"2023-09-13T06:06:17.050401+0000","last_unstale":"2023-09-13T06:06:18.369082+0000","last_undegraded":"2023-09-13T06:06:18.369082+0000","last_fullsized":"2023-09-13T06:06:18.369082+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:33:49.270394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.051470+0000","last_change":"2023-09-13T06:06:18.051397+0000","last_active":"2023-09-13T06:06:18.051470+0000","last_peered":"2023-09-13T06:06:18.051470+0000","last_clean":"2023-09-13T06:06:18.051470+0000","last_became_active":"2023-09-13T06:06:18.050829+0000","last_became_peered":"2023-09-13T06:06:18.050829+0000","last_unstale":"2023-09-13T06:06:18.051470+0000","last_undegraded":"2023-09-13T06:06:18.051470+0000","last_fullsized":"2023-09-13T06:06:18.051470+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:19:54.833147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"101'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.368936+0000","last_change":"2023-09-13T06:06:17.052802+0000","last_active":"2023-09-13T06:06:18.368936+0000","last_peered":"2023-09-13T06:06:18.368936+0000","last_clean":"2023-09-13T06:06:18.368936+0000","last_became_active":"2023-09-13T06:06:17.052406+0000","last_became_peered":"2023-09-13T06:06:17.052406+0000","last_unstale":"2023-09-13T06:06:18.368936+0000","last_undegraded":"2023-09-13T06:06:18.368936+0000","last_fullsized":"2023-09-13T06:06:18.368936+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:48.408244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056633+0000","last_change":"2023-09-13T06:06:18.056449+0000","last_active":"2023-09-13T06:06:18.056633+0000","last_peered":"2023-09-13T06:06:18.056633+0000","last_clean":"2023-09-13T06:06:18.056633+0000","last_became_active":"2023-09-13T06:06:18.055686+0000","last_became_peered":"2023-09-13T06:06:18.055686+0000","last_unstale":"2023-09-13T06:06:18.056633+0000","last_undegraded":"2023-09-13T06:06:18.056633+0000","last_fullsized":"2023-09-13T06:06:18.056633+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:16:54.176283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.051476+0000","last_change":"2023-09-13T06:06:17.058153+0000","last_active":"2023-09-13T06:06:18.051476+0000","last_peered":"2023-09-13T06:06:18.051476+0000","last_clean":"2023-09-13T06:06:18.051476+0000","last_became_active":"2023-09-13T06:06:17.057926+0000","last_became_peered":"2023-09-13T06:06:17.057926+0000","last_unstale":"2023-09-13T06:06:18.051476+0000","last_undegraded":"2023-09-13T06:06:18.051476+0000","last_fullsized":"2023-09-13T06:06:18.051476+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:00:29.343291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055251+0000","last_change":"2023-09-13T06:06:18.054818+0000","last_active":"2023-09-13T06:06:18.055251+0000","last_peered":"2023-09-13T06:06:18.055251+0000","last_clean":"2023-09-13T06:06:18.055251+0000","last_became_active":"2023-09-13T06:06:18.054541+0000","last_became_peered":"2023-09-13T06:06:18.054541+0000","last_unstale":"2023-09-13T06:06:18.055251+0000","last_undegraded":"2023-09-13T06:06:18.055251+0000","last_fullsized":"2023-09-13T06:06:18.055251+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:57.742026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.054008+0000","last_change":"2023-09-13T06:06:17.054352+0000","last_active":"2023-09-13T06:06:18.054008+0000","last_peered":"2023-09-13T06:06:18.054008+0000","last_clean":"2023-09-13T06:06:18.054008+0000","last_became_active":"2023-09-13T06:06:17.053763+0000","last_became_peered":"2023-09-13T06:06:17.053763+0000","last_unstale":"2023-09-13T06:06:18.054008+0000","last_undegraded":"2023-09-13T06:06:18.054008+0000","last_fullsized":"2023-09-13T06:06:18.054008+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:28:02.392833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056175+0000","last_change":"2023-09-13T06:06:18.056114+0000","last_active":"2023-09-13T06:06:18.056175+0000","last_peered":"2023-09-13T06:06:18.056175+0000","last_clean":"2023-09-13T06:06:18.056175+0000","last_became_active":"2023-09-13T06:06:18.055899+0000","last_became_peered":"2023-09-13T06:06:18.055899+0000","last_unstale":"2023-09-13T06:06:18.056175+0000","last_undegraded":"2023-09-13T06:06:18.056175+0000","last_fullsized":"2023-09-13T06:06:18.056175+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:55.805689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.055769+0000","last_change":"2023-09-13T06:06:17.056167+0000","last_active":"2023-09-13T06:06:18.055769+0000","last_peered":"2023-09-13T06:06:18.055769+0000","last_clean":"2023-09-13T06:06:18.055769+0000","last_became_active":"2023-09-13T06:06:17.055903+0000","last_became_peered":"2023-09-13T06:06:17.055903+0000","last_unstale":"2023-09-13T06:06:18.055769+0000","last_undegraded":"2023-09-13T06:06:18.055769+0000","last_fullsized":"2023-09-13T06:06:18.055769+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:46:56.525132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.064635+0000","last_change":"2023-09-13T06:06:18.064538+0000","last_active":"2023-09-13T06:06:18.064635+0000","last_peered":"2023-09-13T06:06:18.064635+0000","last_clean":"2023-09-13T06:06:18.064635+0000","last_became_active":"2023-09-13T06:06:18.063959+0000","last_became_peered":"2023-09-13T06:06:18.063959+0000","last_unstale":"2023-09-13T06:06:18.064635+0000","last_undegraded":"2023-09-13T06:06:18.064635+0000","last_fullsized":"2023-09-13T06:06:18.064635+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:45:17.252173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056564+0000","last_change":"2023-09-13T06:06:17.057632+0000","last_active":"2023-09-13T06:06:18.056564+0000","last_peered":"2023-09-13T06:06:18.056564+0000","last_clean":"2023-09-13T06:06:18.056564+0000","last_became_active":"2023-09-13T06:06:17.057312+0000","last_became_peered":"2023-09-13T06:06:17.057312+0000","last_unstale":"2023-09-13T06:06:18.056564+0000","last_undegraded":"2023-09-13T06:06:18.056564+0000","last_fullsized":"2023-09-13T06:06:18.056564+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:04.653091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.061800+0000","last_change":"2023-09-13T06:06:18.061633+0000","last_active":"2023-09-13T06:06:18.061800+0000","last_peered":"2023-09-13T06:06:18.061800+0000","last_clean":"2023-09-13T06:06:18.061800+0000","last_became_active":"2023-09-13T06:06:18.061216+0000","last_became_peered":"2023-09-13T06:06:18.061216+0000","last_unstale":"2023-09-13T06:06:18.061800+0000","last_undegraded":"2023-09-13T06:06:18.061800+0000","last_fullsized":"2023-09-13T06:06:18.061800+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:56:50.524977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"101'3","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.370335+0000","last_change":"2023-09-13T06:06:17.059158+0000","last_active":"2023-09-13T06:06:18.370335+0000","last_peered":"2023-09-13T06:06:18.370335+0000","last_clean":"2023-09-13T06:06:18.370335+0000","last_became_active":"2023-09-13T06:06:17.056292+0000","last_became_peered":"2023-09-13T06:06:17.056292+0000","last_unstale":"2023-09-13T06:06:18.370335+0000","last_undegraded":"2023-09-13T06:06:18.370335+0000","last_fullsized":"2023-09-13T06:06:18.370335+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:22.943817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.052882+0000","last_change":"2023-09-13T06:06:18.052312+0000","last_active":"2023-09-13T06:06:18.052882+0000","last_peered":"2023-09-13T06:06:18.052882+0000","last_clean":"2023-09-13T06:06:18.052882+0000","last_became_active":"2023-09-13T06:06:18.052041+0000","last_became_peered":"2023-09-13T06:06:18.052041+0000","last_unstale":"2023-09-13T06:06:18.052882+0000","last_undegraded":"2023-09-13T06:06:18.052882+0000","last_fullsized":"2023-09-13T06:06:18.052882+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:42:17.342534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"101'6","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.372155+0000","last_change":"2023-09-13T06:06:17.056318+0000","last_active":"2023-09-13T06:06:18.372155+0000","last_peered":"2023-09-13T06:06:18.372155+0000","last_clean":"2023-09-13T06:06:18.372155+0000","last_became_active":"2023-09-13T06:06:17.055859+0000","last_became_peered":"2023-09-13T06:06:17.055859+0000","last_unstale":"2023-09-13T06:06:18.372155+0000","last_undegraded":"2023-09-13T06:06:18.372155+0000","last_fullsized":"2023-09-13T06:06:18.372155+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:09.363026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060660+0000","last_change":"2023-09-13T06:06:18.060593+0000","last_active":"2023-09-13T06:06:18.060660+0000","last_peered":"2023-09-13T06:06:18.060660+0000","last_clean":"2023-09-13T06:06:18.060660+0000","last_became_active":"2023-09-13T06:06:18.057843+0000","last_became_peered":"2023-09-13T06:06:18.057843+0000","last_unstale":"2023-09-13T06:06:18.060660+0000","last_undegraded":"2023-09-13T06:06:18.060660+0000","last_fullsized":"2023-09-13T06:06:18.060660+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:47:49.294562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.372008+0000","last_change":"2023-09-13T06:06:17.054215+0000","last_active":"2023-09-13T06:06:18.372008+0000","last_peered":"2023-09-13T06:06:18.372008+0000","last_clean":"2023-09-13T06:06:18.372008+0000","last_became_active":"2023-09-13T06:06:17.053422+0000","last_became_peered":"2023-09-13T06:06:17.053422+0000","last_unstale":"2023-09-13T06:06:18.372008+0000","last_undegraded":"2023-09-13T06:06:18.372008+0000","last_fullsized":"2023-09-13T06:06:18.372008+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:48:59.525963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056685+0000","last_change":"2023-09-13T06:06:18.056596+0000","last_active":"2023-09-13T06:06:18.056685+0000","last_peered":"2023-09-13T06:06:18.056685+0000","last_clean":"2023-09-13T06:06:18.056685+0000","last_became_active":"2023-09-13T06:06:18.056075+0000","last_became_peered":"2023-09-13T06:06:18.056075+0000","last_unstale":"2023-09-13T06:06:18.056685+0000","last_undegraded":"2023-09-13T06:06:18.056685+0000","last_fullsized":"2023-09-13T06:06:18.056685+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:14:41.496676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.052928+0000","last_change":"2023-09-13T06:06:17.055189+0000","last_active":"2023-09-13T06:06:18.052928+0000","last_peered":"2023-09-13T06:06:18.052928+0000","last_clean":"2023-09-13T06:06:18.052928+0000","last_became_active":"2023-09-13T06:06:17.054959+0000","last_became_peered":"2023-09-13T06:06:17.054959+0000","last_unstale":"2023-09-13T06:06:18.052928+0000","last_undegraded":"2023-09-13T06:06:18.052928+0000","last_fullsized":"2023-09-13T06:06:18.052928+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:36.726560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.058142+0000","last_change":"2023-09-13T06:06:18.057276+0000","last_active":"2023-09-13T06:06:18.058142+0000","last_peered":"2023-09-13T06:06:18.058142+0000","last_clean":"2023-09-13T06:06:18.058142+0000","last_became_active":"2023-09-13T06:06:18.057047+0000","last_became_peered":"2023-09-13T06:06:18.057047+0000","last_unstale":"2023-09-13T06:06:18.058142+0000","last_undegraded":"2023-09-13T06:06:18.058142+0000","last_fullsized":"2023-09-13T06:06:18.058142+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:05:30.772913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.057400+0000","last_change":"2023-09-13T06:06:17.057382+0000","last_active":"2023-09-13T06:06:18.057400+0000","last_peered":"2023-09-13T06:06:18.057400+0000","last_clean":"2023-09-13T06:06:18.057400+0000","last_became_active":"2023-09-13T06:06:17.057167+0000","last_became_peered":"2023-09-13T06:06:17.057167+0000","last_unstale":"2023-09-13T06:06:18.057400+0000","last_undegraded":"2023-09-13T06:06:18.057400+0000","last_fullsized":"2023-09-13T06:06:18.057400+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:58:00.771288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.061796+0000","last_change":"2023-09-13T06:06:18.061659+0000","last_active":"2023-09-13T06:06:18.061796+0000","last_peered":"2023-09-13T06:06:18.061796+0000","last_clean":"2023-09-13T06:06:18.061796+0000","last_became_active":"2023-09-13T06:06:18.061430+0000","last_became_peered":"2023-09-13T06:06:18.061430+0000","last_unstale":"2023-09-13T06:06:18.061796+0000","last_undegraded":"2023-09-13T06:06:18.061796+0000","last_fullsized":"2023-09-13T06:06:18.061796+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:54:48.412793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"101'8","reported_seq":19,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.372163+0000","last_change":"2023-09-13T06:06:17.051424+0000","last_active":"2023-09-13T06:06:18.372163+0000","last_peered":"2023-09-13T06:06:18.372163+0000","last_clean":"2023-09-13T06:06:18.372163+0000","last_became_active":"2023-09-13T06:06:17.050544+0000","last_became_peered":"2023-09-13T06:06:17.050544+0000","last_unstale":"2023-09-13T06:06:18.372163+0000","last_undegraded":"2023-09-13T06:06:18.372163+0000","last_fullsized":"2023-09-13T06:06:18.372163+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:17:49.298252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063306+0000","last_change":"2023-09-13T06:06:18.063214+0000","last_active":"2023-09-13T06:06:18.063306+0000","last_peered":"2023-09-13T06:06:18.063306+0000","last_clean":"2023-09-13T06:06:18.063306+0000","last_became_active":"2023-09-13T06:06:18.062938+0000","last_became_peered":"2023-09-13T06:06:18.062938+0000","last_unstale":"2023-09-13T06:06:18.063306+0000","last_undegraded":"2023-09-13T06:06:18.063306+0000","last_fullsized":"2023-09-13T06:06:18.063306+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:01:03.615177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"101'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.368198+0000","last_change":"2023-09-13T06:06:17.058384+0000","last_active":"2023-09-13T06:06:18.368198+0000","last_peered":"2023-09-13T06:06:18.368198+0000","last_clean":"2023-09-13T06:06:18.368198+0000","last_became_active":"2023-09-13T06:06:17.057990+0000","last_became_peered":"2023-09-13T06:06:17.057990+0000","last_unstale":"2023-09-13T06:06:18.368198+0000","last_undegraded":"2023-09-13T06:06:18.368198+0000","last_fullsized":"2023-09-13T06:06:18.368198+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:52:42.115948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060208+0000","last_change":"2023-09-13T06:06:18.059328+0000","last_active":"2023-09-13T06:06:18.060208+0000","last_peered":"2023-09-13T06:06:18.060208+0000","last_clean":"2023-09-13T06:06:18.060208+0000","last_became_active":"2023-09-13T06:06:18.058876+0000","last_became_peered":"2023-09-13T06:06:18.058876+0000","last_unstale":"2023-09-13T06:06:18.060208+0000","last_undegraded":"2023-09-13T06:06:18.060208+0000","last_fullsized":"2023-09-13T06:06:18.060208+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:13:28.156878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.371821+0000","last_change":"2023-09-13T06:06:17.052314+0000","last_active":"2023-09-13T06:06:18.371821+0000","last_peered":"2023-09-13T06:06:18.371821+0000","last_clean":"2023-09-13T06:06:18.371821+0000","last_became_active":"2023-09-13T06:06:17.052080+0000","last_became_peered":"2023-09-13T06:06:17.052080+0000","last_unstale":"2023-09-13T06:06:18.371821+0000","last_undegraded":"2023-09-13T06:06:18.371821+0000","last_fullsized":"2023-09-13T06:06:18.371821+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:29:23.794752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056769+0000","last_change":"2023-09-13T06:06:18.054223+0000","last_active":"2023-09-13T06:06:18.056769+0000","last_peered":"2023-09-13T06:06:18.056769+0000","last_clean":"2023-09-13T06:06:18.056769+0000","last_became_active":"2023-09-13T06:06:18.053942+0000","last_became_peered":"2023-09-13T06:06:18.053942+0000","last_unstale":"2023-09-13T06:06:18.056769+0000","last_undegraded":"2023-09-13T06:06:18.056769+0000","last_fullsized":"2023-09-13T06:06:18.056769+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:35:09.588116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.049904+0000","last_change":"2023-09-13T06:06:17.058073+0000","last_active":"2023-09-13T06:06:18.049904+0000","last_peered":"2023-09-13T06:06:18.049904+0000","last_clean":"2023-09-13T06:06:18.049904+0000","last_became_active":"2023-09-13T06:06:17.057844+0000","last_became_peered":"2023-09-13T06:06:17.057844+0000","last_unstale":"2023-09-13T06:06:18.049904+0000","last_undegraded":"2023-09-13T06:06:18.049904+0000","last_fullsized":"2023-09-13T06:06:18.049904+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:17:16.331315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062033+0000","last_change":"2023-09-13T06:06:18.060877+0000","last_active":"2023-09-13T06:06:18.062033+0000","last_peered":"2023-09-13T06:06:18.062033+0000","last_clean":"2023-09-13T06:06:18.062033+0000","last_became_active":"2023-09-13T06:06:18.060339+0000","last_became_peered":"2023-09-13T06:06:18.060339+0000","last_unstale":"2023-09-13T06:06:18.062033+0000","last_undegraded":"2023-09-13T06:06:18.062033+0000","last_fullsized":"2023-09-13T06:06:18.062033+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:24:19.186610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.370264+0000","last_change":"2023-09-13T06:06:17.057504+0000","last_active":"2023-09-13T06:06:18.370264+0000","last_peered":"2023-09-13T06:06:18.370264+0000","last_clean":"2023-09-13T06:06:18.370264+0000","last_became_active":"2023-09-13T06:06:17.057276+0000","last_became_peered":"2023-09-13T06:06:17.057276+0000","last_unstale":"2023-09-13T06:06:18.370264+0000","last_undegraded":"2023-09-13T06:06:18.370264+0000","last_fullsized":"2023-09-13T06:06:18.370264+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:25:28.957256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.059012+0000","last_change":"2023-09-13T06:06:18.058880+0000","last_active":"2023-09-13T06:06:18.059012+0000","last_peered":"2023-09-13T06:06:18.059012+0000","last_clean":"2023-09-13T06:06:18.059012+0000","last_became_active":"2023-09-13T06:06:18.058611+0000","last_became_peered":"2023-09-13T06:06:18.058611+0000","last_unstale":"2023-09-13T06:06:18.059012+0000","last_undegraded":"2023-09-13T06:06:18.059012+0000","last_fullsized":"2023-09-13T06:06:18.059012+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:18:58.091970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.049926+0000","last_change":"2023-09-13T06:06:17.051897+0000","last_active":"2023-09-13T06:06:18.049926+0000","last_peered":"2023-09-13T06:06:18.049926+0000","last_clean":"2023-09-13T06:06:18.049926+0000","last_became_active":"2023-09-13T06:06:17.051672+0000","last_became_peered":"2023-09-13T06:06:17.051672+0000","last_unstale":"2023-09-13T06:06:18.049926+0000","last_undegraded":"2023-09-13T06:06:18.049926+0000","last_fullsized":"2023-09-13T06:06:18.049926+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:29.100478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062056+0000","last_change":"2023-09-13T06:06:18.061923+0000","last_active":"2023-09-13T06:06:18.062056+0000","last_peered":"2023-09-13T06:06:18.062056+0000","last_clean":"2023-09-13T06:06:18.062056+0000","last_became_active":"2023-09-13T06:06:18.061688+0000","last_became_peered":"2023-09-13T06:06:18.061688+0000","last_unstale":"2023-09-13T06:06:18.062056+0000","last_undegraded":"2023-09-13T06:06:18.062056+0000","last_fullsized":"2023-09-13T06:06:18.062056+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:06:15.097483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.048977+0000","last_change":"2023-09-13T06:06:17.057670+0000","last_active":"2023-09-13T06:06:18.048977+0000","last_peered":"2023-09-13T06:06:18.048977+0000","last_clean":"2023-09-13T06:06:18.048977+0000","last_became_active":"2023-09-13T06:06:17.057167+0000","last_became_peered":"2023-09-13T06:06:17.057167+0000","last_unstale":"2023-09-13T06:06:18.048977+0000","last_undegraded":"2023-09-13T06:06:18.048977+0000","last_fullsized":"2023-09-13T06:06:18.048977+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:34:07.206469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.059739+0000","last_change":"2023-09-13T06:06:18.059666+0000","last_active":"2023-09-13T06:06:18.059739+0000","last_peered":"2023-09-13T06:06:18.059739+0000","last_clean":"2023-09-13T06:06:18.059739+0000","last_became_active":"2023-09-13T06:06:18.059406+0000","last_became_peered":"2023-09-13T06:06:18.059406+0000","last_unstale":"2023-09-13T06:06:18.059739+0000","last_undegraded":"2023-09-13T06:06:18.059739+0000","last_fullsized":"2023-09-13T06:06:18.059739+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:13:28.156878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.053057+0000","last_change":"2023-09-13T06:06:17.058325+0000","last_active":"2023-09-13T06:06:18.053057+0000","last_peered":"2023-09-13T06:06:18.053057+0000","last_clean":"2023-09-13T06:06:18.053057+0000","last_became_active":"2023-09-13T06:06:17.057853+0000","last_became_peered":"2023-09-13T06:06:17.057853+0000","last_unstale":"2023-09-13T06:06:18.053057+0000","last_undegraded":"2023-09-13T06:06:18.053057+0000","last_fullsized":"2023-09-13T06:06:18.053057+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:57:37.986408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060929+0000","last_change":"2023-09-13T06:06:18.060792+0000","last_active":"2023-09-13T06:06:18.060929+0000","last_peered":"2023-09-13T06:06:18.060929+0000","last_clean":"2023-09-13T06:06:18.060929+0000","last_became_active":"2023-09-13T06:06:18.060525+0000","last_became_peered":"2023-09-13T06:06:18.060525+0000","last_unstale":"2023-09-13T06:06:18.060929+0000","last_undegraded":"2023-09-13T06:06:18.060929+0000","last_fullsized":"2023-09-13T06:06:18.060929+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:34:51.220597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"101'2","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.371016+0000","last_change":"2023-09-13T06:06:17.052625+0000","last_active":"2023-09-13T06:06:18.371016+0000","last_peered":"2023-09-13T06:06:18.371016+0000","last_clean":"2023-09-13T06:06:18.371016+0000","last_became_active":"2023-09-13T06:06:17.052404+0000","last_became_peered":"2023-09-13T06:06:17.052404+0000","last_unstale":"2023-09-13T06:06:18.371016+0000","last_undegraded":"2023-09-13T06:06:18.371016+0000","last_fullsized":"2023-09-13T06:06:18.371016+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:53:43.240890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.062196+0000","last_change":"2023-09-13T06:06:18.061251+0000","last_active":"2023-09-13T06:06:18.062196+0000","last_peered":"2023-09-13T06:06:18.062196+0000","last_clean":"2023-09-13T06:06:18.062196+0000","last_became_active":"2023-09-13T06:06:18.061025+0000","last_became_peered":"2023-09-13T06:06:18.061025+0000","last_unstale":"2023-09-13T06:06:18.062196+0000","last_undegraded":"2023-09-13T06:06:18.062196+0000","last_fullsized":"2023-09-13T06:06:18.062196+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:28:15.406196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.054868+0000","last_change":"2023-09-13T06:06:17.052035+0000","last_active":"2023-09-13T06:06:18.054868+0000","last_peered":"2023-09-13T06:06:18.054868+0000","last_clean":"2023-09-13T06:06:18.054868+0000","last_became_active":"2023-09-13T06:06:17.051777+0000","last_became_peered":"2023-09-13T06:06:17.051777+0000","last_unstale":"2023-09-13T06:06:18.054868+0000","last_undegraded":"2023-09-13T06:06:18.054868+0000","last_fullsized":"2023-09-13T06:06:18.054868+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:21:59.102968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060996+0000","last_change":"2023-09-13T06:06:18.060585+0000","last_active":"2023-09-13T06:06:18.060996+0000","last_peered":"2023-09-13T06:06:18.060996+0000","last_clean":"2023-09-13T06:06:18.060996+0000","last_became_active":"2023-09-13T06:06:18.060104+0000","last_became_peered":"2023-09-13T06:06:18.060104+0000","last_unstale":"2023-09-13T06:06:18.060996+0000","last_undegraded":"2023-09-13T06:06:18.060996+0000","last_fullsized":"2023-09-13T06:06:18.060996+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:59:44.004971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.057878+0000","last_change":"2023-09-13T06:06:17.056353+0000","last_active":"2023-09-13T06:06:18.057878+0000","last_peered":"2023-09-13T06:06:18.057878+0000","last_clean":"2023-09-13T06:06:18.057878+0000","last_became_active":"2023-09-13T06:06:17.056115+0000","last_became_peered":"2023-09-13T06:06:17.056115+0000","last_unstale":"2023-09-13T06:06:18.057878+0000","last_undegraded":"2023-09-13T06:06:18.057878+0000","last_fullsized":"2023-09-13T06:06:18.057878+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:05:08.637141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.052911+0000","last_change":"2023-09-13T06:06:18.052597+0000","last_active":"2023-09-13T06:06:18.052911+0000","last_peered":"2023-09-13T06:06:18.052911+0000","last_clean":"2023-09-13T06:06:18.052911+0000","last_became_active":"2023-09-13T06:06:18.052367+0000","last_became_peered":"2023-09-13T06:06:18.052367+0000","last_unstale":"2023-09-13T06:06:18.052911+0000","last_undegraded":"2023-09-13T06:06:18.052911+0000","last_fullsized":"2023-09-13T06:06:18.052911+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:23.952724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.056257+0000","last_change":"2023-09-13T06:06:17.058551+0000","last_active":"2023-09-13T06:06:18.056257+0000","last_peered":"2023-09-13T06:06:18.056257+0000","last_clean":"2023-09-13T06:06:18.056257+0000","last_became_active":"2023-09-13T06:06:17.056455+0000","last_became_peered":"2023-09-13T06:06:17.056455+0000","last_unstale":"2023-09-13T06:06:18.056257+0000","last_undegraded":"2023-09-13T06:06:18.056257+0000","last_fullsized":"2023-09-13T06:06:18.056257+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:42:16.333627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063539+0000","last_change":"2023-09-13T06:06:18.063340+0000","last_active":"2023-09-13T06:06:18.063539+0000","last_peered":"2023-09-13T06:06:18.063539+0000","last_clean":"2023-09-13T06:06:18.063539+0000","last_became_active":"2023-09-13T06:06:18.062281+0000","last_became_peered":"2023-09-13T06:06:18.062281+0000","last_unstale":"2023-09-13T06:06:18.063539+0000","last_undegraded":"2023-09-13T06:06:18.063539+0000","last_fullsized":"2023-09-13T06:06:18.063539+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:48.988716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.051780+0000","last_change":"2023-09-13T06:06:17.054633+0000","last_active":"2023-09-13T06:06:18.051780+0000","last_peered":"2023-09-13T06:06:18.051780+0000","last_clean":"2023-09-13T06:06:18.051780+0000","last_became_active":"2023-09-13T06:06:17.054239+0000","last_became_peered":"2023-09-13T06:06:17.054239+0000","last_unstale":"2023-09-13T06:06:18.051780+0000","last_undegraded":"2023-09-13T06:06:18.051780+0000","last_fullsized":"2023-09-13T06:06:18.051780+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:23:08.656035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060791+0000","last_change":"2023-09-13T06:06:18.060729+0000","last_active":"2023-09-13T06:06:18.060791+0000","last_peered":"2023-09-13T06:06:18.060791+0000","last_clean":"2023-09-13T06:06:18.060791+0000","last_became_active":"2023-09-13T06:06:18.060179+0000","last_became_peered":"2023-09-13T06:06:18.060179+0000","last_unstale":"2023-09-13T06:06:18.060791+0000","last_undegraded":"2023-09-13T06:06:18.060791+0000","last_fullsized":"2023-09-13T06:06:18.060791+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:15:58.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.047612+0000","last_change":"2023-09-13T06:06:17.051094+0000","last_active":"2023-09-13T06:06:18.047612+0000","last_peered":"2023-09-13T06:06:18.047612+0000","last_clean":"2023-09-13T06:06:18.047612+0000","last_became_active":"2023-09-13T06:06:17.050858+0000","last_became_peered":"2023-09-13T06:06:17.050858+0000","last_unstale":"2023-09-13T06:06:18.047612+0000","last_undegraded":"2023-09-13T06:06:18.047612+0000","last_fullsized":"2023-09-13T06:06:18.047612+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:52:18.008973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.059246+0000","last_change":"2023-09-13T06:06:18.059054+0000","last_active":"2023-09-13T06:06:18.059246+0000","last_peered":"2023-09-13T06:06:18.059246+0000","last_clean":"2023-09-13T06:06:18.059246+0000","last_became_active":"2023-09-13T06:06:18.058783+0000","last_became_peered":"2023-09-13T06:06:18.058783+0000","last_unstale":"2023-09-13T06:06:18.059246+0000","last_undegraded":"2023-09-13T06:06:18.059246+0000","last_fullsized":"2023-09-13T06:06:18.059246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:44:03.002500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.060766+0000","last_change":"2023-09-13T06:06:17.059338+0000","last_active":"2023-09-13T06:06:18.060766+0000","last_peered":"2023-09-13T06:06:18.060766+0000","last_clean":"2023-09-13T06:06:18.060766+0000","last_became_active":"2023-09-13T06:06:17.058656+0000","last_became_peered":"2023-09-13T06:06:17.058656+0000","last_unstale":"2023-09-13T06:06:18.060766+0000","last_undegraded":"2023-09-13T06:06:18.060766+0000","last_fullsized":"2023-09-13T06:06:18.060766+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:48.408244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.063461+0000","last_change":"2023-09-13T06:06:18.062635+0000","last_active":"2023-09-13T06:06:18.063461+0000","last_peered":"2023-09-13T06:06:18.063461+0000","last_clean":"2023-09-13T06:06:18.063461+0000","last_became_active":"2023-09-13T06:06:18.061508+0000","last_became_peered":"2023-09-13T06:06:18.061508+0000","last_unstale":"2023-09-13T06:06:18.063461+0000","last_undegraded":"2023-09-13T06:06:18.063461+0000","last_fullsized":"2023-09-13T06:06:18.063461+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:29:34.174674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.047108+0000","last_change":"2023-09-13T06:06:17.057224+0000","last_active":"2023-09-13T06:06:18.047108+0000","last_peered":"2023-09-13T06:06:18.047108+0000","last_clean":"2023-09-13T06:06:18.047108+0000","last_became_active":"2023-09-13T06:06:17.056989+0000","last_became_peered":"2023-09-13T06:06:17.056989+0000","last_unstale":"2023-09-13T06:06:18.047108+0000","last_undegraded":"2023-09-13T06:06:18.047108+0000","last_fullsized":"2023-09-13T06:06:18.047108+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:11:50.227377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.059667+0000","last_change":"2023-09-13T06:06:18.059379+0000","last_active":"2023-09-13T06:06:18.059667+0000","last_peered":"2023-09-13T06:06:18.059667+0000","last_clean":"2023-09-13T06:06:18.059667+0000","last_became_active":"2023-09-13T06:06:18.059170+0000","last_became_peered":"2023-09-13T06:06:18.059170+0000","last_unstale":"2023-09-13T06:06:18.059667+0000","last_undegraded":"2023-09-13T06:06:18.059667+0000","last_fullsized":"2023-09-13T06:06:18.059667+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:17.034355+0000","last_clean_scrub_stamp":"2023-09-13T06:06:17.034355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:13:09.824943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"101'1","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-09-13T06:06:18.368252+0000","last_change":"2023-09-13T06:06:17.054073+0000","last_active":"2023-09-13T06:06:18.368252+0000","last_peered":"2023-09-13T06:06:18.368252+0000","last_clean":"2023-09-13T06:06:18.368252+0000","last_became_active":"2023-09-13T06:06:17.053841+0000","last_became_peered":"2023-09-13T06:06:17.053841+0000","last_unstale":"2023-09-13T06:06:18.368252+0000","last_undegraded":"2023-09-13T06:06:18.368252+0000","last_fullsized":"2023-09-13T06:06:18.368252+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:06:16.025448+0000","last_clean_scrub_stamp":"2023-09-13T06:06:16.025448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:16:47.406138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":255,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-09-13T06:06:17.047051+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:06:17.047051+0000","last_peered":"2023-09-13T06:06:17.047051+0000","last_clean":"2023-09-13T06:06:17.047051+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:06:17.047051+0000","last_undegraded":"2023-09-13T06:06:17.047051+0000","last_fullsized":"2023-09-13T06:06:17.047051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:47.497288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194206,"statfs":{"total":200000000,"available":198867348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.58599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98799999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.57399999999999995,"5min":0.375,"15min":0.375},"max":{"1min":0.91100000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61299999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.53100000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.60699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94099999999999995,"5min":1.05,"15min":1.05},"last":0.69999999999999996}]},{"osd":2,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.59599999999999997,"5min":0.432,"15min":0.432},"max":{"1min":0.96599999999999997,"5min":1.395,"15min":1.395},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.50800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.93100000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68200000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.92100000000000004,"5min":1.357,"15min":1.357},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0129999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89500000000000002,"5min":1.018,"15min":1.018},"last":0.79500000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.67800000000000005},"min":{"1min":0.47499999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.875,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.501,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91000000000000003,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.53200000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.873,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89100000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.66500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96199999999999997,"5min":1.181,"15min":1.181},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.52100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":0.78400000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.85399999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.55800000000000005,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.99299999999999999,"5min":1.153,"15min":1.153},"last":0.84899999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.63},{"interface":"front","average":{"1min":0.75,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94199999999999995,"5min":1.085,"15min":1.085},"last":0.71399999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.78700000000000003},"min":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.97099999999999997,"5min":1.526,"15min":1.526},"last":0.68799999999999994}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79100000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63800000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.877,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.83099999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.62},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89400000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85399999999999998,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76200000000000001,"15min":0.71599999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.022,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94699999999999995,"5min":1.133,"15min":1.133},"last":0.81399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.53500000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81599999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68500000000000005,"15min":0.65900000000000003},"min":{"1min":0.60599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88400000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.82799999999999996}]},{"osd":1,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69899999999999995,"15min":0.68700000000000006},"min":{"1min":0.51000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85199999999999998,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69199999999999995,"15min":0.67800000000000005},"min":{"1min":0.58499999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.874}]},{"osd":2,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.53300000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93300000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.749},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85399999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.84499999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71299999999999997,"15min":0.70799999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92300000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81699999999999995}]},{"osd":4,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.435,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89900000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.45900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.93600000000000005,"5min":1.054,"15min":1.054},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67000000000000004,"15min":0.68100000000000005},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89100000000000001,"5min":0.997,"15min":0.997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.51900000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83799999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.879,"5min":1.026,"15min":1.026},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64600000000000002,"15min":0.64100000000000001},"min":{"1min":0.45800000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":1.05,"15min":1.05},"last":0.97999999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67500000000000004,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.872,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.752},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.51300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.45000000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92100000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.84499999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.87,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.95599999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88300000000000001,"5min":1.01,"15min":1.01},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.0960000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88900000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70099999999999996,"15min":0.68899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.123}]},{"osd":7,"last update":"Wed Sep 13 06:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71799999999999997,"15min":0.71099999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":1.26},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52100000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.92000000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":1.2390000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.29899999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61899999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66400000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.37}]},{"osd":1,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42999999999999999,"15min":0.42499999999999999},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.45600000000000002},"min":{"1min":0.35899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.626,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.68400000000000005}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.505,"15min":0.501},"min":{"1min":0.41199999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.439,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70799999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.53000000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0229999999999999,"5min":1.284,"15min":1.284},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.72599999999999998,"15min":0.71599999999999997},"min":{"1min":0.58199999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.65100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.042,"5min":1.111,"15min":1.111},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.61299999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93300000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.61399999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.746,"15min":0.754},"min":{"1min":0.63200000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.995,"5min":1.458,"15min":1.458},"last":0.77300000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.65000000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0589999999999999,"5min":1.383,"15min":1.383},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.753,"15min":0.76500000000000001},"min":{"1min":0.63500000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.99199999999999999,"5min":1.27,"15min":1.27},"last":0.63300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194776,"statfs":{"total":200000000,"available":199450941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.40799999999999997},"min":{"1min":0.32600000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53700000000000003,"5min":10.401,"15min":10.401},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.46700000000000003,"15min":0.437},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":0.35999999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48199999999999998,"15min":0.45700000000000002},"min":{"1min":0.379,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60599999999999998,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.499,"15min":0.46500000000000002},"min":{"1min":0.39600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56499999999999995,"15min":0.52500000000000002},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58899999999999997,"15min":0.54900000000000004},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82399999999999995,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.77300000000000002},"min":{"1min":0.59999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0680000000000001,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.58299999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.054,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.94599999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78400000000000003,"15min":0.77600000000000002},"min":{"1min":0.58499999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.026,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.79800000000000004},"min":{"1min":0.67900000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.032,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.872}]},{"osd":6,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.753,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0980000000000001,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.749}]},{"osd":7,"last update":"Wed Sep 13 06:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.754,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0489999999999999,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.628,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.92700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194776,"statfs":{"total":200000000,"available":199450941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45400000000000001,"15min":0.436},"min":{"1min":0.307,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66200000000000003,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.496},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.34100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68400000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42199999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.45800000000000002},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63600000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.66400000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51800000000000002,"15min":0.48599999999999999},"min":{"1min":0.40699999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68500000000000005,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73199999999999998,"15min":0.72899999999999998},"min":{"1min":0.59599999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.016,"5min":1.089,"15min":1.089},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95499999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.72099999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.0349999999999999,"5min":1.109,"15min":1.109},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.55900000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59099999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97199999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.58799999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97399999999999998,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.63400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.75900000000000001,"15min":0.76600000000000001},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.075,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1112,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194199,"statfs":{"total":200000000,"available":198860539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65400000000000003,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49199999999999999,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.753,"5min":2.294,"15min":2.294},"last":0.42699999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.495},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78200000000000003,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.29899999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57199999999999995,"5min":2.056,"15min":2.056},"last":0.29999999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76600000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.38800000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.746},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.052,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58099999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97299999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.55100000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0980000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.71699999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.78500000000000003,"15min":0.78200000000000003},"min":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1240000000000001,"5min":2.415,"15min":2.415},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.079,"5min":2.347,"15min":2.347},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79600000000000004,"15min":0.80000000000000004},"min":{"1min":0.63200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0800000000000001,"5min":2.367,"15min":2.367},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.59499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.78900000000000003}]}]}],"pool_statfs":[]}} 2023-09-13T06:06:22.811 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T06:06:22.811 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-13T06:06:22.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.989+0000 7f2ec7f67640 1 Processor -- start 2023-09-13T06:06:22.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.989+0000 7f2ec7f67640 1 -- start start 2023-09-13T06:06:22.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec7f67640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2ec00b2e90 0x7f2ec00ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec7f67640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ec00b1460 0x7f2ec00b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:22.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec7f67640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec00b2150 con 0x7f2ec0144d70 2023-09-13T06:06:22.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec7f67640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec00b2430 con 0x7f2ec00b1460 2023-09-13T06:06:22.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec7f67640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec00cedb0 con 0x7f2ec00b2e90 2023-09-13T06:06:22.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec6504640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ec00b1460 0x7f2ec00b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec6504640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ec00b1460 0x7f2ec00b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35984/0 (socket says 172.21.15.130:35984) 2023-09-13T06:06:22.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec6504640 1 -- 172.21.15.130:0/92573121 learned_addr learned my addr 172.21.15.130:0/92573121 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:22.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec5502640 1 --2- 172.21.15.130:0/92573121 >> v2:172.21.15.164:3300/0 conn(0x7f2ec00b2e90 0x7f2ec00ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:22.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec6504640 1 -- 172.21.15.130:0/92573121 >> v2:172.21.15.164:3300/0 conn(0x7f2ec00b2e90 msgr2=0x7f2ec00ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:22.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec6504640 1 --2- 172.21.15.130:0/92573121 >> v2:172.21.15.164:3300/0 conn(0x7f2ec00b2e90 0x7f2ec00ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec6504640 1 -- 172.21.15.130:0/92573121 >> v1:172.21.15.164:6789/0 conn(0x7f2ec0144d70 legacy=0x7f2ec00b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec6504640 1 -- 172.21.15.130:0/92573121 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00cdd90 con 0x7f2ec00b1460 2023-09-13T06:06:22.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec5502640 1 --2- 172.21.15.130:0/92573121 >> v2:172.21.15.164:3300/0 conn(0x7f2ec00b2e90 0x7f2ec00ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:22.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec6504640 1 --2- 172.21.15.130:0/92573121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec00b1460 0x7f2ec00b18f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0145150 tx=0x7f2eb801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915b212826516e34 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:22.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.993+0000 7f2ec4d01640 1 -- 172.21.15.130:0/92573121 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80a5780 con 0x7f2ec00b1460 2023-09-13T06:06:22.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec4d01640 1 -- 172.21.15.130:0/92573121 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb80a58e0 con 0x7f2ec00b1460 2023-09-13T06:06:22.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec4d01640 1 -- 172.21.15.130:0/92573121 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80a5c70 con 0x7f2ec00b1460 2023-09-13T06:06:22.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 -- 172.21.15.130:0/92573121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec00b1460 msgr2=0x7f2ec00b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:22.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 --2- 172.21.15.130:0/92573121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec00b1460 0x7f2ec00b18f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0145150 tx=0x7f2eb801c9d0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 -- 172.21.15.130:0/92573121 shutdown_connections 2023-09-13T06:06:22.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 --2- 172.21.15.130:0/92573121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec00b1460 0x7f2ec00b18f0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 --2- 172.21.15.130:0/92573121 >> v2:172.21.15.164:3300/0 conn(0x7f2ec00b2e90 0x7f2ec00ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:22.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 -- 172.21.15.130:0/92573121 >> 172.21.15.130:0/92573121 conn(0x7f2ec0065990 msgr2=0x7f2ec0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:22.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 -- 172.21.15.130:0/92573121 shutdown_connections 2023-09-13T06:06:23.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 -- 172.21.15.130:0/92573121 wait complete. 2023-09-13T06:06:23.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 Processor -- start 2023-09-13T06:06:23.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 -- start start 2023-09-13T06:06:23.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ec00b1460 0x7f2ec0138560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:23.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec00b2e90 0x7f2ec00cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:23.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ec0144d70 0x7f2ec00ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:23.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec00cb9e0 con 0x7f2ec00b2e90 2023-09-13T06:06:23.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec0138aa0 con 0x7f2ec00b1460 2023-09-13T06:06:23.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec7f67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec00cbc30 con 0x7f2ec0144d70 2023-09-13T06:06:23.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec5502640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec00b2e90 0x7f2ec00cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:23.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec5502640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec00b2e90 0x7f2ec00cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35990/0 (socket says 172.21.15.130:35990) 2023-09-13T06:06:23.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec5502640 1 -- 172.21.15.130:0/829299922 learned_addr learned my addr 172.21.15.130:0/829299922 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:23.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:22.997+0000 7f2ec5d03640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ec00b1460 0x7f2ec0138560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:23.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2ec6504640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ec0144d70 0x7f2ec00ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:23.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2ec5502640 1 -- 172.21.15.130:0/829299922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ec0144d70 msgr2=0x7f2ec00ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:23.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2ec5502640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ec0144d70 0x7f2ec00ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2ec5502640 1 -- 172.21.15.130:0/829299922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ec00b1460 msgr2=0x7f2ec0138560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:23.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2ec5502640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ec00b1460 0x7f2ec0138560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2ec5502640 1 -- 172.21.15.130:0/829299922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8009b30 con 0x7f2ec00b2e90 2023-09-13T06:06:23.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2ec5502640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec00b2e90 0x7f2ec00cd460 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000e810 tx=0x7f2eb000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:23.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2eb67fc640 1 -- 172.21.15.130:0/829299922 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000c8d0 con 0x7f2ec00b2e90 2023-09-13T06:06:23.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2eb67fc640 1 -- 172.21.15.130:0/829299922 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb000ca30 con 0x7f2ec00b2e90 2023-09-13T06:06:23.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2ec7f67640 1 -- 172.21.15.130:0/829299922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec00cbf10 con 0x7f2ec00b2e90 2023-09-13T06:06:23.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2eb67fc640 1 -- 172.21.15.130:0/829299922 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000cdc0 con 0x7f2ec00b2e90 2023-09-13T06:06:23.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2ec7f67640 1 -- 172.21.15.130:0/829299922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec00cc4d0 con 0x7f2ec00b2e90 2023-09-13T06:06:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2ec7f67640 1 -- 172.21.15.130:0/829299922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec00618a0 con 0x7f2ec00b2e90 2023-09-13T06:06:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.001+0000 7f2eb67fc640 1 -- 172.21.15.130:0/829299922 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2eb0013410 con 0x7f2ec00b2e90 2023-09-13T06:06:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.005+0000 7f2eb67fc640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ea4065b50 0x7f2ea4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.005+0000 7f2eb67fc640 1 -- 172.21.15.130:0/829299922 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2eb0082fd0 con 0x7f2ec00b2e90 2023-09-13T06:06:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.005+0000 7f2ec5d03640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ea4065b50 0x7f2ea4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.005+0000 7f2ec5d03640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ea4065b50 0x7f2ea4068010 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc007fd0 tx=0x7f2ebc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.009+0000 7f2eb67fc640 1 -- 172.21.15.130:0/829299922 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2eb00509d0 con 0x7f2ec00b2e90 2023-09-13T06:06:23.021 INFO:tasks.ceph.mds.c.smithi130.stderr:2023-09-13T06:06:23.021+0000 7f29801df640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:06:23.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.209+0000 7f2ec7f67640 1 -- 172.21.15.130:0/829299922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2ec0157460 con 0x7f2ec00b2e90 2023-09-13T06:06:23.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.213+0000 7f2eb67fc640 1 -- 172.21.15.130:0/829299922 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2eb0009480 con 0x7f2ec00b2e90 2023-09-13T06:06:23.215 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:06:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:06:23.215 INFO:teuthology.orchestra.run.smithi130.stdout: caps mds = "allow" 2023-09-13T06:06:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: caps mon = "allow r" 2023-09-13T06:06:23.216 INFO:teuthology.orchestra.run.smithi130.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-13T06:06:23.217 INFO:teuthology.orchestra.run.smithi130.stderr:updated caps for client.0 2023-09-13T06:06:23.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.213+0000 7f2ec7f67640 1 -- 172.21.15.130:0/829299922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ea4065b50 msgr2=0x7f2ea4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:23.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.213+0000 7f2ec7f67640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ea4065b50 0x7f2ea4068010 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc007fd0 tx=0x7f2ebc009040 comp rx=0 tx=0).stop 2023-09-13T06:06:23.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.213+0000 7f2ec7f67640 1 -- 172.21.15.130:0/829299922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec00b2e90 msgr2=0x7f2ec00cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:23.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.213+0000 7f2ec7f67640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec00b2e90 0x7f2ec00cd460 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000e810 tx=0x7f2eb000ecd0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.217+0000 7f2ec7f67640 1 -- 172.21.15.130:0/829299922 shutdown_connections 2023-09-13T06:06:23.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.217+0000 7f2ec7f67640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ea4065b50 0x7f2ea4068010 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.217+0000 7f2ec7f67640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ec0144d70 0x7f2ec00ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.217+0000 7f2ec7f67640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec00b2e90 0x7f2ec00cd460 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.217+0000 7f2ec7f67640 1 --2- 172.21.15.130:0/829299922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ec00b1460 0x7f2ec0138560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.217+0000 7f2ec7f67640 1 -- 172.21.15.130:0/829299922 >> 172.21.15.130:0/829299922 conn(0x7f2ec0065990 msgr2=0x7f2ec015a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:23.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.217+0000 7f2ec7f67640 1 -- 172.21.15.130:0/829299922 shutdown_connections 2023-09-13T06:06:23.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.217+0000 7f2ec7f67640 1 -- 172.21.15.130:0/829299922 wait complete. 2023-09-13T06:06:23.236 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:23.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.373+0000 7fab520cb640 1 Processor -- start 2023-09-13T06:06:23.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.373+0000 7fab520cb640 1 -- start start 2023-09-13T06:06:23.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.373+0000 7fab520cb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fab4c146540 0x7fab4c070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:23.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.373+0000 7fab520cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab4c070b90 0x7fab4c160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:23.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.373+0000 7fab520cb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c070fe0 con 0x7fab4c1436e0 2023-09-13T06:06:23.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.373+0000 7fab520cb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c06f640 con 0x7fab4c146540 2023-09-13T06:06:23.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.373+0000 7fab520cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c06f890 con 0x7fab4c070b90 2023-09-13T06:06:23.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab4c070b90 0x7fab4c160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:23.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab43fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fab4c146540 0x7fab4c070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:23.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab4b7fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fab4c1436e0 0x7fab4c0ac840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:45454/0 (socket says 172.21.15.130:45454) 2023-09-13T06:06:23.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab4c070b90 0x7fab4c160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:44636/0 (socket says 172.21.15.130:44636) 2023-09-13T06:06:23.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab4b7fe640 1 -- 172.21.15.130:0/162513671 learned_addr learned my addr 172.21.15.130:0/162513671 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:23.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab43fff640 1 -- 172.21.15.130:0/162513671 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab4c070b90 msgr2=0x7fab4c160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:23.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab43fff640 1 --2- 172.21.15.130:0/162513671 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab4c070b90 0x7fab4c160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab43fff640 1 -- 172.21.15.130:0/162513671 >> v1:172.21.15.164:6789/0 conn(0x7fab4c1436e0 legacy=0x7fab4c0ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:23.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab43fff640 1 -- 172.21.15.130:0/162513671 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c06fb70 con 0x7fab4c146540 2023-09-13T06:06:23.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab43fff640 1 --2- 172.21.15.130:0/162513671 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab4c146540 0x7fab4c070650 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fab340097c0 tx=0x7fab3401c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f64a2363a18df407 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:23.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab4affd640 1 -- 172.21.15.130:0/162513671 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340ab600 con 0x7fab4c146540 2023-09-13T06:06:23.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab4affd640 1 -- 172.21.15.130:0/162513671 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340a7050 con 0x7fab4c146540 2023-09-13T06:06:23.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.377+0000 7fab4affd640 1 -- 172.21.15.130:0/162513671 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340ab980 con 0x7fab4c146540 2023-09-13T06:06:23.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 -- 172.21.15.130:0/162513671 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab4c146540 msgr2=0x7fab4c070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:23.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 --2- 172.21.15.130:0/162513671 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab4c146540 0x7fab4c070650 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fab340097c0 tx=0x7fab3401c360 comp rx=0 tx=0).stop 2023-09-13T06:06:23.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 -- 172.21.15.130:0/162513671 shutdown_connections 2023-09-13T06:06:23.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 --2- 172.21.15.130:0/162513671 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab4c070b90 0x7fab4c160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 --2- 172.21.15.130:0/162513671 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab4c146540 0x7fab4c070650 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 -- 172.21.15.130:0/162513671 >> 172.21.15.130:0/162513671 conn(0x7fab4c0b0bc0 msgr2=0x7fab4c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:23.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 -- 172.21.15.130:0/162513671 shutdown_connections 2023-09-13T06:06:23.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 -- 172.21.15.130:0/162513671 wait complete. 2023-09-13T06:06:23.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 Processor -- start 2023-09-13T06:06:23.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 -- start start 2023-09-13T06:06:23.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab4c070b90 0x7fab4c160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:23.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab4c1436e0 0x7fab4c15f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:23.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab4c146540 0x7fab4c158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:23.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c15fb50 con 0x7fab4c146540 2023-09-13T06:06:23.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c159da0 con 0x7fab4c1436e0 2023-09-13T06:06:23.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab520cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c15f8b0 con 0x7fab4c070b90 2023-09-13T06:06:23.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab4c146540 0x7fab4c158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:23.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab4c146540 0x7fab4c158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36006/0 (socket says 172.21.15.130:36006) 2023-09-13T06:06:23.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab4bfff640 1 -- 172.21.15.130:0/1319427007 learned_addr learned my addr 172.21.15.130:0/1319427007 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:23.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab4b7fe640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab4c070b90 0x7fab4c160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:23.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.381+0000 7fab43fff640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab4c1436e0 0x7fab4c15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:23.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab4bfff640 1 -- 172.21.15.130:0/1319427007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab4c070b90 msgr2=0x7fab4c160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:23.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab4bfff640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab4c070b90 0x7fab4c160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab4bfff640 1 -- 172.21.15.130:0/1319427007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab4c1436e0 msgr2=0x7fab4c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:23.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab4bfff640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab4c1436e0 0x7fab4c15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab4bfff640 1 -- 172.21.15.130:0/1319427007 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34009420 con 0x7fab4c146540 2023-09-13T06:06:23.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab4bfff640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab4c146540 0x7fab4c158a30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fab4400efc0 tx=0x7fab4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:23.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab48ff9640 1 -- 172.21.15.130:0/1319427007 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44009ba0 con 0x7fab4c146540 2023-09-13T06:06:23.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab48ff9640 1 -- 172.21.15.130:0/1319427007 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4400f040 con 0x7fab4c146540 2023-09-13T06:06:23.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab48ff9640 1 -- 172.21.15.130:0/1319427007 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440146c0 con 0x7fab4c146540 2023-09-13T06:06:23.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab520cb640 1 -- 172.21.15.130:0/1319427007 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c15a040 con 0x7fab4c146540 2023-09-13T06:06:23.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab520cb640 1 -- 172.21.15.130:0/1319427007 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c158f70 con 0x7fab4c146540 2023-09-13T06:06:23.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.385+0000 7fab520cb640 1 -- 172.21.15.130:0/1319427007 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c0618a0 con 0x7fab4c146540 2023-09-13T06:06:23.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.389+0000 7fab48ff9640 1 -- 172.21.15.130:0/1319427007 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fab44014820 con 0x7fab4c146540 2023-09-13T06:06:23.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.389+0000 7fab48ff9640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab2c065b20 0x7fab2c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:23.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.389+0000 7fab48ff9640 1 -- 172.21.15.130:0/1319427007 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab44083c90 con 0x7fab4c146540 2023-09-13T06:06:23.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.389+0000 7fab4b7fe640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab2c065b20 0x7fab2c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:23.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.389+0000 7fab4b7fe640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab2c065b20 0x7fab2c067fe0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fab3c005890 tx=0x7fab3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:23.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.393+0000 7fab48ff9640 1 -- 172.21.15.130:0/1319427007 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fab440516a0 con 0x7fab4c146540 2023-09-13T06:06:23.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.573+0000 7fab520cb640 1 -- 172.21.15.130:0/1319427007 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab4c065f90 con 0x7fab4c146540 2023-09-13T06:06:23.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.573+0000 7fab48ff9640 1 -- 172.21.15.130:0/1319427007 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4924 (secure 0 0 0) 0x7fab44054cc0 con 0x7fab4c146540 2023-09-13T06:06:23.577 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:23.578 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3211692360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3211692360},{"type":"v1","addr":"172.21.15.164:6834","nonce":3211692360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2453731046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2453731046},{"type":"v1","addr":"172.21.15.130:6835","nonce":2453731046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2896649577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2896649577},{"type":"v1","addr":"172.21.15.164:6835","nonce":2896649577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:06:17.421334+0000","modified":"2023-09-13T06:06:20.748001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6888":{"gid":6888,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/878642631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":878642631},{"type":"v1","addr":"172.21.15.130:6837","nonce":878642631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-09-13T06:06:23.579 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 51 2023-09-13T06:06:23.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 -- 172.21.15.130:0/1319427007 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab2c065b20 msgr2=0x7fab2c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:23.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab2c065b20 0x7fab2c067fe0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fab3c005890 tx=0x7fab3c009040 comp rx=0 tx=0).stop 2023-09-13T06:06:23.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 -- 172.21.15.130:0/1319427007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab4c146540 msgr2=0x7fab4c158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:23.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab4c146540 0x7fab4c158a30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fab4400efc0 tx=0x7fab4400c490 comp rx=0 tx=0).stop 2023-09-13T06:06:23.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 -- 172.21.15.130:0/1319427007 shutdown_connections 2023-09-13T06:06:23.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fab2c065b20 0x7fab2c067fe0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab4c1436e0 0x7fab4c15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab4c146540 0x7fab4c158a30 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 --2- 172.21.15.130:0/1319427007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fab4c070b90 0x7fab4c160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:23.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 -- 172.21.15.130:0/1319427007 >> 172.21.15.130:0/1319427007 conn(0x7fab4c0b0bc0 msgr2=0x7fab4c06e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:23.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 -- 172.21.15.130:0/1319427007 shutdown_connections 2023-09-13T06:06:23.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:23.577+0000 7fab520cb640 1 -- 172.21.15.130:0/1319427007 wait complete. 2023-09-13T06:06:24.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T06:06:17.421334+0000', 'modified': '2023-09-13T06:06:20.748001+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6888}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6888': {'gid': 6888, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6837/878642631', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 878642631}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 878642631}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T06:06:24.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T06:06:24.001 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-13T06:06:24.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48c94d640 1 Processor -- start 2023-09-13T06:06:24.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48c94d640 1 -- start start 2023-09-13T06:06:24.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48c94d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa4880ce1a0 0x7fa48806d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48c94d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4880afc70 0x7fa48806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48c94d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa488070e70 con 0x7fa48815d260 2023-09-13T06:06:24.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48c94d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa488072310 con 0x7fa4880ce1a0 2023-09-13T06:06:24.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48c94d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa488070280 con 0x7fa4880afc70 2023-09-13T06:06:24.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48659c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa48815d260 0x7fa4880b5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43800/0 (socket says 172.21.15.130:43800) 2023-09-13T06:06:24.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48659c640 1 -- 172.21.15.130:0/2215881687 learned_addr learned my addr 172.21.15.130:0/2215881687 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:24.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa486d9d640 1 --2- 172.21.15.130:0/2215881687 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4880afc70 0x7fa48806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa485d9b640 1 --2- 172.21.15.130:0/2215881687 >> v2:172.21.15.164:3300/0 conn(0x7fa4880ce1a0 0x7fa48806d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48559a640 1 -- 172.21.15.130:0/2215881687 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374166462 0 0) 0x7fa488070e70 con 0x7fa48815d260 2023-09-13T06:06:24.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48559a640 1 -- 172.21.15.130:0/2215881687 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa474003530 con 0x7fa48815d260 2023-09-13T06:06:24.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa48559a640 1 -- 172.21.15.130:0/2215881687 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 865973311 0 0) 0x7fa474003530 con 0x7fa48815d260 2023-09-13T06:06:24.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa486d9d640 1 -- 172.21.15.130:0/2215881687 >> v2:172.21.15.164:3300/0 conn(0x7fa4880ce1a0 msgr2=0x7fa48806d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:24.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa486d9d640 1 --2- 172.21.15.130:0/2215881687 >> v2:172.21.15.164:3300/0 conn(0x7fa4880ce1a0 0x7fa48806d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa486d9d640 1 -- 172.21.15.130:0/2215881687 >> v1:172.21.15.130:6789/0 conn(0x7fa48815d260 legacy=0x7fa4880b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa486d9d640 1 -- 172.21.15.130:0/2215881687 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa488070540 con 0x7fa4880afc70 2023-09-13T06:06:24.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.141+0000 7fa485d9b640 1 --2- 172.21.15.130:0/2215881687 >> v2:172.21.15.164:3300/0 conn(0x7fa4880ce1a0 0x7fa48806d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:24.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa486d9d640 1 --2- 172.21.15.130:0/2215881687 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4880afc70 0x7fa48806dc20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa480009d90 tx=0x7fa48001c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2bf0648ab72531e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:24.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa48559a640 1 -- 172.21.15.130:0/2215881687 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470001680 con 0x7fa4880afc70 2023-09-13T06:06:24.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa48559a640 1 -- 172.21.15.130:0/2215881687 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4800a5640 con 0x7fa4880afc70 2023-09-13T06:06:24.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa48559a640 1 -- 172.21.15.130:0/2215881687 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800a59d0 con 0x7fa4880afc70 2023-09-13T06:06:24.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa48c94d640 1 -- 172.21.15.130:0/2215881687 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4880afc70 msgr2=0x7fa48806dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa48c94d640 1 --2- 172.21.15.130:0/2215881687 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4880afc70 0x7fa48806dc20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa480009d90 tx=0x7fa48001c840 comp rx=0 tx=0).stop 2023-09-13T06:06:24.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa48c94d640 1 -- 172.21.15.130:0/2215881687 shutdown_connections 2023-09-13T06:06:24.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa48c94d640 1 --2- 172.21.15.130:0/2215881687 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4880afc70 0x7fa48806dc20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa48c94d640 1 --2- 172.21.15.130:0/2215881687 >> v2:172.21.15.164:3300/0 conn(0x7fa4880ce1a0 0x7fa48806d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa48c94d640 1 -- 172.21.15.130:0/2215881687 >> 172.21.15.130:0/2215881687 conn(0x7fa48806a2f0 msgr2=0x7fa48806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:24.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa48c94d640 1 -- 172.21.15.130:0/2215881687 shutdown_connections 2023-09-13T06:06:24.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.145+0000 7fa48c94d640 1 -- 172.21.15.130:0/2215881687 wait complete. 2023-09-13T06:06:24.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa48c94d640 1 Processor -- start 2023-09-13T06:06:24.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa48c94d640 1 -- start start 2023-09-13T06:06:24.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa48c94d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4880afc70 0x7fa4880cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa48c94d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4880ce1a0 0x7fa48815f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa48c94d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48815d260 0x7fa4880ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa48c94d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880cc6e0 con 0x7fa48815d260 2023-09-13T06:06:24.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa48c94d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880cbad0 con 0x7fa4880ce1a0 2023-09-13T06:06:24.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa48c94d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880cbdb0 con 0x7fa4880afc70 2023-09-13T06:06:24.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa486d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48815d260 0x7fa4880ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa486d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48815d260 0x7fa4880ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36014/0 (socket says 172.21.15.130:36014) 2023-09-13T06:06:24.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa486d9d640 1 -- 172.21.15.130:0/1016262835 learned_addr learned my addr 172.21.15.130:0/1016262835 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:24.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa48659c640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4880afc70 0x7fa4880cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa485d9b640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4880ce1a0 0x7fa48815f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa486d9d640 1 -- 172.21.15.130:0/1016262835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4880afc70 msgr2=0x7fa4880cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa486d9d640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4880afc70 0x7fa4880cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa486d9d640 1 -- 172.21.15.130:0/1016262835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4880ce1a0 msgr2=0x7fa48815f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa486d9d640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4880ce1a0 0x7fa48815f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa486d9d640 1 -- 172.21.15.130:0/1016262835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa478009420 con 0x7fa48815d260 2023-09-13T06:06:24.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa486d9d640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48815d260 0x7fa4880ccb70 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa48001d0e0 tx=0x7fa4800195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:24.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa47effd640 1 -- 172.21.15.130:0/1016262835 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800ad850 con 0x7fa48815d260 2023-09-13T06:06:24.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa47effd640 1 -- 172.21.15.130:0/1016262835 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4800ad9b0 con 0x7fa48815d260 2023-09-13T06:06:24.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa47effd640 1 -- 172.21.15.130:0/1016262835 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800add40 con 0x7fa48815d260 2023-09-13T06:06:24.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa48c94d640 1 -- 172.21.15.130:0/1016262835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa480009a70 con 0x7fa48815d260 2023-09-13T06:06:24.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.149+0000 7fa48c94d640 1 -- 172.21.15.130:0/1016262835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4880cc370 con 0x7fa48815d260 2023-09-13T06:06:24.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.153+0000 7fa47effd640 1 -- 172.21.15.130:0/1016262835 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa4800b4050 con 0x7fa48815d260 2023-09-13T06:06:24.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.153+0000 7fa47effd640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa468065b20 0x7fa468067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.153+0000 7fa47effd640 1 -- 172.21.15.130:0/1016262835 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa48011de20 con 0x7fa48815d260 2023-09-13T06:06:24.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.153+0000 7fa48659c640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa468065b20 0x7fa468067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.153+0000 7fa48fcbf000 1 Processor -- start 2023-09-13T06:06:24.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.153+0000 7fa48fcbf000 1 -- start start 2023-09-13T06:06:24.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.153+0000 7fa48659c640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa468065b20 0x7fa468067fe0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa470001190 tx=0x7fa470001120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:24.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61b550 0x561e1b61b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61be70 0x561e1b5ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b600690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1b4991e0 con 0x561e1b6002b0 2023-09-13T06:06:24.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1b4284c0 con 0x561e1b61b550 2023-09-13T06:06:24.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e1b4259f0 con 0x561e1b61be70 2023-09-13T06:06:24.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa486d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b600690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa486d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b600690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36020/0 (socket says 172.21.15.130:36020) 2023-09-13T06:06:24.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa486d9d640 1 -- 172.21.15.130:0/2115912601 learned_addr learned my addr 172.21.15.130:0/2115912601 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:24.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa485d9b640 1 --2- 172.21.15.130:0/2115912601 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61be70 0x561e1b5ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48659c640 1 --2- 172.21.15.130:0/2115912601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61b550 0x561e1b61b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa486d9d640 1 -- 172.21.15.130:0/2115912601 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61be70 msgr2=0x561e1b5ffd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:24.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa486d9d640 1 --2- 172.21.15.130:0/2115912601 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61be70 0x561e1b5ffd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa486d9d640 1 -- 172.21.15.130:0/2115912601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61b550 msgr2=0x561e1b61b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:24.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa486d9d640 1 --2- 172.21.15.130:0/2115912601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61b550 0x561e1b61b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa486d9d640 1 -- 172.21.15.130:0/2115912601 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e1b11b890 con 0x561e1b6002b0 2023-09-13T06:06:24.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa486d9d640 1 --2- 172.21.15.130:0/2115912601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b600690 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa4800b0040 tx=0x7fa4800eeff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de01d7bb1df0815 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:24.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa467fff640 1 -- 172.21.15.130:0/2115912601 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800f32e0 con 0x561e1b6002b0 2023-09-13T06:06:24.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa467fff640 1 -- 172.21.15.130:0/2115912601 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4800f7490 con 0x561e1b6002b0 2023-09-13T06:06:24.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa467fff640 1 -- 172.21.15.130:0/2115912601 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800ebc70 con 0x561e1b6002b0 2023-09-13T06:06:24.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 -- 172.21.15.130:0/2115912601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 msgr2=0x561e1b600690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/2115912601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b600690 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa4800b0040 tx=0x7fa4800eeff0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 -- 172.21.15.130:0/2115912601 shutdown_connections 2023-09-13T06:06:24.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/2115912601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b600690 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/2115912601 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61be70 0x561e1b5ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/2115912601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61b550 0x561e1b61b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 -- 172.21.15.130:0/2115912601 >> 172.21.15.130:0/2115912601 conn(0x561e1b5c8c40 msgr2=0x561e1b5d7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:24.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 -- 172.21.15.130:0/2115912601 shutdown_connections 2023-09-13T06:06:24.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 -- 172.21.15.130:0/2115912601 wait complete. 2023-09-13T06:06:24.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 -- start start 2023-09-13T06:06:24.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.157+0000 7fa48fcbf000 1 Processor -- start 2023-09-13T06:06:24.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b5ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61b550 0x561e1b5d50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b5d5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1b4212e0 con 0x561e1b6002b0 2023-09-13T06:06:24.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1b3dbfe0 con 0x561e1b61be70 2023-09-13T06:06:24.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e1b3dbc80 con 0x561e1b61b550 2023-09-13T06:06:24.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 10 client.0 _ll_register_callbacks cb 0x561e1b5bd260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:06:24.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b5ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b5ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36036/0 (socket says 172.21.15.130:36036) 2023-09-13T06:06:24.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48659c640 1 -- 172.21.15.130:0/699861768 learned_addr learned my addr 172.21.15.130:0/699861768 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:24.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa486d9d640 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b5d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa485d9b640 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61b550 0x561e1b5d50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48659c640 1 -- 172.21.15.130:0/699861768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61b550 msgr2=0x561e1b5d50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:24.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48659c640 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61b550 0x561e1b5d50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48659c640 1 -- 172.21.15.130:0/699861768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 msgr2=0x561e1b5d5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:24.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48659c640 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b5d5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48659c640 1 -- 172.21.15.130:0/699861768 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4880cc370 con 0x561e1b6002b0 2023-09-13T06:06:24.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48659c640 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b5ffb30 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa47000fe80 tx=0x7fa470005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573c64af9efc494f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:24.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa4657fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:06:24.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa4657fa640 1 -- 172.21.15.130:0/699861768 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470026030 con 0x561e1b6002b0 2023-09-13T06:06:24.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 1 -- 172.21.15.130:0/699861768 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e1b3b8a50 con 0x561e1b6002b0 2023-09-13T06:06:24.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa4657fa640 1 -- 172.21.15.130:0/699861768 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa470027070 con 0x561e1b6002b0 2023-09-13T06:06:24.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa4657fa640 1 -- 172.21.15.130:0/699861768 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4700136c0 con 0x561e1b6002b0 2023-09-13T06:06:24.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 10 client.7017 fetch_fsmap learned FSMap version 51 2023-09-13T06:06:24.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 1 -- 172.21.15.130:0/699861768 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x561e1b3e4210 con 0x561e1b6002b0 2023-09-13T06:06:24.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa4657fa640 1 -- 172.21.15.130:0/699861768 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa470031020 con 0x561e1b6002b0 2023-09-13T06:06:24.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa4657fa640 1 -- 172.21.15.130:0/699861768 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa470012070 con 0x561e1b6002b0 2023-09-13T06:06:24.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 10 client.7017 fetch_fsmap finished waiting for FSMap version 51 2023-09-13T06:06:24.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 10 client.7017 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T06:06:24.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 20 client.7017 populate_metadata read hostname 'smithi130' 2023-09-13T06:06:24.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.130:6836/878642631,v1:172.21.15.130:6837/878642631] conn(0x561e1b5d6020 0x561e1b5d6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 4 client.7017 mds_command: new command op to 6888 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T06:06:24.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa48fcbf000 1 -- 172.21.15.130:0/699861768 --> [v2:172.21.15.130:6836/878642631,v1:172.21.15.130:6837/878642631] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e1b3d8820 con 0x561e1b5d6020 2023-09-13T06:06:24.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa485d9b640 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.130:6836/878642631,v1:172.21.15.130:6837/878642631] conn(0x561e1b5d6020 0x561e1b5d6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa4657fa640 10 client.7017 ms_handle_connect on v2:172.21.15.130:6836/878642631 2023-09-13T06:06:24.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.161+0000 7fa485d9b640 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.130:6836/878642631,v1:172.21.15.130:6837/878642631] conn(0x561e1b5d6020 0x561e1b5d6400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ad216a322524e0e server_cookie=9f1b068052261164 in_seq=0 out_seq=0 2023-09-13T06:06:24.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa4657fa640 1 -- 172.21.15.130:0/699861768 <== mds.0 v2:172.21.15.130:6836/878642631 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561e1b3d8820 con 0x561e1b5d6020 2023-09-13T06:06:24.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa4657fa640 10 client.7017 handle_command_reply: tid=0 2023-09-13T06:06:24.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 1 client.7017 shutdown 2023-09-13T06:06:24.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 1 -- 172.21.15.130:0/699861768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 msgr2=0x561e1b5ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b5ffb30 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa47000fe80 tx=0x7fa470005800 comp rx=0 tx=0).stop 2023-09-13T06:06:24.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 1 -- 172.21.15.130:0/699861768 shutdown_connections 2023-09-13T06:06:24.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b5d5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.130:6836/878642631,v1:172.21.15.130:6837/878642631] conn(0x561e1b5d6020 0x561e1b5d6400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61b550 0x561e1b5d50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/699861768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b5ffb30 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 1 -- 172.21.15.130:0/699861768 >> 172.21.15.130:0/699861768 conn(0x561e1b5c8c40 msgr2=0x561e1b601130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:24.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa4657fa640 0 client.7017 ms_handle_reset on v2:172.21.15.130:6836/878642631 2023-09-13T06:06:24.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 1 -- 172.21.15.130:0/699861768 shutdown_connections 2023-09-13T06:06:24.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 1 -- 172.21.15.130:0/699861768 wait complete. 2023-09-13T06:06:24.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.165+0000 7fa48fcbf000 20 client.7017 trim_cache size 0 max 16384 2023-09-13T06:06:24.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.177+0000 7fa48fcbf000 1 Processor -- start 2023-09-13T06:06:24.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.177+0000 7fa48fcbf000 1 -- start start 2023-09-13T06:06:24.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b6002b0 0x561e1b5d5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b61b550 0x561e1b5d4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b5d45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1b0dc940 con 0x561e1b61b550 2023-09-13T06:06:24.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1b462f90 con 0x561e1b61be70 2023-09-13T06:06:24.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e1b41cc50 con 0x561e1b6002b0 2023-09-13T06:06:24.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa485d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b61b550 0x561e1b5d4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa485d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b61b550 0x561e1b5d4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36040/0 (socket says 172.21.15.130:36040) 2023-09-13T06:06:24.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa485d9b640 1 -- 172.21.15.130:0/4130897378 learned_addr learned my addr 172.21.15.130:0/4130897378 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:24.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48659c640 1 --2- 172.21.15.130:0/4130897378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b6002b0 0x561e1b5d5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa486d9d640 1 --2- 172.21.15.130:0/4130897378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b5d45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa485d9b640 1 -- 172.21.15.130:0/4130897378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b6002b0 msgr2=0x561e1b5d5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:24.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa485d9b640 1 --2- 172.21.15.130:0/4130897378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b6002b0 0x561e1b5d5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa485d9b640 1 -- 172.21.15.130:0/4130897378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 msgr2=0x561e1b5d45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:24.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa485d9b640 1 --2- 172.21.15.130:0/4130897378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b5d45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa485d9b640 1 -- 172.21.15.130:0/4130897378 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e1b3ca4a0 con 0x561e1b61b550 2023-09-13T06:06:24.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa486d9d640 1 --2- 172.21.15.130:0/4130897378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b5d45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:24.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa485d9b640 1 --2- 172.21.15.130:0/4130897378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b61b550 0x561e1b5d4080 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fa478000c10 tx=0x7fa478015610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b7df26b25832ba server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:24.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa47cff9640 1 -- 172.21.15.130:0/4130897378 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47801a040 con 0x561e1b61b550 2023-09-13T06:06:24.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa47cff9640 1 -- 172.21.15.130:0/4130897378 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47801c040 con 0x561e1b61b550 2023-09-13T06:06:24.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa47cff9640 1 -- 172.21.15.130:0/4130897378 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4780040f0 con 0x561e1b61b550 2023-09-13T06:06:24.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 -- 172.21.15.130:0/4130897378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b61b550 msgr2=0x561e1b5d4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/4130897378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b61b550 0x561e1b5d4080 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fa478000c10 tx=0x7fa478015610 comp rx=0 tx=0).stop 2023-09-13T06:06:24.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 -- 172.21.15.130:0/4130897378 shutdown_connections 2023-09-13T06:06:24.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/4130897378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b5d45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/4130897378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b61b550 0x561e1b5d4080 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/4130897378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b6002b0 0x561e1b5d5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 -- 172.21.15.130:0/4130897378 >> 172.21.15.130:0/4130897378 conn(0x561e1b5c8c40 msgr2=0x561e1b628b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:24.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 -- 172.21.15.130:0/4130897378 shutdown_connections 2023-09-13T06:06:24.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 -- 172.21.15.130:0/4130897378 wait complete. 2023-09-13T06:06:24.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 -- start start 2023-09-13T06:06:24.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.181+0000 7fa48fcbf000 1 Processor -- start 2023-09-13T06:06:24.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b679410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61b550 0x561e1b62fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b6302c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1b3e14b0 con 0x561e1b6002b0 2023-09-13T06:06:24.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1b5ffb80 con 0x561e1b61be70 2023-09-13T06:06:24.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e1b5d1e70 con 0x561e1b61b550 2023-09-13T06:06:24.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 10 client.0 _ll_register_callbacks cb 0x561e1b3d7ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:06:24.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b679410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b679410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36042/0 (socket says 172.21.15.130:36042) 2023-09-13T06:06:24.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48659c640 1 -- 172.21.15.130:0/362114728 learned_addr learned my addr 172.21.15.130:0/362114728 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:24.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa486d9d640 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b6302c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa485d9b640 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61b550 0x561e1b62fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48659c640 1 -- 172.21.15.130:0/362114728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61b550 msgr2=0x561e1b62fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:24.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48659c640 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61b550 0x561e1b62fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48659c640 1 -- 172.21.15.130:0/362114728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 msgr2=0x561e1b6302c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:24.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48659c640 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b6302c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48659c640 1 -- 172.21.15.130:0/362114728 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa478009ca0 con 0x561e1b6002b0 2023-09-13T06:06:24.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa485d9b640 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61b550 0x561e1b62fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:24.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48659c640 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b679410 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fa470001590 tx=0x7fa470014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c09c17418d2f4c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:24.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa4657fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:06:24.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa4657fa640 1 -- 172.21.15.130:0/362114728 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470026040 con 0x561e1b6002b0 2023-09-13T06:06:24.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa4657fa640 1 -- 172.21.15.130:0/362114728 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa470032080 con 0x561e1b6002b0 2023-09-13T06:06:24.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 -- 172.21.15.130:0/362114728 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e1b3dc900 con 0x561e1b6002b0 2023-09-13T06:06:24.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa4657fa640 1 -- 172.21.15.130:0/362114728 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa470013e90 con 0x561e1b6002b0 2023-09-13T06:06:24.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 10 client.7023 fetch_fsmap learned FSMap version 51 2023-09-13T06:06:24.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 -- 172.21.15.130:0/362114728 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x561e1b11bcc0 con 0x561e1b6002b0 2023-09-13T06:06:24.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa4657fa640 1 -- 172.21.15.130:0/362114728 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561e1b3dc900 con 0x561e1b6002b0 2023-09-13T06:06:24.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa4657fa640 1 -- 172.21.15.130:0/362114728 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa470034040 con 0x561e1b6002b0 2023-09-13T06:06:24.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 10 client.7023 fetch_fsmap finished waiting for FSMap version 51 2023-09-13T06:06:24.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 10 client.7023 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T06:06:24.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 20 client.7023 populate_metadata read hostname 'smithi130' 2023-09-13T06:06:24.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.130:6836/878642631,v1:172.21.15.130:6837/878642631] conn(0x561e1b630800 0x561e1b630be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 4 client.7023 mds_command: new command op to 6888 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T06:06:24.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 -- 172.21.15.130:0/362114728 --> [v2:172.21.15.130:6836/878642631,v1:172.21.15.130:6837/878642631] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561e1b41a2c0 con 0x561e1b630800 2023-09-13T06:06:24.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa485d9b640 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.130:6836/878642631,v1:172.21.15.130:6837/878642631] conn(0x561e1b630800 0x561e1b630be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa485d9b640 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.130:6836/878642631,v1:172.21.15.130:6837/878642631] conn(0x561e1b630800 0x561e1b630be0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f47ce45d94f9a872 server_cookie=e6ddca3e3a9deede in_seq=0 out_seq=0 2023-09-13T06:06:24.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa4657fa640 10 client.7023 ms_handle_connect on v2:172.21.15.130:6836/878642631 2023-09-13T06:06:24.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa4657fa640 1 -- 172.21.15.130:0/362114728 <== mds.0 v2:172.21.15.130:6836/878642631 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561e1b41a2c0 con 0x561e1b630800 2023-09-13T06:06:24.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa4657fa640 10 client.7023 handle_command_reply: tid=0 2023-09-13T06:06:24.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 client.7023 shutdown 2023-09-13T06:06:24.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 -- 172.21.15.130:0/362114728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 msgr2=0x561e1b679410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b679410 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fa470001590 tx=0x7fa470014000 comp rx=0 tx=0).stop 2023-09-13T06:06:24.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 -- 172.21.15.130:0/362114728 shutdown_connections 2023-09-13T06:06:24.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e1b61be70 0x561e1b6302c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.130:6836/878642631,v1:172.21.15.130:6837/878642631] conn(0x561e1b630800 0x561e1b630be0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x561e1b61b550 0x561e1b62fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa4657fa640 0 client.7023 ms_handle_reset on v2:172.21.15.130:6836/878642631 2023-09-13T06:06:24.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 --2- 172.21.15.130:0/362114728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e1b6002b0 0x561e1b679410 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 -- 172.21.15.130:0/362114728 >> 172.21.15.130:0/362114728 conn(0x561e1b5c8c40 msgr2=0x561e1b6282b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:24.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 -- 172.21.15.130:0/362114728 shutdown_connections 2023-09-13T06:06:24.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 1 -- 172.21.15.130:0/362114728 wait complete. 2023-09-13T06:06:24.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.185+0000 7fa48fcbf000 20 client.7023 trim_cache size 0 max 16384 2023-09-13T06:06:24.227 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:06:24.227 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:06:24.227 INFO:teuthology.orchestra.run.smithi130.stdout: "whoami": 0, 2023-09-13T06:06:24.227 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 6888, 2023-09-13T06:06:24.228 INFO:teuthology.orchestra.run.smithi130.stdout: "want_state": "up:active", 2023-09-13T06:06:24.228 INFO:teuthology.orchestra.run.smithi130.stdout: "state": "up:active", 2023-09-13T06:06:24.228 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs", 2023-09-13T06:06:24.229 INFO:teuthology.orchestra.run.smithi130.stdout: "rank_uptime": 5.8291519740000002, 2023-09-13T06:06:24.229 INFO:teuthology.orchestra.run.smithi130.stdout: "mdsmap_epoch": 51, 2023-09-13T06:06:24.229 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch": 102, 2023-09-13T06:06:24.229 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch_barrier": 102, 2023-09-13T06:06:24.230 INFO:teuthology.orchestra.run.smithi130.stdout: "uptime": 11.904624211 2023-09-13T06:06:24.230 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:06:24.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 -- 172.21.15.130:0/1016262835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa468065b20 msgr2=0x7fa468067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa468065b20 0x7fa468067fe0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa470001190 tx=0x7fa470001120 comp rx=0 tx=0).stop 2023-09-13T06:06:24.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 -- 172.21.15.130:0/1016262835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48815d260 msgr2=0x7fa4880ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48815d260 0x7fa4880ccb70 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa48001d0e0 tx=0x7fa4800195e0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 -- 172.21.15.130:0/1016262835 shutdown_connections 2023-09-13T06:06:24.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa468065b20 0x7fa468067fe0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4880ce1a0 0x7fa48815f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48815d260 0x7fa4880ccb70 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 --2- 172.21.15.130:0/1016262835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4880afc70 0x7fa4880cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 -- 172.21.15.130:0/1016262835 >> 172.21.15.130:0/1016262835 conn(0x7fa48806a2f0 msgr2=0x7fa4880ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:24.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 -- 172.21.15.130:0/1016262835 shutdown_connections 2023-09-13T06:06:24.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.189+0000 7fa48c94d640 1 -- 172.21.15.130:0/1016262835 wait complete. 2023-09-13T06:06:24.235 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:06:24.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.377+0000 7f2e0a656640 1 Processor -- start 2023-09-13T06:06:24.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.377+0000 7f2e0a656640 1 -- start start 2023-09-13T06:06:24.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.377+0000 7f2e0a656640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2e040ce7b0 0x7f2e040cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.377+0000 7f2e0a656640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e040ccfd0 con 0x7f2e040b1d20 2023-09-13T06:06:24.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.377+0000 7f2e0a656640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e040ced90 con 0x7f2e04159f20 2023-09-13T06:06:24.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.377+0000 7f2e0a656640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e040b00f0 con 0x7f2e040ce7b0 2023-09-13T06:06:24.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.377+0000 7f2e037fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2e040b1d20 0x7f2e040ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43810/0 (socket says 172.21.15.130:43810) 2023-09-13T06:06:24.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.377+0000 7f2e037fe640 1 -- 172.21.15.130:0/3512259485 learned_addr learned my addr 172.21.15.130:0/3512259485 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:24.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e08bf3640 1 --2- 172.21.15.130:0/3512259485 >> v2:172.21.15.164:3300/0 conn(0x7f2e040ce7b0 0x7f2e040cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e02ffd640 1 -- 172.21.15.130:0/3512259485 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525943299 0 0) 0x7f2e040ccfd0 con 0x7f2e040b1d20 2023-09-13T06:06:24.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e02ffd640 1 -- 172.21.15.130:0/3512259485 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dec003530 con 0x7f2e040b1d20 2023-09-13T06:06:24.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e02ffd640 1 -- 172.21.15.130:0/3512259485 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577077290 0 0) 0x7f2e040ced90 con 0x7f2e04159f20 2023-09-13T06:06:24.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e02ffd640 1 -- 172.21.15.130:0/3512259485 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e040ccfd0 con 0x7f2e04159f20 2023-09-13T06:06:24.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e02ffd640 1 -- 172.21.15.130:0/3512259485 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3661878349 0 0) 0x7f2dec003530 con 0x7f2e040b1d20 2023-09-13T06:06:24.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e08bf3640 1 -- 172.21.15.130:0/3512259485 >> v1:172.21.15.164:6789/0 conn(0x7f2e04159f20 legacy=0x7f2e040b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e08bf3640 1 -- 172.21.15.130:0/3512259485 >> v1:172.21.15.130:6789/0 conn(0x7f2e040b1d20 legacy=0x7f2e040ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e08bf3640 1 -- 172.21.15.130:0/3512259485 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e040cd200 con 0x7f2e040ce7b0 2023-09-13T06:06:24.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e08bf3640 1 --2- 172.21.15.130:0/3512259485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e040ce7b0 0x7f2e040cdfc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009dc0 tx=0x7f2dfc01c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=200ef9a0ee15439 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:24.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e02ffd640 1 -- 172.21.15.130:0/3512259485 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8001680 con 0x7f2e040ce7b0 2023-09-13T06:06:24.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e02ffd640 1 -- 172.21.15.130:0/3512259485 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc0a5610 con 0x7f2e040ce7b0 2023-09-13T06:06:24.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.381+0000 7f2e02ffd640 1 -- 172.21.15.130:0/3512259485 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0a59a0 con 0x7f2e040ce7b0 2023-09-13T06:06:24.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 -- 172.21.15.130:0/3512259485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e040ce7b0 msgr2=0x7f2e040cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 --2- 172.21.15.130:0/3512259485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e040ce7b0 0x7f2e040cdfc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009dc0 tx=0x7f2dfc01c790 comp rx=0 tx=0).stop 2023-09-13T06:06:24.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 -- 172.21.15.130:0/3512259485 shutdown_connections 2023-09-13T06:06:24.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 --2- 172.21.15.130:0/3512259485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e040ce7b0 0x7f2e040cdfc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 -- 172.21.15.130:0/3512259485 >> 172.21.15.130:0/3512259485 conn(0x7f2e04065990 msgr2=0x7f2e04065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 -- 172.21.15.130:0/3512259485 shutdown_connections 2023-09-13T06:06:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 -- 172.21.15.130:0/3512259485 wait complete. 2023-09-13T06:06:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 Processor -- start 2023-09-13T06:06:24.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 -- start start 2023-09-13T06:06:24.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e040b1d20 0x7f2e04147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e040ce7b0 0x7f2e04146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e04159f20 0x7f2e0406c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04147110 con 0x7f2e04159f20 2023-09-13T06:06:24.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040a98c0 con 0x7f2e040ce7b0 2023-09-13T06:06:24.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e0a656640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040a9ba0 con 0x7f2e040b1d20 2023-09-13T06:06:24.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e08bf3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e04159f20 0x7f2e0406c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e08bf3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e04159f20 0x7f2e0406c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36048/0 (socket says 172.21.15.130:36048) 2023-09-13T06:06:24.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.385+0000 7f2e08bf3640 1 -- 172.21.15.130:0/1084331820 learned_addr learned my addr 172.21.15.130:0/1084331820 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:24.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e037fe640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e040ce7b0 0x7f2e04146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e03fff640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e040b1d20 0x7f2e04147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e08bf3640 1 -- 172.21.15.130:0/1084331820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e040b1d20 msgr2=0x7f2e04147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e08bf3640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e040b1d20 0x7f2e04147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e08bf3640 1 -- 172.21.15.130:0/1084331820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e040ce7b0 msgr2=0x7f2e04146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e08bf3640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e040ce7b0 0x7f2e04146bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e08bf3640 1 -- 172.21.15.130:0/1084331820 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc009a70 con 0x7f2e04159f20 2023-09-13T06:06:24.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e037fe640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e040ce7b0 0x7f2e04146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:24.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e03fff640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e040b1d20 0x7f2e04147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:24.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e08bf3640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e04159f20 0x7f2e0406c780 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0b0040 tx=0x7f2dfc019530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:24.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e00ff9640 1 -- 172.21.15.130:0/1084331820 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc003ba0 con 0x7f2e04159f20 2023-09-13T06:06:24.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e00ff9640 1 -- 172.21.15.130:0/1084331820 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc003d00 con 0x7f2e04159f20 2023-09-13T06:06:24.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e0a656640 1 -- 172.21.15.130:0/1084331820 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e040a9e80 con 0x7f2e04159f20 2023-09-13T06:06:24.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e00ff9640 1 -- 172.21.15.130:0/1084331820 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc004260 con 0x7f2e04159f20 2023-09-13T06:06:24.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e0a656640 1 -- 172.21.15.130:0/1084331820 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e040aa440 con 0x7f2e04159f20 2023-09-13T06:06:24.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.389+0000 7f2e0a656640 1 -- 172.21.15.130:0/1084331820 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e040aa660 con 0x7f2e04159f20 2023-09-13T06:06:24.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.393+0000 7f2e00ff9640 1 -- 172.21.15.130:0/1084331820 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2dfc0043c0 con 0x7f2e04159f20 2023-09-13T06:06:24.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.393+0000 7f2e00ff9640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2df0065b20 0x7f2df0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:24.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.393+0000 7f2e00ff9640 1 -- 172.21.15.130:0/1084331820 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2dfc11eb10 con 0x7f2e04159f20 2023-09-13T06:06:24.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.393+0000 7f2e03fff640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2df0065b20 0x7f2df0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:24.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.397+0000 7f2e03fff640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2df0065b20 0x7f2df0067fe0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2df40011f0 tx=0x7f2df4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:24.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.397+0000 7f2e00ff9640 1 -- 172.21.15.130:0/1084331820 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2dfc0ec4d0 con 0x7f2e04159f20 2023-09-13T06:06:24.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.577+0000 7f2e0a656640 1 -- 172.21.15.130:0/1084331820 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2e040618a0 con 0x7f2e04159f20 2023-09-13T06:06:24.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.577+0000 7f2e00ff9640 1 -- 172.21.15.130:0/1084331820 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2dfc009450 con 0x7f2e04159f20 2023-09-13T06:06:24.582 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:06:24.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 -- 172.21.15.130:0/1084331820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2df0065b20 msgr2=0x7f2df0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2df0065b20 0x7f2df0067fe0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2df40011f0 tx=0x7f2df4009040 comp rx=0 tx=0).stop 2023-09-13T06:06:24.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 -- 172.21.15.130:0/1084331820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e04159f20 msgr2=0x7f2e0406c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:24.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e04159f20 0x7f2e0406c780 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0b0040 tx=0x7f2dfc019530 comp rx=0 tx=0).stop 2023-09-13T06:06:24.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 -- 172.21.15.130:0/1084331820 shutdown_connections 2023-09-13T06:06:24.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2df0065b20 0x7f2df0067fe0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e040ce7b0 0x7f2e04146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e04159f20 0x7f2e0406c780 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 --2- 172.21.15.130:0/1084331820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e040b1d20 0x7f2e04147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:24.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 -- 172.21.15.130:0/1084331820 >> 172.21.15.130:0/1084331820 conn(0x7f2e04065990 msgr2=0x7f2e040b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:24.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 -- 172.21.15.130:0/1084331820 shutdown_connections 2023-09-13T06:06:24.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:24.581+0000 7f2e0a656640 1 -- 172.21.15.130:0/1084331820 wait complete. 2023-09-13T06:06:24.600 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:06:24.600 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:06:24.601 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:06:24.601 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T06:06:24.601 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:06:24.602 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:06:24.602 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:06:24.602 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:06:24.603 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:06:24.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:24.604 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:06:24.615 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:06:24.615 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:06:24.616 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:06:24.616 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:24.616 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:06:24.616 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:24.617 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:06:24.617 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:24.617 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:06:24.618 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:06:24.618 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:24.618 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:06:24.618 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:06:24.619 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:24.619 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:06:24.619 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:24.619 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:06:24.620 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42123sec preferred_lft 42123sec 2023-09-13T06:06:24.620 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:06:24.620 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:24.620 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:06:24.621 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:24.621 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:06:24.621 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:24.621 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:06:24.622 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:24.622 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:06:24.622 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:24.622 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:06:24.623 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:24.623 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:06:24.623 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:06:24.624 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:06:24.624 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:24.624 INFO:teuthology.orchestra.run.smithi130.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:06:24.624 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:06:24.625 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:06:24.625 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:24.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:24.626 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:06:24.675 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:06:24.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:24.677 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:06:24.735 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:06:24.735 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:06:24.735 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:06:24.736 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:06:24.736 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:06:24.736 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:06:24.736 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:06:24.736 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:06:24.737 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:06:24.737 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:06:24.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:24.738 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:06:24.738 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:06:24.739 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:06:24.739 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:06:24.739 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:06:24.740 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:06:24.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:24.828 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:06:24.837 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T06:06:24.837 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:06:24.838 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:06:24.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:24.839 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-09-13T06:06:24.901 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:06:24.901 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T06:06:24.952 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:06:24.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:06:24.953 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:06:25.004 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:06:25.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:25.005 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:06:25.099 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:06:25.100 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:06:25.100 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:06:25.114 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:06:25.114 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:06:25.115 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:06:25.115 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:06:25.115 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:06:25.122 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:06:25.122 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:06:25.123 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:06:25.123 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:06:25.123 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:06:25.123 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:06:25.124 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:06:25.124 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:06:25.127 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:06:25.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:25.129 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:06:25.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:25.151 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:06:25.209 INFO:teuthology.orchestra.run.smithi130.stdout:client7032 2023-09-13T06:06:25.210 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:25.210 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:25.261 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:06:25.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.441+0000 7f85d21d2640 1 Processor -- start 2023-09-13T06:06:25.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.441+0000 7f85d21d2640 1 -- start start 2023-09-13T06:06:25.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.441+0000 7f85d21d2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85cc0b1d20 0x7f85cc0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:25.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.441+0000 7f85d21d2640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85cc0ccfd0 con 0x7f85cc0cdfc0 2023-09-13T06:06:25.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.441+0000 7f85d21d2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85cc0ced90 con 0x7f85cc159f20 2023-09-13T06:06:25.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.441+0000 7f85d21d2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc0ce430 con 0x7f85cc0b1d20 2023-09-13T06:06:25.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.441+0000 7f85cbfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f85cc0cdfc0 0x7f85cc0ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43826/0 (socket says 172.21.15.130:43826) 2023-09-13T06:06:25.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.441+0000 7f85cbfff640 1 -- 172.21.15.130:0/1198702954 learned_addr learned my addr 172.21.15.130:0/1198702954 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:25.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.441+0000 7f85caffd640 1 --2- 172.21.15.130:0/1198702954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85cc0b1d20 0x7f85cc0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:25.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.441+0000 7f85ca7fc640 1 -- 172.21.15.130:0/1198702954 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488881707 0 0) 0x7f85cc0ccfd0 con 0x7f85cc0cdfc0 2023-09-13T06:06:25.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85ca7fc640 1 -- 172.21.15.130:0/1198702954 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b4003530 con 0x7f85cc0cdfc0 2023-09-13T06:06:25.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85ca7fc640 1 -- 172.21.15.130:0/1198702954 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156845063 0 0) 0x7f85cc0ced90 con 0x7f85cc159f20 2023-09-13T06:06:25.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85ca7fc640 1 -- 172.21.15.130:0/1198702954 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85cc0ccfd0 con 0x7f85cc159f20 2023-09-13T06:06:25.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85caffd640 1 -- 172.21.15.130:0/1198702954 >> v1:172.21.15.164:6789/0 conn(0x7f85cc159f20 legacy=0x7f85cc0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:25.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85caffd640 1 -- 172.21.15.130:0/1198702954 >> v1:172.21.15.130:6789/0 conn(0x7f85cc0cdfc0 legacy=0x7f85cc0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:25.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85ca7fc640 1 -- 172.21.15.130:0/1198702954 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3477737351 0 0) 0x7f85b4003530 con 0x7f85cc0cdfc0 2023-09-13T06:06:25.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85caffd640 1 -- 172.21.15.130:0/1198702954 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0cd200 con 0x7f85cc0b1d20 2023-09-13T06:06:25.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85caffd640 1 --2- 172.21.15.130:0/1198702954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85cc0b1d20 0x7f85cc0ce7b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097f0 tx=0x7f85c001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1cb62b2b84f46c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:25.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85ca7fc640 1 -- 172.21.15.130:0/1198702954 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4001a00 con 0x7f85cc0b1d20 2023-09-13T06:06:25.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85ca7fc640 1 -- 172.21.15.130:0/1198702954 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c00a7050 con 0x7f85cc0b1d20 2023-09-13T06:06:25.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85ca7fc640 1 -- 172.21.15.130:0/1198702954 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00ab620 con 0x7f85cc0b1d20 2023-09-13T06:06:25.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85d21d2640 1 -- 172.21.15.130:0/1198702954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85cc0b1d20 msgr2=0x7f85cc0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:25.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.445+0000 7f85d21d2640 1 --2- 172.21.15.130:0/1198702954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85cc0b1d20 0x7f85cc0ce7b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097f0 tx=0x7f85c001c3e0 comp rx=0 tx=0).stop 2023-09-13T06:06:25.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 -- 172.21.15.130:0/1198702954 shutdown_connections 2023-09-13T06:06:25.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 --2- 172.21.15.130:0/1198702954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85cc0b1d20 0x7f85cc0ce7b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:25.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 -- 172.21.15.130:0/1198702954 >> 172.21.15.130:0/1198702954 conn(0x7f85cc065990 msgr2=0x7f85cc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:25.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 -- 172.21.15.130:0/1198702954 shutdown_connections 2023-09-13T06:06:25.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 -- 172.21.15.130:0/1198702954 wait complete. 2023-09-13T06:06:25.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 Processor -- start 2023-09-13T06:06:25.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 -- start start 2023-09-13T06:06:25.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85cc0b1d20 0x7f85cc14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:25.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85cc0cdfc0 0x7f85cc147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:25.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85cc159f20 0x7f85cc06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:25.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc14ba90 con 0x7f85cc159f20 2023-09-13T06:06:25.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc155e90 con 0x7f85cc0b1d20 2023-09-13T06:06:25.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85d21d2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc156170 con 0x7f85cc0cdfc0 2023-09-13T06:06:25.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85cbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85cc159f20 0x7f85cc06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:25.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85cbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85cc159f20 0x7f85cc06cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36056/0 (socket says 172.21.15.130:36056) 2023-09-13T06:06:25.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85cbfff640 1 -- 172.21.15.130:0/2565885583 learned_addr learned my addr 172.21.15.130:0/2565885583 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:25.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85caffd640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85cc0cdfc0 0x7f85cc147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:25.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85cb7fe640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85cc0b1d20 0x7f85cc14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:25.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85cbfff640 1 -- 172.21.15.130:0/2565885583 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85cc0cdfc0 msgr2=0x7f85cc147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:25.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85cbfff640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85cc0cdfc0 0x7f85cc147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:25.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85cbfff640 1 -- 172.21.15.130:0/2565885583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85cc0b1d20 msgr2=0x7f85cc14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:25.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85cbfff640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85cc0b1d20 0x7f85cc14b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:25.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85cbfff640 1 -- 172.21.15.130:0/2565885583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0009420 con 0x7f85cc159f20 2023-09-13T06:06:25.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85cb7fe640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85cc0b1d20 0x7f85cc14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:25.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.449+0000 7f85cbfff640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85cc159f20 0x7f85cc06cac0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f85c400cc90 tx=0x7f85c400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:25.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.453+0000 7f85b3fff640 1 -- 172.21.15.130:0/2565885583 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c400cea0 con 0x7f85cc159f20 2023-09-13T06:06:25.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.453+0000 7f85b3fff640 1 -- 172.21.15.130:0/2565885583 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4012400 con 0x7f85cc159f20 2023-09-13T06:06:25.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.453+0000 7f85b3fff640 1 -- 172.21.15.130:0/2565885583 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c40127f0 con 0x7f85cc159f20 2023-09-13T06:06:25.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.453+0000 7f85d21d2640 1 -- 172.21.15.130:0/2565885583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85cc156450 con 0x7f85cc159f20 2023-09-13T06:06:25.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.453+0000 7f85d21d2640 1 -- 172.21.15.130:0/2565885583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85cc14b680 con 0x7f85cc159f20 2023-09-13T06:06:25.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.453+0000 7f85d21d2640 1 -- 172.21.15.130:0/2565885583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc0618a0 con 0x7f85cc159f20 2023-09-13T06:06:25.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.453+0000 7f85b3fff640 1 -- 172.21.15.130:0/2565885583 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f85c4012950 con 0x7f85cc159f20 2023-09-13T06:06:25.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.453+0000 7f85b3fff640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f85b8065b20 0x7f85b8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:25.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.453+0000 7f85b3fff640 1 -- 172.21.15.130:0/2565885583 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85c4083aa0 con 0x7f85cc159f20 2023-09-13T06:06:25.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.453+0000 7f85cb7fe640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f85b8065b20 0x7f85b8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:25.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.453+0000 7f85cb7fe640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f85b8065b20 0x7f85b8067fe0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0011f0 tx=0x7f85bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:25.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.457+0000 7f85b3fff640 1 -- 172.21.15.130:0/2565885583 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f85c4051350 con 0x7f85cc159f20 2023-09-13T06:06:25.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.637+0000 7f85d21d2640 1 -- 172.21.15.130:0/2565885583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f85cc156900 con 0x7f85cc159f20 2023-09-13T06:06:25.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.637+0000 7f85b3fff640 1 -- 172.21.15.130:0/2565885583 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f85c4054970 con 0x7f85cc159f20 2023-09-13T06:06:25.640 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:06:25.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 -- 172.21.15.130:0/2565885583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f85b8065b20 msgr2=0x7f85b8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:25.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f85b8065b20 0x7f85b8067fe0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0011f0 tx=0x7f85bc009040 comp rx=0 tx=0).stop 2023-09-13T06:06:25.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 -- 172.21.15.130:0/2565885583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85cc159f20 msgr2=0x7f85cc06cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:25.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85cc159f20 0x7f85cc06cac0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f85c400cc90 tx=0x7f85c400a430 comp rx=0 tx=0).stop 2023-09-13T06:06:25.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 -- 172.21.15.130:0/2565885583 shutdown_connections 2023-09-13T06:06:25.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f85b8065b20 0x7f85b8067fe0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:25.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85cc159f20 0x7f85cc06cac0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:25.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85cc0cdfc0 0x7f85cc147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:25.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 --2- 172.21.15.130:0/2565885583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85cc0b1d20 0x7f85cc14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:25.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 -- 172.21.15.130:0/2565885583 >> 172.21.15.130:0/2565885583 conn(0x7f85cc065990 msgr2=0x7f85cc159180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:25.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 -- 172.21.15.130:0/2565885583 shutdown_connections 2023-09-13T06:06:25.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:25.641+0000 7f85d21d2640 1 -- 172.21.15.130:0/2565885583 wait complete. 2023-09-13T06:06:25.660 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:06:25.661 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:06:25.661 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:06:25.662 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T06:06:25.662 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:06:25.662 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:06:25.663 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:06:25.663 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:06:25.664 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:06:25.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:25.665 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:06:25.675 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:06:25.676 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:06:25.676 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:06:25.676 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:25.676 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:06:25.676 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:25.677 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:06:25.677 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:25.677 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:06:25.677 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:06:25.677 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:25.678 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:06:25.678 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:06:25.678 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:25.678 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:06:25.679 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:25.679 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:06:25.679 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42138sec preferred_lft 42138sec 2023-09-13T06:06:25.679 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:06:25.679 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:25.680 INFO:teuthology.orchestra.run.smithi164.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:06:25.681 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:06:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:06:25.683 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:06:25.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:25.685 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:06:25.747 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:06:25.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:25.750 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:06:25.806 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:06:25.806 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:06:25.806 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:06:25.807 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:06:25.807 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:06:25.807 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:06:25.807 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:06:25.807 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:06:25.808 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:06:25.808 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:06:25.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:25.809 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:06:25.809 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:06:25.809 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:06:25.810 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:06:25.810 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:06:25.811 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:06:25.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:25.907 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:06:25.917 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-13T06:06:25.917 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:06:25.918 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:06:25.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:25.919 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-09-13T06:06:25.984 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:06:25.984 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T06:06:26.034 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:06:26.035 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:06:26.035 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:06:26.090 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:06:26.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:26.091 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:06:26.186 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:06:26.186 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:06:26.187 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:06:26.201 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:06:26.201 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:06:26.202 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:06:26.202 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:06:26.202 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:06:26.209 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:06:26.210 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:06:26.210 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:06:26.210 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:06:26.210 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:06:26.210 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:06:26.211 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:06:26.211 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:06:26.213 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:06:26.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:26.214 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:06:26.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:26.238 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:06:26.293 INFO:teuthology.orchestra.run.smithi164.stdout:client6532 2023-09-13T06:06:26.293 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:06:26.294 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:26.342 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:26.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.481+0000 7f9b0affa640 1 Processor -- start 2023-09-13T06:06:26.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.481+0000 7f9b0affa640 1 -- start start 2023-09-13T06:06:26.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b0affa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9b040b1d20 0x7f9b040ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:26.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b0affa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b040cdfc0 0x7f9b040b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:26.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b0affa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b040ccfd0 con 0x7f9b04159f20 2023-09-13T06:06:26.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b0affa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b040ce430 con 0x7f9b040b1d20 2023-09-13T06:06:26.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b0affa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040b00f0 con 0x7f9b040cdfc0 2023-09-13T06:06:26.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b08d96640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9b04159f20 0x7f9b040b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43830/0 (socket says 172.21.15.130:43830) 2023-09-13T06:06:26.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b08d96640 1 -- 172.21.15.130:0/1578365214 learned_addr learned my addr 172.21.15.130:0/1578365214 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:26.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b09597640 1 --2- 172.21.15.130:0/1578365214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b040cdfc0 0x7f9b040b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:26.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b03fff640 1 --2- 172.21.15.130:0/1578365214 >> v2:172.21.15.164:3300/0 conn(0x7f9b040b1d20 0x7f9b040ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:26.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b037fe640 1 -- 172.21.15.130:0/1578365214 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855195563 0 0) 0x7f9b040ccfd0 con 0x7f9b04159f20 2023-09-13T06:06:26.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b037fe640 1 -- 172.21.15.130:0/1578365214 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9af4005740 con 0x7f9b04159f20 2023-09-13T06:06:26.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b09597640 1 -- 172.21.15.130:0/1578365214 >> v2:172.21.15.164:3300/0 conn(0x7f9b040b1d20 msgr2=0x7f9b040ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:26.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b09597640 1 --2- 172.21.15.130:0/1578365214 >> v2:172.21.15.164:3300/0 conn(0x7f9b040b1d20 0x7f9b040ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:26.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b09597640 1 -- 172.21.15.130:0/1578365214 >> v1:172.21.15.130:6789/0 conn(0x7f9b04159f20 legacy=0x7f9b040b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:26.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.485+0000 7f9b09597640 1 -- 172.21.15.130:0/1578365214 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040ced90 con 0x7f9b040cdfc0 2023-09-13T06:06:26.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b09597640 1 --2- 172.21.15.130:0/1578365214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b040cdfc0 0x7f9b040b0c90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9afc009dc0 tx=0x7f9afc01c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89963325a1995203 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:26.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b037fe640 1 -- 172.21.15.130:0/1578365214 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0a58e0 con 0x7f9b040cdfc0 2023-09-13T06:06:26.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b037fe640 1 -- 172.21.15.130:0/1578365214 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc0a5a40 con 0x7f9b040cdfc0 2023-09-13T06:06:26.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b037fe640 1 -- 172.21.15.130:0/1578365214 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0a5dd0 con 0x7f9b040cdfc0 2023-09-13T06:06:26.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b0affa640 1 -- 172.21.15.130:0/1578365214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b040cdfc0 msgr2=0x7f9b040b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:26.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b0affa640 1 --2- 172.21.15.130:0/1578365214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b040cdfc0 0x7f9b040b0c90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9afc009dc0 tx=0x7f9afc01c930 comp rx=0 tx=0).stop 2023-09-13T06:06:26.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b0affa640 1 -- 172.21.15.130:0/1578365214 shutdown_connections 2023-09-13T06:06:26.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b0affa640 1 --2- 172.21.15.130:0/1578365214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b040cdfc0 0x7f9b040b0c90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:26.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b0affa640 1 --2- 172.21.15.130:0/1578365214 >> v2:172.21.15.164:3300/0 conn(0x7f9b040b1d20 0x7f9b040ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:26.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b0affa640 1 -- 172.21.15.130:0/1578365214 >> 172.21.15.130:0/1578365214 conn(0x7f9b04065990 msgr2=0x7f9b04065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:26.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b0affa640 1 -- 172.21.15.130:0/1578365214 shutdown_connections 2023-09-13T06:06:26.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b0affa640 1 -- 172.21.15.130:0/1578365214 wait complete. 2023-09-13T06:06:26.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b0affa640 1 Processor -- start 2023-09-13T06:06:26.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.489+0000 7f9b0affa640 1 -- start start 2023-09-13T06:06:26.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b0affa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b040b1d20 0x7f9b0414b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:26.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b0affa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b040cdfc0 0x7f9b04154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:26.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b0affa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b04159f20 0x7f9b040ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:26.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b0affa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b04156fb0 con 0x7f9b04159f20 2023-09-13T06:06:26.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b0affa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b041563a0 con 0x7f9b040cdfc0 2023-09-13T06:06:26.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b0affa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b04156680 con 0x7f9b040b1d20 2023-09-13T06:06:26.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b09597640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b04159f20 0x7f9b040ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:26.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b09597640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b04159f20 0x7f9b040ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36072/0 (socket says 172.21.15.130:36072) 2023-09-13T06:06:26.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b09597640 1 -- 172.21.15.130:0/3194227435 learned_addr learned my addr 172.21.15.130:0/3194227435 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:26.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b08d96640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b040b1d20 0x7f9b0414b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:26.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b03fff640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b040cdfc0 0x7f9b04154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:26.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b09597640 1 -- 172.21.15.130:0/3194227435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b040b1d20 msgr2=0x7f9b0414b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:26.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b09597640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b040b1d20 0x7f9b0414b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:26.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b09597640 1 -- 172.21.15.130:0/3194227435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b040cdfc0 msgr2=0x7f9b04154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:26.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b09597640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b040cdfc0 0x7f9b04154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:26.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b09597640 1 -- 172.21.15.130:0/3194227435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc009a70 con 0x7f9b04159f20 2023-09-13T06:06:26.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b09597640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b04159f20 0x7f9b040ac840 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9afc01a560 tx=0x7f9afc0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:26.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b017fa640 1 -- 172.21.15.130:0/3194227435 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0ad850 con 0x7f9b04159f20 2023-09-13T06:06:26.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b017fa640 1 -- 172.21.15.130:0/3194227435 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc0ad9b0 con 0x7f9b04159f20 2023-09-13T06:06:26.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b017fa640 1 -- 172.21.15.130:0/3194227435 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0add60 con 0x7f9b04159f20 2023-09-13T06:06:26.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b0affa640 1 -- 172.21.15.130:0/3194227435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b04156960 con 0x7f9b04159f20 2023-09-13T06:06:26.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b0affa640 1 -- 172.21.15.130:0/3194227435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0414bcf0 con 0x7f9b04159f20 2023-09-13T06:06:26.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b0affa640 1 -- 172.21.15.130:0/3194227435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b04157120 con 0x7f9b04159f20 2023-09-13T06:06:26.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.493+0000 7f9b017fa640 1 -- 172.21.15.130:0/3194227435 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9afc0b4050 con 0x7f9b04159f20 2023-09-13T06:06:26.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.497+0000 7f9b017fa640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ae8065b50 0x7f9ae8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:26.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.497+0000 7f9b017fa640 1 -- 172.21.15.130:0/3194227435 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9afc11dcf0 con 0x7f9b04159f20 2023-09-13T06:06:26.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.497+0000 7f9b08d96640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ae8065b50 0x7f9ae8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:26.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.497+0000 7f9b08d96640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ae8065b50 0x7f9ae8068010 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9af8007fd0 tx=0x7f9af8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:26.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.501+0000 7f9b017fa640 1 -- 172.21.15.130:0/3194227435 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9afc0eb650 con 0x7f9b04159f20 2023-09-13T06:06:26.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.681+0000 7f9b0affa640 1 -- 172.21.15.130:0/3194227435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b040cd850 con 0x7f9b04159f20 2023-09-13T06:06:26.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.681+0000 7f9b017fa640 1 -- 172.21.15.130:0/3194227435 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f9afc0eec70 con 0x7f9b04159f20 2023-09-13T06:06:26.685 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:26.685 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3211692360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3211692360},{"type":"v1","addr":"172.21.15.164:6834","nonce":3211692360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2453731046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2453731046},{"type":"v1","addr":"172.21.15.130:6835","nonce":2453731046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2896649577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2896649577},{"type":"v1","addr":"172.21.15.164:6835","nonce":2896649577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:06:17.421334+0000","modified":"2023-09-13T06:06:20.748001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6888":{"gid":6888,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/878642631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":878642631},{"type":"v1","addr":"172.21.15.130:6837","nonce":878642631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-09-13T06:06:26.686 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 51 2023-09-13T06:06:26.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 -- 172.21.15.130:0/3194227435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ae8065b50 msgr2=0x7f9ae8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:26.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ae8065b50 0x7f9ae8068010 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9af8007fd0 tx=0x7f9af8009040 comp rx=0 tx=0).stop 2023-09-13T06:06:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 -- 172.21.15.130:0/3194227435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b04159f20 msgr2=0x7f9b040ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b04159f20 0x7f9b040ac840 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9afc01a560 tx=0x7f9afc0196d0 comp rx=0 tx=0).stop 2023-09-13T06:06:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 -- 172.21.15.130:0/3194227435 shutdown_connections 2023-09-13T06:06:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9ae8065b50 0x7f9ae8068010 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b040cdfc0 0x7f9b04154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b04159f20 0x7f9b040ac840 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 --2- 172.21.15.130:0/3194227435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b040b1d20 0x7f9b0414b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 -- 172.21.15.130:0/3194227435 >> 172.21.15.130:0/3194227435 conn(0x7f9b04065990 msgr2=0x7f9b04070650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 -- 172.21.15.130:0/3194227435 shutdown_connections 2023-09-13T06:06:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:26.685+0000 7f9b0affa640 1 -- 172.21.15.130:0/3194227435 wait complete. 2023-09-13T06:06:26.705 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-09-13T06:06:26.862 INFO:teuthology.orchestra.run.smithi130.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":6888,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4886853040000005,"mdsmap_epoch":51,"osdmap_epoch":102,"osdmap_epoch_barrier":102,"uptime":14.564159843000001} 2023-09-13T06:06:26.863 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 6888, "mdsmap_epoch": 51, "osdmap_epoch": 102, "osdmap_epoch_barrier": 102, "rank_uptime": 8.488685304, "state": "up:active", "uptime": 14.564159843, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:06:26.864 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-13T06:06:27.018 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_mon_report_interval":"5"} 2023-09-13T06:06:27.019 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-13T06:06:27.019 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-09-13T06:06:27.019 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:27.020 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:27.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:27.030 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-09-13T06:06:29.336 INFO:teuthology.orchestra.run.smithi130.stderr:265+0 records in 2023-09-13T06:06:29.336 INFO:teuthology.orchestra.run.smithi130.stderr:265+0 records out 2023-09-13T06:06:29.336 INFO:teuthology.orchestra.run.smithi130.stderr:277872640 bytes (278 MB, 265 MiB) copied, 2.25126 s, 123 MB/s 2023-09-13T06:06:29.337 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:29.338 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:29.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:29.347 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-09-13T06:06:31.887 INFO:teuthology.orchestra.run.smithi130.stderr:292+0 records in 2023-09-13T06:06:31.888 INFO:teuthology.orchestra.run.smithi130.stderr:292+0 records out 2023-09-13T06:06:31.888 INFO:teuthology.orchestra.run.smithi130.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.48925 s, 123 MB/s 2023-09-13T06:06:31.889 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-09-13T06:06:31.890 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:06:32.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.025+0000 7fcc77493640 1 Processor -- start 2023-09-13T06:06:32.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.025+0000 7fcc77493640 1 -- start start 2023-09-13T06:06:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc77493640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc70159f20 0x7fcc700ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc77493640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcc700b1d20 0x7fcc700b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc77493640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc700ccfd0 con 0x7fcc700cdfc0 2023-09-13T06:06:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc77493640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc700b00f0 con 0x7fcc700b1d20 2023-09-13T06:06:32.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc77493640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc700ce420 con 0x7fcc70159f20 2023-09-13T06:06:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc75a30640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcc700b1d20 0x7fcc700b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc75a30640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcc700b1d20 0x7fcc700b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:58470/0 (socket says 172.21.15.130:58470) 2023-09-13T06:06:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc75a30640 1 -- 172.21.15.130:0/1321344695 learned_addr learned my addr 172.21.15.130:0/1321344695 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc7522f640 1 --2- 172.21.15.130:0/1321344695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc70159f20 0x7fcc700ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:32.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc75a30640 1 -- 172.21.15.130:0/1321344695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc70159f20 msgr2=0x7fcc700ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc75a30640 1 --2- 172.21.15.130:0/1321344695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc70159f20 0x7fcc700ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc75a30640 1 -- 172.21.15.130:0/1321344695 >> v1:172.21.15.164:6789/0 conn(0x7fcc700cdfc0 legacy=0x7fcc700b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc75a30640 1 -- 172.21.15.130:0/1321344695 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc700ced90 con 0x7fcc700b1d20 2023-09-13T06:06:32.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.029+0000 7fcc67fff640 1 -- 172.21.15.130:0/1321344695 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195333676 0 0) 0x7fcc700ccfd0 con 0x7fcc700cdfc0 2023-09-13T06:06:32.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc75a30640 1 --2- 172.21.15.130:0/1321344695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc700b1d20 0x7fcc700b0c90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800d150 tx=0x7fcc6801ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fa4b91f1079e73 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:32.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc67fff640 1 -- 172.21.15.130:0/1321344695 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800b2d0 con 0x7fcc700b1d20 2023-09-13T06:06:32.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc67fff640 1 -- 172.21.15.130:0/1321344695 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6800b430 con 0x7fcc700b1d20 2023-09-13T06:06:32.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc67fff640 1 -- 172.21.15.130:0/1321344695 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680a7bf0 con 0x7fcc700b1d20 2023-09-13T06:06:32.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 -- 172.21.15.130:0/1321344695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc700b1d20 msgr2=0x7fcc700b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:32.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 --2- 172.21.15.130:0/1321344695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc700b1d20 0x7fcc700b0c90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800d150 tx=0x7fcc6801ec10 comp rx=0 tx=0).stop 2023-09-13T06:06:32.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 -- 172.21.15.130:0/1321344695 shutdown_connections 2023-09-13T06:06:32.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 --2- 172.21.15.130:0/1321344695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc700b1d20 0x7fcc700b0c90 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:32.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 --2- 172.21.15.130:0/1321344695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc70159f20 0x7fcc700ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:32.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 -- 172.21.15.130:0/1321344695 >> 172.21.15.130:0/1321344695 conn(0x7fcc70065990 msgr2=0x7fcc70065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:32.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 -- 172.21.15.130:0/1321344695 shutdown_connections 2023-09-13T06:06:32.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 -- 172.21.15.130:0/1321344695 wait complete. 2023-09-13T06:06:32.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 Processor -- start 2023-09-13T06:06:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 -- start start 2023-09-13T06:06:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc700b1d20 0x7fcc701f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700cdfc0 0x7fcc701556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc70159f20 0x7fcc701f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:32.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc701f5ab0 con 0x7fcc700b1d20 2023-09-13T06:06:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc701f6480 con 0x7fcc700cdfc0 2023-09-13T06:06:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.033+0000 7fcc77493640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc701f5470 con 0x7fcc70159f20 2023-09-13T06:06:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc7522f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc700b1d20 0x7fcc701f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc7522f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc700b1d20 0x7fcc701f5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:58480/0 (socket says 172.21.15.130:58480) 2023-09-13T06:06:32.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc7522f640 1 -- 172.21.15.130:0/993299198 learned_addr learned my addr 172.21.15.130:0/993299198 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:32.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc74a2e640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700cdfc0 0x7fcc701556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:32.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc75a30640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc70159f20 0x7fcc701f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:32.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc7522f640 1 -- 172.21.15.130:0/993299198 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc70159f20 msgr2=0x7fcc701f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:32.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc7522f640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc70159f20 0x7fcc701f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:32.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc7522f640 1 -- 172.21.15.130:0/993299198 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700cdfc0 msgr2=0x7fcc701556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:32.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc7522f640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700cdfc0 0x7fcc701556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:32.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc7522f640 1 -- 172.21.15.130:0/993299198 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6800bd40 con 0x7fcc700b1d20 2023-09-13T06:06:32.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc7522f640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc700b1d20 0x7fcc701f5f40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00e870 tx=0x7fcc6c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:32.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc65ffb640 1 -- 172.21.15.130:0/993299198 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c009510 con 0x7fcc700b1d20 2023-09-13T06:06:32.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc65ffb640 1 -- 172.21.15.130:0/993299198 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c00eec0 con 0x7fcc700b1d20 2023-09-13T06:06:32.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc77493640 1 -- 172.21.15.130:0/993299198 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc701f9550 con 0x7fcc700b1d20 2023-09-13T06:06:32.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc65ffb640 1 -- 172.21.15.130:0/993299198 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00cb40 con 0x7fcc700b1d20 2023-09-13T06:06:32.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc77493640 1 -- 172.21.15.130:0/993299198 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc701f5740 con 0x7fcc700b1d20 2023-09-13T06:06:32.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc77493640 1 -- 172.21.15.130:0/993299198 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc700618a0 con 0x7fcc700b1d20 2023-09-13T06:06:32.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.037+0000 7fcc65ffb640 1 -- 172.21.15.130:0/993299198 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcc6c00cca0 con 0x7fcc700b1d20 2023-09-13T06:06:32.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.041+0000 7fcc65ffb640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc54065b20 0x7fcc54067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:32.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.041+0000 7fcc65ffb640 1 -- 172.21.15.130:0/993299198 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc6c0837c0 con 0x7fcc700b1d20 2023-09-13T06:06:32.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.041+0000 7fcc74a2e640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc54065b20 0x7fcc54067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:32.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.041+0000 7fcc74a2e640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc54065b20 0x7fcc54067fe0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcc701f8a10 tx=0x7fcc60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:32.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.045+0000 7fcc65ffb640 1 -- 172.21.15.130:0/993299198 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcc6c051120 con 0x7fcc700b1d20 2023-09-13T06:06:32.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.193+0000 7fcc77493640 1 -- 172.21.15.130:0/993299198 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcc700cd850 con 0x7fcc700b1d20 2023-09-13T06:06:32.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc65ffb640 1 -- 172.21.15.130:0/993299198 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v103) v1 ==== 81+0+34123 (secure 0 0 0) 0x7fcc6c054740 con 0x7fcc700b1d20 2023-09-13T06:06:32.198 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:06:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 103, 2023-09-13T06:06:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:06:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:06:32.199 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:06:32.189103+0000", 2023-09-13T06:06:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:06:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:06:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:06:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:06:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:06:32.200 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:06:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:06:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:06:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:06:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:06:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:06:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:06:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:06:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:06:32.202 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 13, 2023-09-13T06:06:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:06:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:06:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:06:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:06:32.203 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:06:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:06:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:06:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:06:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:06:32.204 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 4097, 2023-09-13T06:06:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,backfillfull", 2023-09-13T06:06:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:32.205 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:32.206 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:32.207 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:06:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:06:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:06:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:06:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:06:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:32.209 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "103", 2023-09-13T06:06:32.210 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:32.211 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:32.212 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:32.213 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:32.214 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:32.215 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:32.216 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:32.217 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:06:32.218 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:06:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:06:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.219 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:06:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:06:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:06:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:32.220 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 12, 2023-09-13T06:06:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:06:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:15.152093+0000", 2023-09-13T06:06:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 4097, 2023-09-13T06:06:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,backfillfull", 2023-09-13T06:06:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:32.223 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:06:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:06:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:06:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:06:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:06:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:32.225 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:32.226 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "103", 2023-09-13T06:06:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:32.227 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:32.228 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:32.229 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:32.230 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:32.231 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:32.232 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:32.233 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:32.234 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:06:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:06:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:06:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:32.235 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:06:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:06:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:06:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:32.237 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.238 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 13, 2023-09-13T06:06:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:06:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:16.467343+0000", 2023-09-13T06:06:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 4097, 2023-09-13T06:06:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,backfillfull", 2023-09-13T06:06:32.239 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:32.240 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:06:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:06:32.241 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:06:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:06:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:06:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:32.242 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "103", 2023-09-13T06:06:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:32.246 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:32.247 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:32.248 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:32.249 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:32.250 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:06:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:06:32.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:06:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.252 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:06:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:06:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:06:32.253 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:06:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.254 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:06:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:32.255 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:32.256 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:32.257 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:06:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:32.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:06:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:32.259 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:06:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:32.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:06:32.262 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:32.263 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:06:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:32.264 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:06:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:32.265 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:32.266 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:06:32.267 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:06:32.268 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:06:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:06:32.269 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:06:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:06:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:32.270 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:32.271 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:32.272 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.273 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:06:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.274 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:06:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:06:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:32.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:06:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.277 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.278 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:32.278 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.278 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.278 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:06:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:06:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.280 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:06:32.281 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:06:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:06:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:06:32.283 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:06:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:06:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.284 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:32.285 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:32.286 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.287 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:06:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.288 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:06:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:32.289 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:06:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:06:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.291 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.292 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:06:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:06:32.293 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:06:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.295 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:06:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:06:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:06:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:06:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:06:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:32.297 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull", 2023-09-13T06:06:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:32.299 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:32.300 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:32.301 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:32.301 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:32.301 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.301 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.301 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:06:32.302 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:32.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.302 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.302 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:06:32.302 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:32.303 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.303 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.303 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:32.303 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.303 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.304 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.304 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:06:32.304 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:32.304 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.305 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.305 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:06:32.305 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:32.305 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.305 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.306 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:32.306 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.306 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.306 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:06:32.307 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:32.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.307 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.307 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:06:32.307 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:32.308 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.308 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.308 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:32.308 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.308 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.309 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:06:32.309 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:32.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.309 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.309 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:06:32.310 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:32.310 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.310 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.310 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:06:32.311 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:06:32.311 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:06:32.311 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:06:32.311 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:32.311 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:32.311 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:32.312 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.312 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.312 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.312 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:32.312 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:32.312 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:32.313 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:32.313 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:32.313 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:32.313 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:32.313 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:32.313 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:32.314 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:32.314 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:32.314 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:32.314 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:32.314 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.315 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.315 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:06:32.315 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:32.315 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.315 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.316 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:06:32.316 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:32.316 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.316 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.316 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:32.317 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.317 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.317 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:06:32.317 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:32.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.318 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.318 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:06:32.318 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:32.318 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.319 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.319 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:32.319 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.319 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.320 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:06:32.320 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:32.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.320 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.321 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:06:32.321 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:32.321 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.321 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.321 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:32.322 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.322 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.322 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:06:32.322 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:32.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.323 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.323 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:06:32.323 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:32.323 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.323 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.324 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:06:32.324 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:06:32.324 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:06:32.324 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:06:32.324 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:32.325 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:32.325 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:32.325 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.325 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.325 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.325 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:32.326 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:32.326 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:32.326 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:32.326 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:32.326 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:32.327 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:32.327 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:32.327 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:32.327 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:32.327 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:32.327 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:32.328 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:32.328 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.328 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.328 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:06:32.328 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:32.329 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.329 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.329 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.329 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:06:32.329 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:32.330 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.330 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.330 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:32.330 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.331 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.331 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:06:32.331 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:32.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.331 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.332 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:06:32.332 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:32.332 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.332 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.333 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:32.333 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.333 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.333 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:06:32.333 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:32.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.334 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.334 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:06:32.334 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:32.335 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.335 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.335 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:32.335 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.336 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.336 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:06:32.336 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:32.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.337 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.337 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:06:32.337 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:32.337 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.337 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.338 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.338 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:06:32.338 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:06:32.338 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:06:32.338 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:06:32.338 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:32.339 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:32.339 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:32.339 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.340 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:32.340 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:32.340 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:32.340 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:32.340 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:32.340 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:32.341 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:32.341 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:32.341 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:32.341 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:32.341 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:32.342 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:32.342 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:32.342 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.342 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.342 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:06:32.343 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:32.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.343 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.343 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:06:32.344 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:32.344 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.344 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.344 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:32.344 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.345 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.345 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:06:32.345 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:32.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.346 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.346 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:06:32.346 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:32.346 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.346 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.347 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:32.347 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.347 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.347 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:06:32.348 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:32.348 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.348 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.348 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.348 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:06:32.348 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:32.349 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.349 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.349 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:32.349 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.350 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.350 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:06:32.350 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:32.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.351 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.351 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:06:32.351 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:32.351 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.351 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.352 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.352 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:06:32.352 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:06:32.352 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:06:32.352 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:06:32.353 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:32.353 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:32.353 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:32.353 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.354 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:32.354 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:32.354 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:32.354 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:32.354 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:32.355 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:32.355 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:32.355 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:32.355 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:32.355 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:32.355 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:32.356 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:32.356 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:32.356 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.356 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.356 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:06:32.357 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:32.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.357 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.357 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:06:32.358 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:32.358 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.358 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.358 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:32.358 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.359 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.359 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:06:32.359 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:32.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.360 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.360 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:06:32.360 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:32.360 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.360 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.361 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.361 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:32.361 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.361 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.361 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.361 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:06:32.362 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:32.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.362 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.362 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:06:32.363 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:32.363 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.363 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.363 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:32.363 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:32.364 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.364 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:32.364 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:06:32.364 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:32.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.365 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.365 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:32.365 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:06:32.365 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:32.365 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.365 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.366 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.366 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:06:32.366 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:06:32.366 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:06:32.366 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:06:32.367 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:32.367 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:32.367 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:32.367 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:32.367 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.368 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:32.368 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:06:32.368 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.368 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:32.368 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:32.368 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:32.369 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:32.369 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:32.369 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:32.369 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:06:32.369 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:32.370 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.370 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.370 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:32.370 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:32.370 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:32.371 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:32.371 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:32.371 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:32.371 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:06:32.371 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:32.371 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.372 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:32.372 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:32.372 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:32.372 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:32.372 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:32.373 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:32.373 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:06:32.373 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:32.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.373 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.373 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:32.374 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:32.374 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:32.374 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:32.374 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:32.374 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:32.374 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:06:32.375 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:32.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.375 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:32.375 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:32.375 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:32.376 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:32.376 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:32.376 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:32.376 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:06:32.376 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:32.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.377 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.377 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:32.377 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:32.377 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:32.377 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:32.377 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:32.378 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:32.378 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:06:32.378 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:32.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.379 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:32.379 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:32.379 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:32.379 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:32.379 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:32.379 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:32.380 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:06:32.380 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:32.380 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.380 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:32.380 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:32.380 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:32.381 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:32.381 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:32.381 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:32.381 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:32.381 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:06:32.382 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:32.382 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.382 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:32.382 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:06:32.382 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:06:32.383 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:06:32.383 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:06:32.383 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:06:32.383 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:06:32.383 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:06:32.383 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:06:32.384 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:06:32.384 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:06:32.384 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:06:32.384 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:06:32.384 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:06:32.384 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:06:32.384 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:32.385 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:06:32.385 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:06:32.385 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:06:32.385 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:06:32.385 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:06:32.386 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:06:32.386 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:06:32.386 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:06:32.386 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:06:32.386 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:06:32.387 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:06:32.387 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:32.387 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:06:32.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 -- 172.21.15.130:0/993299198 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc54065b20 msgr2=0x7fcc54067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:32.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc54065b20 0x7fcc54067fe0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcc701f8a10 tx=0x7fcc60009040 comp rx=0 tx=0).stop 2023-09-13T06:06:32.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 -- 172.21.15.130:0/993299198 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc700b1d20 msgr2=0x7fcc701f5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:32.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc700b1d20 0x7fcc701f5f40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00e870 tx=0x7fcc6c00ec70 comp rx=0 tx=0).stop 2023-09-13T06:06:32.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 -- 172.21.15.130:0/993299198 shutdown_connections 2023-09-13T06:06:32.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc54065b20 0x7fcc54067fe0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:32.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc700cdfc0 0x7fcc701556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:32.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc70159f20 0x7fcc701f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:32.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 --2- 172.21.15.130:0/993299198 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc700b1d20 0x7fcc701f5f40 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:32.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 -- 172.21.15.130:0/993299198 >> 172.21.15.130:0/993299198 conn(0x7fcc70065990 msgr2=0x7fcc701590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:32.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 -- 172.21.15.130:0/993299198 shutdown_connections 2023-09-13T06:06:32.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:32.197+0000 7fcc77493640 1 -- 172.21.15.130:0/993299198 wait complete. 2023-09-13T06:06:32.391 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:06:33.361 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:06:33.361+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-09-13T06:06:37.392 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:06:37.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb41b656640 1 Processor -- start 2023-09-13T06:06:37.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb41b656640 1 -- start start 2023-09-13T06:06:37.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb41b656640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb4140b1d20 0x7fb4140ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:37.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb41b656640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4140ccfd0 con 0x7fb414159f20 2023-09-13T06:06:37.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb41b656640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4140ced90 con 0x7fb4140cdfc0 2023-09-13T06:06:37.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb41b656640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4140ce430 con 0x7fb4140b1d20 2023-09-13T06:06:37.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb4193f2640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb414159f20 0x7fb4140b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35694/0 (socket says 172.21.15.130:35694) 2023-09-13T06:06:37.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb4193f2640 1 -- 172.21.15.130:0/3908240939 learned_addr learned my addr 172.21.15.130:0/3908240939 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:37.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb418bf1640 1 --2- 172.21.15.130:0/3908240939 >> v2:172.21.15.130:3300/0 conn(0x7fb4140b1d20 0x7fb4140ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:37.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb418bf1640 1 -- 172.21.15.130:0/3908240939 >> v1:172.21.15.164:6789/0 conn(0x7fb4140cdfc0 legacy=0x7fb4140ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:37.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb418bf1640 1 -- 172.21.15.130:0/3908240939 >> v1:172.21.15.130:6789/0 conn(0x7fb414159f20 legacy=0x7fb4140b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:37.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb418bf1640 1 -- 172.21.15.130:0/3908240939 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4140cd200 con 0x7fb4140b1d20 2023-09-13T06:06:37.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.540+0000 7fb40bfff640 1 -- 172.21.15.130:0/3908240939 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332433029 0 0) 0x7fb4140ccfd0 con 0x7fb414159f20 2023-09-13T06:06:37.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.544+0000 7fb418bf1640 1 --2- 172.21.15.130:0/3908240939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4140b1d20 0x7fb4140ce7b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fb4040097f0 tx=0x7fb40401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285d08dac66d0b5c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:37.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.544+0000 7fb40bfff640 1 -- 172.21.15.130:0/3908240939 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4040ab600 con 0x7fb4140b1d20 2023-09-13T06:06:37.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.544+0000 7fb40bfff640 1 -- 172.21.15.130:0/3908240939 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4040a7050 con 0x7fb4140b1d20 2023-09-13T06:06:37.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.544+0000 7fb40bfff640 1 -- 172.21.15.130:0/3908240939 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4040ab980 con 0x7fb4140b1d20 2023-09-13T06:06:37.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.544+0000 7fb41b656640 1 -- 172.21.15.130:0/3908240939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4140b1d20 msgr2=0x7fb4140ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:37.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.544+0000 7fb41b656640 1 --2- 172.21.15.130:0/3908240939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4140b1d20 0x7fb4140ce7b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fb4040097f0 tx=0x7fb40401c3b0 comp rx=0 tx=0).stop 2023-09-13T06:06:37.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.544+0000 7fb41b656640 1 -- 172.21.15.130:0/3908240939 shutdown_connections 2023-09-13T06:06:37.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.544+0000 7fb41b656640 1 --2- 172.21.15.130:0/3908240939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4140b1d20 0x7fb4140ce7b0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:37.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.544+0000 7fb41b656640 1 -- 172.21.15.130:0/3908240939 >> 172.21.15.130:0/3908240939 conn(0x7fb414065990 msgr2=0x7fb414065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:37.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.544+0000 7fb41b656640 1 -- 172.21.15.130:0/3908240939 shutdown_connections 2023-09-13T06:06:37.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.544+0000 7fb41b656640 1 -- 172.21.15.130:0/3908240939 wait complete. 2023-09-13T06:06:37.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb41b656640 1 Processor -- start 2023-09-13T06:06:37.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb41b656640 1 -- start start 2023-09-13T06:06:37.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb41b656640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4140b1d20 0x7fb41414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:37.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb41b656640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4140cdfc0 0x7fb414144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:37.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb41b656640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb414159f20 0x7fb41414a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:37.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb41b656640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41414e7b0 con 0x7fb4140cdfc0 2023-09-13T06:06:37.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb41b656640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41414db30 con 0x7fb414159f20 2023-09-13T06:06:37.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb41b656640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41414de10 con 0x7fb4140b1d20 2023-09-13T06:06:37.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb418bf1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4140cdfc0 0x7fb414144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:37.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb418bf1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4140cdfc0 0x7fb414144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:58506/0 (socket says 172.21.15.130:58506) 2023-09-13T06:06:37.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb418bf1640 1 -- 172.21.15.130:0/1373695783 learned_addr learned my addr 172.21.15.130:0/1373695783 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:37.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb4193f2640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4140b1d20 0x7fb41414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:37.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb418bf1640 1 -- 172.21.15.130:0/1373695783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4140b1d20 msgr2=0x7fb41414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:37.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb419bf3640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb414159f20 0x7fb41414a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:37.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb418bf1640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4140b1d20 0x7fb41414ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:37.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb418bf1640 1 -- 172.21.15.130:0/1373695783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb414159f20 msgr2=0x7fb41414a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:37.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb418bf1640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb414159f20 0x7fb41414a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:37.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb418bf1640 1 -- 172.21.15.130:0/1373695783 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404009420 con 0x7fb4140cdfc0 2023-09-13T06:06:37.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb4193f2640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4140b1d20 0x7fb41414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:37.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb419bf3640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb414159f20 0x7fb41414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:37.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb418bf1640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4140cdfc0 0x7fb414144ed0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fb4040097f0 tx=0x7fb404019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:37.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb409ffb640 1 -- 172.21.15.130:0/1373695783 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4040b4610 con 0x7fb4140cdfc0 2023-09-13T06:06:37.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb409ffb640 1 -- 172.21.15.130:0/1373695783 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4040b4790 con 0x7fb4140cdfc0 2023-09-13T06:06:37.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb409ffb640 1 -- 172.21.15.130:0/1373695783 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4040b4b40 con 0x7fb4140cdfc0 2023-09-13T06:06:37.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb41b656640 1 -- 172.21.15.130:0/1373695783 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41414e0f0 con 0x7fb4140cdfc0 2023-09-13T06:06:37.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb41b656640 1 -- 172.21.15.130:0/1373695783 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41414f110 con 0x7fb4140cdfc0 2023-09-13T06:06:37.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.548+0000 7fb41b656640 1 -- 172.21.15.130:0/1373695783 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4140618a0 con 0x7fb4140cdfc0 2023-09-13T06:06:37.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.552+0000 7fb409ffb640 1 -- 172.21.15.130:0/1373695783 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb4040b2040 con 0x7fb4140cdfc0 2023-09-13T06:06:37.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.552+0000 7fb409ffb640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3f8065b20 0x7fb3f8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:37.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.552+0000 7fb409ffb640 1 -- 172.21.15.130:0/1373695783 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb40411d550 con 0x7fb4140cdfc0 2023-09-13T06:06:37.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.552+0000 7fb409ffb640 1 -- 172.21.15.130:0/1373695783 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7fb3f806d650 con 0x7fb4140cdfc0 2023-09-13T06:06:37.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.552+0000 7fb4193f2640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3f8065b20 0x7fb3f8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:37.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.552+0000 7fb4193f2640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3f8065b20 0x7fb3f8067fe0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb410007fd0 tx=0x7fb410009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:37.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.556+0000 7fb409ffb640 1 -- 172.21.15.130:0/1373695783 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb4040eae00 con 0x7fb4140cdfc0 2023-09-13T06:06:37.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.704+0000 7fb41b656640 1 -- 172.21.15.130:0/1373695783 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb4140cc310 con 0x7fb4140cdfc0 2023-09-13T06:06:37.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb409ffb640 1 -- 172.21.15.130:0/1373695783 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) v1 ==== 81+0+34210 (secure 0 0 0) 0x7fb4040ee420 con 0x7fb4140cdfc0 2023-09-13T06:06:37.710 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:37.711 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:06:37.711 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 106, 2023-09-13T06:06:37.711 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:06:37.711 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:06:37.711 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:06:35.382641+0000", 2023-09-13T06:06:37.712 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:06:37.712 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:06:37.712 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:06:37.712 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:06:37.712 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:06:37.713 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:06:37.713 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:06:37.713 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:06:37.713 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:06:37.713 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:37.714 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:06:37.714 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:06:37.714 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:06:37.714 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:06:37.714 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:06:37.714 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 13, 2023-09-13T06:06:37.715 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:06:37.715 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:06:37.715 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:06:37.715 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:06:37.715 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:06:37.716 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:06:37.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.716 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:06:37.716 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:06:37.716 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:06:37.716 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:06:37.717 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:06:37.717 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:37.717 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:37.717 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:37.717 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:37.718 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:37.718 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:37.718 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:37.718 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:37.718 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:37.718 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:37.719 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:06:37.719 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:06:37.719 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:06:37.719 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:06:37.720 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:06:37.720 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:37.720 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:37.720 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:37.720 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:37.720 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:37.721 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:37.721 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:37.721 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.721 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "104", 2023-09-13T06:06:37.721 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:37.722 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:37.722 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:37.722 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:37.722 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:37.722 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:37.722 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:37.723 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:37.723 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:37.723 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:37.723 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:37.723 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:37.724 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:37.724 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:37.724 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:37.724 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:37.724 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:37.724 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:37.725 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:37.725 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:37.725 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:37.725 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:37.725 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:37.726 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:37.726 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:37.726 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:37.726 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.726 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:37.727 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:37.727 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:37.727 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:37.727 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:37.727 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:37.728 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:37.728 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:37.728 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:37.728 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:37.728 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:37.728 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:37.729 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:06:37.729 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:06:37.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.729 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:37.729 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:06:37.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.730 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:37.730 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:06:37.730 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:06:37.730 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:06:37.731 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:37.731 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:37.731 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:37.731 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:37.731 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:37.731 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.732 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.732 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.732 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 12, 2023-09-13T06:06:37.732 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:06:37.732 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:15.152093+0000", 2023-09-13T06:06:37.733 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:06:37.733 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:06:37.733 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:37.733 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:37.733 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:37.734 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:37.734 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:37.734 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:37.734 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:37.734 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:37.734 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:37.735 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:37.735 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:06:37.735 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:06:37.735 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:06:37.735 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:06:37.736 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:06:37.736 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:37.736 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:37.736 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:37.736 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:37.736 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:37.737 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:37.737 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:37.737 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.737 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "104", 2023-09-13T06:06:37.737 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:37.737 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:37.738 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:37.738 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:37.738 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:37.738 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:37.738 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:37.739 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:37.739 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:37.739 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:37.739 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:37.739 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:37.740 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:37.740 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:37.740 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:37.740 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:37.740 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:37.740 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:37.741 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:37.741 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:37.741 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:37.741 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:37.741 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:37.742 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:37.742 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:37.742 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:37.742 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.742 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:37.743 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:37.743 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:37.743 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:37.743 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:37.743 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:37.744 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:37.744 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:37.744 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:37.744 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:37.744 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:37.744 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:37.745 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:06:37.745 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:06:37.745 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:06:37.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.745 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:37.745 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:37.746 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:06:37.746 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.746 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:37.746 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:06:37.747 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:06:37.747 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:37.747 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:37.747 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:37.747 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:37.747 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:37.748 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:37.748 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.748 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.748 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.748 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 13, 2023-09-13T06:06:37.749 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:06:37.749 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:16.467343+0000", 2023-09-13T06:06:37.749 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:06:37.749 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:06:37.749 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:37.750 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:37.750 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:37.750 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:37.750 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:37.750 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:37.750 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:37.751 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:37.751 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:37.751 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:37.751 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:06:37.751 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:06:37.752 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:06:37.752 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:06:37.752 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:06:37.752 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:37.752 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:37.752 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:37.753 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:37.753 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:37.753 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:37.753 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:37.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.754 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "104", 2023-09-13T06:06:37.754 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:37.754 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:37.754 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:37.754 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:37.754 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:37.755 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:37.755 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:37.755 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:37.755 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:37.755 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:37.756 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:37.756 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:37.756 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:37.756 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:37.756 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:37.757 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:37.757 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:37.757 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:37.757 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:37.757 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:37.757 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:37.758 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:37.758 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:37.758 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:37.758 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:37.758 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:37.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.759 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:37.759 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:37.759 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:37.759 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:37.759 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:37.760 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:37.760 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:37.760 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:37.760 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:37.760 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:37.761 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:37.761 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:37.761 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:06:37.761 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:06:37.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.761 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:37.762 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:37.762 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:06:37.762 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.762 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:37.763 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:06:37.763 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:06:37.763 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:37.763 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:06:37.763 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:06:37.764 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:37.764 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:37.764 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:37.764 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.764 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.764 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:37.765 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:06:37.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.765 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:37.765 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:37.765 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:37.766 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:37.766 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:37.766 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:37.766 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:37.766 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:37.767 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:37.767 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:37.767 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:37.767 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:37.767 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:37.767 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.768 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.768 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:06:37.768 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:37.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.769 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.769 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:06:37.769 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:37.769 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.769 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.770 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:37.770 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.770 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.771 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:06:37.771 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:37.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.771 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.772 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:06:37.772 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:37.772 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.772 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.773 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:37.773 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.773 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.774 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:06:37.774 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:37.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.774 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.774 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.775 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:06:37.775 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:37.775 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.775 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.776 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:37.776 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.776 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.776 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:06:37.777 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:37.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.777 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.777 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.777 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:06:37.777 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:37.778 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.778 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.778 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:06:37.778 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:06:37.779 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:06:37.779 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:06:37.779 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:37.779 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:37.779 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:37.779 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:37.780 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.780 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:37.780 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:37.781 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:37.781 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:37.781 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:37.781 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:37.781 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:37.781 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:37.782 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:37.782 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:37.782 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:37.782 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:37.782 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:37.783 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.783 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.783 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:06:37.783 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:37.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.784 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.784 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:06:37.784 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:37.784 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.785 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.785 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:37.785 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.786 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.786 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:06:37.786 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:37.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.786 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.787 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:06:37.787 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:37.787 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.787 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.788 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:37.788 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.788 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.788 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:06:37.789 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:37.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.789 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.789 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:06:37.790 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:37.790 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.790 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.790 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:37.791 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.791 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.791 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:06:37.791 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:37.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.792 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.792 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:06:37.792 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:37.792 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.793 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.793 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:06:37.793 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:06:37.793 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:06:37.794 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:06:37.794 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:37.794 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:37.794 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:37.794 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:37.795 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.795 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:37.795 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:37.796 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:37.796 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:37.796 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:37.796 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:37.796 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:37.796 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:37.797 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:37.797 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:37.797 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:37.797 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:37.797 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:37.798 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.798 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.798 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:06:37.798 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:37.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.799 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.799 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:06:37.799 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:37.799 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.800 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.800 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:37.800 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.801 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.801 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:06:37.801 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:37.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.802 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.802 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:06:37.802 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:37.802 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.802 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.803 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:37.803 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.803 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.803 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:06:37.804 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:37.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.804 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.804 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:06:37.805 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:37.805 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.805 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.805 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:37.805 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.806 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.806 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:06:37.806 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:37.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.807 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.807 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.807 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:06:37.807 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:37.807 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.807 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.808 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:06:37.808 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:06:37.808 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:06:37.808 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:06:37.808 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:37.809 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:37.809 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:37.809 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:37.809 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.810 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:37.810 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:37.810 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:37.810 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:37.811 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:37.811 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:37.811 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:37.811 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:37.811 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:37.811 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:37.812 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:37.812 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:37.812 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:37.812 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.812 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.813 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:06:37.813 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:37.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.813 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.814 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:06:37.814 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:37.814 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.814 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.815 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:37.815 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.815 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.815 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:06:37.815 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:37.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.816 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.816 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:06:37.816 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:37.816 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.817 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.817 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:37.817 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.818 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.818 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:06:37.818 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:37.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.818 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.819 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:06:37.819 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:37.819 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.819 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.820 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:37.820 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.820 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.820 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:06:37.821 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:37.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.821 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.822 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:06:37.822 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:37.822 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.822 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.823 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:06:37.823 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:06:37.823 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:06:37.823 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:06:37.823 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:37.823 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:37.824 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:37.824 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.824 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:37.825 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:37.825 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:37.825 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:37.825 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:37.825 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:37.825 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:37.826 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:37.826 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:37.826 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:37.826 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:37.826 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:37.827 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:37.827 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.827 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.827 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:06:37.828 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:37.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.828 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.828 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:06:37.829 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:37.829 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.829 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.829 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:37.830 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.830 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.830 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:06:37.830 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:37.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.831 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.831 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:06:37.831 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:37.831 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.832 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.832 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:37.832 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.833 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.833 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:06:37.833 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:37.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.834 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.834 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:06:37.834 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:37.834 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.834 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.835 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:37.835 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.835 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.835 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:06:37.836 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:37.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.836 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.836 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:06:37.837 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:37.837 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.837 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.837 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:06:37.838 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:06:37.838 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:06:37.838 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:06:37.838 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:37.838 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:37.839 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:37.839 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:37.839 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.840 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:37.840 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:37.840 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:37.840 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:37.840 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:37.841 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:37.841 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:37.841 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:37.841 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:37.841 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:37.842 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:37.842 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:37.842 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:37.842 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.843 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.843 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:06:37.843 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:37.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.843 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.843 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.844 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:06:37.844 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:37.844 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.844 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.844 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.845 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:37.845 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.845 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.845 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:06:37.845 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:37.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.846 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.846 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.846 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:06:37.846 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:37.847 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.847 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.847 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:37.847 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.848 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.848 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.848 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:06:37.848 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:37.848 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.849 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.849 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.849 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:06:37.849 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:37.849 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.850 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.850 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:37.850 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.850 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.851 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:06:37.851 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:37.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.851 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.851 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.852 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:06:37.852 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:37.852 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.852 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.852 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.852 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:06:37.853 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:06:37.853 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:06:37.853 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:06:37.853 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:37.853 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:37.854 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:37.854 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.854 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:37.855 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:37.855 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:37.855 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:37.855 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:37.855 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:37.855 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:37.856 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:37.856 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:37.856 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:37.856 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:37.856 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:37.857 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:37.857 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.857 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.857 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:06:37.857 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:37.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.858 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.858 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.858 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:06:37.858 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:37.859 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.859 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.859 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:37.859 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.860 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.860 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:06:37.860 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:37.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.861 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.861 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:06:37.861 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:37.861 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.861 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.862 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:37.862 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.862 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.863 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:06:37.863 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:37.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.863 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.863 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:06:37.864 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:37.864 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.864 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.864 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.864 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:37.865 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.865 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.865 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:06:37.865 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:37.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.866 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.866 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:06:37.866 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:37.866 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.867 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.867 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:06:37.867 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:06:37.867 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:06:37.867 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:06:37.868 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:37.868 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:37.868 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:37.868 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:37.868 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.869 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:37.869 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:37.869 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:37.869 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:37.870 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:37.870 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:37.870 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:37.870 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:37.870 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:37.871 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:37.871 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:37.871 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:37.871 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:37.871 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.872 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.872 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:06:37.872 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:37.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.873 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.873 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:06:37.873 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:37.873 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.873 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.874 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:37.874 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.874 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.874 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:06:37.875 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:37.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.875 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.875 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:06:37.876 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:37.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.876 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.876 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:37.876 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.877 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.877 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:06:37.877 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:37.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.878 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.878 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:06:37.878 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:37.878 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.878 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.879 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:37.879 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:37.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.879 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:37.879 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:06:37.880 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:37.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.880 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:37.880 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:06:37.881 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:37.881 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.881 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.881 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:06:37.881 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:06:37.882 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:06:37.882 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:06:37.882 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:37.885 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull", 2023-09-13T06:06:37.885 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:37.885 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:37.885 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:37.885 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.886 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:37.886 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:06:37.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.886 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:37.886 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:37.887 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:37.887 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:37.887 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:37.887 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:37.887 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:06:37.888 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:37.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.888 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:37.888 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:37.889 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:37.889 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:37.889 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:37.889 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:37.889 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:06:37.890 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:37.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.890 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:37.890 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:37.891 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:37.891 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:37.891 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:37.891 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:37.891 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:06:37.892 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:37.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.892 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:37.892 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:37.893 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:37.893 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:37.893 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:37.893 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:37.893 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:06:37.894 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:37.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.894 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:37.895 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:37.895 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:37.895 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:37.895 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:37.896 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:37.896 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:06:37.896 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:37.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.897 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:37.897 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:37.897 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:37.897 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:37.898 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:37.898 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:37.898 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:06:37.898 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:37.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.899 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:37.899 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:37.899 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:37.899 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:37.900 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:37.900 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:37.900 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:06:37.900 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:37.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:37.901 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:37.901 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:37.901 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:37.901 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:37.901 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:37.902 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:37.902 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:06:37.902 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:37.902 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.902 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:37.902 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:06:37.903 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:06:37.903 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:06:37.903 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:06:37.903 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:06:37.903 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:06:37.904 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:06:37.904 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:06:37.904 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:06:37.904 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:06:37.904 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:06:37.904 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:06:37.905 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:06:37.905 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:06:37.905 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:37.905 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:06:37.906 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:06:37.906 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:06:37.906 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:06:37.906 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:06:37.906 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:06:37.906 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:06:37.907 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:06:37.907 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:06:37.907 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:06:37.907 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:06:37.907 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:37.907 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:06:37.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 -- 172.21.15.130:0/1373695783 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3f8065b20 msgr2=0x7fb3f8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:37.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3f8065b20 0x7fb3f8067fe0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb410007fd0 tx=0x7fb410009040 comp rx=0 tx=0).stop 2023-09-13T06:06:37.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 -- 172.21.15.130:0/1373695783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4140cdfc0 msgr2=0x7fb414144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:37.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4140cdfc0 0x7fb414144ed0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fb4040097f0 tx=0x7fb404019150 comp rx=0 tx=0).stop 2023-09-13T06:06:37.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 -- 172.21.15.130:0/1373695783 shutdown_connections 2023-09-13T06:06:37.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3f8065b20 0x7fb3f8067fe0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:37.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb414159f20 0x7fb41414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:37.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4140cdfc0 0x7fb414144ed0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:37.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 --2- 172.21.15.130:0/1373695783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4140b1d20 0x7fb41414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:37.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 -- 172.21.15.130:0/1373695783 >> 172.21.15.130:0/1373695783 conn(0x7fb414065990 msgr2=0x7fb4140b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:37.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 -- 172.21.15.130:0/1373695783 shutdown_connections 2023-09-13T06:06:37.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:37.708+0000 7fb41b656640 1 -- 172.21.15.130:0/1373695783 wait complete. 2023-09-13T06:06:37.912 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-09-13T06:06:37.913 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:37.913 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:37.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:37.923 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-09-13T06:06:38.300 INFO:teuthology.orchestra.run.smithi130.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-09-13T06:06:38.301 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records in 2023-09-13T06:06:38.301 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records out 2023-09-13T06:06:38.301 INFO:teuthology.orchestra.run.smithi130.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.318294 s, 165 MB/s 2023-09-13T06:06:38.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:06:38.303 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:06:38.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.440+0000 7fe6c6848640 1 Processor -- start 2023-09-13T06:06:38.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.440+0000 7fe6c6848640 1 -- start start 2023-09-13T06:06:38.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.440+0000 7fe6c6848640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe6c0157920 0x7fe6c00ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.440+0000 7fe6c6848640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6c00b0f40 0x7fe6c00b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.440+0000 7fe6c6848640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c00afee0 con 0x7fe6c015e560 2023-09-13T06:06:38.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.440+0000 7fe6c6848640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c00aea50 con 0x7fe6c00b0f40 2023-09-13T06:06:38.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.440+0000 7fe6c6848640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c00b0b20 con 0x7fe6c0157920 2023-09-13T06:06:38.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.440+0000 7fe6bf7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6c00b0f40 0x7fe6c00b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.440+0000 7fe6bf7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6c00b0f40 0x7fe6c00b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:58516/0 (socket says 172.21.15.130:58516) 2023-09-13T06:06:38.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.440+0000 7fe6bf7fe640 1 -- 172.21.15.130:0/2679824015 learned_addr learned my addr 172.21.15.130:0/2679824015 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:38.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.444+0000 7fe6bffff640 1 --2- 172.21.15.130:0/2679824015 >> v2:172.21.15.164:3300/0 conn(0x7fe6c0157920 0x7fe6c00ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.444+0000 7fe6bf7fe640 1 -- 172.21.15.130:0/2679824015 >> v2:172.21.15.164:3300/0 conn(0x7fe6c0157920 msgr2=0x7fe6c00ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:38.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.444+0000 7fe6bf7fe640 1 --2- 172.21.15.130:0/2679824015 >> v2:172.21.15.164:3300/0 conn(0x7fe6c0157920 0x7fe6c00ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.444+0000 7fe6bf7fe640 1 -- 172.21.15.130:0/2679824015 >> v1:172.21.15.164:6789/0 conn(0x7fe6c015e560 legacy=0x7fe6c00ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:38.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.444+0000 7fe6bf7fe640 1 -- 172.21.15.130:0/2679824015 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c00b0180 con 0x7fe6c00b0f40 2023-09-13T06:06:38.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.444+0000 7fe6bf7fe640 1 --2- 172.21.15.130:0/2679824015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6c00b0f40 0x7fe6c00b1610 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00b2660 tx=0x7fe6b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5641b82a9078911 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:38.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.444+0000 7fe6beffd640 1 -- 172.21.15.130:0/2679824015 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40ac640 con 0x7fe6c00b0f40 2023-09-13T06:06:38.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.444+0000 7fe6beffd640 1 -- 172.21.15.130:0/2679824015 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b40ac7a0 con 0x7fe6c00b0f40 2023-09-13T06:06:38.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.444+0000 7fe6beffd640 1 -- 172.21.15.130:0/2679824015 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40acb30 con 0x7fe6c00b0f40 2023-09-13T06:06:38.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.444+0000 7fe6c6848640 1 -- 172.21.15.130:0/2679824015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6c00b0f40 msgr2=0x7fe6c00b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:38.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.444+0000 7fe6c6848640 1 --2- 172.21.15.130:0/2679824015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6c00b0f40 0x7fe6c00b1610 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00b2660 tx=0x7fe6b401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 -- 172.21.15.130:0/2679824015 shutdown_connections 2023-09-13T06:06:38.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 --2- 172.21.15.130:0/2679824015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6c00b0f40 0x7fe6c00b1610 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 --2- 172.21.15.130:0/2679824015 >> v2:172.21.15.164:3300/0 conn(0x7fe6c0157920 0x7fe6c00ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 -- 172.21.15.130:0/2679824015 >> 172.21.15.130:0/2679824015 conn(0x7fe6c0065990 msgr2=0x7fe6c0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:38.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 -- 172.21.15.130:0/2679824015 shutdown_connections 2023-09-13T06:06:38.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 -- 172.21.15.130:0/2679824015 wait complete. 2023-09-13T06:06:38.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 Processor -- start 2023-09-13T06:06:38.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 -- start start 2023-09-13T06:06:38.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c00b0f40 0x7fe6c0136880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c0157920 0x7fe6c0152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6c015e560 0x7fe6c01529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c014e470 con 0x7fe6c015e560 2023-09-13T06:06:38.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c014bb50 con 0x7fe6c0157920 2023-09-13T06:06:38.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c6848640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c014e730 con 0x7fe6c00b0f40 2023-09-13T06:06:38.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c4de5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6c015e560 0x7fe6c01529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c4de5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6c015e560 0x7fe6c01529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:58522/0 (socket says 172.21.15.130:58522) 2023-09-13T06:06:38.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c4de5640 1 -- 172.21.15.130:0/4227115434 learned_addr learned my addr 172.21.15.130:0/4227115434 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:38.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6bffff640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c00b0f40 0x7fe6c0136880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6bf7fe640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c0157920 0x7fe6c0152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c4de5640 1 -- 172.21.15.130:0/4227115434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c00b0f40 msgr2=0x7fe6c0136880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:38.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c4de5640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c00b0f40 0x7fe6c0136880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c4de5640 1 -- 172.21.15.130:0/4227115434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c0157920 msgr2=0x7fe6c0152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:38.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c4de5640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c0157920 0x7fe6c0152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c4de5640 1 -- 172.21.15.130:0/4227115434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b40094d0 con 0x7fe6c015e560 2023-09-13T06:06:38.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6bf7fe640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c0157920 0x7fe6c0152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:38.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.448+0000 7fe6c4de5640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6c015e560 0x7fe6c01529d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800c730 tx=0x7fe6b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:38.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6bcff9640 1 -- 172.21.15.130:0/4227115434 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8003b80 con 0x7fe6c015e560 2023-09-13T06:06:38.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6bcff9640 1 -- 172.21.15.130:0/4227115434 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b8003ce0 con 0x7fe6c015e560 2023-09-13T06:06:38.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6bcff9640 1 -- 172.21.15.130:0/4227115434 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8005310 con 0x7fe6c015e560 2023-09-13T06:06:38.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6c6848640 1 -- 172.21.15.130:0/4227115434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c014ea10 con 0x7fe6c015e560 2023-09-13T06:06:38.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6c6848640 1 -- 172.21.15.130:0/4227115434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c0136dc0 con 0x7fe6c015e560 2023-09-13T06:06:38.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6c6848640 1 -- 172.21.15.130:0/4227115434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c00ae6b0 con 0x7fe6c015e560 2023-09-13T06:06:38.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6bcff9640 1 -- 172.21.15.130:0/4227115434 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe6b8005680 con 0x7fe6c015e560 2023-09-13T06:06:38.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6bcff9640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6ac065b20 0x7fe6ac067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6bcff9640 1 -- 172.21.15.130:0/4227115434 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6b8083160 con 0x7fe6c015e560 2023-09-13T06:06:38.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6bffff640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6ac065b20 0x7fe6ac067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6bcff9640 1 -- 172.21.15.130:0/4227115434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7fe6ac06d650 con 0x7fe6c015e560 2023-09-13T06:06:38.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.452+0000 7fe6bffff640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6ac065b20 0x7fe6ac067fe0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009b60 tx=0x7fe6b0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:38.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.456+0000 7fe6bcff9640 1 -- 172.21.15.130:0/4227115434 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe6c00ae6b0 con 0x7fe6c015e560 2023-09-13T06:06:38.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.608+0000 7fe6c6848640 1 -- 172.21.15.130:0/4227115434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe6c00ae6b0 con 0x7fe6c015e560 2023-09-13T06:06:38.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6bcff9640 1 -- 172.21.15.130:0/4227115434 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) v1 ==== 81+0+34210 (secure 0 0 0) 0x7fe6c00ae6b0 con 0x7fe6c015e560 2023-09-13T06:06:38.614 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:38.615 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:06:38.615 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 106, 2023-09-13T06:06:38.615 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:06:38.615 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:06:38.615 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:06:35.382641+0000", 2023-09-13T06:06:38.616 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:06:38.616 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:06:38.616 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:06:38.616 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:06:38.616 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:06:38.617 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:06:38.617 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:06:38.617 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:06:38.617 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:06:38.617 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:38.617 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:06:38.618 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:06:38.618 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:06:38.618 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:06:38.618 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:06:38.618 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 13, 2023-09-13T06:06:38.619 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:06:38.619 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:06:38.619 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:06:38.619 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:06:38.619 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:06:38.620 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:06:38.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.620 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:06:38.620 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:06:38.620 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:06:38.621 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:06:38.621 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:06:38.621 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:38.621 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:38.621 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:38.621 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:38.622 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:38.622 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:38.622 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:38.622 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:38.622 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:38.623 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:38.623 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:06:38.623 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:06:38.623 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:06:38.623 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:06:38.624 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:06:38.624 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:38.624 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:38.624 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:38.625 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:38.625 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:38.625 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:38.625 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:38.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.626 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "104", 2023-09-13T06:06:38.626 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:38.626 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:38.626 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:38.626 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:38.627 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:38.627 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:38.627 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:38.627 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:38.627 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:38.627 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:38.628 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:38.628 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:38.628 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:38.628 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:38.628 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:38.629 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:38.629 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:38.629 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:38.629 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:38.629 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:38.629 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:38.630 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:38.630 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:38.630 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:38.630 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:38.630 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:38.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.631 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:38.631 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:38.631 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:38.631 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:38.631 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:38.632 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:38.632 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:38.632 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:38.632 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:38.632 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:38.633 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:38.633 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:38.633 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:06:38.633 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:06:38.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.633 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:38.634 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:06:38.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.634 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:38.635 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:06:38.635 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:06:38.635 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:06:38.635 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:38.635 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:38.636 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:38.636 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:38.636 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:38.636 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.637 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 12, 2023-09-13T06:06:38.637 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:06:38.637 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:15.152093+0000", 2023-09-13T06:06:38.637 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:06:38.637 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:06:38.638 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:38.638 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:38.638 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:38.638 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:38.638 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:38.639 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:38.639 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:38.639 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:38.639 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:38.639 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:38.640 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:06:38.640 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:06:38.640 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:06:38.640 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:06:38.640 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:06:38.641 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:38.641 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:38.641 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:38.641 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:38.641 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:38.641 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:38.642 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:38.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.642 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "104", 2023-09-13T06:06:38.642 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:38.642 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:38.643 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:38.643 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:38.643 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:38.643 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:38.643 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:38.643 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:38.644 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:38.644 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:38.644 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:38.644 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:38.645 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:38.645 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:38.645 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:38.645 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:38.645 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:38.646 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:38.646 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:38.648 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:38.648 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:38.648 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:38.648 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:38.648 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:38.649 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:38.649 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:38.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.649 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:38.650 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:38.650 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:38.650 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:38.650 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:38.651 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:38.651 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:38.651 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:38.651 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:38.651 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:38.652 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:38.652 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:38.652 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:06:38.652 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:06:38.652 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:06:38.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.653 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:38.653 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:38.653 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:06:38.653 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.654 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:38.654 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:06:38.654 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:06:38.654 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:38.654 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:38.655 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:38.655 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:38.655 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:38.655 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:38.655 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.656 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 13, 2023-09-13T06:06:38.656 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:06:38.656 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:16.467343+0000", 2023-09-13T06:06:38.656 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:06:38.657 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:06:38.657 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:38.657 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:38.657 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:38.657 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:38.658 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:38.658 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:38.658 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:38.658 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:38.658 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:38.659 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:38.659 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:06:38.659 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:06:38.659 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:06:38.659 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:06:38.659 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:06:38.660 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:38.660 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:38.660 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:38.660 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:38.660 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:38.661 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:38.661 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:38.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.661 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "104", 2023-09-13T06:06:38.661 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:38.662 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:38.662 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:38.662 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:38.662 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:38.662 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:38.662 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:38.663 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:38.663 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:38.663 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:38.663 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:38.663 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:38.664 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:38.664 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:38.664 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:38.664 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:38.664 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:38.665 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:38.665 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:38.665 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:38.665 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:38.665 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:38.665 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:38.666 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:38.666 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:38.666 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:38.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.666 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:38.667 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:38.667 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:38.667 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:38.667 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:38.667 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:38.668 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:38.668 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:38.668 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:38.668 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:38.668 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:38.669 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:38.669 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:06:38.669 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:06:38.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.669 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:38.669 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:38.670 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:06:38.670 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.670 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:38.670 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:06:38.671 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:06:38.671 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:38.671 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:06:38.671 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:06:38.671 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:38.672 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:38.672 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:38.672 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.672 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.672 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:38.673 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:06:38.673 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.673 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:38.673 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:38.673 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:38.673 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:38.674 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:38.674 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:38.674 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:38.674 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:38.674 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:38.675 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:38.675 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:38.675 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:38.675 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:38.675 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.676 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.676 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:06:38.676 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:38.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.677 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.677 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:06:38.677 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:38.677 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.678 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.678 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.678 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:38.678 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.679 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.679 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:06:38.679 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:38.679 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.679 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.680 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.680 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:06:38.680 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:38.680 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.680 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.680 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.681 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:38.681 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.681 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.681 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.681 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:06:38.682 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:38.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.682 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.682 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:06:38.682 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:38.683 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.683 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.683 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.683 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:38.683 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.684 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.684 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.684 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:06:38.684 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:38.684 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.685 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.685 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.685 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:06:38.685 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:38.685 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.685 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.686 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.686 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:06:38.686 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:06:38.686 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:06:38.686 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:06:38.687 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:38.687 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:38.687 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:38.687 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:38.687 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.687 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.688 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.688 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:38.688 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:38.688 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:38.688 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:38.689 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:38.689 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:38.689 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:38.689 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:38.689 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:38.689 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:38.690 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:38.690 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:38.690 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:38.690 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.690 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.691 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.691 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:06:38.691 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:38.691 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.691 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.692 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.692 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:06:38.692 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:38.692 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.692 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.692 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.693 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:38.693 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.693 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.693 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.693 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:06:38.694 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:38.694 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.694 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.694 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.694 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:06:38.695 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:38.695 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.695 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.695 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.695 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:38.695 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.696 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.696 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.696 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:06:38.696 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:38.696 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.697 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.697 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.697 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:06:38.697 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:38.697 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.698 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.698 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:38.698 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.698 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.698 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.699 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:06:38.699 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:38.699 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.699 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.699 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.700 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:06:38.700 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:38.700 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.700 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.700 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.701 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:06:38.701 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:06:38.701 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:06:38.701 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:06:38.701 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:38.701 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:38.702 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:38.702 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:38.702 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.703 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.703 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.703 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:38.703 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:38.705 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:38.705 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:38.705 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:38.706 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:38.706 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:38.706 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:38.706 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:38.706 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:38.707 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:38.707 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:38.707 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:38.707 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.707 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.708 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.708 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:06:38.708 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:38.708 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.708 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.709 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.709 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:06:38.709 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:38.709 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.709 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.710 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.710 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:38.710 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.710 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.710 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.711 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:06:38.711 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:38.711 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.711 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.711 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.712 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:06:38.712 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:38.712 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.712 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.712 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.713 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:38.713 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.713 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.713 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.713 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:06:38.713 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:38.714 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.714 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.714 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.714 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:06:38.714 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:38.715 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.715 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.715 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.715 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:38.715 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.716 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.716 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:06:38.716 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:38.716 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.717 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.717 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:06:38.717 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:38.717 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.717 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.718 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.718 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:06:38.718 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:06:38.718 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:06:38.718 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:06:38.719 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:38.719 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:38.719 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:38.719 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:38.719 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.720 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.720 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.720 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:38.720 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:38.720 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:38.721 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:38.721 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:38.721 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:38.721 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:38.721 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:38.721 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:38.722 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:38.722 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:38.722 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:38.722 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:38.722 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.723 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.723 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.723 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:06:38.723 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:38.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.724 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.724 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.724 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:06:38.724 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:38.724 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.725 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.725 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.725 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:38.725 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.725 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.725 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.726 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:06:38.726 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:38.726 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.726 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.726 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.727 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:06:38.727 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:38.727 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.727 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.727 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:38.728 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.728 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.728 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.728 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:06:38.728 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:38.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.729 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.729 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:06:38.729 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:38.729 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.730 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.730 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.730 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:38.730 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.730 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.731 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.731 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:06:38.731 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:38.731 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.731 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.732 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.732 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:06:38.732 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:38.732 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.732 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.732 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.733 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:06:38.733 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:06:38.733 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:06:38.733 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:06:38.733 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:38.734 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:38.734 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:38.734 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.734 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.735 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:38.735 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:38.735 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:38.735 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:38.735 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:38.735 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:38.736 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:38.736 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:38.736 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:38.736 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:38.736 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:38.737 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:38.737 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:38.737 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.737 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.737 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.738 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:06:38.738 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:38.738 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.738 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.738 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.738 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:06:38.739 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:38.739 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.739 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.739 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:38.740 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.740 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.740 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:06:38.740 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:38.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.741 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.741 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:06:38.741 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:38.742 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.742 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.742 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.742 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:38.742 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.742 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.743 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.743 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:06:38.743 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:38.743 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.743 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.744 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.744 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:06:38.744 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:38.744 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.744 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.745 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.745 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:38.745 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.745 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.745 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.745 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:06:38.746 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:38.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.746 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.746 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.747 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:06:38.747 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:38.747 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.747 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.747 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.747 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:06:38.748 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:06:38.748 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:06:38.748 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:06:38.748 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:38.748 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:38.749 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:38.749 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:38.749 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.749 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.749 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.750 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:38.750 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:38.750 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:38.750 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:38.750 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:38.751 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:38.751 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:38.751 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:38.751 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:38.751 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:38.751 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:38.752 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:38.752 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:38.752 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.752 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.752 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:06:38.753 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:38.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.753 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.753 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:06:38.754 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:38.754 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.754 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.754 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:38.755 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.755 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.755 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:06:38.755 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:38.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.756 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.756 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:06:38.756 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:38.756 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.757 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.757 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:38.757 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.758 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.758 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:06:38.758 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:38.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.759 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.759 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:06:38.759 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:38.759 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.759 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.760 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:38.760 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.760 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.760 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.760 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:06:38.761 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:38.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.761 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.761 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.761 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:06:38.762 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:38.762 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.762 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.762 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:06:38.763 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:06:38.763 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:06:38.763 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:06:38.763 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:38.763 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:38.763 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:38.764 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.764 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:38.764 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:38.765 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:38.765 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:38.765 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:38.765 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:38.765 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:38.766 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:38.766 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:38.766 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:38.766 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:38.766 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:38.767 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:38.767 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.767 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.767 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:06:38.768 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:38.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.768 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.768 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:06:38.769 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:38.769 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.769 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.769 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:38.769 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.770 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.770 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:06:38.770 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:38.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.771 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.771 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:06:38.771 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:38.771 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.772 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.772 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:38.772 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.773 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.773 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:06:38.773 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:38.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.774 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.774 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:06:38.774 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:38.774 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.774 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.775 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:38.775 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.775 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.775 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:06:38.776 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:38.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.776 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.776 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:06:38.777 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:38.777 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.777 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.777 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:06:38.778 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:06:38.778 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:06:38.778 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:06:38.778 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:38.778 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:38.779 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:38.779 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:38.779 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.780 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:38.780 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:38.780 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:38.780 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:38.780 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:38.781 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:38.781 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:38.781 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:38.781 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:38.781 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:38.781 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:38.782 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:38.782 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:38.782 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.783 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.783 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:06:38.783 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:38.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.784 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.784 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:06:38.784 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:38.784 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.784 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.785 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:38.785 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.785 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.785 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:06:38.786 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:38.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.786 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.786 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.786 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:06:38.786 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:38.787 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.787 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.787 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:38.787 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.788 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.788 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:06:38.788 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:38.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.789 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.789 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:06:38.789 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:38.789 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.790 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.790 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:38.790 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:38.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.790 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:38.791 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:06:38.791 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:38.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.791 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:38.792 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:06:38.792 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:38.792 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.792 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.792 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:06:38.793 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:06:38.793 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:06:38.793 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:06:38.793 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:38.793 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull", 2023-09-13T06:06:38.794 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:38.794 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:38.794 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:38.794 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.794 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:38.795 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:06:38.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.795 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:38.795 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:38.795 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:38.795 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:38.796 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:38.796 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:38.796 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:06:38.796 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:38.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.797 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:38.797 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:38.797 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:38.797 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:38.798 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:38.798 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:38.798 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:06:38.798 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:38.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.799 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:38.799 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:38.799 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:38.799 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:38.800 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:38.800 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:38.800 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:06:38.800 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:38.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.801 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:38.801 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:38.801 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:38.801 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:38.802 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:38.802 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:38.802 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:06:38.802 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:38.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.803 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:38.803 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:38.803 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:38.803 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:38.803 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:38.804 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:38.804 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:06:38.804 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:38.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:38.806 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:38.806 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:06:38.806 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:38.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:38.808 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:06:38.808 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:38.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:38.808 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:38.809 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:38.809 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:38.809 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:38.809 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:38.809 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:38.809 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:06:38.810 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:38.810 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.810 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:38.810 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:06:38.810 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:06:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:06:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:06:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:06:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:06:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:06:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:06:38.812 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:06:38.812 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:06:38.812 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:06:38.812 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:06:38.812 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:06:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:06:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:06:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:06:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:06:38.814 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:06:38.814 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:06:38.814 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:06:38.814 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:06:38.814 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:06:38.815 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:06:38.815 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:06:38.815 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:06:38.815 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:38.815 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:06:38.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 -- 172.21.15.130:0/4227115434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6ac065b20 msgr2=0x7fe6ac067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:38.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6ac065b20 0x7fe6ac067fe0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009b60 tx=0x7fe6b0009190 comp rx=0 tx=0).stop 2023-09-13T06:06:38.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 -- 172.21.15.130:0/4227115434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6c015e560 msgr2=0x7fe6c01529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:38.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6c015e560 0x7fe6c01529d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800c730 tx=0x7fe6b800cbf0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 -- 172.21.15.130:0/4227115434 shutdown_connections 2023-09-13T06:06:38.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6ac065b20 0x7fe6ac067fe0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c0157920 0x7fe6c0152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6c015e560 0x7fe6c01529d0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 --2- 172.21.15.130:0/4227115434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c00b0f40 0x7fe6c0136880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 -- 172.21.15.130:0/4227115434 >> 172.21.15.130:0/4227115434 conn(0x7fe6c0065990 msgr2=0x7fe6c0151110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:38.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 -- 172.21.15.130:0/4227115434 shutdown_connections 2023-09-13T06:06:38.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.612+0000 7fe6c6848640 1 -- 172.21.15.130:0/4227115434 wait complete. 2023-09-13T06:06:38.820 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:38.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f55067db640 1 Processor -- start 2023-09-13T06:06:38.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f55067db640 1 -- start start 2023-09-13T06:06:38.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f55067db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f55000d1750 0x7f550015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f55067db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5500146f30 0x7f55000b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f55067db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55000b63c0 con 0x7f55000d1090 2023-09-13T06:06:38.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f55067db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550015dea0 con 0x7f5500146f30 2023-09-13T06:06:38.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f55067db640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55000d0c20 con 0x7f55000d1750 2023-09-13T06:06:38.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f5504d78640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5500146f30 0x7f55000b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f5504d78640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5500146f30 0x7f55000b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:58528/0 (socket says 172.21.15.130:58528) 2023-09-13T06:06:38.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f54ff7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f55000d1090 0x7f5500146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35710/0 (socket says 172.21.15.130:35710) 2023-09-13T06:06:38.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f5504d78640 1 -- 172.21.15.130:0/3522246041 learned_addr learned my addr 172.21.15.130:0/3522246041 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:38.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f54fffff640 1 --2- 172.21.15.130:0/3522246041 >> v2:172.21.15.164:3300/0 conn(0x7f55000d1750 0x7f550015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f5504d78640 1 -- 172.21.15.130:0/3522246041 >> v2:172.21.15.164:3300/0 conn(0x7f55000d1750 msgr2=0x7f550015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:38.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f5504d78640 1 --2- 172.21.15.130:0/3522246041 >> v2:172.21.15.164:3300/0 conn(0x7f55000d1750 0x7f550015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f5504d78640 1 -- 172.21.15.130:0/3522246041 >> v1:172.21.15.130:6789/0 conn(0x7f55000d1090 legacy=0x7f5500146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:38.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.956+0000 7f5504d78640 1 -- 172.21.15.130:0/3522246041 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000b6610 con 0x7f5500146f30 2023-09-13T06:06:38.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f5504d78640 1 --2- 172.21.15.130:0/3522246041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5500146f30 0x7f55000b70f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5500073cd0 tx=0x7f54f801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6efc8ea5d201e813 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:38.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f54feffd640 1 -- 172.21.15.130:0/3522246041 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f80a57d0 con 0x7f5500146f30 2023-09-13T06:06:38.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f54feffd640 1 -- 172.21.15.130:0/3522246041 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f80a5930 con 0x7f5500146f30 2023-09-13T06:06:38.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f54feffd640 1 -- 172.21.15.130:0/3522246041 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f80a5cc0 con 0x7f5500146f30 2023-09-13T06:06:38.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f55067db640 1 -- 172.21.15.130:0/3522246041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5500146f30 msgr2=0x7f55000b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:38.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f55067db640 1 --2- 172.21.15.130:0/3522246041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5500146f30 0x7f55000b70f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5500073cd0 tx=0x7f54f801c910 comp rx=0 tx=0).stop 2023-09-13T06:06:38.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f55067db640 1 -- 172.21.15.130:0/3522246041 shutdown_connections 2023-09-13T06:06:38.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f55067db640 1 --2- 172.21.15.130:0/3522246041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5500146f30 0x7f55000b70f0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f55067db640 1 --2- 172.21.15.130:0/3522246041 >> v2:172.21.15.164:3300/0 conn(0x7f55000d1750 0x7f550015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f55067db640 1 -- 172.21.15.130:0/3522246041 >> 172.21.15.130:0/3522246041 conn(0x7f550006f170 msgr2=0x7f550006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:38.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f55067db640 1 -- 172.21.15.130:0/3522246041 shutdown_connections 2023-09-13T06:06:38.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.960+0000 7f55067db640 1 -- 172.21.15.130:0/3522246041 wait complete. 2023-09-13T06:06:38.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f55067db640 1 Processor -- start 2023-09-13T06:06:38.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f55067db640 1 -- start start 2023-09-13T06:06:38.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f55067db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55000d1090 0x7f55001432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f55067db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55000d1750 0x7f550015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f55067db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5500146f30 0x7f550013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f55067db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550015be90 con 0x7f55000d1750 2023-09-13T06:06:38.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f55067db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550015c170 con 0x7f55000d1090 2023-09-13T06:06:38.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f55067db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550015c450 con 0x7f5500146f30 2023-09-13T06:06:38.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54ff7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55000d1750 0x7f550015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54ff7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55000d1750 0x7f550015b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:58536/0 (socket says 172.21.15.130:58536) 2023-09-13T06:06:38.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54ff7fe640 1 -- 172.21.15.130:0/3372193709 learned_addr learned my addr 172.21.15.130:0/3372193709 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:38.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f5504d78640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5500146f30 0x7f550013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54fffff640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55000d1090 0x7f55001432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54ff7fe640 1 -- 172.21.15.130:0/3372193709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5500146f30 msgr2=0x7f550013eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:38.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54ff7fe640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5500146f30 0x7f550013eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54ff7fe640 1 -- 172.21.15.130:0/3372193709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55000d1090 msgr2=0x7f55001432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:38.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54ff7fe640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55000d1090 0x7f55001432e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:38.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54ff7fe640 1 -- 172.21.15.130:0/3372193709 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8009b30 con 0x7f55000d1750 2023-09-13T06:06:38.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54fffff640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55000d1090 0x7f55001432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:38.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f5504d78640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5500146f30 0x7f550013eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:38.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54ff7fe640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55000d1750 0x7f550015b4b0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f54f400c500 tx=0x7f54f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:38.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54fcff9640 1 -- 172.21.15.130:0/3372193709 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4007500 con 0x7f55000d1750 2023-09-13T06:06:38.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54fcff9640 1 -- 172.21.15.130:0/3372193709 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f4007660 con 0x7f55000d1750 2023-09-13T06:06:38.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f54fcff9640 1 -- 172.21.15.130:0/3372193709 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4004a10 con 0x7f55000d1750 2023-09-13T06:06:38.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f55067db640 1 -- 172.21.15.130:0/3372193709 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55000b7e40 con 0x7f55000d1750 2023-09-13T06:06:38.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.964+0000 7f55067db640 1 -- 172.21.15.130:0/3372193709 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550015c730 con 0x7f55000d1750 2023-09-13T06:06:38.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.968+0000 7f55067db640 1 -- 172.21.15.130:0/3372193709 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5500166740 con 0x7f55000d1750 2023-09-13T06:06:38.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.968+0000 7f54fcff9640 1 -- 172.21.15.130:0/3372193709 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f54f4004b70 con 0x7f55000d1750 2023-09-13T06:06:38.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.968+0000 7f54fcff9640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54ec065b20 0x7f54ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:38.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.968+0000 7f54fcff9640 1 -- 172.21.15.130:0/3372193709 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54f4082460 con 0x7f55000d1750 2023-09-13T06:06:38.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.968+0000 7f54fffff640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54ec065b20 0x7f54ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:38.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.968+0000 7f54fcff9640 1 -- 172.21.15.130:0/3372193709 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7f54ec06d650 con 0x7f55000d1750 2023-09-13T06:06:38.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.968+0000 7f54fffff640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54ec065b20 0x7f54ec067fe0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f550015dd80 tx=0x7f54f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:38.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:38.972+0000 7f54fcff9640 1 -- 172.21.15.130:0/3372193709 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f54f4018060 con 0x7f55000d1750 2023-09-13T06:06:39.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.156+0000 7f55067db640 1 -- 172.21.15.130:0/3372193709 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55000618a0 con 0x7f55000d1750 2023-09-13T06:06:39.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.156+0000 7f54fcff9640 1 -- 172.21.15.130:0/3372193709 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f5500166740 con 0x7f55000d1750 2023-09-13T06:06:39.160 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:39.160 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3211692360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3211692360},{"type":"v1","addr":"172.21.15.164:6834","nonce":3211692360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2453731046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2453731046},{"type":"v1","addr":"172.21.15.130:6835","nonce":2453731046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2896649577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2896649577},{"type":"v1","addr":"172.21.15.164:6835","nonce":2896649577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:06:17.421334+0000","modified":"2023-09-13T06:06:20.748001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6888":{"gid":6888,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/878642631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":878642631},{"type":"v1","addr":"172.21.15.130:6837","nonce":878642631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-09-13T06:06:39.160 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 51 2023-09-13T06:06:39.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 -- 172.21.15.130:0/3372193709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54ec065b20 msgr2=0x7f54ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:39.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54ec065b20 0x7f54ec067fe0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f550015dd80 tx=0x7f54f0008040 comp rx=0 tx=0).stop 2023-09-13T06:06:39.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 -- 172.21.15.130:0/3372193709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55000d1750 msgr2=0x7f550015b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:39.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55000d1750 0x7f550015b4b0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f54f400c500 tx=0x7f54f400c9c0 comp rx=0 tx=0).stop 2023-09-13T06:06:39.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 -- 172.21.15.130:0/3372193709 shutdown_connections 2023-09-13T06:06:39.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f54ec065b20 0x7f54ec067fe0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:39.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5500146f30 0x7f550013eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:39.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55000d1750 0x7f550015b4b0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:39.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 --2- 172.21.15.130:0/3372193709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55000d1090 0x7f55001432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:39.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 -- 172.21.15.130:0/3372193709 >> 172.21.15.130:0/3372193709 conn(0x7f550006f170 msgr2=0x7f55000cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:39.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 -- 172.21.15.130:0/3372193709 shutdown_connections 2023-09-13T06:06:39.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.160+0000 7f55067db640 1 -- 172.21.15.130:0/3372193709 wait complete. 2023-09-13T06:06:39.180 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-09-13T06:06:39.338 INFO:teuthology.orchestra.run.smithi130.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":6888,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.964185636,"mdsmap_epoch":51,"osdmap_epoch":106,"osdmap_epoch_barrier":106,"uptime":27.039664011999999} 2023-09-13T06:06:39.338 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 6888, "mdsmap_epoch": 51, "osdmap_epoch": 106, "osdmap_epoch_barrier": 106, "rank_uptime": 20.964185636, "state": "up:active", "uptime": 27.039664012, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:06:39.339 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-13T06:06:39.339 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:39.340 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:39.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:39.350 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-09-13T06:06:39.402 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:06:39.400+0000 7faa03655640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-09-13T06:06:39.405 INFO:teuthology.orchestra.run.smithi130.stderr:dd: failed to open 'small_file_1': Permission denied 2023-09-13T06:06:39.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:06:39.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:39.407 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-09-13T06:06:39.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:39.459 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-09-13T06:06:39.570 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:06:39.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17cb848640 1 Processor -- start 2023-09-13T06:06:39.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17cb848640 1 -- start start 2023-09-13T06:06:39.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17cb848640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f17c40d1090 0x7f17c415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:39.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17cb848640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17c4146f30 0x7f17c40b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:39.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17cb848640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c40b63c0 con 0x7f17c40d1750 2023-09-13T06:06:39.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17cb848640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c415dea0 con 0x7f17c40d1090 2023-09-13T06:06:39.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17cb848640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40d0c20 con 0x7f17c4146f30 2023-09-13T06:06:39.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17c8de3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f17c40d1090 0x7f17c415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:39.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17c8de3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f17c40d1090 0x7f17c415d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:58552/0 (socket says 172.21.15.130:58552) 2023-09-13T06:06:39.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17c8de3640 1 -- 172.21.15.130:0/3010632908 learned_addr learned my addr 172.21.15.130:0/3010632908 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:39.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17c9de5640 1 --2- 172.21.15.130:0/3010632908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17c4146f30 0x7f17c40b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:39.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17c8de3640 1 -- 172.21.15.130:0/3010632908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17c4146f30 msgr2=0x7f17c40b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:39.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17c8de3640 1 --2- 172.21.15.130:0/3010632908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17c4146f30 0x7f17c40b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:39.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17c8de3640 1 -- 172.21.15.130:0/3010632908 >> v1:172.21.15.164:6789/0 conn(0x7f17c40d1750 legacy=0x7f17c4146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:39.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.708+0000 7f17c8de3640 1 -- 172.21.15.130:0/3010632908 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40b6610 con 0x7f17c40d1090 2023-09-13T06:06:39.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17c8de3640 1 --2- 172.21.15.130:0/3010632908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c40d1090 0x7f17c415d960 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009870 tx=0x7f17b401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f011ad46f0cb33e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:39.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17bbfff640 1 -- 172.21.15.130:0/3010632908 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40aa670 con 0x7f17c40d1090 2023-09-13T06:06:39.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17bbfff640 1 -- 172.21.15.130:0/3010632908 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b40aa7d0 con 0x7f17c40d1090 2023-09-13T06:06:39.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17bbfff640 1 -- 172.21.15.130:0/3010632908 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40aab60 con 0x7f17c40d1090 2023-09-13T06:06:39.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17cb848640 1 -- 172.21.15.130:0/3010632908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c40d1090 msgr2=0x7f17c415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:39.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17cb848640 1 --2- 172.21.15.130:0/3010632908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c40d1090 0x7f17c415d960 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009870 tx=0x7f17b401c510 comp rx=0 tx=0).stop 2023-09-13T06:06:39.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17cb848640 1 -- 172.21.15.130:0/3010632908 shutdown_connections 2023-09-13T06:06:39.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17cb848640 1 --2- 172.21.15.130:0/3010632908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17c4146f30 0x7f17c40b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:39.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17cb848640 1 --2- 172.21.15.130:0/3010632908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c40d1090 0x7f17c415d960 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:39.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17cb848640 1 -- 172.21.15.130:0/3010632908 >> 172.21.15.130:0/3010632908 conn(0x7f17c406f170 msgr2=0x7f17c406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:39.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17cb848640 1 -- 172.21.15.130:0/3010632908 shutdown_connections 2023-09-13T06:06:39.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.712+0000 7f17cb848640 1 -- 172.21.15.130:0/3010632908 wait complete. 2023-09-13T06:06:39.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17cb848640 1 Processor -- start 2023-09-13T06:06:39.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17cb848640 1 -- start start 2023-09-13T06:06:39.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17cb848640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17c40d1090 0x7f17c4164110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:39.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17cb848640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17c40d1750 0x7f17c413eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:39.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17cb848640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c4146f30 0x7f17c4162090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:39.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17cb848640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c415b870 con 0x7f17c4146f30 2023-09-13T06:06:39.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17cb848640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4164650 con 0x7f17c40d1750 2023-09-13T06:06:39.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17cb848640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c415abf0 con 0x7f17c40d1090 2023-09-13T06:06:39.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c9de5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c4146f30 0x7f17c4162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:39.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c9de5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c4146f30 0x7f17c4162090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:58566/0 (socket says 172.21.15.130:58566) 2023-09-13T06:06:39.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c9de5640 1 -- 172.21.15.130:0/415524912 learned_addr learned my addr 172.21.15.130:0/415524912 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:39.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c9de5640 1 -- 172.21.15.130:0/415524912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17c40d1090 msgr2=0x7f17c4164110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:39.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c8de3640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17c40d1750 0x7f17c413eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:39.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c95e4640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17c40d1090 0x7f17c4164110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:39.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c9de5640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17c40d1090 0x7f17c4164110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:39.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c9de5640 1 -- 172.21.15.130:0/415524912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17c40d1750 msgr2=0x7f17c413eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:39.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c9de5640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17c40d1750 0x7f17c413eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:39.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c9de5640 1 -- 172.21.15.130:0/415524912 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40094d0 con 0x7f17c4146f30 2023-09-13T06:06:39.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c95e4640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17c40d1090 0x7f17c4164110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:39.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c8de3640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17c40d1750 0x7f17c413eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:39.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17c9de5640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c4146f30 0x7f17c4162090 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f17bc007e60 tx=0x7f17bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:39.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17b9ffb640 1 -- 172.21.15.130:0/415524912 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc014420 con 0x7f17c4146f30 2023-09-13T06:06:39.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17b9ffb640 1 -- 172.21.15.130:0/415524912 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc0145a0 con 0x7f17c4146f30 2023-09-13T06:06:39.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17cb848640 1 -- 172.21.15.130:0/415524912 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c40b7e40 con 0x7f17c4146f30 2023-09-13T06:06:39.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17b9ffb640 1 -- 172.21.15.130:0/415524912 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc014950 con 0x7f17c4146f30 2023-09-13T06:06:39.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.716+0000 7f17cb848640 1 -- 172.21.15.130:0/415524912 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c415b1b0 con 0x7f17c4146f30 2023-09-13T06:06:39.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.720+0000 7f17cb848640 1 -- 172.21.15.130:0/415524912 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c415b9b0 con 0x7f17c4146f30 2023-09-13T06:06:39.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.720+0000 7f17b9ffb640 1 -- 172.21.15.130:0/415524912 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f17bc014ab0 con 0x7f17c4146f30 2023-09-13T06:06:39.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.720+0000 7f17b9ffb640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17a8065b20 0x7f17a8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:39.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.720+0000 7f17b9ffb640 1 -- 172.21.15.130:0/415524912 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17bc083c80 con 0x7f17c4146f30 2023-09-13T06:06:39.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.720+0000 7f17b9ffb640 1 -- 172.21.15.130:0/415524912 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=108}) v3 -- 0x7f17a806d650 con 0x7f17c4146f30 2023-09-13T06:06:39.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.720+0000 7f17c95e4640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17a8065b20 0x7f17a8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:39.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.720+0000 7f17c95e4640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17a8065b20 0x7f17a8067fe0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f17c0000f70 tx=0x7f17c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:39.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.724+0000 7f17b9ffb640 1 -- 172.21.15.130:0/415524912 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f17c415b9b0 con 0x7f17c4146f30 2023-09-13T06:06:39.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.872+0000 7f17cb848640 1 -- 172.21.15.130:0/415524912 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f17c415b9b0 con 0x7f17c4146f30 2023-09-13T06:06:39.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.872+0000 7f17b9ffb640 1 -- 172.21.15.130:0/415524912 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v107) v1 ==== 81+0+34218 (secure 0 0 0) 0x7f17c415b9b0 con 0x7f17c4146f30 2023-09-13T06:06:39.876 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:39.876 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:06:39.876 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 107, 2023-09-13T06:06:39.877 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:06:39.877 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:06:39.877 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:06:39.404712+0000", 2023-09-13T06:06:39.877 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:06:39.877 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:06:39.877 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:06:39.878 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:06:39.878 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:06:39.878 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:06:39.878 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:06:39.878 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:06:39.879 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:06:39.879 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:39.879 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:06:39.879 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:06:39.879 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:06:39.880 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:06:39.880 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:06:39.880 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 13, 2023-09-13T06:06:39.880 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:06:39.880 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:06:39.881 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:06:39.881 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:06:39.881 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:06:39.881 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:06:39.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.881 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:06:39.882 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:06:39.882 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:06:39.882 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:06:39.882 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:06:39.882 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:39.883 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:39.883 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:39.883 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:39.883 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:39.883 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:39.884 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:39.884 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:39.884 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:39.884 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:39.884 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:06:39.885 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:06:39.885 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:06:39.885 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:06:39.885 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:06:39.885 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:39.885 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:39.886 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:39.886 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:39.886 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:39.886 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:39.886 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:39.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.887 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "104", 2023-09-13T06:06:39.887 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:39.887 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:39.887 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:39.888 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:39.888 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:39.888 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:39.888 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:39.888 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:39.889 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:39.889 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:39.889 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:39.889 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:39.889 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:39.889 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:39.890 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:39.890 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:39.890 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:39.890 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:39.890 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:39.891 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:39.891 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:39.891 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:39.891 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:39.891 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:39.892 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:39.892 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:39.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.892 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:39.892 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:39.892 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:39.893 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:39.893 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:39.893 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:39.893 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:39.893 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:39.894 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:39.894 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:39.894 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:39.894 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:39.894 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:06:39.895 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:06:39.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.895 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:39.895 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:06:39.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.895 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:39.896 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:06:39.896 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:06:39.896 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:06:39.896 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:39.896 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:39.897 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:39.897 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:39.897 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:39.897 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.898 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 12, 2023-09-13T06:06:39.898 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:06:39.898 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:15.152093+0000", 2023-09-13T06:06:39.898 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:06:39.899 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:06:39.899 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:39.899 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:39.899 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:39.899 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:39.899 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:39.900 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:39.900 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:39.900 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:39.900 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:39.900 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:39.901 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:06:39.901 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:06:39.901 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:06:39.901 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:06:39.901 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:06:39.902 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:39.902 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:39.902 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:39.902 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:39.902 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:39.903 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:39.903 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:39.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.903 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "104", 2023-09-13T06:06:39.903 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:39.903 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:39.904 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:39.904 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:39.904 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:39.904 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:39.904 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:39.905 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:39.905 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:39.905 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:39.905 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:39.905 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:39.906 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:39.906 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:39.906 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:39.906 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:39.906 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:39.907 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:39.907 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:39.907 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:39.907 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:39.907 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:39.907 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:39.908 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:39.908 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:39.908 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:39.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.908 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:39.909 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:39.909 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:39.909 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:39.909 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:39.909 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:39.910 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:39.910 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:39.910 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:39.910 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:39.910 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:39.910 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:39.911 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:06:39.911 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:06:39.911 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:06:39.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.911 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:39.912 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:39.912 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:06:39.912 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.912 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:39.912 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:06:39.913 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:06:39.913 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:39.913 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:39.913 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:39.913 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:39.914 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:39.914 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:39.914 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.914 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.915 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 13, 2023-09-13T06:06:39.915 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:06:39.915 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:16.467343+0000", 2023-09-13T06:06:39.915 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 3, 2023-09-13T06:06:39.915 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full", 2023-09-13T06:06:39.915 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:39.916 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:39.916 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:39.916 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:39.916 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:39.916 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:39.917 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:39.917 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:39.917 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:39.917 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:39.917 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:06:39.918 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:06:39.918 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:06:39.918 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:06:39.918 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:06:39.918 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:39.918 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:39.919 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:39.919 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:39.919 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:39.919 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:39.919 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:39.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.920 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "104", 2023-09-13T06:06:39.920 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:39.920 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:39.920 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:39.921 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:39.921 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:39.921 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:39.921 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:39.921 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:39.922 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:39.922 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:39.922 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:39.922 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:39.922 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:39.923 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:39.923 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:39.923 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:39.923 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:39.923 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:39.923 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:39.924 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:39.924 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:39.924 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:39.924 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:39.924 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:39.925 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:39.925 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:39.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.925 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:39.925 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:39.926 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:39.926 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:39.926 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:39.926 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:39.926 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:39.927 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:39.927 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:39.927 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:39.927 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:39.927 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:39.927 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:06:39.928 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:06:39.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.928 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:39.928 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:39.928 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:06:39.929 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.929 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:39.929 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:06:39.929 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:06:39.930 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:39.930 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:06:39.930 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:06:39.930 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:39.930 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:39.931 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:39.931 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.931 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.931 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:39.931 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:06:39.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.932 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:39.932 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:39.932 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:39.932 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:39.932 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:39.933 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:39.933 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:39.933 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:39.933 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:39.933 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:39.934 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:39.934 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:39.934 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:39.934 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.935 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.935 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:06:39.935 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:39.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.936 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.936 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:06:39.936 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:39.936 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.936 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.937 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:39.937 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.937 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.937 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:06:39.938 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:39.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.938 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.938 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:06:39.939 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:39.939 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.939 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.939 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:39.940 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.940 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.940 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:06:39.940 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:39.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.941 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.941 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:06:39.941 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:39.941 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.942 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.942 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:39.942 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.943 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.945 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:06:39.945 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:39.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.945 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.946 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:06:39.946 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:39.946 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.946 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.947 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:06:39.947 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:06:39.947 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:06:39.947 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:06:39.947 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:39.948 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:39.948 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:39.948 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:39.948 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.949 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:39.949 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:39.949 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:39.949 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:39.950 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:39.950 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:39.950 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:39.950 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:39.950 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:39.950 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:39.951 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:39.951 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:39.951 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:39.951 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.952 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.952 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:06:39.952 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:39.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.953 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.953 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:06:39.953 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:39.953 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.953 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.954 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:39.954 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.954 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.955 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:06:39.955 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:39.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.955 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.955 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:06:39.956 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:39.956 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.956 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.956 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:39.957 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.957 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.957 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.957 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:06:39.957 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:39.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.958 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.958 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:06:39.958 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:39.958 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.959 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.959 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:39.959 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.960 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.960 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:06:39.960 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:39.960 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.961 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.961 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:06:39.961 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:39.961 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.961 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.962 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.962 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:06:39.962 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:06:39.962 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:06:39.962 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:06:39.963 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:39.963 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:39.963 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:39.963 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:39.963 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.964 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:39.964 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:39.964 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:39.964 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:39.965 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:39.965 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:39.965 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:39.965 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:39.965 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:39.966 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:39.966 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:39.966 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:39.966 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:39.966 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.967 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.967 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:06:39.967 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:39.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.968 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.968 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:06:39.968 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:39.968 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.968 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.969 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:39.969 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.969 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.969 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:06:39.970 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:39.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.970 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.970 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:06:39.971 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:39.971 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.971 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.971 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:39.972 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.972 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.972 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:06:39.972 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:39.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.973 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.973 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:06:39.973 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:39.973 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.974 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.974 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:39.974 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.975 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.975 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:06:39.975 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:39.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.976 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.976 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:06:39.976 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:39.976 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.976 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.977 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:06:39.977 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:06:39.977 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:06:39.977 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:06:39.977 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:39.978 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:39.978 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:39.978 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:39.978 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.979 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:39.979 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:39.979 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:39.979 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:39.979 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:39.980 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:39.980 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:39.980 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:39.980 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:39.980 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:39.981 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:39.981 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:39.981 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:39.981 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.982 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.982 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:06:39.982 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:39.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.982 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.983 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:06:39.983 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:39.983 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.983 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.984 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:39.984 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.984 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.984 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:06:39.985 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:39.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.985 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.985 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:06:39.985 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:39.986 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.986 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.986 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:39.986 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.987 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.987 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:06:39.987 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:39.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.988 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.988 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:06:39.988 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:39.988 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.988 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.989 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:39.989 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.989 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.989 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.990 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:06:39.990 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:39.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.990 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.990 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:06:39.991 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:39.991 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.991 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.991 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:06:39.992 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:06:39.992 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:06:39.992 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:06:39.992 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:39.992 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:39.993 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:39.993 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.993 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:39.993 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:39.994 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:39.994 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:39.994 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:39.994 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:39.994 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:39.995 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:39.995 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:39.995 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:39.995 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:39.995 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:39.996 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:39.996 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.996 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.996 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:06:39.996 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:39.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.997 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:39.997 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:06:39.997 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:39.998 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:39.998 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:39.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.998 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:39.998 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:39.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:39.999 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:39.999 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:06:39.999 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:39.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:39.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.000 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.000 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:06:40.000 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:40.000 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.000 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.001 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:40.001 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.001 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.002 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:06:40.002 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:40.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.002 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.003 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:06:40.003 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:40.003 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.003 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.003 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:40.004 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.004 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.004 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:06:40.004 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:40.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.005 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.005 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:06:40.005 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:40.006 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.006 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.006 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:06:40.006 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:06:40.007 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:06:40.007 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:06:40.007 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:40.007 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull", 2023-09-13T06:06:40.007 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:40.008 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:40.008 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.008 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:40.009 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:40.009 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:40.009 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:40.009 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:40.009 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:40.009 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:40.010 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:40.010 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:40.010 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:40.010 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:40.010 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:40.011 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:40.011 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.011 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.011 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:06:40.012 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:40.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.012 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.012 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:06:40.012 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:40.013 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.013 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.013 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:40.013 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.014 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.014 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:06:40.014 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:40.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.015 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.015 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:06:40.015 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:40.015 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.015 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.016 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:40.016 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.016 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.017 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:06:40.017 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:40.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.017 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.018 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:06:40.018 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:40.018 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.018 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.019 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:40.019 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.019 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.019 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:06:40.019 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:40.020 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.020 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.020 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:06:40.020 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:40.021 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.021 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.021 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:06:40.021 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:06:40.022 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:06:40.022 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:06:40.022 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:40.022 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:40.022 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:40.022 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.023 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:40.023 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:40.023 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:40.024 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:40.024 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:40.024 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:40.024 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:40.024 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:40.024 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:40.025 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:40.025 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:40.025 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:40.025 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:40.025 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.026 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.026 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:06:40.026 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:40.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.027 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.027 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:06:40.027 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:40.027 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.027 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.028 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:40.028 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.028 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.029 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:06:40.029 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:40.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.029 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.029 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:06:40.030 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:40.030 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.030 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.030 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:40.031 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.031 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.031 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:06:40.031 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:40.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.032 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.032 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:06:40.032 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:40.032 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.033 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.033 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:40.033 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.034 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.034 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:06:40.034 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:40.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.035 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.035 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:06:40.035 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:40.035 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.035 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.036 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:06:40.036 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:06:40.036 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:06:40.036 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:06:40.036 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:40.037 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:40.037 INFO:teuthology.orchestra.run.smithi130.stdout: "full", 2023-09-13T06:06:40.037 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:40.037 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.038 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:40.038 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:40.038 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:40.038 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:40.038 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:40.039 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:40.039 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:40.039 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:40.039 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:40.039 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:40.040 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:40.040 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:40.040 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:40.040 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.041 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.041 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:06:40.041 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:40.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.042 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.042 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:06:40.042 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:40.042 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.042 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.043 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:40.043 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.043 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.043 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:06:40.044 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:40.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.044 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.044 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:06:40.044 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:40.045 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.045 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.045 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:40.045 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.046 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.046 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:06:40.046 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:40.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.047 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.047 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:06:40.047 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:40.047 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.048 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.048 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:40.048 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:40.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.048 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:40.049 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:06:40.049 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:40.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.049 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:40.050 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:06:40.050 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:40.050 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.050 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.051 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:06:40.051 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:06:40.051 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:06:40.051 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:06:40.051 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:40.051 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull", 2023-09-13T06:06:40.052 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:40.052 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:40.052 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:40.052 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.052 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:40.053 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:06:40.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.053 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:40.053 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:40.053 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:40.053 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:40.054 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:40.054 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:40.054 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:06:40.054 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:40.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.055 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:40.055 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:40.055 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:40.055 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:40.056 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:40.056 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:40.056 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:06:40.056 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:40.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.057 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:40.057 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:40.057 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:40.057 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:40.057 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:40.058 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:40.058 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:06:40.058 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:40.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.059 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:40.059 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:40.059 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:40.059 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:40.059 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:40.059 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:40.060 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:06:40.060 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:40.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.060 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:40.061 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:40.061 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:40.061 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:40.061 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:40.061 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:40.062 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:06:40.062 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:40.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.062 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:40.063 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:40.063 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:40.063 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:40.063 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:40.063 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:40.063 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:06:40.064 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:40.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.064 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:40.064 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:40.065 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:40.065 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:40.065 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:40.065 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:40.065 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:06:40.066 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:40.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:40.066 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:40.066 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:40.066 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:40.067 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:40.067 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:40.067 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:40.067 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:06:40.067 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:40.068 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.068 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:40.068 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:06:40.068 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:06:40.068 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:06:40.069 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:06:40.069 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:06:40.069 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:06:40.069 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:06:40.069 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:06:40.069 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:06:40.070 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:06:40.070 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:06:40.070 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:06:40.070 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:06:40.070 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:06:40.071 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:40.071 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:06:40.071 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:06:40.071 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:06:40.072 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:06:40.072 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:06:40.072 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:06:40.072 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:06:40.072 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:06:40.072 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:06:40.073 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:06:40.073 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:06:40.073 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:40.073 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:06:40.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 -- 172.21.15.130:0/415524912 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17a8065b20 msgr2=0x7f17a8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:40.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17a8065b20 0x7f17a8067fe0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f17c0000f70 tx=0x7f17c0009040 comp rx=0 tx=0).stop 2023-09-13T06:06:40.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 -- 172.21.15.130:0/415524912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c4146f30 msgr2=0x7f17c4162090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:40.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c4146f30 0x7f17c4162090 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f17bc007e60 tx=0x7f17bc00e4b0 comp rx=0 tx=0).stop 2023-09-13T06:06:40.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 -- 172.21.15.130:0/415524912 shutdown_connections 2023-09-13T06:06:40.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17a8065b20 0x7f17a8067fe0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:40.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17c40d1750 0x7f17c413eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:40.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c4146f30 0x7f17c4162090 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:40.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 --2- 172.21.15.130:0/415524912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17c40d1090 0x7f17c4164110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:40.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 -- 172.21.15.130:0/415524912 >> 172.21.15.130:0/415524912 conn(0x7f17c406f170 msgr2=0x7f17c406f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:40.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 -- 172.21.15.130:0/415524912 shutdown_connections 2023-09-13T06:06:40.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:39.876+0000 7f17cb848640 1 -- 172.21.15.130:0/415524912 wait complete. 2023-09-13T06:06:40.078 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:06:45.079 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:06:45.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:06:45.131 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:06:45.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.228+0000 7f95097ac640 1 Processor -- start 2023-09-13T06:06:45.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.228+0000 7f95097ac640 1 -- start start 2023-09-13T06:06:45.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.228+0000 7f95097ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9504159f20 0x7f95040ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.228+0000 7f95097ac640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f95040cdfc0 0x7f95040b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.228+0000 7f95097ac640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95040ccfd0 con 0x7f95040b1610 2023-09-13T06:06:45.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.228+0000 7f95097ac640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95040b00f0 con 0x7f95040cdfc0 2023-09-13T06:06:45.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.228+0000 7f95097ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95040ce420 con 0x7f9504159f20 2023-09-13T06:06:45.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.232+0000 7f9502ffd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9504159f20 0x7f95040ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:45.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.232+0000 7f94fa7fc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f95040cdfc0 0x7f95040b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:45.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.232+0000 7f95037fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f95040b1610 0x7f95040ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:59504/0 (socket says 172.21.15.130:59504) 2023-09-13T06:06:45.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.232+0000 7f95037fe640 1 -- 172.21.15.130:0/1589674117 learned_addr learned my addr 172.21.15.130:0/1589674117 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:45.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.232+0000 7f9502ffd640 1 -- 172.21.15.130:0/1589674117 >> v2:172.21.15.164:3300/0 conn(0x7f95040cdfc0 msgr2=0x7f95040b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:45.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.232+0000 7f9502ffd640 1 --2- 172.21.15.130:0/1589674117 >> v2:172.21.15.164:3300/0 conn(0x7f95040cdfc0 0x7f95040b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.232+0000 7f9502ffd640 1 -- 172.21.15.130:0/1589674117 >> v1:172.21.15.164:6789/0 conn(0x7f95040b1610 legacy=0x7f95040ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:45.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.232+0000 7f9502ffd640 1 -- 172.21.15.130:0/1589674117 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95040ced90 con 0x7f9504159f20 2023-09-13T06:06:45.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.232+0000 7f94fa7fc640 1 --2- 172.21.15.130:0/1589674117 >> v2:172.21.15.164:3300/0 conn(0x7f95040cdfc0 0x7f95040b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:45.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.232+0000 7f9502ffd640 1 --2- 172.21.15.130:0/1589674117 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9504159f20 0x7f95040ce7b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0097c0 tx=0x7f94ec01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=847caea09968ef56 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:45.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95027fc640 1 -- 172.21.15.130:0/1589674117 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec0ab600 con 0x7f9504159f20 2023-09-13T06:06:45.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95027fc640 1 -- 172.21.15.130:0/1589674117 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec0a7050 con 0x7f9504159f20 2023-09-13T06:06:45.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95027fc640 1 -- 172.21.15.130:0/1589674117 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec0ab980 con 0x7f9504159f20 2023-09-13T06:06:45.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 -- 172.21.15.130:0/1589674117 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9504159f20 msgr2=0x7f95040ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:45.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 --2- 172.21.15.130:0/1589674117 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9504159f20 0x7f95040ce7b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0097c0 tx=0x7f94ec01c480 comp rx=0 tx=0).stop 2023-09-13T06:06:45.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 -- 172.21.15.130:0/1589674117 shutdown_connections 2023-09-13T06:06:45.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 --2- 172.21.15.130:0/1589674117 >> v2:172.21.15.164:3300/0 conn(0x7f95040cdfc0 0x7f95040b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 --2- 172.21.15.130:0/1589674117 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9504159f20 0x7f95040ce7b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 -- 172.21.15.130:0/1589674117 >> 172.21.15.130:0/1589674117 conn(0x7f9504065990 msgr2=0x7f9504065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:45.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 -- 172.21.15.130:0/1589674117 shutdown_connections 2023-09-13T06:06:45.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 -- 172.21.15.130:0/1589674117 wait complete. 2023-09-13T06:06:45.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 Processor -- start 2023-09-13T06:06:45.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 -- start start 2023-09-13T06:06:45.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95040b1610 0x7f950414fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95040cdfc0 0x7f950414f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9504159f20 0x7f9504159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95041597d0 con 0x7f95040cdfc0 2023-09-13T06:06:45.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95040aa310 con 0x7f95040b1610 2023-09-13T06:06:45.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.236+0000 7f95097ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95040aa5f0 con 0x7f9504159f20 2023-09-13T06:06:45.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fa7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95040cdfc0 0x7f950414f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:45.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f9502ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95040b1610 0x7f950414fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:45.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fa7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95040cdfc0 0x7f950414f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44272/0 (socket says 172.21.15.130:44272) 2023-09-13T06:06:45.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fa7fc640 1 -- 172.21.15.130:0/202022337 learned_addr learned my addr 172.21.15.130:0/202022337 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:45.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f95037fe640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9504159f20 0x7f9504159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:45.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fa7fc640 1 -- 172.21.15.130:0/202022337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9504159f20 msgr2=0x7f9504159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:45.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fa7fc640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9504159f20 0x7f9504159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fa7fc640 1 -- 172.21.15.130:0/202022337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95040b1610 msgr2=0x7f950414fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:45.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fa7fc640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95040b1610 0x7f950414fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fa7fc640 1 -- 172.21.15.130:0/202022337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f4009420 con 0x7f95040cdfc0 2023-09-13T06:06:45.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fa7fc640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95040cdfc0 0x7f950414f2a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f94f400ebe0 tx=0x7f94f400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:45.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fbfff640 1 -- 172.21.15.130:0/202022337 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f400eee0 con 0x7f95040cdfc0 2023-09-13T06:06:45.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fbfff640 1 -- 172.21.15.130:0/202022337 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f400cc30 con 0x7f95040cdfc0 2023-09-13T06:06:45.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f95097ac640 1 -- 172.21.15.130:0/202022337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec009420 con 0x7f95040cdfc0 2023-09-13T06:06:45.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fbfff640 1 -- 172.21.15.130:0/202022337 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4013470 con 0x7f95040cdfc0 2023-09-13T06:06:45.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f95097ac640 1 -- 172.21.15.130:0/202022337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95040aabb0 con 0x7f95040cdfc0 2023-09-13T06:06:45.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f95097ac640 1 -- 172.21.15.130:0/202022337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95040618a0 con 0x7f95040cdfc0 2023-09-13T06:06:45.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fbfff640 1 -- 172.21.15.130:0/202022337 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f94f40135d0 con 0x7f95040cdfc0 2023-09-13T06:06:45.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.240+0000 7f94fbfff640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f94e4065b20 0x7f94e4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.244+0000 7f94fbfff640 1 -- 172.21.15.130:0/202022337 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94f40835b0 con 0x7f95040cdfc0 2023-09-13T06:06:45.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.244+0000 7f9502ffd640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f94e4065b20 0x7f94e4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:45.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.244+0000 7f94fbfff640 1 -- 172.21.15.130:0/202022337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=110}) v3 -- 0x7f94e406d650 con 0x7f95040cdfc0 2023-09-13T06:06:45.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.244+0000 7f9502ffd640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f94e4065b20 0x7f94e4067fe0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0ad000 tx=0x7f94ec0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:45.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.248+0000 7f94fbfff640 1 -- 172.21.15.130:0/202022337 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f94f4081e60 con 0x7f95040cdfc0 2023-09-13T06:06:45.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.384+0000 7f94fbfff640 1 -- 172.21.15.130:0/202022337 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(110..110 src has 1..110) v4 ==== 1468+0+0 (secure 0 0 0) 0x7f94f4055980 con 0x7f95040cdfc0 2023-09-13T06:06:45.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.384+0000 7f94fbfff640 1 -- 172.21.15.130:0/202022337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=111}) v3 -- 0x7f94e406e850 con 0x7f95040cdfc0 2023-09-13T06:06:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f95097ac640 1 -- 172.21.15.130:0/202022337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f95040cd7c0 con 0x7f95040cdfc0 2023-09-13T06:06:45.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f94fbfff640 1 -- 172.21.15.130:0/202022337 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+34123 (secure 0 0 0) 0x7f94f4021030 con 0x7f95040cdfc0 2023-09-13T06:06:45.403 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:45.403 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:06:45.403 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 110, 2023-09-13T06:06:45.404 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:06:45.404 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:06:45.404 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:06:45.379852+0000", 2023-09-13T06:06:45.404 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:06:45.404 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:06:45.405 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:06:45.405 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:06:45.405 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:06:45.405 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:06:45.406 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:06:45.406 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:06:45.406 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:06:45.406 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:45.406 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:06:45.407 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:06:45.407 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:06:45.407 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:06:45.407 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:06:45.407 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 13, 2023-09-13T06:06:45.408 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:06:45.408 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:06:45.408 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:06:45.408 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:06:45.408 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:06:45.409 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:06:45.409 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.409 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:06:45.409 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:06:45.410 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:06:45.410 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 4097, 2023-09-13T06:06:45.410 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,backfillfull", 2023-09-13T06:06:45.410 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:45.411 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:45.411 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:45.411 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:45.411 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:45.411 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:45.412 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:45.412 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:45.412 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:45.412 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:45.412 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:06:45.413 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:06:45.413 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:06:45.413 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:06:45.413 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:06:45.414 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:45.414 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:45.414 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:45.414 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:45.414 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:45.415 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:45.415 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:45.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.415 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "110", 2023-09-13T06:06:45.415 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:45.416 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:45.416 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:45.416 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:45.416 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:45.416 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:45.417 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:45.417 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:45.417 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:45.417 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:45.417 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:45.418 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:45.418 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:45.418 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:45.418 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:45.418 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:45.419 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:45.419 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:45.419 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:45.419 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:45.419 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:45.419 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:45.420 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:45.420 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:45.420 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:45.420 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:45.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.421 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:45.421 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:45.421 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:45.421 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:45.422 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:45.422 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:45.422 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:45.422 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:45.423 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:45.423 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:45.423 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:45.423 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:45.423 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:06:45.424 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:06:45.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.424 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:45.424 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:06:45.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.424 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:45.425 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:06:45.425 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:06:45.425 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:06:45.425 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:45.425 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:45.425 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:45.426 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:45.426 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:45.426 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.427 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 12, 2023-09-13T06:06:45.427 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:06:45.427 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:15.152093+0000", 2023-09-13T06:06:45.427 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 4097, 2023-09-13T06:06:45.427 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,backfillfull", 2023-09-13T06:06:45.428 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:45.428 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:45.428 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:45.428 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:45.428 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:45.429 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:45.429 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:45.429 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:45.429 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:45.429 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:45.430 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:06:45.430 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:06:45.430 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:06:45.430 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:06:45.430 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:06:45.431 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:45.431 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:45.431 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:45.431 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:45.432 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:45.432 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:45.432 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:45.432 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.432 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "110", 2023-09-13T06:06:45.432 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:45.433 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:45.433 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:45.433 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:45.433 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:45.434 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:45.434 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:45.434 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:45.434 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:45.434 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:45.435 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:45.435 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:45.435 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:45.435 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:45.435 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:45.435 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:45.436 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:45.436 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:45.436 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:45.436 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:45.436 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:45.437 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:45.437 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:45.437 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:45.437 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:45.437 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:45.437 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.438 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:45.438 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:45.438 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:45.438 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:45.438 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:45.439 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:45.439 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:45.439 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:45.439 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:45.439 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:45.440 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:45.440 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:45.440 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:06:45.440 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:06:45.440 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:06:45.440 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.441 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:45.441 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:45.441 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:06:45.441 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.442 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:45.442 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:06:45.442 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:06:45.442 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:45.442 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:45.442 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:45.443 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:45.443 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:45.443 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:45.443 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.444 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 13, 2023-09-13T06:06:45.444 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:06:45.444 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:16.467343+0000", 2023-09-13T06:06:45.444 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 4097, 2023-09-13T06:06:45.444 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,backfillfull", 2023-09-13T06:06:45.444 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:45.445 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:45.445 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:45.445 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:45.445 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:45.445 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:45.446 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:45.446 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:45.446 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:45.446 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:45.446 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:06:45.446 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:06:45.447 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:06:45.447 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:06:45.447 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:06:45.447 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:45.447 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:45.448 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:45.448 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:45.448 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:45.448 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:45.448 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:45.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.449 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "110", 2023-09-13T06:06:45.449 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:45.449 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:45.449 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:45.449 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:45.450 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:45.450 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:45.450 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:45.450 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:45.450 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:45.450 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:45.451 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:45.451 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:45.451 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:45.451 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:45.451 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:45.452 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:45.452 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:45.452 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:45.452 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:45.452 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:45.452 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:45.453 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:45.453 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:45.453 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:45.453 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:45.453 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:45.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.454 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:45.454 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:45.454 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:45.454 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:45.455 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:45.455 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:45.455 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:45.455 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:45.455 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:45.456 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:45.456 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:45.456 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:45.456 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:06:45.456 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:06:45.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.457 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:45.457 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:45.457 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:06:45.457 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.457 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.457 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:45.458 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:06:45.458 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:06:45.458 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:45.458 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:06:45.459 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:06:45.459 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:45.459 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:45.459 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:45.459 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.459 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.460 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:45.460 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:06:45.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.460 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:45.460 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:45.460 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:45.461 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:45.461 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:45.461 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:45.461 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:45.461 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:45.461 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:45.462 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:45.462 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:45.462 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:45.462 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:45.462 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.463 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.463 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:06:45.463 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.463 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.464 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.464 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:06:45.464 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.464 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.464 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.465 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:45.465 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.465 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.465 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:06:45.465 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.466 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.466 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.466 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:06:45.466 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.466 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.467 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.467 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:45.467 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.467 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.468 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:06:45.468 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.468 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.468 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:06:45.469 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.469 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.469 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.469 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:45.470 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.470 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.470 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.470 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:06:45.471 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.471 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.471 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:06:45.472 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.472 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.472 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.472 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.472 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:06:45.473 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:06:45.473 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:06:45.473 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:06:45.473 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:45.473 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:45.473 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:45.474 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.474 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:45.474 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:45.475 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:45.475 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:45.475 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:45.475 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:45.475 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:45.475 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:45.476 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:45.476 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:45.476 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:45.476 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:45.476 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:45.477 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.477 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.477 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:06:45.477 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.478 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.478 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:06:45.478 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.478 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.479 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.479 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:45.479 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.480 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.480 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:06:45.480 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.480 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.481 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:06:45.481 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.481 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.481 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.482 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:45.482 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.482 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.482 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:06:45.483 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.483 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.483 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:06:45.483 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.484 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.484 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.484 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:45.484 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.485 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.485 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:06:45.485 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.486 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.486 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:06:45.486 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.486 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.486 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.487 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:06:45.487 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:06:45.487 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:06:45.487 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:06:45.488 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:45.488 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:45.488 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:45.488 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.489 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:45.489 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:45.489 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:45.489 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:45.489 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:45.490 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:45.490 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:45.490 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:45.490 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:45.490 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:45.491 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:45.491 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:45.491 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:45.491 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.491 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.492 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:06:45.492 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.492 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.493 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:06:45.493 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.493 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.493 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.493 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:45.494 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.494 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.494 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.494 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:06:45.494 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.495 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.495 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.495 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:06:45.495 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.496 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.496 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.496 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:45.496 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.497 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.497 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:06:45.497 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.497 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.498 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.498 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:06:45.498 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.498 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.498 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.499 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:45.499 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.499 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.499 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:06:45.500 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.500 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.500 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:06:45.501 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.501 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.501 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.501 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:06:45.501 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:06:45.502 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:06:45.502 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:06:45.502 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:45.502 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:45.502 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:45.503 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.503 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:45.503 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:45.503 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:45.504 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:45.504 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:45.504 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:45.504 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:45.504 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:45.505 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:45.505 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:45.505 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:45.505 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:45.505 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:45.506 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.506 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.506 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:06:45.506 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:45.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.507 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.507 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:06:45.507 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:45.507 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.508 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.508 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:45.508 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.508 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.509 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:06:45.509 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:45.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.509 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.510 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:06:45.510 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:45.510 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.510 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.510 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:45.511 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.511 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.511 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:06:45.511 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:45.512 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.512 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.512 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.512 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:06:45.512 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:45.512 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.513 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.513 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:45.513 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.514 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.514 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:06:45.514 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:45.514 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.514 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.515 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:06:45.515 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:45.515 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.515 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.516 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:06:45.516 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:06:45.516 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:06:45.516 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:06:45.516 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:45.516 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:45.517 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:45.517 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.517 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:45.518 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:45.518 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:45.518 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:45.518 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:45.518 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:45.518 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:45.519 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:45.519 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:45.519 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:45.519 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:45.519 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:45.520 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:45.520 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.520 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.520 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:06:45.520 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:45.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.521 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.521 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:06:45.521 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:45.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.522 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.522 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:45.522 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.523 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.523 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:06:45.523 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:45.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.524 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.524 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:06:45.524 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:45.524 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.525 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.525 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:45.525 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.526 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.526 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:06:45.526 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:45.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.526 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.526 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.527 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:06:45.527 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:45.527 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.527 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.528 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:45.528 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.528 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.528 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.528 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:06:45.528 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:45.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.529 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.529 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:06:45.529 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:45.530 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.530 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.530 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:06:45.530 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:06:45.531 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:06:45.531 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:06:45.531 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:45.531 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:45.531 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:45.532 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.532 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.532 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:45.532 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:45.532 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.536 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.536 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:06:45.536 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:45.536 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.537 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.537 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:45.537 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.537 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.538 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:06:45.538 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:45.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.538 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.539 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:06:45.539 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:45.539 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.539 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.539 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:45.540 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.540 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.540 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.540 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:06:45.540 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:45.541 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.541 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.541 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:06:45.541 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:45.542 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.542 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.542 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:45.542 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.543 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.543 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:06:45.543 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:45.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.543 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.544 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.544 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:06:45.544 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:45.544 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.544 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.545 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:06:45.545 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:06:45.545 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:06:45.545 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:06:45.545 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:45.546 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:45.546 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:45.546 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.546 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.547 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:45.547 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:45.547 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:45.547 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:45.547 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:45.547 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:45.548 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:45.548 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:45.548 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:45.548 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:45.548 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:45.549 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:45.549 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:45.549 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.549 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.549 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:06:45.550 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:45.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.550 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.550 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:06:45.551 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:45.551 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.551 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.551 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:45.552 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.552 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.552 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.552 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:06:45.552 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:45.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.553 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.553 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:06:45.553 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:45.553 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.554 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.554 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:45.554 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.555 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.555 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:06:45.555 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:45.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.555 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.556 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:06:45.556 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:45.556 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.556 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.556 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.556 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:45.557 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.557 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.557 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:06:45.557 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:45.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.558 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.558 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.558 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:06:45.558 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:45.558 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.559 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.559 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:06:45.559 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:06:45.559 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:06:45.560 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:06:45.560 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:45.560 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:45.560 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:45.560 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.561 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.561 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:45.561 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:45.561 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:45.561 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:45.562 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:45.562 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:45.562 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:45.562 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:45.562 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:45.562 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:45.563 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:45.563 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:45.563 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:45.563 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.564 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.564 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:06:45.564 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:45.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.565 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.565 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:06:45.565 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:45.565 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.565 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.566 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:45.566 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.566 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.566 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:06:45.567 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:45.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.567 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.567 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:06:45.568 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:45.568 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.568 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.568 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:45.568 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.569 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.569 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:06:45.569 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:45.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.570 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.570 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:06:45.570 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:45.570 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.571 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.571 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:45.571 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.571 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.572 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:06:45.572 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:45.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.572 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.573 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:06:45.573 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:45.573 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.573 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.574 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:06:45.574 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:06:45.574 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:06:45.574 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:06:45.574 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:45.574 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull", 2023-09-13T06:06:45.575 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:45.575 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:45.575 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.575 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.575 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:45.576 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:06:45.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.576 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:45.576 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:45.576 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:45.576 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:45.577 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:45.577 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:45.577 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:06:45.577 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:45.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.578 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:45.578 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:45.578 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:45.578 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:45.579 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:45.579 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:45.579 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:06:45.579 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:45.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.580 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:45.580 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:45.580 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:45.580 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:45.580 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:45.581 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:45.581 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:06:45.581 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:45.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.581 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:45.582 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:45.582 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:45.582 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:45.582 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:45.582 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:45.583 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:06:45.583 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:45.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.583 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:45.583 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:45.584 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:45.584 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:45.584 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:45.584 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:45.584 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:06:45.585 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:45.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.585 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:45.585 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:45.586 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:45.586 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:45.586 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:45.586 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:45.586 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:06:45.586 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:45.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.587 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:45.587 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:45.587 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:45.588 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:45.588 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:45.588 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:45.588 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:06:45.588 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:45.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.589 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:45.589 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:45.589 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:45.590 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:45.590 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:45.590 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:45.590 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:06:45.590 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:45.590 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.591 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:45.591 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:06:45.591 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:06:45.591 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:06:45.591 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:06:45.592 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:06:45.592 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:06:45.592 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:06:45.592 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:06:45.592 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:06:45.592 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:06:45.593 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:06:45.593 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:06:45.593 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:06:45.593 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:06:45.593 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.594 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:06:45.594 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:06:45.594 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:06:45.594 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:06:45.594 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:06:45.595 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:06:45.595 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:06:45.595 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:06:45.595 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:06:45.595 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:06:45.596 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:06:45.596 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.596 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:06:45.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f95097ac640 1 -- 172.21.15.130:0/202022337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f94e4065b20 msgr2=0x7f94e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:45.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f95097ac640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f94e4065b20 0x7f94e4067fe0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0ad000 tx=0x7f94ec0a6000 comp rx=0 tx=0).stop 2023-09-13T06:06:45.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f95097ac640 1 -- 172.21.15.130:0/202022337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95040cdfc0 msgr2=0x7f950414f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:45.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f95097ac640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95040cdfc0 0x7f950414f2a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f94f400ebe0 tx=0x7f94f400c520 comp rx=0 tx=0).stop 2023-09-13T06:06:45.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f95097ac640 1 -- 172.21.15.130:0/202022337 shutdown_connections 2023-09-13T06:06:45.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f95097ac640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f94e4065b20 0x7f94e4067fe0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f95097ac640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9504159f20 0x7f9504159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f95097ac640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95040cdfc0 0x7f950414f2a0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f95097ac640 1 --2- 172.21.15.130:0/202022337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95040b1610 0x7f950414fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.400+0000 7f95097ac640 1 -- 172.21.15.130:0/202022337 >> 172.21.15.130:0/202022337 conn(0x7f9504065990 msgr2=0x7f9504070120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:45.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.404+0000 7f95097ac640 1 -- 172.21.15.130:0/202022337 shutdown_connections 2023-09-13T06:06:45.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.404+0000 7f95097ac640 1 -- 172.21.15.130:0/202022337 wait complete. 2023-09-13T06:06:45.600 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-09-13T06:06:45.601 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:06:45.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.736+0000 7f341fddb640 1 Processor -- start 2023-09-13T06:06:45.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.736+0000 7f341fddb640 1 -- start start 2023-09-13T06:06:45.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.736+0000 7f341fddb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3418147b50 0x7f34181652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.736+0000 7f341fddb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3418147f30 0x7f3418148410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.736+0000 7f341fddb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341806b5e0 con 0x7f3418148950 2023-09-13T06:06:45.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.736+0000 7f341fddb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341806b8c0 con 0x7f3418147b50 2023-09-13T06:06:45.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.736+0000 7f341fddb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34181657f0 con 0x7f3418147f30 2023-09-13T06:06:45.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.740+0000 7f341db77640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3418147b50 0x7f34181652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:45.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.740+0000 7f341db77640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3418147b50 0x7f34181652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44276/0 (socket says 172.21.15.130:44276) 2023-09-13T06:06:45.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.740+0000 7f341db77640 1 -- 172.21.15.130:0/28233335 learned_addr learned my addr 172.21.15.130:0/28233335 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:45.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.740+0000 7f341db77640 1 -- 172.21.15.130:0/28233335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3418147f30 msgr2=0x7f3418148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:45.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.740+0000 7f341db77640 1 --2- 172.21.15.130:0/28233335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3418147f30 0x7f3418148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.740+0000 7f341db77640 1 -- 172.21.15.130:0/28233335 >> v1:172.21.15.164:6789/0 conn(0x7f3418148950 legacy=0x7f341806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:45.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.740+0000 7f341db77640 1 -- 172.21.15.130:0/28233335 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3418165ac0 con 0x7f3418147b50 2023-09-13T06:06:45.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.740+0000 7f341db77640 1 --2- 172.21.15.130:0/28233335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3418147b50 0x7f34181652b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3414009870 tx=0x7f341401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4682fb9b68d6422 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:45.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.740+0000 7f341cb75640 1 -- 172.21.15.130:0/28233335 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34140aa5f0 con 0x7f3418147b50 2023-09-13T06:06:45.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.740+0000 7f341cb75640 1 -- 172.21.15.130:0/28233335 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34140aa750 con 0x7f3418147b50 2023-09-13T06:06:45.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.740+0000 7f341cb75640 1 -- 172.21.15.130:0/28233335 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34140aaae0 con 0x7f3418147b50 2023-09-13T06:06:45.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 -- 172.21.15.130:0/28233335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3418147b50 msgr2=0x7f34181652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:45.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 --2- 172.21.15.130:0/28233335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3418147b50 0x7f34181652b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3414009870 tx=0x7f341401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 -- 172.21.15.130:0/28233335 shutdown_connections 2023-09-13T06:06:45.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 --2- 172.21.15.130:0/28233335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3418147f30 0x7f3418148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 --2- 172.21.15.130:0/28233335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3418147b50 0x7f34181652b0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 -- 172.21.15.130:0/28233335 >> 172.21.15.130:0/28233335 conn(0x7f3418065990 msgr2=0x7f3418065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:45.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 -- 172.21.15.130:0/28233335 shutdown_connections 2023-09-13T06:06:45.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 -- 172.21.15.130:0/28233335 wait complete. 2023-09-13T06:06:45.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 Processor -- start 2023-09-13T06:06:45.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 -- start start 2023-09-13T06:06:45.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3418147b50 0x7f3418145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3418147f30 0x7f341815fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3418148950 0x7f341813e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341813f8b0 con 0x7f3418147f30 2023-09-13T06:06:45.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341813db50 con 0x7f3418148950 2023-09-13T06:06:45.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341fddb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341813de30 con 0x7f3418147b50 2023-09-13T06:06:45.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341d376640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3418147f30 0x7f341815fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:45.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341d376640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3418147f30 0x7f341815fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44280/0 (socket says 172.21.15.130:44280) 2023-09-13T06:06:45.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341d376640 1 -- 172.21.15.130:0/206109405 learned_addr learned my addr 172.21.15.130:0/206109405 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:45.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341db77640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3418147b50 0x7f3418145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:45.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341e378640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3418148950 0x7f341813e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:45.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341d376640 1 -- 172.21.15.130:0/206109405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3418147b50 msgr2=0x7f3418145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:45.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341d376640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3418147b50 0x7f3418145130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341d376640 1 -- 172.21.15.130:0/206109405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3418148950 msgr2=0x7f341813e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:45.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341d376640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3418148950 0x7f341813e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:45.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341d376640 1 -- 172.21.15.130:0/206109405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34140094d0 con 0x7f3418147f30 2023-09-13T06:06:45.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341db77640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3418147b50 0x7f3418145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:45.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.744+0000 7f341e378640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3418148950 0x7f341813e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:45.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.748+0000 7f341d376640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3418147f30 0x7f341815fa90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f340800b480 tx=0x7f340800b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:45.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.748+0000 7f340e7fc640 1 -- 172.21.15.130:0/206109405 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408010870 con 0x7f3418147f30 2023-09-13T06:06:45.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.748+0000 7f340e7fc640 1 -- 172.21.15.130:0/206109405 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34080109f0 con 0x7f3418147f30 2023-09-13T06:06:45.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.748+0000 7f340e7fc640 1 -- 172.21.15.130:0/206109405 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408010da0 con 0x7f3418147f30 2023-09-13T06:06:45.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.748+0000 7f341fddb640 1 -- 172.21.15.130:0/206109405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341813f4d0 con 0x7f3418147f30 2023-09-13T06:06:45.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.748+0000 7f341fddb640 1 -- 172.21.15.130:0/206109405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3418145670 con 0x7f3418147f30 2023-09-13T06:06:45.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.748+0000 7f341fddb640 1 -- 172.21.15.130:0/206109405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341813f9f0 con 0x7f3418147f30 2023-09-13T06:06:45.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.748+0000 7f340e7fc640 1 -- 172.21.15.130:0/206109405 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f340800f3c0 con 0x7f3418147f30 2023-09-13T06:06:45.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.748+0000 7f340e7fc640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f33fc065b20 0x7f33fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:45.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.748+0000 7f340e7fc640 1 -- 172.21.15.130:0/206109405 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34080833c0 con 0x7f3418147f30 2023-09-13T06:06:45.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.748+0000 7f341db77640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f33fc065b20 0x7f33fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:45.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.752+0000 7f341db77640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f33fc065b20 0x7f33fc067fe0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f34140ae000 tx=0x7f3414008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:45.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.752+0000 7f340e7fc640 1 -- 172.21.15.130:0/206109405 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f341813f9f0 con 0x7f3418147f30 2023-09-13T06:06:45.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.904+0000 7f341fddb640 1 -- 172.21.15.130:0/206109405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f341813f9f0 con 0x7f3418147f30 2023-09-13T06:06:45.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.904+0000 7f340e7fc640 1 -- 172.21.15.130:0/206109405 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+34123 (secure 0 0 0) 0x7f341813f9f0 con 0x7f3418147f30 2023-09-13T06:06:45.908 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:45.908 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:06:45.908 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 110, 2023-09-13T06:06:45.908 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:06:45.909 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:06:45.909 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:06:45.379852+0000", 2023-09-13T06:06:45.909 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:06:45.909 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:06:45.909 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:06:45.910 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:06:45.910 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:06:45.910 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:06:45.910 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:06:45.910 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:06:45.911 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:06:45.911 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:45.911 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:06:45.911 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:06:45.911 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:06:45.912 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:06:45.912 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:06:45.912 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 13, 2023-09-13T06:06:45.912 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:06:45.912 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:06:45.912 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:06:45.913 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:06:45.913 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:06:45.913 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:06:45.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.913 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:06:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:06:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:06:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 4097, 2023-09-13T06:06:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,backfillfull", 2023-09-13T06:06:45.914 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:45.915 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:06:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:06:45.916 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:06:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:06:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:06:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:45.917 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.918 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "110", 2023-09-13T06:06:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:45.919 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:45.920 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:45.921 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:45.922 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.923 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:45.924 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:45.925 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:06:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:06:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:45.926 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:06:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:06:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:06:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:06:45.927 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:45.928 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 12, 2023-09-13T06:06:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:06:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:15.152093+0000", 2023-09-13T06:06:45.929 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 4097, 2023-09-13T06:06:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,backfillfull", 2023-09-13T06:06:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:45.930 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:45.931 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:06:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:06:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:06:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:06:45.932 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:06:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:45.933 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "110", 2023-09-13T06:06:45.934 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:45.935 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:45.936 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:45.937 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:45.938 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.939 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:45.940 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:45.941 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:06:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:06:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:06:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:45.942 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:06:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:45.943 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:06:45.944 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:06:45.944 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:45.944 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:06:45.944 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:06:45.944 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:45.944 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:45.945 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:45.945 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.945 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.945 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 13, 2023-09-13T06:06:45.946 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:06:45.946 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:06:16.467343+0000", 2023-09-13T06:06:45.946 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 4097, 2023-09-13T06:06:45.946 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,backfillfull", 2023-09-13T06:06:45.946 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:06:45.947 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:06:45.947 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:06:45.947 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:06:45.947 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:06:45.947 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:06:45.947 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:06:45.948 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:06:45.948 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:06:45.948 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:06:45.948 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:06:45.948 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:06:45.948 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:06:45.949 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:06:45.949 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:06:45.949 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:06:45.949 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:06:45.949 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:06:45.949 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:06:45.950 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:06:45.950 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:06:45.950 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:06:45.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.950 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "110", 2023-09-13T06:06:45.951 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:06:45.951 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:06:45.951 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:06:45.951 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:06:45.951 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:06:45.951 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:06:45.952 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:06:45.952 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:06:45.952 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:06:45.952 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:06:45.952 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:06:45.952 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:06:45.953 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:06:45.953 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:06:45.953 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:06:45.953 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:06:45.953 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:06:45.954 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:06:45.954 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:06:45.954 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:06:45.954 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:06:45.954 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:06:45.955 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:06:45.955 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:06:45.955 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:06:45.955 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:06:45.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.955 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:06:45.956 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:06:45.956 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:06:45.956 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:06:45.956 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:06:45.956 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:06:45.956 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:06:45.957 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:06:45.957 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:06:45.957 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:06:45.957 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:06:45.957 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:06:45.957 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:06:45.958 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:06:45.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.958 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:06:45.958 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:06:45.958 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:06:45.959 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.959 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:06:45.959 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:06:45.959 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:06:45.959 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:06:45.960 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:06:45.960 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:06:45.960 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:06:45.960 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:06:45.960 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:06:45.960 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.961 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.961 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:45.961 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:06:45.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.961 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:45.961 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:45.962 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:45.962 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:45.962 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:45.962 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:45.962 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:45.963 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:45.963 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:45.963 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:45.963 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:45.963 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:45.964 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:45.964 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.964 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.964 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:06:45.964 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.965 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.965 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:06:45.965 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.966 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.966 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.966 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:45.966 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.967 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.967 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:06:45.967 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.968 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.968 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:06:45.968 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.968 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.968 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.969 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:45.969 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.969 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.970 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:06:45.970 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.970 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.970 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.971 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:06:45.971 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.971 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.971 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.971 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.971 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:45.972 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.972 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.972 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:06:45.972 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.973 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.973 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:06:45.973 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:06:45.974 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.974 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.974 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:06:45.974 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:45.978 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:45.978 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:45.978 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:45.978 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:45.978 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:45.979 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.979 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.979 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:06:45.979 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.980 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.980 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:06:45.980 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.981 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.981 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.981 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.981 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:45.981 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.982 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.982 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:06:45.982 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.983 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.983 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:06:45.983 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.983 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.983 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.984 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:45.984 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.984 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.985 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:06:45.985 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.985 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.985 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:06:45.986 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.986 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.986 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.986 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:45.986 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.987 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.987 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.987 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:06:45.987 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.988 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.988 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:06:45.988 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:06:45.988 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.988 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.989 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:06:45.989 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:06:45.989 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:06:45.989 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:06:45.989 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:45.990 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:45.990 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:45.990 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.990 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.991 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:45.991 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:45.991 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:45.991 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:45.991 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:45.991 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:45.992 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:45.992 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:45.992 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:45.992 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:45.992 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:45.992 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:45.993 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:45.993 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.993 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.993 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:06:45.994 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.994 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.994 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:06:45.995 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.995 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.995 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.995 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:45.995 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.996 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.996 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:06:45.996 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.997 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.997 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:06:45.997 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.997 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:45.998 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:45.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.998 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:45.998 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:45.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.998 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:45.999 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:06:45.999 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:45.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:45.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:45.999 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:45.999 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:06:46.000 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:46.000 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.000 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.000 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:46.001 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.001 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.001 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.001 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:06:46.001 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:46.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.002 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.002 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:06:46.002 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:06:46.002 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.002 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.003 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:06:46.003 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:06:46.003 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:06:46.003 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:06:46.004 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:46.004 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:46.004 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:46.004 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.004 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.005 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:46.005 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:46.005 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:46.005 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:46.005 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:46.006 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:46.006 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:46.006 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:46.006 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:46.006 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:46.006 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:46.007 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:46.007 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:46.007 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.007 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.008 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:06:46.008 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:46.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.008 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.008 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:06:46.009 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:46.009 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.009 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.009 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:46.009 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.010 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.010 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:06:46.010 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:46.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:06:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.011 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.012 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:06:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:06:46.013 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:46.014 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:06:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:06:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:06:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:06:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:06:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:06:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:06:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:46.017 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:46.018 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:46.018 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.018 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:46.019 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:46.020 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:46.020 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:46.020 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:46.020 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:46.020 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:46.020 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:06:46.021 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:06:46.022 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:06:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:06:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.025 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.026 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:06:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.027 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.028 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:06:46.028 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:46.028 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.028 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.028 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:46.029 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.029 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.029 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:06:46.029 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:46.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.030 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.030 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:06:46.030 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:06:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:06:46.031 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:06:46.032 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:06:46.032 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:06:46.032 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:46.032 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:46.032 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:46.033 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.033 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:46.034 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:46.034 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:46.034 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:46.034 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:46.034 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:46.034 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:46.035 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:46.035 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:46.035 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:46.035 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:46.035 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:46.036 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:46.036 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.036 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.036 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:06:46.037 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:46.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.037 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.037 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:06:46.038 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:46.038 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.038 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.038 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:46.039 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.039 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.039 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:06:46.039 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:46.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.040 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.040 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:06:46.040 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:46.040 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.041 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.041 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:46.041 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.041 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.041 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.042 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:06:46.042 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:46.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.042 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.043 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:06:46.043 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:46.043 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.043 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.044 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:46.044 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.044 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.044 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:06:46.045 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:46.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.045 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.045 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:06:46.045 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:06:46.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.046 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.046 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:06:46.047 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:06:46.047 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:06:46.047 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:06:46.047 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:46.047 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:46.047 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:46.048 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.048 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:46.048 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:46.049 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:46.049 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:46.049 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:46.049 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:46.049 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:46.050 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:46.050 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:46.050 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:46.050 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:46.050 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:46.051 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:46.051 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.051 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.051 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:06:46.052 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:46.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.052 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.052 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:06:46.052 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:46.053 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.053 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.053 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:46.053 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.054 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.054 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:06:46.054 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:46.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.055 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.055 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:06:46.055 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:46.055 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.055 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.056 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:46.056 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.056 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.057 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:06:46.057 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:46.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.057 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.058 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:06:46.058 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:46.058 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.058 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.059 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:46.059 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.059 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.059 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:06:46.059 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:46.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.060 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.060 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:06:46.060 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:06:46.060 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.061 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.061 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:06:46.061 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:06:46.061 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:06:46.062 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:06:46.062 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:46.062 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:46.062 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:46.062 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.063 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:46.063 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:06:46.063 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:06:46.063 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:06:46.064 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:06:46.064 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:06:46.064 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:06:46.064 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:06:46.064 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:06:46.064 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 100, 2023-09-13T06:06:46.065 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:06:46.065 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:06:46.065 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:06:46.065 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.065 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.066 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:06:46.066 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:46.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.066 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.067 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:06:46.067 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:46.067 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.067 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.067 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:06:46.068 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.068 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.068 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:06:46.068 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:46.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.069 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.069 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:06:46.069 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:46.069 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.070 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.070 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:06:46.070 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.070 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.071 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:06:46.071 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:46.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.071 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.072 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:06:46.072 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:46.072 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.072 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.073 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:06:46.073 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:06:46.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.073 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:06:46.073 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:06:46.074 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:46.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.074 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:06:46.074 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:06:46.075 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:06:46.075 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.075 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.075 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:06:46.075 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:06:46.076 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:06:46.076 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:06:46.076 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:06:46.076 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull", 2023-09-13T06:06:46.076 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:06:46.077 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:06:46.077 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:06:46.077 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.077 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:46.077 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:06:46.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.078 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:06:46.078 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:46.078 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:46.078 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:46.078 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:46.079 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:46.079 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:06:46.079 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:46.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.080 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:06:46.080 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:46.080 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:46.080 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:46.080 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:46.081 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:46.081 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:06:46.081 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:46.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.081 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:06:46.082 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:46.082 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:46.082 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:46.082 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:46.082 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:46.083 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:06:46.083 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:46.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.083 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:06:46.084 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:46.084 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:46.084 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:46.084 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:46.084 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:46.085 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:06:46.085 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:46.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.085 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:06:46.086 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:46.086 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:46.086 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:46.086 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:46.086 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:46.087 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:06:46.087 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:46.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.087 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:06:46.087 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:46.088 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:46.088 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:46.088 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:46.088 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:46.088 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:06:46.089 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:46.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.089 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:06:46.089 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:46.090 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:46.090 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:46.090 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:46.090 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:46.090 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:06:46.091 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:46.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:06:46.091 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:06:46.091 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:06:46.092 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:06:46.092 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:06:46.092 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:06:46.092 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:06:46.092 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:06:46.093 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:06:46.093 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.093 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:06:46.093 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:06:46.093 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:06:46.093 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:06:46.094 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:06:46.094 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:06:46.094 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:06:46.094 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:06:46.094 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:06:46.095 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:06:46.095 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:06:46.095 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:06:46.095 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:06:46.095 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:06:46.096 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:06:46.096 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:06:46.096 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:06:46.096 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:06:46.097 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:06:46.097 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:06:46.097 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:06:46.097 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:06:46.097 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:06:46.097 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:06:46.098 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:06:46.098 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:06:46.098 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:06:46.098 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:06:46.098 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:06:46.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 -- 172.21.15.130:0/206109405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f33fc065b20 msgr2=0x7f33fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:46.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f33fc065b20 0x7f33fc067fe0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f34140ae000 tx=0x7f3414008040 comp rx=0 tx=0).stop 2023-09-13T06:06:46.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 -- 172.21.15.130:0/206109405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3418147f30 msgr2=0x7f341815fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3418147f30 0x7f341815fa90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f340800b480 tx=0x7f340800b940 comp rx=0 tx=0).stop 2023-09-13T06:06:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 -- 172.21.15.130:0/206109405 shutdown_connections 2023-09-13T06:06:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f33fc065b20 0x7f33fc067fe0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3418148950 0x7f341813e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3418147f30 0x7f341815fa90 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 --2- 172.21.15.130:0/206109405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3418147b50 0x7f3418145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 -- 172.21.15.130:0/206109405 >> 172.21.15.130:0/206109405 conn(0x7f3418065990 msgr2=0x7f341806f780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 -- 172.21.15.130:0/206109405 shutdown_connections 2023-09-13T06:06:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:45.908+0000 7f341fddb640 1 -- 172.21.15.130:0/206109405 wait complete. 2023-09-13T06:06:46.103 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:46.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.236+0000 7fc50ad2c640 1 Processor -- start 2023-09-13T06:06:46.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc50ad2c640 1 -- start start 2023-09-13T06:06:46.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc50ad2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5040ce1a0 0x7fc50406d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:46.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc50ad2c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc5040afc70 0x7fc50406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:46.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc50ad2c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc504070e70 con 0x7fc50415d260 2023-09-13T06:06:46.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc50ad2c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc504072310 con 0x7fc5040afc70 2023-09-13T06:06:46.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc50ad2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc504070280 con 0x7fc5040ce1a0 2023-09-13T06:06:46.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc508ac8640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc50415d260 0x7fc5040b5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51392/0 (socket says 172.21.15.130:51392) 2023-09-13T06:06:46.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc508ac8640 1 -- 172.21.15.130:0/12130971 learned_addr learned my addr 172.21.15.130:0/12130971 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:46.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc503fff640 1 --2- 172.21.15.130:0/12130971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5040ce1a0 0x7fc50406d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:46.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc5092c9640 1 --2- 172.21.15.130:0/12130971 >> v2:172.21.15.164:3300/0 conn(0x7fc5040afc70 0x7fc50406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:46.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc5037fe640 1 -- 172.21.15.130:0/12130971 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826736158 0 0) 0x7fc504070e70 con 0x7fc50415d260 2023-09-13T06:06:46.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc5037fe640 1 -- 172.21.15.130:0/12130971 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f4003530 con 0x7fc50415d260 2023-09-13T06:06:46.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc503fff640 1 -- 172.21.15.130:0/12130971 >> v2:172.21.15.164:3300/0 conn(0x7fc5040afc70 msgr2=0x7fc50406dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:46.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc503fff640 1 --2- 172.21.15.130:0/12130971 >> v2:172.21.15.164:3300/0 conn(0x7fc5040afc70 0x7fc50406dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc5037fe640 1 -- 172.21.15.130:0/12130971 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3244391615 0 0) 0x7fc4f4003530 con 0x7fc50415d260 2023-09-13T06:06:46.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc503fff640 1 -- 172.21.15.130:0/12130971 >> v1:172.21.15.130:6789/0 conn(0x7fc50415d260 legacy=0x7fc5040b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:46.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.240+0000 7fc503fff640 1 -- 172.21.15.130:0/12130971 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc504070540 con 0x7fc5040ce1a0 2023-09-13T06:06:46.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc503fff640 1 --2- 172.21.15.130:0/12130971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5040ce1a0 0x7fc50406d6e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00097c0 tx=0x7fc4f001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b5406bfa5bffa40 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:46.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc5037fe640 1 -- 172.21.15.130:0/12130971 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8001680 con 0x7fc5040ce1a0 2023-09-13T06:06:46.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc5037fe640 1 -- 172.21.15.130:0/12130971 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f00a7050 con 0x7fc5040ce1a0 2023-09-13T06:06:46.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc5037fe640 1 -- 172.21.15.130:0/12130971 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00ab620 con 0x7fc5040ce1a0 2023-09-13T06:06:46.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc50ad2c640 1 -- 172.21.15.130:0/12130971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5040ce1a0 msgr2=0x7fc50406d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:46.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc50ad2c640 1 --2- 172.21.15.130:0/12130971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5040ce1a0 0x7fc50406d6e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00097c0 tx=0x7fc4f001c370 comp rx=0 tx=0).stop 2023-09-13T06:06:46.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc50ad2c640 1 -- 172.21.15.130:0/12130971 shutdown_connections 2023-09-13T06:06:46.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc50ad2c640 1 --2- 172.21.15.130:0/12130971 >> v2:172.21.15.164:3300/0 conn(0x7fc5040afc70 0x7fc50406dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc50ad2c640 1 --2- 172.21.15.130:0/12130971 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5040ce1a0 0x7fc50406d6e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc50ad2c640 1 -- 172.21.15.130:0/12130971 >> 172.21.15.130:0/12130971 conn(0x7fc50406a2f0 msgr2=0x7fc50406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:46.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc50ad2c640 1 -- 172.21.15.130:0/12130971 shutdown_connections 2023-09-13T06:06:46.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc50ad2c640 1 -- 172.21.15.130:0/12130971 wait complete. 2023-09-13T06:06:46.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc50ad2c640 1 Processor -- start 2023-09-13T06:06:46.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.244+0000 7fc50ad2c640 1 -- start start 2023-09-13T06:06:46.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc50ad2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5040afc70 0x7fc504145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:46.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc50ad2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5040ce1a0 0x7fc5040b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:46.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc50ad2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc50415d260 0x7fc5040b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:46.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc50ad2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50414e140 con 0x7fc5040ce1a0 2023-09-13T06:06:46.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc50ad2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc504146400 con 0x7fc50415d260 2023-09-13T06:06:46.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc50ad2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040cf5d0 con 0x7fc5040afc70 2023-09-13T06:06:46.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc503fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5040ce1a0 0x7fc5040b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:46.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc503fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5040ce1a0 0x7fc5040b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44292/0 (socket says 172.21.15.130:44292) 2023-09-13T06:06:46.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc503fff640 1 -- 172.21.15.130:0/3736155468 learned_addr learned my addr 172.21.15.130:0/3736155468 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:46.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc503fff640 1 -- 172.21.15.130:0/3736155468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5040afc70 msgr2=0x7fc504145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:46.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc503fff640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5040afc70 0x7fc504145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc503fff640 1 -- 172.21.15.130:0/3736155468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc50415d260 msgr2=0x7fc5040b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:46.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc503fff640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc50415d260 0x7fc5040b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc503fff640 1 -- 172.21.15.130:0/3736155468 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f0009420 con 0x7fc5040ce1a0 2023-09-13T06:06:46.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc503fff640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5040ce1a0 0x7fc5040b1750 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00ae040 tx=0x7fc4f0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:46.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc5017fa640 1 -- 172.21.15.130:0/3736155468 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00b4430 con 0x7fc5040ce1a0 2023-09-13T06:06:46.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc5017fa640 1 -- 172.21.15.130:0/3736155468 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f00b45b0 con 0x7fc5040ce1a0 2023-09-13T06:06:46.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc5017fa640 1 -- 172.21.15.130:0/3736155468 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00b4960 con 0x7fc5040ce1a0 2023-09-13T06:06:46.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc50ad2c640 1 -- 172.21.15.130:0/3736155468 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5040cf8b0 con 0x7fc5040ce1a0 2023-09-13T06:06:46.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc50ad2c640 1 -- 172.21.15.130:0/3736155468 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5040cfe70 con 0x7fc5040ce1a0 2023-09-13T06:06:46.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.248+0000 7fc50ad2c640 1 -- 172.21.15.130:0/3736155468 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5040618a0 con 0x7fc5040ce1a0 2023-09-13T06:06:46.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.252+0000 7fc5017fa640 1 -- 172.21.15.130:0/3736155468 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc4f00b2040 con 0x7fc5040ce1a0 2023-09-13T06:06:46.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.252+0000 7fc5017fa640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc4e8065b20 0x7fc4e8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:46.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.252+0000 7fc5017fa640 1 -- 172.21.15.130:0/3736155468 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4f011d0e0 con 0x7fc5040ce1a0 2023-09-13T06:06:46.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.252+0000 7fc508ac8640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc4e8065b20 0x7fc4e8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:46.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.252+0000 7fc508ac8640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc4e8065b20 0x7fc4e8067fe0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8001ec0 tx=0x7fc4f8001990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:46.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.256+0000 7fc5017fa640 1 -- 172.21.15.130:0/3736155468 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc4f00ea990 con 0x7fc5040ce1a0 2023-09-13T06:06:46.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 -- 172.21.15.130:0/3736155468 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc504155310 con 0x7fc5040ce1a0 2023-09-13T06:06:46.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc5017fa640 1 -- 172.21.15.130:0/3736155468 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4924 (secure 0 0 0) 0x7fc4f00b0090 con 0x7fc5040ce1a0 2023-09-13T06:06:46.438 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:46.438 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3211692360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3211692360},{"type":"v1","addr":"172.21.15.164:6834","nonce":3211692360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2453731046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2453731046},{"type":"v1","addr":"172.21.15.130:6835","nonce":2453731046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2896649577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2896649577},{"type":"v1","addr":"172.21.15.164:6835","nonce":2896649577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:06:17.421334+0000","modified":"2023-09-13T06:06:20.748001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6888":{"gid":6888,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/878642631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":878642631},{"type":"v1","addr":"172.21.15.130:6837","nonce":878642631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-09-13T06:06:46.438 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 51 2023-09-13T06:06:46.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 -- 172.21.15.130:0/3736155468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc4e8065b20 msgr2=0x7fc4e8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:46.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc4e8065b20 0x7fc4e8067fe0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8001ec0 tx=0x7fc4f8001990 comp rx=0 tx=0).stop 2023-09-13T06:06:46.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 -- 172.21.15.130:0/3736155468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5040ce1a0 msgr2=0x7fc5040b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:46.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5040ce1a0 0x7fc5040b1750 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00ae040 tx=0x7fc4f0019110 comp rx=0 tx=0).stop 2023-09-13T06:06:46.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 -- 172.21.15.130:0/3736155468 shutdown_connections 2023-09-13T06:06:46.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc4e8065b20 0x7fc4e8067fe0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc50415d260 0x7fc5040b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5040ce1a0 0x7fc5040b1750 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 --2- 172.21.15.130:0/3736155468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5040afc70 0x7fc504145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:46.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 -- 172.21.15.130:0/3736155468 >> 172.21.15.130:0/3736155468 conn(0x7fc50406a2f0 msgr2=0x7fc50406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:46.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 -- 172.21.15.130:0/3736155468 shutdown_connections 2023-09-13T06:06:46.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:46.436+0000 7fc50ad2c640 1 -- 172.21.15.130:0/3736155468 wait complete. 2023-09-13T06:06:46.459 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-09-13T06:06:46.616 INFO:teuthology.orchestra.run.smithi130.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":6888,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.241943778,"mdsmap_epoch":51,"osdmap_epoch":110,"osdmap_epoch_barrier":106,"uptime":34.317419115} 2023-09-13T06:06:46.616 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 6888, "mdsmap_epoch": 51, "osdmap_epoch": 110, "osdmap_epoch_barrier": 106, "rank_uptime": 28.241943778, "state": "up:active", "uptime": 34.317419115, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:06:46.617 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-13T06:06:46.617 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:46.618 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:46.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:46.627 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-09-13T06:06:47.170 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records in 2023-09-13T06:06:47.170 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records out 2023-09-13T06:06:47.170 INFO:teuthology.orchestra.run.smithi130.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.491655 s, 107 MB/s 2023-09-13T06:06:47.171 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:06:47.172 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:06:47.239 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:06:47.293 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:06:47.294 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:47.294 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:47.304 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:47.304 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:47.353 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:47.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbf334640 1 Processor -- start 2023-09-13T06:06:47.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbf334640 1 -- start start 2023-09-13T06:06:47.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbf334640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7bb8146b30 0x7f7bb80d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbf334640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7bb80d1f50 0x7f7bb815d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbf334640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb80d1ac0 con 0x7f7bb80d0a10 2023-09-13T06:06:47.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbf334640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb80d0eb0 con 0x7f7bb80d1f50 2023-09-13T06:06:47.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbf334640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb80d1190 con 0x7f7bb8146b30 2023-09-13T06:06:47.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbeb33640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7bb80d1f50 0x7f7bb815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbeb33640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7bb80d1f50 0x7f7bb815d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44294/0 (socket says 172.21.15.130:44294) 2023-09-13T06:06:47.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbeb33640 1 -- 172.21.15.130:0/3415493770 learned_addr learned my addr 172.21.15.130:0/3415493770 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:47.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbe332640 1 --2- 172.21.15.130:0/3415493770 >> v2:172.21.15.164:3300/0 conn(0x7f7bb8146b30 0x7f7bb80d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbeb33640 1 -- 172.21.15.130:0/3415493770 >> v2:172.21.15.164:3300/0 conn(0x7f7bb8146b30 msgr2=0x7f7bb80d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:47.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbeb33640 1 --2- 172.21.15.130:0/3415493770 >> v2:172.21.15.164:3300/0 conn(0x7f7bb8146b30 0x7f7bb80d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbeb33640 1 -- 172.21.15.130:0/3415493770 >> v1:172.21.15.164:6789/0 conn(0x7f7bb80d0a10 legacy=0x7f7bb8070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:47.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.532+0000 7f7bbeb33640 1 -- 172.21.15.130:0/3415493770 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb80d1470 con 0x7f7bb80d1f50 2023-09-13T06:06:47.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbeb33640 1 --2- 172.21.15.130:0/3415493770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb80d1f50 0x7f7bb815d760 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8074610 tx=0x7f7bb001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1643a3e90c994b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:47.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbd330640 1 -- 172.21.15.130:0/3415493770 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00a5880 con 0x7f7bb80d1f50 2023-09-13T06:06:47.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbd330640 1 -- 172.21.15.130:0/3415493770 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb00a59e0 con 0x7f7bb80d1f50 2023-09-13T06:06:47.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbd330640 1 -- 172.21.15.130:0/3415493770 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00a5d70 con 0x7f7bb80d1f50 2023-09-13T06:06:47.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbf334640 1 -- 172.21.15.130:0/3415493770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb80d1f50 msgr2=0x7f7bb815d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:47.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbf334640 1 --2- 172.21.15.130:0/3415493770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb80d1f50 0x7f7bb815d760 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8074610 tx=0x7f7bb001c9a0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbf334640 1 -- 172.21.15.130:0/3415493770 shutdown_connections 2023-09-13T06:06:47.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbf334640 1 --2- 172.21.15.130:0/3415493770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb80d1f50 0x7f7bb815d760 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbf334640 1 --2- 172.21.15.130:0/3415493770 >> v2:172.21.15.164:3300/0 conn(0x7f7bb8146b30 0x7f7bb80d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbf334640 1 -- 172.21.15.130:0/3415493770 >> 172.21.15.130:0/3415493770 conn(0x7f7bb80d3090 msgr2=0x7f7bb80d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:47.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbf334640 1 -- 172.21.15.130:0/3415493770 shutdown_connections 2023-09-13T06:06:47.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbf334640 1 -- 172.21.15.130:0/3415493770 wait complete. 2023-09-13T06:06:47.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbf334640 1 Processor -- start 2023-09-13T06:06:47.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.536+0000 7f7bbf334640 1 -- start start 2023-09-13T06:06:47.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbf334640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb80d0a10 0x7f7bb815ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbf334640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb80d1f50 0x7f7bb8144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbf334640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8146b30 0x7f7bb815b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbf334640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb815cfe0 con 0x7f7bb8146b30 2023-09-13T06:06:47.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbf334640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8142cc0 con 0x7f7bb80d1f50 2023-09-13T06:06:47.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbf334640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb81378a0 con 0x7f7bb80d0a10 2023-09-13T06:06:47.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbeb33640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8146b30 0x7f7bb815b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbeb33640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8146b30 0x7f7bb815b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44308/0 (socket says 172.21.15.130:44308) 2023-09-13T06:06:47.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbeb33640 1 -- 172.21.15.130:0/3117039239 learned_addr learned my addr 172.21.15.130:0/3117039239 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:47.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbe332640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb80d0a10 0x7f7bb815ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbdb31640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb80d1f50 0x7f7bb8144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbeb33640 1 -- 172.21.15.130:0/3117039239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb80d0a10 msgr2=0x7f7bb815ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:47.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbeb33640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb80d0a10 0x7f7bb815ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbeb33640 1 -- 172.21.15.130:0/3117039239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb80d1f50 msgr2=0x7f7bb8144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:47.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbeb33640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb80d1f50 0x7f7bb8144f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbeb33640 1 -- 172.21.15.130:0/3117039239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb0009b30 con 0x7f7bb8146b30 2023-09-13T06:06:47.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbeb33640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8146b30 0x7f7bb815b6c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7bb001a5d0 tx=0x7f7bb0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:47.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7baeffd640 1 -- 172.21.15.130:0/3117039239 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00b8670 con 0x7f7bb8146b30 2023-09-13T06:06:47.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7baeffd640 1 -- 172.21.15.130:0/3117039239 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb00b8810 con 0x7f7bb8146b30 2023-09-13T06:06:47.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7baeffd640 1 -- 172.21.15.130:0/3117039239 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00b8bc0 con 0x7f7bb8146b30 2023-09-13T06:06:47.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbf334640 1 -- 172.21.15.130:0/3117039239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb8137b80 con 0x7f7bb8146b30 2023-09-13T06:06:47.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbf334640 1 -- 172.21.15.130:0/3117039239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb8138140 con 0x7f7bb8146b30 2023-09-13T06:06:47.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.540+0000 7f7bbf334640 1 -- 172.21.15.130:0/3117039239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb80618a0 con 0x7f7bb8146b30 2023-09-13T06:06:47.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.544+0000 7f7baeffd640 1 -- 172.21.15.130:0/3117039239 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7bb00b8d20 con 0x7f7bb8146b30 2023-09-13T06:06:47.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.544+0000 7f7baeffd640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b9c065b20 0x7f7b9c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.544+0000 7f7baeffd640 1 -- 172.21.15.130:0/3117039239 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bb011e810 con 0x7f7bb8146b30 2023-09-13T06:06:47.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.544+0000 7f7bbe332640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b9c065b20 0x7f7b9c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.544+0000 7f7bbe332640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b9c065b20 0x7f7b9c067fe0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7bb81f8fc0 tx=0x7f7bb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:47.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.548+0000 7f7baeffd640 1 -- 172.21.15.130:0/3117039239 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7bb00ec220 con 0x7f7bb8146b30 2023-09-13T06:06:47.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.696+0000 7f7bbf334640 1 -- 172.21.15.130:0/3117039239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bb8137160 con 0x7f7bb8146b30 2023-09-13T06:06:47.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7baeffd640 1 -- 172.21.15.130:0/3117039239 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16671 (secure 0 0 0) 0x7f7bb00ef840 con 0x7f7bb8146b30 2023-09-13T06:06:47.702 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:47.702 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":110,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:45.379852+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:06:15.152093+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-09-13T06:06:16.467343+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:47.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 -- 172.21.15.130:0/3117039239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b9c065b20 msgr2=0x7f7b9c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:47.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b9c065b20 0x7f7b9c067fe0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7bb81f8fc0 tx=0x7f7bb4008040 comp rx=0 tx=0).stop 2023-09-13T06:06:47.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 -- 172.21.15.130:0/3117039239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8146b30 msgr2=0x7f7bb815b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:47.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8146b30 0x7f7bb815b6c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7bb001a5d0 tx=0x7f7bb0019740 comp rx=0 tx=0).stop 2023-09-13T06:06:47.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 -- 172.21.15.130:0/3117039239 shutdown_connections 2023-09-13T06:06:47.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7b9c065b20 0x7f7b9c067fe0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb80d1f50 0x7f7bb8144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8146b30 0x7f7bb815b6c0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 --2- 172.21.15.130:0/3117039239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb80d0a10 0x7f7bb815ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 -- 172.21.15.130:0/3117039239 >> 172.21.15.130:0/3117039239 conn(0x7f7bb80d3090 msgr2=0x7f7bb80b6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:47.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 -- 172.21.15.130:0/3117039239 shutdown_connections 2023-09-13T06:06:47.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.700+0000 7f7bbf334640 1 -- 172.21.15.130:0/3117039239 wait complete. 2023-09-13T06:06:47.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 4097, 'flags_names': 'hashpspool,backfillfull', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:06:15.152093+0000', 'flags': 4097, 'flags_names': 'hashpspool,backfillfull', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:06:16.467343+0000', 'flags': 4097, 'flags_names': 'hashpspool,backfillfull', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:06:47.723 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:06:47.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.860+0000 7eff6c12c640 1 Processor -- start 2023-09-13T06:06:47.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff6c12c640 1 -- start start 2023-09-13T06:06:47.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff6c12c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff64154760 0x7eff640b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff6c12c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7eff64161140 0x7eff6415e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff6c12c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff640b2690 con 0x7eff64154380 2023-09-13T06:06:47.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff6c12c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff64070d80 con 0x7eff64161140 2023-09-13T06:06:47.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff6c12c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff64161700 con 0x7eff64154760 2023-09-13T06:06:47.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff6a6c9640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7eff64161140 0x7eff6415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff696c7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff64154760 0x7eff640b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff69ec8640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7eff64154380 0x7eff64070670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:59518/0 (socket says 172.21.15.130:59518) 2023-09-13T06:06:47.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff69ec8640 1 -- 172.21.15.130:0/3588854703 learned_addr learned my addr 172.21.15.130:0/3588854703 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:47.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff6a6c9640 1 -- 172.21.15.130:0/3588854703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff64154760 msgr2=0x7eff640b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:47.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff6a6c9640 1 --2- 172.21.15.130:0/3588854703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff64154760 0x7eff640b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff6a6c9640 1 -- 172.21.15.130:0/3588854703 >> v1:172.21.15.164:6789/0 conn(0x7eff64154380 legacy=0x7eff64070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:47.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff6a6c9640 1 -- 172.21.15.130:0/3588854703 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff641619e0 con 0x7eff64161140 2023-09-13T06:06:47.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.864+0000 7eff68ec6640 1 -- 172.21.15.130:0/3588854703 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161456822 0 0) 0x7eff640b2690 con 0x7eff64154380 2023-09-13T06:06:47.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff6a6c9640 1 --2- 172.21.15.130:0/3588854703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff64161140 0x7eff6415e180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009d90 tx=0x7eff5c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db5abcd3d6de82c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:47.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff68ec6640 1 -- 172.21.15.130:0/3588854703 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0a59a0 con 0x7eff64161140 2023-09-13T06:06:47.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff68ec6640 1 -- 172.21.15.130:0/3588854703 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c0a5b00 con 0x7eff64161140 2023-09-13T06:06:47.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff68ec6640 1 -- 172.21.15.130:0/3588854703 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0a5e90 con 0x7eff64161140 2023-09-13T06:06:47.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff6c12c640 1 -- 172.21.15.130:0/3588854703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff64161140 msgr2=0x7eff6415e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:47.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff6c12c640 1 --2- 172.21.15.130:0/3588854703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff64161140 0x7eff6415e180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009d90 tx=0x7eff5c01c8c0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff6c12c640 1 -- 172.21.15.130:0/3588854703 shutdown_connections 2023-09-13T06:06:47.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff6c12c640 1 --2- 172.21.15.130:0/3588854703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff64161140 0x7eff6415e180 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff6c12c640 1 --2- 172.21.15.130:0/3588854703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff64154760 0x7eff640b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff6c12c640 1 -- 172.21.15.130:0/3588854703 >> 172.21.15.130:0/3588854703 conn(0x7eff64065990 msgr2=0x7eff64065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff6c12c640 1 -- 172.21.15.130:0/3588854703 shutdown_connections 2023-09-13T06:06:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.868+0000 7eff6c12c640 1 -- 172.21.15.130:0/3588854703 wait complete. 2023-09-13T06:06:47.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6c12c640 1 Processor -- start 2023-09-13T06:06:47.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6c12c640 1 -- start start 2023-09-13T06:06:47.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6c12c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff64154380 0x7eff64148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6c12c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff64154760 0x7eff640b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6c12c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff64161140 0x7eff6414edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6c12c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff64159ef0 con 0x7eff64161140 2023-09-13T06:06:47.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6c12c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff64148c90 con 0x7eff64154760 2023-09-13T06:06:47.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6c12c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6414da10 con 0x7eff64154380 2023-09-13T06:06:47.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6a6c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff64161140 0x7eff6414edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff696c7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff64154760 0x7eff640b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff69ec8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff64154380 0x7eff64148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff696c7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff64154760 0x7eff640b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:34718/0 (socket says 172.21.15.130:34718) 2023-09-13T06:06:47.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff696c7640 1 -- 172.21.15.130:0/1846442396 learned_addr learned my addr 172.21.15.130:0/1846442396 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:47.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff696c7640 1 -- 172.21.15.130:0/1846442396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff64154380 msgr2=0x7eff64148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:47.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff696c7640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff64154380 0x7eff64148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff696c7640 1 -- 172.21.15.130:0/1846442396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff64161140 msgr2=0x7eff6414edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:47.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff696c7640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff64161140 0x7eff6414edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:47.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff696c7640 1 -- 172.21.15.130:0/1846442396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c009a70 con 0x7eff64154760 2023-09-13T06:06:47.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff696c7640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff64154760 0x7eff640b17f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7eff5400e870 tx=0x7eff5400ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:47.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff5a7fc640 1 -- 172.21.15.130:0/1846442396 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff54009510 con 0x7eff64154760 2023-09-13T06:06:47.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff5a7fc640 1 -- 172.21.15.130:0/1846442396 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5400eec0 con 0x7eff64154760 2023-09-13T06:06:47.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff5a7fc640 1 -- 172.21.15.130:0/1846442396 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5400cb40 con 0x7eff64154760 2023-09-13T06:06:47.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6c12c640 1 -- 172.21.15.130:0/1846442396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6414dcf0 con 0x7eff64154760 2023-09-13T06:06:47.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6c12c640 1 -- 172.21.15.130:0/1846442396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6414e2b0 con 0x7eff64154760 2023-09-13T06:06:47.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.872+0000 7eff6c12c640 1 -- 172.21.15.130:0/1846442396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff640618a0 con 0x7eff64154760 2023-09-13T06:06:47.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.876+0000 7eff5a7fc640 1 -- 172.21.15.130:0/1846442396 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7eff5400cca0 con 0x7eff64154760 2023-09-13T06:06:47.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.876+0000 7eff5a7fc640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff48065b20 0x7eff48067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:47.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.876+0000 7eff5a7fc640 1 -- 172.21.15.130:0/1846442396 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff54083460 con 0x7eff64154760 2023-09-13T06:06:47.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.876+0000 7eff69ec8640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff48065b20 0x7eff48067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:47.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.876+0000 7eff69ec8640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff48065b20 0x7eff48067fe0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7eff60000f70 tx=0x7eff60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:47.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:47.880+0000 7eff5a7fc640 1 -- 172.21.15.130:0/1846442396 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7eff54050d40 con 0x7eff64154760 2023-09-13T06:06:48.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.028+0000 7eff6c12c640 1 -- 172.21.15.130:0/1846442396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff64070050 con 0x7eff64154760 2023-09-13T06:06:48.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.028+0000 7eff5a7fc640 1 -- 172.21.15.130:0/1846442396 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff54072070 con 0x7eff64154760 2023-09-13T06:06:48.032 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:06:48.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 -- 172.21.15.130:0/1846442396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff48065b20 msgr2=0x7eff48067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff48065b20 0x7eff48067fe0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7eff60000f70 tx=0x7eff60009040 comp rx=0 tx=0).stop 2023-09-13T06:06:48.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 -- 172.21.15.130:0/1846442396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff64154760 msgr2=0x7eff640b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff64154760 0x7eff640b17f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7eff5400e870 tx=0x7eff5400ec70 comp rx=0 tx=0).stop 2023-09-13T06:06:48.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 -- 172.21.15.130:0/1846442396 shutdown_connections 2023-09-13T06:06:48.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff48065b20 0x7eff48067fe0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff64154760 0x7eff640b17f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff64161140 0x7eff6414edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 --2- 172.21.15.130:0/1846442396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff64154380 0x7eff64148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 -- 172.21.15.130:0/1846442396 >> 172.21.15.130:0/1846442396 conn(0x7eff64065990 msgr2=0x7eff640b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:48.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 -- 172.21.15.130:0/1846442396 shutdown_connections 2023-09-13T06:06:48.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.032+0000 7eff6c12c640 1 -- 172.21.15.130:0/1846442396 wait complete. 2023-09-13T06:06:48.053 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:06:48.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d9b034640 1 Processor -- start 2023-09-13T06:06:48.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d9b034640 1 -- start start 2023-09-13T06:06:48.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d9b034640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d940b2e90 0x7f7d940ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d9b034640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d940b1460 0x7f7d940b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d9b034640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d940b2150 con 0x7f7d94144d70 2023-09-13T06:06:48.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d9b034640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d940b2430 con 0x7f7d940b1460 2023-09-13T06:06:48.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d9b034640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940cedb0 con 0x7f7d940b2e90 2023-09-13T06:06:48.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d995d1640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d940b1460 0x7f7d940b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d995d1640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d940b1460 0x7f7d940b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44320/0 (socket says 172.21.15.130:44320) 2023-09-13T06:06:48.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d995d1640 1 -- 172.21.15.130:0/3847479446 learned_addr learned my addr 172.21.15.130:0/3847479446 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:48.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d8bfff640 1 --2- 172.21.15.130:0/3847479446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d940b2e90 0x7f7d940ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d995d1640 1 -- 172.21.15.130:0/3847479446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d940b2e90 msgr2=0x7f7d940ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:48.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d995d1640 1 --2- 172.21.15.130:0/3847479446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d940b2e90 0x7f7d940ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d995d1640 1 -- 172.21.15.130:0/3847479446 >> v1:172.21.15.164:6789/0 conn(0x7f7d94144d70 legacy=0x7f7d940b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.192+0000 7f7d995d1640 1 -- 172.21.15.130:0/3847479446 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d940cdd90 con 0x7f7d940b1460 2023-09-13T06:06:48.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d995d1640 1 --2- 172.21.15.130:0/3847479446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d940b1460 0x7f7d940b18f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009e50 tx=0x7f7d8c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f86a1bde1b159b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:48.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d8b7fe640 1 -- 172.21.15.130:0/3847479446 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c0a57d0 con 0x7f7d940b1460 2023-09-13T06:06:48.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d8b7fe640 1 -- 172.21.15.130:0/3847479446 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8c0a5930 con 0x7f7d940b1460 2023-09-13T06:06:48.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d8b7fe640 1 -- 172.21.15.130:0/3847479446 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c0a5cc0 con 0x7f7d940b1460 2023-09-13T06:06:48.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d9b034640 1 -- 172.21.15.130:0/3847479446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d940b1460 msgr2=0x7f7d940b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d9b034640 1 --2- 172.21.15.130:0/3847479446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d940b1460 0x7f7d940b18f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009e50 tx=0x7f7d8c01ca10 comp rx=0 tx=0).stop 2023-09-13T06:06:48.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d9b034640 1 -- 172.21.15.130:0/3847479446 shutdown_connections 2023-09-13T06:06:48.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d9b034640 1 --2- 172.21.15.130:0/3847479446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d940b1460 0x7f7d940b18f0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d9b034640 1 --2- 172.21.15.130:0/3847479446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d940b2e90 0x7f7d940ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d9b034640 1 -- 172.21.15.130:0/3847479446 >> 172.21.15.130:0/3847479446 conn(0x7f7d94065990 msgr2=0x7f7d94065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:48.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d9b034640 1 -- 172.21.15.130:0/3847479446 shutdown_connections 2023-09-13T06:06:48.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.196+0000 7f7d9b034640 1 -- 172.21.15.130:0/3847479446 wait complete. 2023-09-13T06:06:48.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d9b034640 1 Processor -- start 2023-09-13T06:06:48.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d9b034640 1 -- start start 2023-09-13T06:06:48.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d9b034640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d940b1460 0x7f7d940adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d9b034640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d940b2e90 0x7f7d94138580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d9b034640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d94144d70 0x7f7d94156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d9b034640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9415bcc0 con 0x7f7d940b2e90 2023-09-13T06:06:48.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d9b034640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940cc3f0 con 0x7f7d94144d70 2023-09-13T06:06:48.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d9b034640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d94154e70 con 0x7f7d940b1460 2023-09-13T06:06:48.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d8bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d940b2e90 0x7f7d94138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d8bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d940b2e90 0x7f7d94138580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44322/0 (socket says 172.21.15.130:44322) 2023-09-13T06:06:48.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d8bfff640 1 -- 172.21.15.130:0/112348743 learned_addr learned my addr 172.21.15.130:0/112348743 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:48.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d995d1640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d94144d70 0x7f7d94156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d98dd0640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d940b1460 0x7f7d940adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d8bfff640 1 -- 172.21.15.130:0/112348743 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d940b1460 msgr2=0x7f7d940adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d8bfff640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d940b1460 0x7f7d940adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d8bfff640 1 -- 172.21.15.130:0/112348743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d94144d70 msgr2=0x7f7d94156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d8bfff640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d94144d70 0x7f7d94156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d8bfff640 1 -- 172.21.15.130:0/112348743 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c009b30 con 0x7f7d940b2e90 2023-09-13T06:06:48.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d995d1640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d94144d70 0x7f7d94156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:48.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d8bfff640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d940b2e90 0x7f7d94138580 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400d830 tx=0x7f7d8400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:48.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d897fa640 1 -- 172.21.15.130:0/112348743 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8400b6c0 con 0x7f7d940b2e90 2023-09-13T06:06:48.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d897fa640 1 -- 172.21.15.130:0/112348743 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8400b820 con 0x7f7d940b2e90 2023-09-13T06:06:48.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d897fa640 1 -- 172.21.15.130:0/112348743 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8400bb90 con 0x7f7d940b2e90 2023-09-13T06:06:48.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d9b034640 1 -- 172.21.15.130:0/112348743 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d940cd370 con 0x7f7d940b2e90 2023-09-13T06:06:48.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.200+0000 7f7d9b034640 1 -- 172.21.15.130:0/112348743 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d940cc920 con 0x7f7d940b2e90 2023-09-13T06:06:48.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.204+0000 7f7d9b034640 1 -- 172.21.15.130:0/112348743 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d940ccb40 con 0x7f7d940b2e90 2023-09-13T06:06:48.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.204+0000 7f7d897fa640 1 -- 172.21.15.130:0/112348743 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7d8401e460 con 0x7f7d940b2e90 2023-09-13T06:06:48.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.204+0000 7f7d897fa640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d80065b20 0x7f7d80067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.204+0000 7f7d897fa640 1 -- 172.21.15.130:0/112348743 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d840838e0 con 0x7f7d940b2e90 2023-09-13T06:06:48.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.204+0000 7f7d98dd0640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d80065b20 0x7f7d80067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.204+0000 7f7d98dd0640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d80065b20 0x7f7d80067fe0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7d940ad4f0 tx=0x7f7d90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:48.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.208+0000 7f7d897fa640 1 -- 172.21.15.130:0/112348743 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7d84051370 con 0x7f7d940b2e90 2023-09-13T06:06:48.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.356+0000 7f7d9b034640 1 -- 172.21.15.130:0/112348743 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d940618a0 con 0x7f7d940b2e90 2023-09-13T06:06:48.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.356+0000 7f7d897fa640 1 -- 172.21.15.130:0/112348743 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d84054990 con 0x7f7d940b2e90 2023-09-13T06:06:48.359 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:06:48.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 -- 172.21.15.130:0/112348743 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d80065b20 msgr2=0x7f7d80067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d80065b20 0x7f7d80067fe0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7d940ad4f0 tx=0x7f7d90009040 comp rx=0 tx=0).stop 2023-09-13T06:06:48.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 -- 172.21.15.130:0/112348743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d940b2e90 msgr2=0x7f7d94138580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d940b2e90 0x7f7d94138580 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400d830 tx=0x7f7d8400dcf0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 -- 172.21.15.130:0/112348743 shutdown_connections 2023-09-13T06:06:48.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d80065b20 0x7f7d80067fe0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d94144d70 0x7f7d94156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d940b2e90 0x7f7d94138580 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 --2- 172.21.15.130:0/112348743 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d940b1460 0x7f7d940adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 -- 172.21.15.130:0/112348743 >> 172.21.15.130:0/112348743 conn(0x7f7d94065990 msgr2=0x7f7d94143a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:48.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 -- 172.21.15.130:0/112348743 shutdown_connections 2023-09-13T06:06:48.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.360+0000 7f7d9b034640 1 -- 172.21.15.130:0/112348743 wait complete. 2023-09-13T06:06:48.380 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:06:48.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79fe159640 1 Processor -- start 2023-09-13T06:06:48.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79fe159640 1 -- start start 2023-09-13T06:06:48.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79fe159640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79f8147030 0x7f79f806fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79fe159640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f79f806d5a0 0x7f79f806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79fe159640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f806b8c0 con 0x7f79f806cb30 2023-09-13T06:06:48.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79fe159640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f806c160 con 0x7f79f806d5a0 2023-09-13T06:06:48.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79fe159640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f806da30 con 0x7f79f8147030 2023-09-13T06:06:48.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79f6ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f79f806d5a0 0x7f79f806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79f7fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f79f806cb30 0x7f79f80ac840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51396/0 (socket says 172.21.15.130:51396) 2023-09-13T06:06:48.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79f7fff640 1 -- 172.21.15.130:0/3849169983 learned_addr learned my addr 172.21.15.130:0/3849169983 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:48.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79f6ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f79f806d5a0 0x7f79f806c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44328/0 (socket says 172.21.15.130:44328) 2023-09-13T06:06:48.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79f77fe640 1 --2- 172.21.15.130:0/3849169983 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79f8147030 0x7f79f806fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79f6ffd640 1 -- 172.21.15.130:0/3849169983 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79f8147030 msgr2=0x7f79f806fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:48.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79f6ffd640 1 --2- 172.21.15.130:0/3849169983 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79f8147030 0x7f79f806fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79f6ffd640 1 -- 172.21.15.130:0/3849169983 >> v1:172.21.15.130:6789/0 conn(0x7f79f806cb30 legacy=0x7f79f80ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.524+0000 7f79f6ffd640 1 -- 172.21.15.130:0/3849169983 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f806bb10 con 0x7f79f806d5a0 2023-09-13T06:06:48.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79f6ffd640 1 --2- 172.21.15.130:0/3849169983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79f806d5a0 0x7f79f806c5f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0097c0 tx=0x7f79ec01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b792dc953ab806 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:48.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79f67fc640 1 -- 172.21.15.130:0/3849169983 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0ab610 con 0x7f79f806d5a0 2023-09-13T06:06:48.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79f67fc640 1 -- 172.21.15.130:0/3849169983 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec0ab770 con 0x7f79f806d5a0 2023-09-13T06:06:48.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79f67fc640 1 -- 172.21.15.130:0/3849169983 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0abb00 con 0x7f79f806d5a0 2023-09-13T06:06:48.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79fe159640 1 -- 172.21.15.130:0/3849169983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79f806d5a0 msgr2=0x7f79f806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79fe159640 1 --2- 172.21.15.130:0/3849169983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79f806d5a0 0x7f79f806c5f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0097c0 tx=0x7f79ec01c3f0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79fe159640 1 -- 172.21.15.130:0/3849169983 shutdown_connections 2023-09-13T06:06:48.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79fe159640 1 --2- 172.21.15.130:0/3849169983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79f806d5a0 0x7f79f806c5f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79fe159640 1 --2- 172.21.15.130:0/3849169983 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79f8147030 0x7f79f806fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79fe159640 1 -- 172.21.15.130:0/3849169983 >> 172.21.15.130:0/3849169983 conn(0x7f79f80b0550 msgr2=0x7f79f80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:48.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79fe159640 1 -- 172.21.15.130:0/3849169983 shutdown_connections 2023-09-13T06:06:48.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.528+0000 7f79fe159640 1 -- 172.21.15.130:0/3849169983 wait complete. 2023-09-13T06:06:48.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79fe159640 1 Processor -- start 2023-09-13T06:06:48.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79fe159640 1 -- start start 2023-09-13T06:06:48.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79fe159640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79f806cb30 0x7f79f8159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79fe159640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79f8147030 0x7f79f8142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79fe159640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79f813ec40 0x7f79f813f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79fe159640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80ce720 con 0x7f79f8147030 2023-09-13T06:06:48.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79fe159640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f815a410 con 0x7f79f813ec40 2023-09-13T06:06:48.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79fe159640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80cdaa0 con 0x7f79f806cb30 2023-09-13T06:06:48.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79f8147030 0x7f79f8142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79f8147030 0x7f79f8142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44332/0 (socket says 172.21.15.130:44332) 2023-09-13T06:06:48.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f6ffd640 1 -- 172.21.15.130:0/1834135156 learned_addr learned my addr 172.21.15.130:0/1834135156 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:48.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f77fe640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79f806cb30 0x7f79f8159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f7fff640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79f813ec40 0x7f79f813f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f6ffd640 1 -- 172.21.15.130:0/1834135156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79f806cb30 msgr2=0x7f79f8159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f6ffd640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79f806cb30 0x7f79f8159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f6ffd640 1 -- 172.21.15.130:0/1834135156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79f813ec40 msgr2=0x7f79f813f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f6ffd640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79f813ec40 0x7f79f813f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f6ffd640 1 -- 172.21.15.130:0/1834135156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec009420 con 0x7f79f8147030 2023-09-13T06:06:48.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f7fff640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79f813ec40 0x7f79f813f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:48.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79f6ffd640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79f8147030 0x7f79f8142dc0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0ad040 tx=0x7f79ec01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:48.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79dffff640 1 -- 172.21.15.130:0/1834135156 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0bf610 con 0x7f79f8147030 2023-09-13T06:06:48.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79dffff640 1 -- 172.21.15.130:0/1834135156 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec0bf7b0 con 0x7f79f8147030 2023-09-13T06:06:48.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79fe159640 1 -- 172.21.15.130:0/1834135156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f80cdd80 con 0x7f79f8147030 2023-09-13T06:06:48.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79dffff640 1 -- 172.21.15.130:0/1834135156 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0bfb60 con 0x7f79f8147030 2023-09-13T06:06:48.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79fe159640 1 -- 172.21.15.130:0/1834135156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f80ce340 con 0x7f79f8147030 2023-09-13T06:06:48.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.532+0000 7f79fe159640 1 -- 172.21.15.130:0/1834135156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f80ce860 con 0x7f79f8147030 2023-09-13T06:06:48.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.536+0000 7f79dffff640 1 -- 172.21.15.130:0/1834135156 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f79ec0b5400 con 0x7f79f8147030 2023-09-13T06:06:48.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.536+0000 7f79dffff640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79e4065b20 0x7f79e4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.536+0000 7f79dffff640 1 -- 172.21.15.130:0/1834135156 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79ec11de90 con 0x7f79f8147030 2023-09-13T06:06:48.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.536+0000 7f79f77fe640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79e4065b20 0x7f79e4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.536+0000 7f79f77fe640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79e4065b20 0x7f79e4067fe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009af0 tx=0x7f79e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:48.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.540+0000 7f79dffff640 1 -- 172.21.15.130:0/1834135156 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f79f80ce860 con 0x7f79f8147030 2023-09-13T06:06:48.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.688+0000 7f79fe159640 1 -- 172.21.15.130:0/1834135156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79f80ce860 con 0x7f79f8147030 2023-09-13T06:06:48.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79dffff640 1 -- 172.21.15.130:0/1834135156 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79f80ce860 con 0x7f79f8147030 2023-09-13T06:06:48.693 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:06:48.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 -- 172.21.15.130:0/1834135156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79e4065b20 msgr2=0x7f79e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79e4065b20 0x7f79e4067fe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009af0 tx=0x7f79e8008040 comp rx=0 tx=0).stop 2023-09-13T06:06:48.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 -- 172.21.15.130:0/1834135156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79f8147030 msgr2=0x7f79f8142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79f8147030 0x7f79f8142dc0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0ad040 tx=0x7f79ec01ac30 comp rx=0 tx=0).stop 2023-09-13T06:06:48.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 -- 172.21.15.130:0/1834135156 shutdown_connections 2023-09-13T06:06:48.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79e4065b20 0x7f79e4067fe0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79f813ec40 0x7f79f813f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79f8147030 0x7f79f8142dc0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 --2- 172.21.15.130:0/1834135156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f79f806cb30 0x7f79f8159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 -- 172.21.15.130:0/1834135156 >> 172.21.15.130:0/1834135156 conn(0x7f79f80b0550 msgr2=0x7f79f81445a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:48.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 -- 172.21.15.130:0/1834135156 shutdown_connections 2023-09-13T06:06:48.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.692+0000 7f79fe159640 1 -- 172.21.15.130:0/1834135156 wait complete. 2023-09-13T06:06:48.713 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:06:48.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.848+0000 7f61511d2640 1 Processor -- start 2023-09-13T06:06:48.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.848+0000 7f61511d2640 1 -- start start 2023-09-13T06:06:48.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f61511d2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f614c0cc780 0x7f614c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f61511d2640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c0ccbe0 con 0x7f614c15b130 2023-09-13T06:06:48.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f61511d2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c0ce980 con 0x7f614c0b04a0 2023-09-13T06:06:48.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f61511d2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0cec60 con 0x7f614c0cc780 2023-09-13T06:06:48.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f614ad9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f614c15b130 0x7f614c0ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51408/0 (socket says 172.21.15.130:51408) 2023-09-13T06:06:48.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f614ad9d640 1 -- 172.21.15.130:0/1934679911 learned_addr learned my addr 172.21.15.130:0/1934679911 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:48.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f614259c640 1 --2- 172.21.15.130:0/1934679911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f614c0cc780 0x7f614c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f614a59c640 1 -- 172.21.15.130:0/1934679911 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994575873 0 0) 0x7f614c0ccbe0 con 0x7f614c15b130 2023-09-13T06:06:48.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f614a59c640 1 -- 172.21.15.130:0/1934679911 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6138003530 con 0x7f614c15b130 2023-09-13T06:06:48.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f614259c640 1 -- 172.21.15.130:0/1934679911 >> v1:172.21.15.164:6789/0 conn(0x7f614c0b04a0 legacy=0x7f614c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f614a59c640 1 -- 172.21.15.130:0/1934679911 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187938791 0 0) 0x7f614c0ce980 con 0x7f614c0b04a0 2023-09-13T06:06:48.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f614259c640 1 -- 172.21.15.130:0/1934679911 >> v1:172.21.15.130:6789/0 conn(0x7f614c15b130 legacy=0x7f614c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.852+0000 7f614259c640 1 -- 172.21.15.130:0/1934679911 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c06c640 con 0x7f614c0cc780 2023-09-13T06:06:48.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.856+0000 7f614259c640 1 --2- 172.21.15.130:0/1934679911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f614c0cc780 0x7f614c15b510 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61340097f0 tx=0x7f613401c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1ea270b9fade5b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:48.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.856+0000 7f614a59c640 1 -- 172.21.15.130:0/1934679911 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c001680 con 0x7f614c0cc780 2023-09-13T06:06:48.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.856+0000 7f614a59c640 1 -- 172.21.15.130:0/1934679911 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61340a7050 con 0x7f614c0cc780 2023-09-13T06:06:48.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.856+0000 7f614a59c640 1 -- 172.21.15.130:0/1934679911 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340ab620 con 0x7f614c0cc780 2023-09-13T06:06:48.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.856+0000 7f61511d2640 1 -- 172.21.15.130:0/1934679911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f614c0cc780 msgr2=0x7f614c15b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.856+0000 7f61511d2640 1 --2- 172.21.15.130:0/1934679911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f614c0cc780 0x7f614c15b510 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61340097f0 tx=0x7f613401c2d0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.856+0000 7f61511d2640 1 -- 172.21.15.130:0/1934679911 shutdown_connections 2023-09-13T06:06:48.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.856+0000 7f61511d2640 1 --2- 172.21.15.130:0/1934679911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f614c0cc780 0x7f614c15b510 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.856+0000 7f61511d2640 1 -- 172.21.15.130:0/1934679911 >> 172.21.15.130:0/1934679911 conn(0x7f614c065990 msgr2=0x7f614c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:48.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.856+0000 7f61511d2640 1 -- 172.21.15.130:0/1934679911 shutdown_connections 2023-09-13T06:06:48.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.856+0000 7f61511d2640 1 -- 172.21.15.130:0/1934679911 wait complete. 2023-09-13T06:06:48.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f61511d2640 1 Processor -- start 2023-09-13T06:06:48.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f61511d2640 1 -- start start 2023-09-13T06:06:48.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f61511d2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f614c0b04a0 0x7f614c146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f61511d2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f614c0cc780 0x7f614c151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f61511d2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f614c15b130 0x7f614c156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f61511d2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c152910 con 0x7f614c0cc780 2023-09-13T06:06:48.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f61511d2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c147120 con 0x7f614c0b04a0 2023-09-13T06:06:48.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f61511d2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c151c90 con 0x7f614c15b130 2023-09-13T06:06:48.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f614259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f614c0cc780 0x7f614c151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f614259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f614c0cc780 0x7f614c151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44346/0 (socket says 172.21.15.130:44346) 2023-09-13T06:06:48.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f614259c640 1 -- 172.21.15.130:0/4261042563 learned_addr learned my addr 172.21.15.130:0/4261042563 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:48.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f614ad9d640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f614c0b04a0 0x7f614c146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f614b59e640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f614c15b130 0x7f614c156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f614259c640 1 -- 172.21.15.130:0/4261042563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f614c15b130 msgr2=0x7f614c156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f614259c640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f614c15b130 0x7f614c156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f614259c640 1 -- 172.21.15.130:0/4261042563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f614c0b04a0 msgr2=0x7f614c146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:48.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f614259c640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f614c0b04a0 0x7f614c146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:48.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f614259c640 1 -- 172.21.15.130:0/4261042563 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6134009420 con 0x7f614c0cc780 2023-09-13T06:06:48.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f614259c640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f614c0cc780 0x7f614c151240 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f61340ae040 tx=0x7f613401ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:48.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f6143fff640 1 -- 172.21.15.130:0/4261042563 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340abd80 con 0x7f614c0cc780 2023-09-13T06:06:48.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f6143fff640 1 -- 172.21.15.130:0/4261042563 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6134004020 con 0x7f614c0cc780 2023-09-13T06:06:48.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f61511d2640 1 -- 172.21.15.130:0/4261042563 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c151f70 con 0x7f614c0cc780 2023-09-13T06:06:48.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f6143fff640 1 -- 172.21.15.130:0/4261042563 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340043d0 con 0x7f614c0cc780 2023-09-13T06:06:48.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f61511d2640 1 -- 172.21.15.130:0/4261042563 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c152530 con 0x7f614c0cc780 2023-09-13T06:06:48.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.860+0000 7f61511d2640 1 -- 172.21.15.130:0/4261042563 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c0618a0 con 0x7f614c0cc780 2023-09-13T06:06:48.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.864+0000 7f6143fff640 1 -- 172.21.15.130:0/4261042563 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6134003620 con 0x7f614c0cc780 2023-09-13T06:06:48.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.864+0000 7f6143fff640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f612c065b20 0x7f612c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:48.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.864+0000 7f6143fff640 1 -- 172.21.15.130:0/4261042563 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f613411da00 con 0x7f614c0cc780 2023-09-13T06:06:48.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.864+0000 7f614ad9d640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f612c065b20 0x7f612c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:48.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.864+0000 7f614ad9d640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f612c065b20 0x7f612c067fe0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f613c001ec0 tx=0x7f613c001c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:48.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:48.868+0000 7f6143fff640 1 -- 172.21.15.130:0/4261042563 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f61340eb3e0 con 0x7f614c0cc780 2023-09-13T06:06:49.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.024+0000 7f61511d2640 1 -- 172.21.15.130:0/4261042563 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f614c15dc70 con 0x7f614c0cc780 2023-09-13T06:06:49.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.024+0000 7f6143fff640 1 -- 172.21.15.130:0/4261042563 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v111) v1 ==== 80+0+0 (secure 0 0 0) 0x7f61340eea00 con 0x7f614c0cc780 2023-09-13T06:06:49.028 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:06:49.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 -- 172.21.15.130:0/4261042563 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f612c065b20 msgr2=0x7f612c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f612c065b20 0x7f612c067fe0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f613c001ec0 tx=0x7f613c001c00 comp rx=0 tx=0).stop 2023-09-13T06:06:49.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 -- 172.21.15.130:0/4261042563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f614c0cc780 msgr2=0x7f614c151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f614c0cc780 0x7f614c151240 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f61340ae040 tx=0x7f613401ab10 comp rx=0 tx=0).stop 2023-09-13T06:06:49.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 -- 172.21.15.130:0/4261042563 shutdown_connections 2023-09-13T06:06:49.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f612c065b20 0x7f612c067fe0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f614c15b130 0x7f614c156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f614c0cc780 0x7f614c151240 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 --2- 172.21.15.130:0/4261042563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f614c0b04a0 0x7f614c146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 -- 172.21.15.130:0/4261042563 >> 172.21.15.130:0/4261042563 conn(0x7f614c065990 msgr2=0x7f614c0b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:49.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 -- 172.21.15.130:0/4261042563 shutdown_connections 2023-09-13T06:06:49.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.028+0000 7f61511d2640 1 -- 172.21.15.130:0/4261042563 wait complete. 2023-09-13T06:06:49.049 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T06:06:49.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:49.050 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-13T06:06:49.169 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:06:49.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:49.170 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T06:06:49.180 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:06:49.180 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:49.190 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:06:49.190 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:49.242 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:49.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8bdc07640 1 Processor -- start 2023-09-13T06:06:49.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8bdc07640 1 -- start start 2023-09-13T06:06:49.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8bdc07640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe8b8159f20 0x7fe8b80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:49.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8bdc07640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b80ccfd0 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8bdc07640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b80ced90 con 0x7fe8b80b1d20 2023-09-13T06:06:49.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8bdc07640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b80b00f0 con 0x7fe8b8159f20 2023-09-13T06:06:49.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8b6ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe8b80cdfc0 0x7fe8b80b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51412/0 (socket says 172.21.15.130:51412) 2023-09-13T06:06:49.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8b6ffd640 1 -- 172.21.15.130:0/1454937743 learned_addr learned my addr 172.21.15.130:0/1454937743 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:49.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8b77fe640 1 --2- 172.21.15.130:0/1454937743 >> v2:172.21.15.164:3300/0 conn(0x7fe8b8159f20 0x7fe8b80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:49.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8b67fc640 1 -- 172.21.15.130:0/1454937743 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705103897 0 0) 0x7fe8b80ccfd0 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8b67fc640 1 -- 172.21.15.130:0/1454937743 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a0003530 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8b77fe640 1 -- 172.21.15.130:0/1454937743 >> v1:172.21.15.164:6789/0 conn(0x7fe8b80b1d20 legacy=0x7fe8b80ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8b77fe640 1 -- 172.21.15.130:0/1454937743 >> v1:172.21.15.130:6789/0 conn(0x7fe8b80cdfc0 legacy=0x7fe8b80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.380+0000 7fe8b77fe640 1 -- 172.21.15.130:0/1454937743 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80cd200 con 0x7fe8b8159f20 2023-09-13T06:06:49.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.384+0000 7fe8b77fe640 1 --2- 172.21.15.130:0/1454937743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b8159f20 0x7fe8b80ce7b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80097c0 tx=0x7fe8a801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0951775b61da0f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:49.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.384+0000 7fe8b67fc640 1 -- 172.21.15.130:0/1454937743 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80ab680 con 0x7fe8b8159f20 2023-09-13T06:06:49.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.384+0000 7fe8b67fc640 1 -- 172.21.15.130:0/1454937743 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a80ab7e0 con 0x7fe8b8159f20 2023-09-13T06:06:49.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.384+0000 7fe8b67fc640 1 -- 172.21.15.130:0/1454937743 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80abb70 con 0x7fe8b8159f20 2023-09-13T06:06:49.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.384+0000 7fe8bdc07640 1 -- 172.21.15.130:0/1454937743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b8159f20 msgr2=0x7fe8b80ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.384+0000 7fe8bdc07640 1 --2- 172.21.15.130:0/1454937743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b8159f20 0x7fe8b80ce7b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80097c0 tx=0x7fe8a801c480 comp rx=0 tx=0).stop 2023-09-13T06:06:49.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.384+0000 7fe8bdc07640 1 -- 172.21.15.130:0/1454937743 shutdown_connections 2023-09-13T06:06:49.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.384+0000 7fe8bdc07640 1 --2- 172.21.15.130:0/1454937743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b8159f20 0x7fe8b80ce7b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.384+0000 7fe8bdc07640 1 -- 172.21.15.130:0/1454937743 >> 172.21.15.130:0/1454937743 conn(0x7fe8b8065990 msgr2=0x7fe8b8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:49.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.384+0000 7fe8bdc07640 1 -- 172.21.15.130:0/1454937743 shutdown_connections 2023-09-13T06:06:49.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.384+0000 7fe8bdc07640 1 -- 172.21.15.130:0/1454937743 wait complete. 2023-09-13T06:06:49.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8bdc07640 1 Processor -- start 2023-09-13T06:06:49.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8bdc07640 1 -- start start 2023-09-13T06:06:49.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8bdc07640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b80b1d20 0x7fe8b8158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:49.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8bdc07640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8b80cdfc0 0x7fe8b814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:49.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8bdc07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b8159f20 0x7fe8b8157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:49.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8bdc07640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8155960 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8bdc07640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8155c40 con 0x7fe8b80b1d20 2023-09-13T06:06:49.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8bdc07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8157140 con 0x7fe8b8159f20 2023-09-13T06:06:49.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8b80cdfc0 0x7fe8b814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:49.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8b80cdfc0 0x7fe8b814dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44350/0 (socket says 172.21.15.130:44350) 2023-09-13T06:06:49.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b6ffd640 1 -- 172.21.15.130:0/3209961789 learned_addr learned my addr 172.21.15.130:0/3209961789 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:49.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b77fe640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b80b1d20 0x7fe8b8158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:49.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b6ffd640 1 -- 172.21.15.130:0/3209961789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b8159f20 msgr2=0x7fe8b8157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b7fff640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b8159f20 0x7fe8b8157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:49.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b6ffd640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b8159f20 0x7fe8b8157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b6ffd640 1 -- 172.21.15.130:0/3209961789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b80b1d20 msgr2=0x7fe8b8158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b6ffd640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b80b1d20 0x7fe8b8158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b6ffd640 1 -- 172.21.15.130:0/3209961789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8009420 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b77fe640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b80b1d20 0x7fe8b8158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:49.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b7fff640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b8159f20 0x7fe8b8157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:49.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8b6ffd640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8b80cdfc0 0x7fe8b814dc20 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c4d0 tx=0x7fe8ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:49.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe89ffff640 1 -- 172.21.15.130:0/3209961789 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac005cf0 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe89ffff640 1 -- 172.21.15.130:0/3209961789 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac005e50 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe89ffff640 1 -- 172.21.15.130:0/3209961789 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac007270 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8bdc07640 1 -- 172.21.15.130:0/3209961789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b8157420 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.388+0000 7fe8bdc07640 1 -- 172.21.15.130:0/3209961789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b8155610 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.392+0000 7fe8bdc07640 1 -- 172.21.15.130:0/3209961789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b80618a0 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.392+0000 7fe89ffff640 1 -- 172.21.15.130:0/3209961789 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe8ac0073d0 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.392+0000 7fe89ffff640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8a4065b50 0x7fe8a4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:49.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.392+0000 7fe89ffff640 1 -- 172.21.15.130:0/3209961789 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8ac082760 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.392+0000 7fe8b77fe640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8a4065b50 0x7fe8a4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:49.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.392+0000 7fe8b77fe640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8a4065b50 0x7fe8a4068010 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80af000 tx=0x7fe8a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:49.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.396+0000 7fe89ffff640 1 -- 172.21.15.130:0/3209961789 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe8ac050160 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.544+0000 7fe8bdc07640 1 -- 172.21.15.130:0/3209961789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8b81578d0 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe89ffff640 1 -- 172.21.15.130:0/3209961789 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16608 (secure 0 0 0) 0x7fe8ac017090 con 0x7fe8b80cdfc0 2023-09-13T06:06:49.549 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:49.550 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":111,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:48.396192+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:06:15.152093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-09-13T06:06:16.467343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:49.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 -- 172.21.15.130:0/3209961789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8a4065b50 msgr2=0x7fe8a4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8a4065b50 0x7fe8a4068010 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80af000 tx=0x7fe8a8008040 comp rx=0 tx=0).stop 2023-09-13T06:06:49.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 -- 172.21.15.130:0/3209961789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8b80cdfc0 msgr2=0x7fe8b814dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8b80cdfc0 0x7fe8b814dc20 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c4d0 tx=0x7fe8ac00c990 comp rx=0 tx=0).stop 2023-09-13T06:06:49.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 -- 172.21.15.130:0/3209961789 shutdown_connections 2023-09-13T06:06:49.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe8a4065b50 0x7fe8a4068010 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b8159f20 0x7fe8b8157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8b80cdfc0 0x7fe8b814dc20 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 --2- 172.21.15.130:0/3209961789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b80b1d20 0x7fe8b8158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 -- 172.21.15.130:0/3209961789 >> 172.21.15.130:0/3209961789 conn(0x7fe8b8065990 msgr2=0x7fe8b8152a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:49.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 -- 172.21.15.130:0/3209961789 shutdown_connections 2023-09-13T06:06:49.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.548+0000 7fe8bdc07640 1 -- 172.21.15.130:0/3209961789 wait complete. 2023-09-13T06:06:49.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:06:15.152093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:06:16.467343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:06:49.573 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:06:49.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb311eab640 1 Processor -- start 2023-09-13T06:06:49.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb311eab640 1 -- start start 2023-09-13T06:06:49.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb311eab640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb30c154760 0x7fb30c0b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:49.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb311eab640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c0b2690 con 0x7fb30c154380 2023-09-13T06:06:49.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb311eab640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c070d80 con 0x7fb30c161140 2023-09-13T06:06:49.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb311eab640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c161700 con 0x7fb30c154760 2023-09-13T06:06:49.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb30b7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb30c154380 0x7fb30c070670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51424/0 (socket says 172.21.15.130:51424) 2023-09-13T06:06:49.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb30b7fe640 1 -- 172.21.15.130:0/4077602874 learned_addr learned my addr 172.21.15.130:0/4077602874 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:49.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb303fff640 1 --2- 172.21.15.130:0/4077602874 >> v2:172.21.15.130:3300/0 conn(0x7fb30c154760 0x7fb30c0b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:49.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb30affd640 1 -- 172.21.15.130:0/4077602874 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390529160 0 0) 0x7fb30c0b2690 con 0x7fb30c154380 2023-09-13T06:06:49.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb30affd640 1 -- 172.21.15.130:0/4077602874 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f8003530 con 0x7fb30c154380 2023-09-13T06:06:49.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb303fff640 1 -- 172.21.15.130:0/4077602874 >> v1:172.21.15.164:6789/0 conn(0x7fb30c161140 legacy=0x7fb30c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb303fff640 1 -- 172.21.15.130:0/4077602874 >> v1:172.21.15.130:6789/0 conn(0x7fb30c154380 legacy=0x7fb30c070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.712+0000 7fb303fff640 1 -- 172.21.15.130:0/4077602874 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c1619e0 con 0x7fb30c154760 2023-09-13T06:06:49.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.716+0000 7fb303fff640 1 --2- 172.21.15.130:0/4077602874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb30c154760 0x7fb30c0b2a80 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40097c0 tx=0x7fb2f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7929a39158776f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:49.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.716+0000 7fb30affd640 1 -- 172.21.15.130:0/4077602874 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40a8050 con 0x7fb30c154760 2023-09-13T06:06:49.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.716+0000 7fb30affd640 1 -- 172.21.15.130:0/4077602874 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f40ac5f0 con 0x7fb30c154760 2023-09-13T06:06:49.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.716+0000 7fb30affd640 1 -- 172.21.15.130:0/4077602874 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40ac980 con 0x7fb30c154760 2023-09-13T06:06:49.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.716+0000 7fb311eab640 1 -- 172.21.15.130:0/4077602874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb30c154760 msgr2=0x7fb30c0b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.716+0000 7fb311eab640 1 --2- 172.21.15.130:0/4077602874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb30c154760 0x7fb30c0b2a80 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40097c0 tx=0x7fb2f401c480 comp rx=0 tx=0).stop 2023-09-13T06:06:49.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.716+0000 7fb311eab640 1 -- 172.21.15.130:0/4077602874 shutdown_connections 2023-09-13T06:06:49.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.716+0000 7fb311eab640 1 --2- 172.21.15.130:0/4077602874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb30c154760 0x7fb30c0b2a80 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.716+0000 7fb311eab640 1 -- 172.21.15.130:0/4077602874 >> 172.21.15.130:0/4077602874 conn(0x7fb30c065990 msgr2=0x7fb30c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:49.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.716+0000 7fb311eab640 1 -- 172.21.15.130:0/4077602874 shutdown_connections 2023-09-13T06:06:49.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.716+0000 7fb311eab640 1 -- 172.21.15.130:0/4077602874 wait complete. 2023-09-13T06:06:49.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb311eab640 1 Processor -- start 2023-09-13T06:06:49.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb311eab640 1 -- start start 2023-09-13T06:06:49.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb311eab640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb30c154380 0x7fb30c148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:49.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb311eab640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb30c154760 0x7fb30c14f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:49.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb311eab640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb30c161140 0x7fb30c15a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:49.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb311eab640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c14ee10 con 0x7fb30c154380 2023-09-13T06:06:49.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb311eab640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c14e200 con 0x7fb30c154760 2023-09-13T06:06:49.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb311eab640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c14e4e0 con 0x7fb30c161140 2023-09-13T06:06:49.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb30b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb30c154380 0x7fb30c148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:49.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb30b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb30c154380 0x7fb30c148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44362/0 (socket says 172.21.15.130:44362) 2023-09-13T06:06:49.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb30b7fe640 1 -- 172.21.15.130:0/3121137650 learned_addr learned my addr 172.21.15.130:0/3121137650 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:49.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb30bfff640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb30c161140 0x7fb30c15a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:49.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb303fff640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb30c154760 0x7fb30c14f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:49.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb30b7fe640 1 -- 172.21.15.130:0/3121137650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb30c161140 msgr2=0x7fb30c15a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb30b7fe640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb30c161140 0x7fb30c15a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb30b7fe640 1 -- 172.21.15.130:0/3121137650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb30c154760 msgr2=0x7fb30c14f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb30b7fe640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb30c154760 0x7fb30c14f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb30b7fe640 1 -- 172.21.15.130:0/3121137650 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f4009420 con 0x7fb30c154380 2023-09-13T06:06:49.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb30bfff640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb30c161140 0x7fb30c15a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:49.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb30b7fe640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb30c154380 0x7fb30c148070 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c4d0 tx=0x7fb2fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:49.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb308ff9640 1 -- 172.21.15.130:0/3121137650 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc005cf0 con 0x7fb30c154380 2023-09-13T06:06:49.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb308ff9640 1 -- 172.21.15.130:0/3121137650 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc005e50 con 0x7fb30c154380 2023-09-13T06:06:49.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb308ff9640 1 -- 172.21.15.130:0/3121137650 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc007270 con 0x7fb30c154380 2023-09-13T06:06:49.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb311eab640 1 -- 172.21.15.130:0/3121137650 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c14e7c0 con 0x7fb30c154380 2023-09-13T06:06:49.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb311eab640 1 -- 172.21.15.130:0/3121137650 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c14de20 con 0x7fb30c154380 2023-09-13T06:06:49.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.720+0000 7fb311eab640 1 -- 172.21.15.130:0/3121137650 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c0618a0 con 0x7fb30c154380 2023-09-13T06:06:49.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.724+0000 7fb308ff9640 1 -- 172.21.15.130:0/3121137650 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb2fc0073d0 con 0x7fb30c154380 2023-09-13T06:06:49.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.724+0000 7fb308ff9640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb2ec065b20 0x7fb2ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:49.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.724+0000 7fb308ff9640 1 -- 172.21.15.130:0/3121137650 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2fc082860 con 0x7fb30c154380 2023-09-13T06:06:49.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.724+0000 7fb303fff640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb2ec065b20 0x7fb2ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:49.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.724+0000 7fb303fff640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb2ec065b20 0x7fb2ec067fe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40ae000 tx=0x7fb2f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:49.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.728+0000 7fb308ff9640 1 -- 172.21.15.130:0/3121137650 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb2fc0501c0 con 0x7fb30c154380 2023-09-13T06:06:49.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 -- 172.21.15.130:0/3121137650 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb30c070050 con 0x7fb30c154380 2023-09-13T06:06:49.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb308ff9640 1 -- 172.21.15.130:0/3121137650 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2fc0170a0 con 0x7fb30c154380 2023-09-13T06:06:49.879 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:06:49.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 -- 172.21.15.130:0/3121137650 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb2ec065b20 msgr2=0x7fb2ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb2ec065b20 0x7fb2ec067fe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40ae000 tx=0x7fb2f4008040 comp rx=0 tx=0).stop 2023-09-13T06:06:49.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 -- 172.21.15.130:0/3121137650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb30c154380 msgr2=0x7fb30c148070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:49.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb30c154380 0x7fb30c148070 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c4d0 tx=0x7fb2fc00c990 comp rx=0 tx=0).stop 2023-09-13T06:06:49.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 -- 172.21.15.130:0/3121137650 shutdown_connections 2023-09-13T06:06:49.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb2ec065b20 0x7fb2ec067fe0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb30c154760 0x7fb30c14f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb30c161140 0x7fb30c15a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 --2- 172.21.15.130:0/3121137650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb30c154380 0x7fb30c148070 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:49.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 -- 172.21.15.130:0/3121137650 >> 172.21.15.130:0/3121137650 conn(0x7fb30c065990 msgr2=0x7fb30c070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:49.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 -- 172.21.15.130:0/3121137650 shutdown_connections 2023-09-13T06:06:49.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:49.876+0000 7fb311eab640 1 -- 172.21.15.130:0/3121137650 wait complete. 2023-09-13T06:06:49.899 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:06:50.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.036+0000 7effaa365640 1 Processor -- start 2023-09-13T06:06:50.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.036+0000 7effaa365640 1 -- start start 2023-09-13T06:06:50.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effaa365640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effa4146d40 0x7effa40b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effaa365640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7effa4070e80 0x7effa40b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effaa365640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa40b42a0 con 0x7effa40d3a80 2023-09-13T06:06:50.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effaa365640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa40b4560 con 0x7effa4070e80 2023-09-13T06:06:50.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effaa365640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa40b4840 con 0x7effa4146d40 2023-09-13T06:06:50.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effa8b62640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7effa40d3a80 0x7effa4070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51436/0 (socket says 172.21.15.130:51436) 2023-09-13T06:06:50.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effa8b62640 1 -- 172.21.15.130:0/1215699972 learned_addr learned my addr 172.21.15.130:0/1215699972 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:50.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effa9363640 1 --2- 172.21.15.130:0/1215699972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effa4146d40 0x7effa40b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effa9b64640 1 --2- 172.21.15.130:0/1215699972 >> v2:172.21.15.164:3300/0 conn(0x7effa4070e80 0x7effa40b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7eff9bfff640 1 -- 172.21.15.130:0/1215699972 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447057672 0 0) 0x7effa40b42a0 con 0x7effa40d3a80 2023-09-13T06:06:50.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7eff9bfff640 1 -- 172.21.15.130:0/1215699972 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff90003530 con 0x7effa40d3a80 2023-09-13T06:06:50.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effa9363640 1 -- 172.21.15.130:0/1215699972 >> v2:172.21.15.164:3300/0 conn(0x7effa4070e80 msgr2=0x7effa40b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:50.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effa9363640 1 --2- 172.21.15.130:0/1215699972 >> v2:172.21.15.164:3300/0 conn(0x7effa4070e80 0x7effa40b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effa9363640 1 -- 172.21.15.130:0/1215699972 >> v1:172.21.15.130:6789/0 conn(0x7effa40d3a80 legacy=0x7effa4070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.040+0000 7effa9363640 1 -- 172.21.15.130:0/1215699972 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa40b4b20 con 0x7effa4146d40 2023-09-13T06:06:50.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7effa9363640 1 --2- 172.21.15.130:0/1215699972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effa4146d40 0x7effa40b8900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7effa00097c0 tx=0x7effa001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc609caae41b98d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:50.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7eff9bfff640 1 -- 172.21.15.130:0/1215699972 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa00ad640 con 0x7effa4146d40 2023-09-13T06:06:50.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7eff9bfff640 1 -- 172.21.15.130:0/1215699972 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa00ad7a0 con 0x7effa4146d40 2023-09-13T06:06:50.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7eff9bfff640 1 -- 172.21.15.130:0/1215699972 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa00adb30 con 0x7effa4146d40 2023-09-13T06:06:50.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7effaa365640 1 -- 172.21.15.130:0/1215699972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effa4146d40 msgr2=0x7effa40b8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7effaa365640 1 --2- 172.21.15.130:0/1215699972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effa4146d40 0x7effa40b8900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7effa00097c0 tx=0x7effa001c480 comp rx=0 tx=0).stop 2023-09-13T06:06:50.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7effaa365640 1 -- 172.21.15.130:0/1215699972 shutdown_connections 2023-09-13T06:06:50.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7effaa365640 1 --2- 172.21.15.130:0/1215699972 >> v2:172.21.15.164:3300/0 conn(0x7effa4070e80 0x7effa40b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7effaa365640 1 --2- 172.21.15.130:0/1215699972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effa4146d40 0x7effa40b8900 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7effaa365640 1 -- 172.21.15.130:0/1215699972 >> 172.21.15.130:0/1215699972 conn(0x7effa40d2f60 msgr2=0x7effa40d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:50.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7effaa365640 1 -- 172.21.15.130:0/1215699972 shutdown_connections 2023-09-13T06:06:50.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7effaa365640 1 -- 172.21.15.130:0/1215699972 wait complete. 2023-09-13T06:06:50.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7effaa365640 1 Processor -- start 2023-09-13T06:06:50.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.044+0000 7effaa365640 1 -- start start 2023-09-13T06:06:50.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effaa365640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effa4070e80 0x7effa4160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effaa365640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effa40d3a80 0x7effa413c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effaa365640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effa4146d40 0x7effa41f8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effaa365640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa4161360 con 0x7effa40d3a80 2023-09-13T06:06:50.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effaa365640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa415a3f0 con 0x7effa4146d40 2023-09-13T06:06:50.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effaa365640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa4159b30 con 0x7effa4070e80 2023-09-13T06:06:50.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effa8b62640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effa40d3a80 0x7effa413c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effa8b62640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effa40d3a80 0x7effa413c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44372/0 (socket says 172.21.15.130:44372) 2023-09-13T06:06:50.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effa8b62640 1 -- 172.21.15.130:0/1126016375 learned_addr learned my addr 172.21.15.130:0/1126016375 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:50.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effa9363640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effa4070e80 0x7effa4160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effa9b64640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effa4146d40 0x7effa41f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effa8b62640 1 -- 172.21.15.130:0/1126016375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effa4070e80 msgr2=0x7effa4160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effa8b62640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effa4070e80 0x7effa4160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effa8b62640 1 -- 172.21.15.130:0/1126016375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effa4146d40 msgr2=0x7effa41f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effa8b62640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effa4146d40 0x7effa41f8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effa8b62640 1 -- 172.21.15.130:0/1126016375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0009420 con 0x7effa40d3a80 2023-09-13T06:06:50.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effa8b62640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effa40d3a80 0x7effa413c980 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c480 tx=0x7eff9400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:50.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7eff99ffb640 1 -- 172.21.15.130:0/1126016375 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94005cf0 con 0x7effa40d3a80 2023-09-13T06:06:50.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7eff99ffb640 1 -- 172.21.15.130:0/1126016375 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff94005e50 con 0x7effa40d3a80 2023-09-13T06:06:50.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effaa365640 1 -- 172.21.15.130:0/1126016375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa4159da0 con 0x7effa40d3a80 2023-09-13T06:06:50.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7eff99ffb640 1 -- 172.21.15.130:0/1126016375 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94007290 con 0x7effa40d3a80 2023-09-13T06:06:50.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effaa365640 1 -- 172.21.15.130:0/1126016375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa413cec0 con 0x7effa40d3a80 2023-09-13T06:06:50.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7effaa365640 1 -- 172.21.15.130:0/1126016375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa40b7f60 con 0x7effa40d3a80 2023-09-13T06:06:50.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.048+0000 7eff99ffb640 1 -- 172.21.15.130:0/1126016375 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7eff940073f0 con 0x7effa40d3a80 2023-09-13T06:06:50.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.052+0000 7eff99ffb640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff88065b20 0x7eff88067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.052+0000 7eff99ffb640 1 -- 172.21.15.130:0/1126016375 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff94082800 con 0x7effa40d3a80 2023-09-13T06:06:50.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.052+0000 7effa9363640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff88065b20 0x7eff88067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.052+0000 7effa9363640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff88065b20 0x7eff88067fe0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7effa00af000 tx=0x7effa00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:50.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.056+0000 7eff99ffb640 1 -- 172.21.15.130:0/1126016375 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7eff94050270 con 0x7effa40d3a80 2023-09-13T06:06:50.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 -- 172.21.15.130:0/1126016375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7effa4070390 con 0x7effa40d3a80 2023-09-13T06:06:50.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7eff99ffb640 1 -- 172.21.15.130:0/1126016375 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff94017020 con 0x7effa40d3a80 2023-09-13T06:06:50.206 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:06:50.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 -- 172.21.15.130:0/1126016375 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff88065b20 msgr2=0x7eff88067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff88065b20 0x7eff88067fe0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7effa00af000 tx=0x7effa00a7070 comp rx=0 tx=0).stop 2023-09-13T06:06:50.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 -- 172.21.15.130:0/1126016375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effa40d3a80 msgr2=0x7effa413c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effa40d3a80 0x7effa413c980 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c480 tx=0x7eff9400c940 comp rx=0 tx=0).stop 2023-09-13T06:06:50.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 -- 172.21.15.130:0/1126016375 shutdown_connections 2023-09-13T06:06:50.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff88065b20 0x7eff88067fe0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effa4146d40 0x7effa41f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effa40d3a80 0x7effa413c980 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 --2- 172.21.15.130:0/1126016375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7effa4070e80 0x7effa4160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 -- 172.21.15.130:0/1126016375 >> 172.21.15.130:0/1126016375 conn(0x7effa40d2f60 msgr2=0x7effa415ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:50.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 -- 172.21.15.130:0/1126016375 shutdown_connections 2023-09-13T06:06:50.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.204+0000 7effaa365640 1 -- 172.21.15.130:0/1126016375 wait complete. 2023-09-13T06:06:50.226 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:06:50.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.364+0000 7fb54ca19640 1 Processor -- start 2023-09-13T06:06:50.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.364+0000 7fb54ca19640 1 -- start start 2023-09-13T06:06:50.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb54ca19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb548144d70 0x7fb5480ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb54ca19640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb5480b2780 0x7fb5480b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb54ca19640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5480b3120 con 0x7fb5480b1460 2023-09-13T06:06:50.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb54ca19640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5480b2430 con 0x7fb5480b2780 2023-09-13T06:06:50.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb54ca19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5480cedb0 con 0x7fb548144d70 2023-09-13T06:06:50.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb53ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb5480b2780 0x7fb5480b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb53ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb5480b2780 0x7fb5480b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44388/0 (socket says 172.21.15.130:44388) 2023-09-13T06:06:50.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb53ffff640 1 -- 172.21.15.130:0/1769569744 learned_addr learned my addr 172.21.15.130:0/1769569744 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:50.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb53ffff640 1 -- 172.21.15.130:0/1769569744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb548144d70 msgr2=0x7fb5480ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:50.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb53ffff640 1 --2- 172.21.15.130:0/1769569744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb548144d70 0x7fb5480ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb53ffff640 1 -- 172.21.15.130:0/1769569744 >> v1:172.21.15.164:6789/0 conn(0x7fb5480b1460 legacy=0x7fb5480b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:50.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.368+0000 7fb53ffff640 1 -- 172.21.15.130:0/1769569744 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5480b2150 con 0x7fb5480b2780 2023-09-13T06:06:50.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb53ffff640 1 --2- 172.21.15.130:0/1769569744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5480b2780 0x7fb5480b2be0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fb530009870 tx=0x7fb53001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd56488362101682 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:50.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb545d9b640 1 -- 172.21.15.130:0/1769569744 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5300ac410 con 0x7fb5480b2780 2023-09-13T06:06:50.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb545d9b640 1 -- 172.21.15.130:0/1769569744 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5300ac570 con 0x7fb5480b2780 2023-09-13T06:06:50.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb545d9b640 1 -- 172.21.15.130:0/1769569744 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5300ac900 con 0x7fb5480b2780 2023-09-13T06:06:50.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb54ca19640 1 -- 172.21.15.130:0/1769569744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5480b2780 msgr2=0x7fb5480b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb54ca19640 1 --2- 172.21.15.130:0/1769569744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5480b2780 0x7fb5480b2be0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fb530009870 tx=0x7fb53001c500 comp rx=0 tx=0).stop 2023-09-13T06:06:50.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb54ca19640 1 -- 172.21.15.130:0/1769569744 shutdown_connections 2023-09-13T06:06:50.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb54ca19640 1 --2- 172.21.15.130:0/1769569744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5480b2780 0x7fb5480b2be0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb54ca19640 1 --2- 172.21.15.130:0/1769569744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb548144d70 0x7fb5480ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb54ca19640 1 -- 172.21.15.130:0/1769569744 >> 172.21.15.130:0/1769569744 conn(0x7fb548065990 msgr2=0x7fb548065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:50.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb54ca19640 1 -- 172.21.15.130:0/1769569744 shutdown_connections 2023-09-13T06:06:50.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb54ca19640 1 -- 172.21.15.130:0/1769569744 wait complete. 2023-09-13T06:06:50.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb54ca19640 1 Processor -- start 2023-09-13T06:06:50.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.372+0000 7fb54ca19640 1 -- start start 2023-09-13T06:06:50.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb54ca19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5480b1460 0x7fb54813b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb54ca19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5480b2780 0x7fb54815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb54ca19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb548144d70 0x7fb548138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb54ca19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5481552d0 con 0x7fb548144d70 2023-09-13T06:06:50.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb54ca19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb548138da0 con 0x7fb5480b1460 2023-09-13T06:06:50.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb54ca19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54815a5b0 con 0x7fb5480b2780 2023-09-13T06:06:50.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb546d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb548144d70 0x7fb548138200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb546d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb548144d70 0x7fb548138200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44394/0 (socket says 172.21.15.130:44394) 2023-09-13T06:06:50.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb546d9d640 1 -- 172.21.15.130:0/585114590 learned_addr learned my addr 172.21.15.130:0/585114590 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:50.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb54659c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5480b1460 0x7fb54813b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb53ffff640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5480b2780 0x7fb54815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb546d9d640 1 -- 172.21.15.130:0/585114590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5480b2780 msgr2=0x7fb54815a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb546d9d640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5480b2780 0x7fb54815a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb546d9d640 1 -- 172.21.15.130:0/585114590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5480b1460 msgr2=0x7fb54813b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb546d9d640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5480b1460 0x7fb54813b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb546d9d640 1 -- 172.21.15.130:0/585114590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5300094d0 con 0x7fb548144d70 2023-09-13T06:06:50.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb546d9d640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb548144d70 0x7fb548138200 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fb54000c780 tx=0x7fb54000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:50.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb53effd640 1 -- 172.21.15.130:0/585114590 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540004b70 con 0x7fb548144d70 2023-09-13T06:06:50.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb53effd640 1 -- 172.21.15.130:0/585114590 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54000ce90 con 0x7fb548144d70 2023-09-13T06:06:50.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb53effd640 1 -- 172.21.15.130:0/585114590 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000a850 con 0x7fb548144d70 2023-09-13T06:06:50.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb54ca19640 1 -- 172.21.15.130:0/585114590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54813c170 con 0x7fb548144d70 2023-09-13T06:06:50.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb54ca19640 1 -- 172.21.15.130:0/585114590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54813b8d0 con 0x7fb548144d70 2023-09-13T06:06:50.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.376+0000 7fb54ca19640 1 -- 172.21.15.130:0/585114590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb548155410 con 0x7fb548144d70 2023-09-13T06:06:50.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.380+0000 7fb53effd640 1 -- 172.21.15.130:0/585114590 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb54000a9b0 con 0x7fb548144d70 2023-09-13T06:06:50.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.380+0000 7fb53effd640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb528065b20 0x7fb528067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.380+0000 7fb53effd640 1 -- 172.21.15.130:0/585114590 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5400833c0 con 0x7fb548144d70 2023-09-13T06:06:50.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.380+0000 7fb54659c640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb528065b20 0x7fb528067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.380+0000 7fb54659c640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb528065b20 0x7fb528067fe0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb5481f7390 tx=0x7fb538006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:50.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.384+0000 7fb53effd640 1 -- 172.21.15.130:0/585114590 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb548155410 con 0x7fb548144d70 2023-09-13T06:06:50.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 -- 172.21.15.130:0/585114590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb548155410 con 0x7fb548144d70 2023-09-13T06:06:50.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb53effd640 1 -- 172.21.15.130:0/585114590 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb548155410 con 0x7fb548144d70 2023-09-13T06:06:50.534 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:06:50.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 -- 172.21.15.130:0/585114590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb528065b20 msgr2=0x7fb528067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb528065b20 0x7fb528067fe0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb5481f7390 tx=0x7fb538006f90 comp rx=0 tx=0).stop 2023-09-13T06:06:50.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 -- 172.21.15.130:0/585114590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb548144d70 msgr2=0x7fb548138200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb548144d70 0x7fb548138200 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fb54000c780 tx=0x7fb54000cc40 comp rx=0 tx=0).stop 2023-09-13T06:06:50.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 -- 172.21.15.130:0/585114590 shutdown_connections 2023-09-13T06:06:50.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb528065b20 0x7fb528067fe0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb548144d70 0x7fb548138200 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5480b2780 0x7fb54815a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 --2- 172.21.15.130:0/585114590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5480b1460 0x7fb54813b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 -- 172.21.15.130:0/585114590 >> 172.21.15.130:0/585114590 conn(0x7fb548065990 msgr2=0x7fb5481576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:50.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 -- 172.21.15.130:0/585114590 shutdown_connections 2023-09-13T06:06:50.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.532+0000 7fb54ca19640 1 -- 172.21.15.130:0/585114590 wait complete. 2023-09-13T06:06:50.556 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:06:50.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.692+0000 7fc551f11640 1 Processor -- start 2023-09-13T06:06:50.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.692+0000 7fc551f11640 1 -- start start 2023-09-13T06:06:50.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc551f11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc54c0ae170 0x7fc54c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc551f11640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54c0cce60 con 0x7fc54c15d9d0 2023-09-13T06:06:50.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc551f11640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54c0cd140 con 0x7fc54c15d5f0 2023-09-13T06:06:50.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc551f11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c0cd420 con 0x7fc54c0ae170 2023-09-13T06:06:50.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc54bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc54c15d9d0 0x7fc54c0cdf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51450/0 (socket says 172.21.15.130:51450) 2023-09-13T06:06:50.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc54bfff640 1 -- 172.21.15.130:0/1739122599 learned_addr learned my addr 172.21.15.130:0/1739122599 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:50.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc54affd640 1 --2- 172.21.15.130:0/1739122599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc54c0ae170 0x7fc54c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc54a7fc640 1 -- 172.21.15.130:0/1739122599 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329363541 0 0) 0x7fc54c0cce60 con 0x7fc54c15d9d0 2023-09-13T06:06:50.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc54a7fc640 1 -- 172.21.15.130:0/1739122599 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc534003450 con 0x7fc54c15d9d0 2023-09-13T06:06:50.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc54a7fc640 1 -- 172.21.15.130:0/1739122599 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598839439 0 0) 0x7fc54c0cd140 con 0x7fc54c15d5f0 2023-09-13T06:06:50.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc54a7fc640 1 -- 172.21.15.130:0/1739122599 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc54c0cce60 con 0x7fc54c15d5f0 2023-09-13T06:06:50.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc54affd640 1 -- 172.21.15.130:0/1739122599 >> v1:172.21.15.164:6789/0 conn(0x7fc54c15d5f0 legacy=0x7fc54c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc54affd640 1 -- 172.21.15.130:0/1739122599 >> v1:172.21.15.130:6789/0 conn(0x7fc54c15d9d0 legacy=0x7fc54c0cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.696+0000 7fc54affd640 1 -- 172.21.15.130:0/1739122599 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c0cd700 con 0x7fc54c0ae170 2023-09-13T06:06:50.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc54affd640 1 --2- 172.21.15.130:0/1739122599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc54c0ae170 0x7fc54c0cc7f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5400097f0 tx=0x7fc54001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b12db7d99c4e344d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:50.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc54a7fc640 1 -- 172.21.15.130:0/1739122599 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5400ab600 con 0x7fc54c0ae170 2023-09-13T06:06:50.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc54a7fc640 1 -- 172.21.15.130:0/1739122599 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5400a7050 con 0x7fc54c0ae170 2023-09-13T06:06:50.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc54a7fc640 1 -- 172.21.15.130:0/1739122599 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5400ab980 con 0x7fc54c0ae170 2023-09-13T06:06:50.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc551f11640 1 -- 172.21.15.130:0/1739122599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc54c0ae170 msgr2=0x7fc54c0cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc551f11640 1 --2- 172.21.15.130:0/1739122599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc54c0ae170 0x7fc54c0cc7f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5400097f0 tx=0x7fc54001c430 comp rx=0 tx=0).stop 2023-09-13T06:06:50.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc551f11640 1 -- 172.21.15.130:0/1739122599 shutdown_connections 2023-09-13T06:06:50.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc551f11640 1 --2- 172.21.15.130:0/1739122599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc54c0ae170 0x7fc54c0cc7f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc551f11640 1 -- 172.21.15.130:0/1739122599 >> 172.21.15.130:0/1739122599 conn(0x7fc54c065990 msgr2=0x7fc54c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:50.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc551f11640 1 -- 172.21.15.130:0/1739122599 shutdown_connections 2023-09-13T06:06:50.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc551f11640 1 -- 172.21.15.130:0/1739122599 wait complete. 2023-09-13T06:06:50.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.700+0000 7fc551f11640 1 Processor -- start 2023-09-13T06:06:50.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc551f11640 1 -- start start 2023-09-13T06:06:50.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc551f11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc54c0ae170 0x7fc54c14a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc551f11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc54c15d5f0 0x7fc54c06f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc551f11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc54c15d9d0 0x7fc54c1f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc551f11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c14bc40 con 0x7fc54c15d5f0 2023-09-13T06:06:50.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc551f11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c14b030 con 0x7fc54c15d9d0 2023-09-13T06:06:50.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc551f11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c14b310 con 0x7fc54c0ae170 2023-09-13T06:06:50.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc54c15d5f0 0x7fc54c06f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc54c15d5f0 0x7fc54c06f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44400/0 (socket says 172.21.15.130:44400) 2023-09-13T06:06:50.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54affd640 1 -- 172.21.15.130:0/2668995605 learned_addr learned my addr 172.21.15.130:0/2668995605 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:50.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54b7fe640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc54c0ae170 0x7fc54c14a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54bfff640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc54c15d9d0 0x7fc54c1f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54affd640 1 -- 172.21.15.130:0/2668995605 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc54c0ae170 msgr2=0x7fc54c14a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54affd640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc54c0ae170 0x7fc54c14a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54affd640 1 -- 172.21.15.130:0/2668995605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc54c15d9d0 msgr2=0x7fc54c1f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54affd640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc54c15d9d0 0x7fc54c1f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54affd640 1 -- 172.21.15.130:0/2668995605 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc540009420 con 0x7fc54c15d5f0 2023-09-13T06:06:50.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54bfff640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc54c15d9d0 0x7fc54c1f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:50.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc54affd640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc54c15d5f0 0x7fc54c06f930 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fc540019040 tx=0x7fc54001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:50.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc533fff640 1 -- 172.21.15.130:0/2668995605 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5400b37d0 con 0x7fc54c15d5f0 2023-09-13T06:06:50.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc533fff640 1 -- 172.21.15.130:0/2668995605 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5400b3950 con 0x7fc54c15d5f0 2023-09-13T06:06:50.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc551f11640 1 -- 172.21.15.130:0/2668995605 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54c14b5f0 con 0x7fc54c15d5f0 2023-09-13T06:06:50.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc533fff640 1 -- 172.21.15.130:0/2668995605 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5400b3d00 con 0x7fc54c15d5f0 2023-09-13T06:06:50.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc551f11640 1 -- 172.21.15.130:0/2668995605 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c14cb90 con 0x7fc54c15d5f0 2023-09-13T06:06:50.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.704+0000 7fc551f11640 1 -- 172.21.15.130:0/2668995605 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54c14bdb0 con 0x7fc54c15d5f0 2023-09-13T06:06:50.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.708+0000 7fc533fff640 1 -- 172.21.15.130:0/2668995605 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc5400b2070 con 0x7fc54c15d5f0 2023-09-13T06:06:50.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.708+0000 7fc533fff640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc538065b50 0x7fc538068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:50.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.708+0000 7fc533fff640 1 -- 172.21.15.130:0/2668995605 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc54011d430 con 0x7fc54c15d5f0 2023-09-13T06:06:50.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.708+0000 7fc54b7fe640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc538065b50 0x7fc538068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:50.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.708+0000 7fc54b7fe640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc538065b50 0x7fc538068010 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc53c001570 tx=0x7fc53c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:50.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.712+0000 7fc533fff640 1 -- 172.21.15.130:0/2668995605 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc5400ead70 con 0x7fc54c15d5f0 2023-09-13T06:06:50.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.868+0000 7fc551f11640 1 -- 172.21.15.130:0/2668995605 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc54c0618a0 con 0x7fc54c15d5f0 2023-09-13T06:06:50.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.868+0000 7fc533fff640 1 -- 172.21.15.130:0/2668995605 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v111) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc5400b0080 con 0x7fc54c15d5f0 2023-09-13T06:06:50.873 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:06:50.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 -- 172.21.15.130:0/2668995605 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc538065b50 msgr2=0x7fc538068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc538065b50 0x7fc538068010 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc53c001570 tx=0x7fc53c009040 comp rx=0 tx=0).stop 2023-09-13T06:06:50.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 -- 172.21.15.130:0/2668995605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc54c15d5f0 msgr2=0x7fc54c06f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:50.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc54c15d5f0 0x7fc54c06f930 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fc540019040 tx=0x7fc54001ac70 comp rx=0 tx=0).stop 2023-09-13T06:06:50.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 -- 172.21.15.130:0/2668995605 shutdown_connections 2023-09-13T06:06:50.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc538065b50 0x7fc538068010 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc54c15d9d0 0x7fc54c1f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc54c15d5f0 0x7fc54c06f930 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 --2- 172.21.15.130:0/2668995605 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc54c0ae170 0x7fc54c14a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:50.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 -- 172.21.15.130:0/2668995605 >> 172.21.15.130:0/2668995605 conn(0x7fc54c065990 msgr2=0x7fc54c158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:50.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 -- 172.21.15.130:0/2668995605 shutdown_connections 2023-09-13T06:06:50.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:50.872+0000 7fc551f11640 1 -- 172.21.15.130:0/2668995605 wait complete. 2023-09-13T06:06:50.893 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T06:06:50.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:50.894 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-13T06:06:50.955 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:06:50.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:06:50.956 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T06:06:50.967 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:06:50.968 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:50.977 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:06:50.978 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:06:50.978 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:06:51.019 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:06:51.019 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:51.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bf74d640 1 Processor -- start 2023-09-13T06:06:51.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bf74d640 1 -- start start 2023-09-13T06:06:51.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bf74d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff1b80d1750 0x7ff1b815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bf74d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff1b80d1090 0x7ff1b8146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bf74d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b80b63c0 con 0x7ff1b80d1b30 2023-09-13T06:06:51.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bf74d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b815dea0 con 0x7ff1b80d1090 2023-09-13T06:06:51.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bf74d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b80d0c20 con 0x7ff1b80d1750 2023-09-13T06:06:51.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bcce8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff1b80d1090 0x7ff1b8146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bcce8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff1b80d1090 0x7ff1b8146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50362/0 (socket says 172.21.15.130:50362) 2023-09-13T06:06:51.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bcce8640 1 -- 172.21.15.130:0/2305369062 learned_addr learned my addr 172.21.15.130:0/2305369062 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:51.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bd4e9640 1 --2- 172.21.15.130:0/2305369062 >> v2:172.21.15.164:3300/0 conn(0x7ff1b80d1750 0x7ff1b815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bcce8640 1 -- 172.21.15.130:0/2305369062 >> v2:172.21.15.164:3300/0 conn(0x7ff1b80d1750 msgr2=0x7ff1b815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:51.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bcce8640 1 --2- 172.21.15.130:0/2305369062 >> v2:172.21.15.164:3300/0 conn(0x7ff1b80d1750 0x7ff1b815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bcce8640 1 -- 172.21.15.130:0/2305369062 >> v1:172.21.15.164:6789/0 conn(0x7ff1b80d1b30 legacy=0x7ff1b80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:51.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.156+0000 7ff1bcce8640 1 -- 172.21.15.130:0/2305369062 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80b6610 con 0x7ff1b80d1090 2023-09-13T06:06:51.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1bcce8640 1 --2- 172.21.15.130:0/2305369062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b80d1090 0x7ff1b8146820 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8073cd0 tx=0x7ff1a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befd00ab2c7cc52c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:51.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1affff640 1 -- 172.21.15.130:0/2305369062 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a80aa430 con 0x7ff1b80d1090 2023-09-13T06:06:51.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1affff640 1 -- 172.21.15.130:0/2305369062 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a80aa590 con 0x7ff1b80d1090 2023-09-13T06:06:51.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1affff640 1 -- 172.21.15.130:0/2305369062 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a80aa920 con 0x7ff1b80d1090 2023-09-13T06:06:51.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1bf74d640 1 -- 172.21.15.130:0/2305369062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b80d1090 msgr2=0x7ff1b8146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1bf74d640 1 --2- 172.21.15.130:0/2305369062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b80d1090 0x7ff1b8146820 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8073cd0 tx=0x7ff1a801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1bf74d640 1 -- 172.21.15.130:0/2305369062 shutdown_connections 2023-09-13T06:06:51.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1bf74d640 1 --2- 172.21.15.130:0/2305369062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b80d1090 0x7ff1b8146820 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1bf74d640 1 --2- 172.21.15.130:0/2305369062 >> v2:172.21.15.164:3300/0 conn(0x7ff1b80d1750 0x7ff1b815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1bf74d640 1 -- 172.21.15.130:0/2305369062 >> 172.21.15.130:0/2305369062 conn(0x7ff1b806f170 msgr2=0x7ff1b806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:51.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1bf74d640 1 -- 172.21.15.130:0/2305369062 shutdown_connections 2023-09-13T06:06:51.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.160+0000 7ff1bf74d640 1 -- 172.21.15.130:0/2305369062 wait complete. 2023-09-13T06:06:51.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bf74d640 1 Processor -- start 2023-09-13T06:06:51.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bf74d640 1 -- start start 2023-09-13T06:06:51.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bf74d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1b80d1090 0x7ff1b813d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bf74d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b80d1750 0x7ff1b813acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bf74d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1b80d1b30 0x7ff1b815be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bf74d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b81437b0 con 0x7ff1b80d1750 2023-09-13T06:06:51.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bf74d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b815fa80 con 0x7ff1b80d1b30 2023-09-13T06:06:51.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bf74d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b815fd60 con 0x7ff1b80d1090 2023-09-13T06:06:51.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bcce8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b80d1750 0x7ff1b813acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bcce8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b80d1750 0x7ff1b813acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50378/0 (socket says 172.21.15.130:50378) 2023-09-13T06:06:51.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bcce8640 1 -- 172.21.15.130:0/676281927 learned_addr learned my addr 172.21.15.130:0/676281927 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:51.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bd4e9640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1b80d1090 0x7ff1b813d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bdcea640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1b80d1b30 0x7ff1b815be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bcce8640 1 -- 172.21.15.130:0/676281927 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1b80d1090 msgr2=0x7ff1b813d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bcce8640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1b80d1090 0x7ff1b813d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bcce8640 1 -- 172.21.15.130:0/676281927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1b80d1b30 msgr2=0x7ff1b815be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bcce8640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1b80d1b30 0x7ff1b815be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bcce8640 1 -- 172.21.15.130:0/676281927 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a80094d0 con 0x7ff1b80d1750 2023-09-13T06:06:51.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bcce8640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b80d1750 0x7ff1b813acf0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80190e0 tx=0x7ff1a801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:51.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1adffb640 1 -- 172.21.15.130:0/676281927 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a80aa430 con 0x7ff1b80d1750 2023-09-13T06:06:51.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1adffb640 1 -- 172.21.15.130:0/676281927 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a80b3800 con 0x7ff1b80d1750 2023-09-13T06:06:51.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bf74d640 1 -- 172.21.15.130:0/676281927 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b8160040 con 0x7ff1b80d1750 2023-09-13T06:06:51.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1adffb640 1 -- 172.21.15.130:0/676281927 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a80b3bb0 con 0x7ff1b80d1750 2023-09-13T06:06:51.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bf74d640 1 -- 172.21.15.130:0/676281927 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b813deb0 con 0x7ff1b80d1750 2023-09-13T06:06:51.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.164+0000 7ff1bf74d640 1 -- 172.21.15.130:0/676281927 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b813e0a0 con 0x7ff1b80d1750 2023-09-13T06:06:51.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.168+0000 7ff1adffb640 1 -- 172.21.15.130:0/676281927 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff1a80b3d10 con 0x7ff1b80d1750 2023-09-13T06:06:51.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.168+0000 7ff1adffb640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff19c065b20 0x7ff19c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.168+0000 7ff1adffb640 1 -- 172.21.15.130:0/676281927 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1a811cfe0 con 0x7ff1b80d1750 2023-09-13T06:06:51.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.168+0000 7ff1bd4e9640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff19c065b20 0x7ff19c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.168+0000 7ff1bd4e9640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff19c065b20 0x7ff19c067fe0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4007a60 tx=0x7ff1b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:51.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.172+0000 7ff1adffb640 1 -- 172.21.15.130:0/676281927 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff1b813e0a0 con 0x7ff1b80d1750 2023-09-13T06:06:51.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.348+0000 7ff1bf74d640 1 -- 172.21.15.130:0/676281927 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1b813e0a0 con 0x7ff1b80d1750 2023-09-13T06:06:51.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.348+0000 7ff1adffb640 1 -- 172.21.15.130:0/676281927 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4924 (secure 0 0 0) 0x7ff1b813e0a0 con 0x7ff1b80d1750 2023-09-13T06:06:51.353 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:51.353 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3211692360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3211692360},{"type":"v1","addr":"172.21.15.164:6834","nonce":3211692360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2453731046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2453731046},{"type":"v1","addr":"172.21.15.130:6835","nonce":2453731046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2896649577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2896649577},{"type":"v1","addr":"172.21.15.164:6835","nonce":2896649577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:06:17.421334+0000","modified":"2023-09-13T06:06:20.748001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6888":{"gid":6888,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/878642631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":878642631},{"type":"v1","addr":"172.21.15.130:6837","nonce":878642631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-09-13T06:06:51.353 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 51 2023-09-13T06:06:51.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 -- 172.21.15.130:0/676281927 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff19c065b20 msgr2=0x7ff19c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff19c065b20 0x7ff19c067fe0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4007a60 tx=0x7ff1b4008040 comp rx=0 tx=0).stop 2023-09-13T06:06:51.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 -- 172.21.15.130:0/676281927 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b80d1750 msgr2=0x7ff1b813acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b80d1750 0x7ff1b813acf0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80190e0 tx=0x7ff1a801ad10 comp rx=0 tx=0).stop 2023-09-13T06:06:51.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 -- 172.21.15.130:0/676281927 shutdown_connections 2023-09-13T06:06:51.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff19c065b20 0x7ff19c067fe0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1b80d1b30 0x7ff1b815be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b80d1750 0x7ff1b813acf0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 --2- 172.21.15.130:0/676281927 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff1b80d1090 0x7ff1b813d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 -- 172.21.15.130:0/676281927 >> 172.21.15.130:0/676281927 conn(0x7ff1b806f170 msgr2=0x7ff1b8145d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:51.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 -- 172.21.15.130:0/676281927 shutdown_connections 2023-09-13T06:06:51.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.352+0000 7ff1bf74d640 1 -- 172.21.15.130:0/676281927 wait complete. 2023-09-13T06:06:51.374 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:51.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a32dd2640 1 Processor -- start 2023-09-13T06:06:51.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a32dd2640 1 -- start start 2023-09-13T06:06:51.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a32dd2640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8a2c15d5f0 0x7f8a2c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a32dd2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8a2c0ae170 0x7f8a2c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a32dd2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a2c15d9d0 0x7f8a2c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a32dd2640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c0cce60 con 0x7f8a2c0ae170 2023-09-13T06:06:51.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a32dd2640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c0cd140 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a32dd2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0cd420 con 0x7f8a2c15d9d0 2023-09-13T06:06:51.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a23fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8a2c0ae170 0x7f8a2c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a30b6e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8a2c15d5f0 0x7f8a2c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a30b6e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8a2c15d5f0 0x7f8a2c0cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:47398/0 (socket says 172.21.15.130:47398) 2023-09-13T06:06:51.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a30b6e640 1 -- 172.21.15.130:0/3543020325 learned_addr learned my addr 172.21.15.130:0/3543020325 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:51.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a3136f640 1 --2- 172.21.15.130:0/3543020325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a2c15d9d0 0x7f8a2c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a30b6e640 1 -- 172.21.15.130:0/3543020325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a2c15d9d0 msgr2=0x7f8a2c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:51.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a30b6e640 1 --2- 172.21.15.130:0/3543020325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a2c15d9d0 0x7f8a2c1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a30b6e640 1 -- 172.21.15.130:0/3543020325 >> v2:172.21.15.130:3300/0 conn(0x7f8a2c0ae170 msgr2=0x7f8a2c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:51.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a30b6e640 1 --2- 172.21.15.130:0/3543020325 >> v2:172.21.15.130:3300/0 conn(0x7f8a2c0ae170 0x7f8a2c0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a30b6e640 1 -- 172.21.15.130:0/3543020325 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0cd700 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.512+0000 7f8a23fff640 1 --2- 172.21.15.130:0/3543020325 >> v2:172.21.15.130:3300/0 conn(0x7f8a2c0ae170 0x7f8a2c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:51.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a30b6e640 1 --2- 172.21.15.130:0/3543020325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a2c15d5f0 0x7f8a2c0cc7f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0b2910 tx=0x7f8a2801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c7123715dd91b33 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:51.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a237fe640 1 -- 172.21.15.130:0/3543020325 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a280a5650 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a237fe640 1 -- 172.21.15.130:0/3543020325 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a280a57b0 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a237fe640 1 -- 172.21.15.130:0/3543020325 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a280a5b40 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a32dd2640 1 -- 172.21.15.130:0/3543020325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a2c15d5f0 msgr2=0x7f8a2c0cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a32dd2640 1 --2- 172.21.15.130:0/3543020325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a2c15d5f0 0x7f8a2c0cc7f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0b2910 tx=0x7f8a2801c940 comp rx=0 tx=0).stop 2023-09-13T06:06:51.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a32dd2640 1 -- 172.21.15.130:0/3543020325 shutdown_connections 2023-09-13T06:06:51.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a32dd2640 1 --2- 172.21.15.130:0/3543020325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a2c15d9d0 0x7f8a2c1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a32dd2640 1 --2- 172.21.15.130:0/3543020325 >> v2:172.21.15.130:3300/0 conn(0x7f8a2c0ae170 0x7f8a2c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a32dd2640 1 --2- 172.21.15.130:0/3543020325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a2c15d5f0 0x7f8a2c0cc7f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a32dd2640 1 -- 172.21.15.130:0/3543020325 >> 172.21.15.130:0/3543020325 conn(0x7f8a2c065990 msgr2=0x7f8a2c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:51.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a32dd2640 1 -- 172.21.15.130:0/3543020325 shutdown_connections 2023-09-13T06:06:51.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.516+0000 7f8a32dd2640 1 -- 172.21.15.130:0/3543020325 wait complete. 2023-09-13T06:06:51.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a32dd2640 1 Processor -- start 2023-09-13T06:06:51.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a32dd2640 1 -- start start 2023-09-13T06:06:51.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a32dd2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a2c0ae170 0x7f8a2c140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a32dd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a2c15d5f0 0x7f8a2c0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a32dd2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a2c15d9d0 0x7f8a2c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a32dd2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0afa70 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a32dd2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0afd50 con 0x7f8a2c15d9d0 2023-09-13T06:06:51.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a32dd2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0b0030 con 0x7f8a2c0ae170 2023-09-13T06:06:51.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a23fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a2c15d5f0 0x7f8a2c0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a23fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a2c15d5f0 0x7f8a2c0aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50390/0 (socket says 172.21.15.130:50390) 2023-09-13T06:06:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a23fff640 1 -- 172.21.15.130:0/1940289690 learned_addr learned my addr 172.21.15.130:0/1940289690 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a23fff640 1 -- 172.21.15.130:0/1940289690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a2c0ae170 msgr2=0x7f8a2c140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a23fff640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a2c0ae170 0x7f8a2c140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a23fff640 1 -- 172.21.15.130:0/1940289690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a2c15d9d0 msgr2=0x7f8a2c06f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a3136f640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a2c15d9d0 0x7f8a2c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a23fff640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a2c15d9d0 0x7f8a2c06f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a23fff640 1 -- 172.21.15.130:0/1940289690 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c009420 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a3136f640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a2c15d9d0 0x7f8a2c06f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a23fff640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a2c15d5f0 0x7f8a2c0aefd0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00ebe0 tx=0x7f8a1c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:51.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a217fa640 1 -- 172.21.15.130:0/1940289690 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00eee0 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a217fa640 1 -- 172.21.15.130:0/1940289690 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c00cc30 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a217fa640 1 -- 172.21.15.130:0/1940289690 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c013470 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.520+0000 7f8a32dd2640 1 -- 172.21.15.130:0/1940289690 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a28009b30 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.524+0000 7f8a32dd2640 1 -- 172.21.15.130:0/1940289690 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c0a87b0 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.524+0000 7f8a32dd2640 1 -- 172.21.15.130:0/1940289690 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c0618a0 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.524+0000 7f8a217fa640 1 -- 172.21.15.130:0/1940289690 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8a1c0135d0 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.524+0000 7f8a217fa640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8a18065b20 0x7f8a18067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.524+0000 7f8a217fa640 1 -- 172.21.15.130:0/1940289690 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a1c083600 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.524+0000 7f8a30b6e640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8a18065b20 0x7f8a18067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.524+0000 7f8a30b6e640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8a18065b20 0x7f8a18067fe0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8a280ae000 tx=0x7f8a28004ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:51.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.528+0000 7f8a217fa640 1 -- 172.21.15.130:0/1940289690 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8a1c050f40 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.680+0000 7f8a32dd2640 1 -- 172.21.15.130:0/1940289690 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a2c06d690 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a217fa640 1 -- 172.21.15.130:0/1940289690 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f8a1c054560 con 0x7f8a2c15d5f0 2023-09-13T06:06:51.686 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:51.686 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":111,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:48.396192+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:06:15.152093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-09-13T06:06:16.467343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:51.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 -- 172.21.15.130:0/1940289690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8a18065b20 msgr2=0x7f8a18067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8a18065b20 0x7f8a18067fe0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8a280ae000 tx=0x7f8a28004ac0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 -- 172.21.15.130:0/1940289690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a2c15d5f0 msgr2=0x7f8a2c0aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a2c15d5f0 0x7f8a2c0aefd0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00ebe0 tx=0x7f8a1c00c520 comp rx=0 tx=0).stop 2023-09-13T06:06:51.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 -- 172.21.15.130:0/1940289690 shutdown_connections 2023-09-13T06:06:51.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8a18065b20 0x7f8a18067fe0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a2c15d9d0 0x7f8a2c06f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a2c15d5f0 0x7f8a2c0aefd0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 --2- 172.21.15.130:0/1940289690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a2c0ae170 0x7f8a2c140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 -- 172.21.15.130:0/1940289690 >> 172.21.15.130:0/1940289690 conn(0x7f8a2c065990 msgr2=0x7f8a2c15a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:51.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 -- 172.21.15.130:0/1940289690 shutdown_connections 2023-09-13T06:06:51.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.684+0000 7f8a32dd2640 1 -- 172.21.15.130:0/1940289690 wait complete. 2023-09-13T06:06:51.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:06:15.152093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:06:16.467343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:06:51.707 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:06:51.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.844+0000 7f5c95796640 1 Processor -- start 2023-09-13T06:06:51.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.844+0000 7f5c95796640 1 -- start start 2023-09-13T06:06:51.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c95796640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5c900d2cd0 0x7f5c901612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c95796640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5c901617e0 0x7f5c900cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c95796640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9015dd40 con 0x7f5c9015ae10 2023-09-13T06:06:51.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c95796640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9015e020 con 0x7f5c900d2cd0 2023-09-13T06:06:51.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c95796640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9015e300 con 0x7f5c901617e0 2023-09-13T06:06:51.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c87fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5c900d2cd0 0x7f5c901612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c87fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5c900d2cd0 0x7f5c901612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50402/0 (socket says 172.21.15.130:50402) 2023-09-13T06:06:51.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c87fff640 1 -- 172.21.15.130:0/1863897316 learned_addr learned my addr 172.21.15.130:0/1863897316 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:51.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c8effd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5c9015ae10 0x7f5c900d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60828/0 (socket says 172.21.15.130:60828) 2023-09-13T06:06:51.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c87fff640 1 -- 172.21.15.130:0/1863897316 >> v2:172.21.15.164:3300/0 conn(0x7f5c901617e0 msgr2=0x7f5c900cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:51.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c87fff640 1 --2- 172.21.15.130:0/1863897316 >> v2:172.21.15.164:3300/0 conn(0x7f5c901617e0 0x7f5c900cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c87fff640 1 -- 172.21.15.130:0/1863897316 >> v1:172.21.15.130:6789/0 conn(0x7f5c9015ae10 legacy=0x7f5c900d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c8e7fc640 1 -- 172.21.15.130:0/1863897316 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446914463 0 0) 0x7f5c9015dd40 con 0x7f5c9015ae10 2023-09-13T06:06:51.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c87fff640 1 -- 172.21.15.130:0/1863897316 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9015e5e0 con 0x7f5c900d2cd0 2023-09-13T06:06:51.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c87fff640 1 --2- 172.21.15.130:0/1863897316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c900d2cd0 0x7f5c901612a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f5c900d1b70 tx=0x7f5c7801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea6e98a45c3cfd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:51.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c8e7fc640 1 -- 172.21.15.130:0/1863897316 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c780ab600 con 0x7f5c900d2cd0 2023-09-13T06:06:51.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c8e7fc640 1 -- 172.21.15.130:0/1863897316 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c780a7050 con 0x7f5c900d2cd0 2023-09-13T06:06:51.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.848+0000 7f5c8e7fc640 1 -- 172.21.15.130:0/1863897316 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c780ab980 con 0x7f5c900d2cd0 2023-09-13T06:06:51.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 -- 172.21.15.130:0/1863897316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c900d2cd0 msgr2=0x7f5c901612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 --2- 172.21.15.130:0/1863897316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c900d2cd0 0x7f5c901612a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f5c900d1b70 tx=0x7f5c7801c3e0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 -- 172.21.15.130:0/1863897316 shutdown_connections 2023-09-13T06:06:51.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 --2- 172.21.15.130:0/1863897316 >> v2:172.21.15.164:3300/0 conn(0x7f5c901617e0 0x7f5c900cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 --2- 172.21.15.130:0/1863897316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c900d2cd0 0x7f5c901612a0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 -- 172.21.15.130:0/1863897316 >> 172.21.15.130:0/1863897316 conn(0x7f5c90065990 msgr2=0x7f5c90065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:51.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 -- 172.21.15.130:0/1863897316 shutdown_connections 2023-09-13T06:06:51.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 -- 172.21.15.130:0/1863897316 wait complete. 2023-09-13T06:06:51.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 Processor -- start 2023-09-13T06:06:51.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 -- start start 2023-09-13T06:06:51.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c900d2cd0 0x7f5c90153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c9015ae10 0x7f5c90163f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c901617e0 0x7f5c901644d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90153fb0 con 0x7f5c9015ae10 2023-09-13T06:06:51.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90164b00 con 0x7f5c900d2cd0 2023-09-13T06:06:51.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c95796640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90158bd0 con 0x7f5c901617e0 2023-09-13T06:06:51.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c87fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c9015ae10 0x7f5c90163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c87fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c9015ae10 0x7f5c90163f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50406/0 (socket says 172.21.15.130:50406) 2023-09-13T06:06:51.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c87fff640 1 -- 172.21.15.130:0/3662319493 learned_addr learned my addr 172.21.15.130:0/3662319493 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:51.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c8effd640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c900d2cd0 0x7f5c90153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.852+0000 7f5c8f7fe640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c901617e0 0x7f5c901644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c87fff640 1 -- 172.21.15.130:0/3662319493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c901617e0 msgr2=0x7f5c901644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c87fff640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c901617e0 0x7f5c901644d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c87fff640 1 -- 172.21.15.130:0/3662319493 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c900d2cd0 msgr2=0x7f5c90153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:51.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c87fff640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c900d2cd0 0x7f5c90153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:51.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c87fff640 1 -- 172.21.15.130:0/3662319493 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c780094d0 con 0x7f5c9015ae10 2023-09-13T06:06:51.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c87fff640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c9015ae10 0x7f5c90163f90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5c7801a010 tx=0x7f5c7801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:51.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c877fe640 1 -- 172.21.15.130:0/3662319493 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78004230 con 0x7f5c9015ae10 2023-09-13T06:06:51.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c877fe640 1 -- 172.21.15.130:0/3662319493 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c78004390 con 0x7f5c9015ae10 2023-09-13T06:06:51.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c95796640 1 -- 172.21.15.130:0/3662319493 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c90158eb0 con 0x7f5c9015ae10 2023-09-13T06:06:51.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c877fe640 1 -- 172.21.15.130:0/3662319493 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78003840 con 0x7f5c9015ae10 2023-09-13T06:06:51.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c95796640 1 -- 172.21.15.130:0/3662319493 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c90159470 con 0x7f5c9015ae10 2023-09-13T06:06:51.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c95796640 1 -- 172.21.15.130:0/3662319493 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c901577f0 con 0x7f5c9015ae10 2023-09-13T06:06:51.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c877fe640 1 -- 172.21.15.130:0/3662319493 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5c780b2050 con 0x7f5c9015ae10 2023-09-13T06:06:51.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c877fe640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c70065b20 0x7f5c70067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:51.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c877fe640 1 -- 172.21.15.130:0/3662319493 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c7811d620 con 0x7f5c9015ae10 2023-09-13T06:06:51.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.856+0000 7f5c8effd640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c70065b20 0x7f5c70067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:51.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.860+0000 7f5c8effd640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c70065b20 0x7f5c70067fe0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5c80007fd0 tx=0x7f5c80007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:51.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:51.860+0000 7f5c877fe640 1 -- 172.21.15.130:0/3662319493 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5c780eaf80 con 0x7f5c9015ae10 2023-09-13T06:06:52.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.008+0000 7f5c95796640 1 -- 172.21.15.130:0/3662319493 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c90159660 con 0x7f5c9015ae10 2023-09-13T06:06:52.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.008+0000 7f5c877fe640 1 -- 172.21.15.130:0/3662319493 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c780ee5a0 con 0x7f5c9015ae10 2023-09-13T06:06:52.011 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:06:52.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 -- 172.21.15.130:0/3662319493 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c70065b20 msgr2=0x7f5c70067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c70065b20 0x7f5c70067fe0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5c80007fd0 tx=0x7f5c80007d60 comp rx=0 tx=0).stop 2023-09-13T06:06:52.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 -- 172.21.15.130:0/3662319493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c9015ae10 msgr2=0x7f5c90163f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c9015ae10 0x7f5c90163f90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5c7801a010 tx=0x7f5c7801ac20 comp rx=0 tx=0).stop 2023-09-13T06:06:52.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 -- 172.21.15.130:0/3662319493 shutdown_connections 2023-09-13T06:06:52.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5c70065b20 0x7f5c70067fe0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c901617e0 0x7f5c901644d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c9015ae10 0x7f5c90163f90 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 --2- 172.21.15.130:0/3662319493 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c900d2cd0 0x7f5c90153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 -- 172.21.15.130:0/3662319493 >> 172.21.15.130:0/3662319493 conn(0x7f5c90065990 msgr2=0x7f5c900b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:52.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 -- 172.21.15.130:0/3662319493 shutdown_connections 2023-09-13T06:06:52.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.012+0000 7f5c95796640 1 -- 172.21.15.130:0/3662319493 wait complete. 2023-09-13T06:06:52.032 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:06:52.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.168+0000 7fdee4d34640 1 Processor -- start 2023-09-13T06:06:52.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.168+0000 7fdee4d34640 1 -- start start 2023-09-13T06:06:52.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdee4d34640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdee0146d40 0x7fdee00b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdee4d34640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdee0070e80 0x7fdee00b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdee4d34640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee00b42a0 con 0x7fdee00d3a80 2023-09-13T06:06:52.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdee4d34640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee00b4560 con 0x7fdee0146d40 2023-09-13T06:06:52.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdee4d34640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee00b4840 con 0x7fdee0070e80 2023-09-13T06:06:52.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdedf7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdee0146d40 0x7fdee00b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdedf7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdee0146d40 0x7fdee00b8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50412/0 (socket says 172.21.15.130:50412) 2023-09-13T06:06:52.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdedf7fe640 1 -- 172.21.15.130:0/2942147345 learned_addr learned my addr 172.21.15.130:0/2942147345 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:52.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdedffff640 1 --2- 172.21.15.130:0/2942147345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdee0070e80 0x7fdee00b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdedf7fe640 1 -- 172.21.15.130:0/2942147345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdee0070e80 msgr2=0x7fdee00b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:52.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdedf7fe640 1 --2- 172.21.15.130:0/2942147345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdee0070e80 0x7fdee00b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdedf7fe640 1 -- 172.21.15.130:0/2942147345 >> v1:172.21.15.164:6789/0 conn(0x7fdee00d3a80 legacy=0x7fdee0070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.172+0000 7fdedf7fe640 1 -- 172.21.15.130:0/2942147345 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee00b4b20 con 0x7fdee0146d40 2023-09-13T06:06:52.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdedf7fe640 1 --2- 172.21.15.130:0/2942147345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee0146d40 0x7fdee00b8900 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fded0009870 tx=0x7fded001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81b41efaaa2b002 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:52.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdede7fc640 1 -- 172.21.15.130:0/2942147345 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded00ab650 con 0x7fdee0146d40 2023-09-13T06:06:52.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdede7fc640 1 -- 172.21.15.130:0/2942147345 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded00ab7b0 con 0x7fdee0146d40 2023-09-13T06:06:52.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdede7fc640 1 -- 172.21.15.130:0/2942147345 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded00abb40 con 0x7fdee0146d40 2023-09-13T06:06:52.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdee4d34640 1 -- 172.21.15.130:0/2942147345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee0146d40 msgr2=0x7fdee00b8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdee4d34640 1 --2- 172.21.15.130:0/2942147345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee0146d40 0x7fdee00b8900 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fded0009870 tx=0x7fded001c540 comp rx=0 tx=0).stop 2023-09-13T06:06:52.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdee4d34640 1 -- 172.21.15.130:0/2942147345 shutdown_connections 2023-09-13T06:06:52.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdee4d34640 1 --2- 172.21.15.130:0/2942147345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdee0070e80 0x7fdee00b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdee4d34640 1 --2- 172.21.15.130:0/2942147345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee0146d40 0x7fdee00b8900 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdee4d34640 1 -- 172.21.15.130:0/2942147345 >> 172.21.15.130:0/2942147345 conn(0x7fdee00d2f60 msgr2=0x7fdee00d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:52.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdee4d34640 1 -- 172.21.15.130:0/2942147345 shutdown_connections 2023-09-13T06:06:52.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdee4d34640 1 -- 172.21.15.130:0/2942147345 wait complete. 2023-09-13T06:06:52.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdee4d34640 1 Processor -- start 2023-09-13T06:06:52.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.176+0000 7fdee4d34640 1 -- start start 2023-09-13T06:06:52.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdee4d34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee0070e80 0x7fdee015c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdee4d34640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdee00d3a80 0x7fdee013f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdee4d34640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdee0146d40 0x7fdee015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdee4d34640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee0148220 con 0x7fdee0070e80 2023-09-13T06:06:52.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdee4d34640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee0147610 con 0x7fdee0146d40 2023-09-13T06:06:52.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdee4d34640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee01478f0 con 0x7fdee00d3a80 2023-09-13T06:06:52.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedf7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee0070e80 0x7fdee015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedf7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee0070e80 0x7fdee015c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50424/0 (socket says 172.21.15.130:50424) 2023-09-13T06:06:52.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedf7fe640 1 -- 172.21.15.130:0/2641204638 learned_addr learned my addr 172.21.15.130:0/2641204638 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:52.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedffff640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdee0146d40 0x7fdee015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedeffd640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdee00d3a80 0x7fdee013f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedf7fe640 1 -- 172.21.15.130:0/2641204638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdee00d3a80 msgr2=0x7fdee013f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedf7fe640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdee00d3a80 0x7fdee013f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedf7fe640 1 -- 172.21.15.130:0/2641204638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdee0146d40 msgr2=0x7fdee015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedf7fe640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdee0146d40 0x7fdee015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedf7fe640 1 -- 172.21.15.130:0/2641204638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded00094d0 con 0x7fdee0070e80 2023-09-13T06:06:52.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedffff640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdee0146d40 0x7fdee015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:52.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdedf7fe640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee0070e80 0x7fdee015c090 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fded00ad040 tx=0x7fded001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:52.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdec7fff640 1 -- 172.21.15.130:0/2641204638 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded00b48c0 con 0x7fdee0070e80 2023-09-13T06:06:52.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdec7fff640 1 -- 172.21.15.130:0/2641204638 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded00b4a40 con 0x7fdee0070e80 2023-09-13T06:06:52.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdec7fff640 1 -- 172.21.15.130:0/2641204638 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded00b4df0 con 0x7fdee0070e80 2023-09-13T06:06:52.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdee4d34640 1 -- 172.21.15.130:0/2641204638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee0147bd0 con 0x7fdee0070e80 2023-09-13T06:06:52.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdee4d34640 1 -- 172.21.15.130:0/2641204638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee013f7e0 con 0x7fdee0070e80 2023-09-13T06:06:52.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdee4d34640 1 -- 172.21.15.130:0/2641204638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee00b7f60 con 0x7fdee0070e80 2023-09-13T06:06:52.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.180+0000 7fdec7fff640 1 -- 172.21.15.130:0/2641204638 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fded00c83a0 con 0x7fdee0070e80 2023-09-13T06:06:52.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.184+0000 7fdec7fff640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdecc065b20 0x7fdecc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.184+0000 7fdec7fff640 1 -- 172.21.15.130:0/2641204638 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fded011de80 con 0x7fdee0070e80 2023-09-13T06:06:52.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.184+0000 7fdedeffd640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdecc065b20 0x7fdecc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.184+0000 7fdedeffd640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdecc065b20 0x7fdecc067fe0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdee0071b20 tx=0x7fded4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:52.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.188+0000 7fdec7fff640 1 -- 172.21.15.130:0/2641204638 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fded00eba30 con 0x7fdee0070e80 2023-09-13T06:06:52.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.336+0000 7fdee4d34640 1 -- 172.21.15.130:0/2641204638 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdee0070390 con 0x7fdee0070e80 2023-09-13T06:06:52.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.336+0000 7fdec7fff640 1 -- 172.21.15.130:0/2641204638 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7fded00ef050 con 0x7fdee0070e80 2023-09-13T06:06:52.339 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:06:52.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 -- 172.21.15.130:0/2641204638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdecc065b20 msgr2=0x7fdecc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdecc065b20 0x7fdecc067fe0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdee0071b20 tx=0x7fded4009040 comp rx=0 tx=0).stop 2023-09-13T06:06:52.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 -- 172.21.15.130:0/2641204638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee0070e80 msgr2=0x7fdee015c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee0070e80 0x7fdee015c090 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fded00ad040 tx=0x7fded001ad80 comp rx=0 tx=0).stop 2023-09-13T06:06:52.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 -- 172.21.15.130:0/2641204638 shutdown_connections 2023-09-13T06:06:52.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdecc065b20 0x7fdecc067fe0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdee0146d40 0x7fdee015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdee00d3a80 0x7fdee013f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 --2- 172.21.15.130:0/2641204638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee0070e80 0x7fdee015c090 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 -- 172.21.15.130:0/2641204638 >> 172.21.15.130:0/2641204638 conn(0x7fdee00d2f60 msgr2=0x7fdee00b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:52.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 -- 172.21.15.130:0/2641204638 shutdown_connections 2023-09-13T06:06:52.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.340+0000 7fdee4d34640 1 -- 172.21.15.130:0/2641204638 wait complete. 2023-09-13T06:06:52.360 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:06:52.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.500+0000 7fac1d7db640 1 Processor -- start 2023-09-13T06:06:52.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.500+0000 7fac1d7db640 1 -- start start 2023-09-13T06:06:52.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.500+0000 7fac1d7db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac1815ae10 0x7fac180d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.500+0000 7fac1d7db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fac180d2b00 0x7fac181612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.500+0000 7fac1d7db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fac181617e0 0x7fac180709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.500+0000 7fac1d7db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1815dd40 con 0x7fac180d2b00 2023-09-13T06:06:52.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.500+0000 7fac1d7db640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1815e020 con 0x7fac181617e0 2023-09-13T06:06:52.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.500+0000 7fac1d7db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1815e300 con 0x7fac1815ae10 2023-09-13T06:06:52.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac0e7fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fac180d2b00 0x7fac181612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac0e7fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fac180d2b00 0x7fac181612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50430/0 (socket says 172.21.15.130:50430) 2023-09-13T06:06:52.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac0e7fc640 1 -- 172.21.15.130:0/2011438113 learned_addr learned my addr 172.21.15.130:0/2011438113 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:52.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac0e7fc640 1 -- 172.21.15.130:0/2011438113 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac1815ae10 msgr2=0x7fac180d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:52.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac0e7fc640 1 --2- 172.21.15.130:0/2011438113 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac1815ae10 0x7fac180d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac0e7fc640 1 -- 172.21.15.130:0/2011438113 >> v2:172.21.15.164:3300/0 conn(0x7fac181617e0 msgr2=0x7fac180709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:52.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac177fe640 1 --2- 172.21.15.130:0/2011438113 >> v2:172.21.15.164:3300/0 conn(0x7fac181617e0 0x7fac180709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac0e7fc640 1 --2- 172.21.15.130:0/2011438113 >> v2:172.21.15.164:3300/0 conn(0x7fac181617e0 0x7fac180709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac0e7fc640 1 -- 172.21.15.130:0/2011438113 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1815e5e0 con 0x7fac180d2b00 2023-09-13T06:06:52.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac177fe640 1 --2- 172.21.15.130:0/2011438113 >> v2:172.21.15.164:3300/0 conn(0x7fac181617e0 0x7fac180709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:52.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac0e7fc640 1 --2- 172.21.15.130:0/2011438113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac180d2b00 0x7fac181612a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fac180d1b40 tx=0x7fac0001c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bc0ad0b9e82fa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:52.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac167fc640 1 -- 172.21.15.130:0/2011438113 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac000ab600 con 0x7fac180d2b00 2023-09-13T06:06:52.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac167fc640 1 -- 172.21.15.130:0/2011438113 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac000a7050 con 0x7fac180d2b00 2023-09-13T06:06:52.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.504+0000 7fac167fc640 1 -- 172.21.15.130:0/2011438113 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac000ab980 con 0x7fac180d2b00 2023-09-13T06:06:52.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 -- 172.21.15.130:0/2011438113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac180d2b00 msgr2=0x7fac181612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 --2- 172.21.15.130:0/2011438113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac180d2b00 0x7fac181612a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fac180d1b40 tx=0x7fac0001c120 comp rx=0 tx=0).stop 2023-09-13T06:06:52.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 -- 172.21.15.130:0/2011438113 shutdown_connections 2023-09-13T06:06:52.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 --2- 172.21.15.130:0/2011438113 >> v2:172.21.15.164:3300/0 conn(0x7fac181617e0 0x7fac180709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 --2- 172.21.15.130:0/2011438113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac180d2b00 0x7fac181612a0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 --2- 172.21.15.130:0/2011438113 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac1815ae10 0x7fac180d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 -- 172.21.15.130:0/2011438113 >> 172.21.15.130:0/2011438113 conn(0x7fac18065990 msgr2=0x7fac18065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:52.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 -- 172.21.15.130:0/2011438113 shutdown_connections 2023-09-13T06:06:52.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 -- 172.21.15.130:0/2011438113 wait complete. 2023-09-13T06:06:52.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 Processor -- start 2023-09-13T06:06:52.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 -- start start 2023-09-13T06:06:52.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac180d2b00 0x7fac1815fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac1815ae10 0x7fac18157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac181617e0 0x7fac18159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac18159500 con 0x7fac180d2b00 2023-09-13T06:06:52.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac18158880 con 0x7fac181617e0 2023-09-13T06:06:52.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac1d7db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac18158b60 con 0x7fac1815ae10 2023-09-13T06:06:52.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac16ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac180d2b00 0x7fac1815fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac16ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac180d2b00 0x7fac1815fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50442/0 (socket says 172.21.15.130:50442) 2023-09-13T06:06:52.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac16ffd640 1 -- 172.21.15.130:0/390667409 learned_addr learned my addr 172.21.15.130:0/390667409 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:52.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac177fe640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac181617e0 0x7fac18159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac0e7fc640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac1815ae10 0x7fac18157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac16ffd640 1 -- 172.21.15.130:0/390667409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac1815ae10 msgr2=0x7fac18157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac16ffd640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac1815ae10 0x7fac18157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac16ffd640 1 -- 172.21.15.130:0/390667409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac181617e0 msgr2=0x7fac18159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.508+0000 7fac16ffd640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac181617e0 0x7fac18159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac16ffd640 1 -- 172.21.15.130:0/390667409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac000094d0 con 0x7fac180d2b00 2023-09-13T06:06:52.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac16ffd640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac180d2b00 0x7fac1815fdd0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fac0800ba50 tx=0x7fac0800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:52.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac0ffff640 1 -- 172.21.15.130:0/390667409 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800cbe0 con 0x7fac180d2b00 2023-09-13T06:06:52.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac0ffff640 1 -- 172.21.15.130:0/390667409 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0800cd60 con 0x7fac180d2b00 2023-09-13T06:06:52.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac0ffff640 1 -- 172.21.15.130:0/390667409 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08014680 con 0x7fac180d2b00 2023-09-13T06:06:52.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac1d7db640 1 -- 172.21.15.130:0/390667409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac18158e40 con 0x7fac180d2b00 2023-09-13T06:06:52.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac1d7db640 1 -- 172.21.15.130:0/390667409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac18160310 con 0x7fac180d2b00 2023-09-13T06:06:52.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac1d7db640 1 -- 172.21.15.130:0/390667409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac180618a0 con 0x7fac180d2b00 2023-09-13T06:06:52.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac0ffff640 1 -- 172.21.15.130:0/390667409 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fac0801d3b0 con 0x7fac180d2b00 2023-09-13T06:06:52.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac0ffff640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fabf8065b20 0x7fabf8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac0ffff640 1 -- 172.21.15.130:0/390667409 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac08083360 con 0x7fac180d2b00 2023-09-13T06:06:52.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.512+0000 7fac0e7fc640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fabf8065b20 0x7fabf8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.516+0000 7fac0e7fc640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fabf8065b20 0x7fabf8067fe0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fac000ad000 tx=0x7fac000a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:52.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.516+0000 7fac0ffff640 1 -- 172.21.15.130:0/390667409 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fac08050c30 con 0x7fac180d2b00 2023-09-13T06:06:52.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 -- 172.21.15.130:0/390667409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac180b68a0 con 0x7fac180d2b00 2023-09-13T06:06:52.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac0ffff640 1 -- 172.21.15.130:0/390667409 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac080190a0 con 0x7fac180d2b00 2023-09-13T06:06:52.671 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:06:52.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 -- 172.21.15.130:0/390667409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fabf8065b20 msgr2=0x7fabf8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fabf8065b20 0x7fabf8067fe0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fac000ad000 tx=0x7fac000a6000 comp rx=0 tx=0).stop 2023-09-13T06:06:52.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 -- 172.21.15.130:0/390667409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac180d2b00 msgr2=0x7fac1815fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac180d2b00 0x7fac1815fdd0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fac0800ba50 tx=0x7fac0800bf10 comp rx=0 tx=0).stop 2023-09-13T06:06:52.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 -- 172.21.15.130:0/390667409 shutdown_connections 2023-09-13T06:06:52.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fabf8065b20 0x7fabf8067fe0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac181617e0 0x7fac18159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac1815ae10 0x7fac18157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 --2- 172.21.15.130:0/390667409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac180d2b00 0x7fac1815fdd0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 -- 172.21.15.130:0/390667409 >> 172.21.15.130:0/390667409 conn(0x7fac18065990 msgr2=0x7fac1815cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:52.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 -- 172.21.15.130:0/390667409 shutdown_connections 2023-09-13T06:06:52.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.668+0000 7fac1d7db640 1 -- 172.21.15.130:0/390667409 wait complete. 2023-09-13T06:06:52.691 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:52.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f998e7fa640 1 Processor -- start 2023-09-13T06:06:52.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f998e7fa640 1 -- start start 2023-09-13T06:06:52.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f998e7fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9988146f30 0x7f998815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f998e7fa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880b63c0 con 0x7f99880d1750 2023-09-13T06:06:52.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f998e7fa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880d0c20 con 0x7f99880d1090 2023-09-13T06:06:52.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f998e7fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998815dea0 con 0x7f9988146f30 2023-09-13T06:06:52.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9987fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f99880d1750 0x7f9988146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60834/0 (socket says 172.21.15.130:60834) 2023-09-13T06:06:52.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9987fff640 1 -- 172.21.15.130:0/2985115913 learned_addr learned my addr 172.21.15.130:0/2985115913 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:52.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f998cd97640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9988146f30 0x7f998815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552692825 0 0) 0x7f99880b63c0 con 0x7f99880d1750 2023-09-13T06:06:52.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9970003530 con 0x7f99880d1750 2023-09-13T06:06:52.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761446287 0 0) 0x7f99880d0c20 con 0x7f99880d1090 2023-09-13T06:06:52.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99880b63c0 con 0x7f99880d1090 2023-09-13T06:06:52.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2100255712 0 0) 0x7f9970003530 con 0x7f99880d1750 2023-09-13T06:06:52.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9988146f30 msgr2=0x7f998815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:52.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9988146f30 0x7f998815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 >> v1:172.21.15.164:6789/0 conn(0x7f99880d1090 legacy=0x7f99880b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880b6610 con 0x7f99880d1750 2023-09-13T06:06:52.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f9978001680 con 0x7f99880d1750 2023-09-13T06:06:52.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 >> v1:172.21.15.130:6789/0 conn(0x7f99880d1750 legacy=0x7f9988146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9970003bb0 0x7f9970003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99700047d0 0x7f9970004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9988146f30 0x7f9970005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997000ba70 con 0x7f99700047d0 2023-09-13T06:06:52.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997000bbe0 con 0x7f9970003bb0 2023-09-13T06:06:52.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997000bda0 con 0x7f9988146f30 2023-09-13T06:06:52.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f99877fe640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99700047d0 0x7f9970004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f9987fff640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9970003bb0 0x7f9970003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f998cd97640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9988146f30 0x7f9970005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f99877fe640 1 -- 172.21.15.130:0/2985115913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9988146f30 msgr2=0x7f9970005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:52.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f99877fe640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9988146f30 0x7f9970005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f99877fe640 1 -- 172.21.15.130:0/2985115913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9970003bb0 msgr2=0x7f9970003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:52.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f99877fe640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9970003bb0 0x7f9970003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.828+0000 7f99877fe640 1 -- 172.21.15.130:0/2985115913 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970003530 con 0x7f99700047d0 2023-09-13T06:06:52.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.832+0000 7f99877fe640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99700047d0 0x7f9970004c50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f997c007fd0 tx=0x7f997c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758f23d03ab5cc9a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:52.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.832+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c0052d0 con 0x7f99700047d0 2023-09-13T06:06:52.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.832+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c005450 con 0x7f99700047d0 2023-09-13T06:06:52.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.832+0000 7f9986ffd640 1 -- 172.21.15.130:0/2985115913 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c0a88b0 con 0x7f99700047d0 2023-09-13T06:06:52.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.832+0000 7f998e7fa640 1 -- 172.21.15.130:0/2985115913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99700047d0 msgr2=0x7f9970004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.832+0000 7f998e7fa640 1 --2- 172.21.15.130:0/2985115913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99700047d0 0x7f9970004c50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f997c007fd0 tx=0x7f997c01ec50 comp rx=0 tx=0).stop 2023-09-13T06:06:52.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.832+0000 7f998cd97640 1 -- 172.21.15.130:0/2985115913 reap_dead start 2023-09-13T06:06:52.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.832+0000 7f998e7fa640 1 -- 172.21.15.130:0/2985115913 shutdown_connections 2023-09-13T06:06:52.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.832+0000 7f998e7fa640 1 -- 172.21.15.130:0/2985115913 >> 172.21.15.130:0/2985115913 conn(0x7f998806f170 msgr2=0x7f998806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:52.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.832+0000 7f998e7fa640 1 -- 172.21.15.130:0/2985115913 shutdown_connections 2023-09-13T06:06:52.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.832+0000 7f998e7fa640 1 -- 172.21.15.130:0/2985115913 wait complete. 2023-09-13T06:06:52.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f998e7fa640 1 Processor -- start 2023-09-13T06:06:52.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f998e7fa640 1 -- start start 2023-09-13T06:06:52.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f998e7fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99700047d0 0x7f998813ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f998e7fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99880cf8c0 0x7f9988141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f998e7fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f998813bd50 0x7f998815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f998e7fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998813b8c0 con 0x7f99880cf8c0 2023-09-13T06:06:52.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f998e7fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998813f760 con 0x7f998813bd50 2023-09-13T06:06:52.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f998e7fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998813fa40 con 0x7f99700047d0 2023-09-13T06:06:52.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f99877fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99880cf8c0 0x7f9988141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f99877fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99880cf8c0 0x7f9988141800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50466/0 (socket says 172.21.15.130:50466) 2023-09-13T06:06:52.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f99877fe640 1 -- 172.21.15.130:0/401672215 learned_addr learned my addr 172.21.15.130:0/401672215 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:52.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f9987fff640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99700047d0 0x7f998813ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f998cd97640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f998813bd50 0x7f998815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f99877fe640 1 -- 172.21.15.130:0/401672215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99700047d0 msgr2=0x7f998813ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f99877fe640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99700047d0 0x7f998813ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f99877fe640 1 -- 172.21.15.130:0/401672215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f998813bd50 msgr2=0x7f998815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:52.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f99877fe640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f998813bd50 0x7f998815ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:52.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f99877fe640 1 -- 172.21.15.130:0/401672215 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998813fd20 con 0x7f99880cf8c0 2023-09-13T06:06:52.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f99877fe640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99880cf8c0 0x7f9988141800 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f997c01ea80 tx=0x7f9970005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:52.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f9984ff9640 1 -- 172.21.15.130:0/401672215 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c0050d0 con 0x7f99880cf8c0 2023-09-13T06:06:52.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f9984ff9640 1 -- 172.21.15.130:0/401672215 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c005230 con 0x7f99880cf8c0 2023-09-13T06:06:52.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f9984ff9640 1 -- 172.21.15.130:0/401672215 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c003820 con 0x7f99880cf8c0 2023-09-13T06:06:52.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f998e7fa640 1 -- 172.21.15.130:0/401672215 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998813b550 con 0x7f99880cf8c0 2023-09-13T06:06:52.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.836+0000 7f998e7fa640 1 -- 172.21.15.130:0/401672215 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998813f3a0 con 0x7f99880cf8c0 2023-09-13T06:06:52.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.840+0000 7f998e7fa640 1 -- 172.21.15.130:0/401672215 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998813f3a0 con 0x7f99880cf8c0 2023-09-13T06:06:52.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.840+0000 7f9984ff9640 1 -- 172.21.15.130:0/401672215 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f997c003980 con 0x7f99880cf8c0 2023-09-13T06:06:52.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.840+0000 7f9984ff9640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9974065b20 0x7f9974067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:52.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.840+0000 7f9984ff9640 1 -- 172.21.15.130:0/401672215 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f997c120ef0 con 0x7f99880cf8c0 2023-09-13T06:06:52.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.840+0000 7f9987fff640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9974065b20 0x7f9974067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:52.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.840+0000 7f9987fff640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9974065b20 0x7f9974067fe0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f99880b5e50 tx=0x7f9978001e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:52.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:52.844+0000 7f9984ff9640 1 -- 172.21.15.130:0/401672215 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f997c0ee8f0 con 0x7f99880cf8c0 2023-09-13T06:06:53.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.024+0000 7f998e7fa640 1 -- 172.21.15.130:0/401672215 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f998813f3a0 con 0x7f99880cf8c0 2023-09-13T06:06:53.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.024+0000 7f9984ff9640 1 -- 172.21.15.130:0/401672215 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f997c0f1f10 con 0x7f99880cf8c0 2023-09-13T06:06:53.028 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:53.028 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3211692360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3211692360},{"type":"v1","addr":"172.21.15.164:6834","nonce":3211692360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2453731046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2453731046},{"type":"v1","addr":"172.21.15.130:6835","nonce":2453731046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2896649577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2896649577},{"type":"v1","addr":"172.21.15.164:6835","nonce":2896649577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:06:17.421334+0000","modified":"2023-09-13T06:06:20.748001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6888":{"gid":6888,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/878642631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":878642631},{"type":"v1","addr":"172.21.15.130:6837","nonce":878642631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-09-13T06:06:53.029 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 51 2023-09-13T06:06:53.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 -- 172.21.15.130:0/401672215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9974065b20 msgr2=0x7f9974067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9974065b20 0x7f9974067fe0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f99880b5e50 tx=0x7f9978001e10 comp rx=0 tx=0).stop 2023-09-13T06:06:53.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 -- 172.21.15.130:0/401672215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99880cf8c0 msgr2=0x7f9988141800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99880cf8c0 0x7f9988141800 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f997c01ea80 tx=0x7f9970005800 comp rx=0 tx=0).stop 2023-09-13T06:06:53.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 -- 172.21.15.130:0/401672215 shutdown_connections 2023-09-13T06:06:53.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9974065b20 0x7f9974067fe0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f998813bd50 0x7f998815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99880cf8c0 0x7f9988141800 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 --2- 172.21.15.130:0/401672215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99700047d0 0x7f998813ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 -- 172.21.15.130:0/401672215 >> 172.21.15.130:0/401672215 conn(0x7f998806f170 msgr2=0x7f99880b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:53.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 -- 172.21.15.130:0/401672215 shutdown_connections 2023-09-13T06:06:53.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.028+0000 7f998e7fa640 1 -- 172.21.15.130:0/401672215 wait complete. 2023-09-13T06:06:53.049 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:53.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f7519fc7640 1 Processor -- start 2023-09-13T06:06:53.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f7519fc7640 1 -- start start 2023-09-13T06:06:53.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f7519fc7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75140d1750 0x7f751415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f7519fc7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75140b63c0 con 0x7f75140d1090 2023-09-13T06:06:53.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f7519fc7640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75140d0c20 con 0x7f7514146f30 2023-09-13T06:06:53.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f7519fc7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751415dea0 con 0x7f75140d1750 2023-09-13T06:06:53.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f7512ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f75140d1090 0x7f7514146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60846/0 (socket says 172.21.15.130:60846) 2023-09-13T06:06:53.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f7512ffd640 1 -- 172.21.15.130:0/1137471865 learned_addr learned my addr 172.21.15.130:0/1137471865 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:53.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017656875 0 0) 0x7f75140b63c0 con 0x7f75140d1090 2023-09-13T06:06:53.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f75137fe640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75140d1750 0x7f751415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74fc003530 con 0x7f75140d1090 2023-09-13T06:06:53.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1801748574 0 0) 0x7f74fc003530 con 0x7f75140d1090 2023-09-13T06:06:53.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75140d1750 msgr2=0x7f751415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:53.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f75127fc640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75140d1750 0x7f751415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 >> v1:172.21.15.164:6789/0 conn(0x7f7514146f30 legacy=0x7f75140b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75140b6610 con 0x7f75140d1090 2023-09-13T06:06:53.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f7508001680 con 0x7f75140d1090 2023-09-13T06:06:53.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 >> v1:172.21.15.130:6789/0 conn(0x7f75140d1090 legacy=0x7f7514146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.184+0000 7f75127fc640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc003a20 0x7f74fc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f75127fc640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 0x7f74fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f75127fc640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75140d1750 0x7f74fc005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc00bb20 con 0x7f74fc0047d0 2023-09-13T06:06:53.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc00bc90 con 0x7f74fc003a20 2023-09-13T06:06:53.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc00be50 con 0x7f75140d1750 2023-09-13T06:06:53.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f7512ffd640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 0x7f74fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f75137fe640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc003a20 0x7f74fc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f7513fff640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75140d1750 0x7f74fc005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f7512ffd640 1 -- 172.21.15.130:0/1137471865 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75140d1750 msgr2=0x7f74fc005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:53.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f7512ffd640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75140d1750 0x7f74fc005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f7512ffd640 1 -- 172.21.15.130:0/1137471865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc003a20 msgr2=0x7f74fc003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:53.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f7512ffd640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc003a20 0x7f74fc003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f7512ffd640 1 -- 172.21.15.130:0/1137471865 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc003530 con 0x7f74fc0047d0 2023-09-13T06:06:53.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f7512ffd640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 0x7f74fc004c50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f750800c240 tx=0x7f750801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c753b71274e4bfcc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:53.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508005ae0 con 0x7f74fc0047d0 2023-09-13T06:06:53.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75080ab070 con 0x7f74fc0047d0 2023-09-13T06:06:53.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.188+0000 7f75127fc640 1 -- 172.21.15.130:0/1137471865 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508007070 con 0x7f74fc0047d0 2023-09-13T06:06:53.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 -- 172.21.15.130:0/1137471865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 msgr2=0x7f74fc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 --2- 172.21.15.130:0/1137471865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 0x7f74fc004c50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f750800c240 tx=0x7f750801f3b0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7513fff640 1 -- 172.21.15.130:0/1137471865 reap_dead start 2023-09-13T06:06:53.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 -- 172.21.15.130:0/1137471865 shutdown_connections 2023-09-13T06:06:53.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 -- 172.21.15.130:0/1137471865 >> 172.21.15.130:0/1137471865 conn(0x7f751406f170 msgr2=0x7f751406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:53.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 -- 172.21.15.130:0/1137471865 shutdown_connections 2023-09-13T06:06:53.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 -- 172.21.15.130:0/1137471865 wait complete. 2023-09-13T06:06:53.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 Processor -- start 2023-09-13T06:06:53.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 -- start start 2023-09-13T06:06:53.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 0x7f751415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f751415bc50 0x7f751415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f751413cc20 0x7f751413d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751415c610 con 0x7f74fc0047d0 2023-09-13T06:06:53.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75141f6d00 con 0x7f751413cc20 2023-09-13T06:06:53.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7519fc7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75141f7190 con 0x7f751415bc50 2023-09-13T06:06:53.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f75137fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 0x7f751415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f75137fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 0x7f751415eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50480/0 (socket says 172.21.15.130:50480) 2023-09-13T06:06:53.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f75137fe640 1 -- 172.21.15.130:0/1566485806 learned_addr learned my addr 172.21.15.130:0/1566485806 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:53.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7513fff640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f751413cc20 0x7f751413d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7512ffd640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f751415bc50 0x7f751415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f75137fe640 1 -- 172.21.15.130:0/1566485806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f751415bc50 msgr2=0x7f751415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f75137fe640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f751415bc50 0x7f751415c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f75137fe640 1 -- 172.21.15.130:0/1566485806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f751413cc20 msgr2=0x7f751413d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f75137fe640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f751413cc20 0x7f751413d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f75137fe640 1 -- 172.21.15.130:0/1566485806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751413d5e0 con 0x7f74fc0047d0 2023-09-13T06:06:53.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.192+0000 7f7513fff640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f751413cc20 0x7f751413d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:53.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.196+0000 7f75137fe640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 0x7f751415eac0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f750400b7f0 tx=0x7f750400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:53.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.196+0000 7f74fbfff640 1 -- 172.21.15.130:0/1566485806 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504004170 con 0x7f74fc0047d0 2023-09-13T06:06:53.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.196+0000 7f74fbfff640 1 -- 172.21.15.130:0/1566485806 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7504010830 con 0x7f74fc0047d0 2023-09-13T06:06:53.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.196+0000 7f7519fc7640 1 -- 172.21.15.130:0/1566485806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75141f63d0 con 0x7f74fc0047d0 2023-09-13T06:06:53.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.196+0000 7f74fbfff640 1 -- 172.21.15.130:0/1566485806 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504010be0 con 0x7f74fc0047d0 2023-09-13T06:06:53.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.196+0000 7f7519fc7640 1 -- 172.21.15.130:0/1566485806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75141f6990 con 0x7f74fc0047d0 2023-09-13T06:06:53.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.196+0000 7f7519fc7640 1 -- 172.21.15.130:0/1566485806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75140618a0 con 0x7f74fc0047d0 2023-09-13T06:06:53.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.196+0000 7f74fbfff640 1 -- 172.21.15.130:0/1566485806 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7504010d40 con 0x7f74fc0047d0 2023-09-13T06:06:53.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.196+0000 7f74fbfff640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7500065b20 0x7f7500067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.196+0000 7f74fbfff640 1 -- 172.21.15.130:0/1566485806 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7504083960 con 0x7f74fc0047d0 2023-09-13T06:06:53.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.196+0000 7f7512ffd640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7500065b20 0x7f7500067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.200+0000 7f7512ffd640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7500065b20 0x7f7500067fe0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f75080af000 tx=0x7f75080aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:53.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.200+0000 7f74fbfff640 1 -- 172.21.15.130:0/1566485806 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f75040512a0 con 0x7f74fc0047d0 2023-09-13T06:06:53.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.352+0000 7f7519fc7640 1 -- 172.21.15.130:0/1566485806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75140b86c0 con 0x7f74fc0047d0 2023-09-13T06:06:53.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.352+0000 7f74fbfff640 1 -- 172.21.15.130:0/1566485806 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f75040548c0 con 0x7f74fc0047d0 2023-09-13T06:06:53.356 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:53.356 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":111,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:48.396192+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:06:15.152093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-09-13T06:06:16.467343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:53.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 -- 172.21.15.130:0/1566485806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7500065b20 msgr2=0x7f7500067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7500065b20 0x7f7500067fe0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f75080af000 tx=0x7f75080aa000 comp rx=0 tx=0).stop 2023-09-13T06:06:53.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 -- 172.21.15.130:0/1566485806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 msgr2=0x7f751415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 0x7f751415eac0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f750400b7f0 tx=0x7f750400bcb0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 -- 172.21.15.130:0/1566485806 shutdown_connections 2023-09-13T06:06:53.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7500065b20 0x7f7500067fe0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f751413cc20 0x7f751413d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f751415bc50 0x7f751415c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 --2- 172.21.15.130:0/1566485806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74fc0047d0 0x7f751415eac0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 -- 172.21.15.130:0/1566485806 >> 172.21.15.130:0/1566485806 conn(0x7f751406f170 msgr2=0x7f751406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:53.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 -- 172.21.15.130:0/1566485806 shutdown_connections 2023-09-13T06:06:53.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.356+0000 7f7519fc7640 1 -- 172.21.15.130:0/1566485806 wait complete. 2023-09-13T06:06:53.377 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:06:53.378 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:53.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc608634640 1 Processor -- start 2023-09-13T06:06:53.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc608634640 1 -- start start 2023-09-13T06:06:53.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc608634640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6000b0f40 0x7fc6000b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc608634640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc60015e560 0x7fc6000b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc608634640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6000afee0 con 0x7fc600157920 2023-09-13T06:06:53.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc608634640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6000aea50 con 0x7fc60015e560 2023-09-13T06:06:53.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc608634640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000b0b20 con 0x7fc6000b0f40 2023-09-13T06:06:53.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc605bcf640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6000b0f40 0x7fc6000b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc6063d0640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc600157920 0x7fc6000ae190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:52768/0 (socket says 172.21.15.130:52768) 2023-09-13T06:06:53.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc6063d0640 1 -- 172.21.15.130:0/2392218479 learned_addr learned my addr 172.21.15.130:0/2392218479 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:53.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc606bd1640 1 --2- 172.21.15.130:0/2392218479 >> v2:172.21.15.164:3300/0 conn(0x7fc60015e560 0x7fc6000b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc6053ce640 1 -- 172.21.15.130:0/2392218479 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997244566 0 0) 0x7fc6000afee0 con 0x7fc600157920 2023-09-13T06:06:53.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc6053ce640 1 -- 172.21.15.130:0/2392218479 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5ec003530 con 0x7fc600157920 2023-09-13T06:06:53.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc605bcf640 1 -- 172.21.15.130:0/2392218479 >> v2:172.21.15.164:3300/0 conn(0x7fc60015e560 msgr2=0x7fc6000b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:53.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc605bcf640 1 --2- 172.21.15.130:0/2392218479 >> v2:172.21.15.164:3300/0 conn(0x7fc60015e560 0x7fc6000b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc605bcf640 1 -- 172.21.15.130:0/2392218479 >> v1:172.21.15.164:6789/0 conn(0x7fc600157920 legacy=0x7fc6000ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc605bcf640 1 -- 172.21.15.130:0/2392218479 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000b0180 con 0x7fc6000b0f40 2023-09-13T06:06:53.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.516+0000 7fc606bd1640 1 --2- 172.21.15.130:0/2392218479 >> v2:172.21.15.164:3300/0 conn(0x7fc60015e560 0x7fc6000b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:53.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.520+0000 7fc605bcf640 1 --2- 172.21.15.130:0/2392218479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6000b0f40 0x7fc6000b1610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00097c0 tx=0x7fc5f001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4327f714dd365df server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:53.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.520+0000 7fc6053ce640 1 -- 172.21.15.130:0/2392218479 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f00ab600 con 0x7fc6000b0f40 2023-09-13T06:06:53.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.520+0000 7fc6053ce640 1 -- 172.21.15.130:0/2392218479 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f00a7050 con 0x7fc6000b0f40 2023-09-13T06:06:53.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.520+0000 7fc6053ce640 1 -- 172.21.15.130:0/2392218479 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f00ab980 con 0x7fc6000b0f40 2023-09-13T06:06:53.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.520+0000 7fc608634640 1 -- 172.21.15.130:0/2392218479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6000b0f40 msgr2=0x7fc6000b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.520+0000 7fc608634640 1 --2- 172.21.15.130:0/2392218479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6000b0f40 0x7fc6000b1610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00097c0 tx=0x7fc5f001c480 comp rx=0 tx=0).stop 2023-09-13T06:06:53.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.520+0000 7fc608634640 1 -- 172.21.15.130:0/2392218479 shutdown_connections 2023-09-13T06:06:53.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.520+0000 7fc608634640 1 --2- 172.21.15.130:0/2392218479 >> v2:172.21.15.164:3300/0 conn(0x7fc60015e560 0x7fc6000b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.520+0000 7fc608634640 1 --2- 172.21.15.130:0/2392218479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6000b0f40 0x7fc6000b1610 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.520+0000 7fc608634640 1 -- 172.21.15.130:0/2392218479 >> 172.21.15.130:0/2392218479 conn(0x7fc600065990 msgr2=0x7fc600065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:53.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc608634640 1 -- 172.21.15.130:0/2392218479 shutdown_connections 2023-09-13T06:06:53.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc608634640 1 -- 172.21.15.130:0/2392218479 wait complete. 2023-09-13T06:06:53.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc608634640 1 Processor -- start 2023-09-13T06:06:53.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc608634640 1 -- start start 2023-09-13T06:06:53.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc608634640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6000b0f40 0x7fc6001546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc608634640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc600157920 0x7fc60014e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc608634640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60015e560 0x7fc60014edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc608634640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc600147fc0 con 0x7fc60015e560 2023-09-13T06:06:53.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc608634640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc600148210 con 0x7fc600157920 2023-09-13T06:06:53.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc608634640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6001484f0 con 0x7fc6000b0f40 2023-09-13T06:06:53.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc606bd1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60015e560 0x7fc60014edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc606bd1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60015e560 0x7fc60014edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50494/0 (socket says 172.21.15.130:50494) 2023-09-13T06:06:53.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc606bd1640 1 -- 172.21.15.130:0/15532362 learned_addr learned my addr 172.21.15.130:0/15532362 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:53.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc6063d0640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6000b0f40 0x7fc6001546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc605bcf640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc600157920 0x7fc60014e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc606bd1640 1 -- 172.21.15.130:0/15532362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6000b0f40 msgr2=0x7fc6001546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc606bd1640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6000b0f40 0x7fc6001546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc606bd1640 1 -- 172.21.15.130:0/15532362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc600157920 msgr2=0x7fc60014e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc606bd1640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc600157920 0x7fc60014e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc606bd1640 1 -- 172.21.15.130:0/15532362 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8009a70 con 0x7fc60015e560 2023-09-13T06:06:53.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc606bd1640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60015e560 0x7fc60014edc0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800ef90 tx=0x7fc5f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:53.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.524+0000 7fc5f6ffd640 1 -- 172.21.15.130:0/15532362 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8009c00 con 0x7fc60015e560 2023-09-13T06:06:53.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.528+0000 7fc5f6ffd640 1 -- 172.21.15.130:0/15532362 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f800f040 con 0x7fc60015e560 2023-09-13T06:06:53.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.528+0000 7fc608634640 1 -- 172.21.15.130:0/15532362 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f0009420 con 0x7fc60015e560 2023-09-13T06:06:53.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.528+0000 7fc5f6ffd640 1 -- 172.21.15.130:0/15532362 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80146a0 con 0x7fc60015e560 2023-09-13T06:06:53.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.528+0000 7fc608634640 1 -- 172.21.15.130:0/15532362 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc600148ab0 con 0x7fc60015e560 2023-09-13T06:06:53.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.528+0000 7fc608634640 1 -- 172.21.15.130:0/15532362 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc600148ca0 con 0x7fc60015e560 2023-09-13T06:06:53.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.528+0000 7fc5f6ffd640 1 -- 172.21.15.130:0/15532362 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc5f8014800 con 0x7fc60015e560 2023-09-13T06:06:53.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.528+0000 7fc5f6ffd640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc5e4065b20 0x7fc5e4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.528+0000 7fc5f6ffd640 1 -- 172.21.15.130:0/15532362 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5f8084130 con 0x7fc60015e560 2023-09-13T06:06:53.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.528+0000 7fc6063d0640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc5e4065b20 0x7fc5e4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.528+0000 7fc6063d0640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc5e4065b20 0x7fc5e4067fe0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0011f0 tx=0x7fc5fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:53.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.532+0000 7fc5f6ffd640 1 -- 172.21.15.130:0/15532362 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc5f8051b10 con 0x7fc60015e560 2023-09-13T06:06:53.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 -- 172.21.15.130:0/15532362 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6000618a0 con 0x7fc60015e560 2023-09-13T06:06:53.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc5f6ffd640 1 -- 172.21.15.130:0/15532362 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4924 (secure 0 0 0) 0x7fc5f8055130 con 0x7fc60015e560 2023-09-13T06:06:53.718 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:53.719 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3211692360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3211692360},{"type":"v1","addr":"172.21.15.164:6834","nonce":3211692360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2453731046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2453731046},{"type":"v1","addr":"172.21.15.130:6835","nonce":2453731046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2896649577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2896649577},{"type":"v1","addr":"172.21.15.164:6835","nonce":2896649577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:06:17.421334+0000","modified":"2023-09-13T06:06:20.748001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6888":{"gid":6888,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/878642631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":878642631},{"type":"v1","addr":"172.21.15.130:6837","nonce":878642631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-09-13T06:06:53.719 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 51 2023-09-13T06:06:53.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 -- 172.21.15.130:0/15532362 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc5e4065b20 msgr2=0x7fc5e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc5e4065b20 0x7fc5e4067fe0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0011f0 tx=0x7fc5fc009040 comp rx=0 tx=0).stop 2023-09-13T06:06:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 -- 172.21.15.130:0/15532362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60015e560 msgr2=0x7fc60014edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60015e560 0x7fc60014edc0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800ef90 tx=0x7fc5f800c490 comp rx=0 tx=0).stop 2023-09-13T06:06:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 -- 172.21.15.130:0/15532362 shutdown_connections 2023-09-13T06:06:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc5e4065b20 0x7fc5e4067fe0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc600157920 0x7fc60014e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60015e560 0x7fc60014edc0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 --2- 172.21.15.130:0/15532362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6000b0f40 0x7fc6001546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 -- 172.21.15.130:0/15532362 >> 172.21.15.130:0/15532362 conn(0x7fc600065990 msgr2=0x7fc6000cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 -- 172.21.15.130:0/15532362 shutdown_connections 2023-09-13T06:06:53.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.716+0000 7fc608634640 1 -- 172.21.15.130:0/15532362 wait complete. 2023-09-13T06:06:53.739 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:06:53.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc55d37640 1 Processor -- start 2023-09-13T06:06:53.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc55d37640 1 -- start start 2023-09-13T06:06:53.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc55d37640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdc500d1090 0x7fdc5015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc55d37640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc500b63c0 con 0x7fdc500d1750 2023-09-13T06:06:53.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc55d37640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc500d0c20 con 0x7fdc50146f30 2023-09-13T06:06:53.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc55d37640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5015dea0 con 0x7fdc500d1090 2023-09-13T06:06:53.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc4f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fdc500d1750 0x7fdc50146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60860/0 (socket says 172.21.15.130:60860) 2023-09-13T06:06:53.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc4f7fe640 1 -- 172.21.15.130:0/1729984644 learned_addr learned my addr 172.21.15.130:0/1729984644 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:53.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110085848 0 0) 0x7fdc500b63c0 con 0x7fdc500d1750 2023-09-13T06:06:53.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc47fff640 1 --2- 172.21.15.130:0/1729984644 >> v2:172.21.15.164:3300/0 conn(0x7fdc500d1090 0x7fdc5015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc3c003530 con 0x7fdc500d1750 2023-09-13T06:06:53.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2196813925 0 0) 0x7fdc3c003530 con 0x7fdc500d1750 2023-09-13T06:06:53.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 >> v2:172.21.15.164:3300/0 conn(0x7fdc500d1090 msgr2=0x7fdc5015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:53.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc4effd640 1 --2- 172.21.15.130:0/1729984644 >> v2:172.21.15.164:3300/0 conn(0x7fdc500d1090 0x7fdc5015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 >> v1:172.21.15.164:6789/0 conn(0x7fdc50146f30 legacy=0x7fdc500b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc500b6610 con 0x7fdc500d1750 2023-09-13T06:06:53.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.876+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fdc40001680 con 0x7fdc500d1750 2023-09-13T06:06:53.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 >> v1:172.21.15.130:6789/0 conn(0x7fdc500d1750 legacy=0x7fdc50146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4effd640 1 --2- 172.21.15.130:0/1729984644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc3c003a40 0x7fdc3c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4effd640 1 --2- 172.21.15.130:0/1729984644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc3c0047d0 0x7fdc3c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4effd640 1 --2- 172.21.15.130:0/1729984644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc3c0052b0 0x7fdc3c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c00c150 con 0x7fdc3c0052b0 2023-09-13T06:06:53.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c00c2c0 con 0x7fdc3c003a40 2023-09-13T06:06:53.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c00c480 con 0x7fdc3c0047d0 2023-09-13T06:06:53.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4f7fe640 1 --2- 172.21.15.130:0/1729984644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc3c003a40 0x7fdc3c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4ffff640 1 --2- 172.21.15.130:0/1729984644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc3c0052b0 0x7fdc3c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc47fff640 1 --2- 172.21.15.130:0/1729984644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc3c0047d0 0x7fdc3c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4f7fe640 1 -- 172.21.15.130:0/1729984644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc3c0047d0 msgr2=0x7fdc3c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:53.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4f7fe640 1 --2- 172.21.15.130:0/1729984644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc3c0047d0 0x7fdc3c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4f7fe640 1 -- 172.21.15.130:0/1729984644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc3c0052b0 msgr2=0x7fdc3c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:53.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4f7fe640 1 --2- 172.21.15.130:0/1729984644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc3c0052b0 0x7fdc3c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4f7fe640 1 -- 172.21.15.130:0/1729984644 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c003530 con 0x7fdc3c003a40 2023-09-13T06:06:53.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4ffff640 1 -- 172.21.15.130:0/1729984644 reap_dead start 2023-09-13T06:06:53.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.880+0000 7fdc4f7fe640 1 --2- 172.21.15.130:0/1729984644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc3c003a40 0x7fdc3c003e60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c0e0 tx=0x7fdc4001f2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aea9d01b62a7a60 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:53.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc400058e0 con 0x7fdc3c003a40 2023-09-13T06:06:53.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40005a40 con 0x7fdc3c003a40 2023-09-13T06:06:53.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc4effd640 1 -- 172.21.15.130:0/1729984644 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40005e70 con 0x7fdc3c003a40 2023-09-13T06:06:53.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 -- 172.21.15.130:0/1729984644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc3c003a40 msgr2=0x7fdc3c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 --2- 172.21.15.130:0/1729984644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc3c003a40 0x7fdc3c003e60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c0e0 tx=0x7fdc4001f2d0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 -- 172.21.15.130:0/1729984644 shutdown_connections 2023-09-13T06:06:53.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 --2- 172.21.15.130:0/1729984644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc3c003a40 0x7fdc3c003e60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 -- 172.21.15.130:0/1729984644 >> 172.21.15.130:0/1729984644 conn(0x7fdc5006f170 msgr2=0x7fdc5006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:53.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 -- 172.21.15.130:0/1729984644 shutdown_connections 2023-09-13T06:06:53.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 -- 172.21.15.130:0/1729984644 wait complete. 2023-09-13T06:06:53.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 Processor -- start 2023-09-13T06:06:53.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 -- start start 2023-09-13T06:06:53.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc3c003a40 0x7fdc500c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc5013fc00 0x7fdc5015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc500b7a40 0x7fdc500b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500b8400 con 0x7fdc3c003a40 2023-09-13T06:06:53.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5015cfe0 con 0x7fdc5013fc00 2023-09-13T06:06:53.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc55d37640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50140370 con 0x7fdc500b7a40 2023-09-13T06:06:53.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc3c003a40 0x7fdc500c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc3c003a40 0x7fdc500c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50522/0 (socket says 172.21.15.130:50522) 2023-09-13T06:06:53.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.884+0000 7fdc4f7fe640 1 -- 172.21.15.130:0/70528958 learned_addr learned my addr 172.21.15.130:0/70528958 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:53.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4ffff640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc500b7a40 0x7fdc500b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc47fff640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc5013fc00 0x7fdc5015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4f7fe640 1 -- 172.21.15.130:0/70528958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc500b7a40 msgr2=0x7fdc500b7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4f7fe640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc500b7a40 0x7fdc500b7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4f7fe640 1 -- 172.21.15.130:0/70528958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc5013fc00 msgr2=0x7fdc5015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:53.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4f7fe640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc5013fc00 0x7fdc5015caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:53.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4f7fe640 1 -- 172.21.15.130:0/70528958 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc50140650 con 0x7fdc3c003a40 2023-09-13T06:06:53.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4f7fe640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc3c003a40 0x7fdc500c91d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fdc40000c10 tx=0x7fdc3c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:53.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4cff9640 1 -- 172.21.15.130:0/70528958 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc400b7070 con 0x7fdc3c003a40 2023-09-13T06:06:53.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4cff9640 1 -- 172.21.15.130:0/70528958 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40000ee0 con 0x7fdc3c003a40 2023-09-13T06:06:53.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc55d37640 1 -- 172.21.15.130:0/70528958 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc50140930 con 0x7fdc3c003a40 2023-09-13T06:06:53.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4cff9640 1 -- 172.21.15.130:0/70528958 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40001600 con 0x7fdc3c003a40 2023-09-13T06:06:53.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc55d37640 1 -- 172.21.15.130:0/70528958 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc50140ef0 con 0x7fdc3c003a40 2023-09-13T06:06:53.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc55d37640 1 -- 172.21.15.130:0/70528958 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc500618a0 con 0x7fdc3c003a40 2023-09-13T06:06:53.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4cff9640 1 -- 172.21.15.130:0/70528958 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdc40005bb0 con 0x7fdc3c003a40 2023-09-13T06:06:53.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4cff9640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc30065b20 0x7fdc30067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:53.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.888+0000 7fdc4cff9640 1 -- 172.21.15.130:0/70528958 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc4011fef0 con 0x7fdc3c003a40 2023-09-13T06:06:53.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.892+0000 7fdc47fff640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc30065b20 0x7fdc30067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:53.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.892+0000 7fdc47fff640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc30065b20 0x7fdc30067fe0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdc5013fb90 tx=0x7fdc38009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:53.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:53.892+0000 7fdc4cff9640 1 -- 172.21.15.130:0/70528958 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdc400ed8f0 con 0x7fdc3c003a40 2023-09-13T06:06:54.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.072+0000 7fdc55d37640 1 -- 172.21.15.130:0/70528958 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc500b4560 con 0x7fdc3c003a40 2023-09-13T06:06:54.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.072+0000 7fdc4cff9640 1 -- 172.21.15.130:0/70528958 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4924 (secure 0 0 0) 0x7fdc400c1090 con 0x7fdc3c003a40 2023-09-13T06:06:54.076 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:54.077 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3211692360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3211692360},{"type":"v1","addr":"172.21.15.164:6834","nonce":3211692360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2453731046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2453731046},{"type":"v1","addr":"172.21.15.130:6835","nonce":2453731046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2896649577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2896649577},{"type":"v1","addr":"172.21.15.164:6835","nonce":2896649577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:06:17.421334+0000","modified":"2023-09-13T06:06:20.748001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6888":{"gid":6888,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/878642631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":878642631},{"type":"v1","addr":"172.21.15.130:6837","nonce":878642631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-09-13T06:06:54.077 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 51 2023-09-13T06:06:54.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 -- 172.21.15.130:0/70528958 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc30065b20 msgr2=0x7fdc30067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc30065b20 0x7fdc30067fe0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdc5013fb90 tx=0x7fdc38009190 comp rx=0 tx=0).stop 2023-09-13T06:06:54.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 -- 172.21.15.130:0/70528958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc3c003a40 msgr2=0x7fdc500c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc3c003a40 0x7fdc500c91d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fdc40000c10 tx=0x7fdc3c005800 comp rx=0 tx=0).stop 2023-09-13T06:06:54.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 -- 172.21.15.130:0/70528958 shutdown_connections 2023-09-13T06:06:54.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc30065b20 0x7fdc30067fe0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc5013fc00 0x7fdc5015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc500b7a40 0x7fdc500b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 --2- 172.21.15.130:0/70528958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc3c003a40 0x7fdc500c91d0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 -- 172.21.15.130:0/70528958 >> 172.21.15.130:0/70528958 conn(0x7fdc5006f170 msgr2=0x7fdc501459a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:54.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 -- 172.21.15.130:0/70528958 shutdown_connections 2023-09-13T06:06:54.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.076+0000 7fdc55d37640 1 -- 172.21.15.130:0/70528958 wait complete. 2023-09-13T06:06:54.097 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:54.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb3476d8640 1 Processor -- start 2023-09-13T06:06:54.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb3476d8640 1 -- start start 2023-09-13T06:06:54.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb3476d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb340147b50 0x7fb3401652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb3476d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb3400af9e0 0x7fb34006bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb3476d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34006b5e0 con 0x7fb340147f30 2023-09-13T06:06:54.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb3476d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34006b8c0 con 0x7fb3400af9e0 2023-09-13T06:06:54.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb3476d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3401657f0 con 0x7fb340147b50 2023-09-13T06:06:54.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb345c75640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb3400af9e0 0x7fb34006bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb345c75640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb3400af9e0 0x7fb34006bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50536/0 (socket says 172.21.15.130:50536) 2023-09-13T06:06:54.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb345c75640 1 -- 172.21.15.130:0/2088152331 learned_addr learned my addr 172.21.15.130:0/2088152331 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:54.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb345474640 1 --2- 172.21.15.130:0/2088152331 >> v2:172.21.15.164:3300/0 conn(0x7fb340147b50 0x7fb3401652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb345c75640 1 -- 172.21.15.130:0/2088152331 >> v2:172.21.15.164:3300/0 conn(0x7fb340147b50 msgr2=0x7fb3401652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:54.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.232+0000 7fb345c75640 1 --2- 172.21.15.130:0/2088152331 >> v2:172.21.15.164:3300/0 conn(0x7fb340147b50 0x7fb3401652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb345c75640 1 -- 172.21.15.130:0/2088152331 >> v1:172.21.15.164:6789/0 conn(0x7fb340147f30 legacy=0x7fb340148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb345c75640 1 -- 172.21.15.130:0/2088152331 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340165ac0 con 0x7fb3400af9e0 2023-09-13T06:06:54.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb345474640 1 --2- 172.21.15.130:0/2088152331 >> v2:172.21.15.164:3300/0 conn(0x7fb340147b50 0x7fb3401652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:54.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb345c75640 1 --2- 172.21.15.130:0/2088152331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3400af9e0 0x7fb34006bd50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fb3400b23d0 tx=0x7fb33801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf98ac5d22737ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:54.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb337fff640 1 -- 172.21.15.130:0/2088152331 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380a5860 con 0x7fb3400af9e0 2023-09-13T06:06:54.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb337fff640 1 -- 172.21.15.130:0/2088152331 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3380a59c0 con 0x7fb3400af9e0 2023-09-13T06:06:54.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb337fff640 1 -- 172.21.15.130:0/2088152331 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380a5d50 con 0x7fb3400af9e0 2023-09-13T06:06:54.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb3476d8640 1 -- 172.21.15.130:0/2088152331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3400af9e0 msgr2=0x7fb34006bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb3476d8640 1 --2- 172.21.15.130:0/2088152331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3400af9e0 0x7fb34006bd50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fb3400b23d0 tx=0x7fb33801c9a0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb3476d8640 1 -- 172.21.15.130:0/2088152331 shutdown_connections 2023-09-13T06:06:54.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb3476d8640 1 --2- 172.21.15.130:0/2088152331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3400af9e0 0x7fb34006bd50 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb3476d8640 1 --2- 172.21.15.130:0/2088152331 >> v2:172.21.15.164:3300/0 conn(0x7fb340147b50 0x7fb3401652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb3476d8640 1 -- 172.21.15.130:0/2088152331 >> 172.21.15.130:0/2088152331 conn(0x7fb340065990 msgr2=0x7fb340065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:54.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb3476d8640 1 -- 172.21.15.130:0/2088152331 shutdown_connections 2023-09-13T06:06:54.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.236+0000 7fb3476d8640 1 -- 172.21.15.130:0/2088152331 wait complete. 2023-09-13T06:06:54.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb3476d8640 1 Processor -- start 2023-09-13T06:06:54.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb3476d8640 1 -- start start 2023-09-13T06:06:54.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb3476d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3400af9e0 0x7fb34013ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb3476d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb340147b50 0x7fb340164150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb3476d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb340147f30 0x7fb3401408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb3476d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb340145710 con 0x7fb340147f30 2023-09-13T06:06:54.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb3476d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb340147200 con 0x7fb3400af9e0 2023-09-13T06:06:54.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb3476d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb340145960 con 0x7fb340147b50 2023-09-13T06:06:54.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb345c75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb340147f30 0x7fb3401408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb345c75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb340147f30 0x7fb3401408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50544/0 (socket says 172.21.15.130:50544) 2023-09-13T06:06:54.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb345c75640 1 -- 172.21.15.130:0/695640256 learned_addr learned my addr 172.21.15.130:0/695640256 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:54.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb345474640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3400af9e0 0x7fb34013ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb344c73640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb340147b50 0x7fb340164150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb345c75640 1 -- 172.21.15.130:0/695640256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb340147b50 msgr2=0x7fb340164150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb345c75640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb340147b50 0x7fb340164150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb345c75640 1 -- 172.21.15.130:0/695640256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3400af9e0 msgr2=0x7fb34013ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb345c75640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3400af9e0 0x7fb34013ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb345c75640 1 -- 172.21.15.130:0/695640256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb338009b30 con 0x7fb340147f30 2023-09-13T06:06:54.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb345c75640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb340147f30 0x7fb3401408c0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fb3380af040 tx=0x7fb338019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:54.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb335ffb640 1 -- 172.21.15.130:0/695640256 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380b8670 con 0x7fb340147f30 2023-09-13T06:06:54.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb335ffb640 1 -- 172.21.15.130:0/695640256 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3380b87d0 con 0x7fb340147f30 2023-09-13T06:06:54.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.240+0000 7fb3476d8640 1 -- 172.21.15.130:0/695640256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb340148ca0 con 0x7fb340147f30 2023-09-13T06:06:54.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.244+0000 7fb335ffb640 1 -- 172.21.15.130:0/695640256 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380b8b60 con 0x7fb340147f30 2023-09-13T06:06:54.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.244+0000 7fb3476d8640 1 -- 172.21.15.130:0/695640256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb340145f20 con 0x7fb340147f30 2023-09-13T06:06:54.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.244+0000 7fb3476d8640 1 -- 172.21.15.130:0/695640256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3400618a0 con 0x7fb340147f30 2023-09-13T06:06:54.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.244+0000 7fb335ffb640 1 -- 172.21.15.130:0/695640256 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb3380b8cc0 con 0x7fb340147f30 2023-09-13T06:06:54.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.244+0000 7fb335ffb640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb324065b20 0x7fb324067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.244+0000 7fb335ffb640 1 -- 172.21.15.130:0/695640256 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb33811e810 con 0x7fb340147f30 2023-09-13T06:06:54.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.244+0000 7fb345474640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb324065b20 0x7fb324067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.248+0000 7fb345474640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb324065b20 0x7fb324067fe0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009950 tx=0x7fb33c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:54.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.248+0000 7fb335ffb640 1 -- 172.21.15.130:0/695640256 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb3380ec2c0 con 0x7fb340147f30 2023-09-13T06:06:54.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.396+0000 7fb3476d8640 1 -- 172.21.15.130:0/695640256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb340161420 con 0x7fb340147f30 2023-09-13T06:06:54.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb335ffb640 1 -- 172.21.15.130:0/695640256 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16608 (secure 0 0 0) 0x7fb3380ef8e0 con 0x7fb340147f30 2023-09-13T06:06:54.401 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:54.402 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":111,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:48.396192+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:06:15.152093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-09-13T06:06:16.467343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:54.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 -- 172.21.15.130:0/695640256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb324065b20 msgr2=0x7fb324067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb324065b20 0x7fb324067fe0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009950 tx=0x7fb33c008040 comp rx=0 tx=0).stop 2023-09-13T06:06:54.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 -- 172.21.15.130:0/695640256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb340147f30 msgr2=0x7fb3401408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb340147f30 0x7fb3401408c0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fb3380af040 tx=0x7fb338019740 comp rx=0 tx=0).stop 2023-09-13T06:06:54.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 -- 172.21.15.130:0/695640256 shutdown_connections 2023-09-13T06:06:54.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb324065b20 0x7fb324067fe0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb340147f30 0x7fb3401408c0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb340147b50 0x7fb340164150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 --2- 172.21.15.130:0/695640256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3400af9e0 0x7fb34013ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 -- 172.21.15.130:0/695640256 >> 172.21.15.130:0/695640256 conn(0x7fb340065990 msgr2=0x7fb3400aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:54.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 -- 172.21.15.130:0/695640256 shutdown_connections 2023-09-13T06:06:54.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.400+0000 7fb3476d8640 1 -- 172.21.15.130:0/695640256 wait complete. 2023-09-13T06:06:54.422 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T06:06:54.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.560+0000 7f0952982640 1 Processor -- start 2023-09-13T06:06:54.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.560+0000 7f0952982640 1 -- start start 2023-09-13T06:06:54.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.560+0000 7f0952982640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f094c0cc780 0x7f094c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f0952982640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c0ccbe0 con 0x7f094c15b130 2023-09-13T06:06:54.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f0952982640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c0ce980 con 0x7f094c0b04a0 2023-09-13T06:06:54.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f0952982640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0cec60 con 0x7f094c0cc780 2023-09-13T06:06:54.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f094c15b130 0x7f094c0ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60876/0 (socket says 172.21.15.130:60876) 2023-09-13T06:06:54.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094bfff640 1 -- 172.21.15.130:0/2205787299 learned_addr learned my addr 172.21.15.130:0/2205787299 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:54.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590691042 0 0) 0x7f094c0ccbe0 con 0x7f094c15b130 2023-09-13T06:06:54.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0934003530 con 0x7f094c15b130 2023-09-13T06:06:54.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094b7fe640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f094c0cc780 0x7f094c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2097497874 0 0) 0x7f0934003530 con 0x7f094c15b130 2023-09-13T06:06:54.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f094c0cc780 msgr2=0x7f094c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:54.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f094c0cc780 0x7f094c15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 >> v1:172.21.15.164:6789/0 conn(0x7f094c0b04a0 legacy=0x7f094c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c06c640 con 0x7f094c15b130 2023-09-13T06:06:54.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f093c001680 con 0x7f094c15b130 2023-09-13T06:06:54.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 >> v1:172.21.15.130:6789/0 conn(0x7f094c15b130 legacy=0x7f094c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0934003a20 0x7f0934003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 0x7f0934004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0934005190 0x7f093400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0cec60 con 0x7f09340047d0 2023-09-13T06:06:54.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093400c0c0 con 0x7f0934005190 2023-09-13T06:06:54.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093400c280 con 0x7f0934003a20 2023-09-13T06:06:54.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094b7fe640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f094c0cc780 0x7f094c15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:54.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094b7fe640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 0x7f0934004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094bfff640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0934003a20 0x7f0934003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f0950f1f640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0934005190 0x7f093400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094b7fe640 1 -- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0934003a20 msgr2=0x7f0934003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:54.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094b7fe640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0934003a20 0x7f0934003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094b7fe640 1 -- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0934005190 msgr2=0x7f093400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:54.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094b7fe640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0934005190 0x7f093400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.564+0000 7f094b7fe640 1 -- 172.21.15.130:0/2205787299 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0934003530 con 0x7f09340047d0 2023-09-13T06:06:54.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f094b7fe640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 0x7f0934004c50 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f094c0cb710 tx=0x7f094001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef975b5db58ec81 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:54.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400ab600 con 0x7f09340047d0 2023-09-13T06:06:54.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09400a7050 con 0x7f09340047d0 2023-09-13T06:06:54.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f094affd640 1 -- 172.21.15.130:0/2205787299 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400ab980 con 0x7f09340047d0 2023-09-13T06:06:54.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f0952982640 1 -- 172.21.15.130:0/2205787299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 msgr2=0x7f0934004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f0952982640 1 --2- 172.21.15.130:0/2205787299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 0x7f0934004c50 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f094c0cb710 tx=0x7f094001c3f0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f0950f1f640 1 -- 172.21.15.130:0/2205787299 reap_dead start 2023-09-13T06:06:54.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f0952982640 1 -- 172.21.15.130:0/2205787299 shutdown_connections 2023-09-13T06:06:54.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f0952982640 1 -- 172.21.15.130:0/2205787299 >> 172.21.15.130:0/2205787299 conn(0x7f094c065990 msgr2=0x7f094c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:54.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f0952982640 1 -- 172.21.15.130:0/2205787299 shutdown_connections 2023-09-13T06:06:54.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f0952982640 1 -- 172.21.15.130:0/2205787299 wait complete. 2023-09-13T06:06:54.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f0952982640 1 Processor -- start 2023-09-13T06:06:54.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.568+0000 7f0952982640 1 -- start start 2023-09-13T06:06:54.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0952982640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 0x7f094c1f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0952982640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f094c1e4790 0x7f094c1e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0952982640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c15c8f0 0x7f094c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0952982640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c158190 con 0x7f09340047d0 2023-09-13T06:06:54.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0952982640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1f30b0 con 0x7f094c15c8f0 2023-09-13T06:06:54.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0952982640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1e4c20 con 0x7f094c1e4790 2023-09-13T06:06:54.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f094bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 0x7f094c1f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f094bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 0x7f094c1f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50568/0 (socket says 172.21.15.130:50568) 2023-09-13T06:06:54.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f094bfff640 1 -- 172.21.15.130:0/2573874841 learned_addr learned my addr 172.21.15.130:0/2573874841 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:54.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f094b7fe640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f094c1e4790 0x7f094c1e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0950f1f640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c15c8f0 0x7f094c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f094bfff640 1 -- 172.21.15.130:0/2573874841 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f094c1e4790 msgr2=0x7f094c1e6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f094bfff640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f094c1e4790 0x7f094c1e6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f094bfff640 1 -- 172.21.15.130:0/2573874841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c15c8f0 msgr2=0x7f094c156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f094bfff640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c15c8f0 0x7f094c156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f094bfff640 1 -- 172.21.15.130:0/2573874841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c1e4f00 con 0x7f09340047d0 2023-09-13T06:06:54.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f094b7fe640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f094c1e4790 0x7f094c1e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:54.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f094bfff640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 0x7f094c1f2b70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f093c0017b0 tx=0x7f093c012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:54.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0948ff9640 1 -- 172.21.15.130:0/2573874841 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c01b070 con 0x7f09340047d0 2023-09-13T06:06:54.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0948ff9640 1 -- 172.21.15.130:0/2573874841 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c014550 con 0x7f09340047d0 2023-09-13T06:06:54.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0952982640 1 -- 172.21.15.130:0/2573874841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c1e51e0 con 0x7f09340047d0 2023-09-13T06:06:54.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0948ff9640 1 -- 172.21.15.130:0/2573874841 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c0148c0 con 0x7f09340047d0 2023-09-13T06:06:54.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0952982640 1 -- 172.21.15.130:0/2573874841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c1e57a0 con 0x7f09340047d0 2023-09-13T06:06:54.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0952982640 1 -- 172.21.15.130:0/2573874841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c0618a0 con 0x7f09340047d0 2023-09-13T06:06:54.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.572+0000 7f0948ff9640 1 -- 172.21.15.130:0/2573874841 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f093c014a20 con 0x7f09340047d0 2023-09-13T06:06:54.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.576+0000 7f0948ff9640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0938065b20 0x7f0938067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.576+0000 7f0948ff9640 1 -- 172.21.15.130:0/2573874841 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f093c086290 con 0x7f09340047d0 2023-09-13T06:06:54.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.576+0000 7f094b7fe640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0938065b20 0x7f0938067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.576+0000 7f094b7fe640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0938065b20 0x7f0938067fe0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f094c06bc40 tx=0x7f09400ad040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:54.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.580+0000 7f0948ff9640 1 -- 172.21.15.130:0/2573874841 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f093c053b40 con 0x7f09340047d0 2023-09-13T06:06:54.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.764+0000 7f0952982640 1 -- 172.21.15.130:0/2573874841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f094c1e5990 con 0x7f09340047d0 2023-09-13T06:06:54.766 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:06:54.764+0000 7faa00e50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T06:06:54.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.768+0000 7f0948ff9640 1 -- 172.21.15.130:0/2573874841 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f093c057160 con 0x7f09340047d0 2023-09-13T06:06:54.772 INFO:teuthology.orchestra.run.smithi130.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T06:06:54.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 -- 172.21.15.130:0/2573874841 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0938065b20 msgr2=0x7f0938067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0938065b20 0x7f0938067fe0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f094c06bc40 tx=0x7f09400ad040 comp rx=0 tx=0).stop 2023-09-13T06:06:54.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 -- 172.21.15.130:0/2573874841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 msgr2=0x7f094c1f2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 0x7f094c1f2b70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f093c0017b0 tx=0x7f093c012920 comp rx=0 tx=0).stop 2023-09-13T06:06:54.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 -- 172.21.15.130:0/2573874841 shutdown_connections 2023-09-13T06:06:54.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0938065b20 0x7f0938067fe0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c15c8f0 0x7f094c156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f094c1e4790 0x7f094c1e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 --2- 172.21.15.130:0/2573874841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09340047d0 0x7f094c1f2b70 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 -- 172.21.15.130:0/2573874841 >> 172.21.15.130:0/2573874841 conn(0x7f094c065990 msgr2=0x7f094c15a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:54.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 -- 172.21.15.130:0/2573874841 shutdown_connections 2023-09-13T06:06:54.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.772+0000 7f0952982640 1 -- 172.21.15.130:0/2573874841 wait complete. 2023-09-13T06:06:54.794 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T06:06:54.837 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:06:54.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.932+0000 7f625a6ec640 1 Processor -- start 2023-09-13T06:06:54.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.932+0000 7f625a6ec640 1 -- start start 2023-09-13T06:06:54.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f625a6ec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f625415d1f0 0x7f62540afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f625a6ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f625406ded0 0x7f625406f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f625a6ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62540b4330 con 0x7f625415d5d0 2023-09-13T06:06:54.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f625a6ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62540b4f90 con 0x7f625406ded0 2023-09-13T06:06:54.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f625a6ec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62540b45f0 con 0x7f625415d1f0 2023-09-13T06:06:54.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f6258c89640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f625406ded0 0x7f625406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f6258c89640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f625406ded0 0x7f625406f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50578/0 (socket says 172.21.15.130:50578) 2023-09-13T06:06:54.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f6258c89640 1 -- 172.21.15.130:0/1851327482 learned_addr learned my addr 172.21.15.130:0/1851327482 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:54.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f62537fe640 1 --1- 172.21.15.130:0/1851327482 >> v1:172.21.15.130:6789/0 conn(0x7f625415d5d0 0x7f625406d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60878/0 (socket says 172.21.15.130:60878) 2023-09-13T06:06:54.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f6253fff640 1 --2- 172.21.15.130:0/1851327482 >> v2:172.21.15.164:3300/0 conn(0x7f625415d1f0 0x7f62540afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f6258c89640 1 -- 172.21.15.130:0/1851327482 >> v2:172.21.15.164:3300/0 conn(0x7f625415d1f0 msgr2=0x7f62540afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:54.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f6258c89640 1 --2- 172.21.15.130:0/1851327482 >> v2:172.21.15.164:3300/0 conn(0x7f625415d1f0 0x7f62540afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f6258c89640 1 -- 172.21.15.130:0/1851327482 >> v1:172.21.15.130:6789/0 conn(0x7f625415d5d0 legacy=0x7f625406d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.936+0000 7f6258c89640 1 -- 172.21.15.130:0/1851327482 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540b48d0 con 0x7f625406ded0 2023-09-13T06:06:54.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f6258c89640 1 --2- 172.21.15.130:0/1851327482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f625406ded0 0x7f625406f170 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f62540671c0 tx=0x7f624c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9cf4b00a9728b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:54.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f6252ffd640 1 -- 172.21.15.130:0/1851327482 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0a56f0 con 0x7f625406ded0 2023-09-13T06:06:54.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f6252ffd640 1 -- 172.21.15.130:0/1851327482 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c0a5850 con 0x7f625406ded0 2023-09-13T06:06:54.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f6252ffd640 1 -- 172.21.15.130:0/1851327482 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0a5be0 con 0x7f625406ded0 2023-09-13T06:06:54.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f625a6ec640 1 -- 172.21.15.130:0/1851327482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f625406ded0 msgr2=0x7f625406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f625a6ec640 1 --2- 172.21.15.130:0/1851327482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f625406ded0 0x7f625406f170 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f62540671c0 tx=0x7f624c01c910 comp rx=0 tx=0).stop 2023-09-13T06:06:54.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f625a6ec640 1 -- 172.21.15.130:0/1851327482 shutdown_connections 2023-09-13T06:06:54.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f625a6ec640 1 --2- 172.21.15.130:0/1851327482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f625406ded0 0x7f625406f170 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f625a6ec640 1 --2- 172.21.15.130:0/1851327482 >> v2:172.21.15.164:3300/0 conn(0x7f625415d1f0 0x7f62540afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f625a6ec640 1 -- 172.21.15.130:0/1851327482 >> 172.21.15.130:0/1851327482 conn(0x7f6254071380 msgr2=0x7f6254071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:54.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f625a6ec640 1 -- 172.21.15.130:0/1851327482 shutdown_connections 2023-09-13T06:06:54.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f625a6ec640 1 -- 172.21.15.130:0/1851327482 wait complete. 2023-09-13T06:06:54.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f625a6ec640 1 Processor -- start 2023-09-13T06:06:54.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.940+0000 7f625a6ec640 1 -- start start 2023-09-13T06:06:54.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f625a6ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f625406ded0 0x7f62541674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f625a6ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625415d1f0 0x7f62540b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f625a6ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625415d5d0 0x7f62540b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f625a6ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625415f290 con 0x7f625406ded0 2023-09-13T06:06:54.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f625a6ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62540b2f40 con 0x7f625415d5d0 2023-09-13T06:06:54.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f625a6ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625415ec80 con 0x7f625415d1f0 2023-09-13T06:06:54.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6253fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f625406ded0 0x7f62541674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6253fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f625406ded0 0x7f62541674f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50582/0 (socket says 172.21.15.130:50582) 2023-09-13T06:06:54.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6253fff640 1 -- 172.21.15.130:0/2177374331 learned_addr learned my addr 172.21.15.130:0/2177374331 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:54.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f62537fe640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625415d1f0 0x7f62540b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6258c89640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625415d5d0 0x7f62540b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6253fff640 1 -- 172.21.15.130:0/2177374331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625415d1f0 msgr2=0x7f62540b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6253fff640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625415d1f0 0x7f62540b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6253fff640 1 -- 172.21.15.130:0/2177374331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625415d5d0 msgr2=0x7f62540b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:54.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6253fff640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625415d5d0 0x7f62540b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:54.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6253fff640 1 -- 172.21.15.130:0/2177374331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c009b30 con 0x7f625406ded0 2023-09-13T06:06:54.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6253fff640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f625406ded0 0x7f62541674f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f624400d5f0 tx=0x7f624400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:54.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6250ff9640 1 -- 172.21.15.130:0/2177374331 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440125f0 con 0x7f625406ded0 2023-09-13T06:06:54.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6250ff9640 1 -- 172.21.15.130:0/2177374331 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6244012750 con 0x7f625406ded0 2023-09-13T06:06:54.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f625a6ec640 1 -- 172.21.15.130:0/2177374331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62540b31e0 con 0x7f625406ded0 2023-09-13T06:06:54.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6250ff9640 1 -- 172.21.15.130:0/2177374331 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6244012ae0 con 0x7f625406ded0 2023-09-13T06:06:54.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f625a6ec640 1 -- 172.21.15.130:0/2177374331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6254167a30 con 0x7f625406ded0 2023-09-13T06:06:54.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f625a6ec640 1 -- 172.21.15.130:0/2177374331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6254167c50 con 0x7f625406ded0 2023-09-13T06:06:54.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.944+0000 7f6250ff9640 1 -- 172.21.15.130:0/2177374331 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6244012c40 con 0x7f625406ded0 2023-09-13T06:06:54.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.948+0000 7f6250ff9640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6240065b50 0x7f6240068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:54.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.948+0000 7f6250ff9640 1 -- 172.21.15.130:0/2177374331 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6244083740 con 0x7f625406ded0 2023-09-13T06:06:54.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.948+0000 7f62537fe640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6240065b50 0x7f6240068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:54.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.948+0000 7f62537fe640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6240065b50 0x7f6240068010 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f62541561d0 tx=0x7f6248007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:54.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:54.952+0000 7f6250ff9640 1 -- 172.21.15.130:0/2177374331 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6244051040 con 0x7f625406ded0 2023-09-13T06:06:55.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.132+0000 7f625a6ec640 1 -- 172.21.15.130:0/2177374331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6254069cc0 con 0x7f625406ded0 2023-09-13T06:06:55.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f6250ff9640 1 -- 172.21.15.130:0/2177374331 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6244007380 con 0x7f625406ded0 2023-09-13T06:06:55.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 -- 172.21.15.130:0/2177374331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6240065b50 msgr2=0x7f6240068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:55.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6240065b50 0x7f6240068010 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f62541561d0 tx=0x7f6248007e50 comp rx=0 tx=0).stop 2023-09-13T06:06:55.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 -- 172.21.15.130:0/2177374331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f625406ded0 msgr2=0x7f62541674f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:55.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f625406ded0 0x7f62541674f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f624400d5f0 tx=0x7f624400dab0 comp rx=0 tx=0).stop 2023-09-13T06:06:55.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 -- 172.21.15.130:0/2177374331 shutdown_connections 2023-09-13T06:06:55.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6240065b50 0x7f6240068010 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:55.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625415d5d0 0x7f62540b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:55.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625415d1f0 0x7f62540b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:55.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 --2- 172.21.15.130:0/2177374331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f625406ded0 0x7f62541674f0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:55.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 -- 172.21.15.130:0/2177374331 >> 172.21.15.130:0/2177374331 conn(0x7f6254071380 msgr2=0x7f6254156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:55.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 -- 172.21.15.130:0/2177374331 shutdown_connections 2023-09-13T06:06:55.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.772+0000 7f625a6ec640 1 -- 172.21.15.130:0/2177374331 wait complete. 2023-09-13T06:06:55.797 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T06:06:55.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.984+0000 7f3e5a448640 1 Processor -- start 2023-09-13T06:06:55.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.984+0000 7f3e5a448640 1 -- start start 2023-09-13T06:06:55.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e5a448640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e540b3170 0x7f3e540b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:55.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e5a448640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3e540b1ff0 0x7f3e540cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:55.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e5a448640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e540ccff0 con 0x7f3e540ccc10 2023-09-13T06:06:55.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e5a448640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5415b590 con 0x7f3e540b1ff0 2023-09-13T06:06:55.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e5a448640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e540b12f0 con 0x7f3e540b3170 2023-09-13T06:06:55.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e589e5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3e540b1ff0 0x7f3e540cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:55.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e589e5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3e540b1ff0 0x7f3e540cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50588/0 (socket says 172.21.15.130:50588) 2023-09-13T06:06:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e589e5640 1 -- 172.21.15.130:0/3379786616 learned_addr learned my addr 172.21.15.130:0/3379786616 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e537fe640 1 --2- 172.21.15.130:0/3379786616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e540b3170 0x7f3e540b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e589e5640 1 -- 172.21.15.130:0/3379786616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e540b3170 msgr2=0x7f3e540b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e589e5640 1 --2- 172.21.15.130:0/3379786616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e540b3170 0x7f3e540b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e589e5640 1 -- 172.21.15.130:0/3379786616 >> v1:172.21.15.164:6789/0 conn(0x7f3e540ccc10 legacy=0x7f3e5415dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:55.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e589e5640 1 -- 172.21.15.130:0/3379786616 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5415e520 con 0x7f3e540b1ff0 2023-09-13T06:06:55.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e537fe640 1 --2- 172.21.15.130:0/3379786616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e540b3170 0x7f3e540b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:55.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.988+0000 7f3e589e5640 1 --2- 172.21.15.130:0/3379786616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e540b1ff0 0x7f3e540cb710 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009e50 tx=0x7f3e4c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66d4487a5aaf493 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:55.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e52ffd640 1 -- 172.21.15.130:0/3379786616 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0a79d0 con 0x7f3e540b1ff0 2023-09-13T06:06:55.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e52ffd640 1 -- 172.21.15.130:0/3379786616 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0a7b30 con 0x7f3e540b1ff0 2023-09-13T06:06:55.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e52ffd640 1 -- 172.21.15.130:0/3379786616 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0af3f0 con 0x7f3e540b1ff0 2023-09-13T06:06:55.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 -- 172.21.15.130:0/3379786616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e540b1ff0 msgr2=0x7f3e540cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:55.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 --2- 172.21.15.130:0/3379786616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e540b1ff0 0x7f3e540cb710 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009e50 tx=0x7f3e4c01ebf0 comp rx=0 tx=0).stop 2023-09-13T06:06:55.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 -- 172.21.15.130:0/3379786616 shutdown_connections 2023-09-13T06:06:55.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 --2- 172.21.15.130:0/3379786616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e540b1ff0 0x7f3e540cb710 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:55.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 --2- 172.21.15.130:0/3379786616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e540b3170 0x7f3e540b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:55.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 -- 172.21.15.130:0/3379786616 >> 172.21.15.130:0/3379786616 conn(0x7f3e540735e0 msgr2=0x7f3e54065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:55.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 -- 172.21.15.130:0/3379786616 shutdown_connections 2023-09-13T06:06:55.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 -- 172.21.15.130:0/3379786616 wait complete. 2023-09-13T06:06:55.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 Processor -- start 2023-09-13T06:06:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 -- start start 2023-09-13T06:06:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e540b1ff0 0x7f3e541f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e540b3170 0x7f3e54149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e540ccc10 0x7f3e54162580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5414b0e0 con 0x7f3e540b3170 2023-09-13T06:06:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5414b3c0 con 0x7f3e540ccc10 2023-09-13T06:06:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e5a448640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5414b6a0 con 0x7f3e540b1ff0 2023-09-13T06:06:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e537fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e540b3170 0x7f3e54149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.992+0000 7f3e537fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e540b3170 0x7f3e54149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50600/0 (socket says 172.21.15.130:50600) 2023-09-13T06:06:56.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e537fe640 1 -- 172.21.15.130:0/1955755789 learned_addr learned my addr 172.21.15.130:0/1955755789 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:56.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e589e5640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e540ccc10 0x7f3e54162580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:56.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e53fff640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e540b1ff0 0x7f3e541f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:56.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e537fe640 1 -- 172.21.15.130:0/1955755789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e540b1ff0 msgr2=0x7f3e541f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:56.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e537fe640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e540b1ff0 0x7f3e541f57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e537fe640 1 -- 172.21.15.130:0/1955755789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e540ccc10 msgr2=0x7f3e54162580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:56.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e537fe640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e540ccc10 0x7f3e54162580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e537fe640 1 -- 172.21.15.130:0/1955755789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c009b30 con 0x7f3e540b3170 2023-09-13T06:06:56.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e537fe640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e540b3170 0x7f3e54149920 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e810 tx=0x7f3e4800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:56.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e50ff9640 1 -- 172.21.15.130:0/1955755789 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800c8d0 con 0x7f3e540b3170 2023-09-13T06:06:56.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e50ff9640 1 -- 172.21.15.130:0/1955755789 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4800ca30 con 0x7f3e540b3170 2023-09-13T06:06:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e50ff9640 1 -- 172.21.15.130:0/1955755789 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800cdc0 con 0x7f3e540b3170 2023-09-13T06:06:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e5a448640 1 -- 172.21.15.130:0/1955755789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5414b980 con 0x7f3e540b3170 2023-09-13T06:06:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e5a448640 1 -- 172.21.15.130:0/1955755789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e541f5d00 con 0x7f3e540b3170 2023-09-13T06:06:56.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e5a448640 1 -- 172.21.15.130:0/1955755789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e540618a0 con 0x7f3e540b3170 2023-09-13T06:06:56.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e50ff9640 1 -- 172.21.15.130:0/1955755789 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3e48013410 con 0x7f3e540b3170 2023-09-13T06:06:56.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:55.996+0000 7f3e50ff9640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e40065b20 0x7f3e40067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:56.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.000+0000 7f3e50ff9640 1 -- 172.21.15.130:0/1955755789 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3e48083140 con 0x7f3e540b3170 2023-09-13T06:06:56.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.000+0000 7f3e53fff640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e40065b20 0x7f3e40067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:56.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.000+0000 7f3e53fff640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e40065b20 0x7f3e40067fe0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3e44007fd0 tx=0x7f3e44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:56.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.000+0000 7f3e50ff9640 1 -- 172.21.15.130:0/1955755789 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3e48050ad0 con 0x7f3e540b3170 2023-09-13T06:06:56.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.148+0000 7f3e5a448640 1 -- 172.21.15.130:0/1955755789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e54149e60 con 0x7f3e540b3170 2023-09-13T06:06:56.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.772+0000 7f3e50ff9640 1 -- 172.21.15.130:0/1955755789 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3e48009480 con 0x7f3e540b3170 2023-09-13T06:06:56.777 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' removed 2023-09-13T06:06:56.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 -- 172.21.15.130:0/1955755789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e40065b20 msgr2=0x7f3e40067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:56.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e40065b20 0x7f3e40067fe0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3e44007fd0 tx=0x7f3e44009040 comp rx=0 tx=0).stop 2023-09-13T06:06:56.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 -- 172.21.15.130:0/1955755789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e540b3170 msgr2=0x7f3e54149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:56.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e540b3170 0x7f3e54149920 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e810 tx=0x7f3e4800ecd0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 -- 172.21.15.130:0/1955755789 shutdown_connections 2023-09-13T06:06:56.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e40065b20 0x7f3e40067fe0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e540ccc10 0x7f3e54162580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e540b3170 0x7f3e54149920 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 --2- 172.21.15.130:0/1955755789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e540b1ff0 0x7f3e541f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 -- 172.21.15.130:0/1955755789 >> 172.21.15.130:0/1955755789 conn(0x7f3e540735e0 msgr2=0x7f3e540cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:56.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 -- 172.21.15.130:0/1955755789 shutdown_connections 2023-09-13T06:06:56.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.776+0000 7f3e5a448640 1 -- 172.21.15.130:0/1955755789 wait complete. 2023-09-13T06:06:56.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T06:06:56.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.944+0000 7fb8a39ac640 1 Processor -- start 2023-09-13T06:06:56.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.944+0000 7fb8a39ac640 1 -- start start 2023-09-13T06:06:56.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a39ac640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb89c0b0630 0x7fb89c0b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:56.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a39ac640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89c160f50 con 0x7fb89c15d110 2023-09-13T06:06:56.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a39ac640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89c1611a0 con 0x7fb89c0ad300 2023-09-13T06:06:56.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a39ac640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c161e20 con 0x7fb89c0b0630 2023-09-13T06:06:56.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a1748640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb89c15d110 0x7fb89c0ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60892/0 (socket says 172.21.15.130:60892) 2023-09-13T06:06:56.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a1748640 1 -- 172.21.15.130:0/1471287377 learned_addr learned my addr 172.21.15.130:0/1471287377 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:56.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a1f49640 1 --2- 172.21.15.130:0/1471287377 >> v2:172.21.15.164:3300/0 conn(0x7fb89c0b0630 0x7fb89c0b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:56.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660984527 0 0) 0x7fb89c160f50 con 0x7fb89c15d110 2023-09-13T06:06:56.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb888003530 con 0x7fb89c15d110 2023-09-13T06:06:56.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3476850839 0 0) 0x7fb888003530 con 0x7fb89c15d110 2023-09-13T06:06:56.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 >> v2:172.21.15.164:3300/0 conn(0x7fb89c0b0630 msgr2=0x7fb89c0b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:56.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 --2- 172.21.15.130:0/1471287377 >> v2:172.21.15.164:3300/0 conn(0x7fb89c0b0630 0x7fb89c0b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 >> v1:172.21.15.164:6789/0 conn(0x7fb89c0ad300 legacy=0x7fb89c0aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:56.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c161480 con 0x7fb89c15d110 2023-09-13T06:06:56.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fb898001680 con 0x7fb89c15d110 2023-09-13T06:06:56.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 >> v1:172.21.15.130:6789/0 conn(0x7fb89c15d110 legacy=0x7fb89c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:56.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 --2- 172.21.15.130:0/1471287377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 0x7fb888003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:56.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 --2- 172.21.15.130:0/1471287377 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8880047d0 0x7fb888004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:56.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 --2- 172.21.15.130:0/1471287377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8880052b0 0x7fb88800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:56.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c161e20 con 0x7fb888003a40 2023-09-13T06:06:56.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88800c180 con 0x7fb8880052b0 2023-09-13T06:06:56.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88800c340 con 0x7fb8880047d0 2023-09-13T06:06:56.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a1748640 1 --2- 172.21.15.130:0/1471287377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 0x7fb888003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:56.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a1f49640 1 --2- 172.21.15.130:0/1471287377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8880052b0 0x7fb88800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:56.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a0f47640 1 --2- 172.21.15.130:0/1471287377 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8880047d0 0x7fb888004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:56.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a1748640 1 -- 172.21.15.130:0/1471287377 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8880047d0 msgr2=0x7fb888004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:56.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a1748640 1 --2- 172.21.15.130:0/1471287377 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8880047d0 0x7fb888004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a1748640 1 -- 172.21.15.130:0/1471287377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8880052b0 msgr2=0x7fb88800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:56.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a1748640 1 --2- 172.21.15.130:0/1471287377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8880052b0 0x7fb88800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a1748640 1 -- 172.21.15.130:0/1471287377 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb888003530 con 0x7fb888003a40 2023-09-13T06:06:56.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.948+0000 7fb8a1f49640 1 -- 172.21.15.130:0/1471287377 reap_dead start 2023-09-13T06:06:56.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb8a1748640 1 --2- 172.21.15.130:0/1471287377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 0x7fb888003e60 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c0e0 tx=0x7fb89801cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a69973b6b02873 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:56.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898005ae0 con 0x7fb888003a40 2023-09-13T06:06:56.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb898005c40 con 0x7fb888003a40 2023-09-13T06:06:56.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb893fff640 1 -- 172.21.15.130:0/1471287377 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8980072b0 con 0x7fb888003a40 2023-09-13T06:06:56.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb8a39ac640 1 -- 172.21.15.130:0/1471287377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 msgr2=0x7fb888003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:56.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb8a39ac640 1 --2- 172.21.15.130:0/1471287377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 0x7fb888003e60 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c0e0 tx=0x7fb89801cae0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb8a39ac640 1 -- 172.21.15.130:0/1471287377 shutdown_connections 2023-09-13T06:06:56.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb8a39ac640 1 --2- 172.21.15.130:0/1471287377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 0x7fb888003e60 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb8a39ac640 1 -- 172.21.15.130:0/1471287377 >> 172.21.15.130:0/1471287377 conn(0x7fb89c0735e0 msgr2=0x7fb89c065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:56.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb8a39ac640 1 -- 172.21.15.130:0/1471287377 shutdown_connections 2023-09-13T06:06:56.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb8a39ac640 1 -- 172.21.15.130:0/1471287377 wait complete. 2023-09-13T06:06:56.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb8a39ac640 1 Processor -- start 2023-09-13T06:06:56.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.952+0000 7fb8a39ac640 1 -- start start 2023-09-13T06:06:56.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a39ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 0x7fb89c1505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:56.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a39ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb89c1ec4b0 0x7fb89c150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:56.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a39ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb89c06d110 0x7fb89c06d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:56.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a39ac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c15b1c0 con 0x7fb888003a40 2023-09-13T06:06:56.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a39ac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c06dad0 con 0x7fb89c1ec4b0 2023-09-13T06:06:56.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a39ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c151440 con 0x7fb89c06d110 2023-09-13T06:06:56.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a1748640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 0x7fb89c1505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:56.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a1748640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 0x7fb89c1505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50614/0 (socket says 172.21.15.130:50614) 2023-09-13T06:06:56.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a1748640 1 -- 172.21.15.130:0/4211421186 learned_addr learned my addr 172.21.15.130:0/4211421186 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:56.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a0f47640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb89c1ec4b0 0x7fb89c150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:56.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a1f49640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb89c06d110 0x7fb89c06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:56.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a1748640 1 -- 172.21.15.130:0/4211421186 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb89c06d110 msgr2=0x7fb89c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:56.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a1748640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb89c06d110 0x7fb89c06d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a1748640 1 -- 172.21.15.130:0/4211421186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb89c1ec4b0 msgr2=0x7fb89c150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:56.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a1748640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb89c1ec4b0 0x7fb89c150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:56.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a1748640 1 -- 172.21.15.130:0/4211421186 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c15a5b0 con 0x7fb888003a40 2023-09-13T06:06:56.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a1748640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 0x7fb89c1505b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fb8980980b0 tx=0x7fb888005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:56.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb891ffb640 1 -- 172.21.15.130:0/4211421186 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8980049f0 con 0x7fb888003a40 2023-09-13T06:06:56.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb891ffb640 1 -- 172.21.15.130:0/4211421186 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb898004b50 con 0x7fb888003a40 2023-09-13T06:06:56.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a39ac640 1 -- 172.21.15.130:0/4211421186 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89c15a890 con 0x7fb888003a40 2023-09-13T06:06:56.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb891ffb640 1 -- 172.21.15.130:0/4211421186 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898001690 con 0x7fb888003a40 2023-09-13T06:06:56.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a39ac640 1 -- 172.21.15.130:0/4211421186 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89c15ae50 con 0x7fb888003a40 2023-09-13T06:06:56.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb8a39ac640 1 -- 172.21.15.130:0/4211421186 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89c0618a0 con 0x7fb888003a40 2023-09-13T06:06:56.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.956+0000 7fb891ffb640 1 -- 172.21.15.130:0/4211421186 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb8980b8070 con 0x7fb888003a40 2023-09-13T06:06:56.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.960+0000 7fb891ffb640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb880065b50 0x7fb880068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:56.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.960+0000 7fb891ffb640 1 -- 172.21.15.130:0/4211421186 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fb89811ce00 con 0x7fb888003a40 2023-09-13T06:06:56.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.960+0000 7fb8a0f47640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb880065b50 0x7fb880068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:56.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.960+0000 7fb8a0f47640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb880065b50 0x7fb880068010 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb89c15da20 tx=0x7fb88c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:56.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:56.964+0000 7fb891ffb640 1 -- 172.21.15.130:0/4211421186 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb8980ea810 con 0x7fb888003a40 2023-09-13T06:06:57.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.112+0000 7fb8a39ac640 1 -- 172.21.15.130:0/4211421186 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb89c065e80 con 0x7fb888003a40 2023-09-13T06:06:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb891ffb640 1 -- 172.21.15.130:0/4211421186 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb8980ede30 con 0x7fb888003a40 2023-09-13T06:06:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' removed 2023-09-13T06:06:57.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 -- 172.21.15.130:0/4211421186 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb880065b50 msgr2=0x7fb880068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:57.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb880065b50 0x7fb880068010 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb89c15da20 tx=0x7fb88c009040 comp rx=0 tx=0).stop 2023-09-13T06:06:57.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 -- 172.21.15.130:0/4211421186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 msgr2=0x7fb89c1505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:57.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 0x7fb89c1505b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fb8980980b0 tx=0x7fb888005800 comp rx=0 tx=0).stop 2023-09-13T06:06:57.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 -- 172.21.15.130:0/4211421186 shutdown_connections 2023-09-13T06:06:57.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb880065b50 0x7fb880068010 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:57.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb89c1ec4b0 0x7fb89c150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:57.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb89c06d110 0x7fb89c06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:57.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 --2- 172.21.15.130:0/4211421186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb888003a40 0x7fb89c1505b0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:57.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 -- 172.21.15.130:0/4211421186 >> 172.21.15.130:0/4211421186 conn(0x7fb89c0735e0 msgr2=0x7fb89c0af080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:57.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 -- 172.21.15.130:0/4211421186 shutdown_connections 2023-09-13T06:06:57.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.776+0000 7fb8a39ac640 1 -- 172.21.15.130:0/4211421186 wait complete. 2023-09-13T06:06:57.800 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-13T06:06:57.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ec00b640 1 Processor -- start 2023-09-13T06:06:57.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ec00b640 1 -- start start 2023-09-13T06:06:57.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ec00b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e4158c10 0x7f99e40b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:57.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ec00b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e406f7f0 con 0x7f99e40b06f0 2023-09-13T06:06:57.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ec00b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e415c230 con 0x7f99e40cc8e0 2023-09-13T06:06:57.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ec00b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40b0c50 con 0x7f99e4158c10 2023-09-13T06:06:57.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e95a6640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f99e40b06f0 0x7f99e40cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60906/0 (socket says 172.21.15.130:60906) 2023-09-13T06:06:57.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e95a6640 1 -- 172.21.15.130:0/2662090076 learned_addr learned my addr 172.21.15.130:0/2662090076 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:57.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571084509 0 0) 0x7f99e406f7f0 con 0x7f99e40b06f0 2023-09-13T06:06:57.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e9da7640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e4158c10 0x7f99e40b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:57.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d0003530 con 0x7f99e40b06f0 2023-09-13T06:06:57.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 438893566 0 0) 0x7f99d0003530 con 0x7f99e40b06f0 2023-09-13T06:06:57.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e4158c10 msgr2=0x7f99e40b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:57.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e4158c10 0x7f99e40b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:57.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 >> v1:172.21.15.164:6789/0 conn(0x7f99e40cc8e0 legacy=0x7f99e40b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:57.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e415b900 con 0x7f99e40b06f0 2023-09-13T06:06:57.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f99d4001680 con 0x7f99e40b06f0 2023-09-13T06:06:57.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 >> v1:172.21.15.130:6789/0 conn(0x7f99e40b06f0 legacy=0x7f99e40cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:57.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99d00039b0 0x7f99d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:57.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e4158c10 0x7f99d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:57.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 0x7f99d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:57.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40b0c50 con 0x7f99d0004d10 2023-09-13T06:06:57.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d000bac0 con 0x7f99d00039b0 2023-09-13T06:06:57.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d000bc80 con 0x7f99e4158c10 2023-09-13T06:06:57.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ea5a8640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 0x7f99d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:57.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e9da7640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99d00039b0 0x7f99d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:57.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99e95a6640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e4158c10 0x7f99d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:57.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ea5a8640 1 -- 172.21.15.130:0/2662090076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e4158c10 msgr2=0x7f99d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:57.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ea5a8640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e4158c10 0x7f99d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:57.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ea5a8640 1 -- 172.21.15.130:0/2662090076 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99d00039b0 msgr2=0x7f99d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:57.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ea5a8640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99d00039b0 0x7f99d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:57.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.940+0000 7f99ea5a8640 1 -- 172.21.15.130:0/2662090076 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d0003530 con 0x7f99d0004d10 2023-09-13T06:06:57.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.944+0000 7f99ea5a8640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 0x7f99d0005190 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f99dc001e70 tx=0x7f99dc01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad0b7d16e68b796 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:57.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.944+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc003b80 con 0x7f99d0004d10 2023-09-13T06:06:57.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.944+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc003ce0 con 0x7f99d0004d10 2023-09-13T06:06:57.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.944+0000 7f99e8da5640 1 -- 172.21.15.130:0/2662090076 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0052c0 con 0x7f99d0004d10 2023-09-13T06:06:57.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.944+0000 7f99ec00b640 1 -- 172.21.15.130:0/2662090076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 msgr2=0x7f99d0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:57.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.944+0000 7f99ec00b640 1 --2- 172.21.15.130:0/2662090076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 0x7f99d0005190 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f99dc001e70 tx=0x7f99dc01c760 comp rx=0 tx=0).stop 2023-09-13T06:06:57.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.944+0000 7f99ea5a8640 1 -- 172.21.15.130:0/2662090076 reap_dead start 2023-09-13T06:06:57.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.944+0000 7f99ec00b640 1 -- 172.21.15.130:0/2662090076 shutdown_connections 2023-09-13T06:06:57.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.944+0000 7f99ec00b640 1 -- 172.21.15.130:0/2662090076 >> 172.21.15.130:0/2662090076 conn(0x7f99e4065990 msgr2=0x7f99e4065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:57.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.944+0000 7f99ec00b640 1 -- 172.21.15.130:0/2662090076 shutdown_connections 2023-09-13T06:06:57.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.944+0000 7f99ec00b640 1 -- 172.21.15.130:0/2662090076 wait complete. 2023-09-13T06:06:57.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99ec00b640 1 Processor -- start 2023-09-13T06:06:57.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99ec00b640 1 -- start start 2023-09-13T06:06:57.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99ec00b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 0x7f99e40adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:57.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99ec00b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e41514c0 0x7f99e4153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:57.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99ec00b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99e4151940 0x7f99e4153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:57.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99ec00b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e41547e0 con 0x7f99d0004d10 2023-09-13T06:06:57.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99ec00b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4155040 con 0x7f99e4151940 2023-09-13T06:06:57.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99ec00b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e41543d0 con 0x7f99e41514c0 2023-09-13T06:06:57.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99e9da7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 0x7f99e40adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:57.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99e9da7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 0x7f99e40adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50630/0 (socket says 172.21.15.130:50630) 2023-09-13T06:06:57.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99e9da7640 1 -- 172.21.15.130:0/2168327091 learned_addr learned my addr 172.21.15.130:0/2168327091 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:57.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99e95a6640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e41514c0 0x7f99e4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:57.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99ea5a8640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99e4151940 0x7f99e4153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:57.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99e9da7640 1 -- 172.21.15.130:0/2168327091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e41514c0 msgr2=0x7f99e4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:57.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99e9da7640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e41514c0 0x7f99e4153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:57.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99e9da7640 1 -- 172.21.15.130:0/2168327091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99e4151940 msgr2=0x7f99e4153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:57.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99e9da7640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99e4151940 0x7f99e4153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:57.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99e9da7640 1 -- 172.21.15.130:0/2168327091 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e41549f0 con 0x7f99d0004d10 2023-09-13T06:06:57.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99e9da7640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 0x7f99e40adbf0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f99e00119d0 tx=0x7f99e0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:57.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99da7fc640 1 -- 172.21.15.130:0/2168327091 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000fb50 con 0x7f99d0004d10 2023-09-13T06:06:57.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99da7fc640 1 -- 172.21.15.130:0/2168327091 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e000fcb0 con 0x7f99d0004d10 2023-09-13T06:06:57.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99da7fc640 1 -- 172.21.15.130:0/2168327091 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0014440 con 0x7f99d0004d10 2023-09-13T06:06:57.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99ec00b640 1 -- 172.21.15.130:0/2168327091 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e4154cd0 con 0x7f99d0004d10 2023-09-13T06:06:57.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.948+0000 7f99ec00b640 1 -- 172.21.15.130:0/2168327091 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e41554d0 con 0x7f99d0004d10 2023-09-13T06:06:57.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.952+0000 7f99ec00b640 1 -- 172.21.15.130:0/2168327091 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e4154e60 con 0x7f99d0004d10 2023-09-13T06:06:57.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.952+0000 7f99da7fc640 1 -- 172.21.15.130:0/2168327091 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f99e00145a0 con 0x7f99d0004d10 2023-09-13T06:06:57.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.952+0000 7f99da7fc640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f99c8065ab0 0x7f99c8067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:57.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.952+0000 7f99da7fc640 1 -- 172.21.15.130:0/2168327091 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f99e00839d0 con 0x7f99d0004d10 2023-09-13T06:06:57.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.952+0000 7f99e95a6640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f99c8065ab0 0x7f99c8067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:57.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.952+0000 7f99e95a6640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f99c8065ab0 0x7f99c8067f70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f99e40cb260 tx=0x7f99d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:57.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:57.956+0000 7f99da7fc640 1 -- 172.21.15.130:0/2168327091 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f99e4154e60 con 0x7f99d0004d10 2023-09-13T06:06:58.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.108+0000 7f99ec00b640 1 -- 172.21.15.130:0/2168327091 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f99e4154e60 con 0x7f99d0004d10 2023-09-13T06:06:58.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.112+0000 7f99da7fc640 1 -- 172.21.15.130:0/2168327091 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f99e0051640 con 0x7f99d0004d10 2023-09-13T06:06:58.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 -- 172.21.15.130:0/2168327091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f99c8065ab0 msgr2=0x7f99c8067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f99c8065ab0 0x7f99c8067f70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f99e40cb260 tx=0x7f99d4009040 comp rx=0 tx=0).stop 2023-09-13T06:06:58.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 -- 172.21.15.130:0/2168327091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 msgr2=0x7f99e40adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 0x7f99e40adbf0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f99e00119d0 tx=0x7f99e0011e90 comp rx=0 tx=0).stop 2023-09-13T06:06:58.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 -- 172.21.15.130:0/2168327091 shutdown_connections 2023-09-13T06:06:58.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f99c8065ab0 0x7f99c8067f70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99e4151940 0x7f99e4153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99e41514c0 0x7f99e4153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 --2- 172.21.15.130:0/2168327091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0004d10 0x7f99e40adbf0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 -- 172.21.15.130:0/2168327091 >> 172.21.15.130:0/2168327091 conn(0x7f99e4065990 msgr2=0x7f99e406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:58.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 -- 172.21.15.130:0/2168327091 shutdown_connections 2023-09-13T06:06:58.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.116+0000 7f99ec00b640 1 -- 172.21.15.130:0/2168327091 wait complete. 2023-09-13T06:06:58.137 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-09-13T06:06:58.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.272+0000 7f5c10434640 1 Processor -- start 2023-09-13T06:06:58.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.272+0000 7f5c10434640 1 -- start start 2023-09-13T06:06:58.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c10434640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5c08147b50 0x7f5c081652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c10434640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c08147f30 0x7f5c08148410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c10434640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5c08148950 0x7f5c0806bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c10434640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0806b5e0 con 0x7f5c08147b50 2023-09-13T06:06:58.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c10434640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0806b8c0 con 0x7f5c08148950 2023-09-13T06:06:58.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c10434640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c081657f0 con 0x7f5c08147f30 2023-09-13T06:06:58.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0e1d0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5c08147b50 0x7f5c081652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0e1d0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5c08147b50 0x7f5c081652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50646/0 (socket says 172.21.15.130:50646) 2023-09-13T06:06:58.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0e1d0640 1 -- 172.21.15.130:0/1332650825 learned_addr learned my addr 172.21.15.130:0/1332650825 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:58.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0d9cf640 1 --2- 172.21.15.130:0/1332650825 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c08147f30 0x7f5c08148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0e1d0640 1 -- 172.21.15.130:0/1332650825 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c08147f30 msgr2=0x7f5c08148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:58.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0e9d1640 1 --2- 172.21.15.130:0/1332650825 >> v2:172.21.15.164:3300/0 conn(0x7f5c08148950 0x7f5c0806bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0e1d0640 1 --2- 172.21.15.130:0/1332650825 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c08147f30 0x7f5c08148410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0e1d0640 1 -- 172.21.15.130:0/1332650825 >> v2:172.21.15.164:3300/0 conn(0x7f5c08148950 msgr2=0x7f5c0806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:58.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0e1d0640 1 --2- 172.21.15.130:0/1332650825 >> v2:172.21.15.164:3300/0 conn(0x7f5c08148950 0x7f5c0806bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0e1d0640 1 -- 172.21.15.130:0/1332650825 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08165ac0 con 0x7f5c08147b50 2023-09-13T06:06:58.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0d9cf640 1 --2- 172.21.15.130:0/1332650825 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c08147f30 0x7f5c08148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:58.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.276+0000 7f5c0e9d1640 1 --2- 172.21.15.130:0/1332650825 >> v2:172.21.15.164:3300/0 conn(0x7f5c08148950 0x7f5c0806bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:06:58.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c0e1d0640 1 --2- 172.21.15.130:0/1332650825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c08147b50 0x7f5c081652b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5c080aeb00 tx=0x7f5c0401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583ff351bc00acd3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:58.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c0d1ce640 1 -- 172.21.15.130:0/1332650825 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c040aa5f0 con 0x7f5c08147b50 2023-09-13T06:06:58.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c0d1ce640 1 -- 172.21.15.130:0/1332650825 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c040aa750 con 0x7f5c08147b50 2023-09-13T06:06:58.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c0d1ce640 1 -- 172.21.15.130:0/1332650825 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c040aaae0 con 0x7f5c08147b50 2023-09-13T06:06:58.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c10434640 1 -- 172.21.15.130:0/1332650825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c08147b50 msgr2=0x7f5c081652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c10434640 1 --2- 172.21.15.130:0/1332650825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c08147b50 0x7f5c081652b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5c080aeb00 tx=0x7f5c0401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c10434640 1 -- 172.21.15.130:0/1332650825 shutdown_connections 2023-09-13T06:06:58.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c10434640 1 --2- 172.21.15.130:0/1332650825 >> v2:172.21.15.164:3300/0 conn(0x7f5c08148950 0x7f5c0806bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c10434640 1 --2- 172.21.15.130:0/1332650825 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c08147f30 0x7f5c08148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c10434640 1 --2- 172.21.15.130:0/1332650825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c08147b50 0x7f5c081652b0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c10434640 1 -- 172.21.15.130:0/1332650825 >> 172.21.15.130:0/1332650825 conn(0x7f5c08065990 msgr2=0x7f5c08065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:58.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c10434640 1 -- 172.21.15.130:0/1332650825 shutdown_connections 2023-09-13T06:06:58.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c10434640 1 -- 172.21.15.130:0/1332650825 wait complete. 2023-09-13T06:06:58.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c10434640 1 Processor -- start 2023-09-13T06:06:58.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.280+0000 7f5c10434640 1 -- start start 2023-09-13T06:06:58.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c10434640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c08147b50 0x7f5c08160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c10434640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c08147f30 0x7f5c0813de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c10434640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c08148950 0x7f5c0813e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c10434640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0813ba90 con 0x7f5c08147b50 2023-09-13T06:06:58.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c10434640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c081613a0 con 0x7f5c08147f30 2023-09-13T06:06:58.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c10434640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0813beb0 con 0x7f5c08148950 2023-09-13T06:06:58.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c0e1d0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c08147b50 0x7f5c08160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c0e1d0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c08147b50 0x7f5c08160e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50648/0 (socket says 172.21.15.130:50648) 2023-09-13T06:06:58.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c0e1d0640 1 -- 172.21.15.130:0/2453770228 learned_addr learned my addr 172.21.15.130:0/2453770228 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:58.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c0d9cf640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c08147f30 0x7f5c0813de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c0e9d1640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c08148950 0x7f5c0813e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c0e1d0640 1 -- 172.21.15.130:0/2453770228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c08148950 msgr2=0x7f5c0813e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c0e1d0640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c08148950 0x7f5c0813e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c0e1d0640 1 -- 172.21.15.130:0/2453770228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c08147f30 msgr2=0x7f5c0813de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c0e1d0640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c08147f30 0x7f5c0813de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c0e1d0640 1 -- 172.21.15.130:0/2453770228 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c040094d0 con 0x7f5c08147b50 2023-09-13T06:06:58.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c0e1d0640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c08147b50 0x7f5c08160e60 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5c040ac040 tx=0x7f5c0401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:58.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5bfeffd640 1 -- 172.21.15.130:0/2453770228 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c040b3800 con 0x7f5c08147b50 2023-09-13T06:06:58.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5bfeffd640 1 -- 172.21.15.130:0/2453770228 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c040b3980 con 0x7f5c08147b50 2023-09-13T06:06:58.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5bfeffd640 1 -- 172.21.15.130:0/2453770228 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c040b3d30 con 0x7f5c08147b50 2023-09-13T06:06:58.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c10434640 1 -- 172.21.15.130:0/2453770228 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0813e340 con 0x7f5c08147b50 2023-09-13T06:06:58.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c10434640 1 -- 172.21.15.130:0/2453770228 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0813b3d0 con 0x7f5c08147b50 2023-09-13T06:06:58.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5c10434640 1 -- 172.21.15.130:0/2453770228 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c080618a0 con 0x7f5c08147b50 2023-09-13T06:06:58.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.284+0000 7f5bfeffd640 1 -- 172.21.15.130:0/2453770228 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5c040c6440 con 0x7f5c08147b50 2023-09-13T06:06:58.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.288+0000 7f5bfeffd640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5bec065b20 0x7f5bec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.288+0000 7f5bfeffd640 1 -- 172.21.15.130:0/2453770228 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5c040a7070 con 0x7f5c08147b50 2023-09-13T06:06:58.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.288+0000 7f5c0d9cf640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5bec065b20 0x7f5bec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.288+0000 7f5c0d9cf640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5bec065b20 0x7f5bec067fe0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5c080ae760 tx=0x7f5bf8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:58.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.292+0000 7f5bfeffd640 1 -- 172.21.15.130:0/2453770228 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5c040eb9c0 con 0x7f5c08147b50 2023-09-13T06:06:58.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.488+0000 7f5c10434640 1 -- 172.21.15.130:0/2453770228 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f5c080b2860 con 0x7f5c08147b50 2023-09-13T06:06:58.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.776+0000 7f5bfeffd640 1 -- 172.21.15.130:0/2453770228 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v306) v1 ==== 137+0+0 (secure 0 0 0) 0x7f5c040eefe0 con 0x7f5c08147b50 2023-09-13T06:06:58.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 -- 172.21.15.130:0/2453770228 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5bec065b20 msgr2=0x7f5bec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5bec065b20 0x7f5bec067fe0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5c080ae760 tx=0x7f5bf8008040 comp rx=0 tx=0).stop 2023-09-13T06:06:58.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 -- 172.21.15.130:0/2453770228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c08147b50 msgr2=0x7f5c08160e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c08147b50 0x7f5c08160e60 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5c040ac040 tx=0x7f5c0401ad10 comp rx=0 tx=0).stop 2023-09-13T06:06:58.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 -- 172.21.15.130:0/2453770228 shutdown_connections 2023-09-13T06:06:58.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5bec065b20 0x7f5bec067fe0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c08147f30 0x7f5c0813de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c08148950 0x7f5c0813e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 --2- 172.21.15.130:0/2453770228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c08147b50 0x7f5c08160e60 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 -- 172.21.15.130:0/2453770228 >> 172.21.15.130:0/2453770228 conn(0x7f5c08065990 msgr2=0x7f5c08161cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:58.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 -- 172.21.15.130:0/2453770228 shutdown_connections 2023-09-13T06:06:58.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.780+0000 7f5c10434640 1 -- 172.21.15.130:0/2453770228 wait complete. 2023-09-13T06:06:58.802 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-09-13T06:06:58.802 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-09-13T06:06:58.803 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-09-13T06:06:58.803 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:06:58.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.936+0000 7f3630034640 1 Processor -- start 2023-09-13T06:06:58.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f3630034640 1 -- start start 2023-09-13T06:06:58.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f3630034640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36280b2da0 0x7f362806f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f3630034640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362815d9e0 con 0x7f362806fc70 2023-09-13T06:06:58.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f3630034640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362815dcc0 con 0x7f36280cf2a0 2023-09-13T06:06:58.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f3630034640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362815e660 con 0x7f36280b2da0 2023-09-13T06:06:58.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362d5cf640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f362806fc70 0x7f36280ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60916/0 (socket says 172.21.15.130:60916) 2023-09-13T06:06:58.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362d5cf640 1 -- 172.21.15.130:0/1543793134 learned_addr learned my addr 172.21.15.130:0/1543793134 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:58.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362ddd0640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36280b2da0 0x7f362806f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085758658 0 0) 0x7f362815d9e0 con 0x7f362806fc70 2023-09-13T06:06:58.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3614003530 con 0x7f362806fc70 2023-09-13T06:06:58.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1080762115 0 0) 0x7f3614003530 con 0x7f362806fc70 2023-09-13T06:06:58.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36280b2da0 msgr2=0x7f362806f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:58.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36280b2da0 0x7f362806f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 >> v1:172.21.15.164:6789/0 conn(0x7f36280cf2a0 legacy=0x7f3628160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362815dfa0 con 0x7f362806fc70 2023-09-13T06:06:58.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f36180016a0 con 0x7f362806fc70 2023-09-13T06:06:58.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 >> v1:172.21.15.130:6789/0 conn(0x7f362806fc70 legacy=0x7f36280ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3614003a20 0x7f3614003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36280b2da0 0x7f36140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3614004d10 0x7f3614005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362815e660 con 0x7f3614004d10 2023-09-13T06:06:58.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361400ba40 con 0x7f3614003a20 2023-09-13T06:06:58.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361400bbb0 con 0x7f36280b2da0 2023-09-13T06:06:58.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362e5d1640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3614004d10 0x7f3614005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362d5cf640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36280b2da0 0x7f36140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362ddd0640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3614003a20 0x7f3614003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362e5d1640 1 -- 172.21.15.130:0/1543793134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36280b2da0 msgr2=0x7f36140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:58.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362e5d1640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36280b2da0 0x7f36140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362e5d1640 1 -- 172.21.15.130:0/1543793134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3614003a20 msgr2=0x7f3614003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:58.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362e5d1640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3614003a20 0x7f3614003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.940+0000 7f362e5d1640 1 -- 172.21.15.130:0/1543793134 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3614003530 con 0x7f3614004d10 2023-09-13T06:06:58.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.944+0000 7f362e5d1640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3614004d10 0x7f3614005190 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3628073a30 tx=0x7f362001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c94490f04422714 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:58.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.944+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200a5710 con 0x7f3614004d10 2023-09-13T06:06:58.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.944+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36200a5870 con 0x7f3614004d10 2023-09-13T06:06:58.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.944+0000 7f362cdce640 1 -- 172.21.15.130:0/1543793134 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200a5c20 con 0x7f3614004d10 2023-09-13T06:06:58.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.944+0000 7f3630034640 1 -- 172.21.15.130:0/1543793134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3614004d10 msgr2=0x7f3614005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.944+0000 7f3630034640 1 --2- 172.21.15.130:0/1543793134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3614004d10 0x7f3614005190 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3628073a30 tx=0x7f362001c820 comp rx=0 tx=0).stop 2023-09-13T06:06:58.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.944+0000 7f362e5d1640 1 -- 172.21.15.130:0/1543793134 reap_dead start 2023-09-13T06:06:58.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.944+0000 7f3630034640 1 -- 172.21.15.130:0/1543793134 shutdown_connections 2023-09-13T06:06:58.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.944+0000 7f3630034640 1 -- 172.21.15.130:0/1543793134 >> 172.21.15.130:0/1543793134 conn(0x7f362806a2f0 msgr2=0x7f362806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:58.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.944+0000 7f3630034640 1 -- 172.21.15.130:0/1543793134 shutdown_connections 2023-09-13T06:06:58.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.944+0000 7f3630034640 1 -- 172.21.15.130:0/1543793134 wait complete. 2023-09-13T06:06:58.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f3630034640 1 Processor -- start 2023-09-13T06:06:58.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f3630034640 1 -- start start 2023-09-13T06:06:58.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f3630034640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3614004d10 0x7f36281f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f3630034640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f362815ca10 0x7f362815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f3630034640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36281f4e20 0x7f36281f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f3630034640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c34c0 con 0x7f36281f4e20 2023-09-13T06:06:58.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f3630034640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36281f3330 con 0x7f362815ca10 2023-09-13T06:06:58.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f3630034640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c2b90 con 0x7f3614004d10 2023-09-13T06:06:58.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f362e5d1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36281f4e20 0x7f36281f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f362e5d1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36281f4e20 0x7f36281f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50668/0 (socket says 172.21.15.130:50668) 2023-09-13T06:06:58.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f362e5d1640 1 -- 172.21.15.130:0/277697232 learned_addr learned my addr 172.21.15.130:0/277697232 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:58.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f362d5cf640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f362815ca10 0x7f362815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f362ddd0640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3614004d10 0x7f36281f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f362e5d1640 1 -- 172.21.15.130:0/277697232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3614004d10 msgr2=0x7f36281f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f362e5d1640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3614004d10 0x7f36281f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f362e5d1640 1 -- 172.21.15.130:0/277697232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f362815ca10 msgr2=0x7f362815ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:58.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f362e5d1640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f362815ca10 0x7f362815ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:58.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f362e5d1640 1 -- 172.21.15.130:0/277697232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280c2e70 con 0x7f36281f4e20 2023-09-13T06:06:58.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f362e5d1640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36281f4e20 0x7f36281f52a0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f362001cd00 tx=0x7f3614005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:58.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f361e7fc640 1 -- 172.21.15.130:0/277697232 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200a5df0 con 0x7f36281f4e20 2023-09-13T06:06:58.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f361e7fc640 1 -- 172.21.15.130:0/277697232 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36200011d0 con 0x7f36281f4e20 2023-09-13T06:06:58.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f361e7fc640 1 -- 172.21.15.130:0/277697232 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620003b80 con 0x7f36281f4e20 2023-09-13T06:06:58.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f3630034640 1 -- 172.21.15.130:0/277697232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36280c3150 con 0x7f36281f4e20 2023-09-13T06:06:58.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.948+0000 7f3630034640 1 -- 172.21.15.130:0/277697232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36281f57e0 con 0x7f36281f4e20 2023-09-13T06:06:58.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.952+0000 7f3630034640 1 -- 172.21.15.130:0/277697232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36280c3630 con 0x7f36281f4e20 2023-09-13T06:06:58.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.952+0000 7f361e7fc640 1 -- 172.21.15.130:0/277697232 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f36200b4040 con 0x7f36281f4e20 2023-09-13T06:06:58.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.952+0000 7f361e7fc640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f360c065b20 0x7f360c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:58.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.952+0000 7f361e7fc640 1 -- 172.21.15.130:0/277697232 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f362011c450 con 0x7f36281f4e20 2023-09-13T06:06:58.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.952+0000 7f362ddd0640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f360c065b20 0x7f360c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:58.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.952+0000 7f362ddd0640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f360c065b20 0x7f360c067fe0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3628134130 tx=0x7f3624009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:58.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:58.956+0000 7f361e7fc640 1 -- 172.21.15.130:0/277697232 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f36200ea170 con 0x7f36281f4e20 2023-09-13T06:06:59.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.104+0000 7f3630034640 1 -- 172.21.15.130:0/277697232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36280618a0 con 0x7f36281f4e20 2023-09-13T06:06:59.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f361e7fc640 1 -- 172.21.15.130:0/277697232 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+13033 (secure 0 0 0) 0x7f36200ed790 con 0x7f36281f4e20 2023-09-13T06:06:59.109 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:06:59.109 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":114,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:06:57.775658+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.130:6837/878642631":"2023-09-14T06:06:54.768652+0000","172.21.15.130:6836/878642631":"2023-09-14T06:06:54.768652+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:06:59.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 -- 172.21.15.130:0/277697232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f360c065b20 msgr2=0x7f360c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f360c065b20 0x7f360c067fe0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3628134130 tx=0x7f3624009190 comp rx=0 tx=0).stop 2023-09-13T06:06:59.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 -- 172.21.15.130:0/277697232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36281f4e20 msgr2=0x7f36281f52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36281f4e20 0x7f36281f52a0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f362001cd00 tx=0x7f3614005800 comp rx=0 tx=0).stop 2023-09-13T06:06:59.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 -- 172.21.15.130:0/277697232 shutdown_connections 2023-09-13T06:06:59.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f360c065b20 0x7f360c067fe0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f362815ca10 0x7f362815ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36281f4e20 0x7f36281f52a0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 --2- 172.21.15.130:0/277697232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3614004d10 0x7f36281f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 -- 172.21.15.130:0/277697232 >> 172.21.15.130:0/277697232 conn(0x7f362806a2f0 msgr2=0x7f36280cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:59.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 -- 172.21.15.130:0/277697232 shutdown_connections 2023-09-13T06:06:59.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.108+0000 7f3630034640 1 -- 172.21.15.130:0/277697232 wait complete. 2023-09-13T06:06:59.131 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:06:59.131 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:06:59.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.268+0000 7f02b8c34640 1 Processor -- start 2023-09-13T06:06:59.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.268+0000 7f02b8c34640 1 -- start start 2023-09-13T06:06:59.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b8c34640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f02b40b2e90 0x7f02b40ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b8c34640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b40b1460 0x7f02b40b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b8c34640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b40b2150 con 0x7f02b4144d70 2023-09-13T06:06:59.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b8c34640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b40b2430 con 0x7f02b40b2e90 2023-09-13T06:06:59.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b8c34640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40cedb0 con 0x7f02b40b1460 2023-09-13T06:06:59.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b259c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f02b4144d70 0x7f02b40b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60932/0 (socket says 172.21.15.130:60932) 2023-09-13T06:06:59.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b259c640 1 -- 172.21.15.130:0/3957795414 learned_addr learned my addr 172.21.15.130:0/3957795414 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:59.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b1d9b640 1 --2- 172.21.15.130:0/3957795414 >> v2:172.21.15.164:3300/0 conn(0x7f02b40b2e90 0x7f02b40ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b2d9d640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b40b1460 0x7f02b40b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878938707 0 0) 0x7f02b40b2150 con 0x7f02b4144d70 2023-09-13T06:06:59.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f029c003530 con 0x7f02b4144d70 2023-09-13T06:06:59.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2991724973 0 0) 0x7f029c003530 con 0x7f02b4144d70 2023-09-13T06:06:59.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b40b1460 msgr2=0x7f02b40b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:59.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b40b1460 0x7f02b40b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 >> v2:172.21.15.164:3300/0 conn(0x7f02b40b2e90 msgr2=0x7f02b40ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:59.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 --2- 172.21.15.130:0/3957795414 >> v2:172.21.15.164:3300/0 conn(0x7f02b40b2e90 0x7f02b40ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b40cdd90 con 0x7f02b4144d70 2023-09-13T06:06:59.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f02a4001680 con 0x7f02b4144d70 2023-09-13T06:06:59.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 >> v1:172.21.15.130:6789/0 conn(0x7f02b4144d70 legacy=0x7f02b40b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c0039f0 0x7f029c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f029c0047d0 0x7f029c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b40b1460 0x7f029c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40b2430 con 0x7f029c0039f0 2023-09-13T06:06:59.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c00b990 con 0x7f029c0047d0 2023-09-13T06:06:59.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c00bad0 con 0x7f02b40b1460 2023-09-13T06:06:59.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b1d9b640 1 --2- 172.21.15.130:0/3957795414 >> v2:172.21.15.164:3300/0 conn(0x7f02b40b2e90 0x7f02b40ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:06:59.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b259c640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c0039f0 0x7f029c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b2d9d640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b40b1460 0x7f029c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b1d9b640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f029c0047d0 0x7f029c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b259c640 1 -- 172.21.15.130:0/3957795414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b40b1460 msgr2=0x7f029c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:59.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b259c640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b40b1460 0x7f029c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b259c640 1 -- 172.21.15.130:0/3957795414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f029c0047d0 msgr2=0x7f029c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:59.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b259c640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f029c0047d0 0x7f029c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.272+0000 7f02b259c640 1 -- 172.21.15.130:0/3957795414 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c003530 con 0x7f029c0039f0 2023-09-13T06:06:59.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.276+0000 7f02b259c640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c0039f0 0x7f029c003e10 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f02a400c270 tx=0x7f02a401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e9c5ea89db960f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:59.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.276+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a40058e0 con 0x7f029c0039f0 2023-09-13T06:06:59.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.276+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a4005a40 con 0x7f029c0039f0 2023-09-13T06:06:59.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.276+0000 7f02b159a640 1 -- 172.21.15.130:0/3957795414 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a4005dd0 con 0x7f029c0039f0 2023-09-13T06:06:59.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.276+0000 7f02b8c34640 1 -- 172.21.15.130:0/3957795414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c0039f0 msgr2=0x7f029c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.276+0000 7f02b8c34640 1 --2- 172.21.15.130:0/3957795414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c0039f0 0x7f029c003e10 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f02a400c270 tx=0x7f02a401cc30 comp rx=0 tx=0).stop 2023-09-13T06:06:59.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.276+0000 7f02b2d9d640 1 -- 172.21.15.130:0/3957795414 reap_dead start 2023-09-13T06:06:59.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.276+0000 7f02b8c34640 1 -- 172.21.15.130:0/3957795414 shutdown_connections 2023-09-13T06:06:59.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.276+0000 7f02b8c34640 1 -- 172.21.15.130:0/3957795414 >> 172.21.15.130:0/3957795414 conn(0x7f02b4065990 msgr2=0x7f02b4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:59.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.276+0000 7f02b8c34640 1 -- 172.21.15.130:0/3957795414 shutdown_connections 2023-09-13T06:06:59.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.276+0000 7f02b8c34640 1 -- 172.21.15.130:0/3957795414 wait complete. 2023-09-13T06:06:59.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b8c34640 1 Processor -- start 2023-09-13T06:06:59.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b8c34640 1 -- start start 2023-09-13T06:06:59.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b8c34640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f029c0039f0 0x7f02b413c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b8c34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02b4158370 0x7f02b4154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b8c34640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b4154740 0x7f02b4163180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b8c34640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40afd50 con 0x7f02b4158370 2023-09-13T06:06:59.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b8c34640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40af790 con 0x7f029c0039f0 2023-09-13T06:06:59.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b8c34640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40afa70 con 0x7f02b4154740 2023-09-13T06:06:59.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b1d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02b4158370 0x7f02b4154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b1d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02b4158370 0x7f02b4154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50698/0 (socket says 172.21.15.130:50698) 2023-09-13T06:06:59.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b1d9b640 1 -- 172.21.15.130:0/3004373455 learned_addr learned my addr 172.21.15.130:0/3004373455 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:59.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b259c640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f029c0039f0 0x7f02b413c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b2d9d640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b4154740 0x7f02b4163180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b1d9b640 1 -- 172.21.15.130:0/3004373455 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b4154740 msgr2=0x7f02b4163180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b1d9b640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b4154740 0x7f02b4163180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b1d9b640 1 -- 172.21.15.130:0/3004373455 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f029c0039f0 msgr2=0x7f02b413c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b1d9b640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f029c0039f0 0x7f02b413c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b1d9b640 1 -- 172.21.15.130:0/3004373455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b40cbb80 con 0x7f02b4158370 2023-09-13T06:06:59.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b1d9b640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02b4158370 0x7f02b4154200 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f02a8011cd0 tx=0x7f02a800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:59.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02a2ffd640 1 -- 172.21.15.130:0/3004373455 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800fd20 con 0x7f02b4158370 2023-09-13T06:06:59.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02a2ffd640 1 -- 172.21.15.130:0/3004373455 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800fe80 con 0x7f02b4158370 2023-09-13T06:06:59.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02a2ffd640 1 -- 172.21.15.130:0/3004373455 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8004270 con 0x7f02b4158370 2023-09-13T06:06:59.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b8c34640 1 -- 172.21.15.130:0/3004373455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b40cbe60 con 0x7f02b4158370 2023-09-13T06:06:59.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.280+0000 7f02b8c34640 1 -- 172.21.15.130:0/3004373455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b40af1d0 con 0x7f02b4158370 2023-09-13T06:06:59.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.284+0000 7f02b8c34640 1 -- 172.21.15.130:0/3004373455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b40cb9e0 con 0x7f02b4158370 2023-09-13T06:06:59.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.284+0000 7f02a2ffd640 1 -- 172.21.15.130:0/3004373455 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f02a80043d0 con 0x7f02b4158370 2023-09-13T06:06:59.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.284+0000 7f02a2ffd640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0294065b20 0x7f0294067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.284+0000 7f02a2ffd640 1 -- 172.21.15.130:0/3004373455 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f02a8083780 con 0x7f02b4158370 2023-09-13T06:06:59.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.284+0000 7f02b259c640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0294065b20 0x7f0294067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.284+0000 7f02b259c640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0294065b20 0x7f0294067fe0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f02a40aa000 tx=0x7f02a4001a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:59.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.288+0000 7f02a2ffd640 1 -- 172.21.15.130:0/3004373455 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f02b40cb9e0 con 0x7f02b4158370 2023-09-13T06:06:59.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.436+0000 7f02b8c34640 1 -- 172.21.15.130:0/3004373455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02b40cb9e0 con 0x7f02b4158370 2023-09-13T06:06:59.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.436+0000 7f02a2ffd640 1 -- 172.21.15.130:0/3004373455 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02b40cb9e0 con 0x7f02b4158370 2023-09-13T06:06:59.441 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:06:59.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 -- 172.21.15.130:0/3004373455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0294065b20 msgr2=0x7f0294067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0294065b20 0x7f0294067fe0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f02a40aa000 tx=0x7f02a4001a80 comp rx=0 tx=0).stop 2023-09-13T06:06:59.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 -- 172.21.15.130:0/3004373455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02b4158370 msgr2=0x7f02b4154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02b4158370 0x7f02b4154200 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f02a8011cd0 tx=0x7f02a800f610 comp rx=0 tx=0).stop 2023-09-13T06:06:59.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 -- 172.21.15.130:0/3004373455 shutdown_connections 2023-09-13T06:06:59.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0294065b20 0x7f0294067fe0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02b4154740 0x7f02b4163180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02b4158370 0x7f02b4154200 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 --2- 172.21.15.130:0/3004373455 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f029c0039f0 0x7f02b413c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 -- 172.21.15.130:0/3004373455 >> 172.21.15.130:0/3004373455 conn(0x7f02b4065990 msgr2=0x7f02b4159a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:59.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 -- 172.21.15.130:0/3004373455 shutdown_connections 2023-09-13T06:06:59.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.440+0000 7f02b8c34640 1 -- 172.21.15.130:0/3004373455 wait complete. 2023-09-13T06:06:59.461 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-09-13T06:06:59.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.596+0000 7fe606f4d640 1 Processor -- start 2023-09-13T06:06:59.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.596+0000 7fe606f4d640 1 -- start start 2023-09-13T06:06:59.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe606f4d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe600159f20 0x7fe6000ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe606f4d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6000b1d20 0x7fe6000b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe606f4d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000ccfd0 con 0x7fe6000cdfc0 2023-09-13T06:06:59.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe606f4d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000b00f0 con 0x7fe6000b1d20 2023-09-13T06:06:59.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe606f4d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000b11d0 con 0x7fe600159f20 2023-09-13T06:06:59.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe5fffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe6000cdfc0 0x7fe6000b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60940/0 (socket says 172.21.15.130:60940) 2023-09-13T06:06:59.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe5fffff640 1 -- 172.21.15.130:0/43858106 learned_addr learned my addr 172.21.15.130:0/43858106 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:06:59.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe6054ea640 1 --2- 172.21.15.130:0/43858106 >> v2:172.21.15.130:3300/0 conn(0x7fe6000b1d20 0x7fe6000b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe604ce9640 1 --2- 172.21.15.130:0/43858106 >> v2:172.21.15.164:3300/0 conn(0x7fe600159f20 0x7fe6000ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe5ff7fe640 1 -- 172.21.15.130:0/43858106 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740239289 0 0) 0x7fe6000ccfd0 con 0x7fe6000cdfc0 2023-09-13T06:06:59.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe5ff7fe640 1 -- 172.21.15.130:0/43858106 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5f0005740 con 0x7fe6000cdfc0 2023-09-13T06:06:59.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe6054ea640 1 -- 172.21.15.130:0/43858106 >> v2:172.21.15.164:3300/0 conn(0x7fe600159f20 msgr2=0x7fe6000ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:06:59.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe6054ea640 1 --2- 172.21.15.130:0/43858106 >> v2:172.21.15.164:3300/0 conn(0x7fe600159f20 0x7fe6000ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe6054ea640 1 -- 172.21.15.130:0/43858106 >> v1:172.21.15.130:6789/0 conn(0x7fe6000cdfc0 legacy=0x7fe6000b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe6054ea640 1 -- 172.21.15.130:0/43858106 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000ced90 con 0x7fe6000b1d20 2023-09-13T06:06:59.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe604ce9640 1 --2- 172.21.15.130:0/43858106 >> v2:172.21.15.164:3300/0 conn(0x7fe600159f20 0x7fe6000ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:06:59.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.600+0000 7fe6054ea640 1 --2- 172.21.15.130:0/43858106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6000b1d20 0x7fe6000b0c90 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe6000b2660 tx=0x7fe5f801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172ea5a0923d5b53 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:59.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe5ff7fe640 1 -- 172.21.15.130:0/43858106 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80a59a0 con 0x7fe6000b1d20 2023-09-13T06:06:59.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe5ff7fe640 1 -- 172.21.15.130:0/43858106 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f80a5b00 con 0x7fe6000b1d20 2023-09-13T06:06:59.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe5ff7fe640 1 -- 172.21.15.130:0/43858106 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80a5e90 con 0x7fe6000b1d20 2023-09-13T06:06:59.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 -- 172.21.15.130:0/43858106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6000b1d20 msgr2=0x7fe6000b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 --2- 172.21.15.130:0/43858106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6000b1d20 0x7fe6000b0c90 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe6000b2660 tx=0x7fe5f801c8e0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 -- 172.21.15.130:0/43858106 shutdown_connections 2023-09-13T06:06:59.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 --2- 172.21.15.130:0/43858106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6000b1d20 0x7fe6000b0c90 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 --2- 172.21.15.130:0/43858106 >> v2:172.21.15.164:3300/0 conn(0x7fe600159f20 0x7fe6000ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 -- 172.21.15.130:0/43858106 >> 172.21.15.130:0/43858106 conn(0x7fe600065990 msgr2=0x7fe600065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:06:59.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 -- 172.21.15.130:0/43858106 shutdown_connections 2023-09-13T06:06:59.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 -- 172.21.15.130:0/43858106 wait complete. 2023-09-13T06:06:59.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 Processor -- start 2023-09-13T06:06:59.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 -- start start 2023-09-13T06:06:59.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6000b1d20 0x7fe60014abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6000cdfc0 0x7fe60014b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe600159f20 0x7fe60014b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60014a450 con 0x7fe600159f20 2023-09-13T06:06:59.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600157570 con 0x7fe6000cdfc0 2023-09-13T06:06:59.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe606f4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe600157850 con 0x7fe6000b1d20 2023-09-13T06:06:59.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe6054ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe600159f20 0x7fe60014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe6054ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe600159f20 0x7fe60014b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50708/0 (socket says 172.21.15.130:50708) 2023-09-13T06:06:59.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.604+0000 7fe6054ea640 1 -- 172.21.15.130:0/1104979166 learned_addr learned my addr 172.21.15.130:0/1104979166 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:06:59.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe604ce9640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6000b1d20 0x7fe60014abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe5fffff640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6000cdfc0 0x7fe60014b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe6054ea640 1 -- 172.21.15.130:0/1104979166 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6000b1d20 msgr2=0x7fe60014abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe6054ea640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6000b1d20 0x7fe60014abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe6054ea640 1 -- 172.21.15.130:0/1104979166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6000cdfc0 msgr2=0x7fe60014b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:06:59.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe6054ea640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6000cdfc0 0x7fe60014b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:06:59.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe6054ea640 1 -- 172.21.15.130:0/1104979166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8009a70 con 0x7fe600159f20 2023-09-13T06:06:59.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe6054ea640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe600159f20 0x7fe60014b640 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80194f0 tx=0x7fe5f8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:59.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe5fd7fa640 1 -- 172.21.15.130:0/1104979166 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80adcc0 con 0x7fe600159f20 2023-09-13T06:06:59.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe5fd7fa640 1 -- 172.21.15.130:0/1104979166 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f80ade20 con 0x7fe600159f20 2023-09-13T06:06:59.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe5fd7fa640 1 -- 172.21.15.130:0/1104979166 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80b9690 con 0x7fe600159f20 2023-09-13T06:06:59.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe606f4d640 1 -- 172.21.15.130:0/1104979166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe600157b30 con 0x7fe600159f20 2023-09-13T06:06:59.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe606f4d640 1 -- 172.21.15.130:0/1104979166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60014bb80 con 0x7fe600159f20 2023-09-13T06:06:59.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe606f4d640 1 -- 172.21.15.130:0/1104979166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6000b0c90 con 0x7fe600159f20 2023-09-13T06:06:59.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.608+0000 7fe5fd7fa640 1 -- 172.21.15.130:0/1104979166 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe5f80b97f0 con 0x7fe600159f20 2023-09-13T06:06:59.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.612+0000 7fe5fd7fa640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5e4065b20 0x7fe5e4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:06:59.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.612+0000 7fe5fd7fa640 1 -- 172.21.15.130:0/1104979166 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe5f811e820 con 0x7fe600159f20 2023-09-13T06:06:59.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.612+0000 7fe604ce9640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5e4065b20 0x7fe5e4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:06:59.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.612+0000 7fe604ce9640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5e4065b20 0x7fe5e4067fe0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400b930 tx=0x7fe5f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:06:59.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.616+0000 7fe5fd7fa640 1 -- 172.21.15.130:0/1104979166 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe5f80ec3d0 con 0x7fe600159f20 2023-09-13T06:06:59.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:06:59.812+0000 7fe606f4d640 1 -- 172.21.15.130:0/1104979166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7fe6000618a0 con 0x7fe600159f20 2023-09-13T06:07:00.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe5fd7fa640 1 -- 172.21.15.130:0/1104979166 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v308) v1 ==== 131+0+0 (secure 0 0 0) 0x7fe5f8009450 con 0x7fe600159f20 2023-09-13T06:07:00.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 -- 172.21.15.130:0/1104979166 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5e4065b20 msgr2=0x7fe5e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:00.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5e4065b20 0x7fe5e4067fe0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400b930 tx=0x7fe5f4008040 comp rx=0 tx=0).stop 2023-09-13T06:07:00.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 -- 172.21.15.130:0/1104979166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe600159f20 msgr2=0x7fe60014b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:00.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe600159f20 0x7fe60014b640 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80194f0 tx=0x7fe5f8019680 comp rx=0 tx=0).stop 2023-09-13T06:07:00.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 -- 172.21.15.130:0/1104979166 shutdown_connections 2023-09-13T06:07:00.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5e4065b20 0x7fe5e4067fe0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:00.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6000cdfc0 0x7fe60014b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:00.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe600159f20 0x7fe60014b640 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:00.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 --2- 172.21.15.130:0/1104979166 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6000b1d20 0x7fe60014abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:00.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 -- 172.21.15.130:0/1104979166 >> 172.21.15.130:0/1104979166 conn(0x7fe600065990 msgr2=0x7fe600070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:00.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 -- 172.21.15.130:0/1104979166 shutdown_connections 2023-09-13T06:07:00.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.788+0000 7fe606f4d640 1 -- 172.21.15.130:0/1104979166 wait complete. 2023-09-13T06:07:00.814 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-13T06:07:00.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.956+0000 7f75e19fa640 1 Processor -- start 2023-09-13T06:07:00.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.956+0000 7f75e19fa640 1 -- start start 2023-09-13T06:07:00.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.960+0000 7f75e19fa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f75dc0d3810 0x7f75dc0d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:00.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.960+0000 7f75e19fa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc147150 con 0x7f75dc146d70 2023-09-13T06:07:00.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.960+0000 7f75e19fa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc0d2770 con 0x7f75dc0d1930 2023-09-13T06:07:00.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.960+0000 7f75e19fa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75dc0d3c70 con 0x7f75dc0d3810 2023-09-13T06:07:00.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.960+0000 7f75daffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f75dc146d70 0x7f75dc0b6b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50058/0 (socket says 172.21.15.130:50058) 2023-09-13T06:07:00.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.960+0000 7f75daffd640 1 -- 172.21.15.130:0/3006090775 learned_addr learned my addr 172.21.15.130:0/3006090775 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:00.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.960+0000 7f75d3fff640 1 --2- 172.21.15.130:0/3006090775 >> v2:172.21.15.130:3300/0 conn(0x7f75dc0d3810 0x7f75dc0d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:00.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.960+0000 7f75d3fff640 1 -- 172.21.15.130:0/3006090775 >> v1:172.21.15.164:6789/0 conn(0x7f75dc0d1930 legacy=0x7f75dc15da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:00.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.960+0000 7f75d3fff640 1 -- 172.21.15.130:0/3006090775 >> v1:172.21.15.130:6789/0 conn(0x7f75dc146d70 legacy=0x7f75dc0b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:00.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.960+0000 7f75d3fff640 1 -- 172.21.15.130:0/3006090775 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc0d2a50 con 0x7f75dc0d3810 2023-09-13T06:07:00.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75d3fff640 1 --2- 172.21.15.130:0/3006090775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75dc0d3810 0x7f75dc0d13f0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f75c40097c0 tx=0x7f75c401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc601063dc2b5b72 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:00.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75da7fc640 1 -- 172.21.15.130:0/3006090775 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40ab600 con 0x7f75dc0d3810 2023-09-13T06:07:00.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75da7fc640 1 -- 172.21.15.130:0/3006090775 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c40a7050 con 0x7f75dc0d3810 2023-09-13T06:07:00.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75da7fc640 1 -- 172.21.15.130:0/3006090775 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40ab980 con 0x7f75dc0d3810 2023-09-13T06:07:00.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 -- 172.21.15.130:0/3006090775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75dc0d3810 msgr2=0x7f75dc0d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:00.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 --2- 172.21.15.130:0/3006090775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75dc0d3810 0x7f75dc0d13f0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f75c40097c0 tx=0x7f75c401c450 comp rx=0 tx=0).stop 2023-09-13T06:07:00.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 -- 172.21.15.130:0/3006090775 shutdown_connections 2023-09-13T06:07:00.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 --2- 172.21.15.130:0/3006090775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75dc0d3810 0x7f75dc0d13f0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:00.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 -- 172.21.15.130:0/3006090775 >> 172.21.15.130:0/3006090775 conn(0x7f75dc06f170 msgr2=0x7f75dc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:00.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 -- 172.21.15.130:0/3006090775 shutdown_connections 2023-09-13T06:07:00.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 -- 172.21.15.130:0/3006090775 wait complete. 2023-09-13T06:07:00.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 Processor -- start 2023-09-13T06:07:00.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 -- start start 2023-09-13T06:07:00.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75dc0d1930 0x7f75dc13d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:00.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75dc0d3810 0x7f75dc1326c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:00.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75dc146d70 0x7f75dc13b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:00.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc154e40 con 0x7f75dc0d3810 2023-09-13T06:07:00.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc13d9c0 con 0x7f75dc0d1930 2023-09-13T06:07:00.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.964+0000 7f75e19fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc133d70 con 0x7f75dc146d70 2023-09-13T06:07:00.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75dc0d3810 0x7f75dc1326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:00.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75dc0d3810 0x7f75dc1326c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60552/0 (socket says 172.21.15.130:60552) 2023-09-13T06:07:00.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d3fff640 1 -- 172.21.15.130:0/600723325 learned_addr learned my addr 172.21.15.130:0/600723325 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:00.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75daffd640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75dc0d1930 0x7f75dc13d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:00.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75db7fe640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75dc146d70 0x7f75dc13b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:00.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d3fff640 1 -- 172.21.15.130:0/600723325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75dc146d70 msgr2=0x7f75dc13b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:00.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d3fff640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75dc146d70 0x7f75dc13b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:00.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d3fff640 1 -- 172.21.15.130:0/600723325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75dc0d1930 msgr2=0x7f75dc13d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:00.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d3fff640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75dc0d1930 0x7f75dc13d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:00.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d3fff640 1 -- 172.21.15.130:0/600723325 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c4009420 con 0x7f75dc0d3810 2023-09-13T06:07:00.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75db7fe640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75dc146d70 0x7f75dc13b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:00.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75daffd640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75dc0d1930 0x7f75dc13d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:00.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d3fff640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75dc0d3810 0x7f75dc1326c0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f75c4019060 tx=0x7f75c401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:00.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d8ff9640 1 -- 172.21.15.130:0/600723325 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40b37d0 con 0x7f75dc0d3810 2023-09-13T06:07:00.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d8ff9640 1 -- 172.21.15.130:0/600723325 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c40b3950 con 0x7f75dc0d3810 2023-09-13T06:07:00.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75e19fa640 1 -- 172.21.15.130:0/600723325 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc134050 con 0x7f75dc0d3810 2023-09-13T06:07:00.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d8ff9640 1 -- 172.21.15.130:0/600723325 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40b3d00 con 0x7f75dc0d3810 2023-09-13T06:07:00.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75e19fa640 1 -- 172.21.15.130:0/600723325 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc142d20 con 0x7f75dc0d3810 2023-09-13T06:07:00.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75e19fa640 1 -- 172.21.15.130:0/600723325 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc134290 con 0x7f75dc0d3810 2023-09-13T06:07:00.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d8ff9640 1 -- 172.21.15.130:0/600723325 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f75c40b2070 con 0x7f75dc0d3810 2023-09-13T06:07:00.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.968+0000 7f75d8ff9640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75bc065b20 0x7f75bc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:00.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.972+0000 7f75d8ff9640 1 -- 172.21.15.130:0/600723325 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f75c411d3d0 con 0x7f75dc0d3810 2023-09-13T06:07:00.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.972+0000 7f75daffd640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75bc065b20 0x7f75bc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:00.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.972+0000 7f75daffd640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75bc065b20 0x7f75bc067fe0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f75cc005890 tx=0x7f75cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:00.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:00.972+0000 7f75d8ff9640 1 -- 172.21.15.130:0/600723325 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f75dc134290 con 0x7f75dc0d3810 2023-09-13T06:07:01.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.120+0000 7f75e19fa640 1 -- 172.21.15.130:0/600723325 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f75dc1428a0 con 0x7f75dc0d3810 2023-09-13T06:07:01.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.124+0000 7f75d8ff9640 1 -- 172.21.15.130:0/600723325 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f75dc1428a0 con 0x7f75dc0d3810 2023-09-13T06:07:01.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 -- 172.21.15.130:0/600723325 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75bc065b20 msgr2=0x7f75bc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75bc065b20 0x7f75bc067fe0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f75cc005890 tx=0x7f75cc009040 comp rx=0 tx=0).stop 2023-09-13T06:07:01.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 -- 172.21.15.130:0/600723325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75dc0d3810 msgr2=0x7f75dc1326c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75dc0d3810 0x7f75dc1326c0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f75c4019060 tx=0x7f75c401ac90 comp rx=0 tx=0).stop 2023-09-13T06:07:01.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 -- 172.21.15.130:0/600723325 shutdown_connections 2023-09-13T06:07:01.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f75bc065b20 0x7f75bc067fe0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75dc146d70 0x7f75dc13b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75dc0d3810 0x7f75dc1326c0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 --2- 172.21.15.130:0/600723325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75dc0d1930 0x7f75dc13d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 -- 172.21.15.130:0/600723325 >> 172.21.15.130:0/600723325 conn(0x7f75dc06f170 msgr2=0x7f75dc0cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:01.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 -- 172.21.15.130:0/600723325 shutdown_connections 2023-09-13T06:07:01.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.128+0000 7f75e19fa640 1 -- 172.21.15.130:0/600723325 wait complete. 2023-09-13T06:07:01.149 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:07:01.150 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:07:01.215 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:07:01.277 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:07:01.277 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:07:01.278 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:01.287 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:07:01.287 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:07:01.288 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:01.297 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:07:01.298 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:07:01.298 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:01.336 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:07:01.336 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:07:01.337 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:01.346 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:07:01.346 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-13T06:07:01.347 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:01.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5872bba640 1 Processor -- start 2023-09-13T06:07:01.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5872bba640 1 -- start start 2023-09-13T06:07:01.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5872bba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ce1a0 0x7f586c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5872bba640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586c070e70 con 0x7f586c15d260 2023-09-13T06:07:01.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5872bba640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586c070280 con 0x7f586c0afc70 2023-09-13T06:07:01.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5872bba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c070540 con 0x7f586c0ce1a0 2023-09-13T06:07:01.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5870956640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f586c15d260 0x7f586c0b5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50068/0 (socket says 172.21.15.130:50068) 2023-09-13T06:07:01.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5870956640 1 -- 172.21.15.130:0/2530340333 learned_addr learned my addr 172.21.15.130:0/2530340333 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:01.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083083710 0 0) 0x7f586c070e70 con 0x7f586c15d260 2023-09-13T06:07:01.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586bfff640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ce1a0 0x7f586c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f585c003530 con 0x7f586c15d260 2023-09-13T06:07:01.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1070767226 0 0) 0x7f585c003530 con 0x7f586c15d260 2023-09-13T06:07:01.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ce1a0 msgr2=0x7f586c06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:01.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ce1a0 0x7f586c06d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 >> v1:172.21.15.164:6789/0 conn(0x7f586c0afc70 legacy=0x7f586c071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c070820 con 0x7f586c15d260 2023-09-13T06:07:01.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f5860001680 con 0x7f586c15d260 2023-09-13T06:07:01.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 >> v1:172.21.15.130:6789/0 conn(0x7f586c15d260 legacy=0x7f586c0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ce1a0 0x7f585c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f585c003fa0 0x7f585c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c004d10 0x7f585c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c070540 con 0x7f585c004d10 2023-09-13T06:07:01.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c00baf0 con 0x7f585c003fa0 2023-09-13T06:07:01.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c00bcb0 con 0x7f586c0ce1a0 2023-09-13T06:07:01.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5871157640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c004d10 0x7f585c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5870956640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ce1a0 0x7f585c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586bfff640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f585c003fa0 0x7f585c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5871157640 1 -- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ce1a0 msgr2=0x7f585c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:01.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5871157640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ce1a0 0x7f585c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5871157640 1 -- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f585c003fa0 msgr2=0x7f585c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:01.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5871157640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f585c003fa0 0x7f585c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5871157640 1 -- 172.21.15.130:0/2530340333 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c003530 con 0x7f585c004d10 2023-09-13T06:07:01.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f586bfff640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f585c003fa0 0x7f585c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:01.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.516+0000 7f5870956640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ce1a0 0x7f585c003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:01.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.520+0000 7f5871157640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c004d10 0x7f585c005190 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5864001e70 tx=0x7f586401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd587044fd1b999 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:01.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.520+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864003b80 con 0x7f585c004d10 2023-09-13T06:07:01.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.520+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5864003ce0 con 0x7f585c004d10 2023-09-13T06:07:01.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.520+0000 7f586b7fe640 1 -- 172.21.15.130:0/2530340333 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640052c0 con 0x7f585c004d10 2023-09-13T06:07:01.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.520+0000 7f5872bba640 1 -- 172.21.15.130:0/2530340333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c004d10 msgr2=0x7f585c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.520+0000 7f5872bba640 1 --2- 172.21.15.130:0/2530340333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f585c004d10 0x7f585c005190 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5864001e70 tx=0x7f586401c760 comp rx=0 tx=0).stop 2023-09-13T06:07:01.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.520+0000 7f5871157640 1 -- 172.21.15.130:0/2530340333 reap_dead start 2023-09-13T06:07:01.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.520+0000 7f5872bba640 1 -- 172.21.15.130:0/2530340333 shutdown_connections 2023-09-13T06:07:01.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.520+0000 7f5872bba640 1 -- 172.21.15.130:0/2530340333 >> 172.21.15.130:0/2530340333 conn(0x7f586c06a2f0 msgr2=0x7f586c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:01.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.520+0000 7f5872bba640 1 -- 172.21.15.130:0/2530340333 shutdown_connections 2023-09-13T06:07:01.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.520+0000 7f5872bba640 1 -- 172.21.15.130:0/2530340333 wait complete. 2023-09-13T06:07:01.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5872bba640 1 Processor -- start 2023-09-13T06:07:01.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5872bba640 1 -- start start 2023-09-13T06:07:01.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5872bba640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f585c004d10 0x7f586c1f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5872bba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ca6b0 0x7f586c0cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5872bba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f586c1464e0 0x7f586c146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5872bba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c0cb070 con 0x7f586c1464e0 2023-09-13T06:07:01.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5872bba640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c1471a0 con 0x7f585c004d10 2023-09-13T06:07:01.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5872bba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c147480 con 0x7f586c0ca6b0 2023-09-13T06:07:01.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5871157640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f586c1464e0 0x7f586c146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5871157640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f586c1464e0 0x7f586c146960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60574/0 (socket says 172.21.15.130:60574) 2023-09-13T06:07:01.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5871157640 1 -- 172.21.15.130:0/2246097683 learned_addr learned my addr 172.21.15.130:0/2246097683 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:01.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f586bfff640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ca6b0 0x7f586c0cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5870956640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f585c004d10 0x7f586c1f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5871157640 1 -- 172.21.15.130:0/2246097683 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ca6b0 msgr2=0x7f586c0cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5871157640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ca6b0 0x7f586c0cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5871157640 1 -- 172.21.15.130:0/2246097683 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f585c004d10 msgr2=0x7f586c1f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5871157640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f585c004d10 0x7f586c1f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5871157640 1 -- 172.21.15.130:0/2246097683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c15ebc0 con 0x7f586c1464e0 2023-09-13T06:07:01.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5871157640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f586c1464e0 0x7f586c146960 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f586401cc40 tx=0x7f585c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:01.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f58697fa640 1 -- 172.21.15.130:0/2246097683 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864006d60 con 0x7f586c1464e0 2023-09-13T06:07:01.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f58697fa640 1 -- 172.21.15.130:0/2246097683 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5864005820 con 0x7f586c1464e0 2023-09-13T06:07:01.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5872bba640 1 -- 172.21.15.130:0/2246097683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586c15eea0 con 0x7f586c1464e0 2023-09-13T06:07:01.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f58697fa640 1 -- 172.21.15.130:0/2246097683 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864007230 con 0x7f586c1464e0 2023-09-13T06:07:01.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.524+0000 7f5872bba640 1 -- 172.21.15.130:0/2246097683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586c1f70d0 con 0x7f586c1464e0 2023-09-13T06:07:01.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.528+0000 7f5872bba640 1 -- 172.21.15.130:0/2246097683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586c15ea20 con 0x7f586c1464e0 2023-09-13T06:07:01.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.528+0000 7f58697fa640 1 -- 172.21.15.130:0/2246097683 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5864007390 con 0x7f586c1464e0 2023-09-13T06:07:01.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.528+0000 7f58697fa640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5850065b50 0x7f5850068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.528+0000 7f58697fa640 1 -- 172.21.15.130:0/2246097683 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f586411ce50 con 0x7f586c1464e0 2023-09-13T06:07:01.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.528+0000 7f5870956640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5850065b50 0x7f5850068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.528+0000 7f5870956640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5850065b50 0x7f5850068010 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5860005a80 tx=0x7f5860009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:01.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.532+0000 7f58697fa640 1 -- 172.21.15.130:0/2246097683 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f586c15ea20 con 0x7f586c1464e0 2023-09-13T06:07:01.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.712+0000 7f5872bba640 1 -- 172.21.15.130:0/2246097683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f586c15ea20 con 0x7f586c1464e0 2023-09-13T06:07:01.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.712+0000 7f58697fa640 1 -- 172.21.15.130:0/2246097683 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f586c15ea20 con 0x7f586c1464e0 2023-09-13T06:07:01.716 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:01.716 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/3211692360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3211692360},{"type":"v1","addr":"172.21.15.164:6834","nonce":3211692360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2453731046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2453731046},{"type":"v1","addr":"172.21.15.130:6835","nonce":2453731046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":6394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2896649577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2896649577},{"type":"v1","addr":"172.21.15.164:6835","nonce":2896649577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/3664669776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":3664669776},{"type":"v1","addr":"172.21.15.130:6837","nonce":3664669776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[]} 2023-09-13T06:07:01.717 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 53 2023-09-13T06:07:01.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 -- 172.21.15.130:0/2246097683 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5850065b50 msgr2=0x7f5850068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5850065b50 0x7f5850068010 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5860005a80 tx=0x7f5860009040 comp rx=0 tx=0).stop 2023-09-13T06:07:01.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 -- 172.21.15.130:0/2246097683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f586c1464e0 msgr2=0x7f586c146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f586c1464e0 0x7f586c146960 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f586401cc40 tx=0x7f585c005800 comp rx=0 tx=0).stop 2023-09-13T06:07:01.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 -- 172.21.15.130:0/2246097683 shutdown_connections 2023-09-13T06:07:01.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5850065b50 0x7f5850068010 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f586c1464e0 0x7f586c146960 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f586c0ca6b0 0x7f586c0cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 --2- 172.21.15.130:0/2246097683 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f585c004d10 0x7f586c1f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 -- 172.21.15.130:0/2246097683 >> 172.21.15.130:0/2246097683 conn(0x7f586c06a2f0 msgr2=0x7f586c0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:01.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 -- 172.21.15.130:0/2246097683 shutdown_connections 2023-09-13T06:07:01.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.716+0000 7f5872bba640 1 -- 172.21.15.130:0/2246097683 wait complete. 2023-09-13T06:07:01.737 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T06:07:01.738 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-13T06:07:01.738 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T06:07:01.738 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:07:01.739 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T06:07:01.739 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-13T06:07:01.739 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T06:07:01.739 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:07:01.740 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T06:07:01.740 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-13T06:07:01.740 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T06:07:01.740 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:07:01.741 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T06:07:01.741 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-13T06:07:01.741 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T06:07:01.741 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:07:01.751 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T06:07:01.752 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T06:07:01.753 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T06:07:01.754 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T06:07:01.756 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T06:07:01.756 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T06:07:01.757 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T06:07:01.757 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T06:07:01.799 INFO:tasks.ceph.mds.a:Started 2023-09-13T06:07:01.800 DEBUG:teuthology.parallel:result is None 2023-09-13T06:07:01.801 INFO:tasks.ceph.mds.b:Started 2023-09-13T06:07:01.801 DEBUG:teuthology.parallel:result is None 2023-09-13T06:07:01.802 INFO:tasks.ceph.mds.c:Started 2023-09-13T06:07:01.803 DEBUG:teuthology.parallel:result is None 2023-09-13T06:07:01.803 INFO:tasks.ceph.mds.d:Started 2023-09-13T06:07:01.804 DEBUG:teuthology.parallel:result is None 2023-09-13T06:07:01.804 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-13T06:07:01.888 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:07:01.891 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:07:01.893 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:07:01.894 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:07:01.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.948+0000 7f2c14967640 1 Processor -- start 2023-09-13T06:07:01.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.948+0000 7f2c14967640 1 -- start start 2023-09-13T06:07:01.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c14967640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2c1015d5f0 0x7f2c100cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c14967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c100ae170 0x7f2c100cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c14967640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2c1015d9d0 0x7f2c101591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c14967640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c100cce60 con 0x7f2c1015d5f0 2023-09-13T06:07:01.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c14967640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c100cd140 con 0x7f2c1015d9d0 2023-09-13T06:07:01.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c14967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100cd420 con 0x7f2c100ae170 2023-09-13T06:07:01.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c0e59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2c1015d5f0 0x7f2c100cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c0e59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2c1015d5f0 0x7f2c100cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60604/0 (socket says 172.21.15.130:60604) 2023-09-13T06:07:01.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c0e59c640 1 -- 172.21.15.130:0/3572985521 learned_addr learned my addr 172.21.15.130:0/3572985521 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:01.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c05d9b640 1 --2- 172.21.15.130:0/3572985521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c100ae170 0x7f2c100cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c0ed9d640 1 --2- 172.21.15.130:0/3572985521 >> v2:172.21.15.164:3300/0 conn(0x7f2c1015d9d0 0x7f2c101591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c0e59c640 1 -- 172.21.15.130:0/3572985521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c100ae170 msgr2=0x7f2c100cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:01.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c0e59c640 1 --2- 172.21.15.130:0/3572985521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c100ae170 0x7f2c100cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c0e59c640 1 -- 172.21.15.130:0/3572985521 >> v2:172.21.15.164:3300/0 conn(0x7f2c1015d9d0 msgr2=0x7f2c101591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:01.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c0e59c640 1 --2- 172.21.15.130:0/3572985521 >> v2:172.21.15.164:3300/0 conn(0x7f2c1015d9d0 0x7f2c101591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c0e59c640 1 -- 172.21.15.130:0/3572985521 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100cd700 con 0x7f2c1015d5f0 2023-09-13T06:07:01.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.952+0000 7f2c0e59c640 1 --2- 172.21.15.130:0/3572985521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c1015d5f0 0x7f2c100cc7f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f2c100b28c0 tx=0x7f2bf801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baffa667e0101f11 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:01.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c0dd9b640 1 -- 172.21.15.130:0/3572985521 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80ab600 con 0x7f2c1015d5f0 2023-09-13T06:07:01.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c0dd9b640 1 -- 172.21.15.130:0/3572985521 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf80a7050 con 0x7f2c1015d5f0 2023-09-13T06:07:01.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c0dd9b640 1 -- 172.21.15.130:0/3572985521 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80ab980 con 0x7f2c1015d5f0 2023-09-13T06:07:01.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 -- 172.21.15.130:0/3572985521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c1015d5f0 msgr2=0x7f2c100cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 --2- 172.21.15.130:0/3572985521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c1015d5f0 0x7f2c100cc7f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f2c100b28c0 tx=0x7f2bf801c470 comp rx=0 tx=0).stop 2023-09-13T06:07:01.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 -- 172.21.15.130:0/3572985521 shutdown_connections 2023-09-13T06:07:01.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 --2- 172.21.15.130:0/3572985521 >> v2:172.21.15.164:3300/0 conn(0x7f2c1015d9d0 0x7f2c101591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 --2- 172.21.15.130:0/3572985521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c100ae170 0x7f2c100cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 --2- 172.21.15.130:0/3572985521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c1015d5f0 0x7f2c100cc7f0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 -- 172.21.15.130:0/3572985521 >> 172.21.15.130:0/3572985521 conn(0x7f2c10065990 msgr2=0x7f2c10065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:01.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 -- 172.21.15.130:0/3572985521 shutdown_connections 2023-09-13T06:07:01.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 -- 172.21.15.130:0/3572985521 wait complete. 2023-09-13T06:07:01.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 Processor -- start 2023-09-13T06:07:01.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 -- start start 2023-09-13T06:07:01.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c100ae170 0x7f2c1013db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c1015d5f0 0x7f2c100abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c1015d9d0 0x7f2c100ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1013e0d0 con 0x7f2c100ae170 2023-09-13T06:07:01.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100ac970 con 0x7f2c1015d5f0 2023-09-13T06:07:01.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.956+0000 7f2c14967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100acc50 con 0x7f2c1015d9d0 2023-09-13T06:07:01.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c0e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c100ae170 0x7f2c1013db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c0e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c100ae170 0x7f2c1013db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60614/0 (socket says 172.21.15.130:60614) 2023-09-13T06:07:01.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c0e59c640 1 -- 172.21.15.130:0/3230151285 learned_addr learned my addr 172.21.15.130:0/3230151285 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:01.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c05d9b640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c1015d5f0 0x7f2c100abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c0ed9d640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c1015d9d0 0x7f2c100ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c0e59c640 1 -- 172.21.15.130:0/3230151285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c1015d9d0 msgr2=0x7f2c100ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c0e59c640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c1015d9d0 0x7f2c100ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c0e59c640 1 -- 172.21.15.130:0/3230151285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c1015d5f0 msgr2=0x7f2c100abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:01.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c0e59c640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c1015d5f0 0x7f2c100abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:01.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c0e59c640 1 -- 172.21.15.130:0/3230151285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf80094d0 con 0x7f2c100ae170 2023-09-13T06:07:01.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c0e59c640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c100ae170 0x7f2c1013db90 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80ae040 tx=0x7f2bf8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:01.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c077fe640 1 -- 172.21.15.130:0/3230151285 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80b4620 con 0x7f2c100ae170 2023-09-13T06:07:01.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c077fe640 1 -- 172.21.15.130:0/3230151285 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf80b4780 con 0x7f2c100ae170 2023-09-13T06:07:01.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c14967640 1 -- 172.21.15.130:0/3230151285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c100acf30 con 0x7f2c100ae170 2023-09-13T06:07:01.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c077fe640 1 -- 172.21.15.130:0/3230151285 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80b4b30 con 0x7f2c100ae170 2023-09-13T06:07:01.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c14967640 1 -- 172.21.15.130:0/3230151285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1014f760 con 0x7f2c100ae170 2023-09-13T06:07:01.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c14967640 1 -- 172.21.15.130:0/3230151285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1014f950 con 0x7f2c100ae170 2023-09-13T06:07:01.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.960+0000 7f2c077fe640 1 -- 172.21.15.130:0/3230151285 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2bf80ba020 con 0x7f2c100ae170 2023-09-13T06:07:01.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.964+0000 7f2c077fe640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2bf0065b20 0x7f2bf0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:01.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.964+0000 7f2c077fe640 1 -- 172.21.15.130:0/3230151285 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2bf8120850 con 0x7f2c100ae170 2023-09-13T06:07:01.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.964+0000 7f2c05d9b640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2bf0065b20 0x7f2bf0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:01.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.964+0000 7f2c05d9b640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2bf0065b20 0x7f2bf0067fe0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2c1006d5b0 tx=0x7f2c00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:01.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:01.968+0000 7f2c077fe640 1 -- 172.21.15.130:0/3230151285 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2bf80ee5d0 con 0x7f2c100ae170 2023-09-13T06:07:02.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:02.128+0000 7f2c14967640 1 -- 172.21.15.130:0/3230151285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2c100618a0 con 0x7f2c100ae170 2023-09-13T06:07:03.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.392+0000 7f2c077fe640 1 -- 172.21.15.130:0/3230151285 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v119) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2bf80b0020 con 0x7f2c100ae170 2023-09-13T06:07:03.395 INFO:teuthology.orchestra.run.smithi130.stderr: removed all blocklist entries 2023-09-13T06:07:03.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 -- 172.21.15.130:0/3230151285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2bf0065b20 msgr2=0x7f2bf0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:03.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2bf0065b20 0x7f2bf0067fe0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2c1006d5b0 tx=0x7f2c00008040 comp rx=0 tx=0).stop 2023-09-13T06:07:03.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 -- 172.21.15.130:0/3230151285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c100ae170 msgr2=0x7f2c1013db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:03.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c100ae170 0x7f2c1013db90 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80ae040 tx=0x7f2bf8019210 comp rx=0 tx=0).stop 2023-09-13T06:07:03.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 -- 172.21.15.130:0/3230151285 shutdown_connections 2023-09-13T06:07:03.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2bf0065b20 0x7f2bf0067fe0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c1015d5f0 0x7f2c100abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c1015d9d0 0x7f2c100ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 --2- 172.21.15.130:0/3230151285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c100ae170 0x7f2c1013db90 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 -- 172.21.15.130:0/3230151285 >> 172.21.15.130:0/3230151285 conn(0x7f2c10065990 msgr2=0x7f2c100ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:03.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 -- 172.21.15.130:0/3230151285 shutdown_connections 2023-09-13T06:07:03.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.396+0000 7f2c14967640 1 -- 172.21.15.130:0/3230151285 wait complete. 2023-09-13T06:07:03.421 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-13T06:07:03.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f5d7ac640 1 Processor -- start 2023-09-13T06:07:03.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f5d7ac640 1 -- start start 2023-09-13T06:07:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f5d7ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f580b2da0 0x7f4f5806f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f5d7ac640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4f5806fc70 0x7f4f580ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f5d7ac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4f580cf0d0 0x7f4f581429c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f5d7ac640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5815e660 con 0x7f4f580cf0d0 2023-09-13T06:07:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f5d7ac640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f580cf4e0 con 0x7f4f5806fc70 2023-09-13T06:07:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f5d7ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5815d9e0 con 0x7f4f580b2da0 2023-09-13T06:07:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f577fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4f580cf0d0 0x7f4f581429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f577fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4f580cf0d0 0x7f4f581429c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60622/0 (socket says 172.21.15.130:60622) 2023-09-13T06:07:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f577fe640 1 -- 172.21.15.130:0/3672060434 learned_addr learned my addr 172.21.15.130:0/3672060434 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:03.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f56ffd640 1 --2- 172.21.15.130:0/3672060434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f580b2da0 0x7f4f5806f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.560+0000 7f4f4e7fc640 1 --2- 172.21.15.130:0/3672060434 >> v2:172.21.15.164:3300/0 conn(0x7f4f5806fc70 0x7f4f580ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f577fe640 1 -- 172.21.15.130:0/3672060434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f580b2da0 msgr2=0x7f4f5806f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:03.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f577fe640 1 --2- 172.21.15.130:0/3672060434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f580b2da0 0x7f4f5806f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f577fe640 1 -- 172.21.15.130:0/3672060434 >> v2:172.21.15.164:3300/0 conn(0x7f4f5806fc70 msgr2=0x7f4f580ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:03.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f577fe640 1 --2- 172.21.15.130:0/3672060434 >> v2:172.21.15.164:3300/0 conn(0x7f4f5806fc70 0x7f4f580ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f577fe640 1 -- 172.21.15.130:0/3672060434 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5815dcc0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f577fe640 1 --2- 172.21.15.130:0/3672060434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f580cf0d0 0x7f4f581429c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4f58073990 tx=0x7f4f5001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7379b031a6580180 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:03.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f567fc640 1 -- 172.21.15.130:0/3672060434 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f500a89b0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f567fc640 1 -- 172.21.15.130:0/3672060434 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f500a8b10 con 0x7f4f580cf0d0 2023-09-13T06:07:03.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f567fc640 1 -- 172.21.15.130:0/3672060434 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f500a8ea0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/3672060434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f580cf0d0 msgr2=0x7f4f581429c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:03.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f5d7ac640 1 --2- 172.21.15.130:0/3672060434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f580cf0d0 0x7f4f581429c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4f58073990 tx=0x7f4f5001ecf0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/3672060434 shutdown_connections 2023-09-13T06:07:03.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f5d7ac640 1 --2- 172.21.15.130:0/3672060434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f580cf0d0 0x7f4f581429c0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f5d7ac640 1 --2- 172.21.15.130:0/3672060434 >> v2:172.21.15.164:3300/0 conn(0x7f4f5806fc70 0x7f4f580ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f5d7ac640 1 --2- 172.21.15.130:0/3672060434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f580b2da0 0x7f4f5806f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.564+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/3672060434 >> 172.21.15.130:0/3672060434 conn(0x7f4f5806a2f0 msgr2=0x7f4f5806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:03.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/3672060434 shutdown_connections 2023-09-13T06:07:03.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/3672060434 wait complete. 2023-09-13T06:07:03.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f5d7ac640 1 Processor -- start 2023-09-13T06:07:03.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f5d7ac640 1 -- start start 2023-09-13T06:07:03.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f5d7ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f5806fc70 0x7f4f5813dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f5d7ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f580b2da0 0x7f4f5815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f5d7ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f580cf0d0 0x7f4f5813ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f5d7ac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f580b0c40 con 0x7f4f580cf0d0 2023-09-13T06:07:03.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f5d7ac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f580b0f20 con 0x7f4f580b2da0 2023-09-13T06:07:03.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f5d7ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f580b1200 con 0x7f4f5806fc70 2023-09-13T06:07:03.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f577fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f580cf0d0 0x7f4f5813ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f577fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f580cf0d0 0x7f4f5813ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60636/0 (socket says 172.21.15.130:60636) 2023-09-13T06:07:03.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f577fe640 1 -- 172.21.15.130:0/183368434 learned_addr learned my addr 172.21.15.130:0/183368434 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:03.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f56ffd640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f5806fc70 0x7f4f5813dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f4e7fc640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f580b2da0 0x7f4f5815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f577fe640 1 -- 172.21.15.130:0/183368434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f5806fc70 msgr2=0x7f4f5813dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:03.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f577fe640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f5806fc70 0x7f4f5813dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f577fe640 1 -- 172.21.15.130:0/183368434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f580b2da0 msgr2=0x7f4f5815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:03.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f577fe640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f580b2da0 0x7f4f5815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f577fe640 1 -- 172.21.15.130:0/183368434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f500094d0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.568+0000 7f4f577fe640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f580cf0d0 0x7f4f5813ed60 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4f500b3040 tx=0x7f4f5001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:03.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.572+0000 7f4f4ffff640 1 -- 172.21.15.130:0/183368434 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f500b0de0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.572+0000 7f4f4ffff640 1 -- 172.21.15.130:0/183368434 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f500bb460 con 0x7f4f580cf0d0 2023-09-13T06:07:03.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.572+0000 7f4f4ffff640 1 -- 172.21.15.130:0/183368434 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f500bb810 con 0x7f4f580cf0d0 2023-09-13T06:07:03.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.572+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/183368434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f580b14e0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.572+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/183368434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f580b1aa0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.572+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/183368434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f580618a0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.572+0000 7f4f4ffff640 1 -- 172.21.15.130:0/183368434 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4f500b83f0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.572+0000 7f4f4ffff640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f38065b20 0x7f4f38067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.572+0000 7f4f4ffff640 1 -- 172.21.15.130:0/183368434 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4f501208d0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.572+0000 7f4f56ffd640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f38065b20 0x7f4f38067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.572+0000 7f4f56ffd640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f38065b20 0x7f4f38067fe0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800b9d0 tx=0x7f4f48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:03.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.576+0000 7f4f4ffff640 1 -- 172.21.15.130:0/183368434 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4f500ee4d0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/183368434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4f580cfbd0 con 0x7f4f580cf0d0 2023-09-13T06:07:03.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f4ffff640 1 -- 172.21.15.130:0/183368434 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4f500c0090 con 0x7f4f580cf0d0 2023-09-13T06:07:03.778 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:03.778 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:07:03.778 INFO:teuthology.orchestra.run.smithi130.stdout: "auth_dump": [ 2023-09-13T06:07:03.778 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.779 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.a", 2023-09-13T06:07:03.779 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw==", 2023-09-13T06:07:03.779 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.779 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:03.779 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:07:03.779 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:07:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.b", 2023-09-13T06:07:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg==", 2023-09-13T06:07:03.781 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.781 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:03.781 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:07:03.781 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:07:03.781 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.c", 2023-09-13T06:07:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A==", 2023-09-13T06:07:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.783 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:03.783 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:07:03.783 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:07:03.783 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.783 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.784 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.d", 2023-09-13T06:07:03.784 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg==", 2023-09-13T06:07:03.784 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.784 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:03.785 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:07:03.785 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:07:03.785 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.785 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.786 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.0", 2023-09-13T06:07:03.786 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw==", 2023-09-13T06:07:03.786 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.786 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:03.786 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.1", 2023-09-13T06:07:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ==", 2023-09-13T06:07:03.788 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.788 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:03.788 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:03.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.788 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.789 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.2", 2023-09-13T06:07:03.789 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw==", 2023-09-13T06:07:03.789 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.789 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.3", 2023-09-13T06:07:03.791 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g==", 2023-09-13T06:07:03.791 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.791 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:03.791 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:03.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.4", 2023-09-13T06:07:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ==", 2023-09-13T06:07:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.793 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:03.793 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:03.793 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.793 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.5", 2023-09-13T06:07:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw==", 2023-09-13T06:07:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:03.795 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.795 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.795 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.6", 2023-09-13T06:07:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA==", 2023-09-13T06:07:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.797 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.7", 2023-09-13T06:07:03.797 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA==", 2023-09-13T06:07:03.797 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.797 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:03.798 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:03.798 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.798 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.799 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.0", 2023-09-13T06:07:03.799 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA==", 2023-09-13T06:07:03.799 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.799 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:03.800 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow r", 2023-09-13T06:07:03.800 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-13T06:07:03.800 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.801 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.1", 2023-09-13T06:07:03.801 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg==", 2023-09-13T06:07:03.801 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.801 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:03.801 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:07:03.801 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:07:03.802 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:07:03.802 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.802 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.2", 2023-09-13T06:07:03.803 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw==", 2023-09-13T06:07:03.803 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.803 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:03.803 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:07:03.803 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:07:03.803 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:07:03.804 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.804 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.3", 2023-09-13T06:07:03.804 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA==", 2023-09-13T06:07:03.805 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.805 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:03.805 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:07:03.805 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:07:03.805 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:07:03.805 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.806 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.admin", 2023-09-13T06:07:03.806 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQANUAFl5ccJOBAAP4KJItnG8vNd5OP/63ai0g==", 2023-09-13T06:07:03.806 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.807 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:07:03.807 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:07:03.807 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:07:03.807 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.807 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.808 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.x", 2023-09-13T06:07:03.808 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ==", 2023-09-13T06:07:03.808 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.808 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:07:03.809 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:07:03.809 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.809 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:03.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:03.809 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.y", 2023-09-13T06:07:03.810 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA==", 2023-09-13T06:07:03.810 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:03.810 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:07:03.810 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:07:03.810 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:03.810 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.811 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:03.811 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:03.811 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:07:03.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/183368434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f38065b20 msgr2=0x7f4f38067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:03.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f38065b20 0x7f4f38067fe0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800b9d0 tx=0x7f4f48008040 comp rx=0 tx=0).stop 2023-09-13T06:07:03.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/183368434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f580cf0d0 msgr2=0x7f4f5813ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:03.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f580cf0d0 0x7f4f5813ed60 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4f500b3040 tx=0x7f4f5001ba90 comp rx=0 tx=0).stop 2023-09-13T06:07:03.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/183368434 shutdown_connections 2023-09-13T06:07:03.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f38065b20 0x7f4f38067fe0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f580b2da0 0x7f4f5815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f580cf0d0 0x7f4f5813ed60 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 --2- 172.21.15.130:0/183368434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f5806fc70 0x7f4f5813dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/183368434 >> 172.21.15.130:0/183368434 conn(0x7f4f5806a2f0 msgr2=0x7f4f580c2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:03.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/183368434 shutdown_connections 2023-09-13T06:07:03.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.776+0000 7f4f5d7ac640 1 -- 172.21.15.130:0/183368434 wait complete. 2023-09-13T06:07:03.815 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:03.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6e3a3640 1 Processor -- start 2023-09-13T06:07:03.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6e3a3640 1 -- start start 2023-09-13T06:07:03.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6e3a3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff680d1750 0x7eff6815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6e3a3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff68146f30 0x7eff680b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6e3a3640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff680b63c0 con 0x7eff680d1090 2023-09-13T06:07:03.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6e3a3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6815dea0 con 0x7eff68146f30 2023-09-13T06:07:03.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6e3a3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff680d0c20 con 0x7eff680d1750 2023-09-13T06:07:03.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6c940640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff68146f30 0x7eff680b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6c940640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff68146f30 0x7eff680b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60638/0 (socket says 172.21.15.130:60638) 2023-09-13T06:07:03.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6c940640 1 -- 172.21.15.130:0/2893974129 learned_addr learned my addr 172.21.15.130:0/2893974129 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:03.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff67fff640 1 --2- 172.21.15.130:0/2893974129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff680d1750 0x7eff6815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6c940640 1 -- 172.21.15.130:0/2893974129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff680d1750 msgr2=0x7eff6815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:03.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6c940640 1 --2- 172.21.15.130:0/2893974129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff680d1750 0x7eff6815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6c940640 1 -- 172.21.15.130:0/2893974129 >> v1:172.21.15.164:6789/0 conn(0x7eff680d1090 legacy=0x7eff68146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:03.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.952+0000 7eff6c940640 1 -- 172.21.15.130:0/2893974129 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff680b6610 con 0x7eff68146f30 2023-09-13T06:07:03.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff6c940640 1 --2- 172.21.15.130:0/2893974129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff68146f30 0x7eff680b70f0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7eff60009e50 tx=0x7eff6001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee9e55c5ffd7342 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:03.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff66ffd640 1 -- 172.21.15.130:0/2893974129 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600a58a0 con 0x7eff68146f30 2023-09-13T06:07:03.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff66ffd640 1 -- 172.21.15.130:0/2893974129 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff600a5a00 con 0x7eff68146f30 2023-09-13T06:07:03.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff66ffd640 1 -- 172.21.15.130:0/2893974129 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600a5d90 con 0x7eff68146f30 2023-09-13T06:07:03.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff6e3a3640 1 -- 172.21.15.130:0/2893974129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff68146f30 msgr2=0x7eff680b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:03.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff6e3a3640 1 --2- 172.21.15.130:0/2893974129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff68146f30 0x7eff680b70f0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7eff60009e50 tx=0x7eff6001c9e0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff6e3a3640 1 -- 172.21.15.130:0/2893974129 shutdown_connections 2023-09-13T06:07:03.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff6e3a3640 1 --2- 172.21.15.130:0/2893974129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff68146f30 0x7eff680b70f0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff6e3a3640 1 --2- 172.21.15.130:0/2893974129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff680d1750 0x7eff6815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff6e3a3640 1 -- 172.21.15.130:0/2893974129 >> 172.21.15.130:0/2893974129 conn(0x7eff6806f170 msgr2=0x7eff6806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:03.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff6e3a3640 1 -- 172.21.15.130:0/2893974129 shutdown_connections 2023-09-13T06:07:03.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.956+0000 7eff6e3a3640 1 -- 172.21.15.130:0/2893974129 wait complete. 2023-09-13T06:07:03.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6e3a3640 1 Processor -- start 2023-09-13T06:07:03.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6e3a3640 1 -- start start 2023-09-13T06:07:03.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6e3a3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff680d1090 0x7eff6815c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6e3a3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff680d1750 0x7eff681640d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6e3a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff68146f30 0x7eff68164610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6e3a3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff68145690 con 0x7eff68146f30 2023-09-13T06:07:03.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6e3a3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6815cea0 con 0x7eff680d1090 2023-09-13T06:07:03.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6e3a3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff68144630 con 0x7eff680d1750 2023-09-13T06:07:03.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6c940640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff68146f30 0x7eff68164610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6c940640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff68146f30 0x7eff68164610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60646/0 (socket says 172.21.15.130:60646) 2023-09-13T06:07:03.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6c940640 1 -- 172.21.15.130:0/1264140175 learned_addr learned my addr 172.21.15.130:0/1264140175 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:03.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff677fe640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff680d1750 0x7eff681640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff67fff640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff680d1090 0x7eff6815c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6c940640 1 -- 172.21.15.130:0/1264140175 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff680d1750 msgr2=0x7eff681640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:03.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6c940640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff680d1750 0x7eff681640d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6c940640 1 -- 172.21.15.130:0/1264140175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff680d1090 msgr2=0x7eff6815c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:03.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6c940640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff680d1090 0x7eff6815c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:03.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6c940640 1 -- 172.21.15.130:0/1264140175 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff60009b30 con 0x7eff68146f30 2023-09-13T06:07:03.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff67fff640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff680d1090 0x7eff6815c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:03.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6c940640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff68146f30 0x7eff68164610 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7eff600af040 tx=0x7eff60019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:03.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff64ff9640 1 -- 172.21.15.130:0/1264140175 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600b8640 con 0x7eff68146f30 2023-09-13T06:07:03.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff64ff9640 1 -- 172.21.15.130:0/1264140175 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff600b87a0 con 0x7eff68146f30 2023-09-13T06:07:03.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6e3a3640 1 -- 172.21.15.130:0/1264140175 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff680b7e40 con 0x7eff68146f30 2023-09-13T06:07:03.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff64ff9640 1 -- 172.21.15.130:0/1264140175 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600b8b10 con 0x7eff68146f30 2023-09-13T06:07:03.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6e3a3640 1 -- 172.21.15.130:0/1264140175 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff68144bb0 con 0x7eff68146f30 2023-09-13T06:07:03.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.960+0000 7eff6e3a3640 1 -- 172.21.15.130:0/1264140175 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff680618a0 con 0x7eff68146f30 2023-09-13T06:07:03.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.964+0000 7eff64ff9640 1 -- 172.21.15.130:0/1264140175 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7eff600b8c70 con 0x7eff68146f30 2023-09-13T06:07:03.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.964+0000 7eff64ff9640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff54065b20 0x7eff54067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:03.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.964+0000 7eff64ff9640 1 -- 172.21.15.130:0/1264140175 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff6011e140 con 0x7eff68146f30 2023-09-13T06:07:03.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.964+0000 7eff67fff640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff54065b20 0x7eff54067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:03.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.964+0000 7eff67fff640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff54065b20 0x7eff54067fe0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7eff58009bb0 tx=0x7eff58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:03.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:03.968+0000 7eff64ff9640 1 -- 172.21.15.130:0/1264140175 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7eff600ebf00 con 0x7eff68146f30 2023-09-13T06:07:04.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.116+0000 7eff6e3a3640 1 -- 172.21.15.130:0/1264140175 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff680ce970 con 0x7eff68146f30 2023-09-13T06:07:04.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.116+0000 7eff64ff9640 1 -- 172.21.15.130:0/1264140175 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+12904 (secure 0 0 0) 0x7eff600ef520 con 0x7eff68146f30 2023-09-13T06:07:04.120 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:04.120 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":119,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:03.385379+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:04.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 -- 172.21.15.130:0/1264140175 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff54065b20 msgr2=0x7eff54067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff54065b20 0x7eff54067fe0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7eff58009bb0 tx=0x7eff58008040 comp rx=0 tx=0).stop 2023-09-13T06:07:04.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 -- 172.21.15.130:0/1264140175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff68146f30 msgr2=0x7eff68164610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff68146f30 0x7eff68164610 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7eff600af040 tx=0x7eff60019780 comp rx=0 tx=0).stop 2023-09-13T06:07:04.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 -- 172.21.15.130:0/1264140175 shutdown_connections 2023-09-13T06:07:04.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff54065b20 0x7eff54067fe0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff68146f30 0x7eff68164610 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff680d1750 0x7eff681640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 --2- 172.21.15.130:0/1264140175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff680d1090 0x7eff6815c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 -- 172.21.15.130:0/1264140175 >> 172.21.15.130:0/1264140175 conn(0x7eff6806f170 msgr2=0x7eff68142af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:04.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 -- 172.21.15.130:0/1264140175 shutdown_connections 2023-09-13T06:07:04.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.120+0000 7eff6e3a3640 1 -- 172.21.15.130:0/1264140175 wait complete. 2023-09-13T06:07:04.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:07:04.142 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:07:04.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.280+0000 7fd2f2419640 1 Processor -- start 2023-09-13T06:07:04.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.280+0000 7fd2f2419640 1 -- start start 2023-09-13T06:07:04.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2f2419640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd2ec0b2e90 0x7fd2ec0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2f2419640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2ec0b1460 0x7fd2ec0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2f2419640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ec0b2150 con 0x7fd2ec144d70 2023-09-13T06:07:04.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2f2419640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec0b2430 con 0x7fd2ec0b2e90 2023-09-13T06:07:04.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2f2419640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0cedb0 con 0x7fd2ec0b1460 2023-09-13T06:07:04.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2ebfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd2ec144d70 0x7fd2ec0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50092/0 (socket says 172.21.15.130:50092) 2023-09-13T06:07:04.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2ebfff640 1 -- 172.21.15.130:0/809591720 learned_addr learned my addr 172.21.15.130:0/809591720 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:04.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2eb7fe640 1 --2- 172.21.15.130:0/809591720 >> v2:172.21.15.130:3300/0 conn(0x7fd2ec0b2e90 0x7fd2ec0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2f09b6640 1 --2- 172.21.15.130:0/809591720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2ec0b1460 0x7fd2ec0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2eb7fe640 1 -- 172.21.15.130:0/809591720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2ec0b1460 msgr2=0x7fd2ec0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:04.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2eb7fe640 1 --2- 172.21.15.130:0/809591720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2ec0b1460 0x7fd2ec0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2eb7fe640 1 -- 172.21.15.130:0/809591720 >> v1:172.21.15.130:6789/0 conn(0x7fd2ec144d70 legacy=0x7fd2ec0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2eb7fe640 1 -- 172.21.15.130:0/809591720 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec0cdd90 con 0x7fd2ec0b2e90 2023-09-13T06:07:04.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2f09b6640 1 --2- 172.21.15.130:0/809591720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2ec0b1460 0x7fd2ec0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:04.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2eb7fe640 1 --2- 172.21.15.130:0/809591720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2ec0b2e90 0x7fd2ec0ce870 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00097c0 tx=0x7fd2e001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aedba7cb725e63e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:04.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2eaffd640 1 -- 172.21.15.130:0/809591720 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00ab600 con 0x7fd2ec0b2e90 2023-09-13T06:07:04.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2eaffd640 1 -- 172.21.15.130:0/809591720 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e00a7050 con 0x7fd2ec0b2e90 2023-09-13T06:07:04.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.284+0000 7fd2eaffd640 1 -- 172.21.15.130:0/809591720 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00ab980 con 0x7fd2ec0b2e90 2023-09-13T06:07:04.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 -- 172.21.15.130:0/809591720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2ec0b2e90 msgr2=0x7fd2ec0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 --2- 172.21.15.130:0/809591720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2ec0b2e90 0x7fd2ec0ce870 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00097c0 tx=0x7fd2e001c480 comp rx=0 tx=0).stop 2023-09-13T06:07:04.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 -- 172.21.15.130:0/809591720 shutdown_connections 2023-09-13T06:07:04.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 --2- 172.21.15.130:0/809591720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2ec0b1460 0x7fd2ec0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 --2- 172.21.15.130:0/809591720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2ec0b2e90 0x7fd2ec0ce870 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 -- 172.21.15.130:0/809591720 >> 172.21.15.130:0/809591720 conn(0x7fd2ec065990 msgr2=0x7fd2ec065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:04.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 -- 172.21.15.130:0/809591720 shutdown_connections 2023-09-13T06:07:04.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 -- 172.21.15.130:0/809591720 wait complete. 2023-09-13T06:07:04.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 Processor -- start 2023-09-13T06:07:04.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 -- start start 2023-09-13T06:07:04.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2ec0b1460 0x7fd2ec13d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2ec0b2e90 0x7fd2ec0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2ec144d70 0x7fd2ec0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec14b830 con 0x7fd2ec0b1460 2023-09-13T06:07:04.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec1f9fd0 con 0x7fd2ec144d70 2023-09-13T06:07:04.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2f2419640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec13fc40 con 0x7fd2ec0b2e90 2023-09-13T06:07:04.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2ebfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2ec0b1460 0x7fd2ec13d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2ebfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2ec0b1460 0x7fd2ec13d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60656/0 (socket says 172.21.15.130:60656) 2023-09-13T06:07:04.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.288+0000 7fd2ebfff640 1 -- 172.21.15.130:0/1843736293 learned_addr learned my addr 172.21.15.130:0/1843736293 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:04.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2f09b6640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2ec144d70 0x7fd2ec0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2eb7fe640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2ec0b2e90 0x7fd2ec0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2ebfff640 1 -- 172.21.15.130:0/1843736293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2ec0b2e90 msgr2=0x7fd2ec0b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2ebfff640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2ec0b2e90 0x7fd2ec0b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2ebfff640 1 -- 172.21.15.130:0/1843736293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2ec144d70 msgr2=0x7fd2ec0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2ebfff640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2ec144d70 0x7fd2ec0b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2ebfff640 1 -- 172.21.15.130:0/1843736293 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e0009420 con 0x7fd2ec0b1460 2023-09-13T06:07:04.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2f09b6640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2ec144d70 0x7fd2ec0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:04.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2ebfff640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2ec0b1460 0x7fd2ec13d030 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c430 tx=0x7fd2dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:04.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2e8ff9640 1 -- 172.21.15.130:0/1843736293 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc005cf0 con 0x7fd2ec0b1460 2023-09-13T06:07:04.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2e8ff9640 1 -- 172.21.15.130:0/1843736293 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc005e50 con 0x7fd2ec0b1460 2023-09-13T06:07:04.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2f2419640 1 -- 172.21.15.130:0/1843736293 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ec13f680 con 0x7fd2ec0b1460 2023-09-13T06:07:04.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2e8ff9640 1 -- 172.21.15.130:0/1843736293 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0072d0 con 0x7fd2ec0b1460 2023-09-13T06:07:04.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2f2419640 1 -- 172.21.15.130:0/1843736293 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ec14b450 con 0x7fd2ec0b1460 2023-09-13T06:07:04.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2f2419640 1 -- 172.21.15.130:0/1843736293 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ec14b2b0 con 0x7fd2ec0b1460 2023-09-13T06:07:04.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2e8ff9640 1 -- 172.21.15.130:0/1843736293 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd2dc007430 con 0x7fd2ec0b1460 2023-09-13T06:07:04.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2e8ff9640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2d8065b50 0x7fd2d8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2e8ff9640 1 -- 172.21.15.130:0/1843736293 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2dc082470 con 0x7fd2ec0b1460 2023-09-13T06:07:04.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.292+0000 7fd2eb7fe640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2d8065b50 0x7fd2d8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.296+0000 7fd2eb7fe640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2d8065b50 0x7fd2d8068010 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00ad000 tx=0x7fd2e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:04.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.296+0000 7fd2e8ff9640 1 -- 172.21.15.130:0/1843736293 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd2ec14b2b0 con 0x7fd2ec0b1460 2023-09-13T06:07:04.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.448+0000 7fd2f2419640 1 -- 172.21.15.130:0/1843736293 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2ec14b2b0 con 0x7fd2ec0b1460 2023-09-13T06:07:04.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.448+0000 7fd2e8ff9640 1 -- 172.21.15.130:0/1843736293 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2ec14b2b0 con 0x7fd2ec0b1460 2023-09-13T06:07:04.453 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:07:04.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 -- 172.21.15.130:0/1843736293 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2d8065b50 msgr2=0x7fd2d8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2d8065b50 0x7fd2d8068010 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00ad000 tx=0x7fd2e0008040 comp rx=0 tx=0).stop 2023-09-13T06:07:04.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 -- 172.21.15.130:0/1843736293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2ec0b1460 msgr2=0x7fd2ec13d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2ec0b1460 0x7fd2ec13d030 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c430 tx=0x7fd2dc00c8f0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 -- 172.21.15.130:0/1843736293 shutdown_connections 2023-09-13T06:07:04.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2d8065b50 0x7fd2d8068010 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2ec144d70 0x7fd2ec0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2ec0b2e90 0x7fd2ec0b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 --2- 172.21.15.130:0/1843736293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2ec0b1460 0x7fd2ec13d030 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 -- 172.21.15.130:0/1843736293 >> 172.21.15.130:0/1843736293 conn(0x7fd2ec065990 msgr2=0x7fd2ec0ad060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:04.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 -- 172.21.15.130:0/1843736293 shutdown_connections 2023-09-13T06:07:04.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.452+0000 7fd2f2419640 1 -- 172.21.15.130:0/1843736293 wait complete. 2023-09-13T06:07:04.474 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T06:07:04.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.608+0000 7f90aa476640 1 Processor -- start 2023-09-13T06:07:04.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90aa476640 1 -- start start 2023-09-13T06:07:04.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90aa476640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f90a4144250 0x7f90a40cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90aa476640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a40ce1d0 0x7f90a4070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90aa476640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a40cd800 con 0x7f90a40706c0 2023-09-13T06:07:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90aa476640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a4070b30 con 0x7f90a4144250 2023-09-13T06:07:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90aa476640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a4144630 con 0x7f90a40ce1d0 2023-09-13T06:07:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90a9474640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f90a4144250 0x7f90a40cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90a9474640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f90a4144250 0x7f90a40cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60664/0 (socket says 172.21.15.130:60664) 2023-09-13T06:07:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90a9474640 1 -- 172.21.15.130:0/338401773 learned_addr learned my addr 172.21.15.130:0/338401773 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90a8c73640 1 --2- 172.21.15.130:0/338401773 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a40ce1d0 0x7f90a4070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90a9474640 1 -- 172.21.15.130:0/338401773 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a40ce1d0 msgr2=0x7f90a4070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90a9474640 1 --2- 172.21.15.130:0/338401773 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a40ce1d0 0x7f90a4070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90a9474640 1 -- 172.21.15.130:0/338401773 >> v1:172.21.15.130:6789/0 conn(0x7f90a40706c0 legacy=0x7f90a415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.612+0000 7f90a9474640 1 -- 172.21.15.130:0/338401773 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a406e450 con 0x7f90a4144250 2023-09-13T06:07:04.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f90a9474640 1 --2- 172.21.15.130:0/338401773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a4144250 0x7f90a40cdc90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009870 tx=0x7f90a001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e542701544a724a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:04.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f909bfff640 1 -- 172.21.15.130:0/338401773 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a00aa670 con 0x7f90a4144250 2023-09-13T06:07:04.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f909bfff640 1 -- 172.21.15.130:0/338401773 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a00aa7d0 con 0x7f90a4144250 2023-09-13T06:07:04.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f909bfff640 1 -- 172.21.15.130:0/338401773 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a00aab60 con 0x7f90a4144250 2023-09-13T06:07:04.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f90aa476640 1 -- 172.21.15.130:0/338401773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a4144250 msgr2=0x7f90a40cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f90aa476640 1 --2- 172.21.15.130:0/338401773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a4144250 0x7f90a40cdc90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009870 tx=0x7f90a001c510 comp rx=0 tx=0).stop 2023-09-13T06:07:04.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f90aa476640 1 -- 172.21.15.130:0/338401773 shutdown_connections 2023-09-13T06:07:04.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f90aa476640 1 --2- 172.21.15.130:0/338401773 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a40ce1d0 0x7f90a4070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f90aa476640 1 --2- 172.21.15.130:0/338401773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a4144250 0x7f90a40cdc90 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f90aa476640 1 -- 172.21.15.130:0/338401773 >> 172.21.15.130:0/338401773 conn(0x7f90a4065b60 msgr2=0x7f90a40aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:04.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f90aa476640 1 -- 172.21.15.130:0/338401773 shutdown_connections 2023-09-13T06:07:04.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f90aa476640 1 -- 172.21.15.130:0/338401773 wait complete. 2023-09-13T06:07:04.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f90aa476640 1 Processor -- start 2023-09-13T06:07:04.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.616+0000 7f90aa476640 1 -- start start 2023-09-13T06:07:04.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90aa476640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a40706c0 0x7f90a4158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90aa476640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a40ce1d0 0x7f90a40aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90aa476640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90a4144250 0x7f90a40aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90aa476640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a4138a90 con 0x7f90a40ce1d0 2023-09-13T06:07:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90aa476640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a41592b0 con 0x7f90a4144250 2023-09-13T06:07:04.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90aa476640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40ad100 con 0x7f90a40706c0 2023-09-13T06:07:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a8c73640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a40ce1d0 0x7f90a40aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a8c73640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a40ce1d0 0x7f90a40aaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60668/0 (socket says 172.21.15.130:60668) 2023-09-13T06:07:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a8c73640 1 -- 172.21.15.130:0/2593784127 learned_addr learned my addr 172.21.15.130:0/2593784127 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a9474640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a40706c0 0x7f90a4158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a9c75640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90a4144250 0x7f90a40aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a8c73640 1 -- 172.21.15.130:0/2593784127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a40706c0 msgr2=0x7f90a4158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a8c73640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a40706c0 0x7f90a4158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a8c73640 1 -- 172.21.15.130:0/2593784127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90a4144250 msgr2=0x7f90a40aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a8c73640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90a4144250 0x7f90a40aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a8c73640 1 -- 172.21.15.130:0/2593784127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00094d0 con 0x7f90a40ce1d0 2023-09-13T06:07:04.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a9c75640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90a4144250 0x7f90a40aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:04.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90a8c73640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a40ce1d0 0x7f90a40aaa00 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f909400d800 tx=0x7f909400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:04.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f9099ffb640 1 -- 172.21.15.130:0/2593784127 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400b6c0 con 0x7f90a40ce1d0 2023-09-13T06:07:04.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f9099ffb640 1 -- 172.21.15.130:0/2593784127 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909400b820 con 0x7f90a40ce1d0 2023-09-13T06:07:04.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f9099ffb640 1 -- 172.21.15.130:0/2593784127 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400bb90 con 0x7f90a40ce1d0 2023-09-13T06:07:04.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90aa476640 1 -- 172.21.15.130:0/2593784127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a4138ce0 con 0x7f90a40ce1d0 2023-09-13T06:07:04.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90aa476640 1 -- 172.21.15.130:0/2593784127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a41392a0 con 0x7f90a40ce1d0 2023-09-13T06:07:04.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.620+0000 7f90aa476640 1 -- 172.21.15.130:0/2593784127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a40618a0 con 0x7f90a40ce1d0 2023-09-13T06:07:04.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.624+0000 7f9099ffb640 1 -- 172.21.15.130:0/2593784127 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f909400bcf0 con 0x7f90a40ce1d0 2023-09-13T06:07:04.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.624+0000 7f9099ffb640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9088065b20 0x7f9088067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.624+0000 7f9099ffb640 1 -- 172.21.15.130:0/2593784127 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9094083500 con 0x7f90a40ce1d0 2023-09-13T06:07:04.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.624+0000 7f90a9474640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9088065b20 0x7f9088067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.624+0000 7f90a9474640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9088065b20 0x7f9088067fe0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f90a00ae000 tx=0x7f90a00b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:04.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.628+0000 7f9099ffb640 1 -- 172.21.15.130:0/2593784127 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9094051100 con 0x7f90a40ce1d0 2023-09-13T06:07:04.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.776+0000 7f90aa476640 1 -- 172.21.15.130:0/2593784127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f90a4070170 con 0x7f90a40ce1d0 2023-09-13T06:07:04.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f9099ffb640 1 -- 172.21.15.130:0/2593784127 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v119) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9094054720 con 0x7f90a40ce1d0 2023-09-13T06:07:04.781 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:04.781 INFO:teuthology.orchestra.run.smithi130.stdout:[ 2023-09-13T06:07:04.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:04.782 INFO:teuthology.orchestra.run.smithi130.stdout: "poolnum": 1, 2023-09-13T06:07:04.782 INFO:teuthology.orchestra.run.smithi130.stdout: "poolname": ".mgr" 2023-09-13T06:07:04.782 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:04.782 INFO:teuthology.orchestra.run.smithi130.stdout:] 2023-09-13T06:07:04.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 -- 172.21.15.130:0/2593784127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9088065b20 msgr2=0x7f9088067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9088065b20 0x7f9088067fe0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f90a00ae000 tx=0x7f90a00b5040 comp rx=0 tx=0).stop 2023-09-13T06:07:04.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 -- 172.21.15.130:0/2593784127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a40ce1d0 msgr2=0x7f90a40aaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a40ce1d0 0x7f90a40aaa00 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f909400d800 tx=0x7f909400dcc0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 -- 172.21.15.130:0/2593784127 shutdown_connections 2023-09-13T06:07:04.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9088065b20 0x7f9088067fe0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90a4144250 0x7f90a40aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a40ce1d0 0x7f90a40aaa00 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 --2- 172.21.15.130:0/2593784127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a40706c0 0x7f90a4158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 -- 172.21.15.130:0/2593784127 >> 172.21.15.130:0/2593784127 conn(0x7f90a4065b60 msgr2=0x7f90a415de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 -- 172.21.15.130:0/2593784127 shutdown_connections 2023-09-13T06:07:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.780+0000 7f90aa476640 1 -- 172.21.15.130:0/2593784127 wait complete. 2023-09-13T06:07:04.802 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T06:07:04.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T06:07:04.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fba6d8640 1 Processor -- start 2023-09-13T06:07:04.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fba6d8640 1 -- start start 2023-09-13T06:07:04.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fba6d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4fb40ccc10 0x7f4fb415dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fba6d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4fb40b3170 0x7f4fb40b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fba6d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fb40b1ff0 0x7f4fb40cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fba6d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb40ccff0 con 0x7f4fb40ccc10 2023-09-13T06:07:04.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fba6d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb40b12f0 con 0x7f4fb40b3170 2023-09-13T06:07:04.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fba6d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb415e520 con 0x7f4fb40b1ff0 2023-09-13T06:07:04.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fb3fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4fb40ccc10 0x7f4fb415dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fb3fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4fb40ccc10 0x7f4fb415dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60674/0 (socket says 172.21.15.130:60674) 2023-09-13T06:07:04.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fb3fff640 1 -- 172.21.15.130:0/277878791 learned_addr learned my addr 172.21.15.130:0/277878791 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:04.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fb8c75640 1 --2- 172.21.15.130:0/277878791 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fb40b1ff0 0x7f4fb40cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fb37fe640 1 --2- 172.21.15.130:0/277878791 >> v2:172.21.15.164:3300/0 conn(0x7f4fb40b3170 0x7f4fb40b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fb3fff640 1 -- 172.21.15.130:0/277878791 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fb40b1ff0 msgr2=0x7f4fb40cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:04.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fb3fff640 1 --2- 172.21.15.130:0/277878791 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fb40b1ff0 0x7f4fb40cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fb3fff640 1 -- 172.21.15.130:0/277878791 >> v2:172.21.15.164:3300/0 conn(0x7f4fb40b3170 msgr2=0x7f4fb40b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:04.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fb3fff640 1 --2- 172.21.15.130:0/277878791 >> v2:172.21.15.164:3300/0 conn(0x7f4fb40b3170 0x7f4fb40b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fb3fff640 1 -- 172.21.15.130:0/277878791 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb415e800 con 0x7f4fb40ccc10 2023-09-13T06:07:04.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.944+0000 7f4fb37fe640 1 --2- 172.21.15.130:0/277878791 >> v2:172.21.15.164:3300/0 conn(0x7f4fb40b3170 0x7f4fb40b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:04.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fb3fff640 1 --2- 172.21.15.130:0/277878791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb40ccc10 0x7f4fb415dcd0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40cece0 tx=0x7f4fa401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e3d843d78ab97e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:04.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fb2ffd640 1 -- 172.21.15.130:0/277878791 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa40ac600 con 0x7f4fb40ccc10 2023-09-13T06:07:04.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fb2ffd640 1 -- 172.21.15.130:0/277878791 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa40a8050 con 0x7f4fb40ccc10 2023-09-13T06:07:04.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fb2ffd640 1 -- 172.21.15.130:0/277878791 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa40ac980 con 0x7f4fb40ccc10 2023-09-13T06:07:04.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fba6d8640 1 -- 172.21.15.130:0/277878791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb40ccc10 msgr2=0x7f4fb415dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fba6d8640 1 --2- 172.21.15.130:0/277878791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb40ccc10 0x7f4fb415dcd0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40cece0 tx=0x7f4fa401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fba6d8640 1 -- 172.21.15.130:0/277878791 shutdown_connections 2023-09-13T06:07:04.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fba6d8640 1 --2- 172.21.15.130:0/277878791 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fb40b1ff0 0x7f4fb40cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fba6d8640 1 --2- 172.21.15.130:0/277878791 >> v2:172.21.15.164:3300/0 conn(0x7f4fb40b3170 0x7f4fb40b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fba6d8640 1 --2- 172.21.15.130:0/277878791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb40ccc10 0x7f4fb415dcd0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fba6d8640 1 -- 172.21.15.130:0/277878791 >> 172.21.15.130:0/277878791 conn(0x7f4fb40735e0 msgr2=0x7f4fb4065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:04.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fba6d8640 1 -- 172.21.15.130:0/277878791 shutdown_connections 2023-09-13T06:07:04.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.948+0000 7f4fba6d8640 1 -- 172.21.15.130:0/277878791 wait complete. 2023-09-13T06:07:04.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fba6d8640 1 Processor -- start 2023-09-13T06:07:04.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fba6d8640 1 -- start start 2023-09-13T06:07:04.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fba6d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fb40b1ff0 0x7f4fb4141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fba6d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fb40b3170 0x7f4fb41539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fba6d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb40ccc10 0x7f4fb4158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fba6d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4152f70 con 0x7f4fb40ccc10 2023-09-13T06:07:04.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fba6d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4153530 con 0x7f4fb40b1ff0 2023-09-13T06:07:04.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fba6d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4141e50 con 0x7f4fb40b3170 2023-09-13T06:07:04.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb8c75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb40ccc10 0x7f4fb4158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb8c75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb40ccc10 0x7f4fb4158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60680/0 (socket says 172.21.15.130:60680) 2023-09-13T06:07:04.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb8c75640 1 -- 172.21.15.130:0/2756802744 learned_addr learned my addr 172.21.15.130:0/2756802744 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:04.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb3fff640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fb40b1ff0 0x7f4fb4141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb37fe640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fb40b3170 0x7f4fb41539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb8c75640 1 -- 172.21.15.130:0/2756802744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fb40b3170 msgr2=0x7f4fb41539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb8c75640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fb40b3170 0x7f4fb41539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb8c75640 1 -- 172.21.15.130:0/2756802744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fb40b1ff0 msgr2=0x7f4fb4141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:04.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb8c75640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fb40b1ff0 0x7f4fb4141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:04.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb8c75640 1 -- 172.21.15.130:0/2756802744 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40094d0 con 0x7f4fb40ccc10 2023-09-13T06:07:04.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb8c75640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb40ccc10 0x7f4fb4158980 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00eed0 tx=0x7f4fac00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:04.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb0ff9640 1 -- 172.21.15.130:0/2756802744 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac010040 con 0x7f4fb40ccc10 2023-09-13T06:07:04.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb0ff9640 1 -- 172.21.15.130:0/2756802744 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac014400 con 0x7f4fb40ccc10 2023-09-13T06:07:04.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fb0ff9640 1 -- 172.21.15.130:0/2756802744 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac009ea0 con 0x7f4fb40ccc10 2023-09-13T06:07:04.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fba6d8640 1 -- 172.21.15.130:0/2756802744 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb4159260 con 0x7f4fb40ccc10 2023-09-13T06:07:04.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fba6d8640 1 -- 172.21.15.130:0/2756802744 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb41531c0 con 0x7f4fb40ccc10 2023-09-13T06:07:04.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.952+0000 7f4fba6d8640 1 -- 172.21.15.130:0/2756802744 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb41536a0 con 0x7f4fb40ccc10 2023-09-13T06:07:04.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.956+0000 7f4fb0ff9640 1 -- 172.21.15.130:0/2756802744 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4fac0147b0 con 0x7f4fb40ccc10 2023-09-13T06:07:04.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.956+0000 7f4fb0ff9640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fa0065b20 0x7f4fa0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:04.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.956+0000 7f4fb0ff9640 1 -- 172.21.15.130:0/2756802744 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4fac0836d0 con 0x7f4fb40ccc10 2023-09-13T06:07:04.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.956+0000 7f4fb3fff640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fa0065b20 0x7f4fa0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:04.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.956+0000 7f4fb3fff640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fa0065b20 0x7f4fa0067fe0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40ae000 tx=0x7f4fa40a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:04.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:04.960+0000 7f4fb0ff9640 1 -- 172.21.15.130:0/2756802744 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4fac051360 con 0x7f4fb40ccc10 2023-09-13T06:07:05.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.108+0000 7f4fba6d8640 1 -- 172.21.15.130:0/2756802744 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4fb40618a0 con 0x7f4fb40ccc10 2023-09-13T06:07:05.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.824+0000 7f4fb0ff9640 1 -- 172.21.15.130:0/2756802744 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v120) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4fac054980 con 0x7f4fb40ccc10 2023-09-13T06:07:05.825 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' created 2023-09-13T06:07:05.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 -- 172.21.15.130:0/2756802744 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fa0065b20 msgr2=0x7f4fa0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:05.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fa0065b20 0x7f4fa0067fe0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40ae000 tx=0x7f4fa40a7000 comp rx=0 tx=0).stop 2023-09-13T06:07:05.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 -- 172.21.15.130:0/2756802744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb40ccc10 msgr2=0x7f4fb4158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:05.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb40ccc10 0x7f4fb4158980 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00eed0 tx=0x7f4fac00b480 comp rx=0 tx=0).stop 2023-09-13T06:07:05.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 -- 172.21.15.130:0/2756802744 shutdown_connections 2023-09-13T06:07:05.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4fa0065b20 0x7f4fa0067fe0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:05.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb40ccc10 0x7f4fb4158980 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:05.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fb40b3170 0x7f4fb41539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:05.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 --2- 172.21.15.130:0/2756802744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fb40b1ff0 0x7f4fb4141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:05.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 -- 172.21.15.130:0/2756802744 >> 172.21.15.130:0/2756802744 conn(0x7f4fb40735e0 msgr2=0x7f4fb40b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:05.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 -- 172.21.15.130:0/2756802744 shutdown_connections 2023-09-13T06:07:05.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.828+0000 7f4fba6d8640 1 -- 172.21.15.130:0/2756802744 wait complete. 2023-09-13T06:07:05.852 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T06:07:05.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.996+0000 7f55a9cd8640 1 Processor -- start 2023-09-13T06:07:05.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.996+0000 7f55a9cd8640 1 -- start start 2023-09-13T06:07:06.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:05.996+0000 7f55a9cd8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f55a41579c0 0x7f55a406f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:06.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a9cd8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a4157da0 con 0x7f55a4161ac0 2023-09-13T06:07:06.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a9cd8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a415e610 con 0x7f55a415df80 2023-09-13T06:07:06.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a9cd8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a415e3f0 con 0x7f55a41579c0 2023-09-13T06:07:06.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a37fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f55a41579c0 0x7f55a406f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:06.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a37fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f55a41579c0 0x7f55a406f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60684/0 (socket says 172.21.15.130:60684) 2023-09-13T06:07:06.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a37fe640 1 -- 172.21.15.130:0/3052054370 learned_addr learned my addr 172.21.15.130:0/3052054370 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:06.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a2ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f55a4161ac0 0x7f55a415d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50110/0 (socket says 172.21.15.130:50110) 2023-09-13T06:07:06.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a37fe640 1 -- 172.21.15.130:0/3052054370 >> v1:172.21.15.164:6789/0 conn(0x7f55a415df80 legacy=0x7f55a40b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:06.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a37fe640 1 -- 172.21.15.130:0/3052054370 >> v1:172.21.15.130:6789/0 conn(0x7f55a4161ac0 legacy=0x7f55a415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:06.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a37fe640 1 -- 172.21.15.130:0/3052054370 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a4160fe0 con 0x7f55a41579c0 2023-09-13T06:07:06.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a37fe640 1 --2- 172.21.15.130:0/3052054370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55a41579c0 0x7f55a406f4a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f5594009870 tx=0x7f559401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400f875a76d3ee server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:06.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a27fc640 1 -- 172.21.15.130:0/3052054370 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940ac620 con 0x7f55a41579c0 2023-09-13T06:07:06.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a27fc640 1 -- 172.21.15.130:0/3052054370 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55940ac780 con 0x7f55a41579c0 2023-09-13T06:07:06.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.000+0000 7f55a27fc640 1 -- 172.21.15.130:0/3052054370 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940acb10 con 0x7f55a41579c0 2023-09-13T06:07:06.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 -- 172.21.15.130:0/3052054370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55a41579c0 msgr2=0x7f55a406f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:06.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 --2- 172.21.15.130:0/3052054370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55a41579c0 0x7f55a406f4a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f5594009870 tx=0x7f559401c4b0 comp rx=0 tx=0).stop 2023-09-13T06:07:06.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 -- 172.21.15.130:0/3052054370 shutdown_connections 2023-09-13T06:07:06.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 --2- 172.21.15.130:0/3052054370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55a41579c0 0x7f55a406f4a0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:06.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 -- 172.21.15.130:0/3052054370 >> 172.21.15.130:0/3052054370 conn(0x7f55a4065990 msgr2=0x7f55a4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:06.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 -- 172.21.15.130:0/3052054370 shutdown_connections 2023-09-13T06:07:06.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 -- 172.21.15.130:0/3052054370 wait complete. 2023-09-13T06:07:06.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 Processor -- start 2023-09-13T06:07:06.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 -- start start 2023-09-13T06:07:06.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55a41579c0 0x7f55a414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:06.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55a415df80 0x7f55a414be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:06.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55a4161ac0 0x7f55a414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:06.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a414df30 con 0x7f55a41579c0 2023-09-13T06:07:06.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a414e7d0 con 0x7f55a415df80 2023-09-13T06:07:06.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a9cd8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a414cd90 con 0x7f55a4161ac0 2023-09-13T06:07:06.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55a41579c0 0x7f55a414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:06.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55a41579c0 0x7f55a414ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60694/0 (socket says 172.21.15.130:60694) 2023-09-13T06:07:06.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a37fe640 1 -- 172.21.15.130:0/2719851019 learned_addr learned my addr 172.21.15.130:0/2719851019 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:06.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a2ffd640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55a415df80 0x7f55a414be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:06.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.004+0000 7f55a3fff640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55a4161ac0 0x7f55a414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:06.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f55a37fe640 1 -- 172.21.15.130:0/2719851019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55a4161ac0 msgr2=0x7f55a414c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:06.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f55a37fe640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55a4161ac0 0x7f55a414c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:06.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f55a37fe640 1 -- 172.21.15.130:0/2719851019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55a415df80 msgr2=0x7f55a414be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:06.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f55a37fe640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55a415df80 0x7f55a414be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:06.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f55a37fe640 1 -- 172.21.15.130:0/2719851019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55940094d0 con 0x7f55a41579c0 2023-09-13T06:07:06.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f55a3fff640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55a4161ac0 0x7f55a414c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:06.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f55a37fe640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55a41579c0 0x7f55a414ec60 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f55940190c0 tx=0x7f559401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:06.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f558bfff640 1 -- 172.21.15.130:0/2719851019 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940b7620 con 0x7f55a41579c0 2023-09-13T06:07:06.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f558bfff640 1 -- 172.21.15.130:0/2719851019 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55940b77a0 con 0x7f55a41579c0 2023-09-13T06:07:06.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f55a9cd8640 1 -- 172.21.15.130:0/2719851019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a4155990 con 0x7f55a41579c0 2023-09-13T06:07:06.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f558bfff640 1 -- 172.21.15.130:0/2719851019 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940b7b50 con 0x7f55a41579c0 2023-09-13T06:07:06.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f55a9cd8640 1 -- 172.21.15.130:0/2719851019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a414e460 con 0x7f55a41579c0 2023-09-13T06:07:06.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f55a9cd8640 1 -- 172.21.15.130:0/2719851019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a40618a0 con 0x7f55a41579c0 2023-09-13T06:07:06.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.008+0000 7f558bfff640 1 -- 172.21.15.130:0/2719851019 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f55940b3040 con 0x7f55a41579c0 2023-09-13T06:07:06.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.012+0000 7f558bfff640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 0x7f5590068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:06.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.012+0000 7f558bfff640 1 -- 172.21.15.130:0/2719851019 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f559411d620 con 0x7f55a41579c0 2023-09-13T06:07:06.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.012+0000 7f55a2ffd640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 0x7f5590068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:06.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.012+0000 7f55a2ffd640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 0x7f5590068010 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f55a40d3030 tx=0x7f5598007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:06.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.016+0000 7f558bfff640 1 -- 172.21.15.130:0/2719851019 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f55940eb1e0 con 0x7f55a41579c0 2023-09-13T06:07:06.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.164+0000 7f55a9cd8640 1 -- 172.21.15.130:0/2719851019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f55a40d2d80 con 0x7f55a41579c0 2023-09-13T06:07:06.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.832+0000 7f558bfff640 1 -- 172.21.15.130:0/2719851019 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v121) v1 ==== 170+0+0 (secure 0 0 0) 0x7f55940ee800 con 0x7f55a41579c0 2023-09-13T06:07:06.837 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' created 2023-09-13T06:07:06.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 -- 172.21.15.130:0/2719851019 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 msgr2=0x7f5590068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:06.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 0x7f5590068010 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f55a40d3030 tx=0x7f5598007c90 comp rx=0 tx=0).stop 2023-09-13T06:07:06.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 -- 172.21.15.130:0/2719851019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55a41579c0 msgr2=0x7f55a414ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:06.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55a41579c0 0x7f55a414ec60 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f55940190c0 tx=0x7f559401acf0 comp rx=0 tx=0).stop 2023-09-13T06:07:06.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 -- 172.21.15.130:0/2719851019 shutdown_connections 2023-09-13T06:07:06.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5590065b50 0x7f5590068010 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:06.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55a415df80 0x7f55a414be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:06.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55a4161ac0 0x7f55a414c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:06.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 --2- 172.21.15.130:0/2719851019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55a41579c0 0x7f55a414ec60 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:06.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 -- 172.21.15.130:0/2719851019 >> 172.21.15.130:0/2719851019 conn(0x7f55a4065990 msgr2=0x7f55a414fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:06.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 -- 172.21.15.130:0/2719851019 shutdown_connections 2023-09-13T06:07:06.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:06.844+0000 7f55a9cd8640 1 -- 172.21.15.130:0/2719851019 wait complete. 2023-09-13T06:07:06.869 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T06:07:07.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f5752a19640 1 Processor -- start 2023-09-13T06:07:07.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f5752a19640 1 -- start start 2023-09-13T06:07:07.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f5752a19640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f574c144d70 0x7f574c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:07.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f5752a19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f574c0b2780 0x7f574c0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:07.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f5752a19640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574c0b3120 con 0x7f574c0b1460 2023-09-13T06:07:07.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f5752a19640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574c0b2430 con 0x7f574c144d70 2023-09-13T06:07:07.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f5752a19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c0cedb0 con 0x7f574c0b2780 2023-09-13T06:07:07.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f574bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f574c144d70 0x7f574c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:07.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f5750fb6640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f574c0b1460 0x7f574c0b18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50116/0 (socket says 172.21.15.130:50116) 2023-09-13T06:07:07.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f5750fb6640 1 -- 172.21.15.130:0/149170007 learned_addr learned my addr 172.21.15.130:0/149170007 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:07.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f574b7fe640 1 --2- 172.21.15.130:0/149170007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f574c0b2780 0x7f574c0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:07.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f574bfff640 1 -- 172.21.15.130:0/149170007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f574c0b2780 msgr2=0x7f574c0b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:07.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f574bfff640 1 --2- 172.21.15.130:0/149170007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f574c0b2780 0x7f574c0b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:07.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f574bfff640 1 -- 172.21.15.130:0/149170007 >> v1:172.21.15.130:6789/0 conn(0x7f574c0b1460 legacy=0x7f574c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:07.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f574bfff640 1 -- 172.21.15.130:0/149170007 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c0b2150 con 0x7f574c144d70 2023-09-13T06:07:07.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f574b7fe640 1 --2- 172.21.15.130:0/149170007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f574c0b2780 0x7f574c0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:07.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.012+0000 7f574affd640 1 -- 172.21.15.130:0/149170007 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979124757 0 0) 0x7f574c0b3120 con 0x7f574c0b1460 2023-09-13T06:07:07.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f574bfff640 1 --2- 172.21.15.130:0/149170007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f574c144d70 0x7f574c0ce870 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f573c0097c0 tx=0x7f573c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e84456b01c44012 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:07.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f574affd640 1 -- 172.21.15.130:0/149170007 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0ab600 con 0x7f574c144d70 2023-09-13T06:07:07.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f574affd640 1 -- 172.21.15.130:0/149170007 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c0a7050 con 0x7f574c144d70 2023-09-13T06:07:07.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f574affd640 1 -- 172.21.15.130:0/149170007 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0ab980 con 0x7f574c144d70 2023-09-13T06:07:07.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f5752a19640 1 -- 172.21.15.130:0/149170007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f574c144d70 msgr2=0x7f574c0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:07.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f5752a19640 1 --2- 172.21.15.130:0/149170007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f574c144d70 0x7f574c0ce870 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f573c0097c0 tx=0x7f573c01c480 comp rx=0 tx=0).stop 2023-09-13T06:07:07.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f5752a19640 1 -- 172.21.15.130:0/149170007 shutdown_connections 2023-09-13T06:07:07.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f5752a19640 1 --2- 172.21.15.130:0/149170007 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f574c0b2780 0x7f574c0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:07.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f5752a19640 1 --2- 172.21.15.130:0/149170007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f574c144d70 0x7f574c0ce870 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:07.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f5752a19640 1 -- 172.21.15.130:0/149170007 >> 172.21.15.130:0/149170007 conn(0x7f574c065990 msgr2=0x7f574c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:07.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f5752a19640 1 -- 172.21.15.130:0/149170007 shutdown_connections 2023-09-13T06:07:07.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f5752a19640 1 -- 172.21.15.130:0/149170007 wait complete. 2023-09-13T06:07:07.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.016+0000 7f5752a19640 1 Processor -- start 2023-09-13T06:07:07.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5752a19640 1 -- start start 2023-09-13T06:07:07.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5752a19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f574c0b1460 0x7f574c1503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:07.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5752a19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f574c0b2780 0x7f574c0b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:07.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5752a19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f574c144d70 0x7f574c13acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:07.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5752a19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c13b230 con 0x7f574c0b1460 2023-09-13T06:07:07.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5752a19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c15ae40 con 0x7f574c0b2780 2023-09-13T06:07:07.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5752a19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c0b0830 con 0x7f574c144d70 2023-09-13T06:07:07.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f574bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f574c0b1460 0x7f574c1503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:07.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f574bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f574c0b1460 0x7f574c1503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60716/0 (socket says 172.21.15.130:60716) 2023-09-13T06:07:07.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f574bfff640 1 -- 172.21.15.130:0/2956461 learned_addr learned my addr 172.21.15.130:0/2956461 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:07.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f574b7fe640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f574c0b2780 0x7f574c0b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:07.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f574bfff640 1 -- 172.21.15.130:0/2956461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f574c144d70 msgr2=0x7f574c13acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:07.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f574bfff640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f574c144d70 0x7f574c13acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:07.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f574bfff640 1 -- 172.21.15.130:0/2956461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f574c0b2780 msgr2=0x7f574c0b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:07.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f574bfff640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f574c0b2780 0x7f574c0b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:07.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f574bfff640 1 -- 172.21.15.130:0/2956461 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c009420 con 0x7f574c0b1460 2023-09-13T06:07:07.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f574b7fe640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f574c0b2780 0x7f574c0b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:07.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f574bfff640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f574c0b1460 0x7f574c1503b0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f573c0ae040 tx=0x7f573c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:07.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5748ff9640 1 -- 172.21.15.130:0/2956461 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0b7650 con 0x7f574c0b1460 2023-09-13T06:07:07.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5748ff9640 1 -- 172.21.15.130:0/2956461 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c0b77d0 con 0x7f574c0b1460 2023-09-13T06:07:07.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5752a19640 1 -- 172.21.15.130:0/2956461 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574c0ae520 con 0x7f574c0b1460 2023-09-13T06:07:07.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5748ff9640 1 -- 172.21.15.130:0/2956461 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0b7b80 con 0x7f574c0b1460 2023-09-13T06:07:07.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5752a19640 1 -- 172.21.15.130:0/2956461 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574c0aeae0 con 0x7f574c0b1460 2023-09-13T06:07:07.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.020+0000 7f5752a19640 1 -- 172.21.15.130:0/2956461 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574c0aecd0 con 0x7f574c0b1460 2023-09-13T06:07:07.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.024+0000 7f5748ff9640 1 -- 172.21.15.130:0/2956461 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f573c0b7ce0 con 0x7f574c0b1460 2023-09-13T06:07:07.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.024+0000 7f5748ff9640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5738065b20 0x7f5738067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:07.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.024+0000 7f5748ff9640 1 -- 172.21.15.130:0/2956461 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f573c11e700 con 0x7f574c0b1460 2023-09-13T06:07:07.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.024+0000 7f574b7fe640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5738065b20 0x7f5738067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:07.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.024+0000 7f574b7fe640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5738065b20 0x7f5738067fe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f574c0b3340 tx=0x7f5740008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:07.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.028+0000 7f5748ff9640 1 -- 172.21.15.130:0/2956461 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f573c0ec1b0 con 0x7f574c0b1460 2023-09-13T06:07:07.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.204+0000 7f5752a19640 1 -- 172.21.15.130:0/2956461 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f574c0618a0 con 0x7f574c0b1460 2023-09-13T06:07:07.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.832+0000 7f5748ff9640 1 -- 172.21.15.130:0/2956461 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v55) v1 ==== 174+0+0 (secure 0 0 0) 0x7f573c0b00c0 con 0x7f574c0b1460 2023-09-13T06:07:07.835 INFO:teuthology.orchestra.run.smithi130.stderr:new fs with metadata pool 14 and data pool 15 2023-09-13T06:07:07.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.836+0000 7f5752a19640 1 -- 172.21.15.130:0/2956461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5738065b20 msgr2=0x7f5738067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:07.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.836+0000 7f5752a19640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5738065b20 0x7f5738067fe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f574c0b3340 tx=0x7f5740008040 comp rx=0 tx=0).stop 2023-09-13T06:07:07.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.836+0000 7f5752a19640 1 -- 172.21.15.130:0/2956461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f574c0b1460 msgr2=0x7f574c1503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:07.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.836+0000 7f5752a19640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f574c0b1460 0x7f574c1503b0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f573c0ae040 tx=0x7f573c01acc0 comp rx=0 tx=0).stop 2023-09-13T06:07:07.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.836+0000 7f5752a19640 1 -- 172.21.15.130:0/2956461 shutdown_connections 2023-09-13T06:07:07.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.840+0000 7f5752a19640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5738065b20 0x7f5738067fe0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:07.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.840+0000 7f5752a19640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f574c0b2780 0x7f574c0b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:07.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.840+0000 7f5752a19640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f574c144d70 0x7f574c13acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:07.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.840+0000 7f5752a19640 1 --2- 172.21.15.130:0/2956461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f574c0b1460 0x7f574c1503b0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:07.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.840+0000 7f5752a19640 1 -- 172.21.15.130:0/2956461 >> 172.21.15.130:0/2956461 conn(0x7f574c065990 msgr2=0x7f574c0cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:07.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.840+0000 7f5752a19640 1 -- 172.21.15.130:0/2956461 shutdown_connections 2023-09-13T06:07:07.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:07.840+0000 7f5752a19640 1 -- 172.21.15.130:0/2956461 wait complete. 2023-09-13T06:07:07.863 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:08.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd5832d8640 1 Processor -- start 2023-09-13T06:07:08.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd5832d8640 1 -- start start 2023-09-13T06:07:08.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd5832d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0d1090 0x7fd57c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd5832d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd57c146f30 0x7fd57c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd5832d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c0b63c0 con 0x7fd57c0d1750 2023-09-13T06:07:08.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd5832d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c15dea0 con 0x7fd57c146f30 2023-09-13T06:07:08.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd5832d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0d0c20 con 0x7fd57c0d1090 2023-09-13T06:07:08.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd581074640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd57c0d1750 0x7fd57c146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50130/0 (socket says 172.21.15.130:50130) 2023-09-13T06:07:08.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd581074640 1 -- 172.21.15.130:0/2106577898 learned_addr learned my addr 172.21.15.130:0/2106577898 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:08.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd581875640 1 --2- 172.21.15.130:0/2106577898 >> v2:172.21.15.164:3300/0 conn(0x7fd57c146f30 0x7fd57c0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd580873640 1 --2- 172.21.15.130:0/2106577898 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0d1090 0x7fd57c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd573fff640 1 -- 172.21.15.130:0/2106577898 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625210396 0 0) 0x7fd57c0b63c0 con 0x7fd57c0d1750 2023-09-13T06:07:08.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd573fff640 1 -- 172.21.15.130:0/2106577898 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd568003530 con 0x7fd57c0d1750 2023-09-13T06:07:08.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd581875640 1 -- 172.21.15.130:0/2106577898 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0d1090 msgr2=0x7fd57c15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:08.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd581875640 1 --2- 172.21.15.130:0/2106577898 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0d1090 0x7fd57c15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd581875640 1 -- 172.21.15.130:0/2106577898 >> v1:172.21.15.130:6789/0 conn(0x7fd57c0d1750 legacy=0x7fd57c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.000+0000 7fd581875640 1 -- 172.21.15.130:0/2106577898 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c0b6610 con 0x7fd57c146f30 2023-09-13T06:07:08.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd581875640 1 --2- 172.21.15.130:0/2106577898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c146f30 0x7fd57c0b70f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd574009d90 tx=0x7fd57401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8670afb886808a47 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:08.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd573fff640 1 -- 172.21.15.130:0/2106577898 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740a59e0 con 0x7fd57c146f30 2023-09-13T06:07:08.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd573fff640 1 -- 172.21.15.130:0/2106577898 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5740a5b40 con 0x7fd57c146f30 2023-09-13T06:07:08.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd573fff640 1 -- 172.21.15.130:0/2106577898 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740ad440 con 0x7fd57c146f30 2023-09-13T06:07:08.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd5832d8640 1 -- 172.21.15.130:0/2106577898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c146f30 msgr2=0x7fd57c0b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd5832d8640 1 --2- 172.21.15.130:0/2106577898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c146f30 0x7fd57c0b70f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd574009d90 tx=0x7fd57401c920 comp rx=0 tx=0).stop 2023-09-13T06:07:08.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd5832d8640 1 -- 172.21.15.130:0/2106577898 shutdown_connections 2023-09-13T06:07:08.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd5832d8640 1 --2- 172.21.15.130:0/2106577898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c146f30 0x7fd57c0b70f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd5832d8640 1 --2- 172.21.15.130:0/2106577898 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0d1090 0x7fd57c15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd5832d8640 1 -- 172.21.15.130:0/2106577898 >> 172.21.15.130:0/2106577898 conn(0x7fd57c06f170 msgr2=0x7fd57c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:08.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd5832d8640 1 -- 172.21.15.130:0/2106577898 shutdown_connections 2023-09-13T06:07:08.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.004+0000 7fd5832d8640 1 -- 172.21.15.130:0/2106577898 wait complete. 2023-09-13T06:07:08.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd5832d8640 1 Processor -- start 2023-09-13T06:07:08.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd5832d8640 1 -- start start 2023-09-13T06:07:08.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd5832d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c0d1090 0x7fd57c0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd5832d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0d1750 0x7fd57c0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd5832d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c146f30 0x7fd57c15cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd5832d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c144300 con 0x7fd57c0d1090 2023-09-13T06:07:08.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd5832d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0c9e70 con 0x7fd57c146f30 2023-09-13T06:07:08.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd5832d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0c9b90 con 0x7fd57c0d1750 2023-09-13T06:07:08.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd581074640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c0d1090 0x7fd57c0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd581074640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c0d1090 0x7fd57c0cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60720/0 (socket says 172.21.15.130:60720) 2023-09-13T06:07:08.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd581074640 1 -- 172.21.15.130:0/3942812615 learned_addr learned my addr 172.21.15.130:0/3942812615 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:08.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd581875640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c146f30 0x7fd57c15cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd580873640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0d1750 0x7fd57c0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd581074640 1 -- 172.21.15.130:0/3942812615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0d1750 msgr2=0x7fd57c0c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd581074640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0d1750 0x7fd57c0c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd581074640 1 -- 172.21.15.130:0/3942812615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c146f30 msgr2=0x7fd57c15cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd581074640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c146f30 0x7fd57c15cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd581074640 1 -- 172.21.15.130:0/3942812615 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd574009a70 con 0x7fd57c0d1090 2023-09-13T06:07:08.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd580873640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0d1750 0x7fd57c0c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:08.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd581074640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c0d1090 0x7fd57c0cac00 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c4d0 tx=0x7fd57800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:08.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd571ffb640 1 -- 172.21.15.130:0/3942812615 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578005cf0 con 0x7fd57c0d1090 2023-09-13T06:07:08.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd571ffb640 1 -- 172.21.15.130:0/3942812615 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd578005e50 con 0x7fd57c0d1090 2023-09-13T06:07:08.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd5832d8640 1 -- 172.21.15.130:0/3942812615 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57c0b7e40 con 0x7fd57c0d1090 2023-09-13T06:07:08.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.008+0000 7fd571ffb640 1 -- 172.21.15.130:0/3942812615 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578007270 con 0x7fd57c0d1090 2023-09-13T06:07:08.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.012+0000 7fd5832d8640 1 -- 172.21.15.130:0/3942812615 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57c143f20 con 0x7fd57c0d1090 2023-09-13T06:07:08.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.012+0000 7fd5832d8640 1 -- 172.21.15.130:0/3942812615 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57c0618a0 con 0x7fd57c0d1090 2023-09-13T06:07:08.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.012+0000 7fd571ffb640 1 -- 172.21.15.130:0/3942812615 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd5780073d0 con 0x7fd57c0d1090 2023-09-13T06:07:08.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.012+0000 7fd571ffb640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd560065b20 0x7fd560067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.012+0000 7fd571ffb640 1 -- 172.21.15.130:0/3942812615 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd578082830 con 0x7fd57c0d1090 2023-09-13T06:07:08.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.012+0000 7fd580873640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd560065b20 0x7fd560067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.012+0000 7fd580873640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd560065b20 0x7fd560067fe0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd57c1f9080 tx=0x7fd56c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:08.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.016+0000 7fd571ffb640 1 -- 172.21.15.130:0/3942812615 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd578050220 con 0x7fd57c0d1090 2023-09-13T06:07:08.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.164+0000 7fd5832d8640 1 -- 172.21.15.130:0/3942812615 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd57c0b86c0 con 0x7fd57c0d1090 2023-09-13T06:07:08.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd571ffb640 1 -- 172.21.15.130:0/3942812615 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fd578017090 con 0x7fd57c0d1090 2023-09-13T06:07:08.169 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:08.169 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":122,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:07.210215+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:05.156883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:06.213714+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:08.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 -- 172.21.15.130:0/3942812615 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd560065b20 msgr2=0x7fd560067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd560065b20 0x7fd560067fe0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd57c1f9080 tx=0x7fd56c008040 comp rx=0 tx=0).stop 2023-09-13T06:07:08.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 -- 172.21.15.130:0/3942812615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c0d1090 msgr2=0x7fd57c0cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c0d1090 0x7fd57c0cac00 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c4d0 tx=0x7fd57800c990 comp rx=0 tx=0).stop 2023-09-13T06:07:08.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 -- 172.21.15.130:0/3942812615 shutdown_connections 2023-09-13T06:07:08.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd560065b20 0x7fd560067fe0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c146f30 0x7fd57c15cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0d1750 0x7fd57c0c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 --2- 172.21.15.130:0/3942812615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c0d1090 0x7fd57c0cac00 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 -- 172.21.15.130:0/3942812615 >> 172.21.15.130:0/3942812615 conn(0x7fd57c06f170 msgr2=0x7fd57c15dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:08.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 -- 172.21.15.130:0/3942812615 shutdown_connections 2023-09-13T06:07:08.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.168+0000 7fd5832d8640 1 -- 172.21.15.130:0/3942812615 wait complete. 2023-09-13T06:07:08.190 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:08.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.324+0000 7f7d53693640 1 Processor -- start 2023-09-13T06:07:08.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.324+0000 7f7d53693640 1 -- start start 2023-09-13T06:07:08.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d53693640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d4c147b50 0x7f7d4c1652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d53693640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d4c0af9e0 0x7f7d4c06bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d53693640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c06b5e0 con 0x7f7d4c147f30 2023-09-13T06:07:08.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d53693640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c06b8c0 con 0x7f7d4c147b50 2023-09-13T06:07:08.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d53693640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1657f0 con 0x7f7d4c0af9e0 2023-09-13T06:07:08.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d5142f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d4c147b50 0x7f7d4c1652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d5142f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d4c147b50 0x7f7d4c1652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60732/0 (socket says 172.21.15.130:60732) 2023-09-13T06:07:08.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d5142f640 1 -- 172.21.15.130:0/2035374937 learned_addr learned my addr 172.21.15.130:0/2035374937 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:08.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d51c30640 1 --2- 172.21.15.130:0/2035374937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d4c0af9e0 0x7f7d4c06bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d5142f640 1 -- 172.21.15.130:0/2035374937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d4c0af9e0 msgr2=0x7f7d4c06bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:08.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d5142f640 1 --2- 172.21.15.130:0/2035374937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d4c0af9e0 0x7f7d4c06bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d5142f640 1 -- 172.21.15.130:0/2035374937 >> v1:172.21.15.130:6789/0 conn(0x7f7d4c147f30 legacy=0x7f7d4c148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d5142f640 1 -- 172.21.15.130:0/2035374937 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c165ac0 con 0x7f7d4c147b50 2023-09-13T06:07:08.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.328+0000 7f7d51c30640 1 --2- 172.21.15.130:0/2035374937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d4c0af9e0 0x7f7d4c06bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:08.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d5142f640 1 --2- 172.21.15.130:0/2035374937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d4c147b50 0x7f7d4c1652b0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009870 tx=0x7f7d4801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7094d6eab53fe9f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:08.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d43fff640 1 -- 172.21.15.130:0/2035374937 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d480aa670 con 0x7f7d4c147b50 2023-09-13T06:07:08.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d43fff640 1 -- 172.21.15.130:0/2035374937 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d480aa7d0 con 0x7f7d4c147b50 2023-09-13T06:07:08.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d43fff640 1 -- 172.21.15.130:0/2035374937 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d480aab60 con 0x7f7d4c147b50 2023-09-13T06:07:08.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 -- 172.21.15.130:0/2035374937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d4c147b50 msgr2=0x7f7d4c1652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 --2- 172.21.15.130:0/2035374937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d4c147b50 0x7f7d4c1652b0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009870 tx=0x7f7d4801c510 comp rx=0 tx=0).stop 2023-09-13T06:07:08.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 -- 172.21.15.130:0/2035374937 shutdown_connections 2023-09-13T06:07:08.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 --2- 172.21.15.130:0/2035374937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d4c0af9e0 0x7f7d4c06bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 --2- 172.21.15.130:0/2035374937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d4c147b50 0x7f7d4c1652b0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 -- 172.21.15.130:0/2035374937 >> 172.21.15.130:0/2035374937 conn(0x7f7d4c065990 msgr2=0x7f7d4c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:08.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 -- 172.21.15.130:0/2035374937 shutdown_connections 2023-09-13T06:07:08.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 -- 172.21.15.130:0/2035374937 wait complete. 2023-09-13T06:07:08.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 Processor -- start 2023-09-13T06:07:08.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 -- start start 2023-09-13T06:07:08.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d4c0af9e0 0x7f7d4c13ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d4c147b50 0x7f7d4c142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d4c147f30 0x7f7d4c160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c140870 con 0x7f7d4c147f30 2023-09-13T06:07:08.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c163720 con 0x7f7d4c147b50 2023-09-13T06:07:08.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d53693640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c163a00 con 0x7f7d4c0af9e0 2023-09-13T06:07:08.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.332+0000 7f7d51c30640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d4c147f30 0x7f7d4c160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d51c30640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d4c147f30 0x7f7d4c160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60742/0 (socket says 172.21.15.130:60742) 2023-09-13T06:07:08.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d51c30640 1 -- 172.21.15.130:0/3753633738 learned_addr learned my addr 172.21.15.130:0/3753633738 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:08.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d50c2e640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d4c147b50 0x7f7d4c142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d5142f640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d4c0af9e0 0x7f7d4c13ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d51c30640 1 -- 172.21.15.130:0/3753633738 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d4c0af9e0 msgr2=0x7f7d4c13ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d51c30640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d4c0af9e0 0x7f7d4c13ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d51c30640 1 -- 172.21.15.130:0/3753633738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d4c147b50 msgr2=0x7f7d4c142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d51c30640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d4c147b50 0x7f7d4c142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d51c30640 1 -- 172.21.15.130:0/3753633738 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d480094d0 con 0x7f7d4c147f30 2023-09-13T06:07:08.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d51c30640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d4c147f30 0x7f7d4c160bb0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400cca0 tx=0x7f7d4400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:08.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d41ffb640 1 -- 172.21.15.130:0/3753633738 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400f680 con 0x7f7d4c147f30 2023-09-13T06:07:08.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d41ffb640 1 -- 172.21.15.130:0/3753633738 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400f800 con 0x7f7d4c147f30 2023-09-13T06:07:08.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d41ffb640 1 -- 172.21.15.130:0/3753633738 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400fbb0 con 0x7f7d4c147f30 2023-09-13T06:07:08.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d53693640 1 -- 172.21.15.130:0/3753633738 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c148ca0 con 0x7f7d4c147f30 2023-09-13T06:07:08.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d53693640 1 -- 172.21.15.130:0/3753633738 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c140ac0 con 0x7f7d4c147f30 2023-09-13T06:07:08.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d53693640 1 -- 172.21.15.130:0/3753633738 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c140ce0 con 0x7f7d4c147f30 2023-09-13T06:07:08.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.336+0000 7f7d41ffb640 1 -- 172.21.15.130:0/3753633738 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7d4400b040 con 0x7f7d4c147f30 2023-09-13T06:07:08.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.340+0000 7f7d41ffb640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d30065b20 0x7f7d30067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.340+0000 7f7d41ffb640 1 -- 172.21.15.130:0/3753633738 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d44083af0 con 0x7f7d4c147f30 2023-09-13T06:07:08.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.340+0000 7f7d5142f640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d30065b20 0x7f7d30067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.340+0000 7f7d5142f640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d30065b20 0x7f7d30067fe0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7d480ae000 tx=0x7f7d480b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:08.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.340+0000 7f7d41ffb640 1 -- 172.21.15.130:0/3753633738 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7d440514e0 con 0x7f7d4c147f30 2023-09-13T06:07:08.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.492+0000 7f7d53693640 1 -- 172.21.15.130:0/3753633738 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d4c0618a0 con 0x7f7d4c147f30 2023-09-13T06:07:08.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.492+0000 7f7d41ffb640 1 -- 172.21.15.130:0/3753633738 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16556 (secure 0 0 0) 0x7f7d4401d090 con 0x7f7d4c147f30 2023-09-13T06:07:08.497 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:08.497 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":123,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:08.370118+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:05.156883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:06.213714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:08.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 -- 172.21.15.130:0/3753633738 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d30065b20 msgr2=0x7f7d30067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d30065b20 0x7f7d30067fe0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7d480ae000 tx=0x7f7d480b5040 comp rx=0 tx=0).stop 2023-09-13T06:07:08.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 -- 172.21.15.130:0/3753633738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d4c147f30 msgr2=0x7f7d4c160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d4c147f30 0x7f7d4c160bb0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400cca0 tx=0x7f7d4400a650 comp rx=0 tx=0).stop 2023-09-13T06:07:08.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 -- 172.21.15.130:0/3753633738 shutdown_connections 2023-09-13T06:07:08.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7d30065b20 0x7f7d30067fe0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d4c147b50 0x7f7d4c142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d4c147f30 0x7f7d4c160bb0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 --2- 172.21.15.130:0/3753633738 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d4c0af9e0 0x7f7d4c13ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 -- 172.21.15.130:0/3753633738 >> 172.21.15.130:0/3753633738 conn(0x7f7d4c065990 msgr2=0x7f7d4c148e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:08.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 -- 172.21.15.130:0/3753633738 shutdown_connections 2023-09-13T06:07:08.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.496+0000 7f7d53693640 1 -- 172.21.15.130:0/3753633738 wait complete. 2023-09-13T06:07:08.518 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T06:07:08.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdef40640 1 Processor -- start 2023-09-13T06:07:08.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdef40640 1 -- start start 2023-09-13T06:07:08.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdef40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd815a080 0x7f8fd80b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdef40640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8fd80b31a0 0x7f8fd80ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdef40640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd80cc850 con 0x7f8fd815e650 2023-09-13T06:07:08.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdef40640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd80b0330 con 0x7f8fd80b31a0 2023-09-13T06:07:08.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdef40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80cbcd0 con 0x7f8fd815a080 2023-09-13T06:07:08.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdd4dd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8fd80b31a0 0x7f8fd80ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdd4dd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8fd80b31a0 0x7f8fd80ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60758/0 (socket says 172.21.15.130:60758) 2023-09-13T06:07:08.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdd4dd640 1 -- 172.21.15.130:0/2589565892 learned_addr learned my addr 172.21.15.130:0/2589565892 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:08.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdccdc640 1 --2- 172.21.15.130:0/2589565892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd815a080 0x7f8fd80b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdd4dd640 1 -- 172.21.15.130:0/2589565892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd815a080 msgr2=0x7f8fd80b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:08.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdd4dd640 1 --2- 172.21.15.130:0/2589565892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd815a080 0x7f8fd80b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdd4dd640 1 -- 172.21.15.130:0/2589565892 >> v1:172.21.15.164:6789/0 conn(0x7f8fd815e650 legacy=0x7f8fd80b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.660+0000 7f8fdd4dd640 1 -- 172.21.15.130:0/2589565892 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80cbfb0 con 0x7f8fd80b31a0 2023-09-13T06:07:08.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fdd4dd640 1 --2- 172.21.15.130:0/2589565892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd80b31a0 0x7f8fd80ccfe0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009e50 tx=0x7f8fd001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0407b6891cd7b66 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:08.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fd77fe640 1 -- 172.21.15.130:0/2589565892 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00090d0 con 0x7f8fd80b31a0 2023-09-13T06:07:08.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fd77fe640 1 -- 172.21.15.130:0/2589565892 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0009230 con 0x7f8fd80b31a0 2023-09-13T06:07:08.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fd77fe640 1 -- 172.21.15.130:0/2589565892 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00a5a30 con 0x7f8fd80b31a0 2023-09-13T06:07:08.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fdef40640 1 -- 172.21.15.130:0/2589565892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd80b31a0 msgr2=0x7f8fd80ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fdef40640 1 --2- 172.21.15.130:0/2589565892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd80b31a0 0x7f8fd80ccfe0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009e50 tx=0x7f8fd001c950 comp rx=0 tx=0).stop 2023-09-13T06:07:08.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fdef40640 1 -- 172.21.15.130:0/2589565892 shutdown_connections 2023-09-13T06:07:08.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fdef40640 1 --2- 172.21.15.130:0/2589565892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd80b31a0 0x7f8fd80ccfe0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fdef40640 1 --2- 172.21.15.130:0/2589565892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd815a080 0x7f8fd80b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fdef40640 1 -- 172.21.15.130:0/2589565892 >> 172.21.15.130:0/2589565892 conn(0x7f8fd8065990 msgr2=0x7f8fd8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:08.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fdef40640 1 -- 172.21.15.130:0/2589565892 shutdown_connections 2023-09-13T06:07:08.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.664+0000 7f8fdef40640 1 -- 172.21.15.130:0/2589565892 wait complete. 2023-09-13T06:07:08.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdef40640 1 Processor -- start 2023-09-13T06:07:08.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdef40640 1 -- start start 2023-09-13T06:07:08.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdef40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd80b31a0 0x7f8fd815cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdef40640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fd815a080 0x7f8fd80b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdef40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd815e650 0x7f8fd80b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdef40640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd815d320 con 0x7f8fd815e650 2023-09-13T06:07:08.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdef40640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd806ca50 con 0x7f8fd815a080 2023-09-13T06:07:08.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdef40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd806cd30 con 0x7f8fd80b31a0 2023-09-13T06:07:08.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdd4dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd815e650 0x7f8fd80b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdd4dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd815e650 0x7f8fd80b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60764/0 (socket says 172.21.15.130:60764) 2023-09-13T06:07:08.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdd4dd640 1 -- 172.21.15.130:0/1843120956 learned_addr learned my addr 172.21.15.130:0/1843120956 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:08.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fd7fff640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fd815a080 0x7f8fd80b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdccdc640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd80b31a0 0x7f8fd815cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdd4dd640 1 -- 172.21.15.130:0/1843120956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd80b31a0 msgr2=0x7f8fd815cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdd4dd640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd80b31a0 0x7f8fd815cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdd4dd640 1 -- 172.21.15.130:0/1843120956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fd815a080 msgr2=0x7f8fd80b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:08.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdd4dd640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fd815a080 0x7f8fd80b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:08.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdd4dd640 1 -- 172.21.15.130:0/1843120956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd0009b30 con 0x7f8fd815e650 2023-09-13T06:07:08.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdd4dd640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd815e650 0x7f8fd80b4620 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f8fd001a580 tx=0x7f8fd00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:08.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fd57fa640 1 -- 172.21.15.130:0/1843120956 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00090d0 con 0x7f8fd815e650 2023-09-13T06:07:08.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fd57fa640 1 -- 172.21.15.130:0/1843120956 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd00b8880 con 0x7f8fd815e650 2023-09-13T06:07:08.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdef40640 1 -- 172.21.15.130:0/1843120956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd806d010 con 0x7f8fd815e650 2023-09-13T06:07:08.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fd57fa640 1 -- 172.21.15.130:0/1843120956 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00b8c30 con 0x7f8fd815e650 2023-09-13T06:07:08.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.668+0000 7f8fdef40640 1 -- 172.21.15.130:0/1843120956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd806d6d0 con 0x7f8fd815e650 2023-09-13T06:07:08.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.672+0000 7f8fdef40640 1 -- 172.21.15.130:0/1843120956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd80618a0 con 0x7f8fd815e650 2023-09-13T06:07:08.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.672+0000 7f8fd57fa640 1 -- 172.21.15.130:0/1843120956 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8fd00b6440 con 0x7f8fd815e650 2023-09-13T06:07:08.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.672+0000 7f8fd57fa640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:08.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.672+0000 7f8fd57fa640 1 -- 172.21.15.130:0/1843120956 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fd011e910 con 0x7f8fd815e650 2023-09-13T06:07:08.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.672+0000 7f8fdccdc640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:08.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.672+0000 7f8fdccdc640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8fd806ea50 tx=0x7f8fcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:08.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.676+0000 7f8fd57fa640 1 -- 172.21.15.130:0/1843120956 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8fd00ec310 con 0x7f8fd815e650 2023-09-13T06:07:08.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:08.860+0000 7f8fdef40640 1 -- 172.21.15.130:0/1843120956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8fd80ce8a0 con 0x7f8fd815e650 2023-09-13T06:07:09.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.848+0000 7f8fd57fa640 1 -- 172.21.15.130:0/1843120956 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v58) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8fd0009510 con 0x7f8fd815e650 2023-09-13T06:07:09.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.848+0000 7f8fdef40640 1 -- 172.21.15.130:0/1843120956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 msgr2=0x7f8fbc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:09.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.848+0000 7f8fdef40640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8fd806ea50 tx=0x7f8fcc008040 comp rx=0 tx=0).stop 2023-09-13T06:07:09.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.848+0000 7f8fdef40640 1 -- 172.21.15.130:0/1843120956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd815e650 msgr2=0x7f8fd80b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:09.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.848+0000 7f8fdef40640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd815e650 0x7f8fd80b4620 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f8fd001a580 tx=0x7f8fd00196f0 comp rx=0 tx=0).stop 2023-09-13T06:07:09.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.848+0000 7f8fdef40640 1 -- 172.21.15.130:0/1843120956 shutdown_connections 2023-09-13T06:07:09.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.848+0000 7f8fdef40640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:09.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.848+0000 7f8fdef40640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fd815a080 0x7f8fd80b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:09.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.852+0000 7f8fdef40640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd815e650 0x7f8fd80b4620 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:09.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.852+0000 7f8fdef40640 1 --2- 172.21.15.130:0/1843120956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fd80b31a0 0x7f8fd815cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:09.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.852+0000 7f8fdef40640 1 -- 172.21.15.130:0/1843120956 >> 172.21.15.130:0/1843120956 conn(0x7f8fd8065990 msgr2=0x7f8fd8150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:09.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.852+0000 7f8fdef40640 1 -- 172.21.15.130:0/1843120956 shutdown_connections 2023-09-13T06:07:09.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:09.852+0000 7f8fdef40640 1 -- 172.21.15.130:0/1843120956 wait complete. 2023-09-13T06:07:09.876 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T06:07:09.876 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T06:07:10.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d2ed8640 1 Processor -- start 2023-09-13T06:07:10.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d2ed8640 1 -- start start 2023-09-13T06:07:10.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d2ed8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146040 0x7fb7cc146420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:10.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d2ed8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb7cc146ce0 0x7fb7cc0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:10.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d2ed8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7cc071150 con 0x7fb7cc070d00 2023-09-13T06:07:10.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d2ed8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc0ae030 con 0x7fb7cc146ce0 2023-09-13T06:07:10.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d2ed8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0ae310 con 0x7fb7cc146040 2023-09-13T06:07:10.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d1475640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb7cc070d00 0x7fb7cc06f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50150/0 (socket says 172.21.15.130:50150) 2023-09-13T06:07:10.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d1475640 1 -- 172.21.15.130:0/2039284425 learned_addr learned my addr 172.21.15.130:0/2039284425 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:10.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7cbfff640 1 --2- 172.21.15.130:0/2039284425 >> v2:172.21.15.164:3300/0 conn(0x7fb7cc146ce0 0x7fb7cc0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:10.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d0c74640 1 --2- 172.21.15.130:0/2039284425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146040 0x7fb7cc146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:10.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7cb7fe640 1 -- 172.21.15.130:0/2039284425 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942289788 0 0) 0x7fb7c4001120 con 0x7fb7cc070d00 2023-09-13T06:07:10.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7cb7fe640 1 -- 172.21.15.130:0/2039284425 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7bc003530 con 0x7fb7cc070d00 2023-09-13T06:07:10.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d0c74640 1 -- 172.21.15.130:0/2039284425 >> v2:172.21.15.164:3300/0 conn(0x7fb7cc146ce0 msgr2=0x7fb7cc0707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:10.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d0c74640 1 --2- 172.21.15.130:0/2039284425 >> v2:172.21.15.164:3300/0 conn(0x7fb7cc146ce0 0x7fb7cc0707c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:10.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d0c74640 1 -- 172.21.15.130:0/2039284425 >> v1:172.21.15.130:6789/0 conn(0x7fb7cc070d00 legacy=0x7fb7cc06f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:10.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7d0c74640 1 -- 172.21.15.130:0/2039284425 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc0ae5f0 con 0x7fb7cc146040 2023-09-13T06:07:10.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.020+0000 7fb7cbfff640 1 --2- 172.21.15.130:0/2039284425 >> v2:172.21.15.164:3300/0 conn(0x7fb7cc146ce0 0x7fb7cc0707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:10.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7d0c74640 1 --2- 172.21.15.130:0/2039284425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146040 0x7fb7cc146420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0009d90 tx=0x7fb7c001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d0f13c41d7aaa5b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:10.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7cb7fe640 1 -- 172.21.15.130:0/2039284425 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c00a57b0 con 0x7fb7cc146040 2023-09-13T06:07:10.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7cb7fe640 1 -- 172.21.15.130:0/2039284425 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c00a5910 con 0x7fb7cc146040 2023-09-13T06:07:10.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7cb7fe640 1 -- 172.21.15.130:0/2039284425 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c00a5ca0 con 0x7fb7cc146040 2023-09-13T06:07:10.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/2039284425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146040 msgr2=0x7fb7cc146420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:10.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7d2ed8640 1 --2- 172.21.15.130:0/2039284425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146040 0x7fb7cc146420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0009d90 tx=0x7fb7c001c950 comp rx=0 tx=0).stop 2023-09-13T06:07:10.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/2039284425 shutdown_connections 2023-09-13T06:07:10.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7d2ed8640 1 --2- 172.21.15.130:0/2039284425 >> v2:172.21.15.164:3300/0 conn(0x7fb7cc146ce0 0x7fb7cc0707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:10.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7d2ed8640 1 --2- 172.21.15.130:0/2039284425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146040 0x7fb7cc146420 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:10.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/2039284425 >> 172.21.15.130:0/2039284425 conn(0x7fb7cc06a730 msgr2=0x7fb7cc065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:10.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/2039284425 shutdown_connections 2023-09-13T06:07:10.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.024+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/2039284425 wait complete. 2023-09-13T06:07:10.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d2ed8640 1 Processor -- start 2023-09-13T06:07:10.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d2ed8640 1 -- start start 2023-09-13T06:07:10.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d2ed8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7cc070d00 0x7fb7cc13ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:10.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d2ed8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc146040 0x7fb7cc0d0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:10.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d2ed8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146ce0 0x7fb7cc15b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:10.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d2ed8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0d0d70 con 0x7fb7cc146040 2023-09-13T06:07:10.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d2ed8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc15c2c0 con 0x7fb7cc070d00 2023-09-13T06:07:10.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d2ed8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc15c5a0 con 0x7fb7cc146ce0 2023-09-13T06:07:10.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7cbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc146040 0x7fb7cc0d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:10.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7cbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc146040 0x7fb7cc0d0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60772/0 (socket says 172.21.15.130:60772) 2023-09-13T06:07:10.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7cbfff640 1 -- 172.21.15.130:0/3624478947 learned_addr learned my addr 172.21.15.130:0/3624478947 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:10.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d0c74640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7cc070d00 0x7fb7cc13ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:10.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d1475640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146ce0 0x7fb7cc15b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:10.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7cbfff640 1 -- 172.21.15.130:0/3624478947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146ce0 msgr2=0x7fb7cc15b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:10.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7cbfff640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146ce0 0x7fb7cc15b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:10.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7cbfff640 1 -- 172.21.15.130:0/3624478947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7cc070d00 msgr2=0x7fb7cc13ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:10.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7cbfff640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7cc070d00 0x7fb7cc13ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:10.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7cbfff640 1 -- 172.21.15.130:0/3624478947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b8009420 con 0x7fb7cc146040 2023-09-13T06:07:10.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d1475640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146ce0 0x7fb7cc15b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:10.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7cbfff640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc146040 0x7fb7cc0d0830 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800ebe0 tx=0x7fb7b800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:10.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7c97fa640 1 -- 172.21.15.130:0/3624478947 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b800eee0 con 0x7fb7cc146040 2023-09-13T06:07:10.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7c97fa640 1 -- 172.21.15.130:0/3624478947 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b800cc30 con 0x7fb7cc146040 2023-09-13T06:07:10.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/3624478947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c0009a70 con 0x7fb7cc146040 2023-09-13T06:07:10.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7c97fa640 1 -- 172.21.15.130:0/3624478947 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8013470 con 0x7fb7cc146040 2023-09-13T06:07:10.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.028+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/3624478947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc15cb60 con 0x7fb7cc146040 2023-09-13T06:07:10.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.032+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/3624478947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7cc0618a0 con 0x7fb7cc146040 2023-09-13T06:07:10.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.032+0000 7fb7c97fa640 1 -- 172.21.15.130:0/3624478947 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb7b80135d0 con 0x7fb7cc146040 2023-09-13T06:07:10.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.032+0000 7fb7c97fa640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 0x7fb7b0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:10.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.032+0000 7fb7c97fa640 1 -- 172.21.15.130:0/3624478947 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7b8083550 con 0x7fb7cc146040 2023-09-13T06:07:10.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.032+0000 7fb7d0c74640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 0x7fb7b0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:10.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.032+0000 7fb7d0c74640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 0x7fb7b0067fe0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00af000 tx=0x7fb7c00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:10.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.036+0000 7fb7c97fa640 1 -- 172.21.15.130:0/3624478947 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb7b8050f40 con 0x7fb7cc146040 2023-09-13T06:07:10.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.212+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/3624478947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb7cc0b1600 con 0x7fb7cc146040 2023-09-13T06:07:10.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.860+0000 7fb7c97fa640 1 -- 172.21.15.130:0/3624478947 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v59) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb7b8054560 con 0x7fb7cc146040 2023-09-13T06:07:10.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/3624478947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 msgr2=0x7fb7b0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:10.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 0x7fb7b0067fe0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00af000 tx=0x7fb7c00a7070 comp rx=0 tx=0).stop 2023-09-13T06:07:10.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/3624478947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc146040 msgr2=0x7fb7cc0d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:10.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc146040 0x7fb7cc0d0830 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800ebe0 tx=0x7fb7b800c520 comp rx=0 tx=0).stop 2023-09-13T06:07:10.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/3624478947 shutdown_connections 2023-09-13T06:07:10.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb7b0065b20 0x7fb7b0067fe0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:10.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7cc146ce0 0x7fb7cc15b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:10.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7cc146040 0x7fb7cc0d0830 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:10.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 --2- 172.21.15.130:0/3624478947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7cc070d00 0x7fb7cc13ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:10.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/3624478947 >> 172.21.15.130:0/3624478947 conn(0x7fb7cc06a730 msgr2=0x7fb7cc13b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:10.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/3624478947 shutdown_connections 2023-09-13T06:07:10.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:10.864+0000 7fb7d2ed8640 1 -- 172.21.15.130:0/3624478947 wait complete. 2023-09-13T06:07:10.887 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T06:07:10.888 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:11.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e4ee48640 1 Processor -- start 2023-09-13T06:07:11.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e4ee48640 1 -- start start 2023-09-13T06:07:11.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e4ee48640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0e480d1090 0x7f0e4815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e4ee48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e48146f30 0x7f0e480b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e4ee48640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e480b63c0 con 0x7f0e480d1750 2023-09-13T06:07:11.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e4ee48640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4815dea0 con 0x7f0e480d1090 2023-09-13T06:07:11.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e4ee48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480d0c20 con 0x7f0e48146f30 2023-09-13T06:07:11.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e4cbe4640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0e480d1750 0x7f0e48146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60790/0 (socket says 172.21.15.130:60790) 2023-09-13T06:07:11.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e4cbe4640 1 -- 172.21.15.130:0/2021874231 learned_addr learned my addr 172.21.15.130:0/2021874231 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:11.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e47fff640 1 --2- 172.21.15.130:0/2021874231 >> v2:172.21.15.130:3300/0 conn(0x7f0e480d1090 0x7f0e4815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e4d3e5640 1 --2- 172.21.15.130:0/2021874231 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e48146f30 0x7f0e480b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e477fe640 1 -- 172.21.15.130:0/2021874231 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691215257 0 0) 0x7f0e480b63c0 con 0x7f0e480d1750 2023-09-13T06:07:11.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e477fe640 1 -- 172.21.15.130:0/2021874231 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e38003530 con 0x7f0e480d1750 2023-09-13T06:07:11.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e47fff640 1 -- 172.21.15.130:0/2021874231 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e48146f30 msgr2=0x7f0e480b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:11.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e47fff640 1 --2- 172.21.15.130:0/2021874231 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e48146f30 0x7f0e480b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e47fff640 1 -- 172.21.15.130:0/2021874231 >> v1:172.21.15.130:6789/0 conn(0x7f0e480d1750 legacy=0x7f0e48146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.028+0000 7f0e47fff640 1 -- 172.21.15.130:0/2021874231 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480b6610 con 0x7f0e480d1090 2023-09-13T06:07:11.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e47fff640 1 --2- 172.21.15.130:0/2021874231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e480d1090 0x7f0e4815d960 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f0e340097c0 tx=0x7f0e3401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42dc83ea2b73749 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:11.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e477fe640 1 -- 172.21.15.130:0/2021874231 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e340ab650 con 0x7f0e480d1090 2023-09-13T06:07:11.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e477fe640 1 -- 172.21.15.130:0/2021874231 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e340ab7b0 con 0x7f0e480d1090 2023-09-13T06:07:11.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e477fe640 1 -- 172.21.15.130:0/2021874231 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e340abb40 con 0x7f0e480d1090 2023-09-13T06:07:11.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e4ee48640 1 -- 172.21.15.130:0/2021874231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e480d1090 msgr2=0x7f0e4815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e4ee48640 1 --2- 172.21.15.130:0/2021874231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e480d1090 0x7f0e4815d960 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f0e340097c0 tx=0x7f0e3401c450 comp rx=0 tx=0).stop 2023-09-13T06:07:11.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e4ee48640 1 -- 172.21.15.130:0/2021874231 shutdown_connections 2023-09-13T06:07:11.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e4ee48640 1 --2- 172.21.15.130:0/2021874231 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e48146f30 0x7f0e480b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e4ee48640 1 --2- 172.21.15.130:0/2021874231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e480d1090 0x7f0e4815d960 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e4ee48640 1 -- 172.21.15.130:0/2021874231 >> 172.21.15.130:0/2021874231 conn(0x7f0e4806f170 msgr2=0x7f0e4806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:11.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e4ee48640 1 -- 172.21.15.130:0/2021874231 shutdown_connections 2023-09-13T06:07:11.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.032+0000 7f0e4ee48640 1 -- 172.21.15.130:0/2021874231 wait complete. 2023-09-13T06:07:11.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4ee48640 1 Processor -- start 2023-09-13T06:07:11.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4ee48640 1 -- start start 2023-09-13T06:07:11.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4ee48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e480d1090 0x7f0e4813dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4ee48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e480d1750 0x7f0e48158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4ee48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e48146f30 0x7f0e4815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4ee48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e48159530 con 0x7f0e48146f30 2023-09-13T06:07:11.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4ee48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e48159eb0 con 0x7f0e480d1750 2023-09-13T06:07:11.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4ee48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4815a190 con 0x7f0e480d1090 2023-09-13T06:07:11.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4d3e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e48146f30 0x7f0e4815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4d3e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e48146f30 0x7f0e4815b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59094/0 (socket says 172.21.15.130:59094) 2023-09-13T06:07:11.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4d3e5640 1 -- 172.21.15.130:0/933413811 learned_addr learned my addr 172.21.15.130:0/933413811 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:11.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4cbe4640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e480d1090 0x7f0e4813dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e47fff640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e480d1750 0x7f0e48158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4d3e5640 1 -- 172.21.15.130:0/933413811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e480d1090 msgr2=0x7f0e4813dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4d3e5640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e480d1090 0x7f0e4813dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4d3e5640 1 -- 172.21.15.130:0/933413811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e480d1750 msgr2=0x7f0e48158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4d3e5640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e480d1750 0x7f0e48158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4d3e5640 1 -- 172.21.15.130:0/933413811 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34009420 con 0x7f0e48146f30 2023-09-13T06:07:11.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4d3e5640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e48146f30 0x7f0e4815b530 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f0e40007e60 tx=0x7f0e4000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:11.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e457fa640 1 -- 172.21.15.130:0/933413811 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40014420 con 0x7f0e48146f30 2023-09-13T06:07:11.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e457fa640 1 -- 172.21.15.130:0/933413811 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e400145a0 con 0x7f0e48146f30 2023-09-13T06:07:11.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4ee48640 1 -- 172.21.15.130:0/933413811 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e480b7e40 con 0x7f0e48146f30 2023-09-13T06:07:11.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e457fa640 1 -- 172.21.15.130:0/933413811 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40014950 con 0x7f0e48146f30 2023-09-13T06:07:11.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4ee48640 1 -- 172.21.15.130:0/933413811 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4815a750 con 0x7f0e48146f30 2023-09-13T06:07:11.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.036+0000 7f0e4ee48640 1 -- 172.21.15.130:0/933413811 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e480618a0 con 0x7f0e48146f30 2023-09-13T06:07:11.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.040+0000 7f0e457fa640 1 -- 172.21.15.130:0/933413811 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0e40014ab0 con 0x7f0e48146f30 2023-09-13T06:07:11.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.040+0000 7f0e457fa640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 0x7f0e2c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.040+0000 7f0e457fa640 1 -- 172.21.15.130:0/933413811 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e40083c30 con 0x7f0e48146f30 2023-09-13T06:07:11.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.040+0000 7f0e4cbe4640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 0x7f0e2c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.040+0000 7f0e4cbe4640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 0x7f0e2c067fe0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0011f0 tx=0x7f0e3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:11.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.044+0000 7f0e457fa640 1 -- 172.21.15.130:0/933413811 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0e40051570 con 0x7f0e48146f30 2023-09-13T06:07:11.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.220+0000 7f0e4ee48640 1 -- 172.21.15.130:0/933413811 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e480b86c0 con 0x7f0e48146f30 2023-09-13T06:07:11.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.220+0000 7f0e457fa640 1 -- 172.21.15.130:0/933413811 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f0e40054b90 con 0x7f0e48146f30 2023-09-13T06:07:11.223 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:11.223 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2121062896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2121062896},{"type":"v1","addr":"172.21.15.164:6834","nonce":2121062896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3004233572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3004233572},{"type":"v1","addr":"172.21.15.164:6835","nonce":3004233572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7311,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3730755977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3730755977},{"type":"v1","addr":"172.21.15.130:6835","nonce":3730755977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:07.210560+0000","modified":"2023-09-13T06:07:10.218199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/4103504372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4103504372},{"type":"v1","addr":"172.21.15.130:6837","nonce":4103504372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-09-13T06:07:11.224 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 59 2023-09-13T06:07:11.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.220+0000 7f0e4ee48640 1 -- 172.21.15.130:0/933413811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 msgr2=0x7f0e2c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.220+0000 7f0e4ee48640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 0x7f0e2c067fe0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0011f0 tx=0x7f0e3c009040 comp rx=0 tx=0).stop 2023-09-13T06:07:11.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.220+0000 7f0e4ee48640 1 -- 172.21.15.130:0/933413811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e48146f30 msgr2=0x7f0e4815b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.220+0000 7f0e4ee48640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e48146f30 0x7f0e4815b530 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f0e40007e60 tx=0x7f0e4000e4b0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.224+0000 7f0e4ee48640 1 -- 172.21.15.130:0/933413811 shutdown_connections 2023-09-13T06:07:11.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.224+0000 7f0e4ee48640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 0x7f0e2c067fe0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.224+0000 7f0e4ee48640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e480d1750 0x7f0e48158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.224+0000 7f0e4ee48640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e48146f30 0x7f0e4815b530 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.224+0000 7f0e4ee48640 1 --2- 172.21.15.130:0/933413811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e480d1090 0x7f0e4813dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.224+0000 7f0e4ee48640 1 -- 172.21.15.130:0/933413811 >> 172.21.15.130:0/933413811 conn(0x7f0e4806f170 msgr2=0x7f0e4813f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:11.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.224+0000 7f0e4ee48640 1 -- 172.21.15.130:0/933413811 shutdown_connections 2023-09-13T06:07:11.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.224+0000 7f0e4ee48640 1 -- 172.21.15.130:0/933413811 wait complete. 2023-09-13T06:07:11.244 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:11.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.380+0000 7fcbbdecb640 1 Processor -- start 2023-09-13T06:07:11.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.380+0000 7fcbbdecb640 1 -- start start 2023-09-13T06:07:11.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.380+0000 7fcbbdecb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb815d5f0 0x7fcbb80cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.380+0000 7fcbbdecb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcbb815d9d0 0x7fcbb80cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.380+0000 7fcbbdecb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb80cce60 con 0x7fcbb80ae170 2023-09-13T06:07:11.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.380+0000 7fcbbdecb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb80cd140 con 0x7fcbb815d9d0 2023-09-13T06:07:11.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.380+0000 7fcbbdecb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80cd420 con 0x7fcbb815d5f0 2023-09-13T06:07:11.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb7fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcbb815d9d0 0x7fcbb80cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb7fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcbb815d9d0 0x7fcbb80cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59106/0 (socket says 172.21.15.130:59106) 2023-09-13T06:07:11.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb7fff640 1 -- 172.21.15.130:0/1176478925 learned_addr learned my addr 172.21.15.130:0/1176478925 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:11.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb77fe640 1 --2- 172.21.15.130:0/1176478925 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb815d5f0 0x7fcbb80cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb7fff640 1 -- 172.21.15.130:0/1176478925 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb815d5f0 msgr2=0x7fcbb80cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:11.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb7fff640 1 --2- 172.21.15.130:0/1176478925 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb815d5f0 0x7fcbb80cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb7fff640 1 -- 172.21.15.130:0/1176478925 >> v1:172.21.15.130:6789/0 conn(0x7fcbb80ae170 legacy=0x7fcbb81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb7fff640 1 -- 172.21.15.130:0/1176478925 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb80cd700 con 0x7fcbb815d9d0 2023-09-13T06:07:11.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb7fff640 1 --2- 172.21.15.130:0/1176478925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb815d9d0 0x7fcbb80cb040 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009e50 tx=0x7fcbb001da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad89f26bc0f63e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:11.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb6ffd640 1 -- 172.21.15.130:0/1176478925 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00a6800 con 0x7fcbb815d9d0 2023-09-13T06:07:11.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb6ffd640 1 -- 172.21.15.130:0/1176478925 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb00a6960 con 0x7fcbb815d9d0 2023-09-13T06:07:11.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.384+0000 7fcbb6ffd640 1 -- 172.21.15.130:0/1176478925 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00a6cf0 con 0x7fcbb815d9d0 2023-09-13T06:07:11.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1176478925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb815d9d0 msgr2=0x7fcbb80cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 --2- 172.21.15.130:0/1176478925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb815d9d0 0x7fcbb80cb040 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009e50 tx=0x7fcbb001da90 comp rx=0 tx=0).stop 2023-09-13T06:07:11.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1176478925 shutdown_connections 2023-09-13T06:07:11.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 --2- 172.21.15.130:0/1176478925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb815d9d0 0x7fcbb80cb040 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 --2- 172.21.15.130:0/1176478925 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb815d5f0 0x7fcbb80cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1176478925 >> 172.21.15.130:0/1176478925 conn(0x7fcbb8065990 msgr2=0x7fcbb8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:11.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1176478925 shutdown_connections 2023-09-13T06:07:11.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1176478925 wait complete. 2023-09-13T06:07:11.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 Processor -- start 2023-09-13T06:07:11.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 -- start start 2023-09-13T06:07:11.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb80ae170 0x7fcbb815b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb815d5f0 0x7fcbb80ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb815d9d0 0x7fcbb815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb8166f20 con 0x7fcbb815d9d0 2023-09-13T06:07:11.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb815c160 con 0x7fcbb80ae170 2023-09-13T06:07:11.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbbdecb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb815cc50 con 0x7fcbb815d5f0 2023-09-13T06:07:11.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbb7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb815d9d0 0x7fcbb815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbb7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb815d9d0 0x7fcbb815c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59114/0 (socket says 172.21.15.130:59114) 2023-09-13T06:07:11.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbb7fff640 1 -- 172.21.15.130:0/1340541139 learned_addr learned my addr 172.21.15.130:0/1340541139 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:11.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbb77fe640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb80ae170 0x7fcbb815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbaffff640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb815d5f0 0x7fcbb80ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbb7fff640 1 -- 172.21.15.130:0/1340541139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb815d5f0 msgr2=0x7fcbb80ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbb7fff640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb815d5f0 0x7fcbb80ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbb7fff640 1 -- 172.21.15.130:0/1340541139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb80ae170 msgr2=0x7fcbb815b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbb7fff640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb80ae170 0x7fcbb815b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbb7fff640 1 -- 172.21.15.130:0/1340541139 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb0009b30 con 0x7fcbb815d9d0 2023-09-13T06:07:11.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.388+0000 7fcbb7fff640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb815d9d0 0x7fcbb815c710 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009e50 tx=0x7fcbb001c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:11.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.392+0000 7fcbb4ff9640 1 -- 172.21.15.130:0/1340541139 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00b8810 con 0x7fcbb815d9d0 2023-09-13T06:07:11.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.392+0000 7fcbb4ff9640 1 -- 172.21.15.130:0/1340541139 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb00b8970 con 0x7fcbb815d9d0 2023-09-13T06:07:11.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.392+0000 7fcbb4ff9640 1 -- 172.21.15.130:0/1340541139 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00b8d00 con 0x7fcbb815d9d0 2023-09-13T06:07:11.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.392+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1340541139 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb815be80 con 0x7fcbb815d9d0 2023-09-13T06:07:11.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.392+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1340541139 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb8166b40 con 0x7fcbb815d9d0 2023-09-13T06:07:11.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.392+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1340541139 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb8167060 con 0x7fcbb815d9d0 2023-09-13T06:07:11.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.392+0000 7fcbb4ff9640 1 -- 172.21.15.130:0/1340541139 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcbb00ae3f0 con 0x7fcbb815d9d0 2023-09-13T06:07:11.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.392+0000 7fcbb4ff9640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb98065b20 0x7fcb98067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.392+0000 7fcbb4ff9640 1 -- 172.21.15.130:0/1340541139 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbb011e380 con 0x7fcbb815d9d0 2023-09-13T06:07:11.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.392+0000 7fcbb77fe640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb98065b20 0x7fcb98067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.392+0000 7fcbb77fe640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb98065b20 0x7fcb98067fe0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcba8007a60 tx=0x7fcba8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:11.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.396+0000 7fcbb4ff9640 1 -- 172.21.15.130:0/1340541139 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcbb8167060 con 0x7fcbb815d9d0 2023-09-13T06:07:11.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.544+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1340541139 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbb8167060 con 0x7fcbb815d9d0 2023-09-13T06:07:11.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbb4ff9640 1 -- 172.21.15.130:0/1340541139 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16556 (secure 0 0 0) 0x7fcbb8167060 con 0x7fcbb815d9d0 2023-09-13T06:07:11.550 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:11.550 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":123,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:08.370118+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:05.156883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:06.213714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:11.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1340541139 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb98065b20 msgr2=0x7fcb98067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb98065b20 0x7fcb98067fe0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcba8007a60 tx=0x7fcba8008040 comp rx=0 tx=0).stop 2023-09-13T06:07:11.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1340541139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb815d9d0 msgr2=0x7fcbb815c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb815d9d0 0x7fcbb815c710 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009e50 tx=0x7fcbb001c2d0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1340541139 shutdown_connections 2023-09-13T06:07:11.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb98065b20 0x7fcb98067fe0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb815d9d0 0x7fcbb815c710 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb815d5f0 0x7fcbb80ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 --2- 172.21.15.130:0/1340541139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb80ae170 0x7fcbb815b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1340541139 >> 172.21.15.130:0/1340541139 conn(0x7fcbb8065990 msgr2=0x7fcbb80ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:11.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1340541139 shutdown_connections 2023-09-13T06:07:11.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.548+0000 7fcbbdecb640 1 -- 172.21.15.130:0/1340541139 wait complete. 2023-09-13T06:07:11.571 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T06:07:11.571 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:07:11.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b81511640 1 Processor -- start 2023-09-13T06:07:11.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b81511640 1 -- start start 2023-09-13T06:07:11.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b81511640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5b7c146f30 0x7f5b7c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b81511640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c0b63c0 con 0x7f5b7c0d1750 2023-09-13T06:07:11.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b81511640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c0d0c20 con 0x7f5b7c0d1090 2023-09-13T06:07:11.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b81511640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c15dea0 con 0x7f5b7c146f30 2023-09-13T06:07:11.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7affd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5b7c0d1750 0x7f5b7c146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60812/0 (socket says 172.21.15.130:60812) 2023-09-13T06:07:11.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7affd640 1 -- 172.21.15.130:0/2565592552 learned_addr learned my addr 172.21.15.130:0/2565592552 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:11.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7b7fe640 1 --2- 172.21.15.130:0/2565592552 >> v2:172.21.15.164:3300/0 conn(0x7f5b7c146f30 0x7f5b7c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419741405 0 0) 0x7f5b7c0b63c0 con 0x7f5b7c0d1750 2023-09-13T06:07:11.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b68003530 con 0x7f5b7c0d1750 2023-09-13T06:07:11.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871801348 0 0) 0x7f5b7c0d0c20 con 0x7f5b7c0d1090 2023-09-13T06:07:11.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b7c0b63c0 con 0x7f5b7c0d1090 2023-09-13T06:07:11.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3020013011 0 0) 0x7f5b68003530 con 0x7f5b7c0d1750 2023-09-13T06:07:11.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 >> v2:172.21.15.164:3300/0 conn(0x7f5b7c146f30 msgr2=0x7f5b7c15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:11.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 --2- 172.21.15.130:0/2565592552 >> v2:172.21.15.164:3300/0 conn(0x7f5b7c146f30 0x7f5b7c15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 >> v1:172.21.15.164:6789/0 conn(0x7f5b7c0d1090 legacy=0x7f5b7c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0b6610 con 0x7f5b7c0d1750 2023-09-13T06:07:11.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f5b64001680 con 0x7f5b7c0d1750 2023-09-13T06:07:11.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 >> v1:172.21.15.130:6789/0 conn(0x7f5b7c0d1750 legacy=0x7f5b7c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b68003b80 0x7f5b68003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 0x7f5b68004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b680051e0 0x7f5b6800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6800c100 con 0x7f5b680047d0 2023-09-13T06:07:11.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6800c270 con 0x7f5b68003b80 2023-09-13T06:07:11.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6800c430 con 0x7f5b680051e0 2023-09-13T06:07:11.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.708+0000 7f5b727fc640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 0x7f5b68004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b7affd640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b68003b80 0x7f5b68003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b7b7fe640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b680051e0 0x7f5b6800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b727fc640 1 -- 172.21.15.130:0/2565592552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b680051e0 msgr2=0x7f5b6800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:11.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b727fc640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b680051e0 0x7f5b6800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b727fc640 1 -- 172.21.15.130:0/2565592552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b68003b80 msgr2=0x7f5b68003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:11.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b727fc640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b68003b80 0x7f5b68003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b727fc640 1 -- 172.21.15.130:0/2565592552 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b68003530 con 0x7f5b680047d0 2023-09-13T06:07:11.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b7affd640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b68003b80 0x7f5b68003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:11.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b7b7fe640 1 -- 172.21.15.130:0/2565592552 reap_dead start 2023-09-13T06:07:11.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b727fc640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 0x7f5b68004c50 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c007fd0 tx=0x7f5b6c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35dae93a96a114f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:11.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0052d0 con 0x7f5b680047d0 2023-09-13T06:07:11.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0a7050 con 0x7f5b680047d0 2023-09-13T06:07:11.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.712+0000 7f5b7a7fc640 1 -- 172.21.15.130:0/2565592552 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c003600 con 0x7f5b680047d0 2023-09-13T06:07:11.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 -- 172.21.15.130:0/2565592552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 msgr2=0x7f5b68004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 0x7f5b68004c50 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c007fd0 tx=0x7f5b6c01c470 comp rx=0 tx=0).stop 2023-09-13T06:07:11.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 -- 172.21.15.130:0/2565592552 shutdown_connections 2023-09-13T06:07:11.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 --2- 172.21.15.130:0/2565592552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 0x7f5b68004c50 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 -- 172.21.15.130:0/2565592552 >> 172.21.15.130:0/2565592552 conn(0x7f5b7c06f170 msgr2=0x7f5b7c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:11.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 -- 172.21.15.130:0/2565592552 shutdown_connections 2023-09-13T06:07:11.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 -- 172.21.15.130:0/2565592552 wait complete. 2023-09-13T06:07:11.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 Processor -- start 2023-09-13T06:07:11.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 -- start start 2023-09-13T06:07:11.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 0x7f5b7c15d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b7c0cdc40 0x7f5b7c0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b7c141980 0x7f5b7c141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0ce5e0 con 0x7f5b680047d0 2023-09-13T06:07:11.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c142fa0 con 0x7f5b7c0cdc40 2023-09-13T06:07:11.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b81511640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0c92f0 con 0x7f5b7c141980 2023-09-13T06:07:11.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 0x7f5b7c15d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 0x7f5b7c15d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59124/0 (socket says 172.21.15.130:59124) 2023-09-13T06:07:11.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.716+0000 7f5b7affd640 1 -- 172.21.15.130:0/781527062 learned_addr learned my addr 172.21.15.130:0/781527062 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:11.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b7b7fe640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b7c141980 0x7f5b7c141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b727fc640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b7c0cdc40 0x7f5b7c0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b7affd640 1 -- 172.21.15.130:0/781527062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b7c141980 msgr2=0x7f5b7c141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b7affd640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b7c141980 0x7f5b7c141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b7affd640 1 -- 172.21.15.130:0/781527062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b7c0cdc40 msgr2=0x7f5b7c0ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b7affd640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b7c0cdc40 0x7f5b7c0ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b7affd640 1 -- 172.21.15.130:0/781527062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c142700 con 0x7f5b680047d0 2023-09-13T06:07:11.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b7affd640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 0x7f5b7c15d0d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f5b64007290 tx=0x7f5b64007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:11.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b73fff640 1 -- 172.21.15.130:0/781527062 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6400f940 con 0x7f5b680047d0 2023-09-13T06:07:11.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b73fff640 1 -- 172.21.15.130:0/781527062 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6400faa0 con 0x7f5b680047d0 2023-09-13T06:07:11.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b81511640 1 -- 172.21.15.130:0/781527062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c1429e0 con 0x7f5b680047d0 2023-09-13T06:07:11.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b73fff640 1 -- 172.21.15.130:0/781527062 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6400fe10 con 0x7f5b680047d0 2023-09-13T06:07:11.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b81511640 1 -- 172.21.15.130:0/781527062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c142340 con 0x7f5b680047d0 2023-09-13T06:07:11.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b81511640 1 -- 172.21.15.130:0/781527062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c0618a0 con 0x7f5b680047d0 2023-09-13T06:07:11.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.720+0000 7f5b73fff640 1 -- 172.21.15.130:0/781527062 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5b6401d460 con 0x7f5b680047d0 2023-09-13T06:07:11.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.724+0000 7f5b73fff640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b5c065b50 0x7f5b5c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:11.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.724+0000 7f5b73fff640 1 -- 172.21.15.130:0/781527062 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b64083250 con 0x7f5b680047d0 2023-09-13T06:07:11.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.724+0000 7f5b727fc640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b5c065b50 0x7f5b5c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:11.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.724+0000 7f5b727fc640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b5c065b50 0x7f5b5c068010 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0ac000 tx=0x7f5b6c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:11.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.728+0000 7f5b73fff640 1 -- 172.21.15.130:0/781527062 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5b64050b90 con 0x7f5b680047d0 2023-09-13T06:07:11.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.872+0000 7f5b81511640 1 -- 172.21.15.130:0/781527062 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b7c15d960 con 0x7f5b5c065b50 2023-09-13T06:07:11.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.880+0000 7f5b73fff640 1 -- 172.21.15.130:0/781527062 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285054 (secure 0 0 0) 0x7f5b6c0052b0 con 0x7f5b5c065b50 2023-09-13T06:07:11.885 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:11.887 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:07:11.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 -- 172.21.15.130:0/781527062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b5c065b50 msgr2=0x7f5b5c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b5c065b50 0x7f5b5c068010 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0ac000 tx=0x7f5b6c0a6000 comp rx=0 tx=0).stop 2023-09-13T06:07:11.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 -- 172.21.15.130:0/781527062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 msgr2=0x7f5b7c15d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:11.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 0x7f5b7c15d0d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f5b64007290 tx=0x7f5b64007750 comp rx=0 tx=0).stop 2023-09-13T06:07:11.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 -- 172.21.15.130:0/781527062 shutdown_connections 2023-09-13T06:07:11.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b5c065b50 0x7f5b5c068010 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b7c0cdc40 0x7f5b7c0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b7c141980 0x7f5b7c141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 --2- 172.21.15.130:0/781527062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b680047d0 0x7f5b7c15d0d0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:11.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 -- 172.21.15.130:0/781527062 >> 172.21.15.130:0/781527062 conn(0x7f5b7c06f170 msgr2=0x7f5b7c0cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:11.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 -- 172.21.15.130:0/781527062 shutdown_connections 2023-09-13T06:07:11.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:11.884+0000 7f5b81511640 1 -- 172.21.15.130:0/781527062 wait complete. 2023-09-13T06:07:11.905 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2023-09-13T06:07:10.608507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556060,"statfs":{"total":1600000000,"available":1593406136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.783907"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.373994+0000","last_change":"2023-09-13T06:07:07.380471+0000","last_active":"2023-09-13T06:07:08.373994+0000","last_peered":"2023-09-13T06:07:08.373994+0000","last_clean":"2023-09-13T06:07:08.373994+0000","last_became_active":"2023-09-13T06:07:07.380262+0000","last_became_peered":"2023-09-13T06:07:07.380262+0000","last_unstale":"2023-09-13T06:07:08.373994+0000","last_undegraded":"2023-09-13T06:07:08.373994+0000","last_fullsized":"2023-09-13T06:07:08.373994+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:50.365706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.382540+0000","last_change":"2023-09-13T06:07:07.382423+0000","last_active":"2023-09-13T06:07:07.382540+0000","last_peered":"2023-09-13T06:07:07.382540+0000","last_clean":"2023-09-13T06:07:07.382540+0000","last_became_active":"2023-09-13T06:07:07.382083+0000","last_became_peered":"2023-09-13T06:07:07.382083+0000","last_unstale":"2023-09-13T06:07:07.382540+0000","last_undegraded":"2023-09-13T06:07:07.382540+0000","last_fullsized":"2023-09-13T06:07:07.382540+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:45.186221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.373994+0000","last_change":"2023-09-13T06:07:07.382635+0000","last_active":"2023-09-13T06:07:08.373994+0000","last_peered":"2023-09-13T06:07:08.373994+0000","last_clean":"2023-09-13T06:07:08.373994+0000","last_became_active":"2023-09-13T06:07:07.382356+0000","last_became_peered":"2023-09-13T06:07:07.382356+0000","last_unstale":"2023-09-13T06:07:08.373994+0000","last_undegraded":"2023-09-13T06:07:08.373994+0000","last_fullsized":"2023-09-13T06:07:08.373994+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:36:23.460094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.379640+0000","last_change":"2023-09-13T06:07:07.379579+0000","last_active":"2023-09-13T06:07:07.379640+0000","last_peered":"2023-09-13T06:07:07.379640+0000","last_clean":"2023-09-13T06:07:07.379640+0000","last_became_active":"2023-09-13T06:07:07.379369+0000","last_became_peered":"2023-09-13T06:07:07.379369+0000","last_unstale":"2023-09-13T06:07:07.379640+0000","last_undegraded":"2023-09-13T06:07:07.379640+0000","last_fullsized":"2023-09-13T06:07:07.379640+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:45.808683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.389837+0000","last_change":"2023-09-13T06:07:07.389752+0000","last_active":"2023-09-13T06:07:07.389837+0000","last_peered":"2023-09-13T06:07:07.389837+0000","last_clean":"2023-09-13T06:07:07.389837+0000","last_became_active":"2023-09-13T06:07:07.389411+0000","last_became_peered":"2023-09-13T06:07:07.389411+0000","last_unstale":"2023-09-13T06:07:07.389837+0000","last_undegraded":"2023-09-13T06:07:07.389837+0000","last_fullsized":"2023-09-13T06:07:07.389837+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:37.293205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374298+0000","last_change":"2023-09-13T06:07:07.387621+0000","last_active":"2023-09-13T06:07:08.374298+0000","last_peered":"2023-09-13T06:07:08.374298+0000","last_clean":"2023-09-13T06:07:08.374298+0000","last_became_active":"2023-09-13T06:07:07.387394+0000","last_became_peered":"2023-09-13T06:07:07.387394+0000","last_unstale":"2023-09-13T06:07:08.374298+0000","last_undegraded":"2023-09-13T06:07:08.374298+0000","last_fullsized":"2023-09-13T06:07:08.374298+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:12:31.442929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374197+0000","last_change":"2023-09-13T06:07:07.388478+0000","last_active":"2023-09-13T06:07:08.374197+0000","last_peered":"2023-09-13T06:07:08.374197+0000","last_clean":"2023-09-13T06:07:08.374197+0000","last_became_active":"2023-09-13T06:07:07.388244+0000","last_became_peered":"2023-09-13T06:07:07.388244+0000","last_unstale":"2023-09-13T06:07:08.374197+0000","last_undegraded":"2023-09-13T06:07:08.374197+0000","last_fullsized":"2023-09-13T06:07:08.374197+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:45:32.170877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.381116+0000","last_change":"2023-09-13T06:07:07.381006+0000","last_active":"2023-09-13T06:07:07.381116+0000","last_peered":"2023-09-13T06:07:07.381116+0000","last_clean":"2023-09-13T06:07:07.381116+0000","last_became_active":"2023-09-13T06:07:07.380728+0000","last_became_peered":"2023-09-13T06:07:07.380728+0000","last_unstale":"2023-09-13T06:07:07.381116+0000","last_undegraded":"2023-09-13T06:07:07.381116+0000","last_fullsized":"2023-09-13T06:07:07.381116+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:45.451849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.389118+0000","last_change":"2023-09-13T06:07:07.389007+0000","last_active":"2023-09-13T06:07:07.389118+0000","last_peered":"2023-09-13T06:07:07.389118+0000","last_clean":"2023-09-13T06:07:07.389118+0000","last_became_active":"2023-09-13T06:07:07.388478+0000","last_became_peered":"2023-09-13T06:07:07.388478+0000","last_unstale":"2023-09-13T06:07:07.389118+0000","last_undegraded":"2023-09-13T06:07:07.389118+0000","last_fullsized":"2023-09-13T06:07:07.389118+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:36:11.629639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.385698+0000","last_change":"2023-09-13T06:07:07.385584+0000","last_active":"2023-09-13T06:07:07.385698+0000","last_peered":"2023-09-13T06:07:07.385698+0000","last_clean":"2023-09-13T06:07:07.385698+0000","last_became_active":"2023-09-13T06:07:07.384740+0000","last_became_peered":"2023-09-13T06:07:07.384740+0000","last_unstale":"2023-09-13T06:07:07.385698+0000","last_undegraded":"2023-09-13T06:07:07.385698+0000","last_fullsized":"2023-09-13T06:07:07.385698+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:26:02.921507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374442+0000","last_change":"2023-09-13T06:07:07.391568+0000","last_active":"2023-09-13T06:07:08.374442+0000","last_peered":"2023-09-13T06:07:08.374442+0000","last_clean":"2023-09-13T06:07:08.374442+0000","last_became_active":"2023-09-13T06:07:07.390883+0000","last_became_peered":"2023-09-13T06:07:07.390883+0000","last_unstale":"2023-09-13T06:07:08.374442+0000","last_undegraded":"2023-09-13T06:07:08.374442+0000","last_fullsized":"2023-09-13T06:07:08.374442+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:05:12.769078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387531+0000","last_change":"2023-09-13T06:07:07.387262+0000","last_active":"2023-09-13T06:07:07.387531+0000","last_peered":"2023-09-13T06:07:07.387531+0000","last_clean":"2023-09-13T06:07:07.387531+0000","last_became_active":"2023-09-13T06:07:07.386992+0000","last_became_peered":"2023-09-13T06:07:07.386992+0000","last_unstale":"2023-09-13T06:07:07.387531+0000","last_undegraded":"2023-09-13T06:07:07.387531+0000","last_fullsized":"2023-09-13T06:07:07.387531+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:49:47.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.384529+0000","last_change":"2023-09-13T06:07:07.384463+0000","last_active":"2023-09-13T06:07:07.384529+0000","last_peered":"2023-09-13T06:07:07.384529+0000","last_clean":"2023-09-13T06:07:07.384529+0000","last_became_active":"2023-09-13T06:07:07.384251+0000","last_became_peered":"2023-09-13T06:07:07.384251+0000","last_unstale":"2023-09-13T06:07:07.384529+0000","last_undegraded":"2023-09-13T06:07:07.384529+0000","last_fullsized":"2023-09-13T06:07:07.384529+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:08:34.914025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374846+0000","last_change":"2023-09-13T06:07:07.385448+0000","last_active":"2023-09-13T06:07:08.374846+0000","last_peered":"2023-09-13T06:07:08.374846+0000","last_clean":"2023-09-13T06:07:08.374846+0000","last_became_active":"2023-09-13T06:07:07.385226+0000","last_became_peered":"2023-09-13T06:07:07.385226+0000","last_unstale":"2023-09-13T06:07:08.374846+0000","last_undegraded":"2023-09-13T06:07:08.374846+0000","last_fullsized":"2023-09-13T06:07:08.374846+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:10:43.936407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.376922+0000","last_change":"2023-09-13T06:07:07.376703+0000","last_active":"2023-09-13T06:07:07.376922+0000","last_peered":"2023-09-13T06:07:07.376922+0000","last_clean":"2023-09-13T06:07:07.376922+0000","last_became_active":"2023-09-13T06:07:07.376329+0000","last_became_peered":"2023-09-13T06:07:07.376329+0000","last_unstale":"2023-09-13T06:07:07.376922+0000","last_undegraded":"2023-09-13T06:07:07.376922+0000","last_fullsized":"2023-09-13T06:07:07.376922+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:22:06.852006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374551+0000","last_change":"2023-09-13T06:07:07.391418+0000","last_active":"2023-09-13T06:07:08.374551+0000","last_peered":"2023-09-13T06:07:08.374551+0000","last_clean":"2023-09-13T06:07:08.374551+0000","last_became_active":"2023-09-13T06:07:07.390520+0000","last_became_peered":"2023-09-13T06:07:07.390520+0000","last_unstale":"2023-09-13T06:07:08.374551+0000","last_undegraded":"2023-09-13T06:07:08.374551+0000","last_fullsized":"2023-09-13T06:07:08.374551+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:19.269661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.378169+0000","last_change":"2023-09-13T06:07:07.378107+0000","last_active":"2023-09-13T06:07:07.378169+0000","last_peered":"2023-09-13T06:07:07.378169+0000","last_clean":"2023-09-13T06:07:07.378169+0000","last_became_active":"2023-09-13T06:07:07.377895+0000","last_became_peered":"2023-09-13T06:07:07.377895+0000","last_unstale":"2023-09-13T06:07:07.378169+0000","last_undegraded":"2023-09-13T06:07:07.378169+0000","last_fullsized":"2023-09-13T06:07:07.378169+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:54:32.683261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.380109+0000","last_change":"2023-09-13T06:07:07.380046+0000","last_active":"2023-09-13T06:07:07.380109+0000","last_peered":"2023-09-13T06:07:07.380109+0000","last_clean":"2023-09-13T06:07:07.380109+0000","last_became_active":"2023-09-13T06:07:07.379831+0000","last_became_peered":"2023-09-13T06:07:07.379831+0000","last_unstale":"2023-09-13T06:07:07.380109+0000","last_undegraded":"2023-09-13T06:07:07.380109+0000","last_fullsized":"2023-09-13T06:07:07.380109+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:19:17.374934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374968+0000","last_change":"2023-09-13T06:07:07.384224+0000","last_active":"2023-09-13T06:07:08.374968+0000","last_peered":"2023-09-13T06:07:08.374968+0000","last_clean":"2023-09-13T06:07:08.374968+0000","last_became_active":"2023-09-13T06:07:07.381330+0000","last_became_peered":"2023-09-13T06:07:07.381330+0000","last_unstale":"2023-09-13T06:07:08.374968+0000","last_undegraded":"2023-09-13T06:07:08.374968+0000","last_fullsized":"2023-09-13T06:07:08.374968+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:20.457097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.386021+0000","last_change":"2023-09-13T06:07:07.385949+0000","last_active":"2023-09-13T06:07:07.386021+0000","last_peered":"2023-09-13T06:07:07.386021+0000","last_clean":"2023-09-13T06:07:07.386021+0000","last_became_active":"2023-09-13T06:07:07.385715+0000","last_became_peered":"2023-09-13T06:07:07.385715+0000","last_unstale":"2023-09-13T06:07:07.386021+0000","last_undegraded":"2023-09-13T06:07:07.386021+0000","last_fullsized":"2023-09-13T06:07:07.386021+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:28:40.489286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375245+0000","last_change":"2023-09-13T06:07:07.380698+0000","last_active":"2023-09-13T06:07:08.375245+0000","last_peered":"2023-09-13T06:07:08.375245+0000","last_clean":"2023-09-13T06:07:08.375245+0000","last_became_active":"2023-09-13T06:07:07.380430+0000","last_became_peered":"2023-09-13T06:07:07.380430+0000","last_unstale":"2023-09-13T06:07:08.375245+0000","last_undegraded":"2023-09-13T06:07:08.375245+0000","last_fullsized":"2023-09-13T06:07:08.375245+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:31.956674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.382524+0000","last_change":"2023-09-13T06:07:07.382294+0000","last_active":"2023-09-13T06:07:07.382524+0000","last_peered":"2023-09-13T06:07:07.382524+0000","last_clean":"2023-09-13T06:07:07.382524+0000","last_became_active":"2023-09-13T06:07:07.381743+0000","last_became_peered":"2023-09-13T06:07:07.381743+0000","last_unstale":"2023-09-13T06:07:07.382524+0000","last_undegraded":"2023-09-13T06:07:07.382524+0000","last_fullsized":"2023-09-13T06:07:07.382524+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:28.110066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.383849+0000","last_change":"2023-09-13T06:07:07.383645+0000","last_active":"2023-09-13T06:07:07.383849+0000","last_peered":"2023-09-13T06:07:07.383849+0000","last_clean":"2023-09-13T06:07:07.383849+0000","last_became_active":"2023-09-13T06:07:07.383306+0000","last_became_peered":"2023-09-13T06:07:07.383306+0000","last_unstale":"2023-09-13T06:07:07.383849+0000","last_undegraded":"2023-09-13T06:07:07.383849+0000","last_fullsized":"2023-09-13T06:07:07.383849+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:08:34.914025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374197+0000","last_change":"2023-09-13T06:07:07.383808+0000","last_active":"2023-09-13T06:07:08.374197+0000","last_peered":"2023-09-13T06:07:08.374197+0000","last_clean":"2023-09-13T06:07:08.374197+0000","last_became_active":"2023-09-13T06:07:07.383505+0000","last_became_peered":"2023-09-13T06:07:07.383505+0000","last_unstale":"2023-09-13T06:07:08.374197+0000","last_undegraded":"2023-09-13T06:07:08.374197+0000","last_fullsized":"2023-09-13T06:07:08.374197+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:33:30.815524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.385884+0000","last_change":"2023-09-13T06:07:07.385810+0000","last_active":"2023-09-13T06:07:07.385884+0000","last_peered":"2023-09-13T06:07:07.385884+0000","last_clean":"2023-09-13T06:07:07.385884+0000","last_became_active":"2023-09-13T06:07:07.385045+0000","last_became_peered":"2023-09-13T06:07:07.385045+0000","last_unstale":"2023-09-13T06:07:07.385884+0000","last_undegraded":"2023-09-13T06:07:07.385884+0000","last_fullsized":"2023-09-13T06:07:07.385884+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:54:32.683261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.377693+0000","last_change":"2023-09-13T06:07:07.377492+0000","last_active":"2023-09-13T06:07:07.377693+0000","last_peered":"2023-09-13T06:07:07.377693+0000","last_clean":"2023-09-13T06:07:07.377693+0000","last_became_active":"2023-09-13T06:07:07.377266+0000","last_became_peered":"2023-09-13T06:07:07.377266+0000","last_unstale":"2023-09-13T06:07:07.377693+0000","last_undegraded":"2023-09-13T06:07:07.377693+0000","last_fullsized":"2023-09-13T06:07:07.377693+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:19:17.374934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374352+0000","last_change":"2023-09-13T06:07:07.381098+0000","last_active":"2023-09-13T06:07:08.374352+0000","last_peered":"2023-09-13T06:07:08.374352+0000","last_clean":"2023-09-13T06:07:08.374352+0000","last_became_active":"2023-09-13T06:07:07.380866+0000","last_became_peered":"2023-09-13T06:07:07.380866+0000","last_unstale":"2023-09-13T06:07:08.374352+0000","last_undegraded":"2023-09-13T06:07:08.374352+0000","last_fullsized":"2023-09-13T06:07:08.374352+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:24:22.790694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387492+0000","last_change":"2023-09-13T06:07:07.387407+0000","last_active":"2023-09-13T06:07:07.387492+0000","last_peered":"2023-09-13T06:07:07.387492+0000","last_clean":"2023-09-13T06:07:07.387492+0000","last_became_active":"2023-09-13T06:07:07.387035+0000","last_became_peered":"2023-09-13T06:07:07.387035+0000","last_unstale":"2023-09-13T06:07:07.387492+0000","last_undegraded":"2023-09-13T06:07:07.387492+0000","last_fullsized":"2023-09-13T06:07:07.387492+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:49:47.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.381249+0000","last_change":"2023-09-13T06:07:07.381155+0000","last_active":"2023-09-13T06:07:07.381249+0000","last_peered":"2023-09-13T06:07:07.381249+0000","last_clean":"2023-09-13T06:07:07.381249+0000","last_became_active":"2023-09-13T06:07:07.380930+0000","last_became_peered":"2023-09-13T06:07:07.380930+0000","last_unstale":"2023-09-13T06:07:07.381249+0000","last_undegraded":"2023-09-13T06:07:07.381249+0000","last_fullsized":"2023-09-13T06:07:07.381249+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:45.808683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375233+0000","last_change":"2023-09-13T06:07:07.384599+0000","last_active":"2023-09-13T06:07:08.375233+0000","last_peered":"2023-09-13T06:07:08.375233+0000","last_clean":"2023-09-13T06:07:08.375233+0000","last_became_active":"2023-09-13T06:07:07.381514+0000","last_became_peered":"2023-09-13T06:07:07.381514+0000","last_unstale":"2023-09-13T06:07:08.375233+0000","last_undegraded":"2023-09-13T06:07:08.375233+0000","last_fullsized":"2023-09-13T06:07:08.375233+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:54:29.152799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387511+0000","last_change":"2023-09-13T06:07:07.387436+0000","last_active":"2023-09-13T06:07:07.387511+0000","last_peered":"2023-09-13T06:07:07.387511+0000","last_clean":"2023-09-13T06:07:07.387511+0000","last_became_active":"2023-09-13T06:07:07.387224+0000","last_became_peered":"2023-09-13T06:07:07.387224+0000","last_unstale":"2023-09-13T06:07:07.387511+0000","last_undegraded":"2023-09-13T06:07:07.387511+0000","last_fullsized":"2023-09-13T06:07:07.387511+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:28.110066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374647+0000","last_change":"2023-09-13T06:07:07.379494+0000","last_active":"2023-09-13T06:07:08.374647+0000","last_peered":"2023-09-13T06:07:08.374647+0000","last_clean":"2023-09-13T06:07:08.374647+0000","last_became_active":"2023-09-13T06:07:07.379271+0000","last_became_peered":"2023-09-13T06:07:07.379271+0000","last_unstale":"2023-09-13T06:07:08.374647+0000","last_undegraded":"2023-09-13T06:07:08.374647+0000","last_fullsized":"2023-09-13T06:07:08.374647+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:52:49.094321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375091+0000","last_change":"2023-09-13T06:07:07.391688+0000","last_active":"2023-09-13T06:07:08.375091+0000","last_peered":"2023-09-13T06:07:08.375091+0000","last_clean":"2023-09-13T06:07:08.375091+0000","last_became_active":"2023-09-13T06:07:07.391473+0000","last_became_peered":"2023-09-13T06:07:07.391473+0000","last_unstale":"2023-09-13T06:07:08.375091+0000","last_undegraded":"2023-09-13T06:07:08.375091+0000","last_fullsized":"2023-09-13T06:07:08.375091+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:57:45.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.844762+0000","last_change":"2023-09-13T06:07:06.847777+0000","last_active":"2023-09-13T06:07:07.844762+0000","last_peered":"2023-09-13T06:07:07.844762+0000","last_clean":"2023-09-13T06:07:07.844762+0000","last_became_active":"2023-09-13T06:07:06.847515+0000","last_became_peered":"2023-09-13T06:07:06.847515+0000","last_unstale":"2023-09-13T06:07:07.844762+0000","last_undegraded":"2023-09-13T06:07:07.844762+0000","last_fullsized":"2023-09-13T06:07:07.844762+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:28:39.478573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387592+0000","last_change":"2023-09-13T06:07:07.387499+0000","last_active":"2023-09-13T06:07:07.387592+0000","last_peered":"2023-09-13T06:07:07.387592+0000","last_clean":"2023-09-13T06:07:07.387592+0000","last_became_active":"2023-09-13T06:07:07.387207+0000","last_became_peered":"2023-09-13T06:07:07.387207+0000","last_unstale":"2023-09-13T06:07:07.387592+0000","last_undegraded":"2023-09-13T06:07:07.387592+0000","last_fullsized":"2023-09-13T06:07:07.387592+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:51:13.933883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374321+0000","last_change":"2023-09-13T06:07:06.840359+0000","last_active":"2023-09-13T06:07:08.374321+0000","last_peered":"2023-09-13T06:07:08.374321+0000","last_clean":"2023-09-13T06:07:08.374321+0000","last_became_active":"2023-09-13T06:07:06.840098+0000","last_became_peered":"2023-09-13T06:07:06.840098+0000","last_unstale":"2023-09-13T06:07:08.374321+0000","last_undegraded":"2023-09-13T06:07:08.374321+0000","last_fullsized":"2023-09-13T06:07:08.374321+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:49:46.732105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374192+0000","last_change":"2023-09-13T06:07:07.382731+0000","last_active":"2023-09-13T06:07:08.374192+0000","last_peered":"2023-09-13T06:07:08.374192+0000","last_clean":"2023-09-13T06:07:08.374192+0000","last_became_active":"2023-09-13T06:07:07.382513+0000","last_became_peered":"2023-09-13T06:07:07.382513+0000","last_unstale":"2023-09-13T06:07:08.374192+0000","last_undegraded":"2023-09-13T06:07:08.374192+0000","last_fullsized":"2023-09-13T06:07:08.374192+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:44:08.071059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.844222+0000","last_change":"2023-09-13T06:07:06.845701+0000","last_active":"2023-09-13T06:07:07.844222+0000","last_peered":"2023-09-13T06:07:07.844222+0000","last_clean":"2023-09-13T06:07:07.844222+0000","last_became_active":"2023-09-13T06:07:06.844365+0000","last_became_peered":"2023-09-13T06:07:06.844365+0000","last_unstale":"2023-09-13T06:07:07.844222+0000","last_undegraded":"2023-09-13T06:07:07.844222+0000","last_fullsized":"2023-09-13T06:07:07.844222+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:36.128173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.384871+0000","last_change":"2023-09-13T06:07:07.384798+0000","last_active":"2023-09-13T06:07:07.384871+0000","last_peered":"2023-09-13T06:07:07.384871+0000","last_clean":"2023-09-13T06:07:07.384871+0000","last_became_active":"2023-09-13T06:07:07.384566+0000","last_became_peered":"2023-09-13T06:07:07.384566+0000","last_unstale":"2023-09-13T06:07:07.384871+0000","last_undegraded":"2023-09-13T06:07:07.384871+0000","last_fullsized":"2023-09-13T06:07:07.384871+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:19:17.374934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.845692+0000","last_change":"2023-09-13T06:07:06.848411+0000","last_active":"2023-09-13T06:07:07.845692+0000","last_peered":"2023-09-13T06:07:07.845692+0000","last_clean":"2023-09-13T06:07:07.845692+0000","last_became_active":"2023-09-13T06:07:06.847340+0000","last_became_peered":"2023-09-13T06:07:06.847340+0000","last_unstale":"2023-09-13T06:07:07.845692+0000","last_undegraded":"2023-09-13T06:07:07.845692+0000","last_fullsized":"2023-09-13T06:07:07.845692+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:14.830866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.389787+0000","last_change":"2023-09-13T06:07:07.389721+0000","last_active":"2023-09-13T06:07:07.389787+0000","last_peered":"2023-09-13T06:07:07.389787+0000","last_clean":"2023-09-13T06:07:07.389787+0000","last_became_active":"2023-09-13T06:07:07.389373+0000","last_became_peered":"2023-09-13T06:07:07.389373+0000","last_unstale":"2023-09-13T06:07:07.389787+0000","last_undegraded":"2023-09-13T06:07:07.389787+0000","last_fullsized":"2023-09-13T06:07:07.389787+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:44:08.071059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374850+0000","last_change":"2023-09-13T06:07:06.847912+0000","last_active":"2023-09-13T06:07:08.374850+0000","last_peered":"2023-09-13T06:07:08.374850+0000","last_clean":"2023-09-13T06:07:08.374850+0000","last_became_active":"2023-09-13T06:07:06.847504+0000","last_became_peered":"2023-09-13T06:07:06.847504+0000","last_unstale":"2023-09-13T06:07:08.374850+0000","last_undegraded":"2023-09-13T06:07:08.374850+0000","last_fullsized":"2023-09-13T06:07:08.374850+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:28:19.910990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374491+0000","last_change":"2023-09-13T06:07:07.384273+0000","last_active":"2023-09-13T06:07:08.374491+0000","last_peered":"2023-09-13T06:07:08.374491+0000","last_clean":"2023-09-13T06:07:08.374491+0000","last_became_active":"2023-09-13T06:07:07.384034+0000","last_became_peered":"2023-09-13T06:07:07.384034+0000","last_unstale":"2023-09-13T06:07:08.374491+0000","last_undegraded":"2023-09-13T06:07:08.374491+0000","last_fullsized":"2023-09-13T06:07:08.374491+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:02:57.740902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.845071+0000","last_change":"2023-09-13T06:07:06.844613+0000","last_active":"2023-09-13T06:07:07.845071+0000","last_peered":"2023-09-13T06:07:07.845071+0000","last_clean":"2023-09-13T06:07:07.845071+0000","last_became_active":"2023-09-13T06:07:06.844393+0000","last_became_peered":"2023-09-13T06:07:06.844393+0000","last_unstale":"2023-09-13T06:07:07.845071+0000","last_undegraded":"2023-09-13T06:07:07.845071+0000","last_fullsized":"2023-09-13T06:07:07.845071+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:49:46.732105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.376902+0000","last_change":"2023-09-13T06:07:07.376550+0000","last_active":"2023-09-13T06:07:07.376902+0000","last_peered":"2023-09-13T06:07:07.376902+0000","last_clean":"2023-09-13T06:07:07.376902+0000","last_became_active":"2023-09-13T06:07:07.375992+0000","last_became_peered":"2023-09-13T06:07:07.375992+0000","last_unstale":"2023-09-13T06:07:07.376902+0000","last_undegraded":"2023-09-13T06:07:07.376902+0000","last_fullsized":"2023-09-13T06:07:07.376902+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:28:40.489286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.375331+0000","last_change":"2023-09-13T06:07:06.848267+0000","last_active":"2023-09-13T06:07:07.375331+0000","last_peered":"2023-09-13T06:07:07.375331+0000","last_clean":"2023-09-13T06:07:07.375331+0000","last_became_active":"2023-09-13T06:07:06.847998+0000","last_became_peered":"2023-09-13T06:07:06.847998+0000","last_unstale":"2023-09-13T06:07:07.375331+0000","last_undegraded":"2023-09-13T06:07:07.375331+0000","last_fullsized":"2023-09-13T06:07:07.375331+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:57:41.831173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.388944+0000","last_change":"2023-09-13T06:07:07.388716+0000","last_active":"2023-09-13T06:07:07.388944+0000","last_peered":"2023-09-13T06:07:07.388944+0000","last_clean":"2023-09-13T06:07:07.388944+0000","last_became_active":"2023-09-13T06:07:07.388149+0000","last_became_peered":"2023-09-13T06:07:07.388149+0000","last_unstale":"2023-09-13T06:07:07.388944+0000","last_undegraded":"2023-09-13T06:07:07.388944+0000","last_fullsized":"2023-09-13T06:07:07.388944+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:37.293205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374554+0000","last_change":"2023-09-13T06:07:06.843851+0000","last_active":"2023-09-13T06:07:08.374554+0000","last_peered":"2023-09-13T06:07:08.374554+0000","last_clean":"2023-09-13T06:07:08.374554+0000","last_became_active":"2023-09-13T06:07:06.843613+0000","last_became_peered":"2023-09-13T06:07:06.843613+0000","last_unstale":"2023-09-13T06:07:08.374554+0000","last_undegraded":"2023-09-13T06:07:08.374554+0000","last_fullsized":"2023-09-13T06:07:08.374554+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:11.243100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.389215+0000","last_change":"2023-09-13T06:07:07.389099+0000","last_active":"2023-09-13T06:07:07.389215+0000","last_peered":"2023-09-13T06:07:07.389215+0000","last_clean":"2023-09-13T06:07:07.389215+0000","last_became_active":"2023-09-13T06:07:07.388832+0000","last_became_peered":"2023-09-13T06:07:07.388832+0000","last_unstale":"2023-09-13T06:07:07.389215+0000","last_undegraded":"2023-09-13T06:07:07.389215+0000","last_fullsized":"2023-09-13T06:07:07.389215+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:44.514158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374325+0000","last_change":"2023-09-13T06:07:06.841256+0000","last_active":"2023-09-13T06:07:08.374325+0000","last_peered":"2023-09-13T06:07:08.374325+0000","last_clean":"2023-09-13T06:07:08.374325+0000","last_became_active":"2023-09-13T06:07:06.841027+0000","last_became_peered":"2023-09-13T06:07:06.841027+0000","last_unstale":"2023-09-13T06:07:08.374325+0000","last_undegraded":"2023-09-13T06:07:08.374325+0000","last_fullsized":"2023-09-13T06:07:08.374325+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:34.923139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.385505+0000","last_change":"2023-09-13T06:07:07.385320+0000","last_active":"2023-09-13T06:07:07.385505+0000","last_peered":"2023-09-13T06:07:07.385505+0000","last_clean":"2023-09-13T06:07:07.385505+0000","last_became_active":"2023-09-13T06:07:07.385028+0000","last_became_peered":"2023-09-13T06:07:07.385028+0000","last_unstale":"2023-09-13T06:07:07.385505+0000","last_undegraded":"2023-09-13T06:07:07.385505+0000","last_fullsized":"2023-09-13T06:07:07.385505+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:45.808683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.371336+0000","last_change":"2023-09-13T06:07:06.845003+0000","last_active":"2023-09-13T06:07:07.371336+0000","last_peered":"2023-09-13T06:07:07.371336+0000","last_clean":"2023-09-13T06:07:07.371336+0000","last_became_active":"2023-09-13T06:07:06.844777+0000","last_became_peered":"2023-09-13T06:07:06.844777+0000","last_unstale":"2023-09-13T06:07:07.371336+0000","last_undegraded":"2023-09-13T06:07:07.371336+0000","last_fullsized":"2023-09-13T06:07:07.371336+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:44.441136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.376210+0000","last_change":"2023-09-13T06:07:07.376123+0000","last_active":"2023-09-13T06:07:07.376210+0000","last_peered":"2023-09-13T06:07:07.376210+0000","last_clean":"2023-09-13T06:07:07.376210+0000","last_became_active":"2023-09-13T06:07:07.375846+0000","last_became_peered":"2023-09-13T06:07:07.375846+0000","last_unstale":"2023-09-13T06:07:07.376210+0000","last_undegraded":"2023-09-13T06:07:07.376210+0000","last_fullsized":"2023-09-13T06:07:07.376210+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:37.138886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374440+0000","last_change":"2023-09-13T06:07:06.842745+0000","last_active":"2023-09-13T06:07:08.374440+0000","last_peered":"2023-09-13T06:07:08.374440+0000","last_clean":"2023-09-13T06:07:08.374440+0000","last_became_active":"2023-09-13T06:07:06.842089+0000","last_became_peered":"2023-09-13T06:07:06.842089+0000","last_unstale":"2023-09-13T06:07:08.374440+0000","last_undegraded":"2023-09-13T06:07:08.374440+0000","last_fullsized":"2023-09-13T06:07:08.374440+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:36:10.618926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374328+0000","last_change":"2023-09-13T06:07:07.389440+0000","last_active":"2023-09-13T06:07:08.374328+0000","last_peered":"2023-09-13T06:07:08.374328+0000","last_clean":"2023-09-13T06:07:08.374328+0000","last_became_active":"2023-09-13T06:07:07.389116+0000","last_became_peered":"2023-09-13T06:07:07.389116+0000","last_unstale":"2023-09-13T06:07:08.374328+0000","last_undegraded":"2023-09-13T06:07:08.374328+0000","last_fullsized":"2023-09-13T06:07:08.374328+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:03:53.375920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.846496+0000","last_change":"2023-09-13T06:07:06.842718+0000","last_active":"2023-09-13T06:07:07.846496+0000","last_peered":"2023-09-13T06:07:07.846496+0000","last_clean":"2023-09-13T06:07:07.846496+0000","last_became_active":"2023-09-13T06:07:06.842264+0000","last_became_peered":"2023-09-13T06:07:06.842264+0000","last_unstale":"2023-09-13T06:07:07.846496+0000","last_undegraded":"2023-09-13T06:07:07.846496+0000","last_fullsized":"2023-09-13T06:07:07.846496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:54:31.672548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.377908+0000","last_change":"2023-09-13T06:07:07.377827+0000","last_active":"2023-09-13T06:07:07.377908+0000","last_peered":"2023-09-13T06:07:07.377908+0000","last_clean":"2023-09-13T06:07:07.377908+0000","last_became_active":"2023-09-13T06:07:07.377228+0000","last_became_peered":"2023-09-13T06:07:07.377228+0000","last_unstale":"2023-09-13T06:07:07.377908+0000","last_undegraded":"2023-09-13T06:07:07.377908+0000","last_fullsized":"2023-09-13T06:07:07.377908+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:44.514158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375405+0000","last_change":"2023-09-13T06:07:06.842287+0000","last_active":"2023-09-13T06:07:08.375405+0000","last_peered":"2023-09-13T06:07:08.375405+0000","last_clean":"2023-09-13T06:07:08.375405+0000","last_became_active":"2023-09-13T06:07:06.842000+0000","last_became_peered":"2023-09-13T06:07:06.842000+0000","last_unstale":"2023-09-13T06:07:08.375405+0000","last_undegraded":"2023-09-13T06:07:08.375405+0000","last_fullsized":"2023-09-13T06:07:08.375405+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:39:55.608980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374372+0000","last_change":"2023-09-13T06:07:07.381317+0000","last_active":"2023-09-13T06:07:08.374372+0000","last_peered":"2023-09-13T06:07:08.374372+0000","last_clean":"2023-09-13T06:07:08.374372+0000","last_became_active":"2023-09-13T06:07:07.381093+0000","last_became_peered":"2023-09-13T06:07:07.381093+0000","last_unstale":"2023-09-13T06:07:08.374372+0000","last_undegraded":"2023-09-13T06:07:08.374372+0000","last_fullsized":"2023-09-13T06:07:08.374372+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:23:49.999069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375381+0000","last_change":"2023-09-13T06:07:06.839370+0000","last_active":"2023-09-13T06:07:08.375381+0000","last_peered":"2023-09-13T06:07:08.375381+0000","last_clean":"2023-09-13T06:07:08.375381+0000","last_became_active":"2023-09-13T06:07:06.839129+0000","last_became_peered":"2023-09-13T06:07:06.839129+0000","last_unstale":"2023-09-13T06:07:08.375381+0000","last_undegraded":"2023-09-13T06:07:08.375381+0000","last_fullsized":"2023-09-13T06:07:08.375381+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:54:38.799176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.388118+0000","last_change":"2023-09-13T06:07:07.387998+0000","last_active":"2023-09-13T06:07:07.388118+0000","last_peered":"2023-09-13T06:07:07.388118+0000","last_clean":"2023-09-13T06:07:07.388118+0000","last_became_active":"2023-09-13T06:07:07.387782+0000","last_became_peered":"2023-09-13T06:07:07.387782+0000","last_unstale":"2023-09-13T06:07:07.388118+0000","last_undegraded":"2023-09-13T06:07:07.388118+0000","last_fullsized":"2023-09-13T06:07:07.388118+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:51:13.933883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.381780+0000","last_change":"2023-09-13T06:07:06.847104+0000","last_active":"2023-09-13T06:07:07.381780+0000","last_peered":"2023-09-13T06:07:07.381780+0000","last_clean":"2023-09-13T06:07:07.381780+0000","last_became_active":"2023-09-13T06:07:06.846870+0000","last_became_peered":"2023-09-13T06:07:06.846870+0000","last_unstale":"2023-09-13T06:07:07.381780+0000","last_undegraded":"2023-09-13T06:07:07.381780+0000","last_fullsized":"2023-09-13T06:07:07.381780+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:14.830866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375022+0000","last_change":"2023-09-13T06:07:07.388087+0000","last_active":"2023-09-13T06:07:08.375022+0000","last_peered":"2023-09-13T06:07:08.375022+0000","last_clean":"2023-09-13T06:07:08.375022+0000","last_became_active":"2023-09-13T06:07:07.387831+0000","last_became_peered":"2023-09-13T06:07:07.387831+0000","last_unstale":"2023-09-13T06:07:08.375022+0000","last_undegraded":"2023-09-13T06:07:08.375022+0000","last_fullsized":"2023-09-13T06:07:08.375022+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:54:33.362658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":20,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374159+0000","last_change":"2023-09-13T06:07:06.842262+0000","last_active":"2023-09-13T06:07:08.374159+0000","last_peered":"2023-09-13T06:07:08.374159+0000","last_clean":"2023-09-13T06:07:08.374159+0000","last_became_active":"2023-09-13T06:07:06.842025+0000","last_became_peered":"2023-09-13T06:07:06.842025+0000","last_unstale":"2023-09-13T06:07:08.374159+0000","last_undegraded":"2023-09-13T06:07:08.374159+0000","last_fullsized":"2023-09-13T06:07:08.374159+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:28:17.086751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.390697+0000","last_change":"2023-09-13T06:07:07.390580+0000","last_active":"2023-09-13T06:07:07.390697+0000","last_peered":"2023-09-13T06:07:07.390697+0000","last_clean":"2023-09-13T06:07:07.390697+0000","last_became_active":"2023-09-13T06:07:07.390329+0000","last_became_peered":"2023-09-13T06:07:07.390329+0000","last_unstale":"2023-09-13T06:07:07.390697+0000","last_undegraded":"2023-09-13T06:07:07.390697+0000","last_fullsized":"2023-09-13T06:07:07.390697+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:45.186221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.843525+0000","last_change":"2023-09-13T06:07:06.842314+0000","last_active":"2023-09-13T06:07:07.843525+0000","last_peered":"2023-09-13T06:07:07.843525+0000","last_clean":"2023-09-13T06:07:07.843525+0000","last_became_active":"2023-09-13T06:07:06.841749+0000","last_became_peered":"2023-09-13T06:07:06.841749+0000","last_unstale":"2023-09-13T06:07:07.843525+0000","last_undegraded":"2023-09-13T06:07:07.843525+0000","last_fullsized":"2023-09-13T06:07:07.843525+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:27.099353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387698+0000","last_change":"2023-09-13T06:07:07.387270+0000","last_active":"2023-09-13T06:07:07.387698+0000","last_peered":"2023-09-13T06:07:07.387698+0000","last_clean":"2023-09-13T06:07:07.387698+0000","last_became_active":"2023-09-13T06:07:07.387043+0000","last_became_peered":"2023-09-13T06:07:07.387043+0000","last_unstale":"2023-09-13T06:07:07.387698+0000","last_undegraded":"2023-09-13T06:07:07.387698+0000","last_fullsized":"2023-09-13T06:07:07.387698+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:36:23.460094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.843100+0000","last_change":"2023-09-13T06:07:06.845785+0000","last_active":"2023-09-13T06:07:07.843100+0000","last_peered":"2023-09-13T06:07:07.843100+0000","last_clean":"2023-09-13T06:07:07.843100+0000","last_became_active":"2023-09-13T06:07:06.845362+0000","last_became_peered":"2023-09-13T06:07:06.845362+0000","last_unstale":"2023-09-13T06:07:07.843100+0000","last_undegraded":"2023-09-13T06:07:07.843100+0000","last_fullsized":"2023-09-13T06:07:07.843100+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:51:12.923170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374623+0000","last_change":"2023-09-13T06:07:07.391836+0000","last_active":"2023-09-13T06:07:08.374623+0000","last_peered":"2023-09-13T06:07:08.374623+0000","last_clean":"2023-09-13T06:07:08.374623+0000","last_became_active":"2023-09-13T06:07:07.391199+0000","last_became_peered":"2023-09-13T06:07:07.391199+0000","last_unstale":"2023-09-13T06:07:08.374623+0000","last_undegraded":"2023-09-13T06:07:08.374623+0000","last_fullsized":"2023-09-13T06:07:08.374623+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:48:00.438829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.375758+0000","last_change":"2023-09-13T06:07:06.845597+0000","last_active":"2023-09-13T06:07:07.375758+0000","last_peered":"2023-09-13T06:07:07.375758+0000","last_clean":"2023-09-13T06:07:07.375758+0000","last_became_active":"2023-09-13T06:07:06.845359+0000","last_became_peered":"2023-09-13T06:07:06.845359+0000","last_unstale":"2023-09-13T06:07:07.375758+0000","last_undegraded":"2023-09-13T06:07:07.375758+0000","last_fullsized":"2023-09-13T06:07:07.375758+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:54.793149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375202+0000","last_change":"2023-09-13T06:07:07.381565+0000","last_active":"2023-09-13T06:07:08.375202+0000","last_peered":"2023-09-13T06:07:08.375202+0000","last_clean":"2023-09-13T06:07:08.375202+0000","last_became_active":"2023-09-13T06:07:07.381032+0000","last_became_peered":"2023-09-13T06:07:07.381032+0000","last_unstale":"2023-09-13T06:07:08.375202+0000","last_undegraded":"2023-09-13T06:07:08.375202+0000","last_fullsized":"2023-09-13T06:07:08.375202+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:31:19.024866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.843846+0000","last_change":"2023-09-13T06:07:06.842800+0000","last_active":"2023-09-13T06:07:07.843846+0000","last_peered":"2023-09-13T06:07:07.843846+0000","last_clean":"2023-09-13T06:07:07.843846+0000","last_became_active":"2023-09-13T06:07:06.842219+0000","last_became_peered":"2023-09-13T06:07:06.842219+0000","last_unstale":"2023-09-13T06:07:07.843846+0000","last_undegraded":"2023-09-13T06:07:07.843846+0000","last_fullsized":"2023-09-13T06:07:07.843846+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:36.282492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375241+0000","last_change":"2023-09-13T06:07:07.380404+0000","last_active":"2023-09-13T06:07:08.375241+0000","last_peered":"2023-09-13T06:07:08.375241+0000","last_clean":"2023-09-13T06:07:08.375241+0000","last_became_active":"2023-09-13T06:07:07.380190+0000","last_became_peered":"2023-09-13T06:07:07.380190+0000","last_unstale":"2023-09-13T06:07:08.375241+0000","last_undegraded":"2023-09-13T06:07:08.375241+0000","last_fullsized":"2023-09-13T06:07:08.375241+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:36:28.554596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.379753+0000","last_change":"2023-09-13T06:07:06.840866+0000","last_active":"2023-09-13T06:07:07.379753+0000","last_peered":"2023-09-13T06:07:07.379753+0000","last_clean":"2023-09-13T06:07:07.379753+0000","last_became_active":"2023-09-13T06:07:06.840633+0000","last_became_peered":"2023-09-13T06:07:06.840633+0000","last_unstale":"2023-09-13T06:07:07.379753+0000","last_undegraded":"2023-09-13T06:07:07.379753+0000","last_fullsized":"2023-09-13T06:07:07.379753+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:28.321881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375335+0000","last_change":"2023-09-13T06:07:07.384382+0000","last_active":"2023-09-13T06:07:08.375335+0000","last_peered":"2023-09-13T06:07:08.375335+0000","last_clean":"2023-09-13T06:07:08.375335+0000","last_became_active":"2023-09-13T06:07:07.384175+0000","last_became_peered":"2023-09-13T06:07:07.384175+0000","last_unstale":"2023-09-13T06:07:08.375335+0000","last_undegraded":"2023-09-13T06:07:08.375335+0000","last_fullsized":"2023-09-13T06:07:08.375335+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:43:07.325949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.379364+0000","last_change":"2023-09-13T06:07:06.841623+0000","last_active":"2023-09-13T06:07:07.379364+0000","last_peered":"2023-09-13T06:07:07.379364+0000","last_clean":"2023-09-13T06:07:07.379364+0000","last_became_active":"2023-09-13T06:07:06.841366+0000","last_became_peered":"2023-09-13T06:07:06.841366+0000","last_unstale":"2023-09-13T06:07:07.379364+0000","last_undegraded":"2023-09-13T06:07:07.379364+0000","last_fullsized":"2023-09-13T06:07:07.379364+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:23:48.988356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.385463+0000","last_change":"2023-09-13T06:07:07.385384+0000","last_active":"2023-09-13T06:07:07.385463+0000","last_peered":"2023-09-13T06:07:07.385463+0000","last_clean":"2023-09-13T06:07:07.385463+0000","last_became_active":"2023-09-13T06:07:07.384379+0000","last_became_peered":"2023-09-13T06:07:07.384379+0000","last_unstale":"2023-09-13T06:07:07.385463+0000","last_undegraded":"2023-09-13T06:07:07.385463+0000","last_fullsized":"2023-09-13T06:07:07.385463+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:36:11.629639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.375059+0000","last_change":"2023-09-13T06:07:06.848567+0000","last_active":"2023-09-13T06:07:07.375059+0000","last_peered":"2023-09-13T06:07:07.375059+0000","last_clean":"2023-09-13T06:07:07.375059+0000","last_became_active":"2023-09-13T06:07:06.847670+0000","last_became_peered":"2023-09-13T06:07:06.847670+0000","last_unstale":"2023-09-13T06:07:07.375059+0000","last_undegraded":"2023-09-13T06:07:07.375059+0000","last_fullsized":"2023-09-13T06:07:07.375059+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:36:10.618926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.383830+0000","last_change":"2023-09-13T06:07:07.383511+0000","last_active":"2023-09-13T06:07:07.383830+0000","last_peered":"2023-09-13T06:07:07.383830+0000","last_clean":"2023-09-13T06:07:07.383830+0000","last_became_active":"2023-09-13T06:07:07.382961+0000","last_became_peered":"2023-09-13T06:07:07.382961+0000","last_unstale":"2023-09-13T06:07:07.383830+0000","last_undegraded":"2023-09-13T06:07:07.383830+0000","last_fullsized":"2023-09-13T06:07:07.383830+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:22:06.852006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.844637+0000","last_change":"2023-09-13T06:07:06.842492+0000","last_active":"2023-09-13T06:07:07.844637+0000","last_peered":"2023-09-13T06:07:07.844637+0000","last_clean":"2023-09-13T06:07:07.844637+0000","last_became_active":"2023-09-13T06:07:06.842228+0000","last_became_peered":"2023-09-13T06:07:06.842228+0000","last_unstale":"2023-09-13T06:07:07.844637+0000","last_undegraded":"2023-09-13T06:07:07.844637+0000","last_fullsized":"2023-09-13T06:07:07.844637+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:49.354993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374767+0000","last_change":"2023-09-13T06:07:07.381117+0000","last_active":"2023-09-13T06:07:08.374767+0000","last_peered":"2023-09-13T06:07:08.374767+0000","last_clean":"2023-09-13T06:07:08.374767+0000","last_became_active":"2023-09-13T06:07:07.380917+0000","last_became_peered":"2023-09-13T06:07:07.380917+0000","last_unstale":"2023-09-13T06:07:08.374767+0000","last_undegraded":"2023-09-13T06:07:08.374767+0000","last_fullsized":"2023-09-13T06:07:08.374767+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:02.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.375139+0000","last_change":"2023-09-13T06:07:06.842945+0000","last_active":"2023-09-13T06:07:07.375139+0000","last_peered":"2023-09-13T06:07:07.375139+0000","last_clean":"2023-09-13T06:07:07.375139+0000","last_became_active":"2023-09-13T06:07:06.842577+0000","last_became_peered":"2023-09-13T06:07:06.842577+0000","last_unstale":"2023-09-13T06:07:07.375139+0000","last_undegraded":"2023-09-13T06:07:07.375139+0000","last_fullsized":"2023-09-13T06:07:07.375139+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:26:01.910794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374479+0000","last_change":"2023-09-13T06:07:07.385830+0000","last_active":"2023-09-13T06:07:08.374479+0000","last_peered":"2023-09-13T06:07:08.374479+0000","last_clean":"2023-09-13T06:07:08.374479+0000","last_became_active":"2023-09-13T06:07:07.385564+0000","last_became_peered":"2023-09-13T06:07:07.385564+0000","last_unstale":"2023-09-13T06:07:08.374479+0000","last_undegraded":"2023-09-13T06:07:08.374479+0000","last_fullsized":"2023-09-13T06:07:08.374479+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:29.332595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.374835+0000","last_change":"2023-09-13T06:07:06.842400+0000","last_active":"2023-09-13T06:07:07.374835+0000","last_peered":"2023-09-13T06:07:07.374835+0000","last_clean":"2023-09-13T06:07:07.374835+0000","last_became_active":"2023-09-13T06:07:06.842171+0000","last_became_peered":"2023-09-13T06:07:06.842171+0000","last_unstale":"2023-09-13T06:07:07.374835+0000","last_undegraded":"2023-09-13T06:07:07.374835+0000","last_fullsized":"2023-09-13T06:07:07.374835+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:51:12.923170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.388088+0000","last_change":"2023-09-13T06:07:07.387886+0000","last_active":"2023-09-13T06:07:07.388088+0000","last_peered":"2023-09-13T06:07:07.388088+0000","last_clean":"2023-09-13T06:07:07.388088+0000","last_became_active":"2023-09-13T06:07:07.387625+0000","last_became_peered":"2023-09-13T06:07:07.387625+0000","last_unstale":"2023-09-13T06:07:07.388088+0000","last_undegraded":"2023-09-13T06:07:07.388088+0000","last_fullsized":"2023-09-13T06:07:07.388088+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:55.803862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.374368+0000","last_change":"2023-09-13T06:07:06.846028+0000","last_active":"2023-09-13T06:07:07.374368+0000","last_peered":"2023-09-13T06:07:07.374368+0000","last_clean":"2023-09-13T06:07:07.374368+0000","last_became_active":"2023-09-13T06:07:06.845760+0000","last_became_peered":"2023-09-13T06:07:06.845760+0000","last_unstale":"2023-09-13T06:07:07.374368+0000","last_undegraded":"2023-09-13T06:07:07.374368+0000","last_fullsized":"2023-09-13T06:07:07.374368+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:20:40.935026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375155+0000","last_change":"2023-09-13T06:07:07.387997+0000","last_active":"2023-09-13T06:07:08.375155+0000","last_peered":"2023-09-13T06:07:08.375155+0000","last_clean":"2023-09-13T06:07:08.375155+0000","last_became_active":"2023-09-13T06:07:07.387616+0000","last_became_peered":"2023-09-13T06:07:07.387616+0000","last_unstale":"2023-09-13T06:07:08.375155+0000","last_undegraded":"2023-09-13T06:07:08.375155+0000","last_fullsized":"2023-09-13T06:07:08.375155+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:15:47.846925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.375181+0000","last_change":"2023-09-13T06:07:06.846177+0000","last_active":"2023-09-13T06:07:07.375181+0000","last_peered":"2023-09-13T06:07:07.375181+0000","last_clean":"2023-09-13T06:07:07.375181+0000","last_became_active":"2023-09-13T06:07:06.845913+0000","last_became_peered":"2023-09-13T06:07:06.845913+0000","last_unstale":"2023-09-13T06:07:07.375181+0000","last_undegraded":"2023-09-13T06:07:07.375181+0000","last_fullsized":"2023-09-13T06:07:07.375181+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:20:40.935026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.382608+0000","last_change":"2023-09-13T06:07:07.382118+0000","last_active":"2023-09-13T06:07:07.382608+0000","last_peered":"2023-09-13T06:07:07.382608+0000","last_clean":"2023-09-13T06:07:07.382608+0000","last_became_active":"2023-09-13T06:07:07.381874+0000","last_became_peered":"2023-09-13T06:07:07.381874+0000","last_unstale":"2023-09-13T06:07:07.382608+0000","last_undegraded":"2023-09-13T06:07:07.382608+0000","last_fullsized":"2023-09-13T06:07:07.382608+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:22:06.852006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.372827+0000","last_change":"2023-09-13T06:07:06.846212+0000","last_active":"2023-09-13T06:07:07.372827+0000","last_peered":"2023-09-13T06:07:07.372827+0000","last_clean":"2023-09-13T06:07:07.372827+0000","last_became_active":"2023-09-13T06:07:06.845444+0000","last_became_peered":"2023-09-13T06:07:06.845444+0000","last_unstale":"2023-09-13T06:07:07.372827+0000","last_undegraded":"2023-09-13T06:07:07.372827+0000","last_fullsized":"2023-09-13T06:07:07.372827+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:14.830866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375319+0000","last_change":"2023-09-13T06:07:07.388967+0000","last_active":"2023-09-13T06:07:08.375319+0000","last_peered":"2023-09-13T06:07:08.375319+0000","last_clean":"2023-09-13T06:07:08.375319+0000","last_became_active":"2023-09-13T06:07:07.388768+0000","last_became_peered":"2023-09-13T06:07:07.388768+0000","last_unstale":"2023-09-13T06:07:08.375319+0000","last_undegraded":"2023-09-13T06:07:08.375319+0000","last_fullsized":"2023-09-13T06:07:08.375319+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:05.145614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.372197+0000","last_change":"2023-09-13T06:07:06.839256+0000","last_active":"2023-09-13T06:07:07.372197+0000","last_peered":"2023-09-13T06:07:07.372197+0000","last_clean":"2023-09-13T06:07:07.372197+0000","last_became_active":"2023-09-13T06:07:06.839029+0000","last_became_peered":"2023-09-13T06:07:06.839029+0000","last_unstale":"2023-09-13T06:07:07.372197+0000","last_undegraded":"2023-09-13T06:07:07.372197+0000","last_fullsized":"2023-09-13T06:07:07.372197+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:49:46.732105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387474+0000","last_change":"2023-09-13T06:07:07.387252+0000","last_active":"2023-09-13T06:07:07.387474+0000","last_peered":"2023-09-13T06:07:07.387474+0000","last_clean":"2023-09-13T06:07:07.387474+0000","last_became_active":"2023-09-13T06:07:07.386695+0000","last_became_peered":"2023-09-13T06:07:07.386695+0000","last_unstale":"2023-09-13T06:07:07.387474+0000","last_undegraded":"2023-09-13T06:07:07.387474+0000","last_fullsized":"2023-09-13T06:07:07.387474+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:28.110066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375399+0000","last_change":"2023-09-13T06:07:06.845611+0000","last_active":"2023-09-13T06:07:08.375399+0000","last_peered":"2023-09-13T06:07:08.375399+0000","last_clean":"2023-09-13T06:07:08.375399+0000","last_became_active":"2023-09-13T06:07:06.845229+0000","last_became_peered":"2023-09-13T06:07:06.845229+0000","last_unstale":"2023-09-13T06:07:08.375399+0000","last_undegraded":"2023-09-13T06:07:08.375399+0000","last_fullsized":"2023-09-13T06:07:08.375399+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:24:30.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375354+0000","last_change":"2023-09-13T06:07:07.385122+0000","last_active":"2023-09-13T06:07:08.375354+0000","last_peered":"2023-09-13T06:07:08.375354+0000","last_clean":"2023-09-13T06:07:08.375354+0000","last_became_active":"2023-09-13T06:07:07.384866+0000","last_became_peered":"2023-09-13T06:07:07.384866+0000","last_unstale":"2023-09-13T06:07:08.375354+0000","last_undegraded":"2023-09-13T06:07:08.375354+0000","last_fullsized":"2023-09-13T06:07:08.375354+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:32:52.657765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374429+0000","last_change":"2023-09-13T06:07:06.844089+0000","last_active":"2023-09-13T06:07:08.374429+0000","last_peered":"2023-09-13T06:07:08.374429+0000","last_clean":"2023-09-13T06:07:08.374429+0000","last_became_active":"2023-09-13T06:07:06.843850+0000","last_became_peered":"2023-09-13T06:07:06.843850+0000","last_unstale":"2023-09-13T06:07:08.374429+0000","last_undegraded":"2023-09-13T06:07:08.374429+0000","last_fullsized":"2023-09-13T06:07:08.374429+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:14.830866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":281,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.373195+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:07:07.373195+0000","last_peered":"2023-09-13T06:07:07.373195+0000","last_clean":"2023-09-13T06:07:07.373195+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:07:07.373195+0000","last_undegraded":"2023-09-13T06:07:07.373195+0000","last_fullsized":"2023-09-13T06:07:07.373195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194076,"statfs":{"total":200000000,"available":198734077,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.70399999999999996},"min":{"1min":0.48399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0189999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.877},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.74399999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70899999999999996,"15min":0.69599999999999995},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.45700000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.55900000000000005,"5min":0.432,"15min":0.432},"max":{"1min":1.016,"5min":1.395,"15min":1.395},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96899999999999997,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.90300000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.51400000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.357,"15min":1.357},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0580000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.85099999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.63200000000000001},"min":{"1min":0.38200000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.85199999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64600000000000002,"15min":0.66400000000000003},"min":{"1min":0.44,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88400000000000001,"5min":1.018,"15min":1.018},"last":0.57299999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67200000000000004,"15min":0.69899999999999995},"min":{"1min":0.48599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98099999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89100000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324445,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92400000000000004,"5min":1.181,"15min":1.181},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.35899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82199999999999995,"5min":1.028,"15min":1.028},"last":0.71699999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68300000000000005,"15min":0.69599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":1.153,"15min":1.153},"last":0.68799999999999994}]},{"osd":2,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.44700000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.877,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90700000000000003,"5min":1.085,"15min":1.085},"last":0.73399999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.92900000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94499999999999995,"5min":1.526,"15min":1.526},"last":0.746}]},{"osd":4,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.59099999999999997},"min":{"1min":0.42599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82499999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.83099999999999996,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.65300000000000002}]},{"osd":5,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.629,"15min":0.621},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83199999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69799999999999995,"15min":0.68200000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.95299999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.71699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86699999999999999,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88300000000000001,"5min":1.133,"15min":1.133},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324375,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.441,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.879,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.66300000000000003},"min":{"1min":0.49099999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.61499999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93000000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69499999999999995,"15min":0.67900000000000005},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.874,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71499999999999997,"15min":0.69499999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.54000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85499999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.53400000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80800000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63800000000000001,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.002,"5min":1.054,"15min":1.054},"last":0.55700000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.46000000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84999999999999998,"5min":0.997,"15min":0.997},"last":0.63},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.878,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67000000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.42099999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72799999999999998,"15min":0.745},"min":{"1min":0.495,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.996,"5min":1.026,"15min":1.026},"last":0.65900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":661,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194651,"statfs":{"total":200000000,"available":199322709,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85899999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.495,"5min":0.38,"15min":0.38},"max":{"1min":0.97999999999999998,"5min":1.05,"15min":1.05},"last":0.502}]},{"osd":1,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.45100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.83299999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.51600000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.877,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.66800000000000004},"min":{"1min":0.495,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72299999999999998,"15min":0.73699999999999999},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93100000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.749}]},{"osd":3,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.51400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.78500000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64900000000000002,"15min":0.67100000000000004},"min":{"1min":0.45700000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.74299999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70299999999999996,"15min":0.68899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.69299999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.49299999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.50600000000000001,"5min":0.498,"15min":0.498},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324445,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.629,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42199999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44}]},{"osd":2,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67400000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.497,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97599999999999998,"5min":1.284,"15min":1.284},"last":0.749},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.71499999999999997},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90900000000000003,"5min":1.044,"15min":1.044},"last":0.78100000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93799999999999994,"5min":1.111,"15min":1.111},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.74199999999999999},"min":{"1min":0.56399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93700000000000006,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95599999999999996,"5min":1.097,"15min":1.097},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91900000000000004,"5min":1.458,"15min":1.458},"last":0.76800000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93899999999999995,"5min":1.383,"15min":1.383},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.95399999999999996,"5min":1.27,"15min":1.27},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324445,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.46899999999999997,"15min":0.40899999999999997},"min":{"1min":0.252,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.59299999999999997,"5min":10.401,"15min":10.401},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.47099999999999997,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56200000000000006,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":0.31}]},{"osd":1,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48899999999999999,"15min":0.45900000000000002},"min":{"1min":0.32700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66900000000000004,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50700000000000001,"15min":0.46700000000000003},"min":{"1min":0.38,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73999999999999999,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58999999999999997,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71399999999999997,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.47799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93799999999999994,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.77900000000000003,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.109,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.44700000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92400000000000004,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.751,"15min":0.73199999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.048,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0840000000000001,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.50700000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.004,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77400000000000002,"15min":0.76900000000000002},"min":{"1min":0.52500000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.135,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":665,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194646,"statfs":{"total":200000000,"available":199318145,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45300000000000001,"15min":0.436},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.80200000000000005,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.317,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68999999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.32700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.498},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48899999999999999,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.50900000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.52600000000000002},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52100000000000002,"15min":0.48699999999999999},"min":{"1min":0.33100000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80600000000000005,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.41499999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.999,"5min":1.089,"15min":1.089},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95999999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.98599999999999999,"5min":1.109,"15min":1.109},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.746},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96699999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90800000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.879}]},{"osd":7,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.47399999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96899999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.747,"15min":0.76200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94499999999999995,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.93600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194075,"statfs":{"total":200000000,"available":198733495,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63800000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.49299999999999999,"15min":0.47399999999999998},"min":{"1min":0.309,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72799999999999998,"5min":2.294,"15min":2.294},"last":0.52000000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.495},"min":{"1min":0.34000000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69099999999999995,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47699999999999998,"15min":0.48099999999999998},"min":{"1min":0.29999999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61699999999999999,"5min":2.056,"15min":2.056},"last":0.41399999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.32900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64200000000000002,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.38800000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.51000000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76100000000000001,"15min":0.78800000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93300000000000005,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.68500000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.02,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.78600000000000003},"min":{"1min":0.55100000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0820000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.80900000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89600000000000002,"5min":2.415,"15min":2.415},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.998,"5min":2.347,"15min":2.347},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.496,"5min":0.495,"15min":0.495},"max":{"1min":0.94299999999999995,"5min":2.367,"15min":2.367},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0509999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.85799999999999998}]}]}],"pool_statfs":[]}} 2023-09-13T06:07:11.911 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:07:12.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.084+0000 7eff7606d640 1 Processor -- start 2023-09-13T06:07:12.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.084+0000 7eff7606d640 1 -- start start 2023-09-13T06:07:12.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff7606d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff700cc7f0 0x7eff700cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff7606d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff7015d5f0 0x7eff701591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff7606d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff700cce60 con 0x7eff700ae170 2023-09-13T06:07:12.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff7606d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff700ccc80 con 0x7eff700cc7f0 2023-09-13T06:07:12.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff7606d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff700b1e20 con 0x7eff7015d5f0 2023-09-13T06:07:12.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff6effd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff700cc7f0 0x7eff700cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff6f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7eff700ae170 0x7eff700b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60814/0 (socket says 172.21.15.130:60814) 2023-09-13T06:07:12.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff6effd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff700cc7f0 0x7eff700cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59128/0 (socket says 172.21.15.130:59128) 2023-09-13T06:07:12.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff6f7fe640 1 -- 172.21.15.130:0/1639780527 learned_addr learned my addr 172.21.15.130:0/1639780527 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:12.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff6ffff640 1 --2- 172.21.15.130:0/1639780527 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff7015d5f0 0x7eff701591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff6effd640 1 -- 172.21.15.130:0/1639780527 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff7015d5f0 msgr2=0x7eff701591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:12.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff6effd640 1 --2- 172.21.15.130:0/1639780527 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff7015d5f0 0x7eff701591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff6effd640 1 -- 172.21.15.130:0/1639780527 >> v1:172.21.15.130:6789/0 conn(0x7eff700ae170 legacy=0x7eff700b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.088+0000 7eff6effd640 1 -- 172.21.15.130:0/1639780527 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700cd140 con 0x7eff700cc7f0 2023-09-13T06:07:12.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff6effd640 1 --2- 172.21.15.130:0/1639780527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff700cc7f0 0x7eff700cb040 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7eff640097c0 tx=0x7eff6401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8794d3345badcb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:12.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff6e7fc640 1 -- 172.21.15.130:0/1639780527 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640ad640 con 0x7eff700cc7f0 2023-09-13T06:07:12.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff6e7fc640 1 -- 172.21.15.130:0/1639780527 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff640ad7a0 con 0x7eff700cc7f0 2023-09-13T06:07:12.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff6e7fc640 1 -- 172.21.15.130:0/1639780527 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640adb30 con 0x7eff700cc7f0 2023-09-13T06:07:12.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff7606d640 1 -- 172.21.15.130:0/1639780527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff700cc7f0 msgr2=0x7eff700cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff7606d640 1 --2- 172.21.15.130:0/1639780527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff700cc7f0 0x7eff700cb040 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7eff640097c0 tx=0x7eff6401c480 comp rx=0 tx=0).stop 2023-09-13T06:07:12.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff7606d640 1 -- 172.21.15.130:0/1639780527 shutdown_connections 2023-09-13T06:07:12.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff7606d640 1 --2- 172.21.15.130:0/1639780527 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff7015d5f0 0x7eff701591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff7606d640 1 --2- 172.21.15.130:0/1639780527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff700cc7f0 0x7eff700cb040 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff7606d640 1 -- 172.21.15.130:0/1639780527 >> 172.21.15.130:0/1639780527 conn(0x7eff70065990 msgr2=0x7eff70065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:12.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff7606d640 1 -- 172.21.15.130:0/1639780527 shutdown_connections 2023-09-13T06:07:12.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff7606d640 1 -- 172.21.15.130:0/1639780527 wait complete. 2023-09-13T06:07:12.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff7606d640 1 Processor -- start 2023-09-13T06:07:12.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.092+0000 7eff7606d640 1 -- start start 2023-09-13T06:07:12.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff7606d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff700ae170 0x7eff70149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff7606d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff700cc7f0 0x7eff7015b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff7606d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff7015d5f0 0x7eff701486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff7606d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7015bae0 con 0x7eff700cc7f0 2023-09-13T06:07:12.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff7606d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff70149a00 con 0x7eff7015d5f0 2023-09-13T06:07:12.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff7606d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7014a1c0 con 0x7eff700ae170 2023-09-13T06:07:12.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff700cc7f0 0x7eff7015b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff700cc7f0 0x7eff7015b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59140/0 (socket says 172.21.15.130:59140) 2023-09-13T06:07:12.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6effd640 1 -- 172.21.15.130:0/1454643277 learned_addr learned my addr 172.21.15.130:0/1454643277 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:12.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6f7fe640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff700ae170 0x7eff70149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6ffff640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff7015d5f0 0x7eff701486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6effd640 1 -- 172.21.15.130:0/1454643277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff700ae170 msgr2=0x7eff70149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6effd640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff700ae170 0x7eff70149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6effd640 1 -- 172.21.15.130:0/1454643277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff7015d5f0 msgr2=0x7eff701486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6effd640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff7015d5f0 0x7eff701486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6effd640 1 -- 172.21.15.130:0/1454643277 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff64009420 con 0x7eff700cc7f0 2023-09-13T06:07:12.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6f7fe640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff700ae170 0x7eff70149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:12.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff6effd640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff700cc7f0 0x7eff7015b5a0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7eff640b0040 tx=0x7eff64019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:12.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff57fff640 1 -- 172.21.15.130:0/1454643277 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640b6820 con 0x7eff700cc7f0 2023-09-13T06:07:12.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff57fff640 1 -- 172.21.15.130:0/1454643277 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff640a6040 con 0x7eff700cc7f0 2023-09-13T06:07:12.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff57fff640 1 -- 172.21.15.130:0/1454643277 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640b6be0 con 0x7eff700cc7f0 2023-09-13T06:07:12.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff7606d640 1 -- 172.21.15.130:0/1454643277 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7014c2d0 con 0x7eff700cc7f0 2023-09-13T06:07:12.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff7606d640 1 -- 172.21.15.130:0/1454643277 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7014c890 con 0x7eff700cc7f0 2023-09-13T06:07:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff7606d640 1 -- 172.21.15.130:0/1454643277 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7006cd90 con 0x7eff700cc7f0 2023-09-13T06:07:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.096+0000 7eff57fff640 1 -- 172.21.15.130:0/1454643277 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7eff640b4040 con 0x7eff700cc7f0 2023-09-13T06:07:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.100+0000 7eff57fff640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff5c065b20 0x7eff5c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.100+0000 7eff57fff640 1 -- 172.21.15.130:0/1454643277 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff6411d5f0 con 0x7eff700cc7f0 2023-09-13T06:07:12.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.100+0000 7eff6f7fe640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff5c065b20 0x7eff5c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.100+0000 7eff6f7fe640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff5c065b20 0x7eff5c067fe0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7eff60007fd0 tx=0x7eff60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:12.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.104+0000 7eff57fff640 1 -- 172.21.15.130:0/1454643277 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7eff640eaf30 con 0x7eff700cc7f0 2023-09-13T06:07:12.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.244+0000 7eff7606d640 1 -- 172.21.15.130:0/1454643277 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff70159b30 con 0x7eff5c065b20 2023-09-13T06:07:12.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.252+0000 7eff57fff640 1 -- 172.21.15.130:0/1454643277 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285054 (secure 0 0 0) 0x7eff60001450 con 0x7eff5c065b20 2023-09-13T06:07:12.258 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:12.260 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:07:12.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 -- 172.21.15.130:0/1454643277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff5c065b20 msgr2=0x7eff5c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff5c065b20 0x7eff5c067fe0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7eff60007fd0 tx=0x7eff60009040 comp rx=0 tx=0).stop 2023-09-13T06:07:12.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 -- 172.21.15.130:0/1454643277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff700cc7f0 msgr2=0x7eff7015b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff700cc7f0 0x7eff7015b5a0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7eff640b0040 tx=0x7eff64019220 comp rx=0 tx=0).stop 2023-09-13T06:07:12.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 -- 172.21.15.130:0/1454643277 shutdown_connections 2023-09-13T06:07:12.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff5c065b20 0x7eff5c067fe0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff7015d5f0 0x7eff701486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff700cc7f0 0x7eff7015b5a0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 --2- 172.21.15.130:0/1454643277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff700ae170 0x7eff70149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 -- 172.21.15.130:0/1454643277 >> 172.21.15.130:0/1454643277 conn(0x7eff70065990 msgr2=0x7eff70070780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:12.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 -- 172.21.15.130:0/1454643277 shutdown_connections 2023-09-13T06:07:12.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.256+0000 7eff7606d640 1 -- 172.21.15.130:0/1454643277 wait complete. 2023-09-13T06:07:12.279 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2023-09-13T06:07:10.608507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556060,"statfs":{"total":1600000000,"available":1593406136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.783907"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.373994+0000","last_change":"2023-09-13T06:07:07.380471+0000","last_active":"2023-09-13T06:07:08.373994+0000","last_peered":"2023-09-13T06:07:08.373994+0000","last_clean":"2023-09-13T06:07:08.373994+0000","last_became_active":"2023-09-13T06:07:07.380262+0000","last_became_peered":"2023-09-13T06:07:07.380262+0000","last_unstale":"2023-09-13T06:07:08.373994+0000","last_undegraded":"2023-09-13T06:07:08.373994+0000","last_fullsized":"2023-09-13T06:07:08.373994+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:50.365706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.382540+0000","last_change":"2023-09-13T06:07:07.382423+0000","last_active":"2023-09-13T06:07:07.382540+0000","last_peered":"2023-09-13T06:07:07.382540+0000","last_clean":"2023-09-13T06:07:07.382540+0000","last_became_active":"2023-09-13T06:07:07.382083+0000","last_became_peered":"2023-09-13T06:07:07.382083+0000","last_unstale":"2023-09-13T06:07:07.382540+0000","last_undegraded":"2023-09-13T06:07:07.382540+0000","last_fullsized":"2023-09-13T06:07:07.382540+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:45.186221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.373994+0000","last_change":"2023-09-13T06:07:07.382635+0000","last_active":"2023-09-13T06:07:08.373994+0000","last_peered":"2023-09-13T06:07:08.373994+0000","last_clean":"2023-09-13T06:07:08.373994+0000","last_became_active":"2023-09-13T06:07:07.382356+0000","last_became_peered":"2023-09-13T06:07:07.382356+0000","last_unstale":"2023-09-13T06:07:08.373994+0000","last_undegraded":"2023-09-13T06:07:08.373994+0000","last_fullsized":"2023-09-13T06:07:08.373994+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:36:23.460094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.379640+0000","last_change":"2023-09-13T06:07:07.379579+0000","last_active":"2023-09-13T06:07:07.379640+0000","last_peered":"2023-09-13T06:07:07.379640+0000","last_clean":"2023-09-13T06:07:07.379640+0000","last_became_active":"2023-09-13T06:07:07.379369+0000","last_became_peered":"2023-09-13T06:07:07.379369+0000","last_unstale":"2023-09-13T06:07:07.379640+0000","last_undegraded":"2023-09-13T06:07:07.379640+0000","last_fullsized":"2023-09-13T06:07:07.379640+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:45.808683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.389837+0000","last_change":"2023-09-13T06:07:07.389752+0000","last_active":"2023-09-13T06:07:07.389837+0000","last_peered":"2023-09-13T06:07:07.389837+0000","last_clean":"2023-09-13T06:07:07.389837+0000","last_became_active":"2023-09-13T06:07:07.389411+0000","last_became_peered":"2023-09-13T06:07:07.389411+0000","last_unstale":"2023-09-13T06:07:07.389837+0000","last_undegraded":"2023-09-13T06:07:07.389837+0000","last_fullsized":"2023-09-13T06:07:07.389837+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:37.293205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374298+0000","last_change":"2023-09-13T06:07:07.387621+0000","last_active":"2023-09-13T06:07:08.374298+0000","last_peered":"2023-09-13T06:07:08.374298+0000","last_clean":"2023-09-13T06:07:08.374298+0000","last_became_active":"2023-09-13T06:07:07.387394+0000","last_became_peered":"2023-09-13T06:07:07.387394+0000","last_unstale":"2023-09-13T06:07:08.374298+0000","last_undegraded":"2023-09-13T06:07:08.374298+0000","last_fullsized":"2023-09-13T06:07:08.374298+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:12:31.442929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374197+0000","last_change":"2023-09-13T06:07:07.388478+0000","last_active":"2023-09-13T06:07:08.374197+0000","last_peered":"2023-09-13T06:07:08.374197+0000","last_clean":"2023-09-13T06:07:08.374197+0000","last_became_active":"2023-09-13T06:07:07.388244+0000","last_became_peered":"2023-09-13T06:07:07.388244+0000","last_unstale":"2023-09-13T06:07:08.374197+0000","last_undegraded":"2023-09-13T06:07:08.374197+0000","last_fullsized":"2023-09-13T06:07:08.374197+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:45:32.170877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.381116+0000","last_change":"2023-09-13T06:07:07.381006+0000","last_active":"2023-09-13T06:07:07.381116+0000","last_peered":"2023-09-13T06:07:07.381116+0000","last_clean":"2023-09-13T06:07:07.381116+0000","last_became_active":"2023-09-13T06:07:07.380728+0000","last_became_peered":"2023-09-13T06:07:07.380728+0000","last_unstale":"2023-09-13T06:07:07.381116+0000","last_undegraded":"2023-09-13T06:07:07.381116+0000","last_fullsized":"2023-09-13T06:07:07.381116+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:45.451849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.389118+0000","last_change":"2023-09-13T06:07:07.389007+0000","last_active":"2023-09-13T06:07:07.389118+0000","last_peered":"2023-09-13T06:07:07.389118+0000","last_clean":"2023-09-13T06:07:07.389118+0000","last_became_active":"2023-09-13T06:07:07.388478+0000","last_became_peered":"2023-09-13T06:07:07.388478+0000","last_unstale":"2023-09-13T06:07:07.389118+0000","last_undegraded":"2023-09-13T06:07:07.389118+0000","last_fullsized":"2023-09-13T06:07:07.389118+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:36:11.629639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.385698+0000","last_change":"2023-09-13T06:07:07.385584+0000","last_active":"2023-09-13T06:07:07.385698+0000","last_peered":"2023-09-13T06:07:07.385698+0000","last_clean":"2023-09-13T06:07:07.385698+0000","last_became_active":"2023-09-13T06:07:07.384740+0000","last_became_peered":"2023-09-13T06:07:07.384740+0000","last_unstale":"2023-09-13T06:07:07.385698+0000","last_undegraded":"2023-09-13T06:07:07.385698+0000","last_fullsized":"2023-09-13T06:07:07.385698+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:26:02.921507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374442+0000","last_change":"2023-09-13T06:07:07.391568+0000","last_active":"2023-09-13T06:07:08.374442+0000","last_peered":"2023-09-13T06:07:08.374442+0000","last_clean":"2023-09-13T06:07:08.374442+0000","last_became_active":"2023-09-13T06:07:07.390883+0000","last_became_peered":"2023-09-13T06:07:07.390883+0000","last_unstale":"2023-09-13T06:07:08.374442+0000","last_undegraded":"2023-09-13T06:07:08.374442+0000","last_fullsized":"2023-09-13T06:07:08.374442+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:05:12.769078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387531+0000","last_change":"2023-09-13T06:07:07.387262+0000","last_active":"2023-09-13T06:07:07.387531+0000","last_peered":"2023-09-13T06:07:07.387531+0000","last_clean":"2023-09-13T06:07:07.387531+0000","last_became_active":"2023-09-13T06:07:07.386992+0000","last_became_peered":"2023-09-13T06:07:07.386992+0000","last_unstale":"2023-09-13T06:07:07.387531+0000","last_undegraded":"2023-09-13T06:07:07.387531+0000","last_fullsized":"2023-09-13T06:07:07.387531+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:49:47.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.384529+0000","last_change":"2023-09-13T06:07:07.384463+0000","last_active":"2023-09-13T06:07:07.384529+0000","last_peered":"2023-09-13T06:07:07.384529+0000","last_clean":"2023-09-13T06:07:07.384529+0000","last_became_active":"2023-09-13T06:07:07.384251+0000","last_became_peered":"2023-09-13T06:07:07.384251+0000","last_unstale":"2023-09-13T06:07:07.384529+0000","last_undegraded":"2023-09-13T06:07:07.384529+0000","last_fullsized":"2023-09-13T06:07:07.384529+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:08:34.914025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374846+0000","last_change":"2023-09-13T06:07:07.385448+0000","last_active":"2023-09-13T06:07:08.374846+0000","last_peered":"2023-09-13T06:07:08.374846+0000","last_clean":"2023-09-13T06:07:08.374846+0000","last_became_active":"2023-09-13T06:07:07.385226+0000","last_became_peered":"2023-09-13T06:07:07.385226+0000","last_unstale":"2023-09-13T06:07:08.374846+0000","last_undegraded":"2023-09-13T06:07:08.374846+0000","last_fullsized":"2023-09-13T06:07:08.374846+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:10:43.936407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.376922+0000","last_change":"2023-09-13T06:07:07.376703+0000","last_active":"2023-09-13T06:07:07.376922+0000","last_peered":"2023-09-13T06:07:07.376922+0000","last_clean":"2023-09-13T06:07:07.376922+0000","last_became_active":"2023-09-13T06:07:07.376329+0000","last_became_peered":"2023-09-13T06:07:07.376329+0000","last_unstale":"2023-09-13T06:07:07.376922+0000","last_undegraded":"2023-09-13T06:07:07.376922+0000","last_fullsized":"2023-09-13T06:07:07.376922+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:22:06.852006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374551+0000","last_change":"2023-09-13T06:07:07.391418+0000","last_active":"2023-09-13T06:07:08.374551+0000","last_peered":"2023-09-13T06:07:08.374551+0000","last_clean":"2023-09-13T06:07:08.374551+0000","last_became_active":"2023-09-13T06:07:07.390520+0000","last_became_peered":"2023-09-13T06:07:07.390520+0000","last_unstale":"2023-09-13T06:07:08.374551+0000","last_undegraded":"2023-09-13T06:07:08.374551+0000","last_fullsized":"2023-09-13T06:07:08.374551+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:19.269661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.378169+0000","last_change":"2023-09-13T06:07:07.378107+0000","last_active":"2023-09-13T06:07:07.378169+0000","last_peered":"2023-09-13T06:07:07.378169+0000","last_clean":"2023-09-13T06:07:07.378169+0000","last_became_active":"2023-09-13T06:07:07.377895+0000","last_became_peered":"2023-09-13T06:07:07.377895+0000","last_unstale":"2023-09-13T06:07:07.378169+0000","last_undegraded":"2023-09-13T06:07:07.378169+0000","last_fullsized":"2023-09-13T06:07:07.378169+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:54:32.683261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.380109+0000","last_change":"2023-09-13T06:07:07.380046+0000","last_active":"2023-09-13T06:07:07.380109+0000","last_peered":"2023-09-13T06:07:07.380109+0000","last_clean":"2023-09-13T06:07:07.380109+0000","last_became_active":"2023-09-13T06:07:07.379831+0000","last_became_peered":"2023-09-13T06:07:07.379831+0000","last_unstale":"2023-09-13T06:07:07.380109+0000","last_undegraded":"2023-09-13T06:07:07.380109+0000","last_fullsized":"2023-09-13T06:07:07.380109+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:19:17.374934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374968+0000","last_change":"2023-09-13T06:07:07.384224+0000","last_active":"2023-09-13T06:07:08.374968+0000","last_peered":"2023-09-13T06:07:08.374968+0000","last_clean":"2023-09-13T06:07:08.374968+0000","last_became_active":"2023-09-13T06:07:07.381330+0000","last_became_peered":"2023-09-13T06:07:07.381330+0000","last_unstale":"2023-09-13T06:07:08.374968+0000","last_undegraded":"2023-09-13T06:07:08.374968+0000","last_fullsized":"2023-09-13T06:07:08.374968+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:20.457097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.386021+0000","last_change":"2023-09-13T06:07:07.385949+0000","last_active":"2023-09-13T06:07:07.386021+0000","last_peered":"2023-09-13T06:07:07.386021+0000","last_clean":"2023-09-13T06:07:07.386021+0000","last_became_active":"2023-09-13T06:07:07.385715+0000","last_became_peered":"2023-09-13T06:07:07.385715+0000","last_unstale":"2023-09-13T06:07:07.386021+0000","last_undegraded":"2023-09-13T06:07:07.386021+0000","last_fullsized":"2023-09-13T06:07:07.386021+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:28:40.489286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375245+0000","last_change":"2023-09-13T06:07:07.380698+0000","last_active":"2023-09-13T06:07:08.375245+0000","last_peered":"2023-09-13T06:07:08.375245+0000","last_clean":"2023-09-13T06:07:08.375245+0000","last_became_active":"2023-09-13T06:07:07.380430+0000","last_became_peered":"2023-09-13T06:07:07.380430+0000","last_unstale":"2023-09-13T06:07:08.375245+0000","last_undegraded":"2023-09-13T06:07:08.375245+0000","last_fullsized":"2023-09-13T06:07:08.375245+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:31.956674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.382524+0000","last_change":"2023-09-13T06:07:07.382294+0000","last_active":"2023-09-13T06:07:07.382524+0000","last_peered":"2023-09-13T06:07:07.382524+0000","last_clean":"2023-09-13T06:07:07.382524+0000","last_became_active":"2023-09-13T06:07:07.381743+0000","last_became_peered":"2023-09-13T06:07:07.381743+0000","last_unstale":"2023-09-13T06:07:07.382524+0000","last_undegraded":"2023-09-13T06:07:07.382524+0000","last_fullsized":"2023-09-13T06:07:07.382524+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:28.110066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.383849+0000","last_change":"2023-09-13T06:07:07.383645+0000","last_active":"2023-09-13T06:07:07.383849+0000","last_peered":"2023-09-13T06:07:07.383849+0000","last_clean":"2023-09-13T06:07:07.383849+0000","last_became_active":"2023-09-13T06:07:07.383306+0000","last_became_peered":"2023-09-13T06:07:07.383306+0000","last_unstale":"2023-09-13T06:07:07.383849+0000","last_undegraded":"2023-09-13T06:07:07.383849+0000","last_fullsized":"2023-09-13T06:07:07.383849+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:08:34.914025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374197+0000","last_change":"2023-09-13T06:07:07.383808+0000","last_active":"2023-09-13T06:07:08.374197+0000","last_peered":"2023-09-13T06:07:08.374197+0000","last_clean":"2023-09-13T06:07:08.374197+0000","last_became_active":"2023-09-13T06:07:07.383505+0000","last_became_peered":"2023-09-13T06:07:07.383505+0000","last_unstale":"2023-09-13T06:07:08.374197+0000","last_undegraded":"2023-09-13T06:07:08.374197+0000","last_fullsized":"2023-09-13T06:07:08.374197+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:33:30.815524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.385884+0000","last_change":"2023-09-13T06:07:07.385810+0000","last_active":"2023-09-13T06:07:07.385884+0000","last_peered":"2023-09-13T06:07:07.385884+0000","last_clean":"2023-09-13T06:07:07.385884+0000","last_became_active":"2023-09-13T06:07:07.385045+0000","last_became_peered":"2023-09-13T06:07:07.385045+0000","last_unstale":"2023-09-13T06:07:07.385884+0000","last_undegraded":"2023-09-13T06:07:07.385884+0000","last_fullsized":"2023-09-13T06:07:07.385884+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:54:32.683261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.377693+0000","last_change":"2023-09-13T06:07:07.377492+0000","last_active":"2023-09-13T06:07:07.377693+0000","last_peered":"2023-09-13T06:07:07.377693+0000","last_clean":"2023-09-13T06:07:07.377693+0000","last_became_active":"2023-09-13T06:07:07.377266+0000","last_became_peered":"2023-09-13T06:07:07.377266+0000","last_unstale":"2023-09-13T06:07:07.377693+0000","last_undegraded":"2023-09-13T06:07:07.377693+0000","last_fullsized":"2023-09-13T06:07:07.377693+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:19:17.374934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374352+0000","last_change":"2023-09-13T06:07:07.381098+0000","last_active":"2023-09-13T06:07:08.374352+0000","last_peered":"2023-09-13T06:07:08.374352+0000","last_clean":"2023-09-13T06:07:08.374352+0000","last_became_active":"2023-09-13T06:07:07.380866+0000","last_became_peered":"2023-09-13T06:07:07.380866+0000","last_unstale":"2023-09-13T06:07:08.374352+0000","last_undegraded":"2023-09-13T06:07:08.374352+0000","last_fullsized":"2023-09-13T06:07:08.374352+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:24:22.790694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387492+0000","last_change":"2023-09-13T06:07:07.387407+0000","last_active":"2023-09-13T06:07:07.387492+0000","last_peered":"2023-09-13T06:07:07.387492+0000","last_clean":"2023-09-13T06:07:07.387492+0000","last_became_active":"2023-09-13T06:07:07.387035+0000","last_became_peered":"2023-09-13T06:07:07.387035+0000","last_unstale":"2023-09-13T06:07:07.387492+0000","last_undegraded":"2023-09-13T06:07:07.387492+0000","last_fullsized":"2023-09-13T06:07:07.387492+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:49:47.742818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.381249+0000","last_change":"2023-09-13T06:07:07.381155+0000","last_active":"2023-09-13T06:07:07.381249+0000","last_peered":"2023-09-13T06:07:07.381249+0000","last_clean":"2023-09-13T06:07:07.381249+0000","last_became_active":"2023-09-13T06:07:07.380930+0000","last_became_peered":"2023-09-13T06:07:07.380930+0000","last_unstale":"2023-09-13T06:07:07.381249+0000","last_undegraded":"2023-09-13T06:07:07.381249+0000","last_fullsized":"2023-09-13T06:07:07.381249+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:45.808683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375233+0000","last_change":"2023-09-13T06:07:07.384599+0000","last_active":"2023-09-13T06:07:08.375233+0000","last_peered":"2023-09-13T06:07:08.375233+0000","last_clean":"2023-09-13T06:07:08.375233+0000","last_became_active":"2023-09-13T06:07:07.381514+0000","last_became_peered":"2023-09-13T06:07:07.381514+0000","last_unstale":"2023-09-13T06:07:08.375233+0000","last_undegraded":"2023-09-13T06:07:08.375233+0000","last_fullsized":"2023-09-13T06:07:08.375233+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:54:29.152799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387511+0000","last_change":"2023-09-13T06:07:07.387436+0000","last_active":"2023-09-13T06:07:07.387511+0000","last_peered":"2023-09-13T06:07:07.387511+0000","last_clean":"2023-09-13T06:07:07.387511+0000","last_became_active":"2023-09-13T06:07:07.387224+0000","last_became_peered":"2023-09-13T06:07:07.387224+0000","last_unstale":"2023-09-13T06:07:07.387511+0000","last_undegraded":"2023-09-13T06:07:07.387511+0000","last_fullsized":"2023-09-13T06:07:07.387511+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:28.110066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374647+0000","last_change":"2023-09-13T06:07:07.379494+0000","last_active":"2023-09-13T06:07:08.374647+0000","last_peered":"2023-09-13T06:07:08.374647+0000","last_clean":"2023-09-13T06:07:08.374647+0000","last_became_active":"2023-09-13T06:07:07.379271+0000","last_became_peered":"2023-09-13T06:07:07.379271+0000","last_unstale":"2023-09-13T06:07:08.374647+0000","last_undegraded":"2023-09-13T06:07:08.374647+0000","last_fullsized":"2023-09-13T06:07:08.374647+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:52:49.094321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375091+0000","last_change":"2023-09-13T06:07:07.391688+0000","last_active":"2023-09-13T06:07:08.375091+0000","last_peered":"2023-09-13T06:07:08.375091+0000","last_clean":"2023-09-13T06:07:08.375091+0000","last_became_active":"2023-09-13T06:07:07.391473+0000","last_became_peered":"2023-09-13T06:07:07.391473+0000","last_unstale":"2023-09-13T06:07:08.375091+0000","last_undegraded":"2023-09-13T06:07:08.375091+0000","last_fullsized":"2023-09-13T06:07:08.375091+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:57:45.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.844762+0000","last_change":"2023-09-13T06:07:06.847777+0000","last_active":"2023-09-13T06:07:07.844762+0000","last_peered":"2023-09-13T06:07:07.844762+0000","last_clean":"2023-09-13T06:07:07.844762+0000","last_became_active":"2023-09-13T06:07:06.847515+0000","last_became_peered":"2023-09-13T06:07:06.847515+0000","last_unstale":"2023-09-13T06:07:07.844762+0000","last_undegraded":"2023-09-13T06:07:07.844762+0000","last_fullsized":"2023-09-13T06:07:07.844762+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:28:39.478573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387592+0000","last_change":"2023-09-13T06:07:07.387499+0000","last_active":"2023-09-13T06:07:07.387592+0000","last_peered":"2023-09-13T06:07:07.387592+0000","last_clean":"2023-09-13T06:07:07.387592+0000","last_became_active":"2023-09-13T06:07:07.387207+0000","last_became_peered":"2023-09-13T06:07:07.387207+0000","last_unstale":"2023-09-13T06:07:07.387592+0000","last_undegraded":"2023-09-13T06:07:07.387592+0000","last_fullsized":"2023-09-13T06:07:07.387592+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:51:13.933883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374321+0000","last_change":"2023-09-13T06:07:06.840359+0000","last_active":"2023-09-13T06:07:08.374321+0000","last_peered":"2023-09-13T06:07:08.374321+0000","last_clean":"2023-09-13T06:07:08.374321+0000","last_became_active":"2023-09-13T06:07:06.840098+0000","last_became_peered":"2023-09-13T06:07:06.840098+0000","last_unstale":"2023-09-13T06:07:08.374321+0000","last_undegraded":"2023-09-13T06:07:08.374321+0000","last_fullsized":"2023-09-13T06:07:08.374321+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:49:46.732105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374192+0000","last_change":"2023-09-13T06:07:07.382731+0000","last_active":"2023-09-13T06:07:08.374192+0000","last_peered":"2023-09-13T06:07:08.374192+0000","last_clean":"2023-09-13T06:07:08.374192+0000","last_became_active":"2023-09-13T06:07:07.382513+0000","last_became_peered":"2023-09-13T06:07:07.382513+0000","last_unstale":"2023-09-13T06:07:08.374192+0000","last_undegraded":"2023-09-13T06:07:08.374192+0000","last_fullsized":"2023-09-13T06:07:08.374192+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:44:08.071059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.844222+0000","last_change":"2023-09-13T06:07:06.845701+0000","last_active":"2023-09-13T06:07:07.844222+0000","last_peered":"2023-09-13T06:07:07.844222+0000","last_clean":"2023-09-13T06:07:07.844222+0000","last_became_active":"2023-09-13T06:07:06.844365+0000","last_became_peered":"2023-09-13T06:07:06.844365+0000","last_unstale":"2023-09-13T06:07:07.844222+0000","last_undegraded":"2023-09-13T06:07:07.844222+0000","last_fullsized":"2023-09-13T06:07:07.844222+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:36.128173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.384871+0000","last_change":"2023-09-13T06:07:07.384798+0000","last_active":"2023-09-13T06:07:07.384871+0000","last_peered":"2023-09-13T06:07:07.384871+0000","last_clean":"2023-09-13T06:07:07.384871+0000","last_became_active":"2023-09-13T06:07:07.384566+0000","last_became_peered":"2023-09-13T06:07:07.384566+0000","last_unstale":"2023-09-13T06:07:07.384871+0000","last_undegraded":"2023-09-13T06:07:07.384871+0000","last_fullsized":"2023-09-13T06:07:07.384871+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:19:17.374934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.845692+0000","last_change":"2023-09-13T06:07:06.848411+0000","last_active":"2023-09-13T06:07:07.845692+0000","last_peered":"2023-09-13T06:07:07.845692+0000","last_clean":"2023-09-13T06:07:07.845692+0000","last_became_active":"2023-09-13T06:07:06.847340+0000","last_became_peered":"2023-09-13T06:07:06.847340+0000","last_unstale":"2023-09-13T06:07:07.845692+0000","last_undegraded":"2023-09-13T06:07:07.845692+0000","last_fullsized":"2023-09-13T06:07:07.845692+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:14.830866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.389787+0000","last_change":"2023-09-13T06:07:07.389721+0000","last_active":"2023-09-13T06:07:07.389787+0000","last_peered":"2023-09-13T06:07:07.389787+0000","last_clean":"2023-09-13T06:07:07.389787+0000","last_became_active":"2023-09-13T06:07:07.389373+0000","last_became_peered":"2023-09-13T06:07:07.389373+0000","last_unstale":"2023-09-13T06:07:07.389787+0000","last_undegraded":"2023-09-13T06:07:07.389787+0000","last_fullsized":"2023-09-13T06:07:07.389787+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:44:08.071059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374850+0000","last_change":"2023-09-13T06:07:06.847912+0000","last_active":"2023-09-13T06:07:08.374850+0000","last_peered":"2023-09-13T06:07:08.374850+0000","last_clean":"2023-09-13T06:07:08.374850+0000","last_became_active":"2023-09-13T06:07:06.847504+0000","last_became_peered":"2023-09-13T06:07:06.847504+0000","last_unstale":"2023-09-13T06:07:08.374850+0000","last_undegraded":"2023-09-13T06:07:08.374850+0000","last_fullsized":"2023-09-13T06:07:08.374850+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:28:19.910990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374491+0000","last_change":"2023-09-13T06:07:07.384273+0000","last_active":"2023-09-13T06:07:08.374491+0000","last_peered":"2023-09-13T06:07:08.374491+0000","last_clean":"2023-09-13T06:07:08.374491+0000","last_became_active":"2023-09-13T06:07:07.384034+0000","last_became_peered":"2023-09-13T06:07:07.384034+0000","last_unstale":"2023-09-13T06:07:08.374491+0000","last_undegraded":"2023-09-13T06:07:08.374491+0000","last_fullsized":"2023-09-13T06:07:08.374491+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:02:57.740902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.845071+0000","last_change":"2023-09-13T06:07:06.844613+0000","last_active":"2023-09-13T06:07:07.845071+0000","last_peered":"2023-09-13T06:07:07.845071+0000","last_clean":"2023-09-13T06:07:07.845071+0000","last_became_active":"2023-09-13T06:07:06.844393+0000","last_became_peered":"2023-09-13T06:07:06.844393+0000","last_unstale":"2023-09-13T06:07:07.845071+0000","last_undegraded":"2023-09-13T06:07:07.845071+0000","last_fullsized":"2023-09-13T06:07:07.845071+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:49:46.732105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.376902+0000","last_change":"2023-09-13T06:07:07.376550+0000","last_active":"2023-09-13T06:07:07.376902+0000","last_peered":"2023-09-13T06:07:07.376902+0000","last_clean":"2023-09-13T06:07:07.376902+0000","last_became_active":"2023-09-13T06:07:07.375992+0000","last_became_peered":"2023-09-13T06:07:07.375992+0000","last_unstale":"2023-09-13T06:07:07.376902+0000","last_undegraded":"2023-09-13T06:07:07.376902+0000","last_fullsized":"2023-09-13T06:07:07.376902+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:28:40.489286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.375331+0000","last_change":"2023-09-13T06:07:06.848267+0000","last_active":"2023-09-13T06:07:07.375331+0000","last_peered":"2023-09-13T06:07:07.375331+0000","last_clean":"2023-09-13T06:07:07.375331+0000","last_became_active":"2023-09-13T06:07:06.847998+0000","last_became_peered":"2023-09-13T06:07:06.847998+0000","last_unstale":"2023-09-13T06:07:07.375331+0000","last_undegraded":"2023-09-13T06:07:07.375331+0000","last_fullsized":"2023-09-13T06:07:07.375331+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:57:41.831173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.388944+0000","last_change":"2023-09-13T06:07:07.388716+0000","last_active":"2023-09-13T06:07:07.388944+0000","last_peered":"2023-09-13T06:07:07.388944+0000","last_clean":"2023-09-13T06:07:07.388944+0000","last_became_active":"2023-09-13T06:07:07.388149+0000","last_became_peered":"2023-09-13T06:07:07.388149+0000","last_unstale":"2023-09-13T06:07:07.388944+0000","last_undegraded":"2023-09-13T06:07:07.388944+0000","last_fullsized":"2023-09-13T06:07:07.388944+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:37.293205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374554+0000","last_change":"2023-09-13T06:07:06.843851+0000","last_active":"2023-09-13T06:07:08.374554+0000","last_peered":"2023-09-13T06:07:08.374554+0000","last_clean":"2023-09-13T06:07:08.374554+0000","last_became_active":"2023-09-13T06:07:06.843613+0000","last_became_peered":"2023-09-13T06:07:06.843613+0000","last_unstale":"2023-09-13T06:07:08.374554+0000","last_undegraded":"2023-09-13T06:07:08.374554+0000","last_fullsized":"2023-09-13T06:07:08.374554+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:11.243100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.389215+0000","last_change":"2023-09-13T06:07:07.389099+0000","last_active":"2023-09-13T06:07:07.389215+0000","last_peered":"2023-09-13T06:07:07.389215+0000","last_clean":"2023-09-13T06:07:07.389215+0000","last_became_active":"2023-09-13T06:07:07.388832+0000","last_became_peered":"2023-09-13T06:07:07.388832+0000","last_unstale":"2023-09-13T06:07:07.389215+0000","last_undegraded":"2023-09-13T06:07:07.389215+0000","last_fullsized":"2023-09-13T06:07:07.389215+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:44.514158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374325+0000","last_change":"2023-09-13T06:07:06.841256+0000","last_active":"2023-09-13T06:07:08.374325+0000","last_peered":"2023-09-13T06:07:08.374325+0000","last_clean":"2023-09-13T06:07:08.374325+0000","last_became_active":"2023-09-13T06:07:06.841027+0000","last_became_peered":"2023-09-13T06:07:06.841027+0000","last_unstale":"2023-09-13T06:07:08.374325+0000","last_undegraded":"2023-09-13T06:07:08.374325+0000","last_fullsized":"2023-09-13T06:07:08.374325+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:34.923139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.385505+0000","last_change":"2023-09-13T06:07:07.385320+0000","last_active":"2023-09-13T06:07:07.385505+0000","last_peered":"2023-09-13T06:07:07.385505+0000","last_clean":"2023-09-13T06:07:07.385505+0000","last_became_active":"2023-09-13T06:07:07.385028+0000","last_became_peered":"2023-09-13T06:07:07.385028+0000","last_unstale":"2023-09-13T06:07:07.385505+0000","last_undegraded":"2023-09-13T06:07:07.385505+0000","last_fullsized":"2023-09-13T06:07:07.385505+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:45.808683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.371336+0000","last_change":"2023-09-13T06:07:06.845003+0000","last_active":"2023-09-13T06:07:07.371336+0000","last_peered":"2023-09-13T06:07:07.371336+0000","last_clean":"2023-09-13T06:07:07.371336+0000","last_became_active":"2023-09-13T06:07:06.844777+0000","last_became_peered":"2023-09-13T06:07:06.844777+0000","last_unstale":"2023-09-13T06:07:07.371336+0000","last_undegraded":"2023-09-13T06:07:07.371336+0000","last_fullsized":"2023-09-13T06:07:07.371336+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:44.441136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.376210+0000","last_change":"2023-09-13T06:07:07.376123+0000","last_active":"2023-09-13T06:07:07.376210+0000","last_peered":"2023-09-13T06:07:07.376210+0000","last_clean":"2023-09-13T06:07:07.376210+0000","last_became_active":"2023-09-13T06:07:07.375846+0000","last_became_peered":"2023-09-13T06:07:07.375846+0000","last_unstale":"2023-09-13T06:07:07.376210+0000","last_undegraded":"2023-09-13T06:07:07.376210+0000","last_fullsized":"2023-09-13T06:07:07.376210+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:37.138886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374440+0000","last_change":"2023-09-13T06:07:06.842745+0000","last_active":"2023-09-13T06:07:08.374440+0000","last_peered":"2023-09-13T06:07:08.374440+0000","last_clean":"2023-09-13T06:07:08.374440+0000","last_became_active":"2023-09-13T06:07:06.842089+0000","last_became_peered":"2023-09-13T06:07:06.842089+0000","last_unstale":"2023-09-13T06:07:08.374440+0000","last_undegraded":"2023-09-13T06:07:08.374440+0000","last_fullsized":"2023-09-13T06:07:08.374440+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:36:10.618926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374328+0000","last_change":"2023-09-13T06:07:07.389440+0000","last_active":"2023-09-13T06:07:08.374328+0000","last_peered":"2023-09-13T06:07:08.374328+0000","last_clean":"2023-09-13T06:07:08.374328+0000","last_became_active":"2023-09-13T06:07:07.389116+0000","last_became_peered":"2023-09-13T06:07:07.389116+0000","last_unstale":"2023-09-13T06:07:08.374328+0000","last_undegraded":"2023-09-13T06:07:08.374328+0000","last_fullsized":"2023-09-13T06:07:08.374328+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:03:53.375920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.846496+0000","last_change":"2023-09-13T06:07:06.842718+0000","last_active":"2023-09-13T06:07:07.846496+0000","last_peered":"2023-09-13T06:07:07.846496+0000","last_clean":"2023-09-13T06:07:07.846496+0000","last_became_active":"2023-09-13T06:07:06.842264+0000","last_became_peered":"2023-09-13T06:07:06.842264+0000","last_unstale":"2023-09-13T06:07:07.846496+0000","last_undegraded":"2023-09-13T06:07:07.846496+0000","last_fullsized":"2023-09-13T06:07:07.846496+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:54:31.672548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.377908+0000","last_change":"2023-09-13T06:07:07.377827+0000","last_active":"2023-09-13T06:07:07.377908+0000","last_peered":"2023-09-13T06:07:07.377908+0000","last_clean":"2023-09-13T06:07:07.377908+0000","last_became_active":"2023-09-13T06:07:07.377228+0000","last_became_peered":"2023-09-13T06:07:07.377228+0000","last_unstale":"2023-09-13T06:07:07.377908+0000","last_undegraded":"2023-09-13T06:07:07.377908+0000","last_fullsized":"2023-09-13T06:07:07.377908+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:44.514158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375405+0000","last_change":"2023-09-13T06:07:06.842287+0000","last_active":"2023-09-13T06:07:08.375405+0000","last_peered":"2023-09-13T06:07:08.375405+0000","last_clean":"2023-09-13T06:07:08.375405+0000","last_became_active":"2023-09-13T06:07:06.842000+0000","last_became_peered":"2023-09-13T06:07:06.842000+0000","last_unstale":"2023-09-13T06:07:08.375405+0000","last_undegraded":"2023-09-13T06:07:08.375405+0000","last_fullsized":"2023-09-13T06:07:08.375405+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:39:55.608980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374372+0000","last_change":"2023-09-13T06:07:07.381317+0000","last_active":"2023-09-13T06:07:08.374372+0000","last_peered":"2023-09-13T06:07:08.374372+0000","last_clean":"2023-09-13T06:07:08.374372+0000","last_became_active":"2023-09-13T06:07:07.381093+0000","last_became_peered":"2023-09-13T06:07:07.381093+0000","last_unstale":"2023-09-13T06:07:08.374372+0000","last_undegraded":"2023-09-13T06:07:08.374372+0000","last_fullsized":"2023-09-13T06:07:08.374372+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:23:49.999069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375381+0000","last_change":"2023-09-13T06:07:06.839370+0000","last_active":"2023-09-13T06:07:08.375381+0000","last_peered":"2023-09-13T06:07:08.375381+0000","last_clean":"2023-09-13T06:07:08.375381+0000","last_became_active":"2023-09-13T06:07:06.839129+0000","last_became_peered":"2023-09-13T06:07:06.839129+0000","last_unstale":"2023-09-13T06:07:08.375381+0000","last_undegraded":"2023-09-13T06:07:08.375381+0000","last_fullsized":"2023-09-13T06:07:08.375381+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:54:38.799176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.388118+0000","last_change":"2023-09-13T06:07:07.387998+0000","last_active":"2023-09-13T06:07:07.388118+0000","last_peered":"2023-09-13T06:07:07.388118+0000","last_clean":"2023-09-13T06:07:07.388118+0000","last_became_active":"2023-09-13T06:07:07.387782+0000","last_became_peered":"2023-09-13T06:07:07.387782+0000","last_unstale":"2023-09-13T06:07:07.388118+0000","last_undegraded":"2023-09-13T06:07:07.388118+0000","last_fullsized":"2023-09-13T06:07:07.388118+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:51:13.933883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.381780+0000","last_change":"2023-09-13T06:07:06.847104+0000","last_active":"2023-09-13T06:07:07.381780+0000","last_peered":"2023-09-13T06:07:07.381780+0000","last_clean":"2023-09-13T06:07:07.381780+0000","last_became_active":"2023-09-13T06:07:06.846870+0000","last_became_peered":"2023-09-13T06:07:06.846870+0000","last_unstale":"2023-09-13T06:07:07.381780+0000","last_undegraded":"2023-09-13T06:07:07.381780+0000","last_fullsized":"2023-09-13T06:07:07.381780+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:14.830866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375022+0000","last_change":"2023-09-13T06:07:07.388087+0000","last_active":"2023-09-13T06:07:08.375022+0000","last_peered":"2023-09-13T06:07:08.375022+0000","last_clean":"2023-09-13T06:07:08.375022+0000","last_became_active":"2023-09-13T06:07:07.387831+0000","last_became_peered":"2023-09-13T06:07:07.387831+0000","last_unstale":"2023-09-13T06:07:08.375022+0000","last_undegraded":"2023-09-13T06:07:08.375022+0000","last_fullsized":"2023-09-13T06:07:08.375022+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:54:33.362658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":20,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374159+0000","last_change":"2023-09-13T06:07:06.842262+0000","last_active":"2023-09-13T06:07:08.374159+0000","last_peered":"2023-09-13T06:07:08.374159+0000","last_clean":"2023-09-13T06:07:08.374159+0000","last_became_active":"2023-09-13T06:07:06.842025+0000","last_became_peered":"2023-09-13T06:07:06.842025+0000","last_unstale":"2023-09-13T06:07:08.374159+0000","last_undegraded":"2023-09-13T06:07:08.374159+0000","last_fullsized":"2023-09-13T06:07:08.374159+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:28:17.086751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.390697+0000","last_change":"2023-09-13T06:07:07.390580+0000","last_active":"2023-09-13T06:07:07.390697+0000","last_peered":"2023-09-13T06:07:07.390697+0000","last_clean":"2023-09-13T06:07:07.390697+0000","last_became_active":"2023-09-13T06:07:07.390329+0000","last_became_peered":"2023-09-13T06:07:07.390329+0000","last_unstale":"2023-09-13T06:07:07.390697+0000","last_undegraded":"2023-09-13T06:07:07.390697+0000","last_fullsized":"2023-09-13T06:07:07.390697+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:45.186221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.843525+0000","last_change":"2023-09-13T06:07:06.842314+0000","last_active":"2023-09-13T06:07:07.843525+0000","last_peered":"2023-09-13T06:07:07.843525+0000","last_clean":"2023-09-13T06:07:07.843525+0000","last_became_active":"2023-09-13T06:07:06.841749+0000","last_became_peered":"2023-09-13T06:07:06.841749+0000","last_unstale":"2023-09-13T06:07:07.843525+0000","last_undegraded":"2023-09-13T06:07:07.843525+0000","last_fullsized":"2023-09-13T06:07:07.843525+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:27.099353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387698+0000","last_change":"2023-09-13T06:07:07.387270+0000","last_active":"2023-09-13T06:07:07.387698+0000","last_peered":"2023-09-13T06:07:07.387698+0000","last_clean":"2023-09-13T06:07:07.387698+0000","last_became_active":"2023-09-13T06:07:07.387043+0000","last_became_peered":"2023-09-13T06:07:07.387043+0000","last_unstale":"2023-09-13T06:07:07.387698+0000","last_undegraded":"2023-09-13T06:07:07.387698+0000","last_fullsized":"2023-09-13T06:07:07.387698+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:36:23.460094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.843100+0000","last_change":"2023-09-13T06:07:06.845785+0000","last_active":"2023-09-13T06:07:07.843100+0000","last_peered":"2023-09-13T06:07:07.843100+0000","last_clean":"2023-09-13T06:07:07.843100+0000","last_became_active":"2023-09-13T06:07:06.845362+0000","last_became_peered":"2023-09-13T06:07:06.845362+0000","last_unstale":"2023-09-13T06:07:07.843100+0000","last_undegraded":"2023-09-13T06:07:07.843100+0000","last_fullsized":"2023-09-13T06:07:07.843100+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:51:12.923170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374623+0000","last_change":"2023-09-13T06:07:07.391836+0000","last_active":"2023-09-13T06:07:08.374623+0000","last_peered":"2023-09-13T06:07:08.374623+0000","last_clean":"2023-09-13T06:07:08.374623+0000","last_became_active":"2023-09-13T06:07:07.391199+0000","last_became_peered":"2023-09-13T06:07:07.391199+0000","last_unstale":"2023-09-13T06:07:08.374623+0000","last_undegraded":"2023-09-13T06:07:08.374623+0000","last_fullsized":"2023-09-13T06:07:08.374623+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:48:00.438829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.375758+0000","last_change":"2023-09-13T06:07:06.845597+0000","last_active":"2023-09-13T06:07:07.375758+0000","last_peered":"2023-09-13T06:07:07.375758+0000","last_clean":"2023-09-13T06:07:07.375758+0000","last_became_active":"2023-09-13T06:07:06.845359+0000","last_became_peered":"2023-09-13T06:07:06.845359+0000","last_unstale":"2023-09-13T06:07:07.375758+0000","last_undegraded":"2023-09-13T06:07:07.375758+0000","last_fullsized":"2023-09-13T06:07:07.375758+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:54.793149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375202+0000","last_change":"2023-09-13T06:07:07.381565+0000","last_active":"2023-09-13T06:07:08.375202+0000","last_peered":"2023-09-13T06:07:08.375202+0000","last_clean":"2023-09-13T06:07:08.375202+0000","last_became_active":"2023-09-13T06:07:07.381032+0000","last_became_peered":"2023-09-13T06:07:07.381032+0000","last_unstale":"2023-09-13T06:07:08.375202+0000","last_undegraded":"2023-09-13T06:07:08.375202+0000","last_fullsized":"2023-09-13T06:07:08.375202+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:31:19.024866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.843846+0000","last_change":"2023-09-13T06:07:06.842800+0000","last_active":"2023-09-13T06:07:07.843846+0000","last_peered":"2023-09-13T06:07:07.843846+0000","last_clean":"2023-09-13T06:07:07.843846+0000","last_became_active":"2023-09-13T06:07:06.842219+0000","last_became_peered":"2023-09-13T06:07:06.842219+0000","last_unstale":"2023-09-13T06:07:07.843846+0000","last_undegraded":"2023-09-13T06:07:07.843846+0000","last_fullsized":"2023-09-13T06:07:07.843846+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:36.282492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375241+0000","last_change":"2023-09-13T06:07:07.380404+0000","last_active":"2023-09-13T06:07:08.375241+0000","last_peered":"2023-09-13T06:07:08.375241+0000","last_clean":"2023-09-13T06:07:08.375241+0000","last_became_active":"2023-09-13T06:07:07.380190+0000","last_became_peered":"2023-09-13T06:07:07.380190+0000","last_unstale":"2023-09-13T06:07:08.375241+0000","last_undegraded":"2023-09-13T06:07:08.375241+0000","last_fullsized":"2023-09-13T06:07:08.375241+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:36:28.554596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.379753+0000","last_change":"2023-09-13T06:07:06.840866+0000","last_active":"2023-09-13T06:07:07.379753+0000","last_peered":"2023-09-13T06:07:07.379753+0000","last_clean":"2023-09-13T06:07:07.379753+0000","last_became_active":"2023-09-13T06:07:06.840633+0000","last_became_peered":"2023-09-13T06:07:06.840633+0000","last_unstale":"2023-09-13T06:07:07.379753+0000","last_undegraded":"2023-09-13T06:07:07.379753+0000","last_fullsized":"2023-09-13T06:07:07.379753+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:28.321881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375335+0000","last_change":"2023-09-13T06:07:07.384382+0000","last_active":"2023-09-13T06:07:08.375335+0000","last_peered":"2023-09-13T06:07:08.375335+0000","last_clean":"2023-09-13T06:07:08.375335+0000","last_became_active":"2023-09-13T06:07:07.384175+0000","last_became_peered":"2023-09-13T06:07:07.384175+0000","last_unstale":"2023-09-13T06:07:08.375335+0000","last_undegraded":"2023-09-13T06:07:08.375335+0000","last_fullsized":"2023-09-13T06:07:08.375335+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:43:07.325949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.379364+0000","last_change":"2023-09-13T06:07:06.841623+0000","last_active":"2023-09-13T06:07:07.379364+0000","last_peered":"2023-09-13T06:07:07.379364+0000","last_clean":"2023-09-13T06:07:07.379364+0000","last_became_active":"2023-09-13T06:07:06.841366+0000","last_became_peered":"2023-09-13T06:07:06.841366+0000","last_unstale":"2023-09-13T06:07:07.379364+0000","last_undegraded":"2023-09-13T06:07:07.379364+0000","last_fullsized":"2023-09-13T06:07:07.379364+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:23:48.988356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.385463+0000","last_change":"2023-09-13T06:07:07.385384+0000","last_active":"2023-09-13T06:07:07.385463+0000","last_peered":"2023-09-13T06:07:07.385463+0000","last_clean":"2023-09-13T06:07:07.385463+0000","last_became_active":"2023-09-13T06:07:07.384379+0000","last_became_peered":"2023-09-13T06:07:07.384379+0000","last_unstale":"2023-09-13T06:07:07.385463+0000","last_undegraded":"2023-09-13T06:07:07.385463+0000","last_fullsized":"2023-09-13T06:07:07.385463+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:36:11.629639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.375059+0000","last_change":"2023-09-13T06:07:06.848567+0000","last_active":"2023-09-13T06:07:07.375059+0000","last_peered":"2023-09-13T06:07:07.375059+0000","last_clean":"2023-09-13T06:07:07.375059+0000","last_became_active":"2023-09-13T06:07:06.847670+0000","last_became_peered":"2023-09-13T06:07:06.847670+0000","last_unstale":"2023-09-13T06:07:07.375059+0000","last_undegraded":"2023-09-13T06:07:07.375059+0000","last_fullsized":"2023-09-13T06:07:07.375059+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:36:10.618926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.383830+0000","last_change":"2023-09-13T06:07:07.383511+0000","last_active":"2023-09-13T06:07:07.383830+0000","last_peered":"2023-09-13T06:07:07.383830+0000","last_clean":"2023-09-13T06:07:07.383830+0000","last_became_active":"2023-09-13T06:07:07.382961+0000","last_became_peered":"2023-09-13T06:07:07.382961+0000","last_unstale":"2023-09-13T06:07:07.383830+0000","last_undegraded":"2023-09-13T06:07:07.383830+0000","last_fullsized":"2023-09-13T06:07:07.383830+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:22:06.852006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.844637+0000","last_change":"2023-09-13T06:07:06.842492+0000","last_active":"2023-09-13T06:07:07.844637+0000","last_peered":"2023-09-13T06:07:07.844637+0000","last_clean":"2023-09-13T06:07:07.844637+0000","last_became_active":"2023-09-13T06:07:06.842228+0000","last_became_peered":"2023-09-13T06:07:06.842228+0000","last_unstale":"2023-09-13T06:07:07.844637+0000","last_undegraded":"2023-09-13T06:07:07.844637+0000","last_fullsized":"2023-09-13T06:07:07.844637+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:49.354993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374767+0000","last_change":"2023-09-13T06:07:07.381117+0000","last_active":"2023-09-13T06:07:08.374767+0000","last_peered":"2023-09-13T06:07:08.374767+0000","last_clean":"2023-09-13T06:07:08.374767+0000","last_became_active":"2023-09-13T06:07:07.380917+0000","last_became_peered":"2023-09-13T06:07:07.380917+0000","last_unstale":"2023-09-13T06:07:08.374767+0000","last_undegraded":"2023-09-13T06:07:08.374767+0000","last_fullsized":"2023-09-13T06:07:08.374767+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:02.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.375139+0000","last_change":"2023-09-13T06:07:06.842945+0000","last_active":"2023-09-13T06:07:07.375139+0000","last_peered":"2023-09-13T06:07:07.375139+0000","last_clean":"2023-09-13T06:07:07.375139+0000","last_became_active":"2023-09-13T06:07:06.842577+0000","last_became_peered":"2023-09-13T06:07:06.842577+0000","last_unstale":"2023-09-13T06:07:07.375139+0000","last_undegraded":"2023-09-13T06:07:07.375139+0000","last_fullsized":"2023-09-13T06:07:07.375139+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:26:01.910794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374479+0000","last_change":"2023-09-13T06:07:07.385830+0000","last_active":"2023-09-13T06:07:08.374479+0000","last_peered":"2023-09-13T06:07:08.374479+0000","last_clean":"2023-09-13T06:07:08.374479+0000","last_became_active":"2023-09-13T06:07:07.385564+0000","last_became_peered":"2023-09-13T06:07:07.385564+0000","last_unstale":"2023-09-13T06:07:08.374479+0000","last_undegraded":"2023-09-13T06:07:08.374479+0000","last_fullsized":"2023-09-13T06:07:08.374479+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:29.332595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.374835+0000","last_change":"2023-09-13T06:07:06.842400+0000","last_active":"2023-09-13T06:07:07.374835+0000","last_peered":"2023-09-13T06:07:07.374835+0000","last_clean":"2023-09-13T06:07:07.374835+0000","last_became_active":"2023-09-13T06:07:06.842171+0000","last_became_peered":"2023-09-13T06:07:06.842171+0000","last_unstale":"2023-09-13T06:07:07.374835+0000","last_undegraded":"2023-09-13T06:07:07.374835+0000","last_fullsized":"2023-09-13T06:07:07.374835+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:51:12.923170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.388088+0000","last_change":"2023-09-13T06:07:07.387886+0000","last_active":"2023-09-13T06:07:07.388088+0000","last_peered":"2023-09-13T06:07:07.388088+0000","last_clean":"2023-09-13T06:07:07.388088+0000","last_became_active":"2023-09-13T06:07:07.387625+0000","last_became_peered":"2023-09-13T06:07:07.387625+0000","last_unstale":"2023-09-13T06:07:07.388088+0000","last_undegraded":"2023-09-13T06:07:07.388088+0000","last_fullsized":"2023-09-13T06:07:07.388088+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:55.803862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.374368+0000","last_change":"2023-09-13T06:07:06.846028+0000","last_active":"2023-09-13T06:07:07.374368+0000","last_peered":"2023-09-13T06:07:07.374368+0000","last_clean":"2023-09-13T06:07:07.374368+0000","last_became_active":"2023-09-13T06:07:06.845760+0000","last_became_peered":"2023-09-13T06:07:06.845760+0000","last_unstale":"2023-09-13T06:07:07.374368+0000","last_undegraded":"2023-09-13T06:07:07.374368+0000","last_fullsized":"2023-09-13T06:07:07.374368+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:20:40.935026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375155+0000","last_change":"2023-09-13T06:07:07.387997+0000","last_active":"2023-09-13T06:07:08.375155+0000","last_peered":"2023-09-13T06:07:08.375155+0000","last_clean":"2023-09-13T06:07:08.375155+0000","last_became_active":"2023-09-13T06:07:07.387616+0000","last_became_peered":"2023-09-13T06:07:07.387616+0000","last_unstale":"2023-09-13T06:07:08.375155+0000","last_undegraded":"2023-09-13T06:07:08.375155+0000","last_fullsized":"2023-09-13T06:07:08.375155+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:15:47.846925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.375181+0000","last_change":"2023-09-13T06:07:06.846177+0000","last_active":"2023-09-13T06:07:07.375181+0000","last_peered":"2023-09-13T06:07:07.375181+0000","last_clean":"2023-09-13T06:07:07.375181+0000","last_became_active":"2023-09-13T06:07:06.845913+0000","last_became_peered":"2023-09-13T06:07:06.845913+0000","last_unstale":"2023-09-13T06:07:07.375181+0000","last_undegraded":"2023-09-13T06:07:07.375181+0000","last_fullsized":"2023-09-13T06:07:07.375181+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:20:40.935026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.382608+0000","last_change":"2023-09-13T06:07:07.382118+0000","last_active":"2023-09-13T06:07:07.382608+0000","last_peered":"2023-09-13T06:07:07.382608+0000","last_clean":"2023-09-13T06:07:07.382608+0000","last_became_active":"2023-09-13T06:07:07.381874+0000","last_became_peered":"2023-09-13T06:07:07.381874+0000","last_unstale":"2023-09-13T06:07:07.382608+0000","last_undegraded":"2023-09-13T06:07:07.382608+0000","last_fullsized":"2023-09-13T06:07:07.382608+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:22:06.852006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.372827+0000","last_change":"2023-09-13T06:07:06.846212+0000","last_active":"2023-09-13T06:07:07.372827+0000","last_peered":"2023-09-13T06:07:07.372827+0000","last_clean":"2023-09-13T06:07:07.372827+0000","last_became_active":"2023-09-13T06:07:06.845444+0000","last_became_peered":"2023-09-13T06:07:06.845444+0000","last_unstale":"2023-09-13T06:07:07.372827+0000","last_undegraded":"2023-09-13T06:07:07.372827+0000","last_fullsized":"2023-09-13T06:07:07.372827+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:14.830866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375319+0000","last_change":"2023-09-13T06:07:07.388967+0000","last_active":"2023-09-13T06:07:08.375319+0000","last_peered":"2023-09-13T06:07:08.375319+0000","last_clean":"2023-09-13T06:07:08.375319+0000","last_became_active":"2023-09-13T06:07:07.388768+0000","last_became_peered":"2023-09-13T06:07:07.388768+0000","last_unstale":"2023-09-13T06:07:08.375319+0000","last_undegraded":"2023-09-13T06:07:08.375319+0000","last_fullsized":"2023-09-13T06:07:08.375319+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:05.145614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.372197+0000","last_change":"2023-09-13T06:07:06.839256+0000","last_active":"2023-09-13T06:07:07.372197+0000","last_peered":"2023-09-13T06:07:07.372197+0000","last_clean":"2023-09-13T06:07:07.372197+0000","last_became_active":"2023-09-13T06:07:06.839029+0000","last_became_peered":"2023-09-13T06:07:06.839029+0000","last_unstale":"2023-09-13T06:07:07.372197+0000","last_undegraded":"2023-09-13T06:07:07.372197+0000","last_fullsized":"2023-09-13T06:07:07.372197+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:49:46.732105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.387474+0000","last_change":"2023-09-13T06:07:07.387252+0000","last_active":"2023-09-13T06:07:07.387474+0000","last_peered":"2023-09-13T06:07:07.387474+0000","last_clean":"2023-09-13T06:07:07.387474+0000","last_became_active":"2023-09-13T06:07:07.386695+0000","last_became_peered":"2023-09-13T06:07:07.386695+0000","last_unstale":"2023-09-13T06:07:07.387474+0000","last_undegraded":"2023-09-13T06:07:07.387474+0000","last_fullsized":"2023-09-13T06:07:07.387474+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:28.110066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375399+0000","last_change":"2023-09-13T06:07:06.845611+0000","last_active":"2023-09-13T06:07:08.375399+0000","last_peered":"2023-09-13T06:07:08.375399+0000","last_clean":"2023-09-13T06:07:08.375399+0000","last_became_active":"2023-09-13T06:07:06.845229+0000","last_became_peered":"2023-09-13T06:07:06.845229+0000","last_unstale":"2023-09-13T06:07:08.375399+0000","last_undegraded":"2023-09-13T06:07:08.375399+0000","last_fullsized":"2023-09-13T06:07:08.375399+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:24:30.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.375354+0000","last_change":"2023-09-13T06:07:07.385122+0000","last_active":"2023-09-13T06:07:08.375354+0000","last_peered":"2023-09-13T06:07:08.375354+0000","last_clean":"2023-09-13T06:07:08.375354+0000","last_became_active":"2023-09-13T06:07:07.384866+0000","last_became_peered":"2023-09-13T06:07:07.384866+0000","last_unstale":"2023-09-13T06:07:08.375354+0000","last_undegraded":"2023-09-13T06:07:08.375354+0000","last_fullsized":"2023-09-13T06:07:08.375354+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:06.823683+0000","last_clean_scrub_stamp":"2023-09-13T06:07:06.823683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:32:52.657765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-09-13T06:07:08.374429+0000","last_change":"2023-09-13T06:07:06.844089+0000","last_active":"2023-09-13T06:07:08.374429+0000","last_peered":"2023-09-13T06:07:08.374429+0000","last_clean":"2023-09-13T06:07:08.374429+0000","last_became_active":"2023-09-13T06:07:06.843850+0000","last_became_peered":"2023-09-13T06:07:06.843850+0000","last_unstale":"2023-09-13T06:07:08.374429+0000","last_undegraded":"2023-09-13T06:07:08.374429+0000","last_fullsized":"2023-09-13T06:07:08.374429+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:05.812970+0000","last_clean_scrub_stamp":"2023-09-13T06:07:05.812970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:14.830866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":281,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-09-13T06:07:07.373195+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:07:07.373195+0000","last_peered":"2023-09-13T06:07:07.373195+0000","last_clean":"2023-09-13T06:07:07.373195+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:07:07.373195+0000","last_undegraded":"2023-09-13T06:07:07.373195+0000","last_fullsized":"2023-09-13T06:07:07.373195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194076,"statfs":{"total":200000000,"available":198734077,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.70399999999999996},"min":{"1min":0.48399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0189999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.877},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.74399999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70899999999999996,"15min":0.69599999999999995},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.45700000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.55900000000000005,"5min":0.432,"15min":0.432},"max":{"1min":1.016,"5min":1.395,"15min":1.395},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96899999999999997,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.90300000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.51400000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.357,"15min":1.357},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0580000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.85099999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.63200000000000001},"min":{"1min":0.38200000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.85199999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64600000000000002,"15min":0.66400000000000003},"min":{"1min":0.44,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88400000000000001,"5min":1.018,"15min":1.018},"last":0.57299999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67200000000000004,"15min":0.69899999999999995},"min":{"1min":0.48599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98099999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89100000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324445,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92400000000000004,"5min":1.181,"15min":1.181},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.35899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82199999999999995,"5min":1.028,"15min":1.028},"last":0.71699999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68300000000000005,"15min":0.69599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":1.153,"15min":1.153},"last":0.68799999999999994}]},{"osd":2,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.44700000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.877,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90700000000000003,"5min":1.085,"15min":1.085},"last":0.73399999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.92900000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94499999999999995,"5min":1.526,"15min":1.526},"last":0.746}]},{"osd":4,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.59099999999999997},"min":{"1min":0.42599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82499999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.83099999999999996,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.65300000000000002}]},{"osd":5,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.629,"15min":0.621},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83199999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69799999999999995,"15min":0.68200000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.95299999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.71699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86699999999999999,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88300000000000001,"5min":1.133,"15min":1.133},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324375,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.441,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.879,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.66300000000000003},"min":{"1min":0.49099999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.61499999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93000000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69499999999999995,"15min":0.67900000000000005},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.874,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71499999999999997,"15min":0.69499999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.54000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85499999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.53400000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80800000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63800000000000001,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.002,"5min":1.054,"15min":1.054},"last":0.55700000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.46000000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84999999999999998,"5min":0.997,"15min":0.997},"last":0.63},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.878,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67000000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.42099999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72799999999999998,"15min":0.745},"min":{"1min":0.495,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.996,"5min":1.026,"15min":1.026},"last":0.65900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":661,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194651,"statfs":{"total":200000000,"available":199322709,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85899999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.495,"5min":0.38,"15min":0.38},"max":{"1min":0.97999999999999998,"5min":1.05,"15min":1.05},"last":0.502}]},{"osd":1,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.45100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.83299999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.51600000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.877,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.66800000000000004},"min":{"1min":0.495,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72299999999999998,"15min":0.73699999999999999},"min":{"1min":0.46500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93100000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.749}]},{"osd":3,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.51400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.78500000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64900000000000002,"15min":0.67100000000000004},"min":{"1min":0.45700000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.74299999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70299999999999996,"15min":0.68899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.69299999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:06:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.49299999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.50600000000000001,"5min":0.498,"15min":0.498},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324445,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.629,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.42999999999999999},"min":{"1min":0.28999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42199999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44}]},{"osd":2,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67400000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.497,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97599999999999998,"5min":1.284,"15min":1.284},"last":0.749},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.71499999999999997},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90900000000000003,"5min":1.044,"15min":1.044},"last":0.78100000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93799999999999994,"5min":1.111,"15min":1.111},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.74199999999999999},"min":{"1min":0.56399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93700000000000006,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95599999999999996,"5min":1.097,"15min":1.097},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91900000000000004,"5min":1.458,"15min":1.458},"last":0.76800000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93899999999999995,"5min":1.383,"15min":1.383},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.95399999999999996,"5min":1.27,"15min":1.27},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324445,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.46899999999999997,"15min":0.40899999999999997},"min":{"1min":0.252,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.59299999999999997,"5min":10.401,"15min":10.401},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.47099999999999997,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56200000000000006,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":0.31}]},{"osd":1,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48899999999999999,"15min":0.45900000000000002},"min":{"1min":0.32700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66900000000000004,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50700000000000001,"15min":0.46700000000000003},"min":{"1min":0.38,"5min":0.312,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.55800000000000005,"15min":0.52200000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73999999999999999,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58999999999999997,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71399999999999997,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.47799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93799999999999994,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.77900000000000003,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.109,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.44700000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92400000000000004,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.751,"15min":0.73199999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.048,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0840000000000001,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.50700000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.004,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77400000000000002,"15min":0.76900000000000002},"min":{"1min":0.52500000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.135,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":665,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194646,"statfs":{"total":200000000,"available":199318145,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45300000000000001,"15min":0.436},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.80200000000000005,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.317,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68999999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.32700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.498},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48899999999999999,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.50900000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.52600000000000002},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52100000000000002,"15min":0.48699999999999999},"min":{"1min":0.33100000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80600000000000005,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.41499999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.999,"5min":1.089,"15min":1.089},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95999999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.98599999999999999,"5min":1.109,"15min":1.109},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.746},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96699999999999997,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90800000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95499999999999996,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.879}]},{"osd":7,"last update":"Wed Sep 13 06:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.47399999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96899999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.747,"15min":0.76200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94499999999999995,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.93600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194075,"statfs":{"total":200000000,"available":198733495,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63800000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.49299999999999999,"15min":0.47399999999999998},"min":{"1min":0.309,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72799999999999998,"5min":2.294,"15min":2.294},"last":0.52000000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.495},"min":{"1min":0.34000000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69099999999999995,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47699999999999998,"15min":0.48099999999999998},"min":{"1min":0.29999999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61699999999999999,"5min":2.056,"15min":2.056},"last":0.41399999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.32900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64200000000000002,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.38800000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.51000000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98299999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76100000000000001,"15min":0.78800000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93300000000000005,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.68500000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.02,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.78600000000000003},"min":{"1min":0.55100000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0820000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.80900000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89600000000000002,"5min":2.415,"15min":2.415},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.998,"5min":2.347,"15min":2.347},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.496,"5min":0.495,"15min":0.495},"max":{"1min":0.94299999999999995,"5min":2.367,"15min":2.367},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0509999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.85799999999999998}]}]}],"pool_statfs":[]}} 2023-09-13T06:07:12.286 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T06:07:12.286 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-13T06:07:12.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97f06a640 1 Processor -- start 2023-09-13T06:07:12.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97f06a640 1 -- start start 2023-09-13T06:07:12.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97f06a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9780cc2d0 0x7ff9780b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97f06a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9780b4830 0x7ff978159db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97f06a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9780cc9d0 con 0x7ff978159900 2023-09-13T06:07:12.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97f06a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9780b0c20 con 0x7ff9780cc2d0 2023-09-13T06:07:12.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97f06a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9780cccb0 con 0x7ff9780b4830 2023-09-13T06:07:12.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97ce06640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9780cc2d0 0x7ff9780b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97ce06640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9780cc2d0 0x7ff9780b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59154/0 (socket says 172.21.15.130:59154) 2023-09-13T06:07:12.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97ce06640 1 -- 172.21.15.130:0/3495075170 learned_addr learned my addr 172.21.15.130:0/3495075170 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:12.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97d607640 1 --2- 172.21.15.130:0/3495075170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9780b4830 0x7ff978159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97ce06640 1 -- 172.21.15.130:0/3495075170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9780b4830 msgr2=0x7ff978159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:12.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97ce06640 1 --2- 172.21.15.130:0/3495075170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9780b4830 0x7ff978159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97ce06640 1 -- 172.21.15.130:0/3495075170 >> v1:172.21.15.164:6789/0 conn(0x7ff978159900 legacy=0x7ff9780b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.464+0000 7ff97ce06640 1 -- 172.21.15.130:0/3495075170 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9780ccf90 con 0x7ff9780cc2d0 2023-09-13T06:07:12.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff97ce06640 1 --2- 172.21.15.130:0/3495075170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9780cc2d0 0x7ff9780b0100 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff974009870 tx=0x7ff97401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8bb383513f9617 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:12.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff96f7fe640 1 -- 172.21.15.130:0/3495075170 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9740aa670 con 0x7ff9780cc2d0 2023-09-13T06:07:12.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff96f7fe640 1 -- 172.21.15.130:0/3495075170 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9740aa7d0 con 0x7ff9780cc2d0 2023-09-13T06:07:12.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff96f7fe640 1 -- 172.21.15.130:0/3495075170 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9740aab60 con 0x7ff9780cc2d0 2023-09-13T06:07:12.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff97f06a640 1 -- 172.21.15.130:0/3495075170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9780cc2d0 msgr2=0x7ff9780b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff97f06a640 1 --2- 172.21.15.130:0/3495075170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9780cc2d0 0x7ff9780b0100 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff974009870 tx=0x7ff97401c510 comp rx=0 tx=0).stop 2023-09-13T06:07:12.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff97f06a640 1 -- 172.21.15.130:0/3495075170 shutdown_connections 2023-09-13T06:07:12.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff97f06a640 1 --2- 172.21.15.130:0/3495075170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9780b4830 0x7ff978159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff97f06a640 1 --2- 172.21.15.130:0/3495075170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9780cc2d0 0x7ff9780b0100 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff97f06a640 1 -- 172.21.15.130:0/3495075170 >> 172.21.15.130:0/3495075170 conn(0x7ff978065990 msgr2=0x7ff978065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:12.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff97f06a640 1 -- 172.21.15.130:0/3495075170 shutdown_connections 2023-09-13T06:07:12.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.468+0000 7ff97f06a640 1 -- 172.21.15.130:0/3495075170 wait complete. 2023-09-13T06:07:12.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97f06a640 1 Processor -- start 2023-09-13T06:07:12.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97f06a640 1 -- start start 2023-09-13T06:07:12.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97f06a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9780b4830 0x7ff97806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97f06a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9780cc2d0 0x7ff978143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97f06a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff978159900 0x7ff978143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97f06a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97806be40 con 0x7ff9780b4830 2023-09-13T06:07:12.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97f06a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97806d810 con 0x7ff978159900 2023-09-13T06:07:12.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97f06a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97806dae0 con 0x7ff9780cc2d0 2023-09-13T06:07:12.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97ce06640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9780b4830 0x7ff97806d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97ce06640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9780b4830 0x7ff97806d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59160/0 (socket says 172.21.15.130:59160) 2023-09-13T06:07:12.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97ce06640 1 -- 172.21.15.130:0/2985171065 learned_addr learned my addr 172.21.15.130:0/2985171065 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:12.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97d607640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff978159900 0x7ff978143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff96ffff640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9780cc2d0 0x7ff978143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97ce06640 1 -- 172.21.15.130:0/2985171065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9780cc2d0 msgr2=0x7ff978143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97ce06640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9780cc2d0 0x7ff978143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97ce06640 1 -- 172.21.15.130:0/2985171065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff978159900 msgr2=0x7ff978143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97ce06640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff978159900 0x7ff978143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97ce06640 1 -- 172.21.15.130:0/2985171065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9740094d0 con 0x7ff9780b4830 2023-09-13T06:07:12.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97d607640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff978159900 0x7ff978143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:12.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff96ffff640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9780cc2d0 0x7ff978143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:12.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97ce06640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9780b4830 0x7ff97806d2d0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ff97401a140 tx=0x7ff97401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:12.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff96d7fa640 1 -- 172.21.15.130:0/2985171065 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9740b3800 con 0x7ff9780b4830 2023-09-13T06:07:12.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff96d7fa640 1 -- 172.21.15.130:0/2985171065 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9740b3960 con 0x7ff9780b4830 2023-09-13T06:07:12.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff96d7fa640 1 -- 172.21.15.130:0/2985171065 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9740b3d10 con 0x7ff9780b4830 2023-09-13T06:07:12.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97f06a640 1 -- 172.21.15.130:0/2985171065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97806ddc0 con 0x7ff9780b4830 2023-09-13T06:07:12.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.472+0000 7ff97f06a640 1 -- 172.21.15.130:0/2985171065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97806e380 con 0x7ff9780b4830 2023-09-13T06:07:12.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.476+0000 7ff97f06a640 1 -- 172.21.15.130:0/2985171065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9780618a0 con 0x7ff9780b4830 2023-09-13T06:07:12.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.476+0000 7ff96d7fa640 1 -- 172.21.15.130:0/2985171065 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff9740b2380 con 0x7ff9780b4830 2023-09-13T06:07:12.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.476+0000 7ff96d7fa640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff964065b20 0x7ff964067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.476+0000 7ff96d7fa640 1 -- 172.21.15.130:0/2985171065 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff97411dc60 con 0x7ff9780b4830 2023-09-13T06:07:12.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.476+0000 7ff96ffff640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff964065b20 0x7ff964067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.476+0000 7ff96ffff640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff964065b20 0x7ff964067fe0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff978156410 tx=0x7ff968009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:12.483 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.480+0000 7ff96d7fa640 1 -- 172.21.15.130:0/2985171065 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff9740eb650 con 0x7ff9780b4830 2023-09-13T06:07:12.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.684+0000 7ff97f06a640 1 -- 172.21.15.130:0/2985171065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff9780b3700 con 0x7ff9780b4830 2023-09-13T06:07:12.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.688+0000 7ff96d7fa640 1 -- 172.21.15.130:0/2985171065 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff9740eec70 con 0x7ff9780b4830 2023-09-13T06:07:12.692 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:07:12.692 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:07:12.693 INFO:teuthology.orchestra.run.smithi130.stdout: caps mds = "allow" 2023-09-13T06:07:12.693 INFO:teuthology.orchestra.run.smithi130.stdout: caps mon = "allow r" 2023-09-13T06:07:12.693 INFO:teuthology.orchestra.run.smithi130.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-13T06:07:12.693 INFO:teuthology.orchestra.run.smithi130.stderr:updated caps for client.0 2023-09-13T06:07:12.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 -- 172.21.15.130:0/2985171065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff964065b20 msgr2=0x7ff964067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff964065b20 0x7ff964067fe0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff978156410 tx=0x7ff968009040 comp rx=0 tx=0).stop 2023-09-13T06:07:12.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 -- 172.21.15.130:0/2985171065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9780b4830 msgr2=0x7ff97806d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9780b4830 0x7ff97806d2d0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ff97401a140 tx=0x7ff97401ad50 comp rx=0 tx=0).stop 2023-09-13T06:07:12.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 -- 172.21.15.130:0/2985171065 shutdown_connections 2023-09-13T06:07:12.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff964065b20 0x7ff964067fe0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff978159900 0x7ff978143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9780cc2d0 0x7ff978143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 --2- 172.21.15.130:0/2985171065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9780b4830 0x7ff97806d2d0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 -- 172.21.15.130:0/2985171065 >> 172.21.15.130:0/2985171065 conn(0x7ff978065990 msgr2=0x7ff978065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:12.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 -- 172.21.15.130:0/2985171065 shutdown_connections 2023-09-13T06:07:12.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.692+0000 7ff97f06a640 1 -- 172.21.15.130:0/2985171065 wait complete. 2023-09-13T06:07:12.713 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:12.806 INFO:tasks.ceph.mds.c.smithi130.stderr:2023-09-13T06:07:12.804+0000 7fb960afb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:07:12.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a6e0ec640 1 Processor -- start 2023-09-13T06:07:12.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a6e0ec640 1 -- start start 2023-09-13T06:07:12.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a6e0ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a680d1750 0x7f4a6815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a6e0ec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4a680d1090 0x7f4a68146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a6e0ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a680d1b30 0x7f4a68146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a6e0ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6815dea0 con 0x7f4a680d1b30 2023-09-13T06:07:12.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a6e0ec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a680b63c0 con 0x7f4a680d1090 2023-09-13T06:07:12.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a6e0ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a680d0c20 con 0x7f4a680d1750 2023-09-13T06:07:12.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a67fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a680d1b30 0x7f4a68146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a67fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a680d1b30 0x7f4a68146d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59166/0 (socket says 172.21.15.130:59166) 2023-09-13T06:07:12.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a67fff640 1 -- 172.21.15.130:0/1999461849 learned_addr learned my addr 172.21.15.130:0/1999461849 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:12.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a66ffd640 1 --2- 172.21.15.130:0/1999461849 >> v2:172.21.15.164:3300/0 conn(0x7f4a680d1090 0x7f4a68146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a677fe640 1 --2- 172.21.15.130:0/1999461849 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a680d1750 0x7f4a6815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a67fff640 1 -- 172.21.15.130:0/1999461849 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a680d1750 msgr2=0x7f4a6815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:12.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a67fff640 1 --2- 172.21.15.130:0/1999461849 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a680d1750 0x7f4a6815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a67fff640 1 -- 172.21.15.130:0/1999461849 >> v2:172.21.15.164:3300/0 conn(0x7f4a680d1090 msgr2=0x7f4a68146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:12.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a67fff640 1 --2- 172.21.15.130:0/1999461849 >> v2:172.21.15.164:3300/0 conn(0x7f4a680d1090 0x7f4a68146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a67fff640 1 -- 172.21.15.130:0/1999461849 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680b6610 con 0x7f4a680d1b30 2023-09-13T06:07:12.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.852+0000 7f4a677fe640 1 --2- 172.21.15.130:0/1999461849 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a680d1750 0x7f4a6815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:12.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a67fff640 1 --2- 172.21.15.130:0/1999461849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a680d1b30 0x7f4a68146d60 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4a680b3550 tx=0x7f4a6001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a1b61576ee6930 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:12.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a667fc640 1 -- 172.21.15.130:0/1999461849 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600a5820 con 0x7f4a680d1b30 2023-09-13T06:07:12.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a667fc640 1 -- 172.21.15.130:0/1999461849 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a600a5980 con 0x7f4a680d1b30 2023-09-13T06:07:12.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a667fc640 1 -- 172.21.15.130:0/1999461849 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600a5d10 con 0x7f4a680d1b30 2023-09-13T06:07:12.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1999461849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a680d1b30 msgr2=0x7f4a68146d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a6e0ec640 1 --2- 172.21.15.130:0/1999461849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a680d1b30 0x7f4a68146d60 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4a680b3550 tx=0x7f4a6001c9a0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1999461849 shutdown_connections 2023-09-13T06:07:12.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a6e0ec640 1 --2- 172.21.15.130:0/1999461849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a680d1b30 0x7f4a68146d60 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a6e0ec640 1 --2- 172.21.15.130:0/1999461849 >> v2:172.21.15.164:3300/0 conn(0x7f4a680d1090 0x7f4a68146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a6e0ec640 1 --2- 172.21.15.130:0/1999461849 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a680d1750 0x7f4a6815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1999461849 >> 172.21.15.130:0/1999461849 conn(0x7f4a6806f170 msgr2=0x7f4a6806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:12.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1999461849 shutdown_connections 2023-09-13T06:07:12.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.856+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1999461849 wait complete. 2023-09-13T06:07:12.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a6e0ec640 1 Processor -- start 2023-09-13T06:07:12.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a6e0ec640 1 -- start start 2023-09-13T06:07:12.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a6e0ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a680d1090 0x7f4a68159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a6e0ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a680d1750 0x7f4a68165be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a6e0ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a680d1b30 0x7f4a68163c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a6e0ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68164650 con 0x7f4a680d1b30 2023-09-13T06:07:12.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a6e0ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68165750 con 0x7f4a680d1750 2023-09-13T06:07:12.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a6e0ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68164e20 con 0x7f4a680d1090 2023-09-13T06:07:12.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a67fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a680d1b30 0x7f4a68163c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a67fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a680d1b30 0x7f4a68163c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59172/0 (socket says 172.21.15.130:59172) 2023-09-13T06:07:12.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a67fff640 1 -- 172.21.15.130:0/1322941347 learned_addr learned my addr 172.21.15.130:0/1322941347 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:12.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a66ffd640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a680d1750 0x7f4a68165be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a677fe640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a680d1090 0x7f4a68159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a67fff640 1 -- 172.21.15.130:0/1322941347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a680d1090 msgr2=0x7f4a68159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a67fff640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a680d1090 0x7f4a68159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a67fff640 1 -- 172.21.15.130:0/1322941347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a680d1750 msgr2=0x7f4a68165be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:12.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a67fff640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a680d1750 0x7f4a68165be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:12.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a67fff640 1 -- 172.21.15.130:0/1322941347 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60009b30 con 0x7f4a680d1b30 2023-09-13T06:07:12.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a67fff640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a680d1b30 0x7f4a68163c70 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4a6001b050 tx=0x7f4a60019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:12.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a4ffff640 1 -- 172.21.15.130:0/1322941347 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600b8670 con 0x7f4a680d1b30 2023-09-13T06:07:12.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a4ffff640 1 -- 172.21.15.130:0/1322941347 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a600b87d0 con 0x7f4a680d1b30 2023-09-13T06:07:12.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1322941347 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a68165100 con 0x7f4a680d1b30 2023-09-13T06:07:12.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a4ffff640 1 -- 172.21.15.130:0/1322941347 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600b8b80 con 0x7f4a680d1b30 2023-09-13T06:07:12.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.860+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1322941347 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a68166120 con 0x7f4a680d1b30 2023-09-13T06:07:12.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.864+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1322941347 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a681658c0 con 0x7f4a680d1b30 2023-09-13T06:07:12.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.864+0000 7f4a4ffff640 1 -- 172.21.15.130:0/1322941347 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4a600b8ce0 con 0x7f4a680d1b30 2023-09-13T06:07:12.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.864+0000 7f4a4ffff640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a54065b50 0x7f4a54068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:12.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.864+0000 7f4a4ffff640 1 -- 172.21.15.130:0/1322941347 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a6011e340 con 0x7f4a680d1b30 2023-09-13T06:07:12.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.864+0000 7f4a677fe640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a54065b50 0x7f4a54068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:12.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.864+0000 7f4a677fe640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a54065b50 0x7f4a54068010 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4a681f8cb0 tx=0x7f4a58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:12.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:12.868+0000 7f4a4ffff640 1 -- 172.21.15.130:0/1322941347 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4a600ebdc0 con 0x7f4a680d1b30 2023-09-13T06:07:13.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.044+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1322941347 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a680618a0 con 0x7f4a680d1b30 2023-09-13T06:07:13.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.044+0000 7f4a4ffff640 1 -- 172.21.15.130:0/1322941347 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f4a600ef3e0 con 0x7f4a680d1b30 2023-09-13T06:07:13.049 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:13.050 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2121062896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2121062896},{"type":"v1","addr":"172.21.15.164:6834","nonce":2121062896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3004233572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3004233572},{"type":"v1","addr":"172.21.15.164:6835","nonce":3004233572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7311,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3730755977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3730755977},{"type":"v1","addr":"172.21.15.130:6835","nonce":3730755977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:07.210560+0000","modified":"2023-09-13T06:07:10.218199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/4103504372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4103504372},{"type":"v1","addr":"172.21.15.130:6837","nonce":4103504372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-09-13T06:07:13.051 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 59 2023-09-13T06:07:13.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1322941347 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a54065b50 msgr2=0x7f4a54068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a54065b50 0x7f4a54068010 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4a681f8cb0 tx=0x7f4a58008040 comp rx=0 tx=0).stop 2023-09-13T06:07:13.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1322941347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a680d1b30 msgr2=0x7f4a68163c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a680d1b30 0x7f4a68163c70 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4a6001b050 tx=0x7f4a60019740 comp rx=0 tx=0).stop 2023-09-13T06:07:13.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1322941347 shutdown_connections 2023-09-13T06:07:13.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4a54065b50 0x7f4a54068010 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a680d1750 0x7f4a68165be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a680d1b30 0x7f4a68163c70 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 --2- 172.21.15.130:0/1322941347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a680d1090 0x7f4a68159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1322941347 >> 172.21.15.130:0/1322941347 conn(0x7f4a6806f170 msgr2=0x7f4a680b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:13.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1322941347 shutdown_connections 2023-09-13T06:07:13.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.048+0000 7f4a6e0ec640 1 -- 172.21.15.130:0/1322941347 wait complete. 2023-09-13T06:07:13.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T06:07:07.210560+0000', 'modified': '2023-09-13T06:07:10.218199+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7320}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7320': {'gid': 7320, 'name': 'c', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6837/4103504372', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 4103504372}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 4103504372}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T06:07:13.472 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T06:07:13.472 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-13T06:07:13.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9f51db640 1 Processor -- start 2023-09-13T06:07:13.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9f51db640 1 -- start start 2023-09-13T06:07:13.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9f51db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb9f00d1750 0x7fb9f015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9f51db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f00d1090 0x7fb9f0146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9f51db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f00b63c0 con 0x7fb9f00d1b30 2023-09-13T06:07:13.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9f51db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f015dea0 con 0x7fb9f00d1750 2023-09-13T06:07:13.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9f51db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f00d0c20 con 0x7fb9f00d1090 2023-09-13T06:07:13.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9eed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb9f00d1750 0x7fb9f015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9eed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb9f00d1750 0x7fb9f015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59176/0 (socket says 172.21.15.130:59176) 2023-09-13T06:07:13.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9eed9d640 1 -- 172.21.15.130:0/3534721836 learned_addr learned my addr 172.21.15.130:0/3534721836 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:13.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9e659c640 1 --2- 172.21.15.130:0/3534721836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f00d1090 0x7fb9f0146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9eed9d640 1 -- 172.21.15.130:0/3534721836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f00d1090 msgr2=0x7fb9f0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:13.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/3534721836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f00d1090 0x7fb9f0146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9eed9d640 1 -- 172.21.15.130:0/3534721836 >> v1:172.21.15.164:6789/0 conn(0x7fb9f00d1b30 legacy=0x7fb9f00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:13.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9eed9d640 1 -- 172.21.15.130:0/3534721836 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f00b6610 con 0x7fb9f00d1750 2023-09-13T06:07:13.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.612+0000 7fb9e659c640 1 --2- 172.21.15.130:0/3534721836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f00d1090 0x7fb9f0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:13.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/3534721836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9f00d1750 0x7fb9f015d960 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009870 tx=0x7fb9d801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62adea7c0544e94f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:13.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9ee59c640 1 -- 172.21.15.130:0/3534721836 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80aa5f0 con 0x7fb9f00d1750 2023-09-13T06:07:13.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9ee59c640 1 -- 172.21.15.130:0/3534721836 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d80aa750 con 0x7fb9f00d1750 2023-09-13T06:07:13.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9ee59c640 1 -- 172.21.15.130:0/3534721836 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80aaae0 con 0x7fb9f00d1750 2023-09-13T06:07:13.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9f51db640 1 -- 172.21.15.130:0/3534721836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9f00d1750 msgr2=0x7fb9f015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9f51db640 1 --2- 172.21.15.130:0/3534721836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9f00d1750 0x7fb9f015d960 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009870 tx=0x7fb9d801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9f51db640 1 -- 172.21.15.130:0/3534721836 shutdown_connections 2023-09-13T06:07:13.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9f51db640 1 --2- 172.21.15.130:0/3534721836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f00d1090 0x7fb9f0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9f51db640 1 --2- 172.21.15.130:0/3534721836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9f00d1750 0x7fb9f015d960 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9f51db640 1 -- 172.21.15.130:0/3534721836 >> 172.21.15.130:0/3534721836 conn(0x7fb9f006f170 msgr2=0x7fb9f006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:13.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9f51db640 1 -- 172.21.15.130:0/3534721836 shutdown_connections 2023-09-13T06:07:13.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.616+0000 7fb9f51db640 1 -- 172.21.15.130:0/3534721836 wait complete. 2023-09-13T06:07:13.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9f51db640 1 Processor -- start 2023-09-13T06:07:13.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9f51db640 1 -- start start 2023-09-13T06:07:13.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9f51db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9f00d1090 0x7fb9f013d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9f51db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f00d1750 0x7fb9f0141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9f51db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9f00d1b30 0x7fb9f013ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9f51db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f013e7f0 con 0x7fb9f00d1b30 2023-09-13T06:07:13.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9f51db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f01f5bb0 con 0x7fb9f00d1090 2023-09-13T06:07:13.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9f51db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0141d80 con 0x7fb9f00d1750 2023-09-13T06:07:13.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9ef59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9f00d1b30 0x7fb9f013ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9ef59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9f00d1b30 0x7fb9f013ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59180/0 (socket says 172.21.15.130:59180) 2023-09-13T06:07:13.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9ef59e640 1 -- 172.21.15.130:0/3588261029 learned_addr learned my addr 172.21.15.130:0/3588261029 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:13.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9e659c640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f00d1750 0x7fb9f0141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9f00d1090 0x7fb9f013d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9ef59e640 1 -- 172.21.15.130:0/3588261029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f00d1750 msgr2=0x7fb9f0141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9ef59e640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f00d1750 0x7fb9f0141840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9ef59e640 1 -- 172.21.15.130:0/3588261029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9f00d1090 msgr2=0x7fb9f013d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9ef59e640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9f00d1090 0x7fb9f013d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9ef59e640 1 -- 172.21.15.130:0/3588261029 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80094d0 con 0x7fb9f00d1b30 2023-09-13T06:07:13.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9ef59e640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9f00d1b30 0x7fb9f013ce30 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800b970 tx=0x7fb9e800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:13.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9e7fff640 1 -- 172.21.15.130:0/3588261029 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e800cb40 con 0x7fb9f00d1b30 2023-09-13T06:07:13.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9e7fff640 1 -- 172.21.15.130:0/3588261029 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e800cca0 con 0x7fb9f00d1b30 2023-09-13T06:07:13.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9e7fff640 1 -- 172.21.15.130:0/3588261029 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8014680 con 0x7fb9f00d1b30 2023-09-13T06:07:13.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9f51db640 1 -- 172.21.15.130:0/3588261029 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f013dc70 con 0x7fb9f00d1b30 2023-09-13T06:07:13.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.620+0000 7fb9f51db640 1 -- 172.21.15.130:0/3588261029 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f013e000 con 0x7fb9f00d1b30 2023-09-13T06:07:13.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.624+0000 7fb9e7fff640 1 -- 172.21.15.130:0/3588261029 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb9e801d3b0 con 0x7fb9f00d1b30 2023-09-13T06:07:13.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.624+0000 7fb9e7fff640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb9d0065b20 0x7fb9d0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.624+0000 7fb9e7fff640 1 -- 172.21.15.130:0/3588261029 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9e8083040 con 0x7fb9f00d1b30 2023-09-13T06:07:13.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.624+0000 7fb9f856a000 1 Processor -- start 2023-09-13T06:07:13.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.624+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb9d0065b20 0x7fb9d0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.624+0000 7fb9f856a000 1 -- start start 2023-09-13T06:07:13.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb9d0065b20 0x7fb9d0067fe0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80ae000 tx=0x7fb9d80b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:13.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015f550 0x555df015f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015fe70 0x555df0143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df0144690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x555deffdd1e0 con 0x555df01442b0 2023-09-13T06:07:13.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x555deff6c4c0 con 0x555df015f550 2023-09-13T06:07:13.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x555deff699f0 con 0x555df015fe70 2023-09-13T06:07:13.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9ef59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df0144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9ef59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df0144690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59190/0 (socket says 172.21.15.130:59190) 2023-09-13T06:07:13.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9ef59e640 1 -- 172.21.15.130:0/1131864857 learned_addr learned my addr 172.21.15.130:0/1131864857 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:13.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/1131864857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015f550 0x555df015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9e659c640 1 --2- 172.21.15.130:0/1131864857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015fe70 0x555df0143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9ef59e640 1 -- 172.21.15.130:0/1131864857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015fe70 msgr2=0x555df0143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:13.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9ef59e640 1 --2- 172.21.15.130:0/1131864857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015fe70 0x555df0143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9ef59e640 1 -- 172.21.15.130:0/1131864857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015f550 msgr2=0x555df015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:13.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9ef59e640 1 --2- 172.21.15.130:0/1131864857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015f550 0x555df015f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9ef59e640 1 -- 172.21.15.130:0/1131864857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555defc5f890 con 0x555df01442b0 2023-09-13T06:07:13.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9e659c640 1 --2- 172.21.15.130:0/1131864857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015fe70 0x555df0143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:13.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9ef59e640 1 --2- 172.21.15.130:0/1131864857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df0144690 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8081510 tx=0x7fb9e800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfa80ab1a42bd8b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:13.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9e4d99640 1 -- 172.21.15.130:0/1131864857 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e805c630 con 0x555df01442b0 2023-09-13T06:07:13.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9e4d99640 1 -- 172.21.15.130:0/1131864857 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e8052aa0 con 0x555df01442b0 2023-09-13T06:07:13.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9e4d99640 1 -- 172.21.15.130:0/1131864857 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8050e10 con 0x555df01442b0 2023-09-13T06:07:13.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 -- 172.21.15.130:0/1131864857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 msgr2=0x555df0144690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 --2- 172.21.15.130:0/1131864857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df0144690 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8081510 tx=0x7fb9e800cf90 comp rx=0 tx=0).stop 2023-09-13T06:07:13.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 -- 172.21.15.130:0/1131864857 shutdown_connections 2023-09-13T06:07:13.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 --2- 172.21.15.130:0/1131864857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df0144690 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 --2- 172.21.15.130:0/1131864857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015fe70 0x555df0143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 --2- 172.21.15.130:0/1131864857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015f550 0x555df015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 -- 172.21.15.130:0/1131864857 >> 172.21.15.130:0/1131864857 conn(0x555df010cc40 msgr2=0x555df011bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:13.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 -- 172.21.15.130:0/1131864857 shutdown_connections 2023-09-13T06:07:13.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 -- 172.21.15.130:0/1131864857 wait complete. 2023-09-13T06:07:13.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 -- start start 2023-09-13T06:07:13.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.628+0000 7fb9f856a000 1 Processor -- start 2023-09-13T06:07:13.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df01442b0 0x555df0143d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df01190a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015fe70 0x555df01195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x555deff652e0 con 0x555df015f550 2023-09-13T06:07:13.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x555deff1ffe0 con 0x555df015fe70 2023-09-13T06:07:13.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x555deff1fc80 con 0x555df01442b0 2023-09-13T06:07:13.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 10 client.0 _ll_register_callbacks cb 0x555df0101260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:07:13.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9e659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df01190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9e659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df01190a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59204/0 (socket says 172.21.15.130:59204) 2023-09-13T06:07:13.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9e659c640 1 -- 172.21.15.130:0/4287024622 learned_addr learned my addr 172.21.15.130:0/4287024622 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:13.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df01442b0 0x555df0143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9ef59e640 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015fe70 0x555df01195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9e659c640 1 -- 172.21.15.130:0/4287024622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df01442b0 msgr2=0x555df0143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:13.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9e659c640 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df01442b0 0x555df0143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9e659c640 1 -- 172.21.15.130:0/4287024622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015fe70 msgr2=0x555df01195e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:13.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9e659c640 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015fe70 0x555df01195e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9e659c640 1 -- 172.21.15.130:0/4287024622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f013e000 con 0x555df015f550 2023-09-13T06:07:13.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df01442b0 0x555df0143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:13.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9e659c640 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df01190a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0012600 tx=0x7fb9e0012ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4da549d006b9315 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:13.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:07:13.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9cdffb640 1 -- 172.21.15.130:0/4287024622 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0004230 con 0x555df015f550 2023-09-13T06:07:13.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9cdffb640 1 -- 172.21.15.130:0/4287024622 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9e0004390 con 0x555df015f550 2023-09-13T06:07:13.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 -- 172.21.15.130:0/4287024622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555defefca50 con 0x555df015f550 2023-09-13T06:07:13.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9cdffb640 1 -- 172.21.15.130:0/4287024622 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e0014770 con 0x555df015f550 2023-09-13T06:07:13.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 10 client.7461 fetch_fsmap learned FSMap version 59 2023-09-13T06:07:13.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 -- 172.21.15.130:0/4287024622 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x555deff28210 con 0x555df015f550 2023-09-13T06:07:13.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9cdffb640 1 -- 172.21.15.130:0/4287024622 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555defefca50 con 0x555df015f550 2023-09-13T06:07:13.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9cdffb640 1 -- 172.21.15.130:0/4287024622 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 59) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb9e00148d0 con 0x555df015f550 2023-09-13T06:07:13.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 10 client.7461 fetch_fsmap finished waiting for FSMap version 59 2023-09-13T06:07:13.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 10 client.7461 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T06:07:13.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 20 client.7461 populate_metadata read hostname 'smithi130' 2023-09-13T06:07:13.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.130:6836/4103504372,v1:172.21.15.130:6837/4103504372] conn(0x555df011a380 0x555df0171600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 4 client.7461 mds_command: new command op to 7320 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T06:07:13.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 -- 172.21.15.130:0/4287024622 --> [v2:172.21.15.130:6836/4103504372,v1:172.21.15.130:6837/4103504372] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555deff1c820 con 0x555df011a380 2023-09-13T06:07:13.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.130:6836/4103504372,v1:172.21.15.130:6837/4103504372] conn(0x555df011a380 0x555df0171600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.130:6836/4103504372,v1:172.21.15.130:6837/4103504372] conn(0x555df011a380 0x555df0171600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19ad6cc2aac9955c server_cookie=bd0778e177086d1 in_seq=0 out_seq=0 2023-09-13T06:07:13.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9cdffb640 10 client.7461 ms_handle_connect on v2:172.21.15.130:6836/4103504372 2023-09-13T06:07:13.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9cdffb640 1 -- 172.21.15.130:0/4287024622 <== mds.0 v2:172.21.15.130:6836/4103504372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555deff1c820 con 0x555df011a380 2023-09-13T06:07:13.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9cdffb640 10 client.7461 handle_command_reply: tid=0 2023-09-13T06:07:13.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 client.7461 shutdown 2023-09-13T06:07:13.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.632+0000 7fb9f856a000 1 -- 172.21.15.130:0/4287024622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 msgr2=0x555df01190a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.636+0000 7fb9f856a000 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df01190a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0012600 tx=0x7fb9e0012ac0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.636+0000 7fb9f856a000 1 -- 172.21.15.130:0/4287024622 shutdown_connections 2023-09-13T06:07:13.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.636+0000 7fb9f856a000 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.130:6836/4103504372,v1:172.21.15.130:6837/4103504372] conn(0x555df011a380 0x555df0171600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.636+0000 7fb9f856a000 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015fe70 0x555df01195e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.636+0000 7fb9f856a000 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df01190a0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.636+0000 7fb9cdffb640 0 client.7461 ms_handle_reset on v2:172.21.15.130:6836/4103504372 2023-09-13T06:07:13.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.636+0000 7fb9f856a000 1 --2- 172.21.15.130:0/4287024622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df01442b0 0x555df0143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.636+0000 7fb9f856a000 1 -- 172.21.15.130:0/4287024622 >> 172.21.15.130:0/4287024622 conn(0x555df010cc40 msgr2=0x555df0145130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:13.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.636+0000 7fb9f856a000 1 -- 172.21.15.130:0/4287024622 shutdown_connections 2023-09-13T06:07:13.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.636+0000 7fb9f856a000 1 -- 172.21.15.130:0/4287024622 wait complete. 2023-09-13T06:07:13.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.636+0000 7fb9f856a000 20 client.7461 trim_cache size 0 max 16384 2023-09-13T06:07:13.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.648+0000 7fb9f856a000 1 Processor -- start 2023-09-13T06:07:13.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.648+0000 7fb9f856a000 1 -- start start 2023-09-13T06:07:13.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df01193c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015f550 0x555df0118050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015fe70 0x555df0118590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x555defc20940 con 0x555df01442b0 2023-09-13T06:07:13.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x555deff41140 con 0x555df015fe70 2023-09-13T06:07:13.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x555df015f200 con 0x555df015f550 2023-09-13T06:07:13.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9eed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df01193c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9eed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df01193c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59208/0 (socket says 172.21.15.130:59208) 2023-09-13T06:07:13.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9eed9d640 1 -- 172.21.15.130:0/2110090163 learned_addr learned my addr 172.21.15.130:0/2110090163 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:13.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9ef59e640 1 --2- 172.21.15.130:0/2110090163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015fe70 0x555df0118590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9e659c640 1 --2- 172.21.15.130:0/2110090163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015f550 0x555df0118050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9eed9d640 1 -- 172.21.15.130:0/2110090163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015f550 msgr2=0x555df0118050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:13.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/2110090163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015f550 0x555df0118050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9eed9d640 1 -- 172.21.15.130:0/2110090163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015fe70 msgr2=0x555df0118590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:13.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/2110090163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015fe70 0x555df0118590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9eed9d640 1 -- 172.21.15.130:0/2110090163 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555deff0e4a0 con 0x555df01442b0 2023-09-13T06:07:13.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9ef59e640 1 --2- 172.21.15.130:0/2110090163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015fe70 0x555df0118590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:13.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/2110090163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df01193c0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009870 tx=0x7fb9d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724fc387dc1edad0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:13.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9e559a640 1 -- 172.21.15.130:0/2110090163 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80aac90 con 0x555df01442b0 2023-09-13T06:07:13.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9e559a640 1 -- 172.21.15.130:0/2110090163 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d80aadf0 con 0x555df01442b0 2023-09-13T06:07:13.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9e559a640 1 -- 172.21.15.130:0/2110090163 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80cb220 con 0x555df01442b0 2023-09-13T06:07:13.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- 172.21.15.130:0/2110090163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 msgr2=0x555df01193c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 --2- 172.21.15.130:0/2110090163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df01193c0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009870 tx=0x7fb9d8004740 comp rx=0 tx=0).stop 2023-09-13T06:07:13.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- 172.21.15.130:0/2110090163 shutdown_connections 2023-09-13T06:07:13.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 --2- 172.21.15.130:0/2110090163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df015fe70 0x555df0118590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 --2- 172.21.15.130:0/2110090163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015f550 0x555df0118050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 --2- 172.21.15.130:0/2110090163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df01442b0 0x555df01193c0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- 172.21.15.130:0/2110090163 >> 172.21.15.130:0/2110090163 conn(0x555df010cc40 msgr2=0x555df016cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:13.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- 172.21.15.130:0/2110090163 shutdown_connections 2023-09-13T06:07:13.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- 172.21.15.130:0/2110090163 wait complete. 2023-09-13T06:07:13.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- start start 2023-09-13T06:07:13.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 Processor -- start 2023-09-13T06:07:13.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df01442b0 0x555df01bd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df0171af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015fe70 0x555df0172030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x555deff60c50 con 0x555df015f550 2023-09-13T06:07:13.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x555deff6ab90 con 0x555df01442b0 2023-09-13T06:07:13.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x555deff32820 con 0x555df015fe70 2023-09-13T06:07:13.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9f856a000 10 client.0 _ll_register_callbacks cb 0x555deff1bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:07:13.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9e659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df0171af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9e659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df0171af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59224/0 (socket says 172.21.15.130:59224) 2023-09-13T06:07:13.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9e659c640 1 -- 172.21.15.130:0/397172650 learned_addr learned my addr 172.21.15.130:0/397172650 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:13.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df01442b0 0x555df01bd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.652+0000 7fb9ef59e640 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015fe70 0x555df0172030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9e659c640 1 -- 172.21.15.130:0/397172650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015fe70 msgr2=0x555df0172030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:13.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9e659c640 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015fe70 0x555df0172030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9e659c640 1 -- 172.21.15.130:0/397172650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df01442b0 msgr2=0x555df01bd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:13.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9e659c640 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df01442b0 0x555df01bd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9e659c640 1 -- 172.21.15.130:0/397172650 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f00b6610 con 0x555df015f550 2023-09-13T06:07:13.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9e659c640 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df0171af0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0008010 tx=0x7fb9e00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3602a9a47994f1c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:13.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:07:13.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9cdffb640 1 -- 172.21.15.130:0/397172650 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0004240 con 0x555df015f550 2023-09-13T06:07:13.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9cdffb640 1 -- 172.21.15.130:0/397172650 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9e00043a0 con 0x555df015f550 2023-09-13T06:07:13.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 -- 172.21.15.130:0/397172650 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555deff20900 con 0x555df015f550 2023-09-13T06:07:13.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9cdffb640 1 -- 172.21.15.130:0/397172650 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e0004560 con 0x555df015f550 2023-09-13T06:07:13.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 10 client.7467 fetch_fsmap learned FSMap version 59 2023-09-13T06:07:13.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 -- 172.21.15.130:0/397172650 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x555defc5fcc0 con 0x555df015f550 2023-09-13T06:07:13.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9cdffb640 1 -- 172.21.15.130:0/397172650 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555deff20900 con 0x555df015f550 2023-09-13T06:07:13.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9cdffb640 1 -- 172.21.15.130:0/397172650 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 59) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb9e0003620 con 0x555df015f550 2023-09-13T06:07:13.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 10 client.7467 fetch_fsmap finished waiting for FSMap version 59 2023-09-13T06:07:13.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 10 client.7467 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T06:07:13.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 20 client.7467 populate_metadata read hostname 'smithi130' 2023-09-13T06:07:13.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.130:6836/4103504372,v1:172.21.15.130:6837/4103504372] conn(0x555df0172570 0x555df0172950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 4 client.7467 mds_command: new command op to 7320 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T06:07:13.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 -- 172.21.15.130:0/397172650 --> [v2:172.21.15.130:6836/4103504372,v1:172.21.15.130:6837/4103504372] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555deff5e2c0 con 0x555df0172570 2023-09-13T06:07:13.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.130:6836/4103504372,v1:172.21.15.130:6837/4103504372] conn(0x555df0172570 0x555df0172950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9eed9d640 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.130:6836/4103504372,v1:172.21.15.130:6837/4103504372] conn(0x555df0172570 0x555df0172950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b47195344eb05 server_cookie=7e56a1e2d9e506c in_seq=0 out_seq=0 2023-09-13T06:07:13.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9cdffb640 10 client.7467 ms_handle_connect on v2:172.21.15.130:6836/4103504372 2023-09-13T06:07:13.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9cdffb640 1 -- 172.21.15.130:0/397172650 <== mds.0 v2:172.21.15.130:6836/4103504372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x555deff5e2c0 con 0x555df0172570 2023-09-13T06:07:13.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9cdffb640 10 client.7467 handle_command_reply: tid=0 2023-09-13T06:07:13.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 client.7467 shutdown 2023-09-13T06:07:13.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 -- 172.21.15.130:0/397172650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 msgr2=0x555df0171af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df0171af0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0008010 tx=0x7fb9e00046d0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 -- 172.21.15.130:0/397172650 shutdown_connections 2023-09-13T06:07:13.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.130:6836/4103504372,v1:172.21.15.130:6837/4103504372] conn(0x555df0172570 0x555df0172950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555df015fe70 0x555df0172030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555df015f550 0x555df0171af0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9cdffb640 0 client.7467 ms_handle_reset on v2:172.21.15.130:6836/4103504372 2023-09-13T06:07:13.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 --2- 172.21.15.130:0/397172650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555df01442b0 0x555df01bd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 -- 172.21.15.130:0/397172650 >> 172.21.15.130:0/397172650 conn(0x555df010cc40 msgr2=0x555df016cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:13.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 -- 172.21.15.130:0/397172650 shutdown_connections 2023-09-13T06:07:13.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 1 -- 172.21.15.130:0/397172650 wait complete. 2023-09-13T06:07:13.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f856a000 20 client.7467 trim_cache size 0 max 16384 2023-09-13T06:07:13.677 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:07:13.677 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:07:13.678 INFO:teuthology.orchestra.run.smithi130.stdout: "whoami": 0, 2023-09-13T06:07:13.678 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 7320, 2023-09-13T06:07:13.678 INFO:teuthology.orchestra.run.smithi130.stdout: "want_state": "up:active", 2023-09-13T06:07:13.678 INFO:teuthology.orchestra.run.smithi130.stdout: "state": "up:active", 2023-09-13T06:07:13.678 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs", 2023-09-13T06:07:13.679 INFO:teuthology.orchestra.run.smithi130.stdout: "rank_uptime": 5.82680986, 2023-09-13T06:07:13.679 INFO:teuthology.orchestra.run.smithi130.stdout: "mdsmap_epoch": 59, 2023-09-13T06:07:13.679 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch": 123, 2023-09-13T06:07:13.679 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch_barrier": 123, 2023-09-13T06:07:13.679 INFO:teuthology.orchestra.run.smithi130.stdout: "uptime": 11.757523482 2023-09-13T06:07:13.679 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:07:13.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 -- 172.21.15.130:0/3588261029 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb9d0065b20 msgr2=0x7fb9d0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb9d0065b20 0x7fb9d0067fe0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80ae000 tx=0x7fb9d80b5040 comp rx=0 tx=0).stop 2023-09-13T06:07:13.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 -- 172.21.15.130:0/3588261029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9f00d1b30 msgr2=0x7fb9f013ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9f00d1b30 0x7fb9f013ce30 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800b970 tx=0x7fb9e800be30 comp rx=0 tx=0).stop 2023-09-13T06:07:13.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 -- 172.21.15.130:0/3588261029 shutdown_connections 2023-09-13T06:07:13.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb9d0065b20 0x7fb9d0067fe0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9f00d1b30 0x7fb9f013ce30 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9f00d1750 0x7fb9f0141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 --2- 172.21.15.130:0/3588261029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9f00d1090 0x7fb9f013d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 -- 172.21.15.130:0/3588261029 >> 172.21.15.130:0/3588261029 conn(0x7fb9f006f170 msgr2=0x7fb9f015dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:13.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 -- 172.21.15.130:0/3588261029 shutdown_connections 2023-09-13T06:07:13.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.656+0000 7fb9f51db640 1 -- 172.21.15.130:0/3588261029 wait complete. 2023-09-13T06:07:13.684 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:07:13.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e7a911640 1 Processor -- start 2023-09-13T06:07:13.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e7a911640 1 -- start start 2023-09-13T06:07:13.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e7a911640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6e740d1090 0x7f6e7415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e7a911640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e740b63c0 con 0x7f6e740d1750 2023-09-13T06:07:13.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e7a911640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e740d0c20 con 0x7f6e74146f30 2023-09-13T06:07:13.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e7a911640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7415dea0 con 0x7f6e740d1090 2023-09-13T06:07:13.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e73fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6e740d1750 0x7f6e74146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60816/0 (socket says 172.21.15.130:60816) 2023-09-13T06:07:13.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e73fff640 1 -- 172.21.15.130:0/4108287722 learned_addr learned my addr 172.21.15.130:0/4108287722 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:13.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e737fe640 1 --2- 172.21.15.130:0/4108287722 >> v2:172.21.15.164:3300/0 conn(0x7f6e740d1090 0x7f6e7415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e72ffd640 1 -- 172.21.15.130:0/4108287722 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738345603 0 0) 0x7f6e740b63c0 con 0x7f6e740d1750 2023-09-13T06:07:13.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e72ffd640 1 -- 172.21.15.130:0/4108287722 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e5c003530 con 0x7f6e740d1750 2023-09-13T06:07:13.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e72ffd640 1 -- 172.21.15.130:0/4108287722 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554772403 0 0) 0x7f6e740d0c20 con 0x7f6e74146f30 2023-09-13T06:07:13.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e72ffd640 1 -- 172.21.15.130:0/4108287722 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e740b63c0 con 0x7f6e74146f30 2023-09-13T06:07:13.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e737fe640 1 -- 172.21.15.130:0/4108287722 >> v1:172.21.15.164:6789/0 conn(0x7f6e74146f30 legacy=0x7f6e740b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e737fe640 1 -- 172.21.15.130:0/4108287722 >> v1:172.21.15.130:6789/0 conn(0x7f6e740d1750 legacy=0x7f6e74146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.820+0000 7f6e737fe640 1 -- 172.21.15.130:0/4108287722 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e740b6610 con 0x7f6e740d1090 2023-09-13T06:07:13.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.824+0000 7f6e737fe640 1 --2- 172.21.15.130:0/4108287722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e740d1090 0x7f6e7415d960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6e680097c0 tx=0x7f6e6801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d66f58eef6bea9e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:13.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.824+0000 7f6e72ffd640 1 -- 172.21.15.130:0/4108287722 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e680ac620 con 0x7f6e740d1090 2023-09-13T06:07:13.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.824+0000 7f6e72ffd640 1 -- 172.21.15.130:0/4108287722 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e680ac780 con 0x7f6e740d1090 2023-09-13T06:07:13.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.824+0000 7f6e72ffd640 1 -- 172.21.15.130:0/4108287722 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e680acb10 con 0x7f6e740d1090 2023-09-13T06:07:13.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.824+0000 7f6e7a911640 1 -- 172.21.15.130:0/4108287722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e740d1090 msgr2=0x7f6e7415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.824+0000 7f6e7a911640 1 --2- 172.21.15.130:0/4108287722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e740d1090 0x7f6e7415d960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6e680097c0 tx=0x7f6e6801c3c0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.824+0000 7f6e7a911640 1 -- 172.21.15.130:0/4108287722 shutdown_connections 2023-09-13T06:07:13.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.824+0000 7f6e7a911640 1 --2- 172.21.15.130:0/4108287722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e740d1090 0x7f6e7415d960 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.824+0000 7f6e7a911640 1 -- 172.21.15.130:0/4108287722 >> 172.21.15.130:0/4108287722 conn(0x7f6e7406f170 msgr2=0x7f6e7406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:13.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.824+0000 7f6e7a911640 1 -- 172.21.15.130:0/4108287722 shutdown_connections 2023-09-13T06:07:13.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.824+0000 7f6e7a911640 1 -- 172.21.15.130:0/4108287722 wait complete. 2023-09-13T06:07:13.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e7a911640 1 Processor -- start 2023-09-13T06:07:13.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e7a911640 1 -- start start 2023-09-13T06:07:13.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e7a911640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e740d1090 0x7f6e7415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e7a911640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6e740d1750 0x7f6e74142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e7a911640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e74146f30 0x7f6e7415e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e7a911640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e74144550 con 0x7f6e740d1090 2023-09-13T06:07:13.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e7a911640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e741439d0 con 0x7f6e74146f30 2023-09-13T06:07:13.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e7a911640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e74143cb0 con 0x7f6e740d1750 2023-09-13T06:07:13.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e73fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e740d1090 0x7f6e7415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e73fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e740d1090 0x7f6e7415cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59234/0 (socket says 172.21.15.130:59234) 2023-09-13T06:07:13.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e73fff640 1 -- 172.21.15.130:0/3928365656 learned_addr learned my addr 172.21.15.130:0/3928365656 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:13.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e78eae640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e74146f30 0x7f6e7415e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e737fe640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6e740d1750 0x7f6e74142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e73fff640 1 -- 172.21.15.130:0/3928365656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6e740d1750 msgr2=0x7f6e74142f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e73fff640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6e740d1750 0x7f6e74142f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e73fff640 1 -- 172.21.15.130:0/3928365656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e74146f30 msgr2=0x7f6e7415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:13.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e73fff640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e74146f30 0x7f6e7415e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:13.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e73fff640 1 -- 172.21.15.130:0/3928365656 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68009420 con 0x7f6e740d1090 2023-09-13T06:07:13.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e737fe640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6e740d1750 0x7f6e74142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:13.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e78eae640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e74146f30 0x7f6e7415e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:13.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e73fff640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e740d1090 0x7f6e7415cef0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400c4f0 tx=0x7f6e6400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:13.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e70ff9640 1 -- 172.21.15.130:0/3928365656 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64005cf0 con 0x7f6e740d1090 2023-09-13T06:07:13.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e70ff9640 1 -- 172.21.15.130:0/3928365656 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e64005e50 con 0x7f6e740d1090 2023-09-13T06:07:13.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e70ff9640 1 -- 172.21.15.130:0/3928365656 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64007270 con 0x7f6e740d1090 2023-09-13T06:07:13.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e7a911640 1 -- 172.21.15.130:0/3928365656 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e74143f90 con 0x7f6e740d1090 2023-09-13T06:07:13.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e7a911640 1 -- 172.21.15.130:0/3928365656 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e74140ec0 con 0x7f6e740d1090 2023-09-13T06:07:13.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.828+0000 7f6e7a911640 1 -- 172.21.15.130:0/3928365656 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e740618a0 con 0x7f6e740d1090 2023-09-13T06:07:13.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.832+0000 7f6e70ff9640 1 -- 172.21.15.130:0/3928365656 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6e640073d0 con 0x7f6e740d1090 2023-09-13T06:07:13.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.832+0000 7f6e70ff9640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6e60065b20 0x7f6e60067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:13.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.832+0000 7f6e70ff9640 1 -- 172.21.15.130:0/3928365656 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e64082850 con 0x7f6e740d1090 2023-09-13T06:07:13.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.832+0000 7f6e737fe640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6e60065b20 0x7f6e60067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:13.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.832+0000 7f6e737fe640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6e60065b20 0x7f6e60067fe0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6e680ae000 tx=0x7f6e68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:13.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:13.836+0000 7f6e70ff9640 1 -- 172.21.15.130:0/3928365656 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6e64050240 con 0x7f6e740d1090 2023-09-13T06:07:14.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 -- 172.21.15.130:0/3928365656 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6e74169100 con 0x7f6e740d1090 2023-09-13T06:07:14.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e70ff9640 1 -- 172.21.15.130:0/3928365656 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6e64017070 con 0x7f6e740d1090 2023-09-13T06:07:14.019 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:07:14.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 -- 172.21.15.130:0/3928365656 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6e60065b20 msgr2=0x7f6e60067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:14.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6e60065b20 0x7f6e60067fe0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6e680ae000 tx=0x7f6e68008040 comp rx=0 tx=0).stop 2023-09-13T06:07:14.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 -- 172.21.15.130:0/3928365656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e740d1090 msgr2=0x7f6e7415cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:14.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e740d1090 0x7f6e7415cef0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400c4f0 tx=0x7f6e6400c9b0 comp rx=0 tx=0).stop 2023-09-13T06:07:14.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 -- 172.21.15.130:0/3928365656 shutdown_connections 2023-09-13T06:07:14.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6e60065b20 0x7f6e60067fe0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:14.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e74146f30 0x7f6e7415e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:14.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6e740d1750 0x7f6e74142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:14.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 --2- 172.21.15.130:0/3928365656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e740d1090 0x7f6e7415cef0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:14.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 -- 172.21.15.130:0/3928365656 >> 172.21.15.130:0/3928365656 conn(0x7f6e7406f170 msgr2=0x7f6e74145c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:14.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 -- 172.21.15.130:0/3928365656 shutdown_connections 2023-09-13T06:07:14.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.016+0000 7f6e7a911640 1 -- 172.21.15.130:0/3928365656 wait complete. 2023-09-13T06:07:14.039 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:07:14.040 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:07:14.040 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:07:14.040 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T06:07:14.041 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:07:14.041 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:07:14.041 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:07:14.042 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:07:14.042 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:07:14.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:14.043 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:07:14.053 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:07:14.054 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:07:14.054 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:07:14.054 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:14.054 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:07:14.054 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:14.055 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:14.055 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:14.055 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:07:14.055 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:14.055 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:14.056 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:07:14.056 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:14.056 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:14.056 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:07:14.056 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:14.056 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:07:14.057 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42073sec preferred_lft 42073sec 2023-09-13T06:07:14.057 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:07:14.057 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:14.057 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:07:14.057 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:14.057 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:07:14.058 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:14.058 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:07:14.058 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:14.058 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:07:14.058 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:14.059 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:07:14.059 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:14.059 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:07:14.059 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:07:14.059 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:07:14.059 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:14.060 INFO:teuthology.orchestra.run.smithi130.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:07:14.060 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:07:14.060 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:07:14.060 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:14.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:14.061 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:07:14.114 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:07:14.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:14.118 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:07:14.170 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:07:14.171 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:07:14.171 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:07:14.171 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:07:14.171 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:07:14.171 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:07:14.172 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:14.172 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:14.172 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:14.172 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:07:14.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:14.173 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:07:14.173 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:07:14.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:07:14.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:07:14.175 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:07:14.175 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:07:14.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:14.268 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:07:14.277 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T06:07:14.278 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:07:14.279 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:07:14.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:14.279 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-09-13T06:07:14.344 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:07:14.345 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T06:07:14.397 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:07:14.397 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:07:14.398 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:07:14.448 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:07:14.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:14.449 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:07:14.538 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:07:14.538 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:07:14.539 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:07:14.553 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:07:14.553 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:07:14.553 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:07:14.553 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:07:14.554 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:07:14.561 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:07:14.562 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:07:14.562 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:07:14.562 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:07:14.562 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:07:14.562 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:07:14.563 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:07:14.563 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:07:14.566 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:07:14.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:14.567 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:07:14.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:14.588 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:07:14.654 INFO:teuthology.orchestra.run.smithi130.stdout:client6898 2023-09-13T06:07:14.655 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:07:14.656 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:14.705 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:07:14.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.884+0000 7fe6d8248640 1 Processor -- start 2023-09-13T06:07:14.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.884+0000 7fe6d8248640 1 -- start start 2023-09-13T06:07:14.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d8248640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6d00d1750 0x7fe6d015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:14.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d8248640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d00b63c0 con 0x7fe6d0146f30 2023-09-13T06:07:14.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d8248640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d00d0c20 con 0x7fe6d00d1090 2023-09-13T06:07:14.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d8248640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d015dea0 con 0x7fe6d00d1750 2023-09-13T06:07:14.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d5fe4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6d00d1750 0x7fe6d015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:14.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d5fe4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6d00d1750 0x7fe6d015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59244/0 (socket says 172.21.15.130:59244) 2023-09-13T06:07:14.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d67e5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe6d0146f30 0x7fe6d00b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60830/0 (socket says 172.21.15.130:60830) 2023-09-13T06:07:14.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d5fe4640 1 -- 172.21.15.130:0/2209310526 learned_addr learned my addr 172.21.15.130:0/2209310526 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:14.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d5fe4640 1 -- 172.21.15.130:0/2209310526 >> v1:172.21.15.164:6789/0 conn(0x7fe6d00d1090 legacy=0x7fe6d0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:14.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d5fe4640 1 -- 172.21.15.130:0/2209310526 >> v1:172.21.15.130:6789/0 conn(0x7fe6d0146f30 legacy=0x7fe6d00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:14.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d5fe4640 1 -- 172.21.15.130:0/2209310526 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d00b6610 con 0x7fe6d00d1750 2023-09-13T06:07:14.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.888+0000 7fe6d4fe2640 1 -- 172.21.15.130:0/2209310526 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747301667 0 0) 0x7fe6d00b63c0 con 0x7fe6d0146f30 2023-09-13T06:07:14.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d5fe4640 1 --2- 172.21.15.130:0/2209310526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d00d1750 0x7fe6d015d960 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009870 tx=0x7fe6cc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09e83cb2b46c2a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:14.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d4fe2640 1 -- 172.21.15.130:0/2209310526 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0ab680 con 0x7fe6d00d1750 2023-09-13T06:07:14.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d4fe2640 1 -- 172.21.15.130:0/2209310526 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc0ab7e0 con 0x7fe6d00d1750 2023-09-13T06:07:14.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d4fe2640 1 -- 172.21.15.130:0/2209310526 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0abb70 con 0x7fe6d00d1750 2023-09-13T06:07:14.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d8248640 1 -- 172.21.15.130:0/2209310526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d00d1750 msgr2=0x7fe6d015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:14.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d8248640 1 --2- 172.21.15.130:0/2209310526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d00d1750 0x7fe6d015d960 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009870 tx=0x7fe6cc01c480 comp rx=0 tx=0).stop 2023-09-13T06:07:14.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d8248640 1 -- 172.21.15.130:0/2209310526 shutdown_connections 2023-09-13T06:07:14.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d8248640 1 --2- 172.21.15.130:0/2209310526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d00d1750 0x7fe6d015d960 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:14.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d8248640 1 -- 172.21.15.130:0/2209310526 >> 172.21.15.130:0/2209310526 conn(0x7fe6d006f170 msgr2=0x7fe6d006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:14.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d8248640 1 -- 172.21.15.130:0/2209310526 shutdown_connections 2023-09-13T06:07:14.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d8248640 1 -- 172.21.15.130:0/2209310526 wait complete. 2023-09-13T06:07:14.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d8248640 1 Processor -- start 2023-09-13T06:07:14.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.892+0000 7fe6d8248640 1 -- start start 2023-09-13T06:07:14.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d8248640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6d00d1090 0x7fe6d0136cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:14.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d8248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d00d1750 0x7fe6d0138d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:14.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d8248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d0146f30 0x7fe6d0139240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:14.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d8248640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d01376f0 con 0x7fe6d00d1750 2023-09-13T06:07:14.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d8248640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d01379d0 con 0x7fe6d00d1090 2023-09-13T06:07:14.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d8248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0137cb0 con 0x7fe6d0146f30 2023-09-13T06:07:14.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d57e3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d00d1750 0x7fe6d0138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:14.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d57e3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d00d1750 0x7fe6d0138d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59254/0 (socket says 172.21.15.130:59254) 2023-09-13T06:07:14.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d57e3640 1 -- 172.21.15.130:0/1203218701 learned_addr learned my addr 172.21.15.130:0/1203218701 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:14.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d5fe4640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6d00d1090 0x7fe6d0136cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:14.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d67e5640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d0146f30 0x7fe6d0139240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:14.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d57e3640 1 -- 172.21.15.130:0/1203218701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d0146f30 msgr2=0x7fe6d0139240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:14.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d57e3640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d0146f30 0x7fe6d0139240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:14.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d57e3640 1 -- 172.21.15.130:0/1203218701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6d00d1090 msgr2=0x7fe6d0136cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:14.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d57e3640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6d00d1090 0x7fe6d0136cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:14.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d57e3640 1 -- 172.21.15.130:0/1203218701 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc0094d0 con 0x7fe6d00d1750 2023-09-13T06:07:14.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d67e5640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d0146f30 0x7fe6d0139240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:14.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d57e3640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d00d1750 0x7fe6d0138d00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000c4d0 tx=0x7fe6c000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:14.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6c67fc640 1 -- 172.21.15.130:0/1203218701 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00052d0 con 0x7fe6d00d1750 2023-09-13T06:07:14.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6c67fc640 1 -- 172.21.15.130:0/1203218701 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c0005430 con 0x7fe6d00d1750 2023-09-13T06:07:14.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6c67fc640 1 -- 172.21.15.130:0/1203218701 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0012830 con 0x7fe6d00d1750 2023-09-13T06:07:14.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d8248640 1 -- 172.21.15.130:0/1203218701 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d0137f90 con 0x7fe6d00d1750 2023-09-13T06:07:14.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d8248640 1 -- 172.21.15.130:0/1203218701 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d0137400 con 0x7fe6d00d1750 2023-09-13T06:07:14.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6d8248640 1 -- 172.21.15.130:0/1203218701 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d00618a0 con 0x7fe6d00d1750 2023-09-13T06:07:14.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.896+0000 7fe6c67fc640 1 -- 172.21.15.130:0/1203218701 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe6c0012990 con 0x7fe6d00d1750 2023-09-13T06:07:14.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.900+0000 7fe6c67fc640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b4065b20 0x7fe6b4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:14.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.900+0000 7fe6c67fc640 1 -- 172.21.15.130:0/1203218701 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6c0082e10 con 0x7fe6d00d1750 2023-09-13T06:07:14.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.900+0000 7fe6d5fe4640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b4065b20 0x7fe6b4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:14.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.900+0000 7fe6d5fe4640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b4065b20 0x7fe6b4067fe0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0af000 tx=0x7fe6cc0b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:14.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:14.904+0000 7fe6c67fc640 1 -- 172.21.15.130:0/1203218701 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe6c0086030 con 0x7fe6d00d1750 2023-09-13T06:07:15.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.080+0000 7fe6d8248640 1 -- 172.21.15.130:0/1203218701 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6d00b86c0 con 0x7fe6d00d1750 2023-09-13T06:07:15.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.080+0000 7fe6c67fc640 1 -- 172.21.15.130:0/1203218701 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe6c00506c0 con 0x7fe6d00d1750 2023-09-13T06:07:15.085 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:07:15.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 -- 172.21.15.130:0/1203218701 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b4065b20 msgr2=0x7fe6b4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:15.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b4065b20 0x7fe6b4067fe0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0af000 tx=0x7fe6cc0b6040 comp rx=0 tx=0).stop 2023-09-13T06:07:15.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 -- 172.21.15.130:0/1203218701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d00d1750 msgr2=0x7fe6d0138d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:15.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d00d1750 0x7fe6d0138d00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000c4d0 tx=0x7fe6c000c990 comp rx=0 tx=0).stop 2023-09-13T06:07:15.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 -- 172.21.15.130:0/1203218701 shutdown_connections 2023-09-13T06:07:15.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe6b4065b20 0x7fe6b4067fe0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:15.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6d0146f30 0x7fe6d0139240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:15.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6d00d1750 0x7fe6d0138d00 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:15.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 --2- 172.21.15.130:0/1203218701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6d00d1090 0x7fe6d0136cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:15.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 -- 172.21.15.130:0/1203218701 >> 172.21.15.130:0/1203218701 conn(0x7fe6d006f170 msgr2=0x7fe6d00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:15.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 -- 172.21.15.130:0/1203218701 shutdown_connections 2023-09-13T06:07:15.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.084+0000 7fe6d8248640 1 -- 172.21.15.130:0/1203218701 wait complete. 2023-09-13T06:07:15.105 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:07:15.105 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:07:15.106 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:07:15.106 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T06:07:15.106 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:07:15.107 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:07:15.107 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:07:15.107 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:07:15.108 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:07:15.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:15.109 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:07:15.119 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:07:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:07:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:07:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:07:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:15.121 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:07:15.121 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:07:15.122 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:15.122 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:07:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:07:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42089sec preferred_lft 42089sec 2023-09-13T06:07:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:07:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:15.124 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:07:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:07:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:15.124 INFO:teuthology.orchestra.run.smithi164.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:07:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:07:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:07:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:15.125 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:07:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:07:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:07:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:15.127 INFO:teuthology.orchestra.run.smithi164.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:07:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:07:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:07:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:15.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:15.129 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:07:15.183 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:07:15.187 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:07:15.191 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:07:15.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:15.196 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:07:15.296 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:07:15.296 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:07:15.297 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:07:15.297 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:07:15.297 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:07:15.297 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:07:15.297 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:15.298 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:15.298 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:15.298 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:07:15.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:15.299 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:07:15.299 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:07:15.299 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:07:15.300 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:07:15.300 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:07:15.301 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:07:15.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:15.398 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:07:15.410 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-13T06:07:15.411 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:07:15.411 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:07:15.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:15.413 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-09-13T06:07:15.474 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:07:15.475 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T06:07:15.526 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:07:15.526 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:07:15.527 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:07:15.578 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:07:15.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:15.579 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:07:15.673 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:07:15.673 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:07:15.673 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:07:15.688 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:07:15.688 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:07:15.688 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:07:15.689 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:07:15.689 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:07:15.696 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:07:15.697 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:07:15.697 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:07:15.697 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:07:15.697 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:07:15.697 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:07:15.698 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:07:15.698 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:07:15.701 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:07:15.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:15.702 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:07:15.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:15.722 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:07:15.777 INFO:teuthology.orchestra.run.smithi164.stdout:client6290 2023-09-13T06:07:15.777 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:07:15.778 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:15.830 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:15.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61e6c48640 1 Processor -- start 2023-09-13T06:07:15.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61e6c48640 1 -- start start 2023-09-13T06:07:15.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61e6c48640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f61e00d1090 0x7f61e015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:15.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61e6c48640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e00b63c0 con 0x7f61e0146f30 2023-09-13T06:07:15.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61e6c48640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e00d0c20 con 0x7f61e00d1750 2023-09-13T06:07:15.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61e6c48640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e015dea0 con 0x7f61e00d1090 2023-09-13T06:07:15.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61d7fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f61e00d1090 0x7f61e015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:15.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61e51e5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f61e0146f30 0x7f61e00b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60838/0 (socket says 172.21.15.130:60838) 2023-09-13T06:07:15.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61e51e5640 1 -- 172.21.15.130:0/2786652111 learned_addr learned my addr 172.21.15.130:0/2786652111 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:15.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61d77fe640 1 -- 172.21.15.130:0/2786652111 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212883140 0 0) 0x7f61e00b63c0 con 0x7f61e0146f30 2023-09-13T06:07:15.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61d7fff640 1 -- 172.21.15.130:0/2786652111 >> v1:172.21.15.164:6789/0 conn(0x7f61e00d1750 legacy=0x7f61e0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:15.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61d7fff640 1 -- 172.21.15.130:0/2786652111 >> v1:172.21.15.130:6789/0 conn(0x7f61e0146f30 legacy=0x7f61e00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:15.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.968+0000 7f61d7fff640 1 -- 172.21.15.130:0/2786652111 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e00b6610 con 0x7f61e00d1090 2023-09-13T06:07:15.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.972+0000 7f61d7fff640 1 --2- 172.21.15.130:0/2786652111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61e00d1090 0x7f61e015d960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f61d00097c0 tx=0x7f61d001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c1315a9019b74f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:15.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.972+0000 7f61d77fe640 1 -- 172.21.15.130:0/2786652111 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00ac620 con 0x7f61e00d1090 2023-09-13T06:07:15.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.972+0000 7f61d77fe640 1 -- 172.21.15.130:0/2786652111 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00ac780 con 0x7f61e00d1090 2023-09-13T06:07:15.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.972+0000 7f61d77fe640 1 -- 172.21.15.130:0/2786652111 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00acb10 con 0x7f61e00d1090 2023-09-13T06:07:15.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.972+0000 7f61e6c48640 1 -- 172.21.15.130:0/2786652111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61e00d1090 msgr2=0x7f61e015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:15.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.972+0000 7f61e6c48640 1 --2- 172.21.15.130:0/2786652111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61e00d1090 0x7f61e015d960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f61d00097c0 tx=0x7f61d001c3c0 comp rx=0 tx=0).stop 2023-09-13T06:07:15.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.972+0000 7f61e6c48640 1 -- 172.21.15.130:0/2786652111 shutdown_connections 2023-09-13T06:07:15.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.972+0000 7f61e6c48640 1 --2- 172.21.15.130:0/2786652111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61e00d1090 0x7f61e015d960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:15.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.972+0000 7f61e6c48640 1 -- 172.21.15.130:0/2786652111 >> 172.21.15.130:0/2786652111 conn(0x7f61e006f170 msgr2=0x7f61e006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:15.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.972+0000 7f61e6c48640 1 -- 172.21.15.130:0/2786652111 shutdown_connections 2023-09-13T06:07:15.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.972+0000 7f61e6c48640 1 -- 172.21.15.130:0/2786652111 wait complete. 2023-09-13T06:07:15.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e6c48640 1 Processor -- start 2023-09-13T06:07:15.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e6c48640 1 -- start start 2023-09-13T06:07:15.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e6c48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e00d1090 0x7f61e013b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:15.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e6c48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61e00d1750 0x7f61e0159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:15.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e6c48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61e0146f30 0x7f61e013cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:15.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e6c48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e01432b0 con 0x7f61e00d1090 2023-09-13T06:07:15.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e6c48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e015a300 con 0x7f61e00d1750 2023-09-13T06:07:15.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e6c48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e01426a0 con 0x7f61e0146f30 2023-09-13T06:07:15.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e49e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e00d1090 0x7f61e013b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:15.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e49e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e00d1090 0x7f61e013b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59256/0 (socket says 172.21.15.130:59256) 2023-09-13T06:07:15.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e49e4640 1 -- 172.21.15.130:0/4103430074 learned_addr learned my addr 172.21.15.130:0/4103430074 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:15.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61d7fff640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61e00d1750 0x7f61e0159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:15.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e51e5640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61e0146f30 0x7f61e013cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:15.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e49e4640 1 -- 172.21.15.130:0/4103430074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61e0146f30 msgr2=0x7f61e013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:15.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e49e4640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61e0146f30 0x7f61e013cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:15.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e49e4640 1 -- 172.21.15.130:0/4103430074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61e00d1750 msgr2=0x7f61e0159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:15.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e49e4640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61e00d1750 0x7f61e0159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:15.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e49e4640 1 -- 172.21.15.130:0/4103430074 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d0009420 con 0x7f61e00d1090 2023-09-13T06:07:15.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e49e4640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e00d1090 0x7f61e013b4a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00c530 tx=0x7f61dc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:15.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61d57fa640 1 -- 172.21.15.130:0/4103430074 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc005220 con 0x7f61e00d1090 2023-09-13T06:07:15.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61d57fa640 1 -- 172.21.15.130:0/4103430074 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc005380 con 0x7f61e00d1090 2023-09-13T06:07:15.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e6c48640 1 -- 172.21.15.130:0/4103430074 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e0142980 con 0x7f61e00d1090 2023-09-13T06:07:15.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61d57fa640 1 -- 172.21.15.130:0/4103430074 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc007270 con 0x7f61e00d1090 2023-09-13T06:07:15.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.976+0000 7f61e6c48640 1 -- 172.21.15.130:0/4103430074 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e0142f40 con 0x7f61e00d1090 2023-09-13T06:07:15.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.980+0000 7f61e6c48640 1 -- 172.21.15.130:0/4103430074 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e00618a0 con 0x7f61e00d1090 2023-09-13T06:07:15.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.980+0000 7f61d57fa640 1 -- 172.21.15.130:0/4103430074 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f61dc0073d0 con 0x7f61e00d1090 2023-09-13T06:07:15.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.980+0000 7f61d57fa640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f61cc065b20 0x7f61cc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:15.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.980+0000 7f61d57fa640 1 -- 172.21.15.130:0/4103430074 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61dc082a10 con 0x7f61e00d1090 2023-09-13T06:07:15.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.980+0000 7f61d7fff640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f61cc065b20 0x7f61cc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:15.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.980+0000 7f61d7fff640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f61cc065b20 0x7f61cc067fe0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f61d00ae000 tx=0x7f61d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:15.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:15.984+0000 7f61d57fa640 1 -- 172.21.15.130:0/4103430074 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f61dc0504a0 con 0x7f61e00d1090 2023-09-13T06:07:16.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.164+0000 7f61e6c48640 1 -- 172.21.15.130:0/4103430074 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61e00b86c0 con 0x7f61e00d1090 2023-09-13T06:07:16.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.164+0000 7f61d57fa640 1 -- 172.21.15.130:0/4103430074 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f61dc053ac0 con 0x7f61e00d1090 2023-09-13T06:07:16.168 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:16.168 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2121062896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2121062896},{"type":"v1","addr":"172.21.15.164:6834","nonce":2121062896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3004233572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3004233572},{"type":"v1","addr":"172.21.15.164:6835","nonce":3004233572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7311,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3730755977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3730755977},{"type":"v1","addr":"172.21.15.130:6835","nonce":3730755977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:07.210560+0000","modified":"2023-09-13T06:07:10.218199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/4103504372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4103504372},{"type":"v1","addr":"172.21.15.130:6837","nonce":4103504372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-09-13T06:07:16.168 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 59 2023-09-13T06:07:16.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 -- 172.21.15.130:0/4103430074 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f61cc065b20 msgr2=0x7f61cc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:16.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f61cc065b20 0x7f61cc067fe0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f61d00ae000 tx=0x7f61d0008040 comp rx=0 tx=0).stop 2023-09-13T06:07:16.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 -- 172.21.15.130:0/4103430074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e00d1090 msgr2=0x7f61e013b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:16.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e00d1090 0x7f61e013b4a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00c530 tx=0x7f61dc00c9f0 comp rx=0 tx=0).stop 2023-09-13T06:07:16.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 -- 172.21.15.130:0/4103430074 shutdown_connections 2023-09-13T06:07:16.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f61cc065b20 0x7f61cc067fe0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:16.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61e00d1750 0x7f61e0159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:16.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61e0146f30 0x7f61e013cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:16.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 --2- 172.21.15.130:0/4103430074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e00d1090 0x7f61e013b4a0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:16.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 -- 172.21.15.130:0/4103430074 >> 172.21.15.130:0/4103430074 conn(0x7f61e006f170 msgr2=0x7f61e00cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:16.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 -- 172.21.15.130:0/4103430074 shutdown_connections 2023-09-13T06:07:16.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.168+0000 7f61e6c48640 1 -- 172.21.15.130:0/4103430074 wait complete. 2023-09-13T06:07:16.188 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-09-13T06:07:16.347 INFO:teuthology.orchestra.run.smithi130.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":7320,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4987376460000004,"mdsmap_epoch":59,"osdmap_epoch":123,"osdmap_epoch_barrier":123,"uptime":14.429466785000001} 2023-09-13T06:07:16.348 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 7320, "mdsmap_epoch": 59, "osdmap_epoch": 123, "osdmap_epoch_barrier": 123, "rank_uptime": 8.498737646, "state": "up:active", "uptime": 14.429466785, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:07:16.349 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-09-13T06:07:16.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.488+0000 7fa547607640 1 Processor -- start 2023-09-13T06:07:16.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.488+0000 7fa547607640 1 -- start start 2023-09-13T06:07:16.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa547607640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa5400cb710 0x7fa5400cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:16.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa547607640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5400ccff0 con 0x7fa5400b3170 2023-09-13T06:07:16.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa547607640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54015b590 con 0x7fa5400ccc10 2023-09-13T06:07:16.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa547607640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5400b12f0 con 0x7fa5400cb710 2023-09-13T06:07:16.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa544ba2640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa5400b3170 0x7fa5400b1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60852/0 (socket says 172.21.15.130:60852) 2023-09-13T06:07:16.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa544ba2640 1 -- 172.21.15.130:0/1930745670 learned_addr learned my addr 172.21.15.130:0/1930745670 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa545ba4640 1 --2- 172.21.15.130:0/1930745670 >> v2:172.21.15.164:3300/0 conn(0x7fa5400cb710 0x7fa5400cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa537fff640 1 -- 172.21.15.130:0/1930745670 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25823945 0 0) 0x7fa5400ccff0 con 0x7fa5400b3170 2023-09-13T06:07:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa537fff640 1 -- 172.21.15.130:0/1930745670 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa52c003530 con 0x7fa5400b3170 2023-09-13T06:07:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa537fff640 1 -- 172.21.15.130:0/1930745670 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79738042 0 0) 0x7fa54015b590 con 0x7fa5400ccc10 2023-09-13T06:07:16.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa537fff640 1 -- 172.21.15.130:0/1930745670 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5400ccff0 con 0x7fa5400ccc10 2023-09-13T06:07:16.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa537fff640 1 -- 172.21.15.130:0/1930745670 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3594993294 0 0) 0x7fa52c003530 con 0x7fa5400b3170 2023-09-13T06:07:16.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa545ba4640 1 -- 172.21.15.130:0/1930745670 >> v1:172.21.15.164:6789/0 conn(0x7fa5400ccc10 legacy=0x7fa54015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:16.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa545ba4640 1 -- 172.21.15.130:0/1930745670 >> v1:172.21.15.130:6789/0 conn(0x7fa5400b3170 legacy=0x7fa5400b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:16.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.492+0000 7fa545ba4640 1 -- 172.21.15.130:0/1930745670 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54015e520 con 0x7fa5400cb710 2023-09-13T06:07:16.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa545ba4640 1 --2- 172.21.15.130:0/1930745670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5400cb710 0x7fa5400cbba0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa538009d90 tx=0x7fa53801c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a25ae4f5742c49 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:16.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa537fff640 1 -- 172.21.15.130:0/1930745670 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530001680 con 0x7fa5400cb710 2023-09-13T06:07:16.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa537fff640 1 -- 172.21.15.130:0/1930745670 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5380a55a0 con 0x7fa5400cb710 2023-09-13T06:07:16.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa537fff640 1 -- 172.21.15.130:0/1930745670 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5380a5930 con 0x7fa5400cb710 2023-09-13T06:07:16.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa547607640 1 -- 172.21.15.130:0/1930745670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5400cb710 msgr2=0x7fa5400cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:16.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa547607640 1 --2- 172.21.15.130:0/1930745670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5400cb710 0x7fa5400cbba0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa538009d90 tx=0x7fa53801c870 comp rx=0 tx=0).stop 2023-09-13T06:07:16.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa547607640 1 -- 172.21.15.130:0/1930745670 shutdown_connections 2023-09-13T06:07:16.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa547607640 1 --2- 172.21.15.130:0/1930745670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5400cb710 0x7fa5400cbba0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:16.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa547607640 1 -- 172.21.15.130:0/1930745670 >> 172.21.15.130:0/1930745670 conn(0x7fa5400735e0 msgr2=0x7fa540065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:16.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa547607640 1 -- 172.21.15.130:0/1930745670 shutdown_connections 2023-09-13T06:07:16.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa547607640 1 -- 172.21.15.130:0/1930745670 wait complete. 2023-09-13T06:07:16.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa547607640 1 Processor -- start 2023-09-13T06:07:16.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.496+0000 7fa547607640 1 -- start start 2023-09-13T06:07:16.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa547607640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5400b3170 0x7fa54015d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:16.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa547607640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5400cb710 0x7fa5401f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:16.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa547607640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5400ccc10 0x7fa5401f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:16.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa547607640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa540151d10 con 0x7fa5400ccc10 2023-09-13T06:07:16.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa547607640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5401576e0 con 0x7fa5400cb710 2023-09-13T06:07:16.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa547607640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400adeb0 con 0x7fa5400b3170 2023-09-13T06:07:16.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa545ba4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5400ccc10 0x7fa5401f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:16.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa545ba4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5400ccc10 0x7fa5401f5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59260/0 (socket says 172.21.15.130:59260) 2023-09-13T06:07:16.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa545ba4640 1 -- 172.21.15.130:0/1600641457 learned_addr learned my addr 172.21.15.130:0/1600641457 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:16.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa5453a3640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5400b3170 0x7fa54015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:16.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa544ba2640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5400cb710 0x7fa5401f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:16.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa545ba4640 1 -- 172.21.15.130:0/1600641457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5400b3170 msgr2=0x7fa54015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:16.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa545ba4640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5400b3170 0x7fa54015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:16.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa545ba4640 1 -- 172.21.15.130:0/1600641457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5400cb710 msgr2=0x7fa5401f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:16.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa545ba4640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5400cb710 0x7fa5401f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:16.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa545ba4640 1 -- 172.21.15.130:0/1600641457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538009a70 con 0x7fa5400ccc10 2023-09-13T06:07:16.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa5453a3640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5400b3170 0x7fa54015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:16.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa544ba2640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5400cb710 0x7fa5401f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:16.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa545ba4640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5400ccc10 0x7fa5401f5960 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fa538009d90 tx=0x7fa538019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:16.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa535ffb640 1 -- 172.21.15.130:0/1600641457 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538003ba0 con 0x7fa5400ccc10 2023-09-13T06:07:16.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa535ffb640 1 -- 172.21.15.130:0/1600641457 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa538003d00 con 0x7fa5400ccc10 2023-09-13T06:07:16.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa547607640 1 -- 172.21.15.130:0/1600641457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54015daa0 con 0x7fa5400ccc10 2023-09-13T06:07:16.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa535ffb640 1 -- 172.21.15.130:0/1600641457 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538004220 con 0x7fa5400ccc10 2023-09-13T06:07:16.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa547607640 1 -- 172.21.15.130:0/1600641457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540157400 con 0x7fa5400ccc10 2023-09-13T06:07:16.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa547607640 1 -- 172.21.15.130:0/1600641457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5401521d0 con 0x7fa5400ccc10 2023-09-13T06:07:16.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.500+0000 7fa535ffb640 1 -- 172.21.15.130:0/1600641457 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa538004380 con 0x7fa5400ccc10 2023-09-13T06:07:16.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.504+0000 7fa535ffb640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa524065b20 0x7fa524067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:16.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.504+0000 7fa535ffb640 1 -- 172.21.15.130:0/1600641457 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa53811d8e0 con 0x7fa5400ccc10 2023-09-13T06:07:16.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.504+0000 7fa5453a3640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa524065b20 0x7fa524067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:16.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.504+0000 7fa5453a3640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa524065b20 0x7fa524067fe0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0011f0 tx=0x7fa53c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:16.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.508+0000 7fa535ffb640 1 -- 172.21.15.130:0/1600641457 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa5380eb230 con 0x7fa5400ccc10 2023-09-13T06:07:16.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:16.656+0000 7fa547607640 1 -- 172.21.15.130:0/1600641457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fa5400618a0 con 0x7fa5400ccc10 2023-09-13T06:07:17.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.396+0000 7fa535ffb640 1 -- 172.21.15.130:0/1600641457 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v124) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa538009450 con 0x7fa5400ccc10 2023-09-13T06:07:17.399 INFO:teuthology.orchestra.run.smithi130.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-09-13T06:07:17.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 -- 172.21.15.130:0/1600641457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa524065b20 msgr2=0x7fa524067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:17.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa524065b20 0x7fa524067fe0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0011f0 tx=0x7fa53c009040 comp rx=0 tx=0).stop 2023-09-13T06:07:17.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 -- 172.21.15.130:0/1600641457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5400ccc10 msgr2=0x7fa5401f5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:17.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5400ccc10 0x7fa5401f5960 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fa538009d90 tx=0x7fa538019610 comp rx=0 tx=0).stop 2023-09-13T06:07:17.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 -- 172.21.15.130:0/1600641457 shutdown_connections 2023-09-13T06:07:17.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa524065b20 0x7fa524067fe0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:17.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5400cb710 0x7fa5401f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:17.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5400ccc10 0x7fa5401f5960 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:17.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 --2- 172.21.15.130:0/1600641457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5400b3170 0x7fa54015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:17.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 -- 172.21.15.130:0/1600641457 >> 172.21.15.130:0/1600641457 conn(0x7fa5400735e0 msgr2=0x7fa540159700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:17.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 -- 172.21.15.130:0/1600641457 shutdown_connections 2023-09-13T06:07:17.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.400+0000 7fa547607640 1 -- 172.21.15.130:0/1600641457 wait complete. 2023-09-13T06:07:17.424 DEBUG:teuthology.orchestra.run.smithi130:> stdin-killer -- python3 -c ' 2023-09-13T06:07:17.424 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-09-13T06:07:17.424 DEBUG:teuthology.orchestra.run.smithi130:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-13T06:07:17.425 DEBUG:teuthology.orchestra.run.smithi130:> os.fchmod(fd, 0O666) 2023-09-13T06:07:17.425 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(fd) 2023-09-13T06:07:17.425 DEBUG:teuthology.orchestra.run.smithi130:> os.close(fd) 2023-09-13T06:07:17.426 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-09-13T06:07:17.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-13T06:07:17.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:17.509 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:07:17.564 INFO:teuthology.orchestra.run.smithi130.stdout:client6898 2023-09-13T06:07:17.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:17.565 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client6898/osdmap') 2023-09-13T06:07:17.628 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 123 barrier 123 flags 0x588000 2023-09-13T06:07:17.629 INFO:teuthology.orchestra.run.smithi130.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:17.629 INFO:teuthology.orchestra.run.smithi130.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:17.629 INFO:teuthology.orchestra.run.smithi130.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:17.629 INFO:teuthology.orchestra.run.smithi130.stdout:osd0 (1)172.21.15.130:6801 100% (exists, up) 100% -1 2023-09-13T06:07:17.630 INFO:teuthology.orchestra.run.smithi130.stdout:osd1 (1)172.21.15.130:6817 100% (exists, up) 100% -1 2023-09-13T06:07:17.630 INFO:teuthology.orchestra.run.smithi130.stdout:osd2 (1)172.21.15.130:6809 100% (exists, up) 100% -1 2023-09-13T06:07:17.630 INFO:teuthology.orchestra.run.smithi130.stdout:osd3 (1)172.21.15.130:6812 100% (exists, up) 100% -1 2023-09-13T06:07:17.630 INFO:teuthology.orchestra.run.smithi130.stdout:osd4 (1)172.21.15.164:6801 100% (exists, up) 100% -1 2023-09-13T06:07:17.630 INFO:teuthology.orchestra.run.smithi130.stdout:osd5 (1)172.21.15.164:6809 100% (exists, up) 100% -1 2023-09-13T06:07:17.631 INFO:teuthology.orchestra.run.smithi130.stdout:osd6 (1)172.21.15.164:6817 100% (exists, up) 100% -1 2023-09-13T06:07:17.631 INFO:teuthology.orchestra.run.smithi130.stdout:osd7 (1)172.21.15.164:6825 100% (exists, up) 100% -1 2023-09-13T06:07:17.632 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records in 2023-09-13T06:07:17.632 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records out 2023-09-13T06:07:17.632 INFO:teuthology.orchestra.run.smithi130.stderr:803 bytes copied, 7.0901e-05 s, 11.3 MB/s 2023-09-13T06:07:17.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-09-13T06:07:17.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.816+0000 7f648360b640 1 Processor -- start 2023-09-13T06:07:17.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.816+0000 7f648360b640 1 -- start start 2023-09-13T06:07:17.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f648360b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f647c070d60 0x7f647c160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:17.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f648360b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c06f640 con 0x7f647c146540 2023-09-13T06:07:17.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f648360b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c06f890 con 0x7f647c1436e0 2023-09-13T06:07:17.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f648360b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c06fb70 con 0x7f647c070d60 2023-09-13T06:07:17.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f6480ba6640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f647c146540 0x7f647c070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60866/0 (socket says 172.21.15.130:60866) 2023-09-13T06:07:17.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f6480ba6640 1 -- 172.21.15.130:0/794817734 learned_addr learned my addr 172.21.15.130:0/794817734 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:17.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f6481ba8640 1 --2- 172.21.15.130:0/794817734 >> v2:172.21.15.164:3300/0 conn(0x7f647c070d60 0x7f647c160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:17.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f6473fff640 1 -- 172.21.15.130:0/794817734 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115284897 0 0) 0x7f647c06f640 con 0x7f647c146540 2023-09-13T06:07:17.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f6473fff640 1 -- 172.21.15.130:0/794817734 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6468003530 con 0x7f647c146540 2023-09-13T06:07:17.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f6473fff640 1 -- 172.21.15.130:0/794817734 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3396034651 0 0) 0x7f6468003530 con 0x7f647c146540 2023-09-13T06:07:17.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f6481ba8640 1 -- 172.21.15.130:0/794817734 >> v1:172.21.15.164:6789/0 conn(0x7f647c1436e0 legacy=0x7f647c0ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:17.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f6481ba8640 1 -- 172.21.15.130:0/794817734 >> v1:172.21.15.130:6789/0 conn(0x7f647c146540 legacy=0x7f647c070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:17.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.820+0000 7f6481ba8640 1 -- 172.21.15.130:0/794817734 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c06fe50 con 0x7f647c070d60 2023-09-13T06:07:17.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f6481ba8640 1 --2- 172.21.15.130:0/794817734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647c070d60 0x7f647c160eb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6474009d90 tx=0x7f647401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f48ff9a5de61e8fb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:17.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f6473fff640 1 -- 172.21.15.130:0/794817734 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c146e10 con 0x7f647c070d60 2023-09-13T06:07:17.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f6473fff640 1 -- 172.21.15.130:0/794817734 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64740a4970 con 0x7f647c070d60 2023-09-13T06:07:17.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f6473fff640 1 -- 172.21.15.130:0/794817734 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c001680 con 0x7f647c070d60 2023-09-13T06:07:17.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f648360b640 1 -- 172.21.15.130:0/794817734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647c070d60 msgr2=0x7f647c160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:17.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f648360b640 1 --2- 172.21.15.130:0/794817734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647c070d60 0x7f647c160eb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6474009d90 tx=0x7f647401c370 comp rx=0 tx=0).stop 2023-09-13T06:07:17.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f648360b640 1 -- 172.21.15.130:0/794817734 shutdown_connections 2023-09-13T06:07:17.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f648360b640 1 --2- 172.21.15.130:0/794817734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647c070d60 0x7f647c160eb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:17.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f648360b640 1 -- 172.21.15.130:0/794817734 >> 172.21.15.130:0/794817734 conn(0x7f647c0b0bc0 msgr2=0x7f647c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:17.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f648360b640 1 -- 172.21.15.130:0/794817734 shutdown_connections 2023-09-13T06:07:17.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f648360b640 1 -- 172.21.15.130:0/794817734 wait complete. 2023-09-13T06:07:17.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f648360b640 1 Processor -- start 2023-09-13T06:07:17.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.824+0000 7f648360b640 1 -- start start 2023-09-13T06:07:17.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f648360b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647c070d60 0x7f647c1470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:17.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f648360b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f647c1436e0 0x7f647c1370f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:17.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f648360b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f647c146540 0x7f647c0afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:17.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f648360b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c143d00 con 0x7f647c146540 2023-09-13T06:07:17.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f648360b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c143fe0 con 0x7f647c070d60 2023-09-13T06:07:17.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f648360b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c1442c0 con 0x7f647c1436e0 2023-09-13T06:07:17.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6481ba8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f647c146540 0x7f647c0afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:17.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6481ba8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f647c146540 0x7f647c0afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59268/0 (socket says 172.21.15.130:59268) 2023-09-13T06:07:17.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6481ba8640 1 -- 172.21.15.130:0/3546174930 learned_addr learned my addr 172.21.15.130:0/3546174930 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:17.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6480ba6640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f647c1436e0 0x7f647c1370f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:17.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f64813a7640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647c070d60 0x7f647c1470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:17.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6481ba8640 1 -- 172.21.15.130:0/3546174930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f647c1436e0 msgr2=0x7f647c1370f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:17.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6481ba8640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f647c1436e0 0x7f647c1370f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:17.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6481ba8640 1 -- 172.21.15.130:0/3546174930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647c070d60 msgr2=0x7f647c1470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:17.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6481ba8640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647c070d60 0x7f647c1470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:17.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6481ba8640 1 -- 172.21.15.130:0/3546174930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474009a70 con 0x7f647c146540 2023-09-13T06:07:17.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6481ba8640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f647c146540 0x7f647c0afb60 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f64740af040 tx=0x7f6474019430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:17.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6471ffb640 1 -- 172.21.15.130:0/3546174930 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474003ba0 con 0x7f647c146540 2023-09-13T06:07:17.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6471ffb640 1 -- 172.21.15.130:0/3546174930 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6474003d00 con 0x7f647c146540 2023-09-13T06:07:17.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f648360b640 1 -- 172.21.15.130:0/3546174930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c1445a0 con 0x7f647c146540 2023-09-13T06:07:17.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6471ffb640 1 -- 172.21.15.130:0/3546174930 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474004240 con 0x7f647c146540 2023-09-13T06:07:17.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f648360b640 1 -- 172.21.15.130:0/3546174930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c0b00a0 con 0x7f647c146540 2023-09-13T06:07:17.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f648360b640 1 -- 172.21.15.130:0/3546174930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c0618a0 con 0x7f647c146540 2023-09-13T06:07:17.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.828+0000 7f6471ffb640 1 -- 172.21.15.130:0/3546174930 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f647c161c00 con 0x7f647c146540 2023-09-13T06:07:17.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.832+0000 7f6471ffb640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6460065b50 0x7f6460068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:17.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.832+0000 7f6471ffb640 1 -- 172.21.15.130:0/3546174930 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f647411cf40 con 0x7f647c146540 2023-09-13T06:07:17.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.832+0000 7f64813a7640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6460065b50 0x7f6460068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:17.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.832+0000 7f64813a7640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6460065b50 0x7f6460068010 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6478000c10 tx=0x7f6478009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:17.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.836+0000 7f6471ffb640 1 -- 172.21.15.130:0/3546174930 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f64740ea930 con 0x7f647c146540 2023-09-13T06:07:17.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:17.992+0000 7f648360b640 1 -- 172.21.15.130:0/3546174930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f647c0618a0 con 0x7f647c146540 2023-09-13T06:07:18.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f6471ffb640 1 -- 172.21.15.130:0/3546174930 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v125) v1 ==== 93+0+0 (secure 0 0 0) 0x7f64740edf50 con 0x7f647c146540 2023-09-13T06:07:18.406 INFO:teuthology.orchestra.run.smithi130.stderr:pauserd,pausewr is set 2023-09-13T06:07:18.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 -- 172.21.15.130:0/3546174930 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6460065b50 msgr2=0x7f6460068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:18.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6460065b50 0x7f6460068010 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6478000c10 tx=0x7f6478009040 comp rx=0 tx=0).stop 2023-09-13T06:07:18.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 -- 172.21.15.130:0/3546174930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f647c146540 msgr2=0x7f647c0afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:18.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f647c146540 0x7f647c0afb60 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f64740af040 tx=0x7f6474019430 comp rx=0 tx=0).stop 2023-09-13T06:07:18.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 -- 172.21.15.130:0/3546174930 shutdown_connections 2023-09-13T06:07:18.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6460065b50 0x7f6460068010 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:18.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f647c146540 0x7f647c0afb60 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:18.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f647c1436e0 0x7f647c1370f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:18.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 --2- 172.21.15.130:0/3546174930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647c070d60 0x7f647c1470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:18.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 -- 172.21.15.130:0/3546174930 >> 172.21.15.130:0/3546174930 conn(0x7f647c0b0bc0 msgr2=0x7f647c0ada40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:18.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 -- 172.21.15.130:0/3546174930 shutdown_connections 2023-09-13T06:07:18.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.404+0000 7f648360b640 1 -- 172.21.15.130:0/3546174930 wait complete. 2023-09-13T06:07:18.427 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-09-13T06:07:18.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.564+0000 7f2e8b59e640 1 Processor -- start 2023-09-13T06:07:18.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.564+0000 7f2e8b59e640 1 -- start start 2023-09-13T06:07:18.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8b59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e8c161810 0x7f2e8c0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:18.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8b59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2e8c0b7ca0 0x7f2e8c0b8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:18.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8b59e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c071440 con 0x7f2e8c146eb0 2023-09-13T06:07:18.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8b59e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c0b5130 con 0x7f2e8c0b7ca0 2023-09-13T06:07:18.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8b59e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0706a0 con 0x7f2e8c161810 2023-09-13T06:07:18.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8ad9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2e8c0b7ca0 0x7f2e8c0b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:18.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8ad9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2e8c0b7ca0 0x7f2e8c0b8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59282/0 (socket says 172.21.15.130:59282) 2023-09-13T06:07:18.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8ad9d640 1 -- 172.21.15.130:0/1042482479 learned_addr learned my addr 172.21.15.130:0/1042482479 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:18.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8a59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2e8c146eb0 0x7f2e8c161100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60872/0 (socket says 172.21.15.130:60872) 2023-09-13T06:07:18.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e89d9b640 1 --2- 172.21.15.130:0/1042482479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e8c161810 0x7f2e8c0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:18.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8ad9d640 1 -- 172.21.15.130:0/1042482479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e8c161810 msgr2=0x7f2e8c0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:18.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8ad9d640 1 --2- 172.21.15.130:0/1042482479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e8c161810 0x7f2e8c0b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:18.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8ad9d640 1 -- 172.21.15.130:0/1042482479 >> v1:172.21.15.130:6789/0 conn(0x7f2e8c146eb0 legacy=0x7f2e8c161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:18.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8ad9d640 1 -- 172.21.15.130:0/1042482479 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c147290 con 0x7f2e8c0b7ca0 2023-09-13T06:07:18.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.568+0000 7f2e8ad9d640 1 --2- 172.21.15.130:0/1042482479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8c0b7ca0 0x7f2e8c0b8130 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009870 tx=0x7f2e8401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03501e12f4c03af server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:18.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8959a640 1 -- 172.21.15.130:0/1042482479 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840aa670 con 0x7f2e8c0b7ca0 2023-09-13T06:07:18.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8959a640 1 -- 172.21.15.130:0/1042482479 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840aa7d0 con 0x7f2e8c0b7ca0 2023-09-13T06:07:18.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8959a640 1 -- 172.21.15.130:0/1042482479 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840aab60 con 0x7f2e8c0b7ca0 2023-09-13T06:07:18.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 -- 172.21.15.130:0/1042482479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8c0b7ca0 msgr2=0x7f2e8c0b8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:18.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 --2- 172.21.15.130:0/1042482479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8c0b7ca0 0x7f2e8c0b8130 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009870 tx=0x7f2e8401c510 comp rx=0 tx=0).stop 2023-09-13T06:07:18.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 -- 172.21.15.130:0/1042482479 shutdown_connections 2023-09-13T06:07:18.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 --2- 172.21.15.130:0/1042482479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8c0b7ca0 0x7f2e8c0b8130 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:18.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 --2- 172.21.15.130:0/1042482479 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e8c161810 0x7f2e8c0b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:18.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 -- 172.21.15.130:0/1042482479 >> 172.21.15.130:0/1042482479 conn(0x7f2e8c0cdd10 msgr2=0x7f2e8c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:18.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 -- 172.21.15.130:0/1042482479 shutdown_connections 2023-09-13T06:07:18.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 -- 172.21.15.130:0/1042482479 wait complete. 2023-09-13T06:07:18.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 Processor -- start 2023-09-13T06:07:18.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 -- start start 2023-09-13T06:07:18.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e8c0b7ca0 0x7f2e8c0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:18.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8c146eb0 0x7f2e8c13ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:18.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e8c161810 0x7f2e8c0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:18.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c13f1c0 con 0x7f2e8c146eb0 2023-09-13T06:07:18.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c1f5e20 con 0x7f2e8c161810 2023-09-13T06:07:18.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.572+0000 7f2e8b59e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c1f6100 con 0x7f2e8c0b7ca0 2023-09-13T06:07:18.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e89d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8c146eb0 0x7f2e8c13ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:18.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e89d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8c146eb0 0x7f2e8c13ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59296/0 (socket says 172.21.15.130:59296) 2023-09-13T06:07:18.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e89d9b640 1 -- 172.21.15.130:0/248707426 learned_addr learned my addr 172.21.15.130:0/248707426 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:18.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e8a59c640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e8c0b7ca0 0x7f2e8c0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:18.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e8ad9d640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e8c161810 0x7f2e8c0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:18.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e89d9b640 1 -- 172.21.15.130:0/248707426 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e8c0b7ca0 msgr2=0x7f2e8c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:18.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e89d9b640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e8c0b7ca0 0x7f2e8c0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:18.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e89d9b640 1 -- 172.21.15.130:0/248707426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e8c161810 msgr2=0x7f2e8c0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:18.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e89d9b640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e8c161810 0x7f2e8c0c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:18.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e89d9b640 1 -- 172.21.15.130:0/248707426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e840094d0 con 0x7f2e8c146eb0 2023-09-13T06:07:18.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e8ad9d640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e8c161810 0x7f2e8c0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:18.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e89d9b640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8c146eb0 0x7f2e8c13ec80 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000d5f0 tx=0x7f2e8000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:18.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e7affd640 1 -- 172.21.15.130:0/248707426 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e800125f0 con 0x7f2e8c146eb0 2023-09-13T06:07:18.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e7affd640 1 -- 172.21.15.130:0/248707426 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e80012750 con 0x7f2e8c146eb0 2023-09-13T06:07:18.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e7affd640 1 -- 172.21.15.130:0/248707426 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80012ae0 con 0x7f2e8c146eb0 2023-09-13T06:07:18.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e8b59e640 1 -- 172.21.15.130:0/248707426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c1f63e0 con 0x7f2e8c146eb0 2023-09-13T06:07:18.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e8b59e640 1 -- 172.21.15.130:0/248707426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c1f5b10 con 0x7f2e8c146eb0 2023-09-13T06:07:18.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e8b59e640 1 -- 172.21.15.130:0/248707426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8c0618a0 con 0x7f2e8c146eb0 2023-09-13T06:07:18.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e7affd640 1 -- 172.21.15.130:0/248707426 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2e80012c40 con 0x7f2e8c146eb0 2023-09-13T06:07:18.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.576+0000 7f2e7affd640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e6c065b20 0x7f2e6c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:18.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.580+0000 7f2e7affd640 1 -- 172.21.15.130:0/248707426 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e80083790 con 0x7f2e8c146eb0 2023-09-13T06:07:18.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.580+0000 7f2e8a59c640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e6c065b20 0x7f2e6c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:18.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.580+0000 7f2e7affd640 1 -- 172.21.15.130:0/248707426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=126+}) v3 -- 0x7f2e6c06d650 con 0x7f2e8c146eb0 2023-09-13T06:07:18.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.580+0000 7f2e8a59c640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e6c065b20 0x7f2e6c067fe0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0012f0 tx=0x7f2e7c001700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:18.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.580+0000 7f2e7affd640 1 -- 172.21.15.130:0/248707426 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2e80051040 con 0x7f2e8c146eb0 2023-09-13T06:07:18.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:18.740+0000 7f2e8b59e640 1 -- 172.21.15.130:0/248707426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f2e8c070300 con 0x7f2e8c146eb0 2023-09-13T06:07:19.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.408+0000 7f2e7affd640 1 -- 172.21.15.130:0/248707426 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(126..126 src has 1..126) v4 ==== 288+0+0 (secure 0 0 0) 0x7f2e80055400 con 0x7f2e8c146eb0 2023-09-13T06:07:19.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.408+0000 7f2e7affd640 1 -- 172.21.15.130:0/248707426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=127}) v3 -- 0x7f2e6c06df00 con 0x7f2e8c146eb0 2023-09-13T06:07:19.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.408+0000 7f2e7affd640 1 -- 172.21.15.130:0/248707426 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v126) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2e80007380 con 0x7f2e8c146eb0 2023-09-13T06:07:19.413 INFO:teuthology.orchestra.run.smithi130.stderr:pauserd,pausewr is unset 2023-09-13T06:07:19.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 -- 172.21.15.130:0/248707426 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e6c065b20 msgr2=0x7f2e6c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:19.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e6c065b20 0x7f2e6c067fe0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0012f0 tx=0x7f2e7c001700 comp rx=0 tx=0).stop 2023-09-13T06:07:19.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 -- 172.21.15.130:0/248707426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8c146eb0 msgr2=0x7f2e8c13ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:19.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8c146eb0 0x7f2e8c13ec80 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000d5f0 tx=0x7f2e8000dab0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 -- 172.21.15.130:0/248707426 shutdown_connections 2023-09-13T06:07:19.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e6c065b20 0x7f2e6c067fe0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e8c161810 0x7f2e8c0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8c146eb0 0x7f2e8c13ec80 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 --2- 172.21.15.130:0/248707426 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e8c0b7ca0 0x7f2e8c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 -- 172.21.15.130:0/248707426 >> 172.21.15.130:0/248707426 conn(0x7f2e8c0cdd10 msgr2=0x7f2e8c0b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:19.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 -- 172.21.15.130:0/248707426 shutdown_connections 2023-09-13T06:07:19.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.412+0000 7f2e8b59e640 1 -- 172.21.15.130:0/248707426 wait complete. 2023-09-13T06:07:19.436 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:19.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.572+0000 7fefa1c6d640 1 Processor -- start 2023-09-13T06:07:19.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.572+0000 7fefa1c6d640 1 -- start start 2023-09-13T06:07:19.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fefa1c6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef9c15b130 0x7fef9c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:19.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fefa1c6d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fef9c0b04a0 0x7fef9c0b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:19.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fefa1c6d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0ce980 con 0x7fef9c0ce180 2023-09-13T06:07:19.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fefa1c6d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c0b0e70 con 0x7fef9c0b04a0 2023-09-13T06:07:19.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fefa1c6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0cec60 con 0x7fef9c15b130 2023-09-13T06:07:19.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fef9bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fef9c0b04a0 0x7fef9c0b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:19.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fef9bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fef9c0b04a0 0x7fef9c0b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59306/0 (socket says 172.21.15.130:59306) 2023-09-13T06:07:19.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fef9bfff640 1 -- 172.21.15.130:0/3329460207 learned_addr learned my addr 172.21.15.130:0/3329460207 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:19.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fef9b7fe640 1 --2- 172.21.15.130:0/3329460207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef9c15b130 0x7fef9c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:19.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fef9bfff640 1 -- 172.21.15.130:0/3329460207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef9c15b130 msgr2=0x7fef9c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:19.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fef9bfff640 1 --2- 172.21.15.130:0/3329460207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef9c15b130 0x7fef9c0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fef9bfff640 1 -- 172.21.15.130:0/3329460207 >> v1:172.21.15.164:6789/0 conn(0x7fef9c0ce180 legacy=0x7fef9c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:19.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fef9bfff640 1 -- 172.21.15.130:0/3329460207 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c06c640 con 0x7fef9c0b04a0 2023-09-13T06:07:19.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.576+0000 7fef9bfff640 1 --2- 172.21.15.130:0/3329460207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef9c0b04a0 0x7fef9c0b0930 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fef94009e50 tx=0x7fef9401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577dc4d9a617d55c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:19.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fef9affd640 1 -- 172.21.15.130:0/3329460207 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940a58e0 con 0x7fef9c0b04a0 2023-09-13T06:07:19.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fef9affd640 1 -- 172.21.15.130:0/3329460207 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef940a5a40 con 0x7fef9c0b04a0 2023-09-13T06:07:19.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fef9affd640 1 -- 172.21.15.130:0/3329460207 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940a5dd0 con 0x7fef9c0b04a0 2023-09-13T06:07:19.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 -- 172.21.15.130:0/3329460207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef9c0b04a0 msgr2=0x7fef9c0b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:19.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 --2- 172.21.15.130:0/3329460207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef9c0b04a0 0x7fef9c0b0930 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fef94009e50 tx=0x7fef9401ca10 comp rx=0 tx=0).stop 2023-09-13T06:07:19.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 -- 172.21.15.130:0/3329460207 shutdown_connections 2023-09-13T06:07:19.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 --2- 172.21.15.130:0/3329460207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef9c0b04a0 0x7fef9c0b0930 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 --2- 172.21.15.130:0/3329460207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef9c15b130 0x7fef9c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 -- 172.21.15.130:0/3329460207 >> 172.21.15.130:0/3329460207 conn(0x7fef9c065990 msgr2=0x7fef9c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:19.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 -- 172.21.15.130:0/3329460207 shutdown_connections 2023-09-13T06:07:19.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 -- 172.21.15.130:0/3329460207 wait complete. 2023-09-13T06:07:19.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 Processor -- start 2023-09-13T06:07:19.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 -- start start 2023-09-13T06:07:19.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef9c0b04a0 0x7fef9c14ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:19.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef9c0ce180 0x7fef9c157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:19.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef9c15b130 0x7fef9c159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:19.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c14ec20 con 0x7fef9c0b04a0 2023-09-13T06:07:19.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c14f690 con 0x7fef9c0ce180 2023-09-13T06:07:19.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fefa1c6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c158870 con 0x7fef9c15b130 2023-09-13T06:07:19.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fef9b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef9c0b04a0 0x7fef9c14ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:19.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fef9b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef9c0b04a0 0x7fef9c14ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59310/0 (socket says 172.21.15.130:59310) 2023-09-13T06:07:19.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fef9b7fe640 1 -- 172.21.15.130:0/288017246 learned_addr learned my addr 172.21.15.130:0/288017246 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:19.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fef9bfff640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef9c15b130 0x7fef9c159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:19.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.580+0000 7fef93fff640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef9c0ce180 0x7fef9c157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:19.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef9b7fe640 1 -- 172.21.15.130:0/288017246 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef9c15b130 msgr2=0x7fef9c159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:19.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef9b7fe640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef9c15b130 0x7fef9c159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef9b7fe640 1 -- 172.21.15.130:0/288017246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef9c0ce180 msgr2=0x7fef9c157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:19.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef9b7fe640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef9c0ce180 0x7fef9c157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef9b7fe640 1 -- 172.21.15.130:0/288017246 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94009b30 con 0x7fef9c0b04a0 2023-09-13T06:07:19.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef93fff640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef9c0ce180 0x7fef9c157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:19.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef9b7fe640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef9c0b04a0 0x7fef9c14ac80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00e870 tx=0x7fef8c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:19.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef98ff9640 1 -- 172.21.15.130:0/288017246 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c009510 con 0x7fef9c0b04a0 2023-09-13T06:07:19.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef98ff9640 1 -- 172.21.15.130:0/288017246 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c00eec0 con 0x7fef9c0b04a0 2023-09-13T06:07:19.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fefa1c6d640 1 -- 172.21.15.130:0/288017246 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c14f040 con 0x7fef9c0b04a0 2023-09-13T06:07:19.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef98ff9640 1 -- 172.21.15.130:0/288017246 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00cb40 con 0x7fef9c0b04a0 2023-09-13T06:07:19.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fefa1c6d640 1 -- 172.21.15.130:0/288017246 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c14b1c0 con 0x7fef9c0b04a0 2023-09-13T06:07:19.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fefa1c6d640 1 -- 172.21.15.130:0/288017246 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c14eea0 con 0x7fef9c0b04a0 2023-09-13T06:07:19.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef98ff9640 1 -- 172.21.15.130:0/288017246 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fef8c00cca0 con 0x7fef9c0b04a0 2023-09-13T06:07:19.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef98ff9640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef7c065b50 0x7fef7c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:19.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.584+0000 7fef98ff9640 1 -- 172.21.15.130:0/288017246 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef8c083320 con 0x7fef9c0b04a0 2023-09-13T06:07:19.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.588+0000 7fef93fff640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef7c065b50 0x7fef7c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:19.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.588+0000 7fef93fff640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef7c065b50 0x7fef7c068010 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fef9c14ee30 tx=0x7fef84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:19.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.588+0000 7fef98ff9640 1 -- 172.21.15.130:0/288017246 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fef9c14eea0 con 0x7fef9c0b04a0 2023-09-13T06:07:19.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.740+0000 7fefa1c6d640 1 -- 172.21.15.130:0/288017246 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef9c14eea0 con 0x7fef9c0b04a0 2023-09-13T06:07:19.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.740+0000 7fef98ff9640 1 -- 172.21.15.130:0/288017246 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16563 (secure 0 0 0) 0x7fef9c14eea0 con 0x7fef9c0b04a0 2023-09-13T06:07:19.743 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:19.744 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":126,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:19.406296+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:05.156883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:06.213714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:19.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 -- 172.21.15.130:0/288017246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef7c065b50 msgr2=0x7fef7c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:19.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef7c065b50 0x7fef7c068010 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fef9c14ee30 tx=0x7fef84009040 comp rx=0 tx=0).stop 2023-09-13T06:07:19.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 -- 172.21.15.130:0/288017246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef9c0b04a0 msgr2=0x7fef9c14ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:19.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef9c0b04a0 0x7fef9c14ac80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00e870 tx=0x7fef8c00ec70 comp rx=0 tx=0).stop 2023-09-13T06:07:19.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 -- 172.21.15.130:0/288017246 shutdown_connections 2023-09-13T06:07:19.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fef7c065b50 0x7fef7c068010 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef9c0ce180 0x7fef9c157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef9c15b130 0x7fef9c159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 --2- 172.21.15.130:0/288017246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef9c0b04a0 0x7fef9c14ac80 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:19.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 -- 172.21.15.130:0/288017246 >> 172.21.15.130:0/288017246 conn(0x7fef9c065990 msgr2=0x7fef9c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:19.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 -- 172.21.15.130:0/288017246 shutdown_connections 2023-09-13T06:07:19.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19.744+0000 7fefa1c6d640 1 -- 172.21.15.130:0/288017246 wait complete. 2023-09-13T06:07:19.765 DEBUG:teuthology.orchestra.run.smithi130:> stdin-killer -- python3 -c ' 2023-09-13T06:07:19.765 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-09-13T06:07:19.766 DEBUG:teuthology.orchestra.run.smithi130:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-13T06:07:19.766 DEBUG:teuthology.orchestra.run.smithi130:> os.fchmod(fd, 0O666) 2023-09-13T06:07:19.766 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(fd) 2023-09-13T06:07:19.767 DEBUG:teuthology.orchestra.run.smithi130:> os.close(fd) 2023-09-13T06:07:19.767 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-09-13T06:07:19.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-13T06:07:19.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:19.843 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:07:19.899 INFO:teuthology.orchestra.run.smithi130.stdout:client6898 2023-09-13T06:07:19.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:19.900 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client6898/osdmap') 2023-09-13T06:07:19.964 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 123 barrier 123 flags 0x588000 2023-09-13T06:07:19.964 INFO:teuthology.orchestra.run.smithi130.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:19.964 INFO:teuthology.orchestra.run.smithi130.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:19.964 INFO:teuthology.orchestra.run.smithi130.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:19.965 INFO:teuthology.orchestra.run.smithi130.stdout:osd0 (1)172.21.15.130:6801 100% (exists, up) 100% -1 2023-09-13T06:07:19.965 INFO:teuthology.orchestra.run.smithi130.stdout:osd1 (1)172.21.15.130:6817 100% (exists, up) 100% -1 2023-09-13T06:07:19.965 INFO:teuthology.orchestra.run.smithi130.stdout:osd2 (1)172.21.15.130:6809 100% (exists, up) 100% -1 2023-09-13T06:07:19.965 INFO:teuthology.orchestra.run.smithi130.stdout:osd3 (1)172.21.15.130:6812 100% (exists, up) 100% -1 2023-09-13T06:07:19.965 INFO:teuthology.orchestra.run.smithi130.stdout:osd4 (1)172.21.15.164:6801 100% (exists, up) 100% -1 2023-09-13T06:07:19.965 INFO:teuthology.orchestra.run.smithi130.stdout:osd5 (1)172.21.15.164:6809 100% (exists, up) 100% -1 2023-09-13T06:07:19.966 INFO:teuthology.orchestra.run.smithi130.stdout:osd6 (1)172.21.15.164:6817 100% (exists, up) 100% -1 2023-09-13T06:07:19.966 INFO:teuthology.orchestra.run.smithi130.stdout:osd7 (1)172.21.15.164:6825 100% (exists, up) 100% -1 2023-09-13T06:07:19.967 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records in 2023-09-13T06:07:19.967 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records out 2023-09-13T06:07:19.967 INFO:teuthology.orchestra.run.smithi130.stderr:803 bytes copied, 6.6655e-05 s, 12.0 MB/s 2023-09-13T06:07:19.967 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:20.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.144+0000 7fd244693640 1 Processor -- start 2023-09-13T06:07:20.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.144+0000 7fd244693640 1 -- start start 2023-09-13T06:07:20.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd244693640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd23c15d5f0 0x7fd23c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:20.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd244693640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd23c0ae170 0x7fd23c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:20.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd244693640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c0cce60 con 0x7fd23c15d9d0 2023-09-13T06:07:20.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd244693640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0cd140 con 0x7fd23c15d5f0 2023-09-13T06:07:20.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd244693640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0cd420 con 0x7fd23c0ae170 2023-09-13T06:07:20.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd24242f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd23c15d5f0 0x7fd23c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:20.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd24242f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd23c15d5f0 0x7fd23c0cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59314/0 (socket says 172.21.15.130:59314) 2023-09-13T06:07:20.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd24242f640 1 -- 172.21.15.130:0/2640770204 learned_addr learned my addr 172.21.15.130:0/2640770204 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:20.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd242c30640 1 --1- 172.21.15.130:0/2640770204 >> v1:172.21.15.130:6789/0 conn(0x7fd23c15d9d0 0x7fd23c1591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:60888/0 (socket says 172.21.15.130:60888) 2023-09-13T06:07:20.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd241c2e640 1 --2- 172.21.15.130:0/2640770204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd23c0ae170 0x7fd23c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:20.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd24242f640 1 -- 172.21.15.130:0/2640770204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd23c0ae170 msgr2=0x7fd23c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:20.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd24242f640 1 --2- 172.21.15.130:0/2640770204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd23c0ae170 0x7fd23c0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:20.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd24242f640 1 -- 172.21.15.130:0/2640770204 >> v1:172.21.15.130:6789/0 conn(0x7fd23c15d9d0 legacy=0x7fd23c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:20.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd24242f640 1 -- 172.21.15.130:0/2640770204 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0cd700 con 0x7fd23c15d5f0 2023-09-13T06:07:20.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd241c2e640 1 --2- 172.21.15.130:0/2640770204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd23c0ae170 0x7fd23c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:20.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.148+0000 7fd24142d640 1 -- 172.21.15.130:0/2640770204 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859849560 0 0) 0x7fd23c0cce60 con 0x7fd23c15d9d0 2023-09-13T06:07:20.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd24242f640 1 --2- 172.21.15.130:0/2640770204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd23c15d5f0 0x7fd23c0cc7f0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fd238009870 tx=0x7fd23801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9638335dae8a58ce server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:20.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd24142d640 1 -- 172.21.15.130:0/2640770204 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380ab600 con 0x7fd23c15d5f0 2023-09-13T06:07:20.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd24142d640 1 -- 172.21.15.130:0/2640770204 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2380a7050 con 0x7fd23c15d5f0 2023-09-13T06:07:20.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd24142d640 1 -- 172.21.15.130:0/2640770204 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380ab980 con 0x7fd23c15d5f0 2023-09-13T06:07:20.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd244693640 1 -- 172.21.15.130:0/2640770204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd23c15d5f0 msgr2=0x7fd23c0cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:20.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd244693640 1 --2- 172.21.15.130:0/2640770204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd23c15d5f0 0x7fd23c0cc7f0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fd238009870 tx=0x7fd23801c4b0 comp rx=0 tx=0).stop 2023-09-13T06:07:20.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd244693640 1 -- 172.21.15.130:0/2640770204 shutdown_connections 2023-09-13T06:07:20.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd244693640 1 --2- 172.21.15.130:0/2640770204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd23c0ae170 0x7fd23c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:20.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd244693640 1 --2- 172.21.15.130:0/2640770204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd23c15d5f0 0x7fd23c0cc7f0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:20.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd244693640 1 -- 172.21.15.130:0/2640770204 >> 172.21.15.130:0/2640770204 conn(0x7fd23c065990 msgr2=0x7fd23c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:20.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd244693640 1 -- 172.21.15.130:0/2640770204 shutdown_connections 2023-09-13T06:07:20.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd244693640 1 -- 172.21.15.130:0/2640770204 wait complete. 2023-09-13T06:07:20.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd244693640 1 Processor -- start 2023-09-13T06:07:20.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.152+0000 7fd244693640 1 -- start start 2023-09-13T06:07:20.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd244693640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd23c0ae170 0x7fd23c1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:20.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd244693640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd23c15d5f0 0x7fd23c13fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:20.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd244693640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd23c15d9d0 0x7fd23c149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:20.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd244693640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c148c70 con 0x7fd23c15d5f0 2023-09-13T06:07:20.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd244693640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c149ad0 con 0x7fd23c0ae170 2023-09-13T06:07:20.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd244693640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c148ec0 con 0x7fd23c15d9d0 2023-09-13T06:07:20.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd241c2e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd23c15d5f0 0x7fd23c13fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:20.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd241c2e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd23c15d5f0 0x7fd23c13fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59316/0 (socket says 172.21.15.130:59316) 2023-09-13T06:07:20.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd241c2e640 1 -- 172.21.15.130:0/1127010339 learned_addr learned my addr 172.21.15.130:0/1127010339 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:20.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd242c30640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd23c15d9d0 0x7fd23c149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:20.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd24242f640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd23c0ae170 0x7fd23c1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:20.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd241c2e640 1 -- 172.21.15.130:0/1127010339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd23c15d9d0 msgr2=0x7fd23c149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:20.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd241c2e640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd23c15d9d0 0x7fd23c149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:20.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd241c2e640 1 -- 172.21.15.130:0/1127010339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd23c0ae170 msgr2=0x7fd23c1502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:20.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd241c2e640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd23c0ae170 0x7fd23c1502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:20.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd241c2e640 1 -- 172.21.15.130:0/1127010339 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2380094d0 con 0x7fd23c15d5f0 2023-09-13T06:07:20.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd241c2e640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd23c15d5f0 0x7fd23c13fc60 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c820 tx=0x7fd22c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:20.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd232ffd640 1 -- 172.21.15.130:0/1127010339 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c007a30 con 0x7fd23c15d5f0 2023-09-13T06:07:20.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd232ffd640 1 -- 172.21.15.130:0/1127010339 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c007b90 con 0x7fd23c15d5f0 2023-09-13T06:07:20.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd232ffd640 1 -- 172.21.15.130:0/1127010339 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0113f0 con 0x7fd23c15d5f0 2023-09-13T06:07:20.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd244693640 1 -- 172.21.15.130:0/1127010339 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c1491a0 con 0x7fd23c15d5f0 2023-09-13T06:07:20.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd244693640 1 -- 172.21.15.130:0/1127010339 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c149760 con 0x7fd23c15d5f0 2023-09-13T06:07:20.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd244693640 1 -- 172.21.15.130:0/1127010339 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c0618a0 con 0x7fd23c15d5f0 2023-09-13T06:07:20.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.156+0000 7fd232ffd640 1 -- 172.21.15.130:0/1127010339 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd22c011550 con 0x7fd23c15d5f0 2023-09-13T06:07:20.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.160+0000 7fd232ffd640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd220065b20 0x7fd220067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:20.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.160+0000 7fd232ffd640 1 -- 172.21.15.130:0/1127010339 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd22c0833a0 con 0x7fd23c15d5f0 2023-09-13T06:07:20.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.160+0000 7fd24242f640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd220065b20 0x7fd220067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:20.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.160+0000 7fd24242f640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd220065b20 0x7fd220067fe0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0b28c0 tx=0x7fd2380a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:20.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.164+0000 7fd232ffd640 1 -- 172.21.15.130:0/1127010339 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd22c050da0 con 0x7fd23c15d5f0 2023-09-13T06:07:20.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.340+0000 7fd244693640 1 -- 172.21.15.130:0/1127010339 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd23c149c10 con 0x7fd23c15d5f0 2023-09-13T06:07:20.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.340+0000 7fd232ffd640 1 -- 172.21.15.130:0/1127010339 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fd22c0543c0 con 0x7fd23c15d5f0 2023-09-13T06:07:20.345 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:20.345 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2121062896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2121062896},{"type":"v1","addr":"172.21.15.164:6834","nonce":2121062896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3004233572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3004233572},{"type":"v1","addr":"172.21.15.164:6835","nonce":3004233572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7311,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3730755977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3730755977},{"type":"v1","addr":"172.21.15.130:6835","nonce":3730755977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:07.210560+0000","modified":"2023-09-13T06:07:10.218199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/4103504372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4103504372},{"type":"v1","addr":"172.21.15.130:6837","nonce":4103504372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-09-13T06:07:20.346 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 59 2023-09-13T06:07:20.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 -- 172.21.15.130:0/1127010339 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd220065b20 msgr2=0x7fd220067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:20.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd220065b20 0x7fd220067fe0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0b28c0 tx=0x7fd2380a6000 comp rx=0 tx=0).stop 2023-09-13T06:07:20.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 -- 172.21.15.130:0/1127010339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd23c15d5f0 msgr2=0x7fd23c13fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:20.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd23c15d5f0 0x7fd23c13fc60 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c820 tx=0x7fd22c00cce0 comp rx=0 tx=0).stop 2023-09-13T06:07:20.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 -- 172.21.15.130:0/1127010339 shutdown_connections 2023-09-13T06:07:20.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd220065b20 0x7fd220067fe0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:20.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd23c15d9d0 0x7fd23c149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:20.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd23c15d5f0 0x7fd23c13fc60 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:20.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 --2- 172.21.15.130:0/1127010339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd23c0ae170 0x7fd23c1502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:20.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 -- 172.21.15.130:0/1127010339 >> 172.21.15.130:0/1127010339 conn(0x7fd23c065990 msgr2=0x7fd23c070980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:20.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 -- 172.21.15.130:0/1127010339 shutdown_connections 2023-09-13T06:07:20.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20.344+0000 7fd244693640 1 -- 172.21.15.130:0/1127010339 wait complete. 2023-09-13T06:07:20.365 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 126 2023-09-13T06:07:20.523 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-09-13T06:07:20.524 DEBUG:teuthology.orchestra.run.smithi130:> stdin-killer -- python3 -c ' 2023-09-13T06:07:20.524 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-09-13T06:07:20.524 DEBUG:teuthology.orchestra.run.smithi130:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-09-13T06:07:20.525 DEBUG:teuthology.orchestra.run.smithi130:> os.fchmod(fd, 0O666) 2023-09-13T06:07:20.525 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(fd) 2023-09-13T06:07:20.526 DEBUG:teuthology.orchestra.run.smithi130:> os.close(fd) 2023-09-13T06:07:20.526 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-09-13T06:07:20.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-13T06:07:20.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:20.605 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:07:20.656 INFO:teuthology.orchestra.run.smithi130.stdout:client6898 2023-09-13T06:07:20.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:20.657 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client6898/osdmap') 2023-09-13T06:07:20.720 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 126 barrier 126 flags 0x588000 2023-09-13T06:07:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:20.721 INFO:teuthology.orchestra.run.smithi130.stdout:osd0 (1)172.21.15.130:6801 100% (exists, up) 100% -1 2023-09-13T06:07:20.722 INFO:teuthology.orchestra.run.smithi130.stdout:osd1 (1)172.21.15.130:6817 100% (exists, up) 100% -1 2023-09-13T06:07:20.722 INFO:teuthology.orchestra.run.smithi130.stdout:osd2 (1)172.21.15.130:6809 100% (exists, up) 100% -1 2023-09-13T06:07:20.722 INFO:teuthology.orchestra.run.smithi130.stdout:osd3 (1)172.21.15.130:6812 100% (exists, up) 100% -1 2023-09-13T06:07:20.722 INFO:teuthology.orchestra.run.smithi130.stdout:osd4 (1)172.21.15.164:6801 100% (exists, up) 100% -1 2023-09-13T06:07:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:osd5 (1)172.21.15.164:6809 100% (exists, up) 100% -1 2023-09-13T06:07:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:osd6 (1)172.21.15.164:6817 100% (exists, up) 100% -1 2023-09-13T06:07:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:osd7 (1)172.21.15.164:6825 100% (exists, up) 100% -1 2023-09-13T06:07:20.724 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records in 2023-09-13T06:07:20.724 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records out 2023-09-13T06:07:20.725 INFO:teuthology.orchestra.run.smithi130.stderr:803 bytes copied, 6.6498e-05 s, 12.1 MB/s 2023-09-13T06:07:20.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:20.725 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:07:20.779 INFO:teuthology.orchestra.run.smithi130.stdout:client6898 2023-09-13T06:07:20.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:20.780 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/33902c8f-11a4-444c-a37a-ca3bab8415c5.client6898/osdmap') 2023-09-13T06:07:20.840 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 126 barrier 126 flags 0x588000 2023-09-13T06:07:20.841 INFO:teuthology.orchestra.run.smithi130.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:20.841 INFO:teuthology.orchestra.run.smithi130.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:20.841 INFO:teuthology.orchestra.run.smithi130.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-09-13T06:07:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:osd0 (1)172.21.15.130:6801 100% (exists, up) 100% -1 2023-09-13T06:07:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:osd1 (1)172.21.15.130:6817 100% (exists, up) 100% -1 2023-09-13T06:07:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:osd2 (1)172.21.15.130:6809 100% (exists, up) 100% -1 2023-09-13T06:07:20.842 INFO:teuthology.orchestra.run.smithi130.stdout:osd3 (1)172.21.15.130:6812 100% (exists, up) 100% -1 2023-09-13T06:07:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:osd4 (1)172.21.15.164:6801 100% (exists, up) 100% -1 2023-09-13T06:07:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:osd5 (1)172.21.15.164:6809 100% (exists, up) 100% -1 2023-09-13T06:07:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:osd6 (1)172.21.15.164:6817 100% (exists, up) 100% -1 2023-09-13T06:07:20.843 INFO:teuthology.orchestra.run.smithi130.stdout:osd7 (1)172.21.15.164:6825 100% (exists, up) 100% -1 2023-09-13T06:07:20.844 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records in 2023-09-13T06:07:20.844 INFO:teuthology.orchestra.run.smithi130.stderr:1+1 records out 2023-09-13T06:07:20.845 INFO:teuthology.orchestra.run.smithi130.stderr:803 bytes copied, 6.6076e-05 s, 12.2 MB/s 2023-09-13T06:07:20.845 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-13T06:07:20.845 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:07:20.846 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:07:20.935 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:07:20.993 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:07:20.993 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:07:20.994 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:21.003 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:07:21.004 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:21.052 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:21.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5921c08640 1 Processor -- start 2023-09-13T06:07:21.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5921c08640 1 -- start start 2023-09-13T06:07:21.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5921c08640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f591c15af40 0x7f591c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5921c08640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c06c890 con 0x7f591c0cc3f0 2023-09-13T06:07:21.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5921c08640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c06cb70 con 0x7f591c157980 2023-09-13T06:07:21.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5921c08640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591c06de70 con 0x7f591c15af40 2023-09-13T06:07:21.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5913fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f591c0cc3f0 0x7f591c0ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48294/0 (socket says 172.21.15.130:48294) 2023-09-13T06:07:21.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5913fff640 1 -- 172.21.15.130:0/3137811769 learned_addr learned my addr 172.21.15.130:0/3137811769 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:21.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5921407640 1 --2- 172.21.15.130:0/3137811769 >> v2:172.21.15.164:3300/0 conn(0x7f591c15af40 0x7f591c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708159000 0 0) 0x7f591c06c890 con 0x7f591c0cc3f0 2023-09-13T06:07:21.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5904005740 con 0x7f591c0cc3f0 2023-09-13T06:07:21.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313668831 0 0) 0x7f591c06cb70 con 0x7f591c157980 2023-09-13T06:07:21.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f591c06c890 con 0x7f591c157980 2023-09-13T06:07:21.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2970732139 0 0) 0x7f5904005740 con 0x7f591c0cc3f0 2023-09-13T06:07:21.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 >> v2:172.21.15.164:3300/0 conn(0x7f591c15af40 msgr2=0x7f591c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:21.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 --2- 172.21.15.130:0/3137811769 >> v2:172.21.15.164:3300/0 conn(0x7f591c15af40 0x7f591c06d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 >> v1:172.21.15.164:6789/0 conn(0x7f591c157980 legacy=0x7f591c0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c06ce50 con 0x7f591c0cc3f0 2023-09-13T06:07:21.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f590c001680 con 0x7f591c0cc3f0 2023-09-13T06:07:21.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5921407640 1 --2- 172.21.15.130:0/3137811769 >> v2:172.21.15.164:3300/0 conn(0x7f591c15af40 0x7f591c06d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:21.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 >> v1:172.21.15.130:6789/0 conn(0x7f591c0cc3f0 legacy=0x7f591c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 --2- 172.21.15.130:0/3137811769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5904005d90 0x7f5904006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 --2- 172.21.15.130:0/3137811769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59040069e0 0x7f5904006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 --2- 172.21.15.130:0/3137811769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59040073a0 0x7f590400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c06de70 con 0x7f59040069e0 2023-09-13T06:07:21.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590400e2a0 con 0x7f59040073a0 2023-09-13T06:07:21.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590400e460 con 0x7f5904005d90 2023-09-13T06:07:21.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5913fff640 1 --2- 172.21.15.130:0/3137811769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59040069e0 0x7f5904006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5913fff640 1 -- 172.21.15.130:0/3137811769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5904005d90 msgr2=0x7f5904006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:21.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5913fff640 1 --2- 172.21.15.130:0/3137811769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5904005d90 0x7f5904006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5913fff640 1 -- 172.21.15.130:0/3137811769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59040073a0 msgr2=0x7f590400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:21.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5913fff640 1 --2- 172.21.15.130:0/3137811769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59040073a0 0x7f590400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5921407640 1 -- 172.21.15.130:0/3137811769 reap_dead start 2023-09-13T06:07:21.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.236+0000 7f5913fff640 1 -- 172.21.15.130:0/3137811769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904005740 con 0x7f59040069e0 2023-09-13T06:07:21.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.240+0000 7f5913fff640 1 --2- 172.21.15.130:0/3137811769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59040069e0 0x7f5904006e60 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c160 tx=0x7f590c01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e280b15354be47 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:21.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.240+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0058e0 con 0x7f59040069e0 2023-09-13T06:07:21.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.240+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c005a40 con 0x7f59040069e0 2023-09-13T06:07:21.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.240+0000 7f59137fe640 1 -- 172.21.15.130:0/3137811769 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c005e50 con 0x7f59040069e0 2023-09-13T06:07:21.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.240+0000 7f5921c08640 1 -- 172.21.15.130:0/3137811769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59040069e0 msgr2=0x7f5904006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.240+0000 7f5921c08640 1 --2- 172.21.15.130:0/3137811769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59040069e0 0x7f5904006e60 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c160 tx=0x7f590c01cba0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.240+0000 7f5921c08640 1 -- 172.21.15.130:0/3137811769 shutdown_connections 2023-09-13T06:07:21.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.240+0000 7f5921c08640 1 --2- 172.21.15.130:0/3137811769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59040069e0 0x7f5904006e60 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.240+0000 7f5921c08640 1 -- 172.21.15.130:0/3137811769 >> 172.21.15.130:0/3137811769 conn(0x7f591c065b60 msgr2=0x7f591c0aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:21.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.240+0000 7f5921c08640 1 -- 172.21.15.130:0/3137811769 shutdown_connections 2023-09-13T06:07:21.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.240+0000 7f5921c08640 1 -- 172.21.15.130:0/3137811769 wait complete. 2023-09-13T06:07:21.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921c08640 1 Processor -- start 2023-09-13T06:07:21.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921c08640 1 -- start start 2023-09-13T06:07:21.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921c08640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59040069e0 0x7f591c1466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921c08640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f591c157d60 0x7f591c159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921c08640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f591c155840 0x7f591c155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921c08640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c156200 con 0x7f591c157d60 2023-09-13T06:07:21.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921c08640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c158de0 con 0x7f59040069e0 2023-09-13T06:07:21.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921c08640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c158260 con 0x7f591c155840 2023-09-13T06:07:21.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5913fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f591c157d60 0x7f591c159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5913fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f591c157d60 0x7f591c159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56650/0 (socket says 172.21.15.130:56650) 2023-09-13T06:07:21.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5913fff640 1 -- 172.21.15.130:0/1058533916 learned_addr learned my addr 172.21.15.130:0/1058533916 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:21.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5920c06640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59040069e0 0x7f591c1466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921407640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f591c155840 0x7f591c155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5913fff640 1 -- 172.21.15.130:0/1058533916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f591c155840 msgr2=0x7f591c155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5913fff640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f591c155840 0x7f591c155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5913fff640 1 -- 172.21.15.130:0/1058533916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59040069e0 msgr2=0x7f591c1466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5913fff640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59040069e0 0x7f591c1466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5913fff640 1 -- 172.21.15.130:0/1058533916 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c158540 con 0x7f591c157d60 2023-09-13T06:07:21.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921407640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f591c155840 0x7f591c155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:21.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5913fff640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f591c157d60 0x7f591c159830 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c160 tx=0x7f5904007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:21.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f59117fa640 1 -- 172.21.15.130:0/1058533916 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0a5cb0 con 0x7f591c157d60 2023-09-13T06:07:21.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f59117fa640 1 -- 172.21.15.130:0/1058533916 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c0a5e10 con 0x7f591c157d60 2023-09-13T06:07:21.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f59117fa640 1 -- 172.21.15.130:0/1058533916 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0049f0 con 0x7f591c157d60 2023-09-13T06:07:21.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921c08640 1 -- 172.21.15.130:0/1058533916 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c158820 con 0x7f591c157d60 2023-09-13T06:07:21.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.244+0000 7f5921c08640 1 -- 172.21.15.130:0/1058533916 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c159d70 con 0x7f591c157d60 2023-09-13T06:07:21.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.248+0000 7f5921c08640 1 -- 172.21.15.130:0/1058533916 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c1ee6e0 con 0x7f591c157d60 2023-09-13T06:07:21.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.248+0000 7f59117fa640 1 -- 172.21.15.130:0/1058533916 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f590c004b50 con 0x7f591c157d60 2023-09-13T06:07:21.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.248+0000 7f59117fa640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5908065b50 0x7f5908068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.248+0000 7f59117fa640 1 -- 172.21.15.130:0/1058533916 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f590c11c8e0 con 0x7f591c157d60 2023-09-13T06:07:21.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.248+0000 7f5920c06640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5908065b50 0x7f5908068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.248+0000 7f5920c06640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5908065b50 0x7f5908068010 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f591c0b33a0 tx=0x7f591800c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:21.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.252+0000 7f59117fa640 1 -- 172.21.15.130:0/1058533916 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f590c0ea230 con 0x7f591c157d60 2023-09-13T06:07:21.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.404+0000 7f5921c08640 1 -- 172.21.15.130:0/1058533916 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f591c0618a0 con 0x7f591c157d60 2023-09-13T06:07:21.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.404+0000 7f59117fa640 1 -- 172.21.15.130:0/1058533916 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16563 (secure 0 0 0) 0x7f590c0bc090 con 0x7f591c157d60 2023-09-13T06:07:21.408 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:21.408 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":126,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:19.406296+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:05.156883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:06.213714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:21.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 -- 172.21.15.130:0/1058533916 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5908065b50 msgr2=0x7f5908068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5908065b50 0x7f5908068010 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f591c0b33a0 tx=0x7f591800c040 comp rx=0 tx=0).stop 2023-09-13T06:07:21.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 -- 172.21.15.130:0/1058533916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f591c157d60 msgr2=0x7f591c159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f591c157d60 0x7f591c159830 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c160 tx=0x7f5904007a10 comp rx=0 tx=0).stop 2023-09-13T06:07:21.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 -- 172.21.15.130:0/1058533916 shutdown_connections 2023-09-13T06:07:21.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5908065b50 0x7f5908068010 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f591c155840 0x7f591c155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f591c157d60 0x7f591c159830 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 --2- 172.21.15.130:0/1058533916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59040069e0 0x7f591c1466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 -- 172.21.15.130:0/1058533916 >> 172.21.15.130:0/1058533916 conn(0x7f591c065b60 msgr2=0x7f591c156910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:21.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 -- 172.21.15.130:0/1058533916 shutdown_connections 2023-09-13T06:07:21.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.408+0000 7f5921c08640 1 -- 172.21.15.130:0/1058533916 wait complete. 2023-09-13T06:07:21.430 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:07:05.156883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:07:06.213714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:07:21.430 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:07:21.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.568+0000 7fb8f9e34640 1 Processor -- start 2023-09-13T06:07:21.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.568+0000 7fb8f9e34640 1 -- start start 2023-09-13T06:07:21.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f9e34640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb8f4144d70 0x7fb8f40ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f9e34640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f40b2150 con 0x7fb8f40b1b70 2023-09-13T06:07:21.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f9e34640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f40cdd90 con 0x7fb8f40b2780 2023-09-13T06:07:21.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f9e34640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f40b2430 con 0x7fb8f4144d70 2023-09-13T06:07:21.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f37fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb8f4144d70 0x7fb8f40ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f3fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb8f40b1b70 0x7fb8f406ca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48300/0 (socket says 172.21.15.130:48300) 2023-09-13T06:07:21.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f3fff640 1 -- 172.21.15.130:0/397053734 learned_addr learned my addr 172.21.15.130:0/397053734 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:21.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f37fe640 1 -- 172.21.15.130:0/397053734 >> v1:172.21.15.164:6789/0 conn(0x7fb8f40b2780 legacy=0x7fb8f40b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:21.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f37fe640 1 -- 172.21.15.130:0/397053734 >> v1:172.21.15.130:6789/0 conn(0x7fb8f40b1b70 legacy=0x7fb8f406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f2ffd640 1 -- 172.21.15.130:0/397053734 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506828472 0 0) 0x7fb8f40b2150 con 0x7fb8f40b1b70 2023-09-13T06:07:21.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f37fe640 1 -- 172.21.15.130:0/397053734 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f40ce070 con 0x7fb8f4144d70 2023-09-13T06:07:21.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.572+0000 7fb8f37fe640 1 --2- 172.21.15.130:0/397053734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8f4144d70 0x7fb8f40ce870 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40097c0 tx=0x7fb8e401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb4c5a6d768670e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:21.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f2ffd640 1 -- 172.21.15.130:0/397053734 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40ab600 con 0x7fb8f4144d70 2023-09-13T06:07:21.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f2ffd640 1 -- 172.21.15.130:0/397053734 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e40a7050 con 0x7fb8f4144d70 2023-09-13T06:07:21.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f2ffd640 1 -- 172.21.15.130:0/397053734 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40ab980 con 0x7fb8f4144d70 2023-09-13T06:07:21.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 -- 172.21.15.130:0/397053734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8f4144d70 msgr2=0x7fb8f40ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 --2- 172.21.15.130:0/397053734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8f4144d70 0x7fb8f40ce870 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40097c0 tx=0x7fb8e401c440 comp rx=0 tx=0).stop 2023-09-13T06:07:21.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 -- 172.21.15.130:0/397053734 shutdown_connections 2023-09-13T06:07:21.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 --2- 172.21.15.130:0/397053734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8f4144d70 0x7fb8f40ce870 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 -- 172.21.15.130:0/397053734 >> 172.21.15.130:0/397053734 conn(0x7fb8f4065990 msgr2=0x7fb8f4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:21.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 -- 172.21.15.130:0/397053734 shutdown_connections 2023-09-13T06:07:21.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 -- 172.21.15.130:0/397053734 wait complete. 2023-09-13T06:07:21.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 Processor -- start 2023-09-13T06:07:21.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 -- start start 2023-09-13T06:07:21.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8f40b1b70 0x7fb8f413b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8f40b2780 0x7fb8f413ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8f4144d70 0x7fb8f414f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4159aa0 con 0x7fb8f4144d70 2023-09-13T06:07:21.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f414fa50 con 0x7fb8f40b2780 2023-09-13T06:07:21.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f9e34640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f413b380 con 0x7fb8f40b1b70 2023-09-13T06:07:21.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8f4144d70 0x7fb8f414f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8f4144d70 0x7fb8f414f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56666/0 (socket says 172.21.15.130:56666) 2023-09-13T06:07:21.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.576+0000 7fb8f3fff640 1 -- 172.21.15.130:0/1368467209 learned_addr learned my addr 172.21.15.130:0/1368467209 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:21.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f37fe640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8f40b1b70 0x7fb8f413b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8ebfff640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8f40b2780 0x7fb8f413ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f3fff640 1 -- 172.21.15.130:0/1368467209 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8f40b1b70 msgr2=0x7fb8f413b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f3fff640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8f40b1b70 0x7fb8f413b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f3fff640 1 -- 172.21.15.130:0/1368467209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8f40b2780 msgr2=0x7fb8f413ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f3fff640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8f40b2780 0x7fb8f413ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f3fff640 1 -- 172.21.15.130:0/1368467209 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4009420 con 0x7fb8f4144d70 2023-09-13T06:07:21.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f37fe640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8f40b1b70 0x7fb8f413b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:21.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f3fff640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8f4144d70 0x7fb8f414f510 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00c810 tx=0x7fb8ec00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:21.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f0ff9640 1 -- 172.21.15.130:0/1368467209 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00a640 con 0x7fb8f4144d70 2023-09-13T06:07:21.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f0ff9640 1 -- 172.21.15.130:0/1368467209 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec00a7c0 con 0x7fb8f4144d70 2023-09-13T06:07:21.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f0ff9640 1 -- 172.21.15.130:0/1368467209 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00ab70 con 0x7fb8f4144d70 2023-09-13T06:07:21.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f9e34640 1 -- 172.21.15.130:0/1368467209 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f4159cf0 con 0x7fb8f4144d70 2023-09-13T06:07:21.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f9e34640 1 -- 172.21.15.130:0/1368467209 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f415a2b0 con 0x7fb8f4144d70 2023-09-13T06:07:21.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f9e34640 1 -- 172.21.15.130:0/1368467209 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f415a4d0 con 0x7fb8f4144d70 2023-09-13T06:07:21.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.580+0000 7fb8f0ff9640 1 -- 172.21.15.130:0/1368467209 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb8ec00acd0 con 0x7fb8f4144d70 2023-09-13T06:07:21.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.584+0000 7fb8f0ff9640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8d4065b20 0x7fb8d4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.584+0000 7fb8f0ff9640 1 -- 172.21.15.130:0/1368467209 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8ec0827b0 con 0x7fb8f4144d70 2023-09-13T06:07:21.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.584+0000 7fb8f37fe640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8d4065b20 0x7fb8d4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.584+0000 7fb8f37fe640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8d4065b20 0x7fb8d4067fe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40ad000 tx=0x7fb8e40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:21.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.588+0000 7fb8f0ff9640 1 -- 172.21.15.130:0/1368467209 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb8ec050100 con 0x7fb8f4144d70 2023-09-13T06:07:21.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.732+0000 7fb8f9e34640 1 -- 172.21.15.130:0/1368467209 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8f40618a0 con 0x7fb8f4144d70 2023-09-13T06:07:21.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f0ff9640 1 -- 172.21.15.130:0/1368467209 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8ec0180a0 con 0x7fb8f4144d70 2023-09-13T06:07:21.737 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:07:21.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 -- 172.21.15.130:0/1368467209 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8d4065b20 msgr2=0x7fb8d4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8d4065b20 0x7fb8d4067fe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40ad000 tx=0x7fb8e40a6000 comp rx=0 tx=0).stop 2023-09-13T06:07:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 -- 172.21.15.130:0/1368467209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8f4144d70 msgr2=0x7fb8f414f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8f4144d70 0x7fb8f414f510 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00c810 tx=0x7fb8ec00ccd0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 -- 172.21.15.130:0/1368467209 shutdown_connections 2023-09-13T06:07:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb8d4065b20 0x7fb8d4067fe0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8f40b2780 0x7fb8f413ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8f4144d70 0x7fb8f414f510 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 --2- 172.21.15.130:0/1368467209 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8f40b1b70 0x7fb8f413b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 -- 172.21.15.130:0/1368467209 >> 172.21.15.130:0/1368467209 conn(0x7fb8f4065990 msgr2=0x7fb8f413c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 -- 172.21.15.130:0/1368467209 shutdown_connections 2023-09-13T06:07:21.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.736+0000 7fb8f9e34640 1 -- 172.21.15.130:0/1368467209 wait complete. 2023-09-13T06:07:21.757 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:07:21.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff330d37640 1 Processor -- start 2023-09-13T06:07:21.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff330d37640 1 -- start start 2023-09-13T06:07:21.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff330d37640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff32c0d0d10 0x7ff32c1619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff330d37640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c15dd40 con 0x7ff32c0d2cd0 2023-09-13T06:07:21.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff330d37640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c15e020 con 0x7ff32c15ae10 2023-09-13T06:07:21.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff330d37640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32c15e300 con 0x7ff32c0d0d10 2023-09-13T06:07:21.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff321d9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff32c0d2cd0 0x7ff32c1612a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48310/0 (socket says 172.21.15.130:48310) 2023-09-13T06:07:21.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff321d9b640 1 -- 172.21.15.130:0/1792233387 learned_addr learned my addr 172.21.15.130:0/1792233387 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:21.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710685256 0 0) 0x7ff32c15dd40 con 0x7ff32c0d2cd0 2023-09-13T06:07:21.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff318003530 con 0x7ff32c0d2cd0 2023-09-13T06:07:21.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff32ad9d640 1 --2- 172.21.15.130:0/1792233387 >> v2:172.21.15.164:3300/0 conn(0x7ff32c0d0d10 0x7ff32c1619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1754711631 0 0) 0x7ff318003530 con 0x7ff32c0d2cd0 2023-09-13T06:07:21.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 >> v2:172.21.15.164:3300/0 conn(0x7ff32c0d0d10 msgr2=0x7ff32c1619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:21.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 --2- 172.21.15.130:0/1792233387 >> v2:172.21.15.164:3300/0 conn(0x7ff32c0d0d10 0x7ff32c1619b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 >> v1:172.21.15.164:6789/0 conn(0x7ff32c15ae10 legacy=0x7ff32c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c15e5e0 con 0x7ff32c0d2cd0 2023-09-13T06:07:21.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7ff314001680 con 0x7ff32c0d2cd0 2023-09-13T06:07:21.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 >> v1:172.21.15.130:6789/0 conn(0x7ff32c0d2cd0 legacy=0x7ff32c1612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff318003a40 0x7ff318003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3180047d0 0x7ff318004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3180052b0 0x7ff31800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c15e300 con 0x7ff3180047d0 2023-09-13T06:07:21.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31800c180 con 0x7ff318003a40 2023-09-13T06:07:21.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.896+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31800c340 con 0x7ff3180052b0 2023-09-13T06:07:21.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff321d9b640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3180047d0 0x7ff318004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff32a59c640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff318003a40 0x7ff318003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff32ad9d640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3180052b0 0x7ff31800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff321d9b640 1 -- 172.21.15.130:0/1792233387 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3180052b0 msgr2=0x7ff31800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:21.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff321d9b640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3180052b0 0x7ff31800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff321d9b640 1 -- 172.21.15.130:0/1792233387 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff318003a40 msgr2=0x7ff318003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:21.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff321d9b640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff318003a40 0x7ff318003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff32ad9d640 1 -- 172.21.15.130:0/1792233387 reap_dead start 2023-09-13T06:07:21.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff321d9b640 1 -- 172.21.15.130:0/1792233387 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff318003530 con 0x7ff3180047d0 2023-09-13T06:07:21.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff32a59c640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff318003a40 0x7ff318003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:21.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff321d9b640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3180047d0 0x7ff318004c50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff31400c0e0 tx=0x7ff31401cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb37009fc33adb7a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:21.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314005ae0 con 0x7ff3180047d0 2023-09-13T06:07:21.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314005c60 con 0x7ff3180047d0 2023-09-13T06:07:21.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.900+0000 7ff329d9b640 1 -- 172.21.15.130:0/1792233387 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3140a57e0 con 0x7ff3180047d0 2023-09-13T06:07:21.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 -- 172.21.15.130:0/1792233387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3180047d0 msgr2=0x7ff318004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3180047d0 0x7ff318004c50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff31400c0e0 tx=0x7ff31401cae0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 -- 172.21.15.130:0/1792233387 shutdown_connections 2023-09-13T06:07:21.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 --2- 172.21.15.130:0/1792233387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3180047d0 0x7ff318004c50 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 -- 172.21.15.130:0/1792233387 >> 172.21.15.130:0/1792233387 conn(0x7ff32c065990 msgr2=0x7ff32c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:21.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 -- 172.21.15.130:0/1792233387 shutdown_connections 2023-09-13T06:07:21.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 -- 172.21.15.130:0/1792233387 wait complete. 2023-09-13T06:07:21.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 Processor -- start 2023-09-13T06:07:21.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 -- start start 2023-09-13T06:07:21.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3180047d0 0x7ff32c15fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff32c1600b0 0x7ff32c0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff32c0c91a0 0x7ff32c1f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c160530 con 0x7ff32c0c91a0 2023-09-13T06:07:21.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c155fe0 con 0x7ff3180047d0 2023-09-13T06:07:21.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.904+0000 7ff330d37640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c1562c0 con 0x7ff32c1600b0 2023-09-13T06:07:21.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff32ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff32c0c91a0 0x7ff32c1f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff32ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff32c0c91a0 0x7ff32c1f5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56680/0 (socket says 172.21.15.130:56680) 2023-09-13T06:07:21.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff32ad9d640 1 -- 172.21.15.130:0/2790008055 learned_addr learned my addr 172.21.15.130:0/2790008055 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:21.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff32a59c640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3180047d0 0x7ff32c15fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff321d9b640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff32c1600b0 0x7ff32c0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff32ad9d640 1 -- 172.21.15.130:0/2790008055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff32c1600b0 msgr2=0x7ff32c0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff32ad9d640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff32c1600b0 0x7ff32c0c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff32ad9d640 1 -- 172.21.15.130:0/2790008055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3180047d0 msgr2=0x7ff32c15fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:21.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff32ad9d640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3180047d0 0x7ff32c15fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:21.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff32ad9d640 1 -- 172.21.15.130:0/2790008055 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c1565a0 con 0x7ff32c0c91a0 2023-09-13T06:07:21.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff321d9b640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff32c1600b0 0x7ff32c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:21.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff32ad9d640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff32c0c91a0 0x7ff32c1f5960 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7ff32c161f50 tx=0x7ff32400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff3237fe640 1 -- 172.21.15.130:0/2790008055 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32400e040 con 0x7ff32c0c91a0 2023-09-13T06:07:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff3237fe640 1 -- 172.21.15.130:0/2790008055 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32400f040 con 0x7ff32c0c91a0 2023-09-13T06:07:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff3237fe640 1 -- 172.21.15.130:0/2790008055 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff324015430 con 0x7ff32c0c91a0 2023-09-13T06:07:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff330d37640 1 -- 172.21.15.130:0/2790008055 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c156880 con 0x7ff32c0c91a0 2023-09-13T06:07:21.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff330d37640 1 -- 172.21.15.130:0/2790008055 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c0c9620 con 0x7ff32c0c91a0 2023-09-13T06:07:21.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff330d37640 1 -- 172.21.15.130:0/2790008055 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c0618a0 con 0x7ff32c0c91a0 2023-09-13T06:07:21.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff3237fe640 1 -- 172.21.15.130:0/2790008055 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff324015590 con 0x7ff32c0c91a0 2023-09-13T06:07:21.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff3237fe640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff30c065b20 0x7ff30c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:21.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff3237fe640 1 -- 172.21.15.130:0/2790008055 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff324083a20 con 0x7ff32c0c91a0 2023-09-13T06:07:21.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.908+0000 7ff32a59c640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff30c065b20 0x7ff30c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:21.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.912+0000 7ff32a59c640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff30c065b20 0x7ff30c067fe0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff31c000c10 tx=0x7ff31c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:21.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:21.912+0000 7ff3237fe640 1 -- 172.21.15.130:0/2790008055 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff324051400 con 0x7ff32c0c91a0 2023-09-13T06:07:22.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.060+0000 7ff330d37640 1 -- 172.21.15.130:0/2790008055 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff32c0b60d0 con 0x7ff32c0c91a0 2023-09-13T06:07:22.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.060+0000 7ff3237fe640 1 -- 172.21.15.130:0/2790008055 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff324054a20 con 0x7ff32c0c91a0 2023-09-13T06:07:22.063 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:07:22.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 -- 172.21.15.130:0/2790008055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff30c065b20 msgr2=0x7ff30c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff30c065b20 0x7ff30c067fe0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff31c000c10 tx=0x7ff31c009040 comp rx=0 tx=0).stop 2023-09-13T06:07:22.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 -- 172.21.15.130:0/2790008055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff32c0c91a0 msgr2=0x7ff32c1f5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff32c0c91a0 0x7ff32c1f5960 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7ff32c161f50 tx=0x7ff32400f580 comp rx=0 tx=0).stop 2023-09-13T06:07:22.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 -- 172.21.15.130:0/2790008055 shutdown_connections 2023-09-13T06:07:22.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff30c065b20 0x7ff30c067fe0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff32c0c91a0 0x7ff32c1f5960 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff32c1600b0 0x7ff32c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 --2- 172.21.15.130:0/2790008055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3180047d0 0x7ff32c15fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 -- 172.21.15.130:0/2790008055 >> 172.21.15.130:0/2790008055 conn(0x7ff32c065990 msgr2=0x7ff32c0b7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:22.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 -- 172.21.15.130:0/2790008055 shutdown_connections 2023-09-13T06:07:22.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.064+0000 7ff330d37640 1 -- 172.21.15.130:0/2790008055 wait complete. 2023-09-13T06:07:22.084 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:07:22.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fce05493640 1 Processor -- start 2023-09-13T06:07:22.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fce05493640 1 -- start start 2023-09-13T06:07:22.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fce05493640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fce0015ae10 0x7fce000d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fce05493640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce001619b0 0x7fce000cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fce05493640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0015dd40 con 0x7fce000d2b00 2023-09-13T06:07:22.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fce05493640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce00161e40 con 0x7fce0015ae10 2023-09-13T06:07:22.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fce05493640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0015e020 con 0x7fce001619b0 2023-09-13T06:07:22.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fcdfeffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fce0015ae10 0x7fce000d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fcdfeffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fce0015ae10 0x7fce000d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56696/0 (socket says 172.21.15.130:56696) 2023-09-13T06:07:22.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fcdfeffd640 1 -- 172.21.15.130:0/2757097616 learned_addr learned my addr 172.21.15.130:0/2757097616 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:22.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fcdfeffd640 1 -- 172.21.15.130:0/2757097616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce001619b0 msgr2=0x7fce000cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:22.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fcdff7fe640 1 --2- 172.21.15.130:0/2757097616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce001619b0 0x7fce000cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fcdfeffd640 1 --2- 172.21.15.130:0/2757097616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce001619b0 0x7fce000cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fcdfeffd640 1 -- 172.21.15.130:0/2757097616 >> v1:172.21.15.164:6789/0 conn(0x7fce000d2b00 legacy=0x7fce001612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:22.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fcdfeffd640 1 -- 172.21.15.130:0/2757097616 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0015e300 con 0x7fce0015ae10 2023-09-13T06:07:22.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.224+0000 7fcdff7fe640 1 --2- 172.21.15.130:0/2757097616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce001619b0 0x7fce000cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:22.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fcdfeffd640 1 --2- 172.21.15.130:0/2757097616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce0015ae10 0x7fce000d25c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0009870 tx=0x7fcdf001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c55e72b26217a63 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:22.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fcdfe7fc640 1 -- 172.21.15.130:0/2757097616 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00ad640 con 0x7fce0015ae10 2023-09-13T06:07:22.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fcdfe7fc640 1 -- 172.21.15.130:0/2757097616 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf00ad7a0 con 0x7fce0015ae10 2023-09-13T06:07:22.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fcdfe7fc640 1 -- 172.21.15.130:0/2757097616 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00adb30 con 0x7fce0015ae10 2023-09-13T06:07:22.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fce05493640 1 -- 172.21.15.130:0/2757097616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce0015ae10 msgr2=0x7fce000d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fce05493640 1 --2- 172.21.15.130:0/2757097616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce0015ae10 0x7fce000d25c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0009870 tx=0x7fcdf001c3b0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fce05493640 1 -- 172.21.15.130:0/2757097616 shutdown_connections 2023-09-13T06:07:22.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fce05493640 1 --2- 172.21.15.130:0/2757097616 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce001619b0 0x7fce000cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fce05493640 1 --2- 172.21.15.130:0/2757097616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce0015ae10 0x7fce000d25c0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fce05493640 1 -- 172.21.15.130:0/2757097616 >> 172.21.15.130:0/2757097616 conn(0x7fce00065990 msgr2=0x7fce00065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:22.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fce05493640 1 -- 172.21.15.130:0/2757097616 shutdown_connections 2023-09-13T06:07:22.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.228+0000 7fce05493640 1 -- 172.21.15.130:0/2757097616 wait complete. 2023-09-13T06:07:22.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fce05493640 1 Processor -- start 2023-09-13T06:07:22.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fce05493640 1 -- start start 2023-09-13T06:07:22.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fce05493640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce000d2b00 0x7fce00154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fce05493640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce0015ae10 0x7fce00151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fce05493640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce001619b0 0x7fce00152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fce05493640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce001603d0 con 0x7fce001619b0 2023-09-13T06:07:22.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fce05493640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0015f7c0 con 0x7fce000d2b00 2023-09-13T06:07:22.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fce05493640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0015faa0 con 0x7fce0015ae10 2023-09-13T06:07:22.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdff7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce001619b0 0x7fce00152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdfeffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce000d2b00 0x7fce00154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdff7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce001619b0 0x7fce00152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56710/0 (socket says 172.21.15.130:56710) 2023-09-13T06:07:22.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdff7fe640 1 -- 172.21.15.130:0/4090494164 learned_addr learned my addr 172.21.15.130:0/4090494164 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:22.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdf7fff640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce0015ae10 0x7fce00151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdff7fe640 1 -- 172.21.15.130:0/4090494164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce0015ae10 msgr2=0x7fce00151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdff7fe640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce0015ae10 0x7fce00151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdff7fe640 1 -- 172.21.15.130:0/4090494164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce000d2b00 msgr2=0x7fce00154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdff7fe640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce000d2b00 0x7fce00154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdff7fe640 1 -- 172.21.15.130:0/4090494164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf00094d0 con 0x7fce001619b0 2023-09-13T06:07:22.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdff7fe640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce001619b0 0x7fce00152090 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800cd50 tx=0x7fcdf800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:22.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdf77fe640 1 -- 172.21.15.130:0/4090494164 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800f680 con 0x7fce001619b0 2023-09-13T06:07:22.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdf77fe640 1 -- 172.21.15.130:0/4090494164 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf800f800 con 0x7fce001619b0 2023-09-13T06:07:22.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fcdf77fe640 1 -- 172.21.15.130:0/4090494164 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800fbb0 con 0x7fce001619b0 2023-09-13T06:07:22.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fce05493640 1 -- 172.21.15.130:0/4090494164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0015fd80 con 0x7fce001619b0 2023-09-13T06:07:22.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fce05493640 1 -- 172.21.15.130:0/4090494164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce00155260 con 0x7fce001619b0 2023-09-13T06:07:22.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.232+0000 7fce05493640 1 -- 172.21.15.130:0/4090494164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce000618a0 con 0x7fce001619b0 2023-09-13T06:07:22.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.236+0000 7fcdf77fe640 1 -- 172.21.15.130:0/4090494164 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcdf800b040 con 0x7fce001619b0 2023-09-13T06:07:22.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.236+0000 7fcdf77fe640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b50 0x7fcde0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.236+0000 7fcdf77fe640 1 -- 172.21.15.130:0/4090494164 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdf8083c50 con 0x7fce001619b0 2023-09-13T06:07:22.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.236+0000 7fcdfeffd640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b50 0x7fcde0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.236+0000 7fcdfeffd640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b50 0x7fcde0068010 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00af000 tx=0x7fcdf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:22.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.240+0000 7fcdf77fe640 1 -- 172.21.15.130:0/4090494164 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcdf80515b0 con 0x7fce001619b0 2023-09-13T06:07:22.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.388+0000 7fce05493640 1 -- 172.21.15.130:0/4090494164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce000b68a0 con 0x7fce001619b0 2023-09-13T06:07:22.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.388+0000 7fcdf77fe640 1 -- 172.21.15.130:0/4090494164 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcdf801d0a0 con 0x7fce001619b0 2023-09-13T06:07:22.391 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:07:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 -- 172.21.15.130:0/4090494164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b50 msgr2=0x7fcde0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b50 0x7fcde0068010 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00af000 tx=0x7fcdf0008040 comp rx=0 tx=0).stop 2023-09-13T06:07:22.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 -- 172.21.15.130:0/4090494164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce001619b0 msgr2=0x7fce00152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce001619b0 0x7fce00152090 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800cd50 tx=0x7fcdf800a650 comp rx=0 tx=0).stop 2023-09-13T06:07:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 -- 172.21.15.130:0/4090494164 shutdown_connections 2023-09-13T06:07:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcde0065b50 0x7fcde0068010 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce001619b0 0x7fce00152090 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce0015ae10 0x7fce00151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 --2- 172.21.15.130:0/4090494164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce000d2b00 0x7fce00154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 -- 172.21.15.130:0/4090494164 >> 172.21.15.130:0/4090494164 conn(0x7fce00065990 msgr2=0x7fce00160f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 -- 172.21.15.130:0/4090494164 shutdown_connections 2023-09-13T06:07:22.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.392+0000 7fce05493640 1 -- 172.21.15.130:0/4090494164 wait complete. 2023-09-13T06:07:22.413 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:07:22.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.552+0000 7fb0de49c640 1 Processor -- start 2023-09-13T06:07:22.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0de49c640 1 -- start start 2023-09-13T06:07:22.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0de49c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb0d8159f20 0x7fb0d80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0de49c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0d80b1d20 0x7fb0d80b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0de49c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d80ccfd0 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0de49c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d80b00f0 con 0x7fb0d8159f20 2023-09-13T06:07:22.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0de49c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80b11d0 con 0x7fb0d80b1d20 2023-09-13T06:07:22.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0d7fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb0d8159f20 0x7fb0d80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0dca39640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0d80b1d20 0x7fb0d80b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0d77fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fb0d80cdfc0 0x7fb0d80b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:52376/0 (socket says 172.21.15.130:52376) 2023-09-13T06:07:22.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0d77fe640 1 -- 172.21.15.130:0/1689679783 learned_addr learned my addr 172.21.15.130:0/1689679783 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:22.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0d6ffd640 1 -- 172.21.15.130:0/1689679783 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054019342 0 0) 0x7fb0d80ccfd0 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0d6ffd640 1 -- 172.21.15.130:0/1689679783 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0c0003530 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0dca39640 1 -- 172.21.15.130:0/1689679783 >> v2:172.21.15.164:3300/0 conn(0x7fb0d8159f20 msgr2=0x7fb0d80ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:22.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0dca39640 1 --2- 172.21.15.130:0/1689679783 >> v2:172.21.15.164:3300/0 conn(0x7fb0d8159f20 0x7fb0d80ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0dca39640 1 -- 172.21.15.130:0/1689679783 >> v1:172.21.15.164:6789/0 conn(0x7fb0d80cdfc0 legacy=0x7fb0d80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0dca39640 1 -- 172.21.15.130:0/1689679783 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d80ced90 con 0x7fb0d80b1d20 2023-09-13T06:07:22.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.556+0000 7fb0d7fff640 1 --2- 172.21.15.130:0/1689679783 >> v2:172.21.15.164:3300/0 conn(0x7fb0d8159f20 0x7fb0d80ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:22.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0dca39640 1 --2- 172.21.15.130:0/1689679783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0d80b1d20 0x7fb0d80b0c90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009d90 tx=0x7fb0d001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa6c9502d3ad02c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:22.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0d6ffd640 1 -- 172.21.15.130:0/1689679783 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00a5a10 con 0x7fb0d80b1d20 2023-09-13T06:07:22.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0d6ffd640 1 -- 172.21.15.130:0/1689679783 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d00a5b70 con 0x7fb0d80b1d20 2023-09-13T06:07:22.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0d6ffd640 1 -- 172.21.15.130:0/1689679783 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00ad440 con 0x7fb0d80b1d20 2023-09-13T06:07:22.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0de49c640 1 -- 172.21.15.130:0/1689679783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0d80b1d20 msgr2=0x7fb0d80b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0de49c640 1 --2- 172.21.15.130:0/1689679783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0d80b1d20 0x7fb0d80b0c90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009d90 tx=0x7fb0d001c950 comp rx=0 tx=0).stop 2023-09-13T06:07:22.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0de49c640 1 -- 172.21.15.130:0/1689679783 shutdown_connections 2023-09-13T06:07:22.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0de49c640 1 --2- 172.21.15.130:0/1689679783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0d80b1d20 0x7fb0d80b0c90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0de49c640 1 --2- 172.21.15.130:0/1689679783 >> v2:172.21.15.164:3300/0 conn(0x7fb0d8159f20 0x7fb0d80ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0de49c640 1 -- 172.21.15.130:0/1689679783 >> 172.21.15.130:0/1689679783 conn(0x7fb0d8065990 msgr2=0x7fb0d8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:22.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0de49c640 1 -- 172.21.15.130:0/1689679783 shutdown_connections 2023-09-13T06:07:22.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.560+0000 7fb0de49c640 1 -- 172.21.15.130:0/1689679783 wait complete. 2023-09-13T06:07:22.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0de49c640 1 Processor -- start 2023-09-13T06:07:22.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0de49c640 1 -- start start 2023-09-13T06:07:22.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0de49c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0d80b1d20 0x7fb0d8148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0de49c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0d80cdfc0 0x7fb0d81469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0de49c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0d8159f20 0x7fb0d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0de49c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d814c3f0 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0de49c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d814ba50 con 0x7fb0d80b1d20 2023-09-13T06:07:22.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0de49c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d814bd30 con 0x7fb0d8159f20 2023-09-13T06:07:22.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0d80cdfc0 0x7fb0d81469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0d80cdfc0 0x7fb0d81469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56714/0 (socket says 172.21.15.130:56714) 2023-09-13T06:07:22.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d77fe640 1 -- 172.21.15.130:0/3282407889 learned_addr learned my addr 172.21.15.130:0/3282407889 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:22.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0dca39640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0d8159f20 0x7fb0d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d7fff640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0d80b1d20 0x7fb0d8148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d77fe640 1 -- 172.21.15.130:0/3282407889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0d8159f20 msgr2=0x7fb0d806d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d77fe640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0d8159f20 0x7fb0d806d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d77fe640 1 -- 172.21.15.130:0/3282407889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0d80b1d20 msgr2=0x7fb0d8148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d77fe640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0d80b1d20 0x7fb0d8148740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d77fe640 1 -- 172.21.15.130:0/3282407889 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8009420 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d77fe640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0d80cdfc0 0x7fb0d81469a0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c450 tx=0x7fb0cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:22.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d4ff9640 1 -- 172.21.15.130:0/3282407889 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc005cf0 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d4ff9640 1 -- 172.21.15.130:0/3282407889 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc005e50 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0de49c640 1 -- 172.21.15.130:0/3282407889 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d0009a70 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0d4ff9640 1 -- 172.21.15.130:0/3282407889 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc007290 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0de49c640 1 -- 172.21.15.130:0/3282407889 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d814c810 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.564+0000 7fb0de49c640 1 -- 172.21.15.130:0/3282407889 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d814c530 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.568+0000 7fb0d4ff9640 1 -- 172.21.15.130:0/3282407889 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb0cc0073f0 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.568+0000 7fb0d4ff9640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0c4065b20 0x7fb0c4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:22.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.568+0000 7fb0d4ff9640 1 -- 172.21.15.130:0/3282407889 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0cc082770 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.568+0000 7fb0d7fff640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0c4065b20 0x7fb0c4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:22.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.568+0000 7fb0d7fff640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0c4065b20 0x7fb0c4067fe0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb0d814cae0 tx=0x7fb0c8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:22.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.572+0000 7fb0d4ff9640 1 -- 172.21.15.130:0/3282407889 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb0d814c530 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0de49c640 1 -- 172.21.15.130:0/3282407889 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb0d814c530 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0d4ff9640 1 -- 172.21.15.130:0/3282407889 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v126) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb0d814c530 con 0x7fb0d80cdfc0 2023-09-13T06:07:22.738 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:07:22.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0de49c640 1 -- 172.21.15.130:0/3282407889 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0c4065b20 msgr2=0x7fb0c4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0de49c640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0c4065b20 0x7fb0c4067fe0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb0d814cae0 tx=0x7fb0c8009190 comp rx=0 tx=0).stop 2023-09-13T06:07:22.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0de49c640 1 -- 172.21.15.130:0/3282407889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0d80cdfc0 msgr2=0x7fb0d81469a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:22.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0de49c640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0d80cdfc0 0x7fb0d81469a0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c450 tx=0x7fb0cc00c910 comp rx=0 tx=0).stop 2023-09-13T06:07:22.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0de49c640 1 -- 172.21.15.130:0/3282407889 shutdown_connections 2023-09-13T06:07:22.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0de49c640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0c4065b20 0x7fb0c4067fe0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0de49c640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0d8159f20 0x7fb0d806d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0de49c640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0d80cdfc0 0x7fb0d81469a0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0de49c640 1 --2- 172.21.15.130:0/3282407889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0d80b1d20 0x7fb0d8148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:22.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.736+0000 7fb0de49c640 1 -- 172.21.15.130:0/3282407889 >> 172.21.15.130:0/3282407889 conn(0x7fb0d8065990 msgr2=0x7fb0d806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:22.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.740+0000 7fb0de49c640 1 -- 172.21.15.130:0/3282407889 shutdown_connections 2023-09-13T06:07:22.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:22.740+0000 7fb0de49c640 1 -- 172.21.15.130:0/3282407889 wait complete. 2023-09-13T06:07:22.760 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T06:07:22.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:22.761 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-13T06:07:22.861 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:07:22.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:22.862 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T06:07:22.872 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:07:22.872 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:22.881 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:07:22.882 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:22.934 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:23.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc703d2640 1 Processor -- start 2023-09-13T06:07:23.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc703d2640 1 -- start start 2023-09-13T06:07:23.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc703d2640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdc680d1750 0x7fdc6815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc703d2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdc680d1090 0x7fdc68146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc703d2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc680b63c0 con 0x7fdc680d1b30 2023-09-13T06:07:23.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc703d2640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6815dea0 con 0x7fdc680d1090 2023-09-13T06:07:23.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc703d2640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc680d0c20 con 0x7fdc680d1750 2023-09-13T06:07:23.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc6d96d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdc680d1090 0x7fdc68146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc6d96d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdc680d1090 0x7fdc68146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56726/0 (socket says 172.21.15.130:56726) 2023-09-13T06:07:23.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc6d96d640 1 -- 172.21.15.130:0/1898574094 learned_addr learned my addr 172.21.15.130:0/1898574094 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:23.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc6e16e640 1 --2- 172.21.15.130:0/1898574094 >> v2:172.21.15.164:3300/0 conn(0x7fdc680d1750 0x7fdc6815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc6d96d640 1 -- 172.21.15.130:0/1898574094 >> v2:172.21.15.164:3300/0 conn(0x7fdc680d1750 msgr2=0x7fdc6815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:23.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc6d96d640 1 --2- 172.21.15.130:0/1898574094 >> v2:172.21.15.164:3300/0 conn(0x7fdc680d1750 0x7fdc6815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc6d96d640 1 -- 172.21.15.130:0/1898574094 >> v1:172.21.15.164:6789/0 conn(0x7fdc680d1b30 legacy=0x7fdc680b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.072+0000 7fdc6d96d640 1 -- 172.21.15.130:0/1898574094 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc680b6610 con 0x7fdc680d1090 2023-09-13T06:07:23.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc6d96d640 1 --2- 172.21.15.130:0/1898574094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc680d1090 0x7fdc68146820 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fdc68073cd0 tx=0x7fdc5801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6748db33a33c6993 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:23.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc6d16c640 1 -- 172.21.15.130:0/1898574094 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580aa430 con 0x7fdc680d1090 2023-09-13T06:07:23.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc6d16c640 1 -- 172.21.15.130:0/1898574094 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc580aa590 con 0x7fdc680d1090 2023-09-13T06:07:23.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc6d16c640 1 -- 172.21.15.130:0/1898574094 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580aa920 con 0x7fdc680d1090 2023-09-13T06:07:23.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc703d2640 1 -- 172.21.15.130:0/1898574094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc680d1090 msgr2=0x7fdc68146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc703d2640 1 --2- 172.21.15.130:0/1898574094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc680d1090 0x7fdc68146820 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fdc68073cd0 tx=0x7fdc5801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc703d2640 1 -- 172.21.15.130:0/1898574094 shutdown_connections 2023-09-13T06:07:23.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc703d2640 1 --2- 172.21.15.130:0/1898574094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc680d1090 0x7fdc68146820 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc703d2640 1 --2- 172.21.15.130:0/1898574094 >> v2:172.21.15.164:3300/0 conn(0x7fdc680d1750 0x7fdc6815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc703d2640 1 -- 172.21.15.130:0/1898574094 >> 172.21.15.130:0/1898574094 conn(0x7fdc6806f170 msgr2=0x7fdc6806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:23.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc703d2640 1 -- 172.21.15.130:0/1898574094 shutdown_connections 2023-09-13T06:07:23.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.076+0000 7fdc703d2640 1 -- 172.21.15.130:0/1898574094 wait complete. 2023-09-13T06:07:23.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc703d2640 1 Processor -- start 2023-09-13T06:07:23.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc703d2640 1 -- start start 2023-09-13T06:07:23.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc703d2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc680d1090 0x7fdc6813c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc703d2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc680d1750 0x7fdc6815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc703d2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc680d1b30 0x7fdc6815c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc703d2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6813de50 con 0x7fdc680d1090 2023-09-13T06:07:23.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc703d2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6813d240 con 0x7fdc680d1750 2023-09-13T06:07:23.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc703d2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6813d520 con 0x7fdc680d1b30 2023-09-13T06:07:23.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc6e16e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc680d1090 0x7fdc6813c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc6e16e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc680d1090 0x7fdc6813c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56734/0 (socket says 172.21.15.130:56734) 2023-09-13T06:07:23.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc6e16e640 1 -- 172.21.15.130:0/493892669 learned_addr learned my addr 172.21.15.130:0/493892669 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:23.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc6d96d640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc680d1750 0x7fdc6815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc6e96f640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc680d1b30 0x7fdc6815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc6e16e640 1 -- 172.21.15.130:0/493892669 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc680d1b30 msgr2=0x7fdc6815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc6e16e640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc680d1b30 0x7fdc6815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc6e16e640 1 -- 172.21.15.130:0/493892669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc680d1750 msgr2=0x7fdc6815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc6e16e640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc680d1750 0x7fdc6815ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc6e16e640 1 -- 172.21.15.130:0/493892669 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc580094d0 con 0x7fdc680d1090 2023-09-13T06:07:23.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc6e16e640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc680d1090 0x7fdc6813c9a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400d800 tx=0x7fdc6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:23.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc5effd640 1 -- 172.21.15.130:0/493892669 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400b6c0 con 0x7fdc680d1090 2023-09-13T06:07:23.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc5effd640 1 -- 172.21.15.130:0/493892669 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6400b860 con 0x7fdc680d1090 2023-09-13T06:07:23.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc703d2640 1 -- 172.21.15.130:0/493892669 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6813d800 con 0x7fdc680d1090 2023-09-13T06:07:23.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc5effd640 1 -- 172.21.15.130:0/493892669 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400bc10 con 0x7fdc680d1090 2023-09-13T06:07:23.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.080+0000 7fdc703d2640 1 -- 172.21.15.130:0/493892669 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6813cee0 con 0x7fdc680d1090 2023-09-13T06:07:23.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.084+0000 7fdc703d2640 1 -- 172.21.15.130:0/493892669 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc680618a0 con 0x7fdc680d1090 2023-09-13T06:07:23.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.084+0000 7fdc5effd640 1 -- 172.21.15.130:0/493892669 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdc6401e460 con 0x7fdc680d1090 2023-09-13T06:07:23.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.084+0000 7fdc5effd640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc4c065b20 0x7fdc4c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.084+0000 7fdc5effd640 1 -- 172.21.15.130:0/493892669 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc640837b0 con 0x7fdc680d1090 2023-09-13T06:07:23.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.084+0000 7fdc6d96d640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc4c065b20 0x7fdc4c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.084+0000 7fdc6d96d640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc4c065b20 0x7fdc4c067fe0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdc580ae000 tx=0x7fdc580b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:23.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.088+0000 7fdc5effd640 1 -- 172.21.15.130:0/493892669 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdc640511b0 con 0x7fdc680d1090 2023-09-13T06:07:23.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.240+0000 7fdc703d2640 1 -- 172.21.15.130:0/493892669 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc680b86c0 con 0x7fdc680d1090 2023-09-13T06:07:23.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.240+0000 7fdc5effd640 1 -- 172.21.15.130:0/493892669 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16563 (secure 0 0 0) 0x7fdc640547d0 con 0x7fdc680d1090 2023-09-13T06:07:23.244 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:23.244 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":126,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:19.406296+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:05.156883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:06.213714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:23.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 -- 172.21.15.130:0/493892669 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc4c065b20 msgr2=0x7fdc4c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc4c065b20 0x7fdc4c067fe0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdc580ae000 tx=0x7fdc580b5040 comp rx=0 tx=0).stop 2023-09-13T06:07:23.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 -- 172.21.15.130:0/493892669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc680d1090 msgr2=0x7fdc6813c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc680d1090 0x7fdc6813c9a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400d800 tx=0x7fdc6400dcc0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 -- 172.21.15.130:0/493892669 shutdown_connections 2023-09-13T06:07:23.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc4c065b20 0x7fdc4c067fe0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc680d1750 0x7fdc6815ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc680d1b30 0x7fdc6815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 --2- 172.21.15.130:0/493892669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc680d1090 0x7fdc6813c9a0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 -- 172.21.15.130:0/493892669 >> 172.21.15.130:0/493892669 conn(0x7fdc6806f170 msgr2=0x7fdc6813edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:23.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 -- 172.21.15.130:0/493892669 shutdown_connections 2023-09-13T06:07:23.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.244+0000 7fdc703d2640 1 -- 172.21.15.130:0/493892669 wait complete. 2023-09-13T06:07:23.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:07:05.156883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:07:06.213714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:07:23.266 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:07:23.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc2049db640 1 Processor -- start 2023-09-13T06:07:23.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc2049db640 1 -- start start 2023-09-13T06:07:23.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc2049db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc20015ae10 0x7fc2000d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc2049db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20015dd40 con 0x7fc2000d2b00 2023-09-13T06:07:23.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc2049db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20015e020 con 0x7fc2001619b0 2023-09-13T06:07:23.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc2049db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc200161e40 con 0x7fc20015ae10 2023-09-13T06:07:23.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc1f5d9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc2000d2b00 0x7fc2001612a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48312/0 (socket says 172.21.15.130:48312) 2023-09-13T06:07:23.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc1f5d9b640 1 -- 172.21.15.130:0/1713980844 learned_addr learned my addr 172.21.15.130:0/1713980844 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:23.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc1fe59c640 1 --2- 172.21.15.130:0/1713980844 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc20015ae10 0x7fc2000d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc1fdd9b640 1 -- 172.21.15.130:0/1713980844 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235217876 0 0) 0x7fc20015dd40 con 0x7fc2000d2b00 2023-09-13T06:07:23.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc1fdd9b640 1 -- 172.21.15.130:0/1713980844 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1ec003530 con 0x7fc2000d2b00 2023-09-13T06:07:23.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc1fdd9b640 1 -- 172.21.15.130:0/1713980844 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079415895 0 0) 0x7fc20015e020 con 0x7fc2001619b0 2023-09-13T06:07:23.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc1fdd9b640 1 -- 172.21.15.130:0/1713980844 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc20015dd40 con 0x7fc2001619b0 2023-09-13T06:07:23.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc1fe59c640 1 -- 172.21.15.130:0/1713980844 >> v1:172.21.15.164:6789/0 conn(0x7fc2001619b0 legacy=0x7fc2000cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc1fe59c640 1 -- 172.21.15.130:0/1713980844 >> v1:172.21.15.130:6789/0 conn(0x7fc2000d2b00 legacy=0x7fc2001612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.408+0000 7fc1fe59c640 1 -- 172.21.15.130:0/1713980844 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20015e300 con 0x7fc20015ae10 2023-09-13T06:07:23.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.412+0000 7fc1fe59c640 1 --2- 172.21.15.130:0/1713980844 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc20015ae10 0x7fc2000d25c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00097f0 tx=0x7fc1f001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c92a3404bed4b5a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:23.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.412+0000 7fc1fdd9b640 1 -- 172.21.15.130:0/1713980844 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00a8050 con 0x7fc20015ae10 2023-09-13T06:07:23.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.412+0000 7fc1fdd9b640 1 -- 172.21.15.130:0/1713980844 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f00ac5f0 con 0x7fc20015ae10 2023-09-13T06:07:23.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.412+0000 7fc1fdd9b640 1 -- 172.21.15.130:0/1713980844 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00ac980 con 0x7fc20015ae10 2023-09-13T06:07:23.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.412+0000 7fc2049db640 1 -- 172.21.15.130:0/1713980844 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc20015ae10 msgr2=0x7fc2000d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.412+0000 7fc2049db640 1 --2- 172.21.15.130:0/1713980844 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc20015ae10 0x7fc2000d25c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00097f0 tx=0x7fc1f001c370 comp rx=0 tx=0).stop 2023-09-13T06:07:23.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.412+0000 7fc2049db640 1 -- 172.21.15.130:0/1713980844 shutdown_connections 2023-09-13T06:07:23.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.412+0000 7fc2049db640 1 --2- 172.21.15.130:0/1713980844 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc20015ae10 0x7fc2000d25c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.412+0000 7fc2049db640 1 -- 172.21.15.130:0/1713980844 >> 172.21.15.130:0/1713980844 conn(0x7fc200065990 msgr2=0x7fc200065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:23.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.412+0000 7fc2049db640 1 -- 172.21.15.130:0/1713980844 shutdown_connections 2023-09-13T06:07:23.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.412+0000 7fc2049db640 1 -- 172.21.15.130:0/1713980844 wait complete. 2023-09-13T06:07:23.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc2049db640 1 Processor -- start 2023-09-13T06:07:23.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc2049db640 1 -- start start 2023-09-13T06:07:23.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc2049db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2000d2b00 0x7fc200151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc2049db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc20015ae10 0x7fc200158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc2049db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2001619b0 0x7fc2001f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc2049db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc200163d00 con 0x7fc20015ae10 2023-09-13T06:07:23.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc2049db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc200162da0 con 0x7fc2001619b0 2023-09-13T06:07:23.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc2049db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc200163080 con 0x7fc2000d2b00 2023-09-13T06:07:23.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1f5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc20015ae10 0x7fc200158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1fe59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2000d2b00 0x7fc200151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1fe59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2000d2b00 0x7fc200151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:47238/0 (socket says 172.21.15.130:47238) 2023-09-13T06:07:23.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1fe59c640 1 -- 172.21.15.130:0/4096509331 learned_addr learned my addr 172.21.15.130:0/4096509331 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:23.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1fed9d640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2001619b0 0x7fc2001f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1f5d9b640 1 -- 172.21.15.130:0/4096509331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2000d2b00 msgr2=0x7fc200151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1f5d9b640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2000d2b00 0x7fc200151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1f5d9b640 1 -- 172.21.15.130:0/4096509331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2001619b0 msgr2=0x7fc2001f7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1f5d9b640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2001619b0 0x7fc2001f7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1f5d9b640 1 -- 172.21.15.130:0/4096509331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0009420 con 0x7fc20015ae10 2023-09-13T06:07:23.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1fe59c640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2000d2b00 0x7fc200151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:23.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1fed9d640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2001619b0 0x7fc2001f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:23.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1f5d9b640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc20015ae10 0x7fc200158ee0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800c400 tx=0x7fc1e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:23.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.416+0000 7fc1f77fe640 1 -- 172.21.15.130:0/4096509331 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8005cf0 con 0x7fc20015ae10 2023-09-13T06:07:23.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.420+0000 7fc1f77fe640 1 -- 172.21.15.130:0/4096509331 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8005e50 con 0x7fc20015ae10 2023-09-13T06:07:23.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.420+0000 7fc2049db640 1 -- 172.21.15.130:0/4096509331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc200163360 con 0x7fc20015ae10 2023-09-13T06:07:23.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.420+0000 7fc1f77fe640 1 -- 172.21.15.130:0/4096509331 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80072d0 con 0x7fc20015ae10 2023-09-13T06:07:23.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.420+0000 7fc2049db640 1 -- 172.21.15.130:0/4096509331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc200163920 con 0x7fc20015ae10 2023-09-13T06:07:23.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.420+0000 7fc2049db640 1 -- 172.21.15.130:0/4096509331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2000618a0 con 0x7fc20015ae10 2023-09-13T06:07:23.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.420+0000 7fc1f77fe640 1 -- 172.21.15.130:0/4096509331 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc1e8007430 con 0x7fc20015ae10 2023-09-13T06:07:23.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.420+0000 7fc1f77fe640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc1e0065b20 0x7fc1e0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.420+0000 7fc1f77fe640 1 -- 172.21.15.130:0/4096509331 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1e80827c0 con 0x7fc20015ae10 2023-09-13T06:07:23.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.420+0000 7fc1fe59c640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc1e0065b20 0x7fc1e0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.424+0000 7fc1fe59c640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc1e0065b20 0x7fc1e0067fe0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009740 tx=0x7fc1f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:23.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.428+0000 7fc1f77fe640 1 -- 172.21.15.130:0/4096509331 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc1e8050280 con 0x7fc20015ae10 2023-09-13T06:07:23.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 -- 172.21.15.130:0/4096509331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2000b68a0 con 0x7fc20015ae10 2023-09-13T06:07:23.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc1f77fe640 1 -- 172.21.15.130:0/4096509331 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1e80538a0 con 0x7fc20015ae10 2023-09-13T06:07:23.578 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:07:23.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 -- 172.21.15.130:0/4096509331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc1e0065b20 msgr2=0x7fc1e0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc1e0065b20 0x7fc1e0067fe0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009740 tx=0x7fc1f0008040 comp rx=0 tx=0).stop 2023-09-13T06:07:23.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 -- 172.21.15.130:0/4096509331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc20015ae10 msgr2=0x7fc200158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc20015ae10 0x7fc200158ee0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800c400 tx=0x7fc1e800c8c0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 -- 172.21.15.130:0/4096509331 shutdown_connections 2023-09-13T06:07:23.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc1e0065b20 0x7fc1e0067fe0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2001619b0 0x7fc2001f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc20015ae10 0x7fc200158ee0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 --2- 172.21.15.130:0/4096509331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc2000d2b00 0x7fc200151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 -- 172.21.15.130:0/4096509331 >> 172.21.15.130:0/4096509331 conn(0x7fc200065990 msgr2=0x7fc2001605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:23.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 -- 172.21.15.130:0/4096509331 shutdown_connections 2023-09-13T06:07:23.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.576+0000 7fc2049db640 1 -- 172.21.15.130:0/4096509331 wait complete. 2023-09-13T06:07:23.599 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:07:23.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.736+0000 7f533432c640 1 Processor -- start 2023-09-13T06:07:23.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.736+0000 7f533432c640 1 -- start start 2023-09-13T06:07:23.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f533432c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f532c0b1460 0x7f532c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f533432c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f532c0b2fd0 0x7f532c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f533432c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532c0cc850 con 0x7f532c15a080 2023-09-13T06:07:23.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f533432c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532c0b33f0 con 0x7f532c0b2fd0 2023-09-13T06:07:23.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f533432c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c0b0330 con 0x7f532c0b1460 2023-09-13T06:07:23.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f53328c9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f532c0b2fd0 0x7f532c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f53328c9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f532c0b2fd0 0x7f532c0ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56752/0 (socket says 172.21.15.130:56752) 2023-09-13T06:07:23.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f53328c9640 1 -- 172.21.15.130:0/2781552337 learned_addr learned my addr 172.21.15.130:0/2781552337 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:23.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f53318c7640 1 --2- 172.21.15.130:0/2781552337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f532c0b1460 0x7f532c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f53328c9640 1 -- 172.21.15.130:0/2781552337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f532c0b1460 msgr2=0x7f532c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:23.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f53328c9640 1 --2- 172.21.15.130:0/2781552337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f532c0b1460 0x7f532c0b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f53328c9640 1 -- 172.21.15.130:0/2781552337 >> v1:172.21.15.164:6789/0 conn(0x7f532c15a080 legacy=0x7f532c15e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f53328c9640 1 -- 172.21.15.130:0/2781552337 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c0cbcd0 con 0x7f532c0b2fd0 2023-09-13T06:07:23.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.740+0000 7f53318c7640 1 --2- 172.21.15.130:0/2781552337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f532c0b1460 0x7f532c0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:23.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f53328c9640 1 --2- 172.21.15.130:0/2781552337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f532c0b2fd0 0x7f532c0ccfe0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5324009e50 tx=0x7f532401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d66c4609633cd72 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:23.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f53310c6640 1 -- 172.21.15.130:0/2781552337 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53240090d0 con 0x7f532c0b2fd0 2023-09-13T06:07:23.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f53310c6640 1 -- 172.21.15.130:0/2781552337 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324009230 con 0x7f532c0b2fd0 2023-09-13T06:07:23.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f53310c6640 1 -- 172.21.15.130:0/2781552337 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53240a5940 con 0x7f532c0b2fd0 2023-09-13T06:07:23.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 -- 172.21.15.130:0/2781552337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f532c0b2fd0 msgr2=0x7f532c0ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 --2- 172.21.15.130:0/2781552337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f532c0b2fd0 0x7f532c0ccfe0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5324009e50 tx=0x7f532401c950 comp rx=0 tx=0).stop 2023-09-13T06:07:23.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 -- 172.21.15.130:0/2781552337 shutdown_connections 2023-09-13T06:07:23.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 --2- 172.21.15.130:0/2781552337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f532c0b2fd0 0x7f532c0ccfe0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 --2- 172.21.15.130:0/2781552337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f532c0b1460 0x7f532c0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 -- 172.21.15.130:0/2781552337 >> 172.21.15.130:0/2781552337 conn(0x7f532c065990 msgr2=0x7f532c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:23.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 -- 172.21.15.130:0/2781552337 shutdown_connections 2023-09-13T06:07:23.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 -- 172.21.15.130:0/2781552337 wait complete. 2023-09-13T06:07:23.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 Processor -- start 2023-09-13T06:07:23.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 -- start start 2023-09-13T06:07:23.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f532c0b1460 0x7f532c158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f532c0b2fd0 0x7f532c154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.744+0000 7f533432c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f532c15a080 0x7f532c146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f533432c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c154f40 con 0x7f532c0b1460 2023-09-13T06:07:23.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f533432c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c154cc0 con 0x7f532c0b2fd0 2023-09-13T06:07:23.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f533432c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c157840 con 0x7f532c15a080 2023-09-13T06:07:23.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f53320c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f532c0b1460 0x7f532c158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f53320c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f532c0b1460 0x7f532c158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56766/0 (socket says 172.21.15.130:56766) 2023-09-13T06:07:23.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f53320c8640 1 -- 172.21.15.130:0/3675520251 learned_addr learned my addr 172.21.15.130:0/3675520251 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:23.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f53318c7640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f532c0b2fd0 0x7f532c154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f53328c9640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f532c15a080 0x7f532c146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f53320c8640 1 -- 172.21.15.130:0/3675520251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f532c15a080 msgr2=0x7f532c146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f53320c8640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f532c15a080 0x7f532c146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f53320c8640 1 -- 172.21.15.130:0/3675520251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f532c0b2fd0 msgr2=0x7f532c154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f53320c8640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f532c0b2fd0 0x7f532c154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f53320c8640 1 -- 172.21.15.130:0/3675520251 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324009b30 con 0x7f532c0b1460 2023-09-13T06:07:23.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f53320c8640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f532c0b1460 0x7f532c158ca0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f532800c3c0 tx=0x7f532800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:23.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f5322ffd640 1 -- 172.21.15.130:0/3675520251 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53280052d0 con 0x7f532c0b1460 2023-09-13T06:07:23.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f5322ffd640 1 -- 172.21.15.130:0/3675520251 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5328005430 con 0x7f532c0b1460 2023-09-13T06:07:23.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f5322ffd640 1 -- 172.21.15.130:0/3675520251 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328003840 con 0x7f532c0b1460 2023-09-13T06:07:23.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f533432c640 1 -- 172.21.15.130:0/3675520251 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c157b20 con 0x7f532c0b1460 2023-09-13T06:07:23.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f533432c640 1 -- 172.21.15.130:0/3675520251 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c1580e0 con 0x7f532c0b1460 2023-09-13T06:07:23.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f533432c640 1 -- 172.21.15.130:0/3675520251 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c0618a0 con 0x7f532c0b1460 2023-09-13T06:07:23.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.748+0000 7f5322ffd640 1 -- 172.21.15.130:0/3675520251 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f53280039a0 con 0x7f532c0b1460 2023-09-13T06:07:23.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.752+0000 7f5322ffd640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5310065b20 0x7f5310067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:23.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.752+0000 7f5322ffd640 1 -- 172.21.15.130:0/3675520251 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5328082540 con 0x7f532c0b1460 2023-09-13T06:07:23.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.752+0000 7f53318c7640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5310065b20 0x7f5310067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:23.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.752+0000 7f53318c7640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5310065b20 0x7f5310067fe0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f532c156aa0 tx=0x7f531c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:23.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.756+0000 7f5322ffd640 1 -- 172.21.15.130:0/3675520251 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f532804ffd0 con 0x7f532c0b1460 2023-09-13T06:07:23.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.900+0000 7f533432c640 1 -- 172.21.15.130:0/3675520251 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f532c0cc850 con 0x7f532c0b1460 2023-09-13T06:07:23.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f5322ffd640 1 -- 172.21.15.130:0/3675520251 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7f532c0cc850 con 0x7f532c0b1460 2023-09-13T06:07:23.905 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:07:23.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 -- 172.21.15.130:0/3675520251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5310065b20 msgr2=0x7f5310067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5310065b20 0x7f5310067fe0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f532c156aa0 tx=0x7f531c008040 comp rx=0 tx=0).stop 2023-09-13T06:07:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 -- 172.21.15.130:0/3675520251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f532c0b1460 msgr2=0x7f532c158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f532c0b1460 0x7f532c158ca0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f532800c3c0 tx=0x7f532800c880 comp rx=0 tx=0).stop 2023-09-13T06:07:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 -- 172.21.15.130:0/3675520251 shutdown_connections 2023-09-13T06:07:23.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5310065b20 0x7f5310067fe0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f532c0b2fd0 0x7f532c154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f532c15a080 0x7f532c146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 --2- 172.21.15.130:0/3675520251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f532c0b1460 0x7f532c158ca0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:23.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 -- 172.21.15.130:0/3675520251 >> 172.21.15.130:0/3675520251 conn(0x7f532c065990 msgr2=0x7f532c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:23.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 -- 172.21.15.130:0/3675520251 shutdown_connections 2023-09-13T06:07:23.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:23.904+0000 7f533432c640 1 -- 172.21.15.130:0/3675520251 wait complete. 2023-09-13T06:07:23.925 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:07:24.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb527537640 1 Processor -- start 2023-09-13T06:07:24.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb527537640 1 -- start start 2023-09-13T06:07:24.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb527537640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb52015a080 0x7fb5200b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb527537640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb5200b31a0 0x7fb5200ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb527537640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5200cc850 con 0x7fb52015e650 2023-09-13T06:07:24.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb527537640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5200b0330 con 0x7fb52015a080 2023-09-13T06:07:24.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb527537640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5200cbcd0 con 0x7fb5200b31a0 2023-09-13T06:07:24.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb5252d3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb52015a080 0x7fb5200b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb5252d3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb52015a080 0x7fb5200b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56770/0 (socket says 172.21.15.130:56770) 2023-09-13T06:07:24.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb5252d3640 1 -- 172.21.15.130:0/3342938973 learned_addr learned my addr 172.21.15.130:0/3342938973 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:24.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb524ad2640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb52015e650 0x7fb5200b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48326/0 (socket says 172.21.15.130:48326) 2023-09-13T06:07:24.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb525ad4640 1 --2- 172.21.15.130:0/3342938973 >> v2:172.21.15.164:3300/0 conn(0x7fb5200b31a0 0x7fb5200ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb5252d3640 1 -- 172.21.15.130:0/3342938973 >> v2:172.21.15.164:3300/0 conn(0x7fb5200b31a0 msgr2=0x7fb5200ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:24.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb5252d3640 1 --2- 172.21.15.130:0/3342938973 >> v2:172.21.15.164:3300/0 conn(0x7fb5200b31a0 0x7fb5200ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb5252d3640 1 -- 172.21.15.130:0/3342938973 >> v1:172.21.15.130:6789/0 conn(0x7fb52015e650 legacy=0x7fb5200b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb5252d3640 1 -- 172.21.15.130:0/3342938973 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5200cbfb0 con 0x7fb52015a080 2023-09-13T06:07:24.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb517fff640 1 -- 172.21.15.130:0/3342938973 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190769445 0 0) 0x7fb510001120 con 0x7fb52015e650 2023-09-13T06:07:24.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.064+0000 7fb525ad4640 1 --2- 172.21.15.130:0/3342938973 >> v2:172.21.15.164:3300/0 conn(0x7fb5200b31a0 0x7fb5200ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:24.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb5252d3640 1 --2- 172.21.15.130:0/3342938973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb52015a080 0x7fb5200b1460 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fb52015db70 tx=0x7fb51c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a32d6c436bb6c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:24.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb517fff640 1 -- 172.21.15.130:0/3342938973 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0ab440 con 0x7fb52015a080 2023-09-13T06:07:24.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb517fff640 1 -- 172.21.15.130:0/3342938973 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c0a7070 con 0x7fb52015a080 2023-09-13T06:07:24.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb517fff640 1 -- 172.21.15.130:0/3342938973 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0ab7c0 con 0x7fb52015a080 2023-09-13T06:07:24.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb527537640 1 -- 172.21.15.130:0/3342938973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb52015a080 msgr2=0x7fb5200b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb527537640 1 --2- 172.21.15.130:0/3342938973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb52015a080 0x7fb5200b1460 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fb52015db70 tx=0x7fb51c01c440 comp rx=0 tx=0).stop 2023-09-13T06:07:24.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb527537640 1 -- 172.21.15.130:0/3342938973 shutdown_connections 2023-09-13T06:07:24.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb527537640 1 --2- 172.21.15.130:0/3342938973 >> v2:172.21.15.164:3300/0 conn(0x7fb5200b31a0 0x7fb5200ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb527537640 1 --2- 172.21.15.130:0/3342938973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb52015a080 0x7fb5200b1460 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb527537640 1 -- 172.21.15.130:0/3342938973 >> 172.21.15.130:0/3342938973 conn(0x7fb520065990 msgr2=0x7fb520065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:24.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb527537640 1 -- 172.21.15.130:0/3342938973 shutdown_connections 2023-09-13T06:07:24.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.068+0000 7fb527537640 1 -- 172.21.15.130:0/3342938973 wait complete. 2023-09-13T06:07:24.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb527537640 1 Processor -- start 2023-09-13T06:07:24.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb527537640 1 -- start start 2023-09-13T06:07:24.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb527537640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5200b31a0 0x7fb5201449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb527537640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb52015a080 0x7fb5201463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb527537640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb52015e650 0x7fb5200ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb527537640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5201458d0 con 0x7fb52015e650 2023-09-13T06:07:24.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb527537640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5201381f0 con 0x7fb5200b31a0 2023-09-13T06:07:24.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb527537640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52014c700 con 0x7fb52015a080 2023-09-13T06:07:24.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb525ad4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb52015e650 0x7fb5200ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb525ad4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb52015e650 0x7fb5200ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56772/0 (socket says 172.21.15.130:56772) 2023-09-13T06:07:24.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb525ad4640 1 -- 172.21.15.130:0/2563073214 learned_addr learned my addr 172.21.15.130:0/2563073214 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:24.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb524ad2640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb52015a080 0x7fb5201463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb5252d3640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5200b31a0 0x7fb5201449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb525ad4640 1 -- 172.21.15.130:0/2563073214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb52015a080 msgr2=0x7fb5201463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb525ad4640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb52015a080 0x7fb5201463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb525ad4640 1 -- 172.21.15.130:0/2563073214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5200b31a0 msgr2=0x7fb5201449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb525ad4640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5200b31a0 0x7fb5201449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb525ad4640 1 -- 172.21.15.130:0/2563073214 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c0094d0 con 0x7fb52015e650 2023-09-13T06:07:24.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb525ad4640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb52015e650 0x7fb5200ac840 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb51800cd80 tx=0x7fb51800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:24.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb515ffb640 1 -- 172.21.15.130:0/2563073214 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51800f680 con 0x7fb52015e650 2023-09-13T06:07:24.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb515ffb640 1 -- 172.21.15.130:0/2563073214 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51800f800 con 0x7fb52015e650 2023-09-13T06:07:24.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb515ffb640 1 -- 172.21.15.130:0/2563073214 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51800fbb0 con 0x7fb52015e650 2023-09-13T06:07:24.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb527537640 1 -- 172.21.15.130:0/2563073214 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb520146930 con 0x7fb52015e650 2023-09-13T06:07:24.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.072+0000 7fb527537640 1 -- 172.21.15.130:0/2563073214 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb520145310 con 0x7fb52015e650 2023-09-13T06:07:24.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.076+0000 7fb527537640 1 -- 172.21.15.130:0/2563073214 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52015ea80 con 0x7fb52015e650 2023-09-13T06:07:24.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.076+0000 7fb515ffb640 1 -- 172.21.15.130:0/2563073214 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb51800b040 con 0x7fb52015e650 2023-09-13T06:07:24.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.076+0000 7fb515ffb640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb504065b50 0x7fb504068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.076+0000 7fb515ffb640 1 -- 172.21.15.130:0/2563073214 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb518083af0 con 0x7fb52015e650 2023-09-13T06:07:24.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.076+0000 7fb5252d3640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb504065b50 0x7fb504068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.076+0000 7fb5252d3640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb504065b50 0x7fb504068010 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0af000 tx=0x7fb51c0b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:24.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.080+0000 7fb515ffb640 1 -- 172.21.15.130:0/2563073214 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb5180514e0 con 0x7fb52015e650 2023-09-13T06:07:24.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.228+0000 7fb527537640 1 -- 172.21.15.130:0/2563073214 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5200618a0 con 0x7fb52015e650 2023-09-13T06:07:24.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.228+0000 7fb515ffb640 1 -- 172.21.15.130:0/2563073214 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb51801d0a0 con 0x7fb52015e650 2023-09-13T06:07:24.234 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:07:24.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 -- 172.21.15.130:0/2563073214 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb504065b50 msgr2=0x7fb504068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb504065b50 0x7fb504068010 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0af000 tx=0x7fb51c0b6040 comp rx=0 tx=0).stop 2023-09-13T06:07:24.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 -- 172.21.15.130:0/2563073214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb52015e650 msgr2=0x7fb5200ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb52015e650 0x7fb5200ac840 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb51800cd80 tx=0x7fb51800a650 comp rx=0 tx=0).stop 2023-09-13T06:07:24.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 -- 172.21.15.130:0/2563073214 shutdown_connections 2023-09-13T06:07:24.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb504065b50 0x7fb504068010 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb52015e650 0x7fb5200ac840 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb52015a080 0x7fb5201463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 --2- 172.21.15.130:0/2563073214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5200b31a0 0x7fb5201449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 -- 172.21.15.130:0/2563073214 >> 172.21.15.130:0/2563073214 conn(0x7fb520065990 msgr2=0x7fb520065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:24.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 -- 172.21.15.130:0/2563073214 shutdown_connections 2023-09-13T06:07:24.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.232+0000 7fb527537640 1 -- 172.21.15.130:0/2563073214 wait complete. 2023-09-13T06:07:24.252 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:07:24.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.388+0000 7f685ec9e640 1 Processor -- start 2023-09-13T06:07:24.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.388+0000 7f685ec9e640 1 -- start start 2023-09-13T06:07:24.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.388+0000 7f685ec9e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f68581436e0 0x7f68580ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.388+0000 7f685ec9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6858070d60 0x7f6858160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.388+0000 7f685ec9e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685806f640 con 0x7f68580acd80 2023-09-13T06:07:24.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.388+0000 7f685ec9e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685806f890 con 0x7f68581436e0 2023-09-13T06:07:24.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.388+0000 7f685ec9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685806fb70 con 0x7f6858070d60 2023-09-13T06:07:24.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f685ca3a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f68581436e0 0x7f68580ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f685d23b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6858070d60 0x7f6858160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f684ffff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f68580acd80 0x7f6858070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:52408/0 (socket says 172.21.15.130:52408) 2023-09-13T06:07:24.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f684ffff640 1 -- 172.21.15.130:0/1939748120 learned_addr learned my addr 172.21.15.130:0/1939748120 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:24.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f685ca3a640 1 -- 172.21.15.130:0/1939748120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6858070d60 msgr2=0x7f6858160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:24.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f685ca3a640 1 --2- 172.21.15.130:0/1939748120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6858070d60 0x7f6858160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f685ca3a640 1 -- 172.21.15.130:0/1939748120 >> v1:172.21.15.164:6789/0 conn(0x7f68580acd80 legacy=0x7f6858070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f685ca3a640 1 -- 172.21.15.130:0/1939748120 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685806fe50 con 0x7f68581436e0 2023-09-13T06:07:24.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f685ca3a640 1 --2- 172.21.15.130:0/1939748120 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68581436e0 0x7f68580ac840 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f68540097c0 tx=0x7f685401c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=543d089c150dae19 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:24.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f684f7fe640 1 -- 172.21.15.130:0/1939748120 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858146e10 con 0x7f68581436e0 2023-09-13T06:07:24.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f684f7fe640 1 -- 172.21.15.130:0/1939748120 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68540a7050 con 0x7f68581436e0 2023-09-13T06:07:24.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.392+0000 7f684f7fe640 1 -- 172.21.15.130:0/1939748120 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68540ab820 con 0x7f68581436e0 2023-09-13T06:07:24.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 -- 172.21.15.130:0/1939748120 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68581436e0 msgr2=0x7f68580ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 --2- 172.21.15.130:0/1939748120 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68581436e0 0x7f68580ac840 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f68540097c0 tx=0x7f685401c360 comp rx=0 tx=0).stop 2023-09-13T06:07:24.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 -- 172.21.15.130:0/1939748120 shutdown_connections 2023-09-13T06:07:24.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 --2- 172.21.15.130:0/1939748120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6858070d60 0x7f6858160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 --2- 172.21.15.130:0/1939748120 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68581436e0 0x7f68580ac840 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 -- 172.21.15.130:0/1939748120 >> 172.21.15.130:0/1939748120 conn(0x7f68580b0bc0 msgr2=0x7f68580b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:24.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 -- 172.21.15.130:0/1939748120 shutdown_connections 2023-09-13T06:07:24.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 -- 172.21.15.130:0/1939748120 wait complete. 2023-09-13T06:07:24.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 Processor -- start 2023-09-13T06:07:24.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 -- start start 2023-09-13T06:07:24.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6858070d60 0x7f685813b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68580acd80 0x7f685815ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68581436e0 0x7f68580ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685813bc30 con 0x7f68580acd80 2023-09-13T06:07:24.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68581604a0 con 0x7f68581436e0 2023-09-13T06:07:24.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ec9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685815f8d0 con 0x7f6858070d60 2023-09-13T06:07:24.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f684ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68580acd80 0x7f685815ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f684ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68580acd80 0x7f685815ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56782/0 (socket says 172.21.15.130:56782) 2023-09-13T06:07:24.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f684ffff640 1 -- 172.21.15.130:0/836148692 learned_addr learned my addr 172.21.15.130:0/836148692 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:24.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685ca3a640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6858070d60 0x7f685813b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.396+0000 7f685d23b640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68581436e0 0x7f68580ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684ffff640 1 -- 172.21.15.130:0/836148692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6858070d60 msgr2=0x7f685813b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684ffff640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6858070d60 0x7f685813b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684ffff640 1 -- 172.21.15.130:0/836148692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68581436e0 msgr2=0x7f68580ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684ffff640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68581436e0 0x7f68580ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684ffff640 1 -- 172.21.15.130:0/836148692 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854009420 con 0x7f68580acd80 2023-09-13T06:07:24.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684ffff640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68580acd80 0x7f685815ee10 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f684800c4d0 tx=0x7f684800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:24.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684d7fa640 1 -- 172.21.15.130:0/836148692 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848005cf0 con 0x7f68580acd80 2023-09-13T06:07:24.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684d7fa640 1 -- 172.21.15.130:0/836148692 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6848005e50 con 0x7f68580acd80 2023-09-13T06:07:24.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f685ec9e640 1 -- 172.21.15.130:0/836148692 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685815fb70 con 0x7f68580acd80 2023-09-13T06:07:24.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684d7fa640 1 -- 172.21.15.130:0/836148692 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848007270 con 0x7f68580acd80 2023-09-13T06:07:24.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f685ec9e640 1 -- 172.21.15.130:0/836148692 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6858160130 con 0x7f68580acd80 2023-09-13T06:07:24.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f685ec9e640 1 -- 172.21.15.130:0/836148692 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6858160650 con 0x7f68580acd80 2023-09-13T06:07:24.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684d7fa640 1 -- 172.21.15.130:0/836148692 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f68480073d0 con 0x7f68580acd80 2023-09-13T06:07:24.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684d7fa640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6844065b20 0x7f6844067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.400+0000 7f684d7fa640 1 -- 172.21.15.130:0/836148692 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6848082640 con 0x7f68580acd80 2023-09-13T06:07:24.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.404+0000 7f685ca3a640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6844065b20 0x7f6844067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.404+0000 7f685ca3a640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6844065b20 0x7f6844067fe0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f68540ad000 tx=0x7f6854008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:24.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.404+0000 7f684d7fa640 1 -- 172.21.15.130:0/836148692 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6858160650 con 0x7f68580acd80 2023-09-13T06:07:24.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 -- 172.21.15.130:0/836148692 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6858160610 con 0x7f68580acd80 2023-09-13T06:07:24.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f684d7fa640 1 -- 172.21.15.130:0/836148692 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v126) v1 ==== 80+0+0 (secure 0 0 0) 0x7f68480500d0 con 0x7f68580acd80 2023-09-13T06:07:24.570 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:07:24.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 -- 172.21.15.130:0/836148692 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6844065b20 msgr2=0x7f6844067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6844065b20 0x7f6844067fe0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f68540ad000 tx=0x7f6854008040 comp rx=0 tx=0).stop 2023-09-13T06:07:24.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 -- 172.21.15.130:0/836148692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68580acd80 msgr2=0x7f685815ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68580acd80 0x7f685815ee10 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f684800c4d0 tx=0x7f684800c990 comp rx=0 tx=0).stop 2023-09-13T06:07:24.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 -- 172.21.15.130:0/836148692 shutdown_connections 2023-09-13T06:07:24.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6844065b20 0x7f6844067fe0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68581436e0 0x7f68580ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68580acd80 0x7f685815ee10 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 --2- 172.21.15.130:0/836148692 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6858070d60 0x7f685813b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 -- 172.21.15.130:0/836148692 >> 172.21.15.130:0/836148692 conn(0x7f68580b0bc0 msgr2=0x7f685813f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:24.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 -- 172.21.15.130:0/836148692 shutdown_connections 2023-09-13T06:07:24.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.568+0000 7f685ec9e640 1 -- 172.21.15.130:0/836148692 wait complete. 2023-09-13T06:07:24.590 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T06:07:24.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:24.592 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-13T06:07:24.647 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:07:24.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:24.648 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T06:07:24.658 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:07:24.659 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:24.669 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:07:24.670 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:07:24.670 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:24.715 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:07:24.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:24.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93e631640 1 Processor -- start 2023-09-13T06:07:24.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93e631640 1 -- start start 2023-09-13T06:07:24.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93e631640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9380d1f50 0x7fa938070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93e631640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa9380706c0 0x7fa93815d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93e631640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9380d1ac0 con 0x7fa938146b30 2023-09-13T06:07:24.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93e631640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa938070b50 con 0x7fa9380d1f50 2023-09-13T06:07:24.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93e631640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9380d0be0 con 0x7fa9380706c0 2023-09-13T06:07:24.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93ce2e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9380d1f50 0x7fa938070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93ce2e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa9380d1f50 0x7fa938070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56788/0 (socket says 172.21.15.130:56788) 2023-09-13T06:07:24.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93ce2e640 1 -- 172.21.15.130:0/4109333199 learned_addr learned my addr 172.21.15.130:0/4109333199 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:24.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93d62f640 1 --1- 172.21.15.130:0/4109333199 >> v1:172.21.15.130:6789/0 conn(0x7fa938146b30 0x7fa9380d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48342/0 (socket says 172.21.15.130:48342) 2023-09-13T06:07:24.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93de30640 1 --2- 172.21.15.130:0/4109333199 >> v2:172.21.15.164:3300/0 conn(0x7fa9380706c0 0x7fa93815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93ce2e640 1 -- 172.21.15.130:0/4109333199 >> v2:172.21.15.164:3300/0 conn(0x7fa9380706c0 msgr2=0x7fa93815d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:24.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93ce2e640 1 --2- 172.21.15.130:0/4109333199 >> v2:172.21.15.164:3300/0 conn(0x7fa9380706c0 0x7fa93815d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93ce2e640 1 -- 172.21.15.130:0/4109333199 >> v1:172.21.15.130:6789/0 conn(0x7fa938146b30 legacy=0x7fa9380d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.852+0000 7fa93ce2e640 1 -- 172.21.15.130:0/4109333199 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9380d0eb0 con 0x7fa9380d1f50 2023-09-13T06:07:24.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa93ce2e640 1 --2- 172.21.15.130:0/4109333199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9380d1f50 0x7fa938070180 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa9380b7dc0 tx=0x7fa92801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5864de792b01dce4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:24.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa92ffff640 1 -- 172.21.15.130:0/4109333199 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9280aa430 con 0x7fa9380d1f50 2023-09-13T06:07:24.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa92ffff640 1 -- 172.21.15.130:0/4109333199 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9280aa590 con 0x7fa9380d1f50 2023-09-13T06:07:24.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa92ffff640 1 -- 172.21.15.130:0/4109333199 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9280aa920 con 0x7fa9380d1f50 2023-09-13T06:07:24.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa93e631640 1 -- 172.21.15.130:0/4109333199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9380d1f50 msgr2=0x7fa938070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa93e631640 1 --2- 172.21.15.130:0/4109333199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9380d1f50 0x7fa938070180 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa9380b7dc0 tx=0x7fa92801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa93e631640 1 -- 172.21.15.130:0/4109333199 shutdown_connections 2023-09-13T06:07:24.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa93e631640 1 --2- 172.21.15.130:0/4109333199 >> v2:172.21.15.164:3300/0 conn(0x7fa9380706c0 0x7fa93815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa93e631640 1 --2- 172.21.15.130:0/4109333199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9380d1f50 0x7fa938070180 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa93e631640 1 -- 172.21.15.130:0/4109333199 >> 172.21.15.130:0/4109333199 conn(0x7fa9380d3090 msgr2=0x7fa9380d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:24.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa93e631640 1 -- 172.21.15.130:0/4109333199 shutdown_connections 2023-09-13T06:07:24.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.856+0000 7fa93e631640 1 -- 172.21.15.130:0/4109333199 wait complete. 2023-09-13T06:07:24.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93e631640 1 Processor -- start 2023-09-13T06:07:24.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93e631640 1 -- start start 2023-09-13T06:07:24.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93e631640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9380706c0 0x7fa93815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93e631640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9380d1f50 0x7fa9381574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93e631640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa938146b30 0x7fa938138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93e631640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93815c5b0 con 0x7fa938146b30 2023-09-13T06:07:24.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93e631640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93815cf10 con 0x7fa9380d1f50 2023-09-13T06:07:24.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93e631640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93813c3f0 con 0x7fa9380706c0 2023-09-13T06:07:24.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93de30640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa938146b30 0x7fa938138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93de30640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa938146b30 0x7fa938138fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56802/0 (socket says 172.21.15.130:56802) 2023-09-13T06:07:24.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93de30640 1 -- 172.21.15.130:0/3752634129 learned_addr learned my addr 172.21.15.130:0/3752634129 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:24.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93de30640 1 -- 172.21.15.130:0/3752634129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9380706c0 msgr2=0x7fa93815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93de30640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9380706c0 0x7fa93815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93de30640 1 -- 172.21.15.130:0/3752634129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9380d1f50 msgr2=0x7fa9381574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:24.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93de30640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9380d1f50 0x7fa9381574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:24.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93de30640 1 -- 172.21.15.130:0/3752634129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9280094d0 con 0x7fa938146b30 2023-09-13T06:07:24.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93de30640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa938146b30 0x7fa938138fe0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fa930007e90 tx=0x7fa93000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:24.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa92dffb640 1 -- 172.21.15.130:0/3752634129 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930014420 con 0x7fa938146b30 2023-09-13T06:07:24.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa92dffb640 1 -- 172.21.15.130:0/3752634129 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9300145a0 con 0x7fa938146b30 2023-09-13T06:07:24.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa92dffb640 1 -- 172.21.15.130:0/3752634129 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930014950 con 0x7fa938146b30 2023-09-13T06:07:24.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93e631640 1 -- 172.21.15.130:0/3752634129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa93813c6d0 con 0x7fa938146b30 2023-09-13T06:07:24.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93e631640 1 -- 172.21.15.130:0/3752634129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa938137910 con 0x7fa938146b30 2023-09-13T06:07:24.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.860+0000 7fa93e631640 1 -- 172.21.15.130:0/3752634129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9380618a0 con 0x7fa938146b30 2023-09-13T06:07:24.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.864+0000 7fa92dffb640 1 -- 172.21.15.130:0/3752634129 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa930014ab0 con 0x7fa938146b30 2023-09-13T06:07:24.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.864+0000 7fa92dffb640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa91c065b20 0x7fa91c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:24.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.864+0000 7fa92dffb640 1 -- 172.21.15.130:0/3752634129 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa930083c40 con 0x7fa938146b30 2023-09-13T06:07:24.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.864+0000 7fa93d62f640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa91c065b20 0x7fa91c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:24.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.864+0000 7fa93d62f640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa91c065b20 0x7fa91c067fe0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa9381f8cd0 tx=0x7fa9340079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:24.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:24.868+0000 7fa92dffb640 1 -- 172.21.15.130:0/3752634129 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa930051530 con 0x7fa938146b30 2023-09-13T06:07:25.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.044+0000 7fa93e631640 1 -- 172.21.15.130:0/3752634129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa93815c6f0 con 0x7fa938146b30 2023-09-13T06:07:25.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa92dffb640 1 -- 172.21.15.130:0/3752634129 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fa93815c6f0 con 0x7fa938146b30 2023-09-13T06:07:25.049 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:25.050 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2121062896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2121062896},{"type":"v1","addr":"172.21.15.164:6834","nonce":2121062896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3004233572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3004233572},{"type":"v1","addr":"172.21.15.164:6835","nonce":3004233572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7311,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3730755977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3730755977},{"type":"v1","addr":"172.21.15.130:6835","nonce":3730755977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:07.210560+0000","modified":"2023-09-13T06:07:10.218199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/4103504372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4103504372},{"type":"v1","addr":"172.21.15.130:6837","nonce":4103504372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-09-13T06:07:25.050 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 59 2023-09-13T06:07:25.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 -- 172.21.15.130:0/3752634129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa91c065b20 msgr2=0x7fa91c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa91c065b20 0x7fa91c067fe0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa9381f8cd0 tx=0x7fa9340079d0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 -- 172.21.15.130:0/3752634129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa938146b30 msgr2=0x7fa938138fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa938146b30 0x7fa938138fe0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fa930007e90 tx=0x7fa93000e4b0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 -- 172.21.15.130:0/3752634129 shutdown_connections 2023-09-13T06:07:25.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa91c065b20 0x7fa91c067fe0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9380d1f50 0x7fa9381574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa938146b30 0x7fa938138fe0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 --2- 172.21.15.130:0/3752634129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9380706c0 0x7fa93815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 -- 172.21.15.130:0/3752634129 >> 172.21.15.130:0/3752634129 conn(0x7fa9380d3090 msgr2=0x7fa9380b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:25.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 -- 172.21.15.130:0/3752634129 shutdown_connections 2023-09-13T06:07:25.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.048+0000 7fa93e631640 1 -- 172.21.15.130:0/3752634129 wait complete. 2023-09-13T06:07:25.070 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:25.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.204+0000 7f692d89e640 1 Processor -- start 2023-09-13T06:07:25.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.204+0000 7f692d89e640 1 -- start start 2023-09-13T06:07:25.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f692d89e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69280d1750 0x7f692815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f692d89e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69280b63c0 con 0x7f69280d1090 2023-09-13T06:07:25.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f692d89e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69280d0c20 con 0x7f6928146f30 2023-09-13T06:07:25.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f692d89e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692815dea0 con 0x7f69280d1750 2023-09-13T06:07:25.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f69267fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f69280d1090 0x7f6928146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48346/0 (socket says 172.21.15.130:48346) 2023-09-13T06:07:25.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f69267fc640 1 -- 172.21.15.130:0/2365865960 learned_addr learned my addr 172.21.15.130:0/2365865960 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:25.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6926ffd640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69280d1750 0x7f692815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398367520 0 0) 0x7f69280b63c0 con 0x7f69280d1090 2023-09-13T06:07:25.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6910003530 con 0x7f69280d1090 2023-09-13T06:07:25.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129393092 0 0) 0x7f69280d0c20 con 0x7f6928146f30 2023-09-13T06:07:25.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69280b63c0 con 0x7f6928146f30 2023-09-13T06:07:25.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3714465443 0 0) 0x7f6910003530 con 0x7f69280d1090 2023-09-13T06:07:25.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69280d1750 msgr2=0x7f692815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:25.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69280d1750 0x7f692815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 >> v1:172.21.15.164:6789/0 conn(0x7f6928146f30 legacy=0x7f69280b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69280b6610 con 0x7f69280d1090 2023-09-13T06:07:25.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f691c001680 con 0x7f69280d1090 2023-09-13T06:07:25.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 >> v1:172.21.15.130:6789/0 conn(0x7f69280d1090 legacy=0x7f6928146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6910003bb0 0x7f6910003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69280d1750 0x7f69100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6910004d10 0x7f6910005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691000ba90 con 0x7f6910003bb0 2023-09-13T06:07:25.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691000bc00 con 0x7f6910004d10 2023-09-13T06:07:25.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691000bdc0 con 0x7f69280d1750 2023-09-13T06:07:25.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6926ffd640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6910003bb0 0x7f6910003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f69267fc640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69280d1750 0x7f69100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f69277fe640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6910004d10 0x7f6910005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6926ffd640 1 -- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69280d1750 msgr2=0x7f69100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:25.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6926ffd640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69280d1750 0x7f69100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6926ffd640 1 -- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6910004d10 msgr2=0x7f6910005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:25.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6926ffd640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6910004d10 0x7f6910005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f6926ffd640 1 -- 172.21.15.130:0/2365865960 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6910003530 con 0x7f6910003bb0 2023-09-13T06:07:25.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f69277fe640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6910004d10 0x7f6910005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:25.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.208+0000 7f69267fc640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69280d1750 0x7f69100047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:25.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.212+0000 7f6926ffd640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6910003bb0 0x7f6910003fb0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6918009ae0 tx=0x7f691801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fe069962cf3094 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:25.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.212+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180a5530 con 0x7f6910003bb0 2023-09-13T06:07:25.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.212+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69180a5690 con 0x7f6910003bb0 2023-09-13T06:07:25.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.212+0000 7f6925ffb640 1 -- 172.21.15.130:0/2365865960 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180a5a40 con 0x7f6910003bb0 2023-09-13T06:07:25.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.212+0000 7f692d89e640 1 -- 172.21.15.130:0/2365865960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6910003bb0 msgr2=0x7f6910003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.212+0000 7f692d89e640 1 --2- 172.21.15.130:0/2365865960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6910003bb0 0x7f6910003fb0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6918009ae0 tx=0x7f691801c960 comp rx=0 tx=0).stop 2023-09-13T06:07:25.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.212+0000 7f69277fe640 1 -- 172.21.15.130:0/2365865960 reap_dead start 2023-09-13T06:07:25.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.212+0000 7f692d89e640 1 -- 172.21.15.130:0/2365865960 shutdown_connections 2023-09-13T06:07:25.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.212+0000 7f692d89e640 1 -- 172.21.15.130:0/2365865960 >> 172.21.15.130:0/2365865960 conn(0x7f692806f170 msgr2=0x7f692806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:25.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.212+0000 7f692d89e640 1 -- 172.21.15.130:0/2365865960 shutdown_connections 2023-09-13T06:07:25.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.212+0000 7f692d89e640 1 -- 172.21.15.130:0/2365865960 wait complete. 2023-09-13T06:07:25.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f692d89e640 1 Processor -- start 2023-09-13T06:07:25.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f692d89e640 1 -- start start 2023-09-13T06:07:25.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f692d89e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6910003bb0 0x7f692813d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f692d89e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f692815f8d0 0x7f692815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f692d89e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f692815b8e0 0x7f692815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f692d89e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6928160290 con 0x7f692815f8d0 2023-09-13T06:07:25.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f692d89e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692815d190 con 0x7f6910003bb0 2023-09-13T06:07:25.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f692d89e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692815c580 con 0x7f692815b8e0 2023-09-13T06:07:25.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f69267fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f692815f8d0 0x7f692815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f69267fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f692815f8d0 0x7f692815fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56826/0 (socket says 172.21.15.130:56826) 2023-09-13T06:07:25.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f69267fc640 1 -- 172.21.15.130:0/3145743461 learned_addr learned my addr 172.21.15.130:0/3145743461 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:25.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f69277fe640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f692815b8e0 0x7f692815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f6926ffd640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6910003bb0 0x7f692813d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f69267fc640 1 -- 172.21.15.130:0/3145743461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f692815b8e0 msgr2=0x7f692815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f69267fc640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f692815b8e0 0x7f692815bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f69267fc640 1 -- 172.21.15.130:0/3145743461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6910003bb0 msgr2=0x7f692813d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f69267fc640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6910003bb0 0x7f692813d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f69267fc640 1 -- 172.21.15.130:0/3145743461 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692815c860 con 0x7f692815f8d0 2023-09-13T06:07:25.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f69277fe640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f692815b8e0 0x7f692815bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:25.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f69267fc640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f692815f8d0 0x7f692815fd50 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f691c000fc0 tx=0x7f691c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:25.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f690ffff640 1 -- 172.21.15.130:0/3145743461 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c00ee60 con 0x7f692815f8d0 2023-09-13T06:07:25.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f690ffff640 1 -- 172.21.15.130:0/3145743461 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c00c8a0 con 0x7f692815f8d0 2023-09-13T06:07:25.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f690ffff640 1 -- 172.21.15.130:0/3145743461 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c00cc30 con 0x7f692815f8d0 2023-09-13T06:07:25.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f692d89e640 1 -- 172.21.15.130:0/3145743461 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692815cb40 con 0x7f692815f8d0 2023-09-13T06:07:25.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f692d89e640 1 -- 172.21.15.130:0/3145743461 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692815c2a0 con 0x7f692815f8d0 2023-09-13T06:07:25.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.216+0000 7f692d89e640 1 -- 172.21.15.130:0/3145743461 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692815d300 con 0x7f692815f8d0 2023-09-13T06:07:25.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.220+0000 7f690ffff640 1 -- 172.21.15.130:0/3145743461 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f691c01d460 con 0x7f692815f8d0 2023-09-13T06:07:25.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.220+0000 7f690ffff640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6914065b50 0x7f6914068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.220+0000 7f690ffff640 1 -- 172.21.15.130:0/3145743461 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f691c0832a0 con 0x7f692815f8d0 2023-09-13T06:07:25.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.220+0000 7f6926ffd640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6914065b50 0x7f6914068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.220+0000 7f6926ffd640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6914065b50 0x7f6914068010 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f69180af000 tx=0x7f69180046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:25.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.224+0000 7f690ffff640 1 -- 172.21.15.130:0/3145743461 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f691c0545e0 con 0x7f692815f8d0 2023-09-13T06:07:25.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.372+0000 7f692d89e640 1 -- 172.21.15.130:0/3145743461 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69280618a0 con 0x7f692815f8d0 2023-09-13T06:07:25.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.372+0000 7f690ffff640 1 -- 172.21.15.130:0/3145743461 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16563 (secure 0 0 0) 0x7f691c054170 con 0x7f692815f8d0 2023-09-13T06:07:25.376 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:25.376 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":126,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:19.406296+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:05.156883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:06.213714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:25.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 -- 172.21.15.130:0/3145743461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6914065b50 msgr2=0x7f6914068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6914065b50 0x7f6914068010 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f69180af000 tx=0x7f69180046d0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 -- 172.21.15.130:0/3145743461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f692815f8d0 msgr2=0x7f692815fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f692815f8d0 0x7f692815fd50 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f691c000fc0 tx=0x7f691c00ec10 comp rx=0 tx=0).stop 2023-09-13T06:07:25.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 -- 172.21.15.130:0/3145743461 shutdown_connections 2023-09-13T06:07:25.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6914065b50 0x7f6914068010 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f692815b8e0 0x7f692815bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f692815f8d0 0x7f692815fd50 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 --2- 172.21.15.130:0/3145743461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6910003bb0 0x7f692813d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 -- 172.21.15.130:0/3145743461 >> 172.21.15.130:0/3145743461 conn(0x7f692806f170 msgr2=0x7f692806ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:25.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 -- 172.21.15.130:0/3145743461 shutdown_connections 2023-09-13T06:07:25.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.376+0000 7f692d89e640 1 -- 172.21.15.130:0/3145743461 wait complete. 2023-09-13T06:07:25.397 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:07:05.156883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:07:06.213714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:07:25.398 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:07:25.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.536+0000 7f9987e93640 1 Processor -- start 2023-09-13T06:07:25.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.536+0000 7f9987e93640 1 -- start start 2023-09-13T06:07:25.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9987e93640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9980144d70 0x7f99800ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9987e93640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f99800b1b70 0x7f99800b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9987e93640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99800b3120 con 0x7f99800b2780 2023-09-13T06:07:25.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9987e93640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99800b2430 con 0x7f99800b1b70 2023-09-13T06:07:25.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9987e93640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99800cedb0 con 0x7f9980144d70 2023-09-13T06:07:25.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9986430640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f99800b1b70 0x7f99800b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9986430640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f99800b1b70 0x7f99800b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56842/0 (socket says 172.21.15.130:56842) 2023-09-13T06:07:25.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9986430640 1 -- 172.21.15.130:0/2485065951 learned_addr learned my addr 172.21.15.130:0/2485065951 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:25.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9986430640 1 -- 172.21.15.130:0/2485065951 >> v2:172.21.15.164:3300/0 conn(0x7f9980144d70 msgr2=0x7f99800ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:25.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9986430640 1 --2- 172.21.15.130:0/2485065951 >> v2:172.21.15.164:3300/0 conn(0x7f9980144d70 0x7f99800ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9986430640 1 -- 172.21.15.130:0/2485065951 >> v1:172.21.15.164:6789/0 conn(0x7f99800b2780 legacy=0x7f99800b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:25.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.540+0000 7f9986430640 1 -- 172.21.15.130:0/2485065951 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99800b2150 con 0x7f99800b1b70 2023-09-13T06:07:25.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9986430640 1 --2- 172.21.15.130:0/2485065951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99800b1b70 0x7f99800b2be0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f99800cff90 tx=0x7f997801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3713c1a907d031a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:25.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9984c2d640 1 -- 172.21.15.130:0/2485065951 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99780a5740 con 0x7f99800b1b70 2023-09-13T06:07:25.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9984c2d640 1 -- 172.21.15.130:0/2485065951 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99780a58a0 con 0x7f99800b1b70 2023-09-13T06:07:25.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9984c2d640 1 -- 172.21.15.130:0/2485065951 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99780a5c30 con 0x7f99800b1b70 2023-09-13T06:07:25.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9987e93640 1 -- 172.21.15.130:0/2485065951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99800b1b70 msgr2=0x7f99800b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9987e93640 1 --2- 172.21.15.130:0/2485065951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99800b1b70 0x7f99800b2be0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f99800cff90 tx=0x7f997801c990 comp rx=0 tx=0).stop 2023-09-13T06:07:25.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9987e93640 1 -- 172.21.15.130:0/2485065951 shutdown_connections 2023-09-13T06:07:25.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9987e93640 1 --2- 172.21.15.130:0/2485065951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99800b1b70 0x7f99800b2be0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9987e93640 1 --2- 172.21.15.130:0/2485065951 >> v2:172.21.15.164:3300/0 conn(0x7f9980144d70 0x7f99800ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9987e93640 1 -- 172.21.15.130:0/2485065951 >> 172.21.15.130:0/2485065951 conn(0x7f9980065990 msgr2=0x7f9980065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:25.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9987e93640 1 -- 172.21.15.130:0/2485065951 shutdown_connections 2023-09-13T06:07:25.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9987e93640 1 -- 172.21.15.130:0/2485065951 wait complete. 2023-09-13T06:07:25.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9987e93640 1 Processor -- start 2023-09-13T06:07:25.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.544+0000 7f9987e93640 1 -- start start 2023-09-13T06:07:25.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9987e93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99800b1b70 0x7f998013be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9987e93640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99800b2780 0x7f99801f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9987e93640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9980144d70 0x7f99801594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9987e93640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9980158090 con 0x7f99800b1b70 2023-09-13T06:07:25.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9987e93640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9980158c60 con 0x7f99800b2780 2023-09-13T06:07:25.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9987e93640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998013a5d0 con 0x7f9980144d70 2023-09-13T06:07:25.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9985c2f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99800b1b70 0x7f998013be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9985c2f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99800b1b70 0x7f998013be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56850/0 (socket says 172.21.15.130:56850) 2023-09-13T06:07:25.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9985c2f640 1 -- 172.21.15.130:0/150433408 learned_addr learned my addr 172.21.15.130:0/150433408 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:25.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9986430640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9980144d70 0x7f99801594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f998542e640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99800b2780 0x7f99801f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9985c2f640 1 -- 172.21.15.130:0/150433408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9980144d70 msgr2=0x7f99801594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9985c2f640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9980144d70 0x7f99801594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9985c2f640 1 -- 172.21.15.130:0/150433408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99800b2780 msgr2=0x7f99801f9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9985c2f640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99800b2780 0x7f99801f9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9985c2f640 1 -- 172.21.15.130:0/150433408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978009b30 con 0x7f99800b1b70 2023-09-13T06:07:25.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f998542e640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99800b2780 0x7f99801f9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:25.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9985c2f640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99800b1b70 0x7f998013be20 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f997c00b440 tx=0x7f997c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:25.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f99767fc640 1 -- 172.21.15.130:0/150433408 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c011890 con 0x7f99800b1b70 2023-09-13T06:07:25.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f99767fc640 1 -- 172.21.15.130:0/150433408 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c011a10 con 0x7f99800b1b70 2023-09-13T06:07:25.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f99767fc640 1 -- 172.21.15.130:0/150433408 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c011dc0 con 0x7f99800b1b70 2023-09-13T06:07:25.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9987e93640 1 -- 172.21.15.130:0/150433408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998013c360 con 0x7f99800b1b70 2023-09-13T06:07:25.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9987e93640 1 -- 172.21.15.130:0/150433408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9980157510 con 0x7f99800b1b70 2023-09-13T06:07:25.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.548+0000 7f9987e93640 1 -- 172.21.15.130:0/150433408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99800618a0 con 0x7f99800b1b70 2023-09-13T06:07:25.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.552+0000 7f99767fc640 1 -- 172.21.15.130:0/150433408 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f997c01a400 con 0x7f99800b1b70 2023-09-13T06:07:25.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.552+0000 7f99767fc640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9964065b20 0x7f9964067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.552+0000 7f99767fc640 1 -- 172.21.15.130:0/150433408 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f997c083610 con 0x7f99800b1b70 2023-09-13T06:07:25.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.552+0000 7f998542e640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9964065b20 0x7f9964067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.552+0000 7f998542e640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9964065b20 0x7f9964067fe0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f998015cc00 tx=0x7f9970009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:25.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.556+0000 7f99767fc640 1 -- 172.21.15.130:0/150433408 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f997c050ff0 con 0x7f99800b1b70 2023-09-13T06:07:25.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.704+0000 7f9987e93640 1 -- 172.21.15.130:0/150433408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99800ad490 con 0x7f99800b1b70 2023-09-13T06:07:25.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.704+0000 7f99767fc640 1 -- 172.21.15.130:0/150433408 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f997c054610 con 0x7f99800b1b70 2023-09-13T06:07:25.707 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:07:25.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 -- 172.21.15.130:0/150433408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9964065b20 msgr2=0x7f9964067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9964065b20 0x7f9964067fe0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f998015cc00 tx=0x7f9970009040 comp rx=0 tx=0).stop 2023-09-13T06:07:25.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 -- 172.21.15.130:0/150433408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99800b1b70 msgr2=0x7f998013be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99800b1b70 0x7f998013be20 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f997c00b440 tx=0x7f997c00b900 comp rx=0 tx=0).stop 2023-09-13T06:07:25.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 -- 172.21.15.130:0/150433408 shutdown_connections 2023-09-13T06:07:25.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9964065b20 0x7f9964067fe0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99800b2780 0x7f99801f9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9980144d70 0x7f99801594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 --2- 172.21.15.130:0/150433408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99800b1b70 0x7f998013be20 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 -- 172.21.15.130:0/150433408 >> 172.21.15.130:0/150433408 conn(0x7f9980065990 msgr2=0x7f9980143380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:25.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 -- 172.21.15.130:0/150433408 shutdown_connections 2023-09-13T06:07:25.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.708+0000 7f9987e93640 1 -- 172.21.15.130:0/150433408 wait complete. 2023-09-13T06:07:25.727 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:07:25.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.868+0000 7f895814d640 1 Processor -- start 2023-09-13T06:07:25.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.868+0000 7f895814d640 1 -- start start 2023-09-13T06:07:25.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.868+0000 7f895814d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8950159fc0 0x7f89500cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.868+0000 7f895814d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f895015b0c0 0x7f89500707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.868+0000 7f895814d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895015ac30 con 0x7f895015a3a0 2023-09-13T06:07:25.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.868+0000 7f895814d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89500cf710 con 0x7f8950159fc0 2023-09-13T06:07:25.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.868+0000 7f895814d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89500cf920 con 0x7f895015b0c0 2023-09-13T06:07:25.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f8955ee9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8950159fc0 0x7f89500cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f89556e8640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f895015a3a0 0x7f895015e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48354/0 (socket says 172.21.15.130:48354) 2023-09-13T06:07:25.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f89556e8640 1 -- 172.21.15.130:0/71084170 learned_addr learned my addr 172.21.15.130:0/71084170 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:25.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f89566ea640 1 --2- 172.21.15.130:0/71084170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f895015b0c0 0x7f89500707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f8955ee9640 1 -- 172.21.15.130:0/71084170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f895015b0c0 msgr2=0x7f89500707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:25.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f8955ee9640 1 --2- 172.21.15.130:0/71084170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f895015b0c0 0x7f89500707c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f8955ee9640 1 -- 172.21.15.130:0/71084170 >> v1:172.21.15.130:6789/0 conn(0x7f895015a3a0 legacy=0x7f895015e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f8955ee9640 1 -- 172.21.15.130:0/71084170 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89500cfc00 con 0x7f8950159fc0 2023-09-13T06:07:25.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f8954ee7640 1 -- 172.21.15.130:0/71084170 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227570608 0 0) 0x7f895015ac30 con 0x7f895015a3a0 2023-09-13T06:07:25.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f8955ee9640 1 --2- 172.21.15.130:0/71084170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8950159fc0 0x7f89500cf1d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f894c0097c0 tx=0x7f894c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b15093837e1025 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:25.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f8954ee7640 1 -- 172.21.15.130:0/71084170 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c0ab600 con 0x7f8950159fc0 2023-09-13T06:07:25.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f8954ee7640 1 -- 172.21.15.130:0/71084170 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c0a7050 con 0x7f8950159fc0 2023-09-13T06:07:25.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.872+0000 7f8954ee7640 1 -- 172.21.15.130:0/71084170 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c0ab980 con 0x7f8950159fc0 2023-09-13T06:07:25.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 -- 172.21.15.130:0/71084170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8950159fc0 msgr2=0x7f89500cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 --2- 172.21.15.130:0/71084170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8950159fc0 0x7f89500cf1d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f894c0097c0 tx=0x7f894c01c480 comp rx=0 tx=0).stop 2023-09-13T06:07:25.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 -- 172.21.15.130:0/71084170 shutdown_connections 2023-09-13T06:07:25.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 --2- 172.21.15.130:0/71084170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f895015b0c0 0x7f89500707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 --2- 172.21.15.130:0/71084170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8950159fc0 0x7f89500cf1d0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 -- 172.21.15.130:0/71084170 >> 172.21.15.130:0/71084170 conn(0x7f895006a730 msgr2=0x7f8950065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:25.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 -- 172.21.15.130:0/71084170 shutdown_connections 2023-09-13T06:07:25.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 -- 172.21.15.130:0/71084170 wait complete. 2023-09-13T06:07:25.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 Processor -- start 2023-09-13T06:07:25.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 -- start start 2023-09-13T06:07:25.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8950159fc0 0x7f895014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f895015a3a0 0x7f895006d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f895015b0c0 0x7f895006da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89500ace60 con 0x7f895015b0c0 2023-09-13T06:07:25.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89500abdc0 con 0x7f8950159fc0 2023-09-13T06:07:25.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f895814d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89500ac0a0 con 0x7f895015a3a0 2023-09-13T06:07:25.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f89566ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f895015b0c0 0x7f895006da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f89566ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f895015b0c0 0x7f895006da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56864/0 (socket says 172.21.15.130:56864) 2023-09-13T06:07:25.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.876+0000 7f89566ea640 1 -- 172.21.15.130:0/858810224 learned_addr learned my addr 172.21.15.130:0/858810224 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:25.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89556e8640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f895015a3a0 0x7f895006d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f8955ee9640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8950159fc0 0x7f895014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89566ea640 1 -- 172.21.15.130:0/858810224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f895015a3a0 msgr2=0x7f895006d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89566ea640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f895015a3a0 0x7f895006d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89566ea640 1 -- 172.21.15.130:0/858810224 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8950159fc0 msgr2=0x7f895014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:25.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89566ea640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8950159fc0 0x7f895014db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:25.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89566ea640 1 -- 172.21.15.130:0/858810224 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c009420 con 0x7f895015b0c0 2023-09-13T06:07:25.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f8955ee9640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8950159fc0 0x7f895014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:25.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89556e8640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f895015a3a0 0x7f895006d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:25.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89566ea640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f895015b0c0 0x7f895006da70 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f894800efc0 tx=0x7f894800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:25.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89467fc640 1 -- 172.21.15.130:0/858810224 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948014480 con 0x7f895015b0c0 2023-09-13T06:07:25.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89467fc640 1 -- 172.21.15.130:0/858810224 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894800f040 con 0x7f895015b0c0 2023-09-13T06:07:25.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f895814d640 1 -- 172.21.15.130:0/858810224 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89500ac380 con 0x7f895015b0c0 2023-09-13T06:07:25.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89467fc640 1 -- 172.21.15.130:0/858810224 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948014820 con 0x7f895015b0c0 2023-09-13T06:07:25.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f895814d640 1 -- 172.21.15.130:0/858810224 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89500ac940 con 0x7f895015b0c0 2023-09-13T06:07:25.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f895814d640 1 -- 172.21.15.130:0/858810224 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89500acb60 con 0x7f895015b0c0 2023-09-13T06:07:25.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89467fc640 1 -- 172.21.15.130:0/858810224 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8948014980 con 0x7f895015b0c0 2023-09-13T06:07:25.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89467fc640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8934065b20 0x7f8934067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:25.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f89467fc640 1 -- 172.21.15.130:0/858810224 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8948083e50 con 0x7f895015b0c0 2023-09-13T06:07:25.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.880+0000 7f8955ee9640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8934065b20 0x7f8934067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:25.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.884+0000 7f8955ee9640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8934065b20 0x7f8934067fe0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f894c0ad000 tx=0x7f894c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:25.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:25.884+0000 7f89467fc640 1 -- 172.21.15.130:0/858810224 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f89480517a0 con 0x7f895015b0c0 2023-09-13T06:07:26.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.032+0000 7f895814d640 1 -- 172.21.15.130:0/858810224 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f89500618a0 con 0x7f895015b0c0 2023-09-13T06:07:26.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.032+0000 7f89467fc640 1 -- 172.21.15.130:0/858810224 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8948054dc0 con 0x7f895015b0c0 2023-09-13T06:07:26.037 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:07:26.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 -- 172.21.15.130:0/858810224 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8934065b20 msgr2=0x7f8934067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8934065b20 0x7f8934067fe0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f894c0ad000 tx=0x7f894c0a6000 comp rx=0 tx=0).stop 2023-09-13T06:07:26.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 -- 172.21.15.130:0/858810224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f895015b0c0 msgr2=0x7f895006da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f895015b0c0 0x7f895006da70 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f894800efc0 tx=0x7f894800c490 comp rx=0 tx=0).stop 2023-09-13T06:07:26.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 -- 172.21.15.130:0/858810224 shutdown_connections 2023-09-13T06:07:26.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8934065b20 0x7f8934067fe0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f895015b0c0 0x7f895006da70 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f895015a3a0 0x7f895006d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 --2- 172.21.15.130:0/858810224 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8950159fc0 0x7f895014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 -- 172.21.15.130:0/858810224 >> 172.21.15.130:0/858810224 conn(0x7f895006a730 msgr2=0x7f89500b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:26.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 -- 172.21.15.130:0/858810224 shutdown_connections 2023-09-13T06:07:26.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.036+0000 7f895814d640 1 -- 172.21.15.130:0/858810224 wait complete. 2023-09-13T06:07:26.056 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:07:26.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de7d40640 1 Processor -- start 2023-09-13T06:07:26.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de7d40640 1 -- start start 2023-09-13T06:07:26.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de7d40640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6de00d2cd0 0x7f6de01612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de7d40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de01617e0 0x7f6de00cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de7d40640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de015dd40 con 0x7f6de015ae10 2023-09-13T06:07:26.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de7d40640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de015e020 con 0x7f6de00d2cd0 2023-09-13T06:07:26.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de7d40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de015e300 con 0x7f6de01617e0 2023-09-13T06:07:26.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de62dd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de01617e0 0x7f6de00cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de52db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6de00d2cd0 0x7f6de01612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de5adc640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f6de015ae10 0x7f6de00d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:52446/0 (socket says 172.21.15.130:52446) 2023-09-13T06:07:26.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de5adc640 1 -- 172.21.15.130:0/4169510475 learned_addr learned my addr 172.21.15.130:0/4169510475 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:26.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de52db640 1 -- 172.21.15.130:0/4169510475 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de01617e0 msgr2=0x7f6de00cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:26.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.196+0000 7f6de52db640 1 --2- 172.21.15.130:0/4169510475 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de01617e0 0x7f6de00cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.200+0000 7f6de52db640 1 -- 172.21.15.130:0/4169510475 >> v1:172.21.15.164:6789/0 conn(0x7f6de015ae10 legacy=0x7f6de00d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.200+0000 7f6de52db640 1 -- 172.21.15.130:0/4169510475 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de015e5e0 con 0x7f6de00d2cd0 2023-09-13T06:07:26.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.200+0000 7f6de52db640 1 --2- 172.21.15.130:0/4169510475 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de00d2cd0 0x7f6de01612a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00097c0 tx=0x7f6dd001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2494b3b6ab2aa4d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:26.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.200+0000 7f6de4ada640 1 -- 172.21.15.130:0/4169510475 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00ab610 con 0x7f6de00d2cd0 2023-09-13T06:07:26.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.200+0000 7f6de4ada640 1 -- 172.21.15.130:0/4169510475 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd00ab770 con 0x7f6de00d2cd0 2023-09-13T06:07:26.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.200+0000 7f6de4ada640 1 -- 172.21.15.130:0/4169510475 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00abb00 con 0x7f6de00d2cd0 2023-09-13T06:07:26.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 -- 172.21.15.130:0/4169510475 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de00d2cd0 msgr2=0x7f6de01612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 --2- 172.21.15.130:0/4169510475 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de00d2cd0 0x7f6de01612a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00097c0 tx=0x7f6dd001c3f0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 -- 172.21.15.130:0/4169510475 shutdown_connections 2023-09-13T06:07:26.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 --2- 172.21.15.130:0/4169510475 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de01617e0 0x7f6de00cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 --2- 172.21.15.130:0/4169510475 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de00d2cd0 0x7f6de01612a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 -- 172.21.15.130:0/4169510475 >> 172.21.15.130:0/4169510475 conn(0x7f6de0065990 msgr2=0x7f6de0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:26.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 -- 172.21.15.130:0/4169510475 shutdown_connections 2023-09-13T06:07:26.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 -- 172.21.15.130:0/4169510475 wait complete. 2023-09-13T06:07:26.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 Processor -- start 2023-09-13T06:07:26.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 -- start start 2023-09-13T06:07:26.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de00d2cd0 0x7f6de01569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de015ae10 0x7f6de015bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6de01617e0 0x7f6de00d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de015cae0 con 0x7f6de01617e0 2023-09-13T06:07:26.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de0155be0 con 0x7f6de00d2cd0 2023-09-13T06:07:26.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de7d40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de0155ec0 con 0x7f6de015ae10 2023-09-13T06:07:26.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de62dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6de01617e0 0x7f6de00d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de62dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6de01617e0 0x7f6de00d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56880/0 (socket says 172.21.15.130:56880) 2023-09-13T06:07:26.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de62dd640 1 -- 172.21.15.130:0/744597843 learned_addr learned my addr 172.21.15.130:0/744597843 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:26.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de5adc640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de00d2cd0 0x7f6de01569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de52db640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de015ae10 0x7f6de015bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de62dd640 1 -- 172.21.15.130:0/744597843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de015ae10 msgr2=0x7f6de015bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de62dd640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de015ae10 0x7f6de015bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de62dd640 1 -- 172.21.15.130:0/744597843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de00d2cd0 msgr2=0x7f6de01569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de62dd640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de00d2cd0 0x7f6de01569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.204+0000 7f6de62dd640 1 -- 172.21.15.130:0/744597843 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0009420 con 0x7f6de01617e0 2023-09-13T06:07:26.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6de62dd640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6de01617e0 0x7f6de00d32a0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800efc0 tx=0x7f6dd800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:26.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6dd67fc640 1 -- 172.21.15.130:0/744597843 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8009ba0 con 0x7f6de01617e0 2023-09-13T06:07:26.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6dd67fc640 1 -- 172.21.15.130:0/744597843 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd800f040 con 0x7f6de01617e0 2023-09-13T06:07:26.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6de7d40640 1 -- 172.21.15.130:0/744597843 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de01561a0 con 0x7f6de01617e0 2023-09-13T06:07:26.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6dd67fc640 1 -- 172.21.15.130:0/744597843 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80146c0 con 0x7f6de01617e0 2023-09-13T06:07:26.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6de7d40640 1 -- 172.21.15.130:0/744597843 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de0152890 con 0x7f6de01617e0 2023-09-13T06:07:26.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6de7d40640 1 -- 172.21.15.130:0/744597843 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de00618a0 con 0x7f6de01617e0 2023-09-13T06:07:26.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6dd67fc640 1 -- 172.21.15.130:0/744597843 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6dd8014820 con 0x7f6de01617e0 2023-09-13T06:07:26.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6dd67fc640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6dc4065b20 0x7f6dc4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6dd67fc640 1 -- 172.21.15.130:0/744597843 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dd8083d40 con 0x7f6de01617e0 2023-09-13T06:07:26.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6de5adc640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6dc4065b20 0x7f6dc4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.208+0000 7f6de5adc640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6dc4065b20 0x7f6dc4067fe0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc005890 tx=0x7f6ddc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:26.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.212+0000 7f6dd67fc640 1 -- 172.21.15.130:0/744597843 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6dd8051720 con 0x7f6de01617e0 2023-09-13T06:07:26.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 -- 172.21.15.130:0/744597843 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6de015cc20 con 0x7f6de01617e0 2023-09-13T06:07:26.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6dd67fc640 1 -- 172.21.15.130:0/744597843 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6dd8018020 con 0x7f6de01617e0 2023-09-13T06:07:26.362 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:07:26.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 -- 172.21.15.130:0/744597843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6dc4065b20 msgr2=0x7f6dc4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6dc4065b20 0x7f6dc4067fe0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc005890 tx=0x7f6ddc009040 comp rx=0 tx=0).stop 2023-09-13T06:07:26.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 -- 172.21.15.130:0/744597843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6de01617e0 msgr2=0x7f6de00d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6de01617e0 0x7f6de00d32a0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800efc0 tx=0x7f6dd800c490 comp rx=0 tx=0).stop 2023-09-13T06:07:26.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 -- 172.21.15.130:0/744597843 shutdown_connections 2023-09-13T06:07:26.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6dc4065b20 0x7f6dc4067fe0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6de01617e0 0x7f6de00d32a0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de015ae10 0x7f6de015bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 --2- 172.21.15.130:0/744597843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de00d2cd0 0x7f6de01569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 -- 172.21.15.130:0/744597843 >> 172.21.15.130:0/744597843 conn(0x7f6de0065990 msgr2=0x7f6de0065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:26.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 -- 172.21.15.130:0/744597843 shutdown_connections 2023-09-13T06:07:26.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.360+0000 7f6de7d40640 1 -- 172.21.15.130:0/744597843 wait complete. 2023-09-13T06:07:26.383 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:26.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff147b96640 1 Processor -- start 2023-09-13T06:07:26.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff147b96640 1 -- start start 2023-09-13T06:07:26.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff147b96640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff1400d1750 0x7ff14015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff147b96640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1400b63c0 con 0x7ff1400d1090 2023-09-13T06:07:26.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff147b96640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1400d0c20 con 0x7ff140146f30 2023-09-13T06:07:26.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff147b96640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14015dea0 con 0x7ff1400d1750 2023-09-13T06:07:26.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff145932640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff1400d1750 0x7ff14015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff145932640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff1400d1750 0x7ff14015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56884/0 (socket says 172.21.15.130:56884) 2023-09-13T06:07:26.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff145131640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff1400d1090 0x7ff140146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48356/0 (socket says 172.21.15.130:48356) 2023-09-13T06:07:26.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff145932640 1 -- 172.21.15.130:0/810729058 learned_addr learned my addr 172.21.15.130:0/810729058 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:26.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff145932640 1 -- 172.21.15.130:0/810729058 >> v1:172.21.15.164:6789/0 conn(0x7ff140146f30 legacy=0x7ff1400b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:26.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff145932640 1 -- 172.21.15.130:0/810729058 >> v1:172.21.15.130:6789/0 conn(0x7ff1400d1090 legacy=0x7ff140146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff144930640 1 -- 172.21.15.130:0/810729058 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658598116 0 0) 0x7ff1400b63c0 con 0x7ff1400d1090 2023-09-13T06:07:26.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.520+0000 7ff145932640 1 -- 172.21.15.130:0/810729058 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400b6610 con 0x7ff1400d1750 2023-09-13T06:07:26.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.524+0000 7ff145932640 1 --2- 172.21.15.130:0/810729058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1400d1750 0x7ff14015d960 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009870 tx=0x7ff13c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a7fcb722e470a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:26.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.524+0000 7ff144930640 1 -- 172.21.15.130:0/810729058 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0ab640 con 0x7ff1400d1750 2023-09-13T06:07:26.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.524+0000 7ff144930640 1 -- 172.21.15.130:0/810729058 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c0a7070 con 0x7ff1400d1750 2023-09-13T06:07:26.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.524+0000 7ff144930640 1 -- 172.21.15.130:0/810729058 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0ab9c0 con 0x7ff1400d1750 2023-09-13T06:07:26.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.524+0000 7ff147b96640 1 -- 172.21.15.130:0/810729058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1400d1750 msgr2=0x7ff14015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.524+0000 7ff147b96640 1 --2- 172.21.15.130:0/810729058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1400d1750 0x7ff14015d960 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009870 tx=0x7ff13c01c440 comp rx=0 tx=0).stop 2023-09-13T06:07:26.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.524+0000 7ff147b96640 1 -- 172.21.15.130:0/810729058 shutdown_connections 2023-09-13T06:07:26.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.524+0000 7ff147b96640 1 --2- 172.21.15.130:0/810729058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1400d1750 0x7ff14015d960 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.524+0000 7ff147b96640 1 -- 172.21.15.130:0/810729058 >> 172.21.15.130:0/810729058 conn(0x7ff14006f170 msgr2=0x7ff14006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:26.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.524+0000 7ff147b96640 1 -- 172.21.15.130:0/810729058 shutdown_connections 2023-09-13T06:07:26.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.524+0000 7ff147b96640 1 -- 172.21.15.130:0/810729058 wait complete. 2023-09-13T06:07:26.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff147b96640 1 Processor -- start 2023-09-13T06:07:26.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff147b96640 1 -- start start 2023-09-13T06:07:26.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff147b96640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1400d1090 0x7ff14013f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff147b96640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1400d1750 0x7ff14015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff147b96640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff140146f30 0x7ff14015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff147b96640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14015cfb0 con 0x7ff1400d1750 2023-09-13T06:07:26.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff147b96640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14015c7a0 con 0x7ff1400d1090 2023-09-13T06:07:26.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff147b96640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14015c9f0 con 0x7ff140146f30 2023-09-13T06:07:26.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff145131640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1400d1750 0x7ff14015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff145131640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1400d1750 0x7ff14015bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56898/0 (socket says 172.21.15.130:56898) 2023-09-13T06:07:26.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff145131640 1 -- 172.21.15.130:0/1083386766 learned_addr learned my addr 172.21.15.130:0/1083386766 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:26.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff146133640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff140146f30 0x7ff14015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff145932640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1400d1090 0x7ff14013f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff145131640 1 -- 172.21.15.130:0/1083386766 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff140146f30 msgr2=0x7ff14015f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff145131640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff140146f30 0x7ff14015f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff145131640 1 -- 172.21.15.130:0/1083386766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1400d1090 msgr2=0x7ff14013f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff145131640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1400d1090 0x7ff14013f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff145131640 1 -- 172.21.15.130:0/1083386766 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0094d0 con 0x7ff1400d1750 2023-09-13T06:07:26.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff145131640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1400d1750 0x7ff14015bed0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ff13000c4b0 tx=0x7ff13000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:26.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff1367fc640 1 -- 172.21.15.130:0/1083386766 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1300074e0 con 0x7ff1400d1750 2023-09-13T06:07:26.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff1367fc640 1 -- 172.21.15.130:0/1083386766 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff130007660 con 0x7ff1400d1750 2023-09-13T06:07:26.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff1367fc640 1 -- 172.21.15.130:0/1083386766 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130004a30 con 0x7ff1400d1750 2023-09-13T06:07:26.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff147b96640 1 -- 172.21.15.130:0/1083386766 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14015ccd0 con 0x7ff1400d1750 2023-09-13T06:07:26.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.528+0000 7ff147b96640 1 -- 172.21.15.130:0/1083386766 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1401477b0 con 0x7ff1400d1750 2023-09-13T06:07:26.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.532+0000 7ff147b96640 1 -- 172.21.15.130:0/1083386766 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff140147330 con 0x7ff1400d1750 2023-09-13T06:07:26.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.532+0000 7ff1367fc640 1 -- 172.21.15.130:0/1083386766 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff130004b90 con 0x7ff1400d1750 2023-09-13T06:07:26.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.532+0000 7ff1367fc640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff124065b20 0x7ff124067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.532+0000 7ff1367fc640 1 -- 172.21.15.130:0/1083386766 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff130082430 con 0x7ff1400d1750 2023-09-13T06:07:26.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.532+0000 7ff145932640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff124065b20 0x7ff124067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.532+0000 7ff145932640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff124065b20 0x7ff124067fe0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0af000 tx=0x7ff13c0b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:26.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.536+0000 7ff1367fc640 1 -- 172.21.15.130:0/1083386766 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff140147330 con 0x7ff1400d1750 2023-09-13T06:07:26.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.716+0000 7ff147b96640 1 -- 172.21.15.130:0/1083386766 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff140147330 con 0x7ff1400d1750 2023-09-13T06:07:26.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.716+0000 7ff1367fc640 1 -- 172.21.15.130:0/1083386766 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4927 (secure 0 0 0) 0x7ff140147330 con 0x7ff1400d1750 2023-09-13T06:07:26.720 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:26.721 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2121062896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2121062896},{"type":"v1","addr":"172.21.15.164:6834","nonce":2121062896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3004233572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3004233572},{"type":"v1","addr":"172.21.15.164:6835","nonce":3004233572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7311,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3730755977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3730755977},{"type":"v1","addr":"172.21.15.130:6835","nonce":3730755977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:07.210560+0000","modified":"2023-09-13T06:07:10.218199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/4103504372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4103504372},{"type":"v1","addr":"172.21.15.130:6837","nonce":4103504372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-09-13T06:07:26.722 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 59 2023-09-13T06:07:26.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 -- 172.21.15.130:0/1083386766 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff124065b20 msgr2=0x7ff124067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff124065b20 0x7ff124067fe0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0af000 tx=0x7ff13c0b6040 comp rx=0 tx=0).stop 2023-09-13T06:07:26.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 -- 172.21.15.130:0/1083386766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1400d1750 msgr2=0x7ff14015bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1400d1750 0x7ff14015bed0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ff13000c4b0 tx=0x7ff13000c970 comp rx=0 tx=0).stop 2023-09-13T06:07:26.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 -- 172.21.15.130:0/1083386766 shutdown_connections 2023-09-13T06:07:26.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff124065b20 0x7ff124067fe0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff140146f30 0x7ff14015f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1400d1750 0x7ff14015bed0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 --2- 172.21.15.130:0/1083386766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1400d1090 0x7ff14013f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 -- 172.21.15.130:0/1083386766 >> 172.21.15.130:0/1083386766 conn(0x7ff14006f170 msgr2=0x7ff1400cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:26.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 -- 172.21.15.130:0/1083386766 shutdown_connections 2023-09-13T06:07:26.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.720+0000 7ff147b96640 1 -- 172.21.15.130:0/1083386766 wait complete. 2023-09-13T06:07:26.740 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:26.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb943a19640 1 Processor -- start 2023-09-13T06:07:26.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb943a19640 1 -- start start 2023-09-13T06:07:26.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb943a19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb93c0d1750 0x7fb93c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb943a19640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c0b63c0 con 0x7fb93c146f30 2023-09-13T06:07:26.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb943a19640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c0d0c20 con 0x7fb93c0d1090 2023-09-13T06:07:26.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb943a19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c15dea0 con 0x7fb93c0d1750 2023-09-13T06:07:26.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb941fb6640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb93c146f30 0x7fb93c0b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48370/0 (socket says 172.21.15.130:48370) 2023-09-13T06:07:26.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb941fb6640 1 -- 172.21.15.130:0/2416601736 learned_addr learned my addr 172.21.15.130:0/2416601736 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:26.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb9417b5640 1 --2- 172.21.15.130:0/2416601736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb93c0d1750 0x7fb93c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb933fff640 1 -- 172.21.15.130:0/2416601736 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879901281 0 0) 0x7fb93c0b63c0 con 0x7fb93c146f30 2023-09-13T06:07:26.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb933fff640 1 -- 172.21.15.130:0/2416601736 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb928003530 con 0x7fb93c146f30 2023-09-13T06:07:26.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb933fff640 1 -- 172.21.15.130:0/2416601736 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907967785 0 0) 0x7fb93c0d0c20 con 0x7fb93c0d1090 2023-09-13T06:07:26.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb933fff640 1 -- 172.21.15.130:0/2416601736 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb93c0b63c0 con 0x7fb93c0d1090 2023-09-13T06:07:26.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb9417b5640 1 -- 172.21.15.130:0/2416601736 >> v1:172.21.15.164:6789/0 conn(0x7fb93c0d1090 legacy=0x7fb93c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb9417b5640 1 -- 172.21.15.130:0/2416601736 >> v1:172.21.15.130:6789/0 conn(0x7fb93c146f30 legacy=0x7fb93c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb933fff640 1 -- 172.21.15.130:0/2416601736 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3434929976 0 0) 0x7fb928003530 con 0x7fb93c146f30 2023-09-13T06:07:26.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.876+0000 7fb9417b5640 1 -- 172.21.15.130:0/2416601736 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c0b6610 con 0x7fb93c0d1750 2023-09-13T06:07:26.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.880+0000 7fb9417b5640 1 --2- 172.21.15.130:0/2416601736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb93c0d1750 0x7fb93c15d960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb9380097f0 tx=0x7fb93801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=745b851ff7959ad9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:26.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.880+0000 7fb933fff640 1 -- 172.21.15.130:0/2416601736 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934001a00 con 0x7fb93c0d1750 2023-09-13T06:07:26.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.880+0000 7fb933fff640 1 -- 172.21.15.130:0/2416601736 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9380a7050 con 0x7fb93c0d1750 2023-09-13T06:07:26.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.880+0000 7fb933fff640 1 -- 172.21.15.130:0/2416601736 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9380ab620 con 0x7fb93c0d1750 2023-09-13T06:07:26.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.880+0000 7fb943a19640 1 -- 172.21.15.130:0/2416601736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb93c0d1750 msgr2=0x7fb93c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.880+0000 7fb943a19640 1 --2- 172.21.15.130:0/2416601736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb93c0d1750 0x7fb93c15d960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb9380097f0 tx=0x7fb93801c370 comp rx=0 tx=0).stop 2023-09-13T06:07:26.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.880+0000 7fb943a19640 1 -- 172.21.15.130:0/2416601736 shutdown_connections 2023-09-13T06:07:26.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.880+0000 7fb943a19640 1 --2- 172.21.15.130:0/2416601736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb93c0d1750 0x7fb93c15d960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.880+0000 7fb943a19640 1 -- 172.21.15.130:0/2416601736 >> 172.21.15.130:0/2416601736 conn(0x7fb93c06f170 msgr2=0x7fb93c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:26.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.880+0000 7fb943a19640 1 -- 172.21.15.130:0/2416601736 shutdown_connections 2023-09-13T06:07:26.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.880+0000 7fb943a19640 1 -- 172.21.15.130:0/2416601736 wait complete. 2023-09-13T06:07:26.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb943a19640 1 Processor -- start 2023-09-13T06:07:26.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb943a19640 1 -- start start 2023-09-13T06:07:26.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb943a19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb93c0d1090 0x7fb93c15ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb943a19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb93c0d1750 0x7fb93c143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb943a19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb93c146f30 0x7fb93c140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb943a19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c145650 con 0x7fb93c0d1750 2023-09-13T06:07:26.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb943a19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c144a40 con 0x7fb93c146f30 2023-09-13T06:07:26.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb943a19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c144d20 con 0x7fb93c0d1090 2023-09-13T06:07:26.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb940fb4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb93c0d1750 0x7fb93c143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb940fb4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb93c0d1750 0x7fb93c143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56914/0 (socket says 172.21.15.130:56914) 2023-09-13T06:07:26.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb940fb4640 1 -- 172.21.15.130:0/1795609836 learned_addr learned my addr 172.21.15.130:0/1795609836 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:26.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb941fb6640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb93c146f30 0x7fb93c140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb9417b5640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb93c0d1090 0x7fb93c15ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb940fb4640 1 -- 172.21.15.130:0/1795609836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb93c0d1090 msgr2=0x7fb93c15ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb940fb4640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb93c0d1090 0x7fb93c15ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb940fb4640 1 -- 172.21.15.130:0/1795609836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb93c146f30 msgr2=0x7fb93c140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:26.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb940fb4640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb93c146f30 0x7fb93c140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:26.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb940fb4640 1 -- 172.21.15.130:0/1795609836 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb938009420 con 0x7fb93c0d1750 2023-09-13T06:07:26.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb940fb4640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb93c0d1750 0x7fb93c143f60 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00c4d0 tx=0x7fb92c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:26.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb931ffb640 1 -- 172.21.15.130:0/1795609836 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c005480 con 0x7fb93c0d1750 2023-09-13T06:07:26.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb931ffb640 1 -- 172.21.15.130:0/1795609836 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c003600 con 0x7fb93c0d1750 2023-09-13T06:07:26.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb943a19640 1 -- 172.21.15.130:0/1795609836 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c145000 con 0x7fb93c0d1750 2023-09-13T06:07:26.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb931ffb640 1 -- 172.21.15.130:0/1795609836 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0039b0 con 0x7fb93c0d1750 2023-09-13T06:07:26.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.884+0000 7fb943a19640 1 -- 172.21.15.130:0/1795609836 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c142820 con 0x7fb93c0d1750 2023-09-13T06:07:26.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.888+0000 7fb943a19640 1 -- 172.21.15.130:0/1795609836 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c0618a0 con 0x7fb93c0d1750 2023-09-13T06:07:26.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.888+0000 7fb931ffb640 1 -- 172.21.15.130:0/1795609836 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb92c003b10 con 0x7fb93c0d1750 2023-09-13T06:07:26.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.888+0000 7fb931ffb640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb920065b50 0x7fb920068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:26.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.888+0000 7fb931ffb640 1 -- 172.21.15.130:0/1795609836 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb92c082840 con 0x7fb93c0d1750 2023-09-13T06:07:26.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.888+0000 7fb9417b5640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb920065b50 0x7fb920068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:26.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.888+0000 7fb9417b5640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb920065b50 0x7fb920068010 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb9380ad000 tx=0x7fb938008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:26.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:26.892+0000 7fb931ffb640 1 -- 172.21.15.130:0/1795609836 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb92c0502e0 con 0x7fb93c0d1750 2023-09-13T06:07:27.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.040+0000 7fb943a19640 1 -- 172.21.15.130:0/1795609836 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb93c0b86c0 con 0x7fb93c0d1750 2023-09-13T06:07:27.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb931ffb640 1 -- 172.21.15.130:0/1795609836 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16563 (secure 0 0 0) 0x7fb92c017020 con 0x7fb93c0d1750 2023-09-13T06:07:27.045 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:27.046 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":126,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:19.406296+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:05.156883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:06.213714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:27.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 -- 172.21.15.130:0/1795609836 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb920065b50 msgr2=0x7fb920068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb920065b50 0x7fb920068010 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb9380ad000 tx=0x7fb938008040 comp rx=0 tx=0).stop 2023-09-13T06:07:27.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 -- 172.21.15.130:0/1795609836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb93c0d1750 msgr2=0x7fb93c143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb93c0d1750 0x7fb93c143f60 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00c4d0 tx=0x7fb92c00c990 comp rx=0 tx=0).stop 2023-09-13T06:07:27.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 -- 172.21.15.130:0/1795609836 shutdown_connections 2023-09-13T06:07:27.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb920065b50 0x7fb920068010 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb93c146f30 0x7fb93c140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb93c0d1750 0x7fb93c143f60 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 --2- 172.21.15.130:0/1795609836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb93c0d1090 0x7fb93c15ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 -- 172.21.15.130:0/1795609836 >> 172.21.15.130:0/1795609836 conn(0x7fb93c06f170 msgr2=0x7fb93c15dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:27.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 -- 172.21.15.130:0/1795609836 shutdown_connections 2023-09-13T06:07:27.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.044+0000 7fb943a19640 1 -- 172.21.15.130:0/1795609836 wait complete. 2023-09-13T06:07:27.067 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:07:27.068 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:27.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0b182640 1 Processor -- start 2023-09-13T06:07:27.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0b182640 1 -- start start 2023-09-13T06:07:27.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0b182640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7eff040d1750 0x7eff0415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0b182640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff04146f30 0x7eff040b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0b182640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040b63c0 con 0x7eff040d1090 2023-09-13T06:07:27.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0b182640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0415dea0 con 0x7eff04146f30 2023-09-13T06:07:27.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0b182640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040d0c20 con 0x7eff040d1750 2023-09-13T06:07:27.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0971f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff04146f30 0x7eff040b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff03fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7eff040d1090 0x7eff04146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48376/0 (socket says 172.21.15.130:48376) 2023-09-13T06:07:27.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff03fff640 1 -- 172.21.15.130:0/2300669915 learned_addr learned my addr 172.21.15.130:0/2300669915 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:27.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff08f1e640 1 --2- 172.21.15.130:0/2300669915 >> v2:172.21.15.164:3300/0 conn(0x7eff040d1750 0x7eff0415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0971f640 1 -- 172.21.15.130:0/2300669915 >> v2:172.21.15.164:3300/0 conn(0x7eff040d1750 msgr2=0x7eff0415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:27.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff037fe640 1 -- 172.21.15.130:0/2300669915 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808534867 0 0) 0x7eff040b63c0 con 0x7eff040d1090 2023-09-13T06:07:27.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0971f640 1 --2- 172.21.15.130:0/2300669915 >> v2:172.21.15.164:3300/0 conn(0x7eff040d1750 0x7eff0415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0971f640 1 -- 172.21.15.130:0/2300669915 >> v1:172.21.15.130:6789/0 conn(0x7eff040d1090 legacy=0x7eff04146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff0971f640 1 -- 172.21.15.130:0/2300669915 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040b6610 con 0x7eff04146f30 2023-09-13T06:07:27.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.204+0000 7eff08f1e640 1 --2- 172.21.15.130:0/2300669915 >> v2:172.21.15.164:3300/0 conn(0x7eff040d1750 0x7eff0415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:27.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff0971f640 1 --2- 172.21.15.130:0/2300669915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff04146f30 0x7eff040b70f0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7eff04073cd0 tx=0x7efefc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ccf9e9c52562e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:27.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff037fe640 1 -- 172.21.15.130:0/2300669915 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0a5910 con 0x7eff04146f30 2023-09-13T06:07:27.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff037fe640 1 -- 172.21.15.130:0/2300669915 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc0a5a70 con 0x7eff04146f30 2023-09-13T06:07:27.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff037fe640 1 -- 172.21.15.130:0/2300669915 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0a5e00 con 0x7eff04146f30 2023-09-13T06:07:27.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff0b182640 1 -- 172.21.15.130:0/2300669915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff04146f30 msgr2=0x7eff040b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff0b182640 1 --2- 172.21.15.130:0/2300669915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff04146f30 0x7eff040b70f0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7eff04073cd0 tx=0x7efefc01c850 comp rx=0 tx=0).stop 2023-09-13T06:07:27.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff0b182640 1 -- 172.21.15.130:0/2300669915 shutdown_connections 2023-09-13T06:07:27.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff0b182640 1 --2- 172.21.15.130:0/2300669915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff04146f30 0x7eff040b70f0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff0b182640 1 --2- 172.21.15.130:0/2300669915 >> v2:172.21.15.164:3300/0 conn(0x7eff040d1750 0x7eff0415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff0b182640 1 -- 172.21.15.130:0/2300669915 >> 172.21.15.130:0/2300669915 conn(0x7eff0406f170 msgr2=0x7eff0406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:27.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff0b182640 1 -- 172.21.15.130:0/2300669915 shutdown_connections 2023-09-13T06:07:27.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.208+0000 7eff0b182640 1 -- 172.21.15.130:0/2300669915 wait complete. 2023-09-13T06:07:27.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0b182640 1 Processor -- start 2023-09-13T06:07:27.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0b182640 1 -- start start 2023-09-13T06:07:27.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0b182640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff040d1090 0x7eff04167b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0b182640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff040d1750 0x7eff04145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0b182640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff04146f30 0x7eff04145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0b182640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff04147310 con 0x7eff040d1090 2023-09-13T06:07:27.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0b182640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff04148170 con 0x7eff040d1750 2023-09-13T06:07:27.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0b182640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff04147560 con 0x7eff04146f30 2023-09-13T06:07:27.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff08f1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff040d1090 0x7eff04167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff08f1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff040d1090 0x7eff04167b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56936/0 (socket says 172.21.15.130:56936) 2023-09-13T06:07:27.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff08f1e640 1 -- 172.21.15.130:0/2407713016 learned_addr learned my addr 172.21.15.130:0/2407713016 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:27.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff03fff640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff040d1750 0x7eff04145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0971f640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff04146f30 0x7eff04145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff08f1e640 1 -- 172.21.15.130:0/2407713016 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff04146f30 msgr2=0x7eff04145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff08f1e640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff04146f30 0x7eff04145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff08f1e640 1 -- 172.21.15.130:0/2407713016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff040d1750 msgr2=0x7eff04145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff08f1e640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff040d1750 0x7eff04145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff08f1e640 1 -- 172.21.15.130:0/2407713016 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc009a70 con 0x7eff040d1090 2023-09-13T06:07:27.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0971f640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff04146f30 0x7eff04145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:27.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff03fff640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff040d1750 0x7eff04145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:27.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff08f1e640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff040d1090 0x7eff04167b50 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7efef800c7f0 tx=0x7efef800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:27.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff017fa640 1 -- 172.21.15.130:0/2407713016 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800cea0 con 0x7eff040d1090 2023-09-13T06:07:27.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff017fa640 1 -- 172.21.15.130:0/2407713016 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef8007a30 con 0x7eff040d1090 2023-09-13T06:07:27.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff017fa640 1 -- 172.21.15.130:0/2407713016 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8007de0 con 0x7eff040d1090 2023-09-13T06:07:27.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0b182640 1 -- 172.21.15.130:0/2407713016 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff040b7e40 con 0x7eff040d1090 2023-09-13T06:07:27.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0b182640 1 -- 172.21.15.130:0/2407713016 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff04147b20 con 0x7eff040d1090 2023-09-13T06:07:27.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.212+0000 7eff0b182640 1 -- 172.21.15.130:0/2407713016 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff040618a0 con 0x7eff040d1090 2023-09-13T06:07:27.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.216+0000 7eff017fa640 1 -- 172.21.15.130:0/2407713016 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efef80113f0 con 0x7eff040d1090 2023-09-13T06:07:27.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.216+0000 7eff017fa640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efee8065b20 0x7efee8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.216+0000 7eff017fa640 1 -- 172.21.15.130:0/2407713016 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efef8083500 con 0x7eff040d1090 2023-09-13T06:07:27.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.216+0000 7eff03fff640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efee8065b20 0x7efee8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.216+0000 7eff03fff640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efee8065b20 0x7efee8067fe0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7eff0415d4b0 tx=0x7efef0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:27.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.220+0000 7eff017fa640 1 -- 172.21.15.130:0/2407713016 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7efef8050db0 con 0x7eff040d1090 2023-09-13T06:07:27.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 -- 172.21.15.130:0/2407713016 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff040b86c0 con 0x7eff040d1090 2023-09-13T06:07:27.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff017fa640 1 -- 172.21.15.130:0/2407713016 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4927 (secure 0 0 0) 0x7efef80543d0 con 0x7eff040d1090 2023-09-13T06:07:27.402 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:27.403 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2121062896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2121062896},{"type":"v1","addr":"172.21.15.164:6834","nonce":2121062896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3004233572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3004233572},{"type":"v1","addr":"172.21.15.164:6835","nonce":3004233572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7311,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3730755977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3730755977},{"type":"v1","addr":"172.21.15.130:6835","nonce":3730755977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:07.210560+0000","modified":"2023-09-13T06:07:10.218199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/4103504372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4103504372},{"type":"v1","addr":"172.21.15.130:6837","nonce":4103504372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-09-13T06:07:27.403 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 59 2023-09-13T06:07:27.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 -- 172.21.15.130:0/2407713016 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efee8065b20 msgr2=0x7efee8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efee8065b20 0x7efee8067fe0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7eff0415d4b0 tx=0x7efef0009040 comp rx=0 tx=0).stop 2023-09-13T06:07:27.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 -- 172.21.15.130:0/2407713016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff040d1090 msgr2=0x7eff04167b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff040d1090 0x7eff04167b50 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7efef800c7f0 tx=0x7efef800ccb0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 -- 172.21.15.130:0/2407713016 shutdown_connections 2023-09-13T06:07:27.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efee8065b20 0x7efee8067fe0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff040d1750 0x7eff04145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff04146f30 0x7eff04145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 --2- 172.21.15.130:0/2407713016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff040d1090 0x7eff04167b50 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 -- 172.21.15.130:0/2407713016 >> 172.21.15.130:0/2407713016 conn(0x7eff0406f170 msgr2=0x7eff04142eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:27.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 -- 172.21.15.130:0/2407713016 shutdown_connections 2023-09-13T06:07:27.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.400+0000 7eff0b182640 1 -- 172.21.15.130:0/2407713016 wait complete. 2023-09-13T06:07:27.424 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:27.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.560+0000 7fc42ec9e640 1 Processor -- start 2023-09-13T06:07:27.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.560+0000 7fc42ec9e640 1 -- start start 2023-09-13T06:07:27.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.560+0000 7fc42ec9e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc428159f20 0x7fc4280ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.560+0000 7fc42ec9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4280cdfc0 0x7fc4280b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.560+0000 7fc42ec9e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc4280b1610 0x7fc4280b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.560+0000 7fc42ec9e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4280b00f0 con 0x7fc4280b1610 2023-09-13T06:07:27.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.560+0000 7fc42ec9e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4280ce420 con 0x7fc428159f20 2023-09-13T06:07:27.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.560+0000 7fc42ec9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4280b11d0 con 0x7fc4280cdfc0 2023-09-13T06:07:27.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.560+0000 7fc42d23b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc4280b1610 0x7fc4280b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.560+0000 7fc42d23b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc4280b1610 0x7fc4280b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56946/0 (socket says 172.21.15.130:56946) 2023-09-13T06:07:27.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.560+0000 7fc42d23b640 1 -- 172.21.15.130:0/893141593 learned_addr learned my addr 172.21.15.130:0/893141593 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:27.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42ca3a640 1 --2- 172.21.15.130:0/893141593 >> v2:172.21.15.164:3300/0 conn(0x7fc428159f20 0x7fc4280ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc41ffff640 1 --2- 172.21.15.130:0/893141593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4280cdfc0 0x7fc4280b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42d23b640 1 -- 172.21.15.130:0/893141593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4280cdfc0 msgr2=0x7fc4280b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:27.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42d23b640 1 --2- 172.21.15.130:0/893141593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4280cdfc0 0x7fc4280b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42d23b640 1 -- 172.21.15.130:0/893141593 >> v2:172.21.15.164:3300/0 conn(0x7fc428159f20 msgr2=0x7fc4280ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:27.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42d23b640 1 --2- 172.21.15.130:0/893141593 >> v2:172.21.15.164:3300/0 conn(0x7fc428159f20 0x7fc4280ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42d23b640 1 -- 172.21.15.130:0/893141593 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4280ccfd0 con 0x7fc4280b1610 2023-09-13T06:07:27.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42ca3a640 1 --2- 172.21.15.130:0/893141593 >> v2:172.21.15.164:3300/0 conn(0x7fc428159f20 0x7fc4280ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:27.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42d23b640 1 --2- 172.21.15.130:0/893141593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4280b1610 0x7fc4280b1a80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fc4280b2660 tx=0x7fc42001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1131149215b6fb7d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:27.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc41f7fe640 1 -- 172.21.15.130:0/893141593 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42000b2d0 con 0x7fc4280b1610 2023-09-13T06:07:27.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc41f7fe640 1 -- 172.21.15.130:0/893141593 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42000b430 con 0x7fc4280b1610 2023-09-13T06:07:27.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc41f7fe640 1 -- 172.21.15.130:0/893141593 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4200a7970 con 0x7fc4280b1610 2023-09-13T06:07:27.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42ec9e640 1 -- 172.21.15.130:0/893141593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4280b1610 msgr2=0x7fc4280b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42ec9e640 1 --2- 172.21.15.130:0/893141593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4280b1610 0x7fc4280b1a80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fc4280b2660 tx=0x7fc42001ebd0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42ec9e640 1 -- 172.21.15.130:0/893141593 shutdown_connections 2023-09-13T06:07:27.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42ec9e640 1 --2- 172.21.15.130:0/893141593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4280b1610 0x7fc4280b1a80 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42ec9e640 1 --2- 172.21.15.130:0/893141593 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4280cdfc0 0x7fc4280b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42ec9e640 1 --2- 172.21.15.130:0/893141593 >> v2:172.21.15.164:3300/0 conn(0x7fc428159f20 0x7fc4280ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.564+0000 7fc42ec9e640 1 -- 172.21.15.130:0/893141593 >> 172.21.15.130:0/893141593 conn(0x7fc428065990 msgr2=0x7fc428065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:27.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42ec9e640 1 -- 172.21.15.130:0/893141593 shutdown_connections 2023-09-13T06:07:27.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42ec9e640 1 -- 172.21.15.130:0/893141593 wait complete. 2023-09-13T06:07:27.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42ec9e640 1 Processor -- start 2023-09-13T06:07:27.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42ec9e640 1 -- start start 2023-09-13T06:07:27.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42ec9e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4280b1610 0x7fc42813c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42ec9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4280cdfc0 0x7fc4280acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42ec9e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc428159f20 0x7fc4280ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42ec9e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42813fd30 con 0x7fc428159f20 2023-09-13T06:07:27.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42ec9e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4281f9cc0 con 0x7fc4280b1610 2023-09-13T06:07:27.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42ec9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc428140150 con 0x7fc4280cdfc0 2023-09-13T06:07:27.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42d23b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc428159f20 0x7fc4280ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42d23b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc428159f20 0x7fc4280ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56952/0 (socket says 172.21.15.130:56952) 2023-09-13T06:07:27.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42d23b640 1 -- 172.21.15.130:0/3507570068 learned_addr learned my addr 172.21.15.130:0/3507570068 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:27.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42ca3a640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4280b1610 0x7fc42813c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc41ffff640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4280cdfc0 0x7fc4280acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42d23b640 1 -- 172.21.15.130:0/3507570068 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4280cdfc0 msgr2=0x7fc4280acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42d23b640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4280cdfc0 0x7fc4280acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42d23b640 1 -- 172.21.15.130:0/3507570068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4280b1610 msgr2=0x7fc42813c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42d23b640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4280b1610 0x7fc42813c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42d23b640 1 -- 172.21.15.130:0/3507570068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42000bd40 con 0x7fc428159f20 2023-09-13T06:07:27.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.568+0000 7fc42d23b640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc428159f20 0x7fc4280ad2a0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fc4200b1040 tx=0x7fc42001b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:27.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.572+0000 7fc41d7fa640 1 -- 172.21.15.130:0/3507570068 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420009800 con 0x7fc428159f20 2023-09-13T06:07:27.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.572+0000 7fc41d7fa640 1 -- 172.21.15.130:0/3507570068 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc420009980 con 0x7fc428159f20 2023-09-13T06:07:27.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.572+0000 7fc41d7fa640 1 -- 172.21.15.130:0/3507570068 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420009d30 con 0x7fc428159f20 2023-09-13T06:07:27.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.572+0000 7fc42ec9e640 1 -- 172.21.15.130:0/3507570068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42813f390 con 0x7fc428159f20 2023-09-13T06:07:27.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.572+0000 7fc42ec9e640 1 -- 172.21.15.130:0/3507570068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42813f950 con 0x7fc428159f20 2023-09-13T06:07:27.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.572+0000 7fc42ec9e640 1 -- 172.21.15.130:0/3507570068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42813fe70 con 0x7fc428159f20 2023-09-13T06:07:27.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.572+0000 7fc41d7fa640 1 -- 172.21.15.130:0/3507570068 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc4200c3460 con 0x7fc428159f20 2023-09-13T06:07:27.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.572+0000 7fc41d7fa640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc414065b20 0x7fc414067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.572+0000 7fc41d7fa640 1 -- 172.21.15.130:0/3507570068 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc42011e4e0 con 0x7fc428159f20 2023-09-13T06:07:27.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.572+0000 7fc42ca3a640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc414065b20 0x7fc414067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.576+0000 7fc42ca3a640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc414065b20 0x7fc414067fe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc42814c240 tx=0x7fc424008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:27.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.576+0000 7fc41d7fa640 1 -- 172.21.15.130:0/3507570068 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc4200ec030 con 0x7fc428159f20 2023-09-13T06:07:27.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.756+0000 7fc42ec9e640 1 -- 172.21.15.130:0/3507570068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4280618a0 con 0x7fc428159f20 2023-09-13T06:07:27.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.756+0000 7fc41d7fa640 1 -- 172.21.15.130:0/3507570068 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fc42000b720 con 0x7fc428159f20 2023-09-13T06:07:27.761 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:27.761 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2121062896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2121062896},{"type":"v1","addr":"172.21.15.164:6834","nonce":2121062896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3004233572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3004233572},{"type":"v1","addr":"172.21.15.164:6835","nonce":3004233572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7311,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3730755977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3730755977},{"type":"v1","addr":"172.21.15.130:6835","nonce":3730755977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:07.210560+0000","modified":"2023-09-13T06:07:10.218199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7320},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7320":{"gid":7320,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/4103504372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4103504372},{"type":"v1","addr":"172.21.15.130:6837","nonce":4103504372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-09-13T06:07:27.762 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 59 2023-09-13T06:07:27.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 -- 172.21.15.130:0/3507570068 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc414065b20 msgr2=0x7fc414067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc414065b20 0x7fc414067fe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc42814c240 tx=0x7fc424008040 comp rx=0 tx=0).stop 2023-09-13T06:07:27.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 -- 172.21.15.130:0/3507570068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc428159f20 msgr2=0x7fc4280ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc428159f20 0x7fc4280ad2a0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fc4200b1040 tx=0x7fc42001b970 comp rx=0 tx=0).stop 2023-09-13T06:07:27.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 -- 172.21.15.130:0/3507570068 shutdown_connections 2023-09-13T06:07:27.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc414065b20 0x7fc414067fe0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc428159f20 0x7fc4280ad2a0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4280cdfc0 0x7fc4280acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 --2- 172.21.15.130:0/3507570068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4280b1610 0x7fc42813c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 -- 172.21.15.130:0/3507570068 >> 172.21.15.130:0/3507570068 conn(0x7fc428065990 msgr2=0x7fc428157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:27.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 -- 172.21.15.130:0/3507570068 shutdown_connections 2023-09-13T06:07:27.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.760+0000 7fc42ec9e640 1 -- 172.21.15.130:0/3507570068 wait complete. 2023-09-13T06:07:27.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:27.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.916+0000 7f436c207640 1 Processor -- start 2023-09-13T06:07:27.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436c207640 1 -- start start 2023-09-13T06:07:27.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436c207640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43640d1090 0x7f436415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436c207640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4364146f30 0x7f43640b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436c207640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43640b63c0 con 0x7f43640d1750 2023-09-13T06:07:27.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436c207640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436415dea0 con 0x7f4364146f30 2023-09-13T06:07:27.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436c207640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43640d0c20 con 0x7f43640d1090 2023-09-13T06:07:27.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436a7a4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4364146f30 0x7f43640b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436a7a4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4364146f30 0x7f43640b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56968/0 (socket says 172.21.15.130:56968) 2023-09-13T06:07:27.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436a7a4640 1 -- 172.21.15.130:0/3179759335 learned_addr learned my addr 172.21.15.130:0/3179759335 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:27.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436a7a4640 1 -- 172.21.15.130:0/3179759335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43640d1090 msgr2=0x7f436415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:27.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436a7a4640 1 --2- 172.21.15.130:0/3179759335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43640d1090 0x7f436415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436a7a4640 1 -- 172.21.15.130:0/3179759335 >> v1:172.21.15.130:6789/0 conn(0x7f43640d1750 legacy=0x7f4364146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.920+0000 7f436a7a4640 1 -- 172.21.15.130:0/3179759335 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43640b6610 con 0x7f4364146f30 2023-09-13T06:07:27.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f436a7a4640 1 --2- 172.21.15.130:0/3179759335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4364146f30 0x7f43640b70f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f435c009e50 tx=0x7f435c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c32cf7c46de2512 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:27.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f4368fa1640 1 -- 172.21.15.130:0/3179759335 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c0a58a0 con 0x7f4364146f30 2023-09-13T06:07:27.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f4368fa1640 1 -- 172.21.15.130:0/3179759335 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c0a5a00 con 0x7f4364146f30 2023-09-13T06:07:27.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f4368fa1640 1 -- 172.21.15.130:0/3179759335 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c0a5d90 con 0x7f4364146f30 2023-09-13T06:07:27.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f436c207640 1 -- 172.21.15.130:0/3179759335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4364146f30 msgr2=0x7f43640b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f436c207640 1 --2- 172.21.15.130:0/3179759335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4364146f30 0x7f43640b70f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f435c009e50 tx=0x7f435c01c9e0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f436c207640 1 -- 172.21.15.130:0/3179759335 shutdown_connections 2023-09-13T06:07:27.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f436c207640 1 --2- 172.21.15.130:0/3179759335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4364146f30 0x7f43640b70f0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f436c207640 1 --2- 172.21.15.130:0/3179759335 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43640d1090 0x7f436415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f436c207640 1 -- 172.21.15.130:0/3179759335 >> 172.21.15.130:0/3179759335 conn(0x7f436406f170 msgr2=0x7f436406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:27.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f436c207640 1 -- 172.21.15.130:0/3179759335 shutdown_connections 2023-09-13T06:07:27.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f436c207640 1 -- 172.21.15.130:0/3179759335 wait complete. 2023-09-13T06:07:27.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f436c207640 1 Processor -- start 2023-09-13T06:07:27.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.924+0000 7f436c207640 1 -- start start 2023-09-13T06:07:27.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f436c207640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43640d1090 0x7f4364145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f436c207640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43640d1750 0x7f43640ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f436c207640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4364146f30 0x7f43640cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f436c207640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436415caa0 con 0x7f43640d1750 2023-09-13T06:07:27.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f436c207640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43640c9cd0 con 0x7f4364146f30 2023-09-13T06:07:27.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f436c207640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43640c9430 con 0x7f43640d1090 2023-09-13T06:07:27.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f43697a2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43640d1750 0x7f43640ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f43697a2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43640d1750 0x7f43640ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56978/0 (socket says 172.21.15.130:56978) 2023-09-13T06:07:27.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f43697a2640 1 -- 172.21.15.130:0/3727289533 learned_addr learned my addr 172.21.15.130:0/3727289533 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:27.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f4369fa3640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43640d1090 0x7f4364145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f436a7a4640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4364146f30 0x7f43640cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f43697a2640 1 -- 172.21.15.130:0/3727289533 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43640d1090 msgr2=0x7f4364145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f43697a2640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43640d1090 0x7f4364145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f43697a2640 1 -- 172.21.15.130:0/3727289533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4364146f30 msgr2=0x7f43640cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:27.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f43697a2640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4364146f30 0x7f43640cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:27.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f43697a2640 1 -- 172.21.15.130:0/3727289533 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c009b30 con 0x7f43640d1750 2023-09-13T06:07:27.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f43697a2640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43640d1750 0x7f43640ca880 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f435400b550 tx=0x7f435400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:27.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f435a7fc640 1 -- 172.21.15.130:0/3727289533 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354010870 con 0x7f43640d1750 2023-09-13T06:07:27.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f435a7fc640 1 -- 172.21.15.130:0/3727289533 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43540109f0 con 0x7f43640d1750 2023-09-13T06:07:27.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f435a7fc640 1 -- 172.21.15.130:0/3727289533 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354010da0 con 0x7f43640d1750 2023-09-13T06:07:27.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f436c207640 1 -- 172.21.15.130:0/3727289533 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43640b7e40 con 0x7f43640d1750 2023-09-13T06:07:27.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f436c207640 1 -- 172.21.15.130:0/3727289533 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43640c99f0 con 0x7f43640d1750 2023-09-13T06:07:27.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.928+0000 7f436c207640 1 -- 172.21.15.130:0/3727289533 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43640618a0 con 0x7f43640d1750 2023-09-13T06:07:27.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.932+0000 7f435a7fc640 1 -- 172.21.15.130:0/3727289533 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f435400f3c0 con 0x7f43640d1750 2023-09-13T06:07:27.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.932+0000 7f435a7fc640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4348065b20 0x7f4348067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:27.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.932+0000 7f435a7fc640 1 -- 172.21.15.130:0/3727289533 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43540832e0 con 0x7f43640d1750 2023-09-13T06:07:27.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.932+0000 7f4369fa3640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4348065b20 0x7f4348067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:27.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.932+0000 7f4369fa3640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4348065b20 0x7f4348067fe0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4360000f70 tx=0x7f4360009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:27.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:27.936+0000 7f435a7fc640 1 -- 172.21.15.130:0/3727289533 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4354050c20 con 0x7f43640d1750 2023-09-13T06:07:28.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.084+0000 7f436c207640 1 -- 172.21.15.130:0/3727289533 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4364143db0 con 0x7f43640d1750 2023-09-13T06:07:28.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.084+0000 7f435a7fc640 1 -- 172.21.15.130:0/3727289533 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16563 (secure 0 0 0) 0x7f4354054240 con 0x7f43640d1750 2023-09-13T06:07:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:28.088 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":126,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:19.406296+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:05.156883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:06.213714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:28.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 -- 172.21.15.130:0/3727289533 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4348065b20 msgr2=0x7f4348067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4348065b20 0x7f4348067fe0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4360000f70 tx=0x7f4360009040 comp rx=0 tx=0).stop 2023-09-13T06:07:28.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 -- 172.21.15.130:0/3727289533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43640d1750 msgr2=0x7f43640ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43640d1750 0x7f43640ca880 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f435400b550 tx=0x7f435400ba10 comp rx=0 tx=0).stop 2023-09-13T06:07:28.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 -- 172.21.15.130:0/3727289533 shutdown_connections 2023-09-13T06:07:28.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4348065b20 0x7f4348067fe0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4364146f30 0x7f43640cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43640d1750 0x7f43640ca880 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 --2- 172.21.15.130:0/3727289533 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43640d1090 0x7f4364145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 -- 172.21.15.130:0/3727289533 >> 172.21.15.130:0/3727289533 conn(0x7f436406f170 msgr2=0x7f43640cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:28.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 -- 172.21.15.130:0/3727289533 shutdown_connections 2023-09-13T06:07:28.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.088+0000 7f436c207640 1 -- 172.21.15.130:0/3727289533 wait complete. 2023-09-13T06:07:28.108 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T06:07:28.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.244+0000 7f0c27a0b640 1 Processor -- start 2023-09-13T06:07:28.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.244+0000 7f0c27a0b640 1 -- start start 2023-09-13T06:07:28.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.244+0000 7f0c27a0b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0c200cc780 0x7f0c2015b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.244+0000 7f0c27a0b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0c200b04a0 0x7f0c200b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.244+0000 7f0c27a0b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c200ccbe0 con 0x7f0c2015b130 2023-09-13T06:07:28.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.244+0000 7f0c27a0b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c200b0e50 con 0x7f0c200cc780 2023-09-13T06:07:28.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.244+0000 7f0c27a0b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c200ce980 con 0x7f0c200b04a0 2023-09-13T06:07:28.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c257a7640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0c2015b130 0x7f0c200ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48404/0 (socket says 172.21.15.130:48404) 2023-09-13T06:07:28.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c257a7640 1 -- 172.21.15.130:0/3175933096 learned_addr learned my addr 172.21.15.130:0/3175933096 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:28.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c24fa6640 1 --2- 172.21.15.130:0/3175933096 >> v2:172.21.15.130:3300/0 conn(0x7f0c200cc780 0x7f0c2015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:28.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c25fa8640 1 --2- 172.21.15.130:0/3175933096 >> v2:172.21.15.164:3300/0 conn(0x7f0c200b04a0 0x7f0c200b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:28.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c24fa6640 1 -- 172.21.15.130:0/3175933096 >> v2:172.21.15.164:3300/0 conn(0x7f0c200b04a0 msgr2=0x7f0c200b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:28.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c24fa6640 1 --2- 172.21.15.130:0/3175933096 >> v2:172.21.15.164:3300/0 conn(0x7f0c200b04a0 0x7f0c200b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c24fa6640 1 -- 172.21.15.130:0/3175933096 >> v1:172.21.15.130:6789/0 conn(0x7f0c2015b130 legacy=0x7f0c200ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c17fff640 1 -- 172.21.15.130:0/3175933096 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134229859 0 0) 0x7f0c200ccbe0 con 0x7f0c2015b130 2023-09-13T06:07:28.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c24fa6640 1 -- 172.21.15.130:0/3175933096 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c200cec60 con 0x7f0c200cc780 2023-09-13T06:07:28.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c25fa8640 1 --2- 172.21.15.130:0/3175933096 >> v2:172.21.15.164:3300/0 conn(0x7f0c200b04a0 0x7f0c200b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:28.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c24fa6640 1 --2- 172.21.15.130:0/3175933096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c200cc780 0x7f0c2015b510 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0c200b28c0 tx=0x7f0c1001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a868f1dc63885d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:28.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c17fff640 1 -- 172.21.15.130:0/3175933096 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c100a7070 con 0x7f0c200cc780 2023-09-13T06:07:28.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c17fff640 1 -- 172.21.15.130:0/3175933096 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c100ab430 con 0x7f0c200cc780 2023-09-13T06:07:28.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.248+0000 7f0c17fff640 1 -- 172.21.15.130:0/3175933096 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c100ab7c0 con 0x7f0c200cc780 2023-09-13T06:07:28.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3175933096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c200cc780 msgr2=0x7f0c2015b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 --2- 172.21.15.130:0/3175933096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c200cc780 0x7f0c2015b510 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0c200b28c0 tx=0x7f0c1001c430 comp rx=0 tx=0).stop 2023-09-13T06:07:28.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3175933096 shutdown_connections 2023-09-13T06:07:28.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 --2- 172.21.15.130:0/3175933096 >> v2:172.21.15.164:3300/0 conn(0x7f0c200b04a0 0x7f0c200b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 --2- 172.21.15.130:0/3175933096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c200cc780 0x7f0c2015b510 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3175933096 >> 172.21.15.130:0/3175933096 conn(0x7f0c20065990 msgr2=0x7f0c20065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:28.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3175933096 shutdown_connections 2023-09-13T06:07:28.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3175933096 wait complete. 2023-09-13T06:07:28.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 Processor -- start 2023-09-13T06:07:28.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 -- start start 2023-09-13T06:07:28.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c200b04a0 0x7f0c201f8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c200cc780 0x7f0c201f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c2015b130 0x7f0c200ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200afb60 con 0x7f0c2015b130 2023-09-13T06:07:28.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200aef50 con 0x7f0c200b04a0 2023-09-13T06:07:28.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c27a0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200af230 con 0x7f0c200cc780 2023-09-13T06:07:28.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c25fa8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c2015b130 0x7f0c200ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:28.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c25fa8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c2015b130 0x7f0c200ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56992/0 (socket says 172.21.15.130:56992) 2023-09-13T06:07:28.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c25fa8640 1 -- 172.21.15.130:0/3735155814 learned_addr learned my addr 172.21.15.130:0/3735155814 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:28.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c257a7640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c200b04a0 0x7f0c201f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:28.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.252+0000 7f0c24fa6640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c200cc780 0x7f0c201f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:28.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c25fa8640 1 -- 172.21.15.130:0/3735155814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c200cc780 msgr2=0x7f0c201f8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c25fa8640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c200cc780 0x7f0c201f8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c25fa8640 1 -- 172.21.15.130:0/3735155814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c200b04a0 msgr2=0x7f0c201f8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c25fa8640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c200b04a0 0x7f0c201f8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c25fa8640 1 -- 172.21.15.130:0/3735155814 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c10009420 con 0x7f0c2015b130 2023-09-13T06:07:28.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c25fa8640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c2015b130 0x7f0c200ae290 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800ce40 tx=0x7f0c1800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:28.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c15ffb640 1 -- 172.21.15.130:0/3735155814 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1800d840 con 0x7f0c2015b130 2023-09-13T06:07:28.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c15ffb640 1 -- 172.21.15.130:0/3735155814 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1800d9a0 con 0x7f0c2015b130 2023-09-13T06:07:28.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c15ffb640 1 -- 172.21.15.130:0/3735155814 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1800dd50 con 0x7f0c2015b130 2023-09-13T06:07:28.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3735155814 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c200af510 con 0x7f0c2015b130 2023-09-13T06:07:28.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3735155814 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2015dbe0 con 0x7f0c2015b130 2023-09-13T06:07:28.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3735155814 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c200afcd0 con 0x7f0c2015b130 2023-09-13T06:07:28.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c15ffb640 1 -- 172.21.15.130:0/3735155814 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0c1801e3b0 con 0x7f0c2015b130 2023-09-13T06:07:28.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c15ffb640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c04065b20 0x7f0c04067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c15ffb640 1 -- 172.21.15.130:0/3735155814 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c18083c50 con 0x7f0c2015b130 2023-09-13T06:07:28.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.256+0000 7f0c257a7640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c04065b20 0x7f0c04067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:28.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.260+0000 7f0c257a7640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c04065b20 0x7f0c04067fe0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c000f70 tx=0x7f0c1c007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:28.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.260+0000 7f0c15ffb640 1 -- 172.21.15.130:0/3735155814 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0c18051640 con 0x7f0c2015b130 2023-09-13T06:07:28.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.440+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3735155814 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0c200618a0 con 0x7f0c2015b130 2023-09-13T06:07:28.442 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:07:28.440+0000 7faa00e50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T06:07:28.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.452+0000 7f0c15ffb640 1 -- 172.21.15.130:0/3735155814 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v60) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0c1801a090 con 0x7f0c2015b130 2023-09-13T06:07:28.454 INFO:teuthology.orchestra.run.smithi130.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T06:07:28.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3735155814 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c04065b20 msgr2=0x7f0c04067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c04065b20 0x7f0c04067fe0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c000f70 tx=0x7f0c1c007df0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3735155814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c2015b130 msgr2=0x7f0c200ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c2015b130 0x7f0c200ae290 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800ce40 tx=0x7f0c1800a710 comp rx=0 tx=0).stop 2023-09-13T06:07:28.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3735155814 shutdown_connections 2023-09-13T06:07:28.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c04065b20 0x7f0c04067fe0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c2015b130 0x7f0c200ae290 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c200cc780 0x7f0c201f8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 --2- 172.21.15.130:0/3735155814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c200b04a0 0x7f0c201f8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3735155814 >> 172.21.15.130:0/3735155814 conn(0x7f0c20065990 msgr2=0x7f0c200b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:28.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3735155814 shutdown_connections 2023-09-13T06:07:28.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.456+0000 7f0c27a0b640 1 -- 172.21.15.130:0/3735155814 wait complete. 2023-09-13T06:07:28.466 INFO:tasks.ceph.mds.c.smithi130.stderr: -4630> 2023-09-13T06:07:12.804+0000 7fb960afb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:07:28.484 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T06:07:28.523 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:07:28.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.628+0000 7f172acde640 1 Processor -- start 2023-09-13T06:07:28.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.628+0000 7f172acde640 1 -- start start 2023-09-13T06:07:28.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.628+0000 7f172acde640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1724070f10 0x7f17240b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.628+0000 7f172acde640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f17240b64d0 0x7f17240b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.628+0000 7f172acde640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1724161790 con 0x7f1724146410 2023-09-13T06:07:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.628+0000 7f172acde640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240b6900 con 0x7f1724070f10 2023-09-13T06:07:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.628+0000 7f172acde640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1724146dd0 con 0x7f17240b64d0 2023-09-13T06:07:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f1729cdc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1724146410 0x7f1724070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48412/0 (socket says 172.21.15.130:48412) 2023-09-13T06:07:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f1729cdc640 1 -- 172.21.15.130:0/3353812065 learned_addr learned my addr 172.21.15.130:0/3353812065 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:28.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f17294db640 1 --2- 172.21.15.130:0/3353812065 >> v2:172.21.15.130:3300/0 conn(0x7f1724070f10 0x7f17240b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:28.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f1728cda640 1 -- 172.21.15.130:0/3353812065 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258346777 0 0) 0x7f1724161790 con 0x7f1724146410 2023-09-13T06:07:28.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f172a4dd640 1 --2- 172.21.15.130:0/3353812065 >> v2:172.21.15.164:3300/0 conn(0x7f17240b64d0 0x7f17240b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:28.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f17294db640 1 -- 172.21.15.130:0/3353812065 >> v2:172.21.15.164:3300/0 conn(0x7f17240b64d0 msgr2=0x7f17240b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:28.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f17294db640 1 --2- 172.21.15.130:0/3353812065 >> v2:172.21.15.164:3300/0 conn(0x7f17240b64d0 0x7f17240b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f17294db640 1 -- 172.21.15.130:0/3353812065 >> v1:172.21.15.130:6789/0 conn(0x7f1724146410 legacy=0x7f1724070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f17294db640 1 -- 172.21.15.130:0/3353812065 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1724160e60 con 0x7f1724070f10 2023-09-13T06:07:28.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f172a4dd640 1 --2- 172.21.15.130:0/3353812065 >> v2:172.21.15.164:3300/0 conn(0x7f17240b64d0 0x7f17240b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:28.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f17294db640 1 --2- 172.21.15.130:0/3353812065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1724070f10 0x7f17240b5f90 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f17241470d0 tx=0x7f171401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db82bec05b6b16cc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:28.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f1728cda640 1 -- 172.21.15.130:0/3353812065 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140a7070 con 0x7f1724070f10 2023-09-13T06:07:28.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f1728cda640 1 -- 172.21.15.130:0/3353812065 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17140ab430 con 0x7f1724070f10 2023-09-13T06:07:28.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.632+0000 7f1728cda640 1 -- 172.21.15.130:0/3353812065 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140ab7c0 con 0x7f1724070f10 2023-09-13T06:07:28.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 -- 172.21.15.130:0/3353812065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1724070f10 msgr2=0x7f17240b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 --2- 172.21.15.130:0/3353812065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1724070f10 0x7f17240b5f90 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f17241470d0 tx=0x7f171401c430 comp rx=0 tx=0).stop 2023-09-13T06:07:28.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 -- 172.21.15.130:0/3353812065 shutdown_connections 2023-09-13T06:07:28.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 --2- 172.21.15.130:0/3353812065 >> v2:172.21.15.164:3300/0 conn(0x7f17240b64d0 0x7f17240b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 --2- 172.21.15.130:0/3353812065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1724070f10 0x7f17240b5f90 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 -- 172.21.15.130:0/3353812065 >> 172.21.15.130:0/3353812065 conn(0x7f1724065990 msgr2=0x7f1724065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:28.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 -- 172.21.15.130:0/3353812065 shutdown_connections 2023-09-13T06:07:28.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 -- 172.21.15.130:0/3353812065 wait complete. 2023-09-13T06:07:28.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 Processor -- start 2023-09-13T06:07:28.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 -- start start 2023-09-13T06:07:28.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1724070f10 0x7f172415ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17240b64d0 0x7f1724157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1724146410 0x7f17240d21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1724136b20 con 0x7f17240b64d0 2023-09-13T06:07:28.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1724137940 con 0x7f1724070f10 2023-09-13T06:07:28.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f172acde640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1724137dd0 con 0x7f1724146410 2023-09-13T06:07:28.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f17294db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17240b64d0 0x7f1724157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:28.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f17294db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17240b64d0 0x7f1724157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57044/0 (socket says 172.21.15.130:57044) 2023-09-13T06:07:28.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f17294db640 1 -- 172.21.15.130:0/4103996182 learned_addr learned my addr 172.21.15.130:0/4103996182 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:28.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f17294db640 1 -- 172.21.15.130:0/4103996182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1724146410 msgr2=0x7f17240d21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f17294db640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1724146410 0x7f17240d21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f17294db640 1 -- 172.21.15.130:0/4103996182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1724070f10 msgr2=0x7f172415ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:28.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f17294db640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1724070f10 0x7f172415ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:28.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.636+0000 7f17294db640 1 -- 172.21.15.130:0/4103996182 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1714009420 con 0x7f17240b64d0 2023-09-13T06:07:28.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.640+0000 7f17294db640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17240b64d0 0x7f1724157360 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f1714019040 tx=0x7f171401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:28.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.640+0000 7f171a7fc640 1 -- 172.21.15.130:0/4103996182 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714004220 con 0x7f17240b64d0 2023-09-13T06:07:28.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.640+0000 7f171a7fc640 1 -- 172.21.15.130:0/4103996182 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17140b9070 con 0x7f17240b64d0 2023-09-13T06:07:28.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.640+0000 7f171a7fc640 1 -- 172.21.15.130:0/4103996182 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140abe30 con 0x7f17240b64d0 2023-09-13T06:07:28.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.640+0000 7f172acde640 1 -- 172.21.15.130:0/4103996182 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1724136d30 con 0x7f17240b64d0 2023-09-13T06:07:28.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.640+0000 7f172acde640 1 -- 172.21.15.130:0/4103996182 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17241372f0 con 0x7f17240b64d0 2023-09-13T06:07:28.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.640+0000 7f172acde640 1 -- 172.21.15.130:0/4103996182 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17240618a0 con 0x7f17240b64d0 2023-09-13T06:07:28.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.640+0000 7f171a7fc640 1 -- 172.21.15.130:0/4103996182 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f17140b4610 con 0x7f17240b64d0 2023-09-13T06:07:28.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.640+0000 7f171a7fc640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1708065b20 0x7f1708067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:28.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.640+0000 7f171a7fc640 1 -- 172.21.15.130:0/4103996182 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f17140bb070 con 0x7f17240b64d0 2023-09-13T06:07:28.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.640+0000 7f1729cdc640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1708065b20 0x7f1708067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:28.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.644+0000 7f1729cdc640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1708065b20 0x7f1708067fe0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f17200011f0 tx=0x7f1720007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:28.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.644+0000 7f171a7fc640 1 -- 172.21.15.130:0/4103996182 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f17140eb0d0 con 0x7f17240b64d0 2023-09-13T06:07:28.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:28.824+0000 7f172acde640 1 -- 172.21.15.130:0/4103996182 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1724137ab0 con 0x7f17240b64d0 2023-09-13T06:07:29.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.456+0000 7f171a7fc640 1 -- 172.21.15.130:0/4103996182 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f17140ee6f0 con 0x7f17240b64d0 2023-09-13T06:07:29.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 -- 172.21.15.130:0/4103996182 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1708065b20 msgr2=0x7f1708067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:29.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1708065b20 0x7f1708067fe0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f17200011f0 tx=0x7f1720007930 comp rx=0 tx=0).stop 2023-09-13T06:07:29.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 -- 172.21.15.130:0/4103996182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17240b64d0 msgr2=0x7f1724157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:29.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17240b64d0 0x7f1724157360 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f1714019040 tx=0x7f171401ac70 comp rx=0 tx=0).stop 2023-09-13T06:07:29.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 -- 172.21.15.130:0/4103996182 shutdown_connections 2023-09-13T06:07:29.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1708065b20 0x7f1708067fe0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:29.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1724146410 0x7f17240d21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:29.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17240b64d0 0x7f1724157360 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:29.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 --2- 172.21.15.130:0/4103996182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1724070f10 0x7f172415ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:29.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 -- 172.21.15.130:0/4103996182 >> 172.21.15.130:0/4103996182 conn(0x7f1724065990 msgr2=0x7f17240cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:29.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 -- 172.21.15.130:0/4103996182 shutdown_connections 2023-09-13T06:07:29.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.460+0000 7f172acde640 1 -- 172.21.15.130:0/4103996182 wait complete. 2023-09-13T06:07:29.483 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T06:07:29.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.664+0000 7f18d4e48640 1 Processor -- start 2023-09-13T06:07:29.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.664+0000 7f18d4e48640 1 -- start start 2023-09-13T06:07:29.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18d4e48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18d00b0fa0 0x7f18d00713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:29.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18d4e48640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d015d890 con 0x7f18d015d4b0 2023-09-13T06:07:29.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18d4e48640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d00cbeb0 con 0x7f18d00cb940 2023-09-13T06:07:29.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18d4e48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d00b2710 con 0x7f18d00b0fa0 2023-09-13T06:07:29.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18ce59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f18d015d4b0 0x7f18d00b0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48420/0 (socket says 172.21.15.130:48420) 2023-09-13T06:07:29.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18ce59c640 1 -- 172.21.15.130:0/3849032708 learned_addr learned my addr 172.21.15.130:0/3849032708 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:29.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18c5d9b640 1 --2- 172.21.15.130:0/3849032708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18d00b0fa0 0x7f18d00713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:29.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18cdd9b640 1 -- 172.21.15.130:0/3849032708 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120560674 0 0) 0x7f18d015d890 con 0x7f18d015d4b0 2023-09-13T06:07:29.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18cdd9b640 1 -- 172.21.15.130:0/3849032708 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18bc003530 con 0x7f18d015d4b0 2023-09-13T06:07:29.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18cdd9b640 1 -- 172.21.15.130:0/3849032708 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147441806 0 0) 0x7f18d00cbeb0 con 0x7f18d00cb940 2023-09-13T06:07:29.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18cdd9b640 1 -- 172.21.15.130:0/3849032708 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d015d890 con 0x7f18d00cb940 2023-09-13T06:07:29.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18c5d9b640 1 -- 172.21.15.130:0/3849032708 >> v1:172.21.15.164:6789/0 conn(0x7f18d00cb940 legacy=0x7f18d00ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:29.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18cdd9b640 1 -- 172.21.15.130:0/3849032708 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2924538368 0 0) 0x7f18bc003530 con 0x7f18d015d4b0 2023-09-13T06:07:29.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18c5d9b640 1 -- 172.21.15.130:0/3849032708 >> v1:172.21.15.130:6789/0 conn(0x7f18d015d4b0 legacy=0x7f18d00b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:29.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.668+0000 7f18c5d9b640 1 -- 172.21.15.130:0/3849032708 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d00b2b30 con 0x7f18d00b0fa0 2023-09-13T06:07:29.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18c5d9b640 1 --2- 172.21.15.130:0/3849032708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18d00b0fa0 0x7f18d00713b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f18c00097f0 tx=0x7f18c001c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1d72d39045a0116 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:29.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18cdd9b640 1 -- 172.21.15.130:0/3849032708 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b8001680 con 0x7f18d00b0fa0 2023-09-13T06:07:29.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18cdd9b640 1 -- 172.21.15.130:0/3849032708 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c00a7050 con 0x7f18d00b0fa0 2023-09-13T06:07:29.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18cdd9b640 1 -- 172.21.15.130:0/3849032708 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c00ab620 con 0x7f18d00b0fa0 2023-09-13T06:07:29.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18d4e48640 1 -- 172.21.15.130:0/3849032708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18d00b0fa0 msgr2=0x7f18d00713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:29.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18d4e48640 1 --2- 172.21.15.130:0/3849032708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18d00b0fa0 0x7f18d00713b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f18c00097f0 tx=0x7f18c001c320 comp rx=0 tx=0).stop 2023-09-13T06:07:29.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18d4e48640 1 -- 172.21.15.130:0/3849032708 shutdown_connections 2023-09-13T06:07:29.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18d4e48640 1 --2- 172.21.15.130:0/3849032708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18d00b0fa0 0x7f18d00713b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:29.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18d4e48640 1 -- 172.21.15.130:0/3849032708 >> 172.21.15.130:0/3849032708 conn(0x7f18d0065f90 msgr2=0x7f18d00cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:29.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18d4e48640 1 -- 172.21.15.130:0/3849032708 shutdown_connections 2023-09-13T06:07:29.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18d4e48640 1 -- 172.21.15.130:0/3849032708 wait complete. 2023-09-13T06:07:29.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.672+0000 7f18d4e48640 1 Processor -- start 2023-09-13T06:07:29.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18d4e48640 1 -- start start 2023-09-13T06:07:29.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18d4e48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18d00b0fa0 0x7f18d015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:29.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18d4e48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18d00cb940 0x7f18d00c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:29.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18d4e48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d015d4b0 0x7f18d00c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:29.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18d4e48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d015bc80 con 0x7f18d015d4b0 2023-09-13T06:07:29.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18d4e48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d00c6130 con 0x7f18d00cb940 2023-09-13T06:07:29.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18d4e48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d00c4b50 con 0x7f18d00b0fa0 2023-09-13T06:07:29.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18ced9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d015d4b0 0x7f18d00c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:29.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18ce59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18d00b0fa0 0x7f18d015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18ced9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d015d4b0 0x7f18d00c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57050/0 (socket says 172.21.15.130:57050) 2023-09-13T06:07:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18ced9d640 1 -- 172.21.15.130:0/907781435 learned_addr learned my addr 172.21.15.130:0/907781435 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18c5d9b640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18d00cb940 0x7f18d00c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18ced9d640 1 -- 172.21.15.130:0/907781435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18d00b0fa0 msgr2=0x7f18d015b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18ced9d640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18d00b0fa0 0x7f18d015b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:29.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18ced9d640 1 -- 172.21.15.130:0/907781435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18d00cb940 msgr2=0x7f18d00c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:29.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18ced9d640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18d00cb940 0x7f18d00c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:29.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18ced9d640 1 -- 172.21.15.130:0/907781435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c0009420 con 0x7f18d015d4b0 2023-09-13T06:07:29.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18ced9d640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d015d4b0 0x7f18d00c3cd0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f18c800c790 tx=0x7f18c800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:29.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18c77fe640 1 -- 172.21.15.130:0/907781435 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800cea0 con 0x7f18d015d4b0 2023-09-13T06:07:29.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18c77fe640 1 -- 172.21.15.130:0/907781435 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c8003b80 con 0x7f18d015d4b0 2023-09-13T06:07:29.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18d4e48640 1 -- 172.21.15.130:0/907781435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d00c4e30 con 0x7f18d015d4b0 2023-09-13T06:07:29.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18c77fe640 1 -- 172.21.15.130:0/907781435 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800a850 con 0x7f18d015d4b0 2023-09-13T06:07:29.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18d4e48640 1 -- 172.21.15.130:0/907781435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d00c53f0 con 0x7f18d015d4b0 2023-09-13T06:07:29.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.676+0000 7f18d4e48640 1 -- 172.21.15.130:0/907781435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d00618a0 con 0x7f18d015d4b0 2023-09-13T06:07:29.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.680+0000 7f18c77fe640 1 -- 172.21.15.130:0/907781435 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f18c800a9b0 con 0x7f18d015d4b0 2023-09-13T06:07:29.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.680+0000 7f18c77fe640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18b0065b20 0x7f18b0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:29.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.680+0000 7f18c77fe640 1 -- 172.21.15.130:0/907781435 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f18c80830f0 con 0x7f18d015d4b0 2023-09-13T06:07:29.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.680+0000 7f18ce59c640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18b0065b20 0x7f18b0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:29.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.680+0000 7f18ce59c640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18b0065b20 0x7f18b0067fe0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f18b8001ec0 tx=0x7f18b80019c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:29.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.684+0000 7f18c77fe640 1 -- 172.21.15.130:0/907781435 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f18c8050a90 con 0x7f18d015d4b0 2023-09-13T06:07:29.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:29.832+0000 7f18d4e48640 1 -- 172.21.15.130:0/907781435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f18d0161de0 con 0x7f18d015d4b0 2023-09-13T06:07:30.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.460+0000 7f18c77fe640 1 -- 172.21.15.130:0/907781435 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 181+0+0 (secure 0 0 0) 0x7f18c80540b0 con 0x7f18d015d4b0 2023-09-13T06:07:30.464 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' removed 2023-09-13T06:07:30.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 -- 172.21.15.130:0/907781435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18b0065b20 msgr2=0x7f18b0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:30.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18b0065b20 0x7f18b0067fe0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f18b8001ec0 tx=0x7f18b80019c0 comp rx=0 tx=0).stop 2023-09-13T06:07:30.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 -- 172.21.15.130:0/907781435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d015d4b0 msgr2=0x7f18d00c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:30.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d015d4b0 0x7f18d00c3cd0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f18c800c790 tx=0x7f18c800cc50 comp rx=0 tx=0).stop 2023-09-13T06:07:30.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 -- 172.21.15.130:0/907781435 shutdown_connections 2023-09-13T06:07:30.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18b0065b20 0x7f18b0067fe0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:30.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18d00cb940 0x7f18d00c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:30.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d015d4b0 0x7f18d00c3cd0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:30.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 --2- 172.21.15.130:0/907781435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18d00b0fa0 0x7f18d015b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:30.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 -- 172.21.15.130:0/907781435 >> 172.21.15.130:0/907781435 conn(0x7f18d0065f90 msgr2=0x7f18d015c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:30.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 -- 172.21.15.130:0/907781435 shutdown_connections 2023-09-13T06:07:30.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.464+0000 7f18d4e48640 1 -- 172.21.15.130:0/907781435 wait complete. 2023-09-13T06:07:30.489 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T06:07:30.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f467d47b640 1 Processor -- start 2023-09-13T06:07:30.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f467d47b640 1 -- start start 2023-09-13T06:07:30.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f467d47b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4678160de0 0x7f4678143460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:30.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f467d47b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f467806f530 0x7f467806f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:30.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f467d47b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46781439a0 con 0x7f46780d0c10 2023-09-13T06:07:30.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f467d47b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4678140740 con 0x7f4678160de0 2023-09-13T06:07:30.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f467d47b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467806fec0 con 0x7f467806f530 2023-09-13T06:07:30.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f466ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4678160de0 0x7f4678143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:30.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f466ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4678160de0 0x7f4678143460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57060/0 (socket says 172.21.15.130:57060) 2023-09-13T06:07:30.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f466ffff640 1 -- 172.21.15.130:0/1716944353 learned_addr learned my addr 172.21.15.130:0/1716944353 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:30.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f46777fe640 1 --2- 172.21.15.130:0/1716944353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f467806f530 0x7f467806f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:30.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f466ffff640 1 -- 172.21.15.130:0/1716944353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f467806f530 msgr2=0x7f467806f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:30.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f466ffff640 1 --2- 172.21.15.130:0/1716944353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f467806f530 0x7f467806f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:30.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f466ffff640 1 -- 172.21.15.130:0/1716944353 >> v1:172.21.15.164:6789/0 conn(0x7f46780d0c10 legacy=0x7f46780b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:30.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.632+0000 7f466ffff640 1 -- 172.21.15.130:0/1716944353 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467815d900 con 0x7f4678160de0 2023-09-13T06:07:30.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f466ffff640 1 --2- 172.21.15.130:0/1716944353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4678160de0 0x7f4678143460 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f4660009870 tx=0x7f466001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb385a2dd4ad11a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:30.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f46767fc640 1 -- 172.21.15.130:0/1716944353 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600ab600 con 0x7f4678160de0 2023-09-13T06:07:30.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f46767fc640 1 -- 172.21.15.130:0/1716944353 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46600a7050 con 0x7f4678160de0 2023-09-13T06:07:30.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f46767fc640 1 -- 172.21.15.130:0/1716944353 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600ab980 con 0x7f4678160de0 2023-09-13T06:07:30.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f467d47b640 1 -- 172.21.15.130:0/1716944353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4678160de0 msgr2=0x7f4678143460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:30.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f467d47b640 1 --2- 172.21.15.130:0/1716944353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4678160de0 0x7f4678143460 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f4660009870 tx=0x7f466001c540 comp rx=0 tx=0).stop 2023-09-13T06:07:30.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f467d47b640 1 -- 172.21.15.130:0/1716944353 shutdown_connections 2023-09-13T06:07:30.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f467d47b640 1 --2- 172.21.15.130:0/1716944353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f467806f530 0x7f467806f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:30.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f467d47b640 1 --2- 172.21.15.130:0/1716944353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4678160de0 0x7f4678143460 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:30.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f467d47b640 1 -- 172.21.15.130:0/1716944353 >> 172.21.15.130:0/1716944353 conn(0x7f4678065990 msgr2=0x7f4678065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:30.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f467d47b640 1 -- 172.21.15.130:0/1716944353 shutdown_connections 2023-09-13T06:07:30.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.636+0000 7f467d47b640 1 -- 172.21.15.130:0/1716944353 wait complete. 2023-09-13T06:07:30.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f467d47b640 1 Processor -- start 2023-09-13T06:07:30.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f467d47b640 1 -- start start 2023-09-13T06:07:30.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f467d47b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f467806f530 0x7f4678153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:30.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f467d47b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46780d0c10 0x7f46780b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:30.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f467d47b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4678160de0 0x7f46780b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:30.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f467d47b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467813f370 con 0x7f4678160de0 2023-09-13T06:07:30.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f467d47b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4678142d50 con 0x7f467806f530 2023-09-13T06:07:30.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f467d47b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467813ecb0 con 0x7f46780d0c10 2023-09-13T06:07:30.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f46777fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4678160de0 0x7f46780b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:30.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f46777fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4678160de0 0x7f46780b57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57076/0 (socket says 172.21.15.130:57076) 2023-09-13T06:07:30.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f46777fe640 1 -- 172.21.15.130:0/1563044519 learned_addr learned my addr 172.21.15.130:0/1563044519 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:30.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f4676ffd640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f467806f530 0x7f4678153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:30.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f466ffff640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46780d0c10 0x7f46780b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:30.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f46777fe640 1 -- 172.21.15.130:0/1563044519 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46780d0c10 msgr2=0x7f46780b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:30.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f46777fe640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46780d0c10 0x7f46780b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:30.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f46777fe640 1 -- 172.21.15.130:0/1563044519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f467806f530 msgr2=0x7f4678153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:30.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f46777fe640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f467806f530 0x7f4678153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:30.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f46777fe640 1 -- 172.21.15.130:0/1563044519 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46600094d0 con 0x7f4678160de0 2023-09-13T06:07:30.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f46777fe640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4678160de0 0x7f46780b57f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f4670007e40 tx=0x7f467000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:30.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f466f7fe640 1 -- 172.21.15.130:0/1563044519 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670014620 con 0x7f4678160de0 2023-09-13T06:07:30.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f466f7fe640 1 -- 172.21.15.130:0/1563044519 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467000ee90 con 0x7f4678160de0 2023-09-13T06:07:30.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f467d47b640 1 -- 172.21.15.130:0/1563044519 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467813ef90 con 0x7f4678160de0 2023-09-13T06:07:30.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f466f7fe640 1 -- 172.21.15.130:0/1563044519 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700149e0 con 0x7f4678160de0 2023-09-13T06:07:30.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.640+0000 7f467d47b640 1 -- 172.21.15.130:0/1563044519 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4678143030 con 0x7f4678160de0 2023-09-13T06:07:30.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.644+0000 7f467d47b640 1 -- 172.21.15.130:0/1563044519 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467813f4b0 con 0x7f4678160de0 2023-09-13T06:07:30.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.644+0000 7f466f7fe640 1 -- 172.21.15.130:0/1563044519 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4670014b40 con 0x7f4678160de0 2023-09-13T06:07:30.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.644+0000 7f466f7fe640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4658065b50 0x7f4658068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:30.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.644+0000 7f466f7fe640 1 -- 172.21.15.130:0/1563044519 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4670083960 con 0x7f4678160de0 2023-09-13T06:07:30.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.644+0000 7f4676ffd640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4658065b50 0x7f4658068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:30.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.644+0000 7f4676ffd640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4658065b50 0x7f4658068010 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4668007fd0 tx=0x7f4668009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:30.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.648+0000 7f466f7fe640 1 -- 172.21.15.130:0/1563044519 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f467813f4b0 con 0x7f4678160de0 2023-09-13T06:07:30.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:30.796+0000 7f467d47b640 1 -- 172.21.15.130:0/1563044519 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f467813f4b0 con 0x7f4678160de0 2023-09-13T06:07:31.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.468+0000 7f466f7fe640 1 -- 172.21.15.130:0/1563044519 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) v1 ==== 169+0+0 (secure 0 0 0) 0x7f467813f4b0 con 0x7f4678160de0 2023-09-13T06:07:31.472 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' removed 2023-09-13T06:07:31.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 -- 172.21.15.130:0/1563044519 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4658065b50 msgr2=0x7f4658068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4658065b50 0x7f4658068010 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4668007fd0 tx=0x7f4668009040 comp rx=0 tx=0).stop 2023-09-13T06:07:31.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 -- 172.21.15.130:0/1563044519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4678160de0 msgr2=0x7f46780b57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4678160de0 0x7f46780b57f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f4670007e40 tx=0x7f467000e4b0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 -- 172.21.15.130:0/1563044519 shutdown_connections 2023-09-13T06:07:31.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4658065b50 0x7f4658068010 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4678160de0 0x7f46780b57f0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46780d0c10 0x7f46780b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 --2- 172.21.15.130:0/1563044519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f467806f530 0x7f4678153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 -- 172.21.15.130:0/1563044519 >> 172.21.15.130:0/1563044519 conn(0x7f4678065990 msgr2=0x7f4678160220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:31.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 -- 172.21.15.130:0/1563044519 shutdown_connections 2023-09-13T06:07:31.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.472+0000 7f467d47b640 1 -- 172.21.15.130:0/1563044519 wait complete. 2023-09-13T06:07:31.494 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-13T06:07:31.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.632+0000 7f3f5afdf640 1 Processor -- start 2023-09-13T06:07:31.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.632+0000 7f3f5afdf640 1 -- start start 2023-09-13T06:07:31.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f5afdf640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f5413c590 0x7f3f5415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f5afdf640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f5413ee30 0x7f3f5413cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f5afdf640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3f54071220 0x7f3f54071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f5afdf640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5406bab0 con 0x7f3f5413c590 2023-09-13T06:07:31.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f5afdf640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f54071b90 con 0x7f3f54071220 2023-09-13T06:07:31.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f5afdf640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5413d320 con 0x7f3f5413ee30 2023-09-13T06:07:31.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f59fdd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f5413c590 0x7f3f5415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f59fdd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f5413c590 0x7f3f5415a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51492/0 (socket says 172.21.15.130:51492) 2023-09-13T06:07:31.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f59fdd640 1 -- 172.21.15.130:0/3975689482 learned_addr learned my addr 172.21.15.130:0/3975689482 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:31.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f597dc640 1 --2- 172.21.15.130:0/3975689482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f5413ee30 0x7f3f5413cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f5a7de640 1 --2- 172.21.15.130:0/3975689482 >> v2:172.21.15.164:3300/0 conn(0x7f3f54071220 0x7f3f54071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f59fdd640 1 -- 172.21.15.130:0/3975689482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f5413ee30 msgr2=0x7f3f5413cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:31.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f59fdd640 1 --2- 172.21.15.130:0/3975689482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f5413ee30 0x7f3f5413cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f59fdd640 1 -- 172.21.15.130:0/3975689482 >> v2:172.21.15.164:3300/0 conn(0x7f3f54071220 msgr2=0x7f3f54071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:31.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f59fdd640 1 --2- 172.21.15.130:0/3975689482 >> v2:172.21.15.164:3300/0 conn(0x7f3f54071220 0x7f3f54071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f59fdd640 1 -- 172.21.15.130:0/3975689482 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5413f300 con 0x7f3f5413c590 2023-09-13T06:07:31.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.636+0000 7f3f59fdd640 1 --2- 172.21.15.130:0/3975689482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f5413c590 0x7f3f5415a6b0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3f54157770 tx=0x7f3f5001d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39eb124b08506963 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:31.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f58fdb640 1 -- 172.21.15.130:0/3975689482 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500a6800 con 0x7f3f5413c590 2023-09-13T06:07:31.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f58fdb640 1 -- 172.21.15.130:0/3975689482 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f500a6960 con 0x7f3f5413c590 2023-09-13T06:07:31.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f58fdb640 1 -- 172.21.15.130:0/3975689482 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500a6cf0 con 0x7f3f5413c590 2023-09-13T06:07:31.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 -- 172.21.15.130:0/3975689482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f5413c590 msgr2=0x7f3f5415a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 --2- 172.21.15.130:0/3975689482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f5413c590 0x7f3f5415a6b0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3f54157770 tx=0x7f3f5001d810 comp rx=0 tx=0).stop 2023-09-13T06:07:31.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 -- 172.21.15.130:0/3975689482 shutdown_connections 2023-09-13T06:07:31.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 --2- 172.21.15.130:0/3975689482 >> v2:172.21.15.164:3300/0 conn(0x7f3f54071220 0x7f3f54071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 --2- 172.21.15.130:0/3975689482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f5413ee30 0x7f3f5413cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 --2- 172.21.15.130:0/3975689482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f5413c590 0x7f3f5415a6b0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 -- 172.21.15.130:0/3975689482 >> 172.21.15.130:0/3975689482 conn(0x7f3f540b0d00 msgr2=0x7f3f540cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:31.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 -- 172.21.15.130:0/3975689482 shutdown_connections 2023-09-13T06:07:31.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 -- 172.21.15.130:0/3975689482 wait complete. 2023-09-13T06:07:31.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 Processor -- start 2023-09-13T06:07:31.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 -- start start 2023-09-13T06:07:31.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f54071220 0x7f3f541552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f5413c590 0x7f3f5415c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f5413ee30 0x7f3f54156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f541565c0 con 0x7f3f5413c590 2023-09-13T06:07:31.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5413c360 con 0x7f3f54071220 2023-09-13T06:07:31.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f5afdf640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5415cb80 con 0x7f3f5413ee30 2023-09-13T06:07:31.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.640+0000 7f3f597dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f5413c590 0x7f3f5415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f597dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f5413c590 0x7f3f5415c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51500/0 (socket says 172.21.15.130:51500) 2023-09-13T06:07:31.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f597dc640 1 -- 172.21.15.130:0/1417199464 learned_addr learned my addr 172.21.15.130:0/1417199464 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:31.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f5a7de640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f5413ee30 0x7f3f54156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f59fdd640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f54071220 0x7f3f541552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f597dc640 1 -- 172.21.15.130:0/1417199464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f5413ee30 msgr2=0x7f3f54156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f597dc640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f5413ee30 0x7f3f54156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f597dc640 1 -- 172.21.15.130:0/1417199464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f54071220 msgr2=0x7f3f541552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f597dc640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f54071220 0x7f3f541552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f597dc640 1 -- 172.21.15.130:0/1417199464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5000a620 con 0x7f3f5413c590 2023-09-13T06:07:31.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f5a7de640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f5413ee30 0x7f3f54156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:31.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f59fdd640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f54071220 0x7f3f541552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:31.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f597dc640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f5413c590 0x7f3f5415c640 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400e900 tx=0x7f3f4400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:31.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f4a7fc640 1 -- 172.21.15.130:0/1417199464 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44009650 con 0x7f3f5413c590 2023-09-13T06:07:31.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f4a7fc640 1 -- 172.21.15.130:0/1417199464 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400ca00 con 0x7f3f5413c590 2023-09-13T06:07:31.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f5afdf640 1 -- 172.21.15.130:0/1417199464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f541559b0 con 0x7f3f5413c590 2023-09-13T06:07:31.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f4a7fc640 1 -- 172.21.15.130:0/1417199464 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400cd90 con 0x7f3f5413c590 2023-09-13T06:07:31.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f5afdf640 1 -- 172.21.15.130:0/1417199464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f54155f70 con 0x7f3f5413c590 2023-09-13T06:07:31.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f5afdf640 1 -- 172.21.15.130:0/1417199464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f540618a0 con 0x7f3f5413c590 2023-09-13T06:07:31.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f4a7fc640 1 -- 172.21.15.130:0/1417199464 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3f44013470 con 0x7f3f5413c590 2023-09-13T06:07:31.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f4a7fc640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f38065b20 0x7f3f38067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.644+0000 7f3f4a7fc640 1 -- 172.21.15.130:0/1417199464 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3f440833b0 con 0x7f3f5413c590 2023-09-13T06:07:31.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.648+0000 7f3f59fdd640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f38065b20 0x7f3f38067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.648+0000 7f3f59fdd640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f38065b20 0x7f3f38067fe0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3f500b0000 tx=0x7f3f500a8070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:31.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.648+0000 7f3f4a7fc640 1 -- 172.21.15.130:0/1417199464 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3f44050f60 con 0x7f3f5413c590 2023-09-13T06:07:31.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.796+0000 7f3f5afdf640 1 -- 172.21.15.130:0/1417199464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3f5406f290 con 0x7f3f5413c590 2023-09-13T06:07:31.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f4a7fc640 1 -- 172.21.15.130:0/1417199464 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3f44054580 con 0x7f3f5413c590 2023-09-13T06:07:31.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 -- 172.21.15.130:0/1417199464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f38065b20 msgr2=0x7f3f38067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f38065b20 0x7f3f38067fe0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3f500b0000 tx=0x7f3f500a8070 comp rx=0 tx=0).stop 2023-09-13T06:07:31.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 -- 172.21.15.130:0/1417199464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f5413c590 msgr2=0x7f3f5415c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f5413c590 0x7f3f5415c640 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400e900 tx=0x7f3f4400edc0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 -- 172.21.15.130:0/1417199464 shutdown_connections 2023-09-13T06:07:31.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3f38065b20 0x7f3f38067fe0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3f5413ee30 0x7f3f54156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f5413c590 0x7f3f5415c640 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 --2- 172.21.15.130:0/1417199464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f54071220 0x7f3f541552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 -- 172.21.15.130:0/1417199464 >> 172.21.15.130:0/1417199464 conn(0x7f3f540b0d00 msgr2=0x7f3f5406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:31.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 -- 172.21.15.130:0/1417199464 shutdown_connections 2023-09-13T06:07:31.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.804+0000 7f3f5afdf640 1 -- 172.21.15.130:0/1417199464 wait complete. 2023-09-13T06:07:31.827 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-09-13T06:07:31.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc59bf4640 1 Processor -- start 2023-09-13T06:07:31.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc59bf4640 1 -- start start 2023-09-13T06:07:31.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc59bf4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdc54146b30 0x7fdc540d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc59bf4640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc540d1ac0 con 0x7fdc540d0a10 2023-09-13T06:07:31.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc59bf4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc540d0eb0 con 0x7fdc540d1f50 2023-09-13T06:07:31.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc59bf4640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc540d1190 con 0x7fdc54146b30 2023-09-13T06:07:31.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc58bf2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdc54146b30 0x7fdc540d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc58bf2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdc54146b30 0x7fdc540d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51508/0 (socket says 172.21.15.130:51508) 2023-09-13T06:07:31.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc58bf2640 1 -- 172.21.15.130:0/2098276104 learned_addr learned my addr 172.21.15.130:0/2098276104 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:31.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc53fff640 1 --1- 172.21.15.130:0/2098276104 >> v1:172.21.15.130:6789/0 conn(0x7fdc540d0a10 0x7fdc54070180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33920/0 (socket says 172.21.15.130:33920) 2023-09-13T06:07:31.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc58bf2640 1 -- 172.21.15.130:0/2098276104 >> v1:172.21.15.164:6789/0 conn(0x7fdc540d1f50 legacy=0x7fdc5415d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc58bf2640 1 -- 172.21.15.130:0/2098276104 >> v1:172.21.15.130:6789/0 conn(0x7fdc540d0a10 legacy=0x7fdc54070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.964+0000 7fdc58bf2640 1 -- 172.21.15.130:0/2098276104 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc540d1470 con 0x7fdc54146b30 2023-09-13T06:07:31.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.968+0000 7fdc58bf2640 1 --2- 172.21.15.130:0/2098276104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc54146b30 0x7fdc540d04d0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009870 tx=0x7fdc4801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d3944e3e0e17cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:31.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.968+0000 7fdc537fe640 1 -- 172.21.15.130:0/2098276104 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480a95f0 con 0x7fdc54146b30 2023-09-13T06:07:31.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.968+0000 7fdc537fe640 1 -- 172.21.15.130:0/2098276104 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc480a9750 con 0x7fdc54146b30 2023-09-13T06:07:31.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.968+0000 7fdc537fe640 1 -- 172.21.15.130:0/2098276104 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480a9ae0 con 0x7fdc54146b30 2023-09-13T06:07:31.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.968+0000 7fdc59bf4640 1 -- 172.21.15.130:0/2098276104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc54146b30 msgr2=0x7fdc540d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.968+0000 7fdc59bf4640 1 --2- 172.21.15.130:0/2098276104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc54146b30 0x7fdc540d04d0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009870 tx=0x7fdc4801c510 comp rx=0 tx=0).stop 2023-09-13T06:07:31.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.968+0000 7fdc59bf4640 1 -- 172.21.15.130:0/2098276104 shutdown_connections 2023-09-13T06:07:31.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.968+0000 7fdc59bf4640 1 --2- 172.21.15.130:0/2098276104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc54146b30 0x7fdc540d04d0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.968+0000 7fdc59bf4640 1 -- 172.21.15.130:0/2098276104 >> 172.21.15.130:0/2098276104 conn(0x7fdc540d3090 msgr2=0x7fdc540d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:31.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.968+0000 7fdc59bf4640 1 -- 172.21.15.130:0/2098276104 shutdown_connections 2023-09-13T06:07:31.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.968+0000 7fdc59bf4640 1 -- 172.21.15.130:0/2098276104 wait complete. 2023-09-13T06:07:31.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc59bf4640 1 Processor -- start 2023-09-13T06:07:31.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc59bf4640 1 -- start start 2023-09-13T06:07:31.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc59bf4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc540d0a10 0x7fdc54144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc59bf4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc540d1f50 0x7fdc54141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc59bf4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc54146b30 0x7fdc540b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc59bf4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54143350 con 0x7fdc540d1f50 2023-09-13T06:07:31.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc59bf4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54143630 con 0x7fdc54146b30 2023-09-13T06:07:31.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc59bf4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54143910 con 0x7fdc540d0a10 2023-09-13T06:07:31.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc540d1f50 0x7fdc54141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc540d1f50 0x7fdc54141180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51524/0 (socket says 172.21.15.130:51524) 2023-09-13T06:07:31.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc53fff640 1 -- 172.21.15.130:0/703991952 learned_addr learned my addr 172.21.15.130:0/703991952 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:31.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc58bf2640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc540d0a10 0x7fdc54144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc593f3640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc54146b30 0x7fdc540b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc53fff640 1 -- 172.21.15.130:0/703991952 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc540d0a10 msgr2=0x7fdc54144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc53fff640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc540d0a10 0x7fdc54144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc53fff640 1 -- 172.21.15.130:0/703991952 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc54146b30 msgr2=0x7fdc540b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:31.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc53fff640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc54146b30 0x7fdc540b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:31.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc53fff640 1 -- 172.21.15.130:0/703991952 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc480094d0 con 0x7fdc540d1f50 2023-09-13T06:07:31.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc53fff640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc540d1f50 0x7fdc54141180 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c490 tx=0x7fdc4000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:31.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc517fa640 1 -- 172.21.15.130:0/703991952 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40007480 con 0x7fdc540d1f50 2023-09-13T06:07:31.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc517fa640 1 -- 172.21.15.130:0/703991952 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc400075e0 con 0x7fdc540d1f50 2023-09-13T06:07:31.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc59bf4640 1 -- 172.21.15.130:0/703991952 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc54143bf0 con 0x7fdc540d1f50 2023-09-13T06:07:31.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc517fa640 1 -- 172.21.15.130:0/703991952 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40004a10 con 0x7fdc540d1f50 2023-09-13T06:07:31.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc59bf4640 1 -- 172.21.15.130:0/703991952 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5415a0b0 con 0x7fdc540d1f50 2023-09-13T06:07:31.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.972+0000 7fdc59bf4640 1 -- 172.21.15.130:0/703991952 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc54143de0 con 0x7fdc540d1f50 2023-09-13T06:07:31.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.976+0000 7fdc517fa640 1 -- 172.21.15.130:0/703991952 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdc40004b70 con 0x7fdc540d1f50 2023-09-13T06:07:31.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.976+0000 7fdc517fa640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc38065b20 0x7fdc38067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:31.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.976+0000 7fdc517fa640 1 -- 172.21.15.130:0/703991952 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdc40082440 con 0x7fdc540d1f50 2023-09-13T06:07:31.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.976+0000 7fdc58bf2640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc38065b20 0x7fdc38067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:31.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.976+0000 7fdc58bf2640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc38065b20 0x7fdc38067fe0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdc480ae000 tx=0x7fdc480b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:31.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:31.980+0000 7fdc517fa640 1 -- 172.21.15.130:0/703991952 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdc40050090 con 0x7fdc540d1f50 2023-09-13T06:07:32.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.176+0000 7fdc59bf4640 1 -- 172.21.15.130:0/703991952 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7fdc540618a0 con 0x7fdc540d1f50 2023-09-13T06:07:32.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc517fa640 1 -- 172.21.15.130:0/703991952 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v339) v1 ==== 128+0+0 (secure 0 0 0) 0x7fdc400536b0 con 0x7fdc540d1f50 2023-09-13T06:07:32.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 -- 172.21.15.130:0/703991952 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc38065b20 msgr2=0x7fdc38067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc38065b20 0x7fdc38067fe0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdc480ae000 tx=0x7fdc480b3040 comp rx=0 tx=0).stop 2023-09-13T06:07:32.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 -- 172.21.15.130:0/703991952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc540d1f50 msgr2=0x7fdc54141180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc540d1f50 0x7fdc54141180 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c490 tx=0x7fdc4000c950 comp rx=0 tx=0).stop 2023-09-13T06:07:32.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 -- 172.21.15.130:0/703991952 shutdown_connections 2023-09-13T06:07:32.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdc38065b20 0x7fdc38067fe0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc54146b30 0x7fdc540b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc540d1f50 0x7fdc54141180 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 --2- 172.21.15.130:0/703991952 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc540d0a10 0x7fdc54144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 -- 172.21.15.130:0/703991952 >> 172.21.15.130:0/703991952 conn(0x7fdc540d3090 msgr2=0x7fdc540b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:32.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 -- 172.21.15.130:0/703991952 shutdown_connections 2023-09-13T06:07:32.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.472+0000 7fdc59bf4640 1 -- 172.21.15.130:0/703991952 wait complete. 2023-09-13T06:07:32.496 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-09-13T06:07:32.496 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-09-13T06:07:32.497 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:32.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.632+0000 7f0f3b693640 1 Processor -- start 2023-09-13T06:07:32.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.632+0000 7f0f3b693640 1 -- start start 2023-09-13T06:07:32.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f3b693640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f34157920 0x7f0f340ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f3b693640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0f340b0f40 0x7f0f340b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f3b693640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f340afee0 con 0x7f0f3415e560 2023-09-13T06:07:32.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f3b693640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f340aea50 con 0x7f0f340b0f40 2023-09-13T06:07:32.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f3b693640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340b0b20 con 0x7f0f34157920 2023-09-13T06:07:32.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f38c2e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0f340b0f40 0x7f0f340b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f39c30640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0f3415e560 0x7f0f340ac840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33928/0 (socket says 172.21.15.130:33928) 2023-09-13T06:07:32.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f39c30640 1 -- 172.21.15.130:0/2564808727 learned_addr learned my addr 172.21.15.130:0/2564808727 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:32.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f38c2e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0f340b0f40 0x7f0f340b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51532/0 (socket says 172.21.15.130:51532) 2023-09-13T06:07:32.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f3942f640 1 --2- 172.21.15.130:0/2564808727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f34157920 0x7f0f340ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f38c2e640 1 -- 172.21.15.130:0/2564808727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f34157920 msgr2=0x7f0f340ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:32.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f38c2e640 1 --2- 172.21.15.130:0/2564808727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f34157920 0x7f0f340ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f38c2e640 1 -- 172.21.15.130:0/2564808727 >> v1:172.21.15.130:6789/0 conn(0x7f0f3415e560 legacy=0x7f0f340ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f38c2e640 1 -- 172.21.15.130:0/2564808727 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340b0180 con 0x7f0f340b0f40 2023-09-13T06:07:32.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.636+0000 7f0f3942f640 1 --2- 172.21.15.130:0/2564808727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f34157920 0x7f0f340ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:32.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f38c2e640 1 --2- 172.21.15.130:0/2564808727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f340b0f40 0x7f0f340b1610 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0f240097c0 tx=0x7f0f2401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb4d2d4682a1d43 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:32.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f2bfff640 1 -- 172.21.15.130:0/2564808727 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240ad660 con 0x7f0f340b0f40 2023-09-13T06:07:32.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f2bfff640 1 -- 172.21.15.130:0/2564808727 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f240ad7c0 con 0x7f0f340b0f40 2023-09-13T06:07:32.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f2bfff640 1 -- 172.21.15.130:0/2564808727 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240adb50 con 0x7f0f340b0f40 2023-09-13T06:07:32.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f3b693640 1 -- 172.21.15.130:0/2564808727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f340b0f40 msgr2=0x7f0f340b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f3b693640 1 --2- 172.21.15.130:0/2564808727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f340b0f40 0x7f0f340b1610 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0f240097c0 tx=0x7f0f2401c450 comp rx=0 tx=0).stop 2023-09-13T06:07:32.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f3b693640 1 -- 172.21.15.130:0/2564808727 shutdown_connections 2023-09-13T06:07:32.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f3b693640 1 --2- 172.21.15.130:0/2564808727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f340b0f40 0x7f0f340b1610 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f3b693640 1 --2- 172.21.15.130:0/2564808727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f34157920 0x7f0f340ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f3b693640 1 -- 172.21.15.130:0/2564808727 >> 172.21.15.130:0/2564808727 conn(0x7f0f34065990 msgr2=0x7f0f34065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:32.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f3b693640 1 -- 172.21.15.130:0/2564808727 shutdown_connections 2023-09-13T06:07:32.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f3b693640 1 -- 172.21.15.130:0/2564808727 wait complete. 2023-09-13T06:07:32.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f3b693640 1 Processor -- start 2023-09-13T06:07:32.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.640+0000 7f0f3b693640 1 -- start start 2023-09-13T06:07:32.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f3b693640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f340b0f40 0x7f0f34153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f3b693640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f34157920 0x7f0f341475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f3b693640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f3415e560 0x7f0f34137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f3b693640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34147af0 con 0x7f0f34157920 2023-09-13T06:07:32.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f3b693640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3414b3d0 con 0x7f0f340b0f40 2023-09-13T06:07:32.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f3b693640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34138000 con 0x7f0f3415e560 2023-09-13T06:07:32.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f38c2e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f34157920 0x7f0f341475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f38c2e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f34157920 0x7f0f341475b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51534/0 (socket says 172.21.15.130:51534) 2023-09-13T06:07:32.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f38c2e640 1 -- 172.21.15.130:0/4294615303 learned_addr learned my addr 172.21.15.130:0/4294615303 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:32.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f39c30640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f3415e560 0x7f0f34137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f3942f640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f340b0f40 0x7f0f34153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f38c2e640 1 -- 172.21.15.130:0/4294615303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f3415e560 msgr2=0x7f0f34137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f38c2e640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f3415e560 0x7f0f34137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f38c2e640 1 -- 172.21.15.130:0/4294615303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f340b0f40 msgr2=0x7f0f34153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f38c2e640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f340b0f40 0x7f0f34153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f38c2e640 1 -- 172.21.15.130:0/4294615303 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f24009420 con 0x7f0f34157920 2023-09-13T06:07:32.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f39c30640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f3415e560 0x7f0f34137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:32.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f3942f640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f340b0f40 0x7f0f34153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:32.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f38c2e640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f34157920 0x7f0f341475b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f0f2401a080 tx=0x7f0f240191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:32.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f29ffb640 1 -- 172.21.15.130:0/4294615303 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240b6610 con 0x7f0f34157920 2023-09-13T06:07:32.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f29ffb640 1 -- 172.21.15.130:0/4294615303 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f240b6790 con 0x7f0f34157920 2023-09-13T06:07:32.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f29ffb640 1 -- 172.21.15.130:0/4294615303 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240b6b40 con 0x7f0f34157920 2023-09-13T06:07:32.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f3b693640 1 -- 172.21.15.130:0/4294615303 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f34147d50 con 0x7f0f34157920 2023-09-13T06:07:32.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f3b693640 1 -- 172.21.15.130:0/4294615303 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f34148310 con 0x7f0f34157920 2023-09-13T06:07:32.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f3b693640 1 -- 172.21.15.130:0/4294615303 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f340ae260 con 0x7f0f34157920 2023-09-13T06:07:32.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.644+0000 7f0f29ffb640 1 -- 172.21.15.130:0/4294615303 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0f240b4040 con 0x7f0f34157920 2023-09-13T06:07:32.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.648+0000 7f0f29ffb640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f18065b20 0x7f0f18067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.648+0000 7f0f29ffb640 1 -- 172.21.15.130:0/4294615303 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0f2411d4b0 con 0x7f0f34157920 2023-09-13T06:07:32.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.648+0000 7f0f3942f640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f18065b20 0x7f0f18067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.648+0000 7f0f3942f640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f18065b20 0x7f0f18067fe0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009980 tx=0x7f0f30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:32.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.652+0000 7f0f29ffb640 1 -- 172.21.15.130:0/4294615303 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0f240eb190 con 0x7f0f34157920 2023-09-13T06:07:32.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.800+0000 7f0f3b693640 1 -- 172.21.15.130:0/4294615303 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f340618a0 con 0x7f0f34157920 2023-09-13T06:07:32.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.800+0000 7f0f29ffb640 1 -- 172.21.15.130:0/4294615303 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+13035 (secure 0 0 0) 0x7f0f240ee7b0 con 0x7f0f34157920 2023-09-13T06:07:32.803 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:32.803 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":129,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:31.462215+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.130:6837/4103504372":"2023-09-14T06:07:28.444885+0000","172.21.15.130:6836/4103504372":"2023-09-14T06:07:28.444885+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:32.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 -- 172.21.15.130:0/4294615303 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f18065b20 msgr2=0x7f0f18067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f18065b20 0x7f0f18067fe0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009980 tx=0x7f0f30008040 comp rx=0 tx=0).stop 2023-09-13T06:07:32.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 -- 172.21.15.130:0/4294615303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f34157920 msgr2=0x7f0f341475b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f34157920 0x7f0f341475b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f0f2401a080 tx=0x7f0f240191f0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 -- 172.21.15.130:0/4294615303 shutdown_connections 2023-09-13T06:07:32.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f18065b20 0x7f0f18067fe0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f3415e560 0x7f0f34137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f34157920 0x7f0f341475b0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 --2- 172.21.15.130:0/4294615303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f340b0f40 0x7f0f34153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 -- 172.21.15.130:0/4294615303 >> 172.21.15.130:0/4294615303 conn(0x7f0f34065990 msgr2=0x7f0f3415ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:32.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 -- 172.21.15.130:0/4294615303 shutdown_connections 2023-09-13T06:07:32.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.804+0000 7f0f3b693640 1 -- 172.21.15.130:0/4294615303 wait complete. 2023-09-13T06:07:32.824 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:07:32.825 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:07:32.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.964+0000 7fb42b5db640 1 Processor -- start 2023-09-13T06:07:32.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.964+0000 7fb42b5db640 1 -- start start 2023-09-13T06:07:32.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.964+0000 7fb42b5db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb424157750 0x7fb424160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.964+0000 7fb42b5db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb424157b30 0x7fb42406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.964+0000 7fb42b5db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb424161e60 con 0x7fb42406f170 2023-09-13T06:07:32.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.964+0000 7fb42b5db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240ae0d0 con 0x7fb424157b30 2023-09-13T06:07:32.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.964+0000 7fb42b5db640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4241615c0 con 0x7fb424157750 2023-09-13T06:07:32.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb428b76640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb424157b30 0x7fb42406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb429377640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb424157750 0x7fb424160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb428b76640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb424157b30 0x7fb42406dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51548/0 (socket says 172.21.15.130:51548) 2023-09-13T06:07:32.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb428b76640 1 -- 172.21.15.130:0/2639124536 learned_addr learned my addr 172.21.15.130:0/2639124536 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:32.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb428b76640 1 -- 172.21.15.130:0/2639124536 >> v2:172.21.15.164:3300/0 conn(0x7fb424157750 msgr2=0x7fb424160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:32.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb428b76640 1 --2- 172.21.15.130:0/2639124536 >> v2:172.21.15.164:3300/0 conn(0x7fb424157750 0x7fb424160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb428b76640 1 -- 172.21.15.130:0/2639124536 >> v1:172.21.15.164:6789/0 conn(0x7fb42406f170 legacy=0x7fb42415e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb428b76640 1 -- 172.21.15.130:0/2639124536 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4241618a0 con 0x7fb424157b30 2023-09-13T06:07:32.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb428b76640 1 --2- 172.21.15.130:0/2639124536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424157b30 0x7fb42406dba0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fb4240664d0 tx=0x7fb41401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce39759503ceba8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:32.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb41bfff640 1 -- 172.21.15.130:0/2639124536 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140ac640 con 0x7fb424157b30 2023-09-13T06:07:32.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb41bfff640 1 -- 172.21.15.130:0/2639124536 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4140ac7a0 con 0x7fb424157b30 2023-09-13T06:07:32.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.968+0000 7fb41bfff640 1 -- 172.21.15.130:0/2639124536 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140acb30 con 0x7fb424157b30 2023-09-13T06:07:32.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 -- 172.21.15.130:0/2639124536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424157b30 msgr2=0x7fb42406dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 --2- 172.21.15.130:0/2639124536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424157b30 0x7fb42406dba0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fb4240664d0 tx=0x7fb41401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 -- 172.21.15.130:0/2639124536 shutdown_connections 2023-09-13T06:07:32.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 --2- 172.21.15.130:0/2639124536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424157b30 0x7fb42406dba0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 --2- 172.21.15.130:0/2639124536 >> v2:172.21.15.164:3300/0 conn(0x7fb424157750 0x7fb424160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 -- 172.21.15.130:0/2639124536 >> 172.21.15.130:0/2639124536 conn(0x7fb424065d60 msgr2=0x7fb4240b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:32.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 -- 172.21.15.130:0/2639124536 shutdown_connections 2023-09-13T06:07:32.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 -- 172.21.15.130:0/2639124536 wait complete. 2023-09-13T06:07:32.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 Processor -- start 2023-09-13T06:07:32.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 -- start start 2023-09-13T06:07:32.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb42406f170 0x7fb424140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb424157750 0x7fb4240ae940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424157b30 0x7fb4240aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424151810 con 0x7fb424157b30 2023-09-13T06:07:32.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424151a20 con 0x7fb42406f170 2023-09-13T06:07:32.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb42b5db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb424151d00 con 0x7fb424157750 2023-09-13T06:07:32.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb429b78640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424157b30 0x7fb4240aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb429b78640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424157b30 0x7fb4240aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51562/0 (socket says 172.21.15.130:51562) 2023-09-13T06:07:32.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb429b78640 1 -- 172.21.15.130:0/2298412249 learned_addr learned my addr 172.21.15.130:0/2298412249 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb429377640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb42406f170 0x7fb424140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb428b76640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb424157750 0x7fb4240ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb429b78640 1 -- 172.21.15.130:0/2298412249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb424157750 msgr2=0x7fb4240ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb429b78640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb424157750 0x7fb4240ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb429b78640 1 -- 172.21.15.130:0/2298412249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb42406f170 msgr2=0x7fb424140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb429b78640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb42406f170 0x7fb424140120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb429b78640 1 -- 172.21.15.130:0/2298412249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4140094d0 con 0x7fb424157b30 2023-09-13T06:07:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.972+0000 7fb428b76640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb424157750 0x7fb4240ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.976+0000 7fb429b78640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424157b30 0x7fb4240aee80 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c730 tx=0x7fb41c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:32.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.976+0000 7fb419ffb640 1 -- 172.21.15.130:0/2298412249 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c003b80 con 0x7fb424157b30 2023-09-13T06:07:32.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.976+0000 7fb419ffb640 1 -- 172.21.15.130:0/2298412249 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c003ce0 con 0x7fb424157b30 2023-09-13T06:07:32.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.976+0000 7fb419ffb640 1 -- 172.21.15.130:0/2298412249 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c00aa30 con 0x7fb424157b30 2023-09-13T06:07:32.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.976+0000 7fb42b5db640 1 -- 172.21.15.130:0/2298412249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb424151fe0 con 0x7fb424157b30 2023-09-13T06:07:32.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.976+0000 7fb42b5db640 1 -- 172.21.15.130:0/2298412249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4241525a0 con 0x7fb424157b30 2023-09-13T06:07:32.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.976+0000 7fb42b5db640 1 -- 172.21.15.130:0/2298412249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb424152790 con 0x7fb424157b30 2023-09-13T06:07:32.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.976+0000 7fb419ffb640 1 -- 172.21.15.130:0/2298412249 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb41c00ab90 con 0x7fb424157b30 2023-09-13T06:07:32.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.976+0000 7fb419ffb640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb408065b20 0x7fb408067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:32.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.976+0000 7fb419ffb640 1 -- 172.21.15.130:0/2298412249 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb41c082d40 con 0x7fb424157b30 2023-09-13T06:07:32.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.976+0000 7fb429377640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb408065b20 0x7fb408067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:32.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.980+0000 7fb429377640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb408065b20 0x7fb408067fe0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb420009b60 tx=0x7fb420009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:32.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:32.980+0000 7fb419ffb640 1 -- 172.21.15.130:0/2298412249 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb41c050990 con 0x7fb424157b30 2023-09-13T06:07:33.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.128+0000 7fb42b5db640 1 -- 172.21.15.130:0/2298412249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4240618a0 con 0x7fb424157b30 2023-09-13T06:07:33.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.128+0000 7fb419ffb640 1 -- 172.21.15.130:0/2298412249 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v129) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb41c053fb0 con 0x7fb424157b30 2023-09-13T06:07:33.132 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:07:33.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 -- 172.21.15.130:0/2298412249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb408065b20 msgr2=0x7fb408067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:33.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb408065b20 0x7fb408067fe0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb420009b60 tx=0x7fb420009190 comp rx=0 tx=0).stop 2023-09-13T06:07:33.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 -- 172.21.15.130:0/2298412249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424157b30 msgr2=0x7fb4240aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:33.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424157b30 0x7fb4240aee80 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c730 tx=0x7fb41c00cbf0 comp rx=0 tx=0).stop 2023-09-13T06:07:33.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 -- 172.21.15.130:0/2298412249 shutdown_connections 2023-09-13T06:07:33.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb408065b20 0x7fb408067fe0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:33.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424157b30 0x7fb4240aee80 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:33.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb424157750 0x7fb4240ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:33.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 --2- 172.21.15.130:0/2298412249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb42406f170 0x7fb424140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:33.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 -- 172.21.15.130:0/2298412249 >> 172.21.15.130:0/2298412249 conn(0x7fb424065d60 msgr2=0x7fb424160430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:33.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 -- 172.21.15.130:0/2298412249 shutdown_connections 2023-09-13T06:07:33.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.132+0000 7fb42b5db640 1 -- 172.21.15.130:0/2298412249 wait complete. 2023-09-13T06:07:33.153 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-09-13T06:07:33.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf46111640 1 Processor -- start 2023-09-13T06:07:33.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf46111640 1 -- start start 2023-09-13T06:07:33.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf46111640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbf400d1090 0x7fbf4015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:33.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf46111640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf400b63c0 con 0x7fbf40146f30 2023-09-13T06:07:33.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf46111640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf400d0c20 con 0x7fbf400d1750 2023-09-13T06:07:33.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf46111640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4015dea0 con 0x7fbf400d1090 2023-09-13T06:07:33.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf3ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fbf40146f30 0x7fbf400b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33932/0 (socket says 172.21.15.130:33932) 2023-09-13T06:07:33.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf3effd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbf400d1090 0x7fbf4015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:33.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf3ffff640 1 -- 172.21.15.130:0/893689108 learned_addr learned my addr 172.21.15.130:0/893689108 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:33.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf3effd640 1 -- 172.21.15.130:0/893689108 >> v1:172.21.15.164:6789/0 conn(0x7fbf400d1750 legacy=0x7fbf40146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:33.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf3effd640 1 -- 172.21.15.130:0/893689108 >> v1:172.21.15.130:6789/0 conn(0x7fbf40146f30 legacy=0x7fbf400b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:33.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.288+0000 7fbf3effd640 1 -- 172.21.15.130:0/893689108 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400b6610 con 0x7fbf400d1090 2023-09-13T06:07:33.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.292+0000 7fbf3effd640 1 --2- 172.21.15.130:0/893689108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf400d1090 0x7fbf4015d960 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fbf340097c0 tx=0x7fbf3401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e052cc733a5185 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:33.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.292+0000 7fbf3e7fc640 1 -- 172.21.15.130:0/893689108 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf340ac620 con 0x7fbf400d1090 2023-09-13T06:07:33.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.292+0000 7fbf3e7fc640 1 -- 172.21.15.130:0/893689108 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf340ac780 con 0x7fbf400d1090 2023-09-13T06:07:33.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.292+0000 7fbf3e7fc640 1 -- 172.21.15.130:0/893689108 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf340acb10 con 0x7fbf400d1090 2023-09-13T06:07:33.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.292+0000 7fbf46111640 1 -- 172.21.15.130:0/893689108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf400d1090 msgr2=0x7fbf4015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:33.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.292+0000 7fbf46111640 1 --2- 172.21.15.130:0/893689108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf400d1090 0x7fbf4015d960 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fbf340097c0 tx=0x7fbf3401c3c0 comp rx=0 tx=0).stop 2023-09-13T06:07:33.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.292+0000 7fbf46111640 1 -- 172.21.15.130:0/893689108 shutdown_connections 2023-09-13T06:07:33.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.292+0000 7fbf46111640 1 --2- 172.21.15.130:0/893689108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf400d1090 0x7fbf4015d960 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:33.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.292+0000 7fbf46111640 1 -- 172.21.15.130:0/893689108 >> 172.21.15.130:0/893689108 conn(0x7fbf4006f170 msgr2=0x7fbf4006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:33.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.292+0000 7fbf46111640 1 -- 172.21.15.130:0/893689108 shutdown_connections 2023-09-13T06:07:33.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.292+0000 7fbf46111640 1 -- 172.21.15.130:0/893689108 wait complete. 2023-09-13T06:07:33.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf46111640 1 Processor -- start 2023-09-13T06:07:33.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf46111640 1 -- start start 2023-09-13T06:07:33.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf46111640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf400d1090 0x7fbf4013d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:33.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf46111640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf400d1750 0x7fbf400b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:33.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf46111640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf40146f30 0x7fbf40142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:33.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf46111640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4013bc30 con 0x7fbf40146f30 2023-09-13T06:07:33.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf46111640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4013bed0 con 0x7fbf400d1750 2023-09-13T06:07:33.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf46111640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4013c1b0 con 0x7fbf400d1090 2023-09-13T06:07:33.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf40146f30 0x7fbf40142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:33.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf40146f30 0x7fbf40142730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51588/0 (socket says 172.21.15.130:51588) 2023-09-13T06:07:33.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3ffff640 1 -- 172.21.15.130:0/1367789309 learned_addr learned my addr 172.21.15.130:0/1367789309 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:33.301 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3f7fe640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf400d1090 0x7fbf4013d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:33.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3effd640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf400d1750 0x7fbf400b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:33.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3ffff640 1 -- 172.21.15.130:0/1367789309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf400d1090 msgr2=0x7fbf4013d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:33.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3ffff640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf400d1090 0x7fbf4013d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:33.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3ffff640 1 -- 172.21.15.130:0/1367789309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf400d1750 msgr2=0x7fbf400b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:33.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3ffff640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf400d1750 0x7fbf400b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:33.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3ffff640 1 -- 172.21.15.130:0/1367789309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf34009420 con 0x7fbf40146f30 2023-09-13T06:07:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3f7fe640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf400d1090 0x7fbf4013d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3effd640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf400d1750 0x7fbf400b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf3ffff640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf40146f30 0x7fbf40142730 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800ca80 tx=0x7fbf3800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf27fff640 1 -- 172.21.15.130:0/1367789309 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3800ac30 con 0x7fbf40146f30 2023-09-13T06:07:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf27fff640 1 -- 172.21.15.130:0/1367789309 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3800ad90 con 0x7fbf40146f30 2023-09-13T06:07:33.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf27fff640 1 -- 172.21.15.130:0/1367789309 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38012600 con 0x7fbf40146f30 2023-09-13T06:07:33.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf46111640 1 -- 172.21.15.130:0/1367789309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4013c490 con 0x7fbf40146f30 2023-09-13T06:07:33.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.296+0000 7fbf46111640 1 -- 172.21.15.130:0/1367789309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4013ca50 con 0x7fbf40146f30 2023-09-13T06:07:33.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.300+0000 7fbf46111640 1 -- 172.21.15.130:0/1367789309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf400618a0 con 0x7fbf40146f30 2023-09-13T06:07:33.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.300+0000 7fbf27fff640 1 -- 172.21.15.130:0/1367789309 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbf38007070 con 0x7fbf40146f30 2023-09-13T06:07:33.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.300+0000 7fbf27fff640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbf2c065b20 0x7fbf2c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:33.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.300+0000 7fbf27fff640 1 -- 172.21.15.130:0/1367789309 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbf38082e00 con 0x7fbf40146f30 2023-09-13T06:07:33.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.300+0000 7fbf3f7fe640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbf2c065b20 0x7fbf2c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:33.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.300+0000 7fbf3f7fe640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbf2c065b20 0x7fbf2c067fe0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000f70 tx=0x7fbf30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:33.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.304+0000 7fbf27fff640 1 -- 172.21.15.130:0/1367789309 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbf38050af0 con 0x7fbf40146f30 2023-09-13T06:07:33.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:33.508+0000 7fbf46111640 1 -- 172.21.15.130:0/1367789309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fbf400b86c0 con 0x7fbf40146f30 2023-09-13T06:07:34.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf27fff640 1 -- 172.21.15.130:0/1367789309 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v341) v1 ==== 143+0+0 (secure 0 0 0) 0x7fbf38017020 con 0x7fbf40146f30 2023-09-13T06:07:34.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 -- 172.21.15.130:0/1367789309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbf2c065b20 msgr2=0x7fbf2c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:34.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbf2c065b20 0x7fbf2c067fe0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000f70 tx=0x7fbf30009040 comp rx=0 tx=0).stop 2023-09-13T06:07:34.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 -- 172.21.15.130:0/1367789309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf40146f30 msgr2=0x7fbf40142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:34.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf40146f30 0x7fbf40142730 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800ca80 tx=0x7fbf3800cf40 comp rx=0 tx=0).stop 2023-09-13T06:07:34.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 -- 172.21.15.130:0/1367789309 shutdown_connections 2023-09-13T06:07:34.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbf2c065b20 0x7fbf2c067fe0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf400d1750 0x7fbf400b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf40146f30 0x7fbf40142730 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 --2- 172.21.15.130:0/1367789309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf400d1090 0x7fbf4013d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 -- 172.21.15.130:0/1367789309 >> 172.21.15.130:0/1367789309 conn(0x7fbf4006f170 msgr2=0x7fbf40141f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:34.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 -- 172.21.15.130:0/1367789309 shutdown_connections 2023-09-13T06:07:34.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.484+0000 7fbf46111640 1 -- 172.21.15.130:0/1367789309 wait complete. 2023-09-13T06:07:34.511 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-13T06:07:34.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa747367640 1 Processor -- start 2023-09-13T06:07:34.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa747367640 1 -- start start 2023-09-13T06:07:34.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa747367640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa740144d70 0x7fa7400ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:34.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa747367640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa7400b1b70 0x7fa7400b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:34.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa747367640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7400b3120 con 0x7fa7400b2780 2023-09-13T06:07:34.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa747367640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7400b2430 con 0x7fa7400b1b70 2023-09-13T06:07:34.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa747367640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7400cedb0 con 0x7fa740144d70 2023-09-13T06:07:34.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa745904640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa7400b1b70 0x7fa7400b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:34.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa745904640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa7400b1b70 0x7fa7400b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51598/0 (socket says 172.21.15.130:51598) 2023-09-13T06:07:34.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa745904640 1 -- 172.21.15.130:0/2939407921 learned_addr learned my addr 172.21.15.130:0/2939407921 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:34.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa745904640 1 -- 172.21.15.130:0/2939407921 >> v2:172.21.15.164:3300/0 conn(0x7fa740144d70 msgr2=0x7fa7400ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:34.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa745103640 1 --2- 172.21.15.130:0/2939407921 >> v2:172.21.15.164:3300/0 conn(0x7fa740144d70 0x7fa7400ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:34.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa745904640 1 --2- 172.21.15.130:0/2939407921 >> v2:172.21.15.164:3300/0 conn(0x7fa740144d70 0x7fa7400ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa745904640 1 -- 172.21.15.130:0/2939407921 >> v1:172.21.15.164:6789/0 conn(0x7fa7400b2780 legacy=0x7fa7400b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:34.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa745904640 1 -- 172.21.15.130:0/2939407921 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400b2150 con 0x7fa7400b1b70 2023-09-13T06:07:34.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.656+0000 7fa745103640 1 --2- 172.21.15.130:0/2939407921 >> v2:172.21.15.164:3300/0 conn(0x7fa740144d70 0x7fa7400ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:34.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa745904640 1 --2- 172.21.15.130:0/2939407921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7400b1b70 0x7fa7400b2be0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa7400cff90 tx=0x7fa73801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1b0c5f3729403f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:34.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa737fff640 1 -- 172.21.15.130:0/2939407921 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380a5740 con 0x7fa7400b1b70 2023-09-13T06:07:34.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa737fff640 1 -- 172.21.15.130:0/2939407921 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7380a58a0 con 0x7fa7400b1b70 2023-09-13T06:07:34.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa737fff640 1 -- 172.21.15.130:0/2939407921 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380a5c30 con 0x7fa7400b1b70 2023-09-13T06:07:34.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa747367640 1 -- 172.21.15.130:0/2939407921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7400b1b70 msgr2=0x7fa7400b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:34.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa747367640 1 --2- 172.21.15.130:0/2939407921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7400b1b70 0x7fa7400b2be0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa7400cff90 tx=0x7fa73801c990 comp rx=0 tx=0).stop 2023-09-13T06:07:34.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa747367640 1 -- 172.21.15.130:0/2939407921 shutdown_connections 2023-09-13T06:07:34.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa747367640 1 --2- 172.21.15.130:0/2939407921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7400b1b70 0x7fa7400b2be0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa747367640 1 --2- 172.21.15.130:0/2939407921 >> v2:172.21.15.164:3300/0 conn(0x7fa740144d70 0x7fa7400ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa747367640 1 -- 172.21.15.130:0/2939407921 >> 172.21.15.130:0/2939407921 conn(0x7fa740065990 msgr2=0x7fa740065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:34.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa747367640 1 -- 172.21.15.130:0/2939407921 shutdown_connections 2023-09-13T06:07:34.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.660+0000 7fa747367640 1 -- 172.21.15.130:0/2939407921 wait complete. 2023-09-13T06:07:34.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa747367640 1 Processor -- start 2023-09-13T06:07:34.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa747367640 1 -- start start 2023-09-13T06:07:34.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa747367640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7400b1b70 0x7fa740137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:34.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa747367640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7400b2780 0x7fa7400cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:34.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa747367640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa740144d70 0x7fa7400ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa747367640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400cd7f0 con 0x7fa740144d70 2023-09-13T06:07:34.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa747367640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa740138190 con 0x7fa7400b1b70 2023-09-13T06:07:34.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa747367640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400cbb80 con 0x7fa7400b2780 2023-09-13T06:07:34.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa745904640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa740144d70 0x7fa7400ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:34.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa745904640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa740144d70 0x7fa7400ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51602/0 (socket says 172.21.15.130:51602) 2023-09-13T06:07:34.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa745904640 1 -- 172.21.15.130:0/2081442279 learned_addr learned my addr 172.21.15.130:0/2081442279 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:34.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa745103640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7400b1b70 0x7fa740137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:34.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa744902640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7400b2780 0x7fa7400cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:34.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa745904640 1 -- 172.21.15.130:0/2081442279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7400b2780 msgr2=0x7fa7400cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:34.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa745904640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7400b2780 0x7fa7400cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa745904640 1 -- 172.21.15.130:0/2081442279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7400b1b70 msgr2=0x7fa740137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:34.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa745904640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7400b1b70 0x7fa740137c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa745904640 1 -- 172.21.15.130:0/2081442279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa738009b30 con 0x7fa740144d70 2023-09-13T06:07:34.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa745904640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa740144d70 0x7fa7400ac840 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa73801b040 tx=0x7fa738019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:34.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa735ffb640 1 -- 172.21.15.130:0/2081442279 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380b8670 con 0x7fa740144d70 2023-09-13T06:07:34.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa735ffb640 1 -- 172.21.15.130:0/2081442279 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7380b87d0 con 0x7fa740144d70 2023-09-13T06:07:34.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa735ffb640 1 -- 172.21.15.130:0/2081442279 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380b8b60 con 0x7fa740144d70 2023-09-13T06:07:34.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa747367640 1 -- 172.21.15.130:0/2081442279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7400cd230 con 0x7fa740144d70 2023-09-13T06:07:34.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.664+0000 7fa747367640 1 -- 172.21.15.130:0/2081442279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7400cbe20 con 0x7fa740144d70 2023-09-13T06:07:34.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.668+0000 7fa747367640 1 -- 172.21.15.130:0/2081442279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7400cb9e0 con 0x7fa740144d70 2023-09-13T06:07:34.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.668+0000 7fa735ffb640 1 -- 172.21.15.130:0/2081442279 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa7380b8cc0 con 0x7fa740144d70 2023-09-13T06:07:34.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.668+0000 7fa735ffb640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa724065b20 0x7fa724067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:34.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.668+0000 7fa735ffb640 1 -- 172.21.15.130:0/2081442279 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa73811e470 con 0x7fa740144d70 2023-09-13T06:07:34.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.668+0000 7fa745103640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa724065b20 0x7fa724067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:34.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.668+0000 7fa745103640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa724065b20 0x7fa724067fe0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa73c006fd0 tx=0x7fa73c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:34.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.672+0000 7fa735ffb640 1 -- 172.21.15.130:0/2081442279 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa7400cb9e0 con 0x7fa740144d70 2023-09-13T06:07:34.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.820+0000 7fa747367640 1 -- 172.21.15.130:0/2081442279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa7400cb9e0 con 0x7fa740144d70 2023-09-13T06:07:34.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.824+0000 7fa735ffb640 1 -- 172.21.15.130:0/2081442279 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa7400cb9e0 con 0x7fa740144d70 2023-09-13T06:07:34.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 -- 172.21.15.130:0/2081442279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa724065b20 msgr2=0x7fa724067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:34.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa724065b20 0x7fa724067fe0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa73c006fd0 tx=0x7fa73c008040 comp rx=0 tx=0).stop 2023-09-13T06:07:34.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 -- 172.21.15.130:0/2081442279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa740144d70 msgr2=0x7fa7400ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:34.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa740144d70 0x7fa7400ac840 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa73801b040 tx=0x7fa738019730 comp rx=0 tx=0).stop 2023-09-13T06:07:34.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 -- 172.21.15.130:0/2081442279 shutdown_connections 2023-09-13T06:07:34.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa724065b20 0x7fa724067fe0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa740144d70 0x7fa7400ac840 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7400b2780 0x7fa7400cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 --2- 172.21.15.130:0/2081442279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7400b1b70 0x7fa740137c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:34.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 -- 172.21.15.130:0/2081442279 >> 172.21.15.130:0/2081442279 conn(0x7fa740065990 msgr2=0x7fa740141100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:34.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 -- 172.21.15.130:0/2081442279 shutdown_connections 2023-09-13T06:07:34.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:34.828+0000 7fa747367640 1 -- 172.21.15.130:0/2081442279 wait complete. 2023-09-13T06:07:34.849 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:07:34.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:07:34.913 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:07:34.989 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:07:34.989 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:07:34.990 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:34.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:07:34.999 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:07:34.999 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:35.009 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:07:35.009 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:07:35.010 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:35.048 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:07:35.049 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:07:35.049 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:35.058 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:07:35.059 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-13T06:07:35.059 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:35.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.224+0000 7f3672511640 1 Processor -- start 2023-09-13T06:07:35.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.224+0000 7f3672511640 1 -- start start 2023-09-13T06:07:35.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f3672511640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f366c146cf0 0x7f366c0c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f3672511640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f366c1610a0 0x7f366c0cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f3672511640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f366c0ccfa0 0x7f366c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f3672511640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0cd430 con 0x7f366c1610a0 2023-09-13T06:07:35.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f3672511640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c06f170 con 0x7f366c0ccfa0 2023-09-13T06:07:35.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f3672511640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0c4150 con 0x7f366c146cf0 2023-09-13T06:07:35.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f366b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f366c1610a0 0x7f366c0cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f366b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f366c1610a0 0x7f366c0cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51612/0 (socket says 172.21.15.130:51612) 2023-09-13T06:07:35.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f366b7fe640 1 -- 172.21.15.130:0/2810772083 learned_addr learned my addr 172.21.15.130:0/2810772083 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:35.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f366bfff640 1 --2- 172.21.15.130:0/2810772083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f366c146cf0 0x7f366c0c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f3670aae640 1 --2- 172.21.15.130:0/2810772083 >> v2:172.21.15.164:3300/0 conn(0x7f366c0ccfa0 0x7f366c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f366b7fe640 1 -- 172.21.15.130:0/2810772083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f366c146cf0 msgr2=0x7f366c0c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:35.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f366b7fe640 1 --2- 172.21.15.130:0/2810772083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f366c146cf0 0x7f366c0c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f366b7fe640 1 -- 172.21.15.130:0/2810772083 >> v2:172.21.15.164:3300/0 conn(0x7f366c0ccfa0 msgr2=0x7f366c06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:35.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f366b7fe640 1 --2- 172.21.15.130:0/2810772083 >> v2:172.21.15.164:3300/0 conn(0x7f366c0ccfa0 0x7f366c06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.228+0000 7f366b7fe640 1 -- 172.21.15.130:0/2810772083 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0c4430 con 0x7f366c1610a0 2023-09-13T06:07:35.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f366b7fe640 1 --2- 172.21.15.130:0/2810772083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f366c1610a0 0x7f366c0cca60 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f366c0cdc50 tx=0x7f366001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcc39553261c2ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:35.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f366affd640 1 -- 172.21.15.130:0/2810772083 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36600a89b0 con 0x7f366c1610a0 2023-09-13T06:07:35.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f366affd640 1 -- 172.21.15.130:0/2810772083 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36600a8b10 con 0x7f366c1610a0 2023-09-13T06:07:35.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f366affd640 1 -- 172.21.15.130:0/2810772083 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36600a8ea0 con 0x7f366c1610a0 2023-09-13T06:07:35.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f3672511640 1 -- 172.21.15.130:0/2810772083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f366c1610a0 msgr2=0x7f366c0cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:35.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f3672511640 1 --2- 172.21.15.130:0/2810772083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f366c1610a0 0x7f366c0cca60 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f366c0cdc50 tx=0x7f366001ecf0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f3672511640 1 -- 172.21.15.130:0/2810772083 shutdown_connections 2023-09-13T06:07:35.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f3672511640 1 --2- 172.21.15.130:0/2810772083 >> v2:172.21.15.164:3300/0 conn(0x7f366c0ccfa0 0x7f366c06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f3672511640 1 --2- 172.21.15.130:0/2810772083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f366c1610a0 0x7f366c0cca60 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f3672511640 1 --2- 172.21.15.130:0/2810772083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f366c146cf0 0x7f366c0c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.236 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f3672511640 1 -- 172.21.15.130:0/2810772083 >> 172.21.15.130:0/2810772083 conn(0x7f366c06a2f0 msgr2=0x7f366c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:35.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f3672511640 1 -- 172.21.15.130:0/2810772083 shutdown_connections 2023-09-13T06:07:35.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f3672511640 1 -- 172.21.15.130:0/2810772083 wait complete. 2023-09-13T06:07:35.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.232+0000 7f3672511640 1 Processor -- start 2023-09-13T06:07:35.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3672511640 1 -- start start 2023-09-13T06:07:35.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3672511640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f366c0ccfa0 0x7f366c1f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3672511640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f366c146cf0 0x7f366c15cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3672511640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f366c1610a0 0x7f366c0cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3672511640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c15d140 con 0x7f366c1610a0 2023-09-13T06:07:35.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3672511640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0cc110 con 0x7f366c0ccfa0 2023-09-13T06:07:35.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3672511640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0ca5f0 con 0x7f366c146cf0 2023-09-13T06:07:35.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3670aae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f366c1610a0 0x7f366c0cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3670aae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f366c1610a0 0x7f366c0cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51620/0 (socket says 172.21.15.130:51620) 2023-09-13T06:07:35.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3670aae640 1 -- 172.21.15.130:0/2416356581 learned_addr learned my addr 172.21.15.130:0/2416356581 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:35.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f366bfff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f366c0ccfa0 0x7f366c1f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f366b7fe640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f366c146cf0 0x7f366c15cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3670aae640 1 -- 172.21.15.130:0/2416356581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f366c146cf0 msgr2=0x7f366c15cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:35.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3670aae640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f366c146cf0 0x7f366c15cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3670aae640 1 -- 172.21.15.130:0/2416356581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f366c0ccfa0 msgr2=0x7f366c1f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:35.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3670aae640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f366c0ccfa0 0x7f366c1f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3670aae640 1 -- 172.21.15.130:0/2416356581 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36600094d0 con 0x7f366c1610a0 2023-09-13T06:07:35.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3670aae640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f366c1610a0 0x7f366c0cbbd0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f366400eed0 tx=0x7f366400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:35.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3668ff9640 1 -- 172.21.15.130:0/2416356581 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664010040 con 0x7f366c1610a0 2023-09-13T06:07:35.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3668ff9640 1 -- 172.21.15.130:0/2416356581 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3664014400 con 0x7f366c1610a0 2023-09-13T06:07:35.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3668ff9640 1 -- 172.21.15.130:0/2416356581 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664009ea0 con 0x7f366c1610a0 2023-09-13T06:07:35.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3672511640 1 -- 172.21.15.130:0/2416356581 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c1f69a0 con 0x7f366c1610a0 2023-09-13T06:07:35.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3672511640 1 -- 172.21.15.130:0/2416356581 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c1f6f60 con 0x7f366c1610a0 2023-09-13T06:07:35.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.236+0000 7f3672511640 1 -- 172.21.15.130:0/2416356581 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c0ca760 con 0x7f366c1610a0 2023-09-13T06:07:35.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.240+0000 7f3668ff9640 1 -- 172.21.15.130:0/2416356581 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f36640147b0 con 0x7f366c1610a0 2023-09-13T06:07:35.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.240+0000 7f3668ff9640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3658065b20 0x7f3658067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.240+0000 7f3668ff9640 1 -- 172.21.15.130:0/2416356581 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3664083660 con 0x7f366c1610a0 2023-09-13T06:07:35.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.240+0000 7f366bfff640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3658065b20 0x7f3658067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.245 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.240+0000 7f366bfff640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3658065b20 0x7f3658067fe0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f366c141100 tx=0x7f365c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:35.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.244+0000 7f3668ff9640 1 -- 172.21.15.130:0/2416356581 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f36640512c0 con 0x7f366c1610a0 2023-09-13T06:07:35.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 -- 172.21.15.130:0/2416356581 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f366c1f7150 con 0x7f366c1610a0 2023-09-13T06:07:35.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3668ff9640 1 -- 172.21.15.130:0/2416356581 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f3664018e90 con 0x7f366c1610a0 2023-09-13T06:07:35.430 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:35.430 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":61,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2121062896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2121062896},{"type":"v1","addr":"172.21.15.164:6834","nonce":2121062896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/3004233572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":3004233572},{"type":"v1","addr":"172.21.15.164:6835","nonce":3004233572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7311,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3730755977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3730755977},{"type":"v1","addr":"172.21.15.130:6835","nonce":3730755977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7674,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/2415672065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":2415672065},{"type":"v1","addr":"172.21.15.130:6837","nonce":2415672065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[]} 2023-09-13T06:07:35.431 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 61 2023-09-13T06:07:35.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 -- 172.21.15.130:0/2416356581 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3658065b20 msgr2=0x7f3658067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:35.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3658065b20 0x7f3658067fe0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f366c141100 tx=0x7f365c009190 comp rx=0 tx=0).stop 2023-09-13T06:07:35.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 -- 172.21.15.130:0/2416356581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f366c1610a0 msgr2=0x7f366c0cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:35.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f366c1610a0 0x7f366c0cbbd0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f366400eed0 tx=0x7f366400b480 comp rx=0 tx=0).stop 2023-09-13T06:07:35.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 -- 172.21.15.130:0/2416356581 shutdown_connections 2023-09-13T06:07:35.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3658065b20 0x7f3658067fe0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f366c1610a0 0x7f366c0cbbd0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f366c146cf0 0x7f366c15cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 --2- 172.21.15.130:0/2416356581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f366c0ccfa0 0x7f366c1f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 -- 172.21.15.130:0/2416356581 >> 172.21.15.130:0/2416356581 conn(0x7f366c06a2f0 msgr2=0x7f366c0ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:35.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 -- 172.21.15.130:0/2416356581 shutdown_connections 2023-09-13T06:07:35.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.428+0000 7f3672511640 1 -- 172.21.15.130:0/2416356581 wait complete. 2023-09-13T06:07:35.451 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T06:07:35.451 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-13T06:07:35.451 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T06:07:35.452 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:07:35.452 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T06:07:35.452 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-13T06:07:35.452 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T06:07:35.453 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:07:35.453 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T06:07:35.453 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-13T06:07:35.454 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T06:07:35.454 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:07:35.454 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T06:07:35.454 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-13T06:07:35.455 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T06:07:35.455 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:07:35.465 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T06:07:35.466 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T06:07:35.467 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T06:07:35.467 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T06:07:35.469 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T06:07:35.469 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T06:07:35.470 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T06:07:35.470 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T06:07:35.513 INFO:tasks.ceph.mds.b:Started 2023-09-13T06:07:35.513 DEBUG:teuthology.parallel:result is None 2023-09-13T06:07:35.515 INFO:tasks.ceph.mds.a:Started 2023-09-13T06:07:35.515 DEBUG:teuthology.parallel:result is None 2023-09-13T06:07:35.516 INFO:tasks.ceph.mds.d:Started 2023-09-13T06:07:35.516 DEBUG:teuthology.parallel:result is None 2023-09-13T06:07:35.517 INFO:tasks.ceph.mds.c:Started 2023-09-13T06:07:35.517 DEBUG:teuthology.parallel:result is None 2023-09-13T06:07:35.518 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-13T06:07:35.604 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:07:35.605 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:07:35.605 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:07:35.606 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:07:35.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.660+0000 7f4dac4cb640 1 Processor -- start 2023-09-13T06:07:35.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.660+0000 7f4dac4cb640 1 -- start start 2023-09-13T06:07:35.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4dac4cb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4da4157920 0x7f4da40ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4dac4cb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4da40b0f40 0x7f4da40b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4dac4cb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da40afee0 con 0x7f4da415e560 2023-09-13T06:07:35.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4dac4cb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da40aea50 con 0x7f4da4157920 2023-09-13T06:07:35.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4dac4cb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da40b0b20 con 0x7f4da40b0f40 2023-09-13T06:07:35.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4daa267640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4da4157920 0x7f4da40ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4daa267640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4da4157920 0x7f4da40ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51664/0 (socket says 172.21.15.130:51664) 2023-09-13T06:07:35.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4daa267640 1 -- 172.21.15.130:0/30277366 learned_addr learned my addr 172.21.15.130:0/30277366 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:35.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4da9a66640 1 --2- 172.21.15.130:0/30277366 >> v2:172.21.15.164:3300/0 conn(0x7f4da40b0f40 0x7f4da40b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4daa267640 1 -- 172.21.15.130:0/30277366 >> v2:172.21.15.164:3300/0 conn(0x7f4da40b0f40 msgr2=0x7f4da40b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:35.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4daa267640 1 --2- 172.21.15.130:0/30277366 >> v2:172.21.15.164:3300/0 conn(0x7f4da40b0f40 0x7f4da40b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4daa267640 1 -- 172.21.15.130:0/30277366 >> v1:172.21.15.130:6789/0 conn(0x7f4da415e560 legacy=0x7f4da40ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:35.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4daa267640 1 -- 172.21.15.130:0/30277366 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da40b0180 con 0x7f4da4157920 2023-09-13T06:07:35.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4da9265640 1 -- 172.21.15.130:0/30277366 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786476368 0 0) 0x7f4da40afee0 con 0x7f4da415e560 2023-09-13T06:07:35.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.664+0000 7f4da9a66640 1 --2- 172.21.15.130:0/30277366 >> v2:172.21.15.164:3300/0 conn(0x7f4da40b0f40 0x7f4da40b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:35.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4daa267640 1 --2- 172.21.15.130:0/30277366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4da4157920 0x7f4da40ae190 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f4da406e070 tx=0x7f4da001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3750e527e2a6719a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:35.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4da9265640 1 -- 172.21.15.130:0/30277366 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da00a5770 con 0x7f4da4157920 2023-09-13T06:07:35.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4da9265640 1 -- 172.21.15.130:0/30277366 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da00a58d0 con 0x7f4da4157920 2023-09-13T06:07:35.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4da9265640 1 -- 172.21.15.130:0/30277366 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da00a5c60 con 0x7f4da4157920 2023-09-13T06:07:35.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4dac4cb640 1 -- 172.21.15.130:0/30277366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4da4157920 msgr2=0x7f4da40ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:35.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4dac4cb640 1 --2- 172.21.15.130:0/30277366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4da4157920 0x7f4da40ae190 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f4da406e070 tx=0x7f4da001c9a0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4dac4cb640 1 -- 172.21.15.130:0/30277366 shutdown_connections 2023-09-13T06:07:35.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4dac4cb640 1 --2- 172.21.15.130:0/30277366 >> v2:172.21.15.164:3300/0 conn(0x7f4da40b0f40 0x7f4da40b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4dac4cb640 1 --2- 172.21.15.130:0/30277366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4da4157920 0x7f4da40ae190 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4dac4cb640 1 -- 172.21.15.130:0/30277366 >> 172.21.15.130:0/30277366 conn(0x7f4da4065990 msgr2=0x7f4da4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:35.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4dac4cb640 1 -- 172.21.15.130:0/30277366 shutdown_connections 2023-09-13T06:07:35.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4dac4cb640 1 -- 172.21.15.130:0/30277366 wait complete. 2023-09-13T06:07:35.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4dac4cb640 1 Processor -- start 2023-09-13T06:07:35.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.668+0000 7f4dac4cb640 1 -- start start 2023-09-13T06:07:35.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4dac4cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4da40b0f40 0x7f4da40709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4dac4cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4da4157920 0x7f4da415fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4dac4cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4da415e560 0x7f4da4160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4dac4cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4159800 con 0x7f4da4157920 2023-09-13T06:07:35.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4dac4cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da41562f0 con 0x7f4da40b0f40 2023-09-13T06:07:35.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4dac4cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4157240 con 0x7f4da415e560 2023-09-13T06:07:35.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4da9a66640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4da4157920 0x7f4da415fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4da9a66640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4da4157920 0x7f4da415fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51670/0 (socket says 172.21.15.130:51670) 2023-09-13T06:07:35.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4da9a66640 1 -- 172.21.15.130:0/720682046 learned_addr learned my addr 172.21.15.130:0/720682046 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:35.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4daa267640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4da40b0f40 0x7f4da40709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4daaa68640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4da415e560 0x7f4da4160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4da9a66640 1 -- 172.21.15.130:0/720682046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4da415e560 msgr2=0x7f4da4160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:35.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4da9a66640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4da415e560 0x7f4da4160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4da9a66640 1 -- 172.21.15.130:0/720682046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4da40b0f40 msgr2=0x7f4da40709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:35.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4da9a66640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4da40b0f40 0x7f4da40709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:35.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4da9a66640 1 -- 172.21.15.130:0/720682046 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da0009b30 con 0x7f4da4157920 2023-09-13T06:07:35.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4da9a66640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4da4157920 0x7f4da415fb40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400d800 tx=0x7f4d9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:35.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4d9affd640 1 -- 172.21.15.130:0/720682046 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940096c0 con 0x7f4da4157920 2023-09-13T06:07:35.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4d9affd640 1 -- 172.21.15.130:0/720682046 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d94009820 con 0x7f4da4157920 2023-09-13T06:07:35.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4d9affd640 1 -- 172.21.15.130:0/720682046 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94009bd0 con 0x7f4da4157920 2023-09-13T06:07:35.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4dac4cb640 1 -- 172.21.15.130:0/720682046 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da4155a50 con 0x7f4da4157920 2023-09-13T06:07:35.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4dac4cb640 1 -- 172.21.15.130:0/720682046 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da4156010 con 0x7f4da4157920 2023-09-13T06:07:35.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4dac4cb640 1 -- 172.21.15.130:0/720682046 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da40618a0 con 0x7f4da4157920 2023-09-13T06:07:35.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.672+0000 7f4d9affd640 1 -- 172.21.15.130:0/720682046 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4d94009d30 con 0x7f4da4157920 2023-09-13T06:07:35.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.676+0000 7f4d9affd640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4d88065b20 0x7f4d88067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:35.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.676+0000 7f4d9affd640 1 -- 172.21.15.130:0/720682046 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4d94083660 con 0x7f4da4157920 2023-09-13T06:07:35.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.676+0000 7f4daa267640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4d88065b20 0x7f4d88067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:35.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.676+0000 7f4daa267640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4d88065b20 0x7f4d88067fe0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4da00ae000 tx=0x7f4da00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:35.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.680+0000 7f4d9affd640 1 -- 172.21.15.130:0/720682046 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4d94051340 con 0x7f4da4157920 2023-09-13T06:07:35.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:35.836+0000 7f4dac4cb640 1 -- 172.21.15.130:0/720682046 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4da4070f30 con 0x7f4da4157920 2023-09-13T06:07:36.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.500+0000 7f4d9affd640 1 -- 172.21.15.130:0/720682046 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v131) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4d94054960 con 0x7f4da4157920 2023-09-13T06:07:36.504 INFO:teuthology.orchestra.run.smithi130.stderr: removed all blocklist entries 2023-09-13T06:07:36.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 -- 172.21.15.130:0/720682046 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4d88065b20 msgr2=0x7f4d88067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:36.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4d88065b20 0x7f4d88067fe0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4da00ae000 tx=0x7f4da00a7070 comp rx=0 tx=0).stop 2023-09-13T06:07:36.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 -- 172.21.15.130:0/720682046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4da4157920 msgr2=0x7f4da415fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:36.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4da4157920 0x7f4da415fb40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400d800 tx=0x7f4d9400dcc0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 -- 172.21.15.130:0/720682046 shutdown_connections 2023-09-13T06:07:36.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4d88065b20 0x7f4d88067fe0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4da415e560 0x7f4da4160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4da4157920 0x7f4da415fb40 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 --2- 172.21.15.130:0/720682046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4da40b0f40 0x7f4da40709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 -- 172.21.15.130:0/720682046 >> 172.21.15.130:0/720682046 conn(0x7f4da4065990 msgr2=0x7f4da40ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 -- 172.21.15.130:0/720682046 shutdown_connections 2023-09-13T06:07:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.504+0000 7f4dac4cb640 1 -- 172.21.15.130:0/720682046 wait complete. 2023-09-13T06:07:36.529 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-13T06:07:36.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.668+0000 7ffa0ddc6640 1 Processor -- start 2023-09-13T06:07:36.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.668+0000 7ffa0ddc6640 1 -- start start 2023-09-13T06:07:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa0ddc6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffa0815b130 0x7ffa080cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa0ddc6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ffa080ce180 0x7ffa0815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa0ddc6640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa080ce980 con 0x7ffa080b04a0 2023-09-13T06:07:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa0ddc6640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa080cec60 con 0x7ffa0815b130 2023-09-13T06:07:36.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa0ddc6640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0806c640 con 0x7ffa080ce180 2023-09-13T06:07:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa077fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffa0815b130 0x7ffa080cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa077fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffa0815b130 0x7ffa080cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51678/0 (socket says 172.21.15.130:51678) 2023-09-13T06:07:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa077fe640 1 -- 172.21.15.130:0/4269532726 learned_addr learned my addr 172.21.15.130:0/4269532726 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa06ffd640 1 --2- 172.21.15.130:0/4269532726 >> v2:172.21.15.164:3300/0 conn(0x7ffa080ce180 0x7ffa0815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa077fe640 1 -- 172.21.15.130:0/4269532726 >> v2:172.21.15.164:3300/0 conn(0x7ffa080ce180 msgr2=0x7ffa0815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:36.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa077fe640 1 --2- 172.21.15.130:0/4269532726 >> v2:172.21.15.164:3300/0 conn(0x7ffa080ce180 0x7ffa0815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa077fe640 1 -- 172.21.15.130:0/4269532726 >> v1:172.21.15.130:6789/0 conn(0x7ffa080b04a0 legacy=0x7ffa0806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.672+0000 7ffa077fe640 1 -- 172.21.15.130:0/4269532726 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0806c920 con 0x7ffa0815b130 2023-09-13T06:07:36.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa077fe640 1 --2- 172.21.15.130:0/4269532726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa0815b130 0x7ffa080cc780 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ffa0806bc40 tx=0x7ff9f801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e60ce8cd1bb0f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:36.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa067fc640 1 -- 172.21.15.130:0/4269532726 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80a7070 con 0x7ffa0815b130 2023-09-13T06:07:36.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa067fc640 1 -- 172.21.15.130:0/4269532726 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f80ab430 con 0x7ffa0815b130 2023-09-13T06:07:36.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa067fc640 1 -- 172.21.15.130:0/4269532726 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80ab7c0 con 0x7ffa0815b130 2023-09-13T06:07:36.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/4269532726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa0815b130 msgr2=0x7ffa080cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:36.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa0ddc6640 1 --2- 172.21.15.130:0/4269532726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa0815b130 0x7ffa080cc780 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ffa0806bc40 tx=0x7ff9f801c500 comp rx=0 tx=0).stop 2023-09-13T06:07:36.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/4269532726 shutdown_connections 2023-09-13T06:07:36.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa0ddc6640 1 --2- 172.21.15.130:0/4269532726 >> v2:172.21.15.164:3300/0 conn(0x7ffa080ce180 0x7ffa0815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa0ddc6640 1 --2- 172.21.15.130:0/4269532726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa0815b130 0x7ffa080cc780 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/4269532726 >> 172.21.15.130:0/4269532726 conn(0x7ffa08065990 msgr2=0x7ffa08065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:36.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/4269532726 shutdown_connections 2023-09-13T06:07:36.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/4269532726 wait complete. 2023-09-13T06:07:36.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa0ddc6640 1 Processor -- start 2023-09-13T06:07:36.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.676+0000 7ffa0ddc6640 1 -- start start 2023-09-13T06:07:36.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa0ddc6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa080b04a0 0x7ffa081473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:36.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa0ddc6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa080ce180 0x7ffa08155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:36.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa0ddc6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa0815b130 0x7ffa080ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:36.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa0ddc6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa081578c0 con 0x7ffa080b04a0 2023-09-13T06:07:36.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa0ddc6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa08158070 con 0x7ffa0815b130 2023-09-13T06:07:36.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa0ddc6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa08157af0 con 0x7ffa080ce180 2023-09-13T06:07:36.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa077fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa080b04a0 0x7ffa081473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:36.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa077fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa080b04a0 0x7ffa081473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51690/0 (socket says 172.21.15.130:51690) 2023-09-13T06:07:36.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa077fe640 1 -- 172.21.15.130:0/1685028529 learned_addr learned my addr 172.21.15.130:0/1685028529 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:36.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa06ffd640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa080ce180 0x7ffa08155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:36.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa07fff640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa0815b130 0x7ffa080ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:36.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa077fe640 1 -- 172.21.15.130:0/1685028529 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa080ce180 msgr2=0x7ffa08155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:36.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa077fe640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa080ce180 0x7ffa08155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa077fe640 1 -- 172.21.15.130:0/1685028529 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa0815b130 msgr2=0x7ffa080ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:36.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa077fe640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa0815b130 0x7ffa080ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa077fe640 1 -- 172.21.15.130:0/1685028529 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80094d0 con 0x7ffa080b04a0 2023-09-13T06:07:36.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa07fff640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa0815b130 0x7ffa080ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:36.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa077fe640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa080b04a0 0x7ffa081473d0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80ad040 tx=0x7ff9f801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:36.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ff9effff640 1 -- 172.21.15.130:0/1685028529 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80b4800 con 0x7ffa080b04a0 2023-09-13T06:07:36.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ff9effff640 1 -- 172.21.15.130:0/1685028529 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f80abe90 con 0x7ffa080b04a0 2023-09-13T06:07:36.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ff9effff640 1 -- 172.21.15.130:0/1685028529 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80b4bc0 con 0x7ffa080b04a0 2023-09-13T06:07:36.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/1685028529 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa080b0e40 con 0x7ffa080b04a0 2023-09-13T06:07:36.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/1685028529 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0815bec0 con 0x7ffa080b04a0 2023-09-13T06:07:36.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/1685028529 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0815bd20 con 0x7ffa080b04a0 2023-09-13T06:07:36.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.680+0000 7ff9effff640 1 -- 172.21.15.130:0/1685028529 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff9f80b4d20 con 0x7ffa080b04a0 2023-09-13T06:07:36.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.684+0000 7ff9effff640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff9f4065b20 0x7ff9f4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:36.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.684+0000 7ff9effff640 1 -- 172.21.15.130:0/1685028529 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff9f811ca10 con 0x7ffa080b04a0 2023-09-13T06:07:36.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.684+0000 7ffa06ffd640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff9f4065b20 0x7ff9f4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:36.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.684+0000 7ffa06ffd640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff9f4065b20 0x7ff9f4067fe0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa081f90d0 tx=0x7ff9fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:36.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.688+0000 7ff9effff640 1 -- 172.21.15.130:0/1685028529 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ffa0815bd20 con 0x7ffa080b04a0 2023-09-13T06:07:36.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.884+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/1685028529 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ffa0815bd20 con 0x7ffa080b04a0 2023-09-13T06:07:36.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.884+0000 7ff9effff640 1 -- 172.21.15.130:0/1685028529 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ffa0815bd20 con 0x7ffa080b04a0 2023-09-13T06:07:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:36.888 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:07:36.888 INFO:teuthology.orchestra.run.smithi130.stdout: "auth_dump": [ 2023-09-13T06:07:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.a", 2023-09-13T06:07:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw==", 2023-09-13T06:07:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.889 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:07:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:07:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.b", 2023-09-13T06:07:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg==", 2023-09-13T06:07:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.891 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:07:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:07:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.c", 2023-09-13T06:07:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A==", 2023-09-13T06:07:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:36.893 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:07:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:07:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.d", 2023-09-13T06:07:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg==", 2023-09-13T06:07:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:07:36.895 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:07:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.896 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.0", 2023-09-13T06:07:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw==", 2023-09-13T06:07:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:36.897 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.1", 2023-09-13T06:07:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ==", 2023-09-13T06:07:36.898 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.2", 2023-09-13T06:07:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw==", 2023-09-13T06:07:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:36.900 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.901 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.3", 2023-09-13T06:07:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g==", 2023-09-13T06:07:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:36.902 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.4", 2023-09-13T06:07:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ==", 2023-09-13T06:07:36.903 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.5", 2023-09-13T06:07:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw==", 2023-09-13T06:07:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.6", 2023-09-13T06:07:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA==", 2023-09-13T06:07:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:36.907 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.908 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.7", 2023-09-13T06:07:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA==", 2023-09-13T06:07:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:07:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:07:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.909 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.0", 2023-09-13T06:07:36.910 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA==", 2023-09-13T06:07:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow r", 2023-09-13T06:07:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-13T06:07:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.911 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.1", 2023-09-13T06:07:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg==", 2023-09-13T06:07:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.912 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:07:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:07:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:07:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.2", 2023-09-13T06:07:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw==", 2023-09-13T06:07:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:36.914 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:07:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:07:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:07:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.915 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.3", 2023-09-13T06:07:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA==", 2023-09-13T06:07:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:07:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:07:36.916 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:07:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:07:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.admin", 2023-09-13T06:07:36.917 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQANUAFl5ccJOBAAP4KJItnG8vNd5OP/63ai0g==", 2023-09-13T06:07:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:07:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:07:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:07:36.918 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.x", 2023-09-13T06:07:36.919 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ==", 2023-09-13T06:07:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:07:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:07:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.y", 2023-09-13T06:07:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA==", 2023-09-13T06:07:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:07:36.921 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:07:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:07:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:07:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:36.922 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:07:36.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/1685028529 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff9f4065b20 msgr2=0x7ff9f4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:36.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff9f4065b20 0x7ff9f4067fe0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa081f90d0 tx=0x7ff9fc008040 comp rx=0 tx=0).stop 2023-09-13T06:07:36.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/1685028529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa080b04a0 msgr2=0x7ffa081473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:36.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa080b04a0 0x7ffa081473d0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80ad040 tx=0x7ff9f801ad40 comp rx=0 tx=0).stop 2023-09-13T06:07:36.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/1685028529 shutdown_connections 2023-09-13T06:07:36.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff9f4065b20 0x7ff9f4067fe0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa0815b130 0x7ffa080ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa080ce180 0x7ffa08155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 --2- 172.21.15.130:0/1685028529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa080b04a0 0x7ffa081473d0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:36.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/1685028529 >> 172.21.15.130:0/1685028529 conn(0x7ffa08065990 msgr2=0x7ffa0806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:36.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/1685028529 shutdown_connections 2023-09-13T06:07:36.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:36.888+0000 7ffa0ddc6640 1 -- 172.21.15.130:0/1685028529 wait complete. 2023-09-13T06:07:36.927 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:37.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff9a8967640 1 Processor -- start 2023-09-13T06:07:37.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff9a8967640 1 -- start start 2023-09-13T06:07:37.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff9a8967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a40d1750 0x7ff9a415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff9a8967640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9a40d1090 0x7ff9a4146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff9a8967640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a40b63c0 con 0x7ff9a40d1b30 2023-09-13T06:07:37.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff9a8967640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a415dea0 con 0x7ff9a40d1090 2023-09-13T06:07:37.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff9a8967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40d0c20 con 0x7ff9a40d1750 2023-09-13T06:07:37.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff999d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9a40d1090 0x7ff9a4146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff999d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9a40d1090 0x7ff9a4146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51696/0 (socket says 172.21.15.130:51696) 2023-09-13T06:07:37.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff999d9b640 1 -- 172.21.15.130:0/3452289750 learned_addr learned my addr 172.21.15.130:0/3452289750 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:37.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff9a259c640 1 --2- 172.21.15.130:0/3452289750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a40d1750 0x7ff9a415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff999d9b640 1 -- 172.21.15.130:0/3452289750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a40d1750 msgr2=0x7ff9a415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff999d9b640 1 --2- 172.21.15.130:0/3452289750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a40d1750 0x7ff9a415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff999d9b640 1 -- 172.21.15.130:0/3452289750 >> v1:172.21.15.164:6789/0 conn(0x7ff9a40d1b30 legacy=0x7ff9a40b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.064+0000 7ff999d9b640 1 -- 172.21.15.130:0/3452289750 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40b6610 con 0x7ff9a40d1090 2023-09-13T06:07:37.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff999d9b640 1 --2- 172.21.15.130:0/3452289750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a40d1090 0x7ff9a4146820 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009870 tx=0x7ff98c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af054e6eceae39ce server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff9a1d9b640 1 -- 172.21.15.130:0/3452289750 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0aa670 con 0x7ff9a40d1090 2023-09-13T06:07:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff9a1d9b640 1 -- 172.21.15.130:0/3452289750 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c0aa7d0 con 0x7ff9a40d1090 2023-09-13T06:07:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff9a1d9b640 1 -- 172.21.15.130:0/3452289750 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0aab60 con 0x7ff9a40d1090 2023-09-13T06:07:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff9a8967640 1 -- 172.21.15.130:0/3452289750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a40d1090 msgr2=0x7ff9a4146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff9a8967640 1 --2- 172.21.15.130:0/3452289750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a40d1090 0x7ff9a4146820 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009870 tx=0x7ff98c01c510 comp rx=0 tx=0).stop 2023-09-13T06:07:37.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff9a8967640 1 -- 172.21.15.130:0/3452289750 shutdown_connections 2023-09-13T06:07:37.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff9a8967640 1 --2- 172.21.15.130:0/3452289750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a40d1090 0x7ff9a4146820 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff9a8967640 1 --2- 172.21.15.130:0/3452289750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a40d1750 0x7ff9a415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff9a8967640 1 -- 172.21.15.130:0/3452289750 >> 172.21.15.130:0/3452289750 conn(0x7ff9a406f170 msgr2=0x7ff9a406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:37.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff9a8967640 1 -- 172.21.15.130:0/3452289750 shutdown_connections 2023-09-13T06:07:37.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.068+0000 7ff9a8967640 1 -- 172.21.15.130:0/3452289750 wait complete. 2023-09-13T06:07:37.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a8967640 1 Processor -- start 2023-09-13T06:07:37.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a8967640 1 -- start start 2023-09-13T06:07:37.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a8967640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a40d1090 0x7ff9a415e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a8967640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a40d1750 0x7ff9a4140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a8967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a40d1b30 0x7ff9a40c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a8967640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a412f3e0 con 0x7ff9a40d1750 2023-09-13T06:07:37.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a8967640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a412f630 con 0x7ff9a40d1090 2023-09-13T06:07:37.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a8967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a412f910 con 0x7ff9a40d1b30 2023-09-13T06:07:37.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff999d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a40d1750 0x7ff9a4140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff999d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a40d1750 0x7ff9a4140a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51704/0 (socket says 172.21.15.130:51704) 2023-09-13T06:07:37.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff999d9b640 1 -- 172.21.15.130:0/1552156893 learned_addr learned my addr 172.21.15.130:0/1552156893 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:37.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a259c640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a40d1090 0x7ff9a415e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a2d9d640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a40d1b30 0x7ff9a40c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff999d9b640 1 -- 172.21.15.130:0/1552156893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a40d1b30 msgr2=0x7ff9a40c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff999d9b640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a40d1b30 0x7ff9a40c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff999d9b640 1 -- 172.21.15.130:0/1552156893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a40d1090 msgr2=0x7ff9a415e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff999d9b640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a40d1090 0x7ff9a415e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff999d9b640 1 -- 172.21.15.130:0/1552156893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c0094d0 con 0x7ff9a40d1750 2023-09-13T06:07:37.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff999d9b640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a40d1750 0x7ff9a4140a30 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7ff98c01a140 tx=0x7ff98c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:37.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff99b7fe640 1 -- 172.21.15.130:0/1552156893 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0aa670 con 0x7ff9a40d1750 2023-09-13T06:07:37.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff99b7fe640 1 -- 172.21.15.130:0/1552156893 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c0b3800 con 0x7ff9a40d1750 2023-09-13T06:07:37.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff99b7fe640 1 -- 172.21.15.130:0/1552156893 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0b3bb0 con 0x7ff9a40d1750 2023-09-13T06:07:37.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a8967640 1 -- 172.21.15.130:0/1552156893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a412fbf0 con 0x7ff9a40d1750 2023-09-13T06:07:37.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.072+0000 7ff9a8967640 1 -- 172.21.15.130:0/1552156893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a41417f0 con 0x7ff9a40d1750 2023-09-13T06:07:37.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.076+0000 7ff9a8967640 1 -- 172.21.15.130:0/1552156893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a40618a0 con 0x7ff9a40d1750 2023-09-13T06:07:37.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.076+0000 7ff99b7fe640 1 -- 172.21.15.130:0/1552156893 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff98c0b3d10 con 0x7ff9a40d1750 2023-09-13T06:07:37.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.076+0000 7ff99b7fe640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff984065b20 0x7ff984067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.076+0000 7ff99b7fe640 1 -- 172.21.15.130:0/1552156893 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff98c11d830 con 0x7ff9a40d1750 2023-09-13T06:07:37.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.076+0000 7ff9a259c640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff984065b20 0x7ff984067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.076+0000 7ff9a259c640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff984065b20 0x7ff984067fe0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff994009b60 tx=0x7ff994009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:37.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.080+0000 7ff99b7fe640 1 -- 172.21.15.130:0/1552156893 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff98c0eb570 con 0x7ff9a40d1750 2023-09-13T06:07:37.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.232+0000 7ff9a8967640 1 -- 172.21.15.130:0/1552156893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9a40cefb0 con 0x7ff9a40d1750 2023-09-13T06:07:37.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.232+0000 7ff99b7fe640 1 -- 172.21.15.130:0/1552156893 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+12904 (secure 0 0 0) 0x7ff98c0eeb90 con 0x7ff9a40d1750 2023-09-13T06:07:37.235 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:37.235 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":133,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:36.511696+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:37.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 -- 172.21.15.130:0/1552156893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff984065b20 msgr2=0x7ff984067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff984065b20 0x7ff984067fe0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff994009b60 tx=0x7ff994009190 comp rx=0 tx=0).stop 2023-09-13T06:07:37.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 -- 172.21.15.130:0/1552156893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a40d1750 msgr2=0x7ff9a4140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a40d1750 0x7ff9a4140a30 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7ff98c01a140 tx=0x7ff98c01ad50 comp rx=0 tx=0).stop 2023-09-13T06:07:37.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 -- 172.21.15.130:0/1552156893 shutdown_connections 2023-09-13T06:07:37.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff984065b20 0x7ff984067fe0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9a40d1b30 0x7ff9a40c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9a40d1750 0x7ff9a4140a30 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 --2- 172.21.15.130:0/1552156893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9a40d1090 0x7ff9a415e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 -- 172.21.15.130:0/1552156893 >> 172.21.15.130:0/1552156893 conn(0x7ff9a406f170 msgr2=0x7ff9a415f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:37.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 -- 172.21.15.130:0/1552156893 shutdown_connections 2023-09-13T06:07:37.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.236+0000 7ff9a8967640 1 -- 172.21.15.130:0/1552156893 wait complete. 2023-09-13T06:07:37.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:07:37.257 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:07:37.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.396+0000 7fbd93711640 1 Processor -- start 2023-09-13T06:07:37.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.396+0000 7fbd93711640 1 -- start start 2023-09-13T06:07:37.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.396+0000 7fbd93711640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd8c160fe0 0x7fbd8c06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.396+0000 7fbd93711640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c161e60 con 0x7fbd8c157750 2023-09-13T06:07:37.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.396+0000 7fbd93711640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c1615c0 con 0x7fbd8c157b30 2023-09-13T06:07:37.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.396+0000 7fbd93711640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0ae0d0 con 0x7fbd8c160fe0 2023-09-13T06:07:37.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.396+0000 7fbd914ad640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fbd8c157750 0x7fbd8c06f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33970/0 (socket says 172.21.15.130:33970) 2023-09-13T06:07:37.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.396+0000 7fbd914ad640 1 -- 172.21.15.130:0/3206555154 learned_addr learned my addr 172.21.15.130:0/3206555154 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:37.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd91cae640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd8c160fe0 0x7fbd8c06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725756139 0 0) 0x7fbd8c161e60 con 0x7fbd8c157750 2023-09-13T06:07:37.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd78003530 con 0x7fbd8c157750 2023-09-13T06:07:37.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922316049 0 0) 0x7fbd8c1615c0 con 0x7fbd8c157b30 2023-09-13T06:07:37.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd8c161e60 con 0x7fbd8c157b30 2023-09-13T06:07:37.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3551901130 0 0) 0x7fbd78003530 con 0x7fbd8c157750 2023-09-13T06:07:37.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd8c160fe0 msgr2=0x7fbd8c06dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:37.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd8c160fe0 0x7fbd8c06dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 >> v1:172.21.15.164:6789/0 conn(0x7fbd8c157b30 legacy=0x7fbd8c15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c1618a0 con 0x7fbd8c157750 2023-09-13T06:07:37.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fbd88001680 con 0x7fbd8c157750 2023-09-13T06:07:37.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 >> v1:172.21.15.130:6789/0 conn(0x7fbd8c157750 legacy=0x7fbd8c06f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd78003bb0 0x7fbd78003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd8c160fe0 0x7fbd780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd78004d10 0x7fbd78005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0ae0d0 con 0x7fbd78004d10 2023-09-13T06:07:37.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7800ba70 con 0x7fbd78003bb0 2023-09-13T06:07:37.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7800bc30 con 0x7fbd8c160fe0 2023-09-13T06:07:37.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd914ad640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd78003bb0 0x7fbd78003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd91cae640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd78004d10 0x7fbd78005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd90cac640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd8c160fe0 0x7fbd780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd91cae640 1 -- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd8c160fe0 msgr2=0x7fbd780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:37.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd91cae640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd8c160fe0 0x7fbd780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd91cae640 1 -- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd78003bb0 msgr2=0x7fbd78003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:37.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd91cae640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd78003bb0 0x7fbd78003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd91cae640 1 -- 172.21.15.130:0/3206555154 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd78003530 con 0x7fbd78004d10 2023-09-13T06:07:37.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.400+0000 7fbd914ad640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd78003bb0 0x7fbd78003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:37.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd91cae640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd78004d10 0x7fbd78005190 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009f90 tx=0x7fbd8401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7b2dfaae25390c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:37.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd840a5a10 con 0x7fbd78004d10 2023-09-13T06:07:37.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8400f040 con 0x7fbd78004d10 2023-09-13T06:07:37.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd83fff640 1 -- 172.21.15.130:0/3206555154 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd840a5db0 con 0x7fbd78004d10 2023-09-13T06:07:37.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd93711640 1 -- 172.21.15.130:0/3206555154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd78004d10 msgr2=0x7fbd78005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd93711640 1 --2- 172.21.15.130:0/3206555154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd78004d10 0x7fbd78005190 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009f90 tx=0x7fbd8401cc20 comp rx=0 tx=0).stop 2023-09-13T06:07:37.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd91cae640 1 -- 172.21.15.130:0/3206555154 reap_dead start 2023-09-13T06:07:37.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd93711640 1 -- 172.21.15.130:0/3206555154 shutdown_connections 2023-09-13T06:07:37.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd93711640 1 -- 172.21.15.130:0/3206555154 >> 172.21.15.130:0/3206555154 conn(0x7fbd8c065d60 msgr2=0x7fbd8c0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:37.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd93711640 1 -- 172.21.15.130:0/3206555154 shutdown_connections 2023-09-13T06:07:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd93711640 1 -- 172.21.15.130:0/3206555154 wait complete. 2023-09-13T06:07:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd93711640 1 Processor -- start 2023-09-13T06:07:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd93711640 1 -- start start 2023-09-13T06:07:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.404+0000 7fbd93711640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd78004d10 0x7fbd8c146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd93711640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd8c0ce630 0x7fbd8c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd93711640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd8c15d560 0x7fbd8c15a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd93711640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c15b8c0 con 0x7fbd8c0ce630 2023-09-13T06:07:37.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd93711640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c146ac0 con 0x7fbd8c15d560 2023-09-13T06:07:37.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd93711640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0cd590 con 0x7fbd78004d10 2023-09-13T06:07:37.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd90cac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd8c0ce630 0x7fbd8c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd90cac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd8c0ce630 0x7fbd8c15d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51732/0 (socket says 172.21.15.130:51732) 2023-09-13T06:07:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd90cac640 1 -- 172.21.15.130:0/4214771337 learned_addr learned my addr 172.21.15.130:0/4214771337 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd914ad640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd78004d10 0x7fbd8c146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd91cae640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd8c15d560 0x7fbd8c15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd90cac640 1 -- 172.21.15.130:0/4214771337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd78004d10 msgr2=0x7fbd8c146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd90cac640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd78004d10 0x7fbd8c146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd90cac640 1 -- 172.21.15.130:0/4214771337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd8c15d560 msgr2=0x7fbd8c15a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd90cac640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd8c15d560 0x7fbd8c15a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd90cac640 1 -- 172.21.15.130:0/4214771337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c0cd870 con 0x7fbd8c0ce630 2023-09-13T06:07:37.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd90cac640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd8c0ce630 0x7fbd8c15d020 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00f730 tx=0x7fbd7c00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:37.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd81ffb640 1 -- 172.21.15.130:0/4214771337 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c0050d0 con 0x7fbd8c0ce630 2023-09-13T06:07:37.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd81ffb640 1 -- 172.21.15.130:0/4214771337 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7c005250 con 0x7fbd8c0ce630 2023-09-13T06:07:37.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd93711640 1 -- 172.21.15.130:0/4214771337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c0cdb50 con 0x7fbd8c0ce630 2023-09-13T06:07:37.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd81ffb640 1 -- 172.21.15.130:0/4214771337 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c00d730 con 0x7fbd8c0ce630 2023-09-13T06:07:37.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd93711640 1 -- 172.21.15.130:0/4214771337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c0ce110 con 0x7fbd8c0ce630 2023-09-13T06:07:37.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd93711640 1 -- 172.21.15.130:0/4214771337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c0618a0 con 0x7fbd8c0ce630 2023-09-13T06:07:37.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd81ffb640 1 -- 172.21.15.130:0/4214771337 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbd7c00d890 con 0x7fbd8c0ce630 2023-09-13T06:07:37.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.408+0000 7fbd81ffb640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbd70065b20 0x7fbd70067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.412+0000 7fbd81ffb640 1 -- 172.21.15.130:0/4214771337 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbd7c082f50 con 0x7fbd8c0ce630 2023-09-13T06:07:37.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.412+0000 7fbd914ad640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbd70065b20 0x7fbd70067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.412+0000 7fbd914ad640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbd70065b20 0x7fbd70067fe0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbd88001c50 tx=0x7fbd88001e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:37.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.416+0000 7fbd81ffb640 1 -- 172.21.15.130:0/4214771337 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbd7c050b50 con 0x7fbd8c0ce630 2023-09-13T06:07:37.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.568+0000 7fbd93711640 1 -- 172.21.15.130:0/4214771337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd8c0d06a0 con 0x7fbd8c0ce630 2023-09-13T06:07:37.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.568+0000 7fbd81ffb640 1 -- 172.21.15.130:0/4214771337 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd7c054170 con 0x7fbd8c0ce630 2023-09-13T06:07:37.572 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:07:37.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 -- 172.21.15.130:0/4214771337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbd70065b20 msgr2=0x7fbd70067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbd70065b20 0x7fbd70067fe0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbd88001c50 tx=0x7fbd88001e30 comp rx=0 tx=0).stop 2023-09-13T06:07:37.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 -- 172.21.15.130:0/4214771337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd8c0ce630 msgr2=0x7fbd8c15d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd8c0ce630 0x7fbd8c15d020 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00f730 tx=0x7fbd7c00fb30 comp rx=0 tx=0).stop 2023-09-13T06:07:37.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 -- 172.21.15.130:0/4214771337 shutdown_connections 2023-09-13T06:07:37.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbd70065b20 0x7fbd70067fe0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd8c15d560 0x7fbd8c15a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd8c0ce630 0x7fbd8c15d020 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 --2- 172.21.15.130:0/4214771337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd78004d10 0x7fbd8c146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 -- 172.21.15.130:0/4214771337 >> 172.21.15.130:0/4214771337 conn(0x7fbd8c065d60 msgr2=0x7fbd8c154c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:37.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 -- 172.21.15.130:0/4214771337 shutdown_connections 2023-09-13T06:07:37.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.572+0000 7fbd93711640 1 -- 172.21.15.130:0/4214771337 wait complete. 2023-09-13T06:07:37.593 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T06:07:37.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.728+0000 7f7f79ccb640 1 Processor -- start 2023-09-13T06:07:37.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.728+0000 7f7f79ccb640 1 -- start start 2023-09-13T06:07:37.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.728+0000 7f7f79ccb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7f740d1090 0x7f7f7415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.728+0000 7f7f79ccb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f740b63c0 con 0x7f7f74146f30 2023-09-13T06:07:37.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.728+0000 7f7f79ccb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f740d0c20 con 0x7f7f740d1750 2023-09-13T06:07:37.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.728+0000 7f7f79ccb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7415dea0 con 0x7f7f740d1090 2023-09-13T06:07:37.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.728+0000 7f7f73fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f7f74146f30 0x7f7f740b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33982/0 (socket says 172.21.15.130:33982) 2023-09-13T06:07:37.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.728+0000 7f7f73fff640 1 -- 172.21.15.130:0/2944019801 learned_addr learned my addr 172.21.15.130:0/2944019801 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:37.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.728+0000 7f7f6bfff640 1 --2- 172.21.15.130:0/2944019801 >> v2:172.21.15.164:3300/0 conn(0x7f7f740d1090 0x7f7f7415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.728+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821321288 0 0) 0x7f7f740b63c0 con 0x7f7f74146f30 2023-09-13T06:07:37.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.728+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f60003530 con 0x7f7f74146f30 2023-09-13T06:07:37.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525178804 0 0) 0x7f7f740d0c20 con 0x7f7f740d1750 2023-09-13T06:07:37.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f740b63c0 con 0x7f7f740d1750 2023-09-13T06:07:37.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1041759455 0 0) 0x7f7f60003530 con 0x7f7f74146f30 2023-09-13T06:07:37.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 >> v2:172.21.15.164:3300/0 conn(0x7f7f740d1090 msgr2=0x7f7f7415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:37.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 --2- 172.21.15.130:0/2944019801 >> v2:172.21.15.164:3300/0 conn(0x7f7f740d1090 0x7f7f7415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 >> v1:172.21.15.164:6789/0 conn(0x7f7f740d1750 legacy=0x7f7f74146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f740b6610 con 0x7f7f74146f30 2023-09-13T06:07:37.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f7f6c001a00 con 0x7f7f74146f30 2023-09-13T06:07:37.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f6bfff640 1 --2- 172.21.15.130:0/2944019801 >> v2:172.21.15.164:3300/0 conn(0x7f7f740d1090 0x7f7f7415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:37.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 >> v1:172.21.15.130:6789/0 conn(0x7f7f74146f30 legacy=0x7f7f740b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 --2- 172.21.15.130:0/2944019801 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f60003b80 0x7f7f60003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 --2- 172.21.15.130:0/2944019801 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f600047d0 0x7f7f60004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 --2- 172.21.15.130:0/2944019801 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f600051e0 0x7f7f6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6000c100 con 0x7f7f60003b80 2023-09-13T06:07:37.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6000c270 con 0x7f7f600051e0 2023-09-13T06:07:37.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6000c430 con 0x7f7f600047d0 2023-09-13T06:07:37.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f737fe640 1 --2- 172.21.15.130:0/2944019801 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f60003b80 0x7f7f60003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f6bfff640 1 --2- 172.21.15.130:0/2944019801 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f600047d0 0x7f7f60004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f73fff640 1 --2- 172.21.15.130:0/2944019801 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f600051e0 0x7f7f6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f737fe640 1 -- 172.21.15.130:0/2944019801 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f600047d0 msgr2=0x7f7f60004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:37.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f737fe640 1 --2- 172.21.15.130:0/2944019801 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f600047d0 0x7f7f60004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f737fe640 1 -- 172.21.15.130:0/2944019801 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f600051e0 msgr2=0x7f7f6000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:37.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f737fe640 1 --2- 172.21.15.130:0/2944019801 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f600051e0 0x7f7f6000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f737fe640 1 -- 172.21.15.130:0/2944019801 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f60003530 con 0x7f7f60003b80 2023-09-13T06:07:37.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f73fff640 1 -- 172.21.15.130:0/2944019801 reap_dead start 2023-09-13T06:07:37.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.732+0000 7f7f737fe640 1 --2- 172.21.15.130:0/2944019801 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f60003b80 0x7f7f60003f80 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f7f64007fd0 tx=0x7f7f6401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785f40bb89cc47 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:37.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640052d0 con 0x7f7f60003b80 2023-09-13T06:07:37.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64005450 con 0x7f7f60003b80 2023-09-13T06:07:37.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f72ffd640 1 -- 172.21.15.130:0/2944019801 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64003840 con 0x7f7f60003b80 2023-09-13T06:07:37.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2944019801 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f60003b80 msgr2=0x7f7f60003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 --2- 172.21.15.130:0/2944019801 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f60003b80 0x7f7f60003f80 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f7f64007fd0 tx=0x7f7f6401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2944019801 shutdown_connections 2023-09-13T06:07:37.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 --2- 172.21.15.130:0/2944019801 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f60003b80 0x7f7f60003f80 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2944019801 >> 172.21.15.130:0/2944019801 conn(0x7f7f7406f170 msgr2=0x7f7f7406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:37.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2944019801 shutdown_connections 2023-09-13T06:07:37.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2944019801 wait complete. 2023-09-13T06:07:37.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 Processor -- start 2023-09-13T06:07:37.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 -- start start 2023-09-13T06:07:37.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f60003b80 0x7f7f7415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7413da00 0x7f7f7413e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f7413f060 0x7f7f7413f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74070c80 con 0x7f7f7413da00 2023-09-13T06:07:37.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7413fa20 con 0x7f7f7413f060 2023-09-13T06:07:37.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f79ccb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7415d170 con 0x7f7f60003b80 2023-09-13T06:07:37.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.736+0000 7f7f6bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7413da00 0x7f7f7413e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f6bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7413da00 0x7f7f7413e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51756/0 (socket says 172.21.15.130:51756) 2023-09-13T06:07:37.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f6bfff640 1 -- 172.21.15.130:0/2038139746 learned_addr learned my addr 172.21.15.130:0/2038139746 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:37.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f737fe640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f60003b80 0x7f7f7415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f73fff640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f7413f060 0x7f7f7413f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f6bfff640 1 -- 172.21.15.130:0/2038139746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f60003b80 msgr2=0x7f7f7415cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f6bfff640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f60003b80 0x7f7f7415cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f6bfff640 1 -- 172.21.15.130:0/2038139746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f7413f060 msgr2=0x7f7f7413f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f6bfff640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f7413f060 0x7f7f7413f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f6bfff640 1 -- 172.21.15.130:0/2038139746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f74070000 con 0x7f7f7413da00 2023-09-13T06:07:37.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f6bfff640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7413da00 0x7f7f7413e7d0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c011a20 tx=0x7f7f5c011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:37.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f70ff9640 1 -- 172.21.15.130:0/2038139746 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00fc10 con 0x7f7f7413da00 2023-09-13T06:07:37.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f70ff9640 1 -- 172.21.15.130:0/2038139746 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c00fd70 con 0x7f7f7413da00 2023-09-13T06:07:37.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f70ff9640 1 -- 172.21.15.130:0/2038139746 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00fee0 con 0x7f7f7413da00 2023-09-13T06:07:37.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2038139746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f740702e0 con 0x7f7f7413da00 2023-09-13T06:07:37.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2038139746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f740708a0 con 0x7f7f7413da00 2023-09-13T06:07:37.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2038139746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f74070ef0 con 0x7f7f7413da00 2023-09-13T06:07:37.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.740+0000 7f7f70ff9640 1 -- 172.21.15.130:0/2038139746 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7f5c014660 con 0x7f7f7413da00 2023-09-13T06:07:37.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.744+0000 7f7f70ff9640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7f54065b50 0x7f7f54068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:37.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.744+0000 7f7f70ff9640 1 -- 172.21.15.130:0/2038139746 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7f5c083770 con 0x7f7f7413da00 2023-09-13T06:07:37.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.744+0000 7f7f737fe640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7f54065b50 0x7f7f54068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:37.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.744+0000 7f7f737fe640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7f54065b50 0x7f7f54068010 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7f640ad000 tx=0x7f7f640a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:37.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.748+0000 7f7f70ff9640 1 -- 172.21.15.130:0/2038139746 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7f74070ef0 con 0x7f7f7413da00 2023-09-13T06:07:37.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.896+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2038139746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7f74070ef0 con 0x7f7f7413da00 2023-09-13T06:07:37.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.896+0000 7f7f70ff9640 1 -- 172.21.15.130:0/2038139746 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v133) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7f74070ef0 con 0x7f7f7413da00 2023-09-13T06:07:37.900 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:37.900 INFO:teuthology.orchestra.run.smithi130.stdout:[ 2023-09-13T06:07:37.900 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:37.901 INFO:teuthology.orchestra.run.smithi130.stdout: "poolnum": 1, 2023-09-13T06:07:37.901 INFO:teuthology.orchestra.run.smithi130.stdout: "poolname": ".mgr" 2023-09-13T06:07:37.901 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:37.901 INFO:teuthology.orchestra.run.smithi130.stdout:] 2023-09-13T06:07:37.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2038139746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7f54065b50 msgr2=0x7f7f54068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7f54065b50 0x7f7f54068010 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7f640ad000 tx=0x7f7f640a7000 comp rx=0 tx=0).stop 2023-09-13T06:07:37.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2038139746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7413da00 msgr2=0x7f7f7413e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:37.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7413da00 0x7f7f7413e7d0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c011a20 tx=0x7f7f5c011ee0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2038139746 shutdown_connections 2023-09-13T06:07:37.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7f54065b50 0x7f7f54068010 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f7413f060 0x7f7f7413f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7413da00 0x7f7f7413e7d0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 --2- 172.21.15.130:0/2038139746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7f60003b80 0x7f7f7415cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:37.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2038139746 >> 172.21.15.130:0/2038139746 conn(0x7f7f7406f170 msgr2=0x7f7f7415dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:37.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2038139746 shutdown_connections 2023-09-13T06:07:37.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:37.900+0000 7f7f79ccb640 1 -- 172.21.15.130:0/2038139746 wait complete. 2023-09-13T06:07:37.921 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T06:07:37.921 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T06:07:38.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.060+0000 7f8e33a0b640 1 Processor -- start 2023-09-13T06:07:38.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.060+0000 7f8e33a0b640 1 -- start start 2023-09-13T06:07:38.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e33a0b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8e2c144a40 0x7f8e2c0aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:38.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e33a0b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8e2c06d0a0 0x7f8e2c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:38.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e33a0b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c06d510 con 0x7f8e2c0b0460 2023-09-13T06:07:38.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e33a0b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c0b08f0 con 0x7f8e2c144a40 2023-09-13T06:07:38.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e33a0b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c144e20 con 0x7f8e2c06d0a0 2023-09-13T06:07:38.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e317a7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8e2c144a40 0x7f8e2c0aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:38.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e30fa6640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f8e2c0b0460 0x7f8e2c06c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33996/0 (socket says 172.21.15.130:33996) 2023-09-13T06:07:38.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e30fa6640 1 -- 172.21.15.130:0/868059161 learned_addr learned my addr 172.21.15.130:0/868059161 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:38.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e317a7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8e2c144a40 0x7f8e2c0aff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51768/0 (socket says 172.21.15.130:51768) 2023-09-13T06:07:38.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e31fa8640 1 --2- 172.21.15.130:0/868059161 >> v2:172.21.15.164:3300/0 conn(0x7f8e2c06d0a0 0x7f8e2c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:38.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e317a7640 1 -- 172.21.15.130:0/868059161 >> v2:172.21.15.164:3300/0 conn(0x7f8e2c06d0a0 msgr2=0x7f8e2c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:38.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e317a7640 1 --2- 172.21.15.130:0/868059161 >> v2:172.21.15.164:3300/0 conn(0x7f8e2c06d0a0 0x7f8e2c15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e317a7640 1 -- 172.21.15.130:0/868059161 >> v1:172.21.15.130:6789/0 conn(0x7f8e2c0b0460 legacy=0x7f8e2c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:38.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e317a7640 1 -- 172.21.15.130:0/868059161 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c06d7c0 con 0x7f8e2c144a40 2023-09-13T06:07:38.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.064+0000 7f8e31fa8640 1 --2- 172.21.15.130:0/868059161 >> v2:172.21.15.164:3300/0 conn(0x7f8e2c06d0a0 0x7f8e2c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:38.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e317a7640 1 --2- 172.21.15.130:0/868059161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e2c144a40 0x7f8e2c0aff20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c06b280 tx=0x7f8e2801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa86661591193ed2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:38.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e23fff640 1 -- 172.21.15.130:0/868059161 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e280a7070 con 0x7f8e2c144a40 2023-09-13T06:07:38.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e23fff640 1 -- 172.21.15.130:0/868059161 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e280ab430 con 0x7f8e2c144a40 2023-09-13T06:07:38.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e23fff640 1 -- 172.21.15.130:0/868059161 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e280ab7c0 con 0x7f8e2c144a40 2023-09-13T06:07:38.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e33a0b640 1 -- 172.21.15.130:0/868059161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e2c144a40 msgr2=0x7f8e2c0aff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:38.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e33a0b640 1 --2- 172.21.15.130:0/868059161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e2c144a40 0x7f8e2c0aff20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c06b280 tx=0x7f8e2801c430 comp rx=0 tx=0).stop 2023-09-13T06:07:38.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e33a0b640 1 -- 172.21.15.130:0/868059161 shutdown_connections 2023-09-13T06:07:38.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e33a0b640 1 --2- 172.21.15.130:0/868059161 >> v2:172.21.15.164:3300/0 conn(0x7f8e2c06d0a0 0x7f8e2c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e33a0b640 1 --2- 172.21.15.130:0/868059161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e2c144a40 0x7f8e2c0aff20 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e33a0b640 1 -- 172.21.15.130:0/868059161 >> 172.21.15.130:0/868059161 conn(0x7f8e2c0735e0 msgr2=0x7f8e2c065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:38.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e33a0b640 1 -- 172.21.15.130:0/868059161 shutdown_connections 2023-09-13T06:07:38.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e33a0b640 1 -- 172.21.15.130:0/868059161 wait complete. 2023-09-13T06:07:38.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e33a0b640 1 Processor -- start 2023-09-13T06:07:38.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.068+0000 7f8e33a0b640 1 -- start start 2023-09-13T06:07:38.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e33a0b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e2c06d0a0 0x7f8e2c163630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:38.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e33a0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e2c0b0460 0x7f8e2c13fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:38.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e33a0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e2c144a40 0x7f8e2c140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:38.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e33a0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c162210 con 0x7f8e2c144a40 2023-09-13T06:07:38.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e33a0b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c161f30 con 0x7f8e2c06d0a0 2023-09-13T06:07:38.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e33a0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c15ee10 con 0x7f8e2c0b0460 2023-09-13T06:07:38.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e31fa8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e2c144a40 0x7f8e2c140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:38.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e31fa8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e2c144a40 0x7f8e2c140860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51782/0 (socket says 172.21.15.130:51782) 2023-09-13T06:07:38.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e31fa8640 1 -- 172.21.15.130:0/1021562278 learned_addr learned my addr 172.21.15.130:0/1021562278 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:38.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e317a7640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e2c06d0a0 0x7f8e2c163630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:38.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e30fa6640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e2c0b0460 0x7f8e2c13fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:38.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e31fa8640 1 -- 172.21.15.130:0/1021562278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e2c0b0460 msgr2=0x7f8e2c13fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:38.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e31fa8640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e2c0b0460 0x7f8e2c13fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e31fa8640 1 -- 172.21.15.130:0/1021562278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e2c06d0a0 msgr2=0x7f8e2c163630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:38.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e31fa8640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e2c06d0a0 0x7f8e2c163630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e31fa8640 1 -- 172.21.15.130:0/1021562278 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e28009420 con 0x7f8e2c144a40 2023-09-13T06:07:38.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e31fa8640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e2c144a40 0x7f8e2c140860 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f8e24007ef0 tx=0x7f8e2400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:38.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e21ffb640 1 -- 172.21.15.130:0/1021562278 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24003ba0 con 0x7f8e2c144a40 2023-09-13T06:07:38.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e21ffb640 1 -- 172.21.15.130:0/1021562278 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2400f040 con 0x7f8e2c144a40 2023-09-13T06:07:38.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e21ffb640 1 -- 172.21.15.130:0/1021562278 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2400de80 con 0x7f8e2c144a40 2023-09-13T06:07:38.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e33a0b640 1 -- 172.21.15.130:0/1021562278 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c15f0f0 con 0x7f8e2c144a40 2023-09-13T06:07:38.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e33a0b640 1 -- 172.21.15.130:0/1021562278 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c163b70 con 0x7f8e2c144a40 2023-09-13T06:07:38.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e33a0b640 1 -- 172.21.15.130:0/1021562278 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c0618a0 con 0x7f8e2c144a40 2023-09-13T06:07:38.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.072+0000 7f8e21ffb640 1 -- 172.21.15.130:0/1021562278 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8e24004030 con 0x7f8e2c144a40 2023-09-13T06:07:38.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.076+0000 7f8e21ffb640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e10065b50 0x7f8e10068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:38.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.076+0000 7f8e21ffb640 1 -- 172.21.15.130:0/1021562278 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8e24083210 con 0x7f8e2c144a40 2023-09-13T06:07:38.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.076+0000 7f8e317a7640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e10065b50 0x7f8e10068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:38.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.076+0000 7f8e317a7640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e10065b50 0x7f8e10068010 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8e280af000 tx=0x7f8e280a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:38.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.080+0000 7f8e21ffb640 1 -- 172.21.15.130:0/1021562278 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8e24050ec0 con 0x7f8e2c144a40 2023-09-13T06:07:38.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.228+0000 7f8e33a0b640 1 -- 172.21.15.130:0/1021562278 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8e2c0cec10 con 0x7f8e2c144a40 2023-09-13T06:07:38.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.520+0000 7f8e21ffb640 1 -- 172.21.15.130:0/1021562278 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v134) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8e240544e0 con 0x7f8e2c144a40 2023-09-13T06:07:38.670 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' created 2023-09-13T06:07:38.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 -- 172.21.15.130:0/1021562278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e10065b50 msgr2=0x7f8e10068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:38.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e10065b50 0x7f8e10068010 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8e280af000 tx=0x7f8e280a7000 comp rx=0 tx=0).stop 2023-09-13T06:07:38.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 -- 172.21.15.130:0/1021562278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e2c144a40 msgr2=0x7f8e2c140860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:38.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e2c144a40 0x7f8e2c140860 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f8e24007ef0 tx=0x7f8e2400d4a0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 -- 172.21.15.130:0/1021562278 shutdown_connections 2023-09-13T06:07:38.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8e10065b50 0x7f8e10068010 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e2c144a40 0x7f8e2c140860 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e2c0b0460 0x7f8e2c13fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 --2- 172.21.15.130:0/1021562278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e2c06d0a0 0x7f8e2c163630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 -- 172.21.15.130:0/1021562278 >> 172.21.15.130:0/1021562278 conn(0x7f8e2c0735e0 msgr2=0x7f8e2c143960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:38.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 -- 172.21.15.130:0/1021562278 shutdown_connections 2023-09-13T06:07:38.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.524+0000 7f8e33a0b640 1 -- 172.21.15.130:0/1021562278 wait complete. 2023-09-13T06:07:38.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T06:07:38.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f9721b9f640 1 Processor -- start 2023-09-13T06:07:38.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f9721b9f640 1 -- start start 2023-09-13T06:07:38.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f9721b9f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f971c0b2e90 0x7f971c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:38.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f9721b9f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c0b2150 con 0x7f971c0b1460 2023-09-13T06:07:38.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f9721b9f640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c0cdd90 con 0x7f971c144d70 2023-09-13T06:07:38.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f9721b9f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0b2430 con 0x7f971c0b2e90 2023-09-13T06:07:38.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f971bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f971c0b1460 0x7f971c0b18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:34006/0 (socket says 172.21.15.130:34006) 2023-09-13T06:07:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f971bfff640 1 -- 172.21.15.130:0/1857087978 learned_addr learned my addr 172.21.15.130:0/1857087978 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f9713fff640 1 --2- 172.21.15.130:0/1857087978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f971c0b2e90 0x7f971c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f971affd640 1 -- 172.21.15.130:0/1857087978 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657690175 0 0) 0x7f971c0b2150 con 0x7f971c0b1460 2023-09-13T06:07:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f971affd640 1 -- 172.21.15.130:0/1857087978 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9708003530 con 0x7f971c0b1460 2023-09-13T06:07:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f971affd640 1 -- 172.21.15.130:0/1857087978 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048691518 0 0) 0x7f971c0cdd90 con 0x7f971c144d70 2023-09-13T06:07:38.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f971affd640 1 -- 172.21.15.130:0/1857087978 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f971c0b2150 con 0x7f971c144d70 2023-09-13T06:07:38.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f9713fff640 1 -- 172.21.15.130:0/1857087978 >> v1:172.21.15.164:6789/0 conn(0x7f971c144d70 legacy=0x7f971c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:38.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f9713fff640 1 -- 172.21.15.130:0/1857087978 >> v1:172.21.15.130:6789/0 conn(0x7f971c0b1460 legacy=0x7f971c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:38.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.820+0000 7f9713fff640 1 -- 172.21.15.130:0/1857087978 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0ce070 con 0x7f971c0b2e90 2023-09-13T06:07:38.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.824+0000 7f9713fff640 1 --2- 172.21.15.130:0/1857087978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f971c0b2e90 0x7f971c0ce870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f97040097f0 tx=0x7f970401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26a7f0639c8f1236 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:38.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.824+0000 7f971affd640 1 -- 172.21.15.130:0/1857087978 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040ab600 con 0x7f971c0b2e90 2023-09-13T06:07:38.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.824+0000 7f971affd640 1 -- 172.21.15.130:0/1857087978 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97040a7050 con 0x7f971c0b2e90 2023-09-13T06:07:38.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.824+0000 7f971affd640 1 -- 172.21.15.130:0/1857087978 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040ab980 con 0x7f971c0b2e90 2023-09-13T06:07:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.824+0000 7f9721b9f640 1 -- 172.21.15.130:0/1857087978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f971c0b2e90 msgr2=0x7f971c0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.824+0000 7f9721b9f640 1 --2- 172.21.15.130:0/1857087978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f971c0b2e90 0x7f971c0ce870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f97040097f0 tx=0x7f970401c4c0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.824+0000 7f9721b9f640 1 -- 172.21.15.130:0/1857087978 shutdown_connections 2023-09-13T06:07:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.824+0000 7f9721b9f640 1 --2- 172.21.15.130:0/1857087978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f971c0b2e90 0x7f971c0ce870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.824+0000 7f9721b9f640 1 -- 172.21.15.130:0/1857087978 >> 172.21.15.130:0/1857087978 conn(0x7f971c065990 msgr2=0x7f971c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.824+0000 7f9721b9f640 1 -- 172.21.15.130:0/1857087978 shutdown_connections 2023-09-13T06:07:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.824+0000 7f9721b9f640 1 -- 172.21.15.130:0/1857087978 wait complete. 2023-09-13T06:07:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9721b9f640 1 Processor -- start 2023-09-13T06:07:38.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9721b9f640 1 -- start start 2023-09-13T06:07:38.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9721b9f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f971c0b1460 0x7f971c0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:38.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9721b9f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c0b2e90 0x7f971c14d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:38.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9721b9f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971c144d70 0x7f971c143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:38.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9721b9f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0b0a00 con 0x7f971c0b2e90 2023-09-13T06:07:38.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9721b9f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c1505b0 con 0x7f971c144d70 2023-09-13T06:07:38.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9721b9f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c139860 con 0x7f971c0b1460 2023-09-13T06:07:38.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9713fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c0b2e90 0x7f971c14d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:38.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9713fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c0b2e90 0x7f971c14d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51786/0 (socket says 172.21.15.130:51786) 2023-09-13T06:07:38.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9713fff640 1 -- 172.21.15.130:0/821924183 learned_addr learned my addr 172.21.15.130:0/821924183 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:38.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f971bfff640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971c144d70 0x7f971c143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f971b7fe640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f971c0b1460 0x7f971c0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9713fff640 1 -- 172.21.15.130:0/821924183 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f971c0b1460 msgr2=0x7f971c0b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9713fff640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f971c0b1460 0x7f971c0b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9713fff640 1 -- 172.21.15.130:0/821924183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971c144d70 msgr2=0x7f971c143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:38.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9713fff640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971c144d70 0x7f971c143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9713fff640 1 -- 172.21.15.130:0/821924183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704009420 con 0x7f971c0b2e90 2023-09-13T06:07:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9713fff640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c0b2e90 0x7f971c14d260 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9704009740 tx=0x7f9704019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9718ff9640 1 -- 172.21.15.130:0/821924183 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040b4840 con 0x7f971c0b2e90 2023-09-13T06:07:38.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9718ff9640 1 -- 172.21.15.130:0/821924183 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97040b49a0 con 0x7f971c0b2e90 2023-09-13T06:07:38.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9718ff9640 1 -- 172.21.15.130:0/821924183 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040b4d50 con 0x7f971c0b2e90 2023-09-13T06:07:38.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9721b9f640 1 -- 172.21.15.130:0/821924183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c14fd10 con 0x7f971c0b2e90 2023-09-13T06:07:38.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.828+0000 7f9721b9f640 1 -- 172.21.15.130:0/821924183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c1502d0 con 0x7f971c0b2e90 2023-09-13T06:07:38.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.832+0000 7f9721b9f640 1 -- 172.21.15.130:0/821924183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c139630 con 0x7f971c0b2e90 2023-09-13T06:07:38.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.832+0000 7f9718ff9640 1 -- 172.21.15.130:0/821924183 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f97040abd50 con 0x7f971c0b2e90 2023-09-13T06:07:38.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.832+0000 7f9718ff9640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f96fc065b20 0x7f96fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:38.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.832+0000 7f9718ff9640 1 -- 172.21.15.130:0/821924183 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f970411d3a0 con 0x7f971c0b2e90 2023-09-13T06:07:38.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.832+0000 7f971b7fe640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f96fc065b20 0x7f96fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:38.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.836+0000 7f971b7fe640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f96fc065b20 0x7f96fc067fe0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f970c0011f0 tx=0x7f970c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:38.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.836+0000 7f9718ff9640 1 -- 172.21.15.130:0/821924183 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f971c139630 con 0x7f971c0b2e90 2023-09-13T06:07:38.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:38.984+0000 7f9721b9f640 1 -- 172.21.15.130:0/821924183 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f971c139630 con 0x7f971c0b2e90 2023-09-13T06:07:39.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.532+0000 7f9718ff9640 1 -- 172.21.15.130:0/821924183 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v135) v1 ==== 170+0+0 (secure 0 0 0) 0x7f97040ee940 con 0x7f971c0b2e90 2023-09-13T06:07:39.540 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' created 2023-09-13T06:07:39.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.544+0000 7f9721b9f640 1 -- 172.21.15.130:0/821924183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f96fc065b20 msgr2=0x7f96fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:39.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.544+0000 7f9721b9f640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f96fc065b20 0x7f96fc067fe0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f970c0011f0 tx=0x7f970c009040 comp rx=0 tx=0).stop 2023-09-13T06:07:39.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.544+0000 7f9721b9f640 1 -- 172.21.15.130:0/821924183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c0b2e90 msgr2=0x7f971c14d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:39.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.544+0000 7f9721b9f640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c0b2e90 0x7f971c14d260 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9704009740 tx=0x7f9704019260 comp rx=0 tx=0).stop 2023-09-13T06:07:39.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.544+0000 7f9721b9f640 1 -- 172.21.15.130:0/821924183 shutdown_connections 2023-09-13T06:07:39.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.544+0000 7f9721b9f640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f96fc065b20 0x7f96fc067fe0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:39.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.544+0000 7f9721b9f640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971c144d70 0x7f971c143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:39.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.544+0000 7f9721b9f640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f971c0b2e90 0x7f971c14d260 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:39.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.544+0000 7f9721b9f640 1 --2- 172.21.15.130:0/821924183 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f971c0b1460 0x7f971c0b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:39.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.544+0000 7f9721b9f640 1 -- 172.21.15.130:0/821924183 >> 172.21.15.130:0/821924183 conn(0x7f971c065990 msgr2=0x7f971c159730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:39.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.548+0000 7f9721b9f640 1 -- 172.21.15.130:0/821924183 shutdown_connections 2023-09-13T06:07:39.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.548+0000 7f9721b9f640 1 -- 172.21.15.130:0/821924183 wait complete. 2023-09-13T06:07:39.568 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T06:07:39.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.708+0000 7f5744cd8640 1 Processor -- start 2023-09-13T06:07:39.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.708+0000 7f5744cd8640 1 -- start start 2023-09-13T06:07:39.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.708+0000 7f5744cd8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f57400b2e90 0x7f57400ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:39.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.708+0000 7f5744cd8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f57400b1460 0x7f57400b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:39.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.708+0000 7f5744cd8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57400b2150 con 0x7f5740144d70 2023-09-13T06:07:39.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.708+0000 7f5744cd8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57400b2430 con 0x7f57400b1460 2023-09-13T06:07:39.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.708+0000 7f5744cd8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57400cedb0 con 0x7f57400b2e90 2023-09-13T06:07:39.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.708+0000 7f573ed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f57400b1460 0x7f57400b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:39.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.708+0000 7f573e59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5740144d70 0x7f57400b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:34016/0 (socket says 172.21.15.130:34016) 2023-09-13T06:07:39.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.708+0000 7f573e59c640 1 -- 172.21.15.130:0/3470350610 learned_addr learned my addr 172.21.15.130:0/3470350610 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:39.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.712+0000 7f573dd9b640 1 --2- 172.21.15.130:0/3470350610 >> v2:172.21.15.164:3300/0 conn(0x7f57400b2e90 0x7f57400ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:39.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.712+0000 7f573ed9d640 1 -- 172.21.15.130:0/3470350610 >> v2:172.21.15.164:3300/0 conn(0x7f57400b2e90 msgr2=0x7f57400ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:39.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.712+0000 7f573ed9d640 1 --2- 172.21.15.130:0/3470350610 >> v2:172.21.15.164:3300/0 conn(0x7f57400b2e90 0x7f57400ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:39.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.712+0000 7f573ed9d640 1 -- 172.21.15.130:0/3470350610 >> v1:172.21.15.130:6789/0 conn(0x7f5740144d70 legacy=0x7f57400b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:39.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.712+0000 7f573ed9d640 1 -- 172.21.15.130:0/3470350610 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57400cdd90 con 0x7f57400b1460 2023-09-13T06:07:39.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.712+0000 7f573ed9d640 1 --2- 172.21.15.130:0/3470350610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57400b1460 0x7f57400b18f0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5740145150 tx=0x7f573801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a6788773ce3d94 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:39.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.712+0000 7f573d59a640 1 -- 172.21.15.130:0/3470350610 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57380a58c0 con 0x7f57400b1460 2023-09-13T06:07:39.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.712+0000 7f573d59a640 1 -- 172.21.15.130:0/3470350610 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57380a5a20 con 0x7f57400b1460 2023-09-13T06:07:39.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.712+0000 7f573d59a640 1 -- 172.21.15.130:0/3470350610 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57380a5db0 con 0x7f57400b1460 2023-09-13T06:07:39.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.712+0000 7f5744cd8640 1 -- 172.21.15.130:0/3470350610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57400b1460 msgr2=0x7f57400b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:39.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.712+0000 7f5744cd8640 1 --2- 172.21.15.130:0/3470350610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57400b1460 0x7f57400b18f0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5740145150 tx=0x7f573801c910 comp rx=0 tx=0).stop 2023-09-13T06:07:39.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 -- 172.21.15.130:0/3470350610 shutdown_connections 2023-09-13T06:07:39.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 --2- 172.21.15.130:0/3470350610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57400b1460 0x7f57400b18f0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:39.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 --2- 172.21.15.130:0/3470350610 >> v2:172.21.15.164:3300/0 conn(0x7f57400b2e90 0x7f57400ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:39.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 -- 172.21.15.130:0/3470350610 >> 172.21.15.130:0/3470350610 conn(0x7f5740065990 msgr2=0x7f5740065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:39.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 -- 172.21.15.130:0/3470350610 shutdown_connections 2023-09-13T06:07:39.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 -- 172.21.15.130:0/3470350610 wait complete. 2023-09-13T06:07:39.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 Processor -- start 2023-09-13T06:07:39.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 -- start start 2023-09-13T06:07:39.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57400b1460 0x7f5740139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:39.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57400b2e90 0x7f574013ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:39.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5740144d70 0x7f5740155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:39.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5740141a20 con 0x7f57400b2e90 2023-09-13T06:07:39.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5740140da0 con 0x7f57400b1460 2023-09-13T06:07:39.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f5744cd8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5740141080 con 0x7f5740144d70 2023-09-13T06:07:39.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f573dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57400b2e90 0x7f574013ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:39.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f573dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57400b2e90 0x7f574013ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51816/0 (socket says 172.21.15.130:51816) 2023-09-13T06:07:39.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f573dd9b640 1 -- 172.21.15.130:0/3193569234 learned_addr learned my addr 172.21.15.130:0/3193569234 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:39.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f573ed9d640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5740144d70 0x7f5740155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:39.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f573e59c640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57400b1460 0x7f5740139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:39.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f573dd9b640 1 -- 172.21.15.130:0/3193569234 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5740144d70 msgr2=0x7f5740155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:39.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f573dd9b640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5740144d70 0x7f5740155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:39.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f573dd9b640 1 -- 172.21.15.130:0/3193569234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57400b1460 msgr2=0x7f5740139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:39.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f573dd9b640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57400b1460 0x7f5740139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:39.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f573dd9b640 1 -- 172.21.15.130:0/3193569234 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5738009a70 con 0x7f57400b2e90 2023-09-13T06:07:39.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.716+0000 7f573dd9b640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57400b2e90 0x7f574013ad40 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f573400d800 tx=0x7f573400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:39.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.720+0000 7f572effd640 1 -- 172.21.15.130:0/3193569234 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400b6c0 con 0x7f57400b2e90 2023-09-13T06:07:39.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.720+0000 7f572effd640 1 -- 172.21.15.130:0/3193569234 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573400b820 con 0x7f57400b2e90 2023-09-13T06:07:39.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.720+0000 7f572effd640 1 -- 172.21.15.130:0/3193569234 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400bb90 con 0x7f57400b2e90 2023-09-13T06:07:39.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.720+0000 7f5744cd8640 1 -- 172.21.15.130:0/3193569234 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5740141360 con 0x7f57400b2e90 2023-09-13T06:07:39.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.720+0000 7f5744cd8640 1 -- 172.21.15.130:0/3193569234 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5740156bb0 con 0x7f57400b2e90 2023-09-13T06:07:39.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.720+0000 7f5744cd8640 1 -- 172.21.15.130:0/3193569234 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57400618a0 con 0x7f57400b2e90 2023-09-13T06:07:39.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.720+0000 7f572effd640 1 -- 172.21.15.130:0/3193569234 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f573400bcf0 con 0x7f57400b2e90 2023-09-13T06:07:39.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.720+0000 7f572effd640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5720065b20 0x7f5720067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:39.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.720+0000 7f572effd640 1 -- 172.21.15.130:0/3193569234 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5734084020 con 0x7f57400b2e90 2023-09-13T06:07:39.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.720+0000 7f573e59c640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5720065b20 0x7f5720067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:39.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.724+0000 7f573e59c640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5720065b20 0x7f5720067fe0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5730005890 tx=0x7f5730009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:39.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.724+0000 7f572effd640 1 -- 172.21.15.130:0/3193569234 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5734051bf0 con 0x7f57400b2e90 2023-09-13T06:07:39.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:39.904+0000 7f5744cd8640 1 -- 172.21.15.130:0/3193569234 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f574006d720 con 0x7f57400b2e90 2023-09-13T06:07:40.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.552+0000 7f572effd640 1 -- 172.21.15.130:0/3193569234 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v64) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5734055210 con 0x7f57400b2e90 2023-09-13T06:07:40.555 INFO:teuthology.orchestra.run.smithi130.stderr:new fs with metadata pool 16 and data pool 17 2023-09-13T06:07:40.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 -- 172.21.15.130:0/3193569234 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5720065b20 msgr2=0x7f5720067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:40.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5720065b20 0x7f5720067fe0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5730005890 tx=0x7f5730009040 comp rx=0 tx=0).stop 2023-09-13T06:07:40.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 -- 172.21.15.130:0/3193569234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57400b2e90 msgr2=0x7f574013ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:40.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57400b2e90 0x7f574013ad40 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f573400d800 tx=0x7f573400dcc0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 -- 172.21.15.130:0/3193569234 shutdown_connections 2023-09-13T06:07:40.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5720065b20 0x7f5720067fe0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5740144d70 0x7f5740155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57400b2e90 0x7f574013ad40 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 --2- 172.21.15.130:0/3193569234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57400b1460 0x7f5740139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 -- 172.21.15.130:0/3193569234 >> 172.21.15.130:0/3193569234 conn(0x7f5740065990 msgr2=0x7f574006b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:40.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 -- 172.21.15.130:0/3193569234 shutdown_connections 2023-09-13T06:07:40.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.556+0000 7f5744cd8640 1 -- 172.21.15.130:0/3193569234 wait complete. 2023-09-13T06:07:40.584 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:40.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.720+0000 7f73bbc93640 1 Processor -- start 2023-09-13T06:07:40.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.720+0000 7f73bbc93640 1 -- start start 2023-09-13T06:07:40.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73bbc93640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f73b4159f20 0x7f73b40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:40.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73bbc93640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40b1d20 0x7f73b40b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:40.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73bbc93640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b40ccfd0 con 0x7f73b40cdfc0 2023-09-13T06:07:40.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73bbc93640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b40b00f0 con 0x7f73b4159f20 2023-09-13T06:07:40.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73bbc93640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b40b11d0 con 0x7f73b40b1d20 2023-09-13T06:07:40.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73b9a2f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f73b4159f20 0x7f73b40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:40.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73b9a2f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f73b4159f20 0x7f73b40ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51820/0 (socket says 172.21.15.130:51820) 2023-09-13T06:07:40.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73b9a2f640 1 -- 172.21.15.130:0/1951143297 learned_addr learned my addr 172.21.15.130:0/1951143297 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:40.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73ba230640 1 --2- 172.21.15.130:0/1951143297 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40b1d20 0x7f73b40b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:40.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73b9a2f640 1 -- 172.21.15.130:0/1951143297 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40b1d20 msgr2=0x7f73b40b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:40.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73b9a2f640 1 --2- 172.21.15.130:0/1951143297 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40b1d20 0x7f73b40b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73b9a2f640 1 -- 172.21.15.130:0/1951143297 >> v1:172.21.15.164:6789/0 conn(0x7f73b40cdfc0 legacy=0x7f73b40b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:40.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.724+0000 7f73b9a2f640 1 -- 172.21.15.130:0/1951143297 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b40ced90 con 0x7f73b4159f20 2023-09-13T06:07:40.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73b9a2f640 1 --2- 172.21.15.130:0/1951143297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73b4159f20 0x7f73b40ce7b0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009870 tx=0x7f73b001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b0dece8925c0ab server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:40.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73b8a2d640 1 -- 172.21.15.130:0/1951143297 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b00a9400 con 0x7f73b4159f20 2023-09-13T06:07:40.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73b8a2d640 1 -- 172.21.15.130:0/1951143297 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b00a9560 con 0x7f73b4159f20 2023-09-13T06:07:40.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73b8a2d640 1 -- 172.21.15.130:0/1951143297 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b00a98f0 con 0x7f73b4159f20 2023-09-13T06:07:40.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73bbc93640 1 -- 172.21.15.130:0/1951143297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73b4159f20 msgr2=0x7f73b40ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:40.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73bbc93640 1 --2- 172.21.15.130:0/1951143297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73b4159f20 0x7f73b40ce7b0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009870 tx=0x7f73b001c540 comp rx=0 tx=0).stop 2023-09-13T06:07:40.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73bbc93640 1 -- 172.21.15.130:0/1951143297 shutdown_connections 2023-09-13T06:07:40.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73bbc93640 1 --2- 172.21.15.130:0/1951143297 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40b1d20 0x7f73b40b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73bbc93640 1 --2- 172.21.15.130:0/1951143297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73b4159f20 0x7f73b40ce7b0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73bbc93640 1 -- 172.21.15.130:0/1951143297 >> 172.21.15.130:0/1951143297 conn(0x7f73b4065990 msgr2=0x7f73b4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:40.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73bbc93640 1 -- 172.21.15.130:0/1951143297 shutdown_connections 2023-09-13T06:07:40.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73bbc93640 1 -- 172.21.15.130:0/1951143297 wait complete. 2023-09-13T06:07:40.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73bbc93640 1 Processor -- start 2023-09-13T06:07:40.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.728+0000 7f73bbc93640 1 -- start start 2023-09-13T06:07:40.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73bbc93640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40b1d20 0x7f73b414b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:40.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73bbc93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73b40cdfc0 0x7f73b4152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:40.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73bbc93640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73b4159f20 0x7f73b40701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:40.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73bbc93640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b41f92f0 con 0x7f73b40cdfc0 2023-09-13T06:07:40.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73bbc93640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b41f95d0 con 0x7f73b4159f20 2023-09-13T06:07:40.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73bbc93640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b41f98b0 con 0x7f73b40b1d20 2023-09-13T06:07:40.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73b922e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73b40cdfc0 0x7f73b4152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:40.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73b9a2f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40b1d20 0x7f73b414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:40.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73b922e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73b40cdfc0 0x7f73b4152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51836/0 (socket says 172.21.15.130:51836) 2023-09-13T06:07:40.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73b922e640 1 -- 172.21.15.130:0/2720230130 learned_addr learned my addr 172.21.15.130:0/2720230130 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:40.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73ba230640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73b4159f20 0x7f73b40701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:40.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73b922e640 1 -- 172.21.15.130:0/2720230130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40b1d20 msgr2=0x7f73b414b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:40.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73b922e640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40b1d20 0x7f73b414b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73b922e640 1 -- 172.21.15.130:0/2720230130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73b4159f20 msgr2=0x7f73b40701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:40.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73b922e640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73b4159f20 0x7f73b40701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73b922e640 1 -- 172.21.15.130:0/2720230130 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b00094d0 con 0x7f73b40cdfc0 2023-09-13T06:07:40.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73b922e640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73b40cdfc0 0x7f73b4152cd0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f73a400c500 tx=0x7f73a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:40.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73aa7fc640 1 -- 172.21.15.130:0/2720230130 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a4005220 con 0x7f73b40cdfc0 2023-09-13T06:07:40.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73aa7fc640 1 -- 172.21.15.130:0/2720230130 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a4005380 con 0x7f73b40cdfc0 2023-09-13T06:07:40.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73aa7fc640 1 -- 172.21.15.130:0/2720230130 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a4007270 con 0x7f73b40cdfc0 2023-09-13T06:07:40.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73bbc93640 1 -- 172.21.15.130:0/2720230130 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b40cd870 con 0x7f73b40cdfc0 2023-09-13T06:07:40.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73bbc93640 1 -- 172.21.15.130:0/2720230130 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b4153210 con 0x7f73b40cdfc0 2023-09-13T06:07:40.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73bbc93640 1 -- 172.21.15.130:0/2720230130 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b40618a0 con 0x7f73b40cdfc0 2023-09-13T06:07:40.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.732+0000 7f73aa7fc640 1 -- 172.21.15.130:0/2720230130 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f73a40073d0 con 0x7f73b40cdfc0 2023-09-13T06:07:40.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.736+0000 7f73aa7fc640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7398065b20 0x7f7398067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:40.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.736+0000 7f73aa7fc640 1 -- 172.21.15.130:0/2720230130 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73a4082b10 con 0x7f73b40cdfc0 2023-09-13T06:07:40.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.736+0000 7f73b9a2f640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7398065b20 0x7f7398067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:40.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.736+0000 7f73b9a2f640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7398065b20 0x7f7398067fe0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f73b00ae000 tx=0x7f73b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:40.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.740+0000 7f73aa7fc640 1 -- 172.21.15.130:0/2720230130 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f73a4050480 con 0x7f73b40cdfc0 2023-09-13T06:07:40.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.888+0000 7f73bbc93640 1 -- 172.21.15.130:0/2720230130 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73b41f9430 con 0x7f73b40cdfc0 2023-09-13T06:07:40.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.888+0000 7f73aa7fc640 1 -- 172.21.15.130:0/2720230130 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16577 (secure 0 0 0) 0x7f73b41f9430 con 0x7f73b40cdfc0 2023-09-13T06:07:40.891 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:40.891 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":136,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:39.910686+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:38.276233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:39.032744+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:40.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 -- 172.21.15.130:0/2720230130 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7398065b20 msgr2=0x7f7398067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:40.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7398065b20 0x7f7398067fe0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f73b00ae000 tx=0x7f73b0008040 comp rx=0 tx=0).stop 2023-09-13T06:07:40.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 -- 172.21.15.130:0/2720230130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73b40cdfc0 msgr2=0x7f73b4152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:40.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73b40cdfc0 0x7f73b4152cd0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f73a400c500 tx=0x7f73a400c9c0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 -- 172.21.15.130:0/2720230130 shutdown_connections 2023-09-13T06:07:40.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7398065b20 0x7f7398067fe0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73b4159f20 0x7f73b40701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73b40cdfc0 0x7f73b4152cd0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 --2- 172.21.15.130:0/2720230130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40b1d20 0x7f73b414b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:40.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 -- 172.21.15.130:0/2720230130 >> 172.21.15.130:0/2720230130 conn(0x7f73b4065990 msgr2=0x7f73b40b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:40.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 -- 172.21.15.130:0/2720230130 shutdown_connections 2023-09-13T06:07:40.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:40.892+0000 7f73bbc93640 1 -- 172.21.15.130:0/2720230130 wait complete. 2023-09-13T06:07:40.912 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:41.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafd4b9f640 1 Processor -- start 2023-09-13T06:07:41.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafd4b9f640 1 -- start start 2023-09-13T06:07:41.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafd4b9f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fafd00d1750 0x7fafd015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:41.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafd4b9f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd00b63c0 con 0x7fafd00d1090 2023-09-13T06:07:41.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafd4b9f640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd00d0c20 con 0x7fafd0146f30 2023-09-13T06:07:41.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafd4b9f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd015dea0 con 0x7fafd00d1750 2023-09-13T06:07:41.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafce59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fafd00d1750 0x7fafd015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:41.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafc5d9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fafd00d1090 0x7fafd0146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36146/0 (socket says 172.21.15.130:36146) 2023-09-13T06:07:41.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafc5d9b640 1 -- 172.21.15.130:0/2776147069 learned_addr learned my addr 172.21.15.130:0/2776147069 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:41.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafce59c640 1 -- 172.21.15.130:0/2776147069 >> v1:172.21.15.164:6789/0 conn(0x7fafd0146f30 legacy=0x7fafd00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafce59c640 1 -- 172.21.15.130:0/2776147069 >> v1:172.21.15.130:6789/0 conn(0x7fafd00d1090 legacy=0x7fafd0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafce59c640 1 -- 172.21.15.130:0/2776147069 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00b6610 con 0x7fafd00d1750 2023-09-13T06:07:41.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.048+0000 7fafcdd9b640 1 -- 172.21.15.130:0/2776147069 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472190836 0 0) 0x7fafd00b63c0 con 0x7fafd00d1090 2023-09-13T06:07:41.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.052+0000 7fafce59c640 1 --2- 172.21.15.130:0/2776147069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd00d1750 0x7fafd015d960 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fafc00097c0 tx=0x7fafc001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ea4567cf3e0528 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:41.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.052+0000 7fafcdd9b640 1 -- 172.21.15.130:0/2776147069 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00ac620 con 0x7fafd00d1750 2023-09-13T06:07:41.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.052+0000 7fafcdd9b640 1 -- 172.21.15.130:0/2776147069 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc00ac780 con 0x7fafd00d1750 2023-09-13T06:07:41.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.052+0000 7fafcdd9b640 1 -- 172.21.15.130:0/2776147069 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00acb10 con 0x7fafd00d1750 2023-09-13T06:07:41.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.052+0000 7fafd4b9f640 1 -- 172.21.15.130:0/2776147069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd00d1750 msgr2=0x7fafd015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.052+0000 7fafd4b9f640 1 --2- 172.21.15.130:0/2776147069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd00d1750 0x7fafd015d960 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fafc00097c0 tx=0x7fafc001c3c0 comp rx=0 tx=0).stop 2023-09-13T06:07:41.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.052+0000 7fafd4b9f640 1 -- 172.21.15.130:0/2776147069 shutdown_connections 2023-09-13T06:07:41.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.052+0000 7fafd4b9f640 1 --2- 172.21.15.130:0/2776147069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd00d1750 0x7fafd015d960 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:41.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.052+0000 7fafd4b9f640 1 -- 172.21.15.130:0/2776147069 >> 172.21.15.130:0/2776147069 conn(0x7fafd006f170 msgr2=0x7fafd006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:41.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.052+0000 7fafd4b9f640 1 -- 172.21.15.130:0/2776147069 shutdown_connections 2023-09-13T06:07:41.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.052+0000 7fafd4b9f640 1 -- 172.21.15.130:0/2776147069 wait complete. 2023-09-13T06:07:41.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafd4b9f640 1 Processor -- start 2023-09-13T06:07:41.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafd4b9f640 1 -- start start 2023-09-13T06:07:41.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafd4b9f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafd00d1090 0x7fafd013df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:41.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafd4b9f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd00d1750 0x7fafd015e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:41.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafd4b9f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd0146f30 0x7fafd0143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:41.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafd4b9f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd015d4d0 con 0x7fafd00d1750 2023-09-13T06:07:41.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafd4b9f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd013e4b0 con 0x7fafd0146f30 2023-09-13T06:07:41.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafd4b9f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd015cf10 con 0x7fafd00d1090 2023-09-13T06:07:41.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd00d1750 0x7fafd015e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:41.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd00d1750 0x7fafd015e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44338/0 (socket says 172.21.15.130:44338) 2023-09-13T06:07:41.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc5d9b640 1 -- 172.21.15.130:0/1095476193 learned_addr learned my addr 172.21.15.130:0/1095476193 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:41.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafced9d640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd0146f30 0x7fafd0143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:41.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafce59c640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafd00d1090 0x7fafd013df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:41.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc5d9b640 1 -- 172.21.15.130:0/1095476193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafd00d1090 msgr2=0x7fafd013df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc5d9b640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafd00d1090 0x7fafd013df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:41.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc5d9b640 1 -- 172.21.15.130:0/1095476193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd0146f30 msgr2=0x7fafd0143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc5d9b640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd0146f30 0x7fafd0143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:41.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc5d9b640 1 -- 172.21.15.130:0/1095476193 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0009420 con 0x7fafd00d1750 2023-09-13T06:07:41.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafced9d640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd0146f30 0x7fafd0143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:41.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc5d9b640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd00d1750 0x7fafd015e250 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fafb800c4b0 tx=0x7fafb800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:41.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc77fe640 1 -- 172.21.15.130:0/1095476193 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb80074e0 con 0x7fafd00d1750 2023-09-13T06:07:41.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc77fe640 1 -- 172.21.15.130:0/1095476193 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb8007640 con 0x7fafd00d1750 2023-09-13T06:07:41.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafc77fe640 1 -- 172.21.15.130:0/1095476193 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8004a30 con 0x7fafd00d1750 2023-09-13T06:07:41.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafd4b9f640 1 -- 172.21.15.130:0/1095476193 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd015d1f0 con 0x7fafd00d1750 2023-09-13T06:07:41.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.056+0000 7fafd4b9f640 1 -- 172.21.15.130:0/1095476193 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd0142f20 con 0x7fafd00d1750 2023-09-13T06:07:41.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.060+0000 7fafd4b9f640 1 -- 172.21.15.130:0/1095476193 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd0142aa0 con 0x7fafd00d1750 2023-09-13T06:07:41.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.060+0000 7fafc77fe640 1 -- 172.21.15.130:0/1095476193 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fafb8004b90 con 0x7fafd00d1750 2023-09-13T06:07:41.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.060+0000 7fafc77fe640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fafb0065b20 0x7fafb0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:41.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.060+0000 7fafc77fe640 1 -- 172.21.15.130:0/1095476193 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafb80824e0 con 0x7fafd00d1750 2023-09-13T06:07:41.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.060+0000 7fafce59c640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fafb0065b20 0x7fafb0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:41.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.060+0000 7fafce59c640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fafb0065b20 0x7fafb0067fe0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fafc00ae000 tx=0x7fafc0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:41.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.064+0000 7fafc77fe640 1 -- 172.21.15.130:0/1095476193 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fafd0142aa0 con 0x7fafd00d1750 2023-09-13T06:07:41.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.212+0000 7fafd4b9f640 1 -- 172.21.15.130:0/1095476193 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafd0142aa0 con 0x7fafd00d1750 2023-09-13T06:07:41.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.212+0000 7fafc77fe640 1 -- 172.21.15.130:0/1095476193 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16577 (secure 0 0 0) 0x7fafd0142aa0 con 0x7fafd00d1750 2023-09-13T06:07:41.215 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:41.215 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":136,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:39.910686+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:38.276233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:39.032744+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:41.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 -- 172.21.15.130:0/1095476193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fafb0065b20 msgr2=0x7fafb0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fafb0065b20 0x7fafb0067fe0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fafc00ae000 tx=0x7fafc0008040 comp rx=0 tx=0).stop 2023-09-13T06:07:41.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 -- 172.21.15.130:0/1095476193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd00d1750 msgr2=0x7fafd015e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd00d1750 0x7fafd015e250 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fafb800c4b0 tx=0x7fafb800c970 comp rx=0 tx=0).stop 2023-09-13T06:07:41.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 -- 172.21.15.130:0/1095476193 shutdown_connections 2023-09-13T06:07:41.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fafb0065b20 0x7fafb0067fe0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:41.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd0146f30 0x7fafd0143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:41.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd00d1750 0x7fafd015e250 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:41.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 --2- 172.21.15.130:0/1095476193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafd00d1090 0x7fafd013df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:41.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 -- 172.21.15.130:0/1095476193 >> 172.21.15.130:0/1095476193 conn(0x7fafd006f170 msgr2=0x7fafd00b70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:41.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 -- 172.21.15.130:0/1095476193 shutdown_connections 2023-09-13T06:07:41.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.216+0000 7fafd4b9f640 1 -- 172.21.15.130:0/1095476193 wait complete. 2023-09-13T06:07:41.236 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T06:07:41.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe215a9e640 1 Processor -- start 2023-09-13T06:07:41.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe215a9e640 1 -- start start 2023-09-13T06:07:41.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe215a9e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe210152240 0x7fe21006ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:41.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe215a9e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21006f210 con 0x7fe21015c0b0 2023-09-13T06:07:41.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe215a9e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21006f480 con 0x7fe210070650 2023-09-13T06:07:41.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe215a9e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21006f760 con 0x7fe210152240 2023-09-13T06:07:41.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe20ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe21015c0b0 0x7fe2100ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36152/0 (socket says 172.21.15.130:36152) 2023-09-13T06:07:41.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe20ffff640 1 -- 172.21.15.130:0/1902846301 learned_addr learned my addr 172.21.15.130:0/1902846301 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:41.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe20f7fe640 1 --2- 172.21.15.130:0/1902846301 >> v2:172.21.15.164:3300/0 conn(0x7fe210152240 0x7fe21006ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:41.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe20e7fc640 1 -- 172.21.15.130:0/1902846301 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283422420 0 0) 0x7fe21006f210 con 0x7fe21015c0b0 2023-09-13T06:07:41.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe20e7fc640 1 -- 172.21.15.130:0/1902846301 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1f8003530 con 0x7fe21015c0b0 2023-09-13T06:07:41.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe20f7fe640 1 -- 172.21.15.130:0/1902846301 >> v1:172.21.15.164:6789/0 conn(0x7fe210070650 legacy=0x7fe21015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe20f7fe640 1 -- 172.21.15.130:0/1902846301 >> v1:172.21.15.130:6789/0 conn(0x7fe21015c0b0 legacy=0x7fe2100ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.376+0000 7fe20f7fe640 1 -- 172.21.15.130:0/1902846301 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21006fa40 con 0x7fe210152240 2023-09-13T06:07:41.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.380+0000 7fe20f7fe640 1 --2- 172.21.15.130:0/1902846301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe210152240 0x7fe21006ff60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe2000097c0 tx=0x7fe20001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13fa7ce27450571e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:41.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.380+0000 7fe20e7fc640 1 -- 172.21.15.130:0/1902846301 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2000a8050 con 0x7fe210152240 2023-09-13T06:07:41.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.380+0000 7fe20e7fc640 1 -- 172.21.15.130:0/1902846301 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2000ac5f0 con 0x7fe210152240 2023-09-13T06:07:41.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.380+0000 7fe20e7fc640 1 -- 172.21.15.130:0/1902846301 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2000ac980 con 0x7fe210152240 2023-09-13T06:07:41.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.380+0000 7fe215a9e640 1 -- 172.21.15.130:0/1902846301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe210152240 msgr2=0x7fe21006ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.380+0000 7fe215a9e640 1 --2- 172.21.15.130:0/1902846301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe210152240 0x7fe21006ff60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe2000097c0 tx=0x7fe20001c480 comp rx=0 tx=0).stop 2023-09-13T06:07:41.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.380+0000 7fe215a9e640 1 -- 172.21.15.130:0/1902846301 shutdown_connections 2023-09-13T06:07:41.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.380+0000 7fe215a9e640 1 --2- 172.21.15.130:0/1902846301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe210152240 0x7fe21006ff60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:41.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.380+0000 7fe215a9e640 1 -- 172.21.15.130:0/1902846301 >> 172.21.15.130:0/1902846301 conn(0x7fe210065d60 msgr2=0x7fe2100b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:41.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.380+0000 7fe215a9e640 1 -- 172.21.15.130:0/1902846301 shutdown_connections 2023-09-13T06:07:41.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.380+0000 7fe215a9e640 1 -- 172.21.15.130:0/1902846301 wait complete. 2023-09-13T06:07:41.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe215a9e640 1 Processor -- start 2023-09-13T06:07:41.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe215a9e640 1 -- start start 2023-09-13T06:07:41.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe215a9e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe210070650 0x7fe2101668a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:41.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe215a9e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe210152240 0x7fe210139680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:41.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe215a9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe21015c0b0 0x7fe210152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:41.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe215a9e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe210166de0 con 0x7fe210152240 2023-09-13T06:07:41.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe215a9e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe210137c40 con 0x7fe210070650 2023-09-13T06:07:41.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe215a9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe210139bc0 con 0x7fe21015c0b0 2023-09-13T06:07:41.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe20effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe210152240 0x7fe210139680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:41.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe20effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe210152240 0x7fe210139680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44340/0 (socket says 172.21.15.130:44340) 2023-09-13T06:07:41.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe20effd640 1 -- 172.21.15.130:0/2191834221 learned_addr learned my addr 172.21.15.130:0/2191834221 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:41.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe20f7fe640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe210070650 0x7fe2101668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:41.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe20ffff640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe21015c0b0 0x7fe210152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:41.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe20effd640 1 -- 172.21.15.130:0/2191834221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe21015c0b0 msgr2=0x7fe210152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe20effd640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe21015c0b0 0x7fe210152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:41.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe20effd640 1 -- 172.21.15.130:0/2191834221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe210070650 msgr2=0x7fe2101668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:41.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe20effd640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe210070650 0x7fe2101668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:41.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe20effd640 1 -- 172.21.15.130:0/2191834221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe200009420 con 0x7fe210152240 2023-09-13T06:07:41.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe20effd640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe210152240 0x7fe210139680 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fe20400c500 tx=0x7fe20400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:41.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe1f7fff640 1 -- 172.21.15.130:0/2191834221 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204005220 con 0x7fe210152240 2023-09-13T06:07:41.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe1f7fff640 1 -- 172.21.15.130:0/2191834221 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe204005380 con 0x7fe210152240 2023-09-13T06:07:41.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe215a9e640 1 -- 172.21.15.130:0/2191834221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe210070ff0 con 0x7fe210152240 2023-09-13T06:07:41.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.384+0000 7fe1f7fff640 1 -- 172.21.15.130:0/2191834221 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204007270 con 0x7fe210152240 2023-09-13T06:07:41.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.388+0000 7fe215a9e640 1 -- 172.21.15.130:0/2191834221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe210137030 con 0x7fe210152240 2023-09-13T06:07:41.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.388+0000 7fe215a9e640 1 -- 172.21.15.130:0/2191834221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe210137dd0 con 0x7fe210152240 2023-09-13T06:07:41.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.388+0000 7fe1f7fff640 1 -- 172.21.15.130:0/2191834221 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe2040073d0 con 0x7fe210152240 2023-09-13T06:07:41.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.388+0000 7fe1f7fff640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe1fc065b20 0x7fe1fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:41.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.388+0000 7fe1f7fff640 1 -- 172.21.15.130:0/2191834221 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe204082c40 con 0x7fe210152240 2023-09-13T06:07:41.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.388+0000 7fe20f7fe640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe1fc065b20 0x7fe1fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:41.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.388+0000 7fe20f7fe640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe1fc065b20 0x7fe1fc067fe0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe2000ae000 tx=0x7fe200008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:41.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.392+0000 7fe1f7fff640 1 -- 172.21.15.130:0/2191834221 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe204050500 con 0x7fe210152240 2023-09-13T06:07:41.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:41.576+0000 7fe215a9e640 1 -- 172.21.15.130:0/2191834221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe2100618a0 con 0x7fe210152240 2023-09-13T06:07:42.508 INFO:tasks.ceph.mds.b.smithi164.stderr:2023-09-13T06:07:42.509+0000 7f37245c1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:07:42.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.560+0000 7fe1f7fff640 1 -- 172.21.15.130:0/2191834221 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe204053b20 con 0x7fe210152240 2023-09-13T06:07:42.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 -- 172.21.15.130:0/2191834221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe1fc065b20 msgr2=0x7fe1fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:42.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe1fc065b20 0x7fe1fc067fe0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe2000ae000 tx=0x7fe200008040 comp rx=0 tx=0).stop 2023-09-13T06:07:42.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 -- 172.21.15.130:0/2191834221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe210152240 msgr2=0x7fe210139680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:42.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe210152240 0x7fe210139680 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fe20400c500 tx=0x7fe20400c9c0 comp rx=0 tx=0).stop 2023-09-13T06:07:42.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 -- 172.21.15.130:0/2191834221 shutdown_connections 2023-09-13T06:07:42.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe1fc065b20 0x7fe1fc067fe0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:42.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe21015c0b0 0x7fe210152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:42.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe210152240 0x7fe210139680 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:42.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 --2- 172.21.15.130:0/2191834221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe210070650 0x7fe2101668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:42.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 -- 172.21.15.130:0/2191834221 >> 172.21.15.130:0/2191834221 conn(0x7fe210065d60 msgr2=0x7fe21014f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:42.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 -- 172.21.15.130:0/2191834221 shutdown_connections 2023-09-13T06:07:42.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.564+0000 7fe215a9e640 1 -- 172.21.15.130:0/2191834221 wait complete. 2023-09-13T06:07:42.589 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T06:07:42.590 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T06:07:42.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.732+0000 7fe1a186d640 1 Processor -- start 2023-09-13T06:07:42.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.732+0000 7fe1a186d640 1 -- start start 2023-09-13T06:07:42.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe1a186d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe19c0d2cd0 0x7fe19c1612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:42.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe1a186d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe19c1617e0 0x7fe19c0cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:42.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe1a186d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19c15dd40 con 0x7fe19c15ae10 2023-09-13T06:07:42.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe1a186d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19c15e020 con 0x7fe19c0d2cd0 2023-09-13T06:07:42.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe1a186d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19c15e300 con 0x7fe19c1617e0 2023-09-13T06:07:42.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe193fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe19c0d2cd0 0x7fe19c1612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:42.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe193fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe19c0d2cd0 0x7fe19c1612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44358/0 (socket says 172.21.15.130:44358) 2023-09-13T06:07:42.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe193fff640 1 -- 172.21.15.130:0/3743174521 learned_addr learned my addr 172.21.15.130:0/3743174521 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:42.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe193fff640 1 -- 172.21.15.130:0/3743174521 >> v2:172.21.15.164:3300/0 conn(0x7fe19c1617e0 msgr2=0x7fe19c0cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:42.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe193fff640 1 --2- 172.21.15.130:0/3743174521 >> v2:172.21.15.164:3300/0 conn(0x7fe19c1617e0 0x7fe19c0cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:42.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe193fff640 1 -- 172.21.15.130:0/3743174521 >> v1:172.21.15.130:6789/0 conn(0x7fe19c15ae10 legacy=0x7fe19c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:42.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.736+0000 7fe193fff640 1 -- 172.21.15.130:0/3743174521 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c15e5e0 con 0x7fe19c0d2cd0 2023-09-13T06:07:42.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe193fff640 1 --2- 172.21.15.130:0/3743174521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe19c0d2cd0 0x7fe19c1612a0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0d1b70 tx=0x7fe18401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe88af358558684 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:42.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe19a7fc640 1 -- 172.21.15.130:0/3743174521 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840ab600 con 0x7fe19c0d2cd0 2023-09-13T06:07:42.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe19a7fc640 1 -- 172.21.15.130:0/3743174521 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1840a7050 con 0x7fe19c0d2cd0 2023-09-13T06:07:42.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe19a7fc640 1 -- 172.21.15.130:0/3743174521 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840ab980 con 0x7fe19c0d2cd0 2023-09-13T06:07:42.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe1a186d640 1 -- 172.21.15.130:0/3743174521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe19c0d2cd0 msgr2=0x7fe19c1612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:42.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe1a186d640 1 --2- 172.21.15.130:0/3743174521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe19c0d2cd0 0x7fe19c1612a0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0d1b70 tx=0x7fe18401c3e0 comp rx=0 tx=0).stop 2023-09-13T06:07:42.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe1a186d640 1 -- 172.21.15.130:0/3743174521 shutdown_connections 2023-09-13T06:07:42.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe1a186d640 1 --2- 172.21.15.130:0/3743174521 >> v2:172.21.15.164:3300/0 conn(0x7fe19c1617e0 0x7fe19c0cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:42.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe1a186d640 1 --2- 172.21.15.130:0/3743174521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe19c0d2cd0 0x7fe19c1612a0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:42.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe1a186d640 1 -- 172.21.15.130:0/3743174521 >> 172.21.15.130:0/3743174521 conn(0x7fe19c065990 msgr2=0x7fe19c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:42.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe1a186d640 1 -- 172.21.15.130:0/3743174521 shutdown_connections 2023-09-13T06:07:42.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe1a186d640 1 -- 172.21.15.130:0/3743174521 wait complete. 2023-09-13T06:07:42.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe1a186d640 1 Processor -- start 2023-09-13T06:07:42.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.740+0000 7fe1a186d640 1 -- start start 2023-09-13T06:07:42.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe1a186d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0d2cd0 0x7fe19c167580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:42.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe1a186d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe19c15ae10 0x7fe19c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:42.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe1a186d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe19c1617e0 0x7fe19c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:42.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe1a186d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c0b5ca0 con 0x7fe19c15ae10 2023-09-13T06:07:42.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe1a186d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c166dc0 con 0x7fe19c0d2cd0 2023-09-13T06:07:42.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe1a186d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c1632e0 con 0x7fe19c1617e0 2023-09-13T06:07:42.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe193fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe19c15ae10 0x7fe19c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:42.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe193fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe19c15ae10 0x7fe19c1550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44360/0 (socket says 172.21.15.130:44360) 2023-09-13T06:07:42.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe193fff640 1 -- 172.21.15.130:0/1419026333 learned_addr learned my addr 172.21.15.130:0/1419026333 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:42.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe19affd640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0d2cd0 0x7fe19c167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:42.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe19b7fe640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe19c1617e0 0x7fe19c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:42.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe193fff640 1 -- 172.21.15.130:0/1419026333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe19c1617e0 msgr2=0x7fe19c155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:42.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe193fff640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe19c1617e0 0x7fe19c155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:42.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe193fff640 1 -- 172.21.15.130:0/1419026333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0d2cd0 msgr2=0x7fe19c167580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:42.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe193fff640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0d2cd0 0x7fe19c167580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:42.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe193fff640 1 -- 172.21.15.130:0/1419026333 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1840094d0 con 0x7fe19c15ae10 2023-09-13T06:07:42.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe19affd640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0d2cd0 0x7fe19c167580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:42.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe193fff640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe19c15ae10 0x7fe19c1550c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe1840ae040 tx=0x7fe184019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:42.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe198ff9640 1 -- 172.21.15.130:0/1419026333 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840b4640 con 0x7fe19c15ae10 2023-09-13T06:07:42.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe198ff9640 1 -- 172.21.15.130:0/1419026333 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1840b47c0 con 0x7fe19c15ae10 2023-09-13T06:07:42.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe198ff9640 1 -- 172.21.15.130:0/1419026333 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840b4b70 con 0x7fe19c15ae10 2023-09-13T06:07:42.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe1a186d640 1 -- 172.21.15.130:0/1419026333 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19c0b5ef0 con 0x7fe19c15ae10 2023-09-13T06:07:42.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe1a186d640 1 -- 172.21.15.130:0/1419026333 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19c0b61d0 con 0x7fe19c15ae10 2023-09-13T06:07:42.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe1a186d640 1 -- 172.21.15.130:0/1419026333 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19c0618a0 con 0x7fe19c15ae10 2023-09-13T06:07:42.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.744+0000 7fe198ff9640 1 -- 172.21.15.130:0/1419026333 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe1840b2070 con 0x7fe19c15ae10 2023-09-13T06:07:42.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.748+0000 7fe198ff9640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe17c065b50 0x7fe17c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:42.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.748+0000 7fe198ff9640 1 -- 172.21.15.130:0/1419026333 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe18411d3b0 con 0x7fe19c15ae10 2023-09-13T06:07:42.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.748+0000 7fe19affd640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe17c065b50 0x7fe17c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:42.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.748+0000 7fe19affd640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe17c065b50 0x7fe17c068010 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000f70 tx=0x7fe18c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:42.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.752+0000 7fe198ff9640 1 -- 172.21.15.130:0/1419026333 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe1840eac60 con 0x7fe19c15ae10 2023-09-13T06:07:42.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:42.928+0000 7fe1a186d640 1 -- 172.21.15.130:0/1419026333 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe19c0b37e0 con 0x7fe19c15ae10 2023-09-13T06:07:43.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.568+0000 7fe198ff9640 1 -- 172.21.15.130:0/1419026333 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe1840ee280 con 0x7fe19c15ae10 2023-09-13T06:07:43.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 -- 172.21.15.130:0/1419026333 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe17c065b50 msgr2=0x7fe17c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:43.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe17c065b50 0x7fe17c068010 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000f70 tx=0x7fe18c009040 comp rx=0 tx=0).stop 2023-09-13T06:07:43.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 -- 172.21.15.130:0/1419026333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe19c15ae10 msgr2=0x7fe19c1550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:43.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe19c15ae10 0x7fe19c1550c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe1840ae040 tx=0x7fe184019180 comp rx=0 tx=0).stop 2023-09-13T06:07:43.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 -- 172.21.15.130:0/1419026333 shutdown_connections 2023-09-13T06:07:43.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe17c065b50 0x7fe17c068010 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe19c1617e0 0x7fe19c155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe19c15ae10 0x7fe19c1550c0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 --2- 172.21.15.130:0/1419026333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe19c0d2cd0 0x7fe19c167580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 -- 172.21.15.130:0/1419026333 >> 172.21.15.130:0/1419026333 conn(0x7fe19c065990 msgr2=0x7fe19c156a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:43.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 -- 172.21.15.130:0/1419026333 shutdown_connections 2023-09-13T06:07:43.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.572+0000 7fe1a186d640 1 -- 172.21.15.130:0/1419026333 wait complete. 2023-09-13T06:07:43.595 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T06:07:43.596 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:43.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.732+0000 7fed53893640 1 Processor -- start 2023-09-13T06:07:43.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.732+0000 7fed53893640 1 -- start start 2023-09-13T06:07:43.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed53893640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fed4c146cf0 0x7fed4c0c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:43.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed53893640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed4c0cd170 0x7fed4c06f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:43.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed53893640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0c4150 con 0x7fed4c1610a0 2023-09-13T06:07:43.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed53893640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c06f170 con 0x7fed4c146cf0 2023-09-13T06:07:43.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed53893640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0c4430 con 0x7fed4c0cd170 2023-09-13T06:07:43.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed5162f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fed4c146cf0 0x7fed4c0c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:43.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed50e2e640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fed4c1610a0 0x7fed4c0cca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:45764/0 (socket says 172.21.15.130:45764) 2023-09-13T06:07:43.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed5162f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fed4c146cf0 0x7fed4c0c38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:52856/0 (socket says 172.21.15.130:52856) 2023-09-13T06:07:43.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed50e2e640 1 -- 172.21.15.130:0/84971393 learned_addr learned my addr 172.21.15.130:0/84971393 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:43.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed51e30640 1 --2- 172.21.15.130:0/84971393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed4c0cd170 0x7fed4c06f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:43.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed5162f640 1 -- 172.21.15.130:0/84971393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed4c0cd170 msgr2=0x7fed4c06f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:43.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed5162f640 1 --2- 172.21.15.130:0/84971393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed4c0cd170 0x7fed4c06f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed5162f640 1 -- 172.21.15.130:0/84971393 >> v1:172.21.15.164:6789/0 conn(0x7fed4c1610a0 legacy=0x7fed4c0cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:43.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed5162f640 1 -- 172.21.15.130:0/84971393 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0c4710 con 0x7fed4c146cf0 2023-09-13T06:07:43.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.736+0000 7fed43fff640 1 -- 172.21.15.130:0/84971393 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497590726 0 0) 0x7fed4c0c4150 con 0x7fed4c1610a0 2023-09-13T06:07:43.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed5162f640 1 --2- 172.21.15.130:0/84971393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed4c146cf0 0x7fed4c0c38e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fed480097c0 tx=0x7fed4801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=706847bbdadbabe4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:43.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed43fff640 1 -- 172.21.15.130:0/84971393 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed480a8970 con 0x7fed4c146cf0 2023-09-13T06:07:43.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed43fff640 1 -- 172.21.15.130:0/84971393 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed480a8ad0 con 0x7fed4c146cf0 2023-09-13T06:07:43.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed43fff640 1 -- 172.21.15.130:0/84971393 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed480a8e60 con 0x7fed4c146cf0 2023-09-13T06:07:43.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed53893640 1 -- 172.21.15.130:0/84971393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed4c146cf0 msgr2=0x7fed4c0c38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:43.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed53893640 1 --2- 172.21.15.130:0/84971393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed4c146cf0 0x7fed4c0c38e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fed480097c0 tx=0x7fed4801ec70 comp rx=0 tx=0).stop 2023-09-13T06:07:43.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed53893640 1 -- 172.21.15.130:0/84971393 shutdown_connections 2023-09-13T06:07:43.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed53893640 1 --2- 172.21.15.130:0/84971393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed4c0cd170 0x7fed4c06f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed53893640 1 --2- 172.21.15.130:0/84971393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed4c146cf0 0x7fed4c0c38e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed53893640 1 -- 172.21.15.130:0/84971393 >> 172.21.15.130:0/84971393 conn(0x7fed4c06a2f0 msgr2=0x7fed4c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:43.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed53893640 1 -- 172.21.15.130:0/84971393 shutdown_connections 2023-09-13T06:07:43.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed53893640 1 -- 172.21.15.130:0/84971393 wait complete. 2023-09-13T06:07:43.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.740+0000 7fed53893640 1 Processor -- start 2023-09-13T06:07:43.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed53893640 1 -- start start 2023-09-13T06:07:43.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed53893640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed4c0cd170 0x7fed4c13f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:43.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed53893640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed4c146cf0 0x7fed4c13d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:43.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed53893640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed4c1610a0 0x7fed4c13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:43.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed53893640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c13e020 con 0x7fed4c146cf0 2023-09-13T06:07:43.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed53893640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c13e300 con 0x7fed4c0cd170 2023-09-13T06:07:43.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed53893640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c13e5e0 con 0x7fed4c1610a0 2023-09-13T06:07:43.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed5162f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed4c0cd170 0x7fed4c13f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:43.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed50e2e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed4c146cf0 0x7fed4c13d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:43.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed5162f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed4c0cd170 0x7fed4c13f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:52862/0 (socket says 172.21.15.130:52862) 2023-09-13T06:07:43.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed5162f640 1 -- 172.21.15.130:0/968613820 learned_addr learned my addr 172.21.15.130:0/968613820 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:43.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed51e30640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed4c1610a0 0x7fed4c13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:43.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed5162f640 1 -- 172.21.15.130:0/968613820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed4c1610a0 msgr2=0x7fed4c13cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:43.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed5162f640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed4c1610a0 0x7fed4c13cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed5162f640 1 -- 172.21.15.130:0/968613820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed4c146cf0 msgr2=0x7fed4c13d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:43.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed5162f640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed4c146cf0 0x7fed4c13d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed5162f640 1 -- 172.21.15.130:0/968613820 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed48009420 con 0x7fed4c0cd170 2023-09-13T06:07:43.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed5162f640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed4c0cd170 0x7fed4c13f0c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fed4801c8a0 tx=0x7fed4801ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:43.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed41ffb640 1 -- 172.21.15.130:0/968613820 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed480b0e10 con 0x7fed4c0cd170 2023-09-13T06:07:43.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed41ffb640 1 -- 172.21.15.130:0/968613820 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed480b9410 con 0x7fed4c0cd170 2023-09-13T06:07:43.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed41ffb640 1 -- 172.21.15.130:0/968613820 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed480b97c0 con 0x7fed4c0cd170 2023-09-13T06:07:43.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed53893640 1 -- 172.21.15.130:0/968613820 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c13e8c0 con 0x7fed4c0cd170 2023-09-13T06:07:43.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed53893640 1 -- 172.21.15.130:0/968613820 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c13dd30 con 0x7fed4c0cd170 2023-09-13T06:07:43.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.744+0000 7fed53893640 1 -- 172.21.15.130:0/968613820 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c0618a0 con 0x7fed4c0cd170 2023-09-13T06:07:43.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.748+0000 7fed41ffb640 1 -- 172.21.15.130:0/968613820 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fed480b7040 con 0x7fed4c0cd170 2023-09-13T06:07:43.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.748+0000 7fed41ffb640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed30065b20 0x7fed30067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:43.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.748+0000 7fed41ffb640 1 -- 172.21.15.130:0/968613820 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed481210f0 con 0x7fed4c0cd170 2023-09-13T06:07:43.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.748+0000 7fed50e2e640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed30065b20 0x7fed30067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:43.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.748+0000 7fed50e2e640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed30065b20 0x7fed30067fe0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fed4c146250 tx=0x7fed3c007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:43.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.752+0000 7fed41ffb640 1 -- 172.21.15.130:0/968613820 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fed480eec00 con 0x7fed4c0cd170 2023-09-13T06:07:43.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.932+0000 7fed53893640 1 -- 172.21.15.130:0/968613820 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed4c0c3170 con 0x7fed4c0cd170 2023-09-13T06:07:43.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.932+0000 7fed41ffb640 1 -- 172.21.15.130:0/968613820 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fed480f2220 con 0x7fed4c0cd170 2023-09-13T06:07:43.935 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:43.935 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1309237651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1309237651},{"type":"v1","addr":"172.21.15.130:6837","nonce":1309237651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1568650238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1568650238},{"type":"v1","addr":"172.21.15.164:6834","nonce":1568650238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1994572743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1994572743},{"type":"v1","addr":"172.21.15.130:6836","nonce":1994572743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:39.911036+0000","modified":"2023-09-13T06:07:42.935333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7773},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7773":{"gid":7773,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/4146626637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4146626637},{"type":"v1","addr":"172.21.15.164:6835","nonce":4146626637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-09-13T06:07:43.936 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 68 2023-09-13T06:07:43.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 -- 172.21.15.130:0/968613820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed30065b20 msgr2=0x7fed30067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:43.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed30065b20 0x7fed30067fe0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fed4c146250 tx=0x7fed3c007df0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 -- 172.21.15.130:0/968613820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed4c0cd170 msgr2=0x7fed4c13f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:43.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed4c0cd170 0x7fed4c13f0c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fed4801c8a0 tx=0x7fed4801ba10 comp rx=0 tx=0).stop 2023-09-13T06:07:43.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 -- 172.21.15.130:0/968613820 shutdown_connections 2023-09-13T06:07:43.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed30065b20 0x7fed30067fe0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed4c1610a0 0x7fed4c13cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed4c146cf0 0x7fed4c13d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 --2- 172.21.15.130:0/968613820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed4c0cd170 0x7fed4c13f0c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:43.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 -- 172.21.15.130:0/968613820 >> 172.21.15.130:0/968613820 conn(0x7fed4c06a2f0 msgr2=0x7fed4c15e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:43.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 -- 172.21.15.130:0/968613820 shutdown_connections 2023-09-13T06:07:43.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:43.936+0000 7fed53893640 1 -- 172.21.15.130:0/968613820 wait complete. 2023-09-13T06:07:43.956 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:07:44.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e45fa640 1 Processor -- start 2023-09-13T06:07:44.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e45fa640 1 -- start start 2023-09-13T06:07:44.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e45fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05dc0d1090 0x7f05dc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e45fa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05dc146f30 0x7f05dc0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e45fa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05dc0b63c0 con 0x7f05dc0d1750 2023-09-13T06:07:44.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e45fa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05dc15dea0 con 0x7f05dc146f30 2023-09-13T06:07:44.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e45fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc0d0c20 con 0x7f05dc0d1090 2023-09-13T06:07:44.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e2b97640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05dc146f30 0x7f05dc0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e2b97640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05dc146f30 0x7f05dc0b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44378/0 (socket says 172.21.15.130:44378) 2023-09-13T06:07:44.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e2b97640 1 -- 172.21.15.130:0/441741422 learned_addr learned my addr 172.21.15.130:0/441741422 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:44.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e1b95640 1 --2- 172.21.15.130:0/441741422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05dc0d1090 0x7f05dc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e2b97640 1 -- 172.21.15.130:0/441741422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05dc0d1090 msgr2=0x7f05dc15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:44.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e2b97640 1 --2- 172.21.15.130:0/441741422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05dc0d1090 0x7f05dc15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e2b97640 1 -- 172.21.15.130:0/441741422 >> v1:172.21.15.164:6789/0 conn(0x7f05dc0d1750 legacy=0x7f05dc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.092+0000 7f05e2b97640 1 -- 172.21.15.130:0/441741422 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc0b6610 con 0x7f05dc146f30 2023-09-13T06:07:44.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e2b97640 1 --2- 172.21.15.130:0/441741422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05dc146f30 0x7f05dc0b70f0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009e50 tx=0x7f05d401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3818d79b6d83a24a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:44.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e1394640 1 -- 172.21.15.130:0/441741422 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40a58a0 con 0x7f05dc146f30 2023-09-13T06:07:44.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e1394640 1 -- 172.21.15.130:0/441741422 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d40a5a00 con 0x7f05dc146f30 2023-09-13T06:07:44.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e1394640 1 -- 172.21.15.130:0/441741422 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40a5d90 con 0x7f05dc146f30 2023-09-13T06:07:44.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e45fa640 1 -- 172.21.15.130:0/441741422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05dc146f30 msgr2=0x7f05dc0b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e45fa640 1 --2- 172.21.15.130:0/441741422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05dc146f30 0x7f05dc0b70f0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009e50 tx=0x7f05d401c9e0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e45fa640 1 -- 172.21.15.130:0/441741422 shutdown_connections 2023-09-13T06:07:44.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e45fa640 1 --2- 172.21.15.130:0/441741422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05dc146f30 0x7f05dc0b70f0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e45fa640 1 --2- 172.21.15.130:0/441741422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05dc0d1090 0x7f05dc15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e45fa640 1 -- 172.21.15.130:0/441741422 >> 172.21.15.130:0/441741422 conn(0x7f05dc06f170 msgr2=0x7f05dc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:44.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e45fa640 1 -- 172.21.15.130:0/441741422 shutdown_connections 2023-09-13T06:07:44.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.096+0000 7f05e45fa640 1 -- 172.21.15.130:0/441741422 wait complete. 2023-09-13T06:07:44.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e45fa640 1 Processor -- start 2023-09-13T06:07:44.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e45fa640 1 -- start start 2023-09-13T06:07:44.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e45fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05dc0d1090 0x7f05dc13ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e45fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05dc0d1750 0x7f05dc15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e45fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05dc146f30 0x7f05dc1678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e45fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc15cb40 con 0x7f05dc146f30 2023-09-13T06:07:44.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e45fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc166880 con 0x7f05dc0d1090 2023-09-13T06:07:44.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e45fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc166b20 con 0x7f05dc0d1750 2023-09-13T06:07:44.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e2b97640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05dc146f30 0x7f05dc1678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e2b97640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05dc146f30 0x7f05dc1678e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44384/0 (socket says 172.21.15.130:44384) 2023-09-13T06:07:44.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e2b97640 1 -- 172.21.15.130:0/3595602641 learned_addr learned my addr 172.21.15.130:0/3595602641 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:44.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e2396640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05dc0d1090 0x7f05dc13ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e1b95640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05dc0d1750 0x7f05dc15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e2b97640 1 -- 172.21.15.130:0/3595602641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05dc0d1750 msgr2=0x7f05dc15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e2b97640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05dc0d1750 0x7f05dc15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e2b97640 1 -- 172.21.15.130:0/3595602641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05dc0d1090 msgr2=0x7f05dc13ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e2b97640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05dc0d1090 0x7f05dc13ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e2b97640 1 -- 172.21.15.130:0/3595602641 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d4009b30 con 0x7f05dc146f30 2023-09-13T06:07:44.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e2b97640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05dc146f30 0x7f05dc1678e0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f05d40af040 tx=0x7f05d4019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:44.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05d2ffd640 1 -- 172.21.15.130:0/3595602641 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40b8640 con 0x7f05dc146f30 2023-09-13T06:07:44.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05d2ffd640 1 -- 172.21.15.130:0/3595602641 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d40b87a0 con 0x7f05dc146f30 2023-09-13T06:07:44.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05d2ffd640 1 -- 172.21.15.130:0/3595602641 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40b8b10 con 0x7f05dc146f30 2023-09-13T06:07:44.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e45fa640 1 -- 172.21.15.130:0/3595602641 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc0b7e40 con 0x7f05dc146f30 2023-09-13T06:07:44.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.100+0000 7f05e45fa640 1 -- 172.21.15.130:0/3595602641 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05dc1670e0 con 0x7f05dc146f30 2023-09-13T06:07:44.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.104+0000 7f05e45fa640 1 -- 172.21.15.130:0/3595602641 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc0618a0 con 0x7f05dc146f30 2023-09-13T06:07:44.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.104+0000 7f05d2ffd640 1 -- 172.21.15.130:0/3595602641 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f05d40b8c70 con 0x7f05dc146f30 2023-09-13T06:07:44.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.104+0000 7f05d2ffd640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05c0065b20 0x7f05c0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.104+0000 7f05d2ffd640 1 -- 172.21.15.130:0/3595602641 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05d411e530 con 0x7f05dc146f30 2023-09-13T06:07:44.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.104+0000 7f05e2396640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05c0065b20 0x7f05c0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.104+0000 7f05e2396640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05c0065b20 0x7f05c0067fe0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f05dc166670 tx=0x7f05d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:44.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.108+0000 7f05d2ffd640 1 -- 172.21.15.130:0/3595602641 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f05d40ebf20 con 0x7f05dc146f30 2023-09-13T06:07:44.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.256+0000 7f05e45fa640 1 -- 172.21.15.130:0/3595602641 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05dc0b86c0 con 0x7f05dc146f30 2023-09-13T06:07:44.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05d2ffd640 1 -- 172.21.15.130:0/3595602641 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16564 (secure 0 0 0) 0x7f05d40ef540 con 0x7f05dc146f30 2023-09-13T06:07:44.261 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:44.262 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":137,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:07:41.534396+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:38.276233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:39.032744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:07:44.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 -- 172.21.15.130:0/3595602641 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05c0065b20 msgr2=0x7f05c0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05c0065b20 0x7f05c0067fe0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f05dc166670 tx=0x7f05d8009040 comp rx=0 tx=0).stop 2023-09-13T06:07:44.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 -- 172.21.15.130:0/3595602641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05dc146f30 msgr2=0x7f05dc1678e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05dc146f30 0x7f05dc1678e0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f05d40af040 tx=0x7f05d4019780 comp rx=0 tx=0).stop 2023-09-13T06:07:44.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 -- 172.21.15.130:0/3595602641 shutdown_connections 2023-09-13T06:07:44.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f05c0065b20 0x7f05c0067fe0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05dc146f30 0x7f05dc1678e0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f05dc0d1750 0x7f05dc15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 --2- 172.21.15.130:0/3595602641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05dc0d1090 0x7f05dc13ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 -- 172.21.15.130:0/3595602641 >> 172.21.15.130:0/3595602641 conn(0x7f05dc06f170 msgr2=0x7f05dc0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:44.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 -- 172.21.15.130:0/3595602641 shutdown_connections 2023-09-13T06:07:44.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.260+0000 7f05e45fa640 1 -- 172.21.15.130:0/3595602641 wait complete. 2023-09-13T06:07:44.282 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T06:07:44.283 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:07:44.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.420+0000 7f8ddc49e640 1 Processor -- start 2023-09-13T06:07:44.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.420+0000 7f8ddc49e640 1 -- start start 2023-09-13T06:07:44.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddc49e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8dd4159f20 0x7f8dd40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddc49e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8dd40b1d20 0x7f8dd40b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddc49e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd40ccfd0 con 0x7f8dd40cdfc0 2023-09-13T06:07:44.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddc49e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd40b00f0 con 0x7f8dd40b1d20 2023-09-13T06:07:44.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddc49e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd40b11d0 con 0x7f8dd4159f20 2023-09-13T06:07:44.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddaa3b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8dd40b1d20 0x7f8dd40b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddaa3b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8dd40b1d20 0x7f8dd40b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44402/0 (socket says 172.21.15.130:44402) 2023-09-13T06:07:44.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddaa3b640 1 -- 172.21.15.130:0/3127945186 learned_addr learned my addr 172.21.15.130:0/3127945186 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:44.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8dda23a640 1 --2- 172.21.15.130:0/3127945186 >> v2:172.21.15.164:3300/0 conn(0x7f8dd4159f20 0x7f8dd40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddaa3b640 1 -- 172.21.15.130:0/3127945186 >> v2:172.21.15.164:3300/0 conn(0x7f8dd4159f20 msgr2=0x7f8dd40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:44.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddaa3b640 1 --2- 172.21.15.130:0/3127945186 >> v2:172.21.15.164:3300/0 conn(0x7f8dd4159f20 0x7f8dd40ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddaa3b640 1 -- 172.21.15.130:0/3127945186 >> v1:172.21.15.164:6789/0 conn(0x7f8dd40cdfc0 legacy=0x7f8dd40b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.424+0000 7f8ddaa3b640 1 -- 172.21.15.130:0/3127945186 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd40ced90 con 0x7f8dd40b1d20 2023-09-13T06:07:44.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8ddaa3b640 1 --2- 172.21.15.130:0/3127945186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd40b1d20 0x7f8dd40b0c90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40b2660 tx=0x7f8dcc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff83a6d63aab470 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:44.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8dd9238640 1 -- 172.21.15.130:0/3127945186 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc0a5860 con 0x7f8dd40b1d20 2023-09-13T06:07:44.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8dd9238640 1 -- 172.21.15.130:0/3127945186 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc0a59c0 con 0x7f8dd40b1d20 2023-09-13T06:07:44.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8dd9238640 1 -- 172.21.15.130:0/3127945186 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc0a5d50 con 0x7f8dd40b1d20 2023-09-13T06:07:44.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3127945186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd40b1d20 msgr2=0x7f8dd40b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8ddc49e640 1 --2- 172.21.15.130:0/3127945186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd40b1d20 0x7f8dd40b0c90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40b2660 tx=0x7f8dcc01c9a0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3127945186 shutdown_connections 2023-09-13T06:07:44.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8ddc49e640 1 --2- 172.21.15.130:0/3127945186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd40b1d20 0x7f8dd40b0c90 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8ddc49e640 1 --2- 172.21.15.130:0/3127945186 >> v2:172.21.15.164:3300/0 conn(0x7f8dd4159f20 0x7f8dd40ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3127945186 >> 172.21.15.130:0/3127945186 conn(0x7f8dd4065990 msgr2=0x7f8dd4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:44.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3127945186 shutdown_connections 2023-09-13T06:07:44.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3127945186 wait complete. 2023-09-13T06:07:44.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8ddc49e640 1 Processor -- start 2023-09-13T06:07:44.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.428+0000 7f8ddc49e640 1 -- start start 2023-09-13T06:07:44.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddc49e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8dd40b1d20 0x7f8dd41f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddc49e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dd40cdfc0 0x7f8dd406c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddc49e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd4159f20 0x7f8dd40c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddc49e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd406d0b0 con 0x7f8dd4159f20 2023-09-13T06:07:44.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddc49e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd41587d0 con 0x7f8dd40cdfc0 2023-09-13T06:07:44.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddc49e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd406c600 con 0x7f8dd40b1d20 2023-09-13T06:07:44.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8dda23a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8dd40b1d20 0x7f8dd41f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddaa3b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd4159f20 0x7f8dd40c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8dda23a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8dd40b1d20 0x7f8dd41f5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:35132/0 (socket says 172.21.15.130:35132) 2023-09-13T06:07:44.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8dda23a640 1 -- 172.21.15.130:0/3312066620 learned_addr learned my addr 172.21.15.130:0/3312066620 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:44.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8dd9a39640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dd40cdfc0 0x7f8dd406c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddaa3b640 1 -- 172.21.15.130:0/3312066620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8dd40b1d20 msgr2=0x7f8dd41f5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddaa3b640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8dd40b1d20 0x7f8dd41f5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddaa3b640 1 -- 172.21.15.130:0/3312066620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dd40cdfc0 msgr2=0x7f8dd406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddaa3b640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dd40cdfc0 0x7f8dd406c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddaa3b640 1 -- 172.21.15.130:0/3312066620 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc009b30 con 0x7f8dd4159f20 2023-09-13T06:07:44.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddaa3b640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd4159f20 0x7f8dd40c6fa0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0ab000 tx=0x7f8dcc019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:44.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8dcaffd640 1 -- 172.21.15.130:0/3312066620 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc0b8470 con 0x7f8dd4159f20 2023-09-13T06:07:44.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8dcaffd640 1 -- 172.21.15.130:0/3312066620 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc0b85d0 con 0x7f8dd4159f20 2023-09-13T06:07:44.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8dcaffd640 1 -- 172.21.15.130:0/3312066620 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc0b8980 con 0x7f8dd4159f20 2023-09-13T06:07:44.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3312066620 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd406c810 con 0x7f8dd4159f20 2023-09-13T06:07:44.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3312066620 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd406cdd0 con 0x7f8dd4159f20 2023-09-13T06:07:44.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3312066620 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd4158530 con 0x7f8dd4159f20 2023-09-13T06:07:44.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.432+0000 7f8dcaffd640 1 -- 172.21.15.130:0/3312066620 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8dcc0b8ae0 con 0x7f8dd4159f20 2023-09-13T06:07:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.436+0000 7f8dcaffd640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8db8065b20 0x7f8db8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.436+0000 7f8dcaffd640 1 -- 172.21.15.130:0/3312066620 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8dcc11e2f0 con 0x7f8dd4159f20 2023-09-13T06:07:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.436+0000 7f8dda23a640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8db8065b20 0x7f8db8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.436+0000 7f8dda23a640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8db8065b20 0x7f8db8067fe0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009bc0 tx=0x7f8dd0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:44.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.440+0000 7f8dcaffd640 1 -- 172.21.15.130:0/3312066620 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8dd4158530 con 0x7f8dd4159f20 2023-09-13T06:07:44.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.588+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3312066620 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8dd40cdaa0 con 0x7f8db8065b20 2023-09-13T06:07:44.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.596+0000 7f8dcaffd640 1 -- 172.21.15.130:0/3312066620 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274837 (secure 0 0 0) 0x7f8dd0011b20 con 0x7f8db8065b20 2023-09-13T06:07:44.601 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:44.604 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:07:44.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3312066620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8db8065b20 msgr2=0x7f8db8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8db8065b20 0x7f8db8067fe0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009bc0 tx=0x7f8dd0009190 comp rx=0 tx=0).stop 2023-09-13T06:07:44.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3312066620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd4159f20 msgr2=0x7f8dd40c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd4159f20 0x7f8dd40c6fa0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0ab000 tx=0x7f8dcc019740 comp rx=0 tx=0).stop 2023-09-13T06:07:44.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3312066620 shutdown_connections 2023-09-13T06:07:44.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8db8065b20 0x7f8db8067fe0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8dd40cdfc0 0x7f8dd406c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd4159f20 0x7f8dd40c6fa0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 --2- 172.21.15.130:0/3312066620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8dd40b1d20 0x7f8dd41f5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3312066620 >> 172.21.15.130:0/3312066620 conn(0x7f8dd4065990 msgr2=0x7f8dd406b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:44.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3312066620 shutdown_connections 2023-09-13T06:07:44.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.600+0000 7f8ddc49e640 1 -- 172.21.15.130:0/3312066620 wait complete. 2023-09-13T06:07:44.622 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2023-09-13T06:07:42.614571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6913,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555586,"statfs":{"total":1600000000,"available":1592920273,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.091051"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.523662+0000","last_change":"2023-09-13T06:07:38.523662+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.523662+0000","last_undegraded":"2023-09-13T06:07:38.523662+0000","last_fullsized":"2023-09-13T06:07:38.523662+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.526238+0000","last_change":"2023-09-13T06:07:38.526238+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.526238+0000","last_undegraded":"2023-09-13T06:07:38.526238+0000","last_fullsized":"2023-09-13T06:07:38.526238+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.527497+0000","last_change":"2023-09-13T06:07:38.527497+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.527497+0000","last_undegraded":"2023-09-13T06:07:38.527497+0000","last_fullsized":"2023-09-13T06:07:38.527497+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.527389+0000","last_change":"2023-09-13T06:07:38.527389+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.527389+0000","last_undegraded":"2023-09-13T06:07:38.527389+0000","last_fullsized":"2023-09-13T06:07:38.527389+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.524431+0000","last_change":"2023-09-13T06:07:38.524431+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.524431+0000","last_undegraded":"2023-09-13T06:07:38.524431+0000","last_fullsized":"2023-09-13T06:07:38.524431+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.526610+0000","last_change":"2023-09-13T06:07:38.526610+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.526610+0000","last_undegraded":"2023-09-13T06:07:38.526610+0000","last_fullsized":"2023-09-13T06:07:38.526610+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.524760+0000","last_change":"2023-09-13T06:07:38.524760+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.524760+0000","last_undegraded":"2023-09-13T06:07:38.524760+0000","last_fullsized":"2023-09-13T06:07:38.524760+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.525285+0000","last_change":"2023-09-13T06:07:38.525285+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.525285+0000","last_undegraded":"2023-09-13T06:07:38.525285+0000","last_fullsized":"2023-09-13T06:07:38.525285+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.526369+0000","last_change":"2023-09-13T06:07:38.526369+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.526369+0000","last_undegraded":"2023-09-13T06:07:38.526369+0000","last_fullsized":"2023-09-13T06:07:38.526369+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.527319+0000","last_change":"2023-09-13T06:07:38.527319+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.527319+0000","last_undegraded":"2023-09-13T06:07:38.527319+0000","last_fullsized":"2023-09-13T06:07:38.527319+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.525201+0000","last_change":"2023-09-13T06:07:38.525201+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.525201+0000","last_undegraded":"2023-09-13T06:07:38.525201+0000","last_fullsized":"2023-09-13T06:07:38.525201+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.526662+0000","last_change":"2023-09-13T06:07:38.526662+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.526662+0000","last_undegraded":"2023-09-13T06:07:38.526662+0000","last_fullsized":"2023-09-13T06:07:38.526662+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.525650+0000","last_change":"2023-09-13T06:07:38.525650+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.525650+0000","last_undegraded":"2023-09-13T06:07:38.525650+0000","last_fullsized":"2023-09-13T06:07:38.525650+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.527405+0000","last_change":"2023-09-13T06:07:38.527405+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.527405+0000","last_undegraded":"2023-09-13T06:07:38.527405+0000","last_fullsized":"2023-09-13T06:07:38.527405+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.527320+0000","last_change":"2023-09-13T06:07:38.527320+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.527320+0000","last_undegraded":"2023-09-13T06:07:38.527320+0000","last_fullsized":"2023-09-13T06:07:38.527320+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.526374+0000","last_change":"2023-09-13T06:07:38.526374+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.526374+0000","last_undegraded":"2023-09-13T06:07:38.526374+0000","last_fullsized":"2023-09-13T06:07:38.526374+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.526675+0000","last_change":"2023-09-13T06:07:38.526675+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.526675+0000","last_undegraded":"2023-09-13T06:07:38.526675+0000","last_fullsized":"2023-09-13T06:07:38.526675+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.527002+0000","last_change":"2023-09-13T06:07:38.527002+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.527002+0000","last_undegraded":"2023-09-13T06:07:38.527002+0000","last_fullsized":"2023-09-13T06:07:38.527002+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.523768+0000","last_change":"2023-09-13T06:07:38.523768+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.523768+0000","last_undegraded":"2023-09-13T06:07:38.523768+0000","last_fullsized":"2023-09-13T06:07:38.523768+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.525496+0000","last_change":"2023-09-13T06:07:38.525496+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.525496+0000","last_undegraded":"2023-09-13T06:07:38.525496+0000","last_fullsized":"2023-09-13T06:07:38.525496+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.526376+0000","last_change":"2023-09-13T06:07:38.526376+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.526376+0000","last_undegraded":"2023-09-13T06:07:38.526376+0000","last_fullsized":"2023-09-13T06:07:38.526376+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.525240+0000","last_change":"2023-09-13T06:07:38.525240+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.525240+0000","last_undegraded":"2023-09-13T06:07:38.525240+0000","last_fullsized":"2023-09-13T06:07:38.525240+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.525202+0000","last_change":"2023-09-13T06:07:38.525202+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.525202+0000","last_undegraded":"2023-09-13T06:07:38.525202+0000","last_fullsized":"2023-09-13T06:07:38.525202+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.527047+0000","last_change":"2023-09-13T06:07:38.527047+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.527047+0000","last_undegraded":"2023-09-13T06:07:38.527047+0000","last_fullsized":"2023-09-13T06:07:38.527047+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.526623+0000","last_change":"2023-09-13T06:07:38.526623+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.526623+0000","last_undegraded":"2023-09-13T06:07:38.526623+0000","last_fullsized":"2023-09-13T06:07:38.526623+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.526085+0000","last_change":"2023-09-13T06:07:38.526085+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.526085+0000","last_undegraded":"2023-09-13T06:07:38.526085+0000","last_fullsized":"2023-09-13T06:07:38.526085+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.527595+0000","last_change":"2023-09-13T06:07:38.527595+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.527595+0000","last_undegraded":"2023-09-13T06:07:38.527595+0000","last_fullsized":"2023-09-13T06:07:38.527595+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.523690+0000","last_change":"2023-09-13T06:07:38.523690+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.523690+0000","last_undegraded":"2023-09-13T06:07:38.523690+0000","last_fullsized":"2023-09-13T06:07:38.523690+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.524684+0000","last_change":"2023-09-13T06:07:38.524684+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.524684+0000","last_undegraded":"2023-09-13T06:07:38.524684+0000","last_fullsized":"2023-09-13T06:07:38.524684+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.526966+0000","last_change":"2023-09-13T06:07:38.526966+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.526966+0000","last_undegraded":"2023-09-13T06:07:38.526966+0000","last_fullsized":"2023-09-13T06:07:38.526966+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.525215+0000","last_change":"2023-09-13T06:07:38.525215+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.525215+0000","last_undegraded":"2023-09-13T06:07:38.525215+0000","last_fullsized":"2023-09-13T06:07:38.525215+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-13T06:07:39.523287+0000","last_change":"2023-09-13T06:07:39.523287+0000","last_active":"2023-09-13T06:07:39.523287+0000","last_peered":"2023-09-13T06:07:39.523287+0000","last_clean":"2023-09-13T06:07:39.523287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:39.523287+0000","last_undegraded":"2023-09-13T06:07:39.523287+0000","last_fullsized":"2023-09-13T06:07:39.523287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-09-13T06:07:38.524122+0000","last_change":"2023-09-13T06:07:38.524122+0000","last_active":"2023-09-13T06:07:38.518208+0000","last_peered":"2023-09-13T06:07:38.518208+0000","last_clean":"2023-09-13T06:07:38.518208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-13T06:07:38.524122+0000","last_undegraded":"2023-09-13T06:07:38.524122+0000","last_fullsized":"2023-09-13T06:07:38.524122+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":293,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-09-13T06:07:36.516226+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:07:36.516226+0000","last_peered":"2023-09-13T06:07:36.516226+0000","last_clean":"2023-09-13T06:07:36.516226+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:07:36.516226+0000","last_undegraded":"2023-09-13T06:07:36.516226+0000","last_fullsized":"2023-09-13T06:07:36.516226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1297,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194015,"statfs":{"total":200000000,"available":198671626,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.52100000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98799999999999999,"5min":1.0189999999999999,"15min":1.3320000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.68999999999999995},"min":{"1min":0.47799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70299999999999996}]},{"osd":1,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.69599999999999995},"min":{"1min":0.501,"5min":0.44,"15min":0.44},"max":{"1min":0.875,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.53200000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94399999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.626}]},{"osd":2,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.45600000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.95399999999999996,"5min":1.016,"15min":1.395},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.53100000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90900000000000003,"5min":0.96899999999999997,"15min":1.2030000000000001},"last":0.71199999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93500000000000005,"5min":0.94599999999999995,"15min":1.357},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94399999999999995,"5min":1.0580000000000001,"15min":1.2629999999999999},"last":0.748}]},{"osd":4,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.32600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80300000000000005,"5min":0.89700000000000002,"15min":0.95899999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63800000000000001,"15min":0.66100000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.018},"last":0.51300000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.67400000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97999999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.69799999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.91500000000000004,"5min":0.98099999999999998,"15min":1.1319999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97199999999999998,"5min":1,"15min":1.0920000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67800000000000005,"15min":0.69199999999999995},"min":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194591,"statfs":{"total":200000000,"available":199261994,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68000000000000005,"15min":0.68799999999999994},"min":{"1min":0.48199999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.181},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.53600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91600000000000004,"5min":1.028,"15min":1.028},"last":0.82299999999999995}]},{"osd":1,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.94199999999999995,"5min":0.996,"15min":1.0840000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.58399999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98299999999999998,"5min":0.99299999999999999,"15min":1.153},"last":0.752}]},{"osd":2,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.59699999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96999999999999997,"5min":0.97399999999999998,"15min":1.4750000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.71699999999999997},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.872,"5min":1.085,"15min":1.085},"last":0.86599999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.499,"5min":0.495,"15min":0.495},"max":{"1min":0.93700000000000006,"5min":1.105,"15min":1.2030000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.526},"last":0.78400000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.439,"5min":0.315,"15min":0.315},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59699999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.42699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.84799999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.68700000000000006},"min":{"1min":0.45900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.92200000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77100000000000002,"15min":0.71899999999999997},"min":{"1min":0.47799999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71099999999999997,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88700000000000001,"5min":1.133,"15min":1.133},"last":0.89000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194591,"statfs":{"total":200000000,"available":199261994,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90300000000000002,"5min":0.95899999999999996,"15min":1.0389999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69799999999999995,"15min":0.66300000000000003},"min":{"1min":0.375,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.42699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92100000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59999999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.70899999999999996,"15min":0.69299999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94099999999999995,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.497,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.997,"15min":0.997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.73099999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65200000000000002,"15min":0.60699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.54800000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.67500000000000004},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.49099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90000000000000002,"5min":0.91400000000000003,"15min":0.94599999999999995},"last":0.76000000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69499999999999995,"15min":0.71799999999999997},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.503,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.024,"5min":1.026,"15min":1.026},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194591,"statfs":{"total":200000000,"available":199261994,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.437,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83299999999999996,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.82699999999999996}]},{"osd":1,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67800000000000005,"15min":0.66600000000000004},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.621},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.85199999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.92500000000000004,"15min":0.92700000000000005},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.55700000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.97699999999999998},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.48299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.052,"5min":1.077,"15min":1.077},"last":0.878},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.78900000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.49099999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.91200000000000003,"5min":0.97999999999999998,"15min":1.01},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.67400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97399999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.746}]},{"osd":6,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65300000000000002,"15min":0.64300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.98999999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70999999999999996,"15min":0.69199999999999995},"min":{"1min":0.46899999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.95199999999999996,"5min":1.123,"15min":1.123},"last":0.69799999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73299999999999998,"15min":0.71599999999999997},"min":{"1min":0.51600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0109999999999999,"5min":1.26,"15min":1.26},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0449999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.59099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":715,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194596,"statfs":{"total":200000000,"available":199267051,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40100000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":0.629,"15min":0.69099999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.35999999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.439,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.46100000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.377}]},{"osd":2,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.38700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.34200000000000003},"max":{"1min":0.71399999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.47799999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91700000000000004,"5min":1.284,"15min":1.284},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90100000000000002,"5min":1.044,"15min":1.044},"last":0.55100000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.54700000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.97099999999999997,"5min":1.042,"15min":1.111},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70899999999999996,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98699999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73299999999999998,"15min":0.72999999999999998},"min":{"1min":0.56699999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.034,"5min":1.097,"15min":1.097},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":0.94099999999999995,"5min":0.998,"15min":1.458},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.74199999999999999,"15min":0.77100000000000002},"min":{"1min":0.57599999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94099999999999995,"5min":1.383,"15min":1.383},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.76100000000000001},"min":{"1min":0.53900000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.95799999999999996,"5min":1.0800000000000001,"15min":1.27},"last":0.622}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194591,"statfs":{"total":200000000,"available":199261994,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.46999999999999997,"15min":0.40899999999999997},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53300000000000003,"5min":10.401,"15min":10.401},"last":0.312},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.46999999999999997,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52500000000000002,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":0.439}]},{"osd":1,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.48799999999999999,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66600000000000004,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.50900000000000001,"15min":0.46800000000000003},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67300000000000004,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.47699999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.55000000000000004,"15min":0.52000000000000002},"min":{"1min":0.33300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.56200000000000006,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58799999999999997,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.40300000000000002,"15min":0.38600000000000001},"max":{"1min":0.60799999999999998,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":0.502}]},{"osd":4,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77800000000000002,"15min":0.76700000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95699999999999996,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93500000000000005,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.60299999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88100000000000001,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.623},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79400000000000004,"15min":0.79100000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.91800000000000004,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.58299999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.72999999999999998},"min":{"1min":0.45500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94299999999999995,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73699999999999999,"15min":0.72599999999999998},"min":{"1min":0.48299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93700000000000006,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.65300000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.749,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99299999999999999,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96799999999999997,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.67300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194591,"statfs":{"total":200000000,"available":199261994,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45300000000000001,"15min":0.436},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.64800000000000002,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46500000000000002,"15min":0.45000000000000001},"min":{"1min":0.314,"5min":0.28899999999999998,"15min":0.27300000000000002},"max":{"1min":0.63,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47799999999999998,"15min":0.46000000000000002},"min":{"1min":0.34100000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60999999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.497,"15min":0.46500000000000002},"min":{"1min":0.36199999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.59999999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.439}]},{"osd":3,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54200000000000004,"15min":0.52500000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.379},"max":{"1min":0.65800000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.51700000000000002,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.58799999999999997,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.41599999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.54300000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.99099999999999999,"5min":1.089,"15min":1.089},"last":0.749},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72199999999999998,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90200000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.92200000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71899999999999997,"15min":0.753},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85799999999999998,"5min":1.1000000000000001,"15min":1.109},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.74399999999999999},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92000000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95399999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97599999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96599999999999997,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.82699999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55500000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0209999999999999,"5min":1.0369999999999999,"15min":1.0669999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93600000000000005,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1297,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194015,"statfs":{"total":200000000,"available":198671626,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.28799999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65800000000000003,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.499,"15min":0.47599999999999998},"min":{"1min":0.32100000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89800000000000002,"5min":2.294,"15min":2.294},"last":0.58799999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.497},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76100000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.33700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63700000000000001,"5min":2.056,"15min":2.056},"last":0.46600000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65200000000000002,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83599999999999997,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0049999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.748,"15min":0.78400000000000003},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.0840000000000001,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.76600000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0389999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.51400000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94899999999999995,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.93200000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.054,"5min":2.415,"15min":2.415},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.76100000000000001,"15min":0.77300000000000002},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98399999999999999,"5min":2.347,"15min":2.347},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":2.367,"15min":2.367},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.60499999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0429999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.82099999999999995}]}]}],"pool_statfs":[]}} 2023-09-13T06:07:44.629 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:07:44.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd681ccb640 1 Processor -- start 2023-09-13T06:07:44.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd681ccb640 1 -- start start 2023-09-13T06:07:44.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd681ccb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd67c0d1750 0x7fd67c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd681ccb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd67c146f30 0x7fd67c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd681ccb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c0b63c0 con 0x7fd67c0d1090 2023-09-13T06:07:44.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd681ccb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c15dea0 con 0x7fd67c0d1750 2023-09-13T06:07:44.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd681ccb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c0d0c20 con 0x7fd67c146f30 2023-09-13T06:07:44.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd67b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd67c0d1750 0x7fd67c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd67b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd67c0d1750 0x7fd67c15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44410/0 (socket says 172.21.15.130:44410) 2023-09-13T06:07:44.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd67b7fe640 1 -- 172.21.15.130:0/4273627814 learned_addr learned my addr 172.21.15.130:0/4273627814 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:44.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd67bfff640 1 --2- 172.21.15.130:0/4273627814 >> v2:172.21.15.164:3300/0 conn(0x7fd67c146f30 0x7fd67c0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd67b7fe640 1 -- 172.21.15.130:0/4273627814 >> v2:172.21.15.164:3300/0 conn(0x7fd67c146f30 msgr2=0x7fd67c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:44.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd67b7fe640 1 --2- 172.21.15.130:0/4273627814 >> v2:172.21.15.164:3300/0 conn(0x7fd67c146f30 0x7fd67c0b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd67b7fe640 1 -- 172.21.15.130:0/4273627814 >> v1:172.21.15.164:6789/0 conn(0x7fd67c0d1090 legacy=0x7fd67c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.804+0000 7fd67b7fe640 1 -- 172.21.15.130:0/4273627814 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c0b6610 con 0x7fd67c0d1750 2023-09-13T06:07:44.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd67b7fe640 1 --2- 172.21.15.130:0/4273627814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd67c0d1750 0x7fd67c15d960 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0d2c80 tx=0x7fd66c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57a063326754f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:44.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd67a7fc640 1 -- 172.21.15.130:0/4273627814 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0ab640 con 0x7fd67c0d1750 2023-09-13T06:07:44.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd67a7fc640 1 -- 172.21.15.130:0/4273627814 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c0a7070 con 0x7fd67c0d1750 2023-09-13T06:07:44.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd67a7fc640 1 -- 172.21.15.130:0/4273627814 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0ab9c0 con 0x7fd67c0d1750 2023-09-13T06:07:44.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd681ccb640 1 -- 172.21.15.130:0/4273627814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd67c0d1750 msgr2=0x7fd67c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd681ccb640 1 --2- 172.21.15.130:0/4273627814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd67c0d1750 0x7fd67c15d960 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0d2c80 tx=0x7fd66c01c440 comp rx=0 tx=0).stop 2023-09-13T06:07:44.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd681ccb640 1 -- 172.21.15.130:0/4273627814 shutdown_connections 2023-09-13T06:07:44.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd681ccb640 1 --2- 172.21.15.130:0/4273627814 >> v2:172.21.15.164:3300/0 conn(0x7fd67c146f30 0x7fd67c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd681ccb640 1 --2- 172.21.15.130:0/4273627814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd67c0d1750 0x7fd67c15d960 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd681ccb640 1 -- 172.21.15.130:0/4273627814 >> 172.21.15.130:0/4273627814 conn(0x7fd67c06f170 msgr2=0x7fd67c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:44.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd681ccb640 1 -- 172.21.15.130:0/4273627814 shutdown_connections 2023-09-13T06:07:44.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.808+0000 7fd681ccb640 1 -- 172.21.15.130:0/4273627814 wait complete. 2023-09-13T06:07:44.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd681ccb640 1 Processor -- start 2023-09-13T06:07:44.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd681ccb640 1 -- start start 2023-09-13T06:07:44.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd681ccb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd67c0d1090 0x7fd67c163460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd681ccb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd67c0d1750 0x7fd67c167080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd681ccb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd67c146f30 0x7fd67c15cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd681ccb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c1675c0 con 0x7fd67c146f30 2023-09-13T06:07:44.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd681ccb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c168100 con 0x7fd67c0d1090 2023-09-13T06:07:44.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd681ccb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c167860 con 0x7fd67c0d1750 2023-09-13T06:07:44.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd67bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd67c146f30 0x7fd67c15cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd67bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd67c146f30 0x7fd67c15cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44416/0 (socket says 172.21.15.130:44416) 2023-09-13T06:07:44.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd67bfff640 1 -- 172.21.15.130:0/3582672678 learned_addr learned my addr 172.21.15.130:0/3582672678 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:44.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd67b7fe640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd67c0d1090 0x7fd67c163460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd67affd640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd67c0d1750 0x7fd67c167080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd67bfff640 1 -- 172.21.15.130:0/3582672678 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd67c0d1750 msgr2=0x7fd67c167080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd67bfff640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd67c0d1750 0x7fd67c167080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd67bfff640 1 -- 172.21.15.130:0/3582672678 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd67c0d1090 msgr2=0x7fd67c163460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd67bfff640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd67c0d1090 0x7fd67c163460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd67bfff640 1 -- 172.21.15.130:0/3582672678 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c0094d0 con 0x7fd67c146f30 2023-09-13T06:07:44.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd67bfff640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd67c146f30 0x7fd67c15cdf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fd67400efc0 tx=0x7fd67400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:44.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd663fff640 1 -- 172.21.15.130:0/3582672678 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674009ba0 con 0x7fd67c146f30 2023-09-13T06:07:44.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd663fff640 1 -- 172.21.15.130:0/3582672678 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67400f040 con 0x7fd67c146f30 2023-09-13T06:07:44.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd663fff640 1 -- 172.21.15.130:0/3582672678 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6740146c0 con 0x7fd67c146f30 2023-09-13T06:07:44.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd681ccb640 1 -- 172.21.15.130:0/3582672678 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c0b7e40 con 0x7fd67c146f30 2023-09-13T06:07:44.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd681ccb640 1 -- 172.21.15.130:0/3582672678 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c167e20 con 0x7fd67c146f30 2023-09-13T06:07:44.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.812+0000 7fd681ccb640 1 -- 172.21.15.130:0/3582672678 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67c0618a0 con 0x7fd67c146f30 2023-09-13T06:07:44.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.816+0000 7fd663fff640 1 -- 172.21.15.130:0/3582672678 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd674014820 con 0x7fd67c146f30 2023-09-13T06:07:44.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.816+0000 7fd663fff640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd668065b20 0x7fd668067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:44.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.816+0000 7fd663fff640 1 -- 172.21.15.130:0/3582672678 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd674083d00 con 0x7fd67c146f30 2023-09-13T06:07:44.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.816+0000 7fd67b7fe640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd668065b20 0x7fd668067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:44.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.816+0000 7fd67b7fe640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd668065b20 0x7fd668067fe0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0af000 tx=0x7fd66c0b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:44.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.820+0000 7fd663fff640 1 -- 172.21.15.130:0/3582672678 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd6740516f0 con 0x7fd67c146f30 2023-09-13T06:07:44.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.968+0000 7fd681ccb640 1 -- 172.21.15.130:0/3582672678 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd67c16a320 con 0x7fd668065b20 2023-09-13T06:07:44.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.972+0000 7fd663fff640 1 -- 172.21.15.130:0/3582672678 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285261 (secure 0 0 0) 0x7fd66c0ab760 con 0x7fd668065b20 2023-09-13T06:07:44.979 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:44.980 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:07:44.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 -- 172.21.15.130:0/3582672678 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd668065b20 msgr2=0x7fd668067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd668065b20 0x7fd668067fe0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0af000 tx=0x7fd66c0b6040 comp rx=0 tx=0).stop 2023-09-13T06:07:44.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 -- 172.21.15.130:0/3582672678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd67c146f30 msgr2=0x7fd67c15cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:44.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd67c146f30 0x7fd67c15cdf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fd67400efc0 tx=0x7fd67400c490 comp rx=0 tx=0).stop 2023-09-13T06:07:44.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 -- 172.21.15.130:0/3582672678 shutdown_connections 2023-09-13T06:07:44.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd668065b20 0x7fd668067fe0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd67c146f30 0x7fd67c15cdf0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd67c0d1750 0x7fd67c167080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 --2- 172.21.15.130:0/3582672678 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd67c0d1090 0x7fd67c163460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:44.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 -- 172.21.15.130:0/3582672678 >> 172.21.15.130:0/3582672678 conn(0x7fd67c06f170 msgr2=0x7fd67c145d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:44.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 -- 172.21.15.130:0/3582672678 shutdown_connections 2023-09-13T06:07:44.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:44.976+0000 7fd681ccb640 1 -- 172.21.15.130:0/3582672678 wait complete. 2023-09-13T06:07:44.999 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2023-09-13T06:07:44.614909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7120,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555379,"statfs":{"total":1600000000,"available":1592709060,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001011"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953614+0000","last_change":"2023-09-13T06:07:40.549787+0000","last_active":"2023-09-13T06:07:41.953614+0000","last_peered":"2023-09-13T06:07:41.953614+0000","last_clean":"2023-09-13T06:07:41.953614+0000","last_became_active":"2023-09-13T06:07:40.549467+0000","last_became_peered":"2023-09-13T06:07:40.549467+0000","last_unstale":"2023-09-13T06:07:41.953614+0000","last_undegraded":"2023-09-13T06:07:41.953614+0000","last_fullsized":"2023-09-13T06:07:41.953614+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:19:44.428625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.781694+0000","last_change":"2023-09-13T06:07:40.546562+0000","last_active":"2023-09-13T06:07:41.781694+0000","last_peered":"2023-09-13T06:07:41.781694+0000","last_clean":"2023-09-13T06:07:41.781694+0000","last_became_active":"2023-09-13T06:07:40.546063+0000","last_became_peered":"2023-09-13T06:07:40.546063+0000","last_unstale":"2023-09-13T06:07:41.781694+0000","last_undegraded":"2023-09-13T06:07:41.781694+0000","last_fullsized":"2023-09-13T06:07:41.781694+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:34:00.612271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.543240+0000","last_change":"2023-09-13T06:07:40.543865+0000","last_active":"2023-09-13T06:07:41.543240+0000","last_peered":"2023-09-13T06:07:41.543240+0000","last_clean":"2023-09-13T06:07:41.543240+0000","last_became_active":"2023-09-13T06:07:40.543550+0000","last_became_peered":"2023-09-13T06:07:40.543550+0000","last_unstale":"2023-09-13T06:07:41.543240+0000","last_undegraded":"2023-09-13T06:07:41.543240+0000","last_fullsized":"2023-09-13T06:07:41.543240+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:32:35.009425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953215+0000","last_change":"2023-09-13T06:07:40.545061+0000","last_active":"2023-09-13T06:07:41.953215+0000","last_peered":"2023-09-13T06:07:41.953215+0000","last_clean":"2023-09-13T06:07:41.953215+0000","last_became_active":"2023-09-13T06:07:40.544555+0000","last_became_peered":"2023-09-13T06:07:40.544555+0000","last_unstale":"2023-09-13T06:07:41.953215+0000","last_undegraded":"2023-09-13T06:07:41.953215+0000","last_fullsized":"2023-09-13T06:07:41.953215+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:40:00.479648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953048+0000","last_change":"2023-09-13T06:07:40.549572+0000","last_active":"2023-09-13T06:07:41.953048+0000","last_peered":"2023-09-13T06:07:41.953048+0000","last_clean":"2023-09-13T06:07:41.953048+0000","last_became_active":"2023-09-13T06:07:40.549327+0000","last_became_peered":"2023-09-13T06:07:40.549327+0000","last_unstale":"2023-09-13T06:07:41.953048+0000","last_undegraded":"2023-09-13T06:07:41.953048+0000","last_fullsized":"2023-09-13T06:07:41.953048+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:55:05.382866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542339+0000","last_change":"2023-09-13T06:07:40.552171+0000","last_active":"2023-09-13T06:07:41.542339+0000","last_peered":"2023-09-13T06:07:41.542339+0000","last_clean":"2023-09-13T06:07:41.542339+0000","last_became_active":"2023-09-13T06:07:40.551604+0000","last_became_peered":"2023-09-13T06:07:40.551604+0000","last_unstale":"2023-09-13T06:07:41.542339+0000","last_undegraded":"2023-09-13T06:07:41.542339+0000","last_fullsized":"2023-09-13T06:07:41.542339+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:40:10.828928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542648+0000","last_change":"2023-09-13T06:07:40.548579+0000","last_active":"2023-09-13T06:07:41.542648+0000","last_peered":"2023-09-13T06:07:41.542648+0000","last_clean":"2023-09-13T06:07:41.542648+0000","last_became_active":"2023-09-13T06:07:40.548128+0000","last_became_peered":"2023-09-13T06:07:40.548128+0000","last_unstale":"2023-09-13T06:07:41.542648+0000","last_undegraded":"2023-09-13T06:07:41.542648+0000","last_fullsized":"2023-09-13T06:07:41.542648+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:30.597412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.543472+0000","last_change":"2023-09-13T06:07:40.546012+0000","last_active":"2023-09-13T06:07:41.543472+0000","last_peered":"2023-09-13T06:07:41.543472+0000","last_clean":"2023-09-13T06:07:41.543472+0000","last_became_active":"2023-09-13T06:07:40.545780+0000","last_became_peered":"2023-09-13T06:07:40.545780+0000","last_unstale":"2023-09-13T06:07:41.543472+0000","last_undegraded":"2023-09-13T06:07:41.543472+0000","last_fullsized":"2023-09-13T06:07:41.543472+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:43:58.929036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953342+0000","last_change":"2023-09-13T06:07:40.545197+0000","last_active":"2023-09-13T06:07:41.953342+0000","last_peered":"2023-09-13T06:07:41.953342+0000","last_clean":"2023-09-13T06:07:41.953342+0000","last_became_active":"2023-09-13T06:07:40.544845+0000","last_became_peered":"2023-09-13T06:07:40.544845+0000","last_unstale":"2023-09-13T06:07:41.953342+0000","last_undegraded":"2023-09-13T06:07:41.953342+0000","last_fullsized":"2023-09-13T06:07:41.953342+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:59:20.229551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953763+0000","last_change":"2023-09-13T06:07:40.550419+0000","last_active":"2023-09-13T06:07:41.953763+0000","last_peered":"2023-09-13T06:07:41.953763+0000","last_clean":"2023-09-13T06:07:41.953763+0000","last_became_active":"2023-09-13T06:07:40.550020+0000","last_became_peered":"2023-09-13T06:07:40.550020+0000","last_unstale":"2023-09-13T06:07:41.953763+0000","last_undegraded":"2023-09-13T06:07:41.953763+0000","last_fullsized":"2023-09-13T06:07:41.953763+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:53:21.124278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.781547+0000","last_change":"2023-09-13T06:07:40.548725+0000","last_active":"2023-09-13T06:07:41.781547+0000","last_peered":"2023-09-13T06:07:41.781547+0000","last_clean":"2023-09-13T06:07:41.781547+0000","last_became_active":"2023-09-13T06:07:40.548472+0000","last_became_peered":"2023-09-13T06:07:40.548472+0000","last_unstale":"2023-09-13T06:07:41.781547+0000","last_undegraded":"2023-09-13T06:07:41.781547+0000","last_fullsized":"2023-09-13T06:07:41.781547+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:48:11.917495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953655+0000","last_change":"2023-09-13T06:07:40.553164+0000","last_active":"2023-09-13T06:07:41.953655+0000","last_peered":"2023-09-13T06:07:41.953655+0000","last_clean":"2023-09-13T06:07:41.953655+0000","last_became_active":"2023-09-13T06:07:40.552933+0000","last_became_peered":"2023-09-13T06:07:40.552933+0000","last_unstale":"2023-09-13T06:07:41.953655+0000","last_undegraded":"2023-09-13T06:07:41.953655+0000","last_fullsized":"2023-09-13T06:07:41.953655+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:54:11.460653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.543361+0000","last_change":"2023-09-13T06:07:40.550615+0000","last_active":"2023-09-13T06:07:41.543361+0000","last_peered":"2023-09-13T06:07:41.543361+0000","last_clean":"2023-09-13T06:07:41.543361+0000","last_became_active":"2023-09-13T06:07:40.550376+0000","last_became_peered":"2023-09-13T06:07:40.550376+0000","last_unstale":"2023-09-13T06:07:41.543361+0000","last_undegraded":"2023-09-13T06:07:41.543361+0000","last_fullsized":"2023-09-13T06:07:41.543361+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:29:03.326990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542366+0000","last_change":"2023-09-13T06:07:40.554175+0000","last_active":"2023-09-13T06:07:41.542366+0000","last_peered":"2023-09-13T06:07:41.542366+0000","last_clean":"2023-09-13T06:07:41.542366+0000","last_became_active":"2023-09-13T06:07:40.553652+0000","last_became_peered":"2023-09-13T06:07:40.553652+0000","last_unstale":"2023-09-13T06:07:41.542366+0000","last_undegraded":"2023-09-13T06:07:41.542366+0000","last_fullsized":"2023-09-13T06:07:41.542366+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:05.047684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542624+0000","last_change":"2023-09-13T06:07:40.551623+0000","last_active":"2023-09-13T06:07:41.542624+0000","last_peered":"2023-09-13T06:07:41.542624+0000","last_clean":"2023-09-13T06:07:41.542624+0000","last_became_active":"2023-09-13T06:07:40.551358+0000","last_became_peered":"2023-09-13T06:07:40.551358+0000","last_unstale":"2023-09-13T06:07:41.542624+0000","last_undegraded":"2023-09-13T06:07:41.542624+0000","last_fullsized":"2023-09-13T06:07:41.542624+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:01:49.813909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953765+0000","last_change":"2023-09-13T06:07:40.548993+0000","last_active":"2023-09-13T06:07:41.953765+0000","last_peered":"2023-09-13T06:07:41.953765+0000","last_clean":"2023-09-13T06:07:41.953765+0000","last_became_active":"2023-09-13T06:07:40.548727+0000","last_became_peered":"2023-09-13T06:07:40.548727+0000","last_unstale":"2023-09-13T06:07:41.953765+0000","last_undegraded":"2023-09-13T06:07:41.953765+0000","last_fullsized":"2023-09-13T06:07:41.953765+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:21:26.465724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.781861+0000","last_change":"2023-09-13T06:07:40.550474+0000","last_active":"2023-09-13T06:07:41.781861+0000","last_peered":"2023-09-13T06:07:41.781861+0000","last_clean":"2023-09-13T06:07:41.781861+0000","last_became_active":"2023-09-13T06:07:40.549574+0000","last_became_peered":"2023-09-13T06:07:40.549574+0000","last_unstale":"2023-09-13T06:07:41.781861+0000","last_undegraded":"2023-09-13T06:07:41.781861+0000","last_fullsized":"2023-09-13T06:07:41.781861+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:17.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.703564+0000","last_change":"2023-09-13T06:07:40.553010+0000","last_active":"2023-09-13T06:07:41.703564+0000","last_peered":"2023-09-13T06:07:41.703564+0000","last_clean":"2023-09-13T06:07:41.703564+0000","last_became_active":"2023-09-13T06:07:40.551718+0000","last_became_peered":"2023-09-13T06:07:40.551718+0000","last_unstale":"2023-09-13T06:07:41.703564+0000","last_undegraded":"2023-09-13T06:07:41.703564+0000","last_fullsized":"2023-09-13T06:07:41.703564+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:13:59.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542493+0000","last_change":"2023-09-13T06:07:40.551090+0000","last_active":"2023-09-13T06:07:41.542493+0000","last_peered":"2023-09-13T06:07:41.542493+0000","last_clean":"2023-09-13T06:07:41.542493+0000","last_became_active":"2023-09-13T06:07:40.550858+0000","last_became_peered":"2023-09-13T06:07:40.550858+0000","last_unstale":"2023-09-13T06:07:41.542493+0000","last_undegraded":"2023-09-13T06:07:41.542493+0000","last_fullsized":"2023-09-13T06:07:41.542493+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:13:59.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.781663+0000","last_change":"2023-09-13T06:07:40.543493+0000","last_active":"2023-09-13T06:07:41.781663+0000","last_peered":"2023-09-13T06:07:41.781663+0000","last_clean":"2023-09-13T06:07:41.781663+0000","last_became_active":"2023-09-13T06:07:40.543248+0000","last_became_peered":"2023-09-13T06:07:40.543248+0000","last_unstale":"2023-09-13T06:07:41.781663+0000","last_undegraded":"2023-09-13T06:07:41.781663+0000","last_fullsized":"2023-09-13T06:07:41.781663+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:17.678437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.781858+0000","last_change":"2023-09-13T06:07:40.543519+0000","last_active":"2023-09-13T06:07:41.781858+0000","last_peered":"2023-09-13T06:07:41.781858+0000","last_clean":"2023-09-13T06:07:41.781858+0000","last_became_active":"2023-09-13T06:07:40.543260+0000","last_became_peered":"2023-09-13T06:07:40.543260+0000","last_unstale":"2023-09-13T06:07:41.781858+0000","last_undegraded":"2023-09-13T06:07:41.781858+0000","last_fullsized":"2023-09-13T06:07:41.781858+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:11.309095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.854900+0000","last_change":"2023-09-13T06:07:40.551903+0000","last_active":"2023-09-13T06:07:41.854900+0000","last_peered":"2023-09-13T06:07:41.854900+0000","last_clean":"2023-09-13T06:07:41.854900+0000","last_became_active":"2023-09-13T06:07:40.551666+0000","last_became_peered":"2023-09-13T06:07:40.551666+0000","last_unstale":"2023-09-13T06:07:41.854900+0000","last_undegraded":"2023-09-13T06:07:41.854900+0000","last_fullsized":"2023-09-13T06:07:41.854900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:01:51.900518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.781652+0000","last_change":"2023-09-13T06:07:40.548858+0000","last_active":"2023-09-13T06:07:41.781652+0000","last_peered":"2023-09-13T06:07:41.781652+0000","last_clean":"2023-09-13T06:07:41.781652+0000","last_became_active":"2023-09-13T06:07:40.547886+0000","last_became_peered":"2023-09-13T06:07:40.547886+0000","last_unstale":"2023-09-13T06:07:41.781652+0000","last_undegraded":"2023-09-13T06:07:41.781652+0000","last_fullsized":"2023-09-13T06:07:41.781652+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:39:28.037559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.855146+0000","last_change":"2023-09-13T06:07:40.544504+0000","last_active":"2023-09-13T06:07:41.855146+0000","last_peered":"2023-09-13T06:07:41.855146+0000","last_clean":"2023-09-13T06:07:41.855146+0000","last_became_active":"2023-09-13T06:07:40.544291+0000","last_became_peered":"2023-09-13T06:07:40.544291+0000","last_unstale":"2023-09-13T06:07:41.855146+0000","last_undegraded":"2023-09-13T06:07:41.855146+0000","last_fullsized":"2023-09-13T06:07:41.855146+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:17.678437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.781813+0000","last_change":"2023-09-13T06:07:40.549726+0000","last_active":"2023-09-13T06:07:41.781813+0000","last_peered":"2023-09-13T06:07:41.781813+0000","last_clean":"2023-09-13T06:07:41.781813+0000","last_became_active":"2023-09-13T06:07:40.548663+0000","last_became_peered":"2023-09-13T06:07:40.548663+0000","last_unstale":"2023-09-13T06:07:41.781813+0000","last_undegraded":"2023-09-13T06:07:41.781813+0000","last_fullsized":"2023-09-13T06:07:41.781813+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:13:59.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953922+0000","last_change":"2023-09-13T06:07:40.546882+0000","last_active":"2023-09-13T06:07:41.953922+0000","last_peered":"2023-09-13T06:07:41.953922+0000","last_clean":"2023-09-13T06:07:41.953922+0000","last_became_active":"2023-09-13T06:07:40.546492+0000","last_became_peered":"2023-09-13T06:07:40.546492+0000","last_unstale":"2023-09-13T06:07:41.953922+0000","last_undegraded":"2023-09-13T06:07:41.953922+0000","last_fullsized":"2023-09-13T06:07:41.953922+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:59:30.115069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542254+0000","last_change":"2023-09-13T06:07:40.545289+0000","last_active":"2023-09-13T06:07:41.542254+0000","last_peered":"2023-09-13T06:07:41.542254+0000","last_clean":"2023-09-13T06:07:41.542254+0000","last_became_active":"2023-09-13T06:07:40.545069+0000","last_became_peered":"2023-09-13T06:07:40.545069+0000","last_unstale":"2023-09-13T06:07:41.542254+0000","last_undegraded":"2023-09-13T06:07:41.542254+0000","last_fullsized":"2023-09-13T06:07:41.542254+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:35:38.248359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.854955+0000","last_change":"2023-09-13T06:07:40.546803+0000","last_active":"2023-09-13T06:07:41.854955+0000","last_peered":"2023-09-13T06:07:41.854955+0000","last_clean":"2023-09-13T06:07:41.854955+0000","last_became_active":"2023-09-13T06:07:40.546474+0000","last_became_peered":"2023-09-13T06:07:40.546474+0000","last_unstale":"2023-09-13T06:07:41.854955+0000","last_undegraded":"2023-09-13T06:07:41.854955+0000","last_fullsized":"2023-09-13T06:07:41.854955+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:21.411637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.781716+0000","last_change":"2023-09-13T06:07:40.548401+0000","last_active":"2023-09-13T06:07:41.781716+0000","last_peered":"2023-09-13T06:07:41.781716+0000","last_clean":"2023-09-13T06:07:41.781716+0000","last_became_active":"2023-09-13T06:07:40.548085+0000","last_became_peered":"2023-09-13T06:07:40.548085+0000","last_unstale":"2023-09-13T06:07:41.781716+0000","last_undegraded":"2023-09-13T06:07:41.781716+0000","last_fullsized":"2023-09-13T06:07:41.781716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:05.047684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542280+0000","last_change":"2023-09-13T06:07:40.538735+0000","last_active":"2023-09-13T06:07:41.542280+0000","last_peered":"2023-09-13T06:07:41.542280+0000","last_clean":"2023-09-13T06:07:41.542280+0000","last_became_active":"2023-09-13T06:07:40.538498+0000","last_became_peered":"2023-09-13T06:07:40.538498+0000","last_unstale":"2023-09-13T06:07:41.542280+0000","last_undegraded":"2023-09-13T06:07:41.542280+0000","last_fullsized":"2023-09-13T06:07:41.542280+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:03:30.440507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.954019+0000","last_change":"2023-09-13T06:07:40.546728+0000","last_active":"2023-09-13T06:07:41.954019+0000","last_peered":"2023-09-13T06:07:41.954019+0000","last_clean":"2023-09-13T06:07:41.954019+0000","last_became_active":"2023-09-13T06:07:40.546195+0000","last_became_peered":"2023-09-13T06:07:40.546195+0000","last_unstale":"2023-09-13T06:07:41.954019+0000","last_undegraded":"2023-09-13T06:07:41.954019+0000","last_fullsized":"2023-09-13T06:07:41.954019+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:28:19.948916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542412+0000","last_change":"2023-09-13T06:07:40.552396+0000","last_active":"2023-09-13T06:07:41.542412+0000","last_peered":"2023-09-13T06:07:41.542412+0000","last_clean":"2023-09-13T06:07:41.542412+0000","last_became_active":"2023-09-13T06:07:40.552132+0000","last_became_peered":"2023-09-13T06:07:40.552132+0000","last_unstale":"2023-09-13T06:07:41.542412+0000","last_undegraded":"2023-09-13T06:07:41.542412+0000","last_fullsized":"2023-09-13T06:07:41.542412+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:59:30.625734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542149+0000","last_change":"2023-09-13T06:07:40.550987+0000","last_active":"2023-09-13T06:07:41.542149+0000","last_peered":"2023-09-13T06:07:41.542149+0000","last_clean":"2023-09-13T06:07:41.542149+0000","last_became_active":"2023-09-13T06:07:40.550714+0000","last_became_peered":"2023-09-13T06:07:40.550714+0000","last_unstale":"2023-09-13T06:07:41.542149+0000","last_undegraded":"2023-09-13T06:07:41.542149+0000","last_fullsized":"2023-09-13T06:07:41.542149+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:48:33.138433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"136'4","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.563482+0000","last_change":"2023-09-13T06:07:39.542487+0000","last_active":"2023-09-13T06:07:40.563482+0000","last_peered":"2023-09-13T06:07:40.563482+0000","last_clean":"2023-09-13T06:07:40.563482+0000","last_became_active":"2023-09-13T06:07:39.542229+0000","last_became_peered":"2023-09-13T06:07:39.542229+0000","last_unstale":"2023-09-13T06:07:40.563482+0000","last_undegraded":"2023-09-13T06:07:40.563482+0000","last_fullsized":"2023-09-13T06:07:40.563482+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:46:03.865403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.703693+0000","last_change":"2023-09-13T06:07:40.553395+0000","last_active":"2023-09-13T06:07:41.703693+0000","last_peered":"2023-09-13T06:07:41.703693+0000","last_clean":"2023-09-13T06:07:41.703693+0000","last_became_active":"2023-09-13T06:07:40.552708+0000","last_became_peered":"2023-09-13T06:07:40.552708+0000","last_unstale":"2023-09-13T06:07:41.703693+0000","last_undegraded":"2023-09-13T06:07:41.703693+0000","last_fullsized":"2023-09-13T06:07:41.703693+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:11.309095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"136'1","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.563222+0000","last_change":"2023-09-13T06:07:39.547061+0000","last_active":"2023-09-13T06:07:40.563222+0000","last_peered":"2023-09-13T06:07:40.563222+0000","last_clean":"2023-09-13T06:07:40.563222+0000","last_became_active":"2023-09-13T06:07:39.546390+0000","last_became_peered":"2023-09-13T06:07:39.546390+0000","last_unstale":"2023-09-13T06:07:40.563222+0000","last_undegraded":"2023-09-13T06:07:40.563222+0000","last_fullsized":"2023-09-13T06:07:40.563222+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:16.673358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542411+0000","last_change":"2023-09-13T06:07:40.552318+0000","last_active":"2023-09-13T06:07:41.542411+0000","last_peered":"2023-09-13T06:07:41.542411+0000","last_clean":"2023-09-13T06:07:41.542411+0000","last_became_active":"2023-09-13T06:07:40.551938+0000","last_became_peered":"2023-09-13T06:07:40.551938+0000","last_unstale":"2023-09-13T06:07:41.542411+0000","last_undegraded":"2023-09-13T06:07:41.542411+0000","last_fullsized":"2023-09-13T06:07:41.542411+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:37:06.338702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"136'2","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.566238+0000","last_change":"2023-09-13T06:07:39.549359+0000","last_active":"2023-09-13T06:07:40.566238+0000","last_peered":"2023-09-13T06:07:40.566238+0000","last_clean":"2023-09-13T06:07:40.566238+0000","last_became_active":"2023-09-13T06:07:39.548833+0000","last_became_peered":"2023-09-13T06:07:39.548833+0000","last_unstale":"2023-09-13T06:07:40.566238+0000","last_undegraded":"2023-09-13T06:07:40.566238+0000","last_fullsized":"2023-09-13T06:07:40.566238+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:29:12.183811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.543329+0000","last_change":"2023-09-13T06:07:40.548226+0000","last_active":"2023-09-13T06:07:41.543329+0000","last_peered":"2023-09-13T06:07:41.543329+0000","last_clean":"2023-09-13T06:07:41.543329+0000","last_became_active":"2023-09-13T06:07:40.547752+0000","last_became_peered":"2023-09-13T06:07:40.547752+0000","last_unstale":"2023-09-13T06:07:41.543329+0000","last_undegraded":"2023-09-13T06:07:41.543329+0000","last_fullsized":"2023-09-13T06:07:41.543329+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:47:15.847357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"136'2","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.566601+0000","last_change":"2023-09-13T06:07:39.548781+0000","last_active":"2023-09-13T06:07:40.566601+0000","last_peered":"2023-09-13T06:07:40.566601+0000","last_clean":"2023-09-13T06:07:40.566601+0000","last_became_active":"2023-09-13T06:07:39.548424+0000","last_became_peered":"2023-09-13T06:07:39.548424+0000","last_unstale":"2023-09-13T06:07:40.566601+0000","last_undegraded":"2023-09-13T06:07:40.566601+0000","last_fullsized":"2023-09-13T06:07:40.566601+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:51:45.628409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953554+0000","last_change":"2023-09-13T06:07:40.550750+0000","last_active":"2023-09-13T06:07:41.953554+0000","last_peered":"2023-09-13T06:07:41.953554+0000","last_clean":"2023-09-13T06:07:41.953554+0000","last_became_active":"2023-09-13T06:07:40.550219+0000","last_became_peered":"2023-09-13T06:07:40.550219+0000","last_unstale":"2023-09-13T06:07:41.953554+0000","last_undegraded":"2023-09-13T06:07:41.953554+0000","last_fullsized":"2023-09-13T06:07:41.953554+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:48:54.258285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"136'1","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.562624+0000","last_change":"2023-09-13T06:07:39.543056+0000","last_active":"2023-09-13T06:07:40.562624+0000","last_peered":"2023-09-13T06:07:40.562624+0000","last_clean":"2023-09-13T06:07:40.562624+0000","last_became_active":"2023-09-13T06:07:39.542821+0000","last_became_peered":"2023-09-13T06:07:39.542821+0000","last_unstale":"2023-09-13T06:07:40.562624+0000","last_undegraded":"2023-09-13T06:07:40.562624+0000","last_fullsized":"2023-09-13T06:07:40.562624+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:07:27.498388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.781977+0000","last_change":"2023-09-13T06:07:40.546319+0000","last_active":"2023-09-13T06:07:41.781977+0000","last_peered":"2023-09-13T06:07:41.781977+0000","last_clean":"2023-09-13T06:07:41.781977+0000","last_became_active":"2023-09-13T06:07:40.545726+0000","last_became_peered":"2023-09-13T06:07:40.545726+0000","last_unstale":"2023-09-13T06:07:41.781977+0000","last_undegraded":"2023-09-13T06:07:41.781977+0000","last_fullsized":"2023-09-13T06:07:41.781977+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:56:30.160031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"136'1","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.565251+0000","last_change":"2023-09-13T06:07:39.547686+0000","last_active":"2023-09-13T06:07:40.565251+0000","last_peered":"2023-09-13T06:07:40.565251+0000","last_clean":"2023-09-13T06:07:40.565251+0000","last_became_active":"2023-09-13T06:07:39.547454+0000","last_became_peered":"2023-09-13T06:07:39.547454+0000","last_unstale":"2023-09-13T06:07:40.565251+0000","last_undegraded":"2023-09-13T06:07:40.565251+0000","last_fullsized":"2023-09-13T06:07:40.565251+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:38:26.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953899+0000","last_change":"2023-09-13T06:07:40.547263+0000","last_active":"2023-09-13T06:07:41.953899+0000","last_peered":"2023-09-13T06:07:41.953899+0000","last_clean":"2023-09-13T06:07:41.953899+0000","last_became_active":"2023-09-13T06:07:40.546894+0000","last_became_peered":"2023-09-13T06:07:40.546894+0000","last_unstale":"2023-09-13T06:07:41.953899+0000","last_undegraded":"2023-09-13T06:07:41.953899+0000","last_fullsized":"2023-09-13T06:07:41.953899+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:58.859952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.540886+0000","last_change":"2023-09-13T06:07:39.543848+0000","last_active":"2023-09-13T06:07:40.540886+0000","last_peered":"2023-09-13T06:07:40.540886+0000","last_clean":"2023-09-13T06:07:40.540886+0000","last_became_active":"2023-09-13T06:07:39.543296+0000","last_became_peered":"2023-09-13T06:07:39.543296+0000","last_unstale":"2023-09-13T06:07:40.540886+0000","last_undegraded":"2023-09-13T06:07:40.540886+0000","last_fullsized":"2023-09-13T06:07:40.540886+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:38:26.988760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542323+0000","last_change":"2023-09-13T06:07:40.549687+0000","last_active":"2023-09-13T06:07:41.542323+0000","last_peered":"2023-09-13T06:07:41.542323+0000","last_clean":"2023-09-13T06:07:41.542323+0000","last_became_active":"2023-09-13T06:07:40.549435+0000","last_became_peered":"2023-09-13T06:07:40.549435+0000","last_unstale":"2023-09-13T06:07:41.542323+0000","last_undegraded":"2023-09-13T06:07:41.542323+0000","last_fullsized":"2023-09-13T06:07:41.542323+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:48:33.138433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.542558+0000","last_change":"2023-09-13T06:07:39.544650+0000","last_active":"2023-09-13T06:07:40.542558+0000","last_peered":"2023-09-13T06:07:40.542558+0000","last_clean":"2023-09-13T06:07:40.542558+0000","last_became_active":"2023-09-13T06:07:39.544420+0000","last_became_peered":"2023-09-13T06:07:39.544420+0000","last_unstale":"2023-09-13T06:07:40.542558+0000","last_undegraded":"2023-09-13T06:07:40.542558+0000","last_fullsized":"2023-09-13T06:07:40.542558+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:47:05.628745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542512+0000","last_change":"2023-09-13T06:07:40.550599+0000","last_active":"2023-09-13T06:07:41.542512+0000","last_peered":"2023-09-13T06:07:41.542512+0000","last_clean":"2023-09-13T06:07:41.542512+0000","last_became_active":"2023-09-13T06:07:40.550281+0000","last_became_peered":"2023-09-13T06:07:40.550281+0000","last_unstale":"2023-09-13T06:07:41.542512+0000","last_undegraded":"2023-09-13T06:07:41.542512+0000","last_fullsized":"2023-09-13T06:07:41.542512+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:35:38.248359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.546940+0000","last_change":"2023-09-13T06:07:39.548638+0000","last_active":"2023-09-13T06:07:40.546940+0000","last_peered":"2023-09-13T06:07:40.546940+0000","last_clean":"2023-09-13T06:07:40.546940+0000","last_became_active":"2023-09-13T06:07:39.548121+0000","last_became_peered":"2023-09-13T06:07:39.548121+0000","last_unstale":"2023-09-13T06:07:40.546940+0000","last_undegraded":"2023-09-13T06:07:40.546940+0000","last_fullsized":"2023-09-13T06:07:40.546940+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:50:19.437344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.703935+0000","last_change":"2023-09-13T06:07:40.551732+0000","last_active":"2023-09-13T06:07:41.703935+0000","last_peered":"2023-09-13T06:07:41.703935+0000","last_clean":"2023-09-13T06:07:41.703935+0000","last_became_active":"2023-09-13T06:07:40.551336+0000","last_became_peered":"2023-09-13T06:07:40.551336+0000","last_unstale":"2023-09-13T06:07:41.703935+0000","last_undegraded":"2023-09-13T06:07:41.703935+0000","last_fullsized":"2023-09-13T06:07:41.703935+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:49:36.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.536139+0000","last_change":"2023-09-13T06:07:39.540338+0000","last_active":"2023-09-13T06:07:40.536139+0000","last_peered":"2023-09-13T06:07:40.536139+0000","last_clean":"2023-09-13T06:07:40.536139+0000","last_became_active":"2023-09-13T06:07:39.540023+0000","last_became_peered":"2023-09-13T06:07:39.540023+0000","last_unstale":"2023-09-13T06:07:40.536139+0000","last_undegraded":"2023-09-13T06:07:40.536139+0000","last_fullsized":"2023-09-13T06:07:40.536139+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:59:18.711407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.855235+0000","last_change":"2023-09-13T06:07:40.543392+0000","last_active":"2023-09-13T06:07:41.855235+0000","last_peered":"2023-09-13T06:07:41.855235+0000","last_clean":"2023-09-13T06:07:41.855235+0000","last_became_active":"2023-09-13T06:07:40.543166+0000","last_became_peered":"2023-09-13T06:07:40.543166+0000","last_unstale":"2023-09-13T06:07:41.855235+0000","last_undegraded":"2023-09-13T06:07:41.855235+0000","last_fullsized":"2023-09-13T06:07:41.855235+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:34:00.612271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"136'3","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.566367+0000","last_change":"2023-09-13T06:07:39.543375+0000","last_active":"2023-09-13T06:07:40.566367+0000","last_peered":"2023-09-13T06:07:40.566367+0000","last_clean":"2023-09-13T06:07:40.566367+0000","last_became_active":"2023-09-13T06:07:39.543094+0000","last_became_peered":"2023-09-13T06:07:39.543094+0000","last_unstale":"2023-09-13T06:07:40.566367+0000","last_undegraded":"2023-09-13T06:07:40.566367+0000","last_fullsized":"2023-09-13T06:07:40.566367+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:56:29.154952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542282+0000","last_change":"2023-09-13T06:07:40.541267+0000","last_active":"2023-09-13T06:07:41.542282+0000","last_peered":"2023-09-13T06:07:41.542282+0000","last_clean":"2023-09-13T06:07:41.542282+0000","last_became_active":"2023-09-13T06:07:40.541040+0000","last_became_peered":"2023-09-13T06:07:40.541040+0000","last_unstale":"2023-09-13T06:07:41.542282+0000","last_undegraded":"2023-09-13T06:07:41.542282+0000","last_fullsized":"2023-09-13T06:07:41.542282+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:51.969265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"136'6","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.568916+0000","last_change":"2023-09-13T06:07:39.546790+0000","last_active":"2023-09-13T06:07:40.568916+0000","last_peered":"2023-09-13T06:07:40.568916+0000","last_clean":"2023-09-13T06:07:40.568916+0000","last_became_active":"2023-09-13T06:07:39.545983+0000","last_became_peered":"2023-09-13T06:07:39.545983+0000","last_unstale":"2023-09-13T06:07:40.568916+0000","last_undegraded":"2023-09-13T06:07:40.568916+0000","last_fullsized":"2023-09-13T06:07:40.568916+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:39:27.032480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.855297+0000","last_change":"2023-09-13T06:07:40.538292+0000","last_active":"2023-09-13T06:07:41.855297+0000","last_peered":"2023-09-13T06:07:41.855297+0000","last_clean":"2023-09-13T06:07:41.855297+0000","last_became_active":"2023-09-13T06:07:40.538117+0000","last_became_peered":"2023-09-13T06:07:40.538117+0000","last_unstale":"2023-09-13T06:07:41.855297+0000","last_undegraded":"2023-09-13T06:07:41.855297+0000","last_fullsized":"2023-09-13T06:07:41.855297+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:46:30.990014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"136'2","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.564901+0000","last_change":"2023-09-13T06:07:39.547161+0000","last_active":"2023-09-13T06:07:40.564901+0000","last_peered":"2023-09-13T06:07:40.564901+0000","last_clean":"2023-09-13T06:07:40.564901+0000","last_became_active":"2023-09-13T06:07:39.546897+0000","last_became_peered":"2023-09-13T06:07:39.546897+0000","last_unstale":"2023-09-13T06:07:40.564901+0000","last_undegraded":"2023-09-13T06:07:40.564901+0000","last_fullsized":"2023-09-13T06:07:40.564901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:24:54.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.855292+0000","last_change":"2023-09-13T06:07:40.546478+0000","last_active":"2023-09-13T06:07:41.855292+0000","last_peered":"2023-09-13T06:07:41.855292+0000","last_clean":"2023-09-13T06:07:41.855292+0000","last_became_active":"2023-09-13T06:07:40.545994+0000","last_became_peered":"2023-09-13T06:07:40.545994+0000","last_unstale":"2023-09-13T06:07:41.855292+0000","last_undegraded":"2023-09-13T06:07:41.855292+0000","last_fullsized":"2023-09-13T06:07:41.855292+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:26:05.047684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.547116+0000","last_change":"2023-09-13T06:07:39.546381+0000","last_active":"2023-09-13T06:07:40.547116+0000","last_peered":"2023-09-13T06:07:40.547116+0000","last_clean":"2023-09-13T06:07:40.547116+0000","last_became_active":"2023-09-13T06:07:39.546143+0000","last_became_peered":"2023-09-13T06:07:39.546143+0000","last_unstale":"2023-09-13T06:07:40.547116+0000","last_undegraded":"2023-09-13T06:07:40.547116+0000","last_fullsized":"2023-09-13T06:07:40.547116+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:01:50.895439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.855086+0000","last_change":"2023-09-13T06:07:40.544980+0000","last_active":"2023-09-13T06:07:41.855086+0000","last_peered":"2023-09-13T06:07:41.855086+0000","last_clean":"2023-09-13T06:07:41.855086+0000","last_became_active":"2023-09-13T06:07:40.544717+0000","last_became_peered":"2023-09-13T06:07:40.544717+0000","last_unstale":"2023-09-13T06:07:41.855086+0000","last_undegraded":"2023-09-13T06:07:41.855086+0000","last_fullsized":"2023-09-13T06:07:41.855086+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:48:11.917495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"136'8","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.567805+0000","last_change":"2023-09-13T06:07:39.546636+0000","last_active":"2023-09-13T06:07:40.567805+0000","last_peered":"2023-09-13T06:07:40.567805+0000","last_clean":"2023-09-13T06:07:40.567805+0000","last_became_active":"2023-09-13T06:07:39.546379+0000","last_became_peered":"2023-09-13T06:07:39.546379+0000","last_unstale":"2023-09-13T06:07:40.567805+0000","last_undegraded":"2023-09-13T06:07:40.567805+0000","last_fullsized":"2023-09-13T06:07:40.567805+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:09:06.608550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953133+0000","last_change":"2023-09-13T06:07:40.553025+0000","last_active":"2023-09-13T06:07:41.953133+0000","last_peered":"2023-09-13T06:07:41.953133+0000","last_clean":"2023-09-13T06:07:41.953133+0000","last_became_active":"2023-09-13T06:07:40.552654+0000","last_became_peered":"2023-09-13T06:07:40.552654+0000","last_unstale":"2023-09-13T06:07:41.953133+0000","last_undegraded":"2023-09-13T06:07:41.953133+0000","last_fullsized":"2023-09-13T06:07:41.953133+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:26:35.621112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"136'1","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.567127+0000","last_change":"2023-09-13T06:07:39.546940+0000","last_active":"2023-09-13T06:07:40.567127+0000","last_peered":"2023-09-13T06:07:40.567127+0000","last_clean":"2023-09-13T06:07:40.567127+0000","last_became_active":"2023-09-13T06:07:39.546436+0000","last_became_peered":"2023-09-13T06:07:39.546436+0000","last_unstale":"2023-09-13T06:07:40.567127+0000","last_undegraded":"2023-09-13T06:07:40.567127+0000","last_fullsized":"2023-09-13T06:07:40.567127+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:16.673358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542268+0000","last_change":"2023-09-13T06:07:40.546220+0000","last_active":"2023-09-13T06:07:41.542268+0000","last_peered":"2023-09-13T06:07:41.542268+0000","last_clean":"2023-09-13T06:07:41.542268+0000","last_became_active":"2023-09-13T06:07:40.546002+0000","last_became_peered":"2023-09-13T06:07:40.546002+0000","last_unstale":"2023-09-13T06:07:41.542268+0000","last_undegraded":"2023-09-13T06:07:41.542268+0000","last_fullsized":"2023-09-13T06:07:41.542268+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:44:30.597412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"136'2","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.566707+0000","last_change":"2023-09-13T06:07:39.546300+0000","last_active":"2023-09-13T06:07:40.566707+0000","last_peered":"2023-09-13T06:07:40.566707+0000","last_clean":"2023-09-13T06:07:40.566707+0000","last_became_active":"2023-09-13T06:07:39.546001+0000","last_became_peered":"2023-09-13T06:07:39.546001+0000","last_unstale":"2023-09-13T06:07:40.566707+0000","last_undegraded":"2023-09-13T06:07:40.566707+0000","last_fullsized":"2023-09-13T06:07:40.566707+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:59.804591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542939+0000","last_change":"2023-09-13T06:07:40.546701+0000","last_active":"2023-09-13T06:07:41.542939+0000","last_peered":"2023-09-13T06:07:41.542939+0000","last_clean":"2023-09-13T06:07:41.542939+0000","last_became_active":"2023-09-13T06:07:40.546471+0000","last_became_peered":"2023-09-13T06:07:40.546471+0000","last_unstale":"2023-09-13T06:07:41.542939+0000","last_undegraded":"2023-09-13T06:07:41.542939+0000","last_fullsized":"2023-09-13T06:07:41.542939+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:17.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"136'1","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.563322+0000","last_change":"2023-09-13T06:07:39.545847+0000","last_active":"2023-09-13T06:07:40.563322+0000","last_peered":"2023-09-13T06:07:40.563322+0000","last_clean":"2023-09-13T06:07:40.563322+0000","last_became_active":"2023-09-13T06:07:39.545431+0000","last_became_peered":"2023-09-13T06:07:39.545431+0000","last_unstale":"2023-09-13T06:07:40.563322+0000","last_undegraded":"2023-09-13T06:07:40.563322+0000","last_fullsized":"2023-09-13T06:07:40.563322+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:20.406558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.543115+0000","last_change":"2023-09-13T06:07:40.540176+0000","last_active":"2023-09-13T06:07:41.543115+0000","last_peered":"2023-09-13T06:07:41.543115+0000","last_clean":"2023-09-13T06:07:41.543115+0000","last_became_active":"2023-09-13T06:07:40.539909+0000","last_became_peered":"2023-09-13T06:07:40.539909+0000","last_unstale":"2023-09-13T06:07:41.543115+0000","last_undegraded":"2023-09-13T06:07:41.543115+0000","last_fullsized":"2023-09-13T06:07:41.543115+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:49:36.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.537402+0000","last_change":"2023-09-13T06:07:39.545541+0000","last_active":"2023-09-13T06:07:40.537402+0000","last_peered":"2023-09-13T06:07:40.537402+0000","last_clean":"2023-09-13T06:07:40.537402+0000","last_became_active":"2023-09-13T06:07:39.545320+0000","last_became_peered":"2023-09-13T06:07:39.545320+0000","last_unstale":"2023-09-13T06:07:40.537402+0000","last_undegraded":"2023-09-13T06:07:40.537402+0000","last_fullsized":"2023-09-13T06:07:40.537402+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:13:03.137454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542957+0000","last_change":"2023-09-13T06:07:40.543256+0000","last_active":"2023-09-13T06:07:41.542957+0000","last_peered":"2023-09-13T06:07:41.542957+0000","last_clean":"2023-09-13T06:07:41.542957+0000","last_became_active":"2023-09-13T06:07:40.542939+0000","last_became_peered":"2023-09-13T06:07:40.542939+0000","last_unstale":"2023-09-13T06:07:41.542957+0000","last_undegraded":"2023-09-13T06:07:41.542957+0000","last_fullsized":"2023-09-13T06:07:41.542957+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:56:30.160031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"136'2","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.567448+0000","last_change":"2023-09-13T06:07:39.548983+0000","last_active":"2023-09-13T06:07:40.567448+0000","last_peered":"2023-09-13T06:07:40.567448+0000","last_clean":"2023-09-13T06:07:40.567448+0000","last_became_active":"2023-09-13T06:07:39.548676+0000","last_became_peered":"2023-09-13T06:07:39.548676+0000","last_unstale":"2023-09-13T06:07:40.567448+0000","last_undegraded":"2023-09-13T06:07:40.567448+0000","last_fullsized":"2023-09-13T06:07:40.567448+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:58:14.536411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953690+0000","last_change":"2023-09-13T06:07:40.550615+0000","last_active":"2023-09-13T06:07:41.953690+0000","last_peered":"2023-09-13T06:07:41.953690+0000","last_clean":"2023-09-13T06:07:41.953690+0000","last_became_active":"2023-09-13T06:07:40.549854+0000","last_became_peered":"2023-09-13T06:07:40.549854+0000","last_unstale":"2023-09-13T06:07:41.953690+0000","last_undegraded":"2023-09-13T06:07:41.953690+0000","last_fullsized":"2023-09-13T06:07:41.953690+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:33:29.223546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.548716+0000","last_change":"2023-09-13T06:07:39.548317+0000","last_active":"2023-09-13T06:07:40.548716+0000","last_peered":"2023-09-13T06:07:40.548716+0000","last_clean":"2023-09-13T06:07:40.548716+0000","last_became_active":"2023-09-13T06:07:39.548094+0000","last_became_peered":"2023-09-13T06:07:39.548094+0000","last_unstale":"2023-09-13T06:07:40.548716+0000","last_undegraded":"2023-09-13T06:07:40.548716+0000","last_fullsized":"2023-09-13T06:07:40.548716+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:36:47.536104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.543251+0000","last_change":"2023-09-13T06:07:40.548468+0000","last_active":"2023-09-13T06:07:41.543251+0000","last_peered":"2023-09-13T06:07:41.543251+0000","last_clean":"2023-09-13T06:07:41.543251+0000","last_became_active":"2023-09-13T06:07:40.548225+0000","last_became_peered":"2023-09-13T06:07:40.548225+0000","last_unstale":"2023-09-13T06:07:41.543251+0000","last_undegraded":"2023-09-13T06:07:41.543251+0000","last_fullsized":"2023-09-13T06:07:41.543251+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:10:41.317314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.541200+0000","last_change":"2023-09-13T06:07:39.546134+0000","last_active":"2023-09-13T06:07:40.541200+0000","last_peered":"2023-09-13T06:07:40.541200+0000","last_clean":"2023-09-13T06:07:40.541200+0000","last_became_active":"2023-09-13T06:07:39.545857+0000","last_became_peered":"2023-09-13T06:07:39.545857+0000","last_unstale":"2023-09-13T06:07:40.541200+0000","last_undegraded":"2023-09-13T06:07:40.541200+0000","last_fullsized":"2023-09-13T06:07:40.541200+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:05:44.463603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.855359+0000","last_change":"2023-09-13T06:07:40.546628+0000","last_active":"2023-09-13T06:07:41.855359+0000","last_peered":"2023-09-13T06:07:41.855359+0000","last_clean":"2023-09-13T06:07:41.855359+0000","last_became_active":"2023-09-13T06:07:40.546274+0000","last_became_peered":"2023-09-13T06:07:40.546274+0000","last_unstale":"2023-09-13T06:07:41.855359+0000","last_undegraded":"2023-09-13T06:07:41.855359+0000","last_fullsized":"2023-09-13T06:07:41.855359+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:13:59.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.542394+0000","last_change":"2023-09-13T06:07:39.548551+0000","last_active":"2023-09-13T06:07:40.542394+0000","last_peered":"2023-09-13T06:07:40.542394+0000","last_clean":"2023-09-13T06:07:40.542394+0000","last_became_active":"2023-09-13T06:07:39.548084+0000","last_became_peered":"2023-09-13T06:07:39.548084+0000","last_unstale":"2023-09-13T06:07:40.542394+0000","last_undegraded":"2023-09-13T06:07:40.542394+0000","last_fullsized":"2023-09-13T06:07:40.542394+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:43:57.923956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.703787+0000","last_change":"2023-09-13T06:07:40.553243+0000","last_active":"2023-09-13T06:07:41.703787+0000","last_peered":"2023-09-13T06:07:41.703787+0000","last_clean":"2023-09-13T06:07:41.703787+0000","last_became_active":"2023-09-13T06:07:40.552281+0000","last_became_peered":"2023-09-13T06:07:40.552281+0000","last_unstale":"2023-09-13T06:07:41.703787+0000","last_undegraded":"2023-09-13T06:07:41.703787+0000","last_fullsized":"2023-09-13T06:07:41.703787+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:56:30.160031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"136'2","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.564112+0000","last_change":"2023-09-13T06:07:39.544731+0000","last_active":"2023-09-13T06:07:40.564112+0000","last_peered":"2023-09-13T06:07:40.564112+0000","last_clean":"2023-09-13T06:07:40.564112+0000","last_became_active":"2023-09-13T06:07:39.544506+0000","last_became_peered":"2023-09-13T06:07:39.544506+0000","last_unstale":"2023-09-13T06:07:40.564112+0000","last_undegraded":"2023-09-13T06:07:40.564112+0000","last_fullsized":"2023-09-13T06:07:40.564112+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:28:11.920735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953793+0000","last_change":"2023-09-13T06:07:40.548172+0000","last_active":"2023-09-13T06:07:41.953793+0000","last_peered":"2023-09-13T06:07:41.953793+0000","last_clean":"2023-09-13T06:07:41.953793+0000","last_became_active":"2023-09-13T06:07:40.547949+0000","last_became_peered":"2023-09-13T06:07:40.547949+0000","last_unstale":"2023-09-13T06:07:41.953793+0000","last_undegraded":"2023-09-13T06:07:41.953793+0000","last_fullsized":"2023-09-13T06:07:41.953793+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:27:41.600797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.549222+0000","last_change":"2023-09-13T06:07:39.545501+0000","last_active":"2023-09-13T06:07:40.549222+0000","last_peered":"2023-09-13T06:07:40.549222+0000","last_clean":"2023-09-13T06:07:40.549222+0000","last_became_active":"2023-09-13T06:07:39.545008+0000","last_became_peered":"2023-09-13T06:07:39.545008+0000","last_unstale":"2023-09-13T06:07:40.549222+0000","last_undegraded":"2023-09-13T06:07:40.549222+0000","last_fullsized":"2023-09-13T06:07:40.549222+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:39:27.032480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953997+0000","last_change":"2023-09-13T06:07:40.547133+0000","last_active":"2023-09-13T06:07:41.953997+0000","last_peered":"2023-09-13T06:07:41.953997+0000","last_clean":"2023-09-13T06:07:41.953997+0000","last_became_active":"2023-09-13T06:07:40.546581+0000","last_became_peered":"2023-09-13T06:07:40.546581+0000","last_unstale":"2023-09-13T06:07:41.953997+0000","last_undegraded":"2023-09-13T06:07:41.953997+0000","last_fullsized":"2023-09-13T06:07:41.953997+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:41.167778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.540878+0000","last_change":"2023-09-13T06:07:39.549569+0000","last_active":"2023-09-13T06:07:40.540878+0000","last_peered":"2023-09-13T06:07:40.540878+0000","last_clean":"2023-09-13T06:07:40.540878+0000","last_became_active":"2023-09-13T06:07:39.549052+0000","last_became_peered":"2023-09-13T06:07:39.549052+0000","last_unstale":"2023-09-13T06:07:40.540878+0000","last_undegraded":"2023-09-13T06:07:40.540878+0000","last_fullsized":"2023-09-13T06:07:40.540878+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:46:29.984935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.703725+0000","last_change":"2023-09-13T06:07:40.552047+0000","last_active":"2023-09-13T06:07:41.703725+0000","last_peered":"2023-09-13T06:07:41.703725+0000","last_clean":"2023-09-13T06:07:41.703725+0000","last_became_active":"2023-09-13T06:07:40.551729+0000","last_became_peered":"2023-09-13T06:07:40.551729+0000","last_unstale":"2023-09-13T06:07:41.703725+0000","last_undegraded":"2023-09-13T06:07:41.703725+0000","last_fullsized":"2023-09-13T06:07:41.703725+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:17.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.536187+0000","last_change":"2023-09-13T06:07:39.542324+0000","last_active":"2023-09-13T06:07:40.536187+0000","last_peered":"2023-09-13T06:07:40.536187+0000","last_clean":"2023-09-13T06:07:40.536187+0000","last_became_active":"2023-09-13T06:07:39.541580+0000","last_became_peered":"2023-09-13T06:07:39.541580+0000","last_unstale":"2023-09-13T06:07:40.536187+0000","last_undegraded":"2023-09-13T06:07:40.536187+0000","last_fullsized":"2023-09-13T06:07:40.536187+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:21:27.046248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.782048+0000","last_change":"2023-09-13T06:07:40.544623+0000","last_active":"2023-09-13T06:07:41.782048+0000","last_peered":"2023-09-13T06:07:41.782048+0000","last_clean":"2023-09-13T06:07:41.782048+0000","last_became_active":"2023-09-13T06:07:40.544377+0000","last_became_peered":"2023-09-13T06:07:40.544377+0000","last_unstale":"2023-09-13T06:07:41.782048+0000","last_undegraded":"2023-09-13T06:07:41.782048+0000","last_fullsized":"2023-09-13T06:07:41.782048+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:49:36.105042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.536555+0000","last_change":"2023-09-13T06:07:39.541618+0000","last_active":"2023-09-13T06:07:40.536555+0000","last_peered":"2023-09-13T06:07:40.536555+0000","last_clean":"2023-09-13T06:07:40.536555+0000","last_became_active":"2023-09-13T06:07:39.541248+0000","last_became_peered":"2023-09-13T06:07:39.541248+0000","last_unstale":"2023-09-13T06:07:40.536555+0000","last_undegraded":"2023-09-13T06:07:40.536555+0000","last_fullsized":"2023-09-13T06:07:40.536555+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:57:16.880746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.781696+0000","last_change":"2023-09-13T06:07:40.552339+0000","last_active":"2023-09-13T06:07:41.781696+0000","last_peered":"2023-09-13T06:07:41.781696+0000","last_clean":"2023-09-13T06:07:41.781696+0000","last_became_active":"2023-09-13T06:07:40.552113+0000","last_became_peered":"2023-09-13T06:07:40.552113+0000","last_unstale":"2023-09-13T06:07:41.781696+0000","last_undegraded":"2023-09-13T06:07:41.781696+0000","last_fullsized":"2023-09-13T06:07:41.781696+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:46:30.990014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.542257+0000","last_change":"2023-09-13T06:07:39.543148+0000","last_active":"2023-09-13T06:07:40.542257+0000","last_peered":"2023-09-13T06:07:40.542257+0000","last_clean":"2023-09-13T06:07:40.542257+0000","last_became_active":"2023-09-13T06:07:39.542398+0000","last_became_peered":"2023-09-13T06:07:39.542398+0000","last_unstale":"2023-09-13T06:07:40.542257+0000","last_undegraded":"2023-09-13T06:07:40.542257+0000","last_fullsized":"2023-09-13T06:07:40.542257+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:34:53.523300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.542751+0000","last_change":"2023-09-13T06:07:40.553985+0000","last_active":"2023-09-13T06:07:41.542751+0000","last_peered":"2023-09-13T06:07:41.542751+0000","last_clean":"2023-09-13T06:07:41.542751+0000","last_became_active":"2023-09-13T06:07:40.553247+0000","last_became_peered":"2023-09-13T06:07:40.553247+0000","last_unstale":"2023-09-13T06:07:41.542751+0000","last_undegraded":"2023-09-13T06:07:41.542751+0000","last_fullsized":"2023-09-13T06:07:41.542751+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:35:11.309095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.545868+0000","last_change":"2023-09-13T06:07:39.550151+0000","last_active":"2023-09-13T06:07:40.545868+0000","last_peered":"2023-09-13T06:07:40.545868+0000","last_clean":"2023-09-13T06:07:40.545868+0000","last_became_active":"2023-09-13T06:07:39.549854+0000","last_became_peered":"2023-09-13T06:07:39.549854+0000","last_unstale":"2023-09-13T06:07:40.545868+0000","last_undegraded":"2023-09-13T06:07:40.545868+0000","last_fullsized":"2023-09-13T06:07:40.545868+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:29:17.503208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.953794+0000","last_change":"2023-09-13T06:07:40.547983+0000","last_active":"2023-09-13T06:07:41.953794+0000","last_peered":"2023-09-13T06:07:41.953794+0000","last_clean":"2023-09-13T06:07:41.953794+0000","last_became_active":"2023-09-13T06:07:40.547306+0000","last_became_peered":"2023-09-13T06:07:40.547306+0000","last_unstale":"2023-09-13T06:07:41.953794+0000","last_undegraded":"2023-09-13T06:07:41.953794+0000","last_fullsized":"2023-09-13T06:07:41.953794+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:03.012628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.541176+0000","last_change":"2023-09-13T06:07:39.549704+0000","last_active":"2023-09-13T06:07:40.541176+0000","last_peered":"2023-09-13T06:07:40.541176+0000","last_clean":"2023-09-13T06:07:40.541176+0000","last_became_active":"2023-09-13T06:07:39.549335+0000","last_became_peered":"2023-09-13T06:07:39.549335+0000","last_unstale":"2023-09-13T06:07:40.541176+0000","last_undegraded":"2023-09-13T06:07:40.541176+0000","last_fullsized":"2023-09-13T06:07:40.541176+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:13:58.592570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-09-13T06:07:41.855144+0000","last_change":"2023-09-13T06:07:40.546679+0000","last_active":"2023-09-13T06:07:41.855144+0000","last_peered":"2023-09-13T06:07:41.855144+0000","last_clean":"2023-09-13T06:07:41.855144+0000","last_became_active":"2023-09-13T06:07:40.546190+0000","last_became_peered":"2023-09-13T06:07:40.546190+0000","last_unstale":"2023-09-13T06:07:41.855144+0000","last_undegraded":"2023-09-13T06:07:41.855144+0000","last_fullsized":"2023-09-13T06:07:41.855144+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:39.523287+0000","last_clean_scrub_stamp":"2023-09-13T06:07:39.523287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:39:28.037559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.537277+0000","last_change":"2023-09-13T06:07:39.544791+0000","last_active":"2023-09-13T06:07:40.537277+0000","last_peered":"2023-09-13T06:07:40.537277+0000","last_clean":"2023-09-13T06:07:40.537277+0000","last_became_active":"2023-09-13T06:07:39.544571+0000","last_became_peered":"2023-09-13T06:07:39.544571+0000","last_unstale":"2023-09-13T06:07:40.537277+0000","last_undegraded":"2023-09-13T06:07:40.537277+0000","last_fullsized":"2023-09-13T06:07:40.537277+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:07:38.518208+0000","last_clean_scrub_stamp":"2023-09-13T06:07:38.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:34:02.510050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":296,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-09-13T06:07:40.538985+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:07:40.538985+0000","last_peered":"2023-09-13T06:07:40.538985+0000","last_clean":"2023-09-13T06:07:40.538985+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:07:40.538985+0000","last_undegraded":"2023-09-13T06:07:40.538985+0000","last_fullsized":"2023-09-13T06:07:40.538985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1322,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193990,"statfs":{"total":200000000,"available":198645843,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.52100000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98799999999999999,"5min":1.0189999999999999,"15min":1.3320000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.68999999999999995},"min":{"1min":0.47799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.89700000000000002}]},{"osd":1,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.69599999999999995},"min":{"1min":0.501,"5min":0.44,"15min":0.44},"max":{"1min":0.875,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.53200000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94399999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.85799999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.45600000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.95399999999999996,"5min":1.016,"15min":1.395},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.53100000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90900000000000003,"5min":0.96899999999999997,"15min":1.2030000000000001},"last":0.872}]},{"osd":3,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93500000000000005,"5min":0.94599999999999995,"15min":1.357},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94399999999999995,"5min":1.0580000000000001,"15min":1.2629999999999999},"last":0.81299999999999994}]},{"osd":4,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.629},"min":{"1min":0.32600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80300000000000005,"5min":0.89700000000000002,"15min":0.95899999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63800000000000001,"15min":0.66100000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.018},"last":0.71099999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.67400000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97999999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.69799999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.91500000000000004,"5min":0.98099999999999998,"15min":1.1319999999999999},"last":0.82899999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97199999999999998,"5min":1,"15min":1.0920000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67800000000000005,"15min":0.69199999999999995},"min":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194567,"statfs":{"total":200000000,"available":199236757,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68000000000000005,"15min":0.68799999999999994},"min":{"1min":0.48199999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.181},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.53600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91600000000000004,"5min":1.028,"15min":1.028},"last":0.96299999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.94199999999999995,"5min":0.996,"15min":1.0840000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.58399999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98299999999999998,"5min":0.99299999999999999,"15min":1.153},"last":0.90200000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.59699999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96999999999999997,"5min":0.97399999999999998,"15min":1.4750000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69799999999999995,"15min":0.71699999999999997},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.872,"5min":1.085,"15min":1.085},"last":1.034}]},{"osd":3,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.499,"5min":0.495,"15min":0.495},"max":{"1min":0.93700000000000006,"5min":1.105,"15min":1.2030000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.754,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.526},"last":1.0129999999999999}]},{"osd":4,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.439,"5min":0.315,"15min":0.315},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.64400000000000002}]},{"osd":5,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.42699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.84799999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.68700000000000006},"min":{"1min":0.45900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.76000000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77100000000000002,"15min":0.71899999999999997},"min":{"1min":0.47799999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":1.071},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71099999999999997,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88700000000000001,"5min":1.133,"15min":1.133},"last":0.73799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194566,"statfs":{"total":200000000,"available":199236223,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90300000000000002,"5min":0.95899999999999996,"15min":1.0389999999999999},"last":0.624},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69799999999999995,"15min":0.66300000000000003},"min":{"1min":0.375,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.42699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92100000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58499999999999996}]},{"osd":2,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.70899999999999996,"15min":0.69299999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94099999999999995,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.56399999999999995}]},{"osd":3,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.497,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88900000000000001,"5min":0.997,"15min":0.997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92700000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65200000000000002,"15min":0.60699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.72199999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.67500000000000004},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.49099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90000000000000002,"5min":0.91400000000000003,"15min":0.94599999999999995},"last":0.496}]},{"osd":7,"last update":"Wed Sep 13 06:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69499999999999995,"15min":0.71799999999999997},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.503,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.024,"5min":1.026,"15min":1.026},"last":0.70199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194567,"statfs":{"total":200000000,"available":199236827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.437,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83299999999999996,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.54600000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67800000000000005,"15min":0.66600000000000004},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.92500000000000004,"15min":0.92700000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.55700000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.97699999999999998},"last":0.81699999999999995}]},{"osd":3,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.48299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.052,"5min":1.077,"15min":1.077},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.78500000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.49099999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.91200000000000003,"5min":0.97999999999999998,"15min":1.01},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.67400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97399999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.91300000000000003}]},{"osd":6,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65300000000000002,"15min":0.64300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.98999999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70999999999999996,"15min":0.69199999999999995},"min":{"1min":0.46899999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.95199999999999996,"5min":1.123,"15min":1.123},"last":0.76100000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73299999999999998,"15min":0.71599999999999997},"min":{"1min":0.51600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0109999999999999,"5min":1.26,"15min":1.26},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0449999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.88900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194565,"statfs":{"total":200000000,"available":199235145,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40100000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":0.629,"15min":0.69099999999999995},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.29799999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.439,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.46100000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40600000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.38700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.34200000000000003},"max":{"1min":0.71399999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.47799999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91700000000000004,"5min":1.284,"15min":1.284},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90100000000000002,"5min":1.044,"15min":1.044},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.54700000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.97099999999999997,"5min":1.042,"15min":1.111},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70899999999999996,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98699999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73299999999999998,"15min":0.72999999999999998},"min":{"1min":0.56699999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.034,"5min":1.097,"15min":1.097},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":0.94099999999999995,"5min":0.998,"15min":1.458},"last":0.82899999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.74199999999999999,"15min":0.77100000000000002},"min":{"1min":0.57599999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94099999999999995,"5min":1.383,"15min":1.383},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.76100000000000001},"min":{"1min":0.53900000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.95799999999999996,"5min":1.0800000000000001,"15min":1.27},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194567,"statfs":{"total":200000000,"available":199236827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.46999999999999997,"15min":0.40899999999999997},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53300000000000003,"5min":10.401,"15min":10.401},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.46999999999999997,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52500000000000002,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":0.379}]},{"osd":1,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.48799999999999999,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66600000000000004,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.50900000000000001,"15min":0.46800000000000003},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67300000000000004,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":0.41899999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.55000000000000004,"15min":0.52000000000000002},"min":{"1min":0.33300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.56200000000000006,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58799999999999997,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.40300000000000002,"15min":0.38600000000000001},"max":{"1min":0.60799999999999998,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77800000000000002,"15min":0.76700000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95699999999999996,"5min":5.4809999999999999,"15min":5.4809999999999999},"last":0.752},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93500000000000005,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.73999999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88100000000000001,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79400000000000004,"15min":0.79100000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.91800000000000004,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.72999999999999998},"min":{"1min":0.45500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94299999999999995,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73699999999999999,"15min":0.72599999999999998},"min":{"1min":0.48299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93700000000000006,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.749,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99299999999999999,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96799999999999997,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194567,"statfs":{"total":200000000,"available":199236703,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45300000000000001,"15min":0.436},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.64800000000000002,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46500000000000002,"15min":0.45000000000000001},"min":{"1min":0.314,"5min":0.28899999999999998,"15min":0.27300000000000002},"max":{"1min":0.63,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46999999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47799999999999998,"15min":0.46000000000000002},"min":{"1min":0.34100000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60999999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.497,"15min":0.46500000000000002},"min":{"1min":0.36199999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.59999999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.29699999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54200000000000004,"15min":0.52500000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.379},"max":{"1min":0.65800000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.433},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.51700000000000002,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.58799999999999997,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.54300000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.99099999999999999,"5min":1.089,"15min":1.089},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72199999999999998,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90200000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71899999999999997,"15min":0.753},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85799999999999998,"5min":1.1000000000000001,"15min":1.109},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.74399999999999999},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92000000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97599999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96599999999999997,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55500000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0209999999999999,"5min":1.0369999999999999,"15min":1.0669999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93600000000000005,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.67700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193988,"statfs":{"total":200000000,"available":198644735,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.28799999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65800000000000003,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.374},{"interface":"front","average":{"1min":0.495,"5min":0.499,"15min":0.47599999999999998},"min":{"1min":0.32100000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89800000000000002,"5min":2.294,"15min":2.294},"last":0.505}]},{"osd":2,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.497},"min":{"1min":0.36899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76100000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.33700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63700000000000001,"5min":2.056,"15min":2.056},"last":0.52500000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65200000000000002,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83599999999999997,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0049999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.748,"15min":0.78400000000000003},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.0840000000000001,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.66100000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0389999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.51400000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94899999999999995,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.054,"5min":2.415,"15min":2.415},"last":0.621},{"interface":"front","average":{"1min":0.749,"5min":0.76100000000000001,"15min":0.77300000000000002},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98399999999999999,"5min":2.347,"15min":2.347},"last":0.67900000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":2.367,"15min":2.367},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.60499999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0429999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.63300000000000001}]}]}],"pool_statfs":[]}} 2023-09-13T06:07:45.005 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T06:07:45.006 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-13T06:07:45.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb518a56640 1 Processor -- start 2023-09-13T06:07:45.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb518a56640 1 -- start start 2023-09-13T06:07:45.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb518a56640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb5140d0d10 0x7fb5141619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:45.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb518a56640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51415dd40 con 0x7fb5140d2cd0 2023-09-13T06:07:45.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb518a56640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51415e020 con 0x7fb51415ae10 2023-09-13T06:07:45.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb518a56640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51415e300 con 0x7fb5140d0d10 2023-09-13T06:07:45.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb512d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb5140d0d10 0x7fb5141619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:45.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb512d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb5140d0d10 0x7fb5141619b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44424/0 (socket says 172.21.15.130:44424) 2023-09-13T06:07:45.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb512d9d640 1 -- 172.21.15.130:0/2681248945 learned_addr learned my addr 172.21.15.130:0/2681248945 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:45.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb512d9d640 1 -- 172.21.15.130:0/2681248945 >> v1:172.21.15.164:6789/0 conn(0x7fb51415ae10 legacy=0x7fb5140d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:45.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb512d9d640 1 -- 172.21.15.130:0/2681248945 >> v1:172.21.15.130:6789/0 conn(0x7fb5140d2cd0 legacy=0x7fb5141612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.184+0000 7fb512d9d640 1 -- 172.21.15.130:0/2681248945 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51415e5e0 con 0x7fb5140d0d10 2023-09-13T06:07:45.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.188+0000 7fb512d9d640 1 --2- 172.21.15.130:0/2681248945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5140d0d10 0x7fb5141619b0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fb50c009e50 tx=0x7fb50c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9baa0ca103a074c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:45.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.188+0000 7fb511d9b640 1 -- 172.21.15.130:0/2681248945 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c0a5820 con 0x7fb5140d0d10 2023-09-13T06:07:45.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.188+0000 7fb511d9b640 1 -- 172.21.15.130:0/2681248945 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c0a5980 con 0x7fb5140d0d10 2023-09-13T06:07:45.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.188+0000 7fb511d9b640 1 -- 172.21.15.130:0/2681248945 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c0a5d10 con 0x7fb5140d0d10 2023-09-13T06:07:45.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.188+0000 7fb518a56640 1 -- 172.21.15.130:0/2681248945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5140d0d10 msgr2=0x7fb5141619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.188+0000 7fb518a56640 1 --2- 172.21.15.130:0/2681248945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5140d0d10 0x7fb5141619b0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fb50c009e50 tx=0x7fb50c01c940 comp rx=0 tx=0).stop 2023-09-13T06:07:45.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.188+0000 7fb518a56640 1 -- 172.21.15.130:0/2681248945 shutdown_connections 2023-09-13T06:07:45.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.188+0000 7fb518a56640 1 --2- 172.21.15.130:0/2681248945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5140d0d10 0x7fb5141619b0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.188+0000 7fb518a56640 1 -- 172.21.15.130:0/2681248945 >> 172.21.15.130:0/2681248945 conn(0x7fb514065990 msgr2=0x7fb514065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:45.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.188+0000 7fb518a56640 1 -- 172.21.15.130:0/2681248945 shutdown_connections 2023-09-13T06:07:45.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.188+0000 7fb518a56640 1 -- 172.21.15.130:0/2681248945 wait complete. 2023-09-13T06:07:45.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb518a56640 1 Processor -- start 2023-09-13T06:07:45.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb518a56640 1 -- start start 2023-09-13T06:07:45.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb518a56640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5140d0d10 0x7fb5141577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:45.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb518a56640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5140d2cd0 0x7fb51414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:45.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb518a56640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb51415ae10 0x7fb514153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:45.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb518a56640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5141580f0 con 0x7fb5140d2cd0 2023-09-13T06:07:45.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb518a56640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb514153fe0 con 0x7fb5140d0d10 2023-09-13T06:07:45.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb518a56640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb514157e10 con 0x7fb51415ae10 2023-09-13T06:07:45.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb509d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5140d2cd0 0x7fb51414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:45.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb509d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5140d2cd0 0x7fb51414f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44432/0 (socket says 172.21.15.130:44432) 2023-09-13T06:07:45.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb509d9b640 1 -- 172.21.15.130:0/844698560 learned_addr learned my addr 172.21.15.130:0/844698560 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:45.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb512d9d640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb51415ae10 0x7fb514153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:45.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb51259c640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5140d0d10 0x7fb5141577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:45.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb509d9b640 1 -- 172.21.15.130:0/844698560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb51415ae10 msgr2=0x7fb514153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb509d9b640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb51415ae10 0x7fb514153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb509d9b640 1 -- 172.21.15.130:0/844698560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5140d0d10 msgr2=0x7fb5141577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb509d9b640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5140d0d10 0x7fb5141577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb509d9b640 1 -- 172.21.15.130:0/844698560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c009b30 con 0x7fb5140d2cd0 2023-09-13T06:07:45.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb509d9b640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5140d2cd0 0x7fb51414f330 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c530 tx=0x7fb4fc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:45.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb50b7fe640 1 -- 172.21.15.130:0/844698560 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc005220 con 0x7fb5140d2cd0 2023-09-13T06:07:45.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb50b7fe640 1 -- 172.21.15.130:0/844698560 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc005380 con 0x7fb5140d2cd0 2023-09-13T06:07:45.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb518a56640 1 -- 172.21.15.130:0/844698560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb514154520 con 0x7fb5140d2cd0 2023-09-13T06:07:45.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb50b7fe640 1 -- 172.21.15.130:0/844698560 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc007270 con 0x7fb5140d2cd0 2023-09-13T06:07:45.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb518a56640 1 -- 172.21.15.130:0/844698560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb514154ae0 con 0x7fb5140d2cd0 2023-09-13T06:07:45.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.192+0000 7fb518a56640 1 -- 172.21.15.130:0/844698560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5140618a0 con 0x7fb5140d2cd0 2023-09-13T06:07:45.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.196+0000 7fb50b7fe640 1 -- 172.21.15.130:0/844698560 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb4fc0073d0 con 0x7fb5140d2cd0 2023-09-13T06:07:45.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.196+0000 7fb50b7fe640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4f4065b20 0x7fb4f4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:45.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.196+0000 7fb50b7fe640 1 -- 172.21.15.130:0/844698560 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4fc082a00 con 0x7fb5140d2cd0 2023-09-13T06:07:45.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.196+0000 7fb51259c640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4f4065b20 0x7fb4f4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:45.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.196+0000 7fb51259c640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4f4065b20 0x7fb4f4067fe0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb5040098e0 tx=0x7fb504009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:45.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.200+0000 7fb50b7fe640 1 -- 172.21.15.130:0/844698560 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb4fc050470 con 0x7fb5140d2cd0 2023-09-13T06:07:45.239 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:07:45.243 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:07:45.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.404+0000 7fb518a56640 1 -- 172.21.15.130:0/844698560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb514160b40 con 0x7fb5140d2cd0 2023-09-13T06:07:45.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb50b7fe640 1 -- 172.21.15.130:0/844698560 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb4fc053a90 con 0x7fb5140d2cd0 2023-09-13T06:07:45.410 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:07:45.410 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:07:45.411 INFO:teuthology.orchestra.run.smithi130.stdout: caps mds = "allow" 2023-09-13T06:07:45.411 INFO:teuthology.orchestra.run.smithi130.stdout: caps mon = "allow r" 2023-09-13T06:07:45.411 INFO:teuthology.orchestra.run.smithi130.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-13T06:07:45.412 INFO:teuthology.orchestra.run.smithi130.stderr:updated caps for client.0 2023-09-13T06:07:45.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 -- 172.21.15.130:0/844698560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4f4065b20 msgr2=0x7fb4f4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4f4065b20 0x7fb4f4067fe0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb5040098e0 tx=0x7fb504009060 comp rx=0 tx=0).stop 2023-09-13T06:07:45.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 -- 172.21.15.130:0/844698560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5140d2cd0 msgr2=0x7fb51414f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5140d2cd0 0x7fb51414f330 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c530 tx=0x7fb4fc00c9f0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 -- 172.21.15.130:0/844698560 shutdown_connections 2023-09-13T06:07:45.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb4f4065b20 0x7fb4f4067fe0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb51415ae10 0x7fb514153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5140d2cd0 0x7fb51414f330 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 --2- 172.21.15.130:0/844698560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5140d0d10 0x7fb5141577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 -- 172.21.15.130:0/844698560 >> 172.21.15.130:0/844698560 conn(0x7fb514065990 msgr2=0x7fb514065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:45.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 -- 172.21.15.130:0/844698560 shutdown_connections 2023-09-13T06:07:45.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.408+0000 7fb518a56640 1 -- 172.21.15.130:0/844698560 wait complete. 2023-09-13T06:07:45.431 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:45.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b38f11640 1 Processor -- start 2023-09-13T06:07:45.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b38f11640 1 -- start start 2023-09-13T06:07:45.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b38f11640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1b340d1750 0x7f1b3415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:45.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b38f11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b34146f30 0x7f1b340b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:45.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b38f11640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b340b63c0 con 0x7f1b340d1090 2023-09-13T06:07:45.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b38f11640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3415dea0 con 0x7f1b340d1750 2023-09-13T06:07:45.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b38f11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340d0c20 con 0x7f1b34146f30 2023-09-13T06:07:45.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b3259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1b340d1750 0x7f1b3415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:45.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b3259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1b340d1750 0x7f1b3415d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44444/0 (socket says 172.21.15.130:44444) 2023-09-13T06:07:45.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b3259c640 1 -- 172.21.15.130:0/1709747845 learned_addr learned my addr 172.21.15.130:0/1709747845 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:45.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b32d9d640 1 --2- 172.21.15.130:0/1709747845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b34146f30 0x7f1b340b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:45.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b3259c640 1 -- 172.21.15.130:0/1709747845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b34146f30 msgr2=0x7f1b340b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:45.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b3259c640 1 --2- 172.21.15.130:0/1709747845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b34146f30 0x7f1b340b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b3259c640 1 -- 172.21.15.130:0/1709747845 >> v1:172.21.15.164:6789/0 conn(0x7f1b340d1090 legacy=0x7f1b34146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.568+0000 7f1b3259c640 1 -- 172.21.15.130:0/1709747845 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b340b6610 con 0x7f1b340d1750 2023-09-13T06:07:45.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.572+0000 7f1b3259c640 1 --2- 172.21.15.130:0/1709747845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b340d1750 0x7f1b3415d960 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009870 tx=0x7f1b2401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f0a97fc650ff74 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:45.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.572+0000 7f1b31d9b640 1 -- 172.21.15.130:0/1709747845 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240aa670 con 0x7f1b340d1750 2023-09-13T06:07:45.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.572+0000 7f1b31d9b640 1 -- 172.21.15.130:0/1709747845 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b240aa7d0 con 0x7f1b340d1750 2023-09-13T06:07:45.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.572+0000 7f1b31d9b640 1 -- 172.21.15.130:0/1709747845 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240aab60 con 0x7f1b340d1750 2023-09-13T06:07:45.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.572+0000 7f1b38f11640 1 -- 172.21.15.130:0/1709747845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b340d1750 msgr2=0x7f1b3415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.572+0000 7f1b38f11640 1 --2- 172.21.15.130:0/1709747845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b340d1750 0x7f1b3415d960 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009870 tx=0x7f1b2401c510 comp rx=0 tx=0).stop 2023-09-13T06:07:45.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 -- 172.21.15.130:0/1709747845 shutdown_connections 2023-09-13T06:07:45.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 --2- 172.21.15.130:0/1709747845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b34146f30 0x7f1b340b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 --2- 172.21.15.130:0/1709747845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b340d1750 0x7f1b3415d960 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 -- 172.21.15.130:0/1709747845 >> 172.21.15.130:0/1709747845 conn(0x7f1b3406f170 msgr2=0x7f1b3406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:45.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 -- 172.21.15.130:0/1709747845 shutdown_connections 2023-09-13T06:07:45.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 -- 172.21.15.130:0/1709747845 wait complete. 2023-09-13T06:07:45.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 Processor -- start 2023-09-13T06:07:45.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 -- start start 2023-09-13T06:07:45.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b340d1090 0x7f1b340ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:45.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b340d1750 0x7f1b3415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:45.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b34146f30 0x7f1b340b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:45.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b34143f60 con 0x7f1b340d1750 2023-09-13T06:07:45.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3415bea0 con 0x7f1b340d1090 2023-09-13T06:07:45.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b38f11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3415c180 con 0x7f1b34146f30 2023-09-13T06:07:45.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b29d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b340d1750 0x7f1b3415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:45.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b29d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b340d1750 0x7f1b3415b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44456/0 (socket says 172.21.15.130:44456) 2023-09-13T06:07:45.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b29d9b640 1 -- 172.21.15.130:0/4255947922 learned_addr learned my addr 172.21.15.130:0/4255947922 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:45.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b32d9d640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b34146f30 0x7f1b340b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:45.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b3259c640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b340d1090 0x7f1b340ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:45.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b29d9b640 1 -- 172.21.15.130:0/4255947922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b34146f30 msgr2=0x7f1b340b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b29d9b640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b34146f30 0x7f1b340b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b29d9b640 1 -- 172.21.15.130:0/4255947922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b340d1090 msgr2=0x7f1b340ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.576+0000 7f1b29d9b640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b340d1090 0x7f1b340ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.580+0000 7f1b29d9b640 1 -- 172.21.15.130:0/4255947922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b240094d0 con 0x7f1b340d1750 2023-09-13T06:07:45.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.580+0000 7f1b29d9b640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b340d1750 0x7f1b3415b4e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00c7c0 tx=0x7f1b1c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:45.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.580+0000 7f1b2b7fe640 1 -- 172.21.15.130:0/4255947922 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c003b80 con 0x7f1b340d1750 2023-09-13T06:07:45.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.580+0000 7f1b2b7fe640 1 -- 172.21.15.130:0/4255947922 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c003ce0 con 0x7f1b340d1750 2023-09-13T06:07:45.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.580+0000 7f1b2b7fe640 1 -- 172.21.15.130:0/4255947922 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c00aa90 con 0x7f1b340d1750 2023-09-13T06:07:45.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.580+0000 7f1b38f11640 1 -- 172.21.15.130:0/4255947922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b340b7e40 con 0x7f1b340d1750 2023-09-13T06:07:45.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.580+0000 7f1b38f11640 1 -- 172.21.15.130:0/4255947922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3415c740 con 0x7f1b340d1750 2023-09-13T06:07:45.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.580+0000 7f1b38f11640 1 -- 172.21.15.130:0/4255947922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b341440d0 con 0x7f1b340d1750 2023-09-13T06:07:45.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.580+0000 7f1b2b7fe640 1 -- 172.21.15.130:0/4255947922 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1b1c00abf0 con 0x7f1b340d1750 2023-09-13T06:07:45.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.580+0000 7f1b2b7fe640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b14065b50 0x7f1b14068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:45.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.584+0000 7f1b2b7fe640 1 -- 172.21.15.130:0/4255947922 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b1c083000 con 0x7f1b340d1750 2023-09-13T06:07:45.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.584+0000 7f1b3259c640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b14065b50 0x7f1b14068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:45.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.584+0000 7f1b3259c640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b14065b50 0x7f1b14068010 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1b240ae000 tx=0x7f1b240b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:45.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.588+0000 7f1b2b7fe640 1 -- 172.21.15.130:0/4255947922 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1b1c050950 con 0x7f1b340d1750 2023-09-13T06:07:45.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.764+0000 7f1b38f11640 1 -- 172.21.15.130:0/4255947922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b340618a0 con 0x7f1b340d1750 2023-09-13T06:07:45.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.764+0000 7f1b2b7fe640 1 -- 172.21.15.130:0/4255947922 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f1b1c053f70 con 0x7f1b340d1750 2023-09-13T06:07:45.769 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:45.769 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1309237651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1309237651},{"type":"v1","addr":"172.21.15.130:6837","nonce":1309237651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1568650238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1568650238},{"type":"v1","addr":"172.21.15.164:6834","nonce":1568650238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1994572743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1994572743},{"type":"v1","addr":"172.21.15.130:6836","nonce":1994572743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:39.911036+0000","modified":"2023-09-13T06:07:42.935333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7773},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7773":{"gid":7773,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/4146626637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4146626637},{"type":"v1","addr":"172.21.15.164:6835","nonce":4146626637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-09-13T06:07:45.771 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 68 2023-09-13T06:07:45.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 -- 172.21.15.130:0/4255947922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b14065b50 msgr2=0x7f1b14068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b14065b50 0x7f1b14068010 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1b240ae000 tx=0x7f1b240b5040 comp rx=0 tx=0).stop 2023-09-13T06:07:45.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 -- 172.21.15.130:0/4255947922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b340d1750 msgr2=0x7f1b3415b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:45.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b340d1750 0x7f1b3415b4e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00c7c0 tx=0x7f1b1c00cbc0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 -- 172.21.15.130:0/4255947922 shutdown_connections 2023-09-13T06:07:45.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b14065b50 0x7f1b14068010 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b34146f30 0x7f1b340b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b340d1750 0x7f1b3415b4e0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 --2- 172.21.15.130:0/4255947922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b340d1090 0x7f1b340ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:45.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 -- 172.21.15.130:0/4255947922 >> 172.21.15.130:0/4255947922 conn(0x7f1b3406f170 msgr2=0x7f1b3415f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:45.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 -- 172.21.15.130:0/4255947922 shutdown_connections 2023-09-13T06:07:45.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:45.768+0000 7f1b38f11640 1 -- 172.21.15.130:0/4255947922 wait complete. 2023-09-13T06:07:46.190 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T06:07:39.911036+0000', 'modified': '2023-09-13T06:07:42.935333+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7773}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7773': {'gid': 7773, 'name': 'b', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.164:6835/4146626637', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6833', 'nonce': 4146626637}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 4146626637}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T06:07:46.191 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T06:07:46.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-13T06:07:46.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.328+0000 7fbe20eec640 1 Processor -- start 2023-09-13T06:07:46.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.328+0000 7fbe20eec640 1 -- start start 2023-09-13T06:07:46.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.328+0000 7fbe20eec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbe1c0b1d20 0x7fbe1c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.328+0000 7fbe20eec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe1c0cdfc0 0x7fbe1c0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.328+0000 7fbe20eec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c0ccfd0 con 0x7fbe1c159f20 2023-09-13T06:07:46.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.328+0000 7fbe20eec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1c0ce430 con 0x7fbe1c0b1d20 2023-09-13T06:07:46.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.328+0000 7fbe20eec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c0b00f0 con 0x7fbe1c0cdfc0 2023-09-13T06:07:46.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.328+0000 7fbe1a59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fbe1c159f20 0x7fbe1c0b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36182/0 (socket says 172.21.15.130:36182) 2023-09-13T06:07:46.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.328+0000 7fbe1a59c640 1 -- 172.21.15.130:0/4260206545 learned_addr learned my addr 172.21.15.130:0/4260206545 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:46.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.328+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/4260206545 >> v2:172.21.15.130:3300/0 conn(0x7fbe1c0b1d20 0x7fbe1c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.328+0000 7fbe1ad9d640 1 --2- 172.21.15.130:0/4260206545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe1c0cdfc0 0x7fbe1c0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.332+0000 7fbe19d9b640 1 -- 172.21.15.130:0/4260206545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe1c0cdfc0 msgr2=0x7fbe1c0b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:46.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.332+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/4260206545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe1c0cdfc0 0x7fbe1c0b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.332+0000 7fbe19d9b640 1 -- 172.21.15.130:0/4260206545 >> v1:172.21.15.130:6789/0 conn(0x7fbe1c159f20 legacy=0x7fbe1c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.332+0000 7fbe19d9b640 1 -- 172.21.15.130:0/4260206545 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c0ced90 con 0x7fbe1c0b1d20 2023-09-13T06:07:46.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.332+0000 7fbe1959a640 1 -- 172.21.15.130:0/4260206545 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834242511 0 0) 0x7fbe1c0ccfd0 con 0x7fbe1c159f20 2023-09-13T06:07:46.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.332+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/4260206545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe1c0b1d20 0x7fbe1c0ce7b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fbe100097f0 tx=0x7fbe1001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fbe58b8d490fc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:46.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.332+0000 7fbe1959a640 1 -- 172.21.15.130:0/4260206545 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100ab600 con 0x7fbe1c0b1d20 2023-09-13T06:07:46.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.332+0000 7fbe1959a640 1 -- 172.21.15.130:0/4260206545 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe100a7050 con 0x7fbe1c0b1d20 2023-09-13T06:07:46.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.332+0000 7fbe1959a640 1 -- 172.21.15.130:0/4260206545 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100ab980 con 0x7fbe1c0b1d20 2023-09-13T06:07:46.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.332+0000 7fbe20eec640 1 -- 172.21.15.130:0/4260206545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe1c0b1d20 msgr2=0x7fbe1c0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.332+0000 7fbe20eec640 1 --2- 172.21.15.130:0/4260206545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe1c0b1d20 0x7fbe1c0ce7b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fbe100097f0 tx=0x7fbe1001c480 comp rx=0 tx=0).stop 2023-09-13T06:07:46.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 -- 172.21.15.130:0/4260206545 shutdown_connections 2023-09-13T06:07:46.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 --2- 172.21.15.130:0/4260206545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe1c0cdfc0 0x7fbe1c0b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 --2- 172.21.15.130:0/4260206545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe1c0b1d20 0x7fbe1c0ce7b0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 -- 172.21.15.130:0/4260206545 >> 172.21.15.130:0/4260206545 conn(0x7fbe1c065990 msgr2=0x7fbe1c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:46.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 -- 172.21.15.130:0/4260206545 shutdown_connections 2023-09-13T06:07:46.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 -- 172.21.15.130:0/4260206545 wait complete. 2023-09-13T06:07:46.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 Processor -- start 2023-09-13T06:07:46.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 -- start start 2023-09-13T06:07:46.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe1c0b1d20 0x7fbe1c070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe1c0cdfc0 0x7fbe1c151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe1c159f20 0x7fbe1c1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c155710 con 0x7fbe1c0cdfc0 2023-09-13T06:07:46.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c154df0 con 0x7fbe1c159f20 2023-09-13T06:07:46.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe20eec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c1558f0 con 0x7fbe1c0b1d20 2023-09-13T06:07:46.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe19d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe1c0cdfc0 0x7fbe1c151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe19d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe1c0cdfc0 0x7fbe1c151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44474/0 (socket says 172.21.15.130:44474) 2023-09-13T06:07:46.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe19d9b640 1 -- 172.21.15.130:0/3270089919 learned_addr learned my addr 172.21.15.130:0/3270089919 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:46.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe1ad9d640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe1c159f20 0x7fbe1c1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe1c0b1d20 0x7fbe1c070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe19d9b640 1 -- 172.21.15.130:0/3270089919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe1c0b1d20 msgr2=0x7fbe1c070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe1c0b1d20 0x7fbe1c070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe19d9b640 1 -- 172.21.15.130:0/3270089919 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe1c159f20 msgr2=0x7fbe1c1548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe1c159f20 0x7fbe1c1548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.336+0000 7fbe19d9b640 1 -- 172.21.15.130:0/3270089919 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe10009420 con 0x7fbe1c0cdfc0 2023-09-13T06:07:46.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.340+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe1c0cdfc0 0x7fbe1c151150 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbe100ae040 tx=0x7fbe10019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:46.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.340+0000 7fbe0affd640 1 -- 172.21.15.130:0/3270089919 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100b4430 con 0x7fbe1c0cdfc0 2023-09-13T06:07:46.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.340+0000 7fbe0affd640 1 -- 172.21.15.130:0/3270089919 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe100b4590 con 0x7fbe1c0cdfc0 2023-09-13T06:07:46.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.340+0000 7fbe0affd640 1 -- 172.21.15.130:0/3270089919 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100b4940 con 0x7fbe1c0cdfc0 2023-09-13T06:07:46.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.340+0000 7fbe20eec640 1 -- 172.21.15.130:0/3270089919 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c155bd0 con 0x7fbe1c0cdfc0 2023-09-13T06:07:46.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.340+0000 7fbe20eec640 1 -- 172.21.15.130:0/3270089919 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c156190 con 0x7fbe1c0cdfc0 2023-09-13T06:07:46.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.340+0000 7fbe0affd640 1 -- 172.21.15.130:0/3270089919 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbe100b2040 con 0x7fbe1c0cdfc0 2023-09-13T06:07:46.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.340+0000 7fbe0affd640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdfc065b20 0x7fbdfc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.340+0000 7fbe0affd640 1 -- 172.21.15.130:0/3270089919 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe1011d100 con 0x7fbe1c0cdfc0 2023-09-13T06:07:46.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.340+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdfc065b20 0x7fbdfc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 Processor -- start 2023-09-13T06:07:46.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdfc065b20 0x7fbdfc067fe0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c000f70 tx=0x7fbe0c007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:46.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 -- start start 2023-09-13T06:07:46.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c0a1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1e70 0x556a9c085d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 0x556a9c086690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9bf1f1e0 con 0x556a9c0a1550 2023-09-13T06:07:46.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9beae4c0 con 0x556a9c0862b0 2023-09-13T06:07:46.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a9beab9f0 con 0x556a9c0a1e70 2023-09-13T06:07:46.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c0a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c0a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44480/0 (socket says 172.21.15.130:44480) 2023-09-13T06:07:46.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1a59c640 1 -- 172.21.15.130:0/1140437043 learned_addr learned my addr 172.21.15.130:0/1140437043 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:46.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1ad9d640 1 --2- 172.21.15.130:0/1140437043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 0x556a9c086690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/1140437043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1e70 0x556a9c085d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1a59c640 1 -- 172.21.15.130:0/1140437043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1e70 msgr2=0x556a9c085d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:46.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/1140437043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1e70 0x556a9c085d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1a59c640 1 -- 172.21.15.130:0/1140437043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 msgr2=0x556a9c086690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:46.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/1140437043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 0x556a9c086690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1a59c640 1 -- 172.21.15.130:0/1140437043 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a9bba1890 con 0x556a9c0a1550 2023-09-13T06:07:46.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1ad9d640 1 --2- 172.21.15.130:0/1140437043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 0x556a9c086690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:46.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/1140437043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c0a1930 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0077f0 tx=0x7fbe0c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e92f0ce67e9f55 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:46.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbdfbfff640 1 -- 172.21.15.130:0/1140437043 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c001d30 con 0x556a9c0a1550 2023-09-13T06:07:46.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbdfbfff640 1 -- 172.21.15.130:0/1140437043 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c013b50 con 0x556a9c0a1550 2023-09-13T06:07:46.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbdfbfff640 1 -- 172.21.15.130:0/1140437043 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c012350 con 0x556a9c0a1550 2023-09-13T06:07:46.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 -- 172.21.15.130:0/1140437043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 msgr2=0x556a9c0a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 --2- 172.21.15.130:0/1140437043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c0a1930 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0077f0 tx=0x7fbe0c012000 comp rx=0 tx=0).stop 2023-09-13T06:07:46.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 -- 172.21.15.130:0/1140437043 shutdown_connections 2023-09-13T06:07:46.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 --2- 172.21.15.130:0/1140437043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 0x556a9c086690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 --2- 172.21.15.130:0/1140437043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1e70 0x556a9c085d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 --2- 172.21.15.130:0/1140437043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c0a1930 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 -- 172.21.15.130:0/1140437043 >> 172.21.15.130:0/1140437043 conn(0x556a9c04ec40 msgr2=0x556a9c05dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:46.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 -- 172.21.15.130:0/1140437043 shutdown_connections 2023-09-13T06:07:46.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.344+0000 7fbe24274000 1 -- 172.21.15.130:0/1140437043 wait complete. 2023-09-13T06:07:46.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 -- start start 2023-09-13T06:07:46.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 Processor -- start 2023-09-13T06:07:46.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0862b0 0x556a9c085d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1550 0x556a9c05b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0a1e70 0x556a9c05b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9bea72e0 con 0x556a9c0862b0 2023-09-13T06:07:46.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9be61fe0 con 0x556a9c0a1e70 2023-09-13T06:07:46.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a9be61c80 con 0x556a9c0a1550 2023-09-13T06:07:46.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 10 client.0 _ll_register_callbacks cb 0x556a9c043260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:07:46.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe1a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0862b0 0x556a9c085d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe1a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0862b0 0x556a9c085d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44488/0 (socket says 172.21.15.130:44488) 2023-09-13T06:07:46.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe1a59c640 1 -- 172.21.15.130:0/1638772138 learned_addr learned my addr 172.21.15.130:0/1638772138 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:46.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe1ad9d640 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0a1e70 0x556a9c05b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1550 0x556a9c05b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe1a59c640 1 -- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1550 msgr2=0x556a9c05b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:46.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1550 0x556a9c05b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe1a59c640 1 -- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0a1e70 msgr2=0x556a9c05b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:46.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0a1e70 0x556a9c05b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe1a59c640 1 -- 172.21.15.130:0/1638772138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c004c80 con 0x556a9c0862b0 2023-09-13T06:07:46.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1550 0x556a9c05b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:46.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0862b0 0x556a9c085d40 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c024040 tx=0x7fbe0c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6abdeab60a33ab4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:46.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbdf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:07:46.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbdf97fa640 1 -- 172.21.15.130:0/1638772138 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c001d30 con 0x556a9c0862b0 2023-09-13T06:07:46.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbdf97fa640 1 -- 172.21.15.130:0/1638772138 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe0c01b050 con 0x556a9c0862b0 2023-09-13T06:07:46.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 -- 172.21.15.130:0/1638772138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a9be3ea50 con 0x556a9c0862b0 2023-09-13T06:07:46.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbdf97fa640 1 -- 172.21.15.130:0/1638772138 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe0c020a60 con 0x556a9c0862b0 2023-09-13T06:07:46.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 10 client.7914 fetch_fsmap learned FSMap version 68 2023-09-13T06:07:46.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 -- 172.21.15.130:0/1638772138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x556a9be6a210 con 0x556a9c0862b0 2023-09-13T06:07:46.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbdf97fa640 1 -- 172.21.15.130:0/1638772138 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a9be3ea50 con 0x556a9c0862b0 2023-09-13T06:07:46.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbdf97fa640 1 -- 172.21.15.130:0/1638772138 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbe0c012070 con 0x556a9c0862b0 2023-09-13T06:07:46.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 10 client.7914 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T06:07:46.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 10 client.7914 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T06:07:46.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 20 client.7914 populate_metadata read hostname 'smithi130' 2023-09-13T06:07:46.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:6833/4146626637,v1:172.21.15.164:6835/4146626637] conn(0x556a9c05c320 0x556a9c0b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 4 client.7914 mds_command: new command op to 7773 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T06:07:46.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe24274000 1 -- 172.21.15.130:0/1638772138 --> [v2:172.21.15.164:6833/4146626637,v1:172.21.15.164:6835/4146626637] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a9be5e820 con 0x556a9c05c320 2023-09-13T06:07:46.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.348+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:6833/4146626637,v1:172.21.15.164:6835/4146626637] conn(0x556a9c05c320 0x556a9c0b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:6833/4146626637,v1:172.21.15.164:6835/4146626637] conn(0x556a9c05c320 0x556a9c0b3600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb84340e7addd8f0 server_cookie=b857e17341c8102b in_seq=0 out_seq=0 2023-09-13T06:07:46.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbdf97fa640 10 client.7914 ms_handle_connect on v2:172.21.15.164:6833/4146626637 2023-09-13T06:07:46.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbdf97fa640 1 -- 172.21.15.130:0/1638772138 <== mds.0 v2:172.21.15.164:6833/4146626637 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556a9be5e820 con 0x556a9c05c320 2023-09-13T06:07:46.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbdf97fa640 10 client.7914 handle_command_reply: tid=0 2023-09-13T06:07:46.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 1 client.7914 shutdown 2023-09-13T06:07:46.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 1 -- 172.21.15.130:0/1638772138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0862b0 msgr2=0x556a9c085d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0862b0 0x556a9c085d40 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c024040 tx=0x7fbe0c000ee0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 1 -- 172.21.15.130:0/1638772138 shutdown_connections 2023-09-13T06:07:46.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:6833/4146626637,v1:172.21.15.164:6835/4146626637] conn(0x556a9c05c320 0x556a9c0b3600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0a1e70 0x556a9c05b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1550 0x556a9c05b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 1 --2- 172.21.15.130:0/1638772138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0862b0 0x556a9c085d40 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbdf97fa640 0 client.7914 ms_handle_reset on v2:172.21.15.164:6833/4146626637 2023-09-13T06:07:46.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 1 -- 172.21.15.130:0/1638772138 >> 172.21.15.130:0/1638772138 conn(0x556a9c04ec40 msgr2=0x556a9c087130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:46.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 1 -- 172.21.15.130:0/1638772138 shutdown_connections 2023-09-13T06:07:46.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 1 -- 172.21.15.130:0/1638772138 wait complete. 2023-09-13T06:07:46.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.352+0000 7fbe24274000 20 client.7914 trim_cache size 0 max 16384 2023-09-13T06:07:46.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 Processor -- start 2023-09-13T06:07:46.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 -- start start 2023-09-13T06:07:46.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 0x556a9c05b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c05a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1e70 0x556a9c05a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9bb62940 con 0x556a9c0a1550 2023-09-13T06:07:46.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9c0b7f90 con 0x556a9c0862b0 2023-09-13T06:07:46.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a9bea46e0 con 0x556a9c0a1e70 2023-09-13T06:07:46.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe19d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c05a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe19d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c05a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44504/0 (socket says 172.21.15.130:44504) 2023-09-13T06:07:46.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe19d9b640 1 -- 172.21.15.130:0/1726794874 learned_addr learned my addr 172.21.15.130:0/1726794874 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:46.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/1726794874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 0x556a9c05b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe1ad9d640 1 --2- 172.21.15.130:0/1726794874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1e70 0x556a9c05a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe19d9b640 1 -- 172.21.15.130:0/1726794874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1e70 msgr2=0x556a9c05a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:46.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/1726794874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1e70 0x556a9c05a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe19d9b640 1 -- 172.21.15.130:0/1726794874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 msgr2=0x556a9c05b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:46.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/1726794874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 0x556a9c05b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe19d9b640 1 -- 172.21.15.130:0/1726794874 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a9be504a0 con 0x556a9c0a1550 2023-09-13T06:07:46.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe1ad9d640 1 --2- 172.21.15.130:0/1726794874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1e70 0x556a9c05a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:46.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/1726794874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 0x556a9c05b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:07:46.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe19d9b640 1 --2- 172.21.15.130:0/1726794874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c05a020 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fbe100eac20 tx=0x7fbe100c0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa61ba7342e25b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:46.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe08ff9640 1 -- 172.21.15.130:0/1726794874 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100f6650 con 0x556a9c0a1550 2023-09-13T06:07:46.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe08ff9640 1 -- 172.21.15.130:0/1726794874 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe100ecac0 con 0x556a9c0a1550 2023-09-13T06:07:46.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe08ff9640 1 -- 172.21.15.130:0/1726794874 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100f2120 con 0x556a9c0a1550 2023-09-13T06:07:46.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 -- 172.21.15.130:0/1726794874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 msgr2=0x556a9c05a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 --2- 172.21.15.130:0/1726794874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c05a020 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fbe100eac20 tx=0x7fbe100c0040 comp rx=0 tx=0).stop 2023-09-13T06:07:46.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 -- 172.21.15.130:0/1726794874 shutdown_connections 2023-09-13T06:07:46.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 --2- 172.21.15.130:0/1726794874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0a1e70 0x556a9c05a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 --2- 172.21.15.130:0/1726794874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1550 0x556a9c05a020 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 --2- 172.21.15.130:0/1726794874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0862b0 0x556a9c05b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 -- 172.21.15.130:0/1726794874 >> 172.21.15.130:0/1726794874 conn(0x556a9c04ec40 msgr2=0x556a9c058500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:46.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 -- 172.21.15.130:0/1726794874 shutdown_connections 2023-09-13T06:07:46.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.368+0000 7fbe24274000 1 -- 172.21.15.130:0/1726794874 wait complete. 2023-09-13T06:07:46.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 -- start start 2023-09-13T06:07:46.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 Processor -- start 2023-09-13T06:07:46.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0862b0 0x556a9c0ff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0a1550 0x556a9c0ffc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1e70 0x556a9c0b3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9bea72e0 con 0x556a9c0a1e70 2023-09-13T06:07:46.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9be674b0 con 0x556a9c0a1550 2023-09-13T06:07:46.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a9bea6170 con 0x556a9c0862b0 2023-09-13T06:07:46.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 10 client.0 _ll_register_callbacks cb 0x556a9be5dea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:07:46.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe1a59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0862b0 0x556a9c0ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe1ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1e70 0x556a9c0b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe1a59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0862b0 0x556a9c0ff710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:35224/0 (socket says 172.21.15.130:35224) 2023-09-13T06:07:46.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe19d9b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0a1550 0x556a9c0ffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe1a59c640 1 -- 172.21.15.130:0/3435694393 learned_addr learned my addr 172.21.15.130:0/3435694393 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:46.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe1ad9d640 1 -- 172.21.15.130:0/3435694393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0862b0 msgr2=0x556a9c0ff710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:46.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe1ad9d640 1 --2- 172.21.15.130:0/3435694393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0862b0 0x556a9c0ff710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe1ad9d640 1 -- 172.21.15.130:0/3435694393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0a1550 msgr2=0x556a9c0ffc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:46.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe1ad9d640 1 --2- 172.21.15.130:0/3435694393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0a1550 0x556a9c0ffc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe1ad9d640 1 -- 172.21.15.130:0/3435694393 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c156190 con 0x556a9c0a1e70 2023-09-13T06:07:46.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe1ad9d640 1 --2- 172.21.15.130:0/3435694393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1e70 0x556a9c0b3910 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fbe14004660 tx=0x7fbe14017780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33624b84a70f59ce server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:46.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbdf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:07:46.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbdf97fa640 1 -- 172.21.15.130:0/3435694393 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400e040 con 0x556a9c0a1e70 2023-09-13T06:07:46.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbdf97fa640 1 -- 172.21.15.130:0/3435694393 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe14021670 con 0x556a9c0a1e70 2023-09-13T06:07:46.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 -- 172.21.15.130:0/3435694393 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a9be62900 con 0x556a9c0a1e70 2023-09-13T06:07:46.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbdf97fa640 1 -- 172.21.15.130:0/3435694393 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe14017ed0 con 0x556a9c0a1e70 2023-09-13T06:07:46.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 10 client.7920 fetch_fsmap learned FSMap version 68 2023-09-13T06:07:46.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 -- 172.21.15.130:0/3435694393 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x556a9bba1cc0 con 0x556a9c0a1e70 2023-09-13T06:07:46.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbdf97fa640 1 -- 172.21.15.130:0/3435694393 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a9be62900 con 0x556a9c0a1e70 2023-09-13T06:07:46.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbdf97fa640 1 -- 172.21.15.130:0/3435694393 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbe14014040 con 0x556a9c0a1e70 2023-09-13T06:07:46.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 10 client.7920 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T06:07:46.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 10 client.7920 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T06:07:46.394 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 20 client.7920 populate_metadata read hostname 'smithi130' 2023-09-13T06:07:46.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 --2- 172.21.15.130:0/3435694393 >> [v2:172.21.15.164:6833/4146626637,v1:172.21.15.164:6835/4146626637] conn(0x556a9c1065e0 0x556a9c1089d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 4 client.7920 mds_command: new command op to 7773 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T06:07:46.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe24274000 1 -- 172.21.15.130:0/3435694393 --> [v2:172.21.15.164:6833/4146626637,v1:172.21.15.164:6835/4146626637] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556a9bea02c0 con 0x556a9c1065e0 2023-09-13T06:07:46.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.372+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/3435694393 >> [v2:172.21.15.164:6833/4146626637,v1:172.21.15.164:6835/4146626637] conn(0x556a9c1065e0 0x556a9c1089d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbdf97fa640 10 client.7920 ms_handle_connect on v2:172.21.15.164:6833/4146626637 2023-09-13T06:07:46.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe1a59c640 1 --2- 172.21.15.130:0/3435694393 >> [v2:172.21.15.164:6833/4146626637,v1:172.21.15.164:6835/4146626637] conn(0x556a9c1065e0 0x556a9c1089d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=639f16d834aed0de server_cookie=f6e2b4dce0192e43 in_seq=0 out_seq=0 2023-09-13T06:07:46.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbdf97fa640 1 -- 172.21.15.130:0/3435694393 <== mds.0 v2:172.21.15.164:6833/4146626637 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x556a9bea02c0 con 0x556a9c1065e0 2023-09-13T06:07:46.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbdf97fa640 10 client.7920 handle_command_reply: tid=0 2023-09-13T06:07:46.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 1 client.7920 shutdown 2023-09-13T06:07:46.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 1 -- 172.21.15.130:0/3435694393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1e70 msgr2=0x556a9c0b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 1 --2- 172.21.15.130:0/3435694393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1e70 0x556a9c0b3910 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fbe14004660 tx=0x7fbe14017780 comp rx=0 tx=0).stop 2023-09-13T06:07:46.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 1 -- 172.21.15.130:0/3435694393 shutdown_connections 2023-09-13T06:07:46.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 1 --2- 172.21.15.130:0/3435694393 >> [v2:172.21.15.164:6833/4146626637,v1:172.21.15.164:6835/4146626637] conn(0x556a9c1065e0 0x556a9c1089d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 1 --2- 172.21.15.130:0/3435694393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a9c0a1550 0x556a9c0ffc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 1 --2- 172.21.15.130:0/3435694393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a9c0a1e70 0x556a9c0b3910 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 1 --2- 172.21.15.130:0/3435694393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556a9c0862b0 0x556a9c0ff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbdf97fa640 0 client.7920 ms_handle_reset on v2:172.21.15.164:6833/4146626637 2023-09-13T06:07:46.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 1 -- 172.21.15.130:0/3435694393 >> 172.21.15.130:0/3435694393 conn(0x556a9c04ec40 msgr2=0x556a9c05c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:46.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 1 -- 172.21.15.130:0/3435694393 shutdown_connections 2023-09-13T06:07:46.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 1 -- 172.21.15.130:0/3435694393 wait complete. 2023-09-13T06:07:46.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe24274000 20 client.7920 trim_cache size 0 max 16384 2023-09-13T06:07:46.399 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:07:46.399 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:07:46.399 INFO:teuthology.orchestra.run.smithi130.stdout: "whoami": 0, 2023-09-13T06:07:46.399 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 7773, 2023-09-13T06:07:46.400 INFO:teuthology.orchestra.run.smithi130.stdout: "want_state": "up:active", 2023-09-13T06:07:46.400 INFO:teuthology.orchestra.run.smithi130.stdout: "state": "up:active", 2023-09-13T06:07:46.400 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs", 2023-09-13T06:07:46.400 INFO:teuthology.orchestra.run.smithi130.stdout: "rank_uptime": 5.8241599749999997, 2023-09-13T06:07:46.400 INFO:teuthology.orchestra.run.smithi130.stdout: "mdsmap_epoch": 68, 2023-09-13T06:07:46.401 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch": 137, 2023-09-13T06:07:46.401 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch_barrier": 137, 2023-09-13T06:07:46.401 INFO:teuthology.orchestra.run.smithi130.stdout: "uptime": 10.766361806999999 2023-09-13T06:07:46.401 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:07:46.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 -- 172.21.15.130:0/3270089919 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdfc065b20 msgr2=0x7fbdfc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdfc065b20 0x7fbdfc067fe0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c000f70 tx=0x7fbe0c007df0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 -- 172.21.15.130:0/3270089919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe1c0cdfc0 msgr2=0x7fbe1c151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe1c0cdfc0 0x7fbe1c151150 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbe100ae040 tx=0x7fbe10019220 comp rx=0 tx=0).stop 2023-09-13T06:07:46.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 -- 172.21.15.130:0/3270089919 shutdown_connections 2023-09-13T06:07:46.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbdfc065b20 0x7fbdfc067fe0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe1c159f20 0x7fbe1c1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe1c0cdfc0 0x7fbe1c151150 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 --2- 172.21.15.130:0/3270089919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe1c0b1d20 0x7fbe1c070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 -- 172.21.15.130:0/3270089919 >> 172.21.15.130:0/3270089919 conn(0x7fbe1c065990 msgr2=0x7fbe1c153760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:46.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 -- 172.21.15.130:0/3270089919 shutdown_connections 2023-09-13T06:07:46.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.376+0000 7fbe20eec640 1 -- 172.21.15.130:0/3270089919 wait complete. 2023-09-13T06:07:46.405 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:07:46.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.540+0000 7ff16abac640 1 Processor -- start 2023-09-13T06:07:46.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.540+0000 7ff16abac640 1 -- start start 2023-09-13T06:07:46.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.544+0000 7ff16abac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff164146540 0x7ff164070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.544+0000 7ff16abac640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16406f640 con 0x7ff164070b90 2023-09-13T06:07:46.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.544+0000 7ff16abac640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff164070fa0 con 0x7ff1641436e0 2023-09-13T06:07:46.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.544+0000 7ff16abac640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16406f890 con 0x7ff164146540 2023-09-13T06:07:46.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.544+0000 7ff15bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff164146540 0x7ff164070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.544+0000 7ff169149640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff164070b90 0x7ff164160eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36196/0 (socket says 172.21.15.130:36196) 2023-09-13T06:07:46.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.544+0000 7ff169149640 1 -- 172.21.15.130:0/2750352805 learned_addr learned my addr 172.21.15.130:0/2750352805 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:46.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.544+0000 7ff15bfff640 1 -- 172.21.15.130:0/2750352805 >> v1:172.21.15.164:6789/0 conn(0x7ff1641436e0 legacy=0x7ff1640ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.544+0000 7ff15bfff640 1 -- 172.21.15.130:0/2750352805 >> v1:172.21.15.130:6789/0 conn(0x7ff164070b90 legacy=0x7ff164160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.544+0000 7ff15bfff640 1 -- 172.21.15.130:0/2750352805 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16406fb70 con 0x7ff164146540 2023-09-13T06:07:46.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.544+0000 7ff15b7fe640 1 -- 172.21.15.130:0/2750352805 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867496837 0 0) 0x7ff16406f640 con 0x7ff164070b90 2023-09-13T06:07:46.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff15bfff640 1 --2- 172.21.15.130:0/2750352805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff164146540 0x7ff164070650 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff1540097c0 tx=0x7ff15401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2d3075f8dd16c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:46.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff15b7fe640 1 -- 172.21.15.130:0/2750352805 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1540ab600 con 0x7ff164146540 2023-09-13T06:07:46.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff15b7fe640 1 -- 172.21.15.130:0/2750352805 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1540a7050 con 0x7ff164146540 2023-09-13T06:07:46.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff15b7fe640 1 -- 172.21.15.130:0/2750352805 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1540ab980 con 0x7ff164146540 2023-09-13T06:07:46.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff16abac640 1 -- 172.21.15.130:0/2750352805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff164146540 msgr2=0x7ff164070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff16abac640 1 --2- 172.21.15.130:0/2750352805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff164146540 0x7ff164070650 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff1540097c0 tx=0x7ff15401c360 comp rx=0 tx=0).stop 2023-09-13T06:07:46.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff16abac640 1 -- 172.21.15.130:0/2750352805 shutdown_connections 2023-09-13T06:07:46.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff16abac640 1 --2- 172.21.15.130:0/2750352805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff164146540 0x7ff164070650 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff16abac640 1 -- 172.21.15.130:0/2750352805 >> 172.21.15.130:0/2750352805 conn(0x7ff1640b0bc0 msgr2=0x7ff1640b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:46.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff16abac640 1 -- 172.21.15.130:0/2750352805 shutdown_connections 2023-09-13T06:07:46.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff16abac640 1 -- 172.21.15.130:0/2750352805 wait complete. 2023-09-13T06:07:46.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff16abac640 1 Processor -- start 2023-09-13T06:07:46.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff16abac640 1 -- start start 2023-09-13T06:07:46.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff16abac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff164070b90 0x7ff16415cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.548+0000 7ff16abac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1641436e0 0x7ff164140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff16abac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff164146540 0x7ff1641416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff16abac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1641425a0 con 0x7ff1641436e0 2023-09-13T06:07:46.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff16abac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff164139380 con 0x7ff164146540 2023-09-13T06:07:46.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff16abac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff164138490 con 0x7ff164070b90 2023-09-13T06:07:46.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff15bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1641436e0 0x7ff164140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff15bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1641436e0 0x7ff164140d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44524/0 (socket says 172.21.15.130:44524) 2023-09-13T06:07:46.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff15bfff640 1 -- 172.21.15.130:0/2325297753 learned_addr learned my addr 172.21.15.130:0/2325297753 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:46.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff169149640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff164146540 0x7ff1641416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff168948640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff164070b90 0x7ff16415cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff15bfff640 1 -- 172.21.15.130:0/2325297753 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff164070b90 msgr2=0x7ff16415cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff15bfff640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff164070b90 0x7ff16415cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff15bfff640 1 -- 172.21.15.130:0/2325297753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff164146540 msgr2=0x7ff1641416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff15bfff640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff164146540 0x7ff1641416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff15bfff640 1 -- 172.21.15.130:0/2325297753 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154009420 con 0x7ff1641436e0 2023-09-13T06:07:46.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff15bfff640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1641436e0 0x7ff164140d20 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff154018f70 tx=0x7ff154019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:46.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff1597fa640 1 -- 172.21.15.130:0/2325297753 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1540b4840 con 0x7ff1641436e0 2023-09-13T06:07:46.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff1597fa640 1 -- 172.21.15.130:0/2325297753 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1540b49c0 con 0x7ff1641436e0 2023-09-13T06:07:46.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff1597fa640 1 -- 172.21.15.130:0/2325297753 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1540b4d70 con 0x7ff1641436e0 2023-09-13T06:07:46.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff16abac640 1 -- 172.21.15.130:0/2325297753 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff164138770 con 0x7ff1641436e0 2023-09-13T06:07:46.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff16abac640 1 -- 172.21.15.130:0/2325297753 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff164138d30 con 0x7ff1641436e0 2023-09-13T06:07:46.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff16abac640 1 -- 172.21.15.130:0/2325297753 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff164139510 con 0x7ff1641436e0 2023-09-13T06:07:46.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.552+0000 7ff1597fa640 1 -- 172.21.15.130:0/2325297753 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff1540b2040 con 0x7ff1641436e0 2023-09-13T06:07:46.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.556+0000 7ff1597fa640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b50 0x7ff150068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:46.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.556+0000 7ff1597fa640 1 -- 172.21.15.130:0/2325297753 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff15411d3d0 con 0x7ff1641436e0 2023-09-13T06:07:46.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.556+0000 7ff168948640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b50 0x7ff150068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:46.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.556+0000 7ff168948640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b50 0x7ff150068010 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff16406cd40 tx=0x7ff160009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:46.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.560+0000 7ff1597fa640 1 -- 172.21.15.130:0/2325297753 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff1540eadc0 con 0x7ff1641436e0 2023-09-13T06:07:46.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.744+0000 7ff16abac640 1 -- 172.21.15.130:0/2325297753 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff1640618a0 con 0x7ff1641436e0 2023-09-13T06:07:46.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.744+0000 7ff1597fa640 1 -- 172.21.15.130:0/2325297753 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff1540b8060 con 0x7ff1641436e0 2023-09-13T06:07:46.747 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:07:46.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 -- 172.21.15.130:0/2325297753 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b50 msgr2=0x7ff150068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b50 0x7ff150068010 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff16406cd40 tx=0x7ff160009040 comp rx=0 tx=0).stop 2023-09-13T06:07:46.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 -- 172.21.15.130:0/2325297753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1641436e0 msgr2=0x7ff164140d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:46.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1641436e0 0x7ff164140d20 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff154018f70 tx=0x7ff154019100 comp rx=0 tx=0).stop 2023-09-13T06:07:46.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 -- 172.21.15.130:0/2325297753 shutdown_connections 2023-09-13T06:07:46.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff150065b50 0x7ff150068010 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff164146540 0x7ff1641416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1641436e0 0x7ff164140d20 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 --2- 172.21.15.130:0/2325297753 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff164070b90 0x7ff16415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:46.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 -- 172.21.15.130:0/2325297753 >> 172.21.15.130:0/2325297753 conn(0x7ff1640b0bc0 msgr2=0x7ff164160b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:46.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 -- 172.21.15.130:0/2325297753 shutdown_connections 2023-09-13T06:07:46.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:46.748+0000 7ff16abac640 1 -- 172.21.15.130:0/2325297753 wait complete. 2023-09-13T06:07:46.768 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:07:46.768 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:07:46.768 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:07:46.769 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T06:07:46.769 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:07:46.770 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:07:46.770 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:07:46.770 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:07:46.771 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:07:46.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:46.771 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:07:46.781 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:07:46.781 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:07:46.782 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:07:46.782 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:46.782 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:07:46.782 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:46.783 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:46.783 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:46.783 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:07:46.783 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:46.784 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:46.784 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:07:46.784 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:46.784 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:46.784 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:07:46.785 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:46.785 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:07:46.785 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42040sec preferred_lft 42040sec 2023-09-13T06:07:46.785 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:07:46.785 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:46.786 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:07:46.789 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:46.790 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:07:46.790 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:46.790 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:07:46.790 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:46.791 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:07:46.791 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:46.791 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:07:46.791 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:46.791 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:07:46.792 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:07:46.792 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:07:46.792 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:46.792 INFO:teuthology.orchestra.run.smithi130.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:07:46.793 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:07:46.793 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:07:46.793 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:46.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:46.795 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:07:46.854 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:07:46.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:46.858 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:07:46.915 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:07:46.915 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:07:46.915 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:07:46.915 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:07:46.916 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:07:46.916 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:07:46.916 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:46.916 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:46.916 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:46.917 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:07:46.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:46.917 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:07:46.918 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:07:46.918 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:07:46.918 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:07:46.919 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:07:46.919 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:07:47.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:47.008 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:07:47.018 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T06:07:47.018 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:07:47.018 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:07:47.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:47.019 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-09-13T06:07:47.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:07:47.080 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T06:07:47.132 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:07:47.132 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:07:47.133 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:07:47.183 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:07:47.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:47.184 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:07:47.273 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:07:47.274 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:07:47.274 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:07:47.288 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:07:47.289 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:07:47.289 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:07:47.289 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:07:47.289 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:07:47.297 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:07:47.298 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:07:47.298 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:07:47.298 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:07:47.298 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:07:47.299 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:07:47.299 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:07:47.299 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:07:47.302 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:07:47.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:47.302 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:07:47.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:47.325 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:07:47.390 INFO:teuthology.orchestra.run.smithi130.stdout:client7252 2023-09-13T06:07:47.391 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:07:47.391 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:47.440 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:07:47.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.624+0000 7f33a8ccb640 1 Processor -- start 2023-09-13T06:07:47.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.624+0000 7f33a8ccb640 1 -- start start 2023-09-13T06:07:47.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f33a8ccb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f33a415b130 0x7f33a40cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:47.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f33a8ccb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 0x7f33a415b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:47.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f33a8ccb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a40ce980 con 0x7f33a40b04a0 2023-09-13T06:07:47.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f33a8ccb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a40cec60 con 0x7f33a415b130 2023-09-13T06:07:47.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f33a8ccb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a406c640 con 0x7f33a40ce180 2023-09-13T06:07:47.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f3399d9b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 0x7f33a415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:47.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f33a259c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f33a415b130 0x7f33a40cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:47.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f3399d9b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 0x7f33a415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:35234/0 (socket says 172.21.15.130:35234) 2023-09-13T06:07:47.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f3399d9b640 1 -- 172.21.15.130:0/1446406538 learned_addr learned my addr 172.21.15.130:0/1446406538 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:47.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f33a259c640 1 --2- 172.21.15.130:0/1446406538 >> v2:172.21.15.164:3300/0 conn(0x7f33a415b130 0x7f33a40cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:53016/0 (socket says 172.21.15.130:53016) 2023-09-13T06:07:47.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f3399d9b640 1 -- 172.21.15.130:0/1446406538 >> v2:172.21.15.164:3300/0 conn(0x7f33a415b130 msgr2=0x7f33a40cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:47.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f3399d9b640 1 --2- 172.21.15.130:0/1446406538 >> v2:172.21.15.164:3300/0 conn(0x7f33a415b130 0x7f33a40cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:47.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f3399d9b640 1 -- 172.21.15.130:0/1446406538 >> v1:172.21.15.164:6789/0 conn(0x7f33a40b04a0 legacy=0x7f33a406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:47.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.628+0000 7f3399d9b640 1 -- 172.21.15.130:0/1446406538 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a406c920 con 0x7f33a40ce180 2023-09-13T06:07:47.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f3399d9b640 1 --2- 172.21.15.130:0/1446406538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 0x7f33a415b510 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f338c009870 tx=0x7f338c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7562f7a993938c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:47.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a1d9b640 1 -- 172.21.15.130:0/1446406538 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c0ab670 con 0x7f33a40ce180 2023-09-13T06:07:47.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a1d9b640 1 -- 172.21.15.130:0/1446406538 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c0ab7d0 con 0x7f33a40ce180 2023-09-13T06:07:47.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a1d9b640 1 -- 172.21.15.130:0/1446406538 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c0abb60 con 0x7f33a40ce180 2023-09-13T06:07:47.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a8ccb640 1 -- 172.21.15.130:0/1446406538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 msgr2=0x7f33a415b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:47.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a8ccb640 1 --2- 172.21.15.130:0/1446406538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 0x7f33a415b510 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f338c009870 tx=0x7f338c01c540 comp rx=0 tx=0).stop 2023-09-13T06:07:47.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a8ccb640 1 -- 172.21.15.130:0/1446406538 shutdown_connections 2023-09-13T06:07:47.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a8ccb640 1 --2- 172.21.15.130:0/1446406538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 0x7f33a415b510 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:47.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a8ccb640 1 --2- 172.21.15.130:0/1446406538 >> v2:172.21.15.164:3300/0 conn(0x7f33a415b130 0x7f33a40cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:47.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a8ccb640 1 -- 172.21.15.130:0/1446406538 >> 172.21.15.130:0/1446406538 conn(0x7f33a4065990 msgr2=0x7f33a4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:47.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a8ccb640 1 -- 172.21.15.130:0/1446406538 shutdown_connections 2023-09-13T06:07:47.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a8ccb640 1 -- 172.21.15.130:0/1446406538 wait complete. 2023-09-13T06:07:47.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.632+0000 7f33a8ccb640 1 Processor -- start 2023-09-13T06:07:47.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a8ccb640 1 -- start start 2023-09-13T06:07:47.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a8ccb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33a40b04a0 0x7f33a415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:47.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a8ccb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 0x7f33a4149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:47.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a8ccb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a415b130 0x7f33a41514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:47.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a8ccb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a415dc20 con 0x7f33a415b130 2023-09-13T06:07:47.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a8ccb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a415bd20 con 0x7f33a40b04a0 2023-09-13T06:07:47.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a8ccb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a415c000 con 0x7f33a40ce180 2023-09-13T06:07:47.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a415b130 0x7f33a41514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:47.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a259c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33a40b04a0 0x7f33a415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:47.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a415b130 0x7f33a41514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44532/0 (socket says 172.21.15.130:44532) 2023-09-13T06:07:47.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a2d9d640 1 -- 172.21.15.130:0/807978506 learned_addr learned my addr 172.21.15.130:0/807978506 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:47.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f3399d9b640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 0x7f33a4149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:47.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a2d9d640 1 -- 172.21.15.130:0/807978506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 msgr2=0x7f33a4149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:47.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a2d9d640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 0x7f33a4149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:47.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a2d9d640 1 -- 172.21.15.130:0/807978506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33a40b04a0 msgr2=0x7f33a415d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:47.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a2d9d640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33a40b04a0 0x7f33a415d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:47.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a2d9d640 1 -- 172.21.15.130:0/807978506 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c0094d0 con 0x7f33a415b130 2023-09-13T06:07:47.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a2d9d640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a415b130 0x7f33a41514c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f339c00c6c0 tx=0x7f339c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:47.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f339b7fe640 1 -- 172.21.15.130:0/807978506 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c003b80 con 0x7f33a415b130 2023-09-13T06:07:47.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f339b7fe640 1 -- 172.21.15.130:0/807978506 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c003ce0 con 0x7f33a415b130 2023-09-13T06:07:47.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a8ccb640 1 -- 172.21.15.130:0/807978506 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a415c2e0 con 0x7f33a415b130 2023-09-13T06:07:47.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f339b7fe640 1 -- 172.21.15.130:0/807978506 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c0052f0 con 0x7f33a415b130 2023-09-13T06:07:47.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a8ccb640 1 -- 172.21.15.130:0/807978506 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a414a4f0 con 0x7f33a415b130 2023-09-13T06:07:47.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.636+0000 7f33a8ccb640 1 -- 172.21.15.130:0/807978506 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a40618a0 con 0x7f33a415b130 2023-09-13T06:07:47.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.640+0000 7f339b7fe640 1 -- 172.21.15.130:0/807978506 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f339c005450 con 0x7f33a415b130 2023-09-13T06:07:47.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.640+0000 7f339b7fe640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3384065b50 0x7f3384068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:47.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.640+0000 7f339b7fe640 1 -- 172.21.15.130:0/807978506 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f339c082e40 con 0x7f33a415b130 2023-09-13T06:07:47.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.640+0000 7f33a259c640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3384065b50 0x7f3384068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:47.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.640+0000 7f33a259c640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3384065b50 0x7f3384068010 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3394009ac0 tx=0x7f3394009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:47.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.644+0000 7f339b7fe640 1 -- 172.21.15.130:0/807978506 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f339c0508d0 con 0x7f33a415b130 2023-09-13T06:07:47.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 -- 172.21.15.130:0/807978506 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f33a415c790 con 0x7f33a415b130 2023-09-13T06:07:47.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f339b7fe640 1 -- 172.21.15.130:0/807978506 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7f339c053ef0 con 0x7f33a415b130 2023-09-13T06:07:47.826 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:07:47.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 -- 172.21.15.130:0/807978506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3384065b50 msgr2=0x7f3384068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:47.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3384065b50 0x7f3384068010 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3394009ac0 tx=0x7f3394009190 comp rx=0 tx=0).stop 2023-09-13T06:07:47.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 -- 172.21.15.130:0/807978506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a415b130 msgr2=0x7f33a41514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:47.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a415b130 0x7f33a41514c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f339c00c6c0 tx=0x7f339c00cb80 comp rx=0 tx=0).stop 2023-09-13T06:07:47.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 -- 172.21.15.130:0/807978506 shutdown_connections 2023-09-13T06:07:47.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3384065b50 0x7f3384068010 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:47.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a415b130 0x7f33a41514c0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:47.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f33a40ce180 0x7f33a4149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:47.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 --2- 172.21.15.130:0/807978506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33a40b04a0 0x7f33a415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:47.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 -- 172.21.15.130:0/807978506 >> 172.21.15.130:0/807978506 conn(0x7f33a4065990 msgr2=0x7f33a40cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:47.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 -- 172.21.15.130:0/807978506 shutdown_connections 2023-09-13T06:07:47.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:47.824+0000 7f33a8ccb640 1 -- 172.21.15.130:0/807978506 wait complete. 2023-09-13T06:07:47.845 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:07:47.846 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:07:47.846 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:07:47.847 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T06:07:47.847 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:07:47.847 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:07:47.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:07:47.848 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:07:47.848 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:07:47.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:47.849 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:07:47.859 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:07:47.860 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:07:47.860 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:07:47.860 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:47.860 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:07:47.861 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:47.861 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:47.861 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:47.861 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:07:47.861 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:47.862 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:47.862 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:07:47.862 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:07:47.862 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:47.862 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:07:47.863 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:47.863 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:07:47.863 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42056sec preferred_lft 42056sec 2023-09-13T06:07:47.863 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:07:47.863 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:47.863 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:07:47.864 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:47.864 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:07:47.864 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:47.864 INFO:teuthology.orchestra.run.smithi164.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:07:47.864 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:07:47.865 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:07:47.865 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:47.865 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:07:47.865 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:47.865 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:07:47.865 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:07:47.866 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:07:47.866 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:47.866 INFO:teuthology.orchestra.run.smithi164.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:07:47.866 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:07:47.866 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:07:47.867 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:07:47.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:47.868 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:07:47.931 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:07:47.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:47.934 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:07:47.988 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:07:47.988 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:07:47.988 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:07:47.988 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:07:47.989 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:07:47.989 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:07:47.989 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:47.989 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:47.989 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:07:47.990 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:07:47.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:47.990 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:07:47.991 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:07:47.991 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:07:47.991 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:07:47.992 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:07:47.992 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:07:48.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:48.086 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:07:48.095 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-13T06:07:48.096 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:07:48.097 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:07:48.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:48.098 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-09-13T06:07:48.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:07:48.160 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T06:07:48.214 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:07:48.214 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:07:48.215 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:07:48.265 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:07:48.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:48.266 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:07:48.362 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:07:48.362 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:07:48.363 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:07:48.378 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:07:48.378 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:07:48.378 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:07:48.379 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:07:48.379 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:07:48.387 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:07:48.387 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:07:48.387 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:07:48.388 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:07:48.388 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:07:48.388 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:07:48.388 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:07:48.388 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:07:48.392 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:07:48.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:48.393 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:07:48.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:48.414 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:07:48.468 INFO:teuthology.orchestra.run.smithi164.stdout:client7935 2023-09-13T06:07:48.468 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:07:48.469 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:48.518 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:07:48.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57fc9db640 1 Processor -- start 2023-09-13T06:07:48.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57fc9db640 1 -- start start 2023-09-13T06:07:48.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57fc9db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f57f80d1750 0x7f57f815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:48.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57fc9db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f57f80d1090 0x7f57f8146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:48.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57fc9db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f80b63c0 con 0x7f57f80d1b30 2023-09-13T06:07:48.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57fc9db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f815dea0 con 0x7f57f80d1750 2023-09-13T06:07:48.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57fc9db640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f80d0c20 con 0x7f57f80d1090 2023-09-13T06:07:48.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57f6d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f57f80d1b30 0x7f57f80b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36212/0 (socket says 172.21.15.130:36212) 2023-09-13T06:07:48.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57f6d9d640 1 -- 172.21.15.130:0/2730310236 learned_addr learned my addr 172.21.15.130:0/2730310236 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:48.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57f659c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f57f80d1750 0x7f57f815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:48.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57f5d9b640 1 --2- 172.21.15.130:0/2730310236 >> v2:172.21.15.164:3300/0 conn(0x7f57f80d1090 0x7f57f8146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57f659c640 1 -- 172.21.15.130:0/2730310236 >> v2:172.21.15.164:3300/0 conn(0x7f57f80d1090 msgr2=0x7f57f8146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57f659c640 1 --2- 172.21.15.130:0/2730310236 >> v2:172.21.15.164:3300/0 conn(0x7f57f80d1090 0x7f57f8146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57f659c640 1 -- 172.21.15.130:0/2730310236 >> v1:172.21.15.130:6789/0 conn(0x7f57f80d1b30 legacy=0x7f57f80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57f659c640 1 -- 172.21.15.130:0/2730310236 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f80b6610 con 0x7f57f80d1750 2023-09-13T06:07:48.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57f5d9b640 1 --2- 172.21.15.130:0/2730310236 >> v2:172.21.15.164:3300/0 conn(0x7f57f80d1090 0x7f57f8146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:48.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.664+0000 7f57f559a640 1 -- 172.21.15.130:0/2730310236 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471270409 0 0) 0x7f57f80b63c0 con 0x7f57f80d1b30 2023-09-13T06:07:48.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57f659c640 1 --2- 172.21.15.130:0/2730310236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f80d1750 0x7f57f815d960 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f57f80c8360 tx=0x7f57e801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa861ca70baac00 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:48.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57f559a640 1 -- 172.21.15.130:0/2730310236 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e80a7070 con 0x7f57f80d1750 2023-09-13T06:07:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57f559a640 1 -- 172.21.15.130:0/2730310236 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e80ab430 con 0x7f57f80d1750 2023-09-13T06:07:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57f559a640 1 -- 172.21.15.130:0/2730310236 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e80ab7c0 con 0x7f57f80d1750 2023-09-13T06:07:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57fc9db640 1 -- 172.21.15.130:0/2730310236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f80d1750 msgr2=0x7f57f815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57fc9db640 1 --2- 172.21.15.130:0/2730310236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f80d1750 0x7f57f815d960 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f57f80c8360 tx=0x7f57e801c430 comp rx=0 tx=0).stop 2023-09-13T06:07:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57fc9db640 1 -- 172.21.15.130:0/2730310236 shutdown_connections 2023-09-13T06:07:48.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57fc9db640 1 --2- 172.21.15.130:0/2730310236 >> v2:172.21.15.164:3300/0 conn(0x7f57f80d1090 0x7f57f8146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:48.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57fc9db640 1 --2- 172.21.15.130:0/2730310236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f80d1750 0x7f57f815d960 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:48.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57fc9db640 1 -- 172.21.15.130:0/2730310236 >> 172.21.15.130:0/2730310236 conn(0x7f57f806f170 msgr2=0x7f57f806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:48.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57fc9db640 1 -- 172.21.15.130:0/2730310236 shutdown_connections 2023-09-13T06:07:48.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.668+0000 7f57fc9db640 1 -- 172.21.15.130:0/2730310236 wait complete. 2023-09-13T06:07:48.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57fc9db640 1 Processor -- start 2023-09-13T06:07:48.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57fc9db640 1 -- start start 2023-09-13T06:07:48.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57fc9db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57f80d1090 0x7f57f815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:48.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57fc9db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f80d1750 0x7f57f8167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:48.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57fc9db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57f80d1b30 0x7f57f81416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:48.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57fc9db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f815d5e0 con 0x7f57f80d1750 2023-09-13T06:07:48.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57fc9db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f81635c0 con 0x7f57f80d1090 2023-09-13T06:07:48.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57fc9db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f8162520 con 0x7f57f80d1b30 2023-09-13T06:07:48.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57f5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f80d1750 0x7f57f8167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:48.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57f5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f80d1750 0x7f57f8167940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44536/0 (socket says 172.21.15.130:44536) 2023-09-13T06:07:48.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57f5d9b640 1 -- 172.21.15.130:0/544427187 learned_addr learned my addr 172.21.15.130:0/544427187 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:48.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57f659c640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57f80d1090 0x7f57f815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:48.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57f6d9d640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57f80d1b30 0x7f57f81416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:48.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57f5d9b640 1 -- 172.21.15.130:0/544427187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57f80d1b30 msgr2=0x7f57f81416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:48.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57f5d9b640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57f80d1b30 0x7f57f81416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:48.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57f5d9b640 1 -- 172.21.15.130:0/544427187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57f80d1090 msgr2=0x7f57f815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:48.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57f5d9b640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57f80d1090 0x7f57f815d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:48.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57f5d9b640 1 -- 172.21.15.130:0/544427187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8009420 con 0x7f57f80d1750 2023-09-13T06:07:48.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57f5d9b640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f80d1750 0x7f57f8167940 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00d800 tx=0x7f57ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:48.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57e6ffd640 1 -- 172.21.15.130:0/544427187 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0096a0 con 0x7f57f80d1750 2023-09-13T06:07:48.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57e6ffd640 1 -- 172.21.15.130:0/544427187 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec009800 con 0x7f57f80d1750 2023-09-13T06:07:48.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57e6ffd640 1 -- 172.21.15.130:0/544427187 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec009bb0 con 0x7f57f80d1750 2023-09-13T06:07:48.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57fc9db640 1 -- 172.21.15.130:0/544427187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f8162800 con 0x7f57f80d1750 2023-09-13T06:07:48.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.672+0000 7f57fc9db640 1 -- 172.21.15.130:0/544427187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f8162dc0 con 0x7f57f80d1750 2023-09-13T06:07:48.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.676+0000 7f57fc9db640 1 -- 172.21.15.130:0/544427187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f80618a0 con 0x7f57f80d1750 2023-09-13T06:07:48.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.676+0000 7f57e6ffd640 1 -- 172.21.15.130:0/544427187 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f57ec009d10 con 0x7f57f80d1750 2023-09-13T06:07:48.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.676+0000 7f57e6ffd640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f57d8065b20 0x7f57d8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:48.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.676+0000 7f57e6ffd640 1 -- 172.21.15.130:0/544427187 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57ec083940 con 0x7f57f80d1750 2023-09-13T06:07:48.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.676+0000 7f57f659c640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f57d8065b20 0x7f57d8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:48.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.676+0000 7f57f659c640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f57d8065b20 0x7f57d8067fe0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f57e80af000 tx=0x7f57e80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:48.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.680+0000 7f57e6ffd640 1 -- 172.21.15.130:0/544427187 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f57ec051290 con 0x7f57f80d1750 2023-09-13T06:07:48.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.860+0000 7f57fc9db640 1 -- 172.21.15.130:0/544427187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57f80b86c0 con 0x7f57f80d1750 2023-09-13T06:07:48.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.860+0000 7f57e6ffd640 1 -- 172.21.15.130:0/544427187 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f57ec00b440 con 0x7f57f80d1750 2023-09-13T06:07:48.864 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:48.864 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1309237651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1309237651},{"type":"v1","addr":"172.21.15.130:6837","nonce":1309237651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1568650238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1568650238},{"type":"v1","addr":"172.21.15.164:6834","nonce":1568650238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1994572743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1994572743},{"type":"v1","addr":"172.21.15.130:6836","nonce":1994572743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:39.911036+0000","modified":"2023-09-13T06:07:42.935333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7773},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7773":{"gid":7773,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/4146626637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4146626637},{"type":"v1","addr":"172.21.15.164:6835","nonce":4146626637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-09-13T06:07:48.865 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 68 2023-09-13T06:07:48.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 -- 172.21.15.130:0/544427187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f57d8065b20 msgr2=0x7f57d8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:48.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f57d8065b20 0x7f57d8067fe0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f57e80af000 tx=0x7f57e80a7000 comp rx=0 tx=0).stop 2023-09-13T06:07:48.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 -- 172.21.15.130:0/544427187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f80d1750 msgr2=0x7f57f8167940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:48.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f80d1750 0x7f57f8167940 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00d800 tx=0x7f57ec00dcc0 comp rx=0 tx=0).stop 2023-09-13T06:07:48.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 -- 172.21.15.130:0/544427187 shutdown_connections 2023-09-13T06:07:48.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f57d8065b20 0x7f57d8067fe0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:48.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57f80d1b30 0x7f57f81416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:48.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f80d1750 0x7f57f8167940 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:48.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 --2- 172.21.15.130:0/544427187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57f80d1090 0x7f57f815d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:48.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 -- 172.21.15.130:0/544427187 >> 172.21.15.130:0/544427187 conn(0x7f57f806f170 msgr2=0x7f57f815dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:48.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 -- 172.21.15.130:0/544427187 shutdown_connections 2023-09-13T06:07:48.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:48.864+0000 7f57fc9db640 1 -- 172.21.15.130:0/544427187 wait complete. 2023-09-13T06:07:48.884 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-09-13T06:07:49.043 INFO:teuthology.orchestra.run.smithi164.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":7773,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4750655750000004,"mdsmap_epoch":68,"osdmap_epoch":137,"osdmap_epoch_barrier":137,"uptime":13.417285288} 2023-09-13T06:07:49.043 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 7773, "mdsmap_epoch": 68, "osdmap_epoch": 137, "osdmap_epoch_barrier": 137, "rank_uptime": 8.475065575, "state": "up:active", "uptime": 13.417285288, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:07:49.044 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-09-13T06:07:49.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.184+0000 7f7fed39f640 1 Processor -- start 2023-09-13T06:07:49.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.184+0000 7f7fed39f640 1 -- start start 2023-09-13T06:07:49.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fed39f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe80b3170 0x7f7fe80b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:49.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fed39f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7fe80b1ff0 0x7f7fe80cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:49.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fed39f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe80ccff0 con 0x7f7fe80ccc10 2023-09-13T06:07:49.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fed39f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe815b590 con 0x7f7fe80b1ff0 2023-09-13T06:07:49.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fed39f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80b12f0 con 0x7f7fe80b3170 2023-09-13T06:07:49.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe6ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f7fe80ccc10 0x7f7fe815dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36220/0 (socket says 172.21.15.130:36220) 2023-09-13T06:07:49.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe6ffd640 1 -- 172.21.15.130:0/103898436 learned_addr learned my addr 172.21.15.130:0/103898436 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:49.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe77fe640 1 --2- 172.21.15.130:0/103898436 >> v2:172.21.15.164:3300/0 conn(0x7f7fe80b1ff0 0x7f7fe80cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:49.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fde7fc640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe80b3170 0x7f7fe80b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:49.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588197301 0 0) 0x7f7fe80ccff0 con 0x7f7fe80ccc10 2023-09-13T06:07:49.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd4003530 con 0x7f7fe80ccc10 2023-09-13T06:07:49.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2964478462 0 0) 0x7f7fd4003530 con 0x7f7fe80ccc10 2023-09-13T06:07:49.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe80b3170 msgr2=0x7f7fe80b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:49.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe80b3170 0x7f7fe80b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:49.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 >> v2:172.21.15.164:3300/0 conn(0x7f7fe80b1ff0 msgr2=0x7f7fe80cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:49.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 --2- 172.21.15.130:0/103898436 >> v2:172.21.15.164:3300/0 conn(0x7f7fe80b1ff0 0x7f7fe80cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:49.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe815e520 con 0x7f7fe80ccc10 2023-09-13T06:07:49.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f7fd8001680 con 0x7f7fe80ccc10 2023-09-13T06:07:49.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 >> v1:172.21.15.130:6789/0 conn(0x7f7fe80ccc10 legacy=0x7f7fe815dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:49.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe80b3170 0x7f7fd40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:49.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fd4003fc0 0x7f7fd40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:49.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd4004d10 0x7f7fd4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:49.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe815b590 con 0x7f7fd4003fc0 2023-09-13T06:07:49.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80b12f0 con 0x7f7fd4004d10 2023-09-13T06:07:49.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd400dc20 con 0x7f7fe80b3170 2023-09-13T06:07:49.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe77fe640 1 --2- 172.21.15.130:0/103898436 >> v2:172.21.15.164:3300/0 conn(0x7f7fe80b1ff0 0x7f7fe80cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:49.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fde7fc640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fd4003fc0 0x7f7fd40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:49.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe6ffd640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe80b3170 0x7f7fd40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:49.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe77fe640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd4004d10 0x7f7fd4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:49.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fde7fc640 1 -- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe80b3170 msgr2=0x7f7fd40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:49.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fde7fc640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe80b3170 0x7f7fd40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:49.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fde7fc640 1 -- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd4004d10 msgr2=0x7f7fd4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:49.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fde7fc640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd4004d10 0x7f7fd4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:49.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fde7fc640 1 -- 172.21.15.130:0/103898436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd4003530 con 0x7f7fd4003fc0 2023-09-13T06:07:49.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.188+0000 7f7fe6ffd640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe80b3170 0x7f7fd40039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:07:49.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fde7fc640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fd4003fc0 0x7f7fd40047d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009ae0 tx=0x7f7fd001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555c1b0ece7d74a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:49.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00a5640 con 0x7f7fd4003fc0 2023-09-13T06:07:49.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd00a57a0 con 0x7f7fd4003fc0 2023-09-13T06:07:49.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fe67fc640 1 -- 172.21.15.130:0/103898436 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00a5b50 con 0x7f7fd4003fc0 2023-09-13T06:07:49.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fed39f640 1 -- 172.21.15.130:0/103898436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fd4003fc0 msgr2=0x7f7fd40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:49.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fed39f640 1 --2- 172.21.15.130:0/103898436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fd4003fc0 0x7f7fd40047d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009ae0 tx=0x7f7fd001ca50 comp rx=0 tx=0).stop 2023-09-13T06:07:49.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fe77fe640 1 -- 172.21.15.130:0/103898436 reap_dead start 2023-09-13T06:07:49.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fed39f640 1 -- 172.21.15.130:0/103898436 shutdown_connections 2023-09-13T06:07:49.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fed39f640 1 -- 172.21.15.130:0/103898436 >> 172.21.15.130:0/103898436 conn(0x7f7fe80735e0 msgr2=0x7f7fe8065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:49.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fed39f640 1 -- 172.21.15.130:0/103898436 shutdown_connections 2023-09-13T06:07:49.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fed39f640 1 -- 172.21.15.130:0/103898436 wait complete. 2023-09-13T06:07:49.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fed39f640 1 Processor -- start 2023-09-13T06:07:49.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.192+0000 7f7fed39f640 1 -- start start 2023-09-13T06:07:49.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fed39f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd4003fc0 0x7f7fe81e55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:49.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fed39f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fe814cd50 0x7f7fe81e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:49.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fed39f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe815a350 0x7f7fe815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:49.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fed39f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe814d1d0 con 0x7f7fe814cd50 2023-09-13T06:07:49.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fed39f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe815ad10 con 0x7f7fd4003fc0 2023-09-13T06:07:49.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fed39f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe81e7a30 con 0x7f7fe815a350 2023-09-13T06:07:49.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fde7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fe814cd50 0x7f7fe81e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:49.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fde7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fe814cd50 0x7f7fe81e74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44556/0 (socket says 172.21.15.130:44556) 2023-09-13T06:07:49.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fde7fc640 1 -- 172.21.15.130:0/1402922764 learned_addr learned my addr 172.21.15.130:0/1402922764 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:49.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fe77fe640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe815a350 0x7f7fe815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:49.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fe6ffd640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd4003fc0 0x7f7fe81e55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:49.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fde7fc640 1 -- 172.21.15.130:0/1402922764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe815a350 msgr2=0x7f7fe815a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:49.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fde7fc640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe815a350 0x7f7fe815a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:49.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fde7fc640 1 -- 172.21.15.130:0/1402922764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd4003fc0 msgr2=0x7f7fe81e55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:49.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fde7fc640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd4003fc0 0x7f7fe81e55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:49.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fde7fc640 1 -- 172.21.15.130:0/1402922764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe81e5b80 con 0x7f7fe814cd50 2023-09-13T06:07:49.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fde7fc640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fe814cd50 0x7f7fe81e74f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009ae0 tx=0x7f7fd4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:49.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fdffff640 1 -- 172.21.15.130:0/1402922764 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00be070 con 0x7f7fe814cd50 2023-09-13T06:07:49.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fdffff640 1 -- 172.21.15.130:0/1402922764 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0004020 con 0x7f7fe814cd50 2023-09-13T06:07:49.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fed39f640 1 -- 172.21.15.130:0/1402922764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe81e5e60 con 0x7f7fe814cd50 2023-09-13T06:07:49.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fdffff640 1 -- 172.21.15.130:0/1402922764 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0004390 con 0x7f7fe814cd50 2023-09-13T06:07:49.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fed39f640 1 -- 172.21.15.130:0/1402922764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe81e6420 con 0x7f7fe814cd50 2023-09-13T06:07:49.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.196+0000 7f7fed39f640 1 -- 172.21.15.130:0/1402922764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe80618a0 con 0x7f7fe814cd50 2023-09-13T06:07:49.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.200+0000 7f7fdffff640 1 -- 172.21.15.130:0/1402922764 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7fd00b4040 con 0x7f7fe814cd50 2023-09-13T06:07:49.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.200+0000 7f7fdffff640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fc8065b50 0x7f7fc8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:49.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.200+0000 7f7fdffff640 1 -- 172.21.15.130:0/1402922764 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fd011d060 con 0x7f7fe814cd50 2023-09-13T06:07:49.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.200+0000 7f7fe6ffd640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fc8065b50 0x7f7fc8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:49.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.200+0000 7f7fe6ffd640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fc8065b50 0x7f7fc8068010 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80078f0 tx=0x7f7fd8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:49.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.204+0000 7f7fdffff640 1 -- 172.21.15.130:0/1402922764 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7fd00ea9b0 con 0x7f7fe814cd50 2023-09-13T06:07:49.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.352+0000 7f7fed39f640 1 -- 172.21.15.130:0/1402922764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f7fe80b0970 con 0x7f7fe814cd50 2023-09-13T06:07:49.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fdffff640 1 -- 172.21.15.130:0/1402922764 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v138) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7fd00edfd0 con 0x7f7fe814cd50 2023-09-13T06:07:49.598 INFO:teuthology.orchestra.run.smithi130.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-09-13T06:07:49.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 -- 172.21.15.130:0/1402922764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fc8065b50 msgr2=0x7f7fc8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:49.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fc8065b50 0x7f7fc8068010 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80078f0 tx=0x7f7fd8009040 comp rx=0 tx=0).stop 2023-09-13T06:07:49.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 -- 172.21.15.130:0/1402922764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fe814cd50 msgr2=0x7f7fe81e74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:49.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fe814cd50 0x7f7fe81e74f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009ae0 tx=0x7f7fd4005800 comp rx=0 tx=0).stop 2023-09-13T06:07:49.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 -- 172.21.15.130:0/1402922764 shutdown_connections 2023-09-13T06:07:49.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fc8065b50 0x7f7fc8068010 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:49.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe815a350 0x7f7fe815a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:49.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fe814cd50 0x7f7fe81e74f0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:49.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 --2- 172.21.15.130:0/1402922764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd4003fc0 0x7f7fe81e55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:49.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 -- 172.21.15.130:0/1402922764 >> 172.21.15.130:0/1402922764 conn(0x7f7fe80735e0 msgr2=0x7f7fe806ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:49.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 -- 172.21.15.130:0/1402922764 shutdown_connections 2023-09-13T06:07:49.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:49.596+0000 7f7fed39f640 1 -- 172.21.15.130:0/1402922764 wait complete. 2023-09-13T06:07:49.619 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-13T06:07:49.778 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_mon_report_interval":"5"} 2023-09-13T06:07:49.779 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-13T06:07:49.779 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-09-13T06:07:49.780 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:07:49.780 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:49.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:49.792 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-09-13T06:07:49.964 INFO:teuthology.orchestra.run.smithi130.stderr:16+0 records in 2023-09-13T06:07:49.964 INFO:teuthology.orchestra.run.smithi130.stderr:16+0 records out 2023-09-13T06:07:49.965 INFO:teuthology.orchestra.run.smithi130.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.115315 s, 145 MB/s 2023-09-13T06:07:49.966 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:07:49.966 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:07:49.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:07:49.977 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-09-13T06:07:50.189 INFO:teuthology.orchestra.run.smithi130.stderr:17+0 records in 2023-09-13T06:07:50.189 INFO:teuthology.orchestra.run.smithi130.stderr:17+0 records out 2023-09-13T06:07:50.189 INFO:teuthology.orchestra.run.smithi130.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.158255 s, 113 MB/s 2023-09-13T06:07:50.191 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-09-13T06:07:50.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:07:50.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.328+0000 7fe5c36ec640 1 Processor -- start 2023-09-13T06:07:50.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.328+0000 7fe5c36ec640 1 -- start start 2023-09-13T06:07:50.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.328+0000 7fe5c36ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5bc0b1d20 0x7fe5bc0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:50.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.328+0000 7fe5c36ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc0ccfd0 con 0x7fe5bc0cdfc0 2023-09-13T06:07:50.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.328+0000 7fe5c36ec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc0ced90 con 0x7fe5bc159f20 2023-09-13T06:07:50.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.328+0000 7fe5c36ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0ce430 con 0x7fe5bc0b1d20 2023-09-13T06:07:50.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.328+0000 7fe5c1c89640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe5bc0cdfc0 0x7fe5bc0ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36236/0 (socket says 172.21.15.130:36236) 2023-09-13T06:07:50.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.328+0000 7fe5c1c89640 1 -- 172.21.15.130:0/3414852706 learned_addr learned my addr 172.21.15.130:0/3414852706 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:50.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5c0c87640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5bc0b1d20 0x7fe5bc0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:50.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914641255 0 0) 0x7fe5bc0ccfd0 con 0x7fe5bc0cdfc0 2023-09-13T06:07:50.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a8005740 con 0x7fe5bc0cdfc0 2023-09-13T06:07:50.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 695203031 0 0) 0x7fe5a8005740 con 0x7fe5bc0cdfc0 2023-09-13T06:07:50.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5bc0b1d20 msgr2=0x7fe5bc0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:50.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5bc0b1d20 0x7fe5bc0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:50.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 >> v1:172.21.15.164:6789/0 conn(0x7fe5bc159f20 legacy=0x7fe5bc0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:50.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc0cd200 con 0x7fe5bc0cdfc0 2023-09-13T06:07:50.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fe5b4001a00 con 0x7fe5bc0cdfc0 2023-09-13T06:07:50.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 >> v1:172.21.15.130:6789/0 conn(0x7fe5bc0cdfc0 legacy=0x7fe5bc0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:50.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5bc0b1d20 0x7fe5a8005c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:50.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5a8006170 0x7fe5a80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:50.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5a8006f20 0x7fe5a80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:50.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0ce430 con 0x7fe5a8006170 2023-09-13T06:07:50.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a8006850 con 0x7fe5a8006f20 2023-09-13T06:07:50.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a8010020 con 0x7fe5bc0b1d20 2023-09-13T06:07:50.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5c0c87640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5a8006170 0x7fe5a80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:50.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5c1488640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5bc0b1d20 0x7fe5a8005c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:50.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5c1c89640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5a8006f20 0x7fe5a80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:50.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5c0c87640 1 -- 172.21.15.130:0/3414852706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5bc0b1d20 msgr2=0x7fe5a8005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:50.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5c0c87640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5bc0b1d20 0x7fe5a8005c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:50.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5c0c87640 1 -- 172.21.15.130:0/3414852706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5a8006f20 msgr2=0x7fe5a80073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:50.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5c0c87640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5a8006f20 0x7fe5a80073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:50.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.332+0000 7fe5c0c87640 1 -- 172.21.15.130:0/3414852706 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8005740 con 0x7fe5a8006170 2023-09-13T06:07:50.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c0c87640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5a8006170 0x7fe5a80069e0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009ae0 tx=0x7fe5ac01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3415706c078826 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:50.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0a5640 con 0x7fe5a8006170 2023-09-13T06:07:50.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac0a57a0 con 0x7fe5a8006170 2023-09-13T06:07:50.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5b3fff640 1 -- 172.21.15.130:0/3414852706 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0a5b50 con 0x7fe5a8006170 2023-09-13T06:07:50.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 -- 172.21.15.130:0/3414852706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5a8006170 msgr2=0x7fe5a80069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:50.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 --2- 172.21.15.130:0/3414852706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5a8006170 0x7fe5a80069e0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009ae0 tx=0x7fe5ac01ca50 comp rx=0 tx=0).stop 2023-09-13T06:07:50.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c1c89640 1 -- 172.21.15.130:0/3414852706 reap_dead start 2023-09-13T06:07:50.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 -- 172.21.15.130:0/3414852706 shutdown_connections 2023-09-13T06:07:50.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 -- 172.21.15.130:0/3414852706 >> 172.21.15.130:0/3414852706 conn(0x7fe5bc065990 msgr2=0x7fe5bc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:50.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 -- 172.21.15.130:0/3414852706 shutdown_connections 2023-09-13T06:07:50.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 -- 172.21.15.130:0/3414852706 wait complete. 2023-09-13T06:07:50.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 Processor -- start 2023-09-13T06:07:50.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 -- start start 2023-09-13T06:07:50.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5a8006170 0x7fe5bc13fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:50.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06c5b0 0x7fe5bc156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:50.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5bc06ca30 0x7fe5bc1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:50.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc156f10 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc06d000 con 0x7fe5bc06ca30 2023-09-13T06:07:50.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.336+0000 7fe5c36ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc151bc0 con 0x7fe5a8006170 2023-09-13T06:07:50.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c0c87640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06c5b0 0x7fe5bc156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:50.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c0c87640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06c5b0 0x7fe5bc156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44576/0 (socket says 172.21.15.130:44576) 2023-09-13T06:07:50.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c0c87640 1 -- 172.21.15.130:0/1882213205 learned_addr learned my addr 172.21.15.130:0/1882213205 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:50.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c1488640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5a8006170 0x7fe5bc13fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:50.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c1c89640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5bc06ca30 0x7fe5bc1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:50.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c0c87640 1 -- 172.21.15.130:0/1882213205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5a8006170 msgr2=0x7fe5bc13fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:50.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c0c87640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5a8006170 0x7fe5bc13fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:50.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c0c87640 1 -- 172.21.15.130:0/1882213205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5bc06ca30 msgr2=0x7fe5bc1569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:50.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c0c87640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5bc06ca30 0x7fe5bc1569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:50.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c0c87640 1 -- 172.21.15.130:0/1882213205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc151ea0 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c0c87640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06c5b0 0x7fe5bc156490 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009ae0 tx=0x7fe5a8007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:50.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5b1ffb640 1 -- 172.21.15.130:0/1882213205 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac004230 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5b1ffb640 1 -- 172.21.15.130:0/1882213205 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac004390 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5b1ffb640 1 -- 172.21.15.130:0/1882213205 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0ad850 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c36ec640 1 -- 172.21.15.130:0/1882213205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc152180 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c36ec640 1 -- 172.21.15.130:0/1882213205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc13ff50 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5c36ec640 1 -- 172.21.15.130:0/1882213205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc151a20 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.340+0000 7fe5b1ffb640 1 -- 172.21.15.130:0/1882213205 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe5ac0b4040 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.344+0000 7fe5b1ffb640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5a0065b20 0x7fe5a0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:50.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.344+0000 7fe5b1ffb640 1 -- 172.21.15.130:0/1882213205 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5ac11db10 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.344+0000 7fe5c1488640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5a0065b20 0x7fe5a0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:50.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.344+0000 7fe5c1488640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5a0065b20 0x7fe5a0067fe0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc1540b0 tx=0x7fe5b80013f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:50.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.348+0000 7fe5b1ffb640 1 -- 172.21.15.130:0/1882213205 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe5bc151a20 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.496+0000 7fe5c36ec640 1 -- 172.21.15.130:0/1882213205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe5bc151a20 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.496+0000 7fe5b1ffb640 1 -- 172.21.15.130:0/1882213205 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+34006 (secure 0 0 0) 0x7fe5bc151a20 con 0x7fe5bc06c5b0 2023-09-13T06:07:50.499 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:50.500 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:07:50.500 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 138, 2023-09-13T06:07:50.500 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:07:50.501 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:07:50.501 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:07:49.591247+0000", 2023-09-13T06:07:50.501 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:07:50.502 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:07:50.502 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:07:50.502 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:07:50.503 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:07:50.503 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:07:50.503 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:07:50.504 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:07:50.504 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:07:50.505 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:07:50.505 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:07:50.505 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:07:50.505 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:07:50.506 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:07:50.506 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:07:50.506 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 17, 2023-09-13T06:07:50.506 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:07:50.506 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:07:50.507 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:07:50.507 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:07:50.507 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:07:50.507 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:07:50.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.508 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:07:50.508 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:07:50.508 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:07:50.508 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:07:50.508 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:07:50.508 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:07:50.509 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:07:50.509 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:07:50.509 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:07:50.509 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:07:50.509 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:07:50.510 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:07:50.510 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:07:50.510 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:07:50.510 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:07:50.510 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:07:50.511 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:07:50.511 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:07:50.511 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:07:50.511 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:07:50.511 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:07:50.512 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:07:50.512 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:07:50.512 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:07:50.512 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:07:50.513 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:07:50.513 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:07:50.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.513 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:07:50.513 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:07:50.514 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:07:50.514 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:07:50.514 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:07:50.515 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:07:50.515 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:07:50.515 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:07:50.515 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:07:50.515 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:07:50.516 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:07:50.516 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:07:50.516 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:07:50.516 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:07:50.517 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:07:50.517 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:07:50.517 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:07:50.517 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:07:50.518 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:07:50.518 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:07:50.518 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:07:50.519 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:07:50.519 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:07:50.519 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:07:50.519 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:07:50.519 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:07:50.520 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:07:50.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.520 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:07:50.520 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:07:50.521 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:07:50.521 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:07:50.521 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:07:50.522 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:07:50.522 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:07:50.522 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:07:50.523 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:07:50.523 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:07:50.523 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:07:50.523 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:07:50.524 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:07:50.524 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:07:50.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.525 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:07:50.525 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:07:50.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.525 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:07:50.526 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:07:50.526 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:07:50.527 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:07:50.527 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:07:50.527 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:07:50.528 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:07:50.528 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:07:50.528 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:07:50.529 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.529 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.530 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 16, 2023-09-13T06:07:50.530 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:07:50.530 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:38.276233+0000", 2023-09-13T06:07:50.531 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:07:50.531 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:07:50.531 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:07:50.531 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:07:50.532 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:07:50.532 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:07:50.532 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:07:50.533 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:07:50.533 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:07:50.533 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:07:50.533 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:07:50.533 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:07:50.534 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:07:50.534 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:07:50.534 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:07:50.534 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:07:50.534 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:07:50.535 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:07:50.535 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:07:50.535 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:07:50.535 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:07:50.535 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:07:50.536 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:07:50.536 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:07:50.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.536 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "136", 2023-09-13T06:07:50.536 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:07:50.537 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:07:50.537 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:07:50.537 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:07:50.537 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:07:50.537 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:07:50.538 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:07:50.538 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:07:50.538 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:07:50.538 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:07:50.538 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:07:50.538 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:07:50.539 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:07:50.539 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:07:50.539 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:07:50.540 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:07:50.540 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:07:50.540 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:07:50.540 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:07:50.540 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:07:50.540 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:07:50.541 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:07:50.541 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:07:50.541 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:07:50.541 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:07:50.541 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:07:50.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.542 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:07:50.542 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:07:50.542 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:07:50.542 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:07:50.543 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:07:50.543 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:07:50.543 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:07:50.543 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:07:50.543 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:07:50.543 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:07:50.544 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:07:50.544 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:07:50.544 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:07:50.544 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:07:50.544 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:07:50.544 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.545 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:07:50.545 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:07:50.545 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:07:50.545 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.546 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:07:50.546 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:07:50.546 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:07:50.546 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:07:50.546 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:07:50.547 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:07:50.547 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:07:50.547 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:07:50.547 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:07:50.547 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.548 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 17, 2023-09-13T06:07:50.548 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:07:50.548 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:39.032744+0000", 2023-09-13T06:07:50.548 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:07:50.549 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:07:50.549 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:07:50.549 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:07:50.549 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:07:50.550 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:07:50.550 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:07:50.550 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:07:50.550 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:07:50.550 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:07:50.550 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:07:50.551 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:07:50.551 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:07:50.551 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:07:50.551 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:07:50.551 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:07:50.552 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:07:50.552 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:07:50.552 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:07:50.553 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:07:50.553 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:07:50.553 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:07:50.553 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:07:50.553 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:07:50.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.554 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "138", 2023-09-13T06:07:50.554 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:07:50.554 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:07:50.555 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:07:50.555 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:07:50.555 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:07:50.555 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:07:50.556 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:07:50.556 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:07:50.556 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:07:50.556 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:07:50.557 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:07:50.557 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:07:50.557 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:07:50.557 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:07:50.558 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:07:50.558 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:07:50.558 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:07:50.558 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:07:50.558 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:07:50.558 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:07:50.559 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:07:50.559 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:07:50.559 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:07:50.560 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:07:50.560 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:07:50.560 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:07:50.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.561 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:07:50.561 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:07:50.561 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:07:50.561 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:07:50.561 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:07:50.561 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:07:50.562 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:07:50.562 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:07:50.562 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:07:50.562 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:07:50.562 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:07:50.563 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:07:50.563 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:07:50.563 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:07:50.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.563 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:07:50.564 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:07:50.564 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:07:50.564 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.564 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:07:50.565 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:07:50.565 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:07:50.565 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:07:50.565 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:07:50.565 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:07:50.566 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:07:50.566 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:07:50.566 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:07:50.566 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.566 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.567 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:07:50.567 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:07:50.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.567 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:07:50.567 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:50.568 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:50.568 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:50.568 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:50.568 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:50.568 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:50.569 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:50.569 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:50.569 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:50.569 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:50.569 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:50.570 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:50.570 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.570 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.570 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.571 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:07:50.571 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:50.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.572 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.572 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:07:50.572 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:50.572 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.572 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.573 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:50.573 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.574 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.574 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:07:50.574 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:50.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.575 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.575 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:07:50.576 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:50.576 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.576 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.576 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:50.577 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.577 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.577 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:07:50.577 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:50.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.578 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.578 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:07:50.578 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:50.579 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.579 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.579 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:50.579 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.580 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.580 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:07:50.580 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:50.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.581 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.581 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:07:50.581 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:50.581 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.582 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.582 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:07:50.582 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:07:50.582 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:07:50.583 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:07:50.583 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:50.583 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:50.583 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:50.583 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.584 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:07:50.584 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:50.584 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:50.584 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:50.585 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:50.585 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:50.585 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:50.585 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:50.585 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:50.586 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:50.586 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:50.586 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:50.586 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:50.587 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.587 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.587 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.587 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:07:50.587 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:50.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.588 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.588 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:07:50.588 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:50.589 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.589 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.589 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:50.589 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.590 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.590 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:07:50.590 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:50.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.591 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.591 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:07:50.591 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:50.592 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.592 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.592 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:50.592 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.593 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.593 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:07:50.593 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:50.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.594 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.595 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:07:50.595 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:50.595 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.596 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.596 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:50.597 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.598 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.598 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:07:50.598 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:50.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.599 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.600 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:07:50.600 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:50.600 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.601 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.601 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:07:50.601 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:07:50.602 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:07:50.602 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:07:50.602 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:50.603 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:50.603 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:50.603 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.604 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:07:50.604 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:50.604 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:50.605 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:50.605 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:50.605 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:50.605 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:50.605 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:50.606 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:50.606 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:50.606 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:50.606 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:50.607 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:50.607 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.608 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.608 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:07:50.608 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:50.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.610 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.610 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:07:50.610 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:50.611 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.611 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.612 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:50.612 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.613 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.613 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:07:50.613 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:50.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.614 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.615 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.615 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:07:50.615 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:50.616 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.616 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.616 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:50.616 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.617 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.617 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:07:50.617 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:50.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.618 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.618 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:07:50.619 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:50.619 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.619 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.620 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:50.620 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.620 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.620 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:07:50.621 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:50.621 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.621 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.621 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:07:50.622 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:50.622 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.622 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.622 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:07:50.623 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:07:50.623 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:07:50.623 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:07:50.623 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:50.624 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:50.624 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:50.624 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.625 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:07:50.625 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:50.625 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:50.625 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:50.625 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:50.626 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:50.626 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:50.626 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:50.626 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:50.627 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:50.627 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:50.627 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:50.627 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:50.627 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.628 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.628 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:07:50.628 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:50.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.629 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.629 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:07:50.629 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:50.629 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.629 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.630 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:50.630 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.631 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.631 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:07:50.631 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:50.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.632 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.632 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:07:50.632 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:50.632 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.632 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.633 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:50.633 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.633 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.634 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:07:50.634 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:50.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.634 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.635 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:07:50.635 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:50.635 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.635 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.635 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:50.636 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.636 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.636 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:07:50.636 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:50.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.637 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.637 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:07:50.638 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:50.638 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.638 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.638 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:07:50.639 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:07:50.639 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:07:50.639 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:07:50.639 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:50.639 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:50.639 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:50.640 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.640 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:07:50.640 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:50.641 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:50.641 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:50.641 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:50.641 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:50.641 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:50.642 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:50.642 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:50.642 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:50.642 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:50.642 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:50.642 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:50.643 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.643 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.643 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:07:50.644 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:50.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.645 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.645 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:07:50.646 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:50.646 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.646 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.647 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:50.647 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.648 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.648 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:07:50.649 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:50.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.650 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.650 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:07:50.650 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:50.651 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.651 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.652 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:50.652 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.652 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.653 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:07:50.653 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:50.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.653 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.653 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:07:50.654 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:50.654 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.654 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.654 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:50.655 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.655 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.655 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:07:50.656 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:50.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.656 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.657 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:07:50.657 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:50.657 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.657 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.657 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:07:50.658 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:07:50.658 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:07:50.658 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:07:50.658 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:50.658 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:50.659 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:50.659 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.660 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:07:50.660 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:50.660 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:50.660 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:50.660 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:50.660 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:50.661 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:50.661 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:50.661 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:50.661 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:50.661 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:50.662 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:50.662 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:50.662 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.662 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.663 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:07:50.663 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:50.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.663 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.663 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:07:50.664 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:50.664 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.664 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.664 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:50.665 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.665 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.665 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:07:50.665 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:50.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.666 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.666 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:07:50.666 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:50.667 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.667 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.667 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:50.667 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.668 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.668 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:07:50.668 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:50.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.669 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.669 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:07:50.669 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:50.669 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.669 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.670 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:50.670 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.670 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.671 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:07:50.671 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:50.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.671 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.671 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:07:50.672 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:50.672 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.672 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.673 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:07:50.673 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:07:50.673 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:07:50.673 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:07:50.673 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:50.673 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:50.674 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:50.674 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.674 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:07:50.675 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:50.675 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:50.675 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:50.675 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:50.675 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:50.676 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:50.676 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:50.676 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:50.676 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:50.676 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:50.676 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:50.677 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:50.677 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.677 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.677 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:07:50.678 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:50.678 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.678 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.678 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:07:50.679 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:50.679 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.679 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.679 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.679 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:50.680 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.680 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.680 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.680 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:07:50.680 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:50.681 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.681 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.681 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.681 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:07:50.681 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:50.681 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.682 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.682 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:50.682 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.683 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.683 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:07:50.683 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:50.683 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.683 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.683 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.684 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:07:50.684 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:50.684 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.684 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.684 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.684 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:50.685 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.685 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.685 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.685 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:07:50.685 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:50.686 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.686 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.686 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.686 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:07:50.686 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:50.686 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.687 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.687 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.687 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:07:50.687 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:07:50.687 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:07:50.688 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:07:50.688 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:50.688 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:50.688 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:50.688 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.688 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.689 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.689 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:07:50.689 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:50.689 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:50.689 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:50.689 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:50.690 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:50.690 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:50.690 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:50.690 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:50.690 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.715 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:07:50.715 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:50.715 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:50.715 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:50.716 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:50.716 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:50.716 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:07:50.716 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:50.716 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.717 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:07:50.717 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:50.717 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:50.717 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:50.717 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:50.717 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:50.718 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:07:50.718 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:50.718 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.718 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:50.718 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:07:50.719 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:50.719 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:50.719 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:50.719 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:50.719 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:50.719 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:07:50.720 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:50.720 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.720 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:07:50.720 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:07:50.720 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:07:50.721 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:07:50.721 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:07:50.721 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:07:50.721 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:07:50.721 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:07:50.721 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:07:50.722 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:07:50.722 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:07:50.722 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:07:50.722 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:07:50.722 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:07:50.723 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:07:50.723 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:50.723 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:07:50.723 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:07:50.723 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:07:50.724 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:07:50.724 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:07:50.724 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:07:50.724 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:07:50.724 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:07:50.725 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:07:50.725 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:07:50.725 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:07:50.725 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:50.725 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:07:50.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 -- 172.21.15.130:0/1882213205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5a0065b20 msgr2=0x7fe5a0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:50.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5a0065b20 0x7fe5a0067fe0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc1540b0 tx=0x7fe5b80013f0 comp rx=0 tx=0).stop 2023-09-13T06:07:50.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 -- 172.21.15.130:0/1882213205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06c5b0 msgr2=0x7fe5bc156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:50.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06c5b0 0x7fe5bc156490 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009ae0 tx=0x7fe5a8007a10 comp rx=0 tx=0).stop 2023-09-13T06:07:50.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 -- 172.21.15.130:0/1882213205 shutdown_connections 2023-09-13T06:07:50.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5a0065b20 0x7fe5a0067fe0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:50.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5bc06ca30 0x7fe5bc1569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:50.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06c5b0 0x7fe5bc156490 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:50.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 --2- 172.21.15.130:0/1882213205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5a8006170 0x7fe5bc13fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:50.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 -- 172.21.15.130:0/1882213205 >> 172.21.15.130:0/1882213205 conn(0x7fe5bc065990 msgr2=0x7fe5bc0aef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:50.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 -- 172.21.15.130:0/1882213205 shutdown_connections 2023-09-13T06:07:50.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:50.500+0000 7fe5c36ec640 1 -- 172.21.15.130:0/1882213205 wait complete. 2023-09-13T06:07:50.730 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:07:55.731 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:07:55.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.876+0000 7f18a52d8640 1 Processor -- start 2023-09-13T06:07:55.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.876+0000 7f18a52d8640 1 -- start start 2023-09-13T06:07:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f18a52d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f18a00ce7b0 0x7f18a00cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f18a52d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00ccfd0 con 0x7f18a00b1d20 2023-09-13T06:07:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f18a52d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00ced90 con 0x7f18a0159f20 2023-09-13T06:07:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f18a52d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00b00f0 con 0x7f18a00ce7b0 2023-09-13T06:07:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f1897fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f18a00b1d20 0x7f18a00ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:56238/0 (socket says 172.21.15.130:56238) 2023-09-13T06:07:55.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f1897fff640 1 -- 172.21.15.130:0/3369837375 learned_addr learned my addr 172.21.15.130:0/3369837375 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:07:55.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397660392 0 0) 0x7f18a00ccfd0 con 0x7f18a00b1d20 2023-09-13T06:07:55.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189f7fe640 1 --2- 172.21.15.130:0/3369837375 >> v2:172.21.15.164:3300/0 conn(0x7f18a00ce7b0 0x7f18a00cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:55.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f188c005740 con 0x7f18a00b1d20 2023-09-13T06:07:55.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 416605645 0 0) 0x7f188c005740 con 0x7f18a00b1d20 2023-09-13T06:07:55.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 >> v2:172.21.15.164:3300/0 conn(0x7f18a00ce7b0 msgr2=0x7f18a00cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:55.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 --2- 172.21.15.130:0/3369837375 >> v2:172.21.15.164:3300/0 conn(0x7f18a00ce7b0 0x7f18a00cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:55.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 >> v1:172.21.15.164:6789/0 conn(0x7f18a0159f20 legacy=0x7f18a00b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:55.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00cd200 con 0x7f18a00b1d20 2023-09-13T06:07:55.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f1888001680 con 0x7f18a00b1d20 2023-09-13T06:07:55.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 >> v1:172.21.15.130:6789/0 conn(0x7f18a00b1d20 legacy=0x7f18a00ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:55.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f188c005c00 0x7f188c006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:55.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f188c0069e0 0x7f188c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:55.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f188c0074c0 0x7f188c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:55.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c00e3b0 con 0x7f188c0069e0 2023-09-13T06:07:55.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c00e520 con 0x7f188c005c00 2023-09-13T06:07:55.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c00e6e0 con 0x7f188c0074c0 2023-09-13T06:07:55.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f1897fff640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f188c0069e0 0x7f188c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189f7fe640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f188c0074c0 0x7f188c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189effd640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f188c005c00 0x7f188c006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f1897fff640 1 -- 172.21.15.130:0/3369837375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f188c0074c0 msgr2=0x7f188c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f1897fff640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f188c0074c0 0x7f188c00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f1897fff640 1 -- 172.21.15.130:0/3369837375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f188c005c00 msgr2=0x7f188c006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:07:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f1897fff640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f188c005c00 0x7f188c006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f1897fff640 1 -- 172.21.15.130:0/3369837375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c005740 con 0x7f188c0069e0 2023-09-13T06:07:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189effd640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f188c005c00 0x7f188c006000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.880+0000 7f189f7fe640 1 -- 172.21.15.130:0/3369837375 reap_dead start 2023-09-13T06:07:55.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.884+0000 7f1897fff640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f188c0069e0 0x7f188c006e60 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f188800c1c0 tx=0x7f188801cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64c5f4da6daecac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:55.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.884+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888005ae0 con 0x7f188c0069e0 2023-09-13T06:07:55.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.884+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1888005c60 con 0x7f188c0069e0 2023-09-13T06:07:55.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.884+0000 7f189e7fc640 1 -- 172.21.15.130:0/3369837375 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880072b0 con 0x7f188c0069e0 2023-09-13T06:07:55.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.884+0000 7f18a52d8640 1 -- 172.21.15.130:0/3369837375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f188c0069e0 msgr2=0x7f188c006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:55.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.884+0000 7f18a52d8640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f188c0069e0 0x7f188c006e60 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f188800c1c0 tx=0x7f188801cb70 comp rx=0 tx=0).stop 2023-09-13T06:07:55.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.884+0000 7f18a52d8640 1 -- 172.21.15.130:0/3369837375 shutdown_connections 2023-09-13T06:07:55.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.884+0000 7f18a52d8640 1 --2- 172.21.15.130:0/3369837375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f188c0069e0 0x7f188c006e60 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:55.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.884+0000 7f18a52d8640 1 -- 172.21.15.130:0/3369837375 >> 172.21.15.130:0/3369837375 conn(0x7f18a0065990 msgr2=0x7f18a0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:55.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.884+0000 7f18a52d8640 1 -- 172.21.15.130:0/3369837375 shutdown_connections 2023-09-13T06:07:55.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.884+0000 7f18a52d8640 1 -- 172.21.15.130:0/3369837375 wait complete. 2023-09-13T06:07:55.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18a52d8640 1 Processor -- start 2023-09-13T06:07:55.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18a52d8640 1 -- start start 2023-09-13T06:07:55.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18a52d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f188c0069e0 0x7f18a01f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:55.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18a52d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a00c9480 0x7f18a00c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:55.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18a52d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18a00aab10 0x7f18a00aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:55.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18a52d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c9e40 con 0x7f18a00aab10 2023-09-13T06:07:55.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18a52d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a01f5990 con 0x7f18a00c9480 2023-09-13T06:07:55.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18a52d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00ac330 con 0x7f188c0069e0 2023-09-13T06:07:55.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f189f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18a00aab10 0x7f18a00aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:55.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f189f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18a00aab10 0x7f18a00aaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:55958/0 (socket says 172.21.15.130:55958) 2023-09-13T06:07:55.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f189f7fe640 1 -- 172.21.15.130:0/2314247478 learned_addr learned my addr 172.21.15.130:0/2314247478 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:07:55.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f189effd640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f188c0069e0 0x7f18a01f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:55.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f1897fff640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a00c9480 0x7f18a00c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:55.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f189f7fe640 1 -- 172.21.15.130:0/2314247478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f188c0069e0 msgr2=0x7f18a01f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:55.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f189f7fe640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f188c0069e0 0x7f18a01f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f189f7fe640 1 -- 172.21.15.130:0/2314247478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a00c9480 msgr2=0x7f18a00c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f189f7fe640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a00c9480 0x7f18a00c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f189f7fe640 1 -- 172.21.15.130:0/2314247478 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00ab4d0 con 0x7f18a00aab10 2023-09-13T06:07:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f189effd640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f188c0069e0 0x7f18a01f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f1897fff640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a00c9480 0x7f18a00c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:07:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f189f7fe640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18a00aab10 0x7f18a00aaf90 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f18980045e0 tx=0x7f1898007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:55.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18977fe640 1 -- 172.21.15.130:0/2314247478 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898009aa0 con 0x7f18a00aab10 2023-09-13T06:07:55.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18977fe640 1 -- 172.21.15.130:0/2314247478 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18980046d0 con 0x7f18a00aab10 2023-09-13T06:07:55.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18a52d8640 1 -- 172.21.15.130:0/2314247478 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a0154770 con 0x7f18a00aab10 2023-09-13T06:07:55.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18977fe640 1 -- 172.21.15.130:0/2314247478 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898015660 con 0x7f18a00aab10 2023-09-13T06:07:55.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18a52d8640 1 -- 172.21.15.130:0/2314247478 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a00aba00 con 0x7f18a00aab10 2023-09-13T06:07:55.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.888+0000 7f18a52d8640 1 -- 172.21.15.130:0/2314247478 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a00ac4c0 con 0x7f18a00aab10 2023-09-13T06:07:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.892+0000 7f18977fe640 1 -- 172.21.15.130:0/2314247478 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f18980157c0 con 0x7f18a00aab10 2023-09-13T06:07:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.892+0000 7f18977fe640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1880065b50 0x7f1880068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:07:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.892+0000 7f18977fe640 1 -- 172.21.15.130:0/2314247478 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1898083990 con 0x7f18a00aab10 2023-09-13T06:07:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.892+0000 7f189effd640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1880065b50 0x7f1880068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:07:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.892+0000 7f189effd640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1880065b50 0x7f1880068010 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f18a00cc830 tx=0x7f1890009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:07:55.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:55.896+0000 7f18977fe640 1 -- 172.21.15.130:0/2314247478 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f18980511c0 con 0x7f18a00aab10 2023-09-13T06:07:56.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.040+0000 7f18a52d8640 1 -- 172.21.15.130:0/2314247478 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f18a00618a0 con 0x7f18a00aab10 2023-09-13T06:07:56.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18977fe640 1 -- 172.21.15.130:0/2314247478 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+34006 (secure 0 0 0) 0x7f18980547e0 con 0x7f18a00aab10 2023-09-13T06:07:56.045 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:07:56.046 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:07:56.046 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 138, 2023-09-13T06:07:56.046 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:07:56.046 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:07:56.046 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:07:49.591247+0000", 2023-09-13T06:07:56.047 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:07:56.047 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:07:56.047 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:07:56.047 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:07:56.047 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:07:56.048 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:07:56.048 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:07:56.048 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:07:56.048 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:07:56.048 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:07:56.049 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:07:56.049 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:07:56.049 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:07:56.049 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:07:56.049 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:07:56.049 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 17, 2023-09-13T06:07:56.050 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:07:56.050 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:07:56.050 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:07:56.050 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:07:56.050 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:07:56.051 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:07:56.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.051 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:07:56.051 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:07:56.051 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:07:56.052 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:07:56.052 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:07:56.052 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:07:56.052 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:07:56.052 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:07:56.052 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:07:56.053 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:07:56.053 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:07:56.053 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:07:56.053 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:07:56.053 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:07:56.054 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:07:56.054 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:07:56.054 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:07:56.054 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:07:56.054 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:07:56.055 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:07:56.055 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:07:56.055 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:07:56.055 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:07:56.055 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:07:56.055 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:07:56.056 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:07:56.056 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:07:56.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.056 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:07:56.056 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:07:56.057 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:07:56.057 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:07:56.057 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:07:56.057 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:07:56.057 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:07:56.058 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:07:56.058 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:07:56.058 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:07:56.058 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:07:56.058 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:07:56.059 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:07:56.059 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:07:56.059 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:07:56.059 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:07:56.059 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:07:56.060 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:07:56.060 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:07:56.060 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:07:56.060 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:07:56.060 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:07:56.061 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:07:56.061 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:07:56.061 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:07:56.061 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:07:56.061 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:07:56.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.062 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:07:56.062 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:07:56.062 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:07:56.062 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:07:56.063 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:07:56.063 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:07:56.063 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:07:56.063 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:07:56.063 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:07:56.063 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:07:56.064 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:07:56.064 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:07:56.064 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:07:56.064 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:07:56.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.065 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:07:56.065 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:07:56.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.065 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:07:56.065 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:07:56.066 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:07:56.066 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:07:56.066 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:07:56.066 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:07:56.066 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:07:56.066 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:07:56.067 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:07:56.067 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.067 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 16, 2023-09-13T06:07:56.068 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:07:56.068 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:38.276233+0000", 2023-09-13T06:07:56.068 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:07:56.068 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:07:56.068 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:07:56.068 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:07:56.069 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:07:56.069 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:07:56.069 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:07:56.069 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:07:56.069 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:07:56.070 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:07:56.070 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:07:56.070 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:07:56.070 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:07:56.070 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:07:56.071 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:07:56.071 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:07:56.071 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:07:56.071 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:07:56.071 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:07:56.071 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:07:56.072 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:07:56.072 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:07:56.072 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:07:56.072 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:07:56.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.073 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "136", 2023-09-13T06:07:56.073 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:07:56.073 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:07:56.073 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:07:56.073 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:07:56.073 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:07:56.074 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:07:56.074 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:07:56.074 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:07:56.074 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:07:56.074 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:07:56.075 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:07:56.075 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:07:56.075 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:07:56.075 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:07:56.075 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:07:56.075 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:07:56.076 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:07:56.076 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:07:56.076 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:07:56.076 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:07:56.076 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:07:56.077 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:07:56.077 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:07:56.077 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:07:56.077 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:07:56.077 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:07:56.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.078 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:07:56.078 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:07:56.078 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:07:56.078 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:07:56.079 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:07:56.079 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:07:56.079 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:07:56.079 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:07:56.079 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:07:56.080 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:07:56.080 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:07:56.080 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:07:56.080 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:07:56.080 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:07:56.080 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:07:56.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.081 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:07:56.081 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:07:56.081 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:07:56.081 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.082 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:07:56.082 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:07:56.082 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:07:56.082 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:07:56.083 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:07:56.083 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:07:56.083 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:07:56.083 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:07:56.083 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:07:56.084 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.084 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 17, 2023-09-13T06:07:56.085 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:07:56.085 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:39.032744+0000", 2023-09-13T06:07:56.085 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:07:56.085 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:07:56.085 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:07:56.086 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:07:56.086 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:07:56.086 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:07:56.086 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:07:56.086 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:07:56.087 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:07:56.087 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:07:56.087 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:07:56.087 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:07:56.087 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:07:56.088 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:07:56.088 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:07:56.088 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:07:56.088 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:07:56.088 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:07:56.088 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:07:56.089 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:07:56.089 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:07:56.089 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:07:56.089 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:07:56.089 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:07:56.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.090 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "138", 2023-09-13T06:07:56.090 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:07:56.090 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:07:56.090 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:07:56.091 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:07:56.091 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:07:56.091 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:07:56.091 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:07:56.091 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:07:56.092 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:07:56.092 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:07:56.092 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:07:56.092 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:07:56.092 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:07:56.093 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:07:56.093 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:07:56.093 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:07:56.093 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:07:56.094 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:07:56.094 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:07:56.094 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:07:56.094 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:07:56.094 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:07:56.095 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:07:56.095 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:07:56.095 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:07:56.095 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:07:56.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.095 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:07:56.096 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:07:56.096 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:07:56.096 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:07:56.096 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:07:56.096 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:07:56.097 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:07:56.097 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:07:56.097 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:07:56.097 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:07:56.097 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:07:56.097 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:07:56.098 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:07:56.098 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:07:56.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.098 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:07:56.098 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:07:56.099 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:07:56.099 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.099 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:07:56.099 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:07:56.099 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:07:56.100 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:07:56.100 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:07:56.100 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:07:56.100 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:07:56.100 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:07:56.101 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:07:56.101 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.101 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.101 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:07:56.101 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:07:56.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.102 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:07:56.102 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:56.102 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:56.102 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:56.103 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:56.103 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:56.103 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:56.103 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:56.103 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:56.103 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:56.104 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:56.104 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:56.104 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:56.104 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.105 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.105 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:07:56.105 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:56.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.105 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.106 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:07:56.106 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:56.106 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.106 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.107 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:56.107 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.107 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.107 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.107 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:07:56.108 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:56.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.108 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.108 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:07:56.108 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:56.109 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.109 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.109 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:56.109 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.110 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.110 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:07:56.110 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:56.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.111 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.111 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:07:56.111 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:56.111 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.111 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.112 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:56.112 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.113 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.113 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:07:56.113 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:56.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.114 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.114 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:07:56.114 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:07:56.114 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.115 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.115 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:07:56.115 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:07:56.116 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:07:56.116 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:07:56.116 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:56.116 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:56.116 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:56.117 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.117 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:07:56.118 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:56.118 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:56.118 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:56.118 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:56.119 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:56.119 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:56.119 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:56.119 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:56.119 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:56.120 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:56.120 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:56.120 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:56.120 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.121 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.121 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:07:56.121 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:56.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.121 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.122 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:07:56.122 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:56.122 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.122 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.123 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:56.123 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.124 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.124 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:07:56.124 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:56.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.125 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.125 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:07:56.125 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:56.126 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.126 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.127 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:56.127 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.127 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.127 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:07:56.128 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:56.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.128 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.129 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:07:56.129 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:56.129 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.129 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.129 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:56.130 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.130 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.130 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:07:56.130 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:56.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.131 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.131 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:07:56.131 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:07:56.131 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.132 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.132 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:07:56.132 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:07:56.132 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:07:56.133 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:07:56.133 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:56.133 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:56.133 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:56.133 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.134 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:07:56.134 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:56.134 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:56.134 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:56.135 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:56.135 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:56.135 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:56.135 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:56.135 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:56.136 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:56.136 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:56.136 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:56.136 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:56.136 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.137 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.137 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.137 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:07:56.137 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:56.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.137 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.138 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.138 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:07:56.138 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:56.138 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.138 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.139 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:56.139 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.139 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.139 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:07:56.140 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:56.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.140 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.140 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.140 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:07:56.141 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:56.141 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.141 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.141 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:56.142 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.142 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.142 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.142 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:07:56.142 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:56.143 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.143 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.143 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.143 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:07:56.143 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:56.143 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.144 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.144 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:56.144 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.144 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.144 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.145 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:07:56.145 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:56.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.145 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.146 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:07:56.146 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:07:56.146 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.146 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.147 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:07:56.147 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:07:56.147 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:07:56.147 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:07:56.147 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:56.148 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:56.148 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:56.148 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.148 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.149 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:07:56.149 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:56.149 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:56.149 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:56.149 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:56.149 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:56.150 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:56.150 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:56.150 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:56.150 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:56.150 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:56.151 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:56.151 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:56.151 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.151 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.151 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.152 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:07:56.152 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:56.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.152 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.152 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:07:56.153 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:56.153 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.153 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.153 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:56.154 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.154 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.154 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:07:56.154 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:56.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.155 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.155 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:07:56.155 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:56.155 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.156 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.156 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:56.156 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.157 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.157 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:07:56.157 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:56.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.158 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.158 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:07:56.159 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:56.159 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.159 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.160 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:56.160 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.160 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.161 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:07:56.161 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:56.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.161 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.162 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:07:56.162 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:07:56.162 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.162 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.162 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:07:56.163 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:07:56.163 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:07:56.163 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:07:56.163 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:56.163 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:56.164 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:56.164 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.164 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:07:56.164 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:56.165 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:56.165 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:56.165 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:56.165 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:56.165 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:56.166 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:56.166 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:56.166 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:56.166 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:56.166 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:56.166 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:56.167 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.167 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.167 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:07:56.167 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:56.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.168 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.168 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:07:56.168 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:56.169 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.169 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.169 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:56.169 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.169 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.170 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.170 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:07:56.170 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:56.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.171 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.171 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:07:56.171 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:56.171 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.171 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.172 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:56.172 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.172 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.173 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:07:56.173 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:56.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.173 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.173 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:07:56.174 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:56.174 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.174 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.174 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:56.175 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.175 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.175 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:07:56.175 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:56.176 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.176 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.176 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:07:56.176 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:07:56.177 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.177 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.177 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:07:56.177 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:07:56.178 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:07:56.178 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:07:56.178 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:56.178 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:56.178 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:56.178 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.179 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.179 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:07:56.179 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:56.180 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:56.180 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:56.180 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:56.180 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:56.181 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:56.181 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:56.181 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:56.181 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:56.181 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:56.181 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:56.182 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:56.182 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.183 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.183 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:07:56.183 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:56.183 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.183 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.183 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.184 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:07:56.184 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:56.184 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.185 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.185 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.185 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:56.185 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.185 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.186 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.186 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:07:56.186 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:56.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.187 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.187 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.187 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:07:56.187 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:56.187 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.188 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.188 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:56.188 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.189 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.189 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:07:56.189 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:56.189 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.189 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.190 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.190 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:07:56.190 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:56.190 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.190 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.191 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:56.191 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.191 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.192 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.192 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:07:56.192 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:56.192 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.193 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.193 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.193 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:07:56.193 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:07:56.193 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.194 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.194 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:07:56.194 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:07:56.195 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:07:56.195 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:07:56.195 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:56.195 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:56.196 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:56.196 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.196 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.196 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:07:56.197 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:56.197 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:56.197 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:56.197 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:56.197 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:56.198 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:56.198 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:56.198 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:56.198 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:56.198 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:56.199 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:56.199 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:56.199 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.199 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.199 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.200 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:07:56.200 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:56.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.200 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.200 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.201 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:07:56.201 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:56.201 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.201 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.201 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.202 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:56.202 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.202 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.202 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.203 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:07:56.203 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:56.203 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.203 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.203 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.204 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:07:56.204 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:56.204 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.204 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.204 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.205 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:56.205 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.205 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.205 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.205 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:07:56.206 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:56.206 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.206 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.206 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.207 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:07:56.207 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:56.207 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.207 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.207 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.208 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:56.208 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.208 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.208 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.208 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:07:56.209 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:56.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.209 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.209 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.209 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:07:56.210 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:07:56.210 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.210 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.210 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.210 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:07:56.211 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:07:56.211 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:07:56.211 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:07:56.211 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:56.211 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:56.211 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:56.212 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.212 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:07:56.212 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:07:56.213 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:07:56.213 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:07:56.213 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:07:56.213 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:07:56.213 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:07:56.214 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:07:56.214 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:07:56.214 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:07:56.214 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:07:56.214 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:07:56.215 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:07:56.215 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.215 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.215 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.216 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:07:56.216 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:56.216 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.216 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.216 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.217 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:07:56.217 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:56.217 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.217 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.218 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:07:56.218 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.218 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.218 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.218 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:07:56.219 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:56.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.219 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.219 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.219 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:07:56.220 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:56.220 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.220 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.220 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.220 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:07:56.221 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.221 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.221 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.221 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:07:56.221 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:56.221 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.222 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.222 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.222 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:07:56.222 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:56.222 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.223 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.223 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:07:56.223 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:07:56.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.224 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:07:56.224 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:07:56.224 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:56.224 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.224 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.225 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:07:56.225 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:07:56.225 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:07:56.225 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.225 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.226 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:07:56.226 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:07:56.226 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:07:56.226 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:07:56.226 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:07:56.227 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:07:56.227 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:07:56.227 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:07:56.227 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.227 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:07:56.228 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:07:56.228 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.228 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:07:56.228 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:56.228 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:56.229 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:56.229 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:56.229 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:56.229 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:07:56.229 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:56.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.230 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.230 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:07:56.230 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:56.230 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:56.230 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:56.231 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:56.231 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:56.231 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:07:56.231 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:56.231 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.232 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:07:56.232 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:56.232 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:56.232 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:56.233 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:56.233 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:56.233 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:07:56.233 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:56.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.234 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:07:56.234 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:56.234 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:56.234 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:56.234 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:56.235 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:56.235 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:07:56.235 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:56.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.236 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:07:56.236 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:56.236 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:56.236 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:56.236 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:56.237 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:56.237 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:07:56.237 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:56.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.237 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:07:56.238 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:56.241 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:56.241 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:56.241 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:56.242 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:56.242 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:07:56.242 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:56.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.242 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.243 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:07:56.243 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:56.243 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:56.243 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:56.243 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:56.244 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:56.244 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:07:56.244 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:56.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:07:56.245 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:07:56.245 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:07:56.245 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:07:56.245 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:07:56.245 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:07:56.246 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:07:56.246 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:07:56.246 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:07:56.246 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.246 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:07:56.247 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:07:56.247 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:07:56.247 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:07:56.247 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:07:56.247 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:07:56.247 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:07:56.248 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:07:56.248 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:07:56.248 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:07:56.248 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:07:56.248 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:07:56.249 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:07:56.249 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:07:56.249 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:07:56.249 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:07:56.249 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:07:56.250 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:07:56.250 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:07:56.250 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:07:56.250 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:07:56.250 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:07:56.251 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:07:56.251 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:07:56.251 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:07:56.251 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:07:56.251 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:07:56.252 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:07:56.252 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:07:56.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 -- 172.21.15.130:0/2314247478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1880065b50 msgr2=0x7f1880068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:56.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1880065b50 0x7f1880068010 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f18a00cc830 tx=0x7f1890009040 comp rx=0 tx=0).stop 2023-09-13T06:07:56.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 -- 172.21.15.130:0/2314247478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18a00aab10 msgr2=0x7f18a00aaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:07:56.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18a00aab10 0x7f18a00aaf90 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f18980045e0 tx=0x7f1898007700 comp rx=0 tx=0).stop 2023-09-13T06:07:56.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 -- 172.21.15.130:0/2314247478 shutdown_connections 2023-09-13T06:07:56.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1880065b50 0x7f1880068010 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:56.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a00c9480 0x7f18a00c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:56.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18a00aab10 0x7f18a00aaf90 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:56.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 --2- 172.21.15.130:0/2314247478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f188c0069e0 0x7f18a01f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:07:56.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 -- 172.21.15.130:0/2314247478 >> 172.21.15.130:0/2314247478 conn(0x7f18a0065990 msgr2=0x7f18a00ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:07:56.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 -- 172.21.15.130:0/2314247478 shutdown_connections 2023-09-13T06:07:56.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:07:56.044+0000 7f18a52d8640 1 -- 172.21.15.130:0/2314247478 wait complete. 2023-09-13T06:07:56.256 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:08:01.257 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:08:01.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.404+0000 7f579b456640 1 Processor -- start 2023-09-13T06:08:01.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.404+0000 7f579b456640 1 -- start start 2023-09-13T06:08:01.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.404+0000 7f579b456640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f57940d1090 0x7f579415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:01.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.404+0000 7f579b456640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5794146f30 0x7f57940b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:01.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.404+0000 7f579b456640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57940b63c0 con 0x7f57940d1750 2023-09-13T06:08:01.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.404+0000 7f579b456640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579415dea0 con 0x7f57940d1090 2023-09-13T06:08:01.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.404+0000 7f579b456640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57940d0c20 con 0x7f5794146f30 2023-09-13T06:08:01.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f57991f2640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f57940d1750 0x7f5794146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49010/0 (socket says 172.21.15.130:49010) 2023-09-13T06:08:01.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f57991f2640 1 -- 172.21.15.130:0/1550769539 learned_addr learned my addr 172.21.15.130:0/1550769539 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:01.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f57999f3640 1 --2- 172.21.15.130:0/1550769539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5794146f30 0x7f57940b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:01.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f57989f1640 1 --2- 172.21.15.130:0/1550769539 >> v2:172.21.15.164:3300/0 conn(0x7f57940d1090 0x7f579415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:01.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f578bfff640 1 -- 172.21.15.130:0/1550769539 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509453047 0 0) 0x7f57940b63c0 con 0x7f57940d1750 2023-09-13T06:08:01.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f578bfff640 1 -- 172.21.15.130:0/1550769539 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5780003530 con 0x7f57940d1750 2023-09-13T06:08:01.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f57989f1640 1 -- 172.21.15.130:0/1550769539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5794146f30 msgr2=0x7f57940b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:01.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f57989f1640 1 --2- 172.21.15.130:0/1550769539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5794146f30 0x7f57940b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:01.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f57989f1640 1 -- 172.21.15.130:0/1550769539 >> v1:172.21.15.130:6789/0 conn(0x7f57940d1750 legacy=0x7f5794146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:01.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f57989f1640 1 -- 172.21.15.130:0/1550769539 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940b6610 con 0x7f57940d1090 2023-09-13T06:08:01.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f57989f1640 1 --2- 172.21.15.130:0/1550769539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57940d1090 0x7f579415d960 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f57840097c0 tx=0x7f578401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=282b7c515d300eea server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:01.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.408+0000 7f578bfff640 1 -- 172.21.15.130:0/1550769539 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840ab650 con 0x7f57940d1090 2023-09-13T06:08:01.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f578bfff640 1 -- 172.21.15.130:0/1550769539 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57840ab7b0 con 0x7f57940d1090 2023-09-13T06:08:01.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f578bfff640 1 -- 172.21.15.130:0/1550769539 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840abb40 con 0x7f57940d1090 2023-09-13T06:08:01.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 -- 172.21.15.130:0/1550769539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57940d1090 msgr2=0x7f579415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:01.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 --2- 172.21.15.130:0/1550769539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57940d1090 0x7f579415d960 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f57840097c0 tx=0x7f578401c450 comp rx=0 tx=0).stop 2023-09-13T06:08:01.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 -- 172.21.15.130:0/1550769539 shutdown_connections 2023-09-13T06:08:01.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 --2- 172.21.15.130:0/1550769539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5794146f30 0x7f57940b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:01.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 --2- 172.21.15.130:0/1550769539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57940d1090 0x7f579415d960 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:01.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 -- 172.21.15.130:0/1550769539 >> 172.21.15.130:0/1550769539 conn(0x7f579406f170 msgr2=0x7f579406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:01.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 -- 172.21.15.130:0/1550769539 shutdown_connections 2023-09-13T06:08:01.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 -- 172.21.15.130:0/1550769539 wait complete. 2023-09-13T06:08:01.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 Processor -- start 2023-09-13T06:08:01.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 -- start start 2023-09-13T06:08:01.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57940d1090 0x7f579413dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:01.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57940d1750 0x7f5794158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:01.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5794146f30 0x7f579415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:01.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5794159530 con 0x7f5794146f30 2023-09-13T06:08:01.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5794159eb0 con 0x7f57940d1750 2023-09-13T06:08:01.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f579b456640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579415a190 con 0x7f57940d1090 2023-09-13T06:08:01.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f57999f3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5794146f30 0x7f579415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:01.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f57999f3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5794146f30 0x7f579415b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54362/0 (socket says 172.21.15.130:54362) 2023-09-13T06:08:01.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f57999f3640 1 -- 172.21.15.130:0/634653583 learned_addr learned my addr 172.21.15.130:0/634653583 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:01.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f57989f1640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57940d1750 0x7f5794158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:01.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.412+0000 7f57991f2640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57940d1090 0x7f579413dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:01.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f57999f3640 1 -- 172.21.15.130:0/634653583 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57940d1090 msgr2=0x7f579413dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:01.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f57999f3640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57940d1090 0x7f579413dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:01.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f57999f3640 1 -- 172.21.15.130:0/634653583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57940d1750 msgr2=0x7f5794158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:01.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f57999f3640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57940d1750 0x7f5794158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:01.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f57999f3640 1 -- 172.21.15.130:0/634653583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5784009420 con 0x7f5794146f30 2023-09-13T06:08:01.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f57989f1640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57940d1750 0x7f5794158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:01.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f57999f3640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5794146f30 0x7f579415b530 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f578c00efc0 tx=0x7f578c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:01.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f5789ffb640 1 -- 172.21.15.130:0/634653583 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c009ba0 con 0x7f5794146f30 2023-09-13T06:08:01.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f5789ffb640 1 -- 172.21.15.130:0/634653583 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c00f040 con 0x7f5794146f30 2023-09-13T06:08:01.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f5789ffb640 1 -- 172.21.15.130:0/634653583 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c0146c0 con 0x7f5794146f30 2023-09-13T06:08:01.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f579b456640 1 -- 172.21.15.130:0/634653583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57940b7e40 con 0x7f5794146f30 2023-09-13T06:08:01.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f579b456640 1 -- 172.21.15.130:0/634653583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579415a750 con 0x7f5794146f30 2023-09-13T06:08:01.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f579b456640 1 -- 172.21.15.130:0/634653583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57940618a0 con 0x7f5794146f30 2023-09-13T06:08:01.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f5789ffb640 1 -- 172.21.15.130:0/634653583 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f578c014820 con 0x7f5794146f30 2023-09-13T06:08:01.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.416+0000 7f5789ffb640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5778065b20 0x7f5778067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:01.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.420+0000 7f5789ffb640 1 -- 172.21.15.130:0/634653583 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f578c084110 con 0x7f5794146f30 2023-09-13T06:08:01.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.420+0000 7f5789ffb640 1 -- 172.21.15.130:0/634653583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7f577806d650 con 0x7f5794146f30 2023-09-13T06:08:01.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.420+0000 7f57991f2640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5778065b20 0x7f5778067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:01.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.420+0000 7f57991f2640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5778065b20 0x7f5778067fe0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f57900011f0 tx=0x7f5790009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:01.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.424+0000 7f5789ffb640 1 -- 172.21.15.130:0/634653583 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f578c051a50 con 0x7f5794146f30 2023-09-13T06:08:01.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.568+0000 7f579b456640 1 -- 172.21.15.130:0/634653583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f57940b86c0 con 0x7f5794146f30 2023-09-13T06:08:01.572 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f5789ffb640 1 -- 172.21.15.130:0/634653583 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+34025 (secure 0 0 0) 0x7f578c018070 con 0x7f5794146f30 2023-09-13T06:08:01.573 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:01.573 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:08:01.573 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 139, 2023-09-13T06:08:01.574 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:08:01.574 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:08:01.574 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:07:57.380470+0000", 2023-09-13T06:08:01.574 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:08:01.574 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:08:01.575 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:08:01.575 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:08:01.575 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:08:01.575 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:08:01.575 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:08:01.576 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:08:01.576 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:08:01.576 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:01.576 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:08:01.576 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:08:01.576 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:08:01.577 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:08:01.577 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:08:01.577 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 17, 2023-09-13T06:08:01.577 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:08:01.577 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:08:01.578 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:08:01.578 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:08:01.578 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:08:01.578 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:08:01.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.579 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:08:01.579 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:08:01.579 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:08:01.579 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:01.579 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:01.580 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:01.580 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:01.580 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:01.580 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:01.580 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:01.580 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:01.581 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:01.581 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:01.581 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:01.581 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:01.581 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:08:01.582 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:08:01.582 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:08:01.582 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:08:01.582 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:08:01.582 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:01.583 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:01.583 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:01.583 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:01.583 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:01.583 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:01.583 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:01.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.584 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:08:01.584 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:01.584 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:01.584 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:01.585 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:01.585 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:01.585 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:01.585 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:01.585 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:01.586 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:01.586 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:01.586 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:01.586 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:01.586 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:01.587 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:01.587 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:01.587 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:01.587 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:01.587 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:01.587 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:01.588 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:01.588 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:01.588 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:01.588 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:01.588 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:01.589 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:01.589 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:01.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.589 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:01.589 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:01.590 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:01.590 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:01.590 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:01.590 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:01.590 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:01.591 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:01.591 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:01.591 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:01.591 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:01.591 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:01.591 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:08:01.592 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:08:01.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.592 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:01.592 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:08:01.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.593 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:01.593 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:08:01.593 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:08:01.593 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:08:01.593 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:08:01.593 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:08:01.594 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:01.594 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:01.594 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:01.594 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.595 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 16, 2023-09-13T06:08:01.595 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:08:01.595 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:38.276233+0000", 2023-09-13T06:08:01.595 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:01.595 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:01.596 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:01.596 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:01.596 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:01.596 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:01.596 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:01.597 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:01.597 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:01.597 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:01.597 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:01.597 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:01.598 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:08:01.598 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:08:01.598 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:08:01.598 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:08:01.598 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:08:01.598 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:01.599 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:01.599 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:01.599 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:01.599 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:01.599 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:01.600 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:01.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.600 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "136", 2023-09-13T06:08:01.600 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:01.600 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:01.601 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:01.601 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:01.601 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:01.601 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:01.601 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:01.602 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:01.602 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:01.602 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:01.602 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:01.602 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:01.603 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:01.603 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:01.603 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:01.603 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:01.603 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:01.603 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:01.604 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:01.604 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:01.604 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:01.604 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:01.604 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:01.605 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:01.605 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:01.605 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:01.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.605 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:01.606 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:01.606 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:01.606 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:01.606 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:01.606 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:01.607 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:01.607 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:01.607 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:01.607 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:01.607 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:01.607 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:01.608 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:08:01.608 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:08:01.608 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:08:01.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.608 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:01.608 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:01.609 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:08:01.609 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.609 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:01.609 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:08:01.610 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:08:01.610 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:01.610 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:08:01.610 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:08:01.610 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:01.611 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:01.611 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:01.611 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.612 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 17, 2023-09-13T06:08:01.612 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:08:01.612 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:39.032744+0000", 2023-09-13T06:08:01.612 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1027, 2023-09-13T06:08:01.612 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-13T06:08:01.612 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:01.613 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:01.613 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:01.613 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:01.613 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:01.613 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:01.614 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:01.614 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:01.614 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:01.614 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:01.614 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:08:01.614 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:08:01.615 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:08:01.615 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:08:01.615 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:08:01.615 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:01.615 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:01.616 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:01.616 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:01.616 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:01.616 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:01.616 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:01.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.617 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "139", 2023-09-13T06:08:01.617 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:01.617 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:01.617 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:01.617 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:01.618 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:01.618 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:01.618 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:01.618 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:01.618 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:01.619 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:08:01.619 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:01.619 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:01.619 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:01.619 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:01.619 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:01.620 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:01.620 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:01.620 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:01.620 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:01.620 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:01.621 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:01.621 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:01.621 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:01.621 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:01.621 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:01.621 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:01.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.622 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:01.622 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:01.622 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:01.622 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:01.623 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:01.623 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:01.623 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:01.623 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:01.623 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:01.624 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:01.624 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:01.624 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:01.624 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:08:01.624 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:08:01.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.625 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:01.625 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:01.625 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:08:01.625 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.626 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:01.626 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:08:01.626 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:08:01.626 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:01.626 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:08:01.626 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:08:01.627 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:01.627 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:01.627 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:01.627 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.627 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.628 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:01.628 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:08:01.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.628 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:01.628 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:01.628 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:01.629 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:01.629 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:01.629 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:01.629 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:01.629 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:01.630 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:01.630 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:01.630 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:01.630 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:01.630 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:01.631 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.631 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.631 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.631 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:08:01.631 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:01.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.632 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.632 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:08:01.632 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:01.632 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.633 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.633 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:01.633 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.633 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.634 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:08:01.634 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:01.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.634 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.635 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:08:01.635 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:01.635 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.635 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.635 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:01.636 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.636 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.636 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:08:01.636 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:01.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.637 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.637 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:08:01.637 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:01.638 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.638 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.638 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:01.638 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.639 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.639 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:08:01.639 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:01.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.640 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.640 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:08:01.640 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:01.640 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.640 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.641 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:08:01.641 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:08:01.641 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:08:01.641 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:08:01.641 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:01.642 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:01.642 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:01.642 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.643 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:01.643 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:01.643 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:01.643 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:01.643 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:01.643 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:01.644 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:01.644 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:01.644 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:01.644 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:01.644 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:01.645 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:01.645 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:01.645 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.645 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.646 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:08:01.646 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:01.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.646 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.646 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:08:01.647 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:01.647 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.647 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.647 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:01.648 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.648 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.648 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:08:01.648 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:01.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.649 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.649 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:08:01.649 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:01.649 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.650 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.650 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:01.650 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.650 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.651 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:08:01.651 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:01.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.651 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.652 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:08:01.652 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:01.652 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.652 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.652 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:01.653 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.653 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.653 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:08:01.653 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:01.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.654 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.654 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:08:01.654 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:01.655 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.655 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.655 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:08:01.655 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:08:01.655 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:08:01.656 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:08:01.656 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:01.656 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:01.656 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:01.656 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.657 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:01.657 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:01.657 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:01.658 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:01.658 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:01.658 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:01.658 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:01.658 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:01.659 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:01.659 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:01.659 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:01.659 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:01.659 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:01.660 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.660 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.660 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:08:01.660 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:01.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.661 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.661 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:08:01.661 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:01.661 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.662 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.662 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:01.662 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.662 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.663 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:08:01.663 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:01.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.663 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.664 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:08:01.664 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:01.664 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.664 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.665 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:01.665 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.665 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.665 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:08:01.666 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:01.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.666 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.666 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.666 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:08:01.667 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:01.667 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.667 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.667 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:01.667 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.668 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.668 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:08:01.668 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:01.668 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.669 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.669 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:08:01.669 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:01.669 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.670 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.670 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:08:01.670 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:08:01.670 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:08:01.670 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:08:01.671 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:01.671 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:01.671 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:01.671 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.672 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:01.672 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:01.672 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:01.672 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:01.672 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:01.673 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:01.673 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:01.673 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:01.673 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:01.673 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:01.674 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:01.674 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:01.674 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:01.674 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.675 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.675 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:08:01.675 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:01.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.675 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.676 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.676 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:08:01.676 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:01.676 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.676 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.677 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:01.677 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.677 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.677 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.677 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:08:01.678 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:01.678 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.678 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.678 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:08:01.678 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:01.679 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.679 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.679 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.679 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:01.679 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.680 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.680 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.680 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:08:01.680 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:01.680 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.680 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.681 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.681 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:08:01.681 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:01.681 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.681 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.682 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.682 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:01.682 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.682 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.683 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:08:01.683 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:01.683 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.683 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.683 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.683 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:08:01.684 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:01.684 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.684 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.684 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.684 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:08:01.685 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:08:01.685 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:08:01.685 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:08:01.685 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:01.685 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:01.685 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:01.686 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.686 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.686 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.686 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:01.686 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:01.687 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:01.687 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:01.687 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:01.687 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:01.687 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:01.688 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:01.688 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:01.688 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:01.688 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:01.688 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:01.689 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:01.689 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.689 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.689 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.689 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:08:01.690 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:01.690 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.690 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.690 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.690 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:08:01.690 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:01.691 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.691 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.691 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.691 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:01.691 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.692 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.692 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.692 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:08:01.692 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:01.692 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.692 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.693 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.693 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:08:01.693 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:01.693 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.693 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.694 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.694 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:01.694 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.694 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.694 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.695 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:08:01.695 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:01.695 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.695 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.695 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.696 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:08:01.696 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:01.696 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.696 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.696 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.696 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:01.697 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.697 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.697 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.697 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:08:01.697 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:01.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.698 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.698 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.698 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:08:01.698 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:01.699 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.699 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.699 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.699 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:08:01.699 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:08:01.700 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:08:01.700 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:08:01.700 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:01.700 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:01.700 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:01.700 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.701 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.701 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.701 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:01.701 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:01.701 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:01.702 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:01.702 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:01.702 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:01.702 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:01.702 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:01.702 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:01.703 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:01.703 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:01.703 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:01.703 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:01.703 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.704 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.704 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.704 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:08:01.704 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:01.704 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.705 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.705 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.705 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:08:01.705 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:01.705 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.706 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.706 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.706 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:01.706 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.706 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.706 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.707 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:08:01.707 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:01.707 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.707 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.707 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.708 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:08:01.708 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:01.708 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.708 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.708 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.708 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:01.709 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.709 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.709 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.709 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:08:01.709 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:01.710 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.710 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.710 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.710 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:08:01.710 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:01.711 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.711 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.711 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.711 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:01.711 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.711 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.712 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.712 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:08:01.712 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:01.712 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.712 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.713 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.713 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:08:01.713 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:01.713 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.713 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.714 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.714 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:08:01.714 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:08:01.714 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:08:01.714 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:08:01.714 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:01.715 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:01.715 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:01.715 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.715 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.716 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:01.716 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:01.716 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:01.716 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:01.716 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:01.716 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:01.717 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:01.717 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:01.717 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:01.717 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:01.717 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:01.718 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:01.718 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:01.718 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.718 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.718 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.718 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:08:01.719 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:01.719 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.719 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.719 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.719 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:08:01.720 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:01.720 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.720 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.720 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.720 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:01.721 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.721 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.721 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.721 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:08:01.721 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:01.721 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.722 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.722 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.722 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:08:01.722 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:01.722 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.723 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.723 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:01.723 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.723 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.723 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.724 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:08:01.724 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:01.724 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.724 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.724 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.725 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:08:01.725 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:01.725 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.725 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.725 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.725 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:01.726 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.726 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.726 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.726 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:08:01.726 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:01.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.727 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.727 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:08:01.727 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:01.727 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.728 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.728 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.728 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:08:01.728 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:08:01.728 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:08:01.729 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:08:01.729 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:01.729 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:01.729 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:01.729 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.730 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.730 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:01.730 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:01.730 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:01.730 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:01.731 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:01.731 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:01.731 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:01.731 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:01.731 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:01.732 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:01.732 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:01.732 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:01.732 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:01.732 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.733 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.733 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:08:01.733 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:01.733 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.734 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.734 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:08:01.734 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:01.734 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.734 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.735 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:01.735 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.735 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.735 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.736 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:08:01.736 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:01.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.736 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.736 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:08:01.737 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:01.737 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.737 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.737 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.737 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:01.738 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.738 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.738 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.738 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:08:01.738 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:01.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.739 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.739 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.739 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:08:01.739 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:01.739 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.740 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.740 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:01.740 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:01.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.741 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:01.741 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:08:01.741 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:01.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.741 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:01.742 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:08:01.742 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:01.742 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.742 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.742 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.743 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:08:01.743 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:08:01.743 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:08:01.743 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:08:01.743 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:01.743 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:01.744 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:01.744 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:01.744 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.744 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:01.744 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:08:01.745 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.745 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:01.745 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:01.745 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:01.745 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:01.745 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:01.746 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:01.746 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:08:01.746 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:01.746 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.746 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.747 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:01.747 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:01.747 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:01.747 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:01.747 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:01.747 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:01.748 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:08:01.748 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:01.748 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.748 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.748 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:01.749 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:01.749 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:01.749 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:01.749 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:01.749 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:01.749 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:08:01.750 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:01.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.750 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:01.750 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:01.751 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:01.751 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:01.751 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:01.751 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:01.751 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:08:01.751 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:01.752 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.752 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:01.752 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:01.752 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:01.753 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:01.753 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:01.753 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:01.753 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:08:01.753 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:01.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.754 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.754 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:01.754 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:01.754 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:01.754 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:01.755 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:01.755 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:01.755 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:08:01.755 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:01.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.756 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:01.756 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:01.756 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:01.756 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:01.756 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:01.757 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:01.757 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:08:01.757 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:01.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.757 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:01.757 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:01.758 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:01.758 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:01.758 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:01.758 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:01.758 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:01.759 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:08:01.759 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:01.759 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.759 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:01.759 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:08:01.760 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:08:01.760 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:08:01.760 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:08:01.760 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:08:01.760 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:08:01.760 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:08:01.761 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:08:01.761 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:08:01.761 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:08:01.761 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:08:01.761 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:08:01.762 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:08:01.762 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:08:01.762 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.762 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:01.762 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:08:01.763 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:08:01.763 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:08:01.763 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:08:01.763 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:08:01.763 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:08:01.763 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:08:01.764 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:08:01.764 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:08:01.764 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:08:01.764 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:08:01.764 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:01.764 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:08:01.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 -- 172.21.15.130:0/634653583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5778065b20 msgr2=0x7f5778067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:01.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5778065b20 0x7f5778067fe0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f57900011f0 tx=0x7f5790009040 comp rx=0 tx=0).stop 2023-09-13T06:08:01.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 -- 172.21.15.130:0/634653583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5794146f30 msgr2=0x7f579415b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:01.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5794146f30 0x7f579415b530 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f578c00efc0 tx=0x7f578c00c490 comp rx=0 tx=0).stop 2023-09-13T06:08:01.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 -- 172.21.15.130:0/634653583 shutdown_connections 2023-09-13T06:08:01.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5778065b20 0x7f5778067fe0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:01.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57940d1750 0x7f5794158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:01.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5794146f30 0x7f579415b530 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:01.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 --2- 172.21.15.130:0/634653583 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f57940d1090 0x7f579413dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:01.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 -- 172.21.15.130:0/634653583 >> 172.21.15.130:0/634653583 conn(0x7f579406f170 msgr2=0x7f579413f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:01.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 -- 172.21.15.130:0/634653583 shutdown_connections 2023-09-13T06:08:01.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:01.572+0000 7f579b456640 1 -- 172.21.15.130:0/634653583 wait complete. 2023-09-13T06:08:01.769 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-09-13T06:08:01.773 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:08:01.773 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:01.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:01.783 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-09-13T06:08:02.174 INFO:teuthology.orchestra.run.smithi130.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-09-13T06:08:02.175 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records in 2023-09-13T06:08:02.175 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records out 2023-09-13T06:08:02.175 INFO:teuthology.orchestra.run.smithi130.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.337883 s, 155 MB/s 2023-09-13T06:08:02.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:08:02.177 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:08:02.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.312+0000 7effa3982640 1 Processor -- start 2023-09-13T06:08:02.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.312+0000 7effa3982640 1 -- start start 2023-09-13T06:08:02.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.312+0000 7effa3982640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7eff9c147b50 0x7eff9c1652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.312+0000 7effa3982640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff9c147f30 0x7eff9c148410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.312+0000 7effa3982640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c06b5e0 con 0x7eff9c148950 2023-09-13T06:08:02.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.312+0000 7effa3982640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c06b8c0 con 0x7eff9c147f30 2023-09-13T06:08:02.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.312+0000 7effa3982640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c1657f0 con 0x7eff9c147b50 2023-09-13T06:08:02.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.312+0000 7effa0f1d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff9c147f30 0x7eff9c148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.312+0000 7effa0f1d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff9c147f30 0x7eff9c148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54372/0 (socket says 172.21.15.130:54372) 2023-09-13T06:08:02.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.312+0000 7effa0f1d640 1 -- 172.21.15.130:0/766337910 learned_addr learned my addr 172.21.15.130:0/766337910 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:02.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.316+0000 7effa0f1d640 1 -- 172.21.15.130:0/766337910 >> v2:172.21.15.164:3300/0 conn(0x7eff9c147b50 msgr2=0x7eff9c1652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:02.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.316+0000 7effa171e640 1 --2- 172.21.15.130:0/766337910 >> v2:172.21.15.164:3300/0 conn(0x7eff9c147b50 0x7eff9c1652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.316+0000 7effa0f1d640 1 --2- 172.21.15.130:0/766337910 >> v2:172.21.15.164:3300/0 conn(0x7eff9c147b50 0x7eff9c1652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.316+0000 7effa0f1d640 1 -- 172.21.15.130:0/766337910 >> v1:172.21.15.164:6789/0 conn(0x7eff9c148950 legacy=0x7eff9c06bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:02.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.316+0000 7effa0f1d640 1 -- 172.21.15.130:0/766337910 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c165ac0 con 0x7eff9c147f30 2023-09-13T06:08:02.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.316+0000 7effa171e640 1 --2- 172.21.15.130:0/766337910 >> v2:172.21.15.164:3300/0 conn(0x7eff9c147b50 0x7eff9c1652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:02.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.316+0000 7effa0f1d640 1 --2- 172.21.15.130:0/766337910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9c147f30 0x7eff9c148410 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0b23d0 tx=0x7eff8c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c076d510716bce0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:02.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.316+0000 7eff93fff640 1 -- 172.21.15.130:0/766337910 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0aa5f0 con 0x7eff9c147f30 2023-09-13T06:08:02.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.316+0000 7eff93fff640 1 -- 172.21.15.130:0/766337910 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c0aa750 con 0x7eff9c147f30 2023-09-13T06:08:02.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.316+0000 7eff93fff640 1 -- 172.21.15.130:0/766337910 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0aaae0 con 0x7eff9c147f30 2023-09-13T06:08:02.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 -- 172.21.15.130:0/766337910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9c147f30 msgr2=0x7eff9c148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:02.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 --2- 172.21.15.130:0/766337910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9c147f30 0x7eff9c148410 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0b23d0 tx=0x7eff8c01c490 comp rx=0 tx=0).stop 2023-09-13T06:08:02.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 -- 172.21.15.130:0/766337910 shutdown_connections 2023-09-13T06:08:02.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 --2- 172.21.15.130:0/766337910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9c147f30 0x7eff9c148410 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 --2- 172.21.15.130:0/766337910 >> v2:172.21.15.164:3300/0 conn(0x7eff9c147b50 0x7eff9c1652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 -- 172.21.15.130:0/766337910 >> 172.21.15.130:0/766337910 conn(0x7eff9c065990 msgr2=0x7eff9c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:02.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 -- 172.21.15.130:0/766337910 shutdown_connections 2023-09-13T06:08:02.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 -- 172.21.15.130:0/766337910 wait complete. 2023-09-13T06:08:02.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 Processor -- start 2023-09-13T06:08:02.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 -- start start 2023-09-13T06:08:02.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff9c147b50 0x7eff9c13d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9c147f30 0x7eff9c160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff9c148950 0x7eff9c142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c143b10 con 0x7eff9c147f30 2023-09-13T06:08:02.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c141590 con 0x7eff9c147b50 2023-09-13T06:08:02.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa3982640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c141870 con 0x7eff9c148950 2023-09-13T06:08:02.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa0f1d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9c147f30 0x7eff9c160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa0f1d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9c147f30 0x7eff9c160cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54388/0 (socket says 172.21.15.130:54388) 2023-09-13T06:08:02.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa0f1d640 1 -- 172.21.15.130:0/3902716246 learned_addr learned my addr 172.21.15.130:0/3902716246 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:02.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa171e640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff9c147b50 0x7eff9c13d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa1f1f640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff9c148950 0x7eff9c142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa0f1d640 1 -- 172.21.15.130:0/3902716246 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff9c148950 msgr2=0x7eff9c142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:02.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa0f1d640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff9c148950 0x7eff9c142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa0f1d640 1 -- 172.21.15.130:0/3902716246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff9c147b50 msgr2=0x7eff9c13d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:02.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa0f1d640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff9c147b50 0x7eff9c13d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa0f1d640 1 -- 172.21.15.130:0/3902716246 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0094d0 con 0x7eff9c147f30 2023-09-13T06:08:02.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.320+0000 7effa0f1d640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9c147f30 0x7eff9c160cc0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7eff8c01a0c0 tx=0x7eff8c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:02.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7eff91ffb640 1 -- 172.21.15.130:0/3902716246 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0b3800 con 0x7eff9c147f30 2023-09-13T06:08:02.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7eff91ffb640 1 -- 172.21.15.130:0/3902716246 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c0b3960 con 0x7eff9c147f30 2023-09-13T06:08:02.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7eff91ffb640 1 -- 172.21.15.130:0/3902716246 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0b3d10 con 0x7eff9c147f30 2023-09-13T06:08:02.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7effa3982640 1 -- 172.21.15.130:0/3902716246 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c141b50 con 0x7eff9c147f30 2023-09-13T06:08:02.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7effa3982640 1 -- 172.21.15.130:0/3902716246 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c142110 con 0x7eff9c147f30 2023-09-13T06:08:02.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7effa3982640 1 -- 172.21.15.130:0/3902716246 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c0618a0 con 0x7eff9c147f30 2023-09-13T06:08:02.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7eff91ffb640 1 -- 172.21.15.130:0/3902716246 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7eff8c0c73a0 con 0x7eff9c147f30 2023-09-13T06:08:02.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7eff91ffb640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff80065b20 0x7eff80067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7eff91ffb640 1 -- 172.21.15.130:0/3902716246 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff8c0a7070 con 0x7eff9c147f30 2023-09-13T06:08:02.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7effa171e640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff80065b20 0x7eff80067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7eff91ffb640 1 -- 172.21.15.130:0/3902716246 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7eff8006d650 con 0x7eff9c147f30 2023-09-13T06:08:02.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.324+0000 7effa171e640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff80065b20 0x7eff80067fe0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7eff9c146840 tx=0x7eff98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:02.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.328+0000 7eff91ffb640 1 -- 172.21.15.130:0/3902716246 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7eff8c0eb7d0 con 0x7eff9c147f30 2023-09-13T06:08:02.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.480+0000 7effa3982640 1 -- 172.21.15.130:0/3902716246 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7eff9c0b0170 con 0x7eff9c147f30 2023-09-13T06:08:02.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.480+0000 7eff91ffb640 1 -- 172.21.15.130:0/3902716246 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+34025 (secure 0 0 0) 0x7eff8c0c3070 con 0x7eff9c147f30 2023-09-13T06:08:02.483 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:02.483 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:08:02.483 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 139, 2023-09-13T06:08:02.483 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:08:02.484 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:08:02.484 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:07:57.380470+0000", 2023-09-13T06:08:02.484 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:08:02.484 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:08:02.484 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:08:02.485 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:08:02.485 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:08:02.485 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:08:02.485 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:08:02.485 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:08:02.486 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:08:02.486 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:02.486 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:08:02.486 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:08:02.486 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:08:02.487 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:08:02.487 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:08:02.487 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 17, 2023-09-13T06:08:02.487 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:08:02.487 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:08:02.488 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:08:02.488 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:08:02.488 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:08:02.488 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:08:02.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.489 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:08:02.489 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:08:02.489 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:08:02.489 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:02.489 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:02.490 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:02.490 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:02.490 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:02.490 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:02.490 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:02.491 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:02.491 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:02.491 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:02.491 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:02.491 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:02.492 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:08:02.492 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:08:02.492 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:08:02.492 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:08:02.492 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:08:02.493 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:02.493 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:02.493 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:02.493 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:02.493 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:02.494 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:02.494 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:02.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.494 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:08:02.494 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:02.495 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:02.495 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:02.495 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:02.495 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:02.495 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:02.495 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:02.496 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:02.496 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:02.496 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:02.496 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:02.496 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:02.497 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:02.497 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:02.497 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:02.497 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:02.497 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:02.498 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:02.498 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:02.498 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:02.498 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:02.498 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:02.499 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:02.499 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:02.499 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:02.499 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:02.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.500 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:02.500 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:02.500 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:02.500 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:02.501 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:02.501 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:02.501 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:02.501 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:02.501 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:02.502 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:02.502 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:02.502 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:02.502 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:08:02.502 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:08:02.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.503 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:02.503 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:08:02.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.503 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:02.503 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:08:02.504 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:08:02.504 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:08:02.504 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:08:02.504 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:08:02.504 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:02.505 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:02.505 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:02.505 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.506 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 16, 2023-09-13T06:08:02.506 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:08:02.506 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:38.276233+0000", 2023-09-13T06:08:02.506 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:02.506 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:02.507 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:02.507 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:02.507 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:02.507 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:02.507 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:02.508 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:02.508 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:02.508 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:02.508 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:02.508 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:02.509 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:08:02.509 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:08:02.509 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:08:02.509 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:08:02.509 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:08:02.510 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:02.510 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:02.510 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:02.510 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:02.510 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:02.511 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:02.511 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:02.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.511 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "136", 2023-09-13T06:08:02.511 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:02.511 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:02.512 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:02.512 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:02.512 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:02.512 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:02.512 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:02.513 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:02.513 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:02.513 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:02.513 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:02.513 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:02.514 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:02.514 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:02.514 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:02.515 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:02.515 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:02.515 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:02.515 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:02.516 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:02.518 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:02.518 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:02.518 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:02.518 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:02.518 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:02.519 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:02.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.519 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:02.519 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:02.519 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:02.519 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:02.520 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:02.520 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:02.520 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:02.520 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:02.520 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:02.521 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:02.521 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:02.521 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:02.521 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:08:02.521 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:08:02.522 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:08:02.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.522 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:02.522 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:02.522 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:08:02.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.523 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.523 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:02.523 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:08:02.523 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:08:02.523 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:02.524 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:08:02.524 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:08:02.524 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:02.524 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:02.524 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:02.525 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.525 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.525 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 17, 2023-09-13T06:08:02.525 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:08:02.526 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:39.032744+0000", 2023-09-13T06:08:02.526 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1027, 2023-09-13T06:08:02.526 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-13T06:08:02.526 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:02.526 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:02.526 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:02.527 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:02.527 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:02.527 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:02.527 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:02.527 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:02.527 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:02.528 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:02.528 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:08:02.528 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:08:02.528 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:08:02.528 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:08:02.529 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:08:02.529 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:02.529 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:02.529 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:02.529 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:02.529 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:02.530 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:02.530 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:02.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.530 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "139", 2023-09-13T06:08:02.530 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:02.531 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:02.531 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:02.531 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:02.531 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:02.531 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:08:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:02.532 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:02.533 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:02.534 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.535 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:02.536 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:02.537 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:08:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:08:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:02.538 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:08:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:02.539 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:08:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:08:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:08:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:08:02.540 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.541 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:08:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:02.542 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:02.543 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:08:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:08:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.546 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.547 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:08:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.548 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:08:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.549 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:08:02.550 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:08:02.551 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:02.552 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:08:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:02.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:08:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:02.554 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:08:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:08:02.555 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:08:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:08:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:02.556 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:02.557 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:02.558 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:08:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:08:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:08:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:08:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:08:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:08:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:08:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:08:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:08:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:08:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:08:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:08:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:02.572 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:02.573 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.574 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:08:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.575 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:08:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.576 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:08:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:02.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:08:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:02.578 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:08:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:08:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.582 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:08:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:08:02.583 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:08:02.584 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:08:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:08:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:08:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:02.585 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:02.586 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:02.587 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:02.588 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:08:02.589 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:08:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:02.590 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:08:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:08:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.594 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:08:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.595 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:08:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:08:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:02.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:08:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:08:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:08:02.599 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:08:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:08:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:02.601 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:02.602 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:08:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:08:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.605 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.606 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:08:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.607 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:08:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.608 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:08:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:02.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:08:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:02.610 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:08:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.612 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:08:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:08:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:08:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:08:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:08:02.614 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.615 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:02.616 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:02.617 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.618 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:08:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.619 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:08:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:08:02.621 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:08:02.622 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:02.623 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:08:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:08:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.625 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.626 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:08:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.627 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:08:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.628 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:08:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:08:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:08:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:08:02.629 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.630 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:02.631 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:02.632 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.633 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:08:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.634 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:08:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.635 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:08:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:02.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:08:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:02.637 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:08:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.639 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:08:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:08:02.641 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:08:02.642 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:08:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:08:02.643 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:08:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:08:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:02.644 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:02.645 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:02.646 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:02.647 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:08:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.648 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:08:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.649 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.650 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:08:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.651 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:08:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.652 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:08:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:02.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:08:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:02.654 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:02.655 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:08:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.656 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:08:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:08:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:08:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:08:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:08:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:02.658 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:02.659 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:02.659 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:02.659 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.659 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:02.659 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:08:02.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.660 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:02.660 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:02.660 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:02.660 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:02.661 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:02.661 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:02.661 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:08:02.661 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:02.661 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.662 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:02.662 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:02.662 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:02.662 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:02.662 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:02.663 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:02.663 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:08:02.663 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:02.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.663 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.663 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:02.664 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:02.664 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:02.664 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:02.664 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:02.664 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:02.665 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:08:02.665 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:02.665 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.665 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:02.665 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:02.666 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:02.666 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:02.666 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:02.666 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:02.666 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:08:02.667 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:02.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.667 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.667 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:02.667 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:02.667 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:02.668 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:02.668 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:02.668 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:02.668 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:08:02.668 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:02.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.669 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.669 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:02.669 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:02.669 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:02.669 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:02.670 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:02.670 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:02.670 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:08:02.670 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:02.670 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.671 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:02.671 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:02.671 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:02.671 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:02.671 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:02.672 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:02.672 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:08:02.672 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:02.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.672 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:02.673 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:02.673 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:02.673 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:02.673 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:02.673 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:02.674 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:02.674 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:08:02.674 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:02.674 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.674 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:02.674 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:08:02.675 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:08:02.675 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:08:02.675 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:08:02.675 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:08:02.675 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:08:02.676 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:08:02.676 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:08:02.676 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:08:02.676 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:08:02.676 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:08:02.676 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:08:02.677 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:08:02.677 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:08:02.677 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.677 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:02.677 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:08:02.678 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:08:02.678 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:08:02.678 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:08:02.678 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:08:02.678 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:08:02.678 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:08:02.679 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:08:02.679 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:08:02.679 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:08:02.679 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:08:02.679 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:02.680 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:08:02.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 -- 172.21.15.130:0/3902716246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff80065b20 msgr2=0x7eff80067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:02.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff80065b20 0x7eff80067fe0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7eff9c146840 tx=0x7eff98008040 comp rx=0 tx=0).stop 2023-09-13T06:08:02.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 -- 172.21.15.130:0/3902716246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9c147f30 msgr2=0x7eff9c160cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:02.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9c147f30 0x7eff9c160cc0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7eff8c01a0c0 tx=0x7eff8c01acd0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 -- 172.21.15.130:0/3902716246 shutdown_connections 2023-09-13T06:08:02.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff80065b20 0x7eff80067fe0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff9c148950 0x7eff9c142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9c147f30 0x7eff9c160cc0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 --2- 172.21.15.130:0/3902716246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff9c147b50 0x7eff9c13d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 -- 172.21.15.130:0/3902716246 >> 172.21.15.130:0/3902716246 conn(0x7eff9c065990 msgr2=0x7eff9c149c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:02.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 -- 172.21.15.130:0/3902716246 shutdown_connections 2023-09-13T06:08:02.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.484+0000 7effa3982640 1 -- 172.21.15.130:0/3902716246 wait complete. 2023-09-13T06:08:02.684 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:08:02.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.820+0000 7f1e8414d640 1 Processor -- start 2023-09-13T06:08:02.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.820+0000 7f1e8414d640 1 -- start start 2023-09-13T06:08:02.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.820+0000 7f1e8414d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e7c0af9e0 0x7f1e7c06bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.820+0000 7f1e8414d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c06b5e0 con 0x7f1e7c147f30 2023-09-13T06:08:02.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.820+0000 7f1e8414d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c06b8c0 con 0x7f1e7c147b50 2023-09-13T06:08:02.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.820+0000 7f1e8414d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c165ac0 con 0x7f1e7c0af9e0 2023-09-13T06:08:02.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.820+0000 7f1e816e8640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1e7c147f30 0x7f1e7c148410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49014/0 (socket says 172.21.15.130:49014) 2023-09-13T06:08:02.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.820+0000 7f1e816e8640 1 -- 172.21.15.130:0/3368951033 learned_addr learned my addr 172.21.15.130:0/3368951033 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:02.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305025110 0 0) 0x7f1e7c06b5e0 con 0x7f1e7c147f30 2023-09-13T06:08:02.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e68003530 con 0x7f1e7c147f30 2023-09-13T06:08:02.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e826ea640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e7c0af9e0 0x7f1e7c06bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4202917273 0 0) 0x7f1e68003530 con 0x7f1e7c147f30 2023-09-13T06:08:02.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e7c0af9e0 msgr2=0x7f1e7c06bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:02.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e7c0af9e0 0x7f1e7c06bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 >> v1:172.21.15.164:6789/0 conn(0x7f1e7c147b50 legacy=0x7f1e7c1652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:02.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c165da0 con 0x7f1e7c147f30 2023-09-13T06:08:02.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f1e6c001680 con 0x7f1e7c147f30 2023-09-13T06:08:02.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 >> v1:172.21.15.130:6789/0 conn(0x7f1e7c147f30 legacy=0x7f1e7c148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:02.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e68003a20 0x7f1e68003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e7c0af9e0 0x7f1e680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e68004d80 0x7f1e68005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c165ac0 con 0x7f1e68004d80 2023-09-13T06:08:02.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6800bbd0 con 0x7f1e68003a20 2023-09-13T06:08:02.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6800bd90 con 0x7f1e7c0af9e0 2023-09-13T06:08:02.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e81ee9640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e68003a20 0x7f1e68003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e826ea640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e68004d80 0x7f1e68005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e816e8640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e7c0af9e0 0x7f1e680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e826ea640 1 -- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e7c0af9e0 msgr2=0x7f1e680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:02.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e826ea640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e7c0af9e0 0x7f1e680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e826ea640 1 -- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e68003a20 msgr2=0x7f1e68003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:02.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e826ea640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e68003a20 0x7f1e68003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e826ea640 1 -- 172.21.15.130:0/3368951033 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e68003530 con 0x7f1e68004d80 2023-09-13T06:08:02.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.824+0000 7f1e81ee9640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e68003a20 0x7f1e68003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:08:02.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e826ea640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e68004d80 0x7f1e68005200 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f1e74007330 tx=0x7f1e7401cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d7e763cdd2186c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:02.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740a5c40 con 0x7f1e68004d80 2023-09-13T06:08:02.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e740a5da0 con 0x7f1e68004d80 2023-09-13T06:08:02.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e80ee7640 1 -- 172.21.15.130:0/3368951033 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740ad660 con 0x7f1e68004d80 2023-09-13T06:08:02.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e8414d640 1 -- 172.21.15.130:0/3368951033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e68004d80 msgr2=0x7f1e68005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:02.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e8414d640 1 --2- 172.21.15.130:0/3368951033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e68004d80 0x7f1e68005200 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f1e74007330 tx=0x7f1e7401cd40 comp rx=0 tx=0).stop 2023-09-13T06:08:02.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e826ea640 1 -- 172.21.15.130:0/3368951033 reap_dead start 2023-09-13T06:08:02.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e8414d640 1 -- 172.21.15.130:0/3368951033 shutdown_connections 2023-09-13T06:08:02.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e8414d640 1 -- 172.21.15.130:0/3368951033 >> 172.21.15.130:0/3368951033 conn(0x7f1e7c065990 msgr2=0x7f1e7c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:02.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e8414d640 1 -- 172.21.15.130:0/3368951033 shutdown_connections 2023-09-13T06:08:02.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e8414d640 1 -- 172.21.15.130:0/3368951033 wait complete. 2023-09-13T06:08:02.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e8414d640 1 Processor -- start 2023-09-13T06:08:02.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.828+0000 7f1e8414d640 1 -- start start 2023-09-13T06:08:02.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e8414d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e68004d80 0x7f1e7c1f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e8414d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e7c06f530 0x7f1e7c0cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e8414d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7c136d30 0x7f1e7c06bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e8414d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c070060 con 0x7f1e7c136d30 2023-09-13T06:08:02.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e8414d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c06faa0 con 0x7f1e7c06f530 2023-09-13T06:08:02.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e8414d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c06fd80 con 0x7f1e68004d80 2023-09-13T06:08:02.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e826ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7c136d30 0x7f1e7c06bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e81ee9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e68004d80 0x7f1e7c1f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e816e8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e7c06f530 0x7f1e7c0cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e826ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7c136d30 0x7f1e7c06bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54412/0 (socket says 172.21.15.130:54412) 2023-09-13T06:08:02.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e826ea640 1 -- 172.21.15.130:0/1036029975 learned_addr learned my addr 172.21.15.130:0/1036029975 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:02.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e826ea640 1 -- 172.21.15.130:0/1036029975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e68004d80 msgr2=0x7f1e7c1f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:02.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e826ea640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e68004d80 0x7f1e7c1f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e826ea640 1 -- 172.21.15.130:0/1036029975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e7c06f530 msgr2=0x7f1e7c0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:02.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e826ea640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e7c06f530 0x7f1e7c0cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:02.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e826ea640 1 -- 172.21.15.130:0/1036029975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c148ca0 con 0x7f1e7c136d30 2023-09-13T06:08:02.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e826ea640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7c136d30 0x7f1e7c06bc50 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f1e740b0040 tx=0x7f1e68005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:02.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e727fc640 1 -- 172.21.15.130:0/1036029975 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740adb30 con 0x7f1e7c136d30 2023-09-13T06:08:02.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e727fc640 1 -- 172.21.15.130:0/1036029975 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e740adc90 con 0x7f1e7c136d30 2023-09-13T06:08:02.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e8414d640 1 -- 172.21.15.130:0/1036029975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c136530 con 0x7f1e7c136d30 2023-09-13T06:08:02.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e727fc640 1 -- 172.21.15.130:0/1036029975 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740b8470 con 0x7f1e7c136d30 2023-09-13T06:08:02.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e8414d640 1 -- 172.21.15.130:0/1036029975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c0cf6a0 con 0x7f1e7c136d30 2023-09-13T06:08:02.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e8414d640 1 -- 172.21.15.130:0/1036029975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c0701a0 con 0x7f1e7c136d30 2023-09-13T06:08:02.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.832+0000 7f1e727fc640 1 -- 172.21.15.130:0/1036029975 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1e740b4070 con 0x7f1e7c136d30 2023-09-13T06:08:02.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.836+0000 7f1e727fc640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e60065b20 0x7f1e60067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:02.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.836+0000 7f1e727fc640 1 -- 172.21.15.130:0/1036029975 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e7411d880 con 0x7f1e7c136d30 2023-09-13T06:08:02.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.836+0000 7f1e81ee9640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e60065b20 0x7f1e60067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:02.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.836+0000 7f1e727fc640 1 -- 172.21.15.130:0/1036029975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7f1e6006d650 con 0x7f1e7c136d30 2023-09-13T06:08:02.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.836+0000 7f1e81ee9640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e60065b20 0x7f1e60067fe0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1e78007fd0 tx=0x7f1e78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:02.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:02.840+0000 7f1e727fc640 1 -- 172.21.15.130:0/1036029975 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1e740bd060 con 0x7f1e7c136d30 2023-09-13T06:08:03.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 -- 172.21.15.130:0/1036029975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e7c0618a0 con 0x7f1e7c136d30 2023-09-13T06:08:03.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e727fc640 1 -- 172.21.15.130:0/1036029975 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f1e740eb150 con 0x7f1e7c136d30 2023-09-13T06:08:03.022 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:03.022 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1309237651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1309237651},{"type":"v1","addr":"172.21.15.130:6837","nonce":1309237651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1568650238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1568650238},{"type":"v1","addr":"172.21.15.164:6834","nonce":1568650238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1994572743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1994572743},{"type":"v1","addr":"172.21.15.130:6836","nonce":1994572743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:39.911036+0000","modified":"2023-09-13T06:07:42.935333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7773},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7773":{"gid":7773,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/4146626637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4146626637},{"type":"v1","addr":"172.21.15.164:6835","nonce":4146626637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-09-13T06:08:03.023 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 68 2023-09-13T06:08:03.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 -- 172.21.15.130:0/1036029975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e60065b20 msgr2=0x7f1e60067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:03.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e60065b20 0x7f1e60067fe0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1e78007fd0 tx=0x7f1e78009040 comp rx=0 tx=0).stop 2023-09-13T06:08:03.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 -- 172.21.15.130:0/1036029975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7c136d30 msgr2=0x7f1e7c06bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:03.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7c136d30 0x7f1e7c06bc50 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f1e740b0040 tx=0x7f1e68005800 comp rx=0 tx=0).stop 2023-09-13T06:08:03.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 -- 172.21.15.130:0/1036029975 shutdown_connections 2023-09-13T06:08:03.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e60065b20 0x7f1e60067fe0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e7c06f530 0x7f1e7c0cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7c136d30 0x7f1e7c06bc50 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 --2- 172.21.15.130:0/1036029975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e68004d80 0x7f1e7c1f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 -- 172.21.15.130:0/1036029975 >> 172.21.15.130:0/1036029975 conn(0x7f1e7c065990 msgr2=0x7f1e7c149bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:03.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 -- 172.21.15.130:0/1036029975 shutdown_connections 2023-09-13T06:08:03.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.020+0000 7f1e8414d640 1 -- 172.21.15.130:0/1036029975 wait complete. 2023-09-13T06:08:03.042 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-09-13T06:08:03.211 INFO:teuthology.orchestra.run.smithi164.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":7773,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":22.643540097999999,"mdsmap_epoch":68,"osdmap_epoch":139,"osdmap_epoch_barrier":139,"uptime":27.585762018} 2023-09-13T06:08:03.211 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 7773, "mdsmap_epoch": 68, "osdmap_epoch": 139, "osdmap_epoch_barrier": 139, "rank_uptime": 22.643540098, "state": "up:active", "uptime": 27.585762018, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:08:03.212 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-13T06:08:03.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:03.212 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-09-13T06:08:03.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:03.224 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-09-13T06:08:03.284 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:08:03.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.464+0000 7f36247a3640 1 Processor -- start 2023-09-13T06:08:03.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.464+0000 7f36247a3640 1 -- start start 2023-09-13T06:08:03.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.464+0000 7f36247a3640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f361c06d240 0x7f361c15e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:03.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.464+0000 7f36247a3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f361c0b2560 0x7f361c0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:03.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f36247a3640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c0b2ed0 con 0x7f361c15a120 2023-09-13T06:08:03.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f36247a3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361c15e440 con 0x7f361c0b2560 2023-09-13T06:08:03.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f36247a3640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361c0c44c0 con 0x7f361c06d240 2023-09-13T06:08:03.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f3622d40640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f361c0b2560 0x7f361c0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:03.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f362253f640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f361c15a120 0x7f361c0c3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49030/0 (socket says 172.21.15.130:49030) 2023-09-13T06:08:03.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f362253f640 1 -- 172.21.15.130:0/1541826787 learned_addr learned my addr 172.21.15.130:0/1541826787 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:03.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f3621d3e640 1 --2- 172.21.15.130:0/1541826787 >> v2:172.21.15.164:3300/0 conn(0x7f361c06d240 0x7f361c15e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:03.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f3622d40640 1 -- 172.21.15.130:0/1541826787 >> v2:172.21.15.164:3300/0 conn(0x7f361c06d240 msgr2=0x7f361c15e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:03.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f3622d40640 1 --2- 172.21.15.130:0/1541826787 >> v2:172.21.15.164:3300/0 conn(0x7f361c06d240 0x7f361c15e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f3622d40640 1 -- 172.21.15.130:0/1541826787 >> v1:172.21.15.130:6789/0 conn(0x7f361c15a120 legacy=0x7f361c0c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:03.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f3622d40640 1 -- 172.21.15.130:0/1541826787 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c15ddc0 con 0x7f361c0b2560 2023-09-13T06:08:03.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f3622d40640 1 --2- 172.21.15.130:0/1541826787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f361c0b2560 0x7f361c0b2990 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f361c0b3060 tx=0x7f361401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db22351b5913ddb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:03.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f362153d640 1 -- 172.21.15.130:0/1541826787 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140a5910 con 0x7f361c0b2560 2023-09-13T06:08:03.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f362153d640 1 -- 172.21.15.130:0/1541826787 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36140a5a70 con 0x7f361c0b2560 2023-09-13T06:08:03.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.468+0000 7f362153d640 1 -- 172.21.15.130:0/1541826787 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140a5e00 con 0x7f361c0b2560 2023-09-13T06:08:03.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 -- 172.21.15.130:0/1541826787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f361c0b2560 msgr2=0x7f361c0b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:03.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 --2- 172.21.15.130:0/1541826787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f361c0b2560 0x7f361c0b2990 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f361c0b3060 tx=0x7f361401c850 comp rx=0 tx=0).stop 2023-09-13T06:08:03.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 -- 172.21.15.130:0/1541826787 shutdown_connections 2023-09-13T06:08:03.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 --2- 172.21.15.130:0/1541826787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f361c0b2560 0x7f361c0b2990 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 --2- 172.21.15.130:0/1541826787 >> v2:172.21.15.164:3300/0 conn(0x7f361c06d240 0x7f361c15e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 -- 172.21.15.130:0/1541826787 >> 172.21.15.130:0/1541826787 conn(0x7f361c06a2f0 msgr2=0x7f361c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:03.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 -- 172.21.15.130:0/1541826787 shutdown_connections 2023-09-13T06:08:03.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 -- 172.21.15.130:0/1541826787 wait complete. 2023-09-13T06:08:03.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 Processor -- start 2023-09-13T06:08:03.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 -- start start 2023-09-13T06:08:03.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f361c06d240 0x7f361c163c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:03.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f361c0b2560 0x7f361c1594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:03.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f361c15a120 0x7f361c0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:03.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1599f0 con 0x7f361c15a120 2023-09-13T06:08:03.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c164850 con 0x7f361c06d240 2023-09-13T06:08:03.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f36247a3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c15ab90 con 0x7f361c0b2560 2023-09-13T06:08:03.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f3622d40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f361c15a120 0x7f361c0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:03.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f362253f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f361c06d240 0x7f361c163c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:03.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f3621d3e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f361c0b2560 0x7f361c1594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:03.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f362253f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f361c06d240 0x7f361c163c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:55900/0 (socket says 172.21.15.130:55900) 2023-09-13T06:08:03.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f3622d40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f361c15a120 0x7f361c0ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54424/0 (socket says 172.21.15.130:54424) 2023-09-13T06:08:03.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.472+0000 7f362253f640 1 -- 172.21.15.130:0/4017578155 learned_addr learned my addr 172.21.15.130:0/4017578155 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:03.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3622d40640 1 -- 172.21.15.130:0/4017578155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f361c0b2560 msgr2=0x7f361c1594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:03.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3622d40640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f361c0b2560 0x7f361c1594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3622d40640 1 -- 172.21.15.130:0/4017578155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f361c06d240 msgr2=0x7f361c163c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:03.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3622d40640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f361c06d240 0x7f361c163c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3622d40640 1 -- 172.21.15.130:0/4017578155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3614009a70 con 0x7f361c15a120 2023-09-13T06:08:03.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f362253f640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f361c06d240 0x7f361c163c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:08:03.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3622d40640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f361c15a120 0x7f361c0ce940 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f361c06d6d0 tx=0x7f36140195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:03.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3612ffd640 1 -- 172.21.15.130:0/4017578155 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140b9860 con 0x7f361c15a120 2023-09-13T06:08:03.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3612ffd640 1 -- 172.21.15.130:0/4017578155 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36140b99c0 con 0x7f361c15a120 2023-09-13T06:08:03.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3612ffd640 1 -- 172.21.15.130:0/4017578155 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140b9d70 con 0x7f361c15a120 2023-09-13T06:08:03.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f36247a3640 1 -- 172.21.15.130:0/4017578155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361c164290 con 0x7f361c15a120 2023-09-13T06:08:03.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f36247a3640 1 -- 172.21.15.130:0/4017578155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c15a820 con 0x7f361c15a120 2023-09-13T06:08:03.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f36247a3640 1 -- 172.21.15.130:0/4017578155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c0cdb50 con 0x7f361c15a120 2023-09-13T06:08:03.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3612ffd640 1 -- 172.21.15.130:0/4017578155 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f36140ad440 con 0x7f361c15a120 2023-09-13T06:08:03.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3612ffd640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3600065b20 0x7f3600067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:03.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f3612ffd640 1 -- 172.21.15.130:0/4017578155 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f361411e500 con 0x7f361c15a120 2023-09-13T06:08:03.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.476+0000 7f362253f640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3600065b20 0x7f3600067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:03.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.480+0000 7f3612ffd640 1 -- 172.21.15.130:0/4017578155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7f360006d650 con 0x7f361c15a120 2023-09-13T06:08:03.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.480+0000 7f362253f640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3600065b20 0x7f3600067fe0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3618005890 tx=0x7f3618009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:03.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.480+0000 7f3612ffd640 1 -- 172.21.15.130:0/4017578155 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f36140ec0b0 con 0x7f361c15a120 2023-09-13T06:08:03.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.632+0000 7f36247a3640 1 -- 172.21.15.130:0/4017578155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f361c15ad20 con 0x7f361c15a120 2023-09-13T06:08:03.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f3612ffd640 1 -- 172.21.15.130:0/4017578155 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+34025 (secure 0 0 0) 0x7f36140b2020 con 0x7f361c15a120 2023-09-13T06:08:03.637 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:03.638 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:08:03.638 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 139, 2023-09-13T06:08:03.638 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:08:03.638 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:08:03.639 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:07:57.380470+0000", 2023-09-13T06:08:03.639 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:08:03.639 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:08:03.639 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:08:03.639 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:08:03.640 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:08:03.640 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:08:03.640 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:08:03.640 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:08:03.640 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:08:03.640 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:03.641 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:08:03.641 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:08:03.641 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:08:03.641 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:08:03.641 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:08:03.642 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 17, 2023-09-13T06:08:03.642 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:08:03.642 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:08:03.642 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:08:03.642 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:08:03.643 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:08:03.643 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:08:03.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.643 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:08:03.643 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:08:03.643 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:08:03.644 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:03.644 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:03.644 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:03.644 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:03.644 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:03.645 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:03.645 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:03.645 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:03.645 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:03.645 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:03.646 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:03.646 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:03.646 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:08:03.646 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:08:03.646 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:08:03.647 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:08:03.647 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:08:03.647 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:03.647 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:03.647 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:03.648 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:03.648 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:03.648 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:03.648 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:03.648 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.649 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:08:03.649 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:03.649 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:03.649 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:03.649 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:03.649 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:03.650 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:03.650 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:03.650 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:03.650 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:03.650 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:03.651 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:03.651 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:03.651 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:03.651 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:03.651 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:03.651 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:03.652 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:03.652 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:03.652 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:03.652 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:03.652 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:03.653 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:03.653 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:03.653 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:03.653 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:03.653 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:03.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.654 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:03.654 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:03.654 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:03.654 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:03.654 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:03.655 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:03.655 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:03.655 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:03.655 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:03.655 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:03.656 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:03.656 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:03.656 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:08:03.656 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:08:03.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.656 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:03.657 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:08:03.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.657 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:03.657 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:08:03.657 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:08:03.658 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:08:03.658 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:08:03.658 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:08:03.658 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:03.658 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:03.658 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:03.659 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.659 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 16, 2023-09-13T06:08:03.659 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:08:03.660 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:38.276233+0000", 2023-09-13T06:08:03.660 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:03.660 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:03.660 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:03.660 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:03.660 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:03.661 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:03.661 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:03.661 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:03.661 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:03.661 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:03.662 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:03.662 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:03.662 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:08:03.662 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:08:03.662 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:08:03.662 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:08:03.663 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:08:03.663 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:03.663 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:03.663 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:03.663 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:03.664 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:03.664 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:03.664 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:03.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.664 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "136", 2023-09-13T06:08:03.664 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:03.665 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:03.665 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:03.665 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:03.665 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:03.665 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:03.666 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:03.666 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:03.666 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:03.666 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:03.666 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:03.667 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:03.667 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:03.667 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:03.667 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:03.667 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:03.668 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:03.668 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:03.668 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:03.668 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:03.668 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:03.668 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:03.669 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:03.669 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:03.669 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:03.669 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:03.669 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.670 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:03.670 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:03.670 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:03.671 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:03.671 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:03.671 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:03.671 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:03.672 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:03.672 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:03.672 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:03.672 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:03.673 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:03.673 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:08:03.673 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:08:03.673 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:08:03.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.674 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:03.674 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:03.674 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:08:03.675 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.675 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:03.675 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:08:03.676 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:08:03.676 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:03.676 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:08:03.676 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:08:03.677 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:03.677 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:03.677 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:03.677 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.678 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.678 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 17, 2023-09-13T06:08:03.678 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:08:03.678 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:39.032744+0000", 2023-09-13T06:08:03.679 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1027, 2023-09-13T06:08:03.679 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-13T06:08:03.679 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:03.679 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:03.679 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:03.680 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:03.680 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:03.680 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:03.680 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:03.680 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:03.680 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:03.681 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:03.681 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:08:03.681 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:08:03.681 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:08:03.681 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:08:03.682 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:08:03.682 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:03.682 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:03.682 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:03.682 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:03.682 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:03.683 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:03.683 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:03.683 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.683 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "139", 2023-09-13T06:08:03.683 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:03.684 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:03.684 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:03.684 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:03.684 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:03.684 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:03.685 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:03.685 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:03.685 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:03.685 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:08:03.685 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:03.685 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:03.686 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:03.686 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:03.686 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:03.686 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:03.686 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:03.687 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:03.687 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:03.687 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:03.687 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:03.687 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:03.687 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:03.688 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:03.688 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:03.688 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:03.688 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.688 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:03.689 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:03.689 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:03.689 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:03.689 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:03.689 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:03.690 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:03.690 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:03.690 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:03.690 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:03.690 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:03.691 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:03.691 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:08:03.691 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:08:03.691 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.691 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:03.692 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:03.692 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:08:03.692 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.692 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.692 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:03.693 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:08:03.693 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:08:03.693 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:03.693 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:08:03.694 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:08:03.694 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:03.694 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:03.694 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:03.694 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.695 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.695 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:03.695 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:08:03.695 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.695 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.699 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.699 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:08:03.699 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:03.699 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.699 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.700 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.700 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:08:03.700 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:03.700 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.701 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.701 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.701 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:03.701 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.701 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.702 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.702 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:08:03.702 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:03.702 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.703 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.703 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.703 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:08:03.703 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:03.703 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.704 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.704 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.704 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:03.704 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.705 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.705 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.705 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:08:03.705 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:03.706 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.706 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.706 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.706 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:08:03.707 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:03.707 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.707 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.708 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.708 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:03.708 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.708 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.708 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.709 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:08:03.709 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:03.709 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.709 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.709 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.710 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:08:03.710 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:03.710 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.710 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.710 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.711 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:08:03.711 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:08:03.711 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:08:03.711 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:08:03.711 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:03.711 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:03.712 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:03.712 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.712 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.712 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.712 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:03.713 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:03.713 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:03.713 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:03.713 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:03.713 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:03.714 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:03.714 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:03.714 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:03.714 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:03.714 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:03.715 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:03.715 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:03.715 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.715 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.715 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.716 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:08:03.716 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:03.716 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.716 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.716 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.717 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:08:03.717 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:03.717 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.717 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.717 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.717 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:03.718 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.718 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.718 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.718 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:08:03.718 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:03.719 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.719 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.719 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.719 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:08:03.719 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:03.720 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.720 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.720 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.720 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:03.720 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.720 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.721 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.721 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:08:03.721 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:03.721 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.721 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.721 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.722 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:08:03.722 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:03.722 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.722 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.722 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.723 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:03.723 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.723 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.723 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.723 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:08:03.724 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:03.724 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.724 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.724 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.724 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:08:03.725 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:03.725 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.725 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.725 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.725 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:08:03.726 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:08:03.726 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:08:03.726 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:08:03.726 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:03.726 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:03.727 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:03.727 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.727 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.727 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:03.727 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:03.728 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:03.728 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:03.728 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:03.728 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:03.728 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:03.729 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:03.729 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:03.729 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:03.729 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:03.729 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:03.730 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:03.730 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.730 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.730 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.730 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:08:03.731 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:03.731 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.731 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.732 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.732 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:08:03.732 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:03.732 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.732 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.732 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.733 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:03.733 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.733 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.733 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.734 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:08:03.734 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:03.734 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.734 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.735 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.735 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:08:03.735 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:03.735 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.736 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.736 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.736 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:03.736 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.736 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.737 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.737 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:08:03.737 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:03.737 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.738 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.738 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.738 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:08:03.738 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:03.739 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.739 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.739 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.739 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:03.740 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.740 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.740 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.740 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:08:03.741 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:03.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.741 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.741 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.742 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:08:03.742 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:03.742 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.742 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.742 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.743 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:08:03.743 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:08:03.743 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:08:03.743 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:08:03.743 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:03.744 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:03.744 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:03.744 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.744 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.744 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.744 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:03.745 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:03.745 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:03.745 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:03.745 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:03.745 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:03.745 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:03.746 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:03.746 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:03.746 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:03.746 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:03.746 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:03.747 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:03.747 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.747 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.747 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:08:03.748 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:03.748 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.748 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.748 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.748 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:08:03.748 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:03.749 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.749 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.749 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.749 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:03.749 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.750 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.750 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:08:03.750 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:03.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.751 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.751 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.751 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:08:03.751 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:03.751 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.751 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.752 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.752 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:03.752 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.752 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.753 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:08:03.753 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:03.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.753 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.754 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:08:03.754 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:03.754 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.754 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.754 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:03.755 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.755 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.755 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:08:03.755 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:03.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.756 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.756 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:08:03.756 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:03.756 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.757 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.757 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:08:03.757 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:08:03.757 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:08:03.758 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:08:03.758 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:03.758 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:03.758 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:03.758 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.759 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.759 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:03.759 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:03.759 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:03.760 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:03.760 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:03.760 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:03.760 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:03.760 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:03.760 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:03.761 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:03.761 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:03.761 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:03.761 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:03.761 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.762 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.762 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:08:03.763 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:03.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.763 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.763 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.763 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:08:03.763 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:03.764 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.764 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.764 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:03.765 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.765 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.765 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:08:03.765 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:03.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.766 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.766 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.766 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:08:03.767 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:03.767 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.767 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.767 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:03.768 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.768 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.768 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:08:03.768 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:03.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.769 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.769 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.769 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:08:03.769 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:03.769 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.770 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.770 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:03.770 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.771 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.771 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:08:03.771 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:03.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.772 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.772 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:08:03.772 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:03.773 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.773 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.773 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:08:03.773 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:08:03.774 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:08:03.774 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:08:03.774 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:03.774 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:03.775 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:03.775 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.775 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.776 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:03.776 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:03.776 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:03.776 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:03.777 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:03.777 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:03.777 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:03.777 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:03.778 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:03.778 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:03.778 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:03.778 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:03.778 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:03.778 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.779 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.779 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:08:03.779 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:03.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:08:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.780 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.781 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:03.781 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.781 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.781 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:08:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.782 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:08:03.783 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:03.783 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.783 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.783 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:03.784 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.784 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.784 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:08:03.784 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:03.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.785 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.785 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:08:03.785 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:03.786 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.786 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.786 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.786 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:03.786 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:08:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.788 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.788 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:08:03.788 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:03.788 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.788 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.789 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:08:03.789 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:08:03.789 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:08:03.789 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:08:03.789 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.790 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:03.791 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:03.791 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:03.791 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:03.791 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:03.791 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:03.792 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:03.793 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:03.793 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.793 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.793 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.793 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:08:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:08:03.794 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:03.795 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.795 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.795 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:03.795 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:08:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.796 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.797 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.797 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:08:03.797 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:03.797 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.797 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.798 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:03.798 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.799 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.799 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:08:03.799 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:03.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.800 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.800 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:08:03.800 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:03.800 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.800 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.801 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:03.801 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.801 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.802 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.802 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:08:03.802 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:03.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.803 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.803 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:08:03.803 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:03.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.803 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.804 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:08:03.804 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:08:03.804 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:08:03.804 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:08:03.804 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:03.805 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:03.805 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:03.805 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.805 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.805 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.806 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:03.806 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:03.806 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:03.806 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:03.806 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:03.806 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:03.807 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:03.807 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:03.807 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:03.807 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:03.807 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:03.808 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:03.808 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:03.808 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.808 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.808 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:08:03.809 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:03.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.809 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.809 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:08:03.810 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:03.810 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.810 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.810 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:03.811 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.811 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.811 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:08:03.811 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:03.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.812 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.812 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:08:03.812 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:03.812 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.813 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.813 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.813 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:03.813 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.813 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.814 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:08:03.814 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:03.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.814 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.815 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:08:03.817 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:03.817 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.817 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.817 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.817 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:03.818 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:03.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.818 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:03.818 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:08:03.818 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:03.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.819 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.819 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:03.819 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:08:03.819 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:03.819 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.820 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.820 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:08:03.820 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:08:03.820 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:08:03.821 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:08:03.821 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:03.821 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:03.821 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:03.821 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:03.821 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.822 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:03.822 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:08:03.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.822 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:03.822 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:03.823 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:03.823 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:03.823 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:03.823 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:03.823 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:08:03.824 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:03.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.824 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:03.824 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:03.825 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:03.825 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:03.825 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:03.825 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:03.825 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:08:03.825 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:03.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.826 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:03.826 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:03.826 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:03.827 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:03.827 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:03.827 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:03.827 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:08:03.827 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:03.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.828 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:03.828 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:03.828 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:03.828 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:03.829 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:03.829 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:03.829 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:08:03.829 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:03.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.830 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:03.830 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:03.830 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:03.830 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:03.830 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:03.831 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:03.831 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:08:03.831 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:03.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.831 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.832 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:03.832 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:03.832 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:03.832 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:03.832 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:03.833 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:03.833 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:08:03.833 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:03.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.833 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:03.834 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:03.834 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:03.834 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:03.834 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:03.834 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:03.835 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:08:03.835 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:03.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:03.835 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:03.836 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:03.836 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:03.836 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:03.836 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:03.836 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:03.836 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:08:03.837 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:03.837 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.837 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:03.837 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:08:03.837 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:08:03.838 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:08:03.838 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:08:03.838 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:08:03.838 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:08:03.838 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:08:03.839 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:08:03.839 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:08:03.839 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:08:03.839 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:08:03.839 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:08:03.839 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:08:03.840 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:08:03.840 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:03.840 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:08:03.840 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:08:03.841 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:08:03.841 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:08:03.841 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:08:03.841 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:08:03.841 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:08:03.841 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:08:03.842 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:08:03.842 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:08:03.842 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:08:03.842 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:03.842 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:08:03.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 -- 172.21.15.130:0/4017578155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3600065b20 msgr2=0x7f3600067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:03.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3600065b20 0x7f3600067fe0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3618005890 tx=0x7f3618009040 comp rx=0 tx=0).stop 2023-09-13T06:08:03.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 -- 172.21.15.130:0/4017578155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f361c15a120 msgr2=0x7f361c0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:03.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f361c15a120 0x7f361c0ce940 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f361c06d6d0 tx=0x7f36140195f0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 -- 172.21.15.130:0/4017578155 shutdown_connections 2023-09-13T06:08:03.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3600065b20 0x7f3600067fe0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f361c15a120 0x7f361c0ce940 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f361c0b2560 0x7f361c1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 --2- 172.21.15.130:0/4017578155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f361c06d240 0x7f361c163c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:03.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 -- 172.21.15.130:0/4017578155 >> 172.21.15.130:0/4017578155 conn(0x7f361c06a2f0 msgr2=0x7f361c06a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:03.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 -- 172.21.15.130:0/4017578155 shutdown_connections 2023-09-13T06:08:03.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:03.636+0000 7f36247a3640 1 -- 172.21.15.130:0/4017578155 wait complete. 2023-09-13T06:08:03.847 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:08:08.848 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:08:08.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5f09e640 1 Processor -- start 2023-09-13T06:08:08.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5f09e640 1 -- start start 2023-09-13T06:08:09.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5f09e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5b58159f20 0x7f5b580ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:09.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5f09e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5b580b1d20 0x7f5b580b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:09.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5f09e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b580ccfd0 con 0x7f5b580cdfc0 2023-09-13T06:08:09.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5f09e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b580b00f0 con 0x7f5b58159f20 2023-09-13T06:08:09.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5f09e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b580b11d0 con 0x7f5b580b1d20 2023-09-13T06:08:09.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5ce3a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5b58159f20 0x7f5b580ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:09.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5ce3a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5b58159f20 0x7f5b580ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54426/0 (socket says 172.21.15.130:54426) 2023-09-13T06:08:09.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5ce3a640 1 -- 172.21.15.130:0/1777766095 learned_addr learned my addr 172.21.15.130:0/1777766095 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:09.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5ce3a640 1 -- 172.21.15.130:0/1777766095 >> v2:172.21.15.164:3300/0 conn(0x7f5b580b1d20 msgr2=0x7f5b580b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:09.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5d63b640 1 --2- 172.21.15.130:0/1777766095 >> v2:172.21.15.164:3300/0 conn(0x7f5b580b1d20 0x7f5b580b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:09.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5ce3a640 1 --2- 172.21.15.130:0/1777766095 >> v2:172.21.15.164:3300/0 conn(0x7f5b580b1d20 0x7f5b580b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:09.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5ce3a640 1 -- 172.21.15.130:0/1777766095 >> v1:172.21.15.164:6789/0 conn(0x7f5b580cdfc0 legacy=0x7f5b580b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:09.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5ce3a640 1 -- 172.21.15.130:0/1777766095 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b580ced90 con 0x7f5b58159f20 2023-09-13T06:08:09.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.995+0000 7f5b5d63b640 1 --2- 172.21.15.130:0/1777766095 >> v2:172.21.15.164:3300/0 conn(0x7f5b580b1d20 0x7f5b580b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:09.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b5ce3a640 1 --2- 172.21.15.130:0/1777766095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b58159f20 0x7f5b580ce7b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5b580cbf60 tx=0x7f5b4c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70235ab701a5992b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:09.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b577fe640 1 -- 172.21.15.130:0/1777766095 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0aa5f0 con 0x7f5b58159f20 2023-09-13T06:08:09.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b577fe640 1 -- 172.21.15.130:0/1777766095 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c0aa750 con 0x7f5b58159f20 2023-09-13T06:08:09.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b577fe640 1 -- 172.21.15.130:0/1777766095 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0aaae0 con 0x7f5b58159f20 2023-09-13T06:08:09.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1777766095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b58159f20 msgr2=0x7f5b580ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:09.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b5f09e640 1 --2- 172.21.15.130:0/1777766095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b58159f20 0x7f5b580ce7b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5b580cbf60 tx=0x7f5b4c01c490 comp rx=0 tx=0).stop 2023-09-13T06:08:09.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1777766095 shutdown_connections 2023-09-13T06:08:09.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b5f09e640 1 --2- 172.21.15.130:0/1777766095 >> v2:172.21.15.164:3300/0 conn(0x7f5b580b1d20 0x7f5b580b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:09.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b5f09e640 1 --2- 172.21.15.130:0/1777766095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b58159f20 0x7f5b580ce7b0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:09.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1777766095 >> 172.21.15.130:0/1777766095 conn(0x7f5b58065990 msgr2=0x7f5b58065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:09.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1777766095 shutdown_connections 2023-09-13T06:08:09.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:08.999+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1777766095 wait complete. 2023-09-13T06:08:09.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b5f09e640 1 Processor -- start 2023-09-13T06:08:09.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b5f09e640 1 -- start start 2023-09-13T06:08:09.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b5f09e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b580b1d20 0x7f5b5814afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:09.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b5f09e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b580cdfc0 0x7f5b58150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:09.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b5f09e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b58159f20 0x7f5b58150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:09.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b5f09e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b581511b0 con 0x7f5b580cdfc0 2023-09-13T06:08:09.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b5f09e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b58149cf0 con 0x7f5b580b1d20 2023-09-13T06:08:09.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b5f09e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b58149f40 con 0x7f5b58159f20 2023-09-13T06:08:09.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b57fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b580cdfc0 0x7f5b58150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:09.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b57fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b580cdfc0 0x7f5b58150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:54428/0 (socket says 172.21.15.130:54428) 2023-09-13T06:08:09.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b57fff640 1 -- 172.21.15.130:0/1574245289 learned_addr learned my addr 172.21.15.130:0/1574245289 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:09.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b5ce3a640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b580b1d20 0x7f5b5814afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:09.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b5d63b640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b58159f20 0x7f5b58150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:09.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b57fff640 1 -- 172.21.15.130:0/1574245289 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b58159f20 msgr2=0x7f5b58150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:09.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b57fff640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b58159f20 0x7f5b58150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:09.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b57fff640 1 -- 172.21.15.130:0/1574245289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b580b1d20 msgr2=0x7f5b5814afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:09.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b57fff640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b580b1d20 0x7f5b5814afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:09.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b57fff640 1 -- 172.21.15.130:0/1574245289 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c0094d0 con 0x7f5b580cdfc0 2023-09-13T06:08:09.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.003+0000 7f5b57fff640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b580cdfc0 0x7f5b58150c70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400c450 tx=0x7f5b4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:09.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.007+0000 7f5b557fa640 1 -- 172.21.15.130:0/1574245289 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b44012830 con 0x7f5b580cdfc0 2023-09-13T06:08:09.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.007+0000 7f5b557fa640 1 -- 172.21.15.130:0/1574245289 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b440129b0 con 0x7f5b580cdfc0 2023-09-13T06:08:09.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.007+0000 7f5b557fa640 1 -- 172.21.15.130:0/1574245289 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b44012d60 con 0x7f5b580cdfc0 2023-09-13T06:08:09.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.007+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1574245289 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5814a220 con 0x7f5b580cdfc0 2023-09-13T06:08:09.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.007+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1574245289 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5814a7e0 con 0x7f5b580cdfc0 2023-09-13T06:08:09.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.007+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1574245289 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b580618a0 con 0x7f5b580cdfc0 2023-09-13T06:08:09.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.007+0000 7f5b557fa640 1 -- 172.21.15.130:0/1574245289 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5b4401c460 con 0x7f5b580cdfc0 2023-09-13T06:08:09.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.007+0000 7f5b557fa640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b3c065b50 0x7f5b3c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:09.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.007+0000 7f5b557fa640 1 -- 172.21.15.130:0/1574245289 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b440830c0 con 0x7f5b580cdfc0 2023-09-13T06:08:09.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.007+0000 7f5b5ce3a640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b3c065b50 0x7f5b3c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:09.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.007+0000 7f5b557fa640 1 -- 172.21.15.130:0/1574245289 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7f5b3c06d680 con 0x7f5b580cdfc0 2023-09-13T06:08:09.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.011+0000 7f5b5ce3a640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b3c065b50 0x7f5b3c068010 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0ae000 tx=0x7f5b4c0b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:09.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.011+0000 7f5b557fa640 1 -- 172.21.15.130:0/1574245289 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5b44050a20 con 0x7f5b580cdfc0 2023-09-13T06:08:09.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.159+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1574245289 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5b58151d30 con 0x7f5b580cdfc0 2023-09-13T06:08:09.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b557fa640 1 -- 172.21.15.130:0/1574245289 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+34025 (secure 0 0 0) 0x7f5b44054040 con 0x7f5b580cdfc0 2023-09-13T06:08:09.168 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:09.168 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:08:09.168 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 139, 2023-09-13T06:08:09.168 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:08:09.168 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:08:09.169 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:07:57.380470+0000", 2023-09-13T06:08:09.169 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:08:09.169 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:08:09.169 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:08:09.169 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:08:09.169 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:08:09.170 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:08:09.170 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:08:09.170 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:08:09.170 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:08:09.170 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:09.171 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:08:09.171 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:08:09.171 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:08:09.173 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:08:09.173 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:08:09.174 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 17, 2023-09-13T06:08:09.174 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:08:09.174 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:08:09.175 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:08:09.175 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:08:09.175 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:08:09.176 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:08:09.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.176 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:08:09.177 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:08:09.177 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:08:09.177 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:09.177 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:09.178 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:09.178 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:09.178 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:09.178 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:09.178 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:09.179 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:09.179 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:09.179 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:09.179 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:09.179 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:09.180 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:08:09.180 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:08:09.180 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:08:09.180 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:08:09.180 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:08:09.181 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:09.181 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:09.181 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:09.181 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:09.181 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:09.181 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:09.182 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:09.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.182 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:08:09.182 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:09.183 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:09.183 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:09.183 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:09.183 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:09.183 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:09.183 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:09.184 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:09.184 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:09.184 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:09.184 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:09.184 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:09.185 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:09.185 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:09.185 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:09.185 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:09.185 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:09.186 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:09.186 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:09.186 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:09.186 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:09.186 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:09.186 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:09.187 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:09.187 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:09.187 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:09.187 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.187 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:09.188 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:09.188 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:09.188 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:09.188 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:09.188 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:09.188 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:09.189 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:09.189 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:09.189 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:09.189 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:09.189 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:09.190 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:08:09.190 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:08:09.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.190 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:09.190 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:08:09.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.191 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:09.192 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:08:09.192 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:08:09.192 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:08:09.192 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:08:09.193 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:08:09.193 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:09.193 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:09.193 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:09.193 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.194 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.194 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.194 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 16, 2023-09-13T06:08:09.195 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:08:09.195 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:38.276233+0000", 2023-09-13T06:08:09.195 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:09.195 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:09.195 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:09.196 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:09.196 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:09.196 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:09.196 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:09.196 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:09.197 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:09.197 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:09.197 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:09.197 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:09.197 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:08:09.198 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:08:09.198 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:08:09.198 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:08:09.198 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:08:09.198 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:09.198 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:09.199 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:09.199 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:09.199 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:09.199 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:09.199 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:09.200 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.200 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "136", 2023-09-13T06:08:09.200 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:09.200 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:09.200 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:09.201 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:09.201 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:09.201 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:09.201 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:09.201 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:09.202 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:09.202 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:09.202 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:09.202 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:09.202 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:09.203 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:09.203 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:09.203 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:09.203 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:09.203 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:09.204 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:09.204 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:09.204 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:09.204 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:09.204 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:09.205 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:09.205 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:09.205 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:09.205 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.205 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:09.206 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:09.206 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:09.206 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:09.206 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:09.206 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:09.207 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:09.207 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:09.207 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:09.207 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:09.207 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:09.208 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:09.208 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:08:09.208 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:08:09.208 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:08:09.208 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.209 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:09.209 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:09.209 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:08:09.209 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.209 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.210 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:09.210 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:08:09.210 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:08:09.210 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:09.210 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:08:09.211 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:08:09.211 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:09.211 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:09.211 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:09.211 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.212 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.212 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.212 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 17, 2023-09-13T06:08:09.212 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:08:09.212 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:39.032744+0000", 2023-09-13T06:08:09.212 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1027, 2023-09-13T06:08:09.213 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-13T06:08:09.213 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:09.213 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:09.213 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:09.213 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:09.214 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:09.214 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:09.214 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:09.214 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:09.214 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:09.215 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:09.215 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:08:09.215 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:08:09.215 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:08:09.215 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:08:09.215 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:08:09.216 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:09.216 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:09.216 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:09.216 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:09.216 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:09.217 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:09.217 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:09.217 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.217 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "139", 2023-09-13T06:08:09.217 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:09.218 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:09.218 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:09.218 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:09.218 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:09.218 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:09.219 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:09.219 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:09.219 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:09.219 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:08:09.219 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:09.220 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:09.220 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:09.220 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:09.220 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:09.220 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:09.221 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:09.221 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:09.221 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:09.221 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:09.221 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:09.222 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:09.222 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:09.222 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:09.222 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:09.222 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:09.223 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.223 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:09.223 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:09.223 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:09.223 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:09.224 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:09.224 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:09.224 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:09.224 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:09.224 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:09.224 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:09.225 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:09.225 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:09.225 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:08:09.225 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:08:09.225 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.226 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:09.226 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:09.226 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:08:09.226 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.226 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.227 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:09.227 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:08:09.227 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:08:09.227 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:09.227 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:08:09.227 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:08:09.228 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:09.228 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:09.228 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:09.228 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.229 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.229 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:09.229 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:08:09.229 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.229 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:09.229 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:09.230 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:09.230 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:09.230 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:09.230 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:09.230 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:09.231 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:09.231 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:09.231 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:09.231 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:09.231 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:09.232 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:09.232 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.232 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.232 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.232 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:08:09.233 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:09.233 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.233 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.233 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.233 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:08:09.234 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:09.234 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.234 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.234 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.234 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:09.234 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.235 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.235 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.235 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:08:09.235 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:09.235 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.236 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.236 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.236 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:08:09.236 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:09.236 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.237 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.237 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:09.237 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.237 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.237 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.238 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:08:09.238 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:09.238 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.238 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.239 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.239 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:08:09.239 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:09.239 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.239 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.239 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.240 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:09.240 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.240 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.240 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.240 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:08:09.241 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:09.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.241 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.241 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.241 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:08:09.242 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:09.242 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.242 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.242 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:08:09.243 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:08:09.243 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:08:09.243 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:08:09.243 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:09.243 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:09.243 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:09.244 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.244 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:09.244 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:09.245 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:09.245 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:09.245 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:09.245 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:09.245 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:09.245 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:09.246 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:09.246 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:09.246 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:09.246 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:09.246 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:09.247 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.247 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.247 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.247 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:08:09.247 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:09.247 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.248 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.248 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.248 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:08:09.248 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:09.248 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.248 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.249 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.249 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:09.249 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.249 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.249 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.249 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:08:09.250 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:09.250 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.250 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.250 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.250 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:08:09.251 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:09.251 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.251 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.251 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.251 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:09.251 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.252 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.252 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:08:09.252 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:09.252 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.252 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.253 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.253 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:08:09.253 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:09.253 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.253 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.254 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:09.254 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.254 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.254 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.254 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:08:09.254 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:09.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.255 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.255 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.255 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:08:09.255 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:09.255 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.256 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.256 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.256 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:08:09.256 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:08:09.256 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:08:09.257 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:08:09.257 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:09.257 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:09.257 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:09.257 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.258 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.258 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:09.258 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:09.258 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:09.258 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:09.259 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:09.259 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:09.259 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:09.259 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:09.259 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:09.259 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:09.260 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:09.260 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:09.260 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:09.260 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.260 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.260 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.261 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:08:09.261 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:09.261 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.261 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.261 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.261 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:08:09.262 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:09.262 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.262 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.262 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:09.262 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.263 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.263 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.263 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:08:09.263 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:09.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.264 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.264 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.264 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:08:09.264 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:09.264 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.264 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.265 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:09.265 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.265 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.265 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.266 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:08:09.266 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:09.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.266 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.266 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.266 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:08:09.267 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:09.267 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.267 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.267 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.267 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:09.268 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.268 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.268 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:08:09.268 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:09.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.269 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.269 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.269 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:08:09.269 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:09.269 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.269 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.270 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:08:09.270 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:08:09.270 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:08:09.270 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:08:09.270 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:09.271 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:09.271 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:09.271 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.271 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.271 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:09.272 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:09.272 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:09.272 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:09.272 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:09.272 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:09.272 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:09.273 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:09.273 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:09.273 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:09.273 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:09.273 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:09.274 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:09.274 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.274 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.274 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.274 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:08:09.275 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:09.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.275 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.275 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.275 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:08:09.275 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:09.276 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.276 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.276 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:09.276 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.277 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.277 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:08:09.277 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:09.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.277 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.278 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.278 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:08:09.278 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:09.278 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.278 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.279 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:09.279 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.279 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.279 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.279 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:08:09.279 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:09.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.280 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.280 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.280 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:08:09.280 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:09.280 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.281 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.281 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:09.281 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.281 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.281 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.282 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:08:09.282 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:09.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.282 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.282 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.283 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:08:09.283 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:09.283 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.283 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.283 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.283 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:08:09.284 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:08:09.284 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:08:09.284 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:08:09.284 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:09.284 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:09.284 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:09.285 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.285 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.285 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.285 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:09.285 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:09.285 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:09.286 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:09.286 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:09.286 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:09.286 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:09.286 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:09.287 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:09.287 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:09.287 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:09.287 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:09.287 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:09.287 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.288 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.288 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:08:09.288 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:09.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.288 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.289 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.289 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:08:09.289 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:09.289 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.289 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.289 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.290 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:09.290 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.290 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.290 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:08:09.290 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:09.291 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.291 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.291 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.291 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:08:09.291 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:09.292 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.292 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.292 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:09.292 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.292 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.293 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.293 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:08:09.293 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:09.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.294 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.294 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:08:09.294 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:09.294 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.294 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.295 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:09.295 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.295 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.295 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.295 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:08:09.295 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:09.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.296 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.296 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.296 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:08:09.296 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:09.297 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.297 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.297 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.297 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:08:09.297 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:08:09.297 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:08:09.298 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:08:09.298 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:09.298 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:09.298 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:09.298 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.299 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.299 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:09.299 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:09.299 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:09.299 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:09.300 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:09.300 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:09.300 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:09.300 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:09.300 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:09.300 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:09.301 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:09.301 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:09.301 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:09.301 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.301 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.302 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:08:09.302 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:09.302 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.302 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.302 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.303 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:08:09.303 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:09.303 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.303 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.304 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:09.304 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.304 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.304 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:08:09.305 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:09.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.305 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.305 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.305 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:08:09.305 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:09.306 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.306 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.306 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.306 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:09.306 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.307 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.307 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:08:09.307 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:09.307 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.308 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.308 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:08:09.308 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:09.308 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.308 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.309 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:09.309 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.309 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.309 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.310 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:08:09.310 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:09.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.310 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.311 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:08:09.311 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:09.311 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.311 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.311 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:08:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:08:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:08:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:08:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:09.313 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:09.313 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.313 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.313 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.313 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:09.314 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:09.314 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:09.314 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:09.314 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:09.314 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:09.314 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:09.315 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:09.315 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:09.315 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:09.315 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:09.315 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:09.316 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:09.316 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.316 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.316 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.316 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:08:09.316 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:09.317 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.317 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.317 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:08:09.317 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:09.318 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.318 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.318 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:09.318 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.319 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.319 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:08:09.319 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:09.319 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.319 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.320 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.320 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:08:09.320 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:09.320 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.320 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.321 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:09.321 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.321 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.321 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:08:09.321 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:09.322 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.322 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.322 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.322 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:08:09.322 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:09.323 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.323 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.323 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:09.323 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.324 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.324 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:08:09.324 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:09.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.325 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.325 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:08:09.325 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:09.325 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.325 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.326 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:08:09.326 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:08:09.326 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:08:09.326 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:08:09.327 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:09.327 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:09.327 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:09.327 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.328 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:09.328 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:09.328 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:09.328 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:09.328 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:09.329 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:09.329 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:09.329 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:09.329 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:09.329 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:09.330 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:09.330 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:09.330 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:09.330 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.330 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.330 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.331 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:08:09.331 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:09.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.331 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.331 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.332 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:08:09.332 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:09.332 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.332 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.333 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:09.333 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.333 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.333 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.333 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:08:09.334 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:09.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.334 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.334 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:08:09.334 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:09.335 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.335 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.335 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.335 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:09.335 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.335 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.336 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.336 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:08:09.336 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:09.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.336 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.337 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.337 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:08:09.337 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:09.337 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.337 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.337 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.338 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:09.338 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:09.338 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.338 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:09.338 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:08:09.338 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:09.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.339 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:09.339 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:08:09.339 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:09.339 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.340 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.340 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.340 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:08:09.340 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:08:09.340 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:08:09.340 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:08:09.341 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:09.341 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:09.341 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:09.341 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:09.341 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.341 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:09.342 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:08:09.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.342 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:09.342 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:09.342 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:09.343 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:09.343 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:09.343 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:09.343 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:08:09.343 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:09.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.344 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.344 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:09.344 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:09.344 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:09.344 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:09.345 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:09.345 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:09.345 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:08:09.345 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:09.345 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.346 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:09.346 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:09.346 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:09.346 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:09.346 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:09.347 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:09.347 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:08:09.347 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:09.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.347 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.348 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:09.348 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:09.348 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:09.348 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:09.348 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:09.348 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:09.349 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:08:09.349 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:09.349 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.349 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.349 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:09.349 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:09.350 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:09.350 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:09.350 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:09.350 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:09.350 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:08:09.351 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:09.351 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.351 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.351 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:09.351 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:09.351 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:09.352 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:09.352 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:09.352 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:09.352 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:08:09.352 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:09.353 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.353 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:09.353 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:09.353 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:09.353 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:09.354 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:09.354 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:09.354 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:08:09.354 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:09.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.355 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:09.355 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:09.355 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:09.355 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:09.355 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:09.356 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:09.356 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:09.356 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:08:09.356 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:09.356 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.356 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:09.357 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:08:09.357 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:08:09.357 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:08:09.357 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:08:09.357 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:08:09.358 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:08:09.358 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:08:09.358 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:08:09.358 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:08:09.358 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:08:09.358 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:08:09.359 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:08:09.359 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:08:09.359 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:08:09.359 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.359 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:09.360 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:08:09.360 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:08:09.360 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:08:09.360 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:08:09.360 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:08:09.360 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:08:09.361 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:08:09.361 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:08:09.361 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:08:09.361 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:08:09.361 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:08:09.361 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:09.362 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:08:09.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1574245289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b3c065b50 msgr2=0x7f5b3c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:09.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b3c065b50 0x7f5b3c068010 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0ae000 tx=0x7f5b4c0b5040 comp rx=0 tx=0).stop 2023-09-13T06:08:09.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1574245289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b580cdfc0 msgr2=0x7f5b58150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:09.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b580cdfc0 0x7f5b58150c70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400c450 tx=0x7f5b4400c910 comp rx=0 tx=0).stop 2023-09-13T06:08:09.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1574245289 shutdown_connections 2023-09-13T06:08:09.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5b3c065b50 0x7f5b3c068010 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:09.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5b58159f20 0x7f5b58150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:09.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b580cdfc0 0x7f5b58150c70 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:09.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 --2- 172.21.15.130:0/1574245289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5b580b1d20 0x7f5b5814afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:09.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1574245289 >> 172.21.15.130:0/1574245289 conn(0x7f5b58065990 msgr2=0x7f5b5806c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:09.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1574245289 shutdown_connections 2023-09-13T06:08:09.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:09.163+0000 7f5b5f09e640 1 -- 172.21.15.130:0/1574245289 wait complete. 2023-09-13T06:08:09.366 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:08:14.367 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:08:14.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.515+0000 7f520974d640 1 Processor -- start 2023-09-13T06:08:14.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.515+0000 7f520974d640 1 -- start start 2023-09-13T06:08:14.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.519+0000 7f520974d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f52040b1d20 0x7f52040ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:14.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.519+0000 7f520974d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52040ccfd0 con 0x7f52040cdfc0 2023-09-13T06:08:14.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.519+0000 7f520974d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52040ced90 con 0x7f5204159f20 2023-09-13T06:08:14.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.519+0000 7f520974d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52040ce430 con 0x7f52040b1d20 2023-09-13T06:08:14.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.519+0000 7f51fbfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f52040b1d20 0x7f52040ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:14.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.519+0000 7f52037fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f52040cdfc0 0x7f52040ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48852/0 (socket says 172.21.15.130:48852) 2023-09-13T06:08:14.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.519+0000 7f52037fe640 1 -- 172.21.15.130:0/3715880377 learned_addr learned my addr 172.21.15.130:0/3715880377 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:14.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.519+0000 7f51fbfff640 1 -- 172.21.15.130:0/3715880377 >> v1:172.21.15.164:6789/0 conn(0x7f5204159f20 legacy=0x7f52040b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:14.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.519+0000 7f51fbfff640 1 -- 172.21.15.130:0/3715880377 >> v1:172.21.15.130:6789/0 conn(0x7f52040cdfc0 legacy=0x7f52040ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:14.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.519+0000 7f51fbfff640 1 -- 172.21.15.130:0/3715880377 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040cd200 con 0x7f52040b1d20 2023-09-13T06:08:14.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f51fbfff640 1 --2- 172.21.15.130:0/3715880377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52040b1d20 0x7f52040ce7b0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0097f0 tx=0x7f51ec01e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd677a8eb3ac21e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:14.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f52027fc640 1 -- 172.21.15.130:0/3715880377 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0ac660 con 0x7f52040b1d20 2023-09-13T06:08:14.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f52027fc640 1 -- 172.21.15.130:0/3715880377 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec0ac7c0 con 0x7f52040b1d20 2023-09-13T06:08:14.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f52027fc640 1 -- 172.21.15.130:0/3715880377 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0acb50 con 0x7f52040b1d20 2023-09-13T06:08:14.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f520974d640 1 -- 172.21.15.130:0/3715880377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52040b1d20 msgr2=0x7f52040ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:14.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f520974d640 1 --2- 172.21.15.130:0/3715880377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52040b1d20 0x7f52040ce7b0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0097f0 tx=0x7f51ec01e600 comp rx=0 tx=0).stop 2023-09-13T06:08:14.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f520974d640 1 -- 172.21.15.130:0/3715880377 shutdown_connections 2023-09-13T06:08:14.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f520974d640 1 --2- 172.21.15.130:0/3715880377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52040b1d20 0x7f52040ce7b0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:14.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f520974d640 1 -- 172.21.15.130:0/3715880377 >> 172.21.15.130:0/3715880377 conn(0x7f5204065990 msgr2=0x7f5204065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:14.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f520974d640 1 -- 172.21.15.130:0/3715880377 shutdown_connections 2023-09-13T06:08:14.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f520974d640 1 -- 172.21.15.130:0/3715880377 wait complete. 2023-09-13T06:08:14.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f520974d640 1 Processor -- start 2023-09-13T06:08:14.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.523+0000 7f520974d640 1 -- start start 2023-09-13T06:08:14.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f520974d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52040b1d20 0x7f520406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:14.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f520974d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52040cdfc0 0x7f52040c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:14.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f520974d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5204159f20 0x7f520406d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:14.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f520974d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520406d850 con 0x7f5204159f20 2023-09-13T06:08:14.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f520974d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520406c270 con 0x7f52040b1d20 2023-09-13T06:08:14.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f520974d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520406c550 con 0x7f52040cdfc0 2023-09-13T06:08:14.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f52037fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5204159f20 0x7f520406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:14.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f52037fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5204159f20 0x7f520406d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45328/0 (socket says 172.21.15.130:45328) 2023-09-13T06:08:14.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f52037fe640 1 -- 172.21.15.130:0/1321074008 learned_addr learned my addr 172.21.15.130:0/1321074008 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:14.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f51fbfff640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52040cdfc0 0x7f52040c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:14.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f5202ffd640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52040b1d20 0x7f520406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:14.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f52037fe640 1 -- 172.21.15.130:0/1321074008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52040cdfc0 msgr2=0x7f52040c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:14.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f52037fe640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52040cdfc0 0x7f52040c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:14.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f52037fe640 1 -- 172.21.15.130:0/1321074008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52040b1d20 msgr2=0x7f520406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:14.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f52037fe640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52040b1d20 0x7f520406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:14.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f52037fe640 1 -- 172.21.15.130:0/1321074008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec009420 con 0x7f5204159f20 2023-09-13T06:08:14.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f52037fe640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5204159f20 0x7f520406d310 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00ca70 tx=0x7f51fc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:14.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f51fb7fe640 1 -- 172.21.15.130:0/1321074008 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00abd0 con 0x7f5204159f20 2023-09-13T06:08:14.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f51fb7fe640 1 -- 172.21.15.130:0/1321074008 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc00ad30 con 0x7f5204159f20 2023-09-13T06:08:14.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f51fb7fe640 1 -- 172.21.15.130:0/1321074008 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc012600 con 0x7f5204159f20 2023-09-13T06:08:14.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f520974d640 1 -- 172.21.15.130:0/1321074008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520406c830 con 0x7f5204159f20 2023-09-13T06:08:14.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f520974d640 1 -- 172.21.15.130:0/1321074008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520406cdf0 con 0x7f5204159f20 2023-09-13T06:08:14.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f520974d640 1 -- 172.21.15.130:0/1321074008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52040618a0 con 0x7f5204159f20 2023-09-13T06:08:14.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.527+0000 7f51fb7fe640 1 -- 172.21.15.130:0/1321074008 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f51fc007070 con 0x7f5204159f20 2023-09-13T06:08:14.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.531+0000 7f51fb7fe640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51e4065b20 0x7f51e4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:14.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.531+0000 7f51fb7fe640 1 -- 172.21.15.130:0/1321074008 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f51fc083070 con 0x7f5204159f20 2023-09-13T06:08:14.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.531+0000 7f51fb7fe640 1 -- 172.21.15.130:0/1321074008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7f51e406d710 con 0x7f5204159f20 2023-09-13T06:08:14.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.531+0000 7f5202ffd640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51e4065b20 0x7f51e4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:14.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.531+0000 7f5202ffd640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51e4065b20 0x7f51e4067fe0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f51f4007fd0 tx=0x7f51f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:14.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.535+0000 7f51fb7fe640 1 -- 172.21.15.130:0/1321074008 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f51fc017020 con 0x7f5204159f20 2023-09-13T06:08:14.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.683+0000 7f520974d640 1 -- 172.21.15.130:0/1321074008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f52040ae7d0 con 0x7f5204159f20 2023-09-13T06:08:14.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.683+0000 7f51fb7fe640 1 -- 172.21.15.130:0/1321074008 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) v1 ==== 81+0+34398 (secure 0 0 0) 0x7f51fc050ac0 con 0x7f5204159f20 2023-09-13T06:08:14.687 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:14.688 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:08:14.688 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 141, 2023-09-13T06:08:14.688 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:08:14.688 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:08:14.688 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:08:14.451599+0000", 2023-09-13T06:08:14.689 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:08:14.689 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:08:14.689 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:08:14.689 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:08:14.690 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:08:14.690 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:08:14.690 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:08:14.690 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:08:14.690 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:08:14.691 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:14.691 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:08:14.691 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:08:14.691 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:08:14.691 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:08:14.692 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:08:14.692 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 17, 2023-09-13T06:08:14.692 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:08:14.692 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:08:14.692 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "luminous", 2023-09-13T06:08:14.693 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:08:14.693 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:08:14.693 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:08:14.693 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.693 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:08:14.694 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:08:14.694 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:08:14.694 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:14.694 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:14.695 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:14.695 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:14.695 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:14.695 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:14.695 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:14.695 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:14.696 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:14.696 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:14.696 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:14.696 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:14.696 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:08:14.697 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:08:14.697 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:08:14.697 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:08:14.697 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:08:14.697 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:14.698 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:14.698 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:14.698 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:14.698 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:14.698 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:08:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:14.699 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:14.700 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:14.700 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:14.700 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:14.700 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:14.700 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:14.701 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:14.701 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:14.701 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:14.701 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:14.702 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:14.702 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:14.702 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:14.702 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:14.702 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:14.703 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:14.703 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:14.703 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:14.703 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:14.703 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:14.705 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:14.705 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:14.705 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:14.705 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:14.706 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.706 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:14.706 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:14.706 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:14.706 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:14.707 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:14.707 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:14.707 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:14.707 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:14.708 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:14.708 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:14.708 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:14.708 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:14.708 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:08:14.709 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:08:14.709 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.709 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:14.709 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:08:14.709 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.709 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:14.710 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:08:14.710 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:08:14.710 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:08:14.710 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:08:14.711 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:08:14.711 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:14.711 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:14.711 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:14.711 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.711 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.712 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.712 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 16, 2023-09-13T06:08:14.712 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:08:14.712 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:38.276233+0000", 2023-09-13T06:08:14.712 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:14.713 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:14.713 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:14.713 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:14.713 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:14.713 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:14.714 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:14.714 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:14.714 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:14.714 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:14.714 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:14.715 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:14.715 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:08:14.715 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:08:14.715 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:08:14.715 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:08:14.716 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:08:14.716 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:14.716 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:14.716 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:14.716 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:14.717 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:14.717 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:14.717 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:14.717 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.717 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "136", 2023-09-13T06:08:14.718 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:14.718 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:14.718 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:14.718 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:14.718 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:14.719 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:14.719 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:14.719 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:14.719 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:14.719 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:14.720 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:14.720 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:14.720 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:14.720 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:14.720 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:14.721 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:14.721 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:14.721 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:14.721 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:14.721 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:14.722 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:14.722 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:14.722 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:14.722 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:14.722 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:14.723 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:14.723 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.723 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:14.723 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:14.723 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:14.724 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:14.724 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:14.724 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:14.724 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:14.724 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:14.725 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:14.725 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:14.725 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:14.725 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:14.725 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:08:14.726 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:08:14.726 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:08:14.726 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.726 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:14.726 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:14.727 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:08:14.727 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.727 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.727 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:14.727 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:08:14.728 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:08:14.728 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:14.728 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:08:14.728 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:08:14.728 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.730 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 17, 2023-09-13T06:08:14.730 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:08:14.730 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:39.032744+0000", 2023-09-13T06:08:14.730 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1027, 2023-09-13T06:08:14.730 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-13T06:08:14.731 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:14.731 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:14.731 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:14.731 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:14.731 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:14.731 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:08:14.733 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:08:14.733 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:08:14.733 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:08:14.733 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:08:14.733 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:14.734 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:14.735 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.735 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "139", 2023-09-13T06:08:14.735 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:14.735 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:14.735 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:14.736 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:14.736 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:14.736 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:14.736 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:14.736 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:14.737 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:14.737 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:08:14.737 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:14.737 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:14.737 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:14.737 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:14.738 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:14.738 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:14.738 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:14.738 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:14.738 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:14.739 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:14.739 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:14.739 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:14.739 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:14.739 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:14.740 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:14.740 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:14.740 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.740 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:14.740 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:14.740 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:14.741 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:14.741 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:14.741 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:14.741 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:14.741 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:14.742 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:14.742 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:14.742 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:14.742 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:14.742 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:08:14.743 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:08:14.743 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.743 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:14.743 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:14.744 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:08:14.744 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.744 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.744 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:14.744 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.5, 2023-09-13T06:08:14.745 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.5, 2023-09-13T06:08:14.745 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:14.745 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.5, 2023-09-13T06:08:14.745 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.5, 2023-09-13T06:08:14.745 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:14.745 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:14.746 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:14.746 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.746 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.746 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:14.746 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:08:14.747 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.747 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:14.747 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:14.747 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:14.747 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:14.748 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:14.748 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:14.748 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:14.748 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:14.748 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:14.749 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:14.749 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:14.749 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:14.749 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:14.749 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.749 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.750 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.750 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:08:14.750 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:14.750 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.750 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.751 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.751 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:08:14.751 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:14.751 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.751 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.752 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.752 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:14.752 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.752 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.752 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.753 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:08:14.753 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:14.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.753 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.753 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.754 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:08:14.754 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:14.754 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.754 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.755 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:14.755 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.755 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.755 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.755 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:08:14.755 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:14.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.756 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.756 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.756 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:08:14.756 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:14.757 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.757 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.757 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:14.757 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.758 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.758 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:08:14.758 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:14.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.758 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.759 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.759 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:08:14.759 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:14.759 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.759 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.760 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:08:14.760 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:08:14.760 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:08:14.760 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:08:14.761 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:14.761 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:14.761 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:14.761 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.762 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.762 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:14.762 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:14.762 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:14.762 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:14.763 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:14.763 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:14.763 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:14.763 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:14.763 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:14.763 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:14.764 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:14.764 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:14.764 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:14.764 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.764 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.765 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.765 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:08:14.765 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:14.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.765 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.765 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.766 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:08:14.766 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:14.766 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.766 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.767 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:14.767 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.767 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.767 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.767 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:08:14.768 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:14.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.768 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.768 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.768 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:08:14.768 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:14.769 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.769 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.769 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:14.769 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.770 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.770 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.770 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:08:14.770 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:14.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.771 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.771 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.771 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:08:14.771 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:14.771 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:08:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.773 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:08:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.775 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:08:14.775 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:08:14.775 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:08:14.775 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:08:14.775 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:14.775 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:14.777 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:14.777 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:14.777 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:14.777 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:14.777 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:14.778 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:14.778 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:14.778 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:14.778 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 140, 2023-09-13T06:08:14.778 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.779 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:08:14.780 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:14.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.780 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.780 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.780 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:08:14.781 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:14.781 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.781 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.781 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:14.782 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.782 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.782 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.782 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:08:14.782 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:14.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.783 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.783 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.783 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:08:14.783 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.785 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.785 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:08:14.785 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:14.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.785 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.786 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.786 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:08:14.786 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:14.786 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.786 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.787 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.787 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:14.787 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.787 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.787 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.788 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:08:14.788 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:14.788 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.788 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.788 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.789 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:08:14.789 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:14.789 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.789 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.790 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:08:14.790 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:08:14.790 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:08:14.790 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:08:14.790 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:14.790 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:14.791 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:14.791 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.791 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:14.792 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:14.792 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:14.792 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:14.792 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:14.792 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:14.793 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:14.793 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:14.793 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:14.793 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:14.793 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:14.794 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:14.794 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:14.794 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.794 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.794 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:08:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.795 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:08:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.796 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:08:14.797 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:08:14.798 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.799 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:08:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.800 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:08:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.801 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.802 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:08:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.803 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:08:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.804 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:08:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:08:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:08:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:08:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:14.805 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:14.806 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:14.807 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:08:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.810 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:08:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:14.811 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:08:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:14.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:08:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:14.813 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:08:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.815 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:08:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.817 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:08:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.818 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:08:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:08:14.819 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:08:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:08:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:08:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:14.820 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:14.822 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 140, 2023-09-13T06:08:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:14.823 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:08:14.824 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:08:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:14.825 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:08:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.827 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:08:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.829 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:08:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.830 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:08:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.831 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:08:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:14.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:08:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:14.833 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:08:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:08:14.834 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:08:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:08:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:14.835 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:14.837 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:14.838 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:08:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:14.839 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:08:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:14.840 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.841 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:08:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.842 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:08:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.843 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:08:14.844 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:08:14.845 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:14.846 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:08:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.847 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:08:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.848 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:08:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:08:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:08:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:08:14.849 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.850 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:14.851 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:14.852 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.853 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:08:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.854 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:08:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.855 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:08:14.856 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:08:14.857 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:14.858 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:08:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:08:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.860 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:14.861 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:08:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:14.862 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:08:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.863 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:08:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:08:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:08:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:08:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:14.864 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:08:14.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:14.866 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:08:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:08:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.869 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:14.870 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:08:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:14.871 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:14.872 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:08:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:08:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:14.875 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:08:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:14.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:14.877 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:08:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:14.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:14.879 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:08:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.880 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:08:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [ 2023-09-13T06:08:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "17.30", 2023-09-13T06:08:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:08:14.881 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:08:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 5 2023-09-13T06:08:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "17.37", 2023-09-13T06:08:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:08:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:14.883 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:08:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 2 2023-09-13T06:08:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:14.884 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:08:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:08:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:08:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:08:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:08:14.885 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:08:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:08:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:08:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:08:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:08:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:08:14.886 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:08:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:08:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:08:14.887 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:08:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:08:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:08:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:08:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:08:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:08:14.888 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:08:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:08:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:08:14.889 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:14.889 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:08:14.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 -- 172.21.15.130:0/1321074008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51e4065b20 msgr2=0x7f51e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:14.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51e4065b20 0x7f51e4067fe0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f51f4007fd0 tx=0x7f51f4009040 comp rx=0 tx=0).stop 2023-09-13T06:08:14.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 -- 172.21.15.130:0/1321074008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5204159f20 msgr2=0x7f520406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:14.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5204159f20 0x7f520406d310 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00ca70 tx=0x7f51fc00cf30 comp rx=0 tx=0).stop 2023-09-13T06:08:14.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 -- 172.21.15.130:0/1321074008 shutdown_connections 2023-09-13T06:08:14.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51e4065b20 0x7f51e4067fe0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:14.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5204159f20 0x7f520406d310 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:14.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52040cdfc0 0x7f52040c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:14.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 --2- 172.21.15.130:0/1321074008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52040b1d20 0x7f520406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:14.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 -- 172.21.15.130:0/1321074008 >> 172.21.15.130:0/1321074008 conn(0x7f5204065990 msgr2=0x7f520406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:14.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 -- 172.21.15.130:0/1321074008 shutdown_connections 2023-09-13T06:08:14.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:14.687+0000 7f520974d640 1 -- 172.21.15.130:0/1321074008 wait complete. 2023-09-13T06:08:14.894 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:08:15.303 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:08:15.308 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:08:19.895 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:08:20.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75afc48640 1 Processor -- start 2023-09-13T06:08:20.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75afc48640 1 -- start start 2023-09-13T06:08:20.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75afc48640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f75a8159f20 0x7f75a80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75afc48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a80b1d20 0x7f75a80b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75afc48640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a80ccfd0 con 0x7f75a80cdfc0 2023-09-13T06:08:20.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75afc48640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a80b00f0 con 0x7f75a8159f20 2023-09-13T06:08:20.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75afc48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80b11d0 con 0x7f75a80b1d20 2023-09-13T06:08:20.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75ad1e3640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f75a80cdfc0 0x7f75a80b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48868/0 (socket says 172.21.15.130:48868) 2023-09-13T06:08:20.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75ad1e3640 1 -- 172.21.15.130:0/483185525 learned_addr learned my addr 172.21.15.130:0/483185525 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:20.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75ad9e4640 1 --2- 172.21.15.130:0/483185525 >> v2:172.21.15.164:3300/0 conn(0x7f75a8159f20 0x7f75a80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75ae1e5640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a80b1d20 0x7f75a80b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.039+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782216968 0 0) 0x7f75a80ccfd0 con 0x7f75a80cdfc0 2023-09-13T06:08:20.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7594003530 con 0x7f75a80cdfc0 2023-09-13T06:08:20.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2066996236 0 0) 0x7f7594003530 con 0x7f75a80cdfc0 2023-09-13T06:08:20.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a80b1d20 msgr2=0x7f75a80b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:20.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a80b1d20 0x7f75a80b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 >> v2:172.21.15.164:3300/0 conn(0x7f75a8159f20 msgr2=0x7f75a80ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:20.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 --2- 172.21.15.130:0/483185525 >> v2:172.21.15.164:3300/0 conn(0x7f75a8159f20 0x7f75a80ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a80ced90 con 0x7f75a80cdfc0 2023-09-13T06:08:20.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f7598001680 con 0x7f75a80cdfc0 2023-09-13T06:08:20.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 >> v1:172.21.15.130:6789/0 conn(0x7f75a80cdfc0 legacy=0x7f75a80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:20.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a80b1d20 0x7f75940039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 0x7f75940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7594004d10 0x7f7594005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80b11d0 con 0x7f7594003f70 2023-09-13T06:08:20.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759400b990 con 0x7f7594004d10 2023-09-13T06:08:20.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759400bb00 con 0x7f75a80b1d20 2023-09-13T06:08:20.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ad1e3640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 0x7f75940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ad9e4640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a80b1d20 0x7f75940039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ae1e5640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7594004d10 0x7f7594005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ad1e3640 1 -- 172.21.15.130:0/483185525 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a80b1d20 msgr2=0x7f75940039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:20.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ad1e3640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a80b1d20 0x7f75940039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ad1e3640 1 -- 172.21.15.130:0/483185525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7594004d10 msgr2=0x7f7594005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:20.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ad1e3640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7594004d10 0x7f7594005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.043+0000 7f75ad1e3640 1 -- 172.21.15.130:0/483185525 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7594003530 con 0x7f7594003f70 2023-09-13T06:08:20.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75ad1e3640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 0x7f75940047d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f759800c240 tx=0x7f759801f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23f727b3defb25a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:20.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598005ae0 con 0x7f7594003f70 2023-09-13T06:08:20.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75980ab070 con 0x7f7594003f70 2023-09-13T06:08:20.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75ac9e2640 1 -- 172.21.15.130:0/483185525 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598007070 con 0x7f7594003f70 2023-09-13T06:08:20.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 -- 172.21.15.130:0/483185525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 msgr2=0x7f75940047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:20.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 --2- 172.21.15.130:0/483185525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 0x7f75940047d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f759800c240 tx=0x7f759801f3d0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75ae1e5640 1 -- 172.21.15.130:0/483185525 reap_dead start 2023-09-13T06:08:20.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 -- 172.21.15.130:0/483185525 shutdown_connections 2023-09-13T06:08:20.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 -- 172.21.15.130:0/483185525 >> 172.21.15.130:0/483185525 conn(0x7f75a8065990 msgr2=0x7f75a8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:20.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 -- 172.21.15.130:0/483185525 shutdown_connections 2023-09-13T06:08:20.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 -- 172.21.15.130:0/483185525 wait complete. 2023-09-13T06:08:20.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 Processor -- start 2023-09-13T06:08:20.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 -- start start 2023-09-13T06:08:20.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 0x7f75a8155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a806f110 0x7f75a8150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75a8157500 0x7f75a81e29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a81511b0 con 0x7f7594003f70 2023-09-13T06:08:20.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a81582a0 con 0x7f75a8157500 2023-09-13T06:08:20.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75afc48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8157ce0 con 0x7f75a806f110 2023-09-13T06:08:20.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.047+0000 7f75ad9e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 0x7f75a8155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75ad9e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 0x7f75a8155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45358/0 (socket says 172.21.15.130:45358) 2023-09-13T06:08:20.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75ad9e4640 1 -- 172.21.15.130:0/1110020321 learned_addr learned my addr 172.21.15.130:0/1110020321 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:20.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75ad1e3640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a806f110 0x7f75a8150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75ae1e5640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75a8157500 0x7f75a81e29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75ad9e4640 1 -- 172.21.15.130:0/1110020321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a806f110 msgr2=0x7f75a8150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:20.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75ad9e4640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a806f110 0x7f75a8150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75ad9e4640 1 -- 172.21.15.130:0/1110020321 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75a8157500 msgr2=0x7f75a81e29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:20.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75ad9e4640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75a8157500 0x7f75a81e29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75ad9e4640 1 -- 172.21.15.130:0/1110020321 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8157fc0 con 0x7f7594003f70 2023-09-13T06:08:20.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75ae1e5640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75a8157500 0x7f75a81e29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:20.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75ad9e4640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 0x7f75a8155130 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f75a40119d0 tx=0x7f75a4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:20.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f759e7fc640 1 -- 172.21.15.130:0/1110020321 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400fb50 con 0x7f7594003f70 2023-09-13T06:08:20.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f759e7fc640 1 -- 172.21.15.130:0/1110020321 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a400fcb0 con 0x7f7594003f70 2023-09-13T06:08:20.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75afc48640 1 -- 172.21.15.130:0/1110020321 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a81e0810 con 0x7f7594003f70 2023-09-13T06:08:20.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f759e7fc640 1 -- 172.21.15.130:0/1110020321 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4014440 con 0x7f7594003f70 2023-09-13T06:08:20.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75afc48640 1 -- 172.21.15.130:0/1110020321 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a81579b0 con 0x7f7594003f70 2023-09-13T06:08:20.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f75afc48640 1 -- 172.21.15.130:0/1110020321 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a80618a0 con 0x7f7594003f70 2023-09-13T06:08:20.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f759e7fc640 1 -- 172.21.15.130:0/1110020321 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f75a401d400 con 0x7f7594003f70 2023-09-13T06:08:20.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f759e7fc640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f758c065b50 0x7f758c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.051+0000 7f759e7fc640 1 -- 172.21.15.130:0/1110020321 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f75a4083b50 con 0x7f7594003f70 2023-09-13T06:08:20.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.055+0000 7f75ad1e3640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f758c065b50 0x7f758c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.055+0000 7f75ad1e3640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f758c065b50 0x7f758c068010 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f75980ae000 tx=0x7f75980b4040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:20.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.059+0000 7f759e7fc640 1 -- 172.21.15.130:0/1110020321 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f75a4051510 con 0x7f7594003f70 2023-09-13T06:08:20.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 -- 172.21.15.130:0/1110020321 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f75a8158ae0 con 0x7f7594003f70 2023-09-13T06:08:20.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f759e7fc640 1 -- 172.21.15.130:0/1110020321 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v142) v1 ==== 81+0+34379 (secure 0 0 0) 0x7f75a4054b30 con 0x7f7594003f70 2023-09-13T06:08:20.213 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:20.214 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:08:20.215 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 142, 2023-09-13T06:08:20.215 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:08:20.215 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:08:20.216 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:08:17.386149+0000", 2023-09-13T06:08:20.216 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:08:20.217 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:08:20.217 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:08:20.218 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:08:20.219 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:08:20.219 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:08:20.219 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:08:20.219 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:08:20.220 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:08:20.220 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:20.220 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:08:20.220 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:08:20.221 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:08:20.221 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:08:20.221 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:08:20.222 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 17, 2023-09-13T06:08:20.222 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:08:20.222 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:08:20.222 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "luminous", 2023-09-13T06:08:20.222 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:08:20.223 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:08:20.223 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:08:20.223 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.223 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:08:20.224 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:08:20.224 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:08:20.224 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:20.224 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:20.224 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:20.225 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:20.225 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:20.226 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:20.226 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:20.226 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:20.227 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:20.227 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:20.227 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:20.227 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:20.227 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:08:20.228 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:08:20.228 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:08:20.228 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:08:20.228 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:08:20.228 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:20.228 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:20.229 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:20.229 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:20.230 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:20.230 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:20.230 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:20.230 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.230 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:08:20.231 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:20.231 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:20.231 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:20.232 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:20.233 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:20.233 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:20.233 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:20.233 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:20.234 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:20.234 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:20.234 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:20.234 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:20.234 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:20.235 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:20.235 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:20.235 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:20.236 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:20.236 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:20.237 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:20.237 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:20.237 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:20.237 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.237 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:20.238 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:20.238 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:20.238 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:20.238 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:20.239 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:20.239 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:20.239 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:20.240 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:20.240 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:20.240 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:20.240 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:20.240 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:08:20.241 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:08:20.241 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.241 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:20.242 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:08:20.242 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.242 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:20.242 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:08:20.242 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:08:20.243 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:08:20.243 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:08:20.243 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:08:20.243 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:20.243 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:20.244 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:20.244 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.244 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.244 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.244 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 16, 2023-09-13T06:08:20.245 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:08:20.245 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:38.276233+0000", 2023-09-13T06:08:20.245 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:20.245 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:20.245 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:20.245 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:20.246 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:20.250 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:20.250 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:20.250 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:20.251 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:20.251 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:20.251 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:20.252 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:20.252 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:08:20.252 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:08:20.252 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:08:20.253 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:08:20.253 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:08:20.253 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:20.253 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:20.254 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:20.254 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:20.254 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:20.255 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:20.255 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:20.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.255 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "136", 2023-09-13T06:08:20.255 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:20.256 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:20.256 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:20.256 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:20.256 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:20.257 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:20.257 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:20.257 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:20.257 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:20.257 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:20.257 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:20.258 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:20.258 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:20.258 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:20.258 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:20.258 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:20.259 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:20.259 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:20.260 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:20.261 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:20.261 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:20.261 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:20.261 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:20.261 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:20.262 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:20.262 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:20.262 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.262 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:20.262 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:20.263 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:20.263 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:20.263 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:20.263 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:20.263 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:20.264 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:20.264 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:20.264 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:20.264 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:20.264 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:20.265 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:08:20.265 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:08:20.265 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:08:20.265 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.265 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:20.265 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:20.266 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:08:20.266 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.266 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:20.266 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:08:20.267 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:08:20.267 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:20.267 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:08:20.267 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:08:20.267 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:20.268 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:20.268 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:20.268 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.268 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.268 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 17, 2023-09-13T06:08:20.269 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:08:20.269 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:39.032744+0000", 2023-09-13T06:08:20.269 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:20.269 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:20.269 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:20.270 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:20.271 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:20.271 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:20.271 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:20.272 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:20.272 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:20.272 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:20.272 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:20.272 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:20.273 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:08:20.273 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:08:20.273 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:08:20.273 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:08:20.274 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:08:20.274 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:20.275 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:20.275 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:20.275 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:20.275 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:20.275 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:20.276 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:20.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.276 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "142", 2023-09-13T06:08:20.276 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:20.276 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:20.277 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:20.277 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:20.277 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:20.278 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:20.278 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:20.278 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:20.278 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:20.278 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:08:20.279 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:20.279 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:20.279 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:20.279 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:20.280 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:20.280 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:20.280 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:20.280 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:20.280 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:20.281 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:20.281 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:20.281 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:20.281 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:20.282 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:20.282 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:20.282 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:20.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.283 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:20.283 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:20.283 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:20.283 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:20.283 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:20.284 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:20.284 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:20.284 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:20.284 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:20.284 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:20.285 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:20.285 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:20.285 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:08:20.286 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:08:20.286 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.286 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:20.286 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:20.286 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:08:20.287 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.287 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:20.287 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.5, 2023-09-13T06:08:20.287 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.5, 2023-09-13T06:08:20.288 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:20.288 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.5, 2023-09-13T06:08:20.288 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.5, 2023-09-13T06:08:20.288 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:20.289 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:20.289 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:20.289 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.289 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.289 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:20.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:08:20.290 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:20.290 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.291 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.291 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.291 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.291 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.291 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.292 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.293 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.293 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.293 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.293 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.293 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:08:20.294 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.294 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.294 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.295 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:08:20.295 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.295 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.295 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.296 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.296 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.297 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.297 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.297 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:08:20.297 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.298 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.298 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.298 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:08:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.299 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.300 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.300 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.300 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:08:20.301 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.301 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.301 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.301 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.302 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:08:20.302 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.302 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.303 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.303 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.303 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.304 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.304 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.304 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.305 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:08:20.305 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.305 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.306 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.306 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.306 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:08:20.307 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.307 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.307 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.308 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:08:20.308 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:08:20.308 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:08:20.309 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:08:20.309 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.310 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.310 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.310 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.310 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.311 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:20.311 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.311 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.311 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.311 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.312 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.312 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.312 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.312 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.312 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.313 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.313 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.313 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.313 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.314 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.314 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.314 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:08:20.314 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.314 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.315 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.315 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.315 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:08:20.316 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.316 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.316 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.316 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.316 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.317 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.317 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.317 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.318 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:08:20.318 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.318 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.318 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.318 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.319 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:08:20.319 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.319 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.319 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.321 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:08:20.321 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.321 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.321 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.321 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.322 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:08:20.322 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.322 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.322 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.323 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.323 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.323 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.323 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.324 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.324 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:08:20.324 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.324 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.324 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.325 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.325 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:08:20.325 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.325 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.325 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.326 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.326 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:08:20.326 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:08:20.326 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:08:20.327 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:08:20.327 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.327 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.327 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.327 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.328 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.328 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:20.329 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.329 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.329 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.329 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.330 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.330 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.330 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.331 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.331 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 140, 2023-09-13T06:08:20.331 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.331 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.332 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.332 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.332 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.333 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.333 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:08:20.334 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.334 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.334 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.335 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.335 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:08:20.335 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.336 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.336 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.336 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.337 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.337 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.337 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.338 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.338 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:08:20.339 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.339 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.339 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.340 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.340 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:08:20.340 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.341 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.341 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.341 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.341 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.342 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.342 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.342 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.342 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:08:20.343 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.343 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.343 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.343 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.343 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:08:20.344 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.344 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.344 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.344 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.345 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.345 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.345 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.345 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.345 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:08:20.346 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.346 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.346 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.346 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.347 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:08:20.347 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.347 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.347 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.347 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.348 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:08:20.348 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:08:20.348 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:08:20.348 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:08:20.348 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.349 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.349 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.349 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.350 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.350 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.350 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:20.350 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.351 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.351 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.351 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.351 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.351 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.352 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.352 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.352 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.352 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.352 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.353 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.353 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.353 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.353 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.354 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:08:20.354 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.354 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.354 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.355 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:08:20.355 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.355 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.355 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.355 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.356 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.356 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.356 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.356 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.356 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:08:20.357 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.357 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.357 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.357 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.358 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:08:20.358 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.358 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.358 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.358 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.359 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.359 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.359 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.359 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.360 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:08:20.360 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.360 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.360 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.361 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.361 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:08:20.361 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.361 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.361 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.362 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.362 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.362 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.362 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.362 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.363 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:08:20.363 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.363 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.363 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.363 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:08:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.364 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.365 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:08:20.365 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:08:20.365 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:08:20.365 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:08:20.366 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.366 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.366 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.367 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.367 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.367 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.368 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:20.368 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.368 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.369 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.369 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.369 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.369 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.370 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.370 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.370 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.371 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.371 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.371 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.371 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.371 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.372 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.372 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:08:20.372 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.372 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.373 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.373 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:08:20.373 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.374 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.374 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.374 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.375 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.375 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.375 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.375 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:08:20.376 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.376 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.376 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.376 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:08:20.377 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.377 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.377 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.377 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.378 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.378 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.379 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:08:20.379 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.379 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.380 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.380 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:08:20.380 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.380 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.380 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.381 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.381 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.381 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.381 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.382 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.382 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:08:20.382 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.382 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.383 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.383 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.384 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:08:20.384 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.384 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.385 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.385 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.385 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:08:20.386 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:08:20.386 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:08:20.386 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:08:20.386 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.387 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.387 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.387 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.388 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.388 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:20.388 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.389 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.389 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.389 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.390 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.390 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.390 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.390 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.391 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 140, 2023-09-13T06:08:20.391 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.391 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.391 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.391 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.392 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.392 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.392 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:08:20.392 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.393 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.393 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.393 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:08:20.393 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.393 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.394 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.394 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.394 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.395 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.395 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:08:20.395 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.395 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.396 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.396 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:08:20.396 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.397 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.397 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.398 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.398 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.398 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.399 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.399 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:08:20.399 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.400 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.401 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.401 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:08:20.401 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.402 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.402 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.402 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.403 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.403 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.403 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.403 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.403 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:08:20.404 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.404 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.404 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.404 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:08:20.405 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.405 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.405 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.405 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:08:20.406 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:08:20.406 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:08:20.406 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:08:20.406 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.406 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.407 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.407 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.407 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.407 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:20.408 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.408 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.408 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.408 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.408 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.409 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.409 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.409 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.409 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.409 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.410 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.410 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.410 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.410 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.410 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:08:20.411 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.411 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.411 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.411 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:08:20.412 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.412 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.412 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.412 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.412 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.413 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.413 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.413 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:08:20.413 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.414 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.414 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.414 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:08:20.414 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.414 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.415 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.415 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.415 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.415 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.415 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.416 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:08:20.416 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.416 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.416 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.416 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.417 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:08:20.417 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.417 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.417 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.417 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.418 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.418 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.418 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.418 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:08:20.418 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.419 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.419 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.419 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.419 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:08:20.419 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.420 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.420 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.420 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:08:20.420 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:08:20.421 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:08:20.421 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:08:20.421 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.421 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.421 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.422 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.422 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.422 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.422 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:20.422 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.422 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.423 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.423 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.423 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.423 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.424 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.424 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.424 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.424 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.424 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.424 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.425 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.425 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.425 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.425 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:08:20.426 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.426 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.426 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.426 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.426 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:08:20.427 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.427 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.427 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.427 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.427 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.428 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.428 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.428 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.428 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:08:20.428 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.429 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.429 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.429 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:08:20.429 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.430 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.430 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.430 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.430 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.431 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.431 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:08:20.431 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.431 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.432 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.432 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:08:20.432 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.432 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.432 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.433 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.433 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.433 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.433 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:08:20.434 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.434 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.434 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:08:20.435 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.435 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.435 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.435 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:08:20.436 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:08:20.436 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:08:20.436 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:08:20.436 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.436 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.436 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.437 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.437 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.437 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:20.437 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:08:20.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.438 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:20.438 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:20.438 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:20.438 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:20.438 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:20.439 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:20.439 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:08:20.439 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:20.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.439 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.439 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:20.440 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:20.440 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:20.440 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:20.440 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:20.440 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:20.441 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:08:20.441 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:20.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.441 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:20.442 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:20.442 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:20.442 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:20.442 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:20.442 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:20.442 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:08:20.443 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:20.443 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.443 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.443 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:20.443 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:20.444 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:20.444 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:20.444 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:20.444 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:20.444 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:08:20.444 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:20.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.445 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:20.445 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:20.445 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:20.446 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:20.446 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:20.446 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:20.446 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:08:20.446 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:20.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.447 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:20.447 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:20.447 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:20.447 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:20.448 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:20.448 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:20.448 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:08:20.448 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:20.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.449 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.449 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:20.449 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:20.449 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:20.449 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:20.449 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:20.450 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:20.450 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:08:20.450 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:20.450 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.451 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:20.451 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:20.451 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:20.451 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:20.451 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:20.452 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:20.452 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:08:20.452 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:20.452 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.452 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:20.452 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:08:20.453 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [ 2023-09-13T06:08:20.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.453 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "17.30", 2023-09-13T06:08:20.453 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:08:20.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.454 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:08:20.454 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 5 2023-09-13T06:08:20.454 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.454 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.455 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "17.37", 2023-09-13T06:08:20.455 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:08:20.455 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.455 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:08:20.455 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 2 2023-09-13T06:08:20.456 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.456 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.456 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.456 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:20.456 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:08:20.457 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:08:20.457 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:08:20.457 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:08:20.457 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:08:20.457 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:08:20.457 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:08:20.458 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:08:20.458 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:08:20.458 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:08:20.458 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:08:20.458 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:08:20.459 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.459 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.459 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:08:20.459 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:08:20.459 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:08:20.460 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:08:20.460 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:08:20.460 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:08:20.460 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:08:20.460 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:08:20.461 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:08:20.461 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:08:20.461 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:08:20.461 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.461 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:08:20.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 -- 172.21.15.130:0/1110020321 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f758c065b50 msgr2=0x7f758c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:20.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f758c065b50 0x7f758c068010 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f75980ae000 tx=0x7f75980b4040 comp rx=0 tx=0).stop 2023-09-13T06:08:20.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 -- 172.21.15.130:0/1110020321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 msgr2=0x7f75a8155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:20.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 0x7f75a8155130 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f75a40119d0 tx=0x7f75a4011e90 comp rx=0 tx=0).stop 2023-09-13T06:08:20.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 -- 172.21.15.130:0/1110020321 shutdown_connections 2023-09-13T06:08:20.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f758c065b50 0x7f758c068010 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75a8157500 0x7f75a81e29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75a806f110 0x7f75a8150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 --2- 172.21.15.130:0/1110020321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7594003f70 0x7f75a8155130 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 -- 172.21.15.130:0/1110020321 >> 172.21.15.130:0/1110020321 conn(0x7f75a8065990 msgr2=0x7f75a80ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:20.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 -- 172.21.15.130:0/1110020321 shutdown_connections 2023-09-13T06:08:20.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.207+0000 7f75afc48640 1 -- 172.21.15.130:0/1110020321 wait complete. 2023-09-13T06:08:20.466 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-09-13T06:08:20.466 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:08:20.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.607+0000 7fd2dfd74640 1 Processor -- start 2023-09-13T06:08:20.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.607+0000 7fd2dfd74640 1 -- start start 2023-09-13T06:08:20.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2dfd74640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd2d815b130 0x7fd2d80cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2dfd74640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd2d80b04a0 0x7fd2d80b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2dfd74640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80ce980 con 0x7fd2d80ce180 2023-09-13T06:08:20.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2dfd74640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d80b0e50 con 0x7fd2d80b04a0 2023-09-13T06:08:20.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2dfd74640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d80cec60 con 0x7fd2d815b130 2023-09-13T06:08:20.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2dd30f640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd2d80ce180 0x7fd2d815b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:48884/0 (socket says 172.21.15.130:48884) 2023-09-13T06:08:20.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2dd30f640 1 -- 172.21.15.130:0/114124817 learned_addr learned my addr 172.21.15.130:0/114124817 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:20.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2de311640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd2d80b04a0 0x7fd2d80b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2ddb10640 1 --2- 172.21.15.130:0/114124817 >> v2:172.21.15.164:3300/0 conn(0x7fd2d815b130 0x7fd2d80cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2de311640 1 -- 172.21.15.130:0/114124817 >> v2:172.21.15.164:3300/0 conn(0x7fd2d815b130 msgr2=0x7fd2d80cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:20.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2de311640 1 --2- 172.21.15.130:0/114124817 >> v2:172.21.15.164:3300/0 conn(0x7fd2d815b130 0x7fd2d80cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2de311640 1 -- 172.21.15.130:0/114124817 >> v1:172.21.15.130:6789/0 conn(0x7fd2d80ce180 legacy=0x7fd2d815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:20.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2de311640 1 -- 172.21.15.130:0/114124817 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d806c640 con 0x7fd2d80b04a0 2023-09-13T06:08:20.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2dcb0e640 1 -- 172.21.15.130:0/114124817 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684679530 0 0) 0x7fd2d80ce980 con 0x7fd2d80ce180 2023-09-13T06:08:20.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.611+0000 7fd2ddb10640 1 --2- 172.21.15.130:0/114124817 >> v2:172.21.15.164:3300/0 conn(0x7fd2d815b130 0x7fd2d80cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:20.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2de311640 1 --2- 172.21.15.130:0/114124817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d80b04a0 0x7fd2d80b0910 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80b1040 tx=0x7fd2d001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2321a1d45d88ea9d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:20.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dcb0e640 1 -- 172.21.15.130:0/114124817 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00a59d0 con 0x7fd2d80b04a0 2023-09-13T06:08:20.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dcb0e640 1 -- 172.21.15.130:0/114124817 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d00a5b30 con 0x7fd2d80b04a0 2023-09-13T06:08:20.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dcb0e640 1 -- 172.21.15.130:0/114124817 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00ad440 con 0x7fd2d80b04a0 2023-09-13T06:08:20.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dfd74640 1 -- 172.21.15.130:0/114124817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d80b04a0 msgr2=0x7fd2d80b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:20.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dfd74640 1 --2- 172.21.15.130:0/114124817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d80b04a0 0x7fd2d80b0910 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80b1040 tx=0x7fd2d001c910 comp rx=0 tx=0).stop 2023-09-13T06:08:20.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dfd74640 1 -- 172.21.15.130:0/114124817 shutdown_connections 2023-09-13T06:08:20.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dfd74640 1 --2- 172.21.15.130:0/114124817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d80b04a0 0x7fd2d80b0910 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dfd74640 1 --2- 172.21.15.130:0/114124817 >> v2:172.21.15.164:3300/0 conn(0x7fd2d815b130 0x7fd2d80cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dfd74640 1 -- 172.21.15.130:0/114124817 >> 172.21.15.130:0/114124817 conn(0x7fd2d8065990 msgr2=0x7fd2d8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:20.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dfd74640 1 -- 172.21.15.130:0/114124817 shutdown_connections 2023-09-13T06:08:20.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dfd74640 1 -- 172.21.15.130:0/114124817 wait complete. 2023-09-13T06:08:20.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dfd74640 1 Processor -- start 2023-09-13T06:08:20.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.615+0000 7fd2dfd74640 1 -- start start 2023-09-13T06:08:20.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2dfd74640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2d80b04a0 0x7fd2d815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2dfd74640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2d80ce180 0x7fd2d81504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2dfd74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d815b130 0x7fd2d8159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2dfd74640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d815c690 con 0x7fd2d815b130 2023-09-13T06:08:20.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2dfd74640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d815bcc0 con 0x7fd2d80ce180 2023-09-13T06:08:20.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2dfd74640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8150a10 con 0x7fd2d80b04a0 2023-09-13T06:08:20.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2de311640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d815b130 0x7fd2d8159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2de311640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d815b130 0x7fd2d8159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45376/0 (socket says 172.21.15.130:45376) 2023-09-13T06:08:20.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2de311640 1 -- 172.21.15.130:0/3454278057 learned_addr learned my addr 172.21.15.130:0/3454278057 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:20.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2dd30f640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2d80ce180 0x7fd2d81504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2de311640 1 -- 172.21.15.130:0/3454278057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2d80b04a0 msgr2=0x7fd2d815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:20.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2de311640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2d80b04a0 0x7fd2d815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2de311640 1 -- 172.21.15.130:0/3454278057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2d80ce180 msgr2=0x7fd2d81504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:20.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2de311640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2d80ce180 0x7fd2d81504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:20.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2de311640 1 -- 172.21.15.130:0/3454278057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009a70 con 0x7fd2d815b130 2023-09-13T06:08:20.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2dd30f640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2d80ce180 0x7fd2d81504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:20.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2de311640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d815b130 0x7fd2d8159740 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00b0040 tx=0x7fd2d00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:20.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2ce7fc640 1 -- 172.21.15.130:0/3454278057 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00adcf0 con 0x7fd2d815b130 2023-09-13T06:08:20.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2ce7fc640 1 -- 172.21.15.130:0/3454278057 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d00ade50 con 0x7fd2d815b130 2023-09-13T06:08:20.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2dfd74640 1 -- 172.21.15.130:0/3454278057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d815b690 con 0x7fd2d815b130 2023-09-13T06:08:20.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2ce7fc640 1 -- 172.21.15.130:0/3454278057 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00b9690 con 0x7fd2d815b130 2023-09-13T06:08:20.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2dfd74640 1 -- 172.21.15.130:0/3454278057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d815b950 con 0x7fd2d815b130 2023-09-13T06:08:20.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2dfd74640 1 -- 172.21.15.130:0/3454278057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d80618a0 con 0x7fd2d815b130 2023-09-13T06:08:20.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.619+0000 7fd2ce7fc640 1 -- 172.21.15.130:0/3454278057 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd2d00b97f0 con 0x7fd2d815b130 2023-09-13T06:08:20.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.623+0000 7fd2ce7fc640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2bc065b20 0x7fd2bc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:20.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.623+0000 7fd2ce7fc640 1 -- 172.21.15.130:0/3454278057 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd2d011eba0 con 0x7fd2d815b130 2023-09-13T06:08:20.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.623+0000 7fd2ddb10640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2bc065b20 0x7fd2bc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:20.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.623+0000 7fd2ddb10640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2bc065b20 0x7fd2bc067fe0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400a890 tx=0x7fd2d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:20.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.627+0000 7fd2ce7fc640 1 -- 172.21.15.130:0/3454278057 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd2d00ec410 con 0x7fd2d815b130 2023-09-13T06:08:20.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.775+0000 7fd2dfd74640 1 -- 172.21.15.130:0/3454278057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd2d815be00 con 0x7fd2d815b130 2023-09-13T06:08:20.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2ce7fc640 1 -- 172.21.15.130:0/3454278057 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v142) v1 ==== 81+0+34379 (secure 0 0 0) 0x7fd2d00efa30 con 0x7fd2d815b130 2023-09-13T06:08:20.781 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:20.781 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:08:20.782 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 142, 2023-09-13T06:08:20.782 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:08:20.782 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:08:20.782 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:08:17.386149+0000", 2023-09-13T06:08:20.783 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:08:20.783 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:08:20.783 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:08:20.783 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:08:20.783 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:08:20.784 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:08:20.784 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:08:20.784 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:08:20.784 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:08:20.785 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:20.785 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:08:20.785 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:08:20.786 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:08:20.786 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:08:20.786 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:08:20.787 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 17, 2023-09-13T06:08:20.787 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:08:20.787 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:08:20.788 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "luminous", 2023-09-13T06:08:20.788 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:08:20.788 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:08:20.788 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:08:20.789 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.789 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:08:20.790 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:08:20.790 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:08:20.790 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:20.790 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:20.791 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:20.791 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:20.791 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:20.791 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:20.792 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:20.792 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:20.792 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:20.792 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:20.793 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:20.793 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:20.793 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:08:20.793 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:08:20.793 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:08:20.794 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:08:20.794 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:08:20.794 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:20.795 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:20.795 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:20.795 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:20.795 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:20.795 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:20.796 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:20.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.796 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:08:20.797 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:20.797 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:20.797 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:20.797 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:20.797 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:20.798 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:20.798 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:20.798 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:20.799 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:20.799 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:20.799 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:20.799 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:20.800 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:20.800 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:20.800 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:20.800 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:20.801 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:20.801 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:20.802 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:20.802 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:20.802 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:20.802 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:20.803 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:20.803 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:20.803 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:20.804 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:20.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.804 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:20.804 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:20.805 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:20.805 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:20.805 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:20.805 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:20.806 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:20.806 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:20.806 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:20.806 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:20.807 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:20.807 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:20.807 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:08:20.808 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:08:20.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.808 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:20.808 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:08:20.809 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.809 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:20.809 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:08:20.809 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:08:20.810 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:08:20.810 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:08:20.810 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:08:20.810 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:20.811 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:20.811 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:20.811 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.812 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 16, 2023-09-13T06:08:20.813 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:08:20.813 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:38.276233+0000", 2023-09-13T06:08:20.813 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:20.813 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:20.814 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:20.814 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:20.814 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:20.814 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:20.815 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:20.815 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:20.815 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:20.815 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:20.816 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:20.816 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:20.816 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:08:20.816 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:08:20.817 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:08:20.817 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:08:20.817 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:08:20.817 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:20.817 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:20.818 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:20.818 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:20.818 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:20.818 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:20.818 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:20.819 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.819 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "136", 2023-09-13T06:08:20.819 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:20.819 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:20.820 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:20.820 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:20.820 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:20.821 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:20.821 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:20.821 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:20.821 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:20.821 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:08:20.822 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:20.822 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:20.822 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:20.822 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:20.823 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:20.823 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:20.823 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:20.823 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:20.824 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:20.824 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:20.824 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:20.824 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:20.825 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:20.825 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:20.825 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:20.825 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:20.825 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.826 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:20.826 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:20.826 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:20.826 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:20.827 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:20.827 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:20.827 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:20.828 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:20.828 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:20.828 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:20.828 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:20.829 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:20.829 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:08:20.829 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:08:20.830 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:08:20.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.830 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:20.830 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:20.830 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:08:20.831 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.831 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.831 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:20.831 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.75, 2023-09-13T06:08:20.832 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.75, 2023-09-13T06:08:20.832 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:20.832 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.75, 2023-09-13T06:08:20.832 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.75, 2023-09-13T06:08:20.832 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:20.833 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:20.833 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:20.833 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.834 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 17, 2023-09-13T06:08:20.834 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:08:20.834 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:07:39.032744+0000", 2023-09-13T06:08:20.835 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:08:20.835 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:08:20.835 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:08:20.835 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:08:20.836 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:08:20.836 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:08:20.836 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:08:20.836 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:08:20.836 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:08:20.837 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:08:20.837 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:08:20.837 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:08:20.837 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:08:20.838 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:08:20.838 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:08:20.838 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:08:20.838 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:08:20.838 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:08:20.839 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:08:20.839 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:08:20.839 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:08:20.840 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:08:20.840 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:08:20.840 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:08:20.840 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.841 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "142", 2023-09-13T06:08:20.841 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:08:20.841 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:08:20.841 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:08:20.842 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:08:20.842 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:08:20.842 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:08:20.842 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:08:20.843 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:08:20.843 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:08:20.843 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:08:20.843 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:08:20.844 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:08:20.844 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:08:20.844 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:08:20.844 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:08:20.844 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:08:20.845 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:08:20.845 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:08:20.845 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:08:20.846 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:08:20.846 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:08:20.846 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:08:20.846 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:08:20.847 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:08:20.847 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:08:20.847 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:08:20.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.848 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:08:20.848 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:08:20.848 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:08:20.849 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:08:20.849 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:08:20.849 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:08:20.849 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:08:20.849 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:08:20.850 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:08:20.850 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:08:20.850 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:08:20.850 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:08:20.851 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:08:20.851 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:08:20.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.852 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:08:20.852 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:08:20.852 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:08:20.852 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.853 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.853 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:08:20.853 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.5, 2023-09-13T06:08:20.853 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.5, 2023-09-13T06:08:20.853 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:08:20.854 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.5, 2023-09-13T06:08:20.854 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.5, 2023-09-13T06:08:20.854 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:08:20.854 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:08:20.855 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:08:20.855 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.855 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.855 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:20.856 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:08:20.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.856 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:20.856 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.857 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.857 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.857 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.857 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.857 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.858 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.858 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.858 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.858 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.859 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.859 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.859 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.860 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.860 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:08:20.860 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.861 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.861 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:08:20.861 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.861 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.862 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.862 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.862 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.863 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.863 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.863 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:08:20.863 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.865 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.865 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:08:20.866 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.866 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.866 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.867 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.867 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.867 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.867 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.868 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:08:20.868 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.869 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.869 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:08:20.869 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.869 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.869 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.870 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.870 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.870 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.870 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.871 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.871 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:08:20.871 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.872 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.872 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:08:20.872 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:08:20.872 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.873 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.873 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:08:20.873 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:08:20.874 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:08:20.874 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:08:20.874 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.875 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.875 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.875 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.876 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:20.876 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.876 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.876 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.877 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.877 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.877 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.878 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.878 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.878 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.878 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.879 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.879 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.879 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.880 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.880 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:08:20.880 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.881 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.881 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:08:20.881 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.881 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.881 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.882 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.882 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.883 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.883 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:08:20.883 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.884 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.884 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:08:20.884 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.884 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.885 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.885 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.885 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.886 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.886 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:08:20.886 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.887 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.887 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:08:20.887 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.888 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.888 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.888 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.888 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.889 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.889 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:08:20.889 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.890 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.890 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.890 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.890 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:08:20.891 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:08:20.891 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.891 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.891 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:08:20.892 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:08:20.892 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:08:20.892 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:08:20.892 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.893 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.893 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.893 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.894 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:20.894 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.894 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.894 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.895 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.895 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.895 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.896 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.896 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.896 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 140, 2023-09-13T06:08:20.896 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.897 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.897 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.897 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.898 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.898 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:08:20.898 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.899 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.899 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:08:20.899 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.900 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.900 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.900 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.900 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.900 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.901 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.901 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.901 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:08:20.901 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.902 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.902 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.903 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:08:20.903 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.903 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.903 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.904 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.904 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.905 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.905 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:08:20.905 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.905 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.906 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.906 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:08:20.906 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.907 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.907 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.907 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.907 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.908 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.908 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:08:20.908 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.909 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.909 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:08:20.909 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:08:20.910 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.910 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.910 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:08:20.911 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:08:20.911 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:08:20.911 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:08:20.911 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.912 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.912 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.912 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.913 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.913 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:20.913 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.913 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.913 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.914 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.914 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.914 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.914 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.915 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.915 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.915 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.915 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.916 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.916 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.916 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.916 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.917 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:08:20.917 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.917 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.917 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.918 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:08:20.918 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.918 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.919 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.919 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.919 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.919 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.920 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.920 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:08:20.920 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.921 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.921 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.921 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:08:20.921 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.922 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.922 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.923 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.923 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.923 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.924 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:08:20.924 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.924 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.925 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.925 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:08:20.925 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.925 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.926 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.926 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.926 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.927 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.927 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.927 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:08:20.928 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.928 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.928 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.928 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.928 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:08:20.929 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:08:20.929 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.929 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.930 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:08:20.930 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:08:20.930 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:08:20.930 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:08:20.931 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.931 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.931 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.932 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.932 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:20.932 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.933 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.933 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.933 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.933 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.934 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.934 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.934 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.934 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.935 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.935 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.935 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.935 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.936 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.936 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.936 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:08:20.936 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.937 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.937 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.937 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:08:20.938 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.938 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.938 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.939 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.939 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.939 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.939 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.939 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:08:20.940 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.940 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.941 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:08:20.941 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.941 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.941 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.942 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.942 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.942 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.943 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.943 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:08:20.943 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.943 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.944 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.944 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:08:20.944 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.945 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.945 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.945 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.945 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.945 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.946 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.946 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:08:20.946 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.947 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.947 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.948 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:08:20.948 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:08:20.948 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.948 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.949 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:08:20.949 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:08:20.949 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:08:20.949 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:08:20.949 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.950 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.950 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.950 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.951 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:20.951 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.951 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.951 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.952 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.952 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.952 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.952 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.953 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.953 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 140, 2023-09-13T06:08:20.953 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.953 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.953 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.954 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.954 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.954 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:08:20.955 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.955 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.955 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:08:20.956 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.956 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.956 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.956 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.957 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.957 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.957 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.957 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:08:20.957 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.958 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.958 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:08:20.959 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.959 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.959 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.959 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.960 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.960 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.960 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.960 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:08:20.961 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.961 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.962 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:08:20.962 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.962 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.962 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.963 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.963 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.964 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.964 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:08:20.964 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.965 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.965 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:08:20.965 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:08:20.966 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.966 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.966 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:08:20.967 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:08:20.967 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:08:20.967 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:08:20.967 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.968 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.968 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.968 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.969 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:20.969 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.970 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.970 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.970 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.970 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.971 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.971 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.971 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.971 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.972 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.972 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.972 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.973 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.973 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.973 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:08:20.973 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.974 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.974 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.974 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.974 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:08:20.975 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.975 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.975 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.976 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.976 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.976 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.977 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:08:20.977 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.977 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.978 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:08:20.978 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.978 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.978 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.979 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.979 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.980 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.980 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:08:20.980 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.980 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.981 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.981 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:08:20.981 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.982 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.982 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.982 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:20.982 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.983 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.983 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:08:20.983 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.984 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.984 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:08:20.985 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:08:20.985 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.985 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.985 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.986 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:08:20.986 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:08:20.986 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:08:20.986 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:08:20.986 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:20.987 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:20.987 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:20.987 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.987 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.988 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:20.988 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:08:20.989 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:08:20.989 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:08:20.989 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:08:20.989 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:08:20.990 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:08:20.990 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:08:20.990 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:08:20.990 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 135, 2023-09-13T06:08:20.991 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:08:20.991 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:08:20.991 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:08:20.991 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.992 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.992 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:08:20.993 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.993 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.993 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:08:20.994 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.994 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.994 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.995 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:08:20.995 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.995 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.995 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.995 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:08:20.996 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.996 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.996 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:20.997 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:08:20.997 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.997 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:20.997 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:20.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:20.998 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:08:20.998 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:20.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:20.999 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:20.999 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:08:20.999 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:20.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.000 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.000 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:21.000 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:08:21.000 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:21.001 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:21.001 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:21.001 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.001 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:08:21.001 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:08:21.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.002 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:08:21.002 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:08:21.002 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:21.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.003 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.003 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:08:21.003 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:08:21.003 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:08:21.004 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:21.004 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:21.004 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.004 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:08:21.005 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:08:21.005 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:08:21.005 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:08:21.006 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:08:21.006 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:08:21.006 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:08:21.006 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:21.006 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:21.007 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:21.007 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:08:21.007 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.007 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:08:21.008 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:21.008 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:21.008 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:21.008 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:21.009 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:21.009 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:08:21.009 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:21.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.010 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.010 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:08:21.010 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:21.010 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:21.010 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:21.011 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:21.011 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:21.011 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:08:21.012 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:21.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.012 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:08:21.013 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:21.013 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:21.013 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:21.013 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:21.014 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:21.014 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:08:21.014 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:21.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.015 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:08:21.015 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:21.015 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:21.015 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:21.015 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:21.016 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:21.016 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:08:21.016 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:21.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.017 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:08:21.017 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:21.017 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:21.017 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:21.018 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:21.018 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:21.018 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:08:21.018 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:21.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.019 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:08:21.019 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:21.019 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:21.020 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:21.020 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:21.020 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:21.020 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:08:21.021 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:21.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.021 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:08:21.021 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:21.022 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:21.022 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:21.022 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:21.022 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:21.023 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:08:21.023 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:21.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.023 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.023 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:08:21.024 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:08:21.024 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:08:21.024 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:08:21.024 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:08:21.024 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:08:21.025 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:08:21.025 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:08:21.025 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:21.025 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:21.025 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:08:21.026 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [ 2023-09-13T06:08:21.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.026 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "17.30", 2023-09-13T06:08:21.026 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:08:21.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.027 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:08:21.027 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 5 2023-09-13T06:08:21.027 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:21.027 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:21.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.028 INFO:teuthology.orchestra.run.smithi130.stdout: "pgid": "17.37", 2023-09-13T06:08:21.028 INFO:teuthology.orchestra.run.smithi130.stdout: "mappings": [ 2023-09-13T06:08:21.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:21.028 INFO:teuthology.orchestra.run.smithi130.stdout: "from": 0, 2023-09-13T06:08:21.029 INFO:teuthology.orchestra.run.smithi130.stdout: "to": 2 2023-09-13T06:08:21.029 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:21.029 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:21.029 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:21.030 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:08:21.030 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:08:21.030 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:08:21.030 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:08:21.031 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:08:21.031 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:08:21.031 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:08:21.031 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:08:21.031 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:08:21.032 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:08:21.032 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:08:21.032 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:08:21.032 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:08:21.032 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:21.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:21.033 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:08:21.033 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:08:21.033 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:08:21.033 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:08:21.033 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:08:21.034 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:08:21.034 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:08:21.034 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:08:21.034 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:08:21.034 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:08:21.034 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:08:21.035 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:21.035 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:08:21.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 -- 172.21.15.130:0/3454278057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2bc065b20 msgr2=0x7fd2bc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:21.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2bc065b20 0x7fd2bc067fe0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400a890 tx=0x7fd2d4008040 comp rx=0 tx=0).stop 2023-09-13T06:08:21.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 -- 172.21.15.130:0/3454278057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d815b130 msgr2=0x7fd2d8159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:21.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d815b130 0x7fd2d8159740 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00b0040 tx=0x7fd2d00196b0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 -- 172.21.15.130:0/3454278057 shutdown_connections 2023-09-13T06:08:21.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd2bc065b20 0x7fd2bc067fe0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2d80ce180 0x7fd2d81504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2d815b130 0x7fd2d8159740 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 --2- 172.21.15.130:0/3454278057 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd2d80b04a0 0x7fd2d815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 -- 172.21.15.130:0/3454278057 >> 172.21.15.130:0/3454278057 conn(0x7fd2d8065990 msgr2=0x7fd2d806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:21.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 -- 172.21.15.130:0/3454278057 shutdown_connections 2023-09-13T06:08:21.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:20.779+0000 7fd2dfd74640 1 -- 172.21.15.130:0/3454278057 wait complete. 2023-09-13T06:08:21.039 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:08:21.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f102672c640 1 Processor -- start 2023-09-13T06:08:21.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f102672c640 1 -- start start 2023-09-13T06:08:21.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f102672c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1020146f30 0x7f102015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:21.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f102672c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10200b63c0 con 0x7f10200d1090 2023-09-13T06:08:21.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f102672c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10200d0c20 con 0x7f10200d1750 2023-09-13T06:08:21.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f102672c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102015dea0 con 0x7f1020146f30 2023-09-13T06:08:21.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f101f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f10200d1090 0x7f10200b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40714/0 (socket says 172.21.15.130:40714) 2023-09-13T06:08:21.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f1024cc9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1020146f30 0x7f102015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:21.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f101f7fe640 1 -- 172.21.15.130:0/1708591021 learned_addr learned my addr 172.21.15.130:0/1708591021 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:21.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f1024cc9640 1 -- 172.21.15.130:0/1708591021 >> v1:172.21.15.164:6789/0 conn(0x7f10200d1750 legacy=0x7f1020146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:21.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f1024cc9640 1 -- 172.21.15.130:0/1708591021 >> v1:172.21.15.130:6789/0 conn(0x7f10200d1090 legacy=0x7f10200b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:21.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f1024cc9640 1 -- 172.21.15.130:0/1708591021 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10200b6610 con 0x7f1020146f30 2023-09-13T06:08:21.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.175+0000 7f101effd640 1 -- 172.21.15.130:0/1708591021 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611513433 0 0) 0x7f10200b63c0 con 0x7f10200d1090 2023-09-13T06:08:21.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.179+0000 7f1024cc9640 1 --2- 172.21.15.130:0/1708591021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1020146f30 0x7f102015d960 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f1018009d90 tx=0x7f101801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd26eb5bd7b38fee server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:21.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.179+0000 7f101effd640 1 -- 172.21.15.130:0/1708591021 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10180a5950 con 0x7f1020146f30 2023-09-13T06:08:21.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.179+0000 7f101effd640 1 -- 172.21.15.130:0/1708591021 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10180a5ab0 con 0x7f1020146f30 2023-09-13T06:08:21.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.179+0000 7f101effd640 1 -- 172.21.15.130:0/1708591021 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10180a5e40 con 0x7f1020146f30 2023-09-13T06:08:21.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.179+0000 7f102672c640 1 -- 172.21.15.130:0/1708591021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1020146f30 msgr2=0x7f102015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:21.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.179+0000 7f102672c640 1 --2- 172.21.15.130:0/1708591021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1020146f30 0x7f102015d960 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f1018009d90 tx=0x7f101801c890 comp rx=0 tx=0).stop 2023-09-13T06:08:21.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.179+0000 7f102672c640 1 -- 172.21.15.130:0/1708591021 shutdown_connections 2023-09-13T06:08:21.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.179+0000 7f102672c640 1 --2- 172.21.15.130:0/1708591021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1020146f30 0x7f102015d960 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.179+0000 7f102672c640 1 -- 172.21.15.130:0/1708591021 >> 172.21.15.130:0/1708591021 conn(0x7f102006f170 msgr2=0x7f102006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:21.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.179+0000 7f102672c640 1 -- 172.21.15.130:0/1708591021 shutdown_connections 2023-09-13T06:08:21.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.179+0000 7f102672c640 1 -- 172.21.15.130:0/1708591021 wait complete. 2023-09-13T06:08:21.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f102672c640 1 Processor -- start 2023-09-13T06:08:21.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f102672c640 1 -- start start 2023-09-13T06:08:21.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f102672c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10200d1090 0x7f102013a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:21.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f102672c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10200d1750 0x7f1020158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:21.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f102672c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1020146f30 0x7f1020158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:21.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f102672c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1020140bf0 con 0x7f10200d1090 2023-09-13T06:08:21.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f102672c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1020140ed0 con 0x7f1020146f30 2023-09-13T06:08:21.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f102672c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102013bf40 con 0x7f10200d1750 2023-09-13T06:08:21.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10200d1090 0x7f102013a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:21.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10200d1090 0x7f102013a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45656/0 (socket says 172.21.15.130:45656) 2023-09-13T06:08:21.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101ffff640 1 -- 172.21.15.130:0/2982025536 learned_addr learned my addr 172.21.15.130:0/2982025536 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:21.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101f7fe640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10200d1750 0x7f1020158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:21.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f1024cc9640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1020146f30 0x7f1020158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:21.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101ffff640 1 -- 172.21.15.130:0/2982025536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10200d1750 msgr2=0x7f1020158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:21.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101ffff640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10200d1750 0x7f1020158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101ffff640 1 -- 172.21.15.130:0/2982025536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1020146f30 msgr2=0x7f1020158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:21.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101ffff640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1020146f30 0x7f1020158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101ffff640 1 -- 172.21.15.130:0/2982025536 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1018009a70 con 0x7f10200d1090 2023-09-13T06:08:21.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101f7fe640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10200d1750 0x7f1020158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:21.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101ffff640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10200d1090 0x7f102013a930 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f101000c500 tx=0x7f101000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:21.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101cff9640 1 -- 172.21.15.130:0/2982025536 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1010005220 con 0x7f10200d1090 2023-09-13T06:08:21.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101cff9640 1 -- 172.21.15.130:0/2982025536 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1010005380 con 0x7f10200d1090 2023-09-13T06:08:21.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f102672c640 1 -- 172.21.15.130:0/2982025536 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102013c220 con 0x7f10200d1090 2023-09-13T06:08:21.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f101cff9640 1 -- 172.21.15.130:0/2982025536 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1010007270 con 0x7f10200d1090 2023-09-13T06:08:21.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.183+0000 7f102672c640 1 -- 172.21.15.130:0/2982025536 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102013b380 con 0x7f10200d1090 2023-09-13T06:08:21.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.187+0000 7f102672c640 1 -- 172.21.15.130:0/2982025536 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102013bda0 con 0x7f10200d1090 2023-09-13T06:08:21.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.187+0000 7f101cff9640 1 -- 172.21.15.130:0/2982025536 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f10100073d0 con 0x7f10200d1090 2023-09-13T06:08:21.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.187+0000 7f101cff9640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f100c065b50 0x7f100c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:21.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.187+0000 7f101cff9640 1 -- 172.21.15.130:0/2982025536 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1010082c70 con 0x7f10200d1090 2023-09-13T06:08:21.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.187+0000 7f101f7fe640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f100c065b50 0x7f100c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:21.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.187+0000 7f101f7fe640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f100c065b50 0x7f100c068010 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f102015b610 tx=0x7f1014007c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:21.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.191+0000 7f101cff9640 1 -- 172.21.15.130:0/2982025536 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f102013bda0 con 0x7f10200d1090 2023-09-13T06:08:21.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 -- 172.21.15.130:0/2982025536 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f102013bda0 con 0x7f10200d1090 2023-09-13T06:08:21.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f101cff9640 1 -- 172.21.15.130:0/2982025536 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f102013bda0 con 0x7f10200d1090 2023-09-13T06:08:21.374 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:21.374 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1309237651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1309237651},{"type":"v1","addr":"172.21.15.130:6837","nonce":1309237651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1568650238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1568650238},{"type":"v1","addr":"172.21.15.164:6834","nonce":1568650238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1994572743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1994572743},{"type":"v1","addr":"172.21.15.130:6836","nonce":1994572743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:39.911036+0000","modified":"2023-09-13T06:07:42.935333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7773},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7773":{"gid":7773,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/4146626637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4146626637},{"type":"v1","addr":"172.21.15.164:6835","nonce":4146626637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-09-13T06:08:21.374 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 68 2023-09-13T06:08:21.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 -- 172.21.15.130:0/2982025536 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f100c065b50 msgr2=0x7f100c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:21.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f100c065b50 0x7f100c068010 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f102015b610 tx=0x7f1014007c60 comp rx=0 tx=0).stop 2023-09-13T06:08:21.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 -- 172.21.15.130:0/2982025536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10200d1090 msgr2=0x7f102013a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:21.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10200d1090 0x7f102013a930 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f101000c500 tx=0x7f101000c9c0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 -- 172.21.15.130:0/2982025536 shutdown_connections 2023-09-13T06:08:21.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f100c065b50 0x7f100c068010 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1020146f30 0x7f1020158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10200d1750 0x7f1020158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 --2- 172.21.15.130:0/2982025536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10200d1090 0x7f102013a930 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:21.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 -- 172.21.15.130:0/2982025536 >> 172.21.15.130:0/2982025536 conn(0x7f102006f170 msgr2=0x7f102006fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:21.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 -- 172.21.15.130:0/2982025536 shutdown_connections 2023-09-13T06:08:21.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:21.371+0000 7f102672c640 1 -- 172.21.15.130:0/2982025536 wait complete. 2023-09-13T06:08:21.396 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-09-13T06:08:21.569 INFO:teuthology.orchestra.run.smithi164.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":7773,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":41.001392735000003,"mdsmap_epoch":68,"osdmap_epoch":142,"osdmap_epoch_barrier":139,"uptime":45.943614132} 2023-09-13T06:08:21.570 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 7773, "mdsmap_epoch": 68, "osdmap_epoch": 142, "osdmap_epoch_barrier": 139, "rank_uptime": 41.001392735, "state": "up:active", "uptime": 45.943614132, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:08:21.571 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-13T06:08:21.571 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:08:21.572 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:21.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:21.583 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-09-13T06:08:22.017 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records in 2023-09-13T06:08:22.018 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records out 2023-09-13T06:08:22.018 INFO:teuthology.orchestra.run.smithi130.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.383491 s, 137 MB/s 2023-09-13T06:08:22.019 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:08:22.020 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:08:22.066 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:08:22.128 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:08:22.129 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:08:22.129 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:22.138 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:08:22.139 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:22.192 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:08:22.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.367+0000 7fa81bc48640 1 Processor -- start 2023-09-13T06:08:22.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.367+0000 7fa81bc48640 1 -- start start 2023-09-13T06:08:22.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa81bc48640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa81415d5f0 0x7fa8140cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa81bc48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8140ae170 0x7fa8140cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa81bc48640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8140cce60 con 0x7fa81415d9d0 2023-09-13T06:08:22.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa81bc48640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8140cd140 con 0x7fa81415d5f0 2023-09-13T06:08:22.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa81bc48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140cd420 con 0x7fa8140ae170 2023-09-13T06:08:22.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa81a1e5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa81415d9d0 0x7fa8141591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40716/0 (socket says 172.21.15.130:40716) 2023-09-13T06:08:22.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa81a1e5640 1 -- 172.21.15.130:0/506683788 learned_addr learned my addr 172.21.15.130:0/506683788 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:22.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa8199e4640 1 --2- 172.21.15.130:0/506683788 >> v2:172.21.15.164:3300/0 conn(0x7fa81415d5f0 0x7fa8140cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa8191e3640 1 --2- 172.21.15.130:0/506683788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8140ae170 0x7fa8140cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa8189e2640 1 -- 172.21.15.130:0/506683788 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555025541 0 0) 0x7fa8140cce60 con 0x7fa81415d9d0 2023-09-13T06:08:22.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa8189e2640 1 -- 172.21.15.130:0/506683788 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa800003530 con 0x7fa81415d9d0 2023-09-13T06:08:22.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa8199e4640 1 -- 172.21.15.130:0/506683788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8140ae170 msgr2=0x7fa8140cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:22.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa8199e4640 1 --2- 172.21.15.130:0/506683788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8140ae170 0x7fa8140cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa8189e2640 1 -- 172.21.15.130:0/506683788 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1879155959 0 0) 0x7fa800003530 con 0x7fa81415d9d0 2023-09-13T06:08:22.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa8199e4640 1 -- 172.21.15.130:0/506683788 >> v1:172.21.15.130:6789/0 conn(0x7fa81415d9d0 legacy=0x7fa8141591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.371+0000 7fa8199e4640 1 -- 172.21.15.130:0/506683788 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140cd700 con 0x7fa81415d5f0 2023-09-13T06:08:22.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa8199e4640 1 --2- 172.21.15.130:0/506683788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa81415d5f0 0x7fa8140cc7f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa8100097c0 tx=0x7fa81001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1eeafde12fd8290d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:22.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa8189e2640 1 -- 172.21.15.130:0/506683788 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c001a00 con 0x7fa81415d5f0 2023-09-13T06:08:22.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa8189e2640 1 -- 172.21.15.130:0/506683788 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8100a7050 con 0x7fa81415d5f0 2023-09-13T06:08:22.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa8189e2640 1 -- 172.21.15.130:0/506683788 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100ab620 con 0x7fa81415d5f0 2023-09-13T06:08:22.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa81bc48640 1 -- 172.21.15.130:0/506683788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa81415d5f0 msgr2=0x7fa8140cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa81bc48640 1 --2- 172.21.15.130:0/506683788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa81415d5f0 0x7fa8140cc7f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa8100097c0 tx=0x7fa81001c310 comp rx=0 tx=0).stop 2023-09-13T06:08:22.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa81bc48640 1 -- 172.21.15.130:0/506683788 shutdown_connections 2023-09-13T06:08:22.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa81bc48640 1 --2- 172.21.15.130:0/506683788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8140ae170 0x7fa8140cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa81bc48640 1 --2- 172.21.15.130:0/506683788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa81415d5f0 0x7fa8140cc7f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa81bc48640 1 -- 172.21.15.130:0/506683788 >> 172.21.15.130:0/506683788 conn(0x7fa814065990 msgr2=0x7fa814065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:22.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa81bc48640 1 -- 172.21.15.130:0/506683788 shutdown_connections 2023-09-13T06:08:22.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa81bc48640 1 -- 172.21.15.130:0/506683788 wait complete. 2023-09-13T06:08:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa81bc48640 1 Processor -- start 2023-09-13T06:08:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.375+0000 7fa81bc48640 1 -- start start 2023-09-13T06:08:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa81bc48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8140ae170 0x7fa81414e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa81bc48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa81415d5f0 0x7fa81414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa81bc48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa81415d9d0 0x7fa814151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa81bc48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81415ccb0 con 0x7fa8140ae170 2023-09-13T06:08:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa81bc48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa814153920 con 0x7fa81415d9d0 2023-09-13T06:08:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa81bc48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa814153c00 con 0x7fa81415d5f0 2023-09-13T06:08:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa8199e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8140ae170 0x7fa81414e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa8199e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8140ae170 0x7fa81414e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45660/0 (socket says 172.21.15.130:45660) 2023-09-13T06:08:22.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa8199e4640 1 -- 172.21.15.130:0/3705455451 learned_addr learned my addr 172.21.15.130:0/3705455451 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:22.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa8191e3640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa81415d5f0 0x7fa81414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa81a1e5640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa81415d9d0 0x7fa814151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa8199e4640 1 -- 172.21.15.130:0/3705455451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa81415d5f0 msgr2=0x7fa81414fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa8199e4640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa81415d5f0 0x7fa81414fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa8199e4640 1 -- 172.21.15.130:0/3705455451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa81415d9d0 msgr2=0x7fa814151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa8199e4640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa81415d9d0 0x7fa814151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa8199e4640 1 -- 172.21.15.130:0/3705455451 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810009420 con 0x7fa8140ae170 2023-09-13T06:08:22.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa81a1e5640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa81415d9d0 0x7fa814151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:22.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa8199e4640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8140ae170 0x7fa81414e190 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fa8100ae040 tx=0x7fa81001ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:22.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa80a7fc640 1 -- 172.21.15.130:0/3705455451 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100b7650 con 0x7fa8140ae170 2023-09-13T06:08:22.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa80a7fc640 1 -- 172.21.15.130:0/3705455451 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8100b77d0 con 0x7fa8140ae170 2023-09-13T06:08:22.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa80a7fc640 1 -- 172.21.15.130:0/3705455451 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100b7b80 con 0x7fa8140ae170 2023-09-13T06:08:22.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa81bc48640 1 -- 172.21.15.130:0/3705455451 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa814159e10 con 0x7fa8140ae170 2023-09-13T06:08:22.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa81bc48640 1 -- 172.21.15.130:0/3705455451 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81414e6d0 con 0x7fa8140ae170 2023-09-13T06:08:22.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa81bc48640 1 -- 172.21.15.130:0/3705455451 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8140618a0 con 0x7fa8140ae170 2023-09-13T06:08:22.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.379+0000 7fa80a7fc640 1 -- 172.21.15.130:0/3705455451 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa8100b7ce0 con 0x7fa8140ae170 2023-09-13T06:08:22.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.383+0000 7fa80a7fc640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa7f8065b20 0x7fa7f8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.383+0000 7fa80a7fc640 1 -- 172.21.15.130:0/3705455451 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa81011dbf0 con 0x7fa8140ae170 2023-09-13T06:08:22.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.383+0000 7fa8191e3640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa7f8065b20 0x7fa7f8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.383+0000 7fa8191e3640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa7f8065b20 0x7fa7f8067fe0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa81415be00 tx=0x7fa804009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:22.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.387+0000 7fa80a7fc640 1 -- 172.21.15.130:0/3705455451 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa8100eb500 con 0x7fa8140ae170 2023-09-13T06:08:22.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.535+0000 7fa81bc48640 1 -- 172.21.15.130:0/3705455451 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8141594c0 con 0x7fa8140ae170 2023-09-13T06:08:22.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa80a7fc640 1 -- 172.21.15.130:0/3705455451 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16665 (secure 0 0 0) 0x7fa8100eeb20 con 0x7fa8140ae170 2023-09-13T06:08:22.541 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:22.541 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":142,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:08:17.386149+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:38.276233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:39.032744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:08:22.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 -- 172.21.15.130:0/3705455451 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa7f8065b20 msgr2=0x7fa7f8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa7f8065b20 0x7fa7f8067fe0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa81415be00 tx=0x7fa804009190 comp rx=0 tx=0).stop 2023-09-13T06:08:22.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 -- 172.21.15.130:0/3705455451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8140ae170 msgr2=0x7fa81414e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8140ae170 0x7fa81414e190 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fa8100ae040 tx=0x7fa81001ab50 comp rx=0 tx=0).stop 2023-09-13T06:08:22.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 -- 172.21.15.130:0/3705455451 shutdown_connections 2023-09-13T06:08:22.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa7f8065b20 0x7fa7f8067fe0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa81415d9d0 0x7fa814151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa81415d5f0 0x7fa81414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 --2- 172.21.15.130:0/3705455451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8140ae170 0x7fa81414e190 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 -- 172.21.15.130:0/3705455451 >> 172.21.15.130:0/3705455451 conn(0x7fa814065990 msgr2=0x7fa8140709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:22.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 -- 172.21.15.130:0/3705455451 shutdown_connections 2023-09-13T06:08:22.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.539+0000 7fa81bc48640 1 -- 172.21.15.130:0/3705455451 wait complete. 2023-09-13T06:08:22.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:07:38.276233+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:07:39.032744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:08:22.562 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:08:22.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f230692c640 1 Processor -- start 2023-09-13T06:08:22.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f230692c640 1 -- start start 2023-09-13T06:08:22.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f230692c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f230015a080 0x7f23000b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f230692c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f230015e650 0x7f23000b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f230692c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23000cc850 con 0x7f23000b2fd0 2023-09-13T06:08:22.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f230692c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23000b3420 con 0x7f230015e650 2023-09-13T06:08:22.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f230692c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23000b0330 con 0x7f230015a080 2023-09-13T06:08:22.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f2304ec9640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f23000b2fd0 0x7f23000ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40722/0 (socket says 172.21.15.130:40722) 2023-09-13T06:08:22.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f2304ec9640 1 -- 172.21.15.130:0/3199103976 learned_addr learned my addr 172.21.15.130:0/3199103976 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:22.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f22fffff640 1 --2- 172.21.15.130:0/3199103976 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f230015a080 0x7f23000b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f22ff7fe640 1 --2- 172.21.15.130:0/3199103976 >> v2:172.21.15.164:3300/0 conn(0x7f230015e650 0x7f23000b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f22feffd640 1 -- 172.21.15.130:0/3199103976 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132891472 0 0) 0x7f22f80014a0 con 0x7f23000b2fd0 2023-09-13T06:08:22.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f22feffd640 1 -- 172.21.15.130:0/3199103976 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e8005740 con 0x7f23000b2fd0 2023-09-13T06:08:22.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f22ff7fe640 1 -- 172.21.15.130:0/3199103976 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f230015a080 msgr2=0x7f23000b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:22.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f22ff7fe640 1 --2- 172.21.15.130:0/3199103976 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f230015a080 0x7f23000b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f22ff7fe640 1 -- 172.21.15.130:0/3199103976 >> v1:172.21.15.130:6789/0 conn(0x7f23000b2fd0 legacy=0x7f23000ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f22feffd640 1 -- 172.21.15.130:0/3199103976 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1743152313 0 0) 0x7f22e8005740 con 0x7f23000b2fd0 2023-09-13T06:08:22.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.703+0000 7f22ff7fe640 1 -- 172.21.15.130:0/3199103976 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23000cbcd0 con 0x7f230015e650 2023-09-13T06:08:22.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f22ff7fe640 1 --2- 172.21.15.130:0/3199103976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f230015e650 0x7f23000b2a90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f22f40097c0 tx=0x7f22f401c2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84ecd0481b0b60b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:22.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f22feffd640 1 -- 172.21.15.130:0/3199103976 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8001b90 con 0x7f230015e650 2023-09-13T06:08:22.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f22feffd640 1 -- 172.21.15.130:0/3199103976 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f40a7050 con 0x7f230015e650 2023-09-13T06:08:22.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f22feffd640 1 -- 172.21.15.130:0/3199103976 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f40ab620 con 0x7f230015e650 2023-09-13T06:08:22.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f230692c640 1 -- 172.21.15.130:0/3199103976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f230015e650 msgr2=0x7f23000b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f230692c640 1 --2- 172.21.15.130:0/3199103976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f230015e650 0x7f23000b2a90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f22f40097c0 tx=0x7f22f401c2b0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f230692c640 1 -- 172.21.15.130:0/3199103976 shutdown_connections 2023-09-13T06:08:22.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f230692c640 1 --2- 172.21.15.130:0/3199103976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f230015e650 0x7f23000b2a90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f230692c640 1 --2- 172.21.15.130:0/3199103976 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f230015a080 0x7f23000b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f230692c640 1 -- 172.21.15.130:0/3199103976 >> 172.21.15.130:0/3199103976 conn(0x7f2300065990 msgr2=0x7f2300065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f230692c640 1 -- 172.21.15.130:0/3199103976 shutdown_connections 2023-09-13T06:08:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.707+0000 7f230692c640 1 -- 172.21.15.130:0/3199103976 wait complete. 2023-09-13T06:08:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f230692c640 1 Processor -- start 2023-09-13T06:08:22.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f230692c640 1 -- start start 2023-09-13T06:08:22.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f230692c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23000b2fd0 0x7f2300156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f230692c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f230015a080 0x7f230006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f230692c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f230015e650 0x7f230006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f230692c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230006c850 con 0x7f230015a080 2023-09-13T06:08:22.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f230692c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230006bc40 con 0x7f230015e650 2023-09-13T06:08:22.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f230692c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230006bf20 con 0x7f23000b2fd0 2023-09-13T06:08:22.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22ff7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f230015a080 0x7f230006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22ff7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f230015a080 0x7f230006cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45664/0 (socket says 172.21.15.130:45664) 2023-09-13T06:08:22.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22ff7fe640 1 -- 172.21.15.130:0/545623803 learned_addr learned my addr 172.21.15.130:0/545623803 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:22.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22fffff640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23000b2fd0 0x7f2300156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f2304ec9640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f230015e650 0x7f230006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22ff7fe640 1 -- 172.21.15.130:0/545623803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23000b2fd0 msgr2=0x7f2300156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22ff7fe640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23000b2fd0 0x7f2300156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22ff7fe640 1 -- 172.21.15.130:0/545623803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f230015e650 msgr2=0x7f230006ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22ff7fe640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f230015e650 0x7f230006ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22ff7fe640 1 -- 172.21.15.130:0/545623803 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4009420 con 0x7f230015a080 2023-09-13T06:08:22.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22ff7fe640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f230015a080 0x7f230006cce0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f22f401cb50 tx=0x7f22f4019050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:22.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22fcff9640 1 -- 172.21.15.130:0/545623803 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f40b4400 con 0x7f230015a080 2023-09-13T06:08:22.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22fcff9640 1 -- 172.21.15.130:0/545623803 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f40b4580 con 0x7f230015a080 2023-09-13T06:08:22.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f22fcff9640 1 -- 172.21.15.130:0/545623803 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f40b4930 con 0x7f230015a080 2023-09-13T06:08:22.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f230692c640 1 -- 172.21.15.130:0/545623803 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230006c200 con 0x7f230015a080 2023-09-13T06:08:22.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f230692c640 1 -- 172.21.15.130:0/545623803 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2300156a70 con 0x7f230015a080 2023-09-13T06:08:22.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.711+0000 7f230692c640 1 -- 172.21.15.130:0/545623803 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230006c9c0 con 0x7f230015a080 2023-09-13T06:08:22.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.715+0000 7f22fcff9640 1 -- 172.21.15.130:0/545623803 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f22f40b2040 con 0x7f230015a080 2023-09-13T06:08:22.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.715+0000 7f22fcff9640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22ec065b50 0x7f22ec068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:22.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.715+0000 7f22fcff9640 1 -- 172.21.15.130:0/545623803 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f22f411d0e0 con 0x7f230015a080 2023-09-13T06:08:22.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.715+0000 7f22fffff640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22ec065b50 0x7f22ec068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:22.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.715+0000 7f22fffff640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22ec065b50 0x7f22ec068010 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009b60 tx=0x7f22f0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:22.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.719+0000 7f22fcff9640 1 -- 172.21.15.130:0/545623803 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f22f40eaa00 con 0x7f230015a080 2023-09-13T06:08:22.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f230692c640 1 -- 172.21.15.130:0/545623803 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23000618a0 con 0x7f230015a080 2023-09-13T06:08:22.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f22fcff9640 1 -- 172.21.15.130:0/545623803 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22f40b00a0 con 0x7f230015a080 2023-09-13T06:08:22.870 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:08:22.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f230692c640 1 -- 172.21.15.130:0/545623803 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22ec065b50 msgr2=0x7f22ec068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f230692c640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22ec065b50 0x7f22ec068010 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009b60 tx=0x7f22f0009190 comp rx=0 tx=0).stop 2023-09-13T06:08:22.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f230692c640 1 -- 172.21.15.130:0/545623803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f230015a080 msgr2=0x7f230006cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:22.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f230692c640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f230015a080 0x7f230006cce0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f22f401cb50 tx=0x7f22f4019050 comp rx=0 tx=0).stop 2023-09-13T06:08:22.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f230692c640 1 -- 172.21.15.130:0/545623803 shutdown_connections 2023-09-13T06:08:22.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f230692c640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22ec065b50 0x7f22ec068010 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f230692c640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f230015e650 0x7f230006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f230692c640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f230015a080 0x7f230006cce0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f230692c640 1 --2- 172.21.15.130:0/545623803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23000b2fd0 0x7f2300156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:22.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.867+0000 7f230692c640 1 -- 172.21.15.130:0/545623803 >> 172.21.15.130:0/545623803 conn(0x7f2300065990 msgr2=0x7f230015d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:22.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.871+0000 7f230692c640 1 -- 172.21.15.130:0/545623803 shutdown_connections 2023-09-13T06:08:22.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:22.871+0000 7f230692c640 1 -- 172.21.15.130:0/545623803 wait complete. 2023-09-13T06:08:22.891 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:08:23.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bbde6d640 1 Processor -- start 2023-09-13T06:08:23.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bbde6d640 1 -- start start 2023-09-13T06:08:23.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bbde6d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0bb815a080 0x7f0bb80b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bbde6d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb80cc850 con 0x7f0bb80b31a0 2023-09-13T06:08:23.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bbde6d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb80b0330 con 0x7f0bb815e650 2023-09-13T06:08:23.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bbde6d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb80cbcd0 con 0x7f0bb815a080 2023-09-13T06:08:23.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bb7fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0bb80b31a0 0x7f0bb80ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40724/0 (socket says 172.21.15.130:40724) 2023-09-13T06:08:23.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bb7fff640 1 -- 172.21.15.130:0/2304483229 learned_addr learned my addr 172.21.15.130:0/2304483229 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:23.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bb77fe640 1 --2- 172.21.15.130:0/2304483229 >> v2:172.21.15.164:3300/0 conn(0x7f0bb815a080 0x7f0bb80b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bb6ffd640 1 -- 172.21.15.130:0/2304483229 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516067228 0 0) 0x7f0bb00014a0 con 0x7f0bb80b31a0 2023-09-13T06:08:23.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bb6ffd640 1 -- 172.21.15.130:0/2304483229 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba4003530 con 0x7f0bb80b31a0 2023-09-13T06:08:23.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bb6ffd640 1 -- 172.21.15.130:0/2304483229 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373206147 0 0) 0x7f0bb80b0330 con 0x7f0bb815e650 2023-09-13T06:08:23.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bb6ffd640 1 -- 172.21.15.130:0/2304483229 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb00014a0 con 0x7f0bb815e650 2023-09-13T06:08:23.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bb77fe640 1 -- 172.21.15.130:0/2304483229 >> v1:172.21.15.164:6789/0 conn(0x7f0bb815e650 legacy=0x7f0bb80b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bb77fe640 1 -- 172.21.15.130:0/2304483229 >> v1:172.21.15.130:6789/0 conn(0x7f0bb80b31a0 legacy=0x7f0bb80ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.031+0000 7f0bb77fe640 1 -- 172.21.15.130:0/2304483229 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb80cbfb0 con 0x7f0bb815a080 2023-09-13T06:08:23.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.035+0000 7f0bb77fe640 1 --2- 172.21.15.130:0/2304483229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bb815a080 0x7f0bb80b1460 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80097c0 tx=0x7f0ba801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=230be6a93879cf19 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:23.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.035+0000 7f0bb6ffd640 1 -- 172.21.15.130:0/2304483229 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80ab600 con 0x7f0bb815a080 2023-09-13T06:08:23.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.035+0000 7f0bb6ffd640 1 -- 172.21.15.130:0/2304483229 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba80a7050 con 0x7f0bb815a080 2023-09-13T06:08:23.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.035+0000 7f0bb6ffd640 1 -- 172.21.15.130:0/2304483229 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80ab980 con 0x7f0bb815a080 2023-09-13T06:08:23.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.035+0000 7f0bbde6d640 1 -- 172.21.15.130:0/2304483229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bb815a080 msgr2=0x7f0bb80b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.035+0000 7f0bbde6d640 1 --2- 172.21.15.130:0/2304483229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bb815a080 0x7f0bb80b1460 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80097c0 tx=0x7f0ba801c390 comp rx=0 tx=0).stop 2023-09-13T06:08:23.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.035+0000 7f0bbde6d640 1 -- 172.21.15.130:0/2304483229 shutdown_connections 2023-09-13T06:08:23.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.035+0000 7f0bbde6d640 1 --2- 172.21.15.130:0/2304483229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bb815a080 0x7f0bb80b1460 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.035+0000 7f0bbde6d640 1 -- 172.21.15.130:0/2304483229 >> 172.21.15.130:0/2304483229 conn(0x7f0bb8065990 msgr2=0x7f0bb8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:23.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.035+0000 7f0bbde6d640 1 -- 172.21.15.130:0/2304483229 shutdown_connections 2023-09-13T06:08:23.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.035+0000 7f0bbde6d640 1 -- 172.21.15.130:0/2304483229 wait complete. 2023-09-13T06:08:23.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bbde6d640 1 Processor -- start 2023-09-13T06:08:23.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bbde6d640 1 -- start start 2023-09-13T06:08:23.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bbde6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bb80b31a0 0x7f0bb81f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bbde6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bb815a080 0x7f0bb814a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bbde6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bb815e650 0x7f0bb814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bbde6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb814f200 con 0x7f0bb815e650 2023-09-13T06:08:23.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bbde6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb814e580 con 0x7f0bb815a080 2023-09-13T06:08:23.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bbde6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb814e860 con 0x7f0bb80b31a0 2023-09-13T06:08:23.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb77fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bb80b31a0 0x7f0bb81f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bb815e650 0x7f0bb814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb77fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bb80b31a0 0x7f0bb81f5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:47018/0 (socket says 172.21.15.130:47018) 2023-09-13T06:08:23.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb77fe640 1 -- 172.21.15.130:0/3167065026 learned_addr learned my addr 172.21.15.130:0/3167065026 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:23.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0baffff640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bb815a080 0x7f0bb814a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb77fe640 1 -- 172.21.15.130:0/3167065026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bb815a080 msgr2=0x7f0bb814a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb77fe640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bb815a080 0x7f0bb814a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb77fe640 1 -- 172.21.15.130:0/3167065026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bb815e650 msgr2=0x7f0bb814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb77fe640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bb815e650 0x7f0bb814ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb77fe640 1 -- 172.21.15.130:0/3167065026 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba8009420 con 0x7f0bb80b31a0 2023-09-13T06:08:23.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb77fe640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bb80b31a0 0x7f0bb81f5e90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80ae040 tx=0x7f0ba801abd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:23.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb4ff9640 1 -- 172.21.15.130:0/3167065026 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80b7450 con 0x7f0bb80b31a0 2023-09-13T06:08:23.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb4ff9640 1 -- 172.21.15.130:0/3167065026 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba80b75d0 con 0x7f0bb80b31a0 2023-09-13T06:08:23.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bbde6d640 1 -- 172.21.15.130:0/3167065026 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb814eb40 con 0x7f0bb80b31a0 2023-09-13T06:08:23.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bb4ff9640 1 -- 172.21.15.130:0/3167065026 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80b7980 con 0x7f0bb80b31a0 2023-09-13T06:08:23.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.039+0000 7f0bbde6d640 1 -- 172.21.15.130:0/3167065026 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb814e250 con 0x7f0bb80b31a0 2023-09-13T06:08:23.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.043+0000 7f0bbde6d640 1 -- 172.21.15.130:0/3167065026 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb815ea60 con 0x7f0bb80b31a0 2023-09-13T06:08:23.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.043+0000 7f0bb4ff9640 1 -- 172.21.15.130:0/3167065026 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0ba80b7ae0 con 0x7f0bb80b31a0 2023-09-13T06:08:23.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.043+0000 7f0bb4ff9640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b98065b20 0x7f0b98067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.043+0000 7f0bb4ff9640 1 -- 172.21.15.130:0/3167065026 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0ba811d9a0 con 0x7f0bb80b31a0 2023-09-13T06:08:23.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.043+0000 7f0baffff640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b98065b20 0x7f0b98067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.043+0000 7f0baffff640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b98065b20 0x7f0b98067fe0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0bb814a190 tx=0x7f0ba0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:23.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.047+0000 7f0bb4ff9640 1 -- 172.21.15.130:0/3167065026 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0bb815ea60 con 0x7f0bb80b31a0 2023-09-13T06:08:23.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.195+0000 7f0bbde6d640 1 -- 172.21.15.130:0/3167065026 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0bb815ea60 con 0x7f0bb80b31a0 2023-09-13T06:08:23.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bb4ff9640 1 -- 172.21.15.130:0/3167065026 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v142) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0bb815ea60 con 0x7f0bb80b31a0 2023-09-13T06:08:23.200 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:08:23.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 -- 172.21.15.130:0/3167065026 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b98065b20 msgr2=0x7f0b98067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b98065b20 0x7f0b98067fe0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0bb814a190 tx=0x7f0ba0009040 comp rx=0 tx=0).stop 2023-09-13T06:08:23.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 -- 172.21.15.130:0/3167065026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bb80b31a0 msgr2=0x7f0bb81f5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bb80b31a0 0x7f0bb81f5e90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80ae040 tx=0x7f0ba801abd0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 -- 172.21.15.130:0/3167065026 shutdown_connections 2023-09-13T06:08:23.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b98065b20 0x7f0b98067fe0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bb815a080 0x7f0bb814a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0bb815e650 0x7f0bb814ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 --2- 172.21.15.130:0/3167065026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0bb80b31a0 0x7f0bb81f5e90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 -- 172.21.15.130:0/3167065026 >> 172.21.15.130:0/3167065026 conn(0x7f0bb8065990 msgr2=0x7f0bb80ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:23.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 -- 172.21.15.130:0/3167065026 shutdown_connections 2023-09-13T06:08:23.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.199+0000 7f0bbde6d640 1 -- 172.21.15.130:0/3167065026 wait complete. 2023-09-13T06:08:23.221 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:08:23.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.359+0000 7f41e6382640 1 Processor -- start 2023-09-13T06:08:23.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.359+0000 7f41e6382640 1 -- start start 2023-09-13T06:08:23.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.359+0000 7f41e6382640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f41e00cca50 0x7f41e00ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.359+0000 7f41e6382640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f41e00ce6c0 0x7f41e0161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.359+0000 7f41e6382640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e00b2620 con 0x7f41e01617f0 2023-09-13T06:08:23.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.359+0000 7f41e6382640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e00b1a80 con 0x7f41e00ce6c0 2023-09-13T06:08:23.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.359+0000 7f41e6382640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e00b2ab0 con 0x7f41e00cca50 2023-09-13T06:08:23.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.359+0000 7f41e491f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f41e00ce6c0 0x7f41e0161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.359+0000 7f41e491f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f41e00ce6c0 0x7f41e0161bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45678/0 (socket says 172.21.15.130:45678) 2023-09-13T06:08:23.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.359+0000 7f41e491f640 1 -- 172.21.15.130:0/1276604098 learned_addr learned my addr 172.21.15.130:0/1276604098 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:23.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41df7fe640 1 --2- 172.21.15.130:0/1276604098 >> v2:172.21.15.164:3300/0 conn(0x7f41e00cca50 0x7f41e00ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41e491f640 1 -- 172.21.15.130:0/1276604098 >> v2:172.21.15.164:3300/0 conn(0x7f41e00cca50 msgr2=0x7f41e00ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:23.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41e491f640 1 --2- 172.21.15.130:0/1276604098 >> v2:172.21.15.164:3300/0 conn(0x7f41e00cca50 0x7f41e00ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41e491f640 1 -- 172.21.15.130:0/1276604098 >> v1:172.21.15.164:6789/0 conn(0x7f41e01617f0 legacy=0x7f41e00cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41e491f640 1 -- 172.21.15.130:0/1276604098 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00b1cf0 con 0x7f41e00ce6c0 2023-09-13T06:08:23.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41e491f640 1 --2- 172.21.15.130:0/1276604098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e00ce6c0 0x7f41e0161bd0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f41e00ceeb0 tx=0x7f41d801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd93261db910529 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:23.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41deffd640 1 -- 172.21.15.130:0/1276604098 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80a5860 con 0x7f41e00ce6c0 2023-09-13T06:08:23.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41deffd640 1 -- 172.21.15.130:0/1276604098 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d80a59c0 con 0x7f41e00ce6c0 2023-09-13T06:08:23.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41deffd640 1 -- 172.21.15.130:0/1276604098 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80a5d50 con 0x7f41e00ce6c0 2023-09-13T06:08:23.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41e6382640 1 -- 172.21.15.130:0/1276604098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e00ce6c0 msgr2=0x7f41e0161bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41e6382640 1 --2- 172.21.15.130:0/1276604098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e00ce6c0 0x7f41e0161bd0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f41e00ceeb0 tx=0x7f41d801c9a0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41e6382640 1 -- 172.21.15.130:0/1276604098 shutdown_connections 2023-09-13T06:08:23.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41e6382640 1 --2- 172.21.15.130:0/1276604098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e00ce6c0 0x7f41e0161bd0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.363+0000 7f41e6382640 1 --2- 172.21.15.130:0/1276604098 >> v2:172.21.15.164:3300/0 conn(0x7f41e00cca50 0x7f41e00ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e6382640 1 -- 172.21.15.130:0/1276604098 >> 172.21.15.130:0/1276604098 conn(0x7f41e0065990 msgr2=0x7f41e0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:23.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e6382640 1 -- 172.21.15.130:0/1276604098 shutdown_connections 2023-09-13T06:08:23.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e6382640 1 -- 172.21.15.130:0/1276604098 wait complete. 2023-09-13T06:08:23.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e6382640 1 Processor -- start 2023-09-13T06:08:23.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e6382640 1 -- start start 2023-09-13T06:08:23.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e6382640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e00cca50 0x7f41e0154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e6382640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41e00ce6c0 0x7f41e006b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e6382640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41e01617f0 0x7f41e006cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e6382640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0153f30 con 0x7f41e00cca50 2023-09-13T06:08:23.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e6382640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e006b880 con 0x7f41e00ce6c0 2023-09-13T06:08:23.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e6382640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e006d090 con 0x7f41e01617f0 2023-09-13T06:08:23.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41dffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e00cca50 0x7f41e0154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41dffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e00cca50 0x7f41e0154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45692/0 (socket says 172.21.15.130:45692) 2023-09-13T06:08:23.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41dffff640 1 -- 172.21.15.130:0/2207069677 learned_addr learned my addr 172.21.15.130:0/2207069677 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:23.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41df7fe640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41e00ce6c0 0x7f41e006b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41e491f640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41e01617f0 0x7f41e006cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41dffff640 1 -- 172.21.15.130:0/2207069677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41e01617f0 msgr2=0x7f41e006cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41dffff640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41e01617f0 0x7f41e006cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41dffff640 1 -- 172.21.15.130:0/2207069677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41e00ce6c0 msgr2=0x7f41e006b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41dffff640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41e00ce6c0 0x7f41e006b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41dffff640 1 -- 172.21.15.130:0/2207069677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009b30 con 0x7f41e00cca50 2023-09-13T06:08:23.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.367+0000 7f41dffff640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e00cca50 0x7f41e0154a90 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c3c0 tx=0x7f41d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:23.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.371+0000 7f41dcff9640 1 -- 172.21.15.130:0/2207069677 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d00052d0 con 0x7f41e00cca50 2023-09-13T06:08:23.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.371+0000 7f41dcff9640 1 -- 172.21.15.130:0/2207069677 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0005430 con 0x7f41e00cca50 2023-09-13T06:08:23.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.371+0000 7f41e6382640 1 -- 172.21.15.130:0/2207069677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e006bab0 con 0x7f41e00cca50 2023-09-13T06:08:23.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.371+0000 7f41dcff9640 1 -- 172.21.15.130:0/2207069677 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0003840 con 0x7f41e00cca50 2023-09-13T06:08:23.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.371+0000 7f41e6382640 1 -- 172.21.15.130:0/2207069677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e006c070 con 0x7f41e00cca50 2023-09-13T06:08:23.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.371+0000 7f41e6382640 1 -- 172.21.15.130:0/2207069677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e00618a0 con 0x7f41e00cca50 2023-09-13T06:08:23.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.371+0000 7f41dcff9640 1 -- 172.21.15.130:0/2207069677 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f41d00039a0 con 0x7f41e00cca50 2023-09-13T06:08:23.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.371+0000 7f41dcff9640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f41cc065b50 0x7f41cc068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.371+0000 7f41dcff9640 1 -- 172.21.15.130:0/2207069677 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f41d0082780 con 0x7f41e00cca50 2023-09-13T06:08:23.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.371+0000 7f41df7fe640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f41cc065b50 0x7f41cc068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.371+0000 7f41df7fe640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f41cc065b50 0x7f41cc068010 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f41e0154fd0 tx=0x7f41d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:23.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.375+0000 7f41dcff9640 1 -- 172.21.15.130:0/2207069677 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f41d0050130 con 0x7f41e00cca50 2023-09-13T06:08:23.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41e6382640 1 -- 172.21.15.130:0/2207069677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41e00b05a0 con 0x7f41e00cca50 2023-09-13T06:08:23.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41dcff9640 1 -- 172.21.15.130:0/2207069677 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v142) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41d0017020 con 0x7f41e00cca50 2023-09-13T06:08:23.531 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:08:23.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41e6382640 1 -- 172.21.15.130:0/2207069677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f41cc065b50 msgr2=0x7f41cc068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41e6382640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f41cc065b50 0x7f41cc068010 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f41e0154fd0 tx=0x7f41d4008040 comp rx=0 tx=0).stop 2023-09-13T06:08:23.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41e6382640 1 -- 172.21.15.130:0/2207069677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e00cca50 msgr2=0x7f41e0154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41e6382640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e00cca50 0x7f41e0154a90 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c3c0 tx=0x7f41d000c880 comp rx=0 tx=0).stop 2023-09-13T06:08:23.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41e6382640 1 -- 172.21.15.130:0/2207069677 shutdown_connections 2023-09-13T06:08:23.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41e6382640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f41cc065b50 0x7f41cc068010 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41e6382640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41e00ce6c0 0x7f41e006b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41e6382640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41e01617f0 0x7f41e006cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41e6382640 1 --2- 172.21.15.130:0/2207069677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e00cca50 0x7f41e0154a90 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.527+0000 7f41e6382640 1 -- 172.21.15.130:0/2207069677 >> 172.21.15.130:0/2207069677 conn(0x7f41e0065990 msgr2=0x7f41e015b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:23.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.531+0000 7f41e6382640 1 -- 172.21.15.130:0/2207069677 shutdown_connections 2023-09-13T06:08:23.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.531+0000 7f41e6382640 1 -- 172.21.15.130:0/2207069677 wait complete. 2023-09-13T06:08:23.551 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:08:23.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa630419640 1 Processor -- start 2023-09-13T06:08:23.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa630419640 1 -- start start 2023-09-13T06:08:23.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa630419640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6280cc780 0x7fa62815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa630419640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa6280b04a0 0x7fa6280b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa630419640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6280ccbe0 con 0x7fa62815b130 2023-09-13T06:08:23.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa630419640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6280b0e70 con 0x7fa6280b04a0 2023-09-13T06:08:23.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa630419640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280ce980 con 0x7fa6280cc780 2023-09-13T06:08:23.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa62e9b6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa6280b04a0 0x7fa6280b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa62e9b6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa6280b04a0 0x7fa6280b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:40396/0 (socket says 172.21.15.130:40396) 2023-09-13T06:08:23.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa62e9b6640 1 -- 172.21.15.130:0/4065651999 learned_addr learned my addr 172.21.15.130:0/4065651999 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:23.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa62d9b4640 1 --2- 172.21.15.130:0/4065651999 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6280cc780 0x7fa62815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa62d1b3640 1 -- 172.21.15.130:0/4065651999 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546011842 0 0) 0x7fa6280ccbe0 con 0x7fa62815b130 2023-09-13T06:08:23.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa62d1b3640 1 -- 172.21.15.130:0/4065651999 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa614003530 con 0x7fa62815b130 2023-09-13T06:08:23.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa62e9b6640 1 -- 172.21.15.130:0/4065651999 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6280cc780 msgr2=0x7fa62815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:23.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa62e9b6640 1 --2- 172.21.15.130:0/4065651999 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6280cc780 0x7fa62815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa62e9b6640 1 -- 172.21.15.130:0/4065651999 >> v1:172.21.15.164:6789/0 conn(0x7fa62815b130 legacy=0x7fa6280ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.691+0000 7fa62e9b6640 1 -- 172.21.15.130:0/4065651999 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6280cec60 con 0x7fa6280b04a0 2023-09-13T06:08:23.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa62e9b6640 1 --2- 172.21.15.130:0/4065651999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6280b04a0 0x7fa6280b0930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa620009e50 tx=0x7fa62001c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16d245e5328cfde7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:23.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa62d1b3640 1 -- 172.21.15.130:0/4065651999 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200a58a0 con 0x7fa6280b04a0 2023-09-13T06:08:23.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa62d1b3640 1 -- 172.21.15.130:0/4065651999 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6200a5a00 con 0x7fa6280b04a0 2023-09-13T06:08:23.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa62d1b3640 1 -- 172.21.15.130:0/4065651999 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200a5d90 con 0x7fa6280b04a0 2023-09-13T06:08:23.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa630419640 1 -- 172.21.15.130:0/4065651999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6280b04a0 msgr2=0x7fa6280b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa630419640 1 --2- 172.21.15.130:0/4065651999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6280b04a0 0x7fa6280b0930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa620009e50 tx=0x7fa62001c9e0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa630419640 1 -- 172.21.15.130:0/4065651999 shutdown_connections 2023-09-13T06:08:23.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa630419640 1 --2- 172.21.15.130:0/4065651999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6280b04a0 0x7fa6280b0930 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa630419640 1 --2- 172.21.15.130:0/4065651999 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa6280cc780 0x7fa62815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa630419640 1 -- 172.21.15.130:0/4065651999 >> 172.21.15.130:0/4065651999 conn(0x7fa628065990 msgr2=0x7fa628065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:23.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa630419640 1 -- 172.21.15.130:0/4065651999 shutdown_connections 2023-09-13T06:08:23.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.695+0000 7fa630419640 1 -- 172.21.15.130:0/4065651999 wait complete. 2023-09-13T06:08:23.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa630419640 1 Processor -- start 2023-09-13T06:08:23.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa630419640 1 -- start start 2023-09-13T06:08:23.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa630419640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6280b04a0 0x7fa628153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa630419640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6280cc780 0x7fa6280af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa630419640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa62815b130 0x7fa6281515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa630419640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa628153aa0 con 0x7fa6280b04a0 2023-09-13T06:08:23.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa630419640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa628153fd0 con 0x7fa6280cc780 2023-09-13T06:08:23.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa630419640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6281542b0 con 0x7fa62815b130 2023-09-13T06:08:23.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa62e1b5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6280b04a0 0x7fa628153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa62e1b5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6280b04a0 0x7fa628153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45702/0 (socket says 172.21.15.130:45702) 2023-09-13T06:08:23.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa62e1b5640 1 -- 172.21.15.130:0/1320390253 learned_addr learned my addr 172.21.15.130:0/1320390253 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:23.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa62d9b4640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6280cc780 0x7fa6280af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa62e1b5640 1 -- 172.21.15.130:0/1320390253 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa62815b130 msgr2=0x7fa6281515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa62e1b5640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa62815b130 0x7fa6281515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa62e1b5640 1 -- 172.21.15.130:0/1320390253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6280cc780 msgr2=0x7fa6280af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa62e1b5640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6280cc780 0x7fa6280af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa62e1b5640 1 -- 172.21.15.130:0/1320390253 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa620009b30 con 0x7fa6280b04a0 2023-09-13T06:08:23.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa62d9b4640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6280cc780 0x7fa6280af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:23.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa62e1b5640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6280b04a0 0x7fa628153560 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fa62400c430 tx=0x7fa62400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:23.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa61effd640 1 -- 172.21.15.130:0/1320390253 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6240052d0 con 0x7fa6280b04a0 2023-09-13T06:08:23.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa61effd640 1 -- 172.21.15.130:0/1320390253 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa624005450 con 0x7fa6280b04a0 2023-09-13T06:08:23.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa630419640 1 -- 172.21.15.130:0/1320390253 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa628154590 con 0x7fa6280b04a0 2023-09-13T06:08:23.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa61effd640 1 -- 172.21.15.130:0/1320390253 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624003840 con 0x7fa6280b04a0 2023-09-13T06:08:23.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.699+0000 7fa630419640 1 -- 172.21.15.130:0/1320390253 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa628154b50 con 0x7fa6280b04a0 2023-09-13T06:08:23.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.703+0000 7fa630419640 1 -- 172.21.15.130:0/1320390253 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6280618a0 con 0x7fa6280b04a0 2023-09-13T06:08:23.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.703+0000 7fa61effd640 1 -- 172.21.15.130:0/1320390253 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa6240039a0 con 0x7fa6280b04a0 2023-09-13T06:08:23.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.703+0000 7fa61effd640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa60c065b20 0x7fa60c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:23.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.703+0000 7fa61effd640 1 -- 172.21.15.130:0/1320390253 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa624082870 con 0x7fa6280b04a0 2023-09-13T06:08:23.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.703+0000 7fa62d9b4640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa60c065b20 0x7fa60c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:23.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.703+0000 7fa62d9b4640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa60c065b20 0x7fa60c067fe0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa628150110 tx=0x7fa618008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:23.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.707+0000 7fa61effd640 1 -- 172.21.15.130:0/1320390253 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa624050170 con 0x7fa6280b04a0 2023-09-13T06:08:23.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.867+0000 7fa630419640 1 -- 172.21.15.130:0/1320390253 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa6280cb0b0 con 0x7fa6280b04a0 2023-09-13T06:08:23.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.867+0000 7fa61effd640 1 -- 172.21.15.130:0/1320390253 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v142) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa624053790 con 0x7fa6280b04a0 2023-09-13T06:08:23.870 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:08:23.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 -- 172.21.15.130:0/1320390253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa60c065b20 msgr2=0x7fa60c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa60c065b20 0x7fa60c067fe0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa628150110 tx=0x7fa618008040 comp rx=0 tx=0).stop 2023-09-13T06:08:23.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 -- 172.21.15.130:0/1320390253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6280b04a0 msgr2=0x7fa628153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:23.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6280b04a0 0x7fa628153560 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fa62400c430 tx=0x7fa62400c8f0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 -- 172.21.15.130:0/1320390253 shutdown_connections 2023-09-13T06:08:23.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa60c065b20 0x7fa60c067fe0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6280cc780 0x7fa6280af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa62815b130 0x7fa6281515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 --2- 172.21.15.130:0/1320390253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6280b04a0 0x7fa628153560 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:23.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 -- 172.21.15.130:0/1320390253 >> 172.21.15.130:0/1320390253 conn(0x7fa628065990 msgr2=0x7fa6280ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:23.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 -- 172.21.15.130:0/1320390253 shutdown_connections 2023-09-13T06:08:23.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:23.871+0000 7fa630419640 1 -- 172.21.15.130:0/1320390253 wait complete. 2023-09-13T06:08:23.891 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T06:08:23.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:23.892 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-13T06:08:23.980 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:08:23.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:23.981 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T06:08:23.992 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:08:23.992 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:24.003 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:08:24.004 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:24.053 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:08:24.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.187+0000 7fecbd9ba640 1 Processor -- start 2023-09-13T06:08:24.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecbd9ba640 1 -- start start 2023-09-13T06:08:24.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecbd9ba640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fecb80cc780 0x7fecb815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecbd9ba640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb80ccbe0 con 0x7fecb815b130 2023-09-13T06:08:24.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecbd9ba640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb80ce980 con 0x7fecb80b04a0 2023-09-13T06:08:24.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecbd9ba640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb80cec60 con 0x7fecb80cc780 2023-09-13T06:08:24.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb6ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fecb815b130 0x7fecb80ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40738/0 (socket says 172.21.15.130:40738) 2023-09-13T06:08:24.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb6ffd640 1 -- 172.21.15.130:0/2363876723 learned_addr learned my addr 172.21.15.130:0/2363876723 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:24.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecaffff640 1 --2- 172.21.15.130:0/2363876723 >> v2:172.21.15.164:3300/0 conn(0x7fecb80cc780 0x7fecb815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058235474 0 0) 0x7fecb80ccbe0 con 0x7fecb815b130 2023-09-13T06:08:24.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca4003530 con 0x7fecb815b130 2023-09-13T06:08:24.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1538236075 0 0) 0x7feca4003530 con 0x7fecb815b130 2023-09-13T06:08:24.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 >> v2:172.21.15.164:3300/0 conn(0x7fecb80cc780 msgr2=0x7fecb815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:24.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 --2- 172.21.15.130:0/2363876723 >> v2:172.21.15.164:3300/0 conn(0x7fecb80cc780 0x7fecb815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 >> v1:172.21.15.164:6789/0 conn(0x7fecb80b04a0 legacy=0x7fecb806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb806c640 con 0x7fecb815b130 2023-09-13T06:08:24.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7feca8001680 con 0x7fecb815b130 2023-09-13T06:08:24.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 >> v1:172.21.15.130:6789/0 conn(0x7fecb815b130 legacy=0x7fecb80ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 --2- 172.21.15.130:0/2363876723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca40039f0 0x7feca4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 --2- 172.21.15.130:0/2363876723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca40047d0 0x7feca4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 --2- 172.21.15.130:0/2363876723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca4005190 0x7feca400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80cec60 con 0x7feca4005190 2023-09-13T06:08:24.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca400c0c0 con 0x7feca40039f0 2023-09-13T06:08:24.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca400c280 con 0x7feca40047d0 2023-09-13T06:08:24.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb77fe640 1 --2- 172.21.15.130:0/2363876723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca4005190 0x7feca400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb6ffd640 1 --2- 172.21.15.130:0/2363876723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca40039f0 0x7feca4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecaffff640 1 --2- 172.21.15.130:0/2363876723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca40047d0 0x7feca4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb77fe640 1 -- 172.21.15.130:0/2363876723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca40047d0 msgr2=0x7feca4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:24.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb77fe640 1 --2- 172.21.15.130:0/2363876723 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca40047d0 0x7feca4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb77fe640 1 -- 172.21.15.130:0/2363876723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca40039f0 msgr2=0x7feca4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:24.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb77fe640 1 --2- 172.21.15.130:0/2363876723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca40039f0 0x7feca4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.191+0000 7fecb77fe640 1 -- 172.21.15.130:0/2363876723 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4003530 con 0x7feca4005190 2023-09-13T06:08:24.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecb77fe640 1 -- 172.21.15.130:0/2363876723 reap_dead start 2023-09-13T06:08:24.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecb77fe640 1 --2- 172.21.15.130:0/2363876723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca4005190 0x7feca400b990 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fecb0001e70 tx=0x7fecb001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f146bd93717910c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:24.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0003b80 con 0x7feca4005190 2023-09-13T06:08:24.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb0003d20 con 0x7feca4005190 2023-09-13T06:08:24.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecb67fc640 1 -- 172.21.15.130:0/2363876723 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0005260 con 0x7feca4005190 2023-09-13T06:08:24.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecbd9ba640 1 -- 172.21.15.130:0/2363876723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca4005190 msgr2=0x7feca400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecbd9ba640 1 --2- 172.21.15.130:0/2363876723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca4005190 0x7feca400b990 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fecb0001e70 tx=0x7fecb001c760 comp rx=0 tx=0).stop 2023-09-13T06:08:24.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecbd9ba640 1 -- 172.21.15.130:0/2363876723 shutdown_connections 2023-09-13T06:08:24.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecbd9ba640 1 --2- 172.21.15.130:0/2363876723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca4005190 0x7feca400b990 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecbd9ba640 1 -- 172.21.15.130:0/2363876723 >> 172.21.15.130:0/2363876723 conn(0x7fecb8065990 msgr2=0x7fecb8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:24.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecbd9ba640 1 -- 172.21.15.130:0/2363876723 shutdown_connections 2023-09-13T06:08:24.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.195+0000 7fecbd9ba640 1 -- 172.21.15.130:0/2363876723 wait complete. 2023-09-13T06:08:24.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecbd9ba640 1 Processor -- start 2023-09-13T06:08:24.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecbd9ba640 1 -- start start 2023-09-13T06:08:24.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecbd9ba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca4005190 0x7fecb814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecbd9ba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecb81560c0 0x7fecb81545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecbd9ba640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecb8154b30 0x7fecb8156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecbd9ba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8155020 con 0x7fecb81560c0 2023-09-13T06:08:24.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecbd9ba640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8155300 con 0x7fecb8154b30 2023-09-13T06:08:24.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecbd9ba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb81555e0 con 0x7feca4005190 2023-09-13T06:08:24.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecaffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecb81560c0 0x7fecb81545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecaffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecb81560c0 0x7fecb81545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45714/0 (socket says 172.21.15.130:45714) 2023-09-13T06:08:24.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecaffff640 1 -- 172.21.15.130:0/4057311786 learned_addr learned my addr 172.21.15.130:0/4057311786 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:24.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecb6ffd640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca4005190 0x7fecb814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecb77fe640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecb8154b30 0x7fecb8156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecaffff640 1 -- 172.21.15.130:0/4057311786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca4005190 msgr2=0x7fecb814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecaffff640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca4005190 0x7fecb814cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecaffff640 1 -- 172.21.15.130:0/4057311786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecb8154b30 msgr2=0x7fecb8156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecaffff640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecb8154b30 0x7fecb8156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecaffff640 1 -- 172.21.15.130:0/4057311786 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb81558c0 con 0x7fecb81560c0 2023-09-13T06:08:24.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecb77fe640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecb8154b30 0x7fecb8156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:24.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecaffff640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecb81560c0 0x7fecb81545f0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7feca0011960 tx=0x7feca0011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:24.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecb4ff9640 1 -- 172.21.15.130:0/4057311786 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000fa30 con 0x7fecb81560c0 2023-09-13T06:08:24.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecb4ff9640 1 -- 172.21.15.130:0/4057311786 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca000fb90 con 0x7fecb81560c0 2023-09-13T06:08:24.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecbd9ba640 1 -- 172.21.15.130:0/4057311786 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb8155ba0 con 0x7fecb81560c0 2023-09-13T06:08:24.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecb4ff9640 1 -- 172.21.15.130:0/4057311786 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0014440 con 0x7fecb81560c0 2023-09-13T06:08:24.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.199+0000 7fecbd9ba640 1 -- 172.21.15.130:0/4057311786 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb814d040 con 0x7fecb81560c0 2023-09-13T06:08:24.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.203+0000 7fecbd9ba640 1 -- 172.21.15.130:0/4057311786 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb806b640 con 0x7fecb81560c0 2023-09-13T06:08:24.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.203+0000 7fecb4ff9640 1 -- 172.21.15.130:0/4057311786 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7feca001d400 con 0x7fecb81560c0 2023-09-13T06:08:24.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.203+0000 7fecb4ff9640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec98065b20 0x7fec98067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.203+0000 7fecb4ff9640 1 -- 172.21.15.130:0/4057311786 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7feca0083b50 con 0x7fecb81560c0 2023-09-13T06:08:24.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.203+0000 7fecb6ffd640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec98065b20 0x7fec98067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.203+0000 7fecb6ffd640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec98065b20 0x7fec98067fe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7feca8007d30 tx=0x7feca8000ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:24.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.207+0000 7fecb4ff9640 1 -- 172.21.15.130:0/4057311786 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7feca0051450 con 0x7fecb81560c0 2023-09-13T06:08:24.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 -- 172.21.15.130:0/4057311786 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecb80618a0 con 0x7fecb81560c0 2023-09-13T06:08:24.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecb4ff9640 1 -- 172.21.15.130:0/4057311786 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16665 (secure 0 0 0) 0x7feca0081130 con 0x7fecb81560c0 2023-09-13T06:08:24.362 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:24.362 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":142,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:08:17.386149+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:38.276233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:39.032744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:08:24.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 -- 172.21.15.130:0/4057311786 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec98065b20 msgr2=0x7fec98067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec98065b20 0x7fec98067fe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7feca8007d30 tx=0x7feca8000ee0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 -- 172.21.15.130:0/4057311786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecb81560c0 msgr2=0x7fecb81545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecb81560c0 0x7fecb81545f0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7feca0011960 tx=0x7feca0011d60 comp rx=0 tx=0).stop 2023-09-13T06:08:24.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 -- 172.21.15.130:0/4057311786 shutdown_connections 2023-09-13T06:08:24.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec98065b20 0x7fec98067fe0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecb8154b30 0x7fecb8156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecb81560c0 0x7fecb81545f0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 --2- 172.21.15.130:0/4057311786 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca4005190 0x7fecb814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 -- 172.21.15.130:0/4057311786 >> 172.21.15.130:0/4057311786 conn(0x7fecb8065990 msgr2=0x7fecb8159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:24.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 -- 172.21.15.130:0/4057311786 shutdown_connections 2023-09-13T06:08:24.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.359+0000 7fecbd9ba640 1 -- 172.21.15.130:0/4057311786 wait complete. 2023-09-13T06:08:24.383 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:07:38.276233+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:07:39.032744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:08:24.384 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:08:24.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.523+0000 7fbfd9a07640 1 Processor -- start 2023-09-13T06:08:24.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.527+0000 7fbfd9a07640 1 -- start start 2023-09-13T06:08:24.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.527+0000 7fbfd9a07640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbfd40b31a0 0x7fbfd40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.527+0000 7fbfd9a07640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40cc850 con 0x7fbfd40b1460 2023-09-13T06:08:24.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.527+0000 7fbfd9a07640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40b0330 con 0x7fbfd415a080 2023-09-13T06:08:24.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.527+0000 7fbfd9a07640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd40cbcd0 con 0x7fbfd40b31a0 2023-09-13T06:08:24.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.527+0000 7fbfca7fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fbfd40b1460 0x7fbfd40b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40744/0 (socket says 172.21.15.130:40744) 2023-09-13T06:08:24.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.527+0000 7fbfca7fc640 1 -- 172.21.15.130:0/3439449084 learned_addr learned my addr 172.21.15.130:0/3439449084 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:24.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.527+0000 7fbfd37fe640 1 --2- 172.21.15.130:0/3439449084 >> v2:172.21.15.130:3300/0 conn(0x7fbfd40b31a0 0x7fbfd40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.527+0000 7fbfd37fe640 1 -- 172.21.15.130:0/3439449084 >> v1:172.21.15.164:6789/0 conn(0x7fbfd415a080 legacy=0x7fbfd415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.527+0000 7fbfd37fe640 1 -- 172.21.15.130:0/3439449084 >> v1:172.21.15.130:6789/0 conn(0x7fbfd40b1460 legacy=0x7fbfd40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.527+0000 7fbfd37fe640 1 -- 172.21.15.130:0/3439449084 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40cbfb0 con 0x7fbfd40b31a0 2023-09-13T06:08:24.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd37fe640 1 --2- 172.21.15.130:0/3439449084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd40b31a0 0x7fbfd40ccfe0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009d90 tx=0x7fbfcc01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3310a428470576e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:24.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd27fc640 1 -- 172.21.15.130:0/3439449084 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0a5660 con 0x7fbfd40b31a0 2023-09-13T06:08:24.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd27fc640 1 -- 172.21.15.130:0/3439449084 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0a57c0 con 0x7fbfd40b31a0 2023-09-13T06:08:24.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd27fc640 1 -- 172.21.15.130:0/3439449084 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0a5b50 con 0x7fbfd40b31a0 2023-09-13T06:08:24.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd9a07640 1 -- 172.21.15.130:0/3439449084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd40b31a0 msgr2=0x7fbfd40ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd9a07640 1 --2- 172.21.15.130:0/3439449084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd40b31a0 0x7fbfd40ccfe0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009d90 tx=0x7fbfcc01c890 comp rx=0 tx=0).stop 2023-09-13T06:08:24.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd9a07640 1 -- 172.21.15.130:0/3439449084 shutdown_connections 2023-09-13T06:08:24.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd9a07640 1 --2- 172.21.15.130:0/3439449084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd40b31a0 0x7fbfd40ccfe0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd9a07640 1 -- 172.21.15.130:0/3439449084 >> 172.21.15.130:0/3439449084 conn(0x7fbfd4065990 msgr2=0x7fbfd4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:24.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd9a07640 1 -- 172.21.15.130:0/3439449084 shutdown_connections 2023-09-13T06:08:24.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd9a07640 1 -- 172.21.15.130:0/3439449084 wait complete. 2023-09-13T06:08:24.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd9a07640 1 Processor -- start 2023-09-13T06:08:24.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.531+0000 7fbfd9a07640 1 -- start start 2023-09-13T06:08:24.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd9a07640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd40b1460 0x7fbfd41f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd9a07640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfd40b31a0 0x7fbfd414ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd9a07640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfd415a080 0x7fbfd414f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd9a07640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41f9980 con 0x7fbfd40b1460 2023-09-13T06:08:24.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd9a07640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4146db0 con 0x7fbfd415a080 2023-09-13T06:08:24.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd9a07640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41f5540 con 0x7fbfd40b31a0 2023-09-13T06:08:24.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd40b1460 0x7fbfd41f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd40b1460 0x7fbfd41f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45724/0 (socket says 172.21.15.130:45724) 2023-09-13T06:08:24.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd2ffd640 1 -- 172.21.15.130:0/1526339890 learned_addr learned my addr 172.21.15.130:0/1526339890 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:24.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd37fe640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfd415a080 0x7fbfd414f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfca7fc640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfd40b31a0 0x7fbfd414ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd2ffd640 1 -- 172.21.15.130:0/1526339890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfd40b31a0 msgr2=0x7fbfd414ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd2ffd640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfd40b31a0 0x7fbfd414ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd2ffd640 1 -- 172.21.15.130:0/1526339890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfd415a080 msgr2=0x7fbfd414f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd2ffd640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfd415a080 0x7fbfd414f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd2ffd640 1 -- 172.21.15.130:0/1526339890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc009a70 con 0x7fbfd40b1460 2023-09-13T06:08:24.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfca7fc640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfd40b31a0 0x7fbfd414ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:24.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd2ffd640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd40b1460 0x7fbfd41f5000 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c3f0 tx=0x7fbfbc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:24.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd0ff9640 1 -- 172.21.15.130:0/1526339890 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0052d0 con 0x7fbfd40b1460 2023-09-13T06:08:24.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd0ff9640 1 -- 172.21.15.130:0/1526339890 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc005430 con 0x7fbfd40b1460 2023-09-13T06:08:24.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd0ff9640 1 -- 172.21.15.130:0/1526339890 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc003840 con 0x7fbfd40b1460 2023-09-13T06:08:24.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd9a07640 1 -- 172.21.15.130:0/1526339890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd41f8d00 con 0x7fbfd40b1460 2023-09-13T06:08:24.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd9a07640 1 -- 172.21.15.130:0/1526339890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd41f92c0 con 0x7fbfd40b1460 2023-09-13T06:08:24.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd9a07640 1 -- 172.21.15.130:0/1526339890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd41f9ac0 con 0x7fbfd40b1460 2023-09-13T06:08:24.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.535+0000 7fbfd0ff9640 1 -- 172.21.15.130:0/1526339890 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbfbc0039a0 con 0x7fbfd40b1460 2023-09-13T06:08:24.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.539+0000 7fbfd0ff9640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbfb4065b20 0x7fbfb4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.539+0000 7fbfd0ff9640 1 -- 172.21.15.130:0/1526339890 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbfbc0827f0 con 0x7fbfd40b1460 2023-09-13T06:08:24.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.539+0000 7fbfca7fc640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbfb4065b20 0x7fbfb4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.539+0000 7fbfca7fc640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbfb4065b20 0x7fbfb4067fe0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4007fd0 tx=0x7fbfc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:24.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.543+0000 7fbfd0ff9640 1 -- 172.21.15.130:0/1526339890 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbfbc0501a0 con 0x7fbfd40b1460 2023-09-13T06:08:24.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd9a07640 1 -- 172.21.15.130:0/1526339890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbfd40618a0 con 0x7fbfd40b1460 2023-09-13T06:08:24.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd0ff9640 1 -- 172.21.15.130:0/1526339890 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfbc017020 con 0x7fbfd40b1460 2023-09-13T06:08:24.694 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:08:24.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd9a07640 1 -- 172.21.15.130:0/1526339890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbfb4065b20 msgr2=0x7fbfb4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd9a07640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbfb4065b20 0x7fbfb4067fe0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4007fd0 tx=0x7fbfc4009040 comp rx=0 tx=0).stop 2023-09-13T06:08:24.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd9a07640 1 -- 172.21.15.130:0/1526339890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd40b1460 msgr2=0x7fbfd41f5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd9a07640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd40b1460 0x7fbfd41f5000 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c3f0 tx=0x7fbfbc00c8b0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd9a07640 1 -- 172.21.15.130:0/1526339890 shutdown_connections 2023-09-13T06:08:24.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd9a07640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbfb4065b20 0x7fbfb4067fe0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd9a07640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfd415a080 0x7fbfd414f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd9a07640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfd40b31a0 0x7fbfd414ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd9a07640 1 --2- 172.21.15.130:0/1526339890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd40b1460 0x7fbfd41f5000 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.691+0000 7fbfd9a07640 1 -- 172.21.15.130:0/1526339890 >> 172.21.15.130:0/1526339890 conn(0x7fbfd4065990 msgr2=0x7fbfd4156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:24.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.695+0000 7fbfd9a07640 1 -- 172.21.15.130:0/1526339890 shutdown_connections 2023-09-13T06:08:24.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.695+0000 7fbfd9a07640 1 -- 172.21.15.130:0/1526339890 wait complete. 2023-09-13T06:08:24.715 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:08:24.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f9174619640 1 Processor -- start 2023-09-13T06:08:24.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f9174619640 1 -- start start 2023-09-13T06:08:24.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f9174619640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 0x7f916c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f9174619640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c0b2150 con 0x7f916c0b1b70 2023-09-13T06:08:24.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f9174619640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c0cdd90 con 0x7f916c0b2780 2023-09-13T06:08:24.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f9174619640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0b2430 con 0x7f916c144d70 2023-09-13T06:08:24.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f9172bb6640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f916c0b1b70 0x7f916c06ca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40752/0 (socket says 172.21.15.130:40752) 2023-09-13T06:08:24.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f9172bb6640 1 -- 172.21.15.130:0/801937082 learned_addr learned my addr 172.21.15.130:0/801937082 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:24.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f91723b5640 1 --2- 172.21.15.130:0/801937082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 0x7f916c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f91713b3640 1 -- 172.21.15.130:0/801937082 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722747633 0 0) 0x7f916c0b2150 con 0x7f916c0b1b70 2023-09-13T06:08:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f91713b3640 1 -- 172.21.15.130:0/801937082 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9158003530 con 0x7f916c0b1b70 2023-09-13T06:08:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f91713b3640 1 -- 172.21.15.130:0/801937082 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891445142 0 0) 0x7f916c0cdd90 con 0x7f916c0b2780 2023-09-13T06:08:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f91713b3640 1 -- 172.21.15.130:0/801937082 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f916c0b2150 con 0x7f916c0b2780 2023-09-13T06:08:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f91723b5640 1 -- 172.21.15.130:0/801937082 >> v1:172.21.15.164:6789/0 conn(0x7f916c0b2780 legacy=0x7f916c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f91723b5640 1 -- 172.21.15.130:0/801937082 >> v1:172.21.15.130:6789/0 conn(0x7f916c0b1b70 legacy=0x7f916c06ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.855+0000 7f91723b5640 1 -- 172.21.15.130:0/801937082 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c0ce070 con 0x7f916c144d70 2023-09-13T06:08:24.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.859+0000 7f91723b5640 1 --2- 172.21.15.130:0/801937082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 0x7f916c0ce870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f91680097f0 tx=0x7f916801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a152f6a21632e37f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:24.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.859+0000 7f91713b3640 1 -- 172.21.15.130:0/801937082 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91680ab600 con 0x7f916c144d70 2023-09-13T06:08:24.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.859+0000 7f91713b3640 1 -- 172.21.15.130:0/801937082 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91680a7050 con 0x7f916c144d70 2023-09-13T06:08:24.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.859+0000 7f91713b3640 1 -- 172.21.15.130:0/801937082 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91680ab980 con 0x7f916c144d70 2023-09-13T06:08:24.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.859+0000 7f9174619640 1 -- 172.21.15.130:0/801937082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 msgr2=0x7f916c0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.859+0000 7f9174619640 1 --2- 172.21.15.130:0/801937082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 0x7f916c0ce870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f91680097f0 tx=0x7f916801c4c0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.859+0000 7f9174619640 1 -- 172.21.15.130:0/801937082 shutdown_connections 2023-09-13T06:08:24.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.859+0000 7f9174619640 1 --2- 172.21.15.130:0/801937082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 0x7f916c0ce870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.859+0000 7f9174619640 1 -- 172.21.15.130:0/801937082 >> 172.21.15.130:0/801937082 conn(0x7f916c065990 msgr2=0x7f916c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:24.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.859+0000 7f9174619640 1 -- 172.21.15.130:0/801937082 shutdown_connections 2023-09-13T06:08:24.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.859+0000 7f9174619640 1 -- 172.21.15.130:0/801937082 wait complete. 2023-09-13T06:08:24.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9174619640 1 Processor -- start 2023-09-13T06:08:24.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9174619640 1 -- start start 2023-09-13T06:08:24.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9174619640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f916c0b1b70 0x7f916c138f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9174619640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916c0b2780 0x7f916c0b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9174619640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 0x7f916c142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9174619640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c1394d0 con 0x7f916c0b2780 2023-09-13T06:08:24.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9174619640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c14d490 con 0x7f916c0b1b70 2023-09-13T06:08:24.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9174619640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c14d770 con 0x7f916c144d70 2023-09-13T06:08:24.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9171bb4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916c0b2780 0x7f916c0b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9171bb4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916c0b2780 0x7f916c0b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45736/0 (socket says 172.21.15.130:45736) 2023-09-13T06:08:24.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9171bb4640 1 -- 172.21.15.130:0/911192092 learned_addr learned my addr 172.21.15.130:0/911192092 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:24.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9172bb6640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 0x7f916c142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f91723b5640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f916c0b1b70 0x7f916c138f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9171bb4640 1 -- 172.21.15.130:0/911192092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 msgr2=0x7f916c142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9171bb4640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 0x7f916c142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9171bb4640 1 -- 172.21.15.130:0/911192092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f916c0b1b70 msgr2=0x7f916c138f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:24.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9171bb4640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f916c0b1b70 0x7f916c138f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:24.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9171bb4640 1 -- 172.21.15.130:0/911192092 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9168009420 con 0x7f916c0b2780 2023-09-13T06:08:24.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9172bb6640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 0x7f916c142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:24.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9171bb4640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916c0b2780 0x7f916c0b0ea0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f915c00c490 tx=0x7f915c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:24.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9162ffd640 1 -- 172.21.15.130:0/911192092 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c0052d0 con 0x7f916c0b2780 2023-09-13T06:08:24.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9162ffd640 1 -- 172.21.15.130:0/911192092 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c005430 con 0x7f916c0b2780 2023-09-13T06:08:24.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9162ffd640 1 -- 172.21.15.130:0/911192092 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c012870 con 0x7f916c0b2780 2023-09-13T06:08:24.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9174619640 1 -- 172.21.15.130:0/911192092 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c14da50 con 0x7f916c0b2780 2023-09-13T06:08:24.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.863+0000 7f9174619640 1 -- 172.21.15.130:0/911192092 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c14e010 con 0x7f916c0b2780 2023-09-13T06:08:24.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.867+0000 7f9174619640 1 -- 172.21.15.130:0/911192092 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916c0618a0 con 0x7f916c0b2780 2023-09-13T06:08:24.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.867+0000 7f9162ffd640 1 -- 172.21.15.130:0/911192092 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f915c0129d0 con 0x7f916c0b2780 2023-09-13T06:08:24.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.867+0000 7f9162ffd640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9150065b20 0x7f9150067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:24.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.867+0000 7f9162ffd640 1 -- 172.21.15.130:0/911192092 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f915c082f90 con 0x7f916c0b2780 2023-09-13T06:08:24.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.867+0000 7f91723b5640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9150065b20 0x7f9150067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:24.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.867+0000 7f91723b5640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9150065b20 0x7f9150067fe0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f91680ad000 tx=0x7f91680a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:24.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:24.871+0000 7f9162ffd640 1 -- 172.21.15.130:0/911192092 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f915c050800 con 0x7f916c0b2780 2023-09-13T06:08:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 -- 172.21.15.130:0/911192092 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f916c1419d0 con 0x7f916c0b2780 2023-09-13T06:08:25.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9162ffd640 1 -- 172.21.15.130:0/911192092 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v142) v1 ==== 104+0+11 (secure 0 0 0) 0x7f915c053e20 con 0x7f916c0b2780 2023-09-13T06:08:25.021 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:08:25.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 -- 172.21.15.130:0/911192092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9150065b20 msgr2=0x7f9150067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9150065b20 0x7f9150067fe0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f91680ad000 tx=0x7f91680a6000 comp rx=0 tx=0).stop 2023-09-13T06:08:25.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 -- 172.21.15.130:0/911192092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916c0b2780 msgr2=0x7f916c0b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916c0b2780 0x7f916c0b0ea0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f915c00c490 tx=0x7f915c00c950 comp rx=0 tx=0).stop 2023-09-13T06:08:25.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 -- 172.21.15.130:0/911192092 shutdown_connections 2023-09-13T06:08:25.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9150065b20 0x7f9150067fe0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f916c144d70 0x7f916c142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916c0b2780 0x7f916c0b0ea0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 --2- 172.21.15.130:0/911192092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f916c0b1b70 0x7f916c138f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 -- 172.21.15.130:0/911192092 >> 172.21.15.130:0/911192092 conn(0x7f916c065990 msgr2=0x7f916c156240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:25.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 -- 172.21.15.130:0/911192092 shutdown_connections 2023-09-13T06:08:25.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.019+0000 7f9174619640 1 -- 172.21.15.130:0/911192092 wait complete. 2023-09-13T06:08:25.042 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:08:25.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.179+0000 7f01f3ddb640 1 Processor -- start 2023-09-13T06:08:25.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.179+0000 7f01f3ddb640 1 -- start start 2023-09-13T06:08:25.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f3ddb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f01ec160fe0 0x7f01ec06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f3ddb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec161e60 con 0x7f01ec157b30 2023-09-13T06:08:25.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f3ddb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec1615c0 con 0x7f01ec157750 2023-09-13T06:08:25.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f3ddb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec0ae0d0 con 0x7f01ec160fe0 2023-09-13T06:08:25.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f1376640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f01ec157b30 0x7f01ec15e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40766/0 (socket says 172.21.15.130:40766) 2023-09-13T06:08:25.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f1376640 1 -- 172.21.15.130:0/3515573669 learned_addr learned my addr 172.21.15.130:0/3515573669 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:25.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f2378640 1 --2- 172.21.15.130:0/3515573669 >> v2:172.21.15.164:3300/0 conn(0x7f01ec160fe0 0x7f01ec06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f0b75640 1 -- 172.21.15.130:0/3515573669 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462360471 0 0) 0x7f01ec161e60 con 0x7f01ec157b30 2023-09-13T06:08:25.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f0b75640 1 -- 172.21.15.130:0/3515573669 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01d8003530 con 0x7f01ec157b30 2023-09-13T06:08:25.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f2378640 1 -- 172.21.15.130:0/3515573669 >> v1:172.21.15.164:6789/0 conn(0x7f01ec157750 legacy=0x7f01ec06f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f2378640 1 -- 172.21.15.130:0/3515573669 >> v1:172.21.15.130:6789/0 conn(0x7f01ec157b30 legacy=0x7f01ec15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.183+0000 7f01f2378640 1 -- 172.21.15.130:0/3515573669 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec1618a0 con 0x7f01ec160fe0 2023-09-13T06:08:25.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f2378640 1 --2- 172.21.15.130:0/3515573669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01ec160fe0 0x7f01ec06dba0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009d90 tx=0x7f01e401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=524d7d5d718eb24 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:25.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f0b75640 1 -- 172.21.15.130:0/3515573669 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40a59e0 con 0x7f01ec160fe0 2023-09-13T06:08:25.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f0b75640 1 -- 172.21.15.130:0/3515573669 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e40a5b40 con 0x7f01ec160fe0 2023-09-13T06:08:25.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f0b75640 1 -- 172.21.15.130:0/3515573669 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40ad440 con 0x7f01ec160fe0 2023-09-13T06:08:25.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3515573669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01ec160fe0 msgr2=0x7f01ec06dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 --2- 172.21.15.130:0/3515573669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01ec160fe0 0x7f01ec06dba0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009d90 tx=0x7f01e401c920 comp rx=0 tx=0).stop 2023-09-13T06:08:25.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3515573669 shutdown_connections 2023-09-13T06:08:25.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 --2- 172.21.15.130:0/3515573669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01ec160fe0 0x7f01ec06dba0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3515573669 >> 172.21.15.130:0/3515573669 conn(0x7f01ec065d60 msgr2=0x7f01ec0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:25.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3515573669 shutdown_connections 2023-09-13T06:08:25.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3515573669 wait complete. 2023-09-13T06:08:25.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 Processor -- start 2023-09-13T06:08:25.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 -- start start 2023-09-13T06:08:25.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01ec157750 0x7f01ec156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01ec157b30 0x7f01ec1382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01ec160fe0 0x7f01ec154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec14b050 con 0x7f01ec157b30 2023-09-13T06:08:25.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec156ff0 con 0x7f01ec157750 2023-09-13T06:08:25.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.187+0000 7f01f3ddb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec14a410 con 0x7f01ec160fe0 2023-09-13T06:08:25.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f1376640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01ec157b30 0x7f01ec1382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f1376640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01ec157b30 0x7f01ec1382a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45742/0 (socket says 172.21.15.130:45742) 2023-09-13T06:08:25.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f1376640 1 -- 172.21.15.130:0/3909016211 learned_addr learned my addr 172.21.15.130:0/3909016211 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:25.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f1b77640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01ec157750 0x7f01ec156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f2378640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01ec160fe0 0x7f01ec154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f1376640 1 -- 172.21.15.130:0/3909016211 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01ec160fe0 msgr2=0x7f01ec154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f1376640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01ec160fe0 0x7f01ec154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f1376640 1 -- 172.21.15.130:0/3909016211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01ec157750 msgr2=0x7f01ec156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f1376640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01ec157750 0x7f01ec156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f1376640 1 -- 172.21.15.130:0/3909016211 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4009a70 con 0x7f01ec157b30 2023-09-13T06:08:25.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f1376640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01ec157b30 0x7f01ec1382a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00c4d0 tx=0x7f01dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:25.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01e27fc640 1 -- 172.21.15.130:0/3909016211 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc005cf0 con 0x7f01ec157b30 2023-09-13T06:08:25.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01e27fc640 1 -- 172.21.15.130:0/3909016211 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc005e50 con 0x7f01ec157b30 2023-09-13T06:08:25.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01e27fc640 1 -- 172.21.15.130:0/3909016211 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc007270 con 0x7f01ec157b30 2023-09-13T06:08:25.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3909016211 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec06fa00 con 0x7f01ec157b30 2023-09-13T06:08:25.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3909016211 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec14a990 con 0x7f01ec157b30 2023-09-13T06:08:25.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3909016211 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec14b190 con 0x7f01ec157b30 2023-09-13T06:08:25.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.191+0000 7f01e27fc640 1 -- 172.21.15.130:0/3909016211 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f01dc0073d0 con 0x7f01ec157b30 2023-09-13T06:08:25.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.195+0000 7f01e27fc640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01d0065b20 0x7f01d0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.195+0000 7f01e27fc640 1 -- 172.21.15.130:0/3909016211 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f01dc0827d0 con 0x7f01ec157b30 2023-09-13T06:08:25.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.195+0000 7f01f1b77640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01d0065b20 0x7f01d0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.195+0000 7f01f1b77640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01d0065b20 0x7f01d0067fe0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f01e8007fd0 tx=0x7f01e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:25.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.199+0000 7f01e27fc640 1 -- 172.21.15.130:0/3909016211 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f01ec14b190 con 0x7f01ec157b30 2023-09-13T06:08:25.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.343+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3909016211 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01ec14b190 con 0x7f01ec157b30 2023-09-13T06:08:25.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.343+0000 7f01e27fc640 1 -- 172.21.15.130:0/3909016211 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v142) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01ec14b190 con 0x7f01ec157b30 2023-09-13T06:08:25.347 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:08:25.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3909016211 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01d0065b20 msgr2=0x7f01d0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01d0065b20 0x7f01d0067fe0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f01e8007fd0 tx=0x7f01e8009040 comp rx=0 tx=0).stop 2023-09-13T06:08:25.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3909016211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01ec157b30 msgr2=0x7f01ec1382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01ec157b30 0x7f01ec1382a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00c4d0 tx=0x7f01dc00c990 comp rx=0 tx=0).stop 2023-09-13T06:08:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3909016211 shutdown_connections 2023-09-13T06:08:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f01d0065b20 0x7f01d0067fe0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01ec160fe0 0x7f01ec154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01ec157b30 0x7f01ec1382a0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 --2- 172.21.15.130:0/3909016211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01ec157750 0x7f01ec156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3909016211 >> 172.21.15.130:0/3909016211 conn(0x7f01ec065d60 msgr2=0x7f01ec14f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3909016211 shutdown_connections 2023-09-13T06:08:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.347+0000 7f01f3ddb640 1 -- 172.21.15.130:0/3909016211 wait complete. 2023-09-13T06:08:25.368 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:08:25.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.507+0000 7f0c9f911640 1 Processor -- start 2023-09-13T06:08:25.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.507+0000 7f0c9f911640 1 -- start start 2023-09-13T06:08:25.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9f911640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0c980d1750 0x7f0c9815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9f911640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0c980d1090 0x7f0c98146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9f911640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c980b63c0 con 0x7f0c980d1b30 2023-09-13T06:08:25.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9f911640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9815dea0 con 0x7f0c980d1090 2023-09-13T06:08:25.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9f911640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c980d0c20 con 0x7f0c980d1750 2023-09-13T06:08:25.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9ceac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0c980d1090 0x7f0c98146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9deae640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0c980d1b30 0x7f0c980b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40774/0 (socket says 172.21.15.130:40774) 2023-09-13T06:08:25.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9deae640 1 -- 172.21.15.130:0/2575946354 learned_addr learned my addr 172.21.15.130:0/2575946354 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:25.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9d6ad640 1 --2- 172.21.15.130:0/2575946354 >> v2:172.21.15.164:3300/0 conn(0x7f0c980d1750 0x7f0c9815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9ceac640 1 -- 172.21.15.130:0/2575946354 >> v2:172.21.15.164:3300/0 conn(0x7f0c980d1750 msgr2=0x7f0c9815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:25.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9ceac640 1 --2- 172.21.15.130:0/2575946354 >> v2:172.21.15.164:3300/0 conn(0x7f0c980d1750 0x7f0c9815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9ceac640 1 -- 172.21.15.130:0/2575946354 >> v1:172.21.15.130:6789/0 conn(0x7f0c980d1b30 legacy=0x7f0c980b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c8ffff640 1 -- 172.21.15.130:0/2575946354 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238439842 0 0) 0x7f0c980b63c0 con 0x7f0c980d1b30 2023-09-13T06:08:25.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.511+0000 7f0c9ceac640 1 -- 172.21.15.130:0/2575946354 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c980b6610 con 0x7f0c980d1090 2023-09-13T06:08:25.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9ceac640 1 --2- 172.21.15.130:0/2575946354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c980d1090 0x7f0c98146820 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f0c98073cd0 tx=0x7f0c8801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbaa5605a9805cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:25.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c8ffff640 1 -- 172.21.15.130:0/2575946354 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880a7070 con 0x7f0c980d1090 2023-09-13T06:08:25.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c8ffff640 1 -- 172.21.15.130:0/2575946354 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c880ab430 con 0x7f0c980d1090 2023-09-13T06:08:25.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c8ffff640 1 -- 172.21.15.130:0/2575946354 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880ab7c0 con 0x7f0c980d1090 2023-09-13T06:08:25.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 -- 172.21.15.130:0/2575946354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c980d1090 msgr2=0x7f0c98146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 --2- 172.21.15.130:0/2575946354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c980d1090 0x7f0c98146820 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f0c98073cd0 tx=0x7f0c8801c430 comp rx=0 tx=0).stop 2023-09-13T06:08:25.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 -- 172.21.15.130:0/2575946354 shutdown_connections 2023-09-13T06:08:25.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 --2- 172.21.15.130:0/2575946354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c980d1090 0x7f0c98146820 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 --2- 172.21.15.130:0/2575946354 >> v2:172.21.15.164:3300/0 conn(0x7f0c980d1750 0x7f0c9815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 -- 172.21.15.130:0/2575946354 >> 172.21.15.130:0/2575946354 conn(0x7f0c9806f170 msgr2=0x7f0c9806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:25.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 -- 172.21.15.130:0/2575946354 shutdown_connections 2023-09-13T06:08:25.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 -- 172.21.15.130:0/2575946354 wait complete. 2023-09-13T06:08:25.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 Processor -- start 2023-09-13T06:08:25.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 -- start start 2023-09-13T06:08:25.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c980d1090 0x7f0c9815cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c980d1750 0x7f0c9813db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c980d1b30 0x7f0c9813e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9815d4a0 con 0x7f0c980d1750 2023-09-13T06:08:25.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c98144550 con 0x7f0c980d1b30 2023-09-13T06:08:25.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.515+0000 7f0c9f911640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c98144830 con 0x7f0c980d1090 2023-09-13T06:08:25.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9ceac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c980d1750 0x7f0c9813db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9ceac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c980d1750 0x7f0c9813db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45758/0 (socket says 172.21.15.130:45758) 2023-09-13T06:08:25.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9ceac640 1 -- 172.21.15.130:0/510369215 learned_addr learned my addr 172.21.15.130:0/510369215 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:25.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9d6ad640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c980d1090 0x7f0c9815cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9deae640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c980d1b30 0x7f0c9813e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9ceac640 1 -- 172.21.15.130:0/510369215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c980d1090 msgr2=0x7f0c9815cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9ceac640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c980d1090 0x7f0c9815cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9ceac640 1 -- 172.21.15.130:0/510369215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c980d1b30 msgr2=0x7f0c9813e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9ceac640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c980d1b30 0x7f0c9813e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9ceac640 1 -- 172.21.15.130:0/510369215 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c88009420 con 0x7f0c980d1750 2023-09-13T06:08:25.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9ceac640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c980d1750 0x7f0c9813db90 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f0c88019040 tx=0x7f0c8801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:25.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c8dffb640 1 -- 172.21.15.130:0/510369215 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880b5610 con 0x7f0c980d1750 2023-09-13T06:08:25.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c8dffb640 1 -- 172.21.15.130:0/510369215 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c880b5790 con 0x7f0c980d1750 2023-09-13T06:08:25.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c8dffb640 1 -- 172.21.15.130:0/510369215 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880b5b40 con 0x7f0c980d1750 2023-09-13T06:08:25.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9f911640 1 -- 172.21.15.130:0/510369215 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c98144b10 con 0x7f0c980d1750 2023-09-13T06:08:25.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9f911640 1 -- 172.21.15.130:0/510369215 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c981450d0 con 0x7f0c980d1750 2023-09-13T06:08:25.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c9f911640 1 -- 172.21.15.130:0/510369215 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c980618a0 con 0x7f0c980d1750 2023-09-13T06:08:25.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.519+0000 7f0c8dffb640 1 -- 172.21.15.130:0/510369215 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0c880b5ca0 con 0x7f0c980d1750 2023-09-13T06:08:25.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.523+0000 7f0c8dffb640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c7c065b20 0x7f0c7c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.523+0000 7f0c8dffb640 1 -- 172.21.15.130:0/510369215 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0c8811d9c0 con 0x7f0c980d1750 2023-09-13T06:08:25.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.523+0000 7f0c9d6ad640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c7c065b20 0x7f0c7c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.523+0000 7f0c9d6ad640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c7c065b20 0x7f0c7c067fe0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0c9815e480 tx=0x7f0c94009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:25.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.527+0000 7f0c8dffb640 1 -- 172.21.15.130:0/510369215 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0c880eb2e0 con 0x7f0c980d1750 2023-09-13T06:08:25.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.683+0000 7f0c9f911640 1 -- 172.21.15.130:0/510369215 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0c981680f0 con 0x7f0c980d1750 2023-09-13T06:08:25.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c8dffb640 1 -- 172.21.15.130:0/510369215 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v142) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0c880c4020 con 0x7f0c980d1750 2023-09-13T06:08:25.689 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:08:25.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 -- 172.21.15.130:0/510369215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c7c065b20 msgr2=0x7f0c7c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c7c065b20 0x7f0c7c067fe0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0c9815e480 tx=0x7f0c94009190 comp rx=0 tx=0).stop 2023-09-13T06:08:25.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 -- 172.21.15.130:0/510369215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c980d1750 msgr2=0x7f0c9813db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c980d1750 0x7f0c9813db90 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f0c88019040 tx=0x7f0c8801ac70 comp rx=0 tx=0).stop 2023-09-13T06:08:25.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 -- 172.21.15.130:0/510369215 shutdown_connections 2023-09-13T06:08:25.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0c7c065b20 0x7f0c7c067fe0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c980d1b30 0x7f0c9813e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c980d1750 0x7f0c9813db90 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 --2- 172.21.15.130:0/510369215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c980d1090 0x7f0c9815cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 -- 172.21.15.130:0/510369215 >> 172.21.15.130:0/510369215 conn(0x7f0c9806f170 msgr2=0x7f0c98145a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:25.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 -- 172.21.15.130:0/510369215 shutdown_connections 2023-09-13T06:08:25.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.687+0000 7f0c9f911640 1 -- 172.21.15.130:0/510369215 wait complete. 2023-09-13T06:08:25.709 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T06:08:25.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:25.710 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-13T06:08:25.778 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:08:25.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:25.779 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T06:08:25.790 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:08:25.790 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:25.800 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:08:25.801 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:08:25.801 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:25.846 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:08:25.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:08:25.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f772a567640 1 Processor -- start 2023-09-13T06:08:25.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f772a567640 1 -- start start 2023-09-13T06:08:25.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f772a567640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f77240d1750 0x7f772415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f772a567640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7724146f30 0x7f77240b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f772a567640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77240b63c0 con 0x7f77240d1090 2023-09-13T06:08:25.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f772a567640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772415dea0 con 0x7f77240d1750 2023-09-13T06:08:25.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f772a567640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77240d0c20 con 0x7f7724146f30 2023-09-13T06:08:25.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f7723fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f77240d1750 0x7f772415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f77237fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f77240d1090 0x7f7724146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40778/0 (socket says 172.21.15.130:40778) 2023-09-13T06:08:25.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f77237fe640 1 -- 172.21.15.130:0/1993769247 learned_addr learned my addr 172.21.15.130:0/1993769247 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:25.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f7728b04640 1 --2- 172.21.15.130:0/1993769247 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7724146f30 0x7f77240b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f7723fff640 1 -- 172.21.15.130:0/1993769247 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7724146f30 msgr2=0x7f77240b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:25.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f7723fff640 1 --2- 172.21.15.130:0/1993769247 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7724146f30 0x7f77240b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f7723fff640 1 -- 172.21.15.130:0/1993769247 >> v1:172.21.15.130:6789/0 conn(0x7f77240d1090 legacy=0x7f7724146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f7722ffd640 1 -- 172.21.15.130:0/1993769247 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558337296 0 0) 0x7f77240b63c0 con 0x7f77240d1090 2023-09-13T06:08:25.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f7723fff640 1 -- 172.21.15.130:0/1993769247 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240b6610 con 0x7f77240d1750 2023-09-13T06:08:25.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.983+0000 7f7728b04640 1 --2- 172.21.15.130:0/1993769247 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7724146f30 0x7f77240b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:25.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f7723fff640 1 --2- 172.21.15.130:0/1993769247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77240d1750 0x7f772415d960 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f77140097c0 tx=0x7f771401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1acf54a1d8cd14 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:25.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f7722ffd640 1 -- 172.21.15.130:0/1993769247 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77140ab650 con 0x7f77240d1750 2023-09-13T06:08:25.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f7722ffd640 1 -- 172.21.15.130:0/1993769247 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77140ab7b0 con 0x7f77240d1750 2023-09-13T06:08:25.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f7722ffd640 1 -- 172.21.15.130:0/1993769247 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77140abb40 con 0x7f77240d1750 2023-09-13T06:08:25.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f772a567640 1 -- 172.21.15.130:0/1993769247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77240d1750 msgr2=0x7f772415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f772a567640 1 --2- 172.21.15.130:0/1993769247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77240d1750 0x7f772415d960 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f77140097c0 tx=0x7f771401c450 comp rx=0 tx=0).stop 2023-09-13T06:08:25.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f772a567640 1 -- 172.21.15.130:0/1993769247 shutdown_connections 2023-09-13T06:08:25.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f772a567640 1 --2- 172.21.15.130:0/1993769247 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7724146f30 0x7f77240b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f772a567640 1 --2- 172.21.15.130:0/1993769247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77240d1750 0x7f772415d960 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f772a567640 1 -- 172.21.15.130:0/1993769247 >> 172.21.15.130:0/1993769247 conn(0x7f772406f170 msgr2=0x7f772406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:25.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f772a567640 1 -- 172.21.15.130:0/1993769247 shutdown_connections 2023-09-13T06:08:25.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.987+0000 7f772a567640 1 -- 172.21.15.130:0/1993769247 wait complete. 2023-09-13T06:08:25.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f772a567640 1 Processor -- start 2023-09-13T06:08:25.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f772a567640 1 -- start start 2023-09-13T06:08:25.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f772a567640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77240d1090 0x7f772415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f772a567640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77240d1750 0x7f772406dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f772a567640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724146f30 0x7f772406e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:25.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f772a567640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7724143d20 con 0x7f77240d1750 2023-09-13T06:08:25.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f772a567640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772415d2e0 con 0x7f7724146f30 2023-09-13T06:08:25.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f772a567640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7724143f70 con 0x7f77240d1090 2023-09-13T06:08:25.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f77237fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77240d1750 0x7f772406dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f77237fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77240d1750 0x7f772406dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45778/0 (socket says 172.21.15.130:45778) 2023-09-13T06:08:25.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f77237fe640 1 -- 172.21.15.130:0/4284590266 learned_addr learned my addr 172.21.15.130:0/4284590266 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:25.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f7723fff640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77240d1090 0x7f772415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f7728b04640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724146f30 0x7f772406e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:25.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f77237fe640 1 -- 172.21.15.130:0/4284590266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77240d1090 msgr2=0x7f772415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f77237fe640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77240d1090 0x7f772415c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f77237fe640 1 -- 172.21.15.130:0/4284590266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724146f30 msgr2=0x7f772406e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:25.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f77237fe640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724146f30 0x7f772406e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:25.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f77237fe640 1 -- 172.21.15.130:0/4284590266 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714009420 con 0x7f77240d1750 2023-09-13T06:08:25.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f77237fe640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77240d1750 0x7f772406dc70 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f771800c4b0 tx=0x7f771800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:25.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f7720ff9640 1 -- 172.21.15.130:0/4284590266 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180074e0 con 0x7f77240d1750 2023-09-13T06:08:25.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f7720ff9640 1 -- 172.21.15.130:0/4284590266 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7718007660 con 0x7f77240d1750 2023-09-13T06:08:26.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f772a567640 1 -- 172.21.15.130:0/4284590266 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77240b7e40 con 0x7f77240d1750 2023-09-13T06:08:26.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f7720ff9640 1 -- 172.21.15.130:0/4284590266 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718004a30 con 0x7f77240d1750 2023-09-13T06:08:26.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f772a567640 1 -- 172.21.15.130:0/4284590266 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7724144530 con 0x7f77240d1750 2023-09-13T06:08:26.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.991+0000 7f772a567640 1 -- 172.21.15.130:0/4284590266 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77240618a0 con 0x7f77240d1750 2023-09-13T06:08:26.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.995+0000 7f7720ff9640 1 -- 172.21.15.130:0/4284590266 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7718004b90 con 0x7f77240d1750 2023-09-13T06:08:26.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.995+0000 7f7720ff9640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7710065b50 0x7f7710068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.995+0000 7f7720ff9640 1 -- 172.21.15.130:0/4284590266 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7718082520 con 0x7f77240d1750 2023-09-13T06:08:26.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.995+0000 7f7723fff640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7710065b50 0x7f7710068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.995+0000 7f7723fff640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7710065b50 0x7f7710068010 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f77140af000 tx=0x7f77140a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:26.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:25.999+0000 7f7720ff9640 1 -- 172.21.15.130:0/4284590266 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f771804fe40 con 0x7f77240d1750 2023-09-13T06:08:26.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f772a567640 1 -- 172.21.15.130:0/4284590266 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77240b86c0 con 0x7f77240d1750 2023-09-13T06:08:26.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f7720ff9640 1 -- 172.21.15.130:0/4284590266 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f7718018090 con 0x7f77240d1750 2023-09-13T06:08:26.182 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:26.182 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1309237651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1309237651},{"type":"v1","addr":"172.21.15.130:6837","nonce":1309237651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1568650238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1568650238},{"type":"v1","addr":"172.21.15.164:6834","nonce":1568650238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1994572743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1994572743},{"type":"v1","addr":"172.21.15.130:6836","nonce":1994572743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:39.911036+0000","modified":"2023-09-13T06:07:42.935333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7773},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7773":{"gid":7773,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/4146626637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4146626637},{"type":"v1","addr":"172.21.15.164:6835","nonce":4146626637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-09-13T06:08:26.183 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 68 2023-09-13T06:08:26.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f772a567640 1 -- 172.21.15.130:0/4284590266 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7710065b50 msgr2=0x7f7710068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f772a567640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7710065b50 0x7f7710068010 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f77140af000 tx=0x7f77140a7000 comp rx=0 tx=0).stop 2023-09-13T06:08:26.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f772a567640 1 -- 172.21.15.130:0/4284590266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77240d1750 msgr2=0x7f772406dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f772a567640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77240d1750 0x7f772406dc70 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f771800c4b0 tx=0x7f771800c970 comp rx=0 tx=0).stop 2023-09-13T06:08:26.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f772a567640 1 -- 172.21.15.130:0/4284590266 shutdown_connections 2023-09-13T06:08:26.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f772a567640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7710065b50 0x7f7710068010 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f772a567640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724146f30 0x7f772406e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f772a567640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77240d1750 0x7f772406dc70 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f772a567640 1 --2- 172.21.15.130:0/4284590266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77240d1090 0x7f772415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.179+0000 7f772a567640 1 -- 172.21.15.130:0/4284590266 >> 172.21.15.130:0/4284590266 conn(0x7f772406f170 msgr2=0x7f7724146780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:26.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.183+0000 7f772a567640 1 -- 172.21.15.130:0/4284590266 shutdown_connections 2023-09-13T06:08:26.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.183+0000 7f772a567640 1 -- 172.21.15.130:0/4284590266 wait complete. 2023-09-13T06:08:26.204 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:08:26.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.339+0000 7f74ce49c640 1 Processor -- start 2023-09-13T06:08:26.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.339+0000 7f74ce49c640 1 -- start start 2023-09-13T06:08:26.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.339+0000 7f74ce49c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f74c8146540 0x7f74c8070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.339+0000 7f74ce49c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c806f640 con 0x7f74c81436e0 2023-09-13T06:08:26.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.339+0000 7f74ce49c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c8070fa0 con 0x7f74c8070b90 2023-09-13T06:08:26.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.339+0000 7f74ce49c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c806f890 con 0x7f74c8146540 2023-09-13T06:08:26.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.339+0000 7f74c7fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f74c81436e0 0x7f74c80ac840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40788/0 (socket says 172.21.15.130:40788) 2023-09-13T06:08:26.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.339+0000 7f74c7fff640 1 -- 172.21.15.130:0/3197982803 learned_addr learned my addr 172.21.15.130:0/3197982803 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:26.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.339+0000 7f74c77fe640 1 --2- 172.21.15.130:0/3197982803 >> v2:172.21.15.130:3300/0 conn(0x7f74c8146540 0x7f74c8070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.343+0000 7f74c77fe640 1 -- 172.21.15.130:0/3197982803 >> v1:172.21.15.164:6789/0 conn(0x7f74c8070b90 legacy=0x7f74c8160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:26.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.343+0000 7f74c77fe640 1 -- 172.21.15.130:0/3197982803 >> v1:172.21.15.130:6789/0 conn(0x7f74c81436e0 legacy=0x7f74c80ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.343+0000 7f74c77fe640 1 -- 172.21.15.130:0/3197982803 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c806fb70 con 0x7f74c8146540 2023-09-13T06:08:26.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.343+0000 7f74c6ffd640 1 -- 172.21.15.130:0/3197982803 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836033625 0 0) 0x7f74c806f640 con 0x7f74c81436e0 2023-09-13T06:08:26.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.343+0000 7f74c77fe640 1 --2- 172.21.15.130:0/3197982803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74c8146540 0x7f74c8070650 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0097c0 tx=0x7f74bc01c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e16392bf1b0681 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:26.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.343+0000 7f74c6ffd640 1 -- 172.21.15.130:0/3197982803 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc0a4ea0 con 0x7f74c8146540 2023-09-13T06:08:26.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.343+0000 7f74c6ffd640 1 -- 172.21.15.130:0/3197982803 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc0a7050 con 0x7f74c8146540 2023-09-13T06:08:26.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.343+0000 7f74c6ffd640 1 -- 172.21.15.130:0/3197982803 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc0ab820 con 0x7f74c8146540 2023-09-13T06:08:26.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.343+0000 7f74ce49c640 1 -- 172.21.15.130:0/3197982803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74c8146540 msgr2=0x7f74c8070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.343+0000 7f74ce49c640 1 --2- 172.21.15.130:0/3197982803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74c8146540 0x7f74c8070650 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0097c0 tx=0x7f74bc01c320 comp rx=0 tx=0).stop 2023-09-13T06:08:26.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.343+0000 7f74ce49c640 1 -- 172.21.15.130:0/3197982803 shutdown_connections 2023-09-13T06:08:26.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 --2- 172.21.15.130:0/3197982803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74c8146540 0x7f74c8070650 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 -- 172.21.15.130:0/3197982803 >> 172.21.15.130:0/3197982803 conn(0x7f74c80b0bc0 msgr2=0x7f74c80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:26.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 -- 172.21.15.130:0/3197982803 shutdown_connections 2023-09-13T06:08:26.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 -- 172.21.15.130:0/3197982803 wait complete. 2023-09-13T06:08:26.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 Processor -- start 2023-09-13T06:08:26.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 -- start start 2023-09-13T06:08:26.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c8070b90 0x7f74c813c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74c81436e0 0x7f74c8159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74c8146540 0x7f74c813a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c813d3a0 con 0x7f74c8146540 2023-09-13T06:08:26.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c813bfc0 con 0x7f74c8070b90 2023-09-13T06:08:26.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c815a1a0 con 0x7f74c81436e0 2023-09-13T06:08:26.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74cca39640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74c8146540 0x7f74c813a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74cca39640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74c8146540 0x7f74c813a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45800/0 (socket says 172.21.15.130:45800) 2023-09-13T06:08:26.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74cca39640 1 -- 172.21.15.130:0/2030989571 learned_addr learned my addr 172.21.15.130:0/2030989571 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:26.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74c7fff640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c8070b90 0x7f74c813c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74c77fe640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74c81436e0 0x7f74c8159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74cca39640 1 -- 172.21.15.130:0/2030989571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74c81436e0 msgr2=0x7f74c8159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74cca39640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74c81436e0 0x7f74c8159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74cca39640 1 -- 172.21.15.130:0/2030989571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c8070b90 msgr2=0x7f74c813c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74cca39640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c8070b90 0x7f74c813c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74cca39640 1 -- 172.21.15.130:0/2030989571 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc009420 con 0x7f74c8146540 2023-09-13T06:08:26.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74c77fe640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74c81436e0 0x7f74c8159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:26.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74c7fff640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c8070b90 0x7f74c813c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:26.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74cca39640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74c8146540 0x7f74c813a540 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f74c000b9a0 tx=0x7f74c000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:26.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74c4ff9640 1 -- 172.21.15.130:0/2030989571 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c000cba0 con 0x7f74c8146540 2023-09-13T06:08:26.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74c4ff9640 1 -- 172.21.15.130:0/2030989571 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c000cd00 con 0x7f74c8146540 2023-09-13T06:08:26.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74c4ff9640 1 -- 172.21.15.130:0/2030989571 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0014680 con 0x7f74c8146540 2023-09-13T06:08:26.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.347+0000 7f74ce49c640 1 -- 172.21.15.130:0/2030989571 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c813b6d0 con 0x7f74c8146540 2023-09-13T06:08:26.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.351+0000 7f74ce49c640 1 -- 172.21.15.130:0/2030989571 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c813bc50 con 0x7f74c8146540 2023-09-13T06:08:26.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.351+0000 7f74ce49c640 1 -- 172.21.15.130:0/2030989571 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c813c170 con 0x7f74c8146540 2023-09-13T06:08:26.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.351+0000 7f74c4ff9640 1 -- 172.21.15.130:0/2030989571 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f74c001d3b0 con 0x7f74c8146540 2023-09-13T06:08:26.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.351+0000 7f74c4ff9640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74b4065b20 0x7f74b4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.351+0000 7f74c4ff9640 1 -- 172.21.15.130:0/2030989571 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f74c0083260 con 0x7f74c8146540 2023-09-13T06:08:26.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.351+0000 7f74c7fff640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74b4065b20 0x7f74b4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.351+0000 7f74c7fff640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74b4065b20 0x7f74b4067fe0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f74b8000f70 tx=0x7f74b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:26.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.355+0000 7f74c4ff9640 1 -- 172.21.15.130:0/2030989571 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f74c813c170 con 0x7f74c8146540 2023-09-13T06:08:26.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74ce49c640 1 -- 172.21.15.130:0/2030989571 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74c813c170 con 0x7f74c8146540 2023-09-13T06:08:26.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74c4ff9640 1 -- 172.21.15.130:0/2030989571 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16665 (secure 0 0 0) 0x7f74c813c170 con 0x7f74c8146540 2023-09-13T06:08:26.510 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:26.510 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":142,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:08:17.386149+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:38.276233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:39.032744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:08:26.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74ce49c640 1 -- 172.21.15.130:0/2030989571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74b4065b20 msgr2=0x7f74b4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74ce49c640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74b4065b20 0x7f74b4067fe0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f74b8000f70 tx=0x7f74b8009040 comp rx=0 tx=0).stop 2023-09-13T06:08:26.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74ce49c640 1 -- 172.21.15.130:0/2030989571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74c8146540 msgr2=0x7f74c813a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74ce49c640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74c8146540 0x7f74c813a540 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f74c000b9a0 tx=0x7f74c000be60 comp rx=0 tx=0).stop 2023-09-13T06:08:26.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74ce49c640 1 -- 172.21.15.130:0/2030989571 shutdown_connections 2023-09-13T06:08:26.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74ce49c640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74b4065b20 0x7f74b4067fe0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74ce49c640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74c8146540 0x7f74c813a540 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74ce49c640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74c81436e0 0x7f74c8159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74ce49c640 1 --2- 172.21.15.130:0/2030989571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74c8070b90 0x7f74c813c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.507+0000 7f74ce49c640 1 -- 172.21.15.130:0/2030989571 >> 172.21.15.130:0/2030989571 conn(0x7f74c80b0bc0 msgr2=0x7f74c8168620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:26.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.511+0000 7f74ce49c640 1 -- 172.21.15.130:0/2030989571 shutdown_connections 2023-09-13T06:08:26.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.511+0000 7f74ce49c640 1 -- 172.21.15.130:0/2030989571 wait complete. 2023-09-13T06:08:26.531 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:07:38.276233+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:07:39.032744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:08:26.532 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:08:26.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.671+0000 7fc6853c6640 1 Processor -- start 2023-09-13T06:08:26.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.671+0000 7fc6853c6640 1 -- start start 2023-09-13T06:08:26.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc6853c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6800b1460 0x7fc6800b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc6853c6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc6800b2fd0 0x7fc6800ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc6853c6640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6800cc850 con 0x7fc68015a080 2023-09-13T06:08:26.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc6853c6640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6800b33f0 con 0x7fc6800b2fd0 2023-09-13T06:08:26.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc6853c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800b0330 con 0x7fc6800b1460 2023-09-13T06:08:26.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc6800b2fd0 0x7fc6800ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc6800b2fd0 0x7fc6800ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45806/0 (socket says 172.21.15.130:45806) 2023-09-13T06:08:26.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67f7fe640 1 -- 172.21.15.130:0/634428060 learned_addr learned my addr 172.21.15.130:0/634428060 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:26.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67e7fc640 1 --2- 172.21.15.130:0/634428060 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6800b1460 0x7fc6800b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67f7fe640 1 -- 172.21.15.130:0/634428060 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6800b1460 msgr2=0x7fc6800b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:26.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67f7fe640 1 --2- 172.21.15.130:0/634428060 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6800b1460 0x7fc6800b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67f7fe640 1 -- 172.21.15.130:0/634428060 >> v1:172.21.15.164:6789/0 conn(0x7fc68015a080 legacy=0x7fc68015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67f7fe640 1 -- 172.21.15.130:0/634428060 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800cbcd0 con 0x7fc6800b2fd0 2023-09-13T06:08:26.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67f7fe640 1 --2- 172.21.15.130:0/634428060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6800b2fd0 0x7fc6800ccfe0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc678009e50 tx=0x7fc67801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c1b443df3da112 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:26.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67dffb640 1 -- 172.21.15.130:0/634428060 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780090d0 con 0x7fc6800b2fd0 2023-09-13T06:08:26.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67dffb640 1 -- 172.21.15.130:0/634428060 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc678009230 con 0x7fc6800b2fd0 2023-09-13T06:08:26.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.675+0000 7fc67dffb640 1 -- 172.21.15.130:0/634428060 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780a5940 con 0x7fc6800b2fd0 2023-09-13T06:08:26.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 -- 172.21.15.130:0/634428060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6800b2fd0 msgr2=0x7fc6800ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 --2- 172.21.15.130:0/634428060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6800b2fd0 0x7fc6800ccfe0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc678009e50 tx=0x7fc67801c950 comp rx=0 tx=0).stop 2023-09-13T06:08:26.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 -- 172.21.15.130:0/634428060 shutdown_connections 2023-09-13T06:08:26.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 --2- 172.21.15.130:0/634428060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6800b2fd0 0x7fc6800ccfe0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 --2- 172.21.15.130:0/634428060 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6800b1460 0x7fc6800b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 -- 172.21.15.130:0/634428060 >> 172.21.15.130:0/634428060 conn(0x7fc680065990 msgr2=0x7fc680065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:26.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 -- 172.21.15.130:0/634428060 shutdown_connections 2023-09-13T06:08:26.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 -- 172.21.15.130:0/634428060 wait complete. 2023-09-13T06:08:26.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 Processor -- start 2023-09-13T06:08:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 -- start start 2023-09-13T06:08:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6800b1460 0x7fc6801458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6800b2fd0 0x7fc6800ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc68015a080 0x7fc6800ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc680153d90 con 0x7fc68015a080 2023-09-13T06:08:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc680152160 con 0x7fc6800b2fd0 2023-09-13T06:08:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc6853c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6801518c0 con 0x7fc6800b1460 2023-09-13T06:08:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc67f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc68015a080 0x7fc6800ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc67f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc68015a080 0x7fc6800ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45818/0 (socket says 172.21.15.130:45818) 2023-09-13T06:08:26.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc67f7fe640 1 -- 172.21.15.130:0/2522561488 learned_addr learned my addr 172.21.15.130:0/2522561488 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:26.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc67e7fc640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6800b2fd0 0x7fc6800ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.679+0000 7fc67effd640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6800b1460 0x7fc6801458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc67f7fe640 1 -- 172.21.15.130:0/2522561488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6800b1460 msgr2=0x7fc6801458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc67f7fe640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6800b1460 0x7fc6801458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc67f7fe640 1 -- 172.21.15.130:0/2522561488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6800b2fd0 msgr2=0x7fc6800ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc67f7fe640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6800b2fd0 0x7fc6800ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc67f7fe640 1 -- 172.21.15.130:0/2522561488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc678009b30 con 0x7fc68015a080 2023-09-13T06:08:26.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc67f7fe640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc68015a080 0x7fc6800ce5a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc6780af040 tx=0x7fc6780196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:26.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc6677fe640 1 -- 172.21.15.130:0/2522561488 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780bd070 con 0x7fc68015a080 2023-09-13T06:08:26.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc6677fe640 1 -- 172.21.15.130:0/2522561488 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6780a5e80 con 0x7fc68015a080 2023-09-13T06:08:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc6677fe640 1 -- 172.21.15.130:0/2522561488 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780090d0 con 0x7fc68015a080 2023-09-13T06:08:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc6853c6640 1 -- 172.21.15.130:0/2522561488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc680151ba0 con 0x7fc68015a080 2023-09-13T06:08:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc6853c6640 1 -- 172.21.15.130:0/2522561488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc680145e30 con 0x7fc68015a080 2023-09-13T06:08:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc6853c6640 1 -- 172.21.15.130:0/2522561488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc680153f00 con 0x7fc68015a080 2023-09-13T06:08:26.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc6677fe640 1 -- 172.21.15.130:0/2522561488 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc6780b88e0 con 0x7fc68015a080 2023-09-13T06:08:26.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc6677fe640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc66c065b20 0x7fc66c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:26.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc6677fe640 1 -- 172.21.15.130:0/2522561488 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc67811df70 con 0x7fc68015a080 2023-09-13T06:08:26.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.683+0000 7fc67effd640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc66c065b20 0x7fc66c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:26.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.687+0000 7fc67effd640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc66c065b20 0x7fc66c067fe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc670000f70 tx=0x7fc670009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:26.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.687+0000 7fc6677fe640 1 -- 172.21.15.130:0/2522561488 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc6780eb7f0 con 0x7fc68015a080 2023-09-13T06:08:26.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.835+0000 7fc6853c6640 1 -- 172.21.15.130:0/2522561488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6800618a0 con 0x7fc68015a080 2023-09-13T06:08:26.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6677fe640 1 -- 172.21.15.130:0/2522561488 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc678009510 con 0x7fc68015a080 2023-09-13T06:08:26.841 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:08:26.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 -- 172.21.15.130:0/2522561488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc66c065b20 msgr2=0x7fc66c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc66c065b20 0x7fc66c067fe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc670000f70 tx=0x7fc670009040 comp rx=0 tx=0).stop 2023-09-13T06:08:26.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 -- 172.21.15.130:0/2522561488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc68015a080 msgr2=0x7fc6800ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:26.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc68015a080 0x7fc6800ce5a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc6780af040 tx=0x7fc6780196f0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 -- 172.21.15.130:0/2522561488 shutdown_connections 2023-09-13T06:08:26.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc66c065b20 0x7fc66c067fe0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6800b2fd0 0x7fc6800ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc68015a080 0x7fc6800ce5a0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 --2- 172.21.15.130:0/2522561488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6800b1460 0x7fc6801458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:26.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 -- 172.21.15.130:0/2522561488 >> 172.21.15.130:0/2522561488 conn(0x7fc680065990 msgr2=0x7fc680157680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:26.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 -- 172.21.15.130:0/2522561488 shutdown_connections 2023-09-13T06:08:26.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.839+0000 7fc6853c6640 1 -- 172.21.15.130:0/2522561488 wait complete. 2023-09-13T06:08:26.862 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:08:27.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.999+0000 7f381f66a640 1 Processor -- start 2023-09-13T06:08:27.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.999+0000 7f381f66a640 1 -- start start 2023-09-13T06:08:27.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.999+0000 7f381f66a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3818144d70 0x7f38180ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.999+0000 7f381f66a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f38180b1b70 0x7f38180b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.999+0000 7f381f66a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38180b3120 con 0x7f38180b2780 2023-09-13T06:08:27.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.999+0000 7f381f66a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180b2430 con 0x7f3818144d70 2023-09-13T06:08:27.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.999+0000 7f381f66a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180cedb0 con 0x7f38180b1b70 2023-09-13T06:08:27.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.999+0000 7f381d406640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3818144d70 0x7f38180ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.999+0000 7f381d406640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3818144d70 0x7f38180ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45832/0 (socket says 172.21.15.130:45832) 2023-09-13T06:08:27.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:26.999+0000 7f381d406640 1 -- 172.21.15.130:0/2461412548 learned_addr learned my addr 172.21.15.130:0/2461412548 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:27.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.003+0000 7f381dc07640 1 --2- 172.21.15.130:0/2461412548 >> v2:172.21.15.164:3300/0 conn(0x7f38180b1b70 0x7f38180b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.003+0000 7f381d406640 1 -- 172.21.15.130:0/2461412548 >> v2:172.21.15.164:3300/0 conn(0x7f38180b1b70 msgr2=0x7f38180b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:27.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.003+0000 7f381d406640 1 --2- 172.21.15.130:0/2461412548 >> v2:172.21.15.164:3300/0 conn(0x7f38180b1b70 0x7f38180b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.003+0000 7f381d406640 1 -- 172.21.15.130:0/2461412548 >> v1:172.21.15.164:6789/0 conn(0x7f38180b2780 legacy=0x7f38180b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:27.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.003+0000 7f381d406640 1 -- 172.21.15.130:0/2461412548 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180b2150 con 0x7f3818144d70 2023-09-13T06:08:27.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.003+0000 7f381d406640 1 --2- 172.21.15.130:0/2461412548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3818144d70 0x7f38180ce870 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f38180668f0 tx=0x7f381401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155892da7ec09a35 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:27.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.003+0000 7f380ffff640 1 -- 172.21.15.130:0/2461412548 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140ab600 con 0x7f3818144d70 2023-09-13T06:08:27.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.003+0000 7f380ffff640 1 -- 172.21.15.130:0/2461412548 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38140a7050 con 0x7f3818144d70 2023-09-13T06:08:27.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.003+0000 7f380ffff640 1 -- 172.21.15.130:0/2461412548 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140ab980 con 0x7f3818144d70 2023-09-13T06:08:27.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.003+0000 7f381f66a640 1 -- 172.21.15.130:0/2461412548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3818144d70 msgr2=0x7f38180ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.003+0000 7f381f66a640 1 --2- 172.21.15.130:0/2461412548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3818144d70 0x7f38180ce870 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f38180668f0 tx=0x7f381401c4c0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 -- 172.21.15.130:0/2461412548 shutdown_connections 2023-09-13T06:08:27.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 --2- 172.21.15.130:0/2461412548 >> v2:172.21.15.164:3300/0 conn(0x7f38180b1b70 0x7f38180b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 --2- 172.21.15.130:0/2461412548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3818144d70 0x7f38180ce870 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 -- 172.21.15.130:0/2461412548 >> 172.21.15.130:0/2461412548 conn(0x7f3818065990 msgr2=0x7f3818065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:27.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 -- 172.21.15.130:0/2461412548 shutdown_connections 2023-09-13T06:08:27.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 -- 172.21.15.130:0/2461412548 wait complete. 2023-09-13T06:08:27.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 Processor -- start 2023-09-13T06:08:27.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 -- start start 2023-09-13T06:08:27.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38180b1b70 0x7f381813b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38180b2780 0x7f38180b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3818144d70 0x7f38181505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180af370 con 0x7f38180b1b70 2023-09-13T06:08:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38181570f0 con 0x7f3818144d70 2023-09-13T06:08:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381f66a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3818157990 con 0x7f38180b2780 2023-09-13T06:08:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381d406640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38180b1b70 0x7f381813b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381d406640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38180b1b70 0x7f381813b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45838/0 (socket says 172.21.15.130:45838) 2023-09-13T06:08:27.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381d406640 1 -- 172.21.15.130:0/1783237070 learned_addr learned my addr 172.21.15.130:0/1783237070 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:27.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381cc05640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38180b2780 0x7f38180b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381dc07640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3818144d70 0x7f38181505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381d406640 1 -- 172.21.15.130:0/1783237070 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38180b2780 msgr2=0x7f38180b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381d406640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38180b2780 0x7f38180b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381d406640 1 -- 172.21.15.130:0/1783237070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3818144d70 msgr2=0x7f38181505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381d406640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3818144d70 0x7f38181505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381d406640 1 -- 172.21.15.130:0/1783237070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38140094d0 con 0x7f38180b1b70 2023-09-13T06:08:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.007+0000 7f381d406640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38180b1b70 0x7f381813b370 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f38140ae040 tx=0x7f3814019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.011+0000 7f380dffb640 1 -- 172.21.15.130:0/1783237070 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140b4420 con 0x7f38180b1b70 2023-09-13T06:08:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.011+0000 7f380dffb640 1 -- 172.21.15.130:0/1783237070 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38140b45a0 con 0x7f38180b1b70 2023-09-13T06:08:27.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.011+0000 7f380dffb640 1 -- 172.21.15.130:0/1783237070 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140b4950 con 0x7f38180b1b70 2023-09-13T06:08:27.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.011+0000 7f381f66a640 1 -- 172.21.15.130:0/1783237070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3818150b30 con 0x7f38180b1b70 2023-09-13T06:08:27.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.011+0000 7f381f66a640 1 -- 172.21.15.130:0/1783237070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38180af090 con 0x7f38180b1b70 2023-09-13T06:08:27.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.011+0000 7f381f66a640 1 -- 172.21.15.130:0/1783237070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38180618a0 con 0x7f38180b1b70 2023-09-13T06:08:27.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.011+0000 7f380dffb640 1 -- 172.21.15.130:0/1783237070 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f38140b2070 con 0x7f38180b1b70 2023-09-13T06:08:27.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.011+0000 7f380dffb640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37fc065b20 0x7f37fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.011+0000 7f380dffb640 1 -- 172.21.15.130:0/1783237070 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f381411c470 con 0x7f38180b1b70 2023-09-13T06:08:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.011+0000 7f381cc05640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37fc065b20 0x7f37fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.015+0000 7f381cc05640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37fc065b20 0x7f37fc067fe0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3818142640 tx=0x7f3808009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.015+0000 7f380dffb640 1 -- 172.21.15.130:0/1783237070 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f38140e9ce0 con 0x7f38180b1b70 2023-09-13T06:08:27.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.163+0000 7f381f66a640 1 -- 172.21.15.130:0/1783237070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f381815d120 con 0x7f38180b1b70 2023-09-13T06:08:27.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.163+0000 7f380dffb640 1 -- 172.21.15.130:0/1783237070 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v142) v1 ==== 104+0+11 (secure 0 0 0) 0x7f38140ed300 con 0x7f38180b1b70 2023-09-13T06:08:27.167 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:08:27.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.163+0000 7f381f66a640 1 -- 172.21.15.130:0/1783237070 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37fc065b20 msgr2=0x7f37fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.163+0000 7f381f66a640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37fc065b20 0x7f37fc067fe0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3818142640 tx=0x7f3808009040 comp rx=0 tx=0).stop 2023-09-13T06:08:27.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.163+0000 7f381f66a640 1 -- 172.21.15.130:0/1783237070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38180b1b70 msgr2=0x7f381813b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.163+0000 7f381f66a640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38180b1b70 0x7f381813b370 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f38140ae040 tx=0x7f3814019260 comp rx=0 tx=0).stop 2023-09-13T06:08:27.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.163+0000 7f381f66a640 1 -- 172.21.15.130:0/1783237070 shutdown_connections 2023-09-13T06:08:27.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.163+0000 7f381f66a640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f37fc065b20 0x7f37fc067fe0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.163+0000 7f381f66a640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3818144d70 0x7f38181505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.163+0000 7f381f66a640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38180b2780 0x7f38180b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.163+0000 7f381f66a640 1 --2- 172.21.15.130:0/1783237070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38180b1b70 0x7f381813b370 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.167+0000 7f381f66a640 1 -- 172.21.15.130:0/1783237070 >> 172.21.15.130:0/1783237070 conn(0x7f3818065990 msgr2=0x7f38180b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:27.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.167+0000 7f381f66a640 1 -- 172.21.15.130:0/1783237070 shutdown_connections 2023-09-13T06:08:27.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.167+0000 7f381f66a640 1 -- 172.21.15.130:0/1783237070 wait complete. 2023-09-13T06:08:27.187 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:08:27.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.323+0000 7f5acc167640 1 Processor -- start 2023-09-13T06:08:27.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.323+0000 7f5acc167640 1 -- start start 2023-09-13T06:08:27.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5acc167640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac415a080 0x7f5ac40b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5acc167640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5ac40b31a0 0x7f5ac40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5acc167640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac40cc850 con 0x7f5ac415e650 2023-09-13T06:08:27.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5acc167640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac40b0330 con 0x7f5ac40b31a0 2023-09-13T06:08:27.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5acc167640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40cbcd0 con 0x7f5ac415a080 2023-09-13T06:08:27.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5aca704640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5ac40b31a0 0x7f5ac40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5aca704640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5ac40b31a0 0x7f5ac40ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45854/0 (socket says 172.21.15.130:45854) 2023-09-13T06:08:27.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5aca704640 1 -- 172.21.15.130:0/1506309402 learned_addr learned my addr 172.21.15.130:0/1506309402 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:27.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5ac9f03640 1 --2- 172.21.15.130:0/1506309402 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac415a080 0x7f5ac40b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5aca704640 1 -- 172.21.15.130:0/1506309402 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac415a080 msgr2=0x7f5ac40b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:27.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5aca704640 1 --2- 172.21.15.130:0/1506309402 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac415a080 0x7f5ac40b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5aca704640 1 -- 172.21.15.130:0/1506309402 >> v1:172.21.15.130:6789/0 conn(0x7f5ac415e650 legacy=0x7f5ac40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5aca704640 1 -- 172.21.15.130:0/1506309402 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40cbfb0 con 0x7f5ac40b31a0 2023-09-13T06:08:27.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.327+0000 7f5ac8f01640 1 -- 172.21.15.130:0/1506309402 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542716424 0 0) 0x7f5ab4001120 con 0x7f5ac415e650 2023-09-13T06:08:27.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5aca704640 1 --2- 172.21.15.130:0/1506309402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac40b31a0 0x7f5ac40ccfe0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00d150 tx=0x7f5abc01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e2cb722dac77c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:27.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5ac8f01640 1 -- 172.21.15.130:0/1506309402 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc00b0d0 con 0x7f5ac40b31a0 2023-09-13T06:08:27.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5ac8f01640 1 -- 172.21.15.130:0/1506309402 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc00b230 con 0x7f5ac40b31a0 2023-09-13T06:08:27.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5ac8f01640 1 -- 172.21.15.130:0/1506309402 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0a7a20 con 0x7f5ac40b31a0 2023-09-13T06:08:27.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5acc167640 1 -- 172.21.15.130:0/1506309402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac40b31a0 msgr2=0x7f5ac40ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5acc167640 1 --2- 172.21.15.130:0/1506309402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac40b31a0 0x7f5ac40ccfe0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00d150 tx=0x7f5abc01eb50 comp rx=0 tx=0).stop 2023-09-13T06:08:27.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5acc167640 1 -- 172.21.15.130:0/1506309402 shutdown_connections 2023-09-13T06:08:27.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5acc167640 1 --2- 172.21.15.130:0/1506309402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac40b31a0 0x7f5ac40ccfe0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5acc167640 1 --2- 172.21.15.130:0/1506309402 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac415a080 0x7f5ac40b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5acc167640 1 -- 172.21.15.130:0/1506309402 >> 172.21.15.130:0/1506309402 conn(0x7f5ac4065990 msgr2=0x7f5ac4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:27.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5acc167640 1 -- 172.21.15.130:0/1506309402 shutdown_connections 2023-09-13T06:08:27.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5acc167640 1 -- 172.21.15.130:0/1506309402 wait complete. 2023-09-13T06:08:27.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5acc167640 1 Processor -- start 2023-09-13T06:08:27.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.331+0000 7f5acc167640 1 -- start start 2023-09-13T06:08:27.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5acc167640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ac40b31a0 0x7f5ac415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5acc167640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac415a080 0x7f5ac415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5acc167640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac415e650 0x7f5ac406cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5acc167640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac415d170 con 0x7f5ac415a080 2023-09-13T06:08:27.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5acc167640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac415d450 con 0x7f5ac40b31a0 2023-09-13T06:08:27.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5acc167640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac415d730 con 0x7f5ac415e650 2023-09-13T06:08:27.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5ac9702640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac415a080 0x7f5ac415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5ac9702640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac415a080 0x7f5ac415b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45860/0 (socket says 172.21.15.130:45860) 2023-09-13T06:08:27.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5ac9702640 1 -- 172.21.15.130:0/2365285213 learned_addr learned my addr 172.21.15.130:0/2365285213 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:27.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5ac9702640 1 -- 172.21.15.130:0/2365285213 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac415e650 msgr2=0x7f5ac406cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5aca704640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac415e650 0x7f5ac406cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5ac9f03640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ac40b31a0 0x7f5ac415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5ac9702640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac415e650 0x7f5ac406cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5ac9702640 1 -- 172.21.15.130:0/2365285213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ac40b31a0 msgr2=0x7f5ac415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5ac9702640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ac40b31a0 0x7f5ac415c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5ac9702640 1 -- 172.21.15.130:0/2365285213 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc00bd40 con 0x7f5ac415a080 2023-09-13T06:08:27.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5aca704640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac415e650 0x7f5ac406cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:27.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5ac9f03640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ac40b31a0 0x7f5ac415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:27.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5ac9702640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac415a080 0x7f5ac415b5f0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c3f0 tx=0x7f5ab400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:27.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5aba7fc640 1 -- 172.21.15.130:0/2365285213 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40052d0 con 0x7f5ac415a080 2023-09-13T06:08:27.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5aba7fc640 1 -- 172.21.15.130:0/2365285213 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab4005450 con 0x7f5ac415a080 2023-09-13T06:08:27.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5aba7fc640 1 -- 172.21.15.130:0/2365285213 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4003860 con 0x7f5ac415a080 2023-09-13T06:08:27.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5acc167640 1 -- 172.21.15.130:0/2365285213 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac415da10 con 0x7f5ac415a080 2023-09-13T06:08:27.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5acc167640 1 -- 172.21.15.130:0/2365285213 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac415ce20 con 0x7f5ac415a080 2023-09-13T06:08:27.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5acc167640 1 -- 172.21.15.130:0/2365285213 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac40618a0 con 0x7f5ac415a080 2023-09-13T06:08:27.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.335+0000 7f5aba7fc640 1 -- 172.21.15.130:0/2365285213 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5ab40039c0 con 0x7f5ac415a080 2023-09-13T06:08:27.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.339+0000 7f5aba7fc640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5aa8065b20 0x7f5aa8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.339+0000 7f5aba7fc640 1 -- 172.21.15.130:0/2365285213 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5ab4082850 con 0x7f5ac415a080 2023-09-13T06:08:27.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.339+0000 7f5ac9f03640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5aa8065b20 0x7f5aa8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.339+0000 7f5ac9f03640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5aa8065b20 0x7f5aa8067fe0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009ae0 tx=0x7f5ac0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:27.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.343+0000 7f5aba7fc640 1 -- 172.21.15.130:0/2365285213 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5ab40500d0 con 0x7f5ac415a080 2023-09-13T06:08:27.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.491+0000 7f5acc167640 1 -- 172.21.15.130:0/2365285213 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ac40cc850 con 0x7f5ac415a080 2023-09-13T06:08:27.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.491+0000 7f5aba7fc640 1 -- 172.21.15.130:0/2365285213 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v143) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ac40cc850 con 0x7f5ac415a080 2023-09-13T06:08:27.496 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:08:27.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 -- 172.21.15.130:0/2365285213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5aa8065b20 msgr2=0x7f5aa8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5aa8065b20 0x7f5aa8067fe0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009ae0 tx=0x7f5ac0008040 comp rx=0 tx=0).stop 2023-09-13T06:08:27.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 -- 172.21.15.130:0/2365285213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac415a080 msgr2=0x7f5ac415b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac415a080 0x7f5ac415b5f0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c3f0 tx=0x7f5ab400c8b0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 -- 172.21.15.130:0/2365285213 shutdown_connections 2023-09-13T06:08:27.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5aa8065b20 0x7f5aa8067fe0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ac415e650 0x7f5ac406cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac415a080 0x7f5ac415b5f0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 --2- 172.21.15.130:0/2365285213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ac40b31a0 0x7f5ac415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 -- 172.21.15.130:0/2365285213 >> 172.21.15.130:0/2365285213 conn(0x7f5ac4065990 msgr2=0x7f5ac4150be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:27.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 -- 172.21.15.130:0/2365285213 shutdown_connections 2023-09-13T06:08:27.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.495+0000 7f5acc167640 1 -- 172.21.15.130:0/2365285213 wait complete. 2023-09-13T06:08:27.518 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:08:27.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.655+0000 7fd15b59e640 1 Processor -- start 2023-09-13T06:08:27.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.655+0000 7fd15b59e640 1 -- start start 2023-09-13T06:08:27.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd15b59e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd15c15bc70 0x7fd15c070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd15b59e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c0cd800 con 0x7fd15c070180 2023-09-13T06:08:27.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd15b59e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c144630 con 0x7fd15c144250 2023-09-13T06:08:27.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd15b59e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c070b50 con 0x7fd15c15bc70 2023-09-13T06:08:27.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd153fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd15c070180 0x7fd15c15b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40814/0 (socket says 172.21.15.130:40814) 2023-09-13T06:08:27.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd153fff640 1 -- 172.21.15.130:0/2824354004 learned_addr learned my addr 172.21.15.130:0/2824354004 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:27.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd15ad9d640 1 --2- 172.21.15.130:0/2824354004 >> v2:172.21.15.164:3300/0 conn(0x7fd15c15bc70 0x7fd15c070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd159d9b640 1 -- 172.21.15.130:0/2824354004 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971688065 0 0) 0x7fd15c0cd800 con 0x7fd15c070180 2023-09-13T06:08:27.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd159d9b640 1 -- 172.21.15.130:0/2824354004 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd148003530 con 0x7fd15c070180 2023-09-13T06:08:27.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd15ad9d640 1 -- 172.21.15.130:0/2824354004 >> v1:172.21.15.164:6789/0 conn(0x7fd15c144250 legacy=0x7fd15c0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd159d9b640 1 -- 172.21.15.130:0/2824354004 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403878999 0 0) 0x7fd15c144630 con 0x7fd15c144250 2023-09-13T06:08:27.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd15ad9d640 1 -- 172.21.15.130:0/2824354004 >> v1:172.21.15.130:6789/0 conn(0x7fd15c070180 legacy=0x7fd15c15b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.659+0000 7fd15ad9d640 1 -- 172.21.15.130:0/2824354004 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c06e450 con 0x7fd15c15bc70 2023-09-13T06:08:27.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd15ad9d640 1 --2- 172.21.15.130:0/2824354004 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15c15bc70 0x7fd15c070610 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd154009d90 tx=0x7fd15401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39e6473a93044519 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:27.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd159d9b640 1 -- 172.21.15.130:0/2824354004 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1540a59e0 con 0x7fd15c15bc70 2023-09-13T06:08:27.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd159d9b640 1 -- 172.21.15.130:0/2824354004 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1540a5b40 con 0x7fd15c15bc70 2023-09-13T06:08:27.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd159d9b640 1 -- 172.21.15.130:0/2824354004 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1540ad440 con 0x7fd15c15bc70 2023-09-13T06:08:27.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd15b59e640 1 -- 172.21.15.130:0/2824354004 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15c15bc70 msgr2=0x7fd15c070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd15b59e640 1 --2- 172.21.15.130:0/2824354004 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15c15bc70 0x7fd15c070610 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd154009d90 tx=0x7fd15401c920 comp rx=0 tx=0).stop 2023-09-13T06:08:27.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd15b59e640 1 -- 172.21.15.130:0/2824354004 shutdown_connections 2023-09-13T06:08:27.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd15b59e640 1 --2- 172.21.15.130:0/2824354004 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15c15bc70 0x7fd15c070610 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd15b59e640 1 -- 172.21.15.130:0/2824354004 >> 172.21.15.130:0/2824354004 conn(0x7fd15c065b60 msgr2=0x7fd15c0aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:27.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd15b59e640 1 -- 172.21.15.130:0/2824354004 shutdown_connections 2023-09-13T06:08:27.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd15b59e640 1 -- 172.21.15.130:0/2824354004 wait complete. 2023-09-13T06:08:27.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd15b59e640 1 Processor -- start 2023-09-13T06:08:27.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.663+0000 7fd15b59e640 1 -- start start 2023-09-13T06:08:27.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd15b59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd15c070180 0x7fd15c15a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd15b59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd15c144250 0x7fd15c1631e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd15b59e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15c15bc70 0x7fd15c163720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd15b59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c160690 con 0x7fd15c144250 2023-09-13T06:08:27.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd15b59e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c1f8380 con 0x7fd15c15bc70 2023-09-13T06:08:27.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd15b59e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c1f85d0 con 0x7fd15c070180 2023-09-13T06:08:27.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd153fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd15c144250 0x7fd15c1631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd153fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd15c144250 0x7fd15c1631e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45870/0 (socket says 172.21.15.130:45870) 2023-09-13T06:08:27.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd153fff640 1 -- 172.21.15.130:0/2563172436 learned_addr learned my addr 172.21.15.130:0/2563172436 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:27.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd15a59c640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd15c070180 0x7fd15c15a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd15ad9d640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15c15bc70 0x7fd15c163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd153fff640 1 -- 172.21.15.130:0/2563172436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd15c070180 msgr2=0x7fd15c15a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd153fff640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd15c070180 0x7fd15c15a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd153fff640 1 -- 172.21.15.130:0/2563172436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15c15bc70 msgr2=0x7fd15c163720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd153fff640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15c15bc70 0x7fd15c163720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd153fff640 1 -- 172.21.15.130:0/2563172436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd154009a70 con 0x7fd15c144250 2023-09-13T06:08:27.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd153fff640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd15c144250 0x7fd15c1631e0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fd14400c4d0 tx=0x7fd14400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:27.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd152ffd640 1 -- 172.21.15.130:0/2563172436 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144005cf0 con 0x7fd15c144250 2023-09-13T06:08:27.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd152ffd640 1 -- 172.21.15.130:0/2563172436 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd144005e50 con 0x7fd15c144250 2023-09-13T06:08:27.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd15b59e640 1 -- 172.21.15.130:0/2563172436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15c1f88b0 con 0x7fd15c144250 2023-09-13T06:08:27.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd152ffd640 1 -- 172.21.15.130:0/2563172436 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144007270 con 0x7fd15c144250 2023-09-13T06:08:27.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd15b59e640 1 -- 172.21.15.130:0/2563172436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15c1f8e70 con 0x7fd15c144250 2023-09-13T06:08:27.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.667+0000 7fd15b59e640 1 -- 172.21.15.130:0/2563172436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15c0618a0 con 0x7fd15c144250 2023-09-13T06:08:27.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.671+0000 7fd152ffd640 1 -- 172.21.15.130:0/2563172436 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd1440073d0 con 0x7fd15c144250 2023-09-13T06:08:27.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.671+0000 7fd152ffd640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd13c065b20 0x7fd13c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:27.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.671+0000 7fd152ffd640 1 -- 172.21.15.130:0/2563172436 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd144082860 con 0x7fd15c144250 2023-09-13T06:08:27.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.671+0000 7fd15a59c640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd13c065b20 0x7fd13c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:27.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.671+0000 7fd152ffd640 1 -- 172.21.15.130:0/2563172436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7fd13c06d710 con 0x7fd15c144250 2023-09-13T06:08:27.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.671+0000 7fd15a59c640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd13c065b20 0x7fd13c067fe0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd14c000f70 tx=0x7fd14c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:27.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.675+0000 7fd152ffd640 1 -- 172.21.15.130:0/2563172436 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd144017020 con 0x7fd15c144250 2023-09-13T06:08:27.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.851+0000 7fd15b59e640 1 -- 172.21.15.130:0/2563172436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd15c0cdd30 con 0x7fd15c144250 2023-09-13T06:08:27.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd152ffd640 1 -- 172.21.15.130:0/2563172436 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fd144082070 con 0x7fd15c144250 2023-09-13T06:08:27.857 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:27.857 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1309237651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1309237651},{"type":"v1","addr":"172.21.15.130:6837","nonce":1309237651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1568650238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1568650238},{"type":"v1","addr":"172.21.15.164:6834","nonce":1568650238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1994572743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1994572743},{"type":"v1","addr":"172.21.15.130:6836","nonce":1994572743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:39.911036+0000","modified":"2023-09-13T06:07:42.935333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7773},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7773":{"gid":7773,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/4146626637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4146626637},{"type":"v1","addr":"172.21.15.164:6835","nonce":4146626637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-09-13T06:08:27.858 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 68 2023-09-13T06:08:27.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 -- 172.21.15.130:0/2563172436 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd13c065b20 msgr2=0x7fd13c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd13c065b20 0x7fd13c067fe0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd14c000f70 tx=0x7fd14c009040 comp rx=0 tx=0).stop 2023-09-13T06:08:27.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 -- 172.21.15.130:0/2563172436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd15c144250 msgr2=0x7fd15c1631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:27.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd15c144250 0x7fd15c1631e0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fd14400c4d0 tx=0x7fd14400c990 comp rx=0 tx=0).stop 2023-09-13T06:08:27.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 -- 172.21.15.130:0/2563172436 shutdown_connections 2023-09-13T06:08:27.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd13c065b20 0x7fd13c067fe0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd15c15bc70 0x7fd15c163720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd15c144250 0x7fd15c1631e0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 --2- 172.21.15.130:0/2563172436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd15c070180 0x7fd15c15a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:27.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 -- 172.21.15.130:0/2563172436 >> 172.21.15.130:0/2563172436 conn(0x7fd15c065b60 msgr2=0x7fd15c143390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:27.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 -- 172.21.15.130:0/2563172436 shutdown_connections 2023-09-13T06:08:27.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:27.855+0000 7fd15b59e640 1 -- 172.21.15.130:0/2563172436 wait complete. 2023-09-13T06:08:27.878 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:08:28.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.011+0000 7fcfc7ed8640 1 Processor -- start 2023-09-13T06:08:28.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc7ed8640 1 -- start start 2023-09-13T06:08:28.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc7ed8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcfc0159f20 0x7fcfc00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc7ed8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfc00cdfc0 0x7fcfc00b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc7ed8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcfc00b1610 0x7fcfc00b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc7ed8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc00b00f0 con 0x7fcfc00b1610 2023-09-13T06:08:28.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc7ed8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc00ce420 con 0x7fcfc0159f20 2023-09-13T06:08:28.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc7ed8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc00b11d0 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc6475640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcfc00b1610 0x7fcfc00b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc6475640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcfc00b1610 0x7fcfc00b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45872/0 (socket says 172.21.15.130:45872) 2023-09-13T06:08:28.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc6475640 1 -- 172.21.15.130:0/1966707558 learned_addr learned my addr 172.21.15.130:0/1966707558 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:28.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc5c74640 1 --2- 172.21.15.130:0/1966707558 >> v2:172.21.15.164:3300/0 conn(0x7fcfc0159f20 0x7fcfc00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc5473640 1 --2- 172.21.15.130:0/1966707558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfc00cdfc0 0x7fcfc00b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc6475640 1 -- 172.21.15.130:0/1966707558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfc00cdfc0 msgr2=0x7fcfc00b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:28.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc6475640 1 --2- 172.21.15.130:0/1966707558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfc00cdfc0 0x7fcfc00b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc6475640 1 -- 172.21.15.130:0/1966707558 >> v2:172.21.15.164:3300/0 conn(0x7fcfc0159f20 msgr2=0x7fcfc00ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:28.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc6475640 1 --2- 172.21.15.130:0/1966707558 >> v2:172.21.15.164:3300/0 conn(0x7fcfc0159f20 0x7fcfc00ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc6475640 1 -- 172.21.15.130:0/1966707558 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00ccfd0 con 0x7fcfc00b1610 2023-09-13T06:08:28.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc5c74640 1 --2- 172.21.15.130:0/1966707558 >> v2:172.21.15.164:3300/0 conn(0x7fcfc0159f20 0x7fcfc00ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:28.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.015+0000 7fcfc5473640 1 --2- 172.21.15.130:0/1966707558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfc00cdfc0 0x7fcfc00b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:28.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc6475640 1 --2- 172.21.15.130:0/1966707558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfc00b1610 0x7fcfc00b1a80 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00b2660 tx=0x7fcfb801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f17de93b3cd7aec server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:28.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc4c72640 1 -- 172.21.15.130:0/1966707558 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80a7760 con 0x7fcfc00b1610 2023-09-13T06:08:28.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc4c72640 1 -- 172.21.15.130:0/1966707558 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb80a78c0 con 0x7fcfc00b1610 2023-09-13T06:08:28.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc4c72640 1 -- 172.21.15.130:0/1966707558 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80a7c50 con 0x7fcfc00b1610 2023-09-13T06:08:28.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/1966707558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfc00b1610 msgr2=0x7fcfc00b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc7ed8640 1 --2- 172.21.15.130:0/1966707558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfc00b1610 0x7fcfc00b1a80 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00b2660 tx=0x7fcfb801ebe0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/1966707558 shutdown_connections 2023-09-13T06:08:28.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc7ed8640 1 --2- 172.21.15.130:0/1966707558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfc00b1610 0x7fcfc00b1a80 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc7ed8640 1 --2- 172.21.15.130:0/1966707558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfc00cdfc0 0x7fcfc00b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc7ed8640 1 --2- 172.21.15.130:0/1966707558 >> v2:172.21.15.164:3300/0 conn(0x7fcfc0159f20 0x7fcfc00ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/1966707558 >> 172.21.15.130:0/1966707558 conn(0x7fcfc0065990 msgr2=0x7fcfc0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:28.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/1966707558 shutdown_connections 2023-09-13T06:08:28.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/1966707558 wait complete. 2023-09-13T06:08:28.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc7ed8640 1 Processor -- start 2023-09-13T06:08:28.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.019+0000 7fcfc7ed8640 1 -- start start 2023-09-13T06:08:28.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc7ed8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfc00b1610 0x7fcfc00ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc7ed8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfc00cdfc0 0x7fcfc00aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc7ed8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfc0159f20 0x7fcfc01477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc7ed8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc00a8950 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc7ed8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc01f4ce0 con 0x7fcfc00b1610 2023-09-13T06:08:28.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc7ed8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc01f4fc0 con 0x7fcfc0159f20 2023-09-13T06:08:28.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc5473640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfc00cdfc0 0x7fcfc00aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc5473640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfc00cdfc0 0x7fcfc00aa6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45878/0 (socket says 172.21.15.130:45878) 2023-09-13T06:08:28.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc5473640 1 -- 172.21.15.130:0/961047232 learned_addr learned my addr 172.21.15.130:0/961047232 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:28.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc5c74640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfc00b1610 0x7fcfc00ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc6475640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfc0159f20 0x7fcfc01477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc5473640 1 -- 172.21.15.130:0/961047232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfc0159f20 msgr2=0x7fcfc01477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc5473640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfc0159f20 0x7fcfc01477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc5473640 1 -- 172.21.15.130:0/961047232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfc00b1610 msgr2=0x7fcfc00ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc5473640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfc00b1610 0x7fcfc00ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc5473640 1 -- 172.21.15.130:0/961047232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb8009b30 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc5473640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfc00cdfc0 0x7fcfc00aa6f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000c7c0 tx=0x7fcfb000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:28.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfb67fc640 1 -- 172.21.15.130:0/961047232 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0007a30 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfb67fc640 1 -- 172.21.15.130:0/961047232 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb0007b90 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfb67fc640 1 -- 172.21.15.130:0/961047232 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000ce70 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/961047232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc01f52a0 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/961047232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc00ac9e0 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.023+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/961047232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc00a8ac0 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.027+0000 7fcfb67fc640 1 -- 172.21.15.130:0/961047232 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcfb00113f0 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.027+0000 7fcfb67fc640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcfa4065b20 0x7fcfa4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.027+0000 7fcfb67fc640 1 -- 172.21.15.130:0/961047232 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcfb0083810 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.027+0000 7fcfc5c74640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcfa4065b20 0x7fcfa4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.027+0000 7fcfb67fc640 1 -- 172.21.15.130:0/961047232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7fcfa406d710 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.027+0000 7fcfc5c74640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcfa4065b20 0x7fcfa4067fe0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc006fd0 tx=0x7fcfbc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:28.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.031+0000 7fcfb67fc640 1 -- 172.21.15.130:0/961047232 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcfc00a8ac0 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.179+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/961047232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfc01f5750 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfb67fc640 1 -- 172.21.15.130:0/961047232 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16684 (secure 0 0 0) 0x7fcfb001e090 con 0x7fcfc00cdfc0 2023-09-13T06:08:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:28.185 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":143,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:08:27.392316+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:38.276233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:39.032744+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:08:28.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/961047232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcfa4065b20 msgr2=0x7fcfa4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcfa4065b20 0x7fcfa4067fe0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc006fd0 tx=0x7fcfbc008040 comp rx=0 tx=0).stop 2023-09-13T06:08:28.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/961047232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfc00cdfc0 msgr2=0x7fcfc00aa6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfc00cdfc0 0x7fcfc00aa6f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000c7c0 tx=0x7fcfb000cc80 comp rx=0 tx=0).stop 2023-09-13T06:08:28.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/961047232 shutdown_connections 2023-09-13T06:08:28.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcfa4065b20 0x7fcfa4067fe0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfc0159f20 0x7fcfc01477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfc00cdfc0 0x7fcfc00aa6f0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 --2- 172.21.15.130:0/961047232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfc00b1610 0x7fcfc00ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/961047232 >> 172.21.15.130:0/961047232 conn(0x7fcfc0065990 msgr2=0x7fcfc0070780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:28.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/961047232 shutdown_connections 2023-09-13T06:08:28.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.183+0000 7fcfc7ed8640 1 -- 172.21.15.130:0/961047232 wait complete. 2023-09-13T06:08:28.206 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:08:28.206 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:08:28.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.339+0000 7f2068fd2640 1 Processor -- start 2023-09-13T06:08:28.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.339+0000 7f2068fd2640 1 -- start start 2023-09-13T06:08:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2068fd2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640cc780 0x7f206415b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2068fd2640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f20640b04a0 0x7f20640b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2068fd2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20640ccbe0 con 0x7f206415b130 2023-09-13T06:08:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2068fd2640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20640b0e70 con 0x7f20640b04a0 2023-09-13T06:08:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2068fd2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20640ce980 con 0x7f20640cc780 2023-09-13T06:08:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2062d9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f20640b04a0 0x7f20640b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2061d9b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640cc780 0x7f206415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2061d9b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640cc780 0x7f206415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:47228/0 (socket says 172.21.15.130:47228) 2023-09-13T06:08:28.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2061d9b640 1 -- 172.21.15.130:0/3042447433 learned_addr learned my addr 172.21.15.130:0/3042447433 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2062d9d640 1 --2- 172.21.15.130:0/3042447433 >> v2:172.21.15.164:3300/0 conn(0x7f20640b04a0 0x7f20640b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:40614/0 (socket says 172.21.15.130:40614) 2023-09-13T06:08:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f206259c640 1 --1- 172.21.15.130:0/3042447433 >> v1:172.21.15.164:6789/0 conn(0x7f206415b130 0x7f20640ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:45172/0 (socket says 172.21.15.130:45172) 2023-09-13T06:08:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2061d9b640 1 -- 172.21.15.130:0/3042447433 >> v2:172.21.15.164:3300/0 conn(0x7f20640b04a0 msgr2=0x7f20640b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2061d9b640 1 --2- 172.21.15.130:0/3042447433 >> v2:172.21.15.164:3300/0 conn(0x7f20640b04a0 0x7f20640b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2061d9b640 1 -- 172.21.15.130:0/3042447433 >> v1:172.21.15.164:6789/0 conn(0x7f206415b130 legacy=0x7f20640ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.343+0000 7f2061d9b640 1 -- 172.21.15.130:0/3042447433 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20640cec60 con 0x7f20640cc780 2023-09-13T06:08:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f2061d9b640 1 --2- 172.21.15.130:0/3042447433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640cc780 0x7f206415b510 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2058009e50 tx=0x7f205801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e362ed2f59fe2a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f206159a640 1 -- 172.21.15.130:0/3042447433 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580a58a0 con 0x7f20640cc780 2023-09-13T06:08:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f206159a640 1 -- 172.21.15.130:0/3042447433 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20580a5a00 con 0x7f20640cc780 2023-09-13T06:08:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f206159a640 1 -- 172.21.15.130:0/3042447433 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580a5d90 con 0x7f20640cc780 2023-09-13T06:08:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f2068fd2640 1 -- 172.21.15.130:0/3042447433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640cc780 msgr2=0x7f206415b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f2068fd2640 1 --2- 172.21.15.130:0/3042447433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640cc780 0x7f206415b510 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2058009e50 tx=0x7f205801c9e0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f2068fd2640 1 -- 172.21.15.130:0/3042447433 shutdown_connections 2023-09-13T06:08:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f2068fd2640 1 --2- 172.21.15.130:0/3042447433 >> v2:172.21.15.164:3300/0 conn(0x7f20640b04a0 0x7f20640b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f2068fd2640 1 --2- 172.21.15.130:0/3042447433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640cc780 0x7f206415b510 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f2068fd2640 1 -- 172.21.15.130:0/3042447433 >> 172.21.15.130:0/3042447433 conn(0x7f2064065990 msgr2=0x7f2064065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f2068fd2640 1 -- 172.21.15.130:0/3042447433 shutdown_connections 2023-09-13T06:08:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f2068fd2640 1 -- 172.21.15.130:0/3042447433 wait complete. 2023-09-13T06:08:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.347+0000 7f2068fd2640 1 Processor -- start 2023-09-13T06:08:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2068fd2640 1 -- start start 2023-09-13T06:08:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2068fd2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640b04a0 0x7f2064158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2068fd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20640cc780 0x7f20641561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2068fd2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206415b130 0x7f2064145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2068fd2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2064156730 con 0x7f20640cc780 2023-09-13T06:08:28.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2068fd2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20641593f0 con 0x7f206415b130 2023-09-13T06:08:28.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2068fd2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2064159110 con 0x7f20640b04a0 2023-09-13T06:08:28.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2061d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20640cc780 0x7f20641561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2061d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20640cc780 0x7f20641561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45892/0 (socket says 172.21.15.130:45892) 2023-09-13T06:08:28.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2061d9b640 1 -- 172.21.15.130:0/1158217253 learned_addr learned my addr 172.21.15.130:0/1158217253 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:28.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f206259c640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640b04a0 0x7f2064158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2062d9d640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206415b130 0x7f2064145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2061d9b640 1 -- 172.21.15.130:0/1158217253 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640b04a0 msgr2=0x7f2064158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2061d9b640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640b04a0 0x7f2064158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2061d9b640 1 -- 172.21.15.130:0/1158217253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206415b130 msgr2=0x7f2064145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2061d9b640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206415b130 0x7f2064145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2061d9b640 1 -- 172.21.15.130:0/1158217253 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2058009b30 con 0x7f20640cc780 2023-09-13T06:08:28.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2061d9b640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20640cc780 0x7f20641561f0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f20580af040 tx=0x7f2058019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:28.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2052ffd640 1 -- 172.21.15.130:0/1158217253 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580b8670 con 0x7f20640cc780 2023-09-13T06:08:28.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2052ffd640 1 -- 172.21.15.130:0/1158217253 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20580b87f0 con 0x7f20640cc780 2023-09-13T06:08:28.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2052ffd640 1 -- 172.21.15.130:0/1158217253 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580b8ba0 con 0x7f20640cc780 2023-09-13T06:08:28.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2068fd2640 1 -- 172.21.15.130:0/1158217253 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20640af340 con 0x7f20640cc780 2023-09-13T06:08:28.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2068fd2640 1 -- 172.21.15.130:0/1158217253 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20640af900 con 0x7f20640cc780 2023-09-13T06:08:28.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.351+0000 7f2068fd2640 1 -- 172.21.15.130:0/1158217253 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20640afaf0 con 0x7f20640cc780 2023-09-13T06:08:28.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.355+0000 7f2052ffd640 1 -- 172.21.15.130:0/1158217253 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f20580b8d00 con 0x7f20640cc780 2023-09-13T06:08:28.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.355+0000 7f2052ffd640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2044065b50 0x7f2044068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.355+0000 7f2052ffd640 1 -- 172.21.15.130:0/1158217253 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f205811e800 con 0x7f20640cc780 2023-09-13T06:08:28.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.355+0000 7f2052ffd640 1 -- 172.21.15.130:0/1158217253 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7f204406d740 con 0x7f20640cc780 2023-09-13T06:08:28.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.355+0000 7f206259c640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2044065b50 0x7f2044068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.355+0000 7f206259c640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2044065b50 0x7f2044068010 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2054000f70 tx=0x7f2054007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:28.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.359+0000 7f2052ffd640 1 -- 172.21.15.130:0/1158217253 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f20580ec2d0 con 0x7f20640cc780 2023-09-13T06:08:28.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 -- 172.21.15.130:0/1158217253 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20640618a0 con 0x7f20640cc780 2023-09-13T06:08:28.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2052ffd640 1 -- 172.21.15.130:0/1158217253 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f20580bc030 con 0x7f20640cc780 2023-09-13T06:08:28.541 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:28.542 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1309237651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1309237651},{"type":"v1","addr":"172.21.15.130:6837","nonce":1309237651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1568650238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1568650238},{"type":"v1","addr":"172.21.15.164:6834","nonce":1568650238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1994572743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1994572743},{"type":"v1","addr":"172.21.15.130:6836","nonce":1994572743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:39.911036+0000","modified":"2023-09-13T06:07:42.935333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7773},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7773":{"gid":7773,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/4146626637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4146626637},{"type":"v1","addr":"172.21.15.164:6835","nonce":4146626637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-09-13T06:08:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 68 2023-09-13T06:08:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 -- 172.21.15.130:0/1158217253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2044065b50 msgr2=0x7f2044068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2044065b50 0x7f2044068010 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2054000f70 tx=0x7f2054007e50 comp rx=0 tx=0).stop 2023-09-13T06:08:28.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 -- 172.21.15.130:0/1158217253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20640cc780 msgr2=0x7f20641561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20640cc780 0x7f20641561f0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f20580af040 tx=0x7f2058019780 comp rx=0 tx=0).stop 2023-09-13T06:08:28.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 -- 172.21.15.130:0/1158217253 shutdown_connections 2023-09-13T06:08:28.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2044065b50 0x7f2044068010 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f206415b130 0x7f2064145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20640cc780 0x7f20641561f0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 --2- 172.21.15.130:0/1158217253 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20640b04a0 0x7f2064158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 -- 172.21.15.130:0/1158217253 >> 172.21.15.130:0/1158217253 conn(0x7f2064065990 msgr2=0x7f2064070160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:28.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 -- 172.21.15.130:0/1158217253 shutdown_connections 2023-09-13T06:08:28.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.539+0000 7f2068fd2640 1 -- 172.21.15.130:0/1158217253 wait complete. 2023-09-13T06:08:28.563 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:08:28.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.699+0000 7fae4359e640 1 Processor -- start 2023-09-13T06:08:28.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.699+0000 7fae4359e640 1 -- start start 2023-09-13T06:08:28.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4359e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fae44146eb0 0x7fae440b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4359e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae44071440 con 0x7fae440b7ca0 2023-09-13T06:08:28.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4359e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae440706a0 con 0x7fae44161100 2023-09-13T06:08:28.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4359e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae440b5130 con 0x7fae44146eb0 2023-09-13T06:08:28.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae42d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fae440b7ca0 0x7fae440b8110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40824/0 (socket says 172.21.15.130:40824) 2023-09-13T06:08:28.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae42d9d640 1 -- 172.21.15.130:0/2792128567 learned_addr learned my addr 172.21.15.130:0/2792128567 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:28.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4259c640 1 --2- 172.21.15.130:0/2792128567 >> v2:172.21.15.164:3300/0 conn(0x7fae44146eb0 0x7fae440b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723941292 0 0) 0x7fae44071440 con 0x7fae440b7ca0 2023-09-13T06:08:28.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae2c003530 con 0x7fae440b7ca0 2023-09-13T06:08:28.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2053804423 0 0) 0x7fae2c003530 con 0x7fae440b7ca0 2023-09-13T06:08:28.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 >> v2:172.21.15.164:3300/0 conn(0x7fae44146eb0 msgr2=0x7fae440b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:28.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 --2- 172.21.15.130:0/2792128567 >> v2:172.21.15.164:3300/0 conn(0x7fae44146eb0 0x7fae440b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 >> v1:172.21.15.164:6789/0 conn(0x7fae44161100 legacy=0x7fae44161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae44147290 con 0x7fae440b7ca0 2023-09-13T06:08:28.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fae3c001a00 con 0x7fae440b7ca0 2023-09-13T06:08:28.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 >> v1:172.21.15.130:6789/0 conn(0x7fae440b7ca0 legacy=0x7fae440b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae2c0039f0 0x7fae2c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae2c0047d0 0x7fae2c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae2c005190 0x7fae2c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae440b5130 con 0x7fae2c005190 2023-09-13T06:08:28.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c00c0c0 con 0x7fae2c0047d0 2023-09-13T06:08:28.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c00c280 con 0x7fae2c0039f0 2023-09-13T06:08:28.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae42d9d640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae2c005190 0x7fae2c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae4259c640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae2c0039f0 0x7fae2c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae41d9b640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae2c0047d0 0x7fae2c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae42d9d640 1 -- 172.21.15.130:0/2792128567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae2c0039f0 msgr2=0x7fae2c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:28.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae42d9d640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae2c0039f0 0x7fae2c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae42d9d640 1 -- 172.21.15.130:0/2792128567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae2c0047d0 msgr2=0x7fae2c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:28.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae42d9d640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae2c0047d0 0x7fae2c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae42d9d640 1 -- 172.21.15.130:0/2792128567 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c003530 con 0x7fae2c005190 2023-09-13T06:08:28.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.703+0000 7fae41d9b640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae2c0047d0 0x7fae2c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:28.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae42d9d640 1 -- 172.21.15.130:0/2792128567 reap_dead start 2023-09-13T06:08:28.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae42d9d640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae2c005190 0x7fae2c00b990 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00a800 tx=0x7fae3c01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96075f792431f18 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:28.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0ac620 con 0x7fae2c005190 2023-09-13T06:08:28.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c0a8070 con 0x7fae2c005190 2023-09-13T06:08:28.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae4159a640 1 -- 172.21.15.130:0/2792128567 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0aca00 con 0x7fae2c005190 2023-09-13T06:08:28.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae4359e640 1 -- 172.21.15.130:0/2792128567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae2c005190 msgr2=0x7fae2c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae4359e640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae2c005190 0x7fae2c00b990 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00a800 tx=0x7fae3c01d300 comp rx=0 tx=0).stop 2023-09-13T06:08:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae4359e640 1 -- 172.21.15.130:0/2792128567 shutdown_connections 2023-09-13T06:08:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae4359e640 1 --2- 172.21.15.130:0/2792128567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae2c005190 0x7fae2c00b990 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae4359e640 1 -- 172.21.15.130:0/2792128567 >> 172.21.15.130:0/2792128567 conn(0x7fae440cdd10 msgr2=0x7fae440ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae4359e640 1 -- 172.21.15.130:0/2792128567 shutdown_connections 2023-09-13T06:08:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.707+0000 7fae4359e640 1 -- 172.21.15.130:0/2792128567 wait complete. 2023-09-13T06:08:28.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae4359e640 1 Processor -- start 2023-09-13T06:08:28.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae4359e640 1 -- start start 2023-09-13T06:08:28.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae4359e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae2c005190 0x7fae44141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae4359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae440c96d0 0x7fae440c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae4359e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae440d2450 0x7fae440d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae4359e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae441f4290 con 0x7fae440c96d0 2023-09-13T06:08:28.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae4359e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae440d2e10 con 0x7fae2c005190 2023-09-13T06:08:28.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae4359e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae440caae0 con 0x7fae440d2450 2023-09-13T06:08:28.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae41d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae440c96d0 0x7fae440c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae41d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae440c96d0 0x7fae440c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45910/0 (socket says 172.21.15.130:45910) 2023-09-13T06:08:28.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae41d9b640 1 -- 172.21.15.130:0/309047791 learned_addr learned my addr 172.21.15.130:0/309047791 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:28.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae4259c640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae2c005190 0x7fae44141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae42d9d640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae440d2450 0x7fae440d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae41d9b640 1 -- 172.21.15.130:0/309047791 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae440d2450 msgr2=0x7fae440d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae41d9b640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae440d2450 0x7fae440d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae41d9b640 1 -- 172.21.15.130:0/309047791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae2c005190 msgr2=0x7fae44141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae41d9b640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae2c005190 0x7fae44141c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae41d9b640 1 -- 172.21.15.130:0/309047791 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae441421d0 con 0x7fae440c96d0 2023-09-13T06:08:28.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae41d9b640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae440c96d0 0x7fae440c9b50 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fae3800e480 tx=0x7fae3800e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:28.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae32ffd640 1 -- 172.21.15.130:0/309047791 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae380052e0 con 0x7fae440c96d0 2023-09-13T06:08:28.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae32ffd640 1 -- 172.21.15.130:0/309047791 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae38005440 con 0x7fae440c96d0 2023-09-13T06:08:28.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae32ffd640 1 -- 172.21.15.130:0/309047791 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38003820 con 0x7fae440c96d0 2023-09-13T06:08:28.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae4359e640 1 -- 172.21.15.130:0/309047791 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae440ca240 con 0x7fae440c96d0 2023-09-13T06:08:28.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.711+0000 7fae4359e640 1 -- 172.21.15.130:0/309047791 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae440ca800 con 0x7fae440c96d0 2023-09-13T06:08:28.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.715+0000 7fae4359e640 1 -- 172.21.15.130:0/309047791 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae441f4400 con 0x7fae440c96d0 2023-09-13T06:08:28.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.715+0000 7fae32ffd640 1 -- 172.21.15.130:0/309047791 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fae38003980 con 0x7fae440c96d0 2023-09-13T06:08:28.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.715+0000 7fae32ffd640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae24065b50 0x7fae24068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:28.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.715+0000 7fae32ffd640 1 -- 172.21.15.130:0/309047791 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fae380830c0 con 0x7fae440c96d0 2023-09-13T06:08:28.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.715+0000 7fae4259c640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae24065b50 0x7fae24068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:28.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.715+0000 7fae32ffd640 1 -- 172.21.15.130:0/309047791 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7fae2406d740 con 0x7fae440c96d0 2023-09-13T06:08:28.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.715+0000 7fae4259c640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae24065b50 0x7fae24068010 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fae34009aa0 tx=0x7fae34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:28.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.719+0000 7fae32ffd640 1 -- 172.21.15.130:0/309047791 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fae441f4400 con 0x7fae440c96d0 2023-09-13T06:08:28.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.895+0000 7fae4359e640 1 -- 172.21.15.130:0/309047791 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae441f43d0 con 0x7fae440c96d0 2023-09-13T06:08:28.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.895+0000 7fae32ffd640 1 -- 172.21.15.130:0/309047791 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fae380509c0 con 0x7fae440c96d0 2023-09-13T06:08:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:28.901 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1309237651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1309237651},{"type":"v1","addr":"172.21.15.130:6837","nonce":1309237651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1568650238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1568650238},{"type":"v1","addr":"172.21.15.164:6834","nonce":1568650238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1994572743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1994572743},{"type":"v1","addr":"172.21.15.130:6836","nonce":1994572743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:07:39.911036+0000","modified":"2023-09-13T06:07:42.935333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7773},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7773":{"gid":7773,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/4146626637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":4146626637},{"type":"v1","addr":"172.21.15.164:6835","nonce":4146626637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-09-13T06:08:28.903 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 68 2023-09-13T06:08:28.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 -- 172.21.15.130:0/309047791 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae24065b50 msgr2=0x7fae24068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae24065b50 0x7fae24068010 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fae34009aa0 tx=0x7fae34008040 comp rx=0 tx=0).stop 2023-09-13T06:08:28.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 -- 172.21.15.130:0/309047791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae440c96d0 msgr2=0x7fae440c9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:28.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae440c96d0 0x7fae440c9b50 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fae3800e480 tx=0x7fae3800e940 comp rx=0 tx=0).stop 2023-09-13T06:08:28.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 -- 172.21.15.130:0/309047791 shutdown_connections 2023-09-13T06:08:28.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae24065b50 0x7fae24068010 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae440d2450 0x7fae440d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae440c96d0 0x7fae440c9b50 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 --2- 172.21.15.130:0/309047791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae2c005190 0x7fae44141c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:28.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 -- 172.21.15.130:0/309047791 >> 172.21.15.130:0/309047791 conn(0x7fae440cdd10 msgr2=0x7fae441614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:28.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 -- 172.21.15.130:0/309047791 shutdown_connections 2023-09-13T06:08:28.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:28.899+0000 7fae4359e640 1 -- 172.21.15.130:0/309047791 wait complete. 2023-09-13T06:08:28.921 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:08:29.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.055+0000 7f565bfad640 1 Processor -- start 2023-09-13T06:08:29.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.055+0000 7f565bfad640 1 -- start start 2023-09-13T06:08:29.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f565bfad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5654147f30 0x7f5654148410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f565bfad640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5654148950 0x7f565406bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f565bfad640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565406b5e0 con 0x7f5654147b50 2023-09-13T06:08:29.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f565bfad640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565406b8c0 con 0x7f5654147f30 2023-09-13T06:08:29.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f565bfad640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5654165ac0 con 0x7f5654148950 2023-09-13T06:08:29.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f5659548640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5654147f30 0x7f5654148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f5659548640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5654147f30 0x7f5654148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45926/0 (socket says 172.21.15.130:45926) 2023-09-13T06:08:29.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f5659548640 1 -- 172.21.15.130:0/1031853016 learned_addr learned my addr 172.21.15.130:0/1031853016 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:29.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f565a54a640 1 --2- 172.21.15.130:0/1031853016 >> v2:172.21.15.164:3300/0 conn(0x7f5654148950 0x7f565406bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f5659548640 1 -- 172.21.15.130:0/1031853016 >> v2:172.21.15.164:3300/0 conn(0x7f5654148950 msgr2=0x7f565406bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:29.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f5659548640 1 --2- 172.21.15.130:0/1031853016 >> v2:172.21.15.164:3300/0 conn(0x7f5654148950 0x7f565406bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f5659548640 1 -- 172.21.15.130:0/1031853016 >> v1:172.21.15.164:6789/0 conn(0x7f5654147b50 legacy=0x7f56541652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f5659548640 1 -- 172.21.15.130:0/1031853016 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5654165da0 con 0x7f5654147f30 2023-09-13T06:08:29.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f5659548640 1 --2- 172.21.15.130:0/1031853016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5654147f30 0x7f5654148410 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f565414aeb0 tx=0x7f564401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d091e488f2219108 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:29.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f5658d47640 1 -- 172.21.15.130:0/1031853016 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56440aa650 con 0x7f5654147f30 2023-09-13T06:08:29.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f5658d47640 1 -- 172.21.15.130:0/1031853016 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56440aa7b0 con 0x7f5654147f30 2023-09-13T06:08:29.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.059+0000 7f5658d47640 1 -- 172.21.15.130:0/1031853016 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56440aab40 con 0x7f5654147f30 2023-09-13T06:08:29.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 -- 172.21.15.130:0/1031853016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5654147f30 msgr2=0x7f5654148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 --2- 172.21.15.130:0/1031853016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5654147f30 0x7f5654148410 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f565414aeb0 tx=0x7f564401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 -- 172.21.15.130:0/1031853016 shutdown_connections 2023-09-13T06:08:29.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 --2- 172.21.15.130:0/1031853016 >> v2:172.21.15.164:3300/0 conn(0x7f5654148950 0x7f565406bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 --2- 172.21.15.130:0/1031853016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5654147f30 0x7f5654148410 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 -- 172.21.15.130:0/1031853016 >> 172.21.15.130:0/1031853016 conn(0x7f5654065990 msgr2=0x7f5654065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:29.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 -- 172.21.15.130:0/1031853016 shutdown_connections 2023-09-13T06:08:29.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 -- 172.21.15.130:0/1031853016 wait complete. 2023-09-13T06:08:29.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 Processor -- start 2023-09-13T06:08:29.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 -- start start 2023-09-13T06:08:29.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5654147b50 0x7f56541406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5654147f30 0x7f5654142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5654148950 0x7f56541429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5654163fd0 con 0x7f5654148950 2023-09-13T06:08:29.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5654140ed0 con 0x7f5654147b50 2023-09-13T06:08:29.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565bfad640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5654163210 con 0x7f5654147f30 2023-09-13T06:08:29.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565a54a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5654148950 0x7f56541429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565a54a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5654148950 0x7f56541429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45940/0 (socket says 172.21.15.130:45940) 2023-09-13T06:08:29.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565a54a640 1 -- 172.21.15.130:0/169575713 learned_addr learned my addr 172.21.15.130:0/169575713 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:29.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f5659548640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5654147f30 0x7f5654142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f565a54a640 1 -- 172.21.15.130:0/169575713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5654147f30 msgr2=0x7f5654142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.063+0000 7f5659d49640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5654147b50 0x7f56541406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f565a54a640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5654147f30 0x7f5654142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f565a54a640 1 -- 172.21.15.130:0/169575713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5654147b50 msgr2=0x7f56541406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f565a54a640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5654147b50 0x7f56541406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f565a54a640 1 -- 172.21.15.130:0/169575713 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440094d0 con 0x7f5654148950 2023-09-13T06:08:29.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f5659548640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5654147f30 0x7f5654142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:29.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f5659d49640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5654147b50 0x7f56541406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:29.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f565a54a640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5654148950 0x7f56541429a0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f564c007d90 tx=0x7f564c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:29.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f564a7fc640 1 -- 172.21.15.130:0/169575713 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c014420 con 0x7f5654148950 2023-09-13T06:08:29.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f564a7fc640 1 -- 172.21.15.130:0/169575713 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c0145a0 con 0x7f5654148950 2023-09-13T06:08:29.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f564a7fc640 1 -- 172.21.15.130:0/169575713 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c014950 con 0x7f5654148950 2023-09-13T06:08:29.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f565bfad640 1 -- 172.21.15.130:0/169575713 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56541634f0 con 0x7f5654148950 2023-09-13T06:08:29.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f565bfad640 1 -- 172.21.15.130:0/169575713 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5654163ab0 con 0x7f5654148950 2023-09-13T06:08:29.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f565bfad640 1 -- 172.21.15.130:0/169575713 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5654163ca0 con 0x7f5654148950 2023-09-13T06:08:29.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f564a7fc640 1 -- 172.21.15.130:0/169575713 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f564c014ab0 con 0x7f5654148950 2023-09-13T06:08:29.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f564a7fc640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5638065b50 0x7f5638068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f564a7fc640 1 -- 172.21.15.130:0/169575713 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f564c083c00 con 0x7f5654148950 2023-09-13T06:08:29.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f5659d49640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5638065b50 0x7f5638068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.067+0000 7f564a7fc640 1 -- 172.21.15.130:0/169575713 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7f563806d740 con 0x7f5654148950 2023-09-13T06:08:29.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.071+0000 7f5659d49640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5638065b50 0x7f5638068010 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5650000f70 tx=0x7f5650009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:29.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.071+0000 7f564a7fc640 1 -- 172.21.15.130:0/169575713 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f564c08a080 con 0x7f5654148950 2023-09-13T06:08:29.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 -- 172.21.15.130:0/169575713 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56540618a0 con 0x7f5654148950 2023-09-13T06:08:29.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f564a7fc640 1 -- 172.21.15.130:0/169575713 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16684 (secure 0 0 0) 0x7f564c051510 con 0x7f5654148950 2023-09-13T06:08:29.225 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:29.226 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":143,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:08:27.392316+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:07:38.276233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-09-13T06:07:39.032744+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:08:29.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 -- 172.21.15.130:0/169575713 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5638065b50 msgr2=0x7f5638068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5638065b50 0x7f5638068010 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5650000f70 tx=0x7f5650009040 comp rx=0 tx=0).stop 2023-09-13T06:08:29.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 -- 172.21.15.130:0/169575713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5654148950 msgr2=0x7f56541429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5654148950 0x7f56541429a0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f564c007d90 tx=0x7f564c00e4b0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 -- 172.21.15.130:0/169575713 shutdown_connections 2023-09-13T06:08:29.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5638065b50 0x7f5638068010 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5654148950 0x7f56541429a0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5654147f30 0x7f5654142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 --2- 172.21.15.130:0/169575713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5654147b50 0x7f56541406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 -- 172.21.15.130:0/169575713 >> 172.21.15.130:0/169575713 conn(0x7f5654065990 msgr2=0x7f5654070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:29.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 -- 172.21.15.130:0/169575713 shutdown_connections 2023-09-13T06:08:29.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.223+0000 7f565bfad640 1 -- 172.21.15.130:0/169575713 wait complete. 2023-09-13T06:08:29.246 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T06:08:29.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f1054540640 1 Processor -- start 2023-09-13T06:08:29.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f1054540640 1 -- start start 2023-09-13T06:08:29.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f1054540640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0ae170 0x7f104c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f1054540640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f104c15d5f0 0x7f104c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f1054540640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f104c0cb4a0 con 0x7f104c0cb040 2023-09-13T06:08:29.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f1054540640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f104c0b1e20 con 0x7f104c15d5f0 2023-09-13T06:08:29.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f1054540640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104c0cce60 con 0x7f104c0ae170 2023-09-13T06:08:29.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f10522dc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0ae170 0x7f104c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f1052add640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f104c15d5f0 0x7f104c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f1052add640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f104c15d5f0 0x7f104c1591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:40680/0 (socket says 172.21.15.130:40680) 2023-09-13T06:08:29.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f10522dc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0ae170 0x7f104c0cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:47270/0 (socket says 172.21.15.130:47270) 2023-09-13T06:08:29.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f1052add640 1 -- 172.21.15.130:0/2946325534 learned_addr learned my addr 172.21.15.130:0/2946325534 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:29.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f10522dc640 1 -- 172.21.15.130:0/2946325534 >> v2:172.21.15.164:3300/0 conn(0x7f104c15d5f0 msgr2=0x7f104c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:29.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f10522dc640 1 --2- 172.21.15.130:0/2946325534 >> v2:172.21.15.164:3300/0 conn(0x7f104c15d5f0 0x7f104c1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f10522dc640 1 -- 172.21.15.130:0/2946325534 >> v1:172.21.15.164:6789/0 conn(0x7f104c0cb040 legacy=0x7f104c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.383+0000 7f10522dc640 1 -- 172.21.15.130:0/2946325534 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c0cd140 con 0x7f104c0ae170 2023-09-13T06:08:29.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.387+0000 7f10522dc640 1 --2- 172.21.15.130:0/2946325534 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0ae170 0x7f104c0cc7f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f10480097c0 tx=0x7f104801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76ec2bfabac7e9c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:29.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.387+0000 7f10512da640 1 -- 172.21.15.130:0/2946325534 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480ab5f0 con 0x7f104c0ae170 2023-09-13T06:08:29.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.387+0000 7f10512da640 1 -- 172.21.15.130:0/2946325534 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10480ab750 con 0x7f104c0ae170 2023-09-13T06:08:29.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.387+0000 7f10512da640 1 -- 172.21.15.130:0/2946325534 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480abae0 con 0x7f104c0ae170 2023-09-13T06:08:29.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.387+0000 7f1054540640 1 -- 172.21.15.130:0/2946325534 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0ae170 msgr2=0x7f104c0cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.387+0000 7f1054540640 1 --2- 172.21.15.130:0/2946325534 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0ae170 0x7f104c0cc7f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f10480097c0 tx=0x7f104801c3f0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.392 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.387+0000 7f1054540640 1 -- 172.21.15.130:0/2946325534 shutdown_connections 2023-09-13T06:08:29.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.387+0000 7f1054540640 1 --2- 172.21.15.130:0/2946325534 >> v2:172.21.15.164:3300/0 conn(0x7f104c15d5f0 0x7f104c1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.387+0000 7f1054540640 1 --2- 172.21.15.130:0/2946325534 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0ae170 0x7f104c0cc7f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.387+0000 7f1054540640 1 -- 172.21.15.130:0/2946325534 >> 172.21.15.130:0/2946325534 conn(0x7f104c065990 msgr2=0x7f104c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:29.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1054540640 1 -- 172.21.15.130:0/2946325534 shutdown_connections 2023-09-13T06:08:29.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1054540640 1 -- 172.21.15.130:0/2946325534 wait complete. 2023-09-13T06:08:29.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1054540640 1 Processor -- start 2023-09-13T06:08:29.395 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1054540640 1 -- start start 2023-09-13T06:08:29.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1054540640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f104c0ae170 0x7f104c147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1054540640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0cb040 0x7f104c0acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1054540640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f104c15d5f0 0x7f104c14be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1054540640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c14e630 con 0x7f104c0ae170 2023-09-13T06:08:29.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1054540640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c14e910 con 0x7f104c15d5f0 2023-09-13T06:08:29.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1054540640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104c14ebf0 con 0x7f104c0cb040 2023-09-13T06:08:29.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f10522dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f104c0ae170 0x7f104c147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f10522dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f104c0ae170 0x7f104c147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45942/0 (socket says 172.21.15.130:45942) 2023-09-13T06:08:29.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f10522dc640 1 -- 172.21.15.130:0/783145947 learned_addr learned my addr 172.21.15.130:0/783145947 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:29.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1051adb640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0cb040 0x7f104c0acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1052add640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f104c15d5f0 0x7f104c14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f10522dc640 1 -- 172.21.15.130:0/783145947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0cb040 msgr2=0x7f104c0acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f10522dc640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0cb040 0x7f104c0acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f10522dc640 1 -- 172.21.15.130:0/783145947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f104c15d5f0 msgr2=0x7f104c14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f10522dc640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f104c15d5f0 0x7f104c14be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f10522dc640 1 -- 172.21.15.130:0/783145947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1048009420 con 0x7f104c0ae170 2023-09-13T06:08:29.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f10522dc640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f104c0ae170 0x7f104c147cf0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f10480ad040 tx=0x7f104801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:29.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.391+0000 7f1042ffd640 1 -- 172.21.15.130:0/783145947 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480bf610 con 0x7f104c0ae170 2023-09-13T06:08:29.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.395+0000 7f1042ffd640 1 -- 172.21.15.130:0/783145947 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10480bf790 con 0x7f104c0ae170 2023-09-13T06:08:29.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.395+0000 7f1042ffd640 1 -- 172.21.15.130:0/783145947 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480bfb40 con 0x7f104c0ae170 2023-09-13T06:08:29.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.395+0000 7f1054540640 1 -- 172.21.15.130:0/783145947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104c14eed0 con 0x7f104c0ae170 2023-09-13T06:08:29.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.395+0000 7f1054540640 1 -- 172.21.15.130:0/783145947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104c148230 con 0x7f104c0ae170 2023-09-13T06:08:29.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.395+0000 7f1054540640 1 -- 172.21.15.130:0/783145947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104c0618a0 con 0x7f104c0ae170 2023-09-13T06:08:29.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.395+0000 7f1042ffd640 1 -- 172.21.15.130:0/783145947 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f10480b5400 con 0x7f104c0ae170 2023-09-13T06:08:29.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.395+0000 7f1042ffd640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1030065b20 0x7f1030067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.395+0000 7f1042ffd640 1 -- 172.21.15.130:0/783145947 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f10480a8050 con 0x7f104c0ae170 2023-09-13T06:08:29.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.395+0000 7f1051adb640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1030065b20 0x7f1030067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.395+0000 7f1042ffd640 1 -- 172.21.15.130:0/783145947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7f103006d710 con 0x7f104c0ae170 2023-09-13T06:08:29.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.395+0000 7f1051adb640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1030065b20 0x7f1030067fe0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f104c14a190 tx=0x7f103c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:29.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.399+0000 7f1042ffd640 1 -- 172.21.15.130:0/783145947 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f10480c4060 con 0x7f104c0ae170 2023-09-13T06:08:29.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.579+0000 7f1054540640 1 -- 172.21.15.130:0/783145947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f104c0cac10 con 0x7f104c0ae170 2023-09-13T06:08:29.583 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:08:29.579+0000 7faa00e50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T06:08:29.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.583+0000 7f1042ffd640 1 -- 172.21.15.130:0/783145947 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(144..144 src has 1..144) v4 ==== 432+0+0 (secure 0 0 0) 0x7f10480efb60 con 0x7f104c0ae170 2023-09-13T06:08:29.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.587+0000 7f1042ffd640 1 -- 172.21.15.130:0/783145947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7f103006dfc0 con 0x7f104c0ae170 2023-09-13T06:08:29.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.587+0000 7f1042ffd640 1 -- 172.21.15.130:0/783145947 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7f10480eb7a0 con 0x7f104c0ae170 2023-09-13T06:08:29.591 INFO:teuthology.orchestra.run.smithi130.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T06:08:29.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 -- 172.21.15.130:0/783145947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1030065b20 msgr2=0x7f1030067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1030065b20 0x7f1030067fe0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f104c14a190 tx=0x7f103c009040 comp rx=0 tx=0).stop 2023-09-13T06:08:29.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 -- 172.21.15.130:0/783145947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f104c0ae170 msgr2=0x7f104c147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f104c0ae170 0x7f104c147cf0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f10480ad040 tx=0x7f104801ac30 comp rx=0 tx=0).stop 2023-09-13T06:08:29.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 -- 172.21.15.130:0/783145947 shutdown_connections 2023-09-13T06:08:29.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1030065b20 0x7f1030067fe0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f104c15d5f0 0x7f104c14be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f104c0cb040 0x7f104c0acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 --2- 172.21.15.130:0/783145947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f104c0ae170 0x7f104c147cf0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 -- 172.21.15.130:0/783145947 >> 172.21.15.130:0/783145947 conn(0x7f104c065990 msgr2=0x7f104c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:29.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 -- 172.21.15.130:0/783145947 shutdown_connections 2023-09-13T06:08:29.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.591+0000 7f1054540640 1 -- 172.21.15.130:0/783145947 wait complete. 2023-09-13T06:08:29.600 INFO:tasks.ceph.mds.b.smithi164.stderr: -9544> 2023-09-13T06:07:42.509+0000 7f37245c1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:08:29.613 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T06:08:29.657 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:08:29.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb6d848640 1 Processor -- start 2023-09-13T06:08:29.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb6d848640 1 -- start start 2023-09-13T06:08:29.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb6d848640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7feb68157ca0 0x7feb6815b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb6d848640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6815ada0 con 0x7feb680cd3b0 2023-09-13T06:08:29.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb6d848640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6815b770 con 0x7feb680ccf00 2023-09-13T06:08:29.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb6d848640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb680cdca0 con 0x7feb68157ca0 2023-09-13T06:08:29.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb677fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7feb680cd3b0 0x7feb6815de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:40828/0 (socket says 172.21.15.130:40828) 2023-09-13T06:08:29.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb677fe640 1 -- 172.21.15.130:0/639588089 learned_addr learned my addr 172.21.15.130:0/639588089 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:29.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb66ffd640 1 --2- 172.21.15.130:0/639588089 >> v2:172.21.15.164:3300/0 conn(0x7feb68157ca0 0x7feb6815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb667fc640 1 -- 172.21.15.130:0/639588089 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405999568 0 0) 0x7feb6815ada0 con 0x7feb680cd3b0 2023-09-13T06:08:29.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb667fc640 1 -- 172.21.15.130:0/639588089 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb54003530 con 0x7feb680cd3b0 2023-09-13T06:08:29.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb66ffd640 1 -- 172.21.15.130:0/639588089 >> v1:172.21.15.164:6789/0 conn(0x7feb680ccf00 legacy=0x7feb680cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb667fc640 1 -- 172.21.15.130:0/639588089 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070053225 0 0) 0x7feb6815b770 con 0x7feb680ccf00 2023-09-13T06:08:29.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb66ffd640 1 -- 172.21.15.130:0/639588089 >> v1:172.21.15.130:6789/0 conn(0x7feb680cd3b0 legacy=0x7feb6815de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.751+0000 7feb66ffd640 1 -- 172.21.15.130:0/639588089 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680cdf80 con 0x7feb68157ca0 2023-09-13T06:08:29.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.755+0000 7feb66ffd640 1 --2- 172.21.15.130:0/639588089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68157ca0 0x7feb6815b230 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feb580097c0 tx=0x7feb5801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da1ddb2153c6ec68 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:29.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.755+0000 7feb667fc640 1 -- 172.21.15.130:0/639588089 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580ab650 con 0x7feb68157ca0 2023-09-13T06:08:29.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.755+0000 7feb667fc640 1 -- 172.21.15.130:0/639588089 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb580ab7b0 con 0x7feb68157ca0 2023-09-13T06:08:29.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.755+0000 7feb667fc640 1 -- 172.21.15.130:0/639588089 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580abb40 con 0x7feb68157ca0 2023-09-13T06:08:29.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.755+0000 7feb6d848640 1 -- 172.21.15.130:0/639588089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68157ca0 msgr2=0x7feb6815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.755+0000 7feb6d848640 1 --2- 172.21.15.130:0/639588089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68157ca0 0x7feb6815b230 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feb580097c0 tx=0x7feb5801c450 comp rx=0 tx=0).stop 2023-09-13T06:08:29.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.755+0000 7feb6d848640 1 -- 172.21.15.130:0/639588089 shutdown_connections 2023-09-13T06:08:29.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.755+0000 7feb6d848640 1 --2- 172.21.15.130:0/639588089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68157ca0 0x7feb6815b230 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.755+0000 7feb6d848640 1 -- 172.21.15.130:0/639588089 >> 172.21.15.130:0/639588089 conn(0x7feb68065990 msgr2=0x7feb68065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:29.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.755+0000 7feb6d848640 1 -- 172.21.15.130:0/639588089 shutdown_connections 2023-09-13T06:08:29.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.755+0000 7feb6d848640 1 -- 172.21.15.130:0/639588089 wait complete. 2023-09-13T06:08:29.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb6d848640 1 Processor -- start 2023-09-13T06:08:29.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb6d848640 1 -- start start 2023-09-13T06:08:29.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb6d848640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb680ccf00 0x7feb680ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb6d848640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb680cd3b0 0x7feb680aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb6d848640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb68157ca0 0x7feb68154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb6d848640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680aa4c0 con 0x7feb68157ca0 2023-09-13T06:08:29.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb6d848640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680a98b0 con 0x7feb680ccf00 2023-09-13T06:08:29.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb6d848640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680a9b90 con 0x7feb680cd3b0 2023-09-13T06:08:29.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb677fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb68157ca0 0x7feb68154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb677fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb68157ca0 0x7feb68154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45952/0 (socket says 172.21.15.130:45952) 2023-09-13T06:08:29.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb677fe640 1 -- 172.21.15.130:0/1084258850 learned_addr learned my addr 172.21.15.130:0/1084258850 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:29.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb5e7fc640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb680cd3b0 0x7feb680aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb66ffd640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb680ccf00 0x7feb680ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb677fe640 1 -- 172.21.15.130:0/1084258850 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb680cd3b0 msgr2=0x7feb680aa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb677fe640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb680cd3b0 0x7feb680aa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb677fe640 1 -- 172.21.15.130:0/1084258850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb680ccf00 msgr2=0x7feb680ab850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:29.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb677fe640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb680ccf00 0x7feb680ab850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:29.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb677fe640 1 -- 172.21.15.130:0/1084258850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb58009420 con 0x7feb68157ca0 2023-09-13T06:08:29.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb677fe640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb68157ca0 0x7feb68154f30 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7feb6000cbb0 tx=0x7feb6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:29.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb64ff9640 1 -- 172.21.15.130:0/1084258850 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000ad40 con 0x7feb68157ca0 2023-09-13T06:08:29.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb64ff9640 1 -- 172.21.15.130:0/1084258850 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb60012400 con 0x7feb68157ca0 2023-09-13T06:08:29.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb64ff9640 1 -- 172.21.15.130:0/1084258850 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000aea0 con 0x7feb68157ca0 2023-09-13T06:08:29.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb6d848640 1 -- 172.21.15.130:0/1084258850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb680a9e70 con 0x7feb68157ca0 2023-09-13T06:08:29.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.759+0000 7feb6d848640 1 -- 172.21.15.130:0/1084258850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb681559b0 con 0x7feb68157ca0 2023-09-13T06:08:29.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.763+0000 7feb6d848640 1 -- 172.21.15.130:0/1084258850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb680aa630 con 0x7feb68157ca0 2023-09-13T06:08:29.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.763+0000 7feb64ff9640 1 -- 172.21.15.130:0/1084258850 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7feb60007070 con 0x7feb68157ca0 2023-09-13T06:08:29.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.763+0000 7feb64ff9640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb48065b50 0x7feb48068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:29.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.763+0000 7feb64ff9640 1 -- 172.21.15.130:0/1084258850 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5853+0+0 (secure 0 0 0) 0x7feb600832c0 con 0x7feb68157ca0 2023-09-13T06:08:29.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.763+0000 7feb66ffd640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb48065b50 0x7feb48068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:29.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.763+0000 7feb64ff9640 1 -- 172.21.15.130:0/1084258850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7feb4806d850 con 0x7feb68157ca0 2023-09-13T06:08:29.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.763+0000 7feb66ffd640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb48065b50 0x7feb48068010 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7feb580af000 tx=0x7feb580a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:29.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.767+0000 7feb64ff9640 1 -- 172.21.15.130:0/1084258850 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7feb60017060 con 0x7feb68157ca0 2023-09-13T06:08:29.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:29.947+0000 7feb6d848640 1 -- 172.21.15.130:0/1084258850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feb680674a0 con 0x7feb68157ca0 2023-09-13T06:08:30.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.587+0000 7feb64ff9640 1 -- 172.21.15.130:0/1084258850 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7feb60050b90 con 0x7feb68157ca0 2023-09-13T06:08:30.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 -- 172.21.15.130:0/1084258850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb48065b50 msgr2=0x7feb48068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:30.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb48065b50 0x7feb48068010 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7feb580af000 tx=0x7feb580a7000 comp rx=0 tx=0).stop 2023-09-13T06:08:30.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 -- 172.21.15.130:0/1084258850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb68157ca0 msgr2=0x7feb68154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:30.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb68157ca0 0x7feb68154f30 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7feb6000cbb0 tx=0x7feb6000a430 comp rx=0 tx=0).stop 2023-09-13T06:08:30.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 -- 172.21.15.130:0/1084258850 shutdown_connections 2023-09-13T06:08:30.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feb48065b50 0x7feb48068010 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:30.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb68157ca0 0x7feb68154f30 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:30.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb680cd3b0 0x7feb680aa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:30.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 --2- 172.21.15.130:0/1084258850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb680ccf00 0x7feb680ab850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:30.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 -- 172.21.15.130:0/1084258850 >> 172.21.15.130:0/1084258850 conn(0x7feb68065990 msgr2=0x7feb6815ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:30.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 -- 172.21.15.130:0/1084258850 shutdown_connections 2023-09-13T06:08:30.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.591+0000 7feb6d848640 1 -- 172.21.15.130:0/1084258850 wait complete. 2023-09-13T06:08:30.615 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T06:08:30.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.755+0000 7f1f36fba640 1 Processor -- start 2023-09-13T06:08:30.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.755+0000 7f1f36fba640 1 -- start start 2023-09-13T06:08:30.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f36fba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f3015d110 0x7f1f300b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:30.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f36fba640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1f300ad300 0x7f1f300ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:30.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f36fba640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f30160f50 con 0x7f1f3015d4f0 2023-09-13T06:08:30.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f36fba640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f30161e20 con 0x7f1f300ad300 2023-09-13T06:08:30.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f36fba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300cd0d0 con 0x7f1f3015d110 2023-09-13T06:08:30.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f27fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1f300ad300 0x7f1f300ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:30.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f27fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1f300ad300 0x7f1f300ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45968/0 (socket says 172.21.15.130:45968) 2023-09-13T06:08:30.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f27fff640 1 -- 172.21.15.130:0/3874131934 learned_addr learned my addr 172.21.15.130:0/3874131934 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:30.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f34d56640 1 --2- 172.21.15.130:0/3874131934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f3015d110 0x7f1f300b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:30.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f27fff640 1 -- 172.21.15.130:0/3874131934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f3015d110 msgr2=0x7f1f300b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:30.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f27fff640 1 --2- 172.21.15.130:0/3874131934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f3015d110 0x7f1f300b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:30.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f27fff640 1 -- 172.21.15.130:0/3874131934 >> v1:172.21.15.164:6789/0 conn(0x7f1f3015d4f0 legacy=0x7f1f300aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:30.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.759+0000 7f1f27fff640 1 -- 172.21.15.130:0/3874131934 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f301611a0 con 0x7f1f300ad300 2023-09-13T06:08:30.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f27fff640 1 --2- 172.21.15.130:0/3874131934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f300ad300 0x7f1f300ccb90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009870 tx=0x7f1f2001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6f0d90980c92b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:30.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f277fe640 1 -- 172.21.15.130:0/3874131934 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200ab600 con 0x7f1f300ad300 2023-09-13T06:08:30.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f277fe640 1 -- 172.21.15.130:0/3874131934 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f200a7050 con 0x7f1f300ad300 2023-09-13T06:08:30.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f277fe640 1 -- 172.21.15.130:0/3874131934 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200ab980 con 0x7f1f300ad300 2023-09-13T06:08:30.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 -- 172.21.15.130:0/3874131934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f300ad300 msgr2=0x7f1f300ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:30.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 --2- 172.21.15.130:0/3874131934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f300ad300 0x7f1f300ccb90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009870 tx=0x7f1f2001c470 comp rx=0 tx=0).stop 2023-09-13T06:08:30.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 -- 172.21.15.130:0/3874131934 shutdown_connections 2023-09-13T06:08:30.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 --2- 172.21.15.130:0/3874131934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f300ad300 0x7f1f300ccb90 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:30.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 --2- 172.21.15.130:0/3874131934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f3015d110 0x7f1f300b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:30.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 -- 172.21.15.130:0/3874131934 >> 172.21.15.130:0/3874131934 conn(0x7f1f300735e0 msgr2=0x7f1f30065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:30.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 -- 172.21.15.130:0/3874131934 shutdown_connections 2023-09-13T06:08:30.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 -- 172.21.15.130:0/3874131934 wait complete. 2023-09-13T06:08:30.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 Processor -- start 2023-09-13T06:08:30.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 -- start start 2023-09-13T06:08:30.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f300ad300 0x7f1f300cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:30.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.763+0000 7f1f36fba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f3015d110 0x7f1f301548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:30.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f36fba640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f3015d4f0 0x7f1f3015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:30.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f36fba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300cb700 con 0x7f1f3015d110 2023-09-13T06:08:30.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f36fba640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f30154e10 con 0x7f1f3015d4f0 2023-09-13T06:08:30.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f36fba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f30154440 con 0x7f1f300ad300 2023-09-13T06:08:30.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f27fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f3015d110 0x7f1f301548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:30.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f27fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f3015d110 0x7f1f301548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:45972/0 (socket says 172.21.15.130:45972) 2023-09-13T06:08:30.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f27fff640 1 -- 172.21.15.130:0/4089836789 learned_addr learned my addr 172.21.15.130:0/4089836789 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:30.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f34d56640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f300ad300 0x7f1f300cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:30.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f35557640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f3015d4f0 0x7f1f3015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:30.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f27fff640 1 -- 172.21.15.130:0/4089836789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f300ad300 msgr2=0x7f1f300cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:30.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f27fff640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f300ad300 0x7f1f300cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:30.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f27fff640 1 -- 172.21.15.130:0/4089836789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f3015d4f0 msgr2=0x7f1f3015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:30.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f27fff640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f3015d4f0 0x7f1f3015ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:30.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f27fff640 1 -- 172.21.15.130:0/4089836789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f200094d0 con 0x7f1f3015d110 2023-09-13T06:08:30.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f27fff640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f3015d110 0x7f1f301548d0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f1f200ae040 tx=0x7f1f20019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:30.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f257fa640 1 -- 172.21.15.130:0/4089836789 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200b4440 con 0x7f1f3015d110 2023-09-13T06:08:30.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f257fa640 1 -- 172.21.15.130:0/4089836789 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f200b45a0 con 0x7f1f3015d110 2023-09-13T06:08:30.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f257fa640 1 -- 172.21.15.130:0/4089836789 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200b4950 con 0x7f1f3015d110 2023-09-13T06:08:30.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f36fba640 1 -- 172.21.15.130:0/4089836789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f30153e30 con 0x7f1f3015d110 2023-09-13T06:08:30.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f36fba640 1 -- 172.21.15.130:0/4089836789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f30152950 con 0x7f1f3015d110 2023-09-13T06:08:30.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f36fba640 1 -- 172.21.15.130:0/4089836789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f301545b0 con 0x7f1f3015d110 2023-09-13T06:08:30.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.767+0000 7f1f257fa640 1 -- 172.21.15.130:0/4089836789 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1f200b2070 con 0x7f1f3015d110 2023-09-13T06:08:30.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.771+0000 7f1f257fa640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f1c065b20 0x7f1f1c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:30.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.771+0000 7f1f257fa640 1 -- 172.21.15.130:0/4089836789 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1f2011d1b0 con 0x7f1f3015d110 2023-09-13T06:08:30.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.771+0000 7f1f257fa640 1 -- 172.21.15.130:0/4089836789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7f1f1c06d820 con 0x7f1f3015d110 2023-09-13T06:08:30.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.771+0000 7f1f34d56640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f1c065b20 0x7f1f1c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:30.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.771+0000 7f1f34d56640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f1c065b20 0x7f1f1c067fe0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c007a60 tx=0x7f1f2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:30.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.775+0000 7f1f257fa640 1 -- 172.21.15.130:0/4089836789 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1f200eab10 con 0x7f1f3015d110 2023-09-13T06:08:30.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:30.919+0000 7f1f36fba640 1 -- 172.21.15.130:0/4089836789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1f300618a0 con 0x7f1f3015d110 2023-09-13T06:08:31.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.591+0000 7f1f257fa640 1 -- 172.21.15.130:0/4089836789 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(145..145 src has 1..145) v4 ==== 354+0+0 (secure 0 0 0) 0x7f1f200f2550 con 0x7f1f3015d110 2023-09-13T06:08:31.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.591+0000 7f1f257fa640 1 -- 172.21.15.130:0/4089836789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7f1f1c06bc50 con 0x7f1f3015d110 2023-09-13T06:08:31.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.595+0000 7f1f257fa640 1 -- 172.21.15.130:0/4089836789 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v145) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1f200b8020 con 0x7f1f3015d110 2023-09-13T06:08:31.822 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' removed 2023-09-13T06:08:31.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 -- 172.21.15.130:0/4089836789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f1c065b20 msgr2=0x7f1f1c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:31.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f1c065b20 0x7f1f1c067fe0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c007a60 tx=0x7f1f2c008040 comp rx=0 tx=0).stop 2023-09-13T06:08:31.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 -- 172.21.15.130:0/4089836789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f3015d110 msgr2=0x7f1f301548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:31.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f3015d110 0x7f1f301548d0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f1f200ae040 tx=0x7f1f20019210 comp rx=0 tx=0).stop 2023-09-13T06:08:31.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 -- 172.21.15.130:0/4089836789 shutdown_connections 2023-09-13T06:08:31.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1f1c065b20 0x7f1f1c067fe0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:31.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f3015d4f0 0x7f1f3015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:31.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f3015d110 0x7f1f301548d0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:31.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 --2- 172.21.15.130:0/4089836789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f300ad300 0x7f1f300cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:31.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 -- 172.21.15.130:0/4089836789 >> 172.21.15.130:0/4089836789 conn(0x7f1f300735e0 msgr2=0x7f1f3006f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:31.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 -- 172.21.15.130:0/4089836789 shutdown_connections 2023-09-13T06:08:31.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.603+0000 7f1f36fba640 1 -- 172.21.15.130:0/4089836789 wait complete. 2023-09-13T06:08:31.825 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T06:08:31.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.967+0000 7fbc01a9e640 1 Processor -- start 2023-09-13T06:08:31.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.967+0000 7fbc01a9e640 1 -- start start 2023-09-13T06:08:31.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbc01a9e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbbfc0b0fa0 0x7fbbfc0713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:31.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbc01a9e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc15d890 con 0x7fbbfc15d4b0 2023-09-13T06:08:31.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbc01a9e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc0cbeb0 con 0x7fbbfc0cb940 2023-09-13T06:08:31.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbc01a9e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0b2710 con 0x7fbbfc0b0fa0 2023-09-13T06:08:31.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfb7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fbbfc15d4b0 0x7fbbfc0b0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42296/0 (socket says 172.21.15.130:42296) 2023-09-13T06:08:31.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfb7fe640 1 -- 172.21.15.130:0/2763378457 learned_addr learned my addr 172.21.15.130:0/2763378457 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:31.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852792562 0 0) 0x7fbbfc15d890 con 0x7fbbfc15d4b0 2023-09-13T06:08:31.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe4003530 con 0x7fbbfc15d4b0 2023-09-13T06:08:31.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfaffd640 1 --2- 172.21.15.130:0/2763378457 >> v2:172.21.15.164:3300/0 conn(0x7fbbfc0b0fa0 0x7fbbfc0713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:31.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883270329 0 0) 0x7fbbe4003530 con 0x7fbbfc15d4b0 2023-09-13T06:08:31.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 >> v2:172.21.15.164:3300/0 conn(0x7fbbfc0b0fa0 msgr2=0x7fbbfc0713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:31.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 --2- 172.21.15.130:0/2763378457 >> v2:172.21.15.164:3300/0 conn(0x7fbbfc0b0fa0 0x7fbbfc0713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:31.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 >> v1:172.21.15.164:6789/0 conn(0x7fbbfc0cb940 legacy=0x7fbbfc0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:31.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc0b2b30 con 0x7fbbfc15d4b0 2023-09-13T06:08:31.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fbbec001680 con 0x7fbbfc15d4b0 2023-09-13T06:08:31.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 >> v1:172.21.15.130:6789/0 conn(0x7fbbfc15d4b0 legacy=0x7fbbfc0b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:31.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe40039f0 0x7fbbe4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:31.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbe40047d0 0x7fbbe4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:31.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 0x7fbbe400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:31.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0b2710 con 0x7fbbe4005200 2023-09-13T06:08:31.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe400c160 con 0x7fbbe40047d0 2023-09-13T06:08:31.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe400c320 con 0x7fbbe40039f0 2023-09-13T06:08:31.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfbfff640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 0x7fbbe400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:31.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfb7fe640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe40039f0 0x7fbbe4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:31.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfaffd640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbe40047d0 0x7fbbe4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:31.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfbfff640 1 -- 172.21.15.130:0/2763378457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe40039f0 msgr2=0x7fbbe4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:31.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfbfff640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe40039f0 0x7fbbe4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:31.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfbfff640 1 -- 172.21.15.130:0/2763378457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbe40047d0 msgr2=0x7fbbe4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:31.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfbfff640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbe40047d0 0x7fbbe4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:31.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfbfff640 1 -- 172.21.15.130:0/2763378457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4003530 con 0x7fbbe4005200 2023-09-13T06:08:31.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.971+0000 7fbbfaffd640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbe40047d0 0x7fbbe4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:31.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbbfbfff640 1 -- 172.21.15.130:0/2763378457 reap_dead start 2023-09-13T06:08:31.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbbfbfff640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 0x7fbbe400b990 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4001e70 tx=0x7fbbf401c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ccdf3ccb762158 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:31.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4003b80 con 0x7fbbe4005200 2023-09-13T06:08:31.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf4003d20 con 0x7fbbe4005200 2023-09-13T06:08:31.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbbfa7fc640 1 -- 172.21.15.130:0/2763378457 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4005310 con 0x7fbbe4005200 2023-09-13T06:08:31.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbc01a9e640 1 -- 172.21.15.130:0/2763378457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 msgr2=0x7fbbe400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:31.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbc01a9e640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 0x7fbbe400b990 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4001e70 tx=0x7fbbf401c6c0 comp rx=0 tx=0).stop 2023-09-13T06:08:31.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbc01a9e640 1 -- 172.21.15.130:0/2763378457 shutdown_connections 2023-09-13T06:08:31.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbc01a9e640 1 --2- 172.21.15.130:0/2763378457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 0x7fbbe400b990 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:31.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbc01a9e640 1 -- 172.21.15.130:0/2763378457 >> 172.21.15.130:0/2763378457 conn(0x7fbbfc065f90 msgr2=0x7fbbfc0cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:31.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbc01a9e640 1 -- 172.21.15.130:0/2763378457 shutdown_connections 2023-09-13T06:08:31.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbc01a9e640 1 -- 172.21.15.130:0/2763378457 wait complete. 2023-09-13T06:08:31.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.975+0000 7fbc01a9e640 1 Processor -- start 2023-09-13T06:08:31.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbc01a9e640 1 -- start start 2023-09-13T06:08:31.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbc01a9e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 0x7fbbfc1f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:31.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbc01a9e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbfc15da40 0x7fbbfc1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:31.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbc01a9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbfc160690 0x7fbbfc15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:31.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbc01a9e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc15ef70 con 0x7fbbe4005200 2023-09-13T06:08:31.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbc01a9e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc159920 con 0x7fbbfc15da40 2023-09-13T06:08:31.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbc01a9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc15ded0 con 0x7fbbfc160690 2023-09-13T06:08:31.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbfb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 0x7fbbfc1f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:31.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbfb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 0x7fbbfc1f2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59536/0 (socket says 172.21.15.130:59536) 2023-09-13T06:08:31.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbfb7fe640 1 -- 172.21.15.130:0/3945116716 learned_addr learned my addr 172.21.15.130:0/3945116716 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:31.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbfbfff640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbfc160690 0x7fbbfc15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:31.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbfaffd640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbfc15da40 0x7fbbfc1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:31.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbfb7fe640 1 -- 172.21.15.130:0/3945116716 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbfc160690 msgr2=0x7fbbfc15fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:31.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbfb7fe640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbfc160690 0x7fbbfc15fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:31.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbfb7fe640 1 -- 172.21.15.130:0/3945116716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbfc15da40 msgr2=0x7fbbfc1593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:31.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbfb7fe640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbfc15da40 0x7fbbfc1593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:31.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbfb7fe640 1 -- 172.21.15.130:0/3945116716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc15e1b0 con 0x7fbbe4005200 2023-09-13T06:08:31.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbfb7fe640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 0x7fbbfc1f2f10 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fbbec012490 tx=0x7fbbec012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:31.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbe3fff640 1 -- 172.21.15.130:0/3945116716 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec014810 con 0x7fbbe4005200 2023-09-13T06:08:31.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbe3fff640 1 -- 172.21.15.130:0/3945116716 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec014990 con 0x7fbbe4005200 2023-09-13T06:08:31.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbbe3fff640 1 -- 172.21.15.130:0/3945116716 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec014d40 con 0x7fbbe4005200 2023-09-13T06:08:31.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbc01a9e640 1 -- 172.21.15.130:0/3945116716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc15e490 con 0x7fbbe4005200 2023-09-13T06:08:31.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbc01a9e640 1 -- 172.21.15.130:0/3945116716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc15ea50 con 0x7fbbe4005200 2023-09-13T06:08:31.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.979+0000 7fbc01a9e640 1 -- 172.21.15.130:0/3945116716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc0618a0 con 0x7fbbe4005200 2023-09-13T06:08:31.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.983+0000 7fbbe3fff640 1 -- 172.21.15.130:0/3945116716 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbbec0153e0 con 0x7fbbe4005200 2023-09-13T06:08:31.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.983+0000 7fbbe3fff640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbe8065b20 0x7fbbe8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:31.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.983+0000 7fbbe3fff640 1 -- 172.21.15.130:0/3945116716 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fbbec085af0 con 0x7fbbe4005200 2023-09-13T06:08:31.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.983+0000 7fbbe3fff640 1 -- 172.21.15.130:0/3945116716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7fbbe806c9b0 con 0x7fbbe4005200 2023-09-13T06:08:31.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.983+0000 7fbbfaffd640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbe8065b20 0x7fbbe8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:31.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.983+0000 7fbbfaffd640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbe8065b20 0x7fbbe8067fe0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0d0700 tx=0x7fbbf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:31.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:31.987+0000 7fbbe3fff640 1 -- 172.21.15.130:0/3945116716 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbbec01c060 con 0x7fbbe4005200 2023-09-13T06:08:32.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.131+0000 7fbc01a9e640 1 -- 172.21.15.130:0/3945116716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbbfc0714b0 con 0x7fbbe4005200 2023-09-13T06:08:32.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.611+0000 7fbbe3fff640 1 -- 172.21.15.130:0/3945116716 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(146..146 src has 1..146) v4 ==== 330+0+0 (secure 0 0 0) 0x7fbbec014ea0 con 0x7fbbe4005200 2023-09-13T06:08:32.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.611+0000 7fbbe3fff640 1 -- 172.21.15.130:0/3945116716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7fbbe806b740 con 0x7fbbe4005200 2023-09-13T06:08:32.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.615+0000 7fbbe3fff640 1 -- 172.21.15.130:0/3945116716 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v146) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbbec053550 con 0x7fbbe4005200 2023-09-13T06:08:32.618 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' removed 2023-09-13T06:08:32.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 -- 172.21.15.130:0/3945116716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbe8065b20 msgr2=0x7fbbe8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:32.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbe8065b20 0x7fbbe8067fe0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0d0700 tx=0x7fbbf0008040 comp rx=0 tx=0).stop 2023-09-13T06:08:32.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 -- 172.21.15.130:0/3945116716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 msgr2=0x7fbbfc1f2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:32.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 0x7fbbfc1f2f10 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fbbec012490 tx=0x7fbbec012950 comp rx=0 tx=0).stop 2023-09-13T06:08:32.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 -- 172.21.15.130:0/3945116716 shutdown_connections 2023-09-13T06:08:32.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbe8065b20 0x7fbbe8067fe0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbfc15da40 0x7fbbfc1593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbfc160690 0x7fbbfc15fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 --2- 172.21.15.130:0/3945116716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4005200 0x7fbbfc1f2f10 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 -- 172.21.15.130:0/3945116716 >> 172.21.15.130:0/3945116716 conn(0x7fbbfc065f90 msgr2=0x7fbbfc15a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:32.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 -- 172.21.15.130:0/3945116716 shutdown_connections 2023-09-13T06:08:32.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.619+0000 7fbc01a9e640 1 -- 172.21.15.130:0/3945116716 wait complete. 2023-09-13T06:08:32.643 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-13T06:08:32.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f943e740640 1 Processor -- start 2023-09-13T06:08:32.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f943e740640 1 -- start start 2023-09-13T06:08:32.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f943e740640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9438161f10 0x7f94380ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:32.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f943e740640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94380d3340 0x7f94380d37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:32.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f943e740640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94380ab700 con 0x7f9438146f10 2023-09-13T06:08:32.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f943e740640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94380d3d30 con 0x7f9438161f10 2023-09-13T06:08:32.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f943e740640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94380d2cd0 con 0x7f94380d3340 2023-09-13T06:08:32.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f94377fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9438161f10 0x7f94380ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:32.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f94377fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9438161f10 0x7f94380ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59544/0 (socket says 172.21.15.130:59544) 2023-09-13T06:08:32.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f94377fe640 1 -- 172.21.15.130:0/3691056339 learned_addr learned my addr 172.21.15.130:0/3691056339 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:32.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f943ccdd640 1 --2- 172.21.15.130:0/3691056339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94380d3340 0x7f94380d37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:32.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f94377fe640 1 -- 172.21.15.130:0/3691056339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94380d3340 msgr2=0x7f94380d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:32.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f94377fe640 1 --2- 172.21.15.130:0/3691056339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94380d3340 0x7f94380d37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f94377fe640 1 -- 172.21.15.130:0/3691056339 >> v1:172.21.15.164:6789/0 conn(0x7f9438146f10 legacy=0x7f94380d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:32.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.783+0000 7f94377fe640 1 -- 172.21.15.130:0/3691056339 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94380aa120 con 0x7f9438161f10 2023-09-13T06:08:32.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f94377fe640 1 --2- 172.21.15.130:0/3691056339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9438161f10 0x7f94380ab1c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f94380d3e70 tx=0x7f942c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13aae8ec24986e0b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:32.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f9436ffd640 1 -- 172.21.15.130:0/3691056339 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0aa650 con 0x7f9438161f10 2023-09-13T06:08:32.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f9436ffd640 1 -- 172.21.15.130:0/3691056339 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0aa7b0 con 0x7f9438161f10 2023-09-13T06:08:32.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f9436ffd640 1 -- 172.21.15.130:0/3691056339 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0aab40 con 0x7f9438161f10 2023-09-13T06:08:32.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f943e740640 1 -- 172.21.15.130:0/3691056339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9438161f10 msgr2=0x7f94380ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:32.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f943e740640 1 --2- 172.21.15.130:0/3691056339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9438161f10 0x7f94380ab1c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f94380d3e70 tx=0x7f942c01c4f0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f943e740640 1 -- 172.21.15.130:0/3691056339 shutdown_connections 2023-09-13T06:08:32.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f943e740640 1 --2- 172.21.15.130:0/3691056339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94380d3340 0x7f94380d37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f943e740640 1 --2- 172.21.15.130:0/3691056339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9438161f10 0x7f94380ab1c0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f943e740640 1 -- 172.21.15.130:0/3691056339 >> 172.21.15.130:0/3691056339 conn(0x7f9438065990 msgr2=0x7f9438065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:32.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f943e740640 1 -- 172.21.15.130:0/3691056339 shutdown_connections 2023-09-13T06:08:32.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.787+0000 7f943e740640 1 -- 172.21.15.130:0/3691056339 wait complete. 2023-09-13T06:08:32.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943e740640 1 Processor -- start 2023-09-13T06:08:32.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943e740640 1 -- start start 2023-09-13T06:08:32.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943e740640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94380d3340 0x7f943815d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:32.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943e740640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9438146f10 0x7f94380ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:32.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943e740640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94381429b0 0x7f94380ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:32.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943e740640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943813eb90 con 0x7f9438146f10 2023-09-13T06:08:32.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943e740640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9438142f20 con 0x7f94380d3340 2023-09-13T06:08:32.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943e740640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9438167c30 con 0x7f94381429b0 2023-09-13T06:08:32.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f94377fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9438146f10 0x7f94380ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:32.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f94377fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9438146f10 0x7f94380ae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59560/0 (socket says 172.21.15.130:59560) 2023-09-13T06:08:32.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f94377fe640 1 -- 172.21.15.130:0/2010119765 learned_addr learned my addr 172.21.15.130:0/2010119765 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:32.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f9437fff640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94380d3340 0x7f943815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:32.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943ccdd640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94381429b0 0x7f94380ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:32.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f94377fe640 1 -- 172.21.15.130:0/2010119765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94381429b0 msgr2=0x7f94380ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:32.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f94377fe640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94381429b0 0x7f94380ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f94377fe640 1 -- 172.21.15.130:0/2010119765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94380d3340 msgr2=0x7f943815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:32.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f94377fe640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94380d3340 0x7f943815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f94377fe640 1 -- 172.21.15.130:0/2010119765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0094d0 con 0x7f9438146f10 2023-09-13T06:08:32.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943ccdd640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94381429b0 0x7f94380ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:32.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f94377fe640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9438146f10 0x7f94380ae170 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f942c0ac040 tx=0x7f942c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:32.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f9434ff9640 1 -- 172.21.15.130:0/2010119765 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0b3800 con 0x7f9438146f10 2023-09-13T06:08:32.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f9434ff9640 1 -- 172.21.15.130:0/2010119765 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0b3960 con 0x7f9438146f10 2023-09-13T06:08:32.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943e740640 1 -- 172.21.15.130:0/2010119765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9438167f10 con 0x7f9438146f10 2023-09-13T06:08:32.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f9434ff9640 1 -- 172.21.15.130:0/2010119765 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0b3d10 con 0x7f9438146f10 2023-09-13T06:08:32.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.791+0000 7f943e740640 1 -- 172.21.15.130:0/2010119765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94381420e0 con 0x7f9438146f10 2023-09-13T06:08:32.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.795+0000 7f943e740640 1 -- 172.21.15.130:0/2010119765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943813ed40 con 0x7f9438146f10 2023-09-13T06:08:32.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.795+0000 7f9434ff9640 1 -- 172.21.15.130:0/2010119765 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f942c0c6390 con 0x7f9438146f10 2023-09-13T06:08:32.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.795+0000 7f9434ff9640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9424065b20 0x7f9424067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:32.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.795+0000 7f9434ff9640 1 -- 172.21.15.130:0/2010119765 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f942c11da50 con 0x7f9438146f10 2023-09-13T06:08:32.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.795+0000 7f9437fff640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9424065b20 0x7f9424067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:32.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.795+0000 7f9437fff640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9424065b20 0x7f9424067fe0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f9428007fd0 tx=0x7f9428009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:32.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.799+0000 7f9434ff9640 1 -- 172.21.15.130:0/2010119765 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f943813ed40 con 0x7f9438146f10 2023-09-13T06:08:32.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.951+0000 7f943e740640 1 -- 172.21.15.130:0/2010119765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f943813ed40 con 0x7f9438146f10 2023-09-13T06:08:32.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.955+0000 7f9434ff9640 1 -- 172.21.15.130:0/2010119765 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f943813ed40 con 0x7f9438146f10 2023-09-13T06:08:32.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 -- 172.21.15.130:0/2010119765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9424065b20 msgr2=0x7f9424067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:32.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9424065b20 0x7f9424067fe0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f9428007fd0 tx=0x7f9428009040 comp rx=0 tx=0).stop 2023-09-13T06:08:32.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 -- 172.21.15.130:0/2010119765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9438146f10 msgr2=0x7f94380ae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:32.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9438146f10 0x7f94380ae170 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f942c0ac040 tx=0x7f942c01ad30 comp rx=0 tx=0).stop 2023-09-13T06:08:32.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 -- 172.21.15.130:0/2010119765 shutdown_connections 2023-09-13T06:08:32.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9424065b20 0x7f9424067fe0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94381429b0 0x7f94380ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9438146f10 0x7f94380ae170 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 --2- 172.21.15.130:0/2010119765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94380d3340 0x7f943815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:32.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 -- 172.21.15.130:0/2010119765 >> 172.21.15.130:0/2010119765 conn(0x7f9438065990 msgr2=0x7f9438065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:32.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 -- 172.21.15.130:0/2010119765 shutdown_connections 2023-09-13T06:08:32.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:32.959+0000 7f943e740640 1 -- 172.21.15.130:0/2010119765 wait complete. 2023-09-13T06:08:32.980 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-09-13T06:08:33.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.115+0000 7f49eb196640 1 Processor -- start 2023-09-13T06:08:33.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.115+0000 7f49eb196640 1 -- start start 2023-09-13T06:08:33.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.115+0000 7f49eb196640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f49e4146540 0x7f49e4070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.115+0000 7f49eb196640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e406f640 con 0x7f49e41436e0 2023-09-13T06:08:33.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.115+0000 7f49eb196640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e4070fa0 con 0x7f49e4070b90 2023-09-13T06:08:33.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.115+0000 7f49eb196640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e406f890 con 0x7f49e4146540 2023-09-13T06:08:33.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.115+0000 7f49e8f32640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f49e41436e0 0x7f49e40ac840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42310/0 (socket says 172.21.15.130:42310) 2023-09-13T06:08:33.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.115+0000 7f49e8f32640 1 -- 172.21.15.130:0/303356119 learned_addr learned my addr 172.21.15.130:0/303356119 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:33.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.115+0000 7f49dbfff640 1 --2- 172.21.15.130:0/303356119 >> v2:172.21.15.164:3300/0 conn(0x7f49e4146540 0x7f49e4070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440435163 0 0) 0x7f49e406f640 con 0x7f49e41436e0 2023-09-13T06:08:33.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49cc003530 con 0x7f49e41436e0 2023-09-13T06:08:33.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046414965 0 0) 0x7f49e4070fa0 con 0x7f49e4070b90 2023-09-13T06:08:33.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e406f640 con 0x7f49e4070b90 2023-09-13T06:08:33.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3769228569 0 0) 0x7f49cc003530 con 0x7f49e41436e0 2023-09-13T06:08:33.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 >> v2:172.21.15.164:3300/0 conn(0x7f49e4146540 msgr2=0x7f49e4070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:33.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 --2- 172.21.15.130:0/303356119 >> v2:172.21.15.164:3300/0 conn(0x7f49e4146540 0x7f49e4070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 >> v1:172.21.15.164:6789/0 conn(0x7f49e4070b90 legacy=0x7f49e4160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e406fb70 con 0x7f49e41436e0 2023-09-13T06:08:33.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f49e0001680 con 0x7f49e41436e0 2023-09-13T06:08:33.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 >> v1:172.21.15.130:6789/0 conn(0x7f49e41436e0 legacy=0x7f49e40ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 --2- 172.21.15.130:0/303356119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc003b80 0x7f49cc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 --2- 172.21.15.130:0/303356119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc0047d0 0x7f49cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 --2- 172.21.15.130:0/303356119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49cc0052a0 0x7f49cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e406f890 con 0x7f49cc0047d0 2023-09-13T06:08:33.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc00c1b0 con 0x7f49cc003b80 2023-09-13T06:08:33.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc00c370 con 0x7f49cc0052a0 2023-09-13T06:08:33.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49dbfff640 1 --2- 172.21.15.130:0/303356119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc0047d0 0x7f49cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49e8f32640 1 --2- 172.21.15.130:0/303356119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc003b80 0x7f49cc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49e9733640 1 --2- 172.21.15.130:0/303356119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49cc0052a0 0x7f49cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49dbfff640 1 -- 172.21.15.130:0/303356119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49cc0052a0 msgr2=0x7f49cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:33.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49dbfff640 1 --2- 172.21.15.130:0/303356119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49cc0052a0 0x7f49cc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49dbfff640 1 -- 172.21.15.130:0/303356119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc003b80 msgr2=0x7f49cc003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:33.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49dbfff640 1 --2- 172.21.15.130:0/303356119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc003b80 0x7f49cc003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49dbfff640 1 -- 172.21.15.130:0/303356119 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc003530 con 0x7f49cc0047d0 2023-09-13T06:08:33.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49e9733640 1 -- 172.21.15.130:0/303356119 reap_dead start 2023-09-13T06:08:33.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.119+0000 7f49dbfff640 1 --2- 172.21.15.130:0/303356119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc0047d0 0x7f49cc004c50 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009ae0 tx=0x7f49d401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c50f4e4bcca5bc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:33.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40a55e0 con 0x7f49cc0047d0 2023-09-13T06:08:33.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d40a5740 con 0x7f49cc0047d0 2023-09-13T06:08:33.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49db7fe640 1 -- 172.21.15.130:0/303356119 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40a5af0 con 0x7f49cc0047d0 2023-09-13T06:08:33.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 -- 172.21.15.130:0/303356119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc0047d0 msgr2=0x7f49cc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 --2- 172.21.15.130:0/303356119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc0047d0 0x7f49cc004c50 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009ae0 tx=0x7f49d401ca70 comp rx=0 tx=0).stop 2023-09-13T06:08:33.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 -- 172.21.15.130:0/303356119 shutdown_connections 2023-09-13T06:08:33.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 --2- 172.21.15.130:0/303356119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc0047d0 0x7f49cc004c50 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 -- 172.21.15.130:0/303356119 >> 172.21.15.130:0/303356119 conn(0x7f49e40b0bc0 msgr2=0x7f49e40b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:33.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 -- 172.21.15.130:0/303356119 shutdown_connections 2023-09-13T06:08:33.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 -- 172.21.15.130:0/303356119 wait complete. 2023-09-13T06:08:33.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 Processor -- start 2023-09-13T06:08:33.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 -- start start 2023-09-13T06:08:33.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc0047d0 0x7f49e4160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49e415d910 0x7f49e412de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e41f6450 0x7f49e41f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e41f5fc0 con 0x7f49e41f6450 2023-09-13T06:08:33.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e41f5cb0 con 0x7f49cc0047d0 2023-09-13T06:08:33.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.123+0000 7f49eb196640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e412e6a0 con 0x7f49e415d910 2023-09-13T06:08:33.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49e9733640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e41f6450 0x7f49e41f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49e9733640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e41f6450 0x7f49e41f68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59578/0 (socket says 172.21.15.130:59578) 2023-09-13T06:08:33.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49e9733640 1 -- 172.21.15.130:0/3276242282 learned_addr learned my addr 172.21.15.130:0/3276242282 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:33.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49e8f32640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc0047d0 0x7f49e4160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49dbfff640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49e415d910 0x7f49e412de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49e9733640 1 -- 172.21.15.130:0/3276242282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49e415d910 msgr2=0x7f49e412de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49e9733640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49e415d910 0x7f49e412de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49e9733640 1 -- 172.21.15.130:0/3276242282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc0047d0 msgr2=0x7f49e4160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49e9733640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc0047d0 0x7f49e4160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49e9733640 1 -- 172.21.15.130:0/3276242282 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e412e980 con 0x7f49e41f6450 2023-09-13T06:08:33.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49e9733640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e41f6450 0x7f49e41f68d0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f49e41469d0 tx=0x7f49dc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:33.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49d97fa640 1 -- 172.21.15.130:0/3276242282 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc017070 con 0x7f49e41f6450 2023-09-13T06:08:33.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49d97fa640 1 -- 172.21.15.130:0/3276242282 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc006b60 con 0x7f49e41f6450 2023-09-13T06:08:33.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49d97fa640 1 -- 172.21.15.130:0/3276242282 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc006d10 con 0x7f49e41f6450 2023-09-13T06:08:33.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49eb196640 1 -- 172.21.15.130:0/3276242282 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e412ec60 con 0x7f49e41f6450 2023-09-13T06:08:33.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49eb196640 1 -- 172.21.15.130:0/3276242282 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e412be30 con 0x7f49e41f6450 2023-09-13T06:08:33.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49eb196640 1 -- 172.21.15.130:0/3276242282 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e412edf0 con 0x7f49e41f6450 2023-09-13T06:08:33.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49d97fa640 1 -- 172.21.15.130:0/3276242282 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f49dc003980 con 0x7f49e41f6450 2023-09-13T06:08:33.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.127+0000 7f49d97fa640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f49d0065b20 0x7f49d0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.131+0000 7f49d97fa640 1 -- 172.21.15.130:0/3276242282 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f49dc082670 con 0x7f49e41f6450 2023-09-13T06:08:33.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.131+0000 7f49e8f32640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f49d0065b20 0x7f49d0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.131+0000 7f49e8f32640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f49d0065b20 0x7f49d0067fe0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f49e0001ec0 tx=0x7f49e0001e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:33.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.131+0000 7f49d97fa640 1 -- 172.21.15.130:0/3276242282 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f49dc0502d0 con 0x7f49e41f6450 2023-09-13T06:08:33.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.331+0000 7f49eb196640 1 -- 172.21.15.130:0/3276242282 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f49e40618a0 con 0x7f49e41f6450 2023-09-13T06:08:33.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.599+0000 7f49d97fa640 1 -- 172.21.15.130:0/3276242282 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v391) v1 ==== 140+0+0 (secure 0 0 0) 0x7f49dc0538f0 con 0x7f49e41f6450 2023-09-13T06:08:33.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 -- 172.21.15.130:0/3276242282 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f49d0065b20 msgr2=0x7f49d0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f49d0065b20 0x7f49d0067fe0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f49e0001ec0 tx=0x7f49e0001e30 comp rx=0 tx=0).stop 2023-09-13T06:08:33.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 -- 172.21.15.130:0/3276242282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e41f6450 msgr2=0x7f49e41f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e41f6450 0x7f49e41f68d0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f49e41469d0 tx=0x7f49dc00eb90 comp rx=0 tx=0).stop 2023-09-13T06:08:33.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 -- 172.21.15.130:0/3276242282 shutdown_connections 2023-09-13T06:08:33.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f49d0065b20 0x7f49d0067fe0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e41f6450 0x7f49e41f68d0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49e415d910 0x7f49e412de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 --2- 172.21.15.130:0/3276242282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc0047d0 0x7f49e4160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 -- 172.21.15.130:0/3276242282 >> 172.21.15.130:0/3276242282 conn(0x7f49e40b0bc0 msgr2=0x7f49e415ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:33.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 -- 172.21.15.130:0/3276242282 shutdown_connections 2023-09-13T06:08:33.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.603+0000 7f49eb196640 1 -- 172.21.15.130:0/3276242282 wait complete. 2023-09-13T06:08:33.626 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-09-13T06:08:33.627 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-09-13T06:08:33.628 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:08:33.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.763+0000 7f012831f640 1 Processor -- start 2023-09-13T06:08:33.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.763+0000 7f012831f640 1 -- start start 2023-09-13T06:08:33.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.763+0000 7f012831f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f01200af9e0 0x7f012006bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.763+0000 7f012831f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012006b5e0 con 0x7f0120147f30 2023-09-13T06:08:33.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.763+0000 7f012831f640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012006b8c0 con 0x7f0120147b50 2023-09-13T06:08:33.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.763+0000 7f012831f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0120165ac0 con 0x7f01200af9e0 2023-09-13T06:08:33.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.763+0000 7f01258ba640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0120147f30 0x7f0120148410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42320/0 (socket says 172.21.15.130:42320) 2023-09-13T06:08:33.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.763+0000 7f01258ba640 1 -- 172.21.15.130:0/2576761166 learned_addr learned my addr 172.21.15.130:0/2576761166 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:33.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.767+0000 7f01268bc640 1 --2- 172.21.15.130:0/2576761166 >> v2:172.21.15.164:3300/0 conn(0x7f01200af9e0 0x7f012006bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.767+0000 7f01250b9640 1 -- 172.21.15.130:0/2576761166 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392971267 0 0) 0x7f012006b5e0 con 0x7f0120147f30 2023-09-13T06:08:33.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.767+0000 7f01250b9640 1 -- 172.21.15.130:0/2576761166 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f010c003530 con 0x7f0120147f30 2023-09-13T06:08:33.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.767+0000 7f01268bc640 1 -- 172.21.15.130:0/2576761166 >> v1:172.21.15.164:6789/0 conn(0x7f0120147b50 legacy=0x7f01201652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.767+0000 7f01268bc640 1 -- 172.21.15.130:0/2576761166 >> v1:172.21.15.130:6789/0 conn(0x7f0120147f30 legacy=0x7f0120148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.767+0000 7f01268bc640 1 -- 172.21.15.130:0/2576761166 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0120165da0 con 0x7f01200af9e0 2023-09-13T06:08:33.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.767+0000 7f01268bc640 1 --2- 172.21.15.130:0/2576761166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01200af9e0 0x7f012006bd50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0118009d90 tx=0x7f011801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5f9a4151923990b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:33.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.767+0000 7f01250b9640 1 -- 172.21.15.130:0/2576761166 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01180a5900 con 0x7f01200af9e0 2023-09-13T06:08:33.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.767+0000 7f01250b9640 1 -- 172.21.15.130:0/2576761166 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01180a5a60 con 0x7f01200af9e0 2023-09-13T06:08:33.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.767+0000 7f01250b9640 1 -- 172.21.15.130:0/2576761166 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01180a5df0 con 0x7f01200af9e0 2023-09-13T06:08:33.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 -- 172.21.15.130:0/2576761166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01200af9e0 msgr2=0x7f012006bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 --2- 172.21.15.130:0/2576761166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01200af9e0 0x7f012006bd50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0118009d90 tx=0x7f011801c920 comp rx=0 tx=0).stop 2023-09-13T06:08:33.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 -- 172.21.15.130:0/2576761166 shutdown_connections 2023-09-13T06:08:33.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 --2- 172.21.15.130:0/2576761166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01200af9e0 0x7f012006bd50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 -- 172.21.15.130:0/2576761166 >> 172.21.15.130:0/2576761166 conn(0x7f0120065990 msgr2=0x7f0120065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:33.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 -- 172.21.15.130:0/2576761166 shutdown_connections 2023-09-13T06:08:33.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 -- 172.21.15.130:0/2576761166 wait complete. 2023-09-13T06:08:33.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 Processor -- start 2023-09-13T06:08:33.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 -- start start 2023-09-13T06:08:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01200af9e0 0x7f01200cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0120147b50 0x7f01200cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0120147f30 0x7f0120163320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0120128680 con 0x7f01200af9e0 2023-09-13T06:08:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0120128960 con 0x7f0120147f30 2023-09-13T06:08:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f012831f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0120128c40 con 0x7f0120147b50 2023-09-13T06:08:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f01260bb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01200af9e0 0x7f01200cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f01260bb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01200af9e0 0x7f01200cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59580/0 (socket says 172.21.15.130:59580) 2023-09-13T06:08:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f01260bb640 1 -- 172.21.15.130:0/3267283771 learned_addr learned my addr 172.21.15.130:0/3267283771 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f01268bc640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0120147f30 0x7f0120163320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f01258ba640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0120147b50 0x7f01200cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f01260bb640 1 -- 172.21.15.130:0/3267283771 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0120147b50 msgr2=0x7f01200cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f01260bb640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0120147b50 0x7f01200cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f01260bb640 1 -- 172.21.15.130:0/3267283771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0120147f30 msgr2=0x7f0120163320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f01260bb640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0120147f30 0x7f0120163320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f01260bb640 1 -- 172.21.15.130:0/3267283771 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0118009a70 con 0x7f01200af9e0 2023-09-13T06:08:33.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.771+0000 7f01268bc640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0120147f30 0x7f0120163320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:33.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f01260bb640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01200af9e0 0x7f01200cf000 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c500 tx=0x7f011c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:33.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f0116ffd640 1 -- 172.21.15.130:0/3267283771 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c005220 con 0x7f01200af9e0 2023-09-13T06:08:33.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f0116ffd640 1 -- 172.21.15.130:0/3267283771 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c005380 con 0x7f01200af9e0 2023-09-13T06:08:33.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f0116ffd640 1 -- 172.21.15.130:0/3267283771 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c007270 con 0x7f01200af9e0 2023-09-13T06:08:33.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f012831f640 1 -- 172.21.15.130:0/3267283771 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0120128f20 con 0x7f01200af9e0 2023-09-13T06:08:33.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f012831f640 1 -- 172.21.15.130:0/3267283771 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01200cf540 con 0x7f01200af9e0 2023-09-13T06:08:33.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f012831f640 1 -- 172.21.15.130:0/3267283771 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0120129440 con 0x7f01200af9e0 2023-09-13T06:08:33.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f0116ffd640 1 -- 172.21.15.130:0/3267283771 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f011c0073d0 con 0x7f01200af9e0 2023-09-13T06:08:33.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f0116ffd640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0104065b20 0x7f0104067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:33.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f0116ffd640 1 -- 172.21.15.130:0/3267283771 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f011c082a30 con 0x7f01200af9e0 2023-09-13T06:08:33.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f01258ba640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0104065b20 0x7f0104067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:33.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.775+0000 7f01258ba640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0104065b20 0x7f0104067fe0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f01201fd460 tx=0x7f0110009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:33.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.779+0000 7f0116ffd640 1 -- 172.21.15.130:0/3267283771 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0120129440 con 0x7f01200af9e0 2023-09-13T06:08:33.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.931+0000 7f012831f640 1 -- 172.21.15.130:0/3267283771 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0120129440 con 0x7f01200af9e0 2023-09-13T06:08:33.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.931+0000 7f0116ffd640 1 -- 172.21.15.130:0/3267283771 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+13035 (secure 0 0 0) 0x7f0120129440 con 0x7f01200af9e0 2023-09-13T06:08:33.934 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:33.935 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":146,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:08:32.598332+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:6835/4146626637":"2023-09-14T06:08:29.586155+0000","172.21.15.164:6833/4146626637":"2023-09-14T06:08:29.586155+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:08:33.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 -- 172.21.15.130:0/3267283771 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0104065b20 msgr2=0x7f0104067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0104065b20 0x7f0104067fe0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f01201fd460 tx=0x7f0110009040 comp rx=0 tx=0).stop 2023-09-13T06:08:33.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 -- 172.21.15.130:0/3267283771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01200af9e0 msgr2=0x7f01200cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:33.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01200af9e0 0x7f01200cf000 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c500 tx=0x7f011c00c9c0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 -- 172.21.15.130:0/3267283771 shutdown_connections 2023-09-13T06:08:33.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0104065b20 0x7f0104067fe0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0120147f30 0x7f0120163320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0120147b50 0x7f01200cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 --2- 172.21.15.130:0/3267283771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01200af9e0 0x7f01200cf000 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:33.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 -- 172.21.15.130:0/3267283771 >> 172.21.15.130:0/3267283771 conn(0x7f0120065990 msgr2=0x7f01200aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:33.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 -- 172.21.15.130:0/3267283771 shutdown_connections 2023-09-13T06:08:33.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:33.935+0000 7f012831f640 1 -- 172.21.15.130:0/3267283771 wait complete. 2023-09-13T06:08:33.955 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:08:33.956 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:08:34.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.091+0000 7f3598982640 1 Processor -- start 2023-09-13T06:08:34.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.091+0000 7f3598982640 1 -- start start 2023-09-13T06:08:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.095+0000 7f3598982640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f359415a080 0x7f35940b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.095+0000 7f3598982640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35940cc850 con 0x7f35940b31a0 2023-09-13T06:08:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.095+0000 7f3598982640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35940b0330 con 0x7f359415e650 2023-09-13T06:08:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.095+0000 7f3598982640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35940cbcd0 con 0x7f359415a080 2023-09-13T06:08:34.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.095+0000 7f359259c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f359415a080 0x7f35940b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:34.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.095+0000 7f3592d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f35940b31a0 0x7f35940ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42324/0 (socket says 172.21.15.130:42324) 2023-09-13T06:08:34.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.095+0000 7f3592d9d640 1 -- 172.21.15.130:0/956498334 learned_addr learned my addr 172.21.15.130:0/956498334 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:34.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.095+0000 7f359259c640 1 -- 172.21.15.130:0/956498334 >> v1:172.21.15.164:6789/0 conn(0x7f359415e650 legacy=0x7f35940b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:34.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.095+0000 7f359259c640 1 -- 172.21.15.130:0/956498334 >> v1:172.21.15.130:6789/0 conn(0x7f35940b31a0 legacy=0x7f35940ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:34.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.095+0000 7f359259c640 1 -- 172.21.15.130:0/956498334 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35940cbfb0 con 0x7f359415a080 2023-09-13T06:08:34.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.095+0000 7f3591d9b640 1 -- 172.21.15.130:0/956498334 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822458032 0 0) 0x7f358c0014a0 con 0x7f35940b31a0 2023-09-13T06:08:34.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f359259c640 1 --2- 172.21.15.130:0/956498334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f359415a080 0x7f35940b1460 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f35840097c0 tx=0x7f358401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3b117a77051d92 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:34.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3591d9b640 1 -- 172.21.15.130:0/956498334 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840ab600 con 0x7f359415a080 2023-09-13T06:08:34.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3591d9b640 1 -- 172.21.15.130:0/956498334 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35840a7050 con 0x7f359415a080 2023-09-13T06:08:34.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3591d9b640 1 -- 172.21.15.130:0/956498334 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840ab980 con 0x7f359415a080 2023-09-13T06:08:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3598982640 1 -- 172.21.15.130:0/956498334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f359415a080 msgr2=0x7f35940b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3598982640 1 --2- 172.21.15.130:0/956498334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f359415a080 0x7f35940b1460 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f35840097c0 tx=0x7f358401c350 comp rx=0 tx=0).stop 2023-09-13T06:08:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3598982640 1 -- 172.21.15.130:0/956498334 shutdown_connections 2023-09-13T06:08:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3598982640 1 --2- 172.21.15.130:0/956498334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f359415a080 0x7f35940b1460 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3598982640 1 -- 172.21.15.130:0/956498334 >> 172.21.15.130:0/956498334 conn(0x7f3594065990 msgr2=0x7f3594065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:34.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3598982640 1 -- 172.21.15.130:0/956498334 shutdown_connections 2023-09-13T06:08:34.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3598982640 1 -- 172.21.15.130:0/956498334 wait complete. 2023-09-13T06:08:34.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3598982640 1 Processor -- start 2023-09-13T06:08:34.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.099+0000 7f3598982640 1 -- start start 2023-09-13T06:08:34.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3598982640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35940b31a0 0x7f35941463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:34.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3598982640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f359415a080 0x7f3594143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:34.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3598982640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f359415e650 0x7f35940b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:34.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3598982640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359406b8d0 con 0x7f359415e650 2023-09-13T06:08:34.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3598982640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35941442c0 con 0x7f359415a080 2023-09-13T06:08:34.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3598982640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359414e380 con 0x7f35940b31a0 2023-09-13T06:08:34.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3592d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f359415e650 0x7f35940b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:34.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3592d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f359415e650 0x7f35940b1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59598/0 (socket says 172.21.15.130:59598) 2023-09-13T06:08:34.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3592d9d640 1 -- 172.21.15.130:0/563946383 learned_addr learned my addr 172.21.15.130:0/563946383 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:34.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f359259c640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35940b31a0 0x7f35941463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:34.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3589d9b640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f359415a080 0x7f3594143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:34.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3592d9d640 1 -- 172.21.15.130:0/563946383 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35940b31a0 msgr2=0x7f35941463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:34.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3592d9d640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35940b31a0 0x7f35941463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3592d9d640 1 -- 172.21.15.130:0/563946383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f359415a080 msgr2=0x7f3594143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:34.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3592d9d640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f359415a080 0x7f3594143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3592d9d640 1 -- 172.21.15.130:0/563946383 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3584009420 con 0x7f359415e650 2023-09-13T06:08:34.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3589d9b640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f359415a080 0x7f3594143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:34.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3592d9d640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f359415e650 0x7f35940b1390 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c810 tx=0x7f358c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:34.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f358b7fe640 1 -- 172.21.15.130:0/563946383 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00a640 con 0x7f359415e650 2023-09-13T06:08:34.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f358b7fe640 1 -- 172.21.15.130:0/563946383 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c00a7a0 con 0x7f359415e650 2023-09-13T06:08:34.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3598982640 1 -- 172.21.15.130:0/563946383 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359414e660 con 0x7f359415e650 2023-09-13T06:08:34.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f358b7fe640 1 -- 172.21.15.130:0/563946383 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00ab50 con 0x7f359415e650 2023-09-13T06:08:34.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3598982640 1 -- 172.21.15.130:0/563946383 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3594147e60 con 0x7f359415e650 2023-09-13T06:08:34.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f3598982640 1 -- 172.21.15.130:0/563946383 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3594149500 con 0x7f359415e650 2023-09-13T06:08:34.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.103+0000 7f358b7fe640 1 -- 172.21.15.130:0/563946383 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f358c00acb0 con 0x7f359415e650 2023-09-13T06:08:34.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.107+0000 7f358b7fe640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3574065b20 0x7f3574067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:34.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.107+0000 7f358b7fe640 1 -- 172.21.15.130:0/563946383 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f358c082360 con 0x7f359415e650 2023-09-13T06:08:34.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.107+0000 7f359259c640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3574065b20 0x7f3574067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:34.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.107+0000 7f359259c640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3574065b20 0x7f3574067fe0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f35840ad000 tx=0x7f35840a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:34.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.111+0000 7f358b7fe640 1 -- 172.21.15.130:0/563946383 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f358c050060 con 0x7f359415e650 2023-09-13T06:08:34.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.255+0000 7f3598982640 1 -- 172.21.15.130:0/563946383 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3594147cc0 con 0x7f359415e650 2023-09-13T06:08:34.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f358b7fe640 1 -- 172.21.15.130:0/563946383 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v146) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3594147cc0 con 0x7f359415e650 2023-09-13T06:08:34.260 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:08:34.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 -- 172.21.15.130:0/563946383 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3574065b20 msgr2=0x7f3574067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:34.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3574065b20 0x7f3574067fe0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f35840ad000 tx=0x7f35840a6000 comp rx=0 tx=0).stop 2023-09-13T06:08:34.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 -- 172.21.15.130:0/563946383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f359415e650 msgr2=0x7f35940b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:34.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f359415e650 0x7f35940b1390 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c810 tx=0x7f358c00ccd0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 -- 172.21.15.130:0/563946383 shutdown_connections 2023-09-13T06:08:34.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3574065b20 0x7f3574067fe0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f359415a080 0x7f3594143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f359415e650 0x7f35940b1390 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 --2- 172.21.15.130:0/563946383 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35940b31a0 0x7f35941463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 -- 172.21.15.130:0/563946383 >> 172.21.15.130:0/563946383 conn(0x7f3594065990 msgr2=0x7f3594153240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:34.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 -- 172.21.15.130:0/563946383 shutdown_connections 2023-09-13T06:08:34.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.259+0000 7f3598982640 1 -- 172.21.15.130:0/563946383 wait complete. 2023-09-13T06:08:34.281 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-09-13T06:08:34.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd580dfa640 1 Processor -- start 2023-09-13T06:08:34.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd580dfa640 1 -- start start 2023-09-13T06:08:34.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd580dfa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd57c0cc780 0x7fd57c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:34.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd580dfa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 0x7fd57c0b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:34.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd580dfa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c0ccbe0 con 0x7fd57c15b130 2023-09-13T06:08:34.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd580dfa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c0b0e70 con 0x7fd57c0cc780 2023-09-13T06:08:34.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd580dfa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0ce980 con 0x7fd57c0b04a0 2023-09-13T06:08:34.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd57ad9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 0x7fd57c0b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:34.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd573fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd57c0cc780 0x7fd57c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:34.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd57ad9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 0x7fd57c0b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:59128/0 (socket says 172.21.15.130:59128) 2023-09-13T06:08:34.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd57ad9d640 1 -- 172.21.15.130:0/3576348025 learned_addr learned my addr 172.21.15.130:0/3576348025 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:34.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd57ad9d640 1 -- 172.21.15.130:0/3576348025 >> v2:172.21.15.164:3300/0 conn(0x7fd57c0cc780 msgr2=0x7fd57c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:34.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd57ad9d640 1 --2- 172.21.15.130:0/3576348025 >> v2:172.21.15.164:3300/0 conn(0x7fd57c0cc780 0x7fd57c15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd57ad9d640 1 -- 172.21.15.130:0/3576348025 >> v1:172.21.15.164:6789/0 conn(0x7fd57c15b130 legacy=0x7fd57c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:34.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd57ad9d640 1 -- 172.21.15.130:0/3576348025 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c0cec60 con 0x7fd57c0b04a0 2023-09-13T06:08:34.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.419+0000 7fd573fff640 1 --2- 172.21.15.130:0/3576348025 >> v2:172.21.15.164:3300/0 conn(0x7fd57c0cc780 0x7fd57c15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:08:34.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd57ad9d640 1 --2- 172.21.15.130:0/3576348025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 0x7fd57c0b0930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd574009e50 tx=0x7fd57401c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a74f2f13e208d92 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:34.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd579d9b640 1 -- 172.21.15.130:0/3576348025 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740a58a0 con 0x7fd57c0b04a0 2023-09-13T06:08:34.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd579d9b640 1 -- 172.21.15.130:0/3576348025 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5740a5a00 con 0x7fd57c0b04a0 2023-09-13T06:08:34.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd579d9b640 1 -- 172.21.15.130:0/3576348025 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740a5d90 con 0x7fd57c0b04a0 2023-09-13T06:08:34.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd580dfa640 1 -- 172.21.15.130:0/3576348025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 msgr2=0x7fd57c0b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:34.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd580dfa640 1 --2- 172.21.15.130:0/3576348025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 0x7fd57c0b0930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd574009e50 tx=0x7fd57401c9e0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd580dfa640 1 -- 172.21.15.130:0/3576348025 shutdown_connections 2023-09-13T06:08:34.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd580dfa640 1 --2- 172.21.15.130:0/3576348025 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 0x7fd57c0b0930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd580dfa640 1 --2- 172.21.15.130:0/3576348025 >> v2:172.21.15.164:3300/0 conn(0x7fd57c0cc780 0x7fd57c15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd580dfa640 1 -- 172.21.15.130:0/3576348025 >> 172.21.15.130:0/3576348025 conn(0x7fd57c065990 msgr2=0x7fd57c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:34.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd580dfa640 1 -- 172.21.15.130:0/3576348025 shutdown_connections 2023-09-13T06:08:34.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.423+0000 7fd580dfa640 1 -- 172.21.15.130:0/3576348025 wait complete. 2023-09-13T06:08:34.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd580dfa640 1 Processor -- start 2023-09-13T06:08:34.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd580dfa640 1 -- start start 2023-09-13T06:08:34.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd580dfa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 0x7fd57c13da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:34.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd580dfa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c0cc780 0x7fd57c14f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:34.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd580dfa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c15b130 0x7fd57c14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:34.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd580dfa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c1540e0 con 0x7fd57c15b130 2023-09-13T06:08:34.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd580dfa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c153760 con 0x7fd57c0cc780 2023-09-13T06:08:34.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd580dfa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c151880 con 0x7fd57c0b04a0 2023-09-13T06:08:34.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd57ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c15b130 0x7fd57c14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:34.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd57ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c15b130 0x7fd57c14fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59612/0 (socket says 172.21.15.130:59612) 2023-09-13T06:08:34.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd57ad9d640 1 -- 172.21.15.130:0/907222712 learned_addr learned my addr 172.21.15.130:0/907222712 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:34.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd573fff640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c0cc780 0x7fd57c14f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:34.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd57a59c640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 0x7fd57c13da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:34.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd57ad9d640 1 -- 172.21.15.130:0/907222712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 msgr2=0x7fd57c13da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:34.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd57ad9d640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 0x7fd57c13da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd57ad9d640 1 -- 172.21.15.130:0/907222712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c0cc780 msgr2=0x7fd57c14f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:34.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd57ad9d640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c0cc780 0x7fd57c14f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:34.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd57ad9d640 1 -- 172.21.15.130:0/907222712 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd564009420 con 0x7fd57c15b130 2023-09-13T06:08:34.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd57ad9d640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c15b130 0x7fd57c14fd10 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fd57401a610 tx=0x7fd574019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:34.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd572ffd640 1 -- 172.21.15.130:0/907222712 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740b8670 con 0x7fd57c15b130 2023-09-13T06:08:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd572ffd640 1 -- 172.21.15.130:0/907222712 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5740b87d0 con 0x7fd57c15b130 2023-09-13T06:08:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd572ffd640 1 -- 172.21.15.130:0/907222712 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740b8b60 con 0x7fd57c15b130 2023-09-13T06:08:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd580dfa640 1 -- 172.21.15.130:0/907222712 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd574009b30 con 0x7fd57c15b130 2023-09-13T06:08:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd580dfa640 1 -- 172.21.15.130:0/907222712 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57c153d00 con 0x7fd57c15b130 2023-09-13T06:08:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.427+0000 7fd580dfa640 1 -- 172.21.15.130:0/907222712 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57c154220 con 0x7fd57c15b130 2023-09-13T06:08:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.431+0000 7fd572ffd640 1 -- 172.21.15.130:0/907222712 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd5740b8cc0 con 0x7fd57c15b130 2023-09-13T06:08:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.431+0000 7fd572ffd640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd55c065b20 0x7fd55c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.431+0000 7fd572ffd640 1 -- 172.21.15.130:0/907222712 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd57411e610 con 0x7fd57c15b130 2023-09-13T06:08:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.431+0000 7fd57a59c640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd55c065b20 0x7fd55c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.431+0000 7fd57a59c640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd55c065b20 0x7fd55c067fe0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd56c000f70 tx=0x7fd56c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:34.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.435+0000 7fd572ffd640 1 -- 172.21.15.130:0/907222712 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd57c154220 con 0x7fd57c15b130 2023-09-13T06:08:34.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:34.639+0000 7fd580dfa640 1 -- 172.21.15.130:0/907222712 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7fd57c154220 con 0x7fd57c15b130 2023-09-13T06:08:35.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.607+0000 7fd572ffd640 1 -- 172.21.15.130:0/907222712 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v393) v1 ==== 135+0+0 (secure 0 0 0) 0x7fd57c154220 con 0x7fd57c15b130 2023-09-13T06:08:35.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 -- 172.21.15.130:0/907222712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd55c065b20 msgr2=0x7fd55c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:35.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd55c065b20 0x7fd55c067fe0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd56c000f70 tx=0x7fd56c009040 comp rx=0 tx=0).stop 2023-09-13T06:08:35.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 -- 172.21.15.130:0/907222712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c15b130 msgr2=0x7fd57c14fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:35.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c15b130 0x7fd57c14fd10 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fd57401a610 tx=0x7fd574019780 comp rx=0 tx=0).stop 2023-09-13T06:08:35.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 -- 172.21.15.130:0/907222712 shutdown_connections 2023-09-13T06:08:35.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd55c065b20 0x7fd55c067fe0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd57c0cc780 0x7fd57c14f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd57c15b130 0x7fd57c14fd10 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 --2- 172.21.15.130:0/907222712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd57c0b04a0 0x7fd57c13da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 -- 172.21.15.130:0/907222712 >> 172.21.15.130:0/907222712 conn(0x7fd57c065990 msgr2=0x7fd57c0b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:35.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 -- 172.21.15.130:0/907222712 shutdown_connections 2023-09-13T06:08:35.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.611+0000 7fd580dfa640 1 -- 172.21.15.130:0/907222712 wait complete. 2023-09-13T06:08:35.638 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-13T06:08:35.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.779+0000 7efc194d5640 1 Processor -- start 2023-09-13T06:08:35.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.779+0000 7efc194d5640 1 -- start start 2023-09-13T06:08:35.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc194d5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efc14144a20 0x7efc1415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:35.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc194d5640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc140afe60 0x7efc140b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:35.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc194d5640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1415ea70 con 0x7efc140ad690 2023-09-13T06:08:35.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc194d5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc140b0850 con 0x7efc14144a20 2023-09-13T06:08:35.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc194d5640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1415ed50 con 0x7efc140afe60 2023-09-13T06:08:35.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc13fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efc14144a20 0x7efc1415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:35.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc13fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efc14144a20 0x7efc1415b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59620/0 (socket says 172.21.15.130:59620) 2023-09-13T06:08:35.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc13fff640 1 -- 172.21.15.130:0/3777169343 learned_addr learned my addr 172.21.15.130:0/3777169343 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:35.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc13fff640 1 -- 172.21.15.130:0/3777169343 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc140afe60 msgr2=0x7efc140b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:35.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc13fff640 1 --2- 172.21.15.130:0/3777169343 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc140afe60 0x7efc140b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc13fff640 1 -- 172.21.15.130:0/3777169343 >> v1:172.21.15.164:6789/0 conn(0x7efc140ad690 legacy=0x7efc1415f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:35.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.783+0000 7efc13fff640 1 -- 172.21.15.130:0/3777169343 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc140ce900 con 0x7efc14144a20 2023-09-13T06:08:35.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc13fff640 1 --2- 172.21.15.130:0/3777169343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc14144a20 0x7efc1415b4a0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7efc04009870 tx=0x7efc0401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e6faa4130a1b50 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:35.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc12ffd640 1 -- 172.21.15.130:0/3777169343 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc040ac410 con 0x7efc14144a20 2023-09-13T06:08:35.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc12ffd640 1 -- 172.21.15.130:0/3777169343 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc040ac570 con 0x7efc14144a20 2023-09-13T06:08:35.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc12ffd640 1 -- 172.21.15.130:0/3777169343 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc040ac900 con 0x7efc14144a20 2023-09-13T06:08:35.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc194d5640 1 -- 172.21.15.130:0/3777169343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc14144a20 msgr2=0x7efc1415b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:35.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc194d5640 1 --2- 172.21.15.130:0/3777169343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc14144a20 0x7efc1415b4a0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7efc04009870 tx=0x7efc0401c500 comp rx=0 tx=0).stop 2023-09-13T06:08:35.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc194d5640 1 -- 172.21.15.130:0/3777169343 shutdown_connections 2023-09-13T06:08:35.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc194d5640 1 --2- 172.21.15.130:0/3777169343 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc140afe60 0x7efc140b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc194d5640 1 --2- 172.21.15.130:0/3777169343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc14144a20 0x7efc1415b4a0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc194d5640 1 -- 172.21.15.130:0/3777169343 >> 172.21.15.130:0/3777169343 conn(0x7efc14065990 msgr2=0x7efc14065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc194d5640 1 -- 172.21.15.130:0/3777169343 shutdown_connections 2023-09-13T06:08:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc194d5640 1 -- 172.21.15.130:0/3777169343 wait complete. 2023-09-13T06:08:35.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc194d5640 1 Processor -- start 2023-09-13T06:08:35.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.787+0000 7efc194d5640 1 -- start start 2023-09-13T06:08:35.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc194d5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc140ad690 0x7efc14140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:35.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc194d5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc140afe60 0x7efc140acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:35.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc194d5640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc14144a20 0x7efc140b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:35.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc194d5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc141f8d20 con 0x7efc140afe60 2023-09-13T06:08:35.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc194d5640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc141f5c30 con 0x7efc140ad690 2023-09-13T06:08:35.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc194d5640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc141f5f10 con 0x7efc14144a20 2023-09-13T06:08:35.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc137fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc140afe60 0x7efc140acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:35.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc137fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc140afe60 0x7efc140acaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59626/0 (socket says 172.21.15.130:59626) 2023-09-13T06:08:35.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc137fe640 1 -- 172.21.15.130:0/2439328850 learned_addr learned my addr 172.21.15.130:0/2439328850 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:35.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc13fff640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc140ad690 0x7efc14140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:35.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc18cd4640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc14144a20 0x7efc140b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:35.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc137fe640 1 -- 172.21.15.130:0/2439328850 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc14144a20 msgr2=0x7efc140b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:35.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc137fe640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc14144a20 0x7efc140b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc137fe640 1 -- 172.21.15.130:0/2439328850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc140ad690 msgr2=0x7efc14140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:35.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc137fe640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc140ad690 0x7efc14140030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc137fe640 1 -- 172.21.15.130:0/2439328850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040094d0 con 0x7efc140afe60 2023-09-13T06:08:35.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc13fff640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc140ad690 0x7efc14140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:35.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc137fe640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc140afe60 0x7efc140acaa0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7efc0800c410 tx=0x7efc0800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:35.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc10ff9640 1 -- 172.21.15.130:0/2439328850 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08003600 con 0x7efc140afe60 2023-09-13T06:08:35.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc10ff9640 1 -- 172.21.15.130:0/2439328850 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc08003780 con 0x7efc140afe60 2023-09-13T06:08:35.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc10ff9640 1 -- 172.21.15.130:0/2439328850 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08003b30 con 0x7efc140afe60 2023-09-13T06:08:35.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc194d5640 1 -- 172.21.15.130:0/2439328850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc141f61f0 con 0x7efc140afe60 2023-09-13T06:08:35.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc194d5640 1 -- 172.21.15.130:0/2439328850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc14140570 con 0x7efc140afe60 2023-09-13T06:08:35.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc194d5640 1 -- 172.21.15.130:0/2439328850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc141f8ed0 con 0x7efc140afe60 2023-09-13T06:08:35.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.791+0000 7efc10ff9640 1 -- 172.21.15.130:0/2439328850 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efc08003c90 con 0x7efc140afe60 2023-09-13T06:08:35.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.795+0000 7efc10ff9640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc00065b20 0x7efc00067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:35.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.795+0000 7efc10ff9640 1 -- 172.21.15.130:0/2439328850 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efc080823c0 con 0x7efc140afe60 2023-09-13T06:08:35.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.795+0000 7efc13fff640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc00065b20 0x7efc00067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:35.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.795+0000 7efc13fff640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc00065b20 0x7efc00067fe0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7efc040ae000 tx=0x7efc04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:35.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.799+0000 7efc10ff9640 1 -- 172.21.15.130:0/2439328850 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7efc141f8ed0 con 0x7efc140afe60 2023-09-13T06:08:35.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.947+0000 7efc194d5640 1 -- 172.21.15.130:0/2439328850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efc140618a0 con 0x7efc140afe60 2023-09-13T06:08:35.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc10ff9640 1 -- 172.21.15.130:0/2439328850 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7efc0804ff70 con 0x7efc140afe60 2023-09-13T06:08:35.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 -- 172.21.15.130:0/2439328850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc00065b20 msgr2=0x7efc00067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:35.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc00065b20 0x7efc00067fe0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7efc040ae000 tx=0x7efc04008040 comp rx=0 tx=0).stop 2023-09-13T06:08:35.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 -- 172.21.15.130:0/2439328850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc140afe60 msgr2=0x7efc140acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:35.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc140afe60 0x7efc140acaa0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7efc0800c410 tx=0x7efc0800c8d0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 -- 172.21.15.130:0/2439328850 shutdown_connections 2023-09-13T06:08:35.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc00065b20 0x7efc00067fe0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc14144a20 0x7efc140b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc140afe60 0x7efc140acaa0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 --2- 172.21.15.130:0/2439328850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc140ad690 0x7efc14140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:35.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 -- 172.21.15.130:0/2439328850 >> 172.21.15.130:0/2439328850 conn(0x7efc14065990 msgr2=0x7efc140ade20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:35.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 -- 172.21.15.130:0/2439328850 shutdown_connections 2023-09-13T06:08:35.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:35.951+0000 7efc194d5640 1 -- 172.21.15.130:0/2439328850 wait complete. 2023-09-13T06:08:35.975 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:08:35.976 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:08:36.051 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:08:36.108 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:08:36.109 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:08:36.110 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:36.121 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:08:36.122 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:08:36.123 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:36.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:08:36.147 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:08:36.148 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:36.178 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:08:36.178 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:08:36.179 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:36.199 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:08:36.200 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-13T06:08:36.200 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:08:36.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b7e48640 1 Processor -- start 2023-09-13T06:08:36.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b7e48640 1 -- start start 2023-09-13T06:08:36.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b7e48640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa0b0147b50 0x7fa0b01652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b7e48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b00af9e0 0x7fa0b006bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b7e48640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b006b5e0 con 0x7fa0b0147f30 2023-09-13T06:08:36.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b7e48640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b006b8c0 con 0x7fa0b0147b50 2023-09-13T06:08:36.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b7e48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b01657f0 con 0x7fa0b00af9e0 2023-09-13T06:08:36.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b63e5640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b00af9e0 0x7fa0b006bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b5be4640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa0b0147b50 0x7fa0b01652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b63e5640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b00af9e0 0x7fa0b006bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:59170/0 (socket says 172.21.15.130:59170) 2023-09-13T06:08:36.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b63e5640 1 -- 172.21.15.130:0/1969797092 learned_addr learned my addr 172.21.15.130:0/1969797092 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:36.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b53e3640 1 --1- 172.21.15.130:0/1969797092 >> v1:172.21.15.164:6789/0 conn(0x7fa0b0147f30 0x7fa0b0148410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:52446/0 (socket says 172.21.15.130:52446) 2023-09-13T06:08:36.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b5be4640 1 --2- 172.21.15.130:0/1969797092 >> v2:172.21.15.164:3300/0 conn(0x7fa0b0147b50 0x7fa0b01652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:50474/0 (socket says 172.21.15.130:50474) 2023-09-13T06:08:36.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b63e5640 1 -- 172.21.15.130:0/1969797092 >> v2:172.21.15.164:3300/0 conn(0x7fa0b0147b50 msgr2=0x7fa0b01652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:36.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b63e5640 1 --2- 172.21.15.130:0/1969797092 >> v2:172.21.15.164:3300/0 conn(0x7fa0b0147b50 0x7fa0b01652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b63e5640 1 -- 172.21.15.130:0/1969797092 >> v1:172.21.15.164:6789/0 conn(0x7fa0b0147f30 legacy=0x7fa0b0148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:36.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.359+0000 7fa0b63e5640 1 -- 172.21.15.130:0/1969797092 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b0165ac0 con 0x7fa0b00af9e0 2023-09-13T06:08:36.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b63e5640 1 --2- 172.21.15.130:0/1969797092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b00af9e0 0x7fa0b006bd50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009e50 tx=0x7fa0a801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cea4b7ee85bf9ae5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:36.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b4be2640 1 -- 172.21.15.130:0/1969797092 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80a58a0 con 0x7fa0b00af9e0 2023-09-13T06:08:36.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b4be2640 1 -- 172.21.15.130:0/1969797092 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a80a5a00 con 0x7fa0b00af9e0 2023-09-13T06:08:36.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b4be2640 1 -- 172.21.15.130:0/1969797092 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80a5d90 con 0x7fa0b00af9e0 2023-09-13T06:08:36.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b7e48640 1 -- 172.21.15.130:0/1969797092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b00af9e0 msgr2=0x7fa0b006bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:36.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b7e48640 1 --2- 172.21.15.130:0/1969797092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b00af9e0 0x7fa0b006bd50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009e50 tx=0x7fa0a801c9e0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b7e48640 1 -- 172.21.15.130:0/1969797092 shutdown_connections 2023-09-13T06:08:36.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b7e48640 1 --2- 172.21.15.130:0/1969797092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b00af9e0 0x7fa0b006bd50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b7e48640 1 --2- 172.21.15.130:0/1969797092 >> v2:172.21.15.164:3300/0 conn(0x7fa0b0147b50 0x7fa0b01652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b7e48640 1 -- 172.21.15.130:0/1969797092 >> 172.21.15.130:0/1969797092 conn(0x7fa0b0065990 msgr2=0x7fa0b0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:36.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b7e48640 1 -- 172.21.15.130:0/1969797092 shutdown_connections 2023-09-13T06:08:36.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.363+0000 7fa0b7e48640 1 -- 172.21.15.130:0/1969797092 wait complete. 2023-09-13T06:08:36.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b7e48640 1 Processor -- start 2023-09-13T06:08:36.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b7e48640 1 -- start start 2023-09-13T06:08:36.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b7e48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0b00af9e0 0x7fa0b0139500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b7e48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b0147b50 0x7fa0b015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b7e48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0147f30 0x7fa0b0144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b7e48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b0164800 con 0x7fa0b0147f30 2023-09-13T06:08:36.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b7e48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b0163bf0 con 0x7fa0b00af9e0 2023-09-13T06:08:36.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b7e48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b0163ed0 con 0x7fa0b0147b50 2023-09-13T06:08:36.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b63e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0147f30 0x7fa0b0144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b63e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0147f30 0x7fa0b0144e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59640/0 (socket says 172.21.15.130:59640) 2023-09-13T06:08:36.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b63e5640 1 -- 172.21.15.130:0/2298370699 learned_addr learned my addr 172.21.15.130:0/2298370699 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:36.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b53e3640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b0147b50 0x7fa0b015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b5be4640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0b00af9e0 0x7fa0b0139500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b63e5640 1 -- 172.21.15.130:0/2298370699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b0147b50 msgr2=0x7fa0b015ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:36.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b63e5640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b0147b50 0x7fa0b015ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b63e5640 1 -- 172.21.15.130:0/2298370699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0b00af9e0 msgr2=0x7fa0b0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:36.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b63e5640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0b00af9e0 0x7fa0b0139500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b63e5640 1 -- 172.21.15.130:0/2298370699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a8009b30 con 0x7fa0b0147f30 2023-09-13T06:08:36.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b5be4640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0b00af9e0 0x7fa0b0139500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:36.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b63e5640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0147f30 0x7fa0b0144e00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa0a801a610 tx=0x7fa0a8019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:36.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0a67fc640 1 -- 172.21.15.130:0/2298370699 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80b8670 con 0x7fa0b0147f30 2023-09-13T06:08:36.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0a67fc640 1 -- 172.21.15.130:0/2298370699 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a80b87d0 con 0x7fa0b0147f30 2023-09-13T06:08:36.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0a67fc640 1 -- 172.21.15.130:0/2298370699 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80b8b60 con 0x7fa0b0147f30 2023-09-13T06:08:36.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b7e48640 1 -- 172.21.15.130:0/2298370699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b0148ca0 con 0x7fa0b0147f30 2023-09-13T06:08:36.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.367+0000 7fa0b7e48640 1 -- 172.21.15.130:0/2298370699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b0164490 con 0x7fa0b0147f30 2023-09-13T06:08:36.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.371+0000 7fa0b7e48640 1 -- 172.21.15.130:0/2298370699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b01649b0 con 0x7fa0b0147f30 2023-09-13T06:08:36.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.371+0000 7fa0a67fc640 1 -- 172.21.15.130:0/2298370699 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa0a80b8cc0 con 0x7fa0b0147f30 2023-09-13T06:08:36.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.371+0000 7fa0a67fc640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa094065b20 0x7fa094067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.371+0000 7fa0a67fc640 1 -- 172.21.15.130:0/2298370699 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa0a811e5b0 con 0x7fa0b0147f30 2023-09-13T06:08:36.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.371+0000 7fa0b5be4640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa094065b20 0x7fa094067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.371+0000 7fa0b5be4640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa094065b20 0x7fa094067fe0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009bb0 tx=0x7fa0ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:36.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.375+0000 7fa0a67fc640 1 -- 172.21.15.130:0/2298370699 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa0b01649b0 con 0x7fa0b0147f30 2023-09-13T06:08:36.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.555+0000 7fa0b7e48640 1 -- 172.21.15.130:0/2298370699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0b01649b0 con 0x7fa0b0147f30 2023-09-13T06:08:36.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.555+0000 7fa0a67fc640 1 -- 172.21.15.130:0/2298370699 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+3711 (secure 0 0 0) 0x7fa0a80bce90 con 0x7fa0b0147f30 2023-09-13T06:08:36.560 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:36.560 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":70,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1309237651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":1309237651},{"type":"v1","addr":"172.21.15.130:6837","nonce":1309237651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1568650238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1568650238},{"type":"v1","addr":"172.21.15.164:6834","nonce":1568650238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63},{"gid":6674,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1868068667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":1868068667},{"type":"v1","addr":"172.21.15.164:6835","nonce":1868068667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/1994572743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":1994572743},{"type":"v1","addr":"172.21.15.130:6836","nonce":1994572743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[]} 2023-09-13T06:08:36.561 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 70 2023-09-13T06:08:36.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 -- 172.21.15.130:0/2298370699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa094065b20 msgr2=0x7fa094067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:36.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa094065b20 0x7fa094067fe0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009bb0 tx=0x7fa0ac008040 comp rx=0 tx=0).stop 2023-09-13T06:08:36.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 -- 172.21.15.130:0/2298370699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0147f30 msgr2=0x7fa0b0144e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:36.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0147f30 0x7fa0b0144e00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa0a801a610 tx=0x7fa0a8019780 comp rx=0 tx=0).stop 2023-09-13T06:08:36.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 -- 172.21.15.130:0/2298370699 shutdown_connections 2023-09-13T06:08:36.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa094065b20 0x7fa094067fe0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0147f30 0x7fa0b0144e00 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0b0147b50 0x7fa0b015ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 --2- 172.21.15.130:0/2298370699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0b00af9e0 0x7fa0b0139500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 -- 172.21.15.130:0/2298370699 >> 172.21.15.130:0/2298370699 conn(0x7fa0b0065990 msgr2=0x7fa0b0148e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:36.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 -- 172.21.15.130:0/2298370699 shutdown_connections 2023-09-13T06:08:36.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.559+0000 7fa0b7e48640 1 -- 172.21.15.130:0/2298370699 wait complete. 2023-09-13T06:08:36.581 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T06:08:36.582 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-13T06:08:36.582 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T06:08:36.582 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:08:36.582 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T06:08:36.583 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-13T06:08:36.583 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T06:08:36.583 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:08:36.584 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T06:08:36.584 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-13T06:08:36.584 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T06:08:36.584 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:08:36.585 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T06:08:36.585 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-13T06:08:36.585 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T06:08:36.585 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:08:36.597 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T06:08:36.598 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T06:08:36.599 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T06:08:36.599 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T06:08:36.601 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T06:08:36.602 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T06:08:36.606 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T06:08:36.607 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T06:08:36.651 INFO:tasks.ceph.mds.a:Started 2023-09-13T06:08:36.652 DEBUG:teuthology.parallel:result is None 2023-09-13T06:08:36.655 INFO:tasks.ceph.mds.b:Started 2023-09-13T06:08:36.656 DEBUG:teuthology.parallel:result is None 2023-09-13T06:08:36.657 INFO:tasks.ceph.mds.c:Started 2023-09-13T06:08:36.658 DEBUG:teuthology.parallel:result is None 2023-09-13T06:08:36.663 INFO:tasks.ceph.mds.d:Started 2023-09-13T06:08:36.663 DEBUG:teuthology.parallel:result is None 2023-09-13T06:08:36.663 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-13T06:08:36.742 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:08:36.748 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:08:36.752 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:08:36.756 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:08:36.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.815+0000 7f1928fc6640 1 Processor -- start 2023-09-13T06:08:36.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.815+0000 7f1928fc6640 1 -- start start 2023-09-13T06:08:36.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.815+0000 7f1928fc6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f19240d1750 0x7f192415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.815+0000 7f1928fc6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1924146f30 0x7f19240b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.815+0000 7f1928fc6640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19240b63c0 con 0x7f19240d1090 2023-09-13T06:08:36.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.815+0000 7f1928fc6640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192415dea0 con 0x7f1924146f30 2023-09-13T06:08:36.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.815+0000 7f1928fc6640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240d0c20 con 0x7f19240d1750 2023-09-13T06:08:36.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.815+0000 7f1922d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1924146f30 0x7f19240b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.815+0000 7f1921d9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f19240d1090 0x7f1924146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42344/0 (socket says 172.21.15.130:42344) 2023-09-13T06:08:36.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.815+0000 7f1921d9b640 1 -- 172.21.15.130:0/3755210355 learned_addr learned my addr 172.21.15.130:0/3755210355 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:36.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f192259c640 1 --2- 172.21.15.130:0/3755210355 >> v2:172.21.15.164:3300/0 conn(0x7f19240d1750 0x7f192415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f1922d9d640 1 -- 172.21.15.130:0/3755210355 >> v2:172.21.15.164:3300/0 conn(0x7f19240d1750 msgr2=0x7f192415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:36.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f1922d9d640 1 --2- 172.21.15.130:0/3755210355 >> v2:172.21.15.164:3300/0 conn(0x7f19240d1750 0x7f192415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f1922d9d640 1 -- 172.21.15.130:0/3755210355 >> v1:172.21.15.130:6789/0 conn(0x7f19240d1090 legacy=0x7f1924146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:36.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f1922d9d640 1 -- 172.21.15.130:0/3755210355 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240b6610 con 0x7f1924146f30 2023-09-13T06:08:36.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f192259c640 1 --2- 172.21.15.130:0/3755210355 >> v2:172.21.15.164:3300/0 conn(0x7f19240d1750 0x7f192415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:36.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f192159a640 1 -- 172.21.15.130:0/3755210355 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137714337 0 0) 0x7f19240b63c0 con 0x7f19240d1090 2023-09-13T06:08:36.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f1922d9d640 1 --2- 172.21.15.130:0/3755210355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1924146f30 0x7f19240b70f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f1924073cd0 tx=0x7f191c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b748b411307e8d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:36.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f192159a640 1 -- 172.21.15.130:0/3755210355 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c0a5910 con 0x7f1924146f30 2023-09-13T06:08:36.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f192159a640 1 -- 172.21.15.130:0/3755210355 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c0a5a70 con 0x7f1924146f30 2023-09-13T06:08:36.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f192159a640 1 -- 172.21.15.130:0/3755210355 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c0a5e00 con 0x7f1924146f30 2023-09-13T06:08:36.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f1928fc6640 1 -- 172.21.15.130:0/3755210355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1924146f30 msgr2=0x7f19240b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:36.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.819+0000 7f1928fc6640 1 --2- 172.21.15.130:0/3755210355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1924146f30 0x7f19240b70f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f1924073cd0 tx=0x7f191c01c850 comp rx=0 tx=0).stop 2023-09-13T06:08:36.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 -- 172.21.15.130:0/3755210355 shutdown_connections 2023-09-13T06:08:36.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 --2- 172.21.15.130:0/3755210355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1924146f30 0x7f19240b70f0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 --2- 172.21.15.130:0/3755210355 >> v2:172.21.15.164:3300/0 conn(0x7f19240d1750 0x7f192415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 -- 172.21.15.130:0/3755210355 >> 172.21.15.130:0/3755210355 conn(0x7f192406f170 msgr2=0x7f192406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:36.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 -- 172.21.15.130:0/3755210355 shutdown_connections 2023-09-13T06:08:36.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 -- 172.21.15.130:0/3755210355 wait complete. 2023-09-13T06:08:36.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 Processor -- start 2023-09-13T06:08:36.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 -- start start 2023-09-13T06:08:36.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240d1090 0x7f192413fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19240d1750 0x7f192415afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1924146f30 0x7f192415b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192415b510 con 0x7f19240d1750 2023-09-13T06:08:36.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b50b0 con 0x7f19240d1090 2023-09-13T06:08:36.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1928fc6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b5390 con 0x7f1924146f30 2023-09-13T06:08:36.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1921d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19240d1750 0x7f192415afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1921d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19240d1750 0x7f192415afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59678/0 (socket says 172.21.15.130:59678) 2023-09-13T06:08:36.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1921d9b640 1 -- 172.21.15.130:0/3492510411 learned_addr learned my addr 172.21.15.130:0/3492510411 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:36.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f192259c640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240d1090 0x7f192413fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1922d9d640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1924146f30 0x7f192415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1921d9b640 1 -- 172.21.15.130:0/3492510411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1924146f30 msgr2=0x7f192415b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:36.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1921d9b640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1924146f30 0x7f192415b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1921d9b640 1 -- 172.21.15.130:0/3492510411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240d1090 msgr2=0x7f192413fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:36.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1921d9b640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240d1090 0x7f192413fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:36.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.823+0000 7f1921d9b640 1 -- 172.21.15.130:0/3492510411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c009a70 con 0x7f19240d1750 2023-09-13T06:08:36.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f1921d9b640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19240d1750 0x7f192415afd0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f191800c4b0 tx=0x7f191800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:36.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f1912ffd640 1 -- 172.21.15.130:0/3492510411 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19180074e0 con 0x7f19240d1750 2023-09-13T06:08:36.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f1912ffd640 1 -- 172.21.15.130:0/3492510411 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1918007660 con 0x7f19240d1750 2023-09-13T06:08:36.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f1912ffd640 1 -- 172.21.15.130:0/3492510411 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918004a30 con 0x7f19240d1750 2023-09-13T06:08:36.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f1928fc6640 1 -- 172.21.15.130:0/3492510411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19240b7e40 con 0x7f19240d1750 2023-09-13T06:08:36.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f1928fc6640 1 -- 172.21.15.130:0/3492510411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19240b5950 con 0x7f19240d1750 2023-09-13T06:08:36.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f1928fc6640 1 -- 172.21.15.130:0/3492510411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19240b5b40 con 0x7f19240d1750 2023-09-13T06:08:36.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f1912ffd640 1 -- 172.21.15.130:0/3492510411 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1918004b90 con 0x7f19240d1750 2023-09-13T06:08:36.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f1912ffd640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1904065b20 0x7f1904067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:36.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f1912ffd640 1 -- 172.21.15.130:0/3492510411 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1918082320 con 0x7f19240d1750 2023-09-13T06:08:36.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f192259c640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1904065b20 0x7f1904067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:36.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.827+0000 7f192259c640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1904065b20 0x7f1904067fe0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f191400c900 tx=0x7f1914008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:36.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.831+0000 7f1912ffd640 1 -- 172.21.15.130:0/3492510411 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f191804ff90 con 0x7f19240d1750 2023-09-13T06:08:36.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:36.991+0000 7f1928fc6640 1 -- 172.21.15.130:0/3492510411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f19240618a0 con 0x7f19240d1750 2023-09-13T06:08:38.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.411+0000 7f1912ffd640 1 -- 172.21.15.130:0/3492510411 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v151) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1918018080 con 0x7f19240d1750 2023-09-13T06:08:38.416 INFO:teuthology.orchestra.run.smithi130.stderr: removed all blocklist entries 2023-09-13T06:08:38.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 -- 172.21.15.130:0/3492510411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1904065b20 msgr2=0x7f1904067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:38.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1904065b20 0x7f1904067fe0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f191400c900 tx=0x7f1914008040 comp rx=0 tx=0).stop 2023-09-13T06:08:38.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 -- 172.21.15.130:0/3492510411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19240d1750 msgr2=0x7f192415afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:38.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19240d1750 0x7f192415afd0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f191800c4b0 tx=0x7f191800c970 comp rx=0 tx=0).stop 2023-09-13T06:08:38.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 -- 172.21.15.130:0/3492510411 shutdown_connections 2023-09-13T06:08:38.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1904065b20 0x7f1904067fe0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1924146f30 0x7f192415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19240d1750 0x7f192415afd0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 --2- 172.21.15.130:0/3492510411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240d1090 0x7f192413fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 -- 172.21.15.130:0/3492510411 >> 172.21.15.130:0/3492510411 conn(0x7f192406f170 msgr2=0x7f1924143090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:38.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 -- 172.21.15.130:0/3492510411 shutdown_connections 2023-09-13T06:08:38.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.415+0000 7f1928fc6640 1 -- 172.21.15.130:0/3492510411 wait complete. 2023-09-13T06:08:38.441 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-13T06:08:38.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.579+0000 7f372af4d640 1 Processor -- start 2023-09-13T06:08:38.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.579+0000 7f372af4d640 1 -- start start 2023-09-13T06:08:38.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f372af4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241436e0 0x7f37240ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f372af4d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3724070d60 0x7f3724160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f372af4d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372406f640 con 0x7f37240acd80 2023-09-13T06:08:38.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f372af4d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372406f890 con 0x7f3724070d60 2023-09-13T06:08:38.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f372af4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372406fb70 con 0x7f37241436e0 2023-09-13T06:08:38.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f3723fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f37240acd80 0x7f3724070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42360/0 (socket says 172.21.15.130:42360) 2023-09-13T06:08:38.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f3723fff640 1 -- 172.21.15.130:0/2531835691 learned_addr learned my addr 172.21.15.130:0/2531835691 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:38.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f3728ce9640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241436e0 0x7f37240ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37294ea640 1 --2- 172.21.15.130:0/2531835691 >> v2:172.21.15.164:3300/0 conn(0x7f3724070d60 0x7f3724160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639720801 0 0) 0x7f372406f640 con 0x7f37240acd80 2023-09-13T06:08:38.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3714003530 con 0x7f37240acd80 2023-09-13T06:08:38.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 236141258 0 0) 0x7f3714003530 con 0x7f37240acd80 2023-09-13T06:08:38.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241436e0 msgr2=0x7f37240ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:38.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241436e0 0x7f37240ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 >> v2:172.21.15.164:3300/0 conn(0x7f3724070d60 msgr2=0x7f3724160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:38.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 --2- 172.21.15.130:0/2531835691 >> v2:172.21.15.164:3300/0 conn(0x7f3724070d60 0x7f3724160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372406fe50 con 0x7f37240acd80 2023-09-13T06:08:38.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f3710001680 con 0x7f37240acd80 2023-09-13T06:08:38.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 >> v1:172.21.15.130:6789/0 conn(0x7f37240acd80 legacy=0x7f3724070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:38.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37140039f0 0x7f3714003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241436e0 0x7f37140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3714004d10 0x7f3714005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372406f890 con 0x7f3714004d10 2023-09-13T06:08:38.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372406fb70 con 0x7f37140039f0 2023-09-13T06:08:38.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371400ba90 con 0x7f37241436e0 2023-09-13T06:08:38.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37294ea640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3714004d10 0x7f3714005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f3723fff640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241436e0 0x7f37140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f3728ce9640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37140039f0 0x7f3714003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37294ea640 1 -- 172.21.15.130:0/2531835691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241436e0 msgr2=0x7f37140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:38.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37294ea640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241436e0 0x7f37140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37294ea640 1 -- 172.21.15.130:0/2531835691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37140039f0 msgr2=0x7f3714003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:38.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37294ea640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37140039f0 0x7f3714003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.583+0000 7f37294ea640 1 -- 172.21.15.130:0/2531835691 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714003530 con 0x7f3714004d10 2023-09-13T06:08:38.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f37294ea640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3714004d10 0x7f3714005190 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f371c009fc0 tx=0x7f371c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573d41e4106e17fd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724146e10 con 0x7f3714004d10 2023-09-13T06:08:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c00f040 con 0x7f3714004d10 2023-09-13T06:08:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f37237fe640 1 -- 172.21.15.130:0/2531835691 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c0a5d60 con 0x7f3714004d10 2023-09-13T06:08:38.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f372af4d640 1 -- 172.21.15.130:0/2531835691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3714004d10 msgr2=0x7f3714005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:38.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f372af4d640 1 --2- 172.21.15.130:0/2531835691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3714004d10 0x7f3714005190 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f371c009fc0 tx=0x7f371c01cc60 comp rx=0 tx=0).stop 2023-09-13T06:08:38.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f37294ea640 1 -- 172.21.15.130:0/2531835691 reap_dead start 2023-09-13T06:08:38.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f372af4d640 1 -- 172.21.15.130:0/2531835691 shutdown_connections 2023-09-13T06:08:38.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f372af4d640 1 -- 172.21.15.130:0/2531835691 >> 172.21.15.130:0/2531835691 conn(0x7f37240b0bc0 msgr2=0x7f37240b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:38.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f372af4d640 1 -- 172.21.15.130:0/2531835691 shutdown_connections 2023-09-13T06:08:38.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f372af4d640 1 -- 172.21.15.130:0/2531835691 wait complete. 2023-09-13T06:08:38.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f372af4d640 1 Processor -- start 2023-09-13T06:08:38.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.587+0000 7f372af4d640 1 -- start start 2023-09-13T06:08:38.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f372af4d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3714004d10 0x7f3724141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f372af4d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f372413fc40 0x7f372415ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f372af4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241400c0 0x7f372415f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f372af4d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37241424b0 con 0x7f372413fc40 2023-09-13T06:08:38.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f372af4d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372413bb30 con 0x7f3714004d10 2023-09-13T06:08:38.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f372af4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3724160760 con 0x7f37241400c0 2023-09-13T06:08:38.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f3723fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f372413fc40 0x7f372415ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f3723fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f372413fc40 0x7f372415ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59694/0 (socket says 172.21.15.130:59694) 2023-09-13T06:08:38.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f3723fff640 1 -- 172.21.15.130:0/165997907 learned_addr learned my addr 172.21.15.130:0/165997907 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:38.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f37294ea640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241400c0 0x7f372415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f3728ce9640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3714004d10 0x7f3724141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f3723fff640 1 -- 172.21.15.130:0/165997907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241400c0 msgr2=0x7f372415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:38.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f3723fff640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241400c0 0x7f372415f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f3723fff640 1 -- 172.21.15.130:0/165997907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3714004d10 msgr2=0x7f3724141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:38.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f3723fff640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3714004d10 0x7f3724141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f3723fff640 1 -- 172.21.15.130:0/165997907 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372413af20 con 0x7f372413fc40 2023-09-13T06:08:38.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f3723fff640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f372413fc40 0x7f372415ef00 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f3710004f80 tx=0x7f3710007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:38.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f37217fa640 1 -- 172.21.15.130:0/165997907 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371000f7b0 con 0x7f372413fc40 2023-09-13T06:08:38.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f37217fa640 1 -- 172.21.15.130:0/165997907 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371000f930 con 0x7f372413fc40 2023-09-13T06:08:38.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f37217fa640 1 -- 172.21.15.130:0/165997907 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371000fce0 con 0x7f372413fc40 2023-09-13T06:08:38.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f372af4d640 1 -- 172.21.15.130:0/165997907 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372413b200 con 0x7f372413fc40 2023-09-13T06:08:38.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f372af4d640 1 -- 172.21.15.130:0/165997907 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372413b7c0 con 0x7f372413fc40 2023-09-13T06:08:38.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.591+0000 7f372af4d640 1 -- 172.21.15.130:0/165997907 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37240618a0 con 0x7f372413fc40 2023-09-13T06:08:38.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.595+0000 7f37217fa640 1 -- 172.21.15.130:0/165997907 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f371001d460 con 0x7f372413fc40 2023-09-13T06:08:38.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.595+0000 7f37217fa640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3708065b20 0x7f3708067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.595+0000 7f37217fa640 1 -- 172.21.15.130:0/165997907 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3710082f90 con 0x7f372413fc40 2023-09-13T06:08:38.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.595+0000 7f3728ce9640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3708065b20 0x7f3708067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.595+0000 7f3728ce9640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3708065b20 0x7f3708067fe0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3718009be0 tx=0x7f3718009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:38.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.599+0000 7f37217fa640 1 -- 172.21.15.130:0/165997907 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3710050b90 con 0x7f372413fc40 2023-09-13T06:08:38.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 -- 172.21.15.130:0/165997907 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f372415d5c0 con 0x7f372413fc40 2023-09-13T06:08:38.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f37217fa640 1 -- 172.21.15.130:0/165997907 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f37100541b0 con 0x7f372413fc40 2023-09-13T06:08:38.802 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:38.802 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:08:38.802 INFO:teuthology.orchestra.run.smithi130.stdout: "auth_dump": [ 2023-09-13T06:08:38.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.803 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.a", 2023-09-13T06:08:38.803 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw==", 2023-09-13T06:08:38.803 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.803 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:08:38.803 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:08:38.804 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:08:38.804 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.804 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.804 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.804 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.b", 2023-09-13T06:08:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg==", 2023-09-13T06:08:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:08:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:08:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:08:38.806 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.806 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.806 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.806 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.c", 2023-09-13T06:08:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A==", 2023-09-13T06:08:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:08:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:08:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:08:38.808 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.808 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.808 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.808 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.808 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.d", 2023-09-13T06:08:38.809 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg==", 2023-09-13T06:08:38.809 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.810 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:08:38.810 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:08:38.810 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:08:38.810 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.810 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.0", 2023-09-13T06:08:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw==", 2023-09-13T06:08:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.811 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:08:38.812 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:08:38.812 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.812 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.812 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.1", 2023-09-13T06:08:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ==", 2023-09-13T06:08:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:08:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:08:38.813 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.814 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.814 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.814 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.2", 2023-09-13T06:08:38.814 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw==", 2023-09-13T06:08:38.815 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.815 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:08:38.815 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:08:38.815 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.816 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.816 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.816 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.816 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.3", 2023-09-13T06:08:38.816 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g==", 2023-09-13T06:08:38.817 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.817 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:08:38.817 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:08:38.817 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.817 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.818 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.4", 2023-09-13T06:08:38.818 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ==", 2023-09-13T06:08:38.819 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.819 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:08:38.819 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:08:38.819 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.819 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.820 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.820 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.820 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.5", 2023-09-13T06:08:38.820 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw==", 2023-09-13T06:08:38.821 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.821 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:08:38.821 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:08:38.821 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.821 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.822 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.822 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.822 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.6", 2023-09-13T06:08:38.822 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA==", 2023-09-13T06:08:38.823 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.823 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:08:38.823 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:08:38.823 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.824 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.824 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.824 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.824 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.7", 2023-09-13T06:08:38.824 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA==", 2023-09-13T06:08:38.825 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.825 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:08:38.825 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:08:38.825 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.826 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.826 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.826 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.827 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.0", 2023-09-13T06:08:38.827 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA==", 2023-09-13T06:08:38.827 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.827 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:08:38.827 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow r", 2023-09-13T06:08:38.828 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-13T06:08:38.828 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.828 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.828 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.828 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.1", 2023-09-13T06:08:38.829 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg==", 2023-09-13T06:08:38.829 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.829 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:08:38.829 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:08:38.829 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:08:38.830 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:08:38.830 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.830 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.830 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.830 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.2", 2023-09-13T06:08:38.831 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw==", 2023-09-13T06:08:38.831 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.831 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:08:38.831 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:08:38.831 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:08:38.831 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:08:38.832 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.832 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.832 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.3", 2023-09-13T06:08:38.832 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA==", 2023-09-13T06:08:38.833 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.833 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:08:38.833 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:08:38.833 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:08:38.833 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:08:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.admin", 2023-09-13T06:08:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQANUAFl5ccJOBAAP4KJItnG8vNd5OP/63ai0g==", 2023-09-13T06:08:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:08:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:08:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:08:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.836 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.836 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.836 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.x", 2023-09-13T06:08:38.836 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ==", 2023-09-13T06:08:38.836 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.837 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:08:38.837 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:08:38.837 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.837 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.837 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:08:38.838 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:38.838 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.y", 2023-09-13T06:08:38.838 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA==", 2023-09-13T06:08:38.838 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:08:38.838 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:08:38.839 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:08:38.839 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:08:38.839 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.839 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:38.839 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:08:38.840 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:08:38.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 -- 172.21.15.130:0/165997907 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3708065b20 msgr2=0x7f3708067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:38.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3708065b20 0x7f3708067fe0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3718009be0 tx=0x7f3718009190 comp rx=0 tx=0).stop 2023-09-13T06:08:38.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 -- 172.21.15.130:0/165997907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f372413fc40 msgr2=0x7f372415ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:38.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f372413fc40 0x7f372415ef00 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f3710004f80 tx=0x7f3710007430 comp rx=0 tx=0).stop 2023-09-13T06:08:38.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 -- 172.21.15.130:0/165997907 shutdown_connections 2023-09-13T06:08:38.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3708065b20 0x7f3708067fe0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37241400c0 0x7f372415f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f372413fc40 0x7f372415ef00 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 --2- 172.21.15.130:0/165997907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3714004d10 0x7f3724141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 -- 172.21.15.130:0/165997907 >> 172.21.15.130:0/165997907 conn(0x7f37240b0bc0 msgr2=0x7f37240ad1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:38.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 -- 172.21.15.130:0/165997907 shutdown_connections 2023-09-13T06:08:38.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.799+0000 7f372af4d640 1 -- 172.21.15.130:0/165997907 wait complete. 2023-09-13T06:08:38.844 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:08:38.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a2a00b640 1 Processor -- start 2023-09-13T06:08:38.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a2a00b640 1 -- start start 2023-09-13T06:08:38.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a2a00b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a240d1750 0x7f7a2415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a2a00b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a24146f30 0x7f7a240b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a2a00b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a240b63c0 con 0x7f7a240d1090 2023-09-13T06:08:38.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a2a00b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2415dea0 con 0x7f7a24146f30 2023-09-13T06:08:38.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a2a00b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240d0c20 con 0x7f7a240d1750 2023-09-13T06:08:38.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a23fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a24146f30 0x7f7a240b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a23fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a24146f30 0x7f7a240b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59700/0 (socket says 172.21.15.130:59700) 2023-09-13T06:08:38.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a23fff640 1 -- 172.21.15.130:0/2113354334 learned_addr learned my addr 172.21.15.130:0/2113354334 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:38.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a237fe640 1 --2- 172.21.15.130:0/2113354334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a240d1750 0x7f7a2415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a23fff640 1 -- 172.21.15.130:0/2113354334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a240d1750 msgr2=0x7f7a2415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:38.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a23fff640 1 --2- 172.21.15.130:0/2113354334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a240d1750 0x7f7a2415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a23fff640 1 -- 172.21.15.130:0/2113354334 >> v1:172.21.15.164:6789/0 conn(0x7f7a240d1090 legacy=0x7f7a24146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:38.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a23fff640 1 -- 172.21.15.130:0/2113354334 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a240b6610 con 0x7f7a24146f30 2023-09-13T06:08:38.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.979+0000 7f7a237fe640 1 --2- 172.21.15.130:0/2113354334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a240d1750 0x7f7a2415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:38.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a23fff640 1 --2- 172.21.15.130:0/2113354334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a24146f30 0x7f7a240b70f0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009e50 tx=0x7f7a1c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c5fe5ce465cc08 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:38.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a22ffd640 1 -- 172.21.15.130:0/2113354334 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0a5820 con 0x7f7a24146f30 2023-09-13T06:08:38.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a22ffd640 1 -- 172.21.15.130:0/2113354334 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c0a5980 con 0x7f7a24146f30 2023-09-13T06:08:38.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a22ffd640 1 -- 172.21.15.130:0/2113354334 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0a5d10 con 0x7f7a24146f30 2023-09-13T06:08:38.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a2a00b640 1 -- 172.21.15.130:0/2113354334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a24146f30 msgr2=0x7f7a240b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:38.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a2a00b640 1 --2- 172.21.15.130:0/2113354334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a24146f30 0x7f7a240b70f0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009e50 tx=0x7f7a1c01c9a0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a2a00b640 1 -- 172.21.15.130:0/2113354334 shutdown_connections 2023-09-13T06:08:38.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a2a00b640 1 --2- 172.21.15.130:0/2113354334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a24146f30 0x7f7a240b70f0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a2a00b640 1 --2- 172.21.15.130:0/2113354334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a240d1750 0x7f7a2415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a2a00b640 1 -- 172.21.15.130:0/2113354334 >> 172.21.15.130:0/2113354334 conn(0x7f7a2406f170 msgr2=0x7f7a2406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:38.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a2a00b640 1 -- 172.21.15.130:0/2113354334 shutdown_connections 2023-09-13T06:08:38.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.983+0000 7f7a2a00b640 1 -- 172.21.15.130:0/2113354334 wait complete. 2023-09-13T06:08:38.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a2a00b640 1 Processor -- start 2023-09-13T06:08:38.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a2a00b640 1 -- start start 2023-09-13T06:08:38.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a2a00b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a240d1090 0x7f7a24167b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a2a00b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a240d1750 0x7f7a2415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a2a00b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a24146f30 0x7f7a24164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a2a00b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2415c120 con 0x7f7a240d1090 2023-09-13T06:08:38.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a2a00b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24145c10 con 0x7f7a240d1750 2023-09-13T06:08:38.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a2a00b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24145ef0 con 0x7f7a24146f30 2023-09-13T06:08:38.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a237fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a240d1090 0x7f7a24167b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a237fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a240d1090 0x7f7a24167b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59714/0 (socket says 172.21.15.130:59714) 2023-09-13T06:08:38.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a237fe640 1 -- 172.21.15.130:0/258256464 learned_addr learned my addr 172.21.15.130:0/258256464 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:38.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a1bfff640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a240d1750 0x7f7a2415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a23fff640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a24146f30 0x7f7a24164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a237fe640 1 -- 172.21.15.130:0/258256464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a24146f30 msgr2=0x7f7a24164280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:38.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a237fe640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a24146f30 0x7f7a24164280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a237fe640 1 -- 172.21.15.130:0/258256464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a240d1750 msgr2=0x7f7a2415c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:38.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a237fe640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a240d1750 0x7f7a2415c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:38.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a237fe640 1 -- 172.21.15.130:0/258256464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c009b30 con 0x7f7a240d1090 2023-09-13T06:08:38.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a23fff640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a24146f30 0x7f7a24164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:38.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a237fe640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a240d1090 0x7f7a24167b60 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400c7c0 tx=0x7f7a1400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:38.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a20ff9640 1 -- 172.21.15.130:0/258256464 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14007a30 con 0x7f7a240d1090 2023-09-13T06:08:38.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a20ff9640 1 -- 172.21.15.130:0/258256464 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14007b90 con 0x7f7a240d1090 2023-09-13T06:08:38.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a20ff9640 1 -- 172.21.15.130:0/258256464 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400ce70 con 0x7f7a240d1090 2023-09-13T06:08:38.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a2a00b640 1 -- 172.21.15.130:0/258256464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a240b7e40 con 0x7f7a240d1090 2023-09-13T06:08:38.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.987+0000 7f7a2a00b640 1 -- 172.21.15.130:0/258256464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2415bdb0 con 0x7f7a240d1090 2023-09-13T06:08:38.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.991+0000 7f7a2a00b640 1 -- 172.21.15.130:0/258256464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a240618a0 con 0x7f7a240d1090 2023-09-13T06:08:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.991+0000 7f7a20ff9640 1 -- 172.21.15.130:0/258256464 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7a140113f0 con 0x7f7a240d1090 2023-09-13T06:08:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.991+0000 7f7a20ff9640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a04065b50 0x7f7a04068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.991+0000 7f7a20ff9640 1 -- 172.21.15.130:0/258256464 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a14083430 con 0x7f7a240d1090 2023-09-13T06:08:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.991+0000 7f7a1bfff640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a04065b50 0x7f7a04068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:38.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.991+0000 7f7a1bfff640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a04065b50 0x7f7a04068010 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7a240d0760 tx=0x7f7a0c007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:38.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:38.995+0000 7f7a20ff9640 1 -- 172.21.15.130:0/258256464 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7a140510e0 con 0x7f7a240d1090 2023-09-13T06:08:39.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.143+0000 7f7a2a00b640 1 -- 172.21.15.130:0/258256464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a240b86c0 con 0x7f7a240d1090 2023-09-13T06:08:39.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a20ff9640 1 -- 172.21.15.130:0/258256464 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+12904 (secure 0 0 0) 0x7f7a14054700 con 0x7f7a240d1090 2023-09-13T06:08:39.148 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:39.148 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":151,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:08:38.412557+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:08:39.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 -- 172.21.15.130:0/258256464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a04065b50 msgr2=0x7f7a04068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a04065b50 0x7f7a04068010 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7a240d0760 tx=0x7f7a0c007e40 comp rx=0 tx=0).stop 2023-09-13T06:08:39.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 -- 172.21.15.130:0/258256464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a240d1090 msgr2=0x7f7a24167b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a240d1090 0x7f7a24167b60 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400c7c0 tx=0x7f7a1400cc80 comp rx=0 tx=0).stop 2023-09-13T06:08:39.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 -- 172.21.15.130:0/258256464 shutdown_connections 2023-09-13T06:08:39.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a04065b50 0x7f7a04068010 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a240d1750 0x7f7a2415c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a24146f30 0x7f7a24164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 --2- 172.21.15.130:0/258256464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a240d1090 0x7f7a24167b60 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 -- 172.21.15.130:0/258256464 >> 172.21.15.130:0/258256464 conn(0x7f7a2406f170 msgr2=0x7f7a24142d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:39.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 -- 172.21.15.130:0/258256464 shutdown_connections 2023-09-13T06:08:39.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.147+0000 7f7a2a00b640 1 -- 172.21.15.130:0/258256464 wait complete. 2023-09-13T06:08:39.169 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:08:39.170 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:08:39.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.307+0000 7f93e70f3640 1 Processor -- start 2023-09-13T06:08:39.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.307+0000 7f93e70f3640 1 -- start start 2023-09-13T06:08:39.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e70f3640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f93e0157750 0x7f93e0160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e70f3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e0157b30 0x7f93e006dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e70f3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f93e006f170 0x7f93e006f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e70f3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e00ae0d0 con 0x7f93e006f170 2023-09-13T06:08:39.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e70f3640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e0161e60 con 0x7f93e0157750 2023-09-13T06:08:39.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e70f3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e01615c0 con 0x7f93e0157b30 2023-09-13T06:08:39.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e5690640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f93e006f170 0x7f93e006f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e5690640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f93e006f170 0x7f93e006f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59730/0 (socket says 172.21.15.130:59730) 2023-09-13T06:08:39.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e5690640 1 -- 172.21.15.130:0/1591226656 learned_addr learned my addr 172.21.15.130:0/1591226656 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:39.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e4e8f640 1 --2- 172.21.15.130:0/1591226656 >> v2:172.21.15.164:3300/0 conn(0x7f93e0157750 0x7f93e0160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93d7fff640 1 --2- 172.21.15.130:0/1591226656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e0157b30 0x7f93e006dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e5690640 1 -- 172.21.15.130:0/1591226656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e0157b30 msgr2=0x7f93e006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:39.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e5690640 1 --2- 172.21.15.130:0/1591226656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e0157b30 0x7f93e006dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e5690640 1 -- 172.21.15.130:0/1591226656 >> v2:172.21.15.164:3300/0 conn(0x7f93e0157750 msgr2=0x7f93e0160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:39.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e5690640 1 --2- 172.21.15.130:0/1591226656 >> v2:172.21.15.164:3300/0 conn(0x7f93e0157750 0x7f93e0160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e5690640 1 -- 172.21.15.130:0/1591226656 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e01618a0 con 0x7f93e006f170 2023-09-13T06:08:39.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e4e8f640 1 --2- 172.21.15.130:0/1591226656 >> v2:172.21.15.164:3300/0 conn(0x7f93e0157750 0x7f93e0160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:08:39.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.311+0000 7f93e5690640 1 --2- 172.21.15.130:0/1591226656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93e006f170 0x7f93e006f5b0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f93e00664d0 tx=0x7f93d801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a1a4193fb4f56a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:39.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93d77fe640 1 -- 172.21.15.130:0/1591226656 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80a5730 con 0x7f93e006f170 2023-09-13T06:08:39.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93d77fe640 1 -- 172.21.15.130:0/1591226656 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d80a5890 con 0x7f93e006f170 2023-09-13T06:08:39.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93d77fe640 1 -- 172.21.15.130:0/1591226656 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80a5c20 con 0x7f93e006f170 2023-09-13T06:08:39.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 -- 172.21.15.130:0/1591226656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93e006f170 msgr2=0x7f93e006f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 --2- 172.21.15.130:0/1591226656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93e006f170 0x7f93e006f5b0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f93e00664d0 tx=0x7f93d801c9a0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 -- 172.21.15.130:0/1591226656 shutdown_connections 2023-09-13T06:08:39.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 --2- 172.21.15.130:0/1591226656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93e006f170 0x7f93e006f5b0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 --2- 172.21.15.130:0/1591226656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e0157b30 0x7f93e006dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 --2- 172.21.15.130:0/1591226656 >> v2:172.21.15.164:3300/0 conn(0x7f93e0157750 0x7f93e0160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 -- 172.21.15.130:0/1591226656 >> 172.21.15.130:0/1591226656 conn(0x7f93e0065d60 msgr2=0x7f93e00b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:39.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 -- 172.21.15.130:0/1591226656 shutdown_connections 2023-09-13T06:08:39.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 -- 172.21.15.130:0/1591226656 wait complete. 2023-09-13T06:08:39.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 Processor -- start 2023-09-13T06:08:39.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 -- start start 2023-09-13T06:08:39.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93e006f170 0x7f93e01f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e0157750 0x7f93e00d0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93e0157b30 0x7f93e00cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0151f10 con 0x7f93e0157b30 2023-09-13T06:08:39.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0151370 con 0x7f93e006f170 2023-09-13T06:08:39.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.315+0000 7f93e70f3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00d05b0 con 0x7f93e0157750 2023-09-13T06:08:39.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e5690640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93e0157b30 0x7f93e00cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e5690640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93e0157b30 0x7f93e00cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59742/0 (socket says 172.21.15.130:59742) 2023-09-13T06:08:39.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e5690640 1 -- 172.21.15.130:0/3347010830 learned_addr learned my addr 172.21.15.130:0/3347010830 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:39.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e4e8f640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93e006f170 0x7f93e01f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93d7fff640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e0157750 0x7f93e00d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e5690640 1 -- 172.21.15.130:0/3347010830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e0157750 msgr2=0x7f93e00d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e5690640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e0157750 0x7f93e00d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e5690640 1 -- 172.21.15.130:0/3347010830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93e006f170 msgr2=0x7f93e01f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e5690640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93e006f170 0x7f93e01f99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e5690640 1 -- 172.21.15.130:0/3347010830 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc009420 con 0x7f93e0157b30 2023-09-13T06:08:39.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e5690640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93e0157b30 0x7f93e00cca00 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f93d801d240 tx=0x7f93d8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:39.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93d57fa640 1 -- 172.21.15.130:0/3347010830 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80b8670 con 0x7f93e0157b30 2023-09-13T06:08:39.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93d57fa640 1 -- 172.21.15.130:0/3347010830 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d80b87d0 con 0x7f93e0157b30 2023-09-13T06:08:39.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93d57fa640 1 -- 172.21.15.130:0/3347010830 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80b8b80 con 0x7f93e0157b30 2023-09-13T06:08:39.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e70f3640 1 -- 172.21.15.130:0/3347010830 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d8009b30 con 0x7f93e0157b30 2023-09-13T06:08:39.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e70f3640 1 -- 172.21.15.130:0/3347010830 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e01518c0 con 0x7f93e0157b30 2023-09-13T06:08:39.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93e70f3640 1 -- 172.21.15.130:0/3347010830 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e01520c0 con 0x7f93e0157b30 2023-09-13T06:08:39.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.319+0000 7f93d57fa640 1 -- 172.21.15.130:0/3347010830 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f93d80b8ce0 con 0x7f93e0157b30 2023-09-13T06:08:39.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.323+0000 7f93d57fa640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93cc065b50 0x7f93cc068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.323+0000 7f93d57fa640 1 -- 172.21.15.130:0/3347010830 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93d811e2b0 con 0x7f93e0157b30 2023-09-13T06:08:39.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.323+0000 7f93e4e8f640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93cc065b50 0x7f93cc068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.323+0000 7f93e4e8f640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93cc065b50 0x7f93cc068010 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0093f0 tx=0x7f93dc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:39.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.327+0000 7f93d57fa640 1 -- 172.21.15.130:0/3347010830 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f93e01520c0 con 0x7f93e0157b30 2023-09-13T06:08:39.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93e70f3640 1 -- 172.21.15.130:0/3347010830 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93e01520c0 con 0x7f93e0157b30 2023-09-13T06:08:39.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93d57fa640 1 -- 172.21.15.130:0/3347010830 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v151) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93e01520c0 con 0x7f93e0157b30 2023-09-13T06:08:39.478 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:08:39.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93e70f3640 1 -- 172.21.15.130:0/3347010830 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93cc065b50 msgr2=0x7f93cc068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93e70f3640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93cc065b50 0x7f93cc068010 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0093f0 tx=0x7f93dc009190 comp rx=0 tx=0).stop 2023-09-13T06:08:39.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93e70f3640 1 -- 172.21.15.130:0/3347010830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93e0157b30 msgr2=0x7f93e00cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93e70f3640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93e0157b30 0x7f93e00cca00 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f93d801d240 tx=0x7f93d8019740 comp rx=0 tx=0).stop 2023-09-13T06:08:39.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93e70f3640 1 -- 172.21.15.130:0/3347010830 shutdown_connections 2023-09-13T06:08:39.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93e70f3640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f93cc065b50 0x7f93cc068010 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93e70f3640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93e0157b30 0x7f93e00cca00 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93e70f3640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f93e0157750 0x7f93e00d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93e70f3640 1 --2- 172.21.15.130:0/3347010830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93e006f170 0x7f93e01f99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.475+0000 7f93e70f3640 1 -- 172.21.15.130:0/3347010830 >> 172.21.15.130:0/3347010830 conn(0x7f93e0065d60 msgr2=0x7f93e00b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:39.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.479+0000 7f93e70f3640 1 -- 172.21.15.130:0/3347010830 shutdown_connections 2023-09-13T06:08:39.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.479+0000 7f93e70f3640 1 -- 172.21.15.130:0/3347010830 wait complete. 2023-09-13T06:08:39.499 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T06:08:39.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb9bba640 1 Processor -- start 2023-09-13T06:08:39.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb9bba640 1 -- start start 2023-09-13T06:08:39.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb9bba640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6fb406ddf0 0x7f6fb4168090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb9bba640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb4072310 con 0x7f6fb415d260 2023-09-13T06:08:39.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb9bba640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb4070e70 con 0x7f6fb40ce1a0 2023-09-13T06:08:39.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb9bba640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb4070280 con 0x7f6fb406ddf0 2023-09-13T06:08:39.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb37fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6fb415d260 0x7f6fb40b5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42374/0 (socket says 172.21.15.130:42374) 2023-09-13T06:08:39.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb37fe640 1 -- 172.21.15.130:0/1961403545 learned_addr learned my addr 172.21.15.130:0/1961403545 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:39.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb3fff640 1 --2- 172.21.15.130:0/1961403545 >> v2:172.21.15.130:3300/0 conn(0x7f6fb406ddf0 0x7f6fb4168090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb27fc640 1 -- 172.21.15.130:0/1961403545 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759657453 0 0) 0x7f6fb4072310 con 0x7f6fb415d260 2023-09-13T06:08:39.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb27fc640 1 -- 172.21.15.130:0/1961403545 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f9c003530 con 0x7f6fb415d260 2023-09-13T06:08:39.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb27fc640 1 -- 172.21.15.130:0/1961403545 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730309905 0 0) 0x7f6fb4070e70 con 0x7f6fb40ce1a0 2023-09-13T06:08:39.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb27fc640 1 -- 172.21.15.130:0/1961403545 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb4072310 con 0x7f6fb40ce1a0 2023-09-13T06:08:39.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb3fff640 1 -- 172.21.15.130:0/1961403545 >> v1:172.21.15.164:6789/0 conn(0x7f6fb40ce1a0 legacy=0x7f6fb406d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb3fff640 1 -- 172.21.15.130:0/1961403545 >> v1:172.21.15.130:6789/0 conn(0x7f6fb415d260 legacy=0x7f6fb40b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.635+0000 7f6fb3fff640 1 -- 172.21.15.130:0/1961403545 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4070540 con 0x7f6fb406ddf0 2023-09-13T06:08:39.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.639+0000 7f6fb3fff640 1 --2- 172.21.15.130:0/1961403545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fb406ddf0 0x7f6fb4168090 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009d90 tx=0x7f6fac01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cef574176e06f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:39.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.639+0000 7f6fb27fc640 1 -- 172.21.15.130:0/1961403545 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0a59e0 con 0x7f6fb406ddf0 2023-09-13T06:08:39.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.639+0000 7f6fb27fc640 1 -- 172.21.15.130:0/1961403545 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac0a5b40 con 0x7f6fb406ddf0 2023-09-13T06:08:39.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.639+0000 7f6fb27fc640 1 -- 172.21.15.130:0/1961403545 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0ad440 con 0x7f6fb406ddf0 2023-09-13T06:08:39.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.639+0000 7f6fb9bba640 1 -- 172.21.15.130:0/1961403545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fb406ddf0 msgr2=0x7f6fb4168090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.639+0000 7f6fb9bba640 1 --2- 172.21.15.130:0/1961403545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fb406ddf0 0x7f6fb4168090 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009d90 tx=0x7f6fac01c920 comp rx=0 tx=0).stop 2023-09-13T06:08:39.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.639+0000 7f6fb9bba640 1 -- 172.21.15.130:0/1961403545 shutdown_connections 2023-09-13T06:08:39.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.639+0000 7f6fb9bba640 1 --2- 172.21.15.130:0/1961403545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fb406ddf0 0x7f6fb4168090 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.639+0000 7f6fb9bba640 1 -- 172.21.15.130:0/1961403545 >> 172.21.15.130:0/1961403545 conn(0x7f6fb406a2f0 msgr2=0x7f6fb406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:39.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.639+0000 7f6fb9bba640 1 -- 172.21.15.130:0/1961403545 shutdown_connections 2023-09-13T06:08:39.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.639+0000 7f6fb9bba640 1 -- 172.21.15.130:0/1961403545 wait complete. 2023-09-13T06:08:39.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb9bba640 1 Processor -- start 2023-09-13T06:08:39.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb9bba640 1 -- start start 2023-09-13T06:08:39.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb9bba640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb406ddf0 0x7f6fb415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb9bba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fb40ce1a0 0x7f6fb415f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb9bba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fb415d260 0x7f6fb414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb9bba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb415cb00 con 0x7f6fb415d260 2023-09-13T06:08:39.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb9bba640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40b1f00 con 0x7f6fb406ddf0 2023-09-13T06:08:39.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb9bba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40b15d0 con 0x7f6fb40ce1a0 2023-09-13T06:08:39.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fb415d260 0x7f6fb414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fb415d260 0x7f6fb414fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59752/0 (socket says 172.21.15.130:59752) 2023-09-13T06:08:39.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb3fff640 1 -- 172.21.15.130:0/87130765 learned_addr learned my addr 172.21.15.130:0/87130765 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:39.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb37fe640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb406ddf0 0x7f6fb415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb2ffd640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fb40ce1a0 0x7f6fb415f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb3fff640 1 -- 172.21.15.130:0/87130765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fb40ce1a0 msgr2=0x7f6fb415f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb3fff640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fb40ce1a0 0x7f6fb415f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb3fff640 1 -- 172.21.15.130:0/87130765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb406ddf0 msgr2=0x7f6fb415c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb3fff640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb406ddf0 0x7f6fb415c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb3fff640 1 -- 172.21.15.130:0/87130765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009a70 con 0x7f6fb415d260 2023-09-13T06:08:39.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb3fff640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fb415d260 0x7f6fb414fef0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0b0040 tx=0x7f6fac0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:39.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6f9bfff640 1 -- 172.21.15.130:0/87130765 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0adcc0 con 0x7f6fb415d260 2023-09-13T06:08:39.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6f9bfff640 1 -- 172.21.15.130:0/87130765 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac0ade20 con 0x7f6fb415d260 2023-09-13T06:08:39.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6f9bfff640 1 -- 172.21.15.130:0/87130765 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0b9690 con 0x7f6fb415d260 2023-09-13T06:08:39.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb9bba640 1 -- 172.21.15.130:0/87130765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb40b18b0 con 0x7f6fb415d260 2023-09-13T06:08:39.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.643+0000 7f6fb9bba640 1 -- 172.21.15.130:0/87130765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb40b1230 con 0x7f6fb415d260 2023-09-13T06:08:39.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.647+0000 7f6fb9bba640 1 -- 172.21.15.130:0/87130765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb40b20b0 con 0x7f6fb415d260 2023-09-13T06:08:39.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.647+0000 7f6f9bfff640 1 -- 172.21.15.130:0/87130765 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6fac0b97f0 con 0x7f6fb415d260 2023-09-13T06:08:39.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.647+0000 7f6f9bfff640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fa0065b20 0x7f6fa0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.647+0000 7f6f9bfff640 1 -- 172.21.15.130:0/87130765 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6fac11e560 con 0x7f6fb415d260 2023-09-13T06:08:39.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.647+0000 7f6fb37fe640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fa0065b20 0x7f6fa0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.647+0000 7f6fb37fe640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fa0065b20 0x7f6fa0067fe0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4007fd0 tx=0x7f6fa4007d80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:39.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.651+0000 7f6f9bfff640 1 -- 172.21.15.130:0/87130765 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6fb40b20b0 con 0x7f6fb415d260 2023-09-13T06:08:39.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 -- 172.21.15.130:0/87130765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6fb40b2070 con 0x7f6fb415d260 2023-09-13T06:08:39.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6f9bfff640 1 -- 172.21.15.130:0/87130765 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v151) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6fac0b2060 con 0x7f6fb415d260 2023-09-13T06:08:39.806 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:39.806 INFO:teuthology.orchestra.run.smithi130.stdout:[ 2023-09-13T06:08:39.806 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:08:39.807 INFO:teuthology.orchestra.run.smithi130.stdout: "poolnum": 1, 2023-09-13T06:08:39.807 INFO:teuthology.orchestra.run.smithi130.stdout: "poolname": ".mgr" 2023-09-13T06:08:39.807 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:08:39.807 INFO:teuthology.orchestra.run.smithi130.stdout:] 2023-09-13T06:08:39.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 -- 172.21.15.130:0/87130765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fa0065b20 msgr2=0x7f6fa0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fa0065b20 0x7f6fa0067fe0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4007fd0 tx=0x7f6fa4007d80 comp rx=0 tx=0).stop 2023-09-13T06:08:39.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 -- 172.21.15.130:0/87130765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fb415d260 msgr2=0x7f6fb414fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fb415d260 0x7f6fb414fef0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0b0040 tx=0x7f6fac0196c0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 -- 172.21.15.130:0/87130765 shutdown_connections 2023-09-13T06:08:39.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6fa0065b20 0x7f6fa0067fe0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fb415d260 0x7f6fb414fef0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fb40ce1a0 0x7f6fb415f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 --2- 172.21.15.130:0/87130765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fb406ddf0 0x7f6fb415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 -- 172.21.15.130:0/87130765 >> 172.21.15.130:0/87130765 conn(0x7f6fb406a2f0 msgr2=0x7f6fb406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:39.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 -- 172.21.15.130:0/87130765 shutdown_connections 2023-09-13T06:08:39.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.803+0000 7f6fb9bba640 1 -- 172.21.15.130:0/87130765 wait complete. 2023-09-13T06:08:39.826 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T06:08:39.827 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T06:08:39.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51f280b640 1 Processor -- start 2023-09-13T06:08:39.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51f280b640 1 -- start start 2023-09-13T06:08:39.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51f280b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f51ec0ccc10 0x7f51ec15dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51f280b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f51ec0b3170 0x7f51ec0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51f280b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec0ccff0 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51f280b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec15b590 con 0x7f51ec0ccc10 2023-09-13T06:08:39.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51f280b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0b12f0 con 0x7f51ec0b3170 2023-09-13T06:08:39.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51ebfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f51ec0ccc10 0x7f51ec15dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51f0da8640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f51ec0b1ff0 0x7f51ec0cb710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:42382/0 (socket says 172.21.15.130:42382) 2023-09-13T06:08:39.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51f0da8640 1 -- 172.21.15.130:0/66193032 learned_addr learned my addr 172.21.15.130:0/66193032 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:39.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51eb7fe640 1 --2- 172.21.15.130:0/66193032 >> v2:172.21.15.164:3300/0 conn(0x7f51ec0b3170 0x7f51ec0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51ebfff640 1 -- 172.21.15.130:0/66193032 >> v2:172.21.15.164:3300/0 conn(0x7f51ec0b3170 msgr2=0x7f51ec0b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:39.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51ebfff640 1 --2- 172.21.15.130:0/66193032 >> v2:172.21.15.164:3300/0 conn(0x7f51ec0b3170 0x7f51ec0b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51ebfff640 1 -- 172.21.15.130:0/66193032 >> v1:172.21.15.130:6789/0 conn(0x7f51ec0b1ff0 legacy=0x7f51ec0cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51ebfff640 1 -- 172.21.15.130:0/66193032 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec15e520 con 0x7f51ec0ccc10 2023-09-13T06:08:39.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51eb7fe640 1 --2- 172.21.15.130:0/66193032 >> v2:172.21.15.164:3300/0 conn(0x7f51ec0b3170 0x7f51ec0b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:39.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.967+0000 7f51eaffd640 1 -- 172.21.15.130:0/66193032 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221179948 0 0) 0x7f51ec0ccff0 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.971+0000 7f51ebfff640 1 --2- 172.21.15.130:0/66193032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51ec0ccc10 0x7f51ec15dcd0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0cece0 tx=0x7f51dc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db764503f58470c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:39.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.971+0000 7f51eaffd640 1 -- 172.21.15.130:0/66193032 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0a7070 con 0x7f51ec0ccc10 2023-09-13T06:08:39.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.971+0000 7f51eaffd640 1 -- 172.21.15.130:0/66193032 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc0ab430 con 0x7f51ec0ccc10 2023-09-13T06:08:39.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.971+0000 7f51eaffd640 1 -- 172.21.15.130:0/66193032 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0ab7c0 con 0x7f51ec0ccc10 2023-09-13T06:08:39.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.971+0000 7f51f280b640 1 -- 172.21.15.130:0/66193032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51ec0ccc10 msgr2=0x7f51ec15dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.971+0000 7f51f280b640 1 --2- 172.21.15.130:0/66193032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51ec0ccc10 0x7f51ec15dcd0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0cece0 tx=0x7f51dc01c430 comp rx=0 tx=0).stop 2023-09-13T06:08:39.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.971+0000 7f51f280b640 1 -- 172.21.15.130:0/66193032 shutdown_connections 2023-09-13T06:08:39.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.971+0000 7f51f280b640 1 --2- 172.21.15.130:0/66193032 >> v2:172.21.15.164:3300/0 conn(0x7f51ec0b3170 0x7f51ec0b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.971+0000 7f51f280b640 1 --2- 172.21.15.130:0/66193032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51ec0ccc10 0x7f51ec15dcd0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.971+0000 7f51f280b640 1 -- 172.21.15.130:0/66193032 >> 172.21.15.130:0/66193032 conn(0x7f51ec0735e0 msgr2=0x7f51ec065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:39.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.971+0000 7f51f280b640 1 -- 172.21.15.130:0/66193032 shutdown_connections 2023-09-13T06:08:39.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51f280b640 1 -- 172.21.15.130:0/66193032 wait complete. 2023-09-13T06:08:39.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51f280b640 1 Processor -- start 2023-09-13T06:08:39.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51f280b640 1 -- start start 2023-09-13T06:08:39.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51f280b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51ec0b1ff0 0x7f51ec1f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51f280b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51ec0b3170 0x7f51ec1f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51f280b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51ec0ccc10 0x7f51ec14a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51f280b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1f41d0 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51f280b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1f3c10 con 0x7f51ec0b3170 2023-09-13T06:08:39.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51f280b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1f3ef0 con 0x7f51ec0ccc10 2023-09-13T06:08:39.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51ec0b1ff0 0x7f51ec1f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51ebfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51ec0b1ff0 0x7f51ec1f43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59778/0 (socket says 172.21.15.130:59778) 2023-09-13T06:08:39.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51ebfff640 1 -- 172.21.15.130:0/3780034009 learned_addr learned my addr 172.21.15.130:0/3780034009 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:39.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51eb7fe640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51ec0b3170 0x7f51ec1f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51f0da8640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51ec0ccc10 0x7f51ec14a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51ebfff640 1 -- 172.21.15.130:0/3780034009 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51ec0ccc10 msgr2=0x7f51ec14a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51ebfff640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51ec0ccc10 0x7f51ec14a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51ebfff640 1 -- 172.21.15.130:0/3780034009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51ec0b3170 msgr2=0x7f51ec1f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:39.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51ebfff640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51ec0b3170 0x7f51ec1f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:39.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51ebfff640 1 -- 172.21.15.130:0/3780034009 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc009420 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.975+0000 7f51ebfff640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51ec0b1ff0 0x7f51ec1f43d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f51dc019040 tx=0x7f51dc01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:39.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.979+0000 7f51e8ff9640 1 -- 172.21.15.130:0/3780034009 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0b5810 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.979+0000 7f51e8ff9640 1 -- 172.21.15.130:0/3780034009 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc0b5990 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.979+0000 7f51f280b640 1 -- 172.21.15.130:0/3780034009 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec14ad20 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.979+0000 7f51e8ff9640 1 -- 172.21.15.130:0/3780034009 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0b5d40 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.979+0000 7f51f280b640 1 -- 172.21.15.130:0/3780034009 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec1f4910 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.979+0000 7f51f280b640 1 -- 172.21.15.130:0/3780034009 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec1f4b00 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.979+0000 7f51e8ff9640 1 -- 172.21.15.130:0/3780034009 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f51dc0c83e0 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.979+0000 7f51e8ff9640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51d8065b20 0x7f51d8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:39.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.979+0000 7f51e8ff9640 1 -- 172.21.15.130:0/3780034009 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f51dc11dff0 con 0x7f51ec0b1ff0 2023-09-13T06:08:39.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.979+0000 7f51eb7fe640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51d8065b20 0x7f51d8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:39.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.979+0000 7f51eb7fe640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51d8065b20 0x7f51d8067fe0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f51ec1f6760 tx=0x7f51e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:39.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:39.983+0000 7f51e8ff9640 1 -- 172.21.15.130:0/3780034009 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f51dc0ebd20 con 0x7f51ec0b1ff0 2023-09-13T06:08:40.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.135+0000 7f51f280b640 1 -- 172.21.15.130:0/3780034009 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f51ec0618a0 con 0x7f51ec0b1ff0 2023-09-13T06:08:40.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.635+0000 7f51e8ff9640 1 -- 172.21.15.130:0/3780034009 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v152) v1 ==== 138+0+0 (secure 0 0 0) 0x7f51dc006e20 con 0x7f51ec0b1ff0 2023-09-13T06:08:40.636 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' created 2023-09-13T06:08:40.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 -- 172.21.15.130:0/3780034009 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51d8065b20 msgr2=0x7f51d8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:40.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51d8065b20 0x7f51d8067fe0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f51ec1f6760 tx=0x7f51e0008040 comp rx=0 tx=0).stop 2023-09-13T06:08:40.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 -- 172.21.15.130:0/3780034009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51ec0b1ff0 msgr2=0x7f51ec1f43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:40.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51ec0b1ff0 0x7f51ec1f43d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f51dc019040 tx=0x7f51dc01ac70 comp rx=0 tx=0).stop 2023-09-13T06:08:40.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 -- 172.21.15.130:0/3780034009 shutdown_connections 2023-09-13T06:08:40.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f51d8065b20 0x7f51d8067fe0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:40.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51ec0b3170 0x7f51ec1f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:40.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f51ec0ccc10 0x7f51ec14a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:40.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 --2- 172.21.15.130:0/3780034009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51ec0b1ff0 0x7f51ec1f43d0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:40.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 -- 172.21.15.130:0/3780034009 >> 172.21.15.130:0/3780034009 conn(0x7f51ec0735e0 msgr2=0x7f51ec159950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:40.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 -- 172.21.15.130:0/3780034009 shutdown_connections 2023-09-13T06:08:40.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.639+0000 7f51f280b640 1 -- 172.21.15.130:0/3780034009 wait complete. 2023-09-13T06:08:40.661 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T06:08:40.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd7e07b640 1 Processor -- start 2023-09-13T06:08:40.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd7e07b640 1 -- start start 2023-09-13T06:08:40.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd7e07b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efd7815a080 0x7efd780b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:40.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd7e07b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efd780b31a0 0x7efd780ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:40.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd7e07b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd780cc850 con 0x7efd7815e650 2023-09-13T06:08:40.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd7e07b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd780b0330 con 0x7efd7815a080 2023-09-13T06:08:40.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd7e07b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd780cbcd0 con 0x7efd780b31a0 2023-09-13T06:08:40.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd777fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efd7815a080 0x7efd780b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:40.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd777fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efd7815a080 0x7efd780b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59784/0 (socket says 172.21.15.130:59784) 2023-09-13T06:08:40.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd777fe640 1 -- 172.21.15.130:0/2038364145 learned_addr learned my addr 172.21.15.130:0/2038364145 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:40.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd777fe640 1 -- 172.21.15.130:0/2038364145 >> v2:172.21.15.164:3300/0 conn(0x7efd780b31a0 msgr2=0x7efd780ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:40.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd777fe640 1 --2- 172.21.15.130:0/2038364145 >> v2:172.21.15.164:3300/0 conn(0x7efd780b31a0 0x7efd780ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:40.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd777fe640 1 -- 172.21.15.130:0/2038364145 >> v1:172.21.15.164:6789/0 conn(0x7efd7815e650 legacy=0x7efd780b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:40.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.807+0000 7efd777fe640 1 -- 172.21.15.130:0/2038364145 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780cbfb0 con 0x7efd7815a080 2023-09-13T06:08:40.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd777fe640 1 --2- 172.21.15.130:0/2038364145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd7815a080 0x7efd780b1460 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7efd7815db70 tx=0x7efd6801e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8e480c1a030f56 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:40.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd767fc640 1 -- 172.21.15.130:0/2038364145 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680aa440 con 0x7efd7815a080 2023-09-13T06:08:40.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd767fc640 1 -- 172.21.15.130:0/2038364145 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd680aa5a0 con 0x7efd7815a080 2023-09-13T06:08:40.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd767fc640 1 -- 172.21.15.130:0/2038364145 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680aa930 con 0x7efd7815a080 2023-09-13T06:08:40.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd7e07b640 1 -- 172.21.15.130:0/2038364145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd7815a080 msgr2=0x7efd780b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:40.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd7e07b640 1 --2- 172.21.15.130:0/2038364145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd7815a080 0x7efd780b1460 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7efd7815db70 tx=0x7efd6801e610 comp rx=0 tx=0).stop 2023-09-13T06:08:40.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd7e07b640 1 -- 172.21.15.130:0/2038364145 shutdown_connections 2023-09-13T06:08:40.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd7e07b640 1 --2- 172.21.15.130:0/2038364145 >> v2:172.21.15.164:3300/0 conn(0x7efd780b31a0 0x7efd780ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:40.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd7e07b640 1 --2- 172.21.15.130:0/2038364145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd7815a080 0x7efd780b1460 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:40.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd7e07b640 1 -- 172.21.15.130:0/2038364145 >> 172.21.15.130:0/2038364145 conn(0x7efd78065990 msgr2=0x7efd78065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:40.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd7e07b640 1 -- 172.21.15.130:0/2038364145 shutdown_connections 2023-09-13T06:08:40.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd7e07b640 1 -- 172.21.15.130:0/2038364145 wait complete. 2023-09-13T06:08:40.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.811+0000 7efd7e07b640 1 Processor -- start 2023-09-13T06:08:40.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd7e07b640 1 -- start start 2023-09-13T06:08:40.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd7e07b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd780b31a0 0x7efd781559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:40.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd7e07b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efd7815a080 0x7efd78148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:40.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd7e07b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd7815e650 0x7efd78151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:40.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd7e07b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd78157020 con 0x7efd7815e650 2023-09-13T06:08:40.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd7e07b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd781f9940 con 0x7efd780b31a0 2023-09-13T06:08:40.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd7e07b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd781f9dd0 con 0x7efd7815a080 2023-09-13T06:08:40.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd77fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd7815e650 0x7efd78151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:40.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd77fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd7815e650 0x7efd78151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59790/0 (socket says 172.21.15.130:59790) 2023-09-13T06:08:40.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd77fff640 1 -- 172.21.15.130:0/476461956 learned_addr learned my addr 172.21.15.130:0/476461956 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:40.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd76ffd640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efd7815a080 0x7efd78148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:40.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd777fe640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd780b31a0 0x7efd781559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:40.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd77fff640 1 -- 172.21.15.130:0/476461956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efd7815a080 msgr2=0x7efd78148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:40.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd77fff640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efd7815a080 0x7efd78148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:40.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd77fff640 1 -- 172.21.15.130:0/476461956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd780b31a0 msgr2=0x7efd781559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:40.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd77fff640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd780b31a0 0x7efd781559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:40.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd77fff640 1 -- 172.21.15.130:0/476461956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680094d0 con 0x7efd7815e650 2023-09-13T06:08:40.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd77fff640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd7815e650 0x7efd78151080 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7efd7000b970 tx=0x7efd7000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:40.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd5ffff640 1 -- 172.21.15.130:0/476461956 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000cb40 con 0x7efd7815e650 2023-09-13T06:08:40.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd5ffff640 1 -- 172.21.15.130:0/476461956 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7000ccc0 con 0x7efd7815e650 2023-09-13T06:08:40.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd7e07b640 1 -- 172.21.15.130:0/476461956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd78148ff0 con 0x7efd7815e650 2023-09-13T06:08:40.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd5ffff640 1 -- 172.21.15.130:0/476461956 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70014680 con 0x7efd7815e650 2023-09-13T06:08:40.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd7e07b640 1 -- 172.21.15.130:0/476461956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd781f9010 con 0x7efd7815e650 2023-09-13T06:08:40.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.815+0000 7efd7e07b640 1 -- 172.21.15.130:0/476461956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd781f9ab0 con 0x7efd7815e650 2023-09-13T06:08:40.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.819+0000 7efd5ffff640 1 -- 172.21.15.130:0/476461956 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efd7001d3b0 con 0x7efd7815e650 2023-09-13T06:08:40.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.819+0000 7efd5ffff640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efd64065b20 0x7efd64067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:40.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.819+0000 7efd5ffff640 1 -- 172.21.15.130:0/476461956 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5227+0+0 (secure 0 0 0) 0x7efd70082f40 con 0x7efd7815e650 2023-09-13T06:08:40.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.819+0000 7efd777fe640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efd64065b20 0x7efd64067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:40.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.819+0000 7efd777fe640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efd64065b20 0x7efd64067fe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efd680b1000 tx=0x7efd680a9000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:40.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.823+0000 7efd5ffff640 1 -- 172.21.15.130:0/476461956 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7efd70050bb0 con 0x7efd7815e650 2023-09-13T06:08:40.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:40.971+0000 7efd7e07b640 1 -- 172.21.15.130:0/476461956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efd780618a0 con 0x7efd7815e650 2023-09-13T06:08:41.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.639+0000 7efd5ffff640 1 -- 172.21.15.130:0/476461956 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v153) v1 ==== 170+0+0 (secure 0 0 0) 0x7efd70019020 con 0x7efd7815e650 2023-09-13T06:08:41.654 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' created 2023-09-13T06:08:41.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 -- 172.21.15.130:0/476461956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efd64065b20 msgr2=0x7efd64067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:41.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efd64065b20 0x7efd64067fe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efd680b1000 tx=0x7efd680a9000 comp rx=0 tx=0).stop 2023-09-13T06:08:41.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 -- 172.21.15.130:0/476461956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd7815e650 msgr2=0x7efd78151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd7815e650 0x7efd78151080 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7efd7000b970 tx=0x7efd7000be30 comp rx=0 tx=0).stop 2023-09-13T06:08:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 -- 172.21.15.130:0/476461956 shutdown_connections 2023-09-13T06:08:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efd64065b20 0x7efd64067fe0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd7815e650 0x7efd78151080 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efd7815a080 0x7efd78148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:41.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 --2- 172.21.15.130:0/476461956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd780b31a0 0x7efd781559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:41.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 -- 172.21.15.130:0/476461956 >> 172.21.15.130:0/476461956 conn(0x7efd78065990 msgr2=0x7efd780b49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:41.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 -- 172.21.15.130:0/476461956 shutdown_connections 2023-09-13T06:08:41.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.655+0000 7efd7e07b640 1 -- 172.21.15.130:0/476461956 wait complete. 2023-09-13T06:08:41.679 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T06:08:41.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb78487b640 1 Processor -- start 2023-09-13T06:08:41.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb78487b640 1 -- start start 2023-09-13T06:08:41.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb78487b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb780157750 0x7fb780160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:41.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb78487b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb78006dba0 0x7fb78015e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:41.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb78487b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78006e010 con 0x7fb780157b30 2023-09-13T06:08:41.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb78487b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7800ae0d0 con 0x7fb78006dba0 2023-09-13T06:08:41.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb78487b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb780161e60 con 0x7fb780157750 2023-09-13T06:08:41.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb77ed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb78006dba0 0x7fb78015e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:41.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb77dd9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb780157b30 0x7fb78006f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50996/0 (socket says 172.21.15.130:50996) 2023-09-13T06:08:41.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb77ed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb78006dba0 0x7fb78015e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57314/0 (socket says 172.21.15.130:57314) 2023-09-13T06:08:41.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb77dd9b640 1 -- 172.21.15.130:0/1952989012 learned_addr learned my addr 172.21.15.130:0/1952989012 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:41.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.819+0000 7fb77e59c640 1 --2- 172.21.15.130:0/1952989012 >> v2:172.21.15.164:3300/0 conn(0x7fb780157750 0x7fb780160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:41.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.823+0000 7fb77ed9d640 1 -- 172.21.15.130:0/1952989012 >> v2:172.21.15.164:3300/0 conn(0x7fb780157750 msgr2=0x7fb780160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:41.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.823+0000 7fb77ed9d640 1 --2- 172.21.15.130:0/1952989012 >> v2:172.21.15.164:3300/0 conn(0x7fb780157750 0x7fb780160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:41.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.823+0000 7fb77ed9d640 1 -- 172.21.15.130:0/1952989012 >> v1:172.21.15.130:6789/0 conn(0x7fb780157b30 legacy=0x7fb78006f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:41.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.823+0000 7fb77ed9d640 1 -- 172.21.15.130:0/1952989012 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7801615c0 con 0x7fb78006dba0 2023-09-13T06:08:41.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.823+0000 7fb77d59a640 1 -- 172.21.15.130:0/1952989012 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510629807 0 0) 0x7fb78006e010 con 0x7fb780157b30 2023-09-13T06:08:41.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.823+0000 7fb77ed9d640 1 --2- 172.21.15.130:0/1952989012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb78006dba0 0x7fb78015e020 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fb7800664d0 tx=0x7fb77801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d09ccb40895f987 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:41.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.823+0000 7fb77d59a640 1 -- 172.21.15.130:0/1952989012 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780a58b0 con 0x7fb78006dba0 2023-09-13T06:08:41.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.823+0000 7fb77d59a640 1 -- 172.21.15.130:0/1952989012 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7780a5a10 con 0x7fb78006dba0 2023-09-13T06:08:41.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.823+0000 7fb77d59a640 1 -- 172.21.15.130:0/1952989012 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780a5da0 con 0x7fb78006dba0 2023-09-13T06:08:41.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 -- 172.21.15.130:0/1952989012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb78006dba0 msgr2=0x7fb78015e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:41.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 --2- 172.21.15.130:0/1952989012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb78006dba0 0x7fb78015e020 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fb7800664d0 tx=0x7fb77801c8e0 comp rx=0 tx=0).stop 2023-09-13T06:08:41.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 -- 172.21.15.130:0/1952989012 shutdown_connections 2023-09-13T06:08:41.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 --2- 172.21.15.130:0/1952989012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb78006dba0 0x7fb78015e020 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:41.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 --2- 172.21.15.130:0/1952989012 >> v2:172.21.15.164:3300/0 conn(0x7fb780157750 0x7fb780160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:41.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 -- 172.21.15.130:0/1952989012 >> 172.21.15.130:0/1952989012 conn(0x7fb780065d60 msgr2=0x7fb7800b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:41.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 -- 172.21.15.130:0/1952989012 shutdown_connections 2023-09-13T06:08:41.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 -- 172.21.15.130:0/1952989012 wait complete. 2023-09-13T06:08:41.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 Processor -- start 2023-09-13T06:08:41.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 -- start start 2023-09-13T06:08:41.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb78006dba0 0x7fb7800cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:41.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb780157750 0x7fb7800cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:41.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780157b30 0x7fb78015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:41.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800cf920 con 0x7fb780157b30 2023-09-13T06:08:41.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78015aed0 con 0x7fb780157750 2023-09-13T06:08:41.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb78487b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800ce270 con 0x7fb78006dba0 2023-09-13T06:08:41.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb77ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780157b30 0x7fb78015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:41.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb77ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780157b30 0x7fb78015a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57318/0 (socket says 172.21.15.130:57318) 2023-09-13T06:08:41.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb77ed9d640 1 -- 172.21.15.130:0/2361300855 learned_addr learned my addr 172.21.15.130:0/2361300855 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:41.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb77dd9b640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb780157750 0x7fb7800cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:41.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.827+0000 7fb77e59c640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb78006dba0 0x7fb7800cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:41.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb77ed9d640 1 -- 172.21.15.130:0/2361300855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb78006dba0 msgr2=0x7fb7800cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:41.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb77ed9d640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb78006dba0 0x7fb7800cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:41.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb77ed9d640 1 -- 172.21.15.130:0/2361300855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb780157750 msgr2=0x7fb7800cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:41.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb77ed9d640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb780157750 0x7fb7800cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:41.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb77ed9d640 1 -- 172.21.15.130:0/2361300855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778009a70 con 0x7fb780157b30 2023-09-13T06:08:41.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb77ed9d640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780157b30 0x7fb78015a990 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb7780194f0 tx=0x7fb778019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:41.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb76effd640 1 -- 172.21.15.130:0/2361300855 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780b9860 con 0x7fb780157b30 2023-09-13T06:08:41.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb76effd640 1 -- 172.21.15.130:0/2361300855 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7780b99c0 con 0x7fb780157b30 2023-09-13T06:08:41.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb78487b640 1 -- 172.21.15.130:0/2361300855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78006fa00 con 0x7fb780157b30 2023-09-13T06:08:41.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb76effd640 1 -- 172.21.15.130:0/2361300855 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780b9d50 con 0x7fb780157b30 2023-09-13T06:08:41.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb78487b640 1 -- 172.21.15.130:0/2361300855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7800ce830 con 0x7fb780157b30 2023-09-13T06:08:41.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb78487b640 1 -- 172.21.15.130:0/2361300855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7800618a0 con 0x7fb780157b30 2023-09-13T06:08:41.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb76effd640 1 -- 172.21.15.130:0/2361300855 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb7780ad440 con 0x7fb780157b30 2023-09-13T06:08:41.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb76effd640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb760065b50 0x7fb760068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:41.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb76effd640 1 -- 172.21.15.130:0/2361300855 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb77811df50 con 0x7fb780157b30 2023-09-13T06:08:41.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.831+0000 7fb77e59c640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb760065b50 0x7fb760068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:41.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.835+0000 7fb77e59c640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb760065b50 0x7fb760068010 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb770009b60 tx=0x7fb770009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:41.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:41.839+0000 7fb76effd640 1 -- 172.21.15.130:0/2361300855 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb7780eb880 con 0x7fb780157b30 2023-09-13T06:08:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.019+0000 7fb78487b640 1 -- 172.21.15.130:0/2361300855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb7800733f0 con 0x7fb780157b30 2023-09-13T06:08:42.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb76effd640 1 -- 172.21.15.130:0/2361300855 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v72) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb7780b2020 con 0x7fb780157b30 2023-09-13T06:08:42.661 INFO:teuthology.orchestra.run.smithi130.stderr:new fs with metadata pool 18 and data pool 19 2023-09-13T06:08:42.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 -- 172.21.15.130:0/2361300855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb760065b50 msgr2=0x7fb760068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:42.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb760065b50 0x7fb760068010 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb770009b60 tx=0x7fb770009190 comp rx=0 tx=0).stop 2023-09-13T06:08:42.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 -- 172.21.15.130:0/2361300855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780157b30 msgr2=0x7fb78015a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:42.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780157b30 0x7fb78015a990 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb7780194f0 tx=0x7fb778019680 comp rx=0 tx=0).stop 2023-09-13T06:08:42.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 -- 172.21.15.130:0/2361300855 shutdown_connections 2023-09-13T06:08:42.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb760065b50 0x7fb760068010 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb780157750 0x7fb7800cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780157b30 0x7fb78015a990 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 --2- 172.21.15.130:0/2361300855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb78006dba0 0x7fb7800cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 -- 172.21.15.130:0/2361300855 >> 172.21.15.130:0/2361300855 conn(0x7fb780065d60 msgr2=0x7fb780153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:42.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 -- 172.21.15.130:0/2361300855 shutdown_connections 2023-09-13T06:08:42.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.659+0000 7fb78487b640 1 -- 172.21.15.130:0/2361300855 wait complete. 2023-09-13T06:08:42.686 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:08:42.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13bc93640 1 Processor -- start 2023-09-13T06:08:42.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13bc93640 1 -- start start 2023-09-13T06:08:42.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13bc93640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd1340d1090 0x7fd13415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:42.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13bc93640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1340b63c0 con 0x7fd134146f30 2023-09-13T06:08:42.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13bc93640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1340d0c20 con 0x7fd1340d1750 2023-09-13T06:08:42.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13bc93640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13415dea0 con 0x7fd1340d1090 2023-09-13T06:08:42.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13a230640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd134146f30 0x7fd1340b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51012/0 (socket says 172.21.15.130:51012) 2023-09-13T06:08:42.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13a230640 1 -- 172.21.15.130:0/3001376943 learned_addr learned my addr 172.21.15.130:0/3001376943 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:42.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13922e640 1 --2- 172.21.15.130:0/3001376943 >> v2:172.21.15.164:3300/0 conn(0x7fd1340d1090 0x7fd13415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:42.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd138a2d640 1 -- 172.21.15.130:0/3001376943 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853244997 0 0) 0x7fd1340b63c0 con 0x7fd134146f30 2023-09-13T06:08:42.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd138a2d640 1 -- 172.21.15.130:0/3001376943 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd120003530 con 0x7fd134146f30 2023-09-13T06:08:42.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd138a2d640 1 -- 172.21.15.130:0/3001376943 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121742727 0 0) 0x7fd1340d0c20 con 0x7fd1340d1750 2023-09-13T06:08:42.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd138a2d640 1 -- 172.21.15.130:0/3001376943 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1340b63c0 con 0x7fd1340d1750 2023-09-13T06:08:42.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13922e640 1 -- 172.21.15.130:0/3001376943 >> v1:172.21.15.164:6789/0 conn(0x7fd1340d1750 legacy=0x7fd134146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:42.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13922e640 1 -- 172.21.15.130:0/3001376943 >> v1:172.21.15.130:6789/0 conn(0x7fd134146f30 legacy=0x7fd1340b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:42.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.823+0000 7fd13922e640 1 -- 172.21.15.130:0/3001376943 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1340b6610 con 0x7fd1340d1090 2023-09-13T06:08:42.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.827+0000 7fd13922e640 1 --2- 172.21.15.130:0/3001376943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1340d1090 0x7fd13415d960 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd1240097c0 tx=0x7fd12401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70cb212d0cb359f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:42.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.827+0000 7fd138a2d640 1 -- 172.21.15.130:0/3001376943 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1240ac620 con 0x7fd1340d1090 2023-09-13T06:08:42.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.827+0000 7fd138a2d640 1 -- 172.21.15.130:0/3001376943 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1240ac780 con 0x7fd1340d1090 2023-09-13T06:08:42.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.827+0000 7fd138a2d640 1 -- 172.21.15.130:0/3001376943 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1240acb10 con 0x7fd1340d1090 2023-09-13T06:08:42.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.827+0000 7fd13bc93640 1 -- 172.21.15.130:0/3001376943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1340d1090 msgr2=0x7fd13415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:42.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.827+0000 7fd13bc93640 1 --2- 172.21.15.130:0/3001376943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1340d1090 0x7fd13415d960 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd1240097c0 tx=0x7fd12401c3c0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.827+0000 7fd13bc93640 1 -- 172.21.15.130:0/3001376943 shutdown_connections 2023-09-13T06:08:42.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.827+0000 7fd13bc93640 1 --2- 172.21.15.130:0/3001376943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1340d1090 0x7fd13415d960 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.827+0000 7fd13bc93640 1 -- 172.21.15.130:0/3001376943 >> 172.21.15.130:0/3001376943 conn(0x7fd13406f170 msgr2=0x7fd13406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:42.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.827+0000 7fd13bc93640 1 -- 172.21.15.130:0/3001376943 shutdown_connections 2023-09-13T06:08:42.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.827+0000 7fd13bc93640 1 -- 172.21.15.130:0/3001376943 wait complete. 2023-09-13T06:08:42.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13bc93640 1 Processor -- start 2023-09-13T06:08:42.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13bc93640 1 -- start start 2023-09-13T06:08:42.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13bc93640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1340d1090 0x7fd1341357f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:42.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13bc93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1340d1750 0x7fd134155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:42.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13bc93640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd134146f30 0x7fd1341f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:42.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13bc93640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1341fa000 con 0x7fd1340d1750 2023-09-13T06:08:42.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13bc93640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13413ced0 con 0x7fd134146f30 2023-09-13T06:08:42.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13bc93640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd134135eb0 con 0x7fd1340d1090 2023-09-13T06:08:42.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13922e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1340d1750 0x7fd134155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:42.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13922e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1340d1750 0x7fd134155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57324/0 (socket says 172.21.15.130:57324) 2023-09-13T06:08:42.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13922e640 1 -- 172.21.15.130:0/2049931465 learned_addr learned my addr 172.21.15.130:0/2049931465 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:42.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13a230640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd134146f30 0x7fd1341f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:42.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd139a2f640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1340d1090 0x7fd1341357f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:42.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13922e640 1 -- 172.21.15.130:0/2049931465 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1340d1090 msgr2=0x7fd1341357f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:42.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13922e640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1340d1090 0x7fd1341357f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13922e640 1 -- 172.21.15.130:0/2049931465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd134146f30 msgr2=0x7fd1341f9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:42.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13922e640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd134146f30 0x7fd1341f9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13922e640 1 -- 172.21.15.130:0/2049931465 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd124009420 con 0x7fd1340d1750 2023-09-13T06:08:42.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13922e640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1340d1750 0x7fd134155ea0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fd1240af040 tx=0x7fd124019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:42.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd12a7fc640 1 -- 172.21.15.130:0/2049931465 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1240ac620 con 0x7fd1340d1750 2023-09-13T06:08:42.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd12a7fc640 1 -- 172.21.15.130:0/2049931465 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1240b5410 con 0x7fd1340d1750 2023-09-13T06:08:42.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd12a7fc640 1 -- 172.21.15.130:0/2049931465 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1240b57e0 con 0x7fd1340d1750 2023-09-13T06:08:42.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13bc93640 1 -- 172.21.15.130:0/2049931465 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13413c5a0 con 0x7fd1340d1750 2023-09-13T06:08:42.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.831+0000 7fd13bc93640 1 -- 172.21.15.130:0/2049931465 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13413cb60 con 0x7fd1340d1750 2023-09-13T06:08:42.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.835+0000 7fd13bc93640 1 -- 172.21.15.130:0/2049931465 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1340618a0 con 0x7fd1340d1750 2023-09-13T06:08:42.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.835+0000 7fd12a7fc640 1 -- 172.21.15.130:0/2049931465 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd1240b3040 con 0x7fd1340d1750 2023-09-13T06:08:42.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.835+0000 7fd12a7fc640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd118065b50 0x7fd118068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:42.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.835+0000 7fd12a7fc640 1 -- 172.21.15.130:0/2049931465 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd12411d360 con 0x7fd1340d1750 2023-09-13T06:08:42.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.835+0000 7fd139a2f640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd118065b50 0x7fd118068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:42.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.835+0000 7fd139a2f640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd118065b50 0x7fd118068010 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd1300011f0 tx=0x7fd130009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:42.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.839+0000 7fd12a7fc640 1 -- 172.21.15.130:0/2049931465 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd1240eac10 con 0x7fd1340d1750 2023-09-13T06:08:42.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.987+0000 7fd13bc93640 1 -- 172.21.15.130:0/2049931465 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd13413c2e0 con 0x7fd1340d1750 2023-09-13T06:08:42.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd12a7fc640 1 -- 172.21.15.130:0/2049931465 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fd1240ee230 con 0x7fd1340d1750 2023-09-13T06:08:42.993 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:42.993 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":154,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:08:42.025937+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:08:40.183838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-09-13T06:08:41.020446+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:08:42.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 -- 172.21.15.130:0/2049931465 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd118065b50 msgr2=0x7fd118068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:42.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd118065b50 0x7fd118068010 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd1300011f0 tx=0x7fd130009040 comp rx=0 tx=0).stop 2023-09-13T06:08:42.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 -- 172.21.15.130:0/2049931465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1340d1750 msgr2=0x7fd134155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:42.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1340d1750 0x7fd134155ea0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fd1240af040 tx=0x7fd124019160 comp rx=0 tx=0).stop 2023-09-13T06:08:42.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 -- 172.21.15.130:0/2049931465 shutdown_connections 2023-09-13T06:08:42.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd118065b50 0x7fd118068010 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd134146f30 0x7fd1341f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1340d1750 0x7fd134155ea0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 --2- 172.21.15.130:0/2049931465 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd1340d1090 0x7fd1341357f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:42.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 -- 172.21.15.130:0/2049931465 >> 172.21.15.130:0/2049931465 conn(0x7fd13406f170 msgr2=0x7fd1340cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:42.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 -- 172.21.15.130:0/2049931465 shutdown_connections 2023-09-13T06:08:42.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:42.991+0000 7fd13bc93640 1 -- 172.21.15.130:0/2049931465 wait complete. 2023-09-13T06:08:43.013 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:08:43.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.147+0000 7f068c52c640 1 Processor -- start 2023-09-13T06:08:43.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.147+0000 7f068c52c640 1 -- start start 2023-09-13T06:08:43.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f068c52c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06841436e0 0x7f06840ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:43.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f068c52c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068406f640 con 0x7f06840acd80 2023-09-13T06:08:43.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f068c52c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068406f890 con 0x7f0684070d60 2023-09-13T06:08:43.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f068c52c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068406fb70 con 0x7f06841436e0 2023-09-13T06:08:43.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f0689ac7640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f06840acd80 0x7f0684070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51024/0 (socket says 172.21.15.130:51024) 2023-09-13T06:08:43.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f0689ac7640 1 -- 172.21.15.130:0/340223120 learned_addr learned my addr 172.21.15.130:0/340223120 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:43.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f068a2c8640 1 --2- 172.21.15.130:0/340223120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06841436e0 0x7f06840ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:43.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f06892c6640 1 -- 172.21.15.130:0/340223120 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361940577 0 0) 0x7f068406f640 con 0x7f06840acd80 2023-09-13T06:08:43.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f06892c6640 1 -- 172.21.15.130:0/340223120 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0670003530 con 0x7f06840acd80 2023-09-13T06:08:43.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f06892c6640 1 -- 172.21.15.130:0/340223120 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358611594 0 0) 0x7f068406f890 con 0x7f0684070d60 2023-09-13T06:08:43.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f06892c6640 1 -- 172.21.15.130:0/340223120 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f068406f640 con 0x7f0684070d60 2023-09-13T06:08:43.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f06892c6640 1 -- 172.21.15.130:0/340223120 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3911913639 0 0) 0x7f0670003530 con 0x7f06840acd80 2023-09-13T06:08:43.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f068a2c8640 1 -- 172.21.15.130:0/340223120 >> v1:172.21.15.164:6789/0 conn(0x7f0684070d60 legacy=0x7f0684160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:43.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f068a2c8640 1 -- 172.21.15.130:0/340223120 >> v1:172.21.15.130:6789/0 conn(0x7f06840acd80 legacy=0x7f0684070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:43.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.151+0000 7f068a2c8640 1 -- 172.21.15.130:0/340223120 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068406fe50 con 0x7f06841436e0 2023-09-13T06:08:43.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f068a2c8640 1 --2- 172.21.15.130:0/340223120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06841436e0 0x7f06840ac840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f06800097f0 tx=0x7f068001c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c313c7a682e54238 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:43.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f06892c6640 1 -- 172.21.15.130:0/340223120 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684146e10 con 0x7f06841436e0 2023-09-13T06:08:43.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f06892c6640 1 -- 172.21.15.130:0/340223120 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06800a7050 con 0x7f06841436e0 2023-09-13T06:08:43.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f06892c6640 1 -- 172.21.15.130:0/340223120 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674001680 con 0x7f06841436e0 2023-09-13T06:08:43.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f068c52c640 1 -- 172.21.15.130:0/340223120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06841436e0 msgr2=0x7f06840ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:43.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f068c52c640 1 --2- 172.21.15.130:0/340223120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06841436e0 0x7f06840ac840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f06800097f0 tx=0x7f068001c2c0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f068c52c640 1 -- 172.21.15.130:0/340223120 shutdown_connections 2023-09-13T06:08:43.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f068c52c640 1 --2- 172.21.15.130:0/340223120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06841436e0 0x7f06840ac840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f068c52c640 1 -- 172.21.15.130:0/340223120 >> 172.21.15.130:0/340223120 conn(0x7f06840b0bc0 msgr2=0x7f06840b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:43.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f068c52c640 1 -- 172.21.15.130:0/340223120 shutdown_connections 2023-09-13T06:08:43.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f068c52c640 1 -- 172.21.15.130:0/340223120 wait complete. 2023-09-13T06:08:43.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f068c52c640 1 Processor -- start 2023-09-13T06:08:43.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.155+0000 7f068c52c640 1 -- start start 2023-09-13T06:08:43.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f068c52c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0684070d60 0x7f06841598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:43.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f068c52c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06840acd80 0x7f0684162c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:43.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f068c52c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06841436e0 0x7f0684071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:43.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f068c52c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0684165dd0 con 0x7f06840acd80 2023-09-13T06:08:43.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f068c52c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0684164b40 con 0x7f0684070d60 2023-09-13T06:08:43.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f068c52c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0684163f30 con 0x7f06841436e0 2023-09-13T06:08:43.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f0689ac7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06840acd80 0x7f0684162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:43.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f0689ac7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06840acd80 0x7f0684162c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57334/0 (socket says 172.21.15.130:57334) 2023-09-13T06:08:43.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f0689ac7640 1 -- 172.21.15.130:0/3114268187 learned_addr learned my addr 172.21.15.130:0/3114268187 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:43.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f068a2c8640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0684070d60 0x7f06841598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:43.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f068aac9640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06841436e0 0x7f0684071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:43.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f0689ac7640 1 -- 172.21.15.130:0/3114268187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06841436e0 msgr2=0x7f0684071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:43.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f0689ac7640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06841436e0 0x7f0684071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f0689ac7640 1 -- 172.21.15.130:0/3114268187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0684070d60 msgr2=0x7f06841598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:43.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f0689ac7640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0684070d60 0x7f06841598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f0689ac7640 1 -- 172.21.15.130:0/3114268187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680009420 con 0x7f06840acd80 2023-09-13T06:08:43.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f0689ac7640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06840acd80 0x7f0684162c40 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f067400c750 tx=0x7f067400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:43.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f067affd640 1 -- 172.21.15.130:0/3114268187 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674005ae0 con 0x7f06840acd80 2023-09-13T06:08:43.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f067affd640 1 -- 172.21.15.130:0/3114268187 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0674005c40 con 0x7f06840acd80 2023-09-13T06:08:43.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f068c52c640 1 -- 172.21.15.130:0/3114268187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0684164210 con 0x7f06840acd80 2023-09-13T06:08:43.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f067affd640 1 -- 172.21.15.130:0/3114268187 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674007070 con 0x7f06840acd80 2023-09-13T06:08:43.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f068c52c640 1 -- 172.21.15.130:0/3114268187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06841647d0 con 0x7f06840acd80 2023-09-13T06:08:43.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f068c52c640 1 -- 172.21.15.130:0/3114268187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06840618a0 con 0x7f06840acd80 2023-09-13T06:08:43.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.159+0000 7f067affd640 1 -- 172.21.15.130:0/3114268187 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f06740071d0 con 0x7f06840acd80 2023-09-13T06:08:43.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.163+0000 7f067affd640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0668065b20 0x7f0668067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:43.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.163+0000 7f067affd640 1 -- 172.21.15.130:0/3114268187 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0674082f20 con 0x7f06840acd80 2023-09-13T06:08:43.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.163+0000 7f068a2c8640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0668065b20 0x7f0668067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:43.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.163+0000 7f068a2c8640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0668065b20 0x7f0668067fe0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f06800ad000 tx=0x7f0680008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:43.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.167+0000 7f067affd640 1 -- 172.21.15.130:0/3114268187 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f06740509b0 con 0x7f06840acd80 2023-09-13T06:08:43.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.315+0000 7f068c52c640 1 -- 172.21.15.130:0/3114268187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f068406d650 con 0x7f06840acd80 2023-09-13T06:08:43.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.315+0000 7f067affd640 1 -- 172.21.15.130:0/3114268187 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f0674053fd0 con 0x7f06840acd80 2023-09-13T06:08:43.320 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:43.320 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":154,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:08:42.025937+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:08:40.183838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-09-13T06:08:41.020446+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:08:43.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 -- 172.21.15.130:0/3114268187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0668065b20 msgr2=0x7f0668067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:43.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0668065b20 0x7f0668067fe0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f06800ad000 tx=0x7f0680008040 comp rx=0 tx=0).stop 2023-09-13T06:08:43.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 -- 172.21.15.130:0/3114268187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06840acd80 msgr2=0x7f0684162c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:43.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06840acd80 0x7f0684162c40 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f067400c750 tx=0x7f067400cc10 comp rx=0 tx=0).stop 2023-09-13T06:08:43.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 -- 172.21.15.130:0/3114268187 shutdown_connections 2023-09-13T06:08:43.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0668065b20 0x7f0668067fe0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06841436e0 0x7f0684071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06840acd80 0x7f0684162c40 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 --2- 172.21.15.130:0/3114268187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0684070d60 0x7f06841598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 -- 172.21.15.130:0/3114268187 >> 172.21.15.130:0/3114268187 conn(0x7f06840b0bc0 msgr2=0x7f0684145be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:43.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 -- 172.21.15.130:0/3114268187 shutdown_connections 2023-09-13T06:08:43.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.319+0000 7f068c52c640 1 -- 172.21.15.130:0/3114268187 wait complete. 2023-09-13T06:08:43.341 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T06:08:43.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35f25ac640 1 Processor -- start 2023-09-13T06:08:43.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35f25ac640 1 -- start start 2023-09-13T06:08:43.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35f25ac640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f35ec144d70 0x7f35ec0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:43.485 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35f25ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec0b2780 0x7f35ec0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:43.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35f25ac640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec0b3120 con 0x7f35ec0b1460 2023-09-13T06:08:43.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35f25ac640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec0b2430 con 0x7f35ec144d70 2023-09-13T06:08:43.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35f25ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0cedb0 con 0x7f35ec0b2780 2023-09-13T06:08:43.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35f0b49640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f35ec0b1460 0x7f35ec0b18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51036/0 (socket says 172.21.15.130:51036) 2023-09-13T06:08:43.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35f0b49640 1 -- 172.21.15.130:0/3949278742 learned_addr learned my addr 172.21.15.130:0/3949278742 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:43.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35eb7fe640 1 --2- 172.21.15.130:0/3949278742 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec0b2780 0x7f35ec0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:43.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35ebfff640 1 --2- 172.21.15.130:0/3949278742 >> v2:172.21.15.164:3300/0 conn(0x7f35ec144d70 0x7f35ec0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:43.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35eaffd640 1 -- 172.21.15.130:0/3949278742 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503756372 0 0) 0x7f35ec0b3120 con 0x7f35ec0b1460 2023-09-13T06:08:43.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35eaffd640 1 -- 172.21.15.130:0/3949278742 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d4003530 con 0x7f35ec0b1460 2023-09-13T06:08:43.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35eb7fe640 1 -- 172.21.15.130:0/3949278742 >> v2:172.21.15.164:3300/0 conn(0x7f35ec144d70 msgr2=0x7f35ec0ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:43.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35eb7fe640 1 --2- 172.21.15.130:0/3949278742 >> v2:172.21.15.164:3300/0 conn(0x7f35ec144d70 0x7f35ec0ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35eaffd640 1 -- 172.21.15.130:0/3949278742 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 147672896 0 0) 0x7f35d4003530 con 0x7f35ec0b1460 2023-09-13T06:08:43.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35eb7fe640 1 -- 172.21.15.130:0/3949278742 >> v1:172.21.15.130:6789/0 conn(0x7f35ec0b1460 legacy=0x7f35ec0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:43.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.483+0000 7f35eb7fe640 1 -- 172.21.15.130:0/3949278742 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec0b2150 con 0x7f35ec0b2780 2023-09-13T06:08:43.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35eb7fe640 1 --2- 172.21.15.130:0/3949278742 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec0b2780 0x7f35ec0b2be0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35e00097c0 tx=0x7f35e001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b77deeea7f1276 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:43.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35eaffd640 1 -- 172.21.15.130:0/3949278742 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4001a00 con 0x7f35ec0b2780 2023-09-13T06:08:43.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35eaffd640 1 -- 172.21.15.130:0/3949278742 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e00a7050 con 0x7f35ec0b2780 2023-09-13T06:08:43.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35eaffd640 1 -- 172.21.15.130:0/3949278742 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00ab620 con 0x7f35ec0b2780 2023-09-13T06:08:43.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35f25ac640 1 -- 172.21.15.130:0/3949278742 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec0b2780 msgr2=0x7f35ec0b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:43.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35f25ac640 1 --2- 172.21.15.130:0/3949278742 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec0b2780 0x7f35ec0b2be0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35e00097c0 tx=0x7f35e001c3a0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35f25ac640 1 -- 172.21.15.130:0/3949278742 shutdown_connections 2023-09-13T06:08:43.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35f25ac640 1 --2- 172.21.15.130:0/3949278742 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec0b2780 0x7f35ec0b2be0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35f25ac640 1 --2- 172.21.15.130:0/3949278742 >> v2:172.21.15.164:3300/0 conn(0x7f35ec144d70 0x7f35ec0ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35f25ac640 1 -- 172.21.15.130:0/3949278742 >> 172.21.15.130:0/3949278742 conn(0x7f35ec065990 msgr2=0x7f35ec065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:43.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35f25ac640 1 -- 172.21.15.130:0/3949278742 shutdown_connections 2023-09-13T06:08:43.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.487+0000 7f35f25ac640 1 -- 172.21.15.130:0/3949278742 wait complete. 2023-09-13T06:08:43.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f25ac640 1 Processor -- start 2023-09-13T06:08:43.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f25ac640 1 -- start start 2023-09-13T06:08:43.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f25ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35ec0b1460 0x7f35ec0ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:43.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f25ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35ec0b2780 0x7f35ec1379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:43.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f25ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec144d70 0x7f35ec0b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:43.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f25ac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec1590e0 con 0x7f35ec0b2780 2023-09-13T06:08:43.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f25ac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec158e00 con 0x7f35ec0b1460 2023-09-13T06:08:43.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f25ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0af520 con 0x7f35ec144d70 2023-09-13T06:08:43.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35eb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35ec0b2780 0x7f35ec1379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:43.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35eb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35ec0b2780 0x7f35ec1379a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57350/0 (socket says 172.21.15.130:57350) 2023-09-13T06:08:43.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35eb7fe640 1 -- 172.21.15.130:0/4193661206 learned_addr learned my addr 172.21.15.130:0/4193661206 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:43.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f0b49640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec144d70 0x7f35ec0b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:43.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35ebfff640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35ec0b1460 0x7f35ec0ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:43.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35eb7fe640 1 -- 172.21.15.130:0/4193661206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec144d70 msgr2=0x7f35ec0b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:43.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35eb7fe640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec144d70 0x7f35ec0b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35eb7fe640 1 -- 172.21.15.130:0/4193661206 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35ec0b1460 msgr2=0x7f35ec0ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:43.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35eb7fe640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35ec0b1460 0x7f35ec0ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:43.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35eb7fe640 1 -- 172.21.15.130:0/4193661206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0009420 con 0x7f35ec0b2780 2023-09-13T06:08:43.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f0b49640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec144d70 0x7f35ec0b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:08:43.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35eb7fe640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35ec0b2780 0x7f35ec1379a0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f35e001aa50 tx=0x7f35e0019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:43.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35e8ff9640 1 -- 172.21.15.130:0/4193661206 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00b4410 con 0x7f35ec0b2780 2023-09-13T06:08:43.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35e8ff9640 1 -- 172.21.15.130:0/4193661206 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e00b4590 con 0x7f35ec0b2780 2023-09-13T06:08:43.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35e8ff9640 1 -- 172.21.15.130:0/4193661206 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00b4940 con 0x7f35ec0b2780 2023-09-13T06:08:43.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f25ac640 1 -- 172.21.15.130:0/4193661206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec0af800 con 0x7f35ec0b2780 2023-09-13T06:08:43.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.491+0000 7f35f25ac640 1 -- 172.21.15.130:0/4193661206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec0aee90 con 0x7f35ec0b2780 2023-09-13T06:08:43.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.495+0000 7f35f25ac640 1 -- 172.21.15.130:0/4193661206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ec0ce330 con 0x7f35ec0b2780 2023-09-13T06:08:43.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.495+0000 7f35e8ff9640 1 -- 172.21.15.130:0/4193661206 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f35e00b2040 con 0x7f35ec0b2780 2023-09-13T06:08:43.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.495+0000 7f35e8ff9640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35d8065b20 0x7f35d8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:43.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.495+0000 7f35e8ff9640 1 -- 172.21.15.130:0/4193661206 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35e011d0f0 con 0x7f35ec0b2780 2023-09-13T06:08:43.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.495+0000 7f35ebfff640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35d8065b20 0x7f35d8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:43.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.495+0000 7f35ebfff640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35d8065b20 0x7f35d8067fe0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009ac0 tx=0x7f35dc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:43.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.499+0000 7f35e8ff9640 1 -- 172.21.15.130:0/4193661206 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f35ec0ce330 con 0x7f35ec0b2780 2023-09-13T06:08:43.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:43.683+0000 7f35f25ac640 1 -- 172.21.15.130:0/4193661206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f35ec0ce330 con 0x7f35ec0b2780 2023-09-13T06:08:44.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.687+0000 7f35e8ff9640 1 -- 172.21.15.130:0/4193661206 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) v1 ==== 118+0+0 (secure 0 0 0) 0x7f35ec0ce330 con 0x7f35ec0b2780 2023-09-13T06:08:44.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 -- 172.21.15.130:0/4193661206 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35d8065b20 msgr2=0x7f35d8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:44.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35d8065b20 0x7f35d8067fe0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009ac0 tx=0x7f35dc009190 comp rx=0 tx=0).stop 2023-09-13T06:08:44.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 -- 172.21.15.130:0/4193661206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35ec0b2780 msgr2=0x7f35ec1379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35ec0b2780 0x7f35ec1379a0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f35e001aa50 tx=0x7f35e0019140 comp rx=0 tx=0).stop 2023-09-13T06:08:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 -- 172.21.15.130:0/4193661206 shutdown_connections 2023-09-13T06:08:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35d8065b20 0x7f35d8067fe0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35ec144d70 0x7f35ec0b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35ec0b2780 0x7f35ec1379a0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:44.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 --2- 172.21.15.130:0/4193661206 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35ec0b1460 0x7f35ec0ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:44.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 -- 172.21.15.130:0/4193661206 >> 172.21.15.130:0/4193661206 conn(0x7f35ec065990 msgr2=0x7f35ec0ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:44.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 -- 172.21.15.130:0/4193661206 shutdown_connections 2023-09-13T06:08:44.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.691+0000 7f35f25ac640 1 -- 172.21.15.130:0/4193661206 wait complete. 2023-09-13T06:08:44.715 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T06:08:44.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T06:08:44.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe605fdb640 1 Processor -- start 2023-09-13T06:08:44.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe605fdb640 1 -- start start 2023-09-13T06:08:44.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe605fdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe60015a080 0x7fe6000b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:44.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe605fdb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe6000b31a0 0x7fe6000ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:44.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe605fdb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000cc850 con 0x7fe60015e650 2023-09-13T06:08:44.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe605fdb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000b0330 con 0x7fe6000b31a0 2023-09-13T06:08:44.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe605fdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000cbcd0 con 0x7fe60015a080 2023-09-13T06:08:44.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe5feffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe60015e650 0x7fe6000b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51038/0 (socket says 172.21.15.130:51038) 2023-09-13T06:08:44.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe5feffd640 1 -- 172.21.15.130:0/2923761551 learned_addr learned my addr 172.21.15.130:0/2923761551 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:44.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe5fffff640 1 --2- 172.21.15.130:0/2923761551 >> v2:172.21.15.130:3300/0 conn(0x7fe6000b31a0 0x7fe6000ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:44.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe5ff7fe640 1 --2- 172.21.15.130:0/2923761551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe60015a080 0x7fe6000b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:44.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe5fffff640 1 -- 172.21.15.130:0/2923761551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe60015a080 msgr2=0x7fe6000b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:44.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe5fffff640 1 --2- 172.21.15.130:0/2923761551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe60015a080 0x7fe6000b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:44.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe5fffff640 1 -- 172.21.15.130:0/2923761551 >> v1:172.21.15.130:6789/0 conn(0x7fe60015e650 legacy=0x7fe6000b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:44.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.859+0000 7fe5fffff640 1 -- 172.21.15.130:0/2923761551 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000cbfb0 con 0x7fe6000b31a0 2023-09-13T06:08:44.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe5fffff640 1 --2- 172.21.15.130:0/2923761551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6000b31a0 0x7fe6000ccfe0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009d90 tx=0x7fe5f801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e04affc53b80f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:44.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe5fe7fc640 1 -- 172.21.15.130:0/2923761551 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80a5750 con 0x7fe6000b31a0 2023-09-13T06:08:44.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe5fe7fc640 1 -- 172.21.15.130:0/2923761551 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f80a58b0 con 0x7fe6000b31a0 2023-09-13T06:08:44.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe5fe7fc640 1 -- 172.21.15.130:0/2923761551 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80a5c40 con 0x7fe6000b31a0 2023-09-13T06:08:44.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe605fdb640 1 -- 172.21.15.130:0/2923761551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6000b31a0 msgr2=0x7fe6000ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:44.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe605fdb640 1 --2- 172.21.15.130:0/2923761551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6000b31a0 0x7fe6000ccfe0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009d90 tx=0x7fe5f801c890 comp rx=0 tx=0).stop 2023-09-13T06:08:44.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe605fdb640 1 -- 172.21.15.130:0/2923761551 shutdown_connections 2023-09-13T06:08:44.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe605fdb640 1 --2- 172.21.15.130:0/2923761551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6000b31a0 0x7fe6000ccfe0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:44.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe605fdb640 1 --2- 172.21.15.130:0/2923761551 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe60015a080 0x7fe6000b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:44.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe605fdb640 1 -- 172.21.15.130:0/2923761551 >> 172.21.15.130:0/2923761551 conn(0x7fe600065990 msgr2=0x7fe600065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:44.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe605fdb640 1 -- 172.21.15.130:0/2923761551 shutdown_connections 2023-09-13T06:08:44.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.863+0000 7fe605fdb640 1 -- 172.21.15.130:0/2923761551 wait complete. 2023-09-13T06:08:44.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe605fdb640 1 Processor -- start 2023-09-13T06:08:44.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe605fdb640 1 -- start start 2023-09-13T06:08:44.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe605fdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6000b31a0 0x7fe6000ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:44.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe605fdb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe60015a080 0x7fe6000ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:44.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe605fdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60015e650 0x7fe6001404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:44.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe605fdb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6001f56a0 con 0x7fe60015e650 2023-09-13T06:08:44.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe605fdb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600153080 con 0x7fe60015a080 2023-09-13T06:08:44.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe605fdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe600152470 con 0x7fe6000b31a0 2023-09-13T06:08:44.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5fffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60015e650 0x7fe6001404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:44.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5fffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60015e650 0x7fe6001404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57362/0 (socket says 172.21.15.130:57362) 2023-09-13T06:08:44.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5fffff640 1 -- 172.21.15.130:0/3216907116 learned_addr learned my addr 172.21.15.130:0/3216907116 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:44.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5ff7fe640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6000b31a0 0x7fe6000ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:44.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5feffd640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe60015a080 0x7fe6000ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:44.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5fffff640 1 -- 172.21.15.130:0/3216907116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6000b31a0 msgr2=0x7fe6000ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:44.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5fffff640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6000b31a0 0x7fe6000ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:44.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5fffff640 1 -- 172.21.15.130:0/3216907116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe60015a080 msgr2=0x7fe6000ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:44.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5fffff640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe60015a080 0x7fe6000ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:44.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5fffff640 1 -- 172.21.15.130:0/3216907116 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8009a70 con 0x7fe60015e650 2023-09-13T06:08:44.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5ff7fe640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6000b31a0 0x7fe6000ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:44.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5feffd640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe60015a080 0x7fe6000ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:44.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5fffff640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60015e650 0x7fe6001404e0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fe5f801af40 tx=0x7fe5f8019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:44.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5e7fff640 1 -- 172.21.15.130:0/3216907116 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80b9860 con 0x7fe60015e650 2023-09-13T06:08:44.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5e7fff640 1 -- 172.21.15.130:0/3216907116 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f80b99c0 con 0x7fe60015e650 2023-09-13T06:08:44.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe5e7fff640 1 -- 172.21.15.130:0/3216907116 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80b9d30 con 0x7fe60015e650 2023-09-13T06:08:44.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe605fdb640 1 -- 172.21.15.130:0/3216907116 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe600152750 con 0x7fe60015e650 2023-09-13T06:08:44.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.867+0000 7fe605fdb640 1 -- 172.21.15.130:0/3216907116 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe600152d10 con 0x7fe60015e650 2023-09-13T06:08:44.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.871+0000 7fe605fdb640 1 -- 172.21.15.130:0/3216907116 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6001531f0 con 0x7fe60015e650 2023-09-13T06:08:44.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.871+0000 7fe5e7fff640 1 -- 172.21.15.130:0/3216907116 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe5f80ad440 con 0x7fe60015e650 2023-09-13T06:08:44.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.871+0000 7fe5e7fff640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5ec065b20 0x7fe5ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:44.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.871+0000 7fe5e7fff640 1 -- 172.21.15.130:0/3216907116 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5f811e7f0 con 0x7fe60015e650 2023-09-13T06:08:44.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.871+0000 7fe5ff7fe640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5ec065b20 0x7fe5ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:44.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.871+0000 7fe5ff7fe640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5ec065b20 0x7fe5ec067fe0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009840 tx=0x7fe5f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:44.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:44.875+0000 7fe5e7fff640 1 -- 172.21.15.130:0/3216907116 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe5f80ec0a0 con 0x7fe60015e650 2023-09-13T06:08:45.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.055+0000 7fe605fdb640 1 -- 172.21.15.130:0/3216907116 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe6000618a0 con 0x7fe60015e650 2023-09-13T06:08:45.667 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:08:45.670 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:08:45.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.695+0000 7fe5e7fff640 1 -- 172.21.15.130:0/3216907116 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe5f80ef6c0 con 0x7fe60015e650 2023-09-13T06:08:45.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 -- 172.21.15.130:0/3216907116 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5ec065b20 msgr2=0x7fe5ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:45.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5ec065b20 0x7fe5ec067fe0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009840 tx=0x7fe5f0008040 comp rx=0 tx=0).stop 2023-09-13T06:08:45.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 -- 172.21.15.130:0/3216907116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60015e650 msgr2=0x7fe6001404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:45.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60015e650 0x7fe6001404e0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fe5f801af40 tx=0x7fe5f8019630 comp rx=0 tx=0).stop 2023-09-13T06:08:45.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 -- 172.21.15.130:0/3216907116 shutdown_connections 2023-09-13T06:08:45.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5ec065b20 0x7fe5ec067fe0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:45.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe60015a080 0x7fe6000ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:45.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60015e650 0x7fe6001404e0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:45.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 --2- 172.21.15.130:0/3216907116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6000b31a0 0x7fe6000ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:45.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 -- 172.21.15.130:0/3216907116 >> 172.21.15.130:0/3216907116 conn(0x7fe600065990 msgr2=0x7fe600156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:45.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 -- 172.21.15.130:0/3216907116 shutdown_connections 2023-09-13T06:08:45.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.699+0000 7fe605fdb640 1 -- 172.21.15.130:0/3216907116 wait complete. 2023-09-13T06:08:45.720 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T06:08:45.721 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:08:45.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.895+0000 7f469e574640 1 Processor -- start 2023-09-13T06:08:45.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.895+0000 7f469e574640 1 -- start start 2023-09-13T06:08:45.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f469e574640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f46980b1d20 0x7f46980ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:45.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f469e574640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f46980cdfc0 0x7f46980b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:45.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f469e574640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46980ccfd0 con 0x7f4698159f20 2023-09-13T06:08:45.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f469e574640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46980ce430 con 0x7f46980cdfc0 2023-09-13T06:08:45.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f469e574640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46980b00f0 con 0x7f46980b1d20 2023-09-13T06:08:45.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f4697fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4698159f20 0x7f46980b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51050/0 (socket says 172.21.15.130:51050) 2023-09-13T06:08:45.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f4697fff640 1 -- 172.21.15.130:0/917542050 learned_addr learned my addr 172.21.15.130:0/917542050 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:45.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f469cb11640 1 --2- 172.21.15.130:0/917542050 >> v2:172.21.15.130:3300/0 conn(0x7f46980cdfc0 0x7f46980b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:45.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f46977fe640 1 --2- 172.21.15.130:0/917542050 >> v2:172.21.15.164:3300/0 conn(0x7f46980b1d20 0x7f46980ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:45.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f469cb11640 1 -- 172.21.15.130:0/917542050 >> v2:172.21.15.164:3300/0 conn(0x7f46980b1d20 msgr2=0x7f46980ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:45.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f469cb11640 1 --2- 172.21.15.130:0/917542050 >> v2:172.21.15.164:3300/0 conn(0x7f46980b1d20 0x7f46980ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:45.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f469cb11640 1 -- 172.21.15.130:0/917542050 >> v1:172.21.15.130:6789/0 conn(0x7f4698159f20 legacy=0x7f46980b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:45.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f469cb11640 1 -- 172.21.15.130:0/917542050 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46980ced90 con 0x7f46980cdfc0 2023-09-13T06:08:45.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f4696ffd640 1 -- 172.21.15.130:0/917542050 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182742601 0 0) 0x7f46980ccfd0 con 0x7f4698159f20 2023-09-13T06:08:45.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.899+0000 7f46977fe640 1 --2- 172.21.15.130:0/917542050 >> v2:172.21.15.164:3300/0 conn(0x7f46980b1d20 0x7f46980ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:45.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f469cb11640 1 --2- 172.21.15.130:0/917542050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46980cdfc0 0x7f46980b0c90 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f4690009d90 tx=0x7f469001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2b4746d3febec1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:45.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f4696ffd640 1 -- 172.21.15.130:0/917542050 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900a5910 con 0x7f46980cdfc0 2023-09-13T06:08:45.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f4696ffd640 1 -- 172.21.15.130:0/917542050 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46900a5a70 con 0x7f46980cdfc0 2023-09-13T06:08:45.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f4696ffd640 1 -- 172.21.15.130:0/917542050 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900a5e00 con 0x7f46980cdfc0 2023-09-13T06:08:45.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f469e574640 1 -- 172.21.15.130:0/917542050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46980cdfc0 msgr2=0x7f46980b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:45.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f469e574640 1 --2- 172.21.15.130:0/917542050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46980cdfc0 0x7f46980b0c90 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f4690009d90 tx=0x7f469001c850 comp rx=0 tx=0).stop 2023-09-13T06:08:45.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f469e574640 1 -- 172.21.15.130:0/917542050 shutdown_connections 2023-09-13T06:08:45.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f469e574640 1 --2- 172.21.15.130:0/917542050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46980cdfc0 0x7f46980b0c90 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:45.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f469e574640 1 --2- 172.21.15.130:0/917542050 >> v2:172.21.15.164:3300/0 conn(0x7f46980b1d20 0x7f46980ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:45.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f469e574640 1 -- 172.21.15.130:0/917542050 >> 172.21.15.130:0/917542050 conn(0x7f4698065990 msgr2=0x7f4698065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:45.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f469e574640 1 -- 172.21.15.130:0/917542050 shutdown_connections 2023-09-13T06:08:45.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f469e574640 1 -- 172.21.15.130:0/917542050 wait complete. 2023-09-13T06:08:45.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f469e574640 1 Processor -- start 2023-09-13T06:08:45.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.903+0000 7f469e574640 1 -- start start 2023-09-13T06:08:45.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f469e574640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46980b1d20 0x7f4698137460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:45.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f469e574640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46980cdfc0 0x7f469814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:45.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f469e574640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4698159f20 0x7f4698153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:45.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f469e574640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698154020 con 0x7f46980b1d20 2023-09-13T06:08:45.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f469e574640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698155580 con 0x7f46980cdfc0 2023-09-13T06:08:45.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f469e574640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4698155860 con 0x7f4698159f20 2023-09-13T06:08:45.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4697fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46980b1d20 0x7f4698137460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:45.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4697fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46980b1d20 0x7f4698137460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57380/0 (socket says 172.21.15.130:57380) 2023-09-13T06:08:45.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4697fff640 1 -- 172.21.15.130:0/1732011369 learned_addr learned my addr 172.21.15.130:0/1732011369 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:45.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f46977fe640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46980cdfc0 0x7f469814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:45.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f469cb11640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4698159f20 0x7f4698153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:45.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4697fff640 1 -- 172.21.15.130:0/1732011369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4698159f20 msgr2=0x7f4698153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:45.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4697fff640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4698159f20 0x7f4698153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:45.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4697fff640 1 -- 172.21.15.130:0/1732011369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46980cdfc0 msgr2=0x7f469814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:45.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4697fff640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46980cdfc0 0x7f469814b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:45.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4697fff640 1 -- 172.21.15.130:0/1732011369 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4690009a70 con 0x7f46980b1d20 2023-09-13T06:08:45.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f46977fe640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46980cdfc0 0x7f469814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:45.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4697fff640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46980b1d20 0x7f4698137460 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f468800c480 tx=0x7f468800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:45.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4694ff9640 1 -- 172.21.15.130:0/1732011369 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880074e0 con 0x7f46980b1d20 2023-09-13T06:08:45.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4694ff9640 1 -- 172.21.15.130:0/1732011369 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4688007660 con 0x7f46980b1d20 2023-09-13T06:08:45.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4694ff9640 1 -- 172.21.15.130:0/1732011369 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688004a30 con 0x7f46980b1d20 2023-09-13T06:08:45.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f469e574640 1 -- 172.21.15.130:0/1732011369 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4698155b40 con 0x7f46980b1d20 2023-09-13T06:08:45.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f469e574640 1 -- 172.21.15.130:0/1732011369 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469814b9a0 con 0x7f46980b1d20 2023-09-13T06:08:45.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f469e574640 1 -- 172.21.15.130:0/1732011369 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46980618a0 con 0x7f46980b1d20 2023-09-13T06:08:45.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.907+0000 7f4694ff9640 1 -- 172.21.15.130:0/1732011369 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4688004b90 con 0x7f46980b1d20 2023-09-13T06:08:45.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.911+0000 7f4694ff9640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4684065b20 0x7f4684067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:45.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.911+0000 7f4694ff9640 1 -- 172.21.15.130:0/1732011369 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46880824b0 con 0x7f46980b1d20 2023-09-13T06:08:45.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.911+0000 7f46977fe640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4684065b20 0x7f4684067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:45.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.911+0000 7f46977fe640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4684065b20 0x7f4684067fe0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f469814b280 tx=0x7f468c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:45.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:45.915+0000 7f4694ff9640 1 -- 172.21.15.130:0/1732011369 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4688053920 con 0x7f46980b1d20 2023-09-13T06:08:46.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.095+0000 7f469e574640 1 -- 172.21.15.130:0/1732011369 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46980cd850 con 0x7f46980b1d20 2023-09-13T06:08:46.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.095+0000 7f4694ff9640 1 -- 172.21.15.130:0/1732011369 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f46880534b0 con 0x7f46980b1d20 2023-09-13T06:08:46.099 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:46.099 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2638049185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2638049185},{"type":"v1","addr":"172.21.15.164:6834","nonce":2638049185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/4101999538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4101999538},{"type":"v1","addr":"172.21.15.130:6835","nonce":4101999538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1691911082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1691911082},{"type":"v1","addr":"172.21.15.130:6837","nonce":1691911082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:08:42.026268+0000","modified":"2023-09-13T06:08:45.060479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2618060608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2618060608},{"type":"v1","addr":"172.21.15.164:6835","nonce":2618060608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-09-13T06:08:46.100 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 76 2023-09-13T06:08:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 -- 172.21.15.130:0/1732011369 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4684065b20 msgr2=0x7f4684067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4684065b20 0x7f4684067fe0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f469814b280 tx=0x7f468c008040 comp rx=0 tx=0).stop 2023-09-13T06:08:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 -- 172.21.15.130:0/1732011369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46980b1d20 msgr2=0x7f4698137460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46980b1d20 0x7f4698137460 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f468800c480 tx=0x7f468800c940 comp rx=0 tx=0).stop 2023-09-13T06:08:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 -- 172.21.15.130:0/1732011369 shutdown_connections 2023-09-13T06:08:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4684065b20 0x7f4684067fe0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46980cdfc0 0x7f469814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4698159f20 0x7f4698153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 --2- 172.21.15.130:0/1732011369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46980b1d20 0x7f4698137460 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 -- 172.21.15.130:0/1732011369 >> 172.21.15.130:0/1732011369 conn(0x7f4698065990 msgr2=0x7f4698154a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:46.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 -- 172.21.15.130:0/1732011369 shutdown_connections 2023-09-13T06:08:46.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.099+0000 7f469e574640 1 -- 172.21.15.130:0/1732011369 wait complete. 2023-09-13T06:08:46.120 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:08:46.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.255+0000 7fbbee048640 1 Processor -- start 2023-09-13T06:08:46.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.255+0000 7fbbee048640 1 -- start start 2023-09-13T06:08:46.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.255+0000 7fbbee048640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80b1d20 0x7fbbe80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbee048640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe80ccfd0 con 0x7fbbe8159f20 2023-09-13T06:08:46.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbee048640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe80ced90 con 0x7fbbe80cdfc0 2023-09-13T06:08:46.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbee048640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80ce430 con 0x7fbbe80b1d20 2023-09-13T06:08:46.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe77fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fbbe8159f20 0x7fbbe80b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51064/0 (socket says 172.21.15.130:51064) 2023-09-13T06:08:46.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe77fe640 1 -- 172.21.15.130:0/2889668839 learned_addr learned my addr 172.21.15.130:0/2889668839 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:46.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe6ffd640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80b1d20 0x7fbbe80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930469761 0 0) 0x7fbbe80ccfd0 con 0x7fbbe8159f20 2023-09-13T06:08:46.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd0003530 con 0x7fbbe8159f20 2023-09-13T06:08:46.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1456021939 0 0) 0x7fbbd0003530 con 0x7fbbe8159f20 2023-09-13T06:08:46.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80b1d20 msgr2=0x7fbbe80ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:46.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80b1d20 0x7fbbe80ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 >> v1:172.21.15.164:6789/0 conn(0x7fbbe80cdfc0 legacy=0x7fbbe80ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe80cd200 con 0x7fbbe8159f20 2023-09-13T06:08:46.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fbbd8001680 con 0x7fbbe8159f20 2023-09-13T06:08:46.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 >> v1:172.21.15.130:6789/0 conn(0x7fbbe8159f20 legacy=0x7fbbe80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbd0003a20 0x7fbbd0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80b1d20 0x7fbbd00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbd0004d10 0x7fbbd0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80ce430 con 0x7fbbd0003a20 2023-09-13T06:08:46.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd000ba70 con 0x7fbbd0004d10 2023-09-13T06:08:46.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd000bc30 con 0x7fbbe80b1d20 2023-09-13T06:08:46.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe77fe640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbd0003a20 0x7fbbd0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe7fff640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbd0004d10 0x7fbbd0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe6ffd640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80b1d20 0x7fbbd00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe77fe640 1 -- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80b1d20 msgr2=0x7fbbd00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:46.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe77fe640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80b1d20 0x7fbbd00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe77fe640 1 -- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbd0004d10 msgr2=0x7fbbd0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:46.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe77fe640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbd0004d10 0x7fbbd0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe77fe640 1 -- 172.21.15.130:0/2889668839 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd0003530 con 0x7fbbd0003a20 2023-09-13T06:08:46.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe7fff640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbd0004d10 0x7fbbd0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:46.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.259+0000 7fbbe6ffd640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80b1d20 0x7fbbd00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:46.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbe77fe640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbd0003a20 0x7fbbd0003e00 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800c190 tx=0x7fbbd801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6620b5c7c27b532b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:46.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8005ae0 con 0x7fbbd0003a20 2023-09-13T06:08:46.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd8005c40 con 0x7fbbd0003a20 2023-09-13T06:08:46.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbe67fc640 1 -- 172.21.15.130:0/2889668839 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8007070 con 0x7fbbd0003a20 2023-09-13T06:08:46.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbee048640 1 -- 172.21.15.130:0/2889668839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbd0003a20 msgr2=0x7fbbd0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbee048640 1 --2- 172.21.15.130:0/2889668839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbd0003a20 0x7fbbd0003e00 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800c190 tx=0x7fbbd801cc20 comp rx=0 tx=0).stop 2023-09-13T06:08:46.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbe7fff640 1 -- 172.21.15.130:0/2889668839 reap_dead start 2023-09-13T06:08:46.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbee048640 1 -- 172.21.15.130:0/2889668839 shutdown_connections 2023-09-13T06:08:46.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbee048640 1 -- 172.21.15.130:0/2889668839 >> 172.21.15.130:0/2889668839 conn(0x7fbbe8065990 msgr2=0x7fbbe8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:46.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbee048640 1 -- 172.21.15.130:0/2889668839 shutdown_connections 2023-09-13T06:08:46.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbee048640 1 -- 172.21.15.130:0/2889668839 wait complete. 2023-09-13T06:08:46.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbee048640 1 Processor -- start 2023-09-13T06:08:46.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.263+0000 7fbbee048640 1 -- start start 2023-09-13T06:08:46.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbee048640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbd0003a20 0x7fbbe8142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbee048640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80aaaa0 0x7fbbe80aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbee048640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe81f6fd0 0x7fbbe81f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbee048640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe81f7990 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbee048640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80ab560 con 0x7fbbd0003a20 2023-09-13T06:08:46.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbee048640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80ab840 con 0x7fbbe80aaaa0 2023-09-13T06:08:46.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe81f6fd0 0x7fbbe81f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe81f6fd0 0x7fbbe81f7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57396/0 (socket says 172.21.15.130:57396) 2023-09-13T06:08:46.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe7fff640 1 -- 172.21.15.130:0/1852691338 learned_addr learned my addr 172.21.15.130:0/1852691338 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:46.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe77fe640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbd0003a20 0x7fbbe8142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe6ffd640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80aaaa0 0x7fbbe80aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe7fff640 1 -- 172.21.15.130:0/1852691338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80aaaa0 msgr2=0x7fbbe80aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe7fff640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80aaaa0 0x7fbbe80aaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe7fff640 1 -- 172.21.15.130:0/1852691338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbd0003a20 msgr2=0x7fbbe8142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe7fff640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbd0003a20 0x7fbbe8142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe7fff640 1 -- 172.21.15.130:0/1852691338 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe80abb20 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe77fe640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbd0003a20 0x7fbbe8142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:46.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe6ffd640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80aaaa0 0x7fbbe80aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:46.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbe7fff640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe81f6fd0 0x7fbbe81f7450 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80717f0 tx=0x7fbbe000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:46.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbcffff640 1 -- 172.21.15.130:0/1852691338 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0003980 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbcffff640 1 -- 172.21.15.130:0/1852691338 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe0003ae0 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbcffff640 1 -- 172.21.15.130:0/1852691338 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00050d0 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbee048640 1 -- 172.21.15.130:0/1852691338 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe80abe00 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbee048640 1 -- 172.21.15.130:0/1852691338 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe8143240 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbee048640 1 -- 172.21.15.130:0/1852691338 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe80618a0 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.267+0000 7fbbcffff640 1 -- 172.21.15.130:0/1852691338 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbbe0005230 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.271+0000 7fbbcffff640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbd4065b20 0x7fbbd4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.271+0000 7fbbcffff640 1 -- 172.21.15.130:0/1852691338 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbe0082f20 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.271+0000 7fbbe77fe640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbd4065b20 0x7fbbd4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.271+0000 7fbbe77fe640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbd4065b20 0x7fbbd4067fe0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80ab000 tx=0x7fbbd80a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:46.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.275+0000 7fbbcffff640 1 -- 172.21.15.130:0/1852691338 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbbe00507d0 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.419+0000 7fbbee048640 1 -- 172.21.15.130:0/1852691338 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbe80ae5d0 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbcffff640 1 -- 172.21.15.130:0/1852691338 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+16616 (secure 0 0 0) 0x7fbbe0053df0 con 0x7fbbe81f6fd0 2023-09-13T06:08:46.425 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:46.425 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":155,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:08:43.399179+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:08:40.183838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-09-13T06:08:41.020446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:08:46.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 -- 172.21.15.130:0/1852691338 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbd4065b20 msgr2=0x7fbbd4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbd4065b20 0x7fbbd4067fe0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80ab000 tx=0x7fbbd80a7070 comp rx=0 tx=0).stop 2023-09-13T06:08:46.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 -- 172.21.15.130:0/1852691338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe81f6fd0 msgr2=0x7fbbe81f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe81f6fd0 0x7fbbe81f7450 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80717f0 tx=0x7fbbe000eb90 comp rx=0 tx=0).stop 2023-09-13T06:08:46.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 -- 172.21.15.130:0/1852691338 shutdown_connections 2023-09-13T06:08:46.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fbbd4065b20 0x7fbbd4067fe0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe81f6fd0 0x7fbbe81f7450 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbe80aaaa0 0x7fbbe80aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 --2- 172.21.15.130:0/1852691338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbd0003a20 0x7fbbe8142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 -- 172.21.15.130:0/1852691338 >> 172.21.15.130:0/1852691338 conn(0x7fbbe8065990 msgr2=0x7fbbe80adbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:46.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 -- 172.21.15.130:0/1852691338 shutdown_connections 2023-09-13T06:08:46.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.423+0000 7fbbee048640 1 -- 172.21.15.130:0/1852691338 wait complete. 2023-09-13T06:08:46.446 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T06:08:46.447 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:08:46.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35ed7ad640 1 Processor -- start 2023-09-13T06:08:46.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35ed7ad640 1 -- start start 2023-09-13T06:08:46.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35ed7ad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f35e80d1090 0x7f35e815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35ed7ad640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e80b63c0 con 0x7f35e80d1750 2023-09-13T06:08:46.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35ed7ad640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e80d0c20 con 0x7f35e8146f30 2023-09-13T06:08:46.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35ed7ad640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e815dea0 con 0x7f35e80d1090 2023-09-13T06:08:46.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35e6ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f35e80d1750 0x7f35e8146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51068/0 (socket says 172.21.15.130:51068) 2023-09-13T06:08:46.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35e6ffd640 1 -- 172.21.15.130:0/69695314 learned_addr learned my addr 172.21.15.130:0/69695314 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:46.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35de7fc640 1 --2- 172.21.15.130:0/69695314 >> v2:172.21.15.130:3300/0 conn(0x7f35e80d1090 0x7f35e815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35e67fc640 1 -- 172.21.15.130:0/69695314 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793480687 0 0) 0x7f35e80b63c0 con 0x7f35e80d1750 2023-09-13T06:08:46.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35e67fc640 1 -- 172.21.15.130:0/69695314 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d4003530 con 0x7f35e80d1750 2023-09-13T06:08:46.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35de7fc640 1 -- 172.21.15.130:0/69695314 >> v1:172.21.15.164:6789/0 conn(0x7f35e8146f30 legacy=0x7f35e80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:46.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35de7fc640 1 -- 172.21.15.130:0/69695314 >> v1:172.21.15.130:6789/0 conn(0x7f35e80d1750 legacy=0x7f35e8146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.583+0000 7f35de7fc640 1 -- 172.21.15.130:0/69695314 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80b6610 con 0x7f35e80d1090 2023-09-13T06:08:46.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.587+0000 7f35de7fc640 1 --2- 172.21.15.130:0/69695314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e80d1090 0x7f35e815d960 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f35d00097c0 tx=0x7f35d001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fb7e24aa4230a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:46.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.587+0000 7f35e67fc640 1 -- 172.21.15.130:0/69695314 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d00ac620 con 0x7f35e80d1090 2023-09-13T06:08:46.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.587+0000 7f35e67fc640 1 -- 172.21.15.130:0/69695314 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d00ac780 con 0x7f35e80d1090 2023-09-13T06:08:46.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.587+0000 7f35e67fc640 1 -- 172.21.15.130:0/69695314 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d00acb10 con 0x7f35e80d1090 2023-09-13T06:08:46.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.587+0000 7f35ed7ad640 1 -- 172.21.15.130:0/69695314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e80d1090 msgr2=0x7f35e815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.587+0000 7f35ed7ad640 1 --2- 172.21.15.130:0/69695314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e80d1090 0x7f35e815d960 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f35d00097c0 tx=0x7f35d001c3c0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.587+0000 7f35ed7ad640 1 -- 172.21.15.130:0/69695314 shutdown_connections 2023-09-13T06:08:46.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.587+0000 7f35ed7ad640 1 --2- 172.21.15.130:0/69695314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e80d1090 0x7f35e815d960 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.587+0000 7f35ed7ad640 1 -- 172.21.15.130:0/69695314 >> 172.21.15.130:0/69695314 conn(0x7f35e806f170 msgr2=0x7f35e806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:46.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.587+0000 7f35ed7ad640 1 -- 172.21.15.130:0/69695314 shutdown_connections 2023-09-13T06:08:46.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.587+0000 7f35ed7ad640 1 -- 172.21.15.130:0/69695314 wait complete. 2023-09-13T06:08:46.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35ed7ad640 1 Processor -- start 2023-09-13T06:08:46.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35ed7ad640 1 -- start start 2023-09-13T06:08:46.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35ed7ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e80d1090 0x7f35e8152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35ed7ad640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35e80d1750 0x7f35e81590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35ed7ad640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e8146f30 0x7f35e8156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35ed7ad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e815c900 con 0x7f35e80d1090 2023-09-13T06:08:46.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35ed7ad640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e81583b0 con 0x7f35e8146f30 2023-09-13T06:08:46.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35ed7ad640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e81577a0 con 0x7f35e80d1750 2023-09-13T06:08:46.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e80d1090 0x7f35e8152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e80d1090 0x7f35e8152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57410/0 (socket says 172.21.15.130:57410) 2023-09-13T06:08:46.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35e6ffd640 1 -- 172.21.15.130:0/933830455 learned_addr learned my addr 172.21.15.130:0/933830455 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:46.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35de7fc640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35e80d1750 0x7f35e81590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35e77fe640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e8146f30 0x7f35e8156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35e6ffd640 1 -- 172.21.15.130:0/933830455 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35e80d1750 msgr2=0x7f35e81590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35e6ffd640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35e80d1750 0x7f35e81590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35e6ffd640 1 -- 172.21.15.130:0/933830455 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e8146f30 msgr2=0x7f35e8156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35e6ffd640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e8146f30 0x7f35e8156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35e6ffd640 1 -- 172.21.15.130:0/933830455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0009420 con 0x7f35e80d1090 2023-09-13T06:08:46.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35de7fc640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35e80d1750 0x7f35e81590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:46.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35e6ffd640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e80d1090 0x7f35e8152890 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f35d800c4d0 tx=0x7f35d800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:46.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35dffff640 1 -- 172.21.15.130:0/933830455 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8005cf0 con 0x7f35e80d1090 2023-09-13T06:08:46.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35dffff640 1 -- 172.21.15.130:0/933830455 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d8005e50 con 0x7f35e80d1090 2023-09-13T06:08:46.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35ed7ad640 1 -- 172.21.15.130:0/933830455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e8157a80 con 0x7f35e80d1090 2023-09-13T06:08:46.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35dffff640 1 -- 172.21.15.130:0/933830455 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8007270 con 0x7f35e80d1090 2023-09-13T06:08:46.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.591+0000 7f35ed7ad640 1 -- 172.21.15.130:0/933830455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e8158040 con 0x7f35e80d1090 2023-09-13T06:08:46.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.595+0000 7f35ed7ad640 1 -- 172.21.15.130:0/933830455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e80618a0 con 0x7f35e80d1090 2023-09-13T06:08:46.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.595+0000 7f35dffff640 1 -- 172.21.15.130:0/933830455 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f35d80073d0 con 0x7f35e80d1090 2023-09-13T06:08:46.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.595+0000 7f35dffff640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35c8065b20 0x7f35c8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.595+0000 7f35dffff640 1 -- 172.21.15.130:0/933830455 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35d80828c0 con 0x7f35e80d1090 2023-09-13T06:08:46.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.595+0000 7f35de7fc640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35c8065b20 0x7f35c8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.595+0000 7f35de7fc640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35c8065b20 0x7f35c8067fe0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f35d00ae000 tx=0x7f35d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:46.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.599+0000 7f35dffff640 1 -- 172.21.15.130:0/933830455 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f35d8050220 con 0x7f35e80d1090 2023-09-13T06:08:46.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.747+0000 7f35ed7ad640 1 -- 172.21.15.130:0/933830455 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35e80b7800 con 0x7f35c8065b20 2023-09-13T06:08:46.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.755+0000 7f35dffff640 1 -- 172.21.15.130:0/933830455 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284865 (secure 0 0 0) 0x7f35d00ab3c0 con 0x7f35c8065b20 2023-09-13T06:08:46.759 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:46.761 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:08:46.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 -- 172.21.15.130:0/933830455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35c8065b20 msgr2=0x7f35c8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35c8065b20 0x7f35c8067fe0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f35d00ae000 tx=0x7f35d0008040 comp rx=0 tx=0).stop 2023-09-13T06:08:46.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 -- 172.21.15.130:0/933830455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e80d1090 msgr2=0x7f35e8152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e80d1090 0x7f35e8152890 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f35d800c4d0 tx=0x7f35d800c990 comp rx=0 tx=0).stop 2023-09-13T06:08:46.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 -- 172.21.15.130:0/933830455 shutdown_connections 2023-09-13T06:08:46.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f35c8065b20 0x7f35c8067fe0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35e8146f30 0x7f35e8156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f35e80d1750 0x7f35e81590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 --2- 172.21.15.130:0/933830455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35e80d1090 0x7f35e8152890 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 -- 172.21.15.130:0/933830455 >> 172.21.15.130:0/933830455 conn(0x7f35e806f170 msgr2=0x7f35e80cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:46.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 -- 172.21.15.130:0/933830455 shutdown_connections 2023-09-13T06:08:46.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.759+0000 7f35ed7ad640 1 -- 172.21.15.130:0/933830455 wait complete. 2023-09-13T06:08:46.779 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2023-09-13T06:08:46.628313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7901,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554598,"statfs":{"total":1600000000,"available":1591909340,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.990683"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.414664+0000","last_change":"2023-09-13T06:08:42.414594+0000","last_active":"2023-09-13T06:08:42.414664+0000","last_peered":"2023-09-13T06:08:42.414664+0000","last_clean":"2023-09-13T06:08:42.414664+0000","last_became_active":"2023-09-13T06:08:42.414091+0000","last_became_peered":"2023-09-13T06:08:42.414091+0000","last_unstale":"2023-09-13T06:08:42.414664+0000","last_undegraded":"2023-09-13T06:08:42.414664+0000","last_fullsized":"2023-09-13T06:08:42.414664+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:46.541402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.412574+0000","last_change":"2023-09-13T06:08:42.412529+0000","last_active":"2023-09-13T06:08:42.412574+0000","last_peered":"2023-09-13T06:08:42.412574+0000","last_clean":"2023-09-13T06:08:42.412574+0000","last_became_active":"2023-09-13T06:08:42.412290+0000","last_became_peered":"2023-09-13T06:08:42.412290+0000","last_unstale":"2023-09-13T06:08:42.412574+0000","last_undegraded":"2023-09-13T06:08:42.412574+0000","last_fullsized":"2023-09-13T06:08:42.412574+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:25:21.723169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.415862+0000","last_change":"2023-09-13T06:08:42.415564+0000","last_active":"2023-09-13T06:08:42.415862+0000","last_peered":"2023-09-13T06:08:42.415862+0000","last_clean":"2023-09-13T06:08:42.415862+0000","last_became_active":"2023-09-13T06:08:42.413942+0000","last_became_peered":"2023-09-13T06:08:42.413942+0000","last_unstale":"2023-09-13T06:08:42.415862+0000","last_undegraded":"2023-09-13T06:08:42.415862+0000","last_fullsized":"2023-09-13T06:08:42.415862+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:43:19.777929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413783+0000","last_change":"2023-09-13T06:08:42.413691+0000","last_active":"2023-09-13T06:08:42.413783+0000","last_peered":"2023-09-13T06:08:42.413783+0000","last_clean":"2023-09-13T06:08:42.413783+0000","last_became_active":"2023-09-13T06:08:42.413421+0000","last_became_peered":"2023-09-13T06:08:42.413421+0000","last_unstale":"2023-09-13T06:08:42.413783+0000","last_undegraded":"2023-09-13T06:08:42.413783+0000","last_fullsized":"2023-09-13T06:08:42.413783+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:49:56.371062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410582+0000","last_change":"2023-09-13T06:08:42.404646+0000","last_active":"2023-09-13T06:08:43.410582+0000","last_peered":"2023-09-13T06:08:43.410582+0000","last_clean":"2023-09-13T06:08:43.410582+0000","last_became_active":"2023-09-13T06:08:42.404374+0000","last_became_peered":"2023-09-13T06:08:42.404374+0000","last_unstale":"2023-09-13T06:08:43.410582+0000","last_undegraded":"2023-09-13T06:08:43.410582+0000","last_fullsized":"2023-09-13T06:08:43.410582+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:50:00.610064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406661+0000","last_change":"2023-09-13T06:08:42.418526+0000","last_active":"2023-09-13T06:08:43.406661+0000","last_peered":"2023-09-13T06:08:43.406661+0000","last_clean":"2023-09-13T06:08:43.406661+0000","last_became_active":"2023-09-13T06:08:42.418046+0000","last_became_peered":"2023-09-13T06:08:42.418046+0000","last_unstale":"2023-09-13T06:08:43.406661+0000","last_undegraded":"2023-09-13T06:08:43.406661+0000","last_fullsized":"2023-09-13T06:08:43.406661+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:32:25.906643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406792+0000","last_change":"2023-09-13T06:08:42.420244+0000","last_active":"2023-09-13T06:08:43.406792+0000","last_peered":"2023-09-13T06:08:43.406792+0000","last_clean":"2023-09-13T06:08:43.406792+0000","last_became_active":"2023-09-13T06:08:42.419388+0000","last_became_peered":"2023-09-13T06:08:42.419388+0000","last_unstale":"2023-09-13T06:08:43.406792+0000","last_undegraded":"2023-09-13T06:08:43.406792+0000","last_fullsized":"2023-09-13T06:08:43.406792+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:19.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.417148+0000","last_change":"2023-09-13T06:08:42.417053+0000","last_active":"2023-09-13T06:08:42.417148+0000","last_peered":"2023-09-13T06:08:42.417148+0000","last_clean":"2023-09-13T06:08:42.417148+0000","last_became_active":"2023-09-13T06:08:42.415215+0000","last_became_peered":"2023-09-13T06:08:42.415215+0000","last_unstale":"2023-09-13T06:08:42.417148+0000","last_undegraded":"2023-09-13T06:08:42.417148+0000","last_fullsized":"2023-09-13T06:08:42.417148+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:03:00.611766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413620+0000","last_change":"2023-09-13T06:08:42.413362+0000","last_active":"2023-09-13T06:08:42.413620+0000","last_peered":"2023-09-13T06:08:42.413620+0000","last_clean":"2023-09-13T06:08:42.413620+0000","last_became_active":"2023-09-13T06:08:42.413091+0000","last_became_peered":"2023-09-13T06:08:42.413091+0000","last_unstale":"2023-09-13T06:08:42.413620+0000","last_undegraded":"2023-09-13T06:08:42.413620+0000","last_fullsized":"2023-09-13T06:08:42.413620+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:04:04.419844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411768+0000","last_change":"2023-09-13T06:08:42.411576+0000","last_active":"2023-09-13T06:08:42.411768+0000","last_peered":"2023-09-13T06:08:42.411768+0000","last_clean":"2023-09-13T06:08:42.411768+0000","last_became_active":"2023-09-13T06:08:42.410808+0000","last_became_peered":"2023-09-13T06:08:42.410808+0000","last_unstale":"2023-09-13T06:08:42.411768+0000","last_undegraded":"2023-09-13T06:08:42.411768+0000","last_fullsized":"2023-09-13T06:08:42.411768+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:52:07.525075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.406265+0000","last_change":"2023-09-13T06:08:42.406217+0000","last_active":"2023-09-13T06:08:42.406265+0000","last_peered":"2023-09-13T06:08:42.406265+0000","last_clean":"2023-09-13T06:08:42.406265+0000","last_became_active":"2023-09-13T06:08:42.405942+0000","last_became_peered":"2023-09-13T06:08:42.405942+0000","last_unstale":"2023-09-13T06:08:42.406265+0000","last_undegraded":"2023-09-13T06:08:42.406265+0000","last_fullsized":"2023-09-13T06:08:42.406265+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:46:12.907659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413591+0000","last_change":"2023-09-13T06:08:42.413331+0000","last_active":"2023-09-13T06:08:42.413591+0000","last_peered":"2023-09-13T06:08:42.413591+0000","last_clean":"2023-09-13T06:08:42.413591+0000","last_became_active":"2023-09-13T06:08:42.413059+0000","last_became_peered":"2023-09-13T06:08:42.413059+0000","last_unstale":"2023-09-13T06:08:42.413591+0000","last_undegraded":"2023-09-13T06:08:42.413591+0000","last_fullsized":"2023-09-13T06:08:42.413591+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:37:26.564665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411394+0000","last_change":"2023-09-13T06:08:42.410551+0000","last_active":"2023-09-13T06:08:42.411394+0000","last_peered":"2023-09-13T06:08:42.411394+0000","last_clean":"2023-09-13T06:08:42.411394+0000","last_became_active":"2023-09-13T06:08:42.410266+0000","last_became_peered":"2023-09-13T06:08:42.410266+0000","last_unstale":"2023-09-13T06:08:42.411394+0000","last_undegraded":"2023-09-13T06:08:42.411394+0000","last_fullsized":"2023-09-13T06:08:42.411394+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:48:08.746602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.412554+0000","last_change":"2023-09-13T06:08:42.412475+0000","last_active":"2023-09-13T06:08:42.412554+0000","last_peered":"2023-09-13T06:08:42.412554+0000","last_clean":"2023-09-13T06:08:42.412554+0000","last_became_active":"2023-09-13T06:08:42.412239+0000","last_became_peered":"2023-09-13T06:08:42.412239+0000","last_unstale":"2023-09-13T06:08:42.412554+0000","last_undegraded":"2023-09-13T06:08:42.412554+0000","last_fullsized":"2023-09-13T06:08:42.412554+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:50:16.270083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.415983+0000","last_change":"2023-09-13T06:08:42.415922+0000","last_active":"2023-09-13T06:08:42.415983+0000","last_peered":"2023-09-13T06:08:42.415983+0000","last_clean":"2023-09-13T06:08:42.415983+0000","last_became_active":"2023-09-13T06:08:42.415416+0000","last_became_peered":"2023-09-13T06:08:42.415416+0000","last_unstale":"2023-09-13T06:08:42.415983+0000","last_undegraded":"2023-09-13T06:08:42.415983+0000","last_fullsized":"2023-09-13T06:08:42.415983+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:55:13.573431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413763+0000","last_change":"2023-09-13T06:08:42.413707+0000","last_active":"2023-09-13T06:08:42.413763+0000","last_peered":"2023-09-13T06:08:42.413763+0000","last_clean":"2023-09-13T06:08:42.413763+0000","last_became_active":"2023-09-13T06:08:42.413238+0000","last_became_peered":"2023-09-13T06:08:42.413238+0000","last_unstale":"2023-09-13T06:08:42.413763+0000","last_undegraded":"2023-09-13T06:08:42.413763+0000","last_fullsized":"2023-09-13T06:08:42.413763+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:36:03.743621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.407051+0000","last_change":"2023-09-13T06:08:42.419924+0000","last_active":"2023-09-13T06:08:43.407051+0000","last_peered":"2023-09-13T06:08:43.407051+0000","last_clean":"2023-09-13T06:08:43.407051+0000","last_became_active":"2023-09-13T06:08:42.418628+0000","last_became_peered":"2023-09-13T06:08:42.418628+0000","last_unstale":"2023-09-13T06:08:43.407051+0000","last_undegraded":"2023-09-13T06:08:43.407051+0000","last_fullsized":"2023-09-13T06:08:43.407051+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:23:27.173378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411791+0000","last_change":"2023-09-13T06:08:42.411700+0000","last_active":"2023-09-13T06:08:42.411791+0000","last_peered":"2023-09-13T06:08:42.411791+0000","last_clean":"2023-09-13T06:08:42.411791+0000","last_became_active":"2023-09-13T06:08:42.410917+0000","last_became_peered":"2023-09-13T06:08:42.410917+0000","last_unstale":"2023-09-13T06:08:42.411791+0000","last_undegraded":"2023-09-13T06:08:42.411791+0000","last_fullsized":"2023-09-13T06:08:42.411791+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:06:51.353638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.409217+0000","last_change":"2023-09-13T06:08:42.409147+0000","last_active":"2023-09-13T06:08:42.409217+0000","last_peered":"2023-09-13T06:08:42.409217+0000","last_clean":"2023-09-13T06:08:42.409217+0000","last_became_active":"2023-09-13T06:08:42.408903+0000","last_became_peered":"2023-09-13T06:08:42.408903+0000","last_unstale":"2023-09-13T06:08:42.409217+0000","last_undegraded":"2023-09-13T06:08:42.409217+0000","last_fullsized":"2023-09-13T06:08:42.409217+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:12:18.102557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.405683+0000","last_change":"2023-09-13T06:08:42.405556+0000","last_active":"2023-09-13T06:08:42.405683+0000","last_peered":"2023-09-13T06:08:42.405683+0000","last_clean":"2023-09-13T06:08:42.405683+0000","last_became_active":"2023-09-13T06:08:42.405269+0000","last_became_peered":"2023-09-13T06:08:42.405269+0000","last_unstale":"2023-09-13T06:08:42.405683+0000","last_undegraded":"2023-09-13T06:08:42.405683+0000","last_fullsized":"2023-09-13T06:08:42.405683+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:02:59.212781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410840+0000","last_change":"2023-09-13T06:08:42.411740+0000","last_active":"2023-09-13T06:08:43.410840+0000","last_peered":"2023-09-13T06:08:43.410840+0000","last_clean":"2023-09-13T06:08:43.410840+0000","last_became_active":"2023-09-13T06:08:42.411508+0000","last_became_peered":"2023-09-13T06:08:42.411508+0000","last_unstale":"2023-09-13T06:08:43.410840+0000","last_undegraded":"2023-09-13T06:08:43.410840+0000","last_fullsized":"2023-09-13T06:08:43.410840+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:25:45.735630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.406249+0000","last_change":"2023-09-13T06:08:42.406181+0000","last_active":"2023-09-13T06:08:42.406249+0000","last_peered":"2023-09-13T06:08:42.406249+0000","last_clean":"2023-09-13T06:08:42.406249+0000","last_became_active":"2023-09-13T06:08:42.405952+0000","last_became_peered":"2023-09-13T06:08:42.405952+0000","last_unstale":"2023-09-13T06:08:42.406249+0000","last_undegraded":"2023-09-13T06:08:42.406249+0000","last_fullsized":"2023-09-13T06:08:42.406249+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:23:24.503135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.416356+0000","last_change":"2023-09-13T06:08:42.416263+0000","last_active":"2023-09-13T06:08:42.416356+0000","last_peered":"2023-09-13T06:08:42.416356+0000","last_clean":"2023-09-13T06:08:42.416356+0000","last_became_active":"2023-09-13T06:08:42.414325+0000","last_became_peered":"2023-09-13T06:08:42.414325+0000","last_unstale":"2023-09-13T06:08:42.416356+0000","last_undegraded":"2023-09-13T06:08:42.416356+0000","last_fullsized":"2023-09-13T06:08:42.416356+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:25:18.573622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.408288+0000","last_change":"2023-09-13T06:08:42.408221+0000","last_active":"2023-09-13T06:08:42.408288+0000","last_peered":"2023-09-13T06:08:42.408288+0000","last_clean":"2023-09-13T06:08:42.408288+0000","last_became_active":"2023-09-13T06:08:42.408000+0000","last_became_peered":"2023-09-13T06:08:42.408000+0000","last_unstale":"2023-09-13T06:08:42.408288+0000","last_undegraded":"2023-09-13T06:08:42.408288+0000","last_fullsized":"2023-09-13T06:08:42.408288+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:10:55.652139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411528+0000","last_change":"2023-09-13T06:08:42.411422+0000","last_active":"2023-09-13T06:08:42.411528+0000","last_peered":"2023-09-13T06:08:42.411528+0000","last_clean":"2023-09-13T06:08:42.411528+0000","last_became_active":"2023-09-13T06:08:42.410509+0000","last_became_peered":"2023-09-13T06:08:42.410509+0000","last_unstale":"2023-09-13T06:08:42.411528+0000","last_undegraded":"2023-09-13T06:08:42.411528+0000","last_fullsized":"2023-09-13T06:08:42.411528+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:12.672357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413639+0000","last_change":"2023-09-13T06:08:42.413573+0000","last_active":"2023-09-13T06:08:42.413639+0000","last_peered":"2023-09-13T06:08:42.413639+0000","last_clean":"2023-09-13T06:08:42.413639+0000","last_became_active":"2023-09-13T06:08:42.412918+0000","last_became_peered":"2023-09-13T06:08:42.412918+0000","last_unstale":"2023-09-13T06:08:42.413639+0000","last_undegraded":"2023-09-13T06:08:42.413639+0000","last_fullsized":"2023-09-13T06:08:42.413639+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:46:11.972388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.420883+0000","last_change":"2023-09-13T06:08:42.420837+0000","last_active":"2023-09-13T06:08:42.420883+0000","last_peered":"2023-09-13T06:08:42.420883+0000","last_clean":"2023-09-13T06:08:42.420883+0000","last_became_active":"2023-09-13T06:08:42.420712+0000","last_became_peered":"2023-09-13T06:08:42.420712+0000","last_unstale":"2023-09-13T06:08:42.420883+0000","last_undegraded":"2023-09-13T06:08:42.420883+0000","last_fullsized":"2023-09-13T06:08:42.420883+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:19:07.900510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413052+0000","last_change":"2023-09-13T06:08:42.406156+0000","last_active":"2023-09-13T06:08:43.413052+0000","last_peered":"2023-09-13T06:08:43.413052+0000","last_clean":"2023-09-13T06:08:43.413052+0000","last_became_active":"2023-09-13T06:08:42.405896+0000","last_became_peered":"2023-09-13T06:08:42.405896+0000","last_unstale":"2023-09-13T06:08:43.413052+0000","last_undegraded":"2023-09-13T06:08:43.413052+0000","last_fullsized":"2023-09-13T06:08:43.413052+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:31:02.386505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413294+0000","last_change":"2023-09-13T06:08:42.413206+0000","last_active":"2023-09-13T06:08:42.413294+0000","last_peered":"2023-09-13T06:08:42.413294+0000","last_clean":"2023-09-13T06:08:42.413294+0000","last_became_active":"2023-09-13T06:08:42.412963+0000","last_became_peered":"2023-09-13T06:08:42.412963+0000","last_unstale":"2023-09-13T06:08:42.413294+0000","last_undegraded":"2023-09-13T06:08:42.413294+0000","last_fullsized":"2023-09-13T06:08:42.413294+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:05:19.372490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.415912+0000","last_change":"2023-09-13T06:08:42.415773+0000","last_active":"2023-09-13T06:08:42.415912+0000","last_peered":"2023-09-13T06:08:42.415912+0000","last_clean":"2023-09-13T06:08:42.415912+0000","last_became_active":"2023-09-13T06:08:42.415064+0000","last_became_peered":"2023-09-13T06:08:42.415064+0000","last_unstale":"2023-09-13T06:08:42.415912+0000","last_undegraded":"2023-09-13T06:08:42.415912+0000","last_fullsized":"2023-09-13T06:08:42.415912+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:00:22.342329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410343+0000","last_change":"2023-09-13T06:08:42.413675+0000","last_active":"2023-09-13T06:08:43.410343+0000","last_peered":"2023-09-13T06:08:43.410343+0000","last_clean":"2023-09-13T06:08:43.410343+0000","last_became_active":"2023-09-13T06:08:42.413263+0000","last_became_peered":"2023-09-13T06:08:42.413263+0000","last_unstale":"2023-09-13T06:08:43.410343+0000","last_undegraded":"2023-09-13T06:08:43.410343+0000","last_fullsized":"2023-09-13T06:08:43.410343+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:56:35.237222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406931+0000","last_change":"2023-09-13T06:08:42.419666+0000","last_active":"2023-09-13T06:08:43.406931+0000","last_peered":"2023-09-13T06:08:43.406931+0000","last_clean":"2023-09-13T06:08:43.406931+0000","last_became_active":"2023-09-13T06:08:42.417622+0000","last_became_peered":"2023-09-13T06:08:42.417622+0000","last_unstale":"2023-09-13T06:08:43.406931+0000","last_undegraded":"2023-09-13T06:08:43.406931+0000","last_fullsized":"2023-09-13T06:08:43.406931+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:45:53.231561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.408109+0000","last_change":"2023-09-13T06:08:42.407917+0000","last_active":"2023-09-13T06:08:42.408109+0000","last_peered":"2023-09-13T06:08:42.408109+0000","last_clean":"2023-09-13T06:08:42.408109+0000","last_became_active":"2023-09-13T06:08:42.407365+0000","last_became_peered":"2023-09-13T06:08:42.407365+0000","last_unstale":"2023-09-13T06:08:42.408109+0000","last_undegraded":"2023-09-13T06:08:42.408109+0000","last_fullsized":"2023-09-13T06:08:42.408109+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:07:50.392665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"154'4","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410513+0000","last_change":"2023-09-13T06:08:41.656637+0000","last_active":"2023-09-13T06:08:43.410513+0000","last_peered":"2023-09-13T06:08:43.410513+0000","last_clean":"2023-09-13T06:08:43.410513+0000","last_became_active":"2023-09-13T06:08:41.656400+0000","last_became_peered":"2023-09-13T06:08:41.656400+0000","last_unstale":"2023-09-13T06:08:43.410513+0000","last_undegraded":"2023-09-13T06:08:43.410513+0000","last_fullsized":"2023-09-13T06:08:43.410513+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:18.178803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.416784+0000","last_change":"2023-09-13T06:08:42.416609+0000","last_active":"2023-09-13T06:08:42.416784+0000","last_peered":"2023-09-13T06:08:42.416784+0000","last_clean":"2023-09-13T06:08:42.416784+0000","last_became_active":"2023-09-13T06:08:42.414848+0000","last_became_peered":"2023-09-13T06:08:42.414848+0000","last_unstale":"2023-09-13T06:08:42.416784+0000","last_undegraded":"2023-09-13T06:08:42.416784+0000","last_fullsized":"2023-09-13T06:08:42.416784+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:11:07.112195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"154'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413247+0000","last_change":"2023-09-13T06:08:41.651586+0000","last_active":"2023-09-13T06:08:43.413247+0000","last_peered":"2023-09-13T06:08:43.413247+0000","last_clean":"2023-09-13T06:08:43.413247+0000","last_became_active":"2023-09-13T06:08:41.651292+0000","last_became_peered":"2023-09-13T06:08:41.651292+0000","last_unstale":"2023-09-13T06:08:43.413247+0000","last_undegraded":"2023-09-13T06:08:43.413247+0000","last_fullsized":"2023-09-13T06:08:43.413247+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:39:01.793594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410526+0000","last_change":"2023-09-13T06:08:42.409900+0000","last_active":"2023-09-13T06:08:43.410526+0000","last_peered":"2023-09-13T06:08:43.410526+0000","last_clean":"2023-09-13T06:08:43.410526+0000","last_became_active":"2023-09-13T06:08:42.409655+0000","last_became_peered":"2023-09-13T06:08:42.409655+0000","last_unstale":"2023-09-13T06:08:43.410526+0000","last_undegraded":"2023-09-13T06:08:43.410526+0000","last_fullsized":"2023-09-13T06:08:43.410526+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:38:08.475495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"154'2","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.671250+0000","last_change":"2023-09-13T06:08:41.652735+0000","last_active":"2023-09-13T06:08:42.671250+0000","last_peered":"2023-09-13T06:08:42.671250+0000","last_clean":"2023-09-13T06:08:42.671250+0000","last_became_active":"2023-09-13T06:08:41.652503+0000","last_became_peered":"2023-09-13T06:08:41.652503+0000","last_unstale":"2023-09-13T06:08:42.671250+0000","last_undegraded":"2023-09-13T06:08:42.671250+0000","last_fullsized":"2023-09-13T06:08:42.671250+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:15:34.317452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410672+0000","last_change":"2023-09-13T06:08:42.411880+0000","last_active":"2023-09-13T06:08:43.410672+0000","last_peered":"2023-09-13T06:08:43.410672+0000","last_clean":"2023-09-13T06:08:43.410672+0000","last_became_active":"2023-09-13T06:08:42.411630+0000","last_became_peered":"2023-09-13T06:08:42.411630+0000","last_unstale":"2023-09-13T06:08:43.410672+0000","last_undegraded":"2023-09-13T06:08:43.410672+0000","last_fullsized":"2023-09-13T06:08:43.410672+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:42:10.314667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"154'2","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.671200+0000","last_change":"2023-09-13T06:08:41.651425+0000","last_active":"2023-09-13T06:08:42.671200+0000","last_peered":"2023-09-13T06:08:42.671200+0000","last_clean":"2023-09-13T06:08:42.671200+0000","last_became_active":"2023-09-13T06:08:41.651026+0000","last_became_peered":"2023-09-13T06:08:41.651026+0000","last_unstale":"2023-09-13T06:08:42.671200+0000","last_undegraded":"2023-09-13T06:08:42.671200+0000","last_fullsized":"2023-09-13T06:08:42.671200+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:42:05.854999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411759+0000","last_change":"2023-09-13T06:08:42.411139+0000","last_active":"2023-09-13T06:08:42.411759+0000","last_peered":"2023-09-13T06:08:42.411759+0000","last_clean":"2023-09-13T06:08:42.411759+0000","last_became_active":"2023-09-13T06:08:42.410538+0000","last_became_peered":"2023-09-13T06:08:42.410538+0000","last_unstale":"2023-09-13T06:08:42.411759+0000","last_undegraded":"2023-09-13T06:08:42.411759+0000","last_fullsized":"2023-09-13T06:08:42.411759+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:12:43.475237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"154'1","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.669985+0000","last_change":"2023-09-13T06:08:41.653311+0000","last_active":"2023-09-13T06:08:42.669985+0000","last_peered":"2023-09-13T06:08:42.669985+0000","last_clean":"2023-09-13T06:08:42.669985+0000","last_became_active":"2023-09-13T06:08:41.652792+0000","last_became_peered":"2023-09-13T06:08:41.652792+0000","last_unstale":"2023-09-13T06:08:42.669985+0000","last_undegraded":"2023-09-13T06:08:42.669985+0000","last_fullsized":"2023-09-13T06:08:42.669985+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:12:47.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.407169+0000","last_change":"2023-09-13T06:08:42.420031+0000","last_active":"2023-09-13T06:08:43.407169+0000","last_peered":"2023-09-13T06:08:43.407169+0000","last_clean":"2023-09-13T06:08:43.407169+0000","last_became_active":"2023-09-13T06:08:42.418903+0000","last_became_peered":"2023-09-13T06:08:42.418903+0000","last_unstale":"2023-09-13T06:08:43.407169+0000","last_undegraded":"2023-09-13T06:08:43.407169+0000","last_fullsized":"2023-09-13T06:08:43.407169+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:27.629327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"154'1","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.671742+0000","last_change":"2023-09-13T06:08:41.649545+0000","last_active":"2023-09-13T06:08:42.671742+0000","last_peered":"2023-09-13T06:08:42.671742+0000","last_clean":"2023-09-13T06:08:42.671742+0000","last_became_active":"2023-09-13T06:08:41.649325+0000","last_became_peered":"2023-09-13T06:08:41.649325+0000","last_unstale":"2023-09-13T06:08:42.671742+0000","last_undegraded":"2023-09-13T06:08:42.671742+0000","last_fullsized":"2023-09-13T06:08:42.671742+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:09:28.485978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411129+0000","last_change":"2023-09-13T06:08:42.410380+0000","last_active":"2023-09-13T06:08:42.411129+0000","last_peered":"2023-09-13T06:08:42.411129+0000","last_clean":"2023-09-13T06:08:42.411129+0000","last_became_active":"2023-09-13T06:08:42.410118+0000","last_became_peered":"2023-09-13T06:08:42.410118+0000","last_unstale":"2023-09-13T06:08:42.411129+0000","last_undegraded":"2023-09-13T06:08:42.411129+0000","last_fullsized":"2023-09-13T06:08:42.411129+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:59:41.814253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406731+0000","last_change":"2023-09-13T06:08:41.655889+0000","last_active":"2023-09-13T06:08:43.406731+0000","last_peered":"2023-09-13T06:08:43.406731+0000","last_clean":"2023-09-13T06:08:43.406731+0000","last_became_active":"2023-09-13T06:08:41.655656+0000","last_became_peered":"2023-09-13T06:08:41.655656+0000","last_unstale":"2023-09-13T06:08:43.406731+0000","last_undegraded":"2023-09-13T06:08:43.406731+0000","last_fullsized":"2023-09-13T06:08:43.406731+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:44:25.754787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.406309+0000","last_change":"2023-09-13T06:08:42.406244+0000","last_active":"2023-09-13T06:08:42.406309+0000","last_peered":"2023-09-13T06:08:42.406309+0000","last_clean":"2023-09-13T06:08:42.406309+0000","last_became_active":"2023-09-13T06:08:42.405945+0000","last_became_peered":"2023-09-13T06:08:42.405945+0000","last_unstale":"2023-09-13T06:08:42.406309+0000","last_undegraded":"2023-09-13T06:08:42.406309+0000","last_fullsized":"2023-09-13T06:08:42.406309+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:28:53.785502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.404695+0000","last_change":"2023-09-13T06:08:41.656185+0000","last_active":"2023-09-13T06:08:42.404695+0000","last_peered":"2023-09-13T06:08:42.404695+0000","last_clean":"2023-09-13T06:08:42.404695+0000","last_became_active":"2023-09-13T06:08:41.655967+0000","last_became_peered":"2023-09-13T06:08:41.655967+0000","last_unstale":"2023-09-13T06:08:42.404695+0000","last_undegraded":"2023-09-13T06:08:42.404695+0000","last_fullsized":"2023-09-13T06:08:42.404695+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:10:58.933914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.412466+0000","last_change":"2023-09-13T06:08:42.412378+0000","last_active":"2023-09-13T06:08:42.412466+0000","last_peered":"2023-09-13T06:08:42.412466+0000","last_clean":"2023-09-13T06:08:42.412466+0000","last_became_active":"2023-09-13T06:08:42.412158+0000","last_became_peered":"2023-09-13T06:08:42.412158+0000","last_unstale":"2023-09-13T06:08:42.412466+0000","last_undegraded":"2023-09-13T06:08:42.412466+0000","last_fullsized":"2023-09-13T06:08:42.412466+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:39:48.939821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413317+0000","last_change":"2023-09-13T06:08:41.655684+0000","last_active":"2023-09-13T06:08:43.413317+0000","last_peered":"2023-09-13T06:08:43.413317+0000","last_clean":"2023-09-13T06:08:43.413317+0000","last_became_active":"2023-09-13T06:08:41.655273+0000","last_became_peered":"2023-09-13T06:08:41.655273+0000","last_unstale":"2023-09-13T06:08:43.413317+0000","last_undegraded":"2023-09-13T06:08:43.413317+0000","last_fullsized":"2023-09-13T06:08:43.413317+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:17:14.437223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413222+0000","last_change":"2023-09-13T06:08:42.412128+0000","last_active":"2023-09-13T06:08:43.413222+0000","last_peered":"2023-09-13T06:08:43.413222+0000","last_clean":"2023-09-13T06:08:43.413222+0000","last_became_active":"2023-09-13T06:08:42.411871+0000","last_became_peered":"2023-09-13T06:08:42.411871+0000","last_unstale":"2023-09-13T06:08:43.413222+0000","last_undegraded":"2023-09-13T06:08:43.413222+0000","last_fullsized":"2023-09-13T06:08:43.413222+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:15:38.711696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.400399+0000","last_change":"2023-09-13T06:08:41.655945+0000","last_active":"2023-09-13T06:08:42.400399+0000","last_peered":"2023-09-13T06:08:42.400399+0000","last_clean":"2023-09-13T06:08:42.400399+0000","last_became_active":"2023-09-13T06:08:41.655528+0000","last_became_peered":"2023-09-13T06:08:41.655528+0000","last_unstale":"2023-09-13T06:08:42.400399+0000","last_undegraded":"2023-09-13T06:08:42.400399+0000","last_fullsized":"2023-09-13T06:08:42.400399+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:37.260030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410560+0000","last_change":"2023-09-13T06:08:42.404897+0000","last_active":"2023-09-13T06:08:43.410560+0000","last_peered":"2023-09-13T06:08:43.410560+0000","last_clean":"2023-09-13T06:08:43.410560+0000","last_became_active":"2023-09-13T06:08:42.404648+0000","last_became_peered":"2023-09-13T06:08:42.404648+0000","last_unstale":"2023-09-13T06:08:43.410560+0000","last_undegraded":"2023-09-13T06:08:43.410560+0000","last_fullsized":"2023-09-13T06:08:43.410560+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:21:51.914029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"154'3","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413154+0000","last_change":"2023-09-13T06:08:41.649702+0000","last_active":"2023-09-13T06:08:43.413154+0000","last_peered":"2023-09-13T06:08:43.413154+0000","last_clean":"2023-09-13T06:08:43.413154+0000","last_became_active":"2023-09-13T06:08:41.649463+0000","last_became_peered":"2023-09-13T06:08:41.649463+0000","last_unstale":"2023-09-13T06:08:43.413154+0000","last_undegraded":"2023-09-13T06:08:43.413154+0000","last_fullsized":"2023-09-13T06:08:43.413154+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:12:42.486048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410383+0000","last_change":"2023-09-13T06:08:42.415955+0000","last_active":"2023-09-13T06:08:43.410383+0000","last_peered":"2023-09-13T06:08:43.410383+0000","last_clean":"2023-09-13T06:08:43.410383+0000","last_became_active":"2023-09-13T06:08:42.415730+0000","last_became_peered":"2023-09-13T06:08:42.415730+0000","last_unstale":"2023-09-13T06:08:43.410383+0000","last_undegraded":"2023-09-13T06:08:43.410383+0000","last_fullsized":"2023-09-13T06:08:43.410383+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:49:53.962623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"154'6","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.674948+0000","last_change":"2023-09-13T06:08:41.658018+0000","last_active":"2023-09-13T06:08:42.674948+0000","last_peered":"2023-09-13T06:08:42.674948+0000","last_clean":"2023-09-13T06:08:42.674948+0000","last_became_active":"2023-09-13T06:08:41.657617+0000","last_became_peered":"2023-09-13T06:08:41.657617+0000","last_unstale":"2023-09-13T06:08:42.674948+0000","last_undegraded":"2023-09-13T06:08:42.674948+0000","last_fullsized":"2023-09-13T06:08:42.674948+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:18:29.012321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411708+0000","last_change":"2023-09-13T06:08:42.411303+0000","last_active":"2023-09-13T06:08:42.411708+0000","last_peered":"2023-09-13T06:08:42.411708+0000","last_clean":"2023-09-13T06:08:42.411708+0000","last_became_active":"2023-09-13T06:08:42.411087+0000","last_became_peered":"2023-09-13T06:08:42.411087+0000","last_unstale":"2023-09-13T06:08:42.411708+0000","last_undegraded":"2023-09-13T06:08:42.411708+0000","last_fullsized":"2023-09-13T06:08:42.411708+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:45:01.041813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411979+0000","last_change":"2023-09-13T06:08:41.657234+0000","last_active":"2023-09-13T06:08:42.411979+0000","last_peered":"2023-09-13T06:08:42.411979+0000","last_clean":"2023-09-13T06:08:42.411979+0000","last_became_active":"2023-09-13T06:08:41.656927+0000","last_became_peered":"2023-09-13T06:08:41.656927+0000","last_unstale":"2023-09-13T06:08:42.411979+0000","last_undegraded":"2023-09-13T06:08:42.411979+0000","last_fullsized":"2023-09-13T06:08:42.411979+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:34:30.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.414933+0000","last_change":"2023-09-13T06:08:42.414865+0000","last_active":"2023-09-13T06:08:42.414933+0000","last_peered":"2023-09-13T06:08:42.414933+0000","last_clean":"2023-09-13T06:08:42.414933+0000","last_became_active":"2023-09-13T06:08:42.414576+0000","last_became_peered":"2023-09-13T06:08:42.414576+0000","last_unstale":"2023-09-13T06:08:42.414933+0000","last_undegraded":"2023-09-13T06:08:42.414933+0000","last_fullsized":"2023-09-13T06:08:42.414933+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:24:40.356187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.403799+0000","last_change":"2023-09-13T06:08:41.653152+0000","last_active":"2023-09-13T06:08:42.403799+0000","last_peered":"2023-09-13T06:08:42.403799+0000","last_clean":"2023-09-13T06:08:42.403799+0000","last_became_active":"2023-09-13T06:08:41.652440+0000","last_became_peered":"2023-09-13T06:08:41.652440+0000","last_unstale":"2023-09-13T06:08:42.403799+0000","last_undegraded":"2023-09-13T06:08:42.403799+0000","last_fullsized":"2023-09-13T06:08:42.403799+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:13:01.641923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411803+0000","last_change":"2023-09-13T06:08:42.411723+0000","last_active":"2023-09-13T06:08:42.411803+0000","last_peered":"2023-09-13T06:08:42.411803+0000","last_clean":"2023-09-13T06:08:42.411803+0000","last_became_active":"2023-09-13T06:08:42.411324+0000","last_became_peered":"2023-09-13T06:08:42.411324+0000","last_unstale":"2023-09-13T06:08:42.411803+0000","last_undegraded":"2023-09-13T06:08:42.411803+0000","last_fullsized":"2023-09-13T06:08:42.411803+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:01.010803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"154'8","reported_seq":19,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.675622+0000","last_change":"2023-09-13T06:08:41.654455+0000","last_active":"2023-09-13T06:08:42.675622+0000","last_peered":"2023-09-13T06:08:42.675622+0000","last_clean":"2023-09-13T06:08:42.675622+0000","last_became_active":"2023-09-13T06:08:41.654048+0000","last_became_peered":"2023-09-13T06:08:41.654048+0000","last_unstale":"2023-09-13T06:08:42.675622+0000","last_undegraded":"2023-09-13T06:08:42.675622+0000","last_fullsized":"2023-09-13T06:08:42.675622+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:26:21.286899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.414345+0000","last_change":"2023-09-13T06:08:42.414170+0000","last_active":"2023-09-13T06:08:42.414345+0000","last_peered":"2023-09-13T06:08:42.414345+0000","last_clean":"2023-09-13T06:08:42.414345+0000","last_became_active":"2023-09-13T06:08:42.413839+0000","last_became_peered":"2023-09-13T06:08:42.413839+0000","last_unstale":"2023-09-13T06:08:42.414345+0000","last_undegraded":"2023-09-13T06:08:42.414345+0000","last_fullsized":"2023-09-13T06:08:42.414345+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:22:05.810462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"154'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413339+0000","last_change":"2023-09-13T06:08:41.647965+0000","last_active":"2023-09-13T06:08:43.413339+0000","last_peered":"2023-09-13T06:08:43.413339+0000","last_clean":"2023-09-13T06:08:43.413339+0000","last_became_active":"2023-09-13T06:08:41.647685+0000","last_became_peered":"2023-09-13T06:08:41.647685+0000","last_unstale":"2023-09-13T06:08:43.413339+0000","last_undegraded":"2023-09-13T06:08:43.413339+0000","last_fullsized":"2023-09-13T06:08:43.413339+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:23:08.750493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413059+0000","last_change":"2023-09-13T06:08:42.405035+0000","last_active":"2023-09-13T06:08:43.413059+0000","last_peered":"2023-09-13T06:08:43.413059+0000","last_clean":"2023-09-13T06:08:43.413059+0000","last_became_active":"2023-09-13T06:08:42.404804+0000","last_became_peered":"2023-09-13T06:08:42.404804+0000","last_unstale":"2023-09-13T06:08:43.413059+0000","last_undegraded":"2023-09-13T06:08:43.413059+0000","last_fullsized":"2023-09-13T06:08:43.413059+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:50:16.270083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"154'2","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.673002+0000","last_change":"2023-09-13T06:08:41.655681+0000","last_active":"2023-09-13T06:08:42.673002+0000","last_peered":"2023-09-13T06:08:42.673002+0000","last_clean":"2023-09-13T06:08:42.673002+0000","last_became_active":"2023-09-13T06:08:41.655342+0000","last_became_peered":"2023-09-13T06:08:41.655342+0000","last_unstale":"2023-09-13T06:08:42.673002+0000","last_undegraded":"2023-09-13T06:08:42.673002+0000","last_fullsized":"2023-09-13T06:08:42.673002+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:09:12.548554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413315+0000","last_change":"2023-09-13T06:08:42.413250+0000","last_active":"2023-09-13T06:08:42.413315+0000","last_peered":"2023-09-13T06:08:42.413315+0000","last_clean":"2023-09-13T06:08:42.413315+0000","last_became_active":"2023-09-13T06:08:42.413046+0000","last_became_peered":"2023-09-13T06:08:42.413046+0000","last_unstale":"2023-09-13T06:08:42.413315+0000","last_undegraded":"2023-09-13T06:08:42.413315+0000","last_fullsized":"2023-09-13T06:08:42.413315+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:45:52.339839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"154'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406840+0000","last_change":"2023-09-13T06:08:41.653490+0000","last_active":"2023-09-13T06:08:43.406840+0000","last_peered":"2023-09-13T06:08:43.406840+0000","last_clean":"2023-09-13T06:08:43.406840+0000","last_became_active":"2023-09-13T06:08:41.653252+0000","last_became_peered":"2023-09-13T06:08:41.653252+0000","last_unstale":"2023-09-13T06:08:43.406840+0000","last_undegraded":"2023-09-13T06:08:43.406840+0000","last_fullsized":"2023-09-13T06:08:43.406840+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:22:51.653858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.406530+0000","last_change":"2023-09-13T06:08:42.406466+0000","last_active":"2023-09-13T06:08:42.406530+0000","last_peered":"2023-09-13T06:08:42.406530+0000","last_clean":"2023-09-13T06:08:42.406530+0000","last_became_active":"2023-09-13T06:08:42.406236+0000","last_became_peered":"2023-09-13T06:08:42.406236+0000","last_unstale":"2023-09-13T06:08:42.406530+0000","last_undegraded":"2023-09-13T06:08:42.406530+0000","last_fullsized":"2023-09-13T06:08:42.406530+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:46:02.148778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413084+0000","last_change":"2023-09-13T06:08:41.650880+0000","last_active":"2023-09-13T06:08:43.413084+0000","last_peered":"2023-09-13T06:08:43.413084+0000","last_clean":"2023-09-13T06:08:43.413084+0000","last_became_active":"2023-09-13T06:08:41.650641+0000","last_became_peered":"2023-09-13T06:08:41.650641+0000","last_unstale":"2023-09-13T06:08:43.413084+0000","last_undegraded":"2023-09-13T06:08:43.413084+0000","last_fullsized":"2023-09-13T06:08:43.413084+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:23.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411411+0000","last_change":"2023-09-13T06:08:42.410649+0000","last_active":"2023-09-13T06:08:42.411411+0000","last_peered":"2023-09-13T06:08:42.411411+0000","last_clean":"2023-09-13T06:08:42.411411+0000","last_became_active":"2023-09-13T06:08:42.410391+0000","last_became_peered":"2023-09-13T06:08:42.410391+0000","last_unstale":"2023-09-13T06:08:42.411411+0000","last_undegraded":"2023-09-13T06:08:42.411411+0000","last_fullsized":"2023-09-13T06:08:42.411411+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:05.439767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"154'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413224+0000","last_change":"2023-09-13T06:08:41.655873+0000","last_active":"2023-09-13T06:08:43.413224+0000","last_peered":"2023-09-13T06:08:43.413224+0000","last_clean":"2023-09-13T06:08:43.413224+0000","last_became_active":"2023-09-13T06:08:41.655542+0000","last_became_peered":"2023-09-13T06:08:41.655542+0000","last_unstale":"2023-09-13T06:08:43.413224+0000","last_undegraded":"2023-09-13T06:08:43.413224+0000","last_fullsized":"2023-09-13T06:08:43.413224+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:05:27.709223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406714+0000","last_change":"2023-09-13T06:08:42.418604+0000","last_active":"2023-09-13T06:08:43.406714+0000","last_peered":"2023-09-13T06:08:43.406714+0000","last_clean":"2023-09-13T06:08:43.406714+0000","last_became_active":"2023-09-13T06:08:42.418080+0000","last_became_peered":"2023-09-13T06:08:42.418080+0000","last_unstale":"2023-09-13T06:08:43.406714+0000","last_undegraded":"2023-09-13T06:08:43.406714+0000","last_fullsized":"2023-09-13T06:08:43.406714+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:45:40.988326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.400540+0000","last_change":"2023-09-13T06:08:41.656047+0000","last_active":"2023-09-13T06:08:42.400540+0000","last_peered":"2023-09-13T06:08:42.400540+0000","last_clean":"2023-09-13T06:08:42.400540+0000","last_became_active":"2023-09-13T06:08:41.655769+0000","last_became_peered":"2023-09-13T06:08:41.655769+0000","last_unstale":"2023-09-13T06:08:42.400540+0000","last_undegraded":"2023-09-13T06:08:42.400540+0000","last_fullsized":"2023-09-13T06:08:42.400540+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:44:25.754787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.406292+0000","last_change":"2023-09-13T06:08:42.405994+0000","last_active":"2023-09-13T06:08:42.406292+0000","last_peered":"2023-09-13T06:08:42.406292+0000","last_clean":"2023-09-13T06:08:42.406292+0000","last_became_active":"2023-09-13T06:08:42.405707+0000","last_became_peered":"2023-09-13T06:08:42.405707+0000","last_unstale":"2023-09-13T06:08:42.406292+0000","last_undegraded":"2023-09-13T06:08:42.406292+0000","last_fullsized":"2023-09-13T06:08:42.406292+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:15:38.711696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.400300+0000","last_change":"2023-09-13T06:08:41.650240+0000","last_active":"2023-09-13T06:08:42.400300+0000","last_peered":"2023-09-13T06:08:42.400300+0000","last_clean":"2023-09-13T06:08:42.400300+0000","last_became_active":"2023-09-13T06:08:41.649648+0000","last_became_peered":"2023-09-13T06:08:41.649648+0000","last_unstale":"2023-09-13T06:08:42.400300+0000","last_undegraded":"2023-09-13T06:08:42.400300+0000","last_fullsized":"2023-09-13T06:08:42.400300+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:50:13.867514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410458+0000","last_change":"2023-09-13T06:08:42.413184+0000","last_active":"2023-09-13T06:08:43.410458+0000","last_peered":"2023-09-13T06:08:43.410458+0000","last_clean":"2023-09-13T06:08:43.410458+0000","last_became_active":"2023-09-13T06:08:42.412926+0000","last_became_peered":"2023-09-13T06:08:42.412926+0000","last_unstale":"2023-09-13T06:08:43.410458+0000","last_undegraded":"2023-09-13T06:08:43.410458+0000","last_fullsized":"2023-09-13T06:08:43.410458+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:30.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.403325+0000","last_change":"2023-09-13T06:08:41.654151+0000","last_active":"2023-09-13T06:08:42.403325+0000","last_peered":"2023-09-13T06:08:42.403325+0000","last_clean":"2023-09-13T06:08:42.403325+0000","last_became_active":"2023-09-13T06:08:41.653929+0000","last_became_peered":"2023-09-13T06:08:41.653929+0000","last_unstale":"2023-09-13T06:08:42.403325+0000","last_undegraded":"2023-09-13T06:08:42.403325+0000","last_fullsized":"2023-09-13T06:08:42.403325+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:20:43.516306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406845+0000","last_change":"2023-09-13T06:08:42.412377+0000","last_active":"2023-09-13T06:08:43.406845+0000","last_peered":"2023-09-13T06:08:43.406845+0000","last_clean":"2023-09-13T06:08:43.406845+0000","last_became_active":"2023-09-13T06:08:42.412074+0000","last_became_peered":"2023-09-13T06:08:42.412074+0000","last_unstale":"2023-09-13T06:08:43.406845+0000","last_undegraded":"2023-09-13T06:08:43.406845+0000","last_fullsized":"2023-09-13T06:08:43.406845+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:50:06.564342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"154'2","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.671429+0000","last_change":"2023-09-13T06:08:41.657898+0000","last_active":"2023-09-13T06:08:42.671429+0000","last_peered":"2023-09-13T06:08:42.671429+0000","last_clean":"2023-09-13T06:08:42.671429+0000","last_became_active":"2023-09-13T06:08:41.657615+0000","last_became_peered":"2023-09-13T06:08:41.657615+0000","last_unstale":"2023-09-13T06:08:42.671429+0000","last_undegraded":"2023-09-13T06:08:42.671429+0000","last_fullsized":"2023-09-13T06:08:42.671429+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:41:01.585581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.414737+0000","last_change":"2023-09-13T06:08:42.414674+0000","last_active":"2023-09-13T06:08:42.414737+0000","last_peered":"2023-09-13T06:08:42.414737+0000","last_clean":"2023-09-13T06:08:42.414737+0000","last_became_active":"2023-09-13T06:08:42.414440+0000","last_became_peered":"2023-09-13T06:08:42.414440+0000","last_unstale":"2023-09-13T06:08:42.414737+0000","last_undegraded":"2023-09-13T06:08:42.414737+0000","last_fullsized":"2023-09-13T06:08:42.414737+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:37:55.423197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410626+0000","last_change":"2023-09-13T06:08:41.650999+0000","last_active":"2023-09-13T06:08:43.410626+0000","last_peered":"2023-09-13T06:08:43.410626+0000","last_clean":"2023-09-13T06:08:43.410626+0000","last_became_active":"2023-09-13T06:08:41.650750+0000","last_became_peered":"2023-09-13T06:08:41.650750+0000","last_unstale":"2023-09-13T06:08:43.410626+0000","last_undegraded":"2023-09-13T06:08:43.410626+0000","last_fullsized":"2023-09-13T06:08:43.410626+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:45:52.224716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411786+0000","last_change":"2023-09-13T06:08:42.411719+0000","last_active":"2023-09-13T06:08:42.411786+0000","last_peered":"2023-09-13T06:08:42.411786+0000","last_clean":"2023-09-13T06:08:42.411786+0000","last_became_active":"2023-09-13T06:08:42.411134+0000","last_became_peered":"2023-09-13T06:08:42.411134+0000","last_unstale":"2023-09-13T06:08:42.411786+0000","last_undegraded":"2023-09-13T06:08:42.411786+0000","last_fullsized":"2023-09-13T06:08:42.411786+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:47:46.716264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.404127+0000","last_change":"2023-09-13T06:08:41.654329+0000","last_active":"2023-09-13T06:08:42.404127+0000","last_peered":"2023-09-13T06:08:42.404127+0000","last_clean":"2023-09-13T06:08:42.404127+0000","last_became_active":"2023-09-13T06:08:41.654036+0000","last_became_peered":"2023-09-13T06:08:41.654036+0000","last_unstale":"2023-09-13T06:08:42.404127+0000","last_undegraded":"2023-09-13T06:08:42.404127+0000","last_fullsized":"2023-09-13T06:08:42.404127+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:51:12.183814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406610+0000","last_change":"2023-09-13T06:08:42.411238+0000","last_active":"2023-09-13T06:08:43.406610+0000","last_peered":"2023-09-13T06:08:43.406610+0000","last_clean":"2023-09-13T06:08:43.406610+0000","last_became_active":"2023-09-13T06:08:42.410737+0000","last_became_peered":"2023-09-13T06:08:42.410737+0000","last_unstale":"2023-09-13T06:08:43.406610+0000","last_undegraded":"2023-09-13T06:08:43.406610+0000","last_fullsized":"2023-09-13T06:08:43.406610+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:32:41.043783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.402964+0000","last_change":"2023-09-13T06:08:41.652273+0000","last_active":"2023-09-13T06:08:42.402964+0000","last_peered":"2023-09-13T06:08:42.402964+0000","last_clean":"2023-09-13T06:08:42.402964+0000","last_became_active":"2023-09-13T06:08:41.652034+0000","last_became_peered":"2023-09-13T06:08:41.652034+0000","last_unstale":"2023-09-13T06:08:42.402964+0000","last_undegraded":"2023-09-13T06:08:42.402964+0000","last_fullsized":"2023-09-13T06:08:42.402964+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:39:18.588049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410294+0000","last_change":"2023-09-13T06:08:42.411731+0000","last_active":"2023-09-13T06:08:43.410294+0000","last_peered":"2023-09-13T06:08:43.410294+0000","last_clean":"2023-09-13T06:08:43.410294+0000","last_became_active":"2023-09-13T06:08:42.411392+0000","last_became_peered":"2023-09-13T06:08:42.411392+0000","last_unstale":"2023-09-13T06:08:43.410294+0000","last_undegraded":"2023-09-13T06:08:43.410294+0000","last_fullsized":"2023-09-13T06:08:43.410294+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:35:19.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.403856+0000","last_change":"2023-09-13T06:08:41.651282+0000","last_active":"2023-09-13T06:08:42.403856+0000","last_peered":"2023-09-13T06:08:42.403856+0000","last_clean":"2023-09-13T06:08:42.403856+0000","last_became_active":"2023-09-13T06:08:41.650716+0000","last_became_peered":"2023-09-13T06:08:41.650716+0000","last_unstale":"2023-09-13T06:08:42.403856+0000","last_undegraded":"2023-09-13T06:08:42.403856+0000","last_fullsized":"2023-09-13T06:08:42.403856+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:13:11.348813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.412961+0000","last_change":"2023-09-13T06:08:42.413303+0000","last_active":"2023-09-13T06:08:43.412961+0000","last_peered":"2023-09-13T06:08:43.412961+0000","last_clean":"2023-09-13T06:08:43.412961+0000","last_became_active":"2023-09-13T06:08:42.412920+0000","last_became_peered":"2023-09-13T06:08:42.412920+0000","last_unstale":"2023-09-13T06:08:43.412961+0000","last_undegraded":"2023-09-13T06:08:43.412961+0000","last_fullsized":"2023-09-13T06:08:43.412961+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:03:15.222376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410492+0000","last_change":"2023-09-13T06:08:41.651035+0000","last_active":"2023-09-13T06:08:43.410492+0000","last_peered":"2023-09-13T06:08:43.410492+0000","last_clean":"2023-09-13T06:08:43.410492+0000","last_became_active":"2023-09-13T06:08:41.650768+0000","last_became_peered":"2023-09-13T06:08:41.650768+0000","last_unstale":"2023-09-13T06:08:43.410492+0000","last_undegraded":"2023-09-13T06:08:43.410492+0000","last_fullsized":"2023-09-13T06:08:43.410492+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:22:51.653858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413814+0000","last_change":"2023-09-13T06:08:42.413713+0000","last_active":"2023-09-13T06:08:42.413814+0000","last_peered":"2023-09-13T06:08:42.413814+0000","last_clean":"2023-09-13T06:08:42.413814+0000","last_became_active":"2023-09-13T06:08:42.413481+0000","last_became_peered":"2023-09-13T06:08:42.413481+0000","last_unstale":"2023-09-13T06:08:42.413814+0000","last_undegraded":"2023-09-13T06:08:42.413814+0000","last_fullsized":"2023-09-13T06:08:42.413814+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:40:39.587491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.400776+0000","last_change":"2023-09-13T06:08:41.656505+0000","last_active":"2023-09-13T06:08:42.400776+0000","last_peered":"2023-09-13T06:08:42.400776+0000","last_clean":"2023-09-13T06:08:42.400776+0000","last_became_active":"2023-09-13T06:08:41.656153+0000","last_became_peered":"2023-09-13T06:08:41.656153+0000","last_unstale":"2023-09-13T06:08:42.400776+0000","last_undegraded":"2023-09-13T06:08:42.400776+0000","last_fullsized":"2023-09-13T06:08:42.400776+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:02:08.104703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.408521+0000","last_change":"2023-09-13T06:08:42.408449+0000","last_active":"2023-09-13T06:08:42.408521+0000","last_peered":"2023-09-13T06:08:42.408521+0000","last_clean":"2023-09-13T06:08:42.408521+0000","last_became_active":"2023-09-13T06:08:42.408232+0000","last_became_peered":"2023-09-13T06:08:42.408232+0000","last_unstale":"2023-09-13T06:08:42.408521+0000","last_undegraded":"2023-09-13T06:08:42.408521+0000","last_fullsized":"2023-09-13T06:08:42.408521+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:11:02.764608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.403527+0000","last_change":"2023-09-13T06:08:41.651108+0000","last_active":"2023-09-13T06:08:42.403527+0000","last_peered":"2023-09-13T06:08:42.403527+0000","last_clean":"2023-09-13T06:08:42.403527+0000","last_became_active":"2023-09-13T06:08:41.650866+0000","last_became_peered":"2023-09-13T06:08:41.650866+0000","last_unstale":"2023-09-13T06:08:42.403527+0000","last_undegraded":"2023-09-13T06:08:42.403527+0000","last_fullsized":"2023-09-13T06:08:42.403527+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:25:40.182587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410707+0000","last_change":"2023-09-13T06:08:42.413499+0000","last_active":"2023-09-13T06:08:43.410707+0000","last_peered":"2023-09-13T06:08:43.410707+0000","last_clean":"2023-09-13T06:08:43.410707+0000","last_became_active":"2023-09-13T06:08:42.412904+0000","last_became_peered":"2023-09-13T06:08:42.412904+0000","last_unstale":"2023-09-13T06:08:43.410707+0000","last_undegraded":"2023-09-13T06:08:43.410707+0000","last_fullsized":"2023-09-13T06:08:43.410707+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:33:48.544819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"154'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410730+0000","last_change":"2023-09-13T06:08:41.655920+0000","last_active":"2023-09-13T06:08:43.410730+0000","last_peered":"2023-09-13T06:08:43.410730+0000","last_clean":"2023-09-13T06:08:43.410730+0000","last_became_active":"2023-09-13T06:08:41.655658+0000","last_became_peered":"2023-09-13T06:08:41.655658+0000","last_unstale":"2023-09-13T06:08:43.410730+0000","last_undegraded":"2023-09-13T06:08:43.410730+0000","last_fullsized":"2023-09-13T06:08:43.410730+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:26.622483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":314,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.402272+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:08:42.402272+0000","last_peered":"2023-09-13T06:08:42.402272+0000","last_clean":"2023-09-13T06:08:42.402272+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:08:42.402272+0000","last_undegraded":"2023-09-13T06:08:42.402272+0000","last_fullsized":"2023-09-13T06:08:42.402272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574940,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1421,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193890,"statfs":{"total":200000000,"available":198544230,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.3320000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.68999999999999995},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70499999999999996,"15min":0.69499999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92200000000000004,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.82499999999999996}]},{"osd":2,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.47499999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.88300000000000001,"5min":1.016,"15min":1.395},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.2030000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.56799999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.357},"last":0.748},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93600000000000005,"5min":1.0580000000000001,"15min":1.2629999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.626},"min":{"1min":0.38700000000000001,"5min":0.32600000000000001,"15min":0.316},"max":{"1min":0.88600000000000001,"5min":0.89700000000000002,"15min":0.95899999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63900000000000001,"15min":0.65700000000000003},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79800000000000004,"5min":0.95899999999999996,"15min":1.018},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63,"15min":0.66800000000000004},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.97099999999999997,"15min":0.97999999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66600000000000004,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.98099999999999998,"15min":1.1319999999999999},"last":0.79100000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.74099999999999999},"min":{"1min":0.433,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0920000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.5,"5min":0.46800000000000003,"15min":0.46600000000000003},"max":{"1min":0.89500000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":844,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199135236,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67400000000000004,"15min":0.68500000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35299999999999998},"max":{"1min":0.879,"5min":1.0649999999999999,"15min":1.181},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.68200000000000005},"min":{"1min":0.52000000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.96299999999999997,"5min":1.028,"15min":1.028},"last":0.54200000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68100000000000005,"15min":0.69299999999999995},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.0840000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.71799999999999997},"min":{"1min":0.50900000000000001,"5min":0.40799999999999997,"15min":0.40200000000000002},"max":{"1min":1.137,"5min":1.137,"15min":1.153},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.54800000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.97399999999999998,"15min":1.4750000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70299999999999996,"15min":0.71499999999999997},"min":{"1min":0.49299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.034,"5min":1.085,"15min":1.085},"last":0.68400000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92000000000000004,"5min":1.105,"15min":1.2030000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.75700000000000001,"15min":0.77800000000000002},"min":{"1min":0.60799999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0129999999999999,"5min":1.0620000000000001,"15min":1.526},"last":0.72599999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.88,"5min":1.024,"15min":1.0589999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":1.018},"last":0.47099999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63600000000000001,"15min":0.624},"min":{"1min":0.432,"5min":0.312,"15min":0.312},"max":{"1min":0.99199999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.43099999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.95499999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49299999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.51600000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.071,"5min":1.1299999999999999,"15min":4.3879999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71399999999999997,"15min":0.70299999999999996},"min":{"1min":0.48299999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.014,"5min":1.133,"15min":1.133},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":842,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194469,"statfs":{"total":200000000,"available":199136848,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.83799999999999997,"5min":0.95899999999999996,"15min":1.0389999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.442,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54100000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.44500000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.93000000000000005,"15min":0.96099999999999997},"last":0.87},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89900000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65300000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70999999999999996,"15min":0.69499999999999995},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96699999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69099999999999995,"15min":0.67400000000000004},"min":{"1min":0.495,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94899999999999995,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91800000000000004,"5min":0.997,"15min":0.997},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70399999999999996,"15min":0.70899999999999996},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85899999999999999,"5min":0.94399999999999995,"15min":0.98099999999999998},"last":0.745}]},{"osd":4,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93899999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.61099999999999999},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95699999999999996,"5min":1.077,"15min":1.077},"last":0.97499999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.67500000000000004},"min":{"1min":0.53700000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86099999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67900000000000005,"15min":0.67500000000000004},"min":{"1min":0.496,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.77200000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69699999999999995,"15min":0.71699999999999997},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91100000000000003,"5min":1.109,"15min":1.109},"last":1.008},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.55000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93400000000000005,"5min":1.026,"15min":1.026},"last":0.996}]}]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":842,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194469,"statfs":{"total":200000000,"available":199136778,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66600000000000004,"15min":0.64500000000000002},"min":{"1min":0.44500000000000001,"5min":0.432,"15min":0.34999999999999998},"max":{"1min":0.83799999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.38},"max":{"1min":1.038,"5min":1.145,"15min":1.145},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68700000000000006,"15min":0.67000000000000004},"min":{"1min":0.57099999999999995,"5min":0.376,"15min":0.376},"max":{"1min":0.88300000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.67600000000000005},"min":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96399999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.623}]},{"osd":2,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.53500000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.57799999999999996,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.71699999999999997},"min":{"1min":0.61399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94599999999999995,"5min":1.077,"15min":1.077},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.55400000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94999999999999996,"5min":1.071,"15min":1.071},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.48999999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.96899999999999997,"5min":0.97999999999999998,"15min":1.01},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.91300000000000003,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.46200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86899999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71699999999999997,"15min":0.69499999999999995},"min":{"1min":0.54900000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.0169999999999999,"5min":1.123,"15min":1.123},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73699999999999999,"15min":0.71799999999999997},"min":{"1min":0.52000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0009999999999999,"5min":1.26,"15min":1.26},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72699999999999998,"15min":0.71299999999999997},"min":{"1min":0.50900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98799999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194469,"statfs":{"total":200000000,"available":199136688,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.25800000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.58099999999999996,"5min":0.629,"15min":0.69099999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.435},"min":{"1min":0.29799999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70299999999999996,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.35399999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.441,"15min":0.42899999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48299999999999998,"15min":0.46200000000000002},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63600000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.38400000000000001,"5min":0.375,"15min":0.33400000000000002},"max":{"1min":0.65500000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.78100000000000003},"last":0.64800000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.46700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96799999999999997,"5min":1.284,"15min":1.284},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90100000000000002,"5min":1.044,"15min":1.044},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.91700000000000004,"5min":1.042,"15min":1.111},"last":0.745},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85499999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.54200000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93700000000000006,"5min":1.097,"15min":1.097},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":0.878,"5min":0.998,"15min":1.458},"last":0.70199999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0600000000000001,"5min":1.383,"15min":1.383},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.88900000000000001,"5min":1.0800000000000001,"15min":1.27},"last":0.71999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199136232,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.25900000000000001,"5min":0.23999999999999999,"15min":0.22700000000000001},"max":{"1min":0.745,"5min":0.86399999999999999,"15min":10.401},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.437,"15min":0.439},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":5.4429999999999996},"last":0.34799999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46800000000000003,"15min":0.46200000000000002},"min":{"1min":0.374,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":5.2640000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48899999999999999,"15min":0.47199999999999998},"min":{"1min":0.38800000000000001,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":4.3369999999999997},"last":0.44600000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70799999999999996,"5min":4.1699999999999999,"15min":6.0410000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.46700000000000003,"5min":0.41399999999999998,"15min":0.38600000000000001},"max":{"1min":0.79000000000000004,"5min":0.82399999999999995,"15min":6.1600000000000001},"last":0.501}]},{"osd":4,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.171,"5min":1.171,"15min":5.4809999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75,"15min":0.76700000000000002},"min":{"1min":0.57999999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.121,"5min":1.121,"15min":4.0599999999999996},"last":1.117}]},{"osd":5,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.56100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1579999999999999,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.58299999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.135,"5min":1.135,"15min":5.5289999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.53700000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0469999999999999,"5min":1.0980000000000001,"15min":4.1609999999999996},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.72799999999999998},"min":{"1min":0.49099999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1100000000000001,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":1.0309999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":4.2400000000000002},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77400000000000002,"15min":0.76400000000000001},"min":{"1min":0.55900000000000005,"5min":0.48699999999999999,"15min":0.48099999999999998},"max":{"1min":1.0700000000000001,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.81499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":842,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194469,"statfs":{"total":200000000,"available":199136848,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.624,"5min":0.80200000000000005,"15min":2.4020000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27300000000000002},"max":{"1min":0.69499999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54200000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48499999999999999,"15min":0.46200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66800000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.504,"15min":0.46800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54900000000000004,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.379},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":0.80600000000000005,"15min":4.0599999999999996},"last":0.48999999999999999}]},{"osd":4,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.55200000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.012,"5min":1.089,"15min":1.089},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73299999999999998,"15min":0.746},"min":{"1min":0.58999999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0669999999999999,"5min":1.125,"15min":1.2150000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97699999999999998,"5min":1.1000000000000001,"15min":1.109},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.57699999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.628,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0189999999999999,"5min":1.1639999999999999,"15min":1.1839999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.61799999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0029999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.028,"5min":1.0369999999999999,"15min":1.0669999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.505,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0409999999999999,"5min":1.1519999999999999,"15min":1.2769999999999999},"last":0.73899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1419,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193893,"statfs":{"total":200000000,"available":198546480,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":2.0190000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69299999999999995,"5min":0.89800000000000002,"15min":2.294},"last":0.34399999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.502,"15min":0.498},"min":{"1min":0.38500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":2.2410000000000001},"last":0.505},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.29899999999999999,"15min":0.29499999999999998},"max":{"1min":0.63900000000000001,"5min":0.72999999999999998,"15min":2.056},"last":0.45300000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.32500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68799999999999994,"5min":0.76600000000000001,"15min":2.0859999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55200000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.76900000000000002,"5min":0.83599999999999997,"15min":2.3820000000000001},"last":0.66700000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.47599999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.88800000000000001,"5min":1.099,"15min":2.1749999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.436,"15min":0.436},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":2.3370000000000002},"last":0.71899999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72399999999999998,"15min":0.76400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":2.3119999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74099999999999999,"15min":0.77700000000000002},"min":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.48799999999999999},"max":{"1min":1.052,"5min":1.0980000000000001,"15min":2.1469999999999998},"last":0.56399999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.5,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0309999999999999,"5min":1.1240000000000001,"15min":2.415},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72399999999999998,"15min":0.76500000000000001},"min":{"1min":0.46200000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.121,"5min":1.121,"15min":2.347},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.745,"15min":0.78500000000000003},"min":{"1min":0.499,"5min":0.495,"15min":0.495},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":2.367},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.53300000000000003,"15min":0.53000000000000003},"max":{"1min":0.98499999999999999,"5min":1.0509999999999999,"15min":2.1179999999999999},"last":0.60199999999999998}]}]}],"pool_statfs":[]}} 2023-09-13T06:08:46.786 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:08:46.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff2924ec640 1 Processor -- start 2023-09-13T06:08:46.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff2924ec640 1 -- start start 2023-09-13T06:08:46.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff2924ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff28c15d260 0x7ff28c0b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff2924ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff28c06ddf0 0x7ff28c071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff2924ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c070e70 con 0x7ff28c0ce1a0 2023-09-13T06:08:46.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff2924ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c070280 con 0x7ff28c15d260 2023-09-13T06:08:46.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff2924ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c070540 con 0x7ff28c06ddf0 2023-09-13T06:08:46.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff28bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff28c15d260 0x7ff28c0b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff28b7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff28c0ce1a0 0x7ff28c06d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51076/0 (socket says 172.21.15.130:51076) 2023-09-13T06:08:46.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff28b7fe640 1 -- 172.21.15.130:0/3977262567 learned_addr learned my addr 172.21.15.130:0/3977262567 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:46.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff290a89640 1 --2- 172.21.15.130:0/3977262567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff28c06ddf0 0x7ff28c071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff28bfff640 1 -- 172.21.15.130:0/3977262567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff28c06ddf0 msgr2=0x7ff28c071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:46.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff28bfff640 1 --2- 172.21.15.130:0/3977262567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff28c06ddf0 0x7ff28c071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff28bfff640 1 -- 172.21.15.130:0/3977262567 >> v1:172.21.15.130:6789/0 conn(0x7ff28c0ce1a0 legacy=0x7ff28c06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff28bfff640 1 -- 172.21.15.130:0/3977262567 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c070820 con 0x7ff28c15d260 2023-09-13T06:08:46.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.963+0000 7ff28affd640 1 -- 172.21.15.130:0/3977262567 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904851172 0 0) 0x7ff28c070e70 con 0x7ff28c0ce1a0 2023-09-13T06:08:46.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff28bfff640 1 --2- 172.21.15.130:0/3977262567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff28c15d260 0x7ff28c0b5800 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0097c0 tx=0x7ff27c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b57e8dd239368b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:46.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff28affd640 1 -- 172.21.15.130:0/3977262567 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0a7070 con 0x7ff28c15d260 2023-09-13T06:08:46.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff28affd640 1 -- 172.21.15.130:0/3977262567 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c0ab430 con 0x7ff28c15d260 2023-09-13T06:08:46.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff28affd640 1 -- 172.21.15.130:0/3977262567 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0ab7c0 con 0x7ff28c15d260 2023-09-13T06:08:46.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff2924ec640 1 -- 172.21.15.130:0/3977262567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff28c15d260 msgr2=0x7ff28c0b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff2924ec640 1 --2- 172.21.15.130:0/3977262567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff28c15d260 0x7ff28c0b5800 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0097c0 tx=0x7ff27c01c450 comp rx=0 tx=0).stop 2023-09-13T06:08:46.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff2924ec640 1 -- 172.21.15.130:0/3977262567 shutdown_connections 2023-09-13T06:08:46.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff2924ec640 1 --2- 172.21.15.130:0/3977262567 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff28c06ddf0 0x7ff28c071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff2924ec640 1 --2- 172.21.15.130:0/3977262567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff28c15d260 0x7ff28c0b5800 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff2924ec640 1 -- 172.21.15.130:0/3977262567 >> 172.21.15.130:0/3977262567 conn(0x7ff28c06a2f0 msgr2=0x7ff28c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:46.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff2924ec640 1 -- 172.21.15.130:0/3977262567 shutdown_connections 2023-09-13T06:08:46.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.967+0000 7ff2924ec640 1 -- 172.21.15.130:0/3977262567 wait complete. 2023-09-13T06:08:46.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff2924ec640 1 Processor -- start 2023-09-13T06:08:46.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff2924ec640 1 -- start start 2023-09-13T06:08:46.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff2924ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff28c06ddf0 0x7ff28c146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff2924ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff28c0ce1a0 0x7ff28c0cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff2924ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c15d260 0x7ff28c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff2924ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c159410 con 0x7ff28c06ddf0 2023-09-13T06:08:46.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff2924ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c1584f0 con 0x7ff28c15d260 2023-09-13T06:08:46.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff2924ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c158790 con 0x7ff28c0ce1a0 2023-09-13T06:08:46.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff28bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff28c06ddf0 0x7ff28c146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff28bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff28c06ddf0 0x7ff28c146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57418/0 (socket says 172.21.15.130:57418) 2023-09-13T06:08:46.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff28bfff640 1 -- 172.21.15.130:0/1630255336 learned_addr learned my addr 172.21.15.130:0/1630255336 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:46.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff290a89640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c15d260 0x7ff28c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff28b7fe640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff28c0ce1a0 0x7ff28c0cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff28bfff640 1 -- 172.21.15.130:0/1630255336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff28c0ce1a0 msgr2=0x7ff28c0cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff28bfff640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff28c0ce1a0 0x7ff28c0cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff28bfff640 1 -- 172.21.15.130:0/1630255336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c15d260 msgr2=0x7ff28c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:46.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff28bfff640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c15d260 0x7ff28c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:46.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff28bfff640 1 -- 172.21.15.130:0/1630255336 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c009420 con 0x7ff28c06ddf0 2023-09-13T06:08:46.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff28b7fe640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff28c0ce1a0 0x7ff28c0cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:46.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff28bfff640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff28c06ddf0 0x7ff28c146530 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7ff27c01ab00 tx=0x7ff27c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:46.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff288ff9640 1 -- 172.21.15.130:0/1630255336 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c004220 con 0x7ff28c06ddf0 2023-09-13T06:08:46.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff288ff9640 1 -- 172.21.15.130:0/1630255336 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c004380 con 0x7ff28c06ddf0 2023-09-13T06:08:46.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff288ff9640 1 -- 172.21.15.130:0/1630255336 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c003820 con 0x7ff28c06ddf0 2023-09-13T06:08:46.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff2924ec640 1 -- 172.21.15.130:0/1630255336 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c158a70 con 0x7ff28c06ddf0 2023-09-13T06:08:46.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.971+0000 7ff2924ec640 1 -- 172.21.15.130:0/1630255336 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c159030 con 0x7ff28c06ddf0 2023-09-13T06:08:46.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.975+0000 7ff2924ec640 1 -- 172.21.15.130:0/1630255336 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c0b3a00 con 0x7ff28c06ddf0 2023-09-13T06:08:46.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.975+0000 7ff288ff9640 1 -- 172.21.15.130:0/1630255336 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff27c003980 con 0x7ff28c06ddf0 2023-09-13T06:08:46.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.975+0000 7ff288ff9640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff278065b20 0x7ff278067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:46.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.975+0000 7ff288ff9640 1 -- 172.21.15.130:0/1630255336 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff27c11d460 con 0x7ff28c06ddf0 2023-09-13T06:08:46.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.975+0000 7ff28b7fe640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff278065b20 0x7ff278067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:46.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.975+0000 7ff28b7fe640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff278065b20 0x7ff278067fe0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff280007fd0 tx=0x7ff280007c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:46.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:46.979+0000 7ff288ff9640 1 -- 172.21.15.130:0/1630255336 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff27c0eadc0 con 0x7ff28c06ddf0 2023-09-13T06:08:47.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.123+0000 7ff2924ec640 1 -- 172.21.15.130:0/1630255336 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff28c072050 con 0x7ff278065b20 2023-09-13T06:08:47.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.131+0000 7ff288ff9640 1 -- 172.21.15.130:0/1630255336 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284865 (secure 0 0 0) 0x7ff280005c90 con 0x7ff278065b20 2023-09-13T06:08:47.135 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:47.138 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:08:47.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.131+0000 7ff2924ec640 1 -- 172.21.15.130:0/1630255336 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff278065b20 msgr2=0x7ff278067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.131+0000 7ff2924ec640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff278065b20 0x7ff278067fe0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff280007fd0 tx=0x7ff280007c20 comp rx=0 tx=0).stop 2023-09-13T06:08:47.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.131+0000 7ff2924ec640 1 -- 172.21.15.130:0/1630255336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff28c06ddf0 msgr2=0x7ff28c146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.131+0000 7ff2924ec640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff28c06ddf0 0x7ff28c146530 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7ff27c01ab00 tx=0x7ff27c01ac90 comp rx=0 tx=0).stop 2023-09-13T06:08:47.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.131+0000 7ff2924ec640 1 -- 172.21.15.130:0/1630255336 shutdown_connections 2023-09-13T06:08:47.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.131+0000 7ff2924ec640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff278065b20 0x7ff278067fe0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.131+0000 7ff2924ec640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff28c15d260 0x7ff28c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.131+0000 7ff2924ec640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff28c0ce1a0 0x7ff28c0cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.131+0000 7ff2924ec640 1 --2- 172.21.15.130:0/1630255336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff28c06ddf0 0x7ff28c146530 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.131+0000 7ff2924ec640 1 -- 172.21.15.130:0/1630255336 >> 172.21.15.130:0/1630255336 conn(0x7ff28c06a2f0 msgr2=0x7ff28c072f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:47.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.135+0000 7ff2924ec640 1 -- 172.21.15.130:0/1630255336 shutdown_connections 2023-09-13T06:08:47.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.135+0000 7ff2924ec640 1 -- 172.21.15.130:0/1630255336 wait complete. 2023-09-13T06:08:47.155 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2023-09-13T06:08:46.628313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7901,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554598,"statfs":{"total":1600000000,"available":1591909340,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.990683"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.414664+0000","last_change":"2023-09-13T06:08:42.414594+0000","last_active":"2023-09-13T06:08:42.414664+0000","last_peered":"2023-09-13T06:08:42.414664+0000","last_clean":"2023-09-13T06:08:42.414664+0000","last_became_active":"2023-09-13T06:08:42.414091+0000","last_became_peered":"2023-09-13T06:08:42.414091+0000","last_unstale":"2023-09-13T06:08:42.414664+0000","last_undegraded":"2023-09-13T06:08:42.414664+0000","last_fullsized":"2023-09-13T06:08:42.414664+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:46.541402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.412574+0000","last_change":"2023-09-13T06:08:42.412529+0000","last_active":"2023-09-13T06:08:42.412574+0000","last_peered":"2023-09-13T06:08:42.412574+0000","last_clean":"2023-09-13T06:08:42.412574+0000","last_became_active":"2023-09-13T06:08:42.412290+0000","last_became_peered":"2023-09-13T06:08:42.412290+0000","last_unstale":"2023-09-13T06:08:42.412574+0000","last_undegraded":"2023-09-13T06:08:42.412574+0000","last_fullsized":"2023-09-13T06:08:42.412574+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:25:21.723169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.415862+0000","last_change":"2023-09-13T06:08:42.415564+0000","last_active":"2023-09-13T06:08:42.415862+0000","last_peered":"2023-09-13T06:08:42.415862+0000","last_clean":"2023-09-13T06:08:42.415862+0000","last_became_active":"2023-09-13T06:08:42.413942+0000","last_became_peered":"2023-09-13T06:08:42.413942+0000","last_unstale":"2023-09-13T06:08:42.415862+0000","last_undegraded":"2023-09-13T06:08:42.415862+0000","last_fullsized":"2023-09-13T06:08:42.415862+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:43:19.777929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413783+0000","last_change":"2023-09-13T06:08:42.413691+0000","last_active":"2023-09-13T06:08:42.413783+0000","last_peered":"2023-09-13T06:08:42.413783+0000","last_clean":"2023-09-13T06:08:42.413783+0000","last_became_active":"2023-09-13T06:08:42.413421+0000","last_became_peered":"2023-09-13T06:08:42.413421+0000","last_unstale":"2023-09-13T06:08:42.413783+0000","last_undegraded":"2023-09-13T06:08:42.413783+0000","last_fullsized":"2023-09-13T06:08:42.413783+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:49:56.371062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410582+0000","last_change":"2023-09-13T06:08:42.404646+0000","last_active":"2023-09-13T06:08:43.410582+0000","last_peered":"2023-09-13T06:08:43.410582+0000","last_clean":"2023-09-13T06:08:43.410582+0000","last_became_active":"2023-09-13T06:08:42.404374+0000","last_became_peered":"2023-09-13T06:08:42.404374+0000","last_unstale":"2023-09-13T06:08:43.410582+0000","last_undegraded":"2023-09-13T06:08:43.410582+0000","last_fullsized":"2023-09-13T06:08:43.410582+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:50:00.610064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406661+0000","last_change":"2023-09-13T06:08:42.418526+0000","last_active":"2023-09-13T06:08:43.406661+0000","last_peered":"2023-09-13T06:08:43.406661+0000","last_clean":"2023-09-13T06:08:43.406661+0000","last_became_active":"2023-09-13T06:08:42.418046+0000","last_became_peered":"2023-09-13T06:08:42.418046+0000","last_unstale":"2023-09-13T06:08:43.406661+0000","last_undegraded":"2023-09-13T06:08:43.406661+0000","last_fullsized":"2023-09-13T06:08:43.406661+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:32:25.906643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406792+0000","last_change":"2023-09-13T06:08:42.420244+0000","last_active":"2023-09-13T06:08:43.406792+0000","last_peered":"2023-09-13T06:08:43.406792+0000","last_clean":"2023-09-13T06:08:43.406792+0000","last_became_active":"2023-09-13T06:08:42.419388+0000","last_became_peered":"2023-09-13T06:08:42.419388+0000","last_unstale":"2023-09-13T06:08:43.406792+0000","last_undegraded":"2023-09-13T06:08:43.406792+0000","last_fullsized":"2023-09-13T06:08:43.406792+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:19.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.417148+0000","last_change":"2023-09-13T06:08:42.417053+0000","last_active":"2023-09-13T06:08:42.417148+0000","last_peered":"2023-09-13T06:08:42.417148+0000","last_clean":"2023-09-13T06:08:42.417148+0000","last_became_active":"2023-09-13T06:08:42.415215+0000","last_became_peered":"2023-09-13T06:08:42.415215+0000","last_unstale":"2023-09-13T06:08:42.417148+0000","last_undegraded":"2023-09-13T06:08:42.417148+0000","last_fullsized":"2023-09-13T06:08:42.417148+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:03:00.611766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413620+0000","last_change":"2023-09-13T06:08:42.413362+0000","last_active":"2023-09-13T06:08:42.413620+0000","last_peered":"2023-09-13T06:08:42.413620+0000","last_clean":"2023-09-13T06:08:42.413620+0000","last_became_active":"2023-09-13T06:08:42.413091+0000","last_became_peered":"2023-09-13T06:08:42.413091+0000","last_unstale":"2023-09-13T06:08:42.413620+0000","last_undegraded":"2023-09-13T06:08:42.413620+0000","last_fullsized":"2023-09-13T06:08:42.413620+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:04:04.419844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411768+0000","last_change":"2023-09-13T06:08:42.411576+0000","last_active":"2023-09-13T06:08:42.411768+0000","last_peered":"2023-09-13T06:08:42.411768+0000","last_clean":"2023-09-13T06:08:42.411768+0000","last_became_active":"2023-09-13T06:08:42.410808+0000","last_became_peered":"2023-09-13T06:08:42.410808+0000","last_unstale":"2023-09-13T06:08:42.411768+0000","last_undegraded":"2023-09-13T06:08:42.411768+0000","last_fullsized":"2023-09-13T06:08:42.411768+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:52:07.525075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.406265+0000","last_change":"2023-09-13T06:08:42.406217+0000","last_active":"2023-09-13T06:08:42.406265+0000","last_peered":"2023-09-13T06:08:42.406265+0000","last_clean":"2023-09-13T06:08:42.406265+0000","last_became_active":"2023-09-13T06:08:42.405942+0000","last_became_peered":"2023-09-13T06:08:42.405942+0000","last_unstale":"2023-09-13T06:08:42.406265+0000","last_undegraded":"2023-09-13T06:08:42.406265+0000","last_fullsized":"2023-09-13T06:08:42.406265+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:46:12.907659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413591+0000","last_change":"2023-09-13T06:08:42.413331+0000","last_active":"2023-09-13T06:08:42.413591+0000","last_peered":"2023-09-13T06:08:42.413591+0000","last_clean":"2023-09-13T06:08:42.413591+0000","last_became_active":"2023-09-13T06:08:42.413059+0000","last_became_peered":"2023-09-13T06:08:42.413059+0000","last_unstale":"2023-09-13T06:08:42.413591+0000","last_undegraded":"2023-09-13T06:08:42.413591+0000","last_fullsized":"2023-09-13T06:08:42.413591+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:37:26.564665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411394+0000","last_change":"2023-09-13T06:08:42.410551+0000","last_active":"2023-09-13T06:08:42.411394+0000","last_peered":"2023-09-13T06:08:42.411394+0000","last_clean":"2023-09-13T06:08:42.411394+0000","last_became_active":"2023-09-13T06:08:42.410266+0000","last_became_peered":"2023-09-13T06:08:42.410266+0000","last_unstale":"2023-09-13T06:08:42.411394+0000","last_undegraded":"2023-09-13T06:08:42.411394+0000","last_fullsized":"2023-09-13T06:08:42.411394+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:48:08.746602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.412554+0000","last_change":"2023-09-13T06:08:42.412475+0000","last_active":"2023-09-13T06:08:42.412554+0000","last_peered":"2023-09-13T06:08:42.412554+0000","last_clean":"2023-09-13T06:08:42.412554+0000","last_became_active":"2023-09-13T06:08:42.412239+0000","last_became_peered":"2023-09-13T06:08:42.412239+0000","last_unstale":"2023-09-13T06:08:42.412554+0000","last_undegraded":"2023-09-13T06:08:42.412554+0000","last_fullsized":"2023-09-13T06:08:42.412554+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:50:16.270083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.415983+0000","last_change":"2023-09-13T06:08:42.415922+0000","last_active":"2023-09-13T06:08:42.415983+0000","last_peered":"2023-09-13T06:08:42.415983+0000","last_clean":"2023-09-13T06:08:42.415983+0000","last_became_active":"2023-09-13T06:08:42.415416+0000","last_became_peered":"2023-09-13T06:08:42.415416+0000","last_unstale":"2023-09-13T06:08:42.415983+0000","last_undegraded":"2023-09-13T06:08:42.415983+0000","last_fullsized":"2023-09-13T06:08:42.415983+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:55:13.573431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413763+0000","last_change":"2023-09-13T06:08:42.413707+0000","last_active":"2023-09-13T06:08:42.413763+0000","last_peered":"2023-09-13T06:08:42.413763+0000","last_clean":"2023-09-13T06:08:42.413763+0000","last_became_active":"2023-09-13T06:08:42.413238+0000","last_became_peered":"2023-09-13T06:08:42.413238+0000","last_unstale":"2023-09-13T06:08:42.413763+0000","last_undegraded":"2023-09-13T06:08:42.413763+0000","last_fullsized":"2023-09-13T06:08:42.413763+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:36:03.743621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.407051+0000","last_change":"2023-09-13T06:08:42.419924+0000","last_active":"2023-09-13T06:08:43.407051+0000","last_peered":"2023-09-13T06:08:43.407051+0000","last_clean":"2023-09-13T06:08:43.407051+0000","last_became_active":"2023-09-13T06:08:42.418628+0000","last_became_peered":"2023-09-13T06:08:42.418628+0000","last_unstale":"2023-09-13T06:08:43.407051+0000","last_undegraded":"2023-09-13T06:08:43.407051+0000","last_fullsized":"2023-09-13T06:08:43.407051+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:23:27.173378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411791+0000","last_change":"2023-09-13T06:08:42.411700+0000","last_active":"2023-09-13T06:08:42.411791+0000","last_peered":"2023-09-13T06:08:42.411791+0000","last_clean":"2023-09-13T06:08:42.411791+0000","last_became_active":"2023-09-13T06:08:42.410917+0000","last_became_peered":"2023-09-13T06:08:42.410917+0000","last_unstale":"2023-09-13T06:08:42.411791+0000","last_undegraded":"2023-09-13T06:08:42.411791+0000","last_fullsized":"2023-09-13T06:08:42.411791+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:06:51.353638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.409217+0000","last_change":"2023-09-13T06:08:42.409147+0000","last_active":"2023-09-13T06:08:42.409217+0000","last_peered":"2023-09-13T06:08:42.409217+0000","last_clean":"2023-09-13T06:08:42.409217+0000","last_became_active":"2023-09-13T06:08:42.408903+0000","last_became_peered":"2023-09-13T06:08:42.408903+0000","last_unstale":"2023-09-13T06:08:42.409217+0000","last_undegraded":"2023-09-13T06:08:42.409217+0000","last_fullsized":"2023-09-13T06:08:42.409217+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:12:18.102557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.405683+0000","last_change":"2023-09-13T06:08:42.405556+0000","last_active":"2023-09-13T06:08:42.405683+0000","last_peered":"2023-09-13T06:08:42.405683+0000","last_clean":"2023-09-13T06:08:42.405683+0000","last_became_active":"2023-09-13T06:08:42.405269+0000","last_became_peered":"2023-09-13T06:08:42.405269+0000","last_unstale":"2023-09-13T06:08:42.405683+0000","last_undegraded":"2023-09-13T06:08:42.405683+0000","last_fullsized":"2023-09-13T06:08:42.405683+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:02:59.212781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410840+0000","last_change":"2023-09-13T06:08:42.411740+0000","last_active":"2023-09-13T06:08:43.410840+0000","last_peered":"2023-09-13T06:08:43.410840+0000","last_clean":"2023-09-13T06:08:43.410840+0000","last_became_active":"2023-09-13T06:08:42.411508+0000","last_became_peered":"2023-09-13T06:08:42.411508+0000","last_unstale":"2023-09-13T06:08:43.410840+0000","last_undegraded":"2023-09-13T06:08:43.410840+0000","last_fullsized":"2023-09-13T06:08:43.410840+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:25:45.735630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.406249+0000","last_change":"2023-09-13T06:08:42.406181+0000","last_active":"2023-09-13T06:08:42.406249+0000","last_peered":"2023-09-13T06:08:42.406249+0000","last_clean":"2023-09-13T06:08:42.406249+0000","last_became_active":"2023-09-13T06:08:42.405952+0000","last_became_peered":"2023-09-13T06:08:42.405952+0000","last_unstale":"2023-09-13T06:08:42.406249+0000","last_undegraded":"2023-09-13T06:08:42.406249+0000","last_fullsized":"2023-09-13T06:08:42.406249+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:23:24.503135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.416356+0000","last_change":"2023-09-13T06:08:42.416263+0000","last_active":"2023-09-13T06:08:42.416356+0000","last_peered":"2023-09-13T06:08:42.416356+0000","last_clean":"2023-09-13T06:08:42.416356+0000","last_became_active":"2023-09-13T06:08:42.414325+0000","last_became_peered":"2023-09-13T06:08:42.414325+0000","last_unstale":"2023-09-13T06:08:42.416356+0000","last_undegraded":"2023-09-13T06:08:42.416356+0000","last_fullsized":"2023-09-13T06:08:42.416356+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:25:18.573622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.408288+0000","last_change":"2023-09-13T06:08:42.408221+0000","last_active":"2023-09-13T06:08:42.408288+0000","last_peered":"2023-09-13T06:08:42.408288+0000","last_clean":"2023-09-13T06:08:42.408288+0000","last_became_active":"2023-09-13T06:08:42.408000+0000","last_became_peered":"2023-09-13T06:08:42.408000+0000","last_unstale":"2023-09-13T06:08:42.408288+0000","last_undegraded":"2023-09-13T06:08:42.408288+0000","last_fullsized":"2023-09-13T06:08:42.408288+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:10:55.652139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411528+0000","last_change":"2023-09-13T06:08:42.411422+0000","last_active":"2023-09-13T06:08:42.411528+0000","last_peered":"2023-09-13T06:08:42.411528+0000","last_clean":"2023-09-13T06:08:42.411528+0000","last_became_active":"2023-09-13T06:08:42.410509+0000","last_became_peered":"2023-09-13T06:08:42.410509+0000","last_unstale":"2023-09-13T06:08:42.411528+0000","last_undegraded":"2023-09-13T06:08:42.411528+0000","last_fullsized":"2023-09-13T06:08:42.411528+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:12.672357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413639+0000","last_change":"2023-09-13T06:08:42.413573+0000","last_active":"2023-09-13T06:08:42.413639+0000","last_peered":"2023-09-13T06:08:42.413639+0000","last_clean":"2023-09-13T06:08:42.413639+0000","last_became_active":"2023-09-13T06:08:42.412918+0000","last_became_peered":"2023-09-13T06:08:42.412918+0000","last_unstale":"2023-09-13T06:08:42.413639+0000","last_undegraded":"2023-09-13T06:08:42.413639+0000","last_fullsized":"2023-09-13T06:08:42.413639+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:46:11.972388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.420883+0000","last_change":"2023-09-13T06:08:42.420837+0000","last_active":"2023-09-13T06:08:42.420883+0000","last_peered":"2023-09-13T06:08:42.420883+0000","last_clean":"2023-09-13T06:08:42.420883+0000","last_became_active":"2023-09-13T06:08:42.420712+0000","last_became_peered":"2023-09-13T06:08:42.420712+0000","last_unstale":"2023-09-13T06:08:42.420883+0000","last_undegraded":"2023-09-13T06:08:42.420883+0000","last_fullsized":"2023-09-13T06:08:42.420883+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:19:07.900510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413052+0000","last_change":"2023-09-13T06:08:42.406156+0000","last_active":"2023-09-13T06:08:43.413052+0000","last_peered":"2023-09-13T06:08:43.413052+0000","last_clean":"2023-09-13T06:08:43.413052+0000","last_became_active":"2023-09-13T06:08:42.405896+0000","last_became_peered":"2023-09-13T06:08:42.405896+0000","last_unstale":"2023-09-13T06:08:43.413052+0000","last_undegraded":"2023-09-13T06:08:43.413052+0000","last_fullsized":"2023-09-13T06:08:43.413052+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:31:02.386505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413294+0000","last_change":"2023-09-13T06:08:42.413206+0000","last_active":"2023-09-13T06:08:42.413294+0000","last_peered":"2023-09-13T06:08:42.413294+0000","last_clean":"2023-09-13T06:08:42.413294+0000","last_became_active":"2023-09-13T06:08:42.412963+0000","last_became_peered":"2023-09-13T06:08:42.412963+0000","last_unstale":"2023-09-13T06:08:42.413294+0000","last_undegraded":"2023-09-13T06:08:42.413294+0000","last_fullsized":"2023-09-13T06:08:42.413294+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:05:19.372490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.415912+0000","last_change":"2023-09-13T06:08:42.415773+0000","last_active":"2023-09-13T06:08:42.415912+0000","last_peered":"2023-09-13T06:08:42.415912+0000","last_clean":"2023-09-13T06:08:42.415912+0000","last_became_active":"2023-09-13T06:08:42.415064+0000","last_became_peered":"2023-09-13T06:08:42.415064+0000","last_unstale":"2023-09-13T06:08:42.415912+0000","last_undegraded":"2023-09-13T06:08:42.415912+0000","last_fullsized":"2023-09-13T06:08:42.415912+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:00:22.342329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410343+0000","last_change":"2023-09-13T06:08:42.413675+0000","last_active":"2023-09-13T06:08:43.410343+0000","last_peered":"2023-09-13T06:08:43.410343+0000","last_clean":"2023-09-13T06:08:43.410343+0000","last_became_active":"2023-09-13T06:08:42.413263+0000","last_became_peered":"2023-09-13T06:08:42.413263+0000","last_unstale":"2023-09-13T06:08:43.410343+0000","last_undegraded":"2023-09-13T06:08:43.410343+0000","last_fullsized":"2023-09-13T06:08:43.410343+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:56:35.237222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406931+0000","last_change":"2023-09-13T06:08:42.419666+0000","last_active":"2023-09-13T06:08:43.406931+0000","last_peered":"2023-09-13T06:08:43.406931+0000","last_clean":"2023-09-13T06:08:43.406931+0000","last_became_active":"2023-09-13T06:08:42.417622+0000","last_became_peered":"2023-09-13T06:08:42.417622+0000","last_unstale":"2023-09-13T06:08:43.406931+0000","last_undegraded":"2023-09-13T06:08:43.406931+0000","last_fullsized":"2023-09-13T06:08:43.406931+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:45:53.231561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.408109+0000","last_change":"2023-09-13T06:08:42.407917+0000","last_active":"2023-09-13T06:08:42.408109+0000","last_peered":"2023-09-13T06:08:42.408109+0000","last_clean":"2023-09-13T06:08:42.408109+0000","last_became_active":"2023-09-13T06:08:42.407365+0000","last_became_peered":"2023-09-13T06:08:42.407365+0000","last_unstale":"2023-09-13T06:08:42.408109+0000","last_undegraded":"2023-09-13T06:08:42.408109+0000","last_fullsized":"2023-09-13T06:08:42.408109+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:07:50.392665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"154'4","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410513+0000","last_change":"2023-09-13T06:08:41.656637+0000","last_active":"2023-09-13T06:08:43.410513+0000","last_peered":"2023-09-13T06:08:43.410513+0000","last_clean":"2023-09-13T06:08:43.410513+0000","last_became_active":"2023-09-13T06:08:41.656400+0000","last_became_peered":"2023-09-13T06:08:41.656400+0000","last_unstale":"2023-09-13T06:08:43.410513+0000","last_undegraded":"2023-09-13T06:08:43.410513+0000","last_fullsized":"2023-09-13T06:08:43.410513+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:18.178803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.416784+0000","last_change":"2023-09-13T06:08:42.416609+0000","last_active":"2023-09-13T06:08:42.416784+0000","last_peered":"2023-09-13T06:08:42.416784+0000","last_clean":"2023-09-13T06:08:42.416784+0000","last_became_active":"2023-09-13T06:08:42.414848+0000","last_became_peered":"2023-09-13T06:08:42.414848+0000","last_unstale":"2023-09-13T06:08:42.416784+0000","last_undegraded":"2023-09-13T06:08:42.416784+0000","last_fullsized":"2023-09-13T06:08:42.416784+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:11:07.112195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"154'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413247+0000","last_change":"2023-09-13T06:08:41.651586+0000","last_active":"2023-09-13T06:08:43.413247+0000","last_peered":"2023-09-13T06:08:43.413247+0000","last_clean":"2023-09-13T06:08:43.413247+0000","last_became_active":"2023-09-13T06:08:41.651292+0000","last_became_peered":"2023-09-13T06:08:41.651292+0000","last_unstale":"2023-09-13T06:08:43.413247+0000","last_undegraded":"2023-09-13T06:08:43.413247+0000","last_fullsized":"2023-09-13T06:08:43.413247+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:39:01.793594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410526+0000","last_change":"2023-09-13T06:08:42.409900+0000","last_active":"2023-09-13T06:08:43.410526+0000","last_peered":"2023-09-13T06:08:43.410526+0000","last_clean":"2023-09-13T06:08:43.410526+0000","last_became_active":"2023-09-13T06:08:42.409655+0000","last_became_peered":"2023-09-13T06:08:42.409655+0000","last_unstale":"2023-09-13T06:08:43.410526+0000","last_undegraded":"2023-09-13T06:08:43.410526+0000","last_fullsized":"2023-09-13T06:08:43.410526+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:38:08.475495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"154'2","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.671250+0000","last_change":"2023-09-13T06:08:41.652735+0000","last_active":"2023-09-13T06:08:42.671250+0000","last_peered":"2023-09-13T06:08:42.671250+0000","last_clean":"2023-09-13T06:08:42.671250+0000","last_became_active":"2023-09-13T06:08:41.652503+0000","last_became_peered":"2023-09-13T06:08:41.652503+0000","last_unstale":"2023-09-13T06:08:42.671250+0000","last_undegraded":"2023-09-13T06:08:42.671250+0000","last_fullsized":"2023-09-13T06:08:42.671250+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:15:34.317452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410672+0000","last_change":"2023-09-13T06:08:42.411880+0000","last_active":"2023-09-13T06:08:43.410672+0000","last_peered":"2023-09-13T06:08:43.410672+0000","last_clean":"2023-09-13T06:08:43.410672+0000","last_became_active":"2023-09-13T06:08:42.411630+0000","last_became_peered":"2023-09-13T06:08:42.411630+0000","last_unstale":"2023-09-13T06:08:43.410672+0000","last_undegraded":"2023-09-13T06:08:43.410672+0000","last_fullsized":"2023-09-13T06:08:43.410672+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:42:10.314667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"154'2","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.671200+0000","last_change":"2023-09-13T06:08:41.651425+0000","last_active":"2023-09-13T06:08:42.671200+0000","last_peered":"2023-09-13T06:08:42.671200+0000","last_clean":"2023-09-13T06:08:42.671200+0000","last_became_active":"2023-09-13T06:08:41.651026+0000","last_became_peered":"2023-09-13T06:08:41.651026+0000","last_unstale":"2023-09-13T06:08:42.671200+0000","last_undegraded":"2023-09-13T06:08:42.671200+0000","last_fullsized":"2023-09-13T06:08:42.671200+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:42:05.854999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411759+0000","last_change":"2023-09-13T06:08:42.411139+0000","last_active":"2023-09-13T06:08:42.411759+0000","last_peered":"2023-09-13T06:08:42.411759+0000","last_clean":"2023-09-13T06:08:42.411759+0000","last_became_active":"2023-09-13T06:08:42.410538+0000","last_became_peered":"2023-09-13T06:08:42.410538+0000","last_unstale":"2023-09-13T06:08:42.411759+0000","last_undegraded":"2023-09-13T06:08:42.411759+0000","last_fullsized":"2023-09-13T06:08:42.411759+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:12:43.475237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"154'1","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.669985+0000","last_change":"2023-09-13T06:08:41.653311+0000","last_active":"2023-09-13T06:08:42.669985+0000","last_peered":"2023-09-13T06:08:42.669985+0000","last_clean":"2023-09-13T06:08:42.669985+0000","last_became_active":"2023-09-13T06:08:41.652792+0000","last_became_peered":"2023-09-13T06:08:41.652792+0000","last_unstale":"2023-09-13T06:08:42.669985+0000","last_undegraded":"2023-09-13T06:08:42.669985+0000","last_fullsized":"2023-09-13T06:08:42.669985+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:12:47.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.407169+0000","last_change":"2023-09-13T06:08:42.420031+0000","last_active":"2023-09-13T06:08:43.407169+0000","last_peered":"2023-09-13T06:08:43.407169+0000","last_clean":"2023-09-13T06:08:43.407169+0000","last_became_active":"2023-09-13T06:08:42.418903+0000","last_became_peered":"2023-09-13T06:08:42.418903+0000","last_unstale":"2023-09-13T06:08:43.407169+0000","last_undegraded":"2023-09-13T06:08:43.407169+0000","last_fullsized":"2023-09-13T06:08:43.407169+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:27.629327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"154'1","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.671742+0000","last_change":"2023-09-13T06:08:41.649545+0000","last_active":"2023-09-13T06:08:42.671742+0000","last_peered":"2023-09-13T06:08:42.671742+0000","last_clean":"2023-09-13T06:08:42.671742+0000","last_became_active":"2023-09-13T06:08:41.649325+0000","last_became_peered":"2023-09-13T06:08:41.649325+0000","last_unstale":"2023-09-13T06:08:42.671742+0000","last_undegraded":"2023-09-13T06:08:42.671742+0000","last_fullsized":"2023-09-13T06:08:42.671742+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:09:28.485978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411129+0000","last_change":"2023-09-13T06:08:42.410380+0000","last_active":"2023-09-13T06:08:42.411129+0000","last_peered":"2023-09-13T06:08:42.411129+0000","last_clean":"2023-09-13T06:08:42.411129+0000","last_became_active":"2023-09-13T06:08:42.410118+0000","last_became_peered":"2023-09-13T06:08:42.410118+0000","last_unstale":"2023-09-13T06:08:42.411129+0000","last_undegraded":"2023-09-13T06:08:42.411129+0000","last_fullsized":"2023-09-13T06:08:42.411129+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:59:41.814253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406731+0000","last_change":"2023-09-13T06:08:41.655889+0000","last_active":"2023-09-13T06:08:43.406731+0000","last_peered":"2023-09-13T06:08:43.406731+0000","last_clean":"2023-09-13T06:08:43.406731+0000","last_became_active":"2023-09-13T06:08:41.655656+0000","last_became_peered":"2023-09-13T06:08:41.655656+0000","last_unstale":"2023-09-13T06:08:43.406731+0000","last_undegraded":"2023-09-13T06:08:43.406731+0000","last_fullsized":"2023-09-13T06:08:43.406731+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:44:25.754787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.406309+0000","last_change":"2023-09-13T06:08:42.406244+0000","last_active":"2023-09-13T06:08:42.406309+0000","last_peered":"2023-09-13T06:08:42.406309+0000","last_clean":"2023-09-13T06:08:42.406309+0000","last_became_active":"2023-09-13T06:08:42.405945+0000","last_became_peered":"2023-09-13T06:08:42.405945+0000","last_unstale":"2023-09-13T06:08:42.406309+0000","last_undegraded":"2023-09-13T06:08:42.406309+0000","last_fullsized":"2023-09-13T06:08:42.406309+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:28:53.785502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.404695+0000","last_change":"2023-09-13T06:08:41.656185+0000","last_active":"2023-09-13T06:08:42.404695+0000","last_peered":"2023-09-13T06:08:42.404695+0000","last_clean":"2023-09-13T06:08:42.404695+0000","last_became_active":"2023-09-13T06:08:41.655967+0000","last_became_peered":"2023-09-13T06:08:41.655967+0000","last_unstale":"2023-09-13T06:08:42.404695+0000","last_undegraded":"2023-09-13T06:08:42.404695+0000","last_fullsized":"2023-09-13T06:08:42.404695+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:10:58.933914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.412466+0000","last_change":"2023-09-13T06:08:42.412378+0000","last_active":"2023-09-13T06:08:42.412466+0000","last_peered":"2023-09-13T06:08:42.412466+0000","last_clean":"2023-09-13T06:08:42.412466+0000","last_became_active":"2023-09-13T06:08:42.412158+0000","last_became_peered":"2023-09-13T06:08:42.412158+0000","last_unstale":"2023-09-13T06:08:42.412466+0000","last_undegraded":"2023-09-13T06:08:42.412466+0000","last_fullsized":"2023-09-13T06:08:42.412466+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:39:48.939821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413317+0000","last_change":"2023-09-13T06:08:41.655684+0000","last_active":"2023-09-13T06:08:43.413317+0000","last_peered":"2023-09-13T06:08:43.413317+0000","last_clean":"2023-09-13T06:08:43.413317+0000","last_became_active":"2023-09-13T06:08:41.655273+0000","last_became_peered":"2023-09-13T06:08:41.655273+0000","last_unstale":"2023-09-13T06:08:43.413317+0000","last_undegraded":"2023-09-13T06:08:43.413317+0000","last_fullsized":"2023-09-13T06:08:43.413317+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:17:14.437223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413222+0000","last_change":"2023-09-13T06:08:42.412128+0000","last_active":"2023-09-13T06:08:43.413222+0000","last_peered":"2023-09-13T06:08:43.413222+0000","last_clean":"2023-09-13T06:08:43.413222+0000","last_became_active":"2023-09-13T06:08:42.411871+0000","last_became_peered":"2023-09-13T06:08:42.411871+0000","last_unstale":"2023-09-13T06:08:43.413222+0000","last_undegraded":"2023-09-13T06:08:43.413222+0000","last_fullsized":"2023-09-13T06:08:43.413222+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:15:38.711696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.400399+0000","last_change":"2023-09-13T06:08:41.655945+0000","last_active":"2023-09-13T06:08:42.400399+0000","last_peered":"2023-09-13T06:08:42.400399+0000","last_clean":"2023-09-13T06:08:42.400399+0000","last_became_active":"2023-09-13T06:08:41.655528+0000","last_became_peered":"2023-09-13T06:08:41.655528+0000","last_unstale":"2023-09-13T06:08:42.400399+0000","last_undegraded":"2023-09-13T06:08:42.400399+0000","last_fullsized":"2023-09-13T06:08:42.400399+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:37.260030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410560+0000","last_change":"2023-09-13T06:08:42.404897+0000","last_active":"2023-09-13T06:08:43.410560+0000","last_peered":"2023-09-13T06:08:43.410560+0000","last_clean":"2023-09-13T06:08:43.410560+0000","last_became_active":"2023-09-13T06:08:42.404648+0000","last_became_peered":"2023-09-13T06:08:42.404648+0000","last_unstale":"2023-09-13T06:08:43.410560+0000","last_undegraded":"2023-09-13T06:08:43.410560+0000","last_fullsized":"2023-09-13T06:08:43.410560+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:21:51.914029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"154'3","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413154+0000","last_change":"2023-09-13T06:08:41.649702+0000","last_active":"2023-09-13T06:08:43.413154+0000","last_peered":"2023-09-13T06:08:43.413154+0000","last_clean":"2023-09-13T06:08:43.413154+0000","last_became_active":"2023-09-13T06:08:41.649463+0000","last_became_peered":"2023-09-13T06:08:41.649463+0000","last_unstale":"2023-09-13T06:08:43.413154+0000","last_undegraded":"2023-09-13T06:08:43.413154+0000","last_fullsized":"2023-09-13T06:08:43.413154+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:12:42.486048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410383+0000","last_change":"2023-09-13T06:08:42.415955+0000","last_active":"2023-09-13T06:08:43.410383+0000","last_peered":"2023-09-13T06:08:43.410383+0000","last_clean":"2023-09-13T06:08:43.410383+0000","last_became_active":"2023-09-13T06:08:42.415730+0000","last_became_peered":"2023-09-13T06:08:42.415730+0000","last_unstale":"2023-09-13T06:08:43.410383+0000","last_undegraded":"2023-09-13T06:08:43.410383+0000","last_fullsized":"2023-09-13T06:08:43.410383+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:49:53.962623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"154'6","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.674948+0000","last_change":"2023-09-13T06:08:41.658018+0000","last_active":"2023-09-13T06:08:42.674948+0000","last_peered":"2023-09-13T06:08:42.674948+0000","last_clean":"2023-09-13T06:08:42.674948+0000","last_became_active":"2023-09-13T06:08:41.657617+0000","last_became_peered":"2023-09-13T06:08:41.657617+0000","last_unstale":"2023-09-13T06:08:42.674948+0000","last_undegraded":"2023-09-13T06:08:42.674948+0000","last_fullsized":"2023-09-13T06:08:42.674948+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:18:29.012321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411708+0000","last_change":"2023-09-13T06:08:42.411303+0000","last_active":"2023-09-13T06:08:42.411708+0000","last_peered":"2023-09-13T06:08:42.411708+0000","last_clean":"2023-09-13T06:08:42.411708+0000","last_became_active":"2023-09-13T06:08:42.411087+0000","last_became_peered":"2023-09-13T06:08:42.411087+0000","last_unstale":"2023-09-13T06:08:42.411708+0000","last_undegraded":"2023-09-13T06:08:42.411708+0000","last_fullsized":"2023-09-13T06:08:42.411708+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:45:01.041813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411979+0000","last_change":"2023-09-13T06:08:41.657234+0000","last_active":"2023-09-13T06:08:42.411979+0000","last_peered":"2023-09-13T06:08:42.411979+0000","last_clean":"2023-09-13T06:08:42.411979+0000","last_became_active":"2023-09-13T06:08:41.656927+0000","last_became_peered":"2023-09-13T06:08:41.656927+0000","last_unstale":"2023-09-13T06:08:42.411979+0000","last_undegraded":"2023-09-13T06:08:42.411979+0000","last_fullsized":"2023-09-13T06:08:42.411979+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:34:30.329479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.414933+0000","last_change":"2023-09-13T06:08:42.414865+0000","last_active":"2023-09-13T06:08:42.414933+0000","last_peered":"2023-09-13T06:08:42.414933+0000","last_clean":"2023-09-13T06:08:42.414933+0000","last_became_active":"2023-09-13T06:08:42.414576+0000","last_became_peered":"2023-09-13T06:08:42.414576+0000","last_unstale":"2023-09-13T06:08:42.414933+0000","last_undegraded":"2023-09-13T06:08:42.414933+0000","last_fullsized":"2023-09-13T06:08:42.414933+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:24:40.356187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.403799+0000","last_change":"2023-09-13T06:08:41.653152+0000","last_active":"2023-09-13T06:08:42.403799+0000","last_peered":"2023-09-13T06:08:42.403799+0000","last_clean":"2023-09-13T06:08:42.403799+0000","last_became_active":"2023-09-13T06:08:41.652440+0000","last_became_peered":"2023-09-13T06:08:41.652440+0000","last_unstale":"2023-09-13T06:08:42.403799+0000","last_undegraded":"2023-09-13T06:08:42.403799+0000","last_fullsized":"2023-09-13T06:08:42.403799+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:13:01.641923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411803+0000","last_change":"2023-09-13T06:08:42.411723+0000","last_active":"2023-09-13T06:08:42.411803+0000","last_peered":"2023-09-13T06:08:42.411803+0000","last_clean":"2023-09-13T06:08:42.411803+0000","last_became_active":"2023-09-13T06:08:42.411324+0000","last_became_peered":"2023-09-13T06:08:42.411324+0000","last_unstale":"2023-09-13T06:08:42.411803+0000","last_undegraded":"2023-09-13T06:08:42.411803+0000","last_fullsized":"2023-09-13T06:08:42.411803+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:01.010803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"154'8","reported_seq":19,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.675622+0000","last_change":"2023-09-13T06:08:41.654455+0000","last_active":"2023-09-13T06:08:42.675622+0000","last_peered":"2023-09-13T06:08:42.675622+0000","last_clean":"2023-09-13T06:08:42.675622+0000","last_became_active":"2023-09-13T06:08:41.654048+0000","last_became_peered":"2023-09-13T06:08:41.654048+0000","last_unstale":"2023-09-13T06:08:42.675622+0000","last_undegraded":"2023-09-13T06:08:42.675622+0000","last_fullsized":"2023-09-13T06:08:42.675622+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:26:21.286899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.414345+0000","last_change":"2023-09-13T06:08:42.414170+0000","last_active":"2023-09-13T06:08:42.414345+0000","last_peered":"2023-09-13T06:08:42.414345+0000","last_clean":"2023-09-13T06:08:42.414345+0000","last_became_active":"2023-09-13T06:08:42.413839+0000","last_became_peered":"2023-09-13T06:08:42.413839+0000","last_unstale":"2023-09-13T06:08:42.414345+0000","last_undegraded":"2023-09-13T06:08:42.414345+0000","last_fullsized":"2023-09-13T06:08:42.414345+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:22:05.810462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"154'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413339+0000","last_change":"2023-09-13T06:08:41.647965+0000","last_active":"2023-09-13T06:08:43.413339+0000","last_peered":"2023-09-13T06:08:43.413339+0000","last_clean":"2023-09-13T06:08:43.413339+0000","last_became_active":"2023-09-13T06:08:41.647685+0000","last_became_peered":"2023-09-13T06:08:41.647685+0000","last_unstale":"2023-09-13T06:08:43.413339+0000","last_undegraded":"2023-09-13T06:08:43.413339+0000","last_fullsized":"2023-09-13T06:08:43.413339+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:23:08.750493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413059+0000","last_change":"2023-09-13T06:08:42.405035+0000","last_active":"2023-09-13T06:08:43.413059+0000","last_peered":"2023-09-13T06:08:43.413059+0000","last_clean":"2023-09-13T06:08:43.413059+0000","last_became_active":"2023-09-13T06:08:42.404804+0000","last_became_peered":"2023-09-13T06:08:42.404804+0000","last_unstale":"2023-09-13T06:08:43.413059+0000","last_undegraded":"2023-09-13T06:08:43.413059+0000","last_fullsized":"2023-09-13T06:08:43.413059+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:50:16.270083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"154'2","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.673002+0000","last_change":"2023-09-13T06:08:41.655681+0000","last_active":"2023-09-13T06:08:42.673002+0000","last_peered":"2023-09-13T06:08:42.673002+0000","last_clean":"2023-09-13T06:08:42.673002+0000","last_became_active":"2023-09-13T06:08:41.655342+0000","last_became_peered":"2023-09-13T06:08:41.655342+0000","last_unstale":"2023-09-13T06:08:42.673002+0000","last_undegraded":"2023-09-13T06:08:42.673002+0000","last_fullsized":"2023-09-13T06:08:42.673002+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:09:12.548554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413315+0000","last_change":"2023-09-13T06:08:42.413250+0000","last_active":"2023-09-13T06:08:42.413315+0000","last_peered":"2023-09-13T06:08:42.413315+0000","last_clean":"2023-09-13T06:08:42.413315+0000","last_became_active":"2023-09-13T06:08:42.413046+0000","last_became_peered":"2023-09-13T06:08:42.413046+0000","last_unstale":"2023-09-13T06:08:42.413315+0000","last_undegraded":"2023-09-13T06:08:42.413315+0000","last_fullsized":"2023-09-13T06:08:42.413315+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:45:52.339839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"154'1","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406840+0000","last_change":"2023-09-13T06:08:41.653490+0000","last_active":"2023-09-13T06:08:43.406840+0000","last_peered":"2023-09-13T06:08:43.406840+0000","last_clean":"2023-09-13T06:08:43.406840+0000","last_became_active":"2023-09-13T06:08:41.653252+0000","last_became_peered":"2023-09-13T06:08:41.653252+0000","last_unstale":"2023-09-13T06:08:43.406840+0000","last_undegraded":"2023-09-13T06:08:43.406840+0000","last_fullsized":"2023-09-13T06:08:43.406840+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:22:51.653858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.406530+0000","last_change":"2023-09-13T06:08:42.406466+0000","last_active":"2023-09-13T06:08:42.406530+0000","last_peered":"2023-09-13T06:08:42.406530+0000","last_clean":"2023-09-13T06:08:42.406530+0000","last_became_active":"2023-09-13T06:08:42.406236+0000","last_became_peered":"2023-09-13T06:08:42.406236+0000","last_unstale":"2023-09-13T06:08:42.406530+0000","last_undegraded":"2023-09-13T06:08:42.406530+0000","last_fullsized":"2023-09-13T06:08:42.406530+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:46:02.148778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413084+0000","last_change":"2023-09-13T06:08:41.650880+0000","last_active":"2023-09-13T06:08:43.413084+0000","last_peered":"2023-09-13T06:08:43.413084+0000","last_clean":"2023-09-13T06:08:43.413084+0000","last_became_active":"2023-09-13T06:08:41.650641+0000","last_became_peered":"2023-09-13T06:08:41.650641+0000","last_unstale":"2023-09-13T06:08:43.413084+0000","last_undegraded":"2023-09-13T06:08:43.413084+0000","last_fullsized":"2023-09-13T06:08:43.413084+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:04:23.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411411+0000","last_change":"2023-09-13T06:08:42.410649+0000","last_active":"2023-09-13T06:08:42.411411+0000","last_peered":"2023-09-13T06:08:42.411411+0000","last_clean":"2023-09-13T06:08:42.411411+0000","last_became_active":"2023-09-13T06:08:42.410391+0000","last_became_peered":"2023-09-13T06:08:42.410391+0000","last_unstale":"2023-09-13T06:08:42.411411+0000","last_undegraded":"2023-09-13T06:08:42.411411+0000","last_fullsized":"2023-09-13T06:08:42.411411+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:05.439767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"154'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.413224+0000","last_change":"2023-09-13T06:08:41.655873+0000","last_active":"2023-09-13T06:08:43.413224+0000","last_peered":"2023-09-13T06:08:43.413224+0000","last_clean":"2023-09-13T06:08:43.413224+0000","last_became_active":"2023-09-13T06:08:41.655542+0000","last_became_peered":"2023-09-13T06:08:41.655542+0000","last_unstale":"2023-09-13T06:08:43.413224+0000","last_undegraded":"2023-09-13T06:08:43.413224+0000","last_fullsized":"2023-09-13T06:08:43.413224+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:05:27.709223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406714+0000","last_change":"2023-09-13T06:08:42.418604+0000","last_active":"2023-09-13T06:08:43.406714+0000","last_peered":"2023-09-13T06:08:43.406714+0000","last_clean":"2023-09-13T06:08:43.406714+0000","last_became_active":"2023-09-13T06:08:42.418080+0000","last_became_peered":"2023-09-13T06:08:42.418080+0000","last_unstale":"2023-09-13T06:08:43.406714+0000","last_undegraded":"2023-09-13T06:08:43.406714+0000","last_fullsized":"2023-09-13T06:08:43.406714+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:45:40.988326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.400540+0000","last_change":"2023-09-13T06:08:41.656047+0000","last_active":"2023-09-13T06:08:42.400540+0000","last_peered":"2023-09-13T06:08:42.400540+0000","last_clean":"2023-09-13T06:08:42.400540+0000","last_became_active":"2023-09-13T06:08:41.655769+0000","last_became_peered":"2023-09-13T06:08:41.655769+0000","last_unstale":"2023-09-13T06:08:42.400540+0000","last_undegraded":"2023-09-13T06:08:42.400540+0000","last_fullsized":"2023-09-13T06:08:42.400540+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:44:25.754787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.406292+0000","last_change":"2023-09-13T06:08:42.405994+0000","last_active":"2023-09-13T06:08:42.406292+0000","last_peered":"2023-09-13T06:08:42.406292+0000","last_clean":"2023-09-13T06:08:42.406292+0000","last_became_active":"2023-09-13T06:08:42.405707+0000","last_became_peered":"2023-09-13T06:08:42.405707+0000","last_unstale":"2023-09-13T06:08:42.406292+0000","last_undegraded":"2023-09-13T06:08:42.406292+0000","last_fullsized":"2023-09-13T06:08:42.406292+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:15:38.711696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.400300+0000","last_change":"2023-09-13T06:08:41.650240+0000","last_active":"2023-09-13T06:08:42.400300+0000","last_peered":"2023-09-13T06:08:42.400300+0000","last_clean":"2023-09-13T06:08:42.400300+0000","last_became_active":"2023-09-13T06:08:41.649648+0000","last_became_peered":"2023-09-13T06:08:41.649648+0000","last_unstale":"2023-09-13T06:08:42.400300+0000","last_undegraded":"2023-09-13T06:08:42.400300+0000","last_fullsized":"2023-09-13T06:08:42.400300+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:50:13.867514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410458+0000","last_change":"2023-09-13T06:08:42.413184+0000","last_active":"2023-09-13T06:08:43.410458+0000","last_peered":"2023-09-13T06:08:43.410458+0000","last_clean":"2023-09-13T06:08:43.410458+0000","last_became_active":"2023-09-13T06:08:42.412926+0000","last_became_peered":"2023-09-13T06:08:42.412926+0000","last_unstale":"2023-09-13T06:08:43.410458+0000","last_undegraded":"2023-09-13T06:08:43.410458+0000","last_fullsized":"2023-09-13T06:08:43.410458+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:30.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.403325+0000","last_change":"2023-09-13T06:08:41.654151+0000","last_active":"2023-09-13T06:08:42.403325+0000","last_peered":"2023-09-13T06:08:42.403325+0000","last_clean":"2023-09-13T06:08:42.403325+0000","last_became_active":"2023-09-13T06:08:41.653929+0000","last_became_peered":"2023-09-13T06:08:41.653929+0000","last_unstale":"2023-09-13T06:08:42.403325+0000","last_undegraded":"2023-09-13T06:08:42.403325+0000","last_fullsized":"2023-09-13T06:08:42.403325+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:20:43.516306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406845+0000","last_change":"2023-09-13T06:08:42.412377+0000","last_active":"2023-09-13T06:08:43.406845+0000","last_peered":"2023-09-13T06:08:43.406845+0000","last_clean":"2023-09-13T06:08:43.406845+0000","last_became_active":"2023-09-13T06:08:42.412074+0000","last_became_peered":"2023-09-13T06:08:42.412074+0000","last_unstale":"2023-09-13T06:08:43.406845+0000","last_undegraded":"2023-09-13T06:08:43.406845+0000","last_fullsized":"2023-09-13T06:08:43.406845+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:50:06.564342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"154'2","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.671429+0000","last_change":"2023-09-13T06:08:41.657898+0000","last_active":"2023-09-13T06:08:42.671429+0000","last_peered":"2023-09-13T06:08:42.671429+0000","last_clean":"2023-09-13T06:08:42.671429+0000","last_became_active":"2023-09-13T06:08:41.657615+0000","last_became_peered":"2023-09-13T06:08:41.657615+0000","last_unstale":"2023-09-13T06:08:42.671429+0000","last_undegraded":"2023-09-13T06:08:42.671429+0000","last_fullsized":"2023-09-13T06:08:42.671429+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:41:01.585581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.414737+0000","last_change":"2023-09-13T06:08:42.414674+0000","last_active":"2023-09-13T06:08:42.414737+0000","last_peered":"2023-09-13T06:08:42.414737+0000","last_clean":"2023-09-13T06:08:42.414737+0000","last_became_active":"2023-09-13T06:08:42.414440+0000","last_became_peered":"2023-09-13T06:08:42.414440+0000","last_unstale":"2023-09-13T06:08:42.414737+0000","last_undegraded":"2023-09-13T06:08:42.414737+0000","last_fullsized":"2023-09-13T06:08:42.414737+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:37:55.423197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410626+0000","last_change":"2023-09-13T06:08:41.650999+0000","last_active":"2023-09-13T06:08:43.410626+0000","last_peered":"2023-09-13T06:08:43.410626+0000","last_clean":"2023-09-13T06:08:43.410626+0000","last_became_active":"2023-09-13T06:08:41.650750+0000","last_became_peered":"2023-09-13T06:08:41.650750+0000","last_unstale":"2023-09-13T06:08:43.410626+0000","last_undegraded":"2023-09-13T06:08:43.410626+0000","last_fullsized":"2023-09-13T06:08:43.410626+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:45:52.224716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.411786+0000","last_change":"2023-09-13T06:08:42.411719+0000","last_active":"2023-09-13T06:08:42.411786+0000","last_peered":"2023-09-13T06:08:42.411786+0000","last_clean":"2023-09-13T06:08:42.411786+0000","last_became_active":"2023-09-13T06:08:42.411134+0000","last_became_peered":"2023-09-13T06:08:42.411134+0000","last_unstale":"2023-09-13T06:08:42.411786+0000","last_undegraded":"2023-09-13T06:08:42.411786+0000","last_fullsized":"2023-09-13T06:08:42.411786+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:47:46.716264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.404127+0000","last_change":"2023-09-13T06:08:41.654329+0000","last_active":"2023-09-13T06:08:42.404127+0000","last_peered":"2023-09-13T06:08:42.404127+0000","last_clean":"2023-09-13T06:08:42.404127+0000","last_became_active":"2023-09-13T06:08:41.654036+0000","last_became_peered":"2023-09-13T06:08:41.654036+0000","last_unstale":"2023-09-13T06:08:42.404127+0000","last_undegraded":"2023-09-13T06:08:42.404127+0000","last_fullsized":"2023-09-13T06:08:42.404127+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:51:12.183814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.406610+0000","last_change":"2023-09-13T06:08:42.411238+0000","last_active":"2023-09-13T06:08:43.406610+0000","last_peered":"2023-09-13T06:08:43.406610+0000","last_clean":"2023-09-13T06:08:43.406610+0000","last_became_active":"2023-09-13T06:08:42.410737+0000","last_became_peered":"2023-09-13T06:08:42.410737+0000","last_unstale":"2023-09-13T06:08:43.406610+0000","last_undegraded":"2023-09-13T06:08:43.406610+0000","last_fullsized":"2023-09-13T06:08:43.406610+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:32:41.043783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.402964+0000","last_change":"2023-09-13T06:08:41.652273+0000","last_active":"2023-09-13T06:08:42.402964+0000","last_peered":"2023-09-13T06:08:42.402964+0000","last_clean":"2023-09-13T06:08:42.402964+0000","last_became_active":"2023-09-13T06:08:41.652034+0000","last_became_peered":"2023-09-13T06:08:41.652034+0000","last_unstale":"2023-09-13T06:08:42.402964+0000","last_undegraded":"2023-09-13T06:08:42.402964+0000","last_fullsized":"2023-09-13T06:08:42.402964+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:39:18.588049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410294+0000","last_change":"2023-09-13T06:08:42.411731+0000","last_active":"2023-09-13T06:08:43.410294+0000","last_peered":"2023-09-13T06:08:43.410294+0000","last_clean":"2023-09-13T06:08:43.410294+0000","last_became_active":"2023-09-13T06:08:42.411392+0000","last_became_peered":"2023-09-13T06:08:42.411392+0000","last_unstale":"2023-09-13T06:08:43.410294+0000","last_undegraded":"2023-09-13T06:08:43.410294+0000","last_fullsized":"2023-09-13T06:08:43.410294+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:35:19.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.403856+0000","last_change":"2023-09-13T06:08:41.651282+0000","last_active":"2023-09-13T06:08:42.403856+0000","last_peered":"2023-09-13T06:08:42.403856+0000","last_clean":"2023-09-13T06:08:42.403856+0000","last_became_active":"2023-09-13T06:08:41.650716+0000","last_became_peered":"2023-09-13T06:08:41.650716+0000","last_unstale":"2023-09-13T06:08:42.403856+0000","last_undegraded":"2023-09-13T06:08:42.403856+0000","last_fullsized":"2023-09-13T06:08:42.403856+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:13:11.348813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.412961+0000","last_change":"2023-09-13T06:08:42.413303+0000","last_active":"2023-09-13T06:08:43.412961+0000","last_peered":"2023-09-13T06:08:43.412961+0000","last_clean":"2023-09-13T06:08:43.412961+0000","last_became_active":"2023-09-13T06:08:42.412920+0000","last_became_peered":"2023-09-13T06:08:42.412920+0000","last_unstale":"2023-09-13T06:08:43.412961+0000","last_undegraded":"2023-09-13T06:08:43.412961+0000","last_fullsized":"2023-09-13T06:08:43.412961+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:03:15.222376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410492+0000","last_change":"2023-09-13T06:08:41.651035+0000","last_active":"2023-09-13T06:08:43.410492+0000","last_peered":"2023-09-13T06:08:43.410492+0000","last_clean":"2023-09-13T06:08:43.410492+0000","last_became_active":"2023-09-13T06:08:41.650768+0000","last_became_peered":"2023-09-13T06:08:41.650768+0000","last_unstale":"2023-09-13T06:08:43.410492+0000","last_undegraded":"2023-09-13T06:08:43.410492+0000","last_fullsized":"2023-09-13T06:08:43.410492+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:22:51.653858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.413814+0000","last_change":"2023-09-13T06:08:42.413713+0000","last_active":"2023-09-13T06:08:42.413814+0000","last_peered":"2023-09-13T06:08:42.413814+0000","last_clean":"2023-09-13T06:08:42.413814+0000","last_became_active":"2023-09-13T06:08:42.413481+0000","last_became_peered":"2023-09-13T06:08:42.413481+0000","last_unstale":"2023-09-13T06:08:42.413814+0000","last_undegraded":"2023-09-13T06:08:42.413814+0000","last_fullsized":"2023-09-13T06:08:42.413814+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:40:39.587491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.400776+0000","last_change":"2023-09-13T06:08:41.656505+0000","last_active":"2023-09-13T06:08:42.400776+0000","last_peered":"2023-09-13T06:08:42.400776+0000","last_clean":"2023-09-13T06:08:42.400776+0000","last_became_active":"2023-09-13T06:08:41.656153+0000","last_became_peered":"2023-09-13T06:08:41.656153+0000","last_unstale":"2023-09-13T06:08:42.400776+0000","last_undegraded":"2023-09-13T06:08:42.400776+0000","last_fullsized":"2023-09-13T06:08:42.400776+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:02:08.104703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.408521+0000","last_change":"2023-09-13T06:08:42.408449+0000","last_active":"2023-09-13T06:08:42.408521+0000","last_peered":"2023-09-13T06:08:42.408521+0000","last_clean":"2023-09-13T06:08:42.408521+0000","last_became_active":"2023-09-13T06:08:42.408232+0000","last_became_peered":"2023-09-13T06:08:42.408232+0000","last_unstale":"2023-09-13T06:08:42.408521+0000","last_undegraded":"2023-09-13T06:08:42.408521+0000","last_fullsized":"2023-09-13T06:08:42.408521+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:11:02.764608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.403527+0000","last_change":"2023-09-13T06:08:41.651108+0000","last_active":"2023-09-13T06:08:42.403527+0000","last_peered":"2023-09-13T06:08:42.403527+0000","last_clean":"2023-09-13T06:08:42.403527+0000","last_became_active":"2023-09-13T06:08:41.650866+0000","last_became_peered":"2023-09-13T06:08:41.650866+0000","last_unstale":"2023-09-13T06:08:42.403527+0000","last_undegraded":"2023-09-13T06:08:42.403527+0000","last_fullsized":"2023-09-13T06:08:42.403527+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:25:40.182587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410707+0000","last_change":"2023-09-13T06:08:42.413499+0000","last_active":"2023-09-13T06:08:43.410707+0000","last_peered":"2023-09-13T06:08:43.410707+0000","last_clean":"2023-09-13T06:08:43.410707+0000","last_became_active":"2023-09-13T06:08:42.412904+0000","last_became_peered":"2023-09-13T06:08:42.412904+0000","last_unstale":"2023-09-13T06:08:43.410707+0000","last_undegraded":"2023-09-13T06:08:43.410707+0000","last_fullsized":"2023-09-13T06:08:43.410707+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:41.636065+0000","last_clean_scrub_stamp":"2023-09-13T06:08:41.636065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:33:48.544819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"154'2","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-09-13T06:08:43.410730+0000","last_change":"2023-09-13T06:08:41.655920+0000","last_active":"2023-09-13T06:08:43.410730+0000","last_peered":"2023-09-13T06:08:43.410730+0000","last_clean":"2023-09-13T06:08:43.410730+0000","last_became_active":"2023-09-13T06:08:41.655658+0000","last_became_peered":"2023-09-13T06:08:41.655658+0000","last_unstale":"2023-09-13T06:08:43.410730+0000","last_undegraded":"2023-09-13T06:08:43.410730+0000","last_fullsized":"2023-09-13T06:08:43.410730+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:08:40.629220+0000","last_clean_scrub_stamp":"2023-09-13T06:08:40.629220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:26.622483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":314,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-09-13T06:08:42.402272+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:08:42.402272+0000","last_peered":"2023-09-13T06:08:42.402272+0000","last_clean":"2023-09-13T06:08:42.402272+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:08:42.402272+0000","last_undegraded":"2023-09-13T06:08:42.402272+0000","last_fullsized":"2023-09-13T06:08:42.402272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574940,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1421,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193890,"statfs":{"total":200000000,"available":198544230,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.3320000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69899999999999995,"15min":0.68999999999999995},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70499999999999996,"15min":0.69499999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92200000000000004,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.82499999999999996}]},{"osd":2,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.47499999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.88300000000000001,"5min":1.016,"15min":1.395},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.2030000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.56799999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.357},"last":0.748},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93600000000000005,"5min":1.0580000000000001,"15min":1.2629999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.626},"min":{"1min":0.38700000000000001,"5min":0.32600000000000001,"15min":0.316},"max":{"1min":0.88600000000000001,"5min":0.89700000000000002,"15min":0.95899999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63900000000000001,"15min":0.65700000000000003},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79800000000000004,"5min":0.95899999999999996,"15min":1.018},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63,"15min":0.66800000000000004},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.97099999999999997,"15min":0.97999999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66600000000000004,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.98099999999999998,"15min":1.1319999999999999},"last":0.79100000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.74099999999999999},"min":{"1min":0.433,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0920000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.5,"5min":0.46800000000000003,"15min":0.46600000000000003},"max":{"1min":0.89500000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":844,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199135236,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67400000000000004,"15min":0.68500000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35299999999999998},"max":{"1min":0.879,"5min":1.0649999999999999,"15min":1.181},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.68200000000000005},"min":{"1min":0.52000000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.96299999999999997,"5min":1.028,"15min":1.028},"last":0.54200000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68100000000000005,"15min":0.69299999999999995},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.0840000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.71799999999999997},"min":{"1min":0.50900000000000001,"5min":0.40799999999999997,"15min":0.40200000000000002},"max":{"1min":1.137,"5min":1.137,"15min":1.153},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.54800000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.97399999999999998,"15min":1.4750000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70299999999999996,"15min":0.71499999999999997},"min":{"1min":0.49299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.034,"5min":1.085,"15min":1.085},"last":0.68400000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92000000000000004,"5min":1.105,"15min":1.2030000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.75700000000000001,"15min":0.77800000000000002},"min":{"1min":0.60799999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0129999999999999,"5min":1.0620000000000001,"15min":1.526},"last":0.72599999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.88,"5min":1.024,"15min":1.0589999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":1.018},"last":0.47099999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63600000000000001,"15min":0.624},"min":{"1min":0.432,"5min":0.312,"15min":0.312},"max":{"1min":0.99199999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.43099999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.95499999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49299999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:08:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.51600000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.071,"5min":1.1299999999999999,"15min":4.3879999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71399999999999997,"15min":0.70299999999999996},"min":{"1min":0.48299999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.014,"5min":1.133,"15min":1.133},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":842,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194469,"statfs":{"total":200000000,"available":199136848,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.83799999999999997,"5min":0.95899999999999996,"15min":1.0389999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.442,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54100000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.44500000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.93000000000000005,"15min":0.96099999999999997},"last":0.87},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89900000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65300000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70999999999999996,"15min":0.69499999999999995},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96699999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69099999999999995,"15min":0.67400000000000004},"min":{"1min":0.495,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94899999999999995,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91800000000000004,"5min":0.997,"15min":0.997},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70399999999999996,"15min":0.70899999999999996},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85899999999999999,"5min":0.94399999999999995,"15min":0.98099999999999998},"last":0.745}]},{"osd":4,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93899999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.61099999999999999},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95699999999999996,"5min":1.077,"15min":1.077},"last":0.97499999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.67500000000000004},"min":{"1min":0.53700000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86099999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67900000000000005,"15min":0.67500000000000004},"min":{"1min":0.496,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.77200000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69699999999999995,"15min":0.71699999999999997},"min":{"1min":0.48999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91100000000000003,"5min":1.109,"15min":1.109},"last":1.008},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.55000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93400000000000005,"5min":1.026,"15min":1.026},"last":0.996}]}]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":842,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194469,"statfs":{"total":200000000,"available":199136778,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66600000000000004,"15min":0.64500000000000002},"min":{"1min":0.44500000000000001,"5min":0.432,"15min":0.34999999999999998},"max":{"1min":0.83799999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.38},"max":{"1min":1.038,"5min":1.145,"15min":1.145},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68700000000000006,"15min":0.67000000000000004},"min":{"1min":0.57099999999999995,"5min":0.376,"15min":0.376},"max":{"1min":0.88300000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.67600000000000005},"min":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96399999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.623}]},{"osd":2,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.53500000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.57799999999999996,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.71699999999999997},"min":{"1min":0.61399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94599999999999995,"5min":1.077,"15min":1.077},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.55400000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94999999999999996,"5min":1.071,"15min":1.071},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.48999999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.96899999999999997,"5min":0.97999999999999998,"15min":1.01},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.91300000000000003,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.46200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86899999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71699999999999997,"15min":0.69499999999999995},"min":{"1min":0.54900000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.0169999999999999,"5min":1.123,"15min":1.123},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73699999999999999,"15min":0.71799999999999997},"min":{"1min":0.52000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0009999999999999,"5min":1.26,"15min":1.26},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72699999999999998,"15min":0.71299999999999997},"min":{"1min":0.50900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.98799999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194469,"statfs":{"total":200000000,"available":199136688,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.41099999999999998,"15min":0.40000000000000002},"min":{"1min":0.25800000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.58099999999999996,"5min":0.629,"15min":0.69099999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.435},"min":{"1min":0.29799999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70299999999999996,"5min":0.75900000000000001,"15min":0.81599999999999995},"last":0.35399999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.441,"15min":0.42899999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48299999999999998,"15min":0.46200000000000002},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63600000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.38400000000000001,"5min":0.375,"15min":0.33400000000000002},"max":{"1min":0.65500000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.78100000000000003},"last":0.64800000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.46700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96799999999999997,"5min":1.284,"15min":1.284},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90100000000000002,"5min":1.044,"15min":1.044},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.52700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.91700000000000004,"5min":1.042,"15min":1.111},"last":0.745},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85499999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.54200000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93700000000000006,"5min":1.097,"15min":1.097},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":0.878,"5min":0.998,"15min":1.458},"last":0.70199999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0600000000000001,"5min":1.383,"15min":1.383},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.88900000000000001,"5min":1.0800000000000001,"15min":1.27},"last":0.71999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194468,"statfs":{"total":200000000,"available":199136232,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.25900000000000001,"5min":0.23999999999999999,"15min":0.22700000000000001},"max":{"1min":0.745,"5min":0.86399999999999999,"15min":10.401},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.437,"15min":0.439},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.27400000000000002},"max":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":5.4429999999999996},"last":0.34799999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46800000000000003,"15min":0.46200000000000002},"min":{"1min":0.374,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":5.2640000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48899999999999999,"15min":0.47199999999999998},"min":{"1min":0.38800000000000001,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":4.3369999999999997},"last":0.44600000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70799999999999996,"5min":4.1699999999999999,"15min":6.0410000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.46700000000000003,"5min":0.41399999999999998,"15min":0.38600000000000001},"max":{"1min":0.79000000000000004,"5min":0.82399999999999995,"15min":6.1600000000000001},"last":0.501}]},{"osd":4,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.171,"5min":1.171,"15min":5.4809999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75,"15min":0.76700000000000002},"min":{"1min":0.57999999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.121,"5min":1.121,"15min":4.0599999999999996},"last":1.117}]},{"osd":5,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.56100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1579999999999999,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.58299999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.135,"5min":1.135,"15min":5.5289999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.53700000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0469999999999999,"5min":1.0980000000000001,"15min":4.1609999999999996},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.72799999999999998},"min":{"1min":0.49099999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1100000000000001,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":1.0309999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":4.2400000000000002},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77400000000000002,"15min":0.76400000000000001},"min":{"1min":0.55900000000000005,"5min":0.48699999999999999,"15min":0.48099999999999998},"max":{"1min":1.0700000000000001,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.81499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":842,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194469,"statfs":{"total":200000000,"available":199136848,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.436,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.624,"5min":0.80200000000000005,"15min":2.4020000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27300000000000002},"max":{"1min":0.69499999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54200000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48499999999999999,"15min":0.46200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66800000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.504,"15min":0.46800000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54900000000000004,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.379},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":0.80600000000000005,"15min":4.0599999999999996},"last":0.48999999999999999}]},{"osd":4,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.55200000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.012,"5min":1.089,"15min":1.089},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73299999999999998,"15min":0.746},"min":{"1min":0.58999999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0669999999999999,"5min":1.125,"15min":1.2150000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97699999999999998,"5min":1.1000000000000001,"15min":1.109},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.57699999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.628,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0189999999999999,"5min":1.1639999999999999,"15min":1.1839999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.61799999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0029999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.028,"5min":1.0369999999999999,"15min":1.0669999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.505,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0409999999999999,"5min":1.1519999999999999,"15min":1.2769999999999999},"last":0.73899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1419,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193893,"statfs":{"total":200000000,"available":198546480,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":2.0190000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69299999999999995,"5min":0.89800000000000002,"15min":2.294},"last":0.34399999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.502,"15min":0.498},"min":{"1min":0.38500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":2.2410000000000001},"last":0.505},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.29899999999999999,"15min":0.29499999999999998},"max":{"1min":0.63900000000000001,"5min":0.72999999999999998,"15min":2.056},"last":0.45300000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.32500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68799999999999994,"5min":0.76600000000000001,"15min":2.0859999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55200000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.76900000000000002,"5min":0.83599999999999997,"15min":2.3820000000000001},"last":0.66700000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.47599999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.88800000000000001,"5min":1.099,"15min":2.1749999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.436,"15min":0.436},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":2.3370000000000002},"last":0.71899999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72399999999999998,"15min":0.76400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":2.3119999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74099999999999999,"15min":0.77700000000000002},"min":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.48799999999999999},"max":{"1min":1.052,"5min":1.0980000000000001,"15min":2.1469999999999998},"last":0.56399999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.5,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0309999999999999,"5min":1.1240000000000001,"15min":2.415},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72399999999999998,"15min":0.76500000000000001},"min":{"1min":0.46200000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.121,"5min":1.121,"15min":2.347},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.745,"15min":0.78500000000000003},"min":{"1min":0.499,"5min":0.495,"15min":0.495},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":2.367},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.53300000000000003,"15min":0.53000000000000003},"max":{"1min":0.98499999999999999,"5min":1.0509999999999999,"15min":2.1179999999999999},"last":0.60199999999999998}]}]}],"pool_statfs":[]}} 2023-09-13T06:08:47.161 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T06:08:47.161 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.335+0000 7f8fe0b11640 1 Processor -- start 2023-09-13T06:08:47.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.335+0000 7f8fe0b11640 1 -- start start 2023-09-13T06:08:47.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fe0b11640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8fdc144d70 0x7f8fdc0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fe0b11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b2780 0x7f8fdc0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fe0b11640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8fdc0b1460 0x7f8fdc0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fe0b11640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc0b2430 con 0x7f8fdc144d70 2023-09-13T06:08:47.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fe0b11640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc0cedb0 con 0x7f8fdc0b1460 2023-09-13T06:08:47.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fe0b11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc0b3120 con 0x7f8fdc0b2780 2023-09-13T06:08:47.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fda59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8fdc144d70 0x7f8fdc0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fda59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8fdc144d70 0x7f8fdc0ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57430/0 (socket says 172.21.15.130:57430) 2023-09-13T06:08:47.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fda59c640 1 -- 172.21.15.130:0/3741065348 learned_addr learned my addr 172.21.15.130:0/3741065348 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:47.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fdad9d640 1 --2- 172.21.15.130:0/3741065348 >> v2:172.21.15.164:3300/0 conn(0x7f8fdc0b1460 0x7f8fdc0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fd1d9b640 1 --2- 172.21.15.130:0/3741065348 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b2780 0x7f8fdc0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fda59c640 1 -- 172.21.15.130:0/3741065348 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b2780 msgr2=0x7f8fdc0b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:47.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fda59c640 1 --2- 172.21.15.130:0/3741065348 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b2780 0x7f8fdc0b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fda59c640 1 -- 172.21.15.130:0/3741065348 >> v2:172.21.15.164:3300/0 conn(0x7f8fdc0b1460 msgr2=0x7f8fdc0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:47.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fda59c640 1 --2- 172.21.15.130:0/3741065348 >> v2:172.21.15.164:3300/0 conn(0x7f8fdc0b1460 0x7f8fdc0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fda59c640 1 -- 172.21.15.130:0/3741065348 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc0b2150 con 0x7f8fdc144d70 2023-09-13T06:08:47.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.339+0000 7f8fd1d9b640 1 --2- 172.21.15.130:0/3741065348 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b2780 0x7f8fdc0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:08:47.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fda59c640 1 --2- 172.21.15.130:0/3741065348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fdc144d70 0x7f8fdc0ce870 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc067290 tx=0x7f8fcc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd8e4679393ffc7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:47.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fd9d9b640 1 -- 172.21.15.130:0/3741065348 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0ac410 con 0x7f8fdc144d70 2023-09-13T06:08:47.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fd9d9b640 1 -- 172.21.15.130:0/3741065348 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0ac570 con 0x7f8fdc144d70 2023-09-13T06:08:47.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fd9d9b640 1 -- 172.21.15.130:0/3741065348 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0ac900 con 0x7f8fdc144d70 2023-09-13T06:08:47.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3741065348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fdc144d70 msgr2=0x7f8fdc0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fe0b11640 1 --2- 172.21.15.130:0/3741065348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fdc144d70 0x7f8fdc0ce870 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc067290 tx=0x7f8fcc01c500 comp rx=0 tx=0).stop 2023-09-13T06:08:47.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3741065348 shutdown_connections 2023-09-13T06:08:47.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fe0b11640 1 --2- 172.21.15.130:0/3741065348 >> v2:172.21.15.164:3300/0 conn(0x7f8fdc0b1460 0x7f8fdc0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fe0b11640 1 --2- 172.21.15.130:0/3741065348 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b2780 0x7f8fdc0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fe0b11640 1 --2- 172.21.15.130:0/3741065348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fdc144d70 0x7f8fdc0ce870 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3741065348 >> 172.21.15.130:0/3741065348 conn(0x7f8fdc065990 msgr2=0x7f8fdc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:47.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3741065348 shutdown_connections 2023-09-13T06:08:47.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3741065348 wait complete. 2023-09-13T06:08:47.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.343+0000 7f8fe0b11640 1 Processor -- start 2023-09-13T06:08:47.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fe0b11640 1 -- start start 2023-09-13T06:08:47.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fe0b11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b1460 0x7f8fdc0ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fe0b11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fdc0b2780 0x7f8fdc139770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fe0b11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fdc144d70 0x7f8fdc1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fe0b11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc15ae90 con 0x7f8fdc144d70 2023-09-13T06:08:47.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fe0b11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc139cb0 con 0x7f8fdc0b2780 2023-09-13T06:08:47.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fe0b11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc143300 con 0x7f8fdc0b1460 2023-09-13T06:08:47.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fdad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fdc144d70 0x7f8fdc1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fda59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b1460 0x7f8fdc0ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fda59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b1460 0x7f8fdc0ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:57530/0 (socket says 172.21.15.130:57530) 2023-09-13T06:08:47.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fda59c640 1 -- 172.21.15.130:0/3352115115 learned_addr learned my addr 172.21.15.130:0/3352115115 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:47.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fdad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fdc144d70 0x7f8fdc1599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57444/0 (socket says 172.21.15.130:57444) 2023-09-13T06:08:47.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fd1d9b640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fdc0b2780 0x7f8fdc139770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fdad9d640 1 -- 172.21.15.130:0/3352115115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b1460 msgr2=0x7f8fdc0ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fdad9d640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b1460 0x7f8fdc0ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fdad9d640 1 -- 172.21.15.130:0/3352115115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fdc0b2780 msgr2=0x7f8fdc139770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fdad9d640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fdc0b2780 0x7f8fdc139770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fdad9d640 1 -- 172.21.15.130:0/3352115115 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc0094d0 con 0x7f8fdc144d70 2023-09-13T06:08:47.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fdad9d640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fdc144d70 0x7f8fdc1599f0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400eed0 tx=0x7f8fd400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:47.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fd37fe640 1 -- 172.21.15.130:0/3352115115 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4010040 con 0x7f8fdc144d70 2023-09-13T06:08:47.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fd37fe640 1 -- 172.21.15.130:0/3352115115 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd4009e60 con 0x7f8fdc144d70 2023-09-13T06:08:47.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3352115115 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc1435e0 con 0x7f8fdc144d70 2023-09-13T06:08:47.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fd37fe640 1 -- 172.21.15.130:0/3352115115 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4014640 con 0x7f8fdc144d70 2023-09-13T06:08:47.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3352115115 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc15aab0 con 0x7f8fdc144d70 2023-09-13T06:08:47.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.347+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3352115115 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc15a630 con 0x7f8fdc144d70 2023-09-13T06:08:47.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.351+0000 7f8fd37fe640 1 -- 172.21.15.130:0/3352115115 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8fd40147a0 con 0x7f8fdc144d70 2023-09-13T06:08:47.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.351+0000 7f8fd37fe640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.351+0000 7f8fd37fe640 1 -- 172.21.15.130:0/3352115115 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fd4083bf0 con 0x7f8fdc144d70 2023-09-13T06:08:47.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.351+0000 7f8fda59c640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.351+0000 7f8fda59c640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc01c540 tx=0x7f8fcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:47.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.355+0000 7f8fd37fe640 1 -- 172.21.15.130:0/3352115115 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8fdc15a630 con 0x7f8fdc144d70 2023-09-13T06:08:47.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.555+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3352115115 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8fdc15a630 con 0x7f8fdc144d70 2023-09-13T06:08:47.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fd37fe640 1 -- 172.21.15.130:0/3352115115 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f8fdc15a630 con 0x7f8fdc144d70 2023-09-13T06:08:47.565 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:08:47.565 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:08:47.565 INFO:teuthology.orchestra.run.smithi130.stdout: caps mds = "allow" 2023-09-13T06:08:47.565 INFO:teuthology.orchestra.run.smithi130.stdout: caps mon = "allow r" 2023-09-13T06:08:47.566 INFO:teuthology.orchestra.run.smithi130.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-13T06:08:47.567 INFO:teuthology.orchestra.run.smithi130.stderr:updated caps for client.0 2023-09-13T06:08:47.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3352115115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 msgr2=0x7f8fbc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc01c540 tx=0x7f8fcc008040 comp rx=0 tx=0).stop 2023-09-13T06:08:47.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3352115115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fdc144d70 msgr2=0x7f8fdc1599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fdc144d70 0x7f8fdc1599f0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400eed0 tx=0x7f8fd400b480 comp rx=0 tx=0).stop 2023-09-13T06:08:47.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3352115115 shutdown_connections 2023-09-13T06:08:47.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8fbc065b20 0x7f8fbc067fe0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fdc0b2780 0x7f8fdc139770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fdc144d70 0x7f8fdc1599f0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 --2- 172.21.15.130:0/3352115115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8fdc0b1460 0x7f8fdc0ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3352115115 >> 172.21.15.130:0/3352115115 conn(0x7f8fdc065990 msgr2=0x7f8fdc06b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:47.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3352115115 shutdown_connections 2023-09-13T06:08:47.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.563+0000 7f8fe0b11640 1 -- 172.21.15.130:0/3352115115 wait complete. 2023-09-13T06:08:47.586 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:08:47.627 INFO:tasks.ceph.mds.d.smithi164.stderr:2023-09-13T06:08:47.624+0000 7fe167a2d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:08:47.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6da340640 1 Processor -- start 2023-09-13T06:08:47.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6da340640 1 -- start start 2023-09-13T06:08:47.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6da340640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc6d40d1090 0x7fc6d415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6da340640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d4146f30 0x7fc6d40b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6da340640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d40b63c0 con 0x7fc6d40d1750 2023-09-13T06:08:47.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6da340640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d415dea0 con 0x7fc6d40d1090 2023-09-13T06:08:47.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6da340640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40d0c20 con 0x7fc6d4146f30 2023-09-13T06:08:47.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d3fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc6d40d1750 0x7fc6d4146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51092/0 (socket says 172.21.15.130:51092) 2023-09-13T06:08:47.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d3fff640 1 -- 172.21.15.130:0/1687679014 learned_addr learned my addr 172.21.15.130:0/1687679014 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:47.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d37fe640 1 --2- 172.21.15.130:0/1687679014 >> v2:172.21.15.164:3300/0 conn(0x7fc6d40d1090 0x7fc6d415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d88dd640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d4146f30 0x7fc6d40b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774743052 0 0) 0x7fc6d40b63c0 con 0x7fc6d40d1750 2023-09-13T06:08:47.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6bc003530 con 0x7fc6d40d1750 2023-09-13T06:08:47.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4230409065 0 0) 0x7fc6bc003530 con 0x7fc6d40d1750 2023-09-13T06:08:47.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d4146f30 msgr2=0x7fc6d40b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:47.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d4146f30 0x7fc6d40b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 >> v2:172.21.15.164:3300/0 conn(0x7fc6d40d1090 msgr2=0x7fc6d415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:47.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 --2- 172.21.15.130:0/1687679014 >> v2:172.21.15.164:3300/0 conn(0x7fc6d40d1090 0x7fc6d415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d40b6610 con 0x7fc6d40d1750 2023-09-13T06:08:47.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fc6c4001680 con 0x7fc6d40d1750 2023-09-13T06:08:47.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 >> v1:172.21.15.130:6789/0 conn(0x7fc6d40d1750 legacy=0x7fc6d4146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc0039f0 0x7fc6bc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d4146f30 0x7fc6bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc004d10 0x7fc6bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40d0c20 con 0x7fc6bc004d10 2023-09-13T06:08:47.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc00b990 con 0x7fc6bc0039f0 2023-09-13T06:08:47.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc00bb00 con 0x7fc6d4146f30 2023-09-13T06:08:47.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d88dd640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc004d10 0x7fc6bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d3fff640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc0039f0 0x7fc6bc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.723+0000 7fc6d37fe640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d4146f30 0x7fc6bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6d88dd640 1 -- 172.21.15.130:0/1687679014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d4146f30 msgr2=0x7fc6bc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:47.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6d88dd640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d4146f30 0x7fc6bc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6d88dd640 1 -- 172.21.15.130:0/1687679014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc0039f0 msgr2=0x7fc6bc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:47.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6d88dd640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc0039f0 0x7fc6bc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6d88dd640 1 -- 172.21.15.130:0/1687679014 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc003530 con 0x7fc6bc004d10 2023-09-13T06:08:47.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6d88dd640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc004d10 0x7fc6bc005190 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009fc0 tx=0x7fc6cc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc84b8d1a8f45564 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:47.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc0a5c70 con 0x7fc6bc004d10 2023-09-13T06:08:47.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc00f040 con 0x7fc6bc004d10 2023-09-13T06:08:47.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6d2ffd640 1 -- 172.21.15.130:0/1687679014 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc0ad440 con 0x7fc6bc004d10 2023-09-13T06:08:47.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6da340640 1 -- 172.21.15.130:0/1687679014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc004d10 msgr2=0x7fc6bc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6da340640 1 --2- 172.21.15.130:0/1687679014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6bc004d10 0x7fc6bc005190 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009fc0 tx=0x7fc6cc01cc60 comp rx=0 tx=0).stop 2023-09-13T06:08:47.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6d88dd640 1 -- 172.21.15.130:0/1687679014 reap_dead start 2023-09-13T06:08:47.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6da340640 1 -- 172.21.15.130:0/1687679014 shutdown_connections 2023-09-13T06:08:47.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6da340640 1 -- 172.21.15.130:0/1687679014 >> 172.21.15.130:0/1687679014 conn(0x7fc6d406f170 msgr2=0x7fc6d406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:47.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6da340640 1 -- 172.21.15.130:0/1687679014 shutdown_connections 2023-09-13T06:08:47.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.727+0000 7fc6da340640 1 -- 172.21.15.130:0/1687679014 wait complete. 2023-09-13T06:08:47.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6da340640 1 Processor -- start 2023-09-13T06:08:47.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6da340640 1 -- start start 2023-09-13T06:08:47.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6da340640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc004d10 0x7fc6d415c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6da340640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6d413e8a0 0x7fc6d415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6da340640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d413ed20 0x7fc6d415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6da340640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d415c640 con 0x7fc6d413e8a0 2023-09-13T06:08:47.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6da340640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d413e4e0 con 0x7fc6bc004d10 2023-09-13T06:08:47.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6da340640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d413f260 con 0x7fc6d413ed20 2023-09-13T06:08:47.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6d37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6d413e8a0 0x7fc6d415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6d37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6d413e8a0 0x7fc6d415e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57466/0 (socket says 172.21.15.130:57466) 2023-09-13T06:08:47.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6d37fe640 1 -- 172.21.15.130:0/1195700603 learned_addr learned my addr 172.21.15.130:0/1195700603 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:47.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6d3fff640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc004d10 0x7fc6d415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6d88dd640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d413ed20 0x7fc6d415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6d37fe640 1 -- 172.21.15.130:0/1195700603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d413ed20 msgr2=0x7fc6d415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6d37fe640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d413ed20 0x7fc6d415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6d37fe640 1 -- 172.21.15.130:0/1195700603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc004d10 msgr2=0x7fc6d415c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6d37fe640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc004d10 0x7fc6d415c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6d37fe640 1 -- 172.21.15.130:0/1195700603 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d413f540 con 0x7fc6d413e8a0 2023-09-13T06:08:47.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.731+0000 7fc6d37fe640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6d413e8a0 0x7fc6d415e4b0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80119c0 tx=0x7fc6c8011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:47.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.735+0000 7fc6d0ff9640 1 -- 172.21.15.130:0/1195700603 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800fb50 con 0x7fc6d413e8a0 2023-09-13T06:08:47.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.735+0000 7fc6d0ff9640 1 -- 172.21.15.130:0/1195700603 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c800fcb0 con 0x7fc6d413e8a0 2023-09-13T06:08:47.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.735+0000 7fc6da340640 1 -- 172.21.15.130:0/1195700603 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d413f820 con 0x7fc6d413e8a0 2023-09-13T06:08:47.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.735+0000 7fc6d0ff9640 1 -- 172.21.15.130:0/1195700603 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8014440 con 0x7fc6d413e8a0 2023-09-13T06:08:47.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.735+0000 7fc6da340640 1 -- 172.21.15.130:0/1195700603 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d413ca10 con 0x7fc6d413e8a0 2023-09-13T06:08:47.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.735+0000 7fc6da340640 1 -- 172.21.15.130:0/1195700603 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d413fa60 con 0x7fc6d413e8a0 2023-09-13T06:08:47.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.735+0000 7fc6d0ff9640 1 -- 172.21.15.130:0/1195700603 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc6c80145a0 con 0x7fc6d413e8a0 2023-09-13T06:08:47.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.735+0000 7fc6d0ff9640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc6c0065b20 0x7fc6c0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:47.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.735+0000 7fc6d0ff9640 1 -- 172.21.15.130:0/1195700603 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6c8083cd0 con 0x7fc6d413e8a0 2023-09-13T06:08:47.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.735+0000 7fc6d3fff640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc6c0065b20 0x7fc6c0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:47.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.735+0000 7fc6d3fff640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc6c0065b20 0x7fc6c0067fe0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4001060 tx=0x7fc6c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:47.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.739+0000 7fc6d0ff9640 1 -- 172.21.15.130:0/1195700603 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc6d413fa60 con 0x7fc6d413e8a0 2023-09-13T06:08:47.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.919+0000 7fc6da340640 1 -- 172.21.15.130:0/1195700603 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6d413c590 con 0x7fc6d413e8a0 2023-09-13T06:08:47.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.919+0000 7fc6d0ff9640 1 -- 172.21.15.130:0/1195700603 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fc6d413c590 con 0x7fc6d413e8a0 2023-09-13T06:08:47.923 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:47.924 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2638049185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2638049185},{"type":"v1","addr":"172.21.15.164:6834","nonce":2638049185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/4101999538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4101999538},{"type":"v1","addr":"172.21.15.130:6835","nonce":4101999538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1691911082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1691911082},{"type":"v1","addr":"172.21.15.130:6837","nonce":1691911082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:08:42.026268+0000","modified":"2023-09-13T06:08:45.060479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2618060608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2618060608},{"type":"v1","addr":"172.21.15.164:6835","nonce":2618060608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-09-13T06:08:47.925 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 76 2023-09-13T06:08:47.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 -- 172.21.15.130:0/1195700603 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc6c0065b20 msgr2=0x7fc6c0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc6c0065b20 0x7fc6c0067fe0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4001060 tx=0x7fc6c4009040 comp rx=0 tx=0).stop 2023-09-13T06:08:47.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 -- 172.21.15.130:0/1195700603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6d413e8a0 msgr2=0x7fc6d415e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:47.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6d413e8a0 0x7fc6d415e4b0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80119c0 tx=0x7fc6c8011e80 comp rx=0 tx=0).stop 2023-09-13T06:08:47.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 -- 172.21.15.130:0/1195700603 shutdown_connections 2023-09-13T06:08:47.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc6c0065b20 0x7fc6c0067fe0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6d413ed20 0x7fc6d415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6d413e8a0 0x7fc6d415e4b0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 --2- 172.21.15.130:0/1195700603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6bc004d10 0x7fc6d415c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:47.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 -- 172.21.15.130:0/1195700603 >> 172.21.15.130:0/1195700603 conn(0x7fc6d406f170 msgr2=0x7fc6d415ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:47.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 -- 172.21.15.130:0/1195700603 shutdown_connections 2023-09-13T06:08:47.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:47.923+0000 7fc6da340640 1 -- 172.21.15.130:0/1195700603 wait complete. 2023-09-13T06:08:48.346 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T06:08:42.026268+0000', 'modified': '2023-09-13T06:08:45.060479+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8244}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8244': {'gid': 8244, 'name': 'd', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.164:6835/2618060608', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6833', 'nonce': 2618060608}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 2618060608}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T06:08:48.347 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T06:08:48.347 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-09-13T06:08:48.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.483+0000 7f0e4700b640 1 Processor -- start 2023-09-13T06:08:48.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.483+0000 7f0e4700b640 1 -- start start 2023-09-13T06:08:48.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.483+0000 7f0e4700b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0e40159f20 0x7f0e400ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.483+0000 7f0e4700b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0e400cdfc0 0x7f0e400b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.483+0000 7f0e4700b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e400ccfd0 con 0x7f0e400b1610 2023-09-13T06:08:48.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.483+0000 7f0e4700b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e400b00f0 con 0x7f0e40159f20 2023-09-13T06:08:48.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.483+0000 7f0e4700b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e400b11d0 con 0x7f0e400cdfc0 2023-09-13T06:08:48.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.483+0000 7f0e44da7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0e40159f20 0x7f0e400ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.483+0000 7f0e455a8640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0e400b1610 0x7f0e400ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51098/0 (socket says 172.21.15.130:51098) 2023-09-13T06:08:48.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.483+0000 7f0e455a8640 1 -- 172.21.15.130:0/4085345562 learned_addr learned my addr 172.21.15.130:0/4085345562 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:48.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e37fff640 1 --2- 172.21.15.130:0/4085345562 >> v2:172.21.15.164:3300/0 conn(0x7f0e400cdfc0 0x7f0e400b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e44da7640 1 -- 172.21.15.130:0/4085345562 >> v2:172.21.15.164:3300/0 conn(0x7f0e400cdfc0 msgr2=0x7f0e400b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:48.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e44da7640 1 --2- 172.21.15.130:0/4085345562 >> v2:172.21.15.164:3300/0 conn(0x7f0e400cdfc0 0x7f0e400b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e44da7640 1 -- 172.21.15.130:0/4085345562 >> v1:172.21.15.130:6789/0 conn(0x7f0e400b1610 legacy=0x7f0e400ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e44da7640 1 -- 172.21.15.130:0/4085345562 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e400ced90 con 0x7f0e40159f20 2023-09-13T06:08:48.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e377fe640 1 -- 172.21.15.130:0/4085345562 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682053369 0 0) 0x7f0e400ccfd0 con 0x7f0e400b1610 2023-09-13T06:08:48.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e44da7640 1 --2- 172.21.15.130:0/4085345562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e40159f20 0x7f0e400ce7b0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f0e400ccb10 tx=0x7f0e3c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ee5bda25e7c432 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:48.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e377fe640 1 -- 172.21.15.130:0/4085345562 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0ac410 con 0x7f0e40159f20 2023-09-13T06:08:48.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e377fe640 1 -- 172.21.15.130:0/4085345562 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0ac570 con 0x7f0e40159f20 2023-09-13T06:08:48.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e377fe640 1 -- 172.21.15.130:0/4085345562 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0ac900 con 0x7f0e40159f20 2023-09-13T06:08:48.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e4700b640 1 -- 172.21.15.130:0/4085345562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e40159f20 msgr2=0x7f0e400ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.487+0000 7f0e4700b640 1 --2- 172.21.15.130:0/4085345562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e40159f20 0x7f0e400ce7b0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f0e400ccb10 tx=0x7f0e3c01c3b0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 -- 172.21.15.130:0/4085345562 shutdown_connections 2023-09-13T06:08:48.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 --2- 172.21.15.130:0/4085345562 >> v2:172.21.15.164:3300/0 conn(0x7f0e400cdfc0 0x7f0e400b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 --2- 172.21.15.130:0/4085345562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e40159f20 0x7f0e400ce7b0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 -- 172.21.15.130:0/4085345562 >> 172.21.15.130:0/4085345562 conn(0x7f0e40065990 msgr2=0x7f0e40065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:48.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 -- 172.21.15.130:0/4085345562 shutdown_connections 2023-09-13T06:08:48.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 -- 172.21.15.130:0/4085345562 wait complete. 2023-09-13T06:08:48.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 Processor -- start 2023-09-13T06:08:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 -- start start 2023-09-13T06:08:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e400b1610 0x7f0e400ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e400cdfc0 0x7f0e4014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e40159f20 0x7f0e40070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400cb070 con 0x7f0e40159f20 2023-09-13T06:08:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400cab10 con 0x7f0e400b1610 2023-09-13T06:08:48.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e4700b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400cad90 con 0x7f0e400cdfc0 2023-09-13T06:08:48.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e455a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e40159f20 0x7f0e40070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e455a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e40159f20 0x7f0e40070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57496/0 (socket says 172.21.15.130:57496) 2023-09-13T06:08:48.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e455a8640 1 -- 172.21.15.130:0/829450808 learned_addr learned my addr 172.21.15.130:0/829450808 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:48.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e37fff640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e400cdfc0 0x7f0e4014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e44da7640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e400b1610 0x7f0e400ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e455a8640 1 -- 172.21.15.130:0/829450808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e400cdfc0 msgr2=0x7f0e4014c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e455a8640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e400cdfc0 0x7f0e4014c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e455a8640 1 -- 172.21.15.130:0/829450808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e400b1610 msgr2=0x7f0e400ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e455a8640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e400b1610 0x7f0e400ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e455a8640 1 -- 172.21.15.130:0/829450808 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c009420 con 0x7f0e40159f20 2023-09-13T06:08:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.491+0000 7f0e455a8640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e40159f20 0x7f0e40070330 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800c7c0 tx=0x7f0e3800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.495+0000 7f0e357fa640 1 -- 172.21.15.130:0/829450808 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800a5e0 con 0x7f0e40159f20 2023-09-13T06:08:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.495+0000 7f0e357fa640 1 -- 172.21.15.130:0/829450808 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3800a760 con 0x7f0e40159f20 2023-09-13T06:08:48.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.495+0000 7f0e357fa640 1 -- 172.21.15.130:0/829450808 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800ab10 con 0x7f0e40159f20 2023-09-13T06:08:48.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.495+0000 7f0e4700b640 1 -- 172.21.15.130:0/829450808 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e400c70d0 con 0x7f0e40159f20 2023-09-13T06:08:48.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.495+0000 7f0e4700b640 1 -- 172.21.15.130:0/829450808 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e400c7690 con 0x7f0e40159f20 2023-09-13T06:08:48.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.495+0000 7f0e357fa640 1 -- 172.21.15.130:0/829450808 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0e3800ac70 con 0x7f0e40159f20 2023-09-13T06:08:48.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.495+0000 7f0e357fa640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 0x7f0e2c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.495+0000 7f0e357fa640 1 -- 172.21.15.130:0/829450808 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e38082610 con 0x7f0e40159f20 2023-09-13T06:08:48.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.495+0000 7f0e44da7640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 0x7f0e2c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.495+0000 7f0e4a37c000 1 Processor -- start 2023-09-13T06:08:48.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 -- start start 2023-09-13T06:08:48.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e44da7640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 0x7f0e2c067fe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0ae000 tx=0x7f0e3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:48.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b8e550 0x563c50b8e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8ee70 0x563c50b72d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b732b0 0x563c50b73690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c50a0c1e0 con 0x563c50b8ee70 2023-09-13T06:08:48.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c5099b4c0 con 0x563c50b8e550 2023-09-13T06:08:48.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c509989f0 con 0x563c50b732b0 2023-09-13T06:08:48.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8ee70 0x563c50b72d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8ee70 0x563c50b72d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57504/0 (socket says 172.21.15.130:57504) 2023-09-13T06:08:48.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e37fff640 1 -- 172.21.15.130:0/2083109737 learned_addr learned my addr 172.21.15.130:0/2083109737 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:48.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e44da7640 1 --2- 172.21.15.130:0/2083109737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b8e550 0x563c50b8e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e455a8640 1 --2- 172.21.15.130:0/2083109737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b732b0 0x563c50b73690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e37fff640 1 -- 172.21.15.130:0/2083109737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b732b0 msgr2=0x563c50b73690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:48.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e37fff640 1 --2- 172.21.15.130:0/2083109737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b732b0 0x563c50b73690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e37fff640 1 -- 172.21.15.130:0/2083109737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b8e550 msgr2=0x563c50b8e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:48.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e37fff640 1 --2- 172.21.15.130:0/2083109737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b8e550 0x563c50b8e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e37fff640 1 -- 172.21.15.130:0/2083109737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c5068e890 con 0x563c50b8ee70 2023-09-13T06:08:48.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e37fff640 1 --2- 172.21.15.130:0/2083109737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8ee70 0x563c50b72d70 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f0e300078e0 tx=0x7f0e30007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8ccf61e2d47fe9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:48.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e267fc640 1 -- 172.21.15.130:0/2083109737 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30004300 con 0x563c50b8ee70 2023-09-13T06:08:48.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e267fc640 1 -- 172.21.15.130:0/2083109737 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e30004460 con 0x563c50b8ee70 2023-09-13T06:08:48.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e267fc640 1 -- 172.21.15.130:0/2083109737 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30010b10 con 0x563c50b8ee70 2023-09-13T06:08:48.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 -- 172.21.15.130:0/2083109737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8ee70 msgr2=0x563c50b72d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/2083109737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8ee70 0x563c50b72d70 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f0e300078e0 tx=0x7f0e30007da0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 -- 172.21.15.130:0/2083109737 shutdown_connections 2023-09-13T06:08:48.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/2083109737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b732b0 0x563c50b73690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/2083109737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8ee70 0x563c50b72d70 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/2083109737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b8e550 0x563c50b8e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 -- 172.21.15.130:0/2083109737 >> 172.21.15.130:0/2083109737 conn(0x563c50b3bc40 msgr2=0x563c50b4ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:48.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 -- 172.21.15.130:0/2083109737 shutdown_connections 2023-09-13T06:08:48.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 -- 172.21.15.130:0/2083109737 wait complete. 2023-09-13T06:08:48.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.499+0000 7f0e4a37c000 1 -- start start 2023-09-13T06:08:48.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 1 Processor -- start 2023-09-13T06:08:48.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b732b0 0x563c50b72d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8e550 0x563c50b480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b8ee70 0x563c50b48610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c509942e0 con 0x563c50b732b0 2023-09-13T06:08:48.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c5094efe0 con 0x563c50b8ee70 2023-09-13T06:08:48.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c5094ec80 con 0x563c50b8e550 2023-09-13T06:08:48.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 10 client.0 _ll_register_callbacks cb 0x563c50b30260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:08:48.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e44da7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b732b0 0x563c50b72d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e44da7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b732b0 0x563c50b72d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57518/0 (socket says 172.21.15.130:57518) 2023-09-13T06:08:48.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e44da7640 1 -- 172.21.15.130:0/749770436 learned_addr learned my addr 172.21.15.130:0/749770436 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:48.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e37fff640 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8e550 0x563c50b480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e455a8640 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b8ee70 0x563c50b48610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e44da7640 1 -- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8e550 msgr2=0x563c50b480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:48.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e44da7640 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8e550 0x563c50b480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e44da7640 1 -- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b8ee70 msgr2=0x563c50b48610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:48.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e44da7640 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b8ee70 0x563c50b48610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e44da7640 1 -- 172.21.15.130:0/749770436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3000e040 con 0x563c50b732b0 2023-09-13T06:08:48.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e44da7640 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b732b0 0x563c50b72d40 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0af040 tx=0x7f0e3c01abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ac4bbe3c92e155 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:48.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:08:48.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/749770436 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0b6d70 con 0x563c50b732b0 2023-09-13T06:08:48.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/749770436 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e3c0c3440 con 0x563c50b732b0 2023-09-13T06:08:48.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 1 -- 172.21.15.130:0/749770436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c5092ba50 con 0x563c50b732b0 2023-09-13T06:08:48.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/749770436 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e3c0c3600 con 0x563c50b732b0 2023-09-13T06:08:48.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 10 client.8391 fetch_fsmap learned FSMap version 76 2023-09-13T06:08:48.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 1 -- 172.21.15.130:0/749770436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x563c50957210 con 0x563c50b732b0 2023-09-13T06:08:48.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/749770436 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c5092ba50 con 0x563c50b732b0 2023-09-13T06:08:48.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/749770436 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0e3c0c3760 con 0x563c50b732b0 2023-09-13T06:08:48.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 10 client.8391 fetch_fsmap finished waiting for FSMap version 76 2023-09-13T06:08:48.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 10 client.8391 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-13T06:08:48.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 20 client.8391 populate_metadata read hostname 'smithi130' 2023-09-13T06:08:48.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:6833/2618060608,v1:172.21.15.164:6835/2618060608] conn(0x563c50b493b0 0x563c50ba0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 4 client.8391 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T06:08:48.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e4a37c000 1 -- 172.21.15.130:0/749770436 --> [v2:172.21.15.164:6833/2618060608,v1:172.21.15.164:6835/2618060608] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c5094b820 con 0x563c50b493b0 2023-09-13T06:08:48.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e37fff640 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:6833/2618060608,v1:172.21.15.164:6835/2618060608] conn(0x563c50b493b0 0x563c50ba0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e37fff640 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:6833/2618060608,v1:172.21.15.164:6835/2618060608] conn(0x563c50b493b0 0x563c50ba0600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7a90badf7da2377 server_cookie=948132a00a42e61f in_seq=0 out_seq=0 2023-09-13T06:08:48.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.503+0000 7f0e1f7fe640 10 client.8391 ms_handle_connect on v2:172.21.15.164:6833/2618060608 2023-09-13T06:08:48.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/749770436 <== mds.0 v2:172.21.15.164:6833/2618060608 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563c5094b820 con 0x563c50b493b0 2023-09-13T06:08:48.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e1f7fe640 10 client.8391 handle_command_reply: tid=0 2023-09-13T06:08:48.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 1 client.8391 shutdown 2023-09-13T06:08:48.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 1 -- 172.21.15.130:0/749770436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b732b0 msgr2=0x563c50b72d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b732b0 0x563c50b72d40 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0af040 tx=0x7f0e3c01abf0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 1 -- 172.21.15.130:0/749770436 shutdown_connections 2023-09-13T06:08:48.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:6833/2618060608,v1:172.21.15.164:6835/2618060608] conn(0x563c50b493b0 0x563c50ba0600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b8ee70 0x563c50b48610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8e550 0x563c50b480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/749770436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b732b0 0x563c50b72d40 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e1f7fe640 0 client.8391 ms_handle_reset on v2:172.21.15.164:6833/2618060608 2023-09-13T06:08:48.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 1 -- 172.21.15.130:0/749770436 >> 172.21.15.130:0/749770436 conn(0x563c50b3bc40 msgr2=0x563c50b74130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:48.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 1 -- 172.21.15.130:0/749770436 shutdown_connections 2023-09-13T06:08:48.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 1 -- 172.21.15.130:0/749770436 wait complete. 2023-09-13T06:08:48.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.507+0000 7f0e4a37c000 20 client.8391 trim_cache size 0 max 16384 2023-09-13T06:08:48.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.519+0000 7f0e4a37c000 1 Processor -- start 2023-09-13T06:08:48.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 -- start start 2023-09-13T06:08:48.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b732b0 0x563c50b48600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50b47080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8ee70 0x563c50b475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c5064f940 con 0x563c50b8e550 2023-09-13T06:08:48.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c50999b90 con 0x563c50b732b0 2023-09-13T06:08:48.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c50b8e200 con 0x563c50b8ee70 2023-09-13T06:08:48.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50b47080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50b47080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57532/0 (socket says 172.21.15.130:57532) 2023-09-13T06:08:48.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e37fff640 1 -- 172.21.15.130:0/2813283720 learned_addr learned my addr 172.21.15.130:0/2813283720 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:48.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e37fff640 1 -- 172.21.15.130:0/2813283720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8ee70 msgr2=0x563c50b475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:48.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e37fff640 1 --2- 172.21.15.130:0/2813283720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8ee70 0x563c50b475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e37fff640 1 -- 172.21.15.130:0/2813283720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b732b0 msgr2=0x563c50b48600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:48.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e44da7640 1 --2- 172.21.15.130:0/2813283720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b732b0 0x563c50b48600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e37fff640 1 --2- 172.21.15.130:0/2813283720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b732b0 0x563c50b48600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e37fff640 1 -- 172.21.15.130:0/2813283720 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c5093d4a0 con 0x563c50b8e550 2023-09-13T06:08:48.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e44da7640 1 --2- 172.21.15.130:0/2813283720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b732b0 0x563c50b48600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:08:48.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e37fff640 1 --2- 172.21.15.130:0/2813283720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50b47080 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0e30000c10 tx=0x7f0e30009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e8ac1b0754ec72 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:48.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e26ffd640 1 -- 172.21.15.130:0/2813283720 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30024040 con 0x563c50b8e550 2023-09-13T06:08:48.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e26ffd640 1 -- 172.21.15.130:0/2813283720 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e30006d20 con 0x563c50b8e550 2023-09-13T06:08:48.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e26ffd640 1 -- 172.21.15.130:0/2813283720 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300295d0 con 0x563c50b8e550 2023-09-13T06:08:48.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 -- 172.21.15.130:0/2813283720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 msgr2=0x563c50b47080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/2813283720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50b47080 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0e30000c10 tx=0x7f0e30009000 comp rx=0 tx=0).stop 2023-09-13T06:08:48.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 -- 172.21.15.130:0/2813283720 shutdown_connections 2023-09-13T06:08:48.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/2813283720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8ee70 0x563c50b475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/2813283720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50b47080 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/2813283720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b732b0 0x563c50b48600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 -- 172.21.15.130:0/2813283720 >> 172.21.15.130:0/2813283720 conn(0x563c50b3bc40 msgr2=0x563c50b9bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:48.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 -- 172.21.15.130:0/2813283720 shutdown_connections 2023-09-13T06:08:48.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 -- 172.21.15.130:0/2813283720 wait complete. 2023-09-13T06:08:48.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 -- start start 2023-09-13T06:08:48.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.523+0000 7f0e4a37c000 1 Processor -- start 2023-09-13T06:08:48.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b732b0 0x563c50bed380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50bed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8ee70 0x563c50ba0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c50ba4f90 con 0x563c50b8e550 2023-09-13T06:08:48.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c50b72fc0 con 0x563c50b732b0 2023-09-13T06:08:48.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c5098e5e0 con 0x563c50b8ee70 2023-09-13T06:08:48.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 10 client.0 _ll_register_callbacks cb 0x563c5094aea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:08:48.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50bed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50bed8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57546/0 (socket says 172.21.15.130:57546) 2023-09-13T06:08:48.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e37fff640 1 -- 172.21.15.130:0/880093940 learned_addr learned my addr 172.21.15.130:0/880093940 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:48.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e44da7640 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b732b0 0x563c50bed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e455a8640 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8ee70 0x563c50ba0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e37fff640 1 -- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8ee70 msgr2=0x563c50ba0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:48.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e37fff640 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8ee70 0x563c50ba0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e37fff640 1 -- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b732b0 msgr2=0x563c50bed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:48.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e37fff640 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b732b0 0x563c50bed380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e37fff640 1 -- 172.21.15.130:0/880093940 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c5068e890 con 0x563c50b8e550 2023-09-13T06:08:48.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e37fff640 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50bed8c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0e3002b040 tx=0x7f0e30004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2178238c288c89 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:48.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:08:48.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/880093940 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30024040 con 0x563c50b8e550 2023-09-13T06:08:48.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/880093940 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e30036070 con 0x563c50b8e550 2023-09-13T06:08:48.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 -- 172.21.15.130:0/880093940 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c5094f900 con 0x563c50b8e550 2023-09-13T06:08:48.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/880093940 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e300295c0 con 0x563c50b8e550 2023-09-13T06:08:48.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 10 client.8397 fetch_fsmap learned FSMap version 76 2023-09-13T06:08:48.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 -- 172.21.15.130:0/880093940 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x563c5068ecc0 con 0x563c50b8e550 2023-09-13T06:08:48.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/880093940 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c5094f900 con 0x563c50b8e550 2023-09-13T06:08:48.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/880093940 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0e30029900 con 0x563c50b8e550 2023-09-13T06:08:48.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 10 client.8397 fetch_fsmap finished waiting for FSMap version 76 2023-09-13T06:08:48.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 10 client.8397 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-13T06:08:48.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 20 client.8397 populate_metadata read hostname 'smithi130' 2023-09-13T06:08:48.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:6833/2618060608,v1:172.21.15.164:6835/2618060608] conn(0x563c50ba17b0 0x563c50ba1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 4 client.8397 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T06:08:48.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 -- 172.21.15.130:0/880093940 --> [v2:172.21.15.164:6833/2618060608,v1:172.21.15.164:6835/2618060608] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563c5098d2c0 con 0x563c50ba17b0 2023-09-13T06:08:48.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e44da7640 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:6833/2618060608,v1:172.21.15.164:6835/2618060608] conn(0x563c50ba17b0 0x563c50ba1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e1f7fe640 10 client.8397 ms_handle_connect on v2:172.21.15.164:6833/2618060608 2023-09-13T06:08:48.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e44da7640 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:6833/2618060608,v1:172.21.15.164:6835/2618060608] conn(0x563c50ba17b0 0x563c50ba1b90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24598a2ed3986586 server_cookie=333868ca2bee603a in_seq=0 out_seq=0 2023-09-13T06:08:48.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e1f7fe640 1 -- 172.21.15.130:0/880093940 <== mds.0 v2:172.21.15.164:6833/2618060608 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x563c5098d2c0 con 0x563c50ba17b0 2023-09-13T06:08:48.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e1f7fe640 10 client.8397 handle_command_reply: tid=0 2023-09-13T06:08:48.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 client.8397 shutdown 2023-09-13T06:08:48.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 -- 172.21.15.130:0/880093940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 msgr2=0x563c50bed8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50bed8c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0e3002b040 tx=0x7f0e30004740 comp rx=0 tx=0).stop 2023-09-13T06:08:48.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 -- 172.21.15.130:0/880093940 shutdown_connections 2023-09-13T06:08:48.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:6833/2618060608,v1:172.21.15.164:6835/2618060608] conn(0x563c50ba17b0 0x563c50ba1b90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x563c50b8ee70 0x563c50ba0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c50b8e550 0x563c50bed8c0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e1f7fe640 0 client.8397 ms_handle_reset on v2:172.21.15.164:6833/2618060608 2023-09-13T06:08:48.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 --2- 172.21.15.130:0/880093940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c50b732b0 0x563c50bed380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 -- 172.21.15.130:0/880093940 >> 172.21.15.130:0/880093940 conn(0x563c50b3bc40 msgr2=0x563c50b71620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:48.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.527+0000 7f0e4a37c000 1 -- 172.21.15.130:0/880093940 shutdown_connections 2023-09-13T06:08:48.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4a37c000 1 -- 172.21.15.130:0/880093940 wait complete. 2023-09-13T06:08:48.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4a37c000 20 client.8397 trim_cache size 0 max 16384 2023-09-13T06:08:48.552 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:08:48.552 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:08:48.552 INFO:teuthology.orchestra.run.smithi130.stdout: "whoami": 0, 2023-09-13T06:08:48.552 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 8244, 2023-09-13T06:08:48.552 INFO:teuthology.orchestra.run.smithi130.stdout: "want_state": "up:active", 2023-09-13T06:08:48.553 INFO:teuthology.orchestra.run.smithi130.stdout: "state": "up:active", 2023-09-13T06:08:48.553 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs", 2023-09-13T06:08:48.553 INFO:teuthology.orchestra.run.smithi130.stdout: "rank_uptime": 5.8725561519999996, 2023-09-13T06:08:48.553 INFO:teuthology.orchestra.run.smithi130.stdout: "mdsmap_epoch": 76, 2023-09-13T06:08:48.553 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch": 155, 2023-09-13T06:08:48.553 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch_barrier": 155, 2023-09-13T06:08:48.554 INFO:teuthology.orchestra.run.smithi130.stdout: "uptime": 11.777537878 2023-09-13T06:08:48.554 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:08:48.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 -- 172.21.15.130:0/829450808 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 msgr2=0x7f0e2c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 0x7f0e2c067fe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0ae000 tx=0x7f0e3c008040 comp rx=0 tx=0).stop 2023-09-13T06:08:48.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 -- 172.21.15.130:0/829450808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e40159f20 msgr2=0x7f0e40070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e40159f20 0x7f0e40070330 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800c7c0 tx=0x7f0e3800cc80 comp rx=0 tx=0).stop 2023-09-13T06:08:48.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 -- 172.21.15.130:0/829450808 shutdown_connections 2023-09-13T06:08:48.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e2c065b20 0x7f0e2c067fe0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e40159f20 0x7f0e40070330 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e400cdfc0 0x7f0e4014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 --2- 172.21.15.130:0/829450808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e400b1610 0x7f0e400ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 -- 172.21.15.130:0/829450808 >> 172.21.15.130:0/829450808 conn(0x7f0e40065990 msgr2=0x7f0e4006cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:48.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 -- 172.21.15.130:0/829450808 shutdown_connections 2023-09-13T06:08:48.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.531+0000 7f0e4700b640 1 -- 172.21.15.130:0/829450808 wait complete. 2023-09-13T06:08:48.558 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:08:48.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.695+0000 7f08cb40b640 1 Processor -- start 2023-09-13T06:08:48.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.695+0000 7f08cb40b640 1 -- start start 2023-09-13T06:08:48.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08cb40b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f08c4157920 0x7f08c40ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08cb40b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f08c40b0f40 0x7f08c40b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08cb40b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c40afee0 con 0x7f08c415e560 2023-09-13T06:08:48.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08cb40b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c40aea50 con 0x7f08c4157920 2023-09-13T06:08:48.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08cb40b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c40b0b20 con 0x7f08c40b0f40 2023-09-13T06:08:48.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08c91a7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f08c4157920 0x7f08c40ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08c91a7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f08c4157920 0x7f08c40ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57554/0 (socket says 172.21.15.130:57554) 2023-09-13T06:08:48.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08c91a7640 1 -- 172.21.15.130:0/2248929978 learned_addr learned my addr 172.21.15.130:0/2248929978 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:48.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08c89a6640 1 --2- 172.21.15.130:0/2248929978 >> v2:172.21.15.164:3300/0 conn(0x7f08c40b0f40 0x7f08c40b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08c91a7640 1 -- 172.21.15.130:0/2248929978 >> v2:172.21.15.164:3300/0 conn(0x7f08c40b0f40 msgr2=0x7f08c40b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:48.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08c91a7640 1 --2- 172.21.15.130:0/2248929978 >> v2:172.21.15.164:3300/0 conn(0x7f08c40b0f40 0x7f08c40b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08c91a7640 1 -- 172.21.15.130:0/2248929978 >> v1:172.21.15.164:6789/0 conn(0x7f08c415e560 legacy=0x7f08c40ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:48.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08c91a7640 1 -- 172.21.15.130:0/2248929978 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c40b0180 con 0x7f08c4157920 2023-09-13T06:08:48.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.699+0000 7f08c91a7640 1 --2- 172.21.15.130:0/2248929978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08c4157920 0x7f08c40ae190 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f08c406e070 tx=0x7f08c001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b4daacf2317ac4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:48.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08bbfff640 1 -- 172.21.15.130:0/2248929978 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c00ac600 con 0x7f08c4157920 2023-09-13T06:08:48.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08bbfff640 1 -- 172.21.15.130:0/2248929978 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c00a8050 con 0x7f08c4157920 2023-09-13T06:08:48.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08bbfff640 1 -- 172.21.15.130:0/2248929978 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c00ac980 con 0x7f08c4157920 2023-09-13T06:08:48.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 -- 172.21.15.130:0/2248929978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08c4157920 msgr2=0x7f08c40ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 --2- 172.21.15.130:0/2248929978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08c4157920 0x7f08c40ae190 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f08c406e070 tx=0x7f08c001c490 comp rx=0 tx=0).stop 2023-09-13T06:08:48.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 -- 172.21.15.130:0/2248929978 shutdown_connections 2023-09-13T06:08:48.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 --2- 172.21.15.130:0/2248929978 >> v2:172.21.15.164:3300/0 conn(0x7f08c40b0f40 0x7f08c40b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 --2- 172.21.15.130:0/2248929978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08c4157920 0x7f08c40ae190 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 -- 172.21.15.130:0/2248929978 >> 172.21.15.130:0/2248929978 conn(0x7f08c4065990 msgr2=0x7f08c4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:48.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 -- 172.21.15.130:0/2248929978 shutdown_connections 2023-09-13T06:08:48.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 -- 172.21.15.130:0/2248929978 wait complete. 2023-09-13T06:08:48.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 Processor -- start 2023-09-13T06:08:48.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 -- start start 2023-09-13T06:08:48.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08c40b0f40 0x7f08c4146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08c4157920 0x7f08c4070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08c415e560 0x7f08c40706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c41473a0 con 0x7f08c4157920 2023-09-13T06:08:48.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c414f020 con 0x7f08c415e560 2023-09-13T06:08:48.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08cb40b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c414ead0 con 0x7f08c40b0f40 2023-09-13T06:08:48.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08c89a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08c4157920 0x7f08c4070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08c89a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08c4157920 0x7f08c4070160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57562/0 (socket says 172.21.15.130:57562) 2023-09-13T06:08:48.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.703+0000 7f08c89a6640 1 -- 172.21.15.130:0/187103933 learned_addr learned my addr 172.21.15.130:0/187103933 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:48.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08c89a6640 1 -- 172.21.15.130:0/187103933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08c40b0f40 msgr2=0x7f08c4146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08c89a6640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08c40b0f40 0x7f08c4146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08c89a6640 1 -- 172.21.15.130:0/187103933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08c415e560 msgr2=0x7f08c40706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08c89a6640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08c415e560 0x7f08c40706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08c89a6640 1 -- 172.21.15.130:0/187103933 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00094d0 con 0x7f08c4157920 2023-09-13T06:08:48.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08c89a6640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08c4157920 0x7f08c4070160 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f08b400d800 tx=0x7f08b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:48.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08b9ffb640 1 -- 172.21.15.130:0/187103933 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400b6c0 con 0x7f08c4157920 2023-09-13T06:08:48.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08b9ffb640 1 -- 172.21.15.130:0/187103933 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b400b820 con 0x7f08c4157920 2023-09-13T06:08:48.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08b9ffb640 1 -- 172.21.15.130:0/187103933 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400bb90 con 0x7f08c4157920 2023-09-13T06:08:48.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08cb40b640 1 -- 172.21.15.130:0/187103933 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c4156bc0 con 0x7f08c4157920 2023-09-13T06:08:48.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08cb40b640 1 -- 172.21.15.130:0/187103933 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c41566a0 con 0x7f08c4157920 2023-09-13T06:08:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08cb40b640 1 -- 172.21.15.130:0/187103933 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c4156860 con 0x7f08c4157920 2023-09-13T06:08:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08b9ffb640 1 -- 172.21.15.130:0/187103933 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f08b400bcf0 con 0x7f08c4157920 2023-09-13T06:08:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08b9ffb640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08a8065b20 0x7f08a8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.707+0000 7f08b9ffb640 1 -- 172.21.15.130:0/187103933 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08b4083820 con 0x7f08c4157920 2023-09-13T06:08:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.711+0000 7f08c91a7640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08a8065b20 0x7f08a8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.711+0000 7f08c91a7640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08a8065b20 0x7f08a8067fe0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f08c00ae000 tx=0x7f08c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.711+0000 7f08b9ffb640 1 -- 172.21.15.130:0/187103933 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f08b4051200 con 0x7f08c4157920 2023-09-13T06:08:48.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.891+0000 7f08cb40b640 1 -- 172.21.15.130:0/187103933 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f08c40618a0 con 0x7f08c4157920 2023-09-13T06:08:48.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.891+0000 7f08b9ffb640 1 -- 172.21.15.130:0/187103933 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7f08b4083070 con 0x7f08c4157920 2023-09-13T06:08:48.895 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:08:48.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 -- 172.21.15.130:0/187103933 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08a8065b20 msgr2=0x7f08a8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08a8065b20 0x7f08a8067fe0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f08c00ae000 tx=0x7f08c0008040 comp rx=0 tx=0).stop 2023-09-13T06:08:48.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 -- 172.21.15.130:0/187103933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08c4157920 msgr2=0x7f08c4070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:48.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08c4157920 0x7f08c4070160 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f08b400d800 tx=0x7f08b400dcc0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 -- 172.21.15.130:0/187103933 shutdown_connections 2023-09-13T06:08:48.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f08a8065b20 0x7f08a8067fe0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08c415e560 0x7f08c40706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08c4157920 0x7f08c4070160 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 --2- 172.21.15.130:0/187103933 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08c40b0f40 0x7f08c4146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:48.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 -- 172.21.15.130:0/187103933 >> 172.21.15.130:0/187103933 conn(0x7f08c4065990 msgr2=0x7f08c40ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:48.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 -- 172.21.15.130:0/187103933 shutdown_connections 2023-09-13T06:08:48.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:48.895+0000 7f08cb40b640 1 -- 172.21.15.130:0/187103933 wait complete. 2023-09-13T06:08:48.915 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:08:48.916 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:08:48.916 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:08:48.916 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T06:08:48.917 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:08:48.917 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:08:48.918 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:08:48.918 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:08:48.918 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:08:48.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:48.919 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:08:48.930 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:08:48.930 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:08:48.930 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:08:48.931 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:48.931 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:08:48.931 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:48.931 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:08:48.931 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:48.932 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:08:48.932 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:08:48.932 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:48.932 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:08:48.932 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:08:48.933 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:48.933 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:08:48.933 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:48.933 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:08:48.933 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 41978sec preferred_lft 41978sec 2023-09-13T06:08:48.934 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:08:48.934 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:48.934 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:08:48.934 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:48.934 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:08:48.934 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:48.935 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:08:48.935 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:48.935 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:08:48.935 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:48.935 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:08:48.936 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:48.936 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:08:48.936 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:08:48.936 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:08:48.936 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:48.937 INFO:teuthology.orchestra.run.smithi130.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:08:48.937 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:08:48.937 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:08:48.937 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:48.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:48.938 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:08:48.990 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:08:48.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:48.992 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:08:49.046 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:08:49.047 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:08:49.047 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:08:49.047 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:08:49.048 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:08:49.048 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:08:49.048 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:08:49.048 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:08:49.049 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:08:49.049 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:08:49.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:49.050 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:08:49.051 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:08:49.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:08:49.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:08:49.052 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:08:49.052 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:08:49.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:49.139 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:08:49.150 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T06:08:49.150 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:08:49.151 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:08:49.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:49.152 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-09-13T06:08:49.213 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:08:49.213 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T06:08:49.264 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:08:49.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:08:49.264 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:08:49.315 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:08:49.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:49.316 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:08:49.408 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:08:49.408 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:08:49.408 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:08:49.423 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:08:49.424 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:08:49.424 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:08:49.424 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:08:49.424 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:08:49.433 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:08:49.433 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:08:49.434 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:08:49.434 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:08:49.434 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:08:49.434 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:08:49.434 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:08:49.435 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:08:49.437 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:08:49.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:49.438 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:08:49.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:49.461 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:08:49.524 INFO:teuthology.orchestra.run.smithi130.stdout:client6830 2023-09-13T06:08:49.525 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:08:49.525 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:49.576 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:08:49.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.755+0000 7fd7eda9c640 1 Processor -- start 2023-09-13T06:08:49.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.755+0000 7fd7eda9c640 1 -- start start 2023-09-13T06:08:49.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7eda9c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd7e80b04a0 0x7fd7e80b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:49.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7eda9c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e80ccbe0 con 0x7fd7e815b130 2023-09-13T06:08:49.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7eda9c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e80ce980 con 0x7fd7e80cc780 2023-09-13T06:08:49.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7eda9c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e80b0e50 con 0x7fd7e80b04a0 2023-09-13T06:08:49.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7e77fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd7e815b130 0x7fd7e80ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51104/0 (socket says 172.21.15.130:51104) 2023-09-13T06:08:49.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7e77fe640 1 -- 172.21.15.130:0/2866033570 learned_addr learned my addr 172.21.15.130:0/2866033570 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:49.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7e7fff640 1 --2- 172.21.15.130:0/2866033570 >> v2:172.21.15.130:3300/0 conn(0x7fd7e80b04a0 0x7fd7e80b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:49.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7e6ffd640 1 -- 172.21.15.130:0/2866033570 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302298794 0 0) 0x7fd7e80ccbe0 con 0x7fd7e815b130 2023-09-13T06:08:49.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7e7fff640 1 -- 172.21.15.130:0/2866033570 >> v1:172.21.15.164:6789/0 conn(0x7fd7e80cc780 legacy=0x7fd7e815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:49.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7e7fff640 1 -- 172.21.15.130:0/2866033570 >> v1:172.21.15.130:6789/0 conn(0x7fd7e815b130 legacy=0x7fd7e80ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:49.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7e7fff640 1 -- 172.21.15.130:0/2866033570 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80cec60 con 0x7fd7e80b04a0 2023-09-13T06:08:49.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.759+0000 7fd7e7fff640 1 --2- 172.21.15.130:0/2866033570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7e80b04a0 0x7fd7e80b0910 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009d90 tx=0x7fd7e001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8be31d77a7f1d9b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:49.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7e6ffd640 1 -- 172.21.15.130:0/2866033570 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00a59a0 con 0x7fd7e80b04a0 2023-09-13T06:08:49.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7e6ffd640 1 -- 172.21.15.130:0/2866033570 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e00a5b00 con 0x7fd7e80b04a0 2023-09-13T06:08:49.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7e6ffd640 1 -- 172.21.15.130:0/2866033570 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00a5e90 con 0x7fd7e80b04a0 2023-09-13T06:08:49.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 -- 172.21.15.130:0/2866033570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7e80b04a0 msgr2=0x7fd7e80b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:49.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 --2- 172.21.15.130:0/2866033570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7e80b04a0 0x7fd7e80b0910 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009d90 tx=0x7fd7e001c8e0 comp rx=0 tx=0).stop 2023-09-13T06:08:49.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 -- 172.21.15.130:0/2866033570 shutdown_connections 2023-09-13T06:08:49.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 --2- 172.21.15.130:0/2866033570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7e80b04a0 0x7fd7e80b0910 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:49.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 -- 172.21.15.130:0/2866033570 >> 172.21.15.130:0/2866033570 conn(0x7fd7e8065990 msgr2=0x7fd7e8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:49.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 -- 172.21.15.130:0/2866033570 shutdown_connections 2023-09-13T06:08:49.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 -- 172.21.15.130:0/2866033570 wait complete. 2023-09-13T06:08:49.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 Processor -- start 2023-09-13T06:08:49.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 -- start start 2023-09-13T06:08:49.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e80b04a0 0x7fd7e814d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:49.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e80cc780 0x7fd7e8153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:49.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7e815b130 0x7fd7e8148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:49.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8151df0 con 0x7fd7e815b130 2023-09-13T06:08:49.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8148c80 con 0x7fd7e80cc780 2023-09-13T06:08:49.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7eda9c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8152be0 con 0x7fd7e80b04a0 2023-09-13T06:08:49.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7e7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7e815b130 0x7fd7e8148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:49.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7e7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7e815b130 0x7fd7e8148740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57578/0 (socket says 172.21.15.130:57578) 2023-09-13T06:08:49.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7e7fff640 1 -- 172.21.15.130:0/3752838239 learned_addr learned my addr 172.21.15.130:0/3752838239 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:49.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7e77fe640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e80b04a0 0x7fd7e814d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:49.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.763+0000 7fd7dffff640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e80cc780 0x7fd7e8153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:49.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e7fff640 1 -- 172.21.15.130:0/3752838239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e80b04a0 msgr2=0x7fd7e814d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:49.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e7fff640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e80b04a0 0x7fd7e814d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:49.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e7fff640 1 -- 172.21.15.130:0/3752838239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e80cc780 msgr2=0x7fd7e8153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:49.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e7fff640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e80cc780 0x7fd7e8153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:49.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e7fff640 1 -- 172.21.15.130:0/3752838239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e0009a70 con 0x7fd7e815b130 2023-09-13T06:08:49.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e7fff640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7e815b130 0x7fd7e8148740 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00194f0 tx=0x7fd7e0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:49.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e4ff9640 1 -- 172.21.15.130:0/3752838239 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00aee00 con 0x7fd7e815b130 2023-09-13T06:08:49.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e4ff9640 1 -- 172.21.15.130:0/3752838239 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e0009450 con 0x7fd7e815b130 2023-09-13T06:08:49.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7eda9c640 1 -- 172.21.15.130:0/3752838239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e81522b0 con 0x7fd7e815b130 2023-09-13T06:08:49.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e4ff9640 1 -- 172.21.15.130:0/3752838239 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00b7610 con 0x7fd7e815b130 2023-09-13T06:08:49.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7eda9c640 1 -- 172.21.15.130:0/3752838239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e8152870 con 0x7fd7e815b130 2023-09-13T06:08:49.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7eda9c640 1 -- 172.21.15.130:0/3752838239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e8152d70 con 0x7fd7e815b130 2023-09-13T06:08:49.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e4ff9640 1 -- 172.21.15.130:0/3752838239 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd7e00b4050 con 0x7fd7e815b130 2023-09-13T06:08:49.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e4ff9640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c8065b20 0x7fd7c8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:49.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e4ff9640 1 -- 172.21.15.130:0/3752838239 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7e011e270 con 0x7fd7e815b130 2023-09-13T06:08:49.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.767+0000 7fd7e77fe640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c8065b20 0x7fd7c8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:49.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.771+0000 7fd7e77fe640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c8065b20 0x7fd7c8067fe0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8000f70 tx=0x7fd7d8007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:49.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.771+0000 7fd7e4ff9640 1 -- 172.21.15.130:0/3752838239 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd7e00ebc70 con 0x7fd7e815b130 2023-09-13T06:08:49.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 -- 172.21.15.130:0/3752838239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd7e80618a0 con 0x7fd7e815b130 2023-09-13T06:08:49.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7e4ff9640 1 -- 172.21.15.130:0/3752838239 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd7e00ef290 con 0x7fd7e815b130 2023-09-13T06:08:49.953 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:08:49.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 -- 172.21.15.130:0/3752838239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c8065b20 msgr2=0x7fd7c8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:49.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c8065b20 0x7fd7c8067fe0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8000f70 tx=0x7fd7d8007df0 comp rx=0 tx=0).stop 2023-09-13T06:08:49.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 -- 172.21.15.130:0/3752838239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7e815b130 msgr2=0x7fd7e8148740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:49.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7e815b130 0x7fd7e8148740 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00194f0 tx=0x7fd7e0019680 comp rx=0 tx=0).stop 2023-09-13T06:08:49.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 -- 172.21.15.130:0/3752838239 shutdown_connections 2023-09-13T06:08:49.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c8065b20 0x7fd7c8067fe0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:49.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7e80cc780 0x7fd7e8153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:49.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7e815b130 0x7fd7e8148740 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:49.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 --2- 172.21.15.130:0/3752838239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7e80b04a0 0x7fd7e814d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:49.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 -- 172.21.15.130:0/3752838239 >> 172.21.15.130:0/3752838239 conn(0x7fd7e8065990 msgr2=0x7fd7e80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:49.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 -- 172.21.15.130:0/3752838239 shutdown_connections 2023-09-13T06:08:49.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:49.951+0000 7fd7eda9c640 1 -- 172.21.15.130:0/3752838239 wait complete. 2023-09-13T06:08:49.974 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:08:49.974 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:08:49.975 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:08:49.975 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T06:08:49.975 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:08:49.976 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:08:49.976 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:08:49.976 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:08:49.977 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:08:49.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:49.977 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:08:49.988 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:08:49.988 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:08:49.989 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:08:49.989 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:49.989 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:08:49.989 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:49.989 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:08:49.989 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:49.990 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:08:49.990 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:08:49.990 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:49.990 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:08:49.990 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:08:49.991 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:49.991 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:08:49.991 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:49.991 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:08:49.991 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 41994sec preferred_lft 41994sec 2023-09-13T06:08:49.992 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:08:49.992 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:49.992 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:08:49.992 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:49.992 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:08:49.993 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:49.993 INFO:teuthology.orchestra.run.smithi164.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:08:49.993 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:08:49.993 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:08:49.993 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:49.993 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:08:49.994 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:49.994 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:08:49.994 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:08:49.994 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:08:49.994 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:49.995 INFO:teuthology.orchestra.run.smithi164.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:08:49.995 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:08:49.995 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:08:49.995 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:08:49.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:49.997 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:08:50.061 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:08:50.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:50.113 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:08:50.170 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:08:50.171 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:08:50.171 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:08:50.172 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:08:50.172 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:08:50.172 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:08:50.172 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:08:50.173 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:08:50.173 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:08:50.173 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:08:50.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:50.175 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:08:50.176 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:08:50.176 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:08:50.177 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:08:50.178 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:08:50.178 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:08:50.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:50.273 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:08:50.284 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-13T06:08:50.284 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:08:50.285 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:08:50.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:50.286 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-09-13T06:08:50.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:08:50.347 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T06:08:50.401 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:08:50.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:08:50.402 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:08:50.453 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:08:50.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:50.454 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:08:50.550 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:08:50.550 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:08:50.551 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:08:50.565 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:08:50.566 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:08:50.566 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:08:50.566 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:08:50.566 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:08:50.574 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:08:50.574 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:08:50.574 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:08:50.575 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:08:50.575 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:08:50.575 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:08:50.575 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:08:50.575 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:08:50.579 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:08:50.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:50.579 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:08:50.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:08:50.601 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:08:50.652 INFO:teuthology.orchestra.run.smithi164.stdout:client7675 2023-09-13T06:08:50.652 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:08:50.653 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:08:50.701 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:08:50.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c651a3640 1 Processor -- start 2023-09-13T06:08:50.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c651a3640 1 -- start start 2023-09-13T06:08:50.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c651a3640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2c60159f20 0x7f2c600ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:50.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c651a3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2c600b1d20 0x7f2c600b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:50.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c651a3640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c600ccfd0 con 0x7f2c600cdfc0 2023-09-13T06:08:50.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c651a3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c600b00f0 con 0x7f2c600b1d20 2023-09-13T06:08:50.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c651a3640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c600b11d0 con 0x7f2c60159f20 2023-09-13T06:08:50.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c5f59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2c600b1d20 0x7f2c600b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:50.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c5e59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2c600cdfc0 0x7f2c600b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51116/0 (socket says 172.21.15.130:51116) 2023-09-13T06:08:50.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c5e59c640 1 -- 172.21.15.130:0/455084520 learned_addr learned my addr 172.21.15.130:0/455084520 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:08:50.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c5ed9d640 1 --2- 172.21.15.130:0/455084520 >> v2:172.21.15.164:3300/0 conn(0x7f2c60159f20 0x7f2c600ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:50.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c5f59e640 1 -- 172.21.15.130:0/455084520 >> v2:172.21.15.164:3300/0 conn(0x7f2c60159f20 msgr2=0x7f2c600ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:50.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c5f59e640 1 --2- 172.21.15.130:0/455084520 >> v2:172.21.15.164:3300/0 conn(0x7f2c60159f20 0x7f2c600ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:50.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c5f59e640 1 -- 172.21.15.130:0/455084520 >> v1:172.21.15.130:6789/0 conn(0x7f2c600cdfc0 legacy=0x7f2c600b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:50.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c5f59e640 1 -- 172.21.15.130:0/455084520 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c600ced90 con 0x7f2c600b1d20 2023-09-13T06:08:50.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.843+0000 7f2c5dd9b640 1 -- 172.21.15.130:0/455084520 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603603608 0 0) 0x7f2c600ccfd0 con 0x7f2c600cdfc0 2023-09-13T06:08:50.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c5f59e640 1 --2- 172.21.15.130:0/455084520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c600b1d20 0x7f2c600b0c90 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f2c600b2660 tx=0x7f2c5801eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b281b347f846a3e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:50.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c5dd9b640 1 -- 172.21.15.130:0/455084520 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580a7bc0 con 0x7f2c600b1d20 2023-09-13T06:08:50.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c5dd9b640 1 -- 172.21.15.130:0/455084520 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c580a7d20 con 0x7f2c600b1d20 2023-09-13T06:08:50.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c5dd9b640 1 -- 172.21.15.130:0/455084520 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580af660 con 0x7f2c600b1d20 2023-09-13T06:08:50.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c651a3640 1 -- 172.21.15.130:0/455084520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c600b1d20 msgr2=0x7f2c600b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:50.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c651a3640 1 --2- 172.21.15.130:0/455084520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c600b1d20 0x7f2c600b0c90 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f2c600b2660 tx=0x7f2c5801eaf0 comp rx=0 tx=0).stop 2023-09-13T06:08:50.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c651a3640 1 -- 172.21.15.130:0/455084520 shutdown_connections 2023-09-13T06:08:50.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c651a3640 1 --2- 172.21.15.130:0/455084520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c600b1d20 0x7f2c600b0c90 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:50.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c651a3640 1 --2- 172.21.15.130:0/455084520 >> v2:172.21.15.164:3300/0 conn(0x7f2c60159f20 0x7f2c600ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:50.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c651a3640 1 -- 172.21.15.130:0/455084520 >> 172.21.15.130:0/455084520 conn(0x7f2c60065990 msgr2=0x7f2c60065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:50.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c651a3640 1 -- 172.21.15.130:0/455084520 shutdown_connections 2023-09-13T06:08:50.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.847+0000 7f2c651a3640 1 -- 172.21.15.130:0/455084520 wait complete. 2023-09-13T06:08:50.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c651a3640 1 Processor -- start 2023-09-13T06:08:50.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c651a3640 1 -- start start 2023-09-13T06:08:50.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c651a3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c600b1d20 0x7f2c6014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:50.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c651a3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c600cdfc0 0x7f2c600ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:50.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c651a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c60159f20 0x7f2c600cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:50.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c651a3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c60152c30 con 0x7f2c60159f20 2023-09-13T06:08:50.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c651a3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c60151b90 con 0x7f2c600cdfc0 2023-09-13T06:08:50.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c651a3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c60151e70 con 0x7f2c600b1d20 2023-09-13T06:08:50.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c5f59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c60159f20 0x7f2c600cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:50.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c5f59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c60159f20 0x7f2c600cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57596/0 (socket says 172.21.15.130:57596) 2023-09-13T06:08:50.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c5f59e640 1 -- 172.21.15.130:0/1727691013 learned_addr learned my addr 172.21.15.130:0/1727691013 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:50.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c5ed9d640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c600b1d20 0x7f2c6014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:50.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c5e59c640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c600cdfc0 0x7f2c600ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:50.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c5f59e640 1 -- 172.21.15.130:0/1727691013 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c600b1d20 msgr2=0x7f2c6014efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:50.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c5f59e640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c600b1d20 0x7f2c6014efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:50.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c5f59e640 1 -- 172.21.15.130:0/1727691013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c600cdfc0 msgr2=0x7f2c600ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:50.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c5f59e640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c600cdfc0 0x7f2c600ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:50.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c5f59e640 1 -- 172.21.15.130:0/1727691013 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c58009a70 con 0x7f2c60159f20 2023-09-13T06:08:50.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.851+0000 7f2c5f59e640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c60159f20 0x7f2c600cef40 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f2c5801b700 tx=0x7f2c5801b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:50.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.855+0000 7f2c477fe640 1 -- 172.21.15.130:0/1727691013 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580a7bc0 con 0x7f2c60159f20 2023-09-13T06:08:50.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.855+0000 7f2c477fe640 1 -- 172.21.15.130:0/1727691013 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c580a7e90 con 0x7f2c60159f20 2023-09-13T06:08:50.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.855+0000 7f2c651a3640 1 -- 172.21.15.130:0/1727691013 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c60152150 con 0x7f2c60159f20 2023-09-13T06:08:50.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.855+0000 7f2c477fe640 1 -- 172.21.15.130:0/1727691013 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580afd00 con 0x7f2c60159f20 2023-09-13T06:08:50.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.855+0000 7f2c651a3640 1 -- 172.21.15.130:0/1727691013 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c60152710 con 0x7f2c60159f20 2023-09-13T06:08:50.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.855+0000 7f2c651a3640 1 -- 172.21.15.130:0/1727691013 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c600618a0 con 0x7f2c60159f20 2023-09-13T06:08:50.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.855+0000 7f2c477fe640 1 -- 172.21.15.130:0/1727691013 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2c580b6070 con 0x7f2c60159f20 2023-09-13T06:08:50.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.855+0000 7f2c477fe640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c4c065b20 0x7f2c4c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:50.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.855+0000 7f2c477fe640 1 -- 172.21.15.130:0/1727691013 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c5811dd40 con 0x7f2c60159f20 2023-09-13T06:08:50.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.855+0000 7f2c5ed9d640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c4c065b20 0x7f2c4c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:50.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.855+0000 7f2c5ed9d640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c4c065b20 0x7f2c4c067fe0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2c60157a20 tx=0x7f2c50009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:50.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:50.859+0000 7f2c477fe640 1 -- 172.21.15.130:0/1727691013 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2c580eb850 con 0x7f2c60159f20 2023-09-13T06:08:51.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.039+0000 7f2c651a3640 1 -- 172.21.15.130:0/1727691013 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c600cd7c0 con 0x7f2c60159f20 2023-09-13T06:08:51.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.039+0000 7f2c477fe640 1 -- 172.21.15.130:0/1727691013 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f2c580afe60 con 0x7f2c60159f20 2023-09-13T06:08:51.043 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:08:51.043 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2638049185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2638049185},{"type":"v1","addr":"172.21.15.164:6834","nonce":2638049185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/4101999538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4101999538},{"type":"v1","addr":"172.21.15.130:6835","nonce":4101999538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1691911082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1691911082},{"type":"v1","addr":"172.21.15.130:6837","nonce":1691911082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:08:42.026268+0000","modified":"2023-09-13T06:08:45.060479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2618060608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2618060608},{"type":"v1","addr":"172.21.15.164:6835","nonce":2618060608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-09-13T06:08:51.044 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 76 2023-09-13T06:08:51.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 -- 172.21.15.130:0/1727691013 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c4c065b20 msgr2=0x7f2c4c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:51.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c4c065b20 0x7f2c4c067fe0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2c60157a20 tx=0x7f2c50009190 comp rx=0 tx=0).stop 2023-09-13T06:08:51.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 -- 172.21.15.130:0/1727691013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c60159f20 msgr2=0x7f2c600cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:51.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c60159f20 0x7f2c600cef40 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f2c5801b700 tx=0x7f2c5801b890 comp rx=0 tx=0).stop 2023-09-13T06:08:51.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 -- 172.21.15.130:0/1727691013 shutdown_connections 2023-09-13T06:08:51.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c4c065b20 0x7f2c4c067fe0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:51.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c600cdfc0 0x7f2c600ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:51.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c60159f20 0x7f2c600cef40 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:51.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 --2- 172.21.15.130:0/1727691013 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c600b1d20 0x7f2c6014efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:51.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 -- 172.21.15.130:0/1727691013 >> 172.21.15.130:0/1727691013 conn(0x7f2c60065990 msgr2=0x7f2c6006b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:51.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 -- 172.21.15.130:0/1727691013 shutdown_connections 2023-09-13T06:08:51.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.043+0000 7f2c651a3640 1 -- 172.21.15.130:0/1727691013 wait complete. 2023-09-13T06:08:51.064 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-09-13T06:08:51.222 INFO:teuthology.orchestra.run.smithi164.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":8244,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5483196929999998,"mdsmap_epoch":76,"osdmap_epoch":155,"osdmap_epoch_barrier":155,"uptime":14.453301378000001} 2023-09-13T06:08:51.223 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 8244, "mdsmap_epoch": 76, "osdmap_epoch": 155, "osdmap_epoch_barrier": 155, "rank_uptime": 8.548319693, "state": "up:active", "uptime": 14.453301378, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:08:51.223 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-09-13T06:08:51.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.363+0000 7faee4967640 1 Processor -- start 2023-09-13T06:08:51.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.363+0000 7faee4967640 1 -- start start 2023-09-13T06:08:51.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.363+0000 7faee4967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faee00ccc10 0x7faee015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:51.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.363+0000 7faee4967640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faee00b3170 0x7faee00b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:51.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.363+0000 7faee4967640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee00ccff0 con 0x7faee00b1ff0 2023-09-13T06:08:51.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.363+0000 7faee4967640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee015b590 con 0x7faee00b3170 2023-09-13T06:08:51.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.363+0000 7faee4967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee00b12f0 con 0x7faee00ccc10 2023-09-13T06:08:51.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faed7fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faee00b3170 0x7faee00b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:51.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faed7fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faee00b3170 0x7faee00b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43502/0 (socket says 172.21.15.130:43502) 2023-09-13T06:08:51.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faed7fff640 1 -- 172.21.15.130:0/651446047 learned_addr learned my addr 172.21.15.130:0/651446047 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:51.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faede59c640 1 --2- 172.21.15.130:0/651446047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faee00ccc10 0x7faee015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:51.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faed7fff640 1 -- 172.21.15.130:0/651446047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faee00ccc10 msgr2=0x7faee015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:08:51.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faed7fff640 1 --2- 172.21.15.130:0/651446047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faee00ccc10 0x7faee015dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:51.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faed7fff640 1 -- 172.21.15.130:0/651446047 >> v1:172.21.15.164:6789/0 conn(0x7faee00b1ff0 legacy=0x7faee00cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:51.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faed7fff640 1 -- 172.21.15.130:0/651446047 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee015e520 con 0x7faee00b3170 2023-09-13T06:08:51.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faed7fff640 1 --2- 172.21.15.130:0/651446047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faee00b3170 0x7faee00b1ab0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7faec800bb10 tx=0x7faec801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684c27129e037613 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:51.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faeddd9b640 1 -- 172.21.15.130:0/651446047 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80a7cb0 con 0x7faee00b3170 2023-09-13T06:08:51.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faeddd9b640 1 -- 172.21.15.130:0/651446047 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec80a7e10 con 0x7faee00b3170 2023-09-13T06:08:51.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.367+0000 7faeddd9b640 1 -- 172.21.15.130:0/651446047 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80af660 con 0x7faee00b3170 2023-09-13T06:08:51.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 -- 172.21.15.130:0/651446047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faee00b3170 msgr2=0x7faee00b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:51.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 --2- 172.21.15.130:0/651446047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faee00b3170 0x7faee00b1ab0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7faec800bb10 tx=0x7faec801ebe0 comp rx=0 tx=0).stop 2023-09-13T06:08:51.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 -- 172.21.15.130:0/651446047 shutdown_connections 2023-09-13T06:08:51.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 --2- 172.21.15.130:0/651446047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faee00b3170 0x7faee00b1ab0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:51.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 --2- 172.21.15.130:0/651446047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faee00ccc10 0x7faee015dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:51.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 -- 172.21.15.130:0/651446047 >> 172.21.15.130:0/651446047 conn(0x7faee00735e0 msgr2=0x7faee0065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:51.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 -- 172.21.15.130:0/651446047 shutdown_connections 2023-09-13T06:08:51.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 -- 172.21.15.130:0/651446047 wait complete. 2023-09-13T06:08:51.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 Processor -- start 2023-09-13T06:08:51.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 -- start start 2023-09-13T06:08:51.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faee00b1ff0 0x7faee013e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:51.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faee00b3170 0x7faee015c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:51.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faee00ccc10 0x7faee015ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:51.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee01f5440 con 0x7faee00b1ff0 2023-09-13T06:08:51.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee01f4830 con 0x7faee00b3170 2023-09-13T06:08:51.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faee4967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee01f4b10 con 0x7faee00ccc10 2023-09-13T06:08:51.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faede59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faee00b1ff0 0x7faee013e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:51.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faede59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faee00b1ff0 0x7faee013e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43510/0 (socket says 172.21.15.130:43510) 2023-09-13T06:08:51.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faede59c640 1 -- 172.21.15.130:0/1556721893 learned_addr learned my addr 172.21.15.130:0/1556721893 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:08:51.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faed7fff640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faee00b3170 0x7faee015c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:51.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faeded9d640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faee00ccc10 0x7faee015ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:51.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faede59c640 1 -- 172.21.15.130:0/1556721893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faee00ccc10 msgr2=0x7faee015ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:51.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faede59c640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faee00ccc10 0x7faee015ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:51.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faede59c640 1 -- 172.21.15.130:0/1556721893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faee00b3170 msgr2=0x7faee015c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:51.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.371+0000 7faede59c640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faee00b3170 0x7faee015c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:51.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faede59c640 1 -- 172.21.15.130:0/1556721893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec800b770 con 0x7faee00b1ff0 2023-09-13T06:08:51.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faede59c640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faee00b1ff0 0x7faee013e870 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7faed000e870 tx=0x7faed000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:51.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faed6ffd640 1 -- 172.21.15.130:0/1556721893 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0009510 con 0x7faee00b1ff0 2023-09-13T06:08:51.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faed6ffd640 1 -- 172.21.15.130:0/1556721893 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000eec0 con 0x7faee00b1ff0 2023-09-13T06:08:51.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faed6ffd640 1 -- 172.21.15.130:0/1556721893 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000cb40 con 0x7faee00b1ff0 2023-09-13T06:08:51.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faee4967640 1 -- 172.21.15.130:0/1556721893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee01f4df0 con 0x7faee00b1ff0 2023-09-13T06:08:51.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faee4967640 1 -- 172.21.15.130:0/1556721893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee013edb0 con 0x7faee00b1ff0 2023-09-13T06:08:51.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faee4967640 1 -- 172.21.15.130:0/1556721893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee00618a0 con 0x7faee00b1ff0 2023-09-13T06:08:51.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faed6ffd640 1 -- 172.21.15.130:0/1556721893 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7faed000cca0 con 0x7faee00b1ff0 2023-09-13T06:08:51.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faed6ffd640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faec0065b50 0x7faec0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:08:51.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faed6ffd640 1 -- 172.21.15.130:0/1556721893 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faed0083300 con 0x7faee00b1ff0 2023-09-13T06:08:51.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.375+0000 7faed7fff640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faec0065b50 0x7faec0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:08:51.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.379+0000 7faed7fff640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faec0065b50 0x7faec0068010 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7faec80b1000 tx=0x7faec80a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:08:51.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.379+0000 7faed6ffd640 1 -- 172.21.15.130:0/1556721893 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7faed0050cf0 con 0x7faee00b1ff0 2023-09-13T06:08:51.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:51.535+0000 7faee4967640 1 -- 172.21.15.130:0/1556721893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7faee00ce0c0 con 0x7faee00b1ff0 2023-09-13T06:08:52.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.423+0000 7faed6ffd640 1 -- 172.21.15.130:0/1556721893 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v156) v1 ==== 181+0+0 (secure 0 0 0) 0x7faed0054310 con 0x7faee00b1ff0 2023-09-13T06:08:52.427 INFO:teuthology.orchestra.run.smithi130.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-09-13T06:08:52.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 -- 172.21.15.130:0/1556721893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faec0065b50 msgr2=0x7faec0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:52.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faec0065b50 0x7faec0068010 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7faec80b1000 tx=0x7faec80a9070 comp rx=0 tx=0).stop 2023-09-13T06:08:52.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 -- 172.21.15.130:0/1556721893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faee00b1ff0 msgr2=0x7faee013e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:08:52.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faee00b1ff0 0x7faee013e870 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7faed000e870 tx=0x7faed000ec70 comp rx=0 tx=0).stop 2023-09-13T06:08:52.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 -- 172.21.15.130:0/1556721893 shutdown_connections 2023-09-13T06:08:52.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faec0065b50 0x7faec0068010 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:52.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faee00b3170 0x7faee015c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:52.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faee00ccc10 0x7faee015ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:52.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 --2- 172.21.15.130:0/1556721893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faee00b1ff0 0x7faee013e870 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:08:52.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 -- 172.21.15.130:0/1556721893 >> 172.21.15.130:0/1556721893 conn(0x7faee00735e0 msgr2=0x7faee015d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:08:52.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 -- 172.21.15.130:0/1556721893 shutdown_connections 2023-09-13T06:08:52.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:08:52.427+0000 7faee4967640 1 -- 172.21.15.130:0/1556721893 wait complete. 2023-09-13T06:08:52.454 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-13T06:08:52.611 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_mon_report_interval":"5"} 2023-09-13T06:08:52.612 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-13T06:08:52.612 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-09-13T06:08:52.762 INFO:teuthology.orchestra.run.smithi130.stdout:{"mon_tick_interval":"5"} 2023-09-13T06:08:52.763 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-09-13T06:08:52.763 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-09-13T06:08:52.763 DEBUG:teuthology.orchestra.run.smithi130:> stdin-killer -- python3 -c ' 2023-09-13T06:08:52.764 DEBUG:teuthology.orchestra.run.smithi130:> import time 2023-09-13T06:08:52.764 DEBUG:teuthology.orchestra.run.smithi130:> import datetime 2023-09-13T06:08:52.765 DEBUG:teuthology.orchestra.run.smithi130:> import subprocess 2023-09-13T06:08:52.765 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-09-13T06:08:52.765 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:08:52.765 DEBUG:teuthology.orchestra.run.smithi130:> # Write some buffered data through before going full, all should be well 2023-09-13T06:08:52.766 DEBUG:teuthology.orchestra.run.smithi130:> print("writing some data through which we expect to succeed") 2023-09-13T06:08:52.766 DEBUG:teuthology.orchestra.run.smithi130:> bytes = 0 2023-09-13T06:08:52.767 DEBUG:teuthology.orchestra.run.smithi130:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-09-13T06:08:52.767 DEBUG:teuthology.orchestra.run.smithi130:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-09-13T06:08:52.767 DEBUG:teuthology.orchestra.run.smithi130:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-09-13T06:08:52.768 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(f) 2023-09-13T06:08:52.768 DEBUG:teuthology.orchestra.run.smithi130:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-09-13T06:08:52.768 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:08:52.769 DEBUG:teuthology.orchestra.run.smithi130:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-09-13T06:08:52.769 DEBUG:teuthology.orchestra.run.smithi130:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-09-13T06:08:52.769 DEBUG:teuthology.orchestra.run.smithi130:> # buffered IO, the error should always only appear from fsync and not 2023-09-13T06:08:52.770 DEBUG:teuthology.orchestra.run.smithi130:> # from write 2023-09-13T06:08:52.770 DEBUG:teuthology.orchestra.run.smithi130:> full = False 2023-09-13T06:08:52.770 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:08:52.771 DEBUG:teuthology.orchestra.run.smithi130:> for n in range(0, int(32 * 0.9)): 2023-09-13T06:08:52.771 DEBUG:teuthology.orchestra.run.smithi130:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-13T06:08:52.771 DEBUG:teuthology.orchestra.run.smithi130:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-09-13T06:08:52.772 DEBUG:teuthology.orchestra.run.smithi130:> print("done writing {0} bytes".format(bytes)) 2023-09-13T06:08:52.772 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:08:52.772 DEBUG:teuthology.orchestra.run.smithi130:> # OK, now we should sneak in under the full condition 2023-09-13T06:08:52.773 DEBUG:teuthology.orchestra.run.smithi130:> # due to the time it takes the OSDs to report to the 2023-09-13T06:08:52.773 DEBUG:teuthology.orchestra.run.smithi130:> # mons, and get a successful fsync on our full-making data 2023-09-13T06:08:52.773 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(f) 2023-09-13T06:08:52.774 DEBUG:teuthology.orchestra.run.smithi130:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-09-13T06:08:52.774 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:08:52.774 DEBUG:teuthology.orchestra.run.smithi130:> # buffered write, add more dirty data to the buffer 2023-09-13T06:08:52.775 DEBUG:teuthology.orchestra.run.smithi130:> print("starting buffered write") 2023-09-13T06:08:52.775 DEBUG:teuthology.orchestra.run.smithi130:> try: 2023-09-13T06:08:52.775 DEBUG:teuthology.orchestra.run.smithi130:> for n in range(0, int(32 * 0.2)): 2023-09-13T06:08:52.776 DEBUG:teuthology.orchestra.run.smithi130:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-13T06:08:52.776 DEBUG:teuthology.orchestra.run.smithi130:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-09-13T06:08:52.776 DEBUG:teuthology.orchestra.run.smithi130:> time.sleep(15.0) 2023-09-13T06:08:52.777 DEBUG:teuthology.orchestra.run.smithi130:> except OSError: 2023-09-13T06:08:52.777 DEBUG:teuthology.orchestra.run.smithi130:> pass; 2023-09-13T06:08:52.777 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:08:52.778 DEBUG:teuthology.orchestra.run.smithi130:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-09-13T06:08:52.778 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:08:52.778 DEBUG:teuthology.orchestra.run.smithi130:> # Wait long enough for a background flush that should fail 2023-09-13T06:08:52.779 DEBUG:teuthology.orchestra.run.smithi130:> time.sleep(30) 2023-09-13T06:08:52.779 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:08:52.779 DEBUG:teuthology.orchestra.run.smithi130:> if False: 2023-09-13T06:08:52.780 DEBUG:teuthology.orchestra.run.smithi130:> # ...and check that the failed background flush is reflected in fclose 2023-09-13T06:08:52.780 DEBUG:teuthology.orchestra.run.smithi130:> try: 2023-09-13T06:08:52.780 DEBUG:teuthology.orchestra.run.smithi130:> os.close(f) 2023-09-13T06:08:52.781 DEBUG:teuthology.orchestra.run.smithi130:> except OSError: 2023-09-13T06:08:52.781 DEBUG:teuthology.orchestra.run.smithi130:> print("close() returned an error as expected") 2023-09-13T06:08:52.782 DEBUG:teuthology.orchestra.run.smithi130:> else: 2023-09-13T06:08:52.782 DEBUG:teuthology.orchestra.run.smithi130:> raise RuntimeError("close() failed to raise error") 2023-09-13T06:08:52.782 DEBUG:teuthology.orchestra.run.smithi130:> else: 2023-09-13T06:08:52.783 DEBUG:teuthology.orchestra.run.smithi130:> # The kernel cephfs client does not raise errors on fclose 2023-09-13T06:08:52.783 DEBUG:teuthology.orchestra.run.smithi130:> os.close(f) 2023-09-13T06:08:52.783 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:08:52.784 DEBUG:teuthology.orchestra.run.smithi130:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-09-13T06:08:52.784 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-09-13T06:09:15.724 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:09:15.729 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:09:45.798 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:09:45.803 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:10:15.858 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:10:15.863 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:10:45.922 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:10:45.927 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:10:57.023 INFO:teuthology.orchestra.run.smithi130.stdout:writing some data through which we expect to succeed 2023-09-13T06:10:57.023 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-09-13T06:10:57.024 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-09-13T06:10:57.024 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-09-13T06:10:57.024 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-09-13T06:10:57.024 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-09-13T06:10:57.024 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-09-13T06:10:57.025 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-09-13T06:10:57.025 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-09-13T06:10:57.025 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-09-13T06:10:57.025 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-09-13T06:10:57.025 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-09-13T06:10:57.025 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-09-13T06:10:57.026 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-09-13T06:10:57.026 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-09-13T06:10:57.026 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-09-13T06:10:57.026 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-09-13T06:10:57.026 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-09-13T06:10:57.027 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-09-13T06:10:57.027 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-09-13T06:10:57.027 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-09-13T06:10:57.027 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-09-13T06:10:57.027 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-09-13T06:10:57.027 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-09-13T06:10:57.028 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-09-13T06:10:57.028 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-09-13T06:10:57.028 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-09-13T06:10:57.028 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-09-13T06:10:57.028 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-09-13T06:10:57.029 INFO:teuthology.orchestra.run.smithi130.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-09-13T06:10:57.029 INFO:teuthology.orchestra.run.smithi130.stdout:done writing 29884416 bytes 2023-09-13T06:10:57.029 INFO:teuthology.orchestra.run.smithi130.stdout:successfully fsync'ed prior to getting full state reported 2023-09-13T06:10:57.029 INFO:teuthology.orchestra.run.smithi130.stdout:starting buffered write 2023-09-13T06:10:57.029 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:10:57.030 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:10:57.030 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:10:57.030 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:10:57.030 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:10:57.030 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:10:57.031 INFO:teuthology.orchestra.run.smithi130.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-09-13T06:10:57.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-13T06:10:57.037 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:10:57.037 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:10:57.098 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:10:57.163 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:10:57.164 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:10:57.164 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:10:57.174 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:10:57.174 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:10:57.224 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:10:57.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f5265cec640 1 Processor -- start 2023-09-13T06:10:57.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f5265cec640 1 -- start start 2023-09-13T06:10:57.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f5265cec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f52600d1750 0x7f526015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f5265cec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52600d1090 0x7f5260146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f5265cec640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f52600d1b30 0x7f5260146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f5265cec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526015dea0 con 0x7f52600d1750 2023-09-13T06:10:57.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f5265cec640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52600b63c0 con 0x7f52600d1b30 2023-09-13T06:10:57.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f5265cec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52600d0c20 con 0x7f52600d1090 2023-09-13T06:10:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f525f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f52600d1750 0x7f526015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f525f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f52600d1750 0x7f526015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35212/0 (socket says 172.21.15.130:35212) 2023-09-13T06:10:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f525f7fe640 1 -- 172.21.15.130:0/2653593882 learned_addr learned my addr 172.21.15.130:0/2653593882 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:10:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f525effd640 1 --2- 172.21.15.130:0/2653593882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52600d1090 0x7f5260146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f525ffff640 1 --2- 172.21.15.130:0/2653593882 >> v2:172.21.15.164:3300/0 conn(0x7f52600d1b30 0x7f5260146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f525f7fe640 1 -- 172.21.15.130:0/2653593882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52600d1090 msgr2=0x7f5260146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:10:57.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f525f7fe640 1 --2- 172.21.15.130:0/2653593882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52600d1090 0x7f5260146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f525f7fe640 1 -- 172.21.15.130:0/2653593882 >> v2:172.21.15.164:3300/0 conn(0x7f52600d1b30 msgr2=0x7f5260146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:10:57.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f525f7fe640 1 --2- 172.21.15.130:0/2653593882 >> v2:172.21.15.164:3300/0 conn(0x7f52600d1b30 0x7f5260146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.413+0000 7f525f7fe640 1 -- 172.21.15.130:0/2653593882 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600b6610 con 0x7f52600d1750 2023-09-13T06:10:57.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f525f7fe640 1 --2- 172.21.15.130:0/2653593882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52600d1750 0x7f526015d960 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f526008ba90 tx=0x7f525001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f302ceeaaebabbb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:57.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f525e7fc640 1 -- 172.21.15.130:0/2653593882 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52500aa5f0 con 0x7f52600d1750 2023-09-13T06:10:57.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f525e7fc640 1 -- 172.21.15.130:0/2653593882 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52500aa750 con 0x7f52600d1750 2023-09-13T06:10:57.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f525e7fc640 1 -- 172.21.15.130:0/2653593882 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52500aaae0 con 0x7f52600d1750 2023-09-13T06:10:57.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f5265cec640 1 -- 172.21.15.130:0/2653593882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52600d1750 msgr2=0x7f526015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f5265cec640 1 --2- 172.21.15.130:0/2653593882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52600d1750 0x7f526015d960 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f526008ba90 tx=0x7f525001c4d0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f5265cec640 1 -- 172.21.15.130:0/2653593882 shutdown_connections 2023-09-13T06:10:57.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f5265cec640 1 --2- 172.21.15.130:0/2653593882 >> v2:172.21.15.164:3300/0 conn(0x7f52600d1b30 0x7f5260146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f5265cec640 1 --2- 172.21.15.130:0/2653593882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52600d1090 0x7f5260146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f5265cec640 1 --2- 172.21.15.130:0/2653593882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52600d1750 0x7f526015d960 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f5265cec640 1 -- 172.21.15.130:0/2653593882 >> 172.21.15.130:0/2653593882 conn(0x7f526006f170 msgr2=0x7f526006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:57.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f5265cec640 1 -- 172.21.15.130:0/2653593882 shutdown_connections 2023-09-13T06:10:57.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.417+0000 7f5265cec640 1 -- 172.21.15.130:0/2653593882 wait complete. 2023-09-13T06:10:57.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5265cec640 1 Processor -- start 2023-09-13T06:10:57.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5265cec640 1 -- start start 2023-09-13T06:10:57.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5265cec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52600d1090 0x7f526012f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5265cec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52600d1750 0x7f52601653b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5265cec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52600d1b30 0x7f52600702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5265cec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5260166930 con 0x7f52600d1750 2023-09-13T06:10:57.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5265cec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5260165cb0 con 0x7f52600d1090 2023-09-13T06:10:57.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5265cec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5260165f90 con 0x7f52600d1b30 2023-09-13T06:10:57.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f525effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52600d1750 0x7f52601653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f525effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52600d1750 0x7f52601653b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35220/0 (socket says 172.21.15.130:35220) 2023-09-13T06:10:57.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f525effd640 1 -- 172.21.15.130:0/1443470517 learned_addr learned my addr 172.21.15.130:0/1443470517 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:10:57.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f525f7fe640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52600d1090 0x7f526012f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f525ffff640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52600d1b30 0x7f52600702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f525effd640 1 -- 172.21.15.130:0/1443470517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52600d1b30 msgr2=0x7f52600702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f525effd640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52600d1b30 0x7f52600702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f525effd640 1 -- 172.21.15.130:0/1443470517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52600d1090 msgr2=0x7f526012f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f525effd640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52600d1090 0x7f526012f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f525effd640 1 -- 172.21.15.130:0/1443470517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52500094d0 con 0x7f52600d1750 2023-09-13T06:10:57.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f525effd640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52600d1750 0x7f52601653b0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f525400d800 tx=0x7f525400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:57.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5247fff640 1 -- 172.21.15.130:0/1443470517 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52540096c0 con 0x7f52600d1750 2023-09-13T06:10:57.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5247fff640 1 -- 172.21.15.130:0/1443470517 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5254009820 con 0x7f52600d1750 2023-09-13T06:10:57.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5265cec640 1 -- 172.21.15.130:0/1443470517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5260166270 con 0x7f52600d1750 2023-09-13T06:10:57.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5247fff640 1 -- 172.21.15.130:0/1443470517 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254009bd0 con 0x7f52600d1750 2023-09-13T06:10:57.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5265cec640 1 -- 172.21.15.130:0/1443470517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52601658f0 con 0x7f52600d1750 2023-09-13T06:10:57.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.421+0000 7f5265cec640 1 -- 172.21.15.130:0/1443470517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5260166a70 con 0x7f52600d1750 2023-09-13T06:10:57.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.425+0000 7f5247fff640 1 -- 172.21.15.130:0/1443470517 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5254009d30 con 0x7f52600d1750 2023-09-13T06:10:57.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.425+0000 7f5247fff640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f524c065b20 0x7f524c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.425+0000 7f5247fff640 1 -- 172.21.15.130:0/1443470517 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5254083980 con 0x7f52600d1750 2023-09-13T06:10:57.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.425+0000 7f525f7fe640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f524c065b20 0x7f524c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.425+0000 7f5247fff640 1 -- 172.21.15.130:0/1443470517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f524c06d710 con 0x7f52600d1750 2023-09-13T06:10:57.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.425+0000 7f525f7fe640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f524c065b20 0x7f524c067fe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f52500ae000 tx=0x7f52500b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:57.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.429+0000 7f5247fff640 1 -- 172.21.15.130:0/1443470517 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5260166a70 con 0x7f52600d1750 2023-09-13T06:10:57.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.585+0000 7f5265cec640 1 -- 172.21.15.130:0/1443470517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5260166a70 con 0x7f52600d1750 2023-09-13T06:10:57.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.585+0000 7f5247fff640 1 -- 172.21.15.130:0/1443470517 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16684 (secure 0 0 0) 0x7f5260166a70 con 0x7f52600d1750 2023-09-13T06:10:57.587 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:10:57.588 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":159,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:10:17.438747+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:08:40.183838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-09-13T06:08:41.020446+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.12","mappings":[{"from":2,"to":0}]},{"pgid":"19.23","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:10:57.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 -- 172.21.15.130:0/1443470517 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f524c065b20 msgr2=0x7f524c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f524c065b20 0x7f524c067fe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f52500ae000 tx=0x7f52500b5040 comp rx=0 tx=0).stop 2023-09-13T06:10:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 -- 172.21.15.130:0/1443470517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52600d1750 msgr2=0x7f52601653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52600d1750 0x7f52601653b0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f525400d800 tx=0x7f525400dcc0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 -- 172.21.15.130:0/1443470517 shutdown_connections 2023-09-13T06:10:57.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f524c065b20 0x7f524c067fe0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f52600d1b30 0x7f52600702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52600d1750 0x7f52601653b0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 --2- 172.21.15.130:0/1443470517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52600d1090 0x7f526012f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 -- 172.21.15.130:0/1443470517 >> 172.21.15.130:0/1443470517 conn(0x7f526006f170 msgr2=0x7f5260142730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:57.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 -- 172.21.15.130:0/1443470517 shutdown_connections 2023-09-13T06:10:57.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.589+0000 7f5265cec640 1 -- 172.21.15.130:0/1443470517 wait complete. 2023-09-13T06:10:57.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:08:40.183838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:08:41.020446+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:10:57.609 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:10:57.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.753+0000 7f9139b37640 1 Processor -- start 2023-09-13T06:10:57.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.753+0000 7f9139b37640 1 -- start start 2023-09-13T06:10:57.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f9139b37640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9134144d70 0x7f91340ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f9139b37640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91340b2150 con 0x7f91340b1b70 2023-09-13T06:10:57.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f9139b37640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91340cdd90 con 0x7f91340b2780 2023-09-13T06:10:57.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f9139b37640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91340b2430 con 0x7f9134144d70 2023-09-13T06:10:57.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f9133fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f91340b1b70 0x7f913406ca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51174/0 (socket says 172.21.15.130:51174) 2023-09-13T06:10:57.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f9133fff640 1 -- 172.21.15.130:0/2040838379 learned_addr learned my addr 172.21.15.130:0/2040838379 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:10:57.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f91337fe640 1 --2- 172.21.15.130:0/2040838379 >> v2:172.21.15.164:3300/0 conn(0x7f9134144d70 0x7f91340ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f91327fc640 1 -- 172.21.15.130:0/2040838379 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753103793 0 0) 0x7f91340b2150 con 0x7f91340b1b70 2023-09-13T06:10:57.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f91327fc640 1 -- 172.21.15.130:0/2040838379 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f911c003530 con 0x7f91340b1b70 2023-09-13T06:10:57.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f91327fc640 1 -- 172.21.15.130:0/2040838379 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880414797 0 0) 0x7f91340cdd90 con 0x7f91340b2780 2023-09-13T06:10:57.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f91327fc640 1 -- 172.21.15.130:0/2040838379 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91340b2150 con 0x7f91340b2780 2023-09-13T06:10:57.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f91337fe640 1 -- 172.21.15.130:0/2040838379 >> v1:172.21.15.164:6789/0 conn(0x7f91340b2780 legacy=0x7f91340b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f91337fe640 1 -- 172.21.15.130:0/2040838379 >> v1:172.21.15.130:6789/0 conn(0x7f91340b1b70 legacy=0x7f913406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.757+0000 7f91337fe640 1 -- 172.21.15.130:0/2040838379 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91340ce070 con 0x7f9134144d70 2023-09-13T06:10:57.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f91337fe640 1 --2- 172.21.15.130:0/2040838379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9134144d70 0x7f91340ce870 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f91240097c0 tx=0x7f912401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2a9486ca50128e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:57.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f91327fc640 1 -- 172.21.15.130:0/2040838379 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91240ab600 con 0x7f9134144d70 2023-09-13T06:10:57.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f91327fc640 1 -- 172.21.15.130:0/2040838379 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91240a7050 con 0x7f9134144d70 2023-09-13T06:10:57.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f91327fc640 1 -- 172.21.15.130:0/2040838379 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91240ab980 con 0x7f9134144d70 2023-09-13T06:10:57.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f9139b37640 1 -- 172.21.15.130:0/2040838379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9134144d70 msgr2=0x7f91340ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f9139b37640 1 --2- 172.21.15.130:0/2040838379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9134144d70 0x7f91340ce870 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f91240097c0 tx=0x7f912401c480 comp rx=0 tx=0).stop 2023-09-13T06:10:57.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f9139b37640 1 -- 172.21.15.130:0/2040838379 shutdown_connections 2023-09-13T06:10:57.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f9139b37640 1 --2- 172.21.15.130:0/2040838379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9134144d70 0x7f91340ce870 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f9139b37640 1 -- 172.21.15.130:0/2040838379 >> 172.21.15.130:0/2040838379 conn(0x7f9134065990 msgr2=0x7f9134065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:57.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f9139b37640 1 -- 172.21.15.130:0/2040838379 shutdown_connections 2023-09-13T06:10:57.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f9139b37640 1 -- 172.21.15.130:0/2040838379 wait complete. 2023-09-13T06:10:57.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f9139b37640 1 Processor -- start 2023-09-13T06:10:57.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.761+0000 7f9139b37640 1 -- start start 2023-09-13T06:10:57.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f9139b37640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91340b1b70 0x7f91341434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f9139b37640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91340b2780 0x7f913414ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f9139b37640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9134144d70 0x7f913413b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f9139b37640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913413c360 con 0x7f91340b1b70 2023-09-13T06:10:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f9139b37640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913414f250 con 0x7f91340b2780 2023-09-13T06:10:57.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f9139b37640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913414dd00 con 0x7f9134144d70 2023-09-13T06:10:57.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f91337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91340b1b70 0x7f91341434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f91337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91340b1b70 0x7f91341434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35226/0 (socket says 172.21.15.130:35226) 2023-09-13T06:10:57.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f91337fe640 1 -- 172.21.15.130:0/3389168371 learned_addr learned my addr 172.21.15.130:0/3389168371 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:10:57.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f9132ffd640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91340b2780 0x7f913414ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f9133fff640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9134144d70 0x7f913413b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f91337fe640 1 -- 172.21.15.130:0/3389168371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9134144d70 msgr2=0x7f913413b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f91337fe640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9134144d70 0x7f913413b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f91337fe640 1 -- 172.21.15.130:0/3389168371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91340b2780 msgr2=0x7f913414ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f91337fe640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91340b2780 0x7f913414ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f91337fe640 1 -- 172.21.15.130:0/3389168371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124009420 con 0x7f91340b1b70 2023-09-13T06:10:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f91337fe640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91340b1b70 0x7f91341434a0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f91240ae040 tx=0x7f912401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f911bfff640 1 -- 172.21.15.130:0/3389168371 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91240b7450 con 0x7f91340b1b70 2023-09-13T06:10:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f911bfff640 1 -- 172.21.15.130:0/3389168371 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91240b75d0 con 0x7f91340b1b70 2023-09-13T06:10:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f9139b37640 1 -- 172.21.15.130:0/3389168371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913413b920 con 0x7f91340b1b70 2023-09-13T06:10:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f911bfff640 1 -- 172.21.15.130:0/3389168371 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91240b7980 con 0x7f91340b1b70 2023-09-13T06:10:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f9139b37640 1 -- 172.21.15.130:0/3389168371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913414e230 con 0x7f91340b1b70 2023-09-13T06:10:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f9139b37640 1 -- 172.21.15.130:0/3389168371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91340618a0 con 0x7f91340b1b70 2023-09-13T06:10:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.765+0000 7f911bfff640 1 -- 172.21.15.130:0/3389168371 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f91240b7ae0 con 0x7f91340b1b70 2023-09-13T06:10:57.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.769+0000 7f911bfff640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9120065b20 0x7f9120067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:57.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.769+0000 7f911bfff640 1 -- 172.21.15.130:0/3389168371 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f912411da30 con 0x7f91340b1b70 2023-09-13T06:10:57.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.769+0000 7f9132ffd640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9120065b20 0x7f9120067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:57.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.769+0000 7f911bfff640 1 -- 172.21.15.130:0/3389168371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f912006d710 con 0x7f91340b1b70 2023-09-13T06:10:57.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.769+0000 7f9132ffd640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9120065b20 0x7f9120067fe0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9134142ec0 tx=0x7f9128009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:57.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.773+0000 7f911bfff640 1 -- 172.21.15.130:0/3389168371 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f91240b0060 con 0x7f91340b1b70 2023-09-13T06:10:57.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 -- 172.21.15.130:0/3389168371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9134155e00 con 0x7f91340b1b70 2023-09-13T06:10:57.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f911bfff640 1 -- 172.21.15.130:0/3389168371 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91240b0070 con 0x7f91340b1b70 2023-09-13T06:10:57.921 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:10:57.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 -- 172.21.15.130:0/3389168371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9120065b20 msgr2=0x7f9120067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9120065b20 0x7f9120067fe0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9134142ec0 tx=0x7f9128009040 comp rx=0 tx=0).stop 2023-09-13T06:10:57.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 -- 172.21.15.130:0/3389168371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91340b1b70 msgr2=0x7f91341434a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:57.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91340b1b70 0x7f91341434a0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f91240ae040 tx=0x7f912401acc0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 -- 172.21.15.130:0/3389168371 shutdown_connections 2023-09-13T06:10:57.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9120065b20 0x7f9120067fe0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91340b2780 0x7f913414ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9134144d70 0x7f913413b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 --2- 172.21.15.130:0/3389168371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91340b1b70 0x7f91341434a0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:57.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 -- 172.21.15.130:0/3389168371 >> 172.21.15.130:0/3389168371 conn(0x7f9134065990 msgr2=0x7f9134156240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:57.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 -- 172.21.15.130:0/3389168371 shutdown_connections 2023-09-13T06:10:57.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:57.921+0000 7f9139b37640 1 -- 172.21.15.130:0/3389168371 wait complete. 2023-09-13T06:10:57.942 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:10:58.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f52233ad640 1 Processor -- start 2023-09-13T06:10:58.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f52233ad640 1 -- start start 2023-09-13T06:10:58.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f52233ad640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521c1617f0 0x7f521c0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f52233ad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f521c0ce890 0x7f521c161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f52233ad640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c0b2620 con 0x7f521c0cc880 2023-09-13T06:10:58.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f52233ad640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521c0b1a80 con 0x7f521c0ce890 2023-09-13T06:10:58.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f52233ad640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c0ccce0 con 0x7f521c1617f0 2023-09-13T06:10:58.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f522194a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f521c0ce890 0x7f521c161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f522194a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f521c0ce890 0x7f521c161bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35240/0 (socket says 172.21.15.130:35240) 2023-09-13T06:10:58.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f522194a640 1 -- 172.21.15.130:0/2751403699 learned_addr learned my addr 172.21.15.130:0/2751403699 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:10:58.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f5221149640 1 --2- 172.21.15.130:0/2751403699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521c1617f0 0x7f521c0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f522194a640 1 -- 172.21.15.130:0/2751403699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521c1617f0 msgr2=0x7f521c0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:10:58.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f522194a640 1 --2- 172.21.15.130:0/2751403699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521c1617f0 0x7f521c0cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f522194a640 1 -- 172.21.15.130:0/2751403699 >> v1:172.21.15.164:6789/0 conn(0x7f521c0cc880 legacy=0x7f521c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.085+0000 7f522194a640 1 -- 172.21.15.130:0/2751403699 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c0b2ab0 con 0x7f521c0ce890 2023-09-13T06:10:58.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f522194a640 1 --2- 172.21.15.130:0/2751403699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f521c0ce890 0x7f521c161bd0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f5214009e50 tx=0x7f521401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99452864b1abc4f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:58.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f5213fff640 1 -- 172.21.15.130:0/2751403699 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52140a5820 con 0x7f521c0ce890 2023-09-13T06:10:58.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f5213fff640 1 -- 172.21.15.130:0/2751403699 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52140a5980 con 0x7f521c0ce890 2023-09-13T06:10:58.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f5213fff640 1 -- 172.21.15.130:0/2751403699 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52140a5d10 con 0x7f521c0ce890 2023-09-13T06:10:58.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f52233ad640 1 -- 172.21.15.130:0/2751403699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f521c0ce890 msgr2=0x7f521c161bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f52233ad640 1 --2- 172.21.15.130:0/2751403699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f521c0ce890 0x7f521c161bd0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f5214009e50 tx=0x7f521401c9e0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f52233ad640 1 -- 172.21.15.130:0/2751403699 shutdown_connections 2023-09-13T06:10:58.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f52233ad640 1 --2- 172.21.15.130:0/2751403699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f521c0ce890 0x7f521c161bd0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f52233ad640 1 --2- 172.21.15.130:0/2751403699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521c1617f0 0x7f521c0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f52233ad640 1 -- 172.21.15.130:0/2751403699 >> 172.21.15.130:0/2751403699 conn(0x7f521c065990 msgr2=0x7f521c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:58.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f52233ad640 1 -- 172.21.15.130:0/2751403699 shutdown_connections 2023-09-13T06:10:58.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f52233ad640 1 -- 172.21.15.130:0/2751403699 wait complete. 2023-09-13T06:10:58.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.089+0000 7f52233ad640 1 Processor -- start 2023-09-13T06:10:58.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f52233ad640 1 -- start start 2023-09-13T06:10:58.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f52233ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f521c0cc880 0x7f521c14c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f52233ad640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521c0ce890 0x7f521c15e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f52233ad640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f521c1617f0 0x7f521c156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f52233ad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c14d200 con 0x7f521c0cc880 2023-09-13T06:10:58.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f52233ad640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c14d7c0 con 0x7f521c1617f0 2023-09-13T06:10:58.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f52233ad640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c15d680 con 0x7f521c0ce890 2023-09-13T06:10:58.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5221149640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f521c0cc880 0x7f521c14c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5221149640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f521c0cc880 0x7f521c14c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35244/0 (socket says 172.21.15.130:35244) 2023-09-13T06:10:58.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5221149640 1 -- 172.21.15.130:0/391408898 learned_addr learned my addr 172.21.15.130:0/391408898 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:10:58.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5220948640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521c0ce890 0x7f521c15e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f522194a640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f521c1617f0 0x7f521c156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5221149640 1 -- 172.21.15.130:0/391408898 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521c0ce890 msgr2=0x7f521c15e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5221149640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521c0ce890 0x7f521c15e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5221149640 1 -- 172.21.15.130:0/391408898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f521c1617f0 msgr2=0x7f521c156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5221149640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f521c1617f0 0x7f521c156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5221149640 1 -- 172.21.15.130:0/391408898 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5214009b30 con 0x7f521c0cc880 2023-09-13T06:10:58.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5221149640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f521c0cc880 0x7f521c14c170 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f521800d5f0 tx=0x7f521800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:58.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5211ffb640 1 -- 172.21.15.130:0/391408898 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52180125f0 con 0x7f521c0cc880 2023-09-13T06:10:58.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5211ffb640 1 -- 172.21.15.130:0/391408898 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5218012750 con 0x7f521c0cc880 2023-09-13T06:10:58.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f52233ad640 1 -- 172.21.15.130:0/391408898 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c15d960 con 0x7f521c0cc880 2023-09-13T06:10:58.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f5211ffb640 1 -- 172.21.15.130:0/391408898 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218012ae0 con 0x7f521c0cc880 2023-09-13T06:10:58.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f52233ad640 1 -- 172.21.15.130:0/391408898 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521c14d450 con 0x7f521c0cc880 2023-09-13T06:10:58.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.093+0000 7f52233ad640 1 -- 172.21.15.130:0/391408898 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521c0618a0 con 0x7f521c0cc880 2023-09-13T06:10:58.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.097+0000 7f5211ffb640 1 -- 172.21.15.130:0/391408898 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5218012c40 con 0x7f521c0cc880 2023-09-13T06:10:58.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.097+0000 7f5211ffb640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5200065b20 0x7f5200067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.097+0000 7f5211ffb640 1 -- 172.21.15.130:0/391408898 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5218083770 con 0x7f521c0cc880 2023-09-13T06:10:58.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.097+0000 7f5220948640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5200065b20 0x7f5200067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.097+0000 7f5211ffb640 1 -- 172.21.15.130:0/391408898 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f520006d710 con 0x7f521c0cc880 2023-09-13T06:10:58.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.097+0000 7f5220948640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5200065b20 0x7f5200067fe0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f521c151d40 tx=0x7f520c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:58.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.101+0000 7f5211ffb640 1 -- 172.21.15.130:0/391408898 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5218051010 con 0x7f521c0cc880 2023-09-13T06:10:58.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.245+0000 7f52233ad640 1 -- 172.21.15.130:0/391408898 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f521c15bb40 con 0x7f521c0cc880 2023-09-13T06:10:58.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.245+0000 7f5211ffb640 1 -- 172.21.15.130:0/391408898 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5218007380 con 0x7f521c0cc880 2023-09-13T06:10:58.247 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:10:58.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 -- 172.21.15.130:0/391408898 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5200065b20 msgr2=0x7f5200067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5200065b20 0x7f5200067fe0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f521c151d40 tx=0x7f520c009040 comp rx=0 tx=0).stop 2023-09-13T06:10:58.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 -- 172.21.15.130:0/391408898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f521c0cc880 msgr2=0x7f521c14c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f521c0cc880 0x7f521c14c170 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f521800d5f0 tx=0x7f521800dab0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 -- 172.21.15.130:0/391408898 shutdown_connections 2023-09-13T06:10:58.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5200065b20 0x7f5200067fe0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f521c1617f0 0x7f521c156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f521c0ce890 0x7f521c15e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 --2- 172.21.15.130:0/391408898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f521c0cc880 0x7f521c14c170 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 -- 172.21.15.130:0/391408898 >> 172.21.15.130:0/391408898 conn(0x7f521c065990 msgr2=0x7f521c15f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:58.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 -- 172.21.15.130:0/391408898 shutdown_connections 2023-09-13T06:10:58.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.249+0000 7f52233ad640 1 -- 172.21.15.130:0/391408898 wait complete. 2023-09-13T06:10:58.268 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:10:58.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a81db640 1 Processor -- start 2023-09-13T06:10:58.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a81db640 1 -- start start 2023-09-13T06:10:58.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a81db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a00d2cd0 0x7f90a01612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a81db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f90a01617e0 0x7f90a00cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a81db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a015dd40 con 0x7f90a015ae10 2023-09-13T06:10:58.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a81db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a015e020 con 0x7f90a01617e0 2023-09-13T06:10:58.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a81db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a015e300 con 0x7f90a00d2cd0 2023-09-13T06:10:58.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a5776640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a00d2cd0 0x7f90a01612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a6778640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f90a01617e0 0x7f90a00cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a5f77640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f90a015ae10 0x7f90a00d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51176/0 (socket says 172.21.15.130:51176) 2023-09-13T06:10:58.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a5f77640 1 -- 172.21.15.130:0/1946814733 learned_addr learned my addr 172.21.15.130:0/1946814733 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:10:58.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a4f75640 1 -- 172.21.15.130:0/1946814733 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840999102 0 0) 0x7f90a015dd40 con 0x7f90a015ae10 2023-09-13T06:10:58.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a5776640 1 -- 172.21.15.130:0/1946814733 >> v2:172.21.15.130:3300/0 conn(0x7f90a01617e0 msgr2=0x7f90a00cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:10:58.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a5776640 1 --2- 172.21.15.130:0/1946814733 >> v2:172.21.15.130:3300/0 conn(0x7f90a01617e0 0x7f90a00cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a5776640 1 -- 172.21.15.130:0/1946814733 >> v1:172.21.15.130:6789/0 conn(0x7f90a015ae10 legacy=0x7f90a00d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a5776640 1 -- 172.21.15.130:0/1946814733 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a015e5e0 con 0x7f90a00d2cd0 2023-09-13T06:10:58.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.413+0000 7f90a6778640 1 --2- 172.21.15.130:0/1946814733 >> v2:172.21.15.130:3300/0 conn(0x7f90a01617e0 0x7f90a00cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:10:58.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a5776640 1 --2- 172.21.15.130:0/1946814733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a00d2cd0 0x7f90a01612a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f90940097c0 tx=0x7f909401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba90f7481c77333 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:58.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a4f75640 1 -- 172.21.15.130:0/1946814733 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90940ab610 con 0x7f90a00d2cd0 2023-09-13T06:10:58.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a4f75640 1 -- 172.21.15.130:0/1946814733 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90940ab770 con 0x7f90a00d2cd0 2023-09-13T06:10:58.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a4f75640 1 -- 172.21.15.130:0/1946814733 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90940abb00 con 0x7f90a00d2cd0 2023-09-13T06:10:58.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a81db640 1 -- 172.21.15.130:0/1946814733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a00d2cd0 msgr2=0x7f90a01612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a81db640 1 --2- 172.21.15.130:0/1946814733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a00d2cd0 0x7f90a01612a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f90940097c0 tx=0x7f909401c3f0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a81db640 1 -- 172.21.15.130:0/1946814733 shutdown_connections 2023-09-13T06:10:58.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a81db640 1 --2- 172.21.15.130:0/1946814733 >> v2:172.21.15.130:3300/0 conn(0x7f90a01617e0 0x7f90a00cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a81db640 1 --2- 172.21.15.130:0/1946814733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a00d2cd0 0x7f90a01612a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a81db640 1 -- 172.21.15.130:0/1946814733 >> 172.21.15.130:0/1946814733 conn(0x7f90a0065990 msgr2=0x7f90a0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:58.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a81db640 1 -- 172.21.15.130:0/1946814733 shutdown_connections 2023-09-13T06:10:58.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.417+0000 7f90a81db640 1 -- 172.21.15.130:0/1946814733 wait complete. 2023-09-13T06:10:58.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a81db640 1 Processor -- start 2023-09-13T06:10:58.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a81db640 1 -- start start 2023-09-13T06:10:58.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a81db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a00d2cd0 0x7f90a0162f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a81db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90a015ae10 0x7f90a01f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a81db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a01617e0 0x7f90a0153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a81db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01f8d00 con 0x7f90a00d2cd0 2023-09-13T06:10:58.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a81db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01f5c70 con 0x7f90a015ae10 2023-09-13T06:10:58.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a81db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01f5eb0 con 0x7f90a01617e0 2023-09-13T06:10:58.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a5f77640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a00d2cd0 0x7f90a0162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a5f77640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a00d2cd0 0x7f90a0162f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35272/0 (socket says 172.21.15.130:35272) 2023-09-13T06:10:58.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a5f77640 1 -- 172.21.15.130:0/3125486626 learned_addr learned my addr 172.21.15.130:0/3125486626 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:10:58.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a6778640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a01617e0 0x7f90a0153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a5776640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90a015ae10 0x7f90a01f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a5f77640 1 -- 172.21.15.130:0/3125486626 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a01617e0 msgr2=0x7f90a0153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a5f77640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a01617e0 0x7f90a0153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a5f77640 1 -- 172.21.15.130:0/3125486626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90a015ae10 msgr2=0x7f90a01f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a5f77640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90a015ae10 0x7f90a01f5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a5f77640 1 -- 172.21.15.130:0/3125486626 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098009a70 con 0x7f90a00d2cd0 2023-09-13T06:10:58.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a6778640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a01617e0 0x7f90a0153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:10:58.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a5f77640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a00d2cd0 0x7f90a0162f00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f909c0011f0 tx=0x7f909c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:58.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90927fc640 1 -- 172.21.15.130:0/3125486626 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c0074e0 con 0x7f90a00d2cd0 2023-09-13T06:10:58.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90927fc640 1 -- 172.21.15.130:0/3125486626 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c007640 con 0x7f90a00d2cd0 2023-09-13T06:10:58.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90927fc640 1 -- 172.21.15.130:0/3125486626 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c004a10 con 0x7f90a00d2cd0 2023-09-13T06:10:58.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a81db640 1 -- 172.21.15.130:0/3125486626 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9094009420 con 0x7f90a00d2cd0 2023-09-13T06:10:58.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.421+0000 7f90a81db640 1 -- 172.21.15.130:0/3125486626 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a01f6470 con 0x7f90a00d2cd0 2023-09-13T06:10:58.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.425+0000 7f90a81db640 1 -- 172.21.15.130:0/3125486626 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a00618a0 con 0x7f90a00d2cd0 2023-09-13T06:10:58.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.425+0000 7f90927fc640 1 -- 172.21.15.130:0/3125486626 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f909c004b70 con 0x7f90a00d2cd0 2023-09-13T06:10:58.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.425+0000 7f90927fc640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9084065b20 0x7f9084067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.425+0000 7f90927fc640 1 -- 172.21.15.130:0/3125486626 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f909c0826b0 con 0x7f90a00d2cd0 2023-09-13T06:10:58.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.425+0000 7f90a5776640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9084065b20 0x7f9084067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.425+0000 7f90927fc640 1 -- 172.21.15.130:0/3125486626 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f908406d710 con 0x7f90a00d2cd0 2023-09-13T06:10:58.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.425+0000 7f90a5776640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9084065b20 0x7f9084067fe0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f90940af000 tx=0x7f90940a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:58.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.429+0000 7f90927fc640 1 -- 172.21.15.130:0/3125486626 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f909c018020 con 0x7f90a00d2cd0 2023-09-13T06:10:58.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.577+0000 7f90a81db640 1 -- 172.21.15.130:0/3125486626 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90a01622d0 con 0x7f90a00d2cd0 2023-09-13T06:10:58.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.577+0000 7f90927fc640 1 -- 172.21.15.130:0/3125486626 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v159) v1 ==== 100+0+11 (secure 0 0 0) 0x7f909c04ff20 con 0x7f90a00d2cd0 2023-09-13T06:10:58.582 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:10:58.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 -- 172.21.15.130:0/3125486626 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9084065b20 msgr2=0x7f9084067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9084065b20 0x7f9084067fe0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f90940af000 tx=0x7f90940a7000 comp rx=0 tx=0).stop 2023-09-13T06:10:58.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 -- 172.21.15.130:0/3125486626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a00d2cd0 msgr2=0x7f90a0162f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a00d2cd0 0x7f90a0162f00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f909c0011f0 tx=0x7f909c00c9b0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 -- 172.21.15.130:0/3125486626 shutdown_connections 2023-09-13T06:10:58.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9084065b20 0x7f9084067fe0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90a015ae10 0x7f90a01f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90a01617e0 0x7f90a0153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 --2- 172.21.15.130:0/3125486626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90a00d2cd0 0x7f90a0162f00 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 -- 172.21.15.130:0/3125486626 >> 172.21.15.130:0/3125486626 conn(0x7f90a0065990 msgr2=0x7f90a00d25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:58.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 -- 172.21.15.130:0/3125486626 shutdown_connections 2023-09-13T06:10:58.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.581+0000 7f90a81db640 1 -- 172.21.15.130:0/3125486626 wait complete. 2023-09-13T06:10:58.600 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:10:58.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.737+0000 7f1c1a493640 1 Processor -- start 2023-09-13T06:10:58.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c1a493640 1 -- start start 2023-09-13T06:10:58.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c1a493640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c140b04a0 0x7f1c140b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c1a493640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c140ccbe0 con 0x7f1c1415b130 2023-09-13T06:10:58.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c1a493640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c140ce980 con 0x7f1c140cc780 2023-09-13T06:10:58.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c1a493640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140b0e70 con 0x7f1c140b04a0 2023-09-13T06:10:58.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c13fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1c1415b130 0x7f1c140ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51178/0 (socket says 172.21.15.130:51178) 2023-09-13T06:10:58.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c13fff640 1 -- 172.21.15.130:0/3112982382 learned_addr learned my addr 172.21.15.130:0/3112982382 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:10:58.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c18a30640 1 --2- 172.21.15.130:0/3112982382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c140b04a0 0x7f1c140b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c12ffd640 1 -- 172.21.15.130:0/3112982382 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837157455 0 0) 0x7f1c140ccbe0 con 0x7f1c1415b130 2023-09-13T06:10:58.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c12ffd640 1 -- 172.21.15.130:0/3112982382 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bfc003530 con 0x7f1c1415b130 2023-09-13T06:10:58.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c12ffd640 1 -- 172.21.15.130:0/3112982382 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461614408 0 0) 0x7f1c140ce980 con 0x7f1c140cc780 2023-09-13T06:10:58.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c12ffd640 1 -- 172.21.15.130:0/3112982382 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c140ccbe0 con 0x7f1c140cc780 2023-09-13T06:10:58.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c12ffd640 1 -- 172.21.15.130:0/3112982382 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3541389737 0 0) 0x7f1bfc003530 con 0x7f1c1415b130 2023-09-13T06:10:58.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c18a30640 1 -- 172.21.15.130:0/3112982382 >> v1:172.21.15.164:6789/0 conn(0x7f1c140cc780 legacy=0x7f1c1415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c18a30640 1 -- 172.21.15.130:0/3112982382 >> v1:172.21.15.130:6789/0 conn(0x7f1c1415b130 legacy=0x7f1c140ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.741+0000 7f1c18a30640 1 -- 172.21.15.130:0/3112982382 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140cec60 con 0x7f1c140b04a0 2023-09-13T06:10:58.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c18a30640 1 --2- 172.21.15.130:0/3112982382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c140b04a0 0x7f1c140b0930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009dc0 tx=0x7f1c0c01c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce819f0605db6e0c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:58.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c12ffd640 1 -- 172.21.15.130:0/3112982382 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04001680 con 0x7f1c140b04a0 2023-09-13T06:10:58.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c12ffd640 1 -- 172.21.15.130:0/3112982382 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c0a56a0 con 0x7f1c140b04a0 2023-09-13T06:10:58.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c12ffd640 1 -- 172.21.15.130:0/3112982382 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c0a5a30 con 0x7f1c140b04a0 2023-09-13T06:10:58.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c1a493640 1 -- 172.21.15.130:0/3112982382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c140b04a0 msgr2=0x7f1c140b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c1a493640 1 --2- 172.21.15.130:0/3112982382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c140b04a0 0x7f1c140b0930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009dc0 tx=0x7f1c0c01c860 comp rx=0 tx=0).stop 2023-09-13T06:10:58.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c1a493640 1 -- 172.21.15.130:0/3112982382 shutdown_connections 2023-09-13T06:10:58.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c1a493640 1 --2- 172.21.15.130:0/3112982382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c140b04a0 0x7f1c140b0930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c1a493640 1 -- 172.21.15.130:0/3112982382 >> 172.21.15.130:0/3112982382 conn(0x7f1c14065990 msgr2=0x7f1c14065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:58.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c1a493640 1 -- 172.21.15.130:0/3112982382 shutdown_connections 2023-09-13T06:10:58.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c1a493640 1 -- 172.21.15.130:0/3112982382 wait complete. 2023-09-13T06:10:58.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.745+0000 7f1c1a493640 1 Processor -- start 2023-09-13T06:10:58.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c1a493640 1 -- start start 2023-09-13T06:10:58.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c1a493640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c140b04a0 0x7f1c141fc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c1a493640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c140cc780 0x7f1c1414bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c1a493640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c1415b130 0x7f1c1414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c1a493640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140ae4c0 con 0x7f1c140b04a0 2023-09-13T06:10:58.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c1a493640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140b02f0 con 0x7f1c140cc780 2023-09-13T06:10:58.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c1a493640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140afa50 con 0x7f1c1415b130 2023-09-13T06:10:58.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c13fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c140b04a0 0x7f1c141fc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c13fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c140b04a0 0x7f1c141fc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35282/0 (socket says 172.21.15.130:35282) 2023-09-13T06:10:58.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c13fff640 1 -- 172.21.15.130:0/1013088386 learned_addr learned my addr 172.21.15.130:0/1013088386 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:10:58.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c18a30640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c1415b130 0x7f1c1414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c137fe640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c140cc780 0x7f1c1414bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c13fff640 1 -- 172.21.15.130:0/1013088386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c1415b130 msgr2=0x7f1c1414a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c13fff640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c1415b130 0x7f1c1414a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c13fff640 1 -- 172.21.15.130:0/1013088386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c140cc780 msgr2=0x7f1c1414bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c13fff640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c140cc780 0x7f1c1414bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c13fff640 1 -- 172.21.15.130:0/1013088386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c009a70 con 0x7f1c140b04a0 2023-09-13T06:10:58.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c18a30640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c1415b130 0x7f1c1414a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:10:58.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c13fff640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c140b04a0 0x7f1c141fc340 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400c780 tx=0x7f1c0400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:58.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c10ff9640 1 -- 172.21.15.130:0/1013088386 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04005ae0 con 0x7f1c140b04a0 2023-09-13T06:10:58.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c10ff9640 1 -- 172.21.15.130:0/1013088386 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c04005c40 con 0x7f1c140b04a0 2023-09-13T06:10:58.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c10ff9640 1 -- 172.21.15.130:0/1013088386 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04007070 con 0x7f1c140b04a0 2023-09-13T06:10:58.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c1a493640 1 -- 172.21.15.130:0/1013088386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c140afd30 con 0x7f1c140b04a0 2023-09-13T06:10:58.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c1a493640 1 -- 172.21.15.130:0/1013088386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c141fc880 con 0x7f1c140b04a0 2023-09-13T06:10:58.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.749+0000 7f1c1a493640 1 -- 172.21.15.130:0/1013088386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c140618a0 con 0x7f1c140b04a0 2023-09-13T06:10:58.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.753+0000 7f1c10ff9640 1 -- 172.21.15.130:0/1013088386 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1c040071f0 con 0x7f1c140b04a0 2023-09-13T06:10:58.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.753+0000 7f1c10ff9640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1c00065b20 0x7f1c00067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:58.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.753+0000 7f1c10ff9640 1 -- 172.21.15.130:0/1013088386 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1c040829f0 con 0x7f1c140b04a0 2023-09-13T06:10:58.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.753+0000 7f1c137fe640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1c00065b20 0x7f1c00067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:58.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.753+0000 7f1c10ff9640 1 -- 172.21.15.130:0/1013088386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f1c0006d710 con 0x7f1c140b04a0 2023-09-13T06:10:58.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.753+0000 7f1c137fe640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1c00065b20 0x7f1c00067fe0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1c14158bc0 tx=0x7f1c08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:58.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.757+0000 7f1c10ff9640 1 -- 172.21.15.130:0/1013088386 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1c04017060 con 0x7f1c140b04a0 2023-09-13T06:10:58.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.913+0000 7f1c1a493640 1 -- 172.21.15.130:0/1013088386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1c140cb270 con 0x7f1c140b04a0 2023-09-13T06:10:58.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.913+0000 7f1c10ff9640 1 -- 172.21.15.130:0/1013088386 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v159) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1c04053e30 con 0x7f1c140b04a0 2023-09-13T06:10:58.915 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:10:58.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 -- 172.21.15.130:0/1013088386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1c00065b20 msgr2=0x7f1c00067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1c00065b20 0x7f1c00067fe0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1c14158bc0 tx=0x7f1c08009040 comp rx=0 tx=0).stop 2023-09-13T06:10:58.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 -- 172.21.15.130:0/1013088386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c140b04a0 msgr2=0x7f1c141fc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:58.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c140b04a0 0x7f1c141fc340 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400c780 tx=0x7f1c0400cc40 comp rx=0 tx=0).stop 2023-09-13T06:10:58.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 -- 172.21.15.130:0/1013088386 shutdown_connections 2023-09-13T06:10:58.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1c00065b20 0x7f1c00067fe0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c140cc780 0x7f1c1414bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c1415b130 0x7f1c1414a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 --2- 172.21.15.130:0/1013088386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c140b04a0 0x7f1c141fc340 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:58.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 -- 172.21.15.130:0/1013088386 >> 172.21.15.130:0/1013088386 conn(0x7f1c14065990 msgr2=0x7f1c140cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:58.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 -- 172.21.15.130:0/1013088386 shutdown_connections 2023-09-13T06:10:58.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:58.917+0000 7f1c1a493640 1 -- 172.21.15.130:0/1013088386 wait complete. 2023-09-13T06:10:58.935 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T06:10:58.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:10:58.936 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-13T06:10:59.003 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:10:59.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:10:59.004 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T06:10:59.014 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:10:59.014 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:10:59.024 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:10:59.025 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:10:59.076 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:10:59.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.213+0000 7f67013c6640 1 Processor -- start 2023-09-13T06:10:59.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.213+0000 7f67013c6640 1 -- start start 2023-09-13T06:10:59.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f67013c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 0x7f66fc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f67013c6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f66fc146f30 0x7f66fc0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f67013c6640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc0b63c0 con 0x7f66fc0d1750 2023-09-13T06:10:59.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f67013c6640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc15dea0 con 0x7f66fc146f30 2023-09-13T06:10:59.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f67013c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0d0c20 con 0x7f66fc0d1090 2023-09-13T06:10:59.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66f27fc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 0x7f66fc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66faffd640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f66fc0d1750 0x7f66fc146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:57338/0 (socket says 172.21.15.130:57338) 2023-09-13T06:10:59.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66f27fc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 0x7f66fc15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:36504/0 (socket says 172.21.15.130:36504) 2023-09-13T06:10:59.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66faffd640 1 -- 172.21.15.130:0/1563543097 learned_addr learned my addr 172.21.15.130:0/1563543097 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:10:59.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66fb7fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f66fc146f30 0x7f66fc0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66fa7fc640 1 -- 172.21.15.130:0/1563543097 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164376943 0 0) 0x7f66fc0b63c0 con 0x7f66fc0d1750 2023-09-13T06:10:59.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66fa7fc640 1 -- 172.21.15.130:0/1563543097 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e8003530 con 0x7f66fc0d1750 2023-09-13T06:10:59.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66f27fc640 1 -- 172.21.15.130:0/1563543097 >> v2:172.21.15.164:3300/0 conn(0x7f66fc146f30 msgr2=0x7f66fc0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:10:59.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66f27fc640 1 --2- 172.21.15.130:0/1563543097 >> v2:172.21.15.164:3300/0 conn(0x7f66fc146f30 0x7f66fc0b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66f27fc640 1 -- 172.21.15.130:0/1563543097 >> v1:172.21.15.164:6789/0 conn(0x7f66fc0d1750 legacy=0x7f66fc146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66f27fc640 1 -- 172.21.15.130:0/1563543097 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc0b6610 con 0x7f66fc0d1090 2023-09-13T06:10:59.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.217+0000 7f66fb7fe640 1 --2- 172.21.15.130:0/1563543097 >> v2:172.21.15.164:3300/0 conn(0x7f66fc146f30 0x7f66fc0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:10:59.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f66f27fc640 1 --2- 172.21.15.130:0/1563543097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 0x7f66fc15d960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009d90 tx=0x7f66e401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbb4fe332069473e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:59.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f66fa7fc640 1 -- 172.21.15.130:0/1563543097 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40a59e0 con 0x7f66fc0d1090 2023-09-13T06:10:59.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f66fa7fc640 1 -- 172.21.15.130:0/1563543097 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e40a5b40 con 0x7f66fc0d1090 2023-09-13T06:10:59.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f66fa7fc640 1 -- 172.21.15.130:0/1563543097 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40ad440 con 0x7f66fc0d1090 2023-09-13T06:10:59.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f67013c6640 1 -- 172.21.15.130:0/1563543097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 msgr2=0x7f66fc15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f67013c6640 1 --2- 172.21.15.130:0/1563543097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 0x7f66fc15d960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009d90 tx=0x7f66e401c920 comp rx=0 tx=0).stop 2023-09-13T06:10:59.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f67013c6640 1 -- 172.21.15.130:0/1563543097 shutdown_connections 2023-09-13T06:10:59.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f67013c6640 1 --2- 172.21.15.130:0/1563543097 >> v2:172.21.15.164:3300/0 conn(0x7f66fc146f30 0x7f66fc0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f67013c6640 1 --2- 172.21.15.130:0/1563543097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 0x7f66fc15d960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f67013c6640 1 -- 172.21.15.130:0/1563543097 >> 172.21.15.130:0/1563543097 conn(0x7f66fc06f170 msgr2=0x7f66fc06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:59.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f67013c6640 1 -- 172.21.15.130:0/1563543097 shutdown_connections 2023-09-13T06:10:59.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f67013c6640 1 -- 172.21.15.130:0/1563543097 wait complete. 2023-09-13T06:10:59.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f67013c6640 1 Processor -- start 2023-09-13T06:10:59.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.221+0000 7f67013c6640 1 -- start start 2023-09-13T06:10:59.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f67013c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 0x7f66fc1670f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f67013c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66fc0d1750 0x7f66fc13ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f67013c6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66fc146f30 0x7f66fc15e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f67013c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc167630 con 0x7f66fc0d1750 2023-09-13T06:10:59.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f67013c6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc13f390 con 0x7f66fc146f30 2023-09-13T06:10:59.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f67013c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc168100 con 0x7f66fc0d1090 2023-09-13T06:10:59.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66fc0d1750 0x7f66fc13ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66fc0d1750 0x7f66fc13ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35298/0 (socket says 172.21.15.130:35298) 2023-09-13T06:10:59.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f27fc640 1 -- 172.21.15.130:0/564458673 learned_addr learned my addr 172.21.15.130:0/564458673 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:10:59.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66fb7fe640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66fc146f30 0x7f66fc15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66faffd640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 0x7f66fc1670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f27fc640 1 -- 172.21.15.130:0/564458673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 msgr2=0x7f66fc1670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f27fc640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 0x7f66fc1670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f27fc640 1 -- 172.21.15.130:0/564458673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66fc146f30 msgr2=0x7f66fc15e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f27fc640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66fc146f30 0x7f66fc15e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f27fc640 1 -- 172.21.15.130:0/564458673 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f4009420 con 0x7f66fc0d1750 2023-09-13T06:10:59.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f27fc640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66fc0d1750 0x7f66fc13ee50 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f66e401afd0 tx=0x7f66e40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:59.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f3fff640 1 -- 172.21.15.130:0/564458673 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40aec70 con 0x7f66fc0d1750 2023-09-13T06:10:59.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f3fff640 1 -- 172.21.15.130:0/564458673 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e40aedd0 con 0x7f66fc0d1750 2023-09-13T06:10:59.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f67013c6640 1 -- 172.21.15.130:0/564458673 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e4009a70 con 0x7f66fc0d1750 2023-09-13T06:10:59.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f66f3fff640 1 -- 172.21.15.130:0/564458673 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40b7630 con 0x7f66fc0d1750 2023-09-13T06:10:59.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f67013c6640 1 -- 172.21.15.130:0/564458673 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc0b7e40 con 0x7f66fc0d1750 2023-09-13T06:10:59.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.225+0000 7f67013c6640 1 -- 172.21.15.130:0/564458673 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc0618a0 con 0x7f66fc0d1750 2023-09-13T06:10:59.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.229+0000 7f66f3fff640 1 -- 172.21.15.130:0/564458673 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f66e40b4050 con 0x7f66fc0d1750 2023-09-13T06:10:59.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.229+0000 7f66f3fff640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66dc065b20 0x7f66dc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.229+0000 7f66f3fff640 1 -- 172.21.15.130:0/564458673 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f66e411e710 con 0x7f66fc0d1750 2023-09-13T06:10:59.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.229+0000 7f66faffd640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66dc065b20 0x7f66dc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.229+0000 7f66f3fff640 1 -- 172.21.15.130:0/564458673 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f66dc06d710 con 0x7f66fc0d1750 2023-09-13T06:10:59.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.229+0000 7f66faffd640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66dc065b20 0x7f66dc067fe0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f66ec007fd0 tx=0x7f66ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:59.233 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.233+0000 7f66f3fff640 1 -- 172.21.15.130:0/564458673 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f66e40b2020 con 0x7f66fc0d1750 2023-09-13T06:10:59.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.381+0000 7f67013c6640 1 -- 172.21.15.130:0/564458673 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66fc0b86c0 con 0x7f66fc0d1750 2023-09-13T06:10:59.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.381+0000 7f66f3fff640 1 -- 172.21.15.130:0/564458673 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16684 (secure 0 0 0) 0x7f66e40ec130 con 0x7f66fc0d1750 2023-09-13T06:10:59.383 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:10:59.383 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":159,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:10:17.438747+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:08:40.183838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-09-13T06:08:41.020446+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.12","mappings":[{"from":2,"to":0}]},{"pgid":"19.23","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:10:59.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 -- 172.21.15.130:0/564458673 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66dc065b20 msgr2=0x7f66dc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66dc065b20 0x7f66dc067fe0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f66ec007fd0 tx=0x7f66ec009040 comp rx=0 tx=0).stop 2023-09-13T06:10:59.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 -- 172.21.15.130:0/564458673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66fc0d1750 msgr2=0x7f66fc13ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66fc0d1750 0x7f66fc13ee50 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f66e401afd0 tx=0x7f66e40196c0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 -- 172.21.15.130:0/564458673 shutdown_connections 2023-09-13T06:10:59.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f66dc065b20 0x7f66dc067fe0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66fc146f30 0x7f66fc15e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66fc0d1750 0x7f66fc13ee50 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 --2- 172.21.15.130:0/564458673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66fc0d1090 0x7f66fc1670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 -- 172.21.15.130:0/564458673 >> 172.21.15.130:0/564458673 conn(0x7f66fc06f170 msgr2=0x7f66fc15f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:59.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 -- 172.21.15.130:0/564458673 shutdown_connections 2023-09-13T06:10:59.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.385+0000 7f67013c6640 1 -- 172.21.15.130:0/564458673 wait complete. 2023-09-13T06:10:59.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:08:40.183838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:08:41.020446+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:10:59.405 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:10:59.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.545+0000 7f920e20b640 1 Processor -- start 2023-09-13T06:10:59.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.545+0000 7f920e20b640 1 -- start start 2023-09-13T06:10:59.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f920e20b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9208144d70 0x7f92080ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f920e20b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92080b2150 con 0x7f92080b2780 2023-09-13T06:10:59.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f920e20b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92080cdd90 con 0x7f92080b1b70 2023-09-13T06:10:59.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f920e20b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92080b2430 con 0x7f9208144d70 2023-09-13T06:10:59.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f91fffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f92080b2780 0x7f92080b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51194/0 (socket says 172.21.15.130:51194) 2023-09-13T06:10:59.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f91fffff640 1 -- 172.21.15.130:0/803619076 learned_addr learned my addr 172.21.15.130:0/803619076 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:10:59.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f92077fe640 1 --2- 172.21.15.130:0/803619076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9208144d70 0x7f92080ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f9206ffd640 1 -- 172.21.15.130:0/803619076 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940353144 0 0) 0x7f92080b2150 con 0x7f92080b2780 2023-09-13T06:10:59.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f9206ffd640 1 -- 172.21.15.130:0/803619076 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f4003530 con 0x7f92080b2780 2023-09-13T06:10:59.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f9206ffd640 1 -- 172.21.15.130:0/803619076 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235509634 0 0) 0x7f92080cdd90 con 0x7f92080b1b70 2023-09-13T06:10:59.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f9206ffd640 1 -- 172.21.15.130:0/803619076 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92080b2150 con 0x7f92080b1b70 2023-09-13T06:10:59.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f92077fe640 1 -- 172.21.15.130:0/803619076 >> v1:172.21.15.164:6789/0 conn(0x7f92080b1b70 legacy=0x7f920806ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f9206ffd640 1 -- 172.21.15.130:0/803619076 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59598945 0 0) 0x7f91f4003530 con 0x7f92080b2780 2023-09-13T06:10:59.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f92077fe640 1 -- 172.21.15.130:0/803619076 >> v1:172.21.15.130:6789/0 conn(0x7f92080b2780 legacy=0x7f92080b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.549+0000 7f92077fe640 1 -- 172.21.15.130:0/803619076 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92080ce070 con 0x7f9208144d70 2023-09-13T06:10:59.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f92077fe640 1 --2- 172.21.15.130:0/803619076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9208144d70 0x7f92080ce870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f91f80097f0 tx=0x7f91f801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eabfebb7111c8ad4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:59.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f9206ffd640 1 -- 172.21.15.130:0/803619076 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0001680 con 0x7f9208144d70 2023-09-13T06:10:59.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f9206ffd640 1 -- 172.21.15.130:0/803619076 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f80a7050 con 0x7f9208144d70 2023-09-13T06:10:59.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f9206ffd640 1 -- 172.21.15.130:0/803619076 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f80ab620 con 0x7f9208144d70 2023-09-13T06:10:59.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f920e20b640 1 -- 172.21.15.130:0/803619076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9208144d70 msgr2=0x7f92080ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f920e20b640 1 --2- 172.21.15.130:0/803619076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9208144d70 0x7f92080ce870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f91f80097f0 tx=0x7f91f801c3e0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f920e20b640 1 -- 172.21.15.130:0/803619076 shutdown_connections 2023-09-13T06:10:59.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f920e20b640 1 --2- 172.21.15.130:0/803619076 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9208144d70 0x7f92080ce870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f920e20b640 1 -- 172.21.15.130:0/803619076 >> 172.21.15.130:0/803619076 conn(0x7f9208065990 msgr2=0x7f9208065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:59.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f920e20b640 1 -- 172.21.15.130:0/803619076 shutdown_connections 2023-09-13T06:10:59.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f920e20b640 1 -- 172.21.15.130:0/803619076 wait complete. 2023-09-13T06:10:59.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f920e20b640 1 Processor -- start 2023-09-13T06:10:59.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.553+0000 7f920e20b640 1 -- start start 2023-09-13T06:10:59.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f920e20b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92080b1b70 0x7f9208154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f920e20b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92080b2780 0x7f9208152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f920e20b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9208144d70 0x7f9208152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f920e20b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92081534c0 con 0x7f92080b2780 2023-09-13T06:10:59.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f920e20b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92081537a0 con 0x7f9208144d70 2023-09-13T06:10:59.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f920e20b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9208153a80 con 0x7f92080b1b70 2023-09-13T06:10:59.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f91fffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92080b2780 0x7f9208152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f91fffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92080b2780 0x7f9208152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35306/0 (socket says 172.21.15.130:35306) 2023-09-13T06:10:59.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f92077fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92080b1b70 0x7f9208154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f91fffff640 1 -- 172.21.15.130:0/2190832129 learned_addr learned my addr 172.21.15.130:0/2190832129 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:10:59.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f9207fff640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9208144d70 0x7f9208152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f91fffff640 1 -- 172.21.15.130:0/2190832129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92080b1b70 msgr2=0x7f9208154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f91fffff640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92080b1b70 0x7f9208154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f91fffff640 1 -- 172.21.15.130:0/2190832129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9208144d70 msgr2=0x7f9208152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f91fffff640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9208144d70 0x7f9208152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f91fffff640 1 -- 172.21.15.130:0/2190832129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f8009420 con 0x7f92080b2780 2023-09-13T06:10:59.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f91fffff640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92080b2780 0x7f9208152480 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f91f000c750 tx=0x7f91f000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:59.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f9204ff9640 1 -- 172.21.15.130:0/2190832129 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0005af0 con 0x7f92080b2780 2023-09-13T06:10:59.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f9204ff9640 1 -- 172.21.15.130:0/2190832129 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0005c50 con 0x7f92080b2780 2023-09-13T06:10:59.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f9204ff9640 1 -- 172.21.15.130:0/2190832129 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0007070 con 0x7f92080b2780 2023-09-13T06:10:59.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f920e20b640 1 -- 172.21.15.130:0/2190832129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9208153d60 con 0x7f92080b2780 2023-09-13T06:10:59.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f920e20b640 1 -- 172.21.15.130:0/2190832129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9208153100 con 0x7f92080b2780 2023-09-13T06:10:59.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.557+0000 7f920e20b640 1 -- 172.21.15.130:0/2190832129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92080618a0 con 0x7f92080b2780 2023-09-13T06:10:59.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.561+0000 7f9204ff9640 1 -- 172.21.15.130:0/2190832129 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f91f00071d0 con 0x7f92080b2780 2023-09-13T06:10:59.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.561+0000 7f9204ff9640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f91e8065b20 0x7f91e8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.561+0000 7f9204ff9640 1 -- 172.21.15.130:0/2190832129 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f91f0082ff0 con 0x7f92080b2780 2023-09-13T06:10:59.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.561+0000 7f92077fe640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f91e8065b20 0x7f91e8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.561+0000 7f9204ff9640 1 -- 172.21.15.130:0/2190832129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f91e806d710 con 0x7f92080b2780 2023-09-13T06:10:59.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.561+0000 7f92077fe640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f91e8065b20 0x7f91e8067fe0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f91f80ad000 tx=0x7f91f80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:59.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.565+0000 7f9204ff9640 1 -- 172.21.15.130:0/2190832129 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f91f00b3db0 con 0x7f92080b2780 2023-09-13T06:10:59.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.713+0000 7f920e20b640 1 -- 172.21.15.130:0/2190832129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92080b0350 con 0x7f92080b2780 2023-09-13T06:10:59.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.713+0000 7f9204ff9640 1 -- 172.21.15.130:0/2190832129 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91f0050950 con 0x7f92080b2780 2023-09-13T06:10:59.714 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:10:59.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 -- 172.21.15.130:0/2190832129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f91e8065b20 msgr2=0x7f91e8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f91e8065b20 0x7f91e8067fe0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f91f80ad000 tx=0x7f91f80a6000 comp rx=0 tx=0).stop 2023-09-13T06:10:59.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 -- 172.21.15.130:0/2190832129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92080b2780 msgr2=0x7f9208152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92080b2780 0x7f9208152480 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f91f000c750 tx=0x7f91f000cc10 comp rx=0 tx=0).stop 2023-09-13T06:10:59.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 -- 172.21.15.130:0/2190832129 shutdown_connections 2023-09-13T06:10:59.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f91e8065b20 0x7f91e8067fe0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9208144d70 0x7f9208152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92080b2780 0x7f9208152480 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 --2- 172.21.15.130:0/2190832129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92080b1b70 0x7f9208154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 -- 172.21.15.130:0/2190832129 >> 172.21.15.130:0/2190832129 conn(0x7f9208065990 msgr2=0x7f920806d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:59.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 -- 172.21.15.130:0/2190832129 shutdown_connections 2023-09-13T06:10:59.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.717+0000 7f920e20b640 1 -- 172.21.15.130:0/2190832129 wait complete. 2023-09-13T06:10:59.735 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:10:59.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.881+0000 7fe039493640 1 Processor -- start 2023-09-13T06:10:59.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.881+0000 7fe039493640 1 -- start start 2023-09-13T06:10:59.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe039493640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe0340b31a0 0x7fe0340ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe039493640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0340cc850 con 0x7fe03415a080 2023-09-13T06:10:59.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe039493640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0340b0330 con 0x7fe0340b1460 2023-09-13T06:10:59.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe039493640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0340cbcd0 con 0x7fe0340b31a0 2023-09-13T06:10:59.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe032ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe03415a080 0x7fe03415e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51208/0 (socket says 172.21.15.130:51208) 2023-09-13T06:10:59.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe032ffd640 1 -- 172.21.15.130:0/1797124525 learned_addr learned my addr 172.21.15.130:0/1797124525 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:10:59.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe0337fe640 1 --2- 172.21.15.130:0/1797124525 >> v2:172.21.15.130:3300/0 conn(0x7fe0340b31a0 0x7fe0340ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe0327fc640 1 -- 172.21.15.130:0/1797124525 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650508371 0 0) 0x7fe024001120 con 0x7fe03415a080 2023-09-13T06:10:59.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe0327fc640 1 -- 172.21.15.130:0/1797124525 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe020003530 con 0x7fe03415a080 2023-09-13T06:10:59.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe0337fe640 1 -- 172.21.15.130:0/1797124525 >> v1:172.21.15.164:6789/0 conn(0x7fe0340b1460 legacy=0x7fe0340b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:10:59.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe0337fe640 1 -- 172.21.15.130:0/1797124525 >> v1:172.21.15.130:6789/0 conn(0x7fe03415a080 legacy=0x7fe03415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe0337fe640 1 -- 172.21.15.130:0/1797124525 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0340cbfb0 con 0x7fe0340b31a0 2023-09-13T06:10:59.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe0337fe640 1 --2- 172.21.15.130:0/1797124525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0340b31a0 0x7fe0340ccfe0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009d90 tx=0x7fe02c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae5ba50d4c2bf70 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:59.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.885+0000 7fe0327fc640 1 -- 172.21.15.130:0/1797124525 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0a5710 con 0x7fe0340b31a0 2023-09-13T06:10:59.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe0327fc640 1 -- 172.21.15.130:0/1797124525 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c0a5870 con 0x7fe0340b31a0 2023-09-13T06:10:59.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe0327fc640 1 -- 172.21.15.130:0/1797124525 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0a5c00 con 0x7fe0340b31a0 2023-09-13T06:10:59.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 -- 172.21.15.130:0/1797124525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0340b31a0 msgr2=0x7fe0340ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 --2- 172.21.15.130:0/1797124525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0340b31a0 0x7fe0340ccfe0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009d90 tx=0x7fe02c01c850 comp rx=0 tx=0).stop 2023-09-13T06:10:59.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 -- 172.21.15.130:0/1797124525 shutdown_connections 2023-09-13T06:10:59.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 --2- 172.21.15.130:0/1797124525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0340b31a0 0x7fe0340ccfe0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 -- 172.21.15.130:0/1797124525 >> 172.21.15.130:0/1797124525 conn(0x7fe034065990 msgr2=0x7fe034065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:10:59.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 -- 172.21.15.130:0/1797124525 shutdown_connections 2023-09-13T06:10:59.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 -- 172.21.15.130:0/1797124525 wait complete. 2023-09-13T06:10:59.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 Processor -- start 2023-09-13T06:10:59.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 -- start start 2023-09-13T06:10:59.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0340b1460 0x7fe0341541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0340b31a0 0x7fe034146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe03415a080 0x7fe03406d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0341476d0 con 0x7fe0340b1460 2023-09-13T06:10:59.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe034147970 con 0x7fe0340b31a0 2023-09-13T06:10:59.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe039493640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe034147c50 con 0x7fe03415a080 2023-09-13T06:10:59.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe032ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0340b1460 0x7fe0341541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe032ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0340b1460 0x7fe0341541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35318/0 (socket says 172.21.15.130:35318) 2023-09-13T06:10:59.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe032ffd640 1 -- 172.21.15.130:0/437204304 learned_addr learned my addr 172.21.15.130:0/437204304 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:10:59.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe02bfff640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0340b31a0 0x7fe034146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.889+0000 7fe0337fe640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe03415a080 0x7fe03406d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe032ffd640 1 -- 172.21.15.130:0/437204304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe03415a080 msgr2=0x7fe03406d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe032ffd640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe03415a080 0x7fe03406d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe032ffd640 1 -- 172.21.15.130:0/437204304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0340b31a0 msgr2=0x7fe034146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:10:59.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe032ffd640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0340b31a0 0x7fe034146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:10:59.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe032ffd640 1 -- 172.21.15.130:0/437204304 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c009a70 con 0x7fe0340b1460 2023-09-13T06:10:59.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe02bfff640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0340b31a0 0x7fe034146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:10:59.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe032ffd640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0340b1460 0x7fe0341541e0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe02400c420 tx=0x7fe02400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:59.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe02b7fe640 1 -- 172.21.15.130:0/437204304 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024005cf0 con 0x7fe0340b1460 2023-09-13T06:10:59.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe02b7fe640 1 -- 172.21.15.130:0/437204304 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe024005e50 con 0x7fe0340b1460 2023-09-13T06:10:59.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe02b7fe640 1 -- 172.21.15.130:0/437204304 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0240072f0 con 0x7fe0340b1460 2023-09-13T06:10:59.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe039493640 1 -- 172.21.15.130:0/437204304 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe034147f30 con 0x7fe0340b1460 2023-09-13T06:10:59.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe039493640 1 -- 172.21.15.130:0/437204304 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe034147260 con 0x7fe0340b1460 2023-09-13T06:10:59.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe039493640 1 -- 172.21.15.130:0/437204304 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0340618a0 con 0x7fe0340b1460 2023-09-13T06:10:59.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe02b7fe640 1 -- 172.21.15.130:0/437204304 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe024007450 con 0x7fe0340b1460 2023-09-13T06:10:59.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe02b7fe640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe014065b50 0x7fe014068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:10:59.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe02b7fe640 1 -- 172.21.15.130:0/437204304 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe0240827a0 con 0x7fe0340b1460 2023-09-13T06:10:59.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe02b7fe640 1 -- 172.21.15.130:0/437204304 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7fe01406d740 con 0x7fe0340b1460 2023-09-13T06:10:59.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.893+0000 7fe02bfff640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe014065b50 0x7fe014068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:10:59.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.897+0000 7fe02bfff640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe014065b50 0x7fe014068010 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe034157330 tx=0x7fe01c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:10:59.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:10:59.897+0000 7fe02b7fe640 1 -- 172.21.15.130:0/437204304 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe024017020 con 0x7fe0340b1460 2023-09-13T06:11:00.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.045+0000 7fe039493640 1 -- 172.21.15.130:0/437204304 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0340cc850 con 0x7fe0340b1460 2023-09-13T06:11:00.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.045+0000 7fe02b7fe640 1 -- 172.21.15.130:0/437204304 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0340cc850 con 0x7fe0340b1460 2023-09-13T06:11:00.045 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:11:00.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.045+0000 7fe039493640 1 -- 172.21.15.130:0/437204304 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe014065b50 msgr2=0x7fe014068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.045+0000 7fe039493640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe014065b50 0x7fe014068010 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe034157330 tx=0x7fe01c009040 comp rx=0 tx=0).stop 2023-09-13T06:11:00.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.045+0000 7fe039493640 1 -- 172.21.15.130:0/437204304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0340b1460 msgr2=0x7fe0341541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.045+0000 7fe039493640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0340b1460 0x7fe0341541e0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe02400c420 tx=0x7fe02400c8e0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.049+0000 7fe039493640 1 -- 172.21.15.130:0/437204304 shutdown_connections 2023-09-13T06:11:00.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.049+0000 7fe039493640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe014065b50 0x7fe014068010 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.049+0000 7fe039493640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0340b31a0 0x7fe034146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.049+0000 7fe039493640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe03415a080 0x7fe03406d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.049+0000 7fe039493640 1 --2- 172.21.15.130:0/437204304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0340b1460 0x7fe0341541e0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.049+0000 7fe039493640 1 -- 172.21.15.130:0/437204304 >> 172.21.15.130:0/437204304 conn(0x7fe034065990 msgr2=0x7fe034158410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:00.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.049+0000 7fe039493640 1 -- 172.21.15.130:0/437204304 shutdown_connections 2023-09-13T06:11:00.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.049+0000 7fe039493640 1 -- 172.21.15.130:0/437204304 wait complete. 2023-09-13T06:11:00.067 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:11:00.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.205+0000 7f19e379f640 1 Processor -- start 2023-09-13T06:11:00.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.205+0000 7f19e379f640 1 -- start start 2023-09-13T06:11:00.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e379f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f19dc0b2e90 0x7f19dc0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e379f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc0b2150 con 0x7f19dc0b1460 2023-09-13T06:11:00.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e379f640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc0cdd90 con 0x7f19dc144d70 2023-09-13T06:11:00.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e379f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc0b2430 con 0x7f19dc0b2e90 2023-09-13T06:11:00.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e1d3c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f19dc0b1460 0x7f19dc0b18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51220/0 (socket says 172.21.15.130:51220) 2023-09-13T06:11:00.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e1d3c640 1 -- 172.21.15.130:0/1184733985 learned_addr learned my addr 172.21.15.130:0/1184733985 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:00.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e0d3a640 1 --2- 172.21.15.130:0/1184733985 >> v2:172.21.15.164:3300/0 conn(0x7f19dc0b2e90 0x7f19dc0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162171994 0 0) 0x7f19dc0b2150 con 0x7f19dc0b1460 2023-09-13T06:11:00.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c8003530 con 0x7f19dc0b1460 2023-09-13T06:11:00.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1570068061 0 0) 0x7f19c8003530 con 0x7f19dc0b1460 2023-09-13T06:11:00.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 >> v2:172.21.15.164:3300/0 conn(0x7f19dc0b2e90 msgr2=0x7f19dc0ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:00.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 --2- 172.21.15.130:0/1184733985 >> v2:172.21.15.164:3300/0 conn(0x7f19dc0b2e90 0x7f19dc0ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 >> v1:172.21.15.164:6789/0 conn(0x7f19dc144d70 legacy=0x7f19dc0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc0ce070 con 0x7f19dc0b1460 2023-09-13T06:11:00.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f19d4001a00 con 0x7f19dc0b1460 2023-09-13T06:11:00.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 >> v1:172.21.15.130:6789/0 conn(0x7f19dc0b1460 legacy=0x7f19dc0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19c80039f0 0x7f19c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19c80047d0 0x7f19c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19c8005190 0x7f19c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0b2430 con 0x7f19c80047d0 2023-09-13T06:11:00.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c800c060 con 0x7f19c8005190 2023-09-13T06:11:00.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c800c220 con 0x7f19c80039f0 2023-09-13T06:11:00.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e0d3a640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19c80047d0 0x7f19c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e1d3c640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19c8005190 0x7f19c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e153b640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19c80039f0 0x7f19c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e0d3a640 1 -- 172.21.15.130:0/1184733985 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19c80039f0 msgr2=0x7f19c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e0d3a640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19c80039f0 0x7f19c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e0d3a640 1 -- 172.21.15.130:0/1184733985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19c8005190 msgr2=0x7f19c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e0d3a640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19c8005190 0x7f19c800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e0d3a640 1 -- 172.21.15.130:0/1184733985 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8003530 con 0x7f19c80047d0 2023-09-13T06:11:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e1d3c640 1 -- 172.21.15.130:0/1184733985 reap_dead start 2023-09-13T06:11:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.209+0000 7f19e153b640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19c80039f0 0x7f19c8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:00.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.213+0000 7f19e0d3a640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19c80047d0 0x7f19c8004c50 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009ae0 tx=0x7f19cc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb5c5ffeede00a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:00.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.213+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0a5640 con 0x7f19c80047d0 2023-09-13T06:11:00.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.213+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc0a57a0 con 0x7f19c80047d0 2023-09-13T06:11:00.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.213+0000 7f19d3fff640 1 -- 172.21.15.130:0/1184733985 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0a5b50 con 0x7f19c80047d0 2023-09-13T06:11:00.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.213+0000 7f19e379f640 1 -- 172.21.15.130:0/1184733985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19c80047d0 msgr2=0x7f19c8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.213+0000 7f19e379f640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19c80047d0 0x7f19c8004c50 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009ae0 tx=0x7f19cc01ca50 comp rx=0 tx=0).stop 2023-09-13T06:11:00.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.213+0000 7f19e379f640 1 -- 172.21.15.130:0/1184733985 shutdown_connections 2023-09-13T06:11:00.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.213+0000 7f19e379f640 1 --2- 172.21.15.130:0/1184733985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19c80047d0 0x7f19c8004c50 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.213+0000 7f19e379f640 1 -- 172.21.15.130:0/1184733985 >> 172.21.15.130:0/1184733985 conn(0x7f19dc065990 msgr2=0x7f19dc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:00.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.213+0000 7f19e379f640 1 -- 172.21.15.130:0/1184733985 shutdown_connections 2023-09-13T06:11:00.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.213+0000 7f19e379f640 1 -- 172.21.15.130:0/1184733985 wait complete. 2023-09-13T06:11:00.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e379f640 1 Processor -- start 2023-09-13T06:11:00.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e379f640 1 -- start start 2023-09-13T06:11:00.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e379f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19c80047d0 0x7f19dc13b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e379f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19dc141ea0 0x7f19dc142320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e379f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19dc15aff0 0x7f19dc15b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e379f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc142860 con 0x7f19dc141ea0 2023-09-13T06:11:00.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e379f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc15bd20 con 0x7f19dc15aff0 2023-09-13T06:11:00.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e379f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc15c000 con 0x7f19c80047d0 2023-09-13T06:11:00.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e0d3a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19dc141ea0 0x7f19dc142320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e0d3a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19dc141ea0 0x7f19dc142320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35338/0 (socket says 172.21.15.130:35338) 2023-09-13T06:11:00.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e0d3a640 1 -- 172.21.15.130:0/1494058794 learned_addr learned my addr 172.21.15.130:0/1494058794 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:00.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e153b640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19c80047d0 0x7f19dc13b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e1d3c640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19dc15aff0 0x7f19dc15b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e0d3a640 1 -- 172.21.15.130:0/1494058794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19c80047d0 msgr2=0x7f19dc13b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e0d3a640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19c80047d0 0x7f19dc13b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e0d3a640 1 -- 172.21.15.130:0/1494058794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19dc15aff0 msgr2=0x7f19dc15b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e0d3a640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19dc15aff0 0x7f19dc15b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e0d3a640 1 -- 172.21.15.130:0/1494058794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc15c2e0 con 0x7f19dc141ea0 2023-09-13T06:11:00.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e0d3a640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19dc141ea0 0x7f19dc142320 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f19cc01c880 tx=0x7f19cc0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:00.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19d1ffb640 1 -- 172.21.15.130:0/1494058794 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc004020 con 0x7f19dc141ea0 2023-09-13T06:11:00.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19d1ffb640 1 -- 172.21.15.130:0/1494058794 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc0041a0 con 0x7f19dc141ea0 2023-09-13T06:11:00.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19d1ffb640 1 -- 172.21.15.130:0/1494058794 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc003620 con 0x7f19dc141ea0 2023-09-13T06:11:00.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e379f640 1 -- 172.21.15.130:0/1494058794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc15c5c0 con 0x7f19dc141ea0 2023-09-13T06:11:00.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e379f640 1 -- 172.21.15.130:0/1494058794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc15b9e0 con 0x7f19dc141ea0 2023-09-13T06:11:00.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.217+0000 7f19e379f640 1 -- 172.21.15.130:0/1494058794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc0618a0 con 0x7f19dc141ea0 2023-09-13T06:11:00.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.221+0000 7f19d1ffb640 1 -- 172.21.15.130:0/1494058794 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f19cc0b4070 con 0x7f19dc141ea0 2023-09-13T06:11:00.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.221+0000 7f19d1ffb640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f19c0065b50 0x7f19c0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.221+0000 7f19d1ffb640 1 -- 172.21.15.130:0/1494058794 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f19cc11dd10 con 0x7f19dc141ea0 2023-09-13T06:11:00.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.221+0000 7f19d1ffb640 1 -- 172.21.15.130:0/1494058794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f19c006d740 con 0x7f19dc141ea0 2023-09-13T06:11:00.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.221+0000 7f19e153b640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f19c0065b50 0x7f19c0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.221+0000 7f19e153b640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f19c0065b50 0x7f19c0068010 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f19dc06ea00 tx=0x7f19d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:00.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.225+0000 7f19d1ffb640 1 -- 172.21.15.130:0/1494058794 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f19cc0eb730 con 0x7f19dc141ea0 2023-09-13T06:11:00.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.373+0000 7f19e379f640 1 -- 172.21.15.130:0/1494058794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19dc0add20 con 0x7f19dc141ea0 2023-09-13T06:11:00.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.373+0000 7f19d1ffb640 1 -- 172.21.15.130:0/1494058794 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v159) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19cc0bc0a0 con 0x7f19dc141ea0 2023-09-13T06:11:00.374 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:11:00.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 -- 172.21.15.130:0/1494058794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f19c0065b50 msgr2=0x7f19c0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f19c0065b50 0x7f19c0068010 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f19dc06ea00 tx=0x7f19d8009040 comp rx=0 tx=0).stop 2023-09-13T06:11:00.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 -- 172.21.15.130:0/1494058794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19dc141ea0 msgr2=0x7f19dc142320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19dc141ea0 0x7f19dc142320 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f19cc01c880 tx=0x7f19cc0197f0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 -- 172.21.15.130:0/1494058794 shutdown_connections 2023-09-13T06:11:00.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f19c0065b50 0x7f19c0068010 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19dc15aff0 0x7f19dc15b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19dc141ea0 0x7f19dc142320 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 --2- 172.21.15.130:0/1494058794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19c80047d0 0x7f19dc13b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 -- 172.21.15.130:0/1494058794 >> 172.21.15.130:0/1494058794 conn(0x7f19dc065990 msgr2=0x7f19dc15a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:00.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 -- 172.21.15.130:0/1494058794 shutdown_connections 2023-09-13T06:11:00.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.377+0000 7f19e379f640 1 -- 172.21.15.130:0/1494058794 wait complete. 2023-09-13T06:11:00.395 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:11:00.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.533+0000 7f97b352c640 1 Processor -- start 2023-09-13T06:11:00.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.533+0000 7f97b352c640 1 -- start start 2023-09-13T06:11:00.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.533+0000 7f97b352c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97ac0d1750 0x7f97ac15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.533+0000 7f97b352c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f97ac0d1090 0x7f97ac146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.533+0000 7f97b352c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ac0b63c0 con 0x7f97ac0d1b30 2023-09-13T06:11:00.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b352c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ac15dea0 con 0x7f97ac0d1090 2023-09-13T06:11:00.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b352c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0d0c20 con 0x7f97ac0d1750 2023-09-13T06:11:00.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b1ac9640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f97ac0d1b30 0x7f97ac0b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51234/0 (socket says 172.21.15.130:51234) 2023-09-13T06:11:00.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b1ac9640 1 -- 172.21.15.130:0/1643910418 learned_addr learned my addr 172.21.15.130:0/1643910418 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:00.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b12c8640 1 --2- 172.21.15.130:0/1643910418 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97ac0d1750 0x7f97ac15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b0ac7640 1 --2- 172.21.15.130:0/1643910418 >> v2:172.21.15.164:3300/0 conn(0x7f97ac0d1090 0x7f97ac146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97a3fff640 1 -- 172.21.15.130:0/1643910418 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656977792 0 0) 0x7f97ac0b63c0 con 0x7f97ac0d1b30 2023-09-13T06:11:00.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97a3fff640 1 -- 172.21.15.130:0/1643910418 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9798003530 con 0x7f97ac0d1b30 2023-09-13T06:11:00.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97a3fff640 1 -- 172.21.15.130:0/1643910418 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652687780 0 0) 0x7f9798003530 con 0x7f97ac0d1b30 2023-09-13T06:11:00.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b12c8640 1 -- 172.21.15.130:0/1643910418 >> v2:172.21.15.164:3300/0 conn(0x7f97ac0d1090 msgr2=0x7f97ac146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:00.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b12c8640 1 --2- 172.21.15.130:0/1643910418 >> v2:172.21.15.164:3300/0 conn(0x7f97ac0d1090 0x7f97ac146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b12c8640 1 -- 172.21.15.130:0/1643910418 >> v1:172.21.15.130:6789/0 conn(0x7f97ac0d1b30 legacy=0x7f97ac0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b12c8640 1 -- 172.21.15.130:0/1643910418 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac0b6610 con 0x7f97ac0d1750 2023-09-13T06:11:00.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b0ac7640 1 --2- 172.21.15.130:0/1643910418 >> v2:172.21.15.164:3300/0 conn(0x7f97ac0d1090 0x7f97ac146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:11:00.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.537+0000 7f97b12c8640 1 --2- 172.21.15.130:0/1643910418 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97ac0d1750 0x7f97ac15d960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f97a80097c0 tx=0x7f97a801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=561d991a09e9fbb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:00.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97a3fff640 1 -- 172.21.15.130:0/1643910418 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4001a00 con 0x7f97ac0d1750 2023-09-13T06:11:00.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97a3fff640 1 -- 172.21.15.130:0/1643910418 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a80a7050 con 0x7f97ac0d1750 2023-09-13T06:11:00.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97a3fff640 1 -- 172.21.15.130:0/1643910418 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a80ab620 con 0x7f97ac0d1750 2023-09-13T06:11:00.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97b352c640 1 -- 172.21.15.130:0/1643910418 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97ac0d1750 msgr2=0x7f97ac15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97b352c640 1 --2- 172.21.15.130:0/1643910418 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97ac0d1750 0x7f97ac15d960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f97a80097c0 tx=0x7f97a801c370 comp rx=0 tx=0).stop 2023-09-13T06:11:00.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97b352c640 1 -- 172.21.15.130:0/1643910418 shutdown_connections 2023-09-13T06:11:00.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97b352c640 1 --2- 172.21.15.130:0/1643910418 >> v2:172.21.15.164:3300/0 conn(0x7f97ac0d1090 0x7f97ac146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97b352c640 1 --2- 172.21.15.130:0/1643910418 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97ac0d1750 0x7f97ac15d960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97b352c640 1 -- 172.21.15.130:0/1643910418 >> 172.21.15.130:0/1643910418 conn(0x7f97ac06f170 msgr2=0x7f97ac06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:00.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97b352c640 1 -- 172.21.15.130:0/1643910418 shutdown_connections 2023-09-13T06:11:00.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97b352c640 1 -- 172.21.15.130:0/1643910418 wait complete. 2023-09-13T06:11:00.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97b352c640 1 Processor -- start 2023-09-13T06:11:00.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.541+0000 7f97b352c640 1 -- start start 2023-09-13T06:11:00.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b352c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97ac0d1090 0x7f97ac1409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b352c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97ac0d1750 0x7f97ac140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b352c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97ac0d1b30 0x7f97ac0b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b352c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0b5ed0 con 0x7f97ac0d1090 2023-09-13T06:11:00.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b352c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac13d7b0 con 0x7f97ac0d1b30 2023-09-13T06:11:00.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b352c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac13da90 con 0x7f97ac0d1750 2023-09-13T06:11:00.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b12c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97ac0d1090 0x7f97ac1409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b12c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97ac0d1090 0x7f97ac1409c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35348/0 (socket says 172.21.15.130:35348) 2023-09-13T06:11:00.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b12c8640 1 -- 172.21.15.130:0/3213942344 learned_addr learned my addr 172.21.15.130:0/3213942344 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:00.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b1ac9640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97ac0d1b30 0x7f97ac0b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b0ac7640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97ac0d1750 0x7f97ac140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b12c8640 1 -- 172.21.15.130:0/3213942344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97ac0d1750 msgr2=0x7f97ac140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b12c8640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97ac0d1750 0x7f97ac140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b12c8640 1 -- 172.21.15.130:0/3213942344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97ac0d1b30 msgr2=0x7f97ac0b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b12c8640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97ac0d1b30 0x7f97ac0b4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b12c8640 1 -- 172.21.15.130:0/3213942344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c009420 con 0x7f97ac0d1090 2023-09-13T06:11:00.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b1ac9640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97ac0d1b30 0x7f97ac0b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:00.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b12c8640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97ac0d1090 0x7f97ac1409c0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f97a80ae040 tx=0x7f97a801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:00.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97a1ffb640 1 -- 172.21.15.130:0/3213942344 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a80b7450 con 0x7f97ac0d1090 2023-09-13T06:11:00.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97a1ffb640 1 -- 172.21.15.130:0/3213942344 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a80b75d0 con 0x7f97ac0d1090 2023-09-13T06:11:00.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b352c640 1 -- 172.21.15.130:0/3213942344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a8009420 con 0x7f97ac0d1090 2023-09-13T06:11:00.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97a1ffb640 1 -- 172.21.15.130:0/3213942344 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a80b7980 con 0x7f97ac0d1090 2023-09-13T06:11:00.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b352c640 1 -- 172.21.15.130:0/3213942344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac13e050 con 0x7f97ac0d1090 2023-09-13T06:11:00.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97b352c640 1 -- 172.21.15.130:0/3213942344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac0618a0 con 0x7f97ac0d1090 2023-09-13T06:11:00.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.545+0000 7f97a1ffb640 1 -- 172.21.15.130:0/3213942344 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f97a80b7ae0 con 0x7f97ac0d1090 2023-09-13T06:11:00.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.549+0000 7f97a1ffb640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9790065b20 0x7f9790067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:00.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.549+0000 7f97a1ffb640 1 -- 172.21.15.130:0/3213942344 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f97a811db20 con 0x7f97ac0d1090 2023-09-13T06:11:00.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.549+0000 7f97b0ac7640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9790065b20 0x7f9790067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:00.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.549+0000 7f97a1ffb640 1 -- 172.21.15.130:0/3213942344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f979006d710 con 0x7f97ac0d1090 2023-09-13T06:11:00.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.549+0000 7f97b0ac7640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9790065b20 0x7f9790067fe0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f97ac142180 tx=0x7f979c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:00.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.553+0000 7f97a1ffb640 1 -- 172.21.15.130:0/3213942344 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f97a80b0060 con 0x7f97ac0d1090 2023-09-13T06:11:00.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 -- 172.21.15.130:0/3213942344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f97ac0b86c0 con 0x7f97ac0d1090 2023-09-13T06:11:00.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97a1ffb640 1 -- 172.21.15.130:0/3213942344 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v159) v1 ==== 80+0+0 (secure 0 0 0) 0x7f97a80eb390 con 0x7f97ac0d1090 2023-09-13T06:11:00.713 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:11:00.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 -- 172.21.15.130:0/3213942344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9790065b20 msgr2=0x7f9790067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9790065b20 0x7f9790067fe0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f97ac142180 tx=0x7f979c008040 comp rx=0 tx=0).stop 2023-09-13T06:11:00.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 -- 172.21.15.130:0/3213942344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97ac0d1090 msgr2=0x7f97ac1409c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:00.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97ac0d1090 0x7f97ac1409c0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f97a80ae040 tx=0x7f97a801abb0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 -- 172.21.15.130:0/3213942344 shutdown_connections 2023-09-13T06:11:00.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9790065b20 0x7f9790067fe0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97ac0d1b30 0x7f97ac0b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97ac0d1750 0x7f97ac140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 --2- 172.21.15.130:0/3213942344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97ac0d1090 0x7f97ac1409c0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:00.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 -- 172.21.15.130:0/3213942344 >> 172.21.15.130:0/3213942344 conn(0x7f97ac06f170 msgr2=0x7f97ac15f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:00.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 -- 172.21.15.130:0/3213942344 shutdown_connections 2023-09-13T06:11:00.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:00.713+0000 7f97b352c640 1 -- 172.21.15.130:0/3213942344 wait complete. 2023-09-13T06:11:00.734 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T06:11:00.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:00.735 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-13T06:11:00.805 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:11:00.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:00.805 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T06:11:00.816 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:11:00.816 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:11:00.825 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:11:00.826 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:11:00.826 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:11:00.868 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:11:00.869 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:11:01.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.005+0000 7ffb6c74d640 1 Processor -- start 2023-09-13T06:11:01.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.005+0000 7ffb6c74d640 1 -- start start 2023-09-13T06:11:01.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.005+0000 7ffb6c74d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffb6415d260 0x7ffb640b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.005+0000 7ffb6c74d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ffb640ce1a0 0x7ffb6406d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.005+0000 7ffb6c74d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb640afc70 0x7ffb6406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.005+0000 7ffb6c74d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb64070e70 con 0x7ffb6415d260 2023-09-13T06:11:01.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.005+0000 7ffb6c74d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb64070280 con 0x7ffb640ce1a0 2023-09-13T06:11:01.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.005+0000 7ffb6c74d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64070540 con 0x7ffb640afc70 2023-09-13T06:11:01.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb6a4e9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffb6415d260 0x7ffb640b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb6a4e9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffb6415d260 0x7ffb640b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52130/0 (socket says 172.21.15.130:52130) 2023-09-13T06:11:01.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb6a4e9640 1 -- 172.21.15.130:0/3147136275 learned_addr learned my addr 172.21.15.130:0/3147136275 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:01.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb69ce8640 1 --2- 172.21.15.130:0/3147136275 >> v2:172.21.15.164:3300/0 conn(0x7ffb640ce1a0 0x7ffb6406d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb6acea640 1 --2- 172.21.15.130:0/3147136275 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb640afc70 0x7ffb6406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb6a4e9640 1 -- 172.21.15.130:0/3147136275 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb640afc70 msgr2=0x7ffb6406dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:01.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb6a4e9640 1 --2- 172.21.15.130:0/3147136275 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb640afc70 0x7ffb6406dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb6a4e9640 1 -- 172.21.15.130:0/3147136275 >> v2:172.21.15.164:3300/0 conn(0x7ffb640ce1a0 msgr2=0x7ffb6406d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:01.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb6a4e9640 1 --2- 172.21.15.130:0/3147136275 >> v2:172.21.15.164:3300/0 conn(0x7ffb640ce1a0 0x7ffb6406d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb6a4e9640 1 -- 172.21.15.130:0/3147136275 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64070820 con 0x7ffb6415d260 2023-09-13T06:11:01.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb69ce8640 1 --2- 172.21.15.130:0/3147136275 >> v2:172.21.15.164:3300/0 conn(0x7ffb640ce1a0 0x7ffb6406d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:01.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb6a4e9640 1 --2- 172.21.15.130:0/3147136275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb6415d260 0x7ffb640b5800 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7ffb64073d60 tx=0x7ffb6001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943d6b86c7c98da0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:01.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb694e7640 1 -- 172.21.15.130:0/3147136275 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600ab670 con 0x7ffb6415d260 2023-09-13T06:11:01.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb694e7640 1 -- 172.21.15.130:0/3147136275 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb600ab7d0 con 0x7ffb6415d260 2023-09-13T06:11:01.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.009+0000 7ffb694e7640 1 -- 172.21.15.130:0/3147136275 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600abb60 con 0x7ffb6415d260 2023-09-13T06:11:01.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 -- 172.21.15.130:0/3147136275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb6415d260 msgr2=0x7ffb640b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 --2- 172.21.15.130:0/3147136275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb6415d260 0x7ffb640b5800 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7ffb64073d60 tx=0x7ffb6001c4d0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 -- 172.21.15.130:0/3147136275 shutdown_connections 2023-09-13T06:11:01.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 --2- 172.21.15.130:0/3147136275 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb640afc70 0x7ffb6406dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 --2- 172.21.15.130:0/3147136275 >> v2:172.21.15.164:3300/0 conn(0x7ffb640ce1a0 0x7ffb6406d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 --2- 172.21.15.130:0/3147136275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb6415d260 0x7ffb640b5800 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 -- 172.21.15.130:0/3147136275 >> 172.21.15.130:0/3147136275 conn(0x7ffb6406a2f0 msgr2=0x7ffb6406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:01.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 -- 172.21.15.130:0/3147136275 shutdown_connections 2023-09-13T06:11:01.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 -- 172.21.15.130:0/3147136275 wait complete. 2023-09-13T06:11:01.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 Processor -- start 2023-09-13T06:11:01.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 -- start start 2023-09-13T06:11:01.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb640afc70 0x7ffb640cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb640ce1a0 0x7ffb640cf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb6415d260 0x7ffb640cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb640cd340 con 0x7ffb640afc70 2023-09-13T06:11:01.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64152f50 con 0x7ffb6415d260 2023-09-13T06:11:01.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6c74d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64153230 con 0x7ffb640ce1a0 2023-09-13T06:11:01.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6a4e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb640afc70 0x7ffb640cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6a4e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb640afc70 0x7ffb640cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52132/0 (socket says 172.21.15.130:52132) 2023-09-13T06:11:01.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6a4e9640 1 -- 172.21.15.130:0/2138438078 learned_addr learned my addr 172.21.15.130:0/2138438078 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:01.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6acea640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb6415d260 0x7ffb640cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb69ce8640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb640ce1a0 0x7ffb640cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.013+0000 7ffb6a4e9640 1 -- 172.21.15.130:0/2138438078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb640ce1a0 msgr2=0x7ffb640cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb6a4e9640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb640ce1a0 0x7ffb640cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb6a4e9640 1 -- 172.21.15.130:0/2138438078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb6415d260 msgr2=0x7ffb640cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb6a4e9640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb6415d260 0x7ffb640cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb6a4e9640 1 -- 172.21.15.130:0/2138438078 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb600094d0 con 0x7ffb640afc70 2023-09-13T06:11:01.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb69ce8640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb640ce1a0 0x7ffb640cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:01.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb6a4e9640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb640afc70 0x7ffb640cce00 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7ffb600ad040 tx=0x7ffb6001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:01.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb5affd640 1 -- 172.21.15.130:0/2138438078 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600b4800 con 0x7ffb640afc70 2023-09-13T06:11:01.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb5affd640 1 -- 172.21.15.130:0/2138438078 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb600b4980 con 0x7ffb640afc70 2023-09-13T06:11:01.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb5affd640 1 -- 172.21.15.130:0/2138438078 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600b4d30 con 0x7ffb640afc70 2023-09-13T06:11:01.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb6c74d640 1 -- 172.21.15.130:0/2138438078 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb64153510 con 0x7ffb640afc70 2023-09-13T06:11:01.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb6c74d640 1 -- 172.21.15.130:0/2138438078 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb64153ad0 con 0x7ffb640afc70 2023-09-13T06:11:01.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb6c74d640 1 -- 172.21.15.130:0/2138438078 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb640618a0 con 0x7ffb640afc70 2023-09-13T06:11:01.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb5affd640 1 -- 172.21.15.130:0/2138438078 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ffb600b3380 con 0x7ffb640afc70 2023-09-13T06:11:01.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb5affd640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb48065b20 0x7ffb48067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.017+0000 7ffb5affd640 1 -- 172.21.15.130:0/2138438078 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffb6011db50 con 0x7ffb640afc70 2023-09-13T06:11:01.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.021+0000 7ffb69ce8640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb48065b20 0x7ffb48067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.021+0000 7ffb5affd640 1 -- 172.21.15.130:0/2138438078 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7ffb4806d710 con 0x7ffb640afc70 2023-09-13T06:11:01.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.021+0000 7ffb69ce8640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb48065b20 0x7ffb48067fe0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ffb64072470 tx=0x7ffb54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:01.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.021+0000 7ffb5affd640 1 -- 172.21.15.130:0/2138438078 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ffb600eb500 con 0x7ffb640afc70 2023-09-13T06:11:01.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 -- 172.21.15.130:0/2138438078 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb64071300 con 0x7ffb640afc70 2023-09-13T06:11:01.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb5affd640 1 -- 172.21.15.130:0/2138438078 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4927 (secure 0 0 0) 0x7ffb600c4030 con 0x7ffb640afc70 2023-09-13T06:11:01.205 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:01.205 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2638049185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2638049185},{"type":"v1","addr":"172.21.15.164:6834","nonce":2638049185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/4101999538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4101999538},{"type":"v1","addr":"172.21.15.130:6835","nonce":4101999538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1691911082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1691911082},{"type":"v1","addr":"172.21.15.130:6837","nonce":1691911082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:08:42.026268+0000","modified":"2023-09-13T06:08:45.060479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2618060608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2618060608},{"type":"v1","addr":"172.21.15.164:6835","nonce":2618060608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-09-13T06:11:01.206 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 76 2023-09-13T06:11:01.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 -- 172.21.15.130:0/2138438078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb48065b20 msgr2=0x7ffb48067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb48065b20 0x7ffb48067fe0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ffb64072470 tx=0x7ffb54008040 comp rx=0 tx=0).stop 2023-09-13T06:11:01.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 -- 172.21.15.130:0/2138438078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb640afc70 msgr2=0x7ffb640cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb640afc70 0x7ffb640cce00 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7ffb600ad040 tx=0x7ffb6001ad10 comp rx=0 tx=0).stop 2023-09-13T06:11:01.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 -- 172.21.15.130:0/2138438078 shutdown_connections 2023-09-13T06:11:01.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb48065b20 0x7ffb48067fe0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb6415d260 0x7ffb640cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb640ce1a0 0x7ffb640cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 --2- 172.21.15.130:0/2138438078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb640afc70 0x7ffb640cce00 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 -- 172.21.15.130:0/2138438078 >> 172.21.15.130:0/2138438078 conn(0x7ffb6406a2f0 msgr2=0x7ffb640ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:01.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 -- 172.21.15.130:0/2138438078 shutdown_connections 2023-09-13T06:11:01.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.205+0000 7ffb6c74d640 1 -- 172.21.15.130:0/2138438078 wait complete. 2023-09-13T06:11:01.226 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:11:01.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78be248640 1 Processor -- start 2023-09-13T06:11:01.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78be248640 1 -- start start 2023-09-13T06:11:01.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78be248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78b815b130 0x7f78b80cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78be248640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f78b80ce180 0x7f78b815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78be248640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b80ce980 con 0x7f78b80b04a0 2023-09-13T06:11:01.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78be248640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b80cec60 con 0x7f78b80ce180 2023-09-13T06:11:01.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78be248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b806c640 con 0x7f78b815b130 2023-09-13T06:11:01.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78b6ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f78b80ce180 0x7f78b815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78b7fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f78b80b04a0 0x7f78b806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38370/0 (socket says 172.21.15.130:38370) 2023-09-13T06:11:01.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78b7fff640 1 -- 172.21.15.130:0/2564916032 learned_addr learned my addr 172.21.15.130:0/2564916032 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:01.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78b77fe640 1 --2- 172.21.15.130:0/2564916032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78b815b130 0x7f78b80cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78b67fc640 1 -- 172.21.15.130:0/2564916032 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170147753 0 0) 0x7f78b80ce980 con 0x7f78b80b04a0 2023-09-13T06:11:01.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78b67fc640 1 -- 172.21.15.130:0/2564916032 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a0003530 con 0x7f78b80b04a0 2023-09-13T06:11:01.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78b6ffd640 1 -- 172.21.15.130:0/2564916032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78b815b130 msgr2=0x7f78b80cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:01.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78b6ffd640 1 --2- 172.21.15.130:0/2564916032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78b815b130 0x7f78b80cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78b6ffd640 1 -- 172.21.15.130:0/2564916032 >> v1:172.21.15.130:6789/0 conn(0x7f78b80b04a0 legacy=0x7f78b806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.365+0000 7f78b6ffd640 1 -- 172.21.15.130:0/2564916032 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b806c920 con 0x7f78b80ce180 2023-09-13T06:11:01.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78b6ffd640 1 --2- 172.21.15.130:0/2564916032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b80ce180 0x7f78b815b510 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0097c0 tx=0x7f78ac01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45271889fedd036c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:01.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78b67fc640 1 -- 172.21.15.130:0/2564916032 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0ac410 con 0x7f78b80ce180 2023-09-13T06:11:01.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78b67fc640 1 -- 172.21.15.130:0/2564916032 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac0ac570 con 0x7f78b80ce180 2023-09-13T06:11:01.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78b67fc640 1 -- 172.21.15.130:0/2564916032 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0ac900 con 0x7f78b80ce180 2023-09-13T06:11:01.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78be248640 1 -- 172.21.15.130:0/2564916032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b80ce180 msgr2=0x7f78b815b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78be248640 1 --2- 172.21.15.130:0/2564916032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b80ce180 0x7f78b815b510 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0097c0 tx=0x7f78ac01c480 comp rx=0 tx=0).stop 2023-09-13T06:11:01.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78be248640 1 -- 172.21.15.130:0/2564916032 shutdown_connections 2023-09-13T06:11:01.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78be248640 1 --2- 172.21.15.130:0/2564916032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b80ce180 0x7f78b815b510 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78be248640 1 --2- 172.21.15.130:0/2564916032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78b815b130 0x7f78b80cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78be248640 1 -- 172.21.15.130:0/2564916032 >> 172.21.15.130:0/2564916032 conn(0x7f78b8065990 msgr2=0x7f78b8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:01.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78be248640 1 -- 172.21.15.130:0/2564916032 shutdown_connections 2023-09-13T06:11:01.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.369+0000 7f78be248640 1 -- 172.21.15.130:0/2564916032 wait complete. 2023-09-13T06:11:01.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78be248640 1 Processor -- start 2023-09-13T06:11:01.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78be248640 1 -- start start 2023-09-13T06:11:01.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78be248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78b80b04a0 0x7f78b81f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78be248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b80ce180 0x7f78b80af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78be248640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78b815b130 0x7f78b815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78be248640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b81528d0 con 0x7f78b80ce180 2023-09-13T06:11:01.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78be248640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b815d1d0 con 0x7f78b815b130 2023-09-13T06:11:01.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78be248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b8151f30 con 0x7f78b80b04a0 2023-09-13T06:11:01.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78b6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b80ce180 0x7f78b80af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78b6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b80ce180 0x7f78b80af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52146/0 (socket says 172.21.15.130:52146) 2023-09-13T06:11:01.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78b6ffd640 1 -- 172.21.15.130:0/1445000947 learned_addr learned my addr 172.21.15.130:0/1445000947 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:01.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78b7fff640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78b815b130 0x7f78b815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78b77fe640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78b80b04a0 0x7f78b81f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78b6ffd640 1 -- 172.21.15.130:0/1445000947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78b80b04a0 msgr2=0x7f78b81f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78b6ffd640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78b80b04a0 0x7f78b81f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78b6ffd640 1 -- 172.21.15.130:0/1445000947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78b815b130 msgr2=0x7f78b815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78b6ffd640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78b815b130 0x7f78b815cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78b6ffd640 1 -- 172.21.15.130:0/1445000947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009420 con 0x7f78b80ce180 2023-09-13T06:11:01.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78b6ffd640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b80ce180 0x7f78b80af9a0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f78ac01a0b0 tx=0x7f78ac019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:01.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f789ffff640 1 -- 172.21.15.130:0/1445000947 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac006e20 con 0x7f78b80ce180 2023-09-13T06:11:01.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f789ffff640 1 -- 172.21.15.130:0/1445000947 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac0b5640 con 0x7f78b80ce180 2023-09-13T06:11:01.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78be248640 1 -- 172.21.15.130:0/1445000947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b8152210 con 0x7f78b80ce180 2023-09-13T06:11:01.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f789ffff640 1 -- 172.21.15.130:0/1445000947 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0b57d0 con 0x7f78b80ce180 2023-09-13T06:11:01.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78be248640 1 -- 172.21.15.130:0/1445000947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b815d400 con 0x7f78b80ce180 2023-09-13T06:11:01.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.373+0000 7f78be248640 1 -- 172.21.15.130:0/1445000947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b80618a0 con 0x7f78b80ce180 2023-09-13T06:11:01.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.377+0000 7f789ffff640 1 -- 172.21.15.130:0/1445000947 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f78ac0b3040 con 0x7f78b80ce180 2023-09-13T06:11:01.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.377+0000 7f789ffff640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f78a4065b20 0x7f78a4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.377+0000 7f789ffff640 1 -- 172.21.15.130:0/1445000947 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f78ac11cee0 con 0x7f78b80ce180 2023-09-13T06:11:01.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.377+0000 7f78b77fe640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f78a4065b20 0x7f78a4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.377+0000 7f789ffff640 1 -- 172.21.15.130:0/1445000947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f78a406d710 con 0x7f78b80ce180 2023-09-13T06:11:01.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.377+0000 7f78b77fe640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f78a4065b20 0x7f78a4067fe0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009ac0 tx=0x7f78a8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:01.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.381+0000 7f789ffff640 1 -- 172.21.15.130:0/1445000947 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f78ac0b9060 con 0x7f78b80ce180 2023-09-13T06:11:01.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.529+0000 7f78be248640 1 -- 172.21.15.130:0/1445000947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78b80cbc50 con 0x7f78b80ce180 2023-09-13T06:11:01.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.533+0000 7f789ffff640 1 -- 172.21.15.130:0/1445000947 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16684 (secure 0 0 0) 0x7f78ac0b1030 con 0x7f78b80ce180 2023-09-13T06:11:01.534 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:01.534 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":159,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:10:17.438747+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:08:40.183838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-09-13T06:08:41.020446+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.12","mappings":[{"from":2,"to":0}]},{"pgid":"19.23","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:11:01.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 -- 172.21.15.130:0/1445000947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f78a4065b20 msgr2=0x7f78a4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f78a4065b20 0x7f78a4067fe0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009ac0 tx=0x7f78a8009190 comp rx=0 tx=0).stop 2023-09-13T06:11:01.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 -- 172.21.15.130:0/1445000947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b80ce180 msgr2=0x7f78b80af9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b80ce180 0x7f78b80af9a0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f78ac01a0b0 tx=0x7f78ac019220 comp rx=0 tx=0).stop 2023-09-13T06:11:01.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 -- 172.21.15.130:0/1445000947 shutdown_connections 2023-09-13T06:11:01.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f78a4065b20 0x7f78a4067fe0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78b815b130 0x7f78b815cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b80ce180 0x7f78b80af9a0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 --2- 172.21.15.130:0/1445000947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78b80b04a0 0x7f78b81f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 -- 172.21.15.130:0/1445000947 >> 172.21.15.130:0/1445000947 conn(0x7f78b8065990 msgr2=0x7f78b80b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:01.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 -- 172.21.15.130:0/1445000947 shutdown_connections 2023-09-13T06:11:01.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.537+0000 7f78be248640 1 -- 172.21.15.130:0/1445000947 wait complete. 2023-09-13T06:11:01.555 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:08:40.183838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:08:41.020446+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:11:01.556 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:11:01.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcda30d8640 1 Processor -- start 2023-09-13T06:11:01.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcda30d8640 1 -- start start 2023-09-13T06:11:01.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcda30d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcd9c0b2e90 0x7fcd9c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcda30d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd9c0b1460 0x7fcd9c0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcda30d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c0b2150 con 0x7fcd9c144d70 2023-09-13T06:11:01.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcda30d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c0b2430 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcda30d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c0cedb0 con 0x7fcd9c0b1460 2023-09-13T06:11:01.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcd93fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcd9c0b2e90 0x7fcd9c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcda0e74640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fcd9c144d70 0x7fcd9c0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38380/0 (socket says 172.21.15.130:38380) 2023-09-13T06:11:01.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcda0e74640 1 -- 172.21.15.130:0/2480952840 learned_addr learned my addr 172.21.15.130:0/2480952840 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:01.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcda1675640 1 --2- 172.21.15.130:0/2480952840 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd9c0b1460 0x7fcd9c0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcd93fff640 1 -- 172.21.15.130:0/2480952840 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd9c0b1460 msgr2=0x7fcd9c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:01.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcd93fff640 1 --2- 172.21.15.130:0/2480952840 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd9c0b1460 0x7fcd9c0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcd93fff640 1 -- 172.21.15.130:0/2480952840 >> v1:172.21.15.130:6789/0 conn(0x7fcd9c144d70 legacy=0x7fcd9c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcd93fff640 1 -- 172.21.15.130:0/2480952840 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0cdd90 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.697+0000 7fcd937fe640 1 -- 172.21.15.130:0/2480952840 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089497683 0 0) 0x7fcd9c0b2150 con 0x7fcd9c144d70 2023-09-13T06:11:01.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcd93fff640 1 --2- 172.21.15.130:0/2480952840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd9c0b2e90 0x7fcd9c0ce870 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0097c0 tx=0x7fcd8c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a14e8097ccb805 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:01.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcd937fe640 1 -- 172.21.15.130:0/2480952840 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0ab600 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcd937fe640 1 -- 172.21.15.130:0/2480952840 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0a7050 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcd937fe640 1 -- 172.21.15.130:0/2480952840 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0ab980 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcda30d8640 1 -- 172.21.15.130:0/2480952840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd9c0b2e90 msgr2=0x7fcd9c0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcda30d8640 1 --2- 172.21.15.130:0/2480952840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd9c0b2e90 0x7fcd9c0ce870 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0097c0 tx=0x7fcd8c01c480 comp rx=0 tx=0).stop 2023-09-13T06:11:01.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcda30d8640 1 -- 172.21.15.130:0/2480952840 shutdown_connections 2023-09-13T06:11:01.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcda30d8640 1 --2- 172.21.15.130:0/2480952840 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd9c0b1460 0x7fcd9c0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcda30d8640 1 --2- 172.21.15.130:0/2480952840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd9c0b2e90 0x7fcd9c0ce870 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcda30d8640 1 -- 172.21.15.130:0/2480952840 >> 172.21.15.130:0/2480952840 conn(0x7fcd9c065990 msgr2=0x7fcd9c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:01.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcda30d8640 1 -- 172.21.15.130:0/2480952840 shutdown_connections 2023-09-13T06:11:01.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.701+0000 7fcda30d8640 1 -- 172.21.15.130:0/2480952840 wait complete. 2023-09-13T06:11:01.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcda30d8640 1 Processor -- start 2023-09-13T06:11:01.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcda30d8640 1 -- start start 2023-09-13T06:11:01.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcda30d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd9c0b1460 0x7fcd9c138a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcda30d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd9c0b2e90 0x7fcd9c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcda30d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd9c144d70 0x7fcd9c0ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcda30d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c155740 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcda30d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c15ca80 con 0x7fcd9c0b1460 2023-09-13T06:11:01.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcda30d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c15cd60 con 0x7fcd9c144d70 2023-09-13T06:11:01.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd93fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd9c0b2e90 0x7fcd9c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd93fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd9c0b2e90 0x7fcd9c15c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52168/0 (socket says 172.21.15.130:52168) 2023-09-13T06:11:01.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd93fff640 1 -- 172.21.15.130:0/3666236008 learned_addr learned my addr 172.21.15.130:0/3666236008 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:01.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd93fff640 1 -- 172.21.15.130:0/3666236008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd9c144d70 msgr2=0x7fcd9c0ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd93fff640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd9c144d70 0x7fcd9c0ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd93fff640 1 -- 172.21.15.130:0/3666236008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd9c0b1460 msgr2=0x7fcd9c138a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd93fff640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd9c0b1460 0x7fcd9c138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd93fff640 1 -- 172.21.15.130:0/3666236008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c009420 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd93fff640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd9c0b2e90 0x7fcd9c15c230 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c01a0b0 tx=0x7fcd8c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:01.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd917fa640 1 -- 172.21.15.130:0/3666236008 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0b7650 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd917fa640 1 -- 172.21.15.130:0/3666236008 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0abe90 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcd917fa640 1 -- 172.21.15.130:0/3666236008 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0b7a10 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcda30d8640 1 -- 172.21.15.130:0/3666236008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c15d040 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.705+0000 7fcda30d8640 1 -- 172.21.15.130:0/3666236008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c15d320 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.709+0000 7fcda30d8640 1 -- 172.21.15.130:0/3666236008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c155510 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.709+0000 7fcd917fa640 1 -- 172.21.15.130:0/3666236008 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcd8c0b7b70 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.709+0000 7fcd917fa640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcd88065b50 0x7fcd88068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:01.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.709+0000 7fcd917fa640 1 -- 172.21.15.130:0/3666236008 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcd8c11dc90 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.709+0000 7fcda0e74640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcd88065b50 0x7fcd88068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:01.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.709+0000 7fcd917fa640 1 -- 172.21.15.130:0/3666236008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7fcd8806d740 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.709+0000 7fcda0e74640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcd88065b50 0x7fcd88068010 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcd980015a0 tx=0x7fcd98007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:01.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.713+0000 7fcd917fa640 1 -- 172.21.15.130:0/3666236008 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcd8c0b0060 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.861+0000 7fcda30d8640 1 -- 172.21.15.130:0/3666236008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd9c0618a0 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.861+0000 7fcd917fa640 1 -- 172.21.15.130:0/3666236008 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd8c0eb500 con 0x7fcd9c0b2e90 2023-09-13T06:11:01.862 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:11:01.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.861+0000 7fcda30d8640 1 -- 172.21.15.130:0/3666236008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcd88065b50 msgr2=0x7fcd88068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.861+0000 7fcda30d8640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcd88065b50 0x7fcd88068010 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcd980015a0 tx=0x7fcd98007970 comp rx=0 tx=0).stop 2023-09-13T06:11:01.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.865+0000 7fcda30d8640 1 -- 172.21.15.130:0/3666236008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd9c0b2e90 msgr2=0x7fcd9c15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:01.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.865+0000 7fcda30d8640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd9c0b2e90 0x7fcd9c15c230 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c01a0b0 tx=0x7fcd8c01acc0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.865+0000 7fcda30d8640 1 -- 172.21.15.130:0/3666236008 shutdown_connections 2023-09-13T06:11:01.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.865+0000 7fcda30d8640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcd88065b50 0x7fcd88068010 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.865+0000 7fcda30d8640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd9c144d70 0x7fcd9c0ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.865+0000 7fcda30d8640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd9c0b2e90 0x7fcd9c15c230 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.865+0000 7fcda30d8640 1 --2- 172.21.15.130:0/3666236008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd9c0b1460 0x7fcd9c138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:01.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.865+0000 7fcda30d8640 1 -- 172.21.15.130:0/3666236008 >> 172.21.15.130:0/3666236008 conn(0x7fcd9c065990 msgr2=0x7fcd9c143f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:01.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.865+0000 7fcda30d8640 1 -- 172.21.15.130:0/3666236008 shutdown_connections 2023-09-13T06:11:01.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:01.865+0000 7fcda30d8640 1 -- 172.21.15.130:0/3666236008 wait complete. 2023-09-13T06:11:01.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:11:02.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.021+0000 7fb40b34d640 1 Processor -- start 2023-09-13T06:11:02.023 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.021+0000 7fb40b34d640 1 -- start start 2023-09-13T06:11:02.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb40b34d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4040b2e90 0x7fb4040ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb40b34d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb4040b1460 0x7fb4040b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb40b34d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4040b2150 con 0x7fb404144d70 2023-09-13T06:11:02.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb40b34d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040b2430 con 0x7fb4040b1460 2023-09-13T06:11:02.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb40b34d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040cedb0 con 0x7fb4040b2e90 2023-09-13T06:11:02.025 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb4098ea640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb4040b1460 0x7fb4040b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb4088e8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4040b2e90 0x7fb4040ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb4098ea640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb4040b1460 0x7fb4040b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37918/0 (socket says 172.21.15.130:37918) 2023-09-13T06:11:02.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb4098ea640 1 -- 172.21.15.130:0/3803441411 learned_addr learned my addr 172.21.15.130:0/3803441411 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:02.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb4098ea640 1 -- 172.21.15.130:0/3803441411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4040b2e90 msgr2=0x7fb4040ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:02.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb4098ea640 1 --2- 172.21.15.130:0/3803441411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4040b2e90 0x7fb4040ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb4098ea640 1 -- 172.21.15.130:0/3803441411 >> v1:172.21.15.164:6789/0 conn(0x7fb404144d70 legacy=0x7fb4040b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.025+0000 7fb4098ea640 1 -- 172.21.15.130:0/3803441411 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040cdd90 con 0x7fb4040b1460 2023-09-13T06:11:02.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb4098ea640 1 --2- 172.21.15.130:0/3803441411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4040b1460 0x7fb4040b18f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009e50 tx=0x7fb3fc01ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23b82d69127a834a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:02.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb3fbfff640 1 -- 172.21.15.130:0/3803441411 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0a57d0 con 0x7fb4040b1460 2023-09-13T06:11:02.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb3fbfff640 1 -- 172.21.15.130:0/3803441411 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc0a5930 con 0x7fb4040b1460 2023-09-13T06:11:02.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb3fbfff640 1 -- 172.21.15.130:0/3803441411 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0a5cc0 con 0x7fb4040b1460 2023-09-13T06:11:02.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb40b34d640 1 -- 172.21.15.130:0/3803441411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4040b1460 msgr2=0x7fb4040b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb40b34d640 1 --2- 172.21.15.130:0/3803441411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4040b1460 0x7fb4040b18f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009e50 tx=0x7fb3fc01ca10 comp rx=0 tx=0).stop 2023-09-13T06:11:02.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb40b34d640 1 -- 172.21.15.130:0/3803441411 shutdown_connections 2023-09-13T06:11:02.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb40b34d640 1 --2- 172.21.15.130:0/3803441411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4040b1460 0x7fb4040b18f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb40b34d640 1 --2- 172.21.15.130:0/3803441411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4040b2e90 0x7fb4040ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb40b34d640 1 -- 172.21.15.130:0/3803441411 >> 172.21.15.130:0/3803441411 conn(0x7fb404065990 msgr2=0x7fb404065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:02.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb40b34d640 1 -- 172.21.15.130:0/3803441411 shutdown_connections 2023-09-13T06:11:02.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb40b34d640 1 -- 172.21.15.130:0/3803441411 wait complete. 2023-09-13T06:11:02.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb40b34d640 1 Processor -- start 2023-09-13T06:11:02.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.029+0000 7fb40b34d640 1 -- start start 2023-09-13T06:11:02.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb40b34d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4040b1460 0x7fb404138b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb40b34d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4040b2e90 0x7fb4041f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb40b34d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb404144d70 0x7fb4040ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb40b34d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040aeb70 con 0x7fb4040b1460 2023-09-13T06:11:02.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb40b34d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040adef0 con 0x7fb404144d70 2023-09-13T06:11:02.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb40b34d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040ae1d0 con 0x7fb4040b2e90 2023-09-13T06:11:02.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb4090e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4040b1460 0x7fb404138b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb4090e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4040b1460 0x7fb404138b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52176/0 (socket says 172.21.15.130:52176) 2023-09-13T06:11:02.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb4090e9640 1 -- 172.21.15.130:0/3787611871 learned_addr learned my addr 172.21.15.130:0/3787611871 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:02.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb4088e8640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4040b2e90 0x7fb4041f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb4098ea640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb404144d70 0x7fb4040ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb4090e9640 1 -- 172.21.15.130:0/3787611871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4040b2e90 msgr2=0x7fb4041f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb4090e9640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4040b2e90 0x7fb4041f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb4090e9640 1 -- 172.21.15.130:0/3787611871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb404144d70 msgr2=0x7fb4040ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb4090e9640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb404144d70 0x7fb4040ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb4090e9640 1 -- 172.21.15.130:0/3787611871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc009b30 con 0x7fb4040b1460 2023-09-13T06:11:02.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb4090e9640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4040b1460 0x7fb404138b40 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c3c0 tx=0x7fb40000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:02.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb3f9ffb640 1 -- 172.21.15.130:0/3787611871 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000052d0 con 0x7fb4040b1460 2023-09-13T06:11:02.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb3f9ffb640 1 -- 172.21.15.130:0/3787611871 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb400005430 con 0x7fb4040b1460 2023-09-13T06:11:02.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb3f9ffb640 1 -- 172.21.15.130:0/3787611871 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400003840 con 0x7fb4040b1460 2023-09-13T06:11:02.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb40b34d640 1 -- 172.21.15.130:0/3787611871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4040ae4b0 con 0x7fb4040b1460 2023-09-13T06:11:02.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb40b34d640 1 -- 172.21.15.130:0/3787611871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb404139080 con 0x7fb4040b1460 2023-09-13T06:11:02.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb40b34d640 1 -- 172.21.15.130:0/3787611871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4040aee90 con 0x7fb4040b1460 2023-09-13T06:11:02.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.033+0000 7fb3f9ffb640 1 -- 172.21.15.130:0/3787611871 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb4000039a0 con 0x7fb4040b1460 2023-09-13T06:11:02.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.037+0000 7fb3f9ffb640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3e8065b20 0x7fb3e8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.037+0000 7fb3f9ffb640 1 -- 172.21.15.130:0/3787611871 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb400082820 con 0x7fb4040b1460 2023-09-13T06:11:02.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.037+0000 7fb4088e8640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3e8065b20 0x7fb3e8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.037+0000 7fb3f9ffb640 1 -- 172.21.15.130:0/3787611871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7fb3e806d710 con 0x7fb4040b1460 2023-09-13T06:11:02.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.037+0000 7fb4088e8640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3e8065b20 0x7fb3e8067fe0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb40406bba0 tx=0x7fb3f4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:02.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.041+0000 7fb3f9ffb640 1 -- 172.21.15.130:0/3787611871 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb400017020 con 0x7fb4040b1460 2023-09-13T06:11:02.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 -- 172.21.15.130:0/3787611871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4040618a0 con 0x7fb4040b1460 2023-09-13T06:11:02.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb3f9ffb640 1 -- 172.21.15.130:0/3787611871 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4040aee90 con 0x7fb4040b1460 2023-09-13T06:11:02.189 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:11:02.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 -- 172.21.15.130:0/3787611871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3e8065b20 msgr2=0x7fb3e8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3e8065b20 0x7fb3e8067fe0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb40406bba0 tx=0x7fb3f4009190 comp rx=0 tx=0).stop 2023-09-13T06:11:02.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 -- 172.21.15.130:0/3787611871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4040b1460 msgr2=0x7fb404138b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4040b1460 0x7fb404138b40 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c3c0 tx=0x7fb40000c880 comp rx=0 tx=0).stop 2023-09-13T06:11:02.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 -- 172.21.15.130:0/3787611871 shutdown_connections 2023-09-13T06:11:02.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb3e8065b20 0x7fb3e8067fe0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb404144d70 0x7fb4040ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb4040b2e90 0x7fb4041f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 --2- 172.21.15.130:0/3787611871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4040b1460 0x7fb404138b40 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 -- 172.21.15.130:0/3787611871 >> 172.21.15.130:0/3787611871 conn(0x7fb404065990 msgr2=0x7fb4040ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:02.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 -- 172.21.15.130:0/3787611871 shutdown_connections 2023-09-13T06:11:02.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.189+0000 7fb40b34d640 1 -- 172.21.15.130:0/3787611871 wait complete. 2023-09-13T06:11:02.210 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:11:02.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.349+0000 7f9124710640 1 Processor -- start 2023-09-13T06:11:02.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.349+0000 7f9124710640 1 -- start start 2023-09-13T06:11:02.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.349+0000 7f9124710640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f911c144d70 0x7f911c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.349+0000 7f9124710640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f911c0b1b70 0x7f911c0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.349+0000 7f9124710640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c0b3120 con 0x7f911c0b2780 2023-09-13T06:11:02.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.349+0000 7f9124710640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c0b2430 con 0x7f911c0b1b70 2023-09-13T06:11:02.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.349+0000 7f9124710640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c0cedb0 con 0x7f911c144d70 2023-09-13T06:11:02.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f9122cad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f911c0b1b70 0x7f911c0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f9122cad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f911c0b1b70 0x7f911c0b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52178/0 (socket says 172.21.15.130:52178) 2023-09-13T06:11:02.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f9122cad640 1 -- 172.21.15.130:0/3473585249 learned_addr learned my addr 172.21.15.130:0/3473585249 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:02.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f91224ac640 1 --2- 172.21.15.130:0/3473585249 >> v2:172.21.15.164:3300/0 conn(0x7f911c144d70 0x7f911c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f9122cad640 1 -- 172.21.15.130:0/3473585249 >> v2:172.21.15.164:3300/0 conn(0x7f911c144d70 msgr2=0x7f911c0ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:02.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f9122cad640 1 --2- 172.21.15.130:0/3473585249 >> v2:172.21.15.164:3300/0 conn(0x7f911c144d70 0x7f911c0ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f9122cad640 1 -- 172.21.15.130:0/3473585249 >> v1:172.21.15.164:6789/0 conn(0x7f911c0b2780 legacy=0x7f911c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f9122cad640 1 -- 172.21.15.130:0/3473585249 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c0b2150 con 0x7f911c0b1b70 2023-09-13T06:11:02.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f9122cad640 1 --2- 172.21.15.130:0/3473585249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f911c0b1b70 0x7f911c0b2be0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f911c0cff90 tx=0x7f911401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580c158622836d4b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:02.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f91214aa640 1 -- 172.21.15.130:0/3473585249 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140a5780 con 0x7f911c0b1b70 2023-09-13T06:11:02.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f91214aa640 1 -- 172.21.15.130:0/3473585249 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91140a58e0 con 0x7f911c0b1b70 2023-09-13T06:11:02.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.353+0000 7f91214aa640 1 -- 172.21.15.130:0/3473585249 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140a5c70 con 0x7f911c0b1b70 2023-09-13T06:11:02.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 -- 172.21.15.130:0/3473585249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f911c0b1b70 msgr2=0x7f911c0b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 --2- 172.21.15.130:0/3473585249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f911c0b1b70 0x7f911c0b2be0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f911c0cff90 tx=0x7f911401c9d0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 -- 172.21.15.130:0/3473585249 shutdown_connections 2023-09-13T06:11:02.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 --2- 172.21.15.130:0/3473585249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f911c0b1b70 0x7f911c0b2be0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 --2- 172.21.15.130:0/3473585249 >> v2:172.21.15.164:3300/0 conn(0x7f911c144d70 0x7f911c0ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 -- 172.21.15.130:0/3473585249 >> 172.21.15.130:0/3473585249 conn(0x7f911c065990 msgr2=0x7f911c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:02.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 -- 172.21.15.130:0/3473585249 shutdown_connections 2023-09-13T06:11:02.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 -- 172.21.15.130:0/3473585249 wait complete. 2023-09-13T06:11:02.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 Processor -- start 2023-09-13T06:11:02.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 -- start start 2023-09-13T06:11:02.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f911c0b1b70 0x7f911c0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f911c0b2780 0x7f911c13bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f911c144d70 0x7f911c15ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0cda20 con 0x7f911c144d70 2023-09-13T06:11:02.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0cbe70 con 0x7f911c0b1b70 2023-09-13T06:11:02.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9124710640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0cc150 con 0x7f911c0b2780 2023-09-13T06:11:02.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9122cad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f911c144d70 0x7f911c15ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9122cad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f911c144d70 0x7f911c15ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52194/0 (socket says 172.21.15.130:52194) 2023-09-13T06:11:02.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9122cad640 1 -- 172.21.15.130:0/4146578700 learned_addr learned my addr 172.21.15.130:0/4146578700 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:02.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9121cab640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f911c0b2780 0x7f911c13bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f91224ac640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f911c0b1b70 0x7f911c0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.357+0000 7f9122cad640 1 -- 172.21.15.130:0/4146578700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f911c0b2780 msgr2=0x7f911c13bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9122cad640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f911c0b2780 0x7f911c13bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9122cad640 1 -- 172.21.15.130:0/4146578700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f911c0b1b70 msgr2=0x7f911c0cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9122cad640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f911c0b1b70 0x7f911c0cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9122cad640 1 -- 172.21.15.130:0/4146578700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114009b30 con 0x7f911c144d70 2023-09-13T06:11:02.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f91224ac640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f911c0b1b70 0x7f911c0cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:02.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9122cad640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f911c144d70 0x7f911c15ac80 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f91140af040 tx=0x7f9114019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:02.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9112ffd640 1 -- 172.21.15.130:0/4146578700 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140b8670 con 0x7f911c144d70 2023-09-13T06:11:02.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9112ffd640 1 -- 172.21.15.130:0/4146578700 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91140b87d0 con 0x7f911c144d70 2023-09-13T06:11:02.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9112ffd640 1 -- 172.21.15.130:0/4146578700 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140b8b80 con 0x7f911c144d70 2023-09-13T06:11:02.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9124710640 1 -- 172.21.15.130:0/4146578700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911c0cc430 con 0x7f911c144d70 2023-09-13T06:11:02.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9124710640 1 -- 172.21.15.130:0/4146578700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c0cc9f0 con 0x7f911c144d70 2023-09-13T06:11:02.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9124710640 1 -- 172.21.15.130:0/4146578700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c0618a0 con 0x7f911c144d70 2023-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9112ffd640 1 -- 172.21.15.130:0/4146578700 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f91140b8ce0 con 0x7f911c144d70 2023-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9112ffd640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9100065b20 0x7f9100067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9112ffd640 1 -- 172.21.15.130:0/4146578700 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f911411ea60 con 0x7f911c144d70 2023-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f91224ac640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9100065b20 0x7f9100067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.361+0000 7f9112ffd640 1 -- 172.21.15.130:0/4146578700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f910006d710 con 0x7f911c144d70 2023-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.365+0000 7f91224ac640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9100065b20 0x7f9100067fe0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9118009b10 tx=0x7f9118008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.365+0000 7f9112ffd640 1 -- 172.21.15.130:0/4146578700 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f91140ec4b0 con 0x7f911c144d70 2023-09-13T06:11:02.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 -- 172.21.15.130:0/4146578700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f911c13c0d0 con 0x7f911c144d70 2023-09-13T06:11:02.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9112ffd640 1 -- 172.21.15.130:0/4146578700 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v159) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91140efad0 con 0x7f911c144d70 2023-09-13T06:11:02.518 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:11:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 -- 172.21.15.130:0/4146578700 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9100065b20 msgr2=0x7f9100067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9100065b20 0x7f9100067fe0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9118009b10 tx=0x7f9118008040 comp rx=0 tx=0).stop 2023-09-13T06:11:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 -- 172.21.15.130:0/4146578700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f911c144d70 msgr2=0x7f911c15ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f911c144d70 0x7f911c15ac80 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f91140af040 tx=0x7f9114019770 comp rx=0 tx=0).stop 2023-09-13T06:11:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 -- 172.21.15.130:0/4146578700 shutdown_connections 2023-09-13T06:11:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9100065b20 0x7f9100067fe0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f911c144d70 0x7f911c15ac80 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f911c0b2780 0x7f911c13bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 --2- 172.21.15.130:0/4146578700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f911c0b1b70 0x7f911c0cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 -- 172.21.15.130:0/4146578700 >> 172.21.15.130:0/4146578700 conn(0x7f911c065990 msgr2=0x7f911c0b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:02.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 -- 172.21.15.130:0/4146578700 shutdown_connections 2023-09-13T06:11:02.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.517+0000 7f9124710640 1 -- 172.21.15.130:0/4146578700 wait complete. 2023-09-13T06:11:02.538 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:11:02.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.677+0000 7fa47860b640 1 Processor -- start 2023-09-13T06:11:02.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.677+0000 7fa47860b640 1 -- start start 2023-09-13T06:11:02.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa47860b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa47015b130 0x7fa4700cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa47860b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4700ce180 0x7fa47015b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa47860b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4700ce980 con 0x7fa4700b04a0 2023-09-13T06:11:02.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa47860b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4700cec60 con 0x7fa4700ce180 2023-09-13T06:11:02.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa47860b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47006c640 con 0x7fa47015b130 2023-09-13T06:11:02.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa475ba6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4700ce180 0x7fa47015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa476ba8640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa4700b04a0 0x7fa47006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38390/0 (socket says 172.21.15.130:38390) 2023-09-13T06:11:02.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa476ba8640 1 -- 172.21.15.130:0/3154735483 learned_addr learned my addr 172.21.15.130:0/3154735483 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:02.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa4763a7640 1 --2- 172.21.15.130:0/3154735483 >> v2:172.21.15.164:3300/0 conn(0x7fa47015b130 0x7fa4700cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa475ba6640 1 -- 172.21.15.130:0/3154735483 >> v2:172.21.15.164:3300/0 conn(0x7fa47015b130 msgr2=0x7fa4700cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:02.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa475ba6640 1 --2- 172.21.15.130:0/3154735483 >> v2:172.21.15.164:3300/0 conn(0x7fa47015b130 0x7fa4700cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa475ba6640 1 -- 172.21.15.130:0/3154735483 >> v1:172.21.15.130:6789/0 conn(0x7fa4700b04a0 legacy=0x7fa47006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa475ba6640 1 -- 172.21.15.130:0/3154735483 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47006c920 con 0x7fa4700ce180 2023-09-13T06:11:02.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.681+0000 7fa4753a5640 1 -- 172.21.15.130:0/3154735483 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077354990 0 0) 0x7fa4700ce980 con 0x7fa4700b04a0 2023-09-13T06:11:02.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa475ba6640 1 --2- 172.21.15.130:0/3154735483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4700ce180 0x7fa47015b510 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa4700b1040 tx=0x7fa46001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eff24692563fb73 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:02.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa4753a5640 1 -- 172.21.15.130:0/3154735483 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600a8050 con 0x7fa4700ce180 2023-09-13T06:11:02.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa4753a5640 1 -- 172.21.15.130:0/3154735483 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4600ac5f0 con 0x7fa4700ce180 2023-09-13T06:11:02.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa4753a5640 1 -- 172.21.15.130:0/3154735483 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600ac980 con 0x7fa4700ce180 2023-09-13T06:11:02.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa47860b640 1 -- 172.21.15.130:0/3154735483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4700ce180 msgr2=0x7fa47015b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa47860b640 1 --2- 172.21.15.130:0/3154735483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4700ce180 0x7fa47015b510 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa4700b1040 tx=0x7fa46001c460 comp rx=0 tx=0).stop 2023-09-13T06:11:02.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa47860b640 1 -- 172.21.15.130:0/3154735483 shutdown_connections 2023-09-13T06:11:02.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa47860b640 1 --2- 172.21.15.130:0/3154735483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4700ce180 0x7fa47015b510 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa47860b640 1 --2- 172.21.15.130:0/3154735483 >> v2:172.21.15.164:3300/0 conn(0x7fa47015b130 0x7fa4700cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa47860b640 1 -- 172.21.15.130:0/3154735483 >> 172.21.15.130:0/3154735483 conn(0x7fa470065990 msgr2=0x7fa470065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:02.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa47860b640 1 -- 172.21.15.130:0/3154735483 shutdown_connections 2023-09-13T06:11:02.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa47860b640 1 -- 172.21.15.130:0/3154735483 wait complete. 2023-09-13T06:11:02.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa47860b640 1 Processor -- start 2023-09-13T06:11:02.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.685+0000 7fa47860b640 1 -- start start 2023-09-13T06:11:02.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa47860b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4700b04a0 0x7fa470149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa47860b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4700ce180 0x7fa47014b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa47860b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa47015b130 0x7fa470147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa47860b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa470149960 con 0x7fa47015b130 2023-09-13T06:11:02.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa47860b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700ad1a0 con 0x7fa4700b04a0 2023-09-13T06:11:02.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa47860b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700afc50 con 0x7fa4700ce180 2023-09-13T06:11:02.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa476ba8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa47015b130 0x7fa470147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa4763a7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4700b04a0 0x7fa470149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa476ba8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa47015b130 0x7fa470147420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52202/0 (socket says 172.21.15.130:52202) 2023-09-13T06:11:02.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa476ba8640 1 -- 172.21.15.130:0/1585356047 learned_addr learned my addr 172.21.15.130:0/1585356047 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:02.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa475ba6640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4700ce180 0x7fa47014b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa476ba8640 1 -- 172.21.15.130:0/1585356047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4700ce180 msgr2=0x7fa47014b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa476ba8640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4700ce180 0x7fa47014b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa476ba8640 1 -- 172.21.15.130:0/1585356047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4700b04a0 msgr2=0x7fa470149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa476ba8640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4700b04a0 0x7fa470149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa476ba8640 1 -- 172.21.15.130:0/1585356047 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa460009420 con 0x7fa47015b130 2023-09-13T06:11:02.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa476ba8640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa47015b130 0x7fa470147420 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa468001570 tx=0x7fa46800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:02.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa466ffd640 1 -- 172.21.15.130:0/1585356047 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800cea0 con 0x7fa47015b130 2023-09-13T06:11:02.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa466ffd640 1 -- 172.21.15.130:0/1585356047 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46800a5e0 con 0x7fa47015b130 2023-09-13T06:11:02.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa47860b640 1 -- 172.21.15.130:0/1585356047 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4700aff30 con 0x7fa47015b130 2023-09-13T06:11:02.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa466ffd640 1 -- 172.21.15.130:0/1585356047 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800a990 con 0x7fa47015b130 2023-09-13T06:11:02.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa47860b640 1 -- 172.21.15.130:0/1585356047 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa470153160 con 0x7fa47015b130 2023-09-13T06:11:02.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa47860b640 1 -- 172.21.15.130:0/1585356047 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa470153380 con 0x7fa47015b130 2023-09-13T06:11:02.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.689+0000 7fa466ffd640 1 -- 172.21.15.130:0/1585356047 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa46800aaf0 con 0x7fa47015b130 2023-09-13T06:11:02.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.693+0000 7fa466ffd640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa454065b20 0x7fa454067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:02.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.693+0000 7fa466ffd640 1 -- 172.21.15.130:0/1585356047 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa4680827e0 con 0x7fa47015b130 2023-09-13T06:11:02.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.693+0000 7fa4763a7640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa454065b20 0x7fa454067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:02.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.693+0000 7fa466ffd640 1 -- 172.21.15.130:0/1585356047 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7fa45406d710 con 0x7fa47015b130 2023-09-13T06:11:02.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.693+0000 7fa4763a7640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa454065b20 0x7fa454067fe0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa47015aaa0 tx=0x7fa46c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:02.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.697+0000 7fa466ffd640 1 -- 172.21.15.130:0/1585356047 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa468018070 con 0x7fa47015b130 2023-09-13T06:11:02.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.877+0000 7fa47860b640 1 -- 172.21.15.130:0/1585356047 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4700618a0 con 0x7fa47015b130 2023-09-13T06:11:02.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.877+0000 7fa466ffd640 1 -- 172.21.15.130:0/1585356047 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fa4680501a0 con 0x7fa47015b130 2023-09-13T06:11:02.880 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:02.880 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2638049185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2638049185},{"type":"v1","addr":"172.21.15.164:6834","nonce":2638049185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/4101999538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4101999538},{"type":"v1","addr":"172.21.15.130:6835","nonce":4101999538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1691911082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1691911082},{"type":"v1","addr":"172.21.15.130:6837","nonce":1691911082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:08:42.026268+0000","modified":"2023-09-13T06:08:45.060479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2618060608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2618060608},{"type":"v1","addr":"172.21.15.164:6835","nonce":2618060608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-09-13T06:11:02.881 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 76 2023-09-13T06:11:02.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 -- 172.21.15.130:0/1585356047 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa454065b20 msgr2=0x7fa454067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa454065b20 0x7fa454067fe0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa47015aaa0 tx=0x7fa46c009190 comp rx=0 tx=0).stop 2023-09-13T06:11:02.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 -- 172.21.15.130:0/1585356047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa47015b130 msgr2=0x7fa470147420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:02.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa47015b130 0x7fa470147420 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa468001570 tx=0x7fa46800cc50 comp rx=0 tx=0).stop 2023-09-13T06:11:02.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 -- 172.21.15.130:0/1585356047 shutdown_connections 2023-09-13T06:11:02.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa454065b20 0x7fa454067fe0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa47015b130 0x7fa470147420 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4700ce180 0x7fa47014b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 --2- 172.21.15.130:0/1585356047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4700b04a0 0x7fa470149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:02.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 -- 172.21.15.130:0/1585356047 >> 172.21.15.130:0/1585356047 conn(0x7fa470065990 msgr2=0x7fa4700b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:02.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 -- 172.21.15.130:0/1585356047 shutdown_connections 2023-09-13T06:11:02.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:02.881+0000 7fa47860b640 1 -- 172.21.15.130:0/1585356047 wait complete. 2023-09-13T06:11:02.900 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:11:03.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.037+0000 7fa7154ec640 1 Processor -- start 2023-09-13T06:11:03.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.037+0000 7fa7154ec640 1 -- start start 2023-09-13T06:11:03.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa7154ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa7100d1090 0x7fa71015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa7154ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7100b63c0 con 0x7fa7100d1750 2023-09-13T06:11:03.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa7154ec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7100d0c20 con 0x7fa710146f30 2023-09-13T06:11:03.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa7154ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71015dea0 con 0x7fa7100d1090 2023-09-13T06:11:03.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa70effd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa7100d1750 0x7fa710146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38396/0 (socket says 172.21.15.130:38396) 2023-09-13T06:11:03.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa70effd640 1 -- 172.21.15.130:0/291012422 learned_addr learned my addr 172.21.15.130:0/291012422 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:03.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa70e7fc640 1 --2- 172.21.15.130:0/291012422 >> v2:172.21.15.130:3300/0 conn(0x7fa7100d1090 0x7fa71015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa70dffb640 1 -- 172.21.15.130:0/291012422 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507210530 0 0) 0x7fa7100b63c0 con 0x7fa7100d1750 2023-09-13T06:11:03.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa70dffb640 1 -- 172.21.15.130:0/291012422 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f8003530 con 0x7fa7100d1750 2023-09-13T06:11:03.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa70e7fc640 1 -- 172.21.15.130:0/291012422 >> v1:172.21.15.164:6789/0 conn(0x7fa710146f30 legacy=0x7fa7100b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa70e7fc640 1 -- 172.21.15.130:0/291012422 >> v1:172.21.15.130:6789/0 conn(0x7fa7100d1750 legacy=0x7fa710146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.041+0000 7fa70e7fc640 1 -- 172.21.15.130:0/291012422 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7100b6610 con 0x7fa7100d1090 2023-09-13T06:11:03.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa70e7fc640 1 --2- 172.21.15.130:0/291012422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7100d1090 0x7fa71015d960 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fa7040097c0 tx=0x7fa70401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b6650e44720ae8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:03.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa70dffb640 1 -- 172.21.15.130:0/291012422 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7040ac620 con 0x7fa7100d1090 2023-09-13T06:11:03.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa70dffb640 1 -- 172.21.15.130:0/291012422 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7040ac780 con 0x7fa7100d1090 2023-09-13T06:11:03.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa70dffb640 1 -- 172.21.15.130:0/291012422 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7040acb10 con 0x7fa7100d1090 2023-09-13T06:11:03.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa7154ec640 1 -- 172.21.15.130:0/291012422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7100d1090 msgr2=0x7fa71015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa7154ec640 1 --2- 172.21.15.130:0/291012422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7100d1090 0x7fa71015d960 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fa7040097c0 tx=0x7fa70401c3c0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa7154ec640 1 -- 172.21.15.130:0/291012422 shutdown_connections 2023-09-13T06:11:03.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa7154ec640 1 --2- 172.21.15.130:0/291012422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7100d1090 0x7fa71015d960 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa7154ec640 1 -- 172.21.15.130:0/291012422 >> 172.21.15.130:0/291012422 conn(0x7fa71006f170 msgr2=0x7fa71006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:03.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa7154ec640 1 -- 172.21.15.130:0/291012422 shutdown_connections 2023-09-13T06:11:03.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa7154ec640 1 -- 172.21.15.130:0/291012422 wait complete. 2023-09-13T06:11:03.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa7154ec640 1 Processor -- start 2023-09-13T06:11:03.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.045+0000 7fa7154ec640 1 -- start start 2023-09-13T06:11:03.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa7154ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7100d1090 0x7fa710152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa7154ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7100d1750 0x7fa7101590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa7154ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa710146f30 0x7fa710156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa7154ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71015c900 con 0x7fa7100d1090 2023-09-13T06:11:03.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa7154ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7101583b0 con 0x7fa7100d1750 2023-09-13T06:11:03.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa7154ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7101577a0 con 0x7fa710146f30 2023-09-13T06:11:03.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa70effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7100d1090 0x7fa710152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa70effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7100d1090 0x7fa710152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52220/0 (socket says 172.21.15.130:52220) 2023-09-13T06:11:03.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa70effd640 1 -- 172.21.15.130:0/284459242 learned_addr learned my addr 172.21.15.130:0/284459242 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:03.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa70e7fc640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7100d1750 0x7fa7101590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa70f7fe640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa710146f30 0x7fa710156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa70effd640 1 -- 172.21.15.130:0/284459242 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa710146f30 msgr2=0x7fa710156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa70effd640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa710146f30 0x7fa710156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa70effd640 1 -- 172.21.15.130:0/284459242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7100d1750 msgr2=0x7fa7101590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa70effd640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7100d1750 0x7fa7101590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa70effd640 1 -- 172.21.15.130:0/284459242 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa704009420 con 0x7fa7100d1090 2023-09-13T06:11:03.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa70effd640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7100d1090 0x7fa710152890 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fa70000c4d0 tx=0x7fa70000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:03.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa6f77fe640 1 -- 172.21.15.130:0/284459242 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700005cf0 con 0x7fa7100d1090 2023-09-13T06:11:03.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa6f77fe640 1 -- 172.21.15.130:0/284459242 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa700005e50 con 0x7fa7100d1090 2023-09-13T06:11:03.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa6f77fe640 1 -- 172.21.15.130:0/284459242 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700007270 con 0x7fa7100d1090 2023-09-13T06:11:03.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa7154ec640 1 -- 172.21.15.130:0/284459242 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa710157a80 con 0x7fa7100d1090 2023-09-13T06:11:03.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa7154ec640 1 -- 172.21.15.130:0/284459242 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa710158040 con 0x7fa7100d1090 2023-09-13T06:11:03.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa7154ec640 1 -- 172.21.15.130:0/284459242 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7100618a0 con 0x7fa7100d1090 2023-09-13T06:11:03.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.049+0000 7fa6f77fe640 1 -- 172.21.15.130:0/284459242 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa7000073d0 con 0x7fa7100d1090 2023-09-13T06:11:03.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.053+0000 7fa6f77fe640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa6fc065b20 0x7fa6fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.053+0000 7fa6f77fe640 1 -- 172.21.15.130:0/284459242 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa700082900 con 0x7fa7100d1090 2023-09-13T06:11:03.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.053+0000 7fa70e7fc640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa6fc065b20 0x7fa6fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.053+0000 7fa6f77fe640 1 -- 172.21.15.130:0/284459242 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7fa6fc06d710 con 0x7fa7100d1090 2023-09-13T06:11:03.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.053+0000 7fa70e7fc640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa6fc065b20 0x7fa6fc067fe0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa7040ae000 tx=0x7fa704008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:03.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.057+0000 7fa6f77fe640 1 -- 172.21.15.130:0/284459242 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa700017020 con 0x7fa7100d1090 2023-09-13T06:11:03.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.201+0000 7fa7154ec640 1 -- 172.21.15.130:0/284459242 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7100b86c0 con 0x7fa7100d1090 2023-09-13T06:11:03.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa6f77fe640 1 -- 172.21.15.130:0/284459242 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16684 (secure 0 0 0) 0x7fa700082070 con 0x7fa7100d1090 2023-09-13T06:11:03.204 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:03.205 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":159,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:10:17.438747+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:08:40.183838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-09-13T06:08:41.020446+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.12","mappings":[{"from":2,"to":0}]},{"pgid":"19.23","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:11:03.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 -- 172.21.15.130:0/284459242 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa6fc065b20 msgr2=0x7fa6fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa6fc065b20 0x7fa6fc067fe0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa7040ae000 tx=0x7fa704008040 comp rx=0 tx=0).stop 2023-09-13T06:11:03.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 -- 172.21.15.130:0/284459242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7100d1090 msgr2=0x7fa710152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7100d1090 0x7fa710152890 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fa70000c4d0 tx=0x7fa70000c990 comp rx=0 tx=0).stop 2023-09-13T06:11:03.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 -- 172.21.15.130:0/284459242 shutdown_connections 2023-09-13T06:11:03.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa6fc065b20 0x7fa6fc067fe0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa7100d1750 0x7fa7101590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa710146f30 0x7fa710156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 --2- 172.21.15.130:0/284459242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7100d1090 0x7fa710152890 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 -- 172.21.15.130:0/284459242 >> 172.21.15.130:0/284459242 conn(0x7fa71006f170 msgr2=0x7fa7100cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:03.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 -- 172.21.15.130:0/284459242 shutdown_connections 2023-09-13T06:11:03.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.205+0000 7fa7154ec640 1 -- 172.21.15.130:0/284459242 wait complete. 2023-09-13T06:11:03.226 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:11:03.226 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:11:03.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fff40640 1 Processor -- start 2023-09-13T06:11:03.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fff40640 1 -- start start 2023-09-13T06:11:03.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fff40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43f8147b50 0x7f43f81652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fff40640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f43f8147f30 0x7f43f8148410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fff40640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f806b5e0 con 0x7f43f8148950 2023-09-13T06:11:03.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fff40640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f806b8c0 con 0x7f43f8147f30 2023-09-13T06:11:03.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fff40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f81657f0 con 0x7f43f8147b50 2023-09-13T06:11:03.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fd4db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f43f8147f30 0x7f43f8148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fd4db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f43f8147f30 0x7f43f8148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52234/0 (socket says 172.21.15.130:52234) 2023-09-13T06:11:03.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fd4db640 1 -- 172.21.15.130:0/3645361805 learned_addr learned my addr 172.21.15.130:0/3645361805 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:03.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fdcdc640 1 --2- 172.21.15.130:0/3645361805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43f8147b50 0x7f43f81652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fd4db640 1 -- 172.21.15.130:0/3645361805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43f8147b50 msgr2=0x7f43f81652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:03.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fd4db640 1 --2- 172.21.15.130:0/3645361805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43f8147b50 0x7f43f81652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fd4db640 1 -- 172.21.15.130:0/3645361805 >> v1:172.21.15.164:6789/0 conn(0x7f43f8148950 legacy=0x7f43f806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.365+0000 7f43fd4db640 1 -- 172.21.15.130:0/3645361805 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f8165ac0 con 0x7f43f8147f30 2023-09-13T06:11:03.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fd4db640 1 --2- 172.21.15.130:0/3645361805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43f8147f30 0x7f43f8148410 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009870 tx=0x7f43e801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42d2719f01305a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:03.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fccda640 1 -- 172.21.15.130:0/3645361805 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80aa670 con 0x7f43f8147f30 2023-09-13T06:11:03.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fccda640 1 -- 172.21.15.130:0/3645361805 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e80aa7d0 con 0x7f43f8147f30 2023-09-13T06:11:03.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fccda640 1 -- 172.21.15.130:0/3645361805 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80aab60 con 0x7f43f8147f30 2023-09-13T06:11:03.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fff40640 1 -- 172.21.15.130:0/3645361805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43f8147f30 msgr2=0x7f43f8148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fff40640 1 --2- 172.21.15.130:0/3645361805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43f8147f30 0x7f43f8148410 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009870 tx=0x7f43e801c510 comp rx=0 tx=0).stop 2023-09-13T06:11:03.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fff40640 1 -- 172.21.15.130:0/3645361805 shutdown_connections 2023-09-13T06:11:03.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fff40640 1 --2- 172.21.15.130:0/3645361805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43f8147f30 0x7f43f8148410 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fff40640 1 --2- 172.21.15.130:0/3645361805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43f8147b50 0x7f43f81652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fff40640 1 -- 172.21.15.130:0/3645361805 >> 172.21.15.130:0/3645361805 conn(0x7f43f8065990 msgr2=0x7f43f8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:03.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fff40640 1 -- 172.21.15.130:0/3645361805 shutdown_connections 2023-09-13T06:11:03.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.369+0000 7f43fff40640 1 -- 172.21.15.130:0/3645361805 wait complete. 2023-09-13T06:11:03.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fff40640 1 Processor -- start 2023-09-13T06:11:03.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fff40640 1 -- start start 2023-09-13T06:11:03.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fff40640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43f8147b50 0x7f43f813ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fff40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43f8147f30 0x7f43f8146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fff40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43f8148950 0x7f43f8146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fff40640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f81629b0 con 0x7f43f8147f30 2023-09-13T06:11:03.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fff40640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8160f30 con 0x7f43f8147b50 2023-09-13T06:11:03.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fff40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8161210 con 0x7f43f8148950 2023-09-13T06:11:03.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fd4db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43f8147f30 0x7f43f8146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fd4db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43f8147f30 0x7f43f8146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52246/0 (socket says 172.21.15.130:52246) 2023-09-13T06:11:03.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fd4db640 1 -- 172.21.15.130:0/4070030491 learned_addr learned my addr 172.21.15.130:0/4070030491 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:03.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fdcdc640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43f8147b50 0x7f43f813ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fe4dd640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43f8148950 0x7f43f8146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fd4db640 1 -- 172.21.15.130:0/4070030491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43f8148950 msgr2=0x7f43f8146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fd4db640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43f8148950 0x7f43f8146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fd4db640 1 -- 172.21.15.130:0/4070030491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43f8147b50 msgr2=0x7f43f813ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fd4db640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43f8147b50 0x7f43f813ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fd4db640 1 -- 172.21.15.130:0/4070030491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e80094d0 con 0x7f43f8147f30 2023-09-13T06:11:03.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fdcdc640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43f8147b50 0x7f43f813ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:03.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fd4db640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43f8147f30 0x7f43f8146300 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f43e80ac040 tx=0x7f43e801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:03.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43ee7fc640 1 -- 172.21.15.130:0/4070030491 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80b3800 con 0x7f43f8147f30 2023-09-13T06:11:03.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43ee7fc640 1 -- 172.21.15.130:0/4070030491 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e80b3980 con 0x7f43f8147f30 2023-09-13T06:11:03.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fff40640 1 -- 172.21.15.130:0/4070030491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f8162360 con 0x7f43f8147f30 2023-09-13T06:11:03.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43ee7fc640 1 -- 172.21.15.130:0/4070030491 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80b3d30 con 0x7f43f8147f30 2023-09-13T06:11:03.379 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fff40640 1 -- 172.21.15.130:0/4070030491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f813cf40 con 0x7f43f8147f30 2023-09-13T06:11:03.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.373+0000 7f43fff40640 1 -- 172.21.15.130:0/4070030491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f8162b20 con 0x7f43f8147f30 2023-09-13T06:11:03.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.377+0000 7f43ee7fc640 1 -- 172.21.15.130:0/4070030491 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f43e80c6390 con 0x7f43f8147f30 2023-09-13T06:11:03.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.377+0000 7f43ee7fc640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43dc065b20 0x7f43dc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.377+0000 7f43ee7fc640 1 -- 172.21.15.130:0/4070030491 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f43e811e0e0 con 0x7f43f8147f30 2023-09-13T06:11:03.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.377+0000 7f43fdcdc640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43dc065b20 0x7f43dc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.377+0000 7f43ee7fc640 1 -- 172.21.15.130:0/4070030491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f43dc06d710 con 0x7f43f8147f30 2023-09-13T06:11:03.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.377+0000 7f43fdcdc640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43dc065b20 0x7f43dc067fe0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f43f4007a70 tx=0x7f43f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:03.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.381+0000 7f43ee7fc640 1 -- 172.21.15.130:0/4070030491 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f43e80eb8c0 con 0x7f43f8147f30 2023-09-13T06:11:03.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.561+0000 7f43fff40640 1 -- 172.21.15.130:0/4070030491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43f80618a0 con 0x7f43f8147f30 2023-09-13T06:11:03.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.561+0000 7f43ee7fc640 1 -- 172.21.15.130:0/4070030491 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f43e80eeee0 con 0x7f43f8147f30 2023-09-13T06:11:03.564 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:03.564 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2638049185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2638049185},{"type":"v1","addr":"172.21.15.164:6834","nonce":2638049185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/4101999538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4101999538},{"type":"v1","addr":"172.21.15.130:6835","nonce":4101999538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1691911082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1691911082},{"type":"v1","addr":"172.21.15.130:6837","nonce":1691911082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:08:42.026268+0000","modified":"2023-09-13T06:08:45.060479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2618060608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2618060608},{"type":"v1","addr":"172.21.15.164:6835","nonce":2618060608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-09-13T06:11:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 76 2023-09-13T06:11:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 -- 172.21.15.130:0/4070030491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43dc065b20 msgr2=0x7f43dc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43dc065b20 0x7f43dc067fe0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f43f4007a70 tx=0x7f43f4008040 comp rx=0 tx=0).stop 2023-09-13T06:11:03.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 -- 172.21.15.130:0/4070030491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43f8147f30 msgr2=0x7f43f8146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43f8147f30 0x7f43f8146300 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f43e80ac040 tx=0x7f43e801ad50 comp rx=0 tx=0).stop 2023-09-13T06:11:03.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 -- 172.21.15.130:0/4070030491 shutdown_connections 2023-09-13T06:11:03.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f43dc065b20 0x7f43dc067fe0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43f8148950 0x7f43f8146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43f8147f30 0x7f43f8146300 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 --2- 172.21.15.130:0/4070030491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43f8147b50 0x7f43f813ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 -- 172.21.15.130:0/4070030491 >> 172.21.15.130:0/4070030491 conn(0x7f43f8065990 msgr2=0x7f43f8070450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:03.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 -- 172.21.15.130:0/4070030491 shutdown_connections 2023-09-13T06:11:03.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.565+0000 7f43fff40640 1 -- 172.21.15.130:0/4070030491 wait complete. 2023-09-13T06:11:03.585 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:11:03.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e7066d640 1 Processor -- start 2023-09-13T06:11:03.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e7066d640 1 -- start start 2023-09-13T06:11:03.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e7066d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e680d1090 0x7f4e6815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e7066d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e680b63c0 con 0x7f4e68146f30 2023-09-13T06:11:03.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e7066d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e680d0c20 con 0x7f4e680d1750 2023-09-13T06:11:03.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e7066d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6815dea0 con 0x7f4e680d1090 2023-09-13T06:11:03.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e6ec0a640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4e68146f30 0x7f4e680b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38400/0 (socket says 172.21.15.130:38400) 2023-09-13T06:11:03.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e6ec0a640 1 -- 172.21.15.130:0/3032605606 learned_addr learned my addr 172.21.15.130:0/3032605606 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:03.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e6dc08640 1 --2- 172.21.15.130:0/3032605606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e680d1090 0x7f4e6815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e6d407640 1 -- 172.21.15.130:0/3032605606 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189022424 0 0) 0x7f4e680b63c0 con 0x7f4e68146f30 2023-09-13T06:11:03.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e6d407640 1 -- 172.21.15.130:0/3032605606 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e54003530 con 0x7f4e68146f30 2023-09-13T06:11:03.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e6d407640 1 -- 172.21.15.130:0/3032605606 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878402341 0 0) 0x7f4e680d0c20 con 0x7f4e680d1750 2023-09-13T06:11:03.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e6d407640 1 -- 172.21.15.130:0/3032605606 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e680b63c0 con 0x7f4e680d1750 2023-09-13T06:11:03.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e6dc08640 1 -- 172.21.15.130:0/3032605606 >> v1:172.21.15.164:6789/0 conn(0x7f4e680d1750 legacy=0x7f4e68146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e6dc08640 1 -- 172.21.15.130:0/3032605606 >> v1:172.21.15.130:6789/0 conn(0x7f4e68146f30 legacy=0x7f4e680b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.725+0000 7f4e6dc08640 1 -- 172.21.15.130:0/3032605606 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e680b6610 con 0x7f4e680d1090 2023-09-13T06:11:03.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.729+0000 7f4e6dc08640 1 --2- 172.21.15.130:0/3032605606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e680d1090 0x7f4e6815d960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4e580097f0 tx=0x7f4e5801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c7323e6a4aa01cc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:03.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.729+0000 7f4e6d407640 1 -- 172.21.15.130:0/3032605606 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580aa5f0 con 0x7f4e680d1090 2023-09-13T06:11:03.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.729+0000 7f4e6d407640 1 -- 172.21.15.130:0/3032605606 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e580aa750 con 0x7f4e680d1090 2023-09-13T06:11:03.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.729+0000 7f4e6d407640 1 -- 172.21.15.130:0/3032605606 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580aaae0 con 0x7f4e680d1090 2023-09-13T06:11:03.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.729+0000 7f4e7066d640 1 -- 172.21.15.130:0/3032605606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e680d1090 msgr2=0x7f4e6815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.729+0000 7f4e7066d640 1 --2- 172.21.15.130:0/3032605606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e680d1090 0x7f4e6815d960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4e580097f0 tx=0x7f4e5801c490 comp rx=0 tx=0).stop 2023-09-13T06:11:03.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.729+0000 7f4e7066d640 1 -- 172.21.15.130:0/3032605606 shutdown_connections 2023-09-13T06:11:03.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.729+0000 7f4e7066d640 1 --2- 172.21.15.130:0/3032605606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e680d1090 0x7f4e6815d960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.729+0000 7f4e7066d640 1 -- 172.21.15.130:0/3032605606 >> 172.21.15.130:0/3032605606 conn(0x7f4e6806f170 msgr2=0x7f4e6806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:03.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.729+0000 7f4e7066d640 1 -- 172.21.15.130:0/3032605606 shutdown_connections 2023-09-13T06:11:03.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.729+0000 7f4e7066d640 1 -- 172.21.15.130:0/3032605606 wait complete. 2023-09-13T06:11:03.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e7066d640 1 Processor -- start 2023-09-13T06:11:03.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e7066d640 1 -- start start 2023-09-13T06:11:03.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e7066d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e680d1090 0x7f4e681547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e7066d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e680d1750 0x7f4e681539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e7066d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e68146f30 0x7f4e680b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e7066d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68155070 con 0x7f4e680d1750 2023-09-13T06:11:03.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e7066d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68155350 con 0x7f4e680d1090 2023-09-13T06:11:03.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e7066d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68155630 con 0x7f4e68146f30 2023-09-13T06:11:03.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e6dc08640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e680d1750 0x7f4e681539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e6dc08640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e680d1750 0x7f4e681539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52254/0 (socket says 172.21.15.130:52254) 2023-09-13T06:11:03.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e6dc08640 1 -- 172.21.15.130:0/1504173680 learned_addr learned my addr 172.21.15.130:0/1504173680 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:03.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e6ec0a640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e68146f30 0x7f4e680b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e6e409640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e680d1090 0x7f4e681547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e6dc08640 1 -- 172.21.15.130:0/1504173680 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e68146f30 msgr2=0x7f4e680b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e6dc08640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e68146f30 0x7f4e680b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e6dc08640 1 -- 172.21.15.130:0/1504173680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e680d1090 msgr2=0x7f4e681547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e6dc08640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e680d1090 0x7f4e681547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e6dc08640 1 -- 172.21.15.130:0/1504173680 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58009420 con 0x7f4e680d1750 2023-09-13T06:11:03.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e6dc08640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e680d1750 0x7f4e681539f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f4e580ac040 tx=0x7f4e5801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:03.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e5effd640 1 -- 172.21.15.130:0/1504173680 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580be610 con 0x7f4e680d1750 2023-09-13T06:11:03.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e5effd640 1 -- 172.21.15.130:0/1504173680 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e580be7b0 con 0x7f4e680d1750 2023-09-13T06:11:03.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e5effd640 1 -- 172.21.15.130:0/1504173680 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580beb60 con 0x7f4e680d1750 2023-09-13T06:11:03.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e7066d640 1 -- 172.21.15.130:0/1504173680 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e68155910 con 0x7f4e680d1750 2023-09-13T06:11:03.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.733+0000 7f4e7066d640 1 -- 172.21.15.130:0/1504173680 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e68154d20 con 0x7f4e680d1750 2023-09-13T06:11:03.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.737+0000 7f4e7066d640 1 -- 172.21.15.130:0/1504173680 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e680618a0 con 0x7f4e680d1750 2023-09-13T06:11:03.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.737+0000 7f4e5effd640 1 -- 172.21.15.130:0/1504173680 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4e580b4400 con 0x7f4e680d1750 2023-09-13T06:11:03.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.737+0000 7f4e5effd640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e4c065b20 0x7f4e4c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:03.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.737+0000 7f4e5effd640 1 -- 172.21.15.130:0/1504173680 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4e580a7070 con 0x7f4e680d1750 2023-09-13T06:11:03.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.737+0000 7f4e5effd640 1 -- 172.21.15.130:0/1504173680 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f4e4c06d710 con 0x7f4e680d1750 2023-09-13T06:11:03.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.737+0000 7f4e6e409640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e4c065b20 0x7f4e4c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:03.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.737+0000 7f4e6e409640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e4c065b20 0x7f4e4c067fe0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f4e640011f0 tx=0x7f4e64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:03.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.741+0000 7f4e5effd640 1 -- 172.21.15.130:0/1504173680 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4e580eb5a0 con 0x7f4e680d1750 2023-09-13T06:11:03.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 -- 172.21.15.130:0/1504173680 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e68155dc0 con 0x7f4e680d1750 2023-09-13T06:11:03.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e5effd640 1 -- 172.21.15.130:0/1504173680 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f4e580eebc0 con 0x7f4e680d1750 2023-09-13T06:11:03.921 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:03.921 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2638049185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2638049185},{"type":"v1","addr":"172.21.15.164:6834","nonce":2638049185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/4101999538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4101999538},{"type":"v1","addr":"172.21.15.130:6835","nonce":4101999538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1691911082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1691911082},{"type":"v1","addr":"172.21.15.130:6837","nonce":1691911082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:08:42.026268+0000","modified":"2023-09-13T06:08:45.060479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2618060608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2618060608},{"type":"v1","addr":"172.21.15.164:6835","nonce":2618060608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-09-13T06:11:03.922 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 76 2023-09-13T06:11:03.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 -- 172.21.15.130:0/1504173680 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e4c065b20 msgr2=0x7f4e4c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e4c065b20 0x7f4e4c067fe0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f4e640011f0 tx=0x7f4e64009040 comp rx=0 tx=0).stop 2023-09-13T06:11:03.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 -- 172.21.15.130:0/1504173680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e680d1750 msgr2=0x7f4e681539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:03.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e680d1750 0x7f4e681539f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f4e580ac040 tx=0x7f4e5801acd0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 -- 172.21.15.130:0/1504173680 shutdown_connections 2023-09-13T06:11:03.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e4c065b20 0x7f4e4c067fe0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e68146f30 0x7f4e680b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e680d1750 0x7f4e681539f0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 --2- 172.21.15.130:0/1504173680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e680d1090 0x7f4e681547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:03.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 -- 172.21.15.130:0/1504173680 >> 172.21.15.130:0/1504173680 conn(0x7f4e6806f170 msgr2=0x7f4e6806fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:03.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 -- 172.21.15.130:0/1504173680 shutdown_connections 2023-09-13T06:11:03.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:03.921+0000 7f4e7066d640 1 -- 172.21.15.130:0/1504173680 wait complete. 2023-09-13T06:11:03.942 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:11:04.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffaa592c640 1 Processor -- start 2023-09-13T06:11:04.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffaa592c640 1 -- start start 2023-09-13T06:11:04.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffaa592c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ffaa00d1090 0x7ffaa015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffaa592c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa0146f30 0x7ffaa00b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffaa592c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa00b63c0 con 0x7ffaa00d1750 2023-09-13T06:11:04.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffaa592c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa015dea0 con 0x7ffaa00d1090 2023-09-13T06:11:04.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffaa592c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa00d0c20 con 0x7ffaa0146f30 2023-09-13T06:11:04.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffa967fc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ffaa00d1090 0x7ffaa015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffa967fc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ffaa00d1090 0x7ffaa015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:37972/0 (socket says 172.21.15.130:37972) 2023-09-13T06:11:04.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffa967fc640 1 -- 172.21.15.130:0/2201854476 learned_addr learned my addr 172.21.15.130:0/2201854476 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:04.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffa9f7fe640 1 --2- 172.21.15.130:0/2201854476 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa0146f30 0x7ffaa00b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffa967fc640 1 -- 172.21.15.130:0/2201854476 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa0146f30 msgr2=0x7ffaa00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:04.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffa967fc640 1 --2- 172.21.15.130:0/2201854476 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa0146f30 0x7ffaa00b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffa967fc640 1 -- 172.21.15.130:0/2201854476 >> v1:172.21.15.164:6789/0 conn(0x7ffaa00d1750 legacy=0x7ffaa0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffa967fc640 1 -- 172.21.15.130:0/2201854476 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa00b6610 con 0x7ffaa00d1090 2023-09-13T06:11:04.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.081+0000 7ffa9e7fc640 1 -- 172.21.15.130:0/2201854476 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155490946 0 0) 0x7ffaa00b63c0 con 0x7ffaa00d1750 2023-09-13T06:11:04.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffa967fc640 1 --2- 172.21.15.130:0/2201854476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffaa00d1090 0x7ffaa015d960 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009e50 tx=0x7ffa8801c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8d466b8ddf9cb61 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:04.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffa9e7fc640 1 -- 172.21.15.130:0/2201854476 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880a58a0 con 0x7ffaa00d1090 2023-09-13T06:11:04.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffa9e7fc640 1 -- 172.21.15.130:0/2201854476 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa880a5a00 con 0x7ffaa00d1090 2023-09-13T06:11:04.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffa9e7fc640 1 -- 172.21.15.130:0/2201854476 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880a5d90 con 0x7ffaa00d1090 2023-09-13T06:11:04.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffaa592c640 1 -- 172.21.15.130:0/2201854476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffaa00d1090 msgr2=0x7ffaa015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffaa592c640 1 --2- 172.21.15.130:0/2201854476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffaa00d1090 0x7ffaa015d960 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009e50 tx=0x7ffa8801c9e0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffaa592c640 1 -- 172.21.15.130:0/2201854476 shutdown_connections 2023-09-13T06:11:04.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffaa592c640 1 --2- 172.21.15.130:0/2201854476 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa0146f30 0x7ffaa00b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffaa592c640 1 --2- 172.21.15.130:0/2201854476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffaa00d1090 0x7ffaa015d960 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffaa592c640 1 -- 172.21.15.130:0/2201854476 >> 172.21.15.130:0/2201854476 conn(0x7ffaa006f170 msgr2=0x7ffaa006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:04.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffaa592c640 1 -- 172.21.15.130:0/2201854476 shutdown_connections 2023-09-13T06:11:04.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.085+0000 7ffaa592c640 1 -- 172.21.15.130:0/2201854476 wait complete. 2023-09-13T06:11:04.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffaa592c640 1 Processor -- start 2023-09-13T06:11:04.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffaa592c640 1 -- start start 2023-09-13T06:11:04.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffaa592c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa00d1090 0x7ffaa015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffaa592c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa00d1750 0x7ffaa0162d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffaa592c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffaa0146f30 0x7ffaa0162090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffaa592c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0167340 con 0x7ffaa00d1750 2023-09-13T06:11:04.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffaa592c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0167620 con 0x7ffaa0146f30 2023-09-13T06:11:04.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffaa592c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0167900 con 0x7ffaa00d1090 2023-09-13T06:11:04.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa967fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa00d1750 0x7ffaa0162d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa00d1090 0x7ffaa015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa00d1090 0x7ffaa015ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:36700/0 (socket says 172.21.15.130:36700) 2023-09-13T06:11:04.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9effd640 1 -- 172.21.15.130:0/2643389439 learned_addr learned my addr 172.21.15.130:0/2643389439 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:04.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9f7fe640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffaa0146f30 0x7ffaa0162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9effd640 1 -- 172.21.15.130:0/2643389439 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffaa0146f30 msgr2=0x7ffaa0162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9effd640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffaa0146f30 0x7ffaa0162090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9effd640 1 -- 172.21.15.130:0/2643389439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa00d1750 msgr2=0x7ffaa0162d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9effd640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa00d1750 0x7ffaa0162d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9effd640 1 -- 172.21.15.130:0/2643389439 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88009b30 con 0x7ffaa00d1090 2023-09-13T06:11:04.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9effd640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa00d1090 0x7ffaa015ccb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c4d0 tx=0x7ffa9000c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:04.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9cff9640 1 -- 172.21.15.130:0/2643389439 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90005480 con 0x7ffaa00d1090 2023-09-13T06:11:04.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9cff9640 1 -- 172.21.15.130:0/2643389439 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa90003600 con 0x7ffaa00d1090 2023-09-13T06:11:04.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffa9cff9640 1 -- 172.21.15.130:0/2643389439 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa900039b0 con 0x7ffaa00d1090 2023-09-13T06:11:04.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.089+0000 7ffaa592c640 1 -- 172.21.15.130:0/2643389439 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa00b7e40 con 0x7ffaa00d1090 2023-09-13T06:11:04.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.093+0000 7ffaa592c640 1 -- 172.21.15.130:0/2643389439 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa015d1f0 con 0x7ffaa00d1090 2023-09-13T06:11:04.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.093+0000 7ffaa592c640 1 -- 172.21.15.130:0/2643389439 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa0143d20 con 0x7ffaa00d1090 2023-09-13T06:11:04.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.093+0000 7ffa9cff9640 1 -- 172.21.15.130:0/2643389439 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ffa90003b10 con 0x7ffaa00d1090 2023-09-13T06:11:04.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.093+0000 7ffa9cff9640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffa80065b20 0x7ffa80067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.093+0000 7ffa9cff9640 1 -- 172.21.15.130:0/2643389439 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffa90082980 con 0x7ffaa00d1090 2023-09-13T06:11:04.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.093+0000 7ffa967fc640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffa80065b20 0x7ffa80067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.093+0000 7ffa9cff9640 1 -- 172.21.15.130:0/2643389439 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7ffa8006d710 con 0x7ffaa00d1090 2023-09-13T06:11:04.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.093+0000 7ffa967fc640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffa80065b20 0x7ffa80067fe0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ffa880ae000 tx=0x7ffa880a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:04.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.097+0000 7ffa9cff9640 1 -- 172.21.15.130:0/2643389439 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ffa90050470 con 0x7ffaa00d1090 2023-09-13T06:11:04.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.249+0000 7ffaa592c640 1 -- 172.21.15.130:0/2643389439 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaa00618a0 con 0x7ffaa00d1090 2023-09-13T06:11:04.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.249+0000 7ffa9cff9640 1 -- 172.21.15.130:0/2643389439 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16684 (secure 0 0 0) 0x7ffa90017030 con 0x7ffaa00d1090 2023-09-13T06:11:04.250 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:04.250 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":159,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:10:17.438747+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:08:40.183838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-09-13T06:08:41.020446+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.12","mappings":[{"from":2,"to":0}]},{"pgid":"19.23","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:11:04.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 -- 172.21.15.130:0/2643389439 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffa80065b20 msgr2=0x7ffa80067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffa80065b20 0x7ffa80067fe0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ffa880ae000 tx=0x7ffa880a7070 comp rx=0 tx=0).stop 2023-09-13T06:11:04.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 -- 172.21.15.130:0/2643389439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa00d1090 msgr2=0x7ffaa015ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa00d1090 0x7ffaa015ccb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c4d0 tx=0x7ffa9000c990 comp rx=0 tx=0).stop 2023-09-13T06:11:04.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 -- 172.21.15.130:0/2643389439 shutdown_connections 2023-09-13T06:11:04.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffa80065b20 0x7ffa80067fe0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffaa0146f30 0x7ffaa0162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa00d1750 0x7ffaa0162d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 --2- 172.21.15.130:0/2643389439 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffaa00d1090 0x7ffaa015ccb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 -- 172.21.15.130:0/2643389439 >> 172.21.15.130:0/2643389439 conn(0x7ffaa006f170 msgr2=0x7ffaa013f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:04.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 -- 172.21.15.130:0/2643389439 shutdown_connections 2023-09-13T06:11:04.254 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.253+0000 7ffaa592c640 1 -- 172.21.15.130:0/2643389439 wait complete. 2023-09-13T06:11:04.271 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T06:11:04.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c52c3a640 1 Processor -- start 2023-09-13T06:11:04.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c52c3a640 1 -- start start 2023-09-13T06:11:04.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c52c3a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c4c0d1f50 0x7f3c4c070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c52c3a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c0d1ac0 con 0x7f3c4c0706c0 2023-09-13T06:11:04.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c52c3a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c0d0be0 con 0x7f3c4c146b30 2023-09-13T06:11:04.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c52c3a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c070b70 con 0x7f3c4c0d1f50 2023-09-13T06:11:04.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c52439640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3c4c0706c0 0x7f3c4c15d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38410/0 (socket says 172.21.15.130:38410) 2023-09-13T06:11:04.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c52439640 1 -- 172.21.15.130:0/559245225 learned_addr learned my addr 172.21.15.130:0/559245225 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:04.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c51437640 1 --2- 172.21.15.130:0/559245225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c4c0d1f50 0x7f3c4c070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c50c36640 1 -- 172.21.15.130:0/559245225 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775534331 0 0) 0x7f3c4c0d1ac0 con 0x7f3c4c0706c0 2023-09-13T06:11:04.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c50c36640 1 -- 172.21.15.130:0/559245225 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c38003530 con 0x7f3c4c0706c0 2023-09-13T06:11:04.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c50c36640 1 -- 172.21.15.130:0/559245225 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166797939 0 0) 0x7f3c4c0d0be0 con 0x7f3c4c146b30 2023-09-13T06:11:04.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c50c36640 1 -- 172.21.15.130:0/559245225 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c4c0d1ac0 con 0x7f3c4c146b30 2023-09-13T06:11:04.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c51437640 1 -- 172.21.15.130:0/559245225 >> v1:172.21.15.164:6789/0 conn(0x7f3c4c146b30 legacy=0x7f3c4c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c51437640 1 -- 172.21.15.130:0/559245225 >> v1:172.21.15.130:6789/0 conn(0x7f3c4c0706c0 legacy=0x7f3c4c15d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.409+0000 7f3c51437640 1 -- 172.21.15.130:0/559245225 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c0d0eb0 con 0x7f3c4c0d1f50 2023-09-13T06:11:04.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.413+0000 7f3c51437640 1 --2- 172.21.15.130:0/559245225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c4c0d1f50 0x7f3c4c070180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0097f0 tx=0x7f3c3c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d3a8ecd6a01d63 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:04.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.413+0000 7f3c50c36640 1 -- 172.21.15.130:0/559245225 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0aa5f0 con 0x7f3c4c0d1f50 2023-09-13T06:11:04.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.413+0000 7f3c50c36640 1 -- 172.21.15.130:0/559245225 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0aa750 con 0x7f3c4c0d1f50 2023-09-13T06:11:04.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.413+0000 7f3c50c36640 1 -- 172.21.15.130:0/559245225 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0aaae0 con 0x7f3c4c0d1f50 2023-09-13T06:11:04.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.413+0000 7f3c52c3a640 1 -- 172.21.15.130:0/559245225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c4c0d1f50 msgr2=0x7f3c4c070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.413+0000 7f3c52c3a640 1 --2- 172.21.15.130:0/559245225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c4c0d1f50 0x7f3c4c070180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0097f0 tx=0x7f3c3c01c490 comp rx=0 tx=0).stop 2023-09-13T06:11:04.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.413+0000 7f3c52c3a640 1 -- 172.21.15.130:0/559245225 shutdown_connections 2023-09-13T06:11:04.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.413+0000 7f3c52c3a640 1 --2- 172.21.15.130:0/559245225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c4c0d1f50 0x7f3c4c070180 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.413+0000 7f3c52c3a640 1 -- 172.21.15.130:0/559245225 >> 172.21.15.130:0/559245225 conn(0x7f3c4c0d3090 msgr2=0x7f3c4c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:04.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.413+0000 7f3c52c3a640 1 -- 172.21.15.130:0/559245225 shutdown_connections 2023-09-13T06:11:04.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.413+0000 7f3c52c3a640 1 -- 172.21.15.130:0/559245225 wait complete. 2023-09-13T06:11:04.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52c3a640 1 Processor -- start 2023-09-13T06:11:04.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52c3a640 1 -- start start 2023-09-13T06:11:04.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52c3a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c4c0706c0 0x7f3c4c15cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52c3a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c4c0d1f50 0x7f3c4c0cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52c3a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c4c146b30 0x7f3c4c0cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52c3a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c15d0e0 con 0x7f3c4c146b30 2023-09-13T06:11:04.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52c3a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c137490 con 0x7f3c4c0d1f50 2023-09-13T06:11:04.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52c3a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c137c00 con 0x7f3c4c0706c0 2023-09-13T06:11:04.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52439640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c4c146b30 0x7f3c4c0cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52439640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c4c146b30 0x7f3c4c0cfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52284/0 (socket says 172.21.15.130:52284) 2023-09-13T06:11:04.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52439640 1 -- 172.21.15.130:0/1431412806 learned_addr learned my addr 172.21.15.130:0/1431412806 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:04.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52439640 1 -- 172.21.15.130:0/1431412806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c4c0706c0 msgr2=0x7f3c4c15cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52439640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c4c0706c0 0x7f3c4c15cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52439640 1 -- 172.21.15.130:0/1431412806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c4c0d1f50 msgr2=0x7f3c4c0cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c51437640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c4c0d1f50 0x7f3c4c0cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52439640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c4c0d1f50 0x7f3c4c0cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52439640 1 -- 172.21.15.130:0/1431412806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c009420 con 0x7f3c4c146b30 2023-09-13T06:11:04.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c51437640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c4c0d1f50 0x7f3c4c0cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:11:04.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52439640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c4c146b30 0x7f3c4c0cfe70 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400cbc0 tx=0x7f3c4400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:04.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c427fc640 1 -- 172.21.15.130:0/1431412806 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400ace0 con 0x7f3c4c146b30 2023-09-13T06:11:04.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c427fc640 1 -- 172.21.15.130:0/1431412806 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4400ae40 con 0x7f3c4c146b30 2023-09-13T06:11:04.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c427fc640 1 -- 172.21.15.130:0/1431412806 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44012600 con 0x7f3c4c146b30 2023-09-13T06:11:04.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52c3a640 1 -- 172.21.15.130:0/1431412806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c137ee0 con 0x7f3c4c146b30 2023-09-13T06:11:04.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.417+0000 7f3c52c3a640 1 -- 172.21.15.130:0/1431412806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c1384a0 con 0x7f3c4c146b30 2023-09-13T06:11:04.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.421+0000 7f3c52c3a640 1 -- 172.21.15.130:0/1431412806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c138690 con 0x7f3c4c146b30 2023-09-13T06:11:04.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.421+0000 7f3c427fc640 1 -- 172.21.15.130:0/1431412806 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3c44012820 con 0x7f3c4c146b30 2023-09-13T06:11:04.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.421+0000 7f3c427fc640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c30065b20 0x7f3c30067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.421+0000 7f3c427fc640 1 -- 172.21.15.130:0/1431412806 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3c440832f0 con 0x7f3c4c146b30 2023-09-13T06:11:04.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.421+0000 7f3c51c38640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c30065b20 0x7f3c30067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.421+0000 7f3c427fc640 1 -- 172.21.15.130:0/1431412806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f3c3006d710 con 0x7f3c4c146b30 2023-09-13T06:11:04.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.421+0000 7f3c51c38640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c30065b20 0x7f3c30067fe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3c48007fd0 tx=0x7f3c48007960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:04.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.425+0000 7f3c427fc640 1 -- 172.21.15.130:0/1431412806 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3c44050c10 con 0x7f3c4c146b30 2023-09-13T06:11:04.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.605+0000 7f3c52c3a640 1 -- 172.21.15.130:0/1431412806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3c4c0b8190 con 0x7f3c4c146b30 2023-09-13T06:11:04.606 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:11:04.605+0000 7faa00e50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T06:11:04.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.609+0000 7f3c427fc640 1 -- 172.21.15.130:0/1431412806 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(160..160 src has 1..160) v4 ==== 432+0+0 (secure 0 0 0) 0x7f3c440830c0 con 0x7f3c4c146b30 2023-09-13T06:11:04.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.609+0000 7f3c427fc640 1 -- 172.21.15.130:0/1431412806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f3c3006df50 con 0x7f3c4c146b30 2023-09-13T06:11:04.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c427fc640 1 -- 172.21.15.130:0/1431412806 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3c44017070 con 0x7f3c4c146b30 2023-09-13T06:11:04.612 INFO:teuthology.orchestra.run.smithi130.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T06:11:04.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 -- 172.21.15.130:0/1431412806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c30065b20 msgr2=0x7f3c30067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c30065b20 0x7f3c30067fe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3c48007fd0 tx=0x7f3c48007960 comp rx=0 tx=0).stop 2023-09-13T06:11:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 -- 172.21.15.130:0/1431412806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c4c146b30 msgr2=0x7f3c4c0cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c4c146b30 0x7f3c4c0cfe70 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400cbc0 tx=0x7f3c4400a430 comp rx=0 tx=0).stop 2023-09-13T06:11:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 -- 172.21.15.130:0/1431412806 shutdown_connections 2023-09-13T06:11:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c30065b20 0x7f3c30067fe0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c4c0d1f50 0x7f3c4c0cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c4c146b30 0x7f3c4c0cfe70 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 --2- 172.21.15.130:0/1431412806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c4c0706c0 0x7f3c4c15cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 -- 172.21.15.130:0/1431412806 >> 172.21.15.130:0/1431412806 conn(0x7f3c4c0d3090 msgr2=0x7f3c4c13c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:04.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 -- 172.21.15.130:0/1431412806 shutdown_connections 2023-09-13T06:11:04.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.613+0000 7f3c52c3a640 1 -- 172.21.15.130:0/1431412806 wait complete. 2023-09-13T06:11:04.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T06:11:04.676 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:11:04.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.773+0000 7f0f70818640 1 Processor -- start 2023-09-13T06:11:04.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.773+0000 7f0f70818640 1 -- start start 2023-09-13T06:11:04.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.773+0000 7f0f70818640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1447a0 0x7f0f6c0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.773+0000 7f0f70818640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0f6c06bb00 0x7f0f6c0cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.773+0000 7f0f70818640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c0ce440 con 0x7f0f6c0cdaa0 2023-09-13T06:11:04.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.773+0000 7f0f70818640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c06e730 con 0x7f0f6c06bb00 2023-09-13T06:11:04.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.773+0000 7f0f70818640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c06bfd0 con 0x7f0f6c1447a0 2023-09-13T06:11:04.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f6ad9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1447a0 0x7f0f6c0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f6a59c640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0f6c0cdaa0 0x7f0f6c06b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:57792/0 (socket says 172.21.15.130:57792) 2023-09-13T06:11:04.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f6a59c640 1 -- 172.21.15.130:0/4214964914 learned_addr learned my addr 172.21.15.130:0/4214964914 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:04.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f6b59e640 1 --2- 172.21.15.130:0/4214964914 >> v2:172.21.15.164:3300/0 conn(0x7f0f6c06bb00 0x7f0f6c0cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f6ad9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1447a0 0x7f0f6c0b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:36732/0 (socket says 172.21.15.130:36732) 2023-09-13T06:11:04.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f6ad9d640 1 -- 172.21.15.130:0/4214964914 >> v2:172.21.15.164:3300/0 conn(0x7f0f6c06bb00 msgr2=0x7f0f6c0cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:04.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f6ad9d640 1 --2- 172.21.15.130:0/4214964914 >> v2:172.21.15.164:3300/0 conn(0x7f0f6c06bb00 0x7f0f6c0cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f6ad9d640 1 -- 172.21.15.130:0/4214964914 >> v1:172.21.15.164:6789/0 conn(0x7f0f6c0cdaa0 legacy=0x7f0f6c06b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f6ad9d640 1 -- 172.21.15.130:0/4214964914 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c0b1720 con 0x7f0f6c1447a0 2023-09-13T06:11:04.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f69d9b640 1 -- 172.21.15.130:0/4214964914 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517068841 0 0) 0x7f0f6c0ce440 con 0x7f0f6c0cdaa0 2023-09-13T06:11:04.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f6ad9d640 1 --2- 172.21.15.130:0/4214964914 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1447a0 0x7f0f6c0b24e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009d90 tx=0x7f0f5c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79767714bb2fefe8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:04.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f69d9b640 1 -- 172.21.15.130:0/4214964914 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0a59e0 con 0x7f0f6c1447a0 2023-09-13T06:11:04.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.777+0000 7f0f69d9b640 1 -- 172.21.15.130:0/4214964914 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0a5b40 con 0x7f0f6c1447a0 2023-09-13T06:11:04.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f69d9b640 1 -- 172.21.15.130:0/4214964914 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0ad440 con 0x7f0f6c1447a0 2023-09-13T06:11:04.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 -- 172.21.15.130:0/4214964914 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1447a0 msgr2=0x7f0f6c0b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 --2- 172.21.15.130:0/4214964914 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1447a0 0x7f0f6c0b24e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009d90 tx=0x7f0f5c01c920 comp rx=0 tx=0).stop 2023-09-13T06:11:04.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 -- 172.21.15.130:0/4214964914 shutdown_connections 2023-09-13T06:11:04.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 --2- 172.21.15.130:0/4214964914 >> v2:172.21.15.164:3300/0 conn(0x7f0f6c06bb00 0x7f0f6c0cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 --2- 172.21.15.130:0/4214964914 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c1447a0 0x7f0f6c0b24e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 -- 172.21.15.130:0/4214964914 >> 172.21.15.130:0/4214964914 conn(0x7f0f6c065990 msgr2=0x7f0f6c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:04.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 -- 172.21.15.130:0/4214964914 shutdown_connections 2023-09-13T06:11:04.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 -- 172.21.15.130:0/4214964914 wait complete. 2023-09-13T06:11:04.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 Processor -- start 2023-09-13T06:11:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 -- start start 2023-09-13T06:11:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f6c06bb00 0x7f0f6c14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c0cdaa0 0x7f0f6c13b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c1447a0 0x7f0f6c152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c152b60 con 0x7f0f6c1447a0 2023-09-13T06:11:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c14b4e0 con 0x7f0f6c06bb00 2023-09-13T06:11:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f70818640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c152270 con 0x7f0f6c0cdaa0 2023-09-13T06:11:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f6b59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c1447a0 0x7f0f6c152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f6b59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c1447a0 0x7f0f6c152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52290/0 (socket says 172.21.15.130:52290) 2023-09-13T06:11:04.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.781+0000 7f0f6b59e640 1 -- 172.21.15.130:0/3325327015 learned_addr learned my addr 172.21.15.130:0/3325327015 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:04.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f6ad9d640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f6c06bb00 0x7f0f6c14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f6a59c640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c0cdaa0 0x7f0f6c13b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f6b59e640 1 -- 172.21.15.130:0/3325327015 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c0cdaa0 msgr2=0x7f0f6c13b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f6b59e640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c0cdaa0 0x7f0f6c13b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f6b59e640 1 -- 172.21.15.130:0/3325327015 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f6c06bb00 msgr2=0x7f0f6c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:04.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f6b59e640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f6c06bb00 0x7f0f6c14afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:04.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f6b59e640 1 -- 172.21.15.130:0/3325327015 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c009a70 con 0x7f0f6c1447a0 2023-09-13T06:11:04.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f6a59c640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c0cdaa0 0x7f0f6c13b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:11:04.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f6b59e640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c1447a0 0x7f0f6c152ff0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e960 tx=0x7f0f6400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:04.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f537fe640 1 -- 172.21.15.130:0/3325327015 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f640096b0 con 0x7f0f6c1447a0 2023-09-13T06:11:04.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f537fe640 1 -- 172.21.15.130:0/3325327015 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6400c9a0 con 0x7f0f6c1447a0 2023-09-13T06:11:04.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f70818640 1 -- 172.21.15.130:0/3325327015 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c152510 con 0x7f0f6c1447a0 2023-09-13T06:11:04.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f537fe640 1 -- 172.21.15.130:0/3325327015 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400cd30 con 0x7f0f6c1447a0 2023-09-13T06:11:04.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f70818640 1 -- 172.21.15.130:0/3325327015 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c13b8d0 con 0x7f0f6c1447a0 2023-09-13T06:11:04.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f70818640 1 -- 172.21.15.130:0/3325327015 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c152d10 con 0x7f0f6c1447a0 2023-09-13T06:11:04.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f537fe640 1 -- 172.21.15.130:0/3325327015 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0f64013470 con 0x7f0f6c1447a0 2023-09-13T06:11:04.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f537fe640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f58065b50 0x7f0f58068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:04.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f537fe640 1 -- 172.21.15.130:0/3325327015 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f0f64083650 con 0x7f0f6c1447a0 2023-09-13T06:11:04.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.785+0000 7f0f6ad9d640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f58065b50 0x7f0f58068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:04.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.789+0000 7f0f537fe640 1 -- 172.21.15.130:0/3325327015 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f0f5806d850 con 0x7f0f6c1447a0 2023-09-13T06:11:04.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.789+0000 7f0f6ad9d640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f58065b50 0x7f0f58068010 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0af000 tx=0x7f0f5c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:04.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.789+0000 7f0f537fe640 1 -- 172.21.15.130:0/3325327015 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0f6c152d10 con 0x7f0f6c1447a0 2023-09-13T06:11:04.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:04.969+0000 7f0f70818640 1 -- 172.21.15.130:0/3325327015 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0f6c152d10 con 0x7f0f6c1447a0 2023-09-13T06:11:05.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.617+0000 7f0f537fe640 1 -- 172.21.15.130:0/3325327015 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f6c152d10 con 0x7f0f6c1447a0 2023-09-13T06:11:05.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.617+0000 7f0f70818640 1 -- 172.21.15.130:0/3325327015 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f58065b50 msgr2=0x7f0f58068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:05.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.617+0000 7f0f70818640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f58065b50 0x7f0f58068010 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0af000 tx=0x7f0f5c0a7070 comp rx=0 tx=0).stop 2023-09-13T06:11:05.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.617+0000 7f0f70818640 1 -- 172.21.15.130:0/3325327015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c1447a0 msgr2=0x7f0f6c152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:05.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.617+0000 7f0f70818640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c1447a0 0x7f0f6c152ff0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e960 tx=0x7f0f6400ee20 comp rx=0 tx=0).stop 2023-09-13T06:11:05.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.621+0000 7f0f70818640 1 -- 172.21.15.130:0/3325327015 shutdown_connections 2023-09-13T06:11:05.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.621+0000 7f0f70818640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0f58065b50 0x7f0f58068010 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:05.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.621+0000 7f0f70818640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f6c1447a0 0x7f0f6c152ff0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:05.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.621+0000 7f0f70818640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f6c0cdaa0 0x7f0f6c13b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:05.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.621+0000 7f0f70818640 1 --2- 172.21.15.130:0/3325327015 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f6c06bb00 0x7f0f6c14afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:05.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.621+0000 7f0f70818640 1 -- 172.21.15.130:0/3325327015 >> 172.21.15.130:0/3325327015 conn(0x7f0f6c065990 msgr2=0x7f0f6c142870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:05.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.621+0000 7f0f70818640 1 -- 172.21.15.130:0/3325327015 shutdown_connections 2023-09-13T06:11:05.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.621+0000 7f0f70818640 1 -- 172.21.15.130:0/3325327015 wait complete. 2023-09-13T06:11:05.639 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T06:11:05.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.781+0000 7fce75fba640 1 Processor -- start 2023-09-13T06:11:05.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.781+0000 7fce75fba640 1 -- start start 2023-09-13T06:11:05.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce75fba640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fce7015d9b0 0x7fce7015de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:05.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce75fba640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fce700cbf10 0x7fce700cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:05.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce75fba640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce700722c0 con 0x7fce70161940 2023-09-13T06:11:05.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce75fba640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce700cc8c0 con 0x7fce700cbf10 2023-09-13T06:11:05.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce75fba640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce700cd040 con 0x7fce7015d9b0 2023-09-13T06:11:05.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce6ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fce700cbf10 0x7fce700cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:05.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce6ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fce700cbf10 0x7fce700cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52298/0 (socket says 172.21.15.130:52298) 2023-09-13T06:11:05.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce6ffff640 1 -- 172.21.15.130:0/2466344922 learned_addr learned my addr 172.21.15.130:0/2466344922 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:05.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce6f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fce70161940 0x7fce700cda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38420/0 (socket says 172.21.15.130:38420) 2023-09-13T06:11:05.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce6effd640 1 --2- 172.21.15.130:0/2466344922 >> v2:172.21.15.164:3300/0 conn(0x7fce7015d9b0 0x7fce7015de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:05.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce6ffff640 1 -- 172.21.15.130:0/2466344922 >> v2:172.21.15.164:3300/0 conn(0x7fce7015d9b0 msgr2=0x7fce7015de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:05.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce6ffff640 1 --2- 172.21.15.130:0/2466344922 >> v2:172.21.15.164:3300/0 conn(0x7fce7015d9b0 0x7fce7015de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:05.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce6ffff640 1 -- 172.21.15.130:0/2466344922 >> v1:172.21.15.130:6789/0 conn(0x7fce70161940 legacy=0x7fce700cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:05.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce6ffff640 1 -- 172.21.15.130:0/2466344922 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce700cd600 con 0x7fce700cbf10 2023-09-13T06:11:05.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.785+0000 7fce6e7fc640 1 -- 172.21.15.130:0/2466344922 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748826103 0 0) 0x7fce60001120 con 0x7fce70161940 2023-09-13T06:11:05.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce6ffff640 1 --2- 172.21.15.130:0/2466344922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce700cbf10 0x7fce700cc380 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fce700ccc20 tx=0x7fce6801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a560c27a5549ba server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:05.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce6e7fc640 1 -- 172.21.15.130:0/2466344922 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce680a5600 con 0x7fce700cbf10 2023-09-13T06:11:05.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce6e7fc640 1 -- 172.21.15.130:0/2466344922 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce680a5760 con 0x7fce700cbf10 2023-09-13T06:11:05.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce6e7fc640 1 -- 172.21.15.130:0/2466344922 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce680a5af0 con 0x7fce700cbf10 2023-09-13T06:11:05.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce75fba640 1 -- 172.21.15.130:0/2466344922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce700cbf10 msgr2=0x7fce700cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:05.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce75fba640 1 --2- 172.21.15.130:0/2466344922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce700cbf10 0x7fce700cc380 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fce700ccc20 tx=0x7fce6801c940 comp rx=0 tx=0).stop 2023-09-13T06:11:05.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce75fba640 1 -- 172.21.15.130:0/2466344922 shutdown_connections 2023-09-13T06:11:05.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce75fba640 1 --2- 172.21.15.130:0/2466344922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce700cbf10 0x7fce700cc380 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:05.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce75fba640 1 --2- 172.21.15.130:0/2466344922 >> v2:172.21.15.164:3300/0 conn(0x7fce7015d9b0 0x7fce7015de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:05.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce75fba640 1 -- 172.21.15.130:0/2466344922 >> 172.21.15.130:0/2466344922 conn(0x7fce70065b60 msgr2=0x7fce70065f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:05.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce75fba640 1 -- 172.21.15.130:0/2466344922 shutdown_connections 2023-09-13T06:11:05.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce75fba640 1 -- 172.21.15.130:0/2466344922 wait complete. 2023-09-13T06:11:05.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce75fba640 1 Processor -- start 2023-09-13T06:11:05.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.789+0000 7fce75fba640 1 -- start start 2023-09-13T06:11:05.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce75fba640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce700cbf10 0x7fce700b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:05.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce75fba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce7015d9b0 0x7fce700af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:05.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce75fba640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce70161940 0x7fce70157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:05.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce75fba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce700aee80 con 0x7fce7015d9b0 2023-09-13T06:11:05.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce75fba640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce700ae290 con 0x7fce70161940 2023-09-13T06:11:05.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce75fba640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce700ae4e0 con 0x7fce700cbf10 2023-09-13T06:11:05.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce7015d9b0 0x7fce700af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:05.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce7015d9b0 0x7fce700af2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52310/0 (socket says 172.21.15.130:52310) 2023-09-13T06:11:05.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6effd640 1 -- 172.21.15.130:0/258203890 learned_addr learned my addr 172.21.15.130:0/258203890 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:05.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6ffff640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce70161940 0x7fce70157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:05.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6f7fe640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce700cbf10 0x7fce700b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:05.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6effd640 1 -- 172.21.15.130:0/258203890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce700cbf10 msgr2=0x7fce700b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:05.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6effd640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce700cbf10 0x7fce700b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:05.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6effd640 1 -- 172.21.15.130:0/258203890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce70161940 msgr2=0x7fce70157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:05.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6effd640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce70161940 0x7fce70157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:05.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6effd640 1 -- 172.21.15.130:0/258203890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce68009b30 con 0x7fce7015d9b0 2023-09-13T06:11:05.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6ffff640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce70161940 0x7fce70157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:05.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce6effd640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce7015d9b0 0x7fce700af2a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fce6400d5f0 tx=0x7fce6400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:05.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce57fff640 1 -- 172.21.15.130:0/258203890 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640125f0 con 0x7fce7015d9b0 2023-09-13T06:11:05.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce57fff640 1 -- 172.21.15.130:0/258203890 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64012750 con 0x7fce7015d9b0 2023-09-13T06:11:05.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce75fba640 1 -- 172.21.15.130:0/258203890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce700ae7c0 con 0x7fce7015d9b0 2023-09-13T06:11:05.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce57fff640 1 -- 172.21.15.130:0/258203890 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64012ae0 con 0x7fce7015d9b0 2023-09-13T06:11:05.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce75fba640 1 -- 172.21.15.130:0/258203890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce700af7e0 con 0x7fce7015d9b0 2023-09-13T06:11:05.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce75fba640 1 -- 172.21.15.130:0/258203890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce700618a0 con 0x7fce7015d9b0 2023-09-13T06:11:05.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.793+0000 7fce57fff640 1 -- 172.21.15.130:0/258203890 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fce64012c40 con 0x7fce7015d9b0 2023-09-13T06:11:05.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.797+0000 7fce57fff640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce5c065b20 0x7fce5c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:05.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.797+0000 7fce57fff640 1 -- 172.21.15.130:0/258203890 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fce640837d0 con 0x7fce7015d9b0 2023-09-13T06:11:05.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.797+0000 7fce6f7fe640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce5c065b20 0x7fce5c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:05.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.797+0000 7fce57fff640 1 -- 172.21.15.130:0/258203890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fce5c06d820 con 0x7fce7015d9b0 2023-09-13T06:11:05.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.797+0000 7fce6f7fe640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce5c065b20 0x7fce5c067fe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce60000f70 tx=0x7fce60007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:05.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.801+0000 7fce57fff640 1 -- 172.21.15.130:0/258203890 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fce64051100 con 0x7fce7015d9b0 2023-09-13T06:11:05.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:05.949+0000 7fce75fba640 1 -- 172.21.15.130:0/258203890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fce700b2320 con 0x7fce7015d9b0 2023-09-13T06:11:06.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.617+0000 7fce57fff640 1 -- 172.21.15.130:0/258203890 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(161..161 src has 1..161) v4 ==== 354+0+0 (secure 0 0 0) 0x7fce64054dc0 con 0x7fce7015d9b0 2023-09-13T06:11:06.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.617+0000 7fce57fff640 1 -- 172.21.15.130:0/258203890 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=162}) v3 -- 0x7fce5c06bc50 con 0x7fce7015d9b0 2023-09-13T06:11:06.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.621+0000 7fce57fff640 1 -- 172.21.15.130:0/258203890 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v161) v1 ==== 181+0+0 (secure 0 0 0) 0x7fce64007380 con 0x7fce7015d9b0 2023-09-13T06:11:06.624 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' removed 2023-09-13T06:11:06.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 -- 172.21.15.130:0/258203890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce5c065b20 msgr2=0x7fce5c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:06.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce5c065b20 0x7fce5c067fe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce60000f70 tx=0x7fce60007c10 comp rx=0 tx=0).stop 2023-09-13T06:11:06.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 -- 172.21.15.130:0/258203890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce7015d9b0 msgr2=0x7fce700af2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:06.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce7015d9b0 0x7fce700af2a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fce6400d5f0 tx=0x7fce6400dab0 comp rx=0 tx=0).stop 2023-09-13T06:11:06.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 -- 172.21.15.130:0/258203890 shutdown_connections 2023-09-13T06:11:06.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fce5c065b20 0x7fce5c067fe0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:06.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce70161940 0x7fce70157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:06.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce7015d9b0 0x7fce700af2a0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:06.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 --2- 172.21.15.130:0/258203890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce700cbf10 0x7fce700b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:06.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 -- 172.21.15.130:0/258203890 >> 172.21.15.130:0/258203890 conn(0x7fce70065b60 msgr2=0x7fce700ad660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:06.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 -- 172.21.15.130:0/258203890 shutdown_connections 2023-09-13T06:11:06.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.629+0000 7fce75fba640 1 -- 172.21.15.130:0/258203890 wait complete. 2023-09-13T06:11:06.648 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T06:11:06.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27db59e640 1 Processor -- start 2023-09-13T06:11:06.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27db59e640 1 -- start start 2023-09-13T06:11:06.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27db59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f27dc159d40 0x7f27dc0cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:06.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27db59e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27dc06e530 con 0x7f27dc0b2570 2023-09-13T06:11:06.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27db59e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27dc0ce490 con 0x7f27dc0ad690 2023-09-13T06:11:06.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27db59e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27dc0ce2a0 con 0x7f27dc159d40 2023-09-13T06:11:06.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27da59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f27dc159d40 0x7f27dc0cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:06.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27da59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f27dc159d40 0x7f27dc0cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52324/0 (socket says 172.21.15.130:52324) 2023-09-13T06:11:06.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27da59c640 1 -- 172.21.15.130:0/3962694954 learned_addr learned my addr 172.21.15.130:0/3962694954 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:06.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27dad9d640 1 --1- 172.21.15.130:0/3962694954 >> v1:172.21.15.130:6789/0 conn(0x7f27dc0b2570 0x7f27dc0cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38422/0 (socket says 172.21.15.130:38422) 2023-09-13T06:11:06.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27da59c640 1 -- 172.21.15.130:0/3962694954 >> v1:172.21.15.164:6789/0 conn(0x7f27dc0ad690 legacy=0x7f27dc15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:06.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27da59c640 1 -- 172.21.15.130:0/3962694954 >> v1:172.21.15.130:6789/0 conn(0x7f27dc0b2570 legacy=0x7f27dc0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:06.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27da59c640 1 -- 172.21.15.130:0/3962694954 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc0ce770 con 0x7f27dc159d40 2023-09-13T06:11:06.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.793+0000 7f27d9d9b640 1 -- 172.21.15.130:0/3962694954 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155365793 0 0) 0x7f27dc06e530 con 0x7f27dc0b2570 2023-09-13T06:11:06.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27da59c640 1 --2- 172.21.15.130:0/3962694954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27dc159d40 0x7f27dc0cdd60 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f27cc006fd0 tx=0x7f27cc01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b23bc27419e0e6a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:06.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27d9d9b640 1 -- 172.21.15.130:0/3962694954 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0a7b00 con 0x7f27dc159d40 2023-09-13T06:11:06.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27d9d9b640 1 -- 172.21.15.130:0/3962694954 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc0a7c60 con 0x7f27dc159d40 2023-09-13T06:11:06.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27d9d9b640 1 -- 172.21.15.130:0/3962694954 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0af440 con 0x7f27dc159d40 2023-09-13T06:11:06.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27db59e640 1 -- 172.21.15.130:0/3962694954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27dc159d40 msgr2=0x7f27dc0cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:06.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27db59e640 1 --2- 172.21.15.130:0/3962694954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27dc159d40 0x7f27dc0cdd60 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f27cc006fd0 tx=0x7f27cc01eb30 comp rx=0 tx=0).stop 2023-09-13T06:11:06.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27db59e640 1 -- 172.21.15.130:0/3962694954 shutdown_connections 2023-09-13T06:11:06.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27db59e640 1 --2- 172.21.15.130:0/3962694954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27dc159d40 0x7f27dc0cdd60 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:06.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27db59e640 1 -- 172.21.15.130:0/3962694954 >> 172.21.15.130:0/3962694954 conn(0x7f27dc0b4120 msgr2=0x7f27dc0b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:06.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27db59e640 1 -- 172.21.15.130:0/3962694954 shutdown_connections 2023-09-13T06:11:06.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27db59e640 1 -- 172.21.15.130:0/3962694954 wait complete. 2023-09-13T06:11:06.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.797+0000 7f27db59e640 1 Processor -- start 2023-09-13T06:11:06.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27db59e640 1 -- start start 2023-09-13T06:11:06.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27db59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27dc0ad690 0x7f27dc14a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:06.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27db59e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27dc0b2570 0x7f27dc06d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:06.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27db59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27dc159d40 0x7f27dc06d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:06.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27db59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc143290 con 0x7f27dc0ad690 2023-09-13T06:11:06.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27db59e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc146cd0 con 0x7f27dc0b2570 2023-09-13T06:11:06.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27db59e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0afd20 con 0x7f27dc159d40 2023-09-13T06:11:06.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27da59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27dc0ad690 0x7f27dc14a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:06.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27da59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27dc0ad690 0x7f27dc14a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52334/0 (socket says 172.21.15.130:52334) 2023-09-13T06:11:06.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27da59c640 1 -- 172.21.15.130:0/929774083 learned_addr learned my addr 172.21.15.130:0/929774083 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:06.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27dad9d640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27dc159d40 0x7f27dc06d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:06.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27d3fff640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27dc0b2570 0x7f27dc06d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:06.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27da59c640 1 -- 172.21.15.130:0/929774083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27dc159d40 msgr2=0x7f27dc06d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:06.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27da59c640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27dc159d40 0x7f27dc06d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:06.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27da59c640 1 -- 172.21.15.130:0/929774083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27dc0b2570 msgr2=0x7f27dc06d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:06.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27da59c640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27dc0b2570 0x7f27dc06d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:06.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27da59c640 1 -- 172.21.15.130:0/929774083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc00b720 con 0x7f27dc0ad690 2023-09-13T06:11:06.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27da59c640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27dc0ad690 0x7f27dc14a860 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f27cc01b740 tx=0x7f27cc01b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:06.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27d2ffd640 1 -- 172.21.15.130:0/929774083 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0bc070 con 0x7f27dc0ad690 2023-09-13T06:11:06.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27d2ffd640 1 -- 172.21.15.130:0/929774083 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc003830 con 0x7f27dc0ad690 2023-09-13T06:11:06.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27d2ffd640 1 -- 172.21.15.130:0/929774083 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc003be0 con 0x7f27dc0ad690 2023-09-13T06:11:06.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27db59e640 1 -- 172.21.15.130:0/929774083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc0b0000 con 0x7f27dc0ad690 2023-09-13T06:11:06.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27db59e640 1 -- 172.21.15.130:0/929774083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27dc1482e0 con 0x7f27dc0ad690 2023-09-13T06:11:06.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.801+0000 7f27db59e640 1 -- 172.21.15.130:0/929774083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27dc0618a0 con 0x7f27dc0ad690 2023-09-13T06:11:06.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.805+0000 7f27d2ffd640 1 -- 172.21.15.130:0/929774083 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f27cc003d40 con 0x7f27dc0ad690 2023-09-13T06:11:06.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.805+0000 7f27d2ffd640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27bc065b20 0x7f27bc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:06.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.805+0000 7f27d2ffd640 1 -- 172.21.15.130:0/929774083 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f27cc11d940 con 0x7f27dc0ad690 2023-09-13T06:11:06.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.805+0000 7f27d2ffd640 1 -- 172.21.15.130:0/929774083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=162}) v3 -- 0x7f27bc06c9b0 con 0x7f27dc0ad690 2023-09-13T06:11:06.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.805+0000 7f27d3fff640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27bc065b20 0x7f27bc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:06.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.805+0000 7f27d3fff640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27bc065b20 0x7f27bc067fe0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0cb670 tx=0x7f27c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:06.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.809+0000 7f27d2ffd640 1 -- 172.21.15.130:0/929774083 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f27cc0eb3a0 con 0x7f27dc0ad690 2023-09-13T06:11:06.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:06.957+0000 7f27db59e640 1 -- 172.21.15.130:0/929774083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27dc0cbcc0 con 0x7f27dc0ad690 2023-09-13T06:11:07.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.449+0000 7f27d2ffd640 1 -- 172.21.15.130:0/929774083 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(162..162 src has 1..162) v4 ==== 721+0+0 (secure 0 0 0) 0x7f27cc0ef760 con 0x7f27dc0ad690 2023-09-13T06:11:07.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.449+0000 7f27d2ffd640 1 -- 172.21.15.130:0/929774083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f27bc06b740 con 0x7f27dc0ad690 2023-09-13T06:11:07.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.457+0000 7f27d2ffd640 1 -- 172.21.15.130:0/929774083 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v162) v1 ==== 169+0+0 (secure 0 0 0) 0x7f27cc0b4030 con 0x7f27dc0ad690 2023-09-13T06:11:07.459 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' removed 2023-09-13T06:11:07.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 -- 172.21.15.130:0/929774083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27bc065b20 msgr2=0x7f27bc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27bc065b20 0x7f27bc067fe0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0cb670 tx=0x7f27c4009040 comp rx=0 tx=0).stop 2023-09-13T06:11:07.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 -- 172.21.15.130:0/929774083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27dc0ad690 msgr2=0x7f27dc14a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27dc0ad690 0x7f27dc14a860 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f27cc01b740 tx=0x7f27cc01b8d0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 -- 172.21.15.130:0/929774083 shutdown_connections 2023-09-13T06:11:07.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f27bc065b20 0x7f27bc067fe0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27dc0b2570 0x7f27dc06d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27dc159d40 0x7f27dc06d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 --2- 172.21.15.130:0/929774083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27dc0ad690 0x7f27dc14a860 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 -- 172.21.15.130:0/929774083 >> 172.21.15.130:0/929774083 conn(0x7f27dc0b4120 msgr2=0x7f27dc15a420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:07.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 -- 172.21.15.130:0/929774083 shutdown_connections 2023-09-13T06:11:07.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.465+0000 7f27db59e640 1 -- 172.21.15.130:0/929774083 wait complete. 2023-09-13T06:11:07.485 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-13T06:11:07.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c9946d640 1 Processor -- start 2023-09-13T06:11:07.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c9946d640 1 -- start start 2023-09-13T06:11:07.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c9946d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c94146f10 0x7f6c940ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c9946d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6c940d3340 0x7f6c940d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c9946d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c940ab700 con 0x7f6c94161f10 2023-09-13T06:11:07.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c9946d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c940d3cd0 con 0x7f6c940d3340 2023-09-13T06:11:07.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c9946d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c940d2cd0 con 0x7f6c94146f10 2023-09-13T06:11:07.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c937fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6c940d3340 0x7f6c940d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c937fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6c940d3340 0x7f6c940d3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52342/0 (socket says 172.21.15.130:52342) 2023-09-13T06:11:07.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c937fe640 1 -- 172.21.15.130:0/114910712 learned_addr learned my addr 172.21.15.130:0/114910712 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:07.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c92ffd640 1 --2- 172.21.15.130:0/114910712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c94146f10 0x7f6c940ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c937fe640 1 -- 172.21.15.130:0/114910712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c94146f10 msgr2=0x7f6c940ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:07.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c937fe640 1 --2- 172.21.15.130:0/114910712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c94146f10 0x7f6c940ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c937fe640 1 -- 172.21.15.130:0/114910712 >> v1:172.21.15.164:6789/0 conn(0x7f6c94161f10 legacy=0x7f6c940d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.629+0000 7f6c937fe640 1 -- 172.21.15.130:0/114910712 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c940aa120 con 0x7f6c940d3340 2023-09-13T06:11:07.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c937fe640 1 --2- 172.21.15.130:0/114910712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c940d3340 0x7f6c940d3790 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f6c940d3e70 tx=0x7f6c8c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e579c329a80f7b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:07.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c91ffb640 1 -- 172.21.15.130:0/114910712 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0a5880 con 0x7f6c940d3340 2023-09-13T06:11:07.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c91ffb640 1 -- 172.21.15.130:0/114910712 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c0a59e0 con 0x7f6c940d3340 2023-09-13T06:11:07.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c91ffb640 1 -- 172.21.15.130:0/114910712 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0a5d70 con 0x7f6c940d3340 2023-09-13T06:11:07.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c9946d640 1 -- 172.21.15.130:0/114910712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c940d3340 msgr2=0x7f6c940d3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c9946d640 1 --2- 172.21.15.130:0/114910712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c940d3340 0x7f6c940d3790 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f6c940d3e70 tx=0x7f6c8c01c9c0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c9946d640 1 -- 172.21.15.130:0/114910712 shutdown_connections 2023-09-13T06:11:07.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c9946d640 1 --2- 172.21.15.130:0/114910712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c940d3340 0x7f6c940d3790 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c9946d640 1 --2- 172.21.15.130:0/114910712 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c94146f10 0x7f6c940ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c9946d640 1 -- 172.21.15.130:0/114910712 >> 172.21.15.130:0/114910712 conn(0x7f6c94065990 msgr2=0x7f6c94065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:07.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c9946d640 1 -- 172.21.15.130:0/114910712 shutdown_connections 2023-09-13T06:11:07.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.633+0000 7f6c9946d640 1 -- 172.21.15.130:0/114910712 wait complete. 2023-09-13T06:11:07.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c9946d640 1 Processor -- start 2023-09-13T06:11:07.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c9946d640 1 -- start start 2023-09-13T06:11:07.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c9946d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c940d3340 0x7f6c9415b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c9946d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c94146f10 0x7f6c9413f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c9946d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c940af4d0 0x7f6c9415b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c9946d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c940af9d0 con 0x7f6c94146f10 2023-09-13T06:11:07.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c9946d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c940afcb0 con 0x7f6c940af4d0 2023-09-13T06:11:07.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c9946d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c940ae210 con 0x7f6c940d3340 2023-09-13T06:11:07.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c927fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c94146f10 0x7f6c9413f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c927fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c94146f10 0x7f6c9413f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52358/0 (socket says 172.21.15.130:52358) 2023-09-13T06:11:07.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c927fc640 1 -- 172.21.15.130:0/2165452610 learned_addr learned my addr 172.21.15.130:0/2165452610 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:07.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c92ffd640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c940d3340 0x7f6c9415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c937fe640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c940af4d0 0x7f6c9415b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c927fc640 1 -- 172.21.15.130:0/2165452610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c940d3340 msgr2=0x7f6c9415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c927fc640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c940d3340 0x7f6c9415b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c927fc640 1 -- 172.21.15.130:0/2165452610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c940af4d0 msgr2=0x7f6c9415b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c927fc640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c940af4d0 0x7f6c9415b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c927fc640 1 -- 172.21.15.130:0/2165452610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c009b30 con 0x7f6c94146f10 2023-09-13T06:11:07.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c937fe640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c940af4d0 0x7f6c9415b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:07.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c927fc640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c94146f10 0x7f6c9413f680 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c3c0 tx=0x7f6c8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:07.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c7b7fe640 1 -- 172.21.15.130:0/2165452610 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c880052d0 con 0x7f6c94146f10 2023-09-13T06:11:07.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c7b7fe640 1 -- 172.21.15.130:0/2165452610 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c88005430 con 0x7f6c94146f10 2023-09-13T06:11:07.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c7b7fe640 1 -- 172.21.15.130:0/2165452610 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88003840 con 0x7f6c94146f10 2023-09-13T06:11:07.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c9946d640 1 -- 172.21.15.130:0/2165452610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c940ae4f0 con 0x7f6c94146f10 2023-09-13T06:11:07.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.637+0000 7f6c9946d640 1 -- 172.21.15.130:0/2165452610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9413fbc0 con 0x7f6c94146f10 2023-09-13T06:11:07.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.641+0000 7f6c9946d640 1 -- 172.21.15.130:0/2165452610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c940adce0 con 0x7f6c94146f10 2023-09-13T06:11:07.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.641+0000 7f6c7b7fe640 1 -- 172.21.15.130:0/2165452610 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6c880039a0 con 0x7f6c94146f10 2023-09-13T06:11:07.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.641+0000 7f6c7b7fe640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c80065b50 0x7f6c80068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.641+0000 7f6c7b7fe640 1 -- 172.21.15.130:0/2165452610 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6c88082580 con 0x7f6c94146f10 2023-09-13T06:11:07.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.641+0000 7f6c92ffd640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c80065b50 0x7f6c80068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.641+0000 7f6c92ffd640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c80065b50 0x7f6c80068010 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400b9d0 tx=0x7f6c84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:07.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.645+0000 7f6c7b7fe640 1 -- 172.21.15.130:0/2165452610 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6c88050130 con 0x7f6c94146f10 2023-09-13T06:11:07.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.793+0000 7f6c9946d640 1 -- 172.21.15.130:0/2165452610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6c940674a0 con 0x7f6c94146f10 2023-09-13T06:11:07.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.797+0000 7f6c7b7fe640 1 -- 172.21.15.130:0/2165452610 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6c88053750 con 0x7f6c94146f10 2023-09-13T06:11:07.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 -- 172.21.15.130:0/2165452610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c80065b50 msgr2=0x7f6c80068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c80065b50 0x7f6c80068010 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400b9d0 tx=0x7f6c84008040 comp rx=0 tx=0).stop 2023-09-13T06:11:07.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 -- 172.21.15.130:0/2165452610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c94146f10 msgr2=0x7f6c9413f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c94146f10 0x7f6c9413f680 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c3c0 tx=0x7f6c8800c880 comp rx=0 tx=0).stop 2023-09-13T06:11:07.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 -- 172.21.15.130:0/2165452610 shutdown_connections 2023-09-13T06:11:07.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6c80065b50 0x7f6c80068010 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c940af4d0 0x7f6c9415b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c94146f10 0x7f6c9413f680 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 --2- 172.21.15.130:0/2165452610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c940d3340 0x7f6c9415b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 -- 172.21.15.130:0/2165452610 >> 172.21.15.130:0/2165452610 conn(0x7f6c94065990 msgr2=0x7f6c940d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:07.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 -- 172.21.15.130:0/2165452610 shutdown_connections 2023-09-13T06:11:07.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.801+0000 7f6c9946d640 1 -- 172.21.15.130:0/2165452610 wait complete. 2023-09-13T06:11:07.819 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-09-13T06:11:07.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.957+0000 7f2db5007640 1 Processor -- start 2023-09-13T06:11:07.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.957+0000 7f2db5007640 1 -- start start 2023-09-13T06:11:07.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.957+0000 7f2db5007640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db01436e0 0x7f2db00ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.957+0000 7f2db5007640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db006f640 con 0x7f2db0070d60 2023-09-13T06:11:07.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.957+0000 7f2db5007640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db006f890 con 0x7f2db00acd80 2023-09-13T06:11:07.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.957+0000 7f2db5007640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db006fb70 con 0x7f2db01436e0 2023-09-13T06:11:07.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2daf59e640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2db0070d60 0x7f2db0160eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38430/0 (socket says 172.21.15.130:38430) 2023-09-13T06:11:07.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2daf59e640 1 -- 172.21.15.130:0/820410677 learned_addr learned my addr 172.21.15.130:0/820410677 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:07.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166873114 0 0) 0x7f2db006f640 con 0x7f2db0070d60 2023-09-13T06:11:07.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d98003530 con 0x7f2db0070d60 2023-09-13T06:11:07.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2daed9d640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db01436e0 0x7f2db00ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 330121933 0 0) 0x7f2d98003530 con 0x7f2db0070d60 2023-09-13T06:11:07.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db01436e0 msgr2=0x7f2db00ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:07.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db01436e0 0x7f2db00ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 >> v1:172.21.15.164:6789/0 conn(0x7f2db00acd80 legacy=0x7f2db0070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db006fe50 con 0x7f2db0070d60 2023-09-13T06:11:07.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f2da8001a00 con 0x7f2db0070d60 2023-09-13T06:11:07.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 >> v1:172.21.15.130:6789/0 conn(0x7f2db0070d60 legacy=0x7f2db0160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db01436e0 0x7f2d98003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d98003ff0 0x7f2d980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d98004d60 0x7f2d980051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db006fb70 con 0x7f2d98004d60 2023-09-13T06:11:07.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9800bc70 con 0x7f2d98003ff0 2023-09-13T06:11:07.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9800be30 con 0x7f2db01436e0 2023-09-13T06:11:07.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2daf59e640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d98004d60 0x7f2d980051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2daed9d640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db01436e0 0x7f2d98003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2dae59c640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d98003ff0 0x7f2d980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2daf59e640 1 -- 172.21.15.130:0/820410677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db01436e0 msgr2=0x7f2d98003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:07.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2daf59e640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db01436e0 0x7f2d98003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2daf59e640 1 -- 172.21.15.130:0/820410677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d98003ff0 msgr2=0x7f2d980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:07.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2daf59e640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d98003ff0 0x7f2d980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.961+0000 7f2daf59e640 1 -- 172.21.15.130:0/820410677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d98003530 con 0x7f2d98004d60 2023-09-13T06:11:07.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2daf59e640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d98004d60 0x7f2d980051e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f2db00b1ff0 tx=0x7f2da801d240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ed530d321d67c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:07.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0146e10 con 0x7f2d98004d60 2023-09-13T06:11:07.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da80a8070 con 0x7f2d98004d60 2023-09-13T06:11:07.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2dadd9b640 1 -- 172.21.15.130:0/820410677 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da80ad8f0 con 0x7f2d98004d60 2023-09-13T06:11:07.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2db5007640 1 -- 172.21.15.130:0/820410677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d98004d60 msgr2=0x7f2d980051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2db5007640 1 --2- 172.21.15.130:0/820410677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d98004d60 0x7f2d980051e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f2db00b1ff0 tx=0x7f2da801d240 comp rx=0 tx=0).stop 2023-09-13T06:11:07.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2daf59e640 1 -- 172.21.15.130:0/820410677 reap_dead start 2023-09-13T06:11:07.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2db5007640 1 -- 172.21.15.130:0/820410677 shutdown_connections 2023-09-13T06:11:07.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2db5007640 1 -- 172.21.15.130:0/820410677 >> 172.21.15.130:0/820410677 conn(0x7f2db00b0bc0 msgr2=0x7f2db00b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:07.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2db5007640 1 -- 172.21.15.130:0/820410677 shutdown_connections 2023-09-13T06:11:07.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2db5007640 1 -- 172.21.15.130:0/820410677 wait complete. 2023-09-13T06:11:07.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2db5007640 1 Processor -- start 2023-09-13T06:11:07.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.965+0000 7f2db5007640 1 -- start start 2023-09-13T06:11:07.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2db5007640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d98004d60 0x7f2db0070650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2db5007640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db0142880 0x7f2db015b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2db5007640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db0143bd0 0x7f2db0144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2db5007640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db0143090 con 0x7f2db0143bd0 2023-09-13T06:11:07.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2db5007640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db0164870 con 0x7f2d98004d60 2023-09-13T06:11:07.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2db5007640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db0144590 con 0x7f2db0142880 2023-09-13T06:11:07.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2daf59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db0143bd0 0x7f2db0144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2daf59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db0143bd0 0x7f2db0144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52390/0 (socket says 172.21.15.130:52390) 2023-09-13T06:11:07.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2daed9d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d98004d60 0x7f2db0070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2daf59e640 1 -- 172.21.15.130:0/1321071365 learned_addr learned my addr 172.21.15.130:0/1321071365 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:07.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2dae59c640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db0142880 0x7f2db015b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2daf59e640 1 -- 172.21.15.130:0/1321071365 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db0142880 msgr2=0x7f2db015b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2daf59e640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db0142880 0x7f2db015b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2daf59e640 1 -- 172.21.15.130:0/1321071365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d98004d60 msgr2=0x7f2db0070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:07.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2daf59e640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d98004d60 0x7f2db0070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:07.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2daf59e640 1 -- 172.21.15.130:0/1321071365 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db0142db0 con 0x7f2db0143bd0 2023-09-13T06:11:07.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2daf59e640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db0143bd0 0x7f2db0144050 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2da801dae0 tx=0x7f2d98005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:07.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2d977fe640 1 -- 172.21.15.130:0/1321071365 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8001800 con 0x7f2db0143bd0 2023-09-13T06:11:07.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2d977fe640 1 -- 172.21.15.130:0/1321071365 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da8001960 con 0x7f2db0143bd0 2023-09-13T06:11:07.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2d977fe640 1 -- 172.21.15.130:0/1321071365 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da80ad630 con 0x7f2db0143bd0 2023-09-13T06:11:07.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2db5007640 1 -- 172.21.15.130:0/1321071365 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db01641b0 con 0x7f2db0143bd0 2023-09-13T06:11:07.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2db5007640 1 -- 172.21.15.130:0/1321071365 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db015cfc0 con 0x7f2db0143bd0 2023-09-13T06:11:07.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2db5007640 1 -- 172.21.15.130:0/1321071365 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db0164010 con 0x7f2db0143bd0 2023-09-13T06:11:07.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.969+0000 7f2d977fe640 1 -- 172.21.15.130:0/1321071365 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2da80aa030 con 0x7f2db0143bd0 2023-09-13T06:11:07.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.973+0000 7f2d977fe640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d9c065b20 0x7f2d9c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:07.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.973+0000 7f2d977fe640 1 -- 172.21.15.130:0/1321071365 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2da811e6b0 con 0x7f2db0143bd0 2023-09-13T06:11:07.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.973+0000 7f2daed9d640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d9c065b20 0x7f2d9c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:07.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.973+0000 7f2daed9d640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d9c065b20 0x7f2d9c067fe0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009be0 tx=0x7f2da0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:07.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:07.973+0000 7f2d977fe640 1 -- 172.21.15.130:0/1321071365 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2da80ec400 con 0x7f2db0143bd0 2023-09-13T06:11:08.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.177+0000 7f2db5007640 1 -- 172.21.15.130:0/1321071365 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f2db0164010 con 0x7f2db0143bd0 2023-09-13T06:11:08.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.629+0000 7f2d977fe640 1 -- 172.21.15.130:0/1321071365 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v485) v1 ==== 132+0+0 (secure 0 0 0) 0x7f2db0164010 con 0x7f2db0143bd0 2023-09-13T06:11:08.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 -- 172.21.15.130:0/1321071365 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d9c065b20 msgr2=0x7f2d9c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:08.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d9c065b20 0x7f2d9c067fe0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009be0 tx=0x7f2da0009190 comp rx=0 tx=0).stop 2023-09-13T06:11:08.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 -- 172.21.15.130:0/1321071365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db0143bd0 msgr2=0x7f2db0144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:08.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db0143bd0 0x7f2db0144050 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2da801dae0 tx=0x7f2d98005800 comp rx=0 tx=0).stop 2023-09-13T06:11:08.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 -- 172.21.15.130:0/1321071365 shutdown_connections 2023-09-13T06:11:08.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2d9c065b20 0x7f2d9c067fe0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db0143bd0 0x7f2db0144050 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2db0142880 0x7f2db015b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 --2- 172.21.15.130:0/1321071365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d98004d60 0x7f2db0070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 -- 172.21.15.130:0/1321071365 >> 172.21.15.130:0/1321071365 conn(0x7f2db00b0bc0 msgr2=0x7f2db00af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:08.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 -- 172.21.15.130:0/1321071365 shutdown_connections 2023-09-13T06:11:08.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.633+0000 7f2db5007640 1 -- 172.21.15.130:0/1321071365 wait complete. 2023-09-13T06:11:08.653 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-09-13T06:11:08.654 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-09-13T06:11:08.654 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-09-13T06:11:08.655 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:11:08.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.793+0000 7f133bc6d640 1 Processor -- start 2023-09-13T06:11:08.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.793+0000 7f133bc6d640 1 -- start start 2023-09-13T06:11:08.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f133bc6d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1334159f20 0x7f13340ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:08.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f133bc6d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13340ccfd0 con 0x7f13340cdfc0 2023-09-13T06:11:08.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f133bc6d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13340ced90 con 0x7f13340b1d20 2023-09-13T06:11:08.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f133bc6d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13340b00f0 con 0x7f1334159f20 2023-09-13T06:11:08.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1339208640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f13340cdfc0 0x7f13340b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38442/0 (socket says 172.21.15.130:38442) 2023-09-13T06:11:08.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1339208640 1 -- 172.21.15.130:0/3123680068 learned_addr learned my addr 172.21.15.130:0/3123680068 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:08.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1339a09640 1 --2- 172.21.15.130:0/3123680068 >> v2:172.21.15.164:3300/0 conn(0x7f1334159f20 0x7f13340ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:08.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790936551 0 0) 0x7f13340ccfd0 con 0x7f13340cdfc0 2023-09-13T06:11:08.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1320003530 con 0x7f13340cdfc0 2023-09-13T06:11:08.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154015420 0 0) 0x7f13340ced90 con 0x7f13340b1d20 2023-09-13T06:11:08.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13340ccfd0 con 0x7f13340b1d20 2023-09-13T06:11:08.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2830234719 0 0) 0x7f1320003530 con 0x7f13340cdfc0 2023-09-13T06:11:08.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 >> v2:172.21.15.164:3300/0 conn(0x7f1334159f20 msgr2=0x7f13340ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:08.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 --2- 172.21.15.130:0/3123680068 >> v2:172.21.15.164:3300/0 conn(0x7f1334159f20 0x7f13340ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 >> v1:172.21.15.164:6789/0 conn(0x7f13340b1d20 legacy=0x7f13340ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:08.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13340cd200 con 0x7f13340cdfc0 2023-09-13T06:11:08.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f1324001680 con 0x7f13340cdfc0 2023-09-13T06:11:08.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 >> v1:172.21.15.130:6789/0 conn(0x7f13340cdfc0 legacy=0x7f13340b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:08.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1320003bd0 0x7f1320003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:08.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 0x7f1320004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:08.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1320005190 0x7f132000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:08.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132000e310 con 0x7f13200047d0 2023-09-13T06:11:08.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132000e480 con 0x7f1320005190 2023-09-13T06:11:08.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132000e640 con 0x7f1320003bd0 2023-09-13T06:11:08.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1339208640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 0x7f1320004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:08.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1339a09640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1320003bd0 0x7f1320003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:08.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f133a20a640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1320005190 0x7f132000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:08.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1339208640 1 -- 172.21.15.130:0/3123680068 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1320003bd0 msgr2=0x7f1320003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:08.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1339208640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1320003bd0 0x7f1320003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1339208640 1 -- 172.21.15.130:0/3123680068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1320005190 msgr2=0x7f132000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:08.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1339208640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1320005190 0x7f132000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f1339208640 1 -- 172.21.15.130:0/3123680068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320003530 con 0x7f13200047d0 2023-09-13T06:11:08.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f133a20a640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1320005190 0x7f132000dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:08.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.797+0000 7f133a20a640 1 -- 172.21.15.130:0/3123680068 reap_dead start 2023-09-13T06:11:08.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.801+0000 7f1339208640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 0x7f1320004c50 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f1324007fa0 tx=0x7f132401cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2010f365f173f007 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:08.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.801+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324005ae0 con 0x7f13200047d0 2023-09-13T06:11:08.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.801+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1324005c40 con 0x7f13200047d0 2023-09-13T06:11:08.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.801+0000 7f1338a07640 1 -- 172.21.15.130:0/3123680068 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13240a5a00 con 0x7f13200047d0 2023-09-13T06:11:08.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.801+0000 7f133bc6d640 1 -- 172.21.15.130:0/3123680068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 msgr2=0x7f1320004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:08.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.801+0000 7f133bc6d640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 0x7f1320004c50 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f1324007fa0 tx=0x7f132401cae0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.801+0000 7f133bc6d640 1 -- 172.21.15.130:0/3123680068 shutdown_connections 2023-09-13T06:11:08.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.801+0000 7f133bc6d640 1 --2- 172.21.15.130:0/3123680068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 0x7f1320004c50 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.801+0000 7f133bc6d640 1 -- 172.21.15.130:0/3123680068 >> 172.21.15.130:0/3123680068 conn(0x7f1334065990 msgr2=0x7f1334065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:08.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.801+0000 7f133bc6d640 1 -- 172.21.15.130:0/3123680068 shutdown_connections 2023-09-13T06:11:08.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.801+0000 7f133bc6d640 1 -- 172.21.15.130:0/3123680068 wait complete. 2023-09-13T06:11:08.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133bc6d640 1 Processor -- start 2023-09-13T06:11:08.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133bc6d640 1 -- start start 2023-09-13T06:11:08.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133bc6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 0x7f13340ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:08.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133bc6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1334150d50 0x7f1334157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:08.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133bc6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1334155190 0x7f13340aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:08.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133bc6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13341583c0 con 0x7f13200047d0 2023-09-13T06:11:08.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133bc6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13340a8430 con 0x7f1334155190 2023-09-13T06:11:08.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133bc6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13340a8710 con 0x7f1334150d50 2023-09-13T06:11:08.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f1339a09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 0x7f13340ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:08.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f1339a09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 0x7f13340ad0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52410/0 (socket says 172.21.15.130:52410) 2023-09-13T06:11:08.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f1339a09640 1 -- 172.21.15.130:0/1892498887 learned_addr learned my addr 172.21.15.130:0/1892498887 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:08.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133a20a640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1334155190 0x7f13340aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:08.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f1339a09640 1 -- 172.21.15.130:0/1892498887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1334150d50 msgr2=0x7f1334157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:08.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f1339a09640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1334150d50 0x7f1334157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f1339a09640 1 -- 172.21.15.130:0/1892498887 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1334155190 msgr2=0x7f13340aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:08.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f1339a09640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1334155190 0x7f13340aa020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f1339a09640 1 -- 172.21.15.130:0/1892498887 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13340a89f0 con 0x7f13200047d0 2023-09-13T06:11:08.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133a20a640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1334155190 0x7f13340aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:11:08.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f1339a09640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 0x7f13340ad0a0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f1330011aa0 tx=0x7f1330011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:08.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f132a7fc640 1 -- 172.21.15.130:0/1892498887 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133000fb80 con 0x7f13200047d0 2023-09-13T06:11:08.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f132a7fc640 1 -- 172.21.15.130:0/1892498887 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133000fce0 con 0x7f13200047d0 2023-09-13T06:11:08.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133bc6d640 1 -- 172.21.15.130:0/1892498887 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13340a8cd0 con 0x7f13200047d0 2023-09-13T06:11:08.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f132a7fc640 1 -- 172.21.15.130:0/1892498887 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330014680 con 0x7f13200047d0 2023-09-13T06:11:08.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133bc6d640 1 -- 172.21.15.130:0/1892498887 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13341580a0 con 0x7f13200047d0 2023-09-13T06:11:08.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.805+0000 7f133bc6d640 1 -- 172.21.15.130:0/1892498887 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13340618a0 con 0x7f13200047d0 2023-09-13T06:11:08.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.809+0000 7f132a7fc640 1 -- 172.21.15.130:0/1892498887 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f13300147e0 con 0x7f13200047d0 2023-09-13T06:11:08.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.809+0000 7f132a7fc640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1318065b50 0x7f1318068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:08.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.809+0000 7f132a7fc640 1 -- 172.21.15.130:0/1892498887 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1330083900 con 0x7f13200047d0 2023-09-13T06:11:08.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.809+0000 7f1339208640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1318065b50 0x7f1318068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:08.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.809+0000 7f1339208640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1318065b50 0x7f1318068010 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f13240ab000 tx=0x7f1324001940 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:08.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.813+0000 7f132a7fc640 1 -- 172.21.15.130:0/1892498887 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f13300514b0 con 0x7f13200047d0 2023-09-13T06:11:08.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.961+0000 7f133bc6d640 1 -- 172.21.15.130:0/1892498887 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1334071f50 con 0x7f13200047d0 2023-09-13T06:11:08.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f132a7fc640 1 -- 172.21.15.130:0/1892498887 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+13035 (secure 0 0 0) 0x7f1330006c40 con 0x7f13200047d0 2023-09-13T06:11:08.964 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:08.964 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":162,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:11:07.451530+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:6835/2618060608":"2023-09-14T06:11:04.609201+0000","172.21.15.164:6833/2618060608":"2023-09-14T06:11:04.609201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:11:08.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 -- 172.21.15.130:0/1892498887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1318065b50 msgr2=0x7f1318068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:08.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1318065b50 0x7f1318068010 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f13240ab000 tx=0x7f1324001940 comp rx=0 tx=0).stop 2023-09-13T06:11:08.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 -- 172.21.15.130:0/1892498887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 msgr2=0x7f13340ad0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:08.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 0x7f13340ad0a0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f1330011aa0 tx=0x7f1330011f60 comp rx=0 tx=0).stop 2023-09-13T06:11:08.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 -- 172.21.15.130:0/1892498887 shutdown_connections 2023-09-13T06:11:08.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1318065b50 0x7f1318068010 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1334155190 0x7f13340aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1334150d50 0x7f1334157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 --2- 172.21.15.130:0/1892498887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13200047d0 0x7f13340ad0a0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:08.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 -- 172.21.15.130:0/1892498887 >> 172.21.15.130:0/1892498887 conn(0x7f1334065990 msgr2=0x7f133406b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:08.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 -- 172.21.15.130:0/1892498887 shutdown_connections 2023-09-13T06:11:08.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:08.965+0000 7f133bc6d640 1 -- 172.21.15.130:0/1892498887 wait complete. 2023-09-13T06:11:08.985 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:11:08.986 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:11:09.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.125+0000 7f6b18b74640 1 Processor -- start 2023-09-13T06:11:09.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.125+0000 7f6b18b74640 1 -- start start 2023-09-13T06:11:09.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b18b74640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b140b31a0 0x7f6b140ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b18b74640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b140cc850 con 0x7f6b1415a080 2023-09-13T06:11:09.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b18b74640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b140b0330 con 0x7f6b140b1460 2023-09-13T06:11:09.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b18b74640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140cbcd0 con 0x7f6b140b31a0 2023-09-13T06:11:09.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b1259c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6b1415a080 0x7f6b1415e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38450/0 (socket says 172.21.15.130:38450) 2023-09-13T06:11:09.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b1259c640 1 -- 172.21.15.130:0/2484261586 learned_addr learned my addr 172.21.15.130:0/2484261586 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:09.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b12d9d640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b140b31a0 0x7f6b140ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400273293 0 0) 0x7f6b04001120 con 0x7f6b1415a080 2023-09-13T06:11:09.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b00003530 con 0x7f6b1415a080 2023-09-13T06:11:09.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115330243 0 0) 0x7f6b140b0330 con 0x7f6b140b1460 2023-09-13T06:11:09.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b04001120 con 0x7f6b140b1460 2023-09-13T06:11:09.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2532505962 0 0) 0x7f6b00003530 con 0x7f6b1415a080 2023-09-13T06:11:09.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b140b31a0 msgr2=0x7f6b140ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:09.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b140b31a0 0x7f6b140ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 >> v1:172.21.15.164:6789/0 conn(0x7f6b140b1460 legacy=0x7f6b140b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:09.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140cbfb0 con 0x7f6b1415a080 2023-09-13T06:11:09.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f6b04001810 con 0x7f6b1415a080 2023-09-13T06:11:09.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b12d9d640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b140b31a0 0x7f6b140ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:11:09.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 >> v1:172.21.15.130:6789/0 conn(0x7f6b1415a080 legacy=0x7f6b1415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:09.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b140b31a0 0x7f6b00003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 0x7f6b000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b00004d10 0x7f6b00005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140cbcd0 con 0x7f6b000040f0 2023-09-13T06:11:09.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0000dd60 con 0x7f6b00004d10 2023-09-13T06:11:09.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0000df20 con 0x7f6b140b31a0 2023-09-13T06:11:09.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b0bfff640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 0x7f6b000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b1259c640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b140b31a0 0x7f6b00003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b12d9d640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b00004d10 0x7f6b00005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b0bfff640 1 -- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b140b31a0 msgr2=0x7f6b00003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:09.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b0bfff640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b140b31a0 0x7f6b00003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b0bfff640 1 -- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b00004d10 msgr2=0x7f6b00005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:09.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b0bfff640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b00004d10 0x7f6b00005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.129+0000 7f6b0bfff640 1 -- 172.21.15.130:0/2484261586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c009a70 con 0x7f6b000040f0 2023-09-13T06:11:09.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.133+0000 7f6b0bfff640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 0x7f6b000047d0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0018d0 tx=0x7f6afc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4056ee2a9501e061 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:09.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.133+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0052d0 con 0x7f6b000040f0 2023-09-13T06:11:09.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.133+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc005450 con 0x7f6b000040f0 2023-09-13T06:11:09.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.133+0000 7f6b11d9b640 1 -- 172.21.15.130:0/2484261586 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc003840 con 0x7f6b000040f0 2023-09-13T06:11:09.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.133+0000 7f6b18b74640 1 -- 172.21.15.130:0/2484261586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 msgr2=0x7f6b000047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:09.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.133+0000 7f6b18b74640 1 --2- 172.21.15.130:0/2484261586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 0x7f6b000047d0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0018d0 tx=0x7f6afc01c530 comp rx=0 tx=0).stop 2023-09-13T06:11:09.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.133+0000 7f6b12d9d640 1 -- 172.21.15.130:0/2484261586 reap_dead start 2023-09-13T06:11:09.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.133+0000 7f6b18b74640 1 -- 172.21.15.130:0/2484261586 shutdown_connections 2023-09-13T06:11:09.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.133+0000 7f6b18b74640 1 -- 172.21.15.130:0/2484261586 >> 172.21.15.130:0/2484261586 conn(0x7f6b14065990 msgr2=0x7f6b14065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:09.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.133+0000 7f6b18b74640 1 -- 172.21.15.130:0/2484261586 shutdown_connections 2023-09-13T06:11:09.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.133+0000 7f6b18b74640 1 -- 172.21.15.130:0/2484261586 wait complete. 2023-09-13T06:11:09.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b18b74640 1 Processor -- start 2023-09-13T06:11:09.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b18b74640 1 -- start start 2023-09-13T06:11:09.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b18b74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 0x7f6b14145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b18b74640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b1415b5f0 0x7f6b14147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b18b74640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b14147960 0x7f6b1415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b18b74640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141f6580 con 0x7f6b000040f0 2023-09-13T06:11:09.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b18b74640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141f8c10 con 0x7f6b1415b5f0 2023-09-13T06:11:09.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b18b74640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141f8e60 con 0x7f6b14147960 2023-09-13T06:11:09.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b1259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 0x7f6b14145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b1259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 0x7f6b14145850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52434/0 (socket says 172.21.15.130:52434) 2023-09-13T06:11:09.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b1259c640 1 -- 172.21.15.130:0/3401812391 learned_addr learned my addr 172.21.15.130:0/3401812391 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:09.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b0bfff640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b1415b5f0 0x7f6b14147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b12d9d640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b14147960 0x7f6b1415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b1259c640 1 -- 172.21.15.130:0/3401812391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b14147960 msgr2=0x7f6b1415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:09.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b1259c640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b14147960 0x7f6b1415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b1259c640 1 -- 172.21.15.130:0/3401812391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b1415b5f0 msgr2=0x7f6b14147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:09.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b1259c640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b1415b5f0 0x7f6b14147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b1259c640 1 -- 172.21.15.130:0/3401812391 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b141f9140 con 0x7f6b000040f0 2023-09-13T06:11:09.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b0bfff640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b1415b5f0 0x7f6b14147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:09.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b1259c640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 0x7f6b14145850 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f6b04007340 tx=0x7f6b04007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:09.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b0affd640 1 -- 172.21.15.130:0/3401812391 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0400f9c0 con 0x7f6b000040f0 2023-09-13T06:11:09.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b0affd640 1 -- 172.21.15.130:0/3401812391 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0400fb40 con 0x7f6b000040f0 2023-09-13T06:11:09.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b0affd640 1 -- 172.21.15.130:0/3401812391 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b040133f0 con 0x7f6b000040f0 2023-09-13T06:11:09.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b18b74640 1 -- 172.21.15.130:0/3401812391 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b141f9420 con 0x7f6b000040f0 2023-09-13T06:11:09.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.137+0000 7f6b18b74640 1 -- 172.21.15.130:0/3401812391 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b141f99e0 con 0x7f6b000040f0 2023-09-13T06:11:09.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.141+0000 7f6b18b74640 1 -- 172.21.15.130:0/3401812391 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b140618a0 con 0x7f6b000040f0 2023-09-13T06:11:09.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.141+0000 7f6b0affd640 1 -- 172.21.15.130:0/3401812391 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6b04013550 con 0x7f6b000040f0 2023-09-13T06:11:09.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.141+0000 7f6b0affd640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6af4065b50 0x7f6af4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.141+0000 7f6b0affd640 1 -- 172.21.15.130:0/3401812391 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6b04082b40 con 0x7f6b000040f0 2023-09-13T06:11:09.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.141+0000 7f6b0bfff640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6af4065b50 0x7f6af4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.141+0000 7f6b0bfff640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6af4065b50 0x7f6af4068010 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0ad000 tx=0x7f6afc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:09.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.145+0000 7f6b0affd640 1 -- 172.21.15.130:0/3401812391 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6b04050840 con 0x7f6b000040f0 2023-09-13T06:11:09.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.293+0000 7f6b18b74640 1 -- 172.21.15.130:0/3401812391 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b140cc850 con 0x7f6b000040f0 2023-09-13T06:11:09.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.293+0000 7f6b0affd640 1 -- 172.21.15.130:0/3401812391 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v162) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b140cc850 con 0x7f6b000040f0 2023-09-13T06:11:09.295 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:11:09.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 -- 172.21.15.130:0/3401812391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6af4065b50 msgr2=0x7f6af4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:09.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6af4065b50 0x7f6af4068010 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0ad000 tx=0x7f6afc0a7000 comp rx=0 tx=0).stop 2023-09-13T06:11:09.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 -- 172.21.15.130:0/3401812391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 msgr2=0x7f6b14145850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:09.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 0x7f6b14145850 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f6b04007340 tx=0x7f6b04007800 comp rx=0 tx=0).stop 2023-09-13T06:11:09.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 -- 172.21.15.130:0/3401812391 shutdown_connections 2023-09-13T06:11:09.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6af4065b50 0x7f6af4068010 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b1415b5f0 0x7f6b14147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b14147960 0x7f6b1415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 --2- 172.21.15.130:0/3401812391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b000040f0 0x7f6b14145850 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 -- 172.21.15.130:0/3401812391 >> 172.21.15.130:0/3401812391 conn(0x7f6b14065990 msgr2=0x7f6b140aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:09.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 -- 172.21.15.130:0/3401812391 shutdown_connections 2023-09-13T06:11:09.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.297+0000 7f6b18b74640 1 -- 172.21.15.130:0/3401812391 wait complete. 2023-09-13T06:11:09.315 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-09-13T06:11:09.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4699d11640 1 Processor -- start 2023-09-13T06:11:09.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4699d11640 1 -- start start 2023-09-13T06:11:09.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4699d11640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4694070990 0x7f46940c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4699d11640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f469415a7e0 0x7f46940c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4699d11640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46940c2cc0 con 0x7f46940b2c10 2023-09-13T06:11:09.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4699d11640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46940c3940 con 0x7f469415a7e0 2023-09-13T06:11:09.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4699d11640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46940c2fa0 con 0x7f4694070990 2023-09-13T06:11:09.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4693fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f469415a7e0 0x7f46940c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4693fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f469415a7e0 0x7f46940c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52448/0 (socket says 172.21.15.130:52448) 2023-09-13T06:11:09.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4693fff640 1 -- 172.21.15.130:0/3849085046 learned_addr learned my addr 172.21.15.130:0/3849085046 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:09.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4692ffd640 1 --2- 172.21.15.130:0/3849085046 >> v2:172.21.15.164:3300/0 conn(0x7f4694070990 0x7f46940c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4693fff640 1 -- 172.21.15.130:0/3849085046 >> v2:172.21.15.164:3300/0 conn(0x7f4694070990 msgr2=0x7f46940c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:09.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4693fff640 1 --2- 172.21.15.130:0/3849085046 >> v2:172.21.15.164:3300/0 conn(0x7f4694070990 0x7f46940c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4693fff640 1 -- 172.21.15.130:0/3849085046 >> v1:172.21.15.164:6789/0 conn(0x7f46940b2c10 legacy=0x7f4694070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:09.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4693fff640 1 -- 172.21.15.130:0/3849085046 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940c3280 con 0x7f469415a7e0 2023-09-13T06:11:09.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.453+0000 7f4692ffd640 1 --2- 172.21.15.130:0/3849085046 >> v2:172.21.15.164:3300/0 conn(0x7f4694070990 0x7f46940c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:09.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f4693fff640 1 --2- 172.21.15.130:0/3849085046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469415a7e0 0x7f46940c43a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f4694073a30 tx=0x7f468c01d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8afbf1bd1c1926 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:09.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f46927fc640 1 -- 172.21.15.130:0/3849085046 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0a5680 con 0x7f469415a7e0 2023-09-13T06:11:09.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f46927fc640 1 -- 172.21.15.130:0/3849085046 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c0a57e0 con 0x7f469415a7e0 2023-09-13T06:11:09.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f46927fc640 1 -- 172.21.15.130:0/3849085046 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0a5b70 con 0x7f469415a7e0 2023-09-13T06:11:09.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f4699d11640 1 -- 172.21.15.130:0/3849085046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469415a7e0 msgr2=0x7f46940c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:09.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f4699d11640 1 --2- 172.21.15.130:0/3849085046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469415a7e0 0x7f46940c43a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f4694073a30 tx=0x7f468c01d310 comp rx=0 tx=0).stop 2023-09-13T06:11:09.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f4699d11640 1 -- 172.21.15.130:0/3849085046 shutdown_connections 2023-09-13T06:11:09.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f4699d11640 1 --2- 172.21.15.130:0/3849085046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469415a7e0 0x7f46940c43a0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f4699d11640 1 --2- 172.21.15.130:0/3849085046 >> v2:172.21.15.164:3300/0 conn(0x7f4694070990 0x7f46940c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f4699d11640 1 -- 172.21.15.130:0/3849085046 >> 172.21.15.130:0/3849085046 conn(0x7f469406a2f0 msgr2=0x7f469406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:09.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f4699d11640 1 -- 172.21.15.130:0/3849085046 shutdown_connections 2023-09-13T06:11:09.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.457+0000 7f4699d11640 1 -- 172.21.15.130:0/3849085046 wait complete. 2023-09-13T06:11:09.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4699d11640 1 Processor -- start 2023-09-13T06:11:09.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4699d11640 1 -- start start 2023-09-13T06:11:09.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4699d11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4694070990 0x7f4694137b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4699d11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46940b2c10 0x7f46941592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4699d11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469415a7e0 0x7f46941597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4699d11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469413bfc0 con 0x7f469415a7e0 2023-09-13T06:11:09.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4699d11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469413b3b0 con 0x7f46940b2c10 2023-09-13T06:11:09.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4699d11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469413b690 con 0x7f4694070990 2023-09-13T06:11:09.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4693fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469415a7e0 0x7f46941597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4693fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469415a7e0 0x7f46941597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52450/0 (socket says 172.21.15.130:52450) 2023-09-13T06:11:09.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4693fff640 1 -- 172.21.15.130:0/1983438613 learned_addr learned my addr 172.21.15.130:0/1983438613 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:09.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f46937fe640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4694070990 0x7f4694137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4692ffd640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46940b2c10 0x7f46941592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4693fff640 1 -- 172.21.15.130:0/1983438613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4694070990 msgr2=0x7f4694137b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:09.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4693fff640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4694070990 0x7f4694137b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4693fff640 1 -- 172.21.15.130:0/1983438613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46940b2c10 msgr2=0x7f46941592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:09.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4693fff640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46940b2c10 0x7f46941592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:09.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4693fff640 1 -- 172.21.15.130:0/1983438613 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c009b30 con 0x7f469415a7e0 2023-09-13T06:11:09.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4693fff640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469415a7e0 0x7f46941597f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f468c0af040 tx=0x7f468c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:09.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f467bfff640 1 -- 172.21.15.130:0/1983438613 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0b8670 con 0x7f469415a7e0 2023-09-13T06:11:09.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f467bfff640 1 -- 172.21.15.130:0/1983438613 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c0b87f0 con 0x7f469415a7e0 2023-09-13T06:11:09.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f467bfff640 1 -- 172.21.15.130:0/1983438613 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0b8ba0 con 0x7f469415a7e0 2023-09-13T06:11:09.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4699d11640 1 -- 172.21.15.130:0/1983438613 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469413b970 con 0x7f469415a7e0 2023-09-13T06:11:09.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.461+0000 7f4699d11640 1 -- 172.21.15.130:0/1983438613 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46941380b0 con 0x7f469415a7e0 2023-09-13T06:11:09.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.465+0000 7f4699d11640 1 -- 172.21.15.130:0/1983438613 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4694138270 con 0x7f469415a7e0 2023-09-13T06:11:09.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.465+0000 7f467bfff640 1 -- 172.21.15.130:0/1983438613 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f468c0b8d00 con 0x7f469415a7e0 2023-09-13T06:11:09.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.465+0000 7f467bfff640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4680065b20 0x7f4680067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:09.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.465+0000 7f467bfff640 1 -- 172.21.15.130:0/1983438613 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f468c11e2f0 con 0x7f469415a7e0 2023-09-13T06:11:09.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.465+0000 7f46937fe640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4680065b20 0x7f4680067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:09.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.465+0000 7f46937fe640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4680065b20 0x7f4680067fe0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4684007fd0 tx=0x7f4684009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:09.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.469+0000 7f467bfff640 1 -- 172.21.15.130:0/1983438613 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4694138270 con 0x7f469415a7e0 2023-09-13T06:11:09.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:09.673+0000 7f4699d11640 1 -- 172.21.15.130:0/1983438613 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f4694138270 con 0x7f469415a7e0 2023-09-13T06:11:10.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.641+0000 7f467bfff640 1 -- 172.21.15.130:0/1983438613 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v487) v1 ==== 134+0+0 (secure 0 0 0) 0x7f4694138270 con 0x7f469415a7e0 2023-09-13T06:11:10.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 -- 172.21.15.130:0/1983438613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4680065b20 msgr2=0x7f4680067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:10.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4680065b20 0x7f4680067fe0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4684007fd0 tx=0x7f4684009040 comp rx=0 tx=0).stop 2023-09-13T06:11:10.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 -- 172.21.15.130:0/1983438613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469415a7e0 msgr2=0x7f46941597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:10.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469415a7e0 0x7f46941597f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f468c0af040 tx=0x7f468c019650 comp rx=0 tx=0).stop 2023-09-13T06:11:10.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 -- 172.21.15.130:0/1983438613 shutdown_connections 2023-09-13T06:11:10.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4680065b20 0x7f4680067fe0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46940b2c10 0x7f46941592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469415a7e0 0x7f46941597f0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 --2- 172.21.15.130:0/1983438613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4694070990 0x7f4694137b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 -- 172.21.15.130:0/1983438613 >> 172.21.15.130:0/1983438613 conn(0x7f469406a2f0 msgr2=0x7f46940c3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:10.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 -- 172.21.15.130:0/1983438613 shutdown_connections 2023-09-13T06:11:10.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.645+0000 7f4699d11640 1 -- 172.21.15.130:0/1983438613 wait complete. 2023-09-13T06:11:10.667 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-13T06:11:10.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a1b340640 1 Processor -- start 2023-09-13T06:11:10.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a1b340640 1 -- start start 2023-09-13T06:11:10.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a1b340640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7a141617f0 0x7f7a140cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:10.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a1b340640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a140b2620 con 0x7f7a140ce890 2023-09-13T06:11:10.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a1b340640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a140b1a80 con 0x7f7a140cc880 2023-09-13T06:11:10.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a1b340640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a140ccd10 con 0x7f7a141617f0 2023-09-13T06:11:10.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a198dd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f7a140ce890 0x7f7a14161bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:38462/0 (socket says 172.21.15.130:38462) 2023-09-13T06:11:10.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a198dd640 1 -- 172.21.15.130:0/796790829 learned_addr learned my addr 172.21.15.130:0/796790829 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:10.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a190dc640 1 --2- 172.21.15.130:0/796790829 >> v2:172.21.15.164:3300/0 conn(0x7f7a141617f0 0x7f7a140cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:10.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639736360 0 0) 0x7f7a140b2620 con 0x7f7a140ce890 2023-09-13T06:11:10.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a00003530 con 0x7f7a140ce890 2023-09-13T06:11:10.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3091415464 0 0) 0x7f7a00003530 con 0x7f7a140ce890 2023-09-13T06:11:10.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 >> v2:172.21.15.164:3300/0 conn(0x7f7a141617f0 msgr2=0x7f7a140cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:10.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 --2- 172.21.15.130:0/796790829 >> v2:172.21.15.164:3300/0 conn(0x7f7a141617f0 0x7f7a140cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 >> v1:172.21.15.164:6789/0 conn(0x7f7a140cc880 legacy=0x7f7a140ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:10.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140b2ab0 con 0x7f7a140ce890 2023-09-13T06:11:10.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f7a0c001a00 con 0x7f7a140ce890 2023-09-13T06:11:10.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 >> v1:172.21.15.130:6789/0 conn(0x7f7a140ce890 legacy=0x7f7a14161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:10.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 --2- 172.21.15.130:0/796790829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a000039f0 0x7f7a00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:10.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 --2- 172.21.15.130:0/796790829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a000047d0 0x7f7a00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:10.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 --2- 172.21.15.130:0/796790829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a00005190 0x7f7a0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:10.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140ccd10 con 0x7f7a000039f0 2023-09-13T06:11:10.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0000c010 con 0x7f7a000047d0 2023-09-13T06:11:10.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.813+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0000c1d0 con 0x7f7a00005190 2023-09-13T06:11:10.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a190dc640 1 --2- 172.21.15.130:0/796790829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a000039f0 0x7f7a00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:10.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a188db640 1 --2- 172.21.15.130:0/796790829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a000047d0 0x7f7a00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:10.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a198dd640 1 --2- 172.21.15.130:0/796790829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a00005190 0x7f7a0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:10.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a190dc640 1 -- 172.21.15.130:0/796790829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a00005190 msgr2=0x7f7a0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:10.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a190dc640 1 --2- 172.21.15.130:0/796790829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a00005190 0x7f7a0000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a190dc640 1 -- 172.21.15.130:0/796790829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a000047d0 msgr2=0x7f7a00004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:10.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a190dc640 1 --2- 172.21.15.130:0/796790829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a000047d0 0x7f7a00004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a190dc640 1 -- 172.21.15.130:0/796790829 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a00003530 con 0x7f7a000039f0 2023-09-13T06:11:10.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a198dd640 1 -- 172.21.15.130:0/796790829 reap_dead start 2023-09-13T06:11:10.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a190dc640 1 --2- 172.21.15.130:0/796790829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a000039f0 0x7f7a00003dd0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009ae0 tx=0x7f7a1001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8865c2947ffe93e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:10.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a100a5660 con 0x7f7a000039f0 2023-09-13T06:11:10.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a100a57c0 con 0x7f7a000039f0 2023-09-13T06:11:10.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a0bfff640 1 -- 172.21.15.130:0/796790829 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a100a5b70 con 0x7f7a000039f0 2023-09-13T06:11:10.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a1b340640 1 -- 172.21.15.130:0/796790829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a000039f0 msgr2=0x7f7a00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:10.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.817+0000 7f7a1b340640 1 --2- 172.21.15.130:0/796790829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a000039f0 0x7f7a00003dd0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009ae0 tx=0x7f7a1001ca70 comp rx=0 tx=0).stop 2023-09-13T06:11:10.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 -- 172.21.15.130:0/796790829 shutdown_connections 2023-09-13T06:11:10.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 --2- 172.21.15.130:0/796790829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a000039f0 0x7f7a00003dd0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 -- 172.21.15.130:0/796790829 >> 172.21.15.130:0/796790829 conn(0x7f7a14065990 msgr2=0x7f7a14065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:10.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 -- 172.21.15.130:0/796790829 shutdown_connections 2023-09-13T06:11:10.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 -- 172.21.15.130:0/796790829 wait complete. 2023-09-13T06:11:10.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 Processor -- start 2023-09-13T06:11:10.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 -- start start 2023-09-13T06:11:10.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a000039f0 0x7f7a140af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:10.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a140cf140 0x7f7a141eae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:10.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a140cf5c0 0x7f7a141eb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:10.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a141fb350 con 0x7f7a140cf5c0 2023-09-13T06:11:10.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1414aa80 con 0x7f7a140cf140 2023-09-13T06:11:10.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a1b340640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a141fa740 con 0x7f7a000039f0 2023-09-13T06:11:10.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a198dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a140cf5c0 0x7f7a141eb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:10.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a198dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a140cf5c0 0x7f7a141eb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52462/0 (socket says 172.21.15.130:52462) 2023-09-13T06:11:10.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a198dd640 1 -- 172.21.15.130:0/672135115 learned_addr learned my addr 172.21.15.130:0/672135115 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:10.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a188db640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a140cf140 0x7f7a141eae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:10.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a190dc640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a000039f0 0x7f7a140af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:10.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a198dd640 1 -- 172.21.15.130:0/672135115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a000039f0 msgr2=0x7f7a140af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:10.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a198dd640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a000039f0 0x7f7a140af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a198dd640 1 -- 172.21.15.130:0/672135115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a140cf140 msgr2=0x7f7a141eae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:10.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a198dd640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a140cf140 0x7f7a141eae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a198dd640 1 -- 172.21.15.130:0/672135115 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a141faa20 con 0x7f7a140cf5c0 2023-09-13T06:11:10.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a188db640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a140cf140 0x7f7a141eae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:10.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a190dc640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a000039f0 0x7f7a140af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:10.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.821+0000 7f7a198dd640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a140cf5c0 0x7f7a141eb380 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f7a00004750 tx=0x7f7a0c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:10.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.825+0000 7f7a09ffb640 1 -- 172.21.15.130:0/672135115 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c00ea30 con 0x7f7a140cf5c0 2023-09-13T06:11:10.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.825+0000 7f7a09ffb640 1 -- 172.21.15.130:0/672135115 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c00ebb0 con 0x7f7a140cf5c0 2023-09-13T06:11:10.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.825+0000 7f7a09ffb640 1 -- 172.21.15.130:0/672135115 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c014430 con 0x7f7a140cf5c0 2023-09-13T06:11:10.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.825+0000 7f7a1b340640 1 -- 172.21.15.130:0/672135115 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a141fad00 con 0x7f7a140cf5c0 2023-09-13T06:11:10.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.825+0000 7f7a1b340640 1 -- 172.21.15.130:0/672135115 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a141fa360 con 0x7f7a140cf5c0 2023-09-13T06:11:10.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.825+0000 7f7a1b340640 1 -- 172.21.15.130:0/672135115 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a14147bd0 con 0x7f7a140cf5c0 2023-09-13T06:11:10.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.825+0000 7f7a09ffb640 1 -- 172.21.15.130:0/672135115 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7a0c014590 con 0x7f7a140cf5c0 2023-09-13T06:11:10.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.825+0000 7f7a09ffb640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79f8065b20 0x7f79f8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:10.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.825+0000 7f7a09ffb640 1 -- 172.21.15.130:0/672135115 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7a0c082cb0 con 0x7f7a140cf5c0 2023-09-13T06:11:10.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.825+0000 7f7a190dc640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79f8065b20 0x7f79f8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:10.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.825+0000 7f7a190dc640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79f8065b20 0x7f79f8067fe0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7a100af000 tx=0x7f7a10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:10.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.829+0000 7f7a09ffb640 1 -- 172.21.15.130:0/672135115 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7a0c050860 con 0x7f7a140cf5c0 2023-09-13T06:11:10.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.977+0000 7f7a1b340640 1 -- 172.21.15.130:0/672135115 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7a140b1fa0 con 0x7f7a140cf5c0 2023-09-13T06:11:10.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.981+0000 7f7a09ffb640 1 -- 172.21.15.130:0/672135115 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7a0c053e80 con 0x7f7a140cf5c0 2023-09-13T06:11:10.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 -- 172.21.15.130:0/672135115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79f8065b20 msgr2=0x7f79f8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:10.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79f8065b20 0x7f79f8067fe0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7a100af000 tx=0x7f7a10008040 comp rx=0 tx=0).stop 2023-09-13T06:11:10.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 -- 172.21.15.130:0/672135115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a140cf5c0 msgr2=0x7f7a141eb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:10.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a140cf5c0 0x7f7a141eb380 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f7a00004750 tx=0x7f7a0c007bc0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 -- 172.21.15.130:0/672135115 shutdown_connections 2023-09-13T06:11:10.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f79f8065b20 0x7f79f8067fe0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a140cf140 0x7f7a141eae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a140cf5c0 0x7f7a141eb380 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 --2- 172.21.15.130:0/672135115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a000039f0 0x7f7a140af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:10.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 -- 172.21.15.130:0/672135115 >> 172.21.15.130:0/672135115 conn(0x7f7a14065990 msgr2=0x7f7a140ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:10.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 -- 172.21.15.130:0/672135115 shutdown_connections 2023-09-13T06:11:10.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:10.985+0000 7f7a1b340640 1 -- 172.21.15.130:0/672135115 wait complete. 2023-09-13T06:11:11.004 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:11:11.004 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:11:11.054 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:11:11.123 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:11:11.123 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:11:11.124 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:11:11.133 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:11:11.134 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:11:11.134 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:11:11.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:11:11.144 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:11:11.144 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:11:11.187 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:11:11.187 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:11:11.188 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:11:11.197 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:11:11.198 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-13T06:11:11.198 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:11:11.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba409e640 1 Processor -- start 2023-09-13T06:11:11.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba409e640 1 -- start start 2023-09-13T06:11:11.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba409e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ffb9c15b130 0x7ffb9c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba409e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9c0b04a0 0x7ffb9c0b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba409e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9c0ce980 con 0x7ffb9c0ce180 2023-09-13T06:11:11.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba409e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9c0b0e70 con 0x7ffb9c15b130 2023-09-13T06:11:11.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba409e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0cec60 con 0x7ffb9c0b04a0 2023-09-13T06:11:11.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba1639640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ffb9c0ce180 0x7ffb9c15b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35642/0 (socket says 172.21.15.130:35642) 2023-09-13T06:11:11.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba1639640 1 -- 172.21.15.130:0/2119001055 learned_addr learned my addr 172.21.15.130:0/2119001055 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:11.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba1e3a640 1 --2- 172.21.15.130:0/2119001055 >> v2:172.21.15.164:3300/0 conn(0x7ffb9c15b130 0x7ffb9c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba263b640 1 --2- 172.21.15.130:0/2119001055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9c0b04a0 0x7ffb9c0b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba0e38640 1 -- 172.21.15.130:0/2119001055 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231947806 0 0) 0x7ffb9c0ce980 con 0x7ffb9c0ce180 2023-09-13T06:11:11.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba0e38640 1 -- 172.21.15.130:0/2119001055 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb88003530 con 0x7ffb9c0ce180 2023-09-13T06:11:11.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba263b640 1 -- 172.21.15.130:0/2119001055 >> v2:172.21.15.164:3300/0 conn(0x7ffb9c15b130 msgr2=0x7ffb9c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:11.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba263b640 1 --2- 172.21.15.130:0/2119001055 >> v2:172.21.15.164:3300/0 conn(0x7ffb9c15b130 0x7ffb9c0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba263b640 1 -- 172.21.15.130:0/2119001055 >> v1:172.21.15.130:6789/0 conn(0x7ffb9c0ce180 legacy=0x7ffb9c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:11.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba263b640 1 -- 172.21.15.130:0/2119001055 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c06c640 con 0x7ffb9c0b04a0 2023-09-13T06:11:11.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.369+0000 7ffba1e3a640 1 --2- 172.21.15.130:0/2119001055 >> v2:172.21.15.164:3300/0 conn(0x7ffb9c15b130 0x7ffb9c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:11:11.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba263b640 1 --2- 172.21.15.130:0/2119001055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9c0b04a0 0x7ffb9c0b0930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009d90 tx=0x7ffb9401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b33b34ed1b35588b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:11.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba0e38640 1 -- 172.21.15.130:0/2119001055 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb940a5a10 con 0x7ffb9c0b04a0 2023-09-13T06:11:11.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba0e38640 1 -- 172.21.15.130:0/2119001055 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb940a5b70 con 0x7ffb9c0b04a0 2023-09-13T06:11:11.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba0e38640 1 -- 172.21.15.130:0/2119001055 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb940ad440 con 0x7ffb9c0b04a0 2023-09-13T06:11:11.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba409e640 1 -- 172.21.15.130:0/2119001055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9c0b04a0 msgr2=0x7ffb9c0b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:11.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba409e640 1 --2- 172.21.15.130:0/2119001055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9c0b04a0 0x7ffb9c0b0930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009d90 tx=0x7ffb9401c950 comp rx=0 tx=0).stop 2023-09-13T06:11:11.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba409e640 1 -- 172.21.15.130:0/2119001055 shutdown_connections 2023-09-13T06:11:11.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba409e640 1 --2- 172.21.15.130:0/2119001055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9c0b04a0 0x7ffb9c0b0930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba409e640 1 --2- 172.21.15.130:0/2119001055 >> v2:172.21.15.164:3300/0 conn(0x7ffb9c15b130 0x7ffb9c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba409e640 1 -- 172.21.15.130:0/2119001055 >> 172.21.15.130:0/2119001055 conn(0x7ffb9c065990 msgr2=0x7ffb9c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:11.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba409e640 1 -- 172.21.15.130:0/2119001055 shutdown_connections 2023-09-13T06:11:11.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.373+0000 7ffba409e640 1 -- 172.21.15.130:0/2119001055 wait complete. 2023-09-13T06:11:11.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba409e640 1 Processor -- start 2023-09-13T06:11:11.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba409e640 1 -- start start 2023-09-13T06:11:11.380 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba409e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb9c0b04a0 0x7ffb9c149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba409e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9c0ce180 0x7ffb9c070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba409e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb9c15b130 0x7ffb9c0706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba409e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0af330 con 0x7ffb9c15b130 2023-09-13T06:11:11.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba409e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c1557b0 con 0x7ffb9c0b04a0 2023-09-13T06:11:11.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba409e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0ae720 con 0x7ffb9c0ce180 2023-09-13T06:11:11.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba263b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb9c15b130 0x7ffb9c0706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba263b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb9c15b130 0x7ffb9c0706a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52616/0 (socket says 172.21.15.130:52616) 2023-09-13T06:11:11.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba263b640 1 -- 172.21.15.130:0/1348779422 learned_addr learned my addr 172.21.15.130:0/1348779422 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:11.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba1639640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9c0ce180 0x7ffb9c070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba1e3a640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb9c0b04a0 0x7ffb9c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba263b640 1 -- 172.21.15.130:0/1348779422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9c0ce180 msgr2=0x7ffb9c070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:11.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba263b640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9c0ce180 0x7ffb9c070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba263b640 1 -- 172.21.15.130:0/1348779422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb9c0b04a0 msgr2=0x7ffb9c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:11.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba263b640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb9c0b04a0 0x7ffb9c149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba263b640 1 -- 172.21.15.130:0/1348779422 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98009420 con 0x7ffb9c15b130 2023-09-13T06:11:11.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba263b640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb9c15b130 0x7ffb9c0706a0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7ffb940b0040 tx=0x7ffb940196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:11.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffb927fc640 1 -- 172.21.15.130:0/1348779422 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb940adce0 con 0x7ffb9c15b130 2023-09-13T06:11:11.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffb927fc640 1 -- 172.21.15.130:0/1348779422 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb940ade40 con 0x7ffb9c15b130 2023-09-13T06:11:11.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffb927fc640 1 -- 172.21.15.130:0/1348779422 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb940b9690 con 0x7ffb9c15b130 2023-09-13T06:11:11.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba409e640 1 -- 172.21.15.130:0/1348779422 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb94009a70 con 0x7ffb9c15b130 2023-09-13T06:11:11.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.377+0000 7ffba409e640 1 -- 172.21.15.130:0/1348779422 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9c0aece0 con 0x7ffb9c15b130 2023-09-13T06:11:11.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.381+0000 7ffba409e640 1 -- 172.21.15.130:0/1348779422 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9c0af4a0 con 0x7ffb9c15b130 2023-09-13T06:11:11.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.381+0000 7ffb927fc640 1 -- 172.21.15.130:0/1348779422 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ffb940b97f0 con 0x7ffb9c15b130 2023-09-13T06:11:11.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.381+0000 7ffb927fc640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb80065b20 0x7ffb80067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.381+0000 7ffb927fc640 1 -- 172.21.15.130:0/1348779422 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffb9411e600 con 0x7ffb9c15b130 2023-09-13T06:11:11.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.381+0000 7ffba1e3a640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb80065b20 0x7ffb80067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.381+0000 7ffba1e3a640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb80065b20 0x7ffb80067fe0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009be0 tx=0x7ffb98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:11.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.385+0000 7ffb927fc640 1 -- 172.21.15.130:0/1348779422 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ffb940ec1b0 con 0x7ffb9c15b130 2023-09-13T06:11:11.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.565+0000 7ffba409e640 1 -- 172.21.15.130:0/1348779422 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb9c0618a0 con 0x7ffb9c15b130 2023-09-13T06:11:11.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.565+0000 7ffb927fc640 1 -- 172.21.15.130:0/1348779422 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+3711 (secure 0 0 0) 0x7ffb940bde90 con 0x7ffb9c15b130 2023-09-13T06:11:11.567 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:11.567 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/2638049185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2638049185},{"type":"v1","addr":"172.21.15.164:6834","nonce":2638049185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":7819,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2728460965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2728460965},{"type":"v1","addr":"172.21.15.164:6835","nonce":2728460965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/4101999538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":4101999538},{"type":"v1","addr":"172.21.15.130:6835","nonce":4101999538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":8238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1691911082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1691911082},{"type":"v1","addr":"172.21.15.130:6837","nonce":1691911082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[]} 2023-09-13T06:11:11.567 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 78 2023-09-13T06:11:11.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 -- 172.21.15.130:0/1348779422 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb80065b20 msgr2=0x7ffb80067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:11.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb80065b20 0x7ffb80067fe0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009be0 tx=0x7ffb98008040 comp rx=0 tx=0).stop 2023-09-13T06:11:11.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 -- 172.21.15.130:0/1348779422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb9c15b130 msgr2=0x7ffb9c0706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:11.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb9c15b130 0x7ffb9c0706a0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7ffb940b0040 tx=0x7ffb940196f0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 -- 172.21.15.130:0/1348779422 shutdown_connections 2023-09-13T06:11:11.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ffb80065b20 0x7ffb80067fe0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb9c15b130 0x7ffb9c0706a0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9c0ce180 0x7ffb9c070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 --2- 172.21.15.130:0/1348779422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb9c0b04a0 0x7ffb9c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 -- 172.21.15.130:0/1348779422 >> 172.21.15.130:0/1348779422 conn(0x7ffb9c065990 msgr2=0x7ffb9c0b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:11.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 -- 172.21.15.130:0/1348779422 shutdown_connections 2023-09-13T06:11:11.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.569+0000 7ffba409e640 1 -- 172.21.15.130:0/1348779422 wait complete. 2023-09-13T06:11:11.588 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T06:11:11.588 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-13T06:11:11.588 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T06:11:11.589 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:11:11.589 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T06:11:11.589 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-13T06:11:11.590 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T06:11:11.590 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:11:11.590 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T06:11:11.591 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-13T06:11:11.591 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T06:11:11.591 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:11:11.591 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T06:11:11.592 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-13T06:11:11.592 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T06:11:11.592 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:11:11.602 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T06:11:11.602 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T06:11:11.604 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T06:11:11.604 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T06:11:11.605 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T06:11:11.606 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T06:11:11.607 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T06:11:11.607 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T06:11:11.649 INFO:tasks.ceph.mds.a:Started 2023-09-13T06:11:11.650 DEBUG:teuthology.parallel:result is None 2023-09-13T06:11:11.651 INFO:tasks.ceph.mds.b:Started 2023-09-13T06:11:11.651 DEBUG:teuthology.parallel:result is None 2023-09-13T06:11:11.652 INFO:tasks.ceph.mds.c:Started 2023-09-13T06:11:11.652 DEBUG:teuthology.parallel:result is None 2023-09-13T06:11:11.653 INFO:tasks.ceph.mds.d:Started 2023-09-13T06:11:11.653 DEBUG:teuthology.parallel:result is None 2023-09-13T06:11:11.654 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-13T06:11:11.736 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:11:11.739 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:11:11.744 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:11:11.746 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:11:11.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4ef10640 1 Processor -- start 2023-09-13T06:11:11.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4ef10640 1 -- start start 2023-09-13T06:11:11.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4ef10640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efc48146540 0x7efc48070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4ef10640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efc48070b90 0x7efc48160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4ef10640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4806f640 con 0x7efc481436e0 2023-09-13T06:11:11.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4ef10640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc48070fa0 con 0x7efc48070b90 2023-09-13T06:11:11.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4ef10640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4806f890 con 0x7efc48146540 2023-09-13T06:11:11.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4ccac640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7efc481436e0 0x7efc480ac840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35652/0 (socket says 172.21.15.130:35652) 2023-09-13T06:11:11.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4ccac640 1 -- 172.21.15.130:0/1166965644 learned_addr learned my addr 172.21.15.130:0/1166965644 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:11.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4d4ad640 1 --2- 172.21.15.130:0/1166965644 >> v2:172.21.15.130:3300/0 conn(0x7efc48070b90 0x7efc48160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc47fff640 1 --2- 172.21.15.130:0/1166965644 >> v2:172.21.15.164:3300/0 conn(0x7efc48146540 0x7efc48070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc477fe640 1 -- 172.21.15.130:0/1166965644 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786114082 0 0) 0x7efc4806f640 con 0x7efc481436e0 2023-09-13T06:11:11.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc477fe640 1 -- 172.21.15.130:0/1166965644 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc38003530 con 0x7efc481436e0 2023-09-13T06:11:11.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4d4ad640 1 -- 172.21.15.130:0/1166965644 >> v2:172.21.15.164:3300/0 conn(0x7efc48146540 msgr2=0x7efc48070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:11.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4d4ad640 1 --2- 172.21.15.130:0/1166965644 >> v2:172.21.15.164:3300/0 conn(0x7efc48146540 0x7efc48070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4d4ad640 1 -- 172.21.15.130:0/1166965644 >> v1:172.21.15.130:6789/0 conn(0x7efc481436e0 legacy=0x7efc480ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:11.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.801+0000 7efc4d4ad640 1 -- 172.21.15.130:0/1166965644 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4806fb70 con 0x7efc48070b90 2023-09-13T06:11:11.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc4d4ad640 1 --2- 172.21.15.130:0/1166965644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc48070b90 0x7efc48160eb0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7efc4806ba00 tx=0x7efc4001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc175db973ba65f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:11.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc477fe640 1 -- 172.21.15.130:0/1166965644 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400a57a0 con 0x7efc48070b90 2023-09-13T06:11:11.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc477fe640 1 -- 172.21.15.130:0/1166965644 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc400a5900 con 0x7efc48070b90 2023-09-13T06:11:11.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc477fe640 1 -- 172.21.15.130:0/1166965644 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400a5c90 con 0x7efc48070b90 2023-09-13T06:11:11.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc4ef10640 1 -- 172.21.15.130:0/1166965644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc48070b90 msgr2=0x7efc48160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:11.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc4ef10640 1 --2- 172.21.15.130:0/1166965644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc48070b90 0x7efc48160eb0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7efc4806ba00 tx=0x7efc4001c7f0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc4ef10640 1 -- 172.21.15.130:0/1166965644 shutdown_connections 2023-09-13T06:11:11.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc4ef10640 1 --2- 172.21.15.130:0/1166965644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc48070b90 0x7efc48160eb0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc4ef10640 1 --2- 172.21.15.130:0/1166965644 >> v2:172.21.15.164:3300/0 conn(0x7efc48146540 0x7efc48070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc4ef10640 1 -- 172.21.15.130:0/1166965644 >> 172.21.15.130:0/1166965644 conn(0x7efc480b0bc0 msgr2=0x7efc480b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:11.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc4ef10640 1 -- 172.21.15.130:0/1166965644 shutdown_connections 2023-09-13T06:11:11.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.805+0000 7efc4ef10640 1 -- 172.21.15.130:0/1166965644 wait complete. 2023-09-13T06:11:11.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ef10640 1 Processor -- start 2023-09-13T06:11:11.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ef10640 1 -- start start 2023-09-13T06:11:11.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ef10640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc48070b90 0x7efc48142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ef10640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc481436e0 0x7efc480aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ef10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc48146540 0x7efc48139280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ef10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc480af0e0 con 0x7efc48146540 2023-09-13T06:11:11.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ef10640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc480af310 con 0x7efc48070b90 2023-09-13T06:11:11.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ef10640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc480af5f0 con 0x7efc481436e0 2023-09-13T06:11:11.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4d4ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc48146540 0x7efc48139280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4d4ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc48146540 0x7efc48139280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52668/0 (socket says 172.21.15.130:52668) 2023-09-13T06:11:11.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4d4ad640 1 -- 172.21.15.130:0/1818231316 learned_addr learned my addr 172.21.15.130:0/1818231316 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:11.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ccac640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc48070b90 0x7efc48142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc47fff640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc481436e0 0x7efc480aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4d4ad640 1 -- 172.21.15.130:0/1818231316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc481436e0 msgr2=0x7efc480aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:11.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4d4ad640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc481436e0 0x7efc480aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4d4ad640 1 -- 172.21.15.130:0/1818231316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc48070b90 msgr2=0x7efc48142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:11.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4d4ad640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc48070b90 0x7efc48142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:11.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4d4ad640 1 -- 172.21.15.130:0/1818231316 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40009a70 con 0x7efc48146540 2023-09-13T06:11:11.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ccac640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc48070b90 0x7efc48142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:11.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4d4ad640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc48146540 0x7efc48139280 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7efc40019400 tx=0x7efc40019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:11.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc457fa640 1 -- 172.21.15.130:0/1818231316 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400b9650 con 0x7efc48146540 2023-09-13T06:11:11.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc457fa640 1 -- 172.21.15.130:0/1818231316 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc400b97b0 con 0x7efc48146540 2023-09-13T06:11:11.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc457fa640 1 -- 172.21.15.130:0/1818231316 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400b9b60 con 0x7efc48146540 2023-09-13T06:11:11.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ef10640 1 -- 172.21.15.130:0/1818231316 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc480af8d0 con 0x7efc48146540 2023-09-13T06:11:11.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ef10640 1 -- 172.21.15.130:0/1818231316 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc480afe90 con 0x7efc48146540 2023-09-13T06:11:11.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.809+0000 7efc4ef10640 1 -- 172.21.15.130:0/1818231316 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc480acf10 con 0x7efc48146540 2023-09-13T06:11:11.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.813+0000 7efc457fa640 1 -- 172.21.15.130:0/1818231316 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efc48161c00 con 0x7efc48146540 2023-09-13T06:11:11.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.813+0000 7efc457fa640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc2c065b20 0x7efc2c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:11.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.813+0000 7efc457fa640 1 -- 172.21.15.130:0/1818231316 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efc4011deb0 con 0x7efc48146540 2023-09-13T06:11:11.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.813+0000 7efc4ccac640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc2c065b20 0x7efc2c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:11.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.813+0000 7efc4ccac640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc2c065b20 0x7efc2c067fe0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0011f0 tx=0x7efc3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:11.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.817+0000 7efc457fa640 1 -- 172.21.15.130:0/1818231316 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7efc400eba60 con 0x7efc48146540 2023-09-13T06:11:11.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:11.977+0000 7efc4ef10640 1 -- 172.21.15.130:0/1818231316 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7efc480618a0 con 0x7efc48146540 2023-09-13T06:11:13.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc457fa640 1 -- 172.21.15.130:0/1818231316 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v167) v1 ==== 97+0+0 (secure 0 0 0) 0x7efc400bd080 con 0x7efc48146540 2023-09-13T06:11:13.476 INFO:teuthology.orchestra.run.smithi130.stderr: removed all blocklist entries 2023-09-13T06:11:13.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 -- 172.21.15.130:0/1818231316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc2c065b20 msgr2=0x7efc2c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:13.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc2c065b20 0x7efc2c067fe0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0011f0 tx=0x7efc3c009040 comp rx=0 tx=0).stop 2023-09-13T06:11:13.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 -- 172.21.15.130:0/1818231316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc48146540 msgr2=0x7efc48139280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:13.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc48146540 0x7efc48139280 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7efc40019400 tx=0x7efc40019590 comp rx=0 tx=0).stop 2023-09-13T06:11:13.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 -- 172.21.15.130:0/1818231316 shutdown_connections 2023-09-13T06:11:13.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efc2c065b20 0x7efc2c067fe0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc48146540 0x7efc48139280 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc481436e0 0x7efc480aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 --2- 172.21.15.130:0/1818231316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc48070b90 0x7efc48142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 -- 172.21.15.130:0/1818231316 >> 172.21.15.130:0/1818231316 conn(0x7efc480b0bc0 msgr2=0x7efc48071170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:13.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 -- 172.21.15.130:0/1818231316 shutdown_connections 2023-09-13T06:11:13.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.477+0000 7efc4ef10640 1 -- 172.21.15.130:0/1818231316 wait complete. 2023-09-13T06:11:13.501 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-13T06:11:13.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.641+0000 7fd4820bd640 1 Processor -- start 2023-09-13T06:11:13.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.641+0000 7fd4820bd640 1 -- start start 2023-09-13T06:11:13.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd4820bd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd47c15b130 0x7fd47c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:13.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd4820bd640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c0ce980 con 0x7fd47c0b04a0 2023-09-13T06:11:13.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd4820bd640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c0cec60 con 0x7fd47c0ce180 2023-09-13T06:11:13.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd4820bd640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c06c640 con 0x7fd47c15b130 2023-09-13T06:11:13.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd47bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd47c0b04a0 0x7fd47c06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35666/0 (socket says 172.21.15.130:35666) 2023-09-13T06:11:13.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd47bfff640 1 -- 172.21.15.130:0/1236941275 learned_addr learned my addr 172.21.15.130:0/1236941275 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:13.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd47b7fe640 1 --2- 172.21.15.130:0/1236941275 >> v2:172.21.15.164:3300/0 conn(0x7fd47c15b130 0x7fd47c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:13.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd47a7fc640 1 -- 172.21.15.130:0/1236941275 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290104403 0 0) 0x7fd47c0ce980 con 0x7fd47c0b04a0 2023-09-13T06:11:13.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd47a7fc640 1 -- 172.21.15.130:0/1236941275 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd464003530 con 0x7fd47c0b04a0 2023-09-13T06:11:13.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd47a7fc640 1 -- 172.21.15.130:0/1236941275 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458142886 0 0) 0x7fd47c0cec60 con 0x7fd47c0ce180 2023-09-13T06:11:13.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd47a7fc640 1 -- 172.21.15.130:0/1236941275 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd47c0ce980 con 0x7fd47c0ce180 2023-09-13T06:11:13.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd47b7fe640 1 -- 172.21.15.130:0/1236941275 >> v1:172.21.15.164:6789/0 conn(0x7fd47c0ce180 legacy=0x7fd47c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:13.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd47b7fe640 1 -- 172.21.15.130:0/1236941275 >> v1:172.21.15.130:6789/0 conn(0x7fd47c0b04a0 legacy=0x7fd47c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:13.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.645+0000 7fd47b7fe640 1 -- 172.21.15.130:0/1236941275 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c06c920 con 0x7fd47c15b130 2023-09-13T06:11:13.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd47b7fe640 1 --2- 172.21.15.130:0/1236941275 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd47c15b130 0x7fd47c0cc780 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0097c0 tx=0x7fd46c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ca11a3f7700d658 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:13.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd47a7fc640 1 -- 172.21.15.130:0/1236941275 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0ab600 con 0x7fd47c15b130 2023-09-13T06:11:13.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd47a7fc640 1 -- 172.21.15.130:0/1236941275 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c0a7050 con 0x7fd47c15b130 2023-09-13T06:11:13.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd47a7fc640 1 -- 172.21.15.130:0/1236941275 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0ab980 con 0x7fd47c15b130 2023-09-13T06:11:13.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd4820bd640 1 -- 172.21.15.130:0/1236941275 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd47c15b130 msgr2=0x7fd47c0cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:13.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd4820bd640 1 --2- 172.21.15.130:0/1236941275 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd47c15b130 0x7fd47c0cc780 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0097c0 tx=0x7fd46c01c480 comp rx=0 tx=0).stop 2023-09-13T06:11:13.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd4820bd640 1 -- 172.21.15.130:0/1236941275 shutdown_connections 2023-09-13T06:11:13.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd4820bd640 1 --2- 172.21.15.130:0/1236941275 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd47c15b130 0x7fd47c0cc780 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd4820bd640 1 -- 172.21.15.130:0/1236941275 >> 172.21.15.130:0/1236941275 conn(0x7fd47c065990 msgr2=0x7fd47c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:13.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd4820bd640 1 -- 172.21.15.130:0/1236941275 shutdown_connections 2023-09-13T06:11:13.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd4820bd640 1 -- 172.21.15.130:0/1236941275 wait complete. 2023-09-13T06:11:13.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd4820bd640 1 Processor -- start 2023-09-13T06:11:13.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.649+0000 7fd4820bd640 1 -- start start 2023-09-13T06:11:13.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd4820bd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd47c0b04a0 0x7fd47c155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:13.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd4820bd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd47c0ce180 0x7fd47c14d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:13.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd4820bd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd47c15b130 0x7fd47c14d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:13.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd4820bd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c155a00 con 0x7fd47c0b04a0 2023-09-13T06:11:13.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd4820bd640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c154dc0 con 0x7fd47c0ce180 2023-09-13T06:11:13.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd4820bd640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c155060 con 0x7fd47c15b130 2023-09-13T06:11:13.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd47c0b04a0 0x7fd47c155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:13.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd47c0b04a0 0x7fd47c155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52682/0 (socket says 172.21.15.130:52682) 2023-09-13T06:11:13.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47b7fe640 1 -- 172.21.15.130:0/415464299 learned_addr learned my addr 172.21.15.130:0/415464299 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:13.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47affd640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd47c0ce180 0x7fd47c14d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:13.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47bfff640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd47c15b130 0x7fd47c14d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:13.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47b7fe640 1 -- 172.21.15.130:0/415464299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd47c15b130 msgr2=0x7fd47c14d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:13.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47b7fe640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd47c15b130 0x7fd47c14d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47b7fe640 1 -- 172.21.15.130:0/415464299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd47c0ce180 msgr2=0x7fd47c14d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:13.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47b7fe640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd47c0ce180 0x7fd47c14d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47b7fe640 1 -- 172.21.15.130:0/415464299 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c009420 con 0x7fd47c0b04a0 2023-09-13T06:11:13.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47affd640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd47c0ce180 0x7fd47c14d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:13.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd47b7fe640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd47c0b04a0 0x7fd47c155e20 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0ae040 tx=0x7fd46c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:13.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd463fff640 1 -- 172.21.15.130:0/415464299 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0b7450 con 0x7fd47c0b04a0 2023-09-13T06:11:13.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd463fff640 1 -- 172.21.15.130:0/415464299 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c0b75d0 con 0x7fd47c0b04a0 2023-09-13T06:11:13.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd463fff640 1 -- 172.21.15.130:0/415464299 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0b7980 con 0x7fd47c0b04a0 2023-09-13T06:11:13.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd4820bd640 1 -- 172.21.15.130:0/415464299 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c155340 con 0x7fd47c0b04a0 2023-09-13T06:11:13.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd4820bd640 1 -- 172.21.15.130:0/415464299 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47c156360 con 0x7fd47c0b04a0 2023-09-13T06:11:13.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.653+0000 7fd4820bd640 1 -- 172.21.15.130:0/415464299 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47c0618a0 con 0x7fd47c0b04a0 2023-09-13T06:11:13.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.657+0000 7fd463fff640 1 -- 172.21.15.130:0/415464299 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd46c0b7ae0 con 0x7fd47c0b04a0 2023-09-13T06:11:13.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.657+0000 7fd463fff640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd468065b20 0x7fd468067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:13.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.657+0000 7fd463fff640 1 -- 172.21.15.130:0/415464299 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd46c11dfe0 con 0x7fd47c0b04a0 2023-09-13T06:11:13.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.657+0000 7fd47affd640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd468065b20 0x7fd468067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:13.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.657+0000 7fd47affd640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd468065b20 0x7fd468067fe0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd47c152790 tx=0x7fd470009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:13.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.661+0000 7fd463fff640 1 -- 172.21.15.130:0/415464299 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd46c0ebcc0 con 0x7fd47c0b04a0 2023-09-13T06:11:13.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.861+0000 7fd4820bd640 1 -- 172.21.15.130:0/415464299 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd47c153380 con 0x7fd47c0b04a0 2023-09-13T06:11:13.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.861+0000 7fd463fff640 1 -- 172.21.15.130:0/415464299 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd46c0b0020 con 0x7fd47c0b04a0 2023-09-13T06:11:13.863 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:13.863 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:11:13.864 INFO:teuthology.orchestra.run.smithi130.stdout: "auth_dump": [ 2023-09-13T06:11:13.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.864 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.a", 2023-09-13T06:11:13.864 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw==", 2023-09-13T06:11:13.864 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.864 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:11:13.865 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:11:13.865 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:11:13.865 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.865 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.866 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.866 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.b", 2023-09-13T06:11:13.866 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg==", 2023-09-13T06:11:13.866 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.866 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:11:13.867 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:11:13.867 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:11:13.867 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.867 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.867 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.868 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.c", 2023-09-13T06:11:13.868 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A==", 2023-09-13T06:11:13.868 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.868 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:11:13.869 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:11:13.869 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:11:13.869 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.869 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.869 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.869 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.870 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.d", 2023-09-13T06:11:13.870 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg==", 2023-09-13T06:11:13.870 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.870 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:11:13.870 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:11:13.871 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:11:13.871 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.871 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.871 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.872 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.0", 2023-09-13T06:11:13.872 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw==", 2023-09-13T06:11:13.872 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.872 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:11:13.872 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:11:13.873 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.873 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.873 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.1", 2023-09-13T06:11:13.873 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ==", 2023-09-13T06:11:13.874 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.874 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:11:13.874 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:11:13.874 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.874 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.875 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.875 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.875 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.2", 2023-09-13T06:11:13.875 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw==", 2023-09-13T06:11:13.875 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.876 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:11:13.876 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:11:13.876 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.876 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.877 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.3", 2023-09-13T06:11:13.877 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g==", 2023-09-13T06:11:13.877 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.877 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:11:13.877 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:11:13.878 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.878 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.878 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.878 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.4", 2023-09-13T06:11:13.879 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ==", 2023-09-13T06:11:13.879 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.879 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:11:13.879 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:11:13.879 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.880 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.880 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.880 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.5", 2023-09-13T06:11:13.881 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw==", 2023-09-13T06:11:13.881 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.881 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:11:13.881 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:11:13.881 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.882 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.882 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.882 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.882 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.6", 2023-09-13T06:11:13.882 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA==", 2023-09-13T06:11:13.883 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.883 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:11:13.883 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:11:13.883 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.883 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.884 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.884 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.884 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.7", 2023-09-13T06:11:13.884 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA==", 2023-09-13T06:11:13.884 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.884 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:11:13.885 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:11:13.885 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.885 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.885 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.885 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.886 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.0", 2023-09-13T06:11:13.886 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA==", 2023-09-13T06:11:13.886 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.886 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:11:13.886 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow r", 2023-09-13T06:11:13.887 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-13T06:11:13.887 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.887 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.887 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.1", 2023-09-13T06:11:13.888 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg==", 2023-09-13T06:11:13.888 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.888 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:11:13.888 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:11:13.888 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:11:13.888 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:11:13.889 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.889 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.2", 2023-09-13T06:11:13.889 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw==", 2023-09-13T06:11:13.890 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.890 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:11:13.890 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:11:13.890 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:11:13.891 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:11:13.891 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.891 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.3", 2023-09-13T06:11:13.891 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA==", 2023-09-13T06:11:13.892 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.892 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:11:13.892 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:11:13.892 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:11:13.892 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:11:13.893 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.893 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.893 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.admin", 2023-09-13T06:11:13.893 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQANUAFl5ccJOBAAP4KJItnG8vNd5OP/63ai0g==", 2023-09-13T06:11:13.894 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.894 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:11:13.894 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:11:13.894 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:11:13.894 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.895 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.895 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.x", 2023-09-13T06:11:13.895 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ==", 2023-09-13T06:11:13.896 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.896 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:11:13.896 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:11:13.896 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.896 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.896 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:11:13.897 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:13.897 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.y", 2023-09-13T06:11:13.897 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA==", 2023-09-13T06:11:13.897 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:11:13.897 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:11:13.898 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:11:13.898 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:11:13.898 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.898 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:13.898 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:11:13.899 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:11:13.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 -- 172.21.15.130:0/415464299 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd468065b20 msgr2=0x7fd468067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:13.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd468065b20 0x7fd468067fe0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd47c152790 tx=0x7fd470009040 comp rx=0 tx=0).stop 2023-09-13T06:11:13.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 -- 172.21.15.130:0/415464299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd47c0b04a0 msgr2=0x7fd47c155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:13.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd47c0b04a0 0x7fd47c155e20 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0ae040 tx=0x7fd46c01acc0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 -- 172.21.15.130:0/415464299 shutdown_connections 2023-09-13T06:11:13.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd468065b20 0x7fd468067fe0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd47c0ce180 0x7fd47c14d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd47c15b130 0x7fd47c14d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 --2- 172.21.15.130:0/415464299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd47c0b04a0 0x7fd47c155e20 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:13.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 -- 172.21.15.130:0/415464299 >> 172.21.15.130:0/415464299 conn(0x7fd47c065990 msgr2=0x7fd47c15dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:13.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 -- 172.21.15.130:0/415464299 shutdown_connections 2023-09-13T06:11:13.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:13.865+0000 7fd4820bd640 1 -- 172.21.15.130:0/415464299 wait complete. 2023-09-13T06:11:13.903 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:11:14.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc966c6d640 1 Processor -- start 2023-09-13T06:11:14.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc966c6d640 1 -- start start 2023-09-13T06:11:14.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc966c6d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc9600d1750 0x7fc96015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc966c6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960146f30 0x7fc9600b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc966c6d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9600b63c0 con 0x7fc9600d1090 2023-09-13T06:11:14.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc966c6d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96015dea0 con 0x7fc9600d1750 2023-09-13T06:11:14.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc966c6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600d0c20 con 0x7fc960146f30 2023-09-13T06:11:14.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc9600d1090 0x7fc960146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35670/0 (socket says 172.21.15.130:35670) 2023-09-13T06:11:14.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95ffff640 1 -- 172.21.15.130:0/3302665781 learned_addr learned my addr 172.21.15.130:0/3302665781 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:14.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc96520a640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960146f30 0x7fc9600b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc964a09640 1 --2- 172.21.15.130:0/3302665781 >> v2:172.21.15.164:3300/0 conn(0x7fc9600d1750 0x7fc96015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191929615 0 0) 0x7fc9600b63c0 con 0x7fc9600d1090 2023-09-13T06:11:14.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc950003530 con 0x7fc9600d1090 2023-09-13T06:11:14.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3460767839 0 0) 0x7fc950003530 con 0x7fc9600d1090 2023-09-13T06:11:14.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960146f30 msgr2=0x7fc9600b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:14.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960146f30 0x7fc9600b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 >> v2:172.21.15.164:3300/0 conn(0x7fc9600d1750 msgr2=0x7fc96015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:14.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 --2- 172.21.15.130:0/3302665781 >> v2:172.21.15.164:3300/0 conn(0x7fc9600d1750 0x7fc96015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9600b6610 con 0x7fc9600d1090 2023-09-13T06:11:14.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fc94c001680 con 0x7fc9600d1090 2023-09-13T06:11:14.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 >> v1:172.21.15.130:6789/0 conn(0x7fc9600d1090 legacy=0x7fc960146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9500039f0 0x7fc950003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9500047d0 0x7fc950004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960146f30 0x7fc950005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600d0c20 con 0x7fc9500047d0 2023-09-13T06:11:14.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95000b990 con 0x7fc9500039f0 2023-09-13T06:11:14.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.041+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95000bad0 con 0x7fc960146f30 2023-09-13T06:11:14.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc95ffff640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9500047d0 0x7fc950004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc96520a640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960146f30 0x7fc950005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc964a09640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9500039f0 0x7fc950003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc95ffff640 1 -- 172.21.15.130:0/3302665781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960146f30 msgr2=0x7fc950005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:14.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc95ffff640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960146f30 0x7fc950005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc95ffff640 1 -- 172.21.15.130:0/3302665781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9500039f0 msgr2=0x7fc950003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:14.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc95ffff640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9500039f0 0x7fc950003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc95ffff640 1 -- 172.21.15.130:0/3302665781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc950003530 con 0x7fc9500047d0 2023-09-13T06:11:14.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc95ffff640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9500047d0 0x7fc950004c50 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00c240 tx=0x7fc94c01f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa54150be3170c61 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:14.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0a8cb0 con 0x7fc9500047d0 2023-09-13T06:11:14.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c0a8e10 con 0x7fc9500047d0 2023-09-13T06:11:14.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3302665781 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c005b00 con 0x7fc9500047d0 2023-09-13T06:11:14.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc966c6d640 1 -- 172.21.15.130:0/3302665781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9500047d0 msgr2=0x7fc950004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc966c6d640 1 --2- 172.21.15.130:0/3302665781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9500047d0 0x7fc950004c50 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00c240 tx=0x7fc94c01f390 comp rx=0 tx=0).stop 2023-09-13T06:11:14.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.045+0000 7fc96520a640 1 -- 172.21.15.130:0/3302665781 reap_dead start 2023-09-13T06:11:14.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 -- 172.21.15.130:0/3302665781 shutdown_connections 2023-09-13T06:11:14.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 -- 172.21.15.130:0/3302665781 >> 172.21.15.130:0/3302665781 conn(0x7fc96006f170 msgr2=0x7fc96006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:14.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 -- 172.21.15.130:0/3302665781 shutdown_connections 2023-09-13T06:11:14.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 -- 172.21.15.130:0/3302665781 wait complete. 2023-09-13T06:11:14.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 Processor -- start 2023-09-13T06:11:14.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 -- start start 2023-09-13T06:11:14.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9500047d0 0x7fc96013aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9601513f0 0x7fc960140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9601604b0 0x7fc960160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc960160e70 con 0x7fc9601513f0 2023-09-13T06:11:14.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc960141250 con 0x7fc9500047d0 2023-09-13T06:11:14.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc966c6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc960141530 con 0x7fc9601604b0 2023-09-13T06:11:14.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc95ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9601513f0 0x7fc960140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc95ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9601513f0 0x7fc960140920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52692/0 (socket says 172.21.15.130:52692) 2023-09-13T06:11:14.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc95ffff640 1 -- 172.21.15.130:0/94071396 learned_addr learned my addr 172.21.15.130:0/94071396 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:14.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc964a09640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9500047d0 0x7fc96013aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc95ffff640 1 -- 172.21.15.130:0/94071396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9601604b0 msgr2=0x7fc960160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc96520a640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9601604b0 0x7fc960160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc95ffff640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9601604b0 0x7fc960160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc95ffff640 1 -- 172.21.15.130:0/94071396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9500047d0 msgr2=0x7fc96013aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc95ffff640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9500047d0 0x7fc96013aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc95ffff640 1 -- 172.21.15.130:0/94071396 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960141810 con 0x7fc9601513f0 2023-09-13T06:11:14.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.049+0000 7fc95ffff640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9601513f0 0x7fc960140920 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00c240 tx=0x7fc950005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:14.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.053+0000 7fc95d7fa640 1 -- 172.21.15.130:0/94071396 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0049f0 con 0x7fc9601513f0 2023-09-13T06:11:14.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.053+0000 7fc95d7fa640 1 -- 172.21.15.130:0/94071396 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c0b6070 con 0x7fc9601513f0 2023-09-13T06:11:14.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.053+0000 7fc95d7fa640 1 -- 172.21.15.130:0/94071396 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c004d50 con 0x7fc9601513f0 2023-09-13T06:11:14.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.053+0000 7fc966c6d640 1 -- 172.21.15.130:0/94071396 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc960141af0 con 0x7fc9601513f0 2023-09-13T06:11:14.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.053+0000 7fc966c6d640 1 -- 172.21.15.130:0/94071396 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc960140e60 con 0x7fc9601513f0 2023-09-13T06:11:14.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.053+0000 7fc966c6d640 1 -- 172.21.15.130:0/94071396 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc960141c80 con 0x7fc9601513f0 2023-09-13T06:11:14.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.053+0000 7fc95d7fa640 1 -- 172.21.15.130:0/94071396 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc94c0070d0 con 0x7fc9601513f0 2023-09-13T06:11:14.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.053+0000 7fc95d7fa640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 0x7fc944067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.053+0000 7fc95d7fa640 1 -- 172.21.15.130:0/94071396 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc94c0b8070 con 0x7fc9601513f0 2023-09-13T06:11:14.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.053+0000 7fc964a09640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 0x7fc944067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.057+0000 7fc964a09640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 0x7fc944067fe0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc954009aa0 tx=0x7fc954008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:14.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.057+0000 7fc95d7fa640 1 -- 172.21.15.130:0/94071396 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc94c0edcc0 con 0x7fc9601513f0 2023-09-13T06:11:14.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 -- 172.21.15.130:0/94071396 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc960141670 con 0x7fc9601513f0 2023-09-13T06:11:14.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc95d7fa640 1 -- 172.21.15.130:0/94071396 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+12904 (secure 0 0 0) 0x7fc960141670 con 0x7fc9601513f0 2023-09-13T06:11:14.209 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:14.210 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":167,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:11:13.471075+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:11:14.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 -- 172.21.15.130:0/94071396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 msgr2=0x7fc944067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 0x7fc944067fe0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc954009aa0 tx=0x7fc954008040 comp rx=0 tx=0).stop 2023-09-13T06:11:14.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 -- 172.21.15.130:0/94071396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9601513f0 msgr2=0x7fc960140920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9601513f0 0x7fc960140920 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00c240 tx=0x7fc950005800 comp rx=0 tx=0).stop 2023-09-13T06:11:14.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 -- 172.21.15.130:0/94071396 shutdown_connections 2023-09-13T06:11:14.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 0x7fc944067fe0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9601604b0 0x7fc960160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9601513f0 0x7fc960140920 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 --2- 172.21.15.130:0/94071396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9500047d0 0x7fc96013aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 -- 172.21.15.130:0/94071396 >> 172.21.15.130:0/94071396 conn(0x7fc96006f170 msgr2=0x7fc9600b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:14.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 -- 172.21.15.130:0/94071396 shutdown_connections 2023-09-13T06:11:14.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.209+0000 7fc966c6d640 1 -- 172.21.15.130:0/94071396 wait complete. 2023-09-13T06:11:14.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:11:14.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:11:14.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8f4dad640 1 Processor -- start 2023-09-13T06:11:14.372 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8f4dad640 1 -- start start 2023-09-13T06:11:14.373 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8f4dad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc8f0144d70 0x7fc8f00ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8f4dad640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc8f00b2780 0x7fc8f00b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8f4dad640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f00b3120 con 0x7fc8f00b1460 2023-09-13T06:11:14.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8f4dad640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f00b2430 con 0x7fc8f0144d70 2023-09-13T06:11:14.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8f4dad640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f00cedb0 con 0x7fc8f00b2780 2023-09-13T06:11:14.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8ee59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc8f0144d70 0x7fc8f00ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8ee59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc8f0144d70 0x7fc8f00ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52702/0 (socket says 172.21.15.130:52702) 2023-09-13T06:11:14.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8ee59c640 1 -- 172.21.15.130:0/515942586 learned_addr learned my addr 172.21.15.130:0/515942586 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:14.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8edd9b640 1 --2- 172.21.15.130:0/515942586 >> v2:172.21.15.164:3300/0 conn(0x7fc8f00b2780 0x7fc8f00b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8ee59c640 1 -- 172.21.15.130:0/515942586 >> v2:172.21.15.164:3300/0 conn(0x7fc8f00b2780 msgr2=0x7fc8f00b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:14.375 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8ee59c640 1 --2- 172.21.15.130:0/515942586 >> v2:172.21.15.164:3300/0 conn(0x7fc8f00b2780 0x7fc8f00b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8ee59c640 1 -- 172.21.15.130:0/515942586 >> v1:172.21.15.164:6789/0 conn(0x7fc8f00b1460 legacy=0x7fc8f00b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.373+0000 7fc8ee59c640 1 -- 172.21.15.130:0/515942586 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f00b2150 con 0x7fc8f0144d70 2023-09-13T06:11:14.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8ee59c640 1 --2- 172.21.15.130:0/515942586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8f0144d70 0x7fc8f00ce870 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0145150 tx=0x7fc8e001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2f40dfffdc1fbb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:14.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8ed59a640 1 -- 172.21.15.130:0/515942586 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00ab5f0 con 0x7fc8f0144d70 2023-09-13T06:11:14.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8ed59a640 1 -- 172.21.15.130:0/515942586 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e00ab750 con 0x7fc8f0144d70 2023-09-13T06:11:14.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8ed59a640 1 -- 172.21.15.130:0/515942586 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00abae0 con 0x7fc8f0144d70 2023-09-13T06:11:14.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8f4dad640 1 -- 172.21.15.130:0/515942586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8f0144d70 msgr2=0x7fc8f00ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8f4dad640 1 --2- 172.21.15.130:0/515942586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8f0144d70 0x7fc8f00ce870 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0145150 tx=0x7fc8e001c500 comp rx=0 tx=0).stop 2023-09-13T06:11:14.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8f4dad640 1 -- 172.21.15.130:0/515942586 shutdown_connections 2023-09-13T06:11:14.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8f4dad640 1 --2- 172.21.15.130:0/515942586 >> v2:172.21.15.164:3300/0 conn(0x7fc8f00b2780 0x7fc8f00b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8f4dad640 1 --2- 172.21.15.130:0/515942586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8f0144d70 0x7fc8f00ce870 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8f4dad640 1 -- 172.21.15.130:0/515942586 >> 172.21.15.130:0/515942586 conn(0x7fc8f0065990 msgr2=0x7fc8f0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:14.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8f4dad640 1 -- 172.21.15.130:0/515942586 shutdown_connections 2023-09-13T06:11:14.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.377+0000 7fc8f4dad640 1 -- 172.21.15.130:0/515942586 wait complete. 2023-09-13T06:11:14.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8f4dad640 1 Processor -- start 2023-09-13T06:11:14.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8f4dad640 1 -- start start 2023-09-13T06:11:14.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8f4dad640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8f00b1460 0x7fc8f015c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8f4dad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8f00b2780 0x7fc8f00af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8f4dad640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f0144d70 0x7fc8f0137fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8f4dad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f015c070 con 0x7fc8f00b2780 2023-09-13T06:11:14.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8f4dad640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f00afab0 con 0x7fc8f0144d70 2023-09-13T06:11:14.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8f4dad640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f00afd30 con 0x7fc8f00b1460 2023-09-13T06:11:14.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8edd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8f00b2780 0x7fc8f00af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8edd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8f00b2780 0x7fc8f00af570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52716/0 (socket says 172.21.15.130:52716) 2023-09-13T06:11:14.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8edd9b640 1 -- 172.21.15.130:0/2947669179 learned_addr learned my addr 172.21.15.130:0/2947669179 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:14.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8ee59c640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8f00b1460 0x7fc8f015c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8eed9d640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f0144d70 0x7fc8f0137fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8edd9b640 1 -- 172.21.15.130:0/2947669179 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8f00b1460 msgr2=0x7fc8f015c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8edd9b640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8f00b1460 0x7fc8f015c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.387 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8edd9b640 1 -- 172.21.15.130:0/2947669179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f0144d70 msgr2=0x7fc8f0137fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8edd9b640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f0144d70 0x7fc8f0137fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8edd9b640 1 -- 172.21.15.130:0/2947669179 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00094d0 con 0x7fc8f00b2780 2023-09-13T06:11:14.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8ee59c640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8f00b1460 0x7fc8f015c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:14.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8edd9b640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8f00b2780 0x7fc8f00af570 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400e930 tx=0x7fc8e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:14.388 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8deffd640 1 -- 172.21.15.130:0/2947669179 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4009690 con 0x7fc8f00b2780 2023-09-13T06:11:14.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8deffd640 1 -- 172.21.15.130:0/2947669179 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e400ca00 con 0x7fc8f00b2780 2023-09-13T06:11:14.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8deffd640 1 -- 172.21.15.130:0/2947669179 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400cd70 con 0x7fc8f00b2780 2023-09-13T06:11:14.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8f4dad640 1 -- 172.21.15.130:0/2947669179 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f00b0010 con 0x7fc8f00b2780 2023-09-13T06:11:14.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8f4dad640 1 -- 172.21.15.130:0/2947669179 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f00b05d0 con 0x7fc8f00b2780 2023-09-13T06:11:14.389 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.381+0000 7fc8f4dad640 1 -- 172.21.15.130:0/2947669179 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f00618a0 con 0x7fc8f00b2780 2023-09-13T06:11:14.390 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.385+0000 7fc8deffd640 1 -- 172.21.15.130:0/2947669179 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc8e4013470 con 0x7fc8f00b2780 2023-09-13T06:11:14.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.385+0000 7fc8deffd640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc8d0065b20 0x7fc8d0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.385+0000 7fc8deffd640 1 -- 172.21.15.130:0/2947669179 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc8e40832c0 con 0x7fc8f00b2780 2023-09-13T06:11:14.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.385+0000 7fc8ee59c640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc8d0065b20 0x7fc8d0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.385+0000 7fc8ee59c640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc8d0065b20 0x7fc8d0067fe0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00af000 tx=0x7fc8e00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:14.391 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.389+0000 7fc8deffd640 1 -- 172.21.15.130:0/2947669179 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc8e4050f80 con 0x7fc8f00b2780 2023-09-13T06:11:14.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.537+0000 7fc8f4dad640 1 -- 172.21.15.130:0/2947669179 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8f00cbe40 con 0x7fc8f00b2780 2023-09-13T06:11:14.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.537+0000 7fc8deffd640 1 -- 172.21.15.130:0/2947669179 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v167) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8e40545a0 con 0x7fc8f00b2780 2023-09-13T06:11:14.538 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:11:14.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 -- 172.21.15.130:0/2947669179 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc8d0065b20 msgr2=0x7fc8d0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc8d0065b20 0x7fc8d0067fe0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00af000 tx=0x7fc8e00a7000 comp rx=0 tx=0).stop 2023-09-13T06:11:14.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 -- 172.21.15.130:0/2947669179 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8f00b2780 msgr2=0x7fc8f00af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8f00b2780 0x7fc8f00af570 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400e930 tx=0x7fc8e400edf0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 -- 172.21.15.130:0/2947669179 shutdown_connections 2023-09-13T06:11:14.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc8d0065b20 0x7fc8d0067fe0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8f0144d70 0x7fc8f0137fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8f00b2780 0x7fc8f00af570 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 --2- 172.21.15.130:0/2947669179 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8f00b1460 0x7fc8f015c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 -- 172.21.15.130:0/2947669179 >> 172.21.15.130:0/2947669179 conn(0x7fc8f0065990 msgr2=0x7fc8f006b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:14.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 -- 172.21.15.130:0/2947669179 shutdown_connections 2023-09-13T06:11:14.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.541+0000 7fc8f4dad640 1 -- 172.21.15.130:0/2947669179 wait complete. 2023-09-13T06:11:14.559 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T06:11:14.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.697+0000 7f7391e9e640 1 Processor -- start 2023-09-13T06:11:14.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.697+0000 7f7391e9e640 1 -- start start 2023-09-13T06:11:14.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f7391e9e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f738c15d260 0x7f738c0b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f7391e9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738c0ce1a0 0x7f738c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f7391e9e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f738c0afc70 0x7f738c06dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f7391e9e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c070e70 con 0x7f738c0afc70 2023-09-13T06:11:14.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f7391e9e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c070280 con 0x7f738c15d260 2023-09-13T06:11:14.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f7391e9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c070540 con 0x7f738c0ce1a0 2023-09-13T06:11:14.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f738bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f738c0afc70 0x7f738c06dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f738bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f738c0afc70 0x7f738c06dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52722/0 (socket says 172.21.15.130:52722) 2023-09-13T06:11:14.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f738bfff640 1 -- 172.21.15.130:0/3477418511 learned_addr learned my addr 172.21.15.130:0/3477418511 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:14.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f738bfff640 1 -- 172.21.15.130:0/3477418511 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738c0ce1a0 msgr2=0x7f738c06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:14.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f738bfff640 1 --2- 172.21.15.130:0/3477418511 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738c0ce1a0 0x7f738c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f738bfff640 1 -- 172.21.15.130:0/3477418511 >> v2:172.21.15.164:3300/0 conn(0x7f738c15d260 msgr2=0x7f738c0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:14.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f738b7fe640 1 --2- 172.21.15.130:0/3477418511 >> v2:172.21.15.164:3300/0 conn(0x7f738c15d260 0x7f738c0b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f738bfff640 1 --2- 172.21.15.130:0/3477418511 >> v2:172.21.15.164:3300/0 conn(0x7f738c15d260 0x7f738c0b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f738bfff640 1 -- 172.21.15.130:0/3477418511 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c070820 con 0x7f738c0afc70 2023-09-13T06:11:14.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.701+0000 7f738b7fe640 1 --2- 172.21.15.130:0/3477418511 >> v2:172.21.15.164:3300/0 conn(0x7f738c15d260 0x7f738c0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:11:14.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f738bfff640 1 --2- 172.21.15.130:0/3477418511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c0afc70 0x7f738c06dc20 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f738c0b3b00 tx=0x7f738401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647ab3015512f099 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:14.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f738a7fc640 1 -- 172.21.15.130:0/3477418511 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840a5800 con 0x7f738c0afc70 2023-09-13T06:11:14.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f738a7fc640 1 -- 172.21.15.130:0/3477418511 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73840a5960 con 0x7f738c0afc70 2023-09-13T06:11:14.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f738a7fc640 1 -- 172.21.15.130:0/3477418511 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840a5cf0 con 0x7f738c0afc70 2023-09-13T06:11:14.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f7391e9e640 1 -- 172.21.15.130:0/3477418511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c0afc70 msgr2=0x7f738c06dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f7391e9e640 1 --2- 172.21.15.130:0/3477418511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c0afc70 0x7f738c06dc20 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f738c0b3b00 tx=0x7f738401c9a0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f7391e9e640 1 -- 172.21.15.130:0/3477418511 shutdown_connections 2023-09-13T06:11:14.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f7391e9e640 1 --2- 172.21.15.130:0/3477418511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c0afc70 0x7f738c06dc20 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f7391e9e640 1 --2- 172.21.15.130:0/3477418511 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738c0ce1a0 0x7f738c06d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f7391e9e640 1 --2- 172.21.15.130:0/3477418511 >> v2:172.21.15.164:3300/0 conn(0x7f738c15d260 0x7f738c0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f7391e9e640 1 -- 172.21.15.130:0/3477418511 >> 172.21.15.130:0/3477418511 conn(0x7f738c06a2f0 msgr2=0x7f738c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:14.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f7391e9e640 1 -- 172.21.15.130:0/3477418511 shutdown_connections 2023-09-13T06:11:14.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f7391e9e640 1 -- 172.21.15.130:0/3477418511 wait complete. 2023-09-13T06:11:14.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f7391e9e640 1 Processor -- start 2023-09-13T06:11:14.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.705+0000 7f7391e9e640 1 -- start start 2023-09-13T06:11:14.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7391e9e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f738c0afc70 0x7f738c15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7391e9e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738c0ce1a0 0x7f738c15e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7391e9e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15d260 0x7f738c14f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7391e9e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c15eea0 con 0x7f738c15d260 2023-09-13T06:11:14.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7391e9e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c1f9100 con 0x7f738c0afc70 2023-09-13T06:11:14.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7391e9e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c1f93e0 con 0x7f738c0ce1a0 2023-09-13T06:11:14.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f738bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15d260 0x7f738c14f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f738bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15d260 0x7f738c14f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52726/0 (socket says 172.21.15.130:52726) 2023-09-13T06:11:14.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f738bfff640 1 -- 172.21.15.130:0/3757353417 learned_addr learned my addr 172.21.15.130:0/3757353417 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:14.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f738b7fe640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f738c0afc70 0x7f738c15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f738affd640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738c0ce1a0 0x7f738c15e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f738bfff640 1 -- 172.21.15.130:0/3757353417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738c0ce1a0 msgr2=0x7f738c15e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f738bfff640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738c0ce1a0 0x7f738c15e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f738bfff640 1 -- 172.21.15.130:0/3757353417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f738c0afc70 msgr2=0x7f738c15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f738bfff640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f738c0afc70 0x7f738c15d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f738bfff640 1 -- 172.21.15.130:0/3757353417 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7384009b30 con 0x7f738c15d260 2023-09-13T06:11:14.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f738bfff640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15d260 0x7f738c14f930 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f73840af040 tx=0x7f7384019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:14.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7373fff640 1 -- 172.21.15.130:0/3757353417 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840b8670 con 0x7f738c15d260 2023-09-13T06:11:14.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7373fff640 1 -- 172.21.15.130:0/3757353417 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73840b87f0 con 0x7f738c15d260 2023-09-13T06:11:14.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7373fff640 1 -- 172.21.15.130:0/3757353417 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840b8ba0 con 0x7f738c15d260 2023-09-13T06:11:14.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7391e9e640 1 -- 172.21.15.130:0/3757353417 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c1f96c0 con 0x7f738c15d260 2023-09-13T06:11:14.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7391e9e640 1 -- 172.21.15.130:0/3757353417 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c13f130 con 0x7f738c15d260 2023-09-13T06:11:14.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7391e9e640 1 -- 172.21.15.130:0/3757353417 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c0618a0 con 0x7f738c15d260 2023-09-13T06:11:14.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.709+0000 7f7373fff640 1 -- 172.21.15.130:0/3757353417 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f73840b8d00 con 0x7f738c15d260 2023-09-13T06:11:14.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.713+0000 7f7373fff640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7378065b20 0x7f7378067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:14.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.713+0000 7f7373fff640 1 -- 172.21.15.130:0/3757353417 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f738411e5f0 con 0x7f738c15d260 2023-09-13T06:11:14.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.713+0000 7f738b7fe640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7378065b20 0x7f7378067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:14.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.713+0000 7f738b7fe640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7378065b20 0x7f7378067fe0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f737c006fd0 tx=0x7f737c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:14.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.717+0000 7f7373fff640 1 -- 172.21.15.130:0/3757353417 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f73840ec360 con 0x7f738c15d260 2023-09-13T06:11:14.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.865+0000 7f7391e9e640 1 -- 172.21.15.130:0/3757353417 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f738c0cd770 con 0x7f738c15d260 2023-09-13T06:11:14.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.865+0000 7f7373fff640 1 -- 172.21.15.130:0/3757353417 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v167) v1 ==== 84+0+65 (secure 0 0 0) 0x7f73840ef980 con 0x7f738c15d260 2023-09-13T06:11:14.867 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:14.867 INFO:teuthology.orchestra.run.smithi130.stdout:[ 2023-09-13T06:11:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:11:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "poolnum": 1, 2023-09-13T06:11:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: "poolname": ".mgr" 2023-09-13T06:11:14.868 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:11:14.868 INFO:teuthology.orchestra.run.smithi130.stdout:] 2023-09-13T06:11:14.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 -- 172.21.15.130:0/3757353417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7378065b20 msgr2=0x7f7378067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7378065b20 0x7f7378067fe0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f737c006fd0 tx=0x7f737c008040 comp rx=0 tx=0).stop 2023-09-13T06:11:14.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 -- 172.21.15.130:0/3757353417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15d260 msgr2=0x7f738c14f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:14.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15d260 0x7f738c14f930 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f73840af040 tx=0x7f7384019740 comp rx=0 tx=0).stop 2023-09-13T06:11:14.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 -- 172.21.15.130:0/3757353417 shutdown_connections 2023-09-13T06:11:14.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7378065b20 0x7f7378067fe0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15d260 0x7f738c14f930 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f738c0ce1a0 0x7f738c15e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 --2- 172.21.15.130:0/3757353417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f738c0afc70 0x7f738c15d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:14.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 -- 172.21.15.130:0/3757353417 >> 172.21.15.130:0/3757353417 conn(0x7f738c06a2f0 msgr2=0x7f738c155760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:14.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 -- 172.21.15.130:0/3757353417 shutdown_connections 2023-09-13T06:11:14.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:14.869+0000 7f7391e9e640 1 -- 172.21.15.130:0/3757353417 wait complete. 2023-09-13T06:11:14.888 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T06:11:14.888 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T06:11:15.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.029+0000 7fa037d67640 1 Processor -- start 2023-09-13T06:11:15.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.029+0000 7fa037d67640 1 -- start start 2023-09-13T06:11:15.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa037d67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0300b0890 0x7fa0300cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa037d67640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa03015d6d0 0x7fa0300cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa037d67640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa030071440 0x7fa0300b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa037d67640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0300b11b0 con 0x7fa03015d6d0 2023-09-13T06:11:15.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa037d67640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0300ca3d0 con 0x7fa030071440 2023-09-13T06:11:15.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa037d67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300ca6b0 con 0x7fa0300b0890 2023-09-13T06:11:15.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa035302640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa03015d6d0 0x7fa0300cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa035302640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa03015d6d0 0x7fa0300cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52730/0 (socket says 172.21.15.130:52730) 2023-09-13T06:11:15.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa035302640 1 -- 172.21.15.130:0/4117472516 learned_addr learned my addr 172.21.15.130:0/4117472516 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:15.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa036304640 1 --2- 172.21.15.130:0/4117472516 >> v2:172.21.15.164:3300/0 conn(0x7fa030071440 0x7fa0300b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa035b03640 1 --2- 172.21.15.130:0/4117472516 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0300b0890 0x7fa0300cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa035302640 1 -- 172.21.15.130:0/4117472516 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0300b0890 msgr2=0x7fa0300cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:15.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa035302640 1 --2- 172.21.15.130:0/4117472516 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0300b0890 0x7fa0300cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa035302640 1 -- 172.21.15.130:0/4117472516 >> v2:172.21.15.164:3300/0 conn(0x7fa030071440 msgr2=0x7fa0300b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:15.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa035302640 1 --2- 172.21.15.130:0/4117472516 >> v2:172.21.15.164:3300/0 conn(0x7fa030071440 0x7fa0300b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa035302640 1 -- 172.21.15.130:0/4117472516 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0300ca990 con 0x7fa03015d6d0 2023-09-13T06:11:15.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.033+0000 7fa036304640 1 --2- 172.21.15.130:0/4117472516 >> v2:172.21.15.164:3300/0 conn(0x7fa030071440 0x7fa0300b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:15.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa035302640 1 --2- 172.21.15.130:0/4117472516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa03015d6d0 0x7fa0300cb470 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fa0300cd240 tx=0x7fa02001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91a6f93c8c06bf7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:15.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa034b01640 1 -- 172.21.15.130:0/4117472516 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0200aa610 con 0x7fa03015d6d0 2023-09-13T06:11:15.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa034b01640 1 -- 172.21.15.130:0/4117472516 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0200a6040 con 0x7fa03015d6d0 2023-09-13T06:11:15.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa034b01640 1 -- 172.21.15.130:0/4117472516 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0200aa990 con 0x7fa03015d6d0 2023-09-13T06:11:15.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa037d67640 1 -- 172.21.15.130:0/4117472516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa03015d6d0 msgr2=0x7fa0300cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:15.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa037d67640 1 --2- 172.21.15.130:0/4117472516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa03015d6d0 0x7fa0300cb470 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fa0300cd240 tx=0x7fa02001c4d0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa037d67640 1 -- 172.21.15.130:0/4117472516 shutdown_connections 2023-09-13T06:11:15.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa037d67640 1 --2- 172.21.15.130:0/4117472516 >> v2:172.21.15.164:3300/0 conn(0x7fa030071440 0x7fa0300b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa037d67640 1 --2- 172.21.15.130:0/4117472516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa03015d6d0 0x7fa0300cb470 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa037d67640 1 --2- 172.21.15.130:0/4117472516 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa0300b0890 0x7fa0300cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa037d67640 1 -- 172.21.15.130:0/4117472516 >> 172.21.15.130:0/4117472516 conn(0x7fa030065f90 msgr2=0x7fa0300cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:15.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa037d67640 1 -- 172.21.15.130:0/4117472516 shutdown_connections 2023-09-13T06:11:15.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa037d67640 1 -- 172.21.15.130:0/4117472516 wait complete. 2023-09-13T06:11:15.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa037d67640 1 Processor -- start 2023-09-13T06:11:15.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.037+0000 7fa037d67640 1 -- start start 2023-09-13T06:11:15.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa037d67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa030071440 0x7fa030152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.042 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa037d67640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0300b0890 0x7fa03014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa037d67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa03015d6d0 0x7fa0300af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa037d67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300b0720 con 0x7fa03015d6d0 2023-09-13T06:11:15.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa037d67640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300afc00 con 0x7fa0300b0890 2023-09-13T06:11:15.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa037d67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03014ec50 con 0x7fa030071440 2023-09-13T06:11:15.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa036304640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa03015d6d0 0x7fa0300af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa036304640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa03015d6d0 0x7fa0300af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52746/0 (socket says 172.21.15.130:52746) 2023-09-13T06:11:15.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa036304640 1 -- 172.21.15.130:0/2177785156 learned_addr learned my addr 172.21.15.130:0/2177785156 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:15.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa035b03640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa030071440 0x7fa030152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa035302640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0300b0890 0x7fa03014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa036304640 1 -- 172.21.15.130:0/2177785156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa030071440 msgr2=0x7fa030152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:15.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa036304640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa030071440 0x7fa030152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa036304640 1 -- 172.21.15.130:0/2177785156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0300b0890 msgr2=0x7fa03014e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:15.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa036304640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0300b0890 0x7fa03014e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa036304640 1 -- 172.21.15.130:0/2177785156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0200094d0 con 0x7fa03015d6d0 2023-09-13T06:11:15.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa035302640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0300b0890 0x7fa03014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:15.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa036304640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa03015d6d0 0x7fa0300af6c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fa028007e10 tx=0x7fa02800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:15.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa0267fc640 1 -- 172.21.15.130:0/2177785156 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028003ba0 con 0x7fa03015d6d0 2023-09-13T06:11:15.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa0267fc640 1 -- 172.21.15.130:0/2177785156 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02800f040 con 0x7fa03015d6d0 2023-09-13T06:11:15.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa037d67640 1 -- 172.21.15.130:0/2177785156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0300afe80 con 0x7fa03015d6d0 2023-09-13T06:11:15.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa0267fc640 1 -- 172.21.15.130:0/2177785156 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800de80 con 0x7fa03015d6d0 2023-09-13T06:11:15.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa037d67640 1 -- 172.21.15.130:0/2177785156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0300b0440 con 0x7fa03015d6d0 2023-09-13T06:11:15.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa037d67640 1 -- 172.21.15.130:0/2177785156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03014e990 con 0x7fa03015d6d0 2023-09-13T06:11:15.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.041+0000 7fa0267fc640 1 -- 172.21.15.130:0/2177785156 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa028004030 con 0x7fa03015d6d0 2023-09-13T06:11:15.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.045+0000 7fa0267fc640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa014065b20 0x7fa014067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.045+0000 7fa0267fc640 1 -- 172.21.15.130:0/2177785156 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0280833c0 con 0x7fa03015d6d0 2023-09-13T06:11:15.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.045+0000 7fa035b03640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa014065b20 0x7fa014067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.045+0000 7fa035b03640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa014065b20 0x7fa014067fe0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00b9d0 tx=0x7fa02c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:15.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.049+0000 7fa0267fc640 1 -- 172.21.15.130:0/2177785156 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa028050f30 con 0x7fa03015d6d0 2023-09-13T06:11:15.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.197+0000 7fa037d67640 1 -- 172.21.15.130:0/2177785156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa0300618a0 con 0x7fa03015d6d0 2023-09-13T06:11:15.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.685+0000 7fa0267fc640 1 -- 172.21.15.130:0/2177785156 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v168) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa028054550 con 0x7fa03015d6d0 2023-09-13T06:11:15.684 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' created 2023-09-13T06:11:15.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 -- 172.21.15.130:0/2177785156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa014065b20 msgr2=0x7fa014067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:15.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa014065b20 0x7fa014067fe0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00b9d0 tx=0x7fa02c008040 comp rx=0 tx=0).stop 2023-09-13T06:11:15.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 -- 172.21.15.130:0/2177785156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa03015d6d0 msgr2=0x7fa0300af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:15.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa03015d6d0 0x7fa0300af6c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fa028007e10 tx=0x7fa02800d4a0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 -- 172.21.15.130:0/2177785156 shutdown_connections 2023-09-13T06:11:15.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa014065b20 0x7fa014067fe0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0300b0890 0x7fa03014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa03015d6d0 0x7fa0300af6c0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 --2- 172.21.15.130:0/2177785156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa030071440 0x7fa030152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 -- 172.21.15.130:0/2177785156 >> 172.21.15.130:0/2177785156 conn(0x7fa030065f90 msgr2=0x7fa03015bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:15.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 -- 172.21.15.130:0/2177785156 shutdown_connections 2023-09-13T06:11:15.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.689+0000 7fa037d67640 1 -- 172.21.15.130:0/2177785156 wait complete. 2023-09-13T06:11:15.709 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T06:11:15.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.853+0000 7feb0a703640 1 Processor -- start 2023-09-13T06:11:15.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.853+0000 7feb0a703640 1 -- start start 2023-09-13T06:11:15.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.853+0000 7feb0a703640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7feb040b2e90 0x7feb040ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.853+0000 7feb0a703640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb040b1460 0x7feb040b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.853+0000 7feb0a703640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb040b2150 con 0x7feb04144d70 2023-09-13T06:11:15.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.853+0000 7feb0a703640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb040b2430 con 0x7feb040b1460 2023-09-13T06:11:15.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.853+0000 7feb0a703640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb040cedb0 con 0x7feb040b2e90 2023-09-13T06:11:15.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb08ca0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb040b1460 0x7feb040b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb08ca0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb040b1460 0x7feb040b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52760/0 (socket says 172.21.15.130:52760) 2023-09-13T06:11:15.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb08ca0640 1 -- 172.21.15.130:0/1501612388 learned_addr learned my addr 172.21.15.130:0/1501612388 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:15.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb037fe640 1 --2- 172.21.15.130:0/1501612388 >> v2:172.21.15.164:3300/0 conn(0x7feb040b2e90 0x7feb040ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb08ca0640 1 -- 172.21.15.130:0/1501612388 >> v2:172.21.15.164:3300/0 conn(0x7feb040b2e90 msgr2=0x7feb040ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:15.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb08ca0640 1 --2- 172.21.15.130:0/1501612388 >> v2:172.21.15.164:3300/0 conn(0x7feb040b2e90 0x7feb040ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb08ca0640 1 -- 172.21.15.130:0/1501612388 >> v1:172.21.15.164:6789/0 conn(0x7feb04144d70 legacy=0x7feb040b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:15.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb08ca0640 1 -- 172.21.15.130:0/1501612388 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb040cdd90 con 0x7feb040b1460 2023-09-13T06:11:15.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb08ca0640 1 --2- 172.21.15.130:0/1501612388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb040b1460 0x7feb040b18f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7feb04145150 tx=0x7feafc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd545562a215cb23 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:15.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb02ffd640 1 -- 172.21.15.130:0/1501612388 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc0a5780 con 0x7feb040b1460 2023-09-13T06:11:15.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb02ffd640 1 -- 172.21.15.130:0/1501612388 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc0a58e0 con 0x7feb040b1460 2023-09-13T06:11:15.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.857+0000 7feb02ffd640 1 -- 172.21.15.130:0/1501612388 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc0a5c70 con 0x7feb040b1460 2023-09-13T06:11:15.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 -- 172.21.15.130:0/1501612388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb040b1460 msgr2=0x7feb040b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:15.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 --2- 172.21.15.130:0/1501612388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb040b1460 0x7feb040b18f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7feb04145150 tx=0x7feafc01c9d0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 -- 172.21.15.130:0/1501612388 shutdown_connections 2023-09-13T06:11:15.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 --2- 172.21.15.130:0/1501612388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb040b1460 0x7feb040b18f0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 --2- 172.21.15.130:0/1501612388 >> v2:172.21.15.164:3300/0 conn(0x7feb040b2e90 0x7feb040ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 -- 172.21.15.130:0/1501612388 >> 172.21.15.130:0/1501612388 conn(0x7feb04065990 msgr2=0x7feb04065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:15.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 -- 172.21.15.130:0/1501612388 shutdown_connections 2023-09-13T06:11:15.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 -- 172.21.15.130:0/1501612388 wait complete. 2023-09-13T06:11:15.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 Processor -- start 2023-09-13T06:11:15.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 -- start start 2023-09-13T06:11:15.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb040b1460 0x7feb04138670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb040b2e90 0x7feb041598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb04144d70 0x7feb0415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0415d6a0 con 0x7feb040b1460 2023-09-13T06:11:15.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040acca0 con 0x7feb04144d70 2023-09-13T06:11:15.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb0a703640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb04142aa0 con 0x7feb040b2e90 2023-09-13T06:11:15.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb03fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb040b1460 0x7feb04138670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb03fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb040b1460 0x7feb04138670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52770/0 (socket says 172.21.15.130:52770) 2023-09-13T06:11:15.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb03fff640 1 -- 172.21.15.130:0/1483352917 learned_addr learned my addr 172.21.15.130:0/1483352917 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:15.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb08ca0640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb04144d70 0x7feb0415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.861+0000 7feb037fe640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb040b2e90 0x7feb041598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb03fff640 1 -- 172.21.15.130:0/1483352917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb040b2e90 msgr2=0x7feb041598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:15.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb03fff640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb040b2e90 0x7feb041598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb03fff640 1 -- 172.21.15.130:0/1483352917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb04144d70 msgr2=0x7feb0415bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:15.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb03fff640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb04144d70 0x7feb0415bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:15.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb03fff640 1 -- 172.21.15.130:0/1483352917 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc009b30 con 0x7feb040b1460 2023-09-13T06:11:15.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb03fff640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb040b1460 0x7feb04138670 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7feaf400c3c0 tx=0x7feaf400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:15.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb00ff9640 1 -- 172.21.15.130:0/1483352917 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf40052d0 con 0x7feb040b1460 2023-09-13T06:11:15.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb00ff9640 1 -- 172.21.15.130:0/1483352917 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf4005430 con 0x7feb040b1460 2023-09-13T06:11:15.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb0a703640 1 -- 172.21.15.130:0/1483352917 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0415bb00 con 0x7feb040b1460 2023-09-13T06:11:15.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb00ff9640 1 -- 172.21.15.130:0/1483352917 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4003840 con 0x7feb040b1460 2023-09-13T06:11:15.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb0a703640 1 -- 172.21.15.130:0/1483352917 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb040ad190 con 0x7feb040b1460 2023-09-13T06:11:15.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb0a703640 1 -- 172.21.15.130:0/1483352917 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb040618a0 con 0x7feb040b1460 2023-09-13T06:11:15.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb00ff9640 1 -- 172.21.15.130:0/1483352917 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7feaf40039a0 con 0x7feb040b1460 2023-09-13T06:11:15.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb00ff9640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feaf0065b20 0x7feaf0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:15.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb00ff9640 1 -- 172.21.15.130:0/1483352917 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5227+0+0 (secure 0 0 0) 0x7feaf40825c0 con 0x7feb040b1460 2023-09-13T06:11:15.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.865+0000 7feb037fe640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feaf0065b20 0x7feaf0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:15.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.869+0000 7feb037fe640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feaf0065b20 0x7feaf0067fe0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7feb04139020 tx=0x7feaf8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:15.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:15.873+0000 7feb00ff9640 1 -- 172.21.15.130:0/1483352917 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7feaf40501a0 con 0x7feb040b1460 2023-09-13T06:11:15.985 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:11:15.989 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:11:16.022 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.021+0000 7feb0a703640 1 -- 172.21.15.130:0/1483352917 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feb04156f80 con 0x7feb040b1460 2023-09-13T06:11:16.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.689+0000 7feb00ff9640 1 -- 172.21.15.130:0/1483352917 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v169) v1 ==== 170+0+0 (secure 0 0 0) 0x7feaf40537c0 con 0x7feb040b1460 2023-09-13T06:11:16.692 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' created 2023-09-13T06:11:16.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.697+0000 7feb0a703640 1 -- 172.21.15.130:0/1483352917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feaf0065b20 msgr2=0x7feaf0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:16.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.697+0000 7feb0a703640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feaf0065b20 0x7feaf0067fe0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7feb04139020 tx=0x7feaf8009190 comp rx=0 tx=0).stop 2023-09-13T06:11:16.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.697+0000 7feb0a703640 1 -- 172.21.15.130:0/1483352917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb040b1460 msgr2=0x7feb04138670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:16.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.697+0000 7feb0a703640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb040b1460 0x7feb04138670 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7feaf400c3c0 tx=0x7feaf400c880 comp rx=0 tx=0).stop 2023-09-13T06:11:16.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.701+0000 7feb0a703640 1 -- 172.21.15.130:0/1483352917 shutdown_connections 2023-09-13T06:11:16.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.701+0000 7feb0a703640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feaf0065b20 0x7feaf0067fe0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:16.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.701+0000 7feb0a703640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb04144d70 0x7feb0415bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:16.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.701+0000 7feb0a703640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb040b2e90 0x7feb041598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:16.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.701+0000 7feb0a703640 1 --2- 172.21.15.130:0/1483352917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb040b1460 0x7feb04138670 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:16.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.701+0000 7feb0a703640 1 -- 172.21.15.130:0/1483352917 >> 172.21.15.130:0/1483352917 conn(0x7feb04065990 msgr2=0x7feb041573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:16.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.701+0000 7feb0a703640 1 -- 172.21.15.130:0/1483352917 shutdown_connections 2023-09-13T06:11:16.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.701+0000 7feb0a703640 1 -- 172.21.15.130:0/1483352917 wait complete. 2023-09-13T06:11:16.724 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T06:11:16.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde6414d640 1 Processor -- start 2023-09-13T06:11:16.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde6414d640 1 -- start start 2023-09-13T06:11:16.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde6414d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fde5c144d70 0x7fde5c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:16.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde6414d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c0b2150 con 0x7fde5c0b1b70 2023-09-13T06:11:16.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde6414d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c0cdd90 con 0x7fde5c0b2780 2023-09-13T06:11:16.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde6414d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c0b2430 con 0x7fde5c144d70 2023-09-13T06:11:16.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde61ee9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fde5c144d70 0x7fde5c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:16.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde61ee9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fde5c144d70 0x7fde5c0ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52776/0 (socket says 172.21.15.130:52776) 2023-09-13T06:11:16.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde61ee9640 1 -- 172.21.15.130:0/3352990141 learned_addr learned my addr 172.21.15.130:0/3352990141 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:16.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde61ee9640 1 -- 172.21.15.130:0/3352990141 >> v1:172.21.15.164:6789/0 conn(0x7fde5c0b2780 legacy=0x7fde5c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:16.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde61ee9640 1 -- 172.21.15.130:0/3352990141 >> v1:172.21.15.130:6789/0 conn(0x7fde5c0b1b70 legacy=0x7fde5c06ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:16.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde61ee9640 1 -- 172.21.15.130:0/3352990141 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c0ce070 con 0x7fde5c144d70 2023-09-13T06:11:16.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.869+0000 7fde60ee7640 1 -- 172.21.15.130:0/3352990141 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647460707 0 0) 0x7fde5c0b2150 con 0x7fde5c0b1b70 2023-09-13T06:11:16.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.873+0000 7fde61ee9640 1 --2- 172.21.15.130:0/3352990141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5c144d70 0x7fde5c0ce870 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fde58009870 tx=0x7fde5801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8518119649f72b6c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:16.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.873+0000 7fde60ee7640 1 -- 172.21.15.130:0/3352990141 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde580ab600 con 0x7fde5c144d70 2023-09-13T06:11:16.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.873+0000 7fde60ee7640 1 -- 172.21.15.130:0/3352990141 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde580a7050 con 0x7fde5c144d70 2023-09-13T06:11:16.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.873+0000 7fde60ee7640 1 -- 172.21.15.130:0/3352990141 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde580ab980 con 0x7fde5c144d70 2023-09-13T06:11:16.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.873+0000 7fde6414d640 1 -- 172.21.15.130:0/3352990141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5c144d70 msgr2=0x7fde5c0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:16.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.873+0000 7fde6414d640 1 --2- 172.21.15.130:0/3352990141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5c144d70 0x7fde5c0ce870 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fde58009870 tx=0x7fde5801c500 comp rx=0 tx=0).stop 2023-09-13T06:11:16.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.873+0000 7fde6414d640 1 -- 172.21.15.130:0/3352990141 shutdown_connections 2023-09-13T06:11:16.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.873+0000 7fde6414d640 1 --2- 172.21.15.130:0/3352990141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5c144d70 0x7fde5c0ce870 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:16.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.873+0000 7fde6414d640 1 -- 172.21.15.130:0/3352990141 >> 172.21.15.130:0/3352990141 conn(0x7fde5c065990 msgr2=0x7fde5c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:16.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.873+0000 7fde6414d640 1 -- 172.21.15.130:0/3352990141 shutdown_connections 2023-09-13T06:11:16.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.873+0000 7fde6414d640 1 -- 172.21.15.130:0/3352990141 wait complete. 2023-09-13T06:11:16.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde6414d640 1 Processor -- start 2023-09-13T06:11:16.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde6414d640 1 -- start start 2023-09-13T06:11:16.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde6414d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde5c0b1b70 0x7fde5c13b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:16.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde6414d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5c0b2780 0x7fde5c13ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:16.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde6414d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde5c144d70 0x7fde5c14f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:16.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde6414d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c159aa0 con 0x7fde5c0b2780 2023-09-13T06:11:16.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde6414d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c14fa50 con 0x7fde5c0b1b70 2023-09-13T06:11:16.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde6414d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c13b380 con 0x7fde5c144d70 2023-09-13T06:11:16.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde616e8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5c0b2780 0x7fde5c13ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:16.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde616e8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5c0b2780 0x7fde5c13ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52784/0 (socket says 172.21.15.130:52784) 2023-09-13T06:11:16.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde616e8640 1 -- 172.21.15.130:0/1636881440 learned_addr learned my addr 172.21.15.130:0/1636881440 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:16.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde61ee9640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde5c0b1b70 0x7fde5c13b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:16.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde626ea640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde5c144d70 0x7fde5c14f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:16.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde616e8640 1 -- 172.21.15.130:0/1636881440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde5c144d70 msgr2=0x7fde5c14f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:16.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde616e8640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde5c144d70 0x7fde5c14f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:16.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde616e8640 1 -- 172.21.15.130:0/1636881440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde5c0b1b70 msgr2=0x7fde5c13b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:16.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde616e8640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde5c0b1b70 0x7fde5c13b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:16.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde616e8640 1 -- 172.21.15.130:0/1636881440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580094d0 con 0x7fde5c0b2780 2023-09-13T06:11:16.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde616e8640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5c0b2780 0x7fde5c13ab60 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00c480 tx=0x7fde4c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:16.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde527fc640 1 -- 172.21.15.130:0/1636881440 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c012830 con 0x7fde5c0b2780 2023-09-13T06:11:16.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde527fc640 1 -- 172.21.15.130:0/1636881440 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c0129b0 con 0x7fde5c0b2780 2023-09-13T06:11:16.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde6414d640 1 -- 172.21.15.130:0/1636881440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c159cf0 con 0x7fde5c0b2780 2023-09-13T06:11:16.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde527fc640 1 -- 172.21.15.130:0/1636881440 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c012d60 con 0x7fde5c0b2780 2023-09-13T06:11:16.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde6414d640 1 -- 172.21.15.130:0/1636881440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c15a2b0 con 0x7fde5c0b2780 2023-09-13T06:11:16.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.877+0000 7fde6414d640 1 -- 172.21.15.130:0/1636881440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c15a4d0 con 0x7fde5c0b2780 2023-09-13T06:11:16.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.881+0000 7fde527fc640 1 -- 172.21.15.130:0/1636881440 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fde4c01c460 con 0x7fde5c0b2780 2023-09-13T06:11:16.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.881+0000 7fde527fc640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde40065b20 0x7fde40067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:16.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.881+0000 7fde527fc640 1 -- 172.21.15.130:0/1636881440 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fde4c082fe0 con 0x7fde5c0b2780 2023-09-13T06:11:16.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.881+0000 7fde61ee9640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde40065b20 0x7fde40067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:16.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.881+0000 7fde61ee9640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde40065b20 0x7fde40067fe0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fde580ad000 tx=0x7fde580a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:16.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:16.885+0000 7fde527fc640 1 -- 172.21.15.130:0/1636881440 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fde4c050a90 con 0x7fde5c0b2780 2023-09-13T06:11:17.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.065+0000 7fde6414d640 1 -- 172.21.15.130:0/1636881440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fde5c0618a0 con 0x7fde5c0b2780 2023-09-13T06:11:17.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.717+0000 7fde527fc640 1 -- 172.21.15.130:0/1636881440 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v80) v1 ==== 174+0+0 (secure 0 0 0) 0x7fde4c0540b0 con 0x7fde5c0b2780 2023-09-13T06:11:17.719 INFO:teuthology.orchestra.run.smithi130.stderr:new fs with metadata pool 20 and data pool 21 2023-09-13T06:11:17.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 -- 172.21.15.130:0/1636881440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde40065b20 msgr2=0x7fde40067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:17.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde40065b20 0x7fde40067fe0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fde580ad000 tx=0x7fde580a6000 comp rx=0 tx=0).stop 2023-09-13T06:11:17.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 -- 172.21.15.130:0/1636881440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5c0b2780 msgr2=0x7fde5c13ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:17.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5c0b2780 0x7fde5c13ab60 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00c480 tx=0x7fde4c00c940 comp rx=0 tx=0).stop 2023-09-13T06:11:17.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 -- 172.21.15.130:0/1636881440 shutdown_connections 2023-09-13T06:11:17.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fde40065b20 0x7fde40067fe0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:17.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde5c144d70 0x7fde5c14f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:17.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5c0b2780 0x7fde5c13ab60 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:17.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 --2- 172.21.15.130:0/1636881440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde5c0b1b70 0x7fde5c13b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:17.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 -- 172.21.15.130:0/1636881440 >> 172.21.15.130:0/1636881440 conn(0x7fde5c065990 msgr2=0x7fde5c13c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:17.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 -- 172.21.15.130:0/1636881440 shutdown_connections 2023-09-13T06:11:17.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.721+0000 7fde6414d640 1 -- 172.21.15.130:0/1636881440 wait complete. 2023-09-13T06:11:17.746 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:11:17.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8779996640 1 Processor -- start 2023-09-13T06:11:17.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8779996640 1 -- start start 2023-09-13T06:11:17.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8779996640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f87740d1750 0x7f877415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:17.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8779996640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f87740d1090 0x7f8774146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:17.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8779996640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87740b63c0 con 0x7f87740d1b30 2023-09-13T06:11:17.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8779996640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877415dea0 con 0x7f87740d1750 2023-09-13T06:11:17.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8779996640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87740d0c20 con 0x7f87740d1090 2023-09-13T06:11:17.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8772ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f87740d1750 0x7f877415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:17.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8772ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f87740d1750 0x7f877415d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52786/0 (socket says 172.21.15.130:52786) 2023-09-13T06:11:17.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8772ffd640 1 -- 172.21.15.130:0/1029224091 learned_addr learned my addr 172.21.15.130:0/1029224091 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:17.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f87727fc640 1 --2- 172.21.15.130:0/1029224091 >> v2:172.21.15.164:3300/0 conn(0x7f87740d1090 0x7f8774146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:17.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8772ffd640 1 -- 172.21.15.130:0/1029224091 >> v2:172.21.15.164:3300/0 conn(0x7f87740d1090 msgr2=0x7f8774146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:17.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8772ffd640 1 --2- 172.21.15.130:0/1029224091 >> v2:172.21.15.164:3300/0 conn(0x7f87740d1090 0x7f8774146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:17.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8772ffd640 1 -- 172.21.15.130:0/1029224091 >> v1:172.21.15.130:6789/0 conn(0x7f87740d1b30 legacy=0x7f87740b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:17.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f8772ffd640 1 -- 172.21.15.130:0/1029224091 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87740b6610 con 0x7f87740d1750 2023-09-13T06:11:17.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.885+0000 7f87727fc640 1 --2- 172.21.15.130:0/1029224091 >> v2:172.21.15.164:3300/0 conn(0x7f87740d1090 0x7f8774146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:11:17.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8772ffd640 1 --2- 172.21.15.130:0/1029224091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87740d1750 0x7f877415d960 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f87740c8360 tx=0x7f876401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9a628e031185e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:17.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8771ffb640 1 -- 172.21.15.130:0/1029224091 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87640aa430 con 0x7f87740d1750 2023-09-13T06:11:17.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8771ffb640 1 -- 172.21.15.130:0/1029224091 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87640aa590 con 0x7f87740d1750 2023-09-13T06:11:17.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8771ffb640 1 -- 172.21.15.130:0/1029224091 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87640aa920 con 0x7f87740d1750 2023-09-13T06:11:17.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8779996640 1 -- 172.21.15.130:0/1029224091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87740d1750 msgr2=0x7f877415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:17.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8779996640 1 --2- 172.21.15.130:0/1029224091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87740d1750 0x7f877415d960 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f87740c8360 tx=0x7f876401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:11:17.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8779996640 1 -- 172.21.15.130:0/1029224091 shutdown_connections 2023-09-13T06:11:17.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8779996640 1 --2- 172.21.15.130:0/1029224091 >> v2:172.21.15.164:3300/0 conn(0x7f87740d1090 0x7f8774146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:17.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8779996640 1 --2- 172.21.15.130:0/1029224091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87740d1750 0x7f877415d960 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:17.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8779996640 1 -- 172.21.15.130:0/1029224091 >> 172.21.15.130:0/1029224091 conn(0x7f877406f170 msgr2=0x7f877406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:17.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8779996640 1 -- 172.21.15.130:0/1029224091 shutdown_connections 2023-09-13T06:11:17.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.889+0000 7f8779996640 1 -- 172.21.15.130:0/1029224091 wait complete. 2023-09-13T06:11:17.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f8779996640 1 Processor -- start 2023-09-13T06:11:17.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f8779996640 1 -- start start 2023-09-13T06:11:17.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f8779996640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87740d1090 0x7f877415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:17.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f8779996640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87740d1750 0x7f877413a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:17.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f8779996640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87740d1b30 0x7f877413be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:17.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f8779996640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877415b280 con 0x7f87740d1750 2023-09-13T06:11:17.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f8779996640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877415b3e0 con 0x7f87740d1b30 2023-09-13T06:11:17.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f8779996640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877415c200 con 0x7f87740d1090 2023-09-13T06:11:17.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f87727fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87740d1750 0x7f877413a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:17.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f87727fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87740d1750 0x7f877413a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52790/0 (socket says 172.21.15.130:52790) 2023-09-13T06:11:17.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f87727fc640 1 -- 172.21.15.130:0/767324408 learned_addr learned my addr 172.21.15.130:0/767324408 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:17.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f87737fe640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87740d1b30 0x7f877413be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:17.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f8772ffd640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87740d1090 0x7f877415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:17.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f87727fc640 1 -- 172.21.15.130:0/767324408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87740d1090 msgr2=0x7f877415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:17.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f87727fc640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87740d1090 0x7f877415ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:17.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f87727fc640 1 -- 172.21.15.130:0/767324408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87740d1b30 msgr2=0x7f877413be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:17.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f87727fc640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87740d1b30 0x7f877413be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:17.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f87727fc640 1 -- 172.21.15.130:0/767324408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87640094d0 con 0x7f87740d1750 2023-09-13T06:11:17.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f87727fc640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87740d1750 0x7f877413a2e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f876800c7f0 tx=0x7f876800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:17.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f875bfff640 1 -- 172.21.15.130:0/767324408 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768007820 con 0x7f87740d1750 2023-09-13T06:11:17.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f875bfff640 1 -- 172.21.15.130:0/767324408 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768007980 con 0x7f87740d1750 2023-09-13T06:11:17.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f8779996640 1 -- 172.21.15.130:0/767324408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877415b5f0 con 0x7f87740d1750 2023-09-13T06:11:17.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f875bfff640 1 -- 172.21.15.130:0/767324408 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768007cf0 con 0x7f87740d1750 2023-09-13T06:11:17.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.893+0000 7f8779996640 1 -- 172.21.15.130:0/767324408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877415bbb0 con 0x7f87740d1750 2023-09-13T06:11:17.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.897+0000 7f8779996640 1 -- 172.21.15.130:0/767324408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877415c370 con 0x7f87740d1750 2023-09-13T06:11:17.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.897+0000 7f875bfff640 1 -- 172.21.15.130:0/767324408 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f87680113f0 con 0x7f87740d1750 2023-09-13T06:11:17.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.897+0000 7f875bfff640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8760065b20 0x7f8760067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:17.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.897+0000 7f875bfff640 1 -- 172.21.15.130:0/767324408 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8768083510 con 0x7f87740d1750 2023-09-13T06:11:17.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.897+0000 7f8772ffd640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8760065b20 0x7f8760067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:17.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.897+0000 7f8772ffd640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8760065b20 0x7f8760067fe0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f87640ae000 tx=0x7f87640a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:17.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:17.901+0000 7f875bfff640 1 -- 172.21.15.130:0/767324408 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8768050f00 con 0x7f87740d1750 2023-09-13T06:11:18.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.049+0000 7f8779996640 1 -- 172.21.15.130:0/767324408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87740618a0 con 0x7f87740d1750 2023-09-13T06:11:18.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.049+0000 7f875bfff640 1 -- 172.21.15.130:0/767324408 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f8768054520 con 0x7f87740d1750 2023-09-13T06:11:18.051 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:18.052 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":170,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:11:17.067630+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:11:15.244077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-09-13T06:11:16.070064+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:11:18.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 -- 172.21.15.130:0/767324408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8760065b20 msgr2=0x7f8760067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8760065b20 0x7f8760067fe0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f87640ae000 tx=0x7f87640a7000 comp rx=0 tx=0).stop 2023-09-13T06:11:18.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 -- 172.21.15.130:0/767324408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87740d1750 msgr2=0x7f877413a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87740d1750 0x7f877413a2e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f876800c7f0 tx=0x7f876800ccb0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 -- 172.21.15.130:0/767324408 shutdown_connections 2023-09-13T06:11:18.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8760065b20 0x7f8760067fe0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87740d1b30 0x7f877413be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87740d1750 0x7f877413a2e0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 --2- 172.21.15.130:0/767324408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87740d1090 0x7f877415ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 -- 172.21.15.130:0/767324408 >> 172.21.15.130:0/767324408 conn(0x7f877406f170 msgr2=0x7f877413f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:18.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 -- 172.21.15.130:0/767324408 shutdown_connections 2023-09-13T06:11:18.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.053+0000 7f8779996640 1 -- 172.21.15.130:0/767324408 wait complete. 2023-09-13T06:11:18.074 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:11:18.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a6acf9640 1 Processor -- start 2023-09-13T06:11:18.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a6acf9640 1 -- start start 2023-09-13T06:11:18.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a6acf9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a640d1090 0x7f6a6415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:18.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a6acf9640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6a64146f30 0x7f6a640b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:18.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a6acf9640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a640b63c0 con 0x7f6a640d1750 2023-09-13T06:11:18.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a6acf9640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6415dea0 con 0x7f6a64146f30 2023-09-13T06:11:18.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a6acf9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640d0c20 con 0x7f6a640d1090 2023-09-13T06:11:18.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a69296640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6a64146f30 0x7f6a640b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:18.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a5bfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a640d1090 0x7f6a6415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:18.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a68a95640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f6a640d1750 0x7f6a64146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:45670/0 (socket says 172.21.15.130:45670) 2023-09-13T06:11:18.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a68a95640 1 -- 172.21.15.130:0/898054946 learned_addr learned my addr 172.21.15.130:0/898054946 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:18.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a69296640 1 -- 172.21.15.130:0/898054946 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a640d1090 msgr2=0x7f6a6415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:18.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a69296640 1 --2- 172.21.15.130:0/898054946 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a640d1090 0x7f6a6415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a69296640 1 -- 172.21.15.130:0/898054946 >> v1:172.21.15.164:6789/0 conn(0x7f6a640d1750 legacy=0x7f6a64146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.213+0000 7f6a69296640 1 -- 172.21.15.130:0/898054946 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a640b6610 con 0x7f6a64146f30 2023-09-13T06:11:18.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a69296640 1 --2- 172.21.15.130:0/898054946 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a64146f30 0x7f6a640b70f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009d90 tx=0x7f6a5c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d95d1fb47c27f720 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:18.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a5b7fe640 1 -- 172.21.15.130:0/898054946 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0a59e0 con 0x7f6a64146f30 2023-09-13T06:11:18.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a5b7fe640 1 -- 172.21.15.130:0/898054946 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c0a5b40 con 0x7f6a64146f30 2023-09-13T06:11:18.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a5b7fe640 1 -- 172.21.15.130:0/898054946 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0ad440 con 0x7f6a64146f30 2023-09-13T06:11:18.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a6acf9640 1 -- 172.21.15.130:0/898054946 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a64146f30 msgr2=0x7f6a640b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a6acf9640 1 --2- 172.21.15.130:0/898054946 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a64146f30 0x7f6a640b70f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009d90 tx=0x7f6a5c01c920 comp rx=0 tx=0).stop 2023-09-13T06:11:18.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a6acf9640 1 -- 172.21.15.130:0/898054946 shutdown_connections 2023-09-13T06:11:18.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a6acf9640 1 --2- 172.21.15.130:0/898054946 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a64146f30 0x7f6a640b70f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a6acf9640 1 --2- 172.21.15.130:0/898054946 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a640d1090 0x7f6a6415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a6acf9640 1 -- 172.21.15.130:0/898054946 >> 172.21.15.130:0/898054946 conn(0x7f6a6406f170 msgr2=0x7f6a6406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:18.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a6acf9640 1 -- 172.21.15.130:0/898054946 shutdown_connections 2023-09-13T06:11:18.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.217+0000 7f6a6acf9640 1 -- 172.21.15.130:0/898054946 wait complete. 2023-09-13T06:11:18.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a6acf9640 1 Processor -- start 2023-09-13T06:11:18.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a6acf9640 1 -- start start 2023-09-13T06:11:18.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a6acf9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a640d1090 0x7f6a64143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:18.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a6acf9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a640d1750 0x7f6a6415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:18.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a6acf9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a64146f30 0x7f6a641648f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:18.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a6acf9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a641450a0 con 0x7f6a64146f30 2023-09-13T06:11:18.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a6acf9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a641441f0 con 0x7f6a640d1090 2023-09-13T06:11:18.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a6acf9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6415d300 con 0x7f6a640d1750 2023-09-13T06:11:18.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a69296640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a64146f30 0x7f6a641648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:18.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a69296640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a64146f30 0x7f6a641648f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52798/0 (socket says 172.21.15.130:52798) 2023-09-13T06:11:18.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a69296640 1 -- 172.21.15.130:0/665639458 learned_addr learned my addr 172.21.15.130:0/665639458 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:18.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a68a95640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a640d1090 0x7f6a64143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:18.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a5bfff640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a640d1750 0x7f6a6415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:18.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a69296640 1 -- 172.21.15.130:0/665639458 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a640d1750 msgr2=0x7f6a6415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a69296640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a640d1750 0x7f6a6415cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a69296640 1 -- 172.21.15.130:0/665639458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a640d1090 msgr2=0x7f6a64143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a69296640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a640d1090 0x7f6a64143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a69296640 1 -- 172.21.15.130:0/665639458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c009a70 con 0x7f6a64146f30 2023-09-13T06:11:18.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a69296640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a64146f30 0x7f6a641648f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0b0040 tx=0x7f6a5c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:18.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a597fa640 1 -- 172.21.15.130:0/665639458 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0add90 con 0x7f6a64146f30 2023-09-13T06:11:18.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a597fa640 1 -- 172.21.15.130:0/665639458 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c009450 con 0x7f6a64146f30 2023-09-13T06:11:18.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a597fa640 1 -- 172.21.15.130:0/665639458 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0b9690 con 0x7f6a64146f30 2023-09-13T06:11:18.229 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a6acf9640 1 -- 172.21.15.130:0/665639458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a640b7e40 con 0x7f6a64146f30 2023-09-13T06:11:18.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.221+0000 7f6a6acf9640 1 -- 172.21.15.130:0/665639458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a64144770 con 0x7f6a64146f30 2023-09-13T06:11:18.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.225+0000 7f6a6acf9640 1 -- 172.21.15.130:0/665639458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a64145210 con 0x7f6a64146f30 2023-09-13T06:11:18.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.225+0000 7f6a597fa640 1 -- 172.21.15.130:0/665639458 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6a5c0b97f0 con 0x7f6a64146f30 2023-09-13T06:11:18.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.225+0000 7f6a597fa640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a50065b20 0x7f6a50067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:18.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.225+0000 7f6a597fa640 1 -- 172.21.15.130:0/665639458 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a5c11eb40 con 0x7f6a64146f30 2023-09-13T06:11:18.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.225+0000 7f6a68a95640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a50065b20 0x7f6a50067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:18.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.225+0000 7f6a68a95640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a50065b20 0x7f6a50067fe0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6a60005890 tx=0x7f6a60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:18.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.229+0000 7f6a597fa640 1 -- 172.21.15.130:0/665639458 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6a5c0ec510 con 0x7f6a64146f30 2023-09-13T06:11:18.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.381+0000 7f6a6acf9640 1 -- 172.21.15.130:0/665639458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a640618a0 con 0x7f6a64146f30 2023-09-13T06:11:18.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.381+0000 7f6a597fa640 1 -- 172.21.15.130:0/665639458 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f6a5c0efb30 con 0x7f6a64146f30 2023-09-13T06:11:18.382 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:18.382 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":170,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:11:17.067630+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:11:15.244077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-09-13T06:11:16.070064+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:11:18.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 -- 172.21.15.130:0/665639458 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a50065b20 msgr2=0x7f6a50067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a50065b20 0x7f6a50067fe0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6a60005890 tx=0x7f6a60009040 comp rx=0 tx=0).stop 2023-09-13T06:11:18.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 -- 172.21.15.130:0/665639458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a64146f30 msgr2=0x7f6a641648f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a64146f30 0x7f6a641648f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0b0040 tx=0x7f6a5c0196c0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 -- 172.21.15.130:0/665639458 shutdown_connections 2023-09-13T06:11:18.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a50065b20 0x7f6a50067fe0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a64146f30 0x7f6a641648f0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a640d1750 0x7f6a6415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 --2- 172.21.15.130:0/665639458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a640d1090 0x7f6a64143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 -- 172.21.15.130:0/665639458 >> 172.21.15.130:0/665639458 conn(0x7f6a6406f170 msgr2=0x7f6a640cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:18.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 -- 172.21.15.130:0/665639458 shutdown_connections 2023-09-13T06:11:18.386 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.385+0000 7f6a6acf9640 1 -- 172.21.15.130:0/665639458 wait complete. 2023-09-13T06:11:18.403 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T06:11:18.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f116d92c640 1 Processor -- start 2023-09-13T06:11:18.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f116d92c640 1 -- start start 2023-09-13T06:11:18.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f116d92c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f116815a080 0x7f11680b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:18.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f116d92c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11680cc850 con 0x7f116815e650 2023-09-13T06:11:18.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f116d92c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11680b0330 con 0x7f11680b31a0 2023-09-13T06:11:18.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f116d92c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11680cbcd0 con 0x7f116815a080 2023-09-13T06:11:18.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f115e7fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f116815e650 0x7f11680b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35702/0 (socket says 172.21.15.130:35702) 2023-09-13T06:11:18.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f115e7fc640 1 -- 172.21.15.130:0/435262121 learned_addr learned my addr 172.21.15.130:0/435262121 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:18.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f1166ffd640 1 --2- 172.21.15.130:0/435262121 >> v2:172.21.15.164:3300/0 conn(0x7f116815a080 0x7f11680b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:18.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f11667fc640 1 -- 172.21.15.130:0/435262121 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034610338 0 0) 0x7f1150001120 con 0x7f116815e650 2023-09-13T06:11:18.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f11667fc640 1 -- 172.21.15.130:0/435262121 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1154003530 con 0x7f116815e650 2023-09-13T06:11:18.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f11667fc640 1 -- 172.21.15.130:0/435262121 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326852975 0 0) 0x7f11680b0330 con 0x7f11680b31a0 2023-09-13T06:11:18.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f11667fc640 1 -- 172.21.15.130:0/435262121 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1150001120 con 0x7f11680b31a0 2023-09-13T06:11:18.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f1166ffd640 1 -- 172.21.15.130:0/435262121 >> v1:172.21.15.164:6789/0 conn(0x7f11680b31a0 legacy=0x7f11680ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f1166ffd640 1 -- 172.21.15.130:0/435262121 >> v1:172.21.15.130:6789/0 conn(0x7f116815e650 legacy=0x7f11680b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.545+0000 7f1166ffd640 1 -- 172.21.15.130:0/435262121 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11680cbfb0 con 0x7f116815a080 2023-09-13T06:11:18.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.549+0000 7f1166ffd640 1 --2- 172.21.15.130:0/435262121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f116815a080 0x7f11680b1460 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f11580097c0 tx=0x7f115801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33417eadd4c2602c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:18.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.549+0000 7f11667fc640 1 -- 172.21.15.130:0/435262121 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580ab600 con 0x7f116815a080 2023-09-13T06:11:18.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.549+0000 7f11667fc640 1 -- 172.21.15.130:0/435262121 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11580a7050 con 0x7f116815a080 2023-09-13T06:11:18.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.549+0000 7f11667fc640 1 -- 172.21.15.130:0/435262121 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580ab980 con 0x7f116815a080 2023-09-13T06:11:18.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.549+0000 7f116d92c640 1 -- 172.21.15.130:0/435262121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f116815a080 msgr2=0x7f11680b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.549+0000 7f116d92c640 1 --2- 172.21.15.130:0/435262121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f116815a080 0x7f11680b1460 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f11580097c0 tx=0x7f115801c390 comp rx=0 tx=0).stop 2023-09-13T06:11:18.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.549+0000 7f116d92c640 1 -- 172.21.15.130:0/435262121 shutdown_connections 2023-09-13T06:11:18.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.549+0000 7f116d92c640 1 --2- 172.21.15.130:0/435262121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f116815a080 0x7f11680b1460 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.549+0000 7f116d92c640 1 -- 172.21.15.130:0/435262121 >> 172.21.15.130:0/435262121 conn(0x7f1168065990 msgr2=0x7f1168065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:18.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.549+0000 7f116d92c640 1 -- 172.21.15.130:0/435262121 shutdown_connections 2023-09-13T06:11:18.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.549+0000 7f116d92c640 1 -- 172.21.15.130:0/435262121 wait complete. 2023-09-13T06:11:18.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f116d92c640 1 Processor -- start 2023-09-13T06:11:18.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f116d92c640 1 -- start start 2023-09-13T06:11:18.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f116d92c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11680b31a0 0x7f116814ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:18.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f116d92c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f116815a080 0x7f116814c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:18.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f116d92c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f116815e650 0x7f116814df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:18.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f116d92c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116814c9a0 con 0x7f116815e650 2023-09-13T06:11:18.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f116d92c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11681475f0 con 0x7f116815a080 2023-09-13T06:11:18.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f116d92c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11681478d0 con 0x7f11680b31a0 2023-09-13T06:11:18.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f11677fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f116815e650 0x7f116814df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:18.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f11677fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f116815e650 0x7f116814df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52800/0 (socket says 172.21.15.130:52800) 2023-09-13T06:11:18.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f11677fe640 1 -- 172.21.15.130:0/2203233751 learned_addr learned my addr 172.21.15.130:0/2203233751 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:18.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f1166ffd640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11680b31a0 0x7f116814ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:18.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f115e7fc640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f116815a080 0x7f116814c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:18.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f11677fe640 1 -- 172.21.15.130:0/2203233751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11680b31a0 msgr2=0x7f116814ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f11677fe640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11680b31a0 0x7f116814ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f11677fe640 1 -- 172.21.15.130:0/2203233751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f116815a080 msgr2=0x7f116814c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:18.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f11677fe640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f116815a080 0x7f116814c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:18.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f11677fe640 1 -- 172.21.15.130:0/2203233751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1158009420 con 0x7f116815e650 2023-09-13T06:11:18.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f115e7fc640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f116815a080 0x7f116814c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:11:18.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f11677fe640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f116815e650 0x7f116814df20 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f116000c790 tx=0x7f116000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:18.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f1164ff9640 1 -- 172.21.15.130:0/2203233751 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000cea0 con 0x7f116815e650 2023-09-13T06:11:18.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f1164ff9640 1 -- 172.21.15.130:0/2203233751 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1160003b80 con 0x7f116815e650 2023-09-13T06:11:18.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f116d92c640 1 -- 172.21.15.130:0/2203233751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1168147bb0 con 0x7f116815e650 2023-09-13T06:11:18.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f1164ff9640 1 -- 172.21.15.130:0/2203233751 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000a850 con 0x7f116815e650 2023-09-13T06:11:18.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.553+0000 7f116d92c640 1 -- 172.21.15.130:0/2203233751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1168148170 con 0x7f116815e650 2023-09-13T06:11:18.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.557+0000 7f116d92c640 1 -- 172.21.15.130:0/2203233751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116815ea60 con 0x7f116815e650 2023-09-13T06:11:18.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.557+0000 7f1164ff9640 1 -- 172.21.15.130:0/2203233751 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f116000a9b0 con 0x7f116815e650 2023-09-13T06:11:18.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.557+0000 7f1164ff9640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1148065b20 0x7f1148067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:18.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.557+0000 7f1164ff9640 1 -- 172.21.15.130:0/2203233751 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11600831e0 con 0x7f116815e650 2023-09-13T06:11:18.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.557+0000 7f1166ffd640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1148065b20 0x7f1148067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:18.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.557+0000 7f1166ffd640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1148065b20 0x7f1148067fe0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f11580ad000 tx=0x7f11580a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:18.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.561+0000 7f1164ff9640 1 -- 172.21.15.130:0/2203233751 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f116815ea60 con 0x7f116815e650 2023-09-13T06:11:18.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:18.749+0000 7f116d92c640 1 -- 172.21.15.130:0/2203233751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f116815ea60 con 0x7f116815e650 2023-09-13T06:11:19.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.741+0000 7f1164ff9640 1 -- 172.21.15.130:0/2203233751 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) v1 ==== 118+0+0 (secure 0 0 0) 0x7f116815ea60 con 0x7f116815e650 2023-09-13T06:11:19.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 -- 172.21.15.130:0/2203233751 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1148065b20 msgr2=0x7f1148067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:19.744 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1148065b20 0x7f1148067fe0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f11580ad000 tx=0x7f11580a4f90 comp rx=0 tx=0).stop 2023-09-13T06:11:19.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 -- 172.21.15.130:0/2203233751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f116815e650 msgr2=0x7f116814df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:19.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f116815e650 0x7f116814df20 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f116000c790 tx=0x7f116000cc50 comp rx=0 tx=0).stop 2023-09-13T06:11:19.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 -- 172.21.15.130:0/2203233751 shutdown_connections 2023-09-13T06:11:19.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1148065b20 0x7f1148067fe0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:19.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f116815a080 0x7f116814c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:19.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f116815e650 0x7f116814df20 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:19.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 --2- 172.21.15.130:0/2203233751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11680b31a0 0x7f116814ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:19.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 -- 172.21.15.130:0/2203233751 >> 172.21.15.130:0/2203233751 conn(0x7f1168065990 msgr2=0x7f116815d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:19.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 -- 172.21.15.130:0/2203233751 shutdown_connections 2023-09-13T06:11:19.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.745+0000 7f116d92c640 1 -- 172.21.15.130:0/2203233751 wait complete. 2023-09-13T06:11:19.767 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T06:11:19.767 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T06:11:19.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.909+0000 7f7efba19640 1 Processor -- start 2023-09-13T06:11:19.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7efba19640 1 -- start start 2023-09-13T06:11:19.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7efba19640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7ef4144d70 0x7f7ef40ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:19.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7efba19640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ef40b2780 0x7f7ef40b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:19.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7efba19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ef40b1460 0x7f7ef40b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:19.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7efba19640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef40b2430 con 0x7f7ef40b2780 2023-09-13T06:11:19.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7efba19640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef40cedb0 con 0x7f7ef4144d70 2023-09-13T06:11:19.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7efba19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40b3120 con 0x7f7ef40b1460 2023-09-13T06:11:19.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7ef8fb4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ef40b2780 0x7f7ef40b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:19.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7ef8fb4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ef40b2780 0x7f7ef40b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52812/0 (socket says 172.21.15.130:52812) 2023-09-13T06:11:19.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7ef8fb4640 1 -- 172.21.15.130:0/2416537379 learned_addr learned my addr 172.21.15.130:0/2416537379 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:19.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7ef9fb6640 1 --2- 172.21.15.130:0/2416537379 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ef40b1460 0x7f7ef40b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:19.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7ef97b5640 1 --2- 172.21.15.130:0/2416537379 >> v2:172.21.15.164:3300/0 conn(0x7f7ef4144d70 0x7f7ef40ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:19.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7ef8fb4640 1 -- 172.21.15.130:0/2416537379 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ef40b1460 msgr2=0x7f7ef40b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:19.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7ef8fb4640 1 --2- 172.21.15.130:0/2416537379 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ef40b1460 0x7f7ef40b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:19.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7ef8fb4640 1 -- 172.21.15.130:0/2416537379 >> v2:172.21.15.164:3300/0 conn(0x7f7ef4144d70 msgr2=0x7f7ef40ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:19.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7ef8fb4640 1 --2- 172.21.15.130:0/2416537379 >> v2:172.21.15.164:3300/0 conn(0x7f7ef4144d70 0x7f7ef40ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:19.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.913+0000 7f7ef8fb4640 1 -- 172.21.15.130:0/2416537379 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef40b2150 con 0x7f7ef40b2780 2023-09-13T06:11:19.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7ef8fb4640 1 --2- 172.21.15.130:0/2416537379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ef40b2780 0x7f7ef40b2be0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40cff90 tx=0x7f7ee401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ecfeb1bad98055 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:19.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7eebfff640 1 -- 172.21.15.130:0/2416537379 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40ac410 con 0x7f7ef40b2780 2023-09-13T06:11:19.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7eebfff640 1 -- 172.21.15.130:0/2416537379 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee40ac570 con 0x7f7ef40b2780 2023-09-13T06:11:19.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7eebfff640 1 -- 172.21.15.130:0/2416537379 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40ac900 con 0x7f7ef40b2780 2023-09-13T06:11:19.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7efba19640 1 -- 172.21.15.130:0/2416537379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ef40b2780 msgr2=0x7f7ef40b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:19.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7efba19640 1 --2- 172.21.15.130:0/2416537379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ef40b2780 0x7f7ef40b2be0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40cff90 tx=0x7f7ee401c500 comp rx=0 tx=0).stop 2023-09-13T06:11:19.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7efba19640 1 -- 172.21.15.130:0/2416537379 shutdown_connections 2023-09-13T06:11:19.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7efba19640 1 --2- 172.21.15.130:0/2416537379 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ef40b1460 0x7f7ef40b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:19.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7efba19640 1 --2- 172.21.15.130:0/2416537379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ef40b2780 0x7f7ef40b2be0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:19.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7efba19640 1 --2- 172.21.15.130:0/2416537379 >> v2:172.21.15.164:3300/0 conn(0x7f7ef4144d70 0x7f7ef40ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:19.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7efba19640 1 -- 172.21.15.130:0/2416537379 >> 172.21.15.130:0/2416537379 conn(0x7f7ef4065990 msgr2=0x7f7ef4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:19.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7efba19640 1 -- 172.21.15.130:0/2416537379 shutdown_connections 2023-09-13T06:11:19.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7efba19640 1 -- 172.21.15.130:0/2416537379 wait complete. 2023-09-13T06:11:19.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.917+0000 7f7efba19640 1 Processor -- start 2023-09-13T06:11:19.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7efba19640 1 -- start start 2023-09-13T06:11:19.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7efba19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ef40b1460 0x7f7ef41368a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:19.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7efba19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ef40b2780 0x7f7ef4135ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:19.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7efba19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef4144d70 0x7f7ef415d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:19.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7efba19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef41361e0 con 0x7f7ef40b2780 2023-09-13T06:11:19.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7efba19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef4156600 con 0x7f7ef4144d70 2023-09-13T06:11:19.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7efba19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef4156020 con 0x7f7ef40b1460 2023-09-13T06:11:19.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef8fb4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ef40b2780 0x7f7ef4135ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:19.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef8fb4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ef40b2780 0x7f7ef4135ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:52820/0 (socket says 172.21.15.130:52820) 2023-09-13T06:11:19.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef8fb4640 1 -- 172.21.15.130:0/739648082 learned_addr learned my addr 172.21.15.130:0/739648082 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:19.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef97b5640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ef40b1460 0x7f7ef41368a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:19.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef9fb6640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef4144d70 0x7f7ef415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:19.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef8fb4640 1 -- 172.21.15.130:0/739648082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ef40b1460 msgr2=0x7f7ef41368a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:19.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef8fb4640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ef40b1460 0x7f7ef41368a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:19.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef8fb4640 1 -- 172.21.15.130:0/739648082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef4144d70 msgr2=0x7f7ef415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:19.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef8fb4640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef4144d70 0x7f7ef415d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:19.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef8fb4640 1 -- 172.21.15.130:0/739648082 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40094d0 con 0x7f7ef40b2780 2023-09-13T06:11:19.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef9fb6640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef4144d70 0x7f7ef415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:19.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ef8fb4640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ef40b2780 0x7f7ef4135ca0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f7ee401abb0 tx=0x7f7ee40192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:19.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ee9ffb640 1 -- 172.21.15.130:0/739648082 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40ac410 con 0x7f7ef40b2780 2023-09-13T06:11:19.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ee9ffb640 1 -- 172.21.15.130:0/739648082 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee40b45c0 con 0x7f7ef40b2780 2023-09-13T06:11:19.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7ee9ffb640 1 -- 172.21.15.130:0/739648082 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40b4990 con 0x7f7ef40b2780 2023-09-13T06:11:19.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7efba19640 1 -- 172.21.15.130:0/739648082 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef415bd80 con 0x7f7ef40b2780 2023-09-13T06:11:19.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7efba19640 1 -- 172.21.15.130:0/739648082 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef415ba30 con 0x7f7ef40b2780 2023-09-13T06:11:19.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.921+0000 7f7efba19640 1 -- 172.21.15.130:0/739648082 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef41567b0 con 0x7f7ef40b2780 2023-09-13T06:11:19.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.925+0000 7f7ee9ffb640 1 -- 172.21.15.130:0/739648082 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7ee40b4af0 con 0x7f7ef40b2780 2023-09-13T06:11:19.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.925+0000 7f7ee9ffb640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7ed8065b20 0x7f7ed8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:19.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.925+0000 7f7ee9ffb640 1 -- 172.21.15.130:0/739648082 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ee411d8a0 con 0x7f7ef40b2780 2023-09-13T06:11:19.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.925+0000 7f7ef97b5640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7ed8065b20 0x7f7ed8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:19.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.925+0000 7f7ef97b5640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7ed8065b20 0x7f7ed8067fe0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40cdbc0 tx=0x7f7ef0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:19.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:19.929+0000 7f7ee9ffb640 1 -- 172.21.15.130:0/739648082 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7ee40eb150 con 0x7f7ef40b2780 2023-09-13T06:11:20.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.109+0000 7f7efba19640 1 -- 172.21.15.130:0/739648082 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7ef415b840 con 0x7f7ef40b2780 2023-09-13T06:11:20.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7ee9ffb640 1 -- 172.21.15.130:0/739648082 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7ee40b10c0 con 0x7f7ef40b2780 2023-09-13T06:11:20.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 -- 172.21.15.130:0/739648082 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7ed8065b20 msgr2=0x7f7ed8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:20.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7ed8065b20 0x7f7ed8067fe0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40cdbc0 tx=0x7f7ef0008040 comp rx=0 tx=0).stop 2023-09-13T06:11:20.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 -- 172.21.15.130:0/739648082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ef40b2780 msgr2=0x7f7ef4135ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:20.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ef40b2780 0x7f7ef4135ca0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f7ee401abb0 tx=0x7f7ee40192a0 comp rx=0 tx=0).stop 2023-09-13T06:11:20.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 -- 172.21.15.130:0/739648082 shutdown_connections 2023-09-13T06:11:20.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7ed8065b20 0x7f7ed8067fe0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:20.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef4144d70 0x7f7ef415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:20.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ef40b2780 0x7f7ef4135ca0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:20.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 --2- 172.21.15.130:0/739648082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ef40b1460 0x7f7ef41368a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:20.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 -- 172.21.15.130:0/739648082 >> 172.21.15.130:0/739648082 conn(0x7f7ef4065990 msgr2=0x7f7ef4143d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:20.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 -- 172.21.15.130:0/739648082 shutdown_connections 2023-09-13T06:11:20.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.749+0000 7f7efba19640 1 -- 172.21.15.130:0/739648082 wait complete. 2023-09-13T06:11:20.773 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T06:11:20.774 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:11:20.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.913+0000 7fc183f59640 1 Processor -- start 2023-09-13T06:11:20.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.913+0000 7fc183f59640 1 -- start start 2023-09-13T06:11:20.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc183f59640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc17c0b1d20 0x7fc17c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:20.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc183f59640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c0ccfd0 con 0x7fc17c159f20 2023-09-13T06:11:20.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc183f59640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c0ced90 con 0x7fc17c0cdfc0 2023-09-13T06:11:20.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc183f59640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c0ce430 con 0x7fc17c0b1d20 2023-09-13T06:11:20.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc181cf5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc17c159f20 0x7fc17c0b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59854/0 (socket says 172.21.15.130:59854) 2023-09-13T06:11:20.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc181cf5640 1 -- 172.21.15.130:0/952810874 learned_addr learned my addr 172.21.15.130:0/952810874 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:20.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc1814f4640 1 --2- 172.21.15.130:0/952810874 >> v2:172.21.15.164:3300/0 conn(0x7fc17c0b1d20 0x7fc17c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:20.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430465327 0 0) 0x7fc17c0ccfd0 con 0x7fc17c159f20 2023-09-13T06:11:20.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc168003530 con 0x7fc17c159f20 2023-09-13T06:11:20.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4211160824 0 0) 0x7fc168003530 con 0x7fc17c159f20 2023-09-13T06:11:20.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 >> v2:172.21.15.164:3300/0 conn(0x7fc17c0b1d20 msgr2=0x7fc17c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:20.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 --2- 172.21.15.130:0/952810874 >> v2:172.21.15.164:3300/0 conn(0x7fc17c0b1d20 0x7fc17c0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:20.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 >> v1:172.21.15.164:6789/0 conn(0x7fc17c0cdfc0 legacy=0x7fc17c0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:20.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c0cd200 con 0x7fc17c159f20 2023-09-13T06:11:20.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fc178001680 con 0x7fc17c159f20 2023-09-13T06:11:20.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 >> v1:172.21.15.130:6789/0 conn(0x7fc17c159f20 legacy=0x7fc17c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:20.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 --2- 172.21.15.130:0/952810874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc168003a70 0x7fc168003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:20.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 --2- 172.21.15.130:0/952810874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1680047d0 0x7fc168004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:20.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 --2- 172.21.15.130:0/952810874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1680052b0 0x7fc16800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:20.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0ce430 con 0x7fc1680052b0 2023-09-13T06:11:20.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16800c1b0 con 0x7fc1680047d0 2023-09-13T06:11:20.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16800c370 con 0x7fc168003a70 2023-09-13T06:11:20.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc1824f6640 1 --2- 172.21.15.130:0/952810874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1680052b0 0x7fc16800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:20.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc1814f4640 1 --2- 172.21.15.130:0/952810874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1680047d0 0x7fc168004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:20.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc181cf5640 1 --2- 172.21.15.130:0/952810874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc168003a70 0x7fc168003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:20.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc1824f6640 1 -- 172.21.15.130:0/952810874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc168003a70 msgr2=0x7fc168003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:20.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc1824f6640 1 --2- 172.21.15.130:0/952810874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc168003a70 0x7fc168003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:20.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc1824f6640 1 -- 172.21.15.130:0/952810874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1680047d0 msgr2=0x7fc168004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:20.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc1824f6640 1 --2- 172.21.15.130:0/952810874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1680047d0 0x7fc168004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:20.924 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.917+0000 7fc1824f6640 1 -- 172.21.15.130:0/952810874 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168003530 con 0x7fc1680052b0 2023-09-13T06:11:20.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc1824f6640 1 -- 172.21.15.130:0/952810874 reap_dead start 2023-09-13T06:11:20.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc1824f6640 1 --2- 172.21.15.130:0/952810874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1680052b0 0x7fc16800b990 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fc174001e70 tx=0x7fc17401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef65c7fa48db56b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:20.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174003b80 con 0x7fc1680052b0 2023-09-13T06:11:20.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc174003d20 con 0x7fc1680052b0 2023-09-13T06:11:20.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc180cf3640 1 -- 172.21.15.130:0/952810874 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174005260 con 0x7fc1680052b0 2023-09-13T06:11:20.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc183f59640 1 -- 172.21.15.130:0/952810874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1680052b0 msgr2=0x7fc16800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:20.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc183f59640 1 --2- 172.21.15.130:0/952810874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1680052b0 0x7fc16800b990 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fc174001e70 tx=0x7fc17401c760 comp rx=0 tx=0).stop 2023-09-13T06:11:20.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc183f59640 1 -- 172.21.15.130:0/952810874 shutdown_connections 2023-09-13T06:11:20.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc183f59640 1 --2- 172.21.15.130:0/952810874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1680052b0 0x7fc16800b990 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:20.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc183f59640 1 -- 172.21.15.130:0/952810874 >> 172.21.15.130:0/952810874 conn(0x7fc17c065990 msgr2=0x7fc17c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:20.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc183f59640 1 -- 172.21.15.130:0/952810874 shutdown_connections 2023-09-13T06:11:20.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.921+0000 7fc183f59640 1 -- 172.21.15.130:0/952810874 wait complete. 2023-09-13T06:11:20.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc183f59640 1 Processor -- start 2023-09-13T06:11:20.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc183f59640 1 -- start start 2023-09-13T06:11:20.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc183f59640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1680052b0 0x7fc17c1f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:20.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc183f59640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc17c1f5f70 0x7fc17c14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:20.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc183f59640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc17c14c6b0 0x7fc17c14cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:20.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc183f59640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1e4a00 con 0x7fc17c1f5f70 2023-09-13T06:11:20.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc183f59640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1e4ce0 con 0x7fc1680052b0 2023-09-13T06:11:20.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc183f59640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1f66e0 con 0x7fc17c14c6b0 2023-09-13T06:11:20.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1814f4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc17c1f5f70 0x7fc17c14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:20.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1814f4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc17c1f5f70 0x7fc17c14bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59646/0 (socket says 172.21.15.130:59646) 2023-09-13T06:11:20.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1814f4640 1 -- 172.21.15.130:0/274969532 learned_addr learned my addr 172.21.15.130:0/274969532 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:20.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc181cf5640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1680052b0 0x7fc17c1f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:20.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1824f6640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc17c14c6b0 0x7fc17c14cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:20.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1814f4640 1 -- 172.21.15.130:0/274969532 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc17c14c6b0 msgr2=0x7fc17c14cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:20.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1814f4640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc17c14c6b0 0x7fc17c14cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:20.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1814f4640 1 -- 172.21.15.130:0/274969532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1680052b0 msgr2=0x7fc17c1f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:20.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1814f4640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1680052b0 0x7fc17c1f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:20.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1814f4640 1 -- 172.21.15.130:0/274969532 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c1f69c0 con 0x7fc17c1f5f70 2023-09-13T06:11:20.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1824f6640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc17c14c6b0 0x7fc17c14cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:20.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1814f4640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc17c1f5f70 0x7fc17c14bb50 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fc16c011960 tx=0x7fc16c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:20.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1727fc640 1 -- 172.21.15.130:0/274969532 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00faf0 con 0x7fc17c1f5f70 2023-09-13T06:11:20.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1727fc640 1 -- 172.21.15.130:0/274969532 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c00fc50 con 0x7fc17c1f5f70 2023-09-13T06:11:20.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc1727fc640 1 -- 172.21.15.130:0/274969532 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c014440 con 0x7fc17c1f5f70 2023-09-13T06:11:20.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc183f59640 1 -- 172.21.15.130:0/274969532 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c1f6ca0 con 0x7fc17c1f5f70 2023-09-13T06:11:20.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc183f59640 1 -- 172.21.15.130:0/274969532 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c14c090 con 0x7fc17c1f5f70 2023-09-13T06:11:20.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.925+0000 7fc183f59640 1 -- 172.21.15.130:0/274969532 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c1e4e50 con 0x7fc17c1f5f70 2023-09-13T06:11:20.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.929+0000 7fc1727fc640 1 -- 172.21.15.130:0/274969532 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc16c0145a0 con 0x7fc17c1f5f70 2023-09-13T06:11:20.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.929+0000 7fc1727fc640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc160065b10 0x7fc160067fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:20.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.929+0000 7fc1727fc640 1 -- 172.21.15.130:0/274969532 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc16c083a60 con 0x7fc17c1f5f70 2023-09-13T06:11:20.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.929+0000 7fc181cf5640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc160065b10 0x7fc160067fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:20.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.929+0000 7fc181cf5640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc160065b10 0x7fc160067fd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc178001bf0 tx=0x7fc178001dd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:20.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:20.933+0000 7fc1727fc640 1 -- 172.21.15.130:0/274969532 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc16c0513a0 con 0x7fc17c1f5f70 2023-09-13T06:11:21.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.109+0000 7fc183f59640 1 -- 172.21.15.130:0/274969532 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc17c0618a0 con 0x7fc17c1f5f70 2023-09-13T06:11:21.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.109+0000 7fc1727fc640 1 -- 172.21.15.130:0/274969532 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fc16c0549c0 con 0x7fc17c1f5f70 2023-09-13T06:11:21.112 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:21.112 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2473585305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2473585305},{"type":"v1","addr":"172.21.15.130:6835","nonce":2473585305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1139512428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1139512428},{"type":"v1","addr":"172.21.15.164:6834","nonce":1139512428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2365480398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2365480398},{"type":"v1","addr":"172.21.15.164:6835","nonce":2365480398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:11:17.067978+0000","modified":"2023-09-13T06:11:20.112082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8646":{"gid":8646,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/597081287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":597081287},{"type":"v1","addr":"172.21.15.130:6837","nonce":597081287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-09-13T06:11:21.115 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 84 2023-09-13T06:11:21.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 -- 172.21.15.130:0/274969532 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc160065b10 msgr2=0x7fc160067fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc160065b10 0x7fc160067fd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc178001bf0 tx=0x7fc178001dd0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 -- 172.21.15.130:0/274969532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc17c1f5f70 msgr2=0x7fc17c14bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc17c1f5f70 0x7fc17c14bb50 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fc16c011960 tx=0x7fc16c011e20 comp rx=0 tx=0).stop 2023-09-13T06:11:21.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 -- 172.21.15.130:0/274969532 shutdown_connections 2023-09-13T06:11:21.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc160065b10 0x7fc160067fd0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc17c14c6b0 0x7fc17c14cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc17c1f5f70 0x7fc17c14bb50 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 --2- 172.21.15.130:0/274969532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1680052b0 0x7fc17c1f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 -- 172.21.15.130:0/274969532 >> 172.21.15.130:0/274969532 conn(0x7fc17c065990 msgr2=0x7fc17c1e7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:21.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 -- 172.21.15.130:0/274969532 shutdown_connections 2023-09-13T06:11:21.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.113+0000 7fc183f59640 1 -- 172.21.15.130:0/274969532 wait complete. 2023-09-13T06:11:21.132 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:11:21.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e549a9640 1 Processor -- start 2023-09-13T06:11:21.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e549a9640 1 -- start start 2023-09-13T06:11:21.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e549a9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e500d1f50 0x7f5e50070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e549a9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5e500706c0 0x7f5e5015d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e549a9640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e500d1ac0 con 0x7f5e50146b30 2023-09-13T06:11:21.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e549a9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e50070b70 con 0x7f5e500706c0 2023-09-13T06:11:21.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e549a9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500d0be0 con 0x7f5e500d1f50 2023-09-13T06:11:21.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e4f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5e50146b30 0x7f5e500d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59866/0 (socket says 172.21.15.130:59866) 2023-09-13T06:11:21.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e4f7fe640 1 -- 172.21.15.130:0/238370320 learned_addr learned my addr 172.21.15.130:0/238370320 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:21.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e4ffff640 1 --2- 172.21.15.130:0/238370320 >> v2:172.21.15.130:3300/0 conn(0x7f5e500706c0 0x7f5e5015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e4effd640 1 --2- 172.21.15.130:0/238370320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e500d1f50 0x7f5e50070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e4ffff640 1 -- 172.21.15.130:0/238370320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e500d1f50 msgr2=0x7f5e50070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:21.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e4ffff640 1 --2- 172.21.15.130:0/238370320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e500d1f50 0x7f5e50070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e4ffff640 1 -- 172.21.15.130:0/238370320 >> v1:172.21.15.130:6789/0 conn(0x7f5e50146b30 legacy=0x7f5e500d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e4ffff640 1 -- 172.21.15.130:0/238370320 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e500d0eb0 con 0x7f5e500706c0 2023-09-13T06:11:21.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.273+0000 7f5e4e7fc640 1 -- 172.21.15.130:0/238370320 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329359676 0 0) 0x7f5e500d1ac0 con 0x7f5e50146b30 2023-09-13T06:11:21.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e4ffff640 1 --2- 172.21.15.130:0/238370320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e500706c0 0x7f5e5015d760 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009d90 tx=0x7f5e4801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d83cb0118fbe9de server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:21.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e4e7fc640 1 -- 172.21.15.130:0/238370320 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e480a59e0 con 0x7f5e500706c0 2023-09-13T06:11:21.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e4e7fc640 1 -- 172.21.15.130:0/238370320 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e480a5b40 con 0x7f5e500706c0 2023-09-13T06:11:21.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e4e7fc640 1 -- 172.21.15.130:0/238370320 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e480ad440 con 0x7f5e500706c0 2023-09-13T06:11:21.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e549a9640 1 -- 172.21.15.130:0/238370320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e500706c0 msgr2=0x7f5e5015d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e549a9640 1 --2- 172.21.15.130:0/238370320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e500706c0 0x7f5e5015d760 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009d90 tx=0x7f5e4801c920 comp rx=0 tx=0).stop 2023-09-13T06:11:21.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e549a9640 1 -- 172.21.15.130:0/238370320 shutdown_connections 2023-09-13T06:11:21.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e549a9640 1 --2- 172.21.15.130:0/238370320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e500706c0 0x7f5e5015d760 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e549a9640 1 --2- 172.21.15.130:0/238370320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e500d1f50 0x7f5e50070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e549a9640 1 -- 172.21.15.130:0/238370320 >> 172.21.15.130:0/238370320 conn(0x7f5e500d3090 msgr2=0x7f5e500d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:21.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e549a9640 1 -- 172.21.15.130:0/238370320 shutdown_connections 2023-09-13T06:11:21.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e549a9640 1 -- 172.21.15.130:0/238370320 wait complete. 2023-09-13T06:11:21.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.277+0000 7f5e549a9640 1 Processor -- start 2023-09-13T06:11:21.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e549a9640 1 -- start start 2023-09-13T06:11:21.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e549a9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e500706c0 0x7f5e500b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e549a9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e500d1f50 0x7f5e5015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e549a9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e50146b30 0x7f5e5015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e549a9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e50141360 con 0x7f5e500706c0 2023-09-13T06:11:21.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e549a9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500b5cb0 con 0x7f5e50146b30 2023-09-13T06:11:21.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e549a9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5015bb50 con 0x7f5e500d1f50 2023-09-13T06:11:21.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e4f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e500706c0 0x7f5e500b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e4f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e500706c0 0x7f5e500b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59668/0 (socket says 172.21.15.130:59668) 2023-09-13T06:11:21.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e4f7fe640 1 -- 172.21.15.130:0/3580513579 learned_addr learned my addr 172.21.15.130:0/3580513579 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:21.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e4ffff640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e50146b30 0x7f5e5015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e4effd640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e500d1f50 0x7f5e5015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e4f7fe640 1 -- 172.21.15.130:0/3580513579 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e500d1f50 msgr2=0x7f5e5015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e4f7fe640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e500d1f50 0x7f5e5015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e4f7fe640 1 -- 172.21.15.130:0/3580513579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e50146b30 msgr2=0x7f5e5015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e4f7fe640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e50146b30 0x7f5e5015a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e4f7fe640 1 -- 172.21.15.130:0/3580513579 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48009a70 con 0x7f5e500706c0 2023-09-13T06:11:21.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e4f7fe640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e500706c0 0x7f5e500b56d0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000c480 tx=0x7f5e4000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:21.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e37fff640 1 -- 172.21.15.130:0/3580513579 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e400074e0 con 0x7f5e500706c0 2023-09-13T06:11:21.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e37fff640 1 -- 172.21.15.130:0/3580513579 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e40007660 con 0x7f5e500706c0 2023-09-13T06:11:21.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e549a9640 1 -- 172.21.15.130:0/3580513579 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e501399f0 con 0x7f5e500706c0 2023-09-13T06:11:21.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e37fff640 1 -- 172.21.15.130:0/3580513579 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40004a30 con 0x7f5e500706c0 2023-09-13T06:11:21.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e549a9640 1 -- 172.21.15.130:0/3580513579 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5015ac20 con 0x7f5e500706c0 2023-09-13T06:11:21.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.281+0000 7f5e549a9640 1 -- 172.21.15.130:0/3580513579 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5015b920 con 0x7f5e500706c0 2023-09-13T06:11:21.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.285+0000 7f5e37fff640 1 -- 172.21.15.130:0/3580513579 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5e40004b90 con 0x7f5e500706c0 2023-09-13T06:11:21.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.285+0000 7f5e37fff640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e3c065b50 0x7f5e3c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.285+0000 7f5e37fff640 1 -- 172.21.15.130:0/3580513579 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e40082750 con 0x7f5e500706c0 2023-09-13T06:11:21.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.285+0000 7f5e4effd640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e3c065b50 0x7f5e3c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.285+0000 7f5e4effd640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e3c065b50 0x7f5e3c068010 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5e5013cc10 tx=0x7f5e44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:21.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.289+0000 7f5e37fff640 1 -- 172.21.15.130:0/3580513579 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5e5015b920 con 0x7f5e500706c0 2023-09-13T06:11:21.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.437+0000 7f5e549a9640 1 -- 172.21.15.130:0/3580513579 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e5015b920 con 0x7f5e500706c0 2023-09-13T06:11:21.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e37fff640 1 -- 172.21.15.130:0/3580513579 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+16616 (secure 0 0 0) 0x7f5e5015b920 con 0x7f5e500706c0 2023-09-13T06:11:21.439 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:21.440 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":171,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:11:18.456771+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:11:15.244077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-09-13T06:11:16.070064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:11:21.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 -- 172.21.15.130:0/3580513579 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e3c065b50 msgr2=0x7f5e3c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e3c065b50 0x7f5e3c068010 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5e5013cc10 tx=0x7f5e44008040 comp rx=0 tx=0).stop 2023-09-13T06:11:21.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 -- 172.21.15.130:0/3580513579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e500706c0 msgr2=0x7f5e500b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e500706c0 0x7f5e500b56d0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000c480 tx=0x7f5e4000c940 comp rx=0 tx=0).stop 2023-09-13T06:11:21.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 -- 172.21.15.130:0/3580513579 shutdown_connections 2023-09-13T06:11:21.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e3c065b50 0x7f5e3c068010 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e50146b30 0x7f5e5015a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e500d1f50 0x7f5e5015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 --2- 172.21.15.130:0/3580513579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e500706c0 0x7f5e500b56d0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 -- 172.21.15.130:0/3580513579 >> 172.21.15.130:0/3580513579 conn(0x7f5e500d3090 msgr2=0x7f5e5006f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:21.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 -- 172.21.15.130:0/3580513579 shutdown_connections 2023-09-13T06:11:21.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.441+0000 7f5e549a9640 1 -- 172.21.15.130:0/3580513579 wait complete. 2023-09-13T06:11:21.460 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T06:11:21.461 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:11:21.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.597+0000 7efef32cb640 1 Processor -- start 2023-09-13T06:11:21.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.597+0000 7efef32cb640 1 -- start start 2023-09-13T06:11:21.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef32cb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efeec0b1d20 0x7efeec0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef32cb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec0ccfd0 con 0x7efeec0cdfc0 2023-09-13T06:11:21.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef32cb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec0ced90 con 0x7efeec159f20 2023-09-13T06:11:21.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef32cb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec0ce430 con 0x7efeec0b1d20 2023-09-13T06:11:21.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef1868640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7efeec0cdfc0 0x7efeec0ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59876/0 (socket says 172.21.15.130:59876) 2023-09-13T06:11:21.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef1868640 1 -- 172.21.15.130:0/2112197895 learned_addr learned my addr 172.21.15.130:0/2112197895 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:21.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef0866640 1 --2- 172.21.15.130:0/2112197895 >> v2:172.21.15.164:3300/0 conn(0x7efeec0b1d20 0x7efeec0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545425601 0 0) 0x7efeec0ccfd0 con 0x7efeec0cdfc0 2023-09-13T06:11:21.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed8003530 con 0x7efeec0cdfc0 2023-09-13T06:11:21.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1676887631 0 0) 0x7efed8003530 con 0x7efeec0cdfc0 2023-09-13T06:11:21.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 >> v2:172.21.15.164:3300/0 conn(0x7efeec0b1d20 msgr2=0x7efeec0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 --2- 172.21.15.130:0/2112197895 >> v2:172.21.15.164:3300/0 conn(0x7efeec0b1d20 0x7efeec0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 >> v1:172.21.15.164:6789/0 conn(0x7efeec159f20 legacy=0x7efeec0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0cd200 con 0x7efeec0cdfc0 2023-09-13T06:11:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7efee4001a00 con 0x7efeec0cdfc0 2023-09-13T06:11:21.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 >> v1:172.21.15.130:6789/0 conn(0x7efeec0cdfc0 legacy=0x7efeec0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8003a20 0x7efed8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed80047d0 0x7efed8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efed8005190 0x7efed800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0ce430 con 0x7efed8003a20 2023-09-13T06:11:21.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed800c0e0 con 0x7efed80047d0 2023-09-13T06:11:21.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed800c2a0 con 0x7efed8005190 2023-09-13T06:11:21.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef1067640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8003a20 0x7efed8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef0866640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed80047d0 0x7efed8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef1868640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efed8005190 0x7efed800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef1067640 1 -- 172.21.15.130:0/2112197895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efed8005190 msgr2=0x7efed800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:21.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef1067640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efed8005190 0x7efed800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef1067640 1 -- 172.21.15.130:0/2112197895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed80047d0 msgr2=0x7efed8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:21.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef1067640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed80047d0 0x7efed8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef1067640 1 -- 172.21.15.130:0/2112197895 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8003530 con 0x7efed8003a20 2023-09-13T06:11:21.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef1868640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efed8005190 0x7efed800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:21.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.601+0000 7efef1868640 1 -- 172.21.15.130:0/2112197895 reap_dead start 2023-09-13T06:11:21.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efef1067640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8003a20 0x7efed8003e00 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7efee8001860 tx=0x7efee801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57968647586517a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:21.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee80ab600 con 0x7efed8003a20 2023-09-13T06:11:21.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee80a7050 con 0x7efed8003a20 2023-09-13T06:11:21.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efee3fff640 1 -- 172.21.15.130:0/2112197895 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee80ab9e0 con 0x7efed8003a20 2023-09-13T06:11:21.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efef32cb640 1 -- 172.21.15.130:0/2112197895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8003a20 msgr2=0x7efed8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efef32cb640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8003a20 0x7efed8003e00 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7efee8001860 tx=0x7efee801c4e0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efef32cb640 1 -- 172.21.15.130:0/2112197895 shutdown_connections 2023-09-13T06:11:21.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efef32cb640 1 --2- 172.21.15.130:0/2112197895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efed8003a20 0x7efed8003e00 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efef32cb640 1 -- 172.21.15.130:0/2112197895 >> 172.21.15.130:0/2112197895 conn(0x7efeec065990 msgr2=0x7efeec065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:21.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efef32cb640 1 -- 172.21.15.130:0/2112197895 shutdown_connections 2023-09-13T06:11:21.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efef32cb640 1 -- 172.21.15.130:0/2112197895 wait complete. 2023-09-13T06:11:21.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efef32cb640 1 Processor -- start 2023-09-13T06:11:21.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.605+0000 7efef32cb640 1 -- start start 2023-09-13T06:11:21.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef32cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8003a20 0x7efeec1f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef32cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efeec155880 0x7efeec155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef32cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec13f060 0x7efeec13f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef32cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec1f4e30 con 0x7efeec13f060 2023-09-13T06:11:21.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef32cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec156240 con 0x7efed8003a20 2023-09-13T06:11:21.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef32cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec1404c0 con 0x7efeec155880 2023-09-13T06:11:21.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef1868640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec13f060 0x7efeec13f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef1868640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec13f060 0x7efeec13f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59690/0 (socket says 172.21.15.130:59690) 2023-09-13T06:11:21.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef1868640 1 -- 172.21.15.130:0/1693607318 learned_addr learned my addr 172.21.15.130:0/1693607318 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:21.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef1067640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8003a20 0x7efeec1f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef0866640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efeec155880 0x7efeec155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef1868640 1 -- 172.21.15.130:0/1693607318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efeec155880 msgr2=0x7efeec155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef1868640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efeec155880 0x7efeec155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef1868640 1 -- 172.21.15.130:0/1693607318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8003a20 msgr2=0x7efeec1f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef1868640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8003a20 0x7efeec1f48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef1868640 1 -- 172.21.15.130:0/1693607318 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec13ecd0 con 0x7efeec13f060 2023-09-13T06:11:21.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef1067640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8003a20 0x7efeec1f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:21.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef0866640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efeec155880 0x7efeec155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:21.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef1868640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec13f060 0x7efeec13f4e0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7efee40012f0 tx=0x7efee4007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:21.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efee1ffb640 1 -- 172.21.15.130:0/1693607318 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee400ea20 con 0x7efeec13f060 2023-09-13T06:11:21.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efee1ffb640 1 -- 172.21.15.130:0/1693607318 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee400eba0 con 0x7efeec13f060 2023-09-13T06:11:21.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efee1ffb640 1 -- 172.21.15.130:0/1693607318 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4013420 con 0x7efeec13f060 2023-09-13T06:11:21.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef32cb640 1 -- 172.21.15.130:0/1693607318 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec140760 con 0x7efeec13f060 2023-09-13T06:11:21.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef32cb640 1 -- 172.21.15.130:0/1693607318 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec140d20 con 0x7efeec13f060 2023-09-13T06:11:21.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efef32cb640 1 -- 172.21.15.130:0/1693607318 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec0618a0 con 0x7efeec13f060 2023-09-13T06:11:21.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.609+0000 7efee1ffb640 1 -- 172.21.15.130:0/1693607318 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efee4013580 con 0x7efeec13f060 2023-09-13T06:11:21.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.613+0000 7efee1ffb640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b50 0x7efed0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:21.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.613+0000 7efee1ffb640 1 -- 172.21.15.130:0/1693607318 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efee4083580 con 0x7efeec13f060 2023-09-13T06:11:21.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.613+0000 7efef1067640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b50 0x7efed0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:21.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.613+0000 7efef1067640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b50 0x7efed0068010 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7efee80ad000 tx=0x7efee80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:21.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.617+0000 7efee1ffb640 1 -- 172.21.15.130:0/1693607318 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7efee4050ec0 con 0x7efeec13f060 2023-09-13T06:11:21.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.765+0000 7efef32cb640 1 -- 172.21.15.130:0/1693607318 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efeec0b10a0 con 0x7efed0065b50 2023-09-13T06:11:21.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.769+0000 7efee1ffb640 1 -- 172.21.15.130:0/1693607318 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284930 (secure 0 0 0) 0x7efee8006ba0 con 0x7efed0065b50 2023-09-13T06:11:21.952 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:21.954 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:11:21.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 -- 172.21.15.130:0/1693607318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b50 msgr2=0x7efed0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b50 0x7efed0068010 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7efee80ad000 tx=0x7efee80a6000 comp rx=0 tx=0).stop 2023-09-13T06:11:21.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 -- 172.21.15.130:0/1693607318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec13f060 msgr2=0x7efeec13f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:21.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec13f060 0x7efeec13f4e0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7efee40012f0 tx=0x7efee4007bc0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 -- 172.21.15.130:0/1693607318 shutdown_connections 2023-09-13T06:11:21.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efed0065b50 0x7efed0068010 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeec13f060 0x7efeec13f4e0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efeec155880 0x7efeec155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 --2- 172.21.15.130:0/1693607318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efed8003a20 0x7efeec1f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:21.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 -- 172.21.15.130:0/1693607318 >> 172.21.15.130:0/1693607318 conn(0x7efeec065990 msgr2=0x7efeec0cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:21.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 -- 172.21.15.130:0/1693607318 shutdown_connections 2023-09-13T06:11:21.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:21.773+0000 7efef32cb640 1 -- 172.21.15.130:0/1693607318 wait complete. 2023-09-13T06:11:21.962 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":466,"stamp":"2023-09-13T06:11:20.667237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8641,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553858,"statfs":{"total":1600000000,"available":1591151296,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.985151"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.471517+0000","last_change":"2023-09-13T06:11:17.471353+0000","last_active":"2023-09-13T06:11:17.471517+0000","last_peered":"2023-09-13T06:11:17.471517+0000","last_clean":"2023-09-13T06:11:17.471517+0000","last_became_active":"2023-09-13T06:11:17.471056+0000","last_became_peered":"2023-09-13T06:11:17.471056+0000","last_unstale":"2023-09-13T06:11:17.471517+0000","last_undegraded":"2023-09-13T06:11:17.471517+0000","last_fullsized":"2023-09-13T06:11:17.471517+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:35:59.132343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.465746+0000","last_change":"2023-09-13T06:11:17.465642+0000","last_active":"2023-09-13T06:11:17.465746+0000","last_peered":"2023-09-13T06:11:17.465746+0000","last_clean":"2023-09-13T06:11:17.465746+0000","last_became_active":"2023-09-13T06:11:17.465044+0000","last_became_peered":"2023-09-13T06:11:17.465044+0000","last_unstale":"2023-09-13T06:11:17.465746+0000","last_undegraded":"2023-09-13T06:11:17.465746+0000","last_fullsized":"2023-09-13T06:11:17.465746+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:30:12.212435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.473481+0000","last_change":"2023-09-13T06:11:17.472711+0000","last_active":"2023-09-13T06:11:17.473481+0000","last_peered":"2023-09-13T06:11:17.473481+0000","last_clean":"2023-09-13T06:11:17.473481+0000","last_became_active":"2023-09-13T06:11:17.472218+0000","last_became_peered":"2023-09-13T06:11:17.472218+0000","last_unstale":"2023-09-13T06:11:17.473481+0000","last_undegraded":"2023-09-13T06:11:17.473481+0000","last_fullsized":"2023-09-13T06:11:17.473481+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:26:12.439786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.475780+0000","last_change":"2023-09-13T06:11:17.475556+0000","last_active":"2023-09-13T06:11:17.475780+0000","last_peered":"2023-09-13T06:11:17.475780+0000","last_clean":"2023-09-13T06:11:17.475780+0000","last_became_active":"2023-09-13T06:11:17.473824+0000","last_became_peered":"2023-09-13T06:11:17.473824+0000","last_unstale":"2023-09-13T06:11:17.475780+0000","last_undegraded":"2023-09-13T06:11:17.475780+0000","last_fullsized":"2023-09-13T06:11:17.475780+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:37:30.901364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.471416+0000","last_change":"2023-09-13T06:11:17.470898+0000","last_active":"2023-09-13T06:11:17.471416+0000","last_peered":"2023-09-13T06:11:17.471416+0000","last_clean":"2023-09-13T06:11:17.471416+0000","last_became_active":"2023-09-13T06:11:17.470670+0000","last_became_peered":"2023-09-13T06:11:17.470670+0000","last_unstale":"2023-09-13T06:11:17.471416+0000","last_undegraded":"2023-09-13T06:11:17.471416+0000","last_fullsized":"2023-09-13T06:11:17.471416+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:20:32.182252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.470495+0000","last_change":"2023-09-13T06:11:17.470236+0000","last_active":"2023-09-13T06:11:17.470495+0000","last_peered":"2023-09-13T06:11:17.470495+0000","last_clean":"2023-09-13T06:11:17.470495+0000","last_became_active":"2023-09-13T06:11:17.469881+0000","last_became_peered":"2023-09-13T06:11:17.469881+0000","last_unstale":"2023-09-13T06:11:17.470495+0000","last_undegraded":"2023-09-13T06:11:17.470495+0000","last_fullsized":"2023-09-13T06:11:17.470495+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:12:37.141167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460519+0000","last_change":"2023-09-13T06:11:17.467328+0000","last_active":"2023-09-13T06:11:18.460519+0000","last_peered":"2023-09-13T06:11:18.460519+0000","last_clean":"2023-09-13T06:11:18.460519+0000","last_became_active":"2023-09-13T06:11:17.467104+0000","last_became_peered":"2023-09-13T06:11:17.467104+0000","last_unstale":"2023-09-13T06:11:18.460519+0000","last_undegraded":"2023-09-13T06:11:18.460519+0000","last_fullsized":"2023-09-13T06:11:18.460519+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:38.103358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.470430+0000","last_change":"2023-09-13T06:11:17.469205+0000","last_active":"2023-09-13T06:11:17.470430+0000","last_peered":"2023-09-13T06:11:17.470430+0000","last_clean":"2023-09-13T06:11:17.470430+0000","last_became_active":"2023-09-13T06:11:17.468949+0000","last_became_peered":"2023-09-13T06:11:17.468949+0000","last_unstale":"2023-09-13T06:11:17.470430+0000","last_undegraded":"2023-09-13T06:11:17.470430+0000","last_fullsized":"2023-09-13T06:11:17.470430+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:43:42.868812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.463678+0000","last_change":"2023-09-13T06:11:17.463609+0000","last_active":"2023-09-13T06:11:17.463678+0000","last_peered":"2023-09-13T06:11:17.463678+0000","last_clean":"2023-09-13T06:11:17.463678+0000","last_became_active":"2023-09-13T06:11:17.463387+0000","last_became_peered":"2023-09-13T06:11:17.463387+0000","last_unstale":"2023-09-13T06:11:17.463678+0000","last_undegraded":"2023-09-13T06:11:17.463678+0000","last_fullsized":"2023-09-13T06:11:17.463678+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:01:34.920445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464571+0000","last_change":"2023-09-13T06:11:17.467839+0000","last_active":"2023-09-13T06:11:18.464571+0000","last_peered":"2023-09-13T06:11:18.464571+0000","last_clean":"2023-09-13T06:11:18.464571+0000","last_became_active":"2023-09-13T06:11:17.467529+0000","last_became_peered":"2023-09-13T06:11:17.467529+0000","last_unstale":"2023-09-13T06:11:18.464571+0000","last_undegraded":"2023-09-13T06:11:18.464571+0000","last_fullsized":"2023-09-13T06:11:18.464571+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:21.796570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.469123+0000","last_change":"2023-09-13T06:11:17.469040+0000","last_active":"2023-09-13T06:11:17.469123+0000","last_peered":"2023-09-13T06:11:17.469123+0000","last_clean":"2023-09-13T06:11:17.469123+0000","last_became_active":"2023-09-13T06:11:17.468829+0000","last_became_peered":"2023-09-13T06:11:17.468829+0000","last_unstale":"2023-09-13T06:11:17.469123+0000","last_undegraded":"2023-09-13T06:11:17.469123+0000","last_fullsized":"2023-09-13T06:11:17.469123+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:51:17.620750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464407+0000","last_change":"2023-09-13T06:11:17.470507+0000","last_active":"2023-09-13T06:11:18.464407+0000","last_peered":"2023-09-13T06:11:18.464407+0000","last_clean":"2023-09-13T06:11:18.464407+0000","last_became_active":"2023-09-13T06:11:17.470256+0000","last_became_peered":"2023-09-13T06:11:17.470256+0000","last_unstale":"2023-09-13T06:11:18.464407+0000","last_undegraded":"2023-09-13T06:11:18.464407+0000","last_fullsized":"2023-09-13T06:11:18.464407+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:00.837172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.478353+0000","last_change":"2023-09-13T06:11:17.478271+0000","last_active":"2023-09-13T06:11:17.478353+0000","last_peered":"2023-09-13T06:11:17.478353+0000","last_clean":"2023-09-13T06:11:17.478353+0000","last_became_active":"2023-09-13T06:11:17.475943+0000","last_became_peered":"2023-09-13T06:11:17.475943+0000","last_unstale":"2023-09-13T06:11:17.478353+0000","last_undegraded":"2023-09-13T06:11:17.478353+0000","last_fullsized":"2023-09-13T06:11:17.478353+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:59.635792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.476212+0000","last_change":"2023-09-13T06:11:17.476033+0000","last_active":"2023-09-13T06:11:17.476212+0000","last_peered":"2023-09-13T06:11:17.476212+0000","last_clean":"2023-09-13T06:11:17.476212+0000","last_became_active":"2023-09-13T06:11:17.474266+0000","last_became_peered":"2023-09-13T06:11:17.474266+0000","last_unstale":"2023-09-13T06:11:17.476212+0000","last_undegraded":"2023-09-13T06:11:17.476212+0000","last_fullsized":"2023-09-13T06:11:17.476212+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:30:57.890905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464719+0000","last_change":"2023-09-13T06:11:17.476383+0000","last_active":"2023-09-13T06:11:18.464719+0000","last_peered":"2023-09-13T06:11:18.464719+0000","last_clean":"2023-09-13T06:11:18.464719+0000","last_became_active":"2023-09-13T06:11:17.475350+0000","last_became_peered":"2023-09-13T06:11:17.475350+0000","last_unstale":"2023-09-13T06:11:18.464719+0000","last_undegraded":"2023-09-13T06:11:18.464719+0000","last_fullsized":"2023-09-13T06:11:18.464719+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:38:36.017550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461319+0000","last_change":"2023-09-13T06:11:17.469926+0000","last_active":"2023-09-13T06:11:18.461319+0000","last_peered":"2023-09-13T06:11:18.461319+0000","last_clean":"2023-09-13T06:11:18.461319+0000","last_became_active":"2023-09-13T06:11:17.469624+0000","last_became_peered":"2023-09-13T06:11:17.469624+0000","last_unstale":"2023-09-13T06:11:18.461319+0000","last_undegraded":"2023-09-13T06:11:18.461319+0000","last_fullsized":"2023-09-13T06:11:18.461319+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:42.560492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464804+0000","last_change":"2023-09-13T06:11:17.465355+0000","last_active":"2023-09-13T06:11:18.464804+0000","last_peered":"2023-09-13T06:11:18.464804+0000","last_clean":"2023-09-13T06:11:18.464804+0000","last_became_active":"2023-09-13T06:11:17.465094+0000","last_became_peered":"2023-09-13T06:11:17.465094+0000","last_unstale":"2023-09-13T06:11:18.464804+0000","last_undegraded":"2023-09-13T06:11:18.464804+0000","last_fullsized":"2023-09-13T06:11:18.464804+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:53:39.948872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.473463+0000","last_change":"2023-09-13T06:11:17.472543+0000","last_active":"2023-09-13T06:11:17.473463+0000","last_peered":"2023-09-13T06:11:17.473463+0000","last_clean":"2023-09-13T06:11:17.473463+0000","last_became_active":"2023-09-13T06:11:17.471775+0000","last_became_peered":"2023-09-13T06:11:17.471775+0000","last_unstale":"2023-09-13T06:11:17.473463+0000","last_undegraded":"2023-09-13T06:11:17.473463+0000","last_fullsized":"2023-09-13T06:11:17.473463+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:30:59.989727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468266+0000","last_change":"2023-09-13T06:11:17.468152+0000","last_active":"2023-09-13T06:11:17.468266+0000","last_peered":"2023-09-13T06:11:17.468266+0000","last_clean":"2023-09-13T06:11:17.468266+0000","last_became_active":"2023-09-13T06:11:17.467934+0000","last_became_peered":"2023-09-13T06:11:17.467934+0000","last_unstale":"2023-09-13T06:11:17.468266+0000","last_undegraded":"2023-09-13T06:11:17.468266+0000","last_fullsized":"2023-09-13T06:11:17.468266+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:17:55.359613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461482+0000","last_change":"2023-09-13T06:11:17.467878+0000","last_active":"2023-09-13T06:11:18.461482+0000","last_peered":"2023-09-13T06:11:18.461482+0000","last_clean":"2023-09-13T06:11:18.461482+0000","last_became_active":"2023-09-13T06:11:17.467640+0000","last_became_peered":"2023-09-13T06:11:17.467640+0000","last_unstale":"2023-09-13T06:11:18.461482+0000","last_undegraded":"2023-09-13T06:11:18.461482+0000","last_fullsized":"2023-09-13T06:11:18.461482+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:29.403563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464593+0000","last_change":"2023-09-13T06:11:17.470500+0000","last_active":"2023-09-13T06:11:18.464593+0000","last_peered":"2023-09-13T06:11:18.464593+0000","last_clean":"2023-09-13T06:11:18.464593+0000","last_became_active":"2023-09-13T06:11:17.470237+0000","last_became_peered":"2023-09-13T06:11:17.470237+0000","last_unstale":"2023-09-13T06:11:18.464593+0000","last_undegraded":"2023-09-13T06:11:18.464593+0000","last_fullsized":"2023-09-13T06:11:18.464593+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:00:59.346150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.472499+0000","last_change":"2023-09-13T06:11:17.472429+0000","last_active":"2023-09-13T06:11:17.472499+0000","last_peered":"2023-09-13T06:11:17.472499+0000","last_clean":"2023-09-13T06:11:17.472499+0000","last_became_active":"2023-09-13T06:11:17.471110+0000","last_became_peered":"2023-09-13T06:11:17.471110+0000","last_unstale":"2023-09-13T06:11:17.472499+0000","last_undegraded":"2023-09-13T06:11:17.472499+0000","last_fullsized":"2023-09-13T06:11:17.472499+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:54:14.141705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.465844+0000","last_change":"2023-09-13T06:11:17.465580+0000","last_active":"2023-09-13T06:11:17.465844+0000","last_peered":"2023-09-13T06:11:17.465844+0000","last_clean":"2023-09-13T06:11:17.465844+0000","last_became_active":"2023-09-13T06:11:17.465352+0000","last_became_peered":"2023-09-13T06:11:17.465352+0000","last_unstale":"2023-09-13T06:11:17.465844+0000","last_undegraded":"2023-09-13T06:11:17.465844+0000","last_fullsized":"2023-09-13T06:11:17.465844+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:51.147378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464708+0000","last_change":"2023-09-13T06:11:17.467668+0000","last_active":"2023-09-13T06:11:18.464708+0000","last_peered":"2023-09-13T06:11:18.464708+0000","last_clean":"2023-09-13T06:11:18.464708+0000","last_became_active":"2023-09-13T06:11:17.467222+0000","last_became_peered":"2023-09-13T06:11:17.467222+0000","last_unstale":"2023-09-13T06:11:18.464708+0000","last_undegraded":"2023-09-13T06:11:18.464708+0000","last_fullsized":"2023-09-13T06:11:18.464708+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:58.738350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461597+0000","last_change":"2023-09-13T06:11:17.469875+0000","last_active":"2023-09-13T06:11:18.461597+0000","last_peered":"2023-09-13T06:11:18.461597+0000","last_clean":"2023-09-13T06:11:18.461597+0000","last_became_active":"2023-09-13T06:11:17.469641+0000","last_became_peered":"2023-09-13T06:11:17.469641+0000","last_unstale":"2023-09-13T06:11:18.461597+0000","last_undegraded":"2023-09-13T06:11:18.461597+0000","last_fullsized":"2023-09-13T06:11:18.461597+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:13.905663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468672+0000","last_change":"2023-09-13T06:11:17.468603+0000","last_active":"2023-09-13T06:11:17.468672+0000","last_peered":"2023-09-13T06:11:17.468672+0000","last_clean":"2023-09-13T06:11:17.468672+0000","last_became_active":"2023-09-13T06:11:17.468303+0000","last_became_peered":"2023-09-13T06:11:17.468303+0000","last_unstale":"2023-09-13T06:11:17.468672+0000","last_undegraded":"2023-09-13T06:11:17.468672+0000","last_fullsized":"2023-09-13T06:11:17.468672+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:03:24.643430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461514+0000","last_change":"2023-09-13T06:11:17.471963+0000","last_active":"2023-09-13T06:11:18.461514+0000","last_peered":"2023-09-13T06:11:18.461514+0000","last_clean":"2023-09-13T06:11:18.461514+0000","last_became_active":"2023-09-13T06:11:17.471744+0000","last_became_peered":"2023-09-13T06:11:17.471744+0000","last_unstale":"2023-09-13T06:11:18.461514+0000","last_undegraded":"2023-09-13T06:11:18.461514+0000","last_fullsized":"2023-09-13T06:11:18.461514+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:10:45.858570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460474+0000","last_change":"2023-09-13T06:11:17.473702+0000","last_active":"2023-09-13T06:11:18.460474+0000","last_peered":"2023-09-13T06:11:18.460474+0000","last_clean":"2023-09-13T06:11:18.460474+0000","last_became_active":"2023-09-13T06:11:17.473563+0000","last_became_peered":"2023-09-13T06:11:17.473563+0000","last_unstale":"2023-09-13T06:11:18.460474+0000","last_undegraded":"2023-09-13T06:11:18.460474+0000","last_fullsized":"2023-09-13T06:11:18.460474+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:05.068765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.470464+0000","last_change":"2023-09-13T06:11:17.469848+0000","last_active":"2023-09-13T06:11:17.470464+0000","last_peered":"2023-09-13T06:11:17.470464+0000","last_clean":"2023-09-13T06:11:17.470464+0000","last_became_active":"2023-09-13T06:11:17.469168+0000","last_became_peered":"2023-09-13T06:11:17.469168+0000","last_unstale":"2023-09-13T06:11:17.470464+0000","last_undegraded":"2023-09-13T06:11:17.470464+0000","last_fullsized":"2023-09-13T06:11:17.470464+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:43:04.535855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.472117+0000","last_change":"2023-09-13T06:11:17.471817+0000","last_active":"2023-09-13T06:11:17.472117+0000","last_peered":"2023-09-13T06:11:17.472117+0000","last_clean":"2023-09-13T06:11:17.472117+0000","last_became_active":"2023-09-13T06:11:17.471264+0000","last_became_peered":"2023-09-13T06:11:17.471264+0000","last_unstale":"2023-09-13T06:11:17.472117+0000","last_undegraded":"2023-09-13T06:11:17.472117+0000","last_fullsized":"2023-09-13T06:11:17.472117+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:10:04.578086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.470210+0000","last_change":"2023-09-13T06:11:17.470118+0000","last_active":"2023-09-13T06:11:17.470210+0000","last_peered":"2023-09-13T06:11:17.470210+0000","last_clean":"2023-09-13T06:11:17.470210+0000","last_became_active":"2023-09-13T06:11:17.469821+0000","last_became_peered":"2023-09-13T06:11:17.469821+0000","last_unstale":"2023-09-13T06:11:17.470210+0000","last_undegraded":"2023-09-13T06:11:17.470210+0000","last_fullsized":"2023-09-13T06:11:17.470210+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:19:03.860435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461600+0000","last_change":"2023-09-13T06:11:17.471024+0000","last_active":"2023-09-13T06:11:18.461600+0000","last_peered":"2023-09-13T06:11:18.461600+0000","last_clean":"2023-09-13T06:11:18.461600+0000","last_became_active":"2023-09-13T06:11:17.470363+0000","last_became_peered":"2023-09-13T06:11:17.470363+0000","last_unstale":"2023-09-13T06:11:18.461600+0000","last_undegraded":"2023-09-13T06:11:18.461600+0000","last_fullsized":"2023-09-13T06:11:18.461600+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:12:26.272273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464876+0000","last_change":"2023-09-13T06:11:17.473360+0000","last_active":"2023-09-13T06:11:18.464876+0000","last_peered":"2023-09-13T06:11:18.464876+0000","last_clean":"2023-09-13T06:11:18.464876+0000","last_became_active":"2023-09-13T06:11:17.472758+0000","last_became_peered":"2023-09-13T06:11:17.472758+0000","last_unstale":"2023-09-13T06:11:18.464876+0000","last_undegraded":"2023-09-13T06:11:18.464876+0000","last_fullsized":"2023-09-13T06:11:18.464876+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:05.068765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"170'4","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464736+0000","last_change":"2023-09-13T06:11:16.692303+0000","last_active":"2023-09-13T06:11:18.464736+0000","last_peered":"2023-09-13T06:11:18.464736+0000","last_clean":"2023-09-13T06:11:18.464736+0000","last_became_active":"2023-09-13T06:11:16.691582+0000","last_became_peered":"2023-09-13T06:11:16.691582+0000","last_unstale":"2023-09-13T06:11:18.464736+0000","last_undegraded":"2023-09-13T06:11:18.464736+0000","last_fullsized":"2023-09-13T06:11:18.464736+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:50:45.571459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468263+0000","last_change":"2023-09-13T06:11:17.467702+0000","last_active":"2023-09-13T06:11:17.468263+0000","last_peered":"2023-09-13T06:11:17.468263+0000","last_clean":"2023-09-13T06:11:17.468263+0000","last_became_active":"2023-09-13T06:11:17.467057+0000","last_became_peered":"2023-09-13T06:11:17.467057+0000","last_unstale":"2023-09-13T06:11:17.468263+0000","last_undegraded":"2023-09-13T06:11:17.468263+0000","last_fullsized":"2023-09-13T06:11:17.468263+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:29:15.008387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"170'1","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.729499+0000","last_change":"2023-09-13T06:11:16.701770+0000","last_active":"2023-09-13T06:11:17.729499+0000","last_peered":"2023-09-13T06:11:17.729499+0000","last_clean":"2023-09-13T06:11:17.729499+0000","last_became_active":"2023-09-13T06:11:16.701095+0000","last_became_peered":"2023-09-13T06:11:16.701095+0000","last_unstale":"2023-09-13T06:11:17.729499+0000","last_undegraded":"2023-09-13T06:11:17.729499+0000","last_fullsized":"2023-09-13T06:11:17.729499+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:29:31.859999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468214+0000","last_change":"2023-09-13T06:11:17.466906+0000","last_active":"2023-09-13T06:11:17.468214+0000","last_peered":"2023-09-13T06:11:17.468214+0000","last_clean":"2023-09-13T06:11:17.468214+0000","last_became_active":"2023-09-13T06:11:17.466643+0000","last_became_peered":"2023-09-13T06:11:17.466643+0000","last_unstale":"2023-09-13T06:11:17.468214+0000","last_undegraded":"2023-09-13T06:11:17.468214+0000","last_fullsized":"2023-09-13T06:11:17.468214+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:11:39.976884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"170'2","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.730982+0000","last_change":"2023-09-13T06:11:16.701115+0000","last_active":"2023-09-13T06:11:17.730982+0000","last_peered":"2023-09-13T06:11:17.730982+0000","last_clean":"2023-09-13T06:11:17.730982+0000","last_became_active":"2023-09-13T06:11:16.700651+0000","last_became_peered":"2023-09-13T06:11:16.700651+0000","last_unstale":"2023-09-13T06:11:17.730982+0000","last_undegraded":"2023-09-13T06:11:17.730982+0000","last_fullsized":"2023-09-13T06:11:17.730982+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:11:13.578713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464830+0000","last_change":"2023-09-13T06:11:17.476701+0000","last_active":"2023-09-13T06:11:18.464830+0000","last_peered":"2023-09-13T06:11:18.464830+0000","last_clean":"2023-09-13T06:11:18.464830+0000","last_became_active":"2023-09-13T06:11:17.475977+0000","last_became_peered":"2023-09-13T06:11:17.475977+0000","last_unstale":"2023-09-13T06:11:18.464830+0000","last_undegraded":"2023-09-13T06:11:18.464830+0000","last_fullsized":"2023-09-13T06:11:18.464830+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:48:54.767374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"170'2","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.729686+0000","last_change":"2023-09-13T06:11:16.700426+0000","last_active":"2023-09-13T06:11:17.729686+0000","last_peered":"2023-09-13T06:11:17.729686+0000","last_clean":"2023-09-13T06:11:17.729686+0000","last_became_active":"2023-09-13T06:11:16.699893+0000","last_became_peered":"2023-09-13T06:11:16.699893+0000","last_unstale":"2023-09-13T06:11:17.729686+0000","last_undegraded":"2023-09-13T06:11:17.729686+0000","last_fullsized":"2023-09-13T06:11:17.729686+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:19:46.418534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.472612+0000","last_change":"2023-09-13T06:11:17.472540+0000","last_active":"2023-09-13T06:11:17.472612+0000","last_peered":"2023-09-13T06:11:17.472612+0000","last_clean":"2023-09-13T06:11:17.472612+0000","last_became_active":"2023-09-13T06:11:17.472149+0000","last_became_peered":"2023-09-13T06:11:17.472149+0000","last_unstale":"2023-09-13T06:11:17.472612+0000","last_undegraded":"2023-09-13T06:11:17.472612+0000","last_fullsized":"2023-09-13T06:11:17.472612+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:11:14.581562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"170'1","reported_seq":13,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461713+0000","last_change":"2023-09-13T06:11:16.695914+0000","last_active":"2023-09-13T06:11:18.461713+0000","last_peered":"2023-09-13T06:11:18.461713+0000","last_clean":"2023-09-13T06:11:18.461713+0000","last_became_active":"2023-09-13T06:11:16.695692+0000","last_became_peered":"2023-09-13T06:11:16.695692+0000","last_unstale":"2023-09-13T06:11:18.461713+0000","last_undegraded":"2023-09-13T06:11:18.461713+0000","last_fullsized":"2023-09-13T06:11:18.461713+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:21:14.360967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.473238+0000","last_change":"2023-09-13T06:11:17.473135+0000","last_active":"2023-09-13T06:11:17.473238+0000","last_peered":"2023-09-13T06:11:17.473238+0000","last_clean":"2023-09-13T06:11:17.473238+0000","last_became_active":"2023-09-13T06:11:17.472721+0000","last_became_peered":"2023-09-13T06:11:17.472721+0000","last_unstale":"2023-09-13T06:11:17.473238+0000","last_undegraded":"2023-09-13T06:11:17.473238+0000","last_fullsized":"2023-09-13T06:11:17.473238+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:45:56.154910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"170'1","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.729091+0000","last_change":"2023-09-13T06:11:16.693471+0000","last_active":"2023-09-13T06:11:17.729091+0000","last_peered":"2023-09-13T06:11:17.729091+0000","last_clean":"2023-09-13T06:11:17.729091+0000","last_became_active":"2023-09-13T06:11:16.693035+0000","last_became_peered":"2023-09-13T06:11:16.693035+0000","last_unstale":"2023-09-13T06:11:17.729091+0000","last_undegraded":"2023-09-13T06:11:17.729091+0000","last_fullsized":"2023-09-13T06:11:17.729091+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:36:50.999384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.464706+0000","last_change":"2023-09-13T06:11:17.464637+0000","last_active":"2023-09-13T06:11:17.464706+0000","last_peered":"2023-09-13T06:11:17.464706+0000","last_clean":"2023-09-13T06:11:17.464706+0000","last_became_active":"2023-09-13T06:11:17.464267+0000","last_became_peered":"2023-09-13T06:11:17.464267+0000","last_unstale":"2023-09-13T06:11:17.464706+0000","last_undegraded":"2023-09-13T06:11:17.464706+0000","last_fullsized":"2023-09-13T06:11:17.464706+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:45:56.154910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461592+0000","last_change":"2023-09-13T06:11:16.694260+0000","last_active":"2023-09-13T06:11:18.461592+0000","last_peered":"2023-09-13T06:11:18.461592+0000","last_clean":"2023-09-13T06:11:18.461592+0000","last_became_active":"2023-09-13T06:11:16.693934+0000","last_became_peered":"2023-09-13T06:11:16.693934+0000","last_unstale":"2023-09-13T06:11:18.461592+0000","last_undegraded":"2023-09-13T06:11:18.461592+0000","last_fullsized":"2023-09-13T06:11:18.461592+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:39:38.036390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.473958+0000","last_change":"2023-09-13T06:11:17.473887+0000","last_active":"2023-09-13T06:11:17.473958+0000","last_peered":"2023-09-13T06:11:17.473958+0000","last_clean":"2023-09-13T06:11:17.473958+0000","last_became_active":"2023-09-13T06:11:17.473516+0000","last_became_peered":"2023-09-13T06:11:17.473516+0000","last_unstale":"2023-09-13T06:11:17.473958+0000","last_undegraded":"2023-09-13T06:11:17.473958+0000","last_fullsized":"2023-09-13T06:11:17.473958+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:23:23.703023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.463726+0000","last_change":"2023-09-13T06:11:16.700954+0000","last_active":"2023-09-13T06:11:17.463726+0000","last_peered":"2023-09-13T06:11:17.463726+0000","last_clean":"2023-09-13T06:11:17.463726+0000","last_became_active":"2023-09-13T06:11:16.699638+0000","last_became_peered":"2023-09-13T06:11:16.699638+0000","last_unstale":"2023-09-13T06:11:17.463726+0000","last_undegraded":"2023-09-13T06:11:17.463726+0000","last_fullsized":"2023-09-13T06:11:17.463726+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:04:50.659111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.473163+0000","last_change":"2023-09-13T06:11:17.473091+0000","last_active":"2023-09-13T06:11:17.473163+0000","last_peered":"2023-09-13T06:11:17.473163+0000","last_clean":"2023-09-13T06:11:17.473163+0000","last_became_active":"2023-09-13T06:11:17.472811+0000","last_became_peered":"2023-09-13T06:11:17.472811+0000","last_unstale":"2023-09-13T06:11:17.473163+0000","last_undegraded":"2023-09-13T06:11:17.473163+0000","last_fullsized":"2023-09-13T06:11:17.473163+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:19:33.850602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.461856+0000","last_change":"2023-09-13T06:11:16.695507+0000","last_active":"2023-09-13T06:11:17.461856+0000","last_peered":"2023-09-13T06:11:17.461856+0000","last_clean":"2023-09-13T06:11:17.461856+0000","last_became_active":"2023-09-13T06:11:16.695234+0000","last_became_peered":"2023-09-13T06:11:16.695234+0000","last_unstale":"2023-09-13T06:11:17.461856+0000","last_undegraded":"2023-09-13T06:11:17.461856+0000","last_fullsized":"2023-09-13T06:11:17.461856+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:54:13.138856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464782+0000","last_change":"2023-09-13T06:11:17.467339+0000","last_active":"2023-09-13T06:11:18.464782+0000","last_peered":"2023-09-13T06:11:18.464782+0000","last_clean":"2023-09-13T06:11:18.464782+0000","last_became_active":"2023-09-13T06:11:17.467047+0000","last_became_peered":"2023-09-13T06:11:17.467047+0000","last_unstale":"2023-09-13T06:11:18.464782+0000","last_undegraded":"2023-09-13T06:11:18.464782+0000","last_fullsized":"2023-09-13T06:11:18.464782+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:54:34.327746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464620+0000","last_change":"2023-09-13T06:11:16.692915+0000","last_active":"2023-09-13T06:11:18.464620+0000","last_peered":"2023-09-13T06:11:18.464620+0000","last_clean":"2023-09-13T06:11:18.464620+0000","last_became_active":"2023-09-13T06:11:16.692159+0000","last_became_peered":"2023-09-13T06:11:16.692159+0000","last_unstale":"2023-09-13T06:11:18.464620+0000","last_undegraded":"2023-09-13T06:11:18.464620+0000","last_fullsized":"2023-09-13T06:11:18.464620+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:57:48.442005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461340+0000","last_change":"2023-09-13T06:11:17.467157+0000","last_active":"2023-09-13T06:11:18.461340+0000","last_peered":"2023-09-13T06:11:18.461340+0000","last_clean":"2023-09-13T06:11:18.461340+0000","last_became_active":"2023-09-13T06:11:17.466914+0000","last_became_peered":"2023-09-13T06:11:17.466914+0000","last_unstale":"2023-09-13T06:11:18.461340+0000","last_undegraded":"2023-09-13T06:11:18.461340+0000","last_fullsized":"2023-09-13T06:11:18.461340+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:26:26.796474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"170'6","reported_seq":18,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460209+0000","last_change":"2023-09-13T06:11:16.696213+0000","last_active":"2023-09-13T06:11:18.460209+0000","last_peered":"2023-09-13T06:11:18.460209+0000","last_clean":"2023-09-13T06:11:18.460209+0000","last_became_active":"2023-09-13T06:11:16.695971+0000","last_became_peered":"2023-09-13T06:11:16.695971+0000","last_unstale":"2023-09-13T06:11:18.460209+0000","last_undegraded":"2023-09-13T06:11:18.460209+0000","last_fullsized":"2023-09-13T06:11:18.460209+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:37:41.319154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.477898+0000","last_change":"2023-09-13T06:11:17.477723+0000","last_active":"2023-09-13T06:11:17.477898+0000","last_peered":"2023-09-13T06:11:17.477898+0000","last_clean":"2023-09-13T06:11:17.477898+0000","last_became_active":"2023-09-13T06:11:17.477485+0000","last_became_peered":"2023-09-13T06:11:17.477485+0000","last_unstale":"2023-09-13T06:11:17.477898+0000","last_undegraded":"2023-09-13T06:11:17.477898+0000","last_fullsized":"2023-09-13T06:11:17.477898+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:16:53.929376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"170'2","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.730121+0000","last_change":"2023-09-13T06:11:16.700768+0000","last_active":"2023-09-13T06:11:17.730121+0000","last_peered":"2023-09-13T06:11:17.730121+0000","last_clean":"2023-09-13T06:11:17.730121+0000","last_became_active":"2023-09-13T06:11:16.700503+0000","last_became_peered":"2023-09-13T06:11:16.700503+0000","last_unstale":"2023-09-13T06:11:17.730121+0000","last_undegraded":"2023-09-13T06:11:17.730121+0000","last_fullsized":"2023-09-13T06:11:17.730121+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:53:44.448153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.464646+0000","last_change":"2023-09-13T06:11:17.464488+0000","last_active":"2023-09-13T06:11:17.464646+0000","last_peered":"2023-09-13T06:11:17.464646+0000","last_clean":"2023-09-13T06:11:17.464646+0000","last_became_active":"2023-09-13T06:11:17.463938+0000","last_became_peered":"2023-09-13T06:11:17.463938+0000","last_unstale":"2023-09-13T06:11:17.464646+0000","last_undegraded":"2023-09-13T06:11:17.464646+0000","last_fullsized":"2023-09-13T06:11:17.464646+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:38:27.698383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.469067+0000","last_change":"2023-09-13T06:11:16.699068+0000","last_active":"2023-09-13T06:11:17.469067+0000","last_peered":"2023-09-13T06:11:17.469067+0000","last_clean":"2023-09-13T06:11:17.469067+0000","last_became_active":"2023-09-13T06:11:16.698835+0000","last_became_peered":"2023-09-13T06:11:16.698835+0000","last_unstale":"2023-09-13T06:11:17.469067+0000","last_undegraded":"2023-09-13T06:11:17.469067+0000","last_fullsized":"2023-09-13T06:11:17.469067+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:34:49.572622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.477980+0000","last_change":"2023-09-13T06:11:17.477822+0000","last_active":"2023-09-13T06:11:17.477980+0000","last_peered":"2023-09-13T06:11:17.477980+0000","last_clean":"2023-09-13T06:11:17.477980+0000","last_became_active":"2023-09-13T06:11:17.475161+0000","last_became_peered":"2023-09-13T06:11:17.475161+0000","last_unstale":"2023-09-13T06:11:17.477980+0000","last_undegraded":"2023-09-13T06:11:17.477980+0000","last_fullsized":"2023-09-13T06:11:17.477980+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:12:26.272273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.458183+0000","last_change":"2023-09-13T06:11:16.691607+0000","last_active":"2023-09-13T06:11:17.458183+0000","last_peered":"2023-09-13T06:11:17.458183+0000","last_clean":"2023-09-13T06:11:17.458183+0000","last_became_active":"2023-09-13T06:11:16.691362+0000","last_became_peered":"2023-09-13T06:11:16.691362+0000","last_unstale":"2023-09-13T06:11:17.458183+0000","last_undegraded":"2023-09-13T06:11:17.458183+0000","last_fullsized":"2023-09-13T06:11:17.458183+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:21:44.640685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.476787+0000","last_change":"2023-09-13T06:11:17.475619+0000","last_active":"2023-09-13T06:11:17.476787+0000","last_peered":"2023-09-13T06:11:17.476787+0000","last_clean":"2023-09-13T06:11:17.476787+0000","last_became_active":"2023-09-13T06:11:17.474041+0000","last_became_peered":"2023-09-13T06:11:17.474041+0000","last_unstale":"2023-09-13T06:11:17.476787+0000","last_undegraded":"2023-09-13T06:11:17.476787+0000","last_fullsized":"2023-09-13T06:11:17.476787+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:09:33.624307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"170'8","reported_seq":20,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461431+0000","last_change":"2023-09-13T06:11:16.699176+0000","last_active":"2023-09-13T06:11:18.461431+0000","last_peered":"2023-09-13T06:11:18.461431+0000","last_clean":"2023-09-13T06:11:18.461431+0000","last_became_active":"2023-09-13T06:11:16.698919+0000","last_became_peered":"2023-09-13T06:11:16.698919+0000","last_unstale":"2023-09-13T06:11:18.461431+0000","last_undegraded":"2023-09-13T06:11:18.461431+0000","last_fullsized":"2023-09-13T06:11:18.461431+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:12:31.284861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464920+0000","last_change":"2023-09-13T06:11:17.476538+0000","last_active":"2023-09-13T06:11:18.464920+0000","last_peered":"2023-09-13T06:11:18.464920+0000","last_clean":"2023-09-13T06:11:18.464920+0000","last_became_active":"2023-09-13T06:11:17.475674+0000","last_became_peered":"2023-09-13T06:11:17.475674+0000","last_unstale":"2023-09-13T06:11:18.464920+0000","last_undegraded":"2023-09-13T06:11:18.464920+0000","last_fullsized":"2023-09-13T06:11:18.464920+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:38.103358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"170'1","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.728297+0000","last_change":"2023-09-13T06:11:16.698283+0000","last_active":"2023-09-13T06:11:17.728297+0000","last_peered":"2023-09-13T06:11:17.728297+0000","last_clean":"2023-09-13T06:11:17.728297+0000","last_became_active":"2023-09-13T06:11:16.698061+0000","last_became_peered":"2023-09-13T06:11:16.698061+0000","last_unstale":"2023-09-13T06:11:17.728297+0000","last_undegraded":"2023-09-13T06:11:17.728297+0000","last_fullsized":"2023-09-13T06:11:17.728297+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:08:29.830158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461512+0000","last_change":"2023-09-13T06:11:17.470933+0000","last_active":"2023-09-13T06:11:18.461512+0000","last_peered":"2023-09-13T06:11:18.461512+0000","last_clean":"2023-09-13T06:11:18.461512+0000","last_became_active":"2023-09-13T06:11:17.470578+0000","last_became_peered":"2023-09-13T06:11:17.470578+0000","last_unstale":"2023-09-13T06:11:18.461512+0000","last_undegraded":"2023-09-13T06:11:18.461512+0000","last_fullsized":"2023-09-13T06:11:18.461512+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:19:33.850602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"170'2","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.730286+0000","last_change":"2023-09-13T06:11:16.696247+0000","last_active":"2023-09-13T06:11:17.730286+0000","last_peered":"2023-09-13T06:11:17.730286+0000","last_clean":"2023-09-13T06:11:17.730286+0000","last_became_active":"2023-09-13T06:11:16.696032+0000","last_became_peered":"2023-09-13T06:11:16.696032+0000","last_unstale":"2023-09-13T06:11:17.730286+0000","last_undegraded":"2023-09-13T06:11:17.730286+0000","last_fullsized":"2023-09-13T06:11:17.730286+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:10:03.575237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.476822+0000","last_change":"2023-09-13T06:11:17.476106+0000","last_active":"2023-09-13T06:11:17.476822+0000","last_peered":"2023-09-13T06:11:17.476822+0000","last_clean":"2023-09-13T06:11:17.476822+0000","last_became_active":"2023-09-13T06:11:17.475302+0000","last_became_peered":"2023-09-13T06:11:17.475302+0000","last_unstale":"2023-09-13T06:11:17.476822+0000","last_undegraded":"2023-09-13T06:11:17.476822+0000","last_fullsized":"2023-09-13T06:11:17.476822+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:55:21.209208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"170'1","reported_seq":13,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461528+0000","last_change":"2023-09-13T06:11:16.693013+0000","last_active":"2023-09-13T06:11:18.461528+0000","last_peered":"2023-09-13T06:11:18.461528+0000","last_clean":"2023-09-13T06:11:18.461528+0000","last_became_active":"2023-09-13T06:11:16.692766+0000","last_became_peered":"2023-09-13T06:11:16.692766+0000","last_unstale":"2023-09-13T06:11:18.461528+0000","last_undegraded":"2023-09-13T06:11:18.461528+0000","last_fullsized":"2023-09-13T06:11:18.461528+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:27.820815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.470480+0000","last_change":"2023-09-13T06:11:17.470097+0000","last_active":"2023-09-13T06:11:17.470480+0000","last_peered":"2023-09-13T06:11:17.470480+0000","last_clean":"2023-09-13T06:11:17.470480+0000","last_became_active":"2023-09-13T06:11:17.469569+0000","last_became_peered":"2023-09-13T06:11:17.469569+0000","last_unstale":"2023-09-13T06:11:17.470480+0000","last_undegraded":"2023-09-13T06:11:17.470480+0000","last_fullsized":"2023-09-13T06:11:17.470480+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:34:50.333509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.461369+0000","last_change":"2023-09-13T06:11:16.702490+0000","last_active":"2023-09-13T06:11:17.461369+0000","last_peered":"2023-09-13T06:11:17.461369+0000","last_clean":"2023-09-13T06:11:17.461369+0000","last_became_active":"2023-09-13T06:11:16.702277+0000","last_became_peered":"2023-09-13T06:11:16.702277+0000","last_unstale":"2023-09-13T06:11:17.461369+0000","last_undegraded":"2023-09-13T06:11:17.461369+0000","last_fullsized":"2023-09-13T06:11:17.461369+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:52:33.859613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.475302+0000","last_change":"2023-09-13T06:11:17.474561+0000","last_active":"2023-09-13T06:11:17.475302+0000","last_peered":"2023-09-13T06:11:17.475302+0000","last_clean":"2023-09-13T06:11:17.475302+0000","last_became_active":"2023-09-13T06:11:17.472951+0000","last_became_peered":"2023-09-13T06:11:17.472951+0000","last_unstale":"2023-09-13T06:11:17.475302+0000","last_undegraded":"2023-09-13T06:11:17.475302+0000","last_fullsized":"2023-09-13T06:11:17.475302+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:29:14.834849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"170'2","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460833+0000","last_change":"2023-09-13T06:11:16.699672+0000","last_active":"2023-09-13T06:11:18.460833+0000","last_peered":"2023-09-13T06:11:18.460833+0000","last_clean":"2023-09-13T06:11:18.460833+0000","last_became_active":"2023-09-13T06:11:16.699282+0000","last_became_peered":"2023-09-13T06:11:16.699282+0000","last_unstale":"2023-09-13T06:11:18.460833+0000","last_undegraded":"2023-09-13T06:11:18.460833+0000","last_fullsized":"2023-09-13T06:11:18.460833+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:54:33.324898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460615+0000","last_change":"2023-09-13T06:11:17.471538+0000","last_active":"2023-09-13T06:11:18.460615+0000","last_peered":"2023-09-13T06:11:18.460615+0000","last_clean":"2023-09-13T06:11:18.460615+0000","last_became_active":"2023-09-13T06:11:17.471310+0000","last_became_peered":"2023-09-13T06:11:17.471310+0000","last_unstale":"2023-09-13T06:11:18.460615+0000","last_undegraded":"2023-09-13T06:11:18.460615+0000","last_fullsized":"2023-09-13T06:11:18.460615+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:57:10.900543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.465087+0000","last_change":"2023-09-13T06:11:16.691792+0000","last_active":"2023-09-13T06:11:18.465087+0000","last_peered":"2023-09-13T06:11:18.465087+0000","last_clean":"2023-09-13T06:11:18.465087+0000","last_became_active":"2023-09-13T06:11:16.691542+0000","last_became_peered":"2023-09-13T06:11:16.691542+0000","last_unstale":"2023-09-13T06:11:18.465087+0000","last_undegraded":"2023-09-13T06:11:18.465087+0000","last_fullsized":"2023-09-13T06:11:18.465087+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:30:37.628981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.467139+0000","last_change":"2023-09-13T06:11:17.466680+0000","last_active":"2023-09-13T06:11:17.467139+0000","last_peered":"2023-09-13T06:11:17.467139+0000","last_clean":"2023-09-13T06:11:17.467139+0000","last_became_active":"2023-09-13T06:11:17.466356+0000","last_became_peered":"2023-09-13T06:11:17.466356+0000","last_unstale":"2023-09-13T06:11:17.467139+0000","last_undegraded":"2023-09-13T06:11:17.467139+0000","last_fullsized":"2023-09-13T06:11:17.467139+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:21:35.430208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464973+0000","last_change":"2023-09-13T06:11:16.696393+0000","last_active":"2023-09-13T06:11:18.464973+0000","last_peered":"2023-09-13T06:11:18.464973+0000","last_clean":"2023-09-13T06:11:18.464973+0000","last_became_active":"2023-09-13T06:11:16.696154+0000","last_became_peered":"2023-09-13T06:11:16.696154+0000","last_unstale":"2023-09-13T06:11:18.464973+0000","last_undegraded":"2023-09-13T06:11:18.464973+0000","last_fullsized":"2023-09-13T06:11:18.464973+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:51:02.373002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460588+0000","last_change":"2023-09-13T06:11:17.471571+0000","last_active":"2023-09-13T06:11:18.460588+0000","last_peered":"2023-09-13T06:11:18.460588+0000","last_clean":"2023-09-13T06:11:18.460588+0000","last_became_active":"2023-09-13T06:11:17.471331+0000","last_became_peered":"2023-09-13T06:11:17.471331+0000","last_unstale":"2023-09-13T06:11:18.460588+0000","last_undegraded":"2023-09-13T06:11:18.460588+0000","last_fullsized":"2023-09-13T06:11:18.460588+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:50.766190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.469204+0000","last_change":"2023-09-13T06:11:16.696827+0000","last_active":"2023-09-13T06:11:17.469204+0000","last_peered":"2023-09-13T06:11:17.469204+0000","last_clean":"2023-09-13T06:11:17.469204+0000","last_became_active":"2023-09-13T06:11:16.696568+0000","last_became_peered":"2023-09-13T06:11:16.696568+0000","last_unstale":"2023-09-13T06:11:17.469204+0000","last_undegraded":"2023-09-13T06:11:17.469204+0000","last_fullsized":"2023-09-13T06:11:17.469204+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:22:47.174908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.477719+0000","last_change":"2023-09-13T06:11:17.477636+0000","last_active":"2023-09-13T06:11:17.477719+0000","last_peered":"2023-09-13T06:11:17.477719+0000","last_clean":"2023-09-13T06:11:17.477719+0000","last_became_active":"2023-09-13T06:11:17.474561+0000","last_became_peered":"2023-09-13T06:11:17.474561+0000","last_unstale":"2023-09-13T06:11:17.477719+0000","last_undegraded":"2023-09-13T06:11:17.477719+0000","last_fullsized":"2023-09-13T06:11:17.477719+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:10:45.858570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"170'2","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464904+0000","last_change":"2023-09-13T06:11:16.698568+0000","last_active":"2023-09-13T06:11:18.464904+0000","last_peered":"2023-09-13T06:11:18.464904+0000","last_clean":"2023-09-13T06:11:18.464904+0000","last_became_active":"2023-09-13T06:11:16.698180+0000","last_became_peered":"2023-09-13T06:11:16.698180+0000","last_unstale":"2023-09-13T06:11:18.464904+0000","last_undegraded":"2023-09-13T06:11:18.464904+0000","last_fullsized":"2023-09-13T06:11:18.464904+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:48:35.956984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.476805+0000","last_change":"2023-09-13T06:11:17.475916+0000","last_active":"2023-09-13T06:11:17.476805+0000","last_peered":"2023-09-13T06:11:17.476805+0000","last_clean":"2023-09-13T06:11:17.476805+0000","last_became_active":"2023-09-13T06:11:17.474939+0000","last_became_peered":"2023-09-13T06:11:17.474939+0000","last_unstale":"2023-09-13T06:11:17.476805+0000","last_undegraded":"2023-09-13T06:11:17.476805+0000","last_fullsized":"2023-09-13T06:11:17.476805+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:06:03.764257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.458571+0000","last_change":"2023-09-13T06:11:16.692198+0000","last_active":"2023-09-13T06:11:17.458571+0000","last_peered":"2023-09-13T06:11:17.458571+0000","last_clean":"2023-09-13T06:11:17.458571+0000","last_became_active":"2023-09-13T06:11:16.691867+0000","last_became_peered":"2023-09-13T06:11:16.691867+0000","last_unstale":"2023-09-13T06:11:17.458571+0000","last_undegraded":"2023-09-13T06:11:17.458571+0000","last_fullsized":"2023-09-13T06:11:17.458571+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:24.821413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468287+0000","last_change":"2023-09-13T06:11:17.467705+0000","last_active":"2023-09-13T06:11:17.468287+0000","last_peered":"2023-09-13T06:11:17.468287+0000","last_clean":"2023-09-13T06:11:17.468287+0000","last_became_active":"2023-09-13T06:11:17.467485+0000","last_became_peered":"2023-09-13T06:11:17.467485+0000","last_unstale":"2023-09-13T06:11:17.468287+0000","last_undegraded":"2023-09-13T06:11:17.468287+0000","last_fullsized":"2023-09-13T06:11:17.468287+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:51.147378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.459035+0000","last_change":"2023-09-13T06:11:16.694731+0000","last_active":"2023-09-13T06:11:17.459035+0000","last_peered":"2023-09-13T06:11:17.459035+0000","last_clean":"2023-09-13T06:11:17.459035+0000","last_became_active":"2023-09-13T06:11:16.694514+0000","last_became_peered":"2023-09-13T06:11:16.694514+0000","last_unstale":"2023-09-13T06:11:17.459035+0000","last_undegraded":"2023-09-13T06:11:17.459035+0000","last_fullsized":"2023-09-13T06:11:17.459035+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:05.659248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468244+0000","last_change":"2023-09-13T06:11:17.467679+0000","last_active":"2023-09-13T06:11:17.468244+0000","last_peered":"2023-09-13T06:11:17.468244+0000","last_clean":"2023-09-13T06:11:17.468244+0000","last_became_active":"2023-09-13T06:11:17.467465+0000","last_became_peered":"2023-09-13T06:11:17.467465+0000","last_unstale":"2023-09-13T06:11:17.468244+0000","last_undegraded":"2023-09-13T06:11:17.468244+0000","last_fullsized":"2023-09-13T06:11:17.468244+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:52:20.037764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.458220+0000","last_change":"2023-09-13T06:11:16.693074+0000","last_active":"2023-09-13T06:11:17.458220+0000","last_peered":"2023-09-13T06:11:17.458220+0000","last_clean":"2023-09-13T06:11:17.458220+0000","last_became_active":"2023-09-13T06:11:16.692833+0000","last_became_peered":"2023-09-13T06:11:16.692833+0000","last_unstale":"2023-09-13T06:11:17.458220+0000","last_undegraded":"2023-09-13T06:11:17.458220+0000","last_fullsized":"2023-09-13T06:11:17.458220+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:07.026012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461666+0000","last_change":"2023-09-13T06:11:17.471519+0000","last_active":"2023-09-13T06:11:18.461666+0000","last_peered":"2023-09-13T06:11:18.461666+0000","last_clean":"2023-09-13T06:11:18.461666+0000","last_became_active":"2023-09-13T06:11:17.471249+0000","last_became_peered":"2023-09-13T06:11:17.471249+0000","last_unstale":"2023-09-13T06:11:18.461666+0000","last_undegraded":"2023-09-13T06:11:18.461666+0000","last_fullsized":"2023-09-13T06:11:18.461666+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:20:32.182252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460467+0000","last_change":"2023-09-13T06:11:16.696634+0000","last_active":"2023-09-13T06:11:18.460467+0000","last_peered":"2023-09-13T06:11:18.460467+0000","last_clean":"2023-09-13T06:11:18.460467+0000","last_became_active":"2023-09-13T06:11:16.696359+0000","last_became_peered":"2023-09-13T06:11:16.696359+0000","last_unstale":"2023-09-13T06:11:18.460467+0000","last_undegraded":"2023-09-13T06:11:18.460467+0000","last_fullsized":"2023-09-13T06:11:18.460467+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:00:58.343302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.478549+0000","last_change":"2023-09-13T06:11:17.478456+0000","last_active":"2023-09-13T06:11:17.478549+0000","last_peered":"2023-09-13T06:11:17.478549+0000","last_clean":"2023-09-13T06:11:17.478549+0000","last_became_active":"2023-09-13T06:11:17.478225+0000","last_became_peered":"2023-09-13T06:11:17.478225+0000","last_unstale":"2023-09-13T06:11:17.478549+0000","last_undegraded":"2023-09-13T06:11:17.478549+0000","last_fullsized":"2023-09-13T06:11:17.478549+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:13.905663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464997+0000","last_change":"2023-09-13T06:11:16.698415+0000","last_active":"2023-09-13T06:11:18.464997+0000","last_peered":"2023-09-13T06:11:18.464997+0000","last_clean":"2023-09-13T06:11:18.464997+0000","last_became_active":"2023-09-13T06:11:16.697845+0000","last_became_peered":"2023-09-13T06:11:16.697845+0000","last_unstale":"2023-09-13T06:11:18.464997+0000","last_undegraded":"2023-09-13T06:11:18.464997+0000","last_fullsized":"2023-09-13T06:11:18.464997+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:07:24.960565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.465009+0000","last_change":"2023-09-13T06:11:17.469984+0000","last_active":"2023-09-13T06:11:18.465009+0000","last_peered":"2023-09-13T06:11:18.465009+0000","last_clean":"2023-09-13T06:11:18.465009+0000","last_became_active":"2023-09-13T06:11:17.469736+0000","last_became_peered":"2023-09-13T06:11:17.469736+0000","last_unstale":"2023-09-13T06:11:18.465009+0000","last_undegraded":"2023-09-13T06:11:18.465009+0000","last_fullsized":"2023-09-13T06:11:18.465009+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:50.766190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468216+0000","last_change":"2023-09-13T06:11:16.696383+0000","last_active":"2023-09-13T06:11:17.468216+0000","last_peered":"2023-09-13T06:11:17.468216+0000","last_clean":"2023-09-13T06:11:17.468216+0000","last_became_active":"2023-09-13T06:11:16.695812+0000","last_became_peered":"2023-09-13T06:11:16.695812+0000","last_unstale":"2023-09-13T06:11:17.468216+0000","last_undegraded":"2023-09-13T06:11:17.468216+0000","last_fullsized":"2023-09-13T06:11:17.468216+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:03.727457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.478639+0000","last_change":"2023-09-13T06:11:17.478535+0000","last_active":"2023-09-13T06:11:17.478639+0000","last_peered":"2023-09-13T06:11:17.478639+0000","last_clean":"2023-09-13T06:11:17.478639+0000","last_became_active":"2023-09-13T06:11:17.477277+0000","last_became_peered":"2023-09-13T06:11:17.477277+0000","last_unstale":"2023-09-13T06:11:17.478639+0000","last_undegraded":"2023-09-13T06:11:17.478639+0000","last_fullsized":"2023-09-13T06:11:17.478639+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:29.403563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.461502+0000","last_change":"2023-09-13T06:11:16.701900+0000","last_active":"2023-09-13T06:11:17.461502+0000","last_peered":"2023-09-13T06:11:17.461502+0000","last_clean":"2023-09-13T06:11:17.461502+0000","last_became_active":"2023-09-13T06:11:16.701528+0000","last_became_peered":"2023-09-13T06:11:16.701528+0000","last_unstale":"2023-09-13T06:11:17.461502+0000","last_undegraded":"2023-09-13T06:11:17.461502+0000","last_fullsized":"2023-09-13T06:11:17.461502+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:38:33.159782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460336+0000","last_change":"2023-09-13T06:11:17.471782+0000","last_active":"2023-09-13T06:11:18.460336+0000","last_peered":"2023-09-13T06:11:18.460336+0000","last_clean":"2023-09-13T06:11:18.460336+0000","last_became_active":"2023-09-13T06:11:17.471488+0000","last_became_peered":"2023-09-13T06:11:17.471488+0000","last_unstale":"2023-09-13T06:11:18.460336+0000","last_undegraded":"2023-09-13T06:11:18.460336+0000","last_fullsized":"2023-09-13T06:11:18.460336+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:48:54.767374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"170'3","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.731740+0000","last_change":"2023-09-13T06:11:16.696853+0000","last_active":"2023-09-13T06:11:17.731740+0000","last_peered":"2023-09-13T06:11:17.731740+0000","last_clean":"2023-09-13T06:11:17.731740+0000","last_became_active":"2023-09-13T06:11:16.696617+0000","last_became_peered":"2023-09-13T06:11:16.696617+0000","last_unstale":"2023-09-13T06:11:17.731740+0000","last_undegraded":"2023-09-13T06:11:17.731740+0000","last_fullsized":"2023-09-13T06:11:17.731740+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:56:50.768293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":332,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.465170+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:11:18.465170+0000","last_peered":"2023-09-13T06:11:18.465170+0000","last_clean":"2023-09-13T06:11:18.465170+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:11:18.465170+0000","last_undegraded":"2023-09-13T06:11:18.465170+0000","last_fullsized":"2023-09-13T06:11:18.465170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1517,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193794,"statfs":{"total":200000000,"available":198445574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.60699999999999998,"5min":0.38100000000000001,"15min":0.34599999999999997},"max":{"1min":0.94699999999999995,"5min":1.0349999999999999,"15min":1.3320000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72299999999999998,"15min":0.70199999999999996},"min":{"1min":0.52800000000000002,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":1.0089999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.54700000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94399999999999995,"5min":0.999,"15min":0.999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.748,"15min":0.73099999999999998},"min":{"1min":0.58799999999999997,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":0.92700000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69199999999999995,"15min":0.69799999999999995},"min":{"1min":0.57199999999999995,"5min":0.45600000000000002,"15min":0.432},"max":{"1min":0.85799999999999998,"5min":1.016,"15min":1.395},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72899999999999998,"15min":0.72199999999999998},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96199999999999997,"5min":0.97099999999999997,"15min":1.2030000000000001},"last":0.80700000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.68300000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":0.95299999999999996,"15min":1.357},"last":0.623},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.008,"5min":1.0580000000000001,"15min":1.2629999999999999},"last":0.77600000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.622},"min":{"1min":0.499,"5min":0.32600000000000001,"15min":0.316},"max":{"1min":0.85999999999999999,"5min":0.89300000000000002,"15min":0.95899999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63600000000000001,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80300000000000005,"5min":0.95899999999999996,"15min":1.018},"last":0.68200000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63800000000000001,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.97099999999999997,"15min":0.97999999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.56399999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.95999999999999996,"5min":0.99199999999999999,"15min":1.1319999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.64800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.0129999999999999,"15min":1.0920000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69899999999999995,"15min":0.69499999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.46600000000000003},"max":{"1min":0.90100000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.75800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574971,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042748,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66300000000000003,"15min":0.68100000000000005},"min":{"1min":0.504,"5min":0.35599999999999998,"15min":0.35299999999999998},"max":{"1min":0.873,"5min":1.0649999999999999,"15min":1.181},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.56699999999999995,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.95899999999999996,"5min":0.96299999999999997,"15min":1.028},"last":0.59199999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.876,"5min":1.024,"15min":1.0840000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.55300000000000005,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":1.137,"15min":1.153},"last":0.62}]},{"osd":2,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.44700000000000001,"15min":0.39300000000000002},"max":{"1min":0.91300000000000003,"5min":0.98599999999999999,"15min":1.4750000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68799999999999994,"15min":0.71199999999999997},"min":{"1min":0.55800000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96199999999999997,"5min":1.034,"15min":1.085},"last":0.66500000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72599999999999998,"15min":0.753},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91100000000000003,"5min":0.93700000000000006,"15min":1.2030000000000001},"last":0.749},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.65500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0009999999999999,"5min":1.0620000000000001,"15min":1.526},"last":0.73299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.40100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":1.024,"15min":1.0589999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.79400000000000004,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.47099999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.0089999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85999999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71699999999999997},"min":{"1min":0.47899999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91000000000000003,"5min":1.071,"15min":4.3879999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.51600000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":1.014,"15min":1.133},"last":0.80900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67300000000000004,"15min":0.66800000000000004},"min":{"1min":0.57299999999999995,"5min":0.35999999999999999,"15min":0.32000000000000001},"max":{"1min":0.876,"5min":0.91300000000000003,"15min":1.0389999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.69599999999999995,"15min":0.67500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.30199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.78800000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70299999999999996,"15min":0.69399999999999995},"min":{"1min":0.505,"5min":0.40699999999999997,"15min":0.36299999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.96099999999999997},"last":0.629},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93400000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.53500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88500000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47299999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91800000000000004,"5min":0.997,"15min":0.997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.71899999999999997,"15min":0.71399999999999997},"min":{"1min":0.61499999999999999,"5min":0.49099999999999999,"15min":0.47099999999999997},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.98099999999999998},"last":0.68300000000000005}]},{"osd":4,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.73099999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.61699999999999999},"min":{"1min":0.46000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76300000000000001,"5min":1.077,"15min":1.077},"last":0.81699999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.505,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82999999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.46700000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83399999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66900000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.70899999999999996,"15min":0.71499999999999997},"min":{"1min":0.502,"5min":0.42099999999999999,"15min":0.41799999999999998},"max":{"1min":0.878,"5min":1.171,"15min":1.171},"last":0.753},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.56699999999999995,"5min":0.495,"15min":0.48499999999999999},"max":{"1min":0.90500000000000003,"5min":1.024,"15min":1.026},"last":0.77000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574971,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042894,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.65300000000000002},"min":{"1min":0.53000000000000003,"5min":0.432,"15min":0.34999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.69599999999999995,"15min":0.68200000000000005},"min":{"1min":0.59099999999999997,"5min":0.436,"15min":0.38},"max":{"1min":0.91300000000000003,"5min":1.145,"15min":1.145},"last":0.45400000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.71499999999999997,"15min":0.68300000000000005},"min":{"1min":0.68300000000000005,"5min":0.39100000000000001,"15min":0.376},"max":{"1min":0.91100000000000003,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70799999999999996,"15min":0.68100000000000005},"min":{"1min":0.58299999999999996,"5min":0.45400000000000001,"15min":0.40500000000000003},"max":{"1min":0.93200000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.68000000000000005},"min":{"1min":0.56200000000000006,"5min":0.45600000000000002,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.76100000000000001,"15min":0.74399999999999999},"min":{"1min":0.68600000000000005,"5min":0.46500000000000002,"15min":0.40600000000000003},"max":{"1min":0.98899999999999999,"5min":1.056,"15min":1.056},"last":0.65200000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.72299999999999998},"min":{"1min":0.60499999999999998,"5min":0.48299999999999998,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":1.077,"15min":1.077},"last":0.626},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.75,"15min":0.72699999999999998},"min":{"1min":0.68700000000000006,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.071},"last":0.75700000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63800000000000001,"15min":0.62},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.88600000000000001,"5min":0.96899999999999997,"15min":1.01},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.45100000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.91300000000000003,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94199999999999995,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.53500000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.92800000000000005,"5min":1.123,"15min":1.123},"last":0.73999999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73299999999999998,"15min":0.71899999999999997},"min":{"1min":0.495,"5min":0.49299999999999999,"15min":0.39200000000000002},"max":{"1min":0.98299999999999998,"5min":1.26,"15min":1.26},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72299999999999998,"15min":0.71299999999999997},"min":{"1min":0.47699999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.96499999999999997,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.82399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042804,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.432,"15min":0.40899999999999997},"min":{"1min":0.33700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47499999999999998,"15min":0.44600000000000001},"min":{"1min":0.307,"5min":0.28999999999999998,"15min":0.28299999999999997},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.43099999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.434},"min":{"1min":0.33700000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.5,"15min":0.47199999999999998},"min":{"1min":0.39300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52000000000000002,"15min":0.50800000000000001},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.33400000000000002},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54200000000000004,"15min":0.52300000000000002},"min":{"1min":0.434,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.78100000000000003},"last":0.46899999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.55800000000000005,"5min":0.46700000000000003,"15min":0.42999999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.284},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.60499999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.044},"last":0.67600000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.56599999999999995,"5min":0.46200000000000002,"15min":0.442},"max":{"1min":1.107,"5min":1.107,"15min":1.111},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72599999999999998,"15min":0.73599999999999999},"min":{"1min":0.52100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.107,"5min":1.107,"15min":1.2270000000000001},"last":0.82099999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.748,"15min":0.73499999999999999},"min":{"1min":0.58499999999999996,"5min":0.48899999999999999,"15min":0.47499999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.61899999999999999,"5min":0.54500000000000004,"15min":0.53000000000000003},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.458},"last":0.81200000000000006}]},{"osd":7,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.74199999999999999,"15min":0.76600000000000001},"min":{"1min":0.56899999999999995,"5min":0.46100000000000002,"15min":0.45900000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.383},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.76100000000000001,"15min":0.76200000000000001},"min":{"1min":0.629,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.27},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834574971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":936,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194376,"statfs":{"total":200000000,"available":199041212,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.32600000000000001,"5min":0.252,"15min":0.22700000000000001},"max":{"1min":0.55200000000000005,"5min":0.745,"15min":10.401},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.45400000000000001,"15min":0.44800000000000001},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.27400000000000002},"max":{"1min":0.66500000000000004,"5min":0.69399999999999995,"15min":5.4429999999999996},"last":0.379}]},{"osd":1,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.46700000000000003},"min":{"1min":0.38200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67800000000000005,"5min":0.68600000000000005,"15min":5.2640000000000002},"last":0.437},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.497,"15min":0.48099999999999998},"min":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.312},"max":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":4.3369999999999997},"last":0.499}]},{"osd":3,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48999999999999999,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":6.0410000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.52600000000000002,"5min":0.41399999999999998,"15min":0.38600000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":6.1600000000000001},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.67400000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92700000000000005,"5min":1.171,"15min":5.4809999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.623,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88500000000000001,"5min":1.121,"15min":4.0599999999999996},"last":0.72099999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.75,"15min":0.76900000000000002},"min":{"1min":0.64200000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94799999999999995,"5min":1.1579999999999999,"15min":4.2089999999999996},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78800000000000003,"15min":0.79700000000000004},"min":{"1min":0.69999999999999996,"5min":0.501,"15min":0.501},"max":{"1min":0.97599999999999998,"5min":1.135,"15min":5.5289999999999999},"last":0.83399999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.66100000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91300000000000003,"5min":1.048,"15min":4.1609999999999996},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.75600000000000001,"15min":0.73799999999999999},"min":{"1min":0.66800000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.99199999999999999,"5min":1.1100000000000001,"15min":4.2380000000000004},"last":0.86499999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.64100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93100000000000005,"5min":1.1879999999999999,"15min":4.2400000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.70099999999999996,"5min":0.48699999999999999,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":1.135,"15min":4.2649999999999997},"last":0.91400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.45600000000000002,"15min":0.44600000000000001},"min":{"1min":0.318,"5min":0.252,"15min":0.252},"max":{"1min":0.78100000000000003,"5min":0.80200000000000005,"15min":2.4020000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.29199999999999998,"15min":0.27300000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.81100000000000005},"last":0.36699999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.46999999999999997},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.67600000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.48099999999999998},"min":{"1min":0.35699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84799999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.33100000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.88,"15min":0.88},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.38100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.59499999999999997,"5min":0.80600000000000005,"15min":4.0599999999999996},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.747,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90000000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.754,"15min":0.75},"min":{"1min":0.67300000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98599999999999999,"5min":1.121,"15min":1.2150000000000001},"last":0.505}]},{"osd":5,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.746,"15min":0.754},"min":{"1min":0.57999999999999996,"5min":0.443,"15min":0.443},"max":{"1min":0.98199999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.76500000000000001,"15min":0.753},"min":{"1min":0.56999999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0109999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.499,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96599999999999997,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.48899999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0640000000000001,"15min":1.3799999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76600000000000001,"15min":0.748},"min":{"1min":0.64600000000000002,"5min":0.47399999999999998,"15min":0.42599999999999999},"max":{"1min":0.997,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.627,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94099999999999995,"5min":1.0409999999999999,"15min":1.2769999999999999},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574971,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1512,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193799,"statfs":{"total":200000000,"available":198450880,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.32600000000000001,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":2.0190000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.309,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.89800000000000002,"15min":2.294},"last":0.34899999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.502},"min":{"1min":0.39600000000000002,"5min":0.34000000000000002,"15min":0.28999999999999998},"max":{"1min":0.68400000000000005,"5min":0.875,"15min":2.2410000000000001},"last":0.438},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.46500000000000002,"15min":0.47799999999999998},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.67500000000000004,"5min":0.76500000000000001,"15min":2.056},"last":0.372}]},{"osd":3,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.38,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":2.0859999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.753,"5min":0.83599999999999997,"15min":2.3820000000000001},"last":0.47399999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.66400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.0309999999999999,"5min":1.034,"15min":2.1749999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.753,"15min":0.77700000000000002},"min":{"1min":0.61699999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.0549999999999999,"5min":1.0940000000000001,"15min":2.3370000000000002},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73499999999999999,"15min":0.76200000000000001},"min":{"1min":0.629,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97999999999999998,"5min":1.0680000000000001,"15min":2.3119999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.71699999999999997,"5min":0.51400000000000001,"15min":0.48799999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":2.1469999999999998},"last":0.81499999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.77400000000000002},"min":{"1min":0.66600000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.01,"5min":1.054,"15min":2.415},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.73599999999999999,"15min":0.76500000000000001},"min":{"1min":0.628,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.113,"5min":1.121,"15min":2.347},"last":0.79500000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.75,"15min":0.78300000000000003},"min":{"1min":0.66200000000000003,"5min":0.496,"15min":0.495},"max":{"1min":1.0920000000000001,"5min":1.1499999999999999,"15min":2.367},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.64700000000000002,"5min":0.53300000000000003,"15min":0.53000000000000003},"max":{"1min":0.92900000000000005,"5min":1.0509999999999999,"15min":2.1179999999999999},"last":0.78000000000000003}]}]}],"pool_statfs":[]}} 2023-09-13T06:11:21.972 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:11:22.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.109+0000 7f1904bac640 1 Processor -- start 2023-09-13T06:11:22.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.109+0000 7f1904bac640 1 -- start start 2023-09-13T06:11:22.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f1904bac640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f19000cc780 0x7f190015b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f1904bac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f19000b04a0 0x7f19000b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f1904bac640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000ccbe0 con 0x7f190015b130 2023-09-13T06:11:22.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f1904bac640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19000b0e50 con 0x7f19000b04a0 2023-09-13T06:11:22.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f1904bac640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19000ce980 con 0x7f19000cc780 2023-09-13T06:11:22.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f18fed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f19000b04a0 0x7f19000b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f18fed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f19000b04a0 0x7f19000b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59692/0 (socket says 172.21.15.130:59692) 2023-09-13T06:11:22.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f18fe59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f190015b130 0x7f19000ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59882/0 (socket says 172.21.15.130:59882) 2023-09-13T06:11:22.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f18fed9d640 1 -- 172.21.15.130:0/2522433327 learned_addr learned my addr 172.21.15.130:0/2522433327 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:22.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f18f7fff640 1 --2- 172.21.15.130:0/2522433327 >> v2:172.21.15.164:3300/0 conn(0x7f19000cc780 0x7f190015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f18fed9d640 1 -- 172.21.15.130:0/2522433327 >> v2:172.21.15.164:3300/0 conn(0x7f19000cc780 msgr2=0x7f190015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f18fed9d640 1 --2- 172.21.15.130:0/2522433327 >> v2:172.21.15.164:3300/0 conn(0x7f19000cc780 0x7f190015b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f18fed9d640 1 -- 172.21.15.130:0/2522433327 >> v1:172.21.15.130:6789/0 conn(0x7f190015b130 legacy=0x7f19000ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f18fed9d640 1 -- 172.21.15.130:0/2522433327 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000cec60 con 0x7f19000b04a0 2023-09-13T06:11:22.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.113+0000 7f18fdd9b640 1 -- 172.21.15.130:0/2522433327 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813925297 0 0) 0x7f19000ccbe0 con 0x7f190015b130 2023-09-13T06:11:22.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f18fed9d640 1 --2- 172.21.15.130:0/2522433327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19000b04a0 0x7f19000b0910 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f190006bc40 tx=0x7f18f801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6078d590b8385878 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:22.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f18fdd9b640 1 -- 172.21.15.130:0/2522433327 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80a5860 con 0x7f19000b04a0 2023-09-13T06:11:22.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f18fdd9b640 1 -- 172.21.15.130:0/2522433327 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f80a59c0 con 0x7f19000b04a0 2023-09-13T06:11:22.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f18fdd9b640 1 -- 172.21.15.130:0/2522433327 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80a5d50 con 0x7f19000b04a0 2023-09-13T06:11:22.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f1904bac640 1 -- 172.21.15.130:0/2522433327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19000b04a0 msgr2=0x7f19000b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f1904bac640 1 --2- 172.21.15.130:0/2522433327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19000b04a0 0x7f19000b0910 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f190006bc40 tx=0x7f18f801c9a0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f1904bac640 1 -- 172.21.15.130:0/2522433327 shutdown_connections 2023-09-13T06:11:22.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f1904bac640 1 --2- 172.21.15.130:0/2522433327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19000b04a0 0x7f19000b0910 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f1904bac640 1 --2- 172.21.15.130:0/2522433327 >> v2:172.21.15.164:3300/0 conn(0x7f19000cc780 0x7f190015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f1904bac640 1 -- 172.21.15.130:0/2522433327 >> 172.21.15.130:0/2522433327 conn(0x7f1900065990 msgr2=0x7f1900065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:22.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f1904bac640 1 -- 172.21.15.130:0/2522433327 shutdown_connections 2023-09-13T06:11:22.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f1904bac640 1 -- 172.21.15.130:0/2522433327 wait complete. 2023-09-13T06:11:22.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f1904bac640 1 Processor -- start 2023-09-13T06:11:22.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.117+0000 7f1904bac640 1 -- start start 2023-09-13T06:11:22.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f1904bac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19000b04a0 0x7f1900138a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f1904bac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19000cc780 0x7f190014c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f1904bac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f190015b130 0x7f19001f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f1904bac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190014ff30 con 0x7f19000cc780 2023-09-13T06:11:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f1904bac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1900153d80 con 0x7f190015b130 2023-09-13T06:11:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f1904bac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1900154060 con 0x7f19000b04a0 2023-09-13T06:11:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19000cc780 0x7f190014c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19000cc780 0x7f190014c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59708/0 (socket says 172.21.15.130:59708) 2023-09-13T06:11:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f7fff640 1 -- 172.21.15.130:0/2592595570 learned_addr learned my addr 172.21.15.130:0/2592595570 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f7fff640 1 -- 172.21.15.130:0/2592595570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19000b04a0 msgr2=0x7f1900138a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f7fff640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19000b04a0 0x7f1900138a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f7fff640 1 -- 172.21.15.130:0/2592595570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f190015b130 msgr2=0x7f19001f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f7fff640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f190015b130 0x7f19001f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f7fff640 1 -- 172.21.15.130:0/2592595570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8009b30 con 0x7f19000cc780 2023-09-13T06:11:22.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f7fff640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19000cc780 0x7f190014c490 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f18e800d800 tx=0x7f18e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:22.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f6ffd640 1 -- 172.21.15.130:0/2592595570 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e800b6c0 con 0x7f19000cc780 2023-09-13T06:11:22.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f6ffd640 1 -- 172.21.15.130:0/2592595570 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e800b820 con 0x7f19000cc780 2023-09-13T06:11:22.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f6ffd640 1 -- 172.21.15.130:0/2592595570 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e800bb90 con 0x7f19000cc780 2023-09-13T06:11:22.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f1904bac640 1 -- 172.21.15.130:0/2592595570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1900154340 con 0x7f19000cc780 2023-09-13T06:11:22.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f1904bac640 1 -- 172.21.15.130:0/2592595570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1900138fc0 con 0x7f19000cc780 2023-09-13T06:11:22.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f1904bac640 1 -- 172.21.15.130:0/2592595570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19000618a0 con 0x7f19000cc780 2023-09-13T06:11:22.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.121+0000 7f18f6ffd640 1 -- 172.21.15.130:0/2592595570 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f18e800bcf0 con 0x7f19000cc780 2023-09-13T06:11:22.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.125+0000 7f18f6ffd640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18e0065b20 0x7f18e0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.125+0000 7f18f6ffd640 1 -- 172.21.15.130:0/2592595570 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18e8083900 con 0x7f19000cc780 2023-09-13T06:11:22.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.125+0000 7f18fe59c640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18e0065b20 0x7f18e0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.125+0000 7f18fe59c640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18e0065b20 0x7f18e0067fe0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f18f00015a0 tx=0x7f18f0007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:22.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.129+0000 7f18f6ffd640 1 -- 172.21.15.130:0/2592595570 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f18e80511b0 con 0x7f19000cc780 2023-09-13T06:11:22.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.273+0000 7f1904bac640 1 -- 172.21.15.130:0/2592595570 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f190015ba50 con 0x7f18e0065b20 2023-09-13T06:11:22.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.281+0000 7f18f6ffd640 1 -- 172.21.15.130:0/2592595570 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284930 (secure 0 0 0) 0x7f18f00070d0 con 0x7f18e0065b20 2023-09-13T06:11:22.284 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:22.286 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:11:22.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 -- 172.21.15.130:0/2592595570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18e0065b20 msgr2=0x7f18e0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18e0065b20 0x7f18e0067fe0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f18f00015a0 tx=0x7f18f0007970 comp rx=0 tx=0).stop 2023-09-13T06:11:22.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 -- 172.21.15.130:0/2592595570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19000cc780 msgr2=0x7f190014c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19000cc780 0x7f190014c490 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f18e800d800 tx=0x7f18e800dcc0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 -- 172.21.15.130:0/2592595570 shutdown_connections 2023-09-13T06:11:22.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f18e0065b20 0x7f18e0067fe0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f190015b130 0x7f19001f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19000cc780 0x7f190014c490 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 --2- 172.21.15.130:0/2592595570 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19000b04a0 0x7f1900138a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 -- 172.21.15.130:0/2592595570 >> 172.21.15.130:0/2592595570 conn(0x7f1900065990 msgr2=0x7f190015a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:22.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 -- 172.21.15.130:0/2592595570 shutdown_connections 2023-09-13T06:11:22.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.285+0000 7f1904bac640 1 -- 172.21.15.130:0/2592595570 wait complete. 2023-09-13T06:11:22.304 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":466,"stamp":"2023-09-13T06:11:20.667237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8641,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553858,"statfs":{"total":1600000000,"available":1591151296,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.985151"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.471517+0000","last_change":"2023-09-13T06:11:17.471353+0000","last_active":"2023-09-13T06:11:17.471517+0000","last_peered":"2023-09-13T06:11:17.471517+0000","last_clean":"2023-09-13T06:11:17.471517+0000","last_became_active":"2023-09-13T06:11:17.471056+0000","last_became_peered":"2023-09-13T06:11:17.471056+0000","last_unstale":"2023-09-13T06:11:17.471517+0000","last_undegraded":"2023-09-13T06:11:17.471517+0000","last_fullsized":"2023-09-13T06:11:17.471517+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:35:59.132343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.465746+0000","last_change":"2023-09-13T06:11:17.465642+0000","last_active":"2023-09-13T06:11:17.465746+0000","last_peered":"2023-09-13T06:11:17.465746+0000","last_clean":"2023-09-13T06:11:17.465746+0000","last_became_active":"2023-09-13T06:11:17.465044+0000","last_became_peered":"2023-09-13T06:11:17.465044+0000","last_unstale":"2023-09-13T06:11:17.465746+0000","last_undegraded":"2023-09-13T06:11:17.465746+0000","last_fullsized":"2023-09-13T06:11:17.465746+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:30:12.212435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.473481+0000","last_change":"2023-09-13T06:11:17.472711+0000","last_active":"2023-09-13T06:11:17.473481+0000","last_peered":"2023-09-13T06:11:17.473481+0000","last_clean":"2023-09-13T06:11:17.473481+0000","last_became_active":"2023-09-13T06:11:17.472218+0000","last_became_peered":"2023-09-13T06:11:17.472218+0000","last_unstale":"2023-09-13T06:11:17.473481+0000","last_undegraded":"2023-09-13T06:11:17.473481+0000","last_fullsized":"2023-09-13T06:11:17.473481+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:26:12.439786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.475780+0000","last_change":"2023-09-13T06:11:17.475556+0000","last_active":"2023-09-13T06:11:17.475780+0000","last_peered":"2023-09-13T06:11:17.475780+0000","last_clean":"2023-09-13T06:11:17.475780+0000","last_became_active":"2023-09-13T06:11:17.473824+0000","last_became_peered":"2023-09-13T06:11:17.473824+0000","last_unstale":"2023-09-13T06:11:17.475780+0000","last_undegraded":"2023-09-13T06:11:17.475780+0000","last_fullsized":"2023-09-13T06:11:17.475780+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:37:30.901364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.471416+0000","last_change":"2023-09-13T06:11:17.470898+0000","last_active":"2023-09-13T06:11:17.471416+0000","last_peered":"2023-09-13T06:11:17.471416+0000","last_clean":"2023-09-13T06:11:17.471416+0000","last_became_active":"2023-09-13T06:11:17.470670+0000","last_became_peered":"2023-09-13T06:11:17.470670+0000","last_unstale":"2023-09-13T06:11:17.471416+0000","last_undegraded":"2023-09-13T06:11:17.471416+0000","last_fullsized":"2023-09-13T06:11:17.471416+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:20:32.182252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.470495+0000","last_change":"2023-09-13T06:11:17.470236+0000","last_active":"2023-09-13T06:11:17.470495+0000","last_peered":"2023-09-13T06:11:17.470495+0000","last_clean":"2023-09-13T06:11:17.470495+0000","last_became_active":"2023-09-13T06:11:17.469881+0000","last_became_peered":"2023-09-13T06:11:17.469881+0000","last_unstale":"2023-09-13T06:11:17.470495+0000","last_undegraded":"2023-09-13T06:11:17.470495+0000","last_fullsized":"2023-09-13T06:11:17.470495+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:12:37.141167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460519+0000","last_change":"2023-09-13T06:11:17.467328+0000","last_active":"2023-09-13T06:11:18.460519+0000","last_peered":"2023-09-13T06:11:18.460519+0000","last_clean":"2023-09-13T06:11:18.460519+0000","last_became_active":"2023-09-13T06:11:17.467104+0000","last_became_peered":"2023-09-13T06:11:17.467104+0000","last_unstale":"2023-09-13T06:11:18.460519+0000","last_undegraded":"2023-09-13T06:11:18.460519+0000","last_fullsized":"2023-09-13T06:11:18.460519+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:38.103358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.470430+0000","last_change":"2023-09-13T06:11:17.469205+0000","last_active":"2023-09-13T06:11:17.470430+0000","last_peered":"2023-09-13T06:11:17.470430+0000","last_clean":"2023-09-13T06:11:17.470430+0000","last_became_active":"2023-09-13T06:11:17.468949+0000","last_became_peered":"2023-09-13T06:11:17.468949+0000","last_unstale":"2023-09-13T06:11:17.470430+0000","last_undegraded":"2023-09-13T06:11:17.470430+0000","last_fullsized":"2023-09-13T06:11:17.470430+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:43:42.868812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.463678+0000","last_change":"2023-09-13T06:11:17.463609+0000","last_active":"2023-09-13T06:11:17.463678+0000","last_peered":"2023-09-13T06:11:17.463678+0000","last_clean":"2023-09-13T06:11:17.463678+0000","last_became_active":"2023-09-13T06:11:17.463387+0000","last_became_peered":"2023-09-13T06:11:17.463387+0000","last_unstale":"2023-09-13T06:11:17.463678+0000","last_undegraded":"2023-09-13T06:11:17.463678+0000","last_fullsized":"2023-09-13T06:11:17.463678+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:01:34.920445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464571+0000","last_change":"2023-09-13T06:11:17.467839+0000","last_active":"2023-09-13T06:11:18.464571+0000","last_peered":"2023-09-13T06:11:18.464571+0000","last_clean":"2023-09-13T06:11:18.464571+0000","last_became_active":"2023-09-13T06:11:17.467529+0000","last_became_peered":"2023-09-13T06:11:17.467529+0000","last_unstale":"2023-09-13T06:11:18.464571+0000","last_undegraded":"2023-09-13T06:11:18.464571+0000","last_fullsized":"2023-09-13T06:11:18.464571+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:21.796570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.469123+0000","last_change":"2023-09-13T06:11:17.469040+0000","last_active":"2023-09-13T06:11:17.469123+0000","last_peered":"2023-09-13T06:11:17.469123+0000","last_clean":"2023-09-13T06:11:17.469123+0000","last_became_active":"2023-09-13T06:11:17.468829+0000","last_became_peered":"2023-09-13T06:11:17.468829+0000","last_unstale":"2023-09-13T06:11:17.469123+0000","last_undegraded":"2023-09-13T06:11:17.469123+0000","last_fullsized":"2023-09-13T06:11:17.469123+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:51:17.620750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464407+0000","last_change":"2023-09-13T06:11:17.470507+0000","last_active":"2023-09-13T06:11:18.464407+0000","last_peered":"2023-09-13T06:11:18.464407+0000","last_clean":"2023-09-13T06:11:18.464407+0000","last_became_active":"2023-09-13T06:11:17.470256+0000","last_became_peered":"2023-09-13T06:11:17.470256+0000","last_unstale":"2023-09-13T06:11:18.464407+0000","last_undegraded":"2023-09-13T06:11:18.464407+0000","last_fullsized":"2023-09-13T06:11:18.464407+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:00.837172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.478353+0000","last_change":"2023-09-13T06:11:17.478271+0000","last_active":"2023-09-13T06:11:17.478353+0000","last_peered":"2023-09-13T06:11:17.478353+0000","last_clean":"2023-09-13T06:11:17.478353+0000","last_became_active":"2023-09-13T06:11:17.475943+0000","last_became_peered":"2023-09-13T06:11:17.475943+0000","last_unstale":"2023-09-13T06:11:17.478353+0000","last_undegraded":"2023-09-13T06:11:17.478353+0000","last_fullsized":"2023-09-13T06:11:17.478353+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:41:59.635792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.476212+0000","last_change":"2023-09-13T06:11:17.476033+0000","last_active":"2023-09-13T06:11:17.476212+0000","last_peered":"2023-09-13T06:11:17.476212+0000","last_clean":"2023-09-13T06:11:17.476212+0000","last_became_active":"2023-09-13T06:11:17.474266+0000","last_became_peered":"2023-09-13T06:11:17.474266+0000","last_unstale":"2023-09-13T06:11:17.476212+0000","last_undegraded":"2023-09-13T06:11:17.476212+0000","last_fullsized":"2023-09-13T06:11:17.476212+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:30:57.890905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464719+0000","last_change":"2023-09-13T06:11:17.476383+0000","last_active":"2023-09-13T06:11:18.464719+0000","last_peered":"2023-09-13T06:11:18.464719+0000","last_clean":"2023-09-13T06:11:18.464719+0000","last_became_active":"2023-09-13T06:11:17.475350+0000","last_became_peered":"2023-09-13T06:11:17.475350+0000","last_unstale":"2023-09-13T06:11:18.464719+0000","last_undegraded":"2023-09-13T06:11:18.464719+0000","last_fullsized":"2023-09-13T06:11:18.464719+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:38:36.017550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461319+0000","last_change":"2023-09-13T06:11:17.469926+0000","last_active":"2023-09-13T06:11:18.461319+0000","last_peered":"2023-09-13T06:11:18.461319+0000","last_clean":"2023-09-13T06:11:18.461319+0000","last_became_active":"2023-09-13T06:11:17.469624+0000","last_became_peered":"2023-09-13T06:11:17.469624+0000","last_unstale":"2023-09-13T06:11:18.461319+0000","last_undegraded":"2023-09-13T06:11:18.461319+0000","last_fullsized":"2023-09-13T06:11:18.461319+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:42.560492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464804+0000","last_change":"2023-09-13T06:11:17.465355+0000","last_active":"2023-09-13T06:11:18.464804+0000","last_peered":"2023-09-13T06:11:18.464804+0000","last_clean":"2023-09-13T06:11:18.464804+0000","last_became_active":"2023-09-13T06:11:17.465094+0000","last_became_peered":"2023-09-13T06:11:17.465094+0000","last_unstale":"2023-09-13T06:11:18.464804+0000","last_undegraded":"2023-09-13T06:11:18.464804+0000","last_fullsized":"2023-09-13T06:11:18.464804+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:53:39.948872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.473463+0000","last_change":"2023-09-13T06:11:17.472543+0000","last_active":"2023-09-13T06:11:17.473463+0000","last_peered":"2023-09-13T06:11:17.473463+0000","last_clean":"2023-09-13T06:11:17.473463+0000","last_became_active":"2023-09-13T06:11:17.471775+0000","last_became_peered":"2023-09-13T06:11:17.471775+0000","last_unstale":"2023-09-13T06:11:17.473463+0000","last_undegraded":"2023-09-13T06:11:17.473463+0000","last_fullsized":"2023-09-13T06:11:17.473463+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:30:59.989727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468266+0000","last_change":"2023-09-13T06:11:17.468152+0000","last_active":"2023-09-13T06:11:17.468266+0000","last_peered":"2023-09-13T06:11:17.468266+0000","last_clean":"2023-09-13T06:11:17.468266+0000","last_became_active":"2023-09-13T06:11:17.467934+0000","last_became_peered":"2023-09-13T06:11:17.467934+0000","last_unstale":"2023-09-13T06:11:17.468266+0000","last_undegraded":"2023-09-13T06:11:17.468266+0000","last_fullsized":"2023-09-13T06:11:17.468266+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:17:55.359613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461482+0000","last_change":"2023-09-13T06:11:17.467878+0000","last_active":"2023-09-13T06:11:18.461482+0000","last_peered":"2023-09-13T06:11:18.461482+0000","last_clean":"2023-09-13T06:11:18.461482+0000","last_became_active":"2023-09-13T06:11:17.467640+0000","last_became_peered":"2023-09-13T06:11:17.467640+0000","last_unstale":"2023-09-13T06:11:18.461482+0000","last_undegraded":"2023-09-13T06:11:18.461482+0000","last_fullsized":"2023-09-13T06:11:18.461482+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:29.403563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464593+0000","last_change":"2023-09-13T06:11:17.470500+0000","last_active":"2023-09-13T06:11:18.464593+0000","last_peered":"2023-09-13T06:11:18.464593+0000","last_clean":"2023-09-13T06:11:18.464593+0000","last_became_active":"2023-09-13T06:11:17.470237+0000","last_became_peered":"2023-09-13T06:11:17.470237+0000","last_unstale":"2023-09-13T06:11:18.464593+0000","last_undegraded":"2023-09-13T06:11:18.464593+0000","last_fullsized":"2023-09-13T06:11:18.464593+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:00:59.346150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.472499+0000","last_change":"2023-09-13T06:11:17.472429+0000","last_active":"2023-09-13T06:11:17.472499+0000","last_peered":"2023-09-13T06:11:17.472499+0000","last_clean":"2023-09-13T06:11:17.472499+0000","last_became_active":"2023-09-13T06:11:17.471110+0000","last_became_peered":"2023-09-13T06:11:17.471110+0000","last_unstale":"2023-09-13T06:11:17.472499+0000","last_undegraded":"2023-09-13T06:11:17.472499+0000","last_fullsized":"2023-09-13T06:11:17.472499+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:54:14.141705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.465844+0000","last_change":"2023-09-13T06:11:17.465580+0000","last_active":"2023-09-13T06:11:17.465844+0000","last_peered":"2023-09-13T06:11:17.465844+0000","last_clean":"2023-09-13T06:11:17.465844+0000","last_became_active":"2023-09-13T06:11:17.465352+0000","last_became_peered":"2023-09-13T06:11:17.465352+0000","last_unstale":"2023-09-13T06:11:17.465844+0000","last_undegraded":"2023-09-13T06:11:17.465844+0000","last_fullsized":"2023-09-13T06:11:17.465844+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:51.147378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464708+0000","last_change":"2023-09-13T06:11:17.467668+0000","last_active":"2023-09-13T06:11:18.464708+0000","last_peered":"2023-09-13T06:11:18.464708+0000","last_clean":"2023-09-13T06:11:18.464708+0000","last_became_active":"2023-09-13T06:11:17.467222+0000","last_became_peered":"2023-09-13T06:11:17.467222+0000","last_unstale":"2023-09-13T06:11:18.464708+0000","last_undegraded":"2023-09-13T06:11:18.464708+0000","last_fullsized":"2023-09-13T06:11:18.464708+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:58.738350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461597+0000","last_change":"2023-09-13T06:11:17.469875+0000","last_active":"2023-09-13T06:11:18.461597+0000","last_peered":"2023-09-13T06:11:18.461597+0000","last_clean":"2023-09-13T06:11:18.461597+0000","last_became_active":"2023-09-13T06:11:17.469641+0000","last_became_peered":"2023-09-13T06:11:17.469641+0000","last_unstale":"2023-09-13T06:11:18.461597+0000","last_undegraded":"2023-09-13T06:11:18.461597+0000","last_fullsized":"2023-09-13T06:11:18.461597+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:13.905663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468672+0000","last_change":"2023-09-13T06:11:17.468603+0000","last_active":"2023-09-13T06:11:17.468672+0000","last_peered":"2023-09-13T06:11:17.468672+0000","last_clean":"2023-09-13T06:11:17.468672+0000","last_became_active":"2023-09-13T06:11:17.468303+0000","last_became_peered":"2023-09-13T06:11:17.468303+0000","last_unstale":"2023-09-13T06:11:17.468672+0000","last_undegraded":"2023-09-13T06:11:17.468672+0000","last_fullsized":"2023-09-13T06:11:17.468672+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:03:24.643430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461514+0000","last_change":"2023-09-13T06:11:17.471963+0000","last_active":"2023-09-13T06:11:18.461514+0000","last_peered":"2023-09-13T06:11:18.461514+0000","last_clean":"2023-09-13T06:11:18.461514+0000","last_became_active":"2023-09-13T06:11:17.471744+0000","last_became_peered":"2023-09-13T06:11:17.471744+0000","last_unstale":"2023-09-13T06:11:18.461514+0000","last_undegraded":"2023-09-13T06:11:18.461514+0000","last_fullsized":"2023-09-13T06:11:18.461514+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:10:45.858570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460474+0000","last_change":"2023-09-13T06:11:17.473702+0000","last_active":"2023-09-13T06:11:18.460474+0000","last_peered":"2023-09-13T06:11:18.460474+0000","last_clean":"2023-09-13T06:11:18.460474+0000","last_became_active":"2023-09-13T06:11:17.473563+0000","last_became_peered":"2023-09-13T06:11:17.473563+0000","last_unstale":"2023-09-13T06:11:18.460474+0000","last_undegraded":"2023-09-13T06:11:18.460474+0000","last_fullsized":"2023-09-13T06:11:18.460474+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:05.068765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.470464+0000","last_change":"2023-09-13T06:11:17.469848+0000","last_active":"2023-09-13T06:11:17.470464+0000","last_peered":"2023-09-13T06:11:17.470464+0000","last_clean":"2023-09-13T06:11:17.470464+0000","last_became_active":"2023-09-13T06:11:17.469168+0000","last_became_peered":"2023-09-13T06:11:17.469168+0000","last_unstale":"2023-09-13T06:11:17.470464+0000","last_undegraded":"2023-09-13T06:11:17.470464+0000","last_fullsized":"2023-09-13T06:11:17.470464+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:43:04.535855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.472117+0000","last_change":"2023-09-13T06:11:17.471817+0000","last_active":"2023-09-13T06:11:17.472117+0000","last_peered":"2023-09-13T06:11:17.472117+0000","last_clean":"2023-09-13T06:11:17.472117+0000","last_became_active":"2023-09-13T06:11:17.471264+0000","last_became_peered":"2023-09-13T06:11:17.471264+0000","last_unstale":"2023-09-13T06:11:17.472117+0000","last_undegraded":"2023-09-13T06:11:17.472117+0000","last_fullsized":"2023-09-13T06:11:17.472117+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:10:04.578086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.470210+0000","last_change":"2023-09-13T06:11:17.470118+0000","last_active":"2023-09-13T06:11:17.470210+0000","last_peered":"2023-09-13T06:11:17.470210+0000","last_clean":"2023-09-13T06:11:17.470210+0000","last_became_active":"2023-09-13T06:11:17.469821+0000","last_became_peered":"2023-09-13T06:11:17.469821+0000","last_unstale":"2023-09-13T06:11:17.470210+0000","last_undegraded":"2023-09-13T06:11:17.470210+0000","last_fullsized":"2023-09-13T06:11:17.470210+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:19:03.860435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461600+0000","last_change":"2023-09-13T06:11:17.471024+0000","last_active":"2023-09-13T06:11:18.461600+0000","last_peered":"2023-09-13T06:11:18.461600+0000","last_clean":"2023-09-13T06:11:18.461600+0000","last_became_active":"2023-09-13T06:11:17.470363+0000","last_became_peered":"2023-09-13T06:11:17.470363+0000","last_unstale":"2023-09-13T06:11:18.461600+0000","last_undegraded":"2023-09-13T06:11:18.461600+0000","last_fullsized":"2023-09-13T06:11:18.461600+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:12:26.272273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464876+0000","last_change":"2023-09-13T06:11:17.473360+0000","last_active":"2023-09-13T06:11:18.464876+0000","last_peered":"2023-09-13T06:11:18.464876+0000","last_clean":"2023-09-13T06:11:18.464876+0000","last_became_active":"2023-09-13T06:11:17.472758+0000","last_became_peered":"2023-09-13T06:11:17.472758+0000","last_unstale":"2023-09-13T06:11:18.464876+0000","last_undegraded":"2023-09-13T06:11:18.464876+0000","last_fullsized":"2023-09-13T06:11:18.464876+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:03:05.068765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"170'4","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464736+0000","last_change":"2023-09-13T06:11:16.692303+0000","last_active":"2023-09-13T06:11:18.464736+0000","last_peered":"2023-09-13T06:11:18.464736+0000","last_clean":"2023-09-13T06:11:18.464736+0000","last_became_active":"2023-09-13T06:11:16.691582+0000","last_became_peered":"2023-09-13T06:11:16.691582+0000","last_unstale":"2023-09-13T06:11:18.464736+0000","last_undegraded":"2023-09-13T06:11:18.464736+0000","last_fullsized":"2023-09-13T06:11:18.464736+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:50:45.571459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468263+0000","last_change":"2023-09-13T06:11:17.467702+0000","last_active":"2023-09-13T06:11:17.468263+0000","last_peered":"2023-09-13T06:11:17.468263+0000","last_clean":"2023-09-13T06:11:17.468263+0000","last_became_active":"2023-09-13T06:11:17.467057+0000","last_became_peered":"2023-09-13T06:11:17.467057+0000","last_unstale":"2023-09-13T06:11:17.468263+0000","last_undegraded":"2023-09-13T06:11:17.468263+0000","last_fullsized":"2023-09-13T06:11:17.468263+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:29:15.008387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"170'1","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.729499+0000","last_change":"2023-09-13T06:11:16.701770+0000","last_active":"2023-09-13T06:11:17.729499+0000","last_peered":"2023-09-13T06:11:17.729499+0000","last_clean":"2023-09-13T06:11:17.729499+0000","last_became_active":"2023-09-13T06:11:16.701095+0000","last_became_peered":"2023-09-13T06:11:16.701095+0000","last_unstale":"2023-09-13T06:11:17.729499+0000","last_undegraded":"2023-09-13T06:11:17.729499+0000","last_fullsized":"2023-09-13T06:11:17.729499+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:29:31.859999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468214+0000","last_change":"2023-09-13T06:11:17.466906+0000","last_active":"2023-09-13T06:11:17.468214+0000","last_peered":"2023-09-13T06:11:17.468214+0000","last_clean":"2023-09-13T06:11:17.468214+0000","last_became_active":"2023-09-13T06:11:17.466643+0000","last_became_peered":"2023-09-13T06:11:17.466643+0000","last_unstale":"2023-09-13T06:11:17.468214+0000","last_undegraded":"2023-09-13T06:11:17.468214+0000","last_fullsized":"2023-09-13T06:11:17.468214+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:11:39.976884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"170'2","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.730982+0000","last_change":"2023-09-13T06:11:16.701115+0000","last_active":"2023-09-13T06:11:17.730982+0000","last_peered":"2023-09-13T06:11:17.730982+0000","last_clean":"2023-09-13T06:11:17.730982+0000","last_became_active":"2023-09-13T06:11:16.700651+0000","last_became_peered":"2023-09-13T06:11:16.700651+0000","last_unstale":"2023-09-13T06:11:17.730982+0000","last_undegraded":"2023-09-13T06:11:17.730982+0000","last_fullsized":"2023-09-13T06:11:17.730982+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:11:13.578713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464830+0000","last_change":"2023-09-13T06:11:17.476701+0000","last_active":"2023-09-13T06:11:18.464830+0000","last_peered":"2023-09-13T06:11:18.464830+0000","last_clean":"2023-09-13T06:11:18.464830+0000","last_became_active":"2023-09-13T06:11:17.475977+0000","last_became_peered":"2023-09-13T06:11:17.475977+0000","last_unstale":"2023-09-13T06:11:18.464830+0000","last_undegraded":"2023-09-13T06:11:18.464830+0000","last_fullsized":"2023-09-13T06:11:18.464830+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:48:54.767374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"170'2","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.729686+0000","last_change":"2023-09-13T06:11:16.700426+0000","last_active":"2023-09-13T06:11:17.729686+0000","last_peered":"2023-09-13T06:11:17.729686+0000","last_clean":"2023-09-13T06:11:17.729686+0000","last_became_active":"2023-09-13T06:11:16.699893+0000","last_became_peered":"2023-09-13T06:11:16.699893+0000","last_unstale":"2023-09-13T06:11:17.729686+0000","last_undegraded":"2023-09-13T06:11:17.729686+0000","last_fullsized":"2023-09-13T06:11:17.729686+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:19:46.418534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.472612+0000","last_change":"2023-09-13T06:11:17.472540+0000","last_active":"2023-09-13T06:11:17.472612+0000","last_peered":"2023-09-13T06:11:17.472612+0000","last_clean":"2023-09-13T06:11:17.472612+0000","last_became_active":"2023-09-13T06:11:17.472149+0000","last_became_peered":"2023-09-13T06:11:17.472149+0000","last_unstale":"2023-09-13T06:11:17.472612+0000","last_undegraded":"2023-09-13T06:11:17.472612+0000","last_fullsized":"2023-09-13T06:11:17.472612+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:11:14.581562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"170'1","reported_seq":13,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461713+0000","last_change":"2023-09-13T06:11:16.695914+0000","last_active":"2023-09-13T06:11:18.461713+0000","last_peered":"2023-09-13T06:11:18.461713+0000","last_clean":"2023-09-13T06:11:18.461713+0000","last_became_active":"2023-09-13T06:11:16.695692+0000","last_became_peered":"2023-09-13T06:11:16.695692+0000","last_unstale":"2023-09-13T06:11:18.461713+0000","last_undegraded":"2023-09-13T06:11:18.461713+0000","last_fullsized":"2023-09-13T06:11:18.461713+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:21:14.360967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.473238+0000","last_change":"2023-09-13T06:11:17.473135+0000","last_active":"2023-09-13T06:11:17.473238+0000","last_peered":"2023-09-13T06:11:17.473238+0000","last_clean":"2023-09-13T06:11:17.473238+0000","last_became_active":"2023-09-13T06:11:17.472721+0000","last_became_peered":"2023-09-13T06:11:17.472721+0000","last_unstale":"2023-09-13T06:11:17.473238+0000","last_undegraded":"2023-09-13T06:11:17.473238+0000","last_fullsized":"2023-09-13T06:11:17.473238+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:45:56.154910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"170'1","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.729091+0000","last_change":"2023-09-13T06:11:16.693471+0000","last_active":"2023-09-13T06:11:17.729091+0000","last_peered":"2023-09-13T06:11:17.729091+0000","last_clean":"2023-09-13T06:11:17.729091+0000","last_became_active":"2023-09-13T06:11:16.693035+0000","last_became_peered":"2023-09-13T06:11:16.693035+0000","last_unstale":"2023-09-13T06:11:17.729091+0000","last_undegraded":"2023-09-13T06:11:17.729091+0000","last_fullsized":"2023-09-13T06:11:17.729091+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:36:50.999384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.464706+0000","last_change":"2023-09-13T06:11:17.464637+0000","last_active":"2023-09-13T06:11:17.464706+0000","last_peered":"2023-09-13T06:11:17.464706+0000","last_clean":"2023-09-13T06:11:17.464706+0000","last_became_active":"2023-09-13T06:11:17.464267+0000","last_became_peered":"2023-09-13T06:11:17.464267+0000","last_unstale":"2023-09-13T06:11:17.464706+0000","last_undegraded":"2023-09-13T06:11:17.464706+0000","last_fullsized":"2023-09-13T06:11:17.464706+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:45:56.154910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461592+0000","last_change":"2023-09-13T06:11:16.694260+0000","last_active":"2023-09-13T06:11:18.461592+0000","last_peered":"2023-09-13T06:11:18.461592+0000","last_clean":"2023-09-13T06:11:18.461592+0000","last_became_active":"2023-09-13T06:11:16.693934+0000","last_became_peered":"2023-09-13T06:11:16.693934+0000","last_unstale":"2023-09-13T06:11:18.461592+0000","last_undegraded":"2023-09-13T06:11:18.461592+0000","last_fullsized":"2023-09-13T06:11:18.461592+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:39:38.036390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.473958+0000","last_change":"2023-09-13T06:11:17.473887+0000","last_active":"2023-09-13T06:11:17.473958+0000","last_peered":"2023-09-13T06:11:17.473958+0000","last_clean":"2023-09-13T06:11:17.473958+0000","last_became_active":"2023-09-13T06:11:17.473516+0000","last_became_peered":"2023-09-13T06:11:17.473516+0000","last_unstale":"2023-09-13T06:11:17.473958+0000","last_undegraded":"2023-09-13T06:11:17.473958+0000","last_fullsized":"2023-09-13T06:11:17.473958+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:23:23.703023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.463726+0000","last_change":"2023-09-13T06:11:16.700954+0000","last_active":"2023-09-13T06:11:17.463726+0000","last_peered":"2023-09-13T06:11:17.463726+0000","last_clean":"2023-09-13T06:11:17.463726+0000","last_became_active":"2023-09-13T06:11:16.699638+0000","last_became_peered":"2023-09-13T06:11:16.699638+0000","last_unstale":"2023-09-13T06:11:17.463726+0000","last_undegraded":"2023-09-13T06:11:17.463726+0000","last_fullsized":"2023-09-13T06:11:17.463726+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:04:50.659111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.473163+0000","last_change":"2023-09-13T06:11:17.473091+0000","last_active":"2023-09-13T06:11:17.473163+0000","last_peered":"2023-09-13T06:11:17.473163+0000","last_clean":"2023-09-13T06:11:17.473163+0000","last_became_active":"2023-09-13T06:11:17.472811+0000","last_became_peered":"2023-09-13T06:11:17.472811+0000","last_unstale":"2023-09-13T06:11:17.473163+0000","last_undegraded":"2023-09-13T06:11:17.473163+0000","last_fullsized":"2023-09-13T06:11:17.473163+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:19:33.850602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.461856+0000","last_change":"2023-09-13T06:11:16.695507+0000","last_active":"2023-09-13T06:11:17.461856+0000","last_peered":"2023-09-13T06:11:17.461856+0000","last_clean":"2023-09-13T06:11:17.461856+0000","last_became_active":"2023-09-13T06:11:16.695234+0000","last_became_peered":"2023-09-13T06:11:16.695234+0000","last_unstale":"2023-09-13T06:11:17.461856+0000","last_undegraded":"2023-09-13T06:11:17.461856+0000","last_fullsized":"2023-09-13T06:11:17.461856+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:54:13.138856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464782+0000","last_change":"2023-09-13T06:11:17.467339+0000","last_active":"2023-09-13T06:11:18.464782+0000","last_peered":"2023-09-13T06:11:18.464782+0000","last_clean":"2023-09-13T06:11:18.464782+0000","last_became_active":"2023-09-13T06:11:17.467047+0000","last_became_peered":"2023-09-13T06:11:17.467047+0000","last_unstale":"2023-09-13T06:11:18.464782+0000","last_undegraded":"2023-09-13T06:11:18.464782+0000","last_fullsized":"2023-09-13T06:11:18.464782+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:54:34.327746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464620+0000","last_change":"2023-09-13T06:11:16.692915+0000","last_active":"2023-09-13T06:11:18.464620+0000","last_peered":"2023-09-13T06:11:18.464620+0000","last_clean":"2023-09-13T06:11:18.464620+0000","last_became_active":"2023-09-13T06:11:16.692159+0000","last_became_peered":"2023-09-13T06:11:16.692159+0000","last_unstale":"2023-09-13T06:11:18.464620+0000","last_undegraded":"2023-09-13T06:11:18.464620+0000","last_fullsized":"2023-09-13T06:11:18.464620+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:57:48.442005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461340+0000","last_change":"2023-09-13T06:11:17.467157+0000","last_active":"2023-09-13T06:11:18.461340+0000","last_peered":"2023-09-13T06:11:18.461340+0000","last_clean":"2023-09-13T06:11:18.461340+0000","last_became_active":"2023-09-13T06:11:17.466914+0000","last_became_peered":"2023-09-13T06:11:17.466914+0000","last_unstale":"2023-09-13T06:11:18.461340+0000","last_undegraded":"2023-09-13T06:11:18.461340+0000","last_fullsized":"2023-09-13T06:11:18.461340+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:26:26.796474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"170'6","reported_seq":18,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460209+0000","last_change":"2023-09-13T06:11:16.696213+0000","last_active":"2023-09-13T06:11:18.460209+0000","last_peered":"2023-09-13T06:11:18.460209+0000","last_clean":"2023-09-13T06:11:18.460209+0000","last_became_active":"2023-09-13T06:11:16.695971+0000","last_became_peered":"2023-09-13T06:11:16.695971+0000","last_unstale":"2023-09-13T06:11:18.460209+0000","last_undegraded":"2023-09-13T06:11:18.460209+0000","last_fullsized":"2023-09-13T06:11:18.460209+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:37:41.319154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.477898+0000","last_change":"2023-09-13T06:11:17.477723+0000","last_active":"2023-09-13T06:11:17.477898+0000","last_peered":"2023-09-13T06:11:17.477898+0000","last_clean":"2023-09-13T06:11:17.477898+0000","last_became_active":"2023-09-13T06:11:17.477485+0000","last_became_peered":"2023-09-13T06:11:17.477485+0000","last_unstale":"2023-09-13T06:11:17.477898+0000","last_undegraded":"2023-09-13T06:11:17.477898+0000","last_fullsized":"2023-09-13T06:11:17.477898+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:16:53.929376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"170'2","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.730121+0000","last_change":"2023-09-13T06:11:16.700768+0000","last_active":"2023-09-13T06:11:17.730121+0000","last_peered":"2023-09-13T06:11:17.730121+0000","last_clean":"2023-09-13T06:11:17.730121+0000","last_became_active":"2023-09-13T06:11:16.700503+0000","last_became_peered":"2023-09-13T06:11:16.700503+0000","last_unstale":"2023-09-13T06:11:17.730121+0000","last_undegraded":"2023-09-13T06:11:17.730121+0000","last_fullsized":"2023-09-13T06:11:17.730121+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:53:44.448153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.464646+0000","last_change":"2023-09-13T06:11:17.464488+0000","last_active":"2023-09-13T06:11:17.464646+0000","last_peered":"2023-09-13T06:11:17.464646+0000","last_clean":"2023-09-13T06:11:17.464646+0000","last_became_active":"2023-09-13T06:11:17.463938+0000","last_became_peered":"2023-09-13T06:11:17.463938+0000","last_unstale":"2023-09-13T06:11:17.464646+0000","last_undegraded":"2023-09-13T06:11:17.464646+0000","last_fullsized":"2023-09-13T06:11:17.464646+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:38:27.698383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.469067+0000","last_change":"2023-09-13T06:11:16.699068+0000","last_active":"2023-09-13T06:11:17.469067+0000","last_peered":"2023-09-13T06:11:17.469067+0000","last_clean":"2023-09-13T06:11:17.469067+0000","last_became_active":"2023-09-13T06:11:16.698835+0000","last_became_peered":"2023-09-13T06:11:16.698835+0000","last_unstale":"2023-09-13T06:11:17.469067+0000","last_undegraded":"2023-09-13T06:11:17.469067+0000","last_fullsized":"2023-09-13T06:11:17.469067+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:34:49.572622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.477980+0000","last_change":"2023-09-13T06:11:17.477822+0000","last_active":"2023-09-13T06:11:17.477980+0000","last_peered":"2023-09-13T06:11:17.477980+0000","last_clean":"2023-09-13T06:11:17.477980+0000","last_became_active":"2023-09-13T06:11:17.475161+0000","last_became_peered":"2023-09-13T06:11:17.475161+0000","last_unstale":"2023-09-13T06:11:17.477980+0000","last_undegraded":"2023-09-13T06:11:17.477980+0000","last_fullsized":"2023-09-13T06:11:17.477980+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:12:26.272273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.458183+0000","last_change":"2023-09-13T06:11:16.691607+0000","last_active":"2023-09-13T06:11:17.458183+0000","last_peered":"2023-09-13T06:11:17.458183+0000","last_clean":"2023-09-13T06:11:17.458183+0000","last_became_active":"2023-09-13T06:11:16.691362+0000","last_became_peered":"2023-09-13T06:11:16.691362+0000","last_unstale":"2023-09-13T06:11:17.458183+0000","last_undegraded":"2023-09-13T06:11:17.458183+0000","last_fullsized":"2023-09-13T06:11:17.458183+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:21:44.640685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.476787+0000","last_change":"2023-09-13T06:11:17.475619+0000","last_active":"2023-09-13T06:11:17.476787+0000","last_peered":"2023-09-13T06:11:17.476787+0000","last_clean":"2023-09-13T06:11:17.476787+0000","last_became_active":"2023-09-13T06:11:17.474041+0000","last_became_peered":"2023-09-13T06:11:17.474041+0000","last_unstale":"2023-09-13T06:11:17.476787+0000","last_undegraded":"2023-09-13T06:11:17.476787+0000","last_fullsized":"2023-09-13T06:11:17.476787+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:09:33.624307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"170'8","reported_seq":20,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461431+0000","last_change":"2023-09-13T06:11:16.699176+0000","last_active":"2023-09-13T06:11:18.461431+0000","last_peered":"2023-09-13T06:11:18.461431+0000","last_clean":"2023-09-13T06:11:18.461431+0000","last_became_active":"2023-09-13T06:11:16.698919+0000","last_became_peered":"2023-09-13T06:11:16.698919+0000","last_unstale":"2023-09-13T06:11:18.461431+0000","last_undegraded":"2023-09-13T06:11:18.461431+0000","last_fullsized":"2023-09-13T06:11:18.461431+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:12:31.284861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464920+0000","last_change":"2023-09-13T06:11:17.476538+0000","last_active":"2023-09-13T06:11:18.464920+0000","last_peered":"2023-09-13T06:11:18.464920+0000","last_clean":"2023-09-13T06:11:18.464920+0000","last_became_active":"2023-09-13T06:11:17.475674+0000","last_became_peered":"2023-09-13T06:11:17.475674+0000","last_unstale":"2023-09-13T06:11:18.464920+0000","last_undegraded":"2023-09-13T06:11:18.464920+0000","last_fullsized":"2023-09-13T06:11:18.464920+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:38.103358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"170'1","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.728297+0000","last_change":"2023-09-13T06:11:16.698283+0000","last_active":"2023-09-13T06:11:17.728297+0000","last_peered":"2023-09-13T06:11:17.728297+0000","last_clean":"2023-09-13T06:11:17.728297+0000","last_became_active":"2023-09-13T06:11:16.698061+0000","last_became_peered":"2023-09-13T06:11:16.698061+0000","last_unstale":"2023-09-13T06:11:17.728297+0000","last_undegraded":"2023-09-13T06:11:17.728297+0000","last_fullsized":"2023-09-13T06:11:17.728297+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:08:29.830158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461512+0000","last_change":"2023-09-13T06:11:17.470933+0000","last_active":"2023-09-13T06:11:18.461512+0000","last_peered":"2023-09-13T06:11:18.461512+0000","last_clean":"2023-09-13T06:11:18.461512+0000","last_became_active":"2023-09-13T06:11:17.470578+0000","last_became_peered":"2023-09-13T06:11:17.470578+0000","last_unstale":"2023-09-13T06:11:18.461512+0000","last_undegraded":"2023-09-13T06:11:18.461512+0000","last_fullsized":"2023-09-13T06:11:18.461512+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:19:33.850602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"170'2","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.730286+0000","last_change":"2023-09-13T06:11:16.696247+0000","last_active":"2023-09-13T06:11:17.730286+0000","last_peered":"2023-09-13T06:11:17.730286+0000","last_clean":"2023-09-13T06:11:17.730286+0000","last_became_active":"2023-09-13T06:11:16.696032+0000","last_became_peered":"2023-09-13T06:11:16.696032+0000","last_unstale":"2023-09-13T06:11:17.730286+0000","last_undegraded":"2023-09-13T06:11:17.730286+0000","last_fullsized":"2023-09-13T06:11:17.730286+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:10:03.575237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.476822+0000","last_change":"2023-09-13T06:11:17.476106+0000","last_active":"2023-09-13T06:11:17.476822+0000","last_peered":"2023-09-13T06:11:17.476822+0000","last_clean":"2023-09-13T06:11:17.476822+0000","last_became_active":"2023-09-13T06:11:17.475302+0000","last_became_peered":"2023-09-13T06:11:17.475302+0000","last_unstale":"2023-09-13T06:11:17.476822+0000","last_undegraded":"2023-09-13T06:11:17.476822+0000","last_fullsized":"2023-09-13T06:11:17.476822+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:55:21.209208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"170'1","reported_seq":13,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461528+0000","last_change":"2023-09-13T06:11:16.693013+0000","last_active":"2023-09-13T06:11:18.461528+0000","last_peered":"2023-09-13T06:11:18.461528+0000","last_clean":"2023-09-13T06:11:18.461528+0000","last_became_active":"2023-09-13T06:11:16.692766+0000","last_became_peered":"2023-09-13T06:11:16.692766+0000","last_unstale":"2023-09-13T06:11:18.461528+0000","last_undegraded":"2023-09-13T06:11:18.461528+0000","last_fullsized":"2023-09-13T06:11:18.461528+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:27.820815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.470480+0000","last_change":"2023-09-13T06:11:17.470097+0000","last_active":"2023-09-13T06:11:17.470480+0000","last_peered":"2023-09-13T06:11:17.470480+0000","last_clean":"2023-09-13T06:11:17.470480+0000","last_became_active":"2023-09-13T06:11:17.469569+0000","last_became_peered":"2023-09-13T06:11:17.469569+0000","last_unstale":"2023-09-13T06:11:17.470480+0000","last_undegraded":"2023-09-13T06:11:17.470480+0000","last_fullsized":"2023-09-13T06:11:17.470480+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:34:50.333509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.461369+0000","last_change":"2023-09-13T06:11:16.702490+0000","last_active":"2023-09-13T06:11:17.461369+0000","last_peered":"2023-09-13T06:11:17.461369+0000","last_clean":"2023-09-13T06:11:17.461369+0000","last_became_active":"2023-09-13T06:11:16.702277+0000","last_became_peered":"2023-09-13T06:11:16.702277+0000","last_unstale":"2023-09-13T06:11:17.461369+0000","last_undegraded":"2023-09-13T06:11:17.461369+0000","last_fullsized":"2023-09-13T06:11:17.461369+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:52:33.859613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.475302+0000","last_change":"2023-09-13T06:11:17.474561+0000","last_active":"2023-09-13T06:11:17.475302+0000","last_peered":"2023-09-13T06:11:17.475302+0000","last_clean":"2023-09-13T06:11:17.475302+0000","last_became_active":"2023-09-13T06:11:17.472951+0000","last_became_peered":"2023-09-13T06:11:17.472951+0000","last_unstale":"2023-09-13T06:11:17.475302+0000","last_undegraded":"2023-09-13T06:11:17.475302+0000","last_fullsized":"2023-09-13T06:11:17.475302+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:29:14.834849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"170'2","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460833+0000","last_change":"2023-09-13T06:11:16.699672+0000","last_active":"2023-09-13T06:11:18.460833+0000","last_peered":"2023-09-13T06:11:18.460833+0000","last_clean":"2023-09-13T06:11:18.460833+0000","last_became_active":"2023-09-13T06:11:16.699282+0000","last_became_peered":"2023-09-13T06:11:16.699282+0000","last_unstale":"2023-09-13T06:11:18.460833+0000","last_undegraded":"2023-09-13T06:11:18.460833+0000","last_fullsized":"2023-09-13T06:11:18.460833+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:54:33.324898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460615+0000","last_change":"2023-09-13T06:11:17.471538+0000","last_active":"2023-09-13T06:11:18.460615+0000","last_peered":"2023-09-13T06:11:18.460615+0000","last_clean":"2023-09-13T06:11:18.460615+0000","last_became_active":"2023-09-13T06:11:17.471310+0000","last_became_peered":"2023-09-13T06:11:17.471310+0000","last_unstale":"2023-09-13T06:11:18.460615+0000","last_undegraded":"2023-09-13T06:11:18.460615+0000","last_fullsized":"2023-09-13T06:11:18.460615+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:57:10.900543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.465087+0000","last_change":"2023-09-13T06:11:16.691792+0000","last_active":"2023-09-13T06:11:18.465087+0000","last_peered":"2023-09-13T06:11:18.465087+0000","last_clean":"2023-09-13T06:11:18.465087+0000","last_became_active":"2023-09-13T06:11:16.691542+0000","last_became_peered":"2023-09-13T06:11:16.691542+0000","last_unstale":"2023-09-13T06:11:18.465087+0000","last_undegraded":"2023-09-13T06:11:18.465087+0000","last_fullsized":"2023-09-13T06:11:18.465087+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:30:37.628981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.467139+0000","last_change":"2023-09-13T06:11:17.466680+0000","last_active":"2023-09-13T06:11:17.467139+0000","last_peered":"2023-09-13T06:11:17.467139+0000","last_clean":"2023-09-13T06:11:17.467139+0000","last_became_active":"2023-09-13T06:11:17.466356+0000","last_became_peered":"2023-09-13T06:11:17.466356+0000","last_unstale":"2023-09-13T06:11:17.467139+0000","last_undegraded":"2023-09-13T06:11:17.467139+0000","last_fullsized":"2023-09-13T06:11:17.467139+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:21:35.430208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464973+0000","last_change":"2023-09-13T06:11:16.696393+0000","last_active":"2023-09-13T06:11:18.464973+0000","last_peered":"2023-09-13T06:11:18.464973+0000","last_clean":"2023-09-13T06:11:18.464973+0000","last_became_active":"2023-09-13T06:11:16.696154+0000","last_became_peered":"2023-09-13T06:11:16.696154+0000","last_unstale":"2023-09-13T06:11:18.464973+0000","last_undegraded":"2023-09-13T06:11:18.464973+0000","last_fullsized":"2023-09-13T06:11:18.464973+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:51:02.373002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460588+0000","last_change":"2023-09-13T06:11:17.471571+0000","last_active":"2023-09-13T06:11:18.460588+0000","last_peered":"2023-09-13T06:11:18.460588+0000","last_clean":"2023-09-13T06:11:18.460588+0000","last_became_active":"2023-09-13T06:11:17.471331+0000","last_became_peered":"2023-09-13T06:11:17.471331+0000","last_unstale":"2023-09-13T06:11:18.460588+0000","last_undegraded":"2023-09-13T06:11:18.460588+0000","last_fullsized":"2023-09-13T06:11:18.460588+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:50.766190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.469204+0000","last_change":"2023-09-13T06:11:16.696827+0000","last_active":"2023-09-13T06:11:17.469204+0000","last_peered":"2023-09-13T06:11:17.469204+0000","last_clean":"2023-09-13T06:11:17.469204+0000","last_became_active":"2023-09-13T06:11:16.696568+0000","last_became_peered":"2023-09-13T06:11:16.696568+0000","last_unstale":"2023-09-13T06:11:17.469204+0000","last_undegraded":"2023-09-13T06:11:17.469204+0000","last_fullsized":"2023-09-13T06:11:17.469204+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:22:47.174908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.477719+0000","last_change":"2023-09-13T06:11:17.477636+0000","last_active":"2023-09-13T06:11:17.477719+0000","last_peered":"2023-09-13T06:11:17.477719+0000","last_clean":"2023-09-13T06:11:17.477719+0000","last_became_active":"2023-09-13T06:11:17.474561+0000","last_became_peered":"2023-09-13T06:11:17.474561+0000","last_unstale":"2023-09-13T06:11:17.477719+0000","last_undegraded":"2023-09-13T06:11:17.477719+0000","last_fullsized":"2023-09-13T06:11:17.477719+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:10:45.858570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"170'2","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464904+0000","last_change":"2023-09-13T06:11:16.698568+0000","last_active":"2023-09-13T06:11:18.464904+0000","last_peered":"2023-09-13T06:11:18.464904+0000","last_clean":"2023-09-13T06:11:18.464904+0000","last_became_active":"2023-09-13T06:11:16.698180+0000","last_became_peered":"2023-09-13T06:11:16.698180+0000","last_unstale":"2023-09-13T06:11:18.464904+0000","last_undegraded":"2023-09-13T06:11:18.464904+0000","last_fullsized":"2023-09-13T06:11:18.464904+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:48:35.956984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.476805+0000","last_change":"2023-09-13T06:11:17.475916+0000","last_active":"2023-09-13T06:11:17.476805+0000","last_peered":"2023-09-13T06:11:17.476805+0000","last_clean":"2023-09-13T06:11:17.476805+0000","last_became_active":"2023-09-13T06:11:17.474939+0000","last_became_peered":"2023-09-13T06:11:17.474939+0000","last_unstale":"2023-09-13T06:11:17.476805+0000","last_undegraded":"2023-09-13T06:11:17.476805+0000","last_fullsized":"2023-09-13T06:11:17.476805+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:06:03.764257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.458571+0000","last_change":"2023-09-13T06:11:16.692198+0000","last_active":"2023-09-13T06:11:17.458571+0000","last_peered":"2023-09-13T06:11:17.458571+0000","last_clean":"2023-09-13T06:11:17.458571+0000","last_became_active":"2023-09-13T06:11:16.691867+0000","last_became_peered":"2023-09-13T06:11:16.691867+0000","last_unstale":"2023-09-13T06:11:17.458571+0000","last_undegraded":"2023-09-13T06:11:17.458571+0000","last_fullsized":"2023-09-13T06:11:17.458571+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:24.821413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468287+0000","last_change":"2023-09-13T06:11:17.467705+0000","last_active":"2023-09-13T06:11:17.468287+0000","last_peered":"2023-09-13T06:11:17.468287+0000","last_clean":"2023-09-13T06:11:17.468287+0000","last_became_active":"2023-09-13T06:11:17.467485+0000","last_became_peered":"2023-09-13T06:11:17.467485+0000","last_unstale":"2023-09-13T06:11:17.468287+0000","last_undegraded":"2023-09-13T06:11:17.468287+0000","last_fullsized":"2023-09-13T06:11:17.468287+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:51.147378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.459035+0000","last_change":"2023-09-13T06:11:16.694731+0000","last_active":"2023-09-13T06:11:17.459035+0000","last_peered":"2023-09-13T06:11:17.459035+0000","last_clean":"2023-09-13T06:11:17.459035+0000","last_became_active":"2023-09-13T06:11:16.694514+0000","last_became_peered":"2023-09-13T06:11:16.694514+0000","last_unstale":"2023-09-13T06:11:17.459035+0000","last_undegraded":"2023-09-13T06:11:17.459035+0000","last_fullsized":"2023-09-13T06:11:17.459035+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:42:05.659248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468244+0000","last_change":"2023-09-13T06:11:17.467679+0000","last_active":"2023-09-13T06:11:17.468244+0000","last_peered":"2023-09-13T06:11:17.468244+0000","last_clean":"2023-09-13T06:11:17.468244+0000","last_became_active":"2023-09-13T06:11:17.467465+0000","last_became_peered":"2023-09-13T06:11:17.467465+0000","last_unstale":"2023-09-13T06:11:17.468244+0000","last_undegraded":"2023-09-13T06:11:17.468244+0000","last_fullsized":"2023-09-13T06:11:17.468244+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:52:20.037764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.458220+0000","last_change":"2023-09-13T06:11:16.693074+0000","last_active":"2023-09-13T06:11:17.458220+0000","last_peered":"2023-09-13T06:11:17.458220+0000","last_clean":"2023-09-13T06:11:17.458220+0000","last_became_active":"2023-09-13T06:11:16.692833+0000","last_became_peered":"2023-09-13T06:11:16.692833+0000","last_unstale":"2023-09-13T06:11:17.458220+0000","last_undegraded":"2023-09-13T06:11:17.458220+0000","last_fullsized":"2023-09-13T06:11:17.458220+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:07.026012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.461666+0000","last_change":"2023-09-13T06:11:17.471519+0000","last_active":"2023-09-13T06:11:18.461666+0000","last_peered":"2023-09-13T06:11:18.461666+0000","last_clean":"2023-09-13T06:11:18.461666+0000","last_became_active":"2023-09-13T06:11:17.471249+0000","last_became_peered":"2023-09-13T06:11:17.471249+0000","last_unstale":"2023-09-13T06:11:18.461666+0000","last_undegraded":"2023-09-13T06:11:18.461666+0000","last_fullsized":"2023-09-13T06:11:18.461666+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:20:32.182252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460467+0000","last_change":"2023-09-13T06:11:16.696634+0000","last_active":"2023-09-13T06:11:18.460467+0000","last_peered":"2023-09-13T06:11:18.460467+0000","last_clean":"2023-09-13T06:11:18.460467+0000","last_became_active":"2023-09-13T06:11:16.696359+0000","last_became_peered":"2023-09-13T06:11:16.696359+0000","last_unstale":"2023-09-13T06:11:18.460467+0000","last_undegraded":"2023-09-13T06:11:18.460467+0000","last_fullsized":"2023-09-13T06:11:18.460467+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:00:58.343302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.478549+0000","last_change":"2023-09-13T06:11:17.478456+0000","last_active":"2023-09-13T06:11:17.478549+0000","last_peered":"2023-09-13T06:11:17.478549+0000","last_clean":"2023-09-13T06:11:17.478549+0000","last_became_active":"2023-09-13T06:11:17.478225+0000","last_became_peered":"2023-09-13T06:11:17.478225+0000","last_unstale":"2023-09-13T06:11:17.478549+0000","last_undegraded":"2023-09-13T06:11:17.478549+0000","last_fullsized":"2023-09-13T06:11:17.478549+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:13.905663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.464997+0000","last_change":"2023-09-13T06:11:16.698415+0000","last_active":"2023-09-13T06:11:18.464997+0000","last_peered":"2023-09-13T06:11:18.464997+0000","last_clean":"2023-09-13T06:11:18.464997+0000","last_became_active":"2023-09-13T06:11:16.697845+0000","last_became_peered":"2023-09-13T06:11:16.697845+0000","last_unstale":"2023-09-13T06:11:18.464997+0000","last_undegraded":"2023-09-13T06:11:18.464997+0000","last_fullsized":"2023-09-13T06:11:18.464997+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:07:24.960565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.465009+0000","last_change":"2023-09-13T06:11:17.469984+0000","last_active":"2023-09-13T06:11:18.465009+0000","last_peered":"2023-09-13T06:11:18.465009+0000","last_clean":"2023-09-13T06:11:18.465009+0000","last_became_active":"2023-09-13T06:11:17.469736+0000","last_became_peered":"2023-09-13T06:11:17.469736+0000","last_unstale":"2023-09-13T06:11:18.465009+0000","last_undegraded":"2023-09-13T06:11:18.465009+0000","last_fullsized":"2023-09-13T06:11:18.465009+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:50.766190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.468216+0000","last_change":"2023-09-13T06:11:16.696383+0000","last_active":"2023-09-13T06:11:17.468216+0000","last_peered":"2023-09-13T06:11:17.468216+0000","last_clean":"2023-09-13T06:11:17.468216+0000","last_became_active":"2023-09-13T06:11:16.695812+0000","last_became_peered":"2023-09-13T06:11:16.695812+0000","last_unstale":"2023-09-13T06:11:17.468216+0000","last_undegraded":"2023-09-13T06:11:17.468216+0000","last_fullsized":"2023-09-13T06:11:17.468216+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:03.727457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.478639+0000","last_change":"2023-09-13T06:11:17.478535+0000","last_active":"2023-09-13T06:11:17.478639+0000","last_peered":"2023-09-13T06:11:17.478639+0000","last_clean":"2023-09-13T06:11:17.478639+0000","last_became_active":"2023-09-13T06:11:17.477277+0000","last_became_peered":"2023-09-13T06:11:17.477277+0000","last_unstale":"2023-09-13T06:11:17.478639+0000","last_undegraded":"2023-09-13T06:11:17.478639+0000","last_fullsized":"2023-09-13T06:11:17.478639+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:29.403563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.461502+0000","last_change":"2023-09-13T06:11:16.701900+0000","last_active":"2023-09-13T06:11:17.461502+0000","last_peered":"2023-09-13T06:11:17.461502+0000","last_clean":"2023-09-13T06:11:17.461502+0000","last_became_active":"2023-09-13T06:11:16.701528+0000","last_became_peered":"2023-09-13T06:11:16.701528+0000","last_unstale":"2023-09-13T06:11:17.461502+0000","last_undegraded":"2023-09-13T06:11:17.461502+0000","last_fullsized":"2023-09-13T06:11:17.461502+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:38:33.159782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":11,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.460336+0000","last_change":"2023-09-13T06:11:17.471782+0000","last_active":"2023-09-13T06:11:18.460336+0000","last_peered":"2023-09-13T06:11:18.460336+0000","last_clean":"2023-09-13T06:11:18.460336+0000","last_became_active":"2023-09-13T06:11:17.471488+0000","last_became_peered":"2023-09-13T06:11:17.471488+0000","last_unstale":"2023-09-13T06:11:18.460336+0000","last_undegraded":"2023-09-13T06:11:18.460336+0000","last_fullsized":"2023-09-13T06:11:18.460336+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:16.680363+0000","last_clean_scrub_stamp":"2023-09-13T06:11:16.680363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:48:54.767374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"170'3","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-09-13T06:11:17.731740+0000","last_change":"2023-09-13T06:11:16.696853+0000","last_active":"2023-09-13T06:11:17.731740+0000","last_peered":"2023-09-13T06:11:17.731740+0000","last_clean":"2023-09-13T06:11:17.731740+0000","last_became_active":"2023-09-13T06:11:16.696617+0000","last_became_peered":"2023-09-13T06:11:16.696617+0000","last_unstale":"2023-09-13T06:11:17.731740+0000","last_undegraded":"2023-09-13T06:11:17.731740+0000","last_fullsized":"2023-09-13T06:11:17.731740+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:11:15.677515+0000","last_clean_scrub_stamp":"2023-09-13T06:11:15.677515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:56:50.768293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":332,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-09-13T06:11:18.465170+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:11:18.465170+0000","last_peered":"2023-09-13T06:11:18.465170+0000","last_clean":"2023-09-13T06:11:18.465170+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:11:18.465170+0000","last_undegraded":"2023-09-13T06:11:18.465170+0000","last_fullsized":"2023-09-13T06:11:18.465170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1517,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193794,"statfs":{"total":200000000,"available":198445574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.60699999999999998,"5min":0.38100000000000001,"15min":0.34599999999999997},"max":{"1min":0.94699999999999995,"5min":1.0349999999999999,"15min":1.3320000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72299999999999998,"15min":0.70199999999999996},"min":{"1min":0.52800000000000002,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":1.0089999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.54700000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94399999999999995,"5min":0.999,"15min":0.999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.748,"15min":0.73099999999999998},"min":{"1min":0.58799999999999997,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":0.92700000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69199999999999995,"15min":0.69799999999999995},"min":{"1min":0.57199999999999995,"5min":0.45600000000000002,"15min":0.432},"max":{"1min":0.85799999999999998,"5min":1.016,"15min":1.395},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72899999999999998,"15min":0.72199999999999998},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96199999999999997,"5min":0.97099999999999997,"15min":1.2030000000000001},"last":0.80700000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.68300000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":0.95299999999999996,"15min":1.357},"last":0.623},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.67300000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.008,"5min":1.0580000000000001,"15min":1.2629999999999999},"last":0.77600000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.622},"min":{"1min":0.499,"5min":0.32600000000000001,"15min":0.316},"max":{"1min":0.85999999999999999,"5min":0.89300000000000002,"15min":0.95899999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63600000000000001,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80300000000000005,"5min":0.95899999999999996,"15min":1.018},"last":0.68200000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63800000000000001,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.97099999999999997,"15min":0.97999999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.56399999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.95999999999999996,"5min":0.99199999999999999,"15min":1.1319999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.64800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.0129999999999999,"15min":1.0920000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69899999999999995,"15min":0.69499999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.46600000000000003},"max":{"1min":0.90100000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.75800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574971,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042748,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66300000000000003,"15min":0.68100000000000005},"min":{"1min":0.504,"5min":0.35599999999999998,"15min":0.35299999999999998},"max":{"1min":0.873,"5min":1.0649999999999999,"15min":1.181},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.56699999999999995,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.95899999999999996,"5min":0.96299999999999997,"15min":1.028},"last":0.59199999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.876,"5min":1.024,"15min":1.0840000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.55300000000000005,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":1.137,"15min":1.153},"last":0.62}]},{"osd":2,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.44700000000000001,"15min":0.39300000000000002},"max":{"1min":0.91300000000000003,"5min":0.98599999999999999,"15min":1.4750000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68799999999999994,"15min":0.71199999999999997},"min":{"1min":0.55800000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96199999999999997,"5min":1.034,"15min":1.085},"last":0.66500000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72599999999999998,"15min":0.753},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91100000000000003,"5min":0.93700000000000006,"15min":1.2030000000000001},"last":0.749},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.65500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0009999999999999,"5min":1.0620000000000001,"15min":1.526},"last":0.73299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.40100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":1.024,"15min":1.0589999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.79400000000000004,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.47099999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.0089999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85999999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71699999999999997},"min":{"1min":0.47899999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91000000000000003,"5min":1.071,"15min":4.3879999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.51600000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":1.014,"15min":1.133},"last":0.80900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67300000000000004,"15min":0.66800000000000004},"min":{"1min":0.57299999999999995,"5min":0.35999999999999999,"15min":0.32000000000000001},"max":{"1min":0.876,"5min":0.91300000000000003,"15min":1.0389999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.69599999999999995,"15min":0.67500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.30199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.78800000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70299999999999996,"15min":0.69399999999999995},"min":{"1min":0.505,"5min":0.40699999999999997,"15min":0.36299999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.96099999999999997},"last":0.629},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93400000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.53500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88500000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47299999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91800000000000004,"5min":0.997,"15min":0.997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.71899999999999997,"15min":0.71399999999999997},"min":{"1min":0.61499999999999999,"5min":0.49099999999999999,"15min":0.47099999999999997},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.98099999999999998},"last":0.68300000000000005}]},{"osd":4,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.73099999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.61699999999999999},"min":{"1min":0.46000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76300000000000001,"5min":1.077,"15min":1.077},"last":0.81699999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.505,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82999999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.46700000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83399999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66900000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.70899999999999996,"15min":0.71499999999999997},"min":{"1min":0.502,"5min":0.42099999999999999,"15min":0.41799999999999998},"max":{"1min":0.878,"5min":1.171,"15min":1.171},"last":0.753},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.56699999999999995,"5min":0.495,"15min":0.48499999999999999},"max":{"1min":0.90500000000000003,"5min":1.024,"15min":1.026},"last":0.77000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574971,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042894,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.65300000000000002},"min":{"1min":0.53000000000000003,"5min":0.432,"15min":0.34999999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.69599999999999995,"15min":0.68200000000000005},"min":{"1min":0.59099999999999997,"5min":0.436,"15min":0.38},"max":{"1min":0.91300000000000003,"5min":1.145,"15min":1.145},"last":0.45400000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.71499999999999997,"15min":0.68300000000000005},"min":{"1min":0.68300000000000005,"5min":0.39100000000000001,"15min":0.376},"max":{"1min":0.91100000000000003,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70799999999999996,"15min":0.68100000000000005},"min":{"1min":0.58299999999999996,"5min":0.45400000000000001,"15min":0.40500000000000003},"max":{"1min":0.93200000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.68000000000000005},"min":{"1min":0.56200000000000006,"5min":0.45600000000000002,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.76100000000000001,"15min":0.74399999999999999},"min":{"1min":0.68600000000000005,"5min":0.46500000000000002,"15min":0.40600000000000003},"max":{"1min":0.98899999999999999,"5min":1.056,"15min":1.056},"last":0.65200000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.72299999999999998},"min":{"1min":0.60499999999999998,"5min":0.48299999999999998,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":1.077,"15min":1.077},"last":0.626},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.75,"15min":0.72699999999999998},"min":{"1min":0.68700000000000006,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.071},"last":0.75700000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63800000000000001,"15min":0.62},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.88600000000000001,"5min":0.96899999999999997,"15min":1.01},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.45100000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.91300000000000003,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94199999999999995,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.53500000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.92800000000000005,"5min":1.123,"15min":1.123},"last":0.73999999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73299999999999998,"15min":0.71899999999999997},"min":{"1min":0.495,"5min":0.49299999999999999,"15min":0.39200000000000002},"max":{"1min":0.98299999999999998,"5min":1.26,"15min":1.26},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72299999999999998,"15min":0.71299999999999997},"min":{"1min":0.47699999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.96499999999999997,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.82399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042804,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.432,"15min":0.40899999999999997},"min":{"1min":0.33700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47499999999999998,"15min":0.44600000000000001},"min":{"1min":0.307,"5min":0.28999999999999998,"15min":0.28299999999999997},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.43099999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.434},"min":{"1min":0.33700000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.5,"15min":0.47199999999999998},"min":{"1min":0.39300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52000000000000002,"15min":0.50800000000000001},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.33400000000000002},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54200000000000004,"15min":0.52300000000000002},"min":{"1min":0.434,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.78100000000000003},"last":0.46899999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.55800000000000005,"5min":0.46700000000000003,"15min":0.42999999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.284},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.60499999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.044},"last":0.67600000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.56599999999999995,"5min":0.46200000000000002,"15min":0.442},"max":{"1min":1.107,"5min":1.107,"15min":1.111},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72599999999999998,"15min":0.73599999999999999},"min":{"1min":0.52100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.107,"5min":1.107,"15min":1.2270000000000001},"last":0.82099999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.748,"15min":0.73499999999999999},"min":{"1min":0.58499999999999996,"5min":0.48899999999999999,"15min":0.47499999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.61899999999999999,"5min":0.54500000000000004,"15min":0.53000000000000003},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.458},"last":0.81200000000000006}]},{"osd":7,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.74199999999999999,"15min":0.76600000000000001},"min":{"1min":0.56899999999999995,"5min":0.46100000000000002,"15min":0.45900000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.383},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.76100000000000001,"15min":0.76200000000000001},"min":{"1min":0.629,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.27},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834574971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":936,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194376,"statfs":{"total":200000000,"available":199041212,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.42099999999999999},"min":{"1min":0.32600000000000001,"5min":0.252,"15min":0.22700000000000001},"max":{"1min":0.55200000000000005,"5min":0.745,"15min":10.401},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.45400000000000001,"15min":0.44800000000000001},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.27400000000000002},"max":{"1min":0.66500000000000004,"5min":0.69399999999999995,"15min":5.4429999999999996},"last":0.379}]},{"osd":1,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.46700000000000003},"min":{"1min":0.38200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.67800000000000005,"5min":0.68600000000000005,"15min":5.2640000000000002},"last":0.437},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.497,"15min":0.48099999999999998},"min":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.312},"max":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":4.3369999999999997},"last":0.499}]},{"osd":3,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48999999999999999,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":6.0410000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.52600000000000002,"5min":0.41399999999999998,"15min":0.38600000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":6.1600000000000001},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.67400000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92700000000000005,"5min":1.171,"15min":5.4809999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.623,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88500000000000001,"5min":1.121,"15min":4.0599999999999996},"last":0.72099999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.75,"15min":0.76900000000000002},"min":{"1min":0.64200000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94799999999999995,"5min":1.1579999999999999,"15min":4.2089999999999996},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78800000000000003,"15min":0.79700000000000004},"min":{"1min":0.69999999999999996,"5min":0.501,"15min":0.501},"max":{"1min":0.97599999999999998,"5min":1.135,"15min":5.5289999999999999},"last":0.83399999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.66100000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91300000000000003,"5min":1.048,"15min":4.1609999999999996},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.75600000000000001,"15min":0.73799999999999999},"min":{"1min":0.66800000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.99199999999999999,"5min":1.1100000000000001,"15min":4.2380000000000004},"last":0.86499999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.64100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93100000000000005,"5min":1.1879999999999999,"15min":4.2400000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.70099999999999996,"5min":0.48699999999999999,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":1.135,"15min":4.2649999999999997},"last":0.91400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.45600000000000002,"15min":0.44600000000000001},"min":{"1min":0.318,"5min":0.252,"15min":0.252},"max":{"1min":0.78100000000000003,"5min":0.80200000000000005,"15min":2.4020000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.29199999999999998,"15min":0.27300000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.81100000000000005},"last":0.36699999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.46999999999999997},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.67600000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.48099999999999998},"min":{"1min":0.35699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84799999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.33100000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.88,"15min":0.88},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.38100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.59499999999999997,"5min":0.80600000000000005,"15min":4.0599999999999996},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.747,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90000000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.754,"15min":0.75},"min":{"1min":0.67300000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98599999999999999,"5min":1.121,"15min":1.2150000000000001},"last":0.505}]},{"osd":5,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.746,"15min":0.754},"min":{"1min":0.57999999999999996,"5min":0.443,"15min":0.443},"max":{"1min":0.98199999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.76500000000000001,"15min":0.753},"min":{"1min":0.56999999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0109999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.499,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96599999999999997,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.48899999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0640000000000001,"15min":1.3799999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76600000000000001,"15min":0.748},"min":{"1min":0.64600000000000002,"5min":0.47399999999999998,"15min":0.42599999999999999},"max":{"1min":0.997,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.627,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94099999999999995,"5min":1.0409999999999999,"15min":1.2769999999999999},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574971,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1512,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193799,"statfs":{"total":200000000,"available":198450880,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.32600000000000001,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":2.0190000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.309,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.89800000000000002,"15min":2.294},"last":0.34899999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.502},"min":{"1min":0.39600000000000002,"5min":0.34000000000000002,"15min":0.28999999999999998},"max":{"1min":0.68400000000000005,"5min":0.875,"15min":2.2410000000000001},"last":0.438},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.46500000000000002,"15min":0.47799999999999998},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.67500000000000004,"5min":0.76500000000000001,"15min":2.056},"last":0.372}]},{"osd":3,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.38,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":2.0859999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.753,"5min":0.83599999999999997,"15min":2.3820000000000001},"last":0.47399999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.66400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.0309999999999999,"5min":1.034,"15min":2.1749999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.753,"15min":0.77700000000000002},"min":{"1min":0.61699999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.0549999999999999,"5min":1.0940000000000001,"15min":2.3370000000000002},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73499999999999999,"15min":0.76200000000000001},"min":{"1min":0.629,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97999999999999998,"5min":1.0680000000000001,"15min":2.3119999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.71699999999999997,"5min":0.51400000000000001,"15min":0.48799999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":2.1469999999999998},"last":0.81499999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.75700000000000001,"15min":0.77400000000000002},"min":{"1min":0.66600000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.01,"5min":1.054,"15min":2.415},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.73599999999999999,"15min":0.76500000000000001},"min":{"1min":0.628,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.113,"5min":1.121,"15min":2.347},"last":0.79500000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.75,"15min":0.78300000000000003},"min":{"1min":0.66200000000000003,"5min":0.496,"15min":0.495},"max":{"1min":1.0920000000000001,"5min":1.1499999999999999,"15min":2.367},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.64700000000000002,"5min":0.53300000000000003,"15min":0.53000000000000003},"max":{"1min":0.92900000000000005,"5min":1.0509999999999999,"15min":2.1179999999999999},"last":0.78000000000000003}]}]}],"pool_statfs":[]}} 2023-09-13T06:11:22.311 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T06:11:22.311 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-13T06:11:22.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e62234640 1 Processor -- start 2023-09-13T06:11:22.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e62234640 1 -- start start 2023-09-13T06:11:22.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e62234640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9e5c0b1b70 0x7f9e5c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e62234640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5c0b2150 con 0x7f9e5c144d70 2023-09-13T06:11:22.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e62234640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5c0cdd90 con 0x7f9e5c0b2e90 2023-09-13T06:11:22.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e62234640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e5c0b2430 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e5b7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9e5c144d70 0x7f9e5c0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59886/0 (socket says 172.21.15.130:59886) 2023-09-13T06:11:22.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e5b7fe640 1 -- 172.21.15.130:0/2238345370 learned_addr learned my addr 172.21.15.130:0/2238345370 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:22.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e5bfff640 1 --2- 172.21.15.130:0/2238345370 >> v2:172.21.15.130:3300/0 conn(0x7f9e5c0b1b70 0x7f9e5c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e5a7fc640 1 -- 172.21.15.130:0/2238345370 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725893101 0 0) 0x7f9e5c0b2150 con 0x7f9e5c144d70 2023-09-13T06:11:22.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e5a7fc640 1 -- 172.21.15.130:0/2238345370 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e44003530 con 0x7f9e5c144d70 2023-09-13T06:11:22.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e5bfff640 1 -- 172.21.15.130:0/2238345370 >> v1:172.21.15.164:6789/0 conn(0x7f9e5c0b2e90 legacy=0x7f9e5c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e5bfff640 1 -- 172.21.15.130:0/2238345370 >> v1:172.21.15.130:6789/0 conn(0x7f9e5c144d70 legacy=0x7f9e5c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.493+0000 7f9e5bfff640 1 -- 172.21.15.130:0/2238345370 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c0ce070 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.497+0000 7f9e5bfff640 1 --2- 172.21.15.130:0/2238345370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e5c0b1b70 0x7f9e5c0ce870 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009d90 tx=0x7f9e5401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27521e5a6345c14b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:22.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.497+0000 7f9e5a7fc640 1 -- 172.21.15.130:0/2238345370 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540a5810 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.497+0000 7f9e5a7fc640 1 -- 172.21.15.130:0/2238345370 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e540a5970 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.497+0000 7f9e5a7fc640 1 -- 172.21.15.130:0/2238345370 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540a5d00 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.497+0000 7f9e62234640 1 -- 172.21.15.130:0/2238345370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e5c0b1b70 msgr2=0x7f9e5c0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.497+0000 7f9e62234640 1 --2- 172.21.15.130:0/2238345370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e5c0b1b70 0x7f9e5c0ce870 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009d90 tx=0x7f9e5401c950 comp rx=0 tx=0).stop 2023-09-13T06:11:22.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.497+0000 7f9e62234640 1 -- 172.21.15.130:0/2238345370 shutdown_connections 2023-09-13T06:11:22.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.497+0000 7f9e62234640 1 --2- 172.21.15.130:0/2238345370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e5c0b1b70 0x7f9e5c0ce870 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.497+0000 7f9e62234640 1 -- 172.21.15.130:0/2238345370 >> 172.21.15.130:0/2238345370 conn(0x7f9e5c065990 msgr2=0x7f9e5c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:22.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.497+0000 7f9e62234640 1 -- 172.21.15.130:0/2238345370 shutdown_connections 2023-09-13T06:11:22.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.497+0000 7f9e62234640 1 -- 172.21.15.130:0/2238345370 wait complete. 2023-09-13T06:11:22.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e62234640 1 Processor -- start 2023-09-13T06:11:22.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e62234640 1 -- start start 2023-09-13T06:11:22.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e62234640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e5c0b1b70 0x7f9e5c0adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e62234640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e5c0b2e90 0x7f9e5c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e62234640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e5c144d70 0x7f9e5c13b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e62234640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c0cbc10 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e62234640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c15e390 con 0x7f9e5c0b2e90 2023-09-13T06:11:22.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e62234640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c13bbd0 con 0x7f9e5c144d70 2023-09-13T06:11:22.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e5b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e5c0b1b70 0x7f9e5c0adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e5b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e5c0b1b70 0x7f9e5c0adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59720/0 (socket says 172.21.15.130:59720) 2023-09-13T06:11:22.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e5b7fe640 1 -- 172.21.15.130:0/2086066094 learned_addr learned my addr 172.21.15.130:0/2086066094 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:22.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e5b7fe640 1 -- 172.21.15.130:0/2086066094 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e5c144d70 msgr2=0x7f9e5c13b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e5b7fe640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e5c144d70 0x7f9e5c13b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e5b7fe640 1 -- 172.21.15.130:0/2086066094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e5c0b2e90 msgr2=0x7f9e5c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e5b7fe640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e5c0b2e90 0x7f9e5c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e5b7fe640 1 -- 172.21.15.130:0/2086066094 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54009a70 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e5b7fe640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e5c0b1b70 0x7f9e5c0adb10 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c420 tx=0x7f9e4c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:22.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e43fff640 1 -- 172.21.15.130:0/2086066094 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c005cf0 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e43fff640 1 -- 172.21.15.130:0/2086066094 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c005e50 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e62234640 1 -- 172.21.15.130:0/2086066094 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5c13beb0 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e43fff640 1 -- 172.21.15.130:0/2086066094 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c0072d0 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e62234640 1 -- 172.21.15.130:0/2086066094 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5c13b710 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.501+0000 7f9e62234640 1 -- 172.21.15.130:0/2086066094 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e5c13b990 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.505+0000 7f9e43fff640 1 -- 172.21.15.130:0/2086066094 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9e4c007430 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.505+0000 7f9e43fff640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9e48065b20 0x7f9e48067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.505+0000 7f9e43fff640 1 -- 172.21.15.130:0/2086066094 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e4c0828c0 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.505+0000 7f9e5affd640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9e48065b20 0x7f9e48067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.505+0000 7f9e5affd640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9e48065b20 0x7f9e48067fe0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9e50000f70 tx=0x7f9e500079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:22.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.509+0000 7f9e43fff640 1 -- 172.21.15.130:0/2086066094 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9e5c13b990 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.661 INFO:tasks.ceph.mds.c.smithi130.stderr:2023-09-13T06:11:22.661+0000 7fbd6c397640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:11:22.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.709+0000 7f9e62234640 1 -- 172.21.15.130:0/2086066094 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9e5c13b990 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.717 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.717+0000 7f9e43fff640 1 -- 172.21.15.130:0/2086066094 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9e5c13b990 con 0x7f9e5c0b1b70 2023-09-13T06:11:22.717 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:11:22.718 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:11:22.718 INFO:teuthology.orchestra.run.smithi130.stdout: caps mds = "allow" 2023-09-13T06:11:22.718 INFO:teuthology.orchestra.run.smithi130.stdout: caps mon = "allow r" 2023-09-13T06:11:22.718 INFO:teuthology.orchestra.run.smithi130.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-13T06:11:22.719 INFO:teuthology.orchestra.run.smithi130.stderr:updated caps for client.0 2023-09-13T06:11:22.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 -- 172.21.15.130:0/2086066094 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9e48065b20 msgr2=0x7f9e48067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9e48065b20 0x7f9e48067fe0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9e50000f70 tx=0x7f9e500079c0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 -- 172.21.15.130:0/2086066094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e5c0b1b70 msgr2=0x7f9e5c0adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e5c0b1b70 0x7f9e5c0adb10 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c420 tx=0x7f9e4c00c8e0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 -- 172.21.15.130:0/2086066094 shutdown_connections 2023-09-13T06:11:22.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9e48065b20 0x7f9e48067fe0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e5c0b2e90 0x7f9e5c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e5c144d70 0x7f9e5c13b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 --2- 172.21.15.130:0/2086066094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e5c0b1b70 0x7f9e5c0adb10 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 -- 172.21.15.130:0/2086066094 >> 172.21.15.130:0/2086066094 conn(0x7f9e5c065990 msgr2=0x7f9e5c1567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:22.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 -- 172.21.15.130:0/2086066094 shutdown_connections 2023-09-13T06:11:22.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.721+0000 7f9e62234640 1 -- 172.21.15.130:0/2086066094 wait complete. 2023-09-13T06:11:22.739 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:11:22.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.877+0000 7f5786367640 1 Processor -- start 2023-09-13T06:11:22.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.877+0000 7f5786367640 1 -- start start 2023-09-13T06:11:22.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.877+0000 7f5786367640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5780157920 0x7f57800ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.877+0000 7f5786367640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f57800b0f40 0x7f57800b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.877+0000 7f5786367640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57800afee0 con 0x7f578015e560 2023-09-13T06:11:22.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.877+0000 7f5786367640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57800aea50 con 0x7f5780157920 2023-09-13T06:11:22.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.877+0000 7f5786367640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57800b0b20 con 0x7f57800b0f40 2023-09-13T06:11:22.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.877+0000 7f577ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5780157920 0x7f57800ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.877+0000 7f577ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5780157920 0x7f57800ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59726/0 (socket says 172.21.15.130:59726) 2023-09-13T06:11:22.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.877+0000 7f577ffff640 1 -- 172.21.15.130:0/628777281 learned_addr learned my addr 172.21.15.130:0/628777281 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:22.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.877+0000 7f577f7fe640 1 --2- 172.21.15.130:0/628777281 >> v2:172.21.15.164:3300/0 conn(0x7f57800b0f40 0x7f57800b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f577ffff640 1 -- 172.21.15.130:0/628777281 >> v2:172.21.15.164:3300/0 conn(0x7f57800b0f40 msgr2=0x7f57800b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:22.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f577ffff640 1 --2- 172.21.15.130:0/628777281 >> v2:172.21.15.164:3300/0 conn(0x7f57800b0f40 0x7f57800b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f577ffff640 1 -- 172.21.15.130:0/628777281 >> v1:172.21.15.164:6789/0 conn(0x7f578015e560 legacy=0x7f57800ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:22.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f577ffff640 1 -- 172.21.15.130:0/628777281 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57800b0180 con 0x7f5780157920 2023-09-13T06:11:22.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f577ffff640 1 --2- 172.21.15.130:0/628777281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5780157920 0x7f57800ae190 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f578006e070 tx=0x7f577001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24339894de2703b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:22.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f577effd640 1 -- 172.21.15.130:0/628777281 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700ac600 con 0x7f5780157920 2023-09-13T06:11:22.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f577effd640 1 -- 172.21.15.130:0/628777281 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57700a8050 con 0x7f5780157920 2023-09-13T06:11:22.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f577effd640 1 -- 172.21.15.130:0/628777281 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700ac980 con 0x7f5780157920 2023-09-13T06:11:22.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f5786367640 1 -- 172.21.15.130:0/628777281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5780157920 msgr2=0x7f57800ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f5786367640 1 --2- 172.21.15.130:0/628777281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5780157920 0x7f57800ae190 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f578006e070 tx=0x7f577001c490 comp rx=0 tx=0).stop 2023-09-13T06:11:22.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f5786367640 1 -- 172.21.15.130:0/628777281 shutdown_connections 2023-09-13T06:11:22.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f5786367640 1 --2- 172.21.15.130:0/628777281 >> v2:172.21.15.164:3300/0 conn(0x7f57800b0f40 0x7f57800b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f5786367640 1 --2- 172.21.15.130:0/628777281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5780157920 0x7f57800ae190 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.881+0000 7f5786367640 1 -- 172.21.15.130:0/628777281 >> 172.21.15.130:0/628777281 conn(0x7f5780065990 msgr2=0x7f5780065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:22.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5786367640 1 -- 172.21.15.130:0/628777281 shutdown_connections 2023-09-13T06:11:22.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5786367640 1 -- 172.21.15.130:0/628777281 wait complete. 2023-09-13T06:11:22.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5786367640 1 Processor -- start 2023-09-13T06:11:22.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5786367640 1 -- start start 2023-09-13T06:11:22.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5786367640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57800b0f40 0x7f5780146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5786367640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5780157920 0x7f5780070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5786367640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f578015e560 0x7f57800706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5786367640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57801473a0 con 0x7f578015e560 2023-09-13T06:11:22.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5786367640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578014f020 con 0x7f57800b0f40 2023-09-13T06:11:22.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5786367640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578014ead0 con 0x7f5780157920 2023-09-13T06:11:22.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5784904640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f578015e560 0x7f57800706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5784904640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f578015e560 0x7f57800706a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59740/0 (socket says 172.21.15.130:59740) 2023-09-13T06:11:22.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5784904640 1 -- 172.21.15.130:0/3756597055 learned_addr learned my addr 172.21.15.130:0/3756597055 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:22.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f577ffff640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57800b0f40 0x7f5780146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f577f7fe640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5780157920 0x7f5780070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5784904640 1 -- 172.21.15.130:0/3756597055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5780157920 msgr2=0x7f5780070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5784904640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5780157920 0x7f5780070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5784904640 1 -- 172.21.15.130:0/3756597055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57800b0f40 msgr2=0x7f5780146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:22.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5784904640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57800b0f40 0x7f5780146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:22.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5784904640 1 -- 172.21.15.130:0/3756597055 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700094d0 con 0x7f578015e560 2023-09-13T06:11:22.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.885+0000 7f5784904640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f578015e560 0x7f57800706a0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f577800b9e0 tx=0x7f577800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:22.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.889+0000 7f577cff9640 1 -- 172.21.15.130:0/3756597055 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778003b80 con 0x7f578015e560 2023-09-13T06:11:22.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.889+0000 7f577cff9640 1 -- 172.21.15.130:0/3756597055 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5778003ce0 con 0x7f578015e560 2023-09-13T06:11:22.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.889+0000 7f577cff9640 1 -- 172.21.15.130:0/3756597055 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577800cae0 con 0x7f578015e560 2023-09-13T06:11:22.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.889+0000 7f5786367640 1 -- 172.21.15.130:0/3756597055 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5780156bc0 con 0x7f578015e560 2023-09-13T06:11:22.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.889+0000 7f5786367640 1 -- 172.21.15.130:0/3756597055 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57801566a0 con 0x7f578015e560 2023-09-13T06:11:22.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.889+0000 7f5786367640 1 -- 172.21.15.130:0/3756597055 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57800618a0 con 0x7f578015e560 2023-09-13T06:11:22.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.889+0000 7f577cff9640 1 -- 172.21.15.130:0/3756597055 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f577800cc40 con 0x7f578015e560 2023-09-13T06:11:22.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.889+0000 7f577cff9640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f576c065b20 0x7f576c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:22.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.889+0000 7f577cff9640 1 -- 172.21.15.130:0/3756597055 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5778082ef0 con 0x7f578015e560 2023-09-13T06:11:22.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.889+0000 7f577ffff640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f576c065b20 0x7f576c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:22.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.893+0000 7f577ffff640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f576c065b20 0x7f576c067fe0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f57700ae000 tx=0x7f57700a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:22.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:22.893+0000 7f577cff9640 1 -- 172.21.15.130:0/3756597055 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5778050960 con 0x7f578015e560 2023-09-13T06:11:23.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 -- 172.21.15.130:0/3756597055 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f578015cf10 con 0x7f578015e560 2023-09-13T06:11:23.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f577cff9640 1 -- 172.21.15.130:0/3756597055 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f5778053f80 con 0x7f578015e560 2023-09-13T06:11:23.073 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:23.073 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2473585305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2473585305},{"type":"v1","addr":"172.21.15.130:6835","nonce":2473585305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1139512428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1139512428},{"type":"v1","addr":"172.21.15.164:6834","nonce":1139512428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2365480398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2365480398},{"type":"v1","addr":"172.21.15.164:6835","nonce":2365480398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:11:17.067978+0000","modified":"2023-09-13T06:11:20.112082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8646":{"gid":8646,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/597081287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":597081287},{"type":"v1","addr":"172.21.15.130:6837","nonce":597081287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-09-13T06:11:23.073 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 84 2023-09-13T06:11:23.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 -- 172.21.15.130:0/3756597055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f576c065b20 msgr2=0x7f576c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f576c065b20 0x7f576c067fe0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f57700ae000 tx=0x7f57700a7000 comp rx=0 tx=0).stop 2023-09-13T06:11:23.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 -- 172.21.15.130:0/3756597055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f578015e560 msgr2=0x7f57800706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f578015e560 0x7f57800706a0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f577800b9e0 tx=0x7f577800bea0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 -- 172.21.15.130:0/3756597055 shutdown_connections 2023-09-13T06:11:23.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f576c065b20 0x7f576c067fe0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f578015e560 0x7f57800706a0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5780157920 0x7f5780070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 --2- 172.21.15.130:0/3756597055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57800b0f40 0x7f5780146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 -- 172.21.15.130:0/3756597055 >> 172.21.15.130:0/3756597055 conn(0x7f5780065990 msgr2=0x7f57800ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:23.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 -- 172.21.15.130:0/3756597055 shutdown_connections 2023-09-13T06:11:23.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.073+0000 7f5786367640 1 -- 172.21.15.130:0/3756597055 wait complete. 2023-09-13T06:11:23.497 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T06:11:17.067978+0000', 'modified': '2023-09-13T06:11:20.112082+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8646': {'gid': 8646, 'name': 'c', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6837/597081287', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 597081287}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 597081287}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T06:11:23.498 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T06:11:23.498 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-13T06:11:23.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c31c6640 1 Processor -- start 2023-09-13T06:11:23.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c31c6640 1 -- start start 2023-09-13T06:11:23.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c31c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88bc0b2da0 0x7f88bc06f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c31c6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f88bc06fc70 0x7f88bc0ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c31c6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f88bc0cf0d0 0x7f88bc1429c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c31c6640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88bc15e660 con 0x7f88bc0cf0d0 2023-09-13T06:11:23.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c31c6640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88bc0cf4e0 con 0x7f88bc06fc70 2023-09-13T06:11:23.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c31c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc15d9e0 con 0x7f88bc0b2da0 2023-09-13T06:11:23.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c1763640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f88bc0cf0d0 0x7f88bc1429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c1763640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f88bc0cf0d0 0x7f88bc1429c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59746/0 (socket says 172.21.15.130:59746) 2023-09-13T06:11:23.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c1763640 1 -- 172.21.15.130:0/4053384549 learned_addr learned my addr 172.21.15.130:0/4053384549 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:23.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88bbfff640 1 --2- 172.21.15.130:0/4053384549 >> v2:172.21.15.164:3300/0 conn(0x7f88bc06fc70 0x7f88bc0ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c0f62640 1 --2- 172.21.15.130:0/4053384549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88bc0b2da0 0x7f88bc06f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c1763640 1 -- 172.21.15.130:0/4053384549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88bc0b2da0 msgr2=0x7f88bc06f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c1763640 1 --2- 172.21.15.130:0/4053384549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88bc0b2da0 0x7f88bc06f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c1763640 1 -- 172.21.15.130:0/4053384549 >> v2:172.21.15.164:3300/0 conn(0x7f88bc06fc70 msgr2=0x7f88bc0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c1763640 1 --2- 172.21.15.130:0/4053384549 >> v2:172.21.15.164:3300/0 conn(0x7f88bc06fc70 0x7f88bc0ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c1763640 1 -- 172.21.15.130:0/4053384549 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc15dcc0 con 0x7f88bc0cf0d0 2023-09-13T06:11:23.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.641+0000 7f88c0f62640 1 --2- 172.21.15.130:0/4053384549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88bc0b2da0 0x7f88bc06f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:23.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88c1763640 1 --2- 172.21.15.130:0/4053384549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88bc0cf0d0 0x7f88bc1429c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f88bc073990 tx=0x7f88b401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3eed5e89abcba4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:23.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88bb7fe640 1 -- 172.21.15.130:0/4053384549 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40af400 con 0x7f88bc0cf0d0 2023-09-13T06:11:23.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88bb7fe640 1 -- 172.21.15.130:0/4053384549 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40ab050 con 0x7f88bc0cf0d0 2023-09-13T06:11:23.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88bb7fe640 1 -- 172.21.15.130:0/4053384549 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40af780 con 0x7f88bc0cf0d0 2023-09-13T06:11:23.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88c31c6640 1 -- 172.21.15.130:0/4053384549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88bc0cf0d0 msgr2=0x7f88bc1429c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88c31c6640 1 --2- 172.21.15.130:0/4053384549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88bc0cf0d0 0x7f88bc1429c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f88bc073990 tx=0x7f88b401f1c0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88c31c6640 1 -- 172.21.15.130:0/4053384549 shutdown_connections 2023-09-13T06:11:23.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88c31c6640 1 --2- 172.21.15.130:0/4053384549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88bc0cf0d0 0x7f88bc1429c0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88c31c6640 1 --2- 172.21.15.130:0/4053384549 >> v2:172.21.15.164:3300/0 conn(0x7f88bc06fc70 0x7f88bc0ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88c31c6640 1 --2- 172.21.15.130:0/4053384549 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88bc0b2da0 0x7f88bc06f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88c31c6640 1 -- 172.21.15.130:0/4053384549 >> 172.21.15.130:0/4053384549 conn(0x7f88bc06a2f0 msgr2=0x7f88bc06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:23.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88c31c6640 1 -- 172.21.15.130:0/4053384549 shutdown_connections 2023-09-13T06:11:23.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88c31c6640 1 -- 172.21.15.130:0/4053384549 wait complete. 2023-09-13T06:11:23.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.645+0000 7f88c31c6640 1 Processor -- start 2023-09-13T06:11:23.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c31c6640 1 -- start start 2023-09-13T06:11:23.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c31c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88bc06fc70 0x7f88bc156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c31c6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88bc0b2da0 0x7f88bc0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c31c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88bc0cf0d0 0x7f88bc0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c31c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc157170 con 0x7f88bc06fc70 2023-09-13T06:11:23.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c31c6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc0caca0 con 0x7f88bc0b2da0 2023-09-13T06:11:23.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c31c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc0c9c00 con 0x7f88bc0cf0d0 2023-09-13T06:11:23.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c0f62640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88bc06fc70 0x7f88bc156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c0f62640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88bc06fc70 0x7f88bc156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59762/0 (socket says 172.21.15.130:59762) 2023-09-13T06:11:23.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c0f62640 1 -- 172.21.15.130:0/2276870795 learned_addr learned my addr 172.21.15.130:0/2276870795 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:23.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88bbfff640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88bc0b2da0 0x7f88bc0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c1763640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88bc0cf0d0 0x7f88bc0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c0f62640 1 -- 172.21.15.130:0/2276870795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88bc0cf0d0 msgr2=0x7f88bc0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c0f62640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88bc0cf0d0 0x7f88bc0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c0f62640 1 -- 172.21.15.130:0/2276870795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88bc0b2da0 msgr2=0x7f88bc0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c0f62640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88bc0b2da0 0x7f88bc0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c0f62640 1 -- 172.21.15.130:0/2276870795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4009b30 con 0x7f88bc06fc70 2023-09-13T06:11:23.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c0f62640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88bc06fc70 0x7f88bc156c30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f88b000e810 tx=0x7f88b000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:23.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88b97fa640 1 -- 172.21.15.130:0/2276870795 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b000c8d0 con 0x7f88bc06fc70 2023-09-13T06:11:23.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88b97fa640 1 -- 172.21.15.130:0/2276870795 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b000ca30 con 0x7f88bc06fc70 2023-09-13T06:11:23.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c31c6640 1 -- 172.21.15.130:0/2276870795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88bc0c9ee0 con 0x7f88bc06fc70 2023-09-13T06:11:23.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88b97fa640 1 -- 172.21.15.130:0/2276870795 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b000cdc0 con 0x7f88bc06fc70 2023-09-13T06:11:23.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.649+0000 7f88c31c6640 1 -- 172.21.15.130:0/2276870795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc0ca4a0 con 0x7f88bc06fc70 2023-09-13T06:11:23.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88b97fa640 1 -- 172.21.15.130:0/2276870795 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f88b0013410 con 0x7f88bc06fc70 2023-09-13T06:11:23.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88b97fa640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f88a0065b20 0x7f88a0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88b97fa640 1 -- 172.21.15.130:0/2276870795 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88b0082ff0 con 0x7f88bc06fc70 2023-09-13T06:11:23.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88bbfff640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f88a0065b20 0x7f88a0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88c653c000 1 Processor -- start 2023-09-13T06:11:23.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88c653c000 1 -- start start 2023-09-13T06:11:23.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88bbfff640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f88a0065b20 0x7f88a0067fe0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0cec80 tx=0x7f88a8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:23.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88c653c000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5550 0x55b09a1d5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88c653c000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1d5e70 0x55b09a1b9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88c653c000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1ba2b0 0x55b09a1ba690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88c653c000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b09a0531e0 con 0x55b09a1ba2b0 2023-09-13T06:11:23.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88c653c000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b099fe24c0 con 0x55b09a1d5e70 2023-09-13T06:11:23.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88c653c000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b099fdf9f0 con 0x55b09a1d5550 2023-09-13T06:11:23.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.653+0000 7f88c1763640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1ba2b0 0x55b09a1ba690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c1763640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1ba2b0 0x55b09a1ba690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59764/0 (socket says 172.21.15.130:59764) 2023-09-13T06:11:23.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c1763640 1 -- 172.21.15.130:0/250088690 learned_addr learned my addr 172.21.15.130:0/250088690 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:23.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88bbfff640 1 --2- 172.21.15.130:0/250088690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1d5e70 0x55b09a1b9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c0f62640 1 --2- 172.21.15.130:0/250088690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5550 0x55b09a1d5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c1763640 1 -- 172.21.15.130:0/250088690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5550 msgr2=0x55b09a1d5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c1763640 1 --2- 172.21.15.130:0/250088690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5550 0x55b09a1d5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c1763640 1 -- 172.21.15.130:0/250088690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1d5e70 msgr2=0x55b09a1b9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c1763640 1 --2- 172.21.15.130:0/250088690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1d5e70 0x55b09a1b9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c1763640 1 -- 172.21.15.130:0/250088690 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b099cd5890 con 0x55b09a1ba2b0 2023-09-13T06:11:23.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c1763640 1 --2- 172.21.15.130:0/250088690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1ba2b0 0x55b09a1ba690 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f88b401f200 tx=0x7f88b4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f7348465576f88 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:23.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88a67fc640 1 -- 172.21.15.130:0/250088690 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40b9440 con 0x55b09a1ba2b0 2023-09-13T06:11:23.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88a67fc640 1 -- 172.21.15.130:0/250088690 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40b95a0 con 0x55b09a1ba2b0 2023-09-13T06:11:23.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88a67fc640 1 -- 172.21.15.130:0/250088690 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40b9950 con 0x55b09a1ba2b0 2023-09-13T06:11:23.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 -- 172.21.15.130:0/250088690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1ba2b0 msgr2=0x55b09a1ba690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 --2- 172.21.15.130:0/250088690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1ba2b0 0x55b09a1ba690 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f88b401f200 tx=0x7f88b4004ac0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 -- 172.21.15.130:0/250088690 shutdown_connections 2023-09-13T06:11:23.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 --2- 172.21.15.130:0/250088690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1d5e70 0x55b09a1b9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 --2- 172.21.15.130:0/250088690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1ba2b0 0x55b09a1ba690 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 --2- 172.21.15.130:0/250088690 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5550 0x55b09a1d5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 -- 172.21.15.130:0/250088690 >> 172.21.15.130:0/250088690 conn(0x55b09a182c40 msgr2=0x55b09a191c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:23.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 -- 172.21.15.130:0/250088690 shutdown_connections 2023-09-13T06:11:23.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 -- 172.21.15.130:0/250088690 wait complete. 2023-09-13T06:11:23.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 -- start start 2023-09-13T06:11:23.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 Processor -- start 2023-09-13T06:11:23.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1ba2b0 0x55b09a1b9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5550 0x55b09a18f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5e70 0x55b09a18f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b099fdb2e0 con 0x55b09a1d5550 2023-09-13T06:11:23.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b099f95fe0 con 0x55b09a1ba2b0 2023-09-13T06:11:23.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b099f95c80 con 0x55b09a1d5e70 2023-09-13T06:11:23.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.657+0000 7f88c653c000 10 client.0 _ll_register_callbacks cb 0x55b09a177260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:11:23.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88bbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5550 0x55b09a18f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88bbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5550 0x55b09a18f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59780/0 (socket says 172.21.15.130:59780) 2023-09-13T06:11:23.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88bbfff640 1 -- 172.21.15.130:0/1446487314 learned_addr learned my addr 172.21.15.130:0/1446487314 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:23.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c0f62640 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1ba2b0 0x55b09a1b9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c1763640 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5e70 0x55b09a18f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88bbfff640 1 -- 172.21.15.130:0/1446487314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5e70 msgr2=0x55b09a18f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88bbfff640 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5e70 0x55b09a18f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88bbfff640 1 -- 172.21.15.130:0/1446487314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1ba2b0 msgr2=0x55b09a1b9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88bbfff640 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1ba2b0 0x55b09a1b9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88bbfff640 1 -- 172.21.15.130:0/1446487314 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc15dcc0 con 0x55b09a1d5550 2023-09-13T06:11:23.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88bbfff640 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5550 0x55b09a18f0d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f88bc13cea0 tx=0x7f88a80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1442ee429b453d28 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:23.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f889b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:11:23.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f889b7fe640 1 -- 172.21.15.130:0/1446487314 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a801c040 con 0x55b09a1d5550 2023-09-13T06:11:23.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 -- 172.21.15.130:0/1446487314 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b099f72a50 con 0x55b09a1d5550 2023-09-13T06:11:23.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f889b7fe640 1 -- 172.21.15.130:0/1446487314 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88a8003e40 con 0x55b09a1d5550 2023-09-13T06:11:23.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f889b7fe640 1 -- 172.21.15.130:0/1446487314 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88a802c440 con 0x55b09a1d5550 2023-09-13T06:11:23.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 10 client.8787 fetch_fsmap learned FSMap version 84 2023-09-13T06:11:23.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 -- 172.21.15.130:0/1446487314 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x55b099f9e210 con 0x55b09a1d5550 2023-09-13T06:11:23.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f889b7fe640 1 -- 172.21.15.130:0/1446487314 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b099f72a50 con 0x55b09a1d5550 2023-09-13T06:11:23.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f889b7fe640 1 -- 172.21.15.130:0/1446487314 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f88a8014440 con 0x55b09a1d5550 2023-09-13T06:11:23.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 10 client.8787 fetch_fsmap finished waiting for FSMap version 84 2023-09-13T06:11:23.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 10 client.8787 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T06:11:23.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 20 client.8787 populate_metadata read hostname 'smithi130' 2023-09-13T06:11:23.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.130:6836/597081287,v1:172.21.15.130:6837/597081287] conn(0x55b09a1903b0 0x55b09a1e7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 4 client.8787 mds_command: new command op to 8646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T06:11:23.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 -- 172.21.15.130:0/1446487314 --> [v2:172.21.15.130:6836/597081287,v1:172.21.15.130:6837/597081287] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b099f92820 con 0x55b09a1903b0 2023-09-13T06:11:23.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c0f62640 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.130:6836/597081287,v1:172.21.15.130:6837/597081287] conn(0x55b09a1903b0 0x55b09a1e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f889b7fe640 10 client.8787 ms_handle_connect on v2:172.21.15.130:6836/597081287 2023-09-13T06:11:23.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c0f62640 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.130:6836/597081287,v1:172.21.15.130:6837/597081287] conn(0x55b09a1903b0 0x55b09a1e7600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=546ef96331b35e78 server_cookie=5bb1eae80ca403b7 in_seq=0 out_seq=0 2023-09-13T06:11:23.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f889b7fe640 1 -- 172.21.15.130:0/1446487314 <== mds.0 v2:172.21.15.130:6836/597081287 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b099f92820 con 0x55b09a1903b0 2023-09-13T06:11:23.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f889b7fe640 10 client.8787 handle_command_reply: tid=0 2023-09-13T06:11:23.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 client.8787 shutdown 2023-09-13T06:11:23.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 -- 172.21.15.130:0/1446487314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5550 msgr2=0x55b09a18f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5550 0x55b09a18f0d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f88bc13cea0 tx=0x7f88a80046d0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 -- 172.21.15.130:0/1446487314 shutdown_connections 2023-09-13T06:11:23.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.130:6836/597081287,v1:172.21.15.130:6837/597081287] conn(0x55b09a1903b0 0x55b09a1e7600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5e70 0x55b09a18f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5550 0x55b09a18f0d0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f889b7fe640 0 client.8787 ms_handle_reset on v2:172.21.15.130:6836/597081287 2023-09-13T06:11:23.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 --2- 172.21.15.130:0/1446487314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1ba2b0 0x55b09a1b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 -- 172.21.15.130:0/1446487314 >> 172.21.15.130:0/1446487314 conn(0x55b09a182c40 msgr2=0x55b09a1bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:23.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.661+0000 7f88c653c000 1 -- 172.21.15.130:0/1446487314 shutdown_connections 2023-09-13T06:11:23.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.665+0000 7f88c653c000 1 -- 172.21.15.130:0/1446487314 wait complete. 2023-09-13T06:11:23.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.665+0000 7f88c653c000 20 client.8787 trim_cache size 0 max 16384 2023-09-13T06:11:23.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.677+0000 7f88c653c000 1 Processor -- start 2023-09-13T06:11:23.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.677+0000 7f88c653c000 1 -- start start 2023-09-13T06:11:23.687 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1ba2b0 0x55b09a18f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1d5550 0x55b09a18e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a18e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b099c96940 con 0x55b09a1d5e70 2023-09-13T06:11:23.688 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b099f9b4b0 con 0x55b09a1d5550 2023-09-13T06:11:23.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b099fd6c50 con 0x55b09a1ba2b0 2023-09-13T06:11:23.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c1763640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a18e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c1763640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a18e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59792/0 (socket says 172.21.15.130:59792) 2023-09-13T06:11:23.689 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c1763640 1 -- 172.21.15.130:0/2944391977 learned_addr learned my addr 172.21.15.130:0/2944391977 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:23.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88bbfff640 1 --2- 172.21.15.130:0/2944391977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1d5550 0x55b09a18e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c0f62640 1 --2- 172.21.15.130:0/2944391977 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1ba2b0 0x55b09a18f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c1763640 1 -- 172.21.15.130:0/2944391977 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1ba2b0 msgr2=0x55b09a18f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c1763640 1 --2- 172.21.15.130:0/2944391977 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1ba2b0 0x55b09a18f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.690 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c1763640 1 -- 172.21.15.130:0/2944391977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1d5550 msgr2=0x55b09a18e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c1763640 1 --2- 172.21.15.130:0/2944391977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1d5550 0x55b09a18e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c1763640 1 -- 172.21.15.130:0/2944391977 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b099f844a0 con 0x55b09a1d5e70 2023-09-13T06:11:23.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c0f62640 1 --2- 172.21.15.130:0/2944391977 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1ba2b0 0x55b09a18f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:11:23.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c1763640 1 --2- 172.21.15.130:0/2944391977 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a18e5c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f88b409bab0 tx=0x7f88b4009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34566b3dd9dc72e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:23.691 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88a6ffd640 1 -- 172.21.15.130:0/2944391977 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40c8040 con 0x55b09a1d5e70 2023-09-13T06:11:23.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88a6ffd640 1 -- 172.21.15.130:0/2944391977 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40039a0 con 0x55b09a1d5e70 2023-09-13T06:11:23.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88a6ffd640 1 -- 172.21.15.130:0/2944391977 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4003d10 con 0x55b09a1d5e70 2023-09-13T06:11:23.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 -- 172.21.15.130:0/2944391977 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 msgr2=0x55b09a18e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 --2- 172.21.15.130:0/2944391977 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a18e5c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f88b409bab0 tx=0x7f88b4009810 comp rx=0 tx=0).stop 2023-09-13T06:11:23.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 -- 172.21.15.130:0/2944391977 shutdown_connections 2023-09-13T06:11:23.692 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 --2- 172.21.15.130:0/2944391977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1d5550 0x55b09a18e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 --2- 172.21.15.130:0/2944391977 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a18e5c0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 --2- 172.21.15.130:0/2944391977 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1ba2b0 0x55b09a18f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 -- 172.21.15.130:0/2944391977 >> 172.21.15.130:0/2944391977 conn(0x55b09a182c40 msgr2=0x55b09a1e2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:23.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 -- 172.21.15.130:0/2944391977 shutdown_connections 2023-09-13T06:11:23.693 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 -- 172.21.15.130:0/2944391977 wait complete. 2023-09-13T06:11:23.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 -- start start 2023-09-13T06:11:23.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.681+0000 7f88c653c000 1 Processor -- start 2023-09-13T06:11:23.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1ba2b0 0x55b09a233bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5550 0x55b09a234110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a1e7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b099f78d90 con 0x55b09a1d5e70 2023-09-13T06:11:23.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b099fa2f00 con 0x55b09a1ba2b0 2023-09-13T06:11:23.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b099fa8820 con 0x55b09a1d5550 2023-09-13T06:11:23.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 10 client.0 _ll_register_callbacks cb 0x55b099f91ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:11:23.695 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c1763640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a1e7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c1763640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a1e7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59798/0 (socket says 172.21.15.130:59798) 2023-09-13T06:11:23.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c1763640 1 -- 172.21.15.130:0/869115176 learned_addr learned my addr 172.21.15.130:0/869115176 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:23.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c0f62640 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1ba2b0 0x55b09a233bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88bbfff640 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5550 0x55b09a234110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c1763640 1 -- 172.21.15.130:0/869115176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5550 msgr2=0x55b09a234110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c1763640 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5550 0x55b09a234110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c1763640 1 -- 172.21.15.130:0/869115176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1ba2b0 msgr2=0x55b09a233bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c1763640 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1ba2b0 0x55b09a233bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c1763640 1 -- 172.21.15.130:0/869115176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b099cd5890 con 0x55b09a1d5e70 2023-09-13T06:11:23.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c1763640 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a1e7eb0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f88b40bc040 tx=0x7f88b401da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f466563b03b8eae2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:23.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f889b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:11:23.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f889b7fe640 1 -- 172.21.15.130:0/869115176 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40db070 con 0x55b09a1d5e70 2023-09-13T06:11:23.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f889b7fe640 1 -- 172.21.15.130:0/869115176 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88b4009150 con 0x55b09a1d5e70 2023-09-13T06:11:23.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 -- 172.21.15.130:0/869115176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b09a18d2f0 con 0x55b09a1d5e70 2023-09-13T06:11:23.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f889b7fe640 1 -- 172.21.15.130:0/869115176 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88b40cd480 con 0x55b09a1d5e70 2023-09-13T06:11:23.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 10 client.8793 fetch_fsmap learned FSMap version 84 2023-09-13T06:11:23.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 -- 172.21.15.130:0/869115176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x55b099cd5cc0 con 0x55b09a1d5e70 2023-09-13T06:11:23.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f889b7fe640 1 -- 172.21.15.130:0/869115176 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b09a18d2f0 con 0x55b09a1d5e70 2023-09-13T06:11:23.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f889b7fe640 1 -- 172.21.15.130:0/869115176 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f88b40cd5e0 con 0x55b09a1d5e70 2023-09-13T06:11:23.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 10 client.8793 fetch_fsmap finished waiting for FSMap version 84 2023-09-13T06:11:23.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 10 client.8793 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T06:11:23.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 20 client.8793 populate_metadata read hostname 'smithi130' 2023-09-13T06:11:23.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.130:6836/597081287,v1:172.21.15.130:6837/597081287] conn(0x55b09a1e8840 0x55b09a1e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 4 client.8793 mds_command: new command op to 8646 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T06:11:23.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 -- 172.21.15.130:0/869115176 --> [v2:172.21.15.130:6836/597081287,v1:172.21.15.130:6837/597081287] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b099f96900 con 0x55b09a1e8840 2023-09-13T06:11:23.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c0f62640 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.130:6836/597081287,v1:172.21.15.130:6837/597081287] conn(0x55b09a1e8840 0x55b09a1e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c0f62640 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.130:6836/597081287,v1:172.21.15.130:6837/597081287] conn(0x55b09a1e8840 0x55b09a1e8c20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56fd28e4311c1f61 server_cookie=f6345cb2f696336c in_seq=0 out_seq=0 2023-09-13T06:11:23.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f889b7fe640 10 client.8793 ms_handle_connect on v2:172.21.15.130:6836/597081287 2023-09-13T06:11:23.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f889b7fe640 1 -- 172.21.15.130:0/869115176 <== mds.0 v2:172.21.15.130:6836/597081287 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b099f96900 con 0x55b09a1e8840 2023-09-13T06:11:23.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f889b7fe640 10 client.8793 handle_command_reply: tid=0 2023-09-13T06:11:23.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 client.8793 shutdown 2023-09-13T06:11:23.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 -- 172.21.15.130:0/869115176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 msgr2=0x55b09a1e7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a1e7eb0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f88b40bc040 tx=0x7f88b401da00 comp rx=0 tx=0).stop 2023-09-13T06:11:23.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 -- 172.21.15.130:0/869115176 shutdown_connections 2023-09-13T06:11:23.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.130:6836/597081287,v1:172.21.15.130:6837/597081287] conn(0x55b09a1e8840 0x55b09a1e8c20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b09a1d5e70 0x55b09a1e7eb0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55b09a1d5550 0x55b09a234110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 --2- 172.21.15.130:0/869115176 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b09a1ba2b0 0x55b09a233bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f889b7fe640 0 client.8793 ms_handle_reset on v2:172.21.15.130:6836/597081287 2023-09-13T06:11:23.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 -- 172.21.15.130:0/869115176 >> 172.21.15.130:0/869115176 conn(0x55b09a182c40 msgr2=0x55b09a1b8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:23.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 -- 172.21.15.130:0/869115176 shutdown_connections 2023-09-13T06:11:23.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 1 -- 172.21.15.130:0/869115176 wait complete. 2023-09-13T06:11:23.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c653c000 20 client.8793 trim_cache size 0 max 16384 2023-09-13T06:11:23.704 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:11:23.705 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:11:23.705 INFO:teuthology.orchestra.run.smithi130.stdout: "whoami": 0, 2023-09-13T06:11:23.705 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 8646, 2023-09-13T06:11:23.705 INFO:teuthology.orchestra.run.smithi130.stdout: "want_state": "up:active", 2023-09-13T06:11:23.705 INFO:teuthology.orchestra.run.smithi130.stdout: "state": "up:active", 2023-09-13T06:11:23.706 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs", 2023-09-13T06:11:23.706 INFO:teuthology.orchestra.run.smithi130.stdout: "rank_uptime": 5.9688059290000002, 2023-09-13T06:11:23.706 INFO:teuthology.orchestra.run.smithi130.stdout: "mdsmap_epoch": 84, 2023-09-13T06:11:23.706 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch": 171, 2023-09-13T06:11:23.706 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch_barrier": 171, 2023-09-13T06:11:23.706 INFO:teuthology.orchestra.run.smithi130.stdout: "uptime": 11.942221929 2023-09-13T06:11:23.707 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:11:23.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c31c6640 1 -- 172.21.15.130:0/2276870795 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f88a0065b20 msgr2=0x7f88a0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c31c6640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f88a0065b20 0x7f88a0067fe0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0cec80 tx=0x7f88a8009190 comp rx=0 tx=0).stop 2023-09-13T06:11:23.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c31c6640 1 -- 172.21.15.130:0/2276870795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88bc06fc70 msgr2=0x7f88bc156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.685+0000 7f88c31c6640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88bc06fc70 0x7f88bc156c30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f88b000e810 tx=0x7f88b000ecd0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.689+0000 7f88c31c6640 1 -- 172.21.15.130:0/2276870795 shutdown_connections 2023-09-13T06:11:23.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.689+0000 7f88c31c6640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f88a0065b20 0x7f88a0067fe0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.689+0000 7f88c31c6640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88bc0b2da0 0x7f88bc0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.689+0000 7f88c31c6640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88bc0cf0d0 0x7f88bc0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.689+0000 7f88c31c6640 1 --2- 172.21.15.130:0/2276870795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88bc06fc70 0x7f88bc156c30 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.689+0000 7f88c31c6640 1 -- 172.21.15.130:0/2276870795 >> 172.21.15.130:0/2276870795 conn(0x7f88bc06a2f0 msgr2=0x7f88bc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:23.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.689+0000 7f88c31c6640 1 -- 172.21.15.130:0/2276870795 shutdown_connections 2023-09-13T06:11:23.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.689+0000 7f88c31c6640 1 -- 172.21.15.130:0/2276870795 wait complete. 2023-09-13T06:11:23.711 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:11:23.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f2499f4d640 1 Processor -- start 2023-09-13T06:11:23.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f2499f4d640 1 -- start start 2023-09-13T06:11:23.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f2499f4d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2494159f20 0x7f24940ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f2499f4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24940cdfc0 0x7f24940b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f2499f4d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24940ccfd0 con 0x7f24940b1610 2023-09-13T06:11:23.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f2499f4d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24940b00f0 con 0x7f2494159f20 2023-09-13T06:11:23.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f2499f4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24940ce420 con 0x7f24940cdfc0 2023-09-13T06:11:23.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f24937fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2494159f20 0x7f24940ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f24937fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2494159f20 0x7f24940ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59814/0 (socket says 172.21.15.130:59814) 2023-09-13T06:11:23.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f24937fe640 1 -- 172.21.15.130:0/2141432389 learned_addr learned my addr 172.21.15.130:0/2141432389 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:23.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f2492ffd640 1 --2- 172.21.15.130:0/2141432389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24940cdfc0 0x7f24940b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f24937fe640 1 -- 172.21.15.130:0/2141432389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24940cdfc0 msgr2=0x7f24940b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f24937fe640 1 --2- 172.21.15.130:0/2141432389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24940cdfc0 0x7f24940b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f24937fe640 1 -- 172.21.15.130:0/2141432389 >> v1:172.21.15.164:6789/0 conn(0x7f24940b1610 legacy=0x7f24940ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:23.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f24937fe640 1 -- 172.21.15.130:0/2141432389 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940ced90 con 0x7f2494159f20 2023-09-13T06:11:23.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.849+0000 7f2492ffd640 1 --2- 172.21.15.130:0/2141432389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24940cdfc0 0x7f24940b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:11:23.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f24937fe640 1 --2- 172.21.15.130:0/2141432389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2494159f20 0x7f24940ce7b0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f2484009870 tx=0x7f248401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe56e117fa724b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:23.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f24927fc640 1 -- 172.21.15.130:0/2141432389 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24840ac410 con 0x7f2494159f20 2023-09-13T06:11:23.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f24927fc640 1 -- 172.21.15.130:0/2141432389 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24840ac570 con 0x7f2494159f20 2023-09-13T06:11:23.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f24927fc640 1 -- 172.21.15.130:0/2141432389 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24840ac900 con 0x7f2494159f20 2023-09-13T06:11:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f2499f4d640 1 -- 172.21.15.130:0/2141432389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2494159f20 msgr2=0x7f24940ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f2499f4d640 1 --2- 172.21.15.130:0/2141432389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2494159f20 0x7f24940ce7b0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f2484009870 tx=0x7f248401c500 comp rx=0 tx=0).stop 2023-09-13T06:11:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f2499f4d640 1 -- 172.21.15.130:0/2141432389 shutdown_connections 2023-09-13T06:11:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f2499f4d640 1 --2- 172.21.15.130:0/2141432389 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24940cdfc0 0x7f24940b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f2499f4d640 1 --2- 172.21.15.130:0/2141432389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2494159f20 0x7f24940ce7b0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f2499f4d640 1 -- 172.21.15.130:0/2141432389 >> 172.21.15.130:0/2141432389 conn(0x7f2494065990 msgr2=0x7f2494065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:23.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f2499f4d640 1 -- 172.21.15.130:0/2141432389 shutdown_connections 2023-09-13T06:11:23.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.853+0000 7f2499f4d640 1 -- 172.21.15.130:0/2141432389 wait complete. 2023-09-13T06:11:23.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2499f4d640 1 Processor -- start 2023-09-13T06:11:23.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2499f4d640 1 -- start start 2023-09-13T06:11:23.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2499f4d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24940b1610 0x7f249414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2499f4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24940cdfc0 0x7f249406ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2499f4d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2494159f20 0x7f249406cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2499f4d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2494155b00 con 0x7f2494159f20 2023-09-13T06:11:23.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2499f4d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24941f5c60 con 0x7f24940b1610 2023-09-13T06:11:23.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2499f4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2494154f80 con 0x7f24940cdfc0 2023-09-13T06:11:23.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2493fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2494159f20 0x7f249406cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2493fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2494159f20 0x7f249406cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59824/0 (socket says 172.21.15.130:59824) 2023-09-13T06:11:23.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2493fff640 1 -- 172.21.15.130:0/4160891705 learned_addr learned my addr 172.21.15.130:0/4160891705 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:23.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f24937fe640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24940b1610 0x7f249414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2492ffd640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24940cdfc0 0x7f249406ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2493fff640 1 -- 172.21.15.130:0/4160891705 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24940cdfc0 msgr2=0x7f249406ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2493fff640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24940cdfc0 0x7f249406ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2493fff640 1 -- 172.21.15.130:0/4160891705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24940b1610 msgr2=0x7f249414ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:23.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2493fff640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24940b1610 0x7f249414ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:23.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2493fff640 1 -- 172.21.15.130:0/4160891705 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24840094d0 con 0x7f2494159f20 2023-09-13T06:11:23.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2493fff640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2494159f20 0x7f249406cfb0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f248c00c780 tx=0x7f248c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:23.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f247bfff640 1 -- 172.21.15.130:0/4160891705 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c004b20 con 0x7f2494159f20 2023-09-13T06:11:23.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f247bfff640 1 -- 172.21.15.130:0/4160891705 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c004c80 con 0x7f2494159f20 2023-09-13T06:11:23.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f247bfff640 1 -- 172.21.15.130:0/4160891705 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00aa90 con 0x7f2494159f20 2023-09-13T06:11:23.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.857+0000 7f2499f4d640 1 -- 172.21.15.130:0/4160891705 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2494155260 con 0x7f2494159f20 2023-09-13T06:11:23.864 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.861+0000 7f2499f4d640 1 -- 172.21.15.130:0/4160891705 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2494155820 con 0x7f2494159f20 2023-09-13T06:11:23.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.861+0000 7f2499f4d640 1 -- 172.21.15.130:0/4160891705 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24941f5e20 con 0x7f2494159f20 2023-09-13T06:11:23.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.861+0000 7f247bfff640 1 -- 172.21.15.130:0/4160891705 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f248c00abf0 con 0x7f2494159f20 2023-09-13T06:11:23.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.861+0000 7f247bfff640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2480065b20 0x7f2480067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:23.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.861+0000 7f247bfff640 1 -- 172.21.15.130:0/4160891705 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f248c083420 con 0x7f2494159f20 2023-09-13T06:11:23.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.861+0000 7f24937fe640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2480065b20 0x7f2480067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:23.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.861+0000 7f24937fe640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2480065b20 0x7f2480067fe0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f24840ae000 tx=0x7f2484009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:23.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:23.865+0000 7f247bfff640 1 -- 172.21.15.130:0/4160891705 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f248c050cf0 con 0x7f2494159f20 2023-09-13T06:11:24.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 -- 172.21.15.130:0/4160891705 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f24940cd7c0 con 0x7f2494159f20 2023-09-13T06:11:24.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f247bfff640 1 -- 172.21.15.130:0/4160891705 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7f248c054310 con 0x7f2494159f20 2023-09-13T06:11:24.049 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:11:24.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 -- 172.21.15.130:0/4160891705 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2480065b20 msgr2=0x7f2480067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:24.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2480065b20 0x7f2480067fe0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f24840ae000 tx=0x7f2484009040 comp rx=0 tx=0).stop 2023-09-13T06:11:24.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 -- 172.21.15.130:0/4160891705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2494159f20 msgr2=0x7f249406cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:24.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2494159f20 0x7f249406cfb0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f248c00c780 tx=0x7f248c00cc40 comp rx=0 tx=0).stop 2023-09-13T06:11:24.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 -- 172.21.15.130:0/4160891705 shutdown_connections 2023-09-13T06:11:24.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2480065b20 0x7f2480067fe0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:24.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2494159f20 0x7f249406cfb0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:24.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24940cdfc0 0x7f249406ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 --2- 172.21.15.130:0/4160891705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24940b1610 0x7f249414ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 -- 172.21.15.130:0/4160891705 >> 172.21.15.130:0/4160891705 conn(0x7f2494065990 msgr2=0x7f2494159240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 -- 172.21.15.130:0/4160891705 shutdown_connections 2023-09-13T06:11:24.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.049+0000 7f2499f4d640 1 -- 172.21.15.130:0/4160891705 wait complete. 2023-09-13T06:11:24.069 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:11:24.070 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:11:24.070 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:11:24.071 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T06:11:24.071 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:11:24.071 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:11:24.072 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:11:24.072 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:11:24.072 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:11:24.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:24.073 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:11:24.083 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:11:24.083 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:11:24.083 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:11:24.084 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:24.084 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:11:24.084 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:24.084 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:11:24.084 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:24.085 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:11:24.085 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:11:24.085 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:24.085 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:11:24.085 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:11:24.086 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:24.086 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:11:24.086 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:24.086 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:11:24.086 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 41823sec preferred_lft 41823sec 2023-09-13T06:11:24.087 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:11:24.087 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:24.087 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:11:24.087 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:24.088 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:11:24.088 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:24.088 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:11:24.088 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:24.088 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:11:24.089 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:24.089 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:11:24.089 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:24.089 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:11:24.089 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:11:24.090 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:11:24.090 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:24.090 INFO:teuthology.orchestra.run.smithi130.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:11:24.090 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:11:24.090 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:11:24.091 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:24.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:24.091 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:11:24.146 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:11:24.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:24.148 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:11:24.212 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:11:24.212 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:11:24.212 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:11:24.212 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:11:24.212 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:11:24.213 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:11:24.213 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:11:24.213 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:11:24.213 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:11:24.213 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:11:24.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:24.214 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:11:24.215 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:11:24.215 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:11:24.215 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:11:24.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:11:24.216 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:11:24.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:24.308 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:11:24.317 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T06:11:24.317 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:11:24.318 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:11:24.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:24.319 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-09-13T06:11:24.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:11:24.384 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T06:11:24.437 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:11:24.437 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:11:24.438 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:11:24.491 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:11:24.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:24.492 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:11:24.589 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:11:24.589 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:11:24.589 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:11:24.604 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:11:24.604 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:11:24.604 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:11:24.605 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:11:24.605 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:11:24.612 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:11:24.612 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:11:24.612 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:11:24.612 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:11:24.613 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:11:24.613 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:11:24.613 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:11:24.613 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:11:24.615 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:11:24.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:24.616 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:11:24.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:24.638 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:11:24.700 INFO:teuthology.orchestra.run.smithi130.stdout:client8050 2023-09-13T06:11:24.700 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:11:24.701 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:11:24.751 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:11:24.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aad9fa640 1 Processor -- start 2023-09-13T06:11:24.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aad9fa640 1 -- start start 2023-09-13T06:11:24.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aad9fa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6aa80d1090 0x7f6aa815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:24.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aad9fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6aa8146f30 0x7f6aa80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:24.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aad9fa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa80b63c0 con 0x7f6aa80d1750 2023-09-13T06:11:24.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aad9fa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa815dea0 con 0x7f6aa80d1090 2023-09-13T06:11:24.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aad9fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa80d0c20 con 0x7f6aa8146f30 2023-09-13T06:11:24.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aa6ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6aa80d1750 0x7f6aa8146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59900/0 (socket says 172.21.15.130:59900) 2023-09-13T06:11:24.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aa6ffd640 1 -- 172.21.15.130:0/2615084449 learned_addr learned my addr 172.21.15.130:0/2615084449 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:24.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6a9e7fc640 1 --2- 172.21.15.130:0/2615084449 >> v2:172.21.15.130:3300/0 conn(0x7f6aa80d1090 0x7f6aa815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:24.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aa77fe640 1 --2- 172.21.15.130:0/2615084449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6aa8146f30 0x7f6aa80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:24.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aa67fc640 1 -- 172.21.15.130:0/2615084449 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661317202 0 0) 0x7f6aa80b63c0 con 0x7f6aa80d1750 2023-09-13T06:11:24.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.933+0000 7f6aa67fc640 1 -- 172.21.15.130:0/2615084449 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a94003530 con 0x7f6aa80d1750 2023-09-13T06:11:24.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6a9e7fc640 1 -- 172.21.15.130:0/2615084449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6aa8146f30 msgr2=0x7f6aa80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:24.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6a9e7fc640 1 --2- 172.21.15.130:0/2615084449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6aa8146f30 0x7f6aa80b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:24.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6a9e7fc640 1 -- 172.21.15.130:0/2615084449 >> v1:172.21.15.130:6789/0 conn(0x7f6aa80d1750 legacy=0x7f6aa8146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:24.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6a9e7fc640 1 -- 172.21.15.130:0/2615084449 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa80b6610 con 0x7f6aa80d1090 2023-09-13T06:11:24.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6a9e7fc640 1 --2- 172.21.15.130:0/2615084449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6aa80d1090 0x7f6aa815d960 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009d90 tx=0x7f6a9001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4982eef542828e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:24.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6aa67fc640 1 -- 172.21.15.130:0/2615084449 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a900a59e0 con 0x7f6aa80d1090 2023-09-13T06:11:24.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6aa67fc640 1 -- 172.21.15.130:0/2615084449 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a900a5b40 con 0x7f6aa80d1090 2023-09-13T06:11:24.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6aa67fc640 1 -- 172.21.15.130:0/2615084449 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a900ad440 con 0x7f6aa80d1090 2023-09-13T06:11:24.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2615084449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6aa80d1090 msgr2=0x7f6aa815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:24.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6aad9fa640 1 --2- 172.21.15.130:0/2615084449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6aa80d1090 0x7f6aa815d960 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009d90 tx=0x7f6a9001c920 comp rx=0 tx=0).stop 2023-09-13T06:11:24.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2615084449 shutdown_connections 2023-09-13T06:11:24.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6aad9fa640 1 --2- 172.21.15.130:0/2615084449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6aa8146f30 0x7f6aa80b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:24.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6aad9fa640 1 --2- 172.21.15.130:0/2615084449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6aa80d1090 0x7f6aa815d960 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:24.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2615084449 >> 172.21.15.130:0/2615084449 conn(0x7f6aa806f170 msgr2=0x7f6aa806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:24.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2615084449 shutdown_connections 2023-09-13T06:11:24.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.937+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2615084449 wait complete. 2023-09-13T06:11:24.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aad9fa640 1 Processor -- start 2023-09-13T06:11:24.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aad9fa640 1 -- start start 2023-09-13T06:11:24.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aad9fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6aa80d1090 0x7f6aa8142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:24.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aad9fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6aa80d1750 0x7f6aa8140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:24.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aad9fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6aa8146f30 0x7f6aa815c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:24.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aad9fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8141510 con 0x7f6aa8146f30 2023-09-13T06:11:24.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aad9fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8165100 con 0x7f6aa80d1090 2023-09-13T06:11:24.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aad9fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8164060 con 0x7f6aa80d1750 2023-09-13T06:11:24.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6aa8146f30 0x7f6aa815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:24.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6aa8146f30 0x7f6aa815c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59838/0 (socket says 172.21.15.130:59838) 2023-09-13T06:11:24.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa77fe640 1 -- 172.21.15.130:0/2882368435 learned_addr learned my addr 172.21.15.130:0/2882368435 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:24.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa6ffd640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6aa80d1090 0x7f6aa8142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:24.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa77fe640 1 -- 172.21.15.130:0/2882368435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6aa80d1750 msgr2=0x7f6aa8140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:24.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6a9e7fc640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6aa80d1750 0x7f6aa8140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:24.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa77fe640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6aa80d1750 0x7f6aa8140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:24.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa77fe640 1 -- 172.21.15.130:0/2882368435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6aa80d1090 msgr2=0x7f6aa8142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:24.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa77fe640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6aa80d1090 0x7f6aa8142030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:24.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa77fe640 1 -- 172.21.15.130:0/2882368435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a90009a70 con 0x7f6aa8146f30 2023-09-13T06:11:24.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6a9e7fc640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6aa80d1750 0x7f6aa8140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:11:24.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa6ffd640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6aa80d1090 0x7f6aa8142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:11:24.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa77fe640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6aa8146f30 0x7f6aa815c2f0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000e7f0 tx=0x7f6aa000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:24.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa4ff9640 1 -- 172.21.15.130:0/2882368435 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0009530 con 0x7f6aa8146f30 2023-09-13T06:11:24.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa4ff9640 1 -- 172.21.15.130:0/2882368435 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa000eea0 con 0x7f6aa8146f30 2023-09-13T06:11:24.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2882368435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa80b7e40 con 0x7f6aa8146f30 2023-09-13T06:11:24.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.941+0000 7f6aa4ff9640 1 -- 172.21.15.130:0/2882368435 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa000cb60 con 0x7f6aa8146f30 2023-09-13T06:11:24.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.945+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2882368435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa8164620 con 0x7f6aa8146f30 2023-09-13T06:11:24.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.945+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2882368435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa80618a0 con 0x7f6aa8146f30 2023-09-13T06:11:24.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.945+0000 7f6aa4ff9640 1 -- 172.21.15.130:0/2882368435 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6aa000ccc0 con 0x7f6aa8146f30 2023-09-13T06:11:24.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.945+0000 7f6aa4ff9640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a88065b20 0x7f6a88067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:24.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.945+0000 7f6aa4ff9640 1 -- 172.21.15.130:0/2882368435 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6aa0083510 con 0x7f6aa8146f30 2023-09-13T06:11:24.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.945+0000 7f6aa6ffd640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a88065b20 0x7f6a88067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:24.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.945+0000 7f6aa6ffd640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a88065b20 0x7f6a88067fe0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6a980011f0 tx=0x7f6a98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:24.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:24.949+0000 7f6aa4ff9640 1 -- 172.21.15.130:0/2882368435 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6aa0050d30 con 0x7f6aa8146f30 2023-09-13T06:11:25.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.125+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2882368435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6aa80b86c0 con 0x7f6aa8146f30 2023-09-13T06:11:25.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aa4ff9640 1 -- 172.21.15.130:0/2882368435 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6aa0054350 con 0x7f6aa8146f30 2023-09-13T06:11:25.128 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:11:25.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2882368435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a88065b20 msgr2=0x7f6a88067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:25.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a88065b20 0x7f6a88067fe0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6a980011f0 tx=0x7f6a98009040 comp rx=0 tx=0).stop 2023-09-13T06:11:25.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2882368435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6aa8146f30 msgr2=0x7f6aa815c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:25.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6aa8146f30 0x7f6aa815c2f0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000e7f0 tx=0x7f6aa000ecb0 comp rx=0 tx=0).stop 2023-09-13T06:11:25.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2882368435 shutdown_connections 2023-09-13T06:11:25.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6a88065b20 0x7f6a88067fe0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:25.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6aa8146f30 0x7f6aa815c2f0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:25.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6aa80d1750 0x7f6aa8140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:25.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 --2- 172.21.15.130:0/2882368435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6aa80d1090 0x7f6aa8142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:25.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2882368435 >> 172.21.15.130:0/2882368435 conn(0x7f6aa806f170 msgr2=0x7f6aa8145c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:25.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2882368435 shutdown_connections 2023-09-13T06:11:25.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:25.129+0000 7f6aad9fa640 1 -- 172.21.15.130:0/2882368435 wait complete. 2023-09-13T06:11:25.151 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:11:25.152 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:11:25.153 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:11:25.153 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T06:11:25.155 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:11:25.156 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:11:25.157 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:11:25.157 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:11:25.157 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:11:25.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:25.159 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:11:25.177 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:11:25.178 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:11:25.178 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:11:25.178 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:25.179 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:11:25.179 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:25.179 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:11:25.179 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:25.180 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:11:25.180 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:11:25.180 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:25.180 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:11:25.180 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:11:25.181 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:25.181 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:11:25.181 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:25.182 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:11:25.182 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 41839sec preferred_lft 41839sec 2023-09-13T06:11:25.182 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:11:25.183 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:25.183 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:11:25.183 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:25.184 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:11:25.184 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:25.184 INFO:teuthology.orchestra.run.smithi164.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:11:25.184 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:11:25.185 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:11:25.185 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:25.185 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:11:25.185 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:25.185 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:11:25.186 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:11:25.186 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:11:25.186 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:25.186 INFO:teuthology.orchestra.run.smithi164.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:11:25.187 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:11:25.187 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:11:25.188 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:11:25.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:25.189 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:11:25.250 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:11:25.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:25.254 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:11:25.311 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:11:25.311 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:11:25.312 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:11:25.312 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:11:25.312 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:11:25.312 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:11:25.313 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:11:25.313 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:11:25.313 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:11:25.313 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:11:25.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:25.315 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:11:25.316 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:11:25.316 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:11:25.317 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:11:25.318 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:11:25.318 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:11:25.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:25.416 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:11:25.432 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-13T06:11:25.432 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:11:25.432 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:11:25.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:25.433 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-09-13T06:11:25.502 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:11:25.503 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T06:11:25.566 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:11:25.567 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:11:25.567 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:11:25.624 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:11:25.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:25.625 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:11:25.724 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:11:25.724 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:11:25.724 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:11:25.739 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:11:25.739 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:11:25.739 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:11:25.739 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:11:25.740 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:11:25.746 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:11:25.746 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:11:25.747 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:11:25.747 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:11:25.747 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:11:25.747 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:11:25.747 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:11:25.748 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:11:25.750 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:11:25.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:25.751 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:11:25.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:11:25.776 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:11:25.837 INFO:teuthology.orchestra.run.smithi164.stdout:client8053 2023-09-13T06:11:25.837 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:11:25.838 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:11:25.895 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:11:26.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.041+0000 7f22dbd67640 1 Processor -- start 2023-09-13T06:11:26.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22dbd67640 1 -- start start 2023-09-13T06:11:26.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22dbd67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d40d0d10 0x7f22d40b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:26.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22dbd67640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f22d406d6e0 0x7f22d406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:26.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22dbd67640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d40b6230 con 0x7f22d4144c20 2023-09-13T06:11:26.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22dbd67640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d406e0b0 con 0x7f22d406d6e0 2023-09-13T06:11:26.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22dbd67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4145000 con 0x7f22d40d0d10 2023-09-13T06:11:26.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22da304640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f22d406d6e0 0x7f22d406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:26.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22da304640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f22d406d6e0 0x7f22d406db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59844/0 (socket says 172.21.15.130:59844) 2023-09-13T06:11:26.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22da304640 1 -- 172.21.15.130:0/3838746793 learned_addr learned my addr 172.21.15.130:0/3838746793 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:26.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22d9302640 1 --2- 172.21.15.130:0/3838746793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d40d0d10 0x7f22d40b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:26.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22da304640 1 -- 172.21.15.130:0/3838746793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d40d0d10 msgr2=0x7f22d40b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:11:26.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22da304640 1 --2- 172.21.15.130:0/3838746793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d40d0d10 0x7f22d40b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22da304640 1 -- 172.21.15.130:0/3838746793 >> v1:172.21.15.130:6789/0 conn(0x7f22d4144c20 legacy=0x7f22d40b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:26.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.045+0000 7f22da304640 1 -- 172.21.15.130:0/3838746793 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d40b5620 con 0x7f22d406d6e0 2023-09-13T06:11:26.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22da304640 1 --2- 172.21.15.130:0/3838746793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d406d6e0 0x7f22d406db70 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009e50 tx=0x7f22cc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402148ce91e1ff92 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:26.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22d8b01640 1 -- 172.21.15.130:0/3838746793 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0a57d0 con 0x7f22d406d6e0 2023-09-13T06:11:26.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22d8b01640 1 -- 172.21.15.130:0/3838746793 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc0a5930 con 0x7f22d406d6e0 2023-09-13T06:11:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22d8b01640 1 -- 172.21.15.130:0/3838746793 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0a5cc0 con 0x7f22d406d6e0 2023-09-13T06:11:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22dbd67640 1 -- 172.21.15.130:0/3838746793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d406d6e0 msgr2=0x7f22d406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22dbd67640 1 --2- 172.21.15.130:0/3838746793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d406d6e0 0x7f22d406db70 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009e50 tx=0x7f22cc01ca10 comp rx=0 tx=0).stop 2023-09-13T06:11:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22dbd67640 1 -- 172.21.15.130:0/3838746793 shutdown_connections 2023-09-13T06:11:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22dbd67640 1 --2- 172.21.15.130:0/3838746793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d406d6e0 0x7f22d406db70 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22dbd67640 1 --2- 172.21.15.130:0/3838746793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d40d0d10 0x7f22d40b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22dbd67640 1 -- 172.21.15.130:0/3838746793 >> 172.21.15.130:0/3838746793 conn(0x7f22d406a2f0 msgr2=0x7f22d406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:26.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22dbd67640 1 -- 172.21.15.130:0/3838746793 shutdown_connections 2023-09-13T06:11:26.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.049+0000 7f22dbd67640 1 -- 172.21.15.130:0/3838746793 wait complete. 2023-09-13T06:11:26.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22dbd67640 1 Processor -- start 2023-09-13T06:11:26.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22dbd67640 1 -- start start 2023-09-13T06:11:26.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22dbd67640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d406d6e0 0x7f22d40b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:26.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22dbd67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d40d0d10 0x7f22d415c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:26.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22dbd67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d4144c20 0x7f22d415a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:26.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22dbd67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40b0aa0 con 0x7f22d40d0d10 2023-09-13T06:11:26.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22dbd67640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d415c960 con 0x7f22d406d6e0 2023-09-13T06:11:26.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22dbd67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d415cb90 con 0x7f22d4144c20 2023-09-13T06:11:26.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22d9302640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d40d0d10 0x7f22d415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:26.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22d9302640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d40d0d10 0x7f22d415c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59856/0 (socket says 172.21.15.130:59856) 2023-09-13T06:11:26.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22d9302640 1 -- 172.21.15.130:0/655139173 learned_addr learned my addr 172.21.15.130:0/655139173 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:26.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22da304640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d4144c20 0x7f22d415a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:26.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22d9b03640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d406d6e0 0x7f22d40b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:26.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.061+0000 7f22d9302640 1 -- 172.21.15.130:0/655139173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d4144c20 msgr2=0x7f22d415a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:26.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22d9302640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d4144c20 0x7f22d415a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22d9302640 1 -- 172.21.15.130:0/655139173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d406d6e0 msgr2=0x7f22d40b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:26.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22d9302640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d406d6e0 0x7f22d40b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.073 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22d9302640 1 -- 172.21.15.130:0/655139173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc009b30 con 0x7f22d40d0d10 2023-09-13T06:11:26.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22d9b03640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d406d6e0 0x7f22d40b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:11:26.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22da304640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d4144c20 0x7f22d415a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:11:26.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22d9302640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d40d0d10 0x7f22d415c420 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f22c400d800 tx=0x7f22c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:26.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22ca7fc640 1 -- 172.21.15.130:0/655139173 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c400b6c0 con 0x7f22d40d0d10 2023-09-13T06:11:26.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22ca7fc640 1 -- 172.21.15.130:0/655139173 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c400b820 con 0x7f22d40d0d10 2023-09-13T06:11:26.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22dbd67640 1 -- 172.21.15.130:0/655139173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d415ce70 con 0x7f22d40d0d10 2023-09-13T06:11:26.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22ca7fc640 1 -- 172.21.15.130:0/655139173 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c400bb90 con 0x7f22d40d0d10 2023-09-13T06:11:26.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22dbd67640 1 -- 172.21.15.130:0/655139173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d415d200 con 0x7f22d40d0d10 2023-09-13T06:11:26.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22dbd67640 1 -- 172.21.15.130:0/655139173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d40b5280 con 0x7f22d40d0d10 2023-09-13T06:11:26.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22ca7fc640 1 -- 172.21.15.130:0/655139173 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f22c400bcf0 con 0x7f22d40d0d10 2023-09-13T06:11:26.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22ca7fc640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22b8065b20 0x7f22b8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:26.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22ca7fc640 1 -- 172.21.15.130:0/655139173 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22c4083950 con 0x7f22d40d0d10 2023-09-13T06:11:26.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.065+0000 7f22d9b03640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22b8065b20 0x7f22b8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:26.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.069+0000 7f22d9b03640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22b8065b20 0x7f22b8067fe0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f22d0000f70 tx=0x7f22d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:26.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.069+0000 7f22ca7fc640 1 -- 172.21.15.130:0/655139173 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f22c4051200 con 0x7f22d40d0d10 2023-09-13T06:11:26.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.249+0000 7f22dbd67640 1 -- 172.21.15.130:0/655139173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22d40618a0 con 0x7f22d40d0d10 2023-09-13T06:11:26.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.249+0000 7f22ca7fc640 1 -- 172.21.15.130:0/655139173 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f22c4054820 con 0x7f22d40d0d10 2023-09-13T06:11:26.252 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:11:26.252 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2473585305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2473585305},{"type":"v1","addr":"172.21.15.130:6835","nonce":2473585305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1139512428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1139512428},{"type":"v1","addr":"172.21.15.164:6834","nonce":1139512428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2365480398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2365480398},{"type":"v1","addr":"172.21.15.164:6835","nonce":2365480398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:11:17.067978+0000","modified":"2023-09-13T06:11:20.112082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8646":{"gid":8646,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/597081287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":597081287},{"type":"v1","addr":"172.21.15.130:6837","nonce":597081287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-09-13T06:11:26.254 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 84 2023-09-13T06:11:26.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 -- 172.21.15.130:0/655139173 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22b8065b20 msgr2=0x7f22b8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:26.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22b8065b20 0x7f22b8067fe0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f22d0000f70 tx=0x7f22d0009040 comp rx=0 tx=0).stop 2023-09-13T06:11:26.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 -- 172.21.15.130:0/655139173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d40d0d10 msgr2=0x7f22d415c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:26.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d40d0d10 0x7f22d415c420 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f22c400d800 tx=0x7f22c400dcc0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 -- 172.21.15.130:0/655139173 shutdown_connections 2023-09-13T06:11:26.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f22b8065b20 0x7f22b8067fe0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22d4144c20 0x7f22d415a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22d40d0d10 0x7f22d415c420 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 --2- 172.21.15.130:0/655139173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d406d6e0 0x7f22d40b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 -- 172.21.15.130:0/655139173 >> 172.21.15.130:0/655139173 conn(0x7f22d406a2f0 msgr2=0x7f22d41656f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:26.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 -- 172.21.15.130:0/655139173 shutdown_connections 2023-09-13T06:11:26.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.253+0000 7f22dbd67640 1 -- 172.21.15.130:0/655139173 wait complete. 2023-09-13T06:11:26.272 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-09-13T06:11:26.432 INFO:teuthology.orchestra.run.smithi130.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":8646,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.6998687609999994,"mdsmap_epoch":84,"osdmap_epoch":171,"osdmap_epoch_barrier":171,"uptime":14.673295424999999} 2023-09-13T06:11:26.433 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 8646, "mdsmap_epoch": 84, "osdmap_epoch": 171, "osdmap_epoch_barrier": 171, "rank_uptime": 8.699868761, "state": "up:active", "uptime": 14.673295425, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:11:26.433 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-09-13T06:11:26.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.577+0000 7fcc22e8a640 1 Processor -- start 2023-09-13T06:11:26.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.577+0000 7fcc22e8a640 1 -- start start 2023-09-13T06:11:26.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc22e8a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcc1c166090 0x7fcc1c168480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:26.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc22e8a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c1468a0 con 0x7fcc1c161110 2023-09-13T06:11:26.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc22e8a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c0d1b40 con 0x7fcc1c160d30 2023-09-13T06:11:26.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc22e8a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c161cd0 con 0x7fcc1c166090 2023-09-13T06:11:26.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc21687640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fcc1c161110 0x7fcc1c1615c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59916/0 (socket says 172.21.15.130:59916) 2023-09-13T06:11:26.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc21687640 1 -- 172.21.15.130:0/916093616 learned_addr learned my addr 172.21.15.130:0/916093616 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:11:26.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc22689640 1 --2- 172.21.15.130:0/916093616 >> v2:172.21.15.164:3300/0 conn(0x7fcc1c166090 0x7fcc1c168480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:26.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc20e86640 1 -- 172.21.15.130:0/916093616 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118320401 0 0) 0x7fcc1c1468a0 con 0x7fcc1c161110 2023-09-13T06:11:26.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc20e86640 1 -- 172.21.15.130:0/916093616 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc08003530 con 0x7fcc1c161110 2023-09-13T06:11:26.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc22689640 1 -- 172.21.15.130:0/916093616 >> v1:172.21.15.164:6789/0 conn(0x7fcc1c160d30 legacy=0x7fcc1c146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:26.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc22689640 1 -- 172.21.15.130:0/916093616 >> v1:172.21.15.130:6789/0 conn(0x7fcc1c161110 legacy=0x7fcc1c1615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:26.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc20e86640 1 -- 172.21.15.130:0/916093616 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2223976286 0 0) 0x7fcc08003530 con 0x7fcc1c161110 2023-09-13T06:11:26.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc22689640 1 -- 172.21.15.130:0/916093616 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0d1e20 con 0x7fcc1c166090 2023-09-13T06:11:26.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.581+0000 7fcc22689640 1 --2- 172.21.15.130:0/916093616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc1c166090 0x7fcc1c168480 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009d90 tx=0x7fcc1401c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf3a4af49b37db2a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:26.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc20e86640 1 -- 172.21.15.130:0/916093616 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c001680 con 0x7fcc1c166090 2023-09-13T06:11:26.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc20e86640 1 -- 172.21.15.130:0/916093616 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc140a64a0 con 0x7fcc1c166090 2023-09-13T06:11:26.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc20e86640 1 -- 172.21.15.130:0/916093616 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc140a6830 con 0x7fcc1c166090 2023-09-13T06:11:26.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 -- 172.21.15.130:0/916093616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc1c166090 msgr2=0x7fcc1c168480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:26.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 --2- 172.21.15.130:0/916093616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc1c166090 0x7fcc1c168480 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009d90 tx=0x7fcc1401c870 comp rx=0 tx=0).stop 2023-09-13T06:11:26.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 -- 172.21.15.130:0/916093616 shutdown_connections 2023-09-13T06:11:26.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 --2- 172.21.15.130:0/916093616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc1c166090 0x7fcc1c168480 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 -- 172.21.15.130:0/916093616 >> 172.21.15.130:0/916093616 conn(0x7fcc1c0d2f90 msgr2=0x7fcc1c0d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:26.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 -- 172.21.15.130:0/916093616 shutdown_connections 2023-09-13T06:11:26.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 -- 172.21.15.130:0/916093616 wait complete. 2023-09-13T06:11:26.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 Processor -- start 2023-09-13T06:11:26.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 -- start start 2023-09-13T06:11:26.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc1c160d30 0x7fcc1c13c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:26.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc1c161110 0x7fcc1c1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:26.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc1c166090 0x7fcc1c0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:26.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1f8fa0 con 0x7fcc1c160d30 2023-09-13T06:11:26.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1f9240 con 0x7fcc1c166090 2023-09-13T06:11:26.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc22e8a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1f9520 con 0x7fcc1c161110 2023-09-13T06:11:26.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc21e88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc1c160d30 0x7fcc1c13c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:26.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc21e88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc1c160d30 0x7fcc1c13c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:59872/0 (socket says 172.21.15.130:59872) 2023-09-13T06:11:26.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.585+0000 7fcc21e88640 1 -- 172.21.15.130:0/339000229 learned_addr learned my addr 172.21.15.130:0/339000229 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:11:26.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc22689640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc1c166090 0x7fcc1c0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:26.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc21687640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc1c161110 0x7fcc1c1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:26.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc21e88640 1 -- 172.21.15.130:0/339000229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc1c161110 msgr2=0x7fcc1c1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:26.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc21e88640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc1c161110 0x7fcc1c1570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc21e88640 1 -- 172.21.15.130:0/339000229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc1c166090 msgr2=0x7fcc1c0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:26.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc21e88640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc1c166090 0x7fcc1c0b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:26.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc21e88640 1 -- 172.21.15.130:0/339000229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc14009a70 con 0x7fcc1c160d30 2023-09-13T06:11:26.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc21e88640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc1c160d30 0x7fcc1c13c280 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800c500 tx=0x7fcc1800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:26.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc127fc640 1 -- 172.21.15.130:0/339000229 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18005220 con 0x7fcc1c160d30 2023-09-13T06:11:26.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc127fc640 1 -- 172.21.15.130:0/339000229 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc18005380 con 0x7fcc1c160d30 2023-09-13T06:11:26.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc22e8a640 1 -- 172.21.15.130:0/339000229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c1f9800 con 0x7fcc1c160d30 2023-09-13T06:11:26.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc127fc640 1 -- 172.21.15.130:0/339000229 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18007270 con 0x7fcc1c160d30 2023-09-13T06:11:26.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc22e8a640 1 -- 172.21.15.130:0/339000229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c157b60 con 0x7fcc1c160d30 2023-09-13T06:11:26.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc22e8a640 1 -- 172.21.15.130:0/339000229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c0618a0 con 0x7fcc1c160d30 2023-09-13T06:11:26.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc127fc640 1 -- 172.21.15.130:0/339000229 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcc180073d0 con 0x7fcc1c160d30 2023-09-13T06:11:26.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc127fc640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc00065b20 0x7fcc00067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:11:26.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.589+0000 7fcc127fc640 1 -- 172.21.15.130:0/339000229 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc18082a70 con 0x7fcc1c160d30 2023-09-13T06:11:26.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.593+0000 7fcc21687640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc00065b20 0x7fcc00067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:11:26.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.593+0000 7fcc21687640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc00065b20 0x7fcc00067fe0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c001ad0 tx=0x7fcc0c001a60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:11:26.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.593+0000 7fcc127fc640 1 -- 172.21.15.130:0/339000229 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcc18050480 con 0x7fcc1c160d30 2023-09-13T06:11:26.745 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:26.745+0000 7fcc22e8a640 1 -- 172.21.15.130:0/339000229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fcc1c0b5b30 con 0x7fcc1c160d30 2023-09-13T06:11:27.484 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc127fc640 1 -- 172.21.15.130:0/339000229 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v172) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcc18053aa0 con 0x7fcc1c160d30 2023-09-13T06:11:27.484 INFO:teuthology.orchestra.run.smithi130.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-09-13T06:11:27.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 -- 172.21.15.130:0/339000229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc00065b20 msgr2=0x7fcc00067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:27.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc00065b20 0x7fcc00067fe0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c001ad0 tx=0x7fcc0c001a60 comp rx=0 tx=0).stop 2023-09-13T06:11:27.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 -- 172.21.15.130:0/339000229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc1c160d30 msgr2=0x7fcc1c13c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:11:27.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc1c160d30 0x7fcc1c13c280 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800c500 tx=0x7fcc1800c9c0 comp rx=0 tx=0).stop 2023-09-13T06:11:27.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 -- 172.21.15.130:0/339000229 shutdown_connections 2023-09-13T06:11:27.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcc00065b20 0x7fcc00067fe0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:27.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc1c166090 0x7fcc1c0b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:27.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc1c161110 0x7fcc1c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:27.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 --2- 172.21.15.130:0/339000229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc1c160d30 0x7fcc1c13c280 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:11:27.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 -- 172.21.15.130:0/339000229 >> 172.21.15.130:0/339000229 conn(0x7fcc1c0d2f90 msgr2=0x7fcc1c0d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:11:27.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 -- 172.21.15.130:0/339000229 shutdown_connections 2023-09-13T06:11:27.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:11:27.485+0000 7fcc22e8a640 1 -- 172.21.15.130:0/339000229 wait complete. 2023-09-13T06:11:27.508 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-13T06:11:27.666 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_mon_report_interval":"5"} 2023-09-13T06:11:27.667 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-13T06:11:27.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-09-13T06:11:27.819 INFO:teuthology.orchestra.run.smithi130.stdout:{"mon_tick_interval":"5"} 2023-09-13T06:11:27.819 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-09-13T06:11:27.820 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-09-13T06:11:27.820 DEBUG:teuthology.orchestra.run.smithi130:> stdin-killer -- python3 -c ' 2023-09-13T06:11:27.821 DEBUG:teuthology.orchestra.run.smithi130:> import time 2023-09-13T06:11:27.821 DEBUG:teuthology.orchestra.run.smithi130:> import datetime 2023-09-13T06:11:27.822 DEBUG:teuthology.orchestra.run.smithi130:> import subprocess 2023-09-13T06:11:27.822 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-09-13T06:11:27.822 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:11:27.823 DEBUG:teuthology.orchestra.run.smithi130:> # Write some buffered data through before going full, all should be well 2023-09-13T06:11:27.823 DEBUG:teuthology.orchestra.run.smithi130:> print("writing some data through which we expect to succeed") 2023-09-13T06:11:27.823 DEBUG:teuthology.orchestra.run.smithi130:> bytes = 0 2023-09-13T06:11:27.824 DEBUG:teuthology.orchestra.run.smithi130:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-09-13T06:11:27.824 DEBUG:teuthology.orchestra.run.smithi130:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-09-13T06:11:27.824 DEBUG:teuthology.orchestra.run.smithi130:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-09-13T06:11:27.824 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(f) 2023-09-13T06:11:27.825 DEBUG:teuthology.orchestra.run.smithi130:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-09-13T06:11:27.825 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:11:27.825 DEBUG:teuthology.orchestra.run.smithi130:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-09-13T06:11:27.826 DEBUG:teuthology.orchestra.run.smithi130:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-09-13T06:11:27.826 DEBUG:teuthology.orchestra.run.smithi130:> # buffered IO, the error should always only appear from fsync and not 2023-09-13T06:11:27.826 DEBUG:teuthology.orchestra.run.smithi130:> # from write 2023-09-13T06:11:27.827 DEBUG:teuthology.orchestra.run.smithi130:> full = False 2023-09-13T06:11:27.827 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:11:27.827 DEBUG:teuthology.orchestra.run.smithi130:> for n in range(0, int(32 * 1.1)): 2023-09-13T06:11:27.828 DEBUG:teuthology.orchestra.run.smithi130:> try: 2023-09-13T06:11:27.828 DEBUG:teuthology.orchestra.run.smithi130:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-09-13T06:11:27.828 DEBUG:teuthology.orchestra.run.smithi130:> print("wrote bytes via buffered write, moving on to fsync") 2023-09-13T06:11:27.829 DEBUG:teuthology.orchestra.run.smithi130:> except OSError as e: 2023-09-13T06:11:27.829 DEBUG:teuthology.orchestra.run.smithi130:> if False: 2023-09-13T06:11:27.829 DEBUG:teuthology.orchestra.run.smithi130:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-09-13T06:11:27.830 DEBUG:teuthology.orchestra.run.smithi130:> raise 2023-09-13T06:11:27.830 DEBUG:teuthology.orchestra.run.smithi130:> else: 2023-09-13T06:11:27.830 DEBUG:teuthology.orchestra.run.smithi130:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-13T06:11:27.831 DEBUG:teuthology.orchestra.run.smithi130:> full = True 2023-09-13T06:11:27.831 DEBUG:teuthology.orchestra.run.smithi130:> break 2023-09-13T06:11:27.831 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:11:27.831 DEBUG:teuthology.orchestra.run.smithi130:> try: 2023-09-13T06:11:27.832 DEBUG:teuthology.orchestra.run.smithi130:> os.fsync(f) 2023-09-13T06:11:27.832 DEBUG:teuthology.orchestra.run.smithi130:> print("fsync'"'"'ed successfully") 2023-09-13T06:11:27.832 DEBUG:teuthology.orchestra.run.smithi130:> except OSError as e: 2023-09-13T06:11:27.833 DEBUG:teuthology.orchestra.run.smithi130:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-13T06:11:27.833 DEBUG:teuthology.orchestra.run.smithi130:> full = True 2023-09-13T06:11:27.833 DEBUG:teuthology.orchestra.run.smithi130:> break 2023-09-13T06:11:27.834 DEBUG:teuthology.orchestra.run.smithi130:> else: 2023-09-13T06:11:27.834 DEBUG:teuthology.orchestra.run.smithi130:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-09-13T06:11:27.835 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:11:27.835 DEBUG:teuthology.orchestra.run.smithi130:> if n > 32 * 0.9: 2023-09-13T06:11:27.835 DEBUG:teuthology.orchestra.run.smithi130:> # Be cautious in the last region where we expect to hit 2023-09-13T06:11:27.836 DEBUG:teuthology.orchestra.run.smithi130:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-09-13T06:11:27.836 DEBUG:teuthology.orchestra.run.smithi130:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-09-13T06:11:27.836 DEBUG:teuthology.orchestra.run.smithi130:> time.sleep(15.0) 2023-09-13T06:11:27.837 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:11:27.837 DEBUG:teuthology.orchestra.run.smithi130:> if not full: 2023-09-13T06:11:27.838 DEBUG:teuthology.orchestra.run.smithi130:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-09-13T06:11:27.838 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:11:27.838 DEBUG:teuthology.orchestra.run.smithi130:> # close() should not raise an error because we already caught it in 2023-09-13T06:11:27.839 DEBUG:teuthology.orchestra.run.smithi130:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-09-13T06:11:27.839 DEBUG:teuthology.orchestra.run.smithi130:> # since then because all IOs got cancelled on the full flag. 2023-09-13T06:11:27.840 DEBUG:teuthology.orchestra.run.smithi130:> print("calling close") 2023-09-13T06:11:27.840 DEBUG:teuthology.orchestra.run.smithi130:> os.close(f) 2023-09-13T06:11:27.840 DEBUG:teuthology.orchestra.run.smithi130:> print("close() did not raise error") 2023-09-13T06:11:27.841 DEBUG:teuthology.orchestra.run.smithi130:> 2023-09-13T06:11:27.841 DEBUG:teuthology.orchestra.run.smithi130:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-09-13T06:11:27.842 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-09-13T06:11:46.049 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:11:46.054 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:12:16.111 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:12:16.115 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:12:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:writing some data through which we expect to succeed 2023-09-13T06:12:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-09-13T06:12:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 1.00 MB 2023-09-13T06:12:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 2.00 MB 2023-09-13T06:12:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 3.00 MB 2023-09-13T06:12:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 4.00 MB 2023-09-13T06:12:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 5.00 MB 2023-09-13T06:12:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 6.00 MB 2023-09-13T06:12:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 7.00 MB 2023-09-13T06:12:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 8.00 MB 2023-09-13T06:12:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 9.00 MB 2023-09-13T06:12:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 10.00 MB 2023-09-13T06:12:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 11.00 MB 2023-09-13T06:12:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 12.00 MB 2023-09-13T06:12:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 13.00 MB 2023-09-13T06:12:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 14.00 MB 2023-09-13T06:12:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 15.00 MB 2023-09-13T06:12:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 16.00 MB 2023-09-13T06:12:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 17.00 MB 2023-09-13T06:12:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 18.00 MB 2023-09-13T06:12:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 19.00 MB 2023-09-13T06:12:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 20.00 MB 2023-09-13T06:12:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 21.00 MB 2023-09-13T06:12:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 22.00 MB 2023-09-13T06:12:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 23.00 MB 2023-09-13T06:12:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 24.00 MB 2023-09-13T06:12:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 25.00 MB 2023-09-13T06:12:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 26.00 MB 2023-09-13T06:12:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 27.00 MB 2023-09-13T06:12:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 28.00 MB 2023-09-13T06:12:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 29.00 MB 2023-09-13T06:12:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 30.00 MB 2023-09-13T06:12:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:12:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 31.00 MB 2023-09-13T06:12:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:12:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 32.00 MB 2023-09-13T06:12:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:12:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:wrote bytes via buffered write, moving on to fsync 2023-09-13T06:12:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:fsync'ed successfully 2023-09-13T06:12:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:Not full yet after 33.00 MB 2023-09-13T06:12:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-09-13T06:12:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:Reached fullness after 33.00 MB 2023-09-13T06:12:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:calling close 2023-09-13T06:12:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:close() did not raise error 2023-09-13T06:12:32.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-13T06:12:32.123 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:12:32.123 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:12:32.177 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:12:32.234 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:12:32.235 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:12:32.235 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:12:32.247 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:12:32.247 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:12:32.303 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:12:32.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed87fac640 1 Processor -- start 2023-09-13T06:12:32.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed87fac640 1 -- start start 2023-09-13T06:12:32.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed87fac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fed800d1090 0x7fed8015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:32.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed87fac640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed800b63c0 con 0x7fed80146f30 2023-09-13T06:12:32.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed87fac640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed800d0c20 con 0x7fed800d1750 2023-09-13T06:12:32.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed87fac640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8015dea0 con 0x7fed800d1090 2023-09-13T06:12:32.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed85547640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fed800d1090 0x7fed8015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:32.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed85547640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fed800d1090 0x7fed8015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48386/0 (socket says 172.21.15.130:48386) 2023-09-13T06:12:32.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed85547640 1 -- 172.21.15.130:0/1439758158 learned_addr learned my addr 172.21.15.130:0/1439758158 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:32.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed85547640 1 -- 172.21.15.130:0/1439758158 >> v1:172.21.15.164:6789/0 conn(0x7fed800d1750 legacy=0x7fed80146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:32.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed85547640 1 -- 172.21.15.130:0/1439758158 >> v1:172.21.15.130:6789/0 conn(0x7fed80146f30 legacy=0x7fed800b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:32.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed85547640 1 -- 172.21.15.130:0/1439758158 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed800b6610 con 0x7fed800d1090 2023-09-13T06:12:32.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.496+0000 7fed84d46640 1 -- 172.21.15.130:0/1439758158 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283622403 0 0) 0x7fed800b63c0 con 0x7fed80146f30 2023-09-13T06:12:32.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.500+0000 7fed85547640 1 --2- 172.21.15.130:0/1439758158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed800d1090 0x7fed8015d960 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fed70009870 tx=0x7fed7001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868484ea32547f2a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:32.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.500+0000 7fed84d46640 1 -- 172.21.15.130:0/1439758158 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700ab680 con 0x7fed800d1090 2023-09-13T06:12:32.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.500+0000 7fed84d46640 1 -- 172.21.15.130:0/1439758158 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed700ab7e0 con 0x7fed800d1090 2023-09-13T06:12:32.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.500+0000 7fed84d46640 1 -- 172.21.15.130:0/1439758158 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700abb70 con 0x7fed800d1090 2023-09-13T06:12:32.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.500+0000 7fed87fac640 1 -- 172.21.15.130:0/1439758158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed800d1090 msgr2=0x7fed8015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:32.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.500+0000 7fed87fac640 1 --2- 172.21.15.130:0/1439758158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed800d1090 0x7fed8015d960 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fed70009870 tx=0x7fed7001c480 comp rx=0 tx=0).stop 2023-09-13T06:12:32.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.500+0000 7fed87fac640 1 -- 172.21.15.130:0/1439758158 shutdown_connections 2023-09-13T06:12:32.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.500+0000 7fed87fac640 1 --2- 172.21.15.130:0/1439758158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed800d1090 0x7fed8015d960 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.500+0000 7fed87fac640 1 -- 172.21.15.130:0/1439758158 >> 172.21.15.130:0/1439758158 conn(0x7fed8006f170 msgr2=0x7fed8006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:32.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.500+0000 7fed87fac640 1 -- 172.21.15.130:0/1439758158 shutdown_connections 2023-09-13T06:12:32.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.500+0000 7fed87fac640 1 -- 172.21.15.130:0/1439758158 wait complete. 2023-09-13T06:12:32.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed87fac640 1 Processor -- start 2023-09-13T06:12:32.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed87fac640 1 -- start start 2023-09-13T06:12:32.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed87fac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed800d1090 0x7fed8013b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:32.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed87fac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed800d1750 0x7fed80159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:32.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed87fac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed80146f30 0x7fed8013cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:32.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed87fac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed801432b0 con 0x7fed800d1750 2023-09-13T06:12:32.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed87fac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8015a300 con 0x7fed800d1090 2023-09-13T06:12:32.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed87fac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed801426a0 con 0x7fed80146f30 2023-09-13T06:12:32.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed85547640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed800d1750 0x7fed80159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:32.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed85547640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed800d1750 0x7fed80159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48402/0 (socket says 172.21.15.130:48402) 2023-09-13T06:12:32.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed85547640 1 -- 172.21.15.130:0/2368486001 learned_addr learned my addr 172.21.15.130:0/2368486001 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:32.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed85d48640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed800d1090 0x7fed8013b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:32.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed85547640 1 -- 172.21.15.130:0/2368486001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed80146f30 msgr2=0x7fed8013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:32.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed85547640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed80146f30 0x7fed8013cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed85547640 1 -- 172.21.15.130:0/2368486001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed800d1090 msgr2=0x7fed8013b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:32.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed85547640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed800d1090 0x7fed8013b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed85547640 1 -- 172.21.15.130:0/2368486001 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed700094d0 con 0x7fed800d1750 2023-09-13T06:12:32.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed85d48640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed800d1090 0x7fed8013b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:32.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed85547640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed800d1750 0x7fed80159dc0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fed700ad040 tx=0x7fed7001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:32.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed767fc640 1 -- 172.21.15.130:0/2368486001 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700b48c0 con 0x7fed800d1750 2023-09-13T06:12:32.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed767fc640 1 -- 172.21.15.130:0/2368486001 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed700b4a40 con 0x7fed800d1750 2023-09-13T06:12:32.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed767fc640 1 -- 172.21.15.130:0/2368486001 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700b4df0 con 0x7fed800d1750 2023-09-13T06:12:32.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed87fac640 1 -- 172.21.15.130:0/2368486001 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed80142980 con 0x7fed800d1750 2023-09-13T06:12:32.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.504+0000 7fed87fac640 1 -- 172.21.15.130:0/2368486001 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed80142f40 con 0x7fed800d1750 2023-09-13T06:12:32.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.508+0000 7fed87fac640 1 -- 172.21.15.130:0/2368486001 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed80143420 con 0x7fed800d1750 2023-09-13T06:12:32.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.508+0000 7fed767fc640 1 -- 172.21.15.130:0/2368486001 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fed700aa460 con 0x7fed800d1750 2023-09-13T06:12:32.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.508+0000 7fed767fc640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed64065b20 0x7fed64067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:32.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.508+0000 7fed767fc640 1 -- 172.21.15.130:0/2368486001 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fed7011de90 con 0x7fed800d1750 2023-09-13T06:12:32.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.508+0000 7fed767fc640 1 -- 172.21.15.130:0/2368486001 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7fed6406d6b0 con 0x7fed800d1750 2023-09-13T06:12:32.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.508+0000 7fed85d48640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed64065b20 0x7fed64067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:32.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.508+0000 7fed85d48640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed64065b20 0x7fed64067fe0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fed7c000f70 tx=0x7fed7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:32.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.512+0000 7fed767fc640 1 -- 172.21.15.130:0/2368486001 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fed700eb860 con 0x7fed800d1750 2023-09-13T06:12:32.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.664+0000 7fed87fac640 1 -- 172.21.15.130:0/2368486001 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed800618a0 con 0x7fed800d1750 2023-09-13T06:12:32.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed767fc640 1 -- 172.21.15.130:0/2368486001 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+16692 (secure 0 0 0) 0x7fed7011f070 con 0x7fed800d1750 2023-09-13T06:12:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:32.668 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":175,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:12:14.598851+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:11:15.244077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-09-13T06:11:16.070064+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:12:32.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 -- 172.21.15.130:0/2368486001 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed64065b20 msgr2=0x7fed64067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:32.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed64065b20 0x7fed64067fe0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fed7c000f70 tx=0x7fed7c009040 comp rx=0 tx=0).stop 2023-09-13T06:12:32.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 -- 172.21.15.130:0/2368486001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed800d1750 msgr2=0x7fed80159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:32.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed800d1750 0x7fed80159dc0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fed700ad040 tx=0x7fed7001acc0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 -- 172.21.15.130:0/2368486001 shutdown_connections 2023-09-13T06:12:32.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fed64065b20 0x7fed64067fe0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed80146f30 0x7fed8013cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed800d1750 0x7fed80159dc0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 --2- 172.21.15.130:0/2368486001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed800d1090 0x7fed8013b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 -- 172.21.15.130:0/2368486001 >> 172.21.15.130:0/2368486001 conn(0x7fed8006f170 msgr2=0x7fed800cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:32.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 -- 172.21.15.130:0/2368486001 shutdown_connections 2023-09-13T06:12:32.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.668+0000 7fed87fac640 1 -- 172.21.15.130:0/2368486001 wait complete. 2023-09-13T06:12:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:11:15.244077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '170', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:11:16.070064+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:12:32.690 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:12:32.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f2714b10640 1 Processor -- start 2023-09-13T06:12:32.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f2714b10640 1 -- start start 2023-09-13T06:12:32.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f2714b10640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27100d2cd0 0x7f27101612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:32.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f2714b10640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f27101617e0 0x7f27100cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:32.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f2714b10640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271015dd40 con 0x7f271015ae10 2023-09-13T06:12:32.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f2714b10640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271015e020 con 0x7f27101617e0 2023-09-13T06:12:32.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f2714b10640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271015e300 con 0x7f27100d2cd0 2023-09-13T06:12:32.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f270ed9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f27101617e0 0x7f27100cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:32.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f270ed9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f27101617e0 0x7f27100cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:58146/0 (socket says 172.21.15.130:58146) 2023-09-13T06:12:32.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f270e59c640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f271015ae10 0x7f27100d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:37516/0 (socket says 172.21.15.130:37516) 2023-09-13T06:12:32.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f270e59c640 1 -- 172.21.15.130:0/3495890496 learned_addr learned my addr 172.21.15.130:0/3495890496 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:32.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.832+0000 7f270dd9b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27100d2cd0 0x7f27101612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:32.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.836+0000 7f270ed9d640 1 -- 172.21.15.130:0/3495890496 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27100d2cd0 msgr2=0x7f27101612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:32.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.836+0000 7f270ed9d640 1 --2- 172.21.15.130:0/3495890496 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27100d2cd0 0x7f27101612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.836+0000 7f270ed9d640 1 -- 172.21.15.130:0/3495890496 >> v1:172.21.15.164:6789/0 conn(0x7f271015ae10 legacy=0x7f27100d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:32.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.836+0000 7f270ed9d640 1 -- 172.21.15.130:0/3495890496 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271015e5e0 con 0x7f27101617e0 2023-09-13T06:12:32.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.836+0000 7f270ed9d640 1 --2- 172.21.15.130:0/3495890496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27101617e0 0x7f27100cfd00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2708009d90 tx=0x7f270801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77cff7370da05e0a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:32.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.836+0000 7f270d59a640 1 -- 172.21.15.130:0/3495890496 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080a58a0 con 0x7f27101617e0 2023-09-13T06:12:32.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.836+0000 7f270d59a640 1 -- 172.21.15.130:0/3495890496 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27080a5a00 con 0x7f27101617e0 2023-09-13T06:12:32.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.836+0000 7f270d59a640 1 -- 172.21.15.130:0/3495890496 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080a5d90 con 0x7f27101617e0 2023-09-13T06:12:32.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.836+0000 7f2714b10640 1 -- 172.21.15.130:0/3495890496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27101617e0 msgr2=0x7f27100cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:32.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.836+0000 7f2714b10640 1 --2- 172.21.15.130:0/3495890496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27101617e0 0x7f27100cfd00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2708009d90 tx=0x7f270801c8c0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 -- 172.21.15.130:0/3495890496 shutdown_connections 2023-09-13T06:12:32.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 --2- 172.21.15.130:0/3495890496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f27101617e0 0x7f27100cfd00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 --2- 172.21.15.130:0/3495890496 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27100d2cd0 0x7f27101612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 -- 172.21.15.130:0/3495890496 >> 172.21.15.130:0/3495890496 conn(0x7f2710065990 msgr2=0x7f2710065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:32.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 -- 172.21.15.130:0/3495890496 shutdown_connections 2023-09-13T06:12:32.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 -- 172.21.15.130:0/3495890496 wait complete. 2023-09-13T06:12:32.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 Processor -- start 2023-09-13T06:12:32.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 -- start start 2023-09-13T06:12:32.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27100d2cd0 0x7f27101f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:32.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f271015ae10 0x7f271015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:32.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27101617e0 0x7f2710140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:32.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27101fa090 con 0x7f27100d2cd0 2023-09-13T06:12:32.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27101623d0 con 0x7f271015ae10 2023-09-13T06:12:32.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f2714b10640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27101412d0 con 0x7f27101617e0 2023-09-13T06:12:32.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f270e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27100d2cd0 0x7f27101f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:32.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f270e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27100d2cd0 0x7f27101f9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48404/0 (socket says 172.21.15.130:48404) 2023-09-13T06:12:32.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f270e59c640 1 -- 172.21.15.130:0/1842260634 learned_addr learned my addr 172.21.15.130:0/1842260634 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:32.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f270ed9d640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27101617e0 0x7f2710140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:32.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f270dd9b640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f271015ae10 0x7f271015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:32.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f270e59c640 1 -- 172.21.15.130:0/1842260634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27101617e0 msgr2=0x7f2710140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:32.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f270e59c640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27101617e0 0x7f2710140d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f270e59c640 1 -- 172.21.15.130:0/1842260634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f271015ae10 msgr2=0x7f271015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:32.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f270e59c640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f271015ae10 0x7f271015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:32.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.840+0000 7f270e59c640 1 -- 172.21.15.130:0/1842260634 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708009a70 con 0x7f27100d2cd0 2023-09-13T06:12:32.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.844+0000 7f270e59c640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27100d2cd0 0x7f27101f9ab0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f270000c500 tx=0x7f270000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:32.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.844+0000 7f26feffd640 1 -- 172.21.15.130:0/1842260634 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700005cf0 con 0x7f27100d2cd0 2023-09-13T06:12:32.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.844+0000 7f26feffd640 1 -- 172.21.15.130:0/1842260634 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2700005e50 con 0x7f27100d2cd0 2023-09-13T06:12:32.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.844+0000 7f2714b10640 1 -- 172.21.15.130:0/1842260634 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27101587d0 con 0x7f27100d2cd0 2023-09-13T06:12:32.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.844+0000 7f26feffd640 1 -- 172.21.15.130:0/1842260634 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000072f0 con 0x7f27100d2cd0 2023-09-13T06:12:32.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.844+0000 7f2714b10640 1 -- 172.21.15.130:0/1842260634 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2710158180 con 0x7f27100d2cd0 2023-09-13T06:12:32.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.844+0000 7f2714b10640 1 -- 172.21.15.130:0/1842260634 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27100618a0 con 0x7f27100d2cd0 2023-09-13T06:12:32.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.844+0000 7f26feffd640 1 -- 172.21.15.130:0/1842260634 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2700007450 con 0x7f27100d2cd0 2023-09-13T06:12:32.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.844+0000 7f26feffd640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26f0065b20 0x7f26f0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:32.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.848+0000 7f26feffd640 1 -- 172.21.15.130:0/1842260634 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f27000827b0 con 0x7f27100d2cd0 2023-09-13T06:12:32.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.848+0000 7f270dd9b640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26f0065b20 0x7f26f0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:32.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.848+0000 7f26feffd640 1 -- 172.21.15.130:0/1842260634 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f26f006d6b0 con 0x7f27100d2cd0 2023-09-13T06:12:32.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.848+0000 7f270dd9b640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26f0065b20 0x7f26f0067fe0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2710156760 tx=0x7f2704009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:32.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.852+0000 7f26feffd640 1 -- 172.21.15.130:0/1842260634 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2700017070 con 0x7f27100d2cd0 2023-09-13T06:12:32.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:32.996+0000 7f2714b10640 1 -- 172.21.15.130:0/1842260634 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27100b68a0 con 0x7f27100d2cd0 2023-09-13T06:12:32.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f26feffd640 1 -- 172.21.15.130:0/1842260634 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v175) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2700050220 con 0x7f27100d2cd0 2023-09-13T06:12:32.999 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:12:33.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 -- 172.21.15.130:0/1842260634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26f0065b20 msgr2=0x7f26f0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26f0065b20 0x7f26f0067fe0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2710156760 tx=0x7f2704009190 comp rx=0 tx=0).stop 2023-09-13T06:12:33.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 -- 172.21.15.130:0/1842260634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27100d2cd0 msgr2=0x7f27101f9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27100d2cd0 0x7f27101f9ab0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f270000c500 tx=0x7f270000c9c0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 -- 172.21.15.130:0/1842260634 shutdown_connections 2023-09-13T06:12:33.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f26f0065b20 0x7f26f0067fe0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f271015ae10 0x7f271015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f27101617e0 0x7f2710140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 --2- 172.21.15.130:0/1842260634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27100d2cd0 0x7f27101f9ab0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 -- 172.21.15.130:0/1842260634 >> 172.21.15.130:0/1842260634 conn(0x7f2710065990 msgr2=0x7f27100d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:33.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 -- 172.21.15.130:0/1842260634 shutdown_connections 2023-09-13T06:12:33.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.000+0000 7f2714b10640 1 -- 172.21.15.130:0/1842260634 wait complete. 2023-09-13T06:12:33.020 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:12:33.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd866c9c640 1 Processor -- start 2023-09-13T06:12:33.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd866c9c640 1 -- start start 2023-09-13T06:12:33.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd866c9c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd86015a080 0x7fd8600b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd866c9c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd86015e650 0x7fd8600b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd866c9c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8600cc850 con 0x7fd8600b2fd0 2023-09-13T06:12:33.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd866c9c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8600b33f0 con 0x7fd86015e650 2023-09-13T06:12:33.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd866c9c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8600b0330 con 0x7fd86015a080 2023-09-13T06:12:33.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd85ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd86015e650 0x7fd8600b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd85ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd86015e650 0x7fd8600b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48414/0 (socket says 172.21.15.130:48414) 2023-09-13T06:12:33.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd85ffff640 1 -- 172.21.15.130:0/1505971566 learned_addr learned my addr 172.21.15.130:0/1505971566 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:33.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd864a38640 1 --2- 172.21.15.130:0/1505971566 >> v2:172.21.15.164:3300/0 conn(0x7fd86015a080 0x7fd8600b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd85ffff640 1 -- 172.21.15.130:0/1505971566 >> v2:172.21.15.164:3300/0 conn(0x7fd86015a080 msgr2=0x7fd8600b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:33.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd85ffff640 1 --2- 172.21.15.130:0/1505971566 >> v2:172.21.15.164:3300/0 conn(0x7fd86015a080 0x7fd8600b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd85ffff640 1 -- 172.21.15.130:0/1505971566 >> v1:172.21.15.164:6789/0 conn(0x7fd8600b2fd0 legacy=0x7fd8600ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd85ffff640 1 -- 172.21.15.130:0/1505971566 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8600cbcd0 con 0x7fd86015e650 2023-09-13T06:12:33.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.160+0000 7fd864a38640 1 --2- 172.21.15.130:0/1505971566 >> v2:172.21.15.164:3300/0 conn(0x7fd86015a080 0x7fd8600b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:33.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd85ffff640 1 --2- 172.21.15.130:0/1505971566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd86015e650 0x7fd8600b2a90 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd8600706b0 tx=0x7fd84c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98448a6b96a76d4e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:33.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd85f7fe640 1 -- 172.21.15.130:0/1505971566 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0ad680 con 0x7fd86015e650 2023-09-13T06:12:33.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd85f7fe640 1 -- 172.21.15.130:0/1505971566 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c0ad7e0 con 0x7fd86015e650 2023-09-13T06:12:33.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd85f7fe640 1 -- 172.21.15.130:0/1505971566 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0adb70 con 0x7fd86015e650 2023-09-13T06:12:33.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd866c9c640 1 -- 172.21.15.130:0/1505971566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd86015e650 msgr2=0x7fd8600b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd866c9c640 1 --2- 172.21.15.130:0/1505971566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd86015e650 0x7fd8600b2a90 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd8600706b0 tx=0x7fd84c01c410 comp rx=0 tx=0).stop 2023-09-13T06:12:33.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd866c9c640 1 -- 172.21.15.130:0/1505971566 shutdown_connections 2023-09-13T06:12:33.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd866c9c640 1 --2- 172.21.15.130:0/1505971566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd86015e650 0x7fd8600b2a90 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd866c9c640 1 --2- 172.21.15.130:0/1505971566 >> v2:172.21.15.164:3300/0 conn(0x7fd86015a080 0x7fd8600b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd866c9c640 1 -- 172.21.15.130:0/1505971566 >> 172.21.15.130:0/1505971566 conn(0x7fd860065990 msgr2=0x7fd860065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:33.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd866c9c640 1 -- 172.21.15.130:0/1505971566 shutdown_connections 2023-09-13T06:12:33.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.164+0000 7fd866c9c640 1 -- 172.21.15.130:0/1505971566 wait complete. 2023-09-13T06:12:33.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd866c9c640 1 Processor -- start 2023-09-13T06:12:33.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd866c9c640 1 -- start start 2023-09-13T06:12:33.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd866c9c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8600b2fd0 0x7fd860155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd866c9c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd86015a080 0x7fd8601f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd866c9c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd86015e650 0x7fd8601593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd866c9c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd860159900 con 0x7fd86015e650 2023-09-13T06:12:33.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd866c9c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8601f5eb0 con 0x7fd86015a080 2023-09-13T06:12:33.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd866c9c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8601f58a0 con 0x7fd8600b2fd0 2023-09-13T06:12:33.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd865239640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd86015e650 0x7fd8601593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd865239640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd86015e650 0x7fd8601593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48420/0 (socket says 172.21.15.130:48420) 2023-09-13T06:12:33.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd864a38640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8600b2fd0 0x7fd860155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd865239640 1 -- 172.21.15.130:0/117577934 learned_addr learned my addr 172.21.15.130:0/117577934 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:33.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd85ffff640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd86015a080 0x7fd8601f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd865239640 1 -- 172.21.15.130:0/117577934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8600b2fd0 msgr2=0x7fd860155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd865239640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8600b2fd0 0x7fd860155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd865239640 1 -- 172.21.15.130:0/117577934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd86015a080 msgr2=0x7fd8601f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd865239640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd86015a080 0x7fd8601f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd865239640 1 -- 172.21.15.130:0/117577934 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c0094d0 con 0x7fd86015e650 2023-09-13T06:12:33.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd865239640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd86015e650 0x7fd8601593c0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c770 tx=0x7fd85800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:33.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.168+0000 7fd85d7fa640 1 -- 172.21.15.130:0/117577934 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858003b80 con 0x7fd86015e650 2023-09-13T06:12:33.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.172+0000 7fd85d7fa640 1 -- 172.21.15.130:0/117577934 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd858003ce0 con 0x7fd86015e650 2023-09-13T06:12:33.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.172+0000 7fd85d7fa640 1 -- 172.21.15.130:0/117577934 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85800aa90 con 0x7fd86015e650 2023-09-13T06:12:33.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.172+0000 7fd866c9c640 1 -- 172.21.15.130:0/117577934 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd860155fa0 con 0x7fd86015e650 2023-09-13T06:12:33.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.172+0000 7fd866c9c640 1 -- 172.21.15.130:0/117577934 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd860156280 con 0x7fd86015e650 2023-09-13T06:12:33.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.172+0000 7fd866c9c640 1 -- 172.21.15.130:0/117577934 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8600618a0 con 0x7fd86015e650 2023-09-13T06:12:33.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.172+0000 7fd85d7fa640 1 -- 172.21.15.130:0/117577934 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd85800abf0 con 0x7fd86015e650 2023-09-13T06:12:33.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.172+0000 7fd85d7fa640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd844065b20 0x7fd844067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.172+0000 7fd85d7fa640 1 -- 172.21.15.130:0/117577934 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd858082f90 con 0x7fd86015e650 2023-09-13T06:12:33.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.172+0000 7fd864a38640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd844065b20 0x7fd844067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.172+0000 7fd85d7fa640 1 -- 172.21.15.130:0/117577934 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7fd84406d6b0 con 0x7fd86015e650 2023-09-13T06:12:33.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.172+0000 7fd864a38640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd844065b20 0x7fd844067fe0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd854006e90 tx=0x7fd854008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:33.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.176+0000 7fd85d7fa640 1 -- 172.21.15.130:0/117577934 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd858050850 con 0x7fd86015e650 2023-09-13T06:12:33.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 -- 172.21.15.130:0/117577934 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8600cc850 con 0x7fd86015e650 2023-09-13T06:12:33.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd85d7fa640 1 -- 172.21.15.130:0/117577934 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v175) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8600cc850 con 0x7fd86015e650 2023-09-13T06:12:33.324 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:12:33.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 -- 172.21.15.130:0/117577934 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd844065b20 msgr2=0x7fd844067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd844065b20 0x7fd844067fe0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd854006e90 tx=0x7fd854008040 comp rx=0 tx=0).stop 2023-09-13T06:12:33.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 -- 172.21.15.130:0/117577934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd86015e650 msgr2=0x7fd8601593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd86015e650 0x7fd8601593c0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c770 tx=0x7fd85800cc30 comp rx=0 tx=0).stop 2023-09-13T06:12:33.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 -- 172.21.15.130:0/117577934 shutdown_connections 2023-09-13T06:12:33.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd844065b20 0x7fd844067fe0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd86015a080 0x7fd8601f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd86015e650 0x7fd8601593c0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 --2- 172.21.15.130:0/117577934 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8600b2fd0 0x7fd860155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 -- 172.21.15.130:0/117577934 >> 172.21.15.130:0/117577934 conn(0x7fd860065990 msgr2=0x7fd860156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:33.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 -- 172.21.15.130:0/117577934 shutdown_connections 2023-09-13T06:12:33.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.324+0000 7fd866c9c640 1 -- 172.21.15.130:0/117577934 wait complete. 2023-09-13T06:12:33.345 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:12:33.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.484+0000 7f7540967640 1 Processor -- start 2023-09-13T06:12:33.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.484+0000 7f7540967640 1 -- start start 2023-09-13T06:12:33.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f7540967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f753c15a080 0x7f753c0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f7540967640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753c0cc850 con 0x7f753c0b31a0 2023-09-13T06:12:33.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f7540967640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753c0b0330 con 0x7f753c15e650 2023-09-13T06:12:33.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f7540967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0cbcd0 con 0x7f753c15a080 2023-09-13T06:12:33.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f753ad9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f753c0b31a0 0x7f753c0ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50908/0 (socket says 172.21.15.130:50908) 2023-09-13T06:12:33.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f753ad9d640 1 -- 172.21.15.130:0/3388730210 learned_addr learned my addr 172.21.15.130:0/3388730210 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:33.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f753a59c640 1 --2- 172.21.15.130:0/3388730210 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f753c15a080 0x7f753c0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f7539d9b640 1 -- 172.21.15.130:0/3388730210 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788575398 0 0) 0x7f75340014a0 con 0x7f753c0b31a0 2023-09-13T06:12:33.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f7539d9b640 1 -- 172.21.15.130:0/3388730210 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7528003530 con 0x7f753c0b31a0 2023-09-13T06:12:33.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f7539d9b640 1 -- 172.21.15.130:0/3388730210 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554031545 0 0) 0x7f753c0b0330 con 0x7f753c15e650 2023-09-13T06:12:33.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f7539d9b640 1 -- 172.21.15.130:0/3388730210 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75340014a0 con 0x7f753c15e650 2023-09-13T06:12:33.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f753a59c640 1 -- 172.21.15.130:0/3388730210 >> v1:172.21.15.164:6789/0 conn(0x7f753c15e650 legacy=0x7f753c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f753a59c640 1 -- 172.21.15.130:0/3388730210 >> v1:172.21.15.130:6789/0 conn(0x7f753c0b31a0 legacy=0x7f753c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.488+0000 7f753a59c640 1 -- 172.21.15.130:0/3388730210 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0cbfb0 con 0x7f753c15a080 2023-09-13T06:12:33.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f753a59c640 1 --2- 172.21.15.130:0/3388730210 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f753c15a080 0x7f753c0b1460 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f752c0097f0 tx=0x7f752c01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a882243d4e31086 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:33.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7539d9b640 1 -- 172.21.15.130:0/3388730210 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c0ab600 con 0x7f753c15a080 2023-09-13T06:12:33.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7539d9b640 1 -- 172.21.15.130:0/3388730210 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c0a7050 con 0x7f753c15a080 2023-09-13T06:12:33.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7539d9b640 1 -- 172.21.15.130:0/3388730210 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c0ab980 con 0x7f753c15a080 2023-09-13T06:12:33.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7540967640 1 -- 172.21.15.130:0/3388730210 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f753c15a080 msgr2=0x7f753c0b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7540967640 1 --2- 172.21.15.130:0/3388730210 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f753c15a080 0x7f753c0b1460 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f752c0097f0 tx=0x7f752c01c3d0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7540967640 1 -- 172.21.15.130:0/3388730210 shutdown_connections 2023-09-13T06:12:33.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7540967640 1 --2- 172.21.15.130:0/3388730210 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f753c15a080 0x7f753c0b1460 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7540967640 1 -- 172.21.15.130:0/3388730210 >> 172.21.15.130:0/3388730210 conn(0x7f753c065990 msgr2=0x7f753c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:33.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7540967640 1 -- 172.21.15.130:0/3388730210 shutdown_connections 2023-09-13T06:12:33.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7540967640 1 -- 172.21.15.130:0/3388730210 wait complete. 2023-09-13T06:12:33.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7540967640 1 Processor -- start 2023-09-13T06:12:33.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.492+0000 7f7540967640 1 -- start start 2023-09-13T06:12:33.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7540967640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f753c0b31a0 0x7f753c151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7540967640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f753c15a080 0x7f753c0acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7540967640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f753c15e650 0x7f753c14f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7540967640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c151d80 con 0x7f753c15a080 2023-09-13T06:12:33.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7540967640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c152060 con 0x7f753c0b31a0 2023-09-13T06:12:33.498 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7540967640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c152340 con 0x7f753c15e650 2023-09-13T06:12:33.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7533fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f753c15a080 0x7f753c0acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7533fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f753c15a080 0x7f753c0acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48426/0 (socket says 172.21.15.130:48426) 2023-09-13T06:12:33.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7533fff640 1 -- 172.21.15.130:0/3127639102 learned_addr learned my addr 172.21.15.130:0/3127639102 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:33.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f753a59c640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f753c0b31a0 0x7f753c151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f753ad9d640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f753c15e650 0x7f753c14f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7533fff640 1 -- 172.21.15.130:0/3127639102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f753c15e650 msgr2=0x7f753c14f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7533fff640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f753c15e650 0x7f753c14f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7533fff640 1 -- 172.21.15.130:0/3127639102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f753c0b31a0 msgr2=0x7f753c151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7533fff640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f753c0b31a0 0x7f753c151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7533fff640 1 -- 172.21.15.130:0/3127639102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c009420 con 0x7f753c15a080 2023-09-13T06:12:33.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f753a59c640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f753c0b31a0 0x7f753c151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:33.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7533fff640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f753c15a080 0x7f753c0acf10 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f752400c430 tx=0x7f752400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:33.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7532ffd640 1 -- 172.21.15.130:0/3127639102 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240052d0 con 0x7f753c15a080 2023-09-13T06:12:33.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7532ffd640 1 -- 172.21.15.130:0/3127639102 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524005450 con 0x7f753c15a080 2023-09-13T06:12:33.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7540967640 1 -- 172.21.15.130:0/3127639102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753c152620 con 0x7f753c15a080 2023-09-13T06:12:33.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7532ffd640 1 -- 172.21.15.130:0/3127639102 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524003840 con 0x7f753c15a080 2023-09-13T06:12:33.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7540967640 1 -- 172.21.15.130:0/3127639102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c14f560 con 0x7f753c15a080 2023-09-13T06:12:33.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.496+0000 7f7540967640 1 -- 172.21.15.130:0/3127639102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753c0618a0 con 0x7f753c15a080 2023-09-13T06:12:33.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.500+0000 7f7532ffd640 1 -- 172.21.15.130:0/3127639102 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f75240039a0 con 0x7f753c15a080 2023-09-13T06:12:33.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.500+0000 7f7532ffd640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f751c065b20 0x7f751c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.500+0000 7f7532ffd640 1 -- 172.21.15.130:0/3127639102 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7524082a90 con 0x7f753c15a080 2023-09-13T06:12:33.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.500+0000 7f753a59c640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f751c065b20 0x7f751c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.500+0000 7f7532ffd640 1 -- 172.21.15.130:0/3127639102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f751c06d6b0 con 0x7f753c15a080 2023-09-13T06:12:33.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.500+0000 7f753a59c640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f751c065b20 0x7f751c067fe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f752c0ad000 tx=0x7f752c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:33.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.504+0000 7f7532ffd640 1 -- 172.21.15.130:0/3127639102 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7524017020 con 0x7f753c15a080 2023-09-13T06:12:33.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.652+0000 7f7540967640 1 -- 172.21.15.130:0/3127639102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f753c152ad0 con 0x7f753c15a080 2023-09-13T06:12:33.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.652+0000 7f7532ffd640 1 -- 172.21.15.130:0/3127639102 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v175) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7524050290 con 0x7f753c15a080 2023-09-13T06:12:33.653 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:12:33.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.652+0000 7f7540967640 1 -- 172.21.15.130:0/3127639102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f751c065b20 msgr2=0x7f751c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.652+0000 7f7540967640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f751c065b20 0x7f751c067fe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f752c0ad000 tx=0x7f752c0a6000 comp rx=0 tx=0).stop 2023-09-13T06:12:33.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.652+0000 7f7540967640 1 -- 172.21.15.130:0/3127639102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f753c15a080 msgr2=0x7f753c0acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.652+0000 7f7540967640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f753c15a080 0x7f753c0acf10 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f752400c430 tx=0x7f752400c8f0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.656+0000 7f7540967640 1 -- 172.21.15.130:0/3127639102 shutdown_connections 2023-09-13T06:12:33.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.656+0000 7f7540967640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f751c065b20 0x7f751c067fe0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.656+0000 7f7540967640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f753c15e650 0x7f753c14f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.656+0000 7f7540967640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f753c15a080 0x7f753c0acf10 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.656+0000 7f7540967640 1 --2- 172.21.15.130:0/3127639102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f753c0b31a0 0x7f753c151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.656+0000 7f7540967640 1 -- 172.21.15.130:0/3127639102 >> 172.21.15.130:0/3127639102 conn(0x7f753c065990 msgr2=0x7f753c165290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:33.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.656+0000 7f7540967640 1 -- 172.21.15.130:0/3127639102 shutdown_connections 2023-09-13T06:12:33.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.656+0000 7f7540967640 1 -- 172.21.15.130:0/3127639102 wait complete. 2023-09-13T06:12:33.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:12:33.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.812+0000 7f4f51140640 1 Processor -- start 2023-09-13T06:12:33.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.812+0000 7f4f51140640 1 -- start start 2023-09-13T06:12:33.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f51140640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4f4c0ae170 0x7f4f4c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f51140640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f4c15d9d0 0x7f4f4c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f51140640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c0cce60 con 0x7f4f4c15d5f0 2023-09-13T06:12:33.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f51140640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c0cd140 con 0x7f4f4c0ae170 2023-09-13T06:12:33.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f51140640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0cd420 con 0x7f4f4c15d9d0 2023-09-13T06:12:33.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f4259c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4f4c0ae170 0x7f4f4c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f4259c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4f4c0ae170 0x7f4f4c0cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:58194/0 (socket says 172.21.15.130:58194) 2023-09-13T06:12:33.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f4259c640 1 -- 172.21.15.130:0/1582833808 learned_addr learned my addr 172.21.15.130:0/1582833808 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:33.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f4b59e640 1 --2- 172.21.15.130:0/1582833808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f4c15d9d0 0x7f4f4c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f4ad9d640 1 --1- 172.21.15.130:0/1582833808 >> v1:172.21.15.164:6789/0 conn(0x7f4f4c15d5f0 0x7f4f4c1591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:37544/0 (socket says 172.21.15.130:37544) 2023-09-13T06:12:33.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f4259c640 1 -- 172.21.15.130:0/1582833808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f4c15d9d0 msgr2=0x7f4f4c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:33.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f4259c640 1 --2- 172.21.15.130:0/1582833808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f4c15d9d0 0x7f4f4c0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f4259c640 1 -- 172.21.15.130:0/1582833808 >> v1:172.21.15.164:6789/0 conn(0x7f4f4c15d5f0 legacy=0x7f4f4c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.816+0000 7f4f4259c640 1 -- 172.21.15.130:0/1582833808 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0cd700 con 0x7f4f4c0ae170 2023-09-13T06:12:33.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f4259c640 1 --2- 172.21.15.130:0/1582833808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f4c0ae170 0x7f4f4c0cc7f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4f34008120 tx=0x7f4f3401c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b958ccdc049e48f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:33.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f4a59c640 1 -- 172.21.15.130:0/1582833808 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34004230 con 0x7f4f4c0ae170 2023-09-13T06:12:33.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f4a59c640 1 -- 172.21.15.130:0/1582833808 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f34004390 con 0x7f4f4c0ae170 2023-09-13T06:12:33.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f4a59c640 1 -- 172.21.15.130:0/1582833808 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34003820 con 0x7f4f4c0ae170 2023-09-13T06:12:33.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f51140640 1 -- 172.21.15.130:0/1582833808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f4c0ae170 msgr2=0x7f4f4c0cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f51140640 1 --2- 172.21.15.130:0/1582833808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f4c0ae170 0x7f4f4c0cc7f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4f34008120 tx=0x7f4f3401c750 comp rx=0 tx=0).stop 2023-09-13T06:12:33.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f51140640 1 -- 172.21.15.130:0/1582833808 shutdown_connections 2023-09-13T06:12:33.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f51140640 1 --2- 172.21.15.130:0/1582833808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f4c15d9d0 0x7f4f4c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f51140640 1 --2- 172.21.15.130:0/1582833808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f4c0ae170 0x7f4f4c0cc7f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f51140640 1 -- 172.21.15.130:0/1582833808 >> 172.21.15.130:0/1582833808 conn(0x7f4f4c065990 msgr2=0x7f4f4c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:33.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f51140640 1 -- 172.21.15.130:0/1582833808 shutdown_connections 2023-09-13T06:12:33.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f51140640 1 -- 172.21.15.130:0/1582833808 wait complete. 2023-09-13T06:12:33.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.820+0000 7f4f51140640 1 Processor -- start 2023-09-13T06:12:33.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f51140640 1 -- start start 2023-09-13T06:12:33.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f51140640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f4c0ae170 0x7f4f4c15c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f51140640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f4c15d5f0 0x7f4f4c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f51140640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f4c15d9d0 0x7f4f4c1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f51140640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c15ae60 con 0x7f4f4c0ae170 2023-09-13T06:12:33.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f51140640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c154600 con 0x7f4f4c15d5f0 2023-09-13T06:12:33.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f51140640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c15b0b0 con 0x7f4f4c15d9d0 2023-09-13T06:12:33.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f4ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f4c0ae170 0x7f4f4c15c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f4ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f4c0ae170 0x7f4f4c15c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48436/0 (socket says 172.21.15.130:48436) 2023-09-13T06:12:33.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f4ad9d640 1 -- 172.21.15.130:0/4072824834 learned_addr learned my addr 172.21.15.130:0/4072824834 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:33.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f4259c640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f4c15d5f0 0x7f4f4c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f4b59e640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f4c15d9d0 0x7f4f4c1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f4ad9d640 1 -- 172.21.15.130:0/4072824834 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f4c15d9d0 msgr2=0x7f4f4c1540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f4ad9d640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f4c15d9d0 0x7f4f4c1540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f4ad9d640 1 -- 172.21.15.130:0/4072824834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f4c15d5f0 msgr2=0x7f4f4c153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f4ad9d640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f4c15d5f0 0x7f4f4c153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f4ad9d640 1 -- 172.21.15.130:0/4072824834 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3400a580 con 0x7f4f4c0ae170 2023-09-13T06:12:33.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f4ad9d640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f4c0ae170 0x7f4f4c15c150 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00c490 tx=0x7f4f3c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:33.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f43fff640 1 -- 172.21.15.130:0/4072824834 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c007480 con 0x7f4f4c0ae170 2023-09-13T06:12:33.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f43fff640 1 -- 172.21.15.130:0/4072824834 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c0075e0 con 0x7f4f4c0ae170 2023-09-13T06:12:33.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f51140640 1 -- 172.21.15.130:0/4072824834 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c15b390 con 0x7f4f4c0ae170 2023-09-13T06:12:33.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f43fff640 1 -- 172.21.15.130:0/4072824834 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c004a10 con 0x7f4f4c0ae170 2023-09-13T06:12:33.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f51140640 1 -- 172.21.15.130:0/4072824834 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c15b950 con 0x7f4f4c0ae170 2023-09-13T06:12:33.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.824+0000 7f4f51140640 1 -- 172.21.15.130:0/4072824834 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c0618a0 con 0x7f4f4c0ae170 2023-09-13T06:12:33.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.828+0000 7f4f43fff640 1 -- 172.21.15.130:0/4072824834 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4f3c004b70 con 0x7f4f4c0ae170 2023-09-13T06:12:33.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.828+0000 7f4f43fff640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f2c065b50 0x7f4f2c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:33.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.828+0000 7f4f43fff640 1 -- 172.21.15.130:0/4072824834 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4f3c0826c0 con 0x7f4f4c0ae170 2023-09-13T06:12:33.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.828+0000 7f4f4259c640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f2c065b50 0x7f4f2c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:33.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.828+0000 7f4f43fff640 1 -- 172.21.15.130:0/4072824834 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f4f2c06d6e0 con 0x7f4f4c0ae170 2023-09-13T06:12:33.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.828+0000 7f4f4259c640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f2c065b50 0x7f4f2c068010 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4f340ae000 tx=0x7f4f340a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:33.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.832+0000 7f4f43fff640 1 -- 172.21.15.130:0/4072824834 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4f3c050090 con 0x7f4f4c0ae170 2023-09-13T06:12:33.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.992+0000 7f4f51140640 1 -- 172.21.15.130:0/4072824834 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4f4c06d690 con 0x7f4f4c0ae170 2023-09-13T06:12:33.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.992+0000 7f4f43fff640 1 -- 172.21.15.130:0/4072824834 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v175) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4f3c018070 con 0x7f4f4c0ae170 2023-09-13T06:12:33.994 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:12:33.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 -- 172.21.15.130:0/4072824834 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f2c065b50 msgr2=0x7f4f2c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f2c065b50 0x7f4f2c068010 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4f340ae000 tx=0x7f4f340a7000 comp rx=0 tx=0).stop 2023-09-13T06:12:33.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 -- 172.21.15.130:0/4072824834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f4c0ae170 msgr2=0x7f4f4c15c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:33.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f4c0ae170 0x7f4f4c15c150 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00c490 tx=0x7f4f3c00c950 comp rx=0 tx=0).stop 2023-09-13T06:12:33.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 -- 172.21.15.130:0/4072824834 shutdown_connections 2023-09-13T06:12:33.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f2c065b50 0x7f4f2c068010 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f4c15d5f0 0x7f4f4c153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f4c15d9d0 0x7f4f4c1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 --2- 172.21.15.130:0/4072824834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f4c0ae170 0x7f4f4c15c150 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:33.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 -- 172.21.15.130:0/4072824834 >> 172.21.15.130:0/4072824834 conn(0x7f4f4c065990 msgr2=0x7f4f4c06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:33.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 -- 172.21.15.130:0/4072824834 shutdown_connections 2023-09-13T06:12:33.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:33.996+0000 7f4f51140640 1 -- 172.21.15.130:0/4072824834 wait complete. 2023-09-13T06:12:34.015 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T06:12:34.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:34.015 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-13T06:12:34.067 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:12:34.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:34.068 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T06:12:34.077 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:12:34.078 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:12:34.088 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:12:34.089 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:12:34.140 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:12:34.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.276+0000 7f48fafad640 1 Processor -- start 2023-09-13T06:12:34.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.276+0000 7f48fafad640 1 -- start start 2023-09-13T06:12:34.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.276+0000 7f48fafad640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f48f40cc780 0x7f48f415b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48fafad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f48f40b04a0 0x7f48f40b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48fafad640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f40ccbe0 con 0x7f48f415b130 2023-09-13T06:12:34.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48fafad640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f40b0e50 con 0x7f48f40b04a0 2023-09-13T06:12:34.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48fafad640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f40ce980 con 0x7f48f40cc780 2023-09-13T06:12:34.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48f954a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f48f40b04a0 0x7f48f40b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48f8d49640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f48f415b130 0x7f48f40ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50912/0 (socket says 172.21.15.130:50912) 2023-09-13T06:12:34.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48f8d49640 1 -- 172.21.15.130:0/954312428 learned_addr learned my addr 172.21.15.130:0/954312428 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:34.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48ebfff640 1 --2- 172.21.15.130:0/954312428 >> v2:172.21.15.164:3300/0 conn(0x7f48f40cc780 0x7f48f415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48f954a640 1 -- 172.21.15.130:0/954312428 >> v2:172.21.15.164:3300/0 conn(0x7f48f40cc780 msgr2=0x7f48f415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:34.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48f954a640 1 --2- 172.21.15.130:0/954312428 >> v2:172.21.15.164:3300/0 conn(0x7f48f40cc780 0x7f48f415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48f954a640 1 -- 172.21.15.130:0/954312428 >> v1:172.21.15.130:6789/0 conn(0x7f48f415b130 legacy=0x7f48f40ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48f954a640 1 -- 172.21.15.130:0/954312428 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f40cec60 con 0x7f48f40b04a0 2023-09-13T06:12:34.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48ebfff640 1 --2- 172.21.15.130:0/954312428 >> v2:172.21.15.164:3300/0 conn(0x7f48f40cc780 0x7f48f415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:34.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48eb7fe640 1 -- 172.21.15.130:0/954312428 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357376556 0 0) 0x7f48f40ccbe0 con 0x7f48f415b130 2023-09-13T06:12:34.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48f954a640 1 --2- 172.21.15.130:0/954312428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48f40b04a0 0x7f48f40b0910 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f48f406bc40 tx=0x7f48ec01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe8e91d80a14f8f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:34.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48eb7fe640 1 -- 172.21.15.130:0/954312428 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0a59a0 con 0x7f48f40b04a0 2023-09-13T06:12:34.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48eb7fe640 1 -- 172.21.15.130:0/954312428 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec0a5b00 con 0x7f48f40b04a0 2023-09-13T06:12:34.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.280+0000 7f48eb7fe640 1 -- 172.21.15.130:0/954312428 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0a5e90 con 0x7f48f40b04a0 2023-09-13T06:12:34.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 -- 172.21.15.130:0/954312428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48f40b04a0 msgr2=0x7f48f40b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 --2- 172.21.15.130:0/954312428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48f40b04a0 0x7f48f40b0910 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f48f406bc40 tx=0x7f48ec01c8e0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 -- 172.21.15.130:0/954312428 shutdown_connections 2023-09-13T06:12:34.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 --2- 172.21.15.130:0/954312428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48f40b04a0 0x7f48f40b0910 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 --2- 172.21.15.130:0/954312428 >> v2:172.21.15.164:3300/0 conn(0x7f48f40cc780 0x7f48f415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 -- 172.21.15.130:0/954312428 >> 172.21.15.130:0/954312428 conn(0x7f48f4065990 msgr2=0x7f48f4065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:34.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 -- 172.21.15.130:0/954312428 shutdown_connections 2023-09-13T06:12:34.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 -- 172.21.15.130:0/954312428 wait complete. 2023-09-13T06:12:34.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 Processor -- start 2023-09-13T06:12:34.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 -- start start 2023-09-13T06:12:34.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48f40b04a0 0x7f48f4156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48f40cc780 0x7f48f41566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48f415b130 0x7f48f4159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4155600 con 0x7f48f415b130 2023-09-13T06:12:34.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4155bc0 con 0x7f48f40b04a0 2023-09-13T06:12:34.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48fafad640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4156ed0 con 0x7f48f40cc780 2023-09-13T06:12:34.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48f954a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48f415b130 0x7f48f4159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48f954a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48f415b130 0x7f48f4159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48460/0 (socket says 172.21.15.130:48460) 2023-09-13T06:12:34.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48f954a640 1 -- 172.21.15.130:0/2410451192 learned_addr learned my addr 172.21.15.130:0/2410451192 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:34.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48ebfff640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48f40cc780 0x7f48f41566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.284+0000 7f48f8d49640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48f40b04a0 0x7f48f4156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48f954a640 1 -- 172.21.15.130:0/2410451192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48f40cc780 msgr2=0x7f48f41566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48f954a640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48f40cc780 0x7f48f41566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48f954a640 1 -- 172.21.15.130:0/2410451192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48f40b04a0 msgr2=0x7f48f4156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48f954a640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48f40b04a0 0x7f48f4156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48f954a640 1 -- 172.21.15.130:0/2410451192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec009a70 con 0x7f48f415b130 2023-09-13T06:12:34.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48f954a640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48f415b130 0x7f48f4159f40 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f48ec01a510 tx=0x7f48ec019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:34.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48e97fa640 1 -- 172.21.15.130:0/2410451192 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0add70 con 0x7f48f415b130 2023-09-13T06:12:34.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48e97fa640 1 -- 172.21.15.130:0/2410451192 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec009450 con 0x7f48f415b130 2023-09-13T06:12:34.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48fafad640 1 -- 172.21.15.130:0/2410451192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f41571b0 con 0x7f48f415b130 2023-09-13T06:12:34.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48e97fa640 1 -- 172.21.15.130:0/2410451192 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0b9690 con 0x7f48f415b130 2023-09-13T06:12:34.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48fafad640 1 -- 172.21.15.130:0/2410451192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f4156be0 con 0x7f48f415b130 2023-09-13T06:12:34.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48fafad640 1 -- 172.21.15.130:0/2410451192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f4155d50 con 0x7f48f415b130 2023-09-13T06:12:34.294 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48e97fa640 1 -- 172.21.15.130:0/2410451192 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f48ec0b97f0 con 0x7f48f415b130 2023-09-13T06:12:34.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48e97fa640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f48e0065b20 0x7f48e0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48e97fa640 1 -- 172.21.15.130:0/2410451192 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f48ec11ea90 con 0x7f48f415b130 2023-09-13T06:12:34.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48f8d49640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f48e0065b20 0x7f48e0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.288+0000 7f48e97fa640 1 -- 172.21.15.130:0/2410451192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f48e006d6b0 con 0x7f48f415b130 2023-09-13T06:12:34.295 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.292+0000 7f48f8d49640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f48e0065b20 0x7f48e0067fe0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f48f0000f70 tx=0x7f48f0007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:34.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.292+0000 7f48e97fa640 1 -- 172.21.15.130:0/2410451192 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f48ec0ec590 con 0x7f48f415b130 2023-09-13T06:12:34.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 -- 172.21.15.130:0/2410451192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48f40618a0 con 0x7f48f415b130 2023-09-13T06:12:34.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48e97fa640 1 -- 172.21.15.130:0/2410451192 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+16692 (secure 0 0 0) 0x7f48ec0b2030 con 0x7f48f415b130 2023-09-13T06:12:34.444 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:34.445 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":175,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:12:14.598851+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:11:15.244077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-09-13T06:11:16.070064+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:12:34.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 -- 172.21.15.130:0/2410451192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f48e0065b20 msgr2=0x7f48e0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f48e0065b20 0x7f48e0067fe0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f48f0000f70 tx=0x7f48f0007df0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 -- 172.21.15.130:0/2410451192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48f415b130 msgr2=0x7f48f4159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48f415b130 0x7f48f4159f40 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f48ec01a510 tx=0x7f48ec019680 comp rx=0 tx=0).stop 2023-09-13T06:12:34.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 -- 172.21.15.130:0/2410451192 shutdown_connections 2023-09-13T06:12:34.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f48e0065b20 0x7f48e0067fe0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48f415b130 0x7f48f4159f40 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f48f40cc780 0x7f48f41566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 --2- 172.21.15.130:0/2410451192 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48f40b04a0 0x7f48f4156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 -- 172.21.15.130:0/2410451192 >> 172.21.15.130:0/2410451192 conn(0x7f48f4065990 msgr2=0x7f48f41544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:34.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 -- 172.21.15.130:0/2410451192 shutdown_connections 2023-09-13T06:12:34.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.444+0000 7f48fafad640 1 -- 172.21.15.130:0/2410451192 wait complete. 2023-09-13T06:12:34.465 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:11:15.244077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '170', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:11:16.070064+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:12:34.466 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:12:34.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5b4ffa640 1 Processor -- start 2023-09-13T06:12:34.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5b4ffa640 1 -- start start 2023-09-13T06:12:34.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5b4ffa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5b00b31a0 0x7fe5b00ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5b4ffa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b00cc850 con 0x7fe5b015a080 2023-09-13T06:12:34.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5b4ffa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b00b0330 con 0x7fe5b00b1460 2023-09-13T06:12:34.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5b4ffa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b00cbcd0 con 0x7fe5b00b31a0 2023-09-13T06:12:34.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5ae59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe5b015a080 0x7fe5b015e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50928/0 (socket says 172.21.15.130:50928) 2023-09-13T06:12:34.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5ae59c640 1 -- 172.21.15.130:0/4136189757 learned_addr learned my addr 172.21.15.130:0/4136189757 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:34.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5aed9d640 1 --2- 172.21.15.130:0/4136189757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5b00b31a0 0x7fe5b00ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5add9b640 1 -- 172.21.15.130:0/4136189757 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737107985 0 0) 0x7fe5a0001120 con 0x7fe5b015a080 2023-09-13T06:12:34.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5add9b640 1 -- 172.21.15.130:0/4136189757 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe59c003530 con 0x7fe5b015a080 2023-09-13T06:12:34.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5add9b640 1 -- 172.21.15.130:0/4136189757 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435479764 0 0) 0x7fe5b00b0330 con 0x7fe5b00b1460 2023-09-13T06:12:34.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5add9b640 1 -- 172.21.15.130:0/4136189757 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a0001120 con 0x7fe5b00b1460 2023-09-13T06:12:34.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5aed9d640 1 -- 172.21.15.130:0/4136189757 >> v1:172.21.15.164:6789/0 conn(0x7fe5b00b1460 legacy=0x7fe5b00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5aed9d640 1 -- 172.21.15.130:0/4136189757 >> v1:172.21.15.130:6789/0 conn(0x7fe5b015a080 legacy=0x7fe5b015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5add9b640 1 -- 172.21.15.130:0/4136189757 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2219120049 0 0) 0x7fe59c003530 con 0x7fe5b015a080 2023-09-13T06:12:34.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.608+0000 7fe5aed9d640 1 -- 172.21.15.130:0/4136189757 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b00cbfb0 con 0x7fe5b00b31a0 2023-09-13T06:12:34.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.612+0000 7fe5aed9d640 1 --2- 172.21.15.130:0/4136189757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5b00b31a0 0x7fe5b00ccfe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009dc0 tx=0x7fe5a801c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c003ea498209703 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:34.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.612+0000 7fe5add9b640 1 -- 172.21.15.130:0/4136189757 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0001810 con 0x7fe5b00b31a0 2023-09-13T06:12:34.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.612+0000 7fe5add9b640 1 -- 172.21.15.130:0/4136189757 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a80a5520 con 0x7fe5b00b31a0 2023-09-13T06:12:34.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.612+0000 7fe5add9b640 1 -- 172.21.15.130:0/4136189757 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80a56b0 con 0x7fe5b00b31a0 2023-09-13T06:12:34.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.612+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/4136189757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5b00b31a0 msgr2=0x7fe5b00ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.612+0000 7fe5b4ffa640 1 --2- 172.21.15.130:0/4136189757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5b00b31a0 0x7fe5b00ccfe0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009dc0 tx=0x7fe5a801c7d0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.612+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/4136189757 shutdown_connections 2023-09-13T06:12:34.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.612+0000 7fe5b4ffa640 1 --2- 172.21.15.130:0/4136189757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5b00b31a0 0x7fe5b00ccfe0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.612+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/4136189757 >> 172.21.15.130:0/4136189757 conn(0x7fe5b0065990 msgr2=0x7fe5b0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:34.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.612+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/4136189757 shutdown_connections 2023-09-13T06:12:34.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.612+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/4136189757 wait complete. 2023-09-13T06:12:34.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5b4ffa640 1 Processor -- start 2023-09-13T06:12:34.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5b4ffa640 1 -- start start 2023-09-13T06:12:34.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5b4ffa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5b00b1460 0x7fe5b014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5b4ffa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5b00b31a0 0x7fe5b0151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5b4ffa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5b015a080 0x7fe5b014f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5b4ffa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0153b00 con 0x7fe5b00b1460 2023-09-13T06:12:34.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5b4ffa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0153de0 con 0x7fe5b015a080 2023-09-13T06:12:34.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5b4ffa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b01540c0 con 0x7fe5b00b31a0 2023-09-13T06:12:34.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5ae59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5b00b1460 0x7fe5b014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5ae59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5b00b1460 0x7fe5b014e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48472/0 (socket says 172.21.15.130:48472) 2023-09-13T06:12:34.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5ae59c640 1 -- 172.21.15.130:0/3704679285 learned_addr learned my addr 172.21.15.130:0/3704679285 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:34.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5aed9d640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5b015a080 0x7fe5b014f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5a5d9b640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5b00b31a0 0x7fe5b0151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5ae59c640 1 -- 172.21.15.130:0/3704679285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5b00b31a0 msgr2=0x7fe5b0151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5ae59c640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5b00b31a0 0x7fe5b0151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5ae59c640 1 -- 172.21.15.130:0/3704679285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5b015a080 msgr2=0x7fe5b014f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5ae59c640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5b015a080 0x7fe5b014f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5ae59c640 1 -- 172.21.15.130:0/3704679285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8009a70 con 0x7fe5b00b1460 2023-09-13T06:12:34.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5ae59c640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5b00b1460 0x7fe5b014e650 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000cad0 tx=0x7fe5a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:34.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.616+0000 7fe5a77fe640 1 -- 172.21.15.130:0/3704679285 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0005cf0 con 0x7fe5b00b1460 2023-09-13T06:12:34.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.620+0000 7fe5a77fe640 1 -- 172.21.15.130:0/3704679285 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a0005e50 con 0x7fe5b00b1460 2023-09-13T06:12:34.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.620+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/3704679285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b01543a0 con 0x7fe5b00b1460 2023-09-13T06:12:34.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.620+0000 7fe5a77fe640 1 -- 172.21.15.130:0/3704679285 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00072b0 con 0x7fe5b00b1460 2023-09-13T06:12:34.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.620+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/3704679285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b014eb90 con 0x7fe5b00b1460 2023-09-13T06:12:34.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.620+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/3704679285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b00618a0 con 0x7fe5b00b1460 2023-09-13T06:12:34.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.620+0000 7fe5a77fe640 1 -- 172.21.15.130:0/3704679285 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe5a0007410 con 0x7fe5b00b1460 2023-09-13T06:12:34.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.620+0000 7fe5a77fe640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe590065b20 0x7fe590067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.620+0000 7fe5a77fe640 1 -- 172.21.15.130:0/3704679285 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe5a0082ab0 con 0x7fe5b00b1460 2023-09-13T06:12:34.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.620+0000 7fe5a5d9b640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe590065b20 0x7fe590067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.620+0000 7fe5a77fe640 1 -- 172.21.15.130:0/3704679285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7fe59006d6b0 con 0x7fe5b00b1460 2023-09-13T06:12:34.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.620+0000 7fe5a5d9b640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe590065b20 0x7fe590067fe0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe5b01f8c60 tx=0x7fe598009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:34.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.624+0000 7fe5a77fe640 1 -- 172.21.15.130:0/3704679285 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe5a0017060 con 0x7fe5b00b1460 2023-09-13T06:12:34.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.776+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/3704679285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5b00cc850 con 0x7fe5b00b1460 2023-09-13T06:12:34.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.776+0000 7fe5a77fe640 1 -- 172.21.15.130:0/3704679285 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v175) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5b00cc850 con 0x7fe5b00b1460 2023-09-13T06:12:34.778 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:12:34.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/3704679285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe590065b20 msgr2=0x7fe590067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe590065b20 0x7fe590067fe0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe5b01f8c60 tx=0x7fe598009040 comp rx=0 tx=0).stop 2023-09-13T06:12:34.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/3704679285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5b00b1460 msgr2=0x7fe5b014e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5b00b1460 0x7fe5b014e650 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000cad0 tx=0x7fe5a000cf90 comp rx=0 tx=0).stop 2023-09-13T06:12:34.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/3704679285 shutdown_connections 2023-09-13T06:12:34.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe590065b20 0x7fe590067fe0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5b015a080 0x7fe5b014f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5b00b31a0 0x7fe5b0151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 --2- 172.21.15.130:0/3704679285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5b00b1460 0x7fe5b014e650 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/3704679285 >> 172.21.15.130:0/3704679285 conn(0x7fe5b0065990 msgr2=0x7fe5b00b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:34.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/3704679285 shutdown_connections 2023-09-13T06:12:34.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.780+0000 7fe5b4ffa640 1 -- 172.21.15.130:0/3704679285 wait complete. 2023-09-13T06:12:34.804 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:12:34.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582cb11640 1 Processor -- start 2023-09-13T06:12:34.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582cb11640 1 -- start start 2023-09-13T06:12:34.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582cb11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f582815ae10 0x7f58280d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582cb11640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582815dd40 con 0x7f58280d2b00 2023-09-13T06:12:34.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582cb11640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582815e020 con 0x7f58281619b0 2023-09-13T06:12:34.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582cb11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5828161e40 con 0x7f582815ae10 2023-09-13T06:12:34.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f5825d9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f58280d2b00 0x7f58281612a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50934/0 (socket says 172.21.15.130:50934) 2023-09-13T06:12:34.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f5825d9b640 1 -- 172.21.15.130:0/680018235 learned_addr learned my addr 172.21.15.130:0/680018235 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:34.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582659c640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f582815ae10 0x7f58280d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155466097 0 0) 0x7f582815dd40 con 0x7f58280d2b00 2023-09-13T06:12:34.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5810003530 con 0x7f58280d2b00 2023-09-13T06:12:34.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2708658273 0 0) 0x7f5810003530 con 0x7f58280d2b00 2023-09-13T06:12:34.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f582815ae10 msgr2=0x7f58280d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:34.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582559a640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f582815ae10 0x7f58280d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 >> v1:172.21.15.164:6789/0 conn(0x7f58281619b0 legacy=0x7f58280cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582815e300 con 0x7f58280d2b00 2023-09-13T06:12:34.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f581c001680 con 0x7f58280d2b00 2023-09-13T06:12:34.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.944+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 >> v1:172.21.15.130:6789/0 conn(0x7f58280d2b00 legacy=0x7f58281612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582559a640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5810003a20 0x7f5810003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582559a640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58100047d0 0x7f5810004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582559a640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f582815ae10 0x7f581000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828161e40 con 0x7f5810003a20 2023-09-13T06:12:34.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58100054d0 con 0x7f58100047d0 2023-09-13T06:12:34.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5810005690 con 0x7f582815ae10 2023-09-13T06:12:34.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582659c640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5810003a20 0x7f5810003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f5825d9b640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58100047d0 0x7f5810004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f5826d9d640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f582815ae10 0x7f581000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582659c640 1 -- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f582815ae10 msgr2=0x7f581000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:34.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582659c640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f582815ae10 0x7f581000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582659c640 1 -- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58100047d0 msgr2=0x7f5810004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:34.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582659c640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58100047d0 0x7f5810004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582659c640 1 -- 172.21.15.130:0/680018235 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5810003530 con 0x7f5810003a20 2023-09-13T06:12:34.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f5825d9b640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58100047d0 0x7f5810004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:34.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f5826d9d640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f582815ae10 0x7f581000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:34.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582659c640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5810003a20 0x7f5810003e40 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f5818009ae0 tx=0x7f581801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eceaaddf92d36642 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:34.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180a6510 con 0x7f5810003a20 2023-09-13T06:12:34.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58180a6670 con 0x7f5810003a20 2023-09-13T06:12:34.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.948+0000 7f582559a640 1 -- 172.21.15.130:0/680018235 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180a6a20 con 0x7f5810003a20 2023-09-13T06:12:34.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 -- 172.21.15.130:0/680018235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5810003a20 msgr2=0x7f5810003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 --2- 172.21.15.130:0/680018235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5810003a20 0x7f5810003e40 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f5818009ae0 tx=0x7f581801ca20 comp rx=0 tx=0).stop 2023-09-13T06:12:34.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f5826d9d640 1 -- 172.21.15.130:0/680018235 reap_dead start 2023-09-13T06:12:34.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 -- 172.21.15.130:0/680018235 shutdown_connections 2023-09-13T06:12:34.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 -- 172.21.15.130:0/680018235 >> 172.21.15.130:0/680018235 conn(0x7f5828065990 msgr2=0x7f5828065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:34.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 -- 172.21.15.130:0/680018235 shutdown_connections 2023-09-13T06:12:34.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 -- 172.21.15.130:0/680018235 wait complete. 2023-09-13T06:12:34.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 Processor -- start 2023-09-13T06:12:34.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 -- start start 2023-09-13T06:12:34.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5810003a20 0x7f5828154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58281582f0 0x7f58281589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5828158f00 0x7f582815fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828155510 con 0x7f5828158f00 2023-09-13T06:12:34.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58280c8e90 con 0x7f5810003a20 2023-09-13T06:12:34.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582cb11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58280c82f0 con 0x7f58281582f0 2023-09-13T06:12:34.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f5826d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5828158f00 0x7f582815fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f5826d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5828158f00 0x7f582815fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48492/0 (socket says 172.21.15.130:48492) 2023-09-13T06:12:34.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f5826d9d640 1 -- 172.21.15.130:0/2146666757 learned_addr learned my addr 172.21.15.130:0/2146666757 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:34.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f5825d9b640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58281582f0 0x7f58281589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582659c640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5810003a20 0x7f5828154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f5826d9d640 1 -- 172.21.15.130:0/2146666757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58281582f0 msgr2=0x7f58281589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f5826d9d640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58281582f0 0x7f58281589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f5826d9d640 1 -- 172.21.15.130:0/2146666757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5810003a20 msgr2=0x7f5828154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:34.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f5826d9d640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5810003a20 0x7f5828154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:34.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f5826d9d640 1 -- 172.21.15.130:0/2146666757 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58281f5e50 con 0x7f5828158f00 2023-09-13T06:12:34.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f5825d9b640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58281582f0 0x7f58281589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:34.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.952+0000 7f582659c640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5810003a20 0x7f5828154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:34.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f5826d9d640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5828158f00 0x7f582815fb70 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f5828161d90 tx=0x7f582000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:34.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f5816ffd640 1 -- 172.21.15.130:0/2146666757 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820017070 con 0x7f5828158f00 2023-09-13T06:12:34.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f5816ffd640 1 -- 172.21.15.130:0/2146666757 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820006b60 con 0x7f5828158f00 2023-09-13T06:12:34.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f5816ffd640 1 -- 172.21.15.130:0/2146666757 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820006d10 con 0x7f5828158f00 2023-09-13T06:12:34.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f582cb11640 1 -- 172.21.15.130:0/2146666757 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58280c8560 con 0x7f5828158f00 2023-09-13T06:12:34.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f582cb11640 1 -- 172.21.15.130:0/2146666757 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58280c8b20 con 0x7f5828158f00 2023-09-13T06:12:34.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f582cb11640 1 -- 172.21.15.130:0/2146666757 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582815d4f0 con 0x7f5828158f00 2023-09-13T06:12:34.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f5816ffd640 1 -- 172.21.15.130:0/2146666757 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5820003980 con 0x7f5828158f00 2023-09-13T06:12:34.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f5816ffd640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5808065b20 0x7f5808067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:34.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f5816ffd640 1 -- 172.21.15.130:0/2146666757 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5820082a60 con 0x7f5828158f00 2023-09-13T06:12:34.974 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f582659c640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5808065b20 0x7f5808067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:34.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.956+0000 7f5816ffd640 1 -- 172.21.15.130:0/2146666757 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f580806d6b0 con 0x7f5828158f00 2023-09-13T06:12:34.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.960+0000 7f582659c640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5808065b20 0x7f5808067fe0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f58180af000 tx=0x7f58180046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:34.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:34.960+0000 7f5816ffd640 1 -- 172.21.15.130:0/2146666757 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f58200502f0 con 0x7f5828158f00 2023-09-13T06:12:35.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 -- 172.21.15.130:0/2146666757 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58280618a0 con 0x7f5828158f00 2023-09-13T06:12:35.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f5816ffd640 1 -- 172.21.15.130:0/2146666757 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v175) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5820053910 con 0x7f5828158f00 2023-09-13T06:12:35.109 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:12:35.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 -- 172.21.15.130:0/2146666757 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5808065b20 msgr2=0x7f5808067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5808065b20 0x7f5808067fe0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f58180af000 tx=0x7f58180046d0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 -- 172.21.15.130:0/2146666757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5828158f00 msgr2=0x7f582815fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5828158f00 0x7f582815fb70 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f5828161d90 tx=0x7f582000eb90 comp rx=0 tx=0).stop 2023-09-13T06:12:35.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 -- 172.21.15.130:0/2146666757 shutdown_connections 2023-09-13T06:12:35.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5808065b20 0x7f5808067fe0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5828158f00 0x7f582815fb70 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58281582f0 0x7f58281589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 --2- 172.21.15.130:0/2146666757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5810003a20 0x7f5828154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 -- 172.21.15.130:0/2146666757 >> 172.21.15.130:0/2146666757 conn(0x7f5828065990 msgr2=0x7f58280b7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:35.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 -- 172.21.15.130:0/2146666757 shutdown_connections 2023-09-13T06:12:35.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.108+0000 7f582cb11640 1 -- 172.21.15.130:0/2146666757 wait complete. 2023-09-13T06:12:35.129 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:12:35.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.268+0000 7fdf4f59e640 1 Processor -- start 2023-09-13T06:12:35.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.268+0000 7fdf4f59e640 1 -- start start 2023-09-13T06:12:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4f59e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdf500cd130 0x7fdf500afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4f59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdf5015a0e0 0x7fdf500b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4f59e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf500b22b0 con 0x7fdf50159d00 2023-09-13T06:12:35.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4f59e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf500cd5e0 con 0x7fdf5015a0e0 2023-09-13T06:12:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4f59e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5015a5f0 con 0x7fdf500cd130 2023-09-13T06:12:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4ed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdf5015a0e0 0x7fdf500b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4ed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdf5015a0e0 0x7fdf500b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48504/0 (socket says 172.21.15.130:48504) 2023-09-13T06:12:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4ed9d640 1 -- 172.21.15.130:0/723575254 learned_addr learned my addr 172.21.15.130:0/723575254 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf45d9b640 1 --2- 172.21.15.130:0/723575254 >> v2:172.21.15.164:3300/0 conn(0x7fdf500cd130 0x7fdf500afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4ed9d640 1 -- 172.21.15.130:0/723575254 >> v2:172.21.15.164:3300/0 conn(0x7fdf500cd130 msgr2=0x7fdf500afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4ed9d640 1 --2- 172.21.15.130:0/723575254 >> v2:172.21.15.164:3300/0 conn(0x7fdf500cd130 0x7fdf500afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4ed9d640 1 -- 172.21.15.130:0/723575254 >> v1:172.21.15.164:6789/0 conn(0x7fdf50159d00 legacy=0x7fdf500cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4ed9d640 1 -- 172.21.15.130:0/723575254 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5015a8d0 con 0x7fdf5015a0e0 2023-09-13T06:12:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.272+0000 7fdf4ed9d640 1 --2- 172.21.15.130:0/723575254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf5015a0e0 0x7fdf500b03a0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fdf5004e1b0 tx=0x7fdf4801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bc0797143fe46d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4dd9b640 1 -- 172.21.15.130:0/723575254 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf480a57b0 con 0x7fdf5015a0e0 2023-09-13T06:12:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4dd9b640 1 -- 172.21.15.130:0/723575254 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf480a5910 con 0x7fdf5015a0e0 2023-09-13T06:12:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4dd9b640 1 -- 172.21.15.130:0/723575254 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf480a5ca0 con 0x7fdf5015a0e0 2023-09-13T06:12:35.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 -- 172.21.15.130:0/723575254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf5015a0e0 msgr2=0x7fdf500b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 --2- 172.21.15.130:0/723575254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf5015a0e0 0x7fdf500b03a0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fdf5004e1b0 tx=0x7fdf4801c8d0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 -- 172.21.15.130:0/723575254 shutdown_connections 2023-09-13T06:12:35.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 --2- 172.21.15.130:0/723575254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf5015a0e0 0x7fdf500b03a0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 --2- 172.21.15.130:0/723575254 >> v2:172.21.15.164:3300/0 conn(0x7fdf500cd130 0x7fdf500afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 -- 172.21.15.130:0/723575254 >> 172.21.15.130:0/723575254 conn(0x7fdf50065990 msgr2=0x7fdf50065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 -- 172.21.15.130:0/723575254 shutdown_connections 2023-09-13T06:12:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 -- 172.21.15.130:0/723575254 wait complete. 2023-09-13T06:12:35.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 Processor -- start 2023-09-13T06:12:35.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 -- start start 2023-09-13T06:12:35.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf500cd130 0x7fdf5014be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf50159d00 0x7fdf501f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf5015a0e0 0x7fdf5006ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501f50e0 con 0x7fdf5015a0e0 2023-09-13T06:12:35.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501f8bd0 con 0x7fdf50159d00 2023-09-13T06:12:35.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.276+0000 7fdf4f59e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501f8eb0 con 0x7fdf500cd130 2023-09-13T06:12:35.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf5015a0e0 0x7fdf5006ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf5015a0e0 0x7fdf5006ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48516/0 (socket says 172.21.15.130:48516) 2023-09-13T06:12:35.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4ed9d640 1 -- 172.21.15.130:0/1378224417 learned_addr learned my addr 172.21.15.130:0/1378224417 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:35.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf45d9b640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf50159d00 0x7fdf501f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4e59c640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf500cd130 0x7fdf5014be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4ed9d640 1 -- 172.21.15.130:0/1378224417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf500cd130 msgr2=0x7fdf5014be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4ed9d640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf500cd130 0x7fdf5014be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4ed9d640 1 -- 172.21.15.130:0/1378224417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf50159d00 msgr2=0x7fdf501f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4ed9d640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf50159d00 0x7fdf501f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4ed9d640 1 -- 172.21.15.130:0/1378224417 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf48009b30 con 0x7fdf5015a0e0 2023-09-13T06:12:35.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4ed9d640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf5015a0e0 0x7fdf5006ba80 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fdf4801a500 tx=0x7fdf48019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:35.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf477fe640 1 -- 172.21.15.130:0/1378224417 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf480b8880 con 0x7fdf5015a0e0 2023-09-13T06:12:35.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf477fe640 1 -- 172.21.15.130:0/1378224417 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf480b89e0 con 0x7fdf5015a0e0 2023-09-13T06:12:35.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf477fe640 1 -- 172.21.15.130:0/1378224417 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf480b8dd0 con 0x7fdf5015a0e0 2023-09-13T06:12:35.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4f59e640 1 -- 172.21.15.130:0/1378224417 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf501f9190 con 0x7fdf5015a0e0 2023-09-13T06:12:35.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4f59e640 1 -- 172.21.15.130:0/1378224417 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5014bb70 con 0x7fdf5015a0e0 2023-09-13T06:12:35.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf4f59e640 1 -- 172.21.15.130:0/1378224417 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf500618a0 con 0x7fdf5015a0e0 2023-09-13T06:12:35.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.280+0000 7fdf477fe640 1 -- 172.21.15.130:0/1378224417 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdf480b6440 con 0x7fdf5015a0e0 2023-09-13T06:12:35.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.284+0000 7fdf477fe640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf30065b20 0x7fdf30067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.284+0000 7fdf477fe640 1 -- 172.21.15.130:0/1378224417 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fdf4811eb20 con 0x7fdf5015a0e0 2023-09-13T06:12:35.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.284+0000 7fdf4e59c640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf30065b20 0x7fdf30067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.284+0000 7fdf477fe640 1 -- 172.21.15.130:0/1378224417 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7fdf3006d6b0 con 0x7fdf5015a0e0 2023-09-13T06:12:35.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.284+0000 7fdf4e59c640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf30065b20 0x7fdf30067fe0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdf40007fd0 tx=0x7fdf40007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:35.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.288+0000 7fdf477fe640 1 -- 172.21.15.130:0/1378224417 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdf480bc060 con 0x7fdf5015a0e0 2023-09-13T06:12:35.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.432+0000 7fdf4f59e640 1 -- 172.21.15.130:0/1378224417 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf500b3440 con 0x7fdf5015a0e0 2023-09-13T06:12:35.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.432+0000 7fdf477fe640 1 -- 172.21.15.130:0/1378224417 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v175) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf480ec610 con 0x7fdf5015a0e0 2023-09-13T06:12:35.435 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:12:35.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 -- 172.21.15.130:0/1378224417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf30065b20 msgr2=0x7fdf30067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf30065b20 0x7fdf30067fe0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdf40007fd0 tx=0x7fdf40007e40 comp rx=0 tx=0).stop 2023-09-13T06:12:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 -- 172.21.15.130:0/1378224417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf5015a0e0 msgr2=0x7fdf5006ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf5015a0e0 0x7fdf5006ba80 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fdf4801a500 tx=0x7fdf48019670 comp rx=0 tx=0).stop 2023-09-13T06:12:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 -- 172.21.15.130:0/1378224417 shutdown_connections 2023-09-13T06:12:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdf30065b20 0x7fdf30067fe0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdf50159d00 0x7fdf501f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf5015a0e0 0x7fdf5006ba80 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 --2- 172.21.15.130:0/1378224417 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdf500cd130 0x7fdf5014be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 -- 172.21.15.130:0/1378224417 >> 172.21.15.130:0/1378224417 conn(0x7fdf50065990 msgr2=0x7fdf50158310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 -- 172.21.15.130:0/1378224417 shutdown_connections 2023-09-13T06:12:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.436+0000 7fdf4f59e640 1 -- 172.21.15.130:0/1378224417 wait complete. 2023-09-13T06:12:35.455 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:12:35.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.592+0000 7eff31bc7640 1 Processor -- start 2023-09-13T06:12:35.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.592+0000 7eff31bc7640 1 -- start start 2023-09-13T06:12:35.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff31bc7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff2c159f20 0x7eff2c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff31bc7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2c0cdfc0 0x7eff2c0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff31bc7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c0ccfd0 con 0x7eff2c0b1610 2023-09-13T06:12:35.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff31bc7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c0b00f0 con 0x7eff2c159f20 2023-09-13T06:12:35.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff31bc7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0ce420 con 0x7eff2c0cdfc0 2023-09-13T06:12:35.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff2b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff2c159f20 0x7eff2c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff2bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7eff2c0b1610 0x7eff2c0ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50944/0 (socket says 172.21.15.130:50944) 2023-09-13T06:12:35.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff2bfff640 1 -- 172.21.15.130:0/4088988930 learned_addr learned my addr 172.21.15.130:0/4088988930 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:35.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff2affd640 1 --2- 172.21.15.130:0/4088988930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2c0cdfc0 0x7eff2c0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff2b7fe640 1 -- 172.21.15.130:0/4088988930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2c0cdfc0 msgr2=0x7eff2c0b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:35.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff2b7fe640 1 --2- 172.21.15.130:0/4088988930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2c0cdfc0 0x7eff2c0b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff2b7fe640 1 -- 172.21.15.130:0/4088988930 >> v1:172.21.15.130:6789/0 conn(0x7eff2c0b1610 legacy=0x7eff2c0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff2b7fe640 1 -- 172.21.15.130:0/4088988930 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0ced90 con 0x7eff2c159f20 2023-09-13T06:12:35.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff2affd640 1 --2- 172.21.15.130:0/4088988930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2c0cdfc0 0x7eff2c0b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:35.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.596+0000 7eff2a7fc640 1 -- 172.21.15.130:0/4088988930 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339429991 0 0) 0x7eff2c0ccfd0 con 0x7eff2c0b1610 2023-09-13T06:12:35.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff2b7fe640 1 --2- 172.21.15.130:0/4088988930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c159f20 0x7eff2c0ce7b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0097c0 tx=0x7eff1c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7aed710f0bdfaa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:35.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff2a7fc640 1 -- 172.21.15.130:0/4088988930 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0ab600 con 0x7eff2c159f20 2023-09-13T06:12:35.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff2a7fc640 1 -- 172.21.15.130:0/4088988930 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c0a7050 con 0x7eff2c159f20 2023-09-13T06:12:35.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff2a7fc640 1 -- 172.21.15.130:0/4088988930 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0ab980 con 0x7eff2c159f20 2023-09-13T06:12:35.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff31bc7640 1 -- 172.21.15.130:0/4088988930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c159f20 msgr2=0x7eff2c0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff31bc7640 1 --2- 172.21.15.130:0/4088988930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c159f20 0x7eff2c0ce7b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0097c0 tx=0x7eff1c01c480 comp rx=0 tx=0).stop 2023-09-13T06:12:35.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff31bc7640 1 -- 172.21.15.130:0/4088988930 shutdown_connections 2023-09-13T06:12:35.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff31bc7640 1 --2- 172.21.15.130:0/4088988930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2c0cdfc0 0x7eff2c0b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff31bc7640 1 --2- 172.21.15.130:0/4088988930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c159f20 0x7eff2c0ce7b0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff31bc7640 1 -- 172.21.15.130:0/4088988930 >> 172.21.15.130:0/4088988930 conn(0x7eff2c065990 msgr2=0x7eff2c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:35.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff31bc7640 1 -- 172.21.15.130:0/4088988930 shutdown_connections 2023-09-13T06:12:35.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff31bc7640 1 -- 172.21.15.130:0/4088988930 wait complete. 2023-09-13T06:12:35.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff31bc7640 1 Processor -- start 2023-09-13T06:12:35.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.600+0000 7eff31bc7640 1 -- start start 2023-09-13T06:12:35.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff31bc7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c0b1610 0x7eff2c141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff31bc7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff2c0cdfc0 0x7eff2c1487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff31bc7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2c159f20 0x7eff2c148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff31bc7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c14dc90 con 0x7eff2c0b1610 2023-09-13T06:12:35.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff31bc7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c149230 con 0x7eff2c0cdfc0 2023-09-13T06:12:35.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff31bc7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c14a580 con 0x7eff2c159f20 2023-09-13T06:12:35.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff2b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c0b1610 0x7eff2c141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff2b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c0b1610 0x7eff2c141d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48534/0 (socket says 172.21.15.130:48534) 2023-09-13T06:12:35.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff2b7fe640 1 -- 172.21.15.130:0/3828756957 learned_addr learned my addr 172.21.15.130:0/3828756957 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:35.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff2bfff640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2c159f20 0x7eff2c148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff2affd640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff2c0cdfc0 0x7eff2c1487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff2b7fe640 1 -- 172.21.15.130:0/3828756957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2c159f20 msgr2=0x7eff2c148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff2b7fe640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2c159f20 0x7eff2c148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff2b7fe640 1 -- 172.21.15.130:0/3828756957 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff2c0cdfc0 msgr2=0x7eff2c1487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff2b7fe640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff2c0cdfc0 0x7eff2c1487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff2b7fe640 1 -- 172.21.15.130:0/3828756957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c009420 con 0x7eff2c0b1610 2023-09-13T06:12:35.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff2b7fe640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c0b1610 0x7eff2c141d10 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7eff1c01a0b0 tx=0x7eff1c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:35.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff13fff640 1 -- 172.21.15.130:0/3828756957 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0b4840 con 0x7eff2c0b1610 2023-09-13T06:12:35.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff13fff640 1 -- 172.21.15.130:0/3828756957 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c0b49c0 con 0x7eff2c0b1610 2023-09-13T06:12:35.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff13fff640 1 -- 172.21.15.130:0/3828756957 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0b4d70 con 0x7eff2c0b1610 2023-09-13T06:12:35.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff31bc7640 1 -- 172.21.15.130:0/3828756957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c1f7520 con 0x7eff2c0b1610 2023-09-13T06:12:35.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff31bc7640 1 -- 172.21.15.130:0/3828756957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c1f7ae0 con 0x7eff2c0b1610 2023-09-13T06:12:35.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff31bc7640 1 -- 172.21.15.130:0/3828756957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c0618a0 con 0x7eff2c0b1610 2023-09-13T06:12:35.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.604+0000 7eff13fff640 1 -- 172.21.15.130:0/3828756957 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7eff1c0b2040 con 0x7eff2c0b1610 2023-09-13T06:12:35.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.608+0000 7eff13fff640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff18065b20 0x7eff18067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:35.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.608+0000 7eff13fff640 1 -- 172.21.15.130:0/3828756957 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7eff1c11d560 con 0x7eff2c0b1610 2023-09-13T06:12:35.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.608+0000 7eff13fff640 1 -- 172.21.15.130:0/3828756957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7eff1806d6a0 con 0x7eff2c0b1610 2023-09-13T06:12:35.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.608+0000 7eff2affd640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff18065b20 0x7eff18067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:35.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.608+0000 7eff2affd640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff18065b20 0x7eff18067fe0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7eff2c146e20 tx=0x7eff20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:35.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.612+0000 7eff13fff640 1 -- 172.21.15.130:0/3828756957 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7eff1c0b8060 con 0x7eff2c0b1610 2023-09-13T06:12:35.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.772+0000 7eff31bc7640 1 -- 172.21.15.130:0/3828756957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7eff2c0cd7c0 con 0x7eff2c0b1610 2023-09-13T06:12:35.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.772+0000 7eff13fff640 1 -- 172.21.15.130:0/3828756957 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v175) v1 ==== 80+0+0 (secure 0 0 0) 0x7eff1c0b0070 con 0x7eff2c0b1610 2023-09-13T06:12:35.774 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:12:35.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 -- 172.21.15.130:0/3828756957 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff18065b20 msgr2=0x7eff18067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff18065b20 0x7eff18067fe0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7eff2c146e20 tx=0x7eff20008040 comp rx=0 tx=0).stop 2023-09-13T06:12:35.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 -- 172.21.15.130:0/3828756957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c0b1610 msgr2=0x7eff2c141d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:35.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c0b1610 0x7eff2c141d10 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7eff1c01a0b0 tx=0x7eff1c019220 comp rx=0 tx=0).stop 2023-09-13T06:12:35.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 -- 172.21.15.130:0/3828756957 shutdown_connections 2023-09-13T06:12:35.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7eff18065b20 0x7eff18067fe0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff2c0cdfc0 0x7eff2c1487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2c159f20 0x7eff2c148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 --2- 172.21.15.130:0/3828756957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c0b1610 0x7eff2c141d10 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:35.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 -- 172.21.15.130:0/3828756957 >> 172.21.15.130:0/3828756957 conn(0x7eff2c065990 msgr2=0x7eff2c0ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:35.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 -- 172.21.15.130:0/3828756957 shutdown_connections 2023-09-13T06:12:35.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:35.776+0000 7eff31bc7640 1 -- 172.21.15.130:0/3828756957 wait complete. 2023-09-13T06:12:35.794 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T06:12:35.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:35.795 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-13T06:12:35.844 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:12:35.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:35.845 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T06:12:35.901 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:12:35.902 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:12:35.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:12:35.912 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:12:35.912 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:12:35.951 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:12:35.952 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:12:36.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.088+0000 7fc07399f640 1 Processor -- start 2023-09-13T06:12:36.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.088+0000 7fc07399f640 1 -- start start 2023-09-13T06:12:36.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc07399f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc06c159f20 0x7fc06c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc07399f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0b1d20 0x7fc06c0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc07399f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06c0ccfd0 con 0x7fc06c0cdfc0 2023-09-13T06:12:36.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc07399f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06c0b00f0 con 0x7fc06c159f20 2023-09-13T06:12:36.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc07399f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0b11d0 con 0x7fc06c0b1d20 2023-09-13T06:12:36.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc070f3a640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc06c0cdfc0 0x7fc06c0b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50948/0 (socket says 172.21.15.130:50948) 2023-09-13T06:12:36.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc070f3a640 1 -- 172.21.15.130:0/3034691101 learned_addr learned my addr 172.21.15.130:0/3034691101 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:36.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc07173b640 1 --2- 172.21.15.130:0/3034691101 >> v2:172.21.15.164:3300/0 conn(0x7fc06c159f20 0x7fc06c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc071f3c640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0b1d20 0x7fc06c0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538715102 0 0) 0x7fc06c0ccfd0 con 0x7fc06c0cdfc0 2023-09-13T06:12:36.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc058003530 con 0x7fc06c0cdfc0 2023-09-13T06:12:36.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503094672 0 0) 0x7fc058003530 con 0x7fc06c0cdfc0 2023-09-13T06:12:36.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0b1d20 msgr2=0x7fc06c0b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:36.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0b1d20 0x7fc06c0b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 >> v2:172.21.15.164:3300/0 conn(0x7fc06c159f20 msgr2=0x7fc06c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:36.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 --2- 172.21.15.130:0/3034691101 >> v2:172.21.15.164:3300/0 conn(0x7fc06c159f20 0x7fc06c0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c0ced90 con 0x7fc06c0cdfc0 2023-09-13T06:12:36.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fc05c001680 con 0x7fc06c0cdfc0 2023-09-13T06:12:36.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 >> v1:172.21.15.130:6789/0 conn(0x7fc06c0cdfc0 legacy=0x7fc06c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0b1d20 0x7fc0580039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc058003fc0 0x7fc0580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 0x7fc058005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0b11d0 con 0x7fc058004d10 2023-09-13T06:12:36.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05800dba0 con 0x7fc058003fc0 2023-09-13T06:12:36.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05800dd60 con 0x7fc06c0b1d20 2023-09-13T06:12:36.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc07173b640 1 --2- 172.21.15.130:0/3034691101 >> v2:172.21.15.164:3300/0 conn(0x7fc06c159f20 0x7fc06c0ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:12:36.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc071f3c640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 0x7fc058005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc070f3a640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc058003fc0 0x7fc0580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc07173b640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0b1d20 0x7fc0580039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc071f3c640 1 -- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0b1d20 msgr2=0x7fc0580039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:36.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc071f3c640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0b1d20 0x7fc0580039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc071f3c640 1 -- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc058003fc0 msgr2=0x7fc0580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:36.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc071f3c640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc058003fc0 0x7fc0580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc071f3c640 1 -- 172.21.15.130:0/3034691101 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058003530 con 0x7fc058004d10 2023-09-13T06:12:36.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.092+0000 7fc070f3a640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc058003fc0 0x7fc0580047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:36.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.096+0000 7fc071f3c640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 0x7fc058005190 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fc064009f90 tx=0x7fc06401ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9940e40c8176b9db server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:36.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.096+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640a5bb0 con 0x7fc058004d10 2023-09-13T06:12:36.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.096+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06400f040 con 0x7fc058004d10 2023-09-13T06:12:36.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.096+0000 7fc063fff640 1 -- 172.21.15.130:0/3034691101 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640ad440 con 0x7fc058004d10 2023-09-13T06:12:36.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.096+0000 7fc07399f640 1 -- 172.21.15.130:0/3034691101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 msgr2=0x7fc058005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.096+0000 7fc07399f640 1 --2- 172.21.15.130:0/3034691101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 0x7fc058005190 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fc064009f90 tx=0x7fc06401ccb0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.096+0000 7fc071f3c640 1 -- 172.21.15.130:0/3034691101 reap_dead start 2023-09-13T06:12:36.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.096+0000 7fc07399f640 1 -- 172.21.15.130:0/3034691101 shutdown_connections 2023-09-13T06:12:36.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.096+0000 7fc07399f640 1 -- 172.21.15.130:0/3034691101 >> 172.21.15.130:0/3034691101 conn(0x7fc06c065990 msgr2=0x7fc06c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:36.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.096+0000 7fc07399f640 1 -- 172.21.15.130:0/3034691101 shutdown_connections 2023-09-13T06:12:36.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.096+0000 7fc07399f640 1 -- 172.21.15.130:0/3034691101 wait complete. 2023-09-13T06:12:36.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07399f640 1 Processor -- start 2023-09-13T06:12:36.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07399f640 1 -- start start 2023-09-13T06:12:36.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07399f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 0x7fc06c149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07399f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0aa0b0 0x7fc06c0aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07399f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc06c153fd0 0x7fc06c154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07399f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0aaa50 con 0x7fc058004d10 2023-09-13T06:12:36.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07399f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c1549a0 con 0x7fc06c153fd0 2023-09-13T06:12:36.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07399f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0a8430 con 0x7fc06c0aa0b0 2023-09-13T06:12:36.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07173b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 0x7fc06c149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07173b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 0x7fc06c149b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48552/0 (socket says 172.21.15.130:48552) 2023-09-13T06:12:36.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07173b640 1 -- 172.21.15.130:0/2386034363 learned_addr learned my addr 172.21.15.130:0/2386034363 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:36.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc070f3a640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0aa0b0 0x7fc06c0aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07173b640 1 -- 172.21.15.130:0/2386034363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0aa0b0 msgr2=0x7fc06c0aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc071f3c640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc06c153fd0 0x7fc06c154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07173b640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0aa0b0 0x7fc06c0aa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07173b640 1 -- 172.21.15.130:0/2386034363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc06c153fd0 msgr2=0x7fc06c154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07173b640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc06c153fd0 0x7fc06c154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07173b640 1 -- 172.21.15.130:0/2386034363 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c0a8680 con 0x7fc058004d10 2023-09-13T06:12:36.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc071f3c640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc06c153fd0 0x7fc06c154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:36.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07173b640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 0x7fc06c149b70 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fc068011930 tx=0x7fc068011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:36.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc061ffb640 1 -- 172.21.15.130:0/2386034363 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc068009740 con 0x7fc058004d10 2023-09-13T06:12:36.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc061ffb640 1 -- 172.21.15.130:0/2386034363 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06800fb70 con 0x7fc058004d10 2023-09-13T06:12:36.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc061ffb640 1 -- 172.21.15.130:0/2386034363 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06800fee0 con 0x7fc058004d10 2023-09-13T06:12:36.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07399f640 1 -- 172.21.15.130:0/2386034363 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c0a8960 con 0x7fc058004d10 2023-09-13T06:12:36.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.100+0000 7fc07399f640 1 -- 172.21.15.130:0/2386034363 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c0a8f20 con 0x7fc058004d10 2023-09-13T06:12:36.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.104+0000 7fc07399f640 1 -- 172.21.15.130:0/2386034363 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c0618a0 con 0x7fc058004d10 2023-09-13T06:12:36.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.104+0000 7fc061ffb640 1 -- 172.21.15.130:0/2386034363 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc068015460 con 0x7fc058004d10 2023-09-13T06:12:36.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.104+0000 7fc061ffb640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc050065b20 0x7fc050067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.104+0000 7fc061ffb640 1 -- 172.21.15.130:0/2386034363 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc068083a80 con 0x7fc058004d10 2023-09-13T06:12:36.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.104+0000 7fc070f3a640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc050065b20 0x7fc050067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.104+0000 7fc061ffb640 1 -- 172.21.15.130:0/2386034363 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7fc05006d6b0 con 0x7fc058004d10 2023-09-13T06:12:36.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.104+0000 7fc070f3a640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc050065b20 0x7fc050067fe0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc05c001ec0 tx=0x7fc05c000f60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:36.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.108+0000 7fc061ffb640 1 -- 172.21.15.130:0/2386034363 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc068051310 con 0x7fc058004d10 2023-09-13T06:12:36.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.284+0000 7fc07399f640 1 -- 172.21.15.130:0/2386034363 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc06c0af2b0 con 0x7fc058004d10 2023-09-13T06:12:36.287 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc061ffb640 1 -- 172.21.15.130:0/2386034363 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fc068022070 con 0x7fc058004d10 2023-09-13T06:12:36.287 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:36.287 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2473585305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2473585305},{"type":"v1","addr":"172.21.15.130:6835","nonce":2473585305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1139512428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1139512428},{"type":"v1","addr":"172.21.15.164:6834","nonce":1139512428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2365480398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2365480398},{"type":"v1","addr":"172.21.15.164:6835","nonce":2365480398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:11:17.067978+0000","modified":"2023-09-13T06:11:20.112082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8646":{"gid":8646,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/597081287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":597081287},{"type":"v1","addr":"172.21.15.130:6837","nonce":597081287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-09-13T06:12:36.288 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 84 2023-09-13T06:12:36.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 -- 172.21.15.130:0/2386034363 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc050065b20 msgr2=0x7fc050067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc050065b20 0x7fc050067fe0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc05c001ec0 tx=0x7fc05c000f60 comp rx=0 tx=0).stop 2023-09-13T06:12:36.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 -- 172.21.15.130:0/2386034363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 msgr2=0x7fc06c149b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 0x7fc06c149b70 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fc068011930 tx=0x7fc068011df0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 -- 172.21.15.130:0/2386034363 shutdown_connections 2023-09-13T06:12:36.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc050065b20 0x7fc050067fe0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc06c153fd0 0x7fc06c154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc06c0aa0b0 0x7fc06c0aa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 --2- 172.21.15.130:0/2386034363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc058004d10 0x7fc06c149b70 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 -- 172.21.15.130:0/2386034363 >> 172.21.15.130:0/2386034363 conn(0x7fc06c065990 msgr2=0x7fc06c0cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:36.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 -- 172.21.15.130:0/2386034363 shutdown_connections 2023-09-13T06:12:36.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.288+0000 7fc07399f640 1 -- 172.21.15.130:0/2386034363 wait complete. 2023-09-13T06:12:36.308 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:12:36.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5996e0b640 1 Processor -- start 2023-09-13T06:12:36.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5996e0b640 1 -- start start 2023-09-13T06:12:36.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5996e0b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5990070890 0x7f5990167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5996e0b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59900d1ac0 con 0x7f59900d1f50 2023-09-13T06:12:36.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5996e0b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59900d0be0 con 0x7f5990146b30 2023-09-13T06:12:36.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5996e0b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59900d0eb0 con 0x7f5990070890 2023-09-13T06:12:36.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5995608640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f59900d1f50 0x7f5990070180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50956/0 (socket says 172.21.15.130:50956) 2023-09-13T06:12:36.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5995608640 1 -- 172.21.15.130:0/2854997495 learned_addr learned my addr 172.21.15.130:0/2854997495 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:36.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f599660a640 1 --2- 172.21.15.130:0/2854997495 >> v2:172.21.15.164:3300/0 conn(0x7f5990070890 0x7f5990167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285769664 0 0) 0x7f59900d1ac0 con 0x7f59900d1f50 2023-09-13T06:12:36.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f597c003530 con 0x7f59900d1f50 2023-09-13T06:12:36.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1102047545 0 0) 0x7f597c003530 con 0x7f59900d1f50 2023-09-13T06:12:36.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 >> v2:172.21.15.164:3300/0 conn(0x7f5990070890 msgr2=0x7f5990167dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:36.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 --2- 172.21.15.130:0/2854997495 >> v2:172.21.15.164:3300/0 conn(0x7f5990070890 0x7f5990167dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 >> v1:172.21.15.164:6789/0 conn(0x7f5990146b30 legacy=0x7f59900d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59900d1190 con 0x7f59900d1f50 2023-09-13T06:12:36.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f5980001680 con 0x7f59900d1f50 2023-09-13T06:12:36.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 >> v1:172.21.15.130:6789/0 conn(0x7f59900d1f50 legacy=0x7f5990070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f597c0039f0 0x7f597c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597c0047d0 0x7f597c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 0x7f597c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59900d0eb0 con 0x7f597c005190 2023-09-13T06:12:36.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c00c010 con 0x7f597c0039f0 2023-09-13T06:12:36.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c00c1d0 con 0x7f597c0047d0 2023-09-13T06:12:36.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f599660a640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 0x7f597c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5995e09640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f597c0039f0 0x7f597c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5995608640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597c0047d0 0x7f597c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f599660a640 1 -- 172.21.15.130:0/2854997495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597c0047d0 msgr2=0x7f597c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:36.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f599660a640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597c0047d0 0x7f597c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f599660a640 1 -- 172.21.15.130:0/2854997495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f597c0039f0 msgr2=0x7f597c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:36.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f599660a640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f597c0039f0 0x7f597c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f599660a640 1 -- 172.21.15.130:0/2854997495 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c003530 con 0x7f597c005190 2023-09-13T06:12:36.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.448+0000 7f5995608640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597c0047d0 0x7f597c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:36.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f599660a640 1 -- 172.21.15.130:0/2854997495 reap_dead start 2023-09-13T06:12:36.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f599660a640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 0x7f597c00b990 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f5988009f90 tx=0x7f598801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561be1a7a889917d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:36.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988003ba0 con 0x7f597c005190 2023-09-13T06:12:36.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598800f040 con 0x7f597c005190 2023-09-13T06:12:36.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f5994e07640 1 -- 172.21.15.130:0/2854997495 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59880a5960 con 0x7f597c005190 2023-09-13T06:12:36.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f5996e0b640 1 -- 172.21.15.130:0/2854997495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 msgr2=0x7f597c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f5996e0b640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 0x7f597c00b990 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f5988009f90 tx=0x7f598801cc60 comp rx=0 tx=0).stop 2023-09-13T06:12:36.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f5996e0b640 1 -- 172.21.15.130:0/2854997495 shutdown_connections 2023-09-13T06:12:36.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f5996e0b640 1 --2- 172.21.15.130:0/2854997495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 0x7f597c00b990 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f5996e0b640 1 -- 172.21.15.130:0/2854997495 >> 172.21.15.130:0/2854997495 conn(0x7f59900d3090 msgr2=0x7f59900d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:36.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f5996e0b640 1 -- 172.21.15.130:0/2854997495 shutdown_connections 2023-09-13T06:12:36.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.452+0000 7f5996e0b640 1 -- 172.21.15.130:0/2854997495 wait complete. 2023-09-13T06:12:36.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5996e0b640 1 Processor -- start 2023-09-13T06:12:36.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5996e0b640 1 -- start start 2023-09-13T06:12:36.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5996e0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 0x7f599014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5996e0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f599014f0a0 0x7f59901e6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5996e0b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59901e66b0 0x7f599013fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5996e0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5990141cf0 con 0x7f597c005190 2023-09-13T06:12:36.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5996e0b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59901e7110 con 0x7f59901e66b0 2023-09-13T06:12:36.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5996e0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599013d350 con 0x7f599014f0a0 2023-09-13T06:12:36.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5995e09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 0x7f599014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5995e09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 0x7f599014e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48572/0 (socket says 172.21.15.130:48572) 2023-09-13T06:12:36.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5995e09640 1 -- 172.21.15.130:0/65810049 learned_addr learned my addr 172.21.15.130:0/65810049 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:36.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5995608640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f599014f0a0 0x7f59901e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f599660a640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59901e66b0 0x7f599013fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5995e09640 1 -- 172.21.15.130:0/65810049 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f599014f0a0 msgr2=0x7f59901e6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5995e09640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f599014f0a0 0x7f59901e6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5995e09640 1 -- 172.21.15.130:0/65810049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59901e66b0 msgr2=0x7f599013fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5995e09640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59901e66b0 0x7f599013fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5995e09640 1 -- 172.21.15.130:0/65810049 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59901e6b50 con 0x7f597c005190 2023-09-13T06:12:36.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5995608640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f599014f0a0 0x7f59901e6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:36.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f599660a640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59901e66b0 0x7f599013fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:36.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5995e09640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 0x7f599014e8c0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f598c00f840 tx=0x7f598c00fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:36.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f59867fc640 1 -- 172.21.15.130:0/65810049 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c0052e0 con 0x7f597c005190 2023-09-13T06:12:36.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f59867fc640 1 -- 172.21.15.130:0/65810049 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c005440 con 0x7f597c005190 2023-09-13T06:12:36.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f59867fc640 1 -- 172.21.15.130:0/65810049 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c00d970 con 0x7f597c005190 2023-09-13T06:12:36.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5996e0b640 1 -- 172.21.15.130:0/65810049 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59901e6e30 con 0x7f597c005190 2023-09-13T06:12:36.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.456+0000 7f5996e0b640 1 -- 172.21.15.130:0/65810049 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5990142200 con 0x7f597c005190 2023-09-13T06:12:36.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.460+0000 7f5996e0b640 1 -- 172.21.15.130:0/65810049 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59900618a0 con 0x7f597c005190 2023-09-13T06:12:36.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.460+0000 7f59867fc640 1 -- 172.21.15.130:0/65810049 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f598c00dad0 con 0x7f597c005190 2023-09-13T06:12:36.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.460+0000 7f59867fc640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5974065b20 0x7f5974067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.460+0000 7f59867fc640 1 -- 172.21.15.130:0/65810049 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f598c083320 con 0x7f597c005190 2023-09-13T06:12:36.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.460+0000 7f5995608640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5974065b20 0x7f5974067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.460+0000 7f59867fc640 1 -- 172.21.15.130:0/65810049 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f597406d6b0 con 0x7f597c005190 2023-09-13T06:12:36.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.460+0000 7f5995608640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5974065b20 0x7f5974067fe0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5980000c10 tx=0x7f5980004810 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:36.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.464+0000 7f59867fc640 1 -- 172.21.15.130:0/65810049 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f598c050c40 con 0x7f597c005190 2023-09-13T06:12:36.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.612+0000 7f5996e0b640 1 -- 172.21.15.130:0/65810049 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59901e3990 con 0x7f597c005190 2023-09-13T06:12:36.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.612+0000 7f59867fc640 1 -- 172.21.15.130:0/65810049 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+16692 (secure 0 0 0) 0x7f598c054260 con 0x7f597c005190 2023-09-13T06:12:36.616 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:36.616 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":175,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:12:14.598851+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:11:15.244077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-09-13T06:11:16.070064+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:12:36.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 -- 172.21.15.130:0/65810049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5974065b20 msgr2=0x7f5974067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5974065b20 0x7f5974067fe0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5980000c10 tx=0x7f5980004810 comp rx=0 tx=0).stop 2023-09-13T06:12:36.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 -- 172.21.15.130:0/65810049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 msgr2=0x7f599014e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 0x7f599014e8c0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f598c00f840 tx=0x7f598c00fd00 comp rx=0 tx=0).stop 2023-09-13T06:12:36.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 -- 172.21.15.130:0/65810049 shutdown_connections 2023-09-13T06:12:36.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5974065b20 0x7f5974067fe0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59901e66b0 0x7f599013fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f599014f0a0 0x7f59901e6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 --2- 172.21.15.130:0/65810049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f597c005190 0x7f599014e8c0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 -- 172.21.15.130:0/65810049 >> 172.21.15.130:0/65810049 conn(0x7f59900d3090 msgr2=0x7f59900d3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:36.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 -- 172.21.15.130:0/65810049 shutdown_connections 2023-09-13T06:12:36.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.616+0000 7f5996e0b640 1 -- 172.21.15.130:0/65810049 wait complete. 2023-09-13T06:12:36.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:11:15.244077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '170', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:11:16.070064+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:12:36.637 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:12:36.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d7e5db640 1 Processor -- start 2023-09-13T06:12:36.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d7e5db640 1 -- start start 2023-09-13T06:12:36.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d7e5db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5d780b1460 0x7f5d780b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d7e5db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d780cc850 con 0x7f5d780b2fd0 2023-09-13T06:12:36.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d7e5db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d780b3420 con 0x7f5d7815a080 2023-09-13T06:12:36.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d7e5db640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d780b0330 con 0x7f5d780b1460 2023-09-13T06:12:36.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d7cb78640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5d780b2fd0 0x7f5d780ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50962/0 (socket says 172.21.15.130:50962) 2023-09-13T06:12:36.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d7cb78640 1 -- 172.21.15.130:0/947265556 learned_addr learned my addr 172.21.15.130:0/947265556 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:36.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d777fe640 1 --2- 172.21.15.130:0/947265556 >> v2:172.21.15.164:3300/0 conn(0x7f5d780b1460 0x7f5d780b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d76ffd640 1 -- 172.21.15.130:0/947265556 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987559106 0 0) 0x7f5d700014a0 con 0x7f5d780b2fd0 2023-09-13T06:12:36.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d76ffd640 1 -- 172.21.15.130:0/947265556 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d60003530 con 0x7f5d780b2fd0 2023-09-13T06:12:36.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d777fe640 1 -- 172.21.15.130:0/947265556 >> v1:172.21.15.164:6789/0 conn(0x7f5d7815a080 legacy=0x7f5d7815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d777fe640 1 -- 172.21.15.130:0/947265556 >> v1:172.21.15.130:6789/0 conn(0x7f5d780b2fd0 legacy=0x7f5d780ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.784+0000 7f5d777fe640 1 -- 172.21.15.130:0/947265556 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780cbcd0 con 0x7f5d780b1460 2023-09-13T06:12:36.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.788+0000 7f5d777fe640 1 --2- 172.21.15.130:0/947265556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d780b1460 0x7f5d780b2a90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0097c0 tx=0x7f5d6c01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a80d8963013a1930 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:36.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.788+0000 7f5d76ffd640 1 -- 172.21.15.130:0/947265556 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0ab600 con 0x7f5d780b1460 2023-09-13T06:12:36.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.788+0000 7f5d76ffd640 1 -- 172.21.15.130:0/947265556 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c0a7050 con 0x7f5d780b1460 2023-09-13T06:12:36.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.788+0000 7f5d76ffd640 1 -- 172.21.15.130:0/947265556 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0ab980 con 0x7f5d780b1460 2023-09-13T06:12:36.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.788+0000 7f5d7e5db640 1 -- 172.21.15.130:0/947265556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d780b1460 msgr2=0x7f5d780b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.788+0000 7f5d7e5db640 1 --2- 172.21.15.130:0/947265556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d780b1460 0x7f5d780b2a90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0097c0 tx=0x7f5d6c01c390 comp rx=0 tx=0).stop 2023-09-13T06:12:36.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.788+0000 7f5d7e5db640 1 -- 172.21.15.130:0/947265556 shutdown_connections 2023-09-13T06:12:36.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.788+0000 7f5d7e5db640 1 --2- 172.21.15.130:0/947265556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d780b1460 0x7f5d780b2a90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.788+0000 7f5d7e5db640 1 -- 172.21.15.130:0/947265556 >> 172.21.15.130:0/947265556 conn(0x7f5d78065990 msgr2=0x7f5d78065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:36.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.788+0000 7f5d7e5db640 1 -- 172.21.15.130:0/947265556 shutdown_connections 2023-09-13T06:12:36.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.788+0000 7f5d7e5db640 1 -- 172.21.15.130:0/947265556 wait complete. 2023-09-13T06:12:36.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7e5db640 1 Processor -- start 2023-09-13T06:12:36.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7e5db640 1 -- start start 2023-09-13T06:12:36.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7e5db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d780b1460 0x7f5d781530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7e5db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d780b2fd0 0x7f5d7813a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7e5db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7815a080 0x7f5d780ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7e5db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7815b5f0 con 0x7f5d7815a080 2023-09-13T06:12:36.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7e5db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7815c170 con 0x7f5d780b2fd0 2023-09-13T06:12:36.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7e5db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7815b840 con 0x7f5d780b1460 2023-09-13T06:12:36.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7cb78640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7815a080 0x7f5d780ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7cb78640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7815a080 0x7f5d780ad0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48584/0 (socket says 172.21.15.130:48584) 2023-09-13T06:12:36.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7cb78640 1 -- 172.21.15.130:0/669064559 learned_addr learned my addr 172.21.15.130:0/669064559 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:36.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d777fe640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d780b2fd0 0x7f5d7813a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d77fff640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d780b1460 0x7f5d781530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7cb78640 1 -- 172.21.15.130:0/669064559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d780b1460 msgr2=0x7f5d781530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7cb78640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d780b1460 0x7f5d781530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7cb78640 1 -- 172.21.15.130:0/669064559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d780b2fd0 msgr2=0x7f5d7813a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7cb78640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d780b2fd0 0x7f5d7813a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7cb78640 1 -- 172.21.15.130:0/669064559 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c009420 con 0x7f5d7815a080 2023-09-13T06:12:36.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7cb78640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7815a080 0x7f5d780ad0b0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000cb40 tx=0x7f5d7000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:36.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d74ff9640 1 -- 172.21.15.130:0/669064559 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000aca0 con 0x7f5d7815a080 2023-09-13T06:12:36.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d74ff9640 1 -- 172.21.15.130:0/669064559 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7000ae00 con 0x7f5d7815a080 2023-09-13T06:12:36.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d74ff9640 1 -- 172.21.15.130:0/669064559 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70012620 con 0x7f5d7815a080 2023-09-13T06:12:36.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7e5db640 1 -- 172.21.15.130:0/669064559 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7815bb20 con 0x7f5d7815a080 2023-09-13T06:12:36.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.792+0000 7f5d7e5db640 1 -- 172.21.15.130:0/669064559 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7813ace0 con 0x7f5d7815a080 2023-09-13T06:12:36.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.796+0000 7f5d7e5db640 1 -- 172.21.15.130:0/669064559 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7815c2e0 con 0x7f5d7815a080 2023-09-13T06:12:36.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.796+0000 7f5d74ff9640 1 -- 172.21.15.130:0/669064559 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5d70007070 con 0x7f5d7815a080 2023-09-13T06:12:36.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.796+0000 7f5d74ff9640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d64065b50 0x7f5d64068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:36.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.796+0000 7f5d74ff9640 1 -- 172.21.15.130:0/669064559 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5d70083150 con 0x7f5d7815a080 2023-09-13T06:12:36.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.796+0000 7f5d77fff640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d64065b50 0x7f5d64068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:36.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.796+0000 7f5d74ff9640 1 -- 172.21.15.130:0/669064559 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f5d6406d6e0 con 0x7f5d7815a080 2023-09-13T06:12:36.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.796+0000 7f5d77fff640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d64065b50 0x7f5d64068010 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5d68007fd0 tx=0x7f5d68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:36.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.800+0000 7f5d74ff9640 1 -- 172.21.15.130:0/669064559 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5d70017060 con 0x7f5d7815a080 2023-09-13T06:12:36.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.948+0000 7f5d7e5db640 1 -- 172.21.15.130:0/669064559 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d780cc850 con 0x7f5d7815a080 2023-09-13T06:12:36.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.948+0000 7f5d74ff9640 1 -- 172.21.15.130:0/669064559 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v175) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d780cc850 con 0x7f5d7815a080 2023-09-13T06:12:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:12:36.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 -- 172.21.15.130:0/669064559 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d64065b50 msgr2=0x7f5d64068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d64065b50 0x7f5d64068010 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5d68007fd0 tx=0x7f5d68009040 comp rx=0 tx=0).stop 2023-09-13T06:12:36.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 -- 172.21.15.130:0/669064559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7815a080 msgr2=0x7f5d780ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:36.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7815a080 0x7f5d780ad0b0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000cb40 tx=0x7f5d7000a060 comp rx=0 tx=0).stop 2023-09-13T06:12:36.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 -- 172.21.15.130:0/669064559 shutdown_connections 2023-09-13T06:12:36.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d64065b50 0x7f5d64068010 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d780b2fd0 0x7f5d7813a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7815a080 0x7f5d780ad0b0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 --2- 172.21.15.130:0/669064559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d780b1460 0x7f5d781530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:36.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 -- 172.21.15.130:0/669064559 >> 172.21.15.130:0/669064559 conn(0x7f5d78065990 msgr2=0x7f5d78065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:36.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 -- 172.21.15.130:0/669064559 shutdown_connections 2023-09-13T06:12:36.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:36.952+0000 7f5d7e5db640 1 -- 172.21.15.130:0/669064559 wait complete. 2023-09-13T06:12:36.971 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:12:37.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb0bb11640 1 Processor -- start 2023-09-13T06:12:37.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb0bb11640 1 -- start start 2023-09-13T06:12:37.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb0bb11640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdb04157750 0x7fdb04160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb0bb11640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdb04157b30 0x7fdb0406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb0bb11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb0406f170 0x7fdb0406f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb0bb11640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb040ae0d0 con 0x7fdb04157b30 2023-09-13T06:12:37.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb0bb11640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb04161e60 con 0x7fdb04157750 2023-09-13T06:12:37.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb0bb11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041615c0 con 0x7fdb0406f170 2023-09-13T06:12:37.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb090ac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdb04157b30 0x7fdb0406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb090ac640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdb04157b30 0x7fdb0406dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48586/0 (socket says 172.21.15.130:48586) 2023-09-13T06:12:37.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb090ac640 1 -- 172.21.15.130:0/2579664910 learned_addr learned my addr 172.21.15.130:0/2579664910 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:37.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb0a0ae640 1 --2- 172.21.15.130:0/2579664910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb0406f170 0x7fdb0406f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb098ad640 1 --2- 172.21.15.130:0/2579664910 >> v2:172.21.15.164:3300/0 conn(0x7fdb04157750 0x7fdb04160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb090ac640 1 -- 172.21.15.130:0/2579664910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb0406f170 msgr2=0x7fdb0406f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:37.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb090ac640 1 --2- 172.21.15.130:0/2579664910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb0406f170 0x7fdb0406f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb090ac640 1 -- 172.21.15.130:0/2579664910 >> v2:172.21.15.164:3300/0 conn(0x7fdb04157750 msgr2=0x7fdb04160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:37.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb090ac640 1 --2- 172.21.15.130:0/2579664910 >> v2:172.21.15.164:3300/0 conn(0x7fdb04157750 0x7fdb04160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb090ac640 1 -- 172.21.15.130:0/2579664910 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb041618a0 con 0x7fdb04157b30 2023-09-13T06:12:37.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.112+0000 7fdb0a0ae640 1 --2- 172.21.15.130:0/2579664910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb0406f170 0x7fdb0406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:37.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb090ac640 1 --2- 172.21.15.130:0/2579664910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb04157b30 0x7fdb0406dba0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fdb040664d0 tx=0x7fdaf401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb8778bd0820451 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:37.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb088ab640 1 -- 172.21.15.130:0/2579664910 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40aa5f0 con 0x7fdb04157b30 2023-09-13T06:12:37.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb088ab640 1 -- 172.21.15.130:0/2579664910 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40aa750 con 0x7fdb04157b30 2023-09-13T06:12:37.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb088ab640 1 -- 172.21.15.130:0/2579664910 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40aaae0 con 0x7fdb04157b30 2023-09-13T06:12:37.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb0bb11640 1 -- 172.21.15.130:0/2579664910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb04157b30 msgr2=0x7fdb0406dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb0bb11640 1 --2- 172.21.15.130:0/2579664910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb04157b30 0x7fdb0406dba0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fdb040664d0 tx=0x7fdaf401c4d0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb0bb11640 1 -- 172.21.15.130:0/2579664910 shutdown_connections 2023-09-13T06:12:37.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb0bb11640 1 --2- 172.21.15.130:0/2579664910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb0406f170 0x7fdb0406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb0bb11640 1 --2- 172.21.15.130:0/2579664910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb04157b30 0x7fdb0406dba0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb0bb11640 1 --2- 172.21.15.130:0/2579664910 >> v2:172.21.15.164:3300/0 conn(0x7fdb04157750 0x7fdb04160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb0bb11640 1 -- 172.21.15.130:0/2579664910 >> 172.21.15.130:0/2579664910 conn(0x7fdb04065d60 msgr2=0x7fdb040b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:37.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb0bb11640 1 -- 172.21.15.130:0/2579664910 shutdown_connections 2023-09-13T06:12:37.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.116+0000 7fdb0bb11640 1 -- 172.21.15.130:0/2579664910 wait complete. 2023-09-13T06:12:37.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0bb11640 1 Processor -- start 2023-09-13T06:12:37.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0bb11640 1 -- start start 2023-09-13T06:12:37.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0bb11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb0406f170 0x7fdb04146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0bb11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb04157750 0x7fdb040af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0bb11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb04157b30 0x7fdb040aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0bb11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040b06f0 con 0x7fdb04157750 2023-09-13T06:12:37.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0bb11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04155a70 con 0x7fdb0406f170 2023-09-13T06:12:37.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0bb11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041470c0 con 0x7fdb04157b30 2023-09-13T06:12:37.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb090ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb04157750 0x7fdb040af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb090ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb04157750 0x7fdb040af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48596/0 (socket says 172.21.15.130:48596) 2023-09-13T06:12:37.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb090ac640 1 -- 172.21.15.130:0/400579011 learned_addr learned my addr 172.21.15.130:0/400579011 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:37.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb098ad640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb0406f170 0x7fdb04146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0a0ae640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb04157b30 0x7fdb040aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb090ac640 1 -- 172.21.15.130:0/400579011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb04157b30 msgr2=0x7fdb040aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb090ac640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb04157b30 0x7fdb040aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb090ac640 1 -- 172.21.15.130:0/400579011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb0406f170 msgr2=0x7fdb04146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb090ac640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb0406f170 0x7fdb04146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb090ac640 1 -- 172.21.15.130:0/400579011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40094d0 con 0x7fdb04157750 2023-09-13T06:12:37.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0a0ae640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb04157b30 0x7fdb040aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:37.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb090ac640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb04157750 0x7fdb040af350 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fdaf401ab80 tx=0x7fdaf401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:37.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdafa7fc640 1 -- 172.21.15.130:0/400579011 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40b3800 con 0x7fdb04157750 2023-09-13T06:12:37.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdafa7fc640 1 -- 172.21.15.130:0/400579011 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40b3980 con 0x7fdb04157750 2023-09-13T06:12:37.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdafa7fc640 1 -- 172.21.15.130:0/400579011 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40b3d30 con 0x7fdb04157750 2023-09-13T06:12:37.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0bb11640 1 -- 172.21.15.130:0/400579011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb040af890 con 0x7fdb04157750 2023-09-13T06:12:37.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0bb11640 1 -- 172.21.15.130:0/400579011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb041f6270 con 0x7fdb04157750 2023-09-13T06:12:37.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.120+0000 7fdb0bb11640 1 -- 172.21.15.130:0/400579011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb040cbfd0 con 0x7fdb04157750 2023-09-13T06:12:37.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.124+0000 7fdafa7fc640 1 -- 172.21.15.130:0/400579011 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdaf40b2380 con 0x7fdb04157750 2023-09-13T06:12:37.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.124+0000 7fdafa7fc640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdae8065b20 0x7fdae8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.124+0000 7fdafa7fc640 1 -- 172.21.15.130:0/400579011 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fdaf40a7070 con 0x7fdb04157750 2023-09-13T06:12:37.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.124+0000 7fdb098ad640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdae8065b20 0x7fdae8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.124+0000 7fdafa7fc640 1 -- 172.21.15.130:0/400579011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7fdae806d6b0 con 0x7fdb04157750 2023-09-13T06:12:37.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.124+0000 7fdb098ad640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdae8065b20 0x7fdae8067fe0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdb00007a60 tx=0x7fdb00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:37.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.128+0000 7fdafa7fc640 1 -- 172.21.15.130:0/400579011 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdaf40eaf40 con 0x7fdb04157750 2023-09-13T06:12:37.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.272+0000 7fdb0bb11640 1 -- 172.21.15.130:0/400579011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb040618a0 con 0x7fdb04157750 2023-09-13T06:12:37.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.272+0000 7fdafa7fc640 1 -- 172.21.15.130:0/400579011 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v175) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdaf40c3020 con 0x7fdb04157750 2023-09-13T06:12:37.276 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:12:37.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 -- 172.21.15.130:0/400579011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdae8065b20 msgr2=0x7fdae8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdae8065b20 0x7fdae8067fe0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdb00007a60 tx=0x7fdb00008040 comp rx=0 tx=0).stop 2023-09-13T06:12:37.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 -- 172.21.15.130:0/400579011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb04157750 msgr2=0x7fdb040af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb04157750 0x7fdb040af350 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fdaf401ab80 tx=0x7fdaf401ad10 comp rx=0 tx=0).stop 2023-09-13T06:12:37.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 -- 172.21.15.130:0/400579011 shutdown_connections 2023-09-13T06:12:37.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdae8065b20 0x7fdae8067fe0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb04157b30 0x7fdb040aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb04157750 0x7fdb040af350 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 --2- 172.21.15.130:0/400579011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb0406f170 0x7fdb04146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 -- 172.21.15.130:0/400579011 >> 172.21.15.130:0/400579011 conn(0x7fdb04065d60 msgr2=0x7fdb0415bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:37.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 -- 172.21.15.130:0/400579011 shutdown_connections 2023-09-13T06:12:37.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.276+0000 7fdb0bb11640 1 -- 172.21.15.130:0/400579011 wait complete. 2023-09-13T06:12:37.295 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:12:37.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec0406d640 1 Processor -- start 2023-09-13T06:12:37.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec0406d640 1 -- start start 2023-09-13T06:12:37.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec0406d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7febfc15ae10 0x7febfc0d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec0406d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febfc1619b0 0x7febfc0cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec0406d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc15dd40 con 0x7febfc0d2b00 2023-09-13T06:12:37.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec0406d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc161e40 con 0x7febfc15ae10 2023-09-13T06:12:37.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec0406d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc15e020 con 0x7febfc1619b0 2023-09-13T06:12:37.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec01e09640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7febfc15ae10 0x7febfc0d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec01e09640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7febfc15ae10 0x7febfc0d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48612/0 (socket says 172.21.15.130:48612) 2023-09-13T06:12:37.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec01e09640 1 -- 172.21.15.130:0/739460829 learned_addr learned my addr 172.21.15.130:0/739460829 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:37.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec0260a640 1 --2- 172.21.15.130:0/739460829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febfc1619b0 0x7febfc0cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec01e09640 1 -- 172.21.15.130:0/739460829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febfc1619b0 msgr2=0x7febfc0cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:37.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec01e09640 1 --2- 172.21.15.130:0/739460829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febfc1619b0 0x7febfc0cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec01e09640 1 -- 172.21.15.130:0/739460829 >> v1:172.21.15.164:6789/0 conn(0x7febfc0d2b00 legacy=0x7febfc1612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec01e09640 1 -- 172.21.15.130:0/739460829 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc15e300 con 0x7febfc15ae10 2023-09-13T06:12:37.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.436+0000 7fec0260a640 1 --2- 172.21.15.130:0/739460829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febfc1619b0 0x7febfc0cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:37.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec01e09640 1 --2- 172.21.15.130:0/739460829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc15ae10 0x7febfc0d25c0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7febf8009870 tx=0x7febf801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f755677a32ac89c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:37.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec00e07640 1 -- 172.21.15.130:0/739460829 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80ab610 con 0x7febfc15ae10 2023-09-13T06:12:37.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec00e07640 1 -- 172.21.15.130:0/739460829 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80ab770 con 0x7febfc15ae10 2023-09-13T06:12:37.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec00e07640 1 -- 172.21.15.130:0/739460829 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80abb00 con 0x7febfc15ae10 2023-09-13T06:12:37.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec0406d640 1 -- 172.21.15.130:0/739460829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc15ae10 msgr2=0x7febfc0d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec0406d640 1 --2- 172.21.15.130:0/739460829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc15ae10 0x7febfc0d25c0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7febf8009870 tx=0x7febf801c3f0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec0406d640 1 -- 172.21.15.130:0/739460829 shutdown_connections 2023-09-13T06:12:37.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec0406d640 1 --2- 172.21.15.130:0/739460829 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febfc1619b0 0x7febfc0cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec0406d640 1 --2- 172.21.15.130:0/739460829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc15ae10 0x7febfc0d25c0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec0406d640 1 -- 172.21.15.130:0/739460829 >> 172.21.15.130:0/739460829 conn(0x7febfc065990 msgr2=0x7febfc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:37.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec0406d640 1 -- 172.21.15.130:0/739460829 shutdown_connections 2023-09-13T06:12:37.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.440+0000 7fec0406d640 1 -- 172.21.15.130:0/739460829 wait complete. 2023-09-13T06:12:37.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec0406d640 1 Processor -- start 2023-09-13T06:12:37.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec0406d640 1 -- start start 2023-09-13T06:12:37.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec0406d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc0d2b00 0x7febfc160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec0406d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febfc15ae10 0x7febfc14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec0406d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febfc1619b0 0x7febfc1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec0406d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc15f980 con 0x7febfc0d2b00 2023-09-13T06:12:37.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec0406d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc15f4f0 con 0x7febfc1619b0 2023-09-13T06:12:37.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec0406d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc14e0e0 con 0x7febfc15ae10 2023-09-13T06:12:37.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec01e09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc0d2b00 0x7febfc160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.459 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec01e09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc0d2b00 0x7febfc160430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48614/0 (socket says 172.21.15.130:48614) 2023-09-13T06:12:37.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec01e09640 1 -- 172.21.15.130:0/2558825654 learned_addr learned my addr 172.21.15.130:0/2558825654 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:37.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec0260a640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febfc1619b0 0x7febfc1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec01608640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febfc15ae10 0x7febfc14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec01e09640 1 -- 172.21.15.130:0/2558825654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febfc15ae10 msgr2=0x7febfc14dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec01e09640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febfc15ae10 0x7febfc14dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec01e09640 1 -- 172.21.15.130:0/2558825654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febfc1619b0 msgr2=0x7febfc1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec01e09640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febfc1619b0 0x7febfc1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec01e09640 1 -- 172.21.15.130:0/2558825654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80094d0 con 0x7febfc0d2b00 2023-09-13T06:12:37.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec01e09640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc0d2b00 0x7febfc160430 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7febf80ad040 tx=0x7febf801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:37.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7febf27fc640 1 -- 172.21.15.130:0/2558825654 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80ab610 con 0x7febfc0d2b00 2023-09-13T06:12:37.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7febf27fc640 1 -- 172.21.15.130:0/2558825654 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80b4820 con 0x7febfc0d2b00 2023-09-13T06:12:37.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec0406d640 1 -- 172.21.15.130:0/2558825654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc159710 con 0x7febfc0d2b00 2023-09-13T06:12:37.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7febf27fc640 1 -- 172.21.15.130:0/2558825654 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80b4bd0 con 0x7febfc0d2b00 2023-09-13T06:12:37.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.444+0000 7fec0406d640 1 -- 172.21.15.130:0/2558825654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc15eea0 con 0x7febfc0d2b00 2023-09-13T06:12:37.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.448+0000 7fec0406d640 1 -- 172.21.15.130:0/2558825654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc0618a0 con 0x7febfc0d2b00 2023-09-13T06:12:37.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.448+0000 7febf27fc640 1 -- 172.21.15.130:0/2558825654 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7febf80b4d30 con 0x7febfc0d2b00 2023-09-13T06:12:37.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.448+0000 7febf27fc640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7febe0065b20 0x7febe0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.448+0000 7febf27fc640 1 -- 172.21.15.130:0/2558825654 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7febf811de10 con 0x7febfc0d2b00 2023-09-13T06:12:37.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.448+0000 7fec01608640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7febe0065b20 0x7febe0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.448+0000 7febf27fc640 1 -- 172.21.15.130:0/2558825654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7febe006d6b0 con 0x7febfc0d2b00 2023-09-13T06:12:37.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.448+0000 7fec01608640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7febe0065b20 0x7febe0067fe0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7febfc158dc0 tx=0x7febec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:37.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.452+0000 7febf27fc640 1 -- 172.21.15.130:0/2558825654 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7febf8121030 con 0x7febfc0d2b00 2023-09-13T06:12:37.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 -- 172.21.15.130:0/2558825654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febfc0b37e0 con 0x7febfc0d2b00 2023-09-13T06:12:37.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7febf27fc640 1 -- 172.21.15.130:0/2558825654 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v175) v1 ==== 100+0+11 (secure 0 0 0) 0x7febf80c4030 con 0x7febfc0d2b00 2023-09-13T06:12:37.612 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:12:37.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 -- 172.21.15.130:0/2558825654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7febe0065b20 msgr2=0x7febe0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7febe0065b20 0x7febe0067fe0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7febfc158dc0 tx=0x7febec009040 comp rx=0 tx=0).stop 2023-09-13T06:12:37.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 -- 172.21.15.130:0/2558825654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc0d2b00 msgr2=0x7febfc160430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc0d2b00 0x7febfc160430 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7febf80ad040 tx=0x7febf801ac30 comp rx=0 tx=0).stop 2023-09-13T06:12:37.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 -- 172.21.15.130:0/2558825654 shutdown_connections 2023-09-13T06:12:37.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7febe0065b20 0x7febe0067fe0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febfc1619b0 0x7febfc1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febfc15ae10 0x7febfc14dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 --2- 172.21.15.130:0/2558825654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc0d2b00 0x7febfc160430 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 -- 172.21.15.130:0/2558825654 >> 172.21.15.130:0/2558825654 conn(0x7febfc065990 msgr2=0x7febfc161000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:37.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 -- 172.21.15.130:0/2558825654 shutdown_connections 2023-09-13T06:12:37.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.612+0000 7fec0406d640 1 -- 172.21.15.130:0/2558825654 wait complete. 2023-09-13T06:12:37.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:12:37.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.772+0000 7f1db82ec640 1 Processor -- start 2023-09-13T06:12:37.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.772+0000 7f1db82ec640 1 -- start start 2023-09-13T06:12:37.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.772+0000 7f1db82ec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1db00b2da0 0x7f1db006f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.772+0000 7f1db82ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00cf2a0 0x7f1db0160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.772+0000 7f1db82ec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db015d9e0 con 0x7f1db006fc70 2023-09-13T06:12:37.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.772+0000 7f1db82ec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db015e660 con 0x7f1db00b2da0 2023-09-13T06:12:37.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.772+0000 7f1db82ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db015dcc0 con 0x7f1db00cf2a0 2023-09-13T06:12:37.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.772+0000 7f1db6088640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1db00b2da0 0x7f1db006f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.772+0000 7f1db6088640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1db00b2da0 0x7f1db006f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48624/0 (socket says 172.21.15.130:48624) 2023-09-13T06:12:37.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.772+0000 7f1db6088640 1 -- 172.21.15.130:0/728732765 learned_addr learned my addr 172.21.15.130:0/728732765 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:37.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.772+0000 7f1db6889640 1 --2- 172.21.15.130:0/728732765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00cf2a0 0x7f1db0160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.776+0000 7f1db6088640 1 -- 172.21.15.130:0/728732765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00cf2a0 msgr2=0x7f1db0160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:37.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.776+0000 7f1db6088640 1 --2- 172.21.15.130:0/728732765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00cf2a0 0x7f1db0160ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.776+0000 7f1db6088640 1 -- 172.21.15.130:0/728732765 >> v1:172.21.15.164:6789/0 conn(0x7f1db006fc70 legacy=0x7f1db00ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.776+0000 7f1db6088640 1 -- 172.21.15.130:0/728732765 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db015dfa0 con 0x7f1db00b2da0 2023-09-13T06:12:37.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.776+0000 7f1db6889640 1 --2- 172.21.15.130:0/728732765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00cf2a0 0x7f1db0160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:37.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.776+0000 7f1db6088640 1 --2- 172.21.15.130:0/728732765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db00b2da0 0x7f1db006f730 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009870 tx=0x7f1dac01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4302a9d5bc115f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:37.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.776+0000 7f1db5086640 1 -- 172.21.15.130:0/728732765 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0a8a30 con 0x7f1db00b2da0 2023-09-13T06:12:37.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.776+0000 7f1db5086640 1 -- 172.21.15.130:0/728732765 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac0a8b90 con 0x7f1db00b2da0 2023-09-13T06:12:37.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.776+0000 7f1db5086640 1 -- 172.21.15.130:0/728732765 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0b0440 con 0x7f1db00b2da0 2023-09-13T06:12:37.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.776+0000 7f1db82ec640 1 -- 172.21.15.130:0/728732765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db00b2da0 msgr2=0x7f1db006f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.776+0000 7f1db82ec640 1 --2- 172.21.15.130:0/728732765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db00b2da0 0x7f1db006f730 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009870 tx=0x7f1dac01ed30 comp rx=0 tx=0).stop 2023-09-13T06:12:37.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 -- 172.21.15.130:0/728732765 shutdown_connections 2023-09-13T06:12:37.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 --2- 172.21.15.130:0/728732765 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00cf2a0 0x7f1db0160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 --2- 172.21.15.130:0/728732765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db00b2da0 0x7f1db006f730 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 -- 172.21.15.130:0/728732765 >> 172.21.15.130:0/728732765 conn(0x7f1db006a2f0 msgr2=0x7f1db006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:37.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 -- 172.21.15.130:0/728732765 shutdown_connections 2023-09-13T06:12:37.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 -- 172.21.15.130:0/728732765 wait complete. 2023-09-13T06:12:37.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 Processor -- start 2023-09-13T06:12:37.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 -- start start 2023-09-13T06:12:37.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1db006fc70 0x7f1db013ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00b2da0 0x7f1db00cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db00cf2a0 0x7f1db00ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0145880 con 0x7f1db00cf2a0 2023-09-13T06:12:37.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0145b60 con 0x7f1db006fc70 2023-09-13T06:12:37.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db82ec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0145e40 con 0x7f1db00b2da0 2023-09-13T06:12:37.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db6889640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db00cf2a0 0x7f1db00ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db6889640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db00cf2a0 0x7f1db00ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48630/0 (socket says 172.21.15.130:48630) 2023-09-13T06:12:37.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db6889640 1 -- 172.21.15.130:0/625800064 learned_addr learned my addr 172.21.15.130:0/625800064 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:37.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db6088640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1db006fc70 0x7f1db013ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db5887640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00b2da0 0x7f1db00cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db6889640 1 -- 172.21.15.130:0/625800064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00b2da0 msgr2=0x7f1db00cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db6889640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00b2da0 0x7f1db00cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db6889640 1 -- 172.21.15.130:0/625800064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1db006fc70 msgr2=0x7f1db013ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db6889640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1db006fc70 0x7f1db013ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db6889640 1 -- 172.21.15.130:0/625800064 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac0094d0 con 0x7f1db00cf2a0 2023-09-13T06:12:37.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db5887640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00b2da0 0x7f1db00cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:37.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db6088640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1db006fc70 0x7f1db013ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:37.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.780+0000 7f1db6889640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db00cf2a0 0x7f1db00ce240 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f1da8007ef0 tx=0x7f1da800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:37.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1da6ffd640 1 -- 172.21.15.130:0/625800064 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8003ba0 con 0x7f1db00cf2a0 2023-09-13T06:12:37.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1da6ffd640 1 -- 172.21.15.130:0/625800064 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da800f040 con 0x7f1db00cf2a0 2023-09-13T06:12:37.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1da6ffd640 1 -- 172.21.15.130:0/625800064 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da800de80 con 0x7f1db00cf2a0 2023-09-13T06:12:37.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1db82ec640 1 -- 172.21.15.130:0/625800064 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db0146120 con 0x7f1db00cf2a0 2023-09-13T06:12:37.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1db82ec640 1 -- 172.21.15.130:0/625800064 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db0144d00 con 0x7f1db00cf2a0 2023-09-13T06:12:37.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1db82ec640 1 -- 172.21.15.130:0/625800064 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db00cf0f0 con 0x7f1db00cf2a0 2023-09-13T06:12:37.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1da6ffd640 1 -- 172.21.15.130:0/625800064 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1da8004030 con 0x7f1db00cf2a0 2023-09-13T06:12:37.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1da6ffd640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d94065b20 0x7f1d94067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:37.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1da6ffd640 1 -- 172.21.15.130:0/625800064 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1da8083520 con 0x7f1db00cf2a0 2023-09-13T06:12:37.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1db6088640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d94065b20 0x7f1d94067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:37.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1da6ffd640 1 -- 172.21.15.130:0/625800064 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f1d9406d6b0 con 0x7f1db00cf2a0 2023-09-13T06:12:37.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.784+0000 7f1db6088640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d94065b20 0x7f1d94067fe0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0b2000 tx=0x7f1dac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:37.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.788+0000 7f1da6ffd640 1 -- 172.21.15.130:0/625800064 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1da8050f90 con 0x7f1db00cf2a0 2023-09-13T06:12:37.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 -- 172.21.15.130:0/625800064 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1db01462b0 con 0x7f1db00cf2a0 2023-09-13T06:12:37.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1da6ffd640 1 -- 172.21.15.130:0/625800064 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f1da801a030 con 0x7f1db00cf2a0 2023-09-13T06:12:37.968 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:37.968 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2473585305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2473585305},{"type":"v1","addr":"172.21.15.130:6835","nonce":2473585305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1139512428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1139512428},{"type":"v1","addr":"172.21.15.164:6834","nonce":1139512428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2365480398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2365480398},{"type":"v1","addr":"172.21.15.164:6835","nonce":2365480398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:11:17.067978+0000","modified":"2023-09-13T06:11:20.112082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8646":{"gid":8646,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/597081287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":597081287},{"type":"v1","addr":"172.21.15.130:6837","nonce":597081287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-09-13T06:12:37.969 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 84 2023-09-13T06:12:37.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 -- 172.21.15.130:0/625800064 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d94065b20 msgr2=0x7f1d94067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d94065b20 0x7f1d94067fe0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0b2000 tx=0x7f1dac008040 comp rx=0 tx=0).stop 2023-09-13T06:12:37.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 -- 172.21.15.130:0/625800064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db00cf2a0 msgr2=0x7f1db00ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:37.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db00cf2a0 0x7f1db00ce240 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f1da8007ef0 tx=0x7f1da800d4a0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 -- 172.21.15.130:0/625800064 shutdown_connections 2023-09-13T06:12:37.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1d94065b20 0x7f1d94067fe0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db00cf2a0 0x7f1db00ce240 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1db00b2da0 0x7f1db00cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 --2- 172.21.15.130:0/625800064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1db006fc70 0x7f1db013ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:37.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 -- 172.21.15.130:0/625800064 >> 172.21.15.130:0/625800064 conn(0x7f1db006a2f0 msgr2=0x7f1db015fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:37.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 -- 172.21.15.130:0/625800064 shutdown_connections 2023-09-13T06:12:37.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:37.968+0000 7f1db82ec640 1 -- 172.21.15.130:0/625800064 wait complete. 2023-09-13T06:12:37.988 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:12:38.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.124+0000 7f507ca9c640 1 Processor -- start 2023-09-13T06:12:38.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.124+0000 7f507ca9c640 1 -- start start 2023-09-13T06:12:38.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f507ca9c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f507815b130 0x7f50780cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f507ca9c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780ce980 con 0x7f50780b04a0 2023-09-13T06:12:38.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f507ca9c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cec60 con 0x7f50780ce180 2023-09-13T06:12:38.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f507ca9c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507806c640 con 0x7f507815b130 2023-09-13T06:12:38.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f5076d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f50780b04a0 0x7f507806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50966/0 (socket says 172.21.15.130:50966) 2023-09-13T06:12:38.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f5076d9d640 1 -- 172.21.15.130:0/1729232493 learned_addr learned my addr 172.21.15.130:0/1729232493 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:38.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f507659c640 1 --2- 172.21.15.130:0/1729232493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f507815b130 0x7f50780cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f5075d9b640 1 -- 172.21.15.130:0/1729232493 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514763034 0 0) 0x7f50780ce980 con 0x7f50780b04a0 2023-09-13T06:12:38.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f5075d9b640 1 -- 172.21.15.130:0/1729232493 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5064003530 con 0x7f50780b04a0 2023-09-13T06:12:38.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f5075d9b640 1 -- 172.21.15.130:0/1729232493 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182015215 0 0) 0x7f50780cec60 con 0x7f50780ce180 2023-09-13T06:12:38.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f5075d9b640 1 -- 172.21.15.130:0/1729232493 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50780ce980 con 0x7f50780ce180 2023-09-13T06:12:38.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f507659c640 1 -- 172.21.15.130:0/1729232493 >> v1:172.21.15.164:6789/0 conn(0x7f50780ce180 legacy=0x7f507815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f507659c640 1 -- 172.21.15.130:0/1729232493 >> v1:172.21.15.130:6789/0 conn(0x7f50780b04a0 legacy=0x7f507806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.128+0000 7f507659c640 1 -- 172.21.15.130:0/1729232493 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507806c920 con 0x7f507815b130 2023-09-13T06:12:38.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f507659c640 1 --2- 172.21.15.130:0/1729232493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f507815b130 0x7f50780cc780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f50680097f0 tx=0x7f506801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5451bae0b2428521 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:38.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f5075d9b640 1 -- 172.21.15.130:0/1729232493 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680ac410 con 0x7f507815b130 2023-09-13T06:12:38.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f5075d9b640 1 -- 172.21.15.130:0/1729232493 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50680ac570 con 0x7f507815b130 2023-09-13T06:12:38.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f5075d9b640 1 -- 172.21.15.130:0/1729232493 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680ac900 con 0x7f507815b130 2023-09-13T06:12:38.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f507ca9c640 1 -- 172.21.15.130:0/1729232493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f507815b130 msgr2=0x7f50780cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f507ca9c640 1 --2- 172.21.15.130:0/1729232493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f507815b130 0x7f50780cc780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f50680097f0 tx=0x7f506801c4c0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f507ca9c640 1 -- 172.21.15.130:0/1729232493 shutdown_connections 2023-09-13T06:12:38.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f507ca9c640 1 --2- 172.21.15.130:0/1729232493 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f507815b130 0x7f50780cc780 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f507ca9c640 1 -- 172.21.15.130:0/1729232493 >> 172.21.15.130:0/1729232493 conn(0x7f5078065990 msgr2=0x7f5078065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:38.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f507ca9c640 1 -- 172.21.15.130:0/1729232493 shutdown_connections 2023-09-13T06:12:38.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f507ca9c640 1 -- 172.21.15.130:0/1729232493 wait complete. 2023-09-13T06:12:38.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f507ca9c640 1 Processor -- start 2023-09-13T06:12:38.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.132+0000 7f507ca9c640 1 -- start start 2023-09-13T06:12:38.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507ca9c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50780b04a0 0x7f507814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507ca9c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50780ce180 0x7f5078152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507ca9c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f507815b130 0x7f507814f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507ca9c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50781592b0 con 0x7f50780b04a0 2023-09-13T06:12:38.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507ca9c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50781530e0 con 0x7f50780ce180 2023-09-13T06:12:38.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507ca9c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50781587f0 con 0x7f507815b130 2023-09-13T06:12:38.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50780b04a0 0x7f507814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50780b04a0 0x7f507814f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48632/0 (socket says 172.21.15.130:48632) 2023-09-13T06:12:38.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507659c640 1 -- 172.21.15.130:0/3675905733 learned_addr learned my addr 172.21.15.130:0/3675905733 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:38.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f5076d9d640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f507815b130 0x7f507814f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f506ffff640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50780ce180 0x7f5078152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507659c640 1 -- 172.21.15.130:0/3675905733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f507815b130 msgr2=0x7f507814f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507659c640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f507815b130 0x7f507814f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507659c640 1 -- 172.21.15.130:0/3675905733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50780ce180 msgr2=0x7f5078152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507659c640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50780ce180 0x7f5078152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507659c640 1 -- 172.21.15.130:0/3675905733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5068009420 con 0x7f50780b04a0 2023-09-13T06:12:38.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507659c640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50780b04a0 0x7f507814f110 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f50680190d0 tx=0x7f5068019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:38.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f506effd640 1 -- 172.21.15.130:0/3675905733 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068006e20 con 0x7f50780b04a0 2023-09-13T06:12:38.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f506effd640 1 -- 172.21.15.130:0/3675905733 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50680ace20 con 0x7f50780b04a0 2023-09-13T06:12:38.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f506effd640 1 -- 172.21.15.130:0/3675905733 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680b5880 con 0x7f50780b04a0 2023-09-13T06:12:38.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507ca9c640 1 -- 172.21.15.130:0/3675905733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5078158cf0 con 0x7f50780b04a0 2023-09-13T06:12:38.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507ca9c640 1 -- 172.21.15.130:0/3675905733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5078152680 con 0x7f50780b04a0 2023-09-13T06:12:38.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f507ca9c640 1 -- 172.21.15.130:0/3675905733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50780618a0 con 0x7f50780b04a0 2023-09-13T06:12:38.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.136+0000 7f506effd640 1 -- 172.21.15.130:0/3675905733 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f50680b3040 con 0x7f50780b04a0 2023-09-13T06:12:38.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.140+0000 7f506effd640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5058065b20 0x7f5058067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.140+0000 7f506effd640 1 -- 172.21.15.130:0/3675905733 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f506811d120 con 0x7f50780b04a0 2023-09-13T06:12:38.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.140+0000 7f506ffff640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5058065b20 0x7f5058067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.140+0000 7f506effd640 1 -- 172.21.15.130:0/3675905733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f505806d6b0 con 0x7f50780b04a0 2023-09-13T06:12:38.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.140+0000 7f506ffff640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5058065b20 0x7f5058067fe0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f50780b23f0 tx=0x7f5060009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:38.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.144+0000 7f506effd640 1 -- 172.21.15.130:0/3675905733 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f50680eaaf0 con 0x7f50780b04a0 2023-09-13T06:12:38.292 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.292+0000 7f507ca9c640 1 -- 172.21.15.130:0/3675905733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50780cc4b0 con 0x7f50780b04a0 2023-09-13T06:12:38.293 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.292+0000 7f506effd640 1 -- 172.21.15.130:0/3675905733 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+16692 (secure 0 0 0) 0x7f50680c2020 con 0x7f50780b04a0 2023-09-13T06:12:38.293 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:38.294 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":175,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:12:14.598851+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:11:15.244077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-09-13T06:11:16.070064+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:12:38.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.292+0000 7f507ca9c640 1 -- 172.21.15.130:0/3675905733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5058065b20 msgr2=0x7f5058067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.296 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.292+0000 7f507ca9c640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5058065b20 0x7f5058067fe0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f50780b23f0 tx=0x7f5060009040 comp rx=0 tx=0).stop 2023-09-13T06:12:38.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.292+0000 7f507ca9c640 1 -- 172.21.15.130:0/3675905733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50780b04a0 msgr2=0x7f507814f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.292+0000 7f507ca9c640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50780b04a0 0x7f507814f110 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f50680190d0 tx=0x7f5068019260 comp rx=0 tx=0).stop 2023-09-13T06:12:38.297 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.296+0000 7f507ca9c640 1 -- 172.21.15.130:0/3675905733 shutdown_connections 2023-09-13T06:12:38.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.296+0000 7f507ca9c640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5058065b20 0x7f5058067fe0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.296+0000 7f507ca9c640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50780ce180 0x7f5078152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.296+0000 7f507ca9c640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f507815b130 0x7f507814f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.296+0000 7f507ca9c640 1 --2- 172.21.15.130:0/3675905733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50780b04a0 0x7f507814f110 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.298 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.296+0000 7f507ca9c640 1 -- 172.21.15.130:0/3675905733 >> 172.21.15.130:0/3675905733 conn(0x7f5078065990 msgr2=0x7f5078070950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:38.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.296+0000 7f507ca9c640 1 -- 172.21.15.130:0/3675905733 shutdown_connections 2023-09-13T06:12:38.299 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.296+0000 7f507ca9c640 1 -- 172.21.15.130:0/3675905733 wait complete. 2023-09-13T06:12:38.314 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:12:38.315 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:12:38.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.452+0000 7f3daa448640 1 Processor -- start 2023-09-13T06:12:38.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.452+0000 7f3daa448640 1 -- start start 2023-09-13T06:12:38.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.452+0000 7f3daa448640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3da40cdb40 0x7f3da40cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.452+0000 7f3daa448640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da40cd900 con 0x7f3da413e9d0 2023-09-13T06:12:38.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.452+0000 7f3daa448640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da4140820 con 0x7f3da40cd520 2023-09-13T06:12:38.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.452+0000 7f3daa448640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da40ce510 con 0x7f3da40cdb40 2023-09-13T06:12:38.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.452+0000 7f3da89e5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3da413e9d0 0x7f3da413ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50982/0 (socket says 172.21.15.130:50982) 2023-09-13T06:12:38.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.452+0000 7f3da89e5640 1 -- 172.21.15.130:0/3461919153 learned_addr learned my addr 172.21.15.130:0/3461919153 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:38.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.452+0000 7f3da37fe640 1 --2- 172.21.15.130:0/3461919153 >> v2:172.21.15.164:3300/0 conn(0x7f3da40cdb40 0x7f3da40cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.456+0000 7f3da2ffd640 1 -- 172.21.15.130:0/3461919153 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861881444 0 0) 0x7f3da40cd900 con 0x7f3da413e9d0 2023-09-13T06:12:38.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.456+0000 7f3da2ffd640 1 -- 172.21.15.130:0/3461919153 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d8c003530 con 0x7f3da413e9d0 2023-09-13T06:12:38.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.456+0000 7f3da2ffd640 1 -- 172.21.15.130:0/3461919153 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122491412 0 0) 0x7f3da4140820 con 0x7f3da40cd520 2023-09-13T06:12:38.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.456+0000 7f3da2ffd640 1 -- 172.21.15.130:0/3461919153 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da40cd900 con 0x7f3da40cd520 2023-09-13T06:12:38.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.456+0000 7f3da37fe640 1 -- 172.21.15.130:0/3461919153 >> v1:172.21.15.164:6789/0 conn(0x7f3da40cd520 legacy=0x7f3da40b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.456+0000 7f3da37fe640 1 -- 172.21.15.130:0/3461919153 >> v1:172.21.15.130:6789/0 conn(0x7f3da413e9d0 legacy=0x7f3da413ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.456+0000 7f3da37fe640 1 -- 172.21.15.130:0/3461919153 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da4140ab0 con 0x7f3da40cdb40 2023-09-13T06:12:38.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.456+0000 7f3da37fe640 1 --2- 172.21.15.130:0/3461919153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3da40cdb40 0x7f3da40cdfd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3d980097c0 tx=0x7f3d9801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cfa7c24edf02741 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:38.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.456+0000 7f3da2ffd640 1 -- 172.21.15.130:0/3461919153 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980ab600 con 0x7f3da40cdb40 2023-09-13T06:12:38.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.456+0000 7f3da2ffd640 1 -- 172.21.15.130:0/3461919153 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d980a7050 con 0x7f3da40cdb40 2023-09-13T06:12:38.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.456+0000 7f3da2ffd640 1 -- 172.21.15.130:0/3461919153 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980ab980 con 0x7f3da40cdb40 2023-09-13T06:12:38.460 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 -- 172.21.15.130:0/3461919153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3da40cdb40 msgr2=0x7f3da40cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.461 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 --2- 172.21.15.130:0/3461919153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3da40cdb40 0x7f3da40cdfd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3d980097c0 tx=0x7f3d9801c480 comp rx=0 tx=0).stop 2023-09-13T06:12:38.462 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 -- 172.21.15.130:0/3461919153 shutdown_connections 2023-09-13T06:12:38.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 --2- 172.21.15.130:0/3461919153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3da40cdb40 0x7f3da40cdfd0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 -- 172.21.15.130:0/3461919153 >> 172.21.15.130:0/3461919153 conn(0x7f3da406e5c0 msgr2=0x7f3da4065960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:38.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 -- 172.21.15.130:0/3461919153 shutdown_connections 2023-09-13T06:12:38.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 -- 172.21.15.130:0/3461919153 wait complete. 2023-09-13T06:12:38.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 Processor -- start 2023-09-13T06:12:38.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 -- start start 2023-09-13T06:12:38.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3da40cd520 0x7f3da4137470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3da40cdb40 0x7f3da4151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da413e9d0 0x7f3da4136c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da4137d70 con 0x7f3da413e9d0 2023-09-13T06:12:38.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da413dcc0 con 0x7f3da40cd520 2023-09-13T06:12:38.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3daa448640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da415de10 con 0x7f3da40cdb40 2023-09-13T06:12:38.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3da89e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da413e9d0 0x7f3da4136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3da89e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da413e9d0 0x7f3da4136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48648/0 (socket says 172.21.15.130:48648) 2023-09-13T06:12:38.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3da89e5640 1 -- 172.21.15.130:0/3134613835 learned_addr learned my addr 172.21.15.130:0/3134613835 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:38.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3da3fff640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3da40cd520 0x7f3da4137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3da37fe640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3da40cdb40 0x7f3da4151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3da89e5640 1 -- 172.21.15.130:0/3134613835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3da40cdb40 msgr2=0x7f3da4151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3da89e5640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3da40cdb40 0x7f3da4151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3da89e5640 1 -- 172.21.15.130:0/3134613835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3da40cd520 msgr2=0x7f3da4137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3da89e5640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3da40cd520 0x7f3da4137470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.460+0000 7f3da89e5640 1 -- 172.21.15.130:0/3134613835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d98009420 con 0x7f3da413e9d0 2023-09-13T06:12:38.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3da89e5640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da413e9d0 0x7f3da4136c20 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00cbd0 tx=0x7f3d9c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:38.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3da0ff9640 1 -- 172.21.15.130:0/3134613835 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00ace0 con 0x7f3da413e9d0 2023-09-13T06:12:38.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3da0ff9640 1 -- 172.21.15.130:0/3134613835 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c00ae40 con 0x7f3da413e9d0 2023-09-13T06:12:38.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3da0ff9640 1 -- 172.21.15.130:0/3134613835 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c012620 con 0x7f3da413e9d0 2023-09-13T06:12:38.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3daa448640 1 -- 172.21.15.130:0/3134613835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da413d700 con 0x7f3da413e9d0 2023-09-13T06:12:38.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3daa448640 1 -- 172.21.15.130:0/3134613835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da415e0b0 con 0x7f3da413e9d0 2023-09-13T06:12:38.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3daa448640 1 -- 172.21.15.130:0/3134613835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da40618a0 con 0x7f3da413e9d0 2023-09-13T06:12:38.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3da0ff9640 1 -- 172.21.15.130:0/3134613835 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3d9c007070 con 0x7f3da413e9d0 2023-09-13T06:12:38.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3da0ff9640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d90065b20 0x7f3d90067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3da0ff9640 1 -- 172.21.15.130:0/3134613835 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3d9c0834b0 con 0x7f3da413e9d0 2023-09-13T06:12:38.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3da3fff640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d90065b20 0x7f3d90067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3da0ff9640 1 -- 172.21.15.130:0/3134613835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f3d9006d6b0 con 0x7f3da413e9d0 2023-09-13T06:12:38.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.464+0000 7f3da3fff640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d90065b20 0x7f3d90067fe0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3d940011f0 tx=0x7f3d94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:38.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.468+0000 7f3da0ff9640 1 -- 172.21.15.130:0/3134613835 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3d9c017060 con 0x7f3da413e9d0 2023-09-13T06:12:38.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.648+0000 7f3daa448640 1 -- 172.21.15.130:0/3134613835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3da40afb80 con 0x7f3da413e9d0 2023-09-13T06:12:38.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.648+0000 7f3da0ff9640 1 -- 172.21.15.130:0/3134613835 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f3d9c017020 con 0x7f3da413e9d0 2023-09-13T06:12:38.651 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:38.651 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2473585305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2473585305},{"type":"v1","addr":"172.21.15.130:6835","nonce":2473585305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1139512428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1139512428},{"type":"v1","addr":"172.21.15.164:6834","nonce":1139512428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2365480398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2365480398},{"type":"v1","addr":"172.21.15.164:6835","nonce":2365480398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:11:17.067978+0000","modified":"2023-09-13T06:11:20.112082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8646":{"gid":8646,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/597081287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":597081287},{"type":"v1","addr":"172.21.15.130:6837","nonce":597081287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-09-13T06:12:38.652 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 84 2023-09-13T06:12:38.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 -- 172.21.15.130:0/3134613835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d90065b20 msgr2=0x7f3d90067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d90065b20 0x7f3d90067fe0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3d940011f0 tx=0x7f3d94009040 comp rx=0 tx=0).stop 2023-09-13T06:12:38.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 -- 172.21.15.130:0/3134613835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da413e9d0 msgr2=0x7f3da4136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da413e9d0 0x7f3da4136c20 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00cbd0 tx=0x7f3d9c00a430 comp rx=0 tx=0).stop 2023-09-13T06:12:38.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 -- 172.21.15.130:0/3134613835 shutdown_connections 2023-09-13T06:12:38.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3d90065b20 0x7f3d90067fe0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3da413e9d0 0x7f3da4136c20 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3da40cdb40 0x7f3da4151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 --2- 172.21.15.130:0/3134613835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3da40cd520 0x7f3da4137470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 -- 172.21.15.130:0/3134613835 >> 172.21.15.130:0/3134613835 conn(0x7f3da406e5c0 msgr2=0x7f3da40b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:38.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 -- 172.21.15.130:0/3134613835 shutdown_connections 2023-09-13T06:12:38.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.652+0000 7f3daa448640 1 -- 172.21.15.130:0/3134613835 wait complete. 2023-09-13T06:12:38.671 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:12:38.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.808+0000 7f719c4cb640 1 Processor -- start 2023-09-13T06:12:38.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.808+0000 7f719c4cb640 1 -- start start 2023-09-13T06:12:38.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719c4cb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f71940b1d20 0x7f71940ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719c4cb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f71940cdfc0 0x7f71940b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719c4cb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71940ccfd0 con 0x7f7194159f20 2023-09-13T06:12:38.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719c4cb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71940ce430 con 0x7f71940cdfc0 2023-09-13T06:12:38.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719c4cb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71940b00f0 con 0x7f71940b1d20 2023-09-13T06:12:38.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719a267640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f7194159f20 0x7f71940b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:50992/0 (socket says 172.21.15.130:50992) 2023-09-13T06:12:38.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719a267640 1 -- 172.21.15.130:0/3680397048 learned_addr learned my addr 172.21.15.130:0/3680397048 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:38.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719aa68640 1 --2- 172.21.15.130:0/3680397048 >> v2:172.21.15.130:3300/0 conn(0x7f71940cdfc0 0x7f71940b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f7199265640 1 -- 172.21.15.130:0/3680397048 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868385896 0 0) 0x7f71940ccfd0 con 0x7f7194159f20 2023-09-13T06:12:38.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f7199a66640 1 --2- 172.21.15.130:0/3680397048 >> v2:172.21.15.164:3300/0 conn(0x7f71940b1d20 0x7f71940ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f7199265640 1 -- 172.21.15.130:0/3680397048 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7180003530 con 0x7f7194159f20 2023-09-13T06:12:38.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719aa68640 1 -- 172.21.15.130:0/3680397048 >> v2:172.21.15.164:3300/0 conn(0x7f71940b1d20 msgr2=0x7f71940ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:38.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719aa68640 1 --2- 172.21.15.130:0/3680397048 >> v2:172.21.15.164:3300/0 conn(0x7f71940b1d20 0x7f71940ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719aa68640 1 -- 172.21.15.130:0/3680397048 >> v1:172.21.15.130:6789/0 conn(0x7f7194159f20 legacy=0x7f71940b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f719aa68640 1 -- 172.21.15.130:0/3680397048 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71940ced90 con 0x7f71940cdfc0 2023-09-13T06:12:38.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.812+0000 7f7199a66640 1 --2- 172.21.15.130:0/3680397048 >> v2:172.21.15.164:3300/0 conn(0x7f71940b1d20 0x7f71940ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:38.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f719aa68640 1 --2- 172.21.15.130:0/3680397048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71940cdfc0 0x7f71940b0c90 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f718c009d90 tx=0x7f718c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de4ce8739d5772c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:38.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f7199265640 1 -- 172.21.15.130:0/3680397048 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0a5910 con 0x7f71940cdfc0 2023-09-13T06:12:38.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f7199265640 1 -- 172.21.15.130:0/3680397048 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c0a5a70 con 0x7f71940cdfc0 2023-09-13T06:12:38.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f7199265640 1 -- 172.21.15.130:0/3680397048 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0a5e00 con 0x7f71940cdfc0 2023-09-13T06:12:38.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f719c4cb640 1 -- 172.21.15.130:0/3680397048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71940cdfc0 msgr2=0x7f71940b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f719c4cb640 1 --2- 172.21.15.130:0/3680397048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71940cdfc0 0x7f71940b0c90 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f718c009d90 tx=0x7f718c01c850 comp rx=0 tx=0).stop 2023-09-13T06:12:38.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f719c4cb640 1 -- 172.21.15.130:0/3680397048 shutdown_connections 2023-09-13T06:12:38.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f719c4cb640 1 --2- 172.21.15.130:0/3680397048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71940cdfc0 0x7f71940b0c90 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f719c4cb640 1 --2- 172.21.15.130:0/3680397048 >> v2:172.21.15.164:3300/0 conn(0x7f71940b1d20 0x7f71940ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f719c4cb640 1 -- 172.21.15.130:0/3680397048 >> 172.21.15.130:0/3680397048 conn(0x7f7194065990 msgr2=0x7f7194065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:38.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f719c4cb640 1 -- 172.21.15.130:0/3680397048 shutdown_connections 2023-09-13T06:12:38.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f719c4cb640 1 -- 172.21.15.130:0/3680397048 wait complete. 2023-09-13T06:12:38.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f719c4cb640 1 Processor -- start 2023-09-13T06:12:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.816+0000 7f719c4cb640 1 -- start start 2023-09-13T06:12:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719c4cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71940b1d20 0x7f719414c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719c4cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71940cdfc0 0x7f719414df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719c4cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7194159f20 0x7f7194156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719c4cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71941374a0 con 0x7f7194159f20 2023-09-13T06:12:38.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719c4cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7194137780 con 0x7f71940b1d20 2023-09-13T06:12:38.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719c4cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7194137a60 con 0x7f71940cdfc0 2023-09-13T06:12:38.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719aa68640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7194159f20 0x7f7194156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719aa68640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7194159f20 0x7f7194156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48662/0 (socket says 172.21.15.130:48662) 2023-09-13T06:12:38.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719aa68640 1 -- 172.21.15.130:0/2608863205 learned_addr learned my addr 172.21.15.130:0/2608863205 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:38.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719a267640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71940b1d20 0x7f719414c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f7199a66640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71940cdfc0 0x7f719414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719aa68640 1 -- 172.21.15.130:0/2608863205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71940cdfc0 msgr2=0x7f719414df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719aa68640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71940cdfc0 0x7f719414df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719aa68640 1 -- 172.21.15.130:0/2608863205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71940b1d20 msgr2=0x7f719414c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:38.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719aa68640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71940b1d20 0x7f719414c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:38.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719aa68640 1 -- 172.21.15.130:0/2608863205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c009a70 con 0x7f7194159f20 2023-09-13T06:12:38.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719a267640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71940b1d20 0x7f719414c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:38.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719aa68640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7194159f20 0x7f7194156360 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f718c0b0040 tx=0x7f718c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:38.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f718affd640 1 -- 172.21.15.130:0/2608863205 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0b9860 con 0x7f7194159f20 2023-09-13T06:12:38.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f718affd640 1 -- 172.21.15.130:0/2608863205 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c0b99c0 con 0x7f7194159f20 2023-09-13T06:12:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f718affd640 1 -- 172.21.15.130:0/2608863205 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0b9d70 con 0x7f7194159f20 2023-09-13T06:12:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719c4cb640 1 -- 172.21.15.130:0/2608863205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7194137d40 con 0x7f7194159f20 2023-09-13T06:12:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719c4cb640 1 -- 172.21.15.130:0/2608863205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719414e4d0 con 0x7f7194159f20 2023-09-13T06:12:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f719c4cb640 1 -- 172.21.15.130:0/2608863205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719414e6c0 con 0x7f7194159f20 2023-09-13T06:12:38.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.820+0000 7f718affd640 1 -- 172.21.15.130:0/2608863205 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f718c0ad440 con 0x7f7194159f20 2023-09-13T06:12:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.824+0000 7f718affd640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7178065b20 0x7f7178067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.824+0000 7f718affd640 1 -- 172.21.15.130:0/2608863205 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f718c11e720 con 0x7f7194159f20 2023-09-13T06:12:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.824+0000 7f719a267640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7178065b20 0x7f7178067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.824+0000 7f718affd640 1 -- 172.21.15.130:0/2608863205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f717806d6b0 con 0x7f7194159f20 2023-09-13T06:12:38.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.824+0000 7f719a267640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7178065b20 0x7f7178067fe0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f71900011f0 tx=0x7f7190009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:38.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:38.828+0000 7f718affd640 1 -- 172.21.15.130:0/2608863205 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f718c0ebfb0 con 0x7f7194159f20 2023-09-13T06:12:39.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.004+0000 7f719c4cb640 1 -- 172.21.15.130:0/2608863205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71940cd850 con 0x7f7194159f20 2023-09-13T06:12:39.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f718affd640 1 -- 172.21.15.130:0/2608863205 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f718c0bd070 con 0x7f7194159f20 2023-09-13T06:12:39.007 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:39.007 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2473585305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2473585305},{"type":"v1","addr":"172.21.15.130:6835","nonce":2473585305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1139512428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1139512428},{"type":"v1","addr":"172.21.15.164:6834","nonce":1139512428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2365480398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2365480398},{"type":"v1","addr":"172.21.15.164:6835","nonce":2365480398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:11:17.067978+0000","modified":"2023-09-13T06:11:20.112082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8646":{"gid":8646,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/597081287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":597081287},{"type":"v1","addr":"172.21.15.130:6837","nonce":597081287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-09-13T06:12:39.008 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 84 2023-09-13T06:12:39.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 -- 172.21.15.130:0/2608863205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7178065b20 msgr2=0x7f7178067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7178065b20 0x7f7178067fe0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f71900011f0 tx=0x7f7190009040 comp rx=0 tx=0).stop 2023-09-13T06:12:39.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 -- 172.21.15.130:0/2608863205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7194159f20 msgr2=0x7f7194156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7194159f20 0x7f7194156360 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f718c0b0040 tx=0x7f718c0195f0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 -- 172.21.15.130:0/2608863205 shutdown_connections 2023-09-13T06:12:39.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7178065b20 0x7f7178067fe0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7194159f20 0x7f7194156360 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71940cdfc0 0x7f719414df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 --2- 172.21.15.130:0/2608863205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71940b1d20 0x7f719414c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 -- 172.21.15.130:0/2608863205 >> 172.21.15.130:0/2608863205 conn(0x7f7194065990 msgr2=0x7f719406b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:39.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 -- 172.21.15.130:0/2608863205 shutdown_connections 2023-09-13T06:12:39.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.008+0000 7f719c4cb640 1 -- 172.21.15.130:0/2608863205 wait complete. 2023-09-13T06:12:39.028 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:12:39.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.164+0000 7f74f0796640 1 Processor -- start 2023-09-13T06:12:39.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74f0796640 1 -- start start 2023-09-13T06:12:39.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74f0796640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74e80d1750 0x7f74e815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74f0796640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f74e8146f30 0x7f74e80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74f0796640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e80b63c0 con 0x7f74e80d1090 2023-09-13T06:12:39.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74f0796640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e815dea0 con 0x7f74e8146f30 2023-09-13T06:12:39.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74f0796640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80d0c20 con 0x7f74e80d1750 2023-09-13T06:12:39.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74eed33640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f74e8146f30 0x7f74e80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74edd31640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f74e80d1090 0x7f74e8146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51002/0 (socket says 172.21.15.130:51002) 2023-09-13T06:12:39.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74edd31640 1 -- 172.21.15.130:0/527833292 learned_addr learned my addr 172.21.15.130:0/527833292 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:39.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74ee532640 1 --2- 172.21.15.130:0/527833292 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74e80d1750 0x7f74e815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74eed33640 1 -- 172.21.15.130:0/527833292 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74e80d1750 msgr2=0x7f74e815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:39.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74eed33640 1 --2- 172.21.15.130:0/527833292 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74e80d1750 0x7f74e815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74eed33640 1 -- 172.21.15.130:0/527833292 >> v1:172.21.15.130:6789/0 conn(0x7f74e80d1090 legacy=0x7f74e8146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74eed33640 1 -- 172.21.15.130:0/527833292 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e80b6610 con 0x7f74e8146f30 2023-09-13T06:12:39.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.168+0000 7f74ed530640 1 -- 172.21.15.130:0/527833292 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436316044 0 0) 0x7f74e80b63c0 con 0x7f74e80d1090 2023-09-13T06:12:39.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74eed33640 1 --2- 172.21.15.130:0/527833292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74e8146f30 0x7f74e80b70f0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009d90 tx=0x7f74e001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48419c2bf5e2f96f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:39.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74ed530640 1 -- 172.21.15.130:0/527833292 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00a59e0 con 0x7f74e8146f30 2023-09-13T06:12:39.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74ed530640 1 -- 172.21.15.130:0/527833292 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e00a5b40 con 0x7f74e8146f30 2023-09-13T06:12:39.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74ed530640 1 -- 172.21.15.130:0/527833292 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00ad440 con 0x7f74e8146f30 2023-09-13T06:12:39.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74f0796640 1 -- 172.21.15.130:0/527833292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74e8146f30 msgr2=0x7f74e80b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74f0796640 1 --2- 172.21.15.130:0/527833292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74e8146f30 0x7f74e80b70f0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009d90 tx=0x7f74e001c920 comp rx=0 tx=0).stop 2023-09-13T06:12:39.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74f0796640 1 -- 172.21.15.130:0/527833292 shutdown_connections 2023-09-13T06:12:39.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74f0796640 1 --2- 172.21.15.130:0/527833292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74e8146f30 0x7f74e80b70f0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74f0796640 1 --2- 172.21.15.130:0/527833292 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74e80d1750 0x7f74e815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74f0796640 1 -- 172.21.15.130:0/527833292 >> 172.21.15.130:0/527833292 conn(0x7f74e806f170 msgr2=0x7f74e806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:39.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74f0796640 1 -- 172.21.15.130:0/527833292 shutdown_connections 2023-09-13T06:12:39.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74f0796640 1 -- 172.21.15.130:0/527833292 wait complete. 2023-09-13T06:12:39.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.172+0000 7f74f0796640 1 Processor -- start 2023-09-13T06:12:39.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74f0796640 1 -- start start 2023-09-13T06:12:39.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74f0796640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74e80d1090 0x7f74e8164600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74f0796640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74e80d1750 0x7f74e8145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74f0796640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74e8146f30 0x7f74e815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74f0796640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8146340 con 0x7f74e8146f30 2023-09-13T06:12:39.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74f0796640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8164f50 con 0x7f74e80d1090 2023-09-13T06:12:39.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74f0796640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8164c70 con 0x7f74e80d1750 2023-09-13T06:12:39.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74eed33640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74e8146f30 0x7f74e815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74eed33640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74e8146f30 0x7f74e815c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48682/0 (socket says 172.21.15.130:48682) 2023-09-13T06:12:39.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74eed33640 1 -- 172.21.15.130:0/3146790402 learned_addr learned my addr 172.21.15.130:0/3146790402 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:39.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74eed33640 1 -- 172.21.15.130:0/3146790402 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74e80d1750 msgr2=0x7f74e8145e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74eed33640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74e80d1750 0x7f74e8145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74eed33640 1 -- 172.21.15.130:0/3146790402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74e80d1090 msgr2=0x7f74e8164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74eed33640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74e80d1090 0x7f74e8164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74eed33640 1 -- 172.21.15.130:0/3146790402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0009a70 con 0x7f74e8146f30 2023-09-13T06:12:39.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74eed33640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74e8146f30 0x7f74e815c0e0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f74e00b0040 tx=0x7f74e00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:39.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74deffd640 1 -- 172.21.15.130:0/3146790402 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00add90 con 0x7f74e8146f30 2023-09-13T06:12:39.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74deffd640 1 -- 172.21.15.130:0/3146790402 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e0009450 con 0x7f74e8146f30 2023-09-13T06:12:39.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74deffd640 1 -- 172.21.15.130:0/3146790402 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00b9690 con 0x7f74e8146f30 2023-09-13T06:12:39.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74f0796640 1 -- 172.21.15.130:0/3146790402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e80b7e40 con 0x7f74e8146f30 2023-09-13T06:12:39.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74f0796640 1 -- 172.21.15.130:0/3146790402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e8162510 con 0x7f74e8146f30 2023-09-13T06:12:39.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.176+0000 7f74f0796640 1 -- 172.21.15.130:0/3146790402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e8162090 con 0x7f74e8146f30 2023-09-13T06:12:39.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.180+0000 7f74deffd640 1 -- 172.21.15.130:0/3146790402 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f74e00b97f0 con 0x7f74e8146f30 2023-09-13T06:12:39.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.180+0000 7f74deffd640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74cc065b20 0x7f74cc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.180+0000 7f74deffd640 1 -- 172.21.15.130:0/3146790402 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f74e011eaa0 con 0x7f74e8146f30 2023-09-13T06:12:39.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.180+0000 7f74deffd640 1 -- 172.21.15.130:0/3146790402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f74cc06d6b0 con 0x7f74e8146f30 2023-09-13T06:12:39.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.180+0000 7f74ee532640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74cc065b20 0x7f74cc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.180+0000 7f74ee532640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74cc065b20 0x7f74cc067fe0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f74e4006aa0 tx=0x7f74e4006a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:39.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.184+0000 7f74deffd640 1 -- 172.21.15.130:0/3146790402 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f74e8162090 con 0x7f74e8146f30 2023-09-13T06:12:39.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74f0796640 1 -- 172.21.15.130:0/3146790402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74e8162090 con 0x7f74e8146f30 2023-09-13T06:12:39.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74deffd640 1 -- 172.21.15.130:0/3146790402 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+16692 (secure 0 0 0) 0x7f74e8162090 con 0x7f74e8146f30 2023-09-13T06:12:39.337 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:39.338 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":175,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:12:14.598851+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:11:15.244077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-09-13T06:11:16.070064+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:12:39.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74f0796640 1 -- 172.21.15.130:0/3146790402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74cc065b20 msgr2=0x7f74cc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74f0796640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74cc065b20 0x7f74cc067fe0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f74e4006aa0 tx=0x7f74e4006a30 comp rx=0 tx=0).stop 2023-09-13T06:12:39.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74f0796640 1 -- 172.21.15.130:0/3146790402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74e8146f30 msgr2=0x7f74e815c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74f0796640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74e8146f30 0x7f74e815c0e0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f74e00b0040 tx=0x7f74e00196c0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74f0796640 1 -- 172.21.15.130:0/3146790402 shutdown_connections 2023-09-13T06:12:39.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74f0796640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f74cc065b20 0x7f74cc067fe0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74f0796640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74e8146f30 0x7f74e815c0e0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74f0796640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74e80d1750 0x7f74e8145e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74f0796640 1 --2- 172.21.15.130:0/3146790402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74e80d1090 0x7f74e8164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.336+0000 7f74f0796640 1 -- 172.21.15.130:0/3146790402 >> 172.21.15.130:0/3146790402 conn(0x7f74e806f170 msgr2=0x7f74e80b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:39.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.340+0000 7f74f0796640 1 -- 172.21.15.130:0/3146790402 shutdown_connections 2023-09-13T06:12:39.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.340+0000 7f74f0796640 1 -- 172.21.15.130:0/3146790402 wait complete. 2023-09-13T06:12:39.358 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T06:12:39.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.496+0000 7fe00d92c640 1 Processor -- start 2023-09-13T06:12:39.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.496+0000 7fe00d92c640 1 -- start start 2023-09-13T06:12:39.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.496+0000 7fe00d92c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe0080d1090 0x7fe00815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.496+0000 7fe00d92c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe008146f30 0x7fe0080b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.496+0000 7fe00d92c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080b63c0 con 0x7fe0080d1750 2023-09-13T06:12:39.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.496+0000 7fe00d92c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00815dea0 con 0x7fe008146f30 2023-09-13T06:12:39.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe00d92c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080d0c20 con 0x7fe0080d1090 2023-09-13T06:12:39.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0077fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe008146f30 0x7fe0080b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0077fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe008146f30 0x7fe0080b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48686/0 (socket says 172.21.15.130:48686) 2023-09-13T06:12:39.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe006ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe0080d1750 0x7fe008146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:51006/0 (socket says 172.21.15.130:51006) 2023-09-13T06:12:39.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0077fe640 1 -- 172.21.15.130:0/2279464836 learned_addr learned my addr 172.21.15.130:0/2279464836 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:39.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fdffffff640 1 --2- 172.21.15.130:0/2279464836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe0080d1090 0x7fe00815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0077fe640 1 -- 172.21.15.130:0/2279464836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe0080d1090 msgr2=0x7fe00815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:39.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0077fe640 1 --2- 172.21.15.130:0/2279464836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe0080d1090 0x7fe00815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0077fe640 1 -- 172.21.15.130:0/2279464836 >> v1:172.21.15.130:6789/0 conn(0x7fe0080d1750 legacy=0x7fe008146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0077fe640 1 -- 172.21.15.130:0/2279464836 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080b6610 con 0x7fe008146f30 2023-09-13T06:12:39.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0067fc640 1 -- 172.21.15.130:0/2279464836 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666008663 0 0) 0x7fe0080b63c0 con 0x7fe0080d1750 2023-09-13T06:12:39.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0077fe640 1 --2- 172.21.15.130:0/2279464836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe008146f30 0x7fe0080b70f0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fe000009e50 tx=0x7fe00001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5f54f45a0b21ca server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:39.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0067fc640 1 -- 172.21.15.130:0/2279464836 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0000a58a0 con 0x7fe008146f30 2023-09-13T06:12:39.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0067fc640 1 -- 172.21.15.130:0/2279464836 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0000a5a00 con 0x7fe008146f30 2023-09-13T06:12:39.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.500+0000 7fe0067fc640 1 -- 172.21.15.130:0/2279464836 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0000a5d90 con 0x7fe008146f30 2023-09-13T06:12:39.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 -- 172.21.15.130:0/2279464836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe008146f30 msgr2=0x7fe0080b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 --2- 172.21.15.130:0/2279464836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe008146f30 0x7fe0080b70f0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fe000009e50 tx=0x7fe00001c9e0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 -- 172.21.15.130:0/2279464836 shutdown_connections 2023-09-13T06:12:39.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 --2- 172.21.15.130:0/2279464836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe008146f30 0x7fe0080b70f0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 --2- 172.21.15.130:0/2279464836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe0080d1090 0x7fe00815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 -- 172.21.15.130:0/2279464836 >> 172.21.15.130:0/2279464836 conn(0x7fe00806f170 msgr2=0x7fe00806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:39.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 -- 172.21.15.130:0/2279464836 shutdown_connections 2023-09-13T06:12:39.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 -- 172.21.15.130:0/2279464836 wait complete. 2023-09-13T06:12:39.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 Processor -- start 2023-09-13T06:12:39.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 -- start start 2023-09-13T06:12:39.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0080d1090 0x7fe0081597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0080d1750 0x7fe00815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe008146f30 0x7fe0080b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080b4d80 con 0x7fe0080d1750 2023-09-13T06:12:39.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00815f5a0 con 0x7fe0080d1090 2023-09-13T06:12:39.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe00d92c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe008159e20 con 0x7fe008146f30 2023-09-13T06:12:39.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fdffffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0080d1750 0x7fe00815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fdffffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0080d1750 0x7fe00815f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48692/0 (socket says 172.21.15.130:48692) 2023-09-13T06:12:39.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fdffffff640 1 -- 172.21.15.130:0/2801170473 learned_addr learned my addr 172.21.15.130:0/2801170473 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:39.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fdffffff640 1 -- 172.21.15.130:0/2801170473 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe008146f30 msgr2=0x7fe0080b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fdffffff640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe008146f30 0x7fe0080b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fdffffff640 1 -- 172.21.15.130:0/2801170473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0080d1090 msgr2=0x7fe0081597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe006ffd640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0080d1090 0x7fe0081597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fdffffff640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0080d1090 0x7fe0081597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fdffffff640 1 -- 172.21.15.130:0/2801170473 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe000009b30 con 0x7fe0080d1750 2023-09-13T06:12:39.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.504+0000 7fe006ffd640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0080d1090 0x7fe0081597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:39.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fdffffff640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0080d1750 0x7fe00815f060 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fdff000e960 tx=0x7fdff000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:39.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fe004ff9640 1 -- 172.21.15.130:0/2801170473 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0009690 con 0x7fe0080d1750 2023-09-13T06:12:39.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fe004ff9640 1 -- 172.21.15.130:0/2801170473 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff000ca00 con 0x7fe0080d1750 2023-09-13T06:12:39.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fe004ff9640 1 -- 172.21.15.130:0/2801170473 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff000cd70 con 0x7fe0080d1750 2023-09-13T06:12:39.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fe00d92c640 1 -- 172.21.15.130:0/2801170473 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0080b7e40 con 0x7fe0080d1750 2023-09-13T06:12:39.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fe00d92c640 1 -- 172.21.15.130:0/2801170473 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0080b46c0 con 0x7fe0080d1750 2023-09-13T06:12:39.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fe00d92c640 1 -- 172.21.15.130:0/2801170473 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0080618a0 con 0x7fe0080d1750 2023-09-13T06:12:39.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fe004ff9640 1 -- 172.21.15.130:0/2801170473 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdff0013470 con 0x7fe0080d1750 2023-09-13T06:12:39.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fe004ff9640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfe8065b20 0x7fdfe8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fe004ff9640 1 -- 172.21.15.130:0/2801170473 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fdff0083620 con 0x7fe0080d1750 2023-09-13T06:12:39.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fe006ffd640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfe8065b20 0x7fdfe8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.508+0000 7fe004ff9640 1 -- 172.21.15.130:0/2801170473 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7fdfe806d6b0 con 0x7fe0080d1750 2023-09-13T06:12:39.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.512+0000 7fe006ffd640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfe8065b20 0x7fdfe8067fe0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdff8000f70 tx=0x7fdff8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:39.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.512+0000 7fe004ff9640 1 -- 172.21.15.130:0/2801170473 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdff0050f40 con 0x7fe0080d1750 2023-09-13T06:12:39.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.696+0000 7fe00d92c640 1 -- 172.21.15.130:0/2801170473 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe0081608e0 con 0x7fe0080d1750 2023-09-13T06:12:39.699 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:12:39.696+0000 7faa00e50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T06:12:39.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.700+0000 7fe004ff9640 1 -- 172.21.15.130:0/2801170473 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(176..176 src has 1..176) v4 ==== 403+0+0 (secure 0 0 0) 0x7fdff0055300 con 0x7fe0080d1750 2023-09-13T06:12:39.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.700+0000 7fe004ff9640 1 -- 172.21.15.130:0/2801170473 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7fdfe806def0 con 0x7fe0080d1750 2023-09-13T06:12:39.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.704+0000 7fe004ff9640 1 -- 172.21.15.130:0/2801170473 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdff0021090 con 0x7fe0080d1750 2023-09-13T06:12:39.704 INFO:teuthology.orchestra.run.smithi130.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T06:12:39.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.704+0000 7fe00d92c640 1 -- 172.21.15.130:0/2801170473 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfe8065b20 msgr2=0x7fdfe8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.704+0000 7fe00d92c640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfe8065b20 0x7fdfe8067fe0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdff8000f70 tx=0x7fdff8009040 comp rx=0 tx=0).stop 2023-09-13T06:12:39.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.704+0000 7fe00d92c640 1 -- 172.21.15.130:0/2801170473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0080d1750 msgr2=0x7fe00815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.704+0000 7fe00d92c640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0080d1750 0x7fe00815f060 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fdff000e960 tx=0x7fdff000ee20 comp rx=0 tx=0).stop 2023-09-13T06:12:39.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.704+0000 7fe00d92c640 1 -- 172.21.15.130:0/2801170473 shutdown_connections 2023-09-13T06:12:39.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.704+0000 7fe00d92c640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfe8065b20 0x7fdfe8067fe0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.704+0000 7fe00d92c640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe008146f30 0x7fe0080b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.704+0000 7fe00d92c640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0080d1750 0x7fe00815f060 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.704+0000 7fe00d92c640 1 --2- 172.21.15.130:0/2801170473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0080d1090 0x7fe0081597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.704+0000 7fe00d92c640 1 -- 172.21.15.130:0/2801170473 >> 172.21.15.130:0/2801170473 conn(0x7fe00806f170 msgr2=0x7fe00815dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:39.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.708+0000 7fe00d92c640 1 -- 172.21.15.130:0/2801170473 shutdown_connections 2023-09-13T06:12:39.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.708+0000 7fe00d92c640 1 -- 172.21.15.130:0/2801170473 wait complete. 2023-09-13T06:12:39.713 INFO:tasks.ceph.mds.c.smithi130.stderr: -9969> 2023-09-13T06:11:22.661+0000 7fbd6c397640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:12:39.727 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T06:12:39.768 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:12:39.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.868+0000 7fb6bec6d640 1 Processor -- start 2023-09-13T06:12:39.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.868+0000 7fb6bec6d640 1 -- start start 2023-09-13T06:12:39.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bec6d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb6b8158c10 0x7fb6b80b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bec6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6b80cc8e0 0x7fb6b80b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.872 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bec6d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b806f7f0 con 0x7fb6b80b06f0 2023-09-13T06:12:39.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bec6d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b815c230 con 0x7fb6b8158c10 2023-09-13T06:12:39.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bec6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b80b0c50 con 0x7fb6b80cc8e0 2023-09-13T06:12:39.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bca09640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb6b8158c10 0x7fb6b80b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.873 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bca09640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb6b8158c10 0x7fb6b80b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48724/0 (socket says 172.21.15.130:48724) 2023-09-13T06:12:39.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bca09640 1 -- 172.21.15.130:0/2036804305 learned_addr learned my addr 172.21.15.130:0/2036804305 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:39.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bd20a640 1 --2- 172.21.15.130:0/2036804305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6b80cc8e0 0x7fb6b80b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bca09640 1 -- 172.21.15.130:0/2036804305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6b80cc8e0 msgr2=0x7fb6b80b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:39.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bca09640 1 --2- 172.21.15.130:0/2036804305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6b80cc8e0 0x7fb6b80b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bca09640 1 -- 172.21.15.130:0/2036804305 >> v1:172.21.15.164:6789/0 conn(0x7fb6b80b06f0 legacy=0x7fb6b80cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:39.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bca09640 1 -- 172.21.15.130:0/2036804305 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b815b900 con 0x7fb6b8158c10 2023-09-13T06:12:39.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6bca09640 1 --2- 172.21.15.130:0/2036804305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6b8158c10 0x7fb6b80b01b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009870 tx=0x7fb6b401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5940e3140123641 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:39.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6af7fe640 1 -- 172.21.15.130:0/2036804305 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40ab600 con 0x7fb6b8158c10 2023-09-13T06:12:39.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6af7fe640 1 -- 172.21.15.130:0/2036804305 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b40ab760 con 0x7fb6b8158c10 2023-09-13T06:12:39.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.872+0000 7fb6af7fe640 1 -- 172.21.15.130:0/2036804305 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40abaf0 con 0x7fb6b8158c10 2023-09-13T06:12:39.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 -- 172.21.15.130:0/2036804305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6b8158c10 msgr2=0x7fb6b80b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 --2- 172.21.15.130:0/2036804305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6b8158c10 0x7fb6b80b01b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009870 tx=0x7fb6b401c440 comp rx=0 tx=0).stop 2023-09-13T06:12:39.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 -- 172.21.15.130:0/2036804305 shutdown_connections 2023-09-13T06:12:39.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 --2- 172.21.15.130:0/2036804305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6b80cc8e0 0x7fb6b80b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 --2- 172.21.15.130:0/2036804305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6b8158c10 0x7fb6b80b01b0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 -- 172.21.15.130:0/2036804305 >> 172.21.15.130:0/2036804305 conn(0x7fb6b8065990 msgr2=0x7fb6b8065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:39.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 -- 172.21.15.130:0/2036804305 shutdown_connections 2023-09-13T06:12:39.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 -- 172.21.15.130:0/2036804305 wait complete. 2023-09-13T06:12:39.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 Processor -- start 2023-09-13T06:12:39.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 -- start start 2023-09-13T06:12:39.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6b80b06f0 0x7fb6b814e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6b80cc8e0 0x7fb6b8153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6b8158c10 0x7fb6b815e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b8154dc0 con 0x7fb6b80b06f0 2023-09-13T06:12:39.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b81472c0 con 0x7fb6b80cc8e0 2023-09-13T06:12:39.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bec6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b814e800 con 0x7fb6b8158c10 2023-09-13T06:12:39.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bca09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6b80b06f0 0x7fb6b814e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bca09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6b80b06f0 0x7fb6b814e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:48740/0 (socket says 172.21.15.130:48740) 2023-09-13T06:12:39.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bca09640 1 -- 172.21.15.130:0/1081098746 learned_addr learned my addr 172.21.15.130:0/1081098746 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:39.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6affff640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6b80cc8e0 0x7fb6b8153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.876+0000 7fb6bd20a640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6b8158c10 0x7fb6b815e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6bca09640 1 -- 172.21.15.130:0/1081098746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6b8158c10 msgr2=0x7fb6b815e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6bca09640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6b8158c10 0x7fb6b815e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6bca09640 1 -- 172.21.15.130:0/1081098746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6b80cc8e0 msgr2=0x7fb6b8153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:39.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6bca09640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6b80cc8e0 0x7fb6b8153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:39.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6bca09640 1 -- 172.21.15.130:0/1081098746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b40094d0 con 0x7fb6b80b06f0 2023-09-13T06:12:39.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6bca09640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6b80b06f0 0x7fb6b814e2c0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40ad040 tx=0x7fb6b401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:39.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6ad7fa640 1 -- 172.21.15.130:0/1081098746 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40ab600 con 0x7fb6b80b06f0 2023-09-13T06:12:39.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6ad7fa640 1 -- 172.21.15.130:0/1081098746 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b40b4800 con 0x7fb6b80b06f0 2023-09-13T06:12:39.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6bec6d640 1 -- 172.21.15.130:0/1081098746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b8159760 con 0x7fb6b80b06f0 2023-09-13T06:12:39.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6ad7fa640 1 -- 172.21.15.130:0/1081098746 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40b4bb0 con 0x7fb6b80b06f0 2023-09-13T06:12:39.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6bec6d640 1 -- 172.21.15.130:0/1081098746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b8159d20 con 0x7fb6b80b06f0 2023-09-13T06:12:39.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6bec6d640 1 -- 172.21.15.130:0/1081098746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b80674a0 con 0x7fb6b80b06f0 2023-09-13T06:12:39.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6ad7fa640 1 -- 172.21.15.130:0/1081098746 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb6b40b4d10 con 0x7fb6b80b06f0 2023-09-13T06:12:39.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6ad7fa640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb6a4065b20 0x7fb6a4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:39.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6ad7fa640 1 -- 172.21.15.130:0/1081098746 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fb6b411da30 con 0x7fb6b80b06f0 2023-09-13T06:12:39.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6ad7fa640 1 -- 172.21.15.130:0/1081098746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7fb6a406d7c0 con 0x7fb6b80b06f0 2023-09-13T06:12:39.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.880+0000 7fb6affff640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb6a4065b20 0x7fb6a4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:39.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.884+0000 7fb6affff640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb6a4065b20 0x7fb6a4067fe0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80cb380 tx=0x7fb6a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:39.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:39.884+0000 7fb6ad7fa640 1 -- 172.21.15.130:0/1081098746 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb6b40c4020 con 0x7fb6b80b06f0 2023-09-13T06:12:40.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.068+0000 7fb6bec6d640 1 -- 172.21.15.130:0/1081098746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb6b8073e50 con 0x7fb6b80b06f0 2023-09-13T06:12:40.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.708+0000 7fb6ad7fa640 1 -- 172.21.15.130:0/1081098746 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v86) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb6b40eb340 con 0x7fb6b80b06f0 2023-09-13T06:12:40.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 -- 172.21.15.130:0/1081098746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb6a4065b20 msgr2=0x7fb6a4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:40.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb6a4065b20 0x7fb6a4067fe0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80cb380 tx=0x7fb6a8008040 comp rx=0 tx=0).stop 2023-09-13T06:12:40.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 -- 172.21.15.130:0/1081098746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6b80b06f0 msgr2=0x7fb6b814e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:40.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6b80b06f0 0x7fb6b814e2c0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40ad040 tx=0x7fb6b401ac80 comp rx=0 tx=0).stop 2023-09-13T06:12:40.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 -- 172.21.15.130:0/1081098746 shutdown_connections 2023-09-13T06:12:40.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb6a4065b20 0x7fb6a4067fe0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:40.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6b80cc8e0 0x7fb6b8153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:40.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6b8158c10 0x7fb6b815e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:40.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 --2- 172.21.15.130:0/1081098746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6b80b06f0 0x7fb6b814e2c0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:40.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 -- 172.21.15.130:0/1081098746 >> 172.21.15.130:0/1081098746 conn(0x7fb6b8065990 msgr2=0x7fb6b80ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:40.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 -- 172.21.15.130:0/1081098746 shutdown_connections 2023-09-13T06:12:40.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.712+0000 7fb6bec6d640 1 -- 172.21.15.130:0/1081098746 wait complete. 2023-09-13T06:12:40.736 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T06:12:40.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc44cb59640 1 Processor -- start 2023-09-13T06:12:40.925 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc44cb59640 1 -- start start 2023-09-13T06:12:40.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc44cb59640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc44815d4b0 0x7fc4480713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:40.928 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc44cb59640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc4480cb940 0x7fc4480b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:40.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc44cb59640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc4480b0dd0 0x7fc448160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:40.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc44cb59640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4480b2710 con 0x7fc4480b0dd0 2023-09-13T06:12:40.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc44cb59640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4480b1260 con 0x7fc4480cb940 2023-09-13T06:12:40.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc44cb59640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44815d890 con 0x7fc44815d4b0 2023-09-13T06:12:40.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc446d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc4480b0dd0 0x7fc448160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:40.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc446d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc4480b0dd0 0x7fc448160fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41442/0 (socket says 172.21.15.130:41442) 2023-09-13T06:12:40.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc446d9d640 1 -- 172.21.15.130:0/1122732869 learned_addr learned my addr 172.21.15.130:0/1122732869 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:40.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc44659c640 1 --2- 172.21.15.130:0/1122732869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc44815d4b0 0x7fc4480713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:40.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc43dd9b640 1 --2- 172.21.15.130:0/1122732869 >> v2:172.21.15.164:3300/0 conn(0x7fc4480cb940 0x7fc4480b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:40.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc446d9d640 1 -- 172.21.15.130:0/1122732869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc44815d4b0 msgr2=0x7fc4480713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:40.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc446d9d640 1 --2- 172.21.15.130:0/1122732869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc44815d4b0 0x7fc4480713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:40.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc446d9d640 1 -- 172.21.15.130:0/1122732869 >> v2:172.21.15.164:3300/0 conn(0x7fc4480cb940 msgr2=0x7fc4480b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:40.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc446d9d640 1 --2- 172.21.15.130:0/1122732869 >> v2:172.21.15.164:3300/0 conn(0x7fc4480cb940 0x7fc4480b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:40.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.924+0000 7fc446d9d640 1 -- 172.21.15.130:0/1122732869 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4480cbeb0 con 0x7fc4480b0dd0 2023-09-13T06:12:40.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc446d9d640 1 --2- 172.21.15.130:0/1122732869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4480b0dd0 0x7fc448160fc0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fc4480b2e50 tx=0x7fc44001c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bce66aec836b0c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:40.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc445d9b640 1 -- 172.21.15.130:0/1122732869 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4400a64e0 con 0x7fc4480b0dd0 2023-09-13T06:12:40.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc445d9b640 1 -- 172.21.15.130:0/1122732869 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4400a6640 con 0x7fc4480b0dd0 2023-09-13T06:12:40.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc445d9b640 1 -- 172.21.15.130:0/1122732869 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4400a69d0 con 0x7fc4480b0dd0 2023-09-13T06:12:40.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc44cb59640 1 -- 172.21.15.130:0/1122732869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4480b0dd0 msgr2=0x7fc448160fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:40.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc44cb59640 1 --2- 172.21.15.130:0/1122732869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4480b0dd0 0x7fc448160fc0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fc4480b2e50 tx=0x7fc44001c650 comp rx=0 tx=0).stop 2023-09-13T06:12:40.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc44cb59640 1 -- 172.21.15.130:0/1122732869 shutdown_connections 2023-09-13T06:12:40.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc44cb59640 1 --2- 172.21.15.130:0/1122732869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4480b0dd0 0x7fc448160fc0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:40.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc44cb59640 1 --2- 172.21.15.130:0/1122732869 >> v2:172.21.15.164:3300/0 conn(0x7fc4480cb940 0x7fc4480b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:40.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc44cb59640 1 --2- 172.21.15.130:0/1122732869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc44815d4b0 0x7fc4480713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:40.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc44cb59640 1 -- 172.21.15.130:0/1122732869 >> 172.21.15.130:0/1122732869 conn(0x7fc448065f90 msgr2=0x7fc4480cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:40.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc44cb59640 1 -- 172.21.15.130:0/1122732869 shutdown_connections 2023-09-13T06:12:40.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.928+0000 7fc44cb59640 1 -- 172.21.15.130:0/1122732869 wait complete. 2023-09-13T06:12:40.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc44cb59640 1 Processor -- start 2023-09-13T06:12:40.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc44cb59640 1 -- start start 2023-09-13T06:12:40.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc44cb59640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4480b0dd0 0x7fc44814bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:40.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc44cb59640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4480cb940 0x7fc44814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:40.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc44cb59640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc44815d4b0 0x7fc448160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:40.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc44cb59640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44814c180 con 0x7fc4480cb940 2023-09-13T06:12:40.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc44cb59640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44814abd0 con 0x7fc44815d4b0 2023-09-13T06:12:40.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc44cb59640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44814b2b0 con 0x7fc4480b0dd0 2023-09-13T06:12:40.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4480cb940 0x7fc44814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:40.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4480cb940 0x7fc44814ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41450/0 (socket says 172.21.15.130:41450) 2023-09-13T06:12:40.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43dd9b640 1 -- 172.21.15.130:0/1473317892 learned_addr learned my addr 172.21.15.130:0/1473317892 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:40.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc44659c640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4480b0dd0 0x7fc44814bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:40.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc446d9d640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc44815d4b0 0x7fc448160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:40.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43dd9b640 1 -- 172.21.15.130:0/1473317892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4480b0dd0 msgr2=0x7fc44814bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:40.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43dd9b640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4480b0dd0 0x7fc44814bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:40.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43dd9b640 1 -- 172.21.15.130:0/1473317892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc44815d4b0 msgr2=0x7fc448160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:40.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43dd9b640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc44815d4b0 0x7fc448160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:40.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43dd9b640 1 -- 172.21.15.130:0/1473317892 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc440009b30 con 0x7fc4480cb940 2023-09-13T06:12:40.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43dd9b640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4480cb940 0x7fc44814ad70 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fc43000d830 tx=0x7fc43000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:40.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43f7fe640 1 -- 172.21.15.130:0/1473317892 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300096a0 con 0x7fc4480cb940 2023-09-13T06:12:40.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43f7fe640 1 -- 172.21.15.130:0/1473317892 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc430009800 con 0x7fc4480cb940 2023-09-13T06:12:40.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc44cb59640 1 -- 172.21.15.130:0/1473317892 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4481f6410 con 0x7fc4480cb940 2023-09-13T06:12:40.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc43f7fe640 1 -- 172.21.15.130:0/1473317892 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430009b70 con 0x7fc4480cb940 2023-09-13T06:12:40.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.932+0000 7fc44cb59640 1 -- 172.21.15.130:0/1473317892 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4481f6c50 con 0x7fc4480cb940 2023-09-13T06:12:40.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.936+0000 7fc44cb59640 1 -- 172.21.15.130:0/1473317892 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4480618a0 con 0x7fc4480cb940 2023-09-13T06:12:40.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.936+0000 7fc43f7fe640 1 -- 172.21.15.130:0/1473317892 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc430014410 con 0x7fc4480cb940 2023-09-13T06:12:40.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.936+0000 7fc43f7fe640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc428065b20 0x7fc428067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:40.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.936+0000 7fc43f7fe640 1 -- 172.21.15.130:0/1473317892 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fc430083bd0 con 0x7fc4480cb940 2023-09-13T06:12:40.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.936+0000 7fc44659c640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc428065b20 0x7fc428067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:40.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.936+0000 7fc43f7fe640 1 -- 172.21.15.130:0/1473317892 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7fc42806d7c0 con 0x7fc4480cb940 2023-09-13T06:12:40.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.936+0000 7fc44659c640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc428065b20 0x7fc428067fe0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc448155300 tx=0x7fc438008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:40.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:40.940+0000 7fc43f7fe640 1 -- 172.21.15.130:0/1473317892 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc430051520 con 0x7fc4480cb940 2023-09-13T06:12:41.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.088+0000 7fc44cb59640 1 -- 172.21.15.130:0/1473317892 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc4480ce4a0 con 0x7fc4480cb940 2023-09-13T06:12:41.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.712+0000 7fc43f7fe640 1 -- 172.21.15.130:0/1473317892 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(177..177 src has 1..177) v4 ==== 325+0+0 (secure 0 0 0) 0x7fc4300551e0 con 0x7fc4480cb940 2023-09-13T06:12:41.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.712+0000 7fc43f7fe640 1 -- 172.21.15.130:0/1473317892 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7fc42806bbf0 con 0x7fc4480cb940 2023-09-13T06:12:41.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.712+0000 7fc43f7fe640 1 -- 172.21.15.130:0/1473317892 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v177) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc430054b40 con 0x7fc4480cb940 2023-09-13T06:12:41.716 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' removed 2023-09-13T06:12:41.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 -- 172.21.15.130:0/1473317892 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc428065b20 msgr2=0x7fc428067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:41.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc428065b20 0x7fc428067fe0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc448155300 tx=0x7fc438008040 comp rx=0 tx=0).stop 2023-09-13T06:12:41.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 -- 172.21.15.130:0/1473317892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4480cb940 msgr2=0x7fc44814ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:41.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4480cb940 0x7fc44814ad70 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fc43000d830 tx=0x7fc43000dcf0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 -- 172.21.15.130:0/1473317892 shutdown_connections 2023-09-13T06:12:41.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc428065b20 0x7fc428067fe0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc44815d4b0 0x7fc448160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4480cb940 0x7fc44814ad70 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 --2- 172.21.15.130:0/1473317892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4480b0dd0 0x7fc44814bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 -- 172.21.15.130:0/1473317892 >> 172.21.15.130:0/1473317892 conn(0x7fc448065f90 msgr2=0x7fc44806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:41.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 -- 172.21.15.130:0/1473317892 shutdown_connections 2023-09-13T06:12:41.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.720+0000 7fc44cb59640 1 -- 172.21.15.130:0/1473317892 wait complete. 2023-09-13T06:12:41.742 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T06:12:41.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.884+0000 7fe98c767640 1 Processor -- start 2023-09-13T06:12:41.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.884+0000 7fe98c767640 1 -- start start 2023-09-13T06:12:41.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98c767640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe984144a40 0x7fe9840aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:41.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98c767640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe9840b0460 0x7fe98406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:41.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98c767640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe98406ced0 0x7fe98406f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:41.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98c767640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9840b08f0 con 0x7fe984144a40 2023-09-13T06:12:41.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98c767640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe984144e20 con 0x7fe9840b0460 2023-09-13T06:12:41.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98c767640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98406d7c0 con 0x7fe98406ced0 2023-09-13T06:12:41.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98a503640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe984144a40 0x7fe9840aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:41.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98a503640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe984144a40 0x7fe9840aff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41458/0 (socket says 172.21.15.130:41458) 2023-09-13T06:12:41.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98a503640 1 -- 172.21.15.130:0/4262958686 learned_addr learned my addr 172.21.15.130:0/4262958686 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:41.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe989d02640 1 --2- 172.21.15.130:0/4262958686 >> v2:172.21.15.164:3300/0 conn(0x7fe9840b0460 0x7fe98406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:41.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98ad04640 1 --2- 172.21.15.130:0/4262958686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe98406ced0 0x7fe98406f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:41.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98a503640 1 -- 172.21.15.130:0/4262958686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe98406ced0 msgr2=0x7fe98406f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:41.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98a503640 1 --2- 172.21.15.130:0/4262958686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe98406ced0 0x7fe98406f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98a503640 1 -- 172.21.15.130:0/4262958686 >> v2:172.21.15.164:3300/0 conn(0x7fe9840b0460 msgr2=0x7fe98406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:41.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98a503640 1 --2- 172.21.15.130:0/4262958686 >> v2:172.21.15.164:3300/0 conn(0x7fe9840b0460 0x7fe98406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98a503640 1 -- 172.21.15.130:0/4262958686 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98406daa0 con 0x7fe984144a40 2023-09-13T06:12:41.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.888+0000 7fe98a503640 1 --2- 172.21.15.130:0/4262958686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe984144a40 0x7fe9840aff20 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fe9840aded0 tx=0x7fe98001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f2767b5eb880f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:41.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe989501640 1 -- 172.21.15.130:0/4262958686 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800aa5f0 con 0x7fe984144a40 2023-09-13T06:12:41.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe989501640 1 -- 172.21.15.130:0/4262958686 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9800aa750 con 0x7fe984144a40 2023-09-13T06:12:41.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe989501640 1 -- 172.21.15.130:0/4262958686 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800aaae0 con 0x7fe984144a40 2023-09-13T06:12:41.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 -- 172.21.15.130:0/4262958686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe984144a40 msgr2=0x7fe9840aff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:41.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 --2- 172.21.15.130:0/4262958686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe984144a40 0x7fe9840aff20 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fe9840aded0 tx=0x7fe98001c4d0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 -- 172.21.15.130:0/4262958686 shutdown_connections 2023-09-13T06:12:41.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 --2- 172.21.15.130:0/4262958686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe98406ced0 0x7fe98406f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 --2- 172.21.15.130:0/4262958686 >> v2:172.21.15.164:3300/0 conn(0x7fe9840b0460 0x7fe98406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 --2- 172.21.15.130:0/4262958686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe984144a40 0x7fe9840aff20 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 -- 172.21.15.130:0/4262958686 >> 172.21.15.130:0/4262958686 conn(0x7fe9840735e0 msgr2=0x7fe984065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:41.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 -- 172.21.15.130:0/4262958686 shutdown_connections 2023-09-13T06:12:41.894 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 -- 172.21.15.130:0/4262958686 wait complete. 2023-09-13T06:12:41.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 Processor -- start 2023-09-13T06:12:41.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 -- start start 2023-09-13T06:12:41.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe98406ced0 0x7fe9840a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:41.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9840b0460 0x7fe98413b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:41.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe984144a40 0x7fe98413b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:41.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98413adb0 con 0x7fe9840b0460 2023-09-13T06:12:41.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840a9e40 con 0x7fe984144a40 2023-09-13T06:12:41.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe98c767640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe984144150 con 0x7fe98406ced0 2023-09-13T06:12:41.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.892+0000 7fe989d02640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9840b0460 0x7fe98413b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:41.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe989d02640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9840b0460 0x7fe98413b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41466/0 (socket says 172.21.15.130:41466) 2023-09-13T06:12:41.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe989d02640 1 -- 172.21.15.130:0/2946093345 learned_addr learned my addr 172.21.15.130:0/2946093345 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:41.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe98a503640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe98406ced0 0x7fe9840a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:41.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe98ad04640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe984144a40 0x7fe98413b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:41.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe989d02640 1 -- 172.21.15.130:0/2946093345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe98406ced0 msgr2=0x7fe9840a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:41.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe989d02640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe98406ced0 0x7fe9840a9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe989d02640 1 -- 172.21.15.130:0/2946093345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe984144a40 msgr2=0x7fe98413b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:41.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe989d02640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe984144a40 0x7fe98413b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:41.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe989d02640 1 -- 172.21.15.130:0/2946093345 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9800094d0 con 0x7fe9840b0460 2023-09-13T06:12:41.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe989d02640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9840b0460 0x7fe98413b240 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fe97400e960 tx=0x7fe97400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:41.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe97affd640 1 -- 172.21.15.130:0/2946093345 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974009690 con 0x7fe9840b0460 2023-09-13T06:12:41.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe97affd640 1 -- 172.21.15.130:0/2946093345 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97400ca00 con 0x7fe9840b0460 2023-09-13T06:12:41.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe98c767640 1 -- 172.21.15.130:0/2946093345 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98413a480 con 0x7fe9840b0460 2023-09-13T06:12:41.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe97affd640 1 -- 172.21.15.130:0/2946093345 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97400cd70 con 0x7fe9840b0460 2023-09-13T06:12:41.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe98c767640 1 -- 172.21.15.130:0/2946093345 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98413aa40 con 0x7fe9840b0460 2023-09-13T06:12:41.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe98c767640 1 -- 172.21.15.130:0/2946093345 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98413af60 con 0x7fe9840b0460 2023-09-13T06:12:41.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe97affd640 1 -- 172.21.15.130:0/2946093345 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe974013470 con 0x7fe9840b0460 2023-09-13T06:12:41.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe97affd640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe968065b20 0x7fe968067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:41.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.896+0000 7fe97affd640 1 -- 172.21.15.130:0/2946093345 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5386+0+0 (secure 0 0 0) 0x7fe9740833e0 con 0x7fe9840b0460 2023-09-13T06:12:41.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.900+0000 7fe98a503640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe968065b20 0x7fe968067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:41.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.900+0000 7fe97affd640 1 -- 172.21.15.130:0/2946093345 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7fe96806c950 con 0x7fe9840b0460 2023-09-13T06:12:41.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.900+0000 7fe98a503640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe968065b20 0x7fe968067fe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe9800ae000 tx=0x7fe9800b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:41.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:41.900+0000 7fe97affd640 1 -- 172.21.15.130:0/2946093345 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe98413af60 con 0x7fe9840b0460 2023-09-13T06:12:42.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.048+0000 7fe98c767640 1 -- 172.21.15.130:0/2946093345 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe98413af60 con 0x7fe9840b0460 2023-09-13T06:12:42.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.476+0000 7fe97affd640 1 -- 172.21.15.130:0/2946093345 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(178..178 src has 1..178) v4 ==== 704+0+0 (secure 0 0 0) 0x7fe974054b60 con 0x7fe9840b0460 2023-09-13T06:12:42.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.476+0000 7fe97affd640 1 -- 172.21.15.130:0/2946093345 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fe96806b6e0 con 0x7fe9840b0460 2023-09-13T06:12:42.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.480+0000 7fe97affd640 1 -- 172.21.15.130:0/2946093345 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v178) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe98413af60 con 0x7fe9840b0460 2023-09-13T06:12:42.481 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' removed 2023-09-13T06:12:42.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.484+0000 7fe98c767640 1 -- 172.21.15.130:0/2946093345 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe968065b20 msgr2=0x7fe968067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:42.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.484+0000 7fe98c767640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe968065b20 0x7fe968067fe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe9800ae000 tx=0x7fe9800b5040 comp rx=0 tx=0).stop 2023-09-13T06:12:42.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.484+0000 7fe98c767640 1 -- 172.21.15.130:0/2946093345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9840b0460 msgr2=0x7fe98413b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:42.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.484+0000 7fe98c767640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9840b0460 0x7fe98413b240 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fe97400e960 tx=0x7fe97400ee20 comp rx=0 tx=0).stop 2023-09-13T06:12:42.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.488+0000 7fe98c767640 1 -- 172.21.15.130:0/2946093345 shutdown_connections 2023-09-13T06:12:42.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.488+0000 7fe98c767640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe968065b20 0x7fe968067fe0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.488+0000 7fe98c767640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe984144a40 0x7fe98413b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.488+0000 7fe98c767640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9840b0460 0x7fe98413b240 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.488+0000 7fe98c767640 1 --2- 172.21.15.130:0/2946093345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe98406ced0 0x7fe9840a9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.488+0000 7fe98c767640 1 -- 172.21.15.130:0/2946093345 >> 172.21.15.130:0/2946093345 conn(0x7fe9840735e0 msgr2=0x7fe984065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:42.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.488+0000 7fe98c767640 1 -- 172.21.15.130:0/2946093345 shutdown_connections 2023-09-13T06:12:42.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.488+0000 7fe98c767640 1 -- 172.21.15.130:0/2946093345 wait complete. 2023-09-13T06:12:42.508 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-13T06:12:42.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.648+0000 7f3ce0c6a640 1 Processor -- start 2023-09-13T06:12:42.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.648+0000 7f3ce0c6a640 1 -- start start 2023-09-13T06:12:42.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3ce0c6a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3cdc070f00 0x7f3cdc0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:42.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3ce0c6a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cdc0712e0 0x7f3cdc143290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:42.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3ce0c6a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc1437d0 con 0x7f3cdc0b1d90 2023-09-13T06:12:42.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3ce0c6a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc070930 con 0x7f3cdc070f00 2023-09-13T06:12:42.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3ce0c6a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc15dab0 con 0x7f3cdc0712e0 2023-09-13T06:12:42.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3cda59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3cdc070f00 0x7f3cdc0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:42.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3cda59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3cdc070f00 0x7f3cdc0703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41472/0 (socket says 172.21.15.130:41472) 2023-09-13T06:12:42.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3cdad9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3cdc0b1d90 0x7f3cdc13f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55342/0 (socket says 172.21.15.130:55342) 2023-09-13T06:12:42.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3cda59c640 1 -- 172.21.15.130:0/168821255 learned_addr learned my addr 172.21.15.130:0/168821255 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:42.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3cd3fff640 1 --2- 172.21.15.130:0/168821255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cdc0712e0 0x7f3cdc143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:42.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3cda59c640 1 -- 172.21.15.130:0/168821255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cdc0712e0 msgr2=0x7f3cdc143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:42.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3cda59c640 1 --2- 172.21.15.130:0/168821255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cdc0712e0 0x7f3cdc143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3cda59c640 1 -- 172.21.15.130:0/168821255 >> v1:172.21.15.130:6789/0 conn(0x7f3cdc0b1d90 legacy=0x7f3cdc13f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:42.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3cda59c640 1 -- 172.21.15.130:0/168821255 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc15dd90 con 0x7f3cdc070f00 2023-09-13T06:12:42.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.652+0000 7f3cd9d9b640 1 -- 172.21.15.130:0/168821255 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839217951 0 0) 0x7f3cdc1437d0 con 0x7f3cdc0b1d90 2023-09-13T06:12:42.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3cda59c640 1 --2- 172.21.15.130:0/168821255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cdc070f00 0x7f3cdc0703f0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009870 tx=0x7f3ccc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e19180a2a8ec379 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:42.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3cd9d9b640 1 -- 172.21.15.130:0/168821255 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0aa670 con 0x7f3cdc070f00 2023-09-13T06:12:42.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3cd9d9b640 1 -- 172.21.15.130:0/168821255 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc0aa7d0 con 0x7f3cdc070f00 2023-09-13T06:12:42.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3cd9d9b640 1 -- 172.21.15.130:0/168821255 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0aab60 con 0x7f3cdc070f00 2023-09-13T06:12:42.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/168821255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cdc070f00 msgr2=0x7f3cdc0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:42.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3ce0c6a640 1 --2- 172.21.15.130:0/168821255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cdc070f00 0x7f3cdc0703f0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009870 tx=0x7f3ccc01c510 comp rx=0 tx=0).stop 2023-09-13T06:12:42.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/168821255 shutdown_connections 2023-09-13T06:12:42.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3ce0c6a640 1 --2- 172.21.15.130:0/168821255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cdc0712e0 0x7f3cdc143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3ce0c6a640 1 --2- 172.21.15.130:0/168821255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cdc070f00 0x7f3cdc0703f0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/168821255 >> 172.21.15.130:0/168821255 conn(0x7f3cdc066210 msgr2=0x7f3cdc0b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:42.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/168821255 shutdown_connections 2023-09-13T06:12:42.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/168821255 wait complete. 2023-09-13T06:12:42.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3ce0c6a640 1 Processor -- start 2023-09-13T06:12:42.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.656+0000 7f3ce0c6a640 1 -- start start 2023-09-13T06:12:42.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3ce0c6a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cdc070f00 0x7f3cdc0cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:42.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3ce0c6a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3cdc0712e0 0x7f3cdc0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:42.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3ce0c6a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cdc0b1d90 0x7f3cdc1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:42.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3ce0c6a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0ce0e0 con 0x7f3cdc070f00 2023-09-13T06:12:42.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3ce0c6a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0b0740 con 0x7f3cdc0712e0 2023-09-13T06:12:42.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3ce0c6a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc13fab0 con 0x7f3cdc0b1d90 2023-09-13T06:12:42.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cda59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cdc070f00 0x7f3cdc0cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:42.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cda59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cdc070f00 0x7f3cdc0cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41476/0 (socket says 172.21.15.130:41476) 2023-09-13T06:12:42.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cda59c640 1 -- 172.21.15.130:0/475864430 learned_addr learned my addr 172.21.15.130:0/475864430 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:42.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cd3fff640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3cdc0712e0 0x7f3cdc0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:42.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cdad9d640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cdc0b1d90 0x7f3cdc1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:42.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cda59c640 1 -- 172.21.15.130:0/475864430 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cdc0b1d90 msgr2=0x7f3cdc1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:42.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cda59c640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cdc0b1d90 0x7f3cdc1535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cda59c640 1 -- 172.21.15.130:0/475864430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3cdc0712e0 msgr2=0x7f3cdc0b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:42.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cda59c640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3cdc0712e0 0x7f3cdc0b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cda59c640 1 -- 172.21.15.130:0/475864430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0094d0 con 0x7f3cdc070f00 2023-09-13T06:12:42.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cda59c640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cdc070f00 0x7f3cdc0cce80 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc01a140 tx=0x7f3ccc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:42.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cd2ffd640 1 -- 172.21.15.130:0/475864430 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0aa670 con 0x7f3cdc070f00 2023-09-13T06:12:42.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cd2ffd640 1 -- 172.21.15.130:0/475864430 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc0b3820 con 0x7f3cdc070f00 2023-09-13T06:12:42.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/475864430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc0cd460 con 0x7f3cdc070f00 2023-09-13T06:12:42.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cd2ffd640 1 -- 172.21.15.130:0/475864430 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0b3bd0 con 0x7f3cdc070f00 2023-09-13T06:12:42.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/475864430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc0cda20 con 0x7f3cdc070f00 2023-09-13T06:12:42.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/475864430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc0674a0 con 0x7f3cdc070f00 2023-09-13T06:12:42.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.660+0000 7f3cd2ffd640 1 -- 172.21.15.130:0/475864430 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3ccc0b3d30 con 0x7f3cdc070f00 2023-09-13T06:12:42.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.664+0000 7f3cd2ffd640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cbc065b20 0x7f3cbc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:42.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.664+0000 7f3cd2ffd640 1 -- 172.21.15.130:0/475864430 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3ccc11d600 con 0x7f3cdc070f00 2023-09-13T06:12:42.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.664+0000 7f3cd3fff640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cbc065b20 0x7f3cbc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:42.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.664+0000 7f3cd3fff640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cbc065b20 0x7f3cbc067fe0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc1f92e0 tx=0x7f3cc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:42.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.668+0000 7f3cd2ffd640 1 -- 172.21.15.130:0/475864430 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3ccc0eb2f0 con 0x7f3cdc070f00 2023-09-13T06:12:42.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.820+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/475864430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3cdc073e50 con 0x7f3cdc070f00 2023-09-13T06:12:42.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3cd2ffd640 1 -- 172.21.15.130:0/475864430 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3ccc0c30a0 con 0x7f3cdc070f00 2023-09-13T06:12:42.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/475864430 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cbc065b20 msgr2=0x7f3cbc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:42.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cbc065b20 0x7f3cbc067fe0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc1f92e0 tx=0x7f3cc4008040 comp rx=0 tx=0).stop 2023-09-13T06:12:42.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/475864430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cdc070f00 msgr2=0x7f3cdc0cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:42.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cdc070f00 0x7f3cdc0cce80 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc01a140 tx=0x7f3ccc01ad50 comp rx=0 tx=0).stop 2023-09-13T06:12:42.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/475864430 shutdown_connections 2023-09-13T06:12:42.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3cbc065b20 0x7f3cbc067fe0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3cdc0712e0 0x7f3cdc0b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3cdc0b1d90 0x7f3cdc1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 --2- 172.21.15.130:0/475864430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cdc070f00 0x7f3cdc0cce80 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/475864430 >> 172.21.15.130:0/475864430 conn(0x7f3cdc066210 msgr2=0x7f3cdc15cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:42.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/475864430 shutdown_connections 2023-09-13T06:12:42.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.828+0000 7f3ce0c6a640 1 -- 172.21.15.130:0/475864430 wait complete. 2023-09-13T06:12:42.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-09-13T06:12:42.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c1ea56640 1 Processor -- start 2023-09-13T06:12:42.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c1ea56640 1 -- start start 2023-09-13T06:12:42.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c1ea56640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180d1090 0x7f8c1815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:42.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c1ea56640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c180b63c0 con 0x7f8c18146f30 2023-09-13T06:12:42.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c1ea56640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c180d0c20 con 0x7f8c180d1750 2023-09-13T06:12:42.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c1ea56640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1815dea0 con 0x7f8c180d1090 2023-09-13T06:12:42.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c1cff3640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f8c18146f30 0x7f8c180b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55348/0 (socket says 172.21.15.130:55348) 2023-09-13T06:12:42.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c1cff3640 1 -- 172.21.15.130:0/4135161184 learned_addr learned my addr 172.21.15.130:0/4135161184 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:42.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c177fe640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180d1090 0x7f8c1815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:42.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681680215 0 0) 0x7f8c180b63c0 con 0x7f8c18146f30 2023-09-13T06:12:42.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c00003530 con 0x7f8c18146f30 2023-09-13T06:12:42.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4106338602 0 0) 0x7f8c00003530 con 0x7f8c18146f30 2023-09-13T06:12:42.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180d1090 msgr2=0x7f8c1815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:42.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180d1090 0x7f8c1815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 >> v1:172.21.15.164:6789/0 conn(0x7f8c180d1750 legacy=0x7f8c18146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:42.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c180b6610 con 0x7f8c18146f30 2023-09-13T06:12:42.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f8c10001a00 con 0x7f8c18146f30 2023-09-13T06:12:42.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 >> v1:172.21.15.130:6789/0 conn(0x7f8c18146f30 legacy=0x7f8c180b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:42.994 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180d1090 0x7f8c00003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:42.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00003fa0 0x7f8c000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:42.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c00004d10 0x7f8c00005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:42.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0000bac0 con 0x7f8c00004d10 2023-09-13T06:12:42.995 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0000bc30 con 0x7f8c00003fa0 2023-09-13T06:12:42.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0000bdf0 con 0x7f8c180d1090 2023-09-13T06:12:42.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c1cff3640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c00004d10 0x7f8c00005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:42.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c17fff640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180d1090 0x7f8c00003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:42.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.988+0000 7f8c177fe640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00003fa0 0x7f8c000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:42.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c1cff3640 1 -- 172.21.15.130:0/4135161184 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180d1090 msgr2=0x7f8c00003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:42.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c1cff3640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180d1090 0x7f8c00003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c1cff3640 1 -- 172.21.15.130:0/4135161184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00003fa0 msgr2=0x7f8c000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:42.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c1cff3640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00003fa0 0x7f8c000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:42.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c1cff3640 1 -- 172.21.15.130:0/4135161184 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00003530 con 0x7f8c00004d10 2023-09-13T06:12:43.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c1cff3640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c00004d10 0x7f8c00005190 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000a830 tx=0x7f8c1001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b367ac41e931c67 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:43.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100072d0 con 0x7f8c00004d10 2023-09-13T06:12:43.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c100a8070 con 0x7f8c00004d10 2023-09-13T06:12:43.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c16ffd640 1 -- 172.21.15.130:0/4135161184 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100076f0 con 0x7f8c00004d10 2023-09-13T06:12:43.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c1ea56640 1 -- 172.21.15.130:0/4135161184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c00004d10 msgr2=0x7f8c00005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:43.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c1ea56640 1 --2- 172.21.15.130:0/4135161184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c00004d10 0x7f8c00005190 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000a830 tx=0x7f8c1001d340 comp rx=0 tx=0).stop 2023-09-13T06:12:43.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.992+0000 7f8c1cff3640 1 -- 172.21.15.130:0/4135161184 reap_dead start 2023-09-13T06:12:43.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 -- 172.21.15.130:0/4135161184 shutdown_connections 2023-09-13T06:12:43.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 -- 172.21.15.130:0/4135161184 >> 172.21.15.130:0/4135161184 conn(0x7f8c1806f170 msgr2=0x7f8c1806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:43.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 -- 172.21.15.130:0/4135161184 shutdown_connections 2023-09-13T06:12:43.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 -- 172.21.15.130:0/4135161184 wait complete. 2023-09-13T06:12:43.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 Processor -- start 2023-09-13T06:12:43.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 -- start start 2023-09-13T06:12:43.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00004d10 0x7f8c181f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:43.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c181399b0 0x7f8c181f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:43.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180b7600 0x7f8c180b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:43.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180b7fd0 con 0x7f8c181399b0 2023-09-13T06:12:43.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c181f70e0 con 0x7f8c00004d10 2023-09-13T06:12:43.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1ea56640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180a9c80 con 0x7f8c180b7600 2023-09-13T06:12:43.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c177fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c181399b0 0x7f8c181f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:43.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c177fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c181399b0 0x7f8c181f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41498/0 (socket says 172.21.15.130:41498) 2023-09-13T06:12:43.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c177fe640 1 -- 172.21.15.130:0/1497765079 learned_addr learned my addr 172.21.15.130:0/1497765079 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:43.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c177fe640 1 -- 172.21.15.130:0/1497765079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180b7600 msgr2=0x7f8c180b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:43.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1cff3640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180b7600 0x7f8c180b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:43.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c177fe640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180b7600 0x7f8c180b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c17fff640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00004d10 0x7f8c181f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:43.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c177fe640 1 -- 172.21.15.130:0/1497765079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00004d10 msgr2=0x7f8c181f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:43.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c177fe640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00004d10 0x7f8c181f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c177fe640 1 -- 172.21.15.130:0/1497765079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c180aa200 con 0x7f8c181399b0 2023-09-13T06:12:43.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c1cff3640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180b7600 0x7f8c180b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:43.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c17fff640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00004d10 0x7f8c181f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:43.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:42.996+0000 7f8c177fe640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c181399b0 0x7f8c181f2470 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0119d0 tx=0x7f8c0c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:43.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.000+0000 7f8c14ff9640 1 -- 172.21.15.130:0/1497765079 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c00fb50 con 0x7f8c181399b0 2023-09-13T06:12:43.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.000+0000 7f8c14ff9640 1 -- 172.21.15.130:0/1497765079 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c00fcb0 con 0x7f8c181399b0 2023-09-13T06:12:43.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.000+0000 7f8c1ea56640 1 -- 172.21.15.130:0/1497765079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c180a9f20 con 0x7f8c181399b0 2023-09-13T06:12:43.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.000+0000 7f8c14ff9640 1 -- 172.21.15.130:0/1497765079 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c014440 con 0x7f8c181399b0 2023-09-13T06:12:43.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.000+0000 7f8c1ea56640 1 -- 172.21.15.130:0/1497765079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c180cd560 con 0x7f8c181399b0 2023-09-13T06:12:43.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.000+0000 7f8c1ea56640 1 -- 172.21.15.130:0/1497765079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c180618a0 con 0x7f8c181399b0 2023-09-13T06:12:43.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.000+0000 7f8c14ff9640 1 -- 172.21.15.130:0/1497765079 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8c0c0145a0 con 0x7f8c181399b0 2023-09-13T06:12:43.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.000+0000 7f8c14ff9640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c04065b20 0x7f8c04067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:43.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.000+0000 7f8c14ff9640 1 -- 172.21.15.130:0/1497765079 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8c0c083930 con 0x7f8c181399b0 2023-09-13T06:12:43.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.000+0000 7f8c17fff640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c04065b20 0x7f8c04067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:43.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.000+0000 7f8c17fff640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c04065b20 0x7f8c04067fe0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8c08007fd0 tx=0x7f8c08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:43.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.004+0000 7f8c14ff9640 1 -- 172.21.15.130:0/1497765079 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8c0c051630 con 0x7f8c181399b0 2023-09-13T06:12:43.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.208+0000 7f8c1ea56640 1 -- 172.21.15.130:0/1497765079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f8c18146d10 con 0x7f8c181399b0 2023-09-13T06:12:43.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.720+0000 7f8c14ff9640 1 -- 172.21.15.130:0/1497765079 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v550) v1 ==== 131+0+0 (secure 0 0 0) 0x7f8c0c059e60 con 0x7f8c181399b0 2023-09-13T06:12:43.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.720+0000 7f8c1ea56640 1 -- 172.21.15.130:0/1497765079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c04065b20 msgr2=0x7f8c04067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:43.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.720+0000 7f8c1ea56640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c04065b20 0x7f8c04067fe0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8c08007fd0 tx=0x7f8c08009040 comp rx=0 tx=0).stop 2023-09-13T06:12:43.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.720+0000 7f8c1ea56640 1 -- 172.21.15.130:0/1497765079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c181399b0 msgr2=0x7f8c181f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:43.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.720+0000 7f8c1ea56640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c181399b0 0x7f8c181f2470 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0119d0 tx=0x7f8c0c011e90 comp rx=0 tx=0).stop 2023-09-13T06:12:43.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.720+0000 7f8c1ea56640 1 -- 172.21.15.130:0/1497765079 shutdown_connections 2023-09-13T06:12:43.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.720+0000 7f8c1ea56640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8c04065b20 0x7f8c04067fe0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.720+0000 7f8c1ea56640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8c180b7600 0x7f8c180b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.720+0000 7f8c1ea56640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c181399b0 0x7f8c181f2470 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.720+0000 7f8c1ea56640 1 --2- 172.21.15.130:0/1497765079 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00004d10 0x7f8c181f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.720+0000 7f8c1ea56640 1 -- 172.21.15.130:0/1497765079 >> 172.21.15.130:0/1497765079 conn(0x7f8c1806f170 msgr2=0x7f8c180b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:43.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.724+0000 7f8c1ea56640 1 -- 172.21.15.130:0/1497765079 shutdown_connections 2023-09-13T06:12:43.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.724+0000 7f8c1ea56640 1 -- 172.21.15.130:0/1497765079 wait complete. 2023-09-13T06:12:43.743 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-09-13T06:12:43.744 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-09-13T06:12:43.744 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:12:43.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2efe396640 1 Processor -- start 2023-09-13T06:12:43.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2efe396640 1 -- start start 2023-09-13T06:12:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2efe396640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1750 0x7f2ef815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2efe396640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ef80d1090 0x7f2ef8146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2efe396640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2ef80d1b30 0x7f2ef8146d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:43.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2efe396640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef815dea0 con 0x7f2ef80d1090 2023-09-13T06:12:43.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2efe396640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef80b63c0 con 0x7f2ef80d1b30 2023-09-13T06:12:43.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2efe396640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80d0c20 con 0x7f2ef80d1750 2023-09-13T06:12:43.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2ef77fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ef80d1090 0x7f2ef8146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:43.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2ef77fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ef80d1090 0x7f2ef8146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41504/0 (socket says 172.21.15.130:41504) 2023-09-13T06:12:43.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2ef77fe640 1 -- 172.21.15.130:0/111599130 learned_addr learned my addr 172.21.15.130:0/111599130 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:43.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2ef7fff640 1 --2- 172.21.15.130:0/111599130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1750 0x7f2ef815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:43.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2efc933640 1 --2- 172.21.15.130:0/111599130 >> v2:172.21.15.164:3300/0 conn(0x7f2ef80d1b30 0x7f2ef8146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:43.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2ef77fe640 1 -- 172.21.15.130:0/111599130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1750 msgr2=0x7f2ef815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:43.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2ef77fe640 1 --2- 172.21.15.130:0/111599130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1750 0x7f2ef815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2ef77fe640 1 -- 172.21.15.130:0/111599130 >> v2:172.21.15.164:3300/0 conn(0x7f2ef80d1b30 msgr2=0x7f2ef8146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:43.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2ef77fe640 1 --2- 172.21.15.130:0/111599130 >> v2:172.21.15.164:3300/0 conn(0x7f2ef80d1b30 0x7f2ef8146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2ef77fe640 1 -- 172.21.15.130:0/111599130 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef80b6610 con 0x7f2ef80d1090 2023-09-13T06:12:43.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2efc933640 1 --2- 172.21.15.130:0/111599130 >> v2:172.21.15.164:3300/0 conn(0x7f2ef80d1b30 0x7f2ef8146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:43.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.884+0000 7f2ef7fff640 1 --2- 172.21.15.130:0/111599130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1750 0x7f2ef815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:43.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2ef77fe640 1 --2- 172.21.15.130:0/111599130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80d1090 0x7f2ef8146820 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f2ef808ba90 tx=0x7f2eec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8ce9507221fd75 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:43.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2ef6ffd640 1 -- 172.21.15.130:0/111599130 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0aa5f0 con 0x7f2ef80d1090 2023-09-13T06:12:43.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2ef6ffd640 1 -- 172.21.15.130:0/111599130 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec0aa750 con 0x7f2ef80d1090 2023-09-13T06:12:43.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2ef6ffd640 1 -- 172.21.15.130:0/111599130 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0aaae0 con 0x7f2ef80d1090 2023-09-13T06:12:43.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2efe396640 1 -- 172.21.15.130:0/111599130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80d1090 msgr2=0x7f2ef8146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:43.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2efe396640 1 --2- 172.21.15.130:0/111599130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80d1090 0x7f2ef8146820 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f2ef808ba90 tx=0x7f2eec01c4d0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2efe396640 1 -- 172.21.15.130:0/111599130 shutdown_connections 2023-09-13T06:12:43.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2efe396640 1 --2- 172.21.15.130:0/111599130 >> v2:172.21.15.164:3300/0 conn(0x7f2ef80d1b30 0x7f2ef8146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2efe396640 1 --2- 172.21.15.130:0/111599130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80d1090 0x7f2ef8146820 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2efe396640 1 --2- 172.21.15.130:0/111599130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1750 0x7f2ef815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2efe396640 1 -- 172.21.15.130:0/111599130 >> 172.21.15.130:0/111599130 conn(0x7f2ef806f170 msgr2=0x7f2ef806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:43.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2efe396640 1 -- 172.21.15.130:0/111599130 shutdown_connections 2023-09-13T06:12:43.893 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.888+0000 7f2efe396640 1 -- 172.21.15.130:0/111599130 wait complete. 2023-09-13T06:12:43.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efe396640 1 Processor -- start 2023-09-13T06:12:43.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efe396640 1 -- start start 2023-09-13T06:12:43.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efe396640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1090 0x7f2ef815f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:43.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efe396640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80d1750 0x7f2ef81f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:43.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efe396640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80d1b30 0x7f2ef813ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:43.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efe396640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef81f6870 con 0x7f2ef80d1750 2023-09-13T06:12:43.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efe396640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef81f7240 con 0x7f2ef80d1b30 2023-09-13T06:12:43.896 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efe396640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef815f350 con 0x7f2ef80d1090 2023-09-13T06:12:43.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80d1750 0x7f2ef81f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:43.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80d1750 0x7f2ef81f6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41512/0 (socket says 172.21.15.130:41512) 2023-09-13T06:12:43.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef77fe640 1 -- 172.21.15.130:0/3801635295 learned_addr learned my addr 172.21.15.130:0/3801635295 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:43.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef7fff640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1090 0x7f2ef815f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:43.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efc933640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80d1b30 0x7f2ef813ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:43.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef77fe640 1 -- 172.21.15.130:0/3801635295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1090 msgr2=0x7f2ef815f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:43.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef77fe640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1090 0x7f2ef815f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef77fe640 1 -- 172.21.15.130:0/3801635295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80d1b30 msgr2=0x7f2ef813ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:43.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef77fe640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80d1b30 0x7f2ef813ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:43.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef77fe640 1 -- 172.21.15.130:0/3801635295 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec0094d0 con 0x7f2ef80d1750 2023-09-13T06:12:43.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef7fff640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1090 0x7f2ef815f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:43.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efc933640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80d1b30 0x7f2ef813ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:43.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef77fe640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80d1750 0x7f2ef81f6d00 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f2eec01ab80 tx=0x7f2eec01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:43.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef4ff9640 1 -- 172.21.15.130:0/3801635295 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0aa5f0 con 0x7f2ef80d1750 2023-09-13T06:12:43.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef4ff9640 1 -- 172.21.15.130:0/3801635295 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec0b3800 con 0x7f2ef80d1750 2023-09-13T06:12:43.899 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2ef4ff9640 1 -- 172.21.15.130:0/3801635295 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0b3bb0 con 0x7f2ef80d1750 2023-09-13T06:12:43.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efe396640 1 -- 172.21.15.130:0/3801635295 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef815f070 con 0x7f2ef80d1750 2023-09-13T06:12:43.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.892+0000 7f2efe396640 1 -- 172.21.15.130:0/3801635295 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef81f6500 con 0x7f2ef80d1750 2023-09-13T06:12:43.900 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.896+0000 7f2efe396640 1 -- 172.21.15.130:0/3801635295 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef80618a0 con 0x7f2ef80d1750 2023-09-13T06:12:43.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.896+0000 7f2ef4ff9640 1 -- 172.21.15.130:0/3801635295 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2eec0b3d10 con 0x7f2ef80d1750 2023-09-13T06:12:43.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.896+0000 7f2ef4ff9640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ee4065b20 0x7f2ee4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:43.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.896+0000 7f2ef4ff9640 1 -- 172.21.15.130:0/3801635295 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2eec0a7070 con 0x7f2ef80d1750 2023-09-13T06:12:43.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.896+0000 7f2ef7fff640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ee4065b20 0x7f2ee4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:43.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.896+0000 7f2ef7fff640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ee4065b20 0x7f2ee4067fe0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c940 tx=0x7f2ee8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:43.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:43.900+0000 7f2ef4ff9640 1 -- 172.21.15.130:0/3801635295 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2eec0eb1f0 con 0x7f2ef80d1750 2023-09-13T06:12:44.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.048+0000 7f2efe396640 1 -- 172.21.15.130:0/3801635295 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ef81f69b0 con 0x7f2ef80d1750 2023-09-13T06:12:44.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.048+0000 7f2ef4ff9640 1 -- 172.21.15.130:0/3801635295 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+13033 (secure 0 0 0) 0x7f2eec115e60 con 0x7f2ef80d1750 2023-09-13T06:12:44.049 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:44.050 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":178,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:12:42.478162+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.130:6837/597081287":"2023-09-14T06:12:39.702611+0000","172.21.15.130:6836/597081287":"2023-09-14T06:12:39.702611+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:12:44.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 -- 172.21.15.130:0/3801635295 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ee4065b20 msgr2=0x7f2ee4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ee4065b20 0x7f2ee4067fe0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c940 tx=0x7f2ee8008040 comp rx=0 tx=0).stop 2023-09-13T06:12:44.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 -- 172.21.15.130:0/3801635295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80d1750 msgr2=0x7f2ef81f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80d1750 0x7f2ef81f6d00 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f2eec01ab80 tx=0x7f2eec01ad10 comp rx=0 tx=0).stop 2023-09-13T06:12:44.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 -- 172.21.15.130:0/3801635295 shutdown_connections 2023-09-13T06:12:44.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2ee4065b20 0x7f2ee4067fe0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef80d1b30 0x7f2ef813ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80d1750 0x7f2ef81f6d00 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 --2- 172.21.15.130:0/3801635295 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef80d1090 0x7f2ef815f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 -- 172.21.15.130:0/3801635295 >> 172.21.15.130:0/3801635295 conn(0x7f2ef806f170 msgr2=0x7f2ef80cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:44.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 -- 172.21.15.130:0/3801635295 shutdown_connections 2023-09-13T06:12:44.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.052+0000 7f2efe396640 1 -- 172.21.15.130:0/3801635295 wait complete. 2023-09-13T06:12:44.071 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:12:44.072 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:12:44.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.212+0000 7f0e4b419640 1 Processor -- start 2023-09-13T06:12:44.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.212+0000 7f0e4b419640 1 -- start start 2023-09-13T06:12:44.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.212+0000 7f0e4b419640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0e440ce890 0x7f0e44162be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:44.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.212+0000 7f0e4b419640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e440b2620 con 0x7f0e441617f0 2023-09-13T06:12:44.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.212+0000 7f0e4b419640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e440b1a80 con 0x7f0e440cca50 2023-09-13T06:12:44.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.212+0000 7f0e4b419640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e440b2ab0 con 0x7f0e440ce890 2023-09-13T06:12:44.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.212+0000 7f0e491b5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0e441617f0 0x7f0e440cc340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55360/0 (socket says 172.21.15.130:55360) 2023-09-13T06:12:44.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.212+0000 7f0e491b5640 1 -- 172.21.15.130:0/1054868567 learned_addr learned my addr 172.21.15.130:0/1054868567 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:44.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.212+0000 7f0e499b6640 1 --2- 172.21.15.130:0/1054868567 >> v2:172.21.15.164:3300/0 conn(0x7f0e440ce890 0x7f0e44162be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:44.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.212+0000 7f0e3bfff640 1 -- 172.21.15.130:0/1054868567 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785984178 0 0) 0x7f0e440b2620 con 0x7f0e441617f0 2023-09-13T06:12:44.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.212+0000 7f0e3bfff640 1 -- 172.21.15.130:0/1054868567 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e30003530 con 0x7f0e441617f0 2023-09-13T06:12:44.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.216+0000 7f0e3bfff640 1 -- 172.21.15.130:0/1054868567 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134239425 0 0) 0x7f0e440b1a80 con 0x7f0e440cca50 2023-09-13T06:12:44.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.216+0000 7f0e3bfff640 1 -- 172.21.15.130:0/1054868567 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e440b2620 con 0x7f0e440cca50 2023-09-13T06:12:44.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.216+0000 7f0e499b6640 1 -- 172.21.15.130:0/1054868567 >> v1:172.21.15.164:6789/0 conn(0x7f0e440cca50 legacy=0x7f0e440ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.216+0000 7f0e499b6640 1 -- 172.21.15.130:0/1054868567 >> v1:172.21.15.130:6789/0 conn(0x7f0e441617f0 legacy=0x7f0e440cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.216+0000 7f0e3bfff640 1 -- 172.21.15.130:0/1054868567 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1810472850 0 0) 0x7f0e30003530 con 0x7f0e441617f0 2023-09-13T06:12:44.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.216+0000 7f0e499b6640 1 -- 172.21.15.130:0/1054868567 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440b1cf0 con 0x7f0e440ce890 2023-09-13T06:12:44.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.216+0000 7f0e499b6640 1 --2- 172.21.15.130:0/1054868567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e440ce890 0x7f0e44162be0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009d90 tx=0x7f0e3c01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1d2736af7e78f76 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:44.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.216+0000 7f0e3bfff640 1 -- 172.21.15.130:0/1054868567 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40001680 con 0x7f0e440ce890 2023-09-13T06:12:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.216+0000 7f0e3bfff640 1 -- 172.21.15.130:0/1054868567 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0a5680 con 0x7f0e440ce890 2023-09-13T06:12:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.216+0000 7f0e3bfff640 1 -- 172.21.15.130:0/1054868567 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0a5a10 con 0x7f0e440ce890 2023-09-13T06:12:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 -- 172.21.15.130:0/1054868567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e440ce890 msgr2=0x7f0e44162be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 --2- 172.21.15.130:0/1054868567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e440ce890 0x7f0e44162be0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009d90 tx=0x7f0e3c01c840 comp rx=0 tx=0).stop 2023-09-13T06:12:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 -- 172.21.15.130:0/1054868567 shutdown_connections 2023-09-13T06:12:44.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 --2- 172.21.15.130:0/1054868567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e440ce890 0x7f0e44162be0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 -- 172.21.15.130:0/1054868567 >> 172.21.15.130:0/1054868567 conn(0x7f0e44065990 msgr2=0x7f0e44065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:44.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 -- 172.21.15.130:0/1054868567 shutdown_connections 2023-09-13T06:12:44.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 -- 172.21.15.130:0/1054868567 wait complete. 2023-09-13T06:12:44.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 Processor -- start 2023-09-13T06:12:44.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 -- start start 2023-09-13T06:12:44.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e440cca50 0x7f0e4414cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:44.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e440ce890 0x7f0e44138e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:44.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e441617f0 0x7f0e44139380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:44.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4414d7d0 con 0x7f0e440cca50 2023-09-13T06:12:44.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4406e1b0 con 0x7f0e440ce890 2023-09-13T06:12:44.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e4b419640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4414e1c0 con 0x7f0e441617f0 2023-09-13T06:12:44.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e491b5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e440cca50 0x7f0e4414cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:44.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e491b5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e440cca50 0x7f0e4414cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41526/0 (socket says 172.21.15.130:41526) 2023-09-13T06:12:44.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e491b5640 1 -- 172.21.15.130:0/3620319586 learned_addr learned my addr 172.21.15.130:0/3620319586 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:44.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e499b6640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e441617f0 0x7f0e44139380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:44.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e489b4640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e440ce890 0x7f0e44138e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:44.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e491b5640 1 -- 172.21.15.130:0/3620319586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e441617f0 msgr2=0x7f0e44139380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e491b5640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e441617f0 0x7f0e44139380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e491b5640 1 -- 172.21.15.130:0/3620319586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e440ce890 msgr2=0x7f0e44138e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e491b5640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e440ce890 0x7f0e44138e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.220+0000 7f0e491b5640 1 -- 172.21.15.130:0/3620319586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c009a70 con 0x7f0e440cca50 2023-09-13T06:12:44.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.224+0000 7f0e491b5640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e440cca50 0x7f0e4414cc80 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000c780 tx=0x7f0e4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:44.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.224+0000 7f0e39ffb640 1 -- 172.21.15.130:0/3620319586 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40005ae0 con 0x7f0e440cca50 2023-09-13T06:12:44.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.224+0000 7f0e39ffb640 1 -- 172.21.15.130:0/3620319586 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40005c40 con 0x7f0e440cca50 2023-09-13T06:12:44.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.224+0000 7f0e39ffb640 1 -- 172.21.15.130:0/3620319586 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40007070 con 0x7f0e440cca50 2023-09-13T06:12:44.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.224+0000 7f0e4b419640 1 -- 172.21.15.130:0/3620319586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e441588c0 con 0x7f0e440cca50 2023-09-13T06:12:44.228 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.224+0000 7f0e4b419640 1 -- 172.21.15.130:0/3620319586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e44158e80 con 0x7f0e440cca50 2023-09-13T06:12:44.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.224+0000 7f0e4b419640 1 -- 172.21.15.130:0/3620319586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e440618a0 con 0x7f0e440cca50 2023-09-13T06:12:44.230 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.224+0000 7f0e39ffb640 1 -- 172.21.15.130:0/3620319586 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0e400071f0 con 0x7f0e440cca50 2023-09-13T06:12:44.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.224+0000 7f0e39ffb640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e28065b20 0x7f0e28067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:44.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.224+0000 7f0e39ffb640 1 -- 172.21.15.130:0/3620319586 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0e400826b0 con 0x7f0e440cca50 2023-09-13T06:12:44.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.224+0000 7f0e489b4640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e28065b20 0x7f0e28067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:44.231 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.228+0000 7f0e489b4640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e28065b20 0x7f0e28067fe0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0e441fd210 tx=0x7f0e34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:44.232 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.228+0000 7f0e39ffb640 1 -- 172.21.15.130:0/3620319586 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0e400503a0 con 0x7f0e440cca50 2023-09-13T06:12:44.381 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 -- 172.21.15.130:0/3620319586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e440cedc0 con 0x7f0e440cca50 2023-09-13T06:12:44.382 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e39ffb640 1 -- 172.21.15.130:0/3620319586 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v178) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e400170a0 con 0x7f0e440cca50 2023-09-13T06:12:44.382 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:12:44.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 -- 172.21.15.130:0/3620319586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e28065b20 msgr2=0x7f0e28067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.383 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e28065b20 0x7f0e28067fe0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0e441fd210 tx=0x7f0e34009040 comp rx=0 tx=0).stop 2023-09-13T06:12:44.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 -- 172.21.15.130:0/3620319586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e440cca50 msgr2=0x7f0e4414cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e440cca50 0x7f0e4414cc80 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000c780 tx=0x7f0e4000cc40 comp rx=0 tx=0).stop 2023-09-13T06:12:44.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 -- 172.21.15.130:0/3620319586 shutdown_connections 2023-09-13T06:12:44.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0e28065b20 0x7f0e28067fe0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.384 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e440ce890 0x7f0e44138e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0e441617f0 0x7f0e44139380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 --2- 172.21.15.130:0/3620319586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e440cca50 0x7f0e4414cc80 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 -- 172.21.15.130:0/3620319586 >> 172.21.15.130:0/3620319586 conn(0x7f0e44065990 msgr2=0x7f0e44157560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 -- 172.21.15.130:0/3620319586 shutdown_connections 2023-09-13T06:12:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.380+0000 7f0e4b419640 1 -- 172.21.15.130:0/3620319586 wait complete. 2023-09-13T06:12:44.401 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-09-13T06:12:44.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5faf59e640 1 Processor -- start 2023-09-13T06:12:44.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5faf59e640 1 -- start start 2023-09-13T06:12:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5faf59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5fb0146eb0 0x7f5fb00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5faf59e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5fb0161100 0x7f5fb0161520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5faf59e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb0071440 con 0x7f5fb00b4120 2023-09-13T06:12:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5faf59e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb00706a0 con 0x7f5fb0146eb0 2023-09-13T06:12:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5faf59e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb0161a60 con 0x7f5fb0161100 2023-09-13T06:12:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5fae59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5fb0146eb0 0x7f5fb00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5fae59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5fb0146eb0 0x7f5fb00b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41542/0 (socket says 172.21.15.130:41542) 2023-09-13T06:12:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5fae59c640 1 -- 172.21.15.130:0/1514552866 learned_addr learned my addr 172.21.15.130:0/1514552866 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5fadd9b640 1 --2- 172.21.15.130:0/1514552866 >> v2:172.21.15.164:3300/0 conn(0x7f5fb0161100 0x7f5fb0161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5fadd9b640 1 -- 172.21.15.130:0/1514552866 >> v2:172.21.15.130:3300/0 conn(0x7f5fb0146eb0 msgr2=0x7f5fb00b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5fadd9b640 1 --2- 172.21.15.130:0/1514552866 >> v2:172.21.15.130:3300/0 conn(0x7f5fb0146eb0 0x7f5fb00b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5fadd9b640 1 -- 172.21.15.130:0/1514552866 >> v1:172.21.15.164:6789/0 conn(0x7f5fb00b4120 legacy=0x7f5fb00b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5fadd9b640 1 -- 172.21.15.130:0/1514552866 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0147290 con 0x7f5fb0161100 2023-09-13T06:12:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.540+0000 7f5fae59c640 1 --2- 172.21.15.130:0/1514552866 >> v2:172.21.15.130:3300/0 conn(0x7f5fb0146eb0 0x7f5fb00b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:12:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5fadd9b640 1 --2- 172.21.15.130:0/1514552866 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fb0161100 0x7f5fb0161520 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00b5ff0 tx=0x7f5fa401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=415fd261ee5bfe56 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5fad59a640 1 -- 172.21.15.130:0/1514552866 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa40ab600 con 0x7f5fb0161100 2023-09-13T06:12:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5fad59a640 1 -- 172.21.15.130:0/1514552866 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa40a7050 con 0x7f5fb0161100 2023-09-13T06:12:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5fad59a640 1 -- 172.21.15.130:0/1514552866 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa40ab980 con 0x7f5fb0161100 2023-09-13T06:12:44.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5faf59e640 1 -- 172.21.15.130:0/1514552866 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fb0161100 msgr2=0x7f5fb0161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5faf59e640 1 --2- 172.21.15.130:0/1514552866 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fb0161100 0x7f5fb0161520 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00b5ff0 tx=0x7f5fa401c430 comp rx=0 tx=0).stop 2023-09-13T06:12:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5faf59e640 1 -- 172.21.15.130:0/1514552866 shutdown_connections 2023-09-13T06:12:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5faf59e640 1 --2- 172.21.15.130:0/1514552866 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fb0161100 0x7f5fb0161520 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5faf59e640 1 --2- 172.21.15.130:0/1514552866 >> v2:172.21.15.130:3300/0 conn(0x7f5fb0146eb0 0x7f5fb00b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5faf59e640 1 -- 172.21.15.130:0/1514552866 >> 172.21.15.130:0/1514552866 conn(0x7f5fb00cdd10 msgr2=0x7f5fb00ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5faf59e640 1 -- 172.21.15.130:0/1514552866 shutdown_connections 2023-09-13T06:12:44.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.544+0000 7f5faf59e640 1 -- 172.21.15.130:0/1514552866 wait complete. 2023-09-13T06:12:44.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faf59e640 1 Processor -- start 2023-09-13T06:12:44.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faf59e640 1 -- start start 2023-09-13T06:12:44.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faf59e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fb00b4120 0x7f5fb00c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:44.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faf59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fb0146eb0 0x7f5fb00c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:44.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faf59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb0161100 0x7f5fb00c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:44.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faf59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb01442d0 con 0x7f5fb0161100 2023-09-13T06:12:44.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faf59e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb01436c0 con 0x7f5fb00b4120 2023-09-13T06:12:44.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faf59e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb01439a0 con 0x7f5fb0146eb0 2023-09-13T06:12:44.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb0161100 0x7f5fb00c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:44.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb0161100 0x7f5fb00c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41556/0 (socket says 172.21.15.130:41556) 2023-09-13T06:12:44.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faed9d640 1 -- 172.21.15.130:0/3210258457 learned_addr learned my addr 172.21.15.130:0/3210258457 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:44.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faed9d640 1 -- 172.21.15.130:0/3210258457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fb0146eb0 msgr2=0x7f5fb00c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5fadd9b640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fb0146eb0 0x7f5fb00c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:44.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5fae59c640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fb00b4120 0x7f5fb00c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:44.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faed9d640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fb0146eb0 0x7f5fb00c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faed9d640 1 -- 172.21.15.130:0/3210258457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fb00b4120 msgr2=0x7f5fb00c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:44.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faed9d640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fb00b4120 0x7f5fb00c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:44.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faed9d640 1 -- 172.21.15.130:0/3210258457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa00094d0 con 0x7f5fb0161100 2023-09-13T06:12:44.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5fadd9b640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fb0146eb0 0x7f5fb00c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:44.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5fae59c640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fb00b4120 0x7f5fb00c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:44.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faed9d640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb0161100 0x7f5fb00c97e0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800c730 tx=0x7f5fa800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:44.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5f9effd640 1 -- 172.21.15.130:0/3210258457 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8003b80 con 0x7f5fb0161100 2023-09-13T06:12:44.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5f9effd640 1 -- 172.21.15.130:0/3210258457 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8003ce0 con 0x7f5fb0161100 2023-09-13T06:12:44.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5f9effd640 1 -- 172.21.15.130:0/3210258457 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800aa30 con 0x7f5fb0161100 2023-09-13T06:12:44.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faf59e640 1 -- 172.21.15.130:0/3210258457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa4009420 con 0x7f5fb0161100 2023-09-13T06:12:44.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.548+0000 7f5faf59e640 1 -- 172.21.15.130:0/3210258457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb0143f60 con 0x7f5fb0161100 2023-09-13T06:12:44.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.552+0000 7f5faf59e640 1 -- 172.21.15.130:0/3210258457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb00618a0 con 0x7f5fb0161100 2023-09-13T06:12:44.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.552+0000 7f5f9effd640 1 -- 172.21.15.130:0/3210258457 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5fa800ab90 con 0x7f5fb0161100 2023-09-13T06:12:44.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.552+0000 7f5f9effd640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f90065b20 0x7f5f90067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:44.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.552+0000 7f5f9effd640 1 -- 172.21.15.130:0/3210258457 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5fa8082d30 con 0x7f5fb0161100 2023-09-13T06:12:44.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.552+0000 7f5fae59c640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f90065b20 0x7f5f90067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:44.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.552+0000 7f5fae59c640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f90065b20 0x7f5f90067fe0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00d1b90 tx=0x7f5fa0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:44.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.556+0000 7f5f9effd640 1 -- 172.21.15.130:0/3210258457 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5fa8050a10 con 0x7f5fb0161100 2023-09-13T06:12:44.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:44.756+0000 7f5faf59e640 1 -- 172.21.15.130:0/3210258457 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f5fb0161790 con 0x7f5fb0161100 2023-09-13T06:12:45.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5f9effd640 1 -- 172.21.15.130:0/3210258457 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v552) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5fa8054030 con 0x7f5fb0161100 2023-09-13T06:12:45.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 -- 172.21.15.130:0/3210258457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f90065b20 msgr2=0x7f5f90067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:45.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f90065b20 0x7f5f90067fe0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00d1b90 tx=0x7f5fa0008040 comp rx=0 tx=0).stop 2023-09-13T06:12:45.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 -- 172.21.15.130:0/3210258457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb0161100 msgr2=0x7f5fb00c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb0161100 0x7f5fb00c97e0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800c730 tx=0x7f5fa800cbf0 comp rx=0 tx=0).stop 2023-09-13T06:12:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 -- 172.21.15.130:0/3210258457 shutdown_connections 2023-09-13T06:12:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5f90065b20 0x7f5f90067fe0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb0161100 0x7f5fb00c97e0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fb0146eb0 0x7f5fb00c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 --2- 172.21.15.130:0/3210258457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fb00b4120 0x7f5fb00c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 -- 172.21.15.130:0/3210258457 >> 172.21.15.130:0/3210258457 conn(0x7f5fb00cdd10 msgr2=0x7f5fb00b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 -- 172.21.15.130:0/3210258457 shutdown_connections 2023-09-13T06:12:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.732+0000 7f5faf59e640 1 -- 172.21.15.130:0/3210258457 wait complete. 2023-09-13T06:12:45.756 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-13T06:12:45.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.900+0000 7f475fad8640 1 Processor -- start 2023-09-13T06:12:45.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.900+0000 7f475fad8640 1 -- start start 2023-09-13T06:12:45.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475fad8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4758146040 0x7f4758146420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:45.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475fad8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580ae030 con 0x7f4758070ed0 2023-09-13T06:12:45.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475fad8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580ae310 con 0x7f4758146ce0 2023-09-13T06:12:45.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475fad8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47580ae5f0 con 0x7f4758146040 2023-09-13T06:12:45.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475e075640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4758070ed0 0x7f475806c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55376/0 (socket says 172.21.15.130:55376) 2023-09-13T06:12:45.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475e075640 1 -- 172.21.15.130:0/178909592 learned_addr learned my addr 172.21.15.130:0/178909592 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:45.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475d874640 1 --2- 172.21.15.130:0/178909592 >> v2:172.21.15.164:3300/0 conn(0x7f4758146040 0x7f4758146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:45.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475c872640 1 -- 172.21.15.130:0/178909592 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659079286 0 0) 0x7f47580ae030 con 0x7f4758070ed0 2023-09-13T06:12:45.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475c872640 1 -- 172.21.15.130:0/178909592 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4744003530 con 0x7f4758070ed0 2023-09-13T06:12:45.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475c872640 1 -- 172.21.15.130:0/178909592 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157164473 0 0) 0x7f47580ae310 con 0x7f4758146ce0 2023-09-13T06:12:45.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475c872640 1 -- 172.21.15.130:0/178909592 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47580ae030 con 0x7f4758146ce0 2023-09-13T06:12:45.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475c872640 1 -- 172.21.15.130:0/178909592 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664146977 0 0) 0x7f4744003530 con 0x7f4758070ed0 2023-09-13T06:12:45.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475d874640 1 -- 172.21.15.130:0/178909592 >> v1:172.21.15.164:6789/0 conn(0x7f4758146ce0 legacy=0x7f47580707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:45.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475d874640 1 -- 172.21.15.130:0/178909592 >> v1:172.21.15.130:6789/0 conn(0x7f4758070ed0 legacy=0x7f475806c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:45.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.904+0000 7f475d874640 1 -- 172.21.15.130:0/178909592 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580ae8d0 con 0x7f4758146040 2023-09-13T06:12:45.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475d874640 1 --2- 172.21.15.130:0/178909592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4758146040 0x7f4758146420 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f47540097c0 tx=0x7f475401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66f7ced39279b580 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:45.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475c872640 1 -- 172.21.15.130:0/178909592 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750001a00 con 0x7f4758146040 2023-09-13T06:12:45.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475c872640 1 -- 172.21.15.130:0/178909592 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47540a7050 con 0x7f4758146040 2023-09-13T06:12:45.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475c872640 1 -- 172.21.15.130:0/178909592 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540ab400 con 0x7f4758146040 2023-09-13T06:12:45.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475fad8640 1 -- 172.21.15.130:0/178909592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4758146040 msgr2=0x7f4758146420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:45.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475fad8640 1 --2- 172.21.15.130:0/178909592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4758146040 0x7f4758146420 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f47540097c0 tx=0x7f475401c3a0 comp rx=0 tx=0).stop 2023-09-13T06:12:45.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475fad8640 1 -- 172.21.15.130:0/178909592 shutdown_connections 2023-09-13T06:12:45.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475fad8640 1 --2- 172.21.15.130:0/178909592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4758146040 0x7f4758146420 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:45.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475fad8640 1 -- 172.21.15.130:0/178909592 >> 172.21.15.130:0/178909592 conn(0x7f475806a730 msgr2=0x7f4758065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:45.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475fad8640 1 -- 172.21.15.130:0/178909592 shutdown_connections 2023-09-13T06:12:45.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475fad8640 1 -- 172.21.15.130:0/178909592 wait complete. 2023-09-13T06:12:45.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475fad8640 1 Processor -- start 2023-09-13T06:12:45.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.908+0000 7f475fad8640 1 -- start start 2023-09-13T06:12:45.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475fad8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4758070ed0 0x7f4758160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:45.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475fad8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4758146040 0x7f4758159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:45.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475fad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4758146ce0 0x7f4758141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:45.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475fad8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475815d890 con 0x7f4758070ed0 2023-09-13T06:12:45.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475fad8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4758161690 con 0x7f4758146040 2023-09-13T06:12:45.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475fad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475815db30 con 0x7f4758146ce0 2023-09-13T06:12:45.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475d874640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4758070ed0 0x7f4758160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:45.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475d874640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4758070ed0 0x7f4758160ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41562/0 (socket says 172.21.15.130:41562) 2023-09-13T06:12:45.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475d874640 1 -- 172.21.15.130:0/2901011440 learned_addr learned my addr 172.21.15.130:0/2901011440 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:45.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475d073640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4758146040 0x7f4758159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:45.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475e075640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4758146ce0 0x7f4758141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:45.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475d874640 1 -- 172.21.15.130:0/2901011440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4758146ce0 msgr2=0x7f4758141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:45.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475d874640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4758146ce0 0x7f4758141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:45.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475d874640 1 -- 172.21.15.130:0/2901011440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4758146040 msgr2=0x7f4758159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:45.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475d874640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4758146040 0x7f4758159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:45.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475d874640 1 -- 172.21.15.130:0/2901011440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754009420 con 0x7f4758070ed0 2023-09-13T06:12:45.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475e075640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4758146ce0 0x7f4758141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:45.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475d874640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4758070ed0 0x7f4758160ff0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f4754018fb0 tx=0x7f4754019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:45.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f474e7fc640 1 -- 172.21.15.130:0/2901011440 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540abce0 con 0x7f4758070ed0 2023-09-13T06:12:45.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f474e7fc640 1 -- 172.21.15.130:0/2901011440 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475806d4c0 con 0x7f4758070ed0 2023-09-13T06:12:45.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f474e7fc640 1 -- 172.21.15.130:0/2901011440 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540b4600 con 0x7f4758070ed0 2023-09-13T06:12:45.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475fad8640 1 -- 172.21.15.130:0/2901011440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475815de10 con 0x7f4758070ed0 2023-09-13T06:12:45.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475fad8640 1 -- 172.21.15.130:0/2901011440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4758139720 con 0x7f4758070ed0 2023-09-13T06:12:45.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f475fad8640 1 -- 172.21.15.130:0/2901011440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47580618a0 con 0x7f4758070ed0 2023-09-13T06:12:45.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.912+0000 7f474e7fc640 1 -- 172.21.15.130:0/2901011440 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f47540b2040 con 0x7f4758070ed0 2023-09-13T06:12:45.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.916+0000 7f474e7fc640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f473c065b20 0x7f473c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:45.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.916+0000 7f474e7fc640 1 -- 172.21.15.130:0/2901011440 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f475411cc40 con 0x7f4758070ed0 2023-09-13T06:12:45.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.916+0000 7f475d073640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f473c065b20 0x7f473c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:45.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.916+0000 7f475d073640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f473c065b20 0x7f473c067fe0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f47580cc260 tx=0x7f4748009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:45.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:45.916+0000 7f474e7fc640 1 -- 172.21.15.130:0/2901011440 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f47540ea910 con 0x7f4758070ed0 2023-09-13T06:12:46.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.064+0000 7f475fad8640 1 -- 172.21.15.130:0/2901011440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4758142d10 con 0x7f4758070ed0 2023-09-13T06:12:46.071 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f474e7fc640 1 -- 172.21.15.130:0/2901011440 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f47540b0020 con 0x7f4758070ed0 2023-09-13T06:12:46.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 -- 172.21.15.130:0/2901011440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f473c065b20 msgr2=0x7f473c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f473c065b20 0x7f473c067fe0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f47580cc260 tx=0x7f4748009040 comp rx=0 tx=0).stop 2023-09-13T06:12:46.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 -- 172.21.15.130:0/2901011440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4758070ed0 msgr2=0x7f4758160ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4758070ed0 0x7f4758160ff0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f4754018fb0 tx=0x7f4754019140 comp rx=0 tx=0).stop 2023-09-13T06:12:46.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 -- 172.21.15.130:0/2901011440 shutdown_connections 2023-09-13T06:12:46.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f473c065b20 0x7f473c067fe0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4758146040 0x7f4758159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4758146ce0 0x7f4758141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 --2- 172.21.15.130:0/2901011440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4758070ed0 0x7f4758160ff0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 -- 172.21.15.130:0/2901011440 >> 172.21.15.130:0/2901011440 conn(0x7f475806a730 msgr2=0x7f4758065d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:46.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 -- 172.21.15.130:0/2901011440 shutdown_connections 2023-09-13T06:12:46.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.072+0000 7f475fad8640 1 -- 172.21.15.130:0/2901011440 wait complete. 2023-09-13T06:12:46.093 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:12:46.094 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:12:46.161 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:12:46.214 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:12:46.215 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:12:46.216 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:12:46.225 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:12:46.225 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:12:46.226 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:12:46.238 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:12:46.238 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:12:46.239 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:12:46.271 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:12:46.276 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:12:46.278 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:12:46.279 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:12:46.279 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:12:46.293 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:12:46.294 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-13T06:12:46.294 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:12:46.463 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7ffd4cb640 1 Processor -- start 2023-09-13T06:12:46.464 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7ffd4cb640 1 -- start start 2023-09-13T06:12:46.465 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7ffd4cb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7ff80d1750 0x7f7ff815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:46.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7ffd4cb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ff80d1090 0x7f7ff8146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:46.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7ffd4cb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff80b63c0 con 0x7f7ff80d1b30 2023-09-13T06:12:46.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7ffd4cb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff815dea0 con 0x7f7ff80d1090 2023-09-13T06:12:46.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7ffd4cb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff80d0c20 con 0x7f7ff80d1750 2023-09-13T06:12:46.466 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7fee7fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ff80d1090 0x7f7ff8146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:46.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7fee7fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ff80d1090 0x7f7ff8146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41564/0 (socket says 172.21.15.130:41564) 2023-09-13T06:12:46.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7fee7fc640 1 -- 172.21.15.130:0/845079957 learned_addr learned my addr 172.21.15.130:0/845079957 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:46.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7ff6ffd640 1 --2- 172.21.15.130:0/845079957 >> v2:172.21.15.164:3300/0 conn(0x7f7ff80d1750 0x7f7ff815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:46.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7fee7fc640 1 -- 172.21.15.130:0/845079957 >> v2:172.21.15.164:3300/0 conn(0x7f7ff80d1750 msgr2=0x7f7ff815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:46.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7fee7fc640 1 --2- 172.21.15.130:0/845079957 >> v2:172.21.15.164:3300/0 conn(0x7f7ff80d1750 0x7f7ff815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.467 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7fee7fc640 1 -- 172.21.15.130:0/845079957 >> v1:172.21.15.164:6789/0 conn(0x7f7ff80d1b30 legacy=0x7f7ff80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.464+0000 7f7fee7fc640 1 -- 172.21.15.130:0/845079957 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff80b6610 con 0x7f7ff80d1090 2023-09-13T06:12:46.468 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7fee7fc640 1 --2- 172.21.15.130:0/845079957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ff80d1090 0x7f7ff8146820 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8073cd0 tx=0x7f7fe801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7db2faa2ed9514 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:46.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7ff67fc640 1 -- 172.21.15.130:0/845079957 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80aa430 con 0x7f7ff80d1090 2023-09-13T06:12:46.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7ff67fc640 1 -- 172.21.15.130:0/845079957 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe80aa590 con 0x7f7ff80d1090 2023-09-13T06:12:46.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7ff67fc640 1 -- 172.21.15.130:0/845079957 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80aa920 con 0x7f7ff80d1090 2023-09-13T06:12:46.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/845079957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ff80d1090 msgr2=0x7f7ff8146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.470 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7ffd4cb640 1 --2- 172.21.15.130:0/845079957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ff80d1090 0x7f7ff8146820 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8073cd0 tx=0x7f7fe801c4d0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/845079957 shutdown_connections 2023-09-13T06:12:46.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7ffd4cb640 1 --2- 172.21.15.130:0/845079957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ff80d1090 0x7f7ff8146820 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7ffd4cb640 1 --2- 172.21.15.130:0/845079957 >> v2:172.21.15.164:3300/0 conn(0x7f7ff80d1750 0x7f7ff815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/845079957 >> 172.21.15.130:0/845079957 conn(0x7f7ff806f170 msgr2=0x7f7ff806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:46.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/845079957 shutdown_connections 2023-09-13T06:12:46.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.468+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/845079957 wait complete. 2023-09-13T06:12:46.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ffd4cb640 1 Processor -- start 2023-09-13T06:12:46.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ffd4cb640 1 -- start start 2023-09-13T06:12:46.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ffd4cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ff80d1090 0x7f7ff813d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:46.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ffd4cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ff80d1750 0x7f7ff813acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:46.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ffd4cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ff80d1b30 0x7f7ff815be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:46.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ffd4cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff81437b0 con 0x7f7ff80d1750 2023-09-13T06:12:46.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ffd4cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff815fa80 con 0x7f7ff80d1090 2023-09-13T06:12:46.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ffd4cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff815fd60 con 0x7f7ff80d1b30 2023-09-13T06:12:46.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7fee7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ff80d1750 0x7f7ff813acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:46.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7fee7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ff80d1750 0x7f7ff813acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41568/0 (socket says 172.21.15.130:41568) 2023-09-13T06:12:46.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7fee7fc640 1 -- 172.21.15.130:0/1360423602 learned_addr learned my addr 172.21.15.130:0/1360423602 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:46.476 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ff6ffd640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ff80d1090 0x7f7ff813d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:46.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ff77fe640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ff80d1b30 0x7f7ff815be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:46.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7fee7fc640 1 -- 172.21.15.130:0/1360423602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ff80d1b30 msgr2=0x7f7ff815be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7fee7fc640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ff80d1b30 0x7f7ff815be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7fee7fc640 1 -- 172.21.15.130:0/1360423602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ff80d1090 msgr2=0x7f7ff813d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7fee7fc640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ff80d1090 0x7f7ff813d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7fee7fc640 1 -- 172.21.15.130:0/1360423602 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe80094d0 con 0x7f7ff80d1750 2023-09-13T06:12:46.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7fee7fc640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ff80d1750 0x7f7ff813acf0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80190e0 tx=0x7f7fe801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:46.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7feffff640 1 -- 172.21.15.130:0/1360423602 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80aa430 con 0x7f7ff80d1750 2023-09-13T06:12:46.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7feffff640 1 -- 172.21.15.130:0/1360423602 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe80b3800 con 0x7f7ff80d1750 2023-09-13T06:12:46.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7feffff640 1 -- 172.21.15.130:0/1360423602 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80b3bb0 con 0x7f7ff80d1750 2023-09-13T06:12:46.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/1360423602 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff8160040 con 0x7f7ff80d1750 2023-09-13T06:12:46.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.472+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/1360423602 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff813deb0 con 0x7f7ff80d1750 2023-09-13T06:12:46.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.476+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/1360423602 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff813e0a0 con 0x7f7ff80d1750 2023-09-13T06:12:46.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.476+0000 7f7feffff640 1 -- 172.21.15.130:0/1360423602 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7fe80b3d10 con 0x7f7ff80d1750 2023-09-13T06:12:46.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.476+0000 7f7feffff640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fd8065b20 0x7f7fd8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:46.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.476+0000 7f7feffff640 1 -- 172.21.15.130:0/1360423602 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7fe811d460 con 0x7f7ff80d1750 2023-09-13T06:12:46.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.476+0000 7f7ff6ffd640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fd8065b20 0x7f7fd8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:46.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.476+0000 7f7ff6ffd640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fd8065b20 0x7f7fd8067fe0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0007a60 tx=0x7f7fe0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:46.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.480+0000 7f7feffff640 1 -- 172.21.15.130:0/1360423602 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7ff813e0a0 con 0x7f7ff80d1750 2023-09-13T06:12:46.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.656+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/1360423602 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ff813e0a0 con 0x7f7ff80d1750 2023-09-13T06:12:46.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.656+0000 7f7feffff640 1 -- 172.21.15.130:0/1360423602 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f7fe80c3e90 con 0x7f7ff80d1750 2023-09-13T06:12:46.659 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:46.660 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":86,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2473585305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2473585305},{"type":"v1","addr":"172.21.15.130:6835","nonce":2473585305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7001,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6834/1139512428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1139512428},{"type":"v1","addr":"172.21.15.164:6834","nonce":1139512428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/2365480398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6833","nonce":2365480398},{"type":"v1","addr":"172.21.15.164:6835","nonce":2365480398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8970,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1982606955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1982606955},{"type":"v1","addr":"172.21.15.130:6837","nonce":1982606955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[]} 2023-09-13T06:12:46.661 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 86 2023-09-13T06:12:46.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/1360423602 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fd8065b20 msgr2=0x7f7fd8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fd8065b20 0x7f7fd8067fe0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0007a60 tx=0x7f7fe0008040 comp rx=0 tx=0).stop 2023-09-13T06:12:46.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/1360423602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ff80d1750 msgr2=0x7f7ff813acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ff80d1750 0x7f7ff813acf0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80190e0 tx=0x7f7fe801ad10 comp rx=0 tx=0).stop 2023-09-13T06:12:46.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/1360423602 shutdown_connections 2023-09-13T06:12:46.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7fd8065b20 0x7f7fd8067fe0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7ff80d1b30 0x7f7ff815be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ff80d1750 0x7f7ff813acf0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 --2- 172.21.15.130:0/1360423602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ff80d1090 0x7f7ff813d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/1360423602 >> 172.21.15.130:0/1360423602 conn(0x7f7ff806f170 msgr2=0x7f7ff8145d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:46.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/1360423602 shutdown_connections 2023-09-13T06:12:46.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.660+0000 7f7ffd4cb640 1 -- 172.21.15.130:0/1360423602 wait complete. 2023-09-13T06:12:46.680 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T06:12:46.680 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-13T06:12:46.680 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T06:12:46.681 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:12:46.682 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T06:12:46.682 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-13T06:12:46.682 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T06:12:46.683 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:12:46.683 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T06:12:46.684 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-13T06:12:46.684 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T06:12:46.685 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:12:46.685 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T06:12:46.685 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-13T06:12:46.686 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T06:12:46.686 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:12:46.694 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T06:12:46.694 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T06:12:46.696 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T06:12:46.696 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T06:12:46.700 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T06:12:46.701 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T06:12:46.702 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T06:12:46.702 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T06:12:46.745 INFO:tasks.ceph.mds.a:Started 2023-09-13T06:12:46.745 DEBUG:teuthology.parallel:result is None 2023-09-13T06:12:46.747 INFO:tasks.ceph.mds.c:Started 2023-09-13T06:12:46.748 DEBUG:teuthology.parallel:result is None 2023-09-13T06:12:46.749 INFO:tasks.ceph.mds.b:Started 2023-09-13T06:12:46.750 DEBUG:teuthology.parallel:result is None 2023-09-13T06:12:46.752 INFO:tasks.ceph.mds.d:Started 2023-09-13T06:12:46.753 DEBUG:teuthology.parallel:result is None 2023-09-13T06:12:46.753 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-13T06:12:46.834 INFO:tasks.ceph.mds.c.smithi130.stdout:starting mds.c at 2023-09-13T06:12:46.835 INFO:tasks.ceph.mds.a.smithi130.stdout:starting mds.a at 2023-09-13T06:12:46.843 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2023-09-13T06:12:46.844 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:12:46.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.900+0000 7f1b79e48640 1 Processor -- start 2023-09-13T06:12:46.901 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.900+0000 7f1b79e48640 1 -- start start 2023-09-13T06:12:46.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.900+0000 7f1b79e48640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1b74146f30 0x7f1b7415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:46.902 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.900+0000 7f1b79e48640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b740b63c0 con 0x7f1b740d1090 2023-09-13T06:12:46.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.900+0000 7f1b79e48640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b740d0c20 con 0x7f1b740d1750 2023-09-13T06:12:46.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.900+0000 7f1b79e48640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7415dea0 con 0x7f1b74146f30 2023-09-13T06:12:46.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.900+0000 7f1b73fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1b74146f30 0x7f1b7415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:46.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.900+0000 7f1b72ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1b740d1090 0x7f1b740b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55404/0 (socket says 172.21.15.130:55404) 2023-09-13T06:12:46.903 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.900+0000 7f1b72ffd640 1 -- 172.21.15.130:0/3361306953 learned_addr learned my addr 172.21.15.130:0/3361306953 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:46.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.904+0000 7f1b73fff640 1 -- 172.21.15.130:0/3361306953 >> v1:172.21.15.164:6789/0 conn(0x7f1b740d1750 legacy=0x7f1b74146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.904+0000 7f1b73fff640 1 -- 172.21.15.130:0/3361306953 >> v1:172.21.15.130:6789/0 conn(0x7f1b740d1090 legacy=0x7f1b740b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.904+0000 7f1b73fff640 1 -- 172.21.15.130:0/3361306953 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b740b6610 con 0x7f1b74146f30 2023-09-13T06:12:46.905 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.904+0000 7f1b73fff640 1 --2- 172.21.15.130:0/3361306953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b74146f30 0x7f1b7415d960 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009d90 tx=0x7f1b6c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17eb3e44cadda922 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:46.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.904+0000 7f1b727fc640 1 -- 172.21.15.130:0/3361306953 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0a5950 con 0x7f1b74146f30 2023-09-13T06:12:46.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.904+0000 7f1b727fc640 1 -- 172.21.15.130:0/3361306953 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c0a5ab0 con 0x7f1b74146f30 2023-09-13T06:12:46.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.904+0000 7f1b727fc640 1 -- 172.21.15.130:0/3361306953 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0a5e40 con 0x7f1b74146f30 2023-09-13T06:12:46.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.904+0000 7f1b79e48640 1 -- 172.21.15.130:0/3361306953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b74146f30 msgr2=0x7f1b7415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.904+0000 7f1b79e48640 1 --2- 172.21.15.130:0/3361306953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b74146f30 0x7f1b7415d960 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009d90 tx=0x7f1b6c01c890 comp rx=0 tx=0).stop 2023-09-13T06:12:46.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 -- 172.21.15.130:0/3361306953 shutdown_connections 2023-09-13T06:12:46.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 --2- 172.21.15.130:0/3361306953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b74146f30 0x7f1b7415d960 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 -- 172.21.15.130:0/3361306953 >> 172.21.15.130:0/3361306953 conn(0x7f1b7406f170 msgr2=0x7f1b7406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:46.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 -- 172.21.15.130:0/3361306953 shutdown_connections 2023-09-13T06:12:46.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 -- 172.21.15.130:0/3361306953 wait complete. 2023-09-13T06:12:46.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 Processor -- start 2023-09-13T06:12:46.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 -- start start 2023-09-13T06:12:46.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b740d1090 0x7f1b7412b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:46.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b740d1750 0x7f1b740b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:46.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b74146f30 0x7f1b7415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:46.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74156730 con 0x7f1b74146f30 2023-09-13T06:12:46.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7415be80 con 0x7f1b740d1750 2023-09-13T06:12:46.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b79e48640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74156980 con 0x7f1b740d1090 2023-09-13T06:12:46.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b73fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b74146f30 0x7f1b7415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:46.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b73fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b74146f30 0x7f1b7415b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41616/0 (socket says 172.21.15.130:41616) 2023-09-13T06:12:46.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b72ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b740d1750 0x7f1b740b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:46.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b73fff640 1 -- 172.21.15.130:0/2471123488 learned_addr learned my addr 172.21.15.130:0/2471123488 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:46.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b737fe640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b740d1090 0x7f1b7412b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:46.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b73fff640 1 -- 172.21.15.130:0/2471123488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b740d1090 msgr2=0x7f1b7412b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b73fff640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b740d1090 0x7f1b7412b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b73fff640 1 -- 172.21.15.130:0/2471123488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b740d1750 msgr2=0x7f1b740b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:46.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b73fff640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b740d1750 0x7f1b740b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:46.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b73fff640 1 -- 172.21.15.130:0/2471123488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c009a70 con 0x7f1b74146f30 2023-09-13T06:12:46.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.908+0000 7f1b73fff640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b74146f30 0x7f1b7415b110 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0b0040 tx=0x7f1b6c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:46.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.912+0000 7f1b5bfff640 1 -- 172.21.15.130:0/2471123488 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0ade40 con 0x7f1b74146f30 2023-09-13T06:12:46.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.912+0000 7f1b5bfff640 1 -- 172.21.15.130:0/2471123488 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c0b9450 con 0x7f1b74146f30 2023-09-13T06:12:46.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.912+0000 7f1b5bfff640 1 -- 172.21.15.130:0/2471123488 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0b9800 con 0x7f1b74146f30 2023-09-13T06:12:46.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.912+0000 7f1b79e48640 1 -- 172.21.15.130:0/2471123488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b74156c60 con 0x7f1b74146f30 2023-09-13T06:12:46.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.912+0000 7f1b79e48640 1 -- 172.21.15.130:0/2471123488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b740b4d40 con 0x7f1b74146f30 2023-09-13T06:12:46.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.912+0000 7f1b79e48640 1 -- 172.21.15.130:0/2471123488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b740b4f30 con 0x7f1b74146f30 2023-09-13T06:12:46.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.912+0000 7f1b5bfff640 1 -- 172.21.15.130:0/2471123488 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1b6c0b9960 con 0x7f1b74146f30 2023-09-13T06:12:46.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.912+0000 7f1b5bfff640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b60065b20 0x7f1b60067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:46.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.912+0000 7f1b5bfff640 1 -- 172.21.15.130:0/2471123488 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1b6c11e780 con 0x7f1b74146f30 2023-09-13T06:12:46.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.912+0000 7f1b737fe640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b60065b20 0x7f1b60067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:46.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.912+0000 7f1b737fe640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b60065b20 0x7f1b60067fe0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1b64007fd0 tx=0x7f1b64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:46.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:46.916+0000 7f1b5bfff640 1 -- 172.21.15.130:0/2471123488 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1b740b4f30 con 0x7f1b74146f30 2023-09-13T06:12:47.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:47.076+0000 7f1b79e48640 1 -- 172.21.15.130:0/2471123488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1b740b4f30 con 0x7f1b74146f30 2023-09-13T06:12:48.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.096+0000 7f1b5bfff640 1 -- 172.21.15.130:0/2471123488 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v183) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1b740b4f30 con 0x7f1b74146f30 2023-09-13T06:12:48.096 INFO:teuthology.orchestra.run.smithi130.stderr: removed all blocklist entries 2023-09-13T06:12:48.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.096+0000 7f1b79e48640 1 -- 172.21.15.130:0/2471123488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b60065b20 msgr2=0x7f1b60067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.096+0000 7f1b79e48640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b60065b20 0x7f1b60067fe0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1b64007fd0 tx=0x7f1b64009040 comp rx=0 tx=0).stop 2023-09-13T06:12:48.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.096+0000 7f1b79e48640 1 -- 172.21.15.130:0/2471123488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b74146f30 msgr2=0x7f1b7415b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.096+0000 7f1b79e48640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b74146f30 0x7f1b7415b110 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0b0040 tx=0x7f1b6c019630 comp rx=0 tx=0).stop 2023-09-13T06:12:48.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.096+0000 7f1b79e48640 1 -- 172.21.15.130:0/2471123488 shutdown_connections 2023-09-13T06:12:48.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.096+0000 7f1b79e48640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b60065b20 0x7f1b60067fe0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.096+0000 7f1b79e48640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b740d1750 0x7f1b740b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.096+0000 7f1b79e48640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b74146f30 0x7f1b7415b110 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.096+0000 7f1b79e48640 1 --2- 172.21.15.130:0/2471123488 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b740d1090 0x7f1b7412b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.096+0000 7f1b79e48640 1 -- 172.21.15.130:0/2471123488 >> 172.21.15.130:0/2471123488 conn(0x7f1b7406f170 msgr2=0x7f1b7415f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:48.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.100+0000 7f1b79e48640 1 -- 172.21.15.130:0/2471123488 shutdown_connections 2023-09-13T06:12:48.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.100+0000 7f1b79e48640 1 -- 172.21.15.130:0/2471123488 wait complete. 2023-09-13T06:12:48.122 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-13T06:12:48.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f663b093640 1 Processor -- start 2023-09-13T06:12:48.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f663b093640 1 -- start start 2023-09-13T06:12:48.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f663b093640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6634159f20 0x7f66340ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f663b093640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f66340cdfc0 0x7f66340b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f663b093640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f66340b1610 0x7f66340b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f663b093640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66340b00f0 con 0x7f66340cdfc0 2023-09-13T06:12:48.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f663b093640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66340ce420 con 0x7f66340b1610 2023-09-13T06:12:48.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f663b093640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340b11d0 con 0x7f6634159f20 2023-09-13T06:12:48.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6633fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f66340cdfc0 0x7f66340b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:48.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6638e2f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6634159f20 0x7f66340ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:48.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6639630640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f66340b1610 0x7f66340b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:48.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6633fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f66340cdfc0 0x7f66340b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41624/0 (socket says 172.21.15.130:41624) 2023-09-13T06:12:48.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6633fff640 1 -- 172.21.15.130:0/1496102588 learned_addr learned my addr 172.21.15.130:0/1496102588 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:48.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6639630640 1 -- 172.21.15.130:0/1496102588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6634159f20 msgr2=0x7f66340ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:48.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6639630640 1 --2- 172.21.15.130:0/1496102588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6634159f20 0x7f66340ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6639630640 1 -- 172.21.15.130:0/1496102588 >> v2:172.21.15.130:3300/0 conn(0x7f66340cdfc0 msgr2=0x7f66340b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:48.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6639630640 1 --2- 172.21.15.130:0/1496102588 >> v2:172.21.15.130:3300/0 conn(0x7f66340cdfc0 0x7f66340b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6639630640 1 -- 172.21.15.130:0/1496102588 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66340ccfd0 con 0x7f66340b1610 2023-09-13T06:12:48.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6638e2f640 1 --2- 172.21.15.130:0/1496102588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6634159f20 0x7f66340ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:12:48.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.264+0000 7f6633fff640 1 --2- 172.21.15.130:0/1496102588 >> v2:172.21.15.130:3300/0 conn(0x7f66340cdfc0 0x7f66340b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:12:48.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f6639630640 1 --2- 172.21.15.130:0/1496102588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66340b1610 0x7f66340b1a80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f66340afcc0 tx=0x7f662c01c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f19dda579e78cf5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:48.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f66337fe640 1 -- 172.21.15.130:0/1496102588 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0a5790 con 0x7f66340b1610 2023-09-13T06:12:48.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f66337fe640 1 -- 172.21.15.130:0/1496102588 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c0a58f0 con 0x7f66340b1610 2023-09-13T06:12:48.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f66337fe640 1 -- 172.21.15.130:0/1496102588 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0a5c80 con 0x7f66340b1610 2023-09-13T06:12:48.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f663b093640 1 -- 172.21.15.130:0/1496102588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66340b1610 msgr2=0x7f66340b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f663b093640 1 --2- 172.21.15.130:0/1496102588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66340b1610 0x7f66340b1a80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f66340afcc0 tx=0x7f662c01c910 comp rx=0 tx=0).stop 2023-09-13T06:12:48.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f663b093640 1 -- 172.21.15.130:0/1496102588 shutdown_connections 2023-09-13T06:12:48.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f663b093640 1 --2- 172.21.15.130:0/1496102588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66340b1610 0x7f66340b1a80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f663b093640 1 --2- 172.21.15.130:0/1496102588 >> v2:172.21.15.130:3300/0 conn(0x7f66340cdfc0 0x7f66340b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f663b093640 1 --2- 172.21.15.130:0/1496102588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6634159f20 0x7f66340ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f663b093640 1 -- 172.21.15.130:0/1496102588 >> 172.21.15.130:0/1496102588 conn(0x7f6634065990 msgr2=0x7f6634065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:48.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f663b093640 1 -- 172.21.15.130:0/1496102588 shutdown_connections 2023-09-13T06:12:48.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.268+0000 7f663b093640 1 -- 172.21.15.130:0/1496102588 wait complete. 2023-09-13T06:12:48.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f663b093640 1 Processor -- start 2023-09-13T06:12:48.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f663b093640 1 -- start start 2023-09-13T06:12:48.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f663b093640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66340b1610 0x7f66341505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f663b093640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66340cdfc0 0x7f6634153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f663b093640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6634159f20 0x7f6634153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f663b093640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340c5410 con 0x7f66340b1610 2023-09-13T06:12:48.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f663b093640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634150b10 con 0x7f66340cdfc0 2023-09-13T06:12:48.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f663b093640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340c4710 con 0x7f6634159f20 2023-09-13T06:12:48.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f6638e2f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66340b1610 0x7f66341505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:48.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f6638e2f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66340b1610 0x7f66341505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41640/0 (socket says 172.21.15.130:41640) 2023-09-13T06:12:48.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f6638e2f640 1 -- 172.21.15.130:0/3796713968 learned_addr learned my addr 172.21.15.130:0/3796713968 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:48.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f6638e2f640 1 -- 172.21.15.130:0/3796713968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6634159f20 msgr2=0x7f6634153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f6638e2f640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6634159f20 0x7f6634153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f6638e2f640 1 -- 172.21.15.130:0/3796713968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66340cdfc0 msgr2=0x7f6634153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f6638e2f640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66340cdfc0 0x7f6634153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f6638e2f640 1 -- 172.21.15.130:0/3796713968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200094d0 con 0x7f66340b1610 2023-09-13T06:12:48.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f6638e2f640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66340b1610 0x7f66341505d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f662800e980 tx=0x7f662800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:48.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f66317fa640 1 -- 172.21.15.130:0/3796713968 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662800ca00 con 0x7f66340b1610 2023-09-13T06:12:48.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f66317fa640 1 -- 172.21.15.130:0/3796713968 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662800cb60 con 0x7f66340b1610 2023-09-13T06:12:48.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f66317fa640 1 -- 172.21.15.130:0/3796713968 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662800ced0 con 0x7f66340b1610 2023-09-13T06:12:48.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f663b093640 1 -- 172.21.15.130:0/3796713968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6628009420 con 0x7f66340b1610 2023-09-13T06:12:48.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.272+0000 7f663b093640 1 -- 172.21.15.130:0/3796713968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c009a70 con 0x7f66340b1610 2023-09-13T06:12:48.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.276+0000 7f663b093640 1 -- 172.21.15.130:0/3796713968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66340618a0 con 0x7f66340b1610 2023-09-13T06:12:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.276+0000 7f66317fa640 1 -- 172.21.15.130:0/3796713968 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6628013470 con 0x7f66340b1610 2023-09-13T06:12:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.276+0000 7f66317fa640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6618065b20 0x7f6618067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.276+0000 7f66317fa640 1 -- 172.21.15.130:0/3796713968 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6628083270 con 0x7f66340b1610 2023-09-13T06:12:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.276+0000 7f6633fff640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6618065b20 0x7f6618067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.276+0000 7f6633fff640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6618065b20 0x7f6618067fe0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6620006f50 tx=0x7f6620006ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:48.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.280+0000 7f66317fa640 1 -- 172.21.15.130:0/3796713968 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6628050e70 con 0x7f66340b1610 2023-09-13T06:12:48.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.480+0000 7f663b093640 1 -- 172.21.15.130:0/3796713968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f663406f290 con 0x7f66340b1610 2023-09-13T06:12:48.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.480+0000 7f66317fa640 1 -- 172.21.15.130:0/3796713968 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6628054490 con 0x7f66340b1610 2023-09-13T06:12:48.482 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:48.483 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:12:48.483 INFO:teuthology.orchestra.run.smithi130.stdout: "auth_dump": [ 2023-09-13T06:12:48.483 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.483 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.a", 2023-09-13T06:12:48.483 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlxJ5SGhAA0cL+TDnlEKJ4yAWQT10TXw==", 2023-09-13T06:12:48.483 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.484 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:12:48.484 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:12:48.484 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:12:48.484 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.484 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.485 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.b", 2023-09-13T06:12:48.485 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlfyVZJxAAnnux0lNtrJzTs4yhAxQLAg==", 2023-09-13T06:12:48.485 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.485 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:12:48.486 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:12:48.486 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:12:48.486 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.486 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.487 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.c", 2023-09-13T06:12:48.487 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl87vMIRAAsshh0UKYpt6uLUaLSSt11A==", 2023-09-13T06:12:48.487 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.487 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:12:48.488 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:12:48.488 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:12:48.488 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.488 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.489 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.489 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mds.d", 2023-09-13T06:12:48.489 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl8UMPLxAAb4wezQGHae0WOcqkswMcUg==", 2023-09-13T06:12:48.489 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.490 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:12:48.490 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:12:48.490 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:12:48.490 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.490 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.491 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.0", 2023-09-13T06:12:48.491 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlrMTUDRAAmgRU+5SpuqrdCdvtaDbPPw==", 2023-09-13T06:12:48.491 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.492 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:12:48.492 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:12:48.492 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.492 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.493 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.1", 2023-09-13T06:12:48.493 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFl/lxsFhAAYzQ6lutNC61YeBc3MFcfwQ==", 2023-09-13T06:12:48.493 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.493 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:12:48.494 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:12:48.494 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.494 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.495 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.2", 2023-09-13T06:12:48.495 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlQWwxHxAAEIjZ/XhHQbGBsVCKg32lBw==", 2023-09-13T06:12:48.495 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.495 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:12:48.496 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:12:48.496 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.496 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.497 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.3", 2023-09-13T06:12:48.497 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQASUAFlNnBEKBAAAUEuhpv47TUE+vIb4up16g==", 2023-09-13T06:12:48.497 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.497 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:12:48.498 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:12:48.498 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.498 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.499 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.4", 2023-09-13T06:12:48.499 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAVUAFlJ2BjNBAAWnSvPeBNKufphR7TYpVjKQ==", 2023-09-13T06:12:48.499 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.499 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:12:48.499 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:12:48.500 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.500 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.500 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.501 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.5", 2023-09-13T06:12:48.501 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlBoqOARAA6y21op9clXZU3S3iRlnqTw==", 2023-09-13T06:12:48.501 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.501 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:12:48.502 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:12:48.502 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.502 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.503 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.503 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.6", 2023-09-13T06:12:48.503 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlD5lfCxAAvXumPe9QBxb+FQjrM0c7zA==", 2023-09-13T06:12:48.503 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.503 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:12:48.504 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:12:48.504 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.504 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.504 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "osd.7", 2023-09-13T06:12:48.505 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAWUAFlTKETFRAAUbQThMC6UNmYUd8f5T68JA==", 2023-09-13T06:12:48.505 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.505 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow profile osd", 2023-09-13T06:12:48.505 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile osd", 2023-09-13T06:12:48.505 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.506 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.506 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.0", 2023-09-13T06:12:48.506 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA==", 2023-09-13T06:12:48.506 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.507 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:12:48.507 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow r", 2023-09-13T06:12:48.507 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-13T06:12:48.507 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.508 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.508 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.1", 2023-09-13T06:12:48.508 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl0tyaARAA2Bn9hwA3RTJyYOVo1kd9Cg==", 2023-09-13T06:12:48.508 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.508 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:12:48.509 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:12:48.509 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:12:48.509 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:12:48.509 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.509 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.510 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.2", 2023-09-13T06:12:48.510 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlTt1XORAA3CocykHm7EOdadtb+g0lsw==", 2023-09-13T06:12:48.510 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.510 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:12:48.510 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:12:48.511 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:12:48.511 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:12:48.511 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.511 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.511 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.3", 2023-09-13T06:12:48.512 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAPUAFl+yAQCBAAvmEvGJDQIAd7hP1dO7n8pA==", 2023-09-13T06:12:48.512 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.512 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow", 2023-09-13T06:12:48.512 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow r", 2023-09-13T06:12:48.512 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow rw", 2023-09-13T06:12:48.512 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow rwx" 2023-09-13T06:12:48.513 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.513 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "client.admin", 2023-09-13T06:12:48.513 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQANUAFl5ccJOBAAP4KJItnG8vNd5OP/63ai0g==", 2023-09-13T06:12:48.514 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.514 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:12:48.514 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": "allow *", 2023-09-13T06:12:48.514 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow *", 2023-09-13T06:12:48.514 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.515 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.515 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.515 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.x", 2023-09-13T06:12:48.515 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFldz/XFRAAzm5zxDPyaLiJwaI7jmPpjQ==", 2023-09-13T06:12:48.515 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.516 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:12:48.516 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:12:48.516 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.516 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:12:48.517 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:48.517 INFO:teuthology.orchestra.run.smithi130.stdout: "entity": "mgr.y", 2023-09-13T06:12:48.517 INFO:teuthology.orchestra.run.smithi130.stdout: "key": "AQAOUAFlr+atERAA6i8Z99e7G18l2EUmbftemA==", 2023-09-13T06:12:48.517 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": { 2023-09-13T06:12:48.517 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": "allow *", 2023-09-13T06:12:48.518 INFO:teuthology.orchestra.run.smithi130.stdout: "mon": "allow profile mgr", 2023-09-13T06:12:48.518 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": "allow *" 2023-09-13T06:12:48.518 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.518 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:48.518 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:12:48.519 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:12:48.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 -- 172.21.15.130:0/3796713968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6618065b20 msgr2=0x7f6618067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6618065b20 0x7f6618067fe0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6620006f50 tx=0x7f6620006ea0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 -- 172.21.15.130:0/3796713968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66340b1610 msgr2=0x7f66341505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66340b1610 0x7f66341505d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f662800e980 tx=0x7f662800ee40 comp rx=0 tx=0).stop 2023-09-13T06:12:48.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 -- 172.21.15.130:0/3796713968 shutdown_connections 2023-09-13T06:12:48.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6618065b20 0x7f6618067fe0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66340cdfc0 0x7f6634153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6634159f20 0x7f6634153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 --2- 172.21.15.130:0/3796713968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66340b1610 0x7f66341505d0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 -- 172.21.15.130:0/3796713968 >> 172.21.15.130:0/3796713968 conn(0x7f6634065990 msgr2=0x7f66340ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:48.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 -- 172.21.15.130:0/3796713968 shutdown_connections 2023-09-13T06:12:48.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.484+0000 7f663b093640 1 -- 172.21.15.130:0/3796713968 wait complete. 2023-09-13T06:12:48.523 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:12:48.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.660+0000 7f0cd699f640 1 Processor -- start 2023-09-13T06:12:48.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.660+0000 7f0cd699f640 1 -- start start 2023-09-13T06:12:48.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.660+0000 7f0cd699f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0cd00ae170 0x7f0cd00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.660+0000 7f0cd699f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0cd015d5f0 0x7f0cd01591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.660+0000 7f0cd699f640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd00cb4d0 con 0x7f0cd00cb040 2023-09-13T06:12:48.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.660+0000 7f0cd699f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd00b1e20 con 0x7f0cd015d5f0 2023-09-13T06:12:48.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.660+0000 7f0cd699f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd00cce60 con 0x7f0cd00ae170 2023-09-13T06:12:48.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0cd4f3c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0cd015d5f0 0x7f0cd01591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:48.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0cd4f3c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0cd015d5f0 0x7f0cd01591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41648/0 (socket says 172.21.15.130:41648) 2023-09-13T06:12:48.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0cd4f3c640 1 -- 172.21.15.130:0/1325072941 learned_addr learned my addr 172.21.15.130:0/1325072941 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:48.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0ccffff640 1 --2- 172.21.15.130:0/1325072941 >> v2:172.21.15.164:3300/0 conn(0x7f0cd00ae170 0x7f0cd00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:48.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0cd4f3c640 1 -- 172.21.15.130:0/1325072941 >> v2:172.21.15.164:3300/0 conn(0x7f0cd00ae170 msgr2=0x7f0cd00cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:48.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0cd4f3c640 1 --2- 172.21.15.130:0/1325072941 >> v2:172.21.15.164:3300/0 conn(0x7f0cd00ae170 0x7f0cd00cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0cd4f3c640 1 -- 172.21.15.130:0/1325072941 >> v1:172.21.15.164:6789/0 conn(0x7f0cd00cb040 legacy=0x7f0cd00b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0cd4f3c640 1 -- 172.21.15.130:0/1325072941 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00cd140 con 0x7f0cd015d5f0 2023-09-13T06:12:48.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0cd4f3c640 1 --2- 172.21.15.130:0/1325072941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cd015d5f0 0x7f0cd01591e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00b2910 tx=0x7f0cc801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9327a2afd56146 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:48.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0cceffd640 1 -- 172.21.15.130:0/1325072941 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80a5800 con 0x7f0cd015d5f0 2023-09-13T06:12:48.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0cceffd640 1 -- 172.21.15.130:0/1325072941 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc80a5960 con 0x7f0cd015d5f0 2023-09-13T06:12:48.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.664+0000 7f0cceffd640 1 -- 172.21.15.130:0/1325072941 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80a5cf0 con 0x7f0cd015d5f0 2023-09-13T06:12:48.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 -- 172.21.15.130:0/1325072941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cd015d5f0 msgr2=0x7f0cd01591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 --2- 172.21.15.130:0/1325072941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cd015d5f0 0x7f0cd01591e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00b2910 tx=0x7f0cc801c940 comp rx=0 tx=0).stop 2023-09-13T06:12:48.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 -- 172.21.15.130:0/1325072941 shutdown_connections 2023-09-13T06:12:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 --2- 172.21.15.130:0/1325072941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cd015d5f0 0x7f0cd01591e0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 --2- 172.21.15.130:0/1325072941 >> v2:172.21.15.164:3300/0 conn(0x7f0cd00ae170 0x7f0cd00cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 -- 172.21.15.130:0/1325072941 >> 172.21.15.130:0/1325072941 conn(0x7f0cd0065990 msgr2=0x7f0cd0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 -- 172.21.15.130:0/1325072941 shutdown_connections 2023-09-13T06:12:48.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 -- 172.21.15.130:0/1325072941 wait complete. 2023-09-13T06:12:48.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 Processor -- start 2023-09-13T06:12:48.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 -- start start 2023-09-13T06:12:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cd00ae170 0x7f0cd0141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0cd00cb040 0x7f0cd00af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0cd015d5f0 0x7f0cd00af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd015a1d0 con 0x7f0cd00ae170 2023-09-13T06:12:48.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd01579a0 con 0x7f0cd00cb040 2023-09-13T06:12:48.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0cd699f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0157c80 con 0x7f0cd015d5f0 2023-09-13T06:12:48.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cd00ae170 0x7f0cd0141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:48.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cd00ae170 0x7f0cd0141bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41654/0 (socket says 172.21.15.130:41654) 2023-09-13T06:12:48.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0ccffff640 1 -- 172.21.15.130:0/10768794 learned_addr learned my addr 172.21.15.130:0/10768794 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:48.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0ccffff640 1 -- 172.21.15.130:0/10768794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0cd015d5f0 msgr2=0x7f0cd00af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0ccffff640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0cd015d5f0 0x7f0cd00af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0ccffff640 1 -- 172.21.15.130:0/10768794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0cd00cb040 msgr2=0x7f0cd00af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0ccf7fe640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0cd00cb040 0x7f0cd00af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:48.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.668+0000 7f0ccffff640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0cd00cb040 0x7f0cd00af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0ccffff640 1 -- 172.21.15.130:0/10768794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8009b30 con 0x7f0cd00ae170 2023-09-13T06:12:48.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0ccf7fe640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0cd00cb040 0x7f0cd00af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:48.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0ccffff640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cd00ae170 0x7f0cd0141bf0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000e930 tx=0x7f0cc000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:48.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0cccff9640 1 -- 172.21.15.130:0/10768794 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0009690 con 0x7f0cd00ae170 2023-09-13T06:12:48.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0cccff9640 1 -- 172.21.15.130:0/10768794 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc000ca00 con 0x7f0cd00ae170 2023-09-13T06:12:48.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0cd699f640 1 -- 172.21.15.130:0/10768794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd0157f60 con 0x7f0cd00ae170 2023-09-13T06:12:48.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0cccff9640 1 -- 172.21.15.130:0/10768794 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc000cd70 con 0x7f0cd00ae170 2023-09-13T06:12:48.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0cd699f640 1 -- 172.21.15.130:0/10768794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd0142130 con 0x7f0cd00ae170 2023-09-13T06:12:48.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0cd699f640 1 -- 172.21.15.130:0/10768794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd0159b30 con 0x7f0cd00ae170 2023-09-13T06:12:48.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0cccff9640 1 -- 172.21.15.130:0/10768794 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0cc0013470 con 0x7f0cd00ae170 2023-09-13T06:12:48.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0cccff9640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0cbc065b20 0x7f0cbc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:48.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0cccff9640 1 -- 172.21.15.130:0/10768794 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0cc00832d0 con 0x7f0cd00ae170 2023-09-13T06:12:48.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.672+0000 7f0ccf7fe640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0cbc065b20 0x7f0cbc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:48.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.676+0000 7f0ccf7fe640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0cbc065b20 0x7f0cbc067fe0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0158e20 tx=0x7f0cc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:48.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.676+0000 7f0cccff9640 1 -- 172.21.15.130:0/10768794 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0cc0050fa0 con 0x7f0cd00ae170 2023-09-13T06:12:48.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.836+0000 7f0cd699f640 1 -- 172.21.15.130:0/10768794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cd00618a0 con 0x7f0cd00ae170 2023-09-13T06:12:48.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cccff9640 1 -- 172.21.15.130:0/10768794 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+12904 (secure 0 0 0) 0x7f0cc00545c0 con 0x7f0cd00ae170 2023-09-13T06:12:48.840 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:48.840 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":183,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:12:48.093926+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:12:48.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 -- 172.21.15.130:0/10768794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0cbc065b20 msgr2=0x7f0cbc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0cbc065b20 0x7f0cbc067fe0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0158e20 tx=0x7f0cc4009040 comp rx=0 tx=0).stop 2023-09-13T06:12:48.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 -- 172.21.15.130:0/10768794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cd00ae170 msgr2=0x7f0cd0141bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:48.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cd00ae170 0x7f0cd0141bf0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000e930 tx=0x7f0cc000edf0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 -- 172.21.15.130:0/10768794 shutdown_connections 2023-09-13T06:12:48.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0cbc065b20 0x7f0cbc067fe0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0cd00cb040 0x7f0cd00af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0cd015d5f0 0x7f0cd00af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 --2- 172.21.15.130:0/10768794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cd00ae170 0x7f0cd0141bf0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:48.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 -- 172.21.15.130:0/10768794 >> 172.21.15.130:0/10768794 conn(0x7f0cd0065990 msgr2=0x7f0cd006f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:48.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 -- 172.21.15.130:0/10768794 shutdown_connections 2023-09-13T06:12:48.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:48.840+0000 7f0cd699f640 1 -- 172.21.15.130:0/10768794 wait complete. 2023-09-13T06:12:48.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:12:48.862 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:12:49.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410c29c640 1 Processor -- start 2023-09-13T06:12:49.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410c29c640 1 -- start start 2023-09-13T06:12:49.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410c29c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f410415a080 0x7f41040b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410c29c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f410415e650 0x7f41040b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410c29c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41040cc850 con 0x7f41040b2fd0 2023-09-13T06:12:49.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410c29c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41040b33f0 con 0x7f410415a080 2023-09-13T06:12:49.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410c29c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41040b0330 con 0x7f410415e650 2023-09-13T06:12:49.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410a038640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f410415a080 0x7f41040b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410a839640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f41040b2fd0 0x7f41040ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55418/0 (socket says 172.21.15.130:55418) 2023-09-13T06:12:49.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410a839640 1 -- 172.21.15.130:0/724268465 learned_addr learned my addr 172.21.15.130:0/724268465 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:49.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f4109837640 1 --2- 172.21.15.130:0/724268465 >> v2:172.21.15.164:3300/0 conn(0x7f410415e650 0x7f41040b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410a038640 1 -- 172.21.15.130:0/724268465 >> v2:172.21.15.164:3300/0 conn(0x7f410415e650 msgr2=0x7f41040b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:49.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410a038640 1 --2- 172.21.15.130:0/724268465 >> v2:172.21.15.164:3300/0 conn(0x7f410415e650 0x7f41040b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410a038640 1 -- 172.21.15.130:0/724268465 >> v1:172.21.15.130:6789/0 conn(0x7f41040b2fd0 legacy=0x7f41040ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f410a038640 1 -- 172.21.15.130:0/724268465 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41040cbcd0 con 0x7f410415a080 2023-09-13T06:12:49.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.004+0000 7f4109036640 1 -- 172.21.15.130:0/724268465 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99988567 0 0) 0x7f40fc0014a0 con 0x7f41040b2fd0 2023-09-13T06:12:49.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f410a038640 1 --2- 172.21.15.130:0/724268465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f410415a080 0x7f41040b1460 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f41040671b0 tx=0x7f410001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ec11fca574c0eb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:49.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f4109036640 1 -- 172.21.15.130:0/724268465 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000ab600 con 0x7f410415a080 2023-09-13T06:12:49.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f4109036640 1 -- 172.21.15.130:0/724268465 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41000a7050 con 0x7f410415a080 2023-09-13T06:12:49.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f4109036640 1 -- 172.21.15.130:0/724268465 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000ab980 con 0x7f410415a080 2023-09-13T06:12:49.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f410c29c640 1 -- 172.21.15.130:0/724268465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f410415a080 msgr2=0x7f41040b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f410c29c640 1 --2- 172.21.15.130:0/724268465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f410415a080 0x7f41040b1460 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f41040671b0 tx=0x7f410001c370 comp rx=0 tx=0).stop 2023-09-13T06:12:49.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f410c29c640 1 -- 172.21.15.130:0/724268465 shutdown_connections 2023-09-13T06:12:49.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f410c29c640 1 --2- 172.21.15.130:0/724268465 >> v2:172.21.15.164:3300/0 conn(0x7f410415e650 0x7f41040b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f410c29c640 1 --2- 172.21.15.130:0/724268465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f410415a080 0x7f41040b1460 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f410c29c640 1 -- 172.21.15.130:0/724268465 >> 172.21.15.130:0/724268465 conn(0x7f4104065990 msgr2=0x7f4104065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:49.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f410c29c640 1 -- 172.21.15.130:0/724268465 shutdown_connections 2023-09-13T06:12:49.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.008+0000 7f410c29c640 1 -- 172.21.15.130:0/724268465 wait complete. 2023-09-13T06:12:49.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410c29c640 1 Processor -- start 2023-09-13T06:12:49.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410c29c640 1 -- start start 2023-09-13T06:12:49.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410c29c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41040b2fd0 0x7f41040a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410c29c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f410415a080 0x7f410413b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410c29c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f410415e650 0x7f4104150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410c29c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41040a92b0 con 0x7f410415a080 2023-09-13T06:12:49.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410c29c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41040a9fd0 con 0x7f41040b2fd0 2023-09-13T06:12:49.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410c29c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410413b870 con 0x7f410415e650 2023-09-13T06:12:49.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f4109837640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f410415a080 0x7f410413b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f4109837640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f410415a080 0x7f410413b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41676/0 (socket says 172.21.15.130:41676) 2023-09-13T06:12:49.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f4109837640 1 -- 172.21.15.130:0/4112710367 learned_addr learned my addr 172.21.15.130:0/4112710367 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:49.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410a038640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41040b2fd0 0x7f41040a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410a839640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f410415e650 0x7f4104150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f4109837640 1 -- 172.21.15.130:0/4112710367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f410415e650 msgr2=0x7f4104150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f4109837640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f410415e650 0x7f4104150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f4109837640 1 -- 172.21.15.130:0/4112710367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41040b2fd0 msgr2=0x7f41040a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f4109837640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41040b2fd0 0x7f41040a8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f4109837640 1 -- 172.21.15.130:0/4112710367 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4100009420 con 0x7f410415a080 2023-09-13T06:12:49.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f4109837640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f410415a080 0x7f410413b330 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f40f400d620 tx=0x7f40f400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:49.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f40faffd640 1 -- 172.21.15.130:0/4112710367 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400b620 con 0x7f410415a080 2023-09-13T06:12:49.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f40faffd640 1 -- 172.21.15.130:0/4112710367 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f400b780 con 0x7f410415a080 2023-09-13T06:12:49.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410c29c640 1 -- 172.21.15.130:0/4112710367 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41040a96e0 con 0x7f410415a080 2023-09-13T06:12:49.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f40faffd640 1 -- 172.21.15.130:0/4112710367 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400bb10 con 0x7f410415a080 2023-09-13T06:12:49.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410c29c640 1 -- 172.21.15.130:0/4112710367 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41040a9c60 con 0x7f410415a080 2023-09-13T06:12:49.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.012+0000 7f410c29c640 1 -- 172.21.15.130:0/4112710367 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41040aa160 con 0x7f410415a080 2023-09-13T06:12:49.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.016+0000 7f40faffd640 1 -- 172.21.15.130:0/4112710367 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f40f400bc70 con 0x7f410415a080 2023-09-13T06:12:49.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.016+0000 7f40faffd640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40e8065b20 0x7f40e8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.016+0000 7f40faffd640 1 -- 172.21.15.130:0/4112710367 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f40f4083430 con 0x7f410415a080 2023-09-13T06:12:49.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.016+0000 7f410a038640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40e8065b20 0x7f40e8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.016+0000 7f410a038640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40e8065b20 0x7f40e8067fe0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f41000ad000 tx=0x7f41000a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:49.021 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.020+0000 7f40faffd640 1 -- 172.21.15.130:0/4112710367 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f40f4051030 con 0x7f410415a080 2023-09-13T06:12:49.168 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 -- 172.21.15.130:0/4112710367 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41040618a0 con 0x7f410415a080 2023-09-13T06:12:49.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f40faffd640 1 -- 172.21.15.130:0/4112710367 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40f4007380 con 0x7f410415a080 2023-09-13T06:12:49.169 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:12:49.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 -- 172.21.15.130:0/4112710367 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40e8065b20 msgr2=0x7f40e8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40e8065b20 0x7f40e8067fe0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f41000ad000 tx=0x7f41000a6000 comp rx=0 tx=0).stop 2023-09-13T06:12:49.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 -- 172.21.15.130:0/4112710367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f410415a080 msgr2=0x7f410413b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f410415a080 0x7f410413b330 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f40f400d620 tx=0x7f40f400dae0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 -- 172.21.15.130:0/4112710367 shutdown_connections 2023-09-13T06:12:49.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f40e8065b20 0x7f40e8067fe0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f410415e650 0x7f4104150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f410415a080 0x7f410413b330 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 --2- 172.21.15.130:0/4112710367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41040b2fd0 0x7f41040a8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 -- 172.21.15.130:0/4112710367 >> 172.21.15.130:0/4112710367 conn(0x7f4104065990 msgr2=0x7f41040ae790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:49.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 -- 172.21.15.130:0/4112710367 shutdown_connections 2023-09-13T06:12:49.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.168+0000 7f410c29c640 1 -- 172.21.15.130:0/4112710367 wait complete. 2023-09-13T06:12:49.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T06:12:49.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.328+0000 7f9c8c86d640 1 Processor -- start 2023-09-13T06:12:49.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.328+0000 7f9c8c86d640 1 -- start start 2023-09-13T06:12:49.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c8c86d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9c880cc780 0x7f9c8815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c8c86d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9c880b04a0 0x7f9c880b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c8c86d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c880ccbe0 con 0x7f9c8815b130 2023-09-13T06:12:49.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c8c86d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c880b0e50 con 0x7f9c880b04a0 2023-09-13T06:12:49.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c8c86d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c880ce980 con 0x7f9c880cc780 2023-09-13T06:12:49.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c86d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9c880b04a0 0x7f9c880b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c86d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9c880b04a0 0x7f9c880b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41680/0 (socket says 172.21.15.130:41680) 2023-09-13T06:12:49.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c86d9d640 1 -- 172.21.15.130:0/3482915110 learned_addr learned my addr 172.21.15.130:0/3482915110 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:49.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c7dd9b640 1 --2- 172.21.15.130:0/3482915110 >> v2:172.21.15.164:3300/0 conn(0x7f9c880cc780 0x7f9c8815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c86d9d640 1 -- 172.21.15.130:0/3482915110 >> v2:172.21.15.164:3300/0 conn(0x7f9c880cc780 msgr2=0x7f9c8815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:49.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c86d9d640 1 --2- 172.21.15.130:0/3482915110 >> v2:172.21.15.164:3300/0 conn(0x7f9c880cc780 0x7f9c8815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c86d9d640 1 -- 172.21.15.130:0/3482915110 >> v1:172.21.15.164:6789/0 conn(0x7f9c8815b130 legacy=0x7f9c880ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:49.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c86d9d640 1 -- 172.21.15.130:0/3482915110 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c880cec60 con 0x7f9c880b04a0 2023-09-13T06:12:49.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.332+0000 7f9c7dd9b640 1 --2- 172.21.15.130:0/3482915110 >> v2:172.21.15.164:3300/0 conn(0x7f9c880cc780 0x7f9c8815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:49.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c86d9d640 1 --2- 172.21.15.130:0/3482915110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c880b04a0 0x7f9c880b0910 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f9c8806bc40 tx=0x7f9c8001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64e2ef394a2e4aa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:49.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c85d9b640 1 -- 172.21.15.130:0/3482915110 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c800aa5f0 con 0x7f9c880b04a0 2023-09-13T06:12:49.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c85d9b640 1 -- 172.21.15.130:0/3482915110 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c800aa750 con 0x7f9c880b04a0 2023-09-13T06:12:49.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c85d9b640 1 -- 172.21.15.130:0/3482915110 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c800aaae0 con 0x7f9c880b04a0 2023-09-13T06:12:49.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c8c86d640 1 -- 172.21.15.130:0/3482915110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c880b04a0 msgr2=0x7f9c880b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c8c86d640 1 --2- 172.21.15.130:0/3482915110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c880b04a0 0x7f9c880b0910 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f9c8806bc40 tx=0x7f9c8001c490 comp rx=0 tx=0).stop 2023-09-13T06:12:49.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c8c86d640 1 -- 172.21.15.130:0/3482915110 shutdown_connections 2023-09-13T06:12:49.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c8c86d640 1 --2- 172.21.15.130:0/3482915110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c880b04a0 0x7f9c880b0910 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c8c86d640 1 --2- 172.21.15.130:0/3482915110 >> v2:172.21.15.164:3300/0 conn(0x7f9c880cc780 0x7f9c8815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c8c86d640 1 -- 172.21.15.130:0/3482915110 >> 172.21.15.130:0/3482915110 conn(0x7f9c88065990 msgr2=0x7f9c88065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:49.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c8c86d640 1 -- 172.21.15.130:0/3482915110 shutdown_connections 2023-09-13T06:12:49.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c8c86d640 1 -- 172.21.15.130:0/3482915110 wait complete. 2023-09-13T06:12:49.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c8c86d640 1 Processor -- start 2023-09-13T06:12:49.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.336+0000 7f9c8c86d640 1 -- start start 2023-09-13T06:12:49.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c8c86d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c880b04a0 0x7f9c88153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c8c86d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c880cc780 0x7f9c880ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c8c86d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8815b130 0x7f9c880acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c8c86d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c881588d0 con 0x7f9c880cc780 2023-09-13T06:12:49.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c8c86d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c881585f0 con 0x7f9c880b04a0 2023-09-13T06:12:49.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c8c86d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8814fc30 con 0x7f9c8815b130 2023-09-13T06:12:49.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c880cc780 0x7f9c880ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c880cc780 0x7f9c880ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41696/0 (socket says 172.21.15.130:41696) 2023-09-13T06:12:49.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7dd9b640 1 -- 172.21.15.130:0/2549360674 learned_addr learned my addr 172.21.15.130:0/2549360674 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:49.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c8659c640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c880b04a0 0x7f9c88153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c86d9d640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8815b130 0x7f9c880acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7dd9b640 1 -- 172.21.15.130:0/2549360674 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8815b130 msgr2=0x7f9c880acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7dd9b640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8815b130 0x7f9c880acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7dd9b640 1 -- 172.21.15.130:0/2549360674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c880b04a0 msgr2=0x7f9c88153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7dd9b640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c880b04a0 0x7f9c88153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7dd9b640 1 -- 172.21.15.130:0/2549360674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c800094d0 con 0x7f9c880cc780 2023-09-13T06:12:49.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7dd9b640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c880cc780 0x7f9c880ac7a0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000cf60 tx=0x7f9c7000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:49.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7f7fe640 1 -- 172.21.15.130:0/2549360674 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000d840 con 0x7f9c880cc780 2023-09-13T06:12:49.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7f7fe640 1 -- 172.21.15.130:0/2549360674 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7000d9a0 con 0x7f9c880cc780 2023-09-13T06:12:49.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c8c86d640 1 -- 172.21.15.130:0/2549360674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8814ff10 con 0x7f9c880cc780 2023-09-13T06:12:49.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7f7fe640 1 -- 172.21.15.130:0/2549360674 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000dd30 con 0x7f9c880cc780 2023-09-13T06:12:49.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c8c86d640 1 -- 172.21.15.130:0/2549360674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c88153580 con 0x7f9c880cc780 2023-09-13T06:12:49.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c8c86d640 1 -- 172.21.15.130:0/2549360674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c880618a0 con 0x7f9c880cc780 2023-09-13T06:12:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.340+0000 7f9c7f7fe640 1 -- 172.21.15.130:0/2549360674 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9c70015440 con 0x7f9c880cc780 2023-09-13T06:12:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.344+0000 7f9c7f7fe640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c68065b20 0x7f9c68067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.344+0000 7f9c7f7fe640 1 -- 172.21.15.130:0/2549360674 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c70083a90 con 0x7f9c880cc780 2023-09-13T06:12:49.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.344+0000 7f9c8659c640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c68065b20 0x7f9c68067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.344+0000 7f9c8659c640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c68065b20 0x7f9c68067fe0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800b810 tx=0x7f9c78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:49.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.348+0000 7f9c7f7fe640 1 -- 172.21.15.130:0/2549360674 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9c70051740 con 0x7f9c880cc780 2023-09-13T06:12:49.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 -- 172.21.15.130:0/2549360674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9c881503c0 con 0x7f9c880cc780 2023-09-13T06:12:49.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c7f7fe640 1 -- 172.21.15.130:0/2549360674 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v183) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9c7001a090 con 0x7f9c880cc780 2023-09-13T06:12:49.498 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:49.498 INFO:teuthology.orchestra.run.smithi130.stdout:[ 2023-09-13T06:12:49.498 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:12:49.498 INFO:teuthology.orchestra.run.smithi130.stdout: "poolnum": 1, 2023-09-13T06:12:49.499 INFO:teuthology.orchestra.run.smithi130.stdout: "poolname": ".mgr" 2023-09-13T06:12:49.499 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:12:49.499 INFO:teuthology.orchestra.run.smithi130.stdout:] 2023-09-13T06:12:49.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 -- 172.21.15.130:0/2549360674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c68065b20 msgr2=0x7f9c68067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c68065b20 0x7f9c68067fe0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800b810 tx=0x7f9c78008040 comp rx=0 tx=0).stop 2023-09-13T06:12:49.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 -- 172.21.15.130:0/2549360674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c880cc780 msgr2=0x7f9c880ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c880cc780 0x7f9c880ac7a0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000cf60 tx=0x7f9c7000cf90 comp rx=0 tx=0).stop 2023-09-13T06:12:49.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 -- 172.21.15.130:0/2549360674 shutdown_connections 2023-09-13T06:12:49.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9c68065b20 0x7f9c68067fe0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.502 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8815b130 0x7f9c880acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c880cc780 0x7f9c880ac7a0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 --2- 172.21.15.130:0/2549360674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c880b04a0 0x7f9c88153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.503 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 -- 172.21.15.130:0/2549360674 >> 172.21.15.130:0/2549360674 conn(0x7f9c88065990 msgr2=0x7f9c880b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:49.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 -- 172.21.15.130:0/2549360674 shutdown_connections 2023-09-13T06:12:49.504 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.496+0000 7f9c8c86d640 1 -- 172.21.15.130:0/2549360674 wait complete. 2023-09-13T06:12:49.517 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T06:12:49.518 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T06:12:49.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.656+0000 7fb27f49c640 1 Processor -- start 2023-09-13T06:12:49.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.656+0000 7fb27f49c640 1 -- start start 2023-09-13T06:12:49.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27f49c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb278144a40 0x7fb2780aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27f49c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb2780b0460 0x7fb27806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27f49c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2780b08c0 con 0x7fb27806ced0 2023-09-13T06:12:49.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27f49c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb278144e20 con 0x7fb2780b0460 2023-09-13T06:12:49.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27f49c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27806d7c0 con 0x7fb278144a40 2023-09-13T06:12:49.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27ca37640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb2780b0460 0x7fb27806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27da39640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb27806ced0 0x7fb27806f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:55426/0 (socket says 172.21.15.130:55426) 2023-09-13T06:12:49.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27da39640 1 -- 172.21.15.130:0/3076271617 learned_addr learned my addr 172.21.15.130:0/3076271617 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:49.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27d238640 1 --2- 172.21.15.130:0/3076271617 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb278144a40 0x7fb2780aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27ca37640 1 -- 172.21.15.130:0/3076271617 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb278144a40 msgr2=0x7fb2780aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:49.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27ca37640 1 --2- 172.21.15.130:0/3076271617 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb278144a40 0x7fb2780aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27ca37640 1 -- 172.21.15.130:0/3076271617 >> v1:172.21.15.130:6789/0 conn(0x7fb27806ced0 legacy=0x7fb27806f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.660+0000 7fb27ca37640 1 -- 172.21.15.130:0/3076271617 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27806daa0 con 0x7fb2780b0460 2023-09-13T06:12:49.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb27ca37640 1 --2- 172.21.15.130:0/3076271617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2780b0460 0x7fb27806c990 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fb2680097c0 tx=0x7fb26801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22988b9e0f8b5fd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:49.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb26ffff640 1 -- 172.21.15.130:0/3076271617 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2680ab650 con 0x7fb2780b0460 2023-09-13T06:12:49.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb26ffff640 1 -- 172.21.15.130:0/3076271617 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2680ab7b0 con 0x7fb2780b0460 2023-09-13T06:12:49.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb26ffff640 1 -- 172.21.15.130:0/3076271617 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2680abb40 con 0x7fb2780b0460 2023-09-13T06:12:49.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb27f49c640 1 -- 172.21.15.130:0/3076271617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2780b0460 msgr2=0x7fb27806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb27f49c640 1 --2- 172.21.15.130:0/3076271617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2780b0460 0x7fb27806c990 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fb2680097c0 tx=0x7fb26801c450 comp rx=0 tx=0).stop 2023-09-13T06:12:49.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb27f49c640 1 -- 172.21.15.130:0/3076271617 shutdown_connections 2023-09-13T06:12:49.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb27f49c640 1 --2- 172.21.15.130:0/3076271617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2780b0460 0x7fb27806c990 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb27f49c640 1 --2- 172.21.15.130:0/3076271617 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb278144a40 0x7fb2780aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb27f49c640 1 -- 172.21.15.130:0/3076271617 >> 172.21.15.130:0/3076271617 conn(0x7fb2780735e0 msgr2=0x7fb278065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:49.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb27f49c640 1 -- 172.21.15.130:0/3076271617 shutdown_connections 2023-09-13T06:12:49.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb27f49c640 1 -- 172.21.15.130:0/3076271617 wait complete. 2023-09-13T06:12:49.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb27f49c640 1 Processor -- start 2023-09-13T06:12:49.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.664+0000 7fb27f49c640 1 -- start start 2023-09-13T06:12:49.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27f49c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27806ced0 0x7fb27815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27f49c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2780b0460 0x7fb27813b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27f49c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb278144a40 0x7fb27813bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27f49c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780af8d0 con 0x7fb27806ced0 2023-09-13T06:12:49.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27f49c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780afbb0 con 0x7fb2780b0460 2023-09-13T06:12:49.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27f49c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780afe90 con 0x7fb278144a40 2023-09-13T06:12:49.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27d238640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27806ced0 0x7fb27815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27d238640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27806ced0 0x7fb27815a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:41714/0 (socket says 172.21.15.130:41714) 2023-09-13T06:12:49.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27d238640 1 -- 172.21.15.130:0/2553757590 learned_addr learned my addr 172.21.15.130:0/2553757590 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:49.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27ca37640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2780b0460 0x7fb27813b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27da39640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb278144a40 0x7fb27813bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27d238640 1 -- 172.21.15.130:0/2553757590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb278144a40 msgr2=0x7fb27813bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27d238640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb278144a40 0x7fb27813bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27d238640 1 -- 172.21.15.130:0/2553757590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2780b0460 msgr2=0x7fb27813b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:49.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27d238640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2780b0460 0x7fb27813b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:49.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27d238640 1 -- 172.21.15.130:0/2553757590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268009420 con 0x7fb27806ced0 2023-09-13T06:12:49.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27da39640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb278144a40 0x7fb27813bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:49.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27d238640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27806ced0 0x7fb27815a9c0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fb27400d5f0 tx=0x7fb27400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:49.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb26dffb640 1 -- 172.21.15.130:0/2553757590 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740125f0 con 0x7fb27806ced0 2023-09-13T06:12:49.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb26dffb640 1 -- 172.21.15.130:0/2553757590 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb274012750 con 0x7fb27806ced0 2023-09-13T06:12:49.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27f49c640 1 -- 172.21.15.130:0/2553757590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2780b0170 con 0x7fb27806ced0 2023-09-13T06:12:49.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb26dffb640 1 -- 172.21.15.130:0/2553757590 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274012ae0 con 0x7fb27806ced0 2023-09-13T06:12:49.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27f49c640 1 -- 172.21.15.130:0/2553757590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27815af00 con 0x7fb27806ced0 2023-09-13T06:12:49.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb27f49c640 1 -- 172.21.15.130:0/2553757590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2780618a0 con 0x7fb27806ced0 2023-09-13T06:12:49.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.668+0000 7fb26dffb640 1 -- 172.21.15.130:0/2553757590 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb274012c40 con 0x7fb27806ced0 2023-09-13T06:12:49.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.672+0000 7fb26dffb640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb25c065b20 0x7fb25c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:49.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.672+0000 7fb26dffb640 1 -- 172.21.15.130:0/2553757590 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb2740833f0 con 0x7fb27806ced0 2023-09-13T06:12:49.677 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.672+0000 7fb27ca37640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb25c065b20 0x7fb25c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:49.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.672+0000 7fb27ca37640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb25c065b20 0x7fb25c067fe0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb2680af000 tx=0x7fb2680a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:49.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.676+0000 7fb26dffb640 1 -- 172.21.15.130:0/2553757590 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb274051080 con 0x7fb27806ced0 2023-09-13T06:12:49.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:49.824+0000 7fb27f49c640 1 -- 172.21.15.130:0/2553757590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb2780afa10 con 0x7fb27806ced0 2023-09-13T06:12:50.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.748+0000 7fb26dffb640 1 -- 172.21.15.130:0/2553757590 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v184) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb2780afa10 con 0x7fb27806ced0 2023-09-13T06:12:50.750 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' created 2023-09-13T06:12:50.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.752+0000 7fb27f49c640 1 -- 172.21.15.130:0/2553757590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb25c065b20 msgr2=0x7fb25c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:50.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.756+0000 7fb27f49c640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb25c065b20 0x7fb25c067fe0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb2680af000 tx=0x7fb2680a7000 comp rx=0 tx=0).stop 2023-09-13T06:12:50.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.756+0000 7fb27f49c640 1 -- 172.21.15.130:0/2553757590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27806ced0 msgr2=0x7fb27815a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:50.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.756+0000 7fb27f49c640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27806ced0 0x7fb27815a9c0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fb27400d5f0 tx=0x7fb27400dab0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.756+0000 7fb27f49c640 1 -- 172.21.15.130:0/2553757590 shutdown_connections 2023-09-13T06:12:50.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.756+0000 7fb27f49c640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb25c065b20 0x7fb25c067fe0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.756+0000 7fb27f49c640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2780b0460 0x7fb27813b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.756+0000 7fb27f49c640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb278144a40 0x7fb27813bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.756+0000 7fb27f49c640 1 --2- 172.21.15.130:0/2553757590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27806ced0 0x7fb27815a9c0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.756+0000 7fb27f49c640 1 -- 172.21.15.130:0/2553757590 >> 172.21.15.130:0/2553757590 conn(0x7fb2780735e0 msgr2=0x7fb27815c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:50.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.756+0000 7fb27f49c640 1 -- 172.21.15.130:0/2553757590 shutdown_connections 2023-09-13T06:12:50.759 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.756+0000 7fb27f49c640 1 -- 172.21.15.130:0/2553757590 wait complete. 2023-09-13T06:12:50.778 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T06:12:50.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.928+0000 7fdfd0893640 1 Processor -- start 2023-09-13T06:12:50.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.928+0000 7fdfd0893640 1 -- start start 2023-09-13T06:12:50.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfd0893640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdfcc144d70 0x7fdfcc0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:50.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfd0893640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdfcc0b2780 0x7fdfcc0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:50.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfd0893640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfcc0b1460 0x7fdfcc0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:50.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfd0893640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b2430 con 0x7fdfcc144d70 2023-09-13T06:12:50.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfd0893640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc0cedb0 con 0x7fdfcc0b2780 2023-09-13T06:12:50.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfd0893640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b3120 con 0x7fdfcc0b1460 2023-09-13T06:12:50.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfca59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdfcc144d70 0x7fdfcc0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:50.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfca59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdfcc144d70 0x7fdfcc0ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49470/0 (socket says 172.21.15.130:49470) 2023-09-13T06:12:50.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfca59c640 1 -- 172.21.15.130:0/1275044387 learned_addr learned my addr 172.21.15.130:0/1275044387 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:50.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfcad9d640 1 --2- 172.21.15.130:0/1275044387 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfcc0b1460 0x7fdfcc0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:50.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfc3fff640 1 --2- 172.21.15.130:0/1275044387 >> v2:172.21.15.164:3300/0 conn(0x7fdfcc0b2780 0x7fdfcc0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:50.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfca59c640 1 -- 172.21.15.130:0/1275044387 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfcc0b1460 msgr2=0x7fdfcc0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:50.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfca59c640 1 --2- 172.21.15.130:0/1275044387 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfcc0b1460 0x7fdfcc0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfca59c640 1 -- 172.21.15.130:0/1275044387 >> v2:172.21.15.164:3300/0 conn(0x7fdfcc0b2780 msgr2=0x7fdfcc0b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:50.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfca59c640 1 --2- 172.21.15.130:0/1275044387 >> v2:172.21.15.164:3300/0 conn(0x7fdfcc0b2780 0x7fdfcc0b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfca59c640 1 -- 172.21.15.130:0/1275044387 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0b2150 con 0x7fdfcc144d70 2023-09-13T06:12:50.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfcad9d640 1 --2- 172.21.15.130:0/1275044387 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfcc0b1460 0x7fdfcc0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:50.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfc3fff640 1 --2- 172.21.15.130:0/1275044387 >> v2:172.21.15.164:3300/0 conn(0x7fdfcc0b2780 0x7fdfcc0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:50.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.932+0000 7fdfca59c640 1 --2- 172.21.15.130:0/1275044387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfcc144d70 0x7fdfcc0ce870 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc145150 tx=0x7fdfbc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1409d074d1db61 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:50.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfc9d9b640 1 -- 172.21.15.130:0/1275044387 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0ac410 con 0x7fdfcc144d70 2023-09-13T06:12:50.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfc9d9b640 1 -- 172.21.15.130:0/1275044387 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0ac570 con 0x7fdfcc144d70 2023-09-13T06:12:50.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfc9d9b640 1 -- 172.21.15.130:0/1275044387 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0ac900 con 0x7fdfcc144d70 2023-09-13T06:12:50.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 -- 172.21.15.130:0/1275044387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfcc144d70 msgr2=0x7fdfcc0ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:50.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 --2- 172.21.15.130:0/1275044387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfcc144d70 0x7fdfcc0ce870 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc145150 tx=0x7fdfbc01c500 comp rx=0 tx=0).stop 2023-09-13T06:12:50.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 -- 172.21.15.130:0/1275044387 shutdown_connections 2023-09-13T06:12:50.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 --2- 172.21.15.130:0/1275044387 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfcc0b1460 0x7fdfcc0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 --2- 172.21.15.130:0/1275044387 >> v2:172.21.15.164:3300/0 conn(0x7fdfcc0b2780 0x7fdfcc0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 --2- 172.21.15.130:0/1275044387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfcc144d70 0x7fdfcc0ce870 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 -- 172.21.15.130:0/1275044387 >> 172.21.15.130:0/1275044387 conn(0x7fdfcc065990 msgr2=0x7fdfcc065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:50.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 -- 172.21.15.130:0/1275044387 shutdown_connections 2023-09-13T06:12:50.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 -- 172.21.15.130:0/1275044387 wait complete. 2023-09-13T06:12:50.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 Processor -- start 2023-09-13T06:12:50.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 -- start start 2023-09-13T06:12:50.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfcc0b1460 0x7fdfcc13ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:50.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfcc0b2780 0x7fdfcc1f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:50.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfcc144d70 0x7fdfcc158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:50.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc13b2d0 con 0x7fdfcc0b2780 2023-09-13T06:12:50.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0af440 con 0x7fdfcc0b1460 2023-09-13T06:12:50.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.936+0000 7fdfd0893640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc142d10 con 0x7fdfcc144d70 2023-09-13T06:12:50.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfcc0b2780 0x7fdfcc1f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:50.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfcc0b2780 0x7fdfcc1f5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49482/0 (socket says 172.21.15.130:49482) 2023-09-13T06:12:50.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc3fff640 1 -- 172.21.15.130:0/2783247084 learned_addr learned my addr 172.21.15.130:0/2783247084 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:50.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfcad9d640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfcc144d70 0x7fdfcc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:50.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfca59c640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfcc0b1460 0x7fdfcc13ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:50.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc3fff640 1 -- 172.21.15.130:0/2783247084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfcc144d70 msgr2=0x7fdfcc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:50.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc3fff640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfcc144d70 0x7fdfcc158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc3fff640 1 -- 172.21.15.130:0/2783247084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfcc0b1460 msgr2=0x7fdfcc13ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:50.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc3fff640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfcc0b1460 0x7fdfcc13ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:50.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc3fff640 1 -- 172.21.15.130:0/2783247084 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc0094d0 con 0x7fdfcc0b2780 2023-09-13T06:12:50.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc3fff640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfcc0b2780 0x7fdfcc1f5da0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400e810 tx=0x7fdfb400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:50.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc2ffd640 1 -- 172.21.15.130:0/2783247084 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb400c8d0 con 0x7fdfcc0b2780 2023-09-13T06:12:50.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc2ffd640 1 -- 172.21.15.130:0/2783247084 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb400ca30 con 0x7fdfcc0b2780 2023-09-13T06:12:50.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc2ffd640 1 -- 172.21.15.130:0/2783247084 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb400cdc0 con 0x7fdfcc0b2780 2023-09-13T06:12:50.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfd0893640 1 -- 172.21.15.130:0/2783247084 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc142ff0 con 0x7fdfcc0b2780 2023-09-13T06:12:50.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfd0893640 1 -- 172.21.15.130:0/2783247084 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc1435b0 con 0x7fdfcc0b2780 2023-09-13T06:12:50.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfd0893640 1 -- 172.21.15.130:0/2783247084 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc0618a0 con 0x7fdfcc0b2780 2023-09-13T06:12:50.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.940+0000 7fdfc2ffd640 1 -- 172.21.15.130:0/2783247084 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdfb4013410 con 0x7fdfcc0b2780 2023-09-13T06:12:50.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.944+0000 7fdfc2ffd640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 0x7fdfac067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:50.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.944+0000 7fdfc2ffd640 1 -- 172.21.15.130:0/2783247084 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fdfb4082eb0 con 0x7fdfcc0b2780 2023-09-13T06:12:50.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.944+0000 7fdfca59c640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 0x7fdfac067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:50.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.944+0000 7fdfca59c640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 0x7fdfac067fe0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0ae000 tx=0x7fdfbc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:50.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:50.948+0000 7fdfc2ffd640 1 -- 172.21.15.130:0/2783247084 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdfb4050a80 con 0x7fdfcc0b2780 2023-09-13T06:12:51.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.096+0000 7fdfd0893640 1 -- 172.21.15.130:0/2783247084 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdfcc15d740 con 0x7fdfcc0b2780 2023-09-13T06:12:51.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.760+0000 7fdfc2ffd640 1 -- 172.21.15.130:0/2783247084 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v185) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdfb4009480 con 0x7fdfcc0b2780 2023-09-13T06:12:51.762 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' created 2023-09-13T06:12:51.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.768+0000 7fdfd0893640 1 -- 172.21.15.130:0/2783247084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 msgr2=0x7fdfac067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:51.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.768+0000 7fdfd0893640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 0x7fdfac067fe0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0ae000 tx=0x7fdfbc009040 comp rx=0 tx=0).stop 2023-09-13T06:12:51.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.768+0000 7fdfd0893640 1 -- 172.21.15.130:0/2783247084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfcc0b2780 msgr2=0x7fdfcc1f5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:51.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.768+0000 7fdfd0893640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfcc0b2780 0x7fdfcc1f5da0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400e810 tx=0x7fdfb400ecd0 comp rx=0 tx=0).stop 2023-09-13T06:12:51.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.772+0000 7fdfd0893640 1 -- 172.21.15.130:0/2783247084 shutdown_connections 2023-09-13T06:12:51.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.772+0000 7fdfd0893640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fdfac065b20 0x7fdfac067fe0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:51.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.772+0000 7fdfd0893640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfcc144d70 0x7fdfcc158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:51.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.772+0000 7fdfd0893640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfcc0b2780 0x7fdfcc1f5da0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:51.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.772+0000 7fdfd0893640 1 --2- 172.21.15.130:0/2783247084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfcc0b1460 0x7fdfcc13ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:51.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.772+0000 7fdfd0893640 1 -- 172.21.15.130:0/2783247084 >> 172.21.15.130:0/2783247084 conn(0x7fdfcc065990 msgr2=0x7fdfcc0acd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:51.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.772+0000 7fdfd0893640 1 -- 172.21.15.130:0/2783247084 shutdown_connections 2023-09-13T06:12:51.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.772+0000 7fdfd0893640 1 -- 172.21.15.130:0/2783247084 wait complete. 2023-09-13T06:12:51.792 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T06:12:51.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.932+0000 7fae99a8a640 1 Processor -- start 2023-09-13T06:12:51.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.932+0000 7fae99a8a640 1 -- start start 2023-09-13T06:12:51.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99a8a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fae94146d40 0x7fae940b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:51.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99a8a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94070e80 0x7fae940b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:51.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99a8a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae940b42a0 con 0x7fae940d3a80 2023-09-13T06:12:51.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99a8a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae940b4560 con 0x7fae94146d40 2023-09-13T06:12:51.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99a8a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae940b4840 con 0x7fae94070e80 2023-09-13T06:12:51.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae98a88640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fae94146d40 0x7fae940b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:51.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99289640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94070e80 0x7fae940b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:51.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99289640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94070e80 0x7fae940b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:46966/0 (socket says 172.21.15.130:46966) 2023-09-13T06:12:51.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99289640 1 -- 172.21.15.130:0/3051501467 learned_addr learned my addr 172.21.15.130:0/3051501467 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:51.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae98a88640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fae94146d40 0x7fae940b8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:40052/0 (socket says 172.21.15.130:40052) 2023-09-13T06:12:51.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99289640 1 -- 172.21.15.130:0/3051501467 >> v2:172.21.15.164:3300/0 conn(0x7fae94146d40 msgr2=0x7fae940b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:51.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99289640 1 --2- 172.21.15.130:0/3051501467 >> v2:172.21.15.164:3300/0 conn(0x7fae94146d40 0x7fae940b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:51.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99289640 1 -- 172.21.15.130:0/3051501467 >> v1:172.21.15.164:6789/0 conn(0x7fae940d3a80 legacy=0x7fae94070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:51.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae99289640 1 -- 172.21.15.130:0/3051501467 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae940b4b20 con 0x7fae94070e80 2023-09-13T06:12:51.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.936+0000 7fae98a88640 1 --2- 172.21.15.130:0/3051501467 >> v2:172.21.15.164:3300/0 conn(0x7fae94146d40 0x7fae940b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:12:51.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae99289640 1 --2- 172.21.15.130:0/3051501467 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94070e80 0x7fae940b5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae8c009e50 tx=0x7fae8c01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e1680d3366dd827 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:51.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae937fe640 1 -- 172.21.15.130:0/3051501467 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0a57f0 con 0x7fae94070e80 2023-09-13T06:12:51.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae937fe640 1 -- 172.21.15.130:0/3051501467 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c0a5950 con 0x7fae94070e80 2023-09-13T06:12:51.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae937fe640 1 -- 172.21.15.130:0/3051501467 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0a5ce0 con 0x7fae94070e80 2023-09-13T06:12:51.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae99a8a640 1 -- 172.21.15.130:0/3051501467 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94070e80 msgr2=0x7fae940b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:51.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae99a8a640 1 --2- 172.21.15.130:0/3051501467 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94070e80 0x7fae940b5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae8c009e50 tx=0x7fae8c01ca10 comp rx=0 tx=0).stop 2023-09-13T06:12:51.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae99a8a640 1 -- 172.21.15.130:0/3051501467 shutdown_connections 2023-09-13T06:12:51.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae99a8a640 1 --2- 172.21.15.130:0/3051501467 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94070e80 0x7fae940b5040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:51.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae99a8a640 1 --2- 172.21.15.130:0/3051501467 >> v2:172.21.15.164:3300/0 conn(0x7fae94146d40 0x7fae940b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:51.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae99a8a640 1 -- 172.21.15.130:0/3051501467 >> 172.21.15.130:0/3051501467 conn(0x7fae940d2f60 msgr2=0x7fae940d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:51.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae99a8a640 1 -- 172.21.15.130:0/3051501467 shutdown_connections 2023-09-13T06:12:51.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae99a8a640 1 -- 172.21.15.130:0/3051501467 wait complete. 2023-09-13T06:12:51.950 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae99a8a640 1 Processor -- start 2023-09-13T06:12:51.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.940+0000 7fae99a8a640 1 -- start start 2023-09-13T06:12:51.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae99a8a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae94070e80 0x7fae941554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:51.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae99a8a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae940d3a80 0x7fae9415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:51.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae99a8a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94146d40 0x7fae94144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:51.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae99a8a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae941550b0 con 0x7fae94070e80 2023-09-13T06:12:51.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae99a8a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae94145a00 con 0x7fae940d3a80 2023-09-13T06:12:51.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae99a8a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae941543e0 con 0x7fae94146d40 2023-09-13T06:12:51.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae98a88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae94070e80 0x7fae941554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:51.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae98a88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae94070e80 0x7fae941554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49488/0 (socket says 172.21.15.130:49488) 2023-09-13T06:12:51.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae98a88640 1 -- 172.21.15.130:0/228296793 learned_addr learned my addr 172.21.15.130:0/228296793 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:51.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae99289640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94146d40 0x7fae94144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:51.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae93fff640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae940d3a80 0x7fae9415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:51.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae98a88640 1 -- 172.21.15.130:0/228296793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94146d40 msgr2=0x7fae94144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:51.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae98a88640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94146d40 0x7fae94144620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:51.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae98a88640 1 -- 172.21.15.130:0/228296793 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae940d3a80 msgr2=0x7fae9415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:51.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae98a88640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae940d3a80 0x7fae9415fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:51.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae98a88640 1 -- 172.21.15.130:0/228296793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae88009420 con 0x7fae94070e80 2023-09-13T06:12:51.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae93fff640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae940d3a80 0x7fae9415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:51.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae98a88640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae94070e80 0x7fae941554d0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fae8800e9b0 tx=0x7fae8800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:51.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae917fa640 1 -- 172.21.15.130:0/228296793 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8800ca00 con 0x7fae94070e80 2023-09-13T06:12:51.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae917fa640 1 -- 172.21.15.130:0/228296793 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8800cb60 con 0x7fae94070e80 2023-09-13T06:12:51.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae917fa640 1 -- 172.21.15.130:0/228296793 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88013470 con 0x7fae94070e80 2023-09-13T06:12:51.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae99a8a640 1 -- 172.21.15.130:0/228296793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c009b30 con 0x7fae94070e80 2023-09-13T06:12:51.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae99a8a640 1 -- 172.21.15.130:0/228296793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae941549f0 con 0x7fae94070e80 2023-09-13T06:12:51.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.944+0000 7fae99a8a640 1 -- 172.21.15.130:0/228296793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae94155320 con 0x7fae94070e80 2023-09-13T06:12:51.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.948+0000 7fae917fa640 1 -- 172.21.15.130:0/228296793 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fae880135d0 con 0x7fae94070e80 2023-09-13T06:12:51.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.948+0000 7fae917fa640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae78065b20 0x7fae78067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:51.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.948+0000 7fae917fa640 1 -- 172.21.15.130:0/228296793 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fae88083440 con 0x7fae94070e80 2023-09-13T06:12:51.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.948+0000 7fae93fff640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae78065b20 0x7fae78067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:51.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.948+0000 7fae93fff640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae78065b20 0x7fae78067fe0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fae940b7530 tx=0x7fae80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:51.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:51.952+0000 7fae917fa640 1 -- 172.21.15.130:0/228296793 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fae88050ea0 con 0x7fae94070e80 2023-09-13T06:12:52.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.128+0000 7fae99a8a640 1 -- 172.21.15.130:0/228296793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fae940b7f60 con 0x7fae94070e80 2023-09-13T06:12:52.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.760+0000 7fae917fa640 1 -- 172.21.15.130:0/228296793 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v88) v1 ==== 174+0+0 (secure 0 0 0) 0x7fae880544c0 con 0x7fae94070e80 2023-09-13T06:12:52.761 INFO:teuthology.orchestra.run.smithi130.stderr:new fs with metadata pool 22 and data pool 23 2023-09-13T06:12:52.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 -- 172.21.15.130:0/228296793 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae78065b20 msgr2=0x7fae78067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:52.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae78065b20 0x7fae78067fe0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fae940b7530 tx=0x7fae80009040 comp rx=0 tx=0).stop 2023-09-13T06:12:52.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 -- 172.21.15.130:0/228296793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae94070e80 msgr2=0x7fae941554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:52.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae94070e80 0x7fae941554d0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fae8800e9b0 tx=0x7fae8800ee70 comp rx=0 tx=0).stop 2023-09-13T06:12:52.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 -- 172.21.15.130:0/228296793 shutdown_connections 2023-09-13T06:12:52.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fae78065b20 0x7fae78067fe0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:52.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae940d3a80 0x7fae9415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:52.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae94146d40 0x7fae94144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:52.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 --2- 172.21.15.130:0/228296793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae94070e80 0x7fae941554d0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:52.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 -- 172.21.15.130:0/228296793 >> 172.21.15.130:0/228296793 conn(0x7fae940d2f60 msgr2=0x7fae941430b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:52.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 -- 172.21.15.130:0/228296793 shutdown_connections 2023-09-13T06:12:52.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.764+0000 7fae99a8a640 1 -- 172.21.15.130:0/228296793 wait complete. 2023-09-13T06:12:52.788 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:12:52.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.928+0000 7f463f69e640 1 Processor -- start 2023-09-13T06:12:52.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463f69e640 1 -- start start 2023-09-13T06:12:52.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463f69e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4638159f20 0x7f46380ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:52.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463f69e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46380cdfc0 0x7f46380b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:52.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463f69e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46380ccfd0 con 0x7f46380b1610 2023-09-13T06:12:52.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463f69e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46380b00f0 con 0x7f4638159f20 2023-09-13T06:12:52.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463f69e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46380ce420 con 0x7f46380cdfc0 2023-09-13T06:12:52.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463d43a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4638159f20 0x7f46380ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:52.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463d43a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4638159f20 0x7f46380ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49504/0 (socket says 172.21.15.130:49504) 2023-09-13T06:12:52.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463d43a640 1 -- 172.21.15.130:0/2780358088 learned_addr learned my addr 172.21.15.130:0/2780358088 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:52.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463d43a640 1 -- 172.21.15.130:0/2780358088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46380cdfc0 msgr2=0x7f46380b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:52.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463cc39640 1 --2- 172.21.15.130:0/2780358088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46380cdfc0 0x7f46380b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:52.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463d43a640 1 --2- 172.21.15.130:0/2780358088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46380cdfc0 0x7f46380b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:52.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463d43a640 1 -- 172.21.15.130:0/2780358088 >> v1:172.21.15.164:6789/0 conn(0x7f46380b1610 legacy=0x7f46380ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:52.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463d43a640 1 -- 172.21.15.130:0/2780358088 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46380ced90 con 0x7f4638159f20 2023-09-13T06:12:52.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.932+0000 7f463cc39640 1 --2- 172.21.15.130:0/2780358088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46380cdfc0 0x7f46380b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:52.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f463d43a640 1 --2- 172.21.15.130:0/2780358088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4638159f20 0x7f46380ce7b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f4634009870 tx=0x7f463401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94715727e85f0d5f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:52.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f462ffff640 1 -- 172.21.15.130:0/2780358088 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340ac410 con 0x7f4638159f20 2023-09-13T06:12:52.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f462ffff640 1 -- 172.21.15.130:0/2780358088 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46340ac570 con 0x7f4638159f20 2023-09-13T06:12:52.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f462ffff640 1 -- 172.21.15.130:0/2780358088 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340ac900 con 0x7f4638159f20 2023-09-13T06:12:52.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f463f69e640 1 -- 172.21.15.130:0/2780358088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4638159f20 msgr2=0x7f46380ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:52.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f463f69e640 1 --2- 172.21.15.130:0/2780358088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4638159f20 0x7f46380ce7b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f4634009870 tx=0x7f463401c500 comp rx=0 tx=0).stop 2023-09-13T06:12:52.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f463f69e640 1 -- 172.21.15.130:0/2780358088 shutdown_connections 2023-09-13T06:12:52.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f463f69e640 1 --2- 172.21.15.130:0/2780358088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46380cdfc0 0x7f46380b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:52.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f463f69e640 1 --2- 172.21.15.130:0/2780358088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4638159f20 0x7f46380ce7b0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:52.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f463f69e640 1 -- 172.21.15.130:0/2780358088 >> 172.21.15.130:0/2780358088 conn(0x7f4638065990 msgr2=0x7f4638065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:52.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f463f69e640 1 -- 172.21.15.130:0/2780358088 shutdown_connections 2023-09-13T06:12:52.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f463f69e640 1 -- 172.21.15.130:0/2780358088 wait complete. 2023-09-13T06:12:52.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.936+0000 7f463f69e640 1 Processor -- start 2023-09-13T06:12:52.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463f69e640 1 -- start start 2023-09-13T06:12:52.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463f69e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46380b1610 0x7f463814f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:52.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463f69e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46380cdfc0 0x7f46380ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:52.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463f69e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4638159f20 0x7f463814f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:52.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463f69e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380caa60 con 0x7f4638159f20 2023-09-13T06:12:52.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463f69e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463814f750 con 0x7f46380b1610 2023-09-13T06:12:52.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463f69e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46380c7a50 con 0x7f46380cdfc0 2023-09-13T06:12:52.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463dc3b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4638159f20 0x7f463814f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:52.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463d43a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46380b1610 0x7f463814f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:52.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463d43a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46380b1610 0x7f463814f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:40060/0 (socket says 172.21.15.130:40060) 2023-09-13T06:12:52.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463cc39640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46380cdfc0 0x7f46380ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:52.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463d43a640 1 -- 172.21.15.130:0/1062588682 learned_addr learned my addr 172.21.15.130:0/1062588682 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:52.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463dc3b640 1 -- 172.21.15.130:0/1062588682 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46380cdfc0 msgr2=0x7f46380ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:52.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463dc3b640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46380cdfc0 0x7f46380ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:52.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463dc3b640 1 -- 172.21.15.130:0/1062588682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46380b1610 msgr2=0x7f463814f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:52.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463dc3b640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46380b1610 0x7f463814f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:52.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463dc3b640 1 -- 172.21.15.130:0/1062588682 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340094d0 con 0x7f4638159f20 2023-09-13T06:12:52.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463dc3b640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4638159f20 0x7f463814f210 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f463000c780 tx=0x7f463000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:52.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f462dffb640 1 -- 172.21.15.130:0/1062588682 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000a840 con 0x7f4638159f20 2023-09-13T06:12:52.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f462dffb640 1 -- 172.21.15.130:0/1062588682 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463000a9a0 con 0x7f4638159f20 2023-09-13T06:12:52.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463f69e640 1 -- 172.21.15.130:0/1062588682 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46381529f0 con 0x7f4638159f20 2023-09-13T06:12:52.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f462dffb640 1 -- 172.21.15.130:0/1062588682 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000ad90 con 0x7f4638159f20 2023-09-13T06:12:52.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463f69e640 1 -- 172.21.15.130:0/1062588682 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46380c7fd0 con 0x7f4638159f20 2023-09-13T06:12:52.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.940+0000 7f463f69e640 1 -- 172.21.15.130:0/1062588682 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46380c81f0 con 0x7f4638159f20 2023-09-13T06:12:52.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.944+0000 7f462dffb640 1 -- 172.21.15.130:0/1062588682 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4630012420 con 0x7f4638159f20 2023-09-13T06:12:52.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.944+0000 7f462dffb640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f461c065b20 0x7f461c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:52.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.944+0000 7f462dffb640 1 -- 172.21.15.130:0/1062588682 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4630083240 con 0x7f4638159f20 2023-09-13T06:12:52.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.944+0000 7f463d43a640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f461c065b20 0x7f461c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:52.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.944+0000 7f463d43a640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f461c065b20 0x7f461c067fe0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4634009870 tx=0x7f4634009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:52.949 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:52.948+0000 7f462dffb640 1 -- 172.21.15.130:0/1062588682 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4630050c40 con 0x7f4638159f20 2023-09-13T06:12:53.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.096+0000 7f463f69e640 1 -- 172.21.15.130:0/1062588682 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46380cd790 con 0x7f4638159f20 2023-09-13T06:12:53.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.096+0000 7f462dffb640 1 -- 172.21.15.130:0/1062588682 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+16621 (secure 0 0 0) 0x7f4630054260 con 0x7f4638159f20 2023-09-13T06:12:53.099 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:53.099 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":186,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:12:52.134721+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:12:49.873320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-09-13T06:12:51.142196+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:12:53.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 -- 172.21.15.130:0/1062588682 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f461c065b20 msgr2=0x7f461c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f461c065b20 0x7f461c067fe0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4634009870 tx=0x7f4634009040 comp rx=0 tx=0).stop 2023-09-13T06:12:53.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 -- 172.21.15.130:0/1062588682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4638159f20 msgr2=0x7f463814f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4638159f20 0x7f463814f210 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f463000c780 tx=0x7f463000cc40 comp rx=0 tx=0).stop 2023-09-13T06:12:53.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 -- 172.21.15.130:0/1062588682 shutdown_connections 2023-09-13T06:12:53.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f461c065b20 0x7f461c067fe0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4638159f20 0x7f463814f210 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46380cdfc0 0x7f46380ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 --2- 172.21.15.130:0/1062588682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46380b1610 0x7f463814f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 -- 172.21.15.130:0/1062588682 >> 172.21.15.130:0/1062588682 conn(0x7f4638065990 msgr2=0x7f4638154650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:53.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 -- 172.21.15.130:0/1062588682 shutdown_connections 2023-09-13T06:12:53.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.100+0000 7f463f69e640 1 -- 172.21.15.130:0/1062588682 wait complete. 2023-09-13T06:12:53.121 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:12:53.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.256+0000 7ff048d11640 1 Processor -- start 2023-09-13T06:12:53.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.256+0000 7ff048d11640 1 -- start start 2023-09-13T06:12:53.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff048d11640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff0440ae170 0x7ff0440cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:53.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff048d11640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0440cce60 con 0x7ff04415d9d0 2023-09-13T06:12:53.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff048d11640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0440cd140 con 0x7ff04415d5f0 2023-09-13T06:12:53.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff048d11640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440cd420 con 0x7ff0440ae170 2023-09-13T06:12:53.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff042d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff04415d9d0 0x7ff0440cdf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43074/0 (socket says 172.21.15.130:43074) 2023-09-13T06:12:53.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff042d9d640 1 -- 172.21.15.130:0/3129184959 learned_addr learned my addr 172.21.15.130:0/3129184959 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:53.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff039d9b640 1 --2- 172.21.15.130:0/3129184959 >> v2:172.21.15.130:3300/0 conn(0x7ff0440ae170 0x7ff0440cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:53.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff041d9b640 1 -- 172.21.15.130:0/3129184959 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48782919 0 0) 0x7ff0440cce60 con 0x7ff04415d9d0 2023-09-13T06:12:53.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff041d9b640 1 -- 172.21.15.130:0/3129184959 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff030003450 con 0x7ff04415d9d0 2023-09-13T06:12:53.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff039d9b640 1 -- 172.21.15.130:0/3129184959 >> v1:172.21.15.164:6789/0 conn(0x7ff04415d5f0 legacy=0x7ff0441591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff039d9b640 1 -- 172.21.15.130:0/3129184959 >> v1:172.21.15.130:6789/0 conn(0x7ff04415d9d0 legacy=0x7ff0440cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.260+0000 7ff039d9b640 1 -- 172.21.15.130:0/3129184959 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0440cd700 con 0x7ff0440ae170 2023-09-13T06:12:53.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff039d9b640 1 --2- 172.21.15.130:0/3129184959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0440ae170 0x7ff0440cc7f0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0097c0 tx=0x7ff02c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d34c0c0700e310 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:53.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff041d9b640 1 -- 172.21.15.130:0/3129184959 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0ab600 con 0x7ff0440ae170 2023-09-13T06:12:53.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff041d9b640 1 -- 172.21.15.130:0/3129184959 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c0a7050 con 0x7ff0440ae170 2023-09-13T06:12:53.263 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff041d9b640 1 -- 172.21.15.130:0/3129184959 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0ab980 con 0x7ff0440ae170 2023-09-13T06:12:53.264 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff048d11640 1 -- 172.21.15.130:0/3129184959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0440ae170 msgr2=0x7ff0440cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff048d11640 1 --2- 172.21.15.130:0/3129184959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0440ae170 0x7ff0440cc7f0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0097c0 tx=0x7ff02c01c3f0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff048d11640 1 -- 172.21.15.130:0/3129184959 shutdown_connections 2023-09-13T06:12:53.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff048d11640 1 --2- 172.21.15.130:0/3129184959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0440ae170 0x7ff0440cc7f0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff048d11640 1 -- 172.21.15.130:0/3129184959 >> 172.21.15.130:0/3129184959 conn(0x7ff044065990 msgr2=0x7ff044065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:53.265 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff048d11640 1 -- 172.21.15.130:0/3129184959 shutdown_connections 2023-09-13T06:12:53.266 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff048d11640 1 -- 172.21.15.130:0/3129184959 wait complete. 2023-09-13T06:12:53.267 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff048d11640 1 Processor -- start 2023-09-13T06:12:53.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.264+0000 7ff048d11640 1 -- start start 2023-09-13T06:12:53.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff048d11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0440ae170 0x7ff04414eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:53.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff048d11640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff04415d5f0 0x7ff044154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:53.268 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff048d11640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff04415d9d0 0x7ff04406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:53.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff048d11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04415af50 con 0x7ff0440ae170 2023-09-13T06:12:53.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff048d11640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0441538a0 con 0x7ff04415d5f0 2023-09-13T06:12:53.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff048d11640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff044153b80 con 0x7ff04415d9d0 2023-09-13T06:12:53.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff04259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0440ae170 0x7ff04414eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:53.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff04259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0440ae170 0x7ff04414eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49532/0 (socket says 172.21.15.130:49532) 2023-09-13T06:12:53.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff04259c640 1 -- 172.21.15.130:0/184217545 learned_addr learned my addr 172.21.15.130:0/184217545 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:53.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff039d9b640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff04415d5f0 0x7ff044154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:53.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff042d9d640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff04415d9d0 0x7ff04406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:53.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff04259c640 1 -- 172.21.15.130:0/184217545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff04415d9d0 msgr2=0x7ff04406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.270 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff04259c640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff04415d9d0 0x7ff04406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff04259c640 1 -- 172.21.15.130:0/184217545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff04415d5f0 msgr2=0x7ff044154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff04259c640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff04415d5f0 0x7ff044154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff04259c640 1 -- 172.21.15.130:0/184217545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c009420 con 0x7ff0440ae170 2023-09-13T06:12:53.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff039d9b640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff04415d5f0 0x7ff044154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:53.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff04259c640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0440ae170 0x7ff04414eec0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7ff03400c500 tx=0x7ff03400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:53.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff03b7fe640 1 -- 172.21.15.130:0/184217545 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034005220 con 0x7ff0440ae170 2023-09-13T06:12:53.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff03b7fe640 1 -- 172.21.15.130:0/184217545 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff034005380 con 0x7ff0440ae170 2023-09-13T06:12:53.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff048d11640 1 -- 172.21.15.130:0/184217545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff044153e60 con 0x7ff0440ae170 2023-09-13T06:12:53.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff03b7fe640 1 -- 172.21.15.130:0/184217545 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034007270 con 0x7ff0440ae170 2023-09-13T06:12:53.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff048d11640 1 -- 172.21.15.130:0/184217545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff044154420 con 0x7ff0440ae170 2023-09-13T06:12:53.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff048d11640 1 -- 172.21.15.130:0/184217545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04415b0e0 con 0x7ff0440ae170 2023-09-13T06:12:53.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.268+0000 7ff03b7fe640 1 -- 172.21.15.130:0/184217545 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff0340073d0 con 0x7ff0440ae170 2023-09-13T06:12:53.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.272+0000 7ff03b7fe640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff024065b20 0x7ff024067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:53.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.272+0000 7ff03b7fe640 1 -- 172.21.15.130:0/184217545 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff034082c20 con 0x7ff0440ae170 2023-09-13T06:12:53.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.272+0000 7ff039d9b640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff024065b20 0x7ff024067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:53.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.272+0000 7ff039d9b640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff024065b20 0x7ff024067fe0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0ad000 tx=0x7ff02c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:53.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.276+0000 7ff03b7fe640 1 -- 172.21.15.130:0/184217545 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff04415b0e0 con 0x7ff0440ae170 2023-09-13T06:12:53.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.424+0000 7ff048d11640 1 -- 172.21.15.130:0/184217545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff04415b090 con 0x7ff0440ae170 2023-09-13T06:12:53.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff03b7fe640 1 -- 172.21.15.130:0/184217545 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+16621 (secure 0 0 0) 0x7ff034050580 con 0x7ff0440ae170 2023-09-13T06:12:53.427 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:53.427 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":186,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:12:52.134721+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:12:49.873320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-09-13T06:12:51.142196+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:12:53.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 -- 172.21.15.130:0/184217545 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff024065b20 msgr2=0x7ff024067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff024065b20 0x7ff024067fe0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0ad000 tx=0x7ff02c008040 comp rx=0 tx=0).stop 2023-09-13T06:12:53.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 -- 172.21.15.130:0/184217545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0440ae170 msgr2=0x7ff04414eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0440ae170 0x7ff04414eec0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7ff03400c500 tx=0x7ff03400c9c0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 -- 172.21.15.130:0/184217545 shutdown_connections 2023-09-13T06:12:53.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff024065b20 0x7ff024067fe0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff04415d5f0 0x7ff044154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff04415d9d0 0x7ff04406bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 --2- 172.21.15.130:0/184217545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0440ae170 0x7ff04414eec0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 -- 172.21.15.130:0/184217545 >> 172.21.15.130:0/184217545 conn(0x7ff044065990 msgr2=0x7ff04406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:53.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 -- 172.21.15.130:0/184217545 shutdown_connections 2023-09-13T06:12:53.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.428+0000 7ff048d11640 1 -- 172.21.15.130:0/184217545 wait complete. 2023-09-13T06:12:53.449 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T06:12:53.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f648019f640 1 Processor -- start 2023-09-13T06:12:53.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f648019f640 1 -- start start 2023-09-13T06:12:53.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f648019f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f64780b1460 0x7f64780b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:53.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f648019f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f64780b2fd0 0x7f64780ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:53.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f648019f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64780cc850 con 0x7f647815a080 2023-09-13T06:12:53.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f648019f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64780b3420 con 0x7f64780b2fd0 2023-09-13T06:12:53.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f648019f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64780b0330 con 0x7f64780b1460 2023-09-13T06:12:53.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f647df3b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f647815a080 0x7f647815e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43090/0 (socket says 172.21.15.130:43090) 2023-09-13T06:12:53.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f647df3b640 1 -- 172.21.15.130:0/720376557 learned_addr learned my addr 172.21.15.130:0/720376557 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:53.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f647e73c640 1 --2- 172.21.15.130:0/720376557 >> v2:172.21.15.130:3300/0 conn(0x7f64780b2fd0 0x7f64780ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:53.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f647d73a640 1 --2- 172.21.15.130:0/720376557 >> v2:172.21.15.164:3300/0 conn(0x7f64780b1460 0x7f64780b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:53.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f647cf39640 1 -- 172.21.15.130:0/720376557 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061372725 0 0) 0x7f6474001120 con 0x7f647815a080 2023-09-13T06:12:53.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f647e73c640 1 -- 172.21.15.130:0/720376557 >> v2:172.21.15.164:3300/0 conn(0x7f64780b1460 msgr2=0x7f64780b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:53.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f647e73c640 1 --2- 172.21.15.130:0/720376557 >> v2:172.21.15.164:3300/0 conn(0x7f64780b1460 0x7f64780b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f647e73c640 1 -- 172.21.15.130:0/720376557 >> v1:172.21.15.130:6789/0 conn(0x7f647815a080 legacy=0x7f647815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.592+0000 7f647e73c640 1 -- 172.21.15.130:0/720376557 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64780cbcd0 con 0x7f64780b2fd0 2023-09-13T06:12:53.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f647e73c640 1 --2- 172.21.15.130:0/720376557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64780b2fd0 0x7f64780ccfe0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f64780671e0 tx=0x7f647001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31c510bc3ac5cfa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:53.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f647cf39640 1 -- 172.21.15.130:0/720376557 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64700a5620 con 0x7f64780b2fd0 2023-09-13T06:12:53.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f647cf39640 1 -- 172.21.15.130:0/720376557 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64700a5780 con 0x7f64780b2fd0 2023-09-13T06:12:53.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f647cf39640 1 -- 172.21.15.130:0/720376557 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64700a5b10 con 0x7f64780b2fd0 2023-09-13T06:12:53.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f648019f640 1 -- 172.21.15.130:0/720376557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64780b2fd0 msgr2=0x7f64780ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f648019f640 1 --2- 172.21.15.130:0/720376557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64780b2fd0 0x7f64780ccfe0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f64780671e0 tx=0x7f647001c850 comp rx=0 tx=0).stop 2023-09-13T06:12:53.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f648019f640 1 -- 172.21.15.130:0/720376557 shutdown_connections 2023-09-13T06:12:53.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f648019f640 1 --2- 172.21.15.130:0/720376557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64780b2fd0 0x7f64780ccfe0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f648019f640 1 --2- 172.21.15.130:0/720376557 >> v2:172.21.15.164:3300/0 conn(0x7f64780b1460 0x7f64780b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f648019f640 1 -- 172.21.15.130:0/720376557 >> 172.21.15.130:0/720376557 conn(0x7f6478065990 msgr2=0x7f6478065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:53.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f648019f640 1 -- 172.21.15.130:0/720376557 shutdown_connections 2023-09-13T06:12:53.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.596+0000 7f648019f640 1 -- 172.21.15.130:0/720376557 wait complete. 2023-09-13T06:12:53.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f648019f640 1 Processor -- start 2023-09-13T06:12:53.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f648019f640 1 -- start start 2023-09-13T06:12:53.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f648019f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64780b1460 0x7f6478147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:53.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f648019f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64780b2fd0 0x7f647815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:53.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f648019f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647815a080 0x7f647806c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:53.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f648019f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647815c410 con 0x7f64780b2fd0 2023-09-13T06:12:53.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f648019f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6478148200 con 0x7f647815a080 2023-09-13T06:12:53.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f648019f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6478148c30 con 0x7f64780b1460 2023-09-13T06:12:53.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f647d73a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64780b2fd0 0x7f647815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:53.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f647d73a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64780b2fd0 0x7f647815c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49550/0 (socket says 172.21.15.130:49550) 2023-09-13T06:12:53.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f647d73a640 1 -- 172.21.15.130:0/2452587764 learned_addr learned my addr 172.21.15.130:0/2452587764 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:53.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f647d73a640 1 -- 172.21.15.130:0/2452587764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64780b1460 msgr2=0x7f6478147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f647d73a640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64780b1460 0x7f6478147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f647d73a640 1 -- 172.21.15.130:0/2452587764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647815a080 msgr2=0x7f647806c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:53.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f647d73a640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647815a080 0x7f647806c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:53.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f647d73a640 1 -- 172.21.15.130:0/2452587764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6470009a70 con 0x7f64780b2fd0 2023-09-13T06:12:53.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f647d73a640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64780b2fd0 0x7f647815c830 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f646800e8a0 tx=0x7f646800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:53.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f646e7fc640 1 -- 172.21.15.130:0/2452587764 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468009510 con 0x7f64780b2fd0 2023-09-13T06:12:53.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f646e7fc640 1 -- 172.21.15.130:0/2452587764 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646800c940 con 0x7f64780b2fd0 2023-09-13T06:12:53.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f646e7fc640 1 -- 172.21.15.130:0/2452587764 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800ccb0 con 0x7f64780b2fd0 2023-09-13T06:12:53.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f648019f640 1 -- 172.21.15.130:0/2452587764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647815b790 con 0x7f64780b2fd0 2023-09-13T06:12:53.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.600+0000 7f648019f640 1 -- 172.21.15.130:0/2452587764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647815bd50 con 0x7f64780b2fd0 2023-09-13T06:12:53.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.604+0000 7f648019f640 1 -- 172.21.15.130:0/2452587764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647815c680 con 0x7f64780b2fd0 2023-09-13T06:12:53.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.604+0000 7f646e7fc640 1 -- 172.21.15.130:0/2452587764 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6468013470 con 0x7f64780b2fd0 2023-09-13T06:12:53.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.604+0000 7f646e7fc640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f645c065b20 0x7f645c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:53.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.604+0000 7f646e7fc640 1 -- 172.21.15.130:0/2452587764 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64680833f0 con 0x7f64780b2fd0 2023-09-13T06:12:53.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.604+0000 7f647df3b640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f645c065b20 0x7f645c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:53.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.604+0000 7f647df3b640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f645c065b20 0x7f645c067fe0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6474001640 tx=0x7f6474001320 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:53.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.608+0000 7f646e7fc640 1 -- 172.21.15.130:0/2452587764 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6468050d30 con 0x7f64780b2fd0 2023-09-13T06:12:53.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:53.788+0000 7f648019f640 1 -- 172.21.15.130:0/2452587764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f64780618a0 con 0x7f64780b2fd0 2023-09-13T06:12:54.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.792+0000 7f646e7fc640 1 -- 172.21.15.130:0/2452587764 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v91) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6468054350 con 0x7f64780b2fd0 2023-09-13T06:12:54.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 -- 172.21.15.130:0/2452587764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f645c065b20 msgr2=0x7f645c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:54.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f645c065b20 0x7f645c067fe0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6474001640 tx=0x7f6474001320 comp rx=0 tx=0).stop 2023-09-13T06:12:54.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 -- 172.21.15.130:0/2452587764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64780b2fd0 msgr2=0x7f647815c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:54.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64780b2fd0 0x7f647815c830 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f646800e8a0 tx=0x7f646800eca0 comp rx=0 tx=0).stop 2023-09-13T06:12:54.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 -- 172.21.15.130:0/2452587764 shutdown_connections 2023-09-13T06:12:54.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f645c065b20 0x7f645c067fe0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:54.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f647815a080 0x7f647806c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:54.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64780b2fd0 0x7f647815c830 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:54.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 --2- 172.21.15.130:0/2452587764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64780b1460 0x7f6478147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:54.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 -- 172.21.15.130:0/2452587764 >> 172.21.15.130:0/2452587764 conn(0x7f6478065990 msgr2=0x7f64780ad4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:54.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 -- 172.21.15.130:0/2452587764 shutdown_connections 2023-09-13T06:12:54.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.796+0000 7f648019f640 1 -- 172.21.15.130:0/2452587764 wait complete. 2023-09-13T06:12:54.818 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T06:12:54.818 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T06:12:54.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c4a0cb640 1 Processor -- start 2023-09-13T06:12:54.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c4a0cb640 1 -- start start 2023-09-13T06:12:54.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c4a0cb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2c440b2e90 0x7f2c440ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:54.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c4a0cb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2c440b1460 0x7f2c440b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:54.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c4a0cb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c440b2150 con 0x7f2c44144d70 2023-09-13T06:12:54.966 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c4a0cb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c440b2430 con 0x7f2c440b1460 2023-09-13T06:12:54.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c4a0cb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c440cedb0 con 0x7f2c440b2e90 2023-09-13T06:12:54.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c43fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2c440b1460 0x7f2c440b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:54.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c437fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2c44144d70 0x7f2c440b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43104/0 (socket says 172.21.15.130:43104) 2023-09-13T06:12:54.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c437fe640 1 -- 172.21.15.130:0/4046993782 learned_addr learned my addr 172.21.15.130:0/4046993782 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:54.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c43fff640 1 -- 172.21.15.130:0/4046993782 >> v2:172.21.15.164:3300/0 conn(0x7f2c440b2e90 msgr2=0x7f2c440ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:54.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c42ffd640 1 --2- 172.21.15.130:0/4046993782 >> v2:172.21.15.164:3300/0 conn(0x7f2c440b2e90 0x7f2c440ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:54.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c427fc640 1 -- 172.21.15.130:0/4046993782 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026155013 0 0) 0x7f2c440b2150 con 0x7f2c44144d70 2023-09-13T06:12:54.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c43fff640 1 --2- 172.21.15.130:0/4046993782 >> v2:172.21.15.164:3300/0 conn(0x7f2c440b2e90 0x7f2c440ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:54.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c43fff640 1 -- 172.21.15.130:0/4046993782 >> v1:172.21.15.130:6789/0 conn(0x7f2c44144d70 legacy=0x7f2c440b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:54.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c43fff640 1 -- 172.21.15.130:0/4046993782 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c440cdd90 con 0x7f2c440b1460 2023-09-13T06:12:54.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.964+0000 7f2c42ffd640 1 --2- 172.21.15.130:0/4046993782 >> v2:172.21.15.164:3300/0 conn(0x7f2c440b2e90 0x7f2c440ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:54.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c43fff640 1 --2- 172.21.15.130:0/4046993782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c440b1460 0x7f2c440b18f0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f2c44145150 tx=0x7f2c3c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0988a6fbb160df server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:54.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c427fc640 1 -- 172.21.15.130:0/4046993782 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0a58c0 con 0x7f2c440b1460 2023-09-13T06:12:54.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c427fc640 1 -- 172.21.15.130:0/4046993782 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c0a5a20 con 0x7f2c440b1460 2023-09-13T06:12:54.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c427fc640 1 -- 172.21.15.130:0/4046993782 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0a5db0 con 0x7f2c440b1460 2023-09-13T06:12:54.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/4046993782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c440b1460 msgr2=0x7f2c440b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:54.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c4a0cb640 1 --2- 172.21.15.130:0/4046993782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c440b1460 0x7f2c440b18f0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f2c44145150 tx=0x7f2c3c01c910 comp rx=0 tx=0).stop 2023-09-13T06:12:54.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/4046993782 shutdown_connections 2023-09-13T06:12:54.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c4a0cb640 1 --2- 172.21.15.130:0/4046993782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c440b1460 0x7f2c440b18f0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:54.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c4a0cb640 1 --2- 172.21.15.130:0/4046993782 >> v2:172.21.15.164:3300/0 conn(0x7f2c440b2e90 0x7f2c440ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:54.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/4046993782 >> 172.21.15.130:0/4046993782 conn(0x7f2c44065990 msgr2=0x7f2c44065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:54.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/4046993782 shutdown_connections 2023-09-13T06:12:54.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.968+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/4046993782 wait complete. 2023-09-13T06:12:54.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c4a0cb640 1 Processor -- start 2023-09-13T06:12:54.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c4a0cb640 1 -- start start 2023-09-13T06:12:54.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c4a0cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c440b1460 0x7f2c441421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:54.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c4a0cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c440b2e90 0x7f2c44139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:54.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c4a0cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c44144d70 0x7f2c44140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:54.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c4a0cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4413ee70 con 0x7f2c44144d70 2023-09-13T06:12:54.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c4a0cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4413fe00 con 0x7f2c440b2e90 2023-09-13T06:12:54.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c4a0cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44140010 con 0x7f2c440b1460 2023-09-13T06:12:54.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c43fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c44144d70 0x7f2c44140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:54.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c43fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c44144d70 0x7f2c44140dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49578/0 (socket says 172.21.15.130:49578) 2023-09-13T06:12:54.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c43fff640 1 -- 172.21.15.130:0/1126491514 learned_addr learned my addr 172.21.15.130:0/1126491514 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:54.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c42ffd640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c440b2e90 0x7f2c44139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:54.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c437fe640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c440b1460 0x7f2c441421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:54.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c43fff640 1 -- 172.21.15.130:0/1126491514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c440b1460 msgr2=0x7f2c441421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:54.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c43fff640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c440b1460 0x7f2c441421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:54.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c43fff640 1 -- 172.21.15.130:0/1126491514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c440b2e90 msgr2=0x7f2c44139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:54.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c43fff640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c440b2e90 0x7f2c44139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:54.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c43fff640 1 -- 172.21.15.130:0/1126491514 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c009a70 con 0x7f2c44144d70 2023-09-13T06:12:54.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c43fff640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c44144d70 0x7f2c44140dd0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c019520 tx=0x7f2c3c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:54.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c2bfff640 1 -- 172.21.15.130:0/1126491514 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0ad850 con 0x7f2c44144d70 2023-09-13T06:12:54.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c2bfff640 1 -- 172.21.15.130:0/1126491514 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c0ad9b0 con 0x7f2c44144d70 2023-09-13T06:12:54.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c2bfff640 1 -- 172.21.15.130:0/1126491514 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0add60 con 0x7f2c44144d70 2023-09-13T06:12:54.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/1126491514 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c441402f0 con 0x7f2c44144d70 2023-09-13T06:12:54.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.972+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/1126491514 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c441408b0 con 0x7f2c44144d70 2023-09-13T06:12:54.982 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.976+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/1126491514 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c44140aa0 con 0x7f2c44144d70 2023-09-13T06:12:54.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.976+0000 7f2c2bfff640 1 -- 172.21.15.130:0/1126491514 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2c3c0b4050 con 0x7f2c44144d70 2023-09-13T06:12:54.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.976+0000 7f2c2bfff640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c30065b20 0x7f2c30067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:54.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.976+0000 7f2c2bfff640 1 -- 172.21.15.130:0/1126491514 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c3c11e2b0 con 0x7f2c44144d70 2023-09-13T06:12:54.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.976+0000 7f2c437fe640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c30065b20 0x7f2c30067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:54.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.976+0000 7f2c437fe640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c30065b20 0x7f2c30067fe0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2c34000f70 tx=0x7f2c34007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:54.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:54.980+0000 7f2c2bfff640 1 -- 172.21.15.130:0/1126491514 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2c3c0ebd30 con 0x7f2c44144d70 2023-09-13T06:12:55.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.168+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/1126491514 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2c440618a0 con 0x7f2c44144d70 2023-09-13T06:12:55.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.796+0000 7f2c2bfff640 1 -- 172.21.15.130:0/1126491514 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v92) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2c3c0ef350 con 0x7f2c44144d70 2023-09-13T06:12:55.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.796+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/1126491514 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c30065b20 msgr2=0x7f2c30067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:55.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.796+0000 7f2c4a0cb640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c30065b20 0x7f2c30067fe0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2c34000f70 tx=0x7f2c34007df0 comp rx=0 tx=0).stop 2023-09-13T06:12:55.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.796+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/1126491514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c44144d70 msgr2=0x7f2c44140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:55.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.796+0000 7f2c4a0cb640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c44144d70 0x7f2c44140dd0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c019520 tx=0x7f2c3c0196b0 comp rx=0 tx=0).stop 2023-09-13T06:12:55.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.796+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/1126491514 shutdown_connections 2023-09-13T06:12:55.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.800+0000 7f2c4a0cb640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2c30065b20 0x7f2c30067fe0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:55.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.800+0000 7f2c4a0cb640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c440b2e90 0x7f2c44139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:55.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.800+0000 7f2c4a0cb640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c44144d70 0x7f2c44140dd0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:55.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.800+0000 7f2c4a0cb640 1 --2- 172.21.15.130:0/1126491514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c440b1460 0x7f2c441421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:55.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.800+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/1126491514 >> 172.21.15.130:0/1126491514 conn(0x7f2c44065990 msgr2=0x7f2c4415d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:55.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.800+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/1126491514 shutdown_connections 2023-09-13T06:12:55.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.800+0000 7f2c4a0cb640 1 -- 172.21.15.130:0/1126491514 wait complete. 2023-09-13T06:12:55.822 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T06:12:55.822 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:12:55.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.964+0000 7fec6c32c640 1 Processor -- start 2023-09-13T06:12:55.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.964+0000 7fec6c32c640 1 -- start start 2023-09-13T06:12:55.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.964+0000 7fec6c32c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fec64159f20 0x7fec640ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:55.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.964+0000 7fec6c32c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fec640cdfc0 0x7fec640b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:55.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.964+0000 7fec6c32c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec640ccfd0 con 0x7fec640b1610 2023-09-13T06:12:55.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.964+0000 7fec6c32c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec640b00f0 con 0x7fec64159f20 2023-09-13T06:12:55.967 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.964+0000 7fec6c32c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec640b11d0 con 0x7fec640cdfc0 2023-09-13T06:12:55.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.964+0000 7fec6a0c8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fec64159f20 0x7fec640ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:55.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.964+0000 7fec6a0c8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fec64159f20 0x7fec640ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49580/0 (socket says 172.21.15.130:49580) 2023-09-13T06:12:55.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.964+0000 7fec6a0c8640 1 -- 172.21.15.130:0/1469734838 learned_addr learned my addr 172.21.15.130:0/1469734838 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:55.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.968+0000 7fec698c7640 1 --2- 172.21.15.130:0/1469734838 >> v2:172.21.15.164:3300/0 conn(0x7fec640cdfc0 0x7fec640b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:55.968 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.968+0000 7fec6a0c8640 1 -- 172.21.15.130:0/1469734838 >> v2:172.21.15.164:3300/0 conn(0x7fec640cdfc0 msgr2=0x7fec640b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:55.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.968+0000 7fec6a0c8640 1 --2- 172.21.15.130:0/1469734838 >> v2:172.21.15.164:3300/0 conn(0x7fec640cdfc0 0x7fec640b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:55.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.968+0000 7fec6a0c8640 1 -- 172.21.15.130:0/1469734838 >> v1:172.21.15.164:6789/0 conn(0x7fec640b1610 legacy=0x7fec640ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:55.969 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.968+0000 7fec6a0c8640 1 -- 172.21.15.130:0/1469734838 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec640ced90 con 0x7fec64159f20 2023-09-13T06:12:55.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.968+0000 7fec6a0c8640 1 --2- 172.21.15.130:0/1469734838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec64159f20 0x7fec640ce7b0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fec640ccb10 tx=0x7fec6001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579204eb88bb4eff server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:55.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.968+0000 7fec690c6640 1 -- 172.21.15.130:0/1469734838 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600a7070 con 0x7fec64159f20 2023-09-13T06:12:55.970 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.968+0000 7fec690c6640 1 -- 172.21.15.130:0/1469734838 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec600ab430 con 0x7fec64159f20 2023-09-13T06:12:55.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.968+0000 7fec690c6640 1 -- 172.21.15.130:0/1469734838 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600ab7c0 con 0x7fec64159f20 2023-09-13T06:12:55.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.968+0000 7fec6c32c640 1 -- 172.21.15.130:0/1469734838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec64159f20 msgr2=0x7fec640ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:55.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.968+0000 7fec6c32c640 1 --2- 172.21.15.130:0/1469734838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec64159f20 0x7fec640ce7b0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fec640ccb10 tx=0x7fec6001c430 comp rx=0 tx=0).stop 2023-09-13T06:12:55.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 -- 172.21.15.130:0/1469734838 shutdown_connections 2023-09-13T06:12:55.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 --2- 172.21.15.130:0/1469734838 >> v2:172.21.15.164:3300/0 conn(0x7fec640cdfc0 0x7fec640b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:55.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 --2- 172.21.15.130:0/1469734838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec64159f20 0x7fec640ce7b0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:55.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 -- 172.21.15.130:0/1469734838 >> 172.21.15.130:0/1469734838 conn(0x7fec64065990 msgr2=0x7fec64065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:55.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 -- 172.21.15.130:0/1469734838 shutdown_connections 2023-09-13T06:12:55.973 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 -- 172.21.15.130:0/1469734838 wait complete. 2023-09-13T06:12:55.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 Processor -- start 2023-09-13T06:12:55.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 -- start start 2023-09-13T06:12:55.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec640b1610 0x7fec640ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:55.975 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec640cdfc0 0x7fec6413f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:55.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec64159f20 0x7fec6413fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:55.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6414f140 con 0x7fec640b1610 2023-09-13T06:12:55.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640cad50 con 0x7fec64159f20 2023-09-13T06:12:55.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6c32c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec64140470 con 0x7fec640cdfc0 2023-09-13T06:12:55.976 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6a0c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec640b1610 0x7fec640ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:55.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6a0c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec640b1610 0x7fec640ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49590/0 (socket says 172.21.15.130:49590) 2023-09-13T06:12:55.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6a0c8640 1 -- 172.21.15.130:0/3213916342 learned_addr learned my addr 172.21.15.130:0/3213916342 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:55.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6a0c8640 1 -- 172.21.15.130:0/3213916342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec640cdfc0 msgr2=0x7fec6413f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:55.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6a0c8640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec640cdfc0 0x7fec6413f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:55.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6a0c8640 1 -- 172.21.15.130:0/3213916342 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec64159f20 msgr2=0x7fec6413fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:55.977 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6a0c8640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec64159f20 0x7fec6413fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:55.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6a0c8640 1 -- 172.21.15.130:0/3213916342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec600094d0 con 0x7fec640b1610 2023-09-13T06:12:55.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec6a0c8640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec640b1610 0x7fec640ca810 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fec6001a060 tx=0x7fec600191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:55.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.972+0000 7fec5affd640 1 -- 172.21.15.130:0/3213916342 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600b4830 con 0x7fec640b1610 2023-09-13T06:12:55.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.976+0000 7fec5affd640 1 -- 172.21.15.130:0/3213916342 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec600b4990 con 0x7fec640b1610 2023-09-13T06:12:55.978 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.976+0000 7fec5affd640 1 -- 172.21.15.130:0/3213916342 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600b4d40 con 0x7fec640b1610 2023-09-13T06:12:55.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.976+0000 7fec6c32c640 1 -- 172.21.15.130:0/3213916342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6413f6e0 con 0x7fec640b1610 2023-09-13T06:12:55.979 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.976+0000 7fec6c32c640 1 -- 172.21.15.130:0/3213916342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6413cf30 con 0x7fec640b1610 2023-09-13T06:12:55.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.976+0000 7fec6c32c640 1 -- 172.21.15.130:0/3213916342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec640618a0 con 0x7fec640b1610 2023-09-13T06:12:55.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.976+0000 7fec5affd640 1 -- 172.21.15.130:0/3213916342 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fec600c0460 con 0x7fec640b1610 2023-09-13T06:12:55.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.976+0000 7fec5affd640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec48065b20 0x7fec48067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:55.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.976+0000 7fec5affd640 1 -- 172.21.15.130:0/3213916342 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec6011d5b0 con 0x7fec640b1610 2023-09-13T06:12:55.980 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.976+0000 7fec698c7640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec48065b20 0x7fec48067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:55.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.976+0000 7fec698c7640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec48065b20 0x7fec48067fe0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fec64164b80 tx=0x7fec54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:55.981 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:55.980+0000 7fec5affd640 1 -- 172.21.15.130:0/3213916342 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fec600eaf80 con 0x7fec640b1610 2023-09-13T06:12:56.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.160+0000 7fec6c32c640 1 -- 172.21.15.130:0/3213916342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec640cd850 con 0x7fec640b1610 2023-09-13T06:12:56.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.160+0000 7fec5affd640 1 -- 172.21.15.130:0/3213916342 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fec6011be60 con 0x7fec640b1610 2023-09-13T06:12:56.163 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:56.163 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/519371055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":519371055},{"type":"v1","addr":"172.21.15.130:6837","nonce":519371055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2464101241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2464101241},{"type":"v1","addr":"172.21.15.130:6836","nonce":2464101241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3066690343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3066690343},{"type":"v1","addr":"172.21.15.164:6833","nonce":3066690343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:12:52.135181+0000","modified":"2023-09-13T06:12:55.174886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8272":{"gid":8272,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2477052868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2477052868},{"type":"v1","addr":"172.21.15.164:6835","nonce":2477052868}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-09-13T06:12:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 92 2023-09-13T06:12:56.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 -- 172.21.15.130:0/3213916342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec48065b20 msgr2=0x7fec48067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec48065b20 0x7fec48067fe0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fec64164b80 tx=0x7fec54008040 comp rx=0 tx=0).stop 2023-09-13T06:12:56.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 -- 172.21.15.130:0/3213916342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec640b1610 msgr2=0x7fec640ca810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec640b1610 0x7fec640ca810 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fec6001a060 tx=0x7fec600191d0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 -- 172.21.15.130:0/3213916342 shutdown_connections 2023-09-13T06:12:56.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec48065b20 0x7fec48067fe0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec64159f20 0x7fec6413fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec640cdfc0 0x7fec6413f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 --2- 172.21.15.130:0/3213916342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec640b1610 0x7fec640ca810 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 -- 172.21.15.130:0/3213916342 >> 172.21.15.130:0/3213916342 conn(0x7fec64065990 msgr2=0x7fec64151d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:56.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 -- 172.21.15.130:0/3213916342 shutdown_connections 2023-09-13T06:12:56.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.164+0000 7fec6c32c640 1 -- 172.21.15.130:0/3213916342 wait complete. 2023-09-13T06:12:56.183 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:12:56.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f0443e56640 1 Processor -- start 2023-09-13T06:12:56.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f0443e56640 1 -- start start 2023-09-13T06:12:56.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f0443e56640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043c0d1750 0x7f043c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f0443e56640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f043c146f30 0x7f043c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f0443e56640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c0b63c0 con 0x7f043c0d1090 2023-09-13T06:12:56.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f0443e56640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c15dea0 con 0x7f043c146f30 2023-09-13T06:12:56.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f0443e56640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0d0c20 con 0x7f043c0d1750 2023-09-13T06:12:56.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f04413f1640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f043c0d1090 0x7f043c146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43118/0 (socket says 172.21.15.130:43118) 2023-09-13T06:12:56.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f04413f1640 1 -- 172.21.15.130:0/3972491233 learned_addr learned my addr 172.21.15.130:0/3972491233 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:56.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f04423f3640 1 --2- 172.21.15.130:0/3972491233 >> v2:172.21.15.164:3300/0 conn(0x7f043c146f30 0x7f043c0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:56.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f0441bf2640 1 --2- 172.21.15.130:0/3972491233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043c0d1750 0x7f043c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:56.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f0440bf0640 1 -- 172.21.15.130:0/3972491233 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118036823 0 0) 0x7f043c0b63c0 con 0x7f043c0d1090 2023-09-13T06:12:56.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f0440bf0640 1 -- 172.21.15.130:0/3972491233 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0428003530 con 0x7f043c0d1090 2023-09-13T06:12:56.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f04423f3640 1 -- 172.21.15.130:0/3972491233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043c0d1750 msgr2=0x7f043c15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:56.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f04423f3640 1 --2- 172.21.15.130:0/3972491233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043c0d1750 0x7f043c15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f04423f3640 1 -- 172.21.15.130:0/3972491233 >> v1:172.21.15.130:6789/0 conn(0x7f043c0d1090 legacy=0x7f043c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f04423f3640 1 -- 172.21.15.130:0/3972491233 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0b6610 con 0x7f043c146f30 2023-09-13T06:12:56.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.320+0000 7f0441bf2640 1 --2- 172.21.15.130:0/3972491233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043c0d1750 0x7f043c15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:12:56.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.324+0000 7f04423f3640 1 --2- 172.21.15.130:0/3972491233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f043c146f30 0x7f043c0b70f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0434009d90 tx=0x7f043401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d71d4ed92dd58484 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:56.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.324+0000 7f0440bf0640 1 -- 172.21.15.130:0/3972491233 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340a59e0 con 0x7f043c146f30 2023-09-13T06:12:56.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.324+0000 7f0440bf0640 1 -- 172.21.15.130:0/3972491233 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04340a5b40 con 0x7f043c146f30 2023-09-13T06:12:56.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.324+0000 7f0440bf0640 1 -- 172.21.15.130:0/3972491233 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340ad440 con 0x7f043c146f30 2023-09-13T06:12:56.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.324+0000 7f0443e56640 1 -- 172.21.15.130:0/3972491233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f043c146f30 msgr2=0x7f043c0b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.324+0000 7f0443e56640 1 --2- 172.21.15.130:0/3972491233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f043c146f30 0x7f043c0b70f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0434009d90 tx=0x7f043401c920 comp rx=0 tx=0).stop 2023-09-13T06:12:56.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.324+0000 7f0443e56640 1 -- 172.21.15.130:0/3972491233 shutdown_connections 2023-09-13T06:12:56.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.324+0000 7f0443e56640 1 --2- 172.21.15.130:0/3972491233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f043c146f30 0x7f043c0b70f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.324+0000 7f0443e56640 1 --2- 172.21.15.130:0/3972491233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043c0d1750 0x7f043c15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.324+0000 7f0443e56640 1 -- 172.21.15.130:0/3972491233 >> 172.21.15.130:0/3972491233 conn(0x7f043c06f170 msgr2=0x7f043c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:56.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f0443e56640 1 -- 172.21.15.130:0/3972491233 shutdown_connections 2023-09-13T06:12:56.329 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f0443e56640 1 -- 172.21.15.130:0/3972491233 wait complete. 2023-09-13T06:12:56.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f0443e56640 1 Processor -- start 2023-09-13T06:12:56.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f0443e56640 1 -- start start 2023-09-13T06:12:56.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f0443e56640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043c0d1090 0x7f043c0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f0443e56640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c0d1750 0x7f043c0caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f0443e56640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f043c146f30 0x7f043c15cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f0443e56640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0cb4c0 con 0x7f043c0d1750 2023-09-13T06:12:56.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f0443e56640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0c8f80 con 0x7f043c146f30 2023-09-13T06:12:56.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f0443e56640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0c9260 con 0x7f043c0d1090 2023-09-13T06:12:56.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f04413f1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c0d1750 0x7f043c0caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:56.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f04413f1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c0d1750 0x7f043c0caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49598/0 (socket says 172.21.15.130:49598) 2023-09-13T06:12:56.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f04413f1640 1 -- 172.21.15.130:0/3685621541 learned_addr learned my addr 172.21.15.130:0/3685621541 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:56.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f04423f3640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f043c146f30 0x7f043c15cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:56.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f0441bf2640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043c0d1090 0x7f043c0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:56.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f04413f1640 1 -- 172.21.15.130:0/3685621541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043c0d1090 msgr2=0x7f043c0c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f04413f1640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043c0d1090 0x7f043c0c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f04413f1640 1 -- 172.21.15.130:0/3685621541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f043c146f30 msgr2=0x7f043c15cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f04413f1640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f043c146f30 0x7f043c15cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f04413f1640 1 -- 172.21.15.130:0/3685621541 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0438009420 con 0x7f043c0d1750 2023-09-13T06:12:56.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.328+0000 7f04413f1640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c0d1750 0x7f043c0caf80 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c450 tx=0x7f042c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:56.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.332+0000 7f04327fc640 1 -- 172.21.15.130:0/3685621541 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c005cf0 con 0x7f043c0d1750 2023-09-13T06:12:56.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.332+0000 7f04327fc640 1 -- 172.21.15.130:0/3685621541 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c005e50 con 0x7f043c0d1750 2023-09-13T06:12:56.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.332+0000 7f04327fc640 1 -- 172.21.15.130:0/3685621541 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c007290 con 0x7f043c0d1750 2023-09-13T06:12:56.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.332+0000 7f0443e56640 1 -- 172.21.15.130:0/3685621541 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0434009a70 con 0x7f043c0d1750 2023-09-13T06:12:56.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.332+0000 7f0443e56640 1 -- 172.21.15.130:0/3685621541 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c0b7e40 con 0x7f043c0d1750 2023-09-13T06:12:56.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.332+0000 7f0443e56640 1 -- 172.21.15.130:0/3685621541 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c0618a0 con 0x7f043c0d1750 2023-09-13T06:12:56.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.332+0000 7f04327fc640 1 -- 172.21.15.130:0/3685621541 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f042c0073f0 con 0x7f043c0d1750 2023-09-13T06:12:56.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.332+0000 7f04327fc640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0420065b20 0x7f0420067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.332+0000 7f04327fc640 1 -- 172.21.15.130:0/3685621541 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f042c0828a0 con 0x7f043c0d1750 2023-09-13T06:12:56.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.332+0000 7f0441bf2640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0420065b20 0x7f0420067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:56.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.332+0000 7f0441bf2640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0420065b20 0x7f0420067fe0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0438009cf0 tx=0x7f0438009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:56.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.336+0000 7f04327fc640 1 -- 172.21.15.130:0/3685621541 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f042c050200 con 0x7f043c0d1750 2023-09-13T06:12:56.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.488+0000 7f0443e56640 1 -- 172.21.15.130:0/3685621541 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f043c0b86c0 con 0x7f043c0d1750 2023-09-13T06:12:56.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.488+0000 7f04327fc640 1 -- 172.21.15.130:0/3685621541 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f042c017070 con 0x7f043c0d1750 2023-09-13T06:12:56.489 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:56.489 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":187,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:12:53.483867+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:12:49.873320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-09-13T06:12:51.142196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:12:56.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 -- 172.21.15.130:0/3685621541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0420065b20 msgr2=0x7f0420067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0420065b20 0x7f0420067fe0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0438009cf0 tx=0x7f0438009190 comp rx=0 tx=0).stop 2023-09-13T06:12:56.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 -- 172.21.15.130:0/3685621541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c0d1750 msgr2=0x7f043c0caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c0d1750 0x7f043c0caf80 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c450 tx=0x7f042c00c910 comp rx=0 tx=0).stop 2023-09-13T06:12:56.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 -- 172.21.15.130:0/3685621541 shutdown_connections 2023-09-13T06:12:56.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0420065b20 0x7f0420067fe0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f043c146f30 0x7f043c15cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c0d1750 0x7f043c0caf80 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 --2- 172.21.15.130:0/3685621541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043c0d1090 0x7f043c0c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 -- 172.21.15.130:0/3685621541 >> 172.21.15.130:0/3685621541 conn(0x7f043c06f170 msgr2=0x7f043c13f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:56.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 -- 172.21.15.130:0/3685621541 shutdown_connections 2023-09-13T06:12:56.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.492+0000 7f0443e56640 1 -- 172.21.15.130:0/3685621541 wait complete. 2023-09-13T06:12:56.510 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T06:12:56.511 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:12:56.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.648+0000 7fcb96c0b640 1 Processor -- start 2023-09-13T06:12:56.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.648+0000 7fcb96c0b640 1 -- start start 2023-09-13T06:12:56.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb96c0b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcb901436e0 0x7fcb900ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb96c0b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcb90070d60 0x7fcb90160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb96c0b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9006f640 con 0x7fcb900acd80 2023-09-13T06:12:56.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb96c0b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9006f890 con 0x7fcb90070d60 2023-09-13T06:12:56.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb96c0b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9006fb70 con 0x7fcb901436e0 2023-09-13T06:12:56.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb951a8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcb90070d60 0x7fcb90160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:56.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb87fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fcb900acd80 0x7fcb90070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43126/0 (socket says 172.21.15.130:43126) 2023-09-13T06:12:56.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb87fff640 1 -- 172.21.15.130:0/2926278163 learned_addr learned my addr 172.21.15.130:0/2926278163 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:56.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb949a7640 1 --2- 172.21.15.130:0/2926278163 >> v2:172.21.15.164:3300/0 conn(0x7fcb901436e0 0x7fcb900ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:56.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb951a8640 1 -- 172.21.15.130:0/2926278163 >> v2:172.21.15.164:3300/0 conn(0x7fcb901436e0 msgr2=0x7fcb900ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:56.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb951a8640 1 --2- 172.21.15.130:0/2926278163 >> v2:172.21.15.164:3300/0 conn(0x7fcb901436e0 0x7fcb900ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb951a8640 1 -- 172.21.15.130:0/2926278163 >> v1:172.21.15.130:6789/0 conn(0x7fcb900acd80 legacy=0x7fcb90070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb877fe640 1 -- 172.21.15.130:0/2926278163 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597421802 0 0) 0x7fcb9006f640 con 0x7fcb900acd80 2023-09-13T06:12:56.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.652+0000 7fcb951a8640 1 -- 172.21.15.130:0/2926278163 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9006fe50 con 0x7fcb90070d60 2023-09-13T06:12:56.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb951a8640 1 --2- 172.21.15.130:0/2926278163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb90070d60 0x7fcb90160eb0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fcb9006e9f0 tx=0x7fcb8801c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f3f5f5e362a764 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:56.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb877fe640 1 -- 172.21.15.130:0/2926278163 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90146e10 con 0x7fcb90070d60 2023-09-13T06:12:56.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb877fe640 1 -- 172.21.15.130:0/2926278163 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb880a57c0 con 0x7fcb90070d60 2023-09-13T06:12:56.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb877fe640 1 -- 172.21.15.130:0/2926278163 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb880a5b50 con 0x7fcb90070d60 2023-09-13T06:12:56.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb96c0b640 1 -- 172.21.15.130:0/2926278163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb90070d60 msgr2=0x7fcb90160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb96c0b640 1 --2- 172.21.15.130:0/2926278163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb90070d60 0x7fcb90160eb0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fcb9006e9f0 tx=0x7fcb8801c7f0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb96c0b640 1 -- 172.21.15.130:0/2926278163 shutdown_connections 2023-09-13T06:12:56.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb96c0b640 1 --2- 172.21.15.130:0/2926278163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb90070d60 0x7fcb90160eb0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb96c0b640 1 --2- 172.21.15.130:0/2926278163 >> v2:172.21.15.164:3300/0 conn(0x7fcb901436e0 0x7fcb900ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb96c0b640 1 -- 172.21.15.130:0/2926278163 >> 172.21.15.130:0/2926278163 conn(0x7fcb900b0bc0 msgr2=0x7fcb900b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:56.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb96c0b640 1 -- 172.21.15.130:0/2926278163 shutdown_connections 2023-09-13T06:12:56.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb96c0b640 1 -- 172.21.15.130:0/2926278163 wait complete. 2023-09-13T06:12:56.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb96c0b640 1 Processor -- start 2023-09-13T06:12:56.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.656+0000 7fcb96c0b640 1 -- start start 2023-09-13T06:12:56.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb96c0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb90070d60 0x7fcb90166a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb96c0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb900acd80 0x7fcb9013f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb96c0b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb901436e0 0x7fcb90143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb96c0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9015dcf0 con 0x7fcb900acd80 2023-09-13T06:12:56.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb96c0b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9015f9a0 con 0x7fcb901436e0 2023-09-13T06:12:56.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb96c0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9015fc80 con 0x7fcb90070d60 2023-09-13T06:12:56.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb87fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb900acd80 0x7fcb9013f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:56.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb87fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb900acd80 0x7fcb9013f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49626/0 (socket says 172.21.15.130:49626) 2023-09-13T06:12:56.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb87fff640 1 -- 172.21.15.130:0/206630470 learned_addr learned my addr 172.21.15.130:0/206630470 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:56.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb87fff640 1 -- 172.21.15.130:0/206630470 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb90070d60 msgr2=0x7fcb90166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb87fff640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb90070d60 0x7fcb90166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb87fff640 1 -- 172.21.15.130:0/206630470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb901436e0 msgr2=0x7fcb90143bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb951a8640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb901436e0 0x7fcb90143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:56.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb87fff640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb901436e0 0x7fcb90143bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb87fff640 1 -- 172.21.15.130:0/206630470 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88009a70 con 0x7fcb900acd80 2023-09-13T06:12:56.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb87fff640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb900acd80 0x7fcb9013f690 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000c4b0 tx=0x7fcb8000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:56.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb857fa640 1 -- 172.21.15.130:0/206630470 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800074e0 con 0x7fcb900acd80 2023-09-13T06:12:56.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb857fa640 1 -- 172.21.15.130:0/206630470 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb80007660 con 0x7fcb900acd80 2023-09-13T06:12:56.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb857fa640 1 -- 172.21.15.130:0/206630470 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80004a30 con 0x7fcb900acd80 2023-09-13T06:12:56.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb96c0b640 1 -- 172.21.15.130:0/206630470 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9015ff60 con 0x7fcb900acd80 2023-09-13T06:12:56.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb96c0b640 1 -- 172.21.15.130:0/206630470 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb90162ca0 con 0x7fcb900acd80 2023-09-13T06:12:56.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb96c0b640 1 -- 172.21.15.130:0/206630470 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9015de30 con 0x7fcb900acd80 2023-09-13T06:12:56.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.660+0000 7fcb857fa640 1 -- 172.21.15.130:0/206630470 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcb80004b90 con 0x7fcb900acd80 2023-09-13T06:12:56.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.664+0000 7fcb857fa640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb7c065b20 0x7fcb7c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:56.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.664+0000 7fcb857fa640 1 -- 172.21.15.130:0/206630470 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb80082590 con 0x7fcb900acd80 2023-09-13T06:12:56.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.664+0000 7fcb949a7640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb7c065b20 0x7fcb7c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:56.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.664+0000 7fcb949a7640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb7c065b20 0x7fcb7c067fe0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c006aa0 tx=0x7fcb8c006a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:56.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.668+0000 7fcb857fa640 1 -- 172.21.15.130:0/206630470 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcb9015de30 con 0x7fcb900acd80 2023-09-13T06:12:56.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.812+0000 7fcb96c0b640 1 -- 172.21.15.130:0/206630470 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb9015de30 con 0x7fcb7c065b20 2023-09-13T06:12:56.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.820+0000 7fcb857fa640 1 -- 172.21.15.130:0/206630470 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284889 (secure 0 0 0) 0x7fcb9015de30 con 0x7fcb7c065b20 2023-09-13T06:12:56.824 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:56.826 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:12:56.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 -- 172.21.15.130:0/206630470 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb7c065b20 msgr2=0x7fcb7c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb7c065b20 0x7fcb7c067fe0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c006aa0 tx=0x7fcb8c006a30 comp rx=0 tx=0).stop 2023-09-13T06:12:56.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 -- 172.21.15.130:0/206630470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb900acd80 msgr2=0x7fcb9013f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:56.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb900acd80 0x7fcb9013f690 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000c4b0 tx=0x7fcb8000c970 comp rx=0 tx=0).stop 2023-09-13T06:12:56.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 -- 172.21.15.130:0/206630470 shutdown_connections 2023-09-13T06:12:56.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcb7c065b20 0x7fcb7c067fe0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb901436e0 0x7fcb90143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb900acd80 0x7fcb9013f690 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 --2- 172.21.15.130:0/206630470 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcb90070d60 0x7fcb90166a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:56.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 -- 172.21.15.130:0/206630470 >> 172.21.15.130:0/206630470 conn(0x7fcb900b0bc0 msgr2=0x7fcb900b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:56.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 -- 172.21.15.130:0/206630470 shutdown_connections 2023-09-13T06:12:56.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:56.824+0000 7fcb96c0b640 1 -- 172.21.15.130:0/206630470 wait complete. 2023-09-13T06:12:56.844 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":530,"stamp":"2023-09-13T06:12:56.691574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553133,"statfs":{"total":1600000000,"available":1590408982,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.938520"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494382+0000","last_change":"2023-09-13T06:12:52.498429+0000","last_active":"2023-09-13T06:12:53.494382+0000","last_peered":"2023-09-13T06:12:53.494382+0000","last_clean":"2023-09-13T06:12:53.494382+0000","last_became_active":"2023-09-13T06:12:52.497835+0000","last_became_peered":"2023-09-13T06:12:52.497835+0000","last_unstale":"2023-09-13T06:12:53.494382+0000","last_undegraded":"2023-09-13T06:12:53.494382+0000","last_fullsized":"2023-09-13T06:12:53.494382+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:52:47.863828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.499420+0000","last_change":"2023-09-13T06:12:52.499336+0000","last_active":"2023-09-13T06:12:52.499420+0000","last_peered":"2023-09-13T06:12:52.499420+0000","last_clean":"2023-09-13T06:12:52.499420+0000","last_became_active":"2023-09-13T06:12:52.499070+0000","last_became_peered":"2023-09-13T06:12:52.499070+0000","last_unstale":"2023-09-13T06:12:52.499420+0000","last_undegraded":"2023-09-13T06:12:52.499420+0000","last_fullsized":"2023-09-13T06:12:52.499420+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:50:17.671842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.497995+0000","last_change":"2023-09-13T06:12:52.497894+0000","last_active":"2023-09-13T06:12:52.497995+0000","last_peered":"2023-09-13T06:12:52.497995+0000","last_clean":"2023-09-13T06:12:52.497995+0000","last_became_active":"2023-09-13T06:12:52.497358+0000","last_became_peered":"2023-09-13T06:12:52.497358+0000","last_unstale":"2023-09-13T06:12:52.497995+0000","last_undegraded":"2023-09-13T06:12:52.497995+0000","last_fullsized":"2023-09-13T06:12:52.497995+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:08:25.535593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492661+0000","last_change":"2023-09-13T06:12:52.494659+0000","last_active":"2023-09-13T06:12:53.492661+0000","last_peered":"2023-09-13T06:12:53.492661+0000","last_clean":"2023-09-13T06:12:53.492661+0000","last_became_active":"2023-09-13T06:12:52.494355+0000","last_became_peered":"2023-09-13T06:12:52.494355+0000","last_unstale":"2023-09-13T06:12:53.492661+0000","last_undegraded":"2023-09-13T06:12:53.492661+0000","last_fullsized":"2023-09-13T06:12:53.492661+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:03:00.930720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498653+0000","last_change":"2023-09-13T06:12:52.498585+0000","last_active":"2023-09-13T06:12:52.498653+0000","last_peered":"2023-09-13T06:12:52.498653+0000","last_clean":"2023-09-13T06:12:52.498653+0000","last_became_active":"2023-09-13T06:12:52.498363+0000","last_became_peered":"2023-09-13T06:12:52.498363+0000","last_unstale":"2023-09-13T06:12:52.498653+0000","last_undegraded":"2023-09-13T06:12:52.498653+0000","last_fullsized":"2023-09-13T06:12:52.498653+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:43:44.083375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493651+0000","last_change":"2023-09-13T06:12:52.494206+0000","last_active":"2023-09-13T06:12:53.493651+0000","last_peered":"2023-09-13T06:12:53.493651+0000","last_clean":"2023-09-13T06:12:53.493651+0000","last_became_active":"2023-09-13T06:12:52.493845+0000","last_became_peered":"2023-09-13T06:12:52.493845+0000","last_unstale":"2023-09-13T06:12:53.493651+0000","last_undegraded":"2023-09-13T06:12:53.493651+0000","last_fullsized":"2023-09-13T06:12:53.493651+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:31:32.314431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.493161+0000","last_change":"2023-09-13T06:12:52.493101+0000","last_active":"2023-09-13T06:12:52.493161+0000","last_peered":"2023-09-13T06:12:52.493161+0000","last_clean":"2023-09-13T06:12:52.493161+0000","last_became_active":"2023-09-13T06:12:52.492438+0000","last_became_peered":"2023-09-13T06:12:52.492438+0000","last_unstale":"2023-09-13T06:12:52.493161+0000","last_undegraded":"2023-09-13T06:12:52.493161+0000","last_fullsized":"2023-09-13T06:12:52.493161+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:40.002752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.496955+0000","last_change":"2023-09-13T06:12:52.496883+0000","last_active":"2023-09-13T06:12:52.496955+0000","last_peered":"2023-09-13T06:12:52.496955+0000","last_clean":"2023-09-13T06:12:52.496955+0000","last_became_active":"2023-09-13T06:12:52.496630+0000","last_became_peered":"2023-09-13T06:12:52.496630+0000","last_unstale":"2023-09-13T06:12:52.496955+0000","last_undegraded":"2023-09-13T06:12:52.496955+0000","last_fullsized":"2023-09-13T06:12:52.496955+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:02.392939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.497712+0000","last_change":"2023-09-13T06:12:52.497590+0000","last_active":"2023-09-13T06:12:52.497712+0000","last_peered":"2023-09-13T06:12:52.497712+0000","last_clean":"2023-09-13T06:12:52.497712+0000","last_became_active":"2023-09-13T06:12:52.497349+0000","last_became_peered":"2023-09-13T06:12:52.497349+0000","last_unstale":"2023-09-13T06:12:52.497712+0000","last_undegraded":"2023-09-13T06:12:52.497712+0000","last_fullsized":"2023-09-13T06:12:52.497712+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:15:13.845400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.500893+0000","last_change":"2023-09-13T06:12:52.500825+0000","last_active":"2023-09-13T06:12:52.500893+0000","last_peered":"2023-09-13T06:12:52.500893+0000","last_clean":"2023-09-13T06:12:52.500893+0000","last_became_active":"2023-09-13T06:12:52.500608+0000","last_became_peered":"2023-09-13T06:12:52.500608+0000","last_unstale":"2023-09-13T06:12:52.500893+0000","last_undegraded":"2023-09-13T06:12:52.500893+0000","last_fullsized":"2023-09-13T06:12:52.500893+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:52:18.096863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.496974+0000","last_change":"2023-09-13T06:12:52.496892+0000","last_active":"2023-09-13T06:12:52.496974+0000","last_peered":"2023-09-13T06:12:52.496974+0000","last_clean":"2023-09-13T06:12:52.496974+0000","last_became_active":"2023-09-13T06:12:52.496656+0000","last_became_peered":"2023-09-13T06:12:52.496656+0000","last_unstale":"2023-09-13T06:12:52.496974+0000","last_undegraded":"2023-09-13T06:12:52.496974+0000","last_fullsized":"2023-09-13T06:12:52.496974+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:35:26.102771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.497592+0000","last_change":"2023-09-13T06:12:52.497395+0000","last_active":"2023-09-13T06:12:52.497592+0000","last_peered":"2023-09-13T06:12:52.497592+0000","last_clean":"2023-09-13T06:12:52.497592+0000","last_became_active":"2023-09-13T06:12:52.497061+0000","last_became_peered":"2023-09-13T06:12:52.497061+0000","last_unstale":"2023-09-13T06:12:52.497592+0000","last_undegraded":"2023-09-13T06:12:52.497592+0000","last_fullsized":"2023-09-13T06:12:52.497592+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:51:48.126810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498160+0000","last_change":"2023-09-13T06:12:52.498091+0000","last_active":"2023-09-13T06:12:52.498160+0000","last_peered":"2023-09-13T06:12:52.498160+0000","last_clean":"2023-09-13T06:12:52.498160+0000","last_became_active":"2023-09-13T06:12:52.497673+0000","last_became_peered":"2023-09-13T06:12:52.497673+0000","last_unstale":"2023-09-13T06:12:52.498160+0000","last_undegraded":"2023-09-13T06:12:52.498160+0000","last_fullsized":"2023-09-13T06:12:52.498160+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:13.923974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.504055+0000","last_change":"2023-09-13T06:12:52.503983+0000","last_active":"2023-09-13T06:12:52.504055+0000","last_peered":"2023-09-13T06:12:52.504055+0000","last_clean":"2023-09-13T06:12:52.504055+0000","last_became_active":"2023-09-13T06:12:52.503240+0000","last_became_peered":"2023-09-13T06:12:52.503240+0000","last_unstale":"2023-09-13T06:12:52.504055+0000","last_undegraded":"2023-09-13T06:12:52.504055+0000","last_fullsized":"2023-09-13T06:12:52.504055+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:31:32.314431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494346+0000","last_change":"2023-09-13T06:12:52.498831+0000","last_active":"2023-09-13T06:12:53.494346+0000","last_peered":"2023-09-13T06:12:53.494346+0000","last_clean":"2023-09-13T06:12:53.494346+0000","last_became_active":"2023-09-13T06:12:52.498418+0000","last_became_peered":"2023-09-13T06:12:52.498418+0000","last_unstale":"2023-09-13T06:12:53.494346+0000","last_undegraded":"2023-09-13T06:12:53.494346+0000","last_fullsized":"2023-09-13T06:12:53.494346+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:40:49.596156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.499521+0000","last_change":"2023-09-13T06:12:52.498901+0000","last_active":"2023-09-13T06:12:52.499521+0000","last_peered":"2023-09-13T06:12:52.499521+0000","last_clean":"2023-09-13T06:12:52.499521+0000","last_became_active":"2023-09-13T06:12:52.498495+0000","last_became_peered":"2023-09-13T06:12:52.498495+0000","last_unstale":"2023-09-13T06:12:52.499521+0000","last_undegraded":"2023-09-13T06:12:52.499521+0000","last_fullsized":"2023-09-13T06:12:52.499521+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:43:25.145008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493618+0000","last_change":"2023-09-13T06:12:52.497316+0000","last_active":"2023-09-13T06:12:53.493618+0000","last_peered":"2023-09-13T06:12:53.493618+0000","last_clean":"2023-09-13T06:12:53.493618+0000","last_became_active":"2023-09-13T06:12:52.497095+0000","last_became_peered":"2023-09-13T06:12:52.497095+0000","last_unstale":"2023-09-13T06:12:53.493618+0000","last_undegraded":"2023-09-13T06:12:53.493618+0000","last_fullsized":"2023-09-13T06:12:53.493618+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:25:07.888230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.487892+0000","last_change":"2023-09-13T06:12:52.487825+0000","last_active":"2023-09-13T06:12:52.487892+0000","last_peered":"2023-09-13T06:12:52.487892+0000","last_clean":"2023-09-13T06:12:52.487892+0000","last_became_active":"2023-09-13T06:12:52.487597+0000","last_became_peered":"2023-09-13T06:12:52.487597+0000","last_unstale":"2023-09-13T06:12:52.487892+0000","last_undegraded":"2023-09-13T06:12:52.487892+0000","last_fullsized":"2023-09-13T06:12:52.487892+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:08.422233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493457+0000","last_change":"2023-09-13T06:12:52.490791+0000","last_active":"2023-09-13T06:12:53.493457+0000","last_peered":"2023-09-13T06:12:53.493457+0000","last_clean":"2023-09-13T06:12:53.493457+0000","last_became_active":"2023-09-13T06:12:52.490447+0000","last_became_peered":"2023-09-13T06:12:52.490447+0000","last_unstale":"2023-09-13T06:12:53.493457+0000","last_undegraded":"2023-09-13T06:12:53.493457+0000","last_fullsized":"2023-09-13T06:12:53.493457+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:25.222443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.500478+0000","last_change":"2023-09-13T06:12:52.500405+0000","last_active":"2023-09-13T06:12:52.500478+0000","last_peered":"2023-09-13T06:12:52.500478+0000","last_clean":"2023-09-13T06:12:52.500478+0000","last_became_active":"2023-09-13T06:12:52.500066+0000","last_became_peered":"2023-09-13T06:12:52.500066+0000","last_unstale":"2023-09-13T06:12:52.500478+0000","last_undegraded":"2023-09-13T06:12:52.500478+0000","last_fullsized":"2023-09-13T06:12:52.500478+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:11:07.530904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493780+0000","last_change":"2023-09-13T06:12:52.495068+0000","last_active":"2023-09-13T06:12:53.493780+0000","last_peered":"2023-09-13T06:12:53.493780+0000","last_clean":"2023-09-13T06:12:53.493780+0000","last_became_active":"2023-09-13T06:12:52.494847+0000","last_became_peered":"2023-09-13T06:12:52.494847+0000","last_unstale":"2023-09-13T06:12:53.493780+0000","last_undegraded":"2023-09-13T06:12:53.493780+0000","last_fullsized":"2023-09-13T06:12:53.493780+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:06:51.378315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.496085+0000","last_change":"2023-09-13T06:12:52.495734+0000","last_active":"2023-09-13T06:12:52.496085+0000","last_peered":"2023-09-13T06:12:52.496085+0000","last_clean":"2023-09-13T06:12:52.496085+0000","last_became_active":"2023-09-13T06:12:52.495500+0000","last_became_peered":"2023-09-13T06:12:52.495500+0000","last_unstale":"2023-09-13T06:12:52.496085+0000","last_undegraded":"2023-09-13T06:12:52.496085+0000","last_fullsized":"2023-09-13T06:12:52.496085+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:13.067858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493602+0000","last_change":"2023-09-13T06:12:52.498412+0000","last_active":"2023-09-13T06:12:53.493602+0000","last_peered":"2023-09-13T06:12:53.493602+0000","last_clean":"2023-09-13T06:12:53.493602+0000","last_became_active":"2023-09-13T06:12:52.497822+0000","last_became_peered":"2023-09-13T06:12:52.497822+0000","last_unstale":"2023-09-13T06:12:53.493602+0000","last_undegraded":"2023-09-13T06:12:53.493602+0000","last_fullsized":"2023-09-13T06:12:53.493602+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:39:32.041149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.502304+0000","last_change":"2023-09-13T06:12:52.502234+0000","last_active":"2023-09-13T06:12:52.502304+0000","last_peered":"2023-09-13T06:12:52.502304+0000","last_clean":"2023-09-13T06:12:52.502304+0000","last_became_active":"2023-09-13T06:12:52.501993+0000","last_became_peered":"2023-09-13T06:12:52.501993+0000","last_unstale":"2023-09-13T06:12:52.502304+0000","last_undegraded":"2023-09-13T06:12:52.502304+0000","last_fullsized":"2023-09-13T06:12:52.502304+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:09.733807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.503561+0000","last_change":"2023-09-13T06:12:52.503290+0000","last_active":"2023-09-13T06:12:52.503561+0000","last_peered":"2023-09-13T06:12:52.503561+0000","last_clean":"2023-09-13T06:12:52.503561+0000","last_became_active":"2023-09-13T06:12:52.502498+0000","last_became_peered":"2023-09-13T06:12:52.502498+0000","last_unstale":"2023-09-13T06:12:52.503561+0000","last_undegraded":"2023-09-13T06:12:52.503561+0000","last_fullsized":"2023-09-13T06:12:52.503561+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:46:08.144174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.495348+0000","last_change":"2023-09-13T06:12:52.495151+0000","last_active":"2023-09-13T06:12:52.495348+0000","last_peered":"2023-09-13T06:12:52.495348+0000","last_clean":"2023-09-13T06:12:52.495348+0000","last_became_active":"2023-09-13T06:12:52.494617+0000","last_became_peered":"2023-09-13T06:12:52.494617+0000","last_unstale":"2023-09-13T06:12:52.495348+0000","last_undegraded":"2023-09-13T06:12:52.495348+0000","last_fullsized":"2023-09-13T06:12:52.495348+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:22:30.238092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.502738+0000","last_change":"2023-09-13T06:12:52.502676+0000","last_active":"2023-09-13T06:12:52.502738+0000","last_peered":"2023-09-13T06:12:52.502738+0000","last_clean":"2023-09-13T06:12:52.502738+0000","last_became_active":"2023-09-13T06:12:52.502441+0000","last_became_peered":"2023-09-13T06:12:52.502441+0000","last_unstale":"2023-09-13T06:12:52.502738+0000","last_undegraded":"2023-09-13T06:12:52.502738+0000","last_fullsized":"2023-09-13T06:12:52.502738+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:17.005954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492617+0000","last_change":"2023-09-13T06:12:52.494375+0000","last_active":"2023-09-13T06:12:53.492617+0000","last_peered":"2023-09-13T06:12:53.492617+0000","last_clean":"2023-09-13T06:12:53.492617+0000","last_became_active":"2023-09-13T06:12:52.494149+0000","last_became_peered":"2023-09-13T06:12:52.494149+0000","last_unstale":"2023-09-13T06:12:53.492617+0000","last_undegraded":"2023-09-13T06:12:53.492617+0000","last_fullsized":"2023-09-13T06:12:53.492617+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:56:23.986324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.503956+0000","last_change":"2023-09-13T06:12:52.503859+0000","last_active":"2023-09-13T06:12:52.503956+0000","last_peered":"2023-09-13T06:12:52.503956+0000","last_clean":"2023-09-13T06:12:52.503956+0000","last_became_active":"2023-09-13T06:12:52.502865+0000","last_became_peered":"2023-09-13T06:12:52.502865+0000","last_unstale":"2023-09-13T06:12:52.503956+0000","last_undegraded":"2023-09-13T06:12:52.503956+0000","last_fullsized":"2023-09-13T06:12:52.503956+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:25:07.888230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.492170+0000","last_change":"2023-09-13T06:12:52.491840+0000","last_active":"2023-09-13T06:12:52.492170+0000","last_peered":"2023-09-13T06:12:52.492170+0000","last_clean":"2023-09-13T06:12:52.492170+0000","last_became_active":"2023-09-13T06:12:52.491611+0000","last_became_peered":"2023-09-13T06:12:52.491611+0000","last_unstale":"2023-09-13T06:12:52.492170+0000","last_undegraded":"2023-09-13T06:12:52.492170+0000","last_fullsized":"2023-09-13T06:12:52.492170+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:54:03.875036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.499407+0000","last_change":"2023-09-13T06:12:52.499101+0000","last_active":"2023-09-13T06:12:52.499407+0000","last_peered":"2023-09-13T06:12:52.499407+0000","last_clean":"2023-09-13T06:12:52.499407+0000","last_became_active":"2023-09-13T06:12:52.498449+0000","last_became_peered":"2023-09-13T06:12:52.498449+0000","last_unstale":"2023-09-13T06:12:52.499407+0000","last_undegraded":"2023-09-13T06:12:52.499407+0000","last_fullsized":"2023-09-13T06:12:52.499407+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:46:42.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.493893+0000","last_change":"2023-09-13T06:12:52.493735+0000","last_active":"2023-09-13T06:12:52.493893+0000","last_peered":"2023-09-13T06:12:52.493893+0000","last_clean":"2023-09-13T06:12:52.493893+0000","last_became_active":"2023-09-13T06:12:52.493306+0000","last_became_peered":"2023-09-13T06:12:52.493306+0000","last_unstale":"2023-09-13T06:12:52.493893+0000","last_undegraded":"2023-09-13T06:12:52.493893+0000","last_fullsized":"2023-09-13T06:12:52.493893+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:40.952126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.495836+0000","last_change":"2023-09-13T06:12:52.495758+0000","last_active":"2023-09-13T06:12:52.495836+0000","last_peered":"2023-09-13T06:12:52.495836+0000","last_clean":"2023-09-13T06:12:52.495836+0000","last_became_active":"2023-09-13T06:12:52.495543+0000","last_became_peered":"2023-09-13T06:12:52.495543+0000","last_unstale":"2023-09-13T06:12:52.495836+0000","last_undegraded":"2023-09-13T06:12:52.495836+0000","last_fullsized":"2023-09-13T06:12:52.495836+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:18:04.322057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"186'4","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494165+0000","last_change":"2023-09-13T06:12:51.775539+0000","last_active":"2023-09-13T06:12:53.494165+0000","last_peered":"2023-09-13T06:12:53.494165+0000","last_clean":"2023-09-13T06:12:53.494165+0000","last_became_active":"2023-09-13T06:12:51.775205+0000","last_became_peered":"2023-09-13T06:12:51.775205+0000","last_unstale":"2023-09-13T06:12:53.494165+0000","last_undegraded":"2023-09-13T06:12:53.494165+0000","last_fullsized":"2023-09-13T06:12:53.494165+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:19:12.612160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.494229+0000","last_change":"2023-09-13T06:12:52.493984+0000","last_active":"2023-09-13T06:12:52.494229+0000","last_peered":"2023-09-13T06:12:52.494229+0000","last_clean":"2023-09-13T06:12:52.494229+0000","last_became_active":"2023-09-13T06:12:52.493335+0000","last_became_peered":"2023-09-13T06:12:52.493335+0000","last_unstale":"2023-09-13T06:12:52.494229+0000","last_undegraded":"2023-09-13T06:12:52.494229+0000","last_fullsized":"2023-09-13T06:12:52.494229+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:01:19.155744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"186'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.776441+0000","last_change":"2023-09-13T06:12:51.775634+0000","last_active":"2023-09-13T06:12:52.776441+0000","last_peered":"2023-09-13T06:12:52.776441+0000","last_clean":"2023-09-13T06:12:52.776441+0000","last_became_active":"2023-09-13T06:12:51.775179+0000","last_became_peered":"2023-09-13T06:12:51.775179+0000","last_unstale":"2023-09-13T06:12:52.776441+0000","last_undegraded":"2023-09-13T06:12:52.776441+0000","last_fullsized":"2023-09-13T06:12:52.776441+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:32:36.127964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493899+0000","last_change":"2023-09-13T06:12:52.494065+0000","last_active":"2023-09-13T06:12:53.493899+0000","last_peered":"2023-09-13T06:12:53.493899+0000","last_clean":"2023-09-13T06:12:53.493899+0000","last_became_active":"2023-09-13T06:12:52.493554+0000","last_became_peered":"2023-09-13T06:12:52.493554+0000","last_unstale":"2023-09-13T06:12:53.493899+0000","last_undegraded":"2023-09-13T06:12:53.493899+0000","last_fullsized":"2023-09-13T06:12:53.493899+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:13:55.582959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"186'2","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493067+0000","last_change":"2023-09-13T06:12:51.773103+0000","last_active":"2023-09-13T06:12:53.493067+0000","last_peered":"2023-09-13T06:12:53.493067+0000","last_clean":"2023-09-13T06:12:53.493067+0000","last_became_active":"2023-09-13T06:12:51.772865+0000","last_became_peered":"2023-09-13T06:12:51.772865+0000","last_unstale":"2023-09-13T06:12:53.493067+0000","last_undegraded":"2023-09-13T06:12:53.493067+0000","last_fullsized":"2023-09-13T06:12:53.493067+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:30:50.349811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.502913+0000","last_change":"2023-09-13T06:12:52.502801+0000","last_active":"2023-09-13T06:12:52.502913+0000","last_peered":"2023-09-13T06:12:52.502913+0000","last_clean":"2023-09-13T06:12:52.502913+0000","last_became_active":"2023-09-13T06:12:52.501636+0000","last_became_peered":"2023-09-13T06:12:52.501636+0000","last_unstale":"2023-09-13T06:12:52.502913+0000","last_undegraded":"2023-09-13T06:12:52.502913+0000","last_fullsized":"2023-09-13T06:12:52.502913+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:38:03.551152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"186'2","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492697+0000","last_change":"2023-09-13T06:12:51.768726+0000","last_active":"2023-09-13T06:12:53.492697+0000","last_peered":"2023-09-13T06:12:53.492697+0000","last_clean":"2023-09-13T06:12:53.492697+0000","last_became_active":"2023-09-13T06:12:51.768458+0000","last_became_peered":"2023-09-13T06:12:51.768458+0000","last_unstale":"2023-09-13T06:12:53.492697+0000","last_undegraded":"2023-09-13T06:12:53.492697+0000","last_fullsized":"2023-09-13T06:12:53.492697+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:19:05.758546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.493966+0000","last_change":"2023-09-13T06:12:52.493900+0000","last_active":"2023-09-13T06:12:52.493966+0000","last_peered":"2023-09-13T06:12:52.493966+0000","last_clean":"2023-09-13T06:12:52.493966+0000","last_became_active":"2023-09-13T06:12:52.493633+0000","last_became_peered":"2023-09-13T06:12:52.493633+0000","last_unstale":"2023-09-13T06:12:52.493966+0000","last_undegraded":"2023-09-13T06:12:52.493966+0000","last_fullsized":"2023-09-13T06:12:52.493966+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:00:35.945241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"186'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.774729+0000","last_change":"2023-09-13T06:12:51.771871+0000","last_active":"2023-09-13T06:12:52.774729+0000","last_peered":"2023-09-13T06:12:52.774729+0000","last_clean":"2023-09-13T06:12:52.774729+0000","last_became_active":"2023-09-13T06:12:51.771585+0000","last_became_peered":"2023-09-13T06:12:51.771585+0000","last_unstale":"2023-09-13T06:12:52.774729+0000","last_undegraded":"2023-09-13T06:12:52.774729+0000","last_fullsized":"2023-09-13T06:12:52.774729+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:17:23.624108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492511+0000","last_change":"2023-09-13T06:12:52.494613+0000","last_active":"2023-09-13T06:12:53.492511+0000","last_peered":"2023-09-13T06:12:53.492511+0000","last_clean":"2023-09-13T06:12:53.492511+0000","last_became_active":"2023-09-13T06:12:52.494018+0000","last_became_peered":"2023-09-13T06:12:52.494018+0000","last_unstale":"2023-09-13T06:12:53.492511+0000","last_undegraded":"2023-09-13T06:12:53.492511+0000","last_fullsized":"2023-09-13T06:12:53.492511+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:53:36.849026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"186'1","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492708+0000","last_change":"2023-09-13T06:12:51.766038+0000","last_active":"2023-09-13T06:12:53.492708+0000","last_peered":"2023-09-13T06:12:53.492708+0000","last_clean":"2023-09-13T06:12:53.492708+0000","last_became_active":"2023-09-13T06:12:51.765793+0000","last_became_peered":"2023-09-13T06:12:51.765793+0000","last_unstale":"2023-09-13T06:12:53.492708+0000","last_undegraded":"2023-09-13T06:12:53.492708+0000","last_fullsized":"2023-09-13T06:12:53.492708+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:01:20.696217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492693+0000","last_change":"2023-09-13T06:12:52.496946+0000","last_active":"2023-09-13T06:12:53.492693+0000","last_peered":"2023-09-13T06:12:53.492693+0000","last_clean":"2023-09-13T06:12:53.492693+0000","last_became_active":"2023-09-13T06:12:52.496680+0000","last_became_peered":"2023-09-13T06:12:52.496680+0000","last_unstale":"2023-09-13T06:12:53.492693+0000","last_undegraded":"2023-09-13T06:12:53.492693+0000","last_fullsized":"2023-09-13T06:12:53.492693+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:31:20.106242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.491960+0000","last_change":"2023-09-13T06:12:51.775991+0000","last_active":"2023-09-13T06:12:52.491960+0000","last_peered":"2023-09-13T06:12:52.491960+0000","last_clean":"2023-09-13T06:12:52.491960+0000","last_became_active":"2023-09-13T06:12:51.775601+0000","last_became_peered":"2023-09-13T06:12:51.775601+0000","last_unstale":"2023-09-13T06:12:52.491960+0000","last_undegraded":"2023-09-13T06:12:52.491960+0000","last_fullsized":"2023-09-13T06:12:52.491960+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:01:56.327032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493574+0000","last_change":"2023-09-13T06:12:52.490659+0000","last_active":"2023-09-13T06:12:53.493574+0000","last_peered":"2023-09-13T06:12:53.493574+0000","last_clean":"2023-09-13T06:12:53.493574+0000","last_became_active":"2023-09-13T06:12:52.490162+0000","last_became_peered":"2023-09-13T06:12:52.490162+0000","last_unstale":"2023-09-13T06:12:53.493574+0000","last_undegraded":"2023-09-13T06:12:53.493574+0000","last_fullsized":"2023-09-13T06:12:53.493574+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:50.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.491247+0000","last_change":"2023-09-13T06:12:51.768767+0000","last_active":"2023-09-13T06:12:52.491247+0000","last_peered":"2023-09-13T06:12:52.491247+0000","last_clean":"2023-09-13T06:12:52.491247+0000","last_became_active":"2023-09-13T06:12:51.768552+0000","last_became_peered":"2023-09-13T06:12:51.768552+0000","last_unstale":"2023-09-13T06:12:52.491247+0000","last_undegraded":"2023-09-13T06:12:52.491247+0000","last_fullsized":"2023-09-13T06:12:52.491247+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:16:22.513927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.493235+0000","last_change":"2023-09-13T06:12:52.493075+0000","last_active":"2023-09-13T06:12:52.493235+0000","last_peered":"2023-09-13T06:12:52.493235+0000","last_clean":"2023-09-13T06:12:52.493235+0000","last_became_active":"2023-09-13T06:12:52.492758+0000","last_became_peered":"2023-09-13T06:12:52.492758+0000","last_unstale":"2023-09-13T06:12:52.493235+0000","last_undegraded":"2023-09-13T06:12:52.493235+0000","last_fullsized":"2023-09-13T06:12:52.493235+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:16:31.118965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493697+0000","last_change":"2023-09-13T06:12:51.772341+0000","last_active":"2023-09-13T06:12:53.493697+0000","last_peered":"2023-09-13T06:12:53.493697+0000","last_clean":"2023-09-13T06:12:53.493697+0000","last_became_active":"2023-09-13T06:12:51.772102+0000","last_became_peered":"2023-09-13T06:12:51.772102+0000","last_unstale":"2023-09-13T06:12:53.493697+0000","last_undegraded":"2023-09-13T06:12:53.493697+0000","last_fullsized":"2023-09-13T06:12:53.493697+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:46:05.090407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.492238+0000","last_change":"2023-09-13T06:12:52.492128+0000","last_active":"2023-09-13T06:12:52.492238+0000","last_peered":"2023-09-13T06:12:52.492238+0000","last_clean":"2023-09-13T06:12:52.492238+0000","last_became_active":"2023-09-13T06:12:52.491904+0000","last_became_peered":"2023-09-13T06:12:52.491904+0000","last_unstale":"2023-09-13T06:12:52.492238+0000","last_undegraded":"2023-09-13T06:12:52.492238+0000","last_fullsized":"2023-09-13T06:12:52.492238+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:58:02.765062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"186'3","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493703+0000","last_change":"2023-09-13T06:12:51.766076+0000","last_active":"2023-09-13T06:12:53.493703+0000","last_peered":"2023-09-13T06:12:53.493703+0000","last_clean":"2023-09-13T06:12:53.493703+0000","last_became_active":"2023-09-13T06:12:51.765801+0000","last_became_peered":"2023-09-13T06:12:51.765801+0000","last_unstale":"2023-09-13T06:12:53.493703+0000","last_undegraded":"2023-09-13T06:12:53.493703+0000","last_fullsized":"2023-09-13T06:12:53.493703+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:21:09.144060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.501160+0000","last_change":"2023-09-13T06:12:52.501092+0000","last_active":"2023-09-13T06:12:52.501160+0000","last_peered":"2023-09-13T06:12:52.501160+0000","last_clean":"2023-09-13T06:12:52.501160+0000","last_became_active":"2023-09-13T06:12:52.500714+0000","last_became_peered":"2023-09-13T06:12:52.500714+0000","last_unstale":"2023-09-13T06:12:52.501160+0000","last_undegraded":"2023-09-13T06:12:52.501160+0000","last_fullsized":"2023-09-13T06:12:52.501160+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:21:53.176689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"186'6","reported_seq":17,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.779146+0000","last_change":"2023-09-13T06:12:51.777783+0000","last_active":"2023-09-13T06:12:52.779146+0000","last_peered":"2023-09-13T06:12:52.779146+0000","last_clean":"2023-09-13T06:12:52.779146+0000","last_became_active":"2023-09-13T06:12:51.777283+0000","last_became_peered":"2023-09-13T06:12:51.777283+0000","last_unstale":"2023-09-13T06:12:52.779146+0000","last_undegraded":"2023-09-13T06:12:52.779146+0000","last_fullsized":"2023-09-13T06:12:52.779146+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:21:31.099902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.494472+0000","last_change":"2023-09-13T06:12:52.494017+0000","last_active":"2023-09-13T06:12:52.494472+0000","last_peered":"2023-09-13T06:12:52.494472+0000","last_clean":"2023-09-13T06:12:52.494472+0000","last_became_active":"2023-09-13T06:12:52.493750+0000","last_became_peered":"2023-09-13T06:12:52.493750+0000","last_unstale":"2023-09-13T06:12:52.494472+0000","last_undegraded":"2023-09-13T06:12:52.494472+0000","last_fullsized":"2023-09-13T06:12:52.494472+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:00:36.443179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"186'2","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493161+0000","last_change":"2023-09-13T06:12:51.766109+0000","last_active":"2023-09-13T06:12:53.493161+0000","last_peered":"2023-09-13T06:12:53.493161+0000","last_clean":"2023-09-13T06:12:53.493161+0000","last_became_active":"2023-09-13T06:12:51.765843+0000","last_became_peered":"2023-09-13T06:12:51.765843+0000","last_unstale":"2023-09-13T06:12:53.493161+0000","last_undegraded":"2023-09-13T06:12:53.493161+0000","last_fullsized":"2023-09-13T06:12:53.493161+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:54:37.490166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498805+0000","last_change":"2023-09-13T06:12:52.498403+0000","last_active":"2023-09-13T06:12:52.498805+0000","last_peered":"2023-09-13T06:12:52.498805+0000","last_clean":"2023-09-13T06:12:52.498805+0000","last_became_active":"2023-09-13T06:12:52.498157+0000","last_became_peered":"2023-09-13T06:12:52.498157+0000","last_unstale":"2023-09-13T06:12:52.498805+0000","last_undegraded":"2023-09-13T06:12:52.498805+0000","last_fullsized":"2023-09-13T06:12:52.498805+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:25:39.987679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.485486+0000","last_change":"2023-09-13T06:12:51.771417+0000","last_active":"2023-09-13T06:12:52.485486+0000","last_peered":"2023-09-13T06:12:52.485486+0000","last_clean":"2023-09-13T06:12:52.485486+0000","last_became_active":"2023-09-13T06:12:51.770812+0000","last_became_peered":"2023-09-13T06:12:51.770812+0000","last_unstale":"2023-09-13T06:12:52.485486+0000","last_undegraded":"2023-09-13T06:12:52.485486+0000","last_fullsized":"2023-09-13T06:12:52.485486+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:46:41.526862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492495+0000","last_change":"2023-09-13T06:12:52.501752+0000","last_active":"2023-09-13T06:12:53.492495+0000","last_peered":"2023-09-13T06:12:53.492495+0000","last_clean":"2023-09-13T06:12:53.492495+0000","last_became_active":"2023-09-13T06:12:52.501563+0000","last_became_peered":"2023-09-13T06:12:52.501563+0000","last_unstale":"2023-09-13T06:12:53.492495+0000","last_undegraded":"2023-09-13T06:12:53.492495+0000","last_fullsized":"2023-09-13T06:12:53.492495+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:12:49.623019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492810+0000","last_change":"2023-09-13T06:12:51.773519+0000","last_active":"2023-09-13T06:12:53.492810+0000","last_peered":"2023-09-13T06:12:53.492810+0000","last_clean":"2023-09-13T06:12:53.492810+0000","last_became_active":"2023-09-13T06:12:51.773268+0000","last_became_peered":"2023-09-13T06:12:51.773268+0000","last_unstale":"2023-09-13T06:12:53.492810+0000","last_undegraded":"2023-09-13T06:12:53.492810+0000","last_fullsized":"2023-09-13T06:12:53.492810+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:41:17.868182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.499837+0000","last_change":"2023-09-13T06:12:52.499734+0000","last_active":"2023-09-13T06:12:52.499837+0000","last_peered":"2023-09-13T06:12:52.499837+0000","last_clean":"2023-09-13T06:12:52.499837+0000","last_became_active":"2023-09-13T06:12:52.499415+0000","last_became_peered":"2023-09-13T06:12:52.499415+0000","last_unstale":"2023-09-13T06:12:52.499837+0000","last_undegraded":"2023-09-13T06:12:52.499837+0000","last_fullsized":"2023-09-13T06:12:52.499837+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:44:29.465325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"186'8","reported_seq":19,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.779446+0000","last_change":"2023-09-13T06:12:51.777760+0000","last_active":"2023-09-13T06:12:52.779446+0000","last_peered":"2023-09-13T06:12:52.779446+0000","last_clean":"2023-09-13T06:12:52.779446+0000","last_became_active":"2023-09-13T06:12:51.777496+0000","last_became_peered":"2023-09-13T06:12:51.777496+0000","last_unstale":"2023-09-13T06:12:52.779446+0000","last_undegraded":"2023-09-13T06:12:52.779446+0000","last_fullsized":"2023-09-13T06:12:52.779446+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:10:57.751382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492909+0000","last_change":"2023-09-13T06:12:52.495690+0000","last_active":"2023-09-13T06:12:53.492909+0000","last_peered":"2023-09-13T06:12:53.492909+0000","last_clean":"2023-09-13T06:12:53.492909+0000","last_became_active":"2023-09-13T06:12:52.495448+0000","last_became_peered":"2023-09-13T06:12:52.495448+0000","last_unstale":"2023-09-13T06:12:53.492909+0000","last_undegraded":"2023-09-13T06:12:53.492909+0000","last_fullsized":"2023-09-13T06:12:53.492909+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:54:16.069000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"186'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.774433+0000","last_change":"2023-09-13T06:12:51.774131+0000","last_active":"2023-09-13T06:12:52.774433+0000","last_peered":"2023-09-13T06:12:52.774433+0000","last_clean":"2023-09-13T06:12:52.774433+0000","last_became_active":"2023-09-13T06:12:51.773733+0000","last_became_peered":"2023-09-13T06:12:51.773733+0000","last_unstale":"2023-09-13T06:12:52.774433+0000","last_undegraded":"2023-09-13T06:12:52.774433+0000","last_fullsized":"2023-09-13T06:12:52.774433+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:06:50.369067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.490852+0000","last_change":"2023-09-13T06:12:52.490661+0000","last_active":"2023-09-13T06:12:52.490852+0000","last_peered":"2023-09-13T06:12:52.490852+0000","last_clean":"2023-09-13T06:12:52.490852+0000","last_became_active":"2023-09-13T06:12:52.490441+0000","last_became_peered":"2023-09-13T06:12:52.490441+0000","last_unstale":"2023-09-13T06:12:52.490852+0000","last_undegraded":"2023-09-13T06:12:52.490852+0000","last_fullsized":"2023-09-13T06:12:52.490852+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:44:20.443030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"186'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.773214+0000","last_change":"2023-09-13T06:12:51.774184+0000","last_active":"2023-09-13T06:12:52.773214+0000","last_peered":"2023-09-13T06:12:52.773214+0000","last_clean":"2023-09-13T06:12:52.773214+0000","last_became_active":"2023-09-13T06:12:51.773768+0000","last_became_peered":"2023-09-13T06:12:51.773768+0000","last_unstale":"2023-09-13T06:12:52.773214+0000","last_undegraded":"2023-09-13T06:12:52.773214+0000","last_fullsized":"2023-09-13T06:12:52.773214+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:05:46.226556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492733+0000","last_change":"2023-09-13T06:12:52.494888+0000","last_active":"2023-09-13T06:12:53.492733+0000","last_peered":"2023-09-13T06:12:53.492733+0000","last_clean":"2023-09-13T06:12:53.492733+0000","last_became_active":"2023-09-13T06:12:52.494341+0000","last_became_peered":"2023-09-13T06:12:52.494341+0000","last_unstale":"2023-09-13T06:12:53.492733+0000","last_undegraded":"2023-09-13T06:12:53.492733+0000","last_fullsized":"2023-09-13T06:12:53.492733+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:46:44.446778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"186'1","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494437+0000","last_change":"2023-09-13T06:12:51.777131+0000","last_active":"2023-09-13T06:12:53.494437+0000","last_peered":"2023-09-13T06:12:53.494437+0000","last_clean":"2023-09-13T06:12:53.494437+0000","last_became_active":"2023-09-13T06:12:51.776578+0000","last_became_peered":"2023-09-13T06:12:51.776578+0000","last_unstale":"2023-09-13T06:12:53.494437+0000","last_undegraded":"2023-09-13T06:12:53.494437+0000","last_fullsized":"2023-09-13T06:12:53.494437+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:25:40.506983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.495364+0000","last_change":"2023-09-13T06:12:52.495290+0000","last_active":"2023-09-13T06:12:52.495364+0000","last_peered":"2023-09-13T06:12:52.495364+0000","last_clean":"2023-09-13T06:12:52.495364+0000","last_became_active":"2023-09-13T06:12:52.494913+0000","last_became_peered":"2023-09-13T06:12:52.494913+0000","last_unstale":"2023-09-13T06:12:52.495364+0000","last_undegraded":"2023-09-13T06:12:52.495364+0000","last_fullsized":"2023-09-13T06:12:52.495364+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:41.250815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494104+0000","last_change":"2023-09-13T06:12:51.768483+0000","last_active":"2023-09-13T06:12:53.494104+0000","last_peered":"2023-09-13T06:12:53.494104+0000","last_clean":"2023-09-13T06:12:53.494104+0000","last_became_active":"2023-09-13T06:12:51.768235+0000","last_became_peered":"2023-09-13T06:12:51.768235+0000","last_unstale":"2023-09-13T06:12:53.494104+0000","last_undegraded":"2023-09-13T06:12:53.494104+0000","last_fullsized":"2023-09-13T06:12:53.494104+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:42:48.298862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498848+0000","last_change":"2023-09-13T06:12:52.498735+0000","last_active":"2023-09-13T06:12:52.498848+0000","last_peered":"2023-09-13T06:12:52.498848+0000","last_clean":"2023-09-13T06:12:52.498848+0000","last_became_active":"2023-09-13T06:12:52.498519+0000","last_became_peered":"2023-09-13T06:12:52.498519+0000","last_unstale":"2023-09-13T06:12:52.498848+0000","last_undegraded":"2023-09-13T06:12:52.498848+0000","last_fullsized":"2023-09-13T06:12:52.498848+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:39:32.041149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"186'2","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492792+0000","last_change":"2023-09-13T06:12:51.773219+0000","last_active":"2023-09-13T06:12:53.492792+0000","last_peered":"2023-09-13T06:12:53.492792+0000","last_clean":"2023-09-13T06:12:53.492792+0000","last_became_active":"2023-09-13T06:12:51.773001+0000","last_became_peered":"2023-09-13T06:12:51.773001+0000","last_unstale":"2023-09-13T06:12:53.492792+0000","last_undegraded":"2023-09-13T06:12:53.492792+0000","last_fullsized":"2023-09-13T06:12:53.492792+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:59:08.687299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498826+0000","last_change":"2023-09-13T06:12:52.498541+0000","last_active":"2023-09-13T06:12:52.498826+0000","last_peered":"2023-09-13T06:12:52.498826+0000","last_clean":"2023-09-13T06:12:52.498826+0000","last_became_active":"2023-09-13T06:12:52.498312+0000","last_became_peered":"2023-09-13T06:12:52.498312+0000","last_unstale":"2023-09-13T06:12:52.498826+0000","last_undegraded":"2023-09-13T06:12:52.498826+0000","last_fullsized":"2023-09-13T06:12:52.498826+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:23:23.317805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494279+0000","last_change":"2023-09-13T06:12:51.765675+0000","last_active":"2023-09-13T06:12:53.494279+0000","last_peered":"2023-09-13T06:12:53.494279+0000","last_clean":"2023-09-13T06:12:53.494279+0000","last_became_active":"2023-09-13T06:12:51.765430+0000","last_became_peered":"2023-09-13T06:12:51.765430+0000","last_unstale":"2023-09-13T06:12:53.494279+0000","last_undegraded":"2023-09-13T06:12:53.494279+0000","last_fullsized":"2023-09-13T06:12:53.494279+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:33.033603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494077+0000","last_change":"2023-09-13T06:12:52.496930+0000","last_active":"2023-09-13T06:12:53.494077+0000","last_peered":"2023-09-13T06:12:53.494077+0000","last_clean":"2023-09-13T06:12:53.494077+0000","last_became_active":"2023-09-13T06:12:52.495312+0000","last_became_peered":"2023-09-13T06:12:52.495312+0000","last_unstale":"2023-09-13T06:12:53.494077+0000","last_undegraded":"2023-09-13T06:12:53.494077+0000","last_fullsized":"2023-09-13T06:12:53.494077+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:58.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493239+0000","last_change":"2023-09-13T06:12:51.772581+0000","last_active":"2023-09-13T06:12:53.493239+0000","last_peered":"2023-09-13T06:12:53.493239+0000","last_clean":"2023-09-13T06:12:53.493239+0000","last_became_active":"2023-09-13T06:12:51.772126+0000","last_became_peered":"2023-09-13T06:12:51.772126+0000","last_unstale":"2023-09-13T06:12:53.493239+0000","last_undegraded":"2023-09-13T06:12:53.493239+0000","last_fullsized":"2023-09-13T06:12:53.493239+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:02.057332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493856+0000","last_change":"2023-09-13T06:12:52.494485+0000","last_active":"2023-09-13T06:12:53.493856+0000","last_peered":"2023-09-13T06:12:53.493856+0000","last_clean":"2023-09-13T06:12:53.493856+0000","last_became_active":"2023-09-13T06:12:52.494159+0000","last_became_peered":"2023-09-13T06:12:52.494159+0000","last_unstale":"2023-09-13T06:12:53.493856+0000","last_undegraded":"2023-09-13T06:12:53.493856+0000","last_fullsized":"2023-09-13T06:12:53.493856+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:08:25.535593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494483+0000","last_change":"2023-09-13T06:12:51.777678+0000","last_active":"2023-09-13T06:12:53.494483+0000","last_peered":"2023-09-13T06:12:53.494483+0000","last_clean":"2023-09-13T06:12:53.494483+0000","last_became_active":"2023-09-13T06:12:51.776904+0000","last_became_peered":"2023-09-13T06:12:51.776904+0000","last_unstale":"2023-09-13T06:12:53.494483+0000","last_undegraded":"2023-09-13T06:12:53.494483+0000","last_fullsized":"2023-09-13T06:12:53.494483+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:32.431665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.492061+0000","last_change":"2023-09-13T06:12:52.491959+0000","last_active":"2023-09-13T06:12:52.492061+0000","last_peered":"2023-09-13T06:12:52.492061+0000","last_clean":"2023-09-13T06:12:52.492061+0000","last_became_active":"2023-09-13T06:12:52.491720+0000","last_became_peered":"2023-09-13T06:12:52.491720+0000","last_unstale":"2023-09-13T06:12:52.492061+0000","last_undegraded":"2023-09-13T06:12:52.492061+0000","last_fullsized":"2023-09-13T06:12:52.492061+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:14.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"186'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.776632+0000","last_change":"2023-09-13T06:12:51.772954+0000","last_active":"2023-09-13T06:12:52.776632+0000","last_peered":"2023-09-13T06:12:52.776632+0000","last_clean":"2023-09-13T06:12:52.776632+0000","last_became_active":"2023-09-13T06:12:51.772722+0000","last_became_peered":"2023-09-13T06:12:51.772722+0000","last_unstale":"2023-09-13T06:12:52.776632+0000","last_undegraded":"2023-09-13T06:12:52.776632+0000","last_fullsized":"2023-09-13T06:12:52.776632+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:32:36.127964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498850+0000","last_change":"2023-09-13T06:12:52.498627+0000","last_active":"2023-09-13T06:12:52.498850+0000","last_peered":"2023-09-13T06:12:52.498850+0000","last_clean":"2023-09-13T06:12:52.498850+0000","last_became_active":"2023-09-13T06:12:52.498350+0000","last_became_peered":"2023-09-13T06:12:52.498350+0000","last_unstale":"2023-09-13T06:12:52.498850+0000","last_undegraded":"2023-09-13T06:12:52.498850+0000","last_fullsized":"2023-09-13T06:12:52.498850+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:17:44.616134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.496608+0000","last_change":"2023-09-13T06:12:51.772772+0000","last_active":"2023-09-13T06:12:52.496608+0000","last_peered":"2023-09-13T06:12:52.496608+0000","last_clean":"2023-09-13T06:12:52.496608+0000","last_became_active":"2023-09-13T06:12:51.772308+0000","last_became_peered":"2023-09-13T06:12:51.772308+0000","last_unstale":"2023-09-13T06:12:52.496608+0000","last_undegraded":"2023-09-13T06:12:52.496608+0000","last_fullsized":"2023-09-13T06:12:52.496608+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:37:38.684275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493929+0000","last_change":"2023-09-13T06:12:52.497729+0000","last_active":"2023-09-13T06:12:53.493929+0000","last_peered":"2023-09-13T06:12:53.493929+0000","last_clean":"2023-09-13T06:12:53.493929+0000","last_became_active":"2023-09-13T06:12:52.497307+0000","last_became_peered":"2023-09-13T06:12:52.497307+0000","last_unstale":"2023-09-13T06:12:53.493929+0000","last_undegraded":"2023-09-13T06:12:53.493929+0000","last_fullsized":"2023-09-13T06:12:53.493929+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:44:29.465325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.492116+0000","last_change":"2023-09-13T06:12:51.771831+0000","last_active":"2023-09-13T06:12:52.492116+0000","last_peered":"2023-09-13T06:12:52.492116+0000","last_clean":"2023-09-13T06:12:52.492116+0000","last_became_active":"2023-09-13T06:12:51.771135+0000","last_became_peered":"2023-09-13T06:12:51.771135+0000","last_unstale":"2023-09-13T06:12:52.492116+0000","last_undegraded":"2023-09-13T06:12:52.492116+0000","last_fullsized":"2023-09-13T06:12:52.492116+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:55:35.803341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.489092+0000","last_change":"2023-09-13T06:12:52.488508+0000","last_active":"2023-09-13T06:12:52.489092+0000","last_peered":"2023-09-13T06:12:52.489092+0000","last_clean":"2023-09-13T06:12:52.489092+0000","last_became_active":"2023-09-13T06:12:52.488297+0000","last_became_peered":"2023-09-13T06:12:52.488297+0000","last_unstale":"2023-09-13T06:12:52.489092+0000","last_undegraded":"2023-09-13T06:12:52.489092+0000","last_fullsized":"2023-09-13T06:12:52.489092+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:23:10.793611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.484934+0000","last_change":"2023-09-13T06:12:51.772409+0000","last_active":"2023-09-13T06:12:52.484934+0000","last_peered":"2023-09-13T06:12:52.484934+0000","last_clean":"2023-09-13T06:12:52.484934+0000","last_became_active":"2023-09-13T06:12:51.772152+0000","last_became_peered":"2023-09-13T06:12:51.772152+0000","last_unstale":"2023-09-13T06:12:52.484934+0000","last_undegraded":"2023-09-13T06:12:52.484934+0000","last_fullsized":"2023-09-13T06:12:52.484934+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:49.121259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.493875+0000","last_change":"2023-09-13T06:12:52.493590+0000","last_active":"2023-09-13T06:12:52.493875+0000","last_peered":"2023-09-13T06:12:52.493875+0000","last_clean":"2023-09-13T06:12:52.493875+0000","last_became_active":"2023-09-13T06:12:52.493002+0000","last_became_peered":"2023-09-13T06:12:52.493002+0000","last_unstale":"2023-09-13T06:12:52.493875+0000","last_undegraded":"2023-09-13T06:12:52.493875+0000","last_fullsized":"2023-09-13T06:12:52.493875+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:01:19.155744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.489964+0000","last_change":"2023-09-13T06:12:51.774629+0000","last_active":"2023-09-13T06:12:52.489964+0000","last_peered":"2023-09-13T06:12:52.489964+0000","last_clean":"2023-09-13T06:12:52.489964+0000","last_became_active":"2023-09-13T06:12:51.774359+0000","last_became_peered":"2023-09-13T06:12:51.774359+0000","last_unstale":"2023-09-13T06:12:52.489964+0000","last_undegraded":"2023-09-13T06:12:52.489964+0000","last_fullsized":"2023-09-13T06:12:52.489964+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:41:50.082397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.499424+0000","last_change":"2023-09-13T06:12:52.499245+0000","last_active":"2023-09-13T06:12:52.499424+0000","last_peered":"2023-09-13T06:12:52.499424+0000","last_clean":"2023-09-13T06:12:52.499424+0000","last_became_active":"2023-09-13T06:12:52.498760+0000","last_became_peered":"2023-09-13T06:12:52.498760+0000","last_unstale":"2023-09-13T06:12:52.499424+0000","last_undegraded":"2023-09-13T06:12:52.499424+0000","last_fullsized":"2023-09-13T06:12:52.499424+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:23:10.793611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492883+0000","last_change":"2023-09-13T06:12:51.774367+0000","last_active":"2023-09-13T06:12:53.492883+0000","last_peered":"2023-09-13T06:12:53.492883+0000","last_clean":"2023-09-13T06:12:53.492883+0000","last_became_active":"2023-09-13T06:12:51.774134+0000","last_became_peered":"2023-09-13T06:12:51.774134+0000","last_unstale":"2023-09-13T06:12:53.492883+0000","last_undegraded":"2023-09-13T06:12:53.492883+0000","last_fullsized":"2023-09-13T06:12:53.492883+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:09:52.208537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498867+0000","last_change":"2023-09-13T06:12:52.498718+0000","last_active":"2023-09-13T06:12:52.498867+0000","last_peered":"2023-09-13T06:12:52.498867+0000","last_clean":"2023-09-13T06:12:52.498867+0000","last_became_active":"2023-09-13T06:12:52.498455+0000","last_became_peered":"2023-09-13T06:12:52.498455+0000","last_unstale":"2023-09-13T06:12:52.498867+0000","last_undegraded":"2023-09-13T06:12:52.498867+0000","last_fullsized":"2023-09-13T06:12:52.498867+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:38.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.491657+0000","last_change":"2023-09-13T06:12:51.770976+0000","last_active":"2023-09-13T06:12:52.491657+0000","last_peered":"2023-09-13T06:12:52.491657+0000","last_clean":"2023-09-13T06:12:52.491657+0000","last_became_active":"2023-09-13T06:12:51.770710+0000","last_became_peered":"2023-09-13T06:12:51.770710+0000","last_unstale":"2023-09-13T06:12:52.491657+0000","last_undegraded":"2023-09-13T06:12:52.491657+0000","last_fullsized":"2023-09-13T06:12:52.491657+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:34:17.480916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.502428+0000","last_change":"2023-09-13T06:12:52.502355+0000","last_active":"2023-09-13T06:12:52.502428+0000","last_peered":"2023-09-13T06:12:52.502428+0000","last_clean":"2023-09-13T06:12:52.502428+0000","last_became_active":"2023-09-13T06:12:52.501911+0000","last_became_peered":"2023-09-13T06:12:52.501911+0000","last_unstale":"2023-09-13T06:12:52.502428+0000","last_undegraded":"2023-09-13T06:12:52.502428+0000","last_fullsized":"2023-09-13T06:12:52.502428+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:13:55.582959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.489768+0000","last_change":"2023-09-13T06:12:51.775451+0000","last_active":"2023-09-13T06:12:52.489768+0000","last_peered":"2023-09-13T06:12:52.489768+0000","last_clean":"2023-09-13T06:12:52.489768+0000","last_became_active":"2023-09-13T06:12:51.774842+0000","last_became_peered":"2023-09-13T06:12:51.774842+0000","last_unstale":"2023-09-13T06:12:52.489768+0000","last_undegraded":"2023-09-13T06:12:52.489768+0000","last_fullsized":"2023-09-13T06:12:52.489768+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:04:16.160132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.492042+0000","last_change":"2023-09-13T06:12:52.491638+0000","last_active":"2023-09-13T06:12:52.492042+0000","last_peered":"2023-09-13T06:12:52.492042+0000","last_clean":"2023-09-13T06:12:52.492042+0000","last_became_active":"2023-09-13T06:12:52.491397+0000","last_became_peered":"2023-09-13T06:12:52.491397+0000","last_unstale":"2023-09-13T06:12:52.492042+0000","last_undegraded":"2023-09-13T06:12:52.492042+0000","last_fullsized":"2023-09-13T06:12:52.492042+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:49:01.116652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.489837+0000","last_change":"2023-09-13T06:12:51.777166+0000","last_active":"2023-09-13T06:12:52.489837+0000","last_peered":"2023-09-13T06:12:52.489837+0000","last_clean":"2023-09-13T06:12:52.489837+0000","last_became_active":"2023-09-13T06:12:51.776917+0000","last_became_peered":"2023-09-13T06:12:51.776917+0000","last_unstale":"2023-09-13T06:12:52.489837+0000","last_undegraded":"2023-09-13T06:12:52.489837+0000","last_fullsized":"2023-09-13T06:12:52.489837+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:33:29.210291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":348,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.487929+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:12:52.487929+0000","last_peered":"2023-09-13T06:12:52.487929+0000","last_clean":"2023-09-13T06:12:52.487929+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:12:52.487929+0000","last_undegraded":"2023-09-13T06:12:52.487929+0000","last_fullsized":"2023-09-13T06:12:52.487929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1604,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193707,"statfs":{"total":200000000,"available":198356591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.70499999999999996},"min":{"1min":0.45600000000000002,"5min":0.38100000000000001,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.0589999999999999,"15min":1.3320000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.70799999999999996},"min":{"1min":0.627,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":0.94099999999999995,"5min":1.0089999999999999,"15min":1.0649999999999999},"last":0.72999999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.70599999999999996},"min":{"1min":0.50900000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96199999999999997,"5min":0.999,"15min":0.999},"last":0.874},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.72999999999999998},"min":{"1min":0.58399999999999996,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":0.92900000000000005,"5min":0.95599999999999996,"15min":1.0960000000000001},"last":0.79900000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.432},"max":{"1min":0.84999999999999998,"5min":0.88300000000000001,"15min":1.395},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75,"15min":0.72699999999999998},"min":{"1min":0.56200000000000006,"5min":0.45300000000000001,"15min":0.42899999999999999},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":1.2030000000000001},"last":0.66500000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.75900000000000001,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.47599999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.357},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.79300000000000004,"15min":0.79100000000000004},"min":{"1min":0.68400000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0149999999999999,"15min":1.2629999999999999},"last":0.77900000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.89300000000000002,"15min":0.95899999999999996},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.39300000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.018},"last":0.70099999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64600000000000002,"15min":0.65900000000000003},"min":{"1min":0.45900000000000002,"5min":0.40300000000000002,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.51000000000000001,"5min":0.40400000000000003,"15min":0.371},"max":{"1min":1.004,"5min":1.004,"15min":1.1319999999999999},"last":0.93500000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.55900000000000005,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":0.91900000000000004,"5min":1.0129999999999999,"15min":1.0920000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.69699999999999995},"min":{"1min":0.50600000000000001,"5min":0.48499999999999999,"15min":0.46600000000000003},"max":{"1min":0.89800000000000002,"5min":0.93600000000000005,"15min":1.0229999999999999},"last":0.89500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949291,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.50800000000000001,"5min":0.35599999999999998,"15min":0.35299999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.181},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.72299999999999998,"15min":0.69499999999999995},"min":{"1min":0.56899999999999995,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.028},"last":0.68600000000000005}]},{"osd":1,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.69699999999999995},"min":{"1min":0.50600000000000001,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.94699999999999995,"5min":1.024,"15min":1.0840000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.54000000000000004,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0900000000000001,"5min":1.137,"15min":1.153},"last":0.73899999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.74099999999999999,"15min":0.72599999999999998},"min":{"1min":0.64000000000000001,"5min":0.53700000000000003,"15min":0.39300000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.4750000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.54000000000000004,"5min":0.49299999999999999,"15min":0.39000000000000001},"max":{"1min":0.89700000000000002,"5min":1.034,"15min":1.085},"last":0.71299999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.76500000000000001,"15min":0.76100000000000001},"min":{"1min":0.59999999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.55900000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.90700000000000003,"5min":1.0129999999999999,"15min":1.526},"last":0.77500000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.626},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.315},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.312},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66700000000000004,"15min":0.68400000000000005},"min":{"1min":0.52900000000000003,"5min":0.39500000000000002,"15min":0.32800000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69699999999999995,"15min":0.71999999999999997},"min":{"1min":0.51100000000000001,"5min":0.45700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":4.3879999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.98299999999999998,"5min":1.056,"15min":1.133},"last":0.60399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194285,"statfs":{"total":200000000,"available":198948709,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.69599999999999995,"15min":0.67300000000000004},"min":{"1min":0.56100000000000005,"5min":0.44400000000000001,"15min":0.32000000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0389999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.71199999999999997,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.33500000000000002,"15min":0.30199999999999999},"max":{"1min":1.0029999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.53100000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.73799999999999999,"15min":0.70399999999999996},"min":{"1min":0.66400000000000003,"5min":0.44500000000000001,"15min":0.36299999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71899999999999997,"15min":0.69299999999999995},"min":{"1min":0.63,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.752,"15min":0.71499999999999997},"min":{"1min":0.57699999999999996,"5min":0.436,"15min":0.40200000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.71799999999999997,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.35699999999999998},"max":{"1min":0.92800000000000005,"5min":1.01,"15min":1.2729999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.54100000000000004,"5min":0.47299999999999998,"15min":0.42799999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.75600000000000001,"15min":0.72399999999999998},"min":{"1min":0.57199999999999995,"5min":0.49099999999999999,"15min":0.47099999999999997},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.76900000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.44400000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.83999999999999997,"5min":0.96999999999999997,"15min":1.0169999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.63},"min":{"1min":0.502,"5min":0.41599999999999998,"15min":0.40300000000000002},"max":{"1min":0.88400000000000001,"5min":0.97499999999999998,"15min":1.077},"last":0.55400000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.50900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.39600000000000002,"15min":0.39200000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.49299999999999999,"5min":0.45100000000000001,"15min":0.41799999999999998},"max":{"1min":1.0049999999999999,"5min":1.171,"15min":1.171},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75700000000000001,"15min":0.74299999999999999},"min":{"1min":0.57999999999999996,"5min":0.51400000000000001,"15min":0.48499999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1027,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194284,"statfs":{"total":200000000,"available":198947631,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68899999999999995,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.38},"max":{"1min":0.98999999999999999,"5min":1.038,"15min":1.145},"last":0.89200000000000002}]},{"osd":1,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.69199999999999995},"min":{"1min":0.50800000000000001,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":0.94599999999999995,"5min":0.997,"15min":1.0960000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.68799999999999994},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.40500000000000003},"max":{"1min":0.93300000000000005,"5min":0.96399999999999997,"15min":1.0309999999999999},"last":0.92500000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73199999999999998,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":0.92600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.748},"min":{"1min":0.57699999999999996,"5min":0.55500000000000005,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":1.056,"15min":1.056},"last":0.85599999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.39000000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.077},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76700000000000002,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.40799999999999997},"max":{"1min":0.93600000000000005,"5min":0.94999999999999996,"15min":1.071},"last":0.872}]},{"osd":5,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64500000000000002,"15min":0.624},"min":{"1min":0.439,"5min":0.41499999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":1.01},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.41799999999999998,"15min":0.34699999999999998},"max":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":1.0960000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.44,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":0.94199999999999995,"15min":1.1930000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.437},"max":{"1min":0.95299999999999996,"5min":1.0169999999999999,"15min":1.123},"last":0.68999999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.39200000000000002},"max":{"1min":0.93799999999999994,"5min":1.0009999999999999,"15min":1.26},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.98799999999999999,"15min":1.2390000000000001},"last":0.71099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949279,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.443,"15min":0.41599999999999998},"min":{"1min":0.27900000000000003,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.64100000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48599999999999999,"15min":0.45500000000000002},"min":{"1min":0.372,"5min":0.29799999999999999,"15min":0.28299999999999997},"max":{"1min":0.73299999999999998,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.36899999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46700000000000003,"15min":0.443},"min":{"1min":0.35999999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64900000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51500000000000001,"15min":0.48299999999999998},"min":{"1min":0.39700000000000002,"5min":0.32300000000000001,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.47299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.53100000000000003},"min":{"1min":0.45300000000000001,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.78100000000000003},"last":0.499}]},{"osd":4,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.55500000000000005,"5min":0.46700000000000003,"15min":0.42999999999999999},"max":{"1min":1,"5min":1.046,"15min":1.284},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.754,"15min":0.72899999999999998},"min":{"1min":0.64400000000000002,"5min":0.50800000000000001,"15min":0.46800000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76500000000000001,"15min":0.745},"min":{"1min":0.63800000000000001,"5min":0.52700000000000002,"15min":0.442},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96999999999999997,"5min":1.107,"15min":1.2270000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76200000000000001,"15min":0.74099999999999999},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.47499999999999998},"max":{"1min":1.073,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77300000000000002,"15min":0.755},"min":{"1min":0.61899999999999999,"5min":0.55300000000000005,"15min":0.53000000000000003},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.458},"last":0.63900000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.60399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"max":{"1min":1.0489999999999999,"5min":1.1679999999999999,"15min":1.383},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79100000000000004,"15min":0.76800000000000002},"min":{"1min":0.69699999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.02,"5min":1.1850000000000001,"15min":1.27},"last":0.69299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949223,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.443,"15min":0.42999999999999999},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.67700000000000005,"5min":0.745,"15min":10.401},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47599999999999998,"15min":0.45600000000000002},"min":{"1min":0.371,"5min":0.318,"15min":0.27400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79700000000000004,"15min":5.4429999999999996},"last":0.34499999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28499999999999998},"max":{"1min":0.63600000000000001,"5min":0.70099999999999996,"15min":5.2640000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51900000000000002,"15min":0.49199999999999999},"min":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.312},"max":{"1min":0.69699999999999995,"5min":0.78000000000000003,"15min":4.3369999999999997},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":6.0410000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.47199999999999998,"5min":0.442,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.85099999999999998,"15min":6.1600000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.78400000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.171,"15min":5.4809999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.55700000000000005,"5min":0.52300000000000002,"15min":0.44700000000000001},"max":{"1min":1.1200000000000001,"5min":1.121,"15min":4.0599999999999996},"last":0.628}]},{"osd":5,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":1.046,"5min":1.1579999999999999,"15min":4.2089999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.83199999999999996,"15min":0.80500000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.501},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":5.5289999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78100000000000003,"15min":0.749},"min":{"1min":0.59799999999999998,"5min":0.505,"15min":0.35099999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":4.1609999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78300000000000003,"15min":0.747},"min":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.1100000000000001,"15min":4.2380000000000004},"last":0.48799999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78900000000000003,"15min":0.753},"min":{"1min":0.59999999999999998,"5min":0.51100000000000001,"15min":0.42699999999999999},"max":{"1min":1.159,"5min":1.1879999999999999,"15min":4.2400000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80400000000000005,"15min":0.77700000000000002},"min":{"1min":0.60499999999999998,"5min":0.53600000000000003,"15min":0.48099999999999998},"max":{"1min":1.0589999999999999,"5min":1.0700000000000001,"15min":4.2649999999999997},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949313,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.32700000000000001,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.69799999999999995,"5min":0.78100000000000003,"15min":2.4020000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.505,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.27300000000000002},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.81100000000000005},"last":0.376}]},{"osd":2,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.5,"15min":0.47599999999999998},"min":{"1min":0.38600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53600000000000003,"15min":0.49399999999999999},"min":{"1min":0.441,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80000000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.41699999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.54200000000000004},"min":{"1min":0.495,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.86399999999999999,"5min":0.88,"15min":0.88},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.503,"15min":0.497},"min":{"1min":0.36799999999999999,"5min":0.32400000000000001,"15min":0.316},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":4.0599999999999996},"last":0.44500000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77200000000000002,"15min":0.74099999999999999},"min":{"1min":0.59899999999999998,"5min":0.52200000000000002,"15min":0.40400000000000003},"max":{"1min":1.0720000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77100000000000002,"15min":0.749},"min":{"1min":0.623,"5min":0.49399999999999999,"15min":0.44600000000000001},"max":{"1min":0.96899999999999997,"5min":1.121,"15min":1.2150000000000001},"last":0.85199999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77200000000000002,"15min":0.753},"min":{"1min":0.63500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.0860000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.755},"min":{"1min":0.60999999999999999,"5min":0.50800000000000001,"15min":0.42999999999999999},"max":{"1min":0.96199999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.748},"min":{"1min":0.58899999999999997,"5min":0.496,"15min":0.39900000000000002},"max":{"1min":0.95799999999999996,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.79400000000000004,"15min":0.76500000000000001},"min":{"1min":0.63200000000000001,"5min":0.48899999999999999,"15min":0.46100000000000002},"max":{"1min":1.012,"5min":1.0640000000000001,"15min":1.3799999999999999},"last":0.752}]},{"osd":7,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.78700000000000003,"15min":0.753},"min":{"1min":0.66500000000000004,"5min":0.48299999999999998,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.67900000000000005,"5min":0.505,"15min":0.41699999999999998},"max":{"1min":1.04,"5min":1.0409999999999999,"15min":1.2769999999999999},"last":0.81999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46000000000000002,"15min":0.45400000000000001},"min":{"1min":0.28199999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":2.0190000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.316,"15min":0.27500000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":2.294},"last":0.54500000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.50900000000000001},"min":{"1min":0.42099999999999999,"5min":0.35699999999999998,"15min":0.28999999999999998},"max":{"1min":0.78700000000000003,"5min":0.875,"15min":2.2410000000000001},"last":0.372},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.38,"5min":0.315,"15min":0.29499999999999998},"max":{"1min":0.748,"5min":0.76500000000000001,"15min":2.056},"last":0.45600000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":2.0859999999999999},"last":0.433},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.46000000000000002,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.73399999999999999,"5min":0.81000000000000005,"15min":2.3820000000000001},"last":0.41099999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.51000000000000001,"5min":0.47599999999999998,"15min":0.436},"max":{"1min":1.0600000000000001,"5min":1.103,"15min":2.1749999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.61399999999999999,"5min":0.56299999999999994,"15min":0.436},"max":{"1min":1,"5min":1.0940000000000001,"15min":2.3370000000000002},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54800000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.052,"5min":1.2609999999999999,"15min":2.3119999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":1.145,"15min":2.1469999999999998},"last":0.47799999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.57299999999999995,"5min":0.5,"15min":0.47699999999999998},"max":{"1min":1.04,"5min":1.0820000000000001,"15min":2.415},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.64500000000000002,"5min":0.46200000000000002,"15min":0.41499999999999998},"max":{"1min":1.198,"5min":1.198,"15min":2.347},"last":0.61699999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.499,"15min":0.495},"max":{"1min":1.0169999999999999,"5min":1.2130000000000001,"15min":2.367},"last":0.505},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0309999999999999,"5min":1.0489999999999999,"15min":2.1179999999999999},"last":0.66100000000000003}]}]}],"pool_statfs":[]}} 2023-09-13T06:12:56.852 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:12:57.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc62266a640 1 Processor -- start 2023-09-13T06:12:57.024 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc62266a640 1 -- start start 2023-09-13T06:12:57.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc62266a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc61c0d1090 0x7fc61c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc62266a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc61c146f30 0x7fc61c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc62266a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c0b63c0 con 0x7fc61c0d1750 2023-09-13T06:12:57.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc62266a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c15dea0 con 0x7fc61c0d1090 2023-09-13T06:12:57.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc62266a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0d0c20 con 0x7fc61c146f30 2023-09-13T06:12:57.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc61c0d1750 0x7fc61c146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43134/0 (socket says 172.21.15.130:43134) 2023-09-13T06:12:57.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61bfff640 1 -- 172.21.15.130:0/3897501698 learned_addr learned my addr 172.21.15.130:0/3897501698 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:57.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc620c07640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc61c146f30 0x7fc61c0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747540586 0 0) 0x7fc61c0b63c0 con 0x7fc61c0d1750 2023-09-13T06:12:57.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61b7fe640 1 --2- 172.21.15.130:0/3897501698 >> v2:172.21.15.164:3300/0 conn(0x7fc61c0d1090 0x7fc61c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc604003530 con 0x7fc61c0d1750 2023-09-13T06:12:57.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 490331560 0 0) 0x7fc604003530 con 0x7fc61c0d1750 2023-09-13T06:12:57.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc61c146f30 msgr2=0x7fc61c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:57.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc61c146f30 0x7fc61c0b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 >> v2:172.21.15.164:3300/0 conn(0x7fc61c0d1090 msgr2=0x7fc61c15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:57.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 --2- 172.21.15.130:0/3897501698 >> v2:172.21.15.164:3300/0 conn(0x7fc61c0d1090 0x7fc61c15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.034 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0b6610 con 0x7fc61c0d1750 2023-09-13T06:12:57.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fc60c001680 con 0x7fc61c0d1750 2023-09-13T06:12:57.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 >> v1:172.21.15.130:6789/0 conn(0x7fc61c0d1750 legacy=0x7fc61c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.035 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6040039f0 0x7fc604003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6040047d0 0x7fc604004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc61c146f30 0x7fc604005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0d0c20 con 0x7fc6040047d0 2023-09-13T06:12:57.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60400b990 con 0x7fc6040039f0 2023-09-13T06:12:57.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60400bad0 con 0x7fc61c146f30 2023-09-13T06:12:57.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61b7fe640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6040047d0 0x7fc604004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc61bfff640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6040039f0 0x7fc604003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.024+0000 7fc620c07640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc61c146f30 0x7fc604005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc61b7fe640 1 -- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc61c146f30 msgr2=0x7fc604005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:57.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc61b7fe640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc61c146f30 0x7fc604005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc61b7fe640 1 -- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6040039f0 msgr2=0x7fc604003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:57.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc61b7fe640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6040039f0 0x7fc604003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc61b7fe640 1 -- 172.21.15.130:0/3897501698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604003530 con 0x7fc6040047d0 2023-09-13T06:12:57.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc61bfff640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6040039f0 0x7fc604003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:12:57.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc61b7fe640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6040047d0 0x7fc604004c50 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc610009ae0 tx=0x7fc61001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8688c5e960d1c5e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:57.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100a6460 con 0x7fc6040047d0 2023-09-13T06:12:57.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6100a65c0 con 0x7fc6040047d0 2023-09-13T06:12:57.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc61affd640 1 -- 172.21.15.130:0/3897501698 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100a6930 con 0x7fc6040047d0 2023-09-13T06:12:57.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc62266a640 1 -- 172.21.15.130:0/3897501698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6040047d0 msgr2=0x7fc604004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc62266a640 1 --2- 172.21.15.130:0/3897501698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6040047d0 0x7fc604004c50 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc610009ae0 tx=0x7fc61001ca50 comp rx=0 tx=0).stop 2023-09-13T06:12:57.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc620c07640 1 -- 172.21.15.130:0/3897501698 reap_dead start 2023-09-13T06:12:57.050 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc62266a640 1 -- 172.21.15.130:0/3897501698 shutdown_connections 2023-09-13T06:12:57.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc62266a640 1 -- 172.21.15.130:0/3897501698 >> 172.21.15.130:0/3897501698 conn(0x7fc61c06f170 msgr2=0x7fc61c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:57.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc62266a640 1 -- 172.21.15.130:0/3897501698 shutdown_connections 2023-09-13T06:12:57.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.028+0000 7fc62266a640 1 -- 172.21.15.130:0/3897501698 wait complete. 2023-09-13T06:12:57.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc62266a640 1 Processor -- start 2023-09-13T06:12:57.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc62266a640 1 -- start start 2023-09-13T06:12:57.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc62266a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6040047d0 0x7fc61c15f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc62266a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc61c15f9f0 0x7fc61c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc62266a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61c15b620 0x7fc61c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc62266a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c15c010 con 0x7fc61c15b620 2023-09-13T06:12:57.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc62266a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c13b420 con 0x7fc61c15f9f0 2023-09-13T06:12:57.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc62266a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c1f2c20 con 0x7fc6040047d0 2023-09-13T06:12:57.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc620c07640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61c15b620 0x7fc61c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc620c07640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61c15b620 0x7fc61c15bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49640/0 (socket says 172.21.15.130:49640) 2023-09-13T06:12:57.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc620c07640 1 -- 172.21.15.130:0/2541104386 learned_addr learned my addr 172.21.15.130:0/2541104386 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:57.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc61b7fe640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc61c15f9f0 0x7fc61c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc61bfff640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6040047d0 0x7fc61c15f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc620c07640 1 -- 172.21.15.130:0/2541104386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6040047d0 msgr2=0x7fc61c15f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc620c07640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6040047d0 0x7fc61c15f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc620c07640 1 -- 172.21.15.130:0/2541104386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc61c15f9f0 msgr2=0x7fc61c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc620c07640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc61c15f9f0 0x7fc61c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc620c07640 1 -- 172.21.15.130:0/2541104386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c1f2f00 con 0x7fc61c15b620 2023-09-13T06:12:57.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc61bfff640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6040047d0 0x7fc61c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:57.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc620c07640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61c15b620 0x7fc61c15bad0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0c8330 tx=0x7fc61400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:57.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc618ff9640 1 -- 172.21.15.130:0/2541104386 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400e040 con 0x7fc61c15b620 2023-09-13T06:12:57.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc618ff9640 1 -- 172.21.15.130:0/2541104386 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61400f040 con 0x7fc61c15b620 2023-09-13T06:12:57.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc62266a640 1 -- 172.21.15.130:0/2541104386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c1f31e0 con 0x7fc61c15b620 2023-09-13T06:12:57.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.032+0000 7fc618ff9640 1 -- 172.21.15.130:0/2541104386 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614015670 con 0x7fc61c15b620 2023-09-13T06:12:57.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.036+0000 7fc62266a640 1 -- 172.21.15.130:0/2541104386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c15a250 con 0x7fc61c15b620 2023-09-13T06:12:57.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.036+0000 7fc62266a640 1 -- 172.21.15.130:0/2541104386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c1f3700 con 0x7fc61c15b620 2023-09-13T06:12:57.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.036+0000 7fc618ff9640 1 -- 172.21.15.130:0/2541104386 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc6140157d0 con 0x7fc61c15b620 2023-09-13T06:12:57.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.036+0000 7fc618ff9640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc608065b50 0x7fc608068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.036+0000 7fc618ff9640 1 -- 172.21.15.130:0/2541104386 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc614083730 con 0x7fc61c15b620 2023-09-13T06:12:57.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.036+0000 7fc61bfff640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc608065b50 0x7fc608068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.036+0000 7fc61bfff640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc608065b50 0x7fc608068010 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc60c001020 tx=0x7fc60c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:57.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.040+0000 7fc618ff9640 1 -- 172.21.15.130:0/2541104386 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc61c1f3700 con 0x7fc61c15b620 2023-09-13T06:12:57.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.184+0000 7fc62266a640 1 -- 172.21.15.130:0/2541104386 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc61c1f2d90 con 0x7fc608065b50 2023-09-13T06:12:57.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.192+0000 7fc618ff9640 1 -- 172.21.15.130:0/2541104386 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284889 (secure 0 0 0) 0x7fc61c1f2d90 con 0x7fc608065b50 2023-09-13T06:12:57.195 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:57.197 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:12:57.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 -- 172.21.15.130:0/2541104386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc608065b50 msgr2=0x7fc608068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc608065b50 0x7fc608068010 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc60c001020 tx=0x7fc60c009040 comp rx=0 tx=0).stop 2023-09-13T06:12:57.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 -- 172.21.15.130:0/2541104386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61c15b620 msgr2=0x7fc61c15bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61c15b620 0x7fc61c15bad0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0c8330 tx=0x7fc61400f580 comp rx=0 tx=0).stop 2023-09-13T06:12:57.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 -- 172.21.15.130:0/2541104386 shutdown_connections 2023-09-13T06:12:57.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc608065b50 0x7fc608068010 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc61c15f9f0 0x7fc61c159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61c15b620 0x7fc61c15bad0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 --2- 172.21.15.130:0/2541104386 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6040047d0 0x7fc61c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 -- 172.21.15.130:0/2541104386 >> 172.21.15.130:0/2541104386 conn(0x7fc61c06f170 msgr2=0x7fc61c0b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:57.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 -- 172.21.15.130:0/2541104386 shutdown_connections 2023-09-13T06:12:57.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.196+0000 7fc62266a640 1 -- 172.21.15.130:0/2541104386 wait complete. 2023-09-13T06:12:57.215 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":530,"stamp":"2023-09-13T06:12:56.691574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553133,"statfs":{"total":1600000000,"available":1590408982,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.938520"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494382+0000","last_change":"2023-09-13T06:12:52.498429+0000","last_active":"2023-09-13T06:12:53.494382+0000","last_peered":"2023-09-13T06:12:53.494382+0000","last_clean":"2023-09-13T06:12:53.494382+0000","last_became_active":"2023-09-13T06:12:52.497835+0000","last_became_peered":"2023-09-13T06:12:52.497835+0000","last_unstale":"2023-09-13T06:12:53.494382+0000","last_undegraded":"2023-09-13T06:12:53.494382+0000","last_fullsized":"2023-09-13T06:12:53.494382+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:52:47.863828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.499420+0000","last_change":"2023-09-13T06:12:52.499336+0000","last_active":"2023-09-13T06:12:52.499420+0000","last_peered":"2023-09-13T06:12:52.499420+0000","last_clean":"2023-09-13T06:12:52.499420+0000","last_became_active":"2023-09-13T06:12:52.499070+0000","last_became_peered":"2023-09-13T06:12:52.499070+0000","last_unstale":"2023-09-13T06:12:52.499420+0000","last_undegraded":"2023-09-13T06:12:52.499420+0000","last_fullsized":"2023-09-13T06:12:52.499420+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:50:17.671842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.497995+0000","last_change":"2023-09-13T06:12:52.497894+0000","last_active":"2023-09-13T06:12:52.497995+0000","last_peered":"2023-09-13T06:12:52.497995+0000","last_clean":"2023-09-13T06:12:52.497995+0000","last_became_active":"2023-09-13T06:12:52.497358+0000","last_became_peered":"2023-09-13T06:12:52.497358+0000","last_unstale":"2023-09-13T06:12:52.497995+0000","last_undegraded":"2023-09-13T06:12:52.497995+0000","last_fullsized":"2023-09-13T06:12:52.497995+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:08:25.535593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492661+0000","last_change":"2023-09-13T06:12:52.494659+0000","last_active":"2023-09-13T06:12:53.492661+0000","last_peered":"2023-09-13T06:12:53.492661+0000","last_clean":"2023-09-13T06:12:53.492661+0000","last_became_active":"2023-09-13T06:12:52.494355+0000","last_became_peered":"2023-09-13T06:12:52.494355+0000","last_unstale":"2023-09-13T06:12:53.492661+0000","last_undegraded":"2023-09-13T06:12:53.492661+0000","last_fullsized":"2023-09-13T06:12:53.492661+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:03:00.930720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498653+0000","last_change":"2023-09-13T06:12:52.498585+0000","last_active":"2023-09-13T06:12:52.498653+0000","last_peered":"2023-09-13T06:12:52.498653+0000","last_clean":"2023-09-13T06:12:52.498653+0000","last_became_active":"2023-09-13T06:12:52.498363+0000","last_became_peered":"2023-09-13T06:12:52.498363+0000","last_unstale":"2023-09-13T06:12:52.498653+0000","last_undegraded":"2023-09-13T06:12:52.498653+0000","last_fullsized":"2023-09-13T06:12:52.498653+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:43:44.083375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493651+0000","last_change":"2023-09-13T06:12:52.494206+0000","last_active":"2023-09-13T06:12:53.493651+0000","last_peered":"2023-09-13T06:12:53.493651+0000","last_clean":"2023-09-13T06:12:53.493651+0000","last_became_active":"2023-09-13T06:12:52.493845+0000","last_became_peered":"2023-09-13T06:12:52.493845+0000","last_unstale":"2023-09-13T06:12:53.493651+0000","last_undegraded":"2023-09-13T06:12:53.493651+0000","last_fullsized":"2023-09-13T06:12:53.493651+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:31:32.314431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.493161+0000","last_change":"2023-09-13T06:12:52.493101+0000","last_active":"2023-09-13T06:12:52.493161+0000","last_peered":"2023-09-13T06:12:52.493161+0000","last_clean":"2023-09-13T06:12:52.493161+0000","last_became_active":"2023-09-13T06:12:52.492438+0000","last_became_peered":"2023-09-13T06:12:52.492438+0000","last_unstale":"2023-09-13T06:12:52.493161+0000","last_undegraded":"2023-09-13T06:12:52.493161+0000","last_fullsized":"2023-09-13T06:12:52.493161+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:34:40.002752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.496955+0000","last_change":"2023-09-13T06:12:52.496883+0000","last_active":"2023-09-13T06:12:52.496955+0000","last_peered":"2023-09-13T06:12:52.496955+0000","last_clean":"2023-09-13T06:12:52.496955+0000","last_became_active":"2023-09-13T06:12:52.496630+0000","last_became_peered":"2023-09-13T06:12:52.496630+0000","last_unstale":"2023-09-13T06:12:52.496955+0000","last_undegraded":"2023-09-13T06:12:52.496955+0000","last_fullsized":"2023-09-13T06:12:52.496955+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:48:02.392939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.497712+0000","last_change":"2023-09-13T06:12:52.497590+0000","last_active":"2023-09-13T06:12:52.497712+0000","last_peered":"2023-09-13T06:12:52.497712+0000","last_clean":"2023-09-13T06:12:52.497712+0000","last_became_active":"2023-09-13T06:12:52.497349+0000","last_became_peered":"2023-09-13T06:12:52.497349+0000","last_unstale":"2023-09-13T06:12:52.497712+0000","last_undegraded":"2023-09-13T06:12:52.497712+0000","last_fullsized":"2023-09-13T06:12:52.497712+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:15:13.845400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.500893+0000","last_change":"2023-09-13T06:12:52.500825+0000","last_active":"2023-09-13T06:12:52.500893+0000","last_peered":"2023-09-13T06:12:52.500893+0000","last_clean":"2023-09-13T06:12:52.500893+0000","last_became_active":"2023-09-13T06:12:52.500608+0000","last_became_peered":"2023-09-13T06:12:52.500608+0000","last_unstale":"2023-09-13T06:12:52.500893+0000","last_undegraded":"2023-09-13T06:12:52.500893+0000","last_fullsized":"2023-09-13T06:12:52.500893+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:52:18.096863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.496974+0000","last_change":"2023-09-13T06:12:52.496892+0000","last_active":"2023-09-13T06:12:52.496974+0000","last_peered":"2023-09-13T06:12:52.496974+0000","last_clean":"2023-09-13T06:12:52.496974+0000","last_became_active":"2023-09-13T06:12:52.496656+0000","last_became_peered":"2023-09-13T06:12:52.496656+0000","last_unstale":"2023-09-13T06:12:52.496974+0000","last_undegraded":"2023-09-13T06:12:52.496974+0000","last_fullsized":"2023-09-13T06:12:52.496974+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:35:26.102771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.497592+0000","last_change":"2023-09-13T06:12:52.497395+0000","last_active":"2023-09-13T06:12:52.497592+0000","last_peered":"2023-09-13T06:12:52.497592+0000","last_clean":"2023-09-13T06:12:52.497592+0000","last_became_active":"2023-09-13T06:12:52.497061+0000","last_became_peered":"2023-09-13T06:12:52.497061+0000","last_unstale":"2023-09-13T06:12:52.497592+0000","last_undegraded":"2023-09-13T06:12:52.497592+0000","last_fullsized":"2023-09-13T06:12:52.497592+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:51:48.126810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498160+0000","last_change":"2023-09-13T06:12:52.498091+0000","last_active":"2023-09-13T06:12:52.498160+0000","last_peered":"2023-09-13T06:12:52.498160+0000","last_clean":"2023-09-13T06:12:52.498160+0000","last_became_active":"2023-09-13T06:12:52.497673+0000","last_became_peered":"2023-09-13T06:12:52.497673+0000","last_unstale":"2023-09-13T06:12:52.498160+0000","last_undegraded":"2023-09-13T06:12:52.498160+0000","last_fullsized":"2023-09-13T06:12:52.498160+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:00:13.923974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.504055+0000","last_change":"2023-09-13T06:12:52.503983+0000","last_active":"2023-09-13T06:12:52.504055+0000","last_peered":"2023-09-13T06:12:52.504055+0000","last_clean":"2023-09-13T06:12:52.504055+0000","last_became_active":"2023-09-13T06:12:52.503240+0000","last_became_peered":"2023-09-13T06:12:52.503240+0000","last_unstale":"2023-09-13T06:12:52.504055+0000","last_undegraded":"2023-09-13T06:12:52.504055+0000","last_fullsized":"2023-09-13T06:12:52.504055+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:31:32.314431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494346+0000","last_change":"2023-09-13T06:12:52.498831+0000","last_active":"2023-09-13T06:12:53.494346+0000","last_peered":"2023-09-13T06:12:53.494346+0000","last_clean":"2023-09-13T06:12:53.494346+0000","last_became_active":"2023-09-13T06:12:52.498418+0000","last_became_peered":"2023-09-13T06:12:52.498418+0000","last_unstale":"2023-09-13T06:12:53.494346+0000","last_undegraded":"2023-09-13T06:12:53.494346+0000","last_fullsized":"2023-09-13T06:12:53.494346+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:40:49.596156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.499521+0000","last_change":"2023-09-13T06:12:52.498901+0000","last_active":"2023-09-13T06:12:52.499521+0000","last_peered":"2023-09-13T06:12:52.499521+0000","last_clean":"2023-09-13T06:12:52.499521+0000","last_became_active":"2023-09-13T06:12:52.498495+0000","last_became_peered":"2023-09-13T06:12:52.498495+0000","last_unstale":"2023-09-13T06:12:52.499521+0000","last_undegraded":"2023-09-13T06:12:52.499521+0000","last_fullsized":"2023-09-13T06:12:52.499521+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:43:25.145008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493618+0000","last_change":"2023-09-13T06:12:52.497316+0000","last_active":"2023-09-13T06:12:53.493618+0000","last_peered":"2023-09-13T06:12:53.493618+0000","last_clean":"2023-09-13T06:12:53.493618+0000","last_became_active":"2023-09-13T06:12:52.497095+0000","last_became_peered":"2023-09-13T06:12:52.497095+0000","last_unstale":"2023-09-13T06:12:53.493618+0000","last_undegraded":"2023-09-13T06:12:53.493618+0000","last_fullsized":"2023-09-13T06:12:53.493618+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:25:07.888230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.487892+0000","last_change":"2023-09-13T06:12:52.487825+0000","last_active":"2023-09-13T06:12:52.487892+0000","last_peered":"2023-09-13T06:12:52.487892+0000","last_clean":"2023-09-13T06:12:52.487892+0000","last_became_active":"2023-09-13T06:12:52.487597+0000","last_became_peered":"2023-09-13T06:12:52.487597+0000","last_unstale":"2023-09-13T06:12:52.487892+0000","last_undegraded":"2023-09-13T06:12:52.487892+0000","last_fullsized":"2023-09-13T06:12:52.487892+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:15:08.422233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493457+0000","last_change":"2023-09-13T06:12:52.490791+0000","last_active":"2023-09-13T06:12:53.493457+0000","last_peered":"2023-09-13T06:12:53.493457+0000","last_clean":"2023-09-13T06:12:53.493457+0000","last_became_active":"2023-09-13T06:12:52.490447+0000","last_became_peered":"2023-09-13T06:12:52.490447+0000","last_unstale":"2023-09-13T06:12:53.493457+0000","last_undegraded":"2023-09-13T06:12:53.493457+0000","last_fullsized":"2023-09-13T06:12:53.493457+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:25.222443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.500478+0000","last_change":"2023-09-13T06:12:52.500405+0000","last_active":"2023-09-13T06:12:52.500478+0000","last_peered":"2023-09-13T06:12:52.500478+0000","last_clean":"2023-09-13T06:12:52.500478+0000","last_became_active":"2023-09-13T06:12:52.500066+0000","last_became_peered":"2023-09-13T06:12:52.500066+0000","last_unstale":"2023-09-13T06:12:52.500478+0000","last_undegraded":"2023-09-13T06:12:52.500478+0000","last_fullsized":"2023-09-13T06:12:52.500478+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:11:07.530904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493780+0000","last_change":"2023-09-13T06:12:52.495068+0000","last_active":"2023-09-13T06:12:53.493780+0000","last_peered":"2023-09-13T06:12:53.493780+0000","last_clean":"2023-09-13T06:12:53.493780+0000","last_became_active":"2023-09-13T06:12:52.494847+0000","last_became_peered":"2023-09-13T06:12:52.494847+0000","last_unstale":"2023-09-13T06:12:53.493780+0000","last_undegraded":"2023-09-13T06:12:53.493780+0000","last_fullsized":"2023-09-13T06:12:53.493780+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:06:51.378315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.496085+0000","last_change":"2023-09-13T06:12:52.495734+0000","last_active":"2023-09-13T06:12:52.496085+0000","last_peered":"2023-09-13T06:12:52.496085+0000","last_clean":"2023-09-13T06:12:52.496085+0000","last_became_active":"2023-09-13T06:12:52.495500+0000","last_became_peered":"2023-09-13T06:12:52.495500+0000","last_unstale":"2023-09-13T06:12:52.496085+0000","last_undegraded":"2023-09-13T06:12:52.496085+0000","last_fullsized":"2023-09-13T06:12:52.496085+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:11:13.067858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493602+0000","last_change":"2023-09-13T06:12:52.498412+0000","last_active":"2023-09-13T06:12:53.493602+0000","last_peered":"2023-09-13T06:12:53.493602+0000","last_clean":"2023-09-13T06:12:53.493602+0000","last_became_active":"2023-09-13T06:12:52.497822+0000","last_became_peered":"2023-09-13T06:12:52.497822+0000","last_unstale":"2023-09-13T06:12:53.493602+0000","last_undegraded":"2023-09-13T06:12:53.493602+0000","last_fullsized":"2023-09-13T06:12:53.493602+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:39:32.041149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.502304+0000","last_change":"2023-09-13T06:12:52.502234+0000","last_active":"2023-09-13T06:12:52.502304+0000","last_peered":"2023-09-13T06:12:52.502304+0000","last_clean":"2023-09-13T06:12:52.502304+0000","last_became_active":"2023-09-13T06:12:52.501993+0000","last_became_peered":"2023-09-13T06:12:52.501993+0000","last_unstale":"2023-09-13T06:12:52.502304+0000","last_undegraded":"2023-09-13T06:12:52.502304+0000","last_fullsized":"2023-09-13T06:12:52.502304+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:44:09.733807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.503561+0000","last_change":"2023-09-13T06:12:52.503290+0000","last_active":"2023-09-13T06:12:52.503561+0000","last_peered":"2023-09-13T06:12:52.503561+0000","last_clean":"2023-09-13T06:12:52.503561+0000","last_became_active":"2023-09-13T06:12:52.502498+0000","last_became_peered":"2023-09-13T06:12:52.502498+0000","last_unstale":"2023-09-13T06:12:52.503561+0000","last_undegraded":"2023-09-13T06:12:52.503561+0000","last_fullsized":"2023-09-13T06:12:52.503561+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:46:08.144174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.495348+0000","last_change":"2023-09-13T06:12:52.495151+0000","last_active":"2023-09-13T06:12:52.495348+0000","last_peered":"2023-09-13T06:12:52.495348+0000","last_clean":"2023-09-13T06:12:52.495348+0000","last_became_active":"2023-09-13T06:12:52.494617+0000","last_became_peered":"2023-09-13T06:12:52.494617+0000","last_unstale":"2023-09-13T06:12:52.495348+0000","last_undegraded":"2023-09-13T06:12:52.495348+0000","last_fullsized":"2023-09-13T06:12:52.495348+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:22:30.238092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.502738+0000","last_change":"2023-09-13T06:12:52.502676+0000","last_active":"2023-09-13T06:12:52.502738+0000","last_peered":"2023-09-13T06:12:52.502738+0000","last_clean":"2023-09-13T06:12:52.502738+0000","last_became_active":"2023-09-13T06:12:52.502441+0000","last_became_peered":"2023-09-13T06:12:52.502441+0000","last_unstale":"2023-09-13T06:12:52.502738+0000","last_undegraded":"2023-09-13T06:12:52.502738+0000","last_fullsized":"2023-09-13T06:12:52.502738+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:17.005954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492617+0000","last_change":"2023-09-13T06:12:52.494375+0000","last_active":"2023-09-13T06:12:53.492617+0000","last_peered":"2023-09-13T06:12:53.492617+0000","last_clean":"2023-09-13T06:12:53.492617+0000","last_became_active":"2023-09-13T06:12:52.494149+0000","last_became_peered":"2023-09-13T06:12:52.494149+0000","last_unstale":"2023-09-13T06:12:53.492617+0000","last_undegraded":"2023-09-13T06:12:53.492617+0000","last_fullsized":"2023-09-13T06:12:53.492617+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:56:23.986324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.503956+0000","last_change":"2023-09-13T06:12:52.503859+0000","last_active":"2023-09-13T06:12:52.503956+0000","last_peered":"2023-09-13T06:12:52.503956+0000","last_clean":"2023-09-13T06:12:52.503956+0000","last_became_active":"2023-09-13T06:12:52.502865+0000","last_became_peered":"2023-09-13T06:12:52.502865+0000","last_unstale":"2023-09-13T06:12:52.503956+0000","last_undegraded":"2023-09-13T06:12:52.503956+0000","last_fullsized":"2023-09-13T06:12:52.503956+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:25:07.888230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.492170+0000","last_change":"2023-09-13T06:12:52.491840+0000","last_active":"2023-09-13T06:12:52.492170+0000","last_peered":"2023-09-13T06:12:52.492170+0000","last_clean":"2023-09-13T06:12:52.492170+0000","last_became_active":"2023-09-13T06:12:52.491611+0000","last_became_peered":"2023-09-13T06:12:52.491611+0000","last_unstale":"2023-09-13T06:12:52.492170+0000","last_undegraded":"2023-09-13T06:12:52.492170+0000","last_fullsized":"2023-09-13T06:12:52.492170+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:54:03.875036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.499407+0000","last_change":"2023-09-13T06:12:52.499101+0000","last_active":"2023-09-13T06:12:52.499407+0000","last_peered":"2023-09-13T06:12:52.499407+0000","last_clean":"2023-09-13T06:12:52.499407+0000","last_became_active":"2023-09-13T06:12:52.498449+0000","last_became_peered":"2023-09-13T06:12:52.498449+0000","last_unstale":"2023-09-13T06:12:52.499407+0000","last_undegraded":"2023-09-13T06:12:52.499407+0000","last_fullsized":"2023-09-13T06:12:52.499407+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:46:42.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.493893+0000","last_change":"2023-09-13T06:12:52.493735+0000","last_active":"2023-09-13T06:12:52.493893+0000","last_peered":"2023-09-13T06:12:52.493893+0000","last_clean":"2023-09-13T06:12:52.493893+0000","last_became_active":"2023-09-13T06:12:52.493306+0000","last_became_peered":"2023-09-13T06:12:52.493306+0000","last_unstale":"2023-09-13T06:12:52.493893+0000","last_undegraded":"2023-09-13T06:12:52.493893+0000","last_fullsized":"2023-09-13T06:12:52.493893+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:55:40.952126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.495836+0000","last_change":"2023-09-13T06:12:52.495758+0000","last_active":"2023-09-13T06:12:52.495836+0000","last_peered":"2023-09-13T06:12:52.495836+0000","last_clean":"2023-09-13T06:12:52.495836+0000","last_became_active":"2023-09-13T06:12:52.495543+0000","last_became_peered":"2023-09-13T06:12:52.495543+0000","last_unstale":"2023-09-13T06:12:52.495836+0000","last_undegraded":"2023-09-13T06:12:52.495836+0000","last_fullsized":"2023-09-13T06:12:52.495836+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:18:04.322057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"186'4","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494165+0000","last_change":"2023-09-13T06:12:51.775539+0000","last_active":"2023-09-13T06:12:53.494165+0000","last_peered":"2023-09-13T06:12:53.494165+0000","last_clean":"2023-09-13T06:12:53.494165+0000","last_became_active":"2023-09-13T06:12:51.775205+0000","last_became_peered":"2023-09-13T06:12:51.775205+0000","last_unstale":"2023-09-13T06:12:53.494165+0000","last_undegraded":"2023-09-13T06:12:53.494165+0000","last_fullsized":"2023-09-13T06:12:53.494165+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:19:12.612160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.494229+0000","last_change":"2023-09-13T06:12:52.493984+0000","last_active":"2023-09-13T06:12:52.494229+0000","last_peered":"2023-09-13T06:12:52.494229+0000","last_clean":"2023-09-13T06:12:52.494229+0000","last_became_active":"2023-09-13T06:12:52.493335+0000","last_became_peered":"2023-09-13T06:12:52.493335+0000","last_unstale":"2023-09-13T06:12:52.494229+0000","last_undegraded":"2023-09-13T06:12:52.494229+0000","last_fullsized":"2023-09-13T06:12:52.494229+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:01:19.155744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"186'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.776441+0000","last_change":"2023-09-13T06:12:51.775634+0000","last_active":"2023-09-13T06:12:52.776441+0000","last_peered":"2023-09-13T06:12:52.776441+0000","last_clean":"2023-09-13T06:12:52.776441+0000","last_became_active":"2023-09-13T06:12:51.775179+0000","last_became_peered":"2023-09-13T06:12:51.775179+0000","last_unstale":"2023-09-13T06:12:52.776441+0000","last_undegraded":"2023-09-13T06:12:52.776441+0000","last_fullsized":"2023-09-13T06:12:52.776441+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:32:36.127964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493899+0000","last_change":"2023-09-13T06:12:52.494065+0000","last_active":"2023-09-13T06:12:53.493899+0000","last_peered":"2023-09-13T06:12:53.493899+0000","last_clean":"2023-09-13T06:12:53.493899+0000","last_became_active":"2023-09-13T06:12:52.493554+0000","last_became_peered":"2023-09-13T06:12:52.493554+0000","last_unstale":"2023-09-13T06:12:53.493899+0000","last_undegraded":"2023-09-13T06:12:53.493899+0000","last_fullsized":"2023-09-13T06:12:53.493899+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:13:55.582959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"186'2","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493067+0000","last_change":"2023-09-13T06:12:51.773103+0000","last_active":"2023-09-13T06:12:53.493067+0000","last_peered":"2023-09-13T06:12:53.493067+0000","last_clean":"2023-09-13T06:12:53.493067+0000","last_became_active":"2023-09-13T06:12:51.772865+0000","last_became_peered":"2023-09-13T06:12:51.772865+0000","last_unstale":"2023-09-13T06:12:53.493067+0000","last_undegraded":"2023-09-13T06:12:53.493067+0000","last_fullsized":"2023-09-13T06:12:53.493067+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:30:50.349811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.502913+0000","last_change":"2023-09-13T06:12:52.502801+0000","last_active":"2023-09-13T06:12:52.502913+0000","last_peered":"2023-09-13T06:12:52.502913+0000","last_clean":"2023-09-13T06:12:52.502913+0000","last_became_active":"2023-09-13T06:12:52.501636+0000","last_became_peered":"2023-09-13T06:12:52.501636+0000","last_unstale":"2023-09-13T06:12:52.502913+0000","last_undegraded":"2023-09-13T06:12:52.502913+0000","last_fullsized":"2023-09-13T06:12:52.502913+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:38:03.551152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"186'2","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492697+0000","last_change":"2023-09-13T06:12:51.768726+0000","last_active":"2023-09-13T06:12:53.492697+0000","last_peered":"2023-09-13T06:12:53.492697+0000","last_clean":"2023-09-13T06:12:53.492697+0000","last_became_active":"2023-09-13T06:12:51.768458+0000","last_became_peered":"2023-09-13T06:12:51.768458+0000","last_unstale":"2023-09-13T06:12:53.492697+0000","last_undegraded":"2023-09-13T06:12:53.492697+0000","last_fullsized":"2023-09-13T06:12:53.492697+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:19:05.758546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.493966+0000","last_change":"2023-09-13T06:12:52.493900+0000","last_active":"2023-09-13T06:12:52.493966+0000","last_peered":"2023-09-13T06:12:52.493966+0000","last_clean":"2023-09-13T06:12:52.493966+0000","last_became_active":"2023-09-13T06:12:52.493633+0000","last_became_peered":"2023-09-13T06:12:52.493633+0000","last_unstale":"2023-09-13T06:12:52.493966+0000","last_undegraded":"2023-09-13T06:12:52.493966+0000","last_fullsized":"2023-09-13T06:12:52.493966+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:00:35.945241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"186'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.774729+0000","last_change":"2023-09-13T06:12:51.771871+0000","last_active":"2023-09-13T06:12:52.774729+0000","last_peered":"2023-09-13T06:12:52.774729+0000","last_clean":"2023-09-13T06:12:52.774729+0000","last_became_active":"2023-09-13T06:12:51.771585+0000","last_became_peered":"2023-09-13T06:12:51.771585+0000","last_unstale":"2023-09-13T06:12:52.774729+0000","last_undegraded":"2023-09-13T06:12:52.774729+0000","last_fullsized":"2023-09-13T06:12:52.774729+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:17:23.624108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492511+0000","last_change":"2023-09-13T06:12:52.494613+0000","last_active":"2023-09-13T06:12:53.492511+0000","last_peered":"2023-09-13T06:12:53.492511+0000","last_clean":"2023-09-13T06:12:53.492511+0000","last_became_active":"2023-09-13T06:12:52.494018+0000","last_became_peered":"2023-09-13T06:12:52.494018+0000","last_unstale":"2023-09-13T06:12:53.492511+0000","last_undegraded":"2023-09-13T06:12:53.492511+0000","last_fullsized":"2023-09-13T06:12:53.492511+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:53:36.849026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"186'1","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492708+0000","last_change":"2023-09-13T06:12:51.766038+0000","last_active":"2023-09-13T06:12:53.492708+0000","last_peered":"2023-09-13T06:12:53.492708+0000","last_clean":"2023-09-13T06:12:53.492708+0000","last_became_active":"2023-09-13T06:12:51.765793+0000","last_became_peered":"2023-09-13T06:12:51.765793+0000","last_unstale":"2023-09-13T06:12:53.492708+0000","last_undegraded":"2023-09-13T06:12:53.492708+0000","last_fullsized":"2023-09-13T06:12:53.492708+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:01:20.696217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492693+0000","last_change":"2023-09-13T06:12:52.496946+0000","last_active":"2023-09-13T06:12:53.492693+0000","last_peered":"2023-09-13T06:12:53.492693+0000","last_clean":"2023-09-13T06:12:53.492693+0000","last_became_active":"2023-09-13T06:12:52.496680+0000","last_became_peered":"2023-09-13T06:12:52.496680+0000","last_unstale":"2023-09-13T06:12:53.492693+0000","last_undegraded":"2023-09-13T06:12:53.492693+0000","last_fullsized":"2023-09-13T06:12:53.492693+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:31:20.106242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.491960+0000","last_change":"2023-09-13T06:12:51.775991+0000","last_active":"2023-09-13T06:12:52.491960+0000","last_peered":"2023-09-13T06:12:52.491960+0000","last_clean":"2023-09-13T06:12:52.491960+0000","last_became_active":"2023-09-13T06:12:51.775601+0000","last_became_peered":"2023-09-13T06:12:51.775601+0000","last_unstale":"2023-09-13T06:12:52.491960+0000","last_undegraded":"2023-09-13T06:12:52.491960+0000","last_fullsized":"2023-09-13T06:12:52.491960+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:01:56.327032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493574+0000","last_change":"2023-09-13T06:12:52.490659+0000","last_active":"2023-09-13T06:12:53.493574+0000","last_peered":"2023-09-13T06:12:53.493574+0000","last_clean":"2023-09-13T06:12:53.493574+0000","last_became_active":"2023-09-13T06:12:52.490162+0000","last_became_peered":"2023-09-13T06:12:52.490162+0000","last_unstale":"2023-09-13T06:12:53.493574+0000","last_undegraded":"2023-09-13T06:12:53.493574+0000","last_fullsized":"2023-09-13T06:12:53.493574+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:08:50.256464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.491247+0000","last_change":"2023-09-13T06:12:51.768767+0000","last_active":"2023-09-13T06:12:52.491247+0000","last_peered":"2023-09-13T06:12:52.491247+0000","last_clean":"2023-09-13T06:12:52.491247+0000","last_became_active":"2023-09-13T06:12:51.768552+0000","last_became_peered":"2023-09-13T06:12:51.768552+0000","last_unstale":"2023-09-13T06:12:52.491247+0000","last_undegraded":"2023-09-13T06:12:52.491247+0000","last_fullsized":"2023-09-13T06:12:52.491247+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:16:22.513927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.493235+0000","last_change":"2023-09-13T06:12:52.493075+0000","last_active":"2023-09-13T06:12:52.493235+0000","last_peered":"2023-09-13T06:12:52.493235+0000","last_clean":"2023-09-13T06:12:52.493235+0000","last_became_active":"2023-09-13T06:12:52.492758+0000","last_became_peered":"2023-09-13T06:12:52.492758+0000","last_unstale":"2023-09-13T06:12:52.493235+0000","last_undegraded":"2023-09-13T06:12:52.493235+0000","last_fullsized":"2023-09-13T06:12:52.493235+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:16:31.118965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493697+0000","last_change":"2023-09-13T06:12:51.772341+0000","last_active":"2023-09-13T06:12:53.493697+0000","last_peered":"2023-09-13T06:12:53.493697+0000","last_clean":"2023-09-13T06:12:53.493697+0000","last_became_active":"2023-09-13T06:12:51.772102+0000","last_became_peered":"2023-09-13T06:12:51.772102+0000","last_unstale":"2023-09-13T06:12:53.493697+0000","last_undegraded":"2023-09-13T06:12:53.493697+0000","last_fullsized":"2023-09-13T06:12:53.493697+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:46:05.090407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.492238+0000","last_change":"2023-09-13T06:12:52.492128+0000","last_active":"2023-09-13T06:12:52.492238+0000","last_peered":"2023-09-13T06:12:52.492238+0000","last_clean":"2023-09-13T06:12:52.492238+0000","last_became_active":"2023-09-13T06:12:52.491904+0000","last_became_peered":"2023-09-13T06:12:52.491904+0000","last_unstale":"2023-09-13T06:12:52.492238+0000","last_undegraded":"2023-09-13T06:12:52.492238+0000","last_fullsized":"2023-09-13T06:12:52.492238+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:58:02.765062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"186'3","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493703+0000","last_change":"2023-09-13T06:12:51.766076+0000","last_active":"2023-09-13T06:12:53.493703+0000","last_peered":"2023-09-13T06:12:53.493703+0000","last_clean":"2023-09-13T06:12:53.493703+0000","last_became_active":"2023-09-13T06:12:51.765801+0000","last_became_peered":"2023-09-13T06:12:51.765801+0000","last_unstale":"2023-09-13T06:12:53.493703+0000","last_undegraded":"2023-09-13T06:12:53.493703+0000","last_fullsized":"2023-09-13T06:12:53.493703+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:21:09.144060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.501160+0000","last_change":"2023-09-13T06:12:52.501092+0000","last_active":"2023-09-13T06:12:52.501160+0000","last_peered":"2023-09-13T06:12:52.501160+0000","last_clean":"2023-09-13T06:12:52.501160+0000","last_became_active":"2023-09-13T06:12:52.500714+0000","last_became_peered":"2023-09-13T06:12:52.500714+0000","last_unstale":"2023-09-13T06:12:52.501160+0000","last_undegraded":"2023-09-13T06:12:52.501160+0000","last_fullsized":"2023-09-13T06:12:52.501160+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:21:53.176689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"186'6","reported_seq":17,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.779146+0000","last_change":"2023-09-13T06:12:51.777783+0000","last_active":"2023-09-13T06:12:52.779146+0000","last_peered":"2023-09-13T06:12:52.779146+0000","last_clean":"2023-09-13T06:12:52.779146+0000","last_became_active":"2023-09-13T06:12:51.777283+0000","last_became_peered":"2023-09-13T06:12:51.777283+0000","last_unstale":"2023-09-13T06:12:52.779146+0000","last_undegraded":"2023-09-13T06:12:52.779146+0000","last_fullsized":"2023-09-13T06:12:52.779146+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:21:31.099902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.494472+0000","last_change":"2023-09-13T06:12:52.494017+0000","last_active":"2023-09-13T06:12:52.494472+0000","last_peered":"2023-09-13T06:12:52.494472+0000","last_clean":"2023-09-13T06:12:52.494472+0000","last_became_active":"2023-09-13T06:12:52.493750+0000","last_became_peered":"2023-09-13T06:12:52.493750+0000","last_unstale":"2023-09-13T06:12:52.494472+0000","last_undegraded":"2023-09-13T06:12:52.494472+0000","last_fullsized":"2023-09-13T06:12:52.494472+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:00:36.443179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"186'2","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493161+0000","last_change":"2023-09-13T06:12:51.766109+0000","last_active":"2023-09-13T06:12:53.493161+0000","last_peered":"2023-09-13T06:12:53.493161+0000","last_clean":"2023-09-13T06:12:53.493161+0000","last_became_active":"2023-09-13T06:12:51.765843+0000","last_became_peered":"2023-09-13T06:12:51.765843+0000","last_unstale":"2023-09-13T06:12:53.493161+0000","last_undegraded":"2023-09-13T06:12:53.493161+0000","last_fullsized":"2023-09-13T06:12:53.493161+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:54:37.490166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498805+0000","last_change":"2023-09-13T06:12:52.498403+0000","last_active":"2023-09-13T06:12:52.498805+0000","last_peered":"2023-09-13T06:12:52.498805+0000","last_clean":"2023-09-13T06:12:52.498805+0000","last_became_active":"2023-09-13T06:12:52.498157+0000","last_became_peered":"2023-09-13T06:12:52.498157+0000","last_unstale":"2023-09-13T06:12:52.498805+0000","last_undegraded":"2023-09-13T06:12:52.498805+0000","last_fullsized":"2023-09-13T06:12:52.498805+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:25:39.987679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.485486+0000","last_change":"2023-09-13T06:12:51.771417+0000","last_active":"2023-09-13T06:12:52.485486+0000","last_peered":"2023-09-13T06:12:52.485486+0000","last_clean":"2023-09-13T06:12:52.485486+0000","last_became_active":"2023-09-13T06:12:51.770812+0000","last_became_peered":"2023-09-13T06:12:51.770812+0000","last_unstale":"2023-09-13T06:12:52.485486+0000","last_undegraded":"2023-09-13T06:12:52.485486+0000","last_fullsized":"2023-09-13T06:12:52.485486+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:46:41.526862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492495+0000","last_change":"2023-09-13T06:12:52.501752+0000","last_active":"2023-09-13T06:12:53.492495+0000","last_peered":"2023-09-13T06:12:53.492495+0000","last_clean":"2023-09-13T06:12:53.492495+0000","last_became_active":"2023-09-13T06:12:52.501563+0000","last_became_peered":"2023-09-13T06:12:52.501563+0000","last_unstale":"2023-09-13T06:12:53.492495+0000","last_undegraded":"2023-09-13T06:12:53.492495+0000","last_fullsized":"2023-09-13T06:12:53.492495+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:12:49.623019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492810+0000","last_change":"2023-09-13T06:12:51.773519+0000","last_active":"2023-09-13T06:12:53.492810+0000","last_peered":"2023-09-13T06:12:53.492810+0000","last_clean":"2023-09-13T06:12:53.492810+0000","last_became_active":"2023-09-13T06:12:51.773268+0000","last_became_peered":"2023-09-13T06:12:51.773268+0000","last_unstale":"2023-09-13T06:12:53.492810+0000","last_undegraded":"2023-09-13T06:12:53.492810+0000","last_fullsized":"2023-09-13T06:12:53.492810+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:41:17.868182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.499837+0000","last_change":"2023-09-13T06:12:52.499734+0000","last_active":"2023-09-13T06:12:52.499837+0000","last_peered":"2023-09-13T06:12:52.499837+0000","last_clean":"2023-09-13T06:12:52.499837+0000","last_became_active":"2023-09-13T06:12:52.499415+0000","last_became_peered":"2023-09-13T06:12:52.499415+0000","last_unstale":"2023-09-13T06:12:52.499837+0000","last_undegraded":"2023-09-13T06:12:52.499837+0000","last_fullsized":"2023-09-13T06:12:52.499837+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:44:29.465325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"186'8","reported_seq":19,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.779446+0000","last_change":"2023-09-13T06:12:51.777760+0000","last_active":"2023-09-13T06:12:52.779446+0000","last_peered":"2023-09-13T06:12:52.779446+0000","last_clean":"2023-09-13T06:12:52.779446+0000","last_became_active":"2023-09-13T06:12:51.777496+0000","last_became_peered":"2023-09-13T06:12:51.777496+0000","last_unstale":"2023-09-13T06:12:52.779446+0000","last_undegraded":"2023-09-13T06:12:52.779446+0000","last_fullsized":"2023-09-13T06:12:52.779446+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:10:57.751382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492909+0000","last_change":"2023-09-13T06:12:52.495690+0000","last_active":"2023-09-13T06:12:53.492909+0000","last_peered":"2023-09-13T06:12:53.492909+0000","last_clean":"2023-09-13T06:12:53.492909+0000","last_became_active":"2023-09-13T06:12:52.495448+0000","last_became_peered":"2023-09-13T06:12:52.495448+0000","last_unstale":"2023-09-13T06:12:53.492909+0000","last_undegraded":"2023-09-13T06:12:53.492909+0000","last_fullsized":"2023-09-13T06:12:53.492909+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:54:16.069000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"186'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.774433+0000","last_change":"2023-09-13T06:12:51.774131+0000","last_active":"2023-09-13T06:12:52.774433+0000","last_peered":"2023-09-13T06:12:52.774433+0000","last_clean":"2023-09-13T06:12:52.774433+0000","last_became_active":"2023-09-13T06:12:51.773733+0000","last_became_peered":"2023-09-13T06:12:51.773733+0000","last_unstale":"2023-09-13T06:12:52.774433+0000","last_undegraded":"2023-09-13T06:12:52.774433+0000","last_fullsized":"2023-09-13T06:12:52.774433+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:06:50.369067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.490852+0000","last_change":"2023-09-13T06:12:52.490661+0000","last_active":"2023-09-13T06:12:52.490852+0000","last_peered":"2023-09-13T06:12:52.490852+0000","last_clean":"2023-09-13T06:12:52.490852+0000","last_became_active":"2023-09-13T06:12:52.490441+0000","last_became_peered":"2023-09-13T06:12:52.490441+0000","last_unstale":"2023-09-13T06:12:52.490852+0000","last_undegraded":"2023-09-13T06:12:52.490852+0000","last_fullsized":"2023-09-13T06:12:52.490852+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:44:20.443030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"186'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.773214+0000","last_change":"2023-09-13T06:12:51.774184+0000","last_active":"2023-09-13T06:12:52.773214+0000","last_peered":"2023-09-13T06:12:52.773214+0000","last_clean":"2023-09-13T06:12:52.773214+0000","last_became_active":"2023-09-13T06:12:51.773768+0000","last_became_peered":"2023-09-13T06:12:51.773768+0000","last_unstale":"2023-09-13T06:12:52.773214+0000","last_undegraded":"2023-09-13T06:12:52.773214+0000","last_fullsized":"2023-09-13T06:12:52.773214+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:05:46.226556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492733+0000","last_change":"2023-09-13T06:12:52.494888+0000","last_active":"2023-09-13T06:12:53.492733+0000","last_peered":"2023-09-13T06:12:53.492733+0000","last_clean":"2023-09-13T06:12:53.492733+0000","last_became_active":"2023-09-13T06:12:52.494341+0000","last_became_peered":"2023-09-13T06:12:52.494341+0000","last_unstale":"2023-09-13T06:12:53.492733+0000","last_undegraded":"2023-09-13T06:12:53.492733+0000","last_fullsized":"2023-09-13T06:12:53.492733+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:46:44.446778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"186'1","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494437+0000","last_change":"2023-09-13T06:12:51.777131+0000","last_active":"2023-09-13T06:12:53.494437+0000","last_peered":"2023-09-13T06:12:53.494437+0000","last_clean":"2023-09-13T06:12:53.494437+0000","last_became_active":"2023-09-13T06:12:51.776578+0000","last_became_peered":"2023-09-13T06:12:51.776578+0000","last_unstale":"2023-09-13T06:12:53.494437+0000","last_undegraded":"2023-09-13T06:12:53.494437+0000","last_fullsized":"2023-09-13T06:12:53.494437+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:25:40.506983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.495364+0000","last_change":"2023-09-13T06:12:52.495290+0000","last_active":"2023-09-13T06:12:52.495364+0000","last_peered":"2023-09-13T06:12:52.495364+0000","last_clean":"2023-09-13T06:12:52.495364+0000","last_became_active":"2023-09-13T06:12:52.494913+0000","last_became_peered":"2023-09-13T06:12:52.494913+0000","last_unstale":"2023-09-13T06:12:52.495364+0000","last_undegraded":"2023-09-13T06:12:52.495364+0000","last_fullsized":"2023-09-13T06:12:52.495364+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:41.250815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494104+0000","last_change":"2023-09-13T06:12:51.768483+0000","last_active":"2023-09-13T06:12:53.494104+0000","last_peered":"2023-09-13T06:12:53.494104+0000","last_clean":"2023-09-13T06:12:53.494104+0000","last_became_active":"2023-09-13T06:12:51.768235+0000","last_became_peered":"2023-09-13T06:12:51.768235+0000","last_unstale":"2023-09-13T06:12:53.494104+0000","last_undegraded":"2023-09-13T06:12:53.494104+0000","last_fullsized":"2023-09-13T06:12:53.494104+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T06:42:48.298862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498848+0000","last_change":"2023-09-13T06:12:52.498735+0000","last_active":"2023-09-13T06:12:52.498848+0000","last_peered":"2023-09-13T06:12:52.498848+0000","last_clean":"2023-09-13T06:12:52.498848+0000","last_became_active":"2023-09-13T06:12:52.498519+0000","last_became_peered":"2023-09-13T06:12:52.498519+0000","last_unstale":"2023-09-13T06:12:52.498848+0000","last_undegraded":"2023-09-13T06:12:52.498848+0000","last_fullsized":"2023-09-13T06:12:52.498848+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:39:32.041149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"186'2","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492792+0000","last_change":"2023-09-13T06:12:51.773219+0000","last_active":"2023-09-13T06:12:53.492792+0000","last_peered":"2023-09-13T06:12:53.492792+0000","last_clean":"2023-09-13T06:12:53.492792+0000","last_became_active":"2023-09-13T06:12:51.773001+0000","last_became_peered":"2023-09-13T06:12:51.773001+0000","last_unstale":"2023-09-13T06:12:53.492792+0000","last_undegraded":"2023-09-13T06:12:53.492792+0000","last_fullsized":"2023-09-13T06:12:53.492792+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:59:08.687299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498826+0000","last_change":"2023-09-13T06:12:52.498541+0000","last_active":"2023-09-13T06:12:52.498826+0000","last_peered":"2023-09-13T06:12:52.498826+0000","last_clean":"2023-09-13T06:12:52.498826+0000","last_became_active":"2023-09-13T06:12:52.498312+0000","last_became_peered":"2023-09-13T06:12:52.498312+0000","last_unstale":"2023-09-13T06:12:52.498826+0000","last_undegraded":"2023-09-13T06:12:52.498826+0000","last_fullsized":"2023-09-13T06:12:52.498826+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:23:23.317805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494279+0000","last_change":"2023-09-13T06:12:51.765675+0000","last_active":"2023-09-13T06:12:53.494279+0000","last_peered":"2023-09-13T06:12:53.494279+0000","last_clean":"2023-09-13T06:12:53.494279+0000","last_became_active":"2023-09-13T06:12:51.765430+0000","last_became_peered":"2023-09-13T06:12:51.765430+0000","last_unstale":"2023-09-13T06:12:53.494279+0000","last_undegraded":"2023-09-13T06:12:53.494279+0000","last_fullsized":"2023-09-13T06:12:53.494279+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:33.033603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494077+0000","last_change":"2023-09-13T06:12:52.496930+0000","last_active":"2023-09-13T06:12:53.494077+0000","last_peered":"2023-09-13T06:12:53.494077+0000","last_clean":"2023-09-13T06:12:53.494077+0000","last_became_active":"2023-09-13T06:12:52.495312+0000","last_became_peered":"2023-09-13T06:12:52.495312+0000","last_unstale":"2023-09-13T06:12:53.494077+0000","last_undegraded":"2023-09-13T06:12:53.494077+0000","last_fullsized":"2023-09-13T06:12:53.494077+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:59:58.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493239+0000","last_change":"2023-09-13T06:12:51.772581+0000","last_active":"2023-09-13T06:12:53.493239+0000","last_peered":"2023-09-13T06:12:53.493239+0000","last_clean":"2023-09-13T06:12:53.493239+0000","last_became_active":"2023-09-13T06:12:51.772126+0000","last_became_peered":"2023-09-13T06:12:51.772126+0000","last_unstale":"2023-09-13T06:12:53.493239+0000","last_undegraded":"2023-09-13T06:12:53.493239+0000","last_fullsized":"2023-09-13T06:12:53.493239+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:09:02.057332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493856+0000","last_change":"2023-09-13T06:12:52.494485+0000","last_active":"2023-09-13T06:12:53.493856+0000","last_peered":"2023-09-13T06:12:53.493856+0000","last_clean":"2023-09-13T06:12:53.493856+0000","last_became_active":"2023-09-13T06:12:52.494159+0000","last_became_peered":"2023-09-13T06:12:52.494159+0000","last_unstale":"2023-09-13T06:12:53.493856+0000","last_undegraded":"2023-09-13T06:12:53.493856+0000","last_fullsized":"2023-09-13T06:12:53.493856+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:08:25.535593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.494483+0000","last_change":"2023-09-13T06:12:51.777678+0000","last_active":"2023-09-13T06:12:53.494483+0000","last_peered":"2023-09-13T06:12:53.494483+0000","last_clean":"2023-09-13T06:12:53.494483+0000","last_became_active":"2023-09-13T06:12:51.776904+0000","last_became_peered":"2023-09-13T06:12:51.776904+0000","last_unstale":"2023-09-13T06:12:53.494483+0000","last_undegraded":"2023-09-13T06:12:53.494483+0000","last_fullsized":"2023-09-13T06:12:53.494483+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:32.431665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.492061+0000","last_change":"2023-09-13T06:12:52.491959+0000","last_active":"2023-09-13T06:12:52.492061+0000","last_peered":"2023-09-13T06:12:52.492061+0000","last_clean":"2023-09-13T06:12:52.492061+0000","last_became_active":"2023-09-13T06:12:52.491720+0000","last_became_peered":"2023-09-13T06:12:52.491720+0000","last_unstale":"2023-09-13T06:12:52.492061+0000","last_undegraded":"2023-09-13T06:12:52.492061+0000","last_fullsized":"2023-09-13T06:12:52.492061+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:14.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"186'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.776632+0000","last_change":"2023-09-13T06:12:51.772954+0000","last_active":"2023-09-13T06:12:52.776632+0000","last_peered":"2023-09-13T06:12:52.776632+0000","last_clean":"2023-09-13T06:12:52.776632+0000","last_became_active":"2023-09-13T06:12:51.772722+0000","last_became_peered":"2023-09-13T06:12:51.772722+0000","last_unstale":"2023-09-13T06:12:52.776632+0000","last_undegraded":"2023-09-13T06:12:52.776632+0000","last_fullsized":"2023-09-13T06:12:52.776632+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:32:36.127964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498850+0000","last_change":"2023-09-13T06:12:52.498627+0000","last_active":"2023-09-13T06:12:52.498850+0000","last_peered":"2023-09-13T06:12:52.498850+0000","last_clean":"2023-09-13T06:12:52.498850+0000","last_became_active":"2023-09-13T06:12:52.498350+0000","last_became_peered":"2023-09-13T06:12:52.498350+0000","last_unstale":"2023-09-13T06:12:52.498850+0000","last_undegraded":"2023-09-13T06:12:52.498850+0000","last_fullsized":"2023-09-13T06:12:52.498850+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:17:44.616134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.496608+0000","last_change":"2023-09-13T06:12:51.772772+0000","last_active":"2023-09-13T06:12:52.496608+0000","last_peered":"2023-09-13T06:12:52.496608+0000","last_clean":"2023-09-13T06:12:52.496608+0000","last_became_active":"2023-09-13T06:12:51.772308+0000","last_became_peered":"2023-09-13T06:12:51.772308+0000","last_unstale":"2023-09-13T06:12:52.496608+0000","last_undegraded":"2023-09-13T06:12:52.496608+0000","last_fullsized":"2023-09-13T06:12:52.496608+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:37:38.684275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.493929+0000","last_change":"2023-09-13T06:12:52.497729+0000","last_active":"2023-09-13T06:12:53.493929+0000","last_peered":"2023-09-13T06:12:53.493929+0000","last_clean":"2023-09-13T06:12:53.493929+0000","last_became_active":"2023-09-13T06:12:52.497307+0000","last_became_peered":"2023-09-13T06:12:52.497307+0000","last_unstale":"2023-09-13T06:12:53.493929+0000","last_undegraded":"2023-09-13T06:12:53.493929+0000","last_fullsized":"2023-09-13T06:12:53.493929+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:44:29.465325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.492116+0000","last_change":"2023-09-13T06:12:51.771831+0000","last_active":"2023-09-13T06:12:52.492116+0000","last_peered":"2023-09-13T06:12:52.492116+0000","last_clean":"2023-09-13T06:12:52.492116+0000","last_became_active":"2023-09-13T06:12:51.771135+0000","last_became_peered":"2023-09-13T06:12:51.771135+0000","last_unstale":"2023-09-13T06:12:52.492116+0000","last_undegraded":"2023-09-13T06:12:52.492116+0000","last_fullsized":"2023-09-13T06:12:52.492116+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:55:35.803341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.489092+0000","last_change":"2023-09-13T06:12:52.488508+0000","last_active":"2023-09-13T06:12:52.489092+0000","last_peered":"2023-09-13T06:12:52.489092+0000","last_clean":"2023-09-13T06:12:52.489092+0000","last_became_active":"2023-09-13T06:12:52.488297+0000","last_became_peered":"2023-09-13T06:12:52.488297+0000","last_unstale":"2023-09-13T06:12:52.489092+0000","last_undegraded":"2023-09-13T06:12:52.489092+0000","last_fullsized":"2023-09-13T06:12:52.489092+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:23:10.793611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.484934+0000","last_change":"2023-09-13T06:12:51.772409+0000","last_active":"2023-09-13T06:12:52.484934+0000","last_peered":"2023-09-13T06:12:52.484934+0000","last_clean":"2023-09-13T06:12:52.484934+0000","last_became_active":"2023-09-13T06:12:51.772152+0000","last_became_peered":"2023-09-13T06:12:51.772152+0000","last_unstale":"2023-09-13T06:12:52.484934+0000","last_undegraded":"2023-09-13T06:12:52.484934+0000","last_fullsized":"2023-09-13T06:12:52.484934+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:49.121259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.493875+0000","last_change":"2023-09-13T06:12:52.493590+0000","last_active":"2023-09-13T06:12:52.493875+0000","last_peered":"2023-09-13T06:12:52.493875+0000","last_clean":"2023-09-13T06:12:52.493875+0000","last_became_active":"2023-09-13T06:12:52.493002+0000","last_became_peered":"2023-09-13T06:12:52.493002+0000","last_unstale":"2023-09-13T06:12:52.493875+0000","last_undegraded":"2023-09-13T06:12:52.493875+0000","last_fullsized":"2023-09-13T06:12:52.493875+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:01:19.155744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.489964+0000","last_change":"2023-09-13T06:12:51.774629+0000","last_active":"2023-09-13T06:12:52.489964+0000","last_peered":"2023-09-13T06:12:52.489964+0000","last_clean":"2023-09-13T06:12:52.489964+0000","last_became_active":"2023-09-13T06:12:51.774359+0000","last_became_peered":"2023-09-13T06:12:51.774359+0000","last_unstale":"2023-09-13T06:12:52.489964+0000","last_undegraded":"2023-09-13T06:12:52.489964+0000","last_fullsized":"2023-09-13T06:12:52.489964+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:41:50.082397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.499424+0000","last_change":"2023-09-13T06:12:52.499245+0000","last_active":"2023-09-13T06:12:52.499424+0000","last_peered":"2023-09-13T06:12:52.499424+0000","last_clean":"2023-09-13T06:12:52.499424+0000","last_became_active":"2023-09-13T06:12:52.498760+0000","last_became_peered":"2023-09-13T06:12:52.498760+0000","last_unstale":"2023-09-13T06:12:52.499424+0000","last_undegraded":"2023-09-13T06:12:52.499424+0000","last_fullsized":"2023-09-13T06:12:52.499424+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:23:10.793611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-09-13T06:12:53.492883+0000","last_change":"2023-09-13T06:12:51.774367+0000","last_active":"2023-09-13T06:12:53.492883+0000","last_peered":"2023-09-13T06:12:53.492883+0000","last_clean":"2023-09-13T06:12:53.492883+0000","last_became_active":"2023-09-13T06:12:51.774134+0000","last_became_peered":"2023-09-13T06:12:51.774134+0000","last_unstale":"2023-09-13T06:12:53.492883+0000","last_undegraded":"2023-09-13T06:12:53.492883+0000","last_fullsized":"2023-09-13T06:12:53.492883+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:09:52.208537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.498867+0000","last_change":"2023-09-13T06:12:52.498718+0000","last_active":"2023-09-13T06:12:52.498867+0000","last_peered":"2023-09-13T06:12:52.498867+0000","last_clean":"2023-09-13T06:12:52.498867+0000","last_became_active":"2023-09-13T06:12:52.498455+0000","last_became_peered":"2023-09-13T06:12:52.498455+0000","last_unstale":"2023-09-13T06:12:52.498867+0000","last_undegraded":"2023-09-13T06:12:52.498867+0000","last_fullsized":"2023-09-13T06:12:52.498867+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:04:38.881877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.491657+0000","last_change":"2023-09-13T06:12:51.770976+0000","last_active":"2023-09-13T06:12:52.491657+0000","last_peered":"2023-09-13T06:12:52.491657+0000","last_clean":"2023-09-13T06:12:52.491657+0000","last_became_active":"2023-09-13T06:12:51.770710+0000","last_became_peered":"2023-09-13T06:12:51.770710+0000","last_unstale":"2023-09-13T06:12:52.491657+0000","last_undegraded":"2023-09-13T06:12:52.491657+0000","last_fullsized":"2023-09-13T06:12:52.491657+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:34:17.480916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.502428+0000","last_change":"2023-09-13T06:12:52.502355+0000","last_active":"2023-09-13T06:12:52.502428+0000","last_peered":"2023-09-13T06:12:52.502428+0000","last_clean":"2023-09-13T06:12:52.502428+0000","last_became_active":"2023-09-13T06:12:52.501911+0000","last_became_peered":"2023-09-13T06:12:52.501911+0000","last_unstale":"2023-09-13T06:12:52.502428+0000","last_undegraded":"2023-09-13T06:12:52.502428+0000","last_fullsized":"2023-09-13T06:12:52.502428+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:13:55.582959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.489768+0000","last_change":"2023-09-13T06:12:51.775451+0000","last_active":"2023-09-13T06:12:52.489768+0000","last_peered":"2023-09-13T06:12:52.489768+0000","last_clean":"2023-09-13T06:12:52.489768+0000","last_became_active":"2023-09-13T06:12:51.774842+0000","last_became_peered":"2023-09-13T06:12:51.774842+0000","last_unstale":"2023-09-13T06:12:52.489768+0000","last_undegraded":"2023-09-13T06:12:52.489768+0000","last_fullsized":"2023-09-13T06:12:52.489768+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:04:16.160132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.492042+0000","last_change":"2023-09-13T06:12:52.491638+0000","last_active":"2023-09-13T06:12:52.492042+0000","last_peered":"2023-09-13T06:12:52.492042+0000","last_clean":"2023-09-13T06:12:52.492042+0000","last_became_active":"2023-09-13T06:12:52.491397+0000","last_became_peered":"2023-09-13T06:12:52.491397+0000","last_unstale":"2023-09-13T06:12:52.492042+0000","last_undegraded":"2023-09-13T06:12:52.492042+0000","last_fullsized":"2023-09-13T06:12:52.492042+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:51.752339+0000","last_clean_scrub_stamp":"2023-09-13T06:12:51.752339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:49:01.116652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.489837+0000","last_change":"2023-09-13T06:12:51.777166+0000","last_active":"2023-09-13T06:12:52.489837+0000","last_peered":"2023-09-13T06:12:52.489837+0000","last_clean":"2023-09-13T06:12:52.489837+0000","last_became_active":"2023-09-13T06:12:51.776917+0000","last_became_peered":"2023-09-13T06:12:51.776917+0000","last_unstale":"2023-09-13T06:12:52.489837+0000","last_undegraded":"2023-09-13T06:12:52.489837+0000","last_fullsized":"2023-09-13T06:12:52.489837+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:12:50.743091+0000","last_clean_scrub_stamp":"2023-09-13T06:12:50.743091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T07:33:29.210291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":348,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-09-13T06:12:52.487929+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:12:52.487929+0000","last_peered":"2023-09-13T06:12:52.487929+0000","last_clean":"2023-09-13T06:12:52.487929+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:12:52.487929+0000","last_undegraded":"2023-09-13T06:12:52.487929+0000","last_fullsized":"2023-09-13T06:12:52.487929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1604,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193707,"statfs":{"total":200000000,"available":198356591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.70499999999999996},"min":{"1min":0.45600000000000002,"5min":0.38100000000000001,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.0589999999999999,"15min":1.3320000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.70799999999999996},"min":{"1min":0.627,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":0.94099999999999995,"5min":1.0089999999999999,"15min":1.0649999999999999},"last":0.72999999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.70599999999999996},"min":{"1min":0.50900000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96199999999999997,"5min":0.999,"15min":0.999},"last":0.874},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.72999999999999998},"min":{"1min":0.58399999999999996,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":0.92900000000000005,"5min":0.95599999999999996,"15min":1.0960000000000001},"last":0.79900000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.432},"max":{"1min":0.84999999999999998,"5min":0.88300000000000001,"15min":1.395},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75,"15min":0.72699999999999998},"min":{"1min":0.56200000000000006,"5min":0.45300000000000001,"15min":0.42899999999999999},"max":{"1min":0.95199999999999996,"5min":0.97099999999999997,"15min":1.2030000000000001},"last":0.66500000000000004}]},{"osd":3,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.75900000000000001,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.47599999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.357},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.79300000000000004,"15min":0.79100000000000004},"min":{"1min":0.68400000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0149999999999999,"15min":1.2629999999999999},"last":0.77900000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.89300000000000002,"15min":0.95899999999999996},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.39300000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.018},"last":0.70099999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64600000000000002,"15min":0.65900000000000003},"min":{"1min":0.45900000000000002,"5min":0.40300000000000002,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.51000000000000001,"5min":0.40400000000000003,"15min":0.371},"max":{"1min":1.004,"5min":1.004,"15min":1.1319999999999999},"last":0.93500000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.55900000000000005,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":0.91900000000000004,"5min":1.0129999999999999,"15min":1.0920000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.69699999999999995},"min":{"1min":0.50600000000000001,"5min":0.48499999999999999,"15min":0.46600000000000003},"max":{"1min":0.89800000000000002,"5min":0.93600000000000005,"15min":1.0229999999999999},"last":0.89500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949291,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.50800000000000001,"5min":0.35599999999999998,"15min":0.35299999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.181},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.72299999999999998,"15min":0.69499999999999995},"min":{"1min":0.56899999999999995,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.028},"last":0.68600000000000005}]},{"osd":1,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.69699999999999995},"min":{"1min":0.50600000000000001,"5min":0.39300000000000002,"15min":0.35499999999999998},"max":{"1min":0.94699999999999995,"5min":1.024,"15min":1.0840000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.54000000000000004,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0900000000000001,"5min":1.137,"15min":1.153},"last":0.73899999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.74099999999999999,"15min":0.72599999999999998},"min":{"1min":0.64000000000000001,"5min":0.53700000000000003,"15min":0.39300000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.4750000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.54000000000000004,"5min":0.49299999999999999,"15min":0.39000000000000001},"max":{"1min":0.89700000000000002,"5min":1.034,"15min":1.085},"last":0.71299999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.76500000000000001,"15min":0.76100000000000001},"min":{"1min":0.59999999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.55900000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.90700000000000003,"5min":1.0129999999999999,"15min":1.526},"last":0.77500000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.626},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.315},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.312},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66700000000000004,"15min":0.68400000000000005},"min":{"1min":0.52900000000000003,"5min":0.39500000000000002,"15min":0.32800000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69699999999999995,"15min":0.71999999999999997},"min":{"1min":0.51100000000000001,"5min":0.45700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":4.3879999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.98299999999999998,"5min":1.056,"15min":1.133},"last":0.60399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194285,"statfs":{"total":200000000,"available":198948709,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.69599999999999995,"15min":0.67300000000000004},"min":{"1min":0.56100000000000005,"5min":0.44400000000000001,"15min":0.32000000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0389999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.71199999999999997,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.33500000000000002,"15min":0.30199999999999999},"max":{"1min":1.0029999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.53100000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.73799999999999999,"15min":0.70399999999999996},"min":{"1min":0.66400000000000003,"5min":0.44500000000000001,"15min":0.36299999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71899999999999997,"15min":0.69299999999999995},"min":{"1min":0.63,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.752,"15min":0.71499999999999997},"min":{"1min":0.57699999999999996,"5min":0.436,"15min":0.40200000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.71799999999999997,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.35699999999999998},"max":{"1min":0.92800000000000005,"5min":1.01,"15min":1.2729999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.54100000000000004,"5min":0.47299999999999998,"15min":0.42799999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.75600000000000001,"15min":0.72399999999999998},"min":{"1min":0.57199999999999995,"5min":0.49099999999999999,"15min":0.47099999999999997},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.76900000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.44400000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.83999999999999997,"5min":0.96999999999999997,"15min":1.0169999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.63},"min":{"1min":0.502,"5min":0.41599999999999998,"15min":0.40300000000000002},"max":{"1min":0.88400000000000001,"5min":0.97499999999999998,"15min":1.077},"last":0.55400000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.50900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.39600000000000002,"15min":0.39200000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.49299999999999999,"5min":0.45100000000000001,"15min":0.41799999999999998},"max":{"1min":1.0049999999999999,"5min":1.171,"15min":1.171},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75700000000000001,"15min":0.74299999999999999},"min":{"1min":0.57999999999999996,"5min":0.51400000000000001,"15min":0.48499999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1027,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194284,"statfs":{"total":200000000,"available":198947631,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68899999999999995,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.38},"max":{"1min":0.98999999999999999,"5min":1.038,"15min":1.145},"last":0.89200000000000002}]},{"osd":1,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.69199999999999995},"min":{"1min":0.50800000000000001,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":0.94599999999999995,"5min":0.997,"15min":1.0960000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.68799999999999994},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.40500000000000003},"max":{"1min":0.93300000000000005,"5min":0.96399999999999997,"15min":1.0309999999999999},"last":0.92500000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73199999999999998,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":0.92600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.748},"min":{"1min":0.57699999999999996,"5min":0.55500000000000005,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":1.056,"15min":1.056},"last":0.85599999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.39000000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.077},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76700000000000002,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.40799999999999997},"max":{"1min":0.93600000000000005,"5min":0.94999999999999996,"15min":1.071},"last":0.872}]},{"osd":5,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64500000000000002,"15min":0.624},"min":{"1min":0.439,"5min":0.41499999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":1.01},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.41799999999999998,"15min":0.34699999999999998},"max":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":1.0960000000000001},"last":0.64900000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.44,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":0.94199999999999995,"15min":1.1930000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.437},"max":{"1min":0.95299999999999996,"5min":1.0169999999999999,"15min":1.123},"last":0.68999999999999995}]},{"osd":7,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.39200000000000002},"max":{"1min":0.93799999999999994,"5min":1.0009999999999999,"15min":1.26},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.98799999999999999,"15min":1.2390000000000001},"last":0.71099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949279,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.443,"15min":0.41599999999999998},"min":{"1min":0.27900000000000003,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.64100000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48599999999999999,"15min":0.45500000000000002},"min":{"1min":0.372,"5min":0.29799999999999999,"15min":0.28299999999999997},"max":{"1min":0.73299999999999998,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.36899999999999999}]},{"osd":1,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46700000000000003,"15min":0.443},"min":{"1min":0.35999999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64900000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51500000000000001,"15min":0.48299999999999998},"min":{"1min":0.39700000000000002,"5min":0.32300000000000001,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.47299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.53100000000000003},"min":{"1min":0.45300000000000001,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.76000000000000001,"5min":0.77000000000000002,"15min":0.78100000000000003},"last":0.499}]},{"osd":4,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.55500000000000005,"5min":0.46700000000000003,"15min":0.42999999999999999},"max":{"1min":1,"5min":1.046,"15min":1.284},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.754,"15min":0.72899999999999998},"min":{"1min":0.64400000000000002,"5min":0.50800000000000001,"15min":0.46800000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76500000000000001,"15min":0.745},"min":{"1min":0.63800000000000001,"5min":0.52700000000000002,"15min":0.442},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96999999999999997,"5min":1.107,"15min":1.2270000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76200000000000001,"15min":0.74099999999999999},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.47499999999999998},"max":{"1min":1.073,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77300000000000002,"15min":0.755},"min":{"1min":0.61899999999999999,"5min":0.55300000000000005,"15min":0.53000000000000003},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.458},"last":0.63900000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.60399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"max":{"1min":1.0489999999999999,"5min":1.1679999999999999,"15min":1.383},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79100000000000004,"15min":0.76800000000000002},"min":{"1min":0.69699999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.02,"5min":1.1850000000000001,"15min":1.27},"last":0.69299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949223,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.443,"15min":0.42999999999999999},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.67700000000000005,"5min":0.745,"15min":10.401},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47599999999999998,"15min":0.45600000000000002},"min":{"1min":0.371,"5min":0.318,"15min":0.27400000000000002},"max":{"1min":0.69699999999999995,"5min":0.79700000000000004,"15min":5.4429999999999996},"last":0.34499999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28499999999999998},"max":{"1min":0.63600000000000001,"5min":0.70099999999999996,"15min":5.2640000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51900000000000002,"15min":0.49199999999999999},"min":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.312},"max":{"1min":0.69699999999999995,"5min":0.78000000000000003,"15min":4.3369999999999997},"last":0.44700000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":6.0410000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.47199999999999998,"5min":0.442,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.85099999999999998,"15min":6.1600000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.78400000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.171,"15min":5.4809999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.55700000000000005,"5min":0.52300000000000002,"15min":0.44700000000000001},"max":{"1min":1.1200000000000001,"5min":1.121,"15min":4.0599999999999996},"last":0.628}]},{"osd":5,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":1.046,"5min":1.1579999999999999,"15min":4.2089999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.83199999999999996,"15min":0.80500000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.501},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":5.5289999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78100000000000003,"15min":0.749},"min":{"1min":0.59799999999999998,"5min":0.505,"15min":0.35099999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":4.1609999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78300000000000003,"15min":0.747},"min":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.1100000000000001,"15min":4.2380000000000004},"last":0.48799999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78900000000000003,"15min":0.753},"min":{"1min":0.59999999999999998,"5min":0.51100000000000001,"15min":0.42699999999999999},"max":{"1min":1.159,"5min":1.1879999999999999,"15min":4.2400000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80400000000000005,"15min":0.77700000000000002},"min":{"1min":0.60499999999999998,"5min":0.53600000000000003,"15min":0.48099999999999998},"max":{"1min":1.0589999999999999,"5min":1.0700000000000001,"15min":4.2649999999999997},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1026,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949313,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.32700000000000001,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.69799999999999995,"5min":0.78100000000000003,"15min":2.4020000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.505,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.27300000000000002},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.81100000000000005},"last":0.376}]},{"osd":2,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.5,"15min":0.47599999999999998},"min":{"1min":0.38600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53600000000000003,"15min":0.49399999999999999},"min":{"1min":0.441,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80000000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.41699999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.54200000000000004},"min":{"1min":0.495,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.86399999999999999,"5min":0.88,"15min":0.88},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.503,"15min":0.497},"min":{"1min":0.36799999999999999,"5min":0.32400000000000001,"15min":0.316},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":4.0599999999999996},"last":0.44500000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77200000000000002,"15min":0.74099999999999999},"min":{"1min":0.59899999999999998,"5min":0.52200000000000002,"15min":0.40400000000000003},"max":{"1min":1.0720000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77100000000000002,"15min":0.749},"min":{"1min":0.623,"5min":0.49399999999999999,"15min":0.44600000000000001},"max":{"1min":0.96899999999999997,"5min":1.121,"15min":1.2150000000000001},"last":0.85199999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77200000000000002,"15min":0.753},"min":{"1min":0.63500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.0860000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.755},"min":{"1min":0.60999999999999999,"5min":0.50800000000000001,"15min":0.42999999999999999},"max":{"1min":0.96199999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.748},"min":{"1min":0.58899999999999997,"5min":0.496,"15min":0.39900000000000002},"max":{"1min":0.95799999999999996,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.79400000000000004,"15min":0.76500000000000001},"min":{"1min":0.63200000000000001,"5min":0.48899999999999999,"15min":0.46100000000000002},"max":{"1min":1.012,"5min":1.0640000000000001,"15min":1.3799999999999999},"last":0.752}]},{"osd":7,"last update":"Wed Sep 13 06:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.78700000000000003,"15min":0.753},"min":{"1min":0.66500000000000004,"5min":0.48299999999999998,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.67900000000000005,"5min":0.505,"15min":0.41699999999999998},"max":{"1min":1.04,"5min":1.0409999999999999,"15min":1.2769999999999999},"last":0.81999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193709,"statfs":{"total":200000000,"available":198358945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46000000000000002,"15min":0.45400000000000001},"min":{"1min":0.28199999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":2.0190000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.316,"15min":0.27500000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":2.294},"last":0.54500000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.50900000000000001},"min":{"1min":0.42099999999999999,"5min":0.35699999999999998,"15min":0.28999999999999998},"max":{"1min":0.78700000000000003,"5min":0.875,"15min":2.2410000000000001},"last":0.372},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.38,"5min":0.315,"15min":0.29499999999999998},"max":{"1min":0.748,"5min":0.76500000000000001,"15min":2.056},"last":0.45600000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":2.0859999999999999},"last":0.433},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.46000000000000002,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.73399999999999999,"5min":0.81000000000000005,"15min":2.3820000000000001},"last":0.41099999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.51000000000000001,"5min":0.47599999999999998,"15min":0.436},"max":{"1min":1.0600000000000001,"5min":1.103,"15min":2.1749999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.61399999999999999,"5min":0.56299999999999994,"15min":0.436},"max":{"1min":1,"5min":1.0940000000000001,"15min":2.3370000000000002},"last":0.63300000000000001}]},{"osd":5,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54800000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.052,"5min":1.2609999999999999,"15min":2.3119999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":1.145,"15min":2.1469999999999998},"last":0.47799999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.57299999999999995,"5min":0.5,"15min":0.47699999999999998},"max":{"1min":1.04,"5min":1.0820000000000001,"15min":2.415},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.64500000000000002,"5min":0.46200000000000002,"15min":0.41499999999999998},"max":{"1min":1.198,"5min":1.198,"15min":2.347},"last":0.61699999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.499,"15min":0.495},"max":{"1min":1.0169999999999999,"5min":1.2130000000000001,"15min":2.367},"last":0.505},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0309999999999999,"5min":1.0489999999999999,"15min":2.1179999999999999},"last":0.66100000000000003}]}]}],"pool_statfs":[]}} 2023-09-13T06:12:57.221 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T06:12:57.222 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-13T06:12:57.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.400+0000 7f9f3ba41640 1 Processor -- start 2023-09-13T06:12:57.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.400+0000 7f9f3ba41640 1 -- start start 2023-09-13T06:12:57.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f3ba41640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9f340b4830 0x7f9f340cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f3ba41640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f340b2750 0x7f9f34159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f3ba41640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340cc9d0 con 0x7f9f34159900 2023-09-13T06:12:57.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f3ba41640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3415a220 con 0x7f9f340b4830 2023-09-13T06:12:57.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f3ba41640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340b0c20 con 0x7f9f340b2750 2023-09-13T06:12:57.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f38fdc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9f340b4830 0x7f9f340cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f39fde640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f340b2750 0x7f9f34159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f39fde640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f340b2750 0x7f9f34159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:47104/0 (socket says 172.21.15.130:47104) 2023-09-13T06:12:57.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f38fdc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9f340b4830 0x7f9f340cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:40198/0 (socket says 172.21.15.130:40198) 2023-09-13T06:12:57.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f39fde640 1 -- 172.21.15.130:0/1771403740 learned_addr learned my addr 172.21.15.130:0/1771403740 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:57.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f39fde640 1 -- 172.21.15.130:0/1771403740 >> v2:172.21.15.164:3300/0 conn(0x7f9f340b4830 msgr2=0x7f9f340cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:57.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f39fde640 1 --2- 172.21.15.130:0/1771403740 >> v2:172.21.15.164:3300/0 conn(0x7f9f340b4830 0x7f9f340cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f39fde640 1 -- 172.21.15.130:0/1771403740 >> v1:172.21.15.164:6789/0 conn(0x7f9f34159900 legacy=0x7f9f340b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.404+0000 7f9f39fde640 1 -- 172.21.15.130:0/1771403740 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340cccb0 con 0x7f9f340b2750 2023-09-13T06:12:57.407 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f39fde640 1 --2- 172.21.15.130:0/1771403740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f340b2750 0x7f9f34159ce0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009e50 tx=0x7f9f2c01c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba47e720a41308c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:57.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f2bfff640 1 -- 172.21.15.130:0/1771403740 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0a57c0 con 0x7f9f340b2750 2023-09-13T06:12:57.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f2bfff640 1 -- 172.21.15.130:0/1771403740 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0a5920 con 0x7f9f340b2750 2023-09-13T06:12:57.408 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f2bfff640 1 -- 172.21.15.130:0/1771403740 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0a5cb0 con 0x7f9f340b2750 2023-09-13T06:12:57.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f3ba41640 1 -- 172.21.15.130:0/1771403740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f340b2750 msgr2=0x7f9f34159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f3ba41640 1 --2- 172.21.15.130:0/1771403740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f340b2750 0x7f9f34159ce0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009e50 tx=0x7f9f2c01c980 comp rx=0 tx=0).stop 2023-09-13T06:12:57.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f3ba41640 1 -- 172.21.15.130:0/1771403740 shutdown_connections 2023-09-13T06:12:57.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f3ba41640 1 --2- 172.21.15.130:0/1771403740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f340b2750 0x7f9f34159ce0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f3ba41640 1 --2- 172.21.15.130:0/1771403740 >> v2:172.21.15.164:3300/0 conn(0x7f9f340b4830 0x7f9f340cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f3ba41640 1 -- 172.21.15.130:0/1771403740 >> 172.21.15.130:0/1771403740 conn(0x7f9f34065990 msgr2=0x7f9f34065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:57.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f3ba41640 1 -- 172.21.15.130:0/1771403740 shutdown_connections 2023-09-13T06:12:57.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f3ba41640 1 -- 172.21.15.130:0/1771403740 wait complete. 2023-09-13T06:12:57.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.408+0000 7f9f3ba41640 1 Processor -- start 2023-09-13T06:12:57.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f3ba41640 1 -- start start 2023-09-13T06:12:57.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f3ba41640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f340b2750 0x7f9f34154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f3ba41640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f340b4830 0x7f9f3406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f3ba41640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f34159900 0x7f9f34153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f3ba41640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f341617c0 con 0x7f9f340b2750 2023-09-13T06:12:57.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f3ba41640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3406dc10 con 0x7f9f340b4830 2023-09-13T06:12:57.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f3ba41640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3406de40 con 0x7f9f34159900 2023-09-13T06:12:57.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f397dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f340b2750 0x7f9f34154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f397dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f340b2750 0x7f9f34154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49648/0 (socket says 172.21.15.130:49648) 2023-09-13T06:12:57.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f397dd640 1 -- 172.21.15.130:0/3078140582 learned_addr learned my addr 172.21.15.130:0/3078140582 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:57.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f38fdc640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f340b4830 0x7f9f3406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f39fde640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f34159900 0x7f9f34153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f397dd640 1 -- 172.21.15.130:0/3078140582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f34159900 msgr2=0x7f9f34153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f397dd640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f34159900 0x7f9f34153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f397dd640 1 -- 172.21.15.130:0/3078140582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f340b4830 msgr2=0x7f9f3406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f397dd640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f340b4830 0x7f9f3406d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f397dd640 1 -- 172.21.15.130:0/3078140582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c009b30 con 0x7f9f340b2750 2023-09-13T06:12:57.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f397dd640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f340b2750 0x7f9f34154620 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000c3a0 tx=0x7f9f3000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:57.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f29ffb640 1 -- 172.21.15.130:0/3078140582 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f300052d0 con 0x7f9f340b2750 2023-09-13T06:12:57.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f29ffb640 1 -- 172.21.15.130:0/3078140582 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f30005450 con 0x7f9f340b2750 2023-09-13T06:12:57.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f3ba41640 1 -- 172.21.15.130:0/3078140582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3406e120 con 0x7f9f340b2750 2023-09-13T06:12:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f29ffb640 1 -- 172.21.15.130:0/3078140582 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30003860 con 0x7f9f340b2750 2023-09-13T06:12:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f3ba41640 1 -- 172.21.15.130:0/3078140582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f341542f0 con 0x7f9f340b2750 2023-09-13T06:12:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.412+0000 7f9f3ba41640 1 -- 172.21.15.130:0/3078140582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f340618a0 con 0x7f9f340b2750 2023-09-13T06:12:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.416+0000 7f9f29ffb640 1 -- 172.21.15.130:0/3078140582 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9f300039c0 con 0x7f9f340b2750 2023-09-13T06:12:57.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.416+0000 7f9f29ffb640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f18065b20 0x7f9f18067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.416+0000 7f9f29ffb640 1 -- 172.21.15.130:0/3078140582 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f30082840 con 0x7f9f340b2750 2023-09-13T06:12:57.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.416+0000 7f9f38fdc640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f18065b20 0x7f9f18067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.416+0000 7f9f38fdc640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f18065b20 0x7f9f18067fe0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9f34065e40 tx=0x7f9f2400a2a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:57.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.420+0000 7f9f29ffb640 1 -- 172.21.15.130:0/3078140582 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9f300501a0 con 0x7f9f340b2750 2023-09-13T06:12:57.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.620+0000 7f9f3ba41640 1 -- 172.21.15.130:0/3078140582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9f340af220 con 0x7f9f340b2750 2023-09-13T06:12:57.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.624+0000 7f9f29ffb640 1 -- 172.21.15.130:0/3078140582 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9f300170b0 con 0x7f9f340b2750 2023-09-13T06:12:57.625 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-09-13T06:12:57.626 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAOUAFl30kkMxAAskwgGTtjoRESnIGPaOYBYA== 2023-09-13T06:12:57.626 INFO:teuthology.orchestra.run.smithi130.stdout: caps mds = "allow" 2023-09-13T06:12:57.626 INFO:teuthology.orchestra.run.smithi130.stdout: caps mon = "allow r" 2023-09-13T06:12:57.626 INFO:teuthology.orchestra.run.smithi130.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-13T06:12:57.626 INFO:teuthology.orchestra.run.smithi130.stderr:updated caps for client.0 2023-09-13T06:12:57.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 -- 172.21.15.130:0/3078140582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f18065b20 msgr2=0x7f9f18067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f18065b20 0x7f9f18067fe0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9f34065e40 tx=0x7f9f2400a2a0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 -- 172.21.15.130:0/3078140582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f340b2750 msgr2=0x7f9f34154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f340b2750 0x7f9f34154620 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000c3a0 tx=0x7f9f3000c860 comp rx=0 tx=0).stop 2023-09-13T06:12:57.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 -- 172.21.15.130:0/3078140582 shutdown_connections 2023-09-13T06:12:57.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f18065b20 0x7f9f18067fe0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f340b4830 0x7f9f3406d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f34159900 0x7f9f34153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 --2- 172.21.15.130:0/3078140582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f340b2750 0x7f9f34154620 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 -- 172.21.15.130:0/3078140582 >> 172.21.15.130:0/3078140582 conn(0x7f9f34065990 msgr2=0x7f9f340ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:57.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 -- 172.21.15.130:0/3078140582 shutdown_connections 2023-09-13T06:12:57.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.628+0000 7f9f3ba41640 1 -- 172.21.15.130:0/3078140582 wait complete. 2023-09-13T06:12:57.647 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:12:57.742 INFO:tasks.ceph.mds.d.smithi164.stderr:2023-09-13T06:12:57.746+0000 7f297f955640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:12:57.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.784+0000 7fba90dc6640 1 Processor -- start 2023-09-13T06:12:57.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.784+0000 7fba90dc6640 1 -- start start 2023-09-13T06:12:57.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba90dc6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fba8c15b130 0x7fba8c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba90dc6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fba8c0b04a0 0x7fba8c0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba90dc6640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c0ce980 con 0x7fba8c0ce180 2023-09-13T06:12:57.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba90dc6640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c0b0e50 con 0x7fba8c15b130 2023-09-13T06:12:57.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba90dc6640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c0cec60 con 0x7fba8c0b04a0 2023-09-13T06:12:57.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba8a59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fba8c15b130 0x7fba8c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba83fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fba8c0ce180 0x7fba8c15b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43146/0 (socket says 172.21.15.130:43146) 2023-09-13T06:12:57.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba83fff640 1 -- 172.21.15.130:0/1695194803 learned_addr learned my addr 172.21.15.130:0/1695194803 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:57.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba8a59c640 1 -- 172.21.15.130:0/1695194803 >> v2:172.21.15.164:3300/0 conn(0x7fba8c0b04a0 msgr2=0x7fba8c0b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:57.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba8a59c640 1 --2- 172.21.15.130:0/1695194803 >> v2:172.21.15.164:3300/0 conn(0x7fba8c0b04a0 0x7fba8c0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba8a59c640 1 -- 172.21.15.130:0/1695194803 >> v1:172.21.15.130:6789/0 conn(0x7fba8c0ce180 legacy=0x7fba8c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba8a59c640 1 -- 172.21.15.130:0/1695194803 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c06c640 con 0x7fba8c15b130 2023-09-13T06:12:57.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba89d9b640 1 -- 172.21.15.130:0/1695194803 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968492247 0 0) 0x7fba8c0ce980 con 0x7fba8c0ce180 2023-09-13T06:12:57.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.788+0000 7fba8a59c640 1 --2- 172.21.15.130:0/1695194803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c15b130 0x7fba8c0cc780 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0b28c0 tx=0x7fba7c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6580ddf348d5319a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:57.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba89d9b640 1 -- 172.21.15.130:0/1695194803 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0ab660 con 0x7fba8c15b130 2023-09-13T06:12:57.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba89d9b640 1 -- 172.21.15.130:0/1695194803 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c0ab7c0 con 0x7fba8c15b130 2023-09-13T06:12:57.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba89d9b640 1 -- 172.21.15.130:0/1695194803 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0abb50 con 0x7fba8c15b130 2023-09-13T06:12:57.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 -- 172.21.15.130:0/1695194803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c15b130 msgr2=0x7fba8c0cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 --2- 172.21.15.130:0/1695194803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c15b130 0x7fba8c0cc780 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0b28c0 tx=0x7fba7c01c460 comp rx=0 tx=0).stop 2023-09-13T06:12:57.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 -- 172.21.15.130:0/1695194803 shutdown_connections 2023-09-13T06:12:57.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 --2- 172.21.15.130:0/1695194803 >> v2:172.21.15.164:3300/0 conn(0x7fba8c0b04a0 0x7fba8c0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 --2- 172.21.15.130:0/1695194803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c15b130 0x7fba8c0cc780 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 -- 172.21.15.130:0/1695194803 >> 172.21.15.130:0/1695194803 conn(0x7fba8c065990 msgr2=0x7fba8c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:57.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 -- 172.21.15.130:0/1695194803 shutdown_connections 2023-09-13T06:12:57.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 -- 172.21.15.130:0/1695194803 wait complete. 2023-09-13T06:12:57.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 Processor -- start 2023-09-13T06:12:57.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 -- start start 2023-09-13T06:12:57.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c0b04a0 0x7fba8c164f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba8c0ce180 0x7fba8c15f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba8c15b130 0x7fba8c15f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c1609c0 con 0x7fba8c0b04a0 2023-09-13T06:12:57.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c165470 con 0x7fba8c0ce180 2023-09-13T06:12:57.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba90dc6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c15fa90 con 0x7fba8c15b130 2023-09-13T06:12:57.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.792+0000 7fba8a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c0b04a0 0x7fba8c164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba8a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c0b04a0 0x7fba8c164f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49668/0 (socket says 172.21.15.130:49668) 2023-09-13T06:12:57.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba8a59c640 1 -- 172.21.15.130:0/1702847665 learned_addr learned my addr 172.21.15.130:0/1702847665 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:57.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba83fff640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba8c0ce180 0x7fba8c15f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba8ad9d640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba8c15b130 0x7fba8c15f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba8a59c640 1 -- 172.21.15.130:0/1702847665 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba8c15b130 msgr2=0x7fba8c15f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba8a59c640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba8c15b130 0x7fba8c15f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba8a59c640 1 -- 172.21.15.130:0/1702847665 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba8c0ce180 msgr2=0x7fba8c15f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba8a59c640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba8c0ce180 0x7fba8c15f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba8a59c640 1 -- 172.21.15.130:0/1702847665 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c009420 con 0x7fba8c0b04a0 2023-09-13T06:12:57.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba8ad9d640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba8c15b130 0x7fba8c15f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:57.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba8a59c640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c0b04a0 0x7fba8c164f30 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fba7c019070 tx=0x7fba7c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:57.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba82ffd640 1 -- 172.21.15.130:0/1702847665 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0b5810 con 0x7fba8c0b04a0 2023-09-13T06:12:57.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba82ffd640 1 -- 172.21.15.130:0/1702847665 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c0b5990 con 0x7fba8c0b04a0 2023-09-13T06:12:57.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba82ffd640 1 -- 172.21.15.130:0/1702847665 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0b5d40 con 0x7fba8c0b04a0 2023-09-13T06:12:57.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba90dc6640 1 -- 172.21.15.130:0/1702847665 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c15fd40 con 0x7fba8c0b04a0 2023-09-13T06:12:57.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba90dc6640 1 -- 172.21.15.130:0/1702847665 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c160300 con 0x7fba8c0b04a0 2023-09-13T06:12:57.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba90dc6640 1 -- 172.21.15.130:0/1702847665 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8c0618a0 con 0x7fba8c0b04a0 2023-09-13T06:12:57.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba82ffd640 1 -- 172.21.15.130:0/1702847665 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fba7c0a9070 con 0x7fba8c0b04a0 2023-09-13T06:12:57.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba82ffd640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fba6c065b20 0x7fba6c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:57.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba82ffd640 1 -- 172.21.15.130:0/1702847665 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba7c11db40 con 0x7fba8c0b04a0 2023-09-13T06:12:57.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.796+0000 7fba83fff640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fba6c065b20 0x7fba6c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:57.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.800+0000 7fba83fff640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fba6c065b20 0x7fba6c067fe0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fba8c15d8f0 tx=0x7fba74007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:57.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.800+0000 7fba82ffd640 1 -- 172.21.15.130:0/1702847665 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fba7c0eb650 con 0x7fba8c0b04a0 2023-09-13T06:12:57.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.988+0000 7fba90dc6640 1 -- 172.21.15.130:0/1702847665 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba8c157480 con 0x7fba8c0b04a0 2023-09-13T06:12:57.989 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.988+0000 7fba82ffd640 1 -- 172.21.15.130:0/1702847665 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fba7c0eec70 con 0x7fba8c0b04a0 2023-09-13T06:12:57.989 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:12:57.989 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/519371055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":519371055},{"type":"v1","addr":"172.21.15.130:6837","nonce":519371055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2464101241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2464101241},{"type":"v1","addr":"172.21.15.130:6836","nonce":2464101241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3066690343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3066690343},{"type":"v1","addr":"172.21.15.164:6833","nonce":3066690343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:12:52.135181+0000","modified":"2023-09-13T06:12:55.174886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8272":{"gid":8272,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2477052868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2477052868},{"type":"v1","addr":"172.21.15.164:6835","nonce":2477052868}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-09-13T06:12:57.990 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 92 2023-09-13T06:12:57.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 -- 172.21.15.130:0/1702847665 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fba6c065b20 msgr2=0x7fba6c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fba6c065b20 0x7fba6c067fe0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fba8c15d8f0 tx=0x7fba74007d60 comp rx=0 tx=0).stop 2023-09-13T06:12:57.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 -- 172.21.15.130:0/1702847665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c0b04a0 msgr2=0x7fba8c164f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:57.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c0b04a0 0x7fba8c164f30 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fba7c019070 tx=0x7fba7c01aca0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 -- 172.21.15.130:0/1702847665 shutdown_connections 2023-09-13T06:12:57.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fba6c065b20 0x7fba6c067fe0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.992 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba8c0ce180 0x7fba8c15f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba8c15b130 0x7fba8c15f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 --2- 172.21.15.130:0/1702847665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c0b04a0 0x7fba8c164f30 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:57.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 -- 172.21.15.130:0/1702847665 >> 172.21.15.130:0/1702847665 conn(0x7fba8c065990 msgr2=0x7fba8c1560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:57.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 -- 172.21.15.130:0/1702847665 shutdown_connections 2023-09-13T06:12:57.993 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:57.992+0000 7fba90dc6640 1 -- 172.21.15.130:0/1702847665 wait complete. 2023-09-13T06:12:58.414 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T06:12:52.135181+0000', 'modified': '2023-09-13T06:12:55.174886+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8272': {'gid': 8272, 'name': 'd', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.164:6835/2477052868', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 2477052868}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 2477052868}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T06:12:58.414 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T06:12:58.415 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-09-13T06:12:58.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.556+0000 7f0322d2c640 1 Processor -- start 2023-09-13T06:12:58.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.556+0000 7f0322d2c640 1 -- start start 2023-09-13T06:12:58.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.556+0000 7f0322d2c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f031c070d60 0x7f031c160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.556+0000 7f0322d2c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031c06f640 con 0x7f031c146540 2023-09-13T06:12:58.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f0322d2c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031c06f890 con 0x7f031c1436e0 2023-09-13T06:12:58.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f0322d2c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031c06fb70 con 0x7f031c070d60 2023-09-13T06:12:58.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f031bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f031c146540 0x7f031c070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43162/0 (socket says 172.21.15.130:43162) 2023-09-13T06:12:58.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f031bfff640 1 -- 172.21.15.130:0/3732476600 learned_addr learned my addr 172.21.15.130:0/3732476600 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:58.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f03212c9640 1 --2- 172.21.15.130:0/3732476600 >> v2:172.21.15.130:3300/0 conn(0x7f031c070d60 0x7f031c160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f031b7fe640 1 -- 172.21.15.130:0/3732476600 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697875196 0 0) 0x7f031c06f640 con 0x7f031c146540 2023-09-13T06:12:58.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f031b7fe640 1 -- 172.21.15.130:0/3732476600 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f030c003530 con 0x7f031c146540 2023-09-13T06:12:58.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f03212c9640 1 -- 172.21.15.130:0/3732476600 >> v1:172.21.15.164:6789/0 conn(0x7f031c1436e0 legacy=0x7f031c0ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f03212c9640 1 -- 172.21.15.130:0/3732476600 >> v1:172.21.15.130:6789/0 conn(0x7f031c146540 legacy=0x7f031c070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f03212c9640 1 -- 172.21.15.130:0/3732476600 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c06fe50 con 0x7f031c070d60 2023-09-13T06:12:58.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f03212c9640 1 --2- 172.21.15.130:0/3732476600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f031c070d60 0x7f031c160eb0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f0314009d90 tx=0x7f031401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1279258758026b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:58.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f031b7fe640 1 -- 172.21.15.130:0/3732476600 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140a5800 con 0x7f031c070d60 2023-09-13T06:12:58.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f031b7fe640 1 -- 172.21.15.130:0/3732476600 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03140a5960 con 0x7f031c070d60 2023-09-13T06:12:58.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.560+0000 7f031b7fe640 1 -- 172.21.15.130:0/3732476600 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140a5cf0 con 0x7f031c070d60 2023-09-13T06:12:58.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 -- 172.21.15.130:0/3732476600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f031c070d60 msgr2=0x7f031c160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 --2- 172.21.15.130:0/3732476600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f031c070d60 0x7f031c160eb0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f0314009d90 tx=0x7f031401c830 comp rx=0 tx=0).stop 2023-09-13T06:12:58.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 -- 172.21.15.130:0/3732476600 shutdown_connections 2023-09-13T06:12:58.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 --2- 172.21.15.130:0/3732476600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f031c070d60 0x7f031c160eb0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 -- 172.21.15.130:0/3732476600 >> 172.21.15.130:0/3732476600 conn(0x7f031c0b0bc0 msgr2=0x7f031c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:58.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 -- 172.21.15.130:0/3732476600 shutdown_connections 2023-09-13T06:12:58.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 -- 172.21.15.130:0/3732476600 wait complete. 2023-09-13T06:12:58.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 Processor -- start 2023-09-13T06:12:58.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 -- start start 2023-09-13T06:12:58.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f031c070d60 0x7f031c15c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f031c1436e0 0x7f031c160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f031c146540 0x7f031c0aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c15cd60 con 0x7f031c070d60 2023-09-13T06:12:58.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c13d420 con 0x7f031c146540 2023-09-13T06:12:58.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0322d2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031c1607e0 con 0x7f031c1436e0 2023-09-13T06:12:58.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0320ac8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f031c070d60 0x7f031c15c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.568 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0320ac8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f031c070d60 0x7f031c15c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49688/0 (socket says 172.21.15.130:49688) 2023-09-13T06:12:58.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f0320ac8640 1 -- 172.21.15.130:0/1420788485 learned_addr learned my addr 172.21.15.130:0/1420788485 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:58.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f031bfff640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f031c1436e0 0x7f031c160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.564+0000 7f03212c9640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f031c146540 0x7f031c0aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f0320ac8640 1 -- 172.21.15.130:0/1420788485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f031c1436e0 msgr2=0x7f031c160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f0320ac8640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f031c1436e0 0x7f031c160000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f0320ac8640 1 -- 172.21.15.130:0/1420788485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f031c146540 msgr2=0x7f031c0aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f0320ac8640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f031c146540 0x7f031c0aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f0320ac8640 1 -- 172.21.15.130:0/1420788485 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0314009a70 con 0x7f031c070d60 2023-09-13T06:12:58.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f0320ac8640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f031c070d60 0x7f031c15c820 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f031000c420 tx=0x7f031000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:58.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f03197fa640 1 -- 172.21.15.130:0/1420788485 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03100052d0 con 0x7f031c070d60 2023-09-13T06:12:58.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f03197fa640 1 -- 172.21.15.130:0/1420788485 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0310005430 con 0x7f031c070d60 2023-09-13T06:12:58.573 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f0322d2c640 1 -- 172.21.15.130:0/1420788485 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031c13bec0 con 0x7f031c070d60 2023-09-13T06:12:58.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f03197fa640 1 -- 172.21.15.130:0/1420788485 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0310003840 con 0x7f031c070d60 2023-09-13T06:12:58.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f0322d2c640 1 -- 172.21.15.130:0/1420788485 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031c160540 con 0x7f031c070d60 2023-09-13T06:12:58.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.568+0000 7f03197fa640 1 -- 172.21.15.130:0/1420788485 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f03100039a0 con 0x7f031c070d60 2023-09-13T06:12:58.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03197fa640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0300065b20 0x7f0300067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.574 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03197fa640 1 -- 172.21.15.130:0/1420788485 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0310082770 con 0x7f031c070d60 2023-09-13T06:12:58.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f031bfff640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0300065b20 0x7f0300067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 Processor -- start 2023-09-13T06:12:58.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 -- start start 2023-09-13T06:12:58.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f031bfff640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0300065b20 0x7f0300067fe0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f031c13c2c0 tx=0x7f0308007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:58.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313e550 0x55a06313e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a063122d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a0631232b0 0x55a063123690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a062fbc1e0 con 0x55a06313ee70 2023-09-13T06:12:58.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a062f4b4c0 con 0x55a06313e550 2023-09-13T06:12:58.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a062f489f0 con 0x55a0631232b0 2023-09-13T06:12:58.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f031bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a063122d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f031bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a063122d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49690/0 (socket says 172.21.15.130:49690) 2023-09-13T06:12:58.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f031bfff640 1 -- 172.21.15.130:0/672589587 learned_addr learned my addr 172.21.15.130:0/672589587 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:58.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03212c9640 1 --2- 172.21.15.130:0/672589587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a0631232b0 0x55a063123690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f0320ac8640 1 --2- 172.21.15.130:0/672589587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313e550 0x55a06313e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f031bfff640 1 -- 172.21.15.130:0/672589587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a0631232b0 msgr2=0x55a063123690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:58.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f031bfff640 1 --2- 172.21.15.130:0/672589587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a0631232b0 0x55a063123690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f031bfff640 1 -- 172.21.15.130:0/672589587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313e550 msgr2=0x55a06313e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:58.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f031bfff640 1 --2- 172.21.15.130:0/672589587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313e550 0x55a06313e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f031bfff640 1 -- 172.21.15.130:0/672589587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a062c3e890 con 0x55a06313ee70 2023-09-13T06:12:58.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f0320ac8640 1 --2- 172.21.15.130:0/672589587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313e550 0x55a06313e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:58.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f031bfff640 1 --2- 172.21.15.130:0/672589587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a063122d70 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f0308005a80 tx=0x7f0308012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01c737817531e3c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:58.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03067fc640 1 -- 172.21.15.130:0/672589587 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03080014f0 con 0x55a06313ee70 2023-09-13T06:12:58.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03067fc640 1 -- 172.21.15.130:0/672589587 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0308001650 con 0x55a06313ee70 2023-09-13T06:12:58.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03067fc640 1 -- 172.21.15.130:0/672589587 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03080019c0 con 0x55a06313ee70 2023-09-13T06:12:58.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 -- 172.21.15.130:0/672589587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 msgr2=0x55a063122d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 --2- 172.21.15.130:0/672589587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a063122d70 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f0308005a80 tx=0x7f0308012000 comp rx=0 tx=0).stop 2023-09-13T06:12:58.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 -- 172.21.15.130:0/672589587 shutdown_connections 2023-09-13T06:12:58.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 --2- 172.21.15.130:0/672589587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a0631232b0 0x55a063123690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 --2- 172.21.15.130:0/672589587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a063122d70 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 --2- 172.21.15.130:0/672589587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313e550 0x55a06313e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 -- 172.21.15.130:0/672589587 >> 172.21.15.130:0/672589587 conn(0x55a0630ebc40 msgr2=0x55a0630fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:58.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 -- 172.21.15.130:0/672589587 shutdown_connections 2023-09-13T06:12:58.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.572+0000 7f03260ae000 1 -- 172.21.15.130:0/672589587 wait complete. 2023-09-13T06:12:58.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 -- start start 2023-09-13T06:12:58.585 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 Processor -- start 2023-09-13T06:12:58.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a0631232b0 0x55a063122d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313e550 0x55a0630f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a062f442e0 con 0x55a06313ee70 2023-09-13T06:12:58.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a062efefe0 con 0x55a06313e550 2023-09-13T06:12:58.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a062efec80 con 0x55a0631232b0 2023-09-13T06:12:58.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 10 client.0 _ll_register_callbacks cb 0x55a0630e0260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:12:58.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03212c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03212c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49702/0 (socket says 172.21.15.130:49702) 2023-09-13T06:12:58.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03212c9640 1 -- 172.21.15.130:0/549926538 learned_addr learned my addr 172.21.15.130:0/549926538 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:58.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f0320ac8640 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a0631232b0 0x55a063122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f031bfff640 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313e550 0x55a0630f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03212c9640 1 -- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a0631232b0 msgr2=0x55a063122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:58.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03212c9640 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a0631232b0 0x55a063122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03212c9640 1 -- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313e550 msgr2=0x55a0630f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:58.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03212c9640 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313e550 0x55a0630f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03212c9640 1 -- 172.21.15.130:0/549926538 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030c003530 con 0x55a06313ee70 2023-09-13T06:12:58.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03212c9640 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f85e0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f0314019440 tx=0x7f031401b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8ca7e79a955489 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:58.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f02fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:12:58.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f02fb7fe640 1 -- 172.21.15.130:0/549926538 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140a5cf0 con 0x55a06313ee70 2023-09-13T06:12:58.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 -- 172.21.15.130:0/549926538 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a062edba50 con 0x55a06313ee70 2023-09-13T06:12:58.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f02fb7fe640 1 -- 172.21.15.130:0/549926538 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03140b8440 con 0x55a06313ee70 2023-09-13T06:12:58.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f02fb7fe640 1 -- 172.21.15.130:0/549926538 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03140a5e50 con 0x55a06313ee70 2023-09-13T06:12:58.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 10 client.9198 fetch_fsmap learned FSMap version 92 2023-09-13T06:12:58.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 -- 172.21.15.130:0/549926538 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55a062f07210 con 0x55a06313ee70 2023-09-13T06:12:58.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f02fb7fe640 1 -- 172.21.15.130:0/549926538 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a062edba50 con 0x55a06313ee70 2023-09-13T06:12:58.590 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f02fb7fe640 1 -- 172.21.15.130:0/549926538 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 92) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f03140b8600 con 0x55a06313ee70 2023-09-13T06:12:58.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 10 client.9198 fetch_fsmap finished waiting for FSMap version 92 2023-09-13T06:12:58.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 10 client.9198 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-13T06:12:58.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 20 client.9198 populate_metadata read hostname 'smithi130' 2023-09-13T06:12:58.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:6834/2477052868,v1:172.21.15.164:6835/2477052868] conn(0x55a0630f9380 0x55a063150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 4 client.9198 mds_command: new command op to 8272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T06:12:58.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f03260ae000 1 -- 172.21.15.130:0/549926538 --> [v2:172.21.15.164:6834/2477052868,v1:172.21.15.164:6835/2477052868] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a062efb820 con 0x55a0630f9380 2023-09-13T06:12:58.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.576+0000 7f0320ac8640 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:6834/2477052868,v1:172.21.15.164:6835/2477052868] conn(0x55a0630f9380 0x55a063150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f0320ac8640 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:6834/2477052868,v1:172.21.15.164:6835/2477052868] conn(0x55a0630f9380 0x55a063150600 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f137b7c83d2a8306 server_cookie=366e8e9a4eef034b in_seq=0 out_seq=0 2023-09-13T06:12:58.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f02fb7fe640 10 client.9198 ms_handle_connect on v2:172.21.15.164:6834/2477052868 2023-09-13T06:12:58.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f02fb7fe640 1 -- 172.21.15.130:0/549926538 <== mds.0 v2:172.21.15.164:6834/2477052868 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a062efb820 con 0x55a0630f9380 2023-09-13T06:12:58.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f02fb7fe640 10 client.9198 handle_command_reply: tid=0 2023-09-13T06:12:58.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 1 client.9198 shutdown 2023-09-13T06:12:58.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 1 -- 172.21.15.130:0/549926538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 msgr2=0x55a0630f85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f85e0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f0314019440 tx=0x7f031401b070 comp rx=0 tx=0).stop 2023-09-13T06:12:58.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 1 -- 172.21.15.130:0/549926538 shutdown_connections 2023-09-13T06:12:58.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:6834/2477052868,v1:172.21.15.164:6835/2477052868] conn(0x55a0630f9380 0x55a063150600 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313e550 0x55a0630f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f85e0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 1 --2- 172.21.15.130:0/549926538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a0631232b0 0x55a063122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f02fb7fe640 0 client.9198 ms_handle_reset on v2:172.21.15.164:6834/2477052868 2023-09-13T06:12:58.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 1 -- 172.21.15.130:0/549926538 >> 172.21.15.130:0/549926538 conn(0x55a0630ebc40 msgr2=0x55a063124130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:58.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 1 -- 172.21.15.130:0/549926538 shutdown_connections 2023-09-13T06:12:58.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 1 -- 172.21.15.130:0/549926538 wait complete. 2023-09-13T06:12:58.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.580+0000 7f03260ae000 20 client.9198 trim_cache size 0 max 16384 2023-09-13T06:12:58.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 Processor -- start 2023-09-13T06:12:58.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 -- start start 2023-09-13T06:12:58.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a0631232b0 0x55a0630f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a06313e550 0x55a0630f7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a062bff940 con 0x55a06313ee70 2023-09-13T06:12:58.597 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a06313e200 con 0x55a0631232b0 2023-09-13T06:12:58.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a062f15f00 con 0x55a06313e550 2023-09-13T06:12:58.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03212c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03212c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49718/0 (socket says 172.21.15.130:49718) 2023-09-13T06:12:58.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03212c9640 1 -- 172.21.15.130:0/897387331 learned_addr learned my addr 172.21.15.130:0/897387331 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:58.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03212c9640 1 -- 172.21.15.130:0/897387331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a06313e550 msgr2=0x55a0630f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:58.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f031bfff640 1 --2- 172.21.15.130:0/897387331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a06313e550 0x55a0630f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f0320ac8640 1 --2- 172.21.15.130:0/897387331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a0631232b0 0x55a0630f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03212c9640 1 --2- 172.21.15.130:0/897387331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a06313e550 0x55a0630f7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03212c9640 1 -- 172.21.15.130:0/897387331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a0631232b0 msgr2=0x55a0630f85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:58.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03212c9640 1 --2- 172.21.15.130:0/897387331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a0631232b0 0x55a0630f85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03212c9640 1 -- 172.21.15.130:0/897387331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a062eed4a0 con 0x55a06313ee70 2023-09-13T06:12:58.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f0320ac8640 1 --2- 172.21.15.130:0/897387331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a0631232b0 0x55a0630f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:12:58.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03212c9640 1 --2- 172.21.15.130:0/897387331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f7590 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f03140c9040 tx=0x7f03140ba040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4cc996cd5d5b0a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:58.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f0306ffd640 1 -- 172.21.15.130:0/897387331 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140a5c20 con 0x55a06313ee70 2023-09-13T06:12:58.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f0306ffd640 1 -- 172.21.15.130:0/897387331 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03140a5d80 con 0x55a06313ee70 2023-09-13T06:12:58.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f0306ffd640 1 -- 172.21.15.130:0/897387331 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140b8660 con 0x55a06313ee70 2023-09-13T06:12:58.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 -- 172.21.15.130:0/897387331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 msgr2=0x55a0630f7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 --2- 172.21.15.130:0/897387331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f7590 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f03140c9040 tx=0x7f03140ba040 comp rx=0 tx=0).stop 2023-09-13T06:12:58.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 -- 172.21.15.130:0/897387331 shutdown_connections 2023-09-13T06:12:58.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 --2- 172.21.15.130:0/897387331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06313ee70 0x55a0630f7590 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 --2- 172.21.15.130:0/897387331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a06313e550 0x55a0630f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 --2- 172.21.15.130:0/897387331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a0631232b0 0x55a0630f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 -- 172.21.15.130:0/897387331 >> 172.21.15.130:0/897387331 conn(0x55a0630ebc40 msgr2=0x55a06314bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:58.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.596+0000 7f03260ae000 1 -- 172.21.15.130:0/897387331 shutdown_connections 2023-09-13T06:12:58.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 -- 172.21.15.130:0/897387331 wait complete. 2023-09-13T06:12:58.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 -- start start 2023-09-13T06:12:58.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 Processor -- start 2023-09-13T06:12:58.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0631232b0 0x55a06319c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a06313e550 0x55a063150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313ee70 0x55a0631513f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a062f43170 con 0x55a0631232b0 2023-09-13T06:12:58.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a062f044b0 con 0x55a06313ee70 2023-09-13T06:12:58.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0630fae70 con 0x55a06313e550 2023-09-13T06:12:58.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 10 client.0 _ll_register_callbacks cb 0x55a062efaea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T06:12:58.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f0320ac8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0631232b0 0x55a06319c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f0320ac8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0631232b0 0x55a06319c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49726/0 (socket says 172.21.15.130:49726) 2023-09-13T06:12:58.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f0320ac8640 1 -- 172.21.15.130:0/4000300943 learned_addr learned my addr 172.21.15.130:0/4000300943 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:58.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f031bfff640 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a06313e550 0x55a063150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03212c9640 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313ee70 0x55a0631513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f0320ac8640 1 -- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a06313e550 msgr2=0x55a063150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:58.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f0320ac8640 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a06313e550 0x55a063150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f0320ac8640 1 -- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313ee70 msgr2=0x55a0631513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:58.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f0320ac8640 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313ee70 0x55a0631513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f0320ac8640 1 -- 172.21.15.130:0/4000300943 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a062f07210 con 0x55a0631232b0 2023-09-13T06:12:58.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03212c9640 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313ee70 0x55a0631513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:58.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f0320ac8640 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0631232b0 0x55a06319c6d0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f0310053dc0 tx=0x7f031001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc5ac62a25c98f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:58.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f02fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2023-09-13T06:12:58.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f02fb7fe640 1 -- 172.21.15.130:0/4000300943 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0310050540 con 0x55a0631232b0 2023-09-13T06:12:58.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f02fb7fe640 1 -- 172.21.15.130:0/4000300943 <== mon.0 v2:172.21.15.130:3300/0 2 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03100506a0 con 0x55a0631232b0 2023-09-13T06:12:58.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 -- 172.21.15.130:0/4000300943 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a062eff900 con 0x55a0631232b0 2023-09-13T06:12:58.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f02fb7fe640 1 -- 172.21.15.130:0/4000300943 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f031005b8d0 con 0x55a0631232b0 2023-09-13T06:12:58.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 10 client.9204 fetch_fsmap learned FSMap version 92 2023-09-13T06:12:58.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 -- 172.21.15.130:0/4000300943 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55a062c3ecc0 con 0x55a0631232b0 2023-09-13T06:12:58.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f02fb7fe640 1 -- 172.21.15.130:0/4000300943 <== mon.0 v2:172.21.15.130:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0310075030 con 0x55a0631232b0 2023-09-13T06:12:58.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f02fb7fe640 1 -- 172.21.15.130:0/4000300943 <== mon.0 v2:172.21.15.130:3300/0 5 ==== fsmap(e 92) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f031004fc20 con 0x55a0631232b0 2023-09-13T06:12:58.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 10 client.9204 fetch_fsmap finished waiting for FSMap version 92 2023-09-13T06:12:58.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 10 client.9204 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-13T06:12:58.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 20 client.9204 populate_metadata read hostname 'smithi130' 2023-09-13T06:12:58.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:6834/2477052868,v1:172.21.15.164:6835/2477052868] conn(0x55a063151930 0x55a063151d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 4 client.9204 mds_command: new command op to 8272 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T06:12:58.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.600+0000 7f03260ae000 1 -- 172.21.15.130:0/4000300943 --> [v2:172.21.15.164:6834/2477052868,v1:172.21.15.164:6835/2477052868] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a062f3d2c0 con 0x55a063151930 2023-09-13T06:12:58.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f031bfff640 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:6834/2477052868,v1:172.21.15.164:6835/2477052868] conn(0x55a063151930 0x55a063151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f031bfff640 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:6834/2477052868,v1:172.21.15.164:6835/2477052868] conn(0x55a063151930 0x55a063151d10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0cd473b06cd80c8 server_cookie=22d8f394975c0d78 in_seq=0 out_seq=0 2023-09-13T06:12:58.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f02fb7fe640 10 client.9204 ms_handle_connect on v2:172.21.15.164:6834/2477052868 2023-09-13T06:12:58.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f02fb7fe640 1 -- 172.21.15.130:0/4000300943 <== mds.0 v2:172.21.15.164:6834/2477052868 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a062f3d2c0 con 0x55a063151930 2023-09-13T06:12:58.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f02fb7fe640 10 client.9204 handle_command_reply: tid=0 2023-09-13T06:12:58.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 1 client.9204 shutdown 2023-09-13T06:12:58.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 1 -- 172.21.15.130:0/4000300943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0631232b0 msgr2=0x55a06319c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0631232b0 0x55a06319c6d0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f0310053dc0 tx=0x7f031001e040 comp rx=0 tx=0).stop 2023-09-13T06:12:58.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 1 -- 172.21.15.130:0/4000300943 shutdown_connections 2023-09-13T06:12:58.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:6834/2477052868,v1:172.21.15.164:6835/2477052868] conn(0x55a063151930 0x55a063151d10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a06313ee70 0x55a0631513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a06313e550 0x55a063150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 1 --2- 172.21.15.130:0/4000300943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0631232b0 0x55a06319c6d0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f02fb7fe640 0 client.9204 ms_handle_reset on v2:172.21.15.164:6834/2477052868 2023-09-13T06:12:58.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 1 -- 172.21.15.130:0/4000300943 >> 172.21.15.130:0/4000300943 conn(0x55a0630ebc40 msgr2=0x55a063121620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:58.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 1 -- 172.21.15.130:0/4000300943 shutdown_connections 2023-09-13T06:12:58.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 1 -- 172.21.15.130:0/4000300943 wait complete. 2023-09-13T06:12:58.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f03260ae000 20 client.9204 trim_cache size 0 max 16384 2023-09-13T06:12:58.618 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:12:58.618 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:12:58.618 INFO:teuthology.orchestra.run.smithi130.stdout: "whoami": 0, 2023-09-13T06:12:58.619 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 8272, 2023-09-13T06:12:58.619 INFO:teuthology.orchestra.run.smithi130.stdout: "want_state": "up:active", 2023-09-13T06:12:58.619 INFO:teuthology.orchestra.run.smithi130.stdout: "state": "up:active", 2023-09-13T06:12:58.619 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs", 2023-09-13T06:12:58.619 INFO:teuthology.orchestra.run.smithi130.stdout: "rank_uptime": 5.8435155200000004, 2023-09-13T06:12:58.619 INFO:teuthology.orchestra.run.smithi130.stdout: "mdsmap_epoch": 92, 2023-09-13T06:12:58.620 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch": 187, 2023-09-13T06:12:58.620 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_epoch_barrier": 187, 2023-09-13T06:12:58.620 INFO:teuthology.orchestra.run.smithi130.stdout: "uptime": 11.755520465 2023-09-13T06:12:58.620 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:12:58.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 -- 172.21.15.130:0/1420788485 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0300065b20 msgr2=0x7f0300067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0300065b20 0x7f0300067fe0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f031c13c2c0 tx=0x7f0308007d40 comp rx=0 tx=0).stop 2023-09-13T06:12:58.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 -- 172.21.15.130:0/1420788485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f031c070d60 msgr2=0x7f031c15c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f031c070d60 0x7f031c15c820 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f031000c420 tx=0x7f031000c8e0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 -- 172.21.15.130:0/1420788485 shutdown_connections 2023-09-13T06:12:58.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0300065b20 0x7f0300067fe0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f031c146540 0x7f031c0aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f031c1436e0 0x7f031c160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 --2- 172.21.15.130:0/1420788485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f031c070d60 0x7f031c15c820 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 -- 172.21.15.130:0/1420788485 >> 172.21.15.130:0/1420788485 conn(0x7f031c0b0bc0 msgr2=0x7f031c0ad1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:58.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 -- 172.21.15.130:0/1420788485 shutdown_connections 2023-09-13T06:12:58.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.604+0000 7f0322d2c640 1 -- 172.21.15.130:0/1420788485 wait complete. 2023-09-13T06:12:58.625 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:12:58.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9de32c640 1 Processor -- start 2023-09-13T06:12:58.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9de32c640 1 -- start start 2023-09-13T06:12:58.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9de32c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc9d80b1d20 0x7fc9d8167ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9de32c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d80afee0 con 0x7fc9d80b0f40 2023-09-13T06:12:58.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9de32c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d80b0180 con 0x7fc9d8157920 2023-09-13T06:12:58.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9de32c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d80aea50 con 0x7fc9d80b1d20 2023-09-13T06:12:58.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9d77fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc9d80b0f40 0x7fc9d80b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:43170/0 (socket says 172.21.15.130:43170) 2023-09-13T06:12:58.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9d77fe640 1 -- 172.21.15.130:0/3969526837 learned_addr learned my addr 172.21.15.130:0/3969526837 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:12:58.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9dc8c9640 1 --2- 172.21.15.130:0/3969526837 >> v2:172.21.15.130:3300/0 conn(0x7fc9d80b1d20 0x7fc9d8167ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9d6ffd640 1 -- 172.21.15.130:0/3969526837 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208595176 0 0) 0x7fc9d80afee0 con 0x7fc9d80b0f40 2023-09-13T06:12:58.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9d6ffd640 1 -- 172.21.15.130:0/3969526837 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c0003530 con 0x7fc9d80b0f40 2023-09-13T06:12:58.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9dc8c9640 1 -- 172.21.15.130:0/3969526837 >> v1:172.21.15.164:6789/0 conn(0x7fc9d8157920 legacy=0x7fc9d80ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9dc8c9640 1 -- 172.21.15.130:0/3969526837 >> v1:172.21.15.130:6789/0 conn(0x7fc9d80b0f40 legacy=0x7fc9d80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.764+0000 7fc9dc8c9640 1 -- 172.21.15.130:0/3969526837 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d80b0460 con 0x7fc9d80b1d20 2023-09-13T06:12:58.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9dc8c9640 1 --2- 172.21.15.130:0/3969526837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d80b1d20 0x7fc9d8167ed0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0009d90 tx=0x7fc9d001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1619824bf10ce64a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:58.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9d6ffd640 1 -- 172.21.15.130:0/3969526837 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00a5920 con 0x7fc9d80b1d20 2023-09-13T06:12:58.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9d6ffd640 1 -- 172.21.15.130:0/3969526837 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d00a5a80 con 0x7fc9d80b1d20 2023-09-13T06:12:58.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9d6ffd640 1 -- 172.21.15.130:0/3969526837 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00a5e10 con 0x7fc9d80b1d20 2023-09-13T06:12:58.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9de32c640 1 -- 172.21.15.130:0/3969526837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d80b1d20 msgr2=0x7fc9d8167ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9de32c640 1 --2- 172.21.15.130:0/3969526837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d80b1d20 0x7fc9d8167ed0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0009d90 tx=0x7fc9d001c950 comp rx=0 tx=0).stop 2023-09-13T06:12:58.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9de32c640 1 -- 172.21.15.130:0/3969526837 shutdown_connections 2023-09-13T06:12:58.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9de32c640 1 --2- 172.21.15.130:0/3969526837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d80b1d20 0x7fc9d8167ed0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9de32c640 1 -- 172.21.15.130:0/3969526837 >> 172.21.15.130:0/3969526837 conn(0x7fc9d8065990 msgr2=0x7fc9d8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:58.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9de32c640 1 -- 172.21.15.130:0/3969526837 shutdown_connections 2023-09-13T06:12:58.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9de32c640 1 -- 172.21.15.130:0/3969526837 wait complete. 2023-09-13T06:12:58.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.768+0000 7fc9de32c640 1 Processor -- start 2023-09-13T06:12:58.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9de32c640 1 -- start start 2023-09-13T06:12:58.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9de32c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d80b0f40 0x7fc9d806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9de32c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d80b1d20 0x7fc9d8145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9de32c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d8157920 0x7fc9d806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9de32c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d80b0b20 con 0x7fc9d80b0f40 2023-09-13T06:12:58.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9de32c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d806d140 con 0x7fc9d8157920 2023-09-13T06:12:58.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9de32c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d806c530 con 0x7fc9d80b1d20 2023-09-13T06:12:58.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d80b0f40 0x7fc9d806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d80b0f40 0x7fc9d806d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49740/0 (socket says 172.21.15.130:49740) 2023-09-13T06:12:58.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d7fff640 1 -- 172.21.15.130:0/642390344 learned_addr learned my addr 172.21.15.130:0/642390344 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:58.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9dc8c9640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d8157920 0x7fc9d806b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d77fe640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d80b1d20 0x7fc9d8145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d7fff640 1 -- 172.21.15.130:0/642390344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d80b1d20 msgr2=0x7fc9d8145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d7fff640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d80b1d20 0x7fc9d8145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d7fff640 1 -- 172.21.15.130:0/642390344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d8157920 msgr2=0x7fc9d806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d7fff640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d8157920 0x7fc9d806b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d7fff640 1 -- 172.21.15.130:0/642390344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0009a70 con 0x7fc9d80b0f40 2023-09-13T06:12:58.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9dc8c9640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d8157920 0x7fc9d806b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:58.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d7fff640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d80b0f40 0x7fc9d806d5d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800c3c0 tx=0x7fc9c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:58.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d4ff9640 1 -- 172.21.15.130:0/642390344 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80052d0 con 0x7fc9d80b0f40 2023-09-13T06:12:58.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d4ff9640 1 -- 172.21.15.130:0/642390344 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c8005430 con 0x7fc9d80b0f40 2023-09-13T06:12:58.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9d4ff9640 1 -- 172.21.15.130:0/642390344 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8003840 con 0x7fc9d80b0f40 2023-09-13T06:12:58.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9de32c640 1 -- 172.21.15.130:0/642390344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d806c810 con 0x7fc9d80b0f40 2023-09-13T06:12:58.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9de32c640 1 -- 172.21.15.130:0/642390344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d806cdd0 con 0x7fc9d80b0f40 2023-09-13T06:12:58.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.772+0000 7fc9de32c640 1 -- 172.21.15.130:0/642390344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d80618a0 con 0x7fc9d80b0f40 2023-09-13T06:12:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.776+0000 7fc9d4ff9640 1 -- 172.21.15.130:0/642390344 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc9c80039a0 con 0x7fc9d80b0f40 2023-09-13T06:12:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.776+0000 7fc9d4ff9640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9c4065b50 0x7fc9c4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.776+0000 7fc9d4ff9640 1 -- 172.21.15.130:0/642390344 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9c8082740 con 0x7fc9d80b0f40 2023-09-13T06:12:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.776+0000 7fc9d77fe640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9c4065b50 0x7fc9c4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:58.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.776+0000 7fc9d77fe640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9c4065b50 0x7fc9c4068010 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc9d815d470 tx=0x7fc9cc007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:58.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.780+0000 7fc9d4ff9640 1 -- 172.21.15.130:0/642390344 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc9c8050130 con 0x7fc9d80b0f40 2023-09-13T06:12:58.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.960+0000 7fc9de32c640 1 -- 172.21.15.130:0/642390344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc9d8153390 con 0x7fc9d80b0f40 2023-09-13T06:12:58.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.960+0000 7fc9d4ff9640 1 -- 172.21.15.130:0/642390344 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc9c8053750 con 0x7fc9d80b0f40 2023-09-13T06:12:58.961 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:12:58.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 -- 172.21.15.130:0/642390344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9c4065b50 msgr2=0x7fc9c4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9c4065b50 0x7fc9c4068010 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc9d815d470 tx=0x7fc9cc007d40 comp rx=0 tx=0).stop 2023-09-13T06:12:58.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 -- 172.21.15.130:0/642390344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d80b0f40 msgr2=0x7fc9d806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:58.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d80b0f40 0x7fc9d806d5d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800c3c0 tx=0x7fc9c800c880 comp rx=0 tx=0).stop 2023-09-13T06:12:58.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 -- 172.21.15.130:0/642390344 shutdown_connections 2023-09-13T06:12:58.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc9c4065b50 0x7fc9c4068010 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9d8157920 0x7fc9d806b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.964 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9d80b1d20 0x7fc9d8145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 --2- 172.21.15.130:0/642390344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9d80b0f40 0x7fc9d806d5d0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:58.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 -- 172.21.15.130:0/642390344 >> 172.21.15.130:0/642390344 conn(0x7fc9d8065990 msgr2=0x7fc9d81526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:58.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 -- 172.21.15.130:0/642390344 shutdown_connections 2023-09-13T06:12:58.965 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:58.964+0000 7fc9de32c640 1 -- 172.21.15.130:0/642390344 wait complete. 2023-09-13T06:12:58.982 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:12:58.983 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:12:58.984 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-09-13T06:12:58.984 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T06:12:58.984 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T06:12:58.985 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:12:58.985 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:12:58.986 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:12:58.986 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:12:58.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:58.987 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-09-13T06:12:58.998 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:12:58.999 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:12:58.999 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:12:58.999 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:12:59.000 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-09-13T06:12:59.000 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:12:59.000 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:12:59.001 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:12:59.001 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-09-13T06:12:59.001 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:12:59.002 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:12:59.002 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-09-13T06:12:59.002 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:12:59.002 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:12:59.003 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:12:59.003 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:12:59.003 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:12:59.003 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 41728sec preferred_lft 41728sec 2023-09-13T06:12:59.004 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-09-13T06:12:59.004 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:12:59.004 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:12:59.005 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:44:b6:63:9e brd ff:ff:ff:ff:ff:ff 2023-09-13T06:12:59.005 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:12:59.005 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:12:59.005 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:12:59.006 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:12:59.006 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:12:59.006 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:12:59.006 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:12:59.007 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:12:59.007 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:12:59.007 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:12:59.007 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:12:59.008 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:12:59.008 INFO:teuthology.orchestra.run.smithi130.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:12:59.008 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:12:59.008 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:12:59.009 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:12:59.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:59.010 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:12:59.073 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-09-13T06:12:59.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:59.076 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-09-13T06:12:59.131 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-09-13T06:12:59.131 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:12:59.131 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:12:59.131 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:12:59.132 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:12:59.132 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:12:59.132 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:12:59.132 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:12:59.132 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:12:59.132 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:12:59.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:59.133 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-09-13T06:12:59.134 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-09-13T06:12:59.137 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:12:59.137 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:12:59.137 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:12:59.138 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-09-13T06:12:59.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:59.231 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:12:59.243 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T06:12:59.244 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:12:59.245 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:12:59.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:59.245 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-09-13T06:12:59.307 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:12:59.308 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T06:12:59.363 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T06:12:59.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:12:59.364 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:12:59.419 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:12:59.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:59.420 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:12:59.523 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:12:59.523 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:12:59.523 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:12:59.538 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:12:59.538 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:12:59.538 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:12:59.539 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:12:59.539 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:12:59.545 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T06:12:59.546 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T06:12:59.546 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2023-09-13T06:12:59.546 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:12:59.546 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:12:59.547 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:12:59.547 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:12:59.547 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:12:59.549 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:12:59.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:59.550 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T06:12:59.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:12:59.572 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:12:59.634 INFO:teuthology.orchestra.run.smithi130.stdout:client7316 2023-09-13T06:12:59.635 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:12:59.635 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:12:59.692 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T06:12:59.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.872+0000 7f0f0dfc6640 1 Processor -- start 2023-09-13T06:12:59.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.872+0000 7f0f0dfc6640 1 -- start start 2023-09-13T06:12:59.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f0dfc6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0f0815b130 0x7f0f080cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:59.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f0dfc6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0f080ce180 0x7f0f0815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:59.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f0dfc6640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f080ce980 con 0x7f0f080b04a0 2023-09-13T06:12:59.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f0dfc6640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f080cec60 con 0x7f0f0815b130 2023-09-13T06:12:59.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f0dfc6640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0806c640 con 0x7f0f080ce180 2023-09-13T06:12:59.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f077fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0f0815b130 0x7f0f080cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:59.877 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f077fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0f0815b130 0x7f0f080cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49754/0 (socket says 172.21.15.130:49754) 2023-09-13T06:12:59.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f077fe640 1 -- 172.21.15.130:0/622829199 learned_addr learned my addr 172.21.15.130:0/622829199 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:59.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f06ffd640 1 --2- 172.21.15.130:0/622829199 >> v2:172.21.15.164:3300/0 conn(0x7f0f080ce180 0x7f0f0815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:59.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f077fe640 1 -- 172.21.15.130:0/622829199 >> v2:172.21.15.164:3300/0 conn(0x7f0f080ce180 msgr2=0x7f0f0815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:12:59.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f077fe640 1 --2- 172.21.15.130:0/622829199 >> v2:172.21.15.164:3300/0 conn(0x7f0f080ce180 0x7f0f0815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:59.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f077fe640 1 -- 172.21.15.130:0/622829199 >> v1:172.21.15.164:6789/0 conn(0x7f0f080b04a0 legacy=0x7f0f0806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:59.878 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.876+0000 7f0f077fe640 1 -- 172.21.15.130:0/622829199 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0806c920 con 0x7f0f0815b130 2023-09-13T06:12:59.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f077fe640 1 --2- 172.21.15.130:0/622829199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f0815b130 0x7f0f080cc780 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0f0806bc40 tx=0x7f0ef801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d0590ba1cbfd6b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:59.879 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f067fc640 1 -- 172.21.15.130:0/622829199 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80a7070 con 0x7f0f0815b130 2023-09-13T06:12:59.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f067fc640 1 -- 172.21.15.130:0/622829199 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef80ab430 con 0x7f0f0815b130 2023-09-13T06:12:59.880 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f067fc640 1 -- 172.21.15.130:0/622829199 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80ab7c0 con 0x7f0f0815b130 2023-09-13T06:12:59.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/622829199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f0815b130 msgr2=0x7f0f080cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:59.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f0dfc6640 1 --2- 172.21.15.130:0/622829199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f0815b130 0x7f0f080cc780 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0f0806bc40 tx=0x7f0ef801c500 comp rx=0 tx=0).stop 2023-09-13T06:12:59.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/622829199 shutdown_connections 2023-09-13T06:12:59.881 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f0dfc6640 1 --2- 172.21.15.130:0/622829199 >> v2:172.21.15.164:3300/0 conn(0x7f0f080ce180 0x7f0f0815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:59.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f0dfc6640 1 --2- 172.21.15.130:0/622829199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f0815b130 0x7f0f080cc780 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:59.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/622829199 >> 172.21.15.130:0/622829199 conn(0x7f0f08065990 msgr2=0x7f0f08065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:12:59.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/622829199 shutdown_connections 2023-09-13T06:12:59.882 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/622829199 wait complete. 2023-09-13T06:12:59.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f0dfc6640 1 Processor -- start 2023-09-13T06:12:59.884 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.880+0000 7f0f0dfc6640 1 -- start start 2023-09-13T06:12:59.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f0dfc6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f080b04a0 0x7f0f081473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:59.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f0dfc6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f080ce180 0x7f0f08155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:59.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f0dfc6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f0815b130 0x7f0f080ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:59.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f0dfc6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f081578c0 con 0x7f0f080ce180 2023-09-13T06:12:59.885 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f0dfc6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f08158070 con 0x7f0f080b04a0 2023-09-13T06:12:59.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f0dfc6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f08157af0 con 0x7f0f0815b130 2023-09-13T06:12:59.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f06ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f080ce180 0x7f0f08155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:59.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f06ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f080ce180 0x7f0f08155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49764/0 (socket says 172.21.15.130:49764) 2023-09-13T06:12:59.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f06ffd640 1 -- 172.21.15.130:0/3875870522 learned_addr learned my addr 172.21.15.130:0/3875870522 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:12:59.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f077fe640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f080b04a0 0x7f0f081473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:59.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f07fff640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f0815b130 0x7f0f080ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:59.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f06ffd640 1 -- 172.21.15.130:0/3875870522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f0815b130 msgr2=0x7f0f080ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:59.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f06ffd640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f0815b130 0x7f0f080ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:59.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f06ffd640 1 -- 172.21.15.130:0/3875870522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f080b04a0 msgr2=0x7f0f081473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:12:59.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f06ffd640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f080b04a0 0x7f0f081473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:12:59.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f06ffd640 1 -- 172.21.15.130:0/3875870522 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef80094d0 con 0x7f0f080ce180 2023-09-13T06:12:59.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f07fff640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f0815b130 0x7f0f080ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:12:59.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f06ffd640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f080ce180 0x7f0f08155d60 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00d830 tx=0x7f0efc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:59.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0eeffff640 1 -- 172.21.15.130:0/3875870522 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00b6c0 con 0x7f0f080ce180 2023-09-13T06:12:59.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0eeffff640 1 -- 172.21.15.130:0/3875870522 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc00b820 con 0x7f0f080ce180 2023-09-13T06:12:59.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0eeffff640 1 -- 172.21.15.130:0/3875870522 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00bb90 con 0x7f0f080ce180 2023-09-13T06:12:59.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/3875870522 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f080b0e40 con 0x7f0f080ce180 2023-09-13T06:12:59.889 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/3875870522 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f08157e40 con 0x7f0f080ce180 2023-09-13T06:12:59.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/3875870522 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f080618a0 con 0x7f0f080ce180 2023-09-13T06:12:59.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.884+0000 7f0eeffff640 1 -- 172.21.15.130:0/3875870522 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0efc01e460 con 0x7f0f080ce180 2023-09-13T06:12:59.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.888+0000 7f0eeffff640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ef4065b20 0x7f0ef4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:12:59.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.888+0000 7f0eeffff640 1 -- 172.21.15.130:0/3875870522 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0efc083ac0 con 0x7f0f080ce180 2023-09-13T06:12:59.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.888+0000 7f0f077fe640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ef4065b20 0x7f0ef4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:12:59.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.888+0000 7f0f077fe640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ef4065b20 0x7f0ef4067fe0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80af000 tx=0x7f0ef80b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:12:59.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:12:59.892+0000 7f0eeffff640 1 -- 172.21.15.130:0/3875870522 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0efc051370 con 0x7f0f080ce180 2023-09-13T06:13:00.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/3875870522 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0f08148160 con 0x7f0f080ce180 2023-09-13T06:13:00.072 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0eeffff640 1 -- 172.21.15.130:0/3875870522 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0efc054990 con 0x7f0f080ce180 2023-09-13T06:13:00.073 INFO:teuthology.orchestra.run.smithi130.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T06:13:00.074 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/3875870522 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ef4065b20 msgr2=0x7f0ef4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:00.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ef4065b20 0x7f0ef4067fe0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80af000 tx=0x7f0ef80b6040 comp rx=0 tx=0).stop 2023-09-13T06:13:00.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/3875870522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f080ce180 msgr2=0x7f0f08155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:00.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f080ce180 0x7f0f08155d60 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00d830 tx=0x7f0efc00dcf0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/3875870522 shutdown_connections 2023-09-13T06:13:00.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0ef4065b20 0x7f0ef4067fe0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f0815b130 0x7f0f080ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f080ce180 0x7f0f08155d60 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 --2- 172.21.15.130:0/3875870522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f080b04a0 0x7f0f081473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/3875870522 >> 172.21.15.130:0/3875870522 conn(0x7f0f08065990 msgr2=0x7f0f0806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:00.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/3875870522 shutdown_connections 2023-09-13T06:13:00.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.072+0000 7f0f0dfc6640 1 -- 172.21.15.130:0/3875870522 wait complete. 2023-09-13T06:13:00.093 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T06:13:00.094 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T06:13:00.094 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-09-13T06:13:00.094 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T06:13:00.095 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T06:13:00.095 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T06:13:00.096 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T06:13:00.096 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T06:13:00.096 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:13:00.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:00.097 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-09-13T06:13:00.107 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T06:13:00.107 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T06:13:00.107 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T06:13:00.107 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:13:00.108 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-09-13T06:13:00.108 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:13:00.108 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:13:00.108 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:13:00.108 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-09-13T06:13:00.109 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:13:00.109 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:13:00.109 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-09-13T06:13:00.109 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-13T06:13:00.109 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:13:00.110 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T06:13:00.110 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:13:00.110 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-13T06:13:00.110 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 41744sec preferred_lft 41744sec 2023-09-13T06:13:00.110 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-09-13T06:13:00.111 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:13:00.111 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-13T06:13:00.111 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:6d:62:77:b6 brd ff:ff:ff:ff:ff:ff 2023-09-13T06:13:00.111 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-13T06:13:00.111 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:13:00.112 INFO:teuthology.orchestra.run.smithi164.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T06:13:00.112 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-13T06:13:00.112 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T06:13:00.112 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:13:00.112 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-13T06:13:00.113 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:13:00.113 INFO:teuthology.orchestra.run.smithi164.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:13:00.113 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:13:00.113 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-13T06:13:00.113 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:13:00.114 INFO:teuthology.orchestra.run.smithi164.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T06:13:00.114 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:13:00.114 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-13T06:13:00.114 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-09-13T06:13:00.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:00.116 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T06:13:00.178 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-09-13T06:13:00.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:00.181 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-09-13T06:13:00.238 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-09-13T06:13:00.238 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T06:13:00.238 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-13T06:13:00.238 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T06:13:00.239 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-13T06:13:00.239 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T06:13:00.239 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:13:00.239 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:13:00.239 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-13T06:13:00.240 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T06:13:00.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:00.240 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-09-13T06:13:00.241 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-09-13T06:13:00.241 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T06:13:00.242 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T06:13:00.242 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T06:13:00.242 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-09-13T06:13:00.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:00.331 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:13:00.341 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-13T06:13:00.341 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:13:00.341 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:13:00.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:00.342 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-09-13T06:13:00.407 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:13:00.408 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T06:13:00.463 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T06:13:00.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T06:13:00.464 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:13:00.515 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T06:13:00.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:00.516 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:13:00.609 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:13:00.609 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:13:00.609 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:13:00.624 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:13:00.624 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:13:00.624 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:13:00.624 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:13:00.624 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:13:00.631 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T06:13:00.631 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T06:13:00.631 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2023-09-13T06:13:00.631 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:3300,172.21.15.164:3300,172.21.15.164:3301" 2023-09-13T06:13:00.632 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T06:13:00.632 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790" 2023-09-13T06:13:00.632 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.130:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2023-09-13T06:13:00.632 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=33902c8f-11a4-444c-a37a-ca3bab8415c5" will pass to kernel 2023-09-13T06:13:00.635 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T06:13:00.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:00.636 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T06:13:00.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:00.657 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T06:13:00.714 INFO:teuthology.orchestra.run.smithi164.stdout:client8392 2023-09-13T06:13:00.714 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:13:00.715 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:00.763 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:13:00.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae8182640 1 Processor -- start 2023-09-13T06:13:00.904 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae8182640 1 -- start start 2023-09-13T06:13:00.906 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae8182640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feae015d5f0 0x7feae00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:00.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae8182640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feae00ae170 0x7feae00cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:00.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae8182640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7feae015d9d0 0x7feae01591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:00.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae8182640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae00cce60 con 0x7feae015d5f0 2023-09-13T06:13:00.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae8182640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae00cd140 con 0x7feae015d9d0 2023-09-13T06:13:00.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae8182640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae00cd420 con 0x7feae00ae170 2023-09-13T06:13:00.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae5f1e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feae015d5f0 0x7feae00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:00.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae5f1e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feae015d5f0 0x7feae00cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38932/0 (socket says 172.21.15.130:38932) 2023-09-13T06:13:00.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae5f1e640 1 -- 172.21.15.130:0/2889019928 learned_addr learned my addr 172.21.15.130:0/2889019928 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:00.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae571d640 1 --2- 172.21.15.130:0/2889019928 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feae00ae170 0x7feae00cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:00.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae671f640 1 --2- 172.21.15.130:0/2889019928 >> v2:172.21.15.164:3300/0 conn(0x7feae015d9d0 0x7feae01591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:00.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae5f1e640 1 -- 172.21.15.130:0/2889019928 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feae00ae170 msgr2=0x7feae00cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:00.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae5f1e640 1 --2- 172.21.15.130:0/2889019928 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feae00ae170 0x7feae00cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae5f1e640 1 -- 172.21.15.130:0/2889019928 >> v2:172.21.15.164:3300/0 conn(0x7feae015d9d0 msgr2=0x7feae01591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:00.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae5f1e640 1 --2- 172.21.15.130:0/2889019928 >> v2:172.21.15.164:3300/0 conn(0x7feae015d9d0 0x7feae01591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae5f1e640 1 -- 172.21.15.130:0/2889019928 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00cd700 con 0x7feae015d5f0 2023-09-13T06:13:00.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.904+0000 7feae671f640 1 --2- 172.21.15.130:0/2889019928 >> v2:172.21.15.164:3300/0 conn(0x7feae015d9d0 0x7feae01591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:00.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae5f1e640 1 --2- 172.21.15.130:0/2889019928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae015d5f0 0x7feae00cc7f0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7feae00b28c0 tx=0x7feadc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a566c050e41f7f9e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:00.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae4f1c640 1 -- 172.21.15.130:0/2889019928 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0ab600 con 0x7feae015d5f0 2023-09-13T06:13:00.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae4f1c640 1 -- 172.21.15.130:0/2889019928 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc0a7050 con 0x7feae015d5f0 2023-09-13T06:13:00.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae4f1c640 1 -- 172.21.15.130:0/2889019928 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0ab980 con 0x7feae015d5f0 2023-09-13T06:13:00.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae8182640 1 -- 172.21.15.130:0/2889019928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae015d5f0 msgr2=0x7feae00cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:00.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae8182640 1 --2- 172.21.15.130:0/2889019928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae015d5f0 0x7feae00cc7f0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7feae00b28c0 tx=0x7feadc01c470 comp rx=0 tx=0).stop 2023-09-13T06:13:00.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae8182640 1 -- 172.21.15.130:0/2889019928 shutdown_connections 2023-09-13T06:13:00.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae8182640 1 --2- 172.21.15.130:0/2889019928 >> v2:172.21.15.164:3300/0 conn(0x7feae015d9d0 0x7feae01591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae8182640 1 --2- 172.21.15.130:0/2889019928 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feae00ae170 0x7feae00cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae8182640 1 --2- 172.21.15.130:0/2889019928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae015d5f0 0x7feae00cc7f0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae8182640 1 -- 172.21.15.130:0/2889019928 >> 172.21.15.130:0/2889019928 conn(0x7feae0065990 msgr2=0x7feae0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:00.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae8182640 1 -- 172.21.15.130:0/2889019928 shutdown_connections 2023-09-13T06:13:00.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.908+0000 7feae8182640 1 -- 172.21.15.130:0/2889019928 wait complete. 2023-09-13T06:13:00.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae8182640 1 Processor -- start 2023-09-13T06:13:00.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae8182640 1 -- start start 2023-09-13T06:13:00.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae8182640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feae00ae170 0x7feae0158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:00.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae8182640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae015d5f0 0x7feae015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:00.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae8182640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feae015d9d0 0x7feae00af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:00.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae8182640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae015b9a0 con 0x7feae015d5f0 2023-09-13T06:13:00.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae8182640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae015b3b0 con 0x7feae00ae170 2023-09-13T06:13:00.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae8182640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae0158840 con 0x7feae015d9d0 2023-09-13T06:13:00.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae571d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae015d5f0 0x7feae015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:00.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae571d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae015d5f0 0x7feae015bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38940/0 (socket says 172.21.15.130:38940) 2023-09-13T06:13:00.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae571d640 1 -- 172.21.15.130:0/1029652093 learned_addr learned my addr 172.21.15.130:0/1029652093 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:00.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae5f1e640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feae00ae170 0x7feae0158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:00.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae671f640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feae015d9d0 0x7feae00af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:00.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae571d640 1 -- 172.21.15.130:0/1029652093 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feae015d9d0 msgr2=0x7feae00af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:00.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae571d640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feae015d9d0 0x7feae00af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae571d640 1 -- 172.21.15.130:0/1029652093 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feae00ae170 msgr2=0x7feae0158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:00.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae571d640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feae00ae170 0x7feae0158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:00.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae571d640 1 -- 172.21.15.130:0/1029652093 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc0094d0 con 0x7feae015d5f0 2023-09-13T06:13:00.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae5f1e640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feae00ae170 0x7feae0158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:00.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae671f640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feae015d9d0 0x7feae00af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae571d640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae015d5f0 0x7feae015bdc0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fead000d800 tx=0x7fead000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7fead67fc640 1 -- 172.21.15.130:0/1029652093 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead000b6c0 con 0x7feae015d5f0 2023-09-13T06:13:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7fead67fc640 1 -- 172.21.15.130:0/1029652093 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead000b840 con 0x7feae015d5f0 2023-09-13T06:13:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7fead67fc640 1 -- 172.21.15.130:0/1029652093 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead000bbf0 con 0x7feae015d5f0 2023-09-13T06:13:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae8182640 1 -- 172.21.15.130:0/1029652093 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae00b0090 con 0x7feae015d5f0 2023-09-13T06:13:00.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.912+0000 7feae8182640 1 -- 172.21.15.130:0/1029652093 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae015b5c0 con 0x7feae015d5f0 2023-09-13T06:13:00.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.916+0000 7feae8182640 1 -- 172.21.15.130:0/1029652093 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae015bae0 con 0x7feae015d5f0 2023-09-13T06:13:00.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.916+0000 7fead67fc640 1 -- 172.21.15.130:0/1029652093 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fead000bd50 con 0x7feae015d5f0 2023-09-13T06:13:00.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.916+0000 7fead67fc640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feac4065b50 0x7feac4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:00.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.916+0000 7fead67fc640 1 -- 172.21.15.130:0/1029652093 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fead00838f0 con 0x7feae015d5f0 2023-09-13T06:13:00.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.916+0000 7feae5f1e640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feac4065b50 0x7feac4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:00.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.916+0000 7feae5f1e640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feac4065b50 0x7feac4068010 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7feadc0ad000 tx=0x7feadc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:00.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:00.920+0000 7fead67fc640 1 -- 172.21.15.130:0/1029652093 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7feae015bae0 con 0x7feae015d5f0 2023-09-13T06:13:01.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 -- 172.21.15.130:0/1029652093 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feae015bae0 con 0x7feae015d5f0 2023-09-13T06:13:01.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7fead67fc640 1 -- 172.21.15.130:0/1029652093 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4926 (secure 0 0 0) 0x7feae015bae0 con 0x7feae015d5f0 2023-09-13T06:13:01.100 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:01.100 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/519371055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":519371055},{"type":"v1","addr":"172.21.15.130:6837","nonce":519371055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2464101241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2464101241},{"type":"v1","addr":"172.21.15.130:6836","nonce":2464101241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3066690343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3066690343},{"type":"v1","addr":"172.21.15.164:6833","nonce":3066690343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:12:52.135181+0000","modified":"2023-09-13T06:12:55.174886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8272":{"gid":8272,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2477052868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2477052868},{"type":"v1","addr":"172.21.15.164:6835","nonce":2477052868}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-09-13T06:13:01.100 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 92 2023-09-13T06:13:01.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 -- 172.21.15.130:0/1029652093 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feac4065b50 msgr2=0x7feac4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:01.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feac4065b50 0x7feac4068010 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7feadc0ad000 tx=0x7feadc008040 comp rx=0 tx=0).stop 2023-09-13T06:13:01.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 -- 172.21.15.130:0/1029652093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae015d5f0 msgr2=0x7feae015bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:01.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae015d5f0 0x7feae015bdc0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fead000d800 tx=0x7fead000dcc0 comp rx=0 tx=0).stop 2023-09-13T06:13:01.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 -- 172.21.15.130:0/1029652093 shutdown_connections 2023-09-13T06:13:01.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7feac4065b50 0x7feac4068010 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:01.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feae015d9d0 0x7feae00af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:01.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae015d5f0 0x7feae015bdc0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:01.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 --2- 172.21.15.130:0/1029652093 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feae00ae170 0x7feae0158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:01.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 -- 172.21.15.130:0/1029652093 >> 172.21.15.130:0/1029652093 conn(0x7feae0065990 msgr2=0x7feae00b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:01.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 -- 172.21.15.130:0/1029652093 shutdown_connections 2023-09-13T06:13:01.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.100+0000 7feae8182640 1 -- 172.21.15.130:0/1029652093 wait complete. 2023-09-13T06:13:01.121 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-09-13T06:13:01.278 INFO:teuthology.orchestra.run.smithi164.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":8272,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5030226039999999,"mdsmap_epoch":92,"osdmap_epoch":187,"osdmap_epoch_barrier":187,"uptime":14.415044228999999} 2023-09-13T06:13:01.279 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 8272, "mdsmap_epoch": 92, "osdmap_epoch": 187, "osdmap_epoch_barrier": 187, "rank_uptime": 8.503022604, "state": "up:active", "uptime": 14.415044229, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:13:01.280 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-09-13T06:13:01.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.420+0000 7ff7a3511640 1 Processor -- start 2023-09-13T06:13:01.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.420+0000 7ff7a3511640 1 -- start start 2023-09-13T06:13:01.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a3511640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff79c0ccc10 0x7ff79c15dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:01.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a3511640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff79c0cb710 0x7ff79c0cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:01.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a3511640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79c0ccff0 con 0x7ff79c0b3170 2023-09-13T06:13:01.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a3511640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79c15b590 con 0x7ff79c0ccc10 2023-09-13T06:13:01.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a3511640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0b12f0 con 0x7ff79c0cb710 2023-09-13T06:13:01.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a0aac640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff79c0b3170 0x7ff79c0b1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:58588/0 (socket says 172.21.15.130:58588) 2023-09-13T06:13:01.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a0aac640 1 -- 172.21.15.130:0/15398635 learned_addr learned my addr 172.21.15.130:0/15398635 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:01.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a12ad640 1 --2- 172.21.15.130:0/15398635 >> v2:172.21.15.164:3300/0 conn(0x7ff79c0ccc10 0x7ff79c15dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:01.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a1aae640 1 --2- 172.21.15.130:0/15398635 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff79c0cb710 0x7ff79c0cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:01.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff793fff640 1 -- 172.21.15.130:0/15398635 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616393209 0 0) 0x7ff79c0ccff0 con 0x7ff79c0b3170 2023-09-13T06:13:01.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff793fff640 1 -- 172.21.15.130:0/15398635 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff788005740 con 0x7ff79c0b3170 2023-09-13T06:13:01.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a12ad640 1 -- 172.21.15.130:0/15398635 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff79c0cb710 msgr2=0x7ff79c0cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:01.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a12ad640 1 --2- 172.21.15.130:0/15398635 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff79c0cb710 0x7ff79c0cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:01.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a12ad640 1 -- 172.21.15.130:0/15398635 >> v1:172.21.15.130:6789/0 conn(0x7ff79c0b3170 legacy=0x7ff79c0b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:01.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a12ad640 1 -- 172.21.15.130:0/15398635 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c15e520 con 0x7ff79c0ccc10 2023-09-13T06:13:01.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.424+0000 7ff7a1aae640 1 --2- 172.21.15.130:0/15398635 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff79c0cb710 0x7ff79c0cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:13:01.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff7a12ad640 1 --2- 172.21.15.130:0/15398635 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0ccc10 0x7ff79c15dcd0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff7980097c0 tx=0x7ff79801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d96fd05f11fe7cc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:01.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff793fff640 1 -- 172.21.15.130:0/15398635 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7980ab600 con 0x7ff79c0ccc10 2023-09-13T06:13:01.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff793fff640 1 -- 172.21.15.130:0/15398635 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7980a7050 con 0x7ff79c0ccc10 2023-09-13T06:13:01.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff793fff640 1 -- 172.21.15.130:0/15398635 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7980ab980 con 0x7ff79c0ccc10 2023-09-13T06:13:01.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff7a3511640 1 -- 172.21.15.130:0/15398635 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0ccc10 msgr2=0x7ff79c15dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:01.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff7a3511640 1 --2- 172.21.15.130:0/15398635 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0ccc10 0x7ff79c15dcd0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff7980097c0 tx=0x7ff79801c480 comp rx=0 tx=0).stop 2023-09-13T06:13:01.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff7a3511640 1 -- 172.21.15.130:0/15398635 shutdown_connections 2023-09-13T06:13:01.429 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff7a3511640 1 --2- 172.21.15.130:0/15398635 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff79c0cb710 0x7ff79c0cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:01.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff7a3511640 1 --2- 172.21.15.130:0/15398635 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0ccc10 0x7ff79c15dcd0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:01.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff7a3511640 1 -- 172.21.15.130:0/15398635 >> 172.21.15.130:0/15398635 conn(0x7ff79c0735e0 msgr2=0x7ff79c065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:01.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff7a3511640 1 -- 172.21.15.130:0/15398635 shutdown_connections 2023-09-13T06:13:01.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff7a3511640 1 -- 172.21.15.130:0/15398635 wait complete. 2023-09-13T06:13:01.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff7a3511640 1 Processor -- start 2023-09-13T06:13:01.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.428+0000 7ff7a3511640 1 -- start start 2023-09-13T06:13:01.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a3511640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff79c0b3170 0x7ff79c06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:01.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a3511640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff79c0cb710 0x7ff79c0ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:01.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a3511640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0ccc10 0x7ff79c1435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:01.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a3511640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c156770 con 0x7ff79c0b3170 2023-09-13T06:13:01.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a3511640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c156440 con 0x7ff79c0ccc10 2023-09-13T06:13:01.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a3511640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0acdf0 con 0x7ff79c0cb710 2023-09-13T06:13:01.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a12ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff79c0b3170 0x7ff79c06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:01.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a12ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff79c0b3170 0x7ff79c06cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38948/0 (socket says 172.21.15.130:38948) 2023-09-13T06:13:01.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a12ad640 1 -- 172.21.15.130:0/2253414883 learned_addr learned my addr 172.21.15.130:0/2253414883 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:01.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a1aae640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0ccc10 0x7ff79c1435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:01.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a0aac640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff79c0cb710 0x7ff79c0ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:01.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a12ad640 1 -- 172.21.15.130:0/2253414883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff79c0cb710 msgr2=0x7ff79c0ac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:01.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a12ad640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff79c0cb710 0x7ff79c0ac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:01.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a12ad640 1 -- 172.21.15.130:0/2253414883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0ccc10 msgr2=0x7ff79c1435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:01.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a12ad640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0ccc10 0x7ff79c1435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:01.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a12ad640 1 -- 172.21.15.130:0/2253414883 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794009a70 con 0x7ff79c0b3170 2023-09-13T06:13:01.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a12ad640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff79c0b3170 0x7ff79c06cc80 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff7980ae040 tx=0x7ff79801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:01.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff791ffb640 1 -- 172.21.15.130:0/2253414883 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798006e20 con 0x7ff79c0b3170 2023-09-13T06:13:01.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff791ffb640 1 -- 172.21.15.130:0/2253414883 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7980b7450 con 0x7ff79c0b3170 2023-09-13T06:13:01.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff791ffb640 1 -- 172.21.15.130:0/2253414883 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7980b7820 con 0x7ff79c0b3170 2023-09-13T06:13:01.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a3511640 1 -- 172.21.15.130:0/2253414883 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff798009420 con 0x7ff79c0b3170 2023-09-13T06:13:01.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a3511640 1 -- 172.21.15.130:0/2253414883 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79c0ad3b0 con 0x7ff79c0b3170 2023-09-13T06:13:01.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff7a3511640 1 -- 172.21.15.130:0/2253414883 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79c0618a0 con 0x7ff79c0b3170 2023-09-13T06:13:01.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.432+0000 7ff791ffb640 1 -- 172.21.15.130:0/2253414883 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff7980b7980 con 0x7ff79c0b3170 2023-09-13T06:13:01.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.436+0000 7ff791ffb640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff780065b20 0x7ff780067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:01.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.436+0000 7ff791ffb640 1 -- 172.21.15.130:0/2253414883 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff79811d960 con 0x7ff79c0b3170 2023-09-13T06:13:01.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.436+0000 7ff7a0aac640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff780065b20 0x7ff780067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:01.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.436+0000 7ff7a0aac640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff780065b20 0x7ff780067fe0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff79c1f4770 tx=0x7ff78c007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:01.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.440+0000 7ff791ffb640 1 -- 172.21.15.130:0/2253414883 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff7980eb210 con 0x7ff79c0b3170 2023-09-13T06:13:01.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:01.588+0000 7ff7a3511640 1 -- 172.21.15.130:0/2253414883 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7ff79c0adbc0 con 0x7ff79c0b3170 2023-09-13T06:13:02.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.504+0000 7ff791ffb640 1 -- 172.21.15.130:0/2253414883 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v188) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff7980ee830 con 0x7ff79c0b3170 2023-09-13T06:13:02.506 INFO:teuthology.orchestra.run.smithi130.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-09-13T06:13:02.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 -- 172.21.15.130:0/2253414883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff780065b20 msgr2=0x7ff780067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:02.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff780065b20 0x7ff780067fe0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff79c1f4770 tx=0x7ff78c007d40 comp rx=0 tx=0).stop 2023-09-13T06:13:02.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 -- 172.21.15.130:0/2253414883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff79c0b3170 msgr2=0x7ff79c06cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:02.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff79c0b3170 0x7ff79c06cc80 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff7980ae040 tx=0x7ff79801acc0 comp rx=0 tx=0).stop 2023-09-13T06:13:02.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 -- 172.21.15.130:0/2253414883 shutdown_connections 2023-09-13T06:13:02.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff780065b20 0x7ff780067fe0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:02.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0ccc10 0x7ff79c1435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:02.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff79c0cb710 0x7ff79c0ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:02.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 --2- 172.21.15.130:0/2253414883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff79c0b3170 0x7ff79c06cc80 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:02.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 -- 172.21.15.130:0/2253414883 >> 172.21.15.130:0/2253414883 conn(0x7ff79c0735e0 msgr2=0x7ff79c1598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:02.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 -- 172.21.15.130:0/2253414883 shutdown_connections 2023-09-13T06:13:02.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:02.508+0000 7ff7a3511640 1 -- 172.21.15.130:0/2253414883 wait complete. 2023-09-13T06:13:02.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-09-13T06:13:02.692 INFO:teuthology.orchestra.run.smithi130.stdout:{"osd_mon_report_interval":"5"} 2023-09-13T06:13:02.692 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-09-13T06:13:02.693 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-09-13T06:13:02.693 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:13:02.694 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:02.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:02.703 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-09-13T06:13:02.886 INFO:teuthology.orchestra.run.smithi130.stderr:16+0 records in 2023-09-13T06:13:02.886 INFO:teuthology.orchestra.run.smithi130.stderr:16+0 records out 2023-09-13T06:13:02.886 INFO:teuthology.orchestra.run.smithi130.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.123457 s, 136 MB/s 2023-09-13T06:13:02.887 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:13:02.888 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:02.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:02.897 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-09-13T06:13:03.063 INFO:teuthology.orchestra.run.smithi130.stderr:17+0 records in 2023-09-13T06:13:03.064 INFO:teuthology.orchestra.run.smithi130.stderr:17+0 records out 2023-09-13T06:13:03.064 INFO:teuthology.orchestra.run.smithi130.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.115193 s, 155 MB/s 2023-09-13T06:13:03.065 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-09-13T06:13:03.066 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:13:03.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.204+0000 7f5d9e019640 1 Processor -- start 2023-09-13T06:13:03.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.204+0000 7f5d9e019640 1 -- start start 2023-09-13T06:13:03.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d9e019640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5d980b1a40 0x7f5d980b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:03.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d9e019640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5d9806bcb0 0x7f5d9806c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:03.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d9e019640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d980b2360 con 0x7f5d98142a40 2023-09-13T06:13:03.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d9e019640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d98161cb0 con 0x7f5d9806bcb0 2023-09-13T06:13:03.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d9e019640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d98161030 con 0x7f5d980b1a40 2023-09-13T06:13:03.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d96ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5d9806bcb0 0x7f5d9806c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:03.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d97fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5d98142a40 0x7f5d98142e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:58592/0 (socket says 172.21.15.130:58592) 2023-09-13T06:13:03.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d97fff640 1 -- 172.21.15.130:0/2175874106 learned_addr learned my addr 172.21.15.130:0/2175874106 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:03.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d977fe640 1 --2- 172.21.15.130:0/2175874106 >> v2:172.21.15.164:3300/0 conn(0x7f5d980b1a40 0x7f5d980b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:03.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d96ffd640 1 -- 172.21.15.130:0/2175874106 >> v2:172.21.15.164:3300/0 conn(0x7f5d980b1a40 msgr2=0x7f5d980b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:03.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d96ffd640 1 --2- 172.21.15.130:0/2175874106 >> v2:172.21.15.164:3300/0 conn(0x7f5d980b1a40 0x7f5d980b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:03.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d96ffd640 1 -- 172.21.15.130:0/2175874106 >> v1:172.21.15.130:6789/0 conn(0x7f5d98142a40 legacy=0x7f5d98142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:03.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d96ffd640 1 -- 172.21.15.130:0/2175874106 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d98161310 con 0x7f5d9806bcb0 2023-09-13T06:13:03.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.208+0000 7f5d967fc640 1 -- 172.21.15.130:0/2175874106 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023607879 0 0) 0x7f5d980b2360 con 0x7f5d98142a40 2023-09-13T06:13:03.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d96ffd640 1 --2- 172.21.15.130:0/2175874106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d9806bcb0 0x7f5d9806c200 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f5d980b2d60 tx=0x7f5d8c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c45f52a98ae4e7f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:03.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d967fc640 1 -- 172.21.15.130:0/2175874106 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0ab600 con 0x7f5d9806bcb0 2023-09-13T06:13:03.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d967fc640 1 -- 172.21.15.130:0/2175874106 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c0a7050 con 0x7f5d9806bcb0 2023-09-13T06:13:03.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d967fc640 1 -- 172.21.15.130:0/2175874106 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0ab980 con 0x7f5d9806bcb0 2023-09-13T06:13:03.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d9e019640 1 -- 172.21.15.130:0/2175874106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d9806bcb0 msgr2=0x7f5d9806c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:03.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d9e019640 1 --2- 172.21.15.130:0/2175874106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d9806bcb0 0x7f5d9806c200 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f5d980b2d60 tx=0x7f5d8c01c340 comp rx=0 tx=0).stop 2023-09-13T06:13:03.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d9e019640 1 -- 172.21.15.130:0/2175874106 shutdown_connections 2023-09-13T06:13:03.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d9e019640 1 --2- 172.21.15.130:0/2175874106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d9806bcb0 0x7f5d9806c200 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:03.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d9e019640 1 --2- 172.21.15.130:0/2175874106 >> v2:172.21.15.164:3300/0 conn(0x7f5d980b1a40 0x7f5d980b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:03.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d9e019640 1 -- 172.21.15.130:0/2175874106 >> 172.21.15.130:0/2175874106 conn(0x7f5d9806e5c0 msgr2=0x7f5d98065960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:03.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d9e019640 1 -- 172.21.15.130:0/2175874106 shutdown_connections 2023-09-13T06:13:03.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d9e019640 1 -- 172.21.15.130:0/2175874106 wait complete. 2023-09-13T06:13:03.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d9e019640 1 Processor -- start 2023-09-13T06:13:03.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.212+0000 7f5d9e019640 1 -- start start 2023-09-13T06:13:03.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d9e019640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d9806bcb0 0x7f5d98070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:03.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d9e019640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d980b1a40 0x7f5d98152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:03.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d9e019640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d98142a40 0x7f5d9813b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:03.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d9e019640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98154890 con 0x7f5d9806bcb0 2023-09-13T06:13:03.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d9e019640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98153fc0 con 0x7f5d980b1a40 2023-09-13T06:13:03.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d9e019640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d981425a0 con 0x7f5d98142a40 2023-09-13T06:13:03.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d9806bcb0 0x7f5d98070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:03.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d9806bcb0 0x7f5d98070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38964/0 (socket says 172.21.15.130:38964) 2023-09-13T06:13:03.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d977fe640 1 -- 172.21.15.130:0/3025265955 learned_addr learned my addr 172.21.15.130:0/3025265955 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:03.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d96ffd640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d980b1a40 0x7f5d98152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:03.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d97fff640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d98142a40 0x7f5d9813b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:03.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d977fe640 1 -- 172.21.15.130:0/3025265955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d98142a40 msgr2=0x7f5d9813b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:03.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d977fe640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d98142a40 0x7f5d9813b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:03.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d977fe640 1 -- 172.21.15.130:0/3025265955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d980b1a40 msgr2=0x7f5d98152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:03.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d977fe640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d980b1a40 0x7f5d98152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:03.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d977fe640 1 -- 172.21.15.130:0/3025265955 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c009420 con 0x7f5d9806bcb0 2023-09-13T06:13:03.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d977fe640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d9806bcb0 0x7f5d98070c40 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800d830 tx=0x7f5d8800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:03.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d7ffff640 1 -- 172.21.15.130:0/3025265955 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800b6c0 con 0x7f5d9806bcb0 2023-09-13T06:13:03.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d7ffff640 1 -- 172.21.15.130:0/3025265955 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8800b820 con 0x7f5d9806bcb0 2023-09-13T06:13:03.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d7ffff640 1 -- 172.21.15.130:0/3025265955 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800bb90 con 0x7f5d9806bcb0 2023-09-13T06:13:03.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d9e019640 1 -- 172.21.15.130:0/3025265955 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d98154240 con 0x7f5d9806bcb0 2023-09-13T06:13:03.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d9e019640 1 -- 172.21.15.130:0/3025265955 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9806fb60 con 0x7f5d9806bcb0 2023-09-13T06:13:03.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d9e019640 1 -- 172.21.15.130:0/3025265955 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d980618a0 con 0x7f5d9806bcb0 2023-09-13T06:13:03.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.216+0000 7f5d7ffff640 1 -- 172.21.15.130:0/3025265955 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5d8801e460 con 0x7f5d9806bcb0 2023-09-13T06:13:03.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.220+0000 7f5d7ffff640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d84065b20 0x7f5d84067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:03.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.220+0000 7f5d7ffff640 1 -- 172.21.15.130:0/3025265955 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d88083990 con 0x7f5d9806bcb0 2023-09-13T06:13:03.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.220+0000 7f5d96ffd640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d84065b20 0x7f5d84067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:03.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.220+0000 7f5d96ffd640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d84065b20 0x7f5d84067fe0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0ad000 tx=0x7f5d8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:03.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.224+0000 7f5d7ffff640 1 -- 172.21.15.130:0/3025265955 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5d88051370 con 0x7f5d9806bcb0 2023-09-13T06:13:03.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.368+0000 7f5d9e019640 1 -- 172.21.15.130:0/3025265955 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5d980ae350 con 0x7f5d9806bcb0 2023-09-13T06:13:03.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d7ffff640 1 -- 172.21.15.130:0/3025265955 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+34050 (secure 0 0 0) 0x7f5d88054990 con 0x7f5d9806bcb0 2023-09-13T06:13:03.372 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:03.372 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:03.372 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 188, 2023-09-13T06:13:03.373 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:13:03.373 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:13:03.373 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:13:02.501263+0000", 2023-09-13T06:13:03.373 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:13:03.373 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:13:03.374 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:13:03.374 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:13:03.374 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:13:03.374 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:13:03.374 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:13:03.375 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:13:03.375 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:13:03.375 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:03.375 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:13:03.375 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:13:03.376 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:13:03.376 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:13:03.376 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:13:03.376 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 23, 2023-09-13T06:13:03.376 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:13:03.376 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:13:03.377 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:13:03.377 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:13:03.377 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:13:03.378 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:13:03.378 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.378 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:13:03.378 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:13:03.378 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:13:03.379 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:03.379 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:03.379 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:03.379 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:03.379 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:03.380 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:03.380 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:03.380 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:03.380 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:03.380 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:03.380 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:03.381 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:03.381 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:13:03.381 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:13:03.381 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:13:03.381 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:13:03.382 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:13:03.382 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:03.382 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:03.382 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:03.382 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:03.383 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:03.383 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:03.383 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:03.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.383 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:13:03.383 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:03.384 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:03.384 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:03.384 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:03.384 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:03.384 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:03.385 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:03.385 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:03.385 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:03.385 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:03.385 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:03.385 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:03.386 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:03.386 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:03.386 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:03.386 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:03.386 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:03.387 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:03.387 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:03.387 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:03.387 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:03.387 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:03.388 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:03.388 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:03.388 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:03.388 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:03.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.388 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:03.389 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:03.389 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:03.389 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:03.389 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:03.389 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:03.389 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:03.390 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:03.390 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:03.390 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:03.390 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:03.390 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:03.391 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:13:03.391 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:13:03.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.391 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:03.391 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:13:03.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.392 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:03.392 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:13:03.392 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:13:03.392 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:13:03.392 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:03.393 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:03.393 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:03.393 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:03.393 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:03.393 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.394 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.394 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 22, 2023-09-13T06:13:03.394 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:13:03.394 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:49.873320+0000", 2023-09-13T06:13:03.394 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:03.395 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:03.395 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:03.395 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:03.395 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:03.395 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:03.395 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:03.396 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:03.396 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:03.396 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:03.396 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:03.396 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:03.396 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:13:03.397 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:13:03.397 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:13:03.397 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:13:03.397 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:13:03.397 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:03.397 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:03.398 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:03.398 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:03.398 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:03.398 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:03.398 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:03.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.399 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "186", 2023-09-13T06:13:03.399 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:03.399 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:03.399 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:03.399 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:03.400 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:03.400 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:03.400 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:03.400 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:03.400 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:03.401 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:03.401 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:03.401 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:03.401 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:03.401 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:03.401 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:03.402 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:03.402 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:03.402 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:03.402 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:03.402 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:03.402 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:03.403 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:03.403 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:03.403 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:03.403 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:03.403 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:03.404 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.404 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:03.404 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:03.404 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:03.404 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:03.405 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:03.405 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:03.405 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:03.405 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:03.405 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:03.406 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:03.406 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:03.406 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:03.406 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:13:03.406 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:13:03.406 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:13:03.407 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.407 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:03.407 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:03.407 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:13:03.407 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.408 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.408 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:03.408 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:13:03.408 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:13:03.408 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:03.408 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:03.409 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:03.409 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:03.409 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:03.409 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:03.409 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.410 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.410 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.410 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 23, 2023-09-13T06:13:03.410 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:13:03.410 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:51.142196+0000", 2023-09-13T06:13:03.410 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:03.411 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:03.411 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:03.411 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:03.411 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:03.411 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:03.412 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:03.412 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:03.412 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:03.412 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:03.413 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:03.413 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:03.413 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:13:03.413 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:13:03.413 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:13:03.414 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:13:03.414 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:13:03.414 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:03.414 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:03.414 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:03.415 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:03.415 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:03.415 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:03.415 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:03.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.415 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "188", 2023-09-13T06:13:03.416 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:03.416 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:03.416 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:03.416 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:03.416 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:03.417 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:03.417 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:03.417 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:03.417 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:03.417 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:13:03.417 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:03.418 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:03.418 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:03.418 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:03.418 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:03.418 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:03.419 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:03.419 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:03.419 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:03.419 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:03.419 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:03.419 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:03.420 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:03.420 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:03.420 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:03.420 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:03.420 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.421 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:03.421 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:03.421 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:03.421 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:03.421 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:03.421 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:03.422 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:03.422 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:03.422 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:03.422 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:03.422 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:03.423 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:03.423 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:13:03.423 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:13:03.423 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.423 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:03.423 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:03.424 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:13:03.424 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.424 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.424 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:03.424 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:13:03.425 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:13:03.425 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:03.425 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:13:03.425 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:13:03.425 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:03.425 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:03.426 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:03.426 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.426 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.426 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:03.426 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:13:03.427 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.427 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:03.427 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:03.427 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:03.427 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:03.427 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:03.428 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:03.428 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:03.428 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:03.428 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:03.428 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:03.429 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:03.429 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:03.429 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:03.429 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.429 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.430 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.430 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:13:03.430 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:03.430 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.430 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.430 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.431 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:13:03.431 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:03.431 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.431 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.431 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.432 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:03.432 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.432 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.432 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.432 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:13:03.432 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:03.433 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.433 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.433 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.433 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:13:03.433 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:03.433 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.434 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.434 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.434 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:03.434 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.434 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.435 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.435 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:13:03.435 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:03.435 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.435 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.436 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.436 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:13:03.436 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:03.436 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.436 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.436 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.437 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:03.437 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.437 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.437 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.437 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:13:03.437 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:03.438 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.438 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.438 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.438 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:13:03.438 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:03.439 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.439 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.439 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.439 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:13:03.439 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:13:03.439 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:13:03.440 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:13:03.440 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:03.440 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:03.440 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:03.440 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.441 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.441 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.441 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:03.441 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:03.441 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:03.441 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:03.442 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:03.442 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:03.442 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:03.442 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:03.442 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:03.443 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:03.443 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:03.443 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:03.443 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:03.445 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.445 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.445 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.445 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:13:03.445 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:03.445 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.446 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.446 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.446 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:13:03.446 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:03.446 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.447 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.447 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.447 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:03.447 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.447 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.447 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.448 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:13:03.448 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:03.448 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.448 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.448 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.449 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:13:03.449 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:03.449 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.449 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.449 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.449 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:03.450 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.450 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.450 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.450 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:13:03.450 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:03.451 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.451 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.451 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.451 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:13:03.451 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:03.451 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.452 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.452 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.452 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:03.452 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.452 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.453 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.453 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:13:03.453 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:03.453 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.453 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.453 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.454 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:13:03.454 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:03.454 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.454 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.454 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.455 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:13:03.455 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:13:03.455 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:13:03.455 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:13:03.455 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:03.456 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:03.456 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:03.456 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.456 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.456 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.456 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:03.457 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:03.457 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:03.457 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:03.457 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:03.457 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:03.458 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:03.458 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:03.458 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:03.458 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:03.458 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:03.458 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:03.459 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:03.459 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.459 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.459 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.459 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:13:03.460 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:03.460 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.460 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.460 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.460 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:13:03.460 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:03.461 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.461 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.461 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:03.461 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.461 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.462 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.462 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:13:03.462 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:03.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.462 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.463 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.463 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:13:03.463 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:03.463 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.463 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.464 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:03.464 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.464 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.464 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.465 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:13:03.465 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:03.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.465 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.465 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.465 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:13:03.466 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:03.466 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.466 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.466 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:03.467 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.467 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.467 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.467 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:13:03.467 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:03.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.468 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.468 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.468 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:13:03.468 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:03.468 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.469 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.469 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.469 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:13:03.469 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:13:03.469 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:13:03.469 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:13:03.470 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:03.470 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:03.470 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:03.470 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.470 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.471 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.471 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:03.471 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:03.471 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:03.471 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:03.471 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:03.472 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:03.472 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:03.472 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:03.472 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:03.472 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:03.473 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:03.473 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:03.473 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:03.473 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.473 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.473 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.474 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:13:03.474 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:03.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.474 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.474 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:13:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:03.476 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.476 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.476 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.476 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:13:03.476 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:03.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.477 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.477 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.477 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:13:03.477 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:03.477 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.478 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.478 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:03.478 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.478 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.479 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.479 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:13:03.479 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:03.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.479 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.480 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.480 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:13:03.480 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:03.480 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.480 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.481 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:03.481 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.481 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.481 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.481 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:13:03.481 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:03.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.482 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.482 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.482 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:13:03.482 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:03.483 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.483 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.483 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:13:03.483 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:13:03.483 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:13:03.484 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:13:03.484 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:03.484 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:03.484 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:03.484 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.485 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.485 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:03.485 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:03.485 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:03.485 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:03.486 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:03.486 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:03.486 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:03.486 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:03.486 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:03.487 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:03.487 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:03.487 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:03.487 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:03.487 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.487 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.488 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.488 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:13:03.488 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:03.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.488 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.488 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.489 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:13:03.489 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:03.489 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.489 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.490 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:03.490 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.490 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.490 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.490 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:13:03.490 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:03.491 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.491 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.491 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.491 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:13:03.491 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:03.492 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.492 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.492 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.492 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:03.492 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.492 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.493 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.493 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:13:03.493 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:03.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.493 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.494 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.494 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:13:03.494 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:03.494 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.494 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.495 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:03.495 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.495 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.495 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.495 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:13:03.496 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:03.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.496 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.496 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:13:03.496 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:03.497 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.497 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.497 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.497 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:13:03.497 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:13:03.497 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:13:03.498 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:13:03.498 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:03.498 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:03.498 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:03.498 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.499 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.499 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:03.499 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:03.499 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:03.499 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:03.500 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:03.500 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:03.500 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:03.500 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:03.500 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:03.501 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:03.501 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:03.501 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:03.501 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:03.501 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.501 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.502 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.502 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:13:03.502 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:03.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.502 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.503 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.503 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:13:03.503 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:03.503 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.503 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.504 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:03.504 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.504 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.504 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.504 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:13:03.504 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:03.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.505 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.505 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.505 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:13:03.505 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:03.506 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.506 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.506 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:03.506 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.506 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.507 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.507 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:13:03.507 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:03.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.507 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.508 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.508 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:13:03.508 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:03.508 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.508 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.508 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.509 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:03.509 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.509 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.509 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.509 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:13:03.509 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:03.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.510 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.510 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.510 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:13:03.510 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:03.511 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.511 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.511 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:13:03.511 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:13:03.511 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:13:03.512 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:13:03.512 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:03.512 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:03.512 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:03.512 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.513 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:03.513 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:03.513 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:03.513 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:03.514 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:03.514 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:03.514 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:03.514 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:03.514 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:03.515 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:03.515 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:03.515 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:03.515 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:03.515 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.515 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.516 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.516 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:13:03.516 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:03.516 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.516 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.517 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.517 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:13:03.517 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:03.517 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.517 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.517 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.518 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:03.518 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.518 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.518 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.518 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:13:03.519 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:03.519 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.519 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.519 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.519 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:13:03.519 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:03.520 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.520 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.520 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:03.520 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.520 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.521 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.521 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:13:03.521 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:03.521 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.521 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.522 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.522 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:13:03.522 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:03.522 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.522 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.522 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.523 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:03.523 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.523 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.523 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.523 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:13:03.524 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:03.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.524 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.524 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.524 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:13:03.524 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:03.525 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.525 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.525 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.525 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:13:03.525 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:13:03.526 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:13:03.526 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:13:03.526 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:03.526 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:03.526 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:03.526 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.527 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.527 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:03.527 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:03.527 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:03.528 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:03.528 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:03.528 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:03.528 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:03.528 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:03.528 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:03.529 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:03.529 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:03.529 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:03.529 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:03.529 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.530 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.530 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:13:03.530 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:03.530 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.531 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.531 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:13:03.531 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:03.532 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.532 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.532 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.532 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:03.532 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.533 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.533 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:13:03.533 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:03.533 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.534 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.534 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:13:03.534 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:03.534 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.534 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.535 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:03.535 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.535 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.535 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.535 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:13:03.536 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:03.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.536 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.536 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:13:03.537 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:03.537 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.537 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.537 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:03.537 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:03.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.538 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:03.538 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:13:03.538 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:03.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.539 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:03.539 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:13:03.539 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:03.539 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.539 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.540 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:13:03.540 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:13:03.540 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:13:03.540 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:13:03.541 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:03.541 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:03.541 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:03.541 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:03.541 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.541 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:03.542 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:13:03.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.542 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:03.542 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:03.542 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:03.543 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:03.543 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:03.543 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:03.543 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:13:03.543 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:03.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.544 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.544 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:03.544 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:03.544 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:03.544 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:03.545 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:03.545 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:03.545 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:13:03.545 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:03.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.546 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:03.546 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:03.546 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:03.546 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:03.546 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:03.546 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:03.547 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:13:03.547 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:03.547 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.547 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.547 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:03.548 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:03.548 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:03.548 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:03.548 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:03.548 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:03.548 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:13:03.549 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:03.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.549 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:03.549 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:03.550 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:03.550 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:03.550 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:03.550 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:03.550 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:13:03.550 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:03.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.551 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:03.551 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:03.551 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:03.552 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:03.552 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:03.552 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:03.552 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:13:03.552 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:03.552 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.553 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:03.553 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:03.553 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:03.553 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:03.554 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:03.554 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:03.554 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:13:03.554 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:03.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.555 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:03.555 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:03.555 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:03.555 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:03.555 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:03.555 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:03.556 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:03.556 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:13:03.556 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:03.556 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.556 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:03.556 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:13:03.557 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:13:03.557 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:13:03.557 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:13:03.557 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:13:03.557 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:13:03.558 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:13:03.558 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:13:03.558 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:13:03.558 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:13:03.558 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:13:03.558 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:13:03.559 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:13:03.559 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:13:03.559 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:03.559 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:13:03.560 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:13:03.560 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:13:03.560 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:13:03.560 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:13:03.560 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:13:03.561 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:13:03.561 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:13:03.561 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:13:03.561 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:13:03.561 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:13:03.561 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:03.562 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:03.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 -- 172.21.15.130:0/3025265955 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d84065b20 msgr2=0x7f5d84067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d84065b20 0x7f5d84067fe0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0ad000 tx=0x7f5d8c008040 comp rx=0 tx=0).stop 2023-09-13T06:13:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 -- 172.21.15.130:0/3025265955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d9806bcb0 msgr2=0x7f5d98070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d9806bcb0 0x7f5d98070c40 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800d830 tx=0x7f5d8800dcf0 comp rx=0 tx=0).stop 2023-09-13T06:13:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 -- 172.21.15.130:0/3025265955 shutdown_connections 2023-09-13T06:13:03.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5d84065b20 0x7f5d84067fe0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d980b1a40 0x7f5d98152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d98142a40 0x7f5d9813b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 --2- 172.21.15.130:0/3025265955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d9806bcb0 0x7f5d98070c40 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 -- 172.21.15.130:0/3025265955 >> 172.21.15.130:0/3025265955 conn(0x7f5d9806e5c0 msgr2=0x7f5d98142e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:03.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 -- 172.21.15.130:0/3025265955 shutdown_connections 2023-09-13T06:13:03.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:03.372+0000 7f5d9e019640 1 -- 172.21.15.130:0/3025265955 wait complete. 2023-09-13T06:13:03.566 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:13:08.567 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:13:08.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd6ddb640 1 Processor -- start 2023-09-13T06:13:08.716 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd6ddb640 1 -- start start 2023-09-13T06:13:08.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd6ddb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efcd00d1750 0x7efcd015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:08.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd6ddb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efcd00d1090 0x7efcd0146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:08.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd6ddb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd00b63c0 con 0x7efcd00d1b30 2023-09-13T06:13:08.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd6ddb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd015dea0 con 0x7efcd00d1750 2023-09-13T06:13:08.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd6ddb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd00d0c20 con 0x7efcd00d1090 2023-09-13T06:13:08.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd4b77640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efcd00d1750 0x7efcd015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:08.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd5378640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7efcd00d1b30 0x7efcd00b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:58608/0 (socket says 172.21.15.130:58608) 2023-09-13T06:13:08.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd5378640 1 -- 172.21.15.130:0/3418405530 learned_addr learned my addr 172.21.15.130:0/3418405530 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:08.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcc7fff640 1 --2- 172.21.15.130:0/3418405530 >> v2:172.21.15.164:3300/0 conn(0x7efcd00d1090 0x7efcd0146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:08.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd4b77640 1 -- 172.21.15.130:0/3418405530 >> v2:172.21.15.164:3300/0 conn(0x7efcd00d1090 msgr2=0x7efcd0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:08.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd4b77640 1 --2- 172.21.15.130:0/3418405530 >> v2:172.21.15.164:3300/0 conn(0x7efcd00d1090 0x7efcd0146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:08.720 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd4b77640 1 -- 172.21.15.130:0/3418405530 >> v1:172.21.15.130:6789/0 conn(0x7efcd00d1b30 legacy=0x7efcd00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:08.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcd4b77640 1 -- 172.21.15.130:0/3418405530 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd00b6610 con 0x7efcd00d1750 2023-09-13T06:13:08.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.716+0000 7efcc7fff640 1 --2- 172.21.15.130:0/3418405530 >> v2:172.21.15.164:3300/0 conn(0x7efcd00d1090 0x7efcd0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:08.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcd4b77640 1 --2- 172.21.15.130:0/3418405530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcd00d1750 0x7efcd015d960 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7efcd00c8360 tx=0x7efccc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eac2327d3c0f8dc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:08.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcc77fe640 1 -- 172.21.15.130:0/3418405530 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0a7070 con 0x7efcd00d1750 2023-09-13T06:13:08.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcc77fe640 1 -- 172.21.15.130:0/3418405530 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc0ab430 con 0x7efcd00d1750 2023-09-13T06:13:08.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcc77fe640 1 -- 172.21.15.130:0/3418405530 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0ab7c0 con 0x7efcd00d1750 2023-09-13T06:13:08.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3418405530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcd00d1750 msgr2=0x7efcd015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:08.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcd6ddb640 1 --2- 172.21.15.130:0/3418405530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcd00d1750 0x7efcd015d960 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7efcd00c8360 tx=0x7efccc01c430 comp rx=0 tx=0).stop 2023-09-13T06:13:08.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3418405530 shutdown_connections 2023-09-13T06:13:08.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcd6ddb640 1 --2- 172.21.15.130:0/3418405530 >> v2:172.21.15.164:3300/0 conn(0x7efcd00d1090 0x7efcd0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:08.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcd6ddb640 1 --2- 172.21.15.130:0/3418405530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcd00d1750 0x7efcd015d960 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:08.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3418405530 >> 172.21.15.130:0/3418405530 conn(0x7efcd006f170 msgr2=0x7efcd006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:08.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3418405530 shutdown_connections 2023-09-13T06:13:08.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.720+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3418405530 wait complete. 2023-09-13T06:13:08.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd6ddb640 1 Processor -- start 2023-09-13T06:13:08.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd6ddb640 1 -- start start 2023-09-13T06:13:08.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd6ddb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efcd00d1090 0x7efcd015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:08.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd6ddb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcd00d1750 0x7efcd0145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:08.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd6ddb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efcd00d1b30 0x7efcd013af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:08.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd6ddb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd01fdcc0 con 0x7efcd00d1750 2023-09-13T06:13:08.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd6ddb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0143c20 con 0x7efcd00d1090 2023-09-13T06:13:08.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd6ddb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0143f00 con 0x7efcd00d1b30 2023-09-13T06:13:08.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcd00d1750 0x7efcd0145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:08.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcd00d1750 0x7efcd0145300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38986/0 (socket says 172.21.15.130:38986) 2023-09-13T06:13:08.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc7fff640 1 -- 172.21.15.130:0/3912005381 learned_addr learned my addr 172.21.15.130:0/3912005381 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:08.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd4b77640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efcd00d1090 0x7efcd015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:08.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd5378640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efcd00d1b30 0x7efcd013af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:08.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc7fff640 1 -- 172.21.15.130:0/3912005381 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efcd00d1b30 msgr2=0x7efcd013af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:08.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc7fff640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efcd00d1b30 0x7efcd013af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:08.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc7fff640 1 -- 172.21.15.130:0/3912005381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efcd00d1090 msgr2=0x7efcd015cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:08.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc7fff640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efcd00d1090 0x7efcd015cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:08.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc7fff640 1 -- 172.21.15.130:0/3912005381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc009420 con 0x7efcd00d1750 2023-09-13T06:13:08.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc7fff640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcd00d1750 0x7efcd0145300 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7efcc000d7d0 tx=0x7efcc000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:08.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc57fa640 1 -- 172.21.15.130:0/3912005381 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc00096a0 con 0x7efcd00d1750 2023-09-13T06:13:08.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc57fa640 1 -- 172.21.15.130:0/3912005381 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc0009800 con 0x7efcd00d1750 2023-09-13T06:13:08.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcc57fa640 1 -- 172.21.15.130:0/3912005381 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0009bb0 con 0x7efcd00d1750 2023-09-13T06:13:08.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3912005381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd01441e0 con 0x7efcd00d1750 2023-09-13T06:13:08.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.724+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3912005381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd015d450 con 0x7efcd00d1750 2023-09-13T06:13:08.732 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.728+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3912005381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd01fde00 con 0x7efcd00d1750 2023-09-13T06:13:08.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.728+0000 7efcc57fa640 1 -- 172.21.15.130:0/3912005381 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efcc0009d10 con 0x7efcd00d1750 2023-09-13T06:13:08.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.728+0000 7efcc57fa640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efcbc065b20 0x7efcbc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:08.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.728+0000 7efcc57fa640 1 -- 172.21.15.130:0/3912005381 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcc00839e0 con 0x7efcd00d1750 2023-09-13T06:13:08.733 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.728+0000 7efcd4b77640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efcbc065b20 0x7efcbc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:08.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.728+0000 7efcc57fa640 1 -- 172.21.15.130:0/3912005381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=190}) v3 -- 0x7efcbc06d650 con 0x7efcd00d1750 2023-09-13T06:13:08.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.728+0000 7efcd4b77640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efcbc065b20 0x7efcbc067fe0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efccc0af000 tx=0x7efccc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:08.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.732+0000 7efcc57fa640 1 -- 172.21.15.130:0/3912005381 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7efcd01fde00 con 0x7efcd00d1750 2023-09-13T06:13:08.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.884+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3912005381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7efcd01fde00 con 0x7efcd00d1750 2023-09-13T06:13:08.886 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.884+0000 7efcc57fa640 1 -- 172.21.15.130:0/3912005381 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) v1 ==== 81+0+34069 (secure 0 0 0) 0x7efcd01fde00 con 0x7efcd00d1750 2023-09-13T06:13:08.887 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:08.887 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:08.887 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 189, 2023-09-13T06:13:08.888 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:13:08.888 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:13:08.888 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:13:07.484452+0000", 2023-09-13T06:13:08.888 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:13:08.888 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:13:08.888 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:13:08.889 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:13:08.889 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:13:08.889 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:13:08.889 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:13:08.889 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:13:08.889 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:13:08.890 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:08.890 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:13:08.890 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:13:08.890 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:13:08.891 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:13:08.891 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:13:08.891 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 23, 2023-09-13T06:13:08.891 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:13:08.891 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:13:08.891 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:13:08.892 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:13:08.892 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:13:08.892 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:13:08.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.892 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:13:08.893 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:13:08.893 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:13:08.893 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:08.893 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:08.893 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:08.894 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:08.894 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:08.894 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:08.894 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:08.894 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:08.895 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:08.895 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:08.895 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:08.895 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:08.895 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:13:08.896 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:13:08.896 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:13:08.896 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:13:08.896 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:13:08.897 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:08.897 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:08.897 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:08.897 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:08.897 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:08.897 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:08.898 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:08.898 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.898 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:13:08.898 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:08.898 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:08.899 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:08.899 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:08.899 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:08.899 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:08.899 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:08.900 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:08.900 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:08.900 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:08.900 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:08.900 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:08.901 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:08.901 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:08.901 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:08.901 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:08.901 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:08.902 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:08.902 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:08.902 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:08.902 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:08.902 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:08.902 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:08.903 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:08.903 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:08.903 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:08.903 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.903 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:08.904 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:08.904 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:08.904 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:08.904 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:08.904 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:08.905 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:08.905 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:08.905 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:08.905 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:08.905 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:08.906 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:08.906 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:13:08.906 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:13:08.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.906 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:08.907 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:13:08.907 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.907 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:08.907 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:13:08.907 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:13:08.907 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:13:08.908 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:08.908 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:08.908 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:08.908 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:08.908 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:08.909 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.909 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 22, 2023-09-13T06:13:08.909 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:13:08.909 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:49.873320+0000", 2023-09-13T06:13:08.910 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:08.910 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:08.910 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:08.910 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:08.910 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:08.911 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:08.911 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:08.911 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:08.911 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:08.911 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:08.912 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:08.912 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:08.912 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:13:08.912 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:13:08.912 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:13:08.912 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:13:08.913 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:13:08.913 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:08.913 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:08.913 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:08.913 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:08.914 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:08.914 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:08.914 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:08.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.914 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "186", 2023-09-13T06:13:08.915 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:08.915 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:08.915 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:08.915 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:08.915 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:08.916 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:08.916 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:08.916 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:08.916 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:08.916 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:08.917 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:08.917 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:08.917 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:08.917 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:08.917 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:08.917 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:08.918 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:08.918 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:08.918 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:08.918 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:08.918 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:08.919 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:08.919 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:08.919 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:08.919 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:08.919 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:08.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.920 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:08.920 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:08.920 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:08.920 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:08.920 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:08.921 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:08.921 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:08.921 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:08.921 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:08.921 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:08.921 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:08.922 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:08.922 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:13:08.922 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:13:08.922 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:13:08.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.923 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:08.923 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:08.923 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:13:08.923 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.923 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:08.924 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:13:08.924 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:13:08.924 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:08.924 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:08.924 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:08.924 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:08.925 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:08.925 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:08.925 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.925 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.926 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 23, 2023-09-13T06:13:08.926 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:13:08.926 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:51.142196+0000", 2023-09-13T06:13:08.926 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1027, 2023-09-13T06:13:08.926 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-13T06:13:08.927 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:08.927 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:08.927 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:08.927 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:08.927 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:08.928 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:08.928 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:08.928 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:08.928 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:08.928 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:08.929 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:13:08.929 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:13:08.929 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:13:08.929 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:13:08.929 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:13:08.929 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:08.930 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:08.930 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:08.930 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:08.930 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:08.930 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:08.931 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:08.931 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.931 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "189", 2023-09-13T06:13:08.931 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:08.931 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:08.932 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:08.932 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:08.932 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:08.932 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:08.932 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:08.933 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:08.933 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:08.933 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:13:08.933 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:08.933 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:08.933 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:08.934 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:08.934 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:08.934 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:08.934 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:08.934 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:08.935 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:08.935 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:08.935 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:08.935 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:08.935 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:08.936 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:08.936 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:08.936 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:08.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.936 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:08.936 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:08.937 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:08.937 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:08.937 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:08.937 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:08.937 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:08.938 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:08.938 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:08.938 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:08.938 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:08.938 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:08.939 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:13:08.939 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:13:08.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.939 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:08.939 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:08.939 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:13:08.940 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.940 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.940 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:08.940 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:13:08.940 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:13:08.941 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:08.941 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:13:08.941 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:13:08.941 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:08.941 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:08.942 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:08.942 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.942 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.942 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:08.942 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:13:08.943 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.943 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:08.943 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:08.943 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:08.944 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:08.944 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:08.944 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:08.944 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:08.944 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:08.944 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:08.945 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:08.945 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:08.945 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:08.945 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:08.945 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.946 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.946 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.946 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:13:08.946 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:08.946 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.947 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.947 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:13:08.947 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:08.947 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.948 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.948 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:08.948 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.949 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.949 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:13:08.949 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:08.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.949 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.950 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.950 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:13:08.950 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:08.950 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.950 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.951 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.951 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:08.951 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.951 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.952 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:13:08.952 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:08.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.952 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.953 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:13:08.953 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:08.953 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.953 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.953 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:08.954 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.954 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.954 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.954 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:13:08.954 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:08.955 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.955 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.955 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:13:08.955 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:08.956 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.956 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.956 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:13:08.956 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:13:08.957 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:13:08.957 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:13:08.957 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:08.957 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:08.957 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:08.957 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.958 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.958 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.958 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:08.958 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:08.958 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:08.959 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:08.959 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:08.959 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:08.959 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:08.959 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:08.960 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:08.960 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:08.960 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:08.960 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:08.960 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:08.960 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.961 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.961 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.961 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:13:08.961 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:08.961 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.962 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.962 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:13:08.962 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:08.962 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.963 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.963 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:08.963 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.963 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.964 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:13:08.964 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:08.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.964 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.964 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.965 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:13:08.965 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:08.965 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.965 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.965 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:08.966 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.966 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.966 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:13:08.966 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:08.967 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.967 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.967 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.967 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:13:08.967 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:08.968 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.968 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.968 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:08.968 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.969 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.969 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:13:08.969 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:08.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.970 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.970 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:13:08.970 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:08.970 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.970 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.971 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:13:08.971 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:13:08.971 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:13:08.971 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:13:08.972 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:08.972 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:08.972 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:08.972 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.973 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.973 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:08.973 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:08.973 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:08.973 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:08.974 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:08.974 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:08.974 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:08.974 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:08.974 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:08.975 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:08.975 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:08.975 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:08.975 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:08.975 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.976 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.976 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:13:08.976 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:08.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.976 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.977 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.977 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:13:08.977 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:08.977 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.977 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.978 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.978 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:08.978 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.978 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.978 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.979 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:13:08.979 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:08.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.979 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.980 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:13:08.980 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:08.980 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.980 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.981 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:08.981 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.981 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.981 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:13:08.982 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:08.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.982 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.982 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.982 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:13:08.983 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:08.983 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.983 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.983 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.983 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:08.984 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.984 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.984 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:13:08.984 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:08.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.985 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.985 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.985 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:13:08.985 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:08.985 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.986 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.986 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:13:08.986 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:13:08.986 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:13:08.987 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:13:08.987 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:08.987 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:08.987 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:08.987 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.988 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:08.988 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:08.988 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:08.989 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:08.989 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:08.989 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:08.989 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:08.989 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:08.989 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:08.990 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:08.990 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:08.990 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:08.990 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:08.990 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.991 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.991 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.991 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:13:08.991 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:08.991 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.992 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.992 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:13:08.992 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:08.992 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.992 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.993 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.993 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:08.993 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.993 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.993 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.994 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:13:08.994 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:08.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.994 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.994 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.995 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:13:08.995 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:08.995 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.995 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.995 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.995 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:08.996 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.996 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.996 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.996 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:13:08.996 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:08.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.997 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:08.997 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:13:08.997 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:08.997 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:08.998 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:08.998 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.998 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:08.998 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:08.998 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:08.999 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:08.999 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:13:08.999 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:08.999 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:08.999 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.000 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.000 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:13:09.000 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:09.000 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.000 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.000 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.001 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:13:09.001 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:13:09.001 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:13:09.001 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:13:09.001 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.002 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.002 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.002 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.002 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.003 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:09.003 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.003 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.003 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.003 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.004 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.004 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.004 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.004 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.004 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.005 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.005 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.005 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.005 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.005 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.005 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.006 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:13:09.006 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.006 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.006 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.007 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:13:09.007 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.007 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.007 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.007 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.008 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.008 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.008 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.008 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.008 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:13:09.009 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.009 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.009 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.009 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:13:09.010 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.010 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.010 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.010 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.010 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.011 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.011 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.011 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.011 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:13:09.011 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.012 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.012 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:13:09.012 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.013 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.013 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.013 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.013 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.014 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.014 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:13:09.014 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.015 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.015 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.015 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:13:09.015 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.015 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.016 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.016 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.016 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:13:09.016 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:13:09.016 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:13:09.017 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:13:09.017 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.017 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.017 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.017 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.018 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.018 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:09.018 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.018 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.019 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.019 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.019 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.019 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.020 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.020 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.020 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.020 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.020 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.021 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.021 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.021 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.021 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:13:09.022 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.022 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.022 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:13:09.023 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.023 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.023 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.023 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.024 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.024 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.024 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.024 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:13:09.024 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.025 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.025 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:13:09.025 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.026 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.026 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.026 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.026 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.026 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.026 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.027 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.027 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:13:09.027 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.027 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.028 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.028 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:13:09.028 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.028 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.028 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.029 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.029 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.029 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.030 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:13:09.030 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.030 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.031 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:13:09.031 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.031 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.031 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.032 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:13:09.032 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:13:09.032 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:13:09.032 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:13:09.033 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.033 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.033 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.033 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.034 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:09.034 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.034 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.034 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.034 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.035 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.035 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.035 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.035 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.035 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.036 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.036 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.036 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.036 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.036 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.037 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:13:09.037 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.037 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.038 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:13:09.038 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.038 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.038 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.039 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.039 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.039 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.039 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.039 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:13:09.039 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.040 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.040 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:13:09.040 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.041 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.041 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.041 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.041 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.042 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.042 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:13:09.042 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.042 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.042 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.043 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.043 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:13:09.043 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.043 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.043 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.044 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.044 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.044 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.045 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:13:09.045 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.045 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.045 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.046 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:13:09.046 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.046 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.046 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.046 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:13:09.047 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:13:09.047 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:13:09.047 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:13:09.047 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.047 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.048 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.048 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.048 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.048 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:09.048 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.049 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.049 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.049 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.049 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.049 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.050 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.050 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.050 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.050 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.050 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.051 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.051 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.051 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.051 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:13:09.051 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.052 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.052 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:13:09.052 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.052 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.053 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.053 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.053 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.054 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.054 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:13:09.054 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.054 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.055 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.055 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:13:09.055 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.055 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.055 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.056 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.056 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.056 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.057 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:13:09.057 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.057 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.057 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.057 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:13:09.058 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.058 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.058 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.058 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.059 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.059 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.059 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:13:09.059 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.060 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.060 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.060 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:13:09.060 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.061 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.061 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.061 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:13:09.061 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:13:09.061 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:13:09.062 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:13:09.062 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.062 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.062 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.062 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.063 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.063 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:09.063 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:13:09.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.063 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:09.063 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.064 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.064 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.064 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.064 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.064 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:13:09.065 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.065 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:09.065 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.066 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.066 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.066 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.066 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.066 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:13:09.067 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.067 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:09.067 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.067 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.068 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.068 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.068 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.068 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:13:09.068 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.069 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:09.069 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.069 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.069 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.070 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.070 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.070 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:13:09.070 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.071 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:09.071 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.071 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.071 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.072 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.072 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.072 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:13:09.072 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.073 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:09.073 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.073 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.073 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.073 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.074 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.074 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:13:09.074 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.075 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:09.075 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.075 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.075 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.075 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.075 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.076 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:13:09.076 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.076 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:09.077 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.077 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.077 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.077 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.077 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.078 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:13:09.078 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.078 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.078 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:09.078 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:13:09.079 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:13:09.079 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:13:09.079 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:13:09.079 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:13:09.079 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:13:09.079 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:13:09.080 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:13:09.080 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:13:09.080 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:13:09.080 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:13:09.080 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:13:09.081 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:13:09.081 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:13:09.081 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.081 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:13:09.081 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:13:09.082 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:13:09.082 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:13:09.082 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:13:09.082 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:13:09.082 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:13:09.083 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:13:09.083 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:13:09.083 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:13:09.083 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:13:09.083 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.084 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:09.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.884+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3912005381 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efcbc065b20 msgr2=0x7efcbc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:09.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.884+0000 7efcd6ddb640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efcbc065b20 0x7efcbc067fe0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efccc0af000 tx=0x7efccc0a7000 comp rx=0 tx=0).stop 2023-09-13T06:13:09.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.884+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3912005381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcd00d1750 msgr2=0x7efcd0145300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:09.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.884+0000 7efcd6ddb640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcd00d1750 0x7efcd0145300 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7efcc000d7d0 tx=0x7efcc000dc90 comp rx=0 tx=0).stop 2023-09-13T06:13:09.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.888+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3912005381 shutdown_connections 2023-09-13T06:13:09.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.888+0000 7efcd6ddb640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efcbc065b20 0x7efcbc067fe0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:09.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.888+0000 7efcd6ddb640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efcd00d1b30 0x7efcd013af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:09.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.888+0000 7efcd6ddb640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcd00d1750 0x7efcd0145300 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:09.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.888+0000 7efcd6ddb640 1 --2- 172.21.15.130:0/3912005381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efcd00d1090 0x7efcd015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:09.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.888+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3912005381 >> 172.21.15.130:0/3912005381 conn(0x7efcd006f170 msgr2=0x7efcd015f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:09.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.888+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3912005381 shutdown_connections 2023-09-13T06:13:09.087 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:08.888+0000 7efcd6ddb640 1 -- 172.21.15.130:0/3912005381 wait complete. 2023-09-13T06:13:09.088 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-09-13T06:13:09.088 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:13:09.089 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:09.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:09.099 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-09-13T06:13:09.487 INFO:teuthology.orchestra.run.smithi130.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-09-13T06:13:09.487 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records in 2023-09-13T06:13:09.488 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records out 2023-09-13T06:13:09.488 INFO:teuthology.orchestra.run.smithi130.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.332731 s, 158 MB/s 2023-09-13T06:13:09.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:13:09.489 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:13:09.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eaf4d8640 1 Processor -- start 2023-09-13T06:13:09.628 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eaf4d8640 1 -- start start 2023-09-13T06:13:09.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eaf4d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ea80d1090 0x7f2ea815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:09.629 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eaf4d8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ea8146f30 0x7f2ea80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:09.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eaf4d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea80b63c0 con 0x7f2ea80d1750 2023-09-13T06:13:09.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eaf4d8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea815dea0 con 0x7f2ea8146f30 2023-09-13T06:13:09.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eaf4d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea80d0c20 con 0x7f2ea80d1090 2023-09-13T06:13:09.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eada75640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ea8146f30 0x7f2ea80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:09.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eada75640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ea8146f30 0x7f2ea80b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38994/0 (socket says 172.21.15.130:38994) 2023-09-13T06:13:09.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eada75640 1 -- 172.21.15.130:0/2370964320 learned_addr learned my addr 172.21.15.130:0/2370964320 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:09.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eaca73640 1 --2- 172.21.15.130:0/2370964320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ea80d1090 0x7f2ea815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:09.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eada75640 1 -- 172.21.15.130:0/2370964320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ea80d1090 msgr2=0x7f2ea815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:09.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eada75640 1 --2- 172.21.15.130:0/2370964320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ea80d1090 0x7f2ea815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:09.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eada75640 1 -- 172.21.15.130:0/2370964320 >> v1:172.21.15.164:6789/0 conn(0x7f2ea80d1750 legacy=0x7f2ea8146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:09.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.628+0000 7f2eada75640 1 -- 172.21.15.130:0/2370964320 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea80b6610 con 0x7f2ea8146f30 2023-09-13T06:13:09.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2eada75640 1 --2- 172.21.15.130:0/2370964320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ea8146f30 0x7f2ea80b70f0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009e50 tx=0x7f2ea001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1aad9c488d5e7db server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:09.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2e9ffff640 1 -- 172.21.15.130:0/2370964320 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00a58a0 con 0x7f2ea8146f30 2023-09-13T06:13:09.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2e9ffff640 1 -- 172.21.15.130:0/2370964320 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea00a5a00 con 0x7f2ea8146f30 2023-09-13T06:13:09.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2e9ffff640 1 -- 172.21.15.130:0/2370964320 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00a5d90 con 0x7f2ea8146f30 2023-09-13T06:13:09.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/2370964320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ea8146f30 msgr2=0x7f2ea80b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:09.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2eaf4d8640 1 --2- 172.21.15.130:0/2370964320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ea8146f30 0x7f2ea80b70f0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009e50 tx=0x7f2ea001c9e0 comp rx=0 tx=0).stop 2023-09-13T06:13:09.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/2370964320 shutdown_connections 2023-09-13T06:13:09.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2eaf4d8640 1 --2- 172.21.15.130:0/2370964320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ea8146f30 0x7f2ea80b70f0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:09.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2eaf4d8640 1 --2- 172.21.15.130:0/2370964320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ea80d1090 0x7f2ea815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:09.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/2370964320 >> 172.21.15.130:0/2370964320 conn(0x7f2ea806f170 msgr2=0x7f2ea806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:09.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/2370964320 shutdown_connections 2023-09-13T06:13:09.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.632+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/2370964320 wait complete. 2023-09-13T06:13:09.637 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eaf4d8640 1 Processor -- start 2023-09-13T06:13:09.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eaf4d8640 1 -- start start 2023-09-13T06:13:09.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eaf4d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ea80d1090 0x7f2ea813ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:09.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eaf4d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ea80d1750 0x7f2ea815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:09.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eaf4d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ea8146f30 0x7f2ea81678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:09.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eaf4d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea815cb40 con 0x7f2ea8146f30 2023-09-13T06:13:09.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eaf4d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea8166880 con 0x7f2ea80d1750 2023-09-13T06:13:09.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eaf4d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea8166b20 con 0x7f2ea80d1090 2023-09-13T06:13:09.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eada75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ea8146f30 0x7f2ea81678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:09.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eada75640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ea8146f30 0x7f2ea81678e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39000/0 (socket says 172.21.15.130:39000) 2023-09-13T06:13:09.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eada75640 1 -- 172.21.15.130:0/1272272466 learned_addr learned my addr 172.21.15.130:0/1272272466 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:09.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2ead274640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ea80d1090 0x7f2ea813ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:09.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eaca73640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ea80d1750 0x7f2ea815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:09.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eada75640 1 -- 172.21.15.130:0/1272272466 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ea80d1090 msgr2=0x7f2ea813ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:09.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eada75640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ea80d1090 0x7f2ea813ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:09.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eada75640 1 -- 172.21.15.130:0/1272272466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ea80d1750 msgr2=0x7f2ea815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:09.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eada75640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ea80d1750 0x7f2ea815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:09.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eada75640 1 -- 172.21.15.130:0/1272272466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0009b30 con 0x7f2ea8146f30 2023-09-13T06:13:09.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eada75640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ea8146f30 0x7f2ea81678e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00af040 tx=0x7f2ea0019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:09.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2e9dffb640 1 -- 172.21.15.130:0/1272272466 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00b8640 con 0x7f2ea8146f30 2023-09-13T06:13:09.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2e9dffb640 1 -- 172.21.15.130:0/1272272466 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea00b87a0 con 0x7f2ea8146f30 2023-09-13T06:13:09.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/1272272466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea80b7e40 con 0x7f2ea8146f30 2023-09-13T06:13:09.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2e9dffb640 1 -- 172.21.15.130:0/1272272466 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00b8b10 con 0x7f2ea8146f30 2023-09-13T06:13:09.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.636+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/1272272466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea81670e0 con 0x7f2ea8146f30 2023-09-13T06:13:09.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.640+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/1272272466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea80618a0 con 0x7f2ea8146f30 2023-09-13T06:13:09.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.640+0000 7f2e9dffb640 1 -- 172.21.15.130:0/1272272466 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2ea00b8c70 con 0x7f2ea8146f30 2023-09-13T06:13:09.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.640+0000 7f2e9dffb640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e8c065b20 0x7f2e8c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:09.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.640+0000 7f2e9dffb640 1 -- 172.21.15.130:0/1272272466 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ea011e600 con 0x7f2ea8146f30 2023-09-13T06:13:09.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.640+0000 7f2ead274640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e8c065b20 0x7f2e8c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:09.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.640+0000 7f2e9dffb640 1 -- 172.21.15.130:0/1272272466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=190}) v3 -- 0x7f2e8c06d650 con 0x7f2ea8146f30 2023-09-13T06:13:09.644 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.640+0000 7f2ead274640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e8c065b20 0x7f2e8c067fe0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8166670 tx=0x7f2ea4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:09.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.644+0000 7f2e9dffb640 1 -- 172.21.15.130:0/1272272466 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2ea00ebff0 con 0x7f2ea8146f30 2023-09-13T06:13:09.794 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.792+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/1272272466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2ea80b86c0 con 0x7f2ea8146f30 2023-09-13T06:13:09.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2e9dffb640 1 -- 172.21.15.130:0/1272272466 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) v1 ==== 81+0+34069 (secure 0 0 0) 0x7f2ea00ef610 con 0x7f2ea8146f30 2023-09-13T06:13:09.796 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:09.796 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:09.796 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 189, 2023-09-13T06:13:09.796 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:13:09.797 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:13:09.797 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:13:07.484452+0000", 2023-09-13T06:13:09.797 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:13:09.797 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:13:09.798 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:13:09.798 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:13:09.798 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:13:09.798 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:13:09.798 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:13:09.799 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:13:09.799 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:13:09.799 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:09.799 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:13:09.799 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:13:09.800 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:13:09.800 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:13:09.800 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:13:09.800 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 23, 2023-09-13T06:13:09.801 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:13:09.801 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:13:09.801 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:13:09.801 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:13:09.802 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:13:09.802 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:13:09.802 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.802 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:13:09.802 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:13:09.803 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:13:09.803 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:09.803 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:09.803 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:09.803 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:09.804 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:09.804 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:09.804 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:09.804 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:09.804 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:09.805 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:09.805 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:09.805 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:09.805 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:13:09.805 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:13:09.805 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:13:09.806 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:13:09.806 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:13:09.806 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:09.806 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:09.806 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:09.807 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:09.807 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:09.807 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:09.807 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:09.807 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.807 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:13:09.807 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:09.808 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:09.808 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:09.808 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:09.808 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:09.808 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:09.809 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:09.809 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:09.809 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:09.809 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:09.809 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:09.810 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:09.810 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:09.810 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:09.810 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:09.810 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:09.810 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:09.811 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:09.811 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:09.811 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:09.811 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:09.811 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:09.812 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:09.812 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:09.812 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:09.812 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:09.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.812 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:09.813 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:09.813 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:09.813 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:09.813 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:09.813 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:09.813 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:09.814 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:09.814 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:09.814 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:09.814 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:09.814 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:09.815 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:13:09.815 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:13:09.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.815 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:09.815 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:13:09.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.816 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:09.816 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:13:09.816 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:13:09.816 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:13:09.816 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:09.817 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:09.817 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:09.817 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:09.817 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:09.817 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.818 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.818 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.818 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 22, 2023-09-13T06:13:09.818 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:13:09.818 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:49.873320+0000", 2023-09-13T06:13:09.818 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:09.819 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:09.819 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:09.819 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:09.819 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:09.819 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:09.819 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:09.820 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:09.820 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:09.820 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:09.820 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:09.820 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:09.821 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:13:09.821 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:13:09.821 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:13:09.821 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:13:09.822 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:13:09.822 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:09.822 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:09.822 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:09.822 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:09.823 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:09.823 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:09.823 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:09.823 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.824 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "186", 2023-09-13T06:13:09.824 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:09.824 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:09.824 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:09.824 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:09.825 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:09.825 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:09.825 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:09.825 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:09.825 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:09.826 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:09.826 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:09.826 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:09.826 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:09.826 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:09.827 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:09.827 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:09.827 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:09.827 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:09.827 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:09.828 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:09.828 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:09.828 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:09.828 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:09.828 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:09.828 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:09.829 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:09.829 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.829 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:09.829 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:09.829 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:09.830 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:09.830 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:09.830 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:09.830 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:09.830 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:09.830 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:09.831 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:09.831 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:09.831 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:09.831 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:13:09.831 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:13:09.832 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:13:09.832 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.832 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:09.832 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:09.832 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:13:09.833 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.833 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.833 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:09.833 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:13:09.833 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:13:09.834 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:09.834 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:09.834 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:09.834 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:09.834 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:09.835 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:09.835 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.835 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.835 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.836 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 23, 2023-09-13T06:13:09.836 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:13:09.836 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:51.142196+0000", 2023-09-13T06:13:09.836 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1027, 2023-09-13T06:13:09.836 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-13T06:13:09.837 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:09.837 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:09.837 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:09.837 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:09.837 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:09.838 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:09.838 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:09.838 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:09.838 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:09.838 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:09.839 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:13:09.839 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:13:09.839 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:13:09.839 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:13:09.840 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:13:09.840 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:09.840 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:09.841 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:09.841 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:09.841 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:09.841 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:09.841 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:09.842 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.842 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "189", 2023-09-13T06:13:09.842 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:09.842 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:09.843 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:09.843 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:09.843 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:09.843 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:09.843 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:09.844 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:09.844 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:09.844 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:13:09.844 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:09.844 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:09.844 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:09.845 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:09.845 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:09.845 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:09.845 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:09.845 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:09.846 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:09.846 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:09.846 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:09.846 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:09.846 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:09.847 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:09.847 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:09.847 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:09.847 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.847 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:09.848 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:09.848 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:09.848 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:09.848 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:09.848 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:09.848 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:09.849 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:09.849 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:09.849 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:09.849 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:09.849 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:09.850 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:13:09.850 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:13:09.850 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.850 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:09.850 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:09.851 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:13:09.851 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.851 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.851 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:09.851 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:13:09.852 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:13:09.852 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:09.852 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:13:09.852 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:13:09.852 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:09.852 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:09.853 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:09.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.853 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.853 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:09.853 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:13:09.854 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.854 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:09.854 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.854 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.854 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.855 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.855 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.855 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.855 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.855 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.856 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.856 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.856 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.856 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.856 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.856 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.857 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.857 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:13:09.857 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:09.857 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.857 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.857 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.858 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:13:09.858 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:09.858 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.858 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.858 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.859 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.859 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.859 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.859 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.859 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:13:09.859 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:09.860 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.860 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.860 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.860 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:13:09.860 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:09.861 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.861 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.861 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.861 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.861 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.861 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.862 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.862 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:13:09.862 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:09.862 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.862 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.862 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.863 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:13:09.863 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:09.863 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.863 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.863 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.864 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.864 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.864 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.864 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.864 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:13:09.864 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:09.865 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.865 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.865 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.865 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:13:09.865 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:09.866 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.866 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.866 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.866 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:13:09.866 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:13:09.867 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:13:09.867 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:13:09.867 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.867 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.867 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.868 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.868 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.868 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.868 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:09.868 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.868 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.869 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.869 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.869 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.869 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.869 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.870 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.870 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.870 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.870 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.870 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.871 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.871 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.871 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.871 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:13:09.871 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:09.872 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.872 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.872 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.872 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:13:09.872 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:09.873 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.873 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.873 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.873 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.873 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.873 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.874 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.874 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:13:09.874 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:09.874 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.874 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.875 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.875 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:13:09.875 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:09.875 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.875 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.876 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.876 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.876 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.876 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.876 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.877 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:13:09.877 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:09.877 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.877 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.877 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.877 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:13:09.878 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:09.878 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.878 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.878 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.878 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.879 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.879 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.879 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.879 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:13:09.879 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:09.879 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.880 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.880 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.880 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:13:09.880 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:09.880 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.881 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.881 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.881 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:13:09.881 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:13:09.881 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:13:09.882 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:13:09.882 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.882 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.882 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.882 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.883 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.883 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.883 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:09.883 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.883 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.883 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.884 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.884 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.884 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.884 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.884 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.885 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.885 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.885 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.885 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.885 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.886 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.886 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.886 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:13:09.886 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:09.886 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.887 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.887 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.887 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:13:09.887 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:09.887 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.888 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.888 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.888 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.888 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.888 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.888 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.889 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:13:09.889 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:09.889 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.889 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.889 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.890 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:13:09.890 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:09.890 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.890 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.891 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.891 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.891 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.891 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.891 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.892 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:13:09.892 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:09.892 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.892 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.892 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.893 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:13:09.893 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:09.893 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.893 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.894 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.894 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.894 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.894 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.894 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.895 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:13:09.895 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:09.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.895 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.896 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.896 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:13:09.896 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:09.896 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.896 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.897 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.897 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:13:09.897 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:13:09.897 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:13:09.897 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:13:09.898 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.898 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.898 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.898 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.899 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.899 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.899 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:09.899 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.900 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.900 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.900 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.900 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.901 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.901 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.901 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.901 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.901 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.902 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.902 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.902 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.902 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.903 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.903 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:13:09.903 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:09.904 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.904 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.904 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.904 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:13:09.904 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:09.905 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.905 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.905 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.905 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.905 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.906 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.906 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.906 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:13:09.906 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:09.906 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.907 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.907 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.907 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:13:09.907 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:09.907 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.907 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.908 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.908 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.908 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.908 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.908 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.908 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:13:09.909 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:09.909 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.909 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.909 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.909 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:13:09.910 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:09.910 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.910 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.910 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.910 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.911 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.911 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.911 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.911 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:13:09.911 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:09.912 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.912 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.912 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.912 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:13:09.912 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:09.912 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.913 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.913 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.913 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:13:09.913 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:13:09.913 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:13:09.913 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:13:09.914 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.914 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.914 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.914 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.914 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.915 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.915 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:09.915 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.915 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.915 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.915 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.916 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.916 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.916 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.916 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.916 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.916 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.917 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.917 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.917 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.917 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.917 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.917 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:13:09.918 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.918 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.918 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.918 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.918 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:13:09.919 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.919 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.919 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.919 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.919 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.919 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.920 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.920 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:13:09.920 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.920 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.920 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.921 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.921 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:13:09.921 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.921 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.921 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.922 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.922 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.922 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.922 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.922 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.923 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:13:09.923 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.923 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.923 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.923 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.923 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:13:09.924 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.924 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.924 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.924 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.924 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.925 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.925 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.925 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.925 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:13:09.925 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.926 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.926 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.926 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.926 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:13:09.926 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:09.927 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.927 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.927 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.927 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:13:09.927 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:13:09.928 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:13:09.928 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:13:09.928 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.928 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.928 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.929 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.929 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.929 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.929 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:09.929 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.929 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.930 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.930 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.930 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.930 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.930 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.931 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.931 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.931 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.931 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.931 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.932 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.932 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.932 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.932 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:13:09.932 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.932 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.933 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.933 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:13:09.933 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.933 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.934 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.934 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.934 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.934 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.934 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.935 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.935 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:13:09.935 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.935 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.936 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.936 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:13:09.936 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.936 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.936 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.936 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.937 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.937 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.937 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.937 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.937 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:13:09.938 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.938 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.938 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.938 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.938 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:13:09.939 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.939 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.939 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.939 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.940 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.940 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.940 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.940 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.941 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:13:09.941 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.941 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.941 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.941 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.941 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:13:09.942 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:09.942 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.942 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.942 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.942 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:13:09.943 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:13:09.943 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:13:09.943 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:13:09.943 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.943 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.944 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.944 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.944 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.944 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.944 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:09.944 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.945 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.945 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.945 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.945 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.945 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.946 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.946 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.946 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.946 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.946 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.947 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.947 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.947 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.947 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.947 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:13:09.948 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.948 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.948 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.948 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.948 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:13:09.949 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.949 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.949 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.949 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.949 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.949 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.950 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.950 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.950 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:13:09.950 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.950 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.951 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.951 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.951 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:13:09.951 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.951 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.951 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.952 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.952 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.952 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.952 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.952 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.953 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:13:09.953 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.953 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.953 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.953 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.953 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:13:09.954 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.954 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.954 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.954 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.954 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.955 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.955 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.955 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.955 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:13:09.955 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.956 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.956 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.956 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.956 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:13:09.956 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:09.956 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.957 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.957 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.957 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:13:09.957 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:13:09.957 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:13:09.958 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:13:09.958 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.958 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.958 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.958 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.959 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.959 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:09.959 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:09.959 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:09.960 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:09.960 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:09.960 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:09.960 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:09.961 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:09.961 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:09.961 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:09.961 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:09.961 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:09.962 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:09.962 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.962 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.962 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.963 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:13:09.963 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.963 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.963 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.963 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.964 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:13:09.964 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.964 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.964 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.965 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.965 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:09.965 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.965 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.965 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.966 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:13:09.966 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.966 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.966 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.967 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.967 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:13:09.967 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.967 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.968 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.968 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.968 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:09.968 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.968 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.968 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.969 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:13:09.969 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.969 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.969 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.970 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:13:09.970 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.970 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.970 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.970 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.971 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:09.971 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:09.971 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.971 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:09.971 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:13:09.971 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.972 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.972 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:09.972 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:13:09.972 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:09.973 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.973 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.973 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:13:09.973 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:13:09.973 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:13:09.974 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:13:09.974 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:09.974 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:09.974 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:09.974 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:09.975 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.975 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:09.975 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:13:09.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.975 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:09.976 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.976 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.976 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.976 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.976 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.976 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:13:09.977 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.977 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.977 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.977 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:09.977 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.978 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.978 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.978 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.978 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.978 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:13:09.979 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.979 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.979 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.979 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:09.979 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.979 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.980 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.980 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.980 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.980 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:13:09.980 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.981 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.981 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:09.981 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.981 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.981 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.982 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.982 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.982 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:13:09.982 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.982 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.983 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.983 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:09.983 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.983 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.983 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.983 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.984 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.984 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:13:09.984 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.984 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.984 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.985 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:09.985 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.985 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.985 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.985 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.985 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.986 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:13:09.986 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.986 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.986 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:09.987 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.987 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.987 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.987 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.987 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.988 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:13:09.988 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.988 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.988 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:09.988 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:09.989 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:09.989 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:09.989 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:09.989 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:09.989 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:09.989 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:13:09.990 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:09.990 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.990 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:09.990 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:13:09.990 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:13:09.991 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:13:09.991 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:13:09.991 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:13:09.991 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:13:09.993 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:13:09.993 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:13:09.993 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:13:09.993 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:13:09.993 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:13:09.994 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:13:09.994 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:13:09.994 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:13:09.994 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.994 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:09.995 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:13:09.995 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:13:09.995 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:13:09.995 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:13:09.995 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:13:09.995 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:13:09.996 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:13:09.996 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:13:09.996 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:13:09.996 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:13:09.996 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:13:09.996 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:09.997 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:09.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/1272272466 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e8c065b20 msgr2=0x7f2e8c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:09.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e8c065b20 0x7f2e8c067fe0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8166670 tx=0x7f2ea4009040 comp rx=0 tx=0).stop 2023-09-13T06:13:09.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/1272272466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ea8146f30 msgr2=0x7f2ea81678e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:09.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ea8146f30 0x7f2ea81678e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00af040 tx=0x7f2ea0019780 comp rx=0 tx=0).stop 2023-09-13T06:13:09.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/1272272466 shutdown_connections 2023-09-13T06:13:09.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2e8c065b20 0x7f2e8c067fe0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ea80d1750 0x7f2ea815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ea8146f30 0x7f2ea81678e0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 --2- 172.21.15.130:0/1272272466 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ea80d1090 0x7f2ea813ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/1272272466 >> 172.21.15.130:0/1272272466 conn(0x7f2ea806f170 msgr2=0x7f2ea80cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:10.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/1272272466 shutdown_connections 2023-09-13T06:13:10.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:09.796+0000 7f2eaf4d8640 1 -- 172.21.15.130:0/1272272466 wait complete. 2023-09-13T06:13:10.001 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:13:10.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c7120640 1 Processor -- start 2023-09-13T06:13:10.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c7120640 1 -- start start 2023-09-13T06:13:10.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c7120640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c00d1f50 0x7fd4c0070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c7120640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd4c00706c0 0x7fd4c015d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c7120640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c00d1ac0 con 0x7fd4c0146b30 2023-09-13T06:13:10.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c7120640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c0070b70 con 0x7fd4c00706c0 2023-09-13T06:13:10.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c7120640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c00d0be0 con 0x7fd4c00d1f50 2023-09-13T06:13:10.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c611e640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd4c0146b30 0x7fd4c00d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:58618/0 (socket says 172.21.15.130:58618) 2023-09-13T06:13:10.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c611e640 1 -- 172.21.15.130:0/958676641 learned_addr learned my addr 172.21.15.130:0/958676641 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:10.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c691f640 1 --2- 172.21.15.130:0/958676641 >> v2:172.21.15.130:3300/0 conn(0x7fd4c00706c0 0x7fd4c015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:10.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c591d640 1 --2- 172.21.15.130:0/958676641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c00d1f50 0x7fd4c0070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:10.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c511c640 1 -- 172.21.15.130:0/958676641 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690280732 0 0) 0x7fd4c00d1ac0 con 0x7fd4c0146b30 2023-09-13T06:13:10.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c511c640 1 -- 172.21.15.130:0/958676641 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4ac003530 con 0x7fd4c0146b30 2023-09-13T06:13:10.143 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c691f640 1 -- 172.21.15.130:0/958676641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c00d1f50 msgr2=0x7fd4c0070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:10.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c691f640 1 --2- 172.21.15.130:0/958676641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c00d1f50 0x7fd4c0070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c691f640 1 -- 172.21.15.130:0/958676641 >> v1:172.21.15.130:6789/0 conn(0x7fd4c0146b30 legacy=0x7fd4c00d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:10.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.140+0000 7fd4c691f640 1 -- 172.21.15.130:0/958676641 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c00d0eb0 con 0x7fd4c00706c0 2023-09-13T06:13:10.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c691f640 1 --2- 172.21.15.130:0/958676641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4c00706c0 0x7fd4c015d760 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009d90 tx=0x7fd4b801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8445d8d1fa4eb8c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:10.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c511c640 1 -- 172.21.15.130:0/958676641 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b80a59e0 con 0x7fd4c00706c0 2023-09-13T06:13:10.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c511c640 1 -- 172.21.15.130:0/958676641 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b80a5b40 con 0x7fd4c00706c0 2023-09-13T06:13:10.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c511c640 1 -- 172.21.15.130:0/958676641 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b80ad440 con 0x7fd4c00706c0 2023-09-13T06:13:10.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c7120640 1 -- 172.21.15.130:0/958676641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4c00706c0 msgr2=0x7fd4c015d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:10.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c7120640 1 --2- 172.21.15.130:0/958676641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4c00706c0 0x7fd4c015d760 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009d90 tx=0x7fd4b801c920 comp rx=0 tx=0).stop 2023-09-13T06:13:10.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c7120640 1 -- 172.21.15.130:0/958676641 shutdown_connections 2023-09-13T06:13:10.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c7120640 1 --2- 172.21.15.130:0/958676641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4c00706c0 0x7fd4c015d760 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c7120640 1 --2- 172.21.15.130:0/958676641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c00d1f50 0x7fd4c0070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c7120640 1 -- 172.21.15.130:0/958676641 >> 172.21.15.130:0/958676641 conn(0x7fd4c00d3090 msgr2=0x7fd4c00d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:10.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c7120640 1 -- 172.21.15.130:0/958676641 shutdown_connections 2023-09-13T06:13:10.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.144+0000 7fd4c7120640 1 -- 172.21.15.130:0/958676641 wait complete. 2023-09-13T06:13:10.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c7120640 1 Processor -- start 2023-09-13T06:13:10.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c7120640 1 -- start start 2023-09-13T06:13:10.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c7120640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4c00706c0 0x7fd4c0134340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c7120640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c00d1f50 0x7fd4c0139900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c7120640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c0146b30 0x7fd4c015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c7120640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c01394e0 con 0x7fd4c00706c0 2023-09-13T06:13:10.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c7120640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0138860 con 0x7fd4c00d1f50 2023-09-13T06:13:10.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c7120640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0138b40 con 0x7fd4c0146b30 2023-09-13T06:13:10.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c611e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4c00706c0 0x7fd4c0134340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:10.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c611e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4c00706c0 0x7fd4c0134340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39026/0 (socket says 172.21.15.130:39026) 2023-09-13T06:13:10.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c611e640 1 -- 172.21.15.130:0/3586351969 learned_addr learned my addr 172.21.15.130:0/3586351969 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:10.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c611e640 1 -- 172.21.15.130:0/3586351969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c0146b30 msgr2=0x7fd4c015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:10.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c611e640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c0146b30 0x7fd4c015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c611e640 1 -- 172.21.15.130:0/3586351969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c00d1f50 msgr2=0x7fd4c0139900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:10.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c591d640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c00d1f50 0x7fd4c0139900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:10.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c611e640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c00d1f50 0x7fd4c0139900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c611e640 1 -- 172.21.15.130:0/3586351969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b8009a70 con 0x7fd4c00706c0 2023-09-13T06:13:10.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c591d640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c00d1f50 0x7fd4c0139900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:10.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c611e640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4c00706c0 0x7fd4c0134340 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00c3c0 tx=0x7fd4bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:10.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4b6ffd640 1 -- 172.21.15.130:0/3586351969 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc005cf0 con 0x7fd4c00706c0 2023-09-13T06:13:10.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4b6ffd640 1 -- 172.21.15.130:0/3586351969 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc005e50 con 0x7fd4c00706c0 2023-09-13T06:13:10.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c7120640 1 -- 172.21.15.130:0/3586351969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c0138e20 con 0x7fd4c00706c0 2023-09-13T06:13:10.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4b6ffd640 1 -- 172.21.15.130:0/3586351969 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0072f0 con 0x7fd4c00706c0 2023-09-13T06:13:10.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c7120640 1 -- 172.21.15.130:0/3586351969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c01384f0 con 0x7fd4c00706c0 2023-09-13T06:13:10.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.148+0000 7fd4c7120640 1 -- 172.21.15.130:0/3586351969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c0139620 con 0x7fd4c00706c0 2023-09-13T06:13:10.156 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.152+0000 7fd4b6ffd640 1 -- 172.21.15.130:0/3586351969 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd4bc007450 con 0x7fd4c00706c0 2023-09-13T06:13:10.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.152+0000 7fd4b6ffd640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd4a4065b20 0x7fd4a4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.152+0000 7fd4b6ffd640 1 -- 172.21.15.130:0/3586351969 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4bc0828f0 con 0x7fd4c00706c0 2023-09-13T06:13:10.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.152+0000 7fd4c591d640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd4a4065b20 0x7fd4a4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:10.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.152+0000 7fd4b6ffd640 1 -- 172.21.15.130:0/3586351969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=190}) v3 -- 0x7fd4a406d650 con 0x7fd4c00706c0 2023-09-13T06:13:10.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.152+0000 7fd4c591d640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd4a4065b20 0x7fd4a4067fe0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0136790 tx=0x7fd4b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:10.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.156+0000 7fd4b6ffd640 1 -- 172.21.15.130:0/3586351969 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd4bc017070 con 0x7fd4c00706c0 2023-09-13T06:13:10.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.332+0000 7fd4c7120640 1 -- 172.21.15.130:0/3586351969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4c00618a0 con 0x7fd4c00706c0 2023-09-13T06:13:10.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.332+0000 7fd4b6ffd640 1 -- 172.21.15.130:0/3586351969 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fd4c0139620 con 0x7fd4c00706c0 2023-09-13T06:13:10.335 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:10.335 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/519371055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":519371055},{"type":"v1","addr":"172.21.15.130:6837","nonce":519371055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2464101241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2464101241},{"type":"v1","addr":"172.21.15.130:6836","nonce":2464101241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3066690343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3066690343},{"type":"v1","addr":"172.21.15.164:6833","nonce":3066690343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:12:52.135181+0000","modified":"2023-09-13T06:12:55.174886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8272":{"gid":8272,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2477052868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2477052868},{"type":"v1","addr":"172.21.15.164:6835","nonce":2477052868}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-09-13T06:13:10.335 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 92 2023-09-13T06:13:10.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 -- 172.21.15.130:0/3586351969 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd4a4065b20 msgr2=0x7fd4a4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:10.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd4a4065b20 0x7fd4a4067fe0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0136790 tx=0x7fd4b0008040 comp rx=0 tx=0).stop 2023-09-13T06:13:10.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 -- 172.21.15.130:0/3586351969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4c00706c0 msgr2=0x7fd4c0134340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:10.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4c00706c0 0x7fd4c0134340 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00c3c0 tx=0x7fd4bc00c880 comp rx=0 tx=0).stop 2023-09-13T06:13:10.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 -- 172.21.15.130:0/3586351969 shutdown_connections 2023-09-13T06:13:10.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd4a4065b20 0x7fd4a4067fe0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c00d1f50 0x7fd4c0139900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c0146b30 0x7fd4c015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 --2- 172.21.15.130:0/3586351969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4c00706c0 0x7fd4c0134340 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 -- 172.21.15.130:0/3586351969 >> 172.21.15.130:0/3586351969 conn(0x7fd4c00d3090 msgr2=0x7fd4c00b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:10.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 -- 172.21.15.130:0/3586351969 shutdown_connections 2023-09-13T06:13:10.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.336+0000 7fd4c7120640 1 -- 172.21.15.130:0/3586351969 wait complete. 2023-09-13T06:13:10.355 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-09-13T06:13:10.523 INFO:teuthology.orchestra.run.smithi164.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":8272,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":17.748375432,"mdsmap_epoch":92,"osdmap_epoch":189,"osdmap_epoch_barrier":189,"uptime":23.660382282} 2023-09-13T06:13:10.524 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 8272, "mdsmap_epoch": 92, "osdmap_epoch": 189, "osdmap_epoch_barrier": 189, "rank_uptime": 17.748375432, "state": "up:active", "uptime": 23.660382282, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:13:10.524 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-13T06:13:10.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:10.525 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-09-13T06:13:10.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:10.537 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-09-13T06:13:10.605 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:13:10.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.784+0000 7fa21a1fa640 1 Processor -- start 2023-09-13T06:13:10.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.784+0000 7fa21a1fa640 1 -- start start 2023-09-13T06:13:10.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.784+0000 7fa21a1fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2140cc780 0x7fa21415b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.784+0000 7fa21a1fa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa2140b04a0 0x7fa2140b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.784+0000 7fa21a1fa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2140ccbe0 con 0x7fa21415b130 2023-09-13T06:13:10.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.784+0000 7fa21a1fa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2140b0e70 con 0x7fa2140b04a0 2023-09-13T06:13:10.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.784+0000 7fa21a1fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2140ce980 con 0x7fa2140cc780 2023-09-13T06:13:10.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa213fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa2140b04a0 0x7fa2140b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:10.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa2137fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa21415b130 0x7fa2140ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:58634/0 (socket says 172.21.15.130:58634) 2023-09-13T06:13:10.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa2137fe640 1 -- 172.21.15.130:0/3998859514 learned_addr learned my addr 172.21.15.130:0/3998859514 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:10.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa212ffd640 1 --2- 172.21.15.130:0/3998859514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2140cc780 0x7fa21415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:10.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa213fff640 1 -- 172.21.15.130:0/3998859514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2140cc780 msgr2=0x7fa21415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:10.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa213fff640 1 --2- 172.21.15.130:0/3998859514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2140cc780 0x7fa21415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa213fff640 1 -- 172.21.15.130:0/3998859514 >> v1:172.21.15.130:6789/0 conn(0x7fa21415b130 legacy=0x7fa2140ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:10.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa213fff640 1 -- 172.21.15.130:0/3998859514 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2140cec60 con 0x7fa2140b04a0 2023-09-13T06:13:10.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa2127fc640 1 -- 172.21.15.130:0/3998859514 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614387886 0 0) 0x7fa2140ccbe0 con 0x7fa21415b130 2023-09-13T06:13:10.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa213fff640 1 --2- 172.21.15.130:0/3998859514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2140b04a0 0x7fa2140b0930 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009d90 tx=0x7fa20c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f5c6d8c9cf4b83 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:10.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa2127fc640 1 -- 172.21.15.130:0/3998859514 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0a59e0 con 0x7fa2140b04a0 2023-09-13T06:13:10.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa2127fc640 1 -- 172.21.15.130:0/3998859514 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c0a5b40 con 0x7fa2140b04a0 2023-09-13T06:13:10.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.788+0000 7fa2127fc640 1 -- 172.21.15.130:0/3998859514 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0ad440 con 0x7fa2140b04a0 2023-09-13T06:13:10.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3998859514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2140b04a0 msgr2=0x7fa2140b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:10.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 --2- 172.21.15.130:0/3998859514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2140b04a0 0x7fa2140b0930 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009d90 tx=0x7fa20c01c920 comp rx=0 tx=0).stop 2023-09-13T06:13:10.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3998859514 shutdown_connections 2023-09-13T06:13:10.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 --2- 172.21.15.130:0/3998859514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2140b04a0 0x7fa2140b0930 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.792 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 --2- 172.21.15.130:0/3998859514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2140cc780 0x7fa21415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3998859514 >> 172.21.15.130:0/3998859514 conn(0x7fa214065990 msgr2=0x7fa214065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:10.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3998859514 shutdown_connections 2023-09-13T06:13:10.793 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3998859514 wait complete. 2023-09-13T06:13:10.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 Processor -- start 2023-09-13T06:13:10.795 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 -- start start 2023-09-13T06:13:10.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2140b04a0 0x7fa214153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2140cc780 0x7fa2141487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa21415b130 0x7fa214152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa214148ce0 con 0x7fa21415b130 2023-09-13T06:13:10.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2140b0340 con 0x7fa2140b04a0 2023-09-13T06:13:10.796 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa21a1fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa214070d60 con 0x7fa2140cc780 2023-09-13T06:13:10.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa213fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa21415b130 0x7fa214152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:10.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa213fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa21415b130 0x7fa214152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:39044/0 (socket says 172.21.15.130:39044) 2023-09-13T06:13:10.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa213fff640 1 -- 172.21.15.130:0/3326181226 learned_addr learned my addr 172.21.15.130:0/3326181226 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:10.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa212ffd640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2140cc780 0x7fa2141487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:10.797 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.792+0000 7fa2137fe640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2140b04a0 0x7fa214153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:10.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa213fff640 1 -- 172.21.15.130:0/3326181226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2140cc780 msgr2=0x7fa2141487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:10.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa213fff640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2140cc780 0x7fa2141487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa213fff640 1 -- 172.21.15.130:0/3326181226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2140b04a0 msgr2=0x7fa214153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:10.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa213fff640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2140b04a0 0x7fa214153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:10.798 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa213fff640 1 -- 172.21.15.130:0/3326181226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c009a70 con 0x7fa21415b130 2023-09-13T06:13:10.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa212ffd640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2140cc780 0x7fa2141487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:13:10.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa213fff640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa21415b130 0x7fa214152d60 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009d90 tx=0x7fa20c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:10.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa1fbfff640 1 -- 172.21.15.130:0/3326181226 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0aed50 con 0x7fa21415b130 2023-09-13T06:13:10.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa1fbfff640 1 -- 172.21.15.130:0/3326181226 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c009450 con 0x7fa21415b130 2023-09-13T06:13:10.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa1fbfff640 1 -- 172.21.15.130:0/3326181226 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c003ba0 con 0x7fa21415b130 2023-09-13T06:13:10.799 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3326181226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa214070430 con 0x7fa21415b130 2023-09-13T06:13:10.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3326181226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2140709f0 con 0x7fa21415b130 2023-09-13T06:13:10.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3326181226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa214070f10 con 0x7fa21415b130 2023-09-13T06:13:10.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa1fbfff640 1 -- 172.21.15.130:0/3326181226 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa20c0b4050 con 0x7fa21415b130 2023-09-13T06:13:10.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa1fbfff640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa200065b20 0x7fa200067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:10.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa1fbfff640 1 -- 172.21.15.130:0/3326181226 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa20c11e7d0 con 0x7fa21415b130 2023-09-13T06:13:10.801 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.796+0000 7fa2137fe640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa200065b20 0x7fa200067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:10.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.800+0000 7fa1fbfff640 1 -- 172.21.15.130:0/3326181226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=190}) v3 -- 0x7fa20006d650 con 0x7fa21415b130 2023-09-13T06:13:10.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.800+0000 7fa2137fe640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa200065b20 0x7fa200067fe0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa204000f70 tx=0x7fa204007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:10.802 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.800+0000 7fa1fbfff640 1 -- 172.21.15.130:0/3326181226 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa20c0b2020 con 0x7fa21415b130 2023-09-13T06:13:10.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.952+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3326181226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa2140618a0 con 0x7fa21415b130 2023-09-13T06:13:10.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.952+0000 7fa1fbfff640 1 -- 172.21.15.130:0/3326181226 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) v1 ==== 81+0+34069 (secure 0 0 0) 0x7fa214070f10 con 0x7fa21415b130 2023-09-13T06:13:10.953 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:10.954 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:10.954 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 189, 2023-09-13T06:13:10.954 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:13:10.954 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:13:10.955 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:13:07.484452+0000", 2023-09-13T06:13:10.955 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:13:10.955 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:13:10.955 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:13:10.955 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:13:10.955 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:13:10.956 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:13:10.956 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:13:10.956 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:13:10.956 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:13:10.956 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:10.957 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:13:10.957 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:13:10.957 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:13:10.957 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:13:10.957 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:13:10.958 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 23, 2023-09-13T06:13:10.958 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:13:10.958 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:13:10.958 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:13:10.958 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:13:10.958 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:13:10.959 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:13:10.959 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:10.959 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:13:10.959 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:13:10.959 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:13:10.960 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:10.960 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:10.960 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:10.960 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:10.960 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:10.961 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:10.961 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:10.961 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:10.961 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:10.961 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:10.961 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:10.962 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:10.962 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:13:10.962 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:13:10.962 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:13:10.962 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:13:10.963 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:13:10.963 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:10.963 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:10.963 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:10.963 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:10.964 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:10.964 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:10.964 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:10.964 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:10.964 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:13:10.964 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:10.965 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:10.965 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:10.965 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:10.965 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:10.965 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:10.966 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:10.966 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:10.966 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:10.966 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:10.966 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:10.967 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:10.967 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:10.967 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:10.967 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:10.967 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:10.967 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:10.968 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:10.968 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:10.968 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:10.968 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:10.968 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:10.969 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:10.969 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:10.969 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:10.969 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:10.969 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:10.969 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:10.970 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:10.970 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:10.970 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:10.970 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:10.970 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:10.971 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:10.971 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:10.971 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:10.971 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:10.971 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:10.972 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:10.972 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:13:10.972 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:13:10.972 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:10.972 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:10.972 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:13:10.973 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:10.973 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:10.973 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:13:10.973 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:13:10.973 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:13:10.974 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:10.974 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:10.974 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:10.974 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:10.974 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:10.975 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:10.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:10.975 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:10.975 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 22, 2023-09-13T06:13:10.975 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:13:10.976 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:49.873320+0000", 2023-09-13T06:13:10.976 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:10.976 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:10.976 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:10.976 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:10.976 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:10.977 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:10.977 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:10.977 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:10.977 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:10.977 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:10.978 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:10.978 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:10.978 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:13:10.978 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:13:10.978 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:13:10.979 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:13:10.979 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:13:10.979 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:10.979 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:10.979 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:10.979 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:10.980 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:10.980 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:10.980 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:10.980 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:10.980 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "186", 2023-09-13T06:13:10.981 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:10.981 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:10.981 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:10.981 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:10.981 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:10.982 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:10.982 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:10.982 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:10.982 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:10.982 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:10.982 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:10.983 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:10.983 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:10.983 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:10.983 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:10.983 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:10.984 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:10.984 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:10.984 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:10.984 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:10.985 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:10.985 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:10.985 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:10.985 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:10.985 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:10.986 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:10.986 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:10.986 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:10.986 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:10.986 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:10.987 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:10.987 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:10.987 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:10.987 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:10.987 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:10.987 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:10.988 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:10.988 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:10.988 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:10.988 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:13:10.988 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:13:10.989 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:13:10.989 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:10.989 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:10.989 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:10.989 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:13:10.990 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:10.990 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:10.990 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:10.990 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:13:10.990 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:13:10.991 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:10.991 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:10.991 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:10.991 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:10.991 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:10.991 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:10.992 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:10.992 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:10.992 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:10.992 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 23, 2023-09-13T06:13:10.992 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:13:10.993 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:51.142196+0000", 2023-09-13T06:13:10.993 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1027, 2023-09-13T06:13:10.993 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-13T06:13:10.993 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:10.993 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:10.993 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:10.994 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:10.994 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:10.994 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:10.994 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:10.994 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:10.995 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:10.995 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:10.995 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:13:10.995 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:13:10.995 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:13:10.995 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:13:10.996 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:13:10.996 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:10.996 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:10.996 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:10.996 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:10.997 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:10.997 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:10.997 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:10.997 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:10.997 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "189", 2023-09-13T06:13:10.997 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:10.998 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:10.998 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:10.998 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:10.998 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:10.998 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:10.999 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:10.999 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:10.999 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:10.999 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:13:10.999 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:10.999 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:11.000 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:11.000 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:11.000 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:11.000 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:11.000 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:11.001 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:11.001 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:11.001 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:11.001 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:11.001 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:11.001 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:11.002 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:11.002 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:11.002 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:11.002 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.002 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:11.003 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:11.003 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:11.003 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:11.003 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:11.003 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:11.004 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:11.004 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:11.004 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:11.004 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:11.004 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:11.005 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:11.005 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:13:11.005 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:13:11.005 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.005 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:11.006 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:11.006 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:13:11.006 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.006 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.006 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:11.007 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:13:11.007 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:13:11.007 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:11.007 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:13:11.007 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:13:11.008 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:11.008 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:11.008 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:11.008 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.008 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.009 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:11.009 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:13:11.009 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.009 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:11.009 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:11.009 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:11.010 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:11.010 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:11.010 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:11.010 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:11.010 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:11.011 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:11.011 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:11.011 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:11.011 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:11.011 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:11.012 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.012 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.012 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.012 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:13:11.012 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:11.012 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.013 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.013 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.013 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:13:11.013 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:11.013 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.013 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.014 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.014 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:11.014 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.014 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.015 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:13:11.015 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:11.017 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.017 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.017 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.017 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:13:11.017 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:11.018 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.018 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.018 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.018 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:11.018 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.019 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.019 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.019 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:13:11.019 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:11.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.020 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.020 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.020 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:13:11.020 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:11.020 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.020 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.021 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.021 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:11.021 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.021 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.021 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.022 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:13:11.022 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:11.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.022 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.023 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.023 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:13:11.023 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:11.023 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.023 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.023 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.024 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:13:11.024 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:13:11.024 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:13:11.024 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:13:11.024 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:11.025 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:11.025 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:11.025 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.025 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.025 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.026 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:11.026 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:11.026 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:11.026 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:11.026 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:11.026 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:11.027 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:11.027 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:11.027 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:11.027 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:11.027 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:11.028 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:11.028 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:11.028 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.028 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.028 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.029 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:13:11.029 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:11.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.029 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.029 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.029 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:13:11.030 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:11.030 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.030 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.030 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:11.031 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.031 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.031 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.031 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:13:11.031 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:11.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.032 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.032 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:13:11.032 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:11.032 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.033 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.033 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.033 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:11.033 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.033 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.034 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.034 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:13:11.034 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:11.034 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.034 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.034 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.035 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:13:11.035 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:11.035 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.035 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.036 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:11.036 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.036 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.036 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.036 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:13:11.036 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:11.037 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.037 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.037 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.037 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:13:11.037 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:11.038 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.038 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.038 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.038 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:13:11.038 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:13:11.039 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:13:11.039 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:13:11.039 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:11.039 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:11.039 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:11.040 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.040 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.040 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.040 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:11.041 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:11.041 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:11.041 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:11.041 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:11.041 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:11.042 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:11.042 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:11.042 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:11.042 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:11.042 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:11.043 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:11.043 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:11.043 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.043 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.043 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.044 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:13:11.044 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:11.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.044 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.044 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.045 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:13:11.045 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:11.045 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.045 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.045 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.046 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:11.046 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.046 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.046 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.046 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:13:11.047 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:11.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.047 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.047 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:13:11.048 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:11.048 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.048 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.048 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.048 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:11.048 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.049 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.049 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:13:11.049 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:11.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.050 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.050 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:13:11.050 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:11.050 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.051 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.051 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.051 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:11.051 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.051 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.052 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.052 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:13:11.052 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:11.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.053 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.053 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:13:11.053 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:11.053 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.053 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.054 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:13:11.054 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:13:11.054 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:13:11.054 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:13:11.054 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:11.055 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:11.055 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:11.055 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.055 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:11.056 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:11.056 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:11.056 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:11.056 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:11.056 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:11.056 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:11.057 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:11.057 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:11.057 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:11.057 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:11.057 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:11.058 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:11.058 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.058 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.058 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:13:11.059 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:11.059 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.059 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.059 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:13:11.059 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:11.060 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.060 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.060 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:11.060 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.061 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.061 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.061 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:13:11.061 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:11.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.062 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.062 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:13:11.062 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:11.062 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.063 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.063 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:11.063 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.063 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.063 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.064 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:13:11.064 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:11.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.064 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.065 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:13:11.065 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:11.065 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.065 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.065 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:11.066 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.066 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.066 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:13:11.066 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:11.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.067 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.067 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:13:11.067 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:11.068 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.068 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.068 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:13:11.068 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:13:11.069 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:13:11.069 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:13:11.069 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:11.069 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:11.069 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:11.069 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.070 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:11.070 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:11.070 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:11.071 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:11.071 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:11.071 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:11.071 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:11.071 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:11.072 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:11.072 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:11.072 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:11.072 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:11.072 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:11.073 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.073 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.073 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:13:11.073 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:11.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.074 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.074 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:13:11.074 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:11.074 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.075 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.075 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:11.075 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.076 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.076 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:13:11.076 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:11.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.076 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.077 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:13:11.077 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:11.077 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.077 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.078 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:11.078 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.078 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.078 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.078 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:13:11.079 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:11.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.079 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.079 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:13:11.080 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:11.080 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.080 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.080 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:11.080 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.081 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.081 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:13:11.081 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:11.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.082 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.082 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.082 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:13:11.082 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:11.082 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.083 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.083 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:13:11.083 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:13:11.083 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:13:11.084 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:13:11.084 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:11.084 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:11.084 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:11.084 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.085 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:11.085 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:11.085 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:11.085 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:11.086 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:11.086 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:11.086 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:11.086 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:11.086 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:11.087 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:11.087 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:11.087 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:11.087 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:11.087 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.088 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.088 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:13:11.088 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:11.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.088 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.089 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:13:11.089 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:11.089 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.089 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.089 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:11.090 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.090 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.090 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:13:11.090 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:11.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.091 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.091 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:13:11.091 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:11.092 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.092 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.092 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:11.092 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.093 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.093 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.093 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:13:11.093 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:11.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.094 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.094 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:13:11.094 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:11.094 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.095 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.095 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:11.095 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.096 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.096 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:13:11.096 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:11.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.096 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.097 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:13:11.097 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:11.097 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.097 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.098 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:13:11.098 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:13:11.098 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:13:11.098 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:13:11.098 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:11.099 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:11.099 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:11.099 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.100 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:11.100 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:11.100 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:11.100 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:11.100 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:11.101 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:11.101 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:11.101 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:11.101 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:11.101 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:11.102 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:11.102 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:11.102 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:11.102 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.103 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.103 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:13:11.103 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:11.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.104 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.104 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:13:11.104 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:11.104 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.104 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.105 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:11.105 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.105 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.105 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:13:11.106 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:11.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.106 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.106 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:13:11.107 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:11.107 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.107 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.107 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:11.108 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.108 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.108 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:13:11.108 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:11.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.109 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.109 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:13:11.109 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:11.109 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.110 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.110 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.110 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:11.110 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.110 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.111 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.111 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:13:11.111 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:11.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.112 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.112 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:13:11.112 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:11.112 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.112 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.113 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:13:11.113 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:13:11.113 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:13:11.113 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:13:11.114 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:11.114 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:11.114 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:11.114 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.115 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:11.115 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:11.115 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:11.115 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:11.116 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:11.116 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:11.116 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:11.116 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:11.116 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:11.116 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:11.117 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:11.117 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:11.117 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:11.117 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.118 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.118 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:13:11.118 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:11.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.119 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.119 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:13:11.119 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:11.119 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.119 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.120 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:11.120 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.120 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.120 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:13:11.121 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:11.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.121 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.121 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.121 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:13:11.122 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:11.122 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.122 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.122 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:11.123 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.123 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.123 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:13:11.123 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:11.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.124 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.124 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:13:11.124 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:11.125 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.125 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.125 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:11.125 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:11.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.126 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:11.126 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:13:11.126 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:11.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.127 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:11.127 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:13:11.127 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:11.127 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.127 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.128 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:13:11.128 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:13:11.128 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:13:11.128 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:13:11.129 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:11.129 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:11.129 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:11.129 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:11.129 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.130 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:11.130 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:13:11.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.130 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:11.130 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:11.130 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:11.131 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:11.131 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:11.131 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:11.131 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:13:11.131 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:11.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.132 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:11.132 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:11.132 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:11.133 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:11.133 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:11.133 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:11.133 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:13:11.133 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:11.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.134 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:11.134 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:11.134 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:11.134 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:11.135 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:11.135 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:11.135 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:13:11.135 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:11.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:11.136 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:11.136 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:11.136 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:11.136 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:11.137 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:11.137 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:13:11.137 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:11.137 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.137 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.138 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:11.138 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:11.138 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:11.138 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:11.138 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:11.138 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:11.139 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:13:11.139 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:11.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.139 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:11.140 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:11.140 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:11.140 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:11.140 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:11.140 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:11.141 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:13:11.141 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:11.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.141 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.141 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:11.141 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:11.142 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:11.142 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:11.142 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:11.142 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:11.142 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:13:11.143 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:11.143 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.143 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:11.143 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:11.143 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:11.143 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:11.144 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:11.144 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:11.144 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:11.144 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:13:11.144 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:11.145 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.145 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:11.145 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:13:11.145 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:13:11.145 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:13:11.145 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:13:11.146 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:13:11.146 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:13:11.146 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:13:11.146 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:13:11.146 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:13:11.147 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:13:11.147 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:13:11.147 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:13:11.147 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:13:11.147 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:13:11.147 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:11.148 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:13:11.148 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:13:11.148 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:13:11.148 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:13:11.149 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:13:11.149 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:13:11.149 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:13:11.149 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:13:11.149 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:13:11.149 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:13:11.150 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:13:11.150 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:11.150 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:11.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3326181226 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa200065b20 msgr2=0x7fa200067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:11.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa200065b20 0x7fa200067fe0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa204000f70 tx=0x7fa204007df0 comp rx=0 tx=0).stop 2023-09-13T06:13:11.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3326181226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa21415b130 msgr2=0x7fa214152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:11.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa21415b130 0x7fa214152d60 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009d90 tx=0x7fa20c0196c0 comp rx=0 tx=0).stop 2023-09-13T06:13:11.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3326181226 shutdown_connections 2023-09-13T06:13:11.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa200065b20 0x7fa200067fe0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:11.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa21415b130 0x7fa214152d60 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:11.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2140cc780 0x7fa2141487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:11.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 --2- 172.21.15.130:0/3326181226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2140b04a0 0x7fa214153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:11.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3326181226 >> 172.21.15.130:0/3326181226 conn(0x7fa214065990 msgr2=0x7fa214155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:11.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3326181226 shutdown_connections 2023-09-13T06:13:11.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:10.956+0000 7fa21a1fa640 1 -- 172.21.15.130:0/3326181226 wait complete. 2023-09-13T06:13:11.155 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:13:16.156 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:13:16.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa1e5c6640 1 Processor -- start 2023-09-13T06:13:16.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa1e5c6640 1 -- start start 2023-09-13T06:13:16.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa1e5c6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faa18147f30 0x7faa18148410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:16.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa1e5c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa18148950 0x7faa1806bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:16.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa1e5c6640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1806b5e0 con 0x7faa18147b50 2023-09-13T06:13:16.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa1e5c6640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1806b8c0 con 0x7faa18147f30 2023-09-13T06:13:16.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa1e5c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa18165ac0 con 0x7faa18148950 2023-09-13T06:13:16.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa177fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faa18147f30 0x7faa18148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:16.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa17fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7faa18147b50 0x7faa181652b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33360/0 (socket says 172.21.15.130:33360) 2023-09-13T06:13:16.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa17fff640 1 -- 172.21.15.130:0/2137874003 learned_addr learned my addr 172.21.15.130:0/2137874003 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:16.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa1cb63640 1 --2- 172.21.15.130:0/2137874003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa18148950 0x7faa1806bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:16.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa177fe640 1 -- 172.21.15.130:0/2137874003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa18148950 msgr2=0x7faa1806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:16.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa177fe640 1 --2- 172.21.15.130:0/2137874003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa18148950 0x7faa1806bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:16.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa177fe640 1 -- 172.21.15.130:0/2137874003 >> v1:172.21.15.130:6789/0 conn(0x7faa18147b50 legacy=0x7faa181652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:16.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa177fe640 1 -- 172.21.15.130:0/2137874003 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa18165da0 con 0x7faa18147f30 2023-09-13T06:13:16.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.304+0000 7faa16ffd640 1 -- 172.21.15.130:0/2137874003 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360668708 0 0) 0x7faa1806b5e0 con 0x7faa18147b50 2023-09-13T06:13:16.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa177fe640 1 --2- 172.21.15.130:0/2137874003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa18147f30 0x7faa18148410 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0097c0 tx=0x7faa0c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccf911cab433f98 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:16.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa16ffd640 1 -- 172.21.15.130:0/2137874003 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0ab670 con 0x7faa18147f30 2023-09-13T06:13:16.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa16ffd640 1 -- 172.21.15.130:0/2137874003 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c0ab7d0 con 0x7faa18147f30 2023-09-13T06:13:16.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa16ffd640 1 -- 172.21.15.130:0/2137874003 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0abb60 con 0x7faa18147f30 2023-09-13T06:13:16.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa1e5c6640 1 -- 172.21.15.130:0/2137874003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa18147f30 msgr2=0x7faa18148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:16.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa1e5c6640 1 --2- 172.21.15.130:0/2137874003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa18147f30 0x7faa18148410 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0097c0 tx=0x7faa0c01c450 comp rx=0 tx=0).stop 2023-09-13T06:13:16.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa1e5c6640 1 -- 172.21.15.130:0/2137874003 shutdown_connections 2023-09-13T06:13:16.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa1e5c6640 1 --2- 172.21.15.130:0/2137874003 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa18148950 0x7faa1806bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:16.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa1e5c6640 1 --2- 172.21.15.130:0/2137874003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa18147f30 0x7faa18148410 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:16.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa1e5c6640 1 -- 172.21.15.130:0/2137874003 >> 172.21.15.130:0/2137874003 conn(0x7faa18065990 msgr2=0x7faa18065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:16.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa1e5c6640 1 -- 172.21.15.130:0/2137874003 shutdown_connections 2023-09-13T06:13:16.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.308+0000 7faa1e5c6640 1 -- 172.21.15.130:0/2137874003 wait complete. 2023-09-13T06:13:16.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1e5c6640 1 Processor -- start 2023-09-13T06:13:16.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1e5c6640 1 -- start start 2023-09-13T06:13:16.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1e5c6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa18147b50 0x7faa181fab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:16.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1e5c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa18147f30 0x7faa18160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:16.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1e5c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa18148950 0x7faa180cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:16.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1e5c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa180cdbf0 con 0x7faa18148950 2023-09-13T06:13:16.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1e5c6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa181613a0 con 0x7faa18147b50 2023-09-13T06:13:16.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1e5c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa180ccfb0 con 0x7faa18147f30 2023-09-13T06:13:16.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1cb63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa18148950 0x7faa180cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:16.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1cb63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa18148950 0x7faa180cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40388/0 (socket says 172.21.15.130:40388) 2023-09-13T06:13:16.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1cb63640 1 -- 172.21.15.130:0/3398144779 learned_addr learned my addr 172.21.15.130:0/3398144779 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:16.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa17fff640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa18147b50 0x7faa181fab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:16.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa177fe640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa18147f30 0x7faa18160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:16.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1cb63640 1 -- 172.21.15.130:0/3398144779 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa18147f30 msgr2=0x7faa18160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:16.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1cb63640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa18147f30 0x7faa18160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:16.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1cb63640 1 -- 172.21.15.130:0/3398144779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa18147b50 msgr2=0x7faa181fab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:16.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1cb63640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa18147b50 0x7faa181fab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:16.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1cb63640 1 -- 172.21.15.130:0/3398144779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c009420 con 0x7faa18148950 2023-09-13T06:13:16.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1cb63640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa18148950 0x7faa180cf470 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7faa1000ec40 tx=0x7faa1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:16.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa14ff9640 1 -- 172.21.15.130:0/3398144779 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1000ced0 con 0x7faa18148950 2023-09-13T06:13:16.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa14ff9640 1 -- 172.21.15.130:0/3398144779 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1000f040 con 0x7faa18148950 2023-09-13T06:13:16.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa14ff9640 1 -- 172.21.15.130:0/3398144779 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa100146c0 con 0x7faa18148950 2023-09-13T06:13:16.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.312+0000 7faa1e5c6640 1 -- 172.21.15.130:0/3398144779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa180cd250 con 0x7faa18148950 2023-09-13T06:13:16.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.316+0000 7faa1e5c6640 1 -- 172.21.15.130:0/3398144779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa180cd810 con 0x7faa18148950 2023-09-13T06:13:16.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.316+0000 7faa1e5c6640 1 -- 172.21.15.130:0/3398144779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa180cdd30 con 0x7faa18148950 2023-09-13T06:13:16.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.316+0000 7faa14ff9640 1 -- 172.21.15.130:0/3398144779 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7faa10014820 con 0x7faa18148950 2023-09-13T06:13:16.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.316+0000 7faa14ff9640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faa04065b20 0x7faa04067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:16.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.316+0000 7faa14ff9640 1 -- 172.21.15.130:0/3398144779 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa10083c40 con 0x7faa18148950 2023-09-13T06:13:16.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.316+0000 7faa17fff640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faa04065b20 0x7faa04067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:16.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.316+0000 7faa14ff9640 1 -- 172.21.15.130:0/3398144779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=190}) v3 -- 0x7faa0406d650 con 0x7faa18148950 2023-09-13T06:13:16.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.316+0000 7faa17fff640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faa04065b20 0x7faa04067fe0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7faa08007fd0 tx=0x7faa08007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:16.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.320+0000 7faa14ff9640 1 -- 172.21.15.130:0/3398144779 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7faa100515a0 con 0x7faa18148950 2023-09-13T06:13:16.423 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:13:16.427 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:13:16.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.472+0000 7faa1e5c6640 1 -- 172.21.15.130:0/3398144779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7faa180618a0 con 0x7faa18148950 2023-09-13T06:13:16.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.472+0000 7faa14ff9640 1 -- 172.21.15.130:0/3398144779 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) v1 ==== 81+0+34069 (secure 0 0 0) 0x7faa10018030 con 0x7faa18148950 2023-09-13T06:13:16.474 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:16.474 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:16.475 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 189, 2023-09-13T06:13:16.475 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:13:16.475 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:13:16.475 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:13:07.484452+0000", 2023-09-13T06:13:16.475 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:13:16.476 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:13:16.476 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:13:16.476 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:13:16.476 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:13:16.476 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:13:16.477 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:13:16.477 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:13:16.477 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:13:16.477 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:16.477 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:13:16.478 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:13:16.478 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:13:16.478 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:13:16.478 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:13:16.478 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 23, 2023-09-13T06:13:16.479 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:13:16.479 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:13:16.479 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:13:16.479 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:13:16.479 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:13:16.479 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:13:16.480 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.480 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:13:16.480 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:13:16.480 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:13:16.480 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:16.481 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:16.481 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:16.481 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:16.481 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:16.481 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:16.482 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:16.482 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:16.482 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:16.482 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:16.482 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:16.482 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:16.483 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:13:16.483 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:13:16.483 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:13:16.483 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:13:16.483 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:13:16.484 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:16.484 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:16.484 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:16.484 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:16.484 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:13:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:13:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:13:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:13:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:13:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:13:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:13:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 22, 2023-09-13T06:13:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:13:16.497 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:49.873320+0000", 2023-09-13T06:13:16.497 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:16.497 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:16.497 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:16.497 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:16.498 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:16.498 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:16.498 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:16.498 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:16.498 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:16.498 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:16.499 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:16.499 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:16.499 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:13:16.499 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:13:16.499 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:13:16.500 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:13:16.500 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:13:16.500 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:16.500 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:16.500 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:16.501 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:16.501 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:16.501 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:16.501 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:16.501 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.502 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "186", 2023-09-13T06:13:16.502 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:16.502 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:16.502 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:16.502 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:16.503 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:16.503 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:16.503 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:16.503 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:16.503 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:16.503 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:16.504 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:16.504 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:16.504 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:16.504 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:16.504 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:16.505 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:16.505 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:16.505 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:16.505 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:16.505 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:16.506 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:16.506 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:16.506 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:16.506 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:16.506 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:16.507 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:16.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.507 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:16.507 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:16.507 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:16.507 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:16.508 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:16.508 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:16.508 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:16.508 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:16.508 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:16.509 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:16.509 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:16.509 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:16.509 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:13:16.509 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:13:16.510 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:13:16.510 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.510 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:16.510 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:16.510 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:13:16.511 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.511 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.511 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:16.511 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:13:16.511 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:13:16.512 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:16.512 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:16.512 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:16.512 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:16.512 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:16.512 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:16.513 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.513 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.513 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.513 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 23, 2023-09-13T06:13:16.513 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:13:16.514 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:51.142196+0000", 2023-09-13T06:13:16.514 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1027, 2023-09-13T06:13:16.514 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-13T06:13:16.514 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:16.514 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:16.515 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:16.515 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:16.515 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:16.515 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:16.515 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:16.515 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:16.516 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:16.516 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:16.516 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:13:16.516 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:13:16.516 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:13:16.517 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:13:16.517 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:13:16.517 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:16.517 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:16.517 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:16.518 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:16.518 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:16.518 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:16.518 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:16.518 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.519 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "189", 2023-09-13T06:13:16.519 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:16.519 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:16.519 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:16.519 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:16.519 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:16.520 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:16.520 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:16.520 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:16.520 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:16.520 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:13:16.521 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:16.521 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:16.521 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:16.521 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:16.521 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:16.522 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:16.522 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:16.522 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:16.522 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:16.522 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:16.523 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:16.523 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:16.523 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:16.523 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:16.523 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:16.523 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:16.524 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.524 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:16.524 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:16.524 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:16.524 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:16.525 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:16.525 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:16.525 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:16.525 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:16.525 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:16.525 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:16.526 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:16.526 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:16.526 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:13:16.526 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:13:16.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.527 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:16.527 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:16.527 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:13:16.527 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.527 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.528 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:16.528 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:13:16.528 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:13:16.528 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:16.528 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:13:16.529 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:13:16.529 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:16.529 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:16.529 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:16.529 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.530 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.530 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:16.530 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:13:16.530 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.530 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:16.531 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:16.531 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:16.531 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:16.531 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:16.531 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:16.532 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:16.532 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:16.532 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:16.532 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:16.532 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:16.532 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:16.533 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:16.533 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.533 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.533 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.533 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:13:16.534 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:16.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.534 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.534 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.534 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:13:16.535 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:16.535 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.535 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.535 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.535 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:16.535 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.536 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.536 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.536 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:13:16.536 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:16.536 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.537 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.537 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.537 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:13:16.537 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:16.537 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.538 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.538 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.538 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:16.538 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.538 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.539 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.539 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:13:16.539 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:16.539 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.539 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.539 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.540 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:13:16.540 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:16.540 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.540 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.540 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.541 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:16.541 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.541 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.541 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.541 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:13:16.541 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:16.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.542 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.542 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.542 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:13:16.542 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:16.543 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.543 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.543 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.543 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:13:16.543 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:13:16.544 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:13:16.544 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:13:16.544 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:16.544 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:16.544 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:16.545 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.545 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.545 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:16.545 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:16.546 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:16.546 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:16.546 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:16.546 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:16.546 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:16.546 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:16.547 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:16.547 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:16.547 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:16.547 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:16.547 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:16.548 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.548 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.548 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:13:16.548 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:16.549 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.549 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.549 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.549 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:13:16.549 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:16.550 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.550 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.550 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.550 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:16.550 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.551 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.551 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:13:16.551 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:16.551 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.551 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.552 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.552 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:13:16.552 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:16.552 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.552 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.553 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:16.553 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.553 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.553 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.554 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:13:16.554 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:16.554 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.554 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.554 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.554 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:13:16.555 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:16.555 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.555 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.555 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.555 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:16.556 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.556 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.556 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.556 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:13:16.556 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:16.557 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.557 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.557 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.557 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:13:16.557 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:16.558 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.558 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.558 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.558 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:13:16.558 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:13:16.559 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:13:16.559 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:13:16.559 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:16.559 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:16.559 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:16.560 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.560 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.560 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.560 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:16.560 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:16.561 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:16.561 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:16.561 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:16.561 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:16.561 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:16.561 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:16.562 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:16.562 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:16.562 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:16.562 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:16.562 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:16.563 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.563 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.563 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.563 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:13:16.563 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:16.564 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.564 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.564 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.564 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:13:16.564 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:16.565 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.565 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.565 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.565 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:16.565 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.566 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.566 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.566 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:13:16.566 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:16.566 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.567 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.567 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.567 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:13:16.567 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:16.567 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.567 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.568 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.568 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:16.568 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.568 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.569 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:13:16.569 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:16.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.569 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.570 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:13:16.570 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:16.570 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.570 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.570 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:16.571 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.571 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.571 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:13:16.571 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:16.572 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.572 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.572 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:13:16.572 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:16.573 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.573 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.573 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:13:16.573 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:13:16.573 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:13:16.574 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:13:16.574 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:16.574 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:16.574 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:16.574 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.575 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.575 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:16.575 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:16.575 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:16.576 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:16.576 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:16.576 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:16.576 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:16.576 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:16.576 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:16.577 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:16.577 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:16.577 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:16.577 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:16.577 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.578 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.578 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.578 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:13:16.578 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:16.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.579 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.579 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.579 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:13:16.579 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:16.579 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.579 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.580 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:16.580 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.580 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.581 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:13:16.581 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:16.581 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.581 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.581 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.581 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:13:16.582 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:16.582 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.582 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.582 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.582 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:16.583 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.583 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.583 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:13:16.583 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:16.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.584 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.584 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:13:16.584 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:16.584 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.585 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.585 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:16.585 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.586 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.586 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:13:16.586 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:16.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.587 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.587 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:13:16.587 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:16.587 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.587 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.587 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.588 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:13:16.588 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:13:16.588 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:13:16.588 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:13:16.588 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:16.589 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:16.589 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:16.589 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.590 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:16.590 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:16.590 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:16.590 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:16.590 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:16.591 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:16.591 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:16.591 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:16.591 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:16.591 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:16.591 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:16.592 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:16.592 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:16.592 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.592 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.593 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:13:16.593 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:16.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.593 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.593 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.594 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:13:16.594 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:16.594 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.594 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.595 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:16.595 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.595 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.595 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:13:16.595 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:16.596 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.596 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.596 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.596 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:13:16.596 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:16.597 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.597 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.597 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.597 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:16.597 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.598 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.598 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:13:16.598 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:16.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.599 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.599 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.599 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:13:16.599 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:16.599 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.599 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.600 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.600 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:16.600 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.600 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.601 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:13:16.601 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:16.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.601 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.601 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:13:16.602 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:16.602 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.602 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.602 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:13:16.603 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:13:16.603 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:13:16.603 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:13:16.603 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:16.603 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:16.604 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:16.604 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.604 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.604 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:16.605 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:16.605 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:16.605 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:16.605 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:16.605 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:16.605 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:16.606 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:16.606 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:16.606 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:16.606 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:16.606 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:16.607 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:16.607 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.607 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.607 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.607 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:13:16.608 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:16.608 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.608 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.608 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.608 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:13:16.609 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:16.609 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.609 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.609 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:16.609 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.610 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.610 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.610 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:13:16.610 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:16.610 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.611 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.611 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.611 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:13:16.611 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:16.611 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.612 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.612 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.612 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:16.612 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.613 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.613 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:13:16.613 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:16.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.614 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.614 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:13:16.614 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:16.614 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.614 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.615 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:16.615 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.615 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.615 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:13:16.616 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:16.616 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.616 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.616 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.616 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:13:16.616 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:16.617 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.617 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.617 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:13:16.617 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:13:16.618 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:13:16.618 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:13:16.618 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:16.618 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:16.618 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:16.619 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.619 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.619 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:16.619 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:16.619 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:16.620 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:16.620 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:16.620 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:16.620 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:16.620 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:16.621 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:16.621 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:16.621 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:16.621 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:16.621 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:16.621 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.622 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.622 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.622 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:13:16.622 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:16.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.623 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.623 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.623 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:13:16.623 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:16.623 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.624 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.624 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.624 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:16.624 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.624 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.625 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:13:16.625 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:16.625 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.625 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.625 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.626 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:13:16.626 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:16.626 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.626 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.626 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.627 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:16.627 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.627 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.627 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:13:16.627 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:16.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.628 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.628 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.628 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:13:16.628 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:16.629 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.629 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.629 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.629 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:16.629 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.630 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.630 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:13:16.630 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:16.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.631 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.631 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:13:16.631 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:16.631 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.631 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.632 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:13:16.632 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:13:16.632 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:13:16.632 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:13:16.632 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:16.633 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:16.633 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:16.633 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.633 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.634 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:16.634 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:16.634 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:16.634 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:16.634 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:16.635 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:16.635 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:16.635 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:16.635 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:16.635 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:16.635 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:16.636 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:16.636 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:16.636 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.636 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.636 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.637 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:13:16.637 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:16.637 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.637 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.637 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.638 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:13:16.638 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:16.638 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.638 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.639 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:16.639 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.639 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.639 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.639 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:13:16.639 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:16.640 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.640 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.640 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.640 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:13:16.640 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:16.641 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.641 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.641 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.641 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:16.641 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.642 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.642 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:13:16.642 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:16.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.643 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.643 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.643 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:13:16.643 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:16.643 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.643 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.644 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.644 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:16.644 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:16.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.644 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:16.645 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:13:16.645 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:16.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.645 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:16.645 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:13:16.646 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:16.646 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.646 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.646 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:13:16.647 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:13:16.647 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:13:16.647 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:13:16.647 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:16.647 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:16.648 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:16.648 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:16.648 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.648 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:16.648 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:13:16.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.649 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:16.649 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:16.649 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:16.649 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:16.650 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:16.650 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:16.650 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:13:16.650 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:16.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.651 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:16.651 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:16.651 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:16.651 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:16.651 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:16.652 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:16.652 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:13:16.652 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:16.652 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.652 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.653 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:16.653 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:16.653 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:16.653 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:16.653 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:16.654 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:16.654 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:13:16.654 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:16.654 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.654 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.655 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:16.655 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:16.655 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:16.655 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:16.655 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:16.655 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:16.656 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:13:16.656 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:16.656 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.656 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:16.657 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:16.657 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:16.657 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:16.657 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:16.657 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:16.657 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:13:16.658 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:16.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.658 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:16.658 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:16.659 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:16.659 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:16.659 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:16.659 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:16.659 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:13:16.660 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:16.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.660 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.660 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:16.660 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:16.661 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:16.661 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:16.661 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:16.661 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:16.661 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:13:16.662 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:16.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:16.662 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:16.662 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:16.663 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:16.663 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:16.663 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:16.663 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:16.663 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:13:16.664 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:16.664 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.664 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:16.664 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:13:16.664 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:13:16.665 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:13:16.665 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:13:16.665 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:13:16.665 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:13:16.665 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:13:16.665 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:13:16.666 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:13:16.666 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:13:16.666 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:13:16.666 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:13:16.666 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:13:16.667 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:13:16.667 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:16.667 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:13:16.667 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:13:16.668 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:13:16.668 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:13:16.668 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:13:16.668 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:13:16.668 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:13:16.668 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:13:16.669 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:13:16.669 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:13:16.669 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:13:16.669 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:16.669 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:16.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 -- 172.21.15.130:0/3398144779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faa04065b20 msgr2=0x7faa04067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:16.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faa04065b20 0x7faa04067fe0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7faa08007fd0 tx=0x7faa08007d60 comp rx=0 tx=0).stop 2023-09-13T06:13:16.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 -- 172.21.15.130:0/3398144779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa18148950 msgr2=0x7faa180cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:16.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa18148950 0x7faa180cf470 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7faa1000ec40 tx=0x7faa1000c490 comp rx=0 tx=0).stop 2023-09-13T06:13:16.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 -- 172.21.15.130:0/3398144779 shutdown_connections 2023-09-13T06:13:16.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7faa04065b20 0x7faa04067fe0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:16.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa18148950 0x7faa180cf470 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:16.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa18147f30 0x7faa18160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:16.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 --2- 172.21.15.130:0/3398144779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa18147b50 0x7faa181fab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:16.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 -- 172.21.15.130:0/3398144779 >> 172.21.15.130:0/3398144779 conn(0x7faa18065990 msgr2=0x7faa18144470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:16.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 -- 172.21.15.130:0/3398144779 shutdown_connections 2023-09-13T06:13:16.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:16.476+0000 7faa1e5c6640 1 -- 172.21.15.130:0/3398144779 wait complete. 2023-09-13T06:13:16.675 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:13:21.676 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:13:21.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.824+0000 7f0b670d8640 1 Processor -- start 2023-09-13T06:13:21.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.824+0000 7f0b670d8640 1 -- start start 2023-09-13T06:13:21.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.824+0000 7f0b670d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0b60157920 0x7f0b600ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:21.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.824+0000 7f0b670d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b600b0f40 0x7f0b600b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:21.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.824+0000 7f0b670d8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b600afee0 con 0x7f0b6015e560 2023-09-13T06:13:21.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.824+0000 7f0b670d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b600aea50 con 0x7f0b60157920 2023-09-13T06:13:21.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.824+0000 7f0b670d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600b0b20 con 0x7f0b600b0f40 2023-09-13T06:13:21.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b65675640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0b6015e560 0x7f0b600ac840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35990/0 (socket says 172.21.15.130:35990) 2023-09-13T06:13:21.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b65675640 1 -- 172.21.15.130:0/4100617495 learned_addr learned my addr 172.21.15.130:0/4100617495 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:21.829 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b57fff640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b600b0f40 0x7f0b600b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:21.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b64e74640 1 --2- 172.21.15.130:0/4100617495 >> v2:172.21.15.164:3300/0 conn(0x7f0b60157920 0x7f0b600ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:21.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718435284 0 0) 0x7f0b600afee0 con 0x7f0b6015e560 2023-09-13T06:13:21.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b48003530 con 0x7f0b6015e560 2023-09-13T06:13:21.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2741775490 0 0) 0x7f0b48003530 con 0x7f0b6015e560 2023-09-13T06:13:21.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b600b0f40 msgr2=0x7f0b600b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:21.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b600b0f40 0x7f0b600b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:21.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 >> v2:172.21.15.164:3300/0 conn(0x7f0b60157920 msgr2=0x7f0b600ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:21.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 --2- 172.21.15.130:0/4100617495 >> v2:172.21.15.164:3300/0 conn(0x7f0b60157920 0x7f0b600ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:21.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b600b0180 con 0x7f0b6015e560 2023-09-13T06:13:21.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f0b58001a00 con 0x7f0b6015e560 2023-09-13T06:13:21.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 >> v1:172.21.15.130:6789/0 conn(0x7f0b6015e560 legacy=0x7f0b600ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:21.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b480039f0 0x7f0b48003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:21.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b600b0f40 0x7f0b480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:21.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b48004d10 0x7f0b48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:21.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600aea50 con 0x7f0b480039f0 2023-09-13T06:13:21.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600b0b20 con 0x7f0b48004d10 2023-09-13T06:13:21.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4800b990 con 0x7f0b600b0f40 2023-09-13T06:13:21.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b64e74640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b480039f0 0x7f0b48003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:21.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b65675640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b48004d10 0x7f0b48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:21.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b57fff640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b600b0f40 0x7f0b480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:21.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b64e74640 1 -- 172.21.15.130:0/4100617495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b600b0f40 msgr2=0x7f0b480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:21.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b64e74640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b600b0f40 0x7f0b480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:21.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b64e74640 1 -- 172.21.15.130:0/4100617495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b48004d10 msgr2=0x7f0b48005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:21.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b64e74640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b48004d10 0x7f0b48005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:21.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.828+0000 7f0b64e74640 1 -- 172.21.15.130:0/4100617495 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b48003530 con 0x7f0b480039f0 2023-09-13T06:13:21.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b64e74640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b480039f0 0x7f0b48003e10 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009ae0 tx=0x7f0b5c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311bd33e6f24c13d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:21.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0a5550 con 0x7f0b480039f0 2023-09-13T06:13:21.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c0a56b0 con 0x7f0b480039f0 2023-09-13T06:13:21.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b577fe640 1 -- 172.21.15.130:0/4100617495 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0a5a60 con 0x7f0b480039f0 2023-09-13T06:13:21.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b670d8640 1 -- 172.21.15.130:0/4100617495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b480039f0 msgr2=0x7f0b48003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:21.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b670d8640 1 --2- 172.21.15.130:0/4100617495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b480039f0 0x7f0b48003e10 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009ae0 tx=0x7f0b5c01ca60 comp rx=0 tx=0).stop 2023-09-13T06:13:21.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b65675640 1 -- 172.21.15.130:0/4100617495 reap_dead start 2023-09-13T06:13:21.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b670d8640 1 -- 172.21.15.130:0/4100617495 shutdown_connections 2023-09-13T06:13:21.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b670d8640 1 -- 172.21.15.130:0/4100617495 >> 172.21.15.130:0/4100617495 conn(0x7f0b60065990 msgr2=0x7f0b60065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:21.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b670d8640 1 -- 172.21.15.130:0/4100617495 shutdown_connections 2023-09-13T06:13:21.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b670d8640 1 -- 172.21.15.130:0/4100617495 wait complete. 2023-09-13T06:13:21.839 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b670d8640 1 Processor -- start 2023-09-13T06:13:21.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.832+0000 7f0b670d8640 1 -- start start 2023-09-13T06:13:21.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b670d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b480039f0 0x7f0b6006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:21.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b670d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b60157e80 0x7f0b601537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:21.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b670d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b60153d00 0x7f0b6013b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:21.840 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b670d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6015ac50 con 0x7f0b60157e80 2023-09-13T06:13:21.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b670d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60152440 con 0x7f0b60153d00 2023-09-13T06:13:21.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b670d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60152720 con 0x7f0b480039f0 2023-09-13T06:13:21.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b60157e80 0x7f0b601537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:21.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b60157e80 0x7f0b601537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40168/0 (socket says 172.21.15.130:40168) 2023-09-13T06:13:21.841 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b57fff640 1 -- 172.21.15.130:0/2521114073 learned_addr learned my addr 172.21.15.130:0/2521114073 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:21.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b64e74640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b480039f0 0x7f0b6006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:21.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b65675640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b60153d00 0x7f0b6013b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:21.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b57fff640 1 -- 172.21.15.130:0/2521114073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b480039f0 msgr2=0x7f0b6006bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:21.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b57fff640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b480039f0 0x7f0b6006bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:21.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b57fff640 1 -- 172.21.15.130:0/2521114073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b60153d00 msgr2=0x7f0b6013b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:21.842 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b57fff640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b60153d00 0x7f0b6013b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:21.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b57fff640 1 -- 172.21.15.130:0/2521114073 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60152a00 con 0x7f0b60157e80 2023-09-13T06:13:21.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b57fff640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b60157e80 0x7f0b601537c0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f0b500115e0 tx=0x7f0b50011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:21.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b557fa640 1 -- 172.21.15.130:0/2521114073 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5000f8f0 con 0x7f0b60157e80 2023-09-13T06:13:21.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b557fa640 1 -- 172.21.15.130:0/2521114073 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5000fa50 con 0x7f0b60157e80 2023-09-13T06:13:21.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b670d8640 1 -- 172.21.15.130:0/2521114073 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b60152ce0 con 0x7f0b60157e80 2023-09-13T06:13:21.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b557fa640 1 -- 172.21.15.130:0/2521114073 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5000fdc0 con 0x7f0b60157e80 2023-09-13T06:13:21.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b670d8640 1 -- 172.21.15.130:0/2521114073 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b601532a0 con 0x7f0b60157e80 2023-09-13T06:13:21.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b670d8640 1 -- 172.21.15.130:0/2521114073 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b600618a0 con 0x7f0b60157e80 2023-09-13T06:13:21.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.836+0000 7f0b557fa640 1 -- 172.21.15.130:0/2521114073 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0b50015460 con 0x7f0b60157e80 2023-09-13T06:13:21.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.840+0000 7f0b557fa640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b4c065b50 0x7f0b4c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:21.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.840+0000 7f0b557fa640 1 -- 172.21.15.130:0/2521114073 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b50083700 con 0x7f0b60157e80 2023-09-13T06:13:21.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.840+0000 7f0b557fa640 1 -- 172.21.15.130:0/2521114073 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=190}) v3 -- 0x7f0b4c06d680 con 0x7f0b60157e80 2023-09-13T06:13:21.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.840+0000 7f0b64e74640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b4c065b50 0x7f0b4c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:21.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.840+0000 7f0b64e74640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b4c065b50 0x7f0b4c068010 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0af000 tx=0x7f0b5c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:21.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.844+0000 7f0b557fa640 1 -- 172.21.15.130:0/2521114073 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0b50051060 con 0x7f0b60157e80 2023-09-13T06:13:21.990 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.988+0000 7f0b670d8640 1 -- 172.21.15.130:0/2521114073 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0b601542c0 con 0x7f0b60157e80 2023-09-13T06:13:21.991 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b557fa640 1 -- 172.21.15.130:0/2521114073 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) v1 ==== 81+0+34069 (secure 0 0 0) 0x7f0b50022020 con 0x7f0b60157e80 2023-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 189, 2023-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:13:21.993 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:13:21.993 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:13:07.484452+0000", 2023-09-13T06:13:21.993 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:13:21.993 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:13:21.993 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:13:21.994 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:13:21.994 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:13:21.994 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:13:21.994 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:13:21.994 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:13:21.995 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:13:21.995 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:21.995 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:13:21.995 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:13:21.995 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:13:21.996 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:13:21.996 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:13:21.996 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 23, 2023-09-13T06:13:21.996 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:13:21.996 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:13:21.997 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:13:21.997 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:13:21.997 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:13:21.997 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:13:21.997 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:21.999 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:21.999 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:21.999 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:21.999 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:21.999 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:22.000 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:22.000 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:22.000 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:22.000 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:22.000 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:13:22.001 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:13:22.001 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:13:22.001 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:13:22.001 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:13:22.001 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:22.002 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:22.002 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:22.002 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:22.002 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:22.002 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:22.002 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:22.003 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.003 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:13:22.003 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:22.003 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:22.003 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:22.004 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:22.004 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:22.004 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:22.004 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:22.004 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:22.005 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:22.005 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:22.005 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:22.005 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:22.005 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:22.006 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:22.006 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:22.006 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:22.006 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:22.006 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:22.006 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:22.007 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:22.007 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:22.007 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:22.007 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:22.007 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:22.008 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:22.008 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:22.008 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.008 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:22.008 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:22.008 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:22.009 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:22.009 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:22.009 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:22.009 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:22.009 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:22.010 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:22.010 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:22.010 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:22.010 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:22.010 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:13:22.011 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:13:22.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.011 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:22.011 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:13:22.011 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.011 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:22.012 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:13:22.012 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:13:22.012 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:13:22.012 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:22.012 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:22.013 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:22.013 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:22.013 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:22.013 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.013 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.014 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.014 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 22, 2023-09-13T06:13:22.014 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:13:22.014 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:49.873320+0000", 2023-09-13T06:13:22.014 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:22.014 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:22.015 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:22.015 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:22.015 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:22.015 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:22.015 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:22.016 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:22.016 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:22.016 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:22.016 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:22.016 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:22.016 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:13:22.017 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:13:22.017 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:13:22.017 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:13:22.017 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:13:22.017 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:22.018 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:22.018 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:22.018 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:22.018 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:22.018 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:22.019 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:22.019 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.019 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "186", 2023-09-13T06:13:22.019 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:22.019 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:22.019 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:22.020 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:22.020 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:22.020 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:22.020 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:22.020 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:22.020 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:22.021 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:22.021 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:22.021 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:22.021 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:22.021 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:22.022 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:22.022 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:22.022 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:22.022 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:22.022 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:22.023 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:22.023 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:22.023 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:22.023 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:22.023 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:22.024 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:22.024 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:22.024 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.024 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:22.024 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:22.024 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:22.025 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:22.025 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:22.025 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:22.025 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:22.025 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:22.026 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:22.026 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:22.026 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:22.026 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:22.026 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:13:22.026 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:13:22.027 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:13:22.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.027 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:22.027 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:22.027 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:13:22.028 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.028 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.028 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:22.028 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:13:22.028 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:13:22.029 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:22.029 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:22.029 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:22.029 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:22.029 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:22.030 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:22.030 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.030 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.030 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 23, 2023-09-13T06:13:22.030 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:13:22.031 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:51.142196+0000", 2023-09-13T06:13:22.031 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1027, 2023-09-13T06:13:22.031 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool,full,full_quota", 2023-09-13T06:13:22.031 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:22.031 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:22.032 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:22.032 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:22.032 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:22.032 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:22.032 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:22.033 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:22.033 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:22.033 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:22.033 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:13:22.033 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:13:22.033 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:13:22.034 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:13:22.034 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:13:22.034 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:22.034 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:22.034 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:22.035 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:22.035 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:22.035 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:22.035 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:22.035 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.036 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "189", 2023-09-13T06:13:22.036 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:22.036 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:22.036 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:22.036 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:22.037 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:22.037 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:22.037 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:22.037 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:22.037 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:22.037 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:13:22.038 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:22.038 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:22.038 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:22.038 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:22.038 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:22.039 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:22.039 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:22.039 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:22.039 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:22.039 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:22.039 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:22.040 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:22.040 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:22.040 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:22.040 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:22.040 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:22.041 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.041 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:22.041 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:22.041 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:22.041 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:22.041 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:22.042 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:22.042 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:22.042 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:22.042 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:22.042 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:22.043 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:22.043 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:22.043 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:13:22.043 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:13:22.043 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.043 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:22.044 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:22.044 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:13:22.044 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.044 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:22.045 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:13:22.045 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:13:22.045 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:22.045 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:13:22.045 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:13:22.046 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:22.046 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:22.046 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:22.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.046 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.046 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:22.047 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:13:22.047 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.047 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:22.047 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:22.047 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:22.048 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:22.048 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:22.048 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:22.048 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:22.048 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:22.048 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:22.049 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:22.049 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:22.049 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:22.049 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:22.049 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.049 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.050 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.050 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:13:22.050 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:22.050 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.051 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.051 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:13:22.051 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:22.051 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.051 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.052 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.052 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:22.052 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.052 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.052 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.052 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:13:22.053 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:22.053 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.053 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.053 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.053 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:13:22.054 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:22.054 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.054 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.054 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.054 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:22.055 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.055 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.055 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.055 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:13:22.055 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:22.056 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.056 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.056 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.056 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:13:22.056 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:22.057 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.057 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.057 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.057 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:22.057 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.058 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.058 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.058 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:13:22.058 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:22.058 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.059 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.059 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.059 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:13:22.059 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:22.059 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.059 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.060 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:13:22.060 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:13:22.060 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:13:22.060 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:13:22.061 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:22.061 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:22.061 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:22.061 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.062 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.062 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:22.062 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:22.062 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:22.062 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:22.063 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:22.063 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:22.063 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:22.063 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:22.063 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:22.064 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:22.064 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:22.064 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:22.064 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:22.064 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.064 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.065 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.065 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:13:22.065 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:22.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.065 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.066 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.066 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:13:22.066 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:22.066 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.066 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.067 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:22.067 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.067 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.067 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.068 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:13:22.068 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:22.068 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.068 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.068 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.068 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:13:22.069 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:22.069 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.069 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.069 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:22.069 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.070 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.070 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:13:22.070 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:22.070 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.071 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.071 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:13:22.071 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:22.071 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.072 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.072 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:22.072 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.072 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.073 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:13:22.073 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:22.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.073 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.073 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.074 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:13:22.074 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:22.074 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.074 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.074 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.075 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:13:22.075 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:13:22.075 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:13:22.075 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:13:22.075 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:22.075 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:22.076 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:22.076 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.076 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:22.077 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:22.077 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:22.077 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:22.077 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:22.077 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:22.077 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:22.078 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:22.078 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:22.078 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:22.078 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:22.078 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:22.079 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:22.079 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.079 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.079 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.079 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:13:22.079 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:22.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.080 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.080 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:13:22.080 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:22.081 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.081 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.081 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:22.081 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.081 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.082 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.082 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:13:22.082 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:22.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.083 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.083 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:13:22.083 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:22.083 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.083 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.084 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:22.084 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.084 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.085 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:13:22.085 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:22.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.085 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.085 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.085 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:13:22.086 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:22.086 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.086 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.086 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:22.087 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.087 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.087 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.087 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:13:22.087 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:22.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.088 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.088 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:13:22.088 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:22.088 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.089 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.089 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:13:22.089 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:13:22.089 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:13:22.090 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:13:22.090 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:22.090 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:22.090 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:22.090 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.091 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:22.091 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:22.091 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:22.092 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:22.092 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:22.092 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:22.092 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:22.092 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:22.093 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:22.093 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:22.093 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:22.093 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:22.093 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:22.094 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.094 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.094 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:13:22.094 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:22.095 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.095 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.095 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.095 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:13:22.095 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:22.095 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.096 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.096 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:22.096 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.096 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.097 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.097 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:13:22.097 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:22.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.098 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.098 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:13:22.098 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:22.098 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.098 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.099 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:22.099 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.099 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.099 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:13:22.100 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:22.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.100 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.100 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:13:22.101 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:22.101 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.101 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.101 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:22.102 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.102 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.102 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:13:22.102 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:22.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.103 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.103 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:13:22.103 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:22.103 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.104 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.104 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:13:22.104 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:13:22.104 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:13:22.105 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:13:22.105 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:22.105 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:22.105 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:22.105 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.106 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.106 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:22.106 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:22.106 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:22.106 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:22.107 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:22.107 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:22.107 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:22.107 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:22.107 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:22.108 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:22.108 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:22.108 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:22.108 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:22.108 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.109 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.109 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:13:22.109 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:22.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.109 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:13:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:13:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:13:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:13:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.115 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.115 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.115 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:13:22.115 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:22.115 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.115 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.116 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:22.116 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.116 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.117 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:13:22.117 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:22.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.117 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.117 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:13:22.118 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:22.118 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.118 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.118 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:13:22.118 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:13:22.119 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:13:22.119 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:13:22.119 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:22.119 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:22.119 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:22.120 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.120 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.120 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:22.120 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:22.121 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:22.121 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:22.121 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:22.121 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:22.121 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:22.122 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:22.122 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:22.122 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:22.122 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:22.122 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:22.123 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:22.123 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.123 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.123 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.123 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:13:22.123 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:22.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.124 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.124 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.124 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:13:22.124 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:22.125 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.125 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.125 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:22.125 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.126 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.126 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:13:22.126 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:22.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.127 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.127 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:13:22.127 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:22.127 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.127 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.128 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:22.128 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.128 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.129 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:13:22.129 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:22.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.129 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.129 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.130 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:13:22.130 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:22.130 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.130 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.131 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:22.131 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.131 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.131 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:13:22.131 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:22.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.132 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.132 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.132 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:13:22.132 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:22.133 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.133 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.133 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:13:22.133 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:13:22.134 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:13:22.134 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:13:22.134 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:22.134 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:22.134 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:22.135 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.135 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:22.135 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:22.136 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:22.136 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:22.136 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:22.136 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:22.136 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:22.136 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:22.137 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:22.137 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:22.137 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:22.137 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:22.137 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:22.138 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.138 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.138 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.138 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:13:22.138 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:22.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.139 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.139 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:13:22.139 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:22.139 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.140 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.140 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:22.140 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.140 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.141 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.141 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:13:22.141 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:22.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.141 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.141 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.142 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:13:22.142 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:22.142 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.142 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.143 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:22.143 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.143 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.143 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.143 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:13:22.143 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:22.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.144 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.144 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.144 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:13:22.144 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:22.145 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.145 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.145 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:22.145 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.146 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.146 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:13:22.146 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:22.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.146 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.147 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.147 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:13:22.147 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:22.147 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.147 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.148 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:13:22.148 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:13:22.148 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:13:22.148 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:13:22.148 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:22.149 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:22.149 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:22.149 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.149 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.149 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.150 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:22.150 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:22.150 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:22.150 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:22.150 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:22.151 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:22.151 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:22.151 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:22.151 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:22.151 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:22.151 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:22.152 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:22.152 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:22.152 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.152 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.152 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.153 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:13:22.153 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:22.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.153 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.153 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:13:22.154 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:22.154 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.154 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.154 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:22.155 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.155 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.155 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.155 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:13:22.155 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:22.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.156 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.156 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:13:22.156 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:22.156 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.157 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.157 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.157 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:22.157 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.158 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.158 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:13:22.158 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:22.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.159 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.159 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:13:22.159 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:22.159 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.159 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.160 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:22.160 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:22.160 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.160 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:22.160 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:13:22.161 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:22.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.161 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:22.161 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:13:22.162 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:22.162 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.162 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.162 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.162 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:13:22.163 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:13:22.163 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:13:22.163 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:13:22.163 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:22.163 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:22.163 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:22.164 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:22.164 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.164 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:22.164 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:13:22.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.165 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:22.165 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:22.165 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:22.165 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:22.165 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:22.166 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:22.166 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:13:22.166 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:22.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.166 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.166 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:22.167 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:22.167 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:22.167 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:22.167 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:22.167 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:22.168 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:13:22.168 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:22.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.168 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:22.169 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:22.169 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:22.169 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:22.169 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:22.169 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:22.169 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:13:22.170 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:22.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.170 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:22.170 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:22.171 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:22.171 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:22.171 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:22.171 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:22.171 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:13:22.172 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:22.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.172 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:22.172 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:22.172 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:22.173 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:22.173 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:22.173 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:22.173 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:13:22.173 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:22.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.174 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.174 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:22.174 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:22.174 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:22.175 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:22.175 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:22.175 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:22.175 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:13:22.175 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:22.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.176 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.176 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:22.176 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:22.176 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:22.176 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:22.177 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:22.177 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:22.177 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:13:22.177 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:22.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.178 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:22.178 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:22.178 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:22.178 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:22.178 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:22.178 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:22.179 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:22.179 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:13:22.179 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:22.179 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.179 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:22.180 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:13:22.180 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:13:22.180 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:13:22.180 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:13:22.180 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:13:22.180 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:13:22.181 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:13:22.181 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:13:22.181 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:13:22.181 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:13:22.181 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:13:22.182 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:13:22.182 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:13:22.182 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:13:22.182 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:22.183 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:13:22.183 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:13:22.183 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:13:22.183 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:13:22.183 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:13:22.183 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:13:22.184 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:13:22.184 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:13:22.184 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:13:22.184 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:13:22.184 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:13:22.185 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:22.185 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:22.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 -- 172.21.15.130:0/2521114073 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b4c065b50 msgr2=0x7f0b4c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b4c065b50 0x7f0b4c068010 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0af000 tx=0x7f0b5c0046d0 comp rx=0 tx=0).stop 2023-09-13T06:13:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 -- 172.21.15.130:0/2521114073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b60157e80 msgr2=0x7f0b601537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b60157e80 0x7f0b601537c0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f0b500115e0 tx=0x7f0b50011aa0 comp rx=0 tx=0).stop 2023-09-13T06:13:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 -- 172.21.15.130:0/2521114073 shutdown_connections 2023-09-13T06:13:22.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0b4c065b50 0x7f0b4c068010 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b60153d00 0x7f0b6013b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b60157e80 0x7f0b601537c0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 --2- 172.21.15.130:0/2521114073 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b480039f0 0x7f0b6006bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 -- 172.21.15.130:0/2521114073 >> 172.21.15.130:0/2521114073 conn(0x7f0b60065990 msgr2=0x7f0b600730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:22.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 -- 172.21.15.130:0/2521114073 shutdown_connections 2023-09-13T06:13:22.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:21.992+0000 7f0b670d8640 1 -- 172.21.15.130:0/2521114073 wait complete. 2023-09-13T06:13:22.189 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-09-13T06:13:27.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:13:27.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f41303640 1 Processor -- start 2023-09-13T06:13:27.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f41303640 1 -- start start 2023-09-13T06:13:27.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f41303640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f3c0d1750 0x7f4f3c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:27.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f41303640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4f3c146f30 0x7f4f3c0b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:27.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f41303640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c0b63c0 con 0x7f4f3c0d1090 2023-09-13T06:13:27.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f41303640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c15dea0 con 0x7f4f3c146f30 2023-09-13T06:13:27.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f41303640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0d0c20 con 0x7f4f3c0d1750 2023-09-13T06:13:27.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f3b7fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4f3c146f30 0x7f4f3c0b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:27.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f3c0d1750 0x7f4f3c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:27.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f327fc640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f4f3c0d1090 0x7f4f3c146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:43066/0 (socket says 172.21.15.130:43066) 2023-09-13T06:13:27.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f327fc640 1 -- 172.21.15.130:0/2325632754 learned_addr learned my addr 172.21.15.130:0/2325632754 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:27.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f3affd640 1 -- 172.21.15.130:0/2325632754 >> v2:172.21.15.164:3300/0 conn(0x7f4f3c146f30 msgr2=0x7f4f3c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:27.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f3affd640 1 --2- 172.21.15.130:0/2325632754 >> v2:172.21.15.164:3300/0 conn(0x7f4f3c146f30 0x7f4f3c0b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f3affd640 1 -- 172.21.15.130:0/2325632754 >> v1:172.21.15.164:6789/0 conn(0x7f4f3c0d1090 legacy=0x7f4f3c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:27.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.339+0000 7f4f3affd640 1 -- 172.21.15.130:0/2325632754 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0b6610 con 0x7f4f3c0d1750 2023-09-13T06:13:27.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f3affd640 1 --2- 172.21.15.130:0/2325632754 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f3c0d1750 0x7f4f3c15d960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0097c0 tx=0x7f4f2c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47e95087ada7ee07 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:27.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f3a7fc640 1 -- 172.21.15.130:0/2325632754 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0ab650 con 0x7f4f3c0d1750 2023-09-13T06:13:27.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f3a7fc640 1 -- 172.21.15.130:0/2325632754 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c0ab7b0 con 0x7f4f3c0d1750 2023-09-13T06:13:27.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f3a7fc640 1 -- 172.21.15.130:0/2325632754 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0abb40 con 0x7f4f3c0d1750 2023-09-13T06:13:27.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f41303640 1 -- 172.21.15.130:0/2325632754 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f3c0d1750 msgr2=0x7f4f3c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:27.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f41303640 1 --2- 172.21.15.130:0/2325632754 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f3c0d1750 0x7f4f3c15d960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0097c0 tx=0x7f4f2c01c450 comp rx=0 tx=0).stop 2023-09-13T06:13:27.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f41303640 1 -- 172.21.15.130:0/2325632754 shutdown_connections 2023-09-13T06:13:27.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f41303640 1 --2- 172.21.15.130:0/2325632754 >> v2:172.21.15.164:3300/0 conn(0x7f4f3c146f30 0x7f4f3c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f41303640 1 --2- 172.21.15.130:0/2325632754 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f3c0d1750 0x7f4f3c15d960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f41303640 1 -- 172.21.15.130:0/2325632754 >> 172.21.15.130:0/2325632754 conn(0x7f4f3c06f170 msgr2=0x7f4f3c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:27.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f41303640 1 -- 172.21.15.130:0/2325632754 shutdown_connections 2023-09-13T06:13:27.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.343+0000 7f4f41303640 1 -- 172.21.15.130:0/2325632754 wait complete. 2023-09-13T06:13:27.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f41303640 1 Processor -- start 2023-09-13T06:13:27.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f41303640 1 -- start start 2023-09-13T06:13:27.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f41303640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f3c0d1090 0x7f4f3c13efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:27.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f41303640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f3c0d1750 0x7f4f3c15c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:27.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f41303640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f3c146f30 0x7f4f3c1665e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:27.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f41303640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c144510 con 0x7f4f3c0d1090 2023-09-13T06:13:27.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f41303640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c166b20 con 0x7f4f3c146f30 2023-09-13T06:13:27.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f41303640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c15c9d0 con 0x7f4f3c0d1750 2023-09-13T06:13:27.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f3c0d1090 0x7f4f3c13efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:27.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f3c0d1090 0x7f4f3c13efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40174/0 (socket says 172.21.15.130:40174) 2023-09-13T06:13:27.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f3affd640 1 -- 172.21.15.130:0/748719905 learned_addr learned my addr 172.21.15.130:0/748719905 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:27.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f327fc640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f3c0d1750 0x7f4f3c15c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:27.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f3b7fe640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f3c146f30 0x7f4f3c1665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:27.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f3affd640 1 -- 172.21.15.130:0/748719905 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f3c0d1750 msgr2=0x7f4f3c15c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:27.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f3affd640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f3c0d1750 0x7f4f3c15c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f3affd640 1 -- 172.21.15.130:0/748719905 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f3c146f30 msgr2=0x7f4f3c1665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:27.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f3affd640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f3c146f30 0x7f4f3c1665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f3affd640 1 -- 172.21.15.130:0/748719905 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c009420 con 0x7f4f3c0d1090 2023-09-13T06:13:27.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f3affd640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f3c0d1090 0x7f4f3c13efc0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0ad040 tx=0x7f4f2c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:27.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f33fff640 1 -- 172.21.15.130:0/748719905 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0bf610 con 0x7f4f3c0d1090 2023-09-13T06:13:27.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f33fff640 1 -- 172.21.15.130:0/748719905 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c0bf790 con 0x7f4f3c0d1090 2023-09-13T06:13:27.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f41303640 1 -- 172.21.15.130:0/748719905 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c0b7e40 con 0x7f4f3c0d1090 2023-09-13T06:13:27.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f33fff640 1 -- 172.21.15.130:0/748719905 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0bfb40 con 0x7f4f3c0d1090 2023-09-13T06:13:27.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.347+0000 7f4f41303640 1 -- 172.21.15.130:0/748719905 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c143ec0 con 0x7f4f3c0d1090 2023-09-13T06:13:27.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.351+0000 7f4f41303640 1 -- 172.21.15.130:0/748719905 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c0618a0 con 0x7f4f3c0d1090 2023-09-13T06:13:27.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.351+0000 7f4f33fff640 1 -- 172.21.15.130:0/748719905 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4f2c0b5400 con 0x7f4f3c0d1090 2023-09-13T06:13:27.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.351+0000 7f4f33fff640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f1c065b20 0x7f4f1c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:27.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.351+0000 7f4f33fff640 1 -- 172.21.15.130:0/748719905 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f2c11e440 con 0x7f4f3c0d1090 2023-09-13T06:13:27.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.351+0000 7f4f327fc640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f1c065b20 0x7f4f1c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:27.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.351+0000 7f4f327fc640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f1c065b20 0x7f4f1c067fe0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c145f10 tx=0x7f4f24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:27.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.355+0000 7f4f33fff640 1 -- 172.21.15.130:0/748719905 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4f2c0ebd80 con 0x7f4f3c0d1090 2023-09-13T06:13:27.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.503+0000 7f4f41303640 1 -- 172.21.15.130:0/748719905 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4f3c067180 con 0x7f4f3c0d1090 2023-09-13T06:13:27.507 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f33fff640 1 -- 172.21.15.130:0/748719905 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v190) v1 ==== 81+0+34050 (secure 0 0 0) 0x7f4f2c0ef3a0 con 0x7f4f3c0d1090 2023-09-13T06:13:27.508 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:27.508 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:27.509 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 190, 2023-09-13T06:13:27.509 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:13:27.509 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:13:27.509 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:13:22.489989+0000", 2023-09-13T06:13:27.510 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:13:27.510 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:13:27.510 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:13:27.510 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:13:27.511 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:13:27.511 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:13:27.511 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:13:27.511 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:13:27.512 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:13:27.512 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:27.512 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:13:27.512 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:13:27.512 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:13:27.513 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:13:27.513 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:13:27.513 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 23, 2023-09-13T06:13:27.513 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:13:27.513 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:13:27.514 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:13:27.514 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:13:27.514 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:13:27.514 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:13:27.514 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.515 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:13:27.515 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:13:27.515 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:13:27.515 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:27.515 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:27.516 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:27.516 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:27.517 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:27.517 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:27.517 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:27.517 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:27.517 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:27.518 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:27.518 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:27.518 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:27.518 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:13:27.518 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:13:27.519 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:13:27.519 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:13:27.519 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:13:27.519 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:27.519 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:27.520 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:27.520 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:27.520 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:27.520 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:27.520 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:27.520 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.521 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:13:27.521 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:27.521 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:27.521 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:27.521 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:27.522 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:27.522 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:27.522 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:27.522 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:27.522 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:27.523 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:27.523 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:27.523 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:27.523 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:27.523 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:27.524 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:27.524 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:27.524 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:27.524 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:27.524 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:27.524 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:27.525 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:27.525 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:27.525 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:27.525 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:27.525 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:27.526 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:27.526 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.526 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:27.526 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:27.526 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:27.527 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:27.527 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:27.527 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:27.527 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:27.527 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:27.527 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:27.528 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:27.528 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:27.528 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:27.528 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:13:27.528 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:13:27.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.529 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:27.529 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:13:27.529 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.529 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:27.530 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:13:27.530 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:13:27.530 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:13:27.530 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:27.530 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:27.530 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:27.531 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:27.531 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:27.531 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.531 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.531 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.531 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 22, 2023-09-13T06:13:27.532 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:13:27.532 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:49.873320+0000", 2023-09-13T06:13:27.532 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:27.532 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:27.532 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:27.533 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:27.533 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:27.533 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:27.533 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:27.533 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:27.534 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:27.534 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:27.534 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:27.534 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:27.534 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:13:27.534 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:13:27.535 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:13:27.535 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:13:27.535 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:13:27.535 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:27.535 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:27.536 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:27.536 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:27.536 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:27.536 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:27.536 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:27.537 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.537 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "186", 2023-09-13T06:13:27.537 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:27.537 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:27.537 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:27.537 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:27.538 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:27.538 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:27.538 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:27.538 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:27.538 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:27.539 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:27.539 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:27.539 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:27.539 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:27.539 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:27.540 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:27.540 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:27.540 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:27.540 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:27.540 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:27.540 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:27.541 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:27.541 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:27.541 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:27.541 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:27.541 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:27.542 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:27.542 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.542 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:27.542 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:27.542 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:27.543 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:27.543 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:27.543 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:27.543 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:27.543 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:27.544 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:27.544 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:27.544 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:27.544 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:27.544 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:13:27.545 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:13:27.545 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:13:27.545 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.545 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:27.545 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:27.546 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:13:27.546 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.546 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.546 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:27.546 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:13:27.546 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:13:27.547 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:27.547 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:27.547 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:27.547 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:27.547 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:27.548 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:27.548 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.548 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.548 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.548 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 23, 2023-09-13T06:13:27.549 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:13:27.549 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:51.142196+0000", 2023-09-13T06:13:27.549 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:27.549 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:27.549 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:27.549 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:27.550 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:27.550 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:27.550 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:27.550 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:27.550 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:27.551 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:27.551 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:27.551 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:27.551 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:13:27.551 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:13:27.551 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:13:27.552 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:13:27.552 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:13:27.552 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:27.552 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:27.552 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:27.553 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:27.553 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:27.553 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:27.553 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:27.553 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.554 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "190", 2023-09-13T06:13:27.554 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:27.554 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:27.554 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:27.554 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:27.555 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:27.555 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:27.555 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:27.555 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:27.555 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:27.555 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:13:27.556 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:27.556 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:27.556 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:27.556 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:27.556 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:27.557 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:27.557 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:27.557 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:27.557 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:27.557 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:27.558 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:27.558 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:27.558 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:27.558 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:27.558 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:27.559 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:27.559 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.559 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:27.559 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:27.559 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:27.559 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:27.560 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:27.560 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:27.560 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:27.560 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:27.561 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:27.561 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:27.561 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:27.561 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:27.561 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:13:27.562 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:13:27.562 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.562 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:27.562 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:27.562 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:13:27.563 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.563 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.563 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:27.563 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:13:27.563 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:13:27.563 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:27.564 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:13:27.564 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:13:27.564 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:27.564 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:27.564 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:27.565 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.565 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.565 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:27.565 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:13:27.565 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.565 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:27.566 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:27.566 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:27.566 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:27.566 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:27.566 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:27.567 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:27.567 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:27.567 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:27.567 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:27.567 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:27.568 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:27.568 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:27.568 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.568 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.568 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.568 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:13:27.569 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:27.569 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.569 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.569 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.569 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:13:27.569 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:27.570 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.570 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.570 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.570 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:27.570 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:13:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:27.571 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:13:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:27.572 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.573 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:13:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.574 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:13:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.575 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.576 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:13:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.577 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:13:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.578 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:13:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:13:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:13:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:13:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:27.579 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:27.580 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:27.581 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:27.582 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:13:27.583 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:13:27.584 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.585 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:13:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.586 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:13:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.587 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.588 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:13:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.589 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:13:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:27.590 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:13:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:13:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.592 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:13:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:13:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:13:27.593 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:13:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.594 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:27.595 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:27.596 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.597 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:13:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.598 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:13:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.599 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:13:27.600 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:13:27.601 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:27.602 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:13:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:27.603 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:13:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:27.604 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.605 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:13:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.606 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:13:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.607 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:13:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:13:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:13:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:13:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:27.608 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.609 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:27.610 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:27.611 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.612 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:13:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:13:27.613 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:27.614 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:13:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:13:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.616 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.617 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:13:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.618 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:13:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:27.619 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:13:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:27.620 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:13:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.621 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:13:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:13:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:13:27.622 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:13:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:27.624 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:27.625 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.626 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:13:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.627 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:13:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.628 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.629 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:13:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.630 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:13:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.631 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:13:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:27.632 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:13:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:27.633 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.634 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:13:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.635 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:13:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.636 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:13:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:13:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:13:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:13:27.637 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.638 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:27.639 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:27.640 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.641 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:13:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.642 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:13:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.643 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:13:27.644 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:13:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:27.645 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.646 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:13:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.647 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:13:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.648 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.649 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:13:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.650 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:13:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.651 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:13:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:13:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:13:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:13:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:27.652 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:27.653 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:27.654 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:27.655 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:13:27.656 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:13:27.657 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.658 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:13:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:13:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.661 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:13:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.662 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:13:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.663 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:13:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:27.664 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:13:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:27.665 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:13:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:13:27.666 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:13:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:13:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.667 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:27.668 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:27.669 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.670 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:13:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.671 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:13:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.672 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.673 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:13:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:13:27.674 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:27.675 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:13:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.676 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:13:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.677 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.678 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:13:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.679 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:13:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.680 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:13:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:13:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:13:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:13:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:27.681 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:13:27.682 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.683 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:27.683 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:27.683 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:27.683 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:27.683 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:27.684 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:27.684 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:13:27.684 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:27.684 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.684 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.685 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:27.685 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:27.685 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:27.685 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:27.685 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:27.685 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:27.686 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:13:27.686 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:27.686 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.686 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.686 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:27.687 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:27.687 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:27.687 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:27.687 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:27.687 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:27.688 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:13:27.688 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:27.688 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.688 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.688 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:27.688 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:27.689 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:27.689 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:27.689 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:27.689 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:27.689 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:13:27.689 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:27.690 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.690 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.690 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:27.690 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:27.690 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:27.691 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:27.691 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:27.691 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:27.691 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:13:27.691 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:27.692 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.692 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.692 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:27.692 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:27.692 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:27.692 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:27.693 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:27.693 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:27.693 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:13:27.693 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:27.693 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.693 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.694 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:27.694 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:27.694 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:27.694 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:27.694 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:27.695 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:27.695 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:13:27.695 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:27.695 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.695 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:27.696 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:27.696 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:27.696 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:27.696 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:27.696 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:27.696 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:27.697 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:13:27.697 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:27.697 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.697 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:27.697 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:13:27.698 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:13:27.698 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:13:27.698 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:13:27.698 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:13:27.698 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:13:27.698 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:13:27.699 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:13:27.699 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:13:27.699 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:13:27.699 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:13:27.699 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:13:27.700 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:13:27.700 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:13:27.700 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.700 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:27.700 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:13:27.700 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:13:27.701 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:13:27.701 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:13:27.701 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:13:27.701 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:13:27.701 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:13:27.701 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:13:27.702 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:13:27.702 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:13:27.702 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:13:27.702 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:27.702 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:27.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 -- 172.21.15.130:0/748719905 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f1c065b20 msgr2=0x7f4f1c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:27.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f1c065b20 0x7f4f1c067fe0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c145f10 tx=0x7f4f24009040 comp rx=0 tx=0).stop 2023-09-13T06:13:27.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 -- 172.21.15.130:0/748719905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f3c0d1090 msgr2=0x7f4f3c13efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:27.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f3c0d1090 0x7f4f3c13efc0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0ad040 tx=0x7f4f2c01ac90 comp rx=0 tx=0).stop 2023-09-13T06:13:27.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 -- 172.21.15.130:0/748719905 shutdown_connections 2023-09-13T06:13:27.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4f1c065b20 0x7f4f1c067fe0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f3c146f30 0x7f4f3c1665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f3c0d1750 0x7f4f3c15c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 --2- 172.21.15.130:0/748719905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f3c0d1090 0x7f4f3c13efc0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 -- 172.21.15.130:0/748719905 >> 172.21.15.130:0/748719905 conn(0x7f4f3c06f170 msgr2=0x7f4f3c0b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:27.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 -- 172.21.15.130:0/748719905 shutdown_connections 2023-09-13T06:13:27.706 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.507+0000 7f4f41303640 1 -- 172.21.15.130:0/748719905 wait complete. 2023-09-13T06:13:27.707 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-09-13T06:13:27.707 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-09-13T06:13:27.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.843+0000 7f1291582640 1 Processor -- start 2023-09-13T06:13:27.846 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.843+0000 7f1291582640 1 -- start start 2023-09-13T06:13:27.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f1291582640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f128c146f30 0x7f128c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:27.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f1291582640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c0b63c0 con 0x7f128c0d1090 2023-09-13T06:13:27.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f1291582640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c0d0c20 con 0x7f128c0d1750 2023-09-13T06:13:27.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f1291582640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c15dea0 con 0x7f128c146f30 2023-09-13T06:13:27.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f12827fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f128c0d1090 0x7f128c0b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35992/0 (socket says 172.21.15.130:35992) 2023-09-13T06:13:27.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f12827fc640 1 -- 172.21.15.130:0/2839018598 learned_addr learned my addr 172.21.15.130:0/2839018598 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:27.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f128b7fe640 1 --2- 172.21.15.130:0/2839018598 >> v2:172.21.15.164:3300/0 conn(0x7f128c146f30 0x7f128c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:27.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f128a7fc640 1 -- 172.21.15.130:0/2839018598 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082732335 0 0) 0x7f128c0b63c0 con 0x7f128c0d1090 2023-09-13T06:13:27.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f128a7fc640 1 -- 172.21.15.130:0/2839018598 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1278003530 con 0x7f128c0d1090 2023-09-13T06:13:27.849 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f128a7fc640 1 -- 172.21.15.130:0/2839018598 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918250888 0 0) 0x7f128c0d0c20 con 0x7f128c0d1750 2023-09-13T06:13:27.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f128a7fc640 1 -- 172.21.15.130:0/2839018598 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f128c0b63c0 con 0x7f128c0d1750 2023-09-13T06:13:27.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f128b7fe640 1 -- 172.21.15.130:0/2839018598 >> v1:172.21.15.164:6789/0 conn(0x7f128c0d1750 legacy=0x7f128c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:27.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f128b7fe640 1 -- 172.21.15.130:0/2839018598 >> v1:172.21.15.130:6789/0 conn(0x7f128c0d1090 legacy=0x7f128c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:27.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.847+0000 7f128b7fe640 1 -- 172.21.15.130:0/2839018598 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c0b6610 con 0x7f128c146f30 2023-09-13T06:13:27.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f128b7fe640 1 --2- 172.21.15.130:0/2839018598 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f128c146f30 0x7f128c15d960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1284009d90 tx=0x7f128401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b70946e6a81ce04 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:27.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f128a7fc640 1 -- 172.21.15.130:0/2839018598 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12840a5950 con 0x7f128c146f30 2023-09-13T06:13:27.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f128a7fc640 1 -- 172.21.15.130:0/2839018598 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12840a5ab0 con 0x7f128c146f30 2023-09-13T06:13:27.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f128a7fc640 1 -- 172.21.15.130:0/2839018598 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12840a5e40 con 0x7f128c146f30 2023-09-13T06:13:27.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f1291582640 1 -- 172.21.15.130:0/2839018598 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f128c146f30 msgr2=0x7f128c15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:27.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f1291582640 1 --2- 172.21.15.130:0/2839018598 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f128c146f30 0x7f128c15d960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1284009d90 tx=0x7f128401c890 comp rx=0 tx=0).stop 2023-09-13T06:13:27.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f1291582640 1 -- 172.21.15.130:0/2839018598 shutdown_connections 2023-09-13T06:13:27.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f1291582640 1 --2- 172.21.15.130:0/2839018598 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f128c146f30 0x7f128c15d960 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f1291582640 1 -- 172.21.15.130:0/2839018598 >> 172.21.15.130:0/2839018598 conn(0x7f128c06f170 msgr2=0x7f128c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:27.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f1291582640 1 -- 172.21.15.130:0/2839018598 shutdown_connections 2023-09-13T06:13:27.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f1291582640 1 -- 172.21.15.130:0/2839018598 wait complete. 2023-09-13T06:13:27.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f1291582640 1 Processor -- start 2023-09-13T06:13:27.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.851+0000 7f1291582640 1 -- start start 2023-09-13T06:13:27.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1291582640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f128c0d1090 0x7f128c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:27.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1291582640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f128c0d1750 0x7f128c13c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:27.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1291582640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f128c146f30 0x7f128c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:27.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1291582640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c13cd60 con 0x7f128c0d1090 2023-09-13T06:13:27.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1291582640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c13d040 con 0x7f128c0d1750 2023-09-13T06:13:27.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1291582640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c13d320 con 0x7f128c146f30 2023-09-13T06:13:27.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f128affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f128c0d1090 0x7f128c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:27.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f128affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f128c0d1090 0x7f128c1595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40176/0 (socket says 172.21.15.130:40176) 2023-09-13T06:13:27.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f128affd640 1 -- 172.21.15.130:0/890430351 learned_addr learned my addr 172.21.15.130:0/890430351 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:27.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f12827fc640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f128c0d1750 0x7f128c13c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:27.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f128b7fe640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f128c146f30 0x7f128c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:27.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f128affd640 1 -- 172.21.15.130:0/890430351 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f128c146f30 msgr2=0x7f128c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:27.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f128affd640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f128c146f30 0x7f128c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f128affd640 1 -- 172.21.15.130:0/890430351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f128c0d1750 msgr2=0x7f128c13c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:27.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f128affd640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f128c0d1750 0x7f128c13c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:27.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f128affd640 1 -- 172.21.15.130:0/890430351 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1284009a70 con 0x7f128c0d1090 2023-09-13T06:13:27.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f128affd640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f128c0d1090 0x7f128c1595a0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c490 tx=0x7f127c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:27.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1283fff640 1 -- 172.21.15.130:0/890430351 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c0052d0 con 0x7f128c0d1090 2023-09-13T06:13:27.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1283fff640 1 -- 172.21.15.130:0/890430351 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c005430 con 0x7f128c0d1090 2023-09-13T06:13:27.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1283fff640 1 -- 172.21.15.130:0/890430351 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c012870 con 0x7f128c0d1090 2023-09-13T06:13:27.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1291582640 1 -- 172.21.15.130:0/890430351 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c13d600 con 0x7f128c0d1090 2023-09-13T06:13:27.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1291582640 1 -- 172.21.15.130:0/890430351 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c1560c0 con 0x7f128c0d1090 2023-09-13T06:13:27.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1291582640 1 -- 172.21.15.130:0/890430351 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c156280 con 0x7f128c0d1090 2023-09-13T06:13:27.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.855+0000 7f1283fff640 1 -- 172.21.15.130:0/890430351 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f127c0129d0 con 0x7f128c0d1090 2023-09-13T06:13:27.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.859+0000 7f1283fff640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f126c065b20 0x7f126c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:27.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.859+0000 7f1283fff640 1 -- 172.21.15.130:0/890430351 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f127c082d50 con 0x7f128c0d1090 2023-09-13T06:13:27.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.859+0000 7f12827fc640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f126c065b20 0x7f126c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:27.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.859+0000 7f12827fc640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f126c065b20 0x7f126c067fe0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f128c160130 tx=0x7f1274007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:27.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:27.863+0000 7f1283fff640 1 -- 172.21.15.130:0/890430351 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f127c050740 con 0x7f128c0d1090 2023-09-13T06:13:28.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.007+0000 7f1291582640 1 -- 172.21.15.130:0/890430351 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f128c0618a0 con 0x7f128c0d1090 2023-09-13T06:13:28.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1283fff640 1 -- 172.21.15.130:0/890430351 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v190) v1 ==== 81+0+34050 (secure 0 0 0) 0x7f127c053d60 con 0x7f128c0d1090 2023-09-13T06:13:28.011 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:28.012 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:28.012 INFO:teuthology.orchestra.run.smithi130.stdout: "epoch": 190, 2023-09-13T06:13:28.012 INFO:teuthology.orchestra.run.smithi130.stdout: "fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", 2023-09-13T06:13:28.012 INFO:teuthology.orchestra.run.smithi130.stdout: "created": "2023-09-13T06:01:07.525413+0000", 2023-09-13T06:13:28.012 INFO:teuthology.orchestra.run.smithi130.stdout: "modified": "2023-09-13T06:13:22.489989+0000", 2023-09-13T06:13:28.013 INFO:teuthology.orchestra.run.smithi130.stdout: "last_up_change": "2023-09-13T06:01:13.090794+0000", 2023-09-13T06:13:28.013 INFO:teuthology.orchestra.run.smithi130.stdout: "last_in_change": "2023-09-13T06:01:10.076099+0000", 2023-09-13T06:13:28.013 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-13T06:13:28.013 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_num": 5799936, 2023-09-13T06:13:28.013 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_set": [ 2023-09-13T06:13:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: "pglog_hardlimit", 2023-09-13T06:13:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: "purged_snapdirs", 2023-09-13T06:13:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_deletes", 2023-09-13T06:13:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: "sortbitwise" 2023-09-13T06:13:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:28.014 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_version": 4, 2023-09-13T06:13:28.015 INFO:teuthology.orchestra.run.smithi130.stdout: "full_ratio": 0.69999998807907104, 2023-09-13T06:13:28.015 INFO:teuthology.orchestra.run.smithi130.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-09-13T06:13:28.015 INFO:teuthology.orchestra.run.smithi130.stdout: "nearfull_ratio": 0.60000002384185791, 2023-09-13T06:13:28.015 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_snapshot": "", 2023-09-13T06:13:28.015 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_max": 23, 2023-09-13T06:13:28.015 INFO:teuthology.orchestra.run.smithi130.stdout: "max_osd": 8, 2023-09-13T06:13:28.016 INFO:teuthology.orchestra.run.smithi130.stdout: "require_min_compat_client": "luminous", 2023-09-13T06:13:28.016 INFO:teuthology.orchestra.run.smithi130.stdout: "min_compat_client": "jewel", 2023-09-13T06:13:28.016 INFO:teuthology.orchestra.run.smithi130.stdout: "require_osd_release": "reef", 2023-09-13T06:13:28.016 INFO:teuthology.orchestra.run.smithi130.stdout: "allow_crimson": false, 2023-09-13T06:13:28.016 INFO:teuthology.orchestra.run.smithi130.stdout: "pools": [ 2023-09-13T06:13:28.016 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.017 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 1, 2023-09-13T06:13:28.017 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": ".mgr", 2023-09-13T06:13:28.017 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:01:14.595128+0000", 2023-09-13T06:13:28.017 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:28.017 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:28.018 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:28.018 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:28.018 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:28.018 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:28.018 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:28.019 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 1, 2023-09-13T06:13:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 1, 2023-09-13T06:13:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 1, 2023-09-13T06:13:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 1, 2023-09-13T06:13:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 1, 2023-09-13T06:13:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:28.021 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:28.021 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:28.021 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:28.021 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:28.021 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:28.022 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.022 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "111", 2023-09-13T06:13:28.022 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:28.022 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:28.022 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:28.023 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:28.023 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:28.023 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:28.023 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:28.023 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:28.023 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:28.024 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:28.024 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:28.024 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:28.024 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:28.024 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:28.025 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:28.025 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:28.025 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:28.025 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:28.025 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:28.025 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:28.026 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:28.026 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:28.026 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:28.026 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:28.026 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:28.027 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_max": 32, 2023-09-13T06:13:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 1 2023-09-13T06:13:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: "mgr": {} 2023-09-13T06:13:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 8, 2023-09-13T06:13:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 8, 2023-09-13T06:13:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 0.25, 2023-09-13T06:13:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:28.032 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.032 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.032 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.032 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 22, 2023-09-13T06:13:28.032 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_metadata", 2023-09-13T06:13:28.033 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:49.873320+0000", 2023-09-13T06:13:28.033 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:28.033 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:28.033 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:28.033 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:28.033 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:28.034 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:28.034 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:28.034 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:28.034 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:28.034 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:28.035 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:28.035 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:28.035 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 32, 2023-09-13T06:13:28.035 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 32, 2023-09-13T06:13:28.037 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 32, 2023-09-13T06:13:28.037 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 32, 2023-09-13T06:13:28.037 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 32, 2023-09-13T06:13:28.037 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:28.037 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:28.038 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:28.038 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:28.038 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:28.038 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:28.038 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:28.039 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.039 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "186", 2023-09-13T06:13:28.039 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:28.039 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:28.039 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:28.040 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:28.040 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:28.040 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:28.040 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:28.040 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:28.040 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 0, 2023-09-13T06:13:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:28.041 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:28.042 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:28.042 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:28.042 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:28.042 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:28.042 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:28.043 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:28.044 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.044 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:28.044 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:28.044 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:28.044 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:28.045 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:28.045 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:28.045 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:28.045 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:28.045 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:28.045 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:28.046 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:28.046 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:28.046 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_bias": 4, 2023-09-13T06:13:28.046 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 16, 2023-09-13T06:13:28.046 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_priority": 5 2023-09-13T06:13:28.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.047 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:28.047 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:28.047 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": "cephfs" 2023-09-13T06:13:28.047 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.047 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.048 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:28.048 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 2, 2023-09-13T06:13:28.048 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 2, 2023-09-13T06:13:28.048 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:28.048 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 2, 2023-09-13T06:13:28.048 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 2, 2023-09-13T06:13:28.049 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:28.049 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:28.049 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:28.049 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.049 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: "pool": 23, 2023-09-13T06:13:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_name": "cephfs_data", 2023-09-13T06:13:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: "create_time": "2023-09-13T06:12:51.142196+0000", 2023-09-13T06:13:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: "flags": 1, 2023-09-13T06:13:28.050 INFO:teuthology.orchestra.run.smithi130.stdout: "flags_names": "hashpspool", 2023-09-13T06:13:28.051 INFO:teuthology.orchestra.run.smithi130.stdout: "type": 1, 2023-09-13T06:13:28.051 INFO:teuthology.orchestra.run.smithi130.stdout: "size": 2, 2023-09-13T06:13:28.051 INFO:teuthology.orchestra.run.smithi130.stdout: "min_size": 1, 2023-09-13T06:13:28.051 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_rule": 0, 2023-09-13T06:13:28.051 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_count": 0, 2023-09-13T06:13:28.052 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_target": 0, 2023-09-13T06:13:28.052 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_barrier": 0, 2023-09-13T06:13:28.052 INFO:teuthology.orchestra.run.smithi130.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-13T06:13:28.052 INFO:teuthology.orchestra.run.smithi130.stdout: "object_hash": 2, 2023-09-13T06:13:28.052 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_autoscale_mode": "off", 2023-09-13T06:13:28.052 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num": 64, 2023-09-13T06:13:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num": 64, 2023-09-13T06:13:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_placement_num_target": 64, 2023-09-13T06:13:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_target": 64, 2023-09-13T06:13:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_pending": 64, 2023-09-13T06:13:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: "last_pg_merge_meta": { 2023-09-13T06:13:28.053 INFO:teuthology.orchestra.run.smithi130.stdout: "source_pgid": "0.0", 2023-09-13T06:13:28.054 INFO:teuthology.orchestra.run.smithi130.stdout: "ready_epoch": 0, 2023-09-13T06:13:28.054 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_started": 0, 2023-09-13T06:13:28.054 INFO:teuthology.orchestra.run.smithi130.stdout: "last_epoch_clean": 0, 2023-09-13T06:13:28.054 INFO:teuthology.orchestra.run.smithi130.stdout: "source_version": "0'0", 2023-09-13T06:13:28.054 INFO:teuthology.orchestra.run.smithi130.stdout: "target_version": "0'0" 2023-09-13T06:13:28.055 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.055 INFO:teuthology.orchestra.run.smithi130.stdout: "last_change": "190", 2023-09-13T06:13:28.055 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend": "0", 2023-09-13T06:13:28.055 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-13T06:13:28.055 INFO:teuthology.orchestra.run.smithi130.stdout: "last_force_op_resend_preluminous": "0", 2023-09-13T06:13:28.056 INFO:teuthology.orchestra.run.smithi130.stdout: "auid": 0, 2023-09-13T06:13:28.056 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_mode": "selfmanaged", 2023-09-13T06:13:28.056 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_seq": 0, 2023-09-13T06:13:28.056 INFO:teuthology.orchestra.run.smithi130.stdout: "snap_epoch": 0, 2023-09-13T06:13:28.056 INFO:teuthology.orchestra.run.smithi130.stdout: "pool_snaps": [], 2023-09-13T06:13:28.057 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps": "[]", 2023-09-13T06:13:28.057 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_bytes": 33554432, 2023-09-13T06:13:28.057 INFO:teuthology.orchestra.run.smithi130.stdout: "quota_max_objects": 0, 2023-09-13T06:13:28.057 INFO:teuthology.orchestra.run.smithi130.stdout: "tiers": [], 2023-09-13T06:13:28.057 INFO:teuthology.orchestra.run.smithi130.stdout: "tier_of": -1, 2023-09-13T06:13:28.057 INFO:teuthology.orchestra.run.smithi130.stdout: "read_tier": -1, 2023-09-13T06:13:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: "write_tier": -1, 2023-09-13T06:13:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_mode": "none", 2023-09-13T06:13:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_bytes": 0, 2023-09-13T06:13:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: "target_max_objects": 0, 2023-09-13T06:13:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-13T06:13:28.058 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-13T06:13:28.059 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-13T06:13:28.059 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_flush_age": 0, 2023-09-13T06:13:28.059 INFO:teuthology.orchestra.run.smithi130.stdout: "cache_min_evict_age": 0, 2023-09-13T06:13:28.059 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profile": "", 2023-09-13T06:13:28.059 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_params": { 2023-09-13T06:13:28.060 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "none" 2023-09-13T06:13:28.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.060 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_period": 0, 2023-09-13T06:13:28.060 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_count": 0, 2023-09-13T06:13:28.060 INFO:teuthology.orchestra.run.smithi130.stdout: "use_gmt_hitset": true, 2023-09-13T06:13:28.060 INFO:teuthology.orchestra.run.smithi130.stdout: "min_read_recency_for_promote": 0, 2023-09-13T06:13:28.061 INFO:teuthology.orchestra.run.smithi130.stdout: "min_write_recency_for_promote": 0, 2023-09-13T06:13:28.061 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_grade_decay_rate": 0, 2023-09-13T06:13:28.061 INFO:teuthology.orchestra.run.smithi130.stdout: "hit_set_search_last_n": 0, 2023-09-13T06:13:28.061 INFO:teuthology.orchestra.run.smithi130.stdout: "grade_table": [], 2023-09-13T06:13:28.061 INFO:teuthology.orchestra.run.smithi130.stdout: "stripe_width": 0, 2023-09-13T06:13:28.062 INFO:teuthology.orchestra.run.smithi130.stdout: "expected_num_objects": 0, 2023-09-13T06:13:28.062 INFO:teuthology.orchestra.run.smithi130.stdout: "fast_read": false, 2023-09-13T06:13:28.062 INFO:teuthology.orchestra.run.smithi130.stdout: "options": { 2023-09-13T06:13:28.062 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_num_min": 64, 2023-09-13T06:13:28.062 INFO:teuthology.orchestra.run.smithi130.stdout: "target_size_ratio": 0.89999997615814209 2023-09-13T06:13:28.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.063 INFO:teuthology.orchestra.run.smithi130.stdout: "application_metadata": { 2023-09-13T06:13:28.063 INFO:teuthology.orchestra.run.smithi130.stdout: "cephfs": { 2023-09-13T06:13:28.063 INFO:teuthology.orchestra.run.smithi130.stdout: "data": "cephfs" 2023-09-13T06:13:28.063 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.064 INFO:teuthology.orchestra.run.smithi130.stdout: "read_balance": { 2023-09-13T06:13:28.064 INFO:teuthology.orchestra.run.smithi130.stdout: "score_acting": 1.3799999952316284, 2023-09-13T06:13:28.064 INFO:teuthology.orchestra.run.smithi130.stdout: "score_stable": 1.3799999952316284, 2023-09-13T06:13:28.064 INFO:teuthology.orchestra.run.smithi130.stdout: "optimal_score": 1, 2023-09-13T06:13:28.064 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_acting": 1.3799999952316284, 2023-09-13T06:13:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: "raw_score_stable": 1.3799999952316284, 2023-09-13T06:13:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity_weighted": 1, 2023-09-13T06:13:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity": 1, 2023-09-13T06:13:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: "average_primary_affinity_weighted": 1 2023-09-13T06:13:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.065 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.066 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:28.066 INFO:teuthology.orchestra.run.smithi130.stdout: "osds": [ 2023-09-13T06:13:28.066 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.066 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:28.066 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:28.067 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:28.067 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:28.067 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:28.067 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:28.067 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:28.067 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:28.068 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.069 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.069 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.069 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6800", 2023-09-13T06:13:28.069 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:28.069 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.070 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.070 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.070 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6801", 2023-09-13T06:13:28.070 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:28.070 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.070 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.071 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:28.071 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.071 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.071 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.072 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6802", 2023-09-13T06:13:28.072 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:28.072 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.072 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.072 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.072 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6803", 2023-09-13T06:13:28.073 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:28.073 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.073 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.073 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:28.074 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.074 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.074 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.074 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6806", 2023-09-13T06:13:28.074 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6807", 2023-09-13T06:13:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:28.075 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.076 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.076 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:28.076 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.076 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.076 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.077 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6804", 2023-09-13T06:13:28.077 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:28.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.077 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.078 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6805", 2023-09-13T06:13:28.078 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3085363071 2023-09-13T06:13:28.078 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.078 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.079 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6801/3085363071", 2023-09-13T06:13:28.079 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6803/3085363071", 2023-09-13T06:13:28.079 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6807/3085363071", 2023-09-13T06:13:28.079 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6805/3085363071", 2023-09-13T06:13:28.079 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:28.079 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:28.080 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:28.080 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.080 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.080 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:28.081 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:28.081 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:28.081 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:28.081 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:28.081 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:28.081 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:28.082 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:28.082 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:28.082 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:28.082 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:28.082 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:28.083 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:28.083 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.083 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.083 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.083 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6814", 2023-09-13T06:13:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6817", 2023-09-13T06:13:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:28.085 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.086 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.086 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6820", 2023-09-13T06:13:28.086 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:28.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.086 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.087 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.087 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6823", 2023-09-13T06:13:28.087 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:28.087 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.087 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6830", 2023-09-13T06:13:28.088 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:28.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.089 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.089 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.089 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6831", 2023-09-13T06:13:28.089 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:28.089 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.090 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.090 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.090 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:28.090 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.090 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.091 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.091 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6826", 2023-09-13T06:13:28.091 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:28.091 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.091 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.092 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.092 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6828", 2023-09-13T06:13:28.092 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 338394792 2023-09-13T06:13:28.092 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.092 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.092 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6817/338394792", 2023-09-13T06:13:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6823/338394792", 2023-09-13T06:13:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6831/338394792", 2023-09-13T06:13:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6828/338394792", 2023-09-13T06:13:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:28.093 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:28.094 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:28.094 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.094 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.094 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:28.095 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:28.096 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:28.096 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:28.096 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:28.096 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:28.096 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:28.096 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6808", 2023-09-13T06:13:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.097 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.098 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.098 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6809", 2023-09-13T06:13:28.098 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:28.098 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.098 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.099 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:28.099 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.099 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.099 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6811", 2023-09-13T06:13:28.100 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:28.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.100 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.100 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.100 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6813", 2023-09-13T06:13:28.101 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:28.101 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.101 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.101 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:28.101 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.102 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.102 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.102 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6822", 2023-09-13T06:13:28.102 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:28.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6825", 2023-09-13T06:13:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.103 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.104 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:28.104 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.104 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.104 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6816", 2023-09-13T06:13:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.105 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6819", 2023-09-13T06:13:28.106 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3833443455 2023-09-13T06:13:28.106 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.106 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.106 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.106 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6809/3833443455", 2023-09-13T06:13:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6813/3833443455", 2023-09-13T06:13:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6825/3833443455", 2023-09-13T06:13:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6819/3833443455", 2023-09-13T06:13:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:28.107 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:28.108 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.108 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.108 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.108 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:28.108 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:28.109 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:28.109 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:28.109 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:28.109 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:28.109 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:28.109 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:28.110 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:28.110 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:28.110 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:28.110 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:28.110 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:28.111 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.111 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.111 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.111 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6810", 2023-09-13T06:13:28.111 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:28.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.112 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.112 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.112 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6812", 2023-09-13T06:13:28.112 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:28.112 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.113 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.113 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:28.113 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.113 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.114 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.114 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6815", 2023-09-13T06:13:28.114 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:28.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.114 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.114 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.115 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6818", 2023-09-13T06:13:28.115 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:28.115 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.115 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.116 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:28.116 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.116 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.116 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.116 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6827", 2023-09-13T06:13:28.116 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:28.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.117 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.117 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.117 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6829", 2023-09-13T06:13:28.117 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:28.117 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.118 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.118 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:28.118 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.118 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.119 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.119 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6821", 2023-09-13T06:13:28.119 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:28.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.119 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.119 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.120 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:6824", 2023-09-13T06:13:28.120 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2159009057 2023-09-13T06:13:28.120 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.120 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.121 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.130:6812/2159009057", 2023-09-13T06:13:28.121 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.130:6818/2159009057", 2023-09-13T06:13:28.121 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.130:6829/2159009057", 2023-09-13T06:13:28.121 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.130:6824/2159009057", 2023-09-13T06:13:28.121 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:28.121 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:28.122 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:28.122 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.122 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.122 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:28.123 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:28.123 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:28.123 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:28.123 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:28.123 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:28.123 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:28.124 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:28.124 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:28.124 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:28.124 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:28.124 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:28.125 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:28.125 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.125 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.125 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.125 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6800", 2023-09-13T06:13:28.125 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6801", 2023-09-13T06:13:28.126 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.127 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6802", 2023-09-13T06:13:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.128 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6803", 2023-09-13T06:13:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.130 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6806", 2023-09-13T06:13:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.131 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6807", 2023-09-13T06:13:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:28.132 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6804", 2023-09-13T06:13:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:28.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6805", 2023-09-13T06:13:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2197166496 2023-09-13T06:13:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.134 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6801/2197166496", 2023-09-13T06:13:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6803/2197166496", 2023-09-13T06:13:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2197166496", 2023-09-13T06:13:28.135 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2197166496", 2023-09-13T06:13:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.136 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:28.137 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:28.138 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6808", 2023-09-13T06:13:28.139 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6809", 2023-09-13T06:13:28.140 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.141 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6810", 2023-09-13T06:13:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.142 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6811", 2023-09-13T06:13:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.143 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.144 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6814", 2023-09-13T06:13:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.145 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6816", 2023-09-13T06:13:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:28.146 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6812", 2023-09-13T06:13:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.147 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6813", 2023-09-13T06:13:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 848118120 2023-09-13T06:13:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.148 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6809/848118120", 2023-09-13T06:13:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6811/848118120", 2023-09-13T06:13:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6816/848118120", 2023-09-13T06:13:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6813/848118120", 2023-09-13T06:13:28.149 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.150 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:28.151 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:28.152 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6815", 2023-09-13T06:13:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.154 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6817", 2023-09-13T06:13:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.155 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6818", 2023-09-13T06:13:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:28.156 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6819", 2023-09-13T06:13:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.157 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.158 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6822", 2023-09-13T06:13:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6823", 2023-09-13T06:13:28.159 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:28.160 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6820", 2023-09-13T06:13:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.161 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6821", 2023-09-13T06:13:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3345829618 2023-09-13T06:13:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.162 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6817/3345829618", 2023-09-13T06:13:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6819/3345829618", 2023-09-13T06:13:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6823/3345829618", 2023-09-13T06:13:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6821/3345829618", 2023-09-13T06:13:28.163 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.164 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-09-13T06:13:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "up": 1, 2023-09-13T06:13:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "in": 1, 2023-09-13T06:13:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "weight": 1, 2023-09-13T06:13:28.165 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_affinity": 1, 2023-09-13T06:13:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_begin": 0, 2023-09-13T06:13:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "last_clean_end": 0, 2023-09-13T06:13:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "up_from": 13, 2023-09-13T06:13:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "up_thru": 185, 2023-09-13T06:13:28.166 INFO:teuthology.orchestra.run.smithi130.stdout: "down_at": 0, 2023-09-13T06:13:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "lost_at": 0, 2023-09-13T06:13:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addrs": { 2023-09-13T06:13:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.167 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6824", 2023-09-13T06:13:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6825", 2023-09-13T06:13:28.168 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addrs": { 2023-09-13T06:13:28.169 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6826", 2023-09-13T06:13:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.170 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6827", 2023-09-13T06:13:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addrs": { 2023-09-13T06:13:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.172 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6830", 2023-09-13T06:13:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6831", 2023-09-13T06:13:28.173 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addrs": { 2023-09-13T06:13:28.174 INFO:teuthology.orchestra.run.smithi130.stdout: "addrvec": [ 2023-09-13T06:13:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v2", 2023-09-13T06:13:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6828", 2023-09-13T06:13:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.175 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-09-13T06:13:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.164:6829", 2023-09-13T06:13:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3372769909 2023-09-13T06:13:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.176 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "public_addr": "172.21.15.164:6825/3372769909", 2023-09-13T06:13:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "cluster_addr": "172.21.15.164:6827/3372769909", 2023-09-13T06:13:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_back_addr": "172.21.15.164:6831/3372769909", 2023-09-13T06:13:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "heartbeat_front_addr": "172.21.15.164:6829/3372769909", 2023-09-13T06:13:28.177 INFO:teuthology.orchestra.run.smithi130.stdout: "state": [ 2023-09-13T06:13:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "exists", 2023-09-13T06:13:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: "up" 2023-09-13T06:13:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2023-09-13T06:13:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.178 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_xinfo": [ 2023-09-13T06:13:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 0, 2023-09-13T06:13:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:28.179 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.245204+0000", 2023-09-13T06:13:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:28.180 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 1, 2023-09-13T06:13:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:28.181 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.335887+0000", 2023-09-13T06:13:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.182 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 2, 2023-09-13T06:13:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:28.183 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.288942+0000", 2023-09-13T06:13:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.184 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 3, 2023-09-13T06:13:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:28.185 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.273774+0000", 2023-09-13T06:13:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 4, 2023-09-13T06:13:28.186 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:28.187 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.296470+0000", 2023-09-13T06:13:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 5, 2023-09-13T06:13:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:28.188 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.327920+0000", 2023-09-13T06:13:28.189 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 6, 2023-09-13T06:13:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.349770+0000", 2023-09-13T06:13:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:28.191 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: { 2023-09-13T06:13:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "osd": 7, 2023-09-13T06:13:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "down_stamp": "0.000000", 2023-09-13T06:13:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_probability": 0, 2023-09-13T06:13:28.192 INFO:teuthology.orchestra.run.smithi130.stdout: "laggy_interval": 0, 2023-09-13T06:13:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "features": 4540138322906710015, 2023-09-13T06:13:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "old_weight": 0, 2023-09-13T06:13:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "last_purged_snaps_scrub": "2023-09-13T06:01:11.376938+0000", 2023-09-13T06:13:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: "dead_epoch": 0 2023-09-13T06:13:28.193 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2023-09-13T06:13:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap": [], 2023-09-13T06:13:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_items": [], 2023-09-13T06:13:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_upmap_primaries": [], 2023-09-13T06:13:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "pg_temp": [], 2023-09-13T06:13:28.194 INFO:teuthology.orchestra.run.smithi130.stdout: "primary_temp": [], 2023-09-13T06:13:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklist": {}, 2023-09-13T06:13:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "range_blocklist": {}, 2023-09-13T06:13:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "erasure_code_profiles": { 2023-09-13T06:13:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "default": { 2023-09-13T06:13:28.195 INFO:teuthology.orchestra.run.smithi130.stdout: "crush-failure-domain": "osd", 2023-09-13T06:13:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "k": "2", 2023-09-13T06:13:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "m": "1", 2023-09-13T06:13:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "plugin": "jerasure", 2023-09-13T06:13:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: "technique": "reed_sol_van" 2023-09-13T06:13:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-09-13T06:13:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "removed_snaps_queue": [], 2023-09-13T06:13:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "new_removed_snaps": [], 2023-09-13T06:13:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "new_purged_snaps": [], 2023-09-13T06:13:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "crush_node_flags": {}, 2023-09-13T06:13:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "device_class_flags": {}, 2023-09-13T06:13:28.197 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode": { 2023-09-13T06:13:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_enabled": false, 2023-09-13T06:13:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_bucket_count": 0, 2023-09-13T06:13:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "degraded_stretch_mode": 0, 2023-09-13T06:13:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "recovering_stretch_mode": 0, 2023-09-13T06:13:28.198 INFO:teuthology.orchestra.run.smithi130.stdout: "stretch_mode_bucket": 0 2023-09-13T06:13:28.199 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-09-13T06:13:28.199 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:28.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 -- 172.21.15.130:0/890430351 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f126c065b20 msgr2=0x7f126c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:28.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f126c065b20 0x7f126c067fe0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f128c160130 tx=0x7f1274007d40 comp rx=0 tx=0).stop 2023-09-13T06:13:28.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 -- 172.21.15.130:0/890430351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f128c0d1090 msgr2=0x7f128c1595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:28.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f128c0d1090 0x7f128c1595a0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c490 tx=0x7f127c00c950 comp rx=0 tx=0).stop 2023-09-13T06:13:28.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 -- 172.21.15.130:0/890430351 shutdown_connections 2023-09-13T06:13:28.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f126c065b20 0x7f126c067fe0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f128c0d1750 0x7f128c13c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f128c146f30 0x7f128c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 --2- 172.21.15.130:0/890430351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f128c0d1090 0x7f128c1595a0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 -- 172.21.15.130:0/890430351 >> 172.21.15.130:0/890430351 conn(0x7f128c06f170 msgr2=0x7f128c15dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:28.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 -- 172.21.15.130:0/890430351 shutdown_connections 2023-09-13T06:13:28.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.011+0000 7f1291582640 1 -- 172.21.15.130:0/890430351 wait complete. 2023-09-13T06:13:28.203 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:13:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6b1ecb640 1 Processor -- start 2023-09-13T06:13:28.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6b1ecb640 1 -- start start 2023-09-13T06:13:28.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6b1ecb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb6ac0d1750 0x7fb6ac15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:28.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6b1ecb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6ac0d1090 0x7fb6ac146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:28.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6b1ecb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac0b63c0 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6b1ecb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac15dea0 con 0x7fb6ac0d1750 2023-09-13T06:13:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6b1ecb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0d0c20 con 0x7fb6ac0d1090 2023-09-13T06:13:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6ab7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb6ac0d1750 0x7fb6ac15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6ab7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb6ac0d1750 0x7fb6ac15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40190/0 (socket says 172.21.15.130:40190) 2023-09-13T06:13:28.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6ab7fe640 1 -- 172.21.15.130:0/2527882112 learned_addr learned my addr 172.21.15.130:0/2527882112 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6a3fff640 1 --2- 172.21.15.130:0/2527882112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6ac0d1090 0x7fb6ac146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6ab7fe640 1 -- 172.21.15.130:0/2527882112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6ac0d1090 msgr2=0x7fb6ac146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6ab7fe640 1 --2- 172.21.15.130:0/2527882112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6ac0d1090 0x7fb6ac146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6ab7fe640 1 -- 172.21.15.130:0/2527882112 >> v1:172.21.15.164:6789/0 conn(0x7fb6ac0d1b30 legacy=0x7fb6ac0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6ab7fe640 1 -- 172.21.15.130:0/2527882112 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac0b6610 con 0x7fb6ac0d1750 2023-09-13T06:13:28.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.343+0000 7fb6a3fff640 1 --2- 172.21.15.130:0/2527882112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6ac0d1090 0x7fb6ac146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:28.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6ab7fe640 1 --2- 172.21.15.130:0/2527882112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6ac0d1750 0x7fb6ac15d960 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009870 tx=0x7fb69c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8178c338b8d0a82e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6aaffd640 1 -- 172.21.15.130:0/2527882112 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0aa5f0 con 0x7fb6ac0d1750 2023-09-13T06:13:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6aaffd640 1 -- 172.21.15.130:0/2527882112 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c0aa750 con 0x7fb6ac0d1750 2023-09-13T06:13:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6aaffd640 1 -- 172.21.15.130:0/2527882112 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0aaae0 con 0x7fb6ac0d1750 2023-09-13T06:13:28.350 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2527882112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6ac0d1750 msgr2=0x7fb6ac15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6b1ecb640 1 --2- 172.21.15.130:0/2527882112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6ac0d1750 0x7fb6ac15d960 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009870 tx=0x7fb69c01c4d0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2527882112 shutdown_connections 2023-09-13T06:13:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6b1ecb640 1 --2- 172.21.15.130:0/2527882112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6ac0d1090 0x7fb6ac146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.351 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6b1ecb640 1 --2- 172.21.15.130:0/2527882112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6ac0d1750 0x7fb6ac15d960 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2527882112 >> 172.21.15.130:0/2527882112 conn(0x7fb6ac06f170 msgr2=0x7fb6ac06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2527882112 shutdown_connections 2023-09-13T06:13:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.347+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2527882112 wait complete. 2023-09-13T06:13:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6b1ecb640 1 Processor -- start 2023-09-13T06:13:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6b1ecb640 1 -- start start 2023-09-13T06:13:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6b1ecb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6ac0d1090 0x7fb6ac13d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6b1ecb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6ac0d1750 0x7fb6ac141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6b1ecb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6ac0d1b30 0x7fb6ac13ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6b1ecb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac13e7f0 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6b1ecb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac1f5bb0 con 0x7fb6ac0d1750 2023-09-13T06:13:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6b1ecb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac141d80 con 0x7fb6ac0d1090 2023-09-13T06:13:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6abfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6ac0d1b30 0x7fb6ac13ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6a3fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6ac0d1750 0x7fb6ac141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6abfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6ac0d1b30 0x7fb6ac13ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40198/0 (socket says 172.21.15.130:40198) 2023-09-13T06:13:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6abfff640 1 -- 172.21.15.130:0/2952234330 learned_addr learned my addr 172.21.15.130:0/2952234330 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6ab7fe640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6ac0d1090 0x7fb6ac13d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:28.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6abfff640 1 -- 172.21.15.130:0/2952234330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6ac0d1090 msgr2=0x7fb6ac13d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6abfff640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6ac0d1090 0x7fb6ac13d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6abfff640 1 -- 172.21.15.130:0/2952234330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6ac0d1750 msgr2=0x7fb6ac141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6abfff640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6ac0d1750 0x7fb6ac141840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6abfff640 1 -- 172.21.15.130:0/2952234330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c0094d0 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6abfff640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6ac0d1b30 0x7fb6ac13ce30 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400b970 tx=0x7fb6a400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:28.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6a8ff9640 1 -- 172.21.15.130:0/2952234330 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400cb40 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6a8ff9640 1 -- 172.21.15.130:0/2952234330 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a400cca0 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6a8ff9640 1 -- 172.21.15.130:0/2952234330 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4014680 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2952234330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac13dc70 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.351+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2952234330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac13e230 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.355+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2952234330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ac1f5d20 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.355+0000 7fb6a8ff9640 1 -- 172.21.15.130:0/2952234330 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb6a401d3b0 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.355+0000 7fb6a8ff9640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb68c065b20 0x7fb68c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:28.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.355+0000 7fb6a8ff9640 1 -- 172.21.15.130:0/2952234330 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6a4083120 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.355+0000 7fb6ab7fe640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb68c065b20 0x7fb68c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:28.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.355+0000 7fb6ab7fe640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb68c065b20 0x7fb68c067fe0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0ae000 tx=0x7fb69c0b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:28.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.359+0000 7fb6a8ff9640 1 -- 172.21.15.130:0/2952234330 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb6ac1f5d20 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2952234330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6ac1f5d20 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6a8ff9640 1 -- 172.21.15.130:0/2952234330 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fb6ac1f5d20 con 0x7fb6ac0d1b30 2023-09-13T06:13:28.540 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:28.540 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/519371055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":519371055},{"type":"v1","addr":"172.21.15.130:6837","nonce":519371055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2464101241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2464101241},{"type":"v1","addr":"172.21.15.130:6836","nonce":2464101241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3066690343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3066690343},{"type":"v1","addr":"172.21.15.164:6833","nonce":3066690343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:12:52.135181+0000","modified":"2023-09-13T06:12:55.174886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8272":{"gid":8272,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2477052868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2477052868},{"type":"v1","addr":"172.21.15.164:6835","nonce":2477052868}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-09-13T06:13:28.541 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 92 2023-09-13T06:13:28.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2952234330 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb68c065b20 msgr2=0x7fb68c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:28.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb68c065b20 0x7fb68c067fe0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0ae000 tx=0x7fb69c0b5040 comp rx=0 tx=0).stop 2023-09-13T06:13:28.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2952234330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6ac0d1b30 msgr2=0x7fb6ac13ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6ac0d1b30 0x7fb6ac13ce30 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400b970 tx=0x7fb6a400be30 comp rx=0 tx=0).stop 2023-09-13T06:13:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2952234330 shutdown_connections 2023-09-13T06:13:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb68c065b20 0x7fb68c067fe0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6ac0d1750 0x7fb6ac141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6ac0d1b30 0x7fb6ac13ce30 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 --2- 172.21.15.130:0/2952234330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6ac0d1090 0x7fb6ac13d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:28.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2952234330 >> 172.21.15.130:0/2952234330 conn(0x7fb6ac06f170 msgr2=0x7fb6ac15dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:28.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2952234330 shutdown_connections 2023-09-13T06:13:28.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:28.539+0000 7fb6b1ecb640 1 -- 172.21.15.130:0/2952234330 wait complete. 2023-09-13T06:13:28.561 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-09-13T06:13:28.729 INFO:teuthology.orchestra.run.smithi164.stdout:{"cluster_fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","whoami":0,"id":8272,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":35.953158924999997,"mdsmap_epoch":92,"osdmap_epoch":190,"osdmap_epoch_barrier":189,"uptime":41.865165726999997} 2023-09-13T06:13:28.729 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "33902c8f-11a4-444c-a37a-ca3bab8415c5", "fs_name": "cephfs", "id": 8272, "mdsmap_epoch": 92, "osdmap_epoch": 190, "osdmap_epoch_barrier": 189, "rank_uptime": 35.953158925, "state": "up:active", "uptime": 41.865165727, "want_state": "up:active", "whoami": 0 } 2023-09-13T06:13:28.730 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-09-13T06:13:28.730 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:13:28.731 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:28.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:28.740 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-09-13T06:13:29.188 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records in 2023-09-13T06:13:29.188 INFO:teuthology.orchestra.run.smithi130.stderr:50+0 records out 2023-09-13T06:13:29.188 INFO:teuthology.orchestra.run.smithi130.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.39621 s, 132 MB/s 2023-09-13T06:13:29.189 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T06:13:29.190 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:13:29.233 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T06:13:29.302 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T06:13:29.302 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:13:29.303 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:29.312 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:13:29.313 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:29.362 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:13:29.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.543+0000 7f1450648640 1 Processor -- start 2023-09-13T06:13:29.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.543+0000 7f1450648640 1 -- start start 2023-09-13T06:13:29.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.543+0000 7f1450648640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1448159f20 0x7f14480ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:29.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.543+0000 7f1450648640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14480b1d20 0x7f14480b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:29.546 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.543+0000 7f1450648640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14480ccfd0 con 0x7f14480cdfc0 2023-09-13T06:13:29.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.543+0000 7f1450648640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14480b00f0 con 0x7f1448159f20 2023-09-13T06:13:29.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.543+0000 7f1450648640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14480b11d0 con 0x7f14480b1d20 2023-09-13T06:13:29.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.543+0000 7f144dbe3640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f14480cdfc0 0x7f14480b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:35994/0 (socket says 172.21.15.130:35994) 2023-09-13T06:13:29.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.543+0000 7f144e3e4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1448159f20 0x7f14480ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:29.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.543+0000 7f144dbe3640 1 -- 172.21.15.130:0/2700389578 learned_addr learned my addr 172.21.15.130:0/2700389578 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:29.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.547+0000 7f144ebe5640 1 --2- 172.21.15.130:0/2700389578 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14480b1d20 0x7f14480b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:29.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.547+0000 7f144e3e4640 1 -- 172.21.15.130:0/2700389578 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14480b1d20 msgr2=0x7f14480b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:29.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.547+0000 7f144e3e4640 1 --2- 172.21.15.130:0/2700389578 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14480b1d20 0x7f14480b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:29.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.547+0000 7f144e3e4640 1 -- 172.21.15.130:0/2700389578 >> v1:172.21.15.130:6789/0 conn(0x7f14480cdfc0 legacy=0x7f14480b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:29.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.547+0000 7f144e3e4640 1 -- 172.21.15.130:0/2700389578 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14480ced90 con 0x7f1448159f20 2023-09-13T06:13:29.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.547+0000 7f144ebe5640 1 --2- 172.21.15.130:0/2700389578 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14480b1d20 0x7f14480b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:29.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.547+0000 7f144e3e4640 1 --2- 172.21.15.130:0/2700389578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1448159f20 0x7f14480ce7b0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f14440097c0 tx=0x7f144401e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfa83b0dbd11859 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:29.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.547+0000 7f144d3e2640 1 -- 172.21.15.130:0/2700389578 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14440a8660 con 0x7f1448159f20 2023-09-13T06:13:29.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.547+0000 7f144d3e2640 1 -- 172.21.15.130:0/2700389578 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14440a87c0 con 0x7f1448159f20 2023-09-13T06:13:29.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.547+0000 7f144d3e2640 1 -- 172.21.15.130:0/2700389578 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14440a8b50 con 0x7f1448159f20 2023-09-13T06:13:29.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 -- 172.21.15.130:0/2700389578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1448159f20 msgr2=0x7f14480ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:29.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 --2- 172.21.15.130:0/2700389578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1448159f20 0x7f14480ce7b0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f14440097c0 tx=0x7f144401e690 comp rx=0 tx=0).stop 2023-09-13T06:13:29.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 -- 172.21.15.130:0/2700389578 shutdown_connections 2023-09-13T06:13:29.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 --2- 172.21.15.130:0/2700389578 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14480b1d20 0x7f14480b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:29.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 --2- 172.21.15.130:0/2700389578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1448159f20 0x7f14480ce7b0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:29.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 -- 172.21.15.130:0/2700389578 >> 172.21.15.130:0/2700389578 conn(0x7f1448065990 msgr2=0x7f1448065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:29.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 -- 172.21.15.130:0/2700389578 shutdown_connections 2023-09-13T06:13:29.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 -- 172.21.15.130:0/2700389578 wait complete. 2023-09-13T06:13:29.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 Processor -- start 2023-09-13T06:13:29.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 -- start start 2023-09-13T06:13:29.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14480b1d20 0x7f1448150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:29.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14480cdfc0 0x7f1448148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:29.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1448159f20 0x7f14480ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:29.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448149b30 con 0x7f14480b1d20 2023-09-13T06:13:29.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448152300 con 0x7f14480cdfc0 2023-09-13T06:13:29.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f1450648640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14481516f0 con 0x7f1448159f20 2023-09-13T06:13:29.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f144e3e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14480b1d20 0x7f1448150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:29.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f144e3e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14480b1d20 0x7f1448150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40204/0 (socket says 172.21.15.130:40204) 2023-09-13T06:13:29.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f144e3e4640 1 -- 172.21.15.130:0/3346478108 learned_addr learned my addr 172.21.15.130:0/3346478108 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:29.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f144ebe5640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1448159f20 0x7f14480ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:29.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f144dbe3640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14480cdfc0 0x7f1448148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:29.557 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f144e3e4640 1 -- 172.21.15.130:0/3346478108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1448159f20 msgr2=0x7f14480ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:29.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f144e3e4640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1448159f20 0x7f14480ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:29.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f144e3e4640 1 -- 172.21.15.130:0/3346478108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14480cdfc0 msgr2=0x7f1448148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:29.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f144e3e4640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14480cdfc0 0x7f1448148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:29.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.551+0000 7f144e3e4640 1 -- 172.21.15.130:0/3346478108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1444009420 con 0x7f14480b1d20 2023-09-13T06:13:29.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f144e3e4640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14480b1d20 0x7f1448150e80 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f144401cd40 tx=0x7f144401b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:29.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f143effd640 1 -- 172.21.15.130:0/3346478108 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14440a8660 con 0x7f14480b1d20 2023-09-13T06:13:29.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f143effd640 1 -- 172.21.15.130:0/3346478108 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14440b3880 con 0x7f14480b1d20 2023-09-13T06:13:29.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f143effd640 1 -- 172.21.15.130:0/3346478108 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14440b3c30 con 0x7f14480b1d20 2023-09-13T06:13:29.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f1450648640 1 -- 172.21.15.130:0/3346478108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14480cd870 con 0x7f14480b1d20 2023-09-13T06:13:29.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f1450648640 1 -- 172.21.15.130:0/3346478108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1448151cb0 con 0x7f14480b1d20 2023-09-13T06:13:29.560 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f1450648640 1 -- 172.21.15.130:0/3346478108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14480618a0 con 0x7f14480b1d20 2023-09-13T06:13:29.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f143effd640 1 -- 172.21.15.130:0/3346478108 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f14440bf460 con 0x7f14480b1d20 2023-09-13T06:13:29.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f143effd640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f142c065b20 0x7f142c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:29.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f143effd640 1 -- 172.21.15.130:0/3346478108 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f144411d760 con 0x7f14480b1d20 2023-09-13T06:13:29.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f144dbe3640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f142c065b20 0x7f142c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:29.561 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.555+0000 7f144dbe3640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f142c065b20 0x7f142c067fe0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f14480b11a0 tx=0x7f1438009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:29.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.559+0000 7f143effd640 1 -- 172.21.15.130:0/3346478108 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f14440eb010 con 0x7f14480b1d20 2023-09-13T06:13:29.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 -- 172.21.15.130:0/3346478108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f144806f640 con 0x7f14480b1d20 2023-09-13T06:13:29.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f143effd640 1 -- 172.21.15.130:0/3346478108 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+16615 (secure 0 0 0) 0x7f14440ae090 con 0x7f14480b1d20 2023-09-13T06:13:29.957 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:29.958 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":190,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:13:22.489989+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:12:49.873320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-09-13T06:12:51.142196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:13:29.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 -- 172.21.15.130:0/3346478108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f142c065b20 msgr2=0x7f142c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:29.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f142c065b20 0x7f142c067fe0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f14480b11a0 tx=0x7f1438009040 comp rx=0 tx=0).stop 2023-09-13T06:13:29.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 -- 172.21.15.130:0/3346478108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14480b1d20 msgr2=0x7f1448150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:29.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14480b1d20 0x7f1448150e80 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f144401cd40 tx=0x7f144401b430 comp rx=0 tx=0).stop 2023-09-13T06:13:29.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 -- 172.21.15.130:0/3346478108 shutdown_connections 2023-09-13T06:13:29.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f142c065b20 0x7f142c067fe0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:29.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14480cdfc0 0x7f1448148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:29.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1448159f20 0x7f14480ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:29.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 --2- 172.21.15.130:0/3346478108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f14480b1d20 0x7f1448150e80 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:29.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 -- 172.21.15.130:0/3346478108 >> 172.21.15.130:0/3346478108 conn(0x7f1448065990 msgr2=0x7f144806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:29.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 -- 172.21.15.130:0/3346478108 shutdown_connections 2023-09-13T06:13:29.963 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:29.711+0000 7f1450648640 1 -- 172.21.15.130:0/3346478108 wait complete. 2023-09-13T06:13:29.964 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:12:49.873320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '186', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:12:51.142196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:13:29.965 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:13:30.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c7e140640 1 Processor -- start 2023-09-13T06:13:30.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c7e140640 1 -- start start 2023-09-13T06:13:30.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c7e140640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3c7815a080 0x7f3c780b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c7e140640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7815e650 0x7f3c780b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c7e140640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c780cc850 con 0x7f3c780b2fd0 2023-09-13T06:13:30.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c7e140640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c780b3420 con 0x7f3c7815a080 2023-09-13T06:13:30.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c7e140640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780b0330 con 0x7f3c7815e650 2023-09-13T06:13:30.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c76ffd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7815e650 0x7f3c780b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c777fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3c7815a080 0x7f3c780b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c777fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3c7815a080 0x7f3c780b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:33856/0 (socket says 172.21.15.130:33856) 2023-09-13T06:13:30.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c777fe640 1 -- 172.21.15.130:0/40207140 learned_addr learned my addr 172.21.15.130:0/40207140 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:30.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c777fe640 1 -- 172.21.15.130:0/40207140 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7815e650 msgr2=0x7f3c780b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:30.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c777fe640 1 --2- 172.21.15.130:0/40207140 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7815e650 0x7f3c780b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c777fe640 1 -- 172.21.15.130:0/40207140 >> v1:172.21.15.164:6789/0 conn(0x7f3c780b2fd0 legacy=0x7f3c780ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c777fe640 1 -- 172.21.15.130:0/40207140 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780cbcd0 con 0x7f3c7815a080 2023-09-13T06:13:30.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.107+0000 7f3c76ffd640 1 --2- 172.21.15.130:0/40207140 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7815e650 0x7f3c780b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:13:30.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c777fe640 1 --2- 172.21.15.130:0/40207140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7815a080 0x7f3c780b1460 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009870 tx=0x7f3c6801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f68d7f6f2d20b3c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:30.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c767fc640 1 -- 172.21.15.130:0/40207140 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680ac620 con 0x7f3c7815a080 2023-09-13T06:13:30.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c767fc640 1 -- 172.21.15.130:0/40207140 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c680ac780 con 0x7f3c7815a080 2023-09-13T06:13:30.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c767fc640 1 -- 172.21.15.130:0/40207140 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680acb10 con 0x7f3c7815a080 2023-09-13T06:13:30.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c7e140640 1 -- 172.21.15.130:0/40207140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7815a080 msgr2=0x7f3c780b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c7e140640 1 --2- 172.21.15.130:0/40207140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7815a080 0x7f3c780b1460 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009870 tx=0x7f3c6801c450 comp rx=0 tx=0).stop 2023-09-13T06:13:30.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c7e140640 1 -- 172.21.15.130:0/40207140 shutdown_connections 2023-09-13T06:13:30.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c7e140640 1 --2- 172.21.15.130:0/40207140 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c7815e650 0x7f3c780b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c7e140640 1 --2- 172.21.15.130:0/40207140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7815a080 0x7f3c780b1460 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c7e140640 1 -- 172.21.15.130:0/40207140 >> 172.21.15.130:0/40207140 conn(0x7f3c78065990 msgr2=0x7f3c78065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:30.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c7e140640 1 -- 172.21.15.130:0/40207140 shutdown_connections 2023-09-13T06:13:30.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.111+0000 7f3c7e140640 1 -- 172.21.15.130:0/40207140 wait complete. 2023-09-13T06:13:30.117 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c7e140640 1 Processor -- start 2023-09-13T06:13:30.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c7e140640 1 -- start start 2023-09-13T06:13:30.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c7e140640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c780b2fd0 0x7f3c78135560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c7e140640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7815a080 0x7f3c780b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c7e140640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815e650 0x7f3c780b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c7e140640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78151190 con 0x7f3c7815e650 2023-09-13T06:13:30.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c7e140640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7814e320 con 0x7f3c7815a080 2023-09-13T06:13:30.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c7e140640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78135aa0 con 0x7f3c780b2fd0 2023-09-13T06:13:30.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c77fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815e650 0x7f3c780b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c77fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815e650 0x7f3c780b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40220/0 (socket says 172.21.15.130:40220) 2023-09-13T06:13:30.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c77fff640 1 -- 172.21.15.130:0/2616999792 learned_addr learned my addr 172.21.15.130:0/2616999792 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:30.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c777fe640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c780b2fd0 0x7f3c78135560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c76ffd640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7815a080 0x7f3c780b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c77fff640 1 -- 172.21.15.130:0/2616999792 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c780b2fd0 msgr2=0x7f3c78135560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c77fff640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c780b2fd0 0x7f3c78135560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.120 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c77fff640 1 -- 172.21.15.130:0/2616999792 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7815a080 msgr2=0x7f3c780b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c77fff640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7815a080 0x7f3c780b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c77fff640 1 -- 172.21.15.130:0/2616999792 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c009420 con 0x7f3c7815e650 2023-09-13T06:13:30.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c77fff640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815e650 0x7f3c780b45f0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000c7a0 tx=0x7f3c7000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:30.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c5ffff640 1 -- 172.21.15.130:0/2616999792 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70003b80 con 0x7f3c7815e650 2023-09-13T06:13:30.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c5ffff640 1 -- 172.21.15.130:0/2616999792 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c70003ce0 con 0x7f3c7815e650 2023-09-13T06:13:30.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c5ffff640 1 -- 172.21.15.130:0/2616999792 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000aa90 con 0x7f3c7815e650 2023-09-13T06:13:30.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c7e140640 1 -- 172.21.15.130:0/2616999792 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c680094d0 con 0x7f3c7815e650 2023-09-13T06:13:30.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.115+0000 7f3c7e140640 1 -- 172.21.15.130:0/2616999792 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c78150860 con 0x7f3c7815e650 2023-09-13T06:13:30.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.119+0000 7f3c7e140640 1 -- 172.21.15.130:0/2616999792 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c78151340 con 0x7f3c7815e650 2023-09-13T06:13:30.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.119+0000 7f3c5ffff640 1 -- 172.21.15.130:0/2616999792 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3c7000abf0 con 0x7f3c7815e650 2023-09-13T06:13:30.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.119+0000 7f3c5ffff640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c64065b20 0x7f3c64067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.119+0000 7f3c5ffff640 1 -- 172.21.15.130:0/2616999792 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c70082f10 con 0x7f3c7815e650 2023-09-13T06:13:30.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.119+0000 7f3c777fe640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c64065b20 0x7f3c64067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.119+0000 7f3c777fe640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c64065b20 0x7f3c64067fe0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3c680ae000 tx=0x7f3c680a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:30.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.123+0000 7f3c5ffff640 1 -- 172.21.15.130:0/2616999792 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3c70050870 con 0x7f3c7815e650 2023-09-13T06:13:30.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 -- 172.21.15.130:0/2616999792 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c780cc850 con 0x7f3c7815e650 2023-09-13T06:13:30.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c5ffff640 1 -- 172.21.15.130:0/2616999792 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v190) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c780cc850 con 0x7f3c7815e650 2023-09-13T06:13:30.276 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:13:30.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 -- 172.21.15.130:0/2616999792 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c64065b20 msgr2=0x7f3c64067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.278 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c64065b20 0x7f3c64067fe0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3c680ae000 tx=0x7f3c680a7000 comp rx=0 tx=0).stop 2023-09-13T06:13:30.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 -- 172.21.15.130:0/2616999792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815e650 msgr2=0x7f3c780b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815e650 0x7f3c780b45f0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000c7a0 tx=0x7f3c7000cc60 comp rx=0 tx=0).stop 2023-09-13T06:13:30.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 -- 172.21.15.130:0/2616999792 shutdown_connections 2023-09-13T06:13:30.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3c64065b20 0x7f3c64067fe0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c7815a080 0x7f3c780b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815e650 0x7f3c780b45f0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 --2- 172.21.15.130:0/2616999792 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c780b2fd0 0x7f3c78135560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 -- 172.21.15.130:0/2616999792 >> 172.21.15.130:0/2616999792 conn(0x7f3c78065990 msgr2=0x7f3c78151570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:30.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 -- 172.21.15.130:0/2616999792 shutdown_connections 2023-09-13T06:13:30.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.275+0000 7f3c7e140640 1 -- 172.21.15.130:0/2616999792 wait complete. 2023-09-13T06:13:30.297 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:13:30.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.439+0000 7f074b359640 1 Processor -- start 2023-09-13T06:13:30.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.439+0000 7f074b359640 1 -- start start 2023-09-13T06:13:30.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.439+0000 7f074b359640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0744070680 0x7f0744142d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f074b359640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f074406d7d0 0x7f0744143280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.443 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f074b359640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f07440cc1f0 0x7f074406f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f074b359640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074415d4c0 con 0x7f074406d7d0 2023-09-13T06:13:30.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f074b359640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074415d710 con 0x7f07440cc1f0 2023-09-13T06:13:30.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f074b359640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074415d9f0 con 0x7f0744070680 2023-09-13T06:13:30.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f07488f4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f074406d7d0 0x7f0744143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f07488f4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f074406d7d0 0x7f0744143280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40236/0 (socket says 172.21.15.130:40236) 2023-09-13T06:13:30.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f07490f5640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0744070680 0x7f0744142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f07488f4640 1 -- 172.21.15.130:0/1719003508 learned_addr learned my addr 172.21.15.130:0/1719003508 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:30.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f07498f6640 1 --2- 172.21.15.130:0/1719003508 >> v2:172.21.15.164:3300/0 conn(0x7f07440cc1f0 0x7f074406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f07488f4640 1 -- 172.21.15.130:0/1719003508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0744070680 msgr2=0x7f0744142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:30.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f07488f4640 1 --2- 172.21.15.130:0/1719003508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0744070680 0x7f0744142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f07488f4640 1 -- 172.21.15.130:0/1719003508 >> v2:172.21.15.164:3300/0 conn(0x7f07440cc1f0 msgr2=0x7f074406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:30.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f07488f4640 1 --2- 172.21.15.130:0/1719003508 >> v2:172.21.15.164:3300/0 conn(0x7f07440cc1f0 0x7f074406f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f07488f4640 1 -- 172.21.15.130:0/1719003508 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074415dcd0 con 0x7f074406d7d0 2023-09-13T06:13:30.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f07488f4640 1 --2- 172.21.15.130:0/1719003508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f074406d7d0 0x7f0744143280 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f0744159ed0 tx=0x7f073401e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebf50e449b3b756 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:30.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f073bfff640 1 -- 172.21.15.130:0/1719003508 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734004230 con 0x7f074406d7d0 2023-09-13T06:13:30.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f073bfff640 1 -- 172.21.15.130:0/1719003508 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07340ab070 con 0x7f074406d7d0 2023-09-13T06:13:30.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.443+0000 7f073bfff640 1 -- 172.21.15.130:0/1719003508 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07340a7750 con 0x7f074406d7d0 2023-09-13T06:13:30.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 -- 172.21.15.130:0/1719003508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f074406d7d0 msgr2=0x7f0744143280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 --2- 172.21.15.130:0/1719003508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f074406d7d0 0x7f0744143280 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f0744159ed0 tx=0x7f073401e9b0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 -- 172.21.15.130:0/1719003508 shutdown_connections 2023-09-13T06:13:30.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 --2- 172.21.15.130:0/1719003508 >> v2:172.21.15.164:3300/0 conn(0x7f07440cc1f0 0x7f074406f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 --2- 172.21.15.130:0/1719003508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f074406d7d0 0x7f0744143280 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 --2- 172.21.15.130:0/1719003508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0744070680 0x7f0744142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 -- 172.21.15.130:0/1719003508 >> 172.21.15.130:0/1719003508 conn(0x7f0744065d60 msgr2=0x7f07440b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:30.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 -- 172.21.15.130:0/1719003508 shutdown_connections 2023-09-13T06:13:30.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 -- 172.21.15.130:0/1719003508 wait complete. 2023-09-13T06:13:30.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 Processor -- start 2023-09-13T06:13:30.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 -- start start 2023-09-13T06:13:30.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0744070680 0x7f07441438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07440cc1f0 0x7f0744134800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0744134d40 0x7f0744135350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074413ab90 con 0x7f0744134d40 2023-09-13T06:13:30.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0744143e10 con 0x7f0744070680 2023-09-13T06:13:30.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f074b359640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074413ae30 con 0x7f07440cc1f0 2023-09-13T06:13:30.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f07498f6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0744134d40 0x7f0744135350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f07498f6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0744134d40 0x7f0744135350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40246/0 (socket says 172.21.15.130:40246) 2023-09-13T06:13:30.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f07498f6640 1 -- 172.21.15.130:0/3717971435 learned_addr learned my addr 172.21.15.130:0/3717971435 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:30.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f07490f5640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0744070680 0x7f07441438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f07488f4640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07440cc1f0 0x7f0744134800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f07498f6640 1 -- 172.21.15.130:0/3717971435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07440cc1f0 msgr2=0x7f0744134800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f07498f6640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07440cc1f0 0x7f0744134800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f07498f6640 1 -- 172.21.15.130:0/3717971435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0744070680 msgr2=0x7f07441438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f07498f6640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0744070680 0x7f07441438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.447+0000 7f07498f6640 1 -- 172.21.15.130:0/3717971435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073400b780 con 0x7f0744134d40 2023-09-13T06:13:30.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.451+0000 7f07498f6640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0744134d40 0x7f0744135350 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f073c00efc0 tx=0x7f073c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:30.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.451+0000 7f0739ffb640 1 -- 172.21.15.130:0/3717971435 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c009ba0 con 0x7f0744134d40 2023-09-13T06:13:30.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.451+0000 7f0739ffb640 1 -- 172.21.15.130:0/3717971435 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c00f040 con 0x7f0744134d40 2023-09-13T06:13:30.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.451+0000 7f0739ffb640 1 -- 172.21.15.130:0/3717971435 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c0146c0 con 0x7f0744134d40 2023-09-13T06:13:30.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.451+0000 7f074b359640 1 -- 172.21.15.130:0/3717971435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074413b110 con 0x7f0744134d40 2023-09-13T06:13:30.455 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.451+0000 7f074b359640 1 -- 172.21.15.130:0/3717971435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0744140270 con 0x7f0744134d40 2023-09-13T06:13:30.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.451+0000 7f074b359640 1 -- 172.21.15.130:0/3717971435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07440618a0 con 0x7f0744134d40 2023-09-13T06:13:30.456 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.451+0000 7f0739ffb640 1 -- 172.21.15.130:0/3717971435 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f073c014820 con 0x7f0744134d40 2023-09-13T06:13:30.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.455+0000 7f0739ffb640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0728065b20 0x7f0728067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.455+0000 7f0739ffb640 1 -- 172.21.15.130:0/3717971435 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f073c083d30 con 0x7f0744134d40 2023-09-13T06:13:30.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.455+0000 7f07490f5640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0728065b20 0x7f0728067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.457 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.455+0000 7f07490f5640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0728065b20 0x7f0728067fe0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0740009ae0 tx=0x7f0740009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:30.458 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.459+0000 7f0739ffb640 1 -- 172.21.15.130:0/3717971435 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f073c051690 con 0x7f0744134d40 2023-09-13T06:13:30.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.603+0000 7f074b359640 1 -- 172.21.15.130:0/3717971435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f074413b5c0 con 0x7f0744134d40 2023-09-13T06:13:30.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.603+0000 7f0739ffb640 1 -- 172.21.15.130:0/3717971435 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v190) v1 ==== 104+0+11 (secure 0 0 0) 0x7f073c054cb0 con 0x7f0744134d40 2023-09-13T06:13:30.607 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:13:30.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 -- 172.21.15.130:0/3717971435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0728065b20 msgr2=0x7f0728067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0728065b20 0x7f0728067fe0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0740009ae0 tx=0x7f0740009190 comp rx=0 tx=0).stop 2023-09-13T06:13:30.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 -- 172.21.15.130:0/3717971435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0744134d40 msgr2=0x7f0744135350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0744134d40 0x7f0744135350 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f073c00efc0 tx=0x7f073c00c490 comp rx=0 tx=0).stop 2023-09-13T06:13:30.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 -- 172.21.15.130:0/3717971435 shutdown_connections 2023-09-13T06:13:30.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0728065b20 0x7f0728067fe0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0744134d40 0x7f0744135350 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07440cc1f0 0x7f0744134800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 --2- 172.21.15.130:0/3717971435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0744070680 0x7f07441438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 -- 172.21.15.130:0/3717971435 >> 172.21.15.130:0/3717971435 conn(0x7f0744065d60 msgr2=0x7f074406ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:30.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 -- 172.21.15.130:0/3717971435 shutdown_connections 2023-09-13T06:13:30.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.607+0000 7f074b359640 1 -- 172.21.15.130:0/3717971435 wait complete. 2023-09-13T06:13:30.627 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:13:30.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.767+0000 7f08b4a0b640 1 Processor -- start 2023-09-13T06:13:30.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.767+0000 7f08b4a0b640 1 -- start start 2023-09-13T06:13:30.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08b4a0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08b00b2e90 0x7f08b00ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08b4a0b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f08b00b1460 0x7f08b00b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08b4a0b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b00b2150 con 0x7f08b0144d70 2023-09-13T06:13:30.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08b4a0b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b00b2430 con 0x7f08b00b1460 2023-09-13T06:13:30.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08b4a0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00cedb0 con 0x7f08b00b2e90 2023-09-13T06:13:30.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08ae59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f08b0144d70 0x7f08b00b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:36004/0 (socket says 172.21.15.130:36004) 2023-09-13T06:13:30.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08ae59c640 1 -- 172.21.15.130:0/1135339761 learned_addr learned my addr 172.21.15.130:0/1135339761 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:30.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08aed9d640 1 --2- 172.21.15.130:0/1135339761 >> v2:172.21.15.130:3300/0 conn(0x7f08b00b1460 0x7f08b00b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08a7fff640 1 --2- 172.21.15.130:0/1135339761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08b00b2e90 0x7f08b00ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08add9b640 1 -- 172.21.15.130:0/1135339761 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251727850 0 0) 0x7f08b00b2150 con 0x7f08b0144d70 2023-09-13T06:13:30.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08add9b640 1 -- 172.21.15.130:0/1135339761 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f089c003530 con 0x7f08b0144d70 2023-09-13T06:13:30.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08aed9d640 1 -- 172.21.15.130:0/1135339761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08b00b2e90 msgr2=0x7f08b00ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:30.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08aed9d640 1 --2- 172.21.15.130:0/1135339761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08b00b2e90 0x7f08b00ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08aed9d640 1 -- 172.21.15.130:0/1135339761 >> v1:172.21.15.130:6789/0 conn(0x7f08b0144d70 legacy=0x7f08b00b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.771+0000 7f08aed9d640 1 -- 172.21.15.130:0/1135339761 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b00cdd90 con 0x7f08b00b1460 2023-09-13T06:13:30.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08aed9d640 1 --2- 172.21.15.130:0/1135339761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b00b1460 0x7f08b00b18f0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009d90 tx=0x7f08a801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c667008f0f12b256 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:30.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08add9b640 1 -- 172.21.15.130:0/1135339761 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80a5900 con 0x7f08b00b1460 2023-09-13T06:13:30.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08add9b640 1 -- 172.21.15.130:0/1135339761 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a80a5a60 con 0x7f08b00b1460 2023-09-13T06:13:30.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08add9b640 1 -- 172.21.15.130:0/1135339761 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80a5df0 con 0x7f08b00b1460 2023-09-13T06:13:30.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08b4a0b640 1 -- 172.21.15.130:0/1135339761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b00b1460 msgr2=0x7f08b00b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08b4a0b640 1 --2- 172.21.15.130:0/1135339761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b00b1460 0x7f08b00b18f0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009d90 tx=0x7f08a801c950 comp rx=0 tx=0).stop 2023-09-13T06:13:30.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08b4a0b640 1 -- 172.21.15.130:0/1135339761 shutdown_connections 2023-09-13T06:13:30.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08b4a0b640 1 --2- 172.21.15.130:0/1135339761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b00b1460 0x7f08b00b18f0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08b4a0b640 1 --2- 172.21.15.130:0/1135339761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08b00b2e90 0x7f08b00ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08b4a0b640 1 -- 172.21.15.130:0/1135339761 >> 172.21.15.130:0/1135339761 conn(0x7f08b0065990 msgr2=0x7f08b0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:30.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08b4a0b640 1 -- 172.21.15.130:0/1135339761 shutdown_connections 2023-09-13T06:13:30.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08b4a0b640 1 -- 172.21.15.130:0/1135339761 wait complete. 2023-09-13T06:13:30.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08b4a0b640 1 Processor -- start 2023-09-13T06:13:30.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.775+0000 7f08b4a0b640 1 -- start start 2023-09-13T06:13:30.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08b4a0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b00b1460 0x7f08b01421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08b4a0b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08b00b2e90 0x7f08b0159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08b4a0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08b0144d70 0x7f08b013e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08b4a0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b013f380 con 0x7f08b00b1460 2023-09-13T06:13:30.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08b4a0b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b0159fa0 con 0x7f08b00b2e90 2023-09-13T06:13:30.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08b4a0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b0142850 con 0x7f08b0144d70 2023-09-13T06:13:30.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08ae59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b00b1460 0x7f08b01421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08ae59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b00b1460 0x7f08b01421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40274/0 (socket says 172.21.15.130:40274) 2023-09-13T06:13:30.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08ae59c640 1 -- 172.21.15.130:0/3688757128 learned_addr learned my addr 172.21.15.130:0/3688757128 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:30.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08aed9d640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08b0144d70 0x7f08b013e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08a7fff640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08b00b2e90 0x7f08b0159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08ae59c640 1 -- 172.21.15.130:0/3688757128 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08b0144d70 msgr2=0x7f08b013e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08ae59c640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08b0144d70 0x7f08b013e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08ae59c640 1 -- 172.21.15.130:0/3688757128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08b00b2e90 msgr2=0x7f08b0159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08ae59c640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08b00b2e90 0x7f08b0159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08ae59c640 1 -- 172.21.15.130:0/3688757128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8009a70 con 0x7f08b00b1460 2023-09-13T06:13:30.785 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08aed9d640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08b0144d70 0x7f08b013e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:30.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08ae59c640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b00b1460 0x7f08b01421e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f08a000c420 tx=0x7f08a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:30.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08a6ffd640 1 -- 172.21.15.130:0/3688757128 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0005cf0 con 0x7f08b00b1460 2023-09-13T06:13:30.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08a6ffd640 1 -- 172.21.15.130:0/3688757128 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a0005e50 con 0x7f08b00b1460 2023-09-13T06:13:30.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08a6ffd640 1 -- 172.21.15.130:0/3688757128 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a00072d0 con 0x7f08b00b1460 2023-09-13T06:13:30.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08b4a0b640 1 -- 172.21.15.130:0/3688757128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b013ed30 con 0x7f08b00b1460 2023-09-13T06:13:30.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08b4a0b640 1 -- 172.21.15.130:0/3688757128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b013e7e0 con 0x7f08b00b1460 2023-09-13T06:13:30.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.779+0000 7f08b4a0b640 1 -- 172.21.15.130:0/3688757128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b00618a0 con 0x7f08b00b1460 2023-09-13T06:13:30.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.783+0000 7f08a6ffd640 1 -- 172.21.15.130:0/3688757128 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f08a0007430 con 0x7f08b00b1460 2023-09-13T06:13:30.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.783+0000 7f08a6ffd640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0890065b50 0x7f0890068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:30.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.783+0000 7f08a6ffd640 1 -- 172.21.15.130:0/3688757128 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08a00826d0 con 0x7f08b00b1460 2023-09-13T06:13:30.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.783+0000 7f08a7fff640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0890065b50 0x7f0890068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:30.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.783+0000 7f08a7fff640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0890065b50 0x7f0890068010 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f08b013dd30 tx=0x7f0898008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:30.791 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.787+0000 7f08a6ffd640 1 -- 172.21.15.130:0/3688757128 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f08a0050160 con 0x7f08b00b1460 2023-09-13T06:13:30.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08b4a0b640 1 -- 172.21.15.130:0/3688757128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08b00b1e00 con 0x7f08b00b1460 2023-09-13T06:13:30.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08a6ffd640 1 -- 172.21.15.130:0/3688757128 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v190) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08a00170a0 con 0x7f08b00b1460 2023-09-13T06:13:30.937 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:13:30.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08b4a0b640 1 -- 172.21.15.130:0/3688757128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0890065b50 msgr2=0x7f0890068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08b4a0b640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0890065b50 0x7f0890068010 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f08b013dd30 tx=0x7f0898008040 comp rx=0 tx=0).stop 2023-09-13T06:13:30.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08b4a0b640 1 -- 172.21.15.130:0/3688757128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b00b1460 msgr2=0x7f08b01421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:30.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08b4a0b640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b00b1460 0x7f08b01421e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f08a000c420 tx=0x7f08a000c8e0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08b4a0b640 1 -- 172.21.15.130:0/3688757128 shutdown_connections 2023-09-13T06:13:30.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08b4a0b640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f0890065b50 0x7f0890068010 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08b4a0b640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08b00b2e90 0x7f08b0159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08b4a0b640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08b0144d70 0x7f08b013e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08b4a0b640 1 --2- 172.21.15.130:0/3688757128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b00b1460 0x7f08b01421e0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:30.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.935+0000 7f08b4a0b640 1 -- 172.21.15.130:0/3688757128 >> 172.21.15.130:0/3688757128 conn(0x7f08b0065990 msgr2=0x7f08b015db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:30.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.939+0000 7f08b4a0b640 1 -- 172.21.15.130:0/3688757128 shutdown_connections 2023-09-13T06:13:30.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:30.939+0000 7f08b4a0b640 1 -- 172.21.15.130:0/3688757128 wait complete. 2023-09-13T06:13:30.957 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:13:31.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d56b67640 1 Processor -- start 2023-09-13T06:13:31.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d56b67640 1 -- start start 2023-09-13T06:13:31.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d56b67640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9d500d1090 0x7f9d5015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d56b67640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9d50146f30 0x7f9d500b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d56b67640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d500b63c0 con 0x7f9d500d1750 2023-09-13T06:13:31.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d56b67640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5015dea0 con 0x7f9d50146f30 2023-09-13T06:13:31.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d56b67640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d500d0c20 con 0x7f9d500d1090 2023-09-13T06:13:31.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d54903640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9d500d1750 0x7f9d50146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:58958/0 (socket says 172.21.15.130:58958) 2023-09-13T06:13:31.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d54903640 1 -- 172.21.15.130:0/4280590635 learned_addr learned my addr 172.21.15.130:0/4280590635 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:31.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d55104640 1 --2- 172.21.15.130:0/4280590635 >> v2:172.21.15.130:3300/0 conn(0x7f9d50146f30 0x7f9d500b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d47fff640 1 --2- 172.21.15.130:0/4280590635 >> v2:172.21.15.164:3300/0 conn(0x7f9d500d1090 0x7f9d5015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d55104640 1 -- 172.21.15.130:0/4280590635 >> v2:172.21.15.164:3300/0 conn(0x7f9d500d1090 msgr2=0x7f9d5015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:31.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d55104640 1 --2- 172.21.15.130:0/4280590635 >> v2:172.21.15.164:3300/0 conn(0x7f9d500d1090 0x7f9d5015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d55104640 1 -- 172.21.15.130:0/4280590635 >> v1:172.21.15.130:6789/0 conn(0x7f9d500d1750 legacy=0x7f9d50146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d55104640 1 -- 172.21.15.130:0/4280590635 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d500b6610 con 0x7f9d50146f30 2023-09-13T06:13:31.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.095+0000 7f9d477fe640 1 -- 172.21.15.130:0/4280590635 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911688024 0 0) 0x7f9d500b63c0 con 0x7f9d500d1750 2023-09-13T06:13:31.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d55104640 1 --2- 172.21.15.130:0/4280590635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d50146f30 0x7f9d500b70f0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f9d500c8360 tx=0x7f9d4801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef2270cfbfcaace server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:31.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d477fe640 1 -- 172.21.15.130:0/4280590635 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d480a5910 con 0x7f9d50146f30 2023-09-13T06:13:31.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d477fe640 1 -- 172.21.15.130:0/4280590635 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d480a5a70 con 0x7f9d50146f30 2023-09-13T06:13:31.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d477fe640 1 -- 172.21.15.130:0/4280590635 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d480a5e00 con 0x7f9d50146f30 2023-09-13T06:13:31.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d56b67640 1 -- 172.21.15.130:0/4280590635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d50146f30 msgr2=0x7f9d500b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d56b67640 1 --2- 172.21.15.130:0/4280590635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d50146f30 0x7f9d500b70f0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f9d500c8360 tx=0x7f9d4801c850 comp rx=0 tx=0).stop 2023-09-13T06:13:31.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d56b67640 1 -- 172.21.15.130:0/4280590635 shutdown_connections 2023-09-13T06:13:31.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d56b67640 1 --2- 172.21.15.130:0/4280590635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d50146f30 0x7f9d500b70f0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d56b67640 1 --2- 172.21.15.130:0/4280590635 >> v2:172.21.15.164:3300/0 conn(0x7f9d500d1090 0x7f9d5015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d56b67640 1 -- 172.21.15.130:0/4280590635 >> 172.21.15.130:0/4280590635 conn(0x7f9d5006f170 msgr2=0x7f9d5006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:31.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d56b67640 1 -- 172.21.15.130:0/4280590635 shutdown_connections 2023-09-13T06:13:31.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.099+0000 7f9d56b67640 1 -- 172.21.15.130:0/4280590635 wait complete. 2023-09-13T06:13:31.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d56b67640 1 Processor -- start 2023-09-13T06:13:31.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d56b67640 1 -- start start 2023-09-13T06:13:31.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d56b67640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d500d1090 0x7f9d50143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d56b67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d500d1750 0x7f9d5006f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d56b67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d50146f30 0x7f9d5013c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d56b67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d50144490 con 0x7f9d500d1750 2023-09-13T06:13:31.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d56b67640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d50144770 con 0x7f9d500d1090 2023-09-13T06:13:31.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d56b67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d50144a50 con 0x7f9d50146f30 2023-09-13T06:13:31.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d47fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d500d1750 0x7f9d5006f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d47fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d500d1750 0x7f9d5006f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33150/0 (socket says 172.21.15.130:33150) 2023-09-13T06:13:31.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d47fff640 1 -- 172.21.15.130:0/3982576546 learned_addr learned my addr 172.21.15.130:0/3982576546 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:31.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d55104640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d50146f30 0x7f9d5013c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d54903640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d500d1090 0x7f9d50143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d47fff640 1 -- 172.21.15.130:0/3982576546 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d50146f30 msgr2=0x7f9d5013c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d47fff640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d50146f30 0x7f9d5013c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d47fff640 1 -- 172.21.15.130:0/3982576546 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d500d1090 msgr2=0x7f9d50143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d47fff640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d500d1090 0x7f9d50143c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d47fff640 1 -- 172.21.15.130:0/3982576546 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48009a70 con 0x7f9d500d1750 2023-09-13T06:13:31.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d47fff640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d500d1750 0x7f9d5006f550 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000d7d0 tx=0x7f9d4000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d457fa640 1 -- 172.21.15.130:0/3982576546 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40018070 con 0x7f9d500d1750 2023-09-13T06:13:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d457fa640 1 -- 172.21.15.130:0/3982576546 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40004020 con 0x7f9d500d1750 2023-09-13T06:13:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d457fa640 1 -- 172.21.15.130:0/3982576546 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d400041d0 con 0x7f9d500d1750 2023-09-13T06:13:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.103+0000 7f9d56b67640 1 -- 172.21.15.130:0/3982576546 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d500b7e40 con 0x7f9d500d1750 2023-09-13T06:13:31.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.107+0000 7f9d56b67640 1 -- 172.21.15.130:0/3982576546 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5013ce00 con 0x7f9d500d1750 2023-09-13T06:13:31.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.107+0000 7f9d56b67640 1 -- 172.21.15.130:0/3982576546 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d500618a0 con 0x7f9d500d1750 2023-09-13T06:13:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.107+0000 7f9d457fa640 1 -- 172.21.15.130:0/3982576546 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9d40004330 con 0x7f9d500d1750 2023-09-13T06:13:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.107+0000 7f9d457fa640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9d3c065b20 0x7f9d3c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.107+0000 7f9d457fa640 1 -- 172.21.15.130:0/3982576546 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d40083140 con 0x7f9d500d1750 2023-09-13T06:13:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.107+0000 7f9d54903640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9d3c065b20 0x7f9d3c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.113 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.107+0000 7f9d54903640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9d3c065b20 0x7f9d3c067fe0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c000f70 tx=0x7f9d4c007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:31.114 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.111+0000 7f9d457fa640 1 -- 172.21.15.130:0/3982576546 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9d40050b20 con 0x7f9d500d1750 2023-09-13T06:13:31.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 -- 172.21.15.130:0/3982576546 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d50144270 con 0x7f9d500d1750 2023-09-13T06:13:31.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d457fa640 1 -- 172.21.15.130:0/3982576546 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v190) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9d40054140 con 0x7f9d500d1750 2023-09-13T06:13:31.272 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:13:31.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 -- 172.21.15.130:0/3982576546 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9d3c065b20 msgr2=0x7f9d3c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9d3c065b20 0x7f9d3c067fe0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c000f70 tx=0x7f9d4c007b80 comp rx=0 tx=0).stop 2023-09-13T06:13:31.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 -- 172.21.15.130:0/3982576546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d500d1750 msgr2=0x7f9d5006f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d500d1750 0x7f9d5006f550 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000d7d0 tx=0x7f9d4000dc90 comp rx=0 tx=0).stop 2023-09-13T06:13:31.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 -- 172.21.15.130:0/3982576546 shutdown_connections 2023-09-13T06:13:31.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9d3c065b20 0x7f9d3c067fe0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d50146f30 0x7f9d5013c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d500d1750 0x7f9d5006f550 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 --2- 172.21.15.130:0/3982576546 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d500d1090 0x7f9d50143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 -- 172.21.15.130:0/3982576546 >> 172.21.15.130:0/3982576546 conn(0x7f9d5006f170 msgr2=0x7f9d5015dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:31.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 -- 172.21.15.130:0/3982576546 shutdown_connections 2023-09-13T06:13:31.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.271+0000 7f9d56b67640 1 -- 172.21.15.130:0/3982576546 wait complete. 2023-09-13T06:13:31.293 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T06:13:31.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:31.295 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-13T06:13:31.395 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:13:31.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:31.396 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T06:13:31.407 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:13:31.407 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:31.417 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:13:31.417 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:31.467 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:13:31.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6ce05c7640 1 Processor -- start 2023-09-13T06:13:31.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6ce05c7640 1 -- start start 2023-09-13T06:13:31.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6ce05c7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6cd8146f30 0x7f6cd815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6ce05c7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd80b63c0 con 0x7f6cd80d1750 2023-09-13T06:13:31.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6ce05c7640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd80d0c20 con 0x7f6cd80d1090 2023-09-13T06:13:31.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6ce05c7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd815dea0 con 0x7f6cd8146f30 2023-09-13T06:13:31.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6cde363640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6cd80d1750 0x7f6cd8146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:58968/0 (socket says 172.21.15.130:58968) 2023-09-13T06:13:31.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6cde363640 1 -- 172.21.15.130:0/3963790740 learned_addr learned my addr 172.21.15.130:0/3963790740 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:31.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6cdeb64640 1 --2- 172.21.15.130:0/3963790740 >> v2:172.21.15.130:3300/0 conn(0x7f6cd8146f30 0x7f6cd815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6cdd361640 1 -- 172.21.15.130:0/3963790740 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627056696 0 0) 0x7f6cd80b63c0 con 0x7f6cd80d1750 2023-09-13T06:13:31.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6cdd361640 1 -- 172.21.15.130:0/3963790740 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cc4003530 con 0x7f6cd80d1750 2023-09-13T06:13:31.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6cdd361640 1 -- 172.21.15.130:0/3963790740 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831952317 0 0) 0x7f6cd80d0c20 con 0x7f6cd80d1090 2023-09-13T06:13:31.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6cdeb64640 1 -- 172.21.15.130:0/3963790740 >> v1:172.21.15.164:6789/0 conn(0x7f6cd80d1090 legacy=0x7f6cd80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6cdeb64640 1 -- 172.21.15.130:0/3963790740 >> v1:172.21.15.130:6789/0 conn(0x7f6cd80d1750 legacy=0x7f6cd8146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.607+0000 7f6cdeb64640 1 -- 172.21.15.130:0/3963790740 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd80b6610 con 0x7f6cd8146f30 2023-09-13T06:13:31.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.611+0000 7f6cdeb64640 1 --2- 172.21.15.130:0/3963790740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cd8146f30 0x7f6cd815d960 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009d90 tx=0x7f6cd001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ba6ea5fa843a0e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:31.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.611+0000 7f6cdd361640 1 -- 172.21.15.130:0/3963790740 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00a5950 con 0x7f6cd8146f30 2023-09-13T06:13:31.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.611+0000 7f6cdd361640 1 -- 172.21.15.130:0/3963790740 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd00a5ab0 con 0x7f6cd8146f30 2023-09-13T06:13:31.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.611+0000 7f6cdd361640 1 -- 172.21.15.130:0/3963790740 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00a5e40 con 0x7f6cd8146f30 2023-09-13T06:13:31.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.611+0000 7f6ce05c7640 1 -- 172.21.15.130:0/3963790740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cd8146f30 msgr2=0x7f6cd815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.611+0000 7f6ce05c7640 1 --2- 172.21.15.130:0/3963790740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cd8146f30 0x7f6cd815d960 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009d90 tx=0x7f6cd001c890 comp rx=0 tx=0).stop 2023-09-13T06:13:31.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.611+0000 7f6ce05c7640 1 -- 172.21.15.130:0/3963790740 shutdown_connections 2023-09-13T06:13:31.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.611+0000 7f6ce05c7640 1 --2- 172.21.15.130:0/3963790740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cd8146f30 0x7f6cd815d960 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.611+0000 7f6ce05c7640 1 -- 172.21.15.130:0/3963790740 >> 172.21.15.130:0/3963790740 conn(0x7f6cd806f170 msgr2=0x7f6cd806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:31.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.611+0000 7f6ce05c7640 1 -- 172.21.15.130:0/3963790740 shutdown_connections 2023-09-13T06:13:31.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.611+0000 7f6ce05c7640 1 -- 172.21.15.130:0/3963790740 wait complete. 2023-09-13T06:13:31.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6ce05c7640 1 Processor -- start 2023-09-13T06:13:31.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6ce05c7640 1 -- start start 2023-09-13T06:13:31.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6ce05c7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cd80d1090 0x7f6cd8142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6ce05c7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cd80d1750 0x7f6cd814bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6ce05c7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cd8146f30 0x7f6cd815e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6ce05c7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd814c080 con 0x7f6cd80d1750 2023-09-13T06:13:31.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6ce05c7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd813a3d0 con 0x7f6cd8146f30 2023-09-13T06:13:31.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6ce05c7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd8143ca0 con 0x7f6cd80d1090 2023-09-13T06:13:31.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cddb62640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cd80d1750 0x7f6cd814bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cde363640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cd80d1090 0x7f6cd8142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cddb62640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cd80d1750 0x7f6cd814bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33170/0 (socket says 172.21.15.130:33170) 2023-09-13T06:13:31.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cddb62640 1 -- 172.21.15.130:0/2408841065 learned_addr learned my addr 172.21.15.130:0/2408841065 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:31.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cdeb64640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cd8146f30 0x7f6cd815e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cddb62640 1 -- 172.21.15.130:0/2408841065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cd80d1090 msgr2=0x7f6cd8142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cddb62640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cd80d1090 0x7f6cd8142570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cddb62640 1 -- 172.21.15.130:0/2408841065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cd8146f30 msgr2=0x7f6cd815e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cddb62640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cd8146f30 0x7f6cd815e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.621 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cddb62640 1 -- 172.21.15.130:0/2408841065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0009a70 con 0x7f6cd80d1750 2023-09-13T06:13:31.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cddb62640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cd80d1750 0x7f6cd814bb40 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c520 tx=0x7f6cc800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:31.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cceffd640 1 -- 172.21.15.130:0/2408841065 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8003600 con 0x7f6cd80d1750 2023-09-13T06:13:31.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cceffd640 1 -- 172.21.15.130:0/2408841065 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc8003780 con 0x7f6cd80d1750 2023-09-13T06:13:31.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6cceffd640 1 -- 172.21.15.130:0/2408841065 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8003b30 con 0x7f6cd80d1750 2023-09-13T06:13:31.622 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6ce05c7640 1 -- 172.21.15.130:0/2408841065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd8142c00 con 0x7f6cd80d1750 2023-09-13T06:13:31.623 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.615+0000 7f6ce05c7640 1 -- 172.21.15.130:0/2408841065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd81431c0 con 0x7f6cd80d1750 2023-09-13T06:13:31.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.619+0000 7f6ce05c7640 1 -- 172.21.15.130:0/2408841065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd80618a0 con 0x7f6cd80d1750 2023-09-13T06:13:31.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.619+0000 7f6cceffd640 1 -- 172.21.15.130:0/2408841065 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6cc8003c90 con 0x7f6cd80d1750 2023-09-13T06:13:31.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.619+0000 7f6cceffd640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cbc065b20 0x7f6cbc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.619+0000 7f6cceffd640 1 -- 172.21.15.130:0/2408841065 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cc80828b0 con 0x7f6cd80d1750 2023-09-13T06:13:31.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.619+0000 7f6cde363640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cbc065b20 0x7f6cbc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.619+0000 7f6cde363640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cbc065b20 0x7f6cbc067fe0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4007fd0 tx=0x7f6cd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:31.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.623+0000 7f6cceffd640 1 -- 172.21.15.130:0/2408841065 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6cc80502a0 con 0x7f6cd80d1750 2023-09-13T06:13:31.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.775+0000 7f6ce05c7640 1 -- 172.21.15.130:0/2408841065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cd80b86c0 con 0x7f6cd80d1750 2023-09-13T06:13:31.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.775+0000 7f6cceffd640 1 -- 172.21.15.130:0/2408841065 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+16615 (secure 0 0 0) 0x7f6cc8017070 con 0x7f6cd80d1750 2023-09-13T06:13:31.777 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:31.778 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":190,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:13:22.489989+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:12:49.873320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-09-13T06:12:51.142196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:13:31.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 -- 172.21.15.130:0/2408841065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cbc065b20 msgr2=0x7f6cbc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cbc065b20 0x7f6cbc067fe0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4007fd0 tx=0x7f6cd4009040 comp rx=0 tx=0).stop 2023-09-13T06:13:31.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 -- 172.21.15.130:0/2408841065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cd80d1750 msgr2=0x7f6cd814bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cd80d1750 0x7f6cd814bb40 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c520 tx=0x7f6cc800c9e0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 -- 172.21.15.130:0/2408841065 shutdown_connections 2023-09-13T06:13:31.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6cbc065b20 0x7f6cbc067fe0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cd8146f30 0x7f6cd815e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cd80d1750 0x7f6cd814bb40 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 --2- 172.21.15.130:0/2408841065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cd80d1090 0x7f6cd8142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 -- 172.21.15.130:0/2408841065 >> 172.21.15.130:0/2408841065 conn(0x7f6cd806f170 msgr2=0x7f6cd815f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:31.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 -- 172.21.15.130:0/2408841065 shutdown_connections 2023-09-13T06:13:31.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.779+0000 7f6ce05c7640 1 -- 172.21.15.130:0/2408841065 wait complete. 2023-09-13T06:13:31.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:12:49.873320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '186', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:12:51.142196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:13:31.799 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:13:31.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fdaa04cb640 1 Processor -- start 2023-09-13T06:13:31.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fdaa04cb640 1 -- start start 2023-09-13T06:13:31.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fdaa04cb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fda980d2cd0 0x7fda981612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fdaa04cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda981617e0 0x7fda980cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.945 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fdaa04cb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9815dd40 con 0x7fda9815ae10 2023-09-13T06:13:31.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fdaa04cb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9815e020 con 0x7fda980d2cd0 2023-09-13T06:13:31.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fdaa04cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9815e300 con 0x7fda981617e0 2023-09-13T06:13:31.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fda9da66640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fda980d2cd0 0x7fda981612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.946 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fda9da66640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fda980d2cd0 0x7fda981612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33172/0 (socket says 172.21.15.130:33172) 2023-09-13T06:13:31.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fda9da66640 1 -- 172.21.15.130:0/2466495845 learned_addr learned my addr 172.21.15.130:0/2466495845 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:31.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fda9e267640 1 --1- 172.21.15.130:0/2466495845 >> v1:172.21.15.164:6789/0 conn(0x7fda9815ae10 0x7fda980d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:53154/0 (socket says 172.21.15.130:53154) 2023-09-13T06:13:31.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fda9ea68640 1 --2- 172.21.15.130:0/2466495845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda981617e0 0x7fda980cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fda9da66640 1 -- 172.21.15.130:0/2466495845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda981617e0 msgr2=0x7fda980cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:31.947 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fda9d265640 1 -- 172.21.15.130:0/2466495845 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972777792 0 0) 0x7fda9815dd40 con 0x7fda9815ae10 2023-09-13T06:13:31.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fda9da66640 1 --2- 172.21.15.130:0/2466495845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda981617e0 0x7fda980cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fda9da66640 1 -- 172.21.15.130:0/2466495845 >> v1:172.21.15.164:6789/0 conn(0x7fda9815ae10 legacy=0x7fda980d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.939+0000 7fda9da66640 1 -- 172.21.15.130:0/2466495845 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9815e5e0 con 0x7fda980d2cd0 2023-09-13T06:13:31.951 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fda9da66640 1 --2- 172.21.15.130:0/2466495845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda980d2cd0 0x7fda981612a0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fda88009870 tx=0x7fda8801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06ef667682d44a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:31.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fda9d265640 1 -- 172.21.15.130:0/2466495845 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98161e20 con 0x7fda980d2cd0 2023-09-13T06:13:31.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fda9d265640 1 -- 172.21.15.130:0/2466495845 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda880aa430 con 0x7fda980d2cd0 2023-09-13T06:13:31.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fda9d265640 1 -- 172.21.15.130:0/2466495845 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda880aa7c0 con 0x7fda980d2cd0 2023-09-13T06:13:31.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2466495845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda980d2cd0 msgr2=0x7fda981612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.952 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fdaa04cb640 1 --2- 172.21.15.130:0/2466495845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda980d2cd0 0x7fda981612a0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fda88009870 tx=0x7fda8801c4b0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2466495845 shutdown_connections 2023-09-13T06:13:31.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fdaa04cb640 1 --2- 172.21.15.130:0/2466495845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda981617e0 0x7fda980cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fdaa04cb640 1 --2- 172.21.15.130:0/2466495845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda980d2cd0 0x7fda981612a0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.953 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2466495845 >> 172.21.15.130:0/2466495845 conn(0x7fda98065990 msgr2=0x7fda98065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:31.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2466495845 shutdown_connections 2023-09-13T06:13:31.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.943+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2466495845 wait complete. 2023-09-13T06:13:31.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fdaa04cb640 1 Processor -- start 2023-09-13T06:13:31.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fdaa04cb640 1 -- start start 2023-09-13T06:13:31.954 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fdaa04cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda980d2cd0 0x7fda98155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fdaa04cb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9815ae10 0x7fda98163c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fdaa04cb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda981617e0 0x7fda98156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fdaa04cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda981650a0 con 0x7fda980d2cd0 2023-09-13T06:13:31.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fdaa04cb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda981563e0 con 0x7fda9815ae10 2023-09-13T06:13:31.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fdaa04cb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda98164150 con 0x7fda981617e0 2023-09-13T06:13:31.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda9e267640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda980d2cd0 0x7fda98155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda9e267640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda980d2cd0 0x7fda98155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33182/0 (socket says 172.21.15.130:33182) 2023-09-13T06:13:31.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda9e267640 1 -- 172.21.15.130:0/2309535405 learned_addr learned my addr 172.21.15.130:0/2309535405 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:31.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda9da66640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9815ae10 0x7fda98163c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda9ea68640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda981617e0 0x7fda98156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda9e267640 1 -- 172.21.15.130:0/2309535405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda981617e0 msgr2=0x7fda98156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda9e267640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda981617e0 0x7fda98156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda9e267640 1 -- 172.21.15.130:0/2309535405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9815ae10 msgr2=0x7fda98163c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:31.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda9e267640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9815ae10 0x7fda98163c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:31.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda9e267640 1 -- 172.21.15.130:0/2309535405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda880094d0 con 0x7fda980d2cd0 2023-09-13T06:13:31.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda9e267640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda980d2cd0 0x7fda98155ea0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fda940011f0 tx=0x7fda9400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:31.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda8effd640 1 -- 172.21.15.130:0/2309535405 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940074e0 con 0x7fda980d2cd0 2023-09-13T06:13:31.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda8effd640 1 -- 172.21.15.130:0/2309535405 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda94007640 con 0x7fda980d2cd0 2023-09-13T06:13:31.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fda8effd640 1 -- 172.21.15.130:0/2309535405 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94004a10 con 0x7fda980d2cd0 2023-09-13T06:13:31.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2309535405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda98164420 con 0x7fda980d2cd0 2023-09-13T06:13:31.959 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.947+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2309535405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda981649e0 con 0x7fda980d2cd0 2023-09-13T06:13:31.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.951+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2309535405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda981651e0 con 0x7fda980d2cd0 2023-09-13T06:13:31.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.951+0000 7fda8effd640 1 -- 172.21.15.130:0/2309535405 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fda94004b70 con 0x7fda980d2cd0 2023-09-13T06:13:31.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.951+0000 7fda8effd640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda7c065b20 0x7fda7c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:31.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.951+0000 7fda8effd640 1 -- 172.21.15.130:0/2309535405 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda94082530 con 0x7fda980d2cd0 2023-09-13T06:13:31.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.951+0000 7fda9da66640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda7c065b20 0x7fda7c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:31.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.951+0000 7fda9da66640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda7c065b20 0x7fda7c067fe0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fda880ae000 tx=0x7fda880b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:31.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:31.955+0000 7fda8effd640 1 -- 172.21.15.130:0/2309535405 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fda9404ff20 con 0x7fda980d2cd0 2023-09-13T06:13:32.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.103+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2309535405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda980618a0 con 0x7fda980d2cd0 2023-09-13T06:13:32.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.103+0000 7fda8effd640 1 -- 172.21.15.130:0/2309535405 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v190) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda940180a0 con 0x7fda980d2cd0 2023-09-13T06:13:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:13:32.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2309535405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda7c065b20 msgr2=0x7fda7c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda7c065b20 0x7fda7c067fe0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fda880ae000 tx=0x7fda880b5040 comp rx=0 tx=0).stop 2023-09-13T06:13:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2309535405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda980d2cd0 msgr2=0x7fda98155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda980d2cd0 0x7fda98155ea0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fda940011f0 tx=0x7fda9400c9b0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2309535405 shutdown_connections 2023-09-13T06:13:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fda7c065b20 0x7fda7c067fe0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda9815ae10 0x7fda98163c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda981617e0 0x7fda98156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 --2- 172.21.15.130:0/2309535405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda980d2cd0 0x7fda98155ea0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2309535405 >> 172.21.15.130:0/2309535405 conn(0x7fda98065990 msgr2=0x7fda9815a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:32.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2309535405 shutdown_connections 2023-09-13T06:13:32.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.107+0000 7fdaa04cb640 1 -- 172.21.15.130:0/2309535405 wait complete. 2023-09-13T06:13:32.127 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:13:32.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.267+0000 7f7327c0b640 1 Processor -- start 2023-09-13T06:13:32.269 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.267+0000 7f7327c0b640 1 -- start start 2023-09-13T06:13:32.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f7327c0b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f73200b31a0 0x7f73200ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f7327c0b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73200cc850 con 0x7f732015a080 2023-09-13T06:13:32.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f7327c0b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73200b0330 con 0x7f73200b1460 2023-09-13T06:13:32.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f7327c0b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73200cbcd0 con 0x7f73200b31a0 2023-09-13T06:13:32.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f73259a7640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f732015a080 0x7f732015e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:58980/0 (socket says 172.21.15.130:58980) 2023-09-13T06:13:32.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f73259a7640 1 -- 172.21.15.130:0/2918155602 learned_addr learned my addr 172.21.15.130:0/2918155602 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:32.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f73261a8640 1 --2- 172.21.15.130:0/2918155602 >> v2:172.21.15.164:3300/0 conn(0x7f73200b31a0 0x7f73200ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.272 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f73249a5640 1 -- 172.21.15.130:0/2918155602 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201272373 0 0) 0x7f731c001120 con 0x7f732015a080 2023-09-13T06:13:32.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f73249a5640 1 -- 172.21.15.130:0/2918155602 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f730c003530 con 0x7f732015a080 2023-09-13T06:13:32.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f73261a8640 1 -- 172.21.15.130:0/2918155602 >> v1:172.21.15.164:6789/0 conn(0x7f73200b1460 legacy=0x7f73200b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f73261a8640 1 -- 172.21.15.130:0/2918155602 >> v1:172.21.15.130:6789/0 conn(0x7f732015a080 legacy=0x7f732015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.273 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f73261a8640 1 -- 172.21.15.130:0/2918155602 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73200cbfb0 con 0x7f73200b31a0 2023-09-13T06:13:32.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.271+0000 7f73261a8640 1 --2- 172.21.15.130:0/2918155602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73200b31a0 0x7f73200ccfe0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7318009d90 tx=0x7f731801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52fca21743fa3d04 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:32.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f73249a5640 1 -- 172.21.15.130:0/2918155602 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73180a5660 con 0x7f73200b31a0 2023-09-13T06:13:32.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f73249a5640 1 -- 172.21.15.130:0/2918155602 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73180a57c0 con 0x7f73200b31a0 2023-09-13T06:13:32.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f73249a5640 1 -- 172.21.15.130:0/2918155602 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73180a5b50 con 0x7f73200b31a0 2023-09-13T06:13:32.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 -- 172.21.15.130:0/2918155602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73200b31a0 msgr2=0x7f73200ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 --2- 172.21.15.130:0/2918155602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73200b31a0 0x7f73200ccfe0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7318009d90 tx=0x7f731801c890 comp rx=0 tx=0).stop 2023-09-13T06:13:32.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 -- 172.21.15.130:0/2918155602 shutdown_connections 2023-09-13T06:13:32.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 --2- 172.21.15.130:0/2918155602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73200b31a0 0x7f73200ccfe0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 -- 172.21.15.130:0/2918155602 >> 172.21.15.130:0/2918155602 conn(0x7f7320065990 msgr2=0x7f7320065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:32.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 -- 172.21.15.130:0/2918155602 shutdown_connections 2023-09-13T06:13:32.277 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 -- 172.21.15.130:0/2918155602 wait complete. 2023-09-13T06:13:32.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 Processor -- start 2023-09-13T06:13:32.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 -- start start 2023-09-13T06:13:32.279 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73200b1460 0x7f7320143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73200b31a0 0x7f73201683d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f732015a080 0x7f7320155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7320168e20 con 0x7f732015a080 2023-09-13T06:13:32.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7320169100 con 0x7f73200b31a0 2023-09-13T06:13:32.280 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f7327c0b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73201693e0 con 0x7f73200b1460 2023-09-13T06:13:32.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f73261a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f732015a080 0x7f7320155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f73261a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f732015a080 0x7f7320155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33186/0 (socket says 172.21.15.130:33186) 2023-09-13T06:13:32.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f73261a8640 1 -- 172.21.15.130:0/3334596728 learned_addr learned my addr 172.21.15.130:0/3334596728 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:32.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f73259a7640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73200b1460 0x7f7320143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.275+0000 7f73251a6640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73200b31a0 0x7f73201683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.281 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73261a8640 1 -- 172.21.15.130:0/3334596728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73200b1460 msgr2=0x7f7320143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73261a8640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73200b1460 0x7f7320143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73261a8640 1 -- 172.21.15.130:0/3334596728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73200b31a0 msgr2=0x7f73201683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73261a8640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73200b31a0 0x7f73201683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.282 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73261a8640 1 -- 172.21.15.130:0/3334596728 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7318009a70 con 0x7f732015a080 2023-09-13T06:13:32.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73251a6640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73200b31a0 0x7f73201683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:32.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73259a7640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73200b1460 0x7f7320143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:32.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73261a8640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f732015a080 0x7f7320155b60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f731801a4c0 tx=0x7f7318019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:32.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73167fc640 1 -- 172.21.15.130:0/3334596728 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73180ad850 con 0x7f732015a080 2023-09-13T06:13:32.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73167fc640 1 -- 172.21.15.130:0/3334596728 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73180ad9b0 con 0x7f732015a080 2023-09-13T06:13:32.283 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73167fc640 1 -- 172.21.15.130:0/3334596728 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73180add20 con 0x7f732015a080 2023-09-13T06:13:32.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f7327c0b640 1 -- 172.21.15.130:0/3334596728 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73201696c0 con 0x7f732015a080 2023-09-13T06:13:32.284 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f7327c0b640 1 -- 172.21.15.130:0/3334596728 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7320143e80 con 0x7f732015a080 2023-09-13T06:13:32.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f7327c0b640 1 -- 172.21.15.130:0/3334596728 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7320169be0 con 0x7f732015a080 2023-09-13T06:13:32.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.279+0000 7f73167fc640 1 -- 172.21.15.130:0/3334596728 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f73180b4050 con 0x7f732015a080 2023-09-13T06:13:32.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.283+0000 7f73167fc640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7304065b20 0x7f7304067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.283+0000 7f73167fc640 1 -- 172.21.15.130:0/3334596728 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f731811e490 con 0x7f732015a080 2023-09-13T06:13:32.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.283+0000 7f73259a7640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7304065b20 0x7f7304067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.283+0000 7f73259a7640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7304065b20 0x7f7304067fe0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f731c001280 tx=0x7f731c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:32.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.283+0000 7f73167fc640 1 -- 172.21.15.130:0/3334596728 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f73180ebfa0 con 0x7f732015a080 2023-09-13T06:13:32.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.431+0000 7f7327c0b640 1 -- 172.21.15.130:0/3334596728 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7320169be0 con 0x7f732015a080 2023-09-13T06:13:32.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.431+0000 7f73167fc640 1 -- 172.21.15.130:0/3334596728 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v190) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7320169be0 con 0x7f732015a080 2023-09-13T06:13:32.436 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:13:32.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 -- 172.21.15.130:0/3334596728 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7304065b20 msgr2=0x7f7304067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7304065b20 0x7f7304067fe0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f731c001280 tx=0x7f731c009040 comp rx=0 tx=0).stop 2023-09-13T06:13:32.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 -- 172.21.15.130:0/3334596728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f732015a080 msgr2=0x7f7320155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f732015a080 0x7f7320155b60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f731801a4c0 tx=0x7f7318019630 comp rx=0 tx=0).stop 2023-09-13T06:13:32.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 -- 172.21.15.130:0/3334596728 shutdown_connections 2023-09-13T06:13:32.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7304065b20 0x7f7304067fe0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73200b31a0 0x7f73201683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f732015a080 0x7f7320155b60 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.440 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 --2- 172.21.15.130:0/3334596728 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73200b1460 0x7f7320143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 -- 172.21.15.130:0/3334596728 >> 172.21.15.130:0/3334596728 conn(0x7f7320065990 msgr2=0x7f732014d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:32.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 -- 172.21.15.130:0/3334596728 shutdown_connections 2023-09-13T06:13:32.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.435+0000 7f7327c0b640 1 -- 172.21.15.130:0/3334596728 wait complete. 2023-09-13T06:13:32.454 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:13:32.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0e5aec640 1 Processor -- start 2023-09-13T06:13:32.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0e5aec640 1 -- start start 2023-09-13T06:13:32.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0e5aec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb0e00d0930 0x7fb0e00b6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0e5aec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e00b2e00 con 0x7fb0e015c470 2023-09-13T06:13:32.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0e5aec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e00b2b20 con 0x7fb0e0158f50 2023-09-13T06:13:32.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0e5aec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e015b990 con 0x7fb0e00d0930 2023-09-13T06:13:32.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0deffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb0e00d0930 0x7fb0e00b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0dffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb0e015c470 0x7fb0e006d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:58992/0 (socket says 172.21.15.130:58992) 2023-09-13T06:13:32.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0dffff640 1 -- 172.21.15.130:0/3722879415 learned_addr learned my addr 172.21.15.130:0/3722879415 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:32.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0de7fc640 1 -- 172.21.15.130:0/3722879415 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388792474 0 0) 0x7fb0e00b2e00 con 0x7fb0e015c470 2023-09-13T06:13:32.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0deffd640 1 -- 172.21.15.130:0/3722879415 >> v1:172.21.15.164:6789/0 conn(0x7fb0e0158f50 legacy=0x7fb0e00b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:32.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0deffd640 1 -- 172.21.15.130:0/3722879415 >> v1:172.21.15.130:6789/0 conn(0x7fb0e015c470 legacy=0x7fb0e006d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.599+0000 7fb0deffd640 1 -- 172.21.15.130:0/3722879415 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e015bc70 con 0x7fb0e00d0930 2023-09-13T06:13:32.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.603+0000 7fb0deffd640 1 --2- 172.21.15.130:0/3722879415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0e00d0930 0x7fb0e00b6860 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40097c0 tx=0x7fb0d401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ad61f7e9408f86 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:32.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.603+0000 7fb0de7fc640 1 -- 172.21.15.130:0/3722879415 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40ab600 con 0x7fb0e00d0930 2023-09-13T06:13:32.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.603+0000 7fb0de7fc640 1 -- 172.21.15.130:0/3722879415 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d40a7050 con 0x7fb0e00d0930 2023-09-13T06:13:32.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.603+0000 7fb0de7fc640 1 -- 172.21.15.130:0/3722879415 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40ab980 con 0x7fb0e00d0930 2023-09-13T06:13:32.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.603+0000 7fb0e5aec640 1 -- 172.21.15.130:0/3722879415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0e00d0930 msgr2=0x7fb0e00b6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.603+0000 7fb0e5aec640 1 --2- 172.21.15.130:0/3722879415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0e00d0930 0x7fb0e00b6860 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40097c0 tx=0x7fb0d401c410 comp rx=0 tx=0).stop 2023-09-13T06:13:32.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.603+0000 7fb0e5aec640 1 -- 172.21.15.130:0/3722879415 shutdown_connections 2023-09-13T06:13:32.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.603+0000 7fb0e5aec640 1 --2- 172.21.15.130:0/3722879415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0e00d0930 0x7fb0e00b6860 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.603+0000 7fb0e5aec640 1 -- 172.21.15.130:0/3722879415 >> 172.21.15.130:0/3722879415 conn(0x7fb0e0065990 msgr2=0x7fb0e0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:32.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.603+0000 7fb0e5aec640 1 -- 172.21.15.130:0/3722879415 shutdown_connections 2023-09-13T06:13:32.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.603+0000 7fb0e5aec640 1 -- 172.21.15.130:0/3722879415 wait complete. 2023-09-13T06:13:32.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0e5aec640 1 Processor -- start 2023-09-13T06:13:32.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0e5aec640 1 -- start start 2023-09-13T06:13:32.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0e5aec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0e00d0930 0x7fb0e0153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0e5aec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e0158f50 0x7fb0e01f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0e5aec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e015c470 0x7fb0e0157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0e5aec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e0154780 con 0x7fb0e00d0930 2023-09-13T06:13:32.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0e5aec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e0153b70 con 0x7fb0e015c470 2023-09-13T06:13:32.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0e5aec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e0153e50 con 0x7fb0e0158f50 2023-09-13T06:13:32.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0df7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0e00d0930 0x7fb0e0153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0df7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0e00d0930 0x7fb0e0153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33218/0 (socket says 172.21.15.130:33218) 2023-09-13T06:13:32.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0df7fe640 1 -- 172.21.15.130:0/662023251 learned_addr learned my addr 172.21.15.130:0/662023251 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:32.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0df7fe640 1 -- 172.21.15.130:0/662023251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e0158f50 msgr2=0x7fb0e01f3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0df7fe640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e0158f50 0x7fb0e01f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0df7fe640 1 -- 172.21.15.130:0/662023251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e015c470 msgr2=0x7fb0e0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0df7fe640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e015c470 0x7fb0e0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0df7fe640 1 -- 172.21.15.130:0/662023251 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4009420 con 0x7fb0e00d0930 2023-09-13T06:13:32.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0df7fe640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0e00d0930 0x7fb0e0153000 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c450 tx=0x7fb0d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:32.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0c7fff640 1 -- 172.21.15.130:0/662023251 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0012830 con 0x7fb0e00d0930 2023-09-13T06:13:32.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0c7fff640 1 -- 172.21.15.130:0/662023251 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d00129b0 con 0x7fb0e00d0930 2023-09-13T06:13:32.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0c7fff640 1 -- 172.21.15.130:0/662023251 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0012d60 con 0x7fb0e00d0930 2023-09-13T06:13:32.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0e5aec640 1 -- 172.21.15.130:0/662023251 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e0154130 con 0x7fb0e00d0930 2023-09-13T06:13:32.613 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.607+0000 7fb0e5aec640 1 -- 172.21.15.130:0/662023251 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e0153540 con 0x7fb0e00d0930 2023-09-13T06:13:32.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.611+0000 7fb0e5aec640 1 -- 172.21.15.130:0/662023251 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e00618a0 con 0x7fb0e00d0930 2023-09-13T06:13:32.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.611+0000 7fb0c7fff640 1 -- 172.21.15.130:0/662023251 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb0d001c460 con 0x7fb0e00d0930 2023-09-13T06:13:32.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.611+0000 7fb0c7fff640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0cc065b20 0x7fb0cc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.611+0000 7fb0c7fff640 1 -- 172.21.15.130:0/662023251 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0d0083190 con 0x7fb0e00d0930 2023-09-13T06:13:32.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.611+0000 7fb0deffd640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0cc065b20 0x7fb0cc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.611+0000 7fb0deffd640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0cc065b20 0x7fb0cc067fe0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40ad000 tx=0x7fb0d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:32.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.615+0000 7fb0c7fff640 1 -- 172.21.15.130:0/662023251 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb0d0050ac0 con 0x7fb0e00d0930 2023-09-13T06:13:32.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.763+0000 7fb0e5aec640 1 -- 172.21.15.130:0/662023251 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0e00b4ba0 con 0x7fb0e00d0930 2023-09-13T06:13:32.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.763+0000 7fb0c7fff640 1 -- 172.21.15.130:0/662023251 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v190) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0d00540e0 con 0x7fb0e00d0930 2023-09-13T06:13:32.766 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:13:32.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 -- 172.21.15.130:0/662023251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0cc065b20 msgr2=0x7fb0cc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0cc065b20 0x7fb0cc067fe0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40ad000 tx=0x7fb0d4008040 comp rx=0 tx=0).stop 2023-09-13T06:13:32.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 -- 172.21.15.130:0/662023251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0e00d0930 msgr2=0x7fb0e0153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.770 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0e00d0930 0x7fb0e0153000 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c450 tx=0x7fb0d000c910 comp rx=0 tx=0).stop 2023-09-13T06:13:32.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 -- 172.21.15.130:0/662023251 shutdown_connections 2023-09-13T06:13:32.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb0cc065b20 0x7fb0cc067fe0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0e015c470 0x7fb0e0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0e0158f50 0x7fb0e01f3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 --2- 172.21.15.130:0/662023251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0e00d0930 0x7fb0e0153000 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 -- 172.21.15.130:0/662023251 >> 172.21.15.130:0/662023251 conn(0x7fb0e0065990 msgr2=0x7fb0e00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:32.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 -- 172.21.15.130:0/662023251 shutdown_connections 2023-09-13T06:13:32.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.767+0000 7fb0e5aec640 1 -- 172.21.15.130:0/662023251 wait complete. 2023-09-13T06:13:32.787 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T06:13:32.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc1f034640 1 Processor -- start 2023-09-13T06:13:32.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc1f034640 1 -- start start 2023-09-13T06:13:32.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc1f034640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efc18157920 0x7efc180ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc1f034640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc180afee0 con 0x7efc180b0f40 2023-09-13T06:13:32.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc1f034640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc180b0180 con 0x7efc180b1d20 2023-09-13T06:13:32.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc1f034640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc180aea50 con 0x7efc18157920 2023-09-13T06:13:32.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc17fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7efc180b0f40 0x7efc180b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59002/0 (socket says 172.21.15.130:59002) 2023-09-13T06:13:32.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc17fff640 1 -- 172.21.15.130:0/1673187535 learned_addr learned my addr 172.21.15.130:0/1673187535 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:32.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc1cdd0640 1 --2- 172.21.15.130:0/1673187535 >> v2:172.21.15.164:3300/0 conn(0x7efc18157920 0x7efc180ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc177fe640 1 -- 172.21.15.130:0/1673187535 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664054116 0 0) 0x7efc180afee0 con 0x7efc180b0f40 2023-09-13T06:13:32.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc177fe640 1 -- 172.21.15.130:0/1673187535 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc08003530 con 0x7efc180b0f40 2023-09-13T06:13:32.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc1cdd0640 1 -- 172.21.15.130:0/1673187535 >> v1:172.21.15.164:6789/0 conn(0x7efc180b1d20 legacy=0x7efc1806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc1cdd0640 1 -- 172.21.15.130:0/1673187535 >> v1:172.21.15.130:6789/0 conn(0x7efc180b0f40 legacy=0x7efc180b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.927+0000 7efc1cdd0640 1 -- 172.21.15.130:0/1673187535 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180b0460 con 0x7efc18157920 2023-09-13T06:13:32.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.931+0000 7efc1cdd0640 1 --2- 172.21.15.130:0/1673187535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc18157920 0x7efc180ae190 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0097c0 tx=0x7efc0c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81702726ce7654f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:32.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.931+0000 7efc177fe640 1 -- 172.21.15.130:0/1673187535 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0ab670 con 0x7efc18157920 2023-09-13T06:13:32.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.931+0000 7efc177fe640 1 -- 172.21.15.130:0/1673187535 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c0ab7d0 con 0x7efc18157920 2023-09-13T06:13:32.933 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.931+0000 7efc177fe640 1 -- 172.21.15.130:0/1673187535 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0abb60 con 0x7efc18157920 2023-09-13T06:13:32.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.931+0000 7efc1f034640 1 -- 172.21.15.130:0/1673187535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc18157920 msgr2=0x7efc180ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.931+0000 7efc1f034640 1 --2- 172.21.15.130:0/1673187535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc18157920 0x7efc180ae190 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0097c0 tx=0x7efc0c01c450 comp rx=0 tx=0).stop 2023-09-13T06:13:32.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.931+0000 7efc1f034640 1 -- 172.21.15.130:0/1673187535 shutdown_connections 2023-09-13T06:13:32.934 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.931+0000 7efc1f034640 1 --2- 172.21.15.130:0/1673187535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc18157920 0x7efc180ae190 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.931+0000 7efc1f034640 1 -- 172.21.15.130:0/1673187535 >> 172.21.15.130:0/1673187535 conn(0x7efc18065990 msgr2=0x7efc18065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:32.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.931+0000 7efc1f034640 1 -- 172.21.15.130:0/1673187535 shutdown_connections 2023-09-13T06:13:32.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.931+0000 7efc1f034640 1 -- 172.21.15.130:0/1673187535 wait complete. 2023-09-13T06:13:32.935 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1f034640 1 Processor -- start 2023-09-13T06:13:32.936 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1f034640 1 -- start start 2023-09-13T06:13:32.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1f034640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc180b0f40 0x7efc181688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.937 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1f034640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc180b1d20 0x7efc181516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1f034640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc18157920 0x7efc1814c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1f034640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b0b20 con 0x7efc180b0f40 2023-09-13T06:13:32.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1f034640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc18154830 con 0x7efc180b1d20 2023-09-13T06:13:32.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1f034640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc18152630 con 0x7efc18157920 2023-09-13T06:13:32.938 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1cdd0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc180b0f40 0x7efc181688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1cdd0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc180b0f40 0x7efc181688a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33232/0 (socket says 172.21.15.130:33232) 2023-09-13T06:13:32.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1cdd0640 1 -- 172.21.15.130:0/1650240492 learned_addr learned my addr 172.21.15.130:0/1650240492 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:32.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1d5d1640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc18157920 0x7efc1814c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1cdd0640 1 -- 172.21.15.130:0/1650240492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc18157920 msgr2=0x7efc1814c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.939 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc17fff640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc180b1d20 0x7efc181516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1cdd0640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc18157920 0x7efc1814c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1cdd0640 1 -- 172.21.15.130:0/1650240492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc180b1d20 msgr2=0x7efc181516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:32.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1cdd0640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc180b1d20 0x7efc181516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:32.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1cdd0640 1 -- 172.21.15.130:0/1650240492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c009420 con 0x7efc180b0f40 2023-09-13T06:13:32.940 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1d5d1640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc18157920 0x7efc1814c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:32.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc17fff640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc180b1d20 0x7efc181516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:32.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1cdd0640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc180b0f40 0x7efc181688a0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7efc0c019060 tx=0x7efc0c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:32.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc157fa640 1 -- 172.21.15.130:0/1650240492 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0bf610 con 0x7efc180b0f40 2023-09-13T06:13:32.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc157fa640 1 -- 172.21.15.130:0/1650240492 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c0bf770 con 0x7efc180b0f40 2023-09-13T06:13:32.941 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc157fa640 1 -- 172.21.15.130:0/1650240492 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0bfb20 con 0x7efc180b0f40 2023-09-13T06:13:32.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1f034640 1 -- 172.21.15.130:0/1650240492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc18153a40 con 0x7efc180b0f40 2023-09-13T06:13:32.942 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.935+0000 7efc1f034640 1 -- 172.21.15.130:0/1650240492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc18154000 con 0x7efc180b0f40 2023-09-13T06:13:32.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.939+0000 7efc1f034640 1 -- 172.21.15.130:0/1650240492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc180618a0 con 0x7efc180b0f40 2023-09-13T06:13:32.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.939+0000 7efc157fa640 1 -- 172.21.15.130:0/1650240492 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efc0c0b5400 con 0x7efc180b0f40 2023-09-13T06:13:32.943 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.939+0000 7efc157fa640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efbfc065b20 0x7efbfc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:32.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.939+0000 7efc157fa640 1 -- 172.21.15.130:0/1650240492 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc0c11e170 con 0x7efc180b0f40 2023-09-13T06:13:32.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.939+0000 7efc17fff640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efbfc065b20 0x7efbfc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:32.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.939+0000 7efc17fff640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efbfc065b20 0x7efbfc067fe0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efc181521e0 tx=0x7efc04009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:32.944 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:32.943+0000 7efc157fa640 1 -- 172.21.15.130:0/1650240492 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7efc0c0ebab0 con 0x7efc180b0f40 2023-09-13T06:13:33.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.103+0000 7efc1f034640 1 -- 172.21.15.130:0/1650240492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efc180ace00 con 0x7efc180b0f40 2023-09-13T06:13:33.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.103+0000 7efc157fa640 1 -- 172.21.15.130:0/1650240492 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v190) v1 ==== 80+0+0 (secure 0 0 0) 0x7efc0c0ef0d0 con 0x7efc180b0f40 2023-09-13T06:13:33.105 INFO:teuthology.orchestra.run.smithi130.stderr:listed 0 entries 2023-09-13T06:13:33.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 -- 172.21.15.130:0/1650240492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efbfc065b20 msgr2=0x7efbfc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efbfc065b20 0x7efbfc067fe0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efc181521e0 tx=0x7efc04009040 comp rx=0 tx=0).stop 2023-09-13T06:13:33.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 -- 172.21.15.130:0/1650240492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc180b0f40 msgr2=0x7efc181688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc180b0f40 0x7efc181688a0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7efc0c019060 tx=0x7efc0c01ac90 comp rx=0 tx=0).stop 2023-09-13T06:13:33.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 -- 172.21.15.130:0/1650240492 shutdown_connections 2023-09-13T06:13:33.109 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7efbfc065b20 0x7efbfc067fe0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efc180b1d20 0x7efc181516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efc18157920 0x7efc1814c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.110 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 --2- 172.21.15.130:0/1650240492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc180b0f40 0x7efc181688a0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 -- 172.21.15.130:0/1650240492 >> 172.21.15.130:0/1650240492 conn(0x7efc18065990 msgr2=0x7efc180ad320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:33.111 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 -- 172.21.15.130:0/1650240492 shutdown_connections 2023-09-13T06:13:33.112 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.107+0000 7efc1f034640 1 -- 172.21.15.130:0/1650240492 wait complete. 2023-09-13T06:13:33.126 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T06:13:33.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:33.127 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-09-13T06:13:33.192 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:13:33.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:33.193 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T06:13:33.203 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:13:33.203 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:33.213 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:13:33.214 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:13:33.214 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:33.260 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:13:33.261 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:13:33.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.395+0000 7fd7667c7640 1 Processor -- start 2023-09-13T06:13:33.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.395+0000 7fd7667c7640 1 -- start start 2023-09-13T06:13:33.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd7667c7640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd760159f20 0x7fd7600ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd7667c7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7600ccfd0 con 0x7fd7600b1d20 2023-09-13T06:13:33.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd7667c7640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7600ced90 con 0x7fd7600cdfc0 2023-09-13T06:13:33.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd7667c7640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7600b00f0 con 0x7fd760159f20 2023-09-13T06:13:33.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd764d64640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd7600b1d20 0x7fd7600ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59018/0 (socket says 172.21.15.130:59018) 2023-09-13T06:13:33.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd764d64640 1 -- 172.21.15.130:0/2055047276 learned_addr learned my addr 172.21.15.130:0/2055047276 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:33.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75ffff640 1 --2- 172.21.15.130:0/2055047276 >> v2:172.21.15.164:3300/0 conn(0x7fd760159f20 0x7fd7600ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972318079 0 0) 0x7fd7600ccfd0 con 0x7fd7600b1d20 2023-09-13T06:13:33.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd748005740 con 0x7fd7600b1d20 2023-09-13T06:13:33.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1826347370 0 0) 0x7fd748005740 con 0x7fd7600b1d20 2023-09-13T06:13:33.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 >> v2:172.21.15.164:3300/0 conn(0x7fd760159f20 msgr2=0x7fd7600ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:33.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 --2- 172.21.15.130:0/2055047276 >> v2:172.21.15.164:3300/0 conn(0x7fd760159f20 0x7fd7600ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 >> v1:172.21.15.164:6789/0 conn(0x7fd7600cdfc0 legacy=0x7fd7600b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600cd200 con 0x7fd7600b1d20 2023-09-13T06:13:33.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fd758001a00 con 0x7fd7600b1d20 2023-09-13T06:13:33.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 >> v1:172.21.15.130:6789/0 conn(0x7fd7600b1d20 legacy=0x7fd7600ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 --2- 172.21.15.130:0/2055047276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd748005c00 0x7fd748006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 --2- 172.21.15.130:0/2055047276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd748006560 0x7fd7480069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 --2- 172.21.15.130:0/2055047276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd748007170 0x7fd74800ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.404 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480104e0 con 0x7fd748007170 2023-09-13T06:13:33.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748010620 con 0x7fd748005c00 2023-09-13T06:13:33.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480107b0 con 0x7fd748006560 2023-09-13T06:13:33.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd764d64640 1 --2- 172.21.15.130:0/2055047276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd748007170 0x7fd74800ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75ffff640 1 --2- 172.21.15.130:0/2055047276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd748005c00 0x7fd748006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.405 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd75f7fe640 1 --2- 172.21.15.130:0/2055047276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd748006560 0x7fd7480069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd764d64640 1 -- 172.21.15.130:0/2055047276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd748006560 msgr2=0x7fd7480069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:33.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd764d64640 1 --2- 172.21.15.130:0/2055047276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd748006560 0x7fd7480069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd764d64640 1 -- 172.21.15.130:0/2055047276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd748005c00 msgr2=0x7fd748006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:33.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd764d64640 1 --2- 172.21.15.130:0/2055047276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd748005c00 0x7fd748006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.406 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.399+0000 7fd764d64640 1 -- 172.21.15.130:0/2055047276 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd748005740 con 0x7fd748007170 2023-09-13T06:13:33.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd764d64640 1 -- 172.21.15.130:0/2055047276 reap_dead start 2023-09-13T06:13:33.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd764d64640 1 --2- 172.21.15.130:0/2055047276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd748007170 0x7fd74800ffa0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fd75800a830 tx=0x7fd75801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70490043d06762 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:33.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7580072d0 con 0x7fd748007170 2023-09-13T06:13:33.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7580a8070 con 0x7fd748007170 2023-09-13T06:13:33.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd75effd640 1 -- 172.21.15.130:0/2055047276 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7580076b0 con 0x7fd748007170 2023-09-13T06:13:33.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd7667c7640 1 -- 172.21.15.130:0/2055047276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd748007170 msgr2=0x7fd74800ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.410 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd7667c7640 1 --2- 172.21.15.130:0/2055047276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd748007170 0x7fd74800ffa0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fd75800a830 tx=0x7fd75801d340 comp rx=0 tx=0).stop 2023-09-13T06:13:33.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd7667c7640 1 -- 172.21.15.130:0/2055047276 shutdown_connections 2023-09-13T06:13:33.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd7667c7640 1 --2- 172.21.15.130:0/2055047276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd748007170 0x7fd74800ffa0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd7667c7640 1 -- 172.21.15.130:0/2055047276 >> 172.21.15.130:0/2055047276 conn(0x7fd760065990 msgr2=0x7fd760065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:33.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd7667c7640 1 -- 172.21.15.130:0/2055047276 shutdown_connections 2023-09-13T06:13:33.411 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.403+0000 7fd7667c7640 1 -- 172.21.15.130:0/2055047276 wait complete. 2023-09-13T06:13:33.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd7667c7640 1 Processor -- start 2023-09-13T06:13:33.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd7667c7640 1 -- start start 2023-09-13T06:13:33.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd7667c7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd748007170 0x7fd7601f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd7667c7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7601ee630 0x7fd7601511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd7667c7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd76006ced0 0x7fd76006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.412 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd7667c7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76006d890 con 0x7fd76006ced0 2023-09-13T06:13:33.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd7667c7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7601f2b70 con 0x7fd748007170 2023-09-13T06:13:33.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd7667c7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7601dfe10 con 0x7fd7601ee630 2023-09-13T06:13:33.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd764d64640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd76006ced0 0x7fd76006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd764d64640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd76006ced0 0x7fd76006d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33250/0 (socket says 172.21.15.130:33250) 2023-09-13T06:13:33.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd764d64640 1 -- 172.21.15.130:0/1233457587 learned_addr learned my addr 172.21.15.130:0/1233457587 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:33.413 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd75ffff640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd748007170 0x7fd7601f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd75f7fe640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7601ee630 0x7fd7601511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd764d64640 1 -- 172.21.15.130:0/1233457587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7601ee630 msgr2=0x7fd7601511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd764d64640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7601ee630 0x7fd7601511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd764d64640 1 -- 172.21.15.130:0/1233457587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd748007170 msgr2=0x7fd7601f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.414 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd764d64640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd748007170 0x7fd7601f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd764d64640 1 -- 172.21.15.130:0/1233457587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760151700 con 0x7fd76006ced0 2023-09-13T06:13:33.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd75f7fe640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7601ee630 0x7fd7601511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:33.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd764d64640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd76006ced0 0x7fd76006d350 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fd758007040 tx=0x7fd748007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:33.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd75cff9640 1 -- 172.21.15.130:0/1233457587 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7580019c0 con 0x7fd76006ced0 2023-09-13T06:13:33.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd75cff9640 1 -- 172.21.15.130:0/1233457587 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758007450 con 0x7fd76006ced0 2023-09-13T06:13:33.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd7667c7640 1 -- 172.21.15.130:0/1233457587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7601eeb60 con 0x7fd76006ced0 2023-09-13T06:13:33.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd75cff9640 1 -- 172.21.15.130:0/1233457587 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758007800 con 0x7fd76006ced0 2023-09-13T06:13:33.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.407+0000 7fd7667c7640 1 -- 172.21.15.130:0/1233457587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7601ef120 con 0x7fd76006ced0 2023-09-13T06:13:33.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.411+0000 7fd7667c7640 1 -- 172.21.15.130:0/1233457587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7600618a0 con 0x7fd76006ced0 2023-09-13T06:13:33.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.411+0000 7fd75cff9640 1 -- 172.21.15.130:0/1233457587 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd7580aa070 con 0x7fd76006ced0 2023-09-13T06:13:33.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.411+0000 7fd75cff9640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd74c065b20 0x7fd74c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.411+0000 7fd75cff9640 1 -- 172.21.15.130:0/1233457587 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd75811cc20 con 0x7fd76006ced0 2023-09-13T06:13:33.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.411+0000 7fd75ffff640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd74c065b20 0x7fd74c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.411+0000 7fd75ffff640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd74c065b20 0x7fd74c067fe0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd750009aa0 tx=0x7fd750008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:33.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.415+0000 7fd75cff9640 1 -- 172.21.15.130:0/1233457587 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd7580ea4d0 con 0x7fd76006ced0 2023-09-13T06:13:33.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.595+0000 7fd7667c7640 1 -- 172.21.15.130:0/1233457587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd76006dbc0 con 0x7fd76006ced0 2023-09-13T06:13:33.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.595+0000 7fd75cff9640 1 -- 172.21.15.130:0/1233457587 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fd7580edaf0 con 0x7fd76006ced0 2023-09-13T06:13:33.600 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:33.600 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/519371055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":519371055},{"type":"v1","addr":"172.21.15.130:6837","nonce":519371055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2464101241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2464101241},{"type":"v1","addr":"172.21.15.130:6836","nonce":2464101241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3066690343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3066690343},{"type":"v1","addr":"172.21.15.164:6833","nonce":3066690343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:12:52.135181+0000","modified":"2023-09-13T06:12:55.174886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8272":{"gid":8272,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2477052868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2477052868},{"type":"v1","addr":"172.21.15.164:6835","nonce":2477052868}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-09-13T06:13:33.602 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 92 2023-09-13T06:13:33.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 -- 172.21.15.130:0/1233457587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd74c065b20 msgr2=0x7fd74c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd74c065b20 0x7fd74c067fe0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd750009aa0 tx=0x7fd750008040 comp rx=0 tx=0).stop 2023-09-13T06:13:33.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 -- 172.21.15.130:0/1233457587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd76006ced0 msgr2=0x7fd76006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd76006ced0 0x7fd76006d350 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fd758007040 tx=0x7fd748007a10 comp rx=0 tx=0).stop 2023-09-13T06:13:33.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 -- 172.21.15.130:0/1233457587 shutdown_connections 2023-09-13T06:13:33.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd74c065b20 0x7fd74c067fe0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd76006ced0 0x7fd76006d350 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7601ee630 0x7fd7601511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 --2- 172.21.15.130:0/1233457587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd748007170 0x7fd7601f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 -- 172.21.15.130:0/1233457587 >> 172.21.15.130:0/1233457587 conn(0x7fd760065990 msgr2=0x7fd7600b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:33.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 -- 172.21.15.130:0/1233457587 shutdown_connections 2023-09-13T06:13:33.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.599+0000 7fd7667c7640 1 -- 172.21.15.130:0/1233457587 wait complete. 2023-09-13T06:13:33.620 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:13:33.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.759+0000 7f1e0ce56640 1 Processor -- start 2023-09-13T06:13:33.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.759+0000 7f1e0ce56640 1 -- start start 2023-09-13T06:13:33.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.759+0000 7f1e0ce56640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e08159f20 0x7f1e080ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.759+0000 7f1e0ce56640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e080ccfd0 con 0x7f1e080b1d20 2023-09-13T06:13:33.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.759+0000 7f1e0ce56640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e080ced90 con 0x7f1e080cdfc0 2023-09-13T06:13:33.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.759+0000 7f1e0ce56640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e080b00f0 con 0x7f1e08159f20 2023-09-13T06:13:33.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.759+0000 7f1e06d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1e080b1d20 0x7f1e080ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59028/0 (socket says 172.21.15.130:59028) 2023-09-13T06:13:33.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.759+0000 7f1e06d9d640 1 -- 172.21.15.130:0/936460969 learned_addr learned my addr 172.21.15.130:0/936460969 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:33.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625492788 0 0) 0x7f1e080ccfd0 con 0x7f1e080b1d20 2023-09-13T06:13:33.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e0659c640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e08159f20 0x7f1e080ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df4003530 con 0x7f1e080b1d20 2023-09-13T06:13:33.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1094265246 0 0) 0x7f1df4003530 con 0x7f1e080b1d20 2023-09-13T06:13:33.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e08159f20 msgr2=0x7f1e080ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:33.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e08159f20 0x7f1e080ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 >> v1:172.21.15.164:6789/0 conn(0x7f1e080cdfc0 legacy=0x7f1e080b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080cd200 con 0x7f1e080b1d20 2023-09-13T06:13:33.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f1e00001a00 con 0x7f1e080b1d20 2023-09-13T06:13:33.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 >> v1:172.21.15.130:6789/0 conn(0x7f1e080b1d20 legacy=0x7f1e080ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1df4003a20 0x7f1df4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e08159f20 0x7f1df40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1df4004d10 0x7f1df4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df400ba40 con 0x7f1df4004d10 2023-09-13T06:13:33.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df400bb80 con 0x7f1df4003a20 2023-09-13T06:13:33.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df400bcf0 con 0x7f1e08159f20 2023-09-13T06:13:33.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e06d9d640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1df4004d10 0x7f1df4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e0659c640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1df4003a20 0x7f1df4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1dfffff640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e08159f20 0x7f1df40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e06d9d640 1 -- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e08159f20 msgr2=0x7f1df40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:33.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e06d9d640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e08159f20 0x7f1df40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e06d9d640 1 -- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1df4003a20 msgr2=0x7f1df4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:33.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e06d9d640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1df4003a20 0x7f1df4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1e06d9d640 1 -- 172.21.15.130:0/936460969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df4003530 con 0x7f1df4004d10 2023-09-13T06:13:33.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.763+0000 7f1dfffff640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e08159f20 0x7f1df40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:33.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e06d9d640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1df4004d10 0x7f1df4005190 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000a830 tx=0x7f1e0001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83202f08df614400 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:33.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e000aa6d0 con 0x7f1df4004d10 2023-09-13T06:13:33.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e000aa850 con 0x7f1df4004d10 2023-09-13T06:13:33.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e05d9b640 1 -- 172.21.15.130:0/936460969 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e000aac00 con 0x7f1df4004d10 2023-09-13T06:13:33.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e0ce56640 1 -- 172.21.15.130:0/936460969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1df4004d10 msgr2=0x7f1df4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e0ce56640 1 --2- 172.21.15.130:0/936460969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1df4004d10 0x7f1df4005190 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000a830 tx=0x7f1e0001faa0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e06d9d640 1 -- 172.21.15.130:0/936460969 reap_dead start 2023-09-13T06:13:33.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e0ce56640 1 -- 172.21.15.130:0/936460969 shutdown_connections 2023-09-13T06:13:33.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e0ce56640 1 -- 172.21.15.130:0/936460969 >> 172.21.15.130:0/936460969 conn(0x7f1e08065990 msgr2=0x7f1e08065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:33.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e0ce56640 1 -- 172.21.15.130:0/936460969 shutdown_connections 2023-09-13T06:13:33.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e0ce56640 1 -- 172.21.15.130:0/936460969 wait complete. 2023-09-13T06:13:33.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e0ce56640 1 Processor -- start 2023-09-13T06:13:33.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.767+0000 7f1e0ce56640 1 -- start start 2023-09-13T06:13:33.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e0ce56640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1df4004d10 0x7f1e081df2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e0ce56640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e0813ee70 0x7f1e08141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e0ce56640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e08141ca0 0x7f1e080ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e0ce56640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e081426e0 con 0x7f1e08141ca0 2023-09-13T06:13:33.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e0ce56640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e081df7f0 con 0x7f1df4004d10 2023-09-13T06:13:33.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e0ce56640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e08142120 con 0x7f1e0813ee70 2023-09-13T06:13:33.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e06d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e08141ca0 0x7f1e080ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e06d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e08141ca0 0x7f1e080ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33274/0 (socket says 172.21.15.130:33274) 2023-09-13T06:13:33.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e06d9d640 1 -- 172.21.15.130:0/3635920411 learned_addr learned my addr 172.21.15.130:0/3635920411 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1dfffff640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e0813ee70 0x7f1e08141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e0659c640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1df4004d10 0x7f1e081df2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e06d9d640 1 -- 172.21.15.130:0/3635920411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e0813ee70 msgr2=0x7f1e08141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e06d9d640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e0813ee70 0x7f1e08141760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e06d9d640 1 -- 172.21.15.130:0/3635920411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1df4004d10 msgr2=0x7f1e081df2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e06d9d640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1df4004d10 0x7f1e081df2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e06d9d640 1 -- 172.21.15.130:0/3635920411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e08142400 con 0x7f1e08141ca0 2023-09-13T06:13:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e0659c640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1df4004d10 0x7f1e081df2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e06d9d640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e08141ca0 0x7f1e080ae2b0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000a830 tx=0x7f1e0001c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1dfeffd640 1 -- 172.21.15.130:0/3635920411 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e000b9040 con 0x7f1e08141ca0 2023-09-13T06:13:33.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1dfeffd640 1 -- 172.21.15.130:0/3635920411 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e000aa6d0 con 0x7f1e08141ca0 2023-09-13T06:13:33.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e0ce56640 1 -- 172.21.15.130:0/3635920411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e08156d50 con 0x7f1e08141ca0 2023-09-13T06:13:33.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1dfeffd640 1 -- 172.21.15.130:0/3635920411 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e000019c0 con 0x7f1e08141ca0 2023-09-13T06:13:33.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e0ce56640 1 -- 172.21.15.130:0/3635920411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0813f2f0 con 0x7f1e08141ca0 2023-09-13T06:13:33.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1e0ce56640 1 -- 172.21.15.130:0/3635920411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e080618a0 con 0x7f1e08141ca0 2023-09-13T06:13:33.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.771+0000 7f1dfeffd640 1 -- 172.21.15.130:0/3635920411 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1e00004b70 con 0x7f1e08141ca0 2023-09-13T06:13:33.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.775+0000 7f1dfeffd640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1de8065b20 0x7f1de8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:33.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.775+0000 7f1dfeffd640 1 -- 172.21.15.130:0/3635920411 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e00120d20 con 0x7f1e08141ca0 2023-09-13T06:13:33.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.775+0000 7f1e0659c640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1de8065b20 0x7f1de8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:33.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.775+0000 7f1e0659c640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1de8065b20 0x7f1de8067fe0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1e080ae250 tx=0x7f1df800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:33.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.779+0000 7f1dfeffd640 1 -- 172.21.15.130:0/3635920411 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1e000ee5d0 con 0x7f1e08141ca0 2023-09-13T06:13:33.926 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 -- 172.21.15.130:0/3635920411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e08157200 con 0x7f1e08141ca0 2023-09-13T06:13:33.927 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1dfeffd640 1 -- 172.21.15.130:0/3635920411 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+16615 (secure 0 0 0) 0x7f1e00001fd0 con 0x7f1e08141ca0 2023-09-13T06:13:33.928 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:33.928 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":190,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:13:22.489989+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:12:49.873320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-09-13T06:12:51.142196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:13:33.929 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 -- 172.21.15.130:0/3635920411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1de8065b20 msgr2=0x7f1de8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1de8065b20 0x7f1de8067fe0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1e080ae250 tx=0x7f1df800d040 comp rx=0 tx=0).stop 2023-09-13T06:13:33.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 -- 172.21.15.130:0/3635920411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e08141ca0 msgr2=0x7f1e080ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:33.930 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e08141ca0 0x7f1e080ae2b0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000a830 tx=0x7f1e0001c840 comp rx=0 tx=0).stop 2023-09-13T06:13:33.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 -- 172.21.15.130:0/3635920411 shutdown_connections 2023-09-13T06:13:33.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1de8065b20 0x7f1de8067fe0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e08141ca0 0x7f1e080ae2b0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e0813ee70 0x7f1e08141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.931 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 --2- 172.21.15.130:0/3635920411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1df4004d10 0x7f1e081df2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:33.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 -- 172.21.15.130:0/3635920411 >> 172.21.15.130:0/3635920411 conn(0x7f1e08065990 msgr2=0x7f1e0806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:33.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 -- 172.21.15.130:0/3635920411 shutdown_connections 2023-09-13T06:13:33.932 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:33.927+0000 7f1e0ce56640 1 -- 172.21.15.130:0/3635920411 wait complete. 2023-09-13T06:13:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T06:01:14.595128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T06:12:49.873320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '186', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T06:12:51.142196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T06:13:33.950 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T06:13:34.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.087+0000 7f53acd9f640 1 Processor -- start 2023-09-13T06:13:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.087+0000 7f53acd9f640 1 -- start start 2023-09-13T06:13:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f53acd9f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f53a8159900 0x7f53a8159db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f53acd9f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f53a80b4120 0x7f53a80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f53acd9f640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a80b4a70 con 0x7f53a80cc2d0 2023-09-13T06:13:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f53acd9f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a80b0c20 con 0x7f53a8159900 2023-09-13T06:13:34.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f53acd9f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a80b0810 con 0x7f53a80b4120 2023-09-13T06:13:34.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f539dd9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f53a8159900 0x7f53a8159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f539dd9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f53a8159900 0x7f53a8159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33278/0 (socket says 172.21.15.130:33278) 2023-09-13T06:13:34.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f539dd9b640 1 -- 172.21.15.130:0/3815542085 learned_addr learned my addr 172.21.15.130:0/3815542085 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:34.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f53a6d9d640 1 --2- 172.21.15.130:0/3815542085 >> v2:172.21.15.164:3300/0 conn(0x7f53a80b4120 0x7f53a80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f539dd9b640 1 -- 172.21.15.130:0/3815542085 >> v2:172.21.15.164:3300/0 conn(0x7f53a80b4120 msgr2=0x7f53a80b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f539dd9b640 1 --2- 172.21.15.130:0/3815542085 >> v2:172.21.15.164:3300/0 conn(0x7f53a80b4120 0x7f53a80b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f539dd9b640 1 -- 172.21.15.130:0/3815542085 >> v1:172.21.15.164:6789/0 conn(0x7f53a80cc2d0 legacy=0x7f53a80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f539dd9b640 1 -- 172.21.15.130:0/3815542085 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80cc9d0 con 0x7f53a8159900 2023-09-13T06:13:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.091+0000 7f53a6d9d640 1 --2- 172.21.15.130:0/3815542085 >> v2:172.21.15.164:3300/0 conn(0x7f53a80b4120 0x7f53a80b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:34.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f539dd9b640 1 --2- 172.21.15.130:0/3815542085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53a8159900 0x7f53a8159db0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f53a815af40 tx=0x7f539001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d21dbe21f68ee4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:34.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53a5d9b640 1 -- 172.21.15.130:0/3815542085 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900aa5f0 con 0x7f53a8159900 2023-09-13T06:13:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53a5d9b640 1 -- 172.21.15.130:0/3815542085 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53900aa750 con 0x7f53a8159900 2023-09-13T06:13:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53a5d9b640 1 -- 172.21.15.130:0/3815542085 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900aaae0 con 0x7f53a8159900 2023-09-13T06:13:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53acd9f640 1 -- 172.21.15.130:0/3815542085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53a8159900 msgr2=0x7f53a8159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53acd9f640 1 --2- 172.21.15.130:0/3815542085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53a8159900 0x7f53a8159db0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f53a815af40 tx=0x7f539001c490 comp rx=0 tx=0).stop 2023-09-13T06:13:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53acd9f640 1 -- 172.21.15.130:0/3815542085 shutdown_connections 2023-09-13T06:13:34.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53acd9f640 1 --2- 172.21.15.130:0/3815542085 >> v2:172.21.15.164:3300/0 conn(0x7f53a80b4120 0x7f53a80b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53acd9f640 1 --2- 172.21.15.130:0/3815542085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53a8159900 0x7f53a8159db0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53acd9f640 1 -- 172.21.15.130:0/3815542085 >> 172.21.15.130:0/3815542085 conn(0x7f53a8065990 msgr2=0x7f53a8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:34.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53acd9f640 1 -- 172.21.15.130:0/3815542085 shutdown_connections 2023-09-13T06:13:34.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53acd9f640 1 -- 172.21.15.130:0/3815542085 wait complete. 2023-09-13T06:13:34.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53acd9f640 1 Processor -- start 2023-09-13T06:13:34.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.095+0000 7f53acd9f640 1 -- start start 2023-09-13T06:13:34.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53acd9f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53a80b4120 0x7f53a80a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53acd9f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53a80cc2d0 0x7f53a815d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.101 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53acd9f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53a8159900 0x7f53a81f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53acd9f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80ab130 con 0x7f53a80cc2d0 2023-09-13T06:13:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53acd9f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80aa4e0 con 0x7f53a8159900 2023-09-13T06:13:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53acd9f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80aa7c0 con 0x7f53a80b4120 2023-09-13T06:13:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53a80cc2d0 0x7f53a815d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53a80cc2d0 0x7f53a815d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33280/0 (socket says 172.21.15.130:33280) 2023-09-13T06:13:34.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539dd9b640 1 -- 172.21.15.130:0/4142669127 learned_addr learned my addr 172.21.15.130:0/4142669127 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:34.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53a659c640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53a80b4120 0x7f53a80a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53a6d9d640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53a8159900 0x7f53a81f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539dd9b640 1 -- 172.21.15.130:0/4142669127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53a80b4120 msgr2=0x7f53a80a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.103 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539dd9b640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53a80b4120 0x7f53a80a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539dd9b640 1 -- 172.21.15.130:0/4142669127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53a8159900 msgr2=0x7f53a81f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539dd9b640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53a8159900 0x7f53a81f6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539dd9b640 1 -- 172.21.15.130:0/4142669127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900094d0 con 0x7f53a80cc2d0 2023-09-13T06:13:34.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53a659c640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53a80b4120 0x7f53a80a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:34.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53a6d9d640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53a8159900 0x7f53a81f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:34.104 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539dd9b640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53a80cc2d0 0x7f53a815d540 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f539001a0c0 tx=0x7f539001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:34.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539f7fe640 1 -- 172.21.15.130:0/4142669127 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900b3800 con 0x7f53a80cc2d0 2023-09-13T06:13:34.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539f7fe640 1 -- 172.21.15.130:0/4142669127 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53900b3980 con 0x7f53a80cc2d0 2023-09-13T06:13:34.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53acd9f640 1 -- 172.21.15.130:0/4142669127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a80aaaa0 con 0x7f53a80cc2d0 2023-09-13T06:13:34.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539f7fe640 1 -- 172.21.15.130:0/4142669127 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900b3d30 con 0x7f53a80cc2d0 2023-09-13T06:13:34.105 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53acd9f640 1 -- 172.21.15.130:0/4142669127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a8163a90 con 0x7f53a80cc2d0 2023-09-13T06:13:34.106 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f53acd9f640 1 -- 172.21.15.130:0/4142669127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a80ab2a0 con 0x7f53a80cc2d0 2023-09-13T06:13:34.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.099+0000 7f539f7fe640 1 -- 172.21.15.130:0/4142669127 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f53900c6390 con 0x7f53a80cc2d0 2023-09-13T06:13:34.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.103+0000 7f539f7fe640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 0x7f538c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.103+0000 7f539f7fe640 1 -- 172.21.15.130:0/4142669127 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53900a7070 con 0x7f53a80cc2d0 2023-09-13T06:13:34.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.103+0000 7f53a659c640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 0x7f538c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.107 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.103+0000 7f53a659c640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 0x7f538c067fe0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5398003ec0 tx=0x7f5398009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:34.108 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.107+0000 7f539f7fe640 1 -- 172.21.15.130:0/4142669127 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f53900eb5c0 con 0x7f53a80cc2d0 2023-09-13T06:13:34.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 -- 172.21.15.130:0/4142669127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53a80618a0 con 0x7f53a80cc2d0 2023-09-13T06:13:34.256 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f539f7fe640 1 -- 172.21.15.130:0/4142669127 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v190) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53900eebe0 con 0x7f53a80cc2d0 2023-09-13T06:13:34.256 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 1 2023-09-13T06:13:34.257 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 -- 172.21.15.130:0/4142669127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 msgr2=0x7f538c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 0x7f538c067fe0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5398003ec0 tx=0x7f5398009040 comp rx=0 tx=0).stop 2023-09-13T06:13:34.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 -- 172.21.15.130:0/4142669127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53a80cc2d0 msgr2=0x7f53a815d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53a80cc2d0 0x7f53a815d540 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f539001a0c0 tx=0x7f539001acd0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.258 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 -- 172.21.15.130:0/4142669127 shutdown_connections 2023-09-13T06:13:34.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f538c065b20 0x7f538c067fe0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53a8159900 0x7f53a81f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53a80cc2d0 0x7f53a815d540 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.259 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 --2- 172.21.15.130:0/4142669127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53a80b4120 0x7f53a80a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 -- 172.21.15.130:0/4142669127 >> 172.21.15.130:0/4142669127 conn(0x7f53a8065990 msgr2=0x7f53a80b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:34.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 -- 172.21.15.130:0/4142669127 shutdown_connections 2023-09-13T06:13:34.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.255+0000 7f53acd9f640 1 -- 172.21.15.130:0/4142669127 wait complete. 2023-09-13T06:13:34.277 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T06:13:34.417 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.415+0000 7f83898d8640 1 Processor -- start 2023-09-13T06:13:34.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.415+0000 7f83898d8640 1 -- start start 2023-09-13T06:13:34.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f83898d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83840d2cd0 0x7f83841612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f83898d8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f83841617e0 0x7f83840cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.419 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f83898d8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838415dd40 con 0x7f838415ae10 2023-09-13T06:13:34.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f83898d8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838415e020 con 0x7f83841617e0 2023-09-13T06:13:34.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f83898d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838415e300 con 0x7f83840d2cd0 2023-09-13T06:13:34.420 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f837bfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83840d2cd0 0x7f83841612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f83837fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f83841617e0 0x7f83840cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f837bfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83840d2cd0 0x7f83841612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:46736/0 (socket says 172.21.15.130:46736) 2023-09-13T06:13:34.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f837bfff640 1 -- 172.21.15.130:0/1457426790 learned_addr learned my addr 172.21.15.130:0/1457426790 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:34.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f837bfff640 1 -- 172.21.15.130:0/1457426790 >> v2:172.21.15.164:3300/0 conn(0x7f83841617e0 msgr2=0x7f83840cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:34.424 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f837bfff640 1 --2- 172.21.15.130:0/1457426790 >> v2:172.21.15.164:3300/0 conn(0x7f83841617e0 0x7f83840cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f837bfff640 1 -- 172.21.15.130:0/1457426790 >> v1:172.21.15.164:6789/0 conn(0x7f838415ae10 legacy=0x7f83840d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.419+0000 7f837bfff640 1 -- 172.21.15.130:0/1457426790 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838415e5e0 con 0x7f83840d2cd0 2023-09-13T06:13:34.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f837bfff640 1 --2- 172.21.15.130:0/1457426790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83840d2cd0 0x7f83841612a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f836c009870 tx=0x7f836c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e50d3919fa13ef4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:34.425 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83827fc640 1 -- 172.21.15.130:0/1457426790 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0aa430 con 0x7f83840d2cd0 2023-09-13T06:13:34.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83827fc640 1 -- 172.21.15.130:0/1457426790 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c0aa590 con 0x7f83840d2cd0 2023-09-13T06:13:34.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83827fc640 1 -- 172.21.15.130:0/1457426790 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0aa920 con 0x7f83840d2cd0 2023-09-13T06:13:34.426 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 -- 172.21.15.130:0/1457426790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83840d2cd0 msgr2=0x7f83841612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 --2- 172.21.15.130:0/1457426790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83840d2cd0 0x7f83841612a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f836c009870 tx=0x7f836c01c4b0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 -- 172.21.15.130:0/1457426790 shutdown_connections 2023-09-13T06:13:34.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 --2- 172.21.15.130:0/1457426790 >> v2:172.21.15.164:3300/0 conn(0x7f83841617e0 0x7f83840cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.427 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 --2- 172.21.15.130:0/1457426790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83840d2cd0 0x7f83841612a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 -- 172.21.15.130:0/1457426790 >> 172.21.15.130:0/1457426790 conn(0x7f8384065990 msgr2=0x7f8384065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:34.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 -- 172.21.15.130:0/1457426790 shutdown_connections 2023-09-13T06:13:34.428 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 -- 172.21.15.130:0/1457426790 wait complete. 2023-09-13T06:13:34.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 Processor -- start 2023-09-13T06:13:34.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 -- start start 2023-09-13T06:13:34.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83840d2cd0 0x7f8384153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f838415ae10 0x7f83840d3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83841617e0 0x7f838414fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841516f0 con 0x7f838415ae10 2023-09-13T06:13:34.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8384150ae0 con 0x7f83840d2cd0 2023-09-13T06:13:34.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.423+0000 7f83898d8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8384150dc0 con 0x7f83841617e0 2023-09-13T06:13:34.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f8382ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83840d2cd0 0x7f8384153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f837bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f838415ae10 0x7f83840d3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f83837fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83841617e0 0x7f838414fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f83837fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83841617e0 0x7f838414fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:46746/0 (socket says 172.21.15.130:46746) 2023-09-13T06:13:34.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f83837fe640 1 -- 172.21.15.130:0/1406920747 learned_addr learned my addr 172.21.15.130:0/1406920747 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:34.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f837bfff640 1 -- 172.21.15.130:0/1406920747 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83841617e0 msgr2=0x7f838414fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f837bfff640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83841617e0 0x7f838414fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f837bfff640 1 -- 172.21.15.130:0/1406920747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83840d2cd0 msgr2=0x7f8384153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f837bfff640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83840d2cd0 0x7f8384153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f837bfff640 1 -- 172.21.15.130:0/1406920747 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0094d0 con 0x7f838415ae10 2023-09-13T06:13:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f8382ffd640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83840d2cd0 0x7f8384153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T06:13:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f837bfff640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f838415ae10 0x7f83840d3500 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f836c0ab000 tx=0x7f836c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f8380ff9640 1 -- 172.21.15.130:0/1406920747 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0aa430 con 0x7f838415ae10 2023-09-13T06:13:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f8380ff9640 1 -- 172.21.15.130:0/1406920747 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c0b3820 con 0x7f838415ae10 2023-09-13T06:13:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f8380ff9640 1 -- 172.21.15.130:0/1406920747 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0b3bd0 con 0x7f838415ae10 2023-09-13T06:13:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f83898d8640 1 -- 172.21.15.130:0/1406920747 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83841510a0 con 0x7f838415ae10 2023-09-13T06:13:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f83898d8640 1 -- 172.21.15.130:0/1406920747 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8384153ea0 con 0x7f838415ae10 2023-09-13T06:13:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f83898d8640 1 -- 172.21.15.130:0/1406920747 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83840618a0 con 0x7f838415ae10 2023-09-13T06:13:34.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.427+0000 7f8380ff9640 1 -- 172.21.15.130:0/1406920747 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f836c0b3d30 con 0x7f838415ae10 2023-09-13T06:13:34.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.431+0000 7f8380ff9640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8364065b20 0x7f8364067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.431+0000 7f8380ff9640 1 -- 172.21.15.130:0/1406920747 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f836c11d6c0 con 0x7f838415ae10 2023-09-13T06:13:34.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.431+0000 7f8382ffd640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8364065b20 0x7f8364067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.431+0000 7f8382ffd640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8364065b20 0x7f8364067fe0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8374007fd0 tx=0x7f8374009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.435+0000 7f8380ff9640 1 -- 172.21.15.130:0/1406920747 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f836c0eb020 con 0x7f838415ae10 2023-09-13T06:13:34.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 -- 172.21.15.130:0/1406920747 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8384070520 con 0x7f838415ae10 2023-09-13T06:13:34.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f8380ff9640 1 -- 172.21.15.130:0/1406920747 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v190) v1 ==== 104+0+11 (secure 0 0 0) 0x7f836c0ee640 con 0x7f838415ae10 2023-09-13T06:13:34.584 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 32 2023-09-13T06:13:34.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 -- 172.21.15.130:0/1406920747 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8364065b20 msgr2=0x7f8364067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8364065b20 0x7f8364067fe0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8374007fd0 tx=0x7f8374009040 comp rx=0 tx=0).stop 2023-09-13T06:13:34.586 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 -- 172.21.15.130:0/1406920747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f838415ae10 msgr2=0x7f83840d3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f838415ae10 0x7f83840d3500 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f836c0ab000 tx=0x7f836c01acf0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 -- 172.21.15.130:0/1406920747 shutdown_connections 2023-09-13T06:13:34.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f8364065b20 0x7f8364067fe0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83841617e0 0x7f838414fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f838415ae10 0x7f83840d3500 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 --2- 172.21.15.130:0/1406920747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83840d2cd0 0x7f8384153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 -- 172.21.15.130:0/1406920747 >> 172.21.15.130:0/1406920747 conn(0x7f8384065990 msgr2=0x7f8384065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:34.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 -- 172.21.15.130:0/1406920747 shutdown_connections 2023-09-13T06:13:34.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.583+0000 7f83898d8640 1 -- 172.21.15.130:0/1406920747 wait complete. 2023-09-13T06:13:34.605 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T06:13:34.747 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e50b67640 1 Processor -- start 2023-09-13T06:13:34.748 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e50b67640 1 -- start start 2023-09-13T06:13:34.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e50b67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e4c15a080 0x7f5e4c0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e50b67640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5e4c15e650 0x7f5e4c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e50b67640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5e4c0b2fd0 0x7f5e4c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e50b67640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4c0cc850 con 0x7f5e4c15e650 2023-09-13T06:13:34.750 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e50b67640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4c0b3420 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e50b67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0b0330 con 0x7f5e4c15a080 2023-09-13T06:13:34.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e43fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5e4c15e650 0x7f5e4c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e43fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5e4c15e650 0x7f5e4c0b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33306/0 (socket says 172.21.15.130:33306) 2023-09-13T06:13:34.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e43fff640 1 -- 172.21.15.130:0/3428831511 learned_addr learned my addr 172.21.15.130:0/3428831511 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:34.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e4ad9d640 1 --2- 172.21.15.130:0/3428831511 >> v2:172.21.15.164:3300/0 conn(0x7f5e4c0b2fd0 0x7f5e4c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e4a59c640 1 --2- 172.21.15.130:0/3428831511 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e4c15a080 0x7f5e4c0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e43fff640 1 -- 172.21.15.130:0/3428831511 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e4c15a080 msgr2=0x7f5e4c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:34.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e43fff640 1 --2- 172.21.15.130:0/3428831511 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e4c15a080 0x7f5e4c0b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e43fff640 1 -- 172.21.15.130:0/3428831511 >> v2:172.21.15.164:3300/0 conn(0x7f5e4c0b2fd0 msgr2=0x7f5e4c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:34.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e43fff640 1 --2- 172.21.15.130:0/3428831511 >> v2:172.21.15.164:3300/0 conn(0x7f5e4c0b2fd0 0x7f5e4c0ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e43fff640 1 -- 172.21.15.130:0/3428831511 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c0cbcd0 con 0x7f5e4c15e650 2023-09-13T06:13:34.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.747+0000 7f5e4ad9d640 1 --2- 172.21.15.130:0/3428831511 >> v2:172.21.15.164:3300/0 conn(0x7f5e4c0b2fd0 0x7f5e4c0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:34.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e43fff640 1 --2- 172.21.15.130:0/3428831511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e4c15e650 0x7f5e4c0b2a90 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0b2830 tx=0x7f5e3401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b5dc6ab65f9193 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:34.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e49d9b640 1 -- 172.21.15.130:0/3428831511 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340ab400 con 0x7f5e4c15e650 2023-09-13T06:13:34.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e49d9b640 1 -- 172.21.15.130:0/3428831511 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e340ab560 con 0x7f5e4c15e650 2023-09-13T06:13:34.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e49d9b640 1 -- 172.21.15.130:0/3428831511 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340ab8f0 con 0x7f5e4c15e650 2023-09-13T06:13:34.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e50b67640 1 -- 172.21.15.130:0/3428831511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e4c15e650 msgr2=0x7f5e4c0b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e50b67640 1 --2- 172.21.15.130:0/3428831511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e4c15e650 0x7f5e4c0b2a90 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0b2830 tx=0x7f5e3401c440 comp rx=0 tx=0).stop 2023-09-13T06:13:34.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e50b67640 1 -- 172.21.15.130:0/3428831511 shutdown_connections 2023-09-13T06:13:34.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e50b67640 1 --2- 172.21.15.130:0/3428831511 >> v2:172.21.15.164:3300/0 conn(0x7f5e4c0b2fd0 0x7f5e4c0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e50b67640 1 --2- 172.21.15.130:0/3428831511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e4c15e650 0x7f5e4c0b2a90 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e50b67640 1 --2- 172.21.15.130:0/3428831511 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e4c15a080 0x7f5e4c0b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e50b67640 1 -- 172.21.15.130:0/3428831511 >> 172.21.15.130:0/3428831511 conn(0x7f5e4c065990 msgr2=0x7f5e4c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:34.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e50b67640 1 -- 172.21.15.130:0/3428831511 shutdown_connections 2023-09-13T06:13:34.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.751+0000 7f5e50b67640 1 -- 172.21.15.130:0/3428831511 wait complete. 2023-09-13T06:13:34.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e50b67640 1 Processor -- start 2023-09-13T06:13:34.758 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e50b67640 1 -- start start 2023-09-13T06:13:34.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e50b67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e4c0b2fd0 0x7f5e4c1f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e50b67640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e4c15a080 0x7f5e4c0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e50b67640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e4c15e650 0x7f5e4c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e50b67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0ac9e0 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e50b67640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0accc0 con 0x7f5e4c15a080 2023-09-13T06:13:34.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e50b67640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0acfa0 con 0x7f5e4c15e650 2023-09-13T06:13:34.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e4a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e4c0b2fd0 0x7f5e4c1f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e4a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e4c0b2fd0 0x7f5e4c1f8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33320/0 (socket says 172.21.15.130:33320) 2023-09-13T06:13:34.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e4a59c640 1 -- 172.21.15.130:0/2765009297 learned_addr learned my addr 172.21.15.130:0/2765009297 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:34.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e4ad9d640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e4c15e650 0x7f5e4c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e43fff640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e4c15a080 0x7f5e4c0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e4a59c640 1 -- 172.21.15.130:0/2765009297 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e4c15e650 msgr2=0x7f5e4c1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e4a59c640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e4c15e650 0x7f5e4c1537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e4a59c640 1 -- 172.21.15.130:0/2765009297 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e4c15a080 msgr2=0x7f5e4c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e4a59c640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e4c15a080 0x7f5e4c0ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e4a59c640 1 -- 172.21.15.130:0/2765009297 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e340094d0 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e43fff640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e4c15a080 0x7f5e4c0ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:34.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e4a59c640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e4c0b2fd0 0x7f5e4c1f8260 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00d800 tx=0x7f5e3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:34.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e42ffd640 1 -- 172.21.15.130:0/2765009297 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00b6c0 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e42ffd640 1 -- 172.21.15.130:0/2765009297 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c00b820 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e42ffd640 1 -- 172.21.15.130:0/2765009297 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00bb90 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e50b67640 1 -- 172.21.15.130:0/2765009297 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4c0ad280 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.755+0000 7f5e50b67640 1 -- 172.21.15.130:0/2765009297 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c06cc80 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.759+0000 7f5e50b67640 1 -- 172.21.15.130:0/2765009297 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4c0618a0 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.759+0000 7f5e42ffd640 1 -- 172.21.15.130:0/2765009297 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5e3c00bcf0 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.759+0000 7f5e42ffd640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e2c065b20 0x7f5e2c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:34.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.759+0000 7f5e42ffd640 1 -- 172.21.15.130:0/2765009297 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e3c083890 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.759+0000 7f5e43fff640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e2c065b20 0x7f5e2c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:34.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.759+0000 7f5e43fff640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e2c065b20 0x7f5e2c067fe0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5e340af000 tx=0x7f5e340a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:34.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.763+0000 7f5e42ffd640 1 -- 172.21.15.130:0/2765009297 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5e3c051140 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.911+0000 7f5e50b67640 1 -- 172.21.15.130:0/2765009297 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e4c159570 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.911+0000 7f5e42ffd640 1 -- 172.21.15.130:0/2765009297 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v190) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e3c054760 con 0x7f5e4c0b2fd0 2023-09-13T06:13:34.914 INFO:teuthology.orchestra.run.smithi130.stdout:pg_num: 64 2023-09-13T06:13:34.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 -- 172.21.15.130:0/2765009297 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e2c065b20 msgr2=0x7f5e2c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e2c065b20 0x7f5e2c067fe0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5e340af000 tx=0x7f5e340a7000 comp rx=0 tx=0).stop 2023-09-13T06:13:34.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 -- 172.21.15.130:0/2765009297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e4c0b2fd0 msgr2=0x7f5e4c1f8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:34.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e4c0b2fd0 0x7f5e4c1f8260 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00d800 tx=0x7f5e3c00dcc0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 -- 172.21.15.130:0/2765009297 shutdown_connections 2023-09-13T06:13:34.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5e2c065b20 0x7f5e2c067fe0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e4c15a080 0x7f5e4c0ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5e4c15e650 0x7f5e4c1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 --2- 172.21.15.130:0/2765009297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e4c0b2fd0 0x7f5e4c1f8260 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:34.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 -- 172.21.15.130:0/2765009297 >> 172.21.15.130:0/2765009297 conn(0x7f5e4c065990 msgr2=0x7f5e4c0b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:34.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 -- 172.21.15.130:0/2765009297 shutdown_connections 2023-09-13T06:13:34.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:34.915+0000 7f5e50b67640 1 -- 172.21.15.130:0/2765009297 wait complete. 2023-09-13T06:13:34.935 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:13:35.075 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46fa6d640 1 Processor -- start 2023-09-13T06:13:35.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46fa6d640 1 -- start start 2023-09-13T06:13:35.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46fa6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4680ce1a0 0x7fa46806d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46fa6d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4680afc70 0x7fa46806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46fa6d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa468070e70 con 0x7fa46815d260 2023-09-13T06:13:35.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46fa6d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa468072310 con 0x7fa4680afc70 2023-09-13T06:13:35.078 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46fa6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa468070280 con 0x7fa4680ce1a0 2023-09-13T06:13:35.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46e00a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4680afc70 0x7fa46806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46e00a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4680afc70 0x7fa46806dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33334/0 (socket says 172.21.15.130:33334) 2023-09-13T06:13:35.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46e00a640 1 -- 172.21.15.130:0/4020939241 learned_addr learned my addr 172.21.15.130:0/4020939241 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:35.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46d008640 1 --2- 172.21.15.130:0/4020939241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4680ce1a0 0x7fa46806d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46e00a640 1 -- 172.21.15.130:0/4020939241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4680ce1a0 msgr2=0x7fa46806d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:35.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46e00a640 1 --2- 172.21.15.130:0/4020939241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4680ce1a0 0x7fa46806d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46e00a640 1 -- 172.21.15.130:0/4020939241 >> v1:172.21.15.164:6789/0 conn(0x7fa46815d260 legacy=0x7fa4680b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.075+0000 7fa46e00a640 1 -- 172.21.15.130:0/4020939241 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468070540 con 0x7fa4680afc70 2023-09-13T06:13:35.082 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46e00a640 1 --2- 172.21.15.130:0/4020939241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4680afc70 0x7fa46806dc20 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fa460009e50 tx=0x7fa46001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb00a1ede1491f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:35.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46c807640 1 -- 172.21.15.130:0/4020939241 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600a5880 con 0x7fa4680afc70 2023-09-13T06:13:35.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46c807640 1 -- 172.21.15.130:0/4020939241 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4600a59e0 con 0x7fa4680afc70 2023-09-13T06:13:35.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46c807640 1 -- 172.21.15.130:0/4020939241 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600a5d70 con 0x7fa4680afc70 2023-09-13T06:13:35.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46fa6d640 1 -- 172.21.15.130:0/4020939241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4680afc70 msgr2=0x7fa46806dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46fa6d640 1 --2- 172.21.15.130:0/4020939241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4680afc70 0x7fa46806dc20 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fa460009e50 tx=0x7fa46001c9c0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46fa6d640 1 -- 172.21.15.130:0/4020939241 shutdown_connections 2023-09-13T06:13:35.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46fa6d640 1 --2- 172.21.15.130:0/4020939241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4680afc70 0x7fa46806dc20 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46fa6d640 1 --2- 172.21.15.130:0/4020939241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4680ce1a0 0x7fa46806d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.084 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46fa6d640 1 -- 172.21.15.130:0/4020939241 >> 172.21.15.130:0/4020939241 conn(0x7fa46806a2f0 msgr2=0x7fa46806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:35.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46fa6d640 1 -- 172.21.15.130:0/4020939241 shutdown_connections 2023-09-13T06:13:35.085 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.079+0000 7fa46fa6d640 1 -- 172.21.15.130:0/4020939241 wait complete. 2023-09-13T06:13:35.088 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46fa6d640 1 Processor -- start 2023-09-13T06:13:35.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46fa6d640 1 -- start start 2023-09-13T06:13:35.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46fa6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4680afc70 0x7fa4680cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46fa6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4680ce1a0 0x7fa4680b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46fa6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa46815d260 0x7fa4680b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46fa6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680b0c70 con 0x7fa4680afc70 2023-09-13T06:13:35.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46fa6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680b0f50 con 0x7fa46815d260 2023-09-13T06:13:35.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46fa6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680b1230 con 0x7fa4680ce1a0 2023-09-13T06:13:35.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46d809640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4680afc70 0x7fa4680cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46d809640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4680afc70 0x7fa4680cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33340/0 (socket says 172.21.15.130:33340) 2023-09-13T06:13:35.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46d809640 1 -- 172.21.15.130:0/1407017320 learned_addr learned my addr 172.21.15.130:0/1407017320 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:35.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46e00a640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa46815d260 0x7fa4680b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46d008640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4680ce1a0 0x7fa4680b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46d809640 1 -- 172.21.15.130:0/1407017320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4680ce1a0 msgr2=0x7fa4680b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46d809640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4680ce1a0 0x7fa4680b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46d809640 1 -- 172.21.15.130:0/1407017320 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa46815d260 msgr2=0x7fa4680b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46d809640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa46815d260 0x7fa4680b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46d809640 1 -- 172.21.15.130:0/1407017320 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa460009b30 con 0x7fa4680afc70 2023-09-13T06:13:35.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46d809640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4680afc70 0x7fa4680cc750 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c3c0 tx=0x7fa46400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:35.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa45e7fc640 1 -- 172.21.15.130:0/1407017320 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4640052d0 con 0x7fa4680afc70 2023-09-13T06:13:35.093 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa45e7fc640 1 -- 172.21.15.130:0/1407017320 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa464005430 con 0x7fa4680afc70 2023-09-13T06:13:35.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46fa6d640 1 -- 172.21.15.130:0/1407017320 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4680b1510 con 0x7fa4680afc70 2023-09-13T06:13:35.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa45e7fc640 1 -- 172.21.15.130:0/1407017320 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464003840 con 0x7fa4680afc70 2023-09-13T06:13:35.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46fa6d640 1 -- 172.21.15.130:0/1407017320 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4680ccc90 con 0x7fa4680afc70 2023-09-13T06:13:35.094 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.083+0000 7fa46fa6d640 1 -- 172.21.15.130:0/1407017320 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4680b1a30 con 0x7fa4680afc70 2023-09-13T06:13:35.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.087+0000 7fa45e7fc640 1 -- 172.21.15.130:0/1407017320 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa4640039a0 con 0x7fa4680afc70 2023-09-13T06:13:35.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.087+0000 7fa45e7fc640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa44c065b20 0x7fa44c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.087+0000 7fa45e7fc640 1 -- 172.21.15.130:0/1407017320 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa464082780 con 0x7fa4680afc70 2023-09-13T06:13:35.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.087+0000 7fa46d008640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa44c065b20 0x7fa44c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.087+0000 7fa46d008640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa44c065b20 0x7fa44c067fe0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa4680b6e20 tx=0x7fa458009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:35.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.091+0000 7fa45e7fc640 1 -- 172.21.15.130:0/1407017320 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa464050180 con 0x7fa4680afc70 2023-09-13T06:13:35.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 -- 172.21.15.130:0/1407017320 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4680618a0 con 0x7fa4680afc70 2023-09-13T06:13:35.271 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa45e7fc640 1 -- 172.21.15.130:0/1407017320 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fa4640537a0 con 0x7fa4680afc70 2023-09-13T06:13:35.272 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:35.272 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/519371055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":519371055},{"type":"v1","addr":"172.21.15.130:6837","nonce":519371055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2464101241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2464101241},{"type":"v1","addr":"172.21.15.130:6836","nonce":2464101241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3066690343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3066690343},{"type":"v1","addr":"172.21.15.164:6833","nonce":3066690343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:12:52.135181+0000","modified":"2023-09-13T06:12:55.174886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8272":{"gid":8272,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2477052868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2477052868},{"type":"v1","addr":"172.21.15.164:6835","nonce":2477052868}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-09-13T06:13:35.273 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 92 2023-09-13T06:13:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 -- 172.21.15.130:0/1407017320 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa44c065b20 msgr2=0x7fa44c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa44c065b20 0x7fa44c067fe0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa4680b6e20 tx=0x7fa458009190 comp rx=0 tx=0).stop 2023-09-13T06:13:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 -- 172.21.15.130:0/1407017320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4680afc70 msgr2=0x7fa4680cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4680afc70 0x7fa4680cc750 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c3c0 tx=0x7fa46400c880 comp rx=0 tx=0).stop 2023-09-13T06:13:35.274 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 -- 172.21.15.130:0/1407017320 shutdown_connections 2023-09-13T06:13:35.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fa44c065b20 0x7fa44c067fe0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa46815d260 0x7fa4680b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa4680ce1a0 0x7fa4680b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 --2- 172.21.15.130:0/1407017320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4680afc70 0x7fa4680cc750 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.275 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 -- 172.21.15.130:0/1407017320 >> 172.21.15.130:0/1407017320 conn(0x7fa46806a2f0 msgr2=0x7fa4680b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 -- 172.21.15.130:0/1407017320 shutdown_connections 2023-09-13T06:13:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.271+0000 7fa46fa6d640 1 -- 172.21.15.130:0/1407017320 wait complete. 2023-09-13T06:13:35.293 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:13:35.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.427+0000 7fd7da019640 1 Processor -- start 2023-09-13T06:13:35.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.431+0000 7fd7da019640 1 -- start start 2023-09-13T06:13:35.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.431+0000 7fd7da019640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd7d40d1090 0x7fd7d415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.431+0000 7fd7da019640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d40b63c0 con 0x7fd7d40d1750 2023-09-13T06:13:35.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.431+0000 7fd7da019640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d40d0c20 con 0x7fd7d4146f30 2023-09-13T06:13:35.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.431+0000 7fd7da019640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d415dea0 con 0x7fd7d40d1090 2023-09-13T06:13:35.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.431+0000 7fd7d37fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd7d40d1750 0x7fd7d4146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59038/0 (socket says 172.21.15.130:59038) 2023-09-13T06:13:35.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.431+0000 7fd7d2ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd7d40d1090 0x7fd7d415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.431+0000 7fd7d37fe640 1 -- 172.21.15.130:0/3823340307 learned_addr learned my addr 172.21.15.130:0/3823340307 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:35.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.431+0000 7fd7d2ffd640 1 -- 172.21.15.130:0/3823340307 >> v1:172.21.15.164:6789/0 conn(0x7fd7d4146f30 legacy=0x7fd7d40b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.431+0000 7fd7d2ffd640 1 -- 172.21.15.130:0/3823340307 >> v1:172.21.15.130:6789/0 conn(0x7fd7d40d1750 legacy=0x7fd7d4146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.434 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.431+0000 7fd7d2ffd640 1 -- 172.21.15.130:0/3823340307 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40b6610 con 0x7fd7d40d1090 2023-09-13T06:13:35.435 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7d2ffd640 1 --2- 172.21.15.130:0/3823340307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7d40d1090 0x7fd7d415d960 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80097c0 tx=0x7fd7c801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0d0e57de20a1b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7d27fc640 1 -- 172.21.15.130:0/3823340307 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c80ac620 con 0x7fd7d40d1090 2023-09-13T06:13:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7d27fc640 1 -- 172.21.15.130:0/3823340307 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c80ac780 con 0x7fd7d40d1090 2023-09-13T06:13:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7d27fc640 1 -- 172.21.15.130:0/3823340307 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c80acb10 con 0x7fd7d40d1090 2023-09-13T06:13:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7da019640 1 -- 172.21.15.130:0/3823340307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7d40d1090 msgr2=0x7fd7d415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7da019640 1 --2- 172.21.15.130:0/3823340307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7d40d1090 0x7fd7d415d960 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80097c0 tx=0x7fd7c801c3c0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7da019640 1 -- 172.21.15.130:0/3823340307 shutdown_connections 2023-09-13T06:13:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7da019640 1 --2- 172.21.15.130:0/3823340307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7d40d1090 0x7fd7d415d960 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7da019640 1 -- 172.21.15.130:0/3823340307 >> 172.21.15.130:0/3823340307 conn(0x7fd7d406f170 msgr2=0x7fd7d406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:35.439 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7da019640 1 -- 172.21.15.130:0/3823340307 shutdown_connections 2023-09-13T06:13:35.441 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7da019640 1 -- 172.21.15.130:0/3823340307 wait complete. 2023-09-13T06:13:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7da019640 1 Processor -- start 2023-09-13T06:13:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.435+0000 7fd7da019640 1 -- start start 2023-09-13T06:13:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7da019640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7d40d1090 0x7fd7d415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7da019640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7d40d1750 0x7fd7d415c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7da019640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7d4146f30 0x7fd7d4144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7da019640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d4147510 con 0x7fd7d40d1750 2023-09-13T06:13:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7da019640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41457c0 con 0x7fd7d4146f30 2023-09-13T06:13:35.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7da019640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d4144f20 con 0x7fd7d40d1090 2023-09-13T06:13:35.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7d40d1750 0x7fd7d415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7d40d1750 0x7fd7d415c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33368/0 (socket says 172.21.15.130:33368) 2023-09-13T06:13:35.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d2ffd640 1 -- 172.21.15.130:0/4291446123 learned_addr learned my addr 172.21.15.130:0/4291446123 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:35.446 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d37fe640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7d40d1090 0x7fd7d415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d2ffd640 1 -- 172.21.15.130:0/4291446123 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7d40d1090 msgr2=0x7fd7d415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d3fff640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7d4146f30 0x7fd7d4144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d2ffd640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7d40d1090 0x7fd7d415cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.447 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d2ffd640 1 -- 172.21.15.130:0/4291446123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7d4146f30 msgr2=0x7fd7d4144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d2ffd640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7d4146f30 0x7fd7d4144660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d2ffd640 1 -- 172.21.15.130:0/4291446123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c8009420 con 0x7fd7d40d1750 2023-09-13T06:13:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d37fe640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7d40d1090 0x7fd7d415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d3fff640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7d4146f30 0x7fd7d4144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7d2ffd640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7d40d1750 0x7fd7d415c110 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80af040 tx=0x7fd7c8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7bbfff640 1 -- 172.21.15.130:0/4291446123 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c80b5610 con 0x7fd7d40d1750 2023-09-13T06:13:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7bbfff640 1 -- 172.21.15.130:0/4291446123 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c80b5790 con 0x7fd7d40d1750 2023-09-13T06:13:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7bbfff640 1 -- 172.21.15.130:0/4291446123 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c80b5b40 con 0x7fd7d40d1750 2023-09-13T06:13:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7da019640 1 -- 172.21.15.130:0/4291446123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d4145200 con 0x7fd7d40d1750 2023-09-13T06:13:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7da019640 1 -- 172.21.15.130:0/4291446123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d415c650 con 0x7fd7d40d1750 2023-09-13T06:13:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.439+0000 7fd7da019640 1 -- 172.21.15.130:0/4291446123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d4147680 con 0x7fd7d40d1750 2023-09-13T06:13:35.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.443+0000 7fd7bbfff640 1 -- 172.21.15.130:0/4291446123 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd7c80b3040 con 0x7fd7d40d1750 2023-09-13T06:13:35.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.443+0000 7fd7bbfff640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c0065b20 0x7fd7c0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.443+0000 7fd7bbfff640 1 -- 172.21.15.130:0/4291446123 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7c811d4c0 con 0x7fd7d40d1750 2023-09-13T06:13:35.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.443+0000 7fd7d37fe640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c0065b20 0x7fd7c0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.443+0000 7fd7d37fe640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c0065b20 0x7fd7c0067fe0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4005890 tx=0x7fd7c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:35.451 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.447+0000 7fd7bbfff640 1 -- 172.21.15.130:0/4291446123 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd7c80eaea0 con 0x7fd7d40d1750 2023-09-13T06:13:35.598 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.595+0000 7fd7da019640 1 -- 172.21.15.130:0/4291446123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7d40618a0 con 0x7fd7d40d1750 2023-09-13T06:13:35.599 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7bbfff640 1 -- 172.21.15.130:0/4291446123 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+16615 (secure 0 0 0) 0x7fd7c80ee4c0 con 0x7fd7d40d1750 2023-09-13T06:13:35.600 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:35.600 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":190,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:13:22.489989+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:12:49.873320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-09-13T06:12:51.142196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:13:35.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 -- 172.21.15.130:0/4291446123 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c0065b20 msgr2=0x7fd7c0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c0065b20 0x7fd7c0067fe0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4005890 tx=0x7fd7c4009040 comp rx=0 tx=0).stop 2023-09-13T06:13:35.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 -- 172.21.15.130:0/4291446123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7d40d1750 msgr2=0x7fd7d415c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7d40d1750 0x7fd7d415c110 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80af040 tx=0x7fd7c8019160 comp rx=0 tx=0).stop 2023-09-13T06:13:35.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 -- 172.21.15.130:0/4291446123 shutdown_connections 2023-09-13T06:13:35.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fd7c0065b20 0x7fd7c0067fe0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7d4146f30 0x7fd7d4144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7d40d1750 0x7fd7d415c110 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 --2- 172.21.15.130:0/4291446123 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd7d40d1090 0x7fd7d415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 -- 172.21.15.130:0/4291446123 >> 172.21.15.130:0/4291446123 conn(0x7fd7d406f170 msgr2=0x7fd7d40cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:35.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 -- 172.21.15.130:0/4291446123 shutdown_connections 2023-09-13T06:13:35.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.599+0000 7fd7da019640 1 -- 172.21.15.130:0/4291446123 wait complete. 2023-09-13T06:13:35.621 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:13:35.621 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:13:35.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc3a4848640 1 Processor -- start 2023-09-13T06:13:35.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc3a4848640 1 -- start start 2023-09-13T06:13:35.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc3a4848640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a00d1090 0x7fc3a015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc3a4848640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc3a0146f30 0x7fc3a00b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc3a4848640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a00b63c0 con 0x7fc3a00d1750 2023-09-13T06:13:35.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc3a4848640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a015dea0 con 0x7fc3a0146f30 2023-09-13T06:13:35.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc3a4848640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a00d0c20 con 0x7fc3a00d1090 2023-09-13T06:13:35.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc39ed9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc3a0146f30 0x7fc3a00b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc39ed9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc3a0146f30 0x7fc3a00b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:43182/0 (socket says 172.21.15.130:43182) 2023-09-13T06:13:35.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc39ed9d640 1 -- 172.21.15.130:0/326621564 learned_addr learned my addr 172.21.15.130:0/326621564 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:35.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc397fff640 1 --2- 172.21.15.130:0/326621564 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a00d1090 0x7fc3a015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc39ed9d640 1 -- 172.21.15.130:0/326621564 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a00d1090 msgr2=0x7fc3a015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:35.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc39ed9d640 1 --2- 172.21.15.130:0/326621564 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a00d1090 0x7fc3a015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc39ed9d640 1 -- 172.21.15.130:0/326621564 >> v1:172.21.15.164:6789/0 conn(0x7fc3a00d1750 legacy=0x7fc3a0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.759+0000 7fc39ed9d640 1 -- 172.21.15.130:0/326621564 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a00b6610 con 0x7fc3a0146f30 2023-09-13T06:13:35.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc39ed9d640 1 --2- 172.21.15.130:0/326621564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a0146f30 0x7fc3a00b70f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc398009e50 tx=0x7fc39801c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77b6c273a05712ed server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:35.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc39dd9b640 1 -- 172.21.15.130:0/326621564 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980a58a0 con 0x7fc3a0146f30 2023-09-13T06:13:35.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc39dd9b640 1 -- 172.21.15.130:0/326621564 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3980a5a00 con 0x7fc3a0146f30 2023-09-13T06:13:35.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc39dd9b640 1 -- 172.21.15.130:0/326621564 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980a5d90 con 0x7fc3a0146f30 2023-09-13T06:13:35.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc3a4848640 1 -- 172.21.15.130:0/326621564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a0146f30 msgr2=0x7fc3a00b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc3a4848640 1 --2- 172.21.15.130:0/326621564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a0146f30 0x7fc3a00b70f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc398009e50 tx=0x7fc39801c9e0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc3a4848640 1 -- 172.21.15.130:0/326621564 shutdown_connections 2023-09-13T06:13:35.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc3a4848640 1 --2- 172.21.15.130:0/326621564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a0146f30 0x7fc3a00b70f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc3a4848640 1 --2- 172.21.15.130:0/326621564 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a00d1090 0x7fc3a015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc3a4848640 1 -- 172.21.15.130:0/326621564 >> 172.21.15.130:0/326621564 conn(0x7fc3a006f170 msgr2=0x7fc3a006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:35.768 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc3a4848640 1 -- 172.21.15.130:0/326621564 shutdown_connections 2023-09-13T06:13:35.769 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.763+0000 7fc3a4848640 1 -- 172.21.15.130:0/326621564 wait complete. 2023-09-13T06:13:35.771 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc3a4848640 1 Processor -- start 2023-09-13T06:13:35.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc3a4848640 1 -- start start 2023-09-13T06:13:35.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc3a4848640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a00d1090 0x7fc3a013ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc3a4848640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a00d1750 0x7fc3a015c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc3a4848640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a0146f30 0x7fc3a01678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.772 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc3a4848640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a015cb40 con 0x7fc3a00d1750 2023-09-13T06:13:35.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc3a4848640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0166880 con 0x7fc3a0146f30 2023-09-13T06:13:35.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc3a4848640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0166b20 con 0x7fc3a00d1090 2023-09-13T06:13:35.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc397fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a00d1750 0x7fc3a015c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc397fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a00d1750 0x7fc3a015c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33376/0 (socket says 172.21.15.130:33376) 2023-09-13T06:13:35.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc397fff640 1 -- 172.21.15.130:0/3271887105 learned_addr learned my addr 172.21.15.130:0/3271887105 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:35.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc39e59c640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a00d1090 0x7fc3a013ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc39ed9d640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a0146f30 0x7fc3a01678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc397fff640 1 -- 172.21.15.130:0/3271887105 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a00d1090 msgr2=0x7fc3a013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc397fff640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a00d1090 0x7fc3a013ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc397fff640 1 -- 172.21.15.130:0/3271887105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a0146f30 msgr2=0x7fc3a01678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc397fff640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a0146f30 0x7fc3a01678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.775 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc397fff640 1 -- 172.21.15.130:0/3271887105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc398009b30 con 0x7fc3a00d1750 2023-09-13T06:13:35.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.767+0000 7fc397fff640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a00d1750 0x7fc3a015c160 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fc38800e930 tx=0x7fc38800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:35.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.771+0000 7fc396ffd640 1 -- 172.21.15.130:0/3271887105 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388009690 con 0x7fc3a00d1750 2023-09-13T06:13:35.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.771+0000 7fc396ffd640 1 -- 172.21.15.130:0/3271887105 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38800ca00 con 0x7fc3a00d1750 2023-09-13T06:13:35.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.771+0000 7fc3a4848640 1 -- 172.21.15.130:0/3271887105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a00b7e40 con 0x7fc3a00d1750 2023-09-13T06:13:35.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.771+0000 7fc396ffd640 1 -- 172.21.15.130:0/3271887105 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38800cd70 con 0x7fc3a00d1750 2023-09-13T06:13:35.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.771+0000 7fc3a4848640 1 -- 172.21.15.130:0/3271887105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a01670e0 con 0x7fc3a00d1750 2023-09-13T06:13:35.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.771+0000 7fc3a4848640 1 -- 172.21.15.130:0/3271887105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a00618a0 con 0x7fc3a00d1750 2023-09-13T06:13:35.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.771+0000 7fc396ffd640 1 -- 172.21.15.130:0/3271887105 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc388013470 con 0x7fc3a00d1750 2023-09-13T06:13:35.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.771+0000 7fc396ffd640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc380065b20 0x7fc380067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:35.780 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.771+0000 7fc396ffd640 1 -- 172.21.15.130:0/3271887105 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3880834d0 con 0x7fc3a00d1750 2023-09-13T06:13:35.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.771+0000 7fc39e59c640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc380065b20 0x7fc380067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:35.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.775+0000 7fc39e59c640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc380065b20 0x7fc380067fe0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0166670 tx=0x7fc390009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:35.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.775+0000 7fc396ffd640 1 -- 172.21.15.130:0/3271887105 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc388050f80 con 0x7fc3a00d1750 2023-09-13T06:13:35.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.955+0000 7fc3a4848640 1 -- 172.21.15.130:0/3271887105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3a00b86c0 con 0x7fc3a00d1750 2023-09-13T06:13:35.958 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.955+0000 7fc396ffd640 1 -- 172.21.15.130:0/3271887105 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4926 (secure 0 0 0) 0x7fc3880545a0 con 0x7fc3a00d1750 2023-09-13T06:13:35.958 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:35.959 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/519371055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":519371055},{"type":"v1","addr":"172.21.15.130:6837","nonce":519371055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2464101241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2464101241},{"type":"v1","addr":"172.21.15.130:6836","nonce":2464101241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3066690343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3066690343},{"type":"v1","addr":"172.21.15.164:6833","nonce":3066690343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:12:52.135181+0000","modified":"2023-09-13T06:12:55.174886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8272":{"gid":8272,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2477052868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2477052868},{"type":"v1","addr":"172.21.15.164:6835","nonce":2477052868}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-09-13T06:13:35.959 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 92 2023-09-13T06:13:35.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 -- 172.21.15.130:0/3271887105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc380065b20 msgr2=0x7fc380067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc380065b20 0x7fc380067fe0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0166670 tx=0x7fc390009040 comp rx=0 tx=0).stop 2023-09-13T06:13:35.960 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 -- 172.21.15.130:0/3271887105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a00d1750 msgr2=0x7fc3a015c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:35.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a00d1750 0x7fc3a015c160 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fc38800e930 tx=0x7fc38800edf0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 -- 172.21.15.130:0/3271887105 shutdown_connections 2023-09-13T06:13:35.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc380065b20 0x7fc380067fe0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3a0146f30 0x7fc3a01678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.961 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a00d1750 0x7fc3a015c160 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 --2- 172.21.15.130:0/3271887105 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc3a00d1090 0x7fc3a013ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:35.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 -- 172.21.15.130:0/3271887105 >> 172.21.15.130:0/3271887105 conn(0x7fc3a006f170 msgr2=0x7fc3a00cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:35.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 -- 172.21.15.130:0/3271887105 shutdown_connections 2023-09-13T06:13:35.962 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:35.959+0000 7fc3a4848640 1 -- 172.21.15.130:0/3271887105 wait complete. 2023-09-13T06:13:35.980 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:13:36.118 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.115+0000 7f840b09c640 1 Processor -- start 2023-09-13T06:13:36.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.115+0000 7f840b09c640 1 -- start start 2023-09-13T06:13:36.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f840b09c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f84040ce7b0 0x7f84040b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f840b09c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f84040cdf30 0x7f84040ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f840b09c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84040ce3c0 con 0x7f84040b1610 2023-09-13T06:13:36.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f840b09c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84040b0050 con 0x7f84040ce7b0 2023-09-13T06:13:36.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f840b09c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84040ced20 con 0x7f84040cdf30 2023-09-13T06:13:36.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f8403fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f84040ce7b0 0x7f84040b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f8408e38640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f84040b1610 0x7f84040b19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59046/0 (socket says 172.21.15.130:59046) 2023-09-13T06:13:36.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f8408e38640 1 -- 172.21.15.130:0/1205620713 learned_addr learned my addr 172.21.15.130:0/1205620713 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:36.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f8409639640 1 --2- 172.21.15.130:0/1205620713 >> v2:172.21.15.164:3300/0 conn(0x7f84040cdf30 0x7f84040ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f8403fff640 1 -- 172.21.15.130:0/1205620713 >> v2:172.21.15.164:3300/0 conn(0x7f84040cdf30 msgr2=0x7f84040ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:36.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f8403fff640 1 --2- 172.21.15.130:0/1205620713 >> v2:172.21.15.164:3300/0 conn(0x7f84040cdf30 0x7f84040ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f8403fff640 1 -- 172.21.15.130:0/1205620713 >> v1:172.21.15.130:6789/0 conn(0x7f84040b1610 legacy=0x7f84040b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f8403fff640 1 -- 172.21.15.130:0/1205620713 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040cd170 con 0x7f84040ce7b0 2023-09-13T06:13:36.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.119+0000 7f84037fe640 1 -- 172.21.15.130:0/1205620713 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211768003 0 0) 0x7f84040ce3c0 con 0x7f84040b1610 2023-09-13T06:13:36.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f8403fff640 1 --2- 172.21.15.130:0/1205620713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84040ce7b0 0x7f84040b0c90 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f84040b27d0 tx=0x7f83f001eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48c07055815a512 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:36.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f84037fe640 1 -- 172.21.15.130:0/1205620713 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040af280 con 0x7f84040ce7b0 2023-09-13T06:13:36.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f84037fe640 1 -- 172.21.15.130:0/1205620713 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f00a7a60 con 0x7f84040ce7b0 2023-09-13T06:13:36.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f84037fe640 1 -- 172.21.15.130:0/1205620713 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00a7df0 con 0x7f84040ce7b0 2023-09-13T06:13:36.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f840b09c640 1 -- 172.21.15.130:0/1205620713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84040ce7b0 msgr2=0x7f84040b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f840b09c640 1 --2- 172.21.15.130:0/1205620713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84040ce7b0 0x7f84040b0c90 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f84040b27d0 tx=0x7f83f001eaa0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f840b09c640 1 -- 172.21.15.130:0/1205620713 shutdown_connections 2023-09-13T06:13:36.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f840b09c640 1 --2- 172.21.15.130:0/1205620713 >> v2:172.21.15.164:3300/0 conn(0x7f84040cdf30 0x7f84040ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f840b09c640 1 --2- 172.21.15.130:0/1205620713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84040ce7b0 0x7f84040b0c90 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f840b09c640 1 -- 172.21.15.130:0/1205620713 >> 172.21.15.130:0/1205620713 conn(0x7f8404065990 msgr2=0x7f8404065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:36.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f840b09c640 1 -- 172.21.15.130:0/1205620713 shutdown_connections 2023-09-13T06:13:36.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f840b09c640 1 -- 172.21.15.130:0/1205620713 wait complete. 2023-09-13T06:13:36.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f840b09c640 1 Processor -- start 2023-09-13T06:13:36.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.123+0000 7f840b09c640 1 -- start start 2023-09-13T06:13:36.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f840b09c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84040b1610 0x7f840414fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f840b09c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84040cdf30 0x7f84040707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f840b09c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84040ce7b0 0x7f84041589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f840b09c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8404156350 con 0x7f84040cdf30 2023-09-13T06:13:36.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f840b09c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840415ca90 con 0x7f84040b1610 2023-09-13T06:13:36.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f840b09c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840415cd30 con 0x7f84040ce7b0 2023-09-13T06:13:36.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f8403fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84040cdf30 0x7f84040707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f8403fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84040cdf30 0x7f84040707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33396/0 (socket says 172.21.15.130:33396) 2023-09-13T06:13:36.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f8403fff640 1 -- 172.21.15.130:0/1579082229 learned_addr learned my addr 172.21.15.130:0/1579082229 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:36.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f8403fff640 1 -- 172.21.15.130:0/1579082229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84040ce7b0 msgr2=0x7f84041589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f8403fff640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84040ce7b0 0x7f84041589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f8403fff640 1 -- 172.21.15.130:0/1579082229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84040b1610 msgr2=0x7f840414fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f8408e38640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84040b1610 0x7f840414fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f8403fff640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84040b1610 0x7f840414fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.136 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f8403fff640 1 -- 172.21.15.130:0/1579082229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f000b6c0 con 0x7f84040cdf30 2023-09-13T06:13:36.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f8408e38640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84040b1610 0x7f840414fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:36.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f8403fff640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84040cdf30 0x7f84040707b0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f83f0000c10 tx=0x7f83f001b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:36.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f84017fa640 1 -- 172.21.15.130:0/1579082229 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0004220 con 0x7f84040cdf30 2023-09-13T06:13:36.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f84017fa640 1 -- 172.21.15.130:0/1579082229 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0004380 con 0x7f84040cdf30 2023-09-13T06:13:36.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f84017fa640 1 -- 172.21.15.130:0/1579082229 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00af850 con 0x7f84040cdf30 2023-09-13T06:13:36.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f840b09c640 1 -- 172.21.15.130:0/1579082229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840415d010 con 0x7f84040cdf30 2023-09-13T06:13:36.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f840b09c640 1 -- 172.21.15.130:0/1579082229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84041f53c0 con 0x7f84040cdf30 2023-09-13T06:13:36.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f840b09c640 1 -- 172.21.15.130:0/1579082229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8404156120 con 0x7f84040cdf30 2023-09-13T06:13:36.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.127+0000 7f84017fa640 1 -- 172.21.15.130:0/1579082229 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f83f00af9b0 con 0x7f84040cdf30 2023-09-13T06:13:36.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.131+0000 7f84017fa640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83e8065b20 0x7f83e8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.131+0000 7f84017fa640 1 -- 172.21.15.130:0/1579082229 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83f011e200 con 0x7f84040cdf30 2023-09-13T06:13:36.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.131+0000 7f8408e38640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83e8065b20 0x7f83e8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.141 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.131+0000 7f8408e38640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83e8065b20 0x7f83e8067fe0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000f70 tx=0x7f83f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:36.142 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.135+0000 7f84017fa640 1 -- 172.21.15.130:0/1579082229 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8404156120 con 0x7f84040cdf30 2023-09-13T06:13:36.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 -- 172.21.15.130:0/1579082229 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8404156120 con 0x7f84040cdf30 2023-09-13T06:13:36.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f84017fa640 1 -- 172.21.15.130:0/1579082229 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4926 (secure 0 0 0) 0x7f8404156120 con 0x7f84040cdf30 2023-09-13T06:13:36.316 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:36.316 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/519371055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":519371055},{"type":"v1","addr":"172.21.15.130:6837","nonce":519371055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2464101241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2464101241},{"type":"v1","addr":"172.21.15.130:6836","nonce":2464101241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3066690343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3066690343},{"type":"v1","addr":"172.21.15.164:6833","nonce":3066690343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T06:12:52.135181+0000","modified":"2023-09-13T06:12:55.174886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8272":{"gid":8272,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/2477052868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":2477052868},{"type":"v1","addr":"172.21.15.164:6835","nonce":2477052868}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-09-13T06:13:36.317 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 92 2023-09-13T06:13:36.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 -- 172.21.15.130:0/1579082229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83e8065b20 msgr2=0x7f83e8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83e8065b20 0x7f83e8067fe0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000f70 tx=0x7f83f8009040 comp rx=0 tx=0).stop 2023-09-13T06:13:36.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 -- 172.21.15.130:0/1579082229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84040cdf30 msgr2=0x7f84040707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84040cdf30 0x7f84040707b0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f83f0000c10 tx=0x7f83f001b840 comp rx=0 tx=0).stop 2023-09-13T06:13:36.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 -- 172.21.15.130:0/1579082229 shutdown_connections 2023-09-13T06:13:36.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f83e8065b20 0x7f83e8067fe0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84040ce7b0 0x7f84041589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84040cdf30 0x7f84040707b0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 --2- 172.21.15.130:0/1579082229 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84040b1610 0x7f840414fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 -- 172.21.15.130:0/1579082229 >> 172.21.15.130:0/1579082229 conn(0x7f8404065990 msgr2=0x7f8404159630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:36.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 -- 172.21.15.130:0/1579082229 shutdown_connections 2023-09-13T06:13:36.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.315+0000 7f840b09c640 1 -- 172.21.15.130:0/1579082229 wait complete. 2023-09-13T06:13:36.336 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:13:36.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.471+0000 7f1add796640 1 Processor -- start 2023-09-13T06:13:36.475 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1add796640 1 -- start start 2023-09-13T06:13:36.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1add796640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1ad80ce7b0 0x7f1ad80cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1add796640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad80ccfd0 con 0x7f1ad8159f20 2023-09-13T06:13:36.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1add796640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad80ced90 con 0x7f1ad80b1d20 2023-09-13T06:13:36.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1add796640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80b00f0 con 0x7f1ad80ce7b0 2023-09-13T06:13:36.477 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1ad77fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1ad80ce7b0 0x7f1ad80cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1ad6ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1ad8159f20 0x7f1ad80b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59052/0 (socket says 172.21.15.130:59052) 2023-09-13T06:13:36.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1ad6ffd640 1 -- 172.21.15.130:0/3749724696 learned_addr learned my addr 172.21.15.130:0/3749724696 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:36.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1ad77fe640 1 -- 172.21.15.130:0/3749724696 >> v1:172.21.15.164:6789/0 conn(0x7f1ad80b1d20 legacy=0x7f1ad80ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.478 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1ad77fe640 1 -- 172.21.15.130:0/3749724696 >> v1:172.21.15.130:6789/0 conn(0x7f1ad8159f20 legacy=0x7f1ad80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1ad77fe640 1 -- 172.21.15.130:0/3749724696 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad80cd200 con 0x7f1ad80ce7b0 2023-09-13T06:13:36.479 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.475+0000 7f1ad67fc640 1 -- 172.21.15.130:0/3749724696 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913595041 0 0) 0x7f1ad80ccfd0 con 0x7f1ad8159f20 2023-09-13T06:13:36.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1ad77fe640 1 --2- 172.21.15.130:0/3749724696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad80ce7b0 0x7f1ad80cdfc0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00097f0 tx=0x7f1ad001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4206b1c282e7340c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:36.480 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1ad67fc640 1 -- 172.21.15.130:0/3749724696 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00ac620 con 0x7f1ad80ce7b0 2023-09-13T06:13:36.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1ad67fc640 1 -- 172.21.15.130:0/3749724696 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad00ac780 con 0x7f1ad80ce7b0 2023-09-13T06:13:36.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1ad67fc640 1 -- 172.21.15.130:0/3749724696 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00acb10 con 0x7f1ad80ce7b0 2023-09-13T06:13:36.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1add796640 1 -- 172.21.15.130:0/3749724696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad80ce7b0 msgr2=0x7f1ad80cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1add796640 1 --2- 172.21.15.130:0/3749724696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad80ce7b0 0x7f1ad80cdfc0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00097f0 tx=0x7f1ad001c3c0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.481 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1add796640 1 -- 172.21.15.130:0/3749724696 shutdown_connections 2023-09-13T06:13:36.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1add796640 1 --2- 172.21.15.130:0/3749724696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad80ce7b0 0x7f1ad80cdfc0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1add796640 1 -- 172.21.15.130:0/3749724696 >> 172.21.15.130:0/3749724696 conn(0x7f1ad8065990 msgr2=0x7f1ad8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:36.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1add796640 1 -- 172.21.15.130:0/3749724696 shutdown_connections 2023-09-13T06:13:36.482 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1add796640 1 -- 172.21.15.130:0/3749724696 wait complete. 2023-09-13T06:13:36.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1add796640 1 Processor -- start 2023-09-13T06:13:36.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.479+0000 7f1add796640 1 -- start start 2023-09-13T06:13:36.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1add796640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad80b1d20 0x7f1ad813b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1add796640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ad80ce7b0 0x7f1ad814ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1add796640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ad8159f20 0x7f1ad81535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1add796640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8152940 con 0x7f1ad80b1d20 2023-09-13T06:13:36.487 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1add796640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8151a90 con 0x7f1ad8159f20 2023-09-13T06:13:36.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1add796640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8151d30 con 0x7f1ad80ce7b0 2023-09-13T06:13:36.488 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ad6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad80b1d20 0x7f1ad813b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ad6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad80b1d20 0x7f1ad813b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33402/0 (socket says 172.21.15.130:33402) 2023-09-13T06:13:36.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ad6ffd640 1 -- 172.21.15.130:0/3189611322 learned_addr learned my addr 172.21.15.130:0/3189611322 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:36.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ad77fe640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ad8159f20 0x7f1ad81535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.489 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ace7fc640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ad80ce7b0 0x7f1ad814ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ad6ffd640 1 -- 172.21.15.130:0/3189611322 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ad80ce7b0 msgr2=0x7f1ad814ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.490 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ad6ffd640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ad80ce7b0 0x7f1ad814ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ad6ffd640 1 -- 172.21.15.130:0/3189611322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ad8159f20 msgr2=0x7f1ad81535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ad6ffd640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ad8159f20 0x7f1ad81535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ad6ffd640 1 -- 172.21.15.130:0/3189611322 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0009420 con 0x7f1ad80b1d20 2023-09-13T06:13:36.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ace7fc640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ad80ce7b0 0x7f1ad814ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:36.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1ad6ffd640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad80b1d20 0x7f1ad813b260 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800c780 tx=0x7f1ac800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:36.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1acffff640 1 -- 172.21.15.130:0/3189611322 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800ce90 con 0x7f1ad80b1d20 2023-09-13T06:13:36.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1acffff640 1 -- 172.21.15.130:0/3189611322 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac800a640 con 0x7f1ad80b1d20 2023-09-13T06:13:36.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1acffff640 1 -- 172.21.15.130:0/3189611322 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800aa70 con 0x7f1ad80b1d20 2023-09-13T06:13:36.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1add796640 1 -- 172.21.15.130:0/3189611322 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad8152010 con 0x7f1ad80b1d20 2023-09-13T06:13:36.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1add796640 1 -- 172.21.15.130:0/3189611322 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad81525d0 con 0x7f1ad80b1d20 2023-09-13T06:13:36.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.483+0000 7f1add796640 1 -- 172.21.15.130:0/3189611322 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad80618a0 con 0x7f1ad80b1d20 2023-09-13T06:13:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.487+0000 7f1acffff640 1 -- 172.21.15.130:0/3189611322 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1ac800abd0 con 0x7f1ad80b1d20 2023-09-13T06:13:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.487+0000 7f1acffff640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ab8065b50 0x7f1ab8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.487+0000 7f1acffff640 1 -- 172.21.15.130:0/3189611322 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ac80826f0 con 0x7f1ad80b1d20 2023-09-13T06:13:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.487+0000 7f1ace7fc640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ab8065b50 0x7f1ab8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.487+0000 7f1ace7fc640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ab8065b50 0x7f1ab8068010 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1ad806db00 tx=0x7f1ac0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.491+0000 7f1acffff640 1 -- 172.21.15.130:0/3189611322 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1ac8050050 con 0x7f1ad80b1d20 2023-09-13T06:13:36.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.639+0000 7f1add796640 1 -- 172.21.15.130:0/3189611322 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ad80b3dd0 con 0x7f1ad80b1d20 2023-09-13T06:13:36.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1acffff640 1 -- 172.21.15.130:0/3189611322 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+16615 (secure 0 0 0) 0x7f1ac8053670 con 0x7f1ad80b1d20 2023-09-13T06:13:36.643 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:36.643 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":190,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:13:22.489989+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-09-13T06:12:49.873320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-09-13T06:12:51.142196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:13:36.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 -- 172.21.15.130:0/3189611322 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ab8065b50 msgr2=0x7f1ab8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ab8065b50 0x7f1ab8068010 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1ad806db00 tx=0x7f1ac0009040 comp rx=0 tx=0).stop 2023-09-13T06:13:36.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 -- 172.21.15.130:0/3189611322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad80b1d20 msgr2=0x7f1ad813b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad80b1d20 0x7f1ad813b260 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800c780 tx=0x7f1ac800cc40 comp rx=0 tx=0).stop 2023-09-13T06:13:36.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 -- 172.21.15.130:0/3189611322 shutdown_connections 2023-09-13T06:13:36.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1ab8065b50 0x7f1ab8068010 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ad8159f20 0x7f1ad81535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ad80ce7b0 0x7f1ad814ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 --2- 172.21.15.130:0/3189611322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad80b1d20 0x7f1ad813b260 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 -- 172.21.15.130:0/3189611322 >> 172.21.15.130:0/3189611322 conn(0x7f1ad8065990 msgr2=0x7f1ad80b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:36.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 -- 172.21.15.130:0/3189611322 shutdown_connections 2023-09-13T06:13:36.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.643+0000 7f1add796640 1 -- 172.21.15.130:0/3189611322 wait complete. 2023-09-13T06:13:36.664 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T06:13:36.803 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee81db640 1 Processor -- start 2023-09-13T06:13:36.804 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee81db640 1 -- start start 2023-09-13T06:13:36.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee81db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcee00af9e0 0x7fcee006bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee81db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee006b5e0 con 0x7fcee0147b50 2023-09-13T06:13:36.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee81db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee006b8c0 con 0x7fcee0147f30 2023-09-13T06:13:36.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee81db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee0165ac0 con 0x7fcee00af9e0 2023-09-13T06:13:36.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee5f77640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fcee0147b50 0x7fcee01652b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59060/0 (socket says 172.21.15.130:59060) 2023-09-13T06:13:36.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee5f77640 1 -- 172.21.15.130:0/144814467 learned_addr learned my addr 172.21.15.130:0/144814467 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:36.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee6778640 1 --2- 172.21.15.130:0/144814467 >> v2:172.21.15.130:3300/0 conn(0x7fcee00af9e0 0x7fcee006bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee4f75640 1 -- 172.21.15.130:0/144814467 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150487201 0 0) 0x7fcee006b5e0 con 0x7fcee0147b50 2023-09-13T06:13:36.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee4f75640 1 -- 172.21.15.130:0/144814467 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcecc003530 con 0x7fcee0147b50 2023-09-13T06:13:36.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee6778640 1 -- 172.21.15.130:0/144814467 >> v1:172.21.15.164:6789/0 conn(0x7fcee0147f30 legacy=0x7fcee0148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:36.807 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee6778640 1 -- 172.21.15.130:0/144814467 >> v1:172.21.15.130:6789/0 conn(0x7fcee0147b50 legacy=0x7fcee01652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.803+0000 7fcee6778640 1 -- 172.21.15.130:0/144814467 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee0165da0 con 0x7fcee00af9e0 2023-09-13T06:13:36.808 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.807+0000 7fcee6778640 1 --2- 172.21.15.130:0/144814467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee00af9e0 0x7fcee006bd50 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fced8009d90 tx=0x7fced801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f894f5d014dc4f3e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:36.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.807+0000 7fcee4f75640 1 -- 172.21.15.130:0/144814467 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced80a58c0 con 0x7fcee00af9e0 2023-09-13T06:13:36.809 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.807+0000 7fcee4f75640 1 -- 172.21.15.130:0/144814467 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced80a5a20 con 0x7fcee00af9e0 2023-09-13T06:13:36.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.807+0000 7fcee4f75640 1 -- 172.21.15.130:0/144814467 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced80a5db0 con 0x7fcee00af9e0 2023-09-13T06:13:36.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.807+0000 7fcee81db640 1 -- 172.21.15.130:0/144814467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee00af9e0 msgr2=0x7fcee006bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.807+0000 7fcee81db640 1 --2- 172.21.15.130:0/144814467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee00af9e0 0x7fcee006bd50 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fced8009d90 tx=0x7fced801c8e0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.807+0000 7fcee81db640 1 -- 172.21.15.130:0/144814467 shutdown_connections 2023-09-13T06:13:36.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.807+0000 7fcee81db640 1 --2- 172.21.15.130:0/144814467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee00af9e0 0x7fcee006bd50 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.807+0000 7fcee81db640 1 -- 172.21.15.130:0/144814467 >> 172.21.15.130:0/144814467 conn(0x7fcee0065990 msgr2=0x7fcee0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:36.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.807+0000 7fcee81db640 1 -- 172.21.15.130:0/144814467 shutdown_connections 2023-09-13T06:13:36.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.807+0000 7fcee81db640 1 -- 172.21.15.130:0/144814467 wait complete. 2023-09-13T06:13:36.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee81db640 1 Processor -- start 2023-09-13T06:13:36.812 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee81db640 1 -- start start 2023-09-13T06:13:36.813 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee81db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcee00af9e0 0x7fcee00cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee81db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0147b50 0x7fcee0163c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee81db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcee0147f30 0x7fcee0143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee81db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee00cf1a0 con 0x7fcee0147b50 2023-09-13T06:13:36.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee81db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee00ce590 con 0x7fcee0147f30 2023-09-13T06:13:36.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee81db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee00ce870 con 0x7fcee00af9e0 2023-09-13T06:13:36.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee5776640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0147b50 0x7fcee0163c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee5776640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0147b50 0x7fcee0163c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33430/0 (socket says 172.21.15.130:33430) 2023-09-13T06:13:36.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee5776640 1 -- 172.21.15.130:0/2567508062 learned_addr learned my addr 172.21.15.130:0/2567508062 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:36.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee5f77640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcee00af9e0 0x7fcee00cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee6778640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcee0147f30 0x7fcee0143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee5776640 1 -- 172.21.15.130:0/2567508062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcee00af9e0 msgr2=0x7fcee00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee5776640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcee00af9e0 0x7fcee00cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee5776640 1 -- 172.21.15.130:0/2567508062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcee0147f30 msgr2=0x7fcee0143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:36.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee5776640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcee0147f30 0x7fcee0143c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:36.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee5776640 1 -- 172.21.15.130:0/2567508062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced8009a70 con 0x7fcee0147b50 2023-09-13T06:13:36.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee5f77640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcee00af9e0 0x7fcee00cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:36.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee6778640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcee0147f30 0x7fcee0143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:36.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee5776640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0147b50 0x7fcee0163c70 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fced000b3e0 tx=0x7fced000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:36.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fced67fc640 1 -- 172.21.15.130:0/2567508062 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0011830 con 0x7fcee0147b50 2023-09-13T06:13:36.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fced67fc640 1 -- 172.21.15.130:0/2567508062 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0011990 con 0x7fcee0147b50 2023-09-13T06:13:36.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee81db640 1 -- 172.21.15.130:0/2567508062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee00ceb50 con 0x7fcee0147b50 2023-09-13T06:13:36.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fced67fc640 1 -- 172.21.15.130:0/2567508062 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0011d80 con 0x7fcee0147b50 2023-09-13T06:13:36.818 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.811+0000 7fcee81db640 1 -- 172.21.15.130:0/2567508062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee00cc8b0 con 0x7fcee0147b50 2023-09-13T06:13:36.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.815+0000 7fcee81db640 1 -- 172.21.15.130:0/2567508062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee00618a0 con 0x7fcee0147b50 2023-09-13T06:13:36.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.815+0000 7fced67fc640 1 -- 172.21.15.130:0/2567508062 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fced001a400 con 0x7fcee0147b50 2023-09-13T06:13:36.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.815+0000 7fced67fc640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcec4065b20 0x7fcec4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:36.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.815+0000 7fced67fc640 1 -- 172.21.15.130:0/2567508062 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fced0083150 con 0x7fcee0147b50 2023-09-13T06:13:36.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.815+0000 7fcee5f77640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcec4065b20 0x7fcec4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:36.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.815+0000 7fcee5f77640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcec4065b20 0x7fcec4067fe0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0011f0 tx=0x7fcedc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:36.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.819+0000 7fced67fc640 1 -- 172.21.15.130:0/2567508062 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fced0050a90 con 0x7fcee0147b50 2023-09-13T06:13:36.999 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:36.999+0000 7fcee81db640 1 -- 172.21.15.130:0/2567508062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcee00cfd20 con 0x7fcee0147b50 2023-09-13T06:13:36.999 INFO:tasks.ceph.mon.a.smithi130.stderr:2023-09-13T06:13:36.999+0000 7faa00e50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T06:13:37.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.003+0000 7fced67fc640 1 -- 172.21.15.130:0/2567508062 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v93) v1 ==== 161+0+0 (secure 0 0 0) 0x7fced00540b0 con 0x7fcee0147b50 2023-09-13T06:13:37.006 INFO:teuthology.orchestra.run.smithi130.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T06:13:37.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 -- 172.21.15.130:0/2567508062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcec4065b20 msgr2=0x7fcec4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:37.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcec4065b20 0x7fcec4067fe0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0011f0 tx=0x7fcedc009040 comp rx=0 tx=0).stop 2023-09-13T06:13:37.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 -- 172.21.15.130:0/2567508062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0147b50 msgr2=0x7fcee0163c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:37.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0147b50 0x7fcee0163c70 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fced000b3e0 tx=0x7fced000b8a0 comp rx=0 tx=0).stop 2023-09-13T06:13:37.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 -- 172.21.15.130:0/2567508062 shutdown_connections 2023-09-13T06:13:37.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fcec4065b20 0x7fcec4067fe0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:37.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcee0147f30 0x7fcee0143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:37.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0147b50 0x7fcee0163c70 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:37.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 --2- 172.21.15.130:0/2567508062 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcee00af9e0 0x7fcee00cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:37.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 -- 172.21.15.130:0/2567508062 >> 172.21.15.130:0/2567508062 conn(0x7fcee0065990 msgr2=0x7fcee00aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:37.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 -- 172.21.15.130:0/2567508062 shutdown_connections 2023-09-13T06:13:37.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.007+0000 7fcee81db640 1 -- 172.21.15.130:0/2567508062 wait complete. 2023-09-13T06:13:37.018 INFO:tasks.ceph.mds.d.smithi164.stderr: -9190> 2023-09-13T06:12:57.746+0000 7f297f955640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T06:13:37.027 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T06:13:37.073 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2023-09-13T06:13:37.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e2e6d640 1 Processor -- start 2023-09-13T06:13:37.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e2e6d640 1 -- start start 2023-09-13T06:13:37.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e2e6d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f97dc0ccf00 0x7f97dc0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:37.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e2e6d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f97dc0cd390 0x7f97dc0cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:37.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e2e6d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc15ada0 con 0x7f97dc157ca0 2023-09-13T06:13:37.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e2e6d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97dc0cdca0 con 0x7f97dc0ccf00 2023-09-13T06:13:37.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e2e6d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97dc0cdf80 con 0x7f97dc0cd390 2023-09-13T06:13:37.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97d3fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f97dc0ccf00 0x7f97dc0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:37.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e140a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f97dc0cd390 0x7f97dc0cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:37.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97d3fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f97dc0ccf00 0x7f97dc0cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33432/0 (socket says 172.21.15.130:33432) 2023-09-13T06:13:37.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97d3fff640 1 -- 172.21.15.130:0/3047069405 learned_addr learned my addr 172.21.15.130:0/3047069405 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:37.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e140a640 1 -- 172.21.15.130:0/3047069405 >> v2:172.21.15.130:3300/0 conn(0x7f97dc0ccf00 msgr2=0x7f97dc0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:37.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e140a640 1 --2- 172.21.15.130:0/3047069405 >> v2:172.21.15.130:3300/0 conn(0x7f97dc0ccf00 0x7f97dc0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:37.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e140a640 1 -- 172.21.15.130:0/3047069405 >> v1:172.21.15.164:6789/0 conn(0x7f97dc157ca0 legacy=0x7f97dc15b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:37.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97e140a640 1 -- 172.21.15.130:0/3047069405 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc0ce260 con 0x7f97dc0cd390 2023-09-13T06:13:37.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.167+0000 7f97d37fe640 1 -- 172.21.15.130:0/3047069405 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121689484 0 0) 0x7f97dc15ada0 con 0x7f97dc157ca0 2023-09-13T06:13:37.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97e140a640 1 --2- 172.21.15.130:0/3047069405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97dc0cd390 0x7f97dc0cb360 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0ccaf0 tx=0x7f97d401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ed827e486f32c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:37.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97d37fe640 1 -- 172.21.15.130:0/3047069405 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d40a59c0 con 0x7f97dc0cd390 2023-09-13T06:13:37.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97d37fe640 1 -- 172.21.15.130:0/3047069405 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d40a5b20 con 0x7f97dc0cd390 2023-09-13T06:13:37.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97d37fe640 1 -- 172.21.15.130:0/3047069405 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d40ad440 con 0x7f97dc0cd390 2023-09-13T06:13:37.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97e2e6d640 1 -- 172.21.15.130:0/3047069405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97dc0cd390 msgr2=0x7f97dc0cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:37.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97e2e6d640 1 --2- 172.21.15.130:0/3047069405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97dc0cd390 0x7f97dc0cb360 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0ccaf0 tx=0x7f97d401c8e0 comp rx=0 tx=0).stop 2023-09-13T06:13:37.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97e2e6d640 1 -- 172.21.15.130:0/3047069405 shutdown_connections 2023-09-13T06:13:37.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97e2e6d640 1 --2- 172.21.15.130:0/3047069405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97dc0cd390 0x7f97dc0cb360 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:37.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97e2e6d640 1 --2- 172.21.15.130:0/3047069405 >> v2:172.21.15.130:3300/0 conn(0x7f97dc0ccf00 0x7f97dc0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:37.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97e2e6d640 1 -- 172.21.15.130:0/3047069405 >> 172.21.15.130:0/3047069405 conn(0x7f97dc065990 msgr2=0x7f97dc065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:37.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97e2e6d640 1 -- 172.21.15.130:0/3047069405 shutdown_connections 2023-09-13T06:13:37.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.171+0000 7f97e2e6d640 1 -- 172.21.15.130:0/3047069405 wait complete. 2023-09-13T06:13:37.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e2e6d640 1 Processor -- start 2023-09-13T06:13:37.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e2e6d640 1 -- start start 2023-09-13T06:13:37.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e2e6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97dc0ccf00 0x7f97dc163a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:37.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e2e6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97dc0cd390 0x7f97dc146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:37.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e2e6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97dc157ca0 0x7f97dc144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:37.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e2e6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc163f60 con 0x7f97dc0ccf00 2023-09-13T06:13:37.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e2e6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc1457d0 con 0x7f97dc0cd390 2023-09-13T06:13:37.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e2e6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc145ab0 con 0x7f97dc157ca0 2023-09-13T06:13:37.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e0c09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97dc0ccf00 0x7f97dc163a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:37.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e0c09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97dc0ccf00 0x7f97dc163a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33448/0 (socket says 172.21.15.130:33448) 2023-09-13T06:13:37.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e0c09640 1 -- 172.21.15.130:0/4160059541 learned_addr learned my addr 172.21.15.130:0/4160059541 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:37.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e140a640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97dc157ca0 0x7f97dc144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:37.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97d3fff640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97dc0cd390 0x7f97dc146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:37.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e0c09640 1 -- 172.21.15.130:0/4160059541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97dc157ca0 msgr2=0x7f97dc144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:37.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e0c09640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97dc157ca0 0x7f97dc144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:37.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e0c09640 1 -- 172.21.15.130:0/4160059541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97dc0cd390 msgr2=0x7f97dc146870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:37.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e0c09640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97dc0cd390 0x7f97dc146870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:37.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e0c09640 1 -- 172.21.15.130:0/4160059541 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d4009a70 con 0x7f97dc0ccf00 2023-09-13T06:13:37.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e0c09640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97dc0ccf00 0x7f97dc163a20 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f97d8001ec0 tx=0x7f97d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:37.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97d17fa640 1 -- 172.21.15.130:0/4160059541 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d80054e0 con 0x7f97dc0ccf00 2023-09-13T06:13:37.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97d17fa640 1 -- 172.21.15.130:0/4160059541 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d8003600 con 0x7f97dc0ccf00 2023-09-13T06:13:37.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97d17fa640 1 -- 172.21.15.130:0/4160059541 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d80039b0 con 0x7f97dc0ccf00 2023-09-13T06:13:37.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e2e6d640 1 -- 172.21.15.130:0/4160059541 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc145d90 con 0x7f97dc0ccf00 2023-09-13T06:13:37.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e2e6d640 1 -- 172.21.15.130:0/4160059541 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc146350 con 0x7f97dc0ccf00 2023-09-13T06:13:37.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.175+0000 7f97e2e6d640 1 -- 172.21.15.130:0/4160059541 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc0674a0 con 0x7f97dc0ccf00 2023-09-13T06:13:37.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.179+0000 7f97d17fa640 1 -- 172.21.15.130:0/4160059541 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f97d8003b10 con 0x7f97dc0ccf00 2023-09-13T06:13:37.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.179+0000 7f97d17fa640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c8065b20 0x7f97c8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:37.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.179+0000 7f97d17fa640 1 -- 172.21.15.130:0/4160059541 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f97d8082930 con 0x7f97dc0ccf00 2023-09-13T06:13:37.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.179+0000 7f97d3fff640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c8065b20 0x7f97c8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:37.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.179+0000 7f97d3fff640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c8065b20 0x7f97c8067fe0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f97dc06d9d0 tx=0x7f97cc009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:37.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.183+0000 7f97d17fa640 1 -- 172.21.15.130:0/4160059541 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f97d8050230 con 0x7f97dc0ccf00 2023-09-13T06:13:37.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:37.363+0000 7f97e2e6d640 1 -- 172.21.15.130:0/4160059541 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f97dc073e50 con 0x7f97dc0ccf00 2023-09-13T06:13:38.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.003+0000 7f97d17fa640 1 -- 172.21.15.130:0/4160059541 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v94) v1 ==== 104+0+0 (secure 0 0 0) 0x7f97d8017020 con 0x7f97dc0ccf00 2023-09-13T06:13:38.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 -- 172.21.15.130:0/4160059541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c8065b20 msgr2=0x7f97c8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:38.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c8065b20 0x7f97c8067fe0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f97dc06d9d0 tx=0x7f97cc009240 comp rx=0 tx=0).stop 2023-09-13T06:13:38.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 -- 172.21.15.130:0/4160059541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97dc0ccf00 msgr2=0x7f97dc163a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:38.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97dc0ccf00 0x7f97dc163a20 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f97d8001ec0 tx=0x7f97d800c8e0 comp rx=0 tx=0).stop 2023-09-13T06:13:38.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 -- 172.21.15.130:0/4160059541 shutdown_connections 2023-09-13T06:13:38.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f97c8065b20 0x7f97c8067fe0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:38.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97dc0cd390 0x7f97dc146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:38.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97dc157ca0 0x7f97dc144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:38.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 --2- 172.21.15.130:0/4160059541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97dc0ccf00 0x7f97dc163a20 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:38.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 -- 172.21.15.130:0/4160059541 >> 172.21.15.130:0/4160059541 conn(0x7f97dc065990 msgr2=0x7f97dc0ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:38.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 -- 172.21.15.130:0/4160059541 shutdown_connections 2023-09-13T06:13:38.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.007+0000 7f97e2e6d640 1 -- 172.21.15.130:0/4160059541 wait complete. 2023-09-13T06:13:38.030 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T06:13:38.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc84d99f640 1 Processor -- start 2023-09-13T06:13:38.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc84d99f640 1 -- start start 2023-09-13T06:13:38.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc84d99f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc8480d0c10 0x7fc848160de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:38.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc84d99f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc84806f530 0x7fc84806f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:38.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc84d99f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84806fec0 con 0x7fc848143460 2023-09-13T06:13:38.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc84d99f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc848140740 con 0x7fc8480d0c10 2023-09-13T06:13:38.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc84d99f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84815d900 con 0x7fc84806f530 2023-09-13T06:13:38.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc846ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc8480d0c10 0x7fc848160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:38.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc83e7fc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fc848143460 0x7fc8480b6f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59070/0 (socket says 172.21.15.130:59070) 2023-09-13T06:13:38.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc83e7fc640 1 -- 172.21.15.130:0/2536174066 learned_addr learned my addr 172.21.15.130:0/2536174066 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:38.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc8477fe640 1 --2- 172.21.15.130:0/2536174066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc84806f530 0x7fc84806f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:38.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc846ffd640 1 -- 172.21.15.130:0/2536174066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc84806f530 msgr2=0x7fc84806f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:38.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc846ffd640 1 --2- 172.21.15.130:0/2536174066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc84806f530 0x7fc84806f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:38.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc846ffd640 1 -- 172.21.15.130:0/2536174066 >> v1:172.21.15.130:6789/0 conn(0x7fc848143460 legacy=0x7fc8480b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:38.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc846ffd640 1 -- 172.21.15.130:0/2536174066 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8480d0ff0 con 0x7fc8480d0c10 2023-09-13T06:13:38.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.175+0000 7fc8467fc640 1 -- 172.21.15.130:0/2536174066 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684563093 0 0) 0x7fc830001120 con 0x7fc848143460 2023-09-13T06:13:38.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc846ffd640 1 --2- 172.21.15.130:0/2536174066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8480d0c10 0x7fc848160de0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fc8380097c0 tx=0x7fc83801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54016f2d04500a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:38.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc8467fc640 1 -- 172.21.15.130:0/2536174066 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8380ab600 con 0x7fc8480d0c10 2023-09-13T06:13:38.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc8467fc640 1 -- 172.21.15.130:0/2536174066 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8380a7050 con 0x7fc8480d0c10 2023-09-13T06:13:38.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc8467fc640 1 -- 172.21.15.130:0/2536174066 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8380ab980 con 0x7fc8480d0c10 2023-09-13T06:13:38.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc84d99f640 1 -- 172.21.15.130:0/2536174066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8480d0c10 msgr2=0x7fc848160de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:38.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc84d99f640 1 --2- 172.21.15.130:0/2536174066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8480d0c10 0x7fc848160de0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fc8380097c0 tx=0x7fc83801c480 comp rx=0 tx=0).stop 2023-09-13T06:13:38.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc84d99f640 1 -- 172.21.15.130:0/2536174066 shutdown_connections 2023-09-13T06:13:38.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc84d99f640 1 --2- 172.21.15.130:0/2536174066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc84806f530 0x7fc84806f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:38.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc84d99f640 1 --2- 172.21.15.130:0/2536174066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8480d0c10 0x7fc848160de0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:38.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc84d99f640 1 -- 172.21.15.130:0/2536174066 >> 172.21.15.130:0/2536174066 conn(0x7fc848065990 msgr2=0x7fc848065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:38.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc84d99f640 1 -- 172.21.15.130:0/2536174066 shutdown_connections 2023-09-13T06:13:38.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.179+0000 7fc84d99f640 1 -- 172.21.15.130:0/2536174066 wait complete. 2023-09-13T06:13:38.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc84d99f640 1 Processor -- start 2023-09-13T06:13:38.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc84d99f640 1 -- start start 2023-09-13T06:13:38.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc84d99f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84806f530 0x7fc848156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:38.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc84d99f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8480d0c10 0x7fc8480b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:38.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc84d99f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848143460 0x7fc8480b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:38.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc84d99f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84813db40 con 0x7fc8480d0c10 2023-09-13T06:13:38.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc84d99f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84813cf30 con 0x7fc84806f530 2023-09-13T06:13:38.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc84d99f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84813d210 con 0x7fc848143460 2023-09-13T06:13:38.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc83e7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8480d0c10 0x7fc8480b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:38.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc83e7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8480d0c10 0x7fc8480b7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33464/0 (socket says 172.21.15.130:33464) 2023-09-13T06:13:38.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc83e7fc640 1 -- 172.21.15.130:0/2133267769 learned_addr learned my addr 172.21.15.130:0/2133267769 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:38.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc8477fe640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848143460 0x7fc8480b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:38.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc846ffd640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84806f530 0x7fc848156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:38.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc83e7fc640 1 -- 172.21.15.130:0/2133267769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848143460 msgr2=0x7fc8480b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:38.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc83e7fc640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848143460 0x7fc8480b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:38.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc83e7fc640 1 -- 172.21.15.130:0/2133267769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84806f530 msgr2=0x7fc848156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:38.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc83e7fc640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84806f530 0x7fc848156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:38.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc83e7fc640 1 -- 172.21.15.130:0/2133267769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc838009420 con 0x7fc8480d0c10 2023-09-13T06:13:38.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc846ffd640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84806f530 0x7fc848156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:38.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc83e7fc640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8480d0c10 0x7fc8480b7780 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fc83000c480 tx=0x7fc83000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:38.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc844ff9640 1 -- 172.21.15.130:0/2133267769 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300074e0 con 0x7fc8480d0c10 2023-09-13T06:13:38.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc844ff9640 1 -- 172.21.15.130:0/2133267769 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830007660 con 0x7fc8480d0c10 2023-09-13T06:13:38.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc84d99f640 1 -- 172.21.15.130:0/2133267769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84813d4f0 con 0x7fc8480d0c10 2023-09-13T06:13:38.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.183+0000 7fc844ff9640 1 -- 172.21.15.130:0/2133267769 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830004a30 con 0x7fc8480d0c10 2023-09-13T06:13:38.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.187+0000 7fc84d99f640 1 -- 172.21.15.130:0/2133267769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84813c240 con 0x7fc8480d0c10 2023-09-13T06:13:38.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.187+0000 7fc84d99f640 1 -- 172.21.15.130:0/2133267769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8480b41a0 con 0x7fc8480d0c10 2023-09-13T06:13:38.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.187+0000 7fc844ff9640 1 -- 172.21.15.130:0/2133267769 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc830004b90 con 0x7fc8480d0c10 2023-09-13T06:13:38.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.187+0000 7fc844ff9640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc828065b20 0x7fc828067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:38.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.187+0000 7fc844ff9640 1 -- 172.21.15.130:0/2133267769 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc8300826d0 con 0x7fc8480d0c10 2023-09-13T06:13:38.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.187+0000 7fc846ffd640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc828065b20 0x7fc828067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:38.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.187+0000 7fc844ff9640 1 -- 172.21.15.130:0/2133267769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7fc82806d760 con 0x7fc8480d0c10 2023-09-13T06:13:38.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.187+0000 7fc846ffd640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc828065b20 0x7fc828067fe0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc8380ad000 tx=0x7fc838008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:38.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.191+0000 7fc844ff9640 1 -- 172.21.15.130:0/2133267769 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc830018060 con 0x7fc8480d0c10 2023-09-13T06:13:38.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:38.339+0000 7fc84d99f640 1 -- 172.21.15.130:0/2133267769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc84806fec0 con 0x7fc8480d0c10 2023-09-13T06:13:39.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.007+0000 7fc844ff9640 1 -- 172.21.15.130:0/2133267769 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(193..193 src has 1..193) v4 ==== 296+0+0 (secure 0 0 0) 0x7fc830004e40 con 0x7fc8480d0c10 2023-09-13T06:13:39.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.007+0000 7fc844ff9640 1 -- 172.21.15.130:0/2133267769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=194}) v3 -- 0x7fc82806bb90 con 0x7fc8480d0c10 2023-09-13T06:13:39.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.011+0000 7fc844ff9640 1 -- 172.21.15.130:0/2133267769 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v193) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc84806fec0 con 0x7fc8480d0c10 2023-09-13T06:13:39.012 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_metadata' removed 2023-09-13T06:13:39.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 -- 172.21.15.130:0/2133267769 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc828065b20 msgr2=0x7fc828067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:39.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc828065b20 0x7fc828067fe0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc8380ad000 tx=0x7fc838008040 comp rx=0 tx=0).stop 2023-09-13T06:13:39.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 -- 172.21.15.130:0/2133267769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8480d0c10 msgr2=0x7fc8480b7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:39.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8480d0c10 0x7fc8480b7780 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fc83000c480 tx=0x7fc83000c940 comp rx=0 tx=0).stop 2023-09-13T06:13:39.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 -- 172.21.15.130:0/2133267769 shutdown_connections 2023-09-13T06:13:39.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc828065b20 0x7fc828067fe0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:39.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848143460 0x7fc8480b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:39.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8480d0c10 0x7fc8480b7780 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:39.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 --2- 172.21.15.130:0/2133267769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84806f530 0x7fc848156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:39.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 -- 172.21.15.130:0/2133267769 >> 172.21.15.130:0/2133267769 conn(0x7fc848065990 msgr2=0x7fc84815e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:39.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 -- 172.21.15.130:0/2133267769 shutdown_connections 2023-09-13T06:13:39.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.015+0000 7fc84d99f640 1 -- 172.21.15.130:0/2133267769 wait complete. 2023-09-13T06:13:39.035 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T06:13:39.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.175+0000 7f1e2e007640 1 Processor -- start 2023-09-13T06:13:39.179 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e2e007640 1 -- start start 2023-09-13T06:13:39.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e2e007640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1e280ccc10 0x7f1e2815dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:39.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e2e007640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1e280b3170 0x7f1e280b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:39.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e2e007640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e280ccff0 con 0x7f1e280b1ff0 2023-09-13T06:13:39.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e2e007640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2815b590 con 0x7f1e280b3170 2023-09-13T06:13:39.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e2e007640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e280b12f0 con 0x7f1e280ccc10 2023-09-13T06:13:39.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e1ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1e280b3170 0x7f1e280b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:39.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e1ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1e280b3170 0x7f1e280b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33470/0 (socket says 172.21.15.130:33470) 2023-09-13T06:13:39.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e1ffff640 1 -- 172.21.15.130:0/3481990644 learned_addr learned my addr 172.21.15.130:0/3481990644 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:39.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e277fe640 1 --2- 172.21.15.130:0/3481990644 >> v2:172.21.15.164:3300/0 conn(0x7f1e280ccc10 0x7f1e2815dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:39.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e1ffff640 1 -- 172.21.15.130:0/3481990644 >> v2:172.21.15.164:3300/0 conn(0x7f1e280ccc10 msgr2=0x7f1e2815dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:39.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e1ffff640 1 --2- 172.21.15.130:0/3481990644 >> v2:172.21.15.164:3300/0 conn(0x7f1e280ccc10 0x7f1e2815dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:39.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e1ffff640 1 -- 172.21.15.130:0/3481990644 >> v1:172.21.15.164:6789/0 conn(0x7f1e280b1ff0 legacy=0x7f1e280cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:39.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e1ffff640 1 -- 172.21.15.130:0/3481990644 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2815e520 con 0x7f1e280b3170 2023-09-13T06:13:39.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.179+0000 7f1e277fe640 1 --2- 172.21.15.130:0/3481990644 >> v2:172.21.15.164:3300/0 conn(0x7f1e280ccc10 0x7f1e2815dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:39.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e1ffff640 1 --2- 172.21.15.130:0/3481990644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e280b3170 0x7f1e280b1ab0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f1e280cee30 tx=0x7f1e1001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d5eeca5d0b0d53 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:39.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e26ffd640 1 -- 172.21.15.130:0/3481990644 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e100a7c70 con 0x7f1e280b3170 2023-09-13T06:13:39.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e26ffd640 1 -- 172.21.15.130:0/3481990644 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e100a7dd0 con 0x7f1e280b3170 2023-09-13T06:13:39.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e26ffd640 1 -- 172.21.15.130:0/3481990644 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e100af660 con 0x7f1e280b3170 2023-09-13T06:13:39.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e2e007640 1 -- 172.21.15.130:0/3481990644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e280b3170 msgr2=0x7f1e280b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:39.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e2e007640 1 --2- 172.21.15.130:0/3481990644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e280b3170 0x7f1e280b1ab0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f1e280cee30 tx=0x7f1e1001eba0 comp rx=0 tx=0).stop 2023-09-13T06:13:39.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e2e007640 1 -- 172.21.15.130:0/3481990644 shutdown_connections 2023-09-13T06:13:39.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e2e007640 1 --2- 172.21.15.130:0/3481990644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e280b3170 0x7f1e280b1ab0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:39.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e2e007640 1 --2- 172.21.15.130:0/3481990644 >> v2:172.21.15.164:3300/0 conn(0x7f1e280ccc10 0x7f1e2815dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:39.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e2e007640 1 -- 172.21.15.130:0/3481990644 >> 172.21.15.130:0/3481990644 conn(0x7f1e280735e0 msgr2=0x7f1e28065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:39.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e2e007640 1 -- 172.21.15.130:0/3481990644 shutdown_connections 2023-09-13T06:13:39.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e2e007640 1 -- 172.21.15.130:0/3481990644 wait complete. 2023-09-13T06:13:39.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.183+0000 7f1e2e007640 1 Processor -- start 2023-09-13T06:13:39.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e2e007640 1 -- start start 2023-09-13T06:13:39.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e2e007640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e280b1ff0 0x7f1e2806cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:39.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e2e007640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e280b3170 0x7f1e28157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:39.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e2e007640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e280ccc10 0x7f1e280aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:39.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e2e007640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280afac0 con 0x7f1e280b1ff0 2023-09-13T06:13:39.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e2e007640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e28158640 con 0x7f1e280ccc10 2023-09-13T06:13:39.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e2e007640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e28158920 con 0x7f1e280b3170 2023-09-13T06:13:39.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e277fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e280b1ff0 0x7f1e2806cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:39.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e277fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e280b1ff0 0x7f1e2806cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33484/0 (socket says 172.21.15.130:33484) 2023-09-13T06:13:39.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e277fe640 1 -- 172.21.15.130:0/512089794 learned_addr learned my addr 172.21.15.130:0/512089794 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:39.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e27fff640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e280ccc10 0x7f1e280aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:39.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e1ffff640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e280b3170 0x7f1e28157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:39.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e277fe640 1 -- 172.21.15.130:0/512089794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e280b3170 msgr2=0x7f1e28157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:39.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e277fe640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e280b3170 0x7f1e28157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:39.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e277fe640 1 -- 172.21.15.130:0/512089794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e280ccc10 msgr2=0x7f1e280aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:39.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e277fe640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e280ccc10 0x7f1e280aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:39.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e277fe640 1 -- 172.21.15.130:0/512089794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1000b770 con 0x7f1e280b1ff0 2023-09-13T06:13:39.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e27fff640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e280ccc10 0x7f1e280aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:39.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e1ffff640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e280b3170 0x7f1e28157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:39.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e277fe640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e280b1ff0 0x7f1e2806cd60 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800d800 tx=0x7f1e1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:39.193 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e24ff9640 1 -- 172.21.15.130:0/512089794 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180096c0 con 0x7f1e280b1ff0 2023-09-13T06:13:39.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e24ff9640 1 -- 172.21.15.130:0/512089794 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18009820 con 0x7f1e280b1ff0 2023-09-13T06:13:39.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e2e007640 1 -- 172.21.15.130:0/512089794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e280af750 con 0x7f1e280b1ff0 2023-09-13T06:13:39.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e24ff9640 1 -- 172.21.15.130:0/512089794 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18009bd0 con 0x7f1e280b1ff0 2023-09-13T06:13:39.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e2e007640 1 -- 172.21.15.130:0/512089794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2806d2a0 con 0x7f1e280b1ff0 2023-09-13T06:13:39.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.187+0000 7f1e2e007640 1 -- 172.21.15.130:0/512089794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e280618a0 con 0x7f1e280b1ff0 2023-09-13T06:13:39.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.191+0000 7f1e24ff9640 1 -- 172.21.15.130:0/512089794 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1e18009d30 con 0x7f1e280b1ff0 2023-09-13T06:13:39.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.191+0000 7f1e24ff9640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e08065b20 0x7f1e08067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:39.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.191+0000 7f1e24ff9640 1 -- 172.21.15.130:0/512089794 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f1e18083880 con 0x7f1e280b1ff0 2023-09-13T06:13:39.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.191+0000 7f1e24ff9640 1 -- 172.21.15.130:0/512089794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=194}) v3 -- 0x7f1e0806c8f0 con 0x7f1e280b1ff0 2023-09-13T06:13:39.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.191+0000 7f1e1ffff640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e08065b20 0x7f1e08067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:39.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.191+0000 7f1e1ffff640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e08065b20 0x7f1e08067fe0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1e100b1000 tx=0x7f1e10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:39.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.195+0000 7f1e24ff9640 1 -- 172.21.15.130:0/512089794 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1e180513c0 con 0x7f1e280b1ff0 2023-09-13T06:13:39.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:39.343+0000 7f1e2e007640 1 -- 172.21.15.130:0/512089794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e280adaf0 con 0x7f1e280b1ff0 2023-09-13T06:13:40.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.011+0000 7f1e24ff9640 1 -- 172.21.15.130:0/512089794 <== mon.0 v2:172.21.15.130:3300/0 7 ==== osd_map(194..194 src has 1..194) v4 ==== 296+0+0 (secure 0 0 0) 0x7f1e18011340 con 0x7f1e280b1ff0 2023-09-13T06:13:40.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.011+0000 7f1e24ff9640 1 -- 172.21.15.130:0/512089794 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f1e0806b680 con 0x7f1e280b1ff0 2023-09-13T06:13:40.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.015+0000 7f1e24ff9640 1 -- 172.21.15.130:0/512089794 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v194) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1e180549e0 con 0x7f1e280b1ff0 2023-09-13T06:13:40.023 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cephfs_data' removed 2023-09-13T06:13:40.026 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 -- 172.21.15.130:0/512089794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e08065b20 msgr2=0x7f1e08067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e08065b20 0x7f1e08067fe0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1e100b1000 tx=0x7f1e10008040 comp rx=0 tx=0).stop 2023-09-13T06:13:40.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 -- 172.21.15.130:0/512089794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e280b1ff0 msgr2=0x7f1e2806cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e280b1ff0 0x7f1e2806cd60 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800d800 tx=0x7f1e1800dcc0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 -- 172.21.15.130:0/512089794 shutdown_connections 2023-09-13T06:13:40.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1e08065b20 0x7f1e08067fe0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e280ccc10 0x7f1e280aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.028 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e280b3170 0x7f1e28157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 --2- 172.21.15.130:0/512089794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e280b1ff0 0x7f1e2806cd60 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 -- 172.21.15.130:0/512089794 >> 172.21.15.130:0/512089794 conn(0x7f1e280735e0 msgr2=0x7f1e2815da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:40.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 -- 172.21.15.130:0/512089794 shutdown_connections 2023-09-13T06:13:40.029 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.027+0000 7f1e2e007640 1 -- 172.21.15.130:0/512089794 wait complete. 2023-09-13T06:13:40.047 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-13T06:13:40.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120ce19640 1 Processor -- start 2023-09-13T06:13:40.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120ce19640 1 -- start start 2023-09-13T06:13:40.188 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120ce19640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f12080cc1d0 0x7f12080cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120ce19640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120806f7f0 con 0x7f1208158c10 2023-09-13T06:13:40.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120ce19640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120815c230 con 0x7f12080b1580 2023-09-13T06:13:40.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120ce19640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12080ccba0 con 0x7f12080cc1d0 2023-09-13T06:13:40.189 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120659c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1208158c10 0x7f12080b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59074/0 (socket says 172.21.15.130:59074) 2023-09-13T06:13:40.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120659c640 1 -- 172.21.15.130:0/814410824 learned_addr learned my addr 172.21.15.130:0/814410824 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:40.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887992234 0 0) 0x7f120806f7f0 con 0x7f1208158c10 2023-09-13T06:13:40.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f4003530 con 0x7f1208158c10 2023-09-13T06:13:40.190 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f11fffff640 1 --2- 172.21.15.130:0/814410824 >> v2:172.21.15.164:3300/0 conn(0x7f12080cc1d0 0x7f12080cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410320707 0 0) 0x7f11f4003530 con 0x7f1208158c10 2023-09-13T06:13:40.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 >> v2:172.21.15.164:3300/0 conn(0x7f12080cc1d0 msgr2=0x7f12080cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:40.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 --2- 172.21.15.130:0/814410824 >> v2:172.21.15.164:3300/0 conn(0x7f12080cc1d0 0x7f12080cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 >> v1:172.21.15.164:6789/0 conn(0x7f12080b1580 legacy=0x7f12080b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080b0c50 con 0x7f1208158c10 2023-09-13T06:13:40.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f11f8001680 con 0x7f1208158c10 2023-09-13T06:13:40.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 >> v1:172.21.15.130:6789/0 conn(0x7f1208158c10 legacy=0x7f12080b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11f40039d0 0x7f11f4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f40047d0 0x7f11f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11f40051e0 0x7f11f400fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.200 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12080ccba0 con 0x7f11f40039d0 2023-09-13T06:13:40.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f4010540 con 0x7f11f40051e0 2023-09-13T06:13:40.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f4010700 con 0x7f11f40047d0 2023-09-13T06:13:40.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120659c640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11f40039d0 0x7f11f4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1206d9d640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11f40051e0 0x7f11f400fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.201 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f11fffff640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f40047d0 0x7f11f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120659c640 1 -- 172.21.15.130:0/814410824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f40047d0 msgr2=0x7f11f4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:40.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120659c640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f40047d0 0x7f11f4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120659c640 1 -- 172.21.15.130:0/814410824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11f40051e0 msgr2=0x7f11f400fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:40.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120659c640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11f40051e0 0x7f11f400fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f120659c640 1 -- 172.21.15.130:0/814410824 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f4003530 con 0x7f11f40039d0 2023-09-13T06:13:40.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1206d9d640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11f40051e0 0x7f11f400fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:40.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.187+0000 7f1206d9d640 1 -- 172.21.15.130:0/814410824 reap_dead start 2023-09-13T06:13:40.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.191+0000 7f120659c640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11f40039d0 0x7f11f4003df0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f11f8001ec0 tx=0x7f11f801caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bc873123afebb1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:40.203 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.191+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8005ae0 con 0x7f11f40039d0 2023-09-13T06:13:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.191+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8005c40 con 0x7f11f40039d0 2023-09-13T06:13:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.191+0000 7f1205d9b640 1 -- 172.21.15.130:0/814410824 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f80072b0 con 0x7f11f40039d0 2023-09-13T06:13:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.191+0000 7f120ce19640 1 -- 172.21.15.130:0/814410824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11f40039d0 msgr2=0x7f11f4003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.191+0000 7f120ce19640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11f40039d0 0x7f11f4003df0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f11f8001ec0 tx=0x7f11f801caf0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.191+0000 7f120ce19640 1 -- 172.21.15.130:0/814410824 shutdown_connections 2023-09-13T06:13:40.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.191+0000 7f120ce19640 1 --2- 172.21.15.130:0/814410824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11f40039d0 0x7f11f4003df0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.191+0000 7f120ce19640 1 -- 172.21.15.130:0/814410824 >> 172.21.15.130:0/814410824 conn(0x7f1208065990 msgr2=0x7f1208065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:40.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.191+0000 7f120ce19640 1 -- 172.21.15.130:0/814410824 shutdown_connections 2023-09-13T06:13:40.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.191+0000 7f120ce19640 1 -- 172.21.15.130:0/814410824 wait complete. 2023-09-13T06:13:40.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f120ce19640 1 Processor -- start 2023-09-13T06:13:40.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f120ce19640 1 -- start start 2023-09-13T06:13:40.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f120ce19640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f40039d0 0x7f1208149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f120ce19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1208158ff0 0x7f1208159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f120ce19640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12080ae400 0x7f12080ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f120ce19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1208149f70 con 0x7f1208158ff0 2023-09-13T06:13:40.206 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f120ce19640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12081599b0 con 0x7f12080ae400 2023-09-13T06:13:40.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f120ce19640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12080a8430 con 0x7f11f40039d0 2023-09-13T06:13:40.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11fffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1208158ff0 0x7f1208159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11fffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1208158ff0 0x7f1208159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33494/0 (socket says 172.21.15.130:33494) 2023-09-13T06:13:40.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11fffff640 1 -- 172.21.15.130:0/1050480261 learned_addr learned my addr 172.21.15.130:0/1050480261 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:40.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f120659c640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f40039d0 0x7f1208149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f1206d9d640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12080ae400 0x7f12080ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11fffff640 1 -- 172.21.15.130:0/1050480261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f40039d0 msgr2=0x7f1208149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11fffff640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f40039d0 0x7f1208149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11fffff640 1 -- 172.21.15.130:0/1050480261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12080ae400 msgr2=0x7f12080ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11fffff640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12080ae400 0x7f12080ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11fffff640 1 -- 172.21.15.130:0/1050480261 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080a8cd0 con 0x7f1208158ff0 2023-09-13T06:13:40.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11fffff640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1208158ff0 0x7f1208159470 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f11f0011690 tx=0x7f11f0011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:40.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11feffd640 1 -- 172.21.15.130:0/1050480261 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0015870 con 0x7f1208158ff0 2023-09-13T06:13:40.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11feffd640 1 -- 172.21.15.130:0/1050480261 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f00159d0 con 0x7f1208158ff0 2023-09-13T06:13:40.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f120ce19640 1 -- 172.21.15.130:0/1050480261 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12080af150 con 0x7f1208158ff0 2023-09-13T06:13:40.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f11feffd640 1 -- 172.21.15.130:0/1050480261 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0015d40 con 0x7f1208158ff0 2023-09-13T06:13:40.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.195+0000 7f120ce19640 1 -- 172.21.15.130:0/1050480261 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12080a8960 con 0x7f1208158ff0 2023-09-13T06:13:40.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.199+0000 7f120ce19640 1 -- 172.21.15.130:0/1050480261 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12080a8e60 con 0x7f1208158ff0 2023-09-13T06:13:40.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.199+0000 7f11feffd640 1 -- 172.21.15.130:0/1050480261 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f11f00263f0 con 0x7f1208158ff0 2023-09-13T06:13:40.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.199+0000 7f11feffd640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11e8065b20 0x7f11e8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.199+0000 7f11feffd640 1 -- 172.21.15.130:0/1050480261 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f11f00836e0 con 0x7f1208158ff0 2023-09-13T06:13:40.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.199+0000 7f120659c640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11e8065b20 0x7f11e8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.199+0000 7f120659c640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11e8065b20 0x7f11e8067fe0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f11f80ab000 tx=0x7f11f80b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:40.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.203+0000 7f11feffd640 1 -- 172.21.15.130:0/1050480261 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f11f0051290 con 0x7f1208158ff0 2023-09-13T06:13:40.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.351+0000 7f120ce19640 1 -- 172.21.15.130:0/1050480261 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f12080674a0 con 0x7f1208158ff0 2023-09-13T06:13:40.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.355+0000 7f11feffd640 1 -- 172.21.15.130:0/1050480261 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f11f00548b0 con 0x7f1208158ff0 2023-09-13T06:13:40.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 -- 172.21.15.130:0/1050480261 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11e8065b20 msgr2=0x7f11e8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11e8065b20 0x7f11e8067fe0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f11f80ab000 tx=0x7f11f80b1040 comp rx=0 tx=0).stop 2023-09-13T06:13:40.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 -- 172.21.15.130:0/1050480261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1208158ff0 msgr2=0x7f1208159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1208158ff0 0x7f1208159470 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f11f0011690 tx=0x7f11f0011a90 comp rx=0 tx=0).stop 2023-09-13T06:13:40.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 -- 172.21.15.130:0/1050480261 shutdown_connections 2023-09-13T06:13:40.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f11e8065b20 0x7f11e8067fe0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12080ae400 0x7f12080ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1208158ff0 0x7f1208159470 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.362 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 --2- 172.21.15.130:0/1050480261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f40039d0 0x7f1208149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 -- 172.21.15.130:0/1050480261 >> 172.21.15.130:0/1050480261 conn(0x7f1208065990 msgr2=0x7f120815adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:40.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 -- 172.21.15.130:0/1050480261 shutdown_connections 2023-09-13T06:13:40.363 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.359+0000 7f120ce19640 1 -- 172.21.15.130:0/1050480261 wait complete. 2023-09-13T06:13:40.379 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-09-13T06:13:40.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.515+0000 7fe5ef72c640 1 Processor -- start 2023-09-13T06:13:40.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.515+0000 7fe5ef72c640 1 -- start start 2023-09-13T06:13:40.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5ef72c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e815d5f0 0x7fe5e80cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5ef72c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e80cce60 con 0x7fe5e815d9d0 2023-09-13T06:13:40.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5ef72c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e80cd140 con 0x7fe5e80ae170 2023-09-13T06:13:40.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5ef72c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e80cd420 con 0x7fe5e815d5f0 2023-09-13T06:13:40.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5edcc9640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe5e815d9d0 0x7fe5e80cdf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:59078/0 (socket says 172.21.15.130:59078) 2023-09-13T06:13:40.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5edcc9640 1 -- 172.21.15.130:0/2179416523 learned_addr learned my addr 172.21.15.130:0/2179416523 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:40.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5ed4c8640 1 --2- 172.21.15.130:0/2179416523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e815d5f0 0x7fe5e80cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5dffff640 1 -- 172.21.15.130:0/2179416523 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974464940 0 0) 0x7fe5e80cce60 con 0x7fe5e815d9d0 2023-09-13T06:13:40.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5dffff640 1 -- 172.21.15.130:0/2179416523 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5d4003530 con 0x7fe5e815d9d0 2023-09-13T06:13:40.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5dffff640 1 -- 172.21.15.130:0/2179416523 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781807512 0 0) 0x7fe5e80cd140 con 0x7fe5e80ae170 2023-09-13T06:13:40.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5dffff640 1 -- 172.21.15.130:0/2179416523 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e80cce60 con 0x7fe5e80ae170 2023-09-13T06:13:40.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5ed4c8640 1 -- 172.21.15.130:0/2179416523 >> v1:172.21.15.164:6789/0 conn(0x7fe5e80ae170 legacy=0x7fe5e81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5ed4c8640 1 -- 172.21.15.130:0/2179416523 >> v1:172.21.15.130:6789/0 conn(0x7fe5e815d9d0 legacy=0x7fe5e80cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.519+0000 7fe5ed4c8640 1 -- 172.21.15.130:0/2179416523 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e80cd700 con 0x7fe5e815d5f0 2023-09-13T06:13:40.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.523+0000 7fe5ed4c8640 1 --2- 172.21.15.130:0/2179416523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e815d5f0 0x7fe5e80cc7f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400a990 tx=0x7fe5e401d800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44c554a0db83b1c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:40.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.523+0000 7fe5dffff640 1 -- 172.21.15.130:0/2179416523 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40a67e0 con 0x7fe5e815d5f0 2023-09-13T06:13:40.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.523+0000 7fe5dffff640 1 -- 172.21.15.130:0/2179416523 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e40a6940 con 0x7fe5e815d5f0 2023-09-13T06:13:40.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.523+0000 7fe5dffff640 1 -- 172.21.15.130:0/2179416523 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40a6cd0 con 0x7fe5e815d5f0 2023-09-13T06:13:40.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.523+0000 7fe5ef72c640 1 -- 172.21.15.130:0/2179416523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e815d5f0 msgr2=0x7fe5e80cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.523+0000 7fe5ef72c640 1 --2- 172.21.15.130:0/2179416523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e815d5f0 0x7fe5e80cc7f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400a990 tx=0x7fe5e401d800 comp rx=0 tx=0).stop 2023-09-13T06:13:40.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.523+0000 7fe5ef72c640 1 -- 172.21.15.130:0/2179416523 shutdown_connections 2023-09-13T06:13:40.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.523+0000 7fe5ef72c640 1 --2- 172.21.15.130:0/2179416523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e815d5f0 0x7fe5e80cc7f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.523+0000 7fe5ef72c640 1 -- 172.21.15.130:0/2179416523 >> 172.21.15.130:0/2179416523 conn(0x7fe5e8065990 msgr2=0x7fe5e8065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:40.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.523+0000 7fe5ef72c640 1 -- 172.21.15.130:0/2179416523 shutdown_connections 2023-09-13T06:13:40.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.523+0000 7fe5ef72c640 1 -- 172.21.15.130:0/2179416523 wait complete. 2023-09-13T06:13:40.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ef72c640 1 Processor -- start 2023-09-13T06:13:40.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ef72c640 1 -- start start 2023-09-13T06:13:40.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ef72c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5e80ae170 0x7fe5e814ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ef72c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e815d5f0 0x7fe5e8147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ef72c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5e815d9d0 0x7fe5e814a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ef72c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e814ef80 con 0x7fe5e80ae170 2023-09-13T06:13:40.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ef72c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e81497c0 con 0x7fe5e815d9d0 2023-09-13T06:13:40.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ef72c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e814de60 con 0x7fe5e815d5f0 2023-09-13T06:13:40.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ed4c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5e80ae170 0x7fe5e814ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ed4c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5e80ae170 0x7fe5e814ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33496/0 (socket says 172.21.15.130:33496) 2023-09-13T06:13:40.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ed4c8640 1 -- 172.21.15.130:0/3799664781 learned_addr learned my addr 172.21.15.130:0/3799664781 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:40.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5eccc7640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e815d5f0 0x7fe5e8147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5edcc9640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5e815d9d0 0x7fe5e814a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ed4c8640 1 -- 172.21.15.130:0/3799664781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e815d5f0 msgr2=0x7fe5e8147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ed4c8640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e815d5f0 0x7fe5e8147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ed4c8640 1 -- 172.21.15.130:0/3799664781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5e815d9d0 msgr2=0x7fe5e814a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:40.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ed4c8640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5e815d9d0 0x7fe5e814a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:40.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ed4c8640 1 -- 172.21.15.130:0/3799664781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e400a5c0 con 0x7fe5e80ae170 2023-09-13T06:13:40.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5edcc9640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5e815d9d0 0x7fe5e814a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:40.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ed4c8640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5e80ae170 0x7fe5e814ea40 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400a990 tx=0x7fe5e401a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:40.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ddffb640 1 -- 172.21.15.130:0/3799664781 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40af9a0 con 0x7fe5e80ae170 2023-09-13T06:13:40.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ddffb640 1 -- 172.21.15.130:0/3799664781 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e40afb00 con 0x7fe5e80ae170 2023-09-13T06:13:40.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ddffb640 1 -- 172.21.15.130:0/3799664781 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40b9440 con 0x7fe5e80ae170 2023-09-13T06:13:40.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ef72c640 1 -- 172.21.15.130:0/3799664781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e814db80 con 0x7fe5e80ae170 2023-09-13T06:13:40.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ef72c640 1 -- 172.21.15.130:0/3799664781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e8149cb0 con 0x7fe5e80ae170 2023-09-13T06:13:40.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.527+0000 7fe5ef72c640 1 -- 172.21.15.130:0/3799664781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e80618a0 con 0x7fe5e80ae170 2023-09-13T06:13:40.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.531+0000 7fe5ddffb640 1 -- 172.21.15.130:0/3799664781 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe5e40b5040 con 0x7fe5e80ae170 2023-09-13T06:13:40.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.531+0000 7fe5ddffb640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5cc065b20 0x7fe5cc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:40.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.531+0000 7fe5ddffb640 1 -- 172.21.15.130:0/3799664781 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe5e411d750 con 0x7fe5e80ae170 2023-09-13T06:13:40.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.531+0000 7fe5eccc7640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5cc065b20 0x7fe5cc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:40.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.531+0000 7fe5eccc7640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5cc065b20 0x7fe5cc067fe0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8007fd0 tx=0x7fe5d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:40.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.535+0000 7fe5ddffb640 1 -- 172.21.15.130:0/3799664781 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe5e40eb300 con 0x7fe5e80ae170 2023-09-13T06:13:40.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:40.735+0000 7fe5ef72c640 1 -- 172.21.15.130:0/3799664781 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fe5e80660b0 con 0x7fe5e80ae170 2023-09-13T06:13:41.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ddffb640 1 -- 172.21.15.130:0/3799664781 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v597) v1 ==== 135+0+0 (secure 0 0 0) 0x7fe5e40ee920 con 0x7fe5e80ae170 2023-09-13T06:13:41.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 -- 172.21.15.130:0/3799664781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5cc065b20 msgr2=0x7fe5cc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:41.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5cc065b20 0x7fe5cc067fe0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8007fd0 tx=0x7fe5d8009040 comp rx=0 tx=0).stop 2023-09-13T06:13:41.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 -- 172.21.15.130:0/3799664781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5e80ae170 msgr2=0x7fe5e814ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:41.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5e80ae170 0x7fe5e814ea40 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400a990 tx=0x7fe5e401a5a0 comp rx=0 tx=0).stop 2023-09-13T06:13:41.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 -- 172.21.15.130:0/3799664781 shutdown_connections 2023-09-13T06:13:41.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fe5cc065b20 0x7fe5cc067fe0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:41.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5e815d9d0 0x7fe5e814a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:41.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e815d5f0 0x7fe5e8147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:41.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 --2- 172.21.15.130:0/3799664781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5e80ae170 0x7fe5e814ea40 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:41.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 -- 172.21.15.130:0/3799664781 >> 172.21.15.130:0/3799664781 conn(0x7fe5e8065990 msgr2=0x7fe5e8070390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:41.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 -- 172.21.15.130:0/3799664781 shutdown_connections 2023-09-13T06:13:41.020 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:41.015+0000 7fe5ef72c640 1 -- 172.21.15.130:0/3799664781 wait complete. 2023-09-13T06:13:41.037 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-09-13T06:13:41.038 INFO:tasks.cephfs_test_runner: 2023-09-13T06:13:41.038 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-09-13T06:13:41.039 INFO:tasks.cephfs_test_runner:Ran 10 tests in 707.793s 2023-09-13T06:13:41.039 INFO:tasks.cephfs_test_runner: 2023-09-13T06:13:41.039 INFO:tasks.cephfs_test_runner:OK 2023-09-13T06:13:41.040 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-09-13T06:13:41.051 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-09-13T06:13:41.064 INFO:tasks.kclient:Unmounting kernel clients... 2023-09-13T06:13:41.065 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:13:41.065 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:41.075 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:13:41.076 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-09-13T06:13:41.076 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:41.126 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15767 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-13T06:13:41.126 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:13:41.127 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:41.137 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:13:41.137 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-09-13T06:13:41.137 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T06:13:41.187 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12058 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-13T06:13:41.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.188 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:13:41.197 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T06:13:41.197 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T06:13:41.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.199 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T06:13:41.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.263 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T06:13:41.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.372 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2023-09-13T06:13:41.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.510 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-09-13T06:13:41.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.520 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2023-09-13T06:13:41.587 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2023-09-13T06:13:41.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:13:41.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.589 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:13:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-13T06:13:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T06:13:41.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.601 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T06:13:41.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.666 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T06:13:41.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.782 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2023-09-13T06:13:41.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.955 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-09-13T06:13:41.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T06:13:41.965 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2023-09-13T06:13:42.040 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2023-09-13T06:13:42.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:13:42.043 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-13T06:13:42.052 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-13T06:13:42.053 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:13:42.191 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f18059db640 1 Processor -- start 2023-09-13T06:13:42.192 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f18059db640 1 -- start start 2023-09-13T06:13:42.194 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f18059db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18000d1750 0x7f180015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f18059db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f18000d1090 0x7f1800146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.195 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f18059db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000b63c0 con 0x7f18000d1b30 2023-09-13T06:13:42.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f18059db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180015dea0 con 0x7f18000d1090 2023-09-13T06:13:42.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f18059db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000d0c20 con 0x7f18000d1750 2023-09-13T06:13:42.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f17f67fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f18000d1090 0x7f1800146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f17f67fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f18000d1090 0x7f1800146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43702/0 (socket says 172.21.15.130:43702) 2023-09-13T06:13:42.197 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f17f67fc640 1 -- 172.21.15.130:0/3134006174 learned_addr learned my addr 172.21.15.130:0/3134006174 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:42.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f17feffd640 1 --2- 172.21.15.130:0/3134006174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18000d1750 0x7f180015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f17f67fc640 1 -- 172.21.15.130:0/3134006174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18000d1750 msgr2=0x7f180015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:42.198 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f17f67fc640 1 --2- 172.21.15.130:0/3134006174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18000d1750 0x7f180015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f17f67fc640 1 -- 172.21.15.130:0/3134006174 >> v1:172.21.15.164:6789/0 conn(0x7f18000d1b30 legacy=0x7f18000b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.199 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.191+0000 7f17f67fc640 1 -- 172.21.15.130:0/3134006174 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000b6610 con 0x7f18000d1090 2023-09-13T06:13:42.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f17f67fc640 1 --2- 172.21.15.130:0/3134006174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18000d1090 0x7f1800146820 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009e50 tx=0x7f17e801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abfc17e5b720728 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:42.207 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f17fe7fc640 1 -- 172.21.15.130:0/3134006174 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80a58a0 con 0x7f18000d1090 2023-09-13T06:13:42.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f17fe7fc640 1 -- 172.21.15.130:0/3134006174 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e80a5a00 con 0x7f18000d1090 2023-09-13T06:13:42.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f17fe7fc640 1 -- 172.21.15.130:0/3134006174 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80a5d90 con 0x7f18000d1090 2023-09-13T06:13:42.208 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f18059db640 1 -- 172.21.15.130:0/3134006174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18000d1090 msgr2=0x7f1800146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f18059db640 1 --2- 172.21.15.130:0/3134006174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18000d1090 0x7f1800146820 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009e50 tx=0x7f17e801c9e0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f18059db640 1 -- 172.21.15.130:0/3134006174 shutdown_connections 2023-09-13T06:13:42.209 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f18059db640 1 --2- 172.21.15.130:0/3134006174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18000d1090 0x7f1800146820 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f18059db640 1 --2- 172.21.15.130:0/3134006174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18000d1750 0x7f180015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f18059db640 1 -- 172.21.15.130:0/3134006174 >> 172.21.15.130:0/3134006174 conn(0x7f180006f170 msgr2=0x7f180006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:42.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f18059db640 1 -- 172.21.15.130:0/3134006174 shutdown_connections 2023-09-13T06:13:42.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.195+0000 7f18059db640 1 -- 172.21.15.130:0/3134006174 wait complete. 2023-09-13T06:13:42.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f18059db640 1 Processor -- start 2023-09-13T06:13:42.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f18059db640 1 -- start start 2023-09-13T06:13:42.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f18059db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18000d1090 0x7f180013bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f18059db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18000d1750 0x7f18000b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f18059db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18000d1b30 0x7f18000b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f18059db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180013c1b0 con 0x7f18000d1090 2023-09-13T06:13:42.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f18059db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180013e8d0 con 0x7f18000d1b30 2023-09-13T06:13:42.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f18059db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000b4c80 con 0x7f18000d1750 2023-09-13T06:13:42.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17feffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18000d1090 0x7f180013bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17feffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18000d1090 0x7f180013bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43704/0 (socket says 172.21.15.130:43704) 2023-09-13T06:13:42.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17feffd640 1 -- 172.21.15.130:0/2814148784 learned_addr learned my addr 172.21.15.130:0/2814148784 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:42.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17f67fc640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18000d1750 0x7f18000b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17ff7fe640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18000d1b30 0x7f18000b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17feffd640 1 -- 172.21.15.130:0/2814148784 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18000d1750 msgr2=0x7f18000b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17feffd640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18000d1750 0x7f18000b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17feffd640 1 -- 172.21.15.130:0/2814148784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18000d1b30 msgr2=0x7f18000b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17feffd640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18000d1b30 0x7f18000b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17feffd640 1 -- 172.21.15.130:0/2814148784 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8009b30 con 0x7f18000d1090 2023-09-13T06:13:42.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17feffd640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18000d1090 0x7f180013bc70 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e930 tx=0x7f17f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:42.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17fcff9640 1 -- 172.21.15.130:0/2814148784 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0009690 con 0x7f18000d1090 2023-09-13T06:13:42.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17fcff9640 1 -- 172.21.15.130:0/2814148784 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f000ca00 con 0x7f18000d1090 2023-09-13T06:13:42.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f17fcff9640 1 -- 172.21.15.130:0/2814148784 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f000cd70 con 0x7f18000d1090 2023-09-13T06:13:42.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f18059db640 1 -- 172.21.15.130:0/2814148784 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18000b4e90 con 0x7f18000d1090 2023-09-13T06:13:42.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.199+0000 7f18059db640 1 -- 172.21.15.130:0/2814148784 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18000b5450 con 0x7f18000d1090 2023-09-13T06:13:42.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.203+0000 7f18059db640 1 -- 172.21.15.130:0/2814148784 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18000618a0 con 0x7f18000d1090 2023-09-13T06:13:42.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.203+0000 7f17fcff9640 1 -- 172.21.15.130:0/2814148784 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f17f0013470 con 0x7f18000d1090 2023-09-13T06:13:42.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.203+0000 7f17fcff9640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17e0065b20 0x7f17e0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.203+0000 7f17fcff9640 1 -- 172.21.15.130:0/2814148784 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f17f00831c0 con 0x7f18000d1090 2023-09-13T06:13:42.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.203+0000 7f17f67fc640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17e0065b20 0x7f17e0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.203+0000 7f17f67fc640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17e0065b20 0x7f17e0067fe0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f17e80ae000 tx=0x7f17e80a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:42.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.207+0000 7f17fcff9640 1 -- 172.21.15.130:0/2814148784 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f17f0050f80 con 0x7f18000d1090 2023-09-13T06:13:42.353 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.351+0000 7f18059db640 1 -- 172.21.15.130:0/2814148784 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1800147170 con 0x7f17e0065b20 2023-09-13T06:13:42.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f17fcff9640 1 -- 172.21.15.130:0/2814148784 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49695 (secure 0 0 0) 0x7f17e8009250 con 0x7f17e0065b20 2023-09-13T06:13:42.356 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:42.357 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:13:42.357 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 -- 172.21.15.130:0/2814148784 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17e0065b20 msgr2=0x7f17e0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17e0065b20 0x7f17e0067fe0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f17e80ae000 tx=0x7f17e80a7070 comp rx=0 tx=0).stop 2023-09-13T06:13:42.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 -- 172.21.15.130:0/2814148784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18000d1090 msgr2=0x7f180013bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18000d1090 0x7f180013bc70 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e930 tx=0x7f17f000edf0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 -- 172.21.15.130:0/2814148784 shutdown_connections 2023-09-13T06:13:42.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f17e0065b20 0x7f17e0067fe0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18000d1b30 0x7f18000b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18000d1750 0x7f18000b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 --2- 172.21.15.130:0/2814148784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18000d1090 0x7f180013bc70 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 -- 172.21.15.130:0/2814148784 >> 172.21.15.130:0/2814148784 conn(0x7f180006f170 msgr2=0x7f180006f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:42.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 -- 172.21.15.130:0/2814148784 shutdown_connections 2023-09-13T06:13:42.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.355+0000 7f18059db640 1 -- 172.21.15.130:0/2814148784 wait complete. 2023-09-13T06:13:42.376 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":559,"stamp":"2023-09-13T06:13:40.702050+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112173,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450326,"statfs":{"total":1600000000,"available":1485134306,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489063,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000869"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":354,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-13T06:13:37.010412+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:13:37.010412+0000","last_peered":"2023-09-13T06:13:37.010412+0000","last_clean":"2023-09-13T06:13:37.010412+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:13:37.010412+0000","last_undegraded":"2023-09-13T06:13:37.010412+0000","last_fullsized":"2023-09-13T06:13:37.010412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185422,"statfs":{"total":200000000,"available":189872665,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.72599999999999998,"15min":0.70299999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":0.91700000000000004,"5min":1.0589999999999999,"15min":1.3320000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73299999999999998,"15min":0.70599999999999996},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":0.83599999999999997,"5min":1.0089999999999999,"15min":1.0649999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88400000000000001,"5min":0.96199999999999997,"15min":0.999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.34999999999999998},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":1.0960000000000001},"last":0.78600000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.877,"15min":1.395},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.42899999999999999},"max":{"1min":0.95099999999999996,"5min":0.96199999999999997,"15min":1.2030000000000001},"last":0.81100000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.47599999999999998},"max":{"1min":0.89400000000000002,"5min":0.97999999999999998,"15min":1.357},"last":0.875},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.60099999999999998,"5min":0.51400000000000001,"15min":0.48899999999999999},"max":{"1min":0.92200000000000004,"5min":1.0149999999999999,"15min":1.2629999999999999},"last":0.72299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.316},"max":{"1min":0.85299999999999998,"5min":0.89300000000000002,"15min":0.95899999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.63300000000000001,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.018},"last":0.90800000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.65700000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.35199999999999998},"max":{"1min":0.86799999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.371},"max":{"1min":0.93500000000000005,"5min":1.004,"15min":1.1319999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.42099999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.0920000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71299999999999997,"15min":0.69599999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46600000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.93999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19495,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175817,"statfs":{"total":200000000,"available":180037054,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.49099999999999999,"5min":0.44500000000000001,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":1.1439999999999999,"15min":1.181},"last":0.627},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72499999999999998,"15min":0.69799999999999995},"min":{"1min":0.51600000000000001,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.91800000000000004,"5min":1.008,"15min":1.028},"last":0.67100000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71899999999999997,"15min":0.69899999999999995},"min":{"1min":0.61599999999999999,"5min":0.439,"15min":0.35499999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0840000000000001},"last":0.495},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.44400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":1.0900000000000001,"15min":1.153},"last":0.72299999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75600000000000001,"15min":0.72799999999999998},"min":{"1min":0.58299999999999996,"5min":0.53700000000000003,"15min":0.39300000000000002},"max":{"1min":0.98899999999999999,"5min":1.0569999999999999,"15min":1.4750000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.49299999999999999,"15min":0.39000000000000001},"max":{"1min":0.93899999999999995,"5min":1.0229999999999999,"15min":1.085},"last":0.60299999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77400000000000002,"15min":0.76100000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.47499999999999998},"max":{"1min":1.0649999999999999,"5min":1.222,"15min":1.222},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.58999999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.526},"last":0.73199999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.315},"max":{"1min":0.88700000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.312},"max":{"1min":0.86599999999999999,"5min":1.198,"15min":1.198},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66200000000000003,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.32800000000000001},"max":{"1min":0.88800000000000001,"5min":1.254,"15min":1.254},"last":0.747}]},{"osd":7,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.505,"5min":0.45700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95899999999999996,"5min":1.1639999999999999,"15min":4.3879999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51700000000000002,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.90800000000000003,"5min":1.056,"15min":1.133},"last":0.64900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574999,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173769,"statfs":{"total":200000000,"available":177939522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.32000000000000001},"max":{"1min":0.81399999999999995,"5min":0.94699999999999995,"15min":1.0389999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70799999999999996,"15min":0.68600000000000005},"min":{"1min":0.52500000000000002,"5min":0.33500000000000002,"15min":0.30199999999999999},"max":{"1min":0.85999999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.745}]},{"osd":1,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74199999999999999,"15min":0.70499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71699999999999997,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.71399999999999997},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.872,"5min":1.01,"15min":1.2729999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.71099999999999997},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.96499999999999997,"15min":0.997},"last":0.628},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.749,"15min":0.72199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47099999999999997},"max":{"1min":0.85199999999999998,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.72599999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.432,"5min":0.308,"15min":0.308},"max":{"1min":0.90900000000000003,"5min":0.96999999999999997,"15min":1.0169999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.97499999999999998,"15min":1.077},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90700000000000003,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":1.159,"15min":1.159},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73099999999999998,"15min":0.71799999999999997},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.41799999999999998},"max":{"1min":0.92400000000000004,"5min":1.171,"15min":1.171},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.48499999999999999},"max":{"1min":0.94299999999999995,"5min":1.413,"15min":1.413},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7264,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188047,"statfs":{"total":200000000,"available":192560857,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68899999999999995,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.38},"max":{"1min":0.98999999999999999,"5min":1.038,"15min":1.145},"last":0.69699999999999995}]},{"osd":1,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.69199999999999995},"min":{"1min":0.50800000000000001,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":0.94599999999999995,"5min":0.997,"15min":1.0960000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.68799999999999994},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.40500000000000003},"max":{"1min":0.93300000000000005,"5min":0.96399999999999997,"15min":1.0309999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73199999999999998,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":0.92600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.754},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.748},"min":{"1min":0.57699999999999996,"5min":0.55500000000000005,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":1.056,"15min":1.056},"last":0.77500000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.39000000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.077},"last":0.746},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76700000000000002,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.40799999999999997},"max":{"1min":0.93600000000000005,"5min":0.94999999999999996,"15min":1.071},"last":0.79600000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64500000000000002,"15min":0.624},"min":{"1min":0.439,"5min":0.41499999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":1.01},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.41799999999999998,"15min":0.34699999999999998},"max":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":1.0960000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.44,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":0.94199999999999995,"15min":1.1930000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.437},"max":{"1min":0.95299999999999996,"5min":1.0169999999999999,"15min":1.123},"last":0.67700000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.39200000000000002},"max":{"1min":0.93799999999999994,"5min":1.0009999999999999,"15min":1.26},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.98799999999999999,"15min":1.2390000000000001},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9255,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186057,"statfs":{"total":200000000,"available":190522802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45500000000000002,"15min":0.41999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.246},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.48299999999999998,"15min":0.45600000000000002},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.753,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.34200000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.44500000000000001},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52800000000000002,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.67300000000000004,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.44}]},{"osd":2,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.36799999999999999,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78100000000000003},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.52100000000000002,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":1.046,"15min":1.284},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75900000000000001,"15min":0.72999999999999998},"min":{"1min":0.61399999999999999,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.86399999999999999,"5min":1.052,"15min":1.052},"last":0.747}]},{"osd":5,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.56599999999999995,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":1.198,"15min":1.198},"last":0.624},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.875,"5min":1.107,"15min":1.2270000000000001},"last":0.65900000000000003}]},{"osd":6,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.73799999999999999},"min":{"1min":0.50600000000000001,"5min":0.48899999999999999,"15min":0.47499999999999998},"max":{"1min":0.89200000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53000000000000003},"max":{"1min":0.94599999999999995,"5min":1.1160000000000001,"15min":1.458},"last":0.78300000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.46100000000000002,"15min":0.45900000000000002},"max":{"1min":0.88300000000000001,"5min":1.1679999999999999,"15min":1.383},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79400000000000004,"15min":0.76500000000000001},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92900000000000005,"5min":1.1850000000000001,"15min":1.27},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21542,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173769,"statfs":{"total":200000000,"available":177940036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.437,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.71899999999999997,"15min":10.401},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48099999999999998,"15min":0.45900000000000002},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.27400000000000002},"max":{"1min":0.70799999999999996,"5min":0.79700000000000004,"15min":5.4429999999999996},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.59699999999999998,"5min":0.70099999999999996,"15min":5.2640000000000002},"last":0.377},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51200000000000001,"15min":0.49399999999999999},"min":{"1min":0.372,"5min":0.35899999999999999,"15min":0.312},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":4.3369999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":6.0410000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.755,"5min":0.85099999999999998,"15min":6.1600000000000001},"last":0.47699999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79400000000000004,"15min":0.78100000000000003},"min":{"1min":0.58799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.94099999999999995,"5min":1.0880000000000001,"15min":5.4809999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79200000000000004,"15min":0.77600000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.44700000000000001},"max":{"1min":1.008,"5min":1.1200000000000001,"15min":4.0599999999999996},"last":0.82799999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":4.2089999999999996},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.501},"max":{"1min":1.0229999999999999,"5min":1.1399999999999999,"15min":5.5289999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.505,"15min":0.35099999999999998},"max":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":4.1609999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76800000000000002,"15min":0.74399999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0980000000000001,"15min":4.2380000000000004},"last":0.76300000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.754},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.42699999999999999},"max":{"1min":0.999,"5min":1.159,"15min":4.2400000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79800000000000004,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.48099999999999998},"max":{"1min":0.98799999999999999,"5min":1.0589999999999999,"15min":4.2649999999999997},"last":0.80400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13350,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181961,"statfs":{"total":200000000,"available":186328700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.55600000000000005,"5min":0.78100000000000003,"15min":2.4020000000000001},"last":0.496},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.497,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27300000000000002},"max":{"1min":0.60999999999999999,"5min":0.78100000000000003,"15min":0.81100000000000005},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.47799999999999998},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":0.63500000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.53000000000000003,"15min":0.495},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.86299999999999999,"15min":0.94199999999999995},"last":0.47099999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56299999999999994,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.39600000000000002,"15min":0.379},"max":{"1min":0.65200000000000002,"5min":0.86399999999999999,"15min":0.88},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":4.0599999999999996},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.74399999999999999},"min":{"1min":0.57799999999999996,"5min":0.52200000000000002,"15min":0.40400000000000003},"max":{"1min":0.94099999999999995,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.75},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":1.121,"15min":1.2150000000000001},"last":0.72799999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77900000000000003,"15min":0.754},"min":{"1min":0.56000000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79100000000000004,"15min":0.76000000000000001},"min":{"1min":0.628,"5min":0.50800000000000001,"15min":0.42999999999999999},"max":{"1min":1.04,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83699999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.77500000000000002,"15min":0.753},"min":{"1min":0.623,"5min":0.496,"15min":0.39900000000000002},"max":{"1min":1,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.76600000000000001},"min":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.46100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0640000000000001,"15min":1.3799999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79100000000000004,"15min":0.75600000000000001},"min":{"1min":0.56999999999999995,"5min":0.48299999999999998,"15min":0.42599999999999999},"max":{"1min":0.95999999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.874},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78300000000000003,"15min":0.76400000000000001},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.41699999999999998},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.2769999999999999},"last":0.77200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9831,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185481,"statfs":{"total":200000000,"available":189932670,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46000000000000002,"15min":0.45400000000000001},"min":{"1min":0.28199999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":2.0190000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.316,"15min":0.27500000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":2.294},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.50900000000000001},"min":{"1min":0.42099999999999999,"5min":0.35699999999999998,"15min":0.28999999999999998},"max":{"1min":0.78700000000000003,"5min":0.875,"15min":2.2410000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.38,"5min":0.315,"15min":0.29499999999999998},"max":{"1min":0.748,"5min":0.76500000000000001,"15min":2.056},"last":0.372}]},{"osd":3,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":2.0859999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.46000000000000002,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.73399999999999999,"5min":0.81000000000000005,"15min":2.3820000000000001},"last":0.44800000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.51000000000000001,"5min":0.47599999999999998,"15min":0.436},"max":{"1min":1.0600000000000001,"5min":1.103,"15min":2.1749999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.61399999999999999,"5min":0.56299999999999994,"15min":0.436},"max":{"1min":1,"5min":1.0940000000000001,"15min":2.3370000000000002},"last":0.56399999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54800000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.052,"5min":1.2609999999999999,"15min":2.3119999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":1.145,"15min":2.1469999999999998},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.57299999999999995,"5min":0.5,"15min":0.47699999999999998},"max":{"1min":1.04,"5min":1.0820000000000001,"15min":2.415},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.64500000000000002,"5min":0.46200000000000002,"15min":0.41499999999999998},"max":{"1min":1.198,"5min":1.198,"15min":2.347},"last":0.61899999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.499,"15min":0.495},"max":{"1min":1.0169999999999999,"5min":1.2130000000000001,"15min":2.367},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0309999999999999,"5min":1.0489999999999999,"15min":2.1179999999999999},"last":0.74399999999999999}]}]}],"pool_statfs":[]}} 2023-09-13T06:13:42.378 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:13:42.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6f064ab640 1 Processor -- start 2023-09-13T06:13:42.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6f064ab640 1 -- start start 2023-09-13T06:13:42.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6f064ab640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f001436e0 0x7f6f000ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6f064ab640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6f000acd80 0x7f6f00070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6f064ab640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0006f640 con 0x7f6f00146540 2023-09-13T06:13:42.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6f064ab640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0006f890 con 0x7f6f000acd80 2023-09-13T06:13:42.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6f064ab640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0006fb70 con 0x7f6f001436e0 2023-09-13T06:13:42.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6f04a48640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6f00146540 0x7f6f00160eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46356/0 (socket says 172.21.15.130:46356) 2023-09-13T06:13:42.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6f04a48640 1 -- 172.21.15.130:0/793610283 learned_addr learned my addr 172.21.15.130:0/793610283 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:42.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6eff7fe640 1 --2- 172.21.15.130:0/793610283 >> v2:172.21.15.164:3300/0 conn(0x7f6f000acd80 0x7f6f00070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223773222 0 0) 0x7f6f0006f640 con 0x7f6f00146540 2023-09-13T06:13:42.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.515+0000 7f6efffff640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f001436e0 0x7f6f000ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee8003530 con 0x7f6f00146540 2023-09-13T06:13:42.521 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2718946272 0 0) 0x7f6ee8003530 con 0x7f6f00146540 2023-09-13T06:13:42.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f001436e0 msgr2=0x7f6f000ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:42.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f001436e0 0x7f6f000ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 >> v2:172.21.15.164:3300/0 conn(0x7f6f000acd80 msgr2=0x7f6f00070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:42.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 --2- 172.21.15.130:0/793610283 >> v2:172.21.15.164:3300/0 conn(0x7f6f000acd80 0x7f6f00070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.522 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0006fe50 con 0x7f6f00146540 2023-09-13T06:13:42.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f6ef8001a00 con 0x7f6f00146540 2023-09-13T06:13:42.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 >> v1:172.21.15.130:6789/0 conn(0x7f6f00146540 legacy=0x7f6f00160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ee80039f0 0x7f6ee8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f001436e0 0x7f6ee80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ee8004d10 0x7f6ee8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0006f890 con 0x7f6ee8004d10 2023-09-13T06:13:42.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0006fb70 con 0x7f6ee80039f0 2023-09-13T06:13:42.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee800ba90 con 0x7f6f001436e0 2023-09-13T06:13:42.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6f04a48640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ee8004d10 0x7f6ee8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6eff7fe640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f001436e0 0x7f6ee80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6efffff640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ee80039f0 0x7f6ee8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6f04a48640 1 -- 172.21.15.130:0/793610283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f001436e0 msgr2=0x7f6ee80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6f04a48640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f001436e0 0x7f6ee80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6f04a48640 1 -- 172.21.15.130:0/793610283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ee80039f0 msgr2=0x7f6ee8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6f04a48640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ee80039f0 0x7f6ee8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.519+0000 7f6f04a48640 1 -- 172.21.15.130:0/793610283 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8003530 con 0x7f6ee8004d10 2023-09-13T06:13:42.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f04a48640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ee8004d10 0x7f6ee8005190 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800a890 tx=0x7f6ef801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c8987d8006acd5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:42.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80ad630 con 0x7f6ee8004d10 2023-09-13T06:13:42.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef80a8070 con 0x7f6ee8004d10 2023-09-13T06:13:42.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6efeffd640 1 -- 172.21.15.130:0/793610283 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80ad9f0 con 0x7f6ee8004d10 2023-09-13T06:13:42.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 -- 172.21.15.130:0/793610283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ee8004d10 msgr2=0x7f6ee8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 --2- 172.21.15.130:0/793610283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ee8004d10 0x7f6ee8005190 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800a890 tx=0x7f6ef801d360 comp rx=0 tx=0).stop 2023-09-13T06:13:42.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f04a48640 1 -- 172.21.15.130:0/793610283 reap_dead start 2023-09-13T06:13:42.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 -- 172.21.15.130:0/793610283 shutdown_connections 2023-09-13T06:13:42.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 -- 172.21.15.130:0/793610283 >> 172.21.15.130:0/793610283 conn(0x7f6f000b0bc0 msgr2=0x7f6f000b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:42.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 -- 172.21.15.130:0/793610283 shutdown_connections 2023-09-13T06:13:42.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 -- 172.21.15.130:0/793610283 wait complete. 2023-09-13T06:13:42.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 Processor -- start 2023-09-13T06:13:42.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 -- start start 2023-09-13T06:13:42.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ee8004d10 0x7f6f001651d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f0015c6b0 0x7f6f00166dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f0015ffa0 0x7f6f00167300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00143210 con 0x7f6f0015ffa0 2023-09-13T06:13:42.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00165a20 con 0x7f6f0015c6b0 2023-09-13T06:13:42.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.523+0000 7f6f064ab640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00165d00 con 0x7f6ee8004d10 2023-09-13T06:13:42.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f04a48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f0015ffa0 0x7f6f00167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6efffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ee8004d10 0x7f6f001651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f04a48640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f0015ffa0 0x7f6f00167300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43724/0 (socket says 172.21.15.130:43724) 2023-09-13T06:13:42.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6efffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ee8004d10 0x7f6f001651d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:49048/0 (socket says 172.21.15.130:49048) 2023-09-13T06:13:42.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f04a48640 1 -- 172.21.15.130:0/3877238542 learned_addr learned my addr 172.21.15.130:0/3877238542 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:42.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6eff7fe640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f0015c6b0 0x7f6f00166dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f04a48640 1 -- 172.21.15.130:0/3877238542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ee8004d10 msgr2=0x7f6f001651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f04a48640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ee8004d10 0x7f6f001651d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f04a48640 1 -- 172.21.15.130:0/3877238542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f0015c6b0 msgr2=0x7f6f00166dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.534 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f04a48640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f0015c6b0 0x7f6f00166dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f04a48640 1 -- 172.21.15.130:0/3877238542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00165fe0 con 0x7f6f0015ffa0 2023-09-13T06:13:42.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6eff7fe640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f0015c6b0 0x7f6f00166dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:42.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f04a48640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f0015ffa0 0x7f6f00167300 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800a830 tx=0x7f6ee8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:42.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6efcff9640 1 -- 172.21.15.130:0/3877238542 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80019c0 con 0x7f6f0015ffa0 2023-09-13T06:13:42.535 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6efcff9640 1 -- 172.21.15.130:0/3877238542 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8001fe0 con 0x7f6f0015ffa0 2023-09-13T06:13:42.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6efcff9640 1 -- 172.21.15.130:0/3877238542 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80ad630 con 0x7f6f0015ffa0 2023-09-13T06:13:42.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f064ab640 1 -- 172.21.15.130:0/3877238542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f001f6e40 con 0x7f6f0015ffa0 2023-09-13T06:13:42.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f064ab640 1 -- 172.21.15.130:0/3877238542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f001662c0 con 0x7f6f0015ffa0 2023-09-13T06:13:42.536 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6f064ab640 1 -- 172.21.15.130:0/3877238542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f001f7030 con 0x7f6f0015ffa0 2023-09-13T06:13:42.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.527+0000 7f6efcff9640 1 -- 172.21.15.130:0/3877238542 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6ef80aa030 con 0x7f6f0015ffa0 2023-09-13T06:13:42.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.531+0000 7f6efcff9640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6eec065b50 0x7f6eec068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.531+0000 7f6efcff9640 1 -- 172.21.15.130:0/3877238542 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6ef811d6d0 con 0x7f6f0015ffa0 2023-09-13T06:13:42.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.531+0000 7f6efffff640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6eec065b50 0x7f6eec068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.531+0000 7f6efffff640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6eec065b50 0x7f6eec068010 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009b60 tx=0x7f6ef0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:42.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.535+0000 7f6efcff9640 1 -- 172.21.15.130:0/3877238542 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6ef80eb430 con 0x7f6f0015ffa0 2023-09-13T06:13:42.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.679+0000 7f6f064ab640 1 -- 172.21.15.130:0/3877238542 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f00070fa0 con 0x7f6eec065b50 2023-09-13T06:13:42.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.679+0000 7f6efcff9640 1 -- 172.21.15.130:0/3877238542 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49695 (secure 0 0 0) 0x7f6ef0019070 con 0x7f6eec065b50 2023-09-13T06:13:42.682 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:42.683 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:13:42.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 -- 172.21.15.130:0/3877238542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6eec065b50 msgr2=0x7f6eec068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6eec065b50 0x7f6eec068010 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009b60 tx=0x7f6ef0009190 comp rx=0 tx=0).stop 2023-09-13T06:13:42.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 -- 172.21.15.130:0/3877238542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f0015ffa0 msgr2=0x7f6f00167300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f0015ffa0 0x7f6f00167300 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800a830 tx=0x7f6ee8005800 comp rx=0 tx=0).stop 2023-09-13T06:13:42.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 -- 172.21.15.130:0/3877238542 shutdown_connections 2023-09-13T06:13:42.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f6eec065b50 0x7f6eec068010 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.685 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f0015c6b0 0x7f6f00166dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f0015ffa0 0x7f6f00167300 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 --2- 172.21.15.130:0/3877238542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ee8004d10 0x7f6f001651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 -- 172.21.15.130:0/3877238542 >> 172.21.15.130:0/3877238542 conn(0x7f6f000b0bc0 msgr2=0x7f6f00160d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:42.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 -- 172.21.15.130:0/3877238542 shutdown_connections 2023-09-13T06:13:42.686 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.683+0000 7f6f064ab640 1 -- 172.21.15.130:0/3877238542 wait complete. 2023-09-13T06:13:42.703 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":559,"stamp":"2023-09-13T06:13:40.702050+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112173,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450326,"statfs":{"total":1600000000,"available":1485134306,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489063,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000869"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":354,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-13T06:13:37.010412+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:13:37.010412+0000","last_peered":"2023-09-13T06:13:37.010412+0000","last_clean":"2023-09-13T06:13:37.010412+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:13:37.010412+0000","last_undegraded":"2023-09-13T06:13:37.010412+0000","last_fullsized":"2023-09-13T06:13:37.010412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185422,"statfs":{"total":200000000,"available":189872665,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.72599999999999998,"15min":0.70299999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":0.91700000000000004,"5min":1.0589999999999999,"15min":1.3320000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73299999999999998,"15min":0.70599999999999996},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":0.83599999999999997,"5min":1.0089999999999999,"15min":1.0649999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88400000000000001,"5min":0.96199999999999997,"15min":0.999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.34999999999999998},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":1.0960000000000001},"last":0.78600000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.877,"15min":1.395},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.42899999999999999},"max":{"1min":0.95099999999999996,"5min":0.96199999999999997,"15min":1.2030000000000001},"last":0.81100000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.47599999999999998},"max":{"1min":0.89400000000000002,"5min":0.97999999999999998,"15min":1.357},"last":0.875},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.60099999999999998,"5min":0.51400000000000001,"15min":0.48899999999999999},"max":{"1min":0.92200000000000004,"5min":1.0149999999999999,"15min":1.2629999999999999},"last":0.72299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.316},"max":{"1min":0.85299999999999998,"5min":0.89300000000000002,"15min":0.95899999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.63300000000000001,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.018},"last":0.90800000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.65700000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.35199999999999998},"max":{"1min":0.86799999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.371},"max":{"1min":0.93500000000000005,"5min":1.004,"15min":1.1319999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.42099999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.0920000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71299999999999997,"15min":0.69599999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46600000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.93999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19495,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175817,"statfs":{"total":200000000,"available":180037054,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.49099999999999999,"5min":0.44500000000000001,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":1.1439999999999999,"15min":1.181},"last":0.627},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72499999999999998,"15min":0.69799999999999995},"min":{"1min":0.51600000000000001,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.91800000000000004,"5min":1.008,"15min":1.028},"last":0.67100000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71899999999999997,"15min":0.69899999999999995},"min":{"1min":0.61599999999999999,"5min":0.439,"15min":0.35499999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0840000000000001},"last":0.495},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.44400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":1.0900000000000001,"15min":1.153},"last":0.72299999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75600000000000001,"15min":0.72799999999999998},"min":{"1min":0.58299999999999996,"5min":0.53700000000000003,"15min":0.39300000000000002},"max":{"1min":0.98899999999999999,"5min":1.0569999999999999,"15min":1.4750000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.49299999999999999,"15min":0.39000000000000001},"max":{"1min":0.93899999999999995,"5min":1.0229999999999999,"15min":1.085},"last":0.60299999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77400000000000002,"15min":0.76100000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.47499999999999998},"max":{"1min":1.0649999999999999,"5min":1.222,"15min":1.222},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.58999999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.526},"last":0.73199999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.315},"max":{"1min":0.88700000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.312},"max":{"1min":0.86599999999999999,"5min":1.198,"15min":1.198},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66200000000000003,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.32800000000000001},"max":{"1min":0.88800000000000001,"5min":1.254,"15min":1.254},"last":0.747}]},{"osd":7,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.505,"5min":0.45700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95899999999999996,"5min":1.1639999999999999,"15min":4.3879999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51700000000000002,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.90800000000000003,"5min":1.056,"15min":1.133},"last":0.64900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574999,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173769,"statfs":{"total":200000000,"available":177939522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.32000000000000001},"max":{"1min":0.81399999999999995,"5min":0.94699999999999995,"15min":1.0389999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70799999999999996,"15min":0.68600000000000005},"min":{"1min":0.52500000000000002,"5min":0.33500000000000002,"15min":0.30199999999999999},"max":{"1min":0.85999999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.745}]},{"osd":1,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74199999999999999,"15min":0.70499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71699999999999997,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.71399999999999997},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.872,"5min":1.01,"15min":1.2729999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.71099999999999997},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.96499999999999997,"15min":0.997},"last":0.628},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.749,"15min":0.72199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47099999999999997},"max":{"1min":0.85199999999999998,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.72599999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.432,"5min":0.308,"15min":0.308},"max":{"1min":0.90900000000000003,"5min":0.96999999999999997,"15min":1.0169999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.97499999999999998,"15min":1.077},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90700000000000003,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":1.159,"15min":1.159},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73099999999999998,"15min":0.71799999999999997},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.41799999999999998},"max":{"1min":0.92400000000000004,"5min":1.171,"15min":1.171},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.48499999999999999},"max":{"1min":0.94299999999999995,"5min":1.413,"15min":1.413},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7264,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188047,"statfs":{"total":200000000,"available":192560857,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68899999999999995,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.38},"max":{"1min":0.98999999999999999,"5min":1.038,"15min":1.145},"last":0.69699999999999995}]},{"osd":1,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.69199999999999995},"min":{"1min":0.50800000000000001,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":0.94599999999999995,"5min":0.997,"15min":1.0960000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.68799999999999994},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.40500000000000003},"max":{"1min":0.93300000000000005,"5min":0.96399999999999997,"15min":1.0309999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73199999999999998,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":0.92600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.754},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.748},"min":{"1min":0.57699999999999996,"5min":0.55500000000000005,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":1.056,"15min":1.056},"last":0.77500000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.39000000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.077},"last":0.746},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76700000000000002,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.40799999999999997},"max":{"1min":0.93600000000000005,"5min":0.94999999999999996,"15min":1.071},"last":0.79600000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64500000000000002,"15min":0.624},"min":{"1min":0.439,"5min":0.41499999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":1.01},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.41799999999999998,"15min":0.34699999999999998},"max":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":1.0960000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.44,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":0.94199999999999995,"15min":1.1930000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.437},"max":{"1min":0.95299999999999996,"5min":1.0169999999999999,"15min":1.123},"last":0.67700000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.39200000000000002},"max":{"1min":0.93799999999999994,"5min":1.0009999999999999,"15min":1.26},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.98799999999999999,"15min":1.2390000000000001},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9255,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186057,"statfs":{"total":200000000,"available":190522802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45500000000000002,"15min":0.41999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.246},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.48299999999999998,"15min":0.45600000000000002},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.753,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.34200000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.44500000000000001},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52800000000000002,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.67300000000000004,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.44}]},{"osd":2,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.36799999999999999,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78100000000000003},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.52100000000000002,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":1.046,"15min":1.284},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75900000000000001,"15min":0.72999999999999998},"min":{"1min":0.61399999999999999,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.86399999999999999,"5min":1.052,"15min":1.052},"last":0.747}]},{"osd":5,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.56599999999999995,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":1.198,"15min":1.198},"last":0.624},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.875,"5min":1.107,"15min":1.2270000000000001},"last":0.65900000000000003}]},{"osd":6,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.73799999999999999},"min":{"1min":0.50600000000000001,"5min":0.48899999999999999,"15min":0.47499999999999998},"max":{"1min":0.89200000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53000000000000003},"max":{"1min":0.94599999999999995,"5min":1.1160000000000001,"15min":1.458},"last":0.78300000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.46100000000000002,"15min":0.45900000000000002},"max":{"1min":0.88300000000000001,"5min":1.1679999999999999,"15min":1.383},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79400000000000004,"15min":0.76500000000000001},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92900000000000005,"5min":1.1850000000000001,"15min":1.27},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21542,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173769,"statfs":{"total":200000000,"available":177940036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.437,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.71899999999999997,"15min":10.401},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48099999999999998,"15min":0.45900000000000002},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.27400000000000002},"max":{"1min":0.70799999999999996,"5min":0.79700000000000004,"15min":5.4429999999999996},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.59699999999999998,"5min":0.70099999999999996,"15min":5.2640000000000002},"last":0.377},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51200000000000001,"15min":0.49399999999999999},"min":{"1min":0.372,"5min":0.35899999999999999,"15min":0.312},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":4.3369999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":6.0410000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.755,"5min":0.85099999999999998,"15min":6.1600000000000001},"last":0.47699999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79400000000000004,"15min":0.78100000000000003},"min":{"1min":0.58799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.94099999999999995,"5min":1.0880000000000001,"15min":5.4809999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79200000000000004,"15min":0.77600000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.44700000000000001},"max":{"1min":1.008,"5min":1.1200000000000001,"15min":4.0599999999999996},"last":0.82799999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":4.2089999999999996},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.501},"max":{"1min":1.0229999999999999,"5min":1.1399999999999999,"15min":5.5289999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.505,"15min":0.35099999999999998},"max":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":4.1609999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76800000000000002,"15min":0.74399999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0980000000000001,"15min":4.2380000000000004},"last":0.76300000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.754},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.42699999999999999},"max":{"1min":0.999,"5min":1.159,"15min":4.2400000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79800000000000004,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.48099999999999998},"max":{"1min":0.98799999999999999,"5min":1.0589999999999999,"15min":4.2649999999999997},"last":0.80400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13350,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181961,"statfs":{"total":200000000,"available":186328700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.55600000000000005,"5min":0.78100000000000003,"15min":2.4020000000000001},"last":0.496},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.497,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27300000000000002},"max":{"1min":0.60999999999999999,"5min":0.78100000000000003,"15min":0.81100000000000005},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.47799999999999998},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":0.63500000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.53000000000000003,"15min":0.495},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.86299999999999999,"15min":0.94199999999999995},"last":0.47099999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56299999999999994,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.39600000000000002,"15min":0.379},"max":{"1min":0.65200000000000002,"5min":0.86399999999999999,"15min":0.88},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":4.0599999999999996},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.74399999999999999},"min":{"1min":0.57799999999999996,"5min":0.52200000000000002,"15min":0.40400000000000003},"max":{"1min":0.94099999999999995,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.75},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":1.121,"15min":1.2150000000000001},"last":0.72799999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77900000000000003,"15min":0.754},"min":{"1min":0.56000000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79100000000000004,"15min":0.76000000000000001},"min":{"1min":0.628,"5min":0.50800000000000001,"15min":0.42999999999999999},"max":{"1min":1.04,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83699999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.77500000000000002,"15min":0.753},"min":{"1min":0.623,"5min":0.496,"15min":0.39900000000000002},"max":{"1min":1,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.76600000000000001},"min":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.46100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0640000000000001,"15min":1.3799999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79100000000000004,"15min":0.75600000000000001},"min":{"1min":0.56999999999999995,"5min":0.48299999999999998,"15min":0.42599999999999999},"max":{"1min":0.95999999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.874},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78300000000000003,"15min":0.76400000000000001},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.41699999999999998},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.2769999999999999},"last":0.77200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9831,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185481,"statfs":{"total":200000000,"available":189932670,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46000000000000002,"15min":0.45400000000000001},"min":{"1min":0.28199999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":2.0190000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.316,"15min":0.27500000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":2.294},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.50900000000000001},"min":{"1min":0.42099999999999999,"5min":0.35699999999999998,"15min":0.28999999999999998},"max":{"1min":0.78700000000000003,"5min":0.875,"15min":2.2410000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.38,"5min":0.315,"15min":0.29499999999999998},"max":{"1min":0.748,"5min":0.76500000000000001,"15min":2.056},"last":0.372}]},{"osd":3,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":2.0859999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.46000000000000002,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.73399999999999999,"5min":0.81000000000000005,"15min":2.3820000000000001},"last":0.44800000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.51000000000000001,"5min":0.47599999999999998,"15min":0.436},"max":{"1min":1.0600000000000001,"5min":1.103,"15min":2.1749999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.61399999999999999,"5min":0.56299999999999994,"15min":0.436},"max":{"1min":1,"5min":1.0940000000000001,"15min":2.3370000000000002},"last":0.56399999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54800000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.052,"5min":1.2609999999999999,"15min":2.3119999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":1.145,"15min":2.1469999999999998},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.57299999999999995,"5min":0.5,"15min":0.47699999999999998},"max":{"1min":1.04,"5min":1.0820000000000001,"15min":2.415},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.64500000000000002,"5min":0.46200000000000002,"15min":0.41499999999999998},"max":{"1min":1.198,"5min":1.198,"15min":2.347},"last":0.61899999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.499,"15min":0.495},"max":{"1min":1.0169999999999999,"5min":1.2130000000000001,"15min":2.367},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0309999999999999,"5min":1.0489999999999999,"15min":2.1179999999999999},"last":0.74399999999999999}]}]}],"pool_statfs":[]}} 2023-09-13T06:13:42.705 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-13T06:13:42.705 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:13:42.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f161d311640 1 Processor -- start 2023-09-13T06:13:42.843 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f161d311640 1 -- start start 2023-09-13T06:13:42.844 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f161d311640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f16180d1750 0x7f161815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f161d311640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16180b63c0 con 0x7f1618146f30 2023-09-13T06:13:42.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f161d311640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16180d0c20 con 0x7f16180d1090 2023-09-13T06:13:42.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f161d311640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161815dea0 con 0x7f16180d1750 2023-09-13T06:13:42.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f16177fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1618146f30 0x7f16180b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46358/0 (socket says 172.21.15.130:46358) 2023-09-13T06:13:42.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f16177fe640 1 -- 172.21.15.130:0/2723884586 learned_addr learned my addr 172.21.15.130:0/2723884586 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:42.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f1616ffd640 1 --2- 172.21.15.130:0/2723884586 >> v2:172.21.15.164:3300/0 conn(0x7f16180d1750 0x7f161815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f16167fc640 1 -- 172.21.15.130:0/2723884586 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577417033 0 0) 0x7f16180b63c0 con 0x7f1618146f30 2023-09-13T06:13:42.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f16167fc640 1 -- 172.21.15.130:0/2723884586 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1604003530 con 0x7f1618146f30 2023-09-13T06:13:42.847 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f16167fc640 1 -- 172.21.15.130:0/2723884586 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839710817 0 0) 0x7f16180d0c20 con 0x7f16180d1090 2023-09-13T06:13:42.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f16167fc640 1 -- 172.21.15.130:0/2723884586 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16180b63c0 con 0x7f16180d1090 2023-09-13T06:13:42.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f1616ffd640 1 -- 172.21.15.130:0/2723884586 >> v1:172.21.15.164:6789/0 conn(0x7f16180d1090 legacy=0x7f1618146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f1616ffd640 1 -- 172.21.15.130:0/2723884586 >> v1:172.21.15.130:6789/0 conn(0x7f1618146f30 legacy=0x7f16180b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f16167fc640 1 -- 172.21.15.130:0/2723884586 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 90798185 0 0) 0x7f1604003530 con 0x7f1618146f30 2023-09-13T06:13:42.848 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.843+0000 7f1616ffd640 1 -- 172.21.15.130:0/2723884586 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16180b6610 con 0x7f16180d1750 2023-09-13T06:13:42.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.847+0000 7f1616ffd640 1 --2- 172.21.15.130:0/2723884586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16180d1750 0x7f161815d960 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f16000097c0 tx=0x7f160001c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78afdfe3e26a27f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:42.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.847+0000 7f16167fc640 1 -- 172.21.15.130:0/2723884586 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610001a00 con 0x7f16180d1750 2023-09-13T06:13:42.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.847+0000 7f16167fc640 1 -- 172.21.15.130:0/2723884586 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16000a7050 con 0x7f16180d1750 2023-09-13T06:13:42.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.847+0000 7f16167fc640 1 -- 172.21.15.130:0/2723884586 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16000ab620 con 0x7f16180d1750 2023-09-13T06:13:42.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.847+0000 7f161d311640 1 -- 172.21.15.130:0/2723884586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16180d1750 msgr2=0x7f161815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.847+0000 7f161d311640 1 --2- 172.21.15.130:0/2723884586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16180d1750 0x7f161815d960 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f16000097c0 tx=0x7f160001c2e0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.847+0000 7f161d311640 1 -- 172.21.15.130:0/2723884586 shutdown_connections 2023-09-13T06:13:42.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.847+0000 7f161d311640 1 --2- 172.21.15.130:0/2723884586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16180d1750 0x7f161815d960 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.851 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.847+0000 7f161d311640 1 -- 172.21.15.130:0/2723884586 >> 172.21.15.130:0/2723884586 conn(0x7f161806f170 msgr2=0x7f161806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:42.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.847+0000 7f161d311640 1 -- 172.21.15.130:0/2723884586 shutdown_connections 2023-09-13T06:13:42.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.847+0000 7f161d311640 1 -- 172.21.15.130:0/2723884586 wait complete. 2023-09-13T06:13:42.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f161d311640 1 Processor -- start 2023-09-13T06:13:42.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f161d311640 1 -- start start 2023-09-13T06:13:42.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f161d311640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16180d1090 0x7f1618139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f161d311640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16180d1750 0x7f161815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.855 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f161d311640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1618146f30 0x7f161815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f161d311640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161815bf50 con 0x7f16180d1750 2023-09-13T06:13:42.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f161d311640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1618155010 con 0x7f16180d1090 2023-09-13T06:13:42.856 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f161d311640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1618155fe0 con 0x7f1618146f30 2023-09-13T06:13:42.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160e7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16180d1750 0x7f161815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160e7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16180d1750 0x7f161815ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43738/0 (socket says 172.21.15.130:43738) 2023-09-13T06:13:42.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160e7fc640 1 -- 172.21.15.130:0/4160486378 learned_addr learned my addr 172.21.15.130:0/4160486378 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:42.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f16177fe640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1618146f30 0x7f161815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f1616ffd640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16180d1090 0x7f1618139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160e7fc640 1 -- 172.21.15.130:0/4160486378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1618146f30 msgr2=0x7f161815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160e7fc640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1618146f30 0x7f161815f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160e7fc640 1 -- 172.21.15.130:0/4160486378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16180d1090 msgr2=0x7f1618139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:42.858 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160e7fc640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16180d1090 0x7f1618139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:42.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160e7fc640 1 -- 172.21.15.130:0/4160486378 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1600009420 con 0x7f16180d1750 2023-09-13T06:13:42.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160e7fc640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16180d1750 0x7f161815ed70 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f160800c530 tx=0x7f160800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:42.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160ffff640 1 -- 172.21.15.130:0/4160486378 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16080052d0 con 0x7f16180d1750 2023-09-13T06:13:42.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160ffff640 1 -- 172.21.15.130:0/4160486378 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1608005430 con 0x7f16180d1750 2023-09-13T06:13:42.859 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f160ffff640 1 -- 172.21.15.130:0/4160486378 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608012870 con 0x7f16180d1750 2023-09-13T06:13:42.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f161d311640 1 -- 172.21.15.130:0/4160486378 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1618155220 con 0x7f16180d1750 2023-09-13T06:13:42.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.851+0000 7f161d311640 1 -- 172.21.15.130:0/4160486378 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16181557e0 con 0x7f16180d1750 2023-09-13T06:13:42.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.855+0000 7f161d311640 1 -- 172.21.15.130:0/4160486378 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16180618a0 con 0x7f16180d1750 2023-09-13T06:13:42.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.855+0000 7f160ffff640 1 -- 172.21.15.130:0/4160486378 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f16080129d0 con 0x7f16180d1750 2023-09-13T06:13:42.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.855+0000 7f160ffff640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 0x7f15f8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:42.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.855+0000 7f160ffff640 1 -- 172.21.15.130:0/4160486378 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1608082b70 con 0x7f16180d1750 2023-09-13T06:13:42.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.855+0000 7f1616ffd640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 0x7f15f8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:42.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.855+0000 7f1616ffd640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 0x7f15f8067fe0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f16000ad000 tx=0x7f16000a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:42.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:42.859+0000 7f160ffff640 1 -- 172.21.15.130:0/4160486378 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1608050750 con 0x7f16180d1750 2023-09-13T06:13:43.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.003+0000 7f161d311640 1 -- 172.21.15.130:0/4160486378 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16180b7800 con 0x7f15f8065b20 2023-09-13T06:13:43.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.007+0000 7f160ffff640 1 -- 172.21.15.130:0/4160486378 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49695 (secure 0 0 0) 0x7f16000ab620 con 0x7f15f8065b20 2023-09-13T06:13:43.009 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:43.009 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:13:43.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.007+0000 7f161d311640 1 -- 172.21.15.130:0/4160486378 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 msgr2=0x7f15f8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:43.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.007+0000 7f161d311640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 0x7f15f8067fe0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f16000ad000 tx=0x7f16000a6000 comp rx=0 tx=0).stop 2023-09-13T06:13:43.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.007+0000 7f161d311640 1 -- 172.21.15.130:0/4160486378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16180d1750 msgr2=0x7f161815ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:43.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.007+0000 7f161d311640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16180d1750 0x7f161815ed70 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f160800c530 tx=0x7f160800c9f0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.007+0000 7f161d311640 1 -- 172.21.15.130:0/4160486378 shutdown_connections 2023-09-13T06:13:43.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.007+0000 7f161d311640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 0x7f15f8067fe0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.007+0000 7f161d311640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1618146f30 0x7f161815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.007+0000 7f161d311640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16180d1750 0x7f161815ed70 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.007+0000 7f161d311640 1 --2- 172.21.15.130:0/4160486378 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16180d1090 0x7f1618139bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.007+0000 7f161d311640 1 -- 172.21.15.130:0/4160486378 >> 172.21.15.130:0/4160486378 conn(0x7f161806f170 msgr2=0x7f161815dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:43.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.011+0000 7f161d311640 1 -- 172.21.15.130:0/4160486378 shutdown_connections 2023-09-13T06:13:43.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.011+0000 7f161d311640 1 -- 172.21.15.130:0/4160486378 wait complete. 2023-09-13T06:13:43.029 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":560,"stamp":"2023-09-13T06:13:42.702337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112173,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450326,"statfs":{"total":1600000000,"available":1485134306,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489063,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.693163"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":354,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-09-13T06:13:37.010412+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:13:37.010412+0000","last_peered":"2023-09-13T06:13:37.010412+0000","last_clean":"2023-09-13T06:13:37.010412+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:13:37.010412+0000","last_undegraded":"2023-09-13T06:13:37.010412+0000","last_fullsized":"2023-09-13T06:13:37.010412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:34:18.557343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185422,"statfs":{"total":200000000,"available":189872665,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.72599999999999998,"15min":0.70299999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":0.91700000000000004,"5min":1.0589999999999999,"15min":1.3320000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73299999999999998,"15min":0.70599999999999996},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":0.83599999999999997,"5min":1.0089999999999999,"15min":1.0649999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88400000000000001,"5min":0.96199999999999997,"15min":0.999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.34999999999999998},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":1.0960000000000001},"last":0.78600000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.877,"15min":1.395},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.42899999999999999},"max":{"1min":0.95099999999999996,"5min":0.96199999999999997,"15min":1.2030000000000001},"last":0.81100000000000005}]},{"osd":3,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.47599999999999998},"max":{"1min":0.89400000000000002,"5min":0.97999999999999998,"15min":1.357},"last":0.875},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.60099999999999998,"5min":0.51400000000000001,"15min":0.48899999999999999},"max":{"1min":0.92200000000000004,"5min":1.0149999999999999,"15min":1.2629999999999999},"last":0.72299999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.316},"max":{"1min":0.85299999999999998,"5min":0.89300000000000002,"15min":0.95899999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.63300000000000001,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.018},"last":0.90800000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.65700000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.35199999999999998},"max":{"1min":0.86799999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.371},"max":{"1min":0.93500000000000005,"5min":1.004,"15min":1.1319999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.42099999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.0920000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71299999999999997,"15min":0.69599999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46600000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.93999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19495,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175817,"statfs":{"total":200000000,"available":180037054,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.49099999999999999,"5min":0.44500000000000001,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":1.1439999999999999,"15min":1.181},"last":0.627},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72499999999999998,"15min":0.69799999999999995},"min":{"1min":0.51600000000000001,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.91800000000000004,"5min":1.008,"15min":1.028},"last":0.67100000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71899999999999997,"15min":0.69899999999999995},"min":{"1min":0.61599999999999999,"5min":0.439,"15min":0.35499999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0840000000000001},"last":0.495},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.44400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":1.0900000000000001,"15min":1.153},"last":0.72299999999999998}]},{"osd":2,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75600000000000001,"15min":0.72799999999999998},"min":{"1min":0.58299999999999996,"5min":0.53700000000000003,"15min":0.39300000000000002},"max":{"1min":0.98899999999999999,"5min":1.0569999999999999,"15min":1.4750000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.49299999999999999,"15min":0.39000000000000001},"max":{"1min":0.93899999999999995,"5min":1.0229999999999999,"15min":1.085},"last":0.60299999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77400000000000002,"15min":0.76100000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.47499999999999998},"max":{"1min":1.0649999999999999,"5min":1.222,"15min":1.222},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.58999999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.526},"last":0.73199999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.315},"max":{"1min":0.88700000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.312},"max":{"1min":0.86599999999999999,"5min":1.198,"15min":1.198},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66200000000000003,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.32800000000000001},"max":{"1min":0.88800000000000001,"5min":1.254,"15min":1.254},"last":0.747}]},{"osd":7,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.505,"5min":0.45700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95899999999999996,"5min":1.1639999999999999,"15min":4.3879999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51700000000000002,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.90800000000000003,"5min":1.056,"15min":1.133},"last":0.64900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574999,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173769,"statfs":{"total":200000000,"available":177939522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.32000000000000001},"max":{"1min":0.81399999999999995,"5min":0.94699999999999995,"15min":1.0389999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70799999999999996,"15min":0.68600000000000005},"min":{"1min":0.52500000000000002,"5min":0.33500000000000002,"15min":0.30199999999999999},"max":{"1min":0.85999999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.745}]},{"osd":1,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74199999999999999,"15min":0.70499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71699999999999997,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.71399999999999997},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.872,"5min":1.01,"15min":1.2729999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.71099999999999997},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.96499999999999997,"15min":0.997},"last":0.628},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.749,"15min":0.72199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47099999999999997},"max":{"1min":0.85199999999999998,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.72599999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.432,"5min":0.308,"15min":0.308},"max":{"1min":0.90900000000000003,"5min":0.96999999999999997,"15min":1.0169999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.97499999999999998,"15min":1.077},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90700000000000003,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":1.159,"15min":1.159},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73099999999999998,"15min":0.71799999999999997},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.41799999999999998},"max":{"1min":0.92400000000000004,"5min":1.171,"15min":1.171},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.48499999999999999},"max":{"1min":0.94299999999999995,"5min":1.413,"15min":1.413},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7264,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188047,"statfs":{"total":200000000,"available":192560857,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68899999999999995,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.38},"max":{"1min":0.98999999999999999,"5min":1.038,"15min":1.145},"last":0.69699999999999995}]},{"osd":1,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.69199999999999995},"min":{"1min":0.50800000000000001,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":0.94599999999999995,"5min":0.997,"15min":1.0960000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.68799999999999994},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.40500000000000003},"max":{"1min":0.93300000000000005,"5min":0.96399999999999997,"15min":1.0309999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73199999999999998,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":0.92600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.754},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.748},"min":{"1min":0.57699999999999996,"5min":0.55500000000000005,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":1.056,"15min":1.056},"last":0.77500000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.39000000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.077},"last":0.746},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76700000000000002,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.40799999999999997},"max":{"1min":0.93600000000000005,"5min":0.94999999999999996,"15min":1.071},"last":0.79600000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64500000000000002,"15min":0.624},"min":{"1min":0.439,"5min":0.41499999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":1.01},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.41799999999999998,"15min":0.34699999999999998},"max":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":1.0960000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.44,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":0.94199999999999995,"15min":1.1930000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.437},"max":{"1min":0.95299999999999996,"5min":1.0169999999999999,"15min":1.123},"last":0.67700000000000005}]},{"osd":7,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.39200000000000002},"max":{"1min":0.93799999999999994,"5min":1.0009999999999999,"15min":1.26},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.98799999999999999,"15min":1.2390000000000001},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9255,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186057,"statfs":{"total":200000000,"available":190522802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45500000000000002,"15min":0.41999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.246},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.48299999999999998,"15min":0.45600000000000002},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.753,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.34200000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.44500000000000001},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52800000000000002,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.67300000000000004,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.44}]},{"osd":2,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.36799999999999999,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78100000000000003},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.52100000000000002,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":1.046,"15min":1.284},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75900000000000001,"15min":0.72999999999999998},"min":{"1min":0.61399999999999999,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.86399999999999999,"5min":1.052,"15min":1.052},"last":0.747}]},{"osd":5,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.56599999999999995,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":1.198,"15min":1.198},"last":0.624},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.875,"5min":1.107,"15min":1.2270000000000001},"last":0.65900000000000003}]},{"osd":6,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.73799999999999999},"min":{"1min":0.50600000000000001,"5min":0.48899999999999999,"15min":0.47499999999999998},"max":{"1min":0.89200000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53000000000000003},"max":{"1min":0.94599999999999995,"5min":1.1160000000000001,"15min":1.458},"last":0.78300000000000003}]},{"osd":7,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.46100000000000002,"15min":0.45900000000000002},"max":{"1min":0.88300000000000001,"5min":1.1679999999999999,"15min":1.383},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79400000000000004,"15min":0.76500000000000001},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92900000000000005,"5min":1.1850000000000001,"15min":1.27},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21542,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173769,"statfs":{"total":200000000,"available":177940036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.437,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.71899999999999997,"15min":10.401},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48099999999999998,"15min":0.45900000000000002},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.27400000000000002},"max":{"1min":0.70799999999999996,"5min":0.79700000000000004,"15min":5.4429999999999996},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.59699999999999998,"5min":0.70099999999999996,"15min":5.2640000000000002},"last":0.377},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51200000000000001,"15min":0.49399999999999999},"min":{"1min":0.372,"5min":0.35899999999999999,"15min":0.312},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":4.3369999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":6.0410000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.755,"5min":0.85099999999999998,"15min":6.1600000000000001},"last":0.47699999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79400000000000004,"15min":0.78100000000000003},"min":{"1min":0.58799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.94099999999999995,"5min":1.0880000000000001,"15min":5.4809999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79200000000000004,"15min":0.77600000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.44700000000000001},"max":{"1min":1.008,"5min":1.1200000000000001,"15min":4.0599999999999996},"last":0.82799999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":4.2089999999999996},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.501},"max":{"1min":1.0229999999999999,"5min":1.1399999999999999,"15min":5.5289999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.505,"15min":0.35099999999999998},"max":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":4.1609999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76800000000000002,"15min":0.74399999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0980000000000001,"15min":4.2380000000000004},"last":0.76300000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.754},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.42699999999999999},"max":{"1min":0.999,"5min":1.159,"15min":4.2400000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79800000000000004,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.48099999999999998},"max":{"1min":0.98799999999999999,"5min":1.0589999999999999,"15min":4.2649999999999997},"last":0.80400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13350,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181961,"statfs":{"total":200000000,"available":186328700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.55600000000000005,"5min":0.78100000000000003,"15min":2.4020000000000001},"last":0.496},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.497,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27300000000000002},"max":{"1min":0.60999999999999999,"5min":0.78100000000000003,"15min":0.81100000000000005},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.47799999999999998},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":0.63500000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.53000000000000003,"15min":0.495},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.86299999999999999,"15min":0.94199999999999995},"last":0.47099999999999997}]},{"osd":3,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56299999999999994,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.39600000000000002,"15min":0.379},"max":{"1min":0.65200000000000002,"5min":0.86399999999999999,"15min":0.88},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":4.0599999999999996},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.74399999999999999},"min":{"1min":0.57799999999999996,"5min":0.52200000000000002,"15min":0.40400000000000003},"max":{"1min":0.94099999999999995,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.75},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":1.121,"15min":1.2150000000000001},"last":0.72799999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77900000000000003,"15min":0.754},"min":{"1min":0.56000000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79100000000000004,"15min":0.76000000000000001},"min":{"1min":0.628,"5min":0.50800000000000001,"15min":0.42999999999999999},"max":{"1min":1.04,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83699999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.77500000000000002,"15min":0.753},"min":{"1min":0.623,"5min":0.496,"15min":0.39900000000000002},"max":{"1min":1,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.76600000000000001},"min":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.46100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0640000000000001,"15min":1.3799999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79100000000000004,"15min":0.75600000000000001},"min":{"1min":0.56999999999999995,"5min":0.48299999999999998,"15min":0.42599999999999999},"max":{"1min":0.95999999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.874},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78300000000000003,"15min":0.76400000000000001},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.41699999999999998},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.2769999999999999},"last":0.77200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9831,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185481,"statfs":{"total":200000000,"available":189932670,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46000000000000002,"15min":0.45400000000000001},"min":{"1min":0.28199999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":2.0190000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.316,"15min":0.27500000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":2.294},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.50900000000000001},"min":{"1min":0.42099999999999999,"5min":0.35699999999999998,"15min":0.28999999999999998},"max":{"1min":0.78700000000000003,"5min":0.875,"15min":2.2410000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48299999999999998,"15min":0.47999999999999998},"min":{"1min":0.38,"5min":0.315,"15min":0.29499999999999998},"max":{"1min":0.748,"5min":0.76500000000000001,"15min":2.056},"last":0.372}]},{"osd":3,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":2.0859999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.46000000000000002,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.73399999999999999,"5min":0.81000000000000005,"15min":2.3820000000000001},"last":0.44800000000000001}]},{"osd":4,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.51000000000000001,"5min":0.47599999999999998,"15min":0.436},"max":{"1min":1.0600000000000001,"5min":1.103,"15min":2.1749999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.61399999999999999,"5min":0.56299999999999994,"15min":0.436},"max":{"1min":1,"5min":1.0940000000000001,"15min":2.3370000000000002},"last":0.56399999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54800000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.052,"5min":1.2609999999999999,"15min":2.3119999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":1.145,"15min":2.1469999999999998},"last":0.67700000000000005}]},{"osd":6,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.57299999999999995,"5min":0.5,"15min":0.47699999999999998},"max":{"1min":1.04,"5min":1.0820000000000001,"15min":2.415},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.64500000000000002,"5min":0.46200000000000002,"15min":0.41499999999999998},"max":{"1min":1.198,"5min":1.198,"15min":2.347},"last":0.61899999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.499,"15min":0.495},"max":{"1min":1.0169999999999999,"5min":1.2130000000000001,"15min":2.367},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0309999999999999,"5min":1.0489999999999999,"15min":2.1179999999999999},"last":0.74399999999999999}]}]}],"pool_statfs":[]}} 2023-09-13T06:13:43.031 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T06:13:43.169 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.167+0000 7feca6ad8640 1 Processor -- start 2023-09-13T06:13:43.170 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.167+0000 7feca6ad8640 1 -- start start 2023-09-13T06:13:43.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7feca6ad8640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7feca0159f20 0x7feca00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:43.171 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7feca6ad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca00b1d20 0x7feca00b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:43.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7feca6ad8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca00ccfd0 con 0x7feca00cdfc0 2023-09-13T06:13:43.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7feca6ad8640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca00b00f0 con 0x7feca0159f20 2023-09-13T06:13:43.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7feca6ad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca00b11d0 con 0x7feca00b1d20 2023-09-13T06:13:43.172 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7fec9ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7feca00cdfc0 0x7feca00b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46364/0 (socket says 172.21.15.130:46364) 2023-09-13T06:13:43.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7fec9ffff640 1 -- 172.21.15.130:0/22346647 learned_addr learned my addr 172.21.15.130:0/22346647 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:43.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7feca5075640 1 --2- 172.21.15.130:0/22346647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca00b1d20 0x7feca00b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:43.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7feca4874640 1 --2- 172.21.15.130:0/22346647 >> v2:172.21.15.164:3300/0 conn(0x7feca0159f20 0x7feca00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:43.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7fec9f7fe640 1 -- 172.21.15.130:0/22346647 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142034167 0 0) 0x7feca00ccfd0 con 0x7feca00cdfc0 2023-09-13T06:13:43.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7fec9f7fe640 1 -- 172.21.15.130:0/22346647 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec90003530 con 0x7feca00cdfc0 2023-09-13T06:13:43.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7feca5075640 1 -- 172.21.15.130:0/22346647 >> v2:172.21.15.164:3300/0 conn(0x7feca0159f20 msgr2=0x7feca00ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:43.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7feca5075640 1 --2- 172.21.15.130:0/22346647 >> v2:172.21.15.164:3300/0 conn(0x7feca0159f20 0x7feca00ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7feca5075640 1 -- 172.21.15.130:0/22346647 >> v1:172.21.15.130:6789/0 conn(0x7feca00cdfc0 legacy=0x7feca00b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:43.174 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.171+0000 7feca5075640 1 -- 172.21.15.130:0/22346647 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca00ced90 con 0x7feca00b1d20 2023-09-13T06:13:43.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7feca5075640 1 --2- 172.21.15.130:0/22346647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca00b1d20 0x7feca00b0c90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec98009d90 tx=0x7fec9801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec80d4dc4a2de052 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:43.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7fec9f7fe640 1 -- 172.21.15.130:0/22346647 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec980a5a10 con 0x7feca00b1d20 2023-09-13T06:13:43.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7fec9f7fe640 1 -- 172.21.15.130:0/22346647 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec980a5b70 con 0x7feca00b1d20 2023-09-13T06:13:43.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7fec9f7fe640 1 -- 172.21.15.130:0/22346647 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec980ad440 con 0x7feca00b1d20 2023-09-13T06:13:43.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7feca6ad8640 1 -- 172.21.15.130:0/22346647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca00b1d20 msgr2=0x7feca00b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:43.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7feca6ad8640 1 --2- 172.21.15.130:0/22346647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca00b1d20 0x7feca00b0c90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec98009d90 tx=0x7fec9801c950 comp rx=0 tx=0).stop 2023-09-13T06:13:43.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7feca6ad8640 1 -- 172.21.15.130:0/22346647 shutdown_connections 2023-09-13T06:13:43.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7feca6ad8640 1 --2- 172.21.15.130:0/22346647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca00b1d20 0x7feca00b0c90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7feca6ad8640 1 --2- 172.21.15.130:0/22346647 >> v2:172.21.15.164:3300/0 conn(0x7feca0159f20 0x7feca00ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7feca6ad8640 1 -- 172.21.15.130:0/22346647 >> 172.21.15.130:0/22346647 conn(0x7feca0065990 msgr2=0x7feca0065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:43.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7feca6ad8640 1 -- 172.21.15.130:0/22346647 shutdown_connections 2023-09-13T06:13:43.178 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7feca6ad8640 1 -- 172.21.15.130:0/22346647 wait complete. 2023-09-13T06:13:43.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7feca6ad8640 1 Processor -- start 2023-09-13T06:13:43.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.175+0000 7feca6ad8640 1 -- start start 2023-09-13T06:13:43.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca6ad8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca00b1d20 0x7feca01f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:43.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca6ad8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca00cdfc0 0x7feca01f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:43.180 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca6ad8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca0159f20 0x7feca0151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:43.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca6ad8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca00c3b40 con 0x7feca00b1d20 2023-09-13T06:13:43.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca6ad8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca01f6770 con 0x7feca00cdfc0 2023-09-13T06:13:43.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca6ad8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca00c2f30 con 0x7feca0159f20 2023-09-13T06:13:43.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca4874640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca00b1d20 0x7feca01f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:43.181 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca4874640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca00b1d20 0x7feca01f6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43752/0 (socket says 172.21.15.130:43752) 2023-09-13T06:13:43.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca4874640 1 -- 172.21.15.130:0/3973618817 learned_addr learned my addr 172.21.15.130:0/3973618817 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:43.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca5075640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca0159f20 0x7feca0151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:43.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7fec9ffff640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca00cdfc0 0x7feca01f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:43.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca4874640 1 -- 172.21.15.130:0/3973618817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca0159f20 msgr2=0x7feca0151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:43.182 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca4874640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca0159f20 0x7feca0151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca4874640 1 -- 172.21.15.130:0/3973618817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca00cdfc0 msgr2=0x7feca01f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:43.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca4874640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca00cdfc0 0x7feca01f6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca4874640 1 -- 172.21.15.130:0/3973618817 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec98009a70 con 0x7feca00b1d20 2023-09-13T06:13:43.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca4874640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca00b1d20 0x7feca01f6230 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fec9400e8a0 tx=0x7fec9400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:43.183 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7fec9d7fa640 1 -- 172.21.15.130:0/3973618817 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94009510 con 0x7feca00b1d20 2023-09-13T06:13:43.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7fec9d7fa640 1 -- 172.21.15.130:0/3973618817 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9400c940 con 0x7feca00b1d20 2023-09-13T06:13:43.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca6ad8640 1 -- 172.21.15.130:0/3973618817 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca00c3210 con 0x7feca00b1d20 2023-09-13T06:13:43.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7fec9d7fa640 1 -- 172.21.15.130:0/3973618817 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9400ccb0 con 0x7feca00b1d20 2023-09-13T06:13:43.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca6ad8640 1 -- 172.21.15.130:0/3973618817 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca00c37d0 con 0x7feca00b1d20 2023-09-13T06:13:43.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7feca6ad8640 1 -- 172.21.15.130:0/3973618817 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca00618a0 con 0x7feca00b1d20 2023-09-13T06:13:43.185 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.179+0000 7fec9d7fa640 1 -- 172.21.15.130:0/3973618817 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fec94013470 con 0x7feca00b1d20 2023-09-13T06:13:43.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.183+0000 7fec9d7fa640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec84065b20 0x7fec84067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:43.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.183+0000 7fec9d7fa640 1 -- 172.21.15.130:0/3973618817 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fec94083180 con 0x7feca00b1d20 2023-09-13T06:13:43.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.183+0000 7fec9ffff640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec84065b20 0x7fec84067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:43.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.183+0000 7fec9ffff640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec84065b20 0x7fec84067fe0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fec8c007fd0 tx=0x7fec8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:43.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.187+0000 7fec9d7fa640 1 -- 172.21.15.130:0/3973618817 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fec94050d30 con 0x7feca00b1d20 2023-09-13T06:13:43.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.335+0000 7feca6ad8640 1 -- 172.21.15.130:0/3973618817 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feca0070eb0 con 0x7feca00b1d20 2023-09-13T06:13:43.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.335+0000 7fec9d7fa640 1 -- 172.21.15.130:0/3973618817 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+13035 (secure 0 0 0) 0x7fec94054350 con 0x7feca00b1d20 2023-09-13T06:13:43.337 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:43.337 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":194,"fsid":"33902c8f-11a4-444c-a37a-ca3bab8415c5","created":"2023-09-13T06:01:07.525413+0000","modified":"2023-09-13T06:13:40.011150+0000","last_up_change":"2023-09-13T06:01:13.090794+0000","last_in_change":"2023-09-13T06:01:10.076099+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T06:01:14.595128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6801","nonce":3085363071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6803","nonce":3085363071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6807","nonce":3085363071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3085363071},{"type":"v1","addr":"172.21.15.130:6805","nonce":3085363071}]},"public_addr":"172.21.15.130:6801/3085363071","cluster_addr":"172.21.15.130:6803/3085363071","heartbeat_back_addr":"172.21.15.130:6807/3085363071","heartbeat_front_addr":"172.21.15.130:6805/3085363071","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6817","nonce":338394792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6823","nonce":338394792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6831","nonce":338394792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":338394792},{"type":"v1","addr":"172.21.15.130:6828","nonce":338394792}]},"public_addr":"172.21.15.130:6817/338394792","cluster_addr":"172.21.15.130:6823/338394792","heartbeat_back_addr":"172.21.15.130:6831/338394792","heartbeat_front_addr":"172.21.15.130:6828/338394792","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6809","nonce":3833443455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6813","nonce":3833443455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6825","nonce":3833443455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3833443455},{"type":"v1","addr":"172.21.15.130:6819","nonce":3833443455}]},"public_addr":"172.21.15.130:6809/3833443455","cluster_addr":"172.21.15.130:6813/3833443455","heartbeat_back_addr":"172.21.15.130:6825/3833443455","heartbeat_front_addr":"172.21.15.130:6819/3833443455","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6812","nonce":2159009057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6818","nonce":2159009057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6827","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6829","nonce":2159009057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":2159009057},{"type":"v1","addr":"172.21.15.130:6824","nonce":2159009057}]},"public_addr":"172.21.15.130:6812/2159009057","cluster_addr":"172.21.15.130:6818/2159009057","heartbeat_back_addr":"172.21.15.130:6829/2159009057","heartbeat_front_addr":"172.21.15.130:6824/2159009057","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6801","nonce":2197166496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6803","nonce":2197166496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6807","nonce":2197166496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2197166496},{"type":"v1","addr":"172.21.15.164:6805","nonce":2197166496}]},"public_addr":"172.21.15.164:6801/2197166496","cluster_addr":"172.21.15.164:6803/2197166496","heartbeat_back_addr":"172.21.15.164:6807/2197166496","heartbeat_front_addr":"172.21.15.164:6805/2197166496","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6809","nonce":848118120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6811","nonce":848118120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6816","nonce":848118120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":848118120},{"type":"v1","addr":"172.21.15.164:6813","nonce":848118120}]},"public_addr":"172.21.15.164:6809/848118120","cluster_addr":"172.21.15.164:6811/848118120","heartbeat_back_addr":"172.21.15.164:6816/848118120","heartbeat_front_addr":"172.21.15.164:6813/848118120","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6817","nonce":3345829618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6819","nonce":3345829618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6823","nonce":3345829618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3345829618},{"type":"v1","addr":"172.21.15.164:6821","nonce":3345829618}]},"public_addr":"172.21.15.164:6817/3345829618","cluster_addr":"172.21.15.164:6819/3345829618","heartbeat_back_addr":"172.21.15.164:6823/3345829618","heartbeat_front_addr":"172.21.15.164:6821/3345829618","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6825","nonce":3372769909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6827","nonce":3372769909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6831","nonce":3372769909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3372769909},{"type":"v1","addr":"172.21.15.164:6829","nonce":3372769909}]},"public_addr":"172.21.15.164:6825/3372769909","cluster_addr":"172.21.15.164:6827/3372769909","heartbeat_back_addr":"172.21.15.164:6831/3372769909","heartbeat_front_addr":"172.21.15.164:6829/3372769909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.245204+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.335887+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.288942+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.273774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.296470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.327920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.349770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T06:01:11.376938+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:6835/2477052868":"2023-09-14T06:13:37.003693+0000","172.21.15.164:6834/2477052868":"2023-09-14T06:13:37.003693+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T06:13:43.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 -- 172.21.15.130:0/3973618817 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec84065b20 msgr2=0x7fec84067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:43.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec84065b20 0x7fec84067fe0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fec8c007fd0 tx=0x7fec8c009040 comp rx=0 tx=0).stop 2023-09-13T06:13:43.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 -- 172.21.15.130:0/3973618817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca00b1d20 msgr2=0x7feca01f6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:43.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca00b1d20 0x7feca01f6230 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fec9400e8a0 tx=0x7fec9400eca0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 -- 172.21.15.130:0/3973618817 shutdown_connections 2023-09-13T06:13:43.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fec84065b20 0x7fec84067fe0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca00cdfc0 0x7feca01f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feca0159f20 0x7feca0151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.340 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 --2- 172.21.15.130:0/3973618817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feca00b1d20 0x7feca01f6230 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:43.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 -- 172.21.15.130:0/3973618817 >> 172.21.15.130:0/3973618817 conn(0x7feca0065990 msgr2=0x7feca006fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:43.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 -- 172.21.15.130:0/3973618817 shutdown_connections 2023-09-13T06:13:43.341 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:43.339+0000 7feca6ad8640 1 -- 172.21.15.130:0/3973618817 wait complete. 2023-09-13T06:13:44.359 INFO:tasks.ceph:Scrubbing osd.0 2023-09-13T06:13:44.360 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-13T06:13:44.512 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.511+0000 7f4e9f59e640 1 Processor -- start 2023-09-13T06:13:44.513 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.511+0000 7f4e9f59e640 1 -- start start 2023-09-13T06:13:44.514 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.511+0000 7f4e9f59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4ea0161110 0x7f4ea01615c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.511+0000 7f4e9f59e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea01468a0 con 0x7f4ea0160d30 2023-09-13T06:13:44.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.511+0000 7f4e9f59e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea00d1b40 con 0x7f4ea00b4120 2023-09-13T06:13:44.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.511+0000 7f4e9f59e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea00d1e20 con 0x7f4ea0161110 2023-09-13T06:13:44.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.511+0000 7f4e9dd9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4ea0161110 0x7f4ea01615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.515 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.511+0000 7f4e9e59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4ea0160d30 0x7f4ea0146190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46376/0 (socket says 172.21.15.130:46376) 2023-09-13T06:13:44.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.511+0000 7f4e9e59c640 1 -- 172.21.15.130:0/2183197001 learned_addr learned my addr 172.21.15.130:0/2183197001 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:44.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.515+0000 7f4e9dd9b640 1 -- 172.21.15.130:0/2183197001 >> v1:172.21.15.164:6789/0 conn(0x7f4ea00b4120 legacy=0x7f4ea00b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.515+0000 7f4e9dd9b640 1 -- 172.21.15.130:0/2183197001 >> v1:172.21.15.130:6789/0 conn(0x7f4ea0160d30 legacy=0x7f4ea0146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.515+0000 7f4e9dd9b640 1 -- 172.21.15.130:0/2183197001 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea00d2100 con 0x7f4ea0161110 2023-09-13T06:13:44.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.515+0000 7f4e9d59a640 1 -- 172.21.15.130:0/2183197001 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953761762 0 0) 0x7f4ea01468a0 con 0x7f4ea0160d30 2023-09-13T06:13:44.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.515+0000 7f4e9dd9b640 1 --2- 172.21.15.130:0/2183197001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ea0161110 0x7f4ea01615c0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f4e940097c0 tx=0x7f4e9401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a817206e6fc0a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:44.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.515+0000 7f4e9d59a640 1 -- 172.21.15.130:0/2183197001 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940ab600 con 0x7f4ea0161110 2023-09-13T06:13:44.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.515+0000 7f4e9d59a640 1 -- 172.21.15.130:0/2183197001 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e940a7050 con 0x7f4ea0161110 2023-09-13T06:13:44.518 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.515+0000 7f4e9d59a640 1 -- 172.21.15.130:0/2183197001 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940ab980 con 0x7f4ea0161110 2023-09-13T06:13:44.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.515+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2183197001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ea0161110 msgr2=0x7f4ea01615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.515+0000 7f4e9f59e640 1 --2- 172.21.15.130:0/2183197001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ea0161110 0x7f4ea01615c0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f4e940097c0 tx=0x7f4e9401c480 comp rx=0 tx=0).stop 2023-09-13T06:13:44.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2183197001 shutdown_connections 2023-09-13T06:13:44.519 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 --2- 172.21.15.130:0/2183197001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ea0161110 0x7f4ea01615c0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2183197001 >> 172.21.15.130:0/2183197001 conn(0x7f4ea00d2f90 msgr2=0x7f4ea00d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:44.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2183197001 shutdown_connections 2023-09-13T06:13:44.520 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2183197001 wait complete. 2023-09-13T06:13:44.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 Processor -- start 2023-09-13T06:13:44.523 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 -- start start 2023-09-13T06:13:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ea00b4120 0x7f4ea013f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ea0160d30 0x7f4ea0141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ea0161110 0x7f4ea0156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea0141d80 con 0x7f4ea0160d30 2023-09-13T06:13:44.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea0142060 con 0x7f4ea00b4120 2023-09-13T06:13:44.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9f59e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea0142340 con 0x7f4ea0161110 2023-09-13T06:13:44.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ea0160d30 0x7f4ea0141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ea0160d30 0x7f4ea0141450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43780/0 (socket says 172.21.15.130:43780) 2023-09-13T06:13:44.525 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9dd9b640 1 -- 172.21.15.130:0/2242352469 learned_addr learned my addr 172.21.15.130:0/2242352469 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:44.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9e59c640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ea00b4120 0x7f4ea013f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9ed9d640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ea0161110 0x7f4ea0156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9dd9b640 1 -- 172.21.15.130:0/2242352469 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ea0161110 msgr2=0x7f4ea0156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9dd9b640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ea0161110 0x7f4ea0156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.526 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9dd9b640 1 -- 172.21.15.130:0/2242352469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ea00b4120 msgr2=0x7f4ea013f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9dd9b640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ea00b4120 0x7f4ea013f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9dd9b640 1 -- 172.21.15.130:0/2242352469 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e94009420 con 0x7f4ea0160d30 2023-09-13T06:13:44.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9e59c640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ea00b4120 0x7f4ea013f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:44.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.519+0000 7f4e9ed9d640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ea0161110 0x7f4ea0156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:44.527 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e9dd9b640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ea0160d30 0x7f4ea0141450 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f4e9401a0b0 tx=0x7f4e94019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:44.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e8effd640 1 -- 172.21.15.130:0/2242352469 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940b5670 con 0x7f4ea0160d30 2023-09-13T06:13:44.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e8effd640 1 -- 172.21.15.130:0/2242352469 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e940abe90 con 0x7f4ea0160d30 2023-09-13T06:13:44.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e8effd640 1 -- 172.21.15.130:0/2242352469 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940b5a30 con 0x7f4ea0160d30 2023-09-13T06:13:44.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2242352469 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea0142620 con 0x7f4ea0160d30 2023-09-13T06:13:44.528 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2242352469 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea013fe70 con 0x7f4ea0160d30 2023-09-13T06:13:44.529 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2242352469 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ea0146d60 con 0x7f4ea0160d30 2023-09-13T06:13:44.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e8effd640 1 -- 172.21.15.130:0/2242352469 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4e940b2040 con 0x7f4ea0160d30 2023-09-13T06:13:44.530 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e8effd640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e80065b20 0x7f4e80067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e8effd640 1 -- 172.21.15.130:0/2242352469 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4e9411e060 con 0x7f4ea0160d30 2023-09-13T06:13:44.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e9e59c640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e80065b20 0x7f4e80067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e8effd640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] conn(0x7f4e8006b980 0x7f4e8006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.531 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e8effd640 1 -- 172.21.15.130:0/2242352469 --> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e8006e450 con 0x7f4e8006b980 2023-09-13T06:13:44.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e8effd640 1 -- 172.21.15.130:0/2242352469 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e9411e3d0 con 0x7f4ea0160d30 2023-09-13T06:13:44.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.523+0000 7f4e9ed9d640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] conn(0x7f4e8006b980 0x7f4e8006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.527+0000 7f4e9e59c640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e80065b20 0x7f4e80067fe0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4e90000f70 tx=0x7f4e90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:44.532 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.527+0000 7f4e9ed9d640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] conn(0x7f4e8006b980 0x7f4e8006dda0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:44.533 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.527+0000 7f4e8effd640 1 -- 172.21.15.130:0/2242352469 <== osd.0 v2:172.21.15.130:6800/3085363071 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f4e8006e450 con 0x7f4e8006b980 2023-09-13T06:13:44.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.535+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2242352469 --> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4ea00618a0 con 0x7f4e8006b980 2023-09-13T06:13:44.538 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.535+0000 7f4e8effd640 1 -- 172.21.15.130:0/2242352469 <== osd.0 v2:172.21.15.130:6800/3085363071 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f4ea00618a0 con 0x7f4e8006b980 2023-09-13T06:13:44.539 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:44.540 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-13T06:13:44.540 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.539+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] conn(0x7f4e8006b980 msgr2=0x7f4e8006dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.539+0000 7f4e9f59e640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:6800/3085363071,v1:172.21.15.130:6801/3085363071] conn(0x7f4e8006b980 0x7f4e8006dda0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.539+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e80065b20 msgr2=0x7f4e80067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.539+0000 7f4e9f59e640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4e80065b20 0x7f4e80067fe0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4e90000f70 tx=0x7f4e90009040 comp rx=0 tx=0).stop 2023-09-13T06:13:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.539+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ea0160d30 msgr2=0x7f4ea0141450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.539+0000 7f4e9f59e640 1 --2- 172.21.15.130:0/2242352469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ea0160d30 0x7f4ea0141450 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f4e9401a0b0 tx=0x7f4e94019220 comp rx=0 tx=0).stop 2023-09-13T06:13:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.539+0000 7f4e9ed9d640 1 -- 172.21.15.130:0/2242352469 reap_dead start 2023-09-13T06:13:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.539+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2242352469 shutdown_connections 2023-09-13T06:13:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.539+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2242352469 >> 172.21.15.130:0/2242352469 conn(0x7f4ea00d2f90 msgr2=0x7f4ea015fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.539+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2242352469 shutdown_connections 2023-09-13T06:13:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.539+0000 7f4e9f59e640 1 -- 172.21.15.130:0/2242352469 wait complete. 2023-09-13T06:13:44.557 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-09-13T06:13:44.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3ffd5fa640 1 Processor -- start 2023-09-13T06:13:44.696 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3ffd5fa640 1 -- start start 2023-09-13T06:13:44.697 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3ffd5fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff815d260 0x7f3ff80b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3ffd5fa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3ff80ce1a0 0x7f3ff806d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3ffd5fa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff8072310 con 0x7f3ff80afc70 2023-09-13T06:13:44.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3ffd5fa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff8070e70 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.698 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3ffd5fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8070280 con 0x7f3ff815d260 2023-09-13T06:13:44.699 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3feffff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3ff80ce1a0 0x7f3ff806d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff815d260 0x7f3ff80b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3feffff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3ff80ce1a0 0x7f3ff806d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.130:35196/0 (socket says 172.21.15.130:35196) 2023-09-13T06:13:44.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3feffff640 1 -- 172.21.15.130:0/691937291 learned_addr learned my addr 172.21.15.130:0/691937291 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:44.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.695+0000 7f3ff77fe640 1 --1- 172.21.15.130:0/691937291 >> v1:172.21.15.164:6789/0 conn(0x7f3ff80afc70 0x7f3ff8160f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.130:39442/0 (socket says 172.21.15.130:39442) 2023-09-13T06:13:44.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.699+0000 7f3feffff640 1 -- 172.21.15.130:0/691937291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff815d260 msgr2=0x7f3ff80b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:44.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.699+0000 7f3feffff640 1 --2- 172.21.15.130:0/691937291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff815d260 0x7f3ff80b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.699+0000 7f3feffff640 1 -- 172.21.15.130:0/691937291 >> v1:172.21.15.164:6789/0 conn(0x7f3ff80afc70 legacy=0x7f3ff8160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.701 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.699+0000 7f3feffff640 1 -- 172.21.15.130:0/691937291 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8070540 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.699+0000 7f3feffff640 1 --2- 172.21.15.130:0/691937291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff80ce1a0 0x7f3ff806d6e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009870 tx=0x7f3fe001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d79ce94b9ec07ffa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.699+0000 7f3ff67fc640 1 -- 172.21.15.130:0/691937291 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00ab620 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.699+0000 7f3ff67fc640 1 -- 172.21.15.130:0/691937291 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe00ab780 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.699+0000 7f3ff67fc640 1 -- 172.21.15.130:0/691937291 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00abb10 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/691937291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff80ce1a0 msgr2=0x7f3ff806d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 --2- 172.21.15.130:0/691937291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff80ce1a0 0x7f3ff806d6e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009870 tx=0x7f3fe001c510 comp rx=0 tx=0).stop 2023-09-13T06:13:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/691937291 shutdown_connections 2023-09-13T06:13:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 --2- 172.21.15.130:0/691937291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff80ce1a0 0x7f3ff806d6e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 --2- 172.21.15.130:0/691937291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff815d260 0x7f3ff80b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/691937291 >> 172.21.15.130:0/691937291 conn(0x7f3ff806a2f0 msgr2=0x7f3ff806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/691937291 shutdown_connections 2023-09-13T06:13:44.705 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/691937291 wait complete. 2023-09-13T06:13:44.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 Processor -- start 2023-09-13T06:13:44.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 -- start start 2023-09-13T06:13:44.707 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff80afc70 0x7f3ff8150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ff80ce1a0 0x7f3ff814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.708 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff815d260 0x7f3ff814f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80ca7e0 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8160190 con 0x7f3ff80afc70 2023-09-13T06:13:44.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ffd5fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8160470 con 0x7f3ff815d260 2023-09-13T06:13:44.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3feffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ff80ce1a0 0x7f3ff814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.709 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3feffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ff80ce1a0 0x7f3ff814eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43788/0 (socket says 172.21.15.130:43788) 2023-09-13T06:13:44.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3feffff640 1 -- 172.21.15.130:0/2038408975 learned_addr learned my addr 172.21.15.130:0/2038408975 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:44.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ff6ffd640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff80afc70 0x7f3ff8150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ff77fe640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff815d260 0x7f3ff814f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3feffff640 1 -- 172.21.15.130:0/2038408975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff815d260 msgr2=0x7f3ff814f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.710 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3feffff640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff815d260 0x7f3ff814f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3feffff640 1 -- 172.21.15.130:0/2038408975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff80afc70 msgr2=0x7f3ff8150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3feffff640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff80afc70 0x7f3ff8150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3feffff640 1 -- 172.21.15.130:0/2038408975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe00094d0 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3ff6ffd640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff80afc70 0x7f3ff8150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:44.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.703+0000 7f3feffff640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ff80ce1a0 0x7f3ff814eea0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00ad040 tx=0x7f3fe001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:44.711 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.707+0000 7f3fef7fe640 1 -- 172.21.15.130:0/2038408975 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00abe80 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.707+0000 7f3fef7fe640 1 -- 172.21.15.130:0/2038408975 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe00be3f0 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.707+0000 7f3fef7fe640 1 -- 172.21.15.130:0/2038408975 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00be780 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.707+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/2038408975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff814f3e0 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.712 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.707+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/2038408975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff8150870 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.713 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.707+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/2038408975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff80ca950 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.707+0000 7f3fef7fe640 1 -- 172.21.15.130:0/2038408975 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3fe00b43f0 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.707+0000 7f3fef7fe640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3fd8065b20 0x7f3fd8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:44.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.707+0000 7f3fef7fe640 1 -- 172.21.15.130:0/2038408975 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3fe011d650 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.707+0000 7f3ff6ffd640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3fd8065b20 0x7f3fd8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:44.714 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.711+0000 7f3ff6ffd640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3fd8065b20 0x7f3fd8067fe0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80cd3d0 tx=0x7f3fe8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:44.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.711+0000 7f3fef7fe640 1 -- 172.21.15.130:0/2038408975 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3ff80ca950 con 0x7f3ff80ce1a0 2023-09-13T06:13:44.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/2038408975 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ff80b5d40 con 0x7f3fd8065b20 2023-09-13T06:13:44.863 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3fef7fe640 1 -- 172.21.15.130:0/2038408975 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3fe8004020 con 0x7f3fd8065b20 2023-09-13T06:13:44.864 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 0 to deep-scrub 2023-09-13T06:13:44.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/2038408975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3fd8065b20 msgr2=0x7f3fd8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3fd8065b20 0x7f3fd8067fe0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80cd3d0 tx=0x7f3fe8008040 comp rx=0 tx=0).stop 2023-09-13T06:13:44.865 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/2038408975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ff80ce1a0 msgr2=0x7f3ff814eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:44.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ff80ce1a0 0x7f3ff814eea0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00ad040 tx=0x7f3fe001ad50 comp rx=0 tx=0).stop 2023-09-13T06:13:44.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/2038408975 shutdown_connections 2023-09-13T06:13:44.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3fd8065b20 0x7f3fd8067fe0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff815d260 0x7f3ff814f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ff80ce1a0 0x7f3ff814eea0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 --2- 172.21.15.130:0/2038408975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff80afc70 0x7f3ff8150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:44.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/2038408975 >> 172.21.15.130:0/2038408975 conn(0x7f3ff806a2f0 msgr2=0x7f3ff80ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:44.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/2038408975 shutdown_connections 2023-09-13T06:13:44.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:44.863+0000 7f3ffd5fa640 1 -- 172.21.15.130:0/2038408975 wait complete. 2023-09-13T06:13:44.884 INFO:tasks.ceph:Scrubbing osd.1 2023-09-13T06:13:44.884 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-13T06:13:45.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70d56af640 1 Processor -- start 2023-09-13T06:13:45.027 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70d56af640 1 -- start start 2023-09-13T06:13:45.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70d56af640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f70d00ad690 0x7f70d00cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.030 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70d56af640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d006e530 con 0x7f70d00b2570 2023-09-13T06:13:45.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70d56af640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00ce490 con 0x7f70d0159d40 2023-09-13T06:13:45.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70d56af640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d00ce2a0 con 0x7f70d00ad690 2023-09-13T06:13:45.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70d4eae640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f70d00b2570 0x7f70d00cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46388/0 (socket says 172.21.15.130:46388) 2023-09-13T06:13:45.031 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70d4eae640 1 -- 172.21.15.130:0/1665357499 learned_addr learned my addr 172.21.15.130:0/1665357499 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:45.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70cf7fe640 1 --2- 172.21.15.130:0/1665357499 >> v2:172.21.15.164:3300/0 conn(0x7f70d00ad690 0x7f70d00cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70ceffd640 1 -- 172.21.15.130:0/1665357499 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767001363 0 0) 0x7f70d006e530 con 0x7f70d00b2570 2023-09-13T06:13:45.032 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70ceffd640 1 -- 172.21.15.130:0/1665357499 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b8003530 con 0x7f70d00b2570 2023-09-13T06:13:45.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70cf7fe640 1 -- 172.21.15.130:0/1665357499 >> v1:172.21.15.164:6789/0 conn(0x7f70d0159d40 legacy=0x7f70d015e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70cf7fe640 1 -- 172.21.15.130:0/1665357499 >> v1:172.21.15.130:6789/0 conn(0x7f70d00b2570 legacy=0x7f70d00cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.033 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.027+0000 7f70cf7fe640 1 -- 172.21.15.130:0/1665357499 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00ce770 con 0x7f70d00ad690 2023-09-13T06:13:45.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.031+0000 7f70cf7fe640 1 --2- 172.21.15.130:0/1665357499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70d00ad690 0x7f70d00cdd60 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f70c40097c0 tx=0x7f70c401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4f2835e4755c98e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.031+0000 7f70ceffd640 1 -- 172.21.15.130:0/1665357499 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40ac620 con 0x7f70d00ad690 2023-09-13T06:13:45.036 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.031+0000 7f70ceffd640 1 -- 172.21.15.130:0/1665357499 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c40ac780 con 0x7f70d00ad690 2023-09-13T06:13:45.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.031+0000 7f70ceffd640 1 -- 172.21.15.130:0/1665357499 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40acb10 con 0x7f70d00ad690 2023-09-13T06:13:45.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.031+0000 7f70d56af640 1 -- 172.21.15.130:0/1665357499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70d00ad690 msgr2=0x7f70d00cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.031+0000 7f70d56af640 1 --2- 172.21.15.130:0/1665357499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70d00ad690 0x7f70d00cdd60 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f70c40097c0 tx=0x7f70c401c3c0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.031+0000 7f70d56af640 1 -- 172.21.15.130:0/1665357499 shutdown_connections 2023-09-13T06:13:45.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.031+0000 7f70d56af640 1 --2- 172.21.15.130:0/1665357499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70d00ad690 0x7f70d00cdd60 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.037 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.031+0000 7f70d56af640 1 -- 172.21.15.130:0/1665357499 >> 172.21.15.130:0/1665357499 conn(0x7f70d00b4120 msgr2=0x7f70d00b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:45.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.031+0000 7f70d56af640 1 -- 172.21.15.130:0/1665357499 shutdown_connections 2023-09-13T06:13:45.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.031+0000 7f70d56af640 1 -- 172.21.15.130:0/1665357499 wait complete. 2023-09-13T06:13:45.038 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d56af640 1 Processor -- start 2023-09-13T06:13:45.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d56af640 1 -- start start 2023-09-13T06:13:45.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d56af640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70d00ad690 0x7f70d00b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d56af640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70d00b2570 0x7f70d015c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d56af640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70d0159d40 0x7f70d01f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.039 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d56af640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00b0ec0 con 0x7f70d00ad690 2023-09-13T06:13:45.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d56af640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d015c970 con 0x7f70d00b2570 2023-09-13T06:13:45.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d56af640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00adf70 con 0x7f70d0159d40 2023-09-13T06:13:45.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70cffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70d00ad690 0x7f70d00b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70cffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70d00ad690 0x7f70d00b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43798/0 (socket says 172.21.15.130:43798) 2023-09-13T06:13:45.040 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70cffff640 1 -- 172.21.15.130:0/2245744993 learned_addr learned my addr 172.21.15.130:0/2245744993 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:45.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d4eae640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70d0159d40 0x7f70d01f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.041 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70cf7fe640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70d00b2570 0x7f70d015c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70cffff640 1 -- 172.21.15.130:0/2245744993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70d0159d40 msgr2=0x7f70d01f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70cffff640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70d0159d40 0x7f70d01f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.043 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70cffff640 1 -- 172.21.15.130:0/2245744993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70d00b2570 msgr2=0x7f70d015c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70cffff640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70d00b2570 0x7f70d015c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70cffff640 1 -- 172.21.15.130:0/2245744993 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c4009420 con 0x7f70d00ad690 2023-09-13T06:13:45.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70cffff640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70d00ad690 0x7f70d00b0980 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c450 tx=0x7f70c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70ccff9640 1 -- 172.21.15.130:0/2245744993 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c00052d0 con 0x7f70d00ad690 2023-09-13T06:13:45.044 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70ccff9640 1 -- 172.21.15.130:0/2245744993 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0005430 con 0x7f70d00ad690 2023-09-13T06:13:45.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d56af640 1 -- 172.21.15.130:0/2245744993 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d015cc20 con 0x7f70d00ad690 2023-09-13T06:13:45.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70ccff9640 1 -- 172.21.15.130:0/2245744993 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0003890 con 0x7f70d00ad690 2023-09-13T06:13:45.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d56af640 1 -- 172.21.15.130:0/2245744993 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d015d1e0 con 0x7f70d00ad690 2023-09-13T06:13:45.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.035+0000 7f70d56af640 1 -- 172.21.15.130:0/2245744993 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70d00cc630 con 0x7f70d00ad690 2023-09-13T06:13:45.045 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.039+0000 7f70ccff9640 1 -- 172.21.15.130:0/2245744993 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f70c00039f0 con 0x7f70d00ad690 2023-09-13T06:13:45.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.039+0000 7f70ccff9640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f70bc065b20 0x7f70bc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.039+0000 7f70ccff9640 1 -- 172.21.15.130:0/2245744993 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f70c0083450 con 0x7f70d00ad690 2023-09-13T06:13:45.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.039+0000 7f70cf7fe640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f70bc065b20 0x7f70bc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.039+0000 7f70ccff9640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] conn(0x7f70bc06b980 0x7f70bc06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.039+0000 7f70ccff9640 1 -- 172.21.15.130:0/2245744993 --> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70bc06e450 con 0x7f70bc06b980 2023-09-13T06:13:45.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.039+0000 7f70ccff9640 1 -- 172.21.15.130:0/2245744993 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70c00837c0 con 0x7f70d00ad690 2023-09-13T06:13:45.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.039+0000 7f70d4eae640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] conn(0x7f70bc06b980 0x7f70bc06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.039+0000 7f70cf7fe640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f70bc065b20 0x7f70bc067fe0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f70c40ae000 tx=0x7f70c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.039+0000 7f70d4eae640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] conn(0x7f70bc06b980 0x7f70bc06dda0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.047 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.039+0000 7f70ccff9640 1 -- 172.21.15.130:0/2245744993 <== osd.1 v2:172.21.15.130:6814/338394792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f70bc06e450 con 0x7f70bc06b980 2023-09-13T06:13:45.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d56af640 1 -- 172.21.15.130:0/2245744993 --> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f70d00cea50 con 0x7f70bc06b980 2023-09-13T06:13:45.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70ccff9640 1 -- 172.21.15.130:0/2245744993 <== osd.1 v2:172.21.15.130:6814/338394792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f70c8001f10 con 0x7f70bc06b980 2023-09-13T06:13:45.053 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:45.053 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-13T06:13:45.053 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:45.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d56af640 1 -- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] conn(0x7f70bc06b980 msgr2=0x7f70bc06dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d56af640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:6814/338394792,v1:172.21.15.130:6817/338394792] conn(0x7f70bc06b980 0x7f70bc06dda0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d56af640 1 -- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f70bc065b20 msgr2=0x7f70bc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d56af640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f70bc065b20 0x7f70bc067fe0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f70c40ae000 tx=0x7f70c4008040 comp rx=0 tx=0).stop 2023-09-13T06:13:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d56af640 1 -- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70d00ad690 msgr2=0x7f70d00b0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d56af640 1 --2- 172.21.15.130:0/2245744993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70d00ad690 0x7f70d00b0980 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c450 tx=0x7f70c000c910 comp rx=0 tx=0).stop 2023-09-13T06:13:45.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d4eae640 1 -- 172.21.15.130:0/2245744993 reap_dead start 2023-09-13T06:13:45.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d56af640 1 -- 172.21.15.130:0/2245744993 shutdown_connections 2023-09-13T06:13:45.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d56af640 1 -- 172.21.15.130:0/2245744993 >> 172.21.15.130:0/2245744993 conn(0x7f70d00b4120 msgr2=0x7f70d00b4730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:45.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d56af640 1 -- 172.21.15.130:0/2245744993 shutdown_connections 2023-09-13T06:13:45.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.051+0000 7f70d56af640 1 -- 172.21.15.130:0/2245744993 wait complete. 2023-09-13T06:13:45.071 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-09-13T06:13:45.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.207+0000 7f299c80b640 1 Processor -- start 2023-09-13T06:13:45.210 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.207+0000 7f299c80b640 1 -- start start 2023-09-13T06:13:45.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f299c80b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f299815b130 0x7f29980cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f299c80b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f29980b04a0 0x7f29980b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f299c80b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29980ce980 con 0x7f29980ce180 2023-09-13T06:13:45.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f299c80b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29980b0e70 con 0x7f29980b04a0 2023-09-13T06:13:45.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f299c80b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29980cec60 con 0x7f299815b130 2023-09-13T06:13:45.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f298dd9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f29980ce180 0x7f299815b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46394/0 (socket says 172.21.15.130:46394) 2023-09-13T06:13:45.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f298dd9b640 1 -- 172.21.15.130:0/90263922 learned_addr learned my addr 172.21.15.130:0/90263922 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:45.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f2996d9d640 1 --2- 172.21.15.130:0/90263922 >> v2:172.21.15.130:3300/0 conn(0x7f29980b04a0 0x7f29980b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f299659c640 1 --2- 172.21.15.130:0/90263922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f299815b130 0x7f29980cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f2996d9d640 1 -- 172.21.15.130:0/90263922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f299815b130 msgr2=0x7f29980cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:45.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f2996d9d640 1 --2- 172.21.15.130:0/90263922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f299815b130 0x7f29980cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f2996d9d640 1 -- 172.21.15.130:0/90263922 >> v1:172.21.15.130:6789/0 conn(0x7f29980ce180 legacy=0x7f299815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f2996d9d640 1 -- 172.21.15.130:0/90263922 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299806c640 con 0x7f29980b04a0 2023-09-13T06:13:45.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.211+0000 7f2995d9b640 1 -- 172.21.15.130:0/90263922 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511079494 0 0) 0x7f29980ce980 con 0x7f29980ce180 2023-09-13T06:13:45.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f2996d9d640 1 --2- 172.21.15.130:0/90263922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29980b04a0 0x7f29980b0930 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f29900097c0 tx=0x7f299001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f7cb004483b3f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f2995d9b640 1 -- 172.21.15.130:0/90263922 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900ab680 con 0x7f29980b04a0 2023-09-13T06:13:45.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f2995d9b640 1 -- 172.21.15.130:0/90263922 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29900ab7e0 con 0x7f29980b04a0 2023-09-13T06:13:45.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f2995d9b640 1 -- 172.21.15.130:0/90263922 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900abb70 con 0x7f29980b04a0 2023-09-13T06:13:45.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f299c80b640 1 -- 172.21.15.130:0/90263922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29980b04a0 msgr2=0x7f29980b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f299c80b640 1 --2- 172.21.15.130:0/90263922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29980b04a0 0x7f29980b0930 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f29900097c0 tx=0x7f299001c480 comp rx=0 tx=0).stop 2023-09-13T06:13:45.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f299c80b640 1 -- 172.21.15.130:0/90263922 shutdown_connections 2023-09-13T06:13:45.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f299c80b640 1 --2- 172.21.15.130:0/90263922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29980b04a0 0x7f29980b0930 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f299c80b640 1 --2- 172.21.15.130:0/90263922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f299815b130 0x7f29980cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f299c80b640 1 -- 172.21.15.130:0/90263922 >> 172.21.15.130:0/90263922 conn(0x7f2998065990 msgr2=0x7f2998065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:45.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f299c80b640 1 -- 172.21.15.130:0/90263922 shutdown_connections 2023-09-13T06:13:45.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f299c80b640 1 -- 172.21.15.130:0/90263922 wait complete. 2023-09-13T06:13:45.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f299c80b640 1 Processor -- start 2023-09-13T06:13:45.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.215+0000 7f299c80b640 1 -- start start 2023-09-13T06:13:45.220 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299c80b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29980b04a0 0x7f299813dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299c80b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29980ce180 0x7f2998070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299c80b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f299815b130 0x7f29980cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299c80b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29981506b0 con 0x7f29980b04a0 2023-09-13T06:13:45.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299c80b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2998150ad0 con 0x7f299815b130 2023-09-13T06:13:45.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299c80b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299814fa30 con 0x7f29980ce180 2023-09-13T06:13:45.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29980b04a0 0x7f299813dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29980b04a0 0x7f299813dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43816/0 (socket says 172.21.15.130:43816) 2023-09-13T06:13:45.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299659c640 1 -- 172.21.15.130:0/2763645762 learned_addr learned my addr 172.21.15.130:0/2763645762 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:45.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f298dd9b640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29980ce180 0x7f2998070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f2996d9d640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f299815b130 0x7f29980cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299659c640 1 -- 172.21.15.130:0/2763645762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29980ce180 msgr2=0x7f2998070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299659c640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29980ce180 0x7f2998070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299659c640 1 -- 172.21.15.130:0/2763645762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f299815b130 msgr2=0x7f29980cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299659c640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f299815b130 0x7f29980cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299659c640 1 -- 172.21.15.130:0/2763645762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2990009420 con 0x7f29980b04a0 2023-09-13T06:13:45.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299659c640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29980b04a0 0x7f299813dad0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f298800efc0 tx=0x7f298800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f298f7fe640 1 -- 172.21.15.130:0/2763645762 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988009b80 con 0x7f29980b04a0 2023-09-13T06:13:45.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f298f7fe640 1 -- 172.21.15.130:0/2763645762 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298800f040 con 0x7f29980b04a0 2023-09-13T06:13:45.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299c80b640 1 -- 172.21.15.130:0/2763645762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299814fd10 con 0x7f29980b04a0 2023-09-13T06:13:45.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f298f7fe640 1 -- 172.21.15.130:0/2763645762 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880146a0 con 0x7f29980b04a0 2023-09-13T06:13:45.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299c80b640 1 -- 172.21.15.130:0/2763645762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29981502d0 con 0x7f29980b04a0 2023-09-13T06:13:45.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.219+0000 7f299c80b640 1 -- 172.21.15.130:0/2763645762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29980618a0 con 0x7f29980b04a0 2023-09-13T06:13:45.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.223+0000 7f298f7fe640 1 -- 172.21.15.130:0/2763645762 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2988014800 con 0x7f29980b04a0 2023-09-13T06:13:45.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.223+0000 7f298f7fe640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2978065b20 0x7f2978067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.223+0000 7f298f7fe640 1 -- 172.21.15.130:0/2763645762 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2988083e60 con 0x7f29980b04a0 2023-09-13T06:13:45.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.223+0000 7f298dd9b640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2978065b20 0x7f2978067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.223+0000 7f298dd9b640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2978065b20 0x7f2978067fe0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2998070b80 tx=0x7f2980007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.227+0000 7f298f7fe640 1 -- 172.21.15.130:0/2763645762 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2988051ab0 con 0x7f29980b04a0 2023-09-13T06:13:45.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.371+0000 7f299c80b640 1 -- 172.21.15.130:0/2763645762 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f299806d930 con 0x7f2978065b20 2023-09-13T06:13:45.374 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f298f7fe640 1 -- 172.21.15.130:0/2763645762 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f29800071f0 con 0x7f2978065b20 2023-09-13T06:13:45.375 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 1 to deep-scrub 2023-09-13T06:13:45.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 -- 172.21.15.130:0/2763645762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2978065b20 msgr2=0x7f2978067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.376 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2978065b20 0x7f2978067fe0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2998070b80 tx=0x7f2980007b60 comp rx=0 tx=0).stop 2023-09-13T06:13:45.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 -- 172.21.15.130:0/2763645762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29980b04a0 msgr2=0x7f299813dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29980b04a0 0x7f299813dad0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f298800efc0 tx=0x7f298800c490 comp rx=0 tx=0).stop 2023-09-13T06:13:45.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 -- 172.21.15.130:0/2763645762 shutdown_connections 2023-09-13T06:13:45.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f2978065b20 0x7f2978067fe0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f299815b130 0x7f29980cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29980ce180 0x7f2998070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 --2- 172.21.15.130:0/2763645762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29980b04a0 0x7f299813dad0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 -- 172.21.15.130:0/2763645762 >> 172.21.15.130:0/2763645762 conn(0x7f2998065990 msgr2=0x7f299815a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:45.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 -- 172.21.15.130:0/2763645762 shutdown_connections 2023-09-13T06:13:45.378 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.375+0000 7f299c80b640 1 -- 172.21.15.130:0/2763645762 wait complete. 2023-09-13T06:13:45.395 INFO:tasks.ceph:Scrubbing osd.2 2023-09-13T06:13:45.395 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-13T06:13:45.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.535+0000 7f5690340640 1 Processor -- start 2023-09-13T06:13:45.537 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.535+0000 7f5690340640 1 -- start start 2023-09-13T06:13:45.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f5690340640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f56880b3170 0x7f56880b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f5690340640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56880b1ff0 0x7f56880cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f5690340640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56880ccff0 con 0x7f56880ccc10 2023-09-13T06:13:45.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f5690340640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568815b590 con 0x7f56880b3170 2023-09-13T06:13:45.539 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f5690340640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56880b12f0 con 0x7f56880b1ff0 2023-09-13T06:13:45.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f568e0dc640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f56880ccc10 0x7f568815dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46406/0 (socket says 172.21.15.130:46406) 2023-09-13T06:13:45.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f568e0dc640 1 -- 172.21.15.130:0/1056181033 learned_addr learned my addr 172.21.15.130:0/1056181033 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:45.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f568e8dd640 1 --2- 172.21.15.130:0/1056181033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56880b1ff0 0x7f56880cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.540 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f568d8db640 1 --2- 172.21.15.130:0/1056181033 >> v2:172.21.15.164:3300/0 conn(0x7f56880b3170 0x7f56880b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f568e8dd640 1 -- 172.21.15.130:0/1056181033 >> v2:172.21.15.164:3300/0 conn(0x7f56880b3170 msgr2=0x7f56880b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:45.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f568e8dd640 1 --2- 172.21.15.130:0/1056181033 >> v2:172.21.15.164:3300/0 conn(0x7f56880b3170 0x7f56880b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f568e8dd640 1 -- 172.21.15.130:0/1056181033 >> v1:172.21.15.130:6789/0 conn(0x7f56880ccc10 legacy=0x7f568815dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.541 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f568d0da640 1 -- 172.21.15.130:0/1056181033 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614603878 0 0) 0x7f56880ccff0 con 0x7f56880ccc10 2023-09-13T06:13:45.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f568e8dd640 1 -- 172.21.15.130:0/1056181033 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568815e520 con 0x7f56880b1ff0 2023-09-13T06:13:45.542 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.539+0000 7f568e8dd640 1 --2- 172.21.15.130:0/1056181033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56880b1ff0 0x7f56880cb710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f568000bfa0 tx=0x7f568001eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=942750f3f1cca60b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f568d0da640 1 -- 172.21.15.130:0/1056181033 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568000b2d0 con 0x7f56880b1ff0 2023-09-13T06:13:45.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f568d0da640 1 -- 172.21.15.130:0/1056181033 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56800a7900 con 0x7f56880b1ff0 2023-09-13T06:13:45.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f568d0da640 1 -- 172.21.15.130:0/1056181033 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800a7c90 con 0x7f56880b1ff0 2023-09-13T06:13:45.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 -- 172.21.15.130:0/1056181033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56880b1ff0 msgr2=0x7f56880cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 --2- 172.21.15.130:0/1056181033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56880b1ff0 0x7f56880cb710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f568000bfa0 tx=0x7f568001eb20 comp rx=0 tx=0).stop 2023-09-13T06:13:45.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 -- 172.21.15.130:0/1056181033 shutdown_connections 2023-09-13T06:13:45.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 --2- 172.21.15.130:0/1056181033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56880b1ff0 0x7f56880cb710 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 --2- 172.21.15.130:0/1056181033 >> v2:172.21.15.164:3300/0 conn(0x7f56880b3170 0x7f56880b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 -- 172.21.15.130:0/1056181033 >> 172.21.15.130:0/1056181033 conn(0x7f56880735e0 msgr2=0x7f5688065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:45.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 -- 172.21.15.130:0/1056181033 shutdown_connections 2023-09-13T06:13:45.545 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 -- 172.21.15.130:0/1056181033 wait complete. 2023-09-13T06:13:45.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 Processor -- start 2023-09-13T06:13:45.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 -- start start 2023-09-13T06:13:45.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56880b1ff0 0x7f5688158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56880b3170 0x7f5688153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56880ccc10 0x7f568806fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568806d690 con 0x7f56880b1ff0 2023-09-13T06:13:45.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56881550c0 con 0x7f56880b3170 2023-09-13T06:13:45.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f5690340640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568806ca80 con 0x7f56880ccc10 2023-09-13T06:13:45.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.543+0000 7f568e0dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56880b1ff0 0x7f5688158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f568e0dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56880b1ff0 0x7f5688158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43820/0 (socket says 172.21.15.130:43820) 2023-09-13T06:13:45.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f568e0dc640 1 -- 172.21.15.130:0/2582598393 learned_addr learned my addr 172.21.15.130:0/2582598393 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:45.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f568e0dc640 1 -- 172.21.15.130:0/2582598393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56880ccc10 msgr2=0x7f568806fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f568e0dc640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56880ccc10 0x7f568806fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f568d8db640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56880b3170 0x7f5688153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f568e0dc640 1 -- 172.21.15.130:0/2582598393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56880b3170 msgr2=0x7f5688153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f568e0dc640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56880b3170 0x7f5688153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f568e0dc640 1 -- 172.21.15.130:0/2582598393 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568000bc80 con 0x7f56880b1ff0 2023-09-13T06:13:45.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f568e0dc640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56880b1ff0 0x7f5688158160 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f568400c4b0 tx=0x7f568400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f567effd640 1 -- 172.21.15.130:0/2582598393 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56840074e0 con 0x7f56880b1ff0 2023-09-13T06:13:45.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f567effd640 1 -- 172.21.15.130:0/2582598393 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684007660 con 0x7f56880b1ff0 2023-09-13T06:13:45.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f5690340640 1 -- 172.21.15.130:0/2582598393 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568806cd60 con 0x7f56880b1ff0 2023-09-13T06:13:45.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f567effd640 1 -- 172.21.15.130:0/2582598393 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684004a30 con 0x7f56880b1ff0 2023-09-13T06:13:45.551 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f5690340640 1 -- 172.21.15.130:0/2582598393 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568806d320 con 0x7f56880b1ff0 2023-09-13T06:13:45.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f5690340640 1 -- 172.21.15.130:0/2582598393 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56880b1590 con 0x7f56880b1ff0 2023-09-13T06:13:45.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f567effd640 1 -- 172.21.15.130:0/2582598393 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5684004b90 con 0x7f56880b1ff0 2023-09-13T06:13:45.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f567effd640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f566c065b20 0x7f566c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f567effd640 1 -- 172.21.15.130:0/2582598393 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f56840824d0 con 0x7f56880b1ff0 2023-09-13T06:13:45.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f568d8db640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f566c065b20 0x7f566c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f567effd640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] conn(0x7f566c06b980 0x7f566c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f567effd640 1 -- 172.21.15.130:0/2582598393 --> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f566c06e450 con 0x7f566c06b980 2023-09-13T06:13:45.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.547+0000 7f567effd640 1 -- 172.21.15.130:0/2582598393 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5684084b90 con 0x7f56880b1ff0 2023-09-13T06:13:45.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.551+0000 7f568e8dd640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] conn(0x7f566c06b980 0x7f566c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.551+0000 7f568d8db640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f566c065b20 0x7f566c067fe0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f56880ad9b0 tx=0x7f5678008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.551+0000 7f568e8dd640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] conn(0x7f566c06b980 0x7f566c06dda0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.551+0000 7f567effd640 1 -- 172.21.15.130:0/2582598393 <== osd.2 v2:172.21.15.130:6808/3833443455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f566c06e450 con 0x7f566c06b980 2023-09-13T06:13:45.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.559+0000 7f5690340640 1 -- 172.21.15.130:0/2582598393 --> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f56880618a0 con 0x7f566c06b980 2023-09-13T06:13:45.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f567effd640 1 -- 172.21.15.130:0/2582598393 <== osd.2 v2:172.21.15.130:6808/3833443455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f56880618a0 con 0x7f566c06b980 2023-09-13T06:13:45.563 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:45.563 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-13T06:13:45.563 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:45.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f5690340640 1 -- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] conn(0x7f566c06b980 msgr2=0x7f566c06dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f5690340640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:6808/3833443455,v1:172.21.15.130:6809/3833443455] conn(0x7f566c06b980 0x7f566c06dda0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f5690340640 1 -- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f566c065b20 msgr2=0x7f566c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f5690340640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f566c065b20 0x7f566c067fe0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f56880ad9b0 tx=0x7f5678008040 comp rx=0 tx=0).stop 2023-09-13T06:13:45.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f5690340640 1 -- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56880b1ff0 msgr2=0x7f5688158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f5690340640 1 --2- 172.21.15.130:0/2582598393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56880b1ff0 0x7f5688158160 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f568400c4b0 tx=0x7f568400c970 comp rx=0 tx=0).stop 2023-09-13T06:13:45.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f568e8dd640 1 -- 172.21.15.130:0/2582598393 reap_dead start 2023-09-13T06:13:45.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f5690340640 1 -- 172.21.15.130:0/2582598393 shutdown_connections 2023-09-13T06:13:45.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f5690340640 1 -- 172.21.15.130:0/2582598393 >> 172.21.15.130:0/2582598393 conn(0x7f56880735e0 msgr2=0x7f568815c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:45.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f5690340640 1 -- 172.21.15.130:0/2582598393 shutdown_connections 2023-09-13T06:13:45.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.563+0000 7f5690340640 1 -- 172.21.15.130:0/2582598393 wait complete. 2023-09-13T06:13:45.581 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-13T06:13:45.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.719+0000 7f3e5ccd8640 1 Processor -- start 2023-09-13T06:13:45.721 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.719+0000 7f3e5ccd8640 1 -- start start 2023-09-13T06:13:45.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.719+0000 7f3e5ccd8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e580d1750 0x7f3e5815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.719+0000 7f3e5ccd8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e580b63c0 con 0x7f3e580d1090 2023-09-13T06:13:45.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.719+0000 7f3e5ccd8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e580d0c20 con 0x7f3e58146f30 2023-09-13T06:13:45.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.719+0000 7f3e5ccd8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5815dea0 con 0x7f3e580d1750 2023-09-13T06:13:45.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e4dd9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3e580d1090 0x7f3e58146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46418/0 (socket says 172.21.15.130:46418) 2023-09-13T06:13:45.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e4dd9b640 1 -- 172.21.15.130:0/2303295837 learned_addr learned my addr 172.21.15.130:0/2303295837 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:45.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e5659c640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e580d1750 0x7f3e5815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807552400 0 0) 0x7f3e580b63c0 con 0x7f3e580d1090 2023-09-13T06:13:45.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e44003530 con 0x7f3e580d1090 2023-09-13T06:13:45.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4260546087 0 0) 0x7f3e44003530 con 0x7f3e580d1090 2023-09-13T06:13:45.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e580d1750 msgr2=0x7f3e5815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:45.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e580d1750 0x7f3e5815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 >> v1:172.21.15.164:6789/0 conn(0x7f3e58146f30 legacy=0x7f3e580b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e580b6610 con 0x7f3e580d1090 2023-09-13T06:13:45.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f3e40001a00 con 0x7f3e580d1090 2023-09-13T06:13:45.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 >> v1:172.21.15.130:6789/0 conn(0x7f3e580d1090 legacy=0x7f3e58146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.727 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 0x7f3e44003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e440047d0 0x7f3e44004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e580d1750 0x7f3e44005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4400ba40 con 0x7f3e44003a20 2023-09-13T06:13:45.728 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4400bb80 con 0x7f3e440047d0 2023-09-13T06:13:45.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4400bd40 con 0x7f3e580d1750 2023-09-13T06:13:45.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e5659c640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 0x7f3e44003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e4dd9b640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e440047d0 0x7f3e44004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e56d9d640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e580d1750 0x7f3e44005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.729 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e5659c640 1 -- 172.21.15.130:0/2303295837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e580d1750 msgr2=0x7f3e44005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:45.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e5659c640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e580d1750 0x7f3e44005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e5659c640 1 -- 172.21.15.130:0/2303295837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e440047d0 msgr2=0x7f3e44004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:45.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e5659c640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e440047d0 0x7f3e44004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.723+0000 7f3e5659c640 1 -- 172.21.15.130:0/2303295837 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e44003530 con 0x7f3e44003a20 2023-09-13T06:13:45.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e5659c640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 0x7f3e44003e00 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009ae0 tx=0x7f3e4801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b5e8f474cc310f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480a5640 con 0x7f3e44003a20 2023-09-13T06:13:45.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e480a57a0 con 0x7f3e44003a20 2023-09-13T06:13:45.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e55d9b640 1 -- 172.21.15.130:0/2303295837 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480a5b50 con 0x7f3e44003a20 2023-09-13T06:13:45.734 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/2303295837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 msgr2=0x7f3e44003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e5ccd8640 1 --2- 172.21.15.130:0/2303295837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 0x7f3e44003e00 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009ae0 tx=0x7f3e4801ca50 comp rx=0 tx=0).stop 2023-09-13T06:13:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e56d9d640 1 -- 172.21.15.130:0/2303295837 reap_dead start 2023-09-13T06:13:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/2303295837 shutdown_connections 2023-09-13T06:13:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/2303295837 >> 172.21.15.130:0/2303295837 conn(0x7f3e5806f170 msgr2=0x7f3e5806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/2303295837 shutdown_connections 2023-09-13T06:13:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/2303295837 wait complete. 2023-09-13T06:13:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e5ccd8640 1 Processor -- start 2023-09-13T06:13:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.727+0000 7f3e5ccd8640 1 -- start start 2023-09-13T06:13:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5ccd8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 0x7f3e581f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5ccd8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e5813be10 0x7f3e5815c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5ccd8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e5813c310 0x7f3e5815ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5ccd8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5813cb60 con 0x7f3e44003a20 2023-09-13T06:13:45.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5ccd8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e581402d0 con 0x7f3e5813be10 2023-09-13T06:13:45.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5ccd8640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e581405b0 con 0x7f3e5813c310 2023-09-13T06:13:45.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 0x7f3e581f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.737 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 0x7f3e581f2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43846/0 (socket says 172.21.15.130:43846) 2023-09-13T06:13:45.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5659c640 1 -- 172.21.15.130:0/3254840239 learned_addr learned my addr 172.21.15.130:0/3254840239 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:45.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e56d9d640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e5813c310 0x7f3e5815ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e4dd9b640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e5813be10 0x7f3e5815c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.738 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5659c640 1 -- 172.21.15.130:0/3254840239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e5813c310 msgr2=0x7f3e5815ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5659c640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e5813c310 0x7f3e5815ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5659c640 1 -- 172.21.15.130:0/3254840239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e5813be10 msgr2=0x7f3e5815c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5659c640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e5813be10 0x7f3e5815c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5659c640 1 -- 172.21.15.130:0/3254840239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e58140890 con 0x7f3e44003a20 2023-09-13T06:13:45.739 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5659c640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 0x7f3e581f2b00 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009ae0 tx=0x7f3e44005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e4f7fe640 1 -- 172.21.15.130:0/3254840239 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480be070 con 0x7f3e44003a20 2023-09-13T06:13:45.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e4f7fe640 1 -- 172.21.15.130:0/3254840239 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e48004020 con 0x7f3e44003a20 2023-09-13T06:13:45.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e4f7fe640 1 -- 172.21.15.130:0/3254840239 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48004390 con 0x7f3e44003a20 2023-09-13T06:13:45.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/3254840239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e58140b70 con 0x7f3e44003a20 2023-09-13T06:13:45.740 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/3254840239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5815ce30 con 0x7f3e44003a20 2023-09-13T06:13:45.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/3254840239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e58140d00 con 0x7f3e44003a20 2023-09-13T06:13:45.741 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.731+0000 7f3e4f7fe640 1 -- 172.21.15.130:0/3254840239 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3e480b4040 con 0x7f3e44003a20 2023-09-13T06:13:45.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.735+0000 7f3e4f7fe640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e38065b20 0x7f3e38067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:45.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.735+0000 7f3e4f7fe640 1 -- 172.21.15.130:0/3254840239 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3e4811cb40 con 0x7f3e44003a20 2023-09-13T06:13:45.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.735+0000 7f3e4dd9b640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e38065b20 0x7f3e38067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:45.742 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.735+0000 7f3e4dd9b640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e38065b20 0x7f3e38067fe0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3e58142080 tx=0x7f3e40006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:45.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.739+0000 7f3e4f7fe640 1 -- 172.21.15.130:0/3254840239 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3e480ea790 con 0x7f3e44003a20 2023-09-13T06:13:45.887 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/3254840239 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e580b6bd0 con 0x7f3e38065b20 2023-09-13T06:13:45.888 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e4f7fe640 1 -- 172.21.15.130:0/3254840239 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3e40007920 con 0x7f3e38065b20 2023-09-13T06:13:45.888 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 2 to deep-scrub 2023-09-13T06:13:45.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/3254840239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e38065b20 msgr2=0x7f3e38067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e38065b20 0x7f3e38067fe0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3e58142080 tx=0x7f3e40006040 comp rx=0 tx=0).stop 2023-09-13T06:13:45.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/3254840239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 msgr2=0x7f3e581f2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:45.890 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 0x7f3e581f2b00 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009ae0 tx=0x7f3e44005800 comp rx=0 tx=0).stop 2023-09-13T06:13:45.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/3254840239 shutdown_connections 2023-09-13T06:13:45.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f3e38065b20 0x7f3e38067fe0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e5813be10 0x7f3e5815c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.891 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3e5813c310 0x7f3e5815ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 --2- 172.21.15.130:0/3254840239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e44003a20 0x7f3e581f2b00 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:45.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/3254840239 >> 172.21.15.130:0/3254840239 conn(0x7f3e5806f170 msgr2=0x7f3e580b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:45.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/3254840239 shutdown_connections 2023-09-13T06:13:45.892 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:45.887+0000 7f3e5ccd8640 1 -- 172.21.15.130:0/3254840239 wait complete. 2023-09-13T06:13:45.909 INFO:tasks.ceph:Scrubbing osd.3 2023-09-13T06:13:45.910 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-09-13T06:13:46.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5efdbfa640 1 Processor -- start 2023-09-13T06:13:46.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5efdbfa640 1 -- start start 2023-09-13T06:13:46.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5efdbfa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5ef815d110 0x7f5ef80b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5efdbfa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5ef80ad300 0x7f5ef80ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5efdbfa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef8160f50 con 0x7f5ef815d4f0 2023-09-13T06:13:46.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5efdbfa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef8161e20 con 0x7f5ef815d110 2023-09-13T06:13:46.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5efdbfa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef80cd0d0 con 0x7f5ef80ad300 2023-09-13T06:13:46.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5ef77fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5ef815d110 0x7f5ef80b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5ef77fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5ef815d110 0x7f5ef80b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43852/0 (socket says 172.21.15.130:43852) 2023-09-13T06:13:46.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5ef77fe640 1 -- 172.21.15.130:0/303059007 learned_addr learned my addr 172.21.15.130:0/303059007 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:46.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5eeffff640 1 --2- 172.21.15.130:0/303059007 >> v2:172.21.15.164:3300/0 conn(0x7f5ef80ad300 0x7f5ef80ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5ef77fe640 1 -- 172.21.15.130:0/303059007 >> v2:172.21.15.164:3300/0 conn(0x7f5ef80ad300 msgr2=0x7f5ef80ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:46.055 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5ef77fe640 1 --2- 172.21.15.130:0/303059007 >> v2:172.21.15.164:3300/0 conn(0x7f5ef80ad300 0x7f5ef80ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5ef77fe640 1 -- 172.21.15.130:0/303059007 >> v1:172.21.15.164:6789/0 conn(0x7f5ef815d4f0 legacy=0x7f5ef80aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5ef77fe640 1 -- 172.21.15.130:0/303059007 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef81611a0 con 0x7f5ef815d110 2023-09-13T06:13:46.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.051+0000 7f5eeffff640 1 --2- 172.21.15.130:0/303059007 >> v2:172.21.15.164:3300/0 conn(0x7f5ef80ad300 0x7f5ef80ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:46.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5ef77fe640 1 --2- 172.21.15.130:0/303059007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef815d110 0x7f5ef80b3020 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80cffd0 tx=0x7f5ee801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618349d15ebaf5ae server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5ef6ffd640 1 -- 172.21.15.130:0/303059007 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80ad660 con 0x7f5ef815d110 2023-09-13T06:13:46.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5ef6ffd640 1 -- 172.21.15.130:0/303059007 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee80ad7c0 con 0x7f5ef815d110 2023-09-13T06:13:46.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5ef6ffd640 1 -- 172.21.15.130:0/303059007 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80adb50 con 0x7f5ef815d110 2023-09-13T06:13:46.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5efdbfa640 1 -- 172.21.15.130:0/303059007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef815d110 msgr2=0x7f5ef80b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5efdbfa640 1 --2- 172.21.15.130:0/303059007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef815d110 0x7f5ef80b3020 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80cffd0 tx=0x7f5ee801c470 comp rx=0 tx=0).stop 2023-09-13T06:13:46.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5efdbfa640 1 -- 172.21.15.130:0/303059007 shutdown_connections 2023-09-13T06:13:46.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5efdbfa640 1 --2- 172.21.15.130:0/303059007 >> v2:172.21.15.164:3300/0 conn(0x7f5ef80ad300 0x7f5ef80ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5efdbfa640 1 --2- 172.21.15.130:0/303059007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef815d110 0x7f5ef80b3020 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5efdbfa640 1 -- 172.21.15.130:0/303059007 >> 172.21.15.130:0/303059007 conn(0x7f5ef80735e0 msgr2=0x7f5ef8065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:46.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5efdbfa640 1 -- 172.21.15.130:0/303059007 shutdown_connections 2023-09-13T06:13:46.060 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.055+0000 7f5efdbfa640 1 -- 172.21.15.130:0/303059007 wait complete. 2023-09-13T06:13:46.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5efdbfa640 1 Processor -- start 2023-09-13T06:13:46.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5efdbfa640 1 -- start start 2023-09-13T06:13:46.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5efdbfa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ef80ad300 0x7f5ef815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5efdbfa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef815d110 0x7f5ef815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5efdbfa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ef815d4f0 0x7f5ef815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5efdbfa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef806e0f0 con 0x7f5ef815d110 2023-09-13T06:13:46.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5efdbfa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef815e2e0 con 0x7f5ef815d4f0 2023-09-13T06:13:46.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5efdbfa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef815e530 con 0x7f5ef80ad300 2023-09-13T06:13:46.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5eeffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef815d110 0x7f5ef815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5eeffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef815d110 0x7f5ef815a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43866/0 (socket says 172.21.15.130:43866) 2023-09-13T06:13:46.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5eeffff640 1 -- 172.21.15.130:0/3877222988 learned_addr learned my addr 172.21.15.130:0/3877222988 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:46.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5ef77fe640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ef80ad300 0x7f5ef815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5ef7fff640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ef815d4f0 0x7f5ef815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5eeffff640 1 -- 172.21.15.130:0/3877222988 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ef80ad300 msgr2=0x7f5ef815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5eeffff640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5ef80ad300 0x7f5ef815d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5eeffff640 1 -- 172.21.15.130:0/3877222988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ef815d4f0 msgr2=0x7f5ef815a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5eeffff640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5ef815d4f0 0x7f5ef815a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5eeffff640 1 -- 172.21.15.130:0/3877222988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80094d0 con 0x7f5ef815d110 2023-09-13T06:13:46.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5eeffff640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef815d110 0x7f5ef815a2a0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000e810 tx=0x7f5ee000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5ef4ff9640 1 -- 172.21.15.130:0/3877222988 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000c8d0 con 0x7f5ef815d110 2023-09-13T06:13:46.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5ef4ff9640 1 -- 172.21.15.130:0/3877222988 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee000ca30 con 0x7f5ef815d110 2023-09-13T06:13:46.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5ef4ff9640 1 -- 172.21.15.130:0/3877222988 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000cdc0 con 0x7f5ef815d110 2023-09-13T06:13:46.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5efdbfa640 1 -- 172.21.15.130:0/3877222988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef815e810 con 0x7f5ef815d110 2023-09-13T06:13:46.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5efdbfa640 1 -- 172.21.15.130:0/3877222988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef81533a0 con 0x7f5ef815d110 2023-09-13T06:13:46.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.059+0000 7f5efdbfa640 1 -- 172.21.15.130:0/3877222988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ef8161a40 con 0x7f5ef815d110 2023-09-13T06:13:46.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.063+0000 7f5ef4ff9640 1 -- 172.21.15.130:0/3877222988 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5ee0013410 con 0x7f5ef815d110 2023-09-13T06:13:46.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.063+0000 7f5ef4ff9640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5ed8065b20 0x7f5ed8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.063+0000 7f5ef4ff9640 1 -- 172.21.15.130:0/3877222988 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5ee0082d80 con 0x7f5ef815d110 2023-09-13T06:13:46.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.063+0000 7f5ef77fe640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5ed8065b20 0x7f5ed8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.063+0000 7f5ef4ff9640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] conn(0x7f5ed806b980 0x7f5ed806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.063+0000 7f5ef4ff9640 1 -- 172.21.15.130:0/3877222988 --> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ed806e450 con 0x7f5ed806b980 2023-09-13T06:13:46.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.063+0000 7f5ef4ff9640 1 -- 172.21.15.130:0/3877222988 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ee0085440 con 0x7f5ef815d110 2023-09-13T06:13:46.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.063+0000 7f5ef7fff640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] conn(0x7f5ed806b980 0x7f5ed806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.063+0000 7f5ef77fe640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5ed8065b20 0x7f5ed8067fe0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80af000 tx=0x7f5ee80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.063+0000 7f5ef7fff640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] conn(0x7f5ed806b980 0x7f5ed806dda0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.070 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.063+0000 7f5ef4ff9640 1 -- 172.21.15.130:0/3877222988 <== osd.3 v2:172.21.15.130:6810/2159009057 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f5ed806e450 con 0x7f5ed806b980 2023-09-13T06:13:46.076 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5efdbfa640 1 -- 172.21.15.130:0/3877222988 --> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5ef80618a0 con 0x7f5ed806b980 2023-09-13T06:13:46.077 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5ef4ff9640 1 -- 172.21.15.130:0/3877222988 <== osd.3 v2:172.21.15.130:6810/2159009057 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f5ef80618a0 con 0x7f5ed806b980 2023-09-13T06:13:46.077 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:46.078 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-13T06:13:46.078 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:46.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5efdbfa640 1 -- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] conn(0x7f5ed806b980 msgr2=0x7f5ed806dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5efdbfa640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:6810/2159009057,v1:172.21.15.130:6812/2159009057] conn(0x7f5ed806b980 0x7f5ed806dda0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.079 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5efdbfa640 1 -- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5ed8065b20 msgr2=0x7f5ed8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5efdbfa640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5ed8065b20 0x7f5ed8067fe0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80af000 tx=0x7f5ee80a7000 comp rx=0 tx=0).stop 2023-09-13T06:13:46.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5efdbfa640 1 -- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef815d110 msgr2=0x7f5ef815a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5efdbfa640 1 --2- 172.21.15.130:0/3877222988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef815d110 0x7f5ef815a2a0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000e810 tx=0x7f5ee000ecd0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.080 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5ef7fff640 1 -- 172.21.15.130:0/3877222988 reap_dead start 2023-09-13T06:13:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5efdbfa640 1 -- 172.21.15.130:0/3877222988 shutdown_connections 2023-09-13T06:13:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5efdbfa640 1 -- 172.21.15.130:0/3877222988 >> 172.21.15.130:0/3877222988 conn(0x7f5ef80735e0 msgr2=0x7f5ef80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5efdbfa640 1 -- 172.21.15.130:0/3877222988 shutdown_connections 2023-09-13T06:13:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.075+0000 7f5efdbfa640 1 -- 172.21.15.130:0/3877222988 wait complete. 2023-09-13T06:13:46.095 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-09-13T06:13:46.234 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f93248640 1 Processor -- start 2023-09-13T06:13:46.235 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f93248640 1 -- start start 2023-09-13T06:13:46.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f93248640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9f8c0b2da0 0x7f9f8c06f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f93248640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9f8c06fc70 0x7f9f8c0ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f93248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f8c0cf0d0 0x7f9f8c1429c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.237 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f93248640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c15e660 con 0x7f9f8c0b2da0 2023-09-13T06:13:46.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f93248640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c0cf540 con 0x7f9f8c06fc70 2023-09-13T06:13:46.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f93248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c15d9e0 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f90fe4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9f8c0b2da0 0x7f9f8c06f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f90fe4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9f8c0b2da0 0x7f9f8c06f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43876/0 (socket says 172.21.15.130:43876) 2023-09-13T06:13:46.238 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f90fe4640 1 -- 172.21.15.130:0/3597007919 learned_addr learned my addr 172.21.15.130:0/3597007919 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:46.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f8bfff640 1 --2- 172.21.15.130:0/3597007919 >> v2:172.21.15.164:3300/0 conn(0x7f9f8c06fc70 0x7f9f8c0ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f917e5640 1 --2- 172.21.15.130:0/3597007919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f8c0cf0d0 0x7f9f8c1429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f90fe4640 1 -- 172.21.15.130:0/3597007919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f8c0cf0d0 msgr2=0x7f9f8c1429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:46.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f90fe4640 1 --2- 172.21.15.130:0/3597007919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f8c0cf0d0 0x7f9f8c1429c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.239 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f90fe4640 1 -- 172.21.15.130:0/3597007919 >> v2:172.21.15.164:3300/0 conn(0x7f9f8c06fc70 msgr2=0x7f9f8c0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:46.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f90fe4640 1 --2- 172.21.15.130:0/3597007919 >> v2:172.21.15.164:3300/0 conn(0x7f9f8c06fc70 0x7f9f8c0ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f90fe4640 1 -- 172.21.15.130:0/3597007919 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c15dcc0 con 0x7f9f8c0b2da0 2023-09-13T06:13:46.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f8bfff640 1 --2- 172.21.15.130:0/3597007919 >> v2:172.21.15.164:3300/0 conn(0x7f9f8c06fc70 0x7f9f8c0ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:46.240 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.235+0000 7f9f917e5640 1 --2- 172.21.15.130:0/3597007919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f8c0cf0d0 0x7f9f8c1429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:46.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f90fe4640 1 --2- 172.21.15.130:0/3597007919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f8c0b2da0 0x7f9f8c06f730 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0d0020 tx=0x7f9f8001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecfe4c68a2bc0d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.241 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f8b7fe640 1 -- 172.21.15.130:0/3597007919 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800a89b0 con 0x7f9f8c0b2da0 2023-09-13T06:13:46.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f8b7fe640 1 -- 172.21.15.130:0/3597007919 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f800a8b10 con 0x7f9f8c0b2da0 2023-09-13T06:13:46.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f8b7fe640 1 -- 172.21.15.130:0/3597007919 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800a8ea0 con 0x7f9f8c0b2da0 2023-09-13T06:13:46.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f93248640 1 -- 172.21.15.130:0/3597007919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f8c0b2da0 msgr2=0x7f9f8c06f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f93248640 1 --2- 172.21.15.130:0/3597007919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f8c0b2da0 0x7f9f8c06f730 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0d0020 tx=0x7f9f8001ecf0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f93248640 1 -- 172.21.15.130:0/3597007919 shutdown_connections 2023-09-13T06:13:46.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f93248640 1 --2- 172.21.15.130:0/3597007919 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f8c0cf0d0 0x7f9f8c1429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f93248640 1 --2- 172.21.15.130:0/3597007919 >> v2:172.21.15.164:3300/0 conn(0x7f9f8c06fc70 0x7f9f8c0ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f93248640 1 --2- 172.21.15.130:0/3597007919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f8c0b2da0 0x7f9f8c06f730 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f93248640 1 -- 172.21.15.130:0/3597007919 >> 172.21.15.130:0/3597007919 conn(0x7f9f8c06a2f0 msgr2=0x7f9f8c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:46.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f93248640 1 -- 172.21.15.130:0/3597007919 shutdown_connections 2023-09-13T06:13:46.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.239+0000 7f9f93248640 1 -- 172.21.15.130:0/3597007919 wait complete. 2023-09-13T06:13:46.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f93248640 1 Processor -- start 2023-09-13T06:13:46.246 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f93248640 1 -- start start 2023-09-13T06:13:46.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f93248640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f8c06fc70 0x7f9f8c1450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f93248640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f8c0b2da0 0x7f9f8c13c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f93248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f8c0cf0d0 0x7f9f8c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f93248640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0cef40 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.247 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f93248640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c1457a0 con 0x7f9f8c0b2da0 2023-09-13T06:13:46.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f93248640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c145a80 con 0x7f9f8c06fc70 2023-09-13T06:13:46.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f917e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f8c0cf0d0 0x7f9f8c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f90fe4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f8c06fc70 0x7f9f8c1450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f917e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f8c0cf0d0 0x7f9f8c0cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43890/0 (socket says 172.21.15.130:43890) 2023-09-13T06:13:46.248 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f917e5640 1 -- 172.21.15.130:0/515398543 learned_addr learned my addr 172.21.15.130:0/515398543 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:46.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f8bfff640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f8c0b2da0 0x7f9f8c13c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f917e5640 1 -- 172.21.15.130:0/515398543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f8c06fc70 msgr2=0x7f9f8c1450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f917e5640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f8c06fc70 0x7f9f8c1450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f917e5640 1 -- 172.21.15.130:0/515398543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f8c0b2da0 msgr2=0x7f9f8c13c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f917e5640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f8c0b2da0 0x7f9f8c13c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.249 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f917e5640 1 -- 172.21.15.130:0/515398543 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f800094d0 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f917e5640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f8c0cf0d0 0x7f9f8c0cdbd0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400cd50 tx=0x7f9f8400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f897fa640 1 -- 172.21.15.130:0/515398543 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400f680 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f897fa640 1 -- 172.21.15.130:0/515398543 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8400f800 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.250 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f93248640 1 -- 172.21.15.130:0/515398543 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c145d60 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f897fa640 1 -- 172.21.15.130:0/515398543 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400fbb0 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f93248640 1 -- 172.21.15.130:0/515398543 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c146320 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.251 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.243+0000 7f9f93248640 1 -- 172.21.15.130:0/515398543 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c0c91b0 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.247+0000 7f9f897fa640 1 -- 172.21.15.130:0/515398543 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9f8400b040 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.247+0000 7f9f897fa640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f70065b20 0x7f9f70067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.252 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.247+0000 7f9f897fa640 1 -- 172.21.15.130:0/515398543 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9f840838a0 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.247+0000 7f9f90fe4640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f70065b20 0x7f9f70067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.247+0000 7f9f90fe4640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f70065b20 0x7f9f70067fe0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9f800b2000 tx=0x7f9f80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.253 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.251+0000 7f9f897fa640 1 -- 172.21.15.130:0/515398543 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9f8c0c91b0 con 0x7f9f8c0cf0d0 2023-09-13T06:13:46.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 -- 172.21.15.130:0/515398543 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f8c15e280 con 0x7f9f70065b20 2023-09-13T06:13:46.399 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f897fa640 1 -- 172.21.15.130:0/515398543 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9f800b0620 con 0x7f9f70065b20 2023-09-13T06:13:46.399 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 3 to deep-scrub 2023-09-13T06:13:46.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 -- 172.21.15.130:0/515398543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f70065b20 msgr2=0x7f9f70067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f70065b20 0x7f9f70067fe0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9f800b2000 tx=0x7f9f80009040 comp rx=0 tx=0).stop 2023-09-13T06:13:46.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 -- 172.21.15.130:0/515398543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f8c0cf0d0 msgr2=0x7f9f8c0cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f8c0cf0d0 0x7f9f8c0cdbd0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400cd50 tx=0x7f9f8400a650 comp rx=0 tx=0).stop 2023-09-13T06:13:46.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 -- 172.21.15.130:0/515398543 shutdown_connections 2023-09-13T06:13:46.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9f70065b20 0x7f9f70067fe0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f8c0b2da0 0x7f9f8c13c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f8c0cf0d0 0x7f9f8c0cdbd0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 --2- 172.21.15.130:0/515398543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f8c06fc70 0x7f9f8c1450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 -- 172.21.15.130:0/515398543 >> 172.21.15.130:0/515398543 conn(0x7f9f8c06a2f0 msgr2=0x7f9f8c0c2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:46.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 -- 172.21.15.130:0/515398543 shutdown_connections 2023-09-13T06:13:46.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.399+0000 7f9f93248640 1 -- 172.21.15.130:0/515398543 wait complete. 2023-09-13T06:13:46.420 INFO:tasks.ceph:Scrubbing osd.4 2023-09-13T06:13:46.420 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-09-13T06:13:46.562 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4595bb7640 1 Processor -- start 2023-09-13T06:13:46.563 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4595bb7640 1 -- start start 2023-09-13T06:13:46.564 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4595bb7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4590160d30 0x7f4590146190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4595bb7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4590161110 0x7f4590161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4595bb7640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f45900b6350 0x7f45900b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4595bb7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45900d1b40 con 0x7f4590160d30 2023-09-13T06:13:46.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4595bb7640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45900d1e20 con 0x7f45900b6350 2023-09-13T06:13:46.565 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4595bb7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45900d2100 con 0x7f4590161110 2023-09-13T06:13:46.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4594bb5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4590160d30 0x7f4590146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4594bb5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4590160d30 0x7f4590146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43894/0 (socket says 172.21.15.130:43894) 2023-09-13T06:13:46.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4594bb5640 1 -- 172.21.15.130:0/1397931135 learned_addr learned my addr 172.21.15.130:0/1397931135 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:46.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f45953b6640 1 --2- 172.21.15.130:0/1397931135 >> v2:172.21.15.164:3300/0 conn(0x7f45900b6350 0x7f45900b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.566 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f458ffff640 1 --2- 172.21.15.130:0/1397931135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4590161110 0x7f4590161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4594bb5640 1 -- 172.21.15.130:0/1397931135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4590161110 msgr2=0x7f4590161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:46.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4594bb5640 1 --2- 172.21.15.130:0/1397931135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4590161110 0x7f4590161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4594bb5640 1 -- 172.21.15.130:0/1397931135 >> v2:172.21.15.164:3300/0 conn(0x7f45900b6350 msgr2=0x7f45900b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:46.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4594bb5640 1 --2- 172.21.15.130:0/1397931135 >> v2:172.21.15.164:3300/0 conn(0x7f45900b6350 0x7f45900b67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.567 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.563+0000 7f4594bb5640 1 -- 172.21.15.130:0/1397931135 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900d23e0 con 0x7f4590160d30 2023-09-13T06:13:46.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f4594bb5640 1 --2- 172.21.15.130:0/1397931135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4590160d30 0x7f4590146190 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f459008ba70 tx=0x7f458401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a614913d88472bd3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f458f7fe640 1 -- 172.21.15.130:0/1397931135 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840ab600 con 0x7f4590160d30 2023-09-13T06:13:46.569 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f458f7fe640 1 -- 172.21.15.130:0/1397931135 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45840a7050 con 0x7f4590160d30 2023-09-13T06:13:46.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f458f7fe640 1 -- 172.21.15.130:0/1397931135 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840ab980 con 0x7f4590160d30 2023-09-13T06:13:46.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f4595bb7640 1 -- 172.21.15.130:0/1397931135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4590160d30 msgr2=0x7f4590146190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f4595bb7640 1 --2- 172.21.15.130:0/1397931135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4590160d30 0x7f4590146190 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f459008ba70 tx=0x7f458401c500 comp rx=0 tx=0).stop 2023-09-13T06:13:46.570 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f4595bb7640 1 -- 172.21.15.130:0/1397931135 shutdown_connections 2023-09-13T06:13:46.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f4595bb7640 1 --2- 172.21.15.130:0/1397931135 >> v2:172.21.15.164:3300/0 conn(0x7f45900b6350 0x7f45900b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f4595bb7640 1 --2- 172.21.15.130:0/1397931135 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4590161110 0x7f4590161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f4595bb7640 1 --2- 172.21.15.130:0/1397931135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4590160d30 0x7f4590146190 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f4595bb7640 1 -- 172.21.15.130:0/1397931135 >> 172.21.15.130:0/1397931135 conn(0x7f45900d2f90 msgr2=0x7f45900d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:46.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f4595bb7640 1 -- 172.21.15.130:0/1397931135 shutdown_connections 2023-09-13T06:13:46.571 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.567+0000 7f4595bb7640 1 -- 172.21.15.130:0/1397931135 wait complete. 2023-09-13T06:13:46.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4595bb7640 1 Processor -- start 2023-09-13T06:13:46.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4595bb7640 1 -- start start 2023-09-13T06:13:46.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4595bb7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45900b6350 0x7f4590158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.575 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4595bb7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4590160d30 0x7f459013d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4595bb7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4590161110 0x7f4590142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4595bb7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459013dee0 con 0x7f4590161110 2023-09-13T06:13:46.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4595bb7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45901438c0 con 0x7f45900b6350 2023-09-13T06:13:46.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4595bb7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4590143300 con 0x7f4590160d30 2023-09-13T06:13:46.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f45953b6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4590161110 0x7f4590142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f45953b6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4590161110 0x7f4590142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43908/0 (socket says 172.21.15.130:43908) 2023-09-13T06:13:46.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f45953b6640 1 -- 172.21.15.130:0/3009327952 learned_addr learned my addr 172.21.15.130:0/3009327952 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:46.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f458ffff640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4590160d30 0x7f459013d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4594bb5640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45900b6350 0x7f4590158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f45953b6640 1 -- 172.21.15.130:0/3009327952 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4590160d30 msgr2=0x7f459013d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f45953b6640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4590160d30 0x7f459013d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.578 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f45953b6640 1 -- 172.21.15.130:0/3009327952 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45900b6350 msgr2=0x7f4590158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f45953b6640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45900b6350 0x7f4590158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f45953b6640 1 -- 172.21.15.130:0/3009327952 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45840094d0 con 0x7f4590161110 2023-09-13T06:13:46.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f45953b6640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4590161110 0x7f4590142ab0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f4588007d20 tx=0x7f458800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.579 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f458d7fa640 1 -- 172.21.15.130:0/3009327952 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588014420 con 0x7f4590161110 2023-09-13T06:13:46.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f458d7fa640 1 -- 172.21.15.130:0/3009327952 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45880145a0 con 0x7f4590161110 2023-09-13T06:13:46.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f458d7fa640 1 -- 172.21.15.130:0/3009327952 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588014950 con 0x7f4590161110 2023-09-13T06:13:46.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4595bb7640 1 -- 172.21.15.130:0/3009327952 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45901435e0 con 0x7f4590161110 2023-09-13T06:13:46.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4595bb7640 1 -- 172.21.15.130:0/3009327952 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459015e0a0 con 0x7f4590161110 2023-09-13T06:13:46.580 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.571+0000 7f4595bb7640 1 -- 172.21.15.130:0/3009327952 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f459015dc40 con 0x7f4590161110 2023-09-13T06:13:46.581 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.575+0000 7f458d7fa640 1 -- 172.21.15.130:0/3009327952 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4588014ab0 con 0x7f4590161110 2023-09-13T06:13:46.582 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.575+0000 7f458d7fa640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4574065b20 0x7f4574067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.575+0000 7f458d7fa640 1 -- 172.21.15.130:0/3009327952 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4588083940 con 0x7f4590161110 2023-09-13T06:13:46.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.575+0000 7f4594bb5640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4574065b20 0x7f4574067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.575+0000 7f458d7fa640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] conn(0x7f457406b980 0x7f457406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.575+0000 7f458d7fa640 1 -- 172.21.15.130:0/3009327952 --> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f457406e450 con 0x7f457406b980 2023-09-13T06:13:46.583 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.575+0000 7f458d7fa640 1 -- 172.21.15.130:0/3009327952 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45880882a0 con 0x7f4590161110 2023-09-13T06:13:46.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.575+0000 7f458ffff640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] conn(0x7f457406b980 0x7f457406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.575+0000 7f4594bb5640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4574065b20 0x7f4574067fe0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f45840ad000 tx=0x7f4584008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.575+0000 7f458ffff640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] conn(0x7f457406b980 0x7f457406dda0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.584 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.575+0000 7f458d7fa640 1 -- 172.21.15.130:0/3009327952 <== osd.4 v2:172.21.15.164:6800/2197166496 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f457406e450 con 0x7f457406b980 2023-09-13T06:13:46.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f4595bb7640 1 -- 172.21.15.130:0/3009327952 --> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4590146d60 con 0x7f457406b980 2023-09-13T06:13:46.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f458d7fa640 1 -- 172.21.15.130:0/3009327952 <== osd.4 v2:172.21.15.164:6800/2197166496 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f457c00bb00 con 0x7f457406b980 2023-09-13T06:13:46.589 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:46.590 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-13T06:13:46.590 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:46.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f4595bb7640 1 -- 172.21.15.130:0/3009327952 >> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] conn(0x7f457406b980 msgr2=0x7f457406dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f4595bb7640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.164:6800/2197166496,v1:172.21.15.164:6801/2197166496] conn(0x7f457406b980 0x7f457406dda0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f4595bb7640 1 -- 172.21.15.130:0/3009327952 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4574065b20 msgr2=0x7f4574067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.591 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f4595bb7640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f4574065b20 0x7f4574067fe0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f45840ad000 tx=0x7f4584008040 comp rx=0 tx=0).stop 2023-09-13T06:13:46.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f4595bb7640 1 -- 172.21.15.130:0/3009327952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4590161110 msgr2=0x7f4590142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f4595bb7640 1 --2- 172.21.15.130:0/3009327952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4590161110 0x7f4590142ab0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f4588007d20 tx=0x7f458800e4b0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f45953b6640 1 -- 172.21.15.130:0/3009327952 reap_dead start 2023-09-13T06:13:46.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f4595bb7640 1 -- 172.21.15.130:0/3009327952 shutdown_connections 2023-09-13T06:13:46.592 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f4595bb7640 1 -- 172.21.15.130:0/3009327952 >> 172.21.15.130:0/3009327952 conn(0x7f45900d2f90 msgr2=0x7f4590159590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:46.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f4595bb7640 1 -- 172.21.15.130:0/3009327952 shutdown_connections 2023-09-13T06:13:46.593 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.587+0000 7f4595bb7640 1 -- 172.21.15.130:0/3009327952 wait complete. 2023-09-13T06:13:46.607 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-09-13T06:13:46.677 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:13:46.682 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:13:46.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.747+0000 7ff34e7db640 1 Processor -- start 2023-09-13T06:13:46.749 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.747+0000 7ff34e7db640 1 -- start start 2023-09-13T06:13:46.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.747+0000 7ff34e7db640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff3480cc780 0x7ff34815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.747+0000 7ff34e7db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3480b04a0 0x7ff3480b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.747+0000 7ff34e7db640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3480ccbe0 con 0x7ff34815b130 2023-09-13T06:13:46.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.747+0000 7ff34e7db640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3480b0e70 con 0x7ff3480cc780 2023-09-13T06:13:46.751 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.747+0000 7ff34e7db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3480ce980 con 0x7ff3480b04a0 2023-09-13T06:13:46.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff3477fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff3480cc780 0x7ff34815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff347fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff34815b130 0x7ff3480ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46422/0 (socket says 172.21.15.130:46422) 2023-09-13T06:13:46.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff347fff640 1 -- 172.21.15.130:0/4057095001 learned_addr learned my addr 172.21.15.130:0/4057095001 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:46.752 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff34cd78640 1 --2- 172.21.15.130:0/4057095001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3480b04a0 0x7ff3480b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff3477fe640 1 -- 172.21.15.130:0/4057095001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3480b04a0 msgr2=0x7ff3480b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:46.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff3477fe640 1 --2- 172.21.15.130:0/4057095001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3480b04a0 0x7ff3480b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff3477fe640 1 -- 172.21.15.130:0/4057095001 >> v1:172.21.15.130:6789/0 conn(0x7ff34815b130 legacy=0x7ff3480ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff3477fe640 1 -- 172.21.15.130:0/4057095001 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3480cec60 con 0x7ff3480cc780 2023-09-13T06:13:46.753 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff346ffd640 1 -- 172.21.15.130:0/4057095001 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553760907 0 0) 0x7ff3480ccbe0 con 0x7ff34815b130 2023-09-13T06:13:46.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff3477fe640 1 --2- 172.21.15.130:0/4057095001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3480cc780 0x7ff34815b510 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0097c0 tx=0x7ff33c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ed24db686b091e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.755 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff346ffd640 1 -- 172.21.15.130:0/4057095001 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0ab650 con 0x7ff3480cc780 2023-09-13T06:13:46.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff346ffd640 1 -- 172.21.15.130:0/4057095001 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c0ab7b0 con 0x7ff3480cc780 2023-09-13T06:13:46.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.751+0000 7ff346ffd640 1 -- 172.21.15.130:0/4057095001 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0abb40 con 0x7ff3480cc780 2023-09-13T06:13:46.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 -- 172.21.15.130:0/4057095001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3480cc780 msgr2=0x7ff34815b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 --2- 172.21.15.130:0/4057095001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3480cc780 0x7ff34815b510 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0097c0 tx=0x7ff33c01c450 comp rx=0 tx=0).stop 2023-09-13T06:13:46.756 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 -- 172.21.15.130:0/4057095001 shutdown_connections 2023-09-13T06:13:46.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 --2- 172.21.15.130:0/4057095001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3480b04a0 0x7ff3480b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 --2- 172.21.15.130:0/4057095001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3480cc780 0x7ff34815b510 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 -- 172.21.15.130:0/4057095001 >> 172.21.15.130:0/4057095001 conn(0x7ff348065990 msgr2=0x7ff348065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:46.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 -- 172.21.15.130:0/4057095001 shutdown_connections 2023-09-13T06:13:46.757 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 -- 172.21.15.130:0/4057095001 wait complete. 2023-09-13T06:13:46.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 Processor -- start 2023-09-13T06:13:46.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 -- start start 2023-09-13T06:13:46.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3480b04a0 0x7ff34814ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3480cc780 0x7ff3481558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff34815b130 0x7ff3481535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3480ae330 con 0x7ff3480cc780 2023-09-13T06:13:46.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff348153ec0 con 0x7ff34815b130 2023-09-13T06:13:46.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34e7db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3481541a0 con 0x7ff3480b04a0 2023-09-13T06:13:46.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff3477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3480cc780 0x7ff3481558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.761 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff3477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3480cc780 0x7ff3481558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43926/0 (socket says 172.21.15.130:43926) 2023-09-13T06:13:46.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff3477fe640 1 -- 172.21.15.130:0/203592435 learned_addr learned my addr 172.21.15.130:0/203592435 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:46.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff34cd78640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff34815b130 0x7ff3481535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff347fff640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3480b04a0 0x7ff34814ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff3477fe640 1 -- 172.21.15.130:0/203592435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3480b04a0 msgr2=0x7ff34814ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff3477fe640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3480b04a0 0x7ff34814ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff3477fe640 1 -- 172.21.15.130:0/203592435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff34815b130 msgr2=0x7ff3481535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff3477fe640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff34815b130 0x7ff3481535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.755+0000 7ff3477fe640 1 -- 172.21.15.130:0/203592435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c009420 con 0x7ff3480cc780 2023-09-13T06:13:46.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.759+0000 7ff3477fe640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3480cc780 0x7ff3481558c0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0ad040 tx=0x7ff33c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.759+0000 7ff344ff9640 1 -- 172.21.15.130:0/203592435 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0b5810 con 0x7ff3480cc780 2023-09-13T06:13:46.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.759+0000 7ff344ff9640 1 -- 172.21.15.130:0/203592435 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c0b5970 con 0x7ff3480cc780 2023-09-13T06:13:46.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.759+0000 7ff344ff9640 1 -- 172.21.15.130:0/203592435 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0b5d20 con 0x7ff3480cc780 2023-09-13T06:13:46.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.759+0000 7ff34e7db640 1 -- 172.21.15.130:0/203592435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3480ae5d0 con 0x7ff3480cc780 2023-09-13T06:13:46.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.759+0000 7ff34e7db640 1 -- 172.21.15.130:0/203592435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff348153b00 con 0x7ff3480cc780 2023-09-13T06:13:46.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.759+0000 7ff34e7db640 1 -- 172.21.15.130:0/203592435 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3480618a0 con 0x7ff3480cc780 2023-09-13T06:13:46.765 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.759+0000 7ff344ff9640 1 -- 172.21.15.130:0/203592435 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff33c0bf410 con 0x7ff3480cc780 2023-09-13T06:13:46.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.759+0000 7ff344ff9640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff334065b20 0x7ff334067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:46.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.759+0000 7ff344ff9640 1 -- 172.21.15.130:0/203592435 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff33c11dbd0 con 0x7ff3480cc780 2023-09-13T06:13:46.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.759+0000 7ff347fff640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff334065b20 0x7ff334067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:46.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.763+0000 7ff347fff640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff334065b20 0x7ff334067fe0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff338000f70 tx=0x7ff338007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:46.766 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.763+0000 7ff344ff9640 1 -- 172.21.15.130:0/203592435 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff33c0eb780 con 0x7ff3480cc780 2023-09-13T06:13:46.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.911+0000 7ff34e7db640 1 -- 172.21.15.130:0/203592435 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff34815ba50 con 0x7ff334065b20 2023-09-13T06:13:46.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff344ff9640 1 -- 172.21.15.130:0/203592435 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff338007da0 con 0x7ff334065b20 2023-09-13T06:13:46.915 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 4 to deep-scrub 2023-09-13T06:13:46.916 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 -- 172.21.15.130:0/203592435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff334065b20 msgr2=0x7ff334067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff334065b20 0x7ff334067fe0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff338000f70 tx=0x7ff338007c10 comp rx=0 tx=0).stop 2023-09-13T06:13:46.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 -- 172.21.15.130:0/203592435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3480cc780 msgr2=0x7ff3481558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:46.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3480cc780 0x7ff3481558c0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0ad040 tx=0x7ff33c01ac90 comp rx=0 tx=0).stop 2023-09-13T06:13:46.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 -- 172.21.15.130:0/203592435 shutdown_connections 2023-09-13T06:13:46.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7ff334065b20 0x7ff334067fe0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff34815b130 0x7ff3481535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3480cc780 0x7ff3481558c0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 --2- 172.21.15.130:0/203592435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3480b04a0 0x7ff34814ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:46.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 -- 172.21.15.130:0/203592435 >> 172.21.15.130:0/203592435 conn(0x7ff348065990 msgr2=0x7ff34806f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:46.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 -- 172.21.15.130:0/203592435 shutdown_connections 2023-09-13T06:13:46.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:46.915+0000 7ff34e7db640 1 -- 172.21.15.130:0/203592435 wait complete. 2023-09-13T06:13:46.935 INFO:tasks.ceph:Scrubbing osd.5 2023-09-13T06:13:46.935 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-09-13T06:13:47.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac24aca640 1 Processor -- start 2023-09-13T06:13:47.119 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac24aca640 1 -- start start 2023-09-13T06:13:47.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac24aca640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fac20159d40 0x7fac200cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac24aca640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fac200b2570 0x7fac200b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac24aca640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2006e530 con 0x7fac200ad690 2023-09-13T06:13:47.121 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac24aca640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac200ce2a0 con 0x7fac200b2570 2023-09-13T06:13:47.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac24aca640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac200b2f40 con 0x7fac20159d40 2023-09-13T06:13:47.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac1ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fac200b2570 0x7fac200b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac1ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fac200b2570 0x7fac200b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43938/0 (socket says 172.21.15.130:43938) 2023-09-13T06:13:47.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac1ffff640 1 -- 172.21.15.130:0/3228043892 learned_addr learned my addr 172.21.15.130:0/3228043892 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:47.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac1f7fe640 1 --2- 172.21.15.130:0/3228043892 >> v2:172.21.15.164:3300/0 conn(0x7fac20159d40 0x7fac200cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac1ffff640 1 -- 172.21.15.130:0/3228043892 >> v2:172.21.15.164:3300/0 conn(0x7fac20159d40 msgr2=0x7fac200cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:47.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac1ffff640 1 --2- 172.21.15.130:0/3228043892 >> v2:172.21.15.164:3300/0 conn(0x7fac20159d40 0x7fac200cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac1ffff640 1 -- 172.21.15.130:0/3228043892 >> v1:172.21.15.164:6789/0 conn(0x7fac200ad690 legacy=0x7fac2015e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.119+0000 7fac1ffff640 1 -- 172.21.15.130:0/3228043892 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac200ce490 con 0x7fac200b2570 2023-09-13T06:13:47.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac1ffff640 1 --2- 172.21.15.130:0/3228043892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac200b2570 0x7fac200b2a00 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fac2004e830 tx=0x7fac1801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0a97eaa6cea05a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac1e7fc640 1 -- 172.21.15.130:0/3228043892 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180a57d0 con 0x7fac200b2570 2023-09-13T06:13:47.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac1e7fc640 1 -- 172.21.15.130:0/3228043892 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180a5930 con 0x7fac200b2570 2023-09-13T06:13:47.125 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac1e7fc640 1 -- 172.21.15.130:0/3228043892 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180a5cc0 con 0x7fac200b2570 2023-09-13T06:13:47.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac24aca640 1 -- 172.21.15.130:0/3228043892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac200b2570 msgr2=0x7fac200b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac24aca640 1 --2- 172.21.15.130:0/3228043892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac200b2570 0x7fac200b2a00 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fac2004e830 tx=0x7fac1801c910 comp rx=0 tx=0).stop 2023-09-13T06:13:47.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac24aca640 1 -- 172.21.15.130:0/3228043892 shutdown_connections 2023-09-13T06:13:47.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac24aca640 1 --2- 172.21.15.130:0/3228043892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac200b2570 0x7fac200b2a00 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac24aca640 1 --2- 172.21.15.130:0/3228043892 >> v2:172.21.15.164:3300/0 conn(0x7fac20159d40 0x7fac200cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac24aca640 1 -- 172.21.15.130:0/3228043892 >> 172.21.15.130:0/3228043892 conn(0x7fac200b4120 msgr2=0x7fac200b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:47.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac24aca640 1 -- 172.21.15.130:0/3228043892 shutdown_connections 2023-09-13T06:13:47.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac24aca640 1 -- 172.21.15.130:0/3228043892 wait complete. 2023-09-13T06:13:47.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.123+0000 7fac24aca640 1 Processor -- start 2023-09-13T06:13:47.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac24aca640 1 -- start start 2023-09-13T06:13:47.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac24aca640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac200ad690 0x7fac200acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.130 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac24aca640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac200b2570 0x7fac2015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac24aca640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac20159d40 0x7fac201f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac24aca640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200afaf0 con 0x7fac20159d40 2023-09-13T06:13:47.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac24aca640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2015c730 con 0x7fac200ad690 2023-09-13T06:13:47.131 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac24aca640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac200ad250 con 0x7fac200b2570 2023-09-13T06:13:47.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac20159d40 0x7fac201f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac20159d40 0x7fac201f32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43952/0 (socket says 172.21.15.130:43952) 2023-09-13T06:13:47.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac1ffff640 1 -- 172.21.15.130:0/3737242621 learned_addr learned my addr 172.21.15.130:0/3737242621 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:47.132 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac1f7fe640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac200ad690 0x7fac200acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac1effd640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac200b2570 0x7fac2015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac1ffff640 1 -- 172.21.15.130:0/3737242621 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac200b2570 msgr2=0x7fac2015be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac1ffff640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac200b2570 0x7fac2015be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac1ffff640 1 -- 172.21.15.130:0/3737242621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac200ad690 msgr2=0x7fac200acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.133 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac1ffff640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac200ad690 0x7fac200acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac1ffff640 1 -- 172.21.15.130:0/3737242621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18009b30 con 0x7fac20159d40 2023-09-13T06:13:47.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac1ffff640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac20159d40 0x7fac201f32c0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fac180af040 tx=0x7fac180196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac07fff640 1 -- 172.21.15.130:0/3737242621 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180b8670 con 0x7fac20159d40 2023-09-13T06:13:47.134 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac07fff640 1 -- 172.21.15.130:0/3737242621 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180b87f0 con 0x7fac20159d40 2023-09-13T06:13:47.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac07fff640 1 -- 172.21.15.130:0/3737242621 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180b8ba0 con 0x7fac20159d40 2023-09-13T06:13:47.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac24aca640 1 -- 172.21.15.130:0/3737242621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac200af1c0 con 0x7fac20159d40 2023-09-13T06:13:47.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac24aca640 1 -- 172.21.15.130:0/3737242621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac200af780 con 0x7fac20159d40 2023-09-13T06:13:47.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.127+0000 7fac24aca640 1 -- 172.21.15.130:0/3737242621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac200cea50 con 0x7fac20159d40 2023-09-13T06:13:47.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.131+0000 7fac07fff640 1 -- 172.21.15.130:0/3737242621 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fac180b8d00 con 0x7fac20159d40 2023-09-13T06:13:47.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.131+0000 7fac07fff640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fac0c065b20 0x7fac0c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.131+0000 7fac07fff640 1 -- 172.21.15.130:0/3737242621 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fac1811e940 con 0x7fac20159d40 2023-09-13T06:13:47.137 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.131+0000 7fac07fff640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] conn(0x7fac0c06b980 0x7fac0c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.131+0000 7fac07fff640 1 -- 172.21.15.130:0/3737242621 --> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac0c06e450 con 0x7fac0c06b980 2023-09-13T06:13:47.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.131+0000 7fac07fff640 1 -- 172.21.15.130:0/3737242621 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac1811ecb0 con 0x7fac20159d40 2023-09-13T06:13:47.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.131+0000 7fac1f7fe640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fac0c065b20 0x7fac0c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.131+0000 7fac1effd640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] conn(0x7fac0c06b980 0x7fac0c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.138 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.131+0000 7fac1f7fe640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fac0c065b20 0x7fac0c067fe0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fac2015a530 tx=0x7fac10006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.131+0000 7fac1effd640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] conn(0x7fac0c06b980 0x7fac0c06dda0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.139 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.131+0000 7fac07fff640 1 -- 172.21.15.130:0/3737242621 <== osd.5 v2:172.21.15.164:6808/848118120 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fac0c06e450 con 0x7fac0c06b980 2023-09-13T06:13:47.144 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac24aca640 1 -- 172.21.15.130:0/3737242621 --> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fac2015dcd0 con 0x7fac0c06b980 2023-09-13T06:13:47.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac07fff640 1 -- 172.21.15.130:0/3737242621 <== osd.5 v2:172.21.15.164:6808/848118120 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fac14001450 con 0x7fac0c06b980 2023-09-13T06:13:47.145 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:47.146 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-13T06:13:47.146 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:47.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac24aca640 1 -- 172.21.15.130:0/3737242621 >> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] conn(0x7fac0c06b980 msgr2=0x7fac0c06dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac24aca640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.164:6808/848118120,v1:172.21.15.164:6809/848118120] conn(0x7fac0c06b980 0x7fac0c06dda0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac24aca640 1 -- 172.21.15.130:0/3737242621 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fac0c065b20 msgr2=0x7fac0c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac24aca640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fac0c065b20 0x7fac0c067fe0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fac2015a530 tx=0x7fac10006f90 comp rx=0 tx=0).stop 2023-09-13T06:13:47.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac24aca640 1 -- 172.21.15.130:0/3737242621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac20159d40 msgr2=0x7fac201f32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac24aca640 1 --2- 172.21.15.130:0/3737242621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac20159d40 0x7fac201f32c0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fac180af040 tx=0x7fac180196b0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac1ffff640 1 -- 172.21.15.130:0/3737242621 reap_dead start 2023-09-13T06:13:47.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac24aca640 1 -- 172.21.15.130:0/3737242621 shutdown_connections 2023-09-13T06:13:47.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac24aca640 1 -- 172.21.15.130:0/3737242621 >> 172.21.15.130:0/3737242621 conn(0x7fac200b4120 msgr2=0x7fac2006cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:47.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac24aca640 1 -- 172.21.15.130:0/3737242621 shutdown_connections 2023-09-13T06:13:47.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.143+0000 7fac24aca640 1 -- 172.21.15.130:0/3737242621 wait complete. 2023-09-13T06:13:47.164 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-09-13T06:13:47.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb99ad2c640 1 Processor -- start 2023-09-13T06:13:47.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb99ad2c640 1 -- start start 2023-09-13T06:13:47.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb99ad2c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb9940b04a0 0x7fb9940b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb99ad2c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9940ccbe0 con 0x7fb99415b130 2023-09-13T06:13:47.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb99ad2c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9940ce980 con 0x7fb9940cc780 2023-09-13T06:13:47.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb99ad2c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9940b0e50 con 0x7fb9940b04a0 2023-09-13T06:13:47.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb998ac8640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb99415b130 0x7fb9940ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46434/0 (socket says 172.21.15.130:46434) 2023-09-13T06:13:47.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb998ac8640 1 -- 172.21.15.130:0/2085285826 learned_addr learned my addr 172.21.15.130:0/2085285826 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:47.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9992c9640 1 --2- 172.21.15.130:0/2085285826 >> v2:172.21.15.164:3300/0 conn(0x7fb9940b04a0 0x7fb9940b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795002700 0 0) 0x7fb9940ccbe0 con 0x7fb99415b130 2023-09-13T06:13:47.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb984003530 con 0x7fb99415b130 2023-09-13T06:13:47.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 833521373 0 0) 0x7fb984003530 con 0x7fb99415b130 2023-09-13T06:13:47.309 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 >> v2:172.21.15.164:3300/0 conn(0x7fb9940b04a0 msgr2=0x7fb9940b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:47.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 --2- 172.21.15.130:0/2085285826 >> v2:172.21.15.164:3300/0 conn(0x7fb9940b04a0 0x7fb9940b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 >> v1:172.21.15.164:6789/0 conn(0x7fb9940cc780 legacy=0x7fb99415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9940cec60 con 0x7fb99415b130 2023-09-13T06:13:47.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7fb988001680 con 0x7fb99415b130 2023-09-13T06:13:47.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 >> v1:172.21.15.130:6789/0 conn(0x7fb99415b130 legacy=0x7fb9940ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 --2- 172.21.15.130:0/2085285826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb984003a40 0x7fb984003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 --2- 172.21.15.130:0/2085285826 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9840047d0 0x7fb984004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 --2- 172.21.15.130:0/2085285826 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9840051e0 0x7fb98400fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9940b0e50 con 0x7fb984003a40 2023-09-13T06:13:47.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb984010520 con 0x7fb9840047d0 2023-09-13T06:13:47.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9840106e0 con 0x7fb9840051e0 2023-09-13T06:13:47.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb998ac8640 1 --2- 172.21.15.130:0/2085285826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb984003a40 0x7fb984003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb993fff640 1 --2- 172.21.15.130:0/2085285826 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9840047d0 0x7fb984004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9992c9640 1 --2- 172.21.15.130:0/2085285826 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9840051e0 0x7fb98400fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb998ac8640 1 -- 172.21.15.130:0/2085285826 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9840051e0 msgr2=0x7fb98400fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:47.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb998ac8640 1 --2- 172.21.15.130:0/2085285826 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9840051e0 0x7fb98400fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb998ac8640 1 -- 172.21.15.130:0/2085285826 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9840047d0 msgr2=0x7fb984004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:47.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb998ac8640 1 --2- 172.21.15.130:0/2085285826 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9840047d0 0x7fb984004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb998ac8640 1 -- 172.21.15.130:0/2085285826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb984003530 con 0x7fb984003a40 2023-09-13T06:13:47.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.303+0000 7fb9992c9640 1 -- 172.21.15.130:0/2085285826 reap_dead start 2023-09-13T06:13:47.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.307+0000 7fb998ac8640 1 --2- 172.21.15.130:0/2085285826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb984003a40 0x7fb984003e60 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fb98800c110 tx=0x7fb98801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9697fda0cebb198e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.307+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988005ae0 con 0x7fb984003a40 2023-09-13T06:13:47.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.307+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb988005c40 con 0x7fb984003a40 2023-09-13T06:13:47.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.307+0000 7fb9937fe640 1 -- 172.21.15.130:0/2085285826 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9880a5810 con 0x7fb984003a40 2023-09-13T06:13:47.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.307+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2085285826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb984003a40 msgr2=0x7fb984003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.307+0000 7fb99ad2c640 1 --2- 172.21.15.130:0/2085285826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb984003a40 0x7fb984003e60 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fb98800c110 tx=0x7fb98801cab0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.307+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2085285826 shutdown_connections 2023-09-13T06:13:47.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.307+0000 7fb99ad2c640 1 --2- 172.21.15.130:0/2085285826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb984003a40 0x7fb984003e60 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.307+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2085285826 >> 172.21.15.130:0/2085285826 conn(0x7fb994065990 msgr2=0x7fb994065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:47.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.307+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2085285826 shutdown_connections 2023-09-13T06:13:47.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.307+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2085285826 wait complete. 2023-09-13T06:13:47.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb99ad2c640 1 Processor -- start 2023-09-13T06:13:47.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb99ad2c640 1 -- start start 2023-09-13T06:13:47.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb99ad2c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb984003a40 0x7fb994151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb99ad2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb994152890 0x7fb9940aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb99ad2c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb994152d10 0x7fb9940aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb99ad2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9940a9e30 con 0x7fb994152890 2023-09-13T06:13:47.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb99ad2c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb994151b40 con 0x7fb994152d10 2023-09-13T06:13:47.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb99ad2c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9940aced0 con 0x7fb984003a40 2023-09-13T06:13:47.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb993fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb994152890 0x7fb9940aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb993fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb994152890 0x7fb9940aa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43958/0 (socket says 172.21.15.130:43958) 2023-09-13T06:13:47.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb993fff640 1 -- 172.21.15.130:0/2436259394 learned_addr learned my addr 172.21.15.130:0/2436259394 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:47.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb998ac8640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb984003a40 0x7fb994151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb9992c9640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb994152d10 0x7fb9940aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb993fff640 1 -- 172.21.15.130:0/2436259394 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb984003a40 msgr2=0x7fb994151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb993fff640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb984003a40 0x7fb994151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb993fff640 1 -- 172.21.15.130:0/2436259394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb994152d10 msgr2=0x7fb9940aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb993fff640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb994152d10 0x7fb9940aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb993fff640 1 -- 172.21.15.130:0/2436259394 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9940ad1b0 con 0x7fb994152890 2023-09-13T06:13:47.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb993fff640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb994152890 0x7fb9940aa0f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fb98000f770 tx=0x7fb98000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb9917fa640 1 -- 172.21.15.130:0/2436259394 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9800050d0 con 0x7fb994152890 2023-09-13T06:13:47.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb9917fa640 1 -- 172.21.15.130:0/2436259394 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb980005230 con 0x7fb994152890 2023-09-13T06:13:47.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb9917fa640 1 -- 172.21.15.130:0/2436259394 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98000d730 con 0x7fb994152890 2023-09-13T06:13:47.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2436259394 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb994151db0 con 0x7fb994152890 2023-09-13T06:13:47.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.311+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2436259394 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb994152370 con 0x7fb994152890 2023-09-13T06:13:47.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.315+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2436259394 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb994152530 con 0x7fb994152890 2023-09-13T06:13:47.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.315+0000 7fb9917fa640 1 -- 172.21.15.130:0/2436259394 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb98000d890 con 0x7fb994152890 2023-09-13T06:13:47.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.315+0000 7fb9917fa640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb978065b50 0x7fb978068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.315+0000 7fb9917fa640 1 -- 172.21.15.130:0/2436259394 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb980082d50 con 0x7fb994152890 2023-09-13T06:13:47.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.315+0000 7fb998ac8640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb978065b50 0x7fb978068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.315+0000 7fb998ac8640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb978065b50 0x7fb978068010 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb9880ab000 tx=0x7fb9880a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.319+0000 7fb9917fa640 1 -- 172.21.15.130:0/2436259394 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb9800509b0 con 0x7fb994152890 2023-09-13T06:13:47.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.467+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2436259394 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb99406c920 con 0x7fb978065b50 2023-09-13T06:13:47.469 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.467+0000 7fb9917fa640 1 -- 172.21.15.130:0/2436259394 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb9880b5040 con 0x7fb978065b50 2023-09-13T06:13:47.470 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 5 to deep-scrub 2023-09-13T06:13:47.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2436259394 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb978065b50 msgr2=0x7fb978068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.471 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb978065b50 0x7fb978068010 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb9880ab000 tx=0x7fb9880a7070 comp rx=0 tx=0).stop 2023-09-13T06:13:47.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2436259394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb994152890 msgr2=0x7fb9940aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb994152890 0x7fb9940aa0f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fb98000f770 tx=0x7fb98000fc30 comp rx=0 tx=0).stop 2023-09-13T06:13:47.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2436259394 shutdown_connections 2023-09-13T06:13:47.472 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb978065b50 0x7fb978068010 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb994152d10 0x7fb9940aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb994152890 0x7fb9940aa0f0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 --2- 172.21.15.130:0/2436259394 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb984003a40 0x7fb994151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2436259394 >> 172.21.15.130:0/2436259394 conn(0x7fb994065990 msgr2=0x7fb9940b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:47.473 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2436259394 shutdown_connections 2023-09-13T06:13:47.474 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.471+0000 7fb99ad2c640 1 -- 172.21.15.130:0/2436259394 wait complete. 2023-09-13T06:13:47.490 INFO:tasks.ceph:Scrubbing osd.6 2023-09-13T06:13:47.491 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-09-13T06:13:47.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.631+0000 7f1a98893640 1 Processor -- start 2023-09-13T06:13:47.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.631+0000 7f1a98893640 1 -- start start 2023-09-13T06:13:47.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a98893640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1a940ccc10 0x7f1a9415dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.635 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a98893640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a940ccff0 con 0x7f1a940cb710 2023-09-13T06:13:47.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a98893640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9415b590 con 0x7f1a940b3170 2023-09-13T06:13:47.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a98893640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a940b12f0 con 0x7f1a940ccc10 2023-09-13T06:13:47.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a92d9d640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1a940cb710 0x7f1a940cd1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46444/0 (socket says 172.21.15.130:46444) 2023-09-13T06:13:47.636 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a92d9d640 1 -- 172.21.15.130:0/1528611982 learned_addr learned my addr 172.21.15.130:0/1528611982 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:47.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9259c640 1 --2- 172.21.15.130:0/1528611982 >> v2:172.21.15.164:3300/0 conn(0x7f1a940ccc10 0x7f1a9415dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823240853 0 0) 0x7f1a940ccff0 con 0x7f1a940cb710 2023-09-13T06:13:47.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a7c005740 con 0x7f1a940cb710 2023-09-13T06:13:47.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 73113969 0 0) 0x7f1a7c005740 con 0x7f1a940cb710 2023-09-13T06:13:47.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 >> v2:172.21.15.164:3300/0 conn(0x7f1a940ccc10 msgr2=0x7f1a9415dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:47.639 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 --2- 172.21.15.130:0/1528611982 >> v2:172.21.15.164:3300/0 conn(0x7f1a940ccc10 0x7f1a9415dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 >> v1:172.21.15.164:6789/0 conn(0x7f1a940b3170 legacy=0x7f1a940b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9415e520 con 0x7f1a940cb710 2023-09-13T06:13:47.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f1a8c001680 con 0x7f1a940cb710 2023-09-13T06:13:47.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 >> v1:172.21.15.130:6789/0 conn(0x7f1a940cb710 legacy=0x7f1a940cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.640 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a7c005c50 0x7f1a7c006070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 0x7f1a7c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a7c0071c0 0x7f1a7c00ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940b12f0 con 0x7f1a7c0065b0 2023-09-13T06:13:47.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c010510 con 0x7f1a7c0071c0 2023-09-13T06:13:47.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c0106d0 con 0x7f1a7c005c50 2023-09-13T06:13:47.641 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a91d9b640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 0x7f1a7c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a9259c640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a7c005c50 0x7f1a7c006070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a92d9d640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a7c0071c0 0x7f1a7c00ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a91d9b640 1 -- 172.21.15.130:0/1528611982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a7c005c50 msgr2=0x7f1a7c006070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:47.642 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a91d9b640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a7c005c50 0x7f1a7c006070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a91d9b640 1 -- 172.21.15.130:0/1528611982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a7c0071c0 msgr2=0x7f1a7c00ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:47.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a91d9b640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a7c0071c0 0x7f1a7c00ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a91d9b640 1 -- 172.21.15.130:0/1528611982 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c005740 con 0x7f1a7c0065b0 2023-09-13T06:13:47.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a92d9d640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a7c0071c0 0x7f1a7c00ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:47.643 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.635+0000 7f1a92d9d640 1 -- 172.21.15.130:0/1528611982 reap_dead start 2023-09-13T06:13:47.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.639+0000 7f1a91d9b640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 0x7f1a7c0069e0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f1a88001780 tx=0x7f1a8801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476a5d65128afe0c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.639+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a880a4ea0 con 0x7f1a7c0065b0 2023-09-13T06:13:47.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.639+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a880a7050 con 0x7f1a7c0065b0 2023-09-13T06:13:47.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.639+0000 7f1a9159a640 1 -- 172.21.15.130:0/1528611982 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88003600 con 0x7f1a7c0065b0 2023-09-13T06:13:47.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.639+0000 7f1a98893640 1 -- 172.21.15.130:0/1528611982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 msgr2=0x7f1a7c0069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.639+0000 7f1a98893640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 0x7f1a7c0069e0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f1a88001780 tx=0x7f1a8801c3e0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.639+0000 7f1a98893640 1 -- 172.21.15.130:0/1528611982 shutdown_connections 2023-09-13T06:13:47.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.639+0000 7f1a98893640 1 --2- 172.21.15.130:0/1528611982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 0x7f1a7c0069e0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.639+0000 7f1a98893640 1 -- 172.21.15.130:0/1528611982 >> 172.21.15.130:0/1528611982 conn(0x7f1a940735e0 msgr2=0x7f1a94065990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:47.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.639+0000 7f1a98893640 1 -- 172.21.15.130:0/1528611982 shutdown_connections 2023-09-13T06:13:47.648 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.639+0000 7f1a98893640 1 -- 172.21.15.130:0/1528611982 wait complete. 2023-09-13T06:13:47.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a98893640 1 Processor -- start 2023-09-13T06:13:47.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a98893640 1 -- start start 2023-09-13T06:13:47.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a98893640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 0x7f1a9414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a98893640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a940ae570 0x7f1a9406e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.649 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a98893640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a941570d0 0x7f1a94157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a98893640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94157a90 con 0x7f1a7c0065b0 2023-09-13T06:13:47.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a98893640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940aed00 con 0x7f1a940ae570 2023-09-13T06:13:47.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a98893640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940aefe0 con 0x7f1a941570d0 2023-09-13T06:13:47.650 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a9259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 0x7f1a9414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a9259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 0x7f1a9414cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43968/0 (socket says 172.21.15.130:43968) 2023-09-13T06:13:47.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a9259c640 1 -- 172.21.15.130:0/1270931992 learned_addr learned my addr 172.21.15.130:0/1270931992 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:47.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a91d9b640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a940ae570 0x7f1a9406e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a92d9d640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a941570d0 0x7f1a94157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a9259c640 1 -- 172.21.15.130:0/1270931992 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a941570d0 msgr2=0x7f1a94157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.651 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a9259c640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a941570d0 0x7f1a94157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a9259c640 1 -- 172.21.15.130:0/1270931992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a940ae570 msgr2=0x7f1a9406e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a9259c640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a940ae570 0x7f1a9406e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a9259c640 1 -- 172.21.15.130:0/1270931992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940af2c0 con 0x7f1a7c0065b0 2023-09-13T06:13:47.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a9259c640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 0x7f1a9414cb50 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f1a84011e30 tx=0x7f1a8400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.652 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a82ffd640 1 -- 172.21.15.130:0/1270931992 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400e040 con 0x7f1a7c0065b0 2023-09-13T06:13:47.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a82ffd640 1 -- 172.21.15.130:0/1270931992 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8400f040 con 0x7f1a7c0065b0 2023-09-13T06:13:47.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a82ffd640 1 -- 172.21.15.130:0/1270931992 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84009c00 con 0x7f1a7c0065b0 2023-09-13T06:13:47.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a98893640 1 -- 172.21.15.130:0/1270931992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a940af5a0 con 0x7f1a7c0065b0 2023-09-13T06:13:47.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a98893640 1 -- 172.21.15.130:0/1270931992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a940afda0 con 0x7f1a7c0065b0 2023-09-13T06:13:47.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.643+0000 7f1a98893640 1 -- 172.21.15.130:0/1270931992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a9415eae0 con 0x7f1a7c0065b0 2023-09-13T06:13:47.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.647+0000 7f1a82ffd640 1 -- 172.21.15.130:0/1270931992 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1a84015850 con 0x7f1a7c0065b0 2023-09-13T06:13:47.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.647+0000 7f1a82ffd640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a74065b20 0x7f1a74067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.647+0000 7f1a82ffd640 1 -- 172.21.15.130:0/1270931992 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1a84083f50 con 0x7f1a7c0065b0 2023-09-13T06:13:47.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.647+0000 7f1a82ffd640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] conn(0x7f1a7406b980 0x7f1a7406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.647+0000 7f1a91d9b640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a74065b20 0x7f1a74067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.647+0000 7f1a82ffd640 1 -- 172.21.15.130:0/1270931992 --> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a7406e450 con 0x7f1a7406b980 2023-09-13T06:13:47.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.647+0000 7f1a82ffd640 1 -- 172.21.15.130:0/1270931992 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a8400fee0 con 0x7f1a7c0065b0 2023-09-13T06:13:47.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.647+0000 7f1a92d9d640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] conn(0x7f1a7406b980 0x7f1a7406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.647+0000 7f1a91d9b640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a74065b20 0x7f1a74067fe0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1a88001750 tx=0x7f1a880011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.647+0000 7f1a92d9d640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] conn(0x7f1a7406b980 0x7f1a7406dda0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.647+0000 7f1a82ffd640 1 -- 172.21.15.130:0/1270931992 <== osd.6 v2:172.21.15.164:6815/3345829618 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f1a7406e450 con 0x7f1a7406b980 2023-09-13T06:13:47.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.659+0000 7f1a98893640 1 -- 172.21.15.130:0/1270931992 --> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1a9415e800 con 0x7f1a7406b980 2023-09-13T06:13:47.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.659+0000 7f1a82ffd640 1 -- 172.21.15.130:0/1270931992 <== osd.6 v2:172.21.15.164:6815/3345829618 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f1a8c005120 con 0x7f1a7406b980 2023-09-13T06:13:47.662 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:47.662 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-13T06:13:47.662 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:47.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.659+0000 7f1a98893640 1 -- 172.21.15.130:0/1270931992 >> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] conn(0x7f1a7406b980 msgr2=0x7f1a7406dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.659+0000 7f1a98893640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.164:6815/3345829618,v1:172.21.15.164:6817/3345829618] conn(0x7f1a7406b980 0x7f1a7406dda0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.659+0000 7f1a98893640 1 -- 172.21.15.130:0/1270931992 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a74065b20 msgr2=0x7f1a74067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.659+0000 7f1a98893640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1a74065b20 0x7f1a74067fe0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1a88001750 tx=0x7f1a880011a0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.659+0000 7f1a98893640 1 -- 172.21.15.130:0/1270931992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 msgr2=0x7f1a9414cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.659+0000 7f1a98893640 1 --2- 172.21.15.130:0/1270931992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a7c0065b0 0x7f1a9414cb50 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f1a84011e30 tx=0x7f1a8400f580 comp rx=0 tx=0).stop 2023-09-13T06:13:47.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.659+0000 7f1a92d9d640 1 -- 172.21.15.130:0/1270931992 reap_dead start 2023-09-13T06:13:47.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.659+0000 7f1a98893640 1 -- 172.21.15.130:0/1270931992 shutdown_connections 2023-09-13T06:13:47.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.659+0000 7f1a98893640 1 -- 172.21.15.130:0/1270931992 >> 172.21.15.130:0/1270931992 conn(0x7f1a940735e0 msgr2=0x7f1a9415d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:47.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.663+0000 7f1a98893640 1 -- 172.21.15.130:0/1270931992 shutdown_connections 2023-09-13T06:13:47.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.663+0000 7f1a98893640 1 -- 172.21.15.130:0/1270931992 wait complete. 2023-09-13T06:13:47.681 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-09-13T06:13:47.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5538540640 1 Processor -- start 2023-09-13T06:13:47.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5538540640 1 -- start start 2023-09-13T06:13:47.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5538540640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553015b130 0x7f55300cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.821 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5538540640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f55300ce180 0x7f553015b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5538540640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f55300b04a0 0x7f55300b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5538540640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55300b0e70 con 0x7f55300b04a0 2023-09-13T06:13:47.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5538540640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55300ce980 con 0x7f55300ce180 2023-09-13T06:13:47.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5538540640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55300cec60 con 0x7f553015b130 2023-09-13T06:13:47.822 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5536add640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f55300b04a0 0x7f55300b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5536add640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f55300b04a0 0x7f55300b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43974/0 (socket says 172.21.15.130:43974) 2023-09-13T06:13:47.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5536add640 1 -- 172.21.15.130:0/1936787174 learned_addr learned my addr 172.21.15.130:0/1936787174 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:47.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5535adb640 1 --2- 172.21.15.130:0/1936787174 >> v2:172.21.15.164:3300/0 conn(0x7f55300ce180 0x7f553015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f55362dc640 1 --2- 172.21.15.130:0/1936787174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553015b130 0x7f55300cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5536add640 1 -- 172.21.15.130:0/1936787174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553015b130 msgr2=0x7f55300cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:47.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5536add640 1 --2- 172.21.15.130:0/1936787174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553015b130 0x7f55300cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5536add640 1 -- 172.21.15.130:0/1936787174 >> v2:172.21.15.164:3300/0 conn(0x7f55300ce180 msgr2=0x7f553015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:47.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5536add640 1 --2- 172.21.15.130:0/1936787174 >> v2:172.21.15.164:3300/0 conn(0x7f55300ce180 0x7f553015b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5536add640 1 -- 172.21.15.130:0/1936787174 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553006c640 con 0x7f55300b04a0 2023-09-13T06:13:47.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.819+0000 7f5535adb640 1 --2- 172.21.15.130:0/1936787174 >> v2:172.21.15.164:3300/0 conn(0x7f55300ce180 0x7f553015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:13:47.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f5536add640 1 --2- 172.21.15.130:0/1936787174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55300b04a0 0x7f55300b0930 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f55300b27a0 tx=0x7f552801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a695ae02bf69a25 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f55352da640 1 -- 172.21.15.130:0/1936787174 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280a5850 con 0x7f55300b04a0 2023-09-13T06:13:47.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f55352da640 1 -- 172.21.15.130:0/1936787174 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55280a59b0 con 0x7f55300b04a0 2023-09-13T06:13:47.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f55352da640 1 -- 172.21.15.130:0/1936787174 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280a5d40 con 0x7f55300b04a0 2023-09-13T06:13:47.826 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f5538540640 1 -- 172.21.15.130:0/1936787174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55300b04a0 msgr2=0x7f55300b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f5538540640 1 --2- 172.21.15.130:0/1936787174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55300b04a0 0x7f55300b0930 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f55300b27a0 tx=0x7f552801c9d0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f5538540640 1 -- 172.21.15.130:0/1936787174 shutdown_connections 2023-09-13T06:13:47.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f5538540640 1 --2- 172.21.15.130:0/1936787174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55300b04a0 0x7f55300b0930 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f5538540640 1 --2- 172.21.15.130:0/1936787174 >> v2:172.21.15.164:3300/0 conn(0x7f55300ce180 0x7f553015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.827 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f5538540640 1 --2- 172.21.15.130:0/1936787174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f553015b130 0x7f55300cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f5538540640 1 -- 172.21.15.130:0/1936787174 >> 172.21.15.130:0/1936787174 conn(0x7f5530065990 msgr2=0x7f5530065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:47.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f5538540640 1 -- 172.21.15.130:0/1936787174 shutdown_connections 2023-09-13T06:13:47.828 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.823+0000 7f5538540640 1 -- 172.21.15.130:0/1936787174 wait complete. 2023-09-13T06:13:47.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5538540640 1 Processor -- start 2023-09-13T06:13:47.830 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5538540640 1 -- start start 2023-09-13T06:13:47.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5538540640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55300b04a0 0x7f55301521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5538540640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55300ce180 0x7f553006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5538540640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f553015b130 0x7f553006f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.831 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5538540640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5530159480 con 0x7f55300b04a0 2023-09-13T06:13:47.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5538540640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553013e370 con 0x7f553015b130 2023-09-13T06:13:47.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5538540640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5530151160 con 0x7f55300ce180 2023-09-13T06:13:47.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f55362dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55300b04a0 0x7f55301521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f55362dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55300b04a0 0x7f55301521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43982/0 (socket says 172.21.15.130:43982) 2023-09-13T06:13:47.832 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f55362dc640 1 -- 172.21.15.130:0/2265602492 learned_addr learned my addr 172.21.15.130:0/2265602492 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:47.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5536add640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f553015b130 0x7f553006f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f55362dc640 1 -- 172.21.15.130:0/2265602492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55300ce180 msgr2=0x7f553006f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5535adb640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55300ce180 0x7f553006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f55362dc640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55300ce180 0x7f553006f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f55362dc640 1 -- 172.21.15.130:0/2265602492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f553015b130 msgr2=0x7f553006f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f55362dc640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f553015b130 0x7f553006f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f55362dc640 1 -- 172.21.15.130:0/2265602492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5528009b30 con 0x7f55300b04a0 2023-09-13T06:13:47.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5536add640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f553015b130 0x7f553006f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:47.834 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5535adb640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55300ce180 0x7f553006f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:13:47.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f55362dc640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55300b04a0 0x7f55301521a0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f552c00e8a0 tx=0x7f552c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5526ffd640 1 -- 172.21.15.130:0/2265602492 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c009510 con 0x7f55300b04a0 2023-09-13T06:13:47.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5526ffd640 1 -- 172.21.15.130:0/2265602492 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c00c940 con 0x7f55300b04a0 2023-09-13T06:13:47.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5538540640 1 -- 172.21.15.130:0/2265602492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5530151440 con 0x7f55300b04a0 2023-09-13T06:13:47.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5526ffd640 1 -- 172.21.15.130:0/2265602492 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c00ccb0 con 0x7f55300b04a0 2023-09-13T06:13:47.835 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5538540640 1 -- 172.21.15.130:0/2265602492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5530151a00 con 0x7f55300b04a0 2023-09-13T06:13:47.836 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.827+0000 7f5538540640 1 -- 172.21.15.130:0/2265602492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55301591e0 con 0x7f55300b04a0 2023-09-13T06:13:47.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.831+0000 7f5526ffd640 1 -- 172.21.15.130:0/2265602492 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f552c013470 con 0x7f55300b04a0 2023-09-13T06:13:47.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.831+0000 7f5526ffd640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5514065b50 0x7f5514068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:47.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.831+0000 7f5526ffd640 1 -- 172.21.15.130:0/2265602492 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f552c083150 con 0x7f55300b04a0 2023-09-13T06:13:47.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.831+0000 7f5535adb640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5514065b50 0x7f5514068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:47.837 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.831+0000 7f5535adb640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5514065b50 0x7f5514068010 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f55300afc10 tx=0x7f5520008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:47.838 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.835+0000 7f5526ffd640 1 -- 172.21.15.130:0/2265602492 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f55301591e0 con 0x7f55300b04a0 2023-09-13T06:13:47.983 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 -- 172.21.15.130:0/2265602492 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f553015ba50 con 0x7f5514065b50 2023-09-13T06:13:47.984 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5526ffd640 1 -- 172.21.15.130:0/2265602492 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f552000d550 con 0x7f5514065b50 2023-09-13T06:13:47.984 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 6 to deep-scrub 2023-09-13T06:13:47.985 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 -- 172.21.15.130:0/2265602492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5514065b50 msgr2=0x7f5514068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5514065b50 0x7f5514068010 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f55300afc10 tx=0x7f5520008040 comp rx=0 tx=0).stop 2023-09-13T06:13:47.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 -- 172.21.15.130:0/2265602492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55300b04a0 msgr2=0x7f55301521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:47.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55300b04a0 0x7f55301521a0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f552c00e8a0 tx=0x7f552c00eca0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.986 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 -- 172.21.15.130:0/2265602492 shutdown_connections 2023-09-13T06:13:47.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f5514065b50 0x7f5514068010 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f553015b130 0x7f553006f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55300ce180 0x7f553006f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.987 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 --2- 172.21.15.130:0/2265602492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55300b04a0 0x7f55301521a0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:47.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 -- 172.21.15.130:0/2265602492 >> 172.21.15.130:0/2265602492 conn(0x7f5530065990 msgr2=0x7f5530152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:47.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 -- 172.21.15.130:0/2265602492 shutdown_connections 2023-09-13T06:13:47.988 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:47.983+0000 7f5538540640 1 -- 172.21.15.130:0/2265602492 wait complete. 2023-09-13T06:13:48.005 INFO:tasks.ceph:Scrubbing osd.7 2023-09-13T06:13:48.005 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-09-13T06:13:48.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a9d3c6640 1 Processor -- start 2023-09-13T06:13:48.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a9d3c6640 1 -- start start 2023-09-13T06:13:48.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a9d3c6640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a98160de0 0x7f7a98143460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a9d3c6640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7a9806f530 0x7f7a9806f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a9d3c6640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a981439a0 con 0x7f7a980d0c10 2023-09-13T06:13:48.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a9d3c6640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a98140740 con 0x7f7a98160de0 2023-09-13T06:13:48.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a9d3c6640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9815d900 con 0x7f7a9806f530 2023-09-13T06:13:48.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a96ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f7a980d0c10 0x7f7a980b6f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46460/0 (socket says 172.21.15.130:46460) 2023-09-13T06:13:48.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a96ffd640 1 -- 172.21.15.130:0/3640490490 learned_addr learned my addr 172.21.15.130:0/3640490490 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:48.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a967fc640 1 --2- 172.21.15.130:0/3640490490 >> v2:172.21.15.130:3300/0 conn(0x7f7a98160de0 0x7f7a98143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a977fe640 1 --2- 172.21.15.130:0/3640490490 >> v2:172.21.15.164:3300/0 conn(0x7f7a9806f530 0x7f7a9806f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a95ffb640 1 -- 172.21.15.130:0/3640490490 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774203046 0 0) 0x7f7a88001120 con 0x7f7a980d0c10 2023-09-13T06:13:48.151 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a95ffb640 1 -- 172.21.15.130:0/3640490490 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a80003530 con 0x7f7a980d0c10 2023-09-13T06:13:48.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a967fc640 1 -- 172.21.15.130:0/3640490490 >> v2:172.21.15.164:3300/0 conn(0x7f7a9806f530 msgr2=0x7f7a9806f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:48.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a967fc640 1 --2- 172.21.15.130:0/3640490490 >> v2:172.21.15.164:3300/0 conn(0x7f7a9806f530 0x7f7a9806f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a967fc640 1 -- 172.21.15.130:0/3640490490 >> v1:172.21.15.130:6789/0 conn(0x7f7a980d0c10 legacy=0x7f7a980b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.152 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.147+0000 7f7a967fc640 1 -- 172.21.15.130:0/3640490490 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9806fe80 con 0x7f7a98160de0 2023-09-13T06:13:48.153 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a967fc640 1 --2- 172.21.15.130:0/3640490490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a98160de0 0x7f7a98143460 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f7a980b6810 tx=0x7f7a8c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a450497a94ddb02 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:48.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a95ffb640 1 -- 172.21.15.130:0/3640490490 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0ab600 con 0x7f7a98160de0 2023-09-13T06:13:48.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a95ffb640 1 -- 172.21.15.130:0/3640490490 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c0a7050 con 0x7f7a98160de0 2023-09-13T06:13:48.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a95ffb640 1 -- 172.21.15.130:0/3640490490 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0ab980 con 0x7f7a98160de0 2023-09-13T06:13:48.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/3640490490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a98160de0 msgr2=0x7f7a98143460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.154 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a9d3c6640 1 --2- 172.21.15.130:0/3640490490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a98160de0 0x7f7a98143460 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f7a980b6810 tx=0x7f7a8c01c460 comp rx=0 tx=0).stop 2023-09-13T06:13:48.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/3640490490 shutdown_connections 2023-09-13T06:13:48.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a9d3c6640 1 --2- 172.21.15.130:0/3640490490 >> v2:172.21.15.164:3300/0 conn(0x7f7a9806f530 0x7f7a9806f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a9d3c6640 1 --2- 172.21.15.130:0/3640490490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a98160de0 0x7f7a98143460 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/3640490490 >> 172.21.15.130:0/3640490490 conn(0x7f7a98065990 msgr2=0x7f7a98065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:48.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/3640490490 shutdown_connections 2023-09-13T06:13:48.155 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.151+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/3640490490 wait complete. 2023-09-13T06:13:48.157 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a9d3c6640 1 Processor -- start 2023-09-13T06:13:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a9d3c6640 1 -- start start 2023-09-13T06:13:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a9d3c6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a9806f530 0x7f7a980b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a9d3c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0c10 0x7f7a98138f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a9d3c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a98160de0 0x7f7a9813e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a9d3c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9813b640 con 0x7f7a980d0c10 2023-09-13T06:13:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a9d3c6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9813ba60 con 0x7f7a9806f530 2023-09-13T06:13:48.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a9d3c6640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9813aca0 con 0x7f7a98160de0 2023-09-13T06:13:48.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a967fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0c10 0x7f7a98138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a967fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0c10 0x7f7a98138f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44012/0 (socket says 172.21.15.130:44012) 2023-09-13T06:13:48.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a967fc640 1 -- 172.21.15.130:0/110606817 learned_addr learned my addr 172.21.15.130:0/110606817 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:48.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a96ffd640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a9806f530 0x7f7a980b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a977fe640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a98160de0 0x7f7a9813e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a967fc640 1 -- 172.21.15.130:0/110606817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a98160de0 msgr2=0x7f7a9813e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a967fc640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7a98160de0 0x7f7a9813e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a967fc640 1 -- 172.21.15.130:0/110606817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a9806f530 msgr2=0x7f7a980b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a967fc640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7a9806f530 0x7f7a980b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a967fc640 1 -- 172.21.15.130:0/110606817 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c009420 con 0x7f7a980d0c10 2023-09-13T06:13:48.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a967fc640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0c10 0x7f7a98138f60 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c019070 tx=0x7f7a8c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:48.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a7f7fe640 1 -- 172.21.15.130:0/110606817 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0b4430 con 0x7f7a980d0c10 2023-09-13T06:13:48.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a7f7fe640 1 -- 172.21.15.130:0/110606817 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c0b45b0 con 0x7f7a980d0c10 2023-09-13T06:13:48.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a7f7fe640 1 -- 172.21.15.130:0/110606817 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0b4960 con 0x7f7a980d0c10 2023-09-13T06:13:48.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/110606817 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9813af80 con 0x7f7a980d0c10 2023-09-13T06:13:48.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.155+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/110606817 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a98140140 con 0x7f7a980d0c10 2023-09-13T06:13:48.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.159+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/110606817 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7a98161c60 con 0x7f7a980d0c10 2023-09-13T06:13:48.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.159+0000 7f7a7f7fe640 1 -- 172.21.15.130:0/110606817 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7a8c0b2040 con 0x7f7a980d0c10 2023-09-13T06:13:48.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.159+0000 7f7a7f7fe640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a84065b20 0x7f7a84067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.159+0000 7f7a7f7fe640 1 -- 172.21.15.130:0/110606817 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7a8c11d820 con 0x7f7a980d0c10 2023-09-13T06:13:48.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.159+0000 7f7a96ffd640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a84065b20 0x7f7a84067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.159+0000 7f7a7f7fe640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] conn(0x7f7a8406b980 0x7f7a8406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.159+0000 7f7a7f7fe640 1 -- 172.21.15.130:0/110606817 --> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a8406e450 con 0x7f7a8406b980 2023-09-13T06:13:48.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.159+0000 7f7a7f7fe640 1 -- 172.21.15.130:0/110606817 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a8c11db90 con 0x7f7a980d0c10 2023-09-13T06:13:48.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.159+0000 7f7a977fe640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] conn(0x7f7a8406b980 0x7f7a8406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.159+0000 7f7a96ffd640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a84065b20 0x7f7a84067fe0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7a88001280 tx=0x7f7a88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:48.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.159+0000 7f7a977fe640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] conn(0x7f7a8406b980 0x7f7a8406dda0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:48.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.163+0000 7f7a7f7fe640 1 -- 172.21.15.130:0/110606817 <== osd.7 v2:172.21.15.164:6824/3372769909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f7a8406e450 con 0x7f7a8406b980 2023-09-13T06:13:48.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.171+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/110606817 --> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7a98161980 con 0x7f7a8406b980 2023-09-13T06:13:48.173 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.171+0000 7f7a7f7fe640 1 -- 172.21.15.130:0/110606817 <== osd.7 v2:172.21.15.164:6824/3372769909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f7a9000f040 con 0x7f7a8406b980 2023-09-13T06:13:48.174 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-09-13T06:13:48.174 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-13T06:13:48.174 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-09-13T06:13:48.175 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.171+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/110606817 >> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] conn(0x7f7a8406b980 msgr2=0x7f7a8406dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.171+0000 7f7a9d3c6640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.164:6824/3372769909,v1:172.21.15.164:6825/3372769909] conn(0x7f7a8406b980 0x7f7a8406dda0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.171+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/110606817 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a84065b20 msgr2=0x7f7a84067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.171+0000 7f7a9d3c6640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f7a84065b20 0x7f7a84067fe0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7a88001280 tx=0x7f7a88009040 comp rx=0 tx=0).stop 2023-09-13T06:13:48.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.171+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/110606817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0c10 msgr2=0x7f7a98138f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.176 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.171+0000 7f7a9d3c6640 1 --2- 172.21.15.130:0/110606817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0c10 0x7f7a98138f60 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c019070 tx=0x7f7a8c019200 comp rx=0 tx=0).stop 2023-09-13T06:13:48.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.171+0000 7f7a977fe640 1 -- 172.21.15.130:0/110606817 reap_dead start 2023-09-13T06:13:48.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.175+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/110606817 shutdown_connections 2023-09-13T06:13:48.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.175+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/110606817 >> 172.21.15.130:0/110606817 conn(0x7f7a98065990 msgr2=0x7f7a98065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:48.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.175+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/110606817 shutdown_connections 2023-09-13T06:13:48.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.175+0000 7f7a9d3c6640 1 -- 172.21.15.130:0/110606817 wait complete. 2023-09-13T06:13:48.192 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-09-13T06:13:48.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc966a7b640 1 Processor -- start 2023-09-13T06:13:48.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc966a7b640 1 -- start start 2023-09-13T06:13:48.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc966a7b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960159f20 0x7fc9600ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc966a7b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc9600cdfc0 0x7fc9600b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc966a7b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9600ccfd0 con 0x7fc9600b1610 2023-09-13T06:13:48.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc966a7b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9600b00f0 con 0x7fc9600cdfc0 2023-09-13T06:13:48.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc966a7b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600ce420 con 0x7fc960159f20 2023-09-13T06:13:48.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc964817640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960159f20 0x7fc9600ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc95ffff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc9600cdfc0 0x7fc9600b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc964817640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960159f20 0x7fc9600ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:49324/0 (socket says 172.21.15.130:49324) 2023-09-13T06:13:48.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc964817640 1 -- 172.21.15.130:0/3484548002 learned_addr learned my addr 172.21.15.130:0/3484548002 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:48.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc964817640 1 -- 172.21.15.130:0/3484548002 >> v2:172.21.15.164:3300/0 conn(0x7fc9600cdfc0 msgr2=0x7fc9600b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:48.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc964817640 1 --2- 172.21.15.130:0/3484548002 >> v2:172.21.15.164:3300/0 conn(0x7fc9600cdfc0 0x7fc9600b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc964817640 1 -- 172.21.15.130:0/3484548002 >> v1:172.21.15.164:6789/0 conn(0x7fc9600b1610 legacy=0x7fc9600ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc964817640 1 -- 172.21.15.130:0/3484548002 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9600ced90 con 0x7fc960159f20 2023-09-13T06:13:48.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.331+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3484548002 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457952258 0 0) 0x7fc9600ccfd0 con 0x7fc9600b1610 2023-09-13T06:13:48.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc964817640 1 --2- 172.21.15.130:0/3484548002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960159f20 0x7fc9600ce7b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc954009870 tx=0x7fc95401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=768a4af808585586 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:48.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3484548002 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9540a7070 con 0x7fc960159f20 2023-09-13T06:13:48.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3484548002 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9540ab430 con 0x7fc960159f20 2023-09-13T06:13:48.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc95f7fe640 1 -- 172.21.15.130:0/3484548002 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9540ab7c0 con 0x7fc960159f20 2023-09-13T06:13:48.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc966a7b640 1 -- 172.21.15.130:0/3484548002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960159f20 msgr2=0x7fc9600ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc966a7b640 1 --2- 172.21.15.130:0/3484548002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960159f20 0x7fc9600ce7b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc954009870 tx=0x7fc95401c540 comp rx=0 tx=0).stop 2023-09-13T06:13:48.338 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc966a7b640 1 -- 172.21.15.130:0/3484548002 shutdown_connections 2023-09-13T06:13:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc966a7b640 1 --2- 172.21.15.130:0/3484548002 >> v2:172.21.15.164:3300/0 conn(0x7fc9600cdfc0 0x7fc9600b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc966a7b640 1 --2- 172.21.15.130:0/3484548002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc960159f20 0x7fc9600ce7b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc966a7b640 1 -- 172.21.15.130:0/3484548002 >> 172.21.15.130:0/3484548002 conn(0x7fc960065990 msgr2=0x7fc960065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc966a7b640 1 -- 172.21.15.130:0/3484548002 shutdown_connections 2023-09-13T06:13:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.335+0000 7fc966a7b640 1 -- 172.21.15.130:0/3484548002 wait complete. 2023-09-13T06:13:48.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc966a7b640 1 Processor -- start 2023-09-13T06:13:48.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc966a7b640 1 -- start start 2023-09-13T06:13:48.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc966a7b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9600b1610 0x7fc96013fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc966a7b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9600cdfc0 0x7fc9601513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.342 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc966a7b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc960159f20 0x7fc9601576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc966a7b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9601400a0 con 0x7fc960159f20 2023-09-13T06:13:48.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc966a7b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc960150310 con 0x7fc9600cdfc0 2023-09-13T06:13:48.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc966a7b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9601505f0 con 0x7fc9600b1610 2023-09-13T06:13:48.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc964817640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9600b1610 0x7fc96013fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc965018640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc960159f20 0x7fc9601576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc964817640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9600b1610 0x7fc96013fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.130:49330/0 (socket says 172.21.15.130:49330) 2023-09-13T06:13:48.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc964817640 1 -- 172.21.15.130:0/1525629752 learned_addr learned my addr 172.21.15.130:0/1525629752 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:48.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc95ffff640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9600cdfc0 0x7fc9601513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc965018640 1 -- 172.21.15.130:0/1525629752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9600b1610 msgr2=0x7fc96013fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.344 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc965018640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9600b1610 0x7fc96013fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc965018640 1 -- 172.21.15.130:0/1525629752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9600cdfc0 msgr2=0x7fc9601513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc965018640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9600cdfc0 0x7fc9601513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc965018640 1 -- 172.21.15.130:0/1525629752 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540094d0 con 0x7fc960159f20 2023-09-13T06:13:48.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc965018640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc960159f20 0x7fc9601576c0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fc9580012f0 tx=0x7fc95800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:48.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc95d7fa640 1 -- 172.21.15.130:0/1525629752 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958003b80 con 0x7fc960159f20 2023-09-13T06:13:48.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc95d7fa640 1 -- 172.21.15.130:0/1525629752 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958003d00 con 0x7fc960159f20 2023-09-13T06:13:48.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc95d7fa640 1 -- 172.21.15.130:0/1525629752 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580052b0 con 0x7fc960159f20 2023-09-13T06:13:48.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc966a7b640 1 -- 172.21.15.130:0/1525629752 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9601508d0 con 0x7fc960159f20 2023-09-13T06:13:48.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.339+0000 7fc966a7b640 1 -- 172.21.15.130:0/1525629752 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc960150e90 con 0x7fc960159f20 2023-09-13T06:13:48.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.343+0000 7fc966a7b640 1 -- 172.21.15.130:0/1525629752 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9600618a0 con 0x7fc960159f20 2023-09-13T06:13:48.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.343+0000 7fc95d7fa640 1 -- 172.21.15.130:0/1525629752 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc958005410 con 0x7fc960159f20 2023-09-13T06:13:48.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.343+0000 7fc95d7fa640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 0x7fc944067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.343+0000 7fc95d7fa640 1 -- 172.21.15.130:0/1525629752 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc958082b10 con 0x7fc960159f20 2023-09-13T06:13:48.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.343+0000 7fc964817640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 0x7fc944067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.343+0000 7fc964817640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 0x7fc944067fe0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc95401c580 tx=0x7fc9540a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:48.349 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.347+0000 7fc95d7fa640 1 -- 172.21.15.130:0/1525629752 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc9580508a0 con 0x7fc960159f20 2023-09-13T06:13:48.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.495+0000 7fc966a7b640 1 -- 172.21.15.130:0/1525629752 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9600cdaa0 con 0x7fc944065b20 2023-09-13T06:13:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.495+0000 7fc95d7fa640 1 -- 172.21.15.130:0/1525629752 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc9540ab860 con 0x7fc944065b20 2023-09-13T06:13:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 7 to deep-scrub 2023-09-13T06:13:48.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.495+0000 7fc966a7b640 1 -- 172.21.15.130:0/1525629752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 msgr2=0x7fc944067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.495+0000 7fc966a7b640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 0x7fc944067fe0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc95401c580 tx=0x7fc9540a7000 comp rx=0 tx=0).stop 2023-09-13T06:13:48.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.495+0000 7fc966a7b640 1 -- 172.21.15.130:0/1525629752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc960159f20 msgr2=0x7fc9601576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.499+0000 7fc966a7b640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc960159f20 0x7fc9601576c0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fc9580012f0 tx=0x7fc95800cbe0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.499 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.499+0000 7fc966a7b640 1 -- 172.21.15.130:0/1525629752 shutdown_connections 2023-09-13T06:13:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.499+0000 7fc966a7b640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fc944065b20 0x7fc944067fe0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.499+0000 7fc966a7b640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9600cdfc0 0x7fc9601513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.499+0000 7fc966a7b640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc960159f20 0x7fc9601576c0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.499+0000 7fc966a7b640 1 --2- 172.21.15.130:0/1525629752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9600b1610 0x7fc96013fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.499+0000 7fc966a7b640 1 -- 172.21.15.130:0/1525629752 >> 172.21.15.130:0/1525629752 conn(0x7fc960065990 msgr2=0x7fc96006b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.499+0000 7fc966a7b640 1 -- 172.21.15.130:0/1525629752 shutdown_connections 2023-09-13T06:13:48.501 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.499+0000 7fc966a7b640 1 -- 172.21.15.130:0/1525629752 wait complete. 2023-09-13T06:13:48.518 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:13:48.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f161c1fa640 1 Processor -- start 2023-09-13T06:13:48.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f161c1fa640 1 -- start start 2023-09-13T06:13:48.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f161c1fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1614147b50 0x7f16141652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f161c1fa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1614147f30 0x7f1614148410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f161c1fa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161406b5e0 con 0x7f1614148950 2023-09-13T06:13:48.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f161c1fa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161406b8c0 con 0x7f1614147f30 2023-09-13T06:13:48.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f161c1fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16141657f0 con 0x7f1614147b50 2023-09-13T06:13:48.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f161a797640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1614148950 0x7f161406bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:46474/0 (socket says 172.21.15.130:46474) 2023-09-13T06:13:48.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f161a797640 1 -- 172.21.15.130:0/63248755 learned_addr learned my addr 172.21.15.130:0/63248755 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:13:48.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f1619f96640 1 --2- 172.21.15.130:0/63248755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1614147b50 0x7f16141652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f1619795640 1 --2- 172.21.15.130:0/63248755 >> v2:172.21.15.164:3300/0 conn(0x7f1614147f30 0x7f1614148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f1618f94640 1 -- 172.21.15.130:0/63248755 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684942543 0 0) 0x7f161406b5e0 con 0x7f1614148950 2023-09-13T06:13:48.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.655+0000 7f1618f94640 1 -- 172.21.15.130:0/63248755 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1600003530 con 0x7f1614148950 2023-09-13T06:13:48.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.659+0000 7f1618f94640 1 -- 172.21.15.130:0/63248755 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1604216973 0 0) 0x7f1600003530 con 0x7f1614148950 2023-09-13T06:13:48.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.659+0000 7f1619f96640 1 -- 172.21.15.130:0/63248755 >> v2:172.21.15.164:3300/0 conn(0x7f1614147f30 msgr2=0x7f1614148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:13:48.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.659+0000 7f1619f96640 1 --2- 172.21.15.130:0/63248755 >> v2:172.21.15.164:3300/0 conn(0x7f1614147f30 0x7f1614148410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.659+0000 7f1619f96640 1 -- 172.21.15.130:0/63248755 >> v1:172.21.15.130:6789/0 conn(0x7f1614148950 legacy=0x7f161406bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.659+0000 7f1619f96640 1 -- 172.21.15.130:0/63248755 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614165ac0 con 0x7f1614147b50 2023-09-13T06:13:48.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.659+0000 7f1619f96640 1 --2- 172.21.15.130:0/63248755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1614147b50 0x7f16141652b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16100097c0 tx=0x7f161001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=147cf4785d38ab00 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:48.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.659+0000 7f1618f94640 1 -- 172.21.15.130:0/63248755 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c001a00 con 0x7f1614147b50 2023-09-13T06:13:48.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.659+0000 7f1618f94640 1 -- 172.21.15.130:0/63248755 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100a7050 con 0x7f1614147b50 2023-09-13T06:13:48.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.659+0000 7f1618f94640 1 -- 172.21.15.130:0/63248755 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100ab620 con 0x7f1614147b50 2023-09-13T06:13:48.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.659+0000 7f161c1fa640 1 -- 172.21.15.130:0/63248755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1614147b50 msgr2=0x7f16141652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.659+0000 7f161c1fa640 1 --2- 172.21.15.130:0/63248755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1614147b50 0x7f16141652b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16100097c0 tx=0x7f161001c370 comp rx=0 tx=0).stop 2023-09-13T06:13:48.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 -- 172.21.15.130:0/63248755 shutdown_connections 2023-09-13T06:13:48.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 --2- 172.21.15.130:0/63248755 >> v2:172.21.15.164:3300/0 conn(0x7f1614147f30 0x7f1614148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 --2- 172.21.15.130:0/63248755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1614147b50 0x7f16141652b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 -- 172.21.15.130:0/63248755 >> 172.21.15.130:0/63248755 conn(0x7f1614065990 msgr2=0x7f1614065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:48.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 -- 172.21.15.130:0/63248755 shutdown_connections 2023-09-13T06:13:48.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 -- 172.21.15.130:0/63248755 wait complete. 2023-09-13T06:13:48.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 Processor -- start 2023-09-13T06:13:48.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 -- start start 2023-09-13T06:13:48.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1614147b50 0x7f1614163680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1614147f30 0x7f1614160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1614148950 0x7f1614144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16140cfe60 con 0x7f1614147f30 2023-09-13T06:13:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1614163bc0 con 0x7f1614148950 2023-09-13T06:13:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161c1fa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161413c8d0 con 0x7f1614147b50 2023-09-13T06:13:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f1619795640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1614147f30 0x7f1614160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f1619795640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1614147f30 0x7f1614160d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44032/0 (socket says 172.21.15.130:44032) 2023-09-13T06:13:48.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f1619795640 1 -- 172.21.15.130:0/1170668587 learned_addr learned my addr 172.21.15.130:0/1170668587 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:13:48.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f1619f96640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1614147b50 0x7f1614163680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f161a797640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1614148950 0x7f1614144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f1619795640 1 -- 172.21.15.130:0/1170668587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1614147b50 msgr2=0x7f1614163680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f1619795640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1614147b50 0x7f1614163680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f1619795640 1 -- 172.21.15.130:0/1170668587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1614148950 msgr2=0x7f1614144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f1619795640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1614148950 0x7f1614144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f1619795640 1 -- 172.21.15.130:0/1170668587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1610009420 con 0x7f1614147f30 2023-09-13T06:13:48.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.663+0000 7f1619795640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1614147f30 0x7f1614160d80 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f160400e930 tx=0x7f160400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:48.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.667+0000 7f160a7fc640 1 -- 172.21.15.130:0/1170668587 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604009690 con 0x7f1614147f30 2023-09-13T06:13:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.667+0000 7f160a7fc640 1 -- 172.21.15.130:0/1170668587 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160400ca00 con 0x7f1614147f30 2023-09-13T06:13:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.667+0000 7f161c1fa640 1 -- 172.21.15.130:0/1170668587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16141643b0 con 0x7f1614147f30 2023-09-13T06:13:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.667+0000 7f160a7fc640 1 -- 172.21.15.130:0/1170668587 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160400cd90 con 0x7f1614147f30 2023-09-13T06:13:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.667+0000 7f161c1fa640 1 -- 172.21.15.130:0/1170668587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16141640d0 con 0x7f1614147f30 2023-09-13T06:13:48.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.667+0000 7f161c1fa640 1 -- 172.21.15.130:0/1170668587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16140618a0 con 0x7f1614147f30 2023-09-13T06:13:48.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.667+0000 7f160a7fc640 1 -- 172.21.15.130:0/1170668587 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1604013470 con 0x7f1614147f30 2023-09-13T06:13:48.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.667+0000 7f160a7fc640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 0x7f15f8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:13:48.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.667+0000 7f160a7fc640 1 -- 172.21.15.130:0/1170668587 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f16040831b0 con 0x7f1614147f30 2023-09-13T06:13:48.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.667+0000 7f1619f96640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 0x7f15f8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:13:48.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.667+0000 7f1619f96640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 0x7f15f8067fe0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f16100ad000 tx=0x7f1610008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:13:48.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.671+0000 7f160a7fc640 1 -- 172.21.15.130:0/1170668587 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1604050f70 con 0x7f1614147f30 2023-09-13T06:13:48.819 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.819+0000 7f161c1fa640 1 -- 172.21.15.130:0/1170668587 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f161416e650 con 0x7f15f8065b20 2023-09-13T06:13:48.820 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.819+0000 7f160a7fc640 1 -- 172.21.15.130:0/1170668587 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49800 (secure 0 0 0) 0x7f16100bc090 con 0x7f15f8065b20 2023-09-13T06:13:48.821 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:13:48.822 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:13:48.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 -- 172.21.15.130:0/1170668587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 msgr2=0x7f15f8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.823 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 0x7f15f8067fe0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f16100ad000 tx=0x7f1610008040 comp rx=0 tx=0).stop 2023-09-13T06:13:48.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 -- 172.21.15.130:0/1170668587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1614147f30 msgr2=0x7f1614160d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:13:48.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1614147f30 0x7f1614160d80 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f160400e930 tx=0x7f160400edf0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 -- 172.21.15.130:0/1170668587 shutdown_connections 2023-09-13T06:13:48.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f15f8065b20 0x7f15f8067fe0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.824 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1614148950 0x7f1614144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1614147f30 0x7f1614160d80 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 --2- 172.21.15.130:0/1170668587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1614147b50 0x7f1614163680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:13:48.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 -- 172.21.15.130:0/1170668587 >> 172.21.15.130:0/1170668587 conn(0x7f1614065990 msgr2=0x7f1614143d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:13:48.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 -- 172.21.15.130:0/1170668587 shutdown_connections 2023-09-13T06:13:48.825 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:13:48.823+0000 7f161c1fa640 1 -- 172.21.15.130:0/1170668587 wait complete. 2023-09-13T06:13:48.842 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":563,"stamp":"2023-09-13T06:13:48.703217+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552753,"statfs":{"total":1600000000,"available":1590019888,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.688016"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":357,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-09-13T06:13:40.029498+0000","last_change":"2023-09-13T06:01:16.138585+0000","last_active":"2023-09-13T06:13:40.029498+0000","last_peered":"2023-09-13T06:13:40.029498+0000","last_clean":"2023-09-13T06:13:40.029498+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:13:40.029498+0000","last_undegraded":"2023-09-13T06:13:40.029498+0000","last_fullsized":"2023-09-13T06:13:40.029498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T06:01:15.114493+0000","last_clean_scrub_stamp":"2023-09-13T06:01:15.114493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193661,"statfs":{"total":200000000,"available":198309710,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.72599999999999998,"15min":0.70299999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":0.91700000000000004,"5min":1.0589999999999999,"15min":1.3320000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73299999999999998,"15min":0.70599999999999996},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":0.83599999999999997,"5min":1.0089999999999999,"15min":1.0649999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88400000000000001,"5min":0.96199999999999997,"15min":0.999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.34999999999999998},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":1.0960000000000001},"last":0.90900000000000003}]},{"osd":2,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.877,"15min":1.395},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.42899999999999999},"max":{"1min":0.95099999999999996,"5min":0.96199999999999997,"15min":1.2030000000000001},"last":0.68899999999999995}]},{"osd":3,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.47599999999999998},"max":{"1min":0.89400000000000002,"5min":0.97999999999999998,"15min":1.357},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.60099999999999998,"5min":0.51400000000000001,"15min":0.48899999999999999},"max":{"1min":0.92200000000000004,"5min":1.0149999999999999,"15min":1.2629999999999999},"last":0.78200000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.316},"max":{"1min":0.85299999999999998,"5min":0.89300000000000002,"15min":0.95899999999999996},"last":0.75},{"interface":"front","average":{"1min":0.625,"5min":0.63300000000000001,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.018},"last":0.81100000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.65700000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.35199999999999998},"max":{"1min":0.86799999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.371},"max":{"1min":0.93500000000000005,"5min":1.004,"15min":1.1319999999999999},"last":0.88200000000000001}]},{"osd":6,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.42099999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.0920000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71299999999999997,"15min":0.69599999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46600000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.72999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.49099999999999999,"5min":0.44500000000000001,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":1.1439999999999999,"15min":1.181},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72499999999999998,"15min":0.69799999999999995},"min":{"1min":0.51600000000000001,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.91800000000000004,"5min":1.008,"15min":1.028},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71899999999999997,"15min":0.69899999999999995},"min":{"1min":0.61599999999999999,"5min":0.439,"15min":0.35499999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0840000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.44400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":1.0900000000000001,"15min":1.153},"last":0.79800000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75600000000000001,"15min":0.72799999999999998},"min":{"1min":0.58299999999999996,"5min":0.53700000000000003,"15min":0.39300000000000002},"max":{"1min":0.98899999999999999,"5min":1.0569999999999999,"15min":1.4750000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.49299999999999999,"15min":0.39000000000000001},"max":{"1min":0.93899999999999995,"5min":1.0229999999999999,"15min":1.085},"last":0.77900000000000003}]},{"osd":3,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77400000000000002,"15min":0.76100000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.47499999999999998},"max":{"1min":1.0649999999999999,"5min":1.222,"15min":1.222},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.58999999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.526},"last":0.67800000000000005}]},{"osd":4,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.315},"max":{"1min":0.88700000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.52200000000000002}]},{"osd":5,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.312},"max":{"1min":0.86599999999999999,"5min":1.198,"15min":1.198},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66200000000000003,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.32800000000000001},"max":{"1min":0.88800000000000001,"5min":1.254,"15min":1.254},"last":0.70399999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.505,"5min":0.45700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95899999999999996,"5min":1.1639999999999999,"15min":4.3879999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51700000000000002,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.90800000000000003,"5min":1.056,"15min":1.133},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.32000000000000001},"max":{"1min":0.81399999999999995,"5min":0.94699999999999995,"15min":1.0389999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70799999999999996,"15min":0.68600000000000005},"min":{"1min":0.52500000000000002,"5min":0.33500000000000002,"15min":0.30199999999999999},"max":{"1min":0.85999999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.72199999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74199999999999999,"15min":0.70499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71699999999999997,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.76700000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.71399999999999997},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.627},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.872,"5min":1.01,"15min":1.2729999999999999},"last":0.57999999999999996}]},{"osd":3,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.71099999999999997},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.96499999999999997,"15min":0.997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.749,"15min":0.72199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47099999999999997},"max":{"1min":0.85199999999999998,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.67200000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.432,"5min":0.308,"15min":0.308},"max":{"1min":0.90900000000000003,"5min":0.96999999999999997,"15min":1.0169999999999999},"last":0.375},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.97499999999999998,"15min":1.077},"last":0.68799999999999994}]},{"osd":6,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90700000000000003,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":1.159,"15min":1.159},"last":0.61799999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73099999999999998,"15min":0.71799999999999997},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.41799999999999998},"max":{"1min":0.92400000000000004,"5min":1.171,"15min":1.171},"last":0.752},{"interface":"front","average":{"1min":0.749,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.48499999999999999},"max":{"1min":0.94299999999999995,"5min":1.413,"15min":1.413},"last":0.70199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68899999999999995,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.38},"max":{"1min":0.98999999999999999,"5min":1.038,"15min":1.145},"last":0.66000000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.69199999999999995},"min":{"1min":0.50800000000000001,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":0.94599999999999995,"5min":0.997,"15min":1.0960000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.68799999999999994},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.40500000000000003},"max":{"1min":0.93300000000000005,"5min":0.96399999999999997,"15min":1.0309999999999999},"last":0.623}]},{"osd":2,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73199999999999998,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":0.92600000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.748},"min":{"1min":0.57699999999999996,"5min":0.55500000000000005,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":1.056,"15min":1.056},"last":0.747}]},{"osd":3,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.39000000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.077},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76700000000000002,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.55400000000000005,"15min":0.40799999999999997},"max":{"1min":0.93600000000000005,"5min":0.94999999999999996,"15min":1.071},"last":0.72499999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64500000000000002,"15min":0.624},"min":{"1min":0.439,"5min":0.41499999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":1.01},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.41799999999999998,"15min":0.34699999999999998},"max":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":1.0960000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.44,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":0.94199999999999995,"15min":1.1930000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.437},"max":{"1min":0.95299999999999996,"5min":1.0169999999999999,"15min":1.123},"last":0.83199999999999996}]},{"osd":7,"last update":"Wed Sep 13 06:12:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.39200000000000002},"max":{"1min":0.93799999999999994,"5min":1.0009999999999999,"15min":1.26},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":0.98799999999999999,"15min":1.2390000000000001},"last":0.81499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45500000000000002,"15min":0.41999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.246},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.48299999999999998,"15min":0.45600000000000002},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.753,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.54600000000000004}]},{"osd":1,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.44500000000000001},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.502},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52800000000000002,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.67300000000000004,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.49099999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.36799999999999999,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78100000000000003},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.52100000000000002,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":1.046,"15min":1.284},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75900000000000001,"15min":0.72999999999999998},"min":{"1min":0.61399999999999999,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.86399999999999999,"5min":1.052,"15min":1.052},"last":0.65600000000000003}]},{"osd":5,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.56599999999999995,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":1.198,"15min":1.198},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.875,"5min":1.107,"15min":1.2270000000000001},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.73799999999999999},"min":{"1min":0.50600000000000001,"5min":0.48899999999999999,"15min":0.47499999999999998},"max":{"1min":0.89200000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53000000000000003},"max":{"1min":0.94599999999999995,"5min":1.1160000000000001,"15min":1.458},"last":0.72599999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.46100000000000002,"15min":0.45900000000000002},"max":{"1min":0.88300000000000001,"5min":1.1679999999999999,"15min":1.383},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79400000000000004,"15min":0.76500000000000001},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92900000000000005,"5min":1.1850000000000001,"15min":1.27},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.437,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.71899999999999997,"15min":10.401},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48099999999999998,"15min":0.45900000000000002},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.27400000000000002},"max":{"1min":0.70799999999999996,"5min":0.79700000000000004,"15min":5.4429999999999996},"last":0.40200000000000002}]},{"osd":1,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.59699999999999998,"5min":0.70099999999999996,"15min":5.2640000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51200000000000001,"15min":0.49399999999999999},"min":{"1min":0.372,"5min":0.35899999999999999,"15min":0.312},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":4.3369999999999997},"last":0.36799999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":6.0410000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.755,"5min":0.85099999999999998,"15min":6.1600000000000001},"last":0.503}]},{"osd":4,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79400000000000004,"15min":0.78100000000000003},"min":{"1min":0.58799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.94099999999999995,"5min":1.0880000000000001,"15min":5.4809999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79200000000000004,"15min":0.77600000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.44700000000000001},"max":{"1min":1.008,"5min":1.1200000000000001,"15min":4.0599999999999996},"last":0.85199999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":4.2089999999999996},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.501},"max":{"1min":1.0229999999999999,"5min":1.1399999999999999,"15min":5.5289999999999999},"last":0.82299999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.505,"15min":0.35099999999999998},"max":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":4.1609999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76800000000000002,"15min":0.74399999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0980000000000001,"15min":4.2380000000000004},"last":0.83599999999999997}]},{"osd":7,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.754},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.42699999999999999},"max":{"1min":0.999,"5min":1.159,"15min":4.2400000000000002},"last":0.875},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79800000000000004,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.48099999999999998},"max":{"1min":0.98799999999999999,"5min":1.0589999999999999,"15min":4.2649999999999997},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.55600000000000005,"5min":0.78100000000000003,"15min":2.4020000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.497,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27300000000000002},"max":{"1min":0.60999999999999999,"5min":0.78100000000000003,"15min":0.81100000000000005},"last":0.29799999999999999}]},{"osd":2,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.47799999999999998},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":0.63500000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.53000000000000003,"15min":0.495},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.86299999999999999,"15min":0.94199999999999995},"last":0.33800000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56299999999999994,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.39600000000000002,"15min":0.379},"max":{"1min":0.65200000000000002,"5min":0.86399999999999999,"15min":0.88},"last":0.373},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":4.0599999999999996},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.74399999999999999},"min":{"1min":0.57799999999999996,"5min":0.52200000000000002,"15min":0.40400000000000003},"max":{"1min":0.94099999999999995,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.75},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":1.121,"15min":1.2150000000000001},"last":0.67800000000000005}]},{"osd":5,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77900000000000003,"15min":0.754},"min":{"1min":0.56000000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79100000000000004,"15min":0.76000000000000001},"min":{"1min":0.628,"5min":0.50800000000000001,"15min":0.42999999999999999},"max":{"1min":1.04,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.77500000000000002,"15min":0.753},"min":{"1min":0.623,"5min":0.496,"15min":0.39900000000000002},"max":{"1min":1,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.76600000000000001},"min":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.46100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0640000000000001,"15min":1.3799999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79100000000000004,"15min":0.75600000000000001},"min":{"1min":0.56999999999999995,"5min":0.48299999999999998,"15min":0.42599999999999999},"max":{"1min":0.95999999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78300000000000003,"15min":0.76400000000000001},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.41699999999999998},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.2769999999999999},"last":0.58099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193661,"statfs":{"total":200000000,"available":198309710,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.45400000000000001,"15min":0.45100000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.754,"15min":2.0190000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.82099999999999995,"15min":2.294},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.28999999999999998},"max":{"1min":0.76200000000000001,"5min":0.78700000000000003,"15min":2.2410000000000001},"last":0.376},{"interface":"front","average":{"1min":0.442,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":2.056},"last":0.35999999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.32500000000000001,"15min":0.29099999999999998},"max":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":2.0859999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":0.81000000000000005,"15min":2.3820000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.74199999999999999},"min":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.436},"max":{"1min":1.0049999999999999,"5min":1.103,"15min":2.1749999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.436},"max":{"1min":0.93300000000000005,"5min":1.0549999999999999,"15min":2.3370000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76800000000000002,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.41399999999999998},"max":{"1min":0.97899999999999998,"5min":1.2609999999999999,"15min":2.3119999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99099999999999999,"5min":1.145,"15min":2.1469999999999998},"last":0.621}]},{"osd":6,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.59699999999999998,"5min":0.54600000000000004,"15min":0.47699999999999998},"max":{"1min":1.038,"5min":1.0820000000000001,"15min":2.415},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.76500000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.41499999999999998},"max":{"1min":0.97199999999999998,"5min":1.198,"15min":2.347},"last":0.77100000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.78300000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.2130000000000001,"15min":2.367},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94799999999999995,"5min":1.0489999999999999,"15min":2.1179999999999999},"last":0.59999999999999998}]}]}],"pool_statfs":[]}} 2023-09-13T06:13:48.846 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-13T06:01:15.114493+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=1, tm_sec=15, tm_wday=2, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=43, tm_wday=2, tm_yday=256, tm_isdst=0) 2023-09-13T06:13:48.846 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-13T06:14:08.848 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T06:14:08.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a26cec640 1 Processor -- start 2023-09-13T06:14:08.996 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a26cec640 1 -- start start 2023-09-13T06:14:08.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a26cec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a200d1090 0x7f9a2015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:08.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a26cec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200b63c0 con 0x7f9a200d1750 2023-09-13T06:14:08.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a26cec640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200d0c20 con 0x7f9a20146f30 2023-09-13T06:14:08.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a26cec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2015dea0 con 0x7f9a200d1090 2023-09-13T06:14:08.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a24a88640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9a200d1750 0x7f9a20146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:47982/0 (socket says 172.21.15.130:47982) 2023-09-13T06:14:08.998 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a24a88640 1 -- 172.21.15.130:0/2217790197 learned_addr learned my addr 172.21.15.130:0/2217790197 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:14:09.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800523408 0 0) 0x7f9a200b63c0 con 0x7f9a200d1750 2023-09-13T06:14:09.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a10003530 con 0x7f9a200d1750 2023-09-13T06:14:09.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1ffff640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a200d1090 0x7f9a2015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1011842188 0 0) 0x7f9a10003530 con 0x7f9a200d1750 2023-09-13T06:14:09.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a200d1090 msgr2=0x7f9a2015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:14:09.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a200d1090 0x7f9a2015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 >> v1:172.21.15.164:6789/0 conn(0x7f9a20146f30 legacy=0x7f9a200b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a200b6610 con 0x7f9a200d1750 2023-09-13T06:14:09.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 <== mon.0 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3536042911 0 0) 0x7f9a14001680 con 0x7f9a200d1750 2023-09-13T06:14:09.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 >> v1:172.21.15.130:6789/0 conn(0x7f9a200d1750 legacy=0x7f9a20146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a10003a20 0x7f9a10003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a100047d0 0x7f9a10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a200d1090 0x7f9a1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100054c0 con 0x7f9a10003a20 2023-09-13T06:14:09.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a10005630 con 0x7f9a100047d0 2023-09-13T06:14:09.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.995+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1000bf00 con 0x7f9a200d1090 2023-09-13T06:14:09.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a24a88640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a10003a20 0x7f9a10003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a25289640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a200d1090 0x7f9a1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a1ffff640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a100047d0 0x7f9a10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a24a88640 1 -- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a200d1090 msgr2=0x7f9a1000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:14:09.003 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a24a88640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a200d1090 0x7f9a1000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a24a88640 1 -- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a100047d0 msgr2=0x7f9a10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T06:14:09.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a24a88640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a100047d0 0x7f9a10004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a24a88640 1 -- 172.21.15.130:0/2217790197 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10003530 con 0x7f9a10003a20 2023-09-13T06:14:09.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a1ffff640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a100047d0 0x7f9a10004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T06:14:09.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a24a88640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a10003a20 0x7f9a10003e40 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c0e0 tx=0x7f9a1401cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a6086dec4f65c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:14:09.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14005ae0 con 0x7f9a10003a20 2023-09-13T06:14:09.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14005c40 con 0x7f9a10003a20 2023-09-13T06:14:09.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:08.999+0000 7f9a1f7fe640 1 -- 172.21.15.130:0/2217790197 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14007070 con 0x7f9a10003a20 2023-09-13T06:14:09.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 -- 172.21.15.130:0/2217790197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a10003a20 msgr2=0x7f9a10003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 --2- 172.21.15.130:0/2217790197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a10003a20 0x7f9a10003e40 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c0e0 tx=0x7f9a1401cb30 comp rx=0 tx=0).stop 2023-09-13T06:14:09.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a25289640 1 -- 172.21.15.130:0/2217790197 reap_dead start 2023-09-13T06:14:09.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 -- 172.21.15.130:0/2217790197 shutdown_connections 2023-09-13T06:14:09.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 -- 172.21.15.130:0/2217790197 >> 172.21.15.130:0/2217790197 conn(0x7f9a2006f170 msgr2=0x7f9a2006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:14:09.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 -- 172.21.15.130:0/2217790197 shutdown_connections 2023-09-13T06:14:09.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 -- 172.21.15.130:0/2217790197 wait complete. 2023-09-13T06:14:09.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 Processor -- start 2023-09-13T06:14:09.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 -- start start 2023-09-13T06:14:09.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a10003a20 0x7f9a20167560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a2015ceb0 0x7f9a20162fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a2015d2f0 0x7f9a200c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2013fb40 con 0x7f9a2015d2f0 2023-09-13T06:14:09.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20167b60 con 0x7f9a2015ceb0 2023-09-13T06:14:09.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a26cec640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20167e40 con 0x7f9a10003a20 2023-09-13T06:14:09.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a25289640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a2015d2f0 0x7f9a200c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a25289640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a2015d2f0 0x7f9a200c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60532/0 (socket says 172.21.15.130:60532) 2023-09-13T06:14:09.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a25289640 1 -- 172.21.15.130:0/211216289 learned_addr learned my addr 172.21.15.130:0/211216289 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:14:09.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a25289640 1 -- 172.21.15.130:0/211216289 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a10003a20 msgr2=0x7f9a20167560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.011 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.003+0000 7f9a25289640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a10003a20 0x7f9a20167560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a25289640 1 -- 172.21.15.130:0/211216289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a2015ceb0 msgr2=0x7f9a20162fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a25289640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a2015ceb0 0x7f9a20162fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a25289640 1 -- 172.21.15.130:0/211216289 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20168120 con 0x7f9a2015d2f0 2023-09-13T06:14:09.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a25289640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a2015d2f0 0x7f9a200c88f0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f9a200d2c50 tx=0x7f9a1800fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:14:09.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a1d7fa640 1 -- 172.21.15.130:0/211216289 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18006d70 con 0x7f9a2015d2f0 2023-09-13T06:14:09.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a1d7fa640 1 -- 172.21.15.130:0/211216289 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a18003980 con 0x7f9a2015d2f0 2023-09-13T06:14:09.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a1d7fa640 1 -- 172.21.15.130:0/211216289 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18003d30 con 0x7f9a2015d2f0 2023-09-13T06:14:09.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a26cec640 1 -- 172.21.15.130:0/211216289 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a20163520 con 0x7f9a2015d2f0 2023-09-13T06:14:09.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a26cec640 1 -- 172.21.15.130:0/211216289 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a200c9000 con 0x7f9a2015d2f0 2023-09-13T06:14:09.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a26cec640 1 -- 172.21.15.130:0/211216289 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2015e5e0 con 0x7f9a2015d2f0 2023-09-13T06:14:09.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a1d7fa640 1 -- 172.21.15.130:0/211216289 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9a18005070 con 0x7f9a2015d2f0 2023-09-13T06:14:09.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a1d7fa640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9a04065b20 0x7f9a04067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a1d7fa640 1 -- 172.21.15.130:0/211216289 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9a18082560 con 0x7f9a2015d2f0 2023-09-13T06:14:09.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.007+0000 7f9a24a88640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9a04065b20 0x7f9a04067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.011+0000 7f9a24a88640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9a04065b20 0x7f9a04067fe0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9a140ab000 tx=0x7f9a14001940 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:14:09.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.011+0000 7f9a1d7fa640 1 -- 172.21.15.130:0/211216289 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9a18050080 con 0x7f9a2015d2f0 2023-09-13T06:14:09.159 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.159+0000 7f9a26cec640 1 -- 172.21.15.130:0/211216289 --> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a2013f9c0 con 0x7f9a04065b20 2023-09-13T06:14:09.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.159+0000 7f9a1d7fa640 1 -- 172.21.15.130:0/211216289 <== mgr.4105 v2:172.21.15.130:6832/2737069497 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49847 (secure 0 0 0) 0x7f9a14000ee0 con 0x7f9a04065b20 2023-09-13T06:14:09.162 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:14:09.162 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-09-13T06:14:09.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 -- 172.21.15.130:0/211216289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9a04065b20 msgr2=0x7f9a04067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9a04065b20 0x7f9a04067fe0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9a140ab000 tx=0x7f9a14001940 comp rx=0 tx=0).stop 2023-09-13T06:14:09.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 -- 172.21.15.130:0/211216289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a2015d2f0 msgr2=0x7f9a200c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a2015d2f0 0x7f9a200c88f0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f9a200d2c50 tx=0x7f9a1800fcd0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 -- 172.21.15.130:0/211216289 shutdown_connections 2023-09-13T06:14:09.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f9a04065b20 0x7f9a04067fe0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a2015ceb0 0x7f9a20162fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a2015d2f0 0x7f9a200c88f0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 --2- 172.21.15.130:0/211216289 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a10003a20 0x7f9a20167560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 -- 172.21.15.130:0/211216289 >> 172.21.15.130:0/211216289 conn(0x7f9a2006f170 msgr2=0x7f9a20142c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:14:09.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 -- 172.21.15.130:0/211216289 shutdown_connections 2023-09-13T06:14:09.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.163+0000 7f9a26cec640 1 -- 172.21.15.130:0/211216289 wait complete. 2023-09-13T06:14:09.182 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":573,"stamp":"2023-09-13T06:14:08.707573+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552753,"statfs":{"total":1600000000,"available":1590019888,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002631"},"pg_stats":[{"pgid":"1.0","version":"194'119","reported_seq":367,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-09-13T06:13:49.557404+0000","last_change":"2023-09-13T06:13:49.557453+0000","last_active":"2023-09-13T06:13:49.557404+0000","last_peered":"2023-09-13T06:13:49.557404+0000","last_clean":"2023-09-13T06:13:49.557404+0000","last_became_active":"2023-09-13T06:01:16.138392+0000","last_became_peered":"2023-09-13T06:01:16.138392+0000","last_unstale":"2023-09-13T06:13:49.557404+0000","last_undegraded":"2023-09-13T06:13:49.557404+0000","last_fullsized":"2023-09-13T06:13:49.557404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"194'119","last_scrub_stamp":"2023-09-13T06:13:49.557366+0000","last_deep_scrub":"194'119","last_deep_scrub_stamp":"2023-09-13T06:13:49.557366+0000","last_clean_scrub_stamp":"2023-09-13T06:13:49.557366+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:30:17.172482+0000","scrub_duration":0.0026656599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193661,"statfs":{"total":200000000,"available":198309710,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.72599999999999998,"15min":0.70299999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":0.91700000000000004,"5min":1.0589999999999999,"15min":1.3320000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73299999999999998,"15min":0.70599999999999996},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.375},"max":{"1min":0.83599999999999997,"5min":1.0089999999999999,"15min":1.0649999999999999},"last":0.77800000000000002}]},{"osd":1,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88400000000000001,"5min":0.96199999999999997,"15min":0.999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.34999999999999998},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":1.0960000000000001},"last":0.69899999999999995}]},{"osd":2,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.877,"15min":1.395},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.42899999999999999},"max":{"1min":0.95099999999999996,"5min":0.96199999999999997,"15min":1.2030000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.47599999999999998},"max":{"1min":0.89400000000000002,"5min":0.97999999999999998,"15min":1.357},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.60099999999999998,"5min":0.51400000000000001,"15min":0.48899999999999999},"max":{"1min":0.92200000000000004,"5min":1.0149999999999999,"15min":1.2629999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.316},"max":{"1min":0.85299999999999998,"5min":0.89300000000000002,"15min":0.95899999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.63300000000000001,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.018},"last":0.504}]},{"osd":5,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.65700000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.35199999999999998},"max":{"1min":0.86799999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.371},"max":{"1min":0.93500000000000005,"5min":1.004,"15min":1.1319999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.42099999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.0920000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71299999999999997,"15min":0.69599999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46600000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.49099999999999999,"5min":0.44500000000000001,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":1.1439999999999999,"15min":1.181},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72499999999999998,"15min":0.69799999999999995},"min":{"1min":0.51600000000000001,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.91800000000000004,"5min":1.008,"15min":1.028},"last":0.93899999999999995}]},{"osd":1,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71899999999999997,"15min":0.69899999999999995},"min":{"1min":0.61599999999999999,"5min":0.439,"15min":0.35499999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0840000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.44400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":1.0900000000000001,"15min":1.153},"last":0.79600000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75600000000000001,"15min":0.72799999999999998},"min":{"1min":0.58299999999999996,"5min":0.53700000000000003,"15min":0.39300000000000002},"max":{"1min":0.98899999999999999,"5min":1.0569999999999999,"15min":1.4750000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.71199999999999997},"min":{"1min":0.505,"5min":0.49299999999999999,"15min":0.39000000000000001},"max":{"1min":0.93899999999999995,"5min":1.0229999999999999,"15min":1.085},"last":0.76300000000000001}]},{"osd":3,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77400000000000002,"15min":0.76100000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.47499999999999998},"max":{"1min":1.0649999999999999,"5min":1.222,"15min":1.222},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.76900000000000002},"min":{"1min":0.58999999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.526},"last":0.96599999999999997}]},{"osd":4,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.315},"max":{"1min":0.88700000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.312},"max":{"1min":0.86599999999999999,"5min":1.198,"15min":1.198},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66200000000000003,"15min":0.68200000000000005},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.32800000000000001},"max":{"1min":0.88800000000000001,"5min":1.254,"15min":1.254},"last":0.59799999999999998}]},{"osd":7,"last update":"Wed Sep 13 06:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.505,"5min":0.45700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95899999999999996,"5min":1.1639999999999999,"15min":4.3879999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51700000000000002,"5min":0.443,"15min":0.40799999999999997},"max":{"1min":0.90800000000000003,"5min":1.056,"15min":1.133},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.32000000000000001},"max":{"1min":0.81399999999999995,"5min":0.94699999999999995,"15min":1.0389999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70799999999999996,"15min":0.68600000000000005},"min":{"1min":0.52500000000000002,"5min":0.33500000000000002,"15min":0.30199999999999999},"max":{"1min":0.85999999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.71699999999999997}]},{"osd":1,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74199999999999999,"15min":0.70499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71699999999999997,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80000000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.71399999999999997},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.872,"5min":1.01,"15min":1.2729999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.71099999999999997},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.96499999999999997,"15min":0.997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.749,"15min":0.72199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47099999999999997},"max":{"1min":0.85199999999999998,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73999999999999999}]},{"osd":4,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.432,"5min":0.308,"15min":0.308},"max":{"1min":0.90900000000000003,"5min":0.96999999999999997,"15min":1.0169999999999999},"last":0.439},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.97499999999999998,"15min":1.077},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90700000000000003,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.54100000000000004,"5min":0.39600000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":1.159,"15min":1.159},"last":0.49099999999999999}]},{"osd":7,"last update":"Wed Sep 13 06:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73099999999999998,"15min":0.71799999999999997},"min":{"1min":0.502,"5min":0.45100000000000001,"15min":0.41799999999999998},"max":{"1min":0.92400000000000004,"5min":1.171,"15min":1.171},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.48499999999999999},"max":{"1min":0.94299999999999995,"5min":1.413,"15min":1.413},"last":0.60899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68000000000000005,"15min":0.65800000000000003},"min":{"1min":0.45500000000000002,"5min":0.438,"15min":0.34999999999999998},"max":{"1min":0.81799999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70399999999999996,"15min":0.68700000000000006},"min":{"1min":0.51300000000000001,"5min":0.436,"15min":0.38},"max":{"1min":0.94999999999999996,"5min":0.98999999999999999,"15min":1.145},"last":0.80900000000000005}]},{"osd":1,"last update":"Wed Sep 13 06:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72999999999999998,"15min":0.69299999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.86599999999999999,"5min":0.997,"15min":1.0960000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70699999999999996,"15min":0.68799999999999994},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82499999999999996,"5min":0.94099999999999995,"15min":1.0309999999999999},"last":0.92100000000000004}]},{"osd":2,"last update":"Wed Sep 13 06:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71999999999999997,"15min":0.69099999999999995},"min":{"1min":0.52800000000000002,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":0.84499999999999997,"5min":0.92600000000000005,"15min":0.96199999999999997},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76700000000000002,"15min":0.746},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.40600000000000003},"max":{"1min":0.84399999999999997,"5min":0.98899999999999999,"15min":1.056},"last":0.89500000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.72999999999999998},"min":{"1min":0.57699999999999996,"5min":0.48899999999999999,"15min":0.39000000000000001},"max":{"1min":0.90500000000000003,"5min":0.97499999999999998,"15min":1.077},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.40799999999999997},"max":{"1min":0.82899999999999996,"5min":0.94299999999999995,"15min":1.071},"last":0.875}]},{"osd":5,"last update":"Wed Sep 13 06:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.624},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.373},"max":{"1min":0.88,"5min":0.91800000000000004,"15min":1.01},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64500000000000002,"15min":0.66200000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.34699999999999998},"max":{"1min":0.88300000000000001,"5min":0.93700000000000006,"15min":1.0960000000000001},"last":0.58099999999999996}]},{"osd":6,"last update":"Wed Sep 13 06:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.45500000000000002,"5min":0.44,"15min":0.32500000000000001},"max":{"1min":0.91700000000000004,"5min":0.94199999999999995,"15min":1.1930000000000001},"last":0.628},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.501,"5min":0.47299999999999998,"15min":0.437},"max":{"1min":0.89900000000000002,"5min":0.95299999999999996,"15min":1.123},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.71999999999999997},"min":{"1min":0.51800000000000002,"5min":0.48499999999999999,"15min":0.39200000000000002},"max":{"1min":0.94099999999999995,"5min":0.98299999999999998,"15min":1.26},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.2390000000000001},"last":0.73799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45500000000000002,"15min":0.41999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.246},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.48299999999999998,"15min":0.45600000000000002},"min":{"1min":0.33700000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.753,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.44500000000000001},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52800000000000002,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.67300000000000004,"5min":0.74299999999999999,"15min":0.76000000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78800000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.36799999999999999,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78100000000000003},"last":0.59999999999999998}]},{"osd":4,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.52100000000000002,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":1.046,"15min":1.284},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75900000000000001,"15min":0.72999999999999998},"min":{"1min":0.61399999999999999,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.86399999999999999,"5min":1.052,"15min":1.052},"last":0.91700000000000004}]},{"osd":5,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.74299999999999999},"min":{"1min":0.58699999999999997,"5min":0.56599999999999995,"15min":0.442},"max":{"1min":0.84999999999999998,"5min":1.198,"15min":1.198},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.875,"5min":1.107,"15min":1.2270000000000001},"last":0.875}]},{"osd":6,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.73799999999999999},"min":{"1min":0.50600000000000001,"5min":0.48899999999999999,"15min":0.47499999999999998},"max":{"1min":0.89200000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.53000000000000003},"max":{"1min":0.94599999999999995,"5min":1.1160000000000001,"15min":1.458},"last":0.89300000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.46100000000000002,"15min":0.45900000000000002},"max":{"1min":0.88300000000000001,"5min":1.1679999999999999,"15min":1.383},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79400000000000004,"15min":0.76500000000000001},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92900000000000005,"5min":1.1850000000000001,"15min":1.27},"last":0.85199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.437,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.57899999999999996,"5min":0.71899999999999997,"15min":10.401},"last":0.315},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48099999999999998,"15min":0.45900000000000002},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.27400000000000002},"max":{"1min":0.70799999999999996,"5min":0.79700000000000004,"15min":5.4429999999999996},"last":0.34999999999999998}]},{"osd":1,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.59699999999999998,"5min":0.70099999999999996,"15min":5.2640000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51200000000000001,"15min":0.49399999999999999},"min":{"1min":0.372,"5min":0.35899999999999999,"15min":0.312},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":4.3369999999999997},"last":0.501}]},{"osd":3,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.311},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":6.0410000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38600000000000001},"max":{"1min":0.755,"5min":0.85099999999999998,"15min":6.1600000000000001},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79400000000000004,"15min":0.78100000000000003},"min":{"1min":0.58799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.94099999999999995,"5min":1.0880000000000001,"15min":5.4809999999999999},"last":0.752},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79200000000000004,"15min":0.77600000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.44700000000000001},"max":{"1min":1.008,"5min":1.1200000000000001,"15min":4.0599999999999996},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.5,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":4.2089999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.501},"max":{"1min":1.0229999999999999,"5min":1.1399999999999999,"15min":5.5289999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.505,"15min":0.35099999999999998},"max":{"1min":0.96999999999999997,"5min":1.0840000000000001,"15min":4.1609999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76800000000000002,"15min":0.74399999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0980000000000001,"15min":4.2380000000000004},"last":0.77300000000000002}]},{"osd":7,"last update":"Wed Sep 13 06:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.754},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.42699999999999999},"max":{"1min":0.999,"5min":1.159,"15min":4.2400000000000002},"last":0.624},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79800000000000004,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.48099999999999998},"max":{"1min":0.98799999999999999,"5min":1.0589999999999999,"15min":4.2649999999999997},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1074,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194238,"statfs":{"total":200000000,"available":198900078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.252},"max":{"1min":0.55600000000000005,"5min":0.78100000000000003,"15min":2.4020000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.497,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27300000000000002},"max":{"1min":0.60999999999999999,"5min":0.78100000000000003,"15min":0.81100000000000005},"last":0.627}]},{"osd":2,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.47799999999999998},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.318},"max":{"1min":0.63500000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.75},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.53000000000000003,"15min":0.495},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.86299999999999999,"15min":0.94199999999999995},"last":0.72399999999999998}]},{"osd":3,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56299999999999994,"15min":0.54200000000000004},"min":{"1min":0.40799999999999997,"5min":0.39600000000000002,"15min":0.379},"max":{"1min":0.65200000000000002,"5min":0.86399999999999999,"15min":0.88},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":4.0599999999999996},"last":0.70199999999999996}]},{"osd":4,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.74399999999999999},"min":{"1min":0.57799999999999996,"5min":0.52200000000000002,"15min":0.40400000000000003},"max":{"1min":0.94099999999999995,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.75},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":1.121,"15min":1.2150000000000001},"last":0.83399999999999996}]},{"osd":5,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77900000000000003,"15min":0.754},"min":{"1min":0.56000000000000005,"5min":0.443,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79100000000000004,"15min":0.76000000000000001},"min":{"1min":0.628,"5min":0.50800000000000001,"15min":0.42999999999999999},"max":{"1min":1.04,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.77500000000000002,"15min":0.753},"min":{"1min":0.623,"5min":0.496,"15min":0.39900000000000002},"max":{"1min":1,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.76600000000000001},"min":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.46100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0640000000000001,"15min":1.3799999999999999},"last":0.91600000000000004}]},{"osd":7,"last update":"Wed Sep 13 06:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79100000000000004,"15min":0.75600000000000001},"min":{"1min":0.56999999999999995,"5min":0.48299999999999998,"15min":0.42599999999999999},"max":{"1min":0.95999999999999996,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78300000000000003,"15min":0.76400000000000001},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.41699999999999998},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.2769999999999999},"last":0.875}]}]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193661,"statfs":{"total":200000000,"available":198309710,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.45400000000000001,"15min":0.45100000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.754,"15min":2.0190000000000001},"last":0.371},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":0.72399999999999998,"5min":0.82099999999999995,"15min":2.294},"last":0.38800000000000001}]},{"osd":2,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.28999999999999998},"max":{"1min":0.76200000000000001,"5min":0.78700000000000003,"15min":2.2410000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":2.056},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.32500000000000001,"15min":0.29099999999999998},"max":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":2.0859999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":0.81000000000000005,"15min":2.3820000000000001},"last":0.66700000000000004}]},{"osd":4,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.74199999999999999},"min":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.436},"max":{"1min":1.0049999999999999,"5min":1.103,"15min":2.1749999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.436},"max":{"1min":0.93300000000000005,"5min":1.0549999999999999,"15min":2.3370000000000002},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76800000000000002,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.41399999999999998},"max":{"1min":0.97899999999999998,"5min":1.2609999999999999,"15min":2.3119999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99099999999999999,"5min":1.145,"15min":2.1469999999999998},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.59699999999999998,"5min":0.54600000000000004,"15min":0.47699999999999998},"max":{"1min":1.038,"5min":1.0820000000000001,"15min":2.415},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.76500000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.41499999999999998},"max":{"1min":0.97199999999999998,"5min":1.198,"15min":2.347},"last":0.71899999999999997}]},{"osd":7,"last update":"Wed Sep 13 06:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.78300000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.2130000000000001,"15min":2.367},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94799999999999995,"5min":1.0489999999999999,"15min":2.1179999999999999},"last":0.68600000000000005}]}]}],"pool_statfs":[]}} 2023-09-13T06:14:09.185 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-13T06:14:09.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b23dfa640 1 Processor -- start 2023-09-13T06:14:09.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b23dfa640 1 -- start start 2023-09-13T06:14:09.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b23dfa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b1c0d0d10 0x7f1b1c1619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b23dfa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1c15dd40 con 0x7f1b1c0d2cd0 2023-09-13T06:14:09.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b23dfa640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1c15e020 con 0x7f1b1c15ae10 2023-09-13T06:14:09.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b23dfa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c15e300 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b21395640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1b1c0d2cd0 0x7f1b1c1612a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:47986/0 (socket says 172.21.15.130:47986) 2023-09-13T06:14:09.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b21395640 1 -- 172.21.15.130:0/2850968920 learned_addr learned my addr 172.21.15.130:0/2850968920 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:14:09.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b22397640 1 --2- 172.21.15.130:0/2850968920 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b1c0d0d10 0x7f1b1c1619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b20b94640 1 -- 172.21.15.130:0/2850968920 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020939248 0 0) 0x7f1b1c15dd40 con 0x7f1b1c0d2cd0 2023-09-13T06:14:09.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b20b94640 1 -- 172.21.15.130:0/2850968920 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b08003530 con 0x7f1b1c0d2cd0 2023-09-13T06:14:09.323 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b20b94640 1 -- 172.21.15.130:0/2850968920 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042054997 0 0) 0x7f1b1c15e020 con 0x7f1b1c15ae10 2023-09-13T06:14:09.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b20b94640 1 -- 172.21.15.130:0/2850968920 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b1c15dd40 con 0x7f1b1c15ae10 2023-09-13T06:14:09.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b22397640 1 -- 172.21.15.130:0/2850968920 >> v1:172.21.15.164:6789/0 conn(0x7f1b1c15ae10 legacy=0x7f1b1c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b20b94640 1 -- 172.21.15.130:0/2850968920 <== mon.0 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4104693876 0 0) 0x7f1b08003530 con 0x7f1b1c0d2cd0 2023-09-13T06:14:09.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b22397640 1 -- 172.21.15.130:0/2850968920 >> v1:172.21.15.130:6789/0 conn(0x7f1b1c0d2cd0 legacy=0x7f1b1c1612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.324 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.319+0000 7f1b22397640 1 -- 172.21.15.130:0/2850968920 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c15e5e0 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.323+0000 7f1b22397640 1 --2- 172.21.15.130:0/2850968920 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b1c0d0d10 0x7f1b1c1619b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009dc0 tx=0x7f1b1401c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e78585663fdf811a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:14:09.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.323+0000 7f1b20b94640 1 -- 172.21.15.130:0/2850968920 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c001680 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.323+0000 7f1b20b94640 1 -- 172.21.15.130:0/2850968920 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b140a5660 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.323+0000 7f1b20b94640 1 -- 172.21.15.130:0/2850968920 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b140a59f0 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.323+0000 7f1b23dfa640 1 -- 172.21.15.130:0/2850968920 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b1c0d0d10 msgr2=0x7f1b1c1619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.323+0000 7f1b23dfa640 1 --2- 172.21.15.130:0/2850968920 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b1c0d0d10 0x7f1b1c1619b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009dc0 tx=0x7f1b1401c800 comp rx=0 tx=0).stop 2023-09-13T06:14:09.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.323+0000 7f1b23dfa640 1 -- 172.21.15.130:0/2850968920 shutdown_connections 2023-09-13T06:14:09.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.323+0000 7f1b23dfa640 1 --2- 172.21.15.130:0/2850968920 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b1c0d0d10 0x7f1b1c1619b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.323+0000 7f1b23dfa640 1 -- 172.21.15.130:0/2850968920 >> 172.21.15.130:0/2850968920 conn(0x7f1b1c065990 msgr2=0x7f1b1c065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:14:09.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.323+0000 7f1b23dfa640 1 -- 172.21.15.130:0/2850968920 shutdown_connections 2023-09-13T06:14:09.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.323+0000 7f1b23dfa640 1 -- 172.21.15.130:0/2850968920 wait complete. 2023-09-13T06:14:09.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b23dfa640 1 Processor -- start 2023-09-13T06:14:09.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b23dfa640 1 -- start start 2023-09-13T06:14:09.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b23dfa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b1c0d0d10 0x7f1b1c159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.331 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b23dfa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b1c0d2cd0 0x7f1b1c150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b23dfa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b1c15ae10 0x7f1b1c150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b23dfa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c152f50 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b23dfa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c151500 con 0x7f1b1c15ae10 2023-09-13T06:14:09.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b23dfa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c1531a0 con 0x7f1b1c0d2cd0 2023-09-13T06:14:09.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b21b96640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b1c0d0d10 0x7f1b1c159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.332 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b21b96640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b1c0d0d10 0x7f1b1c159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60536/0 (socket says 172.21.15.130:60536) 2023-09-13T06:14:09.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b21b96640 1 -- 172.21.15.130:0/65597200 learned_addr learned my addr 172.21.15.130:0/65597200 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:14:09.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b21b96640 1 -- 172.21.15.130:0/65597200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b1c0d2cd0 msgr2=0x7f1b1c150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b21b96640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b1c0d2cd0 0x7f1b1c150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b21b96640 1 -- 172.21.15.130:0/65597200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b1c15ae10 msgr2=0x7f1b1c150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.333 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b21b96640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b1c15ae10 0x7f1b1c150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b21b96640 1 -- 172.21.15.130:0/65597200 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b14009a70 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b21b96640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b1c0d0d10 0x7f1b1c159730 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800c430 tx=0x7f1b1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:14:09.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b127fc640 1 -- 172.21.15.130:0/65597200 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b180052d0 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b127fc640 1 -- 172.21.15.130:0/65597200 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b18005450 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.334 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b23dfa640 1 -- 172.21.15.130:0/65597200 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1c153480 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.327+0000 7f1b127fc640 1 -- 172.21.15.130:0/65597200 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18003840 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.331+0000 7f1b23dfa640 1 -- 172.21.15.130:0/65597200 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c153a40 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.331+0000 7f1b23dfa640 1 -- 172.21.15.130:0/65597200 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1c0618a0 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.331+0000 7f1b127fc640 1 -- 172.21.15.130:0/65597200 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1b180039a0 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.331+0000 7f1b127fc640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b00065b20 0x7f1b00067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.336 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.331+0000 7f1b127fc640 1 -- 172.21.15.130:0/65597200 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1b180826a0 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.331+0000 7f1b21395640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b00065b20 0x7f1b00067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.331+0000 7f1b21395640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b00065b20 0x7f1b00067fe0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c001350 tx=0x7f1b0c001280 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:14:09.337 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.335+0000 7f1b127fc640 1 -- 172.21.15.130:0/65597200 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1b18050250 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.487+0000 7f1b23dfa640 1 -- 172.21.15.130:0/65597200 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1b1c154dd0 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.491 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.491+0000 7f1b127fc640 1 -- 172.21.15.130:0/65597200 <== mon.0 v2:172.21.15.130:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1b18050250 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.492 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.491+0000 7f1b127fc640 1 -- 172.21.15.130:0/65597200 <== mon.0 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1b18053870 con 0x7f1b1c0d0d10 2023-09-13T06:14:09.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.491+0000 7f1b23dfa640 1 -- 172.21.15.130:0/65597200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b00065b20 msgr2=0x7f1b00067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.491+0000 7f1b23dfa640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b00065b20 0x7f1b00067fe0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c001350 tx=0x7f1b0c001280 comp rx=0 tx=0).stop 2023-09-13T06:14:09.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.491+0000 7f1b23dfa640 1 -- 172.21.15.130:0/65597200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b1c0d0d10 msgr2=0x7f1b1c159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.491+0000 7f1b23dfa640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b1c0d0d10 0x7f1b1c159730 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800c430 tx=0x7f1b1800c8f0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.495+0000 7f1b23dfa640 1 -- 172.21.15.130:0/65597200 shutdown_connections 2023-09-13T06:14:09.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.495+0000 7f1b23dfa640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7f1b00065b20 0x7f1b00067fe0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.495+0000 7f1b23dfa640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b1c15ae10 0x7f1b1c150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.495+0000 7f1b23dfa640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1b1c0d2cd0 0x7f1b1c150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.495+0000 7f1b23dfa640 1 --2- 172.21.15.130:0/65597200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b1c0d0d10 0x7f1b1c159730 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.495+0000 7f1b23dfa640 1 -- 172.21.15.130:0/65597200 >> 172.21.15.130:0/65597200 conn(0x7f1b1c065990 msgr2=0x7f1b1c1616c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:14:09.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.495+0000 7f1b23dfa640 1 -- 172.21.15.130:0/65597200 shutdown_connections 2023-09-13T06:14:09.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.495+0000 7f1b23dfa640 1 -- 172.21.15.130:0/65597200 wait complete. 2023-09-13T06:14:09.514 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T06:14:09.515 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T06:14:09.653 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.651+0000 7fb28efdb640 1 Processor -- start 2023-09-13T06:14:09.654 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.651+0000 7fb28efdb640 1 -- start start 2023-09-13T06:14:09.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb28efdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 0x7fb2880b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb28efdb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2880ccbe0 con 0x7fb2880cc780 2023-09-13T06:14:09.655 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb28efdb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2880ce980 con 0x7fb28815b130 2023-09-13T06:14:09.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb28efdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880b0e70 con 0x7fb2880b04a0 2023-09-13T06:14:09.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb287fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb2880cc780 0x7fb28815b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:47990/0 (socket says 172.21.15.130:47990) 2023-09-13T06:14:09.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb287fff640 1 -- 172.21.15.130:0/2002429949 learned_addr learned my addr 172.21.15.130:0/2002429949 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-09-13T06:14:09.656 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb28d578640 1 --2- 172.21.15.130:0/2002429949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 0x7fb2880b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb2877fe640 1 -- 172.21.15.130:0/2002429949 <== mon.0 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063013017 0 0) 0x7fb2880ccbe0 con 0x7fb2880cc780 2023-09-13T06:14:09.657 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb2877fe640 1 -- 172.21.15.130:0/2002429949 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb278003530 con 0x7fb2880cc780 2023-09-13T06:14:09.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb2877fe640 1 -- 172.21.15.130:0/2002429949 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169371124 0 0) 0x7fb2880ce980 con 0x7fb28815b130 2023-09-13T06:14:09.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb2877fe640 1 -- 172.21.15.130:0/2002429949 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2880ccbe0 con 0x7fb28815b130 2023-09-13T06:14:09.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb28d578640 1 -- 172.21.15.130:0/2002429949 >> v1:172.21.15.164:6789/0 conn(0x7fb28815b130 legacy=0x7fb2880ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb28d578640 1 -- 172.21.15.130:0/2002429949 >> v1:172.21.15.130:6789/0 conn(0x7fb2880cc780 legacy=0x7fb28815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.658 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.655+0000 7fb28d578640 1 -- 172.21.15.130:0/2002429949 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880cec60 con 0x7fb2880b04a0 2023-09-13T06:14:09.659 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb28d578640 1 --2- 172.21.15.130:0/2002429949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 0x7fb2880b0930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb280009dc0 tx=0x7fb28001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d01027fbe924e8c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:14:09.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb2877fe640 1 -- 172.21.15.130:0/2002429949 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800a5a00 con 0x7fb2880b04a0 2023-09-13T06:14:09.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb2877fe640 1 -- 172.21.15.130:0/2002429949 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb2800a5b60 con 0x7fb2880b04a0 2023-09-13T06:14:09.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb2877fe640 1 -- 172.21.15.130:0/2002429949 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800ad440 con 0x7fb2880b04a0 2023-09-13T06:14:09.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb28efdb640 1 -- 172.21.15.130:0/2002429949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 msgr2=0x7fb2880b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.660 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb28efdb640 1 --2- 172.21.15.130:0/2002429949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 0x7fb2880b0930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb280009dc0 tx=0x7fb28001c940 comp rx=0 tx=0).stop 2023-09-13T06:14:09.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb28efdb640 1 -- 172.21.15.130:0/2002429949 shutdown_connections 2023-09-13T06:14:09.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb28efdb640 1 --2- 172.21.15.130:0/2002429949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 0x7fb2880b0930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb28efdb640 1 -- 172.21.15.130:0/2002429949 >> 172.21.15.130:0/2002429949 conn(0x7fb288065990 msgr2=0x7fb288065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:14:09.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb28efdb640 1 -- 172.21.15.130:0/2002429949 shutdown_connections 2023-09-13T06:14:09.661 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb28efdb640 1 -- 172.21.15.130:0/2002429949 wait complete. 2023-09-13T06:14:09.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb28efdb640 1 Processor -- start 2023-09-13T06:14:09.662 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.659+0000 7fb28efdb640 1 -- start start 2023-09-13T06:14:09.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28efdb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 0x7fb28814beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28efdb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2880cc780 0x7fb2880b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28efdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb28815b130 0x7fb2880b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28efdb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb288150e00 con 0x7fb28815b130 2023-09-13T06:14:09.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28efdb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2881501f0 con 0x7fb2880cc780 2023-09-13T06:14:09.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28efdb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2881504d0 con 0x7fb2880b04a0 2023-09-13T06:14:09.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28d578640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb28815b130 0x7fb2880b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28d578640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb28815b130 0x7fb2880b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:60540/0 (socket says 172.21.15.130:60540) 2023-09-13T06:14:09.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28d578640 1 -- 172.21.15.130:0/3264847279 learned_addr learned my addr 172.21.15.130:0/3264847279 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-09-13T06:14:09.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb287fff640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2880cc780 0x7fb2880b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28d578640 1 -- 172.21.15.130:0/3264847279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 msgr2=0x7fb28814beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28cd77640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 0x7fb28814beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28d578640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 0x7fb28814beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28d578640 1 -- 172.21.15.130:0/3264847279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2880cc780 msgr2=0x7fb2880b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28d578640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2880cc780 0x7fb2880b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28d578640 1 -- 172.21.15.130:0/3264847279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280009a70 con 0x7fb28815b130 2023-09-13T06:14:09.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb287fff640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2880cc780 0x7fb2880b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:14:09.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28cd77640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 0x7fb28814beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T06:14:09.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28d578640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb28815b130 0x7fb2880b1f10 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fb2800b0040 tx=0x7fb2800196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:14:09.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb2857fa640 1 -- 172.21.15.130:0/3264847279 <== mon.0 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800adcc0 con 0x7fb28815b130 2023-09-13T06:14:09.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb2857fa640 1 -- 172.21.15.130:0/3264847279 <== mon.0 v2:172.21.15.130:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb2800ade20 con 0x7fb28815b130 2023-09-13T06:14:09.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb2857fa640 1 -- 172.21.15.130:0/3264847279 <== mon.0 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800b9690 con 0x7fb28815b130 2023-09-13T06:14:09.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28efdb640 1 -- 172.21.15.130:0/3264847279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2881507b0 con 0x7fb28815b130 2023-09-13T06:14:09.668 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28efdb640 1 -- 172.21.15.130:0/3264847279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2881f5260 con 0x7fb28815b130 2023-09-13T06:14:09.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb28efdb640 1 -- 172.21.15.130:0/3264847279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb288150c60 con 0x7fb28815b130 2023-09-13T06:14:09.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.663+0000 7fb2857fa640 1 -- 172.21.15.130:0/3264847279 <== mon.0 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb2800b97f0 con 0x7fb28815b130 2023-09-13T06:14:09.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.667+0000 7fb2857fa640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb26c065b20 0x7fb26c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T06:14:09.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.667+0000 7fb2857fa640 1 -- 172.21.15.130:0/3264847279 <== mon.0 v2:172.21.15.130:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb28011e810 con 0x7fb28815b130 2023-09-13T06:14:09.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.667+0000 7fb28cd77640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb26c065b20 0x7fb26c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T06:14:09.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.667+0000 7fb28cd77640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb26c065b20 0x7fb26c067fe0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0011f0 tx=0x7fb27c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T06:14:09.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.671+0000 7fb2857fa640 1 -- 172.21.15.130:0/3264847279 <== mon.0 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb288150c60 con 0x7fb28815b130 2023-09-13T06:14:09.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.847+0000 7fb28efdb640 1 -- 172.21.15.130:0/3264847279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb288150c60 con 0x7fb28815b130 2023-09-13T06:14:09.850 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb2857fa640 1 -- 172.21.15.130:0/3264847279 <== mon.0 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+3708 (secure 0 0 0) 0x7fb2800bde90 con 0x7fb28815b130 2023-09-13T06:14:09.851 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-09-13T06:14:09.851 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":94,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/519371055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":519371055},{"type":"v1","addr":"172.21.15.130:6837","nonce":519371055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2464101241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2464101241},{"type":"v1","addr":"172.21.15.130:6836","nonce":2464101241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/3066690343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":3066690343},{"type":"v1","addr":"172.21.15.164:6833","nonce":3066690343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":8572,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/4220642731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4220642731},{"type":"v1","addr":"172.21.15.164:6835","nonce":4220642731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":94}],"filesystems":[]} 2023-09-13T06:14:09.851 INFO:teuthology.orchestra.run.smithi130.stderr:dumped fsmap epoch 94 2023-09-13T06:14:09.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 -- 172.21.15.130:0/3264847279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb26c065b20 msgr2=0x7fb26c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb26c065b20 0x7fb26c067fe0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0011f0 tx=0x7fb27c009040 comp rx=0 tx=0).stop 2023-09-13T06:14:09.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 -- 172.21.15.130:0/3264847279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb28815b130 msgr2=0x7fb2880b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T06:14:09.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb28815b130 0x7fb2880b1f10 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fb2800b0040 tx=0x7fb2800196e0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 -- 172.21.15.130:0/3264847279 shutdown_connections 2023-09-13T06:14:09.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.130:6832/2737069497,v1:172.21.15.130:6833/2737069497] conn(0x7fb26c065b20 0x7fb26c067fe0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2880cc780 0x7fb2880b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb28815b130 0x7fb2880b1f10 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 --2- 172.21.15.130:0/3264847279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2880b04a0 0x7fb28814beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T06:14:09.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 -- 172.21.15.130:0/3264847279 >> 172.21.15.130:0/3264847279 conn(0x7fb288065990 msgr2=0x7fb28815d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T06:14:09.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 -- 172.21.15.130:0/3264847279 shutdown_connections 2023-09-13T06:14:09.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-09-13T06:14:09.851+0000 7fb28efdb640 1 -- 172.21.15.130:0/3264847279 wait complete. 2023-09-13T06:14:09.871 DEBUG:tasks.cephfs.filesystem:already dead... 2023-09-13T06:14:09.871 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-13T06:14:09.872 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T06:14:09.872 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:09.884 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T06:14:09.885 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T06:14:09.885 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:09.937 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T06:14:09.938 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T06:14:09.938 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:09.952 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T06:14:09.953 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T06:14:09.953 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.009 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T06:14:10.010 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-13T06:14:10.010 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-13T06:14:10.011 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.055 INFO:tasks.ceph.osd.0:Stopped 2023-09-13T06:14:10.055 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-13T06:14:10.055 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.111 INFO:tasks.ceph.osd.1:Stopped 2023-09-13T06:14:10.112 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-13T06:14:10.112 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.173 INFO:tasks.ceph.osd.2:Stopped 2023-09-13T06:14:10.174 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-13T06:14:10.174 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.216 INFO:tasks.ceph.osd.3:Stopped 2023-09-13T06:14:10.216 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-09-13T06:14:10.217 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.260 INFO:tasks.ceph.osd.4:Stopped 2023-09-13T06:14:10.261 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-09-13T06:14:10.261 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.297 INFO:tasks.ceph.osd.5:Stopped 2023-09-13T06:14:10.298 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-09-13T06:14:10.298 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.391 INFO:tasks.ceph.osd.6:Stopped 2023-09-13T06:14:10.392 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-09-13T06:14:10.392 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.434 INFO:tasks.ceph.osd.7:Stopped 2023-09-13T06:14:10.435 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-13T06:14:10.435 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-09-13T06:14:10.436 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.488 INFO:tasks.ceph.mgr.y:Stopped 2023-09-13T06:14:10.488 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-13T06:14:10.489 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.538 INFO:tasks.ceph.mgr.x:Stopped 2023-09-13T06:14:10.539 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-13T06:14:10.539 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-13T06:14:10.539 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.558 INFO:tasks.ceph.mon.a:Stopped 2023-09-13T06:14:10.558 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-13T06:14:10.558 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.575 INFO:tasks.ceph.mon.b:Stopped 2023-09-13T06:14:10.575 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-13T06:14:10.575 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T06:14:10.638 INFO:tasks.ceph.mon.c:Stopped 2023-09-13T06:14:10.639 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-13T06:14:10.639 DEBUG:teuthology.orchestra.run.smithi130:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-09-13T06:14:10.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-09-13T06:14:10.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-09-13T06:14:10.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-09-13T06:14:10.673 INFO:teuthology.orchestra.run.smithi130.stdout:2023-09-13T06:01:12.114787+0000 osd.2 (osd.2) 3 : cluster [WRN] OSD bench result of 139869.973143 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.2. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-09-13T06:14:10.674 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-09-13T06:14:10.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-09-13T06:14:10.757 DEBUG:teuthology.orchestra.run.smithi130:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-09-13T06:14:10.836 DEBUG:teuthology.orchestra.run.smithi130:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-09-13T06:14:10.915 INFO:teuthology.orchestra.run.smithi130.stdout:2023-09-13T06:01:12.114787+0000 osd.2 (osd.2) 3 : cluster [WRN] OSD bench result of 139869.973143 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.2. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-09-13T06:14:10.916 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:14:10.916 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-13T06:14:11.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:14:11.373 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-13T06:14:11.816 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:14:11.817 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-13T06:14:12.152 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:14:12.153 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-13T06:14:12.561 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:14:12.561 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-09-13T06:14:12.962 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:14:12.962 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-09-13T06:14:13.405 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:14:13.406 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-09-13T06:14:13.774 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:14:13.774 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-09-13T06:14:14.230 INFO:tasks.ceph:Archiving mon data... 2023-09-13T06:14:14.231 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784/data/mon.a.tgz 2023-09-13T06:14:14.232 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2023-09-13T06:14:14.242 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.s4rMShOAAr 2023-09-13T06:14:14.242 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.s4rMShOAAr 2023-09-13T06:14:14.393 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.s4rMShOAAr 2023-09-13T06:14:14.470 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.s4rMShOAAr is 431KB 2023-09-13T06:14:14.536 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.s4rMShOAAr 2023-09-13T06:14:14.545 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784/data/mon.b.tgz 2023-09-13T06:14:14.545 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2023-09-13T06:14:14.554 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.jsLtckqMv6 2023-09-13T06:14:14.555 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jsLtckqMv6 2023-09-13T06:14:14.707 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.jsLtckqMv6 2023-09-13T06:14:14.783 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.jsLtckqMv6 is 446KB 2023-09-13T06:14:14.853 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.jsLtckqMv6 2023-09-13T06:14:14.861 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784/data/mon.c.tgz 2023-09-13T06:14:14.862 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2023-09-13T06:14:14.910 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.0z7y1ioPaj 2023-09-13T06:14:14.911 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0z7y1ioPaj 2023-09-13T06:14:15.057 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.0z7y1ioPaj 2023-09-13T06:14:15.135 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.0z7y1ioPaj is 446KB 2023-09-13T06:14:15.201 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.0z7y1ioPaj 2023-09-13T06:14:15.210 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-13T06:14:15.210 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-13T06:14:15.214 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-13T06:14:15.270 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-13T06:14:15.271 DEBUG:teuthology.orchestra.run.smithi130:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-13T06:14:15.281 DEBUG:teuthology.orchestra.run.smithi164:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-13T06:14:15.318 INFO:teuthology.orchestra.run.smithi130.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-13T06:14:15.346 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-13T06:14:15.353 INFO:tasks.ceph:Archiving crash dumps... 2023-09-13T06:14:15.355 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784/remote/smithi130/crash 2023-09-13T06:14:15.356 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-13T06:14:15.387 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784/remote/smithi164/crash 2023-09-13T06:14:15.388 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-13T06:14:15.413 INFO:tasks.ceph:Shutting down logrotate 2023-09-13T06:14:15.414 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:14:15.433 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T06:14:15.516 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-13T06:14:15.539 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-13T06:14:15.558 INFO:tasks.ceph:Compressing logs... 2023-09-13T06:14:15.559 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-13T06:14:15.585 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-13T06:14:15.611 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49490.log 2023-09-13T06:14:15.612 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2023-09-13T06:14:15.613 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34529.log 2023-09-13T06:14:15.613 INFO:teuthology.orchestra.run.smithi130.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49490.log.gz 2023-09-13T06:14:15.614 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37851.log 2023-09-13T06:14:15.614 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2023-09-13T06:14:15.615 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34529.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34529.log.gz 2023-09-13T06:14:15.615 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34962.log 2023-09-13T06:14:15.616 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38530.log 2023-09-13T06:14:15.616 INFO:teuthology.orchestra.run.smithi130.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37851.log.gz 2023-09-13T06:14:15.617 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34962.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34962.log.gz 2023-09-13T06:14:15.617 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51694.log 2023-09-13T06:14:15.618 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38530.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.34740.log -- replaced with /var/log/ceph/ceph-client.admin.38530.log.gz 2023-09-13T06:14:15.618 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:15.619 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48902.log 2023-09-13T06:14:15.619 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51694.log.gz 2023-09-13T06:14:15.620 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34740.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34740.log.gz 2023-09-13T06:14:15.621 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54880.log 2023-09-13T06:14:15.621 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48902.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48902.log.gz 2023-09-13T06:14:15.622 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36510.log 2023-09-13T06:14:15.623 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54880.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54880.log.gz 2023-09-13T06:14:15.623 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51235.log 2023-09-13T06:14:15.624 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36510.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36510.log.gz 2023-09-13T06:14:15.624 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47309.log 2023-09-13T06:14:15.625 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51235.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51235.log.gz 2023-09-13T06:14:15.625 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2023-09-13T06:14:15.626 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47309.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47309.log.gz 2023-09-13T06:14:15.626 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44268.log 2023-09-13T06:14:15.627 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48714.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2023-09-13T06:14:15.627 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53008.log 2023-09-13T06:14:15.628 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40675.log 2023-09-13T06:14:15.628 INFO:teuthology.orchestra.run.smithi130.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44268.log.gz 2023-09-13T06:14:15.629 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53008.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53008.log.gz 2023-09-13T06:14:15.629 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40988.log 2023-09-13T06:14:15.630 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39550.log 2023-09-13T06:14:15.631 INFO:teuthology.orchestra.run.smithi130.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40675.log.gz 2023-09-13T06:14:15.631 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40988.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40988.log.gz 2023-09-13T06:14:15.632 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38035.log 2023-09-13T06:14:15.632 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33574.log 2023-09-13T06:14:15.633 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39550.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39550.log.gz 2023-09-13T06:14:15.634 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37957.log 2023-09-13T06:14:15.634 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38035.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38035.log.gz 2023-09-13T06:14:15.634 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41280.log 2023-09-13T06:14:15.636 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37957.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37957.log.gz 2023-09-13T06:14:15.637 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-09-13T06:14:15.637 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41280.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41280.log.gz -5 2023-09-13T06:14:15.637 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.0.40102.log 2023-09-13T06:14:15.639 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34586.log 2023-09-13T06:14:15.639 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.33574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34350.log 2023-09-13T06:14:15.639 INFO:teuthology.orchestra.run.smithi164.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33574.log.gz 2023-09-13T06:14:15.639 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34586.log.gz 2023-09-13T06:14:15.640 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34158.log 2023-09-13T06:14:15.640 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34350.log.gz 2023-09-13T06:14:15.640 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34942.log 2023-09-13T06:14:15.640 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34158.log.gz 2023-09-13T06:14:15.641 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34239.log 2023-09-13T06:14:15.641 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34942.log.gz 2023-09-13T06:14:15.641 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-09-13T06:14:15.641 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.3.34239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.34239.log.gz 2023-09-13T06:14:15.642 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-09-13T06:14:15.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-09-13T06:14:15.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-09-13T06:14:15.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-09-13T06:14:15.650 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34832.log 2023-09-13T06:14:15.650 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34355.log 2023-09-13T06:14:15.650 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34832.log.gz 2023-09-13T06:14:15.651 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35358.log 2023-09-13T06:14:15.651 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34355.log.gz 2023-09-13T06:14:15.651 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35062.log 2023-09-13T06:14:15.651 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.35358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35358.log.gz 2023-09-13T06:14:15.651 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35481.log 2023-09-13T06:14:15.652 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.35062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35062.log.gz 2023-09-13T06:14:15.652 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33598.log 2023-09-13T06:14:15.652 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.35481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35481.log.gz 2023-09-13T06:14:15.652 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-09-13T06:14:15.652 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.33598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33694.log 2023-09-13T06:14:15.653 INFO:teuthology.orchestra.run.smithi164.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33598.log.gz 2023-09-13T06:14:15.653 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35220.log 2023-09-13T06:14:15.653 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.33694.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33694.log.gz 2023-09-13T06:14:15.653 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-09-13T06:14:15.661 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.35220.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-13T06:14:15.662 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35220.log.gz 2023-09-13T06:14:15.662 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33718.log 2023-09-13T06:14:15.662 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34234.log 2023-09-13T06:14:15.662 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.33718.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33718.log.gz 2023-09-13T06:14:15.663 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-09-13T06:14:15.663 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.3.34234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.34234.log.gz 2023-09-13T06:14:15.663 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34463.log 2023-09-13T06:14:15.663 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.c.log: 92.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-13T06:14:15.663 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34581.log 2023-09-13T06:14:15.664 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34463.log: 94.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-09-13T06:14:15.664 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34463.log.gz 2023-09-13T06:14:15.664 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35215.log 2023-09-13T06:14:15.664 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34837.log 2023-09-13T06:14:15.665 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34581.log.gz 2023-09-13T06:14:15.673 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.35215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35215.log.gz 2023-09-13T06:14:15.674 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-13T06:14:15.674 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34947.log 2023-09-13T06:14:15.674 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34837.log.gz 2023-09-13T06:14:15.674 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-09-13T06:14:15.674 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34947.log.gz 2023-09-13T06:14:15.675 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33550.log 2023-09-13T06:14:15.675 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35363.log 2023-09-13T06:14:15.675 INFO:teuthology.orchestra.run.smithi164.stderr: 94.0%/var/log/ceph/ceph-client.admin.33550.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-13T06:14:15.675 INFO:teuthology.orchestra.run.smithi164.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33550.log.gz 2023-09-13T06:14:15.675 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33646.log 2023-09-13T06:14:15.676 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.35363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35363.log.gz 2023-09-13T06:14:15.676 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-09-13T06:14:15.676 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.33646.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33646.log.gz 2023-09-13T06:14:15.676 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-09-13T06:14:15.679 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35067.log 2023-09-13T06:14:15.679 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-09-13T06:14:15.679 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.35067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35067.log.gz 2023-09-13T06:14:15.682 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50871.log 2023-09-13T06:14:15.683 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.40102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40102.log.gz 2023-09-13T06:14:15.683 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43324.log 2023-09-13T06:14:15.683 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50871.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50871.log.gz 2023-09-13T06:14:15.683 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54100.log 2023-09-13T06:14:15.683 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43324.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.48007.log 2023-09-13T06:14:15.684 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43324.log.gz 2023-09-13T06:14:15.684 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54518.log 87.9% 2023-09-13T06:14:15.684 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54100.log.gz 2023-09-13T06:14:15.684 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48007.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48007.log.gz 2023-09-13T06:14:15.685 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51001.log 2023-09-13T06:14:15.685 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54518.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54518.log.gz 2023-09-13T06:14:15.685 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52361.log 2023-09-13T06:14:15.685 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51001.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51001.log.gz 2023-09-13T06:14:15.685 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53034.log 2023-09-13T06:14:15.685 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43246.log 2023-09-13T06:14:15.686 INFO:teuthology.orchestra.run.smithi130.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52361.log.gz 2023-09-13T06:14:15.686 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48376.log 2023-09-13T06:14:15.686 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43246.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53034.log.gz 2023-09-13T06:14:15.686 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43246.log.gz 2023-09-13T06:14:15.687 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44989.log 2023-09-13T06:14:15.687 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49698.log 2023-09-13T06:14:15.687 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48376.log.gz 2023-09-13T06:14:15.687 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44989.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44989.log.gz 2023-09-13T06:14:15.688 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37683.log 2023-09-13T06:14:15.688 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34959.log 2023-09-13T06:14:15.688 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49698.log.gz 2023-09-13T06:14:15.688 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50252.log 2023-09-13T06:14:15.688 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37683.log.gz 2023-09-13T06:14:15.689 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44383.log 2023-09-13T06:14:15.689 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34959.log.gz 2023-09-13T06:14:15.689 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53324.log 2023-09-13T06:14:15.689 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50252.log.gz 2023-09-13T06:14:15.689 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44383.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.37603.log -- replaced with /var/log/ceph/ceph-client.admin.44383.log.gz 2023-09-13T06:14:15.690 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:15.690 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53324.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.53324.log.gz 2023-09-13T06:14:15.690 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53350.log 2023-09-13T06:14:15.690 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55090.log 2023-09-13T06:14:15.690 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37603.log.gz 2023-09-13T06:14:15.690 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54309.log 2023-09-13T06:14:15.691 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53350.log.gz 2023-09-13T06:14:15.691 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.55090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48685.log 2023-09-13T06:14:15.691 INFO:teuthology.orchestra.run.smithi130.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55090.log.gz 2023-09-13T06:14:15.691 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54309.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54309.log.gz 2023-09-13T06:14:15.691 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40884.log 2023-09-13T06:14:15.692 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49594.log 2023-09-13T06:14:15.692 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48685.log.gz 2023-09-13T06:14:15.692 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53851.log 2023-09-13T06:14:15.692 INFO:teuthology.orchestra.run.smithi130.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40884.log.gz 2023-09-13T06:14:15.692 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47257.log 2023-09-13T06:14:15.693 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49594.log.gz 2023-09-13T06:14:15.693 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53851.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53851.log.gz 2023-09-13T06:14:15.693 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40858.log 2023-09-13T06:14:15.693 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53246.log 2023-09-13T06:14:15.693 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47257.log.gz 2023-09-13T06:14:15.694 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40858.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-09-13T06:14:15.694 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40858.log.gz 2023-09-13T06:14:15.694 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38665.log 2023-09-13T06:14:15.694 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53246.log.gz 2023-09-13T06:14:15.695 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36108.log 2023-09-13T06:14:15.695 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50148.log 2023-09-13T06:14:15.695 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38665.log.gz 2023-09-13T06:14:15.695 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43645.log 2023-09-13T06:14:15.695 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36108.log.gz 2023-09-13T06:14:15.695 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50148.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50148.log.gz 2023-09-13T06:14:15.696 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55218.log 2023-09-13T06:14:15.696 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48114.log 2023-09-13T06:14:15.696 INFO:teuthology.orchestra.run.smithi130.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43645.log.gz 2023-09-13T06:14:15.696 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.55218.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55218.log.gz 2023-09-13T06:14:15.696 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39850.log 2023-09-13T06:14:15.697 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48659.log 2023-09-13T06:14:15.697 INFO:teuthology.orchestra.run.smithi130.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48114.log.gz 2023-09-13T06:14:15.697 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39850.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39850.log.gz 2023-09-13T06:14:15.697 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52745.log 2023-09-13T06:14:15.697 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46433.log 2023-09-13T06:14:15.698 INFO:teuthology.orchestra.run.smithi130.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48659.log.gz 2023-09-13T06:14:15.698 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52745.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52745.log.gz 2023-09-13T06:14:15.698 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53142.log 2023-09-13T06:14:15.698 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46433.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46433.log.gz 2023-09-13T06:14:15.698 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54440.log 2023-09-13T06:14:15.699 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53142.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53142.log.gz 2023-09-13T06:14:15.699 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46090.log 2023-09-13T06:14:15.699 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48770.log 2023-09-13T06:14:15.699 INFO:teuthology.orchestra.run.smithi130.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54440.log.gz 2023-09-13T06:14:15.700 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46090.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46090.log.gz 2023-09-13T06:14:15.700 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49360.log 2023-09-13T06:14:15.702 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35486.log 2023-09-13T06:14:15.702 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34721.log 2023-09-13T06:14:15.702 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.35486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35486.log.gz 2023-09-13T06:14:15.710 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48142.log 2023-09-13T06:14:15.711 INFO:teuthology.orchestra.run.smithi130.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48770.log.gz 2023-09-13T06:14:15.711 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49360.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49360.log.gz 2023-09-13T06:14:15.711 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47694.log 2023-09-13T06:14:15.711 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41191.log 2023-09-13T06:14:15.711 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48142.log.gz 2023-09-13T06:14:15.712 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47694.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47694.log.gz 2023-09-13T06:14:15.712 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37709.log 2023-09-13T06:14:15.712 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53771.log 2023-09-13T06:14:15.712 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41191.log.gz 2023-09-13T06:14:15.713 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37709.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37709.log.gz 2023-09-13T06:14:15.713 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41774.log 2023-09-13T06:14:15.713 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53771.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53771.log.gz 2023-09-13T06:14:15.713 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39524.log 2023-09-13T06:14:15.713 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41774.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41774.log.gz 2023-09-13T06:14:15.714 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48990.log 2023-09-13T06:14:15.714 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39285.log 2023-09-13T06:14:15.714 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39524.log.gz 2023-09-13T06:14:15.714 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48990.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48990.log.gz 2023-09-13T06:14:15.714 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43517.log 2023-09-13T06:14:15.715 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50419.log 2023-09-13T06:14:15.715 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39285.log.gz 2023-09-13T06:14:15.715 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43517.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43517.log.gz 2023-09-13T06:14:15.715 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51392.log 2023-09-13T06:14:15.715 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50419.log: gzip -5 88.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.50419.log.gz 2023-09-13T06:14:15.716 INFO:teuthology.orchestra.run.smithi130.stderr: /var/log/ceph/ceph-client.admin.34337.log 2023-09-13T06:14:15.716 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51392.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51392.log.gz 2023-09-13T06:14:15.716 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36450.log 2023-09-13T06:14:15.716 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40225.log 2023-09-13T06:14:15.716 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34337.log.gz 2023-09-13T06:14:15.717 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36450.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36450.log.gz 2023-09-13T06:14:15.717 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50016.log 2023-09-13T06:14:15.717 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50379.log 2023-09-13T06:14:15.717 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40225.log.gz 2023-09-13T06:14:15.717 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50016.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50016.log.gz 2023-09-13T06:14:15.718 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39056.log 2023-09-13T06:14:15.718 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.50379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50379.log.gz 2023-09-13T06:14:15.718 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40343.log 2023-09-13T06:14:15.718 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38165.log 2023-09-13T06:14:15.718 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39056.log.gz 2023-09-13T06:14:15.719 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41800.log 2023-09-13T06:14:15.719 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40343.log.gz 2023-09-13T06:14:15.719 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51131.log 2023-09-13T06:14:15.719 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38165.log.gz 2023-09-13T06:14:15.719 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46519.log 2023-09-13T06:14:15.719 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41800.log.gz 2023-09-13T06:14:15.720 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51131.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51131.log.gz 2023-09-13T06:14:15.720 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49882.log 2023-09-13T06:14:15.720 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43963.log 2023-09-13T06:14:15.722 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34726.log 2023-09-13T06:14:15.722 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34721.log.gz 2023-09-13T06:14:15.726 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46519.log.gz 2023-09-13T06:14:15.727 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49882.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49882.log.gz 2023-09-13T06:14:15.727 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37983.log 2023-09-13T06:14:15.727 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37226.log 2023-09-13T06:14:15.727 INFO:teuthology.orchestra.run.smithi130.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43963.log.gz 2023-09-13T06:14:15.728 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37983.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37983.log.gz 2023-09-13T06:14:15.728 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50200.log 2023-09-13T06:14:15.728 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35719.log 2023-09-13T06:14:15.728 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37226.log.gz 2023-09-13T06:14:15.728 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50200.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50200.log.gz 2023-09-13T06:14:15.728 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52916.log 2023-09-13T06:14:15.729 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.35719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35719.log.gz 2023-09-13T06:14:15.729 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53428.log 2023-09-13T06:14:15.729 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52916.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52916.log.gz 2023-09-13T06:14:15.729 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34547.log 2023-09-13T06:14:15.729 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45322.log 2023-09-13T06:14:15.730 INFO:teuthology.orchestra.run.smithi130.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53428.log.gz 2023-09-13T06:14:15.730 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34547.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34547.log.gz 2023-09-13T06:14:15.730 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36805.log 2023-09-13T06:14:15.730 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45322.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45322.log.gz 2023-09-13T06:14:15.730 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51261.log 2023-09-13T06:14:15.731 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36805.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36805.log.gz 2023-09-13T06:14:15.731 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50662.log 2023-09-13T06:14:15.731 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36484.log 2023-09-13T06:14:15.731 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51261.log.gz 2023-09-13T06:14:15.731 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50662.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50662.log.gz 2023-09-13T06:14:15.732 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42184.log 2023-09-13T06:14:15.733 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34149.log 2023-09-13T06:14:15.733 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34726.log.gz 2023-09-13T06:14:15.736 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37472.log 2023-09-13T06:14:15.736 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36484.log.gz 2023-09-13T06:14:15.737 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42184.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42184.log.gz 2023-09-13T06:14:15.737 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42945.log 2023-09-13T06:14:15.737 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49073.log 2023-09-13T06:14:15.737 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37472.log.gz 2023-09-13T06:14:15.737 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42945.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42945.log.gz 2023-09-13T06:14:15.738 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35248.log 2023-09-13T06:14:15.738 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37931.log 2023-09-13T06:14:15.738 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49073.log.gz 2023-09-13T06:14:15.738 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35248.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35248.log.gz 2023-09-13T06:14:15.738 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49542.log 2023-09-13T06:14:15.739 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37931.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37931.log.gz 2023-09-13T06:14:15.739 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49386.log 2023-09-13T06:14:15.739 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42210.log 2023-09-13T06:14:15.739 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49542.log.gz 2023-09-13T06:14:15.739 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40832.log 2023-09-13T06:14:15.740 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49386.log.gz 2023-09-13T06:14:15.741 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42210.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42210.log.gz 2023-09-13T06:14:15.741 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38292.log 2023-09-13T06:14:15.742 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45837.log 2023-09-13T06:14:15.742 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40832.log.gz 2023-09-13T06:14:15.742 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.38292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38292.log.gz 2023-09-13T06:14:15.742 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34946.log 2023-09-13T06:14:15.742 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45837.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45837.log.gz 2023-09-13T06:14:15.743 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51027.log 2023-09-13T06:14:15.744 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34946.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34946.log.gz 2023-09-13T06:14:15.744 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53194.log 2023-09-13T06:14:15.744 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51027.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51027.log.gz 2023-09-13T06:14:15.745 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34197.log 2023-09-13T06:14:15.746 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33622.log 2023-09-13T06:14:15.746 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34149.log.gz 2023-09-13T06:14:15.747 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53194.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53194.log.gz 2023-09-13T06:14:15.748 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44015.log 2023-09-13T06:14:15.748 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34197.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34197.log.gz 2023-09-13T06:14:15.748 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55168.log 2023-09-13T06:14:15.748 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44015.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44015.log.gz 2023-09-13T06:14:15.748 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40806.log 2023-09-13T06:14:15.749 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.55168.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55168.log.gz 2023-09-13T06:14:15.750 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48531.log 2023-09-13T06:14:15.750 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40806.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40806.log.gz 2023-09-13T06:14:15.750 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50374.log 2023-09-13T06:14:15.751 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.48531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48531.log.gz 2023-09-13T06:14:15.751 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49830.log 2023-09-13T06:14:15.751 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.50374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50374.log.gz 2023-09-13T06:14:15.752 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46467.log 2023-09-13T06:14:15.753 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49830.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49830.log.gz 2023-09-13T06:14:15.753 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44677.log 2023-09-13T06:14:15.754 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52440.log 2023-09-13T06:14:15.754 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46467.log.gz 2023-09-13T06:14:15.755 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44677.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44677.log.gz 2023-09-13T06:14:15.755 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37524.log 2023-09-13T06:14:15.756 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52440.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52440.log.gz 2023-09-13T06:14:15.757 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36562.log 2023-09-13T06:14:15.757 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37524.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37524.log.gz 2023-09-13T06:14:15.758 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43806.log 2023-09-13T06:14:15.759 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36562.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36562.log.gz 2023-09-13T06:14:15.759 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38113.log 2023-09-13T06:14:15.760 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43806.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43806.log.gz 2023-09-13T06:14:15.760 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34955.log 2023-09-13T06:14:15.761 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34458.log 2023-09-13T06:14:15.761 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.33622.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33622.log.gz 2023-09-13T06:14:15.762 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38113.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38113.log.gz 2023-09-13T06:14:15.762 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45179.log 2023-09-13T06:14:15.762 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34955.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-09-13T06:14:15.763 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45759.log 2023-09-13T06:14:15.763 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34955.log.gz 2023-09-13T06:14:15.764 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42419.log 2023-09-13T06:14:15.764 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45179.log.gz 2023-09-13T06:14:15.764 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52622.log 2023-09-13T06:14:15.764 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45759.log.gz 2023-09-13T06:14:15.765 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54231.log 2023-09-13T06:14:15.765 INFO:teuthology.orchestra.run.smithi130.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42419.log.gz 2023-09-13T06:14:15.766 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52622.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52622.log.gz -5 2023-09-13T06:14:15.766 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-osd.2.log 2023-09-13T06:14:15.767 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34493.log 2023-09-13T06:14:15.767 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54231.log.gz 2023-09-13T06:14:15.768 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37498.log 2023-09-13T06:14:15.769 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33670.log 2023-09-13T06:14:15.769 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42971.log 2023-09-13T06:14:15.770 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34493.log.gz 2023-09-13T06:14:15.771 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39315.log 2023-09-13T06:14:15.771 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37498.log.gz 2023-09-13T06:14:15.771 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42971.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2023-09-13T06:14:15.772 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42367.log 2023-09-13T06:14:15.772 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48850.log 2023-09-13T06:14:15.773 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51157.log 2023-09-13T06:14:15.774 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51965.log 2023-09-13T06:14:15.775 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42158.log 2023-09-13T06:14:15.776 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41590.log 2023-09-13T06:14:15.777 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54387.log 2023-09-13T06:14:15.778 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35978.log 2023-09-13T06:14:15.781 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41941.log 2023-09-13T06:14:15.781 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34441.log 2023-09-13T06:14:15.782 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53086.log 2023-09-13T06:14:15.783 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39315.log: /var/log/ceph/ceph-client.admin.42367.log: /var/log/ceph/ceph-client.admin.34441.log: /var/log/ceph/ceph-client.admin.48850.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39315.log.gz 2023-09-13T06:14:15.783 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42367.log.gz 2023-09-13T06:14:15.784 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34441.log.gz 2023-09-13T06:14:15.784 INFO:teuthology.orchestra.run.smithi130.stderr:gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48850.log.gz 2023-09-13T06:14:15.784 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39606.log 2023-09-13T06:14:15.785 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.34458.log: /var/log/ceph/ceph-client.admin.33670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34458.log.gz 2023-09-13T06:14:15.786 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51157.log: /var/log/ceph/ceph-client.admin.51965.log: /var/log/ceph/ceph-client.admin.42158.log: /var/log/ceph/ceph-client.admin.41590.log: /var/log/ceph/ceph-client.admin.53086.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51965.log.gz 2023-09-13T06:14:15.786 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51157.log.gz 2023-09-13T06:14:15.786 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42158.log.gz 2023-09-13T06:14:15.786 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41590.log.gz 2023-09-13T06:14:15.786 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54387.log: /var/log/ceph/ceph-client.admin.35978.log: 88.2%/var/log/ceph/ceph-client.admin.41941.log: -- replaced with /var/log/ceph/ceph-client.admin.53086.log.gz 2023-09-13T06:14:15.787 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35430.log 2023-09-13T06:14:15.787 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54387.log.gz 2023-09-13T06:14:15.787 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35978.log.gz 2023-09-13T06:14:15.787 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41941.log.gz 2023-09-13T06:14:15.789 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36966.log 2023-09-13T06:14:15.789 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39606.log.gz 2023-09-13T06:14:15.789 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55064.log 2023-09-13T06:14:15.789 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35430.log.gz 2023-09-13T06:14:15.789 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36698.log 2023-09-13T06:14:15.790 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36966.log.gz 2023-09-13T06:14:15.791 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.55064.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55064.log.gz 2023-09-13T06:14:15.791 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42341.log 2023-09-13T06:14:15.791 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36698.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36698.log.gz 2023-09-13T06:14:15.792 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51824.log 2023-09-13T06:14:15.793 INFO:teuthology.orchestra.run.smithi164.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33670.log.gz 2023-09-13T06:14:15.793 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42341.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42341.log.gz 2023-09-13T06:14:15.794 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47362.log 2023-09-13T06:14:15.794 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51824.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51824.log.gz 2023-09-13T06:14:15.794 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35828.log 2023-09-13T06:14:15.795 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47362.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47362.log.gz 2023-09-13T06:14:15.795 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52230.log 2023-09-13T06:14:15.795 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.2.35828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35828.log.gz 2023-09-13T06:14:15.796 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49204.log 2023-09-13T06:14:15.797 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52230.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52230.log.gz 2023-09-13T06:14:15.797 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54750.log 2023-09-13T06:14:15.798 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49204.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49204.log.gz 2023-09-13T06:14:15.798 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54776.log 2023-09-13T06:14:15.799 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54750.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54750.log.gz 2023-09-13T06:14:15.799 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49151.log 2023-09-13T06:14:15.800 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54776.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54776.log.gz 2023-09-13T06:14:15.800 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37577.log 2023-09-13T06:14:15.801 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49151.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49151.log.gz 2023-09-13T06:14:15.801 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45268.log 2023-09-13T06:14:15.802 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37577.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37577.log.gz 2023-09-13T06:14:15.803 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40754.log 2023-09-13T06:14:15.804 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45268.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45268.log.gz 2023-09-13T06:14:15.804 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41403.log 2023-09-13T06:14:15.805 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40754.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40754.log.gz 2023-09-13T06:14:15.805 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46299.log 2023-09-13T06:14:15.806 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41403.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41403.log.gz 2023-09-13T06:14:15.806 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45915.log 2023-09-13T06:14:15.807 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46299.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46299.log.gz 2023-09-13T06:14:15.807 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40540.log 2023-09-13T06:14:15.808 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45915.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45915.log.gz 2023-09-13T06:14:15.808 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40198.log 2023-09-13T06:14:15.809 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40540.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40540.log.gz 2023-09-13T06:14:15.809 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48298.log 2023-09-13T06:14:15.810 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40198.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40198.log.gz 2023-09-13T06:14:15.811 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46729.log 2023-09-13T06:14:15.811 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48298.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48298.log.gz 2023-09-13T06:14:15.812 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-09-13T06:14:15.813 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40056.log 2023-09-13T06:14:15.813 INFO:teuthology.orchestra.run.smithi130.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.46729.log.gz 2023-09-13T06:14:15.814 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41927.log 2023-09-13T06:14:15.815 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40056.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40056.log.gz 2023-09-13T06:14:15.815 INFO:teuthology.orchestra.run.smithi164.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-09-13T06:14:15.816 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38139.log 2023-09-13T06:14:15.817 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.41927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48545.log 2023-09-13T06:14:15.817 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41927.log.gz 2023-09-13T06:14:15.818 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38139.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38139.log.gz 2023-09-13T06:14:15.818 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37174.log 2023-09-13T06:14:15.819 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48545.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48545.log.gz 2023-09-13T06:14:15.820 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36940.log 2023-09-13T06:14:15.821 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34961.log 2023-09-13T06:14:15.821 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37174.log.gz 2023-09-13T06:14:15.822 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36940.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36940.log.gz 2023-09-13T06:14:15.822 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34467.log 2023-09-13T06:14:15.823 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34961.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34961.log.gz 2023-09-13T06:14:15.824 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34531.log 2023-09-13T06:14:15.825 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2023-09-13T06:14:15.825 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34467.log.gz 2023-09-13T06:14:15.826 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34531.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34531.log.gz 2023-09-13T06:14:15.827 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49177.log 2023-09-13T06:14:15.827 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49620.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2023-09-13T06:14:15.828 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47915.log 2023-09-13T06:14:15.829 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54466.log 2023-09-13T06:14:15.829 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49177.log.gz 2023-09-13T06:14:15.830 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47915.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47915.log.gz 2023-09-13T06:14:15.830 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52021.log 2023-09-13T06:14:15.831 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54466.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54466.log.gz 2023-09-13T06:14:15.832 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54570.log 2023-09-13T06:14:15.833 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46038.log 2023-09-13T06:14:15.834 INFO:teuthology.orchestra.run.smithi164.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-09-13T06:14:15.834 INFO:teuthology.orchestra.run.smithi130.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52021.log.gz 2023-09-13T06:14:15.834 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54570.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54570.log.gz 2023-09-13T06:14:15.835 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42101.log 2023-09-13T06:14:15.836 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46038.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46038.log.gz 2023-09-13T06:14:15.836 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45467.log 2023-09-13T06:14:15.837 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43754.log 2023-09-13T06:14:15.838 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42101.log.gz 2023-09-13T06:14:15.838 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45467.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45467.log.gz 2023-09-13T06:14:15.839 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44481.log 2023-09-13T06:14:15.840 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43754.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43754.log.gz 2023-09-13T06:14:15.841 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43859.log 2023-09-13T06:14:15.842 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44481.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44481.log.gz 2023-09-13T06:14:15.842 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40280.log 2023-09-13T06:14:15.843 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43859.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43859.log.gz 2023-09-13T06:14:15.844 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47883.log 2023-09-13T06:14:15.845 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40649.log 2023-09-13T06:14:15.846 INFO:teuthology.orchestra.run.smithi130.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40280.log.gz 2023-09-13T06:14:15.846 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47883.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47883.log.gz 2023-09-13T06:14:15.847 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48168.log 2023-09-13T06:14:15.847 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40649.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40649.log.gz 2023-09-13T06:14:15.848 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49308.log 2023-09-13T06:14:15.849 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47205.log 2023-09-13T06:14:15.850 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48168.log.gz 2023-09-13T06:14:15.850 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49308.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49308.log.gz 2023-09-13T06:14:15.851 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43937.log 2023-09-13T06:14:15.852 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47205.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47205.log.gz 2023-09-13T06:14:15.852 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54179.log 2023-09-13T06:14:15.854 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43937.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43937.log.gz 2023-09-13T06:14:15.854 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53715.log 2023-09-13T06:14:15.855 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45040.log 2023-09-13T06:14:15.856 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54179.log.gz 2023-09-13T06:14:15.856 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53715.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53715.log.gz 2023-09-13T06:14:15.857 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42629.log 2023-09-13T06:14:15.858 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.45040.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.45040.log.gz -5 2023-09-13T06:14:15.858 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48404.log 2023-09-13T06:14:15.859 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42629.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42629.log.gz 2023-09-13T06:14:15.860 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44643.log 2023-09-13T06:14:15.861 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48404.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48404.log.gz 2023-09-13T06:14:15.861 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46599.log 2023-09-13T06:14:15.862 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44643.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44643.log.gz 2023-09-13T06:14:15.863 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36290.log 2023-09-13T06:14:15.864 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46599.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46599.log.gz 2023-09-13T06:14:15.864 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48964.log 2023-09-13T06:14:15.865 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36290.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36290.log.gz 2023-09-13T06:14:15.866 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47746.log 2023-09-13T06:14:15.867 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48964.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48964.log.gz 2023-09-13T06:14:15.867 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47824.log 2023-09-13T06:14:15.868 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47746.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47746.log.gz 2023-09-13T06:14:15.869 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45681.log 2023-09-13T06:14:15.870 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40122.log 2023-09-13T06:14:15.870 INFO:teuthology.orchestra.run.smithi130.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47824.log.gz 2023-09-13T06:14:15.871 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45681.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45681.log.gz 2023-09-13T06:14:15.871 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34115.log 2023-09-13T06:14:15.872 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40254.log 2023-09-13T06:14:15.873 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40122.log.gz 2023-09-13T06:14:15.873 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34115.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34115.log.gz 2023-09-13T06:14:15.874 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53632.log 2023-09-13T06:14:15.876 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42577.log 2023-09-13T06:14:15.876 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40254.log.gz 2023-09-13T06:14:15.876 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53632.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53632.log.gz 2023-09-13T06:14:15.877 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46325.log 2023-09-13T06:14:15.878 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43472.log 2023-09-13T06:14:15.879 INFO:teuthology.orchestra.run.smithi130.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42577.log.gz 2023-09-13T06:14:15.879 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46325.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46325.log.gz 2023-09-13T06:14:15.880 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40936.log 2023-09-13T06:14:15.880 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.43472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39772.log 2023-09-13T06:14:15.881 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43472.log.gz 2023-09-13T06:14:15.881 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40936.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40936.log.gz 2023-09-13T06:14:15.882 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49412.log 2023-09-13T06:14:15.883 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52121.log 2023-09-13T06:14:15.883 INFO:teuthology.orchestra.run.smithi130.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39772.log.gz 2023-09-13T06:14:15.884 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49412.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49412.log.gz 2023-09-13T06:14:15.884 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35195.log 2023-09-13T06:14:15.885 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46064.log 2023-09-13T06:14:15.886 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52121.log: /var/log/ceph/ceph-client.admin.35195.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52121.log.gz 2023-09-13T06:14:15.887 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35195.log.gz 2023-09-13T06:14:15.887 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49646.log 2023-09-13T06:14:15.888 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44067.log 2023-09-13T06:14:15.889 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46064.log.gz 2023-09-13T06:14:15.889 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49646.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49646.log.gz 2023-09-13T06:14:15.889 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53877.log 2023-09-13T06:14:15.890 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52570.log 2023-09-13T06:14:15.891 INFO:teuthology.orchestra.run.smithi130.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44067.log.gz 2023-09-13T06:14:15.892 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53877.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53877.log.gz 2023-09-13T06:14:15.892 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53298.log 2023-09-13T06:14:15.893 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5/var/log/ceph/ceph-client.admin.52570.log: --verbose -- /var/log/ceph/ceph-client.admin.34744.log 2023-09-13T06:14:15.893 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52570.log.gz 2023-09-13T06:14:15.894 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53298.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53298.log.gz 2023-09-13T06:14:15.894 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51850.log 2023-09-13T06:14:15.895 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47020.log 2023-09-13T06:14:15.896 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34744.log.gz 2023-09-13T06:14:15.897 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42854.log 2023-09-13T06:14:15.897 INFO:teuthology.orchestra.run.smithi130.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.51850.log.gz 2023-09-13T06:14:15.898 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51183.log 2023-09-13T06:14:15.898 INFO:teuthology.orchestra.run.smithi130.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47020.log.gz 2023-09-13T06:14:15.899 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42854.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42854.log.gz 2023-09-13T06:14:15.899 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53544.log 2023-09-13T06:14:15.900 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51183.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51183.log.gz 2023-09-13T06:14:15.901 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43194.log 2023-09-13T06:14:15.902 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48272.log 2023-09-13T06:14:15.902 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53544.log.gz 2023-09-13T06:14:15.903 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43194.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43194.log.gz 2023-09-13T06:14:15.904 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51668.log 2023-09-13T06:14:15.905 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35823.log 2023-09-13T06:14:15.905 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48272.log.gz 2023-09-13T06:14:15.906 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51668.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51668.log.gz 2023-09-13T06:14:15.906 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46625.log 2023-09-13T06:14:15.907 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.2.35823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2023-09-13T06:14:15.907 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35823.log.gz 2023-09-13T06:14:15.908 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46625.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46625.log.gz 2023-09-13T06:14:15.908 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43671.log 2023-09-13T06:14:15.909 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52173.log 2023-09-13T06:14:15.910 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2023-09-13T06:14:15.910 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43671.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43671.log.gz 2023-09-13T06:14:15.911 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39030.log 2023-09-13T06:14:15.912 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46547.log 2023-09-13T06:14:15.912 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52173.log.gz 2023-09-13T06:14:15.913 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39030.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39030.log.gz 2023-09-13T06:14:15.913 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39746.log 2023-09-13T06:14:15.914 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41538.log 2023-09-13T06:14:15.915 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46547.log.gz 2023-09-13T06:14:15.916 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39746.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39746.log.gz 2023-09-13T06:14:15.916 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50636.log 2023-09-13T06:14:15.917 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54283.log 2023-09-13T06:14:15.917 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41538.log.gz 2023-09-13T06:14:15.918 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50636.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50636.log.gz 2023-09-13T06:14:15.918 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47283.log 2023-09-13T06:14:15.919 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33761.log 2023-09-13T06:14:15.920 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54283.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54283.log.gz 2023-09-13T06:14:15.920 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47283.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47283.log.gz 2023-09-13T06:14:15.921 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53596.log 2023-09-13T06:14:15.922 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35352.log 2023-09-13T06:14:15.922 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33761.log.gz 2023-09-13T06:14:15.923 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53596.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53596.log.gz 2023-09-13T06:14:15.923 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51720.log 2023-09-13T06:14:15.924 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44320.log 2023-09-13T06:14:15.925 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35352.log.gz 2023-09-13T06:14:15.925 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51720.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51720.log.gz 2023-09-13T06:14:15.926 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39954.log 2023-09-13T06:14:15.927 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44320.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44320.log.gz 2023-09-13T06:14:15.927 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37252.log 2023-09-13T06:14:15.929 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39954.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39954.log.gz 2023-09-13T06:14:15.929 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42551.log 2023-09-13T06:14:15.930 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37252.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37252.log.gz 2023-09-13T06:14:15.931 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53658.log 2023-09-13T06:14:15.932 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42551.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42551.log.gz 2023-09-13T06:14:15.932 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43491.log 2023-09-13T06:14:15.933 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53658.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53658.log.gz 2023-09-13T06:14:15.934 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41644.log 2023-09-13T06:14:15.935 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43491.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43491.log.gz 2023-09-13T06:14:15.935 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53939.log 2023-09-13T06:14:15.936 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41644.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41644.log.gz 2023-09-13T06:14:15.937 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51105.log 2023-09-13T06:14:15.938 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53939.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53939.log.gz 2023-09-13T06:14:15.938 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41826.log 2023-09-13T06:14:15.940 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51105.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51105.log.gz 2023-09-13T06:14:15.940 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54802.log 2023-09-13T06:14:15.941 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45242.log 2023-09-13T06:14:15.942 INFO:teuthology.orchestra.run.smithi130.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.41826.log.gz 2023-09-13T06:14:15.943 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54802.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54802.log.gz 2023-09-13T06:14:15.943 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54698.log 2023-09-13T06:14:15.944 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54986.log 2023-09-13T06:14:15.944 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45242.log.gz 2023-09-13T06:14:15.945 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54698.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54698.log.gz 2023-09-13T06:14:15.946 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35534.log 2023-09-13T06:14:15.947 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54986.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54986.log.gz 2023-09-13T06:14:15.947 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36724.log 2023-09-13T06:14:15.949 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39129.log 2023-09-13T06:14:15.949 INFO:teuthology.orchestra.run.smithi130.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35534.log.gz 2023-09-13T06:14:15.949 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36724.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36724.log.gz 2023-09-13T06:14:15.950 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42236.log 2023-09-13T06:14:15.951 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35274.log 2023-09-13T06:14:15.951 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39129.log.gz 2023-09-13T06:14:15.952 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42236.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42236.log.gz 2023-09-13T06:14:15.953 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39824.log 2023-09-13T06:14:15.954 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50122.log 2023-09-13T06:14:15.955 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35274.log: /var/log/ceph/ceph-client.admin.39824.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35274.log.gz 2023-09-13T06:14:15.955 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52667.log 2023-09-13T06:14:15.955 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39824.log.gz 2023-09-13T06:14:15.956 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41217.log 2023-09-13T06:14:15.957 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50122.log.gz 2023-09-13T06:14:15.957 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52667.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52667.log.gz 2023-09-13T06:14:15.958 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41429.log 2023-09-13T06:14:15.959 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41217.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41217.log.gz 2023-09-13T06:14:15.959 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48246.log 2023-09-13T06:14:15.960 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53478.log 2023-09-13T06:14:15.961 INFO:teuthology.orchestra.run.smithi130.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41429.log.gz 2023-09-13T06:14:15.961 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48246.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48246.log.gz 2023-09-13T06:14:15.962 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42393.log 2023-09-13T06:14:15.963 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53478.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53478.log.gz 2023-09-13T06:14:15.964 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38978.log 2023-09-13T06:14:15.965 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42393.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42393.log.gz 2023-09-13T06:14:15.965 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37096.log 2023-09-13T06:14:15.966 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38978.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38978.log.gz 2023-09-13T06:14:15.967 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40910.log 2023-09-13T06:14:15.968 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37096.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37096.log.gz 2023-09-13T06:14:15.968 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43477.log 2023-09-13T06:14:15.969 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40910.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40910.log.gz 2023-09-13T06:14:15.970 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37018.log 2023-09-13T06:14:15.970 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.43477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43477.log.gz 2023-09-13T06:14:15.971 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35169.log 2023-09-13T06:14:15.972 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37018.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-09-13T06:14:15.972 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37018.log.gz 2023-09-13T06:14:15.973 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35169.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35169.log.gz 2023-09-13T06:14:15.974 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41014.log 2023-09-13T06:14:15.975 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37148.log 2023-09-13T06:14:15.977 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38556.log 2023-09-13T06:14:15.977 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41014.log.gz 2023-09-13T06:14:15.978 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37148.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.52518.log 2023-09-13T06:14:15.978 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37148.log.gz 2023-09-13T06:14:15.980 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54017.log 2023-09-13T06:14:15.981 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52518.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38556.log.gz 2023-09-13T06:14:15.981 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52518.log.gz 2023-09-13T06:14:15.981 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40395.log 2023-09-13T06:14:15.983 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54017.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54017.log.gz 2023-09-13T06:14:15.983 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54361.log 2023-09-13T06:14:15.984 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40395.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40395.log.gz 2023-09-13T06:14:15.985 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41312.log 2023-09-13T06:14:15.986 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54361.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54361.log.gz 2023-09-13T06:14:15.987 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39876.log 2023-09-13T06:14:15.992 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41312.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41312.log.gz 2023-09-13T06:14:15.992 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36030.log 2023-09-13T06:14:15.992 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39876.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39876.log.gz 2023-09-13T06:14:15.992 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48480.log 2023-09-13T06:14:15.993 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36030.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36030.log.gz 2023-09-13T06:14:15.993 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44093.log 2023-09-13T06:14:15.994 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48480.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48480.log.gz 2023-09-13T06:14:15.994 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54828.log 2023-09-13T06:14:15.995 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44093.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44093.log.gz 2023-09-13T06:14:15.996 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38634.log 2023-09-13T06:14:15.997 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54828.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54828.log.gz 2023-09-13T06:14:15.997 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41456.log 2023-09-13T06:14:15.998 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38634.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38634.log.gz 2023-09-13T06:14:15.999 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52693.log 2023-09-13T06:14:16.000 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41456.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41456.log.gz 2023-09-13T06:14:16.001 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49042.log 2023-09-13T06:14:16.002 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52693.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52693.log.gz 2023-09-13T06:14:16.003 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35848.log 2023-09-13T06:14:16.004 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49042.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49042.log.gz 2023-09-13T06:14:16.005 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44507.log 2023-09-13T06:14:16.006 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35848.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35848.log.gz 2023-09-13T06:14:16.007 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41059.log 2023-09-13T06:14:16.009 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34283.log 2023-09-13T06:14:16.009 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44507.log.gz 2023-09-13T06:14:16.010 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41059.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41059.log.gz 2023-09-13T06:14:16.011 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45205.log 2023-09-13T06:14:16.011 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34283.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34283.log.gz 2023-09-13T06:14:16.012 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38395.log 2023-09-13T06:14:16.013 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45205.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45205.log.gz -5 2023-09-13T06:14:16.013 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47798.log 2023-09-13T06:14:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38395.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.41247.log 2023-09-13T06:14:16.015 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38395.log.gz 2023-09-13T06:14:16.016 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47798.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47798.log.gz 2023-09-13T06:14:16.017 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51588.log 2023-09-13T06:14:16.018 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54672.log 2023-09-13T06:14:16.018 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41247.log.gz 2023-09-13T06:14:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51588.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51588.log.gz 2023-09-13T06:14:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39497.log 2023-09-13T06:14:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36672.log 2023-09-13T06:14:16.021 INFO:teuthology.orchestra.run.smithi130.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54672.log.gz 2023-09-13T06:14:16.023 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41165.log 2023-09-13T06:14:16.023 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39497.log.gz 2023-09-13T06:14:16.024 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36672.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.36672.log.gz 2023-09-13T06:14:16.024 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.46825.log 2023-09-13T06:14:16.025 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34754.log 2023-09-13T06:14:16.026 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41165.log.gz 2023-09-13T06:14:16.026 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.46825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46825.log.gz 2023-09-13T06:14:16.027 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36620.log 2023-09-13T06:14:16.029 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34754.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34754.log.gz 2023-09-13T06:14:16.029 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43024.log 2023-09-13T06:14:16.030 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36620.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36620.log.gz 2023-09-13T06:14:16.030 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44559.log 2023-09-13T06:14:16.032 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48822.log 2023-09-13T06:14:16.032 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43024.log.gz 2023-09-13T06:14:16.033 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44559.log: gzip -5 --verbose 88.2% -- /var/log/ceph/ceph-client.admin.40006.log -- replaced with /var/log/ceph/ceph-client.admin.44559.log.gz 2023-09-13T06:14:16.033 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:16.035 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48822.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48822.log.gz 2023-09-13T06:14:16.035 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40514.log 2023-09-13T06:14:16.036 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45655.log 2023-09-13T06:14:16.036 INFO:teuthology.orchestra.run.smithi130.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.40006.log.gz 2023-09-13T06:14:16.037 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40514.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.40514.log.gz --verbose 2023-09-13T06:14:16.038 INFO:teuthology.orchestra.run.smithi130.stderr: -- /var/log/ceph/ceph-client.admin.42445.log 2023-09-13T06:14:16.039 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45655.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45655.log.gz 2023-09-13T06:14:16.040 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38480.log 2023-09-13T06:14:16.040 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42445.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42445.log.gz 2023-09-13T06:14:16.041 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43052.log 2023-09-13T06:14:16.042 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38480.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38480.log.gz 2023-09-13T06:14:16.043 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44703.log 2023-09-13T06:14:16.044 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43052.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43052.log.gz 2023-09-13T06:14:16.044 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55192.log 2023-09-13T06:14:16.046 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41670.log 2023-09-13T06:14:16.046 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44703.log.gz 2023-09-13T06:14:16.047 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.55192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2023-09-13T06:14:16.047 INFO:teuthology.orchestra.run.smithi130.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55192.log.gz 2023-09-13T06:14:16.048 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2023-09-13T06:14:16.049 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41670.log.gz 2023-09-13T06:14:16.050 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36186.log: gzip -5 --verbose -- 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz 2023-09-13T06:14:16.051 INFO:teuthology.orchestra.run.smithi130.stderr: /var/log/ceph/ceph-client.admin.35143.log 2023-09-13T06:14:16.051 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46779.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2023-09-13T06:14:16.052 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42759.log 2023-09-13T06:14:16.053 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47668.log 2023-09-13T06:14:16.053 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35143.log.gz 2023-09-13T06:14:16.055 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42759.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42759.log.gz 2023-09-13T06:14:16.055 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47414.log 2023-09-13T06:14:16.056 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47668.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47668.log.gz 2023-09-13T06:14:16.056 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53913.log 2023-09-13T06:14:16.058 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38332.log 2023-09-13T06:14:16.058 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47414.log.gz 2023-09-13T06:14:16.060 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53913.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53913.log.gz 2023-09-13T06:14:16.060 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.51951.log 2023-09-13T06:14:16.060 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38332.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38332.log.gz 2023-09-13T06:14:16.061 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51946.log 2023-09-13T06:14:16.062 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.51951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51951.log.gz 2023-09-13T06:14:16.062 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37905.log 2023-09-13T06:14:16.063 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.51946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51946.log.gz 2023-09-13T06:14:16.064 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43298.log 2023-09-13T06:14:16.066 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37905.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37905.log.gz 2023-09-13T06:14:16.066 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55142.log 2023-09-13T06:14:16.067 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43298.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43298.log.gz 2023-09-13T06:14:16.067 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48796.log 2023-09-13T06:14:16.068 INFO:teuthology.orchestra.run.smithi164.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-09-13T06:14:16.069 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.55142.log: gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.54854.log -- replaced with /var/log/ceph/ceph-client.admin.55142.log.gz 2023-09-13T06:14:16.069 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:16.070 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48796.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48796.log.gz 2023-09-13T06:14:16.071 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54544.log 2023-09-13T06:14:16.072 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54854.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54854.log.gz -5 2023-09-13T06:14:16.072 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39233.log 2023-09-13T06:14:16.074 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50819.log 2023-09-13T06:14:16.074 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54544.log.gz 2023-09-13T06:14:16.075 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39233.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39233.log.gz 2023-09-13T06:14:16.075 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54048.log 2023-09-13T06:14:16.077 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50819.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50819.log.gz 2023-09-13T06:14:16.077 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.53524.log 2023-09-13T06:14:16.078 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54048.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54048.log.gz 2023-09-13T06:14:16.078 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46935.log 2023-09-13T06:14:16.079 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.53524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53524.log.gz 2023-09-13T06:14:16.080 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50767.log 2023-09-13T06:14:16.082 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46935.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46935.log.gz 2023-09-13T06:14:16.082 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47231.log 2023-09-13T06:14:16.083 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50767.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50767.log.gz 2023-09-13T06:14:16.083 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45150.log 2023-09-13T06:14:16.085 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47231.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44887.log 2023-09-13T06:14:16.085 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47231.log.gz 2023-09-13T06:14:16.086 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45150.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45150.log.gz 2023-09-13T06:14:16.086 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49990.log 2023-09-13T06:14:16.087 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44887.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.44887.log.gz 2023-09-13T06:14:16.088 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47095.log 2023-09-13T06:14:16.089 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48194.log 2023-09-13T06:14:16.089 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49990.log.gz 2023-09-13T06:14:16.091 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47095.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47095.log.gz 2023-09-13T06:14:16.091 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log 2023-09-13T06:14:16.092 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48194.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48194.log.gz 2023-09-13T06:14:16.092 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44729.log 2023-09-13T06:14:16.094 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34542.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43593.log 2023-09-13T06:14:16.094 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34542.log.gz 2023-09-13T06:14:16.095 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37278.log 88.4% 2023-09-13T06:14:16.095 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44729.log.gz 2023-09-13T06:14:16.096 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43593.log: gzip -5 88.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.43593.log.gz -- 2023-09-13T06:14:16.097 INFO:teuthology.orchestra.run.smithi130.stderr: /var/log/ceph/ceph-osd.1.log 2023-09-13T06:14:16.098 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37278.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37278.log.gz 2023-09-13T06:14:16.098 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41564.log 2023-09-13T06:14:16.100 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40597.log 2023-09-13T06:14:16.101 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41564.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41564.log.gz 2023-09-13T06:14:16.101 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50579.log 2023-09-13T06:14:16.103 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40597.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44835.log 2023-09-13T06:14:16.103 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40597.log.gz 2023-09-13T06:14:16.104 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54906.log 2023-09-13T06:14:16.105 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50579.log.gz 2023-09-13T06:14:16.106 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49125.log 2023-09-13T06:14:16.107 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54906.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz 2023-09-13T06:14:16.107 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45524.log 2023-09-13T06:14:16.108 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54906.log.gz 2023-09-13T06:14:16.108 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49125.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49125.log.gz 2023-09-13T06:14:16.109 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44216.log 2023-09-13T06:14:16.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45524.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34037.log 2023-09-13T06:14:16.111 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45524.log.gz 2023-09-13T06:14:16.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52069.log 2023-09-13T06:14:16.113 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44216.log.gz 2023-09-13T06:14:16.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34037.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.34037.log.gz /var/log/ceph/ceph-client.admin.46116.log 2023-09-13T06:14:16.114 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:16.115 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52069.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52069.log.gz 2023-09-13T06:14:16.116 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39445.log 2023-09-13T06:14:16.117 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46116.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36420.log 2023-09-13T06:14:16.117 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46116.log.gz 2023-09-13T06:14:16.118 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36342.log 2023-09-13T06:14:16.118 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39445.log.gz 2023-09-13T06:14:16.120 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43376.log 2023-09-13T06:14:16.120 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36420.log.gz 2023-09-13T06:14:16.122 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35482.log 2023-09-13T06:14:16.122 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36342.log.gz 2023-09-13T06:14:16.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49856.log 2023-09-13T06:14:16.124 INFO:teuthology.orchestra.run.smithi130.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43376.log.gz 2023-09-13T06:14:16.125 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35482.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35482.log.gz 2023-09-13T06:14:16.125 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41139.log 2023-09-13T06:14:16.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40566.log 2023-09-13T06:14:16.127 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41139.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49856.log.gz 2023-09-13T06:14:16.128 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45863.log 2023-09-13T06:14:16.128 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41139.log.gz 2023-09-13T06:14:16.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40566.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40566.log.gz 2023-09-13T06:14:16.129 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46703.log 2023-09-13T06:14:16.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37735.log 2023-09-13T06:14:16.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46703.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45863.log.gz 2023-09-13T06:14:16.132 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46493.log 2023-09-13T06:14:16.132 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46703.log.gz 2023-09-13T06:14:16.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45986.log 2023-09-13T06:14:16.134 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37735.log.gz 2023-09-13T06:14:16.135 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44190.log 2023-09-13T06:14:16.136 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45986.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46493.log.gz 2023-09-13T06:14:16.137 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2023-09-13T06:14:16.137 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45986.log.gz 2023-09-13T06:14:16.138 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44190.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44190.log.gz 2023-09-13T06:14:16.138 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36238.log 2023-09-13T06:14:16.139 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34752.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2023-09-13T06:14:16.140 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36212.log 2023-09-13T06:14:16.141 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52492.log 2023-09-13T06:14:16.142 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36238.log.gz 2023-09-13T06:14:16.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36212.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36212.log.gz 2023-09-13T06:14:16.143 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41722.log 2023-09-13T06:14:16.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52492.log: gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.45785.log 2023-09-13T06:14:16.145 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52492.log.gz 2023-09-13T06:14:16.146 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53529.log 2023-09-13T06:14:16.146 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41722.log.gz 2023-09-13T06:14:16.147 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52204.log 2023-09-13T06:14:16.148 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45785.log.gz 2023-09-13T06:14:16.149 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.53529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44939.log 2023-09-13T06:14:16.149 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53529.log.gz 2023-09-13T06:14:16.150 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52204.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52204.log.gz 2023-09-13T06:14:16.150 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49438.log 2023-09-13T06:14:16.152 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36264.log 2023-09-13T06:14:16.153 INFO:teuthology.orchestra.run.smithi130.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44939.log.gz 2023-09-13T06:14:16.153 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49438.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49438.log.gz 2023-09-13T06:14:16.153 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45415.log 2023-09-13T06:14:16.158 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46142.log 2023-09-13T06:14:16.158 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45415.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36264.log.gz 2023-09-13T06:14:16.159 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52544.log 2023-09-13T06:14:16.159 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45415.log.gz 2023-09-13T06:14:16.159 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46142.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43567.log 2023-09-13T06:14:16.159 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46142.log.gz 2023-09-13T06:14:16.160 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52544.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52544.log.gz 2023-09-13T06:14:16.160 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47336.log 2023-09-13T06:14:16.161 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43567.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49568.log 2023-09-13T06:14:16.161 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43567.log.gz 2023-09-13T06:14:16.162 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53745.log 2023-09-13T06:14:16.163 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47336.log.gz 2023-09-13T06:14:16.164 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36316.log 2023-09-13T06:14:16.165 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53745.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49568.log.gz 2023-09-13T06:14:16.166 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53745.log.gz 2023-09-13T06:14:16.166 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45296.log 2023-09-13T06:14:16.168 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50949.log 2023-09-13T06:14:16.168 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36316.log.gz 2023-09-13T06:14:16.169 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45296.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49516.log 2023-09-13T06:14:16.169 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45296.log.gz 2023-09-13T06:14:16.170 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34755.log 2023-09-13T06:14:16.170 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50949.log.gz 2023-09-13T06:14:16.172 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45889.log 2023-09-13T06:14:16.172 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49516.log.gz 2023-09-13T06:14:16.173 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34755.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37070.log 2023-09-13T06:14:16.173 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34755.log.gz 2023-09-13T06:14:16.175 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41510.log 2023-09-13T06:14:16.175 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45889.log.gz 2023-09-13T06:14:16.176 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37070.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37070.log.gz -5 2023-09-13T06:14:16.176 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41113.log 2023-09-13T06:14:16.177 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38952.log 2023-09-13T06:14:16.178 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41113.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41510.log.gz 2023-09-13T06:14:16.179 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35456.log 2023-09-13T06:14:16.179 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41113.log.gz 2023-09-13T06:14:16.181 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38952.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.50688.log 2023-09-13T06:14:16.181 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38952.log.gz 2023-09-13T06:14:16.182 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35456.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52256.log 2023-09-13T06:14:16.182 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35456.log.gz 2023-09-13T06:14:16.184 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50688.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50688.log.gz 2023-09-13T06:14:16.184 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34963.log 2023-09-13T06:14:16.185 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50445.log 2023-09-13T06:14:16.186 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52256.log.gz 2023-09-13T06:14:16.186 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50501.log 2023-09-13T06:14:16.187 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50445.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34963.log.gz 2023-09-13T06:14:16.188 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53060.log 2023-09-13T06:14:16.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50445.log.gz 2023-09-13T06:14:16.190 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41967.log 2023-09-13T06:14:16.190 INFO:teuthology.orchestra.run.smithi130.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50501.log.gz 2023-09-13T06:14:16.191 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53060.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53060.log.gz 2023-09-13T06:14:16.191 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38421.log 2023-09-13T06:14:16.193 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48633.log 2023-09-13T06:14:16.193 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41967.log.gz 2023-09-13T06:14:16.194 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38421.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38421.log.gz 2023-09-13T06:14:16.195 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36368.log 2023-09-13T06:14:16.196 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39082.log 2023-09-13T06:14:16.196 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48633.log.gz 2023-09-13T06:14:16.197 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36368.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53376.log 2023-09-13T06:14:16.198 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36368.log.gz 2023-09-13T06:14:16.199 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49934.log 2023-09-13T06:14:16.199 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39082.log.gz 2023-09-13T06:14:16.201 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44119.log 2023-09-13T06:14:16.201 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49934.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53376.log.gz 2023-09-13T06:14:16.202 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52414.log 2023-09-13T06:14:16.202 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49934.log.gz 2023-09-13T06:14:16.204 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44119.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44533.log 2023-09-13T06:14:16.204 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44119.log.gz 2023-09-13T06:14:16.205 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52414.log: gzip 89.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.52414.log.gz --verbose 2023-09-13T06:14:16.205 INFO:teuthology.orchestra.run.smithi130.stderr: -- /var/log/ceph/ceph-client.admin.45550.log 2023-09-13T06:14:16.207 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49016.log 2023-09-13T06:14:16.208 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44533.log: /var/log/ceph/ceph-client.admin.45550.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44533.log.gz 2023-09-13T06:14:16.208 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37763.log 2023-09-13T06:14:16.208 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45550.log.gz 2023-09-13T06:14:16.210 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50393.log 2023-09-13T06:14:16.210 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37763.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49016.log.gz 2023-09-13T06:14:16.211 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45811.log 2023-09-13T06:14:16.212 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37763.log.gz 2023-09-13T06:14:16.212 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39980.log 2023-09-13T06:14:16.213 INFO:teuthology.orchestra.run.smithi130.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50393.log.gz 2023-09-13T06:14:16.214 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34545.log 2023-09-13T06:14:16.215 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45811.log.gz 2023-09-13T06:14:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39980.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-13T06:14:16.216 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39980.log.gz 2023-09-13T06:14:16.217 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47519.log 2023-09-13T06:14:16.217 INFO:teuthology.orchestra.run.smithi130.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34545.log.gz 2023-09-13T06:14:16.219 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48938.log 2023-09-13T06:14:16.220 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36134.log 2023-09-13T06:14:16.221 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48938.log: 86.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-13T06:14:16.221 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47519.log.gz 2023-09-13T06:14:16.222 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48938.log.gz 2023-09-13T06:14:16.223 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42523.log 2023-09-13T06:14:16.223 INFO:teuthology.orchestra.run.smithi164.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-09-13T06:14:16.224 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36134.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36134.log.gz 2023-09-13T06:14:16.224 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2023-09-13T06:14:16.226 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39578.log 2023-09-13T06:14:16.226 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42523.log.gz 2023-09-13T06:14:16.227 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51772.log 2023-09-13T06:14:16.227 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2023-09-13T06:14:16.229 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50042.log 2023-09-13T06:14:16.229 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39578.log.gz 2023-09-13T06:14:16.230 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51772.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52596.log 2023-09-13T06:14:16.230 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51772.log.gz 2023-09-13T06:14:16.231 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50042.log: gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.51746.log 2023-09-13T06:14:16.232 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50042.log.gz 2023-09-13T06:14:16.233 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50553.log 2023-09-13T06:14:16.234 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51746.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52596.log.gz 2023-09-13T06:14:16.235 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49230.log 2023-09-13T06:14:16.235 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51746.log.gz 2023-09-13T06:14:16.236 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49764.log 2023-09-13T06:14:16.236 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50553.log.gz 2023-09-13T06:14:16.238 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35326.log 2023-09-13T06:14:16.239 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49764.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49230.log.gz 2023-09-13T06:14:16.239 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49764.log.gz 2023-09-13T06:14:16.239 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54074.log 2023-09-13T06:14:16.241 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38874.log 2023-09-13T06:14:16.241 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35326.log.gz 2023-09-13T06:14:16.243 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54074.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54074.log.gz -5 2023-09-13T06:14:16.243 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42789.log 2023-09-13T06:14:16.244 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41482.log 2023-09-13T06:14:16.244 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38874.log.gz 2023-09-13T06:14:16.245 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42789.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42789.log.gz 2023-09-13T06:14:16.245 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41748.log 2023-09-13T06:14:16.247 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39640.log 2023-09-13T06:14:16.247 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41482.log.gz 2023-09-13T06:14:16.248 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41748.log: gzip 87.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.41748.log.gz --verbose 2023-09-13T06:14:16.248 INFO:teuthology.orchestra.run.smithi130.stderr: -- /var/log/ceph/ceph-client.admin.35378.log 2023-09-13T06:14:16.250 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43780.log 2023-09-13T06:14:16.251 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39640.log.gz 2023-09-13T06:14:16.251 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47069.log 2023-09-13T06:14:16.252 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43780.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35378.log.gz 2023-09-13T06:14:16.254 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36831.log 2023-09-13T06:14:16.254 INFO:teuthology.orchestra.run.smithi130.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43780.log.gz 2023-09-13T06:14:16.254 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40487.log 2023-09-13T06:14:16.255 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47069.log.gz 2023-09-13T06:14:16.256 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36831.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46175.log 2023-09-13T06:14:16.256 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36831.log.gz 2023-09-13T06:14:16.258 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40487.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.40487.log.gz --verbose 2023-09-13T06:14:16.258 INFO:teuthology.orchestra.run.smithi130.stderr: -- /var/log/ceph/ceph-client.admin.46651.log 2023-09-13T06:14:16.259 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46175.log: gzip -5 --verbose 89.3% -- /var/log/ceph/ceph-client.admin.47467.log -- replaced with /var/log/ceph/ceph-client.admin.46175.log.gz 2023-09-13T06:14:16.259 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:16.260 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42315.log 88.3% 2023-09-13T06:14:16.261 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46651.log.gz 2023-09-13T06:14:16.261 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47467.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47467.log.gz 2023-09-13T06:14:16.262 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47545.log 2023-09-13T06:14:16.264 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51326.log 2023-09-13T06:14:16.264 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42315.log.gz 2023-09-13T06:14:16.265 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47545.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44415.log 2023-09-13T06:14:16.265 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47545.log.gz 2023-09-13T06:14:16.267 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51326.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51326.log.gz 2023-09-13T06:14:16.267 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38061.log 2023-09-13T06:14:16.269 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46405.log 2023-09-13T06:14:16.269 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38061.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44415.log.gz 2023-09-13T06:14:16.270 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54126.log 2023-09-13T06:14:16.270 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38061.log.gz 2023-09-13T06:14:16.271 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38926.log 2023-09-13T06:14:16.271 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46405.log.gz 2023-09-13T06:14:16.272 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54126.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54126.log.gz 2023-09-13T06:14:16.273 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42127.log 2023-09-13T06:14:16.275 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51554.log 2023-09-13T06:14:16.275 INFO:teuthology.orchestra.run.smithi130.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38926.log.gz 2023-09-13T06:14:16.276 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34010.log 2023-09-13T06:14:16.276 INFO:teuthology.orchestra.run.smithi130.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42127.log.gz 2023-09-13T06:14:16.277 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51554.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.51554.log.gz --verbose 2023-09-13T06:14:16.277 INFO:teuthology.orchestra.run.smithi130.stderr: -- /var/log/ceph/ceph-client.admin.43140.log 2023-09-13T06:14:16.278 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34010.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34010.log.gz 2023-09-13T06:14:16.279 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42919.log 2023-09-13T06:14:16.280 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43140.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43140.log.gz 2023-09-13T06:14:16.281 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52335.log 2023-09-13T06:14:16.282 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42919.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51470.log 2023-09-13T06:14:16.282 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42919.log.gz 2023-09-13T06:14:16.283 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50068.log 2023-09-13T06:14:16.283 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52335.log.gz 2023-09-13T06:14:16.285 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37044.log 2023-09-13T06:14:16.286 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50068.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51470.log.gz 2023-09-13T06:14:16.286 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50527.log 2023-09-13T06:14:16.286 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50068.log.gz 2023-09-13T06:14:16.287 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37044.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37044.log.gz 2023-09-13T06:14:16.288 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36536.log 2023-09-13T06:14:16.289 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48740.log 2023-09-13T06:14:16.289 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50527.log.gz 2023-09-13T06:14:16.291 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47174.log 2023-09-13T06:14:16.291 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36536.log.gz 2023-09-13T06:14:16.292 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34063.log 2023-09-13T06:14:16.293 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48740.log.gz 2023-09-13T06:14:16.294 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47174.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47174.log.gz -5 2023-09-13T06:14:16.294 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47597.log 2023-09-13T06:14:16.295 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46987.log 2023-09-13T06:14:16.295 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34063.log.gz 2023-09-13T06:14:16.297 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47597.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43114.log 2023-09-13T06:14:16.297 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47597.log.gz 2023-09-13T06:14:16.298 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34538.log 2023-09-13T06:14:16.299 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43114.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46987.log.gz 2023-09-13T06:14:16.301 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53168.log 2023-09-13T06:14:16.301 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43114.log.gz 2023-09-13T06:14:16.302 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34538.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34538.log.gz 2023-09-13T06:14:16.302 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54413.log 2023-09-13T06:14:16.303 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45080.log 2023-09-13T06:14:16.304 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54413.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53168.log.gz 2023-09-13T06:14:16.305 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52282.log 2023-09-13T06:14:16.305 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54413.log.gz 2023-09-13T06:14:16.306 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39720.log 2023-09-13T06:14:16.306 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45080.log.gz 2023-09-13T06:14:16.307 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52282.log: gzip -5 88.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.52282.log.gz -- 2023-09-13T06:14:16.308 INFO:teuthology.orchestra.run.smithi130.stderr: /var/log/ceph/ceph-client.admin.47623.log 2023-09-13T06:14:16.309 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52982.log 2023-09-13T06:14:16.310 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47623.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39720.log.gz 2023-09-13T06:14:16.311 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39928.log 2023-09-13T06:14:16.311 INFO:teuthology.orchestra.run.smithi130.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47623.log.gz 2023-09-13T06:14:16.312 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47850.log 2023-09-13T06:14:16.313 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39928.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52982.log.gz 2023-09-13T06:14:16.314 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51294.log 2023-09-13T06:14:16.314 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39928.log.gz 2023-09-13T06:14:16.315 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47850.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37375.log 2023-09-13T06:14:16.315 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47850.log.gz 2023-09-13T06:14:16.317 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51294.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51294.log.gz 2023-09-13T06:14:16.317 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37825.log 2023-09-13T06:14:16.318 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36056.log 2023-09-13T06:14:16.320 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37375.log: /var/log/ceph/ceph-client.admin.37825.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37375.log.gz 2023-09-13T06:14:16.320 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51640.log 2023-09-13T06:14:16.320 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37825.log.gz 2023-09-13T06:14:16.321 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51496.log 2023-09-13T06:14:16.322 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51640.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36056.log.gz 2023-09-13T06:14:16.323 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55116.log 2023-09-13T06:14:16.323 INFO:teuthology.orchestra.run.smithi130.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51640.log.gz 2023-09-13T06:14:16.324 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38447.log 2023-09-13T06:14:16.324 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51496.log.gz 2023-09-13T06:14:16.326 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.55116.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51444.log 2023-09-13T06:14:16.326 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55116.log.gz 2023-09-13T06:14:16.327 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50975.log 2023-09-13T06:14:16.327 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38447.log.gz 2023-09-13T06:14:16.328 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48597.log 2023-09-13T06:14:16.330 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51444.log: /var/log/ceph/ceph-client.admin.50975.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51444.log.gz 2023-09-13T06:14:16.330 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39666.log 2023-09-13T06:14:16.330 INFO:teuthology.orchestra.run.smithi130.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50975.log.gz 2023-09-13T06:14:16.332 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48597.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48597.log.gz -5 2023-09-13T06:14:16.332 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46573.log 2023-09-13T06:14:16.333 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39666.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39666.log.gz 2023-09-13T06:14:16.333 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47571.log 2023-09-13T06:14:16.335 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46573.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52823.log 2023-09-13T06:14:16.335 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46573.log.gz 2023-09-13T06:14:16.336 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47571.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47571.log.gz 2023-09-13T06:14:16.336 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49282.log 2023-09-13T06:14:16.338 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41616.log 2023-09-13T06:14:16.338 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52823.log.gz 2023-09-13T06:14:16.339 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34311.log 2023-09-13T06:14:16.340 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49282.log.gz 2023-09-13T06:14:16.341 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33886.log 2023-09-13T06:14:16.341 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41616.log.gz 2023-09-13T06:14:16.342 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34311.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34311.log.gz 2023-09-13T06:14:16.342 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42075.log 2023-09-13T06:14:16.344 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33886.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35594.log 2023-09-13T06:14:16.344 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33886.log.gz 2023-09-13T06:14:16.346 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50605.log 2023-09-13T06:14:16.346 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42075.log.gz 2023-09-13T06:14:16.347 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35594.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35594.log.gz 2023-09-13T06:14:16.347 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48350.log 2023-09-13T06:14:16.349 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50605.log: gzip -5 87.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.50605.log.gz /var/log/ceph/ceph-client.admin.54932.log 2023-09-13T06:14:16.349 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:16.350 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48350.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37791.log 2023-09-13T06:14:16.350 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48350.log.gz 2023-09-13T06:14:16.351 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43885.log 2023-09-13T06:14:16.352 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54932.log.gz 2023-09-13T06:14:16.353 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43220.log 2023-09-13T06:14:16.354 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43885.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37791.log.gz 2023-09-13T06:14:16.355 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39207.log 2023-09-13T06:14:16.355 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43885.log.gz 2023-09-13T06:14:16.356 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37657.log 2023-09-13T06:14:16.357 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39207.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43220.log.gz 2023-09-13T06:14:16.358 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38087.log 2023-09-13T06:14:16.358 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39207.log.gz 2023-09-13T06:14:16.359 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45123.log 2023-09-13T06:14:16.360 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37657.log.gz 2023-09-13T06:14:16.361 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37304.log 2023-09-13T06:14:16.361 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38087.log.gz 2023-09-13T06:14:16.362 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45123.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.43702.log -- replaced with /var/log/ceph/ceph-client.admin.45123.log.gz 2023-09-13T06:14:16.363 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:16.364 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37304.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35900.log 2023-09-13T06:14:16.364 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37304.log.gz 2023-09-13T06:14:16.365 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43702.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43702.log.gz 2023-09-13T06:14:16.365 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36992.log 2023-09-13T06:14:16.367 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50740.log 2023-09-13T06:14:16.367 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35900.log.gz 2023-09-13T06:14:16.368 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39798.log 2023-09-13T06:14:16.369 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36992.log.gz 2023-09-13T06:14:16.370 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50740.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46012.log 2023-09-13T06:14:16.370 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50740.log.gz 2023-09-13T06:14:16.371 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54335.log 2023-09-13T06:14:16.371 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39798.log.gz 2023-09-13T06:14:16.372 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47981.log 2023-09-13T06:14:16.373 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46012.log.gz 2023-09-13T06:14:16.374 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49334.log 2023-09-13T06:14:16.375 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54335.log.gz/var/log/ceph/ceph-client.admin.47981.log: 2023-09-13T06:14:16.375 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43080.log 2023-09-13T06:14:16.376 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47981.log.gz 2023-09-13T06:14:16.377 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49334.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.40421.log -- replaced with /var/log/ceph/ceph-client.admin.49334.log.gz 2023-09-13T06:14:16.377 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:16.378 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43080.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43080.log.gz 2023-09-13T06:14:16.379 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48430.log 2023-09-13T06:14:16.380 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40421.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36779.log 2023-09-13T06:14:16.380 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40421.log.gz 2023-09-13T06:14:16.382 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49672.log 2023-09-13T06:14:16.382 INFO:teuthology.orchestra.run.smithi130.stderr: 91.1%/var/log/ceph/ceph-client.admin.36779.log: -- replaced with /var/log/ceph/ceph-client.admin.48430.log.gz 2023-09-13T06:14:16.383 INFO:teuthology.orchestra.run.smithi130.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36779.log.gz 2023-09-13T06:14:16.383 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40317.log 2023-09-13T06:14:16.385 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51418.log 2023-09-13T06:14:16.385 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40317.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49672.log.gz 2023-09-13T06:14:16.386 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53220.log 2023-09-13T06:14:16.386 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40317.log.gz 2023-09-13T06:14:16.387 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51418.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51418.log.gz 2023-09-13T06:14:16.389 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2023-09-13T06:14:16.390 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53220.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52797.log 2023-09-13T06:14:16.391 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53220.log.gz 2023-09-13T06:14:16.392 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43166.log 2023-09-13T06:14:16.392 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2023-09-13T06:14:16.393 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42655.log 2023-09-13T06:14:16.394 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52797.log.gz 2023-09-13T06:14:16.395 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44783.log 2023-09-13T06:14:16.396 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42655.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43166.log.gz 2023-09-13T06:14:16.396 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39155.log 2023-09-13T06:14:16.397 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42655.log.gz 2023-09-13T06:14:16.397 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44783.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44783.log.gz 2023-09-13T06:14:16.398 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34534.log 2023-09-13T06:14:16.399 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39155.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52147.log 2023-09-13T06:14:16.400 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39155.log.gz 2023-09-13T06:14:16.401 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46902.log 2023-09-13T06:14:16.401 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34534.log.gz 2023-09-13T06:14:16.402 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49099.log 2023-09-13T06:14:16.403 INFO:teuthology.orchestra.run.smithi130.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52147.log.gz 2023-09-13T06:14:16.404 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47388.log 2023-09-13T06:14:16.405 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46902.log.gz/var/log/ceph/ceph-client.admin.49099.log: 2023-09-13T06:14:16.406 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-13T06:14:16.406 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49099.log.gz 2023-09-13T06:14:16.407 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47388.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-09-13T06:14:16.407 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47388.log.gz 2023-09-13T06:14:16.408 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34389.log 2023-09-13T06:14:16.410 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34546.log 2023-09-13T06:14:16.412 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34389.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34389.log.gz 2023-09-13T06:14:16.412 INFO:teuthology.orchestra.run.smithi130.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-13T06:14:16.414 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48324.log 2023-09-13T06:14:16.416 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37122.log 2023-09-13T06:14:16.416 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34546.log.gz 2023-09-13T06:14:16.417 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44913.log 2023-09-13T06:14:16.418 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37122.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48324.log.gz 2023-09-13T06:14:16.419 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37122.log.gz 2023-09-13T06:14:16.420 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53689.log 2023-09-13T06:14:16.422 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38717.log 2023-09-13T06:14:16.423 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53689.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44913.log.gz 2023-09-13T06:14:16.423 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53689.log.gz 2023-09-13T06:14:16.424 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50094.log 2023-09-13T06:14:16.426 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48571.log 2023-09-13T06:14:16.427 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50094.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38717.log.gz 2023-09-13T06:14:16.427 INFO:teuthology.orchestra.run.smithi130.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50094.log.gz 2023-09-13T06:14:16.428 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-09-13T06:14:16.430 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43426.log 2023-09-13T06:14:16.431 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mds.a.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48571.log.gz 2023-09-13T06:14:16.433 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33063.log 2023-09-13T06:14:16.434 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43426.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43426.log.gz 2023-09-13T06:14:16.436 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36857.log 2023-09-13T06:14:16.438 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.tmp-client.admin.33063.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33063.log.gz 2023-09-13T06:14:16.439 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52095.log 2023-09-13T06:14:16.441 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36857.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36857.log.gz 2023-09-13T06:14:16.443 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35709.log 2023-09-13T06:14:16.445 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52095.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52095.log.gz 2023-09-13T06:14:16.447 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37877.log 2023-09-13T06:14:16.448 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.35709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35709.log.gz 2023-09-13T06:14:16.450 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42733.log 2023-09-13T06:14:16.452 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37877.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37877.log.gz 2023-09-13T06:14:16.453 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54205.log 2023-09-13T06:14:16.455 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42733.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42733.log.gz 2023-09-13T06:14:16.457 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38796.log 2023-09-13T06:14:16.459 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54205.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54205.log.gz 2023-09-13T06:14:16.461 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37349.log 2023-09-13T06:14:16.463 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38796.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38796.log.gz 2023-09-13T06:14:16.464 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52884.log 2023-09-13T06:14:16.466 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37349.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37349.log.gz 2023-09-13T06:14:16.467 INFO:teuthology.orchestra.run.smithi164.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-09-13T06:14:16.468 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50897.log 2023-09-13T06:14:16.470 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52884.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52884.log.gz 2023-09-13T06:14:16.472 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36082.log 2023-09-13T06:14:16.474 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50897.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50897.log.gz 2023-09-13T06:14:16.475 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42023.log 2023-09-13T06:14:16.477 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36082.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36082.log.gz 2023-09-13T06:14:16.479 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41377.log 2023-09-13T06:14:16.481 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42023.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42023.log.gz 2023-09-13T06:14:16.482 INFO:teuthology.orchestra.run.smithi164.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-09-13T06:14:16.483 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38362.log 2023-09-13T06:14:16.484 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41377.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41377.log.gz 2023-09-13T06:14:16.486 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51053.log 2023-09-13T06:14:16.488 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38362.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38362.log.gz 2023-09-13T06:14:16.490 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45389.log 2023-09-13T06:14:16.491 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51053.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51053.log.gz 2023-09-13T06:14:16.493 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54620.log 2023-09-13T06:14:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45389.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45389.log.gz 2023-09-13T06:14:16.497 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38191.log 2023-09-13T06:14:16.499 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54620.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54620.log.gz 2023-09-13T06:14:16.500 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47121.log 2023-09-13T06:14:16.503 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38191.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.38191.log.gz 2023-09-13T06:14:16.504 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43989.log 2023-09-13T06:14:16.506 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47121.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47121.log.gz 2023-09-13T06:14:16.508 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50174.log 2023-09-13T06:14:16.510 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43989.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43989.log.gz 2023-09-13T06:14:16.512 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35404.log 2023-09-13T06:14:16.514 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50174.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50174.log.gz 2023-09-13T06:14:16.515 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53991.log 2023-09-13T06:14:16.517 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35404.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35404.log.gz 2023-09-13T06:14:16.519 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52719.log 2023-09-13T06:14:16.521 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53991.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53991.log.gz 2023-09-13T06:14:16.522 INFO:teuthology.orchestra.run.smithi164.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-09-13T06:14:16.522 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42262.log 2023-09-13T06:14:16.524 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52719.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52719.log.gz 2023-09-13T06:14:16.526 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53114.log 2023-09-13T06:14:16.528 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42262.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42262.log.gz 2023-09-13T06:14:16.530 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41696.log 2023-09-13T06:14:16.531 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53114.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53114.log.gz 2023-09-13T06:14:16.533 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38306.log 2023-09-13T06:14:16.535 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41696.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41696.log.gz 2023-09-13T06:14:16.537 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37200.log 2023-09-13T06:14:16.539 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38306.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38306.log.gz 2023-09-13T06:14:16.541 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44861.log 2023-09-13T06:14:16.543 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37200.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37200.log.gz 2023-09-13T06:14:16.544 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52466.log 2023-09-13T06:14:16.546 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44861.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44861.log.gz 2023-09-13T06:14:16.548 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41876.log 2023-09-13T06:14:16.550 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52466.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52466.log.gz 2023-09-13T06:14:16.551 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49962.log 2023-09-13T06:14:16.553 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41876.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41876.log.gz 2023-09-13T06:14:16.555 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53825.log 2023-09-13T06:14:16.557 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49962.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49962.log.gz 2023-09-13T06:14:16.559 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42497.log 2023-09-13T06:14:16.561 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53825.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53825.log.gz 2023-09-13T06:14:16.562 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51209.log 2023-09-13T06:14:16.564 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42497.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42497.log.gz 2023-09-13T06:14:16.566 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40148.log 2023-09-13T06:14:16.568 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51209.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51209.log.gz 2023-09-13T06:14:16.569 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38769.log 2023-09-13T06:14:16.572 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40148.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40148.log.gz 2023-09-13T06:14:16.573 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43728.log 2023-09-13T06:14:16.575 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38769.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38769.log.gz 2023-09-13T06:14:16.576 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47147.log 2023-09-13T06:14:16.578 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43728.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43728.log.gz 2023-09-13T06:14:16.580 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51991.log 2023-09-13T06:14:16.582 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47147.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47147.log.gz 2023-09-13T06:14:16.584 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36588.log 2023-09-13T06:14:16.586 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51991.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51991.log.gz 2023-09-13T06:14:16.587 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46830.log 2023-09-13T06:14:16.589 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36588.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36588.log.gz 2023-09-13T06:14:16.591 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35739.log 2023-09-13T06:14:16.592 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.46830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46830.log.gz 2023-09-13T06:14:16.594 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39902.log 2023-09-13T06:14:16.596 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35739.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35739.log.gz 2023-09-13T06:14:16.598 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52771.log 2023-09-13T06:14:16.603 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39902.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39902.log.gz 2023-09-13T06:14:16.603 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53570.log 2023-09-13T06:14:16.604 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52771.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.52771.log.gz 2023-09-13T06:14:16.605 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40780.log 2023-09-13T06:14:16.607 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53570.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53570.log.gz 2023-09-13T06:14:16.609 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36888.log 2023-09-13T06:14:16.611 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40780.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40780.log.gz 2023-09-13T06:14:16.612 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48526.log 2023-09-13T06:14:16.614 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36888.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36888.log.gz 2023-09-13T06:14:16.616 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52849.log 2023-09-13T06:14:16.617 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.48526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48526.log.gz 2023-09-13T06:14:16.619 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37631.log 2023-09-13T06:14:16.621 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52849.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52849.log.gz 2023-09-13T06:14:16.623 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36004.log 2023-09-13T06:14:16.624 INFO:teuthology.orchestra.run.smithi164.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-09-13T06:14:16.625 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37631.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37631.log.gz 2023-09-13T06:14:16.626 INFO:teuthology.orchestra.run.smithi164.stderr: 2023-09-13T06:14:16.626 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m1.017s 2023-09-13T06:14:16.626 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m4.440s 2023-09-13T06:14:16.626 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.442s 2023-09-13T06:14:16.627 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38743.log 2023-09-13T06:14:16.628 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36004.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36004.log.gz 2023-09-13T06:14:16.630 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43272.log 2023-09-13T06:14:16.632 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38743.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38743.log.gz 2023-09-13T06:14:16.634 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34735.log 2023-09-13T06:14:16.635 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43272.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43272.log.gz 2023-09-13T06:14:16.637 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33984.log 2023-09-13T06:14:16.639 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34735.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34735.log.gz 2023-09-13T06:14:16.641 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52388.log 2023-09-13T06:14:16.643 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33984.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33984.log.gz 2023-09-13T06:14:16.644 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55012.log 2023-09-13T06:14:16.647 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52388.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52388.log.gz 2023-09-13T06:14:16.648 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44757.log 2023-09-13T06:14:16.650 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.55012.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55012.log.gz 2023-09-13T06:14:16.652 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49908.log 2023-09-13T06:14:16.654 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44757.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44757.log.gz 2023-09-13T06:14:16.656 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34748.log 2023-09-13T06:14:16.658 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49908.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49908.log.gz 2023-09-13T06:14:16.659 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2023-09-13T06:14:16.661 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34748.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34748.log.gz 2023-09-13T06:14:16.663 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44350.log 2023-09-13T06:14:16.665 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49732.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2023-09-13T06:14:16.667 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44164.log 2023-09-13T06:14:16.669 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44350.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44350.log.gz 2023-09-13T06:14:16.670 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42471.log 2023-09-13T06:14:16.672 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44164.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44164.log.gz 2023-09-13T06:14:16.674 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46377.log 2023-09-13T06:14:16.676 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42471.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42471.log.gz 2023-09-13T06:14:16.678 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33919.log 2023-09-13T06:14:16.681 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46377.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46377.log.gz 2023-09-13T06:14:16.681 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53402.log 2023-09-13T06:14:16.684 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33919.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33919.log.gz 2023-09-13T06:14:16.685 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40369.log 2023-09-13T06:14:16.687 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53402.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53402.log.gz 2023-09-13T06:14:16.689 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50226.log 2023-09-13T06:14:16.691 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40369.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40369.log.gz 2023-09-13T06:14:16.693 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45707.log 2023-09-13T06:14:16.695 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50226.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50226.log.gz 2023-09-13T06:14:16.697 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45035.log 2023-09-13T06:14:16.699 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45707.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45707.log.gz 2023-09-13T06:14:16.700 INFO:teuthology.orchestra.run.smithi130.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-09-13T06:14:16.700 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39692.log 2023-09-13T06:14:16.702 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.45035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50714.log 2023-09-13T06:14:16.703 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0%/var/log/ceph/ceph-client.admin.39692.log: -- replaced with /var/log/ceph/ceph-client.0.45035.log.gz 2023-09-13T06:14:16.703 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39692.log.gz 2023-09-13T06:14:16.704 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45054.log 2023-09-13T06:14:16.706 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41087.log 2023-09-13T06:14:16.707 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45054.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50714.log.gz 2023-09-13T06:14:16.708 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45054.log.gz 2023-09-13T06:14:16.708 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47772.log 2023-09-13T06:14:16.710 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.41087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52308.log 2023-09-13T06:14:16.711 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47772.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41087.log.gz 2023-09-13T06:14:16.712 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47772.log.gz 2023-09-13T06:14:16.712 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51079.log 2023-09-13T06:14:16.715 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.52308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53965.log 2023-09-13T06:14:16.716 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51079.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51079.log.gz 2023-09-13T06:14:16.716 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52308.log.gz 2023-09-13T06:14:16.716 INFO:teuthology.orchestra.run.smithi130.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-09-13T06:14:16.717 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34231.log 2023-09-13T06:14:16.718 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54646.log 2023-09-13T06:14:16.719 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53965.log.gz 2023-09-13T06:14:16.719 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2023-09-13T06:14:16.720 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34231.log.gz 2023-09-13T06:14:16.721 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47441.log 2023-09-13T06:14:16.722 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54646.log.gz 2023-09-13T06:14:16.723 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34415.log 2023-09-13T06:14:16.723 INFO:teuthology.orchestra.run.smithi130.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2023-09-13T06:14:16.725 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47441.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36394.log 2023-09-13T06:14:16.725 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47441.log.gz 2023-09-13T06:14:16.726 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35222.log 2023-09-13T06:14:16.726 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34415.log.gz 2023-09-13T06:14:16.727 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39181.log 2023-09-13T06:14:16.727 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36394.log.gz 2023-09-13T06:14:16.729 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35222.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49464.log 2023-09-13T06:14:16.729 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35222.log.gz 2023-09-13T06:14:16.730 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39181.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38848.log 2023-09-13T06:14:16.730 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39181.log.gz 2023-09-13T06:14:16.731 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51900.log 2023-09-13T06:14:16.731 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49464.log.gz 2023-09-13T06:14:16.733 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38822.log 2023-09-13T06:14:16.733 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38848.log.gz 2023-09-13T06:14:16.734 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51900.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51900.log.gz 2023-09-13T06:14:16.734 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42049.log 2023-09-13T06:14:16.736 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40728.log 2023-09-13T06:14:16.736 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38822.log.gz 2023-09-13T06:14:16.737 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42049.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46844.log 2023-09-13T06:14:16.737 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42049.log.gz 2023-09-13T06:14:16.739 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33518.log 2023-09-13T06:14:16.739 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40728.log.gz 2023-09-13T06:14:16.740 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45629.log 2023-09-13T06:14:16.741 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46844.log.gz 2023-09-13T06:14:16.741 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33518.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33518.log.gz 2023-09-13T06:14:16.742 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54152.log 2023-09-13T06:14:16.743 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39471.log 2023-09-13T06:14:16.743 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45629.log.gz 2023-09-13T06:14:16.744 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54152.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42998.log 2023-09-13T06:14:16.745 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54152.log.gz 2023-09-13T06:14:16.746 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39471.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50328.log 2023-09-13T06:14:16.746 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39471.log.gz 2023-09-13T06:14:16.748 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51614.log 2023-09-13T06:14:16.748 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42998.log.gz 2023-09-13T06:14:16.749 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50328.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50328.log.gz 2023-09-13T06:14:16.749 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38608.log 2023-09-13T06:14:16.750 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55038.log 2023-09-13T06:14:16.751 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51614.log.gz 2023-09-13T06:14:16.751 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44041.log 2023-09-13T06:14:16.752 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38608.log.gz 2023-09-13T06:14:16.753 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.55038.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36914.log 2023-09-13T06:14:16.753 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55038.log.gz 2023-09-13T06:14:16.754 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42289.log 2023-09-13T06:14:16.755 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44041.log.gz 2023-09-13T06:14:16.756 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37407.log 2023-09-13T06:14:16.757 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36914.log.gz 2023-09-13T06:14:16.758 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34257.log 2023-09-13T06:14:16.758 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42289.log.gz 2023-09-13T06:14:16.759 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45576.log 2023-09-13T06:14:16.759 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37407.log.gz 2023-09-13T06:14:16.761 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36753.log 2023-09-13T06:14:16.761 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34257.log.gz 2023-09-13T06:14:16.761 INFO:teuthology.orchestra.run.smithi130.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-09-13T06:14:16.762 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39348.log 2023-09-13T06:14:16.762 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2023-09-13T06:14:16.763 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47720.log 2023-09-13T06:14:16.764 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36753.log: /var/log/ceph/ceph-client.admin.39348.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36753.log.gz 2023-09-13T06:14:16.764 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39348.log.gz 2023-09-13T06:14:16.765 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48876.log 2023-09-13T06:14:16.766 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53272.log 2023-09-13T06:14:16.766 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47720.log.gz 2023-09-13T06:14:16.767 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48876.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48876.log.gz 2023-09-13T06:14:16.767 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42822.log 2023-09-13T06:14:16.769 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37551.log 2023-09-13T06:14:16.769 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53272.log.gz 2023-09-13T06:14:16.769 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42822.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42822.log.gz 2023-09-13T06:14:16.771 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41922.log 2023-09-13T06:14:16.771 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46677.log 2023-09-13T06:14:16.771 INFO:teuthology.orchestra.run.smithi130.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37551.log.gz 2023-09-13T06:14:16.773 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.41922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41922.log.gz 2023-09-13T06:14:16.773 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46351.log 2023-09-13T06:14:16.773 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54492.log 2023-09-13T06:14:16.774 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46677.log.gz 2023-09-13T06:14:16.775 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46351.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46351.log.gz 2023-09-13T06:14:16.775 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36160.log 2023-09-13T06:14:16.776 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35952.log 2023-09-13T06:14:16.777 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54492.log.gz 2023-09-13T06:14:16.777 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36160.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36160.log.gz 2023-09-13T06:14:16.777 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35508.log 2023-09-13T06:14:16.779 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43350.log 2023-09-13T06:14:16.779 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35952.log.gz 2023-09-13T06:14:16.780 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35508.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35508.log.gz 2023-09-13T06:14:16.780 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51524.log 2023-09-13T06:14:16.781 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38241.log 2023-09-13T06:14:16.781 INFO:teuthology.orchestra.run.smithi130.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43350.log.gz 2023-09-13T06:14:16.782 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51524.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51524.log.gz 2023-09-13T06:14:16.783 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50278.log 2023-09-13T06:14:16.783 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46872.log 2023-09-13T06:14:16.783 INFO:teuthology.orchestra.run.smithi130.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38241.log.gz 2023-09-13T06:14:16.784 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50278.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50278.log.gz 2023-09-13T06:14:16.784 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38009.log 2023-09-13T06:14:16.786 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46872.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46872.log.gz 2023-09-13T06:14:16.786 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33422.log 2023-09-13T06:14:16.787 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38009.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38009.log.gz 2023-09-13T06:14:16.787 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46273.log 2023-09-13T06:14:16.788 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50845.log 2023-09-13T06:14:16.789 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46273.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.33422.log.gz 2023-09-13T06:14:16.789 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46273.log.gz 2023-09-13T06:14:16.790 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2023-09-13T06:14:16.791 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54958.log 2023-09-13T06:14:16.791 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50845.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50845.log.gz 2023-09-13T06:14:16.792 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44294.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2023-09-13T06:14:16.793 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53799.log 2023-09-13T06:14:16.793 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38900.log 2023-09-13T06:14:16.794 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54958.log.gz 2023-09-13T06:14:16.795 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53799.log: gzip -5 --verbose 89.3% -- -- replaced with /var/log/ceph/ceph-client.admin.53799.log.gz /var/log/ceph/ceph-client.admin.46961.log 2023-09-13T06:14:16.795 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:16.796 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43619.log 2023-09-13T06:14:16.797 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38900.log.gz 2023-09-13T06:14:16.797 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46961.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46961.log.gz 2023-09-13T06:14:16.798 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35874.log 2023-09-13T06:14:16.799 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40623.log 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43619.log.gz 2023-09-13T06:14:16.800 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:16.800 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35874.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35874.log.gz 2023-09-13T06:14:16.801 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43911.log 2023-09-13T06:14:16.801 INFO:teuthology.orchestra.run.smithi130.stderr:gzip/var/log/ceph/ceph-client.admin.40623.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45363.log 2023-09-13T06:14:16.802 INFO:teuthology.orchestra.run.smithi130.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40623.log.gz 2023-09-13T06:14:16.803 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43911.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43911.log.gz 2023-09-13T06:14:16.806 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34951.log 2023-09-13T06:14:16.807 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5/var/log/ceph/ceph-client.admin.45363.log: --verbose -- /var/log/ceph/ceph-client.admin.42681.log 2023-09-13T06:14:16.807 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45363.log.gz 2023-09-13T06:14:16.807 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34951.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34951.log.gz 2023-09-13T06:14:16.807 INFO:teuthology.orchestra.run.smithi130.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-09-13T06:14:16.807 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50923.log 2023-09-13T06:14:16.808 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38691.log 2023-09-13T06:14:16.808 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42681.log.gz 2023-09-13T06:14:16.809 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49256.log 2023-09-13T06:14:16.809 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50923.log.gz 2023-09-13T06:14:16.809 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38691.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38691.log.gz 2023-09-13T06:14:16.810 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34935.log 2023-09-13T06:14:16.811 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44585.log 2023-09-13T06:14:16.811 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49256.log.gz 2023-09-13T06:14:16.811 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34935.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34935.log.gz 2023-09-13T06:14:16.811 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48060.log 2023-09-13T06:14:16.812 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38582.log 2023-09-13T06:14:16.812 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44585.log.gz 2023-09-13T06:14:16.813 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48060.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48060.log.gz 2023-09-13T06:14:16.813 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34751.log 2023-09-13T06:14:16.815 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39380.log 2023-09-13T06:14:16.815 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38582.log.gz 2023-09-13T06:14:16.816 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34751.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34751.log.gz 2023-09-13T06:14:16.816 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48220.log 2023-09-13T06:14:16.817 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51798.log 2023-09-13T06:14:16.817 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39380.log.gz 2023-09-13T06:14:16.818 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48220.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48220.log.gz 2023-09-13T06:14:16.818 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40701.log 2023-09-13T06:14:16.819 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51798.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.51798.log.gz -5 2023-09-13T06:14:16.819 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39259.log 2023-09-13T06:14:16.820 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40701.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40701.log.gz 2023-09-13T06:14:16.820 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44809.log 2023-09-13T06:14:16.821 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40461.log 2023-09-13T06:14:16.822 INFO:teuthology.orchestra.run.smithi130.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39259.log.gz 2023-09-13T06:14:16.822 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44809.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44809.log.gz 2023-09-13T06:14:16.823 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45441.log 2023-09-13T06:14:16.823 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40461.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.40461.log.gz -- 2023-09-13T06:14:16.824 INFO:teuthology.orchestra.run.smithi130.stderr: /var/log/ceph/ceph-client.admin.42707.log 2023-09-13T06:14:16.824 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45441.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45441.log.gz 2023-09-13T06:14:16.825 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44615.log 2023-09-13T06:14:16.826 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.42707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34141.log 2023-09-13T06:14:16.826 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42707.log.gz 2023-09-13T06:14:16.826 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44615.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44615.log.gz 2023-09-13T06:14:16.827 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48086.log 2023-09-13T06:14:16.828 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34141.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.34141.log.gz 2023-09-13T06:14:16.829 INFO:teuthology.orchestra.run.smithi130.stderr: /var/log/ceph/ceph-client.admin.54257.log 2023-09-13T06:14:16.829 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48086.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48086.log.gz 2023-09-13T06:14:16.830 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45498.log 2023-09-13T06:14:16.830 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34363.log 2023-09-13T06:14:16.831 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54257.log.gz 2023-09-13T06:14:16.832 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45498.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45498.log.gz 2023-09-13T06:14:16.832 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43833.log 2023-09-13T06:14:16.833 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38287.log 2023-09-13T06:14:16.833 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34363.log.gz 2023-09-13T06:14:16.834 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.43833.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43833.log.gz 2023-09-13T06:14:16.834 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45960.log 2023-09-13T06:14:16.835 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.38287.log: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-09-13T06:14:16.835 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38287.log.gz 2023-09-13T06:14:16.836 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50793.log 2023-09-13T06:14:16.836 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54724.log 2023-09-13T06:14:16.837 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45960.log.gz 2023-09-13T06:14:16.837 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40962.log 2023-09-13T06:14:16.838 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50793.log.gz 2023-09-13T06:14:16.838 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54724.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54724.log.gz 2023-09-13T06:14:16.839 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34089.log 2023-09-13T06:14:16.840 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34169.log 2023-09-13T06:14:16.840 INFO:teuthology.orchestra.run.smithi130.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40962.log.gz 2023-09-13T06:14:16.841 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34089.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34089.log.gz 2023-09-13T06:14:16.841 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45733.log 2023-09-13T06:14:16.842 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.34169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35926.log 2023-09-13T06:14:16.842 INFO:teuthology.orchestra.run.smithi130.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34169.log.gz 2023-09-13T06:14:16.843 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45733.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45733.log.gz 2023-09-13T06:14:16.843 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40107.log 2023-09-13T06:14:16.844 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35300.log 2023-09-13T06:14:16.844 INFO:teuthology.orchestra.run.smithi130.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35926.log.gz 2023-09-13T06:14:16.845 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.40107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40107.log.gz 2023-09-13T06:14:16.846 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36646.log 2023-09-13T06:14:16.846 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35300.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.35300.log.gz 2023-09-13T06:14:16.847 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39004.log 2023-09-13T06:14:16.847 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36646.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36646.log.gz 2023-09-13T06:14:16.848 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44242.log 2023-09-13T06:14:16.849 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39004.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39004.log.gz 2023-09-13T06:14:16.849 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.44242.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44242.log.gz 2023-09-13T06:14:16.997 INFO:teuthology.orchestra.run.smithi130.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-09-13T06:14:17.160 INFO:teuthology.orchestra.run.smithi130.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-09-13T06:14:17.161 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-09-13T06:14:17.162 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m1.573s 2023-09-13T06:14:17.162 INFO:teuthology.orchestra.run.smithi130.stderr:user 0m6.269s 2023-09-13T06:14:17.162 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m2.020s 2023-09-13T06:14:17.163 INFO:tasks.ceph:Archiving logs... 2023-09-13T06:14:17.164 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784/remote/smithi130/log 2023-09-13T06:14:17.165 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-13T06:14:18.335 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784/remote/smithi164/log 2023-09-13T06:14:18.336 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-13T06:14:18.879 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-13T06:14:18.895 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-13T06:14:18.895 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-13T06:14:18.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-13T06:14:18.975 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-13T06:14:18.988 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-13T06:14:18.989 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T06:14:18.993 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T06:14:19.006 INFO:teuthology.orchestra.run.smithi130.stdout: remote refid st t when poll reach delay offset jitter 2023-09-13T06:14:19.006 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================== 2023-09-13T06:14:19.006 INFO:teuthology.orchestra.run.smithi130.stdout:*hv01.front.sepi 44.4.53.2 2 u 50 64 377 0.076 -2.977 0.864 2023-09-13T06:14:19.007 INFO:teuthology.orchestra.run.smithi130.stdout:+hv02.front.sepi 63.231.80.2 3 u 47 64 377 0.107 -2.547 1.547 2023-09-13T06:14:19.007 INFO:teuthology.orchestra.run.smithi130.stdout:+hv03.front.sepi 74.6.168.72 3 u 51 64 377 0.083 -4.078 0.859 2023-09-13T06:14:19.007 INFO:teuthology.orchestra.run.smithi130.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-09-13T06:14:19.010 INFO:teuthology.orchestra.run.smithi164.stdout: remote refid st t when poll reach delay offset jitter 2023-09-13T06:14:19.011 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================== 2023-09-13T06:14:19.011 INFO:teuthology.orchestra.run.smithi164.stdout:*hv01.front.sepi 44.4.53.2 2 u 50 64 377 0.090 -4.375 2.019 2023-09-13T06:14:19.011 INFO:teuthology.orchestra.run.smithi164.stdout:+hv02.front.sepi 63.231.80.2 3 u 44 64 377 0.102 -0.517 1.497 2023-09-13T06:14:19.012 INFO:teuthology.orchestra.run.smithi164.stdout:+hv03.front.sepi 74.6.168.72 3 u 49 64 377 0.082 -5.468 2.029 2023-09-13T06:14:19.012 INFO:teuthology.orchestra.run.smithi164.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-09-13T06:14:19.013 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-13T06:14:19.024 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-13T06:14:19.025 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-13T06:14:19.040 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-13T06:14:19.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-13T06:14:19.071 INFO:teuthology.task.internal:Duration was 1491.208371 seconds 2023-09-13T06:14:19.072 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-13T06:14:19.085 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-13T06:14:19.086 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-13T06:14:19.090 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-13T06:14:19.200 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-13T06:14:19.201 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2023-09-13T06:14:19.201 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-13T06:14:19.225 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2023-09-13T06:14:19.225 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-13T06:14:19.249 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-13T06:14:19.249 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-13T06:14:19.270 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-13T06:14:19.330 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-13T06:14:19.330 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-13T06:14:19.349 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-13T06:14:19.443 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-13T06:14:19.461 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-13T06:14:19.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-13T06:14:19.485 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-13T06:14:19.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-13T06:14:19.518 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-13T06:14:19.533 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-13T06:14:19.548 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2023-09-13T06:14:19.568 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2023-09-13T06:14:19.587 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-13T06:14:19.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:14:19.617 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-13T06:14:19.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T06:14:19.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-13T06:14:19.655 INFO:teuthology.task.internal:Transferring archived files... 2023-09-13T06:14:19.656 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784/remote/smithi130 2023-09-13T06:14:19.656 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-13T06:14:19.687 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784/remote/smithi164 2023-09-13T06:14:19.687 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-13T06:14:19.713 INFO:teuthology.task.internal:Removing archive directory... 2023-09-13T06:14:19.713 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-13T06:14:19.733 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-13T06:14:19.759 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-13T06:14:19.772 INFO:teuthology.task.internal:Not uploading archives. 2023-09-13T06:14:19.772 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-13T06:14:19.783 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-13T06:14:19.784 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-13T06:14:19.788 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-13T06:14:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: 655429 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 06:14 /home/ubuntu/cephtest 2023-09-13T06:14:19.815 INFO:teuthology.orchestra.run.smithi164.stdout: 655428 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 06:14 /home/ubuntu/cephtest 2023-09-13T06:14:19.817 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-13T06:14:19.829 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-13T06:14:19.854 INFO:teuthology.nuke:Checking targets against current locks 2023-09-13T06:14:19.883 DEBUG:teuthology.nuke:shortname: smithi130 2023-09-13T06:14:19.884 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T06:14:19.909 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 05:39:25.023643', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZER4UGcEI6enXkigtPnCyOc30c1H/DznkXXH94GzoJrvoorCMKfGD4t/n6rIIjYstXihfGkhcg9vMriF6gSHI='} 2023-09-13T06:14:19.914 DEBUG:teuthology.nuke:shortname: smithi164 2023-09-13T06:14:19.914 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T06:14:19.939 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 05:39:25.021696', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOc5UpwiSAB418Q3UlT4i6G9ympj9jDTnPR4Mhje6qobPby2tceV/zpsAslXnO78jcLKUx4CIQoWDUgluT+3/xg='} 2023-09-13T06:14:19.966 INFO:teuthology.orchestra.console.smithi130:Power off 2023-09-13T06:14:19.967 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T06:14:19.993 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2023-09-13T06:14:19.993 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T06:14:20.011 INFO:teuthology.orchestra.console.smithi164:Power off 2023-09-13T06:14:20.011 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T06:14:20.019 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-09-13T06:14:20.033 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-09-13T06:14:20.033 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T06:14:20.055 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-09-13T06:14:24.021 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T06:14:24.057 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T06:14:24.132 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-09-13T06:14:24.167 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-09-13T06:14:28.134 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T06:14:28.168 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T06:14:28.244 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2023-09-13T06:14:28.278 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-09-13T06:14:28.345 INFO:teuthology.orchestra.console.smithi130:Power off completed 2023-09-13T06:14:32.285 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T06:14:32.395 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-09-13T06:14:32.496 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-09-13T06:14:32.605 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c client.1-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1491.2083706855774 failure_reason: '"2023-09-13T06:01:12.114787+0000 osd.2 (osd.2) 3 : cluster [WRN] OSD bench result of 139869.973143 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.2. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2023-09-13T06:14:32.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T06:14:32.686 INFO:teuthology.run:FAIL